-- Logs begin at Sat 2022-09-10 10:55:37 UTC, end at Sat 2022-09-10 13:33:48 UTC. -- Sep 10 11:27:25.152361 n-d-856895-1 systemd[1]: Starting Devstack devstack@n-api.service... Sep 10 11:27:25.163905 n-d-856895-1 devstack@n-api.service[106473]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 10 11:27:25.165895 n-d-856895-1 devstack@n-api.service[106473]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 10 11:27:25 2022] *** Sep 10 11:27:25.165895 n-d-856895-1 devstack@n-api.service[106473]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 10 11:27:25.165895 n-d-856895-1 devstack@n-api.service[106473]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 10 11:27:25.165895 n-d-856895-1 devstack@n-api.service[106473]: nodename: n-d-856895-1 Sep 10 11:27:25.165895 n-d-856895-1 devstack@n-api.service[106473]: machine: x86_64 Sep 10 11:27:25.165895 n-d-856895-1 devstack@n-api.service[106473]: clock source: unix Sep 10 11:27:25.165895 n-d-856895-1 devstack@n-api.service[106473]: pcre jit disabled Sep 10 11:27:25.165895 n-d-856895-1 devstack@n-api.service[106473]: detected number of CPU cores: 4 Sep 10 11:27:25.165895 n-d-856895-1 devstack@n-api.service[106473]: current working directory: / Sep 10 11:27:25.165895 n-d-856895-1 devstack@n-api.service[106473]: detected binary path: /usr/bin/uwsgi-core Sep 10 11:27:25.166611 n-d-856895-1 devstack@n-api.service[106473]: your processes number limit is 47680 Sep 10 11:27:25.166611 n-d-856895-1 devstack@n-api.service[106473]: your memory page size is 4096 bytes Sep 10 11:27:25.166611 n-d-856895-1 devstack@n-api.service[106473]: detected max file descriptor number: 2048 Sep 10 11:27:25.166611 n-d-856895-1 devstack@n-api.service[106473]: lock engine: pthread robust mutexes Sep 10 11:27:25.166611 n-d-856895-1 devstack@n-api.service[106473]: thunder lock: enabled Sep 10 11:27:25.166611 n-d-856895-1 devstack@n-api.service[106473]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 10 11:27:25.166611 n-d-856895-1 devstack@n-api.service[106473]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 10 11:27:25.205556 n-d-856895-1 devstack@n-api.service[106473]: Python main interpreter initialized at 0x5652a1b789c0 Sep 10 11:27:25.205556 n-d-856895-1 devstack@n-api.service[106473]: python threads support enabled Sep 10 11:27:25.205556 n-d-856895-1 devstack@n-api.service[106473]: your server socket listen backlog is limited to 100 connections Sep 10 11:27:25.205556 n-d-856895-1 devstack@n-api.service[106473]: your mercy for graceful operations on workers is 90 seconds Sep 10 11:27:25.205875 n-d-856895-1 devstack@n-api.service[106473]: mapped 403077 bytes (393 KB) for 2 cores Sep 10 11:27:25.205956 n-d-856895-1 devstack@n-api.service[106473]: *** Operational MODE: preforking *** Sep 10 11:27:25.206211 n-d-856895-1 devstack@n-api.service[106473]: *** uWSGI is running in multiple interpreter mode *** Sep 10 11:27:25.206211 n-d-856895-1 devstack@n-api.service[106473]: spawned uWSGI master process (pid: 106473) Sep 10 11:27:25.206395 n-d-856895-1 systemd[1]: Started Devstack devstack@n-api.service. Sep 10 11:27:25.208210 n-d-856895-1 devstack@n-api.service[106473]: spawned uWSGI worker 1 (pid: 106474, cores: 1) Sep 10 11:27:25.208210 n-d-856895-1 devstack@n-api.service[106473]: spawned uWSGI worker 2 (pid: 106475, cores: 1) Sep 10 11:27:25.208210 n-d-856895-1 devstack@n-api.service[106473]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 10 11:27:25.868703 n-d-856895-1 devstack@n-api.service[106474]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 10 11:27:25.874848 n-d-856895-1 devstack@n-api.service[106475]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 10 11:27:26.956191 n-d-856895-1 devstack@n-api.service[106474]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 10 11:27:26.956191 n-d-856895-1 devstack@n-api.service[106474]: from cryptography.utils import int_from_bytes Sep 10 11:27:26.956824 n-d-856895-1 devstack@n-api.service[106474]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 10 11:27:26.956824 n-d-856895-1 devstack@n-api.service[106474]: from cryptography.utils import int_from_bytes Sep 10 11:27:26.960150 n-d-856895-1 devstack@n-api.service[106475]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 10 11:27:26.960150 n-d-856895-1 devstack@n-api.service[106475]: from cryptography.utils import int_from_bytes Sep 10 11:27:26.960602 n-d-856895-1 devstack@n-api.service[106475]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 10 11:27:26.960602 n-d-856895-1 devstack@n-api.service[106475]: from cryptography.utils import int_from_bytes Sep 10 11:27:29.466989 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 10 11:27:29.467582 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 10 11:27:29.467703 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 10 11:27:29.468060 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 10 11:27:29.468312 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 10 11:27:29.468693 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.469017 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.469333 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.469647 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.470045 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.470157 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 10 11:27:29.470574 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.470716 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 10 11:27:29.470810 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.470954 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 10 11:27:29.471053 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.471304 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.471396 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 10 11:27:29.471566 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.471661 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 10 11:27:29.471878 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.471975 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.472215 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-856895-1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.472302 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.472514 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.472617 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.472822 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.472994 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.473129 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.473217 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.473439 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.473532 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.473740 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.473827 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.474056 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.474152 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.474358 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.474445 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.474678 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.474844 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.474997 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.475313 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.475421 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-856895-1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.475620 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.475725 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.475926 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.476017 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.476255 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.476354 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.476564 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.476662 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.476870 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.476973 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.477182 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.477286 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.477485 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.477573 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.477797 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.477987 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.478101 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.478299 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.478475 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-856895-1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.478604 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.478784 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.478914 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.479092 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.479275 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.479424 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.479591 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.479828 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.479914 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.480136 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.480227 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.480454 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.480548 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.480757 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.480862 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.481071 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.481165 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.481373 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.481465 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-856895-1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.481696 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.481799 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.482009 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.482096 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.482331 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.482422 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.482633 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.482768 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.482936 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.483079 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.483263 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.483486 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.483582 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.483810 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.483895 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.484132 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.484232 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.484440 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.484524 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.484683 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.484774 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.484986 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.485078 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.485301 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.485392 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.486149 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.486304 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.486461 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.486615 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.486727 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.486818 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.486930 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.487102 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.487278 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.487449 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.487567 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.487755 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.487869 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.488061 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.488173 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.488311 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.488473 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.488619 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.488778 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.488931 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.489073 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.489243 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.489375 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.489563 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.489662 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.489814 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.489962 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.490053 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.490273 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.490359 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.490581 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.490676 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.490898 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.491008 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.491216 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.491304 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.491532 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.491616 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.491861 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.491959 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.492156 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.492240 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.492459 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.492599 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.492762 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.492857 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.493067 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.493153 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.493383 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.493466 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.493695 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.493787 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.494006 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.494133 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.494308 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.494404 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.494609 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.494695 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.494909 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.494993 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.495245 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.495334 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.495583 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.495678 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.495884 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.495969 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.496130 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.496278 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.496427 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.496588 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.496726 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.496906 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.497038 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.497227 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.497325 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.497534 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.497619 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.497841 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.497932 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.498147 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.498239 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.498465 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.498555 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.498764 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.498860 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.499066 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.499202 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.499346 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.499430 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.499649 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.499745 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.499956 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.500041 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.500251 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.500340 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.500552 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.500642 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.500851 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.500993 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.501193 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.501851 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.501998 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.502144 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.502291 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.502388 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.502588 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.502673 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.502887 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.502980 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.503208 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.503308 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.503519 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.503603 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.503825 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.503908 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.504126 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.504274 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.504426 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.504520 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.504728 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.504819 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.505028 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.505118 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.505328 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.505412 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.505641 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.505743 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.505942 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.506036 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.506245 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.506339 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.506547 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.506643 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.506843 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.506927 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.507144 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.507292 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.507472 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.507571 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.507777 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.507875 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.508078 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.508164 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.508376 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.508477 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.508675 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.508760 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.508972 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.509055 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.509272 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.509365 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.509568 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.509651 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.509868 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.509962 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.510163 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.510248 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.510466 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.510559 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.510777 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.510860 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.511079 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.511207 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.511404 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.511489 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.511703 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.511798 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.512004 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.512089 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.512310 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.512403 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.512615 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.512736 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.512919 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.513010 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.513222 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.513306 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.513523 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.513619 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.513838 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.513931 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.514157 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.514242 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.514466 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.514562 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.514774 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.514858 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.515079 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.515197 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.515413 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.515507 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:27:29.515722 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.515853 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.516029 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.516190 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.516346 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.516533 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.516660 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.516892 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.517202 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.517524 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.517755 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.518014 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.518149 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.518313 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.518607 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.518702 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.518929 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.519026 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.519279 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.519369 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.519603 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.519700 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.519914 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.520008 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.520230 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.520321 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.520549 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.520635 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.520872 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.520960 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.521192 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.521276 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.521505 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.521589 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.521817 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.521903 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.522126 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.522225 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.522432 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.522519 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.522743 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.522883 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.523065 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.523150 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.523404 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.523499 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.523720 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.523814 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.524031 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.524122 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.524347 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.524441 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.524657 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.524743 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.524966 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.525062 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.525275 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.525373 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.525585 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.525672 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.525890 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.525975 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.526221 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.526315 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.526530 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.526614 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.526846 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.526930 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.527169 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.527257 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.527492 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.527589 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.527807 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.527892 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.528116 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.528203 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.528424 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.528510 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.528732 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.528825 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.529034 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.529120 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.529336 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.529428 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.529637 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.529723 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.529942 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.530028 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.530242 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.530328 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.530556 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.530657 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.530881 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.530965 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.531198 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.531334 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.531524 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.531618 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.531826 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.531917 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.532135 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.532296 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.532988 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.533150 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.533300 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.533494 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.533662 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.533787 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.533886 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.534101 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.534188 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.534410 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.534496 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.534714 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.534807 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.535035 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.535134 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.535377 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.535462 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.535682 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.535779 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.536000 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.536094 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.536305 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.536390 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.536609 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.536721 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.536920 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.537012 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.537225 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.537311 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.537530 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.537626 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.537836 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.537919 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.538143 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.538241 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.538447 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.538548 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.538759 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.538852 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.539066 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.539152 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.539401 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.539486 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.539726 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.539811 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.540025 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.540110 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.540331 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.540416 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.540646 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.540732 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.540957 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.541053 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.541259 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.541345 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.541566 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.541666 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.541867 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.541960 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.542167 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.542252 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.542468 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.542562 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.542772 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.542907 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.543071 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.543182 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.543398 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.543484 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.543701 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.543796 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.544006 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.544098 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.544306 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.544392 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.544622 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.544716 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.544929 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.545014 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.545229 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.545321 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.545529 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.545622 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.545828 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.545912 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.546141 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.546223 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.546449 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.546536 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.546753 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.546837 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.547059 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.547143 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.547395 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.547482 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.547707 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.547828 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.548041 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.548139 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.548926 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.549083 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.549240 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.549363 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.549532 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.549685 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.549839 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.550001 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.550149 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.550312 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.550495 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.550652 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.550804 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.550928 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.551148 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.551257 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.551510 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.551608 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.551835 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.551929 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.552161 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.552245 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.552475 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.552567 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.552778 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.552863 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.553089 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.553174 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.553402 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.553494 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.553717 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.553801 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.554031 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.554123 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.554352 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.554436 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.554660 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.554744 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.554972 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.555056 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.555307 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.555409 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.555615 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.555701 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.555922 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.556016 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.556226 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.556311 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.556539 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.556622 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.556842 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.556933 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.557156 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.557242 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.557460 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.557551 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.557776 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.557861 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.558085 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.558180 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.558398 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.558491 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.558699 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.558793 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.559010 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.559103 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.559357 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.559444 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.559673 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.559767 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.559975 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.560059 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.560283 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.560368 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.560593 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.560686 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.560897 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.560981 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.561202 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.561295 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.561508 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.561641 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.561809 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.561893 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.562108 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.562207 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.562415 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.562501 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.562728 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.562829 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.563032 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.563117 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.563363 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.563451 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.563703 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.563842 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.564045 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.564190 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.564358 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.564612 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.564709 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.564935 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.565020 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.565240 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.565341 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.565551 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.565637 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.565862 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.565945 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.566169 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.566254 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.566488 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.566607 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.566791 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.566878 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.567093 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.567198 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.567422 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.567535 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.567738 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.567831 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.568043 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.568190 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.568345 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.568436 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.568645 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.568730 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.568951 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.569037 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.569270 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.569353 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.569584 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.569683 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.569884 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.570012 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.570199 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.570283 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.570508 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.570600 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.570813 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.570898 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.571122 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.571256 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.571454 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.571557 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.571758 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.571848 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.572067 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.572157 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.572627 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.572727 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.572931 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.573041 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.573236 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.573348 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.573544 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.573631 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.573849 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.573942 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.574161 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.574254 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.574480 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.574603 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.574786 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.574938 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.575093 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.575284 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.575425 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.575600 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.575727 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.575930 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.576035 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.576248 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.576346 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.576562 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.576877 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.576968 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.577192 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.577286 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.577504 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.577589 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.577818 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.577902 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.578143 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.578236 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.578454 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.578619 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.578769 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.578855 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.579084 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.579195 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.579454 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.579598 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.579783 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.579935 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.580102 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.580189 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.580404 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.580667 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.580760 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.581005 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.581089 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.581309 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.581403 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.581611 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.581697 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.581916 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.582011 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.582224 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.582318 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.582526 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.582612 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.582827 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.582921 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.583127 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.583255 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.583453 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.583540 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.583766 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.583852 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.584072 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.584158 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.584384 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.584471 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.584687 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.584779 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.585005 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.585099 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.585311 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.585403 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.585610 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.585695 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.585910 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.586004 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.586209 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.586295 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.586511 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.586595 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.586817 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.586910 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.587125 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.587230 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.587475 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.587571 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.587786 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.587879 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.588104 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.588189 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.588403 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.588495 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.588725 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.588852 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.589028 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.589124 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.589331 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.589428 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.589632 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.589719 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.589935 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.590019 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.590237 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.590322 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.590537 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.590624 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.590846 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.590940 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.591155 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.591287 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.591487 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.591580 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.591792 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.591878 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.592095 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.592202 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.592399 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.592493 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.592700 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.592785 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.593012 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.593118 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.593319 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.593405 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.593621 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.593706 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.593921 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.594019 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.594224 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.594320 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.594526 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.594618 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.594826 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.595431 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.595701 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.595855 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.596001 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.596148 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.596305 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.596460 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.596598 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.596736 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.596893 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.597044 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.597257 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.597357 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.597569 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.597653 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.597876 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.597962 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.598179 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.598272 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.598495 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.598588 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.598799 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.598896 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.599101 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.599209 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.599431 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.599520 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.599736 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.599833 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.600036 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.600129 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.600336 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.600421 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.600639 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.600731 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.600947 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.601032 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.601256 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.601341 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.601557 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.601655 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.601860 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.601943 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.602161 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.602262 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.602462 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.602548 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.602762 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.602856 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.603068 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.603240 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.603393 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.603480 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.603693 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.603779 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.603992 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.604077 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.604293 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.604380 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.604598 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.604683 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.604916 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.605046 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.605220 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.605304 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.605518 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.605602 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.605819 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.605912 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.606119 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.606204 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.606424 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.606507 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.606735 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.606828 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.607041 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.607126 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.607374 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.607464 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.607681 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.607779 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.607987 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.608073 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.608295 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.608386 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.608600 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.608701 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.608910 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.608995 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.609211 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.609295 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.609517 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.609611 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.609820 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.609913 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.610128 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.610220 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.610427 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.610564 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.611376 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.611498 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.611671 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.611767 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.611983 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.612070 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.612297 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.612398 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.612610 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.612702 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.612926 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.613012 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.613246 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.613338 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.613547 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.613631 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.613855 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.613941 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.614165 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.614249 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.614475 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.614568 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.614778 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.614861 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.615083 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.615211 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.615423 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.615521 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.615737 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.615823 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.616048 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.616132 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.616357 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.616451 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.616666 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.616758 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.616970 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.617092 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.617279 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.617407 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.617588 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.617724 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.617892 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.618040 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.618214 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.618355 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.618523 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.618671 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.618827 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.618987 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.619133 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.619329 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.619457 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.619648 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.619774 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.619965 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.620069 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.620282 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.620464 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.620597 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.620773 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.620909 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.621081 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.621223 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.621383 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.621536 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.621691 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.621844 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.622000 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.622172 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.622300 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.622485 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.622610 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.622791 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.622912 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.623105 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.623348 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.623448 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.623657 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.623755 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.623964 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.624049 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.624271 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.624452 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.624578 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.624769 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.624879 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.625083 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.625211 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.625393 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.625486 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.625708 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.625793 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.626022 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.626106 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.626377 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.626543 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.626691 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.626841 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.626978 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.627065 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.627331 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.627441 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.627722 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.627807 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.628039 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.628163 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.628342 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.628440 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.628649 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.628733 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.628956 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.629041 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.629269 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.629388 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.629595 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.629680 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.629902 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.630028 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.630209 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.630302 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.630516 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.630603 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.630838 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.630921 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.631140 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.631274 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.631484 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.631584 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.631805 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.631890 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.632112 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.632204 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.632423 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.632512 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.632726 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.632905 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.633044 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.633221 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.633362 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.633537 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.633659 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.633861 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.633976 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.634189 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.634389 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.634519 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.634708 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.634832 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.635015 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.635152 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.635354 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.635489 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.635674 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.635815 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.635975 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.636147 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.636275 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.636464 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.636581 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.636786 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.636871 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.637094 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.637181 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.637420 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.637507 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.637747 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.637844 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.638058 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.638142 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.638364 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.638448 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.638667 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.638796 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.638968 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.639097 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.639289 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.639442 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.639609 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.639773 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.639908 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.640102 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.640195 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.640411 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.640501 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.640723 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.640812 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.641039 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.641138 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.641350 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.641448 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.641661 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.641750 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.642012 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.642109 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.642323 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.642436 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.642638 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.642734 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.642983 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.643077 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.643340 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.643500 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.643648 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.643736 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.643953 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.644038 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.644280 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.644411 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.644589 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.644676 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.644902 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.644987 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.645220 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.645305 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.645545 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.645629 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.645864 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.645950 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.646177 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.646270 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.646491 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.646577 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.646801 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.646884 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.647101 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.647201 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.647436 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.647519 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.647744 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.647828 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.648050 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.648144 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.648355 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.648448 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.648658 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.648757 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.648967 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.649055 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.649270 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.649365 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.649570 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.649665 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.649873 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.649957 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.650192 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.650277 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.650494 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.650589 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.650814 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.650900 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.651122 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.651241 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.651448 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.651614 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.651752 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.651838 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.652053 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.652139 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.652387 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.652473 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.652687 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.652773 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.652992 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.653076 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.653300 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.653386 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.653613 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.653707 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.653918 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.654003 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.654226 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.654312 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.654533 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.654620 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.654847 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.654935 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.655151 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.655272 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.655496 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.655582 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.655807 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.655900 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.656111 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.656196 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.656418 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.656503 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.656727 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.656823 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.657037 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.657122 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.657872 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.658177 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.658345 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.658510 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.658653 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.658808 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.659018 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.659145 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.659372 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.659543 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.659697 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.659787 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.660024 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.660128 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.660332 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.660423 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.660640 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.660729 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.660950 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.661038 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.661258 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.661348 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.661569 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.661655 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.661885 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.661973 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.662203 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.662290 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.662523 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.662634 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.662836 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.663050 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.663141 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.663417 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.663514 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.663740 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.663837 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.664059 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.664149 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.664379 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.664468 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.664689 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.664791 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.665004 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.665092 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.665313 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.665401 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.665625 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.665738 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.665935 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.666023 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.666242 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.666330 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.666565 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.666681 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.666861 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.666954 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.667198 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.667292 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.667496 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.667587 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.667807 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.667895 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.668118 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.668215 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.668437 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.668535 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.668764 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.668851 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.669078 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.669186 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.669387 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.669477 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.669697 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.669786 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.670075 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.670184 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.670325 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.670520 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.670641 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.670830 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.670956 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.671174 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.671305 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.671498 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.671625 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.671818 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.671942 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.672129 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.672258 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.672441 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.672570 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.672764 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.672875 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.673671 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.673795 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.673971 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.674228 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.674318 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.674572 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.674664 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.674875 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.674975 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.675212 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.675305 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.675525 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.675615 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.677717 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.677789 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.677872 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.677943 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.678018 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.678087 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.678153 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.678219 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.678285 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.678359 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.678434 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.678509 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.678577 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.678643 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.678708 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.678782 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.678857 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.678932 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.679007 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.679074 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.679184 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.679274 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.679380 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.679618 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.679736 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.679824 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.679984 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.680200 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.680307 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.680454 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.680579 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.680769 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.680874 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.681079 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.681174 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.681403 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.681498 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.681715 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.681813 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.682041 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.682249 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.682346 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.682598 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.682686 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.682921 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.683010 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.683248 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.683354 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.683554 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.683652 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.683864 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.683955 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.684166 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.684255 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.684469 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.684566 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.684780 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.684868 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.685083 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.685171 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.685391 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.685489 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.685692 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.685790 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.686000 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.686087 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.686298 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.686399 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.686606 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.686695 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.686920 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.687007 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.687257 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.687359 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.687560 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.687655 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.687868 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.687955 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.688171 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.688260 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.688473 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.688570 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.688832 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.688932 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.689145 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.689237 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.689467 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.689565 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.689775 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.689863 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.690084 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.690175 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.690395 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.690496 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.690699 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.690789 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.691014 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.691264 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.691360 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.691609 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.691699 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.691932 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.692023 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.692243 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.692331 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.692578 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.692666 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.692884 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.692975 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.693186 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.693275 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.693489 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.693578 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.693802 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.693890 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.694108 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.694199 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.694418 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.694517 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.694728 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.694815 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.695034 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.695121 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.695365 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.695464 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.695673 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.695762 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.695979 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.696067 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.696284 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.696381 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.696589 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.696857 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.696946 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.697186 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.697525 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.697744 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.697834 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.698051 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.698141 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.698354 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.698452 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.698665 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.698755 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.698991 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.699078 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.699324 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.699464 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.699640 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.699728 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.699953 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.700041 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.700266 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.700362 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.700570 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.700660 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.700875 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.700964 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.701181 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.701270 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.701487 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.701576 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.701798 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.701885 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.702113 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.702202 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.702421 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.702510 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.702724 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.702813 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.703036 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.703376 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.703468 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.703692 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.703789 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.704005 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.704140 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.704364 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.704465 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.704712 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.704850 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.705036 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.705283 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.705372 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.705612 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.705701 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.705929 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.706037 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.706250 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.706346 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.706561 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.706650 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.706877 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.706964 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.707206 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.707297 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.707535 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.707627 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.707855 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.707945 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.708160 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.708250 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.708463 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.708551 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.708766 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.709073 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.709161 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.709419 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.709622 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.709713 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.709882 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.709966 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.710055 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.710269 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.710366 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.710575 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.710672 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.710875 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.710964 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.711207 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.711302 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.711503 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.711619 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.711802 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.711938 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.712107 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.712274 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.712406 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.712616 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.712712 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.712952 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.713040 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.713276 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.713365 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.713576 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.713672 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.713878 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.713973 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.714183 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.714271 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.714483 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.714569 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.714788 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.714876 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.715089 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.715200 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.715426 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.715523 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.715728 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.715816 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.716037 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.716132 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.716347 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.716436 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.716655 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.716752 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.716968 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.717098 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.717273 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.717360 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.717587 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.717687 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.717894 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.717982 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.718212 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.718300 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.718530 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.718846 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.719119 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.719255 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.719485 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.719791 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.720699 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.720856 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.721097 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.721254 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.721408 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.721498 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.721715 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.721804 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.722028 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.722348 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.722441 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.722661 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.722758 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.722974 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.723060 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.723317 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.723438 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.723656 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.723768 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.723971 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.724060 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.724292 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.724381 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.724609 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.724699 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.724922 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.725020 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.725246 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.725334 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.725554 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.725657 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.725865 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.725952 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.726173 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.726261 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.726481 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.726571 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.726788 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.726884 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.727102 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.727231 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.727473 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.727775 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.728092 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.728408 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.728730 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.729049 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.729184 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.729520 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.729854 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.730180 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.730532 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.730748 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.730870 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.730978 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.731190 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.731309 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.731531 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.731664 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.731867 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.731990 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.732989 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.733124 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.733249 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.733549 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.733645 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.733728 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.733809 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.733877 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.733967 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.734049 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.734138 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.734219 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.734298 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.734420 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.734519 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 10 11:27:29.734603 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.734733 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.735054 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.735408 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.736293 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.736619 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.737056 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.737406 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.737744 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.738065 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.738442 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.738732 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.739088 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.739442 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.739798 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.740134 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.740457 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.740778 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.741090 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:27:29.741382 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 10 11:27:29.888290 n-d-856895-1 devstack@n-api.service[106474]: INFO dbcounter [None req-89624729-c61d-4a34-a8b7-ad0b3ef39c13 None None] Registered counter for database nova_api Sep 10 11:27:29.894506 n-d-856895-1 devstack@n-api.service[106475]: INFO dbcounter [None req-181ecda6-47e0-4ec6-9467-670d1a71cdc6 None None] Registered counter for database nova_api Sep 10 11:27:29.911507 n-d-856895-1 devstack@n-api.service[106474]: DEBUG oslo_db.sqlalchemy.engines [None req-89624729-c61d-4a34-a8b7-ad0b3ef39c13 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 11:27:29.915388 n-d-856895-1 devstack@n-api.service[106475]: DEBUG oslo_db.sqlalchemy.engines [None req-181ecda6-47e0-4ec6-9467-670d1a71cdc6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 11:27:29.918218 n-d-856895-1 devstack@n-api.service[106474]: DEBUG dbcounter [-] [106474] Writer thread running {{(pid=106474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 11:27:29.922428 n-d-856895-1 devstack@n-api.service[106475]: DEBUG dbcounter [-] [106475] Writer thread running {{(pid=106475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 11:27:29.978090 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.context [None req-89624729-c61d-4a34-a8b7-ad0b3ef39c13 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d31511aa-3734-4d55-9c57-4a88c62d4dfd(cell1) {{(pid=106474) load_cells /opt/stack/nova/nova/context.py:464}} Sep 10 11:27:29.981490 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.context [None req-181ecda6-47e0-4ec6-9467-670d1a71cdc6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d31511aa-3734-4d55-9c57-4a88c62d4dfd(cell1) {{(pid=106475) load_cells /opt/stack/nova/nova/context.py:464}} Sep 10 11:27:29.982574 n-d-856895-1 devstack@n-api.service[106474]: DEBUG oslo_concurrency.lockutils [None req-89624729-c61d-4a34-a8b7-ad0b3ef39c13 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:29.983049 n-d-856895-1 devstack@n-api.service[106474]: DEBUG oslo_concurrency.lockutils [None req-89624729-c61d-4a34-a8b7-ad0b3ef39c13 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:29.984655 n-d-856895-1 devstack@n-api.service[106474]: DEBUG oslo_concurrency.lockutils [None req-89624729-c61d-4a34-a8b7-ad0b3ef39c13 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:29.985373 n-d-856895-1 devstack@n-api.service[106474]: DEBUG oslo_concurrency.lockutils [None req-89624729-c61d-4a34-a8b7-ad0b3ef39c13 None None] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:29.985754 n-d-856895-1 devstack@n-api.service[106475]: DEBUG oslo_concurrency.lockutils [None req-181ecda6-47e0-4ec6-9467-670d1a71cdc6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:29.985861 n-d-856895-1 devstack@n-api.service[106474]: DEBUG oslo_concurrency.lockutils [None req-89624729-c61d-4a34-a8b7-ad0b3ef39c13 None None] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:29.986482 n-d-856895-1 devstack@n-api.service[106475]: DEBUG oslo_concurrency.lockutils [None req-181ecda6-47e0-4ec6-9467-670d1a71cdc6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:29.987861 n-d-856895-1 devstack@n-api.service[106474]: DEBUG oslo_concurrency.lockutils [None req-89624729-c61d-4a34-a8b7-ad0b3ef39c13 None None] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:29.988090 n-d-856895-1 devstack@n-api.service[106475]: DEBUG oslo_concurrency.lockutils [None req-181ecda6-47e0-4ec6-9467-670d1a71cdc6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:29.988831 n-d-856895-1 devstack@n-api.service[106475]: DEBUG oslo_concurrency.lockutils [None req-181ecda6-47e0-4ec6-9467-670d1a71cdc6 None None] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:27:29.989279 n-d-856895-1 devstack@n-api.service[106475]: DEBUG oslo_concurrency.lockutils [None req-181ecda6-47e0-4ec6-9467-670d1a71cdc6 None None] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:27:29.989860 n-d-856895-1 devstack@n-api.service[106474]: INFO dbcounter [None req-89624729-c61d-4a34-a8b7-ad0b3ef39c13 None None] Registered counter for database nova_cell0 Sep 10 11:27:29.991299 n-d-856895-1 devstack@n-api.service[106475]: DEBUG oslo_concurrency.lockutils [None req-181ecda6-47e0-4ec6-9467-670d1a71cdc6 None None] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:27:29.993300 n-d-856895-1 devstack@n-api.service[106475]: INFO dbcounter [None req-181ecda6-47e0-4ec6-9467-670d1a71cdc6 None None] Registered counter for database nova_cell0 Sep 10 11:27:29.993887 n-d-856895-1 devstack@n-api.service[106474]: INFO dbcounter [None req-89624729-c61d-4a34-a8b7-ad0b3ef39c13 None None] Registered counter for database nova_cell1 Sep 10 11:27:29.997297 n-d-856895-1 devstack@n-api.service[106475]: INFO dbcounter [None req-181ecda6-47e0-4ec6-9467-670d1a71cdc6 None None] Registered counter for database nova_cell1 Sep 10 11:27:30.001292 n-d-856895-1 devstack@n-api.service[106474]: DEBUG oslo_db.sqlalchemy.engines [None req-89624729-c61d-4a34-a8b7-ad0b3ef39c13 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 11:27:30.003839 n-d-856895-1 devstack@n-api.service[106474]: DEBUG oslo_db.sqlalchemy.engines [None req-89624729-c61d-4a34-a8b7-ad0b3ef39c13 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 11:27:30.004765 n-d-856895-1 devstack@n-api.service[106475]: DEBUG oslo_db.sqlalchemy.engines [None req-181ecda6-47e0-4ec6-9467-670d1a71cdc6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 11:27:30.009065 n-d-856895-1 devstack@n-api.service[106474]: DEBUG dbcounter [-] [106474] Writer thread running {{(pid=106474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 11:27:30.009549 n-d-856895-1 devstack@n-api.service[106475]: DEBUG dbcounter [-] [106475] Writer thread running {{(pid=106475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 11:27:30.010419 n-d-856895-1 devstack@n-api.service[106475]: DEBUG oslo_db.sqlalchemy.engines [None req-181ecda6-47e0-4ec6-9467-670d1a71cdc6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 11:27:30.147885 n-d-856895-1 devstack@n-api.service[106474]: DEBUG dbcounter [-] [106474] Writer thread running {{(pid=106474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 11:27:30.154868 n-d-856895-1 devstack@n-api.service[106475]: DEBUG dbcounter [-] [106475] Writer thread running {{(pid=106475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 11:27:30.158498 n-d-856895-1 devstack@n-api.service[106474]: INFO dbcounter [None req-89624729-c61d-4a34-a8b7-ad0b3ef39c13 None None] Registered counter for database nova_cell0 Sep 10 11:27:30.164180 n-d-856895-1 devstack@n-api.service[106475]: INFO dbcounter [None req-181ecda6-47e0-4ec6-9467-670d1a71cdc6 None None] Registered counter for database nova_cell0 Sep 10 11:27:30.167218 n-d-856895-1 devstack@n-api.service[106474]: DEBUG oslo_db.sqlalchemy.engines [None req-89624729-c61d-4a34-a8b7-ad0b3ef39c13 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 11:27:30.170762 n-d-856895-1 devstack@n-api.service[106475]: DEBUG oslo_db.sqlalchemy.engines [None req-181ecda6-47e0-4ec6-9467-670d1a71cdc6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 11:27:30.171967 n-d-856895-1 devstack@n-api.service[106474]: DEBUG dbcounter [-] [106474] Writer thread running {{(pid=106474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 11:27:30.175611 n-d-856895-1 devstack@n-api.service[106475]: DEBUG dbcounter [-] [106475] Writer thread running {{(pid=106475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 11:27:30.510477 n-d-856895-1 devstack@n-api.service[106475]: WARNING keystonemiddleware.auth_token [None req-181ecda6-47e0-4ec6-9467-670d1a71cdc6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 10 11:27:30.516309 n-d-856895-1 devstack@n-api.service[106474]: WARNING keystonemiddleware.auth_token [None req-89624729-c61d-4a34-a8b7-ad0b3ef39c13 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 10 11:27:30.518342 n-d-856895-1 devstack@n-api.service[106475]: WARNING keystonemiddleware.auth_token [None req-181ecda6-47e0-4ec6-9467-670d1a71cdc6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 10 11:27:30.524217 n-d-856895-1 devstack@n-api.service[106474]: WARNING keystonemiddleware.auth_token [None req-89624729-c61d-4a34-a8b7-ad0b3ef39c13 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 10 11:27:30.863343 n-d-856895-1 devstack@n-api.service[106475]: WARNING keystonemiddleware.auth_token [None req-181ecda6-47e0-4ec6-9467-670d1a71cdc6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 10 11:27:30.869222 n-d-856895-1 devstack@n-api.service[106475]: WARNING keystonemiddleware.auth_token [None req-181ecda6-47e0-4ec6-9467-670d1a71cdc6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 10 11:27:30.871348 n-d-856895-1 devstack@n-api.service[106474]: WARNING keystonemiddleware.auth_token [None req-89624729-c61d-4a34-a8b7-ad0b3ef39c13 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 10 11:27:30.874482 n-d-856895-1 devstack@n-api.service[106475]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5652a1b789c0 pid: 106475 (default app) Sep 10 11:27:30.877494 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-181ecda6-47e0-4ec6-9467-670d1a71cdc6 None None] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:27:30.877814 n-d-856895-1 devstack@n-api.service[106474]: WARNING keystonemiddleware.auth_token [None req-89624729-c61d-4a34-a8b7-ad0b3ef39c13 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 10 11:27:30.878668 n-d-856895-1 devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-181ecda6-47e0-4ec6-9467-670d1a71cdc6 None None] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002632 Sep 10 11:27:30.879074 n-d-856895-1 devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 788 bytes} [Sat Sep 10 11:27:30 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:27:30.883323 n-d-856895-1 devstack@n-api.service[106474]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5652a1b789c0 pid: 106474 (default app) Sep 10 11:28:52.673501 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-181ecda6-47e0-4ec6-9467-670d1a71cdc6 None None] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:52.674422 n-d-856895-1 devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-181ecda6-47e0-4ec6-9467-670d1a71cdc6 None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Sep 10 11:28:52.674808 n-d-856895-1 devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 2/2] 10.222.0.23 () {54 vars in 931 bytes} [Sat Sep 10 11:28:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:28:52.687478 n-d-856895-1 devstack@n-api.service[106474]: DEBUG dbcounter [-] [106474] Writing DB stats nova_api:SELECT=3 {{(pid=106474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:28:52.688643 n-d-856895-1 devstack@n-api.service[106474]: DEBUG dbcounter [-] [106474] Writing DB stats nova_cell1:SELECT=3 {{(pid=106474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:28:52.689694 n-d-856895-1 devstack@n-api.service[106474]: DEBUG dbcounter [-] [106474] Writing DB stats nova_cell0:SELECT=3 {{(pid=106474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:28:52.690488 n-d-856895-1 devstack@n-api.service[106474]: DEBUG dbcounter [-] [106474] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:28:53.584608 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-2571b84c-f974-4829-b46e-58cda55a0321 admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:53.617684 n-d-856895-1 devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-2571b84c-f974-4829-b46e-58cda55a0321 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.935941 Sep 10 11:28:53.618679 n-d-856895-1 devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 1/3] 10.222.0.23 () {60 vars in 1292 bytes} [Sat Sep 10 11:28:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:28:56.236963 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-181ecda6-47e0-4ec6-9467-670d1a71cdc6 None None] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:56.237948 n-d-856895-1 devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-181ecda6-47e0-4ec6-9467-670d1a71cdc6 None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001390 Sep 10 11:28:56.238519 n-d-856895-1 devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 3/4] 10.222.0.23 () {54 vars in 931 bytes} [Sat Sep 10 11:28:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:28:56.687270 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-26cf1bb9-0c51-4262-8ee9-71366dd9927c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "c1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "ram": 256}} {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:28:56.734403 n-d-856895-1 devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-26cf1bb9-0c51-4262-8ee9-71366dd9927c admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.489754 Sep 10 11:28:56.735209 n-d-856895-1 devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 2/5] 10.222.0.23 () {64 vars in 1283 bytes} [Sat Sep 10 11:28:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 10 11:28:56.749408 n-d-856895-1 devstack@n-api.service[106475]: DEBUG dbcounter [-] [106475] Writing DB stats nova_api:SELECT=3 {{(pid=106475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:28:56.751427 n-d-856895-1 devstack@n-api.service[106475]: DEBUG dbcounter [-] [106475] Writing DB stats nova_cell0:SELECT=3 {{(pid=106475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:28:56.752155 n-d-856895-1 devstack@n-api.service[106475]: DEBUG dbcounter [-] [106475] Writing DB stats nova_cell1:SELECT=3 {{(pid=106475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:28:56.752874 n-d-856895-1 devstack@n-api.service[106475]: DEBUG dbcounter [-] [106475] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:28:56.961608 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-fa813881-32dc-4053-931b-d65e229ed5d2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:28:57.031028 n-d-856895-1 devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-fa813881-32dc-4053-931b-d65e229ed5d2 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.287247 Sep 10 11:28:57.031648 n-d-856895-1 devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 4/6] 10.222.0.23 () {64 vars in 1336 bytes} [Sat Sep 10 11:28:56 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:28:59.789769 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-26cf1bb9-0c51-4262-8ee9-71366dd9927c admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:28:59.790711 n-d-856895-1 devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-26cf1bb9-0c51-4262-8ee9-71366dd9927c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Sep 10 11:28:59.791341 n-d-856895-1 devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 3/7] 10.222.0.23 () {54 vars in 931 bytes} [Sat Sep 10 11:28:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:29:00.607412 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-f172374e-cd87-4be4-9c7b-d9d458345c47 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "disk": 5, "id": "d1", "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M"}} {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:29:00.670422 n-d-856895-1 devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-f172374e-cd87-4be4-9c7b-d9d458345c47 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.871774 Sep 10 11:29:00.674098 n-d-856895-1 devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 5/8] 10.222.0.23 () {64 vars in 1283 bytes} [Sat Sep 10 11:28:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:29:00.691815 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-d9f1ff33-4563-4a2d-9743-cbc8bddf0e2b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:29:00.749724 n-d-856895-1 devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-d9f1ff33-4563-4a2d-9743-cbc8bddf0e2b admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.067388 Sep 10 11:29:00.750326 n-d-856895-1 devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 4/9] 10.222.0.23 () {64 vars in 1336 bytes} [Sat Sep 10 11:29:00 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:29:03.625435 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-f172374e-cd87-4be4-9c7b-d9d458345c47 admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:03.629270 n-d-856895-1 devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-f172374e-cd87-4be4-9c7b-d9d458345c47 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003628 Sep 10 11:29:03.631059 n-d-856895-1 devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 6/10] 10.222.0.23 () {54 vars in 931 bytes} [Sat Sep 10 11:29:03 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:29:04.268927 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-9291f75c-3dde-4966-949e-84ce69ddc396 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "disk": 10, "id": "d2", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "ram": 1024}} {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:29:04.294954 n-d-856895-1 devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-9291f75c-3dde-4966-949e-84ce69ddc396 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.653654 Sep 10 11:29:04.295955 n-d-856895-1 devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 5/11] 10.222.0.23 () {64 vars in 1283 bytes} [Sat Sep 10 11:29:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:29:04.309098 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-0aa0c4c8-9ec2-4acd-b644-13bda82844ed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:29:04.338142 n-d-856895-1 devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-0aa0c4c8-9ec2-4acd-b644-13bda82844ed admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032702 Sep 10 11:29:04.338811 n-d-856895-1 devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 7/12] 10.222.0.23 () {64 vars in 1336 bytes} [Sat Sep 10 11:29:04 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:29:06.973667 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-9291f75c-3dde-4966-949e-84ce69ddc396 admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:06.975435 n-d-856895-1 devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-9291f75c-3dde-4966-949e-84ce69ddc396 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002089 Sep 10 11:29:06.976018 n-d-856895-1 devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 6/13] 10.222.0.23 () {54 vars in 931 bytes} [Sat Sep 10 11:29:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:29:07.443443 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-f026e5b7-2a23-45fd-879a-1401cfa74216 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds2G", "vcpus": 2, "ram": 2048, "swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:29:07.467679 n-d-856895-1 devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-f026e5b7-2a23-45fd-879a-1401cfa74216 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.484134 Sep 10 11:29:07.469016 n-d-856895-1 devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 8/14] 10.222.0.23 () {64 vars in 1283 bytes} [Sat Sep 10 11:29:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 10 11:29:07.482555 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-5836b41e-7a96-4609-8909-9acfea626716 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:29:07.513453 n-d-856895-1 devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-5836b41e-7a96-4609-8909-9acfea626716 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035081 Sep 10 11:29:07.514274 n-d-856895-1 devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 7/15] 10.222.0.23 () {64 vars in 1336 bytes} [Sat Sep 10 11:29:07 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:29:10.215083 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-f026e5b7-2a23-45fd-879a-1401cfa74216 admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:10.216721 n-d-856895-1 devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-f026e5b7-2a23-45fd-879a-1401cfa74216 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002071 Sep 10 11:29:10.217274 n-d-856895-1 devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 9/16] 10.222.0.23 () {54 vars in 931 bytes} [Sat Sep 10 11:29:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:29:10.656416 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-5c702e67-0576-49d6-83cb-0f60c5560f51 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 4096, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "disk": 20, "vcpus": 4, "id": "d4"}} {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:29:10.680261 n-d-856895-1 devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-5c702e67-0576-49d6-83cb-0f60c5560f51 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.455967 Sep 10 11:29:10.681051 n-d-856895-1 devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 8/17] 10.222.0.23 () {64 vars in 1283 bytes} [Sat Sep 10 11:29:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 10 11:29:10.693405 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-1e646822-d6a3-4532-9e17-ebce8e31daf7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:29:10.722151 n-d-856895-1 devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-1e646822-d6a3-4532-9e17-ebce8e31daf7 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032541 Sep 10 11:29:10.723060 n-d-856895-1 devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 10/18] 10.222.0.23 () {64 vars in 1336 bytes} [Sat Sep 10 11:29:10 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:29:13.388478 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-5c702e67-0576-49d6-83cb-0f60c5560f51 admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:13.389706 n-d-856895-1 devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-5c702e67-0576-49d6-83cb-0f60c5560f51 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Sep 10 11:29:13.389952 n-d-856895-1 devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 9/19] 10.222.0.23 () {54 vars in 931 bytes} [Sat Sep 10 11:29:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:29:13.857365 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-a88f51f0-9d65-4bb6-bec6-f0413d9d96bb admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:13.887255 n-d-856895-1 devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-a88f51f0-9d65-4bb6-bec6-f0413d9d96bb admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.490451 Sep 10 11:29:13.887900 n-d-856895-1 devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 11/20] 10.222.0.23 () {60 vars in 1292 bytes} [Sat Sep 10 11:29:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:29:16.765173 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-5c702e67-0576-49d6-83cb-0f60c5560f51 admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:16.766279 n-d-856895-1 devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-5c702e67-0576-49d6-83cb-0f60c5560f51 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001580 Sep 10 11:29:16.766723 n-d-856895-1 devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 10/21] 10.222.0.23 () {54 vars in 931 bytes} [Sat Sep 10 11:29:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:29:17.215067 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-dec66e67-2759-4303-980d-082b91330517 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "1", "vcpus": 1, "disk": 1, "swap": 0, "rxtx_factor": 1.0}} {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:29:17.237924 n-d-856895-1 devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-dec66e67-2759-4303-980d-082b91330517 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.465022 Sep 10 11:29:17.238541 n-d-856895-1 devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 12/22] 10.222.0.23 () {64 vars in 1283 bytes} [Sat Sep 10 11:29:16 2022] POST /compute/v2.1/flavors => generated 402 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:29:17.250810 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-4ea097f2-7954-4531-947c-0e66064235bc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:29:17.282830 n-d-856895-1 devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-4ea097f2-7954-4531-947c-0e66064235bc admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035915 Sep 10 11:29:17.283562 n-d-856895-1 devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 11/23] 10.222.0.23 () {64 vars in 1333 bytes} [Sat Sep 10 11:29:17 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:29:20.187216 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-dec66e67-2759-4303-980d-082b91330517 admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:20.188330 n-d-856895-1 devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-dec66e67-2759-4303-980d-082b91330517 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001940 Sep 10 11:29:20.188726 n-d-856895-1 devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 13/24] 10.222.0.23 () {54 vars in 931 bytes} [Sat Sep 10 11:29:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:29:20.582718 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-44133327-a66f-4c56-ae49-3da89c5209de admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 20, "rxtx_factor": 1.0, "vcpus": 1, "id": "2", "name": "m1.small", "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:29:20.602774 n-d-856895-1 devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-44133327-a66f-4c56-ae49-3da89c5209de admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.408010 Sep 10 11:29:20.603666 n-d-856895-1 devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 12/25] 10.222.0.23 () {64 vars in 1283 bytes} [Sat Sep 10 11:29:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:29:20.615541 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-43cfc9ef-ae4d-4dfa-b8ea-b719f4d073df admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:29:20.641281 n-d-856895-1 devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-43cfc9ef-ae4d-4dfa-b8ea-b719f4d073df admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029389 Sep 10 11:29:20.641860 n-d-856895-1 devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 14/26] 10.222.0.23 () {64 vars in 1333 bytes} [Sat Sep 10 11:29:20 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:29:23.255043 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-44133327-a66f-4c56-ae49-3da89c5209de admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:23.256190 n-d-856895-1 devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-44133327-a66f-4c56-ae49-3da89c5209de admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Sep 10 11:29:23.256699 n-d-856895-1 devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 13/27] 10.222.0.23 () {54 vars in 931 bytes} [Sat Sep 10 11:29:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:29:23.677633 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-9d4a5437-c844-4aa8-8784-2aef543a3fe8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 2, "rxtx_factor": 1.0, "disk": 40, "name": "m1.medium", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "3"}} {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:29:23.703792 n-d-856895-1 devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-9d4a5437-c844-4aa8-8784-2aef543a3fe8 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.440698 Sep 10 11:29:23.704565 n-d-856895-1 devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 15/28] 10.222.0.23 () {64 vars in 1283 bytes} [Sat Sep 10 11:29:23 2022] POST /compute/v2.1/flavors => generated 406 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:29:23.716391 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-010e27ae-2a12-4150-b0f3-66bf1a7460f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:29:23.721283 n-d-856895-1 devstack@n-api.service[106474]: DEBUG dbcounter [-] [106474] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:29:23.746857 n-d-856895-1 devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-010e27ae-2a12-4150-b0f3-66bf1a7460f3 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034009 Sep 10 11:29:23.747461 n-d-856895-1 devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 14/29] 10.222.0.23 () {64 vars in 1333 bytes} [Sat Sep 10 11:29:23 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:29:26.411272 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-9d4a5437-c844-4aa8-8784-2aef543a3fe8 admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:26.412915 n-d-856895-1 devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-9d4a5437-c844-4aa8-8784-2aef543a3fe8 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002156 Sep 10 11:29:26.413318 n-d-856895-1 devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 16/30] 10.222.0.23 () {54 vars in 931 bytes} [Sat Sep 10 11:29:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:29:26.852085 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-bb84fbd2-d2f0-4ab2-8e12-2b670143884b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 80, "os-flavor-access:is_public": true, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "name": "m1.large", "ram": 8192}} {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:29:26.872942 n-d-856895-1 devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-bb84fbd2-d2f0-4ab2-8e12-2b670143884b admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.453071 Sep 10 11:29:26.873782 n-d-856895-1 devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 15/31] 10.222.0.23 () {64 vars in 1283 bytes} [Sat Sep 10 11:29:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:29:26.886489 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-4cf798ed-f4b3-4742-9350-205f9127ddef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:29:26.911414 n-d-856895-1 devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-4cf798ed-f4b3-4742-9350-205f9127ddef admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028519 Sep 10 11:29:26.924022 n-d-856895-1 devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 17/32] 10.222.0.23 () {64 vars in 1333 bytes} [Sat Sep 10 11:29:26 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:29:29.565701 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-bb84fbd2-d2f0-4ab2-8e12-2b670143884b admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:29.567450 n-d-856895-1 devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-bb84fbd2-d2f0-4ab2-8e12-2b670143884b admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002144 Sep 10 11:29:29.568049 n-d-856895-1 devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 16/33] 10.222.0.23 () {54 vars in 931 bytes} [Sat Sep 10 11:29:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:29:30.006433 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-439590e9-45ab-4f79-a8e3-72034a6e4735 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "disk": 160, "vcpus": 8, "ram": 16384, "rxtx_factor": 1.0, "name": "m1.xlarge", "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:29:30.017608 n-d-856895-1 devstack@n-api.service[106475]: DEBUG dbcounter [-] [106475] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:29:30.032396 n-d-856895-1 devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-439590e9-45ab-4f79-a8e3-72034a6e4735 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.458006 Sep 10 11:29:30.039252 n-d-856895-1 devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 18/34] 10.222.0.23 () {64 vars in 1283 bytes} [Sat Sep 10 11:29:29 2022] POST /compute/v2.1/flavors => generated 408 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:29:30.045200 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-1c94b9c1-7dbd-4b49-9f84-4f3f5323db19 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:29:30.076571 n-d-856895-1 devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-1c94b9c1-7dbd-4b49-9f84-4f3f5323db19 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035042 Sep 10 11:29:30.077148 n-d-856895-1 devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 17/35] 10.222.0.23 () {64 vars in 1333 bytes} [Sat Sep 10 11:29:30 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:29:50.521031 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-439590e9-45ab-4f79-a8e3-72034a6e4735 admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:50.522089 n-d-856895-1 devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-439590e9-45ab-4f79-a8e3-72034a6e4735 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Sep 10 11:29:50.522488 n-d-856895-1 devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 19/36] 10.222.0.23 () {54 vars in 931 bytes} [Sat Sep 10 11:29:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:29:50.533092 n-d-856895-1 devstack@n-api.service[106474]: DEBUG dbcounter [-] [106474] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:29:50.910743 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-22d75a12-ce72-4414-bd79-48e771aa9e9a admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:50.929187 n-d-856895-1 devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-22d75a12-ce72-4414-bd79-48e771aa9e9a admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.400840 Sep 10 11:29:50.929718 n-d-856895-1 devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 18/37] 10.222.0.23 () {60 vars in 1292 bytes} [Sat Sep 10 11:29:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:29:52.237385 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-439590e9-45ab-4f79-a8e3-72034a6e4735 admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:52.238429 n-d-856895-1 devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-439590e9-45ab-4f79-a8e3-72034a6e4735 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Sep 10 11:29:52.238825 n-d-856895-1 devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 20/38] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Sep 10 11:29:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:29:52.780861 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-1d70ae37-ce3d-4306-b6ac-e1bed38daf2e admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:52.786852 n-d-856895-1 devstack@n-api.service[106474]: INFO nova.api.openstack.wsgi [None req-1d70ae37-ce3d-4306-b6ac-e1bed38daf2e admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 10 11:29:52.790172 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-1d70ae37-ce3d-4306-b6ac-e1bed38daf2e admin admin] Request method failure captured: Sep 10 11:29:52.790172 n-d-856895-1 devstack@n-api.service[106474]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 10 11:29:52.790172 n-d-856895-1 devstack@n-api.service[106474]: Accept: application/json Sep 10 11:29:52.790172 n-d-856895-1 devstack@n-api.service[106474]: Accept-Encoding: gzip, deflate Sep 10 11:29:52.790172 n-d-856895-1 devstack@n-api.service[106474]: Connection: keep-alive Sep 10 11:29:52.790172 n-d-856895-1 devstack@n-api.service[106474]: Content-Length: 0 Sep 10 11:29:52.790172 n-d-856895-1 devstack@n-api.service[106474]: Host: 10.222.0.23 Sep 10 11:29:52.790172 n-d-856895-1 devstack@n-api.service[106474]: Openstack-Api-Version: compute 2.92 Sep 10 11:29:52.790172 n-d-856895-1 devstack@n-api.service[106474]: Openstack-System-Scope: None Sep 10 11:29:52.790172 n-d-856895-1 devstack@n-api.service[106474]: User-Agent: python-novaclient Sep 10 11:29:52.790172 n-d-856895-1 devstack@n-api.service[106474]: X-Auth-Token: gAAAAABjHHUwP7o7iDrwSKejsckTQNFY9Gpc-YK5avENXwqx4IhcQdE90BdDnygaB0mmN9jykp11sQjcXHVMErMveXNEGYZAxeuYC2RM5aIAme59L1YuncW5OAMGZw9lmDLVQUdXg_jOFihuODPFXfVel-C74npdBIxMTUhBxtBxfObmHhT-n2I Sep 10 11:29:52.790172 n-d-856895-1 devstack@n-api.service[106474]: X-Domain-Id: None Sep 10 11:29:52.790172 n-d-856895-1 devstack@n-api.service[106474]: X-Domain-Name: None Sep 10 11:29:52.790172 n-d-856895-1 devstack@n-api.service[106474]: X-Identity-Status: Confirmed Sep 10 11:29:52.790172 n-d-856895-1 devstack@n-api.service[106474]: X-Is-Admin-Project: True Sep 10 11:29:52.790172 n-d-856895-1 devstack@n-api.service[106474]: X-Openstack-Nova-Api-Version: 2.92 Sep 10 11:29:52.790172 n-d-856895-1 devstack@n-api.service[106474]: X-Project-Domain-Id: default Sep 10 11:29:52.790172 n-d-856895-1 devstack@n-api.service[106474]: X-Project-Domain-Name: Default Sep 10 11:29:52.790172 n-d-856895-1 devstack@n-api.service[106474]: X-Project-Id: c49fecad45e34522a7f6ad0340beb10a Sep 10 11:29:52.790172 n-d-856895-1 devstack@n-api.service[106474]: X-Project-Name: admin Sep 10 11:29:52.790172 n-d-856895-1 devstack@n-api.service[106474]: X-Role: reader,admin,member Sep 10 11:29:52.790172 n-d-856895-1 devstack@n-api.service[106474]: X-Roles: reader,admin,member Sep 10 11:29:52.791846 n-d-856895-1 devstack@n-api.service[106474]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c49fecad45e34522a7f6ad0340beb10a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c49fecad45e34522a7f6ad0340beb10a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c49fecad45e34522a7f6ad0340beb10a", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c49fecad45e34522a7f6ad0340beb10a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:29:52.791846 n-d-856895-1 devstack@n-api.service[106474]: X-Tenant: admin Sep 10 11:29:52.791846 n-d-856895-1 devstack@n-api.service[106474]: X-Tenant-Id: c49fecad45e34522a7f6ad0340beb10a Sep 10 11:29:52.791846 n-d-856895-1 devstack@n-api.service[106474]: X-Tenant-Name: admin Sep 10 11:29:52.791846 n-d-856895-1 devstack@n-api.service[106474]: X-User: admin Sep 10 11:29:52.791846 n-d-856895-1 devstack@n-api.service[106474]: X-User-Domain-Id: default Sep 10 11:29:52.791846 n-d-856895-1 devstack@n-api.service[106474]: X-User-Domain-Name: Default Sep 10 11:29:52.791846 n-d-856895-1 devstack@n-api.service[106474]: X-User-Id: 1617d20dca82483c9598e04a5712fb72 Sep 10 11:29:52.791846 n-d-856895-1 devstack@n-api.service[106474]: X-User-Name: admin Sep 10 11:29:52.791846 n-d-856895-1 devstack@n-api.service[106474]: method: > Sep 10 11:29:52.791846 n-d-856895-1 devstack@n-api.service[106474]: exception: Flavor 42 could not be found. Sep 10 11:29:52.791846 n-d-856895-1 devstack@n-api.service[106474]: action_args: {'id': '42'} Sep 10 11:29:52.791846 n-d-856895-1 devstack@n-api.service[106474]: {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:29:52.791846 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:29:52.792768 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 10 11:29:52.792768 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 10 11:29:52.792768 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 10 11:29:52.792768 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 10 11:29:52.792768 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 11:29:52.792768 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 11:29:52.792768 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 10 11:29:52.792768 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 10 11:29:52.792768 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 10 11:29:52.792768 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:29:52.792768 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 10 11:29:52.792768 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 10 11:29:52.792768 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 10 11:29:52.792768 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Sep 10 11:29:52.792768 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:29:52.792768 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Sep 10 11:29:52.792768 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:29:52.792768 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:29:52.792768 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:29:52.794059 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:29:52.794059 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:29:52.794059 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:29:52.794059 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:29:52.794059 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 10 11:29:52.794059 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:29:52.794059 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 10 11:29:52.794059 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Sep 10 11:29:52.794059 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:29:52.794059 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Sep 10 11:29:52.794059 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:29:52.794059 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:29:52.794059 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:29:52.794059 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:29:52.794059 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:29:52.794059 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 10 11:29:52.794059 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Sep 10 11:29:52.794059 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-1d70ae37-ce3d-4306-b6ac-e1bed38daf2e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:29:52.795384 n-d-856895-1 devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-1d70ae37-ce3d-4306-b6ac-e1bed38daf2e admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.397427 Sep 10 11:29:52.795384 n-d-856895-1 devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 19/39] 10.222.0.23 () {60 vars in 1190 bytes} [Sat Sep 10 11:29:52 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 10 11:29:52.802274 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-e314bb96-ba06-473b-a5a1-6a7a7e48a944 admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:52.824512 n-d-856895-1 devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-e314bb96-ba06-473b-a5a1-6a7a7e48a944 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026806 Sep 10 11:29:52.825043 n-d-856895-1 devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 21/40] 10.222.0.23 () {60 vars in 1210 bytes} [Sat Sep 10 11:29:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:29:52.847508 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-f9c1a7fe-25a1-44d4-9791-0045b6a4d47d admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:52.870303 n-d-856895-1 devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-f9c1a7fe-25a1-44d4-9791-0045b6a4d47d admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027980 Sep 10 11:29:52.870851 n-d-856895-1 devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 20/41] 10.222.0.23 () {60 vars in 1210 bytes} [Sat Sep 10 11:29:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:29:52.880693 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-4cb5f497-5107-4da3-a219-08c217c876b9 admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:52.885919 n-d-856895-1 devstack@n-api.service[106475]: INFO nova.api.openstack.wsgi [None req-4cb5f497-5107-4da3-a219-08c217c876b9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 10 11:29:52.889204 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-4cb5f497-5107-4da3-a219-08c217c876b9 admin admin] Request method failure captured: Sep 10 11:29:52.889204 n-d-856895-1 devstack@n-api.service[106475]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 10 11:29:52.889204 n-d-856895-1 devstack@n-api.service[106475]: Accept: application/json Sep 10 11:29:52.889204 n-d-856895-1 devstack@n-api.service[106475]: Accept-Encoding: gzip, deflate Sep 10 11:29:52.889204 n-d-856895-1 devstack@n-api.service[106475]: Connection: keep-alive Sep 10 11:29:52.889204 n-d-856895-1 devstack@n-api.service[106475]: Content-Length: 0 Sep 10 11:29:52.889204 n-d-856895-1 devstack@n-api.service[106475]: Host: 10.222.0.23 Sep 10 11:29:52.889204 n-d-856895-1 devstack@n-api.service[106475]: Openstack-Api-Version: compute 2.92 Sep 10 11:29:52.889204 n-d-856895-1 devstack@n-api.service[106475]: Openstack-System-Scope: None Sep 10 11:29:52.889204 n-d-856895-1 devstack@n-api.service[106475]: User-Agent: python-novaclient Sep 10 11:29:52.889204 n-d-856895-1 devstack@n-api.service[106475]: X-Auth-Token: gAAAAABjHHUwP7o7iDrwSKejsckTQNFY9Gpc-YK5avENXwqx4IhcQdE90BdDnygaB0mmN9jykp11sQjcXHVMErMveXNEGYZAxeuYC2RM5aIAme59L1YuncW5OAMGZw9lmDLVQUdXg_jOFihuODPFXfVel-C74npdBIxMTUhBxtBxfObmHhT-n2I Sep 10 11:29:52.889204 n-d-856895-1 devstack@n-api.service[106475]: X-Domain-Id: None Sep 10 11:29:52.889204 n-d-856895-1 devstack@n-api.service[106475]: X-Domain-Name: None Sep 10 11:29:52.889204 n-d-856895-1 devstack@n-api.service[106475]: X-Identity-Status: Confirmed Sep 10 11:29:52.889204 n-d-856895-1 devstack@n-api.service[106475]: X-Is-Admin-Project: True Sep 10 11:29:52.889204 n-d-856895-1 devstack@n-api.service[106475]: X-Openstack-Nova-Api-Version: 2.92 Sep 10 11:29:52.889204 n-d-856895-1 devstack@n-api.service[106475]: X-Project-Domain-Id: default Sep 10 11:29:52.889204 n-d-856895-1 devstack@n-api.service[106475]: X-Project-Domain-Name: Default Sep 10 11:29:52.889204 n-d-856895-1 devstack@n-api.service[106475]: X-Project-Id: c49fecad45e34522a7f6ad0340beb10a Sep 10 11:29:52.889204 n-d-856895-1 devstack@n-api.service[106475]: X-Project-Name: admin Sep 10 11:29:52.889204 n-d-856895-1 devstack@n-api.service[106475]: X-Role: reader,admin,member Sep 10 11:29:52.889204 n-d-856895-1 devstack@n-api.service[106475]: X-Roles: reader,admin,member Sep 10 11:29:52.890539 n-d-856895-1 devstack@n-api.service[106475]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c49fecad45e34522a7f6ad0340beb10a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c49fecad45e34522a7f6ad0340beb10a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c49fecad45e34522a7f6ad0340beb10a", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c49fecad45e34522a7f6ad0340beb10a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:29:52.890539 n-d-856895-1 devstack@n-api.service[106475]: X-Tenant: admin Sep 10 11:29:52.890539 n-d-856895-1 devstack@n-api.service[106475]: X-Tenant-Id: c49fecad45e34522a7f6ad0340beb10a Sep 10 11:29:52.890539 n-d-856895-1 devstack@n-api.service[106475]: X-Tenant-Name: admin Sep 10 11:29:52.890539 n-d-856895-1 devstack@n-api.service[106475]: X-User: admin Sep 10 11:29:52.890539 n-d-856895-1 devstack@n-api.service[106475]: X-User-Domain-Id: default Sep 10 11:29:52.890539 n-d-856895-1 devstack@n-api.service[106475]: X-User-Domain-Name: Default Sep 10 11:29:52.890539 n-d-856895-1 devstack@n-api.service[106475]: X-User-Id: 1617d20dca82483c9598e04a5712fb72 Sep 10 11:29:52.890539 n-d-856895-1 devstack@n-api.service[106475]: X-User-Name: admin Sep 10 11:29:52.890539 n-d-856895-1 devstack@n-api.service[106475]: method: > Sep 10 11:29:52.890539 n-d-856895-1 devstack@n-api.service[106475]: exception: Flavor 42 could not be found. Sep 10 11:29:52.890539 n-d-856895-1 devstack@n-api.service[106475]: action_args: {'id': '42'} Sep 10 11:29:52.890539 n-d-856895-1 devstack@n-api.service[106475]: {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:29:52.890539 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:29:52.891457 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 10 11:29:52.891457 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 10 11:29:52.891457 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 10 11:29:52.891457 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 10 11:29:52.891457 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 11:29:52.891457 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 11:29:52.891457 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 10 11:29:52.891457 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 10 11:29:52.891457 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 10 11:29:52.891457 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:29:52.891457 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 10 11:29:52.891457 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 10 11:29:52.891457 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 10 11:29:52.891457 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Sep 10 11:29:52.891457 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:29:52.891457 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Sep 10 11:29:52.891457 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:29:52.891457 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:29:52.891457 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:29:52.892647 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:29:52.892647 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:29:52.892647 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:29:52.892647 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:29:52.892647 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 10 11:29:52.892647 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:29:52.892647 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 10 11:29:52.892647 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Sep 10 11:29:52.892647 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:29:52.892647 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Sep 10 11:29:52.892647 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:29:52.892647 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:29:52.892647 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:29:52.892647 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:29:52.892647 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:29:52.892647 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 10 11:29:52.892647 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Sep 10 11:29:52.892647 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-4cb5f497-5107-4da3-a219-08c217c876b9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:29:52.893632 n-d-856895-1 devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-4cb5f497-5107-4da3-a219-08c217c876b9 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013813 Sep 10 11:29:52.893632 n-d-856895-1 devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 22/42] 10.222.0.23 () {60 vars in 1190 bytes} [Sat Sep 10 11:29:52 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 10 11:29:54.103639 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-f9c1a7fe-25a1-44d4-9791-0045b6a4d47d admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:54.104671 n-d-856895-1 devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-f9c1a7fe-25a1-44d4-9791-0045b6a4d47d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Sep 10 11:29:54.105066 n-d-856895-1 devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 21/43] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Sep 10 11:29:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:29:54.636991 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-90d9b74f-4fc9-42ca-b1ca-bd3311820c16 admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:54.642406 n-d-856895-1 devstack@n-api.service[106475]: INFO nova.api.openstack.wsgi [None req-90d9b74f-4fc9-42ca-b1ca-bd3311820c16 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 10 11:29:54.643968 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-90d9b74f-4fc9-42ca-b1ca-bd3311820c16 admin admin] Request method failure captured: Sep 10 11:29:54.643968 n-d-856895-1 devstack@n-api.service[106475]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 10 11:29:54.643968 n-d-856895-1 devstack@n-api.service[106475]: Accept: application/json Sep 10 11:29:54.643968 n-d-856895-1 devstack@n-api.service[106475]: Accept-Encoding: gzip, deflate Sep 10 11:29:54.643968 n-d-856895-1 devstack@n-api.service[106475]: Connection: keep-alive Sep 10 11:29:54.643968 n-d-856895-1 devstack@n-api.service[106475]: Content-Length: 0 Sep 10 11:29:54.643968 n-d-856895-1 devstack@n-api.service[106475]: Host: 10.222.0.23 Sep 10 11:29:54.643968 n-d-856895-1 devstack@n-api.service[106475]: Openstack-Api-Version: compute 2.92 Sep 10 11:29:54.643968 n-d-856895-1 devstack@n-api.service[106475]: Openstack-System-Scope: None Sep 10 11:29:54.643968 n-d-856895-1 devstack@n-api.service[106475]: User-Agent: python-novaclient Sep 10 11:29:54.643968 n-d-856895-1 devstack@n-api.service[106475]: X-Auth-Token: gAAAAABjHHUydK_6cPcd0KHlj2Ct9IZn2lCPmiKbUtdT_MZyS9xJqqyA_epOSQI29VXVVX32HohwRKHpo6U7GSTs0BY8ocTC5yqKI9nNnPy843XUfK-fwnj-RZ0brmVaIlHcHajuSgXTIKNhZALWCVUEv3v0osegaW4BQhzDYYtnVVBj1PUFh20 Sep 10 11:29:54.643968 n-d-856895-1 devstack@n-api.service[106475]: X-Domain-Id: None Sep 10 11:29:54.643968 n-d-856895-1 devstack@n-api.service[106475]: X-Domain-Name: None Sep 10 11:29:54.643968 n-d-856895-1 devstack@n-api.service[106475]: X-Identity-Status: Confirmed Sep 10 11:29:54.643968 n-d-856895-1 devstack@n-api.service[106475]: X-Is-Admin-Project: True Sep 10 11:29:54.643968 n-d-856895-1 devstack@n-api.service[106475]: X-Openstack-Nova-Api-Version: 2.92 Sep 10 11:29:54.643968 n-d-856895-1 devstack@n-api.service[106475]: X-Project-Domain-Id: default Sep 10 11:29:54.643968 n-d-856895-1 devstack@n-api.service[106475]: X-Project-Domain-Name: Default Sep 10 11:29:54.643968 n-d-856895-1 devstack@n-api.service[106475]: X-Project-Id: c49fecad45e34522a7f6ad0340beb10a Sep 10 11:29:54.643968 n-d-856895-1 devstack@n-api.service[106475]: X-Project-Name: admin Sep 10 11:29:54.643968 n-d-856895-1 devstack@n-api.service[106475]: X-Role: reader,admin,member Sep 10 11:29:54.643968 n-d-856895-1 devstack@n-api.service[106475]: X-Roles: reader,admin,member Sep 10 11:29:54.645586 n-d-856895-1 devstack@n-api.service[106475]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c49fecad45e34522a7f6ad0340beb10a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c49fecad45e34522a7f6ad0340beb10a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c49fecad45e34522a7f6ad0340beb10a", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c49fecad45e34522a7f6ad0340beb10a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:29:54.645586 n-d-856895-1 devstack@n-api.service[106475]: X-Tenant: admin Sep 10 11:29:54.645586 n-d-856895-1 devstack@n-api.service[106475]: X-Tenant-Id: c49fecad45e34522a7f6ad0340beb10a Sep 10 11:29:54.645586 n-d-856895-1 devstack@n-api.service[106475]: X-Tenant-Name: admin Sep 10 11:29:54.645586 n-d-856895-1 devstack@n-api.service[106475]: X-User: admin Sep 10 11:29:54.645586 n-d-856895-1 devstack@n-api.service[106475]: X-User-Domain-Id: default Sep 10 11:29:54.645586 n-d-856895-1 devstack@n-api.service[106475]: X-User-Domain-Name: Default Sep 10 11:29:54.645586 n-d-856895-1 devstack@n-api.service[106475]: X-User-Id: 1617d20dca82483c9598e04a5712fb72 Sep 10 11:29:54.645586 n-d-856895-1 devstack@n-api.service[106475]: X-User-Name: admin Sep 10 11:29:54.645586 n-d-856895-1 devstack@n-api.service[106475]: method: > Sep 10 11:29:54.645586 n-d-856895-1 devstack@n-api.service[106475]: exception: Flavor 84 could not be found. Sep 10 11:29:54.645586 n-d-856895-1 devstack@n-api.service[106475]: action_args: {'id': '84'} Sep 10 11:29:54.645586 n-d-856895-1 devstack@n-api.service[106475]: {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:29:54.645586 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:29:54.646459 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 10 11:29:54.646459 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 10 11:29:54.646459 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 10 11:29:54.646459 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 10 11:29:54.646459 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 11:29:54.646459 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 11:29:54.646459 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 10 11:29:54.646459 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 10 11:29:54.646459 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 10 11:29:54.646459 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:29:54.646459 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 10 11:29:54.646459 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 10 11:29:54.646459 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 10 11:29:54.646459 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Sep 10 11:29:54.646459 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:29:54.646459 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Sep 10 11:29:54.646459 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:29:54.646459 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:29:54.646459 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:29:54.647697 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:29:54.647697 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:29:54.647697 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:29:54.647697 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:29:54.647697 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 10 11:29:54.647697 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:29:54.647697 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 10 11:29:54.647697 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Sep 10 11:29:54.647697 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:29:54.647697 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Sep 10 11:29:54.647697 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:29:54.647697 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:29:54.647697 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:29:54.647697 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:29:54.647697 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:29:54.647697 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 10 11:29:54.647697 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Sep 10 11:29:54.647697 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-90d9b74f-4fc9-42ca-b1ca-bd3311820c16 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:29:54.648968 n-d-856895-1 devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-90d9b74f-4fc9-42ca-b1ca-bd3311820c16 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.402551 Sep 10 11:29:54.648968 n-d-856895-1 devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 23/44] 10.222.0.23 () {60 vars in 1190 bytes} [Sat Sep 10 11:29:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 10 11:29:54.655306 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-ff6de78d-352a-4d43-9503-b7313a1bac62 admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:54.669979 n-d-856895-1 devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-ff6de78d-352a-4d43-9503-b7313a1bac62 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018341 Sep 10 11:29:54.670519 n-d-856895-1 devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 22/45] 10.222.0.23 () {60 vars in 1210 bytes} [Sat Sep 10 11:29:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:29:54.680917 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-619db013-45ce-440c-b7b4-9609285ba336 admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:54.697123 n-d-856895-1 devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-619db013-45ce-440c-b7b4-9609285ba336 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019910 Sep 10 11:29:54.697676 n-d-856895-1 devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 24/46] 10.222.0.23 () {60 vars in 1210 bytes} [Sat Sep 10 11:29:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:29:54.707308 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-67f650c5-7d8e-41f5-b40e-3640abaee354 admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:54.712510 n-d-856895-1 devstack@n-api.service[106474]: INFO nova.api.openstack.wsgi [None req-67f650c5-7d8e-41f5-b40e-3640abaee354 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 10 11:29:54.714040 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-67f650c5-7d8e-41f5-b40e-3640abaee354 admin admin] Request method failure captured: Sep 10 11:29:54.714040 n-d-856895-1 devstack@n-api.service[106474]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 10 11:29:54.714040 n-d-856895-1 devstack@n-api.service[106474]: Accept: application/json Sep 10 11:29:54.714040 n-d-856895-1 devstack@n-api.service[106474]: Accept-Encoding: gzip, deflate Sep 10 11:29:54.714040 n-d-856895-1 devstack@n-api.service[106474]: Connection: keep-alive Sep 10 11:29:54.714040 n-d-856895-1 devstack@n-api.service[106474]: Content-Length: 0 Sep 10 11:29:54.714040 n-d-856895-1 devstack@n-api.service[106474]: Host: 10.222.0.23 Sep 10 11:29:54.714040 n-d-856895-1 devstack@n-api.service[106474]: Openstack-Api-Version: compute 2.92 Sep 10 11:29:54.714040 n-d-856895-1 devstack@n-api.service[106474]: Openstack-System-Scope: None Sep 10 11:29:54.714040 n-d-856895-1 devstack@n-api.service[106474]: User-Agent: python-novaclient Sep 10 11:29:54.714040 n-d-856895-1 devstack@n-api.service[106474]: X-Auth-Token: gAAAAABjHHUydK_6cPcd0KHlj2Ct9IZn2lCPmiKbUtdT_MZyS9xJqqyA_epOSQI29VXVVX32HohwRKHpo6U7GSTs0BY8ocTC5yqKI9nNnPy843XUfK-fwnj-RZ0brmVaIlHcHajuSgXTIKNhZALWCVUEv3v0osegaW4BQhzDYYtnVVBj1PUFh20 Sep 10 11:29:54.714040 n-d-856895-1 devstack@n-api.service[106474]: X-Domain-Id: None Sep 10 11:29:54.714040 n-d-856895-1 devstack@n-api.service[106474]: X-Domain-Name: None Sep 10 11:29:54.714040 n-d-856895-1 devstack@n-api.service[106474]: X-Identity-Status: Confirmed Sep 10 11:29:54.714040 n-d-856895-1 devstack@n-api.service[106474]: X-Is-Admin-Project: True Sep 10 11:29:54.714040 n-d-856895-1 devstack@n-api.service[106474]: X-Openstack-Nova-Api-Version: 2.92 Sep 10 11:29:54.714040 n-d-856895-1 devstack@n-api.service[106474]: X-Project-Domain-Id: default Sep 10 11:29:54.714040 n-d-856895-1 devstack@n-api.service[106474]: X-Project-Domain-Name: Default Sep 10 11:29:54.714040 n-d-856895-1 devstack@n-api.service[106474]: X-Project-Id: c49fecad45e34522a7f6ad0340beb10a Sep 10 11:29:54.714040 n-d-856895-1 devstack@n-api.service[106474]: X-Project-Name: admin Sep 10 11:29:54.714040 n-d-856895-1 devstack@n-api.service[106474]: X-Role: reader,admin,member Sep 10 11:29:54.714040 n-d-856895-1 devstack@n-api.service[106474]: X-Roles: reader,admin,member Sep 10 11:29:54.715592 n-d-856895-1 devstack@n-api.service[106474]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c49fecad45e34522a7f6ad0340beb10a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c49fecad45e34522a7f6ad0340beb10a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c49fecad45e34522a7f6ad0340beb10a", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c49fecad45e34522a7f6ad0340beb10a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:29:54.715592 n-d-856895-1 devstack@n-api.service[106474]: X-Tenant: admin Sep 10 11:29:54.715592 n-d-856895-1 devstack@n-api.service[106474]: X-Tenant-Id: c49fecad45e34522a7f6ad0340beb10a Sep 10 11:29:54.715592 n-d-856895-1 devstack@n-api.service[106474]: X-Tenant-Name: admin Sep 10 11:29:54.715592 n-d-856895-1 devstack@n-api.service[106474]: X-User: admin Sep 10 11:29:54.715592 n-d-856895-1 devstack@n-api.service[106474]: X-User-Domain-Id: default Sep 10 11:29:54.715592 n-d-856895-1 devstack@n-api.service[106474]: X-User-Domain-Name: Default Sep 10 11:29:54.715592 n-d-856895-1 devstack@n-api.service[106474]: X-User-Id: 1617d20dca82483c9598e04a5712fb72 Sep 10 11:29:54.715592 n-d-856895-1 devstack@n-api.service[106474]: X-User-Name: admin Sep 10 11:29:54.715592 n-d-856895-1 devstack@n-api.service[106474]: method: > Sep 10 11:29:54.715592 n-d-856895-1 devstack@n-api.service[106474]: exception: Flavor 84 could not be found. Sep 10 11:29:54.715592 n-d-856895-1 devstack@n-api.service[106474]: action_args: {'id': '84'} Sep 10 11:29:54.715592 n-d-856895-1 devstack@n-api.service[106474]: {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:29:54.715592 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:29:54.716443 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 10 11:29:54.716443 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 10 11:29:54.716443 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 10 11:29:54.716443 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 10 11:29:54.716443 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 11:29:54.716443 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 11:29:54.716443 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 10 11:29:54.716443 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 10 11:29:54.716443 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 10 11:29:54.716443 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:29:54.716443 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 10 11:29:54.716443 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 10 11:29:54.716443 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 10 11:29:54.716443 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Sep 10 11:29:54.716443 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:29:54.716443 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Sep 10 11:29:54.716443 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:29:54.716443 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:29:54.716443 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:29:54.717668 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:29:54.717668 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:29:54.717668 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:29:54.717668 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:29:54.717668 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 10 11:29:54.717668 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:29:54.717668 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 10 11:29:54.717668 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Sep 10 11:29:54.717668 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:29:54.717668 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Sep 10 11:29:54.717668 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:29:54.717668 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:29:54.717668 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:29:54.717668 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:29:54.717668 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:29:54.717668 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 10 11:29:54.717668 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Sep 10 11:29:54.717668 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-67f650c5-7d8e-41f5-b40e-3640abaee354 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:29:54.718691 n-d-856895-1 devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-67f650c5-7d8e-41f5-b40e-3640abaee354 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011812 Sep 10 11:29:54.718691 n-d-856895-1 devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 23/47] 10.222.0.23 () {60 vars in 1190 bytes} [Sat Sep 10 11:29:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 10 11:29:55.933836 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-619db013-45ce-440c-b7b4-9609285ba336 admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:55.934863 n-d-856895-1 devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-619db013-45ce-440c-b7b4-9609285ba336 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Sep 10 11:29:55.935270 n-d-856895-1 devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 25/48] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Sep 10 11:29:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:29:56.572103 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-9dad1644-51ec-4095-bb94-4a5cf3f4b0bd admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:56.578113 n-d-856895-1 devstack@n-api.service[106474]: INFO nova.api.openstack.wsgi [None req-9dad1644-51ec-4095-bb94-4a5cf3f4b0bd admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 10 11:29:56.579829 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-9dad1644-51ec-4095-bb94-4a5cf3f4b0bd admin admin] Request method failure captured: Sep 10 11:29:56.579829 n-d-856895-1 devstack@n-api.service[106474]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 10 11:29:56.579829 n-d-856895-1 devstack@n-api.service[106474]: Accept: application/json Sep 10 11:29:56.579829 n-d-856895-1 devstack@n-api.service[106474]: Accept-Encoding: gzip, deflate Sep 10 11:29:56.579829 n-d-856895-1 devstack@n-api.service[106474]: Connection: keep-alive Sep 10 11:29:56.579829 n-d-856895-1 devstack@n-api.service[106474]: Content-Length: 0 Sep 10 11:29:56.579829 n-d-856895-1 devstack@n-api.service[106474]: Host: 10.222.0.23 Sep 10 11:29:56.579829 n-d-856895-1 devstack@n-api.service[106474]: Openstack-Api-Version: compute 2.92 Sep 10 11:29:56.579829 n-d-856895-1 devstack@n-api.service[106474]: Openstack-System-Scope: None Sep 10 11:29:56.579829 n-d-856895-1 devstack@n-api.service[106474]: User-Agent: python-novaclient Sep 10 11:29:56.579829 n-d-856895-1 devstack@n-api.service[106474]: X-Auth-Token: gAAAAABjHHUzYpnUN9heI6dgBXb8LX85-1FAuz4bBKwFX2A1BDxh-Likipt6FeX6YVEL7Hx7kqu1XJOFCGDKH4ldxgDrxwEqdm2CrnfFe3DWLoBmE7tn4YFk9J9UsM2Fogy2UMldBr-QyPypegeFYGwRQ3mvvN_KULjp8a0U6A3oDX_LV0Ke0vs Sep 10 11:29:56.579829 n-d-856895-1 devstack@n-api.service[106474]: X-Domain-Id: None Sep 10 11:29:56.579829 n-d-856895-1 devstack@n-api.service[106474]: X-Domain-Name: None Sep 10 11:29:56.579829 n-d-856895-1 devstack@n-api.service[106474]: X-Identity-Status: Confirmed Sep 10 11:29:56.579829 n-d-856895-1 devstack@n-api.service[106474]: X-Is-Admin-Project: True Sep 10 11:29:56.579829 n-d-856895-1 devstack@n-api.service[106474]: X-Openstack-Nova-Api-Version: 2.92 Sep 10 11:29:56.579829 n-d-856895-1 devstack@n-api.service[106474]: X-Project-Domain-Id: default Sep 10 11:29:56.579829 n-d-856895-1 devstack@n-api.service[106474]: X-Project-Domain-Name: Default Sep 10 11:29:56.579829 n-d-856895-1 devstack@n-api.service[106474]: X-Project-Id: c49fecad45e34522a7f6ad0340beb10a Sep 10 11:29:56.579829 n-d-856895-1 devstack@n-api.service[106474]: X-Project-Name: admin Sep 10 11:29:56.579829 n-d-856895-1 devstack@n-api.service[106474]: X-Role: reader,admin,member Sep 10 11:29:56.579829 n-d-856895-1 devstack@n-api.service[106474]: X-Roles: reader,admin,member Sep 10 11:29:56.581452 n-d-856895-1 devstack@n-api.service[106474]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c49fecad45e34522a7f6ad0340beb10a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c49fecad45e34522a7f6ad0340beb10a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c49fecad45e34522a7f6ad0340beb10a", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c49fecad45e34522a7f6ad0340beb10a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:29:56.581452 n-d-856895-1 devstack@n-api.service[106474]: X-Tenant: admin Sep 10 11:29:56.581452 n-d-856895-1 devstack@n-api.service[106474]: X-Tenant-Id: c49fecad45e34522a7f6ad0340beb10a Sep 10 11:29:56.581452 n-d-856895-1 devstack@n-api.service[106474]: X-Tenant-Name: admin Sep 10 11:29:56.581452 n-d-856895-1 devstack@n-api.service[106474]: X-User: admin Sep 10 11:29:56.581452 n-d-856895-1 devstack@n-api.service[106474]: X-User-Domain-Id: default Sep 10 11:29:56.581452 n-d-856895-1 devstack@n-api.service[106474]: X-User-Domain-Name: Default Sep 10 11:29:56.581452 n-d-856895-1 devstack@n-api.service[106474]: X-User-Id: 1617d20dca82483c9598e04a5712fb72 Sep 10 11:29:56.581452 n-d-856895-1 devstack@n-api.service[106474]: X-User-Name: admin Sep 10 11:29:56.581452 n-d-856895-1 devstack@n-api.service[106474]: method: > Sep 10 11:29:56.581452 n-d-856895-1 devstack@n-api.service[106474]: exception: Flavor 451 could not be found. Sep 10 11:29:56.581452 n-d-856895-1 devstack@n-api.service[106474]: action_args: {'id': '451'} Sep 10 11:29:56.581452 n-d-856895-1 devstack@n-api.service[106474]: {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:29:56.581452 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:29:56.582387 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 10 11:29:56.582387 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 10 11:29:56.582387 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 10 11:29:56.582387 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 10 11:29:56.582387 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 11:29:56.582387 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 11:29:56.582387 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 10 11:29:56.582387 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 10 11:29:56.582387 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 10 11:29:56.582387 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:29:56.582387 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 10 11:29:56.582387 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 10 11:29:56.582387 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 10 11:29:56.582387 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Sep 10 11:29:56.582387 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:29:56.582387 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Sep 10 11:29:56.582387 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:29:56.582387 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:29:56.582387 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:29:56.583627 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:29:56.583627 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:29:56.583627 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:29:56.583627 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:29:56.583627 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 10 11:29:56.583627 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:29:56.583627 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 10 11:29:56.583627 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Sep 10 11:29:56.583627 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:29:56.583627 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Sep 10 11:29:56.583627 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:29:56.583627 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:29:56.583627 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:29:56.583627 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:29:56.583627 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:29:56.583627 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 10 11:29:56.583627 n-d-856895-1 devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Sep 10 11:29:56.583627 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-9dad1644-51ec-4095-bb94-4a5cf3f4b0bd admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:29:56.584647 n-d-856895-1 devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-9dad1644-51ec-4095-bb94-4a5cf3f4b0bd admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.508574 Sep 10 11:29:56.584647 n-d-856895-1 devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 24/49] 10.222.0.23 () {60 vars in 1193 bytes} [Sat Sep 10 11:29:56 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 510 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 10 11:29:56.590884 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-23c91940-974a-407b-9347-fa24de6cf6a1 admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:56.606364 n-d-856895-1 devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-23c91940-974a-407b-9347-fa24de6cf6a1 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018993 Sep 10 11:29:56.606810 n-d-856895-1 devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 26/50] 10.222.0.23 () {60 vars in 1210 bytes} [Sat Sep 10 11:29:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:29:56.616610 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-dd06486f-31fb-4408-a9cf-42812b452176 admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:56.631454 n-d-856895-1 devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-dd06486f-31fb-4408-a9cf-42812b452176 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018344 Sep 10 11:29:56.631976 n-d-856895-1 devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 25/51] 10.222.0.23 () {60 vars in 1210 bytes} [Sat Sep 10 11:29:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:29:56.640891 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-5cfee653-941f-431b-9d5b-baec3c59b958 admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:56.645938 n-d-856895-1 devstack@n-api.service[106475]: INFO nova.api.openstack.wsgi [None req-5cfee653-941f-431b-9d5b-baec3c59b958 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 10 11:29:56.647488 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-5cfee653-941f-431b-9d5b-baec3c59b958 admin admin] Request method failure captured: Sep 10 11:29:56.647488 n-d-856895-1 devstack@n-api.service[106475]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 10 11:29:56.647488 n-d-856895-1 devstack@n-api.service[106475]: Accept: application/json Sep 10 11:29:56.647488 n-d-856895-1 devstack@n-api.service[106475]: Accept-Encoding: gzip, deflate Sep 10 11:29:56.647488 n-d-856895-1 devstack@n-api.service[106475]: Connection: keep-alive Sep 10 11:29:56.647488 n-d-856895-1 devstack@n-api.service[106475]: Content-Length: 0 Sep 10 11:29:56.647488 n-d-856895-1 devstack@n-api.service[106475]: Host: 10.222.0.23 Sep 10 11:29:56.647488 n-d-856895-1 devstack@n-api.service[106475]: Openstack-Api-Version: compute 2.92 Sep 10 11:29:56.647488 n-d-856895-1 devstack@n-api.service[106475]: Openstack-System-Scope: None Sep 10 11:29:56.647488 n-d-856895-1 devstack@n-api.service[106475]: User-Agent: python-novaclient Sep 10 11:29:56.647488 n-d-856895-1 devstack@n-api.service[106475]: X-Auth-Token: gAAAAABjHHUzYpnUN9heI6dgBXb8LX85-1FAuz4bBKwFX2A1BDxh-Likipt6FeX6YVEL7Hx7kqu1XJOFCGDKH4ldxgDrxwEqdm2CrnfFe3DWLoBmE7tn4YFk9J9UsM2Fogy2UMldBr-QyPypegeFYGwRQ3mvvN_KULjp8a0U6A3oDX_LV0Ke0vs Sep 10 11:29:56.647488 n-d-856895-1 devstack@n-api.service[106475]: X-Domain-Id: None Sep 10 11:29:56.647488 n-d-856895-1 devstack@n-api.service[106475]: X-Domain-Name: None Sep 10 11:29:56.647488 n-d-856895-1 devstack@n-api.service[106475]: X-Identity-Status: Confirmed Sep 10 11:29:56.647488 n-d-856895-1 devstack@n-api.service[106475]: X-Is-Admin-Project: True Sep 10 11:29:56.647488 n-d-856895-1 devstack@n-api.service[106475]: X-Openstack-Nova-Api-Version: 2.92 Sep 10 11:29:56.647488 n-d-856895-1 devstack@n-api.service[106475]: X-Project-Domain-Id: default Sep 10 11:29:56.647488 n-d-856895-1 devstack@n-api.service[106475]: X-Project-Domain-Name: Default Sep 10 11:29:56.647488 n-d-856895-1 devstack@n-api.service[106475]: X-Project-Id: c49fecad45e34522a7f6ad0340beb10a Sep 10 11:29:56.647488 n-d-856895-1 devstack@n-api.service[106475]: X-Project-Name: admin Sep 10 11:29:56.647488 n-d-856895-1 devstack@n-api.service[106475]: X-Role: reader,admin,member Sep 10 11:29:56.647488 n-d-856895-1 devstack@n-api.service[106475]: X-Roles: reader,admin,member Sep 10 11:29:56.649040 n-d-856895-1 devstack@n-api.service[106475]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c49fecad45e34522a7f6ad0340beb10a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c49fecad45e34522a7f6ad0340beb10a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c49fecad45e34522a7f6ad0340beb10a", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c49fecad45e34522a7f6ad0340beb10a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:29:56.649040 n-d-856895-1 devstack@n-api.service[106475]: X-Tenant: admin Sep 10 11:29:56.649040 n-d-856895-1 devstack@n-api.service[106475]: X-Tenant-Id: c49fecad45e34522a7f6ad0340beb10a Sep 10 11:29:56.649040 n-d-856895-1 devstack@n-api.service[106475]: X-Tenant-Name: admin Sep 10 11:29:56.649040 n-d-856895-1 devstack@n-api.service[106475]: X-User: admin Sep 10 11:29:56.649040 n-d-856895-1 devstack@n-api.service[106475]: X-User-Domain-Id: default Sep 10 11:29:56.649040 n-d-856895-1 devstack@n-api.service[106475]: X-User-Domain-Name: Default Sep 10 11:29:56.649040 n-d-856895-1 devstack@n-api.service[106475]: X-User-Id: 1617d20dca82483c9598e04a5712fb72 Sep 10 11:29:56.649040 n-d-856895-1 devstack@n-api.service[106475]: X-User-Name: admin Sep 10 11:29:56.649040 n-d-856895-1 devstack@n-api.service[106475]: method: > Sep 10 11:29:56.649040 n-d-856895-1 devstack@n-api.service[106475]: exception: Flavor 451 could not be found. Sep 10 11:29:56.649040 n-d-856895-1 devstack@n-api.service[106475]: action_args: {'id': '451'} Sep 10 11:29:56.649040 n-d-856895-1 devstack@n-api.service[106475]: {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:29:56.649040 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:29:56.649991 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 10 11:29:56.649991 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 10 11:29:56.649991 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 10 11:29:56.649991 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 10 11:29:56.649991 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 11:29:56.649991 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 11:29:56.649991 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 10 11:29:56.649991 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 10 11:29:56.649991 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 10 11:29:56.649991 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:29:56.649991 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 10 11:29:56.649991 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 10 11:29:56.649991 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 10 11:29:56.649991 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Sep 10 11:29:56.649991 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:29:56.649991 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Sep 10 11:29:56.649991 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:29:56.649991 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:29:56.649991 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:29:56.651283 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:29:56.651283 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:29:56.651283 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:29:56.651283 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:29:56.651283 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 10 11:29:56.651283 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:29:56.651283 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 10 11:29:56.651283 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Sep 10 11:29:56.651283 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:29:56.651283 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Sep 10 11:29:56.651283 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:29:56.651283 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:29:56.651283 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:29:56.651283 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:29:56.651283 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:29:56.651283 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 10 11:29:56.651283 n-d-856895-1 devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Sep 10 11:29:56.651283 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-5cfee653-941f-431b-9d5b-baec3c59b958 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:29:56.652513 n-d-856895-1 devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-5cfee653-941f-431b-9d5b-baec3c59b958 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011441 Sep 10 11:29:56.652513 n-d-856895-1 devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 27/52] 10.222.0.23 () {60 vars in 1193 bytes} [Sat Sep 10 11:29:56 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 10 11:29:57.857248 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-dd06486f-31fb-4408-a9cf-42812b452176 admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:57.858263 n-d-856895-1 devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-dd06486f-31fb-4408-a9cf-42812b452176 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Sep 10 11:29:57.858656 n-d-856895-1 devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 26/53] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Sep 10 11:29:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:29:58.385246 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-5a801b62-eaf9-4473-8b1a-dc28b007c97f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:29:58.404476 n-d-856895-1 devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-5a801b62-eaf9-4473-8b1a-dc28b007c97f admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.408880 Sep 10 11:29:58.405013 n-d-856895-1 devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 28/54] 10.222.0.23 () {64 vars in 1235 bytes} [Sat Sep 10 11:29:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:29:59.679997 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-dd06486f-31fb-4408-a9cf-42812b452176 admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:29:59.681080 n-d-856895-1 devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-dd06486f-31fb-4408-a9cf-42812b452176 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Sep 10 11:29:59.681511 n-d-856895-1 devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 27/55] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Sep 10 11:29:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:30:00.270717 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-a3a8084a-f286-42b0-a9dd-9aa71214f348 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:30:00.289224 n-d-856895-1 devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-a3a8084a-f286-42b0-a9dd-9aa71214f348 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.418543 Sep 10 11:30:00.289763 n-d-856895-1 devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 29/56] 10.222.0.23 () {64 vars in 1235 bytes} [Sat Sep 10 11:29:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:30:01.499335 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-dd06486f-31fb-4408-a9cf-42812b452176 admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:30:01.500407 n-d-856895-1 devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-dd06486f-31fb-4408-a9cf-42812b452176 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Sep 10 11:30:01.500804 n-d-856895-1 devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 28/57] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Sep 10 11:30:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:30:02.022235 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-5675c00c-bea4-43e0-854b-b84598cb2253 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:30:02.041138 n-d-856895-1 devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-5675c00c-bea4-43e0-854b-b84598cb2253 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.400297 Sep 10 11:30:02.041670 n-d-856895-1 devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 30/58] 10.222.0.23 () {64 vars in 1235 bytes} [Sat Sep 10 11:30:01 2022] POST /compute/v2.1/flavors => generated 407 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:30:03.263150 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-dd06486f-31fb-4408-a9cf-42812b452176 admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:30:03.264176 n-d-856895-1 devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-dd06486f-31fb-4408-a9cf-42812b452176 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Sep 10 11:30:03.264558 n-d-856895-1 devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 29/59] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Sep 10 11:30:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:30:03.783656 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-21503f3c-ab20-4ec1-8ff8-cea5319b535d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:30:03.803232 n-d-856895-1 devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-21503f3c-ab20-4ec1-8ff8-cea5319b535d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.398582 Sep 10 11:30:03.803781 n-d-856895-1 devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 31/60] 10.222.0.23 () {64 vars in 1235 bytes} [Sat Sep 10 11:30:03 2022] POST /compute/v2.1/flavors => generated 409 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:30:05.023311 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-dd06486f-31fb-4408-a9cf-42812b452176 admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:30:05.024331 n-d-856895-1 devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-dd06486f-31fb-4408-a9cf-42812b452176 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Sep 10 11:30:05.024729 n-d-856895-1 devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 30/61] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Sep 10 11:30:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:30:05.544491 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-4deb0183-de9e-4fd3-bd9c-d62ea85bfb76 admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:30:05.565184 n-d-856895-1 devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-4deb0183-de9e-4fd3-bd9c-d62ea85bfb76 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.401620 Sep 10 11:30:05.565734 n-d-856895-1 devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 32/62] 10.222.0.23 () {60 vars in 1202 bytes} [Sat Sep 10 11:30:05 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:31:02.609525 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-dd06486f-31fb-4408-a9cf-42812b452176 admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:31:02.610454 n-d-856895-1 devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-dd06486f-31fb-4408-a9cf-42812b452176 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Sep 10 11:31:02.610859 n-d-856895-1 devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 31/63] 10.222.0.23 () {54 vars in 931 bytes} [Sat Sep 10 11:31:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:31:02.622101 n-d-856895-1 devstack@n-api.service[106475]: DEBUG dbcounter [-] [106475] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:31:03.000575 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-1d2322c8-251c-40ee-b549-9d9d46b065d8 admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:31:03.021314 n-d-856895-1 devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-1d2322c8-251c-40ee-b549-9d9d46b065d8 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.403623 Sep 10 11:31:03.021846 n-d-856895-1 devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 33/64] 10.222.0.23 () {60 vars in 1292 bytes} [Sat Sep 10 11:31:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:31:03.042593 n-d-856895-1 devstack@n-api.service[106474]: DEBUG dbcounter [-] [106474] Writing DB stats nova_api:SELECT=14 {{(pid=106474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:31:03.046712 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-58e05c5b-d8e4-4f8b-b227-e9551e65cb9a admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:31:03.055090 n-d-856895-1 devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-58e05c5b-d8e4-4f8b-b227-e9551e65cb9a admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013899 Sep 10 11:31:03.055677 n-d-856895-1 devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 32/65] 10.222.0.23 () {60 vars in 1283 bytes} [Sat Sep 10 11:31:03 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:31:03.067822 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-810a4472-15f7-4528-9424-019e8fcafb1a admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:31:03.074970 n-d-856895-1 devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-810a4472-15f7-4528-9424-019e8fcafb1a admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011459 Sep 10 11:31:03.075507 n-d-856895-1 devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 34/66] 10.222.0.23 () {60 vars in 1286 bytes} [Sat Sep 10 11:31:03 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:31:03.087123 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-dfc1aaf7-4646-42ef-aa92-105dbaae4a6d admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:31:03.094219 n-d-856895-1 devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-dfc1aaf7-4646-42ef-aa92-105dbaae4a6d admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010535 Sep 10 11:31:03.094726 n-d-856895-1 devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 33/67] 10.222.0.23 () {60 vars in 1286 bytes} [Sat Sep 10 11:31:03 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:31:03.105723 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-d78eee49-114f-4d39-ac8d-92dfd473541d admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:31:03.113401 n-d-856895-1 devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-d78eee49-114f-4d39-ac8d-92dfd473541d admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010492 Sep 10 11:31:03.113972 n-d-856895-1 devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 35/68] 10.222.0.23 () {60 vars in 1283 bytes} [Sat Sep 10 11:31:03 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:36:17.807624 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-dfc1aaf7-4646-42ef-aa92-105dbaae4a6d admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:36:17.808635 n-d-856895-1 devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-dfc1aaf7-4646-42ef-aa92-105dbaae4a6d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Sep 10 11:36:17.809030 n-d-856895-1 devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 34/69] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Sep 10 11:36:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:36:17.955218 n-d-856895-1 devstack@n-api.service[106475]: DEBUG dbcounter [-] [106475] Writing DB stats nova_api:SELECT=6 {{(pid=106475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:36:18.097269 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-705181df-0c4f-4025-ba9e-5f8020f3b5af admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:36:18.101989 n-d-856895-1 devstack@n-api.service[106475]: DEBUG oslo_concurrency.lockutils [None req-705181df-0c4f-4025-ba9e-5f8020f3b5af admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:18.102459 n-d-856895-1 devstack@n-api.service[106475]: DEBUG oslo_concurrency.lockutils [None req-705181df-0c4f-4025-ba9e-5f8020f3b5af admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:18.102914 n-d-856895-1 devstack@n-api.service[106475]: DEBUG oslo_concurrency.lockutils [None req-705181df-0c4f-4025-ba9e-5f8020f3b5af admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:18.103659 n-d-856895-1 devstack@n-api.service[106475]: DEBUG oslo_concurrency.lockutils [None req-705181df-0c4f-4025-ba9e-5f8020f3b5af admin admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:18.104106 n-d-856895-1 devstack@n-api.service[106475]: DEBUG oslo_concurrency.lockutils [None req-705181df-0c4f-4025-ba9e-5f8020f3b5af admin admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:18.104524 n-d-856895-1 devstack@n-api.service[106475]: DEBUG oslo_concurrency.lockutils [None req-705181df-0c4f-4025-ba9e-5f8020f3b5af admin admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:18.143478 n-d-856895-1 devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-705181df-0c4f-4025-ba9e-5f8020f3b5af admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.189400 Sep 10 11:36:18.144052 n-d-856895-1 devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 36/70] 10.222.0.23 () {60 vars in 1193 bytes} [Sat Sep 10 11:36:17 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:36:19.217412 n-d-856895-1 devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-dfc1aaf7-4646-42ef-aa92-105dbaae4a6d admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:36:19.218422 n-d-856895-1 devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-dfc1aaf7-4646-42ef-aa92-105dbaae4a6d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Sep 10 11:36:19.218821 n-d-856895-1 devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 35/71] 10.222.0.23 () {56 vars in 1074 bytes} [Sat Sep 10 11:36:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:36:19.410487 n-d-856895-1 devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-d7bbbf8c-ca37-43f4-a85c-cc226ca85d62 admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:36:19.414126 n-d-856895-1 devstack@n-api.service[106475]: DEBUG oslo_concurrency.lockutils [None req-d7bbbf8c-ca37-43f4-a85c-cc226ca85d62 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:19.414600 n-d-856895-1 devstack@n-api.service[106475]: DEBUG oslo_concurrency.lockutils [None req-d7bbbf8c-ca37-43f4-a85c-cc226ca85d62 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:19.415032 n-d-856895-1 devstack@n-api.service[106475]: DEBUG oslo_concurrency.lockutils [None req-d7bbbf8c-ca37-43f4-a85c-cc226ca85d62 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:19.415782 n-d-856895-1 devstack@n-api.service[106475]: DEBUG oslo_concurrency.lockutils [None req-d7bbbf8c-ca37-43f4-a85c-cc226ca85d62 admin admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:36:19.416227 n-d-856895-1 devstack@n-api.service[106475]: DEBUG oslo_concurrency.lockutils [None req-d7bbbf8c-ca37-43f4-a85c-cc226ca85d62 admin admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:36:19.416644 n-d-856895-1 devstack@n-api.service[106475]: DEBUG oslo_concurrency.lockutils [None req-d7bbbf8c-ca37-43f4-a85c-cc226ca85d62 admin admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:36:19.439854 n-d-856895-1 devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-d7bbbf8c-ca37-43f4-a85c-cc226ca85d62 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.080467 Sep 10 11:36:19.440389 n-d-856895-1 devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 37/72] 10.222.0.23 () {60 vars in 1193 bytes} [Sat Sep 10 11:36:19 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:37:02.937994 n-d-856895-1 systemd[1]: Stopping Devstack devstack@n-api.service... Sep 10 11:37:02.940594 n-d-856895-1 devstack@n-api.service[106473]: Sat Sep 10 11:37:02 2022 - graceful shutdown triggered... Sep 10 11:37:02.941072 n-d-856895-1 devstack@n-api.service[106474]: Gracefully killing worker 1 (pid: 106474)... Sep 10 11:37:02.941443 n-d-856895-1 devstack@n-api.service[106475]: Gracefully killing worker 2 (pid: 106475)... Sep 10 11:37:03.077069 n-d-856895-1 devstack@n-api.service[106474]: DEBUG dbcounter [-] [106474] Writing DB stats nova_api:SELECT=4 {{(pid=106474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:37:03.938756 n-d-856895-1 devstack@n-api.service[106473]: worker 1 buried after 1 seconds Sep 10 11:37:03.938756 n-d-856895-1 devstack@n-api.service[106473]: worker 2 buried after 1 seconds Sep 10 11:37:03.938756 n-d-856895-1 devstack@n-api.service[106473]: goodbye to uWSGI. Sep 10 11:37:03.940455 n-d-856895-1 systemd[1]: devstack@n-api.service: Succeeded. Sep 10 11:37:03.941017 n-d-856895-1 systemd[1]: Stopped Devstack devstack@n-api.service. Sep 10 11:37:03.943813 n-d-856895-1 systemd[1]: Starting Devstack devstack@n-api.service... Sep 10 11:37:03.962104 n-d-856895-1 devstack@n-api.service[128764]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 10 11:37:03.979180 n-d-856895-1 devstack@n-api.service[128764]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 10 11:37:03 2022] *** Sep 10 11:37:03.979378 n-d-856895-1 devstack@n-api.service[128764]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 10 11:37:03.979378 n-d-856895-1 devstack@n-api.service[128764]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 10 11:37:03.979378 n-d-856895-1 devstack@n-api.service[128764]: nodename: n-d-856895-1 Sep 10 11:37:03.979378 n-d-856895-1 devstack@n-api.service[128764]: machine: x86_64 Sep 10 11:37:03.979378 n-d-856895-1 devstack@n-api.service[128764]: clock source: unix Sep 10 11:37:03.979378 n-d-856895-1 devstack@n-api.service[128764]: pcre jit disabled Sep 10 11:37:03.979378 n-d-856895-1 devstack@n-api.service[128764]: detected number of CPU cores: 4 Sep 10 11:37:03.979378 n-d-856895-1 devstack@n-api.service[128764]: current working directory: / Sep 10 11:37:03.979378 n-d-856895-1 devstack@n-api.service[128764]: detected binary path: /usr/bin/uwsgi-core Sep 10 11:37:03.979378 n-d-856895-1 devstack@n-api.service[128764]: your processes number limit is 47680 Sep 10 11:37:03.980057 n-d-856895-1 devstack@n-api.service[128764]: your memory page size is 4096 bytes Sep 10 11:37:03.980057 n-d-856895-1 devstack@n-api.service[128764]: detected max file descriptor number: 2048 Sep 10 11:37:03.980057 n-d-856895-1 devstack@n-api.service[128764]: lock engine: pthread robust mutexes Sep 10 11:37:03.980057 n-d-856895-1 devstack@n-api.service[128764]: thunder lock: enabled Sep 10 11:37:03.980057 n-d-856895-1 devstack@n-api.service[128764]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 10 11:37:03.980057 n-d-856895-1 devstack@n-api.service[128764]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 10 11:37:04.034620 n-d-856895-1 devstack@n-api.service[128764]: Python main interpreter initialized at 0x55a2e17729c0 Sep 10 11:37:04.034620 n-d-856895-1 devstack@n-api.service[128764]: python threads support enabled Sep 10 11:37:04.034620 n-d-856895-1 devstack@n-api.service[128764]: your server socket listen backlog is limited to 100 connections Sep 10 11:37:04.034620 n-d-856895-1 devstack@n-api.service[128764]: your mercy for graceful operations on workers is 90 seconds Sep 10 11:37:04.035083 n-d-856895-1 devstack@n-api.service[128764]: mapped 403077 bytes (393 KB) for 2 cores Sep 10 11:37:04.035083 n-d-856895-1 devstack@n-api.service[128764]: *** Operational MODE: preforking *** Sep 10 11:37:04.035359 n-d-856895-1 devstack@n-api.service[128764]: *** uWSGI is running in multiple interpreter mode *** Sep 10 11:37:04.035359 n-d-856895-1 devstack@n-api.service[128764]: spawned uWSGI master process (pid: 128764) Sep 10 11:37:04.035566 n-d-856895-1 systemd[1]: Started Devstack devstack@n-api.service. Sep 10 11:37:04.036243 n-d-856895-1 devstack@n-api.service[128764]: spawned uWSGI worker 1 (pid: 128776, cores: 1) Sep 10 11:37:04.039260 n-d-856895-1 devstack@n-api.service[128764]: spawned uWSGI worker 2 (pid: 128777, cores: 1) Sep 10 11:37:04.039260 n-d-856895-1 devstack@n-api.service[128764]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 10 11:37:04.711083 n-d-856895-1 devstack@n-api.service[128777]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 10 11:37:04.775376 n-d-856895-1 devstack@n-api.service[128776]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 10 11:37:05.897168 n-d-856895-1 devstack@n-api.service[128777]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 10 11:37:05.897168 n-d-856895-1 devstack@n-api.service[128777]: from cryptography.utils import int_from_bytes Sep 10 11:37:05.897940 n-d-856895-1 devstack@n-api.service[128777]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 10 11:37:05.897940 n-d-856895-1 devstack@n-api.service[128777]: from cryptography.utils import int_from_bytes Sep 10 11:37:05.963852 n-d-856895-1 devstack@n-api.service[128776]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 10 11:37:05.963852 n-d-856895-1 devstack@n-api.service[128776]: from cryptography.utils import int_from_bytes Sep 10 11:37:05.964443 n-d-856895-1 devstack@n-api.service[128776]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 10 11:37:05.964443 n-d-856895-1 devstack@n-api.service[128776]: from cryptography.utils import int_from_bytes Sep 10 11:37:08.355227 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 10 11:37:08.355793 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 10 11:37:08.355969 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 10 11:37:08.356341 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 10 11:37:08.356605 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 10 11:37:08.357012 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.357347 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.357675 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.358016 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.358343 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.358662 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.358994 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.359353 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.359696 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.359966 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.360292 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.360804 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-856895-1 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.361141 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.361461 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.361783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.362117 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.362430 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.362762 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.363077 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.363623 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.364090 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.364404 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.364734 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.365098 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.365404 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.365726 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.366057 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.366651 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.367320 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.367320 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.367514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-856895-1 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.367845 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.368167 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.368493 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.368929 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.369250 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.369583 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.369897 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.370228 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.370545 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.370891 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.371244 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.371576 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.371907 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.372218 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.372535 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.372857 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.373175 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.373488 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.373800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.374055 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.374368 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.374698 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.375026 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.375391 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.375647 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.375904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.376236 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.376564 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.376885 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.377202 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.377513 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.377825 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.378136 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.378450 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.378758 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.379069 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.379425 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.379749 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.380079 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.380395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.380721 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.381135 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.381391 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.381706 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.382705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.383495 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.383495 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.383753 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.384084 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.384401 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.384718 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.385034 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.385366 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.385714 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.386024 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.386284 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.386593 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.386904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.387259 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.387576 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.387891 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.388205 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.388512 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.388826 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.389141 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.389453 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.389768 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.390080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.390391 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.390704 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.391016 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.391358 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.391668 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.391999 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.392325 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.392638 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.392952 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.393268 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.393581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.393908 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.394222 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.394536 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.394867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.395198 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.395516 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.395843 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.396156 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.396471 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.396795 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.397107 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.397420 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.398393 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.398792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.399115 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.399451 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.399783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.400075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.400386 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.400696 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.401005 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.401314 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.401640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.401971 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.402285 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.402599 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.402910 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.403259 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.403612 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.403953 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.404303 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.404626 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.404969 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.405305 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.405625 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.405949 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.406267 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.406601 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.406920 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.407262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.407584 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.407756 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 10 11:37:08.408189 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.408296 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 10 11:37:08.408382 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.408545 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 10 11:37:08.408645 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.408867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.408964 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 10 11:37:08.409170 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 10 11:37:08.409275 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.409507 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.409615 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.409825 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.409918 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.410158 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.410277 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.410497 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.410598 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.411217 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.411315 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.411399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.411473 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.411473 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.411618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.411865 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.412020 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.412202 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.412361 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.412517 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.412673 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.412828 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.412983 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.413129 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.413291 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-856895-1 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.413445 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.413604 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.413750 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.413902 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.414224 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.414373 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.414535 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.414844 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.415145 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.415345 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.415503 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.415674 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.415781 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.415868 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.416002 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.416002 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.416186 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.416293 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.416379 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.416552 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.416681 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.416882 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.416984 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.417181 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.417288 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.417516 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.417606 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.417832 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.417937 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.418156 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.418257 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.418471 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.418576 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.418791 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.418880 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.419103 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.419249 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.419452 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.419567 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-856895-1 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.419771 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.419870 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.420090 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.420180 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.420406 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.420512 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.420718 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.420857 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.421028 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.421175 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.421347 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.421494 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.421644 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.421821 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.421975 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.422149 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.422311 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.422463 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.422630 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.422795 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.422971 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.423120 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.423326 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.423473 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.423647 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.423800 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.423966 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.424110 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.424285 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.424424 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.424596 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.424738 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.424924 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.425067 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.425239 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.425382 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.425536 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.425677 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.425867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.425972 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.426184 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.426277 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.426498 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.426614 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.426836 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.426947 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.427152 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.427326 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.427491 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.427590 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.427744 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.427836 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.428069 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.428161 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.428394 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.428496 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.428709 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.428825 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.429061 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.429166 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.429394 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.429500 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.429715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.429818 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.430033 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.430124 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.430379 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.430482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.430695 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.430793 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.431007 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.431106 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.431357 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.431460 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.431682 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.431862 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.432020 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.432162 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.432320 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.432480 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.432625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.432766 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.432921 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.433070 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.433231 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.433385 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.433527 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.433679 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.433839 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.433994 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.434137 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.434302 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.434445 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.434585 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.434732 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.434880 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.435029 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.435222 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.435377 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.435468 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.435661 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.435764 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.435982 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.436090 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.436296 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.436397 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.436610 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.436703 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.436931 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.437038 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.437206 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.437363 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.437514 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.437648 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.437825 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.437925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.438150 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.438250 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.438464 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.438555 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.438775 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.438868 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.439085 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.439225 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.439420 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.439556 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.439849 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.439965 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.440167 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.440266 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.440492 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.440597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.440790 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.440882 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.441102 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.441193 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.441414 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.441513 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.441722 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.441821 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.442034 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.442135 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.442343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.442449 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.442651 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.442758 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.442975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.443066 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.443311 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.443419 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.443631 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.443722 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.443943 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.444042 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.444257 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.444356 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.445100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.445246 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.445417 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.445589 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.445732 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.445917 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.446042 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.446247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.446371 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.446570 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.446685 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.446893 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.447001 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.447253 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.447387 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.447581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.447727 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.447910 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.448018 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.448235 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.448336 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.448541 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.448649 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.448854 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.448953 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.449177 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.449276 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.449491 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.449589 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.449821 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.449969 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.450113 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.450212 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.450422 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.450522 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.450730 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.450834 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.451042 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.451133 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.451375 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.451468 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.451685 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.451792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.451991 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.452094 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.452315 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.452407 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.452640 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.452745 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.452953 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.453045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.453265 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.453362 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.453571 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.453670 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.453886 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.453975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 10 11:37:08.454227 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.454366 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.454528 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.454629 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.454845 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.454937 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.455188 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.455293 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.455503 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.455647 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.455819 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.455917 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.456131 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.456305 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.456462 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.456607 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.456762 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.456861 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.457096 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.457210 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.457416 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.457526 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.457727 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.457832 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.458039 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.458145 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.458351 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.458441 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.458661 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.458751 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.459270 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.459388 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.459588 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.459686 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.459902 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.460037 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.460765 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.460873 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.461083 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.461183 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.461410 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.461509 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.461747 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.461839 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.462073 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.462164 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.462392 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.462483 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.462728 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.462825 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.463048 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.463139 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.463402 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.463497 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.463741 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.463841 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.464045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.464171 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.464362 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.464469 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.464680 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.464786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.464994 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.465096 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.465311 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.465425 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.465634 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.465777 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.465954 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.466047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.466272 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.466377 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.466588 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.466729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.466918 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.467029 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.467261 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.467370 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.467594 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.467689 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.467879 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.467974 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.468196 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.468296 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.468512 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.468612 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.468854 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.469096 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.469200 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.469438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.469529 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.469764 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.469897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.470095 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.470195 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.470416 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.470514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.470734 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.470841 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.471051 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.471154 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.471395 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.471485 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.471709 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.471819 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.472020 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.472154 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.472331 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.472431 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.472647 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.472739 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.472956 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.473044 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.473275 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.473366 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.473589 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.473680 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.473903 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.473993 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.474216 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.474314 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.474533 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.474625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.475398 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.475523 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.475619 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.475702 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.475801 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.475881 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.476028 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.476124 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.476272 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.476391 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.476489 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.476572 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.476726 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.476824 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.477039 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.477212 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.477354 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.477444 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.477670 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.477795 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.477981 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.478103 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.478293 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.478405 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.478602 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.478712 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.478925 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.479044 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.479265 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.479370 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.479583 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.479687 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.479959 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.480076 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.480224 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.480392 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.480555 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.480704 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.480857 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.480997 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.481165 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.481312 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.481492 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.481630 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.481805 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.481945 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.482115 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.482277 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.482414 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.482572 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.482718 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.482871 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.483019 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.483157 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.483356 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.483462 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.483677 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.483768 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.483995 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.484085 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.484305 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.484409 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.484615 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.484713 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.484929 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.485026 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.485237 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.485348 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.485545 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.485643 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.485854 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.485945 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.486162 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.486268 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.486469 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.486559 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.486782 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.486914 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.487103 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.487214 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.487439 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.487531 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.487756 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.487869 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.488063 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.488153 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.488387 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.488491 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.488702 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.488810 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.489014 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.489124 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.489326 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.489427 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.489643 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.489751 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.489960 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.490070 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.490273 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.490384 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.490603 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.490719 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.490920 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.491020 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.491263 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.491399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.491606 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.491718 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.491929 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.492052 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.492256 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.492393 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.492576 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.492678 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.492903 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.492994 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.493220 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.493311 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.493542 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.493640 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.493853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.493944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.494167 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.494268 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.494478 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.494578 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.494792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.494894 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.495104 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.495222 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.495473 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.495574 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.495785 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.495928 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.496118 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.496265 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.496409 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.496501 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.496722 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.496821 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.497035 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.497134 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.497353 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.497471 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.497670 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.497789 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.498058 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.498180 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.498307 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.498406 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.498575 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.498666 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.498919 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.499075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.499255 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.499349 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.499586 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.499677 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.499904 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.500013 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.500231 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.500324 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.500545 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.500648 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.500865 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.500956 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.501202 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.501540 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.501661 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.501857 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.502069 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.502210 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.502300 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.502532 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.502665 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.502860 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.503124 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.503342 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.503498 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.503640 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.503790 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.503938 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.504096 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.504248 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.504415 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.504565 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.504738 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.504888 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.505060 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.505228 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.505378 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.505520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.505668 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.505819 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.505967 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.506109 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.506279 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.506429 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.506716 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.506852 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.507654 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.507770 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.507986 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.508089 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.508253 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.508362 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.508547 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.508654 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.508871 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.509063 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.509227 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.509374 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.509514 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.509646 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.509794 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.509952 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.510192 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.510346 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.510478 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.510589 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.510709 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.510834 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.511016 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.511124 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.511404 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.511553 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.511697 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.511793 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.512013 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.512116 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.512322 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.512423 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.512643 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.512737 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.512969 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.513063 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.513284 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.513378 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.513597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.513704 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.513910 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.514048 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.514225 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.514372 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.514555 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.514695 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.514876 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.515014 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.515207 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.515366 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.515526 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.515692 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.515845 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.516020 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.516162 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.516347 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.516477 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.516663 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.516828 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.517093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.517187 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.517407 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.517559 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.517721 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.517824 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.518035 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.518201 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.518342 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.518534 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.518669 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.518812 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.518954 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.519258 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.519417 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.519603 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.519739 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.519915 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.520057 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.520228 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.520385 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.520559 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.520711 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.520879 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.521035 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.521179 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.521319 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.521535 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.521683 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.521854 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.522000 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.522167 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.522312 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.522487 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.522743 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.522952 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.523147 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.523351 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.523496 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.523635 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.523813 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.523917 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.524147 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.524247 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.524485 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.524585 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.524802 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.524903 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.525111 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.525202 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.525424 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.525524 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.525734 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.525839 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.526046 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.526145 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.526367 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.526459 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.526678 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.526778 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.526992 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.527095 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.527372 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.527473 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.527657 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.527775 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.527972 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.528066 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.528283 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.528387 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.528592 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.528761 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.528902 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.529098 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.529239 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.529425 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.529559 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.529760 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.529916 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.530105 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.530271 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.530415 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.530577 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.530732 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.531645 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.531825 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.531978 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.532135 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.532277 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.532419 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.532567 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.532723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.532873 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.533024 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.533166 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.533321 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.533481 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.533624 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.533772 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.533923 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.534072 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.534213 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.534360 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.534499 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.534658 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.534818 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.534962 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.535099 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.535099 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.535356 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.535457 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.535549 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.535634 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.535718 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.535808 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.535899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.535991 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.536075 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.536305 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.536396 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.536623 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.536722 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.536936 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.537042 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.537251 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.537354 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.537562 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.537655 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.537870 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.538006 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.538728 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.538865 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.539048 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.539178 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.539540 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.539727 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.539887 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.540040 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.540200 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.540366 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.540515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.540669 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.541040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.541218 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.541675 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.541837 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.541940 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.542076 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.542076 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.542247 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.542464 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.542757 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.542885 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.543075 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.543273 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.543424 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.543531 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.543708 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.543811 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.544023 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.544126 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.544354 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.544476 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.544683 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.544790 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.544989 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.545093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.545303 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.545408 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.545612 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.545714 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.545921 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.546026 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.546230 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.546334 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.546541 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.546635 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.546849 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.546943 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.547177 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.547278 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.547484 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.547591 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.547793 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.547886 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.548101 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.548197 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.548430 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.548532 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.548744 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.548999 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.549109 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.549206 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.549354 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.549512 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.549660 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.549754 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.549998 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.550101 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.550311 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.550403 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.550669 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.550794 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.550980 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.551074 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.551323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.551420 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.551651 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.551773 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.551964 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.552058 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.552284 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.552377 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.552599 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.552690 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.552907 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.552997 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.553229 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.553336 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.553546 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.553646 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.554453 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.554651 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.554903 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.555007 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.555240 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.555408 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.555576 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.555734 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.555900 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.556057 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.556222 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.556381 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.556555 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.556706 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.556887 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.557028 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.557221 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.557349 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.557539 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.557711 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.557886 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.558042 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.558195 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.558354 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.558500 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.558644 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.558799 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.558967 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.559115 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.559323 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.559429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.559637 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.559804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.559958 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.560098 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.560268 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.560404 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.560583 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.560720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.560914 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.561064 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.561231 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.561374 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.561527 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.561692 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.561846 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.562060 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.562202 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.562397 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.562497 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.562722 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.562822 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.563046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.563146 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.563380 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.563475 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.563700 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.563800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.564012 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.564104 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.564359 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.564520 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.564676 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.564847 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.564995 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.565157 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.565316 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.565462 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.565606 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.565749 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.565950 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.566102 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.566281 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.566441 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.566593 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.566735 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.566885 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.567045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.567255 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.567362 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.567634 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.567785 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.567952 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.568111 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.568272 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.568459 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.568583 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.568799 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.568893 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.569139 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.569242 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.569503 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.569669 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.569876 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.570034 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.570137 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.570233 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.570426 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.570523 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.570755 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.570863 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.571065 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.571283 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.571418 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.571521 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.571843 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.572523 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.572652 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.572774 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.572887 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.573000 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.573120 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.573244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.573359 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.573480 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.573605 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.573737 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.573862 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.574016 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.574147 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.574261 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.574413 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.574541 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.574719 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.574851 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.575039 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.575185 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.575381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.575516 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.575713 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.575850 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.576138 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.576317 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.576440 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.576683 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.576827 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.576980 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.577259 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.577382 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.577607 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.577756 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.577987 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.578136 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.578416 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.578825 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.579148 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.579368 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.579493 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.579622 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.579737 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.579922 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.580052 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.580252 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.580484 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.580629 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.580736 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.580842 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.580931 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.581185 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.581385 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.581530 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.581632 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.581793 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.582322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.582486 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.582633 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.582786 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.582786 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.583142 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.583333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.583503 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.583615 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.583691 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.584314 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.584462 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.584644 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.584782 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.584964 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.585097 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.585372 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.585560 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.585843 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.585978 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.586300 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.586416 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.586679 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.586920 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.587077 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.587306 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.587435 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.587529 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.587960 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.588276 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.588408 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.588530 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.588731 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.588899 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.589020 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.589143 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.589278 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.589511 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.589850 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.590050 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.590266 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.590266 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.590534 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.591017 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.591258 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.591351 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.591441 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.591517 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.591732 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.591899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.591987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.592059 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.592193 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.592279 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.592470 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.592773 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.592870 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.593223 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.593425 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.593425 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.593620 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.593715 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.593942 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.594033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.594307 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.594415 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.594614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.595438 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.595438 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.595810 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.595918 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.596008 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.596138 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.596264 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.596460 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.596568 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.596645 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.596717 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.596798 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.596882 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.596955 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.597225 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.597328 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.597591 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.597721 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.597922 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.598030 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.598416 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.598520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.598595 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.598679 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.624051 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.624704 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.625022 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.625870 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.626463 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.627039 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.627495 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.627643 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.627795 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.627935 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.628397 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.628514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.628606 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.628709 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.628802 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.628900 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.629032 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.629125 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.629215 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.629290 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.629362 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.629638 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.629720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.629802 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.629863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.629863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.630354 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.630439 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.630497 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.630594 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.630594 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.630791 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.630915 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.630915 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.631035 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.631101 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.631199 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.631284 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.631349 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.631461 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.631536 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.631604 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.631604 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.631735 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.631826 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.631925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.632003 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.632143 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.632219 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.632278 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.632334 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.632389 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.632494 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.632494 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.632706 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.632767 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.632889 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.632954 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.633080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.633080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.633291 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.633291 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.633458 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.633458 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.633575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.633974 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.634083 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.634148 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.634264 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.634327 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.634397 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.634503 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.634759 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.634759 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.634927 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.634999 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.635112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.635213 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.635353 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.635601 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.635801 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.636646 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.638074 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.638194 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.638194 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.638429 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.638580 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.638766 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.638890 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.638997 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.640307 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.640460 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.640651 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.640848 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.641101 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.641380 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.641380 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.641380 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.641742 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.641742 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.641742 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.641742 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.641742 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.641742 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.641742 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.641742 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.642844 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.643001 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.643129 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.643129 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.643129 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.643129 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.643129 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.643129 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.643129 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.643129 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.644840 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.644840 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.644840 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.644840 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.645592 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.646461 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.646461 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.646737 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.646859 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.647041 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.647212 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.647352 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.647481 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.648184 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.648184 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.648481 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.648612 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.648795 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.648795 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.649088 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.649088 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.649350 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.649527 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.649663 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.649791 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.649918 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.650045 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.650182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.650182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.650422 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.650551 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.650678 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.650813 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.650941 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.650941 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.651210 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.651345 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.651473 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.651614 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.651742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.651870 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.651996 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.652124 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.652250 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.652250 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.652250 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.652250 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.652250 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.652250 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.652250 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.652250 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.653195 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.653195 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.653195 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.653195 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.653663 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.653792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.653919 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.654046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.654046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.654046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.654046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.654046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.654046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.654046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.654864 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.654864 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.659664 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.659733 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.659796 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.659855 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.659913 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.660030 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.660093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.660152 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.660232 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.660290 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.660552 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.660552 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.660683 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.660683 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.660786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.660786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.660886 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.660950 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.660950 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 10 11:37:08.661052 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.661052 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.661052 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.661052 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.661052 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.661052 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.661052 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.661052 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.661423 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.661423 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.661423 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.661423 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.661423 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.661423 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.661423 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.661423 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.661799 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.661799 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.661799 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.661799 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.661799 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.661799 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.661799 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.661799 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.662162 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.662162 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.662162 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.662162 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.662162 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.662162 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.662162 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.662162 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.662576 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.663904 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.664115 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.664665 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.665207 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.665591 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.665723 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.666073 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.666484 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.667103 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.667222 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.667898 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.668271 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.668431 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.668758 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.669210 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.669841 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.669979 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.670691 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.670777 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.671150 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.671686 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.672050 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.672353 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.672933 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.673302 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.673653 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.674123 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.674462 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.674798 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.675131 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.675649 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.676120 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.676582 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.676744 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.677079 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.677442 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.677810 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.678141 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.678480 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.678853 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.679201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.679598 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.679988 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.680333 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.680656 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.680977 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.681298 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.681623 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.682018 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.682349 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.682669 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.683106 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.683459 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.683780 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.684102 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.684422 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.684740 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.685060 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.685377 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.685694 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.686009 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.686325 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.686645 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.686951 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.687295 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.687619 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.687935 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.688278 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.688594 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.689004 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.689248 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.689594 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.689920 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.690252 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.690573 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.690970 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.695201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.695201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.695201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.695201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.695201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.695201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.695201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.695201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.696231 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.696231 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.696231 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.696231 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.696231 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.696231 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.696932 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.696932 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.696932 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.697308 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.697548 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.697870 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.698261 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.698528 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.698851 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.699188 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.699519 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.699839 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.700167 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.700489 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.700809 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.701138 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.701462 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.701799 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.702198 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.702528 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.702886 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.703536 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.703688 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.704014 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.704378 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.704720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.705049 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.705375 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.705820 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 10 11:37:08.705967 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 10 11:37:08.714016 n-d-856895-1 devstack@n-api.service[128777]: INFO dbcounter [None req-255e9b0d-d14f-436d-a136-50314ab6dc74 None None] Registered counter for database nova_api Sep 10 11:37:08.736152 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_db.sqlalchemy.engines [None req-255e9b0d-d14f-436d-a136-50314ab6dc74 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128777) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 11:37:08.743718 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writer thread running {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 11:37:08.771546 n-d-856895-1 devstack@n-api.service[128776]: INFO dbcounter [None req-702174e2-5e56-4d88-babe-b7efe45a63a6 None None] Registered counter for database nova_api Sep 10 11:37:08.793417 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_db.sqlalchemy.engines [None req-702174e2-5e56-4d88-babe-b7efe45a63a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128776) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 11:37:08.801180 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writer thread running {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 11:37:08.806976 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.context [None req-255e9b0d-d14f-436d-a136-50314ab6dc74 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d31511aa-3734-4d55-9c57-4a88c62d4dfd(cell1) {{(pid=128777) load_cells /opt/stack/nova/nova/context.py:464}} Sep 10 11:37:08.811067 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-255e9b0d-d14f-436d-a136-50314ab6dc74 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:08.811594 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-255e9b0d-d14f-436d-a136-50314ab6dc74 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:08.813187 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-255e9b0d-d14f-436d-a136-50314ab6dc74 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:08.813949 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-255e9b0d-d14f-436d-a136-50314ab6dc74 None None] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:08.814401 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-255e9b0d-d14f-436d-a136-50314ab6dc74 None None] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:08.816461 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-255e9b0d-d14f-436d-a136-50314ab6dc74 None None] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:08.818488 n-d-856895-1 devstack@n-api.service[128777]: INFO dbcounter [None req-255e9b0d-d14f-436d-a136-50314ab6dc74 None None] Registered counter for database nova_cell0 Sep 10 11:37:08.822870 n-d-856895-1 devstack@n-api.service[128777]: INFO dbcounter [None req-255e9b0d-d14f-436d-a136-50314ab6dc74 None None] Registered counter for database nova_cell1 Sep 10 11:37:08.830414 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_db.sqlalchemy.engines [None req-255e9b0d-d14f-436d-a136-50314ab6dc74 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128777) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 11:37:08.834195 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_db.sqlalchemy.engines [None req-255e9b0d-d14f-436d-a136-50314ab6dc74 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128777) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 11:37:08.841815 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writer thread running {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 11:37:08.843257 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writer thread running {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 11:37:08.862198 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.context [None req-702174e2-5e56-4d88-babe-b7efe45a63a6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d31511aa-3734-4d55-9c57-4a88c62d4dfd(cell1) {{(pid=128776) load_cells /opt/stack/nova/nova/context.py:464}} Sep 10 11:37:08.866202 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-702174e2-5e56-4d88-babe-b7efe45a63a6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:08.866873 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-702174e2-5e56-4d88-babe-b7efe45a63a6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:08.868557 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-702174e2-5e56-4d88-babe-b7efe45a63a6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:08.869294 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-702174e2-5e56-4d88-babe-b7efe45a63a6 None None] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:08.869742 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-702174e2-5e56-4d88-babe-b7efe45a63a6 None None] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:08.871768 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-702174e2-5e56-4d88-babe-b7efe45a63a6 None None] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:08.873778 n-d-856895-1 devstack@n-api.service[128776]: INFO dbcounter [None req-702174e2-5e56-4d88-babe-b7efe45a63a6 None None] Registered counter for database nova_cell0 Sep 10 11:37:08.877821 n-d-856895-1 devstack@n-api.service[128776]: INFO dbcounter [None req-702174e2-5e56-4d88-babe-b7efe45a63a6 None None] Registered counter for database nova_cell1 Sep 10 11:37:08.885050 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_db.sqlalchemy.engines [None req-702174e2-5e56-4d88-babe-b7efe45a63a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128776) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 11:37:08.887659 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_db.sqlalchemy.engines [None req-702174e2-5e56-4d88-babe-b7efe45a63a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128776) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 11:37:08.892368 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writer thread running {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 11:37:08.994145 n-d-856895-1 devstack@n-api.service[128777]: INFO dbcounter [None req-255e9b0d-d14f-436d-a136-50314ab6dc74 None None] Registered counter for database nova_cell0 Sep 10 11:37:09.002319 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_db.sqlalchemy.engines [None req-255e9b0d-d14f-436d-a136-50314ab6dc74 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128777) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 11:37:09.007502 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writer thread running {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 11:37:09.037665 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writer thread running {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 11:37:09.047117 n-d-856895-1 devstack@n-api.service[128776]: INFO dbcounter [None req-702174e2-5e56-4d88-babe-b7efe45a63a6 None None] Registered counter for database nova_cell0 Sep 10 11:37:09.054580 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_db.sqlalchemy.engines [None req-702174e2-5e56-4d88-babe-b7efe45a63a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128776) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 10 11:37:09.059423 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writer thread running {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 10 11:37:09.330752 n-d-856895-1 devstack@n-api.service[128777]: WARNING keystonemiddleware.auth_token [None req-255e9b0d-d14f-436d-a136-50314ab6dc74 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 10 11:37:09.339008 n-d-856895-1 devstack@n-api.service[128777]: WARNING keystonemiddleware.auth_token [None req-255e9b0d-d14f-436d-a136-50314ab6dc74 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 10 11:37:09.390238 n-d-856895-1 devstack@n-api.service[128776]: WARNING keystonemiddleware.auth_token [None req-702174e2-5e56-4d88-babe-b7efe45a63a6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 10 11:37:09.397643 n-d-856895-1 devstack@n-api.service[128776]: WARNING keystonemiddleware.auth_token [None req-702174e2-5e56-4d88-babe-b7efe45a63a6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 10 11:37:09.685733 n-d-856895-1 devstack@n-api.service[128777]: WARNING keystonemiddleware.auth_token [None req-255e9b0d-d14f-436d-a136-50314ab6dc74 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 10 11:37:09.691667 n-d-856895-1 devstack@n-api.service[128777]: WARNING keystonemiddleware.auth_token [None req-255e9b0d-d14f-436d-a136-50314ab6dc74 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 10 11:37:09.697564 n-d-856895-1 devstack@n-api.service[128777]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a2e17729c0 pid: 128777 (default app) Sep 10 11:37:09.747181 n-d-856895-1 devstack@n-api.service[128776]: WARNING keystonemiddleware.auth_token [None req-702174e2-5e56-4d88-babe-b7efe45a63a6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 10 11:37:09.753216 n-d-856895-1 devstack@n-api.service[128776]: WARNING keystonemiddleware.auth_token [None req-702174e2-5e56-4d88-babe-b7efe45a63a6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 10 11:37:09.759325 n-d-856895-1 devstack@n-api.service[128776]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a2e17729c0 pid: 128776 (default app) Sep 10 11:37:49.713180 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:37:49.714792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:37:49.715742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:37:49.716748 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:37:50.573793 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:37:50.575956 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:37:50.576999 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:37:50.577985 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:37:51.477268 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-62183ae4-e261-4d06-a538-3afca098905f tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1008160043", "id": 278925469, "os-flavor-access:is_public": "True"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:37:51.531338 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-62183ae4-e261-4d06-a538-3afca098905f tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 1.828919 Sep 10 11:37:51.532271 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1/1] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:37:49 2022] POST /compute/v2.1/flavors => generated 427 bytes in 1831 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:37:51.533288 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-62183ae4-e261-4d06-a538-3afca098905f tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:51.534177 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-62183ae4-e261-4d06-a538-3afca098905f tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001115 Sep 10 11:37:51.534495 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2/2] 10.222.0.23 () {56 vars in 886 bytes} [Sat Sep 10 11:37:51 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 10 11:37:51.926589 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-37783963-7e58-4658-a659-0831e5af7e97 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Calling method '.version_select at 0x7f4078cbc3a0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:51.934222 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-37783963-7e58-4658-a659-0831e5af7e97 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d31511aa-3734-4d55-9c57-4a88c62d4dfd(cell1) {{(pid=128776) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 10 11:37:51.934969 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-37783963-7e58-4658-a659-0831e5af7e97 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:51.935475 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-37783963-7e58-4658-a659-0831e5af7e97 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:51.935906 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-37783963-7e58-4658-a659-0831e5af7e97 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:51.975994 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-37783963-7e58-4658-a659-0831e5af7e97 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:51.976474 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-37783963-7e58-4658-a659-0831e5af7e97 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:51.977153 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-37783963-7e58-4658-a659-0831e5af7e97 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:51.992481 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-37783963-7e58-4658-a659-0831e5af7e97 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:51.993141 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-37783963-7e58-4658-a659-0831e5af7e97 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:51.993871 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-37783963-7e58-4658-a659-0831e5af7e97 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:52.003372 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-37783963-7e58-4658-a659-0831e5af7e97 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.450089 Sep 10 11:37:52.004769 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1/3] 10.222.0.23 () {58 vars in 1167 bytes} [Sat Sep 10 11:37:50 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:37:52.198620 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-57891293-cc7b-4c80-b421-6ff2d3e8319b tempest-AggregatesAdminTestV241-1609795554 tempest-AggregatesAdminTestV241-1609795554-project-admin] Calling method '.version_select at 0x7f4078cbcf70>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:52.213622 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-57891293-cc7b-4c80-b421-6ff2d3e8319b tempest-AggregatesAdminTestV241-1609795554 tempest-AggregatesAdminTestV241-1609795554-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d31511aa-3734-4d55-9c57-4a88c62d4dfd(cell1) {{(pid=128777) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 10 11:37:52.215653 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57891293-cc7b-4c80-b421-6ff2d3e8319b tempest-AggregatesAdminTestV241-1609795554 tempest-AggregatesAdminTestV241-1609795554-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:52.217878 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57891293-cc7b-4c80-b421-6ff2d3e8319b tempest-AggregatesAdminTestV241-1609795554 tempest-AggregatesAdminTestV241-1609795554-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:52.218480 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57891293-cc7b-4c80-b421-6ff2d3e8319b tempest-AggregatesAdminTestV241-1609795554 tempest-AggregatesAdminTestV241-1609795554-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:52.276894 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57891293-cc7b-4c80-b421-6ff2d3e8319b tempest-AggregatesAdminTestV241-1609795554 tempest-AggregatesAdminTestV241-1609795554-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:52.277385 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57891293-cc7b-4c80-b421-6ff2d3e8319b tempest-AggregatesAdminTestV241-1609795554 tempest-AggregatesAdminTestV241-1609795554-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:52.277811 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57891293-cc7b-4c80-b421-6ff2d3e8319b tempest-AggregatesAdminTestV241-1609795554 tempest-AggregatesAdminTestV241-1609795554-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:52.304211 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1a669159-c9f6-480a-b324-4729d4d518ac tempest-FlavorsV261TestJSON-1732655732 tempest-FlavorsV261TestJSON-1732655732-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-622141290", "id": 143694846, "os-flavor-access:is_public": "True"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:37:52.310764 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57891293-cc7b-4c80-b421-6ff2d3e8319b tempest-AggregatesAdminTestV241-1609795554 tempest-AggregatesAdminTestV241-1609795554-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:52.311633 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57891293-cc7b-4c80-b421-6ff2d3e8319b tempest-AggregatesAdminTestV241-1609795554 tempest-AggregatesAdminTestV241-1609795554-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:52.312209 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57891293-cc7b-4c80-b421-6ff2d3e8319b tempest-AggregatesAdminTestV241-1609795554 tempest-AggregatesAdminTestV241-1609795554-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:52.319565 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-57891293-cc7b-4c80-b421-6ff2d3e8319b tempest-AggregatesAdminTestV241-1609795554 tempest-AggregatesAdminTestV241-1609795554-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.783734 Sep 10 11:37:52.320316 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3/4] 10.222.0.23 () {60 vars in 1208 bytes} [Sat Sep 10 11:37:51 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:37:52.324817 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7d171dca-eb0d-42f0-b428-ab53c969d548 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:52.365231 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7d171dca-eb0d-42f0-b428-ab53c969d548 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/278925469" status: 202 len: 0 microversion: 2.1 time: 0.042979 Sep 10 11:37:52.369636 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 4/5] 10.222.0.23 () {58 vars in 1158 bytes} [Sat Sep 10 11:37:52 2022] DELETE /compute/v2.1/flavors/278925469 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:37:52.468649 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1a669159-c9f6-480a-b324-4729d4d518ac tempest-FlavorsV261TestJSON-1732655732 tempest-FlavorsV261TestJSON-1732655732-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.61 time: 0.460860 Sep 10 11:37:52.469239 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2/6] 10.222.0.23 () {62 vars in 1188 bytes} [Sat Sep 10 11:37:52 2022] POST /compute/v2.1/flavors => generated 464 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:37:52.495904 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2d9a2cbd-d60d-4d1e-a738-f613b5350ad0 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1670088845", "name": "tempest-test_aggregate-1562800094"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:37:52.544289 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.aggregate [None req-2d9a2cbd-d60d-4d1e-a738-f613b5350ad0 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Generated uuid 409df912-26fa-4caf-9093-3ff51c5b2666 for aggregate {{(pid=128776) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 11:37:52.679305 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2d9a2cbd-d60d-4d1e-a738-f613b5350ad0 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.196593 Sep 10 11:37:52.680439 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3/7] 10.222.0.23 () {60 vars in 1165 bytes} [Sat Sep 10 11:37:52 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:37:52.696672 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-17fcf468-f1a9-4bc8-96d4-edc125362289 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:52.761305 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9b9ba2c9-6030-4d38-a7d6-97107982a945 tempest-AZAdminV2TestJSON-722701539 tempest-AZAdminV2TestJSON-722701539-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:52.762962 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9b9ba2c9-6030-4d38-a7d6-97107982a945 tempest-AZAdminV2TestJSON-722701539 tempest-AZAdminV2TestJSON-722701539-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:52.763577 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9b9ba2c9-6030-4d38-a7d6-97107982a945 tempest-AZAdminV2TestJSON-722701539 tempest-AZAdminV2TestJSON-722701539-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:52.764038 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9b9ba2c9-6030-4d38-a7d6-97107982a945 tempest-AZAdminV2TestJSON-722701539 tempest-AZAdminV2TestJSON-722701539-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:52.765119 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9b9ba2c9-6030-4d38-a7d6-97107982a945 tempest-AZAdminV2TestJSON-722701539 tempest-AZAdminV2TestJSON-722701539-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:52.765565 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9b9ba2c9-6030-4d38-a7d6-97107982a945 tempest-AZAdminV2TestJSON-722701539 tempest-AZAdminV2TestJSON-722701539-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:52.765981 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9b9ba2c9-6030-4d38-a7d6-97107982a945 tempest-AZAdminV2TestJSON-722701539 tempest-AZAdminV2TestJSON-722701539-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:52.772723 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-17fcf468-f1a9-4bc8-96d4-edc125362289 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.091053 Sep 10 11:37:52.773890 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:37:52 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:37:52.857733 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9b9ba2c9-6030-4d38-a7d6-97107982a945 tempest-AZAdminV2TestJSON-722701539 tempest-AZAdminV2TestJSON-722701539-project-admin] 10.222.0.23 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.486491 Sep 10 11:37:52.860715 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 5/9] 10.222.0.23 () {58 vars in 1164 bytes} [Sat Sep 10 11:37:52 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:37:52.873686 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0595f8d0-0473-401c-b239-df5b85e1e913 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:52.899865 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0595f8d0-0473-401c-b239-df5b85e1e913 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.036453 Sep 10 11:37:52.902054 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 6/10] 10.222.0.23 () {58 vars in 1143 bytes} [Sat Sep 10 11:37:52 2022] GET /compute/v2.1/os-aggregates => generated 303 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:37:52.915576 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2939d2e5-ed1f-480c-b02b-6630a3f95ef6 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1665005662", "id": 1089546880, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:37:52.939828 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2939d2e5-ed1f-480c-b02b-6630a3f95ef6 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.034682 Sep 10 11:37:52.941557 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 7/11] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:37:52 2022] POST /compute/v2.1/flavors => generated 417 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:37:52.947233 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a441970a-bd02-4e3d-b478-73578381558f tempest-AZAdminV2TestJSON-722701539 tempest-AZAdminV2TestJSON-722701539-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:52.951390 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a441970a-bd02-4e3d-b478-73578381558f tempest-AZAdminV2TestJSON-722701539 tempest-AZAdminV2TestJSON-722701539-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:52.952466 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a441970a-bd02-4e3d-b478-73578381558f tempest-AZAdminV2TestJSON-722701539 tempest-AZAdminV2TestJSON-722701539-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:52.953259 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a441970a-bd02-4e3d-b478-73578381558f tempest-AZAdminV2TestJSON-722701539 tempest-AZAdminV2TestJSON-722701539-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:52.954429 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a441970a-bd02-4e3d-b478-73578381558f tempest-AZAdminV2TestJSON-722701539 tempest-AZAdminV2TestJSON-722701539-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:52.955086 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a441970a-bd02-4e3d-b478-73578381558f tempest-AZAdminV2TestJSON-722701539 tempest-AZAdminV2TestJSON-722701539-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:52.955742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a441970a-bd02-4e3d-b478-73578381558f tempest-AZAdminV2TestJSON-722701539 tempest-AZAdminV2TestJSON-722701539-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:52.993977 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a441970a-bd02-4e3d-b478-73578381558f tempest-AZAdminV2TestJSON-722701539 tempest-AZAdminV2TestJSON-722701539-project-admin] 10.222.0.23 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.050949 Sep 10 11:37:52.995267 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 8/12] 10.222.0.23 () {58 vars in 1185 bytes} [Sat Sep 10 11:37:52 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:37:53.015963 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c6306e38-62a4-4ef2-89b0-9e5052ce1aa5 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-856895-1"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:37:53.095606 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c6306e38-62a4-4ef2-89b0-9e5052ce1aa5 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:53.096148 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c6306e38-62a4-4ef2-89b0-9e5052ce1aa5 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:53.097793 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c6306e38-62a4-4ef2-89b0-9e5052ce1aa5 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:53.152188 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-18a918ab-ac49-470a-9f9a-7b474c48ef32 tempest-FlavorsV261TestJSON-1106007318 tempest-FlavorsV261TestJSON-1106007318-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:53.195611 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-18a918ab-ac49-470a-9f9a-7b474c48ef32 tempest-FlavorsV261TestJSON-1106007318 tempest-FlavorsV261TestJSON-1106007318-project] 10.222.0.23 "GET /compute/v2.1/flavors/143694846" status: 200 len: 464 microversion: 2.61 time: 0.419904 Sep 10 11:37:53.197973 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 5/13] 10.222.0.23 () {60 vars in 1196 bytes} [Sat Sep 10 11:37:52 2022] GET /compute/v2.1/flavors/143694846 => generated 464 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:37:53.206169 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-870cd107-f08b-4ba3-ba8e-ef63449f2837 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:53.264005 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-870cd107-f08b-4ba3-ba8e-ef63449f2837 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.062852 Sep 10 11:37:53.267845 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 6/14] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:37:53 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:37:53.284562 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a9c0d4b0-8ed0-4e6f-9128-adc4d3e49197 tempest-FlavorsV261TestJSON-1732655732 tempest-FlavorsV261TestJSON-1732655732-project-admin] Action: 'update', calling method: .version_select at 0x7f4079076b80>, body: {"flavor": {"description": "new"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:37:53.365110 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a9c0d4b0-8ed0-4e6f-9128-adc4d3e49197 tempest-FlavorsV261TestJSON-1732655732 tempest-FlavorsV261TestJSON-1732655732-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/143694846" status: 200 len: 465 microversion: 2.61 time: 0.094759 Sep 10 11:37:53.366628 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 7/15] 10.222.0.23 () {62 vars in 1216 bytes} [Sat Sep 10 11:37:53 2022] PUT /compute/v2.1/flavors/143694846 => generated 465 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:37:53.387063 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-081394c5-bd72-4c53-abbb-55539558af8e tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:53.446655 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-081394c5-bd72-4c53-abbb-55539558af8e tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1089546880" status: 202 len: 0 microversion: 2.1 time: 0.078894 Sep 10 11:37:53.447258 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 8/16] 10.222.0.23 () {58 vars in 1161 bytes} [Sat Sep 10 11:37:53 2022] DELETE /compute/v2.1/flavors/1089546880 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:37:53.456170 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6920398e-07c1-49e2-bc65-9fcba5a55334 tempest-FlavorsV261TestJSON-1106007318 tempest-FlavorsV261TestJSON-1106007318-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:53.524532 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6920398e-07c1-49e2-bc65-9fcba5a55334 tempest-FlavorsV261TestJSON-1106007318 tempest-FlavorsV261TestJSON-1106007318-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6246 microversion: 2.61 time: 0.075694 Sep 10 11:37:53.535989 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 9/17] 10.222.0.23 () {60 vars in 1187 bytes} [Sat Sep 10 11:37:53 2022] GET /compute/v2.1/flavors/detail => generated 6246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:37:53.550867 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9ddf80ad-04c6-48e8-b867-a093ddf0f9e9 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:53.579650 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9ddf80ad-04c6-48e8-b867-a093ddf0f9e9 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.034353 Sep 10 11:37:53.581194 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 10/18] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:37:53 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:37:53.597715 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e2f5b2aa-c90d-42c0-9f9e-4bfbdb0296da tempest-FlavorsV261TestJSON-1106007318 tempest-FlavorsV261TestJSON-1106007318-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:53.654997 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e2f5b2aa-c90d-42c0-9f9e-4bfbdb0296da tempest-FlavorsV261TestJSON-1106007318 tempest-FlavorsV261TestJSON-1106007318-project] 10.222.0.23 "GET /compute/v2.1/flavors" status: 200 len: 3153 microversion: 2.61 time: 0.071880 Sep 10 11:37:53.658093 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 11/19] 10.222.0.23 () {60 vars in 1166 bytes} [Sat Sep 10 11:37:53 2022] GET /compute/v2.1/flavors => generated 3153 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:37:53.677702 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-612111e6-dee4-4643-bce0-d2b55106310a tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2098829927", "id": 723440646, "os-flavor-access:is_public": "True"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:37:53.703969 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-612111e6-dee4-4643-bce0-d2b55106310a tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.031710 Sep 10 11:37:53.706117 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 12/20] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:37:53 2022] POST /compute/v2.1/flavors => generated 426 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:37:53.713208 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-325e85ae-8841-46b6-8c15-b2ca66dc9835 tempest-FlavorsV261TestJSON-1732655732 tempest-FlavorsV261TestJSON-1732655732-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:53.737661 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-325e85ae-8841-46b6-8c15-b2ca66dc9835 tempest-FlavorsV261TestJSON-1732655732 tempest-FlavorsV261TestJSON-1732655732-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/143694846" status: 202 len: 0 microversion: 2.61 time: 0.029917 Sep 10 11:37:53.744736 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 13/21] 10.222.0.23 () {60 vars in 1199 bytes} [Sat Sep 10 11:37:53 2022] DELETE /compute/v2.1/flavors/143694846 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:37:53.751041 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ba10195c-0b3c-4510-b5ef-444e86dcfa5d tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:53.781841 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ba10195c-0b3c-4510-b5ef-444e86dcfa5d tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/723440646" status: 202 len: 0 microversion: 2.1 time: 0.035371 Sep 10 11:37:53.782714 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 14/22] 10.222.0.23 () {58 vars in 1158 bytes} [Sat Sep 10 11:37:53 2022] DELETE /compute/v2.1/flavors/723440646 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:37:53.793094 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-61f48d7b-8626-4055-9bc6-6d1d56d491ba tempest-FlavorsV261TestJSON-1732655732 tempest-FlavorsV261TestJSON-1732655732-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:53.860180 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-61f48d7b-8626-4055-9bc6-6d1d56d491ba tempest-FlavorsV261TestJSON-1732655732 tempest-FlavorsV261TestJSON-1732655732-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.073895 Sep 10 11:37:53.861484 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 15/23] 10.222.0.23 () {60 vars in 1187 bytes} [Sat Sep 10 11:37:53 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:37:53.884122 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5801a760-14ac-47d3-a9fe-8d07a994a50d tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:53.916050 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5801a760-14ac-47d3-a9fe-8d07a994a50d tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051848 Sep 10 11:37:53.918581 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 16/24] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:37:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:37:53.939558 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-47e43a52-9f86-4880-acbf-a7324da13c0b tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1309220852", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:37:53.968868 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-47e43a52-9f86-4880-acbf-a7324da13c0b tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.032840 Sep 10 11:37:53.970398 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 17/25] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:37:53 2022] POST /compute/v2.1/flavors => generated 507 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:37:53.984652 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6542d5cb-c3bb-41b7-b999-acbfff56deeb tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:54.013752 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6542d5cb-c3bb-41b7-b999-acbfff56deeb tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/f70462c4-9de6-43f2-ac96-ac6c0e0aab86" status: 202 len: 0 microversion: 2.1 time: 0.033986 Sep 10 11:37:54.015740 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 18/26] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:37:53 2022] DELETE /compute/v2.1/flavors/f70462c4-9de6-43f2-ac96-ac6c0e0aab86 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:37:54.025430 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fa806deb-5aa0-4740-b06a-d690719f8c06 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:54.065931 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fa806deb-5aa0-4740-b06a-d690719f8c06 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046564 Sep 10 11:37:54.066871 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 19/27] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:37:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:37:54.088969 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-32f2f395-4948-46dc-b128-8deb33db67cf tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1349742020", "id": "78b4bd0e-4bdd-4f05-abd4-78f95d3b401c", "os-flavor-access:is_public": "True"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:37:54.117544 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-32f2f395-4948-46dc-b128-8deb33db67cf tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.032277 Sep 10 11:37:54.118152 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 20/28] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:37:54 2022] POST /compute/v2.1/flavors => generated 507 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:37:54.138800 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8035bc63-4400-404d-9c9a-0cd3e61390cd tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:54.179278 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8035bc63-4400-404d-9c9a-0cd3e61390cd tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/78b4bd0e-4bdd-4f05-abd4-78f95d3b401c" status: 202 len: 0 microversion: 2.1 time: 0.046286 Sep 10 11:37:54.179909 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 21/29] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:37:54 2022] DELETE /compute/v2.1/flavors/78b4bd0e-4bdd-4f05-abd4-78f95d3b401c => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:37:54.189803 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d4c483bd-97a4-4626-be3f-5c4d65bcd1aa tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:54.240648 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d4c483bd-97a4-4626-be3f-5c4d65bcd1aa tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056167 Sep 10 11:37:54.259757 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 22/30] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:37:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:37:54.285275 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f90a99fe-4b3b-499c-a5d8-0af797046428 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1973802366", "id": 1242641277, "os-flavor-access:is_public": "True"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:37:54.372233 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f90a99fe-4b3b-499c-a5d8-0af797046428 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.106151 Sep 10 11:37:54.381730 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 23/31] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:37:54 2022] POST /compute/v2.1/flavors => generated 414 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:37:54.391998 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8c89eeff-d02f-426e-9ebc-ae5029a4fb63 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:54.408151 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8c89eeff-d02f-426e-9ebc-ae5029a4fb63 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/1242641277" status: 200 len: 414 microversion: 2.1 time: 0.024630 Sep 10 11:37:54.408842 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c6306e38-62a4-4ef2-89b0-9e5052ce1aa5 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 315 microversion: 2.1 time: 1.409843 Sep 10 11:37:54.411402 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 9/32] 10.222.0.23 () {60 vars in 1191 bytes} [Sat Sep 10 11:37:52 2022] POST /compute/v2.1/os-aggregates/1/action => generated 315 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:37:54.427865 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 24/33] 10.222.0.23 () {58 vars in 1158 bytes} [Sat Sep 10 11:37:54 2022] GET /compute/v2.1/flavors/1242641277 => generated 414 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:37:55.297444 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a02cc319-5758-4741-b674-e9d31c4e4479 tempest-FlavorsAdminTestJSON-677186644 tempest-FlavorsAdminTestJSON-677186644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:55.390486 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a02cc319-5758-4741-b674-e9d31c4e4479 tempest-FlavorsAdminTestJSON-677186644 tempest-FlavorsAdminTestJSON-677186644-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.956214 Sep 10 11:37:55.391201 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 10/34] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:37:54 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:37:55.412137 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d8775c13-0b46-4dbb-a004-5e8c47be6cbd tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:55.450079 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d8775c13-0b46-4dbb-a004-5e8c47be6cbd tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1242641277" status: 202 len: 0 microversion: 2.1 time: 0.042262 Sep 10 11:37:55.457212 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 11/35] 10.222.0.23 () {58 vars in 1161 bytes} [Sat Sep 10 11:37:55 2022] DELETE /compute/v2.1/flavors/1242641277 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 11:37:55.472136 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-80ca2ed5-d859-4127-b358-9c9e6e01e667 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:55.517875 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-80ca2ed5-d859-4127-b358-9c9e6e01e667 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053553 Sep 10 11:37:55.519152 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 12/36] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:37:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:37:55.539575 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-790ec158-e025-43ea-9ebd-22da46f4660b tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1480619538", "id": 1622810095, "os-flavor-access:is_public": "False"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:37:55.568399 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-790ec158-e025-43ea-9ebd-22da46f4660b tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.032475 Sep 10 11:37:55.570373 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 13/37] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:37:55 2022] POST /compute/v2.1/flavors => generated 430 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:37:55.586126 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1b87b4f1-c4f1-4fef-b349-de0f85e5c8bf tempest-FlavorsAdminTestJSON-677186644 tempest-FlavorsAdminTestJSON-677186644-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "1622810095"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:37:55.607511 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-1b87b4f1-c4f1-4fef-b349-de0f85e5c8bf tempest-FlavorsAdminTestJSON-677186644 tempest-FlavorsAdminTestJSON-677186644-project] HTTP exception thrown: Flavor 1622810095 could not be found. Sep 10 11:37:55.611721 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1b87b4f1-c4f1-4fef-b349-de0f85e5c8bf tempest-FlavorsAdminTestJSON-677186644 tempest-FlavorsAdminTestJSON-677186644-project] Request method failure captured: Sep 10 11:37:55.611721 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 11:37:55.611721 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:37:55.611721 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:37:55.611721 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:37:55.611721 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 107 Sep 10 11:37:55.611721 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:37:55.611721 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:37:55.611721 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:37:55.611721 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:37:55.611721 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHcLALyGHiphDutzlu33iap-NYGnWNDr_YK2sJi3BxmkNIW-4WWTmVou-cHxYxrvksJoYCcNfWxxcLxTTlkmkdlrs_AdcUZHPqGuuUdNdCUOjyAGi5qMQeFgPDPmFoY99S9nAKq7u2f03IaLPpFrAEmGWCcWAJgMtIFeZs_D9GiIBFI Sep 10 11:37:55.611721 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:37:55.611721 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:37:55.611721 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:37:55.611721 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:37:55.611721 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:37:55.611721 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:37:55.611721 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 81bfdd792de84db1bbbed7c42a281f9c Sep 10 11:37:55.611721 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-FlavorsAdminTestJSON-677186644 Sep 10 11:37:55.611721 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:37:55.611721 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:37:55.613566 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/81bfdd792de84db1bbbed7c42a281f9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/81bfdd792de84db1bbbed7c42a281f9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_81bfdd792de84db1bbbed7c42a281f9c", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/81bfdd792de84db1bbbed7c42a281f9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:37:55.613566 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-FlavorsAdminTestJSON-677186644 Sep 10 11:37:55.613566 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 81bfdd792de84db1bbbed7c42a281f9c Sep 10 11:37:55.613566 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-677186644 Sep 10 11:37:55.613566 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-FlavorsAdminTestJSON-677186644-project Sep 10 11:37:55.613566 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:37:55.613566 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:37:55.613566 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 3645a4006924478cb74fc1a0b43973e5 Sep 10 11:37:55.613566 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-FlavorsAdminTestJSON-677186644-project Sep 10 11:37:55.613566 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:37:55.613566 n-d-856895-1 devstack@n-api.service[128777]: {"server": {"name": "test", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "1622810095"}} Sep 10 11:37:55.613566 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:37:55.613566 n-d-856895-1 devstack@n-api.service[128777]: exception: Flavor 1622810095 could not be found. Sep 10 11:37:55.614238 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'c23d4d62-7ab9-4623-9273-7f44582aa2e1', 'flavorRef': '1622810095'}}} Sep 10 11:37:55.614238 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:37:55.614238 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:37:55.614238 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 10 11:37:55.614238 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 10 11:37:55.614238 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 10 11:37:55.614238 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 10 11:37:55.614238 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 11:37:55.614238 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 11:37:55.614238 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 10 11:37:55.614238 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 10 11:37:55.614238 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 10 11:37:55.614238 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:37:55.614238 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 10 11:37:55.614238 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 10 11:37:55.614238 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1622810095 could not be found. Sep 10 11:37:55.614238 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:37:55.614238 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:37:55.614238 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:37:55.614238 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:37:55.616317 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:37:55.616317 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:37:55.616317 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:37:55.616317 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:37:55.616317 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:37:55.616317 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:37:55.616317 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:37:55.616317 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:37:55.616317 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:37:55.616317 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:37:55.616317 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:37:55.616317 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:37:55.616317 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 10 11:37:55.616317 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 10 11:37:55.616317 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 10 11:37:55.616317 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1622810095 could not be found. Sep 10 11:37:55.616317 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:37:55.616317 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:37:55.616317 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:37:55.616317 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:37:55.616317 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:37:55.617527 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:37:55.617527 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:37:55.617527 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:37:55.617527 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1622810095 could not be found. Sep 10 11:37:55.617527 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:37:55.619277 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1b87b4f1-c4f1-4fef-b349-de0f85e5c8bf tempest-FlavorsAdminTestJSON-677186644 tempest-FlavorsAdminTestJSON-677186644-project] Returning 400 to user: Flavor 1622810095 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:37:55.620422 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1b87b4f1-c4f1-4fef-b349-de0f85e5c8bf tempest-FlavorsAdminTestJSON-677186644 tempest-FlavorsAdminTestJSON-677186644-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.042014 Sep 10 11:37:55.621522 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 14/38] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:37:55 2022] POST /compute/v2.1/servers => generated 81 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Sep 10 11:37:55.633830 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-881a509e-d21f-469b-9798-deb3d318c500 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:55.663326 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-881a509e-d21f-469b-9798-deb3d318c500 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1622810095" status: 202 len: 0 microversion: 2.1 time: 0.037824 Sep 10 11:37:55.663914 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 15/39] 10.222.0.23 () {58 vars in 1161 bytes} [Sat Sep 10 11:37:55 2022] DELETE /compute/v2.1/flavors/1622810095 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 11:37:55.674541 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-91e8e5ff-9f09-4c40-8192-d38c752fe1ab tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:55.680648 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a13ecefc-3686-496b-a50d-4d667541599d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-256052528", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "availability_zone": "tempest-test_az-1670088845"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:37:55.719990 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a13ecefc-3686-496b-a50d-4d667541599d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:55.721710 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-91e8e5ff-9f09-4c40-8192-d38c752fe1ab tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053363 Sep 10 11:37:55.722006 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a13ecefc-3686-496b-a50d-4d667541599d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:55.722832 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a13ecefc-3686-496b-a50d-4d667541599d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:55.725923 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 16/40] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:37:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:37:55.728097 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a13ecefc-3686-496b-a50d-4d667541599d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:55.728587 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a13ecefc-3686-496b-a50d-4d667541599d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:55.729292 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a13ecefc-3686-496b-a50d-4d667541599d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:55.729917 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=15 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:37:55.747353 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e5e46660-084e-439e-9a02-7f9a1fd06137 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-492088055", "id": 262103795, "os-flavor-access:is_public": "False"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:37:55.799623 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e5e46660-084e-439e-9a02-7f9a1fd06137 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.056721 Sep 10 11:37:55.803360 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 17/41] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:37:55 2022] POST /compute/v2.1/flavors => generated 411 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:37:55.822046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a14df524-ba9a-4a97-9030-32413830b51f tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-85008834", "id": 1204087189, "os-flavor-access:is_public": "True"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:37:55.850341 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a14df524-ba9a-4a97-9030-32413830b51f tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.039082 Sep 10 11:37:55.860008 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 18/42] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:37:55 2022] POST /compute/v2.1/flavors => generated 412 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:37:55.869182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0e86c74d-2877-4902-890f-db776797f450 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:55.914424 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0e86c74d-2877-4902-890f-db776797f450 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 414 microversion: 2.1 time: 0.052948 Sep 10 11:37:55.923488 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 19/43] 10.222.0.23 () {58 vars in 1169 bytes} [Sat Sep 10 11:37:55 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 414 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:37:55.934181 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2a4b6010-a1f2-4791-a995-a32507c156f0 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:55.947611 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2a4b6010-a1f2-4791-a995-a32507c156f0 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 414 microversion: 2.1 time: 0.016419 Sep 10 11:37:55.948517 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 20/44] 10.222.0.23 () {58 vars in 1177 bytes} [Sat Sep 10 11:37:55 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 414 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:37:55.964134 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4e4b998a-d5cc-468b-a29f-626e0c91cb7c tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:55.980262 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4e4b998a-d5cc-468b-a29f-626e0c91cb7c tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 414 microversion: 2.1 time: 0.021002 Sep 10 11:37:55.988399 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 21/45] 10.222.0.23 () {58 vars in 1171 bytes} [Sat Sep 10 11:37:55 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 414 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:37:56.002451 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3c072848-1efa-4aea-a027-e160c260f2da tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:56.028041 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3c072848-1efa-4aea-a027-e160c260f2da tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 414 microversion: 2.1 time: 0.036671 Sep 10 11:37:56.030050 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 22/46] 10.222.0.23 () {58 vars in 1169 bytes} [Sat Sep 10 11:37:55 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 414 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:37:56.043080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-98527000-9a43-4769-b8b0-2431d5f5359f tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:56.069470 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-98527000-9a43-4769-b8b0-2431d5f5359f tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5393 microversion: 2.1 time: 0.029670 Sep 10 11:37:56.076803 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 23/47] 10.222.0.23 () {58 vars in 1169 bytes} [Sat Sep 10 11:37:56 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5393 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:37:56.091741 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-faafc542-6b47-4490-bbe1-077e55856ca3 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:56.127536 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-faafc542-6b47-4490-bbe1-077e55856ca3 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5393 microversion: 2.1 time: 0.040769 Sep 10 11:37:56.127724 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 24/48] 10.222.0.23 () {58 vars in 1175 bytes} [Sat Sep 10 11:37:56 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5393 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:37:56.147447 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b6f4c9b2-4477-4bc6-bfc8-bc41770d63c0 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:56.177888 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b6f4c9b2-4477-4bc6-bfc8-bc41770d63c0 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5393 microversion: 2.1 time: 0.034338 Sep 10 11:37:56.178726 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 25/49] 10.222.0.23 () {58 vars in 1173 bytes} [Sat Sep 10 11:37:56 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5393 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:37:56.200312 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1a21bdd1-dc85-4b8c-9cac-f87dad4bc6b5 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:56.246739 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1a21bdd1-dc85-4b8c-9cac-f87dad4bc6b5 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5393 microversion: 2.1 time: 0.051273 Sep 10 11:37:56.248174 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 26/50] 10.222.0.23 () {58 vars in 1169 bytes} [Sat Sep 10 11:37:56 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5393 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:37:56.271801 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-04a1629e-6252-4c5e-b052-bde12bc7641d tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:56.309948 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-04a1629e-6252-4c5e-b052-bde12bc7641d tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1204087189" status: 202 len: 0 microversion: 2.1 time: 0.046278 Sep 10 11:37:56.311083 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 27/51] 10.222.0.23 () {58 vars in 1161 bytes} [Sat Sep 10 11:37:56 2022] DELETE /compute/v2.1/flavors/1204087189 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:37:56.318800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-73d83be0-d9af-4c41-a84f-08fd10ab48c6 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:56.325080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6,nova_api:DELETE=12 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:37:56.339972 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-73d83be0-d9af-4c41-a84f-08fd10ab48c6 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024949 Sep 10 11:37:56.341176 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 28/52] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:37:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:37:56.359913 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6ed41e30-94b7-42a0-a450-0bce003bb4aa tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:56.379075 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6ed41e30-94b7-42a0-a450-0bce003bb4aa tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/262103795" status: 202 len: 0 microversion: 2.1 time: 0.022728 Sep 10 11:37:56.380847 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 29/53] 10.222.0.23 () {58 vars in 1158 bytes} [Sat Sep 10 11:37:56 2022] DELETE /compute/v2.1/flavors/262103795 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 11:37:56.388019 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7b00dc8a-6cd3-4354-b1cb-193af70f9ea1 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:56.425131 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7b00dc8a-6cd3-4354-b1cb-193af70f9ea1 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040415 Sep 10 11:37:56.425730 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 30/54] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:37:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:37:56.448840 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ba253502-d72f-4a69-90c2-8292825ed399 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-431359989", "id": 397349808, "os-flavor-access:is_public": "False"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:37:56.474400 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ba253502-d72f-4a69-90c2-8292825ed399 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.030081 Sep 10 11:37:56.486939 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 31/55] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:37:56 2022] POST /compute/v2.1/flavors => generated 411 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:37:56.492563 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-94b5515c-3ce7-4bd1-934d-d85cdc22eb75 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:56.513993 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-94b5515c-3ce7-4bd1-934d-d85cdc22eb75 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025809 Sep 10 11:37:56.514861 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 32/56] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:37:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:37:56.534023 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6e485e8a-a88d-42fa-8e80-51d81d1375f0 tempest-FlavorsAdminTestJSON-677186644 tempest-FlavorsAdminTestJSON-677186644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:56.559766 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6e485e8a-a88d-42fa-8e80-51d81d1375f0 tempest-FlavorsAdminTestJSON-677186644 tempest-FlavorsAdminTestJSON-677186644-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029955 Sep 10 11:37:56.571391 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 33/57] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:37:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:37:56.581131 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f3389139-19b2-407d-8144-94641209a41b tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:56.602704 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f3389139-19b2-407d-8144-94641209a41b tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/397349808" status: 202 len: 0 microversion: 2.1 time: 0.025033 Sep 10 11:37:56.603674 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 34/58] 10.222.0.23 () {58 vars in 1158 bytes} [Sat Sep 10 11:37:56 2022] DELETE /compute/v2.1/flavors/397349808 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 11:37:56.612040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b56944a3-b449-4bb8-ad11-20fdd1502259 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:56.634135 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b56944a3-b449-4bb8-ad11-20fdd1502259 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025796 Sep 10 11:37:56.650770 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 35/59] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:37:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:37:56.658545 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5e134972-9017-4353-8e09-a0a07f5197b1 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1163500335", "id": 625752246, "os-flavor-access:is_public": "True"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:37:56.687119 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5e134972-9017-4353-8e09-a0a07f5197b1 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.035091 Sep 10 11:37:56.689305 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 36/60] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:37:56 2022] POST /compute/v2.1/flavors => generated 411 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:37:56.701593 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fe30d1b1-25e6-43ce-8135-796d742b516c tempest-FlavorsAdminTestJSON-677186644 tempest-FlavorsAdminTestJSON-677186644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:56.729205 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fe30d1b1-25e6-43ce-8135-796d742b516c tempest-FlavorsAdminTestJSON-677186644 tempest-FlavorsAdminTestJSON-677186644-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.031580 Sep 10 11:37:56.743387 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 37/61] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:37:56 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:37:57.090477 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-a13ecefc-3686-496b-a50d-4d667541599d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] validate_networks() for None {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:37:57.193204 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5ed9ae76-4f45-4282-8ba1-735215a09422 tempest-FlavorsAccessTestJSON-514719538 tempest-FlavorsAccessTestJSON-514719538-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-395405612", "id": 1089481335, "os-flavor-access:is_public": "False"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:37:57.225578 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5ed9ae76-4f45-4282-8ba1-735215a09422 tempest-FlavorsAccessTestJSON-514719538 tempest-FlavorsAccessTestJSON-514719538-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.480668 Sep 10 11:37:57.226329 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 38/62] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:37:56 2022] POST /compute/v2.1/flavors => generated 430 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:37:57.240196 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-df67d170-1800-4097-ab4f-653c0b18b7e2 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:57.275579 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-df67d170-1800-4097-ab4f-653c0b18b7e2 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/625752246" status: 202 len: 0 microversion: 2.1 time: 0.048187 Sep 10 11:37:57.276430 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 39/63] 10.222.0.23 () {58 vars in 1158 bytes} [Sat Sep 10 11:37:57 2022] DELETE /compute/v2.1/flavors/625752246 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:37:57.283262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-abbf9bec-09ca-4275-9b4f-6d93f9ec577f tempest-FlavorsAccessTestJSON-514719538 tempest-FlavorsAccessTestJSON-514719538-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4bfbcb77d7e74786993eeb9568d7f0b5"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:37:57.437677 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-a13ecefc-3686-496b-a50d-4d667541599d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:37:57.438105 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-a13ecefc-3686-496b-a50d-4d667541599d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:37:57.438576 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-a13ecefc-3686-496b-a50d-4d667541599d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:37:57.438987 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-a13ecefc-3686-496b-a50d-4d667541599d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:37:57.439603 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-a13ecefc-3686-496b-a50d-4d667541599d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:37:57.454870 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a13ecefc-3686-496b-a50d-4d667541599d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:57.455654 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a13ecefc-3686-496b-a50d-4d667541599d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:57.456340 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a13ecefc-3686-496b-a50d-4d667541599d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:57.457435 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a13ecefc-3686-496b-a50d-4d667541599d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:37:57.458044 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a13ecefc-3686-496b-a50d-4d667541599d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:37:57.460164 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a13ecefc-3686-496b-a50d-4d667541599d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:37:57.508163 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-a13ecefc-3686-496b-a50d-4d667541599d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Getting quotas for project a8943799e9af4699bcfd87690773282e. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:37:57.515734 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-a13ecefc-3686-496b-a50d-4d667541599d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Getting quotas for user ce70607350b14ce98add3c72ed36c9c4 and project a8943799e9af4699bcfd87690773282e. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:37:57.531560 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a13ecefc-3686-496b-a50d-4d667541599d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:37:57.534553 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a13ecefc-3686-496b-a50d-4d667541599d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] [instance: b33b0f22-808a-483c-9683-a16f98eccfa6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:37:57.642428 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a13ecefc-3686-496b-a50d-4d667541599d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.643322 Sep 10 11:37:57.647812 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 25/64] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:37:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:37:57.653521 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ef0bce2c-2475-4e0e-bc8c-492a770d0c11 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:57.717486 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ef0bce2c-2475-4e0e-bc8c-492a770d0c11 tempest-FlavorsAdminTestJSON-985894452 tempest-FlavorsAdminTestJSON-985894452-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.067294 Sep 10 11:37:57.723330 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 26/65] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:37:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:37:57.730899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e09ab750-b4b4-4b4a-9d29-3da9350e6a45 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:57.735908 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e09ab750-b4b4-4b4a-9d29-3da9350e6a45 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] [instance: b33b0f22-808a-483c-9683-a16f98eccfa6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:37:57.844363 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e09ab750-b4b4-4b4a-9d29-3da9350e6a45 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce70607350b14ce98add3c72ed36c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8943799e9af4699bcfd87690773282e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:37:57.858750 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e09ab750-b4b4-4b4a-9d29-3da9350e6a45 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] 10.222.0.23 "GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6" status: 200 len: 1242 microversion: 2.1 time: 0.133991 Sep 10 11:37:57.859378 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 27/66] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:37:57 2022] GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6 => generated 1242 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:37:58.020527 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-abbf9bec-09ca-4275-9b4f-6d93f9ec577f tempest-FlavorsAccessTestJSON-514719538 tempest-FlavorsAccessTestJSON-514719538-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1089481335/action" status: 200 len: 97 microversion: 2.1 time: 0.741511 Sep 10 11:37:58.022075 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 40/67] 10.222.0.23 () {60 vars in 1200 bytes} [Sat Sep 10 11:37:57 2022] POST /compute/v2.1/flavors/1089481335/action => generated 97 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:37:58.668450 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-05d48261-ce55-49fb-8f86-e8b1b2ae0dbf tempest-FlavorsAccessTestJSON-1442693808 tempest-FlavorsAccessTestJSON-1442693808-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:58.710732 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-05d48261-ce55-49fb-8f86-e8b1b2ae0dbf tempest-FlavorsAccessTestJSON-1442693808 tempest-FlavorsAccessTestJSON-1442693808-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5411 microversion: 2.1 time: 0.678456 Sep 10 11:37:58.715492 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 28/68] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:37:58 2022] GET /compute/v2.1/flavors/detail => generated 5411 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:37:58.735192 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9338e9ea-5cd4-4ed6-9d65-3ae8eab396ce tempest-FlavorsAccessTestJSON-514719538 tempest-FlavorsAccessTestJSON-514719538-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "4bfbcb77d7e74786993eeb9568d7f0b5"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:37:58.882330 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-aff4cba3-a9bb-4452-88e7-b0ae65922883 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:58.883522 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-aff4cba3-a9bb-4452-88e7-b0ae65922883 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] [instance: b33b0f22-808a-483c-9683-a16f98eccfa6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:37:59.058429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-aff4cba3-a9bb-4452-88e7-b0ae65922883 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce70607350b14ce98add3c72ed36c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8943799e9af4699bcfd87690773282e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:37:59.095667 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-aff4cba3-a9bb-4452-88e7-b0ae65922883 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] 10.222.0.23 "GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6" status: 200 len: 1242 microversion: 2.1 time: 0.217547 Sep 10 11:37:59.115076 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 29/69] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:37:58 2022] GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6 => generated 1242 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:37:59.842610 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9338e9ea-5cd4-4ed6-9d65-3ae8eab396ce tempest-FlavorsAccessTestJSON-514719538 tempest-FlavorsAccessTestJSON-514719538-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1089481335/action" status: 200 len: 21 microversion: 2.1 time: 1.111024 Sep 10 11:37:59.851633 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 41/70] 10.222.0.23 () {60 vars in 1200 bytes} [Sat Sep 10 11:37:58 2022] POST /compute/v2.1/flavors/1089481335/action => generated 21 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:37:59.854080 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-39b7c93a-9e54-4088-8015-cc8174c8267e tempest-FlavorsAccessTestJSON-1442693808 tempest-FlavorsAccessTestJSON-1442693808-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:59.891581 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-39b7c93a-9e54-4088-8015-cc8174c8267e tempest-FlavorsAccessTestJSON-1442693808 tempest-FlavorsAccessTestJSON-1442693808-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042196 Sep 10 11:37:59.892790 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 30/71] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:37:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:37:59.915685 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9342099b-ca0f-4874-92af-2727eeec938b tempest-FlavorsAccessTestJSON-514719538 tempest-FlavorsAccessTestJSON-514719538-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:59.947855 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9342099b-ca0f-4874-92af-2727eeec938b tempest-FlavorsAccessTestJSON-514719538 tempest-FlavorsAccessTestJSON-514719538-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1089481335" status: 202 len: 0 microversion: 2.1 time: 0.037626 Sep 10 11:37:59.948879 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 42/72] 10.222.0.23 () {58 vars in 1161 bytes} [Sat Sep 10 11:37:59 2022] DELETE /compute/v2.1/flavors/1089481335 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:37:59.957197 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ab28d263-3aae-4f0a-906a-160031904c26 tempest-FlavorsAccessTestJSON-514719538 tempest-FlavorsAccessTestJSON-514719538-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:37:59.997556 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ab28d263-3aae-4f0a-906a-160031904c26 tempest-FlavorsAccessTestJSON-514719538 tempest-FlavorsAccessTestJSON-514719538-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043636 Sep 10 11:38:00.001142 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 31/73] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:37:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:38:00.022044 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7d27d353-196a-4ce7-a820-bab847f79b90 tempest-FlavorsAccessTestJSON-514719538 tempest-FlavorsAccessTestJSON-514719538-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1275937463", "id": 1085879922, "os-flavor-access:is_public": "False"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:00.056524 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7d27d353-196a-4ce7-a820-bab847f79b90 tempest-FlavorsAccessTestJSON-514719538 tempest-FlavorsAccessTestJSON-514719538-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.039238 Sep 10 11:38:00.057136 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 43/74] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:38:00 2022] POST /compute/v2.1/flavors => generated 431 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:00.070344 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4b7a1293-f07e-4f9e-b824-25e4396d0201 tempest-FlavorsAccessTestJSON-514719538 tempest-FlavorsAccessTestJSON-514719538-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:00.084254 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4b7a1293-f07e-4f9e-b824-25e4396d0201 tempest-FlavorsAccessTestJSON-514719538 tempest-FlavorsAccessTestJSON-514719538-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/1085879922/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.017947 Sep 10 11:38:00.094799 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d454d7e7-6b28-495b-b07e-1212d26e87f5 tempest-FlavorsAccessTestJSON-514719538 tempest-FlavorsAccessTestJSON-514719538-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:00.098698 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 32/75] 10.222.0.23 () {58 vars in 1209 bytes} [Sat Sep 10 11:38:00 2022] GET /compute/v2.1/flavors/1085879922/os-flavor-access => generated 21 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:38:00.122603 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c06c33f1-356f-480b-bf11-a9f9cb3fa036 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:00.123382 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c06c33f1-356f-480b-bf11-a9f9cb3fa036 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] [instance: b33b0f22-808a-483c-9683-a16f98eccfa6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:00.128227 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d454d7e7-6b28-495b-b07e-1212d26e87f5 tempest-FlavorsAccessTestJSON-514719538 tempest-FlavorsAccessTestJSON-514719538-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1085879922" status: 202 len: 0 microversion: 2.1 time: 0.037001 Sep 10 11:38:00.136594 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c06c33f1-356f-480b-bf11-a9f9cb3fa036 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:00.137120 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 44/76] 10.222.0.23 () {58 vars in 1161 bytes} [Sat Sep 10 11:38:00 2022] DELETE /compute/v2.1/flavors/1085879922 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:38:00.139804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c06c33f1-356f-480b-bf11-a9f9cb3fa036 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:00.143441 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c06c33f1-356f-480b-bf11-a9f9cb3fa036 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:00.144387 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c06c33f1-356f-480b-bf11-a9f9cb3fa036 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:00.145380 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ee3df429-4e95-4295-8189-d77edd2ed7ba tempest-FlavorsAccessTestJSON-514719538 tempest-FlavorsAccessTestJSON-514719538-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:00.146855 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c06c33f1-356f-480b-bf11-a9f9cb3fa036 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:00.156456 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c06c33f1-356f-480b-bf11-a9f9cb3fa036 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:00.211222 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ee3df429-4e95-4295-8189-d77edd2ed7ba tempest-FlavorsAccessTestJSON-514719538 tempest-FlavorsAccessTestJSON-514719538-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064416 Sep 10 11:38:00.224526 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 45/77] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:38:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:00.409666 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c06c33f1-356f-480b-bf11-a9f9cb3fa036 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce70607350b14ce98add3c72ed36c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8943799e9af4699bcfd87690773282e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:00.436600 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c06c33f1-356f-480b-bf11-a9f9cb3fa036 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] 10.222.0.23 "GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6" status: 200 len: 1290 microversion: 2.1 time: 0.318347 Sep 10 11:38:00.437195 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 33/78] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:00 2022] GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6 => generated 1290 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:01.464169 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3dad3ad9-f25d-475d-a404-a0463c58eb8f tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:01.465502 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3dad3ad9-f25d-475d-a404-a0463c58eb8f tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] [instance: b33b0f22-808a-483c-9683-a16f98eccfa6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:01.495031 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3dad3ad9-f25d-475d-a404-a0463c58eb8f tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:01.497075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3dad3ad9-f25d-475d-a404-a0463c58eb8f tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:01.497647 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3dad3ad9-f25d-475d-a404-a0463c58eb8f tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:01.499483 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3dad3ad9-f25d-475d-a404-a0463c58eb8f tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:01.502943 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3dad3ad9-f25d-475d-a404-a0463c58eb8f tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:01.503585 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3dad3ad9-f25d-475d-a404-a0463c58eb8f tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:02.977844 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=4 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:38:04.206433 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-db8551fb-36a0-44b6-b2fb-f25fa934090f tempest-QuotaClassesAdmin257Test-1981704717 tempest-QuotaClassesAdmin257Test-1981704717-project-admin] Calling method '.version_select at 0x7f407814fe50>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:04.247901 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-db8551fb-36a0-44b6-b2fb-f25fa934090f tempest-QuotaClassesAdmin257Test-1981704717 tempest-QuotaClassesAdmin257Test-1981704717-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 1.191954 Sep 10 11:38:04.251366 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 34/79] 10.222.0.23 () {60 vars in 1226 bytes} [Sat Sep 10 11:38:03 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 10 11:38:04.265064 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-15873bf2-209f-4bc3-ba1f-194bb11d02e7 tempest-QuotaClassesAdmin257Test-1981704717 tempest-QuotaClassesAdmin257Test-1981704717-project-admin] Action: 'update', calling method: .version_select at 0x7f40781e0d30>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:04.701204 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3dad3ad9-f25d-475d-a404-a0463c58eb8f tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce70607350b14ce98add3c72ed36c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8943799e9af4699bcfd87690773282e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:04.752156 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3dad3ad9-f25d-475d-a404-a0463c58eb8f tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] 10.222.0.23 "GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6" status: 200 len: 1338 microversion: 2.1 time: 3.293522 Sep 10 11:38:04.755214 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 46/80] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:01 2022] GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6 => generated 1338 bytes in 3297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:04.777698 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-15873bf2-209f-4bc3-ba1f-194bb11d02e7 tempest-QuotaClassesAdmin257Test-1981704717 tempest-QuotaClassesAdmin257Test-1981704717-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.517347 Sep 10 11:38:04.780964 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 35/81] 10.222.0.23 () {62 vars in 1247 bytes} [Sat Sep 10 11:38:04 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 10 11:38:04.795307 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bc451a40-d8d4-444b-86f2-f70f3276f506 tempest-QuotaClassesAdmin257Test-1981704717 tempest-QuotaClassesAdmin257Test-1981704717-project-admin] Calling method '.version_select at 0x7f40780a9940>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:04.815772 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bc451a40-d8d4-444b-86f2-f70f3276f506 tempest-QuotaClassesAdmin257Test-1981704717 tempest-QuotaClassesAdmin257Test-1981704717-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.026677 Sep 10 11:38:04.818291 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 36/82] 10.222.0.23 () {60 vars in 1226 bytes} [Sat Sep 10 11:38:04 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:38:04.838804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5a558079-f121-4c1a-a7e5-9bccc7222d93 tempest-QuotaClassesAdmin257Test-1981704717 tempest-QuotaClassesAdmin257Test-1981704717-project-admin] Action: 'update', calling method: .version_select at 0x7f40780eaca0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:04.982681 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5a558079-f121-4c1a-a7e5-9bccc7222d93 tempest-QuotaClassesAdmin257Test-1981704717 tempest-QuotaClassesAdmin257Test-1981704717-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.155995 Sep 10 11:38:04.984434 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 37/83] 10.222.0.23 () {62 vars in 1247 bytes} [Sat Sep 10 11:38:04 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:38:05.600626 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-dd4449de-97cf-4233-b2b1-733a37670cca tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1067266860", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:05.732425 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-dd4449de-97cf-4233-b2b1-733a37670cca tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] validate_networks() for None {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:38:05.785370 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c35d286b-155c-4261-a43c-63e31912f8b1 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:05.787592 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c35d286b-155c-4261-a43c-63e31912f8b1 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] [instance: b33b0f22-808a-483c-9683-a16f98eccfa6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:05.809993 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c35d286b-155c-4261-a43c-63e31912f8b1 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:05.810266 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c35d286b-155c-4261-a43c-63e31912f8b1 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:05.813482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c35d286b-155c-4261-a43c-63e31912f8b1 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:05.816643 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c35d286b-155c-4261-a43c-63e31912f8b1 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:05.817293 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c35d286b-155c-4261-a43c-63e31912f8b1 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:05.818850 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c35d286b-155c-4261-a43c-63e31912f8b1 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:06.291341 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-dd4449de-97cf-4233-b2b1-733a37670cca tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:38:06.291792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-dd4449de-97cf-4233-b2b1-733a37670cca tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:38:06.292280 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-dd4449de-97cf-4233-b2b1-733a37670cca tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:38:06.292702 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-dd4449de-97cf-4233-b2b1-733a37670cca tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:38:06.293132 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-dd4449de-97cf-4233-b2b1-733a37670cca tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:38:06.340781 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd4449de-97cf-4233-b2b1-733a37670cca tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:06.341204 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd4449de-97cf-4233-b2b1-733a37670cca tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:06.341659 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd4449de-97cf-4233-b2b1-733a37670cca tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:06.349939 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd4449de-97cf-4233-b2b1-733a37670cca tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:06.352242 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd4449de-97cf-4233-b2b1-733a37670cca tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:06.354546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd4449de-97cf-4233-b2b1-733a37670cca tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:06.388000 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c35d286b-155c-4261-a43c-63e31912f8b1 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce70607350b14ce98add3c72ed36c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8943799e9af4699bcfd87690773282e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:06.397947 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c35d286b-155c-4261-a43c-63e31912f8b1 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] 10.222.0.23 "GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6" status: 200 len: 1338 microversion: 2.1 time: 0.619614 Sep 10 11:38:06.402415 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 38/84] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:05 2022] GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6 => generated 1338 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:06.414835 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-dd4449de-97cf-4233-b2b1-733a37670cca tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Getting quotas for project a040213a0ea443cd97b346b0d4e79d4d. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:38:06.425877 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-dd4449de-97cf-4233-b2b1-733a37670cca tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Getting quotas for user 53b632d0a5ac48fea0da5aa15632cffb and project a040213a0ea443cd97b346b0d4e79d4d. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:38:06.452203 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-dd4449de-97cf-4233-b2b1-733a37670cca tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:38:06.456451 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-dd4449de-97cf-4233-b2b1-733a37670cca tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 749908de-9f45-4b7f-9ce5-171d2cf11511] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:38:06.597775 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-dd4449de-97cf-4233-b2b1-733a37670cca tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.821132 Sep 10 11:38:06.600127 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 47/85] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:38:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:38:06.611080 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c0ac7833-0d80-456a-be62-d3d49b0a92ef tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:06.611951 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c0ac7833-0d80-456a-be62-d3d49b0a92ef tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 749908de-9f45-4b7f-9ce5-171d2cf11511] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:06.616569 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=10,nova_api:UPDATE=14 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:38:06.739019 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c0ac7833-0d80-456a-be62-d3d49b0a92ef tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b632d0a5ac48fea0da5aa15632cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a040213a0ea443cd97b346b0d4e79d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:06.748436 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c0ac7833-0d80-456a-be62-d3d49b0a92ef tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511" status: 200 len: 1220 microversion: 2.1 time: 0.141218 Sep 10 11:38:06.757354 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 39/86] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:06 2022] GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511 => generated 1220 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:07.426885 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e31f432d-93ae-4e68-bba4-04a3b3628ea1 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:07.429734 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e31f432d-93ae-4e68-bba4-04a3b3628ea1 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] [instance: b33b0f22-808a-483c-9683-a16f98eccfa6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:07.440669 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e31f432d-93ae-4e68-bba4-04a3b3628ea1 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:07.441389 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e31f432d-93ae-4e68-bba4-04a3b3628ea1 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:07.442022 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e31f432d-93ae-4e68-bba4-04a3b3628ea1 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:07.443510 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e31f432d-93ae-4e68-bba4-04a3b3628ea1 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:07.445154 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e31f432d-93ae-4e68-bba4-04a3b3628ea1 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:07.446785 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e31f432d-93ae-4e68-bba4-04a3b3628ea1 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:07.483492 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=4 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:38:07.932224 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e31f432d-93ae-4e68-bba4-04a3b3628ea1 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce70607350b14ce98add3c72ed36c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8943799e9af4699bcfd87690773282e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:07.963736 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e31f432d-93ae-4e68-bba4-04a3b3628ea1 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] 10.222.0.23 "GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6" status: 200 len: 1338 microversion: 2.1 time: 0.542181 Sep 10 11:38:07.968513 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 40/87] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:07 2022] GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6 => generated 1338 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:38:07.997555 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dcf272d6-2290-4915-b766-df8a01a38631 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:08.007421 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-dcf272d6-2290-4915-b766-df8a01a38631 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 749908de-9f45-4b7f-9ce5-171d2cf11511] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:08.088305 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b21706e9-c7b4-454c-a975-bd54d181c571 tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Calling method '.version_select at 0x7f4078117280>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:08.092819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-dcf272d6-2290-4915-b766-df8a01a38631 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b632d0a5ac48fea0da5aa15632cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a040213a0ea443cd97b346b0d4e79d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:08.092987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b21706e9-c7b4-454c-a975-bd54d181c571 tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:08.093453 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b21706e9-c7b4-454c-a975-bd54d181c571 tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:08.093894 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b21706e9-c7b4-454c-a975-bd54d181c571 tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:08.104251 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-dcf272d6-2290-4915-b766-df8a01a38631 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511" status: 200 len: 1220 microversion: 2.1 time: 0.129637 Sep 10 11:38:08.105453 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 41/88] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:07 2022] GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511 => generated 1220 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:08.165570 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b21706e9-c7b4-454c-a975-bd54d181c571 tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:08.169641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b21706e9-c7b4-454c-a975-bd54d181c571 tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:08.170411 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b21706e9-c7b4-454c-a975-bd54d181c571 tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:08.198081 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b21706e9-c7b4-454c-a975-bd54d181c571 tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:08.199779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b21706e9-c7b4-454c-a975-bd54d181c571 tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:08.201671 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b21706e9-c7b4-454c-a975-bd54d181c571 tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:08.216704 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b21706e9-c7b4-454c-a975-bd54d181c571 tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.935645 Sep 10 11:38:08.221419 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 48/89] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:38:07 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:08.241340 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-65e294c6-aabc-4b38-ad97-df191f7331aa tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Calling method '.version_select at 0x7f40780ddee0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:08.245456 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65e294c6-aabc-4b38-ad97-df191f7331aa tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:08.246634 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65e294c6-aabc-4b38-ad97-df191f7331aa tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:08.247767 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65e294c6-aabc-4b38-ad97-df191f7331aa tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:08.357501 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65e294c6-aabc-4b38-ad97-df191f7331aa tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:08.358022 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65e294c6-aabc-4b38-ad97-df191f7331aa tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:08.358474 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65e294c6-aabc-4b38-ad97-df191f7331aa tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:08.452290 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65e294c6-aabc-4b38-ad97-df191f7331aa tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:08.453094 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65e294c6-aabc-4b38-ad97-df191f7331aa tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:08.453352 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65e294c6-aabc-4b38-ad97-df191f7331aa tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:08.473725 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-65e294c6-aabc-4b38-ad97-df191f7331aa tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.243649 Sep 10 11:38:08.479303 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 42/90] 10.222.0.23 () {58 vars in 1167 bytes} [Sat Sep 10 11:38:08 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:08.501185 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c03796ce-4acc-43c7-88cc-b3c7576544db tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Calling method '.version_select at 0x7f4078061d30>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:08.504199 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c03796ce-4acc-43c7-88cc-b3c7576544db tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:08.509078 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c03796ce-4acc-43c7-88cc-b3c7576544db tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:08.513429 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c03796ce-4acc-43c7-88cc-b3c7576544db tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:08.578777 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=16,nova_api:INSERT=8 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:38:08.596462 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c03796ce-4acc-43c7-88cc-b3c7576544db tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:08.598395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c03796ce-4acc-43c7-88cc-b3c7576544db tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:08.600990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c03796ce-4acc-43c7-88cc-b3c7576544db tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:08.659117 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c03796ce-4acc-43c7-88cc-b3c7576544db tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:08.659736 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c03796ce-4acc-43c7-88cc-b3c7576544db tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:08.660245 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c03796ce-4acc-43c7-88cc-b3c7576544db tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:08.685767 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c03796ce-4acc-43c7-88cc-b3c7576544db tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.187506 Sep 10 11:38:08.690327 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 49/91] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:38:08 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:38:08.701605 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ff0300ac-3ab3-43ba-874b-a01d8916d89b tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Calling method '.version_select at 0x7f40780e0dc0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:08.703813 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff0300ac-3ab3-43ba-874b-a01d8916d89b tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:08.704741 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff0300ac-3ab3-43ba-874b-a01d8916d89b tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:08.706344 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff0300ac-3ab3-43ba-874b-a01d8916d89b tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:08.769033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff0300ac-3ab3-43ba-874b-a01d8916d89b tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:08.774199 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff0300ac-3ab3-43ba-874b-a01d8916d89b tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:08.775086 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff0300ac-3ab3-43ba-874b-a01d8916d89b tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:08.807192 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ff0300ac-3ab3-43ba-874b-a01d8916d89b tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.095841 Sep 10 11:38:08.811045 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 43/92] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Sep 10 11:38:08 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:08.825964 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-09fedbf2-1bd2-4a05-81bd-60e7ca41058b tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Calling method '.version_select at 0x7f4078061550>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:08.829683 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-09fedbf2-1bd2-4a05-81bd-60e7ca41058b tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:08.830434 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-09fedbf2-1bd2-4a05-81bd-60e7ca41058b tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:08.831025 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-09fedbf2-1bd2-4a05-81bd-60e7ca41058b tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:08.888971 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-09fedbf2-1bd2-4a05-81bd-60e7ca41058b tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.064872 Sep 10 11:38:08.890441 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 50/93] 10.222.0.23 () {58 vars in 1179 bytes} [Sat Sep 10 11:38:08 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:08.903684 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3756ad0b-87e4-498d-8b95-2484f5bb2620 tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Calling method '.version_select at 0x7f40781e0430>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:08.906056 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3756ad0b-87e4-498d-8b95-2484f5bb2620 tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:08.906880 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3756ad0b-87e4-498d-8b95-2484f5bb2620 tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:08.907466 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3756ad0b-87e4-498d-8b95-2484f5bb2620 tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:08.945975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3756ad0b-87e4-498d-8b95-2484f5bb2620 tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:08.946546 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3756ad0b-87e4-498d-8b95-2484f5bb2620 tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:08.948210 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3756ad0b-87e4-498d-8b95-2484f5bb2620 tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:08.996015 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3756ad0b-87e4-498d-8b95-2484f5bb2620 tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:08.997238 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3756ad0b-87e4-498d-8b95-2484f5bb2620 tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:08.998433 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-40ceeb4c-1bb2-4104-95dd-2b31f987aeb6 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:08.998679 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3756ad0b-87e4-498d-8b95-2484f5bb2620 tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:08.999396 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-40ceeb4c-1bb2-4104-95dd-2b31f987aeb6 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] [instance: b33b0f22-808a-483c-9683-a16f98eccfa6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:09.012026 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3756ad0b-87e4-498d-8b95-2484f5bb2620 tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.112413 Sep 10 11:38:09.013406 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 44/94] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:38:08 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:09.022087 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40ceeb4c-1bb2-4104-95dd-2b31f987aeb6 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:09.024610 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40ceeb4c-1bb2-4104-95dd-2b31f987aeb6 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:09.025313 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40ceeb4c-1bb2-4104-95dd-2b31f987aeb6 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:09.027085 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40ceeb4c-1bb2-4104-95dd-2b31f987aeb6 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:09.027802 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40ceeb4c-1bb2-4104-95dd-2b31f987aeb6 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:09.029371 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40ceeb4c-1bb2-4104-95dd-2b31f987aeb6 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:09.038317 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-084ebdc0-3605-42ef-b2d2-40d4130851f4 tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Calling method '.version_select at 0x7f40781e0e50>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:09.042463 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-084ebdc0-3605-42ef-b2d2-40d4130851f4 tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:09.043125 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-084ebdc0-3605-42ef-b2d2-40d4130851f4 tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:09.043868 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-084ebdc0-3605-42ef-b2d2-40d4130851f4 tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:09.086758 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-084ebdc0-3605-42ef-b2d2-40d4130851f4 tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:09.088148 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-084ebdc0-3605-42ef-b2d2-40d4130851f4 tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:09.089417 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-084ebdc0-3605-42ef-b2d2-40d4130851f4 tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:09.124489 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-084ebdc0-3605-42ef-b2d2-40d4130851f4 tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.102241 Sep 10 11:38:09.126786 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 45/95] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Sep 10 11:38:09 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:38:09.149669 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-75945ba2-7112-4c4d-858d-35f0f2628641 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:09.151653 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-75945ba2-7112-4c4d-858d-35f0f2628641 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 749908de-9f45-4b7f-9ce5-171d2cf11511] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:09.170901 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75945ba2-7112-4c4d-858d-35f0f2628641 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:09.173477 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75945ba2-7112-4c4d-858d-35f0f2628641 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:09.174184 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75945ba2-7112-4c4d-858d-35f0f2628641 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:09.178875 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75945ba2-7112-4c4d-858d-35f0f2628641 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:09.179977 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75945ba2-7112-4c4d-858d-35f0f2628641 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:09.182376 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75945ba2-7112-4c4d-858d-35f0f2628641 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:09.658017 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-75945ba2-7112-4c4d-858d-35f0f2628641 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b632d0a5ac48fea0da5aa15632cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a040213a0ea443cd97b346b0d4e79d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:09.679445 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-75945ba2-7112-4c4d-858d-35f0f2628641 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511" status: 200 len: 1272 microversion: 2.1 time: 0.545627 Sep 10 11:38:09.683796 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 46/96] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:09 2022] GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511 => generated 1272 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:09.710325 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-27b00274-55a1-43d1-9f41-120b2418c5f6 tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Calling method '.version_select at 0x7f40780dddc0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:09.712756 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27b00274-55a1-43d1-9f41-120b2418c5f6 tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:09.719823 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27b00274-55a1-43d1-9f41-120b2418c5f6 tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:09.721671 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27b00274-55a1-43d1-9f41-120b2418c5f6 tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:09.767957 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27b00274-55a1-43d1-9f41-120b2418c5f6 tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:09.768774 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27b00274-55a1-43d1-9f41-120b2418c5f6 tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:09.770090 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27b00274-55a1-43d1-9f41-120b2418c5f6 tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:09.793059 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-27b00274-55a1-43d1-9f41-120b2418c5f6 tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.103593 Sep 10 11:38:09.799750 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 47/97] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Sep 10 11:38:09 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:09.948109 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-40ceeb4c-1bb2-4104-95dd-2b31f987aeb6 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce70607350b14ce98add3c72ed36c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8943799e9af4699bcfd87690773282e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:09.964842 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-40ceeb4c-1bb2-4104-95dd-2b31f987aeb6 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] 10.222.0.23 "GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6" status: 200 len: 1338 microversion: 2.1 time: 0.966393 Sep 10 11:38:09.973220 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 51/98] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:08 2022] GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6 => generated 1338 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:38:10.001681 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8fec5d8a-e767-4ae7-9838-496fab4fbdfd tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Calling method '.version_select at 0x7f4073fec310>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:10.013033 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8fec5d8a-e767-4ae7-9838-496fab4fbdfd tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:10.016450 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8fec5d8a-e767-4ae7-9838-496fab4fbdfd tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:10.018441 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8fec5d8a-e767-4ae7-9838-496fab4fbdfd tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:10.059292 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8fec5d8a-e767-4ae7-9838-496fab4fbdfd tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:10.060515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8fec5d8a-e767-4ae7-9838-496fab4fbdfd tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:10.061313 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8fec5d8a-e767-4ae7-9838-496fab4fbdfd tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:10.084564 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8fec5d8a-e767-4ae7-9838-496fab4fbdfd tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:10.086769 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8fec5d8a-e767-4ae7-9838-496fab4fbdfd tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:10.087268 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8fec5d8a-e767-4ae7-9838-496fab4fbdfd tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:10.102374 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8fec5d8a-e767-4ae7-9838-496fab4fbdfd tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Acquiring lock "compute-rpcapi-router" {{(pid=128777) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 10 11:38:10.102776 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8fec5d8a-e767-4ae7-9838-496fab4fbdfd tempest-HypervisorAdminTestJSON-1244227295 tempest-HypervisorAdminTestJSON-1244227295-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=128777) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 10 11:38:10.103890 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-192c940e-c3ff-49df-b1cf-af266c6cdeec None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:10.104354 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-192c940e-c3ff-49df-b1cf-af266c6cdeec None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:10.104788 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-192c940e-c3ff-49df-b1cf-af266c6cdeec None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:10.108416 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-192c940e-c3ff-49df-b1cf-af266c6cdeec None None] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:10.108935 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-192c940e-c3ff-49df-b1cf-af266c6cdeec None None] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:10.109376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-192c940e-c3ff-49df-b1cf-af266c6cdeec None None] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:10.130707 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.compute.rpcapi [None req-192c940e-c3ff-49df-b1cf-af266c6cdeec None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 10 11:38:10.138542 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-192c940e-c3ff-49df-b1cf-af266c6cdeec None None] Releasing lock "compute-rpcapi-router" {{(pid=128777) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 10 11:38:10.210676 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-192c940e-c3ff-49df-b1cf-af266c6cdeec None None] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.233864 Sep 10 11:38:10.211230 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 52/99] 10.222.0.23 () {58 vars in 1173 bytes} [Sat Sep 10 11:38:09 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:10.386584 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-08fe5a15-b91e-4701-9373-746f2c60783a req-6bbd62b3-c785-40d2-b7c0-6d7c92d4c7d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b33b0f22-808a-483c-9683-a16f98eccfa6", "tag": "9d826429-f324-4423-b183-ba434abae3e6"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:10.437837 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-08fe5a15-b91e-4701-9373-746f2c60783a req-6bbd62b3-c785-40d2-b7c0-6d7c92d4c7d9 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:10.439640 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-08fe5a15-b91e-4701-9373-746f2c60783a req-6bbd62b3-c785-40d2-b7c0-6d7c92d4c7d9 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:10.442158 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-08fe5a15-b91e-4701-9373-746f2c60783a req-6bbd62b3-c785-40d2-b7c0-6d7c92d4c7d9 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:10.518355 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-08fe5a15-b91e-4701-9373-746f2c60783a req-6bbd62b3-c785-40d2-b7c0-6d7c92d4c7d9 service nova] Creating event network-changed:9d826429-f324-4423-b183-ba434abae3e6 for instance b33b0f22-808a-483c-9683-a16f98eccfa6 on n-h2-856895-1 Sep 10 11:38:10.521078 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-08fe5a15-b91e-4701-9373-746f2c60783a req-6bbd62b3-c785-40d2-b7c0-6d7c92d4c7d9 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128776) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 10 11:38:10.521636 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-08fe5a15-b91e-4701-9373-746f2c60783a req-6bbd62b3-c785-40d2-b7c0-6d7c92d4c7d9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128776) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 10 11:38:10.522770 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-acde1db8-471b-42d9-9d49-b6b23dba557d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:10.525431 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-acde1db8-471b-42d9-9d49-b6b23dba557d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:10.525913 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-acde1db8-471b-42d9-9d49-b6b23dba557d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:10.526800 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-acde1db8-471b-42d9-9d49-b6b23dba557d None None] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:10.530217 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-acde1db8-471b-42d9-9d49-b6b23dba557d None None] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:10.530806 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-acde1db8-471b-42d9-9d49-b6b23dba557d None None] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:10.559452 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.compute.rpcapi [None req-acde1db8-471b-42d9-9d49-b6b23dba557d None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 10 11:38:10.560945 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-acde1db8-471b-42d9-9d49-b6b23dba557d None None] Releasing lock "compute-rpcapi-router" {{(pid=128776) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 10 11:38:10.585825 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-acde1db8-471b-42d9-9d49-b6b23dba557d None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.782412 Sep 10 11:38:10.587280 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 48/100] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:10.719866 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-52257358-688e-46ce-b92b-ddcfe302b247 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:10.721237 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-52257358-688e-46ce-b92b-ddcfe302b247 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 749908de-9f45-4b7f-9ce5-171d2cf11511] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:10.748445 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-52257358-688e-46ce-b92b-ddcfe302b247 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:10.748994 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-52257358-688e-46ce-b92b-ddcfe302b247 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:10.759514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-52257358-688e-46ce-b92b-ddcfe302b247 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:10.761402 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-52257358-688e-46ce-b92b-ddcfe302b247 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:10.762067 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-52257358-688e-46ce-b92b-ddcfe302b247 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:10.763845 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-52257358-688e-46ce-b92b-ddcfe302b247 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:10.957394 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-52257358-688e-46ce-b92b-ddcfe302b247 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b632d0a5ac48fea0da5aa15632cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a040213a0ea443cd97b346b0d4e79d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:10.970239 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-52257358-688e-46ce-b92b-ddcfe302b247 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511" status: 200 len: 1278 microversion: 2.1 time: 0.257133 Sep 10 11:38:10.997429 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 53/101] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:10 2022] GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511 => generated 1278 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:11.010484 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-131d8e8d-76ca-4013-bc60-0e95e42b2811 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:11.012421 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-131d8e8d-76ca-4013-bc60-0e95e42b2811 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] [instance: b33b0f22-808a-483c-9683-a16f98eccfa6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:11.021362 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-131d8e8d-76ca-4013-bc60-0e95e42b2811 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:11.022074 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-131d8e8d-76ca-4013-bc60-0e95e42b2811 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:11.024038 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-131d8e8d-76ca-4013-bc60-0e95e42b2811 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:11.025331 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-131d8e8d-76ca-4013-bc60-0e95e42b2811 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:11.025974 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-131d8e8d-76ca-4013-bc60-0e95e42b2811 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:11.026574 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-131d8e8d-76ca-4013-bc60-0e95e42b2811 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:11.390725 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-131d8e8d-76ca-4013-bc60-0e95e42b2811 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce70607350b14ce98add3c72ed36c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8943799e9af4699bcfd87690773282e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:11.401565 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-131d8e8d-76ca-4013-bc60-0e95e42b2811 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] 10.222.0.23 "GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6" status: 200 len: 1338 microversion: 2.1 time: 0.398019 Sep 10 11:38:11.407603 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 54/102] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:10 2022] GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6 => generated 1338 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:11.471353 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8b7d8766-6d02-44a8-aabc-b6d89bfb0307 tempest-HypervisorAdminNegativeTestJSON-2080231747 tempest-HypervisorAdminNegativeTestJSON-2080231747-project] Calling method '.version_select at 0x7f40780dd700>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:11.473928 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8b7d8766-6d02-44a8-aabc-b6d89bfb0307 tempest-HypervisorAdminNegativeTestJSON-2080231747 tempest-HypervisorAdminNegativeTestJSON-2080231747-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '4b892541091940bbbdd8d3e9c61dcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b1bddeb6994be79f306e310dae8a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:11.493046 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8b7d8766-6d02-44a8-aabc-b6d89bfb0307 tempest-HypervisorAdminNegativeTestJSON-2080231747 tempest-HypervisorAdminNegativeTestJSON-2080231747-project] Request method failure captured: Sep 10 11:38:11.493046 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Sep 10 11:38:11.493046 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:38:11.493046 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:38:11.493046 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:38:11.493046 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:38:11.493046 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:38:11.493046 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:38:11.493046 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:38:11.493046 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:38:11.493046 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHcf542dtUNZ5vNGgNjAL9NZZ4EIZTIEHH9yNsWmMFBcLDx4zSmNlZtPgnnSM7tKDtU8AJV4a2MAG6fYSu4HqIspygM8C3VT0g1u8uEIcGcloZAwCGTNu2JOcNu4FawrYI-Rl9VQwsqO90Xo4SakuKS8lu09tfcPip90hlilPk8mhqE Sep 10 11:38:11.493046 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:38:11.493046 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:38:11.493046 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:38:11.493046 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:38:11.493046 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:38:11.493046 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:38:11.493046 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 45b1bddeb6994be79f306e310dae8a01 Sep 10 11:38:11.493046 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2080231747 Sep 10 11:38:11.493046 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:38:11.493046 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:38:11.494347 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/45b1bddeb6994be79f306e310dae8a01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/45b1bddeb6994be79f306e310dae8a01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_45b1bddeb6994be79f306e310dae8a01", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/45b1bddeb6994be79f306e310dae8a01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:38:11.494347 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2080231747 Sep 10 11:38:11.494347 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 45b1bddeb6994be79f306e310dae8a01 Sep 10 11:38:11.494347 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2080231747 Sep 10 11:38:11.494347 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-HypervisorAdminNegativeTestJSON-2080231747-project Sep 10 11:38:11.494347 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:38:11.494347 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:38:11.494347 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 4b892541091940bbbdd8d3e9c61dcfd5 Sep 10 11:38:11.494347 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2080231747-project Sep 10 11:38:11.494347 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:38:11.494347 n-d-856895-1 devstack@n-api.service[128776]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 10 11:38:11.494347 n-d-856895-1 devstack@n-api.service[128776]: action_args: {} Sep 10 11:38:11.494347 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:38:11.495155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:11.495155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:11.495155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:11.495155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:38:11.495155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:38:11.495155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:38:11.495155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:38:11.495155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:38:11.495155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:38:11.495155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Sep 10 11:38:11.495155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._detail(req) Sep 10 11:38:11.495155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Sep 10 11:38:11.495155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Sep 10 11:38:11.495155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 11:38:11.495155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 11:38:11.495155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 11:38:11.495155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 11:38:11.495155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:38:11.495155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:38:11.497027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:38:11.497027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:38:11.497027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 11:38:11.497027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 11:38:11.497027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 11:38:11.497027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 11:38:11.497027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 11:38:11.497027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 11:38:11.497027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 10 11:38:11.497027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:11.497027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:11.497027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:11.497027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:11.497027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:11.497027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:11.497027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 11:38:11.497027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 11:38:11.497027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 10 11:38:11.497027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:11.499559 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8b7d8766-6d02-44a8-aabc-b6d89bfb0307 tempest-HypervisorAdminNegativeTestJSON-2080231747 tempest-HypervisorAdminNegativeTestJSON-2080231747-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:38:11.500626 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8b7d8766-6d02-44a8-aabc-b6d89bfb0307 tempest-HypervisorAdminNegativeTestJSON-2080231747 tempest-HypervisorAdminNegativeTestJSON-2080231747-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.732854 Sep 10 11:38:11.501379 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 49/103] 10.222.0.23 () {58 vars in 1167 bytes} [Sat Sep 10 11:38:10 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 734 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 10 11:38:11.512588 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3b8c7311-8e7f-4541-8f4b-d09194a0eca6 tempest-HypervisorAdminNegativeTestJSON-2080231747 tempest-HypervisorAdminNegativeTestJSON-2080231747-project] Calling method '.version_select at 0x7f4073f67ca0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:11.514403 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3b8c7311-8e7f-4541-8f4b-d09194a0eca6 tempest-HypervisorAdminNegativeTestJSON-2080231747 tempest-HypervisorAdminNegativeTestJSON-2080231747-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '4b892541091940bbbdd8d3e9c61dcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b1bddeb6994be79f306e310dae8a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:11.525437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3b8c7311-8e7f-4541-8f4b-d09194a0eca6 tempest-HypervisorAdminNegativeTestJSON-2080231747 tempest-HypervisorAdminNegativeTestJSON-2080231747-project] Request method failure captured: Sep 10 11:38:11.525437 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Sep 10 11:38:11.525437 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:38:11.525437 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:38:11.525437 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:38:11.525437 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:38:11.525437 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:38:11.525437 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:38:11.525437 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:38:11.525437 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:38:11.525437 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHcf542dtUNZ5vNGgNjAL9NZZ4EIZTIEHH9yNsWmMFBcLDx4zSmNlZtPgnnSM7tKDtU8AJV4a2MAG6fYSu4HqIspygM8C3VT0g1u8uEIcGcloZAwCGTNu2JOcNu4FawrYI-Rl9VQwsqO90Xo4SakuKS8lu09tfcPip90hlilPk8mhqE Sep 10 11:38:11.525437 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:38:11.525437 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:38:11.525437 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:38:11.525437 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:38:11.525437 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:38:11.525437 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:38:11.525437 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 45b1bddeb6994be79f306e310dae8a01 Sep 10 11:38:11.525437 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2080231747 Sep 10 11:38:11.525437 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:38:11.525437 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:38:11.526558 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/45b1bddeb6994be79f306e310dae8a01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/45b1bddeb6994be79f306e310dae8a01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_45b1bddeb6994be79f306e310dae8a01", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/45b1bddeb6994be79f306e310dae8a01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:38:11.526558 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2080231747 Sep 10 11:38:11.526558 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 45b1bddeb6994be79f306e310dae8a01 Sep 10 11:38:11.526558 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2080231747 Sep 10 11:38:11.526558 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-HypervisorAdminNegativeTestJSON-2080231747-project Sep 10 11:38:11.526558 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:38:11.526558 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:38:11.526558 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 4b892541091940bbbdd8d3e9c61dcfd5 Sep 10 11:38:11.526558 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2080231747-project Sep 10 11:38:11.526558 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:38:11.526558 n-d-856895-1 devstack@n-api.service[128777]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 10 11:38:11.526558 n-d-856895-1 devstack@n-api.service[128777]: action_args: {} Sep 10 11:38:11.526558 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:38:11.527295 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:11.527295 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:11.527295 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:11.527295 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:38:11.527295 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:38:11.527295 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:38:11.527295 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:38:11.527295 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:38:11.527295 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:38:11.527295 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Sep 10 11:38:11.527295 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 10 11:38:11.527295 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Sep 10 11:38:11.527295 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Sep 10 11:38:11.527295 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 11:38:11.527295 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 11:38:11.527295 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 11:38:11.527295 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 11:38:11.527295 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:38:11.527295 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:38:11.528216 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:38:11.528216 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:38:11.528216 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 11:38:11.528216 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 11:38:11.528216 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 11:38:11.528216 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 11:38:11.528216 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 11:38:11.528216 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 11:38:11.528216 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 10 11:38:11.528216 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:11.528216 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:11.528216 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:11.528216 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:11.528216 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:11.528216 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:11.528216 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 11:38:11.528216 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 11:38:11.528216 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 10 11:38:11.528216 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:11.529487 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3b8c7311-8e7f-4541-8f4b-d09194a0eca6 tempest-HypervisorAdminNegativeTestJSON-2080231747 tempest-HypervisorAdminNegativeTestJSON-2080231747-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:38:11.529487 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3b8c7311-8e7f-4541-8f4b-d09194a0eca6 tempest-HypervisorAdminNegativeTestJSON-2080231747 tempest-HypervisorAdminNegativeTestJSON-2080231747-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.019480 Sep 10 11:38:11.530876 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 55/104] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:38:11 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:38:11.540951 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d3615a1d-2f29-4e6c-8037-b7ab99b6bc6e tempest-HypervisorAdminNegativeTestJSON-2080231747 tempest-HypervisorAdminNegativeTestJSON-2080231747-project] Calling method '.version_select at 0x7f40780ea820>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:11.542883 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d3615a1d-2f29-4e6c-8037-b7ab99b6bc6e tempest-HypervisorAdminNegativeTestJSON-2080231747 tempest-HypervisorAdminNegativeTestJSON-2080231747-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '4b892541091940bbbdd8d3e9c61dcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b1bddeb6994be79f306e310dae8a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:11.546137 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d3615a1d-2f29-4e6c-8037-b7ab99b6bc6e tempest-HypervisorAdminNegativeTestJSON-2080231747 tempest-HypervisorAdminNegativeTestJSON-2080231747-project] Request method failure captured: Sep 10 11:38:11.546137 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Sep 10 11:38:11.546137 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:38:11.546137 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:38:11.546137 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:38:11.546137 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:38:11.546137 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:38:11.546137 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:38:11.546137 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:38:11.546137 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:38:11.546137 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHcf542dtUNZ5vNGgNjAL9NZZ4EIZTIEHH9yNsWmMFBcLDx4zSmNlZtPgnnSM7tKDtU8AJV4a2MAG6fYSu4HqIspygM8C3VT0g1u8uEIcGcloZAwCGTNu2JOcNu4FawrYI-Rl9VQwsqO90Xo4SakuKS8lu09tfcPip90hlilPk8mhqE Sep 10 11:38:11.546137 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:38:11.546137 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:38:11.546137 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:38:11.546137 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:38:11.546137 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:38:11.546137 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:38:11.546137 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 45b1bddeb6994be79f306e310dae8a01 Sep 10 11:38:11.546137 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2080231747 Sep 10 11:38:11.546137 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:38:11.546137 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:38:11.547350 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/45b1bddeb6994be79f306e310dae8a01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/45b1bddeb6994be79f306e310dae8a01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_45b1bddeb6994be79f306e310dae8a01", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/45b1bddeb6994be79f306e310dae8a01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:38:11.547350 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2080231747 Sep 10 11:38:11.547350 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 45b1bddeb6994be79f306e310dae8a01 Sep 10 11:38:11.547350 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2080231747 Sep 10 11:38:11.547350 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-HypervisorAdminNegativeTestJSON-2080231747-project Sep 10 11:38:11.547350 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:38:11.547350 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:38:11.547350 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 4b892541091940bbbdd8d3e9c61dcfd5 Sep 10 11:38:11.547350 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2080231747-project Sep 10 11:38:11.547350 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:38:11.547350 n-d-856895-1 devstack@n-api.service[128776]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 10 11:38:11.547350 n-d-856895-1 devstack@n-api.service[128776]: action_args: {} Sep 10 11:38:11.547350 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:38:11.548371 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:11.548371 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:11.548371 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:11.548371 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:38:11.548371 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:38:11.548371 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:38:11.548371 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:38:11.548371 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:38:11.548371 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:38:11.548371 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Sep 10 11:38:11.548371 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Sep 10 11:38:11.548371 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 11:38:11.548371 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 11:38:11.548371 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 11:38:11.548371 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 11:38:11.548371 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:38:11.548371 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:38:11.548371 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:38:11.548371 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:38:11.549466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 11:38:11.549466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 11:38:11.549466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 11:38:11.549466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 11:38:11.549466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 11:38:11.549466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 11:38:11.549466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 10 11:38:11.549466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:11.549466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:11.549466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:11.549466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:11.549466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:11.549466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:11.549466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 11:38:11.549466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 11:38:11.549466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 10 11:38:11.549466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:11.552130 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d3615a1d-2f29-4e6c-8037-b7ab99b6bc6e tempest-HypervisorAdminNegativeTestJSON-2080231747 tempest-HypervisorAdminNegativeTestJSON-2080231747-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:38:11.563785 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d3615a1d-2f29-4e6c-8037-b7ab99b6bc6e tempest-HypervisorAdminNegativeTestJSON-2080231747 tempest-HypervisorAdminNegativeTestJSON-2080231747-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.027534 Sep 10 11:38:11.570211 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 50/105] 10.222.0.23 () {58 vars in 1179 bytes} [Sat Sep 10 11:38:11 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:38:12.000028 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-867a3f08-b74b-43d2-9ea0-e7b93b29e389 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:12.000898 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-867a3f08-b74b-43d2-9ea0-e7b93b29e389 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 749908de-9f45-4b7f-9ce5-171d2cf11511] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:12.021532 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-867a3f08-b74b-43d2-9ea0-e7b93b29e389 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:12.024365 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-867a3f08-b74b-43d2-9ea0-e7b93b29e389 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:12.033673 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-867a3f08-b74b-43d2-9ea0-e7b93b29e389 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:12.034805 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-867a3f08-b74b-43d2-9ea0-e7b93b29e389 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:12.035524 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-867a3f08-b74b-43d2-9ea0-e7b93b29e389 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:12.036778 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-867a3f08-b74b-43d2-9ea0-e7b93b29e389 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:12.276331 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-867a3f08-b74b-43d2-9ea0-e7b93b29e389 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b632d0a5ac48fea0da5aa15632cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a040213a0ea443cd97b346b0d4e79d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:12.289728 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-867a3f08-b74b-43d2-9ea0-e7b93b29e389 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511" status: 200 len: 1278 microversion: 2.1 time: 0.293922 Sep 10 11:38:12.290898 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 51/106] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:11 2022] GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511 => generated 1278 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:12.425629 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9226524e-3d28-44a6-aaa9-96604f0f194f tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:12.426394 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9226524e-3d28-44a6-aaa9-96604f0f194f tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] [instance: b33b0f22-808a-483c-9683-a16f98eccfa6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:12.436588 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9226524e-3d28-44a6-aaa9-96604f0f194f tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:12.437517 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9226524e-3d28-44a6-aaa9-96604f0f194f tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:12.440036 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9226524e-3d28-44a6-aaa9-96604f0f194f tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:12.441058 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9226524e-3d28-44a6-aaa9-96604f0f194f tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:12.441763 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9226524e-3d28-44a6-aaa9-96604f0f194f tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:12.443286 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9226524e-3d28-44a6-aaa9-96604f0f194f tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:12.745017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4729421f-741b-4864-a2cb-4a875270a168 tempest-HypervisorAdminNegativeTestJSON-1361042168 tempest-HypervisorAdminNegativeTestJSON-1361042168-project-admin] Calling method '.version_select at 0x7f4073ec7c10>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:12.748328 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4729421f-741b-4864-a2cb-4a875270a168 tempest-HypervisorAdminNegativeTestJSON-1361042168 tempest-HypervisorAdminNegativeTestJSON-1361042168-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:12.750526 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4729421f-741b-4864-a2cb-4a875270a168 tempest-HypervisorAdminNegativeTestJSON-1361042168 tempest-HypervisorAdminNegativeTestJSON-1361042168-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:12.751465 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4729421f-741b-4864-a2cb-4a875270a168 tempest-HypervisorAdminNegativeTestJSON-1361042168 tempest-HypervisorAdminNegativeTestJSON-1361042168-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:12.792342 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9226524e-3d28-44a6-aaa9-96604f0f194f tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce70607350b14ce98add3c72ed36c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8943799e9af4699bcfd87690773282e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:12.808423 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9226524e-3d28-44a6-aaa9-96604f0f194f tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] 10.222.0.23 "GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6" status: 200 len: 1338 microversion: 2.1 time: 0.387141 Sep 10 11:38:12.812460 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 52/107] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:12 2022] GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6 => generated 1338 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:12.814174 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4729421f-741b-4864-a2cb-4a875270a168 tempest-HypervisorAdminNegativeTestJSON-1361042168 tempest-HypervisorAdminNegativeTestJSON-1361042168-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:12.814889 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4729421f-741b-4864-a2cb-4a875270a168 tempest-HypervisorAdminNegativeTestJSON-1361042168 tempest-HypervisorAdminNegativeTestJSON-1361042168-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:12.815784 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4729421f-741b-4864-a2cb-4a875270a168 tempest-HypervisorAdminNegativeTestJSON-1361042168 tempest-HypervisorAdminNegativeTestJSON-1361042168-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:12.842098 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4729421f-741b-4864-a2cb-4a875270a168 tempest-HypervisorAdminNegativeTestJSON-1361042168 tempest-HypervisorAdminNegativeTestJSON-1361042168-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:12.845489 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4729421f-741b-4864-a2cb-4a875270a168 tempest-HypervisorAdminNegativeTestJSON-1361042168 tempest-HypervisorAdminNegativeTestJSON-1361042168-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:12.846634 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4729421f-741b-4864-a2cb-4a875270a168 tempest-HypervisorAdminNegativeTestJSON-1361042168 tempest-HypervisorAdminNegativeTestJSON-1361042168-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:12.868402 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4729421f-741b-4864-a2cb-4a875270a168 tempest-HypervisorAdminNegativeTestJSON-1361042168 tempest-HypervisorAdminNegativeTestJSON-1361042168-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.297955 Sep 10 11:38:12.874138 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 56/108] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:38:11 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:12.884750 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bd3996ac-3c4d-4251-b890-71a5829f6632 tempest-HypervisorAdminNegativeTestJSON-2080231747 tempest-HypervisorAdminNegativeTestJSON-2080231747-project] Calling method '.version_select at 0x7f4073ffd670>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:12.886552 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bd3996ac-3c4d-4251-b890-71a5829f6632 tempest-HypervisorAdminNegativeTestJSON-2080231747 tempest-HypervisorAdminNegativeTestJSON-2080231747-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '4b892541091940bbbdd8d3e9c61dcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b1bddeb6994be79f306e310dae8a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:12.888125 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bd3996ac-3c4d-4251-b890-71a5829f6632 tempest-HypervisorAdminNegativeTestJSON-2080231747 tempest-HypervisorAdminNegativeTestJSON-2080231747-project] Request method failure captured: Sep 10 11:38:12.888125 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Sep 10 11:38:12.888125 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:38:12.888125 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:38:12.888125 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:38:12.888125 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:38:12.888125 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:38:12.888125 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:38:12.888125 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:38:12.888125 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:38:12.888125 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHcf542dtUNZ5vNGgNjAL9NZZ4EIZTIEHH9yNsWmMFBcLDx4zSmNlZtPgnnSM7tKDtU8AJV4a2MAG6fYSu4HqIspygM8C3VT0g1u8uEIcGcloZAwCGTNu2JOcNu4FawrYI-Rl9VQwsqO90Xo4SakuKS8lu09tfcPip90hlilPk8mhqE Sep 10 11:38:12.888125 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:38:12.888125 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:38:12.888125 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:38:12.888125 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:38:12.888125 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:38:12.888125 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:38:12.888125 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 45b1bddeb6994be79f306e310dae8a01 Sep 10 11:38:12.888125 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2080231747 Sep 10 11:38:12.888125 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:38:12.888125 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:38:12.889213 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/45b1bddeb6994be79f306e310dae8a01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/45b1bddeb6994be79f306e310dae8a01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_45b1bddeb6994be79f306e310dae8a01", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/45b1bddeb6994be79f306e310dae8a01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:38:12.889213 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2080231747 Sep 10 11:38:12.889213 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 45b1bddeb6994be79f306e310dae8a01 Sep 10 11:38:12.889213 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2080231747 Sep 10 11:38:12.889213 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-HypervisorAdminNegativeTestJSON-2080231747-project Sep 10 11:38:12.889213 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:38:12.889213 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:38:12.889213 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 4b892541091940bbbdd8d3e9c61dcfd5 Sep 10 11:38:12.889213 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2080231747-project Sep 10 11:38:12.889213 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:38:12.889213 n-d-856895-1 devstack@n-api.service[128776]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 10 11:38:12.889213 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '1'} Sep 10 11:38:12.889213 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:38:12.890147 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:12.890147 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:12.890147 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:12.890147 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:38:12.890147 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:38:12.890147 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:38:12.890147 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:38:12.890147 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:38:12.890147 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:38:12.890147 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Sep 10 11:38:12.890147 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Sep 10 11:38:12.890147 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 11:38:12.890147 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 11:38:12.890147 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 11:38:12.890147 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 11:38:12.890147 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:38:12.890147 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:38:12.890147 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:38:12.890147 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:38:12.891337 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 11:38:12.891337 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 11:38:12.891337 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 11:38:12.891337 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 11:38:12.891337 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 11:38:12.891337 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 11:38:12.891337 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 10 11:38:12.891337 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:12.891337 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:12.891337 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:12.891337 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:12.891337 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:12.891337 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:12.891337 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 11:38:12.891337 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 11:38:12.891337 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 10 11:38:12.891337 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:12.892383 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bd3996ac-3c4d-4251-b890-71a5829f6632 tempest-HypervisorAdminNegativeTestJSON-2080231747 tempest-HypervisorAdminNegativeTestJSON-2080231747-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:38:12.892383 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bd3996ac-3c4d-4251-b890-71a5829f6632 tempest-HypervisorAdminNegativeTestJSON-2080231747 tempest-HypervisorAdminNegativeTestJSON-2080231747-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.010332 Sep 10 11:38:12.903302 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 53/109] 10.222.0.23 () {58 vars in 1173 bytes} [Sat Sep 10 11:38:12 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:38:12.910020 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a13e89de-be0e-4727-9f72-652d2ec65048 tempest-HypervisorAdminNegativeTestJSON-1361042168 tempest-HypervisorAdminNegativeTestJSON-1361042168-project-admin] Calling method '.version_select at 0x7f4073fe8f70>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:12.912827 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-a13e89de-be0e-4727-9f72-652d2ec65048 tempest-HypervisorAdminNegativeTestJSON-1361042168 tempest-HypervisorAdminNegativeTestJSON-1361042168-project-admin] HTTP exception thrown: Hypervisor with ID '69a3cde1-d89d-4234-84b5-563393327e73' could not be found. Sep 10 11:38:12.943766 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a13e89de-be0e-4727-9f72-652d2ec65048 tempest-HypervisorAdminNegativeTestJSON-1361042168 tempest-HypervisorAdminNegativeTestJSON-1361042168-project-admin] Request method failure captured: Sep 10 11:38:12.943766 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/os-hypervisors/69a3cde1-d89d-4234-84b5-563393327e73/uptime HTTP/1.1 Sep 10 11:38:12.943766 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:38:12.943766 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:38:12.943766 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:38:12.943766 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:38:12.943766 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:38:12.943766 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:38:12.943766 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:38:12.943766 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:38:12.943766 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHcipp7t_Z2u3iO17MoMBjuE8nX-EvQdQaOgpBMS-ZLArQddib7-HEct6kUloRQX__Xq8JU2tOym3CJIc3LNPhUY8u1vcoFfnwDmfcN4ze4UOAvzT42LfmqAn0_bqCmeKCXfC2AgdBH1VxQbpNAEHv5bsia43l5xQBxoW9NZaJkytj0 Sep 10 11:38:12.943766 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:38:12.943766 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:38:12.943766 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:38:12.943766 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:38:12.943766 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:38:12.943766 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:38:12.943766 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 5d48d2a6d44f456c820ca20cd3848098 Sep 10 11:38:12.943766 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1361042168 Sep 10 11:38:12.943766 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,admin,member Sep 10 11:38:12.943766 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,admin,member Sep 10 11:38:12.945201 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d48d2a6d44f456c820ca20cd3848098"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d48d2a6d44f456c820ca20cd3848098"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5d48d2a6d44f456c820ca20cd3848098", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5d48d2a6d44f456c820ca20cd3848098"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:38:12.945201 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1361042168 Sep 10 11:38:12.945201 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 5d48d2a6d44f456c820ca20cd3848098 Sep 10 11:38:12.945201 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1361042168 Sep 10 11:38:12.945201 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-HypervisorAdminNegativeTestJSON-1361042168-project-admin Sep 10 11:38:12.945201 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:38:12.945201 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:38:12.945201 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 954bf0a4c7a14d6d955f8f1adeb7941e Sep 10 11:38:12.945201 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1361042168-project-admin Sep 10 11:38:12.945201 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:38:12.945201 n-d-856895-1 devstack@n-api.service[128776]: exception: Hypervisor with ID '69a3cde1-d89d-4234-84b5-563393327e73' could not be found. Sep 10 11:38:12.945201 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '69a3cde1-d89d-4234-84b5-563393327e73'} Sep 10 11:38:12.945969 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:38:12.945969 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:12.945969 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 10 11:38:12.945969 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 10 11:38:12.945969 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '69a3cde1-d89d-4234-84b5-563393327e73' Sep 10 11:38:12.945969 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:12.945969 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:12.945969 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:12.945969 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:12.945969 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 10 11:38:12.945969 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 10 11:38:12.945969 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 10 11:38:12.945969 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 10 11:38:12.945969 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 10 11:38:12.945969 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:12.945969 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:12.945969 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:12.945969 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:12.945969 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 10 11:38:12.945969 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 10 11:38:12.945969 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 10 11:38:12.945969 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 10 11:38:12.947365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 10 11:38:12.947365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:12.947365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:12.947365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:12.947365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:12.947365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:12.947365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:12.947365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:38:12.947365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:38:12.947365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:38:12.947365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:38:12.947365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:38:12.947365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:38:12.947365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Sep 10 11:38:12.947365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 10 11:38:12.947365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 10 11:38:12.947365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 10 11:38:12.947365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '69a3cde1-d89d-4234-84b5-563393327e73' could not be found. Sep 10 11:38:12.947365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:12.947365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:12.947365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:12.948771 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:12.948771 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:12.948771 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:12.948771 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:38:12.948771 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:38:12.948771 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '69a3cde1-d89d-4234-84b5-563393327e73' could not be found. Sep 10 11:38:12.948771 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:12.948771 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a13e89de-be0e-4727-9f72-652d2ec65048 tempest-HypervisorAdminNegativeTestJSON-1361042168 tempest-HypervisorAdminNegativeTestJSON-1361042168-project-admin] Returning 404 to user: Hypervisor with ID '69a3cde1-d89d-4234-84b5-563393327e73' could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:38:12.948771 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a13e89de-be0e-4727-9f72-652d2ec65048 tempest-HypervisorAdminNegativeTestJSON-1361042168 tempest-HypervisorAdminNegativeTestJSON-1361042168-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/69a3cde1-d89d-4234-84b5-563393327e73/uptime" status: 404 len: 123 microversion: 2.1 time: 0.039858 Sep 10 11:38:12.951405 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 54/110] 10.222.0.23 () {58 vars in 1278 bytes} [Sat Sep 10 11:38:12 2022] GET /compute/v2.1/os-hypervisors/69a3cde1-d89d-4234-84b5-563393327e73/uptime => generated 123 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:38:12.968213 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-20a7af11-2d5f-42c8-bb67-4e43e460e3a2 tempest-HypervisorAdminNegativeTestJSON-1361042168 tempest-HypervisorAdminNegativeTestJSON-1361042168-project-admin] Calling method '.version_select at 0x7f4073fe8dc0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:12.973463 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20a7af11-2d5f-42c8-bb67-4e43e460e3a2 tempest-HypervisorAdminNegativeTestJSON-1361042168 tempest-HypervisorAdminNegativeTestJSON-1361042168-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:12.979614 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20a7af11-2d5f-42c8-bb67-4e43e460e3a2 tempest-HypervisorAdminNegativeTestJSON-1361042168 tempest-HypervisorAdminNegativeTestJSON-1361042168-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:12.984092 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20a7af11-2d5f-42c8-bb67-4e43e460e3a2 tempest-HypervisorAdminNegativeTestJSON-1361042168 tempest-HypervisorAdminNegativeTestJSON-1361042168-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:13.019411 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20a7af11-2d5f-42c8-bb67-4e43e460e3a2 tempest-HypervisorAdminNegativeTestJSON-1361042168 tempest-HypervisorAdminNegativeTestJSON-1361042168-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:13.021555 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20a7af11-2d5f-42c8-bb67-4e43e460e3a2 tempest-HypervisorAdminNegativeTestJSON-1361042168 tempest-HypervisorAdminNegativeTestJSON-1361042168-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:13.022707 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20a7af11-2d5f-42c8-bb67-4e43e460e3a2 tempest-HypervisorAdminNegativeTestJSON-1361042168 tempest-HypervisorAdminNegativeTestJSON-1361042168-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:13.049981 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20a7af11-2d5f-42c8-bb67-4e43e460e3a2 tempest-HypervisorAdminNegativeTestJSON-1361042168 tempest-HypervisorAdminNegativeTestJSON-1361042168-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:13.050920 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20a7af11-2d5f-42c8-bb67-4e43e460e3a2 tempest-HypervisorAdminNegativeTestJSON-1361042168 tempest-HypervisorAdminNegativeTestJSON-1361042168-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:13.052192 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20a7af11-2d5f-42c8-bb67-4e43e460e3a2 tempest-HypervisorAdminNegativeTestJSON-1361042168 tempest-HypervisorAdminNegativeTestJSON-1361042168-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:13.061871 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-20a7af11-2d5f-42c8-bb67-4e43e460e3a2 tempest-HypervisorAdminNegativeTestJSON-1361042168 tempest-HypervisorAdminNegativeTestJSON-1361042168-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.106525 Sep 10 11:38:13.062847 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 55/111] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:38:12 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:13.075437 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e9219529-bb24-43ae-8592-2c3f1cbf659a tempest-HypervisorAdminNegativeTestJSON-2080231747 tempest-HypervisorAdminNegativeTestJSON-2080231747-project] Calling method '.version_select at 0x7f4073ffdaf0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:13.080178 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e9219529-bb24-43ae-8592-2c3f1cbf659a tempest-HypervisorAdminNegativeTestJSON-2080231747 tempest-HypervisorAdminNegativeTestJSON-2080231747-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '4b892541091940bbbdd8d3e9c61dcfd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45b1bddeb6994be79f306e310dae8a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:13.082575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e9219529-bb24-43ae-8592-2c3f1cbf659a tempest-HypervisorAdminNegativeTestJSON-2080231747 tempest-HypervisorAdminNegativeTestJSON-2080231747-project] Request method failure captured: Sep 10 11:38:13.082575 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Sep 10 11:38:13.082575 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:38:13.082575 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:38:13.082575 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:38:13.082575 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:38:13.082575 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:38:13.082575 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:38:13.082575 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:38:13.082575 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:38:13.082575 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHcf542dtUNZ5vNGgNjAL9NZZ4EIZTIEHH9yNsWmMFBcLDx4zSmNlZtPgnnSM7tKDtU8AJV4a2MAG6fYSu4HqIspygM8C3VT0g1u8uEIcGcloZAwCGTNu2JOcNu4FawrYI-Rl9VQwsqO90Xo4SakuKS8lu09tfcPip90hlilPk8mhqE Sep 10 11:38:13.082575 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:38:13.082575 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:38:13.082575 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:38:13.082575 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:38:13.082575 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:38:13.082575 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:38:13.082575 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 45b1bddeb6994be79f306e310dae8a01 Sep 10 11:38:13.082575 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2080231747 Sep 10 11:38:13.082575 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:38:13.082575 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:38:13.084560 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/45b1bddeb6994be79f306e310dae8a01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/45b1bddeb6994be79f306e310dae8a01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_45b1bddeb6994be79f306e310dae8a01", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/45b1bddeb6994be79f306e310dae8a01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:38:13.084560 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2080231747 Sep 10 11:38:13.084560 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 45b1bddeb6994be79f306e310dae8a01 Sep 10 11:38:13.084560 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2080231747 Sep 10 11:38:13.084560 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-HypervisorAdminNegativeTestJSON-2080231747-project Sep 10 11:38:13.084560 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:38:13.084560 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:38:13.084560 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 4b892541091940bbbdd8d3e9c61dcfd5 Sep 10 11:38:13.084560 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2080231747-project Sep 10 11:38:13.084560 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:38:13.084560 n-d-856895-1 devstack@n-api.service[128776]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 10 11:38:13.084560 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '1'} Sep 10 11:38:13.084560 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:38:13.085215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:13.085215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:13.085215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:13.085215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:38:13.085215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:38:13.085215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:38:13.085215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:38:13.085215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:38:13.085215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:38:13.085215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 10 11:38:13.085215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 10 11:38:13.085215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Sep 10 11:38:13.085215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Sep 10 11:38:13.085215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 11:38:13.085215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 11:38:13.085215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 11:38:13.085215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 11:38:13.085215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:38:13.085215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:38:13.086142 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:38:13.086142 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:38:13.086142 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 11:38:13.086142 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 11:38:13.086142 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 11:38:13.086142 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 11:38:13.086142 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 11:38:13.086142 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 11:38:13.086142 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 10 11:38:13.086142 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:13.086142 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:13.086142 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:13.086142 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:13.086142 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:13.086142 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:13.086142 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 11:38:13.086142 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 11:38:13.086142 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 10 11:38:13.086142 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:13.089891 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e9219529-bb24-43ae-8592-2c3f1cbf659a tempest-HypervisorAdminNegativeTestJSON-2080231747 tempest-HypervisorAdminNegativeTestJSON-2080231747-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:38:13.093096 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e9219529-bb24-43ae-8592-2c3f1cbf659a tempest-HypervisorAdminNegativeTestJSON-2080231747 tempest-HypervisorAdminNegativeTestJSON-2080231747-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.021428 Sep 10 11:38:13.096430 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 56/112] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Sep 10 11:38:13 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:38:13.105384 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bb492fc1-33d5-4e55-ab5c-385c2494e03d tempest-HypervisorAdminNegativeTestJSON-1361042168 tempest-HypervisorAdminNegativeTestJSON-1361042168-project-admin] Calling method '.version_select at 0x7f40780ddaf0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:13.111046 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-bb492fc1-33d5-4e55-ab5c-385c2494e03d tempest-HypervisorAdminNegativeTestJSON-1361042168 tempest-HypervisorAdminNegativeTestJSON-1361042168-project-admin] HTTP exception thrown: Hypervisor with ID 'ebb79bcc-2d83-42b0-86e6-f87b6b8ac531' could not be found. Sep 10 11:38:13.123899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bb492fc1-33d5-4e55-ab5c-385c2494e03d tempest-HypervisorAdminNegativeTestJSON-1361042168 tempest-HypervisorAdminNegativeTestJSON-1361042168-project-admin] Request method failure captured: Sep 10 11:38:13.123899 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/os-hypervisors/ebb79bcc-2d83-42b0-86e6-f87b6b8ac531 HTTP/1.1 Sep 10 11:38:13.123899 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:38:13.123899 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:38:13.123899 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:38:13.123899 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:38:13.123899 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:38:13.123899 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:38:13.123899 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:38:13.123899 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:38:13.123899 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHcipp7t_Z2u3iO17MoMBjuE8nX-EvQdQaOgpBMS-ZLArQddib7-HEct6kUloRQX__Xq8JU2tOym3CJIc3LNPhUY8u1vcoFfnwDmfcN4ze4UOAvzT42LfmqAn0_bqCmeKCXfC2AgdBH1VxQbpNAEHv5bsia43l5xQBxoW9NZaJkytj0 Sep 10 11:38:13.123899 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:38:13.123899 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:38:13.123899 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:38:13.123899 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:38:13.123899 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:38:13.123899 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:38:13.123899 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 5d48d2a6d44f456c820ca20cd3848098 Sep 10 11:38:13.123899 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1361042168 Sep 10 11:38:13.123899 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,admin,member Sep 10 11:38:13.123899 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,admin,member Sep 10 11:38:13.125151 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d48d2a6d44f456c820ca20cd3848098"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d48d2a6d44f456c820ca20cd3848098"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5d48d2a6d44f456c820ca20cd3848098", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5d48d2a6d44f456c820ca20cd3848098"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:38:13.125151 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1361042168 Sep 10 11:38:13.125151 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 5d48d2a6d44f456c820ca20cd3848098 Sep 10 11:38:13.125151 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1361042168 Sep 10 11:38:13.125151 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-HypervisorAdminNegativeTestJSON-1361042168-project-admin Sep 10 11:38:13.125151 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:38:13.125151 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:38:13.125151 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 954bf0a4c7a14d6d955f8f1adeb7941e Sep 10 11:38:13.125151 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1361042168-project-admin Sep 10 11:38:13.125151 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:38:13.125151 n-d-856895-1 devstack@n-api.service[128776]: exception: Hypervisor with ID 'ebb79bcc-2d83-42b0-86e6-f87b6b8ac531' could not be found. Sep 10 11:38:13.125151 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'ebb79bcc-2d83-42b0-86e6-f87b6b8ac531'} Sep 10 11:38:13.125762 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:38:13.125762 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:13.125762 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 10 11:38:13.125762 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 10 11:38:13.125762 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'ebb79bcc-2d83-42b0-86e6-f87b6b8ac531' Sep 10 11:38:13.125762 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:13.125762 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:13.125762 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:13.125762 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:13.125762 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 10 11:38:13.125762 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 10 11:38:13.125762 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 10 11:38:13.125762 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 10 11:38:13.125762 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 10 11:38:13.125762 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:13.125762 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:13.125762 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:13.125762 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:13.125762 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 10 11:38:13.125762 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 10 11:38:13.125762 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 10 11:38:13.125762 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 10 11:38:13.126813 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 10 11:38:13.126813 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:13.126813 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:13.126813 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:13.126813 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:13.126813 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:13.126813 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:13.126813 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:38:13.126813 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:38:13.126813 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:38:13.126813 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:38:13.126813 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:38:13.126813 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:38:13.126813 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 10 11:38:13.126813 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 10 11:38:13.126813 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Sep 10 11:38:13.126813 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 10 11:38:13.126813 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 10 11:38:13.126813 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 10 11:38:13.126813 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'ebb79bcc-2d83-42b0-86e6-f87b6b8ac531' could not be found. Sep 10 11:38:13.127835 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:13.127835 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:13.127835 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:13.127835 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:13.127835 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:13.127835 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:13.127835 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:38:13.127835 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:38:13.127835 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'ebb79bcc-2d83-42b0-86e6-f87b6b8ac531' could not be found. Sep 10 11:38:13.127835 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:13.136115 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bb492fc1-33d5-4e55-ab5c-385c2494e03d tempest-HypervisorAdminNegativeTestJSON-1361042168 tempest-HypervisorAdminNegativeTestJSON-1361042168-project-admin] Returning 404 to user: Hypervisor with ID 'ebb79bcc-2d83-42b0-86e6-f87b6b8ac531' could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:38:13.139449 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bb492fc1-33d5-4e55-ab5c-385c2494e03d tempest-HypervisorAdminNegativeTestJSON-1361042168 tempest-HypervisorAdminNegativeTestJSON-1361042168-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/ebb79bcc-2d83-42b0-86e6-f87b6b8ac531" status: 404 len: 123 microversion: 2.1 time: 0.037584 Sep 10 11:38:13.140252 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 57/113] 10.222.0.23 () {58 vars in 1257 bytes} [Sat Sep 10 11:38:13 2022] GET /compute/v2.1/os-hypervisors/ebb79bcc-2d83-42b0-86e6-f87b6b8ac531 => generated 123 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:38:13.323538 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f2ad6c2a-b3ef-4d78-8e4d-33419ad81d5b tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:13.323538 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f2ad6c2a-b3ef-4d78-8e4d-33419ad81d5b tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 749908de-9f45-4b7f-9ce5-171d2cf11511] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:13.334880 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f2ad6c2a-b3ef-4d78-8e4d-33419ad81d5b tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:13.335414 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f2ad6c2a-b3ef-4d78-8e4d-33419ad81d5b tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:13.335854 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f2ad6c2a-b3ef-4d78-8e4d-33419ad81d5b tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:13.336567 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f2ad6c2a-b3ef-4d78-8e4d-33419ad81d5b tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:13.337029 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f2ad6c2a-b3ef-4d78-8e4d-33419ad81d5b tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:13.337458 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f2ad6c2a-b3ef-4d78-8e4d-33419ad81d5b tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:13.396969 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f8ea58d8-3bc4-4498-a66e-fffed30a33aa tempest-FlavorMetadataValidation-1170729186 tempest-FlavorMetadataValidation-1170729186-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-2062317085", "id": 260582451, "os-flavor-access:is_public": "True"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:13.435323 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f8ea58d8-3bc4-4498-a66e-fffed30a33aa tempest-FlavorMetadataValidation-1170729186 tempest-FlavorMetadataValidation-1170729186-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.86 time: 0.548196 Sep 10 11:38:13.440549 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 57/114] 10.222.0.23 () {62 vars in 1188 bytes} [Sat Sep 10 11:38:12 2022] POST /compute/v2.1/flavors => generated 468 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:38:13.453729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ae49088d-04db-4ce6-8e28-8af8b00c27e9 tempest-FlavorMetadataValidation-1170729186 tempest-FlavorMetadataValidation-1170729186-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:13.513123 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f2ad6c2a-b3ef-4d78-8e4d-33419ad81d5b tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b632d0a5ac48fea0da5aa15632cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a040213a0ea443cd97b346b0d4e79d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:13.529943 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f2ad6c2a-b3ef-4d78-8e4d-33419ad81d5b tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511" status: 200 len: 1278 microversion: 2.1 time: 0.211365 Sep 10 11:38:13.540044 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 58/115] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:13 2022] GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511 => generated 1278 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:38:13.835385 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-13e9eaba-016c-45ae-b470-e3ca9fb58fd7 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:13.837497 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-13e9eaba-016c-45ae-b470-e3ca9fb58fd7 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] [instance: b33b0f22-808a-483c-9683-a16f98eccfa6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:13.852171 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13e9eaba-016c-45ae-b470-e3ca9fb58fd7 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:13.855559 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13e9eaba-016c-45ae-b470-e3ca9fb58fd7 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:13.860182 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13e9eaba-016c-45ae-b470-e3ca9fb58fd7 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:13.861364 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13e9eaba-016c-45ae-b470-e3ca9fb58fd7 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:13.862785 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13e9eaba-016c-45ae-b470-e3ca9fb58fd7 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:13.870233 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13e9eaba-016c-45ae-b470-e3ca9fb58fd7 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:14.086657 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ae49088d-04db-4ce6-8e28-8af8b00c27e9 tempest-FlavorMetadataValidation-1170729186 tempest-FlavorMetadataValidation-1170729186-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/260582451/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.635188 Sep 10 11:38:14.088739 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 58/116] 10.222.0.23 () {62 vars in 1262 bytes} [Sat Sep 10 11:38:13 2022] POST /compute/v2.1/flavors/260582451/os-extra_specs => generated 62 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:38:14.110994 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2763b0fc-a149-4e99-a196-fde83b12e234 tempest-FlavorMetadataValidation-1170729186 tempest-FlavorMetadataValidation-1170729186-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:14.159085 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2763b0fc-a149-4e99-a196-fde83b12e234 tempest-FlavorMetadataValidation-1170729186 tempest-FlavorMetadataValidation-1170729186-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/260582451" status: 202 len: 0 microversion: 2.86 time: 0.063350 Sep 10 11:38:14.161826 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 59/117] 10.222.0.23 () {60 vars in 1199 bytes} [Sat Sep 10 11:38:14 2022] DELETE /compute/v2.1/flavors/260582451 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:38:14.359326 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-13e9eaba-016c-45ae-b470-e3ca9fb58fd7 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce70607350b14ce98add3c72ed36c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8943799e9af4699bcfd87690773282e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:14.372464 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-13e9eaba-016c-45ae-b470-e3ca9fb58fd7 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] 10.222.0.23 "GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6" status: 200 len: 1338 microversion: 2.1 time: 0.542351 Sep 10 11:38:14.377264 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 59/118] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:13 2022] GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6 => generated 1338 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:14.391023 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-88cd01fa-c672-4f45-9d56-09fdc8890499 tempest-FlavorMetadataValidation-1170729186 tempest-FlavorMetadataValidation-1170729186-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:14.456106 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-88cd01fa-c672-4f45-9d56-09fdc8890499 tempest-FlavorMetadataValidation-1170729186 tempest-FlavorMetadataValidation-1170729186-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.077450 Sep 10 11:38:14.469923 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 60/119] 10.222.0.23 () {60 vars in 1187 bytes} [Sat Sep 10 11:38:14 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:38:14.565144 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-78b13776-b867-438d-851e-c5075726b98e tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:14.565938 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-78b13776-b867-438d-851e-c5075726b98e tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 749908de-9f45-4b7f-9ce5-171d2cf11511] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:14.579943 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-78b13776-b867-438d-851e-c5075726b98e tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:14.583343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-78b13776-b867-438d-851e-c5075726b98e tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:14.587551 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-78b13776-b867-438d-851e-c5075726b98e tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:14.589285 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-78b13776-b867-438d-851e-c5075726b98e tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:14.592415 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-78b13776-b867-438d-851e-c5075726b98e tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:14.593797 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-78b13776-b867-438d-851e-c5075726b98e tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:14.837618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c7852909-92dc-4d94-b258-2f13fa3d16e3 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:14.873142 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c7852909-92dc-4d94-b258-2f13fa3d16e3 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.709940 Sep 10 11:38:14.876681 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 60/120] 10.222.0.23 () {58 vars in 1137 bytes} [Sat Sep 10 11:38:14 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:14.897106 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-78b13776-b867-438d-851e-c5075726b98e tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b632d0a5ac48fea0da5aa15632cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a040213a0ea443cd97b346b0d4e79d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:14.908396 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-78b13776-b867-438d-851e-c5075726b98e tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511" status: 200 len: 1320 microversion: 2.1 time: 0.346889 Sep 10 11:38:14.911678 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 61/121] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:14 2022] GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511 => generated 1320 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:38:15.400102 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e9c0791c-fa24-406c-8176-80eba58904c6 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:15.403671 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e9c0791c-fa24-406c-8176-80eba58904c6 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] [instance: b33b0f22-808a-483c-9683-a16f98eccfa6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:15.428210 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e9c0791c-fa24-406c-8176-80eba58904c6 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:15.430354 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e9c0791c-fa24-406c-8176-80eba58904c6 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:15.433256 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e9c0791c-fa24-406c-8176-80eba58904c6 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:15.437131 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e9c0791c-fa24-406c-8176-80eba58904c6 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:15.440876 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e9c0791c-fa24-406c-8176-80eba58904c6 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:15.444696 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e9c0791c-fa24-406c-8176-80eba58904c6 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:15.491617 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:38:15.681787 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e9c0791c-fa24-406c-8176-80eba58904c6 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce70607350b14ce98add3c72ed36c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8943799e9af4699bcfd87690773282e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:15.689936 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e9c0791c-fa24-406c-8176-80eba58904c6 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] 10.222.0.23 "GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6" status: 200 len: 1338 microversion: 2.1 time: 0.295924 Sep 10 11:38:15.691962 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 62/122] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:15 2022] GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6 => generated 1338 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:38:15.733263 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1880b59f-c23b-4deb-a18a-79040a3436d3 tempest-ServersWithSpecificFlavorTestJSON-657795576 tempest-ServersWithSpecificFlavorTestJSON-657795576-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1687936296", "id": 435889313, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:15.830193 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1880b59f-c23b-4deb-a18a-79040a3436d3 tempest-ServersWithSpecificFlavorTestJSON-657795576 tempest-ServersWithSpecificFlavorTestJSON-657795576-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.944557 Sep 10 11:38:15.831267 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 61/123] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:38:14 2022] POST /compute/v2.1/flavors => generated 422 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:15.853229 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-42ca575e-ec73-4e16-aaf5-90ae406fe819 tempest-ServersWithSpecificFlavorTestJSON-657795576 tempest-ServersWithSpecificFlavorTestJSON-657795576-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:15.877674 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-42ca575e-ec73-4e16-aaf5-90ae406fe819 tempest-ServersWithSpecificFlavorTestJSON-657795576 tempest-ServersWithSpecificFlavorTestJSON-657795576-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.032134 Sep 10 11:38:15.879228 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 63/124] 10.222.0.23 () {58 vars in 1182 bytes} [Sat Sep 10 11:38:15 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:38:15.891842 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f3e2e945-3c6d-4a46-a2f9-bc31c0ab67d2 tempest-ServersWithSpecificFlavorTestJSON-657795576 tempest-ServersWithSpecificFlavorTestJSON-657795576-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-783493368", "id": 2057106990, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:15.940148 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f3e2e945-3c6d-4a46-a2f9-bc31c0ab67d2 tempest-ServersWithSpecificFlavorTestJSON-657795576 tempest-ServersWithSpecificFlavorTestJSON-657795576-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.052304 Sep 10 11:38:15.941305 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 62/125] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:38:15 2022] POST /compute/v2.1/flavors => generated 424 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:38:15.956999 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f7cc496d-30e1-47aa-9ff3-ba8c23aa1a15 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:15.958564 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f7cc496d-30e1-47aa-9ff3-ba8c23aa1a15 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 749908de-9f45-4b7f-9ce5-171d2cf11511] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:15.968006 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f7cc496d-30e1-47aa-9ff3-ba8c23aa1a15 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:15.969187 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f7cc496d-30e1-47aa-9ff3-ba8c23aa1a15 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:15.970278 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f7cc496d-30e1-47aa-9ff3-ba8c23aa1a15 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:15.972213 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f7cc496d-30e1-47aa-9ff3-ba8c23aa1a15 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:15.976279 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f7cc496d-30e1-47aa-9ff3-ba8c23aa1a15 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:15.977590 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1ef68fb8-1169-46b4-801f-71764f97fd09 tempest-ServersWithSpecificFlavorTestJSON-657795576 tempest-ServersWithSpecificFlavorTestJSON-657795576-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:15.978129 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f7cc496d-30e1-47aa-9ff3-ba8c23aa1a15 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:16.000049 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1ef68fb8-1169-46b4-801f-71764f97fd09 tempest-ServersWithSpecificFlavorTestJSON-657795576 tempest-ServersWithSpecificFlavorTestJSON-657795576-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.035333 Sep 10 11:38:16.003418 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 63/126] 10.222.0.23 () {58 vars in 1182 bytes} [Sat Sep 10 11:38:15 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:38:16.022243 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f1ee6a4a-5a8c-4374-8e79-33d5ce6b3f1e tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Action: 'create', calling method: .version_select at 0x7f4073f64af0>, body: {"keypair": {"name": "tempest-keypair-567849478", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVT1xtdrwpK1b4irL5HtQwkA2qlrlPuKcZwnyoQwDkVufMFaZ59DWOE2dExf3NN5NIyroCv1TLaHHY1T5HiruceEwNUBDW1tIVEowWiRANNXc0dILvorKOI5xnDT68iHg=="}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:16.083511 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-f1ee6a4a-5a8c-4374-8e79-33d5ce6b3f1e tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Getting quotas for project 2c44e3e2920e48868e1c05f70b1d7639. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:38:16.099479 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-f1ee6a4a-5a8c-4374-8e79-33d5ce6b3f1e tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Getting quotas for user b64e2df030a745de8ae7eda29d2ac30a and project 2c44e3e2920e48868e1c05f70b1d7639. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:38:16.181529 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f1ee6a4a-5a8c-4374-8e79-33d5ce6b3f1e tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.169217 Sep 10 11:38:16.190172 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 64/127] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 11:38:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:16.330836 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f7cc496d-30e1-47aa-9ff3-ba8c23aa1a15 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b632d0a5ac48fea0da5aa15632cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a040213a0ea443cd97b346b0d4e79d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:16.342587 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f7cc496d-30e1-47aa-9ff3-ba8c23aa1a15 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511" status: 200 len: 1320 microversion: 2.1 time: 0.391425 Sep 10 11:38:16.343678 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 64/128] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:15 2022] GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511 => generated 1320 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:38:16.730503 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5e0cc318-2e1f-4350-bb09-3cad7a0467eb tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:16.732117 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5e0cc318-2e1f-4350-bb09-3cad7a0467eb tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] [instance: b33b0f22-808a-483c-9683-a16f98eccfa6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:16.746680 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5e0cc318-2e1f-4350-bb09-3cad7a0467eb tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:16.756143 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5e0cc318-2e1f-4350-bb09-3cad7a0467eb tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:16.759272 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5e0cc318-2e1f-4350-bb09-3cad7a0467eb tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:16.762823 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5e0cc318-2e1f-4350-bb09-3cad7a0467eb tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:16.769669 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5e0cc318-2e1f-4350-bb09-3cad7a0467eb tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:16.774805 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5e0cc318-2e1f-4350-bb09-3cad7a0467eb tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:17.385010 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-65d65b7c-9733-4b20-ac5b-0a50b444dafd tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:17.385844 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-65d65b7c-9733-4b20-ac5b-0a50b444dafd tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 749908de-9f45-4b7f-9ce5-171d2cf11511] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:17.407457 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65d65b7c-9733-4b20-ac5b-0a50b444dafd tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:17.410340 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65d65b7c-9733-4b20-ac5b-0a50b444dafd tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:17.412072 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65d65b7c-9733-4b20-ac5b-0a50b444dafd tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:17.415037 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65d65b7c-9733-4b20-ac5b-0a50b444dafd tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:17.422116 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65d65b7c-9733-4b20-ac5b-0a50b444dafd tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:17.423088 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65d65b7c-9733-4b20-ac5b-0a50b444dafd tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:17.443952 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5e0cc318-2e1f-4350-bb09-3cad7a0467eb tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce70607350b14ce98add3c72ed36c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8943799e9af4699bcfd87690773282e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:17.460306 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5e0cc318-2e1f-4350-bb09-3cad7a0467eb tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] 10.222.0.23 "GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6" status: 200 len: 1338 microversion: 2.1 time: 0.728986 Sep 10 11:38:17.462226 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 65/129] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:16 2022] GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6 => generated 1338 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:18.102066 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=43,nova_cell0:UPDATE=7 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:38:18.260122 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-65d65b7c-9733-4b20-ac5b-0a50b444dafd tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b632d0a5ac48fea0da5aa15632cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a040213a0ea443cd97b346b0d4e79d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:18.275988 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-65d65b7c-9733-4b20-ac5b-0a50b444dafd tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511" status: 200 len: 1320 microversion: 2.1 time: 0.898268 Sep 10 11:38:18.281981 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 65/130] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:17 2022] GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511 => generated 1320 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:18.490093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bed66cda-2c94-40d2-84e8-eb4a5c8b75f7 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:18.491386 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bed66cda-2c94-40d2-84e8-eb4a5c8b75f7 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] [instance: b33b0f22-808a-483c-9683-a16f98eccfa6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:18.511026 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bed66cda-2c94-40d2-84e8-eb4a5c8b75f7 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:18.513878 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bed66cda-2c94-40d2-84e8-eb4a5c8b75f7 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:18.516634 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bed66cda-2c94-40d2-84e8-eb4a5c8b75f7 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:18.518737 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bed66cda-2c94-40d2-84e8-eb4a5c8b75f7 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:18.523323 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bed66cda-2c94-40d2-84e8-eb4a5c8b75f7 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:18.524020 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bed66cda-2c94-40d2-84e8-eb4a5c8b75f7 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:19.206040 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-20b29dbc-1a6a-4243-9f1e-57e5e07ca39f req-c07895a8-c8d6-4c3c-b871-d7abebfce98a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "749908de-9f45-4b7f-9ce5-171d2cf11511", "tag": "827daca3-67d0-4ffc-a4e0-4ba6d318438e"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:19.225937 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-20b29dbc-1a6a-4243-9f1e-57e5e07ca39f req-c07895a8-c8d6-4c3c-b871-d7abebfce98a service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:19.226740 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-20b29dbc-1a6a-4243-9f1e-57e5e07ca39f req-c07895a8-c8d6-4c3c-b871-d7abebfce98a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:19.227563 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-20b29dbc-1a6a-4243-9f1e-57e5e07ca39f req-c07895a8-c8d6-4c3c-b871-d7abebfce98a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:19.253941 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-20b29dbc-1a6a-4243-9f1e-57e5e07ca39f req-c07895a8-c8d6-4c3c-b871-d7abebfce98a service nova] Creating event network-changed:827daca3-67d0-4ffc-a4e0-4ba6d318438e for instance 749908de-9f45-4b7f-9ce5-171d2cf11511 on n-h1-856895-1 Sep 10 11:38:19.265919 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-20b29dbc-1a6a-4243-9f1e-57e5e07ca39f req-c07895a8-c8d6-4c3c-b871-d7abebfce98a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061150 Sep 10 11:38:19.267352 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 66/131] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:38:19.308554 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c841e220-fe05-4379-b891-651df34a629d tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:19.309586 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c841e220-fe05-4379-b891-651df34a629d tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 749908de-9f45-4b7f-9ce5-171d2cf11511] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:19.316531 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c841e220-fe05-4379-b891-651df34a629d tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:19.317987 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c841e220-fe05-4379-b891-651df34a629d tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:19.318742 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c841e220-fe05-4379-b891-651df34a629d tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:19.323239 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c841e220-fe05-4379-b891-651df34a629d tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:19.325733 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c841e220-fe05-4379-b891-651df34a629d tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:19.326424 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c841e220-fe05-4379-b891-651df34a629d tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:19.891587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bed66cda-2c94-40d2-84e8-eb4a5c8b75f7 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce70607350b14ce98add3c72ed36c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8943799e9af4699bcfd87690773282e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:19.895667 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=79 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:38:19.920212 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bed66cda-2c94-40d2-84e8-eb4a5c8b75f7 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] 10.222.0.23 "GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6" status: 200 len: 1338 microversion: 2.1 time: 1.434264 Sep 10 11:38:19.921676 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 66/132] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:18 2022] GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6 => generated 1338 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:20.130451 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=4 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:38:20.482792 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c841e220-fe05-4379-b891-651df34a629d tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b632d0a5ac48fea0da5aa15632cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a040213a0ea443cd97b346b0d4e79d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:20.493036 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c841e220-fe05-4379-b891-651df34a629d tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511" status: 200 len: 1320 microversion: 2.1 time: 1.188829 Sep 10 11:38:20.515203 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 67/133] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:19 2022] GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511 => generated 1320 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:38:20.585353 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6436434e-e7d6-443b-b873-ba92d2ad822d tempest-QuotasAdminTestV257-588700391 tempest-QuotasAdminTestV257-588700391-project-admin] Action: 'update', calling method: .version_select at 0x7f4073f06430>, body: {"quota_set": {"ram": "5120"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:20.767251 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6436434e-e7d6-443b-b873-ba92d2ad822d tempest-QuotasAdminTestV257-588700391 tempest-QuotasAdminTestV257-588700391-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:20.767742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6436434e-e7d6-443b-b873-ba92d2ad822d tempest-QuotasAdminTestV257-588700391 tempest-QuotasAdminTestV257-588700391-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:20.768175 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6436434e-e7d6-443b-b873-ba92d2ad822d tempest-QuotasAdminTestV257-588700391 tempest-QuotasAdminTestV257-588700391-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:20.771395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6436434e-e7d6-443b-b873-ba92d2ad822d tempest-QuotasAdminTestV257-588700391 tempest-QuotasAdminTestV257-588700391-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:20.774191 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6436434e-e7d6-443b-b873-ba92d2ad822d tempest-QuotasAdminTestV257-588700391 tempest-QuotasAdminTestV257-588700391-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:20.776210 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6436434e-e7d6-443b-b873-ba92d2ad822d tempest-QuotasAdminTestV257-588700391 tempest-QuotasAdminTestV257-588700391-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:20.915603 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6436434e-e7d6-443b-b873-ba92d2ad822d tempest-QuotasAdminTestV257-588700391 tempest-QuotasAdminTestV257-588700391-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/7ede50bd221b4aeb9aad3355cff4e3ed" status: 200 len: 148 microversion: 2.57 time: 0.992496 Sep 10 11:38:20.917374 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 67/134] 10.222.0.23 () {62 vars in 1303 bytes} [Sat Sep 10 11:38:19 2022] PUT /compute/v2.1/os-quota-sets/7ede50bd221b4aeb9aad3355cff4e3ed => generated 148 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:38:20.930228 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-79c80277-8238-4cd3-8d08-bfe23ad61d44 tempest-QuotasAdminTestV257-588700391 tempest-QuotasAdminTestV257-588700391-project-admin] Calling method '.version_select at 0x7f4073f90160>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:20.967228 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-58b2471f-2828-4b16-accf-95861b44a8cf tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:20.972585 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-58b2471f-2828-4b16-accf-95861b44a8cf tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] [instance: b33b0f22-808a-483c-9683-a16f98eccfa6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:20.976327 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:38:20.993034 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-58b2471f-2828-4b16-accf-95861b44a8cf tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:20.993724 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-58b2471f-2828-4b16-accf-95861b44a8cf tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:20.994178 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-58b2471f-2828-4b16-accf-95861b44a8cf tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:20.997692 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-58b2471f-2828-4b16-accf-95861b44a8cf tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:20.998180 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-58b2471f-2828-4b16-accf-95861b44a8cf tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:20.998626 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-58b2471f-2828-4b16-accf-95861b44a8cf tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:21.443254 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-58b2471f-2828-4b16-accf-95861b44a8cf tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce70607350b14ce98add3c72ed36c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8943799e9af4699bcfd87690773282e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:21.466061 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-58b2471f-2828-4b16-accf-95861b44a8cf tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] 10.222.0.23 "GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6" status: 200 len: 1338 microversion: 2.1 time: 0.506826 Sep 10 11:38:21.466758 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 68/135] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:20 2022] GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6 => generated 1338 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:21.520911 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-767405c0-3d65-4422-bb67-273a7aca2636 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:21.521896 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-767405c0-3d65-4422-bb67-273a7aca2636 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 749908de-9f45-4b7f-9ce5-171d2cf11511] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:21.542304 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-767405c0-3d65-4422-bb67-273a7aca2636 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:21.546997 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-767405c0-3d65-4422-bb67-273a7aca2636 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:21.546997 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-767405c0-3d65-4422-bb67-273a7aca2636 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:21.552420 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-767405c0-3d65-4422-bb67-273a7aca2636 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:21.554381 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-767405c0-3d65-4422-bb67-273a7aca2636 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:21.555019 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-767405c0-3d65-4422-bb67-273a7aca2636 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:21.585213 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79c80277-8238-4cd3-8d08-bfe23ad61d44 tempest-QuotasAdminTestV257-588700391 tempest-QuotasAdminTestV257-588700391-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:21.587406 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79c80277-8238-4cd3-8d08-bfe23ad61d44 tempest-QuotasAdminTestV257-588700391 tempest-QuotasAdminTestV257-588700391-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:21.588198 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79c80277-8238-4cd3-8d08-bfe23ad61d44 tempest-QuotasAdminTestV257-588700391 tempest-QuotasAdminTestV257-588700391-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:21.591143 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79c80277-8238-4cd3-8d08-bfe23ad61d44 tempest-QuotasAdminTestV257-588700391 tempest-QuotasAdminTestV257-588700391-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:21.592683 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79c80277-8238-4cd3-8d08-bfe23ad61d44 tempest-QuotasAdminTestV257-588700391 tempest-QuotasAdminTestV257-588700391-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:21.593495 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79c80277-8238-4cd3-8d08-bfe23ad61d44 tempest-QuotasAdminTestV257-588700391 tempest-QuotasAdminTestV257-588700391-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:21.680581 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-79c80277-8238-4cd3-8d08-bfe23ad61d44 tempest-QuotasAdminTestV257-588700391 tempest-QuotasAdminTestV257-588700391-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/7ede50bd221b4aeb9aad3355cff4e3ed/detail" status: 200 len: 463 microversion: 2.57 time: 0.756757 Sep 10 11:38:21.701814 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 68/136] 10.222.0.23 () {60 vars in 1304 bytes} [Sat Sep 10 11:38:20 2022] GET /compute/v2.1/os-quota-sets/7ede50bd221b4aeb9aad3355cff4e3ed/detail => generated 463 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:38:22.213185 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-767405c0-3d65-4422-bb67-273a7aca2636 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b632d0a5ac48fea0da5aa15632cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a040213a0ea443cd97b346b0d4e79d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:22.221261 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-767405c0-3d65-4422-bb67-273a7aca2636 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511" status: 200 len: 1320 microversion: 2.1 time: 0.705022 Sep 10 11:38:22.231284 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 69/137] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:21 2022] GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511 => generated 1320 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:22.462041 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fce80593-4e65-431c-9140-dd52594f2e12 tempest-QuotasAdminTestV257-588700391 tempest-QuotasAdminTestV257-588700391-project-admin] Action: 'update', calling method: .version_select at 0x7f40780e0280>, body: {"quota_set": {"ram": "2048"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:22.493840 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8947f789-538a-431d-a275-699f60c4d63d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:22.494466 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8947f789-538a-431d-a275-699f60c4d63d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] [instance: b33b0f22-808a-483c-9683-a16f98eccfa6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:22.516155 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8947f789-538a-431d-a275-699f60c4d63d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:22.516658 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8947f789-538a-431d-a275-699f60c4d63d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:22.517106 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8947f789-538a-431d-a275-699f60c4d63d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:22.517820 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8947f789-538a-431d-a275-699f60c4d63d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:22.518278 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8947f789-538a-431d-a275-699f60c4d63d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:22.518707 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8947f789-538a-431d-a275-699f60c4d63d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:23.314486 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8947f789-538a-431d-a275-699f60c4d63d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce70607350b14ce98add3c72ed36c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8943799e9af4699bcfd87690773282e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:23.328494 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8947f789-538a-431d-a275-699f60c4d63d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] 10.222.0.23 "GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6" status: 200 len: 1338 microversion: 2.1 time: 0.838392 Sep 10 11:38:23.334767 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 70/138] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:22 2022] GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6 => generated 1338 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:38:23.355606 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-224e4e3a-1661-4e4a-9020-74b2283354cd tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:23.364336 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-224e4e3a-1661-4e4a-9020-74b2283354cd tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 749908de-9f45-4b7f-9ce5-171d2cf11511] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:23.383633 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-224e4e3a-1661-4e4a-9020-74b2283354cd tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:23.384595 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-224e4e3a-1661-4e4a-9020-74b2283354cd tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:23.385604 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-224e4e3a-1661-4e4a-9020-74b2283354cd tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:23.387774 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-224e4e3a-1661-4e4a-9020-74b2283354cd tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:23.390111 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-224e4e3a-1661-4e4a-9020-74b2283354cd tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:23.390926 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-224e4e3a-1661-4e4a-9020-74b2283354cd tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:23.703683 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fce80593-4e65-431c-9140-dd52594f2e12 tempest-QuotasAdminTestV257-588700391 tempest-QuotasAdminTestV257-588700391-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:23.708257 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fce80593-4e65-431c-9140-dd52594f2e12 tempest-QuotasAdminTestV257-588700391 tempest-QuotasAdminTestV257-588700391-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:23.708940 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fce80593-4e65-431c-9140-dd52594f2e12 tempest-QuotasAdminTestV257-588700391 tempest-QuotasAdminTestV257-588700391-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:23.710067 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fce80593-4e65-431c-9140-dd52594f2e12 tempest-QuotasAdminTestV257-588700391 tempest-QuotasAdminTestV257-588700391-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:23.710534 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fce80593-4e65-431c-9140-dd52594f2e12 tempest-QuotasAdminTestV257-588700391 tempest-QuotasAdminTestV257-588700391-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:23.710960 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fce80593-4e65-431c-9140-dd52594f2e12 tempest-QuotasAdminTestV257-588700391 tempest-QuotasAdminTestV257-588700391-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:23.774281 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-224e4e3a-1661-4e4a-9020-74b2283354cd tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b632d0a5ac48fea0da5aa15632cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a040213a0ea443cd97b346b0d4e79d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:23.783566 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-224e4e3a-1661-4e4a-9020-74b2283354cd tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511" status: 200 len: 1320 microversion: 2.1 time: 0.447576 Sep 10 11:38:23.803532 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 71/139] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:23 2022] GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511 => generated 1320 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:23.901886 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fa424629-9b4a-4787-aa83-87b30dc86fbf tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1132342317", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "2057106990", "adminPass": "***", "networks": [{"uuid": "d4fb7237-4375-41be-b61d-e67b4c1202ba"}], "security_groups": [{"name": "tempest-securitygroup--1705104674"}], "key_name": "tempest-keypair-567849478", "user_data": "}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:23.921939 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fce80593-4e65-431c-9140-dd52594f2e12 tempest-QuotasAdminTestV257-588700391 tempest-QuotasAdminTestV257-588700391-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:23.925042 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fce80593-4e65-431c-9140-dd52594f2e12 tempest-QuotasAdminTestV257-588700391 tempest-QuotasAdminTestV257-588700391-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:23.932165 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fce80593-4e65-431c-9140-dd52594f2e12 tempest-QuotasAdminTestV257-588700391 tempest-QuotasAdminTestV257-588700391-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:23.936218 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fce80593-4e65-431c-9140-dd52594f2e12 tempest-QuotasAdminTestV257-588700391 tempest-QuotasAdminTestV257-588700391-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:23.940236 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fce80593-4e65-431c-9140-dd52594f2e12 tempest-QuotasAdminTestV257-588700391 tempest-QuotasAdminTestV257-588700391-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:23.941825 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fce80593-4e65-431c-9140-dd52594f2e12 tempest-QuotasAdminTestV257-588700391 tempest-QuotasAdminTestV257-588700391-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:24.218944 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fce80593-4e65-431c-9140-dd52594f2e12 tempest-QuotasAdminTestV257-588700391 tempest-QuotasAdminTestV257-588700391-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/7ede50bd221b4aeb9aad3355cff4e3ed?user_id=8662382a051b48e68a16871d415de0f5" status: 200 len: 148 microversion: 2.57 time: 1.763152 Sep 10 11:38:24.224948 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 69/140] 10.222.0.23 () {62 vars in 1384 bytes} [Sat Sep 10 11:38:22 2022] PUT /compute/v2.1/os-quota-sets/7ede50bd221b4aeb9aad3355cff4e3ed?user_id=8662382a051b48e68a16871d415de0f5 => generated 148 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:38:24.242315 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b195e328-42d3-4cea-a06d-357a51d88f38 tempest-QuotasAdminTestV257-588700391 tempest-QuotasAdminTestV257-588700391-project-admin] Calling method '.version_select at 0x7f4073f90f70>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:24.663406 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-fa424629-9b4a-4787-aa83-87b30dc86fbf tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] validate_networks() for [('d4fb7237-4375-41be-b61d-e67b4c1202ba', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:38:24.693703 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b195e328-42d3-4cea-a06d-357a51d88f38 tempest-QuotasAdminTestV257-588700391 tempest-QuotasAdminTestV257-588700391-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/7ede50bd221b4aeb9aad3355cff4e3ed?user_id=8662382a051b48e68a16871d415de0f5" status: 200 len: 190 microversion: 2.57 time: 0.459145 Sep 10 11:38:24.694755 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 70/141] 10.222.0.23 () {60 vars in 1364 bytes} [Sat Sep 10 11:38:24 2022] GET /compute/v2.1/os-quota-sets/7ede50bd221b4aeb9aad3355cff4e3ed?user_id=8662382a051b48e68a16871d415de0f5 => generated 190 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 10 11:38:24.700620 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-da56ea24-fcdd-413b-8ed7-2927deb75d17 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:24.701479 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-da56ea24-fcdd-413b-8ed7-2927deb75d17 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] [instance: b33b0f22-808a-483c-9683-a16f98eccfa6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:24.710141 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da56ea24-fcdd-413b-8ed7-2927deb75d17 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:24.712233 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da56ea24-fcdd-413b-8ed7-2927deb75d17 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:24.713205 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da56ea24-fcdd-413b-8ed7-2927deb75d17 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:24.715381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da56ea24-fcdd-413b-8ed7-2927deb75d17 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:24.716759 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da56ea24-fcdd-413b-8ed7-2927deb75d17 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:24.717413 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da56ea24-fcdd-413b-8ed7-2927deb75d17 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:25.307060 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-da56ea24-fcdd-413b-8ed7-2927deb75d17 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce70607350b14ce98add3c72ed36c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8943799e9af4699bcfd87690773282e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:25.316107 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-da56ea24-fcdd-413b-8ed7-2927deb75d17 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] 10.222.0.23 "GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6" status: 200 len: 1338 microversion: 2.1 time: 0.619844 Sep 10 11:38:25.329257 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 71/142] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:24 2022] GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6 => generated 1338 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:25.753979 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8316e597-d7b6-4460-955e-49ba6e81fc30 tempest-HypervisorAdminNegativeUnderV252Test-1538801748 tempest-HypervisorAdminNegativeUnderV252Test-1538801748-project-admin] Calling method '.version_select at 0x7f40780ddaf0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:25.756203 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8316e597-d7b6-4460-955e-49ba6e81fc30 tempest-HypervisorAdminNegativeUnderV252Test-1538801748 tempest-HypervisorAdminNegativeUnderV252Test-1538801748-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:25.756863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8316e597-d7b6-4460-955e-49ba6e81fc30 tempest-HypervisorAdminNegativeUnderV252Test-1538801748 tempest-HypervisorAdminNegativeUnderV252Test-1538801748-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:25.757461 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8316e597-d7b6-4460-955e-49ba6e81fc30 tempest-HypervisorAdminNegativeUnderV252Test-1538801748 tempest-HypervisorAdminNegativeUnderV252Test-1538801748-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:25.778442 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8316e597-d7b6-4460-955e-49ba6e81fc30 tempest-HypervisorAdminNegativeUnderV252Test-1538801748 tempest-HypervisorAdminNegativeUnderV252Test-1538801748-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:25.781513 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8316e597-d7b6-4460-955e-49ba6e81fc30 tempest-HypervisorAdminNegativeUnderV252Test-1538801748 tempest-HypervisorAdminNegativeUnderV252Test-1538801748-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:25.782782 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8316e597-d7b6-4460-955e-49ba6e81fc30 tempest-HypervisorAdminNegativeUnderV252Test-1538801748 tempest-HypervisorAdminNegativeUnderV252Test-1538801748-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:25.798434 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8316e597-d7b6-4460-955e-49ba6e81fc30 tempest-HypervisorAdminNegativeUnderV252Test-1538801748 tempest-HypervisorAdminNegativeUnderV252Test-1538801748-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:25.800167 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8316e597-d7b6-4460-955e-49ba6e81fc30 tempest-HypervisorAdminNegativeUnderV252Test-1538801748 tempest-HypervisorAdminNegativeUnderV252Test-1538801748-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:25.800859 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8316e597-d7b6-4460-955e-49ba6e81fc30 tempest-HypervisorAdminNegativeUnderV252Test-1538801748 tempest-HypervisorAdminNegativeUnderV252Test-1538801748-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:25.810051 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8316e597-d7b6-4460-955e-49ba6e81fc30 tempest-HypervisorAdminNegativeUnderV252Test-1538801748 tempest-HypervisorAdminNegativeUnderV252Test-1538801748-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.479632 Sep 10 11:38:25.811571 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 72/143] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:38:25 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:25.822571 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1617681f-0687-4c2a-b1ca-673db4d64213 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:25.824762 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1617681f-0687-4c2a-b1ca-673db4d64213 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 749908de-9f45-4b7f-9ce5-171d2cf11511] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:25.836976 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1617681f-0687-4c2a-b1ca-673db4d64213 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:25.837815 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1617681f-0687-4c2a-b1ca-673db4d64213 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:25.838486 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1617681f-0687-4c2a-b1ca-673db4d64213 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:25.840084 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1617681f-0687-4c2a-b1ca-673db4d64213 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:25.845909 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1617681f-0687-4c2a-b1ca-673db4d64213 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:25.846719 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1617681f-0687-4c2a-b1ca-673db4d64213 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:26.150171 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1617681f-0687-4c2a-b1ca-673db4d64213 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b632d0a5ac48fea0da5aa15632cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a040213a0ea443cd97b346b0d4e79d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:26.165815 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1617681f-0687-4c2a-b1ca-673db4d64213 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511" status: 200 len: 1320 microversion: 2.1 time: 0.352908 Sep 10 11:38:26.166409 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 73/144] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:25 2022] GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511 => generated 1320 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:26.209354 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-fa424629-9b4a-4787-aa83-87b30dc86fbf tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:38:26.210068 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-fa424629-9b4a-4787-aa83-87b30dc86fbf tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:38:26.210687 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-fa424629-9b4a-4787-aa83-87b30dc86fbf tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:38:26.211319 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-fa424629-9b4a-4787-aa83-87b30dc86fbf tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:38:26.212051 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-fa424629-9b4a-4787-aa83-87b30dc86fbf tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:38:26.233624 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fa424629-9b4a-4787-aa83-87b30dc86fbf tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:26.234114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fa424629-9b4a-4787-aa83-87b30dc86fbf tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:26.234553 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fa424629-9b4a-4787-aa83-87b30dc86fbf tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:26.235335 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fa424629-9b4a-4787-aa83-87b30dc86fbf tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:26.235793 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fa424629-9b4a-4787-aa83-87b30dc86fbf tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:26.236266 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fa424629-9b4a-4787-aa83-87b30dc86fbf tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:26.281161 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-fa424629-9b4a-4787-aa83-87b30dc86fbf tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Getting quotas for project 2c44e3e2920e48868e1c05f70b1d7639. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:38:26.284767 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-324dfb59-4950-42bf-9bfc-b03f29a4807c tempest-FlavorsV255TestJSON-1342856963 tempest-FlavorsV255TestJSON-1342856963-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1580435038", "id": 462582149, "os-flavor-access:is_public": "True"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:26.290955 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-fa424629-9b4a-4787-aa83-87b30dc86fbf tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Getting quotas for user b64e2df030a745de8ae7eda29d2ac30a and project 2c44e3e2920e48868e1c05f70b1d7639. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:38:26.293770 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=7,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:38:26.336778 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:38:26.357996 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fa424629-9b4a-4787-aa83-87b30dc86fbf tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:38:26.369774 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fa424629-9b4a-4787-aa83-87b30dc86fbf tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: cd42bf97-63e2-4a4b-a5db-d747a478dcbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:38:26.372791 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-324dfb59-4950-42bf-9bfc-b03f29a4807c tempest-FlavorsV255TestJSON-1342856963 tempest-FlavorsV255TestJSON-1342856963-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.197910 Sep 10 11:38:26.373464 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 74/145] 10.222.0.23 () {62 vars in 1188 bytes} [Sat Sep 10 11:38:26 2022] POST /compute/v2.1/flavors => generated 446 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:38:26.510501 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fa424629-9b4a-4787-aa83-87b30dc86fbf tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.616829 Sep 10 11:38:26.520678 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 72/146] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:38:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 2628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 11:38:26.533026 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-68254dc6-ab1d-4219-9c71-69ae56eaa206 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:26.538990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-68254dc6-ab1d-4219-9c71-69ae56eaa206 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] [instance: b33b0f22-808a-483c-9683-a16f98eccfa6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:26.548804 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-68254dc6-ab1d-4219-9c71-69ae56eaa206 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:26.551896 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-68254dc6-ab1d-4219-9c71-69ae56eaa206 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:26.554469 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-68254dc6-ab1d-4219-9c71-69ae56eaa206 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:26.556500 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-68254dc6-ab1d-4219-9c71-69ae56eaa206 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:26.557819 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-68254dc6-ab1d-4219-9c71-69ae56eaa206 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:26.558941 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-68254dc6-ab1d-4219-9c71-69ae56eaa206 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:26.646170 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-75f9218b-6835-4765-a306-e3abf74e54b2 tempest-HypervisorAdminNegativeUnderV252Test-742495159 tempest-HypervisorAdminNegativeUnderV252Test-742495159-project] Calling method '.version_select at 0x7f4073f8ff70>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:26.648989 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-75f9218b-6835-4765-a306-e3abf74e54b2 tempest-HypervisorAdminNegativeUnderV252Test-742495159 tempest-HypervisorAdminNegativeUnderV252Test-742495159-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'd229910e3e1a4612a4712cabc9fa0027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47b93316b1441eba6c1eec294e49007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:26.651121 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-75f9218b-6835-4765-a306-e3abf74e54b2 tempest-HypervisorAdminNegativeUnderV252Test-742495159 tempest-HypervisorAdminNegativeUnderV252Test-742495159-project] Request method failure captured: Sep 10 11:38:26.651121 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/os-hypervisors/n-h2-856895-1/search HTTP/1.1 Sep 10 11:38:26.651121 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:38:26.651121 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:38:26.651121 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:38:26.651121 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:38:26.651121 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:38:26.651121 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:38:26.651121 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:38:26.651121 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:38:26.651121 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHctIQWzSXI6UW-ANI8CXpm0DnLQetdJPzdXPI428YZ11e8uHLA9CppuAbbSNBOMlDK305bAH0XAIG2Feu8YQvoVksds5HveDXlbjzc1XTZRce8kdmhbyLUupHxflWUfPyJW4_aw5hUKk0EZDQ4JtQfoZImdY7Y5zXBoEDuYVus-5Pg Sep 10 11:38:26.651121 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:38:26.651121 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:38:26.651121 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:38:26.651121 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:38:26.651121 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:38:26.651121 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:38:26.651121 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: b47b93316b1441eba6c1eec294e49007 Sep 10 11:38:26.651121 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-742495159 Sep 10 11:38:26.651121 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:38:26.651121 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:38:26.652317 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b47b93316b1441eba6c1eec294e49007"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b47b93316b1441eba6c1eec294e49007"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b47b93316b1441eba6c1eec294e49007", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b47b93316b1441eba6c1eec294e49007"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:38:26.652317 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-742495159 Sep 10 11:38:26.652317 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: b47b93316b1441eba6c1eec294e49007 Sep 10 11:38:26.652317 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-742495159 Sep 10 11:38:26.652317 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-742495159-project Sep 10 11:38:26.652317 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:38:26.652317 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:38:26.652317 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: d229910e3e1a4612a4712cabc9fa0027 Sep 10 11:38:26.652317 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-742495159-project Sep 10 11:38:26.652317 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:38:26.652317 n-d-856895-1 devstack@n-api.service[128776]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 10 11:38:26.652317 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'n-h2-856895-1'} Sep 10 11:38:26.653107 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:38:26.653107 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:26.653107 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:26.653107 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:26.653107 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:38:26.653107 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:38:26.653107 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:38:26.653107 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:38:26.653107 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:38:26.653107 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:38:26.653107 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Sep 10 11:38:26.653107 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Sep 10 11:38:26.653107 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 11:38:26.653107 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 11:38:26.653107 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 11:38:26.653107 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 11:38:26.653107 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:38:26.653107 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:38:26.653107 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:38:26.654205 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:38:26.654205 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 11:38:26.654205 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 11:38:26.654205 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 11:38:26.654205 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 11:38:26.654205 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 11:38:26.654205 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 11:38:26.654205 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 10 11:38:26.654205 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:26.654205 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:26.654205 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:26.654205 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:26.654205 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:26.654205 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:26.654205 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 11:38:26.654205 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 11:38:26.654205 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 10 11:38:26.654205 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:26.655175 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-75f9218b-6835-4765-a306-e3abf74e54b2 tempest-HypervisorAdminNegativeUnderV252Test-742495159 tempest-HypervisorAdminNegativeUnderV252Test-742495159-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:38:26.655175 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-75f9218b-6835-4765-a306-e3abf74e54b2 tempest-HypervisorAdminNegativeUnderV252Test-742495159 tempest-HypervisorAdminNegativeUnderV252Test-742495159-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/n-h2-856895-1/search" status: 403 len: 117 microversion: 2.1 time: 0.279269 Sep 10 11:38:26.660250 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 75/147] 10.222.0.23 () {58 vars in 1209 bytes} [Sat Sep 10 11:38:26 2022] GET /compute/v2.1/os-hypervisors/n-h2-856895-1/search => generated 117 bytes in 286 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:38:26.940491 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-68254dc6-ab1d-4219-9c71-69ae56eaa206 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce70607350b14ce98add3c72ed36c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8943799e9af4699bcfd87690773282e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:26.951078 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1fd996c4-dfef-4e1e-9970-aa7f628e6229 tempest-FlavorsV255TestJSON-1973063987 tempest-FlavorsV255TestJSON-1973063987-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:26.964297 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-68254dc6-ab1d-4219-9c71-69ae56eaa206 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] 10.222.0.23 "GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6" status: 200 len: 1338 microversion: 2.1 time: 0.441857 Sep 10 11:38:26.969939 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 73/148] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:26 2022] GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6 => generated 1338 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:26.972021 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1fd996c4-dfef-4e1e-9970-aa7f628e6229 tempest-FlavorsV255TestJSON-1973063987 tempest-FlavorsV255TestJSON-1973063987-project] 10.222.0.23 "GET /compute/v2.1/flavors/462582149" status: 200 len: 446 microversion: 2.55 time: 0.310320 Sep 10 11:38:26.979927 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-49f3be35-fff2-4a4a-926b-6f0bbd9e39ba tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:26.983453 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-49f3be35-fff2-4a4a-926b-6f0bbd9e39ba tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: cd42bf97-63e2-4a4b-a5db-d747a478dcbd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:26.985205 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 76/149] 10.222.0.23 () {60 vars in 1196 bytes} [Sat Sep 10 11:38:26 2022] GET /compute/v2.1/flavors/462582149 => generated 446 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:38:26.998397 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b251394d-39b1-4755-834d-fe49e8e17b01 tempest-HypervisorAdminNegativeUnderV252Test-1538801748 tempest-HypervisorAdminNegativeUnderV252Test-1538801748-project-admin] Calling method '.version_select at 0x7f4073ffcdc0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:27.006647 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b251394d-39b1-4755-834d-fe49e8e17b01 tempest-HypervisorAdminNegativeUnderV252Test-1538801748 tempest-HypervisorAdminNegativeUnderV252Test-1538801748-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:27.009948 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b251394d-39b1-4755-834d-fe49e8e17b01 tempest-HypervisorAdminNegativeUnderV252Test-1538801748 tempest-HypervisorAdminNegativeUnderV252Test-1538801748-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:27.011021 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b251394d-39b1-4755-834d-fe49e8e17b01 tempest-HypervisorAdminNegativeUnderV252Test-1538801748 tempest-HypervisorAdminNegativeUnderV252Test-1538801748-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:27.052361 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-b251394d-39b1-4755-834d-fe49e8e17b01 tempest-HypervisorAdminNegativeUnderV252Test-1538801748 tempest-HypervisorAdminNegativeUnderV252Test-1538801748-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 10 11:38:27.053739 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b251394d-39b1-4755-834d-fe49e8e17b01 tempest-HypervisorAdminNegativeUnderV252Test-1538801748 tempest-HypervisorAdminNegativeUnderV252Test-1538801748-project-admin] Request method failure captured: Sep 10 11:38:27.053739 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Sep 10 11:38:27.053739 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:38:27.053739 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:38:27.053739 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:38:27.053739 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:38:27.053739 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:38:27.053739 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:38:27.053739 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:38:27.053739 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:38:27.053739 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHcwldpcPSjq-FQy6kckK38vpdcZ9exiTILBUP7st6nOxbEObHtruSOYa-vdfaUU5uawJ4ux6Oh90itR-_-7IDBIkYjsIWQOyQ22GKlNN7t_Nv7YH5lghoLVPKtdugeo5h_duvkf48iZOc7zLtvgAQFSxPCooB-oTsjNg3Hpr9qScCs Sep 10 11:38:27.053739 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:38:27.053739 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:38:27.053739 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:38:27.053739 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:38:27.053739 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:38:27.053739 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:38:27.053739 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: e687a986c3e44e5db3df5e3e3375b33a Sep 10 11:38:27.053739 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1538801748 Sep 10 11:38:27.053739 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,admin,member Sep 10 11:38:27.053739 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,admin,member Sep 10 11:38:27.054887 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e687a986c3e44e5db3df5e3e3375b33a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e687a986c3e44e5db3df5e3e3375b33a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e687a986c3e44e5db3df5e3e3375b33a", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e687a986c3e44e5db3df5e3e3375b33a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:38:27.054887 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1538801748 Sep 10 11:38:27.054887 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: e687a986c3e44e5db3df5e3e3375b33a Sep 10 11:38:27.054887 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1538801748 Sep 10 11:38:27.054887 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1538801748-project-admin Sep 10 11:38:27.054887 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:38:27.054887 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:38:27.054887 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: df88a558f6e849b3a133bfae297dcadc Sep 10 11:38:27.054887 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1538801748-project-admin Sep 10 11:38:27.054887 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:38:27.054887 n-d-856895-1 devstack@n-api.service[128776]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 10 11:38:27.054887 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'nonexistent_hypervisor_name'} Sep 10 11:38:27.055604 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:38:27.055604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:27.055604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:27.055604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:27.055604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:38:27.055604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:38:27.055604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:38:27.055604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:38:27.055604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:38:27.055604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:38:27.055604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Sep 10 11:38:27.055604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 10 11:38:27.055604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 10 11:38:27.055604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 10 11:38:27.055604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 10 11:38:27.055604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:27.055604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:27.055604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:27.055604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:27.055604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:27.062992 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:27.062992 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:38:27.062992 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:38:27.062992 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 10 11:38:27.062992 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:27.062992 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b251394d-39b1-4755-834d-fe49e8e17b01 tempest-HypervisorAdminNegativeUnderV252Test-1538801748 tempest-HypervisorAdminNegativeUnderV252Test-1538801748-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:38:27.062992 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b251394d-39b1-4755-834d-fe49e8e17b01 tempest-HypervisorAdminNegativeUnderV252Test-1538801748 tempest-HypervisorAdminNegativeUnderV252Test-1538801748-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.069421 Sep 10 11:38:27.062992 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 77/150] 10.222.0.23 () {58 vars in 1251 bytes} [Sat Sep 10 11:38:26 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:38:27.062992 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4c134be6-da5c-4f1d-af54-98b7dd1d0f90 tempest-FlavorsV255TestJSON-1342856963 tempest-FlavorsV255TestJSON-1342856963-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:27.095595 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-49f3be35-fff2-4a4a-926b-6f0bbd9e39ba tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64e2df030a745de8ae7eda29d2ac30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c44e3e2920e48868e1c05f70b1d7639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:27.110391 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-49f3be35-fff2-4a4a-926b-6f0bbd9e39ba tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "GET /compute/v2.1/servers/cd42bf97-63e2-4a4b-a5db-d747a478dcbd" status: 200 len: 1264 microversion: 2.1 time: 0.138779 Sep 10 11:38:27.111925 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 74/151] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:26 2022] GET /compute/v2.1/servers/cd42bf97-63e2-4a4b-a5db-d747a478dcbd => generated 1264 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:27.117674 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-191b3ad7-9e98-40e7-8a9e-dfb3e49ea47b tempest-HypervisorAdminNegativeUnderV252Test-1538801748 tempest-HypervisorAdminNegativeUnderV252Test-1538801748-project-admin] Calling method '.version_select at 0x7f4073e41820>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:27.119797 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-191b3ad7-9e98-40e7-8a9e-dfb3e49ea47b tempest-HypervisorAdminNegativeUnderV252Test-1538801748 tempest-HypervisorAdminNegativeUnderV252Test-1538801748-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:27.120519 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-191b3ad7-9e98-40e7-8a9e-dfb3e49ea47b tempest-HypervisorAdminNegativeUnderV252Test-1538801748 tempest-HypervisorAdminNegativeUnderV252Test-1538801748-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:27.120950 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-191b3ad7-9e98-40e7-8a9e-dfb3e49ea47b tempest-HypervisorAdminNegativeUnderV252Test-1538801748 tempest-HypervisorAdminNegativeUnderV252Test-1538801748-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:27.157242 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4c134be6-da5c-4f1d-af54-98b7dd1d0f90 tempest-FlavorsV255TestJSON-1342856963 tempest-FlavorsV255TestJSON-1342856963-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/462582149" status: 200 len: 447 microversion: 2.55 time: 0.099502 Sep 10 11:38:27.165834 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 78/152] 10.222.0.23 () {62 vars in 1216 bytes} [Sat Sep 10 11:38:27 2022] PUT /compute/v2.1/flavors/462582149 => generated 447 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:38:27.166017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-191b3ad7-9e98-40e7-8a9e-dfb3e49ea47b tempest-HypervisorAdminNegativeUnderV252Test-1538801748 tempest-HypervisorAdminNegativeUnderV252Test-1538801748-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:27.166017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-191b3ad7-9e98-40e7-8a9e-dfb3e49ea47b tempest-HypervisorAdminNegativeUnderV252Test-1538801748 tempest-HypervisorAdminNegativeUnderV252Test-1538801748-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:27.166017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-191b3ad7-9e98-40e7-8a9e-dfb3e49ea47b tempest-HypervisorAdminNegativeUnderV252Test-1538801748 tempest-HypervisorAdminNegativeUnderV252Test-1538801748-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:27.173968 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-86ac7fdd-d3a5-410a-a965-07619e3bd364 tempest-FlavorsV255TestJSON-1973063987 tempest-FlavorsV255TestJSON-1973063987-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:27.204393 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-191b3ad7-9e98-40e7-8a9e-dfb3e49ea47b tempest-HypervisorAdminNegativeUnderV252Test-1538801748 tempest-HypervisorAdminNegativeUnderV252Test-1538801748-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:27.213737 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-191b3ad7-9e98-40e7-8a9e-dfb3e49ea47b tempest-HypervisorAdminNegativeUnderV252Test-1538801748 tempest-HypervisorAdminNegativeUnderV252Test-1538801748-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:27.216515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-191b3ad7-9e98-40e7-8a9e-dfb3e49ea47b tempest-HypervisorAdminNegativeUnderV252Test-1538801748 tempest-HypervisorAdminNegativeUnderV252Test-1538801748-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:27.226716 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-86ac7fdd-d3a5-410a-a965-07619e3bd364 tempest-FlavorsV255TestJSON-1973063987 tempest-FlavorsV255TestJSON-1973063987-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6590 microversion: 2.55 time: 0.058187 Sep 10 11:38:27.228085 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 79/153] 10.222.0.23 () {60 vars in 1187 bytes} [Sat Sep 10 11:38:27 2022] GET /compute/v2.1/flavors/detail => generated 6590 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:38:27.234544 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6e520288-7e25-44a1-8c02-1c7d84f00747 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:27.234713 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-191b3ad7-9e98-40e7-8a9e-dfb3e49ea47b tempest-HypervisorAdminNegativeUnderV252Test-1538801748 tempest-HypervisorAdminNegativeUnderV252Test-1538801748-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.121713 Sep 10 11:38:27.235319 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 75/154] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:38:27 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:27.243029 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6e520288-7e25-44a1-8c02-1c7d84f00747 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 749908de-9f45-4b7f-9ce5-171d2cf11511] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:27.249618 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e520288-7e25-44a1-8c02-1c7d84f00747 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:27.250320 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e520288-7e25-44a1-8c02-1c7d84f00747 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:27.250568 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-252eb4af-2724-4107-8d9f-a2e106478c3b tempest-HypervisorAdminNegativeUnderV252Test-742495159 tempest-HypervisorAdminNegativeUnderV252Test-742495159-project] Calling method '.version_select at 0x7f4073f41b80>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:27.250766 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e520288-7e25-44a1-8c02-1c7d84f00747 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:27.251730 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e520288-7e25-44a1-8c02-1c7d84f00747 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:27.253544 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e520288-7e25-44a1-8c02-1c7d84f00747 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:27.254861 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e520288-7e25-44a1-8c02-1c7d84f00747 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:27.260654 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-252eb4af-2724-4107-8d9f-a2e106478c3b tempest-HypervisorAdminNegativeUnderV252Test-742495159 tempest-HypervisorAdminNegativeUnderV252Test-742495159-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'd229910e3e1a4612a4712cabc9fa0027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b47b93316b1441eba6c1eec294e49007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:27.267835 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-252eb4af-2724-4107-8d9f-a2e106478c3b tempest-HypervisorAdminNegativeUnderV252Test-742495159 tempest-HypervisorAdminNegativeUnderV252Test-742495159-project] Request method failure captured: Sep 10 11:38:27.267835 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Sep 10 11:38:27.267835 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:38:27.267835 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:38:27.267835 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:38:27.267835 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:38:27.267835 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:38:27.267835 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:38:27.267835 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:38:27.267835 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:38:27.267835 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHctIQWzSXI6UW-ANI8CXpm0DnLQetdJPzdXPI428YZ11e8uHLA9CppuAbbSNBOMlDK305bAH0XAIG2Feu8YQvoVksds5HveDXlbjzc1XTZRce8kdmhbyLUupHxflWUfPyJW4_aw5hUKk0EZDQ4JtQfoZImdY7Y5zXBoEDuYVus-5Pg Sep 10 11:38:27.267835 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:38:27.267835 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:38:27.267835 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:38:27.267835 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:38:27.267835 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:38:27.267835 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:38:27.267835 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: b47b93316b1441eba6c1eec294e49007 Sep 10 11:38:27.267835 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-742495159 Sep 10 11:38:27.267835 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:38:27.267835 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:38:27.269056 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b47b93316b1441eba6c1eec294e49007"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b47b93316b1441eba6c1eec294e49007"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b47b93316b1441eba6c1eec294e49007", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b47b93316b1441eba6c1eec294e49007"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:38:27.269056 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-742495159 Sep 10 11:38:27.269056 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: b47b93316b1441eba6c1eec294e49007 Sep 10 11:38:27.269056 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-742495159 Sep 10 11:38:27.269056 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-742495159-project Sep 10 11:38:27.269056 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:38:27.269056 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:38:27.269056 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: d229910e3e1a4612a4712cabc9fa0027 Sep 10 11:38:27.269056 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-742495159-project Sep 10 11:38:27.269056 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:38:27.269056 n-d-856895-1 devstack@n-api.service[128777]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 10 11:38:27.269056 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '1'} Sep 10 11:38:27.269751 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:38:27.269751 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:27.269751 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:27.269751 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:27.269751 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:38:27.269751 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:38:27.269751 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:38:27.269751 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:38:27.269751 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:38:27.269751 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:38:27.269751 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Sep 10 11:38:27.269751 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Sep 10 11:38:27.269751 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 11:38:27.269751 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 11:38:27.269751 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 11:38:27.269751 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 11:38:27.269751 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:38:27.269751 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:38:27.269751 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:38:27.271473 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:38:27.271473 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 11:38:27.271473 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 11:38:27.271473 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 11:38:27.271473 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 11:38:27.271473 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 11:38:27.271473 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 11:38:27.271473 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 10 11:38:27.271473 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:27.271473 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:27.271473 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:27.271473 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:27.271473 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:27.271473 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:27.271473 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 11:38:27.271473 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 11:38:27.271473 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 10 11:38:27.271473 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:27.277030 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-252eb4af-2724-4107-8d9f-a2e106478c3b tempest-HypervisorAdminNegativeUnderV252Test-742495159 tempest-HypervisorAdminNegativeUnderV252Test-742495159-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:38:27.278056 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-252eb4af-2724-4107-8d9f-a2e106478c3b tempest-HypervisorAdminNegativeUnderV252Test-742495159 tempest-HypervisorAdminNegativeUnderV252Test-742495159-project] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.033304 Sep 10 11:38:27.286908 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 76/155] 10.222.0.23 () {58 vars in 1176 bytes} [Sat Sep 10 11:38:27 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:38:27.300961 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bdd7ec2b-6f5c-4ad5-b397-277a467d995e tempest-FlavorsV255TestJSON-1973063987 tempest-FlavorsV255TestJSON-1973063987-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:27.355531 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bdd7ec2b-6f5c-4ad5-b397-277a467d995e tempest-FlavorsV255TestJSON-1973063987 tempest-FlavorsV255TestJSON-1973063987-project] 10.222.0.23 "GET /compute/v2.1/flavors" status: 200 len: 3680 microversion: 2.55 time: 0.070563 Sep 10 11:38:27.374052 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 77/156] 10.222.0.23 () {60 vars in 1166 bytes} [Sat Sep 10 11:38:27 2022] GET /compute/v2.1/flavors => generated 3680 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:38:27.380658 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fc9abc41-c489-4e7b-8e26-4f8b5546312d tempest-HypervisorAdminNegativeUnderV252Test-1538801748 tempest-HypervisorAdminNegativeUnderV252Test-1538801748-project-admin] Calling method '.version_select at 0x7f4073e15e50>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:27.382984 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc9abc41-c489-4e7b-8e26-4f8b5546312d tempest-HypervisorAdminNegativeUnderV252Test-1538801748 tempest-HypervisorAdminNegativeUnderV252Test-1538801748-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:27.383513 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc9abc41-c489-4e7b-8e26-4f8b5546312d tempest-HypervisorAdminNegativeUnderV252Test-1538801748 tempest-HypervisorAdminNegativeUnderV252Test-1538801748-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:27.384163 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc9abc41-c489-4e7b-8e26-4f8b5546312d tempest-HypervisorAdminNegativeUnderV252Test-1538801748 tempest-HypervisorAdminNegativeUnderV252Test-1538801748-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:27.403191 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-fc9abc41-c489-4e7b-8e26-4f8b5546312d tempest-HypervisorAdminNegativeUnderV252Test-1538801748 tempest-HypervisorAdminNegativeUnderV252Test-1538801748-project-admin] HTTP exception thrown: No hypervisor matching '45c031cd-8102-4cfc-bb01-2926beba7aaf' could be found. Sep 10 11:38:27.406029 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fc9abc41-c489-4e7b-8e26-4f8b5546312d tempest-HypervisorAdminNegativeUnderV252Test-1538801748 tempest-HypervisorAdminNegativeUnderV252Test-1538801748-project-admin] Request method failure captured: Sep 10 11:38:27.406029 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/os-hypervisors/45c031cd-8102-4cfc-bb01-2926beba7aaf/servers HTTP/1.1 Sep 10 11:38:27.406029 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:38:27.406029 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:38:27.406029 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:38:27.406029 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:38:27.406029 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:38:27.406029 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:38:27.406029 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:38:27.406029 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:38:27.406029 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHcwldpcPSjq-FQy6kckK38vpdcZ9exiTILBUP7st6nOxbEObHtruSOYa-vdfaUU5uawJ4ux6Oh90itR-_-7IDBIkYjsIWQOyQ22GKlNN7t_Nv7YH5lghoLVPKtdugeo5h_duvkf48iZOc7zLtvgAQFSxPCooB-oTsjNg3Hpr9qScCs Sep 10 11:38:27.406029 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:38:27.406029 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:38:27.406029 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:38:27.406029 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:38:27.406029 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:38:27.406029 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:38:27.406029 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: e687a986c3e44e5db3df5e3e3375b33a Sep 10 11:38:27.406029 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1538801748 Sep 10 11:38:27.406029 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,admin,member Sep 10 11:38:27.406029 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,admin,member Sep 10 11:38:27.407212 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e687a986c3e44e5db3df5e3e3375b33a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e687a986c3e44e5db3df5e3e3375b33a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e687a986c3e44e5db3df5e3e3375b33a", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e687a986c3e44e5db3df5e3e3375b33a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:38:27.407212 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1538801748 Sep 10 11:38:27.407212 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: e687a986c3e44e5db3df5e3e3375b33a Sep 10 11:38:27.407212 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1538801748 Sep 10 11:38:27.407212 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1538801748-project-admin Sep 10 11:38:27.407212 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:38:27.407212 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:38:27.407212 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: df88a558f6e849b3a133bfae297dcadc Sep 10 11:38:27.407212 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1538801748-project-admin Sep 10 11:38:27.407212 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:38:27.407212 n-d-856895-1 devstack@n-api.service[128777]: exception: No hypervisor matching '45c031cd-8102-4cfc-bb01-2926beba7aaf' could be found. Sep 10 11:38:27.407212 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '45c031cd-8102-4cfc-bb01-2926beba7aaf'} Sep 10 11:38:27.407855 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:38:27.407855 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:27.407855 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:27.407855 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:27.407855 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:38:27.407855 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:38:27.407855 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:38:27.407855 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:38:27.407855 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:38:27.407855 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:38:27.407855 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Sep 10 11:38:27.407855 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 10 11:38:27.407855 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 10 11:38:27.407855 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 10 11:38:27.407855 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '45c031cd-8102-4cfc-bb01-2926beba7aaf' could be found. Sep 10 11:38:27.407855 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:27.407855 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:27.407855 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:27.407855 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:27.408862 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:27.408862 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:27.408862 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:38:27.408862 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:38:27.408862 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '45c031cd-8102-4cfc-bb01-2926beba7aaf' could be found. Sep 10 11:38:27.408862 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:27.408862 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fc9abc41-c489-4e7b-8e26-4f8b5546312d tempest-HypervisorAdminNegativeUnderV252Test-1538801748 tempest-HypervisorAdminNegativeUnderV252Test-1538801748-project-admin] Returning 404 to user: No hypervisor matching '45c031cd-8102-4cfc-bb01-2926beba7aaf' could be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:38:27.408862 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fc9abc41-c489-4e7b-8e26-4f8b5546312d tempest-HypervisorAdminNegativeUnderV252Test-1538801748 tempest-HypervisorAdminNegativeUnderV252Test-1538801748-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/45c031cd-8102-4cfc-bb01-2926beba7aaf/servers" status: 404 len: 123 microversion: 2.1 time: 0.033650 Sep 10 11:38:27.411790 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 78/157] 10.222.0.23 () {58 vars in 1281 bytes} [Sat Sep 10 11:38:27 2022] GET /compute/v2.1/os-hypervisors/45c031cd-8102-4cfc-bb01-2926beba7aaf/servers => generated 123 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:38:27.418718 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b30f1a4f-8820-465c-927d-c30d02bdfa3b tempest-FlavorsV255TestJSON-1342856963 tempest-FlavorsV255TestJSON-1342856963-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:27.440227 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b30f1a4f-8820-465c-927d-c30d02bdfa3b tempest-FlavorsV255TestJSON-1342856963 tempest-FlavorsV255TestJSON-1342856963-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/462582149" status: 202 len: 0 microversion: 2.55 time: 0.027048 Sep 10 11:38:27.444823 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 79/158] 10.222.0.23 () {60 vars in 1199 bytes} [Sat Sep 10 11:38:27 2022] DELETE /compute/v2.1/flavors/462582149 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:38:27.454034 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5fe33c91-67ab-4929-bdb2-b6490589da15 tempest-FlavorsV255TestJSON-1342856963 tempest-FlavorsV255TestJSON-1342856963-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:27.506902 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6e520288-7e25-44a1-8c02-1c7d84f00747 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b632d0a5ac48fea0da5aa15632cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a040213a0ea443cd97b346b0d4e79d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:27.508978 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5fe33c91-67ab-4929-bdb2-b6490589da15 tempest-FlavorsV255TestJSON-1342856963 tempest-FlavorsV255TestJSON-1342856963-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6153 microversion: 2.55 time: 0.059695 Sep 10 11:38:27.510143 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 80/159] 10.222.0.23 () {60 vars in 1187 bytes} [Sat Sep 10 11:38:27 2022] GET /compute/v2.1/flavors/detail => generated 6153 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:38:27.531341 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6e520288-7e25-44a1-8c02-1c7d84f00747 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511" status: 200 len: 1320 microversion: 2.1 time: 0.300475 Sep 10 11:38:27.532261 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 80/160] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:27 2022] GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511 => generated 1320 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:27.990734 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-19af939a-f2c3-4707-bef6-902b9a9b19df tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:27.992005 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-19af939a-f2c3-4707-bef6-902b9a9b19df tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] [instance: b33b0f22-808a-483c-9683-a16f98eccfa6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:28.001289 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-19af939a-f2c3-4707-bef6-902b9a9b19df tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:28.001781 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-19af939a-f2c3-4707-bef6-902b9a9b19df tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:28.002218 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-19af939a-f2c3-4707-bef6-902b9a9b19df tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:28.002927 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-19af939a-f2c3-4707-bef6-902b9a9b19df tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:28.003411 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-19af939a-f2c3-4707-bef6-902b9a9b19df tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:28.003840 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-19af939a-f2c3-4707-bef6-902b9a9b19df tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:28.140694 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-87c5bc16-f128-46b0-bb67-d3caabee466a tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:28.142765 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-87c5bc16-f128-46b0-bb67-d3caabee466a tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: cd42bf97-63e2-4a4b-a5db-d747a478dcbd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:28.168938 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-87c5bc16-f128-46b0-bb67-d3caabee466a tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:28.170085 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-87c5bc16-f128-46b0-bb67-d3caabee466a tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:28.171738 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-87c5bc16-f128-46b0-bb67-d3caabee466a tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:28.173478 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-87c5bc16-f128-46b0-bb67-d3caabee466a tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:28.174561 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-87c5bc16-f128-46b0-bb67-d3caabee466a tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:28.175491 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-87c5bc16-f128-46b0-bb67-d3caabee466a tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:28.368078 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-87c5bc16-f128-46b0-bb67-d3caabee466a tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64e2df030a745de8ae7eda29d2ac30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c44e3e2920e48868e1c05f70b1d7639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:28.386073 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-87c5bc16-f128-46b0-bb67-d3caabee466a tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "GET /compute/v2.1/servers/cd42bf97-63e2-4a4b-a5db-d747a478dcbd" status: 200 len: 1338 microversion: 2.1 time: 0.251602 Sep 10 11:38:28.400179 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 81/161] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:28 2022] GET /compute/v2.1/servers/cd42bf97-63e2-4a4b-a5db-d747a478dcbd => generated 1338 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:28.409149 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-19af939a-f2c3-4707-bef6-902b9a9b19df tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce70607350b14ce98add3c72ed36c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8943799e9af4699bcfd87690773282e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:28.429977 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-19af939a-f2c3-4707-bef6-902b9a9b19df tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] 10.222.0.23 "GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6" status: 200 len: 1338 microversion: 2.1 time: 0.443299 Sep 10 11:38:28.434227 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 81/162] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:27 2022] GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6 => generated 1338 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:28.561942 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0f31fbca-f53f-46b9-bc17-ee79926145a2 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:28.562884 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0f31fbca-f53f-46b9-bc17-ee79926145a2 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 749908de-9f45-4b7f-9ce5-171d2cf11511] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:28.576665 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f31fbca-f53f-46b9-bc17-ee79926145a2 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:28.580120 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f31fbca-f53f-46b9-bc17-ee79926145a2 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:28.582045 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f31fbca-f53f-46b9-bc17-ee79926145a2 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:28.587397 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f31fbca-f53f-46b9-bc17-ee79926145a2 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:28.589423 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f31fbca-f53f-46b9-bc17-ee79926145a2 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:28.591217 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f31fbca-f53f-46b9-bc17-ee79926145a2 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:28.872126 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0f31fbca-f53f-46b9-bc17-ee79926145a2 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b632d0a5ac48fea0da5aa15632cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a040213a0ea443cd97b346b0d4e79d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:28.881389 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0f31fbca-f53f-46b9-bc17-ee79926145a2 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511" status: 200 len: 1320 microversion: 2.1 time: 0.328082 Sep 10 11:38:28.882826 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 82/163] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:28 2022] GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511 => generated 1320 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:29.436130 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2e0339eb-a547-4d65-b391-b1a43618961f tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:29.440060 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2e0339eb-a547-4d65-b391-b1a43618961f tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: cd42bf97-63e2-4a4b-a5db-d747a478dcbd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:29.458199 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-851c8a52-457b-4d2a-bb07-c64124526d96 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:29.458882 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-851c8a52-457b-4d2a-bb07-c64124526d96 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] [instance: b33b0f22-808a-483c-9683-a16f98eccfa6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:29.467434 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2e0339eb-a547-4d65-b391-b1a43618961f tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:29.468467 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2e0339eb-a547-4d65-b391-b1a43618961f tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:29.469302 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2e0339eb-a547-4d65-b391-b1a43618961f tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:29.470356 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2e0339eb-a547-4d65-b391-b1a43618961f tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:29.471122 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2e0339eb-a547-4d65-b391-b1a43618961f tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:29.471795 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-851c8a52-457b-4d2a-bb07-c64124526d96 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:29.471929 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2e0339eb-a547-4d65-b391-b1a43618961f tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:29.472293 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-851c8a52-457b-4d2a-bb07-c64124526d96 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:29.472802 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-851c8a52-457b-4d2a-bb07-c64124526d96 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:29.473642 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-851c8a52-457b-4d2a-bb07-c64124526d96 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:29.474103 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-851c8a52-457b-4d2a-bb07-c64124526d96 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:29.478784 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-851c8a52-457b-4d2a-bb07-c64124526d96 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:29.726633 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2e0339eb-a547-4d65-b391-b1a43618961f tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64e2df030a745de8ae7eda29d2ac30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c44e3e2920e48868e1c05f70b1d7639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:29.754660 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2e0339eb-a547-4d65-b391-b1a43618961f tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "GET /compute/v2.1/servers/cd42bf97-63e2-4a4b-a5db-d747a478dcbd" status: 200 len: 1344 microversion: 2.1 time: 0.328560 Sep 10 11:38:29.756693 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 82/164] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:29 2022] GET /compute/v2.1/servers/cd42bf97-63e2-4a4b-a5db-d747a478dcbd => generated 1344 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:29.859599 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-851c8a52-457b-4d2a-bb07-c64124526d96 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce70607350b14ce98add3c72ed36c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8943799e9af4699bcfd87690773282e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:29.870657 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-851c8a52-457b-4d2a-bb07-c64124526d96 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] 10.222.0.23 "GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6" status: 200 len: 1338 microversion: 2.1 time: 0.417737 Sep 10 11:38:29.884600 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 83/165] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:29 2022] GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6 => generated 1338 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:29.913420 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3a4d8a11-0cdf-4301-827a-cc5e0c4d2e39 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:29.914146 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3a4d8a11-0cdf-4301-827a-cc5e0c4d2e39 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 749908de-9f45-4b7f-9ce5-171d2cf11511] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:29.921314 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a4d8a11-0cdf-4301-827a-cc5e0c4d2e39 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:29.922170 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a4d8a11-0cdf-4301-827a-cc5e0c4d2e39 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:29.922853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a4d8a11-0cdf-4301-827a-cc5e0c4d2e39 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:29.923981 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a4d8a11-0cdf-4301-827a-cc5e0c4d2e39 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:29.927760 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a4d8a11-0cdf-4301-827a-cc5e0c4d2e39 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:29.928465 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a4d8a11-0cdf-4301-827a-cc5e0c4d2e39 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:30.263041 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3a4d8a11-0cdf-4301-827a-cc5e0c4d2e39 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b632d0a5ac48fea0da5aa15632cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a040213a0ea443cd97b346b0d4e79d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:30.312940 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3a4d8a11-0cdf-4301-827a-cc5e0c4d2e39 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511" status: 200 len: 1320 microversion: 2.1 time: 0.408700 Sep 10 11:38:30.323710 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 83/166] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:29 2022] GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511 => generated 1320 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:30.784924 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a04037be-48c1-407b-8ada-68f26c473e30 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:30.786769 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a04037be-48c1-407b-8ada-68f26c473e30 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: cd42bf97-63e2-4a4b-a5db-d747a478dcbd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:30.803420 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a04037be-48c1-407b-8ada-68f26c473e30 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:30.805267 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a04037be-48c1-407b-8ada-68f26c473e30 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:30.807356 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a04037be-48c1-407b-8ada-68f26c473e30 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:30.811059 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a04037be-48c1-407b-8ada-68f26c473e30 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:30.812817 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a04037be-48c1-407b-8ada-68f26c473e30 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:30.814349 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a04037be-48c1-407b-8ada-68f26c473e30 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:30.897947 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-328c348d-285a-4d14-bff7-0dd7a658c287 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:30.900393 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-328c348d-285a-4d14-bff7-0dd7a658c287 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] [instance: b33b0f22-808a-483c-9683-a16f98eccfa6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:30.921955 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-328c348d-285a-4d14-bff7-0dd7a658c287 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:30.922785 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-328c348d-285a-4d14-bff7-0dd7a658c287 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:30.923524 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-328c348d-285a-4d14-bff7-0dd7a658c287 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:30.927131 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-328c348d-285a-4d14-bff7-0dd7a658c287 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:30.933349 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-328c348d-285a-4d14-bff7-0dd7a658c287 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:30.934041 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-328c348d-285a-4d14-bff7-0dd7a658c287 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:30.999803 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a04037be-48c1-407b-8ada-68f26c473e30 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64e2df030a745de8ae7eda29d2ac30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c44e3e2920e48868e1c05f70b1d7639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:31.014393 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a04037be-48c1-407b-8ada-68f26c473e30 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "GET /compute/v2.1/servers/cd42bf97-63e2-4a4b-a5db-d747a478dcbd" status: 200 len: 1344 microversion: 2.1 time: 0.233881 Sep 10 11:38:31.015713 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 84/167] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:30 2022] GET /compute/v2.1/servers/cd42bf97-63e2-4a4b-a5db-d747a478dcbd => generated 1344 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:31.245033 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-328c348d-285a-4d14-bff7-0dd7a658c287 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce70607350b14ce98add3c72ed36c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8943799e9af4699bcfd87690773282e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:31.260697 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-328c348d-285a-4d14-bff7-0dd7a658c287 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] 10.222.0.23 "GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6" status: 200 len: 1338 microversion: 2.1 time: 0.368512 Sep 10 11:38:31.262626 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 84/168] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:30 2022] GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6 => generated 1338 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:38:31.343046 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6d499620-3fbc-4022-9aaa-ec90abec4aad tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:31.343728 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6d499620-3fbc-4022-9aaa-ec90abec4aad tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 749908de-9f45-4b7f-9ce5-171d2cf11511] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:31.354701 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6d499620-3fbc-4022-9aaa-ec90abec4aad tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:31.355222 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6d499620-3fbc-4022-9aaa-ec90abec4aad tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:31.355661 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6d499620-3fbc-4022-9aaa-ec90abec4aad tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:31.361050 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6d499620-3fbc-4022-9aaa-ec90abec4aad tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:31.362788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6d499620-3fbc-4022-9aaa-ec90abec4aad tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:31.364627 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6d499620-3fbc-4022-9aaa-ec90abec4aad tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:31.638270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6d499620-3fbc-4022-9aaa-ec90abec4aad tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b632d0a5ac48fea0da5aa15632cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a040213a0ea443cd97b346b0d4e79d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:31.663082 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6d499620-3fbc-4022-9aaa-ec90abec4aad tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511" status: 200 len: 1320 microversion: 2.1 time: 0.325669 Sep 10 11:38:31.664817 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 85/169] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:31 2022] GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511 => generated 1320 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:32.038197 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6989061a-3d9d-4cad-957f-483873ade2ab tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:32.038831 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6989061a-3d9d-4cad-957f-483873ade2ab tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: cd42bf97-63e2-4a4b-a5db-d747a478dcbd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:32.047901 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6989061a-3d9d-4cad-957f-483873ade2ab tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:32.048388 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6989061a-3d9d-4cad-957f-483873ade2ab tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:32.048825 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6989061a-3d9d-4cad-957f-483873ade2ab tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:32.049543 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6989061a-3d9d-4cad-957f-483873ade2ab tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:32.049991 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6989061a-3d9d-4cad-957f-483873ade2ab tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:32.050632 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6989061a-3d9d-4cad-957f-483873ade2ab tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:32.086987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-65ce395b-1988-498e-878c-9940185493cc req-0e88096b-5957-4d9f-81e2-69028e58796a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b33b0f22-808a-483c-9683-a16f98eccfa6", "name": "network-vif-plugged", "status": "completed", "tag": "9d826429-f324-4423-b183-ba434abae3e6"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:32.114763 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-65ce395b-1988-498e-878c-9940185493cc req-0e88096b-5957-4d9f-81e2-69028e58796a service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:32.115665 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-65ce395b-1988-498e-878c-9940185493cc req-0e88096b-5957-4d9f-81e2-69028e58796a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:32.116299 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-65ce395b-1988-498e-878c-9940185493cc req-0e88096b-5957-4d9f-81e2-69028e58796a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:32.181321 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-65ce395b-1988-498e-878c-9940185493cc req-0e88096b-5957-4d9f-81e2-69028e58796a service nova] Creating event network-vif-plugged:9d826429-f324-4423-b183-ba434abae3e6 for instance b33b0f22-808a-483c-9683-a16f98eccfa6 on n-h2-856895-1 Sep 10 11:38:32.195338 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-65ce395b-1988-498e-878c-9940185493cc req-0e88096b-5957-4d9f-81e2-69028e58796a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.294952 Sep 10 11:38:32.196005 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 85/170] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:32.253741 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6989061a-3d9d-4cad-957f-483873ade2ab tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64e2df030a745de8ae7eda29d2ac30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c44e3e2920e48868e1c05f70b1d7639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:32.268252 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6989061a-3d9d-4cad-957f-483873ade2ab tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "GET /compute/v2.1/servers/cd42bf97-63e2-4a4b-a5db-d747a478dcbd" status: 200 len: 1412 microversion: 2.1 time: 0.233782 Sep 10 11:38:32.269374 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 86/171] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:32 2022] GET /compute/v2.1/servers/cd42bf97-63e2-4a4b-a5db-d747a478dcbd => generated 1412 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:38:32.287682 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d1d58d10-4950-4487-aa36-1abffbb90051 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:32.288725 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d1d58d10-4950-4487-aa36-1abffbb90051 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] [instance: b33b0f22-808a-483c-9683-a16f98eccfa6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:32.303784 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1d58d10-4950-4487-aa36-1abffbb90051 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:32.304340 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1d58d10-4950-4487-aa36-1abffbb90051 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:32.305648 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1d58d10-4950-4487-aa36-1abffbb90051 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:32.305734 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1d58d10-4950-4487-aa36-1abffbb90051 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:32.306239 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1d58d10-4950-4487-aa36-1abffbb90051 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:32.311112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1d58d10-4950-4487-aa36-1abffbb90051 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:32.588008 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-a5bef7d2-8f88-4645-a56e-753058b55890 req-8b5ddbda-994b-4ebc-8212-0530cdf92c88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd42bf97-63e2-4a4b-a5db-d747a478dcbd", "tag": "f0809fa9-bdcc-4999-bb5a-18a1f232c5f6"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:32.604390 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a5bef7d2-8f88-4645-a56e-753058b55890 req-8b5ddbda-994b-4ebc-8212-0530cdf92c88 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:32.607497 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a5bef7d2-8f88-4645-a56e-753058b55890 req-8b5ddbda-994b-4ebc-8212-0530cdf92c88 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:32.608746 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a5bef7d2-8f88-4645-a56e-753058b55890 req-8b5ddbda-994b-4ebc-8212-0530cdf92c88 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:32.640752 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-a5bef7d2-8f88-4645-a56e-753058b55890 req-8b5ddbda-994b-4ebc-8212-0530cdf92c88 service nova] Creating event network-changed:f0809fa9-bdcc-4999-bb5a-18a1f232c5f6 for instance cd42bf97-63e2-4a4b-a5db-d747a478dcbd on n-h2-856895-1 Sep 10 11:38:32.650358 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d1d58d10-4950-4487-aa36-1abffbb90051 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce70607350b14ce98add3c72ed36c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8943799e9af4699bcfd87690773282e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:32.660108 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d1d58d10-4950-4487-aa36-1abffbb90051 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] 10.222.0.23 "GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6" status: 200 len: 1338 microversion: 2.1 time: 0.378527 Sep 10 11:38:32.663309 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-a5bef7d2-8f88-4645-a56e-753058b55890 req-8b5ddbda-994b-4ebc-8212-0530cdf92c88 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081257 Sep 10 11:38:32.667206 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 87/172] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:38:32.678023 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 86/173] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:32 2022] GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6 => generated 1338 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:32.687675 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f75683c1-910e-43e1-b587-4052578ecb95 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:32.688642 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f75683c1-910e-43e1-b587-4052578ecb95 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 749908de-9f45-4b7f-9ce5-171d2cf11511] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:32.705620 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f75683c1-910e-43e1-b587-4052578ecb95 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:32.706563 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f75683c1-910e-43e1-b587-4052578ecb95 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:32.709828 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f75683c1-910e-43e1-b587-4052578ecb95 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:32.711703 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f75683c1-910e-43e1-b587-4052578ecb95 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:32.712701 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f75683c1-910e-43e1-b587-4052578ecb95 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:32.714651 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f75683c1-910e-43e1-b587-4052578ecb95 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:32.990969 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f75683c1-910e-43e1-b587-4052578ecb95 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b632d0a5ac48fea0da5aa15632cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a040213a0ea443cd97b346b0d4e79d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:32.993768 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:38:33.008124 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f75683c1-910e-43e1-b587-4052578ecb95 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511" status: 200 len: 1320 microversion: 2.1 time: 0.324450 Sep 10 11:38:33.024108 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 88/174] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:32 2022] GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511 => generated 1320 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:33.209489 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-150ffac3-f04e-4c47-9d7b-99ec6d7bafd1 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1842750671", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:33.296518 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-85cb7a59-0d6a-46b7-b68f-4fb01a4569c3 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:33.297064 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-85cb7a59-0d6a-46b7-b68f-4fb01a4569c3 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: cd42bf97-63e2-4a4b-a5db-d747a478dcbd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:33.302737 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-150ffac3-f04e-4c47-9d7b-99ec6d7bafd1 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] validate_networks() for None {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:38:33.320198 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85cb7a59-0d6a-46b7-b68f-4fb01a4569c3 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:33.320691 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85cb7a59-0d6a-46b7-b68f-4fb01a4569c3 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:33.321123 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85cb7a59-0d6a-46b7-b68f-4fb01a4569c3 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:33.321841 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85cb7a59-0d6a-46b7-b68f-4fb01a4569c3 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:33.322272 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85cb7a59-0d6a-46b7-b68f-4fb01a4569c3 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:33.322898 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85cb7a59-0d6a-46b7-b68f-4fb01a4569c3 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:33.682719 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-85cb7a59-0d6a-46b7-b68f-4fb01a4569c3 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64e2df030a745de8ae7eda29d2ac30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c44e3e2920e48868e1c05f70b1d7639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:33.705377 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-85cb7a59-0d6a-46b7-b68f-4fb01a4569c3 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "GET /compute/v2.1/servers/cd42bf97-63e2-4a4b-a5db-d747a478dcbd" status: 200 len: 1412 microversion: 2.1 time: 0.406231 Sep 10 11:38:33.708906 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 89/175] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:33 2022] GET /compute/v2.1/servers/cd42bf97-63e2-4a4b-a5db-d747a478dcbd => generated 1412 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:33.740888 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-173dcab9-e357-45b1-afb9-8992d7668d1d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:33.748173 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-173dcab9-e357-45b1-afb9-8992d7668d1d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] [instance: b33b0f22-808a-483c-9683-a16f98eccfa6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:33.763914 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-173dcab9-e357-45b1-afb9-8992d7668d1d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:33.764735 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-173dcab9-e357-45b1-afb9-8992d7668d1d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:33.766321 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-173dcab9-e357-45b1-afb9-8992d7668d1d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:33.770678 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-173dcab9-e357-45b1-afb9-8992d7668d1d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:33.772323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-173dcab9-e357-45b1-afb9-8992d7668d1d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:33.772985 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-173dcab9-e357-45b1-afb9-8992d7668d1d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:33.787770 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-150ffac3-f04e-4c47-9d7b-99ec6d7bafd1 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:38:33.788236 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-150ffac3-f04e-4c47-9d7b-99ec6d7bafd1 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:38:33.788717 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-150ffac3-f04e-4c47-9d7b-99ec6d7bafd1 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:38:33.789172 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-150ffac3-f04e-4c47-9d7b-99ec6d7bafd1 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:38:33.789934 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-150ffac3-f04e-4c47-9d7b-99ec6d7bafd1 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:38:33.810420 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=27 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:38:33.816772 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-150ffac3-f04e-4c47-9d7b-99ec6d7bafd1 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:33.819621 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-150ffac3-f04e-4c47-9d7b-99ec6d7bafd1 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:33.822188 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-150ffac3-f04e-4c47-9d7b-99ec6d7bafd1 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:33.824033 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-150ffac3-f04e-4c47-9d7b-99ec6d7bafd1 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:33.827426 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-150ffac3-f04e-4c47-9d7b-99ec6d7bafd1 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:33.828869 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-150ffac3-f04e-4c47-9d7b-99ec6d7bafd1 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:33.892451 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-150ffac3-f04e-4c47-9d7b-99ec6d7bafd1 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Getting quotas for project b95726b0caac4b7fb5f0db90d268430b. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:38:33.900913 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-150ffac3-f04e-4c47-9d7b-99ec6d7bafd1 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Getting quotas for user 03c91799a8724c499cd1afe82e3fd657 and project b95726b0caac4b7fb5f0db90d268430b. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:38:33.920771 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-150ffac3-f04e-4c47-9d7b-99ec6d7bafd1 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:38:33.928156 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-150ffac3-f04e-4c47-9d7b-99ec6d7bafd1 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] [instance: 58290798-70af-44a5-85cc-20871f15c110] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:38:34.021418 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=7 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:38:34.057434 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-150ffac3-f04e-4c47-9d7b-99ec6d7bafd1 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.166937 Sep 10 11:38:34.064182 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 87/176] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:38:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1174 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 11:38:34.079141 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a1fa06b3-1471-4e93-8425-335607471f20 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:34.080359 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a1fa06b3-1471-4e93-8425-335607471f20 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 749908de-9f45-4b7f-9ce5-171d2cf11511] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:34.109208 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-173dcab9-e357-45b1-afb9-8992d7668d1d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce70607350b14ce98add3c72ed36c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8943799e9af4699bcfd87690773282e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:34.110016 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a1fa06b3-1471-4e93-8425-335607471f20 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:34.111638 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a1fa06b3-1471-4e93-8425-335607471f20 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:34.114968 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a1fa06b3-1471-4e93-8425-335607471f20 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:34.115906 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a1fa06b3-1471-4e93-8425-335607471f20 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:34.123967 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a1fa06b3-1471-4e93-8425-335607471f20 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:34.124451 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a1fa06b3-1471-4e93-8425-335607471f20 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:34.125856 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-173dcab9-e357-45b1-afb9-8992d7668d1d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] 10.222.0.23 "GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6" status: 200 len: 1338 microversion: 2.1 time: 0.400903 Sep 10 11:38:34.126641 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 90/177] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:33 2022] GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6 => generated 1338 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:34.142569 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a66a8612-24d8-4179-84d3-50cfcb59f9df tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:34.143402 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a66a8612-24d8-4179-84d3-50cfcb59f9df tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] [instance: 58290798-70af-44a5-85cc-20871f15c110] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:34.288016 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a66a8612-24d8-4179-84d3-50cfcb59f9df tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c91799a8724c499cd1afe82e3fd657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95726b0caac4b7fb5f0db90d268430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:34.297238 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a66a8612-24d8-4179-84d3-50cfcb59f9df tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] 10.222.0.23 "GET /compute/v2.1/servers/58290798-70af-44a5-85cc-20871f15c110" status: 200 len: 1222 microversion: 2.1 time: 0.169362 Sep 10 11:38:34.299360 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 91/178] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:34 2022] GET /compute/v2.1/servers/58290798-70af-44a5-85cc-20871f15c110 => generated 1222 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:34.387157 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a1fa06b3-1471-4e93-8425-335607471f20 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b632d0a5ac48fea0da5aa15632cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a040213a0ea443cd97b346b0d4e79d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:34.400632 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a1fa06b3-1471-4e93-8425-335607471f20 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511" status: 200 len: 1320 microversion: 2.1 time: 0.335095 Sep 10 11:38:34.418492 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 88/179] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:34 2022] GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511 => generated 1320 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:34.734022 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fe874f8a-e34c-44b9-9405-f3e0219cce86 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:34.734840 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fe874f8a-e34c-44b9-9405-f3e0219cce86 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: cd42bf97-63e2-4a4b-a5db-d747a478dcbd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:34.768968 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe874f8a-e34c-44b9-9405-f3e0219cce86 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:34.776781 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe874f8a-e34c-44b9-9405-f3e0219cce86 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:34.780904 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe874f8a-e34c-44b9-9405-f3e0219cce86 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:34.782149 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe874f8a-e34c-44b9-9405-f3e0219cce86 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:34.787847 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe874f8a-e34c-44b9-9405-f3e0219cce86 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:34.791412 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe874f8a-e34c-44b9-9405-f3e0219cce86 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:35.381656 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e3fcae15-d775-4ee2-9ba2-123f6bd57672 tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Calling method '.version_select at 0x7f4073dfb4c0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:35.385182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e3fcae15-d775-4ee2-9ba2-123f6bd57672 tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:35.385671 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e3fcae15-d775-4ee2-9ba2-123f6bd57672 tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:35.386110 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e3fcae15-d775-4ee2-9ba2-123f6bd57672 tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:35.386836 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e3fcae15-d775-4ee2-9ba2-123f6bd57672 tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:35.387326 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e3fcae15-d775-4ee2-9ba2-123f6bd57672 tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:35.387936 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e3fcae15-d775-4ee2-9ba2-123f6bd57672 tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:35.465866 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e3fcae15-d775-4ee2-9ba2-123f6bd57672 tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 0.521702 Sep 10 11:38:35.466773 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 89/180] 10.222.0.23 () {58 vars in 1128 bytes} [Sat Sep 10 11:38:34 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:35.480185 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-995c7fdd-1d6a-454b-8773-a02cb00e8df6 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:35.480807 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-995c7fdd-1d6a-454b-8773-a02cb00e8df6 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] [instance: b33b0f22-808a-483c-9683-a16f98eccfa6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:35.497221 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-995c7fdd-1d6a-454b-8773-a02cb00e8df6 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:35.499032 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-995c7fdd-1d6a-454b-8773-a02cb00e8df6 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:35.500876 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-995c7fdd-1d6a-454b-8773-a02cb00e8df6 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:35.502322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-995c7fdd-1d6a-454b-8773-a02cb00e8df6 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:35.503259 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-995c7fdd-1d6a-454b-8773-a02cb00e8df6 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:35.503743 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-995c7fdd-1d6a-454b-8773-a02cb00e8df6 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:35.508997 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fe874f8a-e34c-44b9-9405-f3e0219cce86 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64e2df030a745de8ae7eda29d2ac30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c44e3e2920e48868e1c05f70b1d7639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:35.521144 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fe874f8a-e34c-44b9-9405-f3e0219cce86 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "GET /compute/v2.1/servers/cd42bf97-63e2-4a4b-a5db-d747a478dcbd" status: 200 len: 1412 microversion: 2.1 time: 0.790340 Sep 10 11:38:35.521756 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 92/181] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:34 2022] GET /compute/v2.1/servers/cd42bf97-63e2-4a4b-a5db-d747a478dcbd => generated 1412 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:35.610776 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e47d845a-a0fc-4360-a6d2-e3972df14c5f tempest-InstanceUsageAuditLogNegativeTestJSON-1217896857 tempest-InstanceUsageAuditLogNegativeTestJSON-1217896857-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:35.615401 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-e47d845a-a0fc-4360-a6d2-e3972df14c5f tempest-InstanceUsageAuditLogNegativeTestJSON-1217896857 tempest-InstanceUsageAuditLogNegativeTestJSON-1217896857-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Sep 10 11:38:35.624038 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e47d845a-a0fc-4360-a6d2-e3972df14c5f tempest-InstanceUsageAuditLogNegativeTestJSON-1217896857 tempest-InstanceUsageAuditLogNegativeTestJSON-1217896857-project-admin] Request method failure captured: Sep 10 11:38:35.624038 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Sep 10 11:38:35.624038 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:38:35.624038 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:38:35.624038 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:38:35.624038 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:38:35.624038 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:38:35.624038 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:38:35.624038 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:38:35.624038 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:38:35.624038 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHc7fBLDqB42FCtV4lRIs4_3vmWOqDKWEJkIabpRASFOgDxdV9O4jd4wgzM-lQEISJDzj0HKI5UnRUuIQKrulAWagmU5mpWGHKT1MY5qF0PlVkgKTp_XZ_4xfIu1iiV4mtQu1OdyKXivdAH8mD9Ha-G-OBfJ-eeRaXwW3lE_HjJ0szU Sep 10 11:38:35.624038 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:38:35.624038 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:38:35.624038 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:38:35.624038 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:38:35.624038 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:38:35.624038 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:38:35.624038 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 3e914c7cd1ce48ce9cadd4cc2e27b4d5 Sep 10 11:38:35.624038 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1217896857 Sep 10 11:38:35.624038 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,admin,member Sep 10 11:38:35.624038 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,admin,member Sep 10 11:38:35.625184 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3e914c7cd1ce48ce9cadd4cc2e27b4d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3e914c7cd1ce48ce9cadd4cc2e27b4d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3e914c7cd1ce48ce9cadd4cc2e27b4d5", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3e914c7cd1ce48ce9cadd4cc2e27b4d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:38:35.625184 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1217896857 Sep 10 11:38:35.625184 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 3e914c7cd1ce48ce9cadd4cc2e27b4d5 Sep 10 11:38:35.625184 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1217896857 Sep 10 11:38:35.625184 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1217896857-project-admin Sep 10 11:38:35.625184 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:38:35.625184 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:38:35.625184 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: ad0c986442e04ecfae2f278f559076cd Sep 10 11:38:35.625184 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1217896857-project-admin Sep 10 11:38:35.625184 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:38:35.625184 n-d-856895-1 devstack@n-api.service[128776]: exception: Invalid timestamp for date invalid_time Sep 10 11:38:35.625763 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'invalid_time'} Sep 10 11:38:35.625763 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:38:35.625763 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:35.625763 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Sep 10 11:38:35.625763 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Sep 10 11:38:35.625763 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Sep 10 11:38:35.625763 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Sep 10 11:38:35.625763 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Sep 10 11:38:35.625763 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Sep 10 11:38:35.625763 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Sep 10 11:38:35.625763 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:35.625763 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:35.625763 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:35.625763 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:35.625763 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:35.625763 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:35.625763 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:38:35.625763 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:38:35.625763 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:38:35.625763 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:38:35.626855 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Sep 10 11:38:35.626855 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Sep 10 11:38:35.626855 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Sep 10 11:38:35.626855 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:35.626855 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:35.626855 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:35.626855 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:35.626855 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:35.626855 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:35.626855 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:38:35.626855 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:38:35.626855 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Sep 10 11:38:35.626855 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:35.630429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e47d845a-a0fc-4360-a6d2-e3972df14c5f tempest-InstanceUsageAuditLogNegativeTestJSON-1217896857 tempest-InstanceUsageAuditLogNegativeTestJSON-1217896857-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:38:35.631712 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e47d845a-a0fc-4360-a6d2-e3972df14c5f tempest-InstanceUsageAuditLogNegativeTestJSON-1217896857 tempest-InstanceUsageAuditLogNegativeTestJSON-1217896857-project-admin] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.104678 Sep 10 11:38:35.632501 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 93/182] 10.222.0.23 () {58 vars in 1224 bytes} [Sat Sep 10 11:38:35 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 10 11:38:35.637957 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b30a6feb-d18d-41f1-a1ba-e116554087fd tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:35.638788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b30a6feb-d18d-41f1-a1ba-e116554087fd tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] [instance: 58290798-70af-44a5-85cc-20871f15c110] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:35.652634 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b30a6feb-d18d-41f1-a1ba-e116554087fd tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:35.654399 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b30a6feb-d18d-41f1-a1ba-e116554087fd tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:35.656364 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b30a6feb-d18d-41f1-a1ba-e116554087fd tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:35.658096 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b30a6feb-d18d-41f1-a1ba-e116554087fd tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:35.661026 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b30a6feb-d18d-41f1-a1ba-e116554087fd tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:35.663028 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b30a6feb-d18d-41f1-a1ba-e116554087fd tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:35.718427 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-995c7fdd-1d6a-454b-8773-a02cb00e8df6 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce70607350b14ce98add3c72ed36c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8943799e9af4699bcfd87690773282e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:35.726866 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-995c7fdd-1d6a-454b-8773-a02cb00e8df6 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] 10.222.0.23 "GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6" status: 200 len: 1487 microversion: 2.1 time: 0.259010 Sep 10 11:38:35.727479 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 90/183] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:35 2022] GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6 => generated 1487 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:35.737319 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-34528329-eda4-49af-943c-aeb8582e114d tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:35.745712 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-34528329-eda4-49af-943c-aeb8582e114d tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 749908de-9f45-4b7f-9ce5-171d2cf11511] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:35.754844 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-34528329-eda4-49af-943c-aeb8582e114d tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:35.755859 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-34528329-eda4-49af-943c-aeb8582e114d tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:35.756443 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-34528329-eda4-49af-943c-aeb8582e114d tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:35.757329 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-34528329-eda4-49af-943c-aeb8582e114d tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:35.757925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-34528329-eda4-49af-943c-aeb8582e114d tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:35.758492 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-34528329-eda4-49af-943c-aeb8582e114d tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:35.850898 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b30a6feb-d18d-41f1-a1ba-e116554087fd tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c91799a8724c499cd1afe82e3fd657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95726b0caac4b7fb5f0db90d268430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:35.859648 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b30a6feb-d18d-41f1-a1ba-e116554087fd tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] 10.222.0.23 "GET /compute/v2.1/servers/58290798-70af-44a5-85cc-20871f15c110" status: 200 len: 1274 microversion: 2.1 time: 0.225778 Sep 10 11:38:35.860297 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 94/184] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:35 2022] GET /compute/v2.1/servers/58290798-70af-44a5-85cc-20871f15c110 => generated 1274 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:35.866109 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5736147e-30c6-46ce-958e-a7abe465fada tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Calling method '.version_select at 0x7f4078b22790>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:35.871505 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5736147e-30c6-46ce-958e-a7abe465fada tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:35.872239 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5736147e-30c6-46ce-958e-a7abe465fada tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:35.872973 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5736147e-30c6-46ce-958e-a7abe465fada tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:35.874020 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5736147e-30c6-46ce-958e-a7abe465fada tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:35.874616 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5736147e-30c6-46ce-958e-a7abe465fada tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:35.875217 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5736147e-30c6-46ce-958e-a7abe465fada tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:35.909764 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5736147e-30c6-46ce-958e-a7abe465fada tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 398 microversion: 2.1 time: 0.047884 Sep 10 11:38:35.911344 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 95/185] 10.222.0.23 () {58 vars in 1139 bytes} [Sat Sep 10 11:38:35 2022] GET /compute/v2.1/os-hosts?zone= => generated 398 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:36.034518 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-34528329-eda4-49af-943c-aeb8582e114d tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b632d0a5ac48fea0da5aa15632cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a040213a0ea443cd97b346b0d4e79d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:36.041445 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b6a96098-9dd8-4f33-a578-7fd154fc6314 tempest-InstanceUsageAuditLogNegativeTestJSON-1000198379 tempest-InstanceUsageAuditLogNegativeTestJSON-1000198379-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:36.043948 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b6a96098-9dd8-4f33-a578-7fd154fc6314 tempest-InstanceUsageAuditLogNegativeTestJSON-1000198379 tempest-InstanceUsageAuditLogNegativeTestJSON-1000198379-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'e4cf5672eb834bf09fa9f475881253d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff2a65b96e4ed6a736b78d57923921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:36.045920 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-34528329-eda4-49af-943c-aeb8582e114d tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511" status: 200 len: 1320 microversion: 2.1 time: 0.317404 Sep 10 11:38:36.059482 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 91/186] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:35 2022] GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511 => generated 1320 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:36.059675 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b6a96098-9dd8-4f33-a578-7fd154fc6314 tempest-InstanceUsageAuditLogNegativeTestJSON-1000198379 tempest-InstanceUsageAuditLogNegativeTestJSON-1000198379-project] Request method failure captured: Sep 10 11:38:36.059675 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Sep 10 11:38:36.059675 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:38:36.059675 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:38:36.059675 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:38:36.059675 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:38:36.059675 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:38:36.059675 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:38:36.059675 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:38:36.059675 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:38:36.059675 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHc5UK4c8l61-EBhNgLkLJlKZq0Vqcz13n1ToIDMjNbyqjt48j8TlsxWMv687DEYAvQuGpzsLfR3lStgZVxf6V6hMMk6iAzqJSOhZDZ60mi7HVImTSq86SZwyECIOVXinhAwKafScx9rGq3BF_F9x_Bi4R_PWbURYiFUmykX2UaQjSc Sep 10 11:38:36.059675 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:38:36.059675 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:38:36.059675 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:38:36.059675 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:38:36.059675 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:38:36.059675 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:38:36.059675 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 5bff2a65b96e4ed6a736b78d57923921 Sep 10 11:38:36.059675 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1000198379 Sep 10 11:38:36.059675 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:38:36.059675 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:38:36.060985 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5bff2a65b96e4ed6a736b78d57923921"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5bff2a65b96e4ed6a736b78d57923921"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5bff2a65b96e4ed6a736b78d57923921", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5bff2a65b96e4ed6a736b78d57923921"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:38:36.060985 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1000198379 Sep 10 11:38:36.060985 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 5bff2a65b96e4ed6a736b78d57923921 Sep 10 11:38:36.060985 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1000198379 Sep 10 11:38:36.060985 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1000198379-project Sep 10 11:38:36.060985 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:38:36.060985 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:38:36.060985 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: e4cf5672eb834bf09fa9f475881253d5 Sep 10 11:38:36.060985 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1000198379-project Sep 10 11:38:36.060985 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:38:36.061654 n-d-856895-1 devstack@n-api.service[128776]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 10 11:38:36.061654 n-d-856895-1 devstack@n-api.service[128776]: action_args: {} Sep 10 11:38:36.061654 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:38:36.061654 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:36.061654 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:36.061654 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:36.061654 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:38:36.061654 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:38:36.061654 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:38:36.061654 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:38:36.061654 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Sep 10 11:38:36.061654 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Sep 10 11:38:36.061654 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 11:38:36.061654 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 11:38:36.061654 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 11:38:36.061654 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 11:38:36.061654 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:38:36.061654 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:38:36.061654 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:38:36.061654 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:38:36.062879 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 11:38:36.062879 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 11:38:36.062879 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 11:38:36.062879 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 11:38:36.062879 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 11:38:36.062879 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 11:38:36.062879 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 10 11:38:36.062879 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:36.062879 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:36.062879 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:36.062879 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:36.062879 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:36.062879 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:36.062879 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 11:38:36.062879 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 11:38:36.062879 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 10 11:38:36.062879 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:36.068134 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b6a96098-9dd8-4f33-a578-7fd154fc6314 tempest-InstanceUsageAuditLogNegativeTestJSON-1000198379 tempest-InstanceUsageAuditLogNegativeTestJSON-1000198379-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:38:36.068134 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b6a96098-9dd8-4f33-a578-7fd154fc6314 tempest-InstanceUsageAuditLogNegativeTestJSON-1000198379 tempest-InstanceUsageAuditLogNegativeTestJSON-1000198379-project] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.140381 Sep 10 11:38:36.068134 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 96/187] 10.222.0.23 () {58 vars in 1185 bytes} [Sat Sep 10 11:38:35 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 145 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:38:36.068813 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f92a5701-0932-4478-b871-8eff98c2701f tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:36.068813 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f92a5701-0932-4478-b871-8eff98c2701f tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] [instance: b33b0f22-808a-483c-9683-a16f98eccfa6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:36.075433 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6809872b-6bca-4e97-a26c-c9733a50b8df tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Calling method '.version_select at 0x7f4073f37820>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:36.075612 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f92a5701-0932-4478-b871-8eff98c2701f tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:36.075933 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f92a5701-0932-4478-b871-8eff98c2701f tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:36.076374 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f92a5701-0932-4478-b871-8eff98c2701f tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:36.079872 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f92a5701-0932-4478-b871-8eff98c2701f tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:36.080240 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f92a5701-0932-4478-b871-8eff98c2701f tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:36.080680 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f92a5701-0932-4478-b871-8eff98c2701f tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:36.087396 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6809872b-6bca-4e97-a26c-c9733a50b8df tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:36.089597 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6809872b-6bca-4e97-a26c-c9733a50b8df tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:36.090984 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6809872b-6bca-4e97-a26c-c9733a50b8df tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:36.091800 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6809872b-6bca-4e97-a26c-c9733a50b8df tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:36.093010 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6809872b-6bca-4e97-a26c-c9733a50b8df tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:36.093601 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6809872b-6bca-4e97-a26c-c9733a50b8df tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:36.128455 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6809872b-6bca-4e97-a26c-c9733a50b8df tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.070125 Sep 10 11:38:36.129637 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 97/188] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Sep 10 11:38:36 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:38:36.136311 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6a9bff88-d074-4ad0-bde1-a72e82a0c1ae tempest-InstanceUsageAuditLogNegativeTestJSON-1000198379 tempest-InstanceUsageAuditLogNegativeTestJSON-1000198379-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:36.138398 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6a9bff88-d074-4ad0-bde1-a72e82a0c1ae tempest-InstanceUsageAuditLogNegativeTestJSON-1000198379 tempest-InstanceUsageAuditLogNegativeTestJSON-1000198379-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'e4cf5672eb834bf09fa9f475881253d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bff2a65b96e4ed6a736b78d57923921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:36.140900 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6a9bff88-d074-4ad0-bde1-a72e82a0c1ae tempest-InstanceUsageAuditLogNegativeTestJSON-1000198379 tempest-InstanceUsageAuditLogNegativeTestJSON-1000198379-project] Request method failure captured: Sep 10 11:38:36.140900 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-09-10%2011:38:36 HTTP/1.1 Sep 10 11:38:36.140900 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:38:36.140900 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:38:36.140900 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:38:36.140900 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:38:36.140900 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:38:36.140900 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:38:36.140900 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:38:36.140900 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:38:36.140900 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHc5UK4c8l61-EBhNgLkLJlKZq0Vqcz13n1ToIDMjNbyqjt48j8TlsxWMv687DEYAvQuGpzsLfR3lStgZVxf6V6hMMk6iAzqJSOhZDZ60mi7HVImTSq86SZwyECIOVXinhAwKafScx9rGq3BF_F9x_Bi4R_PWbURYiFUmykX2UaQjSc Sep 10 11:38:36.140900 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:38:36.140900 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:38:36.140900 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:38:36.140900 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:38:36.140900 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:38:36.140900 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:38:36.140900 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 5bff2a65b96e4ed6a736b78d57923921 Sep 10 11:38:36.140900 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1000198379 Sep 10 11:38:36.140900 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:38:36.140900 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:38:36.142049 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5bff2a65b96e4ed6a736b78d57923921"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5bff2a65b96e4ed6a736b78d57923921"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5bff2a65b96e4ed6a736b78d57923921", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5bff2a65b96e4ed6a736b78d57923921"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:38:36.142049 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1000198379 Sep 10 11:38:36.142049 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 5bff2a65b96e4ed6a736b78d57923921 Sep 10 11:38:36.142049 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1000198379 Sep 10 11:38:36.142049 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1000198379-project Sep 10 11:38:36.142049 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:38:36.142049 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:38:36.142049 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: e4cf5672eb834bf09fa9f475881253d5 Sep 10 11:38:36.142049 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1000198379-project Sep 10 11:38:36.142049 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:38:36.142567 n-d-856895-1 devstack@n-api.service[128776]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 10 11:38:36.142567 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '2022-09-10 11:38:36'} Sep 10 11:38:36.142567 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:38:36.142567 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:36.142567 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:36.142567 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:36.142567 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:38:36.142567 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:38:36.142567 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:38:36.142567 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:38:36.142567 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Sep 10 11:38:36.142567 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Sep 10 11:38:36.142567 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 11:38:36.142567 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 11:38:36.142567 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 11:38:36.142567 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 11:38:36.142567 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:38:36.142567 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:38:36.142567 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:38:36.142567 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:38:36.143621 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 11:38:36.143621 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 11:38:36.143621 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 11:38:36.143621 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 11:38:36.143621 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 11:38:36.143621 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 11:38:36.143621 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 10 11:38:36.143621 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:36.143621 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:36.143621 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:36.143621 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:36.143621 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:36.143621 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:36.143621 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 11:38:36.143621 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 11:38:36.143621 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 10 11:38:36.143621 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:36.145399 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6a9bff88-d074-4ad0-bde1-a72e82a0c1ae tempest-InstanceUsageAuditLogNegativeTestJSON-1000198379 tempest-InstanceUsageAuditLogNegativeTestJSON-1000198379-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:38:36.145399 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6a9bff88-d074-4ad0-bde1-a72e82a0c1ae tempest-InstanceUsageAuditLogNegativeTestJSON-1000198379 tempest-InstanceUsageAuditLogNegativeTestJSON-1000198379-project] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-10 11:38:36" status: 403 len: 128 microversion: 2.1 time: 0.011721 Sep 10 11:38:36.145399 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 98/189] 10.222.0.23 () {58 vars in 1251 bytes} [Sat Sep 10 11:38:36 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-10%2011%3A38%3A36 => generated 128 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:38:36.223715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=100 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:38:36.247299 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-182b3c82-0efa-4d4e-bd30-a00cab7accd1 req-067f73a1-3497-4493-98d4-51a83e662610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "749908de-9f45-4b7f-9ce5-171d2cf11511", "name": "network-vif-plugged", "status": "completed", "tag": "827daca3-67d0-4ffc-a4e0-4ba6d318438e"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:36.275255 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-182b3c82-0efa-4d4e-bd30-a00cab7accd1 req-067f73a1-3497-4493-98d4-51a83e662610 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:36.275747 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-182b3c82-0efa-4d4e-bd30-a00cab7accd1 req-067f73a1-3497-4493-98d4-51a83e662610 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:36.276186 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-182b3c82-0efa-4d4e-bd30-a00cab7accd1 req-067f73a1-3497-4493-98d4-51a83e662610 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:36.352565 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-182b3c82-0efa-4d4e-bd30-a00cab7accd1 req-067f73a1-3497-4493-98d4-51a83e662610 service nova] Creating event network-vif-plugged:827daca3-67d0-4ffc-a4e0-4ba6d318438e for instance 749908de-9f45-4b7f-9ce5-171d2cf11511 on n-h1-856895-1 Sep 10 11:38:36.381468 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-182b3c82-0efa-4d4e-bd30-a00cab7accd1 req-067f73a1-3497-4493-98d4-51a83e662610 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137950 Sep 10 11:38:36.385848 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 99/190] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:36.553195 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-43de94c2-4dfb-47c6-b6c3-8525f46ec138 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:36.553917 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-43de94c2-4dfb-47c6-b6c3-8525f46ec138 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: cd42bf97-63e2-4a4b-a5db-d747a478dcbd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:36.560565 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-43de94c2-4dfb-47c6-b6c3-8525f46ec138 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:36.561295 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-43de94c2-4dfb-47c6-b6c3-8525f46ec138 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:36.561899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-43de94c2-4dfb-47c6-b6c3-8525f46ec138 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:36.562763 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-43de94c2-4dfb-47c6-b6c3-8525f46ec138 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:36.563399 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-43de94c2-4dfb-47c6-b6c3-8525f46ec138 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:36.563987 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-43de94c2-4dfb-47c6-b6c3-8525f46ec138 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:37.114763 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f92a5701-0932-4478-b871-8eff98c2701f tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6" status: 200 len: 1638 microversion: 2.1 time: 1.062888 Sep 10 11:38:37.116148 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 92/191] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:36 2022] GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6 => generated 1638 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:37.135556 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8a18cef0-ce1b-40e8-97e9-9277d382e177 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:37.136260 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8a18cef0-ce1b-40e8-97e9-9277d382e177 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] [instance: 58290798-70af-44a5-85cc-20871f15c110] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:37.164522 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a18cef0-ce1b-40e8-97e9-9277d382e177 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:37.168206 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a18cef0-ce1b-40e8-97e9-9277d382e177 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:37.169703 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a18cef0-ce1b-40e8-97e9-9277d382e177 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:37.172852 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a18cef0-ce1b-40e8-97e9-9277d382e177 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:37.173840 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a18cef0-ce1b-40e8-97e9-9277d382e177 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:37.174475 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a18cef0-ce1b-40e8-97e9-9277d382e177 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:37.230492 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-43de94c2-4dfb-47c6-b6c3-8525f46ec138 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64e2df030a745de8ae7eda29d2ac30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c44e3e2920e48868e1c05f70b1d7639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:37.244705 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-43de94c2-4dfb-47c6-b6c3-8525f46ec138 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "GET /compute/v2.1/servers/cd42bf97-63e2-4a4b-a5db-d747a478dcbd" status: 200 len: 1412 microversion: 2.1 time: 0.699093 Sep 10 11:38:37.245531 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 100/192] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:36 2022] GET /compute/v2.1/servers/cd42bf97-63e2-4a4b-a5db-d747a478dcbd => generated 1412 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:37.253529 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-af627276-baad-484d-b205-644acd2dfd5b tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:37.255524 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-af627276-baad-484d-b205-644acd2dfd5b tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 749908de-9f45-4b7f-9ce5-171d2cf11511] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:37.271974 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af627276-baad-484d-b205-644acd2dfd5b tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:37.273067 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af627276-baad-484d-b205-644acd2dfd5b tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:37.274416 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af627276-baad-484d-b205-644acd2dfd5b tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:37.285571 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af627276-baad-484d-b205-644acd2dfd5b tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:37.286176 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af627276-baad-484d-b205-644acd2dfd5b tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:37.287062 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af627276-baad-484d-b205-644acd2dfd5b tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:37.335810 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8a18cef0-ce1b-40e8-97e9-9277d382e177 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c91799a8724c499cd1afe82e3fd657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95726b0caac4b7fb5f0db90d268430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:37.349259 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8a18cef0-ce1b-40e8-97e9-9277d382e177 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] 10.222.0.23 "GET /compute/v2.1/servers/58290798-70af-44a5-85cc-20871f15c110" status: 200 len: 1280 microversion: 2.1 time: 0.231040 Sep 10 11:38:37.349936 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 93/193] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:37 2022] GET /compute/v2.1/servers/58290798-70af-44a5-85cc-20871f15c110 => generated 1280 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:37.371563 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e99db4ed-a748-4c53-ab7e-fbd711a7fddd tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:37.372069 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e99db4ed-a748-4c53-ab7e-fbd711a7fddd tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] [instance: b33b0f22-808a-483c-9683-a16f98eccfa6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:37.384911 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e99db4ed-a748-4c53-ab7e-fbd711a7fddd tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:37.385396 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e99db4ed-a748-4c53-ab7e-fbd711a7fddd tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:37.385824 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e99db4ed-a748-4c53-ab7e-fbd711a7fddd tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:37.386702 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e99db4ed-a748-4c53-ab7e-fbd711a7fddd tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:37.387153 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e99db4ed-a748-4c53-ab7e-fbd711a7fddd tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:37.387716 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e99db4ed-a748-4c53-ab7e-fbd711a7fddd tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:37.675437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e99db4ed-a748-4c53-ab7e-fbd711a7fddd tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] [instance: b33b0f22-808a-483c-9683-a16f98eccfa6] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:38:37.880631 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-af627276-baad-484d-b205-644acd2dfd5b tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b632d0a5ac48fea0da5aa15632cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a040213a0ea443cd97b346b0d4e79d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:37.887684 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e99db4ed-a748-4c53-ab7e-fbd711a7fddd tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6" status: 204 len: 0 microversion: 2.1 time: 0.532535 Sep 10 11:38:37.892103 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 94/194] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:38:37 2022] DELETE /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:38:37.899817 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5de99e25-fee3-4a62-94e3-7920848ca5a5 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:37.900682 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5de99e25-fee3-4a62-94e3-7920848ca5a5 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] [instance: b33b0f22-808a-483c-9683-a16f98eccfa6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:37.908216 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5de99e25-fee3-4a62-94e3-7920848ca5a5 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:37.908926 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5de99e25-fee3-4a62-94e3-7920848ca5a5 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:37.909514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5de99e25-fee3-4a62-94e3-7920848ca5a5 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:37.911006 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5de99e25-fee3-4a62-94e3-7920848ca5a5 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:37.911613 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5de99e25-fee3-4a62-94e3-7920848ca5a5 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:37.912146 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5de99e25-fee3-4a62-94e3-7920848ca5a5 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:37.923402 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-af627276-baad-484d-b205-644acd2dfd5b tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511" status: 200 len: 1320 microversion: 2.1 time: 0.673224 Sep 10 11:38:37.941025 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 101/195] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:37 2022] GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511 => generated 1320 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:38.270235 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-21c0474a-cab5-41e0-8d83-3f52dcd57ac4 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:38.270861 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-21c0474a-cab5-41e0-8d83-3f52dcd57ac4 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: cd42bf97-63e2-4a4b-a5db-d747a478dcbd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:38.275536 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5de99e25-fee3-4a62-94e3-7920848ca5a5 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce70607350b14ce98add3c72ed36c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8943799e9af4699bcfd87690773282e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:38.285667 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5de99e25-fee3-4a62-94e3-7920848ca5a5 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] 10.222.0.23 "GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6" status: 200 len: 1493 microversion: 2.1 time: 0.391267 Sep 10 11:38:38.287442 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 95/196] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:37 2022] GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6 => generated 1493 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:38.302283 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-21c0474a-cab5-41e0-8d83-3f52dcd57ac4 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:38.302792 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-21c0474a-cab5-41e0-8d83-3f52dcd57ac4 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:38.303259 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-21c0474a-cab5-41e0-8d83-3f52dcd57ac4 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:38.303979 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-21c0474a-cab5-41e0-8d83-3f52dcd57ac4 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:38.304430 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-21c0474a-cab5-41e0-8d83-3f52dcd57ac4 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:38.304905 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-21c0474a-cab5-41e0-8d83-3f52dcd57ac4 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:38.397585 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-39576b86-e068-4cd2-9701-20ab74655dd9 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:38.398604 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-39576b86-e068-4cd2-9701-20ab74655dd9 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] [instance: 58290798-70af-44a5-85cc-20871f15c110] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:38.409374 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-39576b86-e068-4cd2-9701-20ab74655dd9 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:38.411315 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-39576b86-e068-4cd2-9701-20ab74655dd9 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:38.412573 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-39576b86-e068-4cd2-9701-20ab74655dd9 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:38.414525 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-39576b86-e068-4cd2-9701-20ab74655dd9 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:38.415681 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-39576b86-e068-4cd2-9701-20ab74655dd9 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:38.416826 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-39576b86-e068-4cd2-9701-20ab74655dd9 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:38.514862 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-21c0474a-cab5-41e0-8d83-3f52dcd57ac4 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64e2df030a745de8ae7eda29d2ac30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c44e3e2920e48868e1c05f70b1d7639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:38.525409 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-21c0474a-cab5-41e0-8d83-3f52dcd57ac4 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "GET /compute/v2.1/servers/cd42bf97-63e2-4a4b-a5db-d747a478dcbd" status: 200 len: 1412 microversion: 2.1 time: 0.260019 Sep 10 11:38:38.526583 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 102/197] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:38 2022] GET /compute/v2.1/servers/cd42bf97-63e2-4a4b-a5db-d747a478dcbd => generated 1412 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:38:38.772311 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-39576b86-e068-4cd2-9701-20ab74655dd9 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c91799a8724c499cd1afe82e3fd657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95726b0caac4b7fb5f0db90d268430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:38.796653 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-39576b86-e068-4cd2-9701-20ab74655dd9 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] 10.222.0.23 "GET /compute/v2.1/servers/58290798-70af-44a5-85cc-20871f15c110" status: 200 len: 1322 microversion: 2.1 time: 0.419622 Sep 10 11:38:38.797480 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 96/198] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:38 2022] GET /compute/v2.1/servers/58290798-70af-44a5-85cc-20871f15c110 => generated 1322 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:38.948871 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7104fd45-0d45-492f-a0d9-64d183ca2594 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:38.949630 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7104fd45-0d45-492f-a0d9-64d183ca2594 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 749908de-9f45-4b7f-9ce5-171d2cf11511] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:38.959513 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7104fd45-0d45-492f-a0d9-64d183ca2594 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:38.960133 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7104fd45-0d45-492f-a0d9-64d183ca2594 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:38.960655 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7104fd45-0d45-492f-a0d9-64d183ca2594 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:38.962799 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7104fd45-0d45-492f-a0d9-64d183ca2594 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:38.963500 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7104fd45-0d45-492f-a0d9-64d183ca2594 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:38.966351 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7104fd45-0d45-492f-a0d9-64d183ca2594 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:39.015018 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-e9fdda02-209c-4a5a-8f00-d32742f48cea req-a98c69d1-8f6f-4bd4-965a-4e01e5d27c30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58290798-70af-44a5-85cc-20871f15c110", "tag": "3b3caf11-da53-4207-9580-10640c3c54cb"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:39.045421 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e9fdda02-209c-4a5a-8f00-d32742f48cea req-a98c69d1-8f6f-4bd4-965a-4e01e5d27c30 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:39.046364 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e9fdda02-209c-4a5a-8f00-d32742f48cea req-a98c69d1-8f6f-4bd4-965a-4e01e5d27c30 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:39.046943 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e9fdda02-209c-4a5a-8f00-d32742f48cea req-a98c69d1-8f6f-4bd4-965a-4e01e5d27c30 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:39.061479 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-e9fdda02-209c-4a5a-8f00-d32742f48cea req-a98c69d1-8f6f-4bd4-965a-4e01e5d27c30 service nova] Creating event network-changed:3b3caf11-da53-4207-9580-10640c3c54cb for instance 58290798-70af-44a5-85cc-20871f15c110 on n-h1-856895-1 Sep 10 11:38:39.067785 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-e9fdda02-209c-4a5a-8f00-d32742f48cea req-a98c69d1-8f6f-4bd4-965a-4e01e5d27c30 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056960 Sep 10 11:38:39.068923 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 97/199] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:38:39.310262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c1c7fc8b-ff90-42a5-99d6-5a636eed8c6d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:39.312441 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c1c7fc8b-ff90-42a5-99d6-5a636eed8c6d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] [instance: b33b0f22-808a-483c-9683-a16f98eccfa6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:39.331258 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1c7fc8b-ff90-42a5-99d6-5a636eed8c6d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:39.335432 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1c7fc8b-ff90-42a5-99d6-5a636eed8c6d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:39.340884 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1c7fc8b-ff90-42a5-99d6-5a636eed8c6d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:39.344927 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1c7fc8b-ff90-42a5-99d6-5a636eed8c6d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:39.346097 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1c7fc8b-ff90-42a5-99d6-5a636eed8c6d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:39.348548 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1c7fc8b-ff90-42a5-99d6-5a636eed8c6d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:39.358082 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7104fd45-0d45-492f-a0d9-64d183ca2594 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b632d0a5ac48fea0da5aa15632cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a040213a0ea443cd97b346b0d4e79d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:39.369873 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7104fd45-0d45-492f-a0d9-64d183ca2594 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511" status: 200 len: 1320 microversion: 2.1 time: 0.424850 Sep 10 11:38:39.373500 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 103/200] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:38 2022] GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511 => generated 1320 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:39.384420 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-ede3e834-924d-4afb-9f33-55f13df4eaea req-52470ef7-9e18-43de-9ac8-c78335e112e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd42bf97-63e2-4a4b-a5db-d747a478dcbd", "name": "network-vif-plugged", "status": "completed", "tag": "f0809fa9-bdcc-4999-bb5a-18a1f232c5f6"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:39.421722 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ede3e834-924d-4afb-9f33-55f13df4eaea req-52470ef7-9e18-43de-9ac8-c78335e112e1 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:39.422215 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ede3e834-924d-4afb-9f33-55f13df4eaea req-52470ef7-9e18-43de-9ac8-c78335e112e1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:39.422651 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ede3e834-924d-4afb-9f33-55f13df4eaea req-52470ef7-9e18-43de-9ac8-c78335e112e1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:39.450355 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-ede3e834-924d-4afb-9f33-55f13df4eaea req-52470ef7-9e18-43de-9ac8-c78335e112e1 service nova] Creating event network-vif-plugged:f0809fa9-bdcc-4999-bb5a-18a1f232c5f6 for instance cd42bf97-63e2-4a4b-a5db-d747a478dcbd on n-h2-856895-1 Sep 10 11:38:39.473750 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-ede3e834-924d-4afb-9f33-55f13df4eaea req-52470ef7-9e18-43de-9ac8-c78335e112e1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097472 Sep 10 11:38:39.474731 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 104/201] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:39.550586 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f8148369-ddf6-4e93-9016-0bdfa2a0a19d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:39.551428 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f8148369-ddf6-4e93-9016-0bdfa2a0a19d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: cd42bf97-63e2-4a4b-a5db-d747a478dcbd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:39.563855 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f8148369-ddf6-4e93-9016-0bdfa2a0a19d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:39.564348 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f8148369-ddf6-4e93-9016-0bdfa2a0a19d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:39.565957 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f8148369-ddf6-4e93-9016-0bdfa2a0a19d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:39.566753 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f8148369-ddf6-4e93-9016-0bdfa2a0a19d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:39.567267 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f8148369-ddf6-4e93-9016-0bdfa2a0a19d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:39.567705 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f8148369-ddf6-4e93-9016-0bdfa2a0a19d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:39.948078 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c1c7fc8b-ff90-42a5-99d6-5a636eed8c6d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce70607350b14ce98add3c72ed36c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8943799e9af4699bcfd87690773282e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:39.962481 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c1c7fc8b-ff90-42a5-99d6-5a636eed8c6d tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] 10.222.0.23 "GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6" status: 200 len: 1493 microversion: 2.1 time: 0.656958 Sep 10 11:38:39.982464 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 98/202] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:39 2022] GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6 => generated 1493 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:39.989438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6c543da4-169f-4e37-b3ce-82340d3b4bc0 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:39.990466 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6c543da4-169f-4e37-b3ce-82340d3b4bc0 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] [instance: 58290798-70af-44a5-85cc-20871f15c110] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:39.998510 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6c543da4-169f-4e37-b3ce-82340d3b4bc0 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:39.999874 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6c543da4-169f-4e37-b3ce-82340d3b4bc0 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:40.000804 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6c543da4-169f-4e37-b3ce-82340d3b4bc0 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:40.001786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6c543da4-169f-4e37-b3ce-82340d3b4bc0 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:40.002865 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6c543da4-169f-4e37-b3ce-82340d3b4bc0 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:40.003610 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6c543da4-169f-4e37-b3ce-82340d3b4bc0 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:40.076277 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f8148369-ddf6-4e93-9016-0bdfa2a0a19d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64e2df030a745de8ae7eda29d2ac30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c44e3e2920e48868e1c05f70b1d7639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:40.087054 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f8148369-ddf6-4e93-9016-0bdfa2a0a19d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "GET /compute/v2.1/servers/cd42bf97-63e2-4a4b-a5db-d747a478dcbd" status: 200 len: 1412 microversion: 2.1 time: 0.540711 Sep 10 11:38:40.087690 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 105/203] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:39 2022] GET /compute/v2.1/servers/cd42bf97-63e2-4a4b-a5db-d747a478dcbd => generated 1412 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:38:40.377477 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6c543da4-169f-4e37-b3ce-82340d3b4bc0 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c91799a8724c499cd1afe82e3fd657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95726b0caac4b7fb5f0db90d268430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:40.391100 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6c543da4-169f-4e37-b3ce-82340d3b4bc0 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] 10.222.0.23 "GET /compute/v2.1/servers/58290798-70af-44a5-85cc-20871f15c110" status: 200 len: 1322 microversion: 2.1 time: 0.407094 Sep 10 11:38:40.391731 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 99/204] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:39 2022] GET /compute/v2.1/servers/58290798-70af-44a5-85cc-20871f15c110 => generated 1322 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:40.406576 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3f55ef4a-0702-4241-b214-de9f27f81ea5 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:40.407562 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3f55ef4a-0702-4241-b214-de9f27f81ea5 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 749908de-9f45-4b7f-9ce5-171d2cf11511] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:40.415973 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3f55ef4a-0702-4241-b214-de9f27f81ea5 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:40.417554 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3f55ef4a-0702-4241-b214-de9f27f81ea5 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:40.418001 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3f55ef4a-0702-4241-b214-de9f27f81ea5 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:40.419763 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3f55ef4a-0702-4241-b214-de9f27f81ea5 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:40.420964 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3f55ef4a-0702-4241-b214-de9f27f81ea5 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:40.421645 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3f55ef4a-0702-4241-b214-de9f27f81ea5 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:40.833150 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3f55ef4a-0702-4241-b214-de9f27f81ea5 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b632d0a5ac48fea0da5aa15632cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a040213a0ea443cd97b346b0d4e79d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:40.849151 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3f55ef4a-0702-4241-b214-de9f27f81ea5 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511" status: 200 len: 1470 microversion: 2.1 time: 0.453169 Sep 10 11:38:40.850642 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 106/205] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:40 2022] GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511 => generated 1470 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:40.995056 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-52505765-6dd4-40c8-a6a7-35894317d8f5 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:40.995715 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-52505765-6dd4-40c8-a6a7-35894317d8f5 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] [instance: b33b0f22-808a-483c-9683-a16f98eccfa6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:41.011456 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52505765-6dd4-40c8-a6a7-35894317d8f5 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:41.011994 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52505765-6dd4-40c8-a6a7-35894317d8f5 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:41.014887 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52505765-6dd4-40c8-a6a7-35894317d8f5 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:41.021237 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52505765-6dd4-40c8-a6a7-35894317d8f5 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:41.021715 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52505765-6dd4-40c8-a6a7-35894317d8f5 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:41.022166 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52505765-6dd4-40c8-a6a7-35894317d8f5 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:41.222082 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-52505765-6dd4-40c8-a6a7-35894317d8f5 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce70607350b14ce98add3c72ed36c9c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8943799e9af4699bcfd87690773282e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:41.255155 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-52505765-6dd4-40c8-a6a7-35894317d8f5 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] 10.222.0.23 "GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6" status: 200 len: 1451 microversion: 2.1 time: 0.263346 Sep 10 11:38:41.268173 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 107/206] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:40 2022] GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6 => generated 1451 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:41.274049 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c323f126-9ca4-4069-ac07-0fd4d21ceda4 tempest-DeleteServersAdminTestJSON-685079201 tempest-DeleteServersAdminTestJSON-685079201-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:41.274770 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c323f126-9ca4-4069-ac07-0fd4d21ceda4 tempest-DeleteServersAdminTestJSON-685079201 tempest-DeleteServersAdminTestJSON-685079201-project-admin] [instance: 749908de-9f45-4b7f-9ce5-171d2cf11511] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:41.286033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9a7ddb56-c6d2-41d7-ab3b-b538c5cdc354 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:41.286666 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9a7ddb56-c6d2-41d7-ab3b-b538c5cdc354 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: cd42bf97-63e2-4a4b-a5db-d747a478dcbd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:41.294802 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c323f126-9ca4-4069-ac07-0fd4d21ceda4 tempest-DeleteServersAdminTestJSON-685079201 tempest-DeleteServersAdminTestJSON-685079201-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:41.295451 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c323f126-9ca4-4069-ac07-0fd4d21ceda4 tempest-DeleteServersAdminTestJSON-685079201 tempest-DeleteServersAdminTestJSON-685079201-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:41.295904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c323f126-9ca4-4069-ac07-0fd4d21ceda4 tempest-DeleteServersAdminTestJSON-685079201 tempest-DeleteServersAdminTestJSON-685079201-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:41.304926 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c323f126-9ca4-4069-ac07-0fd4d21ceda4 tempest-DeleteServersAdminTestJSON-685079201 tempest-DeleteServersAdminTestJSON-685079201-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:41.313557 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a7ddb56-c6d2-41d7-ab3b-b538c5cdc354 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:41.317953 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c323f126-9ca4-4069-ac07-0fd4d21ceda4 tempest-DeleteServersAdminTestJSON-685079201 tempest-DeleteServersAdminTestJSON-685079201-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:41.318585 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c323f126-9ca4-4069-ac07-0fd4d21ceda4 tempest-DeleteServersAdminTestJSON-685079201 tempest-DeleteServersAdminTestJSON-685079201-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:41.319018 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a7ddb56-c6d2-41d7-ab3b-b538c5cdc354 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:41.319671 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a7ddb56-c6d2-41d7-ab3b-b538c5cdc354 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:41.320880 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a7ddb56-c6d2-41d7-ab3b-b538c5cdc354 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:41.321549 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a7ddb56-c6d2-41d7-ab3b-b538c5cdc354 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:41.322169 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a7ddb56-c6d2-41d7-ab3b-b538c5cdc354 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:41.457857 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c323f126-9ca4-4069-ac07-0fd4d21ceda4 tempest-DeleteServersAdminTestJSON-685079201 tempest-DeleteServersAdminTestJSON-685079201-project-admin] [instance: 749908de-9f45-4b7f-9ce5-171d2cf11511] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:38:41.741445 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c323f126-9ca4-4069-ac07-0fd4d21ceda4 tempest-DeleteServersAdminTestJSON-685079201 tempest-DeleteServersAdminTestJSON-685079201-project-admin] 10.222.0.23 "DELETE /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511" status: 204 len: 0 microversion: 2.1 time: 0.869001 Sep 10 11:38:41.742055 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 100/207] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:38:40 2022] DELETE /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511 => generated 0 bytes in 871 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:38:41.768479 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-985810b1-dd5d-4213-a582-19971cbd0ef2 req-faf8ec40-134d-414c-aa28-24d6997bab5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b33b0f22-808a-483c-9683-a16f98eccfa6", "name": "network-vif-deleted", "tag": "9d826429-f324-4423-b183-ba434abae3e6"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:41.783365 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-985810b1-dd5d-4213-a582-19971cbd0ef2 req-faf8ec40-134d-414c-aa28-24d6997bab5f service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:41.784050 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-985810b1-dd5d-4213-a582-19971cbd0ef2 req-faf8ec40-134d-414c-aa28-24d6997bab5f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:41.784852 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-985810b1-dd5d-4213-a582-19971cbd0ef2 req-faf8ec40-134d-414c-aa28-24d6997bab5f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:41.798141 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-985810b1-dd5d-4213-a582-19971cbd0ef2 req-faf8ec40-134d-414c-aa28-24d6997bab5f service nova] Creating event network-vif-deleted:9d826429-f324-4423-b183-ba434abae3e6 for instance b33b0f22-808a-483c-9683-a16f98eccfa6 on n-h2-856895-1 Sep 10 11:38:41.810460 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-985810b1-dd5d-4213-a582-19971cbd0ef2 req-faf8ec40-134d-414c-aa28-24d6997bab5f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062989 Sep 10 11:38:41.811755 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 101/208] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:41.821961 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7d692bf5-f5b5-4947-8ed5-fc9d71d12e23 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:41.822978 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7d692bf5-f5b5-4947-8ed5-fc9d71d12e23 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] [instance: 58290798-70af-44a5-85cc-20871f15c110] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:41.828628 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:38:41.830519 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d692bf5-f5b5-4947-8ed5-fc9d71d12e23 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:41.831435 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d692bf5-f5b5-4947-8ed5-fc9d71d12e23 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:41.833177 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d692bf5-f5b5-4947-8ed5-fc9d71d12e23 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:41.834383 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d692bf5-f5b5-4947-8ed5-fc9d71d12e23 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:41.835058 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d692bf5-f5b5-4947-8ed5-fc9d71d12e23 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:41.835745 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d692bf5-f5b5-4947-8ed5-fc9d71d12e23 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:41.851113 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9a7ddb56-c6d2-41d7-ab3b-b538c5cdc354 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64e2df030a745de8ae7eda29d2ac30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c44e3e2920e48868e1c05f70b1d7639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:41.866457 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9a7ddb56-c6d2-41d7-ab3b-b538c5cdc354 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "GET /compute/v2.1/servers/cd42bf97-63e2-4a4b-a5db-d747a478dcbd" status: 200 len: 1610 microversion: 2.1 time: 0.587177 Sep 10 11:38:41.869917 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 108/209] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:41 2022] GET /compute/v2.1/servers/cd42bf97-63e2-4a4b-a5db-d747a478dcbd => generated 1610 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:41.896270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1c0f4d33-e745-42ae-b62b-11825e6c36b3 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:41.897215 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1c0f4d33-e745-42ae-b62b-11825e6c36b3 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 749908de-9f45-4b7f-9ce5-171d2cf11511] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:41.910932 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1c0f4d33-e745-42ae-b62b-11825e6c36b3 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:41.911457 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1c0f4d33-e745-42ae-b62b-11825e6c36b3 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:41.911883 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1c0f4d33-e745-42ae-b62b-11825e6c36b3 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:41.912720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1c0f4d33-e745-42ae-b62b-11825e6c36b3 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:41.913188 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1c0f4d33-e745-42ae-b62b-11825e6c36b3 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:41.913601 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1c0f4d33-e745-42ae-b62b-11825e6c36b3 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:42.166094 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7d692bf5-f5b5-4947-8ed5-fc9d71d12e23 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c91799a8724c499cd1afe82e3fd657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95726b0caac4b7fb5f0db90d268430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:42.175620 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7d692bf5-f5b5-4947-8ed5-fc9d71d12e23 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] 10.222.0.23 "GET /compute/v2.1/servers/58290798-70af-44a5-85cc-20871f15c110" status: 200 len: 1322 microversion: 2.1 time: 0.362188 Sep 10 11:38:42.180150 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 102/210] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:41 2022] GET /compute/v2.1/servers/58290798-70af-44a5-85cc-20871f15c110 => generated 1322 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:42.200252 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9632dbc4-0fe1-4af3-a2e3-c1d418d60ece tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:42.200940 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9632dbc4-0fe1-4af3-a2e3-c1d418d60ece tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: cd42bf97-63e2-4a4b-a5db-d747a478dcbd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:42.208503 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9632dbc4-0fe1-4af3-a2e3-c1d418d60ece tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:42.209458 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9632dbc4-0fe1-4af3-a2e3-c1d418d60ece tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:42.210157 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9632dbc4-0fe1-4af3-a2e3-c1d418d60ece tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:42.211022 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9632dbc4-0fe1-4af3-a2e3-c1d418d60ece tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:42.211642 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9632dbc4-0fe1-4af3-a2e3-c1d418d60ece tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:42.212217 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9632dbc4-0fe1-4af3-a2e3-c1d418d60ece tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:42.356902 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1c0f4d33-e745-42ae-b62b-11825e6c36b3 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b632d0a5ac48fea0da5aa15632cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a040213a0ea443cd97b346b0d4e79d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:42.366293 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1c0f4d33-e745-42ae-b62b-11825e6c36b3 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511" status: 200 len: 1476 microversion: 2.1 time: 0.495311 Sep 10 11:38:42.366875 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 109/211] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:41 2022] GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511 => generated 1476 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:42.381351 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9632dbc4-0fe1-4af3-a2e3-c1d418d60ece tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "GET /compute/v2.1/servers/cd42bf97-63e2-4a4b-a5db-d747a478dcbd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.184850 Sep 10 11:38:42.382568 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 103/212] 10.222.0.23 () {58 vars in 1275 bytes} [Sat Sep 10 11:38:42 2022] GET /compute/v2.1/servers/cd42bf97-63e2-4a4b-a5db-d747a478dcbd/os-interface => generated 284 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:42.387291 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3f3d283e-a471-475f-8ecb-d82d30b34306 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:42.388100 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3f3d283e-a471-475f-8ecb-d82d30b34306 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] [instance: b33b0f22-808a-483c-9683-a16f98eccfa6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:42.395881 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3f3d283e-a471-475f-8ecb-d82d30b34306 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:42.396640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3f3d283e-a471-475f-8ecb-d82d30b34306 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:42.397262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3f3d283e-a471-475f-8ecb-d82d30b34306 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:42.398124 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3f3d283e-a471-475f-8ecb-d82d30b34306 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:42.398740 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3f3d283e-a471-475f-8ecb-d82d30b34306 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:42.399382 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3f3d283e-a471-475f-8ecb-d82d30b34306 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:42.428220 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-3f3d283e-a471-475f-8ecb-d82d30b34306 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] HTTP exception thrown: Instance b33b0f22-808a-483c-9683-a16f98eccfa6 could not be found. Sep 10 11:38:42.432428 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3f3d283e-a471-475f-8ecb-d82d30b34306 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Request method failure captured: Sep 10 11:38:42.432428 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6 HTTP/1.1 Sep 10 11:38:42.432428 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:38:42.432428 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:38:42.432428 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:38:42.432428 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:38:42.432428 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:38:42.432428 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:38:42.432428 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:38:42.432428 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:38:42.432428 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHcLE9uhUlPhKBThuclBJjVZvWZzTeVk9WpKwgK3QeQnKGNgt3X9g9xkxwx_SFhUGPOT_XYMwGC0SHxPkDZrdF_QBDok4tty140saoiOcEW5Ny-Vbvin_dSfr3sxa3a5kfKQG6lrX-j3ggslgu9FOSH9ocHgNP5vjCubfTdsIc93zv4 Sep 10 11:38:42.432428 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:38:42.432428 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:38:42.432428 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:38:42.432428 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:38:42.432428 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:38:42.432428 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:38:42.432428 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: a8943799e9af4699bcfd87690773282e Sep 10 11:38:42.432428 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-AggregatesAdminTestJSON-156690684 Sep 10 11:38:42.432428 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:38:42.432428 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:38:42.433722 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a8943799e9af4699bcfd87690773282e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a8943799e9af4699bcfd87690773282e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a8943799e9af4699bcfd87690773282e", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a8943799e9af4699bcfd87690773282e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:38:42.433722 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-AggregatesAdminTestJSON-156690684 Sep 10 11:38:42.433722 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: a8943799e9af4699bcfd87690773282e Sep 10 11:38:42.433722 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-156690684 Sep 10 11:38:42.433722 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-AggregatesAdminTestJSON-156690684-project Sep 10 11:38:42.433722 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:38:42.433722 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:38:42.433722 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: ce70607350b14ce98add3c72ed36c9c4 Sep 10 11:38:42.433722 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-AggregatesAdminTestJSON-156690684-project Sep 10 11:38:42.433722 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:38:42.433722 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance b33b0f22-808a-483c-9683-a16f98eccfa6 could not be found. Sep 10 11:38:42.433722 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'b33b0f22-808a-483c-9683-a16f98eccfa6'} Sep 10 11:38:42.434514 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:38:42.434514 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:42.434514 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:38:42.434514 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:38:42.434514 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:38:42.434514 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:38:42.434514 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:38:42.434514 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:38:42.434514 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:38:42.434514 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:38:42.434514 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b33b0f22-808a-483c-9683-a16f98eccfa6 could not be found. Sep 10 11:38:42.434514 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:42.434514 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:42.434514 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:42.434514 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:42.434514 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:42.434514 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:42.434514 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:38:42.434514 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:38:42.434514 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:38:42.435679 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:38:42.435679 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:38:42.435679 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:38:42.435679 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:38:42.435679 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:38:42.435679 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:38:42.435679 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:38:42.435679 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b33b0f22-808a-483c-9683-a16f98eccfa6 could not be found. Sep 10 11:38:42.435679 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:42.435679 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:42.435679 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:42.435679 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:42.435679 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:42.435679 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:42.435679 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:38:42.435679 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:38:42.435679 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b33b0f22-808a-483c-9683-a16f98eccfa6 could not be found. Sep 10 11:38:42.435679 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:42.436746 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3f3d283e-a471-475f-8ecb-d82d30b34306 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Returning 404 to user: Instance b33b0f22-808a-483c-9683-a16f98eccfa6 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:38:42.436746 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3f3d283e-a471-475f-8ecb-d82d30b34306 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] 10.222.0.23 "GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6" status: 404 len: 111 microversion: 2.1 time: 0.050246 Sep 10 11:38:42.439084 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 104/213] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:42 2022] GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:38:42.449715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7b59d92e-df9a-47a0-ad46-b3cd0f395d56 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-856895-1"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:42.488458 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b59d92e-df9a-47a0-ad46-b3cd0f395d56 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:42.489743 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b59d92e-df9a-47a0-ad46-b3cd0f395d56 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:42.490357 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b59d92e-df9a-47a0-ad46-b3cd0f395d56 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:42.601105 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-91a80412-ea33-4211-885f-1b1aed574dda tempest-NetworksTest-1974444788 tempest-NetworksTest-1974444788-project-admin] Calling method '.version_select at 0x7f4079363d30>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:42.738325 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7b59d92e-df9a-47a0-ad46-b3cd0f395d56 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 300 microversion: 2.1 time: 0.292449 Sep 10 11:38:42.743558 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 105/214] 10.222.0.23 () {60 vars in 1191 bytes} [Sat Sep 10 11:38:42 2022] POST /compute/v2.1/os-aggregates/1/action => generated 300 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:42.756579 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-172a90af-29ce-4710-a561-41920eec0b8f tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:42.798035 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-172a90af-29ce-4710-a561-41920eec0b8f tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.047134 Sep 10 11:38:42.799227 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 106/215] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Sep 10 11:38:42 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 11:38:42.820937 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c06ed1df-0c1b-451e-9794-9791cbc61061 tempest-AggregatesAdminTestV241-1609795554 tempest-AggregatesAdminTestV241-1609795554-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-138354279"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:42.826740 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.aggregate [None req-c06ed1df-0c1b-451e-9794-9791cbc61061 tempest-AggregatesAdminTestV241-1609795554 tempest-AggregatesAdminTestV241-1609795554-project-admin] Generated uuid 26fb1ca2-e2db-4c58-9bec-f13574c565b1 for aggregate {{(pid=128777) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 11:38:42.877456 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c06ed1df-0c1b-451e-9794-9791cbc61061 tempest-AggregatesAdminTestV241-1609795554 tempest-AggregatesAdminTestV241-1609795554-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.060255 Sep 10 11:38:42.878533 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 107/216] 10.222.0.23 () {62 vars in 1205 bytes} [Sat Sep 10 11:38:42 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:38:42.890044 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-99d4395d-b03b-4c3c-af8b-df83b5d4236f tempest-AggregatesAdminTestV241-1609795554 tempest-AggregatesAdminTestV241-1609795554-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1290207384"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:43.031326 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-99d4395d-b03b-4c3c-af8b-df83b5d4236f tempest-AggregatesAdminTestV241-1609795554 tempest-AggregatesAdminTestV241-1609795554-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-aggregates/2" status: 200 len: 299 microversion: 2.41 time: 0.144179 Sep 10 11:38:43.032047 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 108/217] 10.222.0.23 () {62 vars in 1210 bytes} [Sat Sep 10 11:38:42 2022] PUT /compute/v2.1/os-aggregates/2 => generated 299 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:38:43.045580 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-eae33055-23c1-4a32-a56d-7cfeaaac0218 tempest-AggregatesAdminTestV241-1609795554 tempest-AggregatesAdminTestV241-1609795554-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:43.066253 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-eae33055-23c1-4a32-a56d-7cfeaaac0218 tempest-AggregatesAdminTestV241-1609795554 tempest-AggregatesAdminTestV241-1609795554-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 299 microversion: 2.41 time: 0.019365 Sep 10 11:38:43.066791 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-91a80412-ea33-4211-885f-1b1aed574dda tempest-NetworksTest-1974444788 tempest-NetworksTest-1974444788-project-admin] 10.222.0.23 "GET /compute/v2.1/os-networks" status: 200 len: 4683 microversion: 2.1 time: 0.697917 Sep 10 11:38:43.067473 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 109/218] 10.222.0.23 () {60 vars in 1190 bytes} [Sat Sep 10 11:38:43 2022] GET /compute/v2.1/os-aggregates/2 => generated 299 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 10 11:38:43.067599 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 110/219] 10.222.0.23 () {58 vars in 1137 bytes} [Sat Sep 10 11:38:42 2022] GET /compute/v2.1/os-networks => generated 4683 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:43.076199 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-00e137cc-9160-4abb-bb78-ada4067cc3b7 tempest-NetworksTest-1974444788 tempest-NetworksTest-1974444788-project-admin] Calling method '.version_select at 0x7f4073f10b80>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:43.079112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9d7e5136-d581-4196-9137-1f7f1226c8ab tempest-AggregatesAdminTestV241-1609795554 tempest-AggregatesAdminTestV241-1609795554-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-856895-1"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:43.093001 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9d7e5136-d581-4196-9137-1f7f1226c8ab tempest-AggregatesAdminTestV241-1609795554 tempest-AggregatesAdminTestV241-1609795554-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:43.093742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9d7e5136-d581-4196-9137-1f7f1226c8ab tempest-AggregatesAdminTestV241-1609795554 tempest-AggregatesAdminTestV241-1609795554-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:43.094366 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9d7e5136-d581-4196-9137-1f7f1226c8ab tempest-AggregatesAdminTestV241-1609795554 tempest-AggregatesAdminTestV241-1609795554-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:43.277293 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9d7e5136-d581-4196-9137-1f7f1226c8ab tempest-AggregatesAdminTestV241-1609795554 tempest-AggregatesAdminTestV241-1609795554-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 314 microversion: 2.41 time: 0.202427 Sep 10 11:38:43.277913 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 110/220] 10.222.0.23 () {62 vars in 1232 bytes} [Sat Sep 10 11:38:43 2022] POST /compute/v2.1/os-aggregates/2/action => generated 314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 10 11:38:43.290253 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cb8229e5-5b11-409a-b38c-011c54ccd75f tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:43.290881 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cb8229e5-5b11-409a-b38c-011c54ccd75f tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] [instance: 58290798-70af-44a5-85cc-20871f15c110] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:43.297739 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb8229e5-5b11-409a-b38c-011c54ccd75f tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:43.298232 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb8229e5-5b11-409a-b38c-011c54ccd75f tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:43.298674 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb8229e5-5b11-409a-b38c-011c54ccd75f tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:43.299416 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb8229e5-5b11-409a-b38c-011c54ccd75f tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:43.299872 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb8229e5-5b11-409a-b38c-011c54ccd75f tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:43.300839 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb8229e5-5b11-409a-b38c-011c54ccd75f tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:43.519505 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-00e137cc-9160-4abb-bb78-ada4067cc3b7 tempest-NetworksTest-1974444788 tempest-NetworksTest-1974444788-project-admin] 10.222.0.23 "GET /compute/v2.1/os-networks/9626420b-79de-41a5-9c99-74681e351ad0" status: 200 len: 652 microversion: 2.1 time: 0.446623 Sep 10 11:38:43.524247 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 111/221] 10.222.0.23 () {58 vars in 1248 bytes} [Sat Sep 10 11:38:43 2022] GET /compute/v2.1/os-networks/9626420b-79de-41a5-9c99-74681e351ad0 => generated 652 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:43.530075 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-421a6206-008f-435b-9899-489467737b36 tempest-AggregatesAdminTestV241-1609795554 tempest-AggregatesAdminTestV241-1609795554-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-856895-1"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:43.542748 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-421a6206-008f-435b-9899-489467737b36 tempest-AggregatesAdminTestV241-1609795554 tempest-AggregatesAdminTestV241-1609795554-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:43.543696 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-421a6206-008f-435b-9899-489467737b36 tempest-AggregatesAdminTestV241-1609795554 tempest-AggregatesAdminTestV241-1609795554-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:43.544294 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-421a6206-008f-435b-9899-489467737b36 tempest-AggregatesAdminTestV241-1609795554 tempest-AggregatesAdminTestV241-1609795554-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:43.554855 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cb8229e5-5b11-409a-b38c-011c54ccd75f tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c91799a8724c499cd1afe82e3fd657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95726b0caac4b7fb5f0db90d268430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:43.565366 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cb8229e5-5b11-409a-b38c-011c54ccd75f tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] 10.222.0.23 "GET /compute/v2.1/servers/58290798-70af-44a5-85cc-20871f15c110" status: 200 len: 1322 microversion: 2.1 time: 0.279053 Sep 10 11:38:43.566351 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 111/222] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:43 2022] GET /compute/v2.1/servers/58290798-70af-44a5-85cc-20871f15c110 => generated 1322 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:43.572878 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5ca8c702-561c-4d13-b597-7de6379498b9 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:43.574046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5ca8c702-561c-4d13-b597-7de6379498b9 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 749908de-9f45-4b7f-9ce5-171d2cf11511] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:43.588432 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ca8c702-561c-4d13-b597-7de6379498b9 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:43.589287 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ca8c702-561c-4d13-b597-7de6379498b9 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:43.589724 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ca8c702-561c-4d13-b597-7de6379498b9 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:43.590429 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ca8c702-561c-4d13-b597-7de6379498b9 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:43.590873 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ca8c702-561c-4d13-b597-7de6379498b9 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:43.595465 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ca8c702-561c-4d13-b597-7de6379498b9 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:43.800201 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5ca8c702-561c-4d13-b597-7de6379498b9 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b632d0a5ac48fea0da5aa15632cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a040213a0ea443cd97b346b0d4e79d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:43.805123 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:38:43.812210 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5ca8c702-561c-4d13-b597-7de6379498b9 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511" status: 200 len: 1476 microversion: 2.1 time: 0.244632 Sep 10 11:38:43.813142 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 112/223] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:43 2022] GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511 => generated 1476 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:43.818543 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-db4738bc-eead-46a6-9605-c143de376723 tempest-NetworksTest-1974444788 tempest-NetworksTest-1974444788-project-admin] Calling method '.version_select at 0x7f4073d728b0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:43.910914 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=5 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:38:43.954379 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-db4738bc-eead-46a6-9605-c143de376723 tempest-NetworksTest-1974444788 tempest-NetworksTest-1974444788-project-admin] 10.222.0.23 "GET /compute/v2.1/os-networks" status: 200 len: 4683 microversion: 2.1 time: 0.139306 Sep 10 11:38:43.955207 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 113/224] 10.222.0.23 () {58 vars in 1137 bytes} [Sat Sep 10 11:38:43 2022] GET /compute/v2.1/os-networks => generated 4683 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:44.026834 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b0593954-78c6-4949-832c-b127f0be8af0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-495880043", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "71f52e07-83f9-4397-aa4d-2431ed919e89"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:44.074236 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-421a6206-008f-435b-9899-489467737b36 tempest-AggregatesAdminTestV241-1609795554 tempest-AggregatesAdminTestV241-1609795554-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 299 microversion: 2.41 time: 0.546939 Sep 10 11:38:44.075629 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 112/225] 10.222.0.23 () {62 vars in 1232 bytes} [Sat Sep 10 11:38:43 2022] POST /compute/v2.1/os-aggregates/2/action => generated 299 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:38:44.089351 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-72573fd1-da84-45da-9d40-8a5318647ea4 tempest-AggregatesAdminTestV241-1609795554 tempest-AggregatesAdminTestV241-1609795554-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:44.121457 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-b0593954-78c6-4949-832c-b127f0be8af0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] validate_networks() for [('71f52e07-83f9-4397-aa4d-2431ed919e89', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:38:44.123633 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-72573fd1-da84-45da-9d40-8a5318647ea4 tempest-AggregatesAdminTestV241-1609795554 tempest-AggregatesAdminTestV241-1609795554-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.41 time: 0.039636 Sep 10 11:38:44.124217 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 113/226] 10.222.0.23 () {60 vars in 1193 bytes} [Sat Sep 10 11:38:44 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:44.169189 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0f79c1ee-2e4c-4855-97da-acd5d197e260 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2111560954"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:44.173160 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.aggregate [None req-0f79c1ee-2e4c-4855-97da-acd5d197e260 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Generated uuid 560aab8f-cae6-4e0f-8df9-f7d11b0b2752 for aggregate {{(pid=128776) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 11:38:44.213747 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0f79c1ee-2e4c-4855-97da-acd5d197e260 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.047715 Sep 10 11:38:44.217162 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 114/227] 10.222.0.23 () {60 vars in 1164 bytes} [Sat Sep 10 11:38:44 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:38:44.230406 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-86d8035f-694e-406a-8250-07973524b1d7 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-856895-1"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:44.243037 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86d8035f-694e-406a-8250-07973524b1d7 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:44.244043 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86d8035f-694e-406a-8250-07973524b1d7 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:44.244561 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86d8035f-694e-406a-8250-07973524b1d7 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:44.295395 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=20 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:38:44.455391 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-86d8035f-694e-406a-8250-07973524b1d7 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.228800 Sep 10 11:38:44.455990 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 115/228] 10.222.0.23 () {60 vars in 1191 bytes} [Sat Sep 10 11:38:44 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:44.468775 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-519c1381-21d4-43fd-890c-b4ef9b82def3 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:44.483915 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-519c1381-21d4-43fd-890c-b4ef9b82def3 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 242 microversion: 2.1 time: 0.019253 Sep 10 11:38:44.490566 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 116/229] 10.222.0.23 () {58 vars in 1149 bytes} [Sat Sep 10 11:38:44 2022] GET /compute/v2.1/os-aggregates/3 => generated 242 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:44.497405 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-948ecd31-e0e3-4bb2-a4b0-c42c5b81637a tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-856895-1"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:44.512699 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:INSERT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:38:44.524122 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-948ecd31-e0e3-4bb2-a4b0-c42c5b81637a tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:44.524803 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-948ecd31-e0e3-4bb2-a4b0-c42c5b81637a tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:44.528091 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-948ecd31-e0e3-4bb2-a4b0-c42c5b81637a tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:44.747418 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-948ecd31-e0e3-4bb2-a4b0-c42c5b81637a tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.254640 Sep 10 11:38:44.748165 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 117/230] 10.222.0.23 () {60 vars in 1191 bytes} [Sat Sep 10 11:38:44 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:38:44.764424 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fdbfb517-66a7-4f07-8be8-dba30e02f3bb tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:44.766638 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fdbfb517-66a7-4f07-8be8-dba30e02f3bb tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: cd42bf97-63e2-4a4b-a5db-d747a478dcbd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:44.788359 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fdbfb517-66a7-4f07-8be8-dba30e02f3bb tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:44.792137 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fdbfb517-66a7-4f07-8be8-dba30e02f3bb tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:44.795873 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fdbfb517-66a7-4f07-8be8-dba30e02f3bb tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:44.796877 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fdbfb517-66a7-4f07-8be8-dba30e02f3bb tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:44.801044 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fdbfb517-66a7-4f07-8be8-dba30e02f3bb tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:44.802962 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fdbfb517-66a7-4f07-8be8-dba30e02f3bb tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:44.810784 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:38:44.860172 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-b0593954-78c6-4949-832c-b127f0be8af0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:38:44.861281 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-b0593954-78c6-4949-832c-b127f0be8af0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:38:44.861999 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-b0593954-78c6-4949-832c-b127f0be8af0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:38:44.862563 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-b0593954-78c6-4949-832c-b127f0be8af0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:38:44.863351 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-b0593954-78c6-4949-832c-b127f0be8af0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:38:44.876963 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0593954-78c6-4949-832c-b127f0be8af0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:44.880385 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0593954-78c6-4949-832c-b127f0be8af0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:44.881037 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0593954-78c6-4949-832c-b127f0be8af0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:44.881959 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0593954-78c6-4949-832c-b127f0be8af0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:44.886905 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0593954-78c6-4949-832c-b127f0be8af0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:44.887821 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0593954-78c6-4949-832c-b127f0be8af0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:44.928814 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-b0593954-78c6-4949-832c-b127f0be8af0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Getting quotas for project 6750367ae6604f798bfd58e2839f83e2. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:38:44.934136 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-b0593954-78c6-4949-832c-b127f0be8af0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Getting quotas for user 805e0c24bd364ac8852387db73b614d9 and project 6750367ae6604f798bfd58e2839f83e2. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:38:44.948443 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b0593954-78c6-4949-832c-b127f0be8af0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:38:44.951722 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b0593954-78c6-4949-832c-b127f0be8af0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:38:45.034204 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b0593954-78c6-4949-832c-b127f0be8af0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.078085 Sep 10 11:38:45.036485 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 114/231] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:38:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1081 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:38:45.051152 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-fd683b2d-3bfb-40e3-bdc8-3c2cb324509c req-5a843ad5-eb4d-4fee-8ff9-008706d34fc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd42bf97-63e2-4a4b-a5db-d747a478dcbd", "tag": "f0809fa9-bdcc-4999-bb5a-18a1f232c5f6"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:45.074517 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-fd683b2d-3bfb-40e3-bdc8-3c2cb324509c req-5a843ad5-eb4d-4fee-8ff9-008706d34fc5 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:45.076677 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-fd683b2d-3bfb-40e3-bdc8-3c2cb324509c req-5a843ad5-eb4d-4fee-8ff9-008706d34fc5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:45.077402 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-fd683b2d-3bfb-40e3-bdc8-3c2cb324509c req-5a843ad5-eb4d-4fee-8ff9-008706d34fc5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:45.111470 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-fd683b2d-3bfb-40e3-bdc8-3c2cb324509c req-5a843ad5-eb4d-4fee-8ff9-008706d34fc5 service nova] Creating event network-changed:f0809fa9-bdcc-4999-bb5a-18a1f232c5f6 for instance cd42bf97-63e2-4a4b-a5db-d747a478dcbd on n-h2-856895-1 Sep 10 11:38:45.119620 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-fd683b2d-3bfb-40e3-bdc8-3c2cb324509c req-5a843ad5-eb4d-4fee-8ff9-008706d34fc5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081718 Sep 10 11:38:45.121051 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 115/232] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:45.141868 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-dad08bf8-87e0-4f2f-a09c-8b8f5cc80794 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:45.143698 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-dad08bf8-87e0-4f2f-a09c-8b8f5cc80794 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] [instance: 58290798-70af-44a5-85cc-20871f15c110] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:45.153563 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dad08bf8-87e0-4f2f-a09c-8b8f5cc80794 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:45.154302 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dad08bf8-87e0-4f2f-a09c-8b8f5cc80794 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:45.155618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dad08bf8-87e0-4f2f-a09c-8b8f5cc80794 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:45.156512 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dad08bf8-87e0-4f2f-a09c-8b8f5cc80794 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:45.157184 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dad08bf8-87e0-4f2f-a09c-8b8f5cc80794 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:45.157786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dad08bf8-87e0-4f2f-a09c-8b8f5cc80794 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:45.162793 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fdbfb517-66a7-4f07-8be8-dba30e02f3bb tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64e2df030a745de8ae7eda29d2ac30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c44e3e2920e48868e1c05f70b1d7639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:45.170818 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fdbfb517-66a7-4f07-8be8-dba30e02f3bb tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "GET /compute/v2.1/servers/cd42bf97-63e2-4a4b-a5db-d747a478dcbd" status: 200 len: 1588 microversion: 2.1 time: 0.421206 Sep 10 11:38:45.174511 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 118/233] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:44 2022] GET /compute/v2.1/servers/cd42bf97-63e2-4a4b-a5db-d747a478dcbd => generated 1588 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:45.193037 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d76f4ed1-ea72-4f84-95f5-bbf6dfc7dbfe tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:45.286185 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d76f4ed1-ea72-4f84-95f5-bbf6dfc7dbfe tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.108728 Sep 10 11:38:45.296483 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 119/234] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Sep 10 11:38:45 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 11:38:45.305801 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-39fea029-9309-4076-9187-653437dd1c8e tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:45.306420 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-39fea029-9309-4076-9187-653437dd1c8e tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 749908de-9f45-4b7f-9ce5-171d2cf11511] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:45.328182 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-39fea029-9309-4076-9187-653437dd1c8e tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:45.336748 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-39fea029-9309-4076-9187-653437dd1c8e tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:45.339809 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-39fea029-9309-4076-9187-653437dd1c8e tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:45.341390 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-39fea029-9309-4076-9187-653437dd1c8e tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:45.345067 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-39fea029-9309-4076-9187-653437dd1c8e tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:45.347568 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-39fea029-9309-4076-9187-653437dd1c8e tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:45.375923 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-dad08bf8-87e0-4f2f-a09c-8b8f5cc80794 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c91799a8724c499cd1afe82e3fd657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95726b0caac4b7fb5f0db90d268430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:45.387658 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-dad08bf8-87e0-4f2f-a09c-8b8f5cc80794 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] 10.222.0.23 "GET /compute/v2.1/servers/58290798-70af-44a5-85cc-20871f15c110" status: 200 len: 1322 microversion: 2.1 time: 0.265122 Sep 10 11:38:45.400371 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 116/235] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:45 2022] GET /compute/v2.1/servers/58290798-70af-44a5-85cc-20871f15c110 => generated 1322 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:45.411563 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-25bcb49d-228d-46ed-801d-3a5814443a90 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:45.413676 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-25bcb49d-228d-46ed-801d-3a5814443a90 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:45.507775 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-25bcb49d-228d-46ed-801d-3a5814443a90 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:45.516729 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-25bcb49d-228d-46ed-801d-3a5814443a90 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f" status: 200 len: 1210 microversion: 2.1 time: 0.115124 Sep 10 11:38:45.517530 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 117/236] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:45 2022] GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f => generated 1210 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:45.526781 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-47e3cb89-0fe8-46b4-b0d6-cb31cd1cfa7c tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-380371704"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:45.540291 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.aggregate [None req-47e3cb89-0fe8-46b4-b0d6-cb31cd1cfa7c tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Generated uuid c42c6fde-15e9-4d24-bcb1-9f14dada2550 for aggregate {{(pid=128777) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 11:38:45.600913 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-47e3cb89-0fe8-46b4-b0d6-cb31cd1cfa7c tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.079336 Sep 10 11:38:45.602648 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 118/237] 10.222.0.23 () {60 vars in 1164 bytes} [Sat Sep 10 11:38:45 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:45.615863 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-55ccbde3-dd03-4d2a-8c89-764a35239a5e tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-856895-1"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:45.620234 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-39fea029-9309-4076-9187-653437dd1c8e tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b632d0a5ac48fea0da5aa15632cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a040213a0ea443cd97b346b0d4e79d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:45.630270 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-55ccbde3-dd03-4d2a-8c89-764a35239a5e tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:45.633082 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-55ccbde3-dd03-4d2a-8c89-764a35239a5e tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:45.633892 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-39fea029-9309-4076-9187-653437dd1c8e tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511" status: 200 len: 1476 microversion: 2.1 time: 0.335951 Sep 10 11:38:45.634408 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-55ccbde3-dd03-4d2a-8c89-764a35239a5e tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:45.648783 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 120/238] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:45 2022] GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511 => generated 1476 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:45.873554 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-55ccbde3-dd03-4d2a-8c89-764a35239a5e tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 241 microversion: 2.1 time: 0.262439 Sep 10 11:38:45.881096 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 119/239] 10.222.0.23 () {60 vars in 1191 bytes} [Sat Sep 10 11:38:45 2022] POST /compute/v2.1/os-aggregates/4/action => generated 241 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:45.887430 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-67727737-f28e-4ab0-8a32-66d150fc1bbd tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:45.907305 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-67727737-f28e-4ab0-8a32-66d150fc1bbd tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.1 time: 0.024317 Sep 10 11:38:45.908395 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 121/240] 10.222.0.23 () {58 vars in 1143 bytes} [Sat Sep 10 11:38:45 2022] GET /compute/v2.1/os-aggregates => generated 244 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:45.920418 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3fdba89f-bcc5-428d-bb11-be0edf647e44 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-856895-1"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:45.964009 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3fdba89f-bcc5-428d-bb11-be0edf647e44 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:45.964507 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3fdba89f-bcc5-428d-bb11-be0edf647e44 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:45.969484 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3fdba89f-bcc5-428d-bb11-be0edf647e44 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:46.229070 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3fdba89f-bcc5-428d-bb11-be0edf647e44 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.312459 Sep 10 11:38:46.230525 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 120/241] 10.222.0.23 () {60 vars in 1191 bytes} [Sat Sep 10 11:38:45 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:46.241347 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4d04282e-2c54-4093-95f9-84bc5c921ebc tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:46.246898 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=4 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:38:46.297352 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4d04282e-2c54-4093-95f9-84bc5c921ebc tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.060021 Sep 10 11:38:46.304040 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 122/242] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Sep 10 11:38:46 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 11:38:46.313633 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ae9fdb90-23cf-4301-a1a3-1b6de341586d tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1102749547"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:46.318068 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.aggregate [None req-ae9fdb90-23cf-4301-a1a3-1b6de341586d tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Generated uuid 78dd092e-9a9a-4600-b5f8-7c2fbe19774e for aggregate {{(pid=128777) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 11:38:46.361880 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ae9fdb90-23cf-4301-a1a3-1b6de341586d tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.052405 Sep 10 11:38:46.363456 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 121/243] 10.222.0.23 () {60 vars in 1164 bytes} [Sat Sep 10 11:38:46 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:46.375115 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fdd246ca-808b-439c-996c-285f1c93cd71 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-856895-1"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:46.397701 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fdd246ca-808b-439c-996c-285f1c93cd71 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:46.398445 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fdd246ca-808b-439c-996c-285f1c93cd71 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:46.399038 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fdd246ca-808b-439c-996c-285f1c93cd71 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:46.414341 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2bff2992-b316-49ff-8e5a-38442377e215 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:46.415221 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2bff2992-b316-49ff-8e5a-38442377e215 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] [instance: 58290798-70af-44a5-85cc-20871f15c110] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:46.431729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2bff2992-b316-49ff-8e5a-38442377e215 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:46.433858 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2bff2992-b316-49ff-8e5a-38442377e215 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:46.434585 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2bff2992-b316-49ff-8e5a-38442377e215 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:46.437373 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2bff2992-b316-49ff-8e5a-38442377e215 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:46.438133 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2bff2992-b316-49ff-8e5a-38442377e215 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:46.438814 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2bff2992-b316-49ff-8e5a-38442377e215 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:46.682738 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fdd246ca-808b-439c-996c-285f1c93cd71 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 242 microversion: 2.1 time: 0.310682 Sep 10 11:38:46.683480 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 123/244] 10.222.0.23 () {60 vars in 1191 bytes} [Sat Sep 10 11:38:46 2022] POST /compute/v2.1/os-aggregates/5/action => generated 242 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:46.693139 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2bff2992-b316-49ff-8e5a-38442377e215 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c91799a8724c499cd1afe82e3fd657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95726b0caac4b7fb5f0db90d268430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:46.704230 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-442bfb5b-46cc-4771-8095-94eb283f1bb2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:46.705422 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2bff2992-b316-49ff-8e5a-38442377e215 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] 10.222.0.23 "GET /compute/v2.1/servers/58290798-70af-44a5-85cc-20871f15c110" status: 200 len: 1322 microversion: 2.1 time: 0.293849 Sep 10 11:38:46.710359 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 122/245] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:46 2022] GET /compute/v2.1/servers/58290798-70af-44a5-85cc-20871f15c110 => generated 1322 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:38:46.716233 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-442bfb5b-46cc-4771-8095-94eb283f1bb2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:46.718805 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d187182a-e87c-4dcd-9217-e33da5062171 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:46.721405 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d187182a-e87c-4dcd-9217-e33da5062171 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 749908de-9f45-4b7f-9ce5-171d2cf11511] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:46.733857 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d187182a-e87c-4dcd-9217-e33da5062171 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:46.736557 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d187182a-e87c-4dcd-9217-e33da5062171 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:46.740497 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d187182a-e87c-4dcd-9217-e33da5062171 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:46.741537 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d187182a-e87c-4dcd-9217-e33da5062171 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:46.742219 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d187182a-e87c-4dcd-9217-e33da5062171 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:46.742888 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d187182a-e87c-4dcd-9217-e33da5062171 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:46.752296 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-442bfb5b-46cc-4771-8095-94eb283f1bb2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:46.752804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-442bfb5b-46cc-4771-8095-94eb283f1bb2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:46.753717 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-442bfb5b-46cc-4771-8095-94eb283f1bb2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:46.754746 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-442bfb5b-46cc-4771-8095-94eb283f1bb2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:46.756012 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-442bfb5b-46cc-4771-8095-94eb283f1bb2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:46.756669 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-442bfb5b-46cc-4771-8095-94eb283f1bb2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:47.053511 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-442bfb5b-46cc-4771-8095-94eb283f1bb2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:47.082969 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-442bfb5b-46cc-4771-8095-94eb283f1bb2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f" status: 200 len: 1262 microversion: 2.1 time: 0.398459 Sep 10 11:38:47.086046 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 124/246] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:46 2022] GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f => generated 1262 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:47.113206 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-78fc578b-f06a-4904-abf9-dda2759cff30 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-856895-1"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:47.161738 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-78fc578b-f06a-4904-abf9-dda2759cff30 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:47.163258 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-78fc578b-f06a-4904-abf9-dda2759cff30 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:47.163875 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-78fc578b-f06a-4904-abf9-dda2759cff30 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:47.203544 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d187182a-e87c-4dcd-9217-e33da5062171 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b632d0a5ac48fea0da5aa15632cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a040213a0ea443cd97b346b0d4e79d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:47.218141 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d187182a-e87c-4dcd-9217-e33da5062171 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511" status: 200 len: 1476 microversion: 2.1 time: 0.504126 Sep 10 11:38:47.235674 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 123/247] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:46 2022] GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511 => generated 1476 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:47.271793 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-5451eada-0fa7-4f4d-8074-adf5635697e9 req-48019402-b84e-45dd-9f9c-0475f98960ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "749908de-9f45-4b7f-9ce5-171d2cf11511", "name": "network-vif-deleted", "tag": "827daca3-67d0-4ffc-a4e0-4ba6d318438e"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:47.304173 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-5451eada-0fa7-4f4d-8074-adf5635697e9 req-48019402-b84e-45dd-9f9c-0475f98960ae service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:47.304965 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-5451eada-0fa7-4f4d-8074-adf5635697e9 req-48019402-b84e-45dd-9f9c-0475f98960ae service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:47.306690 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-5451eada-0fa7-4f4d-8074-adf5635697e9 req-48019402-b84e-45dd-9f9c-0475f98960ae service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:47.348430 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-5451eada-0fa7-4f4d-8074-adf5635697e9 req-48019402-b84e-45dd-9f9c-0475f98960ae service nova] Creating event network-vif-deleted:827daca3-67d0-4ffc-a4e0-4ba6d318438e for instance 749908de-9f45-4b7f-9ce5-171d2cf11511 on n-h1-856895-1 Sep 10 11:38:47.386151 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-5451eada-0fa7-4f4d-8074-adf5635697e9 req-48019402-b84e-45dd-9f9c-0475f98960ae service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118083 Sep 10 11:38:47.386783 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 124/248] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:38:47.467586 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-78fc578b-f06a-4904-abf9-dda2759cff30 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 227 microversion: 2.1 time: 0.379606 Sep 10 11:38:47.477851 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 125/249] 10.222.0.23 () {60 vars in 1191 bytes} [Sat Sep 10 11:38:47 2022] POST /compute/v2.1/os-aggregates/5/action => generated 227 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:47.482568 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-38a48c16-8c13-45c8-b056-35720c695dd0 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:47.525087 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=5,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:38:47.542246 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-38a48c16-8c13-45c8-b056-35720c695dd0 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.062656 Sep 10 11:38:47.542893 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 125/250] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Sep 10 11:38:47 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 10 11:38:47.564578 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3fd7295c-a309-41ef-a246-8a64acd4d41c tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1918417612"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:47.574886 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.aggregate [None req-3fd7295c-a309-41ef-a246-8a64acd4d41c tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Generated uuid b05438fb-9155-4f16-a50d-4aeca7464250 for aggregate {{(pid=128776) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 11:38:47.619533 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-20540e5f-1103-48f2-84d9-7cd5cc21f399 tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Calling method '.version_select at 0x7f4073f61b80>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:47.623679 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-20540e5f-1103-48f2-84d9-7cd5cc21f399 tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:47.626630 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-20540e5f-1103-48f2-84d9-7cd5cc21f399 tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:47.627443 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-20540e5f-1103-48f2-84d9-7cd5cc21f399 tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:47.628594 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-20540e5f-1103-48f2-84d9-7cd5cc21f399 tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:47.629373 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-20540e5f-1103-48f2-84d9-7cd5cc21f399 tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:47.630635 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-20540e5f-1103-48f2-84d9-7cd5cc21f399 tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:47.648140 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3fd7295c-a309-41ef-a246-8a64acd4d41c tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.097361 Sep 10 11:38:47.651387 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 126/251] 10.222.0.23 () {60 vars in 1164 bytes} [Sat Sep 10 11:38:47 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:47.671577 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0956923f-3ecb-47da-9b7a-b902fb5da1f0 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:47.675439 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-20540e5f-1103-48f2-84d9-7cd5cc21f399 tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.060973 Sep 10 11:38:47.676379 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 126/252] 10.222.0.23 () {58 vars in 1128 bytes} [Sat Sep 10 11:38:47 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:47.701801 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e836fad3-aafc-4fb7-ae3c-7a559e06cf8e tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Calling method '.version_select at 0x7f40791fd550>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:47.706093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e836fad3-aafc-4fb7-ae3c-7a559e06cf8e tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:47.707666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e836fad3-aafc-4fb7-ae3c-7a559e06cf8e tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:47.708296 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e836fad3-aafc-4fb7-ae3c-7a559e06cf8e tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:47.709628 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e836fad3-aafc-4fb7-ae3c-7a559e06cf8e tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:47.710508 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e836fad3-aafc-4fb7-ae3c-7a559e06cf8e tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:47.711047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e836fad3-aafc-4fb7-ae3c-7a559e06cf8e tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:47.753138 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0956923f-3ecb-47da-9b7a-b902fb5da1f0 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.091805 Sep 10 11:38:47.756010 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e836fad3-aafc-4fb7-ae3c-7a559e06cf8e tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.067441 Sep 10 11:38:47.764815 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 127/253] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Sep 10 11:38:47 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 11:38:47.778350 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-83e4318b-c419-4982-aa4c-c1d4b8dc0fef tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:47.778929 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 127/254] 10.222.0.23 () {58 vars in 1155 bytes} [Sat Sep 10 11:38:47 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:47.780802 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-83e4318b-c419-4982-aa4c-c1d4b8dc0fef tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] [instance: 58290798-70af-44a5-85cc-20871f15c110] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:47.791053 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-43277f59-a159-4483-997a-fa7661a89941 tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Calling method '.version_select at 0x7f4073f41820>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:47.802953 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-43277f59-a159-4483-997a-fa7661a89941 tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:47.803680 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-43277f59-a159-4483-997a-fa7661a89941 tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:47.804265 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-43277f59-a159-4483-997a-fa7661a89941 tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:47.805705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-43277f59-a159-4483-997a-fa7661a89941 tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:47.806322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-43277f59-a159-4483-997a-fa7661a89941 tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:47.806902 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-43277f59-a159-4483-997a-fa7661a89941 tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:47.822981 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-83e4318b-c419-4982-aa4c-c1d4b8dc0fef tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:47.823505 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-83e4318b-c419-4982-aa4c-c1d4b8dc0fef tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:47.823940 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-83e4318b-c419-4982-aa4c-c1d4b8dc0fef tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:47.824642 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-83e4318b-c419-4982-aa4c-c1d4b8dc0fef tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:47.832188 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-83e4318b-c419-4982-aa4c-c1d4b8dc0fef tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:47.832700 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-83e4318b-c419-4982-aa4c-c1d4b8dc0fef tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:47.844261 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-43277f59-a159-4483-997a-fa7661a89941 tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.063834 Sep 10 11:38:47.851367 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 128/255] 10.222.0.23 () {58 vars in 1128 bytes} [Sat Sep 10 11:38:47 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:47.861285 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4bba207e-4388-4fb3-afb5-793572e7088d tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:47.876733 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-4bba207e-4388-4fb3-afb5-793572e7088d tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Sep 10 11:38:47.896033 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4bba207e-4388-4fb3-afb5-793572e7088d tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Request method failure captured: Sep 10 11:38:47.896033 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 Sep 10 11:38:47.896033 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:38:47.896033 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:38:47.896033 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:38:47.896033 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:38:47.896033 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:38:47.896033 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:38:47.896033 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:38:47.896033 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:38:47.896033 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHcOM8fGOXD7xJRBlSL4ps2ULtlDnXsxWwCoFPNDlEObci0FzVX59FqgjYC7WDnBSygopbZ7zaJCvKdwg5Eu4YnRezfJ61KAWoYjjcwP9vihF_RAR59l0CfBHYW1vTh5KJZFJLLiv6pBtt1cdiSm6TT3zfiJpuk9WG4oPYywqZpxsa4 Sep 10 11:38:47.896033 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:38:47.896033 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:38:47.896033 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:38:47.896033 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:38:47.896033 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:38:47.896033 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:38:47.896033 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 30692ffbb5d74d97bb650325bbd85c3d Sep 10 11:38:47.896033 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-AggregatesAdminTestJSON-1106198004 Sep 10 11:38:47.896033 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,admin,member Sep 10 11:38:47.896033 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,admin,member Sep 10 11:38:47.897565 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/30692ffbb5d74d97bb650325bbd85c3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/30692ffbb5d74d97bb650325bbd85c3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_30692ffbb5d74d97bb650325bbd85c3d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/30692ffbb5d74d97bb650325bbd85c3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:38:47.897565 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-AggregatesAdminTestJSON-1106198004 Sep 10 11:38:47.897565 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 30692ffbb5d74d97bb650325bbd85c3d Sep 10 11:38:47.897565 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1106198004 Sep 10 11:38:47.897565 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-AggregatesAdminTestJSON-1106198004-project-admin Sep 10 11:38:47.897565 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:38:47.897565 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:38:47.897565 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 2699938fb11c4cd4931a0edd914dc64c Sep 10 11:38:47.897565 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-AggregatesAdminTestJSON-1106198004-project-admin Sep 10 11:38:47.897565 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:38:47.897565 n-d-856895-1 devstack@n-api.service[128777]: exception: Aggregate 6 could not be found. Sep 10 11:38:47.897565 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '6'} Sep 10 11:38:47.897565 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:38:47.898465 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:47.898465 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 10 11:38:47.898465 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 10 11:38:47.898465 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 10 11:38:47.898465 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 10 11:38:47.898465 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 11:38:47.898465 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 11:38:47.898465 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 10 11:38:47.898465 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 10 11:38:47.898465 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 11:38:47.898465 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 11:38:47.898465 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 10 11:38:47.898465 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 10 11:38:47.898465 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Sep 10 11:38:47.898465 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:47.898465 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:47.898465 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:47.898465 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:47.898465 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:47.904364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:47.904364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:38:47.904364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:38:47.904364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:38:47.904364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:38:47.904364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 10 11:38:47.904364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:38:47.904364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Sep 10 11:38:47.904364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:47.904364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:47.904364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:47.904364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:47.904364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:47.904364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:47.904364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:38:47.904364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:38:47.904364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Sep 10 11:38:47.904364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:47.908140 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4bba207e-4388-4fb3-afb5-793572e7088d tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:38:47.908140 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4bba207e-4388-4fb3-afb5-793572e7088d tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.047258 Sep 10 11:38:47.909219 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 129/256] 10.222.0.23 () {58 vars in 1149 bytes} [Sat Sep 10 11:38:47 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:38:47.944986 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cb505a02-5792-406e-b76c-3ace3c890678 tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Calling method '.version_select at 0x7f4073b66ee0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:47.975625 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb505a02-5792-406e-b76c-3ace3c890678 tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:47.976825 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb505a02-5792-406e-b76c-3ace3c890678 tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:47.977531 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb505a02-5792-406e-b76c-3ace3c890678 tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:48.002253 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb505a02-5792-406e-b76c-3ace3c890678 tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:48.002932 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb505a02-5792-406e-b76c-3ace3c890678 tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:48.004060 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb505a02-5792-406e-b76c-3ace3c890678 tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:48.060966 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cb505a02-5792-406e-b76c-3ace3c890678 tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-h2-856895-1" status: 200 len: 598 microversion: 2.1 time: 0.145676 Sep 10 11:38:48.062203 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 130/257] 10.222.0.23 () {58 vars in 1170 bytes} [Sat Sep 10 11:38:47 2022] GET /compute/v2.1/os-hosts/n-h2-856895-1 => generated 598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:48.067819 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-047a8299-cc1b-481d-a33b-809861bedd9d tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:48.095912 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-047a8299-cc1b-481d-a33b-809861bedd9d tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Sep 10 11:38:48.099298 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-047a8299-cc1b-481d-a33b-809861bedd9d tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Request method failure captured: Sep 10 11:38:48.099298 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Sep 10 11:38:48.099298 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:38:48.099298 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:38:48.099298 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:38:48.099298 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:38:48.099298 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:38:48.099298 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:38:48.099298 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:38:48.099298 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:38:48.099298 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHcOM8fGOXD7xJRBlSL4ps2ULtlDnXsxWwCoFPNDlEObci0FzVX59FqgjYC7WDnBSygopbZ7zaJCvKdwg5Eu4YnRezfJ61KAWoYjjcwP9vihF_RAR59l0CfBHYW1vTh5KJZFJLLiv6pBtt1cdiSm6TT3zfiJpuk9WG4oPYywqZpxsa4 Sep 10 11:38:48.099298 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:38:48.099298 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:38:48.099298 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:38:48.099298 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:38:48.099298 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:38:48.099298 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:38:48.099298 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 30692ffbb5d74d97bb650325bbd85c3d Sep 10 11:38:48.099298 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-AggregatesAdminTestJSON-1106198004 Sep 10 11:38:48.099298 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,admin,member Sep 10 11:38:48.099298 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,admin,member Sep 10 11:38:48.100809 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/30692ffbb5d74d97bb650325bbd85c3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/30692ffbb5d74d97bb650325bbd85c3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_30692ffbb5d74d97bb650325bbd85c3d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/30692ffbb5d74d97bb650325bbd85c3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:38:48.100809 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-AggregatesAdminTestJSON-1106198004 Sep 10 11:38:48.100809 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 30692ffbb5d74d97bb650325bbd85c3d Sep 10 11:38:48.100809 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1106198004 Sep 10 11:38:48.100809 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-AggregatesAdminTestJSON-1106198004-project-admin Sep 10 11:38:48.100809 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:38:48.100809 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:38:48.100809 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 2699938fb11c4cd4931a0edd914dc64c Sep 10 11:38:48.100809 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-AggregatesAdminTestJSON-1106198004-project-admin Sep 10 11:38:48.100809 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:38:48.100809 n-d-856895-1 devstack@n-api.service[128777]: exception: Aggregate 6 could not be found. Sep 10 11:38:48.100809 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '6'} Sep 10 11:38:48.100809 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:38:48.101664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:48.101664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 10 11:38:48.101664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 10 11:38:48.101664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 11:38:48.101664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 11:38:48.101664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:38:48.101664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:38:48.101664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:38:48.101664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:38:48.101664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 11:38:48.101664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 11:38:48.101664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 10 11:38:48.101664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 10 11:38:48.101664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 11:38:48.101664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 11:38:48.101664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 10 11:38:48.101664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 10 11:38:48.101664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 11:38:48.101664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 11:38:48.103739 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 10 11:38:48.103739 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 10 11:38:48.103739 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Sep 10 11:38:48.103739 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:48.103739 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:48.103739 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:48.103739 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:48.103739 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:48.103739 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:48.103739 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:38:48.103739 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:38:48.103739 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:38:48.103739 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:38:48.103739 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 10 11:38:48.103739 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:38:48.103739 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Sep 10 11:38:48.103739 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:48.103739 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:48.103739 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:48.103739 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:48.103739 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:48.107828 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:48.107828 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:38:48.107828 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:38:48.107828 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Sep 10 11:38:48.107828 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:48.111119 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-047a8299-cc1b-481d-a33b-809861bedd9d tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:38:48.140443 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-047a8299-cc1b-481d-a33b-809861bedd9d tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.064803 Sep 10 11:38:48.141873 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 131/258] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Sep 10 11:38:48 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:38:48.147764 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b20dd400-b5e9-4ae5-825d-8cfe0caf2929 tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Calling method '.version_select at 0x7f4073b66dc0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:48.158262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b20dd400-b5e9-4ae5-825d-8cfe0caf2929 tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:48.158767 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b20dd400-b5e9-4ae5-825d-8cfe0caf2929 tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:48.159290 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b20dd400-b5e9-4ae5-825d-8cfe0caf2929 tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:48.184063 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b20dd400-b5e9-4ae5-825d-8cfe0caf2929 tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:48.184829 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b20dd400-b5e9-4ae5-825d-8cfe0caf2929 tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:48.186152 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b20dd400-b5e9-4ae5-825d-8cfe0caf2929 tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:48.232327 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b20dd400-b5e9-4ae5-825d-8cfe0caf2929 tempest-HostsAdminTestJSON-1811261160 tempest-HostsAdminTestJSON-1811261160-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-h1-856895-1" status: 200 len: 467 microversion: 2.1 time: 0.087584 Sep 10 11:38:48.232958 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 132/259] 10.222.0.23 () {58 vars in 1170 bytes} [Sat Sep 10 11:38:48 2022] GET /compute/v2.1/os-hosts/n-h1-856895-1 => generated 467 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:48.278593 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8f667ee6-9899-4226-9f5b-e4cdfe58a9fc tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:48.282783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8f667ee6-9899-4226-9f5b-e4cdfe58a9fc tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:48.311227 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8f667ee6-9899-4226-9f5b-e4cdfe58a9fc tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:48.315448 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8f667ee6-9899-4226-9f5b-e4cdfe58a9fc tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:48.315997 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8f667ee6-9899-4226-9f5b-e4cdfe58a9fc tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:48.326342 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8f667ee6-9899-4226-9f5b-e4cdfe58a9fc tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:48.326899 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8f667ee6-9899-4226-9f5b-e4cdfe58a9fc tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:48.327381 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8f667ee6-9899-4226-9f5b-e4cdfe58a9fc tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:48.793591 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-83e4318b-c419-4982-aa4c-c1d4b8dc0fef tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c91799a8724c499cd1afe82e3fd657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95726b0caac4b7fb5f0db90d268430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:48.812169 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-83e4318b-c419-4982-aa4c-c1d4b8dc0fef tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] 10.222.0.23 "GET /compute/v2.1/servers/58290798-70af-44a5-85cc-20871f15c110" status: 200 len: 1322 microversion: 2.1 time: 1.045465 Sep 10 11:38:48.832915 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 128/260] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:47 2022] GET /compute/v2.1/servers/58290798-70af-44a5-85cc-20871f15c110 => generated 1322 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:48.841432 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2a24ffe3-921b-40ea-ae4a-f3cebbbf454e tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-572002923", "name": "tempest-test_aggregate-612602801"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:48.846179 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.aggregate [None req-2a24ffe3-921b-40ea-ae4a-f3cebbbf454e tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Generated uuid 74f365b0-8185-450f-ac33-819b6ed00a7c for aggregate {{(pid=128776) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 11:38:48.885790 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2a24ffe3-921b-40ea-ae4a-f3cebbbf454e tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.050844 Sep 10 11:38:48.887758 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 129/261] 10.222.0.23 () {60 vars in 1165 bytes} [Sat Sep 10 11:38:48 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:48.900110 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4a3851bf-8c1a-4183-bc35-820a1ae29176 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:48.904073 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4a3851bf-8c1a-4183-bc35-820a1ae29176 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 749908de-9f45-4b7f-9ce5-171d2cf11511] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:48.921596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4a3851bf-8c1a-4183-bc35-820a1ae29176 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:48.922169 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4a3851bf-8c1a-4183-bc35-820a1ae29176 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:48.926536 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4a3851bf-8c1a-4183-bc35-820a1ae29176 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:48.929145 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4a3851bf-8c1a-4183-bc35-820a1ae29176 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:48.929639 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4a3851bf-8c1a-4183-bc35-820a1ae29176 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:48.931732 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4a3851bf-8c1a-4183-bc35-820a1ae29176 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:48.981960 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-4a3851bf-8c1a-4183-bc35-820a1ae29176 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] HTTP exception thrown: Instance 749908de-9f45-4b7f-9ce5-171d2cf11511 could not be found. Sep 10 11:38:48.984031 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8f667ee6-9899-4226-9f5b-e4cdfe58a9fc tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:48.993876 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4a3851bf-8c1a-4183-bc35-820a1ae29176 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Request method failure captured: Sep 10 11:38:48.993876 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511 HTTP/1.1 Sep 10 11:38:48.993876 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:38:48.993876 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:38:48.993876 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:38:48.993876 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:38:48.993876 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:38:48.993876 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:38:48.993876 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:38:48.993876 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:38:48.993876 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHcXl-_p7vgI4dby_qITzIhY55KdqBBP_6TYBDe1-vZ3vQLtFhnNKuZafnu4iFHGhqNTOMhJlRV-u1tvuhxUB0IQrpdLW4q9Ju-gqUTkenwnw7mqv5ryGW1KpkQbdTVUYpQYgxFcA7deHFC16m4dRTiLt_WhC-yJSPnJh72fs6TE474 Sep 10 11:38:48.993876 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:38:48.993876 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:38:48.993876 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:38:48.993876 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:38:48.993876 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:38:48.993876 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:38:48.993876 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: a040213a0ea443cd97b346b0d4e79d4d Sep 10 11:38:48.993876 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1489315855 Sep 10 11:38:48.993876 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:38:48.993876 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:38:48.995480 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a040213a0ea443cd97b346b0d4e79d4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a040213a0ea443cd97b346b0d4e79d4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a040213a0ea443cd97b346b0d4e79d4d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a040213a0ea443cd97b346b0d4e79d4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:38:48.995480 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-DeleteServersAdminTestJSON-1489315855 Sep 10 11:38:48.995480 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: a040213a0ea443cd97b346b0d4e79d4d Sep 10 11:38:48.995480 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1489315855 Sep 10 11:38:48.995480 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-DeleteServersAdminTestJSON-1489315855-project Sep 10 11:38:48.995480 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:38:48.995480 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:38:48.995480 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 53b632d0a5ac48fea0da5aa15632cffb Sep 10 11:38:48.995480 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-DeleteServersAdminTestJSON-1489315855-project Sep 10 11:38:48.995480 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:38:48.995480 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 749908de-9f45-4b7f-9ce5-171d2cf11511 could not be found. Sep 10 11:38:48.995480 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '749908de-9f45-4b7f-9ce5-171d2cf11511'} Sep 10 11:38:48.996579 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:38:48.996579 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:48.996579 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:38:48.996579 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:38:48.996579 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:38:48.996579 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:38:48.996579 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:38:48.996579 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:38:48.996579 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:38:48.996579 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:38:48.996579 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 749908de-9f45-4b7f-9ce5-171d2cf11511 could not be found. Sep 10 11:38:48.996579 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:48.996579 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:48.996579 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:48.996579 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:48.996579 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:48.996579 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:48.996579 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:38:48.996579 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:38:48.996579 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:38:48.998996 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:38:48.998996 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:38:48.998996 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:38:48.998996 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:38:48.998996 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:38:48.998996 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:38:48.998996 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:38:48.998996 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 749908de-9f45-4b7f-9ce5-171d2cf11511 could not be found. Sep 10 11:38:48.998996 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:48.998996 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:48.998996 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:48.998996 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:48.998996 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:48.998996 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:48.998996 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:38:48.998996 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:38:48.998996 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 749908de-9f45-4b7f-9ce5-171d2cf11511 could not be found. Sep 10 11:38:48.998996 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:49.000279 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8f667ee6-9899-4226-9f5b-e4cdfe58a9fc tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f" status: 200 len: 1268 microversion: 2.1 time: 0.756381 Sep 10 11:38:49.000279 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 133/262] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:48 2022] GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f => generated 1268 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:49.008702 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4a3851bf-8c1a-4183-bc35-820a1ae29176 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Returning 404 to user: Instance 749908de-9f45-4b7f-9ce5-171d2cf11511 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:38:49.010250 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4a3851bf-8c1a-4183-bc35-820a1ae29176 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511" status: 404 len: 111 microversion: 2.1 time: 0.120439 Sep 10 11:38:49.012921 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 130/263] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:48 2022] GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:38:49.026461 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6174af1b-ede7-46e1-995f-2a44a875b4c3 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:49.091867 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6174af1b-ede7-46e1-995f-2a44a875b4c3 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.087955 Sep 10 11:38:49.094320 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 134/264] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Sep 10 11:38:48 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 11:38:49.104857 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-04cc763a-d3c8-4060-89c7-f5085e4667b0 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:49.117903 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-04cc763a-d3c8-4060-89c7-f5085e4667b0 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Sep 10 11:38:49.134485 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-04cc763a-d3c8-4060-89c7-f5085e4667b0 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Request method failure captured: Sep 10 11:38:49.134485 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Sep 10 11:38:49.134485 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:38:49.134485 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:38:49.134485 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:38:49.134485 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:38:49.134485 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:38:49.134485 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:38:49.134485 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:38:49.134485 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:38:49.134485 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHcOM8fGOXD7xJRBlSL4ps2ULtlDnXsxWwCoFPNDlEObci0FzVX59FqgjYC7WDnBSygopbZ7zaJCvKdwg5Eu4YnRezfJ61KAWoYjjcwP9vihF_RAR59l0CfBHYW1vTh5KJZFJLLiv6pBtt1cdiSm6TT3zfiJpuk9WG4oPYywqZpxsa4 Sep 10 11:38:49.134485 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:38:49.134485 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:38:49.134485 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:38:49.134485 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:38:49.134485 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:38:49.134485 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:38:49.134485 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 30692ffbb5d74d97bb650325bbd85c3d Sep 10 11:38:49.134485 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-AggregatesAdminTestJSON-1106198004 Sep 10 11:38:49.134485 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,admin,member Sep 10 11:38:49.134485 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,admin,member Sep 10 11:38:49.135798 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/30692ffbb5d74d97bb650325bbd85c3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/30692ffbb5d74d97bb650325bbd85c3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_30692ffbb5d74d97bb650325bbd85c3d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/30692ffbb5d74d97bb650325bbd85c3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:38:49.135798 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-AggregatesAdminTestJSON-1106198004 Sep 10 11:38:49.135798 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 30692ffbb5d74d97bb650325bbd85c3d Sep 10 11:38:49.135798 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1106198004 Sep 10 11:38:49.135798 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-AggregatesAdminTestJSON-1106198004-project-admin Sep 10 11:38:49.135798 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:38:49.135798 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:38:49.135798 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 2699938fb11c4cd4931a0edd914dc64c Sep 10 11:38:49.135798 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-AggregatesAdminTestJSON-1106198004-project-admin Sep 10 11:38:49.135798 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:38:49.135798 n-d-856895-1 devstack@n-api.service[128776]: exception: Aggregate 7 could not be found. Sep 10 11:38:49.135798 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '7'} Sep 10 11:38:49.135798 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:38:49.136518 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:49.136518 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 10 11:38:49.136518 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 10 11:38:49.136518 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 10 11:38:49.136518 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 10 11:38:49.136518 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 11:38:49.136518 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 11:38:49.136518 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 10 11:38:49.136518 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 10 11:38:49.136518 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 11:38:49.136518 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 11:38:49.136518 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 10 11:38:49.136518 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 10 11:38:49.136518 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Sep 10 11:38:49.136518 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:49.136518 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:49.136518 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:49.136518 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:49.136518 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:49.137505 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:49.137505 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:38:49.137505 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:38:49.137505 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:38:49.137505 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:38:49.137505 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 10 11:38:49.137505 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:38:49.137505 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Sep 10 11:38:49.137505 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:49.137505 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:49.137505 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:49.137505 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:49.137505 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:49.137505 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:49.137505 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:38:49.137505 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:38:49.137505 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Sep 10 11:38:49.137505 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:49.141781 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-04cc763a-d3c8-4060-89c7-f5085e4667b0 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:38:49.146096 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-04cc763a-d3c8-4060-89c7-f5085e4667b0 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.044675 Sep 10 11:38:49.150774 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 131/265] 10.222.0.23 () {58 vars in 1149 bytes} [Sat Sep 10 11:38:49 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:38:49.156737 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-840fbbf5-d63b-49ee-974e-0401b806a392 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:49.189621 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-840fbbf5-d63b-49ee-974e-0401b806a392 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Sep 10 11:38:49.189830 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-840fbbf5-d63b-49ee-974e-0401b806a392 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Request method failure captured: Sep 10 11:38:49.189830 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Sep 10 11:38:49.189830 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:38:49.189830 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:38:49.189830 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:38:49.189830 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:38:49.189830 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:38:49.189830 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:38:49.189830 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:38:49.189830 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:38:49.189830 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHcOM8fGOXD7xJRBlSL4ps2ULtlDnXsxWwCoFPNDlEObci0FzVX59FqgjYC7WDnBSygopbZ7zaJCvKdwg5Eu4YnRezfJ61KAWoYjjcwP9vihF_RAR59l0CfBHYW1vTh5KJZFJLLiv6pBtt1cdiSm6TT3zfiJpuk9WG4oPYywqZpxsa4 Sep 10 11:38:49.189830 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:38:49.189830 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:38:49.189830 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:38:49.189830 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:38:49.189830 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:38:49.189830 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:38:49.189830 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 30692ffbb5d74d97bb650325bbd85c3d Sep 10 11:38:49.189830 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-AggregatesAdminTestJSON-1106198004 Sep 10 11:38:49.189830 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,admin,member Sep 10 11:38:49.189830 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,admin,member Sep 10 11:38:49.191239 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/30692ffbb5d74d97bb650325bbd85c3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/30692ffbb5d74d97bb650325bbd85c3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_30692ffbb5d74d97bb650325bbd85c3d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/30692ffbb5d74d97bb650325bbd85c3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:38:49.191239 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-AggregatesAdminTestJSON-1106198004 Sep 10 11:38:49.191239 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 30692ffbb5d74d97bb650325bbd85c3d Sep 10 11:38:49.191239 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1106198004 Sep 10 11:38:49.191239 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-AggregatesAdminTestJSON-1106198004-project-admin Sep 10 11:38:49.191239 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:38:49.191239 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:38:49.191239 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 2699938fb11c4cd4931a0edd914dc64c Sep 10 11:38:49.191239 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-AggregatesAdminTestJSON-1106198004-project-admin Sep 10 11:38:49.191239 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:38:49.191239 n-d-856895-1 devstack@n-api.service[128777]: exception: Aggregate 7 could not be found. Sep 10 11:38:49.191239 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '7'} Sep 10 11:38:49.191239 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:38:49.192078 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:49.192078 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 10 11:38:49.192078 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 10 11:38:49.192078 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 11:38:49.192078 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 11:38:49.192078 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:38:49.192078 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:38:49.192078 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:38:49.192078 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:38:49.192078 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 11:38:49.192078 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 11:38:49.192078 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 10 11:38:49.192078 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 10 11:38:49.192078 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 11:38:49.192078 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 11:38:49.192078 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 10 11:38:49.192078 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 10 11:38:49.192078 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 11:38:49.192078 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 11:38:49.193290 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 10 11:38:49.193290 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 10 11:38:49.193290 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Sep 10 11:38:49.193290 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:49.193290 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:49.193290 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:49.193290 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:49.193290 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:49.193290 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:49.193290 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:38:49.193290 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:38:49.193290 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:38:49.193290 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:38:49.193290 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 10 11:38:49.193290 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:38:49.193290 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Sep 10 11:38:49.193290 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:49.193290 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:49.193290 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:49.193290 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:49.193290 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:49.194636 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:49.194636 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:38:49.194636 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:38:49.194636 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Sep 10 11:38:49.194636 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:49.196973 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-840fbbf5-d63b-49ee-974e-0401b806a392 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:38:49.199512 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-840fbbf5-d63b-49ee-974e-0401b806a392 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.047069 Sep 10 11:38:49.202110 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 135/266] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Sep 10 11:38:49 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:38:49.212196 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-68a7915f-84b7-4757-85f2-adbd071c9ced tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-462316425"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:49.220763 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.aggregate [None req-68a7915f-84b7-4757-85f2-adbd071c9ced tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Generated uuid 5543e66c-4d0f-41f1-8ed7-8e5ffcdea479 for aggregate {{(pid=128776) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 11:38:49.284161 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-68a7915f-84b7-4757-85f2-adbd071c9ced tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.075332 Sep 10 11:38:49.287970 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 132/267] 10.222.0.23 () {60 vars in 1164 bytes} [Sat Sep 10 11:38:49 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:49.299541 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5221fad0-facb-46ee-bcd3-b5d33cc0b38b tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:49.314020 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5221fad0-facb-46ee-bcd3-b5d33cc0b38b tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 226 microversion: 2.1 time: 0.018864 Sep 10 11:38:49.314411 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 136/268] 10.222.0.23 () {58 vars in 1149 bytes} [Sat Sep 10 11:38:49 2022] GET /compute/v2.1/os-aggregates/8 => generated 226 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:49.329748 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6a951927-4fee-44a0-a8bc-34089143a3f0 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:49.395890 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6a951927-4fee-44a0-a8bc-34089143a3f0 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 264 microversion: 2.1 time: 0.069953 Sep 10 11:38:49.396504 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 133/269] 10.222.0.23 () {60 vars in 1191 bytes} [Sat Sep 10 11:38:49 2022] POST /compute/v2.1/os-aggregates/8/action => generated 264 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:49.408444 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c6214fbf-ddb1-443c-9e17-c062d28ed7b4 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:49.426163 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c6214fbf-ddb1-443c-9e17-c062d28ed7b4 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 240 microversion: 2.1 time: 0.018695 Sep 10 11:38:49.429614 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 137/270] 10.222.0.23 () {58 vars in 1149 bytes} [Sat Sep 10 11:38:49 2022] GET /compute/v2.1/os-aggregates/8 => generated 240 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:49.430897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-62c4f67b-728f-46af-b939-3973aff73501 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1610202299", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:49.445922 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-53e7932d-53fe-416f-a791-a1c0970f8753 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:49.518239 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-53e7932d-53fe-416f-a791-a1c0970f8753 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.078917 Sep 10 11:38:49.519585 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 138/271] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Sep 10 11:38:49 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 11:38:49.533251 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8009387b-f26e-4900-807e-a97925d27fbe tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2024812195", "availability_zone": "tempest-test_az-103136108"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:49.568872 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-62c4f67b-728f-46af-b939-3973aff73501 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] validate_networks() for None {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:38:49.604753 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.aggregate [None req-8009387b-f26e-4900-807e-a97925d27fbe tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Generated uuid 8a0dee99-c321-42d8-ae1e-068281d41f7d for aggregate {{(pid=128777) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 11:38:49.652816 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8009387b-f26e-4900-807e-a97925d27fbe tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.128272 Sep 10 11:38:49.654020 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 139/272] 10.222.0.23 () {60 vars in 1165 bytes} [Sat Sep 10 11:38:49 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:49.674628 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c09e09e6-2a1c-4890-8af2-11d6c52c636a tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2024812195_new", "availability_zone": "tempest-test_az-103136108_new"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:49.764539 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c09e09e6-2a1c-4890-8af2-11d6c52c636a tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:49.767438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c09e09e6-2a1c-4890-8af2-11d6c52c636a tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:49.768071 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c09e09e6-2a1c-4890-8af2-11d6c52c636a tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:49.837973 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c09e09e6-2a1c-4890-8af2-11d6c52c636a tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 334 microversion: 2.1 time: 0.175588 Sep 10 11:38:49.838740 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 140/273] 10.222.0.23 () {60 vars in 1170 bytes} [Sat Sep 10 11:38:49 2022] PUT /compute/v2.1/os-aggregates/9 => generated 334 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:49.852423 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-102bfce6-4ed9-40b9-9ca8-9ed2e34f929f tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:49.853796 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-102bfce6-4ed9-40b9-9ca8-9ed2e34f929f tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] [instance: 58290798-70af-44a5-85cc-20871f15c110] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:49.866798 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-102bfce6-4ed9-40b9-9ca8-9ed2e34f929f tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:49.868460 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-102bfce6-4ed9-40b9-9ca8-9ed2e34f929f tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:49.869553 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-102bfce6-4ed9-40b9-9ca8-9ed2e34f929f tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:49.870768 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-102bfce6-4ed9-40b9-9ca8-9ed2e34f929f tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:49.871854 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-102bfce6-4ed9-40b9-9ca8-9ed2e34f929f tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:49.872496 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-102bfce6-4ed9-40b9-9ca8-9ed2e34f929f tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:50.403385 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-62c4f67b-728f-46af-b939-3973aff73501 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:38:50.403896 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-62c4f67b-728f-46af-b939-3973aff73501 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:38:50.404278 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-62c4f67b-728f-46af-b939-3973aff73501 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:38:50.404699 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-62c4f67b-728f-46af-b939-3973aff73501 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:38:50.405105 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-62c4f67b-728f-46af-b939-3973aff73501 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:38:50.426447 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-62c4f67b-728f-46af-b939-3973aff73501 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:50.426865 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-62c4f67b-728f-46af-b939-3973aff73501 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:50.427354 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-62c4f67b-728f-46af-b939-3973aff73501 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:50.433245 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-62c4f67b-728f-46af-b939-3973aff73501 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:50.434094 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-62c4f67b-728f-46af-b939-3973aff73501 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:50.434539 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-62c4f67b-728f-46af-b939-3973aff73501 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:50.479120 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-62c4f67b-728f-46af-b939-3973aff73501 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Getting quotas for project a040213a0ea443cd97b346b0d4e79d4d. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:38:50.484312 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-62c4f67b-728f-46af-b939-3973aff73501 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Getting quotas for user 53b632d0a5ac48fea0da5aa15632cffb and project a040213a0ea443cd97b346b0d4e79d4d. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:38:50.500314 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-62c4f67b-728f-46af-b939-3973aff73501 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:38:50.502988 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-62c4f67b-728f-46af-b939-3973aff73501 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 810c2316-10c5-47b4-9118-0298629d94e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:38:50.550918 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-102bfce6-4ed9-40b9-9ca8-9ed2e34f929f tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c91799a8724c499cd1afe82e3fd657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95726b0caac4b7fb5f0db90d268430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:50.568343 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-102bfce6-4ed9-40b9-9ca8-9ed2e34f929f tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] 10.222.0.23 "GET /compute/v2.1/servers/58290798-70af-44a5-85cc-20871f15c110" status: 200 len: 1322 microversion: 2.1 time: 0.727337 Sep 10 11:38:50.572460 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 141/274] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:49 2022] GET /compute/v2.1/servers/58290798-70af-44a5-85cc-20871f15c110 => generated 1322 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:50.599548 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-39196ba7-76ef-4f7a-a69c-b05105cb5a26 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:50.622819 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-39196ba7-76ef-4f7a-a69c-b05105cb5a26 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 337 microversion: 2.1 time: 0.048971 Sep 10 11:38:50.638025 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 142/275] 10.222.0.23 () {58 vars in 1143 bytes} [Sat Sep 10 11:38:50 2022] GET /compute/v2.1/os-aggregates => generated 337 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:50.656112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-29d064df-9a7d-4d4c-8171-d199b11baf2e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:50.661160 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-29d064df-9a7d-4d4c-8171-d199b11baf2e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:50.662486 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-62c4f67b-728f-46af-b939-3973aff73501 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.236242 Sep 10 11:38:50.672086 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 134/276] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:38:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1256 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:38:50.681059 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29d064df-9a7d-4d4c-8171-d199b11baf2e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:50.681571 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29d064df-9a7d-4d4c-8171-d199b11baf2e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:50.682018 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29d064df-9a7d-4d4c-8171-d199b11baf2e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:50.685602 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29d064df-9a7d-4d4c-8171-d199b11baf2e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:50.686167 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-1c89c467-bd63-427e-add9-e8fe035fc007 req-bec5b95a-36e5-4b18-afa9-de2815440ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58290798-70af-44a5-85cc-20871f15c110", "name": "network-vif-plugged", "status": "completed", "tag": "3b3caf11-da53-4207-9580-10640c3c54cb"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:50.687416 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29d064df-9a7d-4d4c-8171-d199b11baf2e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:50.690223 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29d064df-9a7d-4d4c-8171-d199b11baf2e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:50.721157 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-1c89c467-bd63-427e-add9-e8fe035fc007 req-bec5b95a-36e5-4b18-afa9-de2815440ff8 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:50.723768 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-1c89c467-bd63-427e-add9-e8fe035fc007 req-bec5b95a-36e5-4b18-afa9-de2815440ff8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:50.726742 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-1c89c467-bd63-427e-add9-e8fe035fc007 req-bec5b95a-36e5-4b18-afa9-de2815440ff8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:50.754547 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-1c89c467-bd63-427e-add9-e8fe035fc007 req-bec5b95a-36e5-4b18-afa9-de2815440ff8 service nova] Creating event network-vif-plugged:3b3caf11-da53-4207-9580-10640c3c54cb for instance 58290798-70af-44a5-85cc-20871f15c110 on n-h1-856895-1 Sep 10 11:38:50.772924 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-1c89c467-bd63-427e-add9-e8fe035fc007 req-bec5b95a-36e5-4b18-afa9-de2815440ff8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097469 Sep 10 11:38:50.774086 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 135/277] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:50.789219 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-488b5e9e-e06e-424b-a865-6c6cb3d0b7b3 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:50.869680 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-488b5e9e-e06e-424b-a865-6c6cb3d0b7b3 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.092395 Sep 10 11:38:50.873703 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 136/278] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Sep 10 11:38:50 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 11:38:50.888455 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-45b69c4e-c470-47bd-8e40-bd8d21b39713 req-f61028a7-c975-4713-9f4c-b14774279524 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f", "tag": "ea955540-4c57-4a66-aec1-116d10e8a2f8"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:50.917287 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-45b69c4e-c470-47bd-8e40-bd8d21b39713 req-f61028a7-c975-4713-9f4c-b14774279524 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:50.918303 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-45b69c4e-c470-47bd-8e40-bd8d21b39713 req-f61028a7-c975-4713-9f4c-b14774279524 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:50.918734 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-45b69c4e-c470-47bd-8e40-bd8d21b39713 req-f61028a7-c975-4713-9f4c-b14774279524 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:50.941278 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-45b69c4e-c470-47bd-8e40-bd8d21b39713 req-f61028a7-c975-4713-9f4c-b14774279524 service nova] Creating event network-changed:ea955540-4c57-4a66-aec1-116d10e8a2f8 for instance e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f on n-h2-856895-1 Sep 10 11:38:50.951525 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-45b69c4e-c470-47bd-8e40-bd8d21b39713 req-f61028a7-c975-4713-9f4c-b14774279524 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073325 Sep 10 11:38:50.952434 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 137/279] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:50.963200 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7abd85a2-0133-48ca-8ade-c6c392776315 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:50.964114 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7abd85a2-0133-48ca-8ade-c6c392776315 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 810c2316-10c5-47b4-9118-0298629d94e1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:50.973327 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=10,nova_api:INSERT=9 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:38:51.139763 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7abd85a2-0133-48ca-8ade-c6c392776315 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b632d0a5ac48fea0da5aa15632cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a040213a0ea443cd97b346b0d4e79d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:51.162749 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7abd85a2-0133-48ca-8ade-c6c392776315 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/810c2316-10c5-47b4-9118-0298629d94e1" status: 200 len: 1220 microversion: 2.1 time: 0.199071 Sep 10 11:38:51.163628 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 138/280] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:50 2022] GET /compute/v2.1/servers/810c2316-10c5-47b4-9118-0298629d94e1 => generated 1220 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:51.177356 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-86745c5c-e2ac-4242-aac4-70f3bb1752f2 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-56859722"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:51.180798 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.aggregate [None req-86745c5c-e2ac-4242-aac4-70f3bb1752f2 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Generated uuid eaad75c5-bf48-4bbd-8462-e32d867b1704 for aggregate {{(pid=128776) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 11:38:51.229533 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-86745c5c-e2ac-4242-aac4-70f3bb1752f2 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.064795 Sep 10 11:38:51.235318 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 139/281] 10.222.0.23 () {60 vars in 1164 bytes} [Sat Sep 10 11:38:51 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:51.297935 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-29d064df-9a7d-4d4c-8171-d199b11baf2e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:51.309777 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-29d064df-9a7d-4d4c-8171-d199b11baf2e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f" status: 200 len: 1310 microversion: 2.1 time: 0.670249 Sep 10 11:38:51.317444 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 143/282] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:50 2022] GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f => generated 1310 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:51.329669 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e2d08bcd-f750-4a9c-8ea3-076aa6cbed90 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:51.342241 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e2d08bcd-f750-4a9c-8ea3-076aa6cbed90 tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 229 microversion: 2.1 time: 0.023409 Sep 10 11:38:51.343509 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 144/283] 10.222.0.23 () {58 vars in 1143 bytes} [Sat Sep 10 11:38:51 2022] GET /compute/v2.1/os-aggregates => generated 229 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:51.356310 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1986d32c-8923-4bf7-8ca1-0f9e1db2032c tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:51.410275 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1986d32c-8923-4bf7-8ca1-0f9e1db2032c tempest-AggregatesAdminTestJSON-1106198004 tempest-AggregatesAdminTestJSON-1106198004-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.057719 Sep 10 11:38:51.412891 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 145/284] 10.222.0.23 () {58 vars in 1155 bytes} [Sat Sep 10 11:38:51 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 11:38:51.426872 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3a408801-143b-4872-8642-ae32699788b2 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:51.427419 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3a408801-143b-4872-8642-ae32699788b2 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] [instance: b33b0f22-808a-483c-9683-a16f98eccfa6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:51.444990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a408801-143b-4872-8642-ae32699788b2 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:51.446293 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a408801-143b-4872-8642-ae32699788b2 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:51.447368 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a408801-143b-4872-8642-ae32699788b2 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:51.448358 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a408801-143b-4872-8642-ae32699788b2 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:51.449484 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a408801-143b-4872-8642-ae32699788b2 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:51.450725 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a408801-143b-4872-8642-ae32699788b2 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:51.476455 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-3a408801-143b-4872-8642-ae32699788b2 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] HTTP exception thrown: Instance b33b0f22-808a-483c-9683-a16f98eccfa6 could not be found. Sep 10 11:38:51.478340 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3a408801-143b-4872-8642-ae32699788b2 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Request method failure captured: Sep 10 11:38:51.478340 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6 HTTP/1.1 Sep 10 11:38:51.478340 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:38:51.478340 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:38:51.478340 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:38:51.478340 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:38:51.478340 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:38:51.478340 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:38:51.478340 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:38:51.478340 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:38:51.478340 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHcLE9uhUlPhKBThuclBJjVZvWZzTeVk9WpKwgK3QeQnKGNgt3X9g9xkxwx_SFhUGPOT_XYMwGC0SHxPkDZrdF_QBDok4tty140saoiOcEW5Ny-Vbvin_dSfr3sxa3a5kfKQG6lrX-j3ggslgu9FOSH9ocHgNP5vjCubfTdsIc93zv4 Sep 10 11:38:51.478340 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:38:51.478340 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:38:51.478340 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:38:51.478340 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:38:51.478340 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:38:51.478340 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:38:51.478340 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: a8943799e9af4699bcfd87690773282e Sep 10 11:38:51.478340 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-AggregatesAdminTestJSON-156690684 Sep 10 11:38:51.478340 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:38:51.478340 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:38:51.479681 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a8943799e9af4699bcfd87690773282e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a8943799e9af4699bcfd87690773282e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a8943799e9af4699bcfd87690773282e", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a8943799e9af4699bcfd87690773282e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:38:51.479681 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-AggregatesAdminTestJSON-156690684 Sep 10 11:38:51.479681 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: a8943799e9af4699bcfd87690773282e Sep 10 11:38:51.479681 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-156690684 Sep 10 11:38:51.479681 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-AggregatesAdminTestJSON-156690684-project Sep 10 11:38:51.479681 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:38:51.479681 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:38:51.479681 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: ce70607350b14ce98add3c72ed36c9c4 Sep 10 11:38:51.479681 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-AggregatesAdminTestJSON-156690684-project Sep 10 11:38:51.479681 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:38:51.479681 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance b33b0f22-808a-483c-9683-a16f98eccfa6 could not be found. Sep 10 11:38:51.479681 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'b33b0f22-808a-483c-9683-a16f98eccfa6'} Sep 10 11:38:51.480430 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:38:51.480430 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:51.480430 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:38:51.480430 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:38:51.480430 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:38:51.480430 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:38:51.480430 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:38:51.480430 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:38:51.480430 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:38:51.480430 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:38:51.480430 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b33b0f22-808a-483c-9683-a16f98eccfa6 could not be found. Sep 10 11:38:51.480430 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:51.480430 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:51.480430 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:51.480430 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:51.480430 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:51.480430 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:51.480430 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:38:51.480430 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:38:51.480430 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:38:51.481522 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:38:51.481522 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:38:51.481522 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:38:51.481522 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:38:51.481522 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:38:51.481522 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:38:51.481522 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:38:51.481522 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:38:51.481522 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:38:51.481522 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b33b0f22-808a-483c-9683-a16f98eccfa6 could not be found. Sep 10 11:38:51.481522 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:51.481522 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:51.481522 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:51.481522 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:51.481522 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:51.481522 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:51.481522 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:38:51.481522 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:38:51.481522 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b33b0f22-808a-483c-9683-a16f98eccfa6 could not be found. Sep 10 11:38:51.481522 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:51.485096 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3a408801-143b-4872-8642-ae32699788b2 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Returning 404 to user: Instance b33b0f22-808a-483c-9683-a16f98eccfa6 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:38:51.486216 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3a408801-143b-4872-8642-ae32699788b2 tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6" status: 404 len: 111 microversion: 2.1 time: 0.067767 Sep 10 11:38:51.487309 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 146/285] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:38:51 2022] DELETE /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:38:51.497770 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a20bc9d3-b8ca-4f19-8d8a-e334134bd5cb tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:51.498890 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a20bc9d3-b8ca-4f19-8d8a-e334134bd5cb tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] [instance: b33b0f22-808a-483c-9683-a16f98eccfa6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:51.507808 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a20bc9d3-b8ca-4f19-8d8a-e334134bd5cb tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:51.508632 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a20bc9d3-b8ca-4f19-8d8a-e334134bd5cb tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:51.509669 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a20bc9d3-b8ca-4f19-8d8a-e334134bd5cb tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:51.510827 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a20bc9d3-b8ca-4f19-8d8a-e334134bd5cb tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:51.511509 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a20bc9d3-b8ca-4f19-8d8a-e334134bd5cb tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:51.512115 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a20bc9d3-b8ca-4f19-8d8a-e334134bd5cb tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:51.530389 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-a20bc9d3-b8ca-4f19-8d8a-e334134bd5cb tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] HTTP exception thrown: Instance b33b0f22-808a-483c-9683-a16f98eccfa6 could not be found. Sep 10 11:38:51.532057 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a20bc9d3-b8ca-4f19-8d8a-e334134bd5cb tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Request method failure captured: Sep 10 11:38:51.532057 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6 HTTP/1.1 Sep 10 11:38:51.532057 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:38:51.532057 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:38:51.532057 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:38:51.532057 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:38:51.532057 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:38:51.532057 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:38:51.532057 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:38:51.532057 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:38:51.532057 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHcLE9uhUlPhKBThuclBJjVZvWZzTeVk9WpKwgK3QeQnKGNgt3X9g9xkxwx_SFhUGPOT_XYMwGC0SHxPkDZrdF_QBDok4tty140saoiOcEW5Ny-Vbvin_dSfr3sxa3a5kfKQG6lrX-j3ggslgu9FOSH9ocHgNP5vjCubfTdsIc93zv4 Sep 10 11:38:51.532057 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:38:51.532057 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:38:51.532057 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:38:51.532057 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:38:51.532057 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:38:51.532057 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:38:51.532057 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: a8943799e9af4699bcfd87690773282e Sep 10 11:38:51.532057 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-AggregatesAdminTestJSON-156690684 Sep 10 11:38:51.532057 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:38:51.532057 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:38:51.533534 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a8943799e9af4699bcfd87690773282e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a8943799e9af4699bcfd87690773282e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a8943799e9af4699bcfd87690773282e", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a8943799e9af4699bcfd87690773282e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:38:51.533534 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-AggregatesAdminTestJSON-156690684 Sep 10 11:38:51.533534 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: a8943799e9af4699bcfd87690773282e Sep 10 11:38:51.533534 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-156690684 Sep 10 11:38:51.533534 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-AggregatesAdminTestJSON-156690684-project Sep 10 11:38:51.533534 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:38:51.533534 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:38:51.533534 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: ce70607350b14ce98add3c72ed36c9c4 Sep 10 11:38:51.533534 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-AggregatesAdminTestJSON-156690684-project Sep 10 11:38:51.533534 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:38:51.533534 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance b33b0f22-808a-483c-9683-a16f98eccfa6 could not be found. Sep 10 11:38:51.533534 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'b33b0f22-808a-483c-9683-a16f98eccfa6'} Sep 10 11:38:51.534973 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:38:51.534973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:51.534973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:38:51.534973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:38:51.534973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:38:51.534973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:38:51.534973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:38:51.534973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:38:51.534973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:38:51.534973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:38:51.534973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b33b0f22-808a-483c-9683-a16f98eccfa6 could not be found. Sep 10 11:38:51.534973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:51.534973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:51.534973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:51.534973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:51.534973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:51.534973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:51.534973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:38:51.534973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:38:51.534973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:38:51.536353 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:38:51.536353 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:38:51.536353 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:38:51.536353 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:38:51.536353 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:38:51.536353 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:38:51.536353 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:38:51.536353 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b33b0f22-808a-483c-9683-a16f98eccfa6 could not be found. Sep 10 11:38:51.536353 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:51.536353 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:51.536353 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:51.536353 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:51.536353 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:51.536353 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:51.536353 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:38:51.536353 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:38:51.536353 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b33b0f22-808a-483c-9683-a16f98eccfa6 could not be found. Sep 10 11:38:51.536353 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:51.537518 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a20bc9d3-b8ca-4f19-8d8a-e334134bd5cb tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] Returning 404 to user: Instance b33b0f22-808a-483c-9683-a16f98eccfa6 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:38:51.538538 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a20bc9d3-b8ca-4f19-8d8a-e334134bd5cb tempest-AggregatesAdminTestJSON-156690684 tempest-AggregatesAdminTestJSON-156690684-project] 10.222.0.23 "GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6" status: 404 len: 111 microversion: 2.1 time: 0.046329 Sep 10 11:38:51.539406 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 147/286] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:51 2022] GET /compute/v2.1/servers/b33b0f22-808a-483c-9683-a16f98eccfa6 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 11:38:51.602871 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-49f20694-8505-4401-b01b-a75a7969cf5c tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:51.603542 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-49f20694-8505-4401-b01b-a75a7969cf5c tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] [instance: 58290798-70af-44a5-85cc-20871f15c110] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:51.609671 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-49f20694-8505-4401-b01b-a75a7969cf5c tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:51.610160 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-49f20694-8505-4401-b01b-a75a7969cf5c tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:51.610596 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-49f20694-8505-4401-b01b-a75a7969cf5c tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:51.611319 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-49f20694-8505-4401-b01b-a75a7969cf5c tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:51.611770 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-49f20694-8505-4401-b01b-a75a7969cf5c tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:51.612385 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-49f20694-8505-4401-b01b-a75a7969cf5c tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:51.694253 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cb0abcd0-39b4-4cf3-b313-96243278ba5e tempest-ServicesAdminTestJSON-255695630 tempest-ServicesAdminTestJSON-255695630-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:51.702493 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb0abcd0-39b4-4cf3-b313-96243278ba5e tempest-ServicesAdminTestJSON-255695630 tempest-ServicesAdminTestJSON-255695630-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:51.703059 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb0abcd0-39b4-4cf3-b313-96243278ba5e tempest-ServicesAdminTestJSON-255695630 tempest-ServicesAdminTestJSON-255695630-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:51.710294 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb0abcd0-39b4-4cf3-b313-96243278ba5e tempest-ServicesAdminTestJSON-255695630 tempest-ServicesAdminTestJSON-255695630-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:51.711134 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb0abcd0-39b4-4cf3-b313-96243278ba5e tempest-ServicesAdminTestJSON-255695630 tempest-ServicesAdminTestJSON-255695630-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:51.711831 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb0abcd0-39b4-4cf3-b313-96243278ba5e tempest-ServicesAdminTestJSON-255695630 tempest-ServicesAdminTestJSON-255695630-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:51.712453 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb0abcd0-39b4-4cf3-b313-96243278ba5e tempest-ServicesAdminTestJSON-255695630 tempest-ServicesAdminTestJSON-255695630-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:51.785076 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-49f20694-8505-4401-b01b-a75a7969cf5c tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c91799a8724c499cd1afe82e3fd657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95726b0caac4b7fb5f0db90d268430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:51.786316 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cb0abcd0-39b4-4cf3-b313-96243278ba5e tempest-ServicesAdminTestJSON-255695630 tempest-ServicesAdminTestJSON-255695630-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.549499 Sep 10 11:38:51.795877 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-49f20694-8505-4401-b01b-a75a7969cf5c tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] 10.222.0.23 "GET /compute/v2.1/servers/58290798-70af-44a5-85cc-20871f15c110" status: 200 len: 1322 microversion: 2.1 time: 0.199880 Sep 10 11:38:51.798952 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 148/287] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:51 2022] GET /compute/v2.1/servers/58290798-70af-44a5-85cc-20871f15c110 => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:51.801020 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 140/288] 10.222.0.23 () {58 vars in 1137 bytes} [Sat Sep 10 11:38:51 2022] GET /compute/v2.1/os-services => generated 944 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:51.811981 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bb909a31-17c4-4009-859b-bbad716cc0ea tempest-ServicesAdminTestJSON-255695630 tempest-ServicesAdminTestJSON-255695630-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:51.816337 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bb909a31-17c4-4009-859b-bbad716cc0ea tempest-ServicesAdminTestJSON-255695630 tempest-ServicesAdminTestJSON-255695630-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:51.816898 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bb909a31-17c4-4009-859b-bbad716cc0ea tempest-ServicesAdminTestJSON-255695630 tempest-ServicesAdminTestJSON-255695630-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:51.817419 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bb909a31-17c4-4009-859b-bbad716cc0ea tempest-ServicesAdminTestJSON-255695630 tempest-ServicesAdminTestJSON-255695630-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:51.818264 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bb909a31-17c4-4009-859b-bbad716cc0ea tempest-ServicesAdminTestJSON-255695630 tempest-ServicesAdminTestJSON-255695630-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:51.818723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bb909a31-17c4-4009-859b-bbad716cc0ea tempest-ServicesAdminTestJSON-255695630 tempest-ServicesAdminTestJSON-255695630-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:51.819266 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bb909a31-17c4-4009-859b-bbad716cc0ea tempest-ServicesAdminTestJSON-255695630 tempest-ServicesAdminTestJSON-255695630-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:51.824653 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=17 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:38:51.849522 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bb909a31-17c4-4009-859b-bbad716cc0ea tempest-ServicesAdminTestJSON-255695630 tempest-ServicesAdminTestJSON-255695630-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=n-d-856895-1" status: 200 len: 578 microversion: 2.1 time: 0.045877 Sep 10 11:38:51.851218 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 149/289] 10.222.0.23 () {58 vars in 1172 bytes} [Sat Sep 10 11:38:51 2022] GET /compute/v2.1/os-services?host=n-d-856895-1 => generated 578 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:51.863150 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9e922a48-2256-4972-92d0-c26e4d0a3f4c tempest-ServicesAdminTestJSON-255695630 tempest-ServicesAdminTestJSON-255695630-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:51.866715 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9e922a48-2256-4972-92d0-c26e4d0a3f4c tempest-ServicesAdminTestJSON-255695630 tempest-ServicesAdminTestJSON-255695630-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:51.867244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9e922a48-2256-4972-92d0-c26e4d0a3f4c tempest-ServicesAdminTestJSON-255695630 tempest-ServicesAdminTestJSON-255695630-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:51.867687 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9e922a48-2256-4972-92d0-c26e4d0a3f4c tempest-ServicesAdminTestJSON-255695630 tempest-ServicesAdminTestJSON-255695630-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:51.868416 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9e922a48-2256-4972-92d0-c26e4d0a3f4c tempest-ServicesAdminTestJSON-255695630 tempest-ServicesAdminTestJSON-255695630-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:51.869132 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9e922a48-2256-4972-92d0-c26e4d0a3f4c tempest-ServicesAdminTestJSON-255695630 tempest-ServicesAdminTestJSON-255695630-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:51.869840 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9e922a48-2256-4972-92d0-c26e4d0a3f4c tempest-ServicesAdminTestJSON-255695630 tempest-ServicesAdminTestJSON-255695630-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:51.898728 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9e922a48-2256-4972-92d0-c26e4d0a3f4c tempest-ServicesAdminTestJSON-255695630 tempest-ServicesAdminTestJSON-255695630-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.039698 Sep 10 11:38:51.899658 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 141/290] 10.222.0.23 () {58 vars in 1176 bytes} [Sat Sep 10 11:38:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:38:51.914716 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f905050a-ffe5-42f1-afd0-74961d4b5599 tempest-ServicesAdminTestJSON-255695630 tempest-ServicesAdminTestJSON-255695630-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:51.919037 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f905050a-ffe5-42f1-afd0-74961d4b5599 tempest-ServicesAdminTestJSON-255695630 tempest-ServicesAdminTestJSON-255695630-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:51.920673 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f905050a-ffe5-42f1-afd0-74961d4b5599 tempest-ServicesAdminTestJSON-255695630 tempest-ServicesAdminTestJSON-255695630-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:51.921287 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f905050a-ffe5-42f1-afd0-74961d4b5599 tempest-ServicesAdminTestJSON-255695630 tempest-ServicesAdminTestJSON-255695630-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:51.922113 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f905050a-ffe5-42f1-afd0-74961d4b5599 tempest-ServicesAdminTestJSON-255695630 tempest-ServicesAdminTestJSON-255695630-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:51.922643 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f905050a-ffe5-42f1-afd0-74961d4b5599 tempest-ServicesAdminTestJSON-255695630 tempest-ServicesAdminTestJSON-255695630-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:51.923201 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f905050a-ffe5-42f1-afd0-74961d4b5599 tempest-ServicesAdminTestJSON-255695630 tempest-ServicesAdminTestJSON-255695630-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:51.952865 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f905050a-ffe5-42f1-afd0-74961d4b5599 tempest-ServicesAdminTestJSON-255695630 tempest-ServicesAdminTestJSON-255695630-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.043182 Sep 10 11:38:51.960049 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 150/291] 10.222.0.23 () {58 vars in 1137 bytes} [Sat Sep 10 11:38:51 2022] GET /compute/v2.1/os-services => generated 944 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:38:52.191015 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dc731893-6649-449e-8b16-e74cf4d54bf1 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:52.195524 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-dc731893-6649-449e-8b16-e74cf4d54bf1 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 810c2316-10c5-47b4-9118-0298629d94e1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:52.202938 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dc731893-6649-449e-8b16-e74cf4d54bf1 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:52.204262 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dc731893-6649-449e-8b16-e74cf4d54bf1 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:52.204853 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dc731893-6649-449e-8b16-e74cf4d54bf1 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:52.214469 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dc731893-6649-449e-8b16-e74cf4d54bf1 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:52.216678 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dc731893-6649-449e-8b16-e74cf4d54bf1 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:52.217986 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dc731893-6649-449e-8b16-e74cf4d54bf1 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:52.305121 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-dc731893-6649-449e-8b16-e74cf4d54bf1 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b632d0a5ac48fea0da5aa15632cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a040213a0ea443cd97b346b0d4e79d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:52.316506 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-dc731893-6649-449e-8b16-e74cf4d54bf1 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/810c2316-10c5-47b4-9118-0298629d94e1" status: 200 len: 1272 microversion: 2.1 time: 0.134403 Sep 10 11:38:52.317661 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 142/292] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:52 2022] GET /compute/v2.1/servers/810c2316-10c5-47b4-9118-0298629d94e1 => generated 1272 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:52.340135 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-97de8d7b-33ae-44fe-aa37-980b545c4ba5 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:52.341025 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-97de8d7b-33ae-44fe-aa37-980b545c4ba5 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:52.349845 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-97de8d7b-33ae-44fe-aa37-980b545c4ba5 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:52.350856 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-97de8d7b-33ae-44fe-aa37-980b545c4ba5 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:52.351537 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-97de8d7b-33ae-44fe-aa37-980b545c4ba5 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:52.354247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-97de8d7b-33ae-44fe-aa37-980b545c4ba5 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:52.354995 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-97de8d7b-33ae-44fe-aa37-980b545c4ba5 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:52.355673 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-97de8d7b-33ae-44fe-aa37-980b545c4ba5 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:52.593468 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-97de8d7b-33ae-44fe-aa37-980b545c4ba5 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:52.609593 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-97de8d7b-33ae-44fe-aa37-980b545c4ba5 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f" status: 200 len: 1310 microversion: 2.1 time: 0.279683 Sep 10 11:38:52.623972 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 151/293] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:52 2022] GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f => generated 1310 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:52.821767 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6eea9806-105c-4dc8-92da-ed67ccb66691 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:52.822392 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6eea9806-105c-4dc8-92da-ed67ccb66691 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] [instance: 58290798-70af-44a5-85cc-20871f15c110] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:52.828681 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6eea9806-105c-4dc8-92da-ed67ccb66691 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:52.829347 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6eea9806-105c-4dc8-92da-ed67ccb66691 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:52.829954 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6eea9806-105c-4dc8-92da-ed67ccb66691 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:52.830924 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6eea9806-105c-4dc8-92da-ed67ccb66691 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:52.832136 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6eea9806-105c-4dc8-92da-ed67ccb66691 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:52.832761 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6eea9806-105c-4dc8-92da-ed67ccb66691 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:53.046541 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e36081dc-5320-4c4d-aa12-0e04d757f25f tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:53.050697 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6eea9806-105c-4dc8-92da-ed67ccb66691 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c91799a8724c499cd1afe82e3fd657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95726b0caac4b7fb5f0db90d268430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:53.059863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e36081dc-5320-4c4d-aa12-0e04d757f25f tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:53.060342 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e36081dc-5320-4c4d-aa12-0e04d757f25f tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:53.061967 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6eea9806-105c-4dc8-92da-ed67ccb66691 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] 10.222.0.23 "GET /compute/v2.1/servers/58290798-70af-44a5-85cc-20871f15c110" status: 200 len: 1472 microversion: 2.1 time: 0.243983 Sep 10 11:38:53.062724 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 152/294] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:52 2022] GET /compute/v2.1/servers/58290798-70af-44a5-85cc-20871f15c110 => generated 1472 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:38:53.064044 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e36081dc-5320-4c4d-aa12-0e04d757f25f tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:53.064852 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e36081dc-5320-4c4d-aa12-0e04d757f25f tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:53.067738 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e36081dc-5320-4c4d-aa12-0e04d757f25f tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:53.068398 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e36081dc-5320-4c4d-aa12-0e04d757f25f tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:53.299338 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e36081dc-5320-4c4d-aa12-0e04d757f25f tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.705269 Sep 10 11:38:53.299851 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 143/295] 10.222.0.23 () {58 vars in 1176 bytes} [Sat Sep 10 11:38:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:53.320613 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-754cc091-7baf-47fd-ac40-90d9cd332c0a tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-492978022"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:53.325611 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.aggregate [None req-754cc091-7baf-47fd-ac40-90d9cd332c0a tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Generated uuid 124f2dac-16eb-4c93-bf5f-bd6f0e5a17f8 for aggregate {{(pid=128776) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 11:38:53.352858 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-754cc091-7baf-47fd-ac40-90d9cd332c0a tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.041982 Sep 10 11:38:53.354882 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 144/296] 10.222.0.23 () {60 vars in 1164 bytes} [Sat Sep 10 11:38:53 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:53.360356 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-783656c3-a927-493d-8ce1-0a9daf7d9efe tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:53.361321 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-783656c3-a927-493d-8ce1-0a9daf7d9efe tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 810c2316-10c5-47b4-9118-0298629d94e1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:53.369870 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-783656c3-a927-493d-8ce1-0a9daf7d9efe tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:53.370735 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-783656c3-a927-493d-8ce1-0a9daf7d9efe tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:53.371428 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-783656c3-a927-493d-8ce1-0a9daf7d9efe tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:53.372456 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-783656c3-a927-493d-8ce1-0a9daf7d9efe tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:53.373088 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-783656c3-a927-493d-8ce1-0a9daf7d9efe tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:53.374200 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-783656c3-a927-493d-8ce1-0a9daf7d9efe tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:53.465798 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-783656c3-a927-493d-8ce1-0a9daf7d9efe tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b632d0a5ac48fea0da5aa15632cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a040213a0ea443cd97b346b0d4e79d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:53.469871 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4abf2c78-71f3-4c7d-ba4b-d73a8e27d1fd tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:53.470781 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4abf2c78-71f3-4c7d-ba4b-d73a8e27d1fd tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] [instance: 739a00a0-5f92-4bb9-8089-56c91b748615] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:53.478480 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-783656c3-a927-493d-8ce1-0a9daf7d9efe tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/810c2316-10c5-47b4-9118-0298629d94e1" status: 200 len: 1278 microversion: 2.1 time: 0.121962 Sep 10 11:38:53.479738 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-4abf2c78-71f3-4c7d-ba4b-d73a8e27d1fd tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] HTTP exception thrown: Instance 739a00a0-5f92-4bb9-8089-56c91b748615 could not be found. Sep 10 11:38:53.481720 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 145/297] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:53 2022] GET /compute/v2.1/servers/810c2316-10c5-47b4-9118-0298629d94e1 => generated 1278 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:53.482463 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4abf2c78-71f3-4c7d-ba4b-d73a8e27d1fd tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Request method failure captured: Sep 10 11:38:53.482463 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers/739a00a0-5f92-4bb9-8089-56c91b748615/action HTTP/1.1 Sep 10 11:38:53.482463 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:38:53.482463 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:38:53.482463 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:38:53.482463 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 15 Sep 10 11:38:53.482463 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:38:53.482463 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:38:53.482463 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:38:53.482463 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:38:53.482463 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHc4_F0tNAExskgexgV7fMjvrq1d3bxjxQaj33mc2GLrEkISohR83aFYjnG9kdcXL2x5sr7UdXpgs5WTWdSPum1ob47Pv0AHqX1qH3LoLJINbaKHjymeuJ56ebxv_p5pKSHdT6O5XV77o6-48QSS9f9X2mbEBmLP0JlbgsKMen32P-E Sep 10 11:38:53.482463 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:38:53.482463 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:38:53.482463 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:38:53.482463 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:38:53.482463 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:38:53.482463 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:38:53.482463 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: f42645262cc346ca85abc49a69f5f9b9 Sep 10 11:38:53.482463 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-486642793 Sep 10 11:38:53.482463 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,admin,member Sep 10 11:38:53.482463 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,admin,member Sep 10 11:38:53.483718 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f42645262cc346ca85abc49a69f5f9b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f42645262cc346ca85abc49a69f5f9b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f42645262cc346ca85abc49a69f5f9b9", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f42645262cc346ca85abc49a69f5f9b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:38:53.483718 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersAdminNegativeTestJSON-486642793 Sep 10 11:38:53.483718 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: f42645262cc346ca85abc49a69f5f9b9 Sep 10 11:38:53.483718 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-486642793 Sep 10 11:38:53.483718 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersAdminNegativeTestJSON-486642793-project-admin Sep 10 11:38:53.483718 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:38:53.483718 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:38:53.483718 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: ae71c1cae8744694bbce6d52821438bb Sep 10 11:38:53.483718 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersAdminNegativeTestJSON-486642793-project-admin Sep 10 11:38:53.483718 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:38:53.483718 n-d-856895-1 devstack@n-api.service[128777]: {"migrate": {}} Sep 10 11:38:53.483718 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:38:53.483718 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 739a00a0-5f92-4bb9-8089-56c91b748615 could not be found. Sep 10 11:38:53.484469 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '739a00a0-5f92-4bb9-8089-56c91b748615', 'body': {'migrate': {}}} Sep 10 11:38:53.484469 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:38:53.484469 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:53.484469 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:38:53.484469 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:38:53.484469 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:38:53.484469 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:38:53.484469 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 11:38:53.484469 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 11:38:53.484469 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 739a00a0-5f92-4bb9-8089-56c91b748615 could not be found. Sep 10 11:38:53.484469 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:53.484469 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:53.484469 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:53.484469 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:53.484469 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:53.484469 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:53.484469 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:38:53.484469 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:38:53.484469 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:38:53.484469 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:38:53.485519 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:38:53.485519 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:38:53.485519 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Sep 10 11:38:53.485519 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Sep 10 11:38:53.485519 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:38:53.485519 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:38:53.485519 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 739a00a0-5f92-4bb9-8089-56c91b748615 could not be found. Sep 10 11:38:53.485519 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:53.485519 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:53.485519 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:53.485519 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:53.485519 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:53.485519 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:53.485519 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:38:53.485519 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:38:53.485519 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 739a00a0-5f92-4bb9-8089-56c91b748615 could not be found. Sep 10 11:38:53.485519 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:53.488935 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4abf2c78-71f3-4c7d-ba4b-d73a8e27d1fd tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Returning 404 to user: Instance 739a00a0-5f92-4bb9-8089-56c91b748615 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:38:53.490042 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4abf2c78-71f3-4c7d-ba4b-d73a8e27d1fd tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/739a00a0-5f92-4bb9-8089-56c91b748615/action" status: 404 len: 111 microversion: 2.1 time: 0.406415 Sep 10 11:38:53.491264 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 153/298] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:38:53 2022] POST /compute/v2.1/servers/739a00a0-5f92-4bb9-8089-56c91b748615/action => generated 111 bytes in 408 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 11:38:53.506827 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8cbf3d36-0e8d-47e6-8260-7f87f00feb16 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-856895-1"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:53.528188 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8cbf3d36-0e8d-47e6-8260-7f87f00feb16 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:53.528679 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8cbf3d36-0e8d-47e6-8260-7f87f00feb16 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:53.529116 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8cbf3d36-0e8d-47e6-8260-7f87f00feb16 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:53.635889 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0e138fbf-1cc6-48b8-a4d6-37ce73ea9fe7 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:53.637335 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0e138fbf-1cc6-48b8-a4d6-37ce73ea9fe7 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:53.653127 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e138fbf-1cc6-48b8-a4d6-37ce73ea9fe7 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:53.654165 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e138fbf-1cc6-48b8-a4d6-37ce73ea9fe7 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:53.655051 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e138fbf-1cc6-48b8-a4d6-37ce73ea9fe7 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:53.657225 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e138fbf-1cc6-48b8-a4d6-37ce73ea9fe7 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:53.658205 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e138fbf-1cc6-48b8-a4d6-37ce73ea9fe7 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:53.659103 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e138fbf-1cc6-48b8-a4d6-37ce73ea9fe7 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:53.713432 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=100 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:38:53.821234 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8cbf3d36-0e8d-47e6-8260-7f87f00feb16 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 242 microversion: 2.1 time: 0.337664 Sep 10 11:38:53.821833 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 146/299] 10.222.0.23 () {60 vars in 1194 bytes} [Sat Sep 10 11:38:53 2022] POST /compute/v2.1/os-aggregates/11/action => generated 242 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:53.840503 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d262bc4b-edeb-4536-ba31-351efd155894 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-504541680", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:53.916518 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-d262bc4b-edeb-4536-ba31-351efd155894 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] validate_networks() for None {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:38:53.978804 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0e138fbf-1cc6-48b8-a4d6-37ce73ea9fe7 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:53.993680 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0e138fbf-1cc6-48b8-a4d6-37ce73ea9fe7 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f" status: 200 len: 1310 microversion: 2.1 time: 0.355216 Sep 10 11:38:53.993680 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 154/300] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:53 2022] GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f => generated 1310 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:38:54.010429 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c96a5bd7-eb39-4450-9d3c-64ac737283e8 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-856895-1"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:54.027545 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c96a5bd7-eb39-4450-9d3c-64ac737283e8 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:54.028234 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c96a5bd7-eb39-4450-9d3c-64ac737283e8 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:54.028768 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c96a5bd7-eb39-4450-9d3c-64ac737283e8 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:54.038545 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:DELETE=7,nova_api:SELECT=89,nova_api:INSERT=2,nova_api:UPDATE=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:38:54.071307 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-c96a5bd7-eb39-4450-9d3c-64ac737283e8 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] HTTP exception thrown: Aggregate 11 already has host n-h2-856895-1. Sep 10 11:38:54.095623 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c96a5bd7-eb39-4450-9d3c-64ac737283e8 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Request method failure captured: Sep 10 11:38:54.095623 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Sep 10 11:38:54.095623 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:38:54.095623 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:38:54.095623 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:38:54.095623 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 39 Sep 10 11:38:54.095623 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:38:54.095623 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:38:54.095623 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:38:54.095623 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:38:54.095623 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHdMmjmJlORb7Mn9h0LiG6VjGgHzN0KMleJ88MPwntD_3w_8FT4TQGi2Jkk9-1w-yGeOVtrvCBl0CkyNVVCw3ufgJZ3fmryUbNV3QNpo2jJzWbaR3wVY5BdQ-7FEmbTLdjQF9E5Zbbfk5chIheFwEKlGiwp-XfXu3oH47BQ00WZG7Vc Sep 10 11:38:54.095623 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:38:54.095623 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:38:54.095623 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:38:54.095623 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:38:54.095623 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:38:54.095623 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:38:54.095623 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: cee7249e943d467eaec957455ed8a715 Sep 10 11:38:54.095623 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1641762440 Sep 10 11:38:54.095623 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,admin,member Sep 10 11:38:54.095623 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,admin,member Sep 10 11:38:54.098456 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cee7249e943d467eaec957455ed8a715"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cee7249e943d467eaec957455ed8a715"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cee7249e943d467eaec957455ed8a715", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cee7249e943d467eaec957455ed8a715"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:38:54.098456 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1641762440 Sep 10 11:38:54.098456 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: cee7249e943d467eaec957455ed8a715 Sep 10 11:38:54.098456 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1641762440 Sep 10 11:38:54.098456 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin Sep 10 11:38:54.098456 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:38:54.098456 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:38:54.098456 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: e1f7dc2c9dd94b5ebba6126f7d0de5e9 Sep 10 11:38:54.098456 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin Sep 10 11:38:54.098456 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:38:54.098456 n-d-856895-1 devstack@n-api.service[128777]: {"add_host": {"host": "n-h2-856895-1"}} Sep 10 11:38:54.098456 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:38:54.098456 n-d-856895-1 devstack@n-api.service[128777]: exception: Aggregate 11 already has host n-h2-856895-1. Sep 10 11:38:54.099396 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '11', 'body': {'add_host': {'host': 'n-h2-856895-1'}}} Sep 10 11:38:54.099396 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:38:54.099396 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:54.099396 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 10 11:38:54.099396 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 10 11:38:54.099396 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 10 11:38:54.099396 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 10 11:38:54.099396 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 10 11:38:54.099396 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 10 11:38:54.099396 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 10 11:38:54.099396 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 10 11:38:54.099396 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 10 11:38:54.099396 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 10 11:38:54.099396 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 10 11:38:54.099396 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result.read() Sep 10 11:38:54.099396 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 10 11:38:54.099396 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 10 11:38:54.099396 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 10 11:38:54.099396 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 10 11:38:54.100663 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 10 11:38:54.100663 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 10 11:38:54.100663 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 10 11:38:54.100663 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 10 11:38:54.100663 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-856895-1-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 10 11:38:54.100663 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:54.100663 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 10 11:38:54.100663 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:54.100663 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:54.100663 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Sep 10 11:38:54.100663 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Sep 10 11:38:54.100663 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 10 11:38:54.100663 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi session.flush() Sep 10 11:38:54.100663 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 10 11:38:54.100663 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 10 11:38:54.100663 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 10 11:38:54.100663 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 10 11:38:54.100663 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 10 11:38:54.100663 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 10 11:38:54.101992 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 10 11:38:54.101992 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception Sep 10 11:38:54.101992 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 10 11:38:54.101992 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 10 11:38:54.101992 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 10 11:38:54.101992 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 10 11:38:54.101992 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 10 11:38:54.101992 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 10 11:38:54.101992 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 10 11:38:54.101992 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 10 11:38:54.101992 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 10 11:38:54.101992 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 10 11:38:54.101992 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 10 11:38:54.101992 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 10 11:38:54.101992 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 10 11:38:54.101992 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 10 11:38:54.101992 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 10 11:38:54.101992 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 10 11:38:54.103282 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 10 11:38:54.103282 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 10 11:38:54.103282 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 10 11:38:54.103282 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 10 11:38:54.103282 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 10 11:38:54.103282 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception Sep 10 11:38:54.103282 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 10 11:38:54.103282 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 10 11:38:54.103282 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 10 11:38:54.103282 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 10 11:38:54.103282 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 10 11:38:54.103282 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 10 11:38:54.103282 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 10 11:38:54.103282 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 10 11:38:54.103282 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 10 11:38:54.103282 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 10 11:38:54.103282 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 10 11:38:54.103282 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result.read() Sep 10 11:38:54.104474 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 10 11:38:54.104474 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 10 11:38:54.104474 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 10 11:38:54.104474 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 10 11:38:54.104474 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 10 11:38:54.104474 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 10 11:38:54.104474 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 10 11:38:54.104474 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 10 11:38:54.104474 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-856895-1-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 10 11:38:54.104474 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Sep 10 11:38:54.104474 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 10, 11, 38, 54, 57676), 'updated_at': None, 'host': 'n-h2-856895-1', 'aggregate_id': 11}] Sep 10 11:38:54.104474 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 10 11:38:54.104474 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:54.104474 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:54.104474 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:54.104474 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:54.104474 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 10 11:38:54.105444 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 10 11:38:54.105444 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 11:38:54.105444 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 11:38:54.105444 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:38:54.105444 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:38:54.105444 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:38:54.105444 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:38:54.105444 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 11:38:54.105444 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 11:38:54.105444 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Sep 10 11:38:54.105444 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Sep 10 11:38:54.105444 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 10 11:38:54.105444 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 10 11:38:54.105444 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Sep 10 11:38:54.105444 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Sep 10 11:38:54.105444 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Sep 10 11:38:54.105444 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Sep 10 11:38:54.105444 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 11 already has host n-h2-856895-1. Sep 10 11:38:54.105444 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:54.105444 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:54.107767 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:54.107767 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:54.107767 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:54.107767 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:54.107767 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:38:54.107767 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:38:54.107767 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:38:54.107767 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:38:54.107767 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:38:54.107767 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:38:54.107767 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Sep 10 11:38:54.107767 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 10 11:38:54.107767 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 11 already has host n-h2-856895-1. Sep 10 11:38:54.107767 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:54.107767 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:54.107767 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:54.107767 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:54.107767 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:54.107767 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:54.107767 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:38:54.107767 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:38:54.108944 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 already has host n-h2-856895-1. Sep 10 11:38:54.108944 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:54.108944 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c96a5bd7-eb39-4450-9d3c-64ac737283e8 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Returning 409 to user: Aggregate 11 already has host n-h2-856895-1. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:38:54.108944 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c96a5bd7-eb39-4450-9d3c-64ac737283e8 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 96 microversion: 2.1 time: 0.108994 Sep 10 11:38:54.108944 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 155/301] 10.222.0.23 () {60 vars in 1194 bytes} [Sat Sep 10 11:38:53 2022] POST /compute/v2.1/os-aggregates/11/action => generated 96 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Sep 10 11:38:54.117780 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3ae28839-4f98-43c9-96a0-570c6a672158 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-856895-1"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:54.147750 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3ae28839-4f98-43c9-96a0-570c6a672158 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:54.150400 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3ae28839-4f98-43c9-96a0-570c6a672158 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:54.150861 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3ae28839-4f98-43c9-96a0-570c6a672158 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:54.326439 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3ae28839-4f98-43c9-96a0-570c6a672158 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.215909 Sep 10 11:38:54.328263 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 156/302] 10.222.0.23 () {60 vars in 1194 bytes} [Sat Sep 10 11:38:54 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:54.340066 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1f7e9713-4d7a-4553-bc31-6ca74608ecff tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:54.385049 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1f7e9713-4d7a-4553-bc31-6ca74608ecff tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.048598 Sep 10 11:38:54.388282 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 157/303] 10.222.0.23 () {58 vars in 1155 bytes} [Sat Sep 10 11:38:54 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 11:38:54.400921 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-20a0a9fa-ad7b-45e6-be1b-9332affd7201 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-335698151"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:54.411779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.aggregate [None req-20a0a9fa-ad7b-45e6-be1b-9332affd7201 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Generated uuid ebad9a44-3c61-4863-98ec-3efb0b063890 for aggregate {{(pid=128777) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 11:38:54.437168 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-20a0a9fa-ad7b-45e6-be1b-9332affd7201 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.043688 Sep 10 11:38:54.438887 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 158/304] 10.222.0.23 () {60 vars in 1164 bytes} [Sat Sep 10 11:38:54 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:54.489689 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-d262bc4b-edeb-4536-ba31-351efd155894 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:38:54.490677 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-d262bc4b-edeb-4536-ba31-351efd155894 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:38:54.491387 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-d262bc4b-edeb-4536-ba31-351efd155894 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:38:54.492002 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-d262bc4b-edeb-4536-ba31-351efd155894 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:38:54.492576 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-d262bc4b-edeb-4536-ba31-351efd155894 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:38:54.526001 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d262bc4b-edeb-4536-ba31-351efd155894 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:54.528125 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d262bc4b-edeb-4536-ba31-351efd155894 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:54.533419 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d262bc4b-edeb-4536-ba31-351efd155894 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:54.534681 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d262bc4b-edeb-4536-ba31-351efd155894 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:54.535576 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d262bc4b-edeb-4536-ba31-351efd155894 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:54.536430 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d262bc4b-edeb-4536-ba31-351efd155894 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:54.578109 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-d262bc4b-edeb-4536-ba31-351efd155894 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Getting quotas for project b95726b0caac4b7fb5f0db90d268430b. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:38:54.598589 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-d262bc4b-edeb-4536-ba31-351efd155894 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Getting quotas for user 03c91799a8724c499cd1afe82e3fd657 and project b95726b0caac4b7fb5f0db90d268430b. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:38:54.639955 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d262bc4b-edeb-4536-ba31-351efd155894 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:38:54.644437 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d262bc4b-edeb-4536-ba31-351efd155894 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] [instance: 966031ed-9a06-4a3d-92f7-96adcfa7e364] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:38:54.759458 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d262bc4b-edeb-4536-ba31-351efd155894 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.926338 Sep 10 11:38:54.767740 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 147/305] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:38:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:38:54.774898 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7f5195ff-b23f-4ee9-8e52-01ba3b37d5f3 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:54.786862 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7f5195ff-b23f-4ee9-8e52-01ba3b37d5f3 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 810c2316-10c5-47b4-9118-0298629d94e1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:54.806022 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f5195ff-b23f-4ee9-8e52-01ba3b37d5f3 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:54.807763 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f5195ff-b23f-4ee9-8e52-01ba3b37d5f3 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:54.809471 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f5195ff-b23f-4ee9-8e52-01ba3b37d5f3 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:54.811098 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f5195ff-b23f-4ee9-8e52-01ba3b37d5f3 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:54.812486 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f5195ff-b23f-4ee9-8e52-01ba3b37d5f3 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:54.813927 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f5195ff-b23f-4ee9-8e52-01ba3b37d5f3 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:54.943646 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9cf23918-ed70-467a-b542-90d8603906a2 tempest-AggregatesAdminNegativeTestJSON-569853065 tempest-AggregatesAdminNegativeTestJSON-569853065-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-856895-1"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:54.950465 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9cf23918-ed70-467a-b542-90d8603906a2 tempest-AggregatesAdminNegativeTestJSON-569853065 tempest-AggregatesAdminNegativeTestJSON-569853065-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'c24cc606ac0b4cf1a9d591e60f5925b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df299053aef9403d8cba9cb22a5ee84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:54.951854 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9cf23918-ed70-467a-b542-90d8603906a2 tempest-AggregatesAdminNegativeTestJSON-569853065 tempest-AggregatesAdminNegativeTestJSON-569853065-project] Request method failure captured: Sep 10 11:38:54.951854 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Sep 10 11:38:54.951854 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:38:54.951854 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:38:54.951854 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:38:54.951854 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 39 Sep 10 11:38:54.951854 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:38:54.951854 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:38:54.951854 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:38:54.951854 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:38:54.951854 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHdKibWVtQNfpsfGlam6Hs_AhvVQCrvy-4eI4LEMjybGRHR94xwEkNXiP_QktAh6BXegkb0Z_rHoLltcfp2l0gV9h-Tk-fsFfG7J4otG5jNqW_wIpp8ZZyUTAfSura9e7mg70T6j_fSHNmrk8uMa8RDFgeISoHXELaOhd8k0vjCrMXA Sep 10 11:38:54.951854 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:38:54.951854 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:38:54.951854 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:38:54.951854 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:38:54.951854 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:38:54.951854 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:38:54.951854 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: df299053aef9403d8cba9cb22a5ee84f Sep 10 11:38:54.951854 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-569853065 Sep 10 11:38:54.951854 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:38:54.951854 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:38:54.953162 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/df299053aef9403d8cba9cb22a5ee84f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/df299053aef9403d8cba9cb22a5ee84f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_df299053aef9403d8cba9cb22a5ee84f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/df299053aef9403d8cba9cb22a5ee84f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:38:54.953162 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-569853065 Sep 10 11:38:54.953162 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: df299053aef9403d8cba9cb22a5ee84f Sep 10 11:38:54.953162 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-569853065 Sep 10 11:38:54.953162 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-AggregatesAdminNegativeTestJSON-569853065-project Sep 10 11:38:54.953162 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:38:54.953162 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:38:54.953162 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: c24cc606ac0b4cf1a9d591e60f5925b2 Sep 10 11:38:54.953162 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-569853065-project Sep 10 11:38:54.953162 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:38:54.953162 n-d-856895-1 devstack@n-api.service[128777]: {"add_host": {"host": "n-h2-856895-1"}} Sep 10 11:38:54.953162 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:38:54.953162 n-d-856895-1 devstack@n-api.service[128777]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 10 11:38:54.953947 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '12', 'body': {'add_host': {'host': 'n-h2-856895-1'}}} Sep 10 11:38:54.953947 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:38:54.953947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:54.953947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:54.953947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:54.953947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:38:54.953947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:38:54.953947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:38:54.953947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:38:54.953947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:38:54.953947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:38:54.953947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Sep 10 11:38:54.953947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Sep 10 11:38:54.953947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 11:38:54.953947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 11:38:54.953947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 11:38:54.953947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 11:38:54.953947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:38:54.953947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:38:54.955045 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:38:54.955045 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:38:54.955045 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 11:38:54.955045 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 11:38:54.955045 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 11:38:54.955045 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 11:38:54.955045 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 11:38:54.955045 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 11:38:54.955045 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 10 11:38:54.955045 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:54.955045 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:54.955045 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:54.955045 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:54.955045 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:54.955045 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:54.955045 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 11:38:54.955045 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 11:38:54.955045 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 10 11:38:54.955045 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:54.956180 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9cf23918-ed70-467a-b542-90d8603906a2 tempest-AggregatesAdminNegativeTestJSON-569853065 tempest-AggregatesAdminNegativeTestJSON-569853065-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:38:54.956551 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9cf23918-ed70-467a-b542-90d8603906a2 tempest-AggregatesAdminNegativeTestJSON-569853065 tempest-AggregatesAdminNegativeTestJSON-569853065-project] 10.222.0.23 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.508812 Sep 10 11:38:54.959339 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 159/306] 10.222.0.23 () {60 vars in 1194 bytes} [Sat Sep 10 11:38:54 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 511 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:38:54.971253 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-171e0de5-bf15-4078-8a92-9be8e865f81b tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:54.973803 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-171e0de5-bf15-4078-8a92-9be8e865f81b tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] [instance: 966031ed-9a06-4a3d-92f7-96adcfa7e364] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:55.149408 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-171e0de5-bf15-4078-8a92-9be8e865f81b tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c91799a8724c499cd1afe82e3fd657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95726b0caac4b7fb5f0db90d268430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:55.159098 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-171e0de5-bf15-4078-8a92-9be8e865f81b tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] 10.222.0.23 "GET /compute/v2.1/servers/966031ed-9a06-4a3d-92f7-96adcfa7e364" status: 200 len: 1221 microversion: 2.1 time: 0.196498 Sep 10 11:38:55.161782 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 160/307] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:54 2022] GET /compute/v2.1/servers/966031ed-9a06-4a3d-92f7-96adcfa7e364 => generated 1221 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:55.184075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e8055f89-3370-4e6e-bff8-d4fb90b153ed tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:55.216361 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e8055f89-3370-4e6e-bff8-d4fb90b153ed tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.037218 Sep 10 11:38:55.222773 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 161/308] 10.222.0.23 () {58 vars in 1155 bytes} [Sat Sep 10 11:38:55 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 11:38:55.232326 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-adade8fa-a15b-4fe9-8f1f-3279b6b49d6b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:55.233313 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-adade8fa-a15b-4fe9-8f1f-3279b6b49d6b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:55.254430 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-adade8fa-a15b-4fe9-8f1f-3279b6b49d6b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:55.256638 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-adade8fa-a15b-4fe9-8f1f-3279b6b49d6b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:55.257640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-adade8fa-a15b-4fe9-8f1f-3279b6b49d6b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:55.260837 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-adade8fa-a15b-4fe9-8f1f-3279b6b49d6b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:55.261377 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-adade8fa-a15b-4fe9-8f1f-3279b6b49d6b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:55.262636 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-adade8fa-a15b-4fe9-8f1f-3279b6b49d6b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:55.477052 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7f5195ff-b23f-4ee9-8e52-01ba3b37d5f3 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b632d0a5ac48fea0da5aa15632cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a040213a0ea443cd97b346b0d4e79d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:55.486703 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7f5195ff-b23f-4ee9-8e52-01ba3b37d5f3 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/810c2316-10c5-47b4-9118-0298629d94e1" status: 200 len: 1320 microversion: 2.1 time: 0.723705 Sep 10 11:38:55.493748 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 148/309] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:54 2022] GET /compute/v2.1/servers/810c2316-10c5-47b4-9118-0298629d94e1 => generated 1320 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:55.507582 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-699df5fc-f75c-4cff-948d-a6eec7dcbe70 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1633080748"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:55.526895 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.aggregate [None req-699df5fc-f75c-4cff-948d-a6eec7dcbe70 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Generated uuid 0fcafe02-ace3-418b-b76a-758960819480 for aggregate {{(pid=128776) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 11:38:55.590953 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-699df5fc-f75c-4cff-948d-a6eec7dcbe70 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.095338 Sep 10 11:38:55.595607 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 149/310] 10.222.0.23 () {60 vars in 1164 bytes} [Sat Sep 10 11:38:55 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:55.609146 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d0b72e0f-56b7-4954-bf54-0e5e842c2842 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-110024330"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:55.633954 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-adade8fa-a15b-4fe9-8f1f-3279b6b49d6b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:55.643179 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-adade8fa-a15b-4fe9-8f1f-3279b6b49d6b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f" status: 200 len: 1310 microversion: 2.1 time: 0.418426 Sep 10 11:38:55.646068 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 162/311] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:55 2022] GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f => generated 1310 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:55.666648 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d0b72e0f-56b7-4954-bf54-0e5e842c2842 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:55.668297 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d0b72e0f-56b7-4954-bf54-0e5e842c2842 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:55.671682 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d0b72e0f-56b7-4954-bf54-0e5e842c2842 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:55.686380 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d0b72e0f-56b7-4954-bf54-0e5e842c2842 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:55.687604 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d0b72e0f-56b7-4954-bf54-0e5e842c2842 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:55.689314 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d0b72e0f-56b7-4954-bf54-0e5e842c2842 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:55.714699 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-d0b72e0f-56b7-4954-bf54-0e5e842c2842 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-110024330 could not be found. Sep 10 11:38:55.717638 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d0b72e0f-56b7-4954-bf54-0e5e842c2842 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Request method failure captured: Sep 10 11:38:55.717638 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Sep 10 11:38:55.717638 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:38:55.717638 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:38:55.717638 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:38:55.717638 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 57 Sep 10 11:38:55.717638 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:38:55.717638 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:38:55.717638 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:38:55.717638 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:38:55.717638 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHdMmjmJlORb7Mn9h0LiG6VjGgHzN0KMleJ88MPwntD_3w_8FT4TQGi2Jkk9-1w-yGeOVtrvCBl0CkyNVVCw3ufgJZ3fmryUbNV3QNpo2jJzWbaR3wVY5BdQ-7FEmbTLdjQF9E5Zbbfk5chIheFwEKlGiwp-XfXu3oH47BQ00WZG7Vc Sep 10 11:38:55.717638 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:38:55.717638 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:38:55.717638 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:38:55.717638 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:38:55.717638 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:38:55.717638 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:38:55.717638 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: cee7249e943d467eaec957455ed8a715 Sep 10 11:38:55.717638 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1641762440 Sep 10 11:38:55.717638 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,admin,member Sep 10 11:38:55.717638 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,admin,member Sep 10 11:38:55.719359 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cee7249e943d467eaec957455ed8a715"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cee7249e943d467eaec957455ed8a715"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cee7249e943d467eaec957455ed8a715", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cee7249e943d467eaec957455ed8a715"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:38:55.719359 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1641762440 Sep 10 11:38:55.719359 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: cee7249e943d467eaec957455ed8a715 Sep 10 11:38:55.719359 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1641762440 Sep 10 11:38:55.719359 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin Sep 10 11:38:55.719359 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:38:55.719359 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:38:55.719359 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: e1f7dc2c9dd94b5ebba6126f7d0de5e9 Sep 10 11:38:55.719359 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin Sep 10 11:38:55.719359 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 11:38:55.719359 n-d-856895-1 devstack@n-api.service[128776]: {"add_host": {"host": "tempest-nonexist_host-110024330"}} Sep 10 11:38:55.719359 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:38:55.720166 n-d-856895-1 devstack@n-api.service[128776]: exception: Compute host tempest-nonexist_host-110024330 could not be found. Sep 10 11:38:55.720166 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-110024330'}}} Sep 10 11:38:55.720166 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:38:55.720166 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:55.720166 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 10 11:38:55.720166 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 10 11:38:55.720166 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 11:38:55.720166 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 11:38:55.720166 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 10 11:38:55.720166 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 10 11:38:55.720166 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 11:38:55.720166 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 11:38:55.720166 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 10 11:38:55.720166 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 10 11:38:55.720166 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-110024330' is not mapped to any cell Sep 10 11:38:55.720166 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:55.720166 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:55.720166 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:55.720166 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:55.720166 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 10 11:38:55.721545 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 10 11:38:55.721545 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 10 11:38:55.721545 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 10 11:38:55.721545 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 10 11:38:55.721545 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:55.721545 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:55.721545 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:55.721545 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:55.721545 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 10 11:38:55.721545 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 10 11:38:55.721545 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 11:38:55.721545 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 11:38:55.721545 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:38:55.721545 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:38:55.721545 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:38:55.721545 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:38:55.721545 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 11:38:55.721545 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 11:38:55.721545 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Sep 10 11:38:55.721545 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Sep 10 11:38:55.723363 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 10 11:38:55.723363 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 10 11:38:55.723363 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-110024330 could not be found. Sep 10 11:38:55.723363 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:55.723363 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:55.723363 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:55.723363 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:55.723363 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:55.723363 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:55.723363 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:38:55.723363 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:38:55.723363 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:38:55.723363 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:38:55.723363 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:38:55.723363 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:38:55.723363 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Sep 10 11:38:55.723363 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:38:55.723363 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-110024330 could not be found. Sep 10 11:38:55.723363 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:55.723363 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:55.723363 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:55.724490 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:55.724490 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:55.724490 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:55.724490 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:38:55.724490 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:38:55.724490 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-110024330 could not be found. Sep 10 11:38:55.724490 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:55.724490 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d0b72e0f-56b7-4954-bf54-0e5e842c2842 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-110024330 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:38:55.724490 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d0b72e0f-56b7-4954-bf54-0e5e842c2842 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 110 microversion: 2.1 time: 0.117398 Sep 10 11:38:55.724490 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 150/312] 10.222.0.23 () {60 vars in 1194 bytes} [Sat Sep 10 11:38:55 2022] POST /compute/v2.1/os-aggregates/13/action => generated 110 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:38:55.733812 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-04745e78-0cb1-4030-b687-be20d760ab5e tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:55.777197 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-04745e78-0cb1-4030-b687-be20d760ab5e tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.049731 Sep 10 11:38:55.777764 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 163/313] 10.222.0.23 () {58 vars in 1155 bytes} [Sat Sep 10 11:38:55 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 11:38:55.789515 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2e6c88b4-7290-4478-8688-d83580de3cbb tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:55.805124 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2e6c88b4-7290-4478-8688-d83580de3cbb tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Request method failure captured: Sep 10 11:38:55.805124 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 10 11:38:55.805124 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:38:55.805124 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:38:55.805124 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:38:55.805124 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 283 Sep 10 11:38:55.805124 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:38:55.805124 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:38:55.805124 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:38:55.805124 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:38:55.805124 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHdMmjmJlORb7Mn9h0LiG6VjGgHzN0KMleJ88MPwntD_3w_8FT4TQGi2Jkk9-1w-yGeOVtrvCBl0CkyNVVCw3ufgJZ3fmryUbNV3QNpo2jJzWbaR3wVY5BdQ-7FEmbTLdjQF9E5Zbbfk5chIheFwEKlGiwp-XfXu3oH47BQ00WZG7Vc Sep 10 11:38:55.805124 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:38:55.805124 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:38:55.805124 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:38:55.805124 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:38:55.805124 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:38:55.805124 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:38:55.805124 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: cee7249e943d467eaec957455ed8a715 Sep 10 11:38:55.805124 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1641762440 Sep 10 11:38:55.805124 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,admin,member Sep 10 11:38:55.805124 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,admin,member Sep 10 11:38:55.806873 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cee7249e943d467eaec957455ed8a715"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cee7249e943d467eaec957455ed8a715"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cee7249e943d467eaec957455ed8a715", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cee7249e943d467eaec957455ed8a715"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:38:55.806873 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1641762440 Sep 10 11:38:55.806873 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: cee7249e943d467eaec957455ed8a715 Sep 10 11:38:55.806873 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1641762440 Sep 10 11:38:55.806873 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin Sep 10 11:38:55.806873 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:38:55.806873 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:38:55.806873 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: e1f7dc2c9dd94b5ebba6126f7d0de5e9 Sep 10 11:38:55.806873 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin Sep 10 11:38:55.806873 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 11:38:55.807684 n-d-856895-1 devstack@n-api.service[128776]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 10 11:38:55.807684 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:38:55.807684 n-d-856895-1 devstack@n-api.service[128776]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 11:38:55.807684 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 10 11:38:55.807684 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:38:55.807684 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:55.807684 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 11:38:55.807684 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 11:38:55.807684 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 11:38:55.807684 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise error Sep 10 11:38:55.808434 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 11:38:55.808434 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:55.808434 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Sep 10 11:38:55.808434 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 10 11:38:55.808434 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:55.808434 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 10 11:38:55.808434 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 10 11:38:55.808434 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:55.808434 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:55.808434 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:55.808434 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:55.808434 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:55.808434 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:55.808434 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:38:55.808434 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:38:55.808434 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:38:55.808434 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:38:55.809611 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:38:55.809611 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:38:55.809611 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 11:38:55.809611 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 11:38:55.809611 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 11:38:55.809611 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 11:38:55.809611 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 11:38:55.809611 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 11:38:55.809611 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 11:38:55.809611 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:55.809611 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:55.809611 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:55.809611 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:55.809611 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:55.809611 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:55.810652 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 11:38:55.810652 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 11:38:55.810652 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 11:38:55.810652 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:55.810652 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2e6c88b4-7290-4478-8688-d83580de3cbb tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:38:55.811013 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2e6c88b4-7290-4478-8688-d83580de3cbb tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.023470 Sep 10 11:38:55.811013 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 151/314] 10.222.0.23 () {60 vars in 1165 bytes} [Sat Sep 10 11:38:55 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:38:55.818749 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c82149dc-8267-4bfe-81ee-375d5cdde9ec tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:55.823703 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c82149dc-8267-4bfe-81ee-375d5cdde9ec tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Request method failure captured: Sep 10 11:38:55.823703 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 10 11:38:55.823703 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:38:55.823703 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:38:55.823703 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:38:55.823703 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 27 Sep 10 11:38:55.823703 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:38:55.823703 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:38:55.823703 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:38:55.823703 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:38:55.823703 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHdMmjmJlORb7Mn9h0LiG6VjGgHzN0KMleJ88MPwntD_3w_8FT4TQGi2Jkk9-1w-yGeOVtrvCBl0CkyNVVCw3ufgJZ3fmryUbNV3QNpo2jJzWbaR3wVY5BdQ-7FEmbTLdjQF9E5Zbbfk5chIheFwEKlGiwp-XfXu3oH47BQ00WZG7Vc Sep 10 11:38:55.823703 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:38:55.823703 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:38:55.823703 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:38:55.823703 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:38:55.823703 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:38:55.823703 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:38:55.823703 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: cee7249e943d467eaec957455ed8a715 Sep 10 11:38:55.823703 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1641762440 Sep 10 11:38:55.823703 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,admin,member Sep 10 11:38:55.823703 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,admin,member Sep 10 11:38:55.825652 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cee7249e943d467eaec957455ed8a715"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cee7249e943d467eaec957455ed8a715"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cee7249e943d467eaec957455ed8a715", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cee7249e943d467eaec957455ed8a715"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:38:55.825652 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1641762440 Sep 10 11:38:55.825652 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: cee7249e943d467eaec957455ed8a715 Sep 10 11:38:55.825652 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1641762440 Sep 10 11:38:55.825652 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin Sep 10 11:38:55.825652 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:38:55.825652 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:38:55.825652 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: e1f7dc2c9dd94b5ebba6126f7d0de5e9 Sep 10 11:38:55.825652 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin Sep 10 11:38:55.825652 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:38:55.825652 n-d-856895-1 devstack@n-api.service[128777]: {"aggregate": {"name": ""}} Sep 10 11:38:55.825652 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:38:55.825652 n-d-856895-1 devstack@n-api.service[128777]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 10 11:38:55.826353 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'body': {'aggregate': {'name': ''}}} Sep 10 11:38:55.826353 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:38:55.826353 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:55.826353 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 11:38:55.826353 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 11:38:55.826353 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 11:38:55.826353 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise error Sep 10 11:38:55.826353 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 10 11:38:55.826353 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:55.826353 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Sep 10 11:38:55.826353 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 10 11:38:55.826353 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:55.826353 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 10 11:38:55.826353 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi '' Sep 10 11:38:55.826353 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:55.826353 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:55.826353 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:55.826353 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:55.826353 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:55.826353 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:55.826353 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:38:55.826353 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:38:55.826353 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:38:55.827615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:38:55.827615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:38:55.827615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:38:55.827615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 11:38:55.827615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 11:38:55.827615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 11:38:55.827615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 11:38:55.827615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 11:38:55.827615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 11:38:55.827615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 10 11:38:55.827615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:55.827615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:55.827615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:55.827615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:55.827615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:55.827615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:55.827615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 11:38:55.827615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 11:38:55.827615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 10 11:38:55.827615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:55.828658 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c82149dc-8267-4bfe-81ee-375d5cdde9ec tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:38:55.828658 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c82149dc-8267-4bfe-81ee-375d5cdde9ec tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.014207 Sep 10 11:38:55.835025 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 164/315] 10.222.0.23 () {60 vars in 1164 bytes} [Sat Sep 10 11:38:55 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:38:55.847738 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-31933763-3ed6-4de9-b9ab-c4416070aa69 tempest-AggregatesAdminNegativeTestJSON-569853065 tempest-AggregatesAdminNegativeTestJSON-569853065-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1578172244"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:55.851220 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-31933763-3ed6-4de9-b9ab-c4416070aa69 tempest-AggregatesAdminNegativeTestJSON-569853065 tempest-AggregatesAdminNegativeTestJSON-569853065-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'c24cc606ac0b4cf1a9d591e60f5925b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df299053aef9403d8cba9cb22a5ee84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:55.852960 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-31933763-3ed6-4de9-b9ab-c4416070aa69 tempest-AggregatesAdminNegativeTestJSON-569853065 tempest-AggregatesAdminNegativeTestJSON-569853065-project] Request method failure captured: Sep 10 11:38:55.852960 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 10 11:38:55.852960 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:38:55.852960 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:38:55.852960 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:38:55.852960 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 60 Sep 10 11:38:55.852960 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:38:55.852960 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:38:55.852960 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:38:55.852960 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:38:55.852960 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHdKibWVtQNfpsfGlam6Hs_AhvVQCrvy-4eI4LEMjybGRHR94xwEkNXiP_QktAh6BXegkb0Z_rHoLltcfp2l0gV9h-Tk-fsFfG7J4otG5jNqW_wIpp8ZZyUTAfSura9e7mg70T6j_fSHNmrk8uMa8RDFgeISoHXELaOhd8k0vjCrMXA Sep 10 11:38:55.852960 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:38:55.852960 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:38:55.852960 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:38:55.852960 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:38:55.852960 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:38:55.852960 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:38:55.852960 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: df299053aef9403d8cba9cb22a5ee84f Sep 10 11:38:55.852960 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-569853065 Sep 10 11:38:55.852960 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:38:55.852960 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:38:55.854355 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/df299053aef9403d8cba9cb22a5ee84f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/df299053aef9403d8cba9cb22a5ee84f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_df299053aef9403d8cba9cb22a5ee84f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/df299053aef9403d8cba9cb22a5ee84f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:38:55.854355 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-569853065 Sep 10 11:38:55.854355 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: df299053aef9403d8cba9cb22a5ee84f Sep 10 11:38:55.854355 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-569853065 Sep 10 11:38:55.854355 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-AggregatesAdminNegativeTestJSON-569853065-project Sep 10 11:38:55.854355 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:38:55.854355 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:38:55.854355 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: c24cc606ac0b4cf1a9d591e60f5925b2 Sep 10 11:38:55.854355 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-569853065-project Sep 10 11:38:55.854355 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 11:38:55.854355 n-d-856895-1 devstack@n-api.service[128776]: {"aggregate": {"name": "tempest-test_aggregate-1578172244"}} Sep 10 11:38:55.854355 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:38:55.854355 n-d-856895-1 devstack@n-api.service[128776]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 10 11:38:55.855277 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1578172244'}}} Sep 10 11:38:55.855277 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:38:55.855277 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:55.855277 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:55.855277 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:55.855277 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:38:55.855277 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:38:55.855277 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:38:55.855277 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:38:55.855277 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:38:55.855277 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:38:55.855277 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:38:55.855277 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:38:55.855277 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Sep 10 11:38:55.855277 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Sep 10 11:38:55.855277 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 11:38:55.855277 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 11:38:55.855277 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 11:38:55.855277 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 11:38:55.856825 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:38:55.856825 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:38:55.856825 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:38:55.856825 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:38:55.856825 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 11:38:55.856825 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 11:38:55.856825 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 11:38:55.856825 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 11:38:55.856825 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 11:38:55.856825 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 11:38:55.856825 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 10 11:38:55.856825 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:55.856825 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:55.856825 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:55.856825 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:55.856825 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:55.856825 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:55.856825 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 11:38:55.856825 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 11:38:55.856825 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 10 11:38:55.857927 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:55.857927 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-31933763-3ed6-4de9-b9ab-c4416070aa69 tempest-AggregatesAdminNegativeTestJSON-569853065 tempest-AggregatesAdminNegativeTestJSON-569853065-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:38:55.857927 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-31933763-3ed6-4de9-b9ab-c4416070aa69 tempest-AggregatesAdminNegativeTestJSON-569853065 tempest-AggregatesAdminNegativeTestJSON-569853065-project] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.012120 Sep 10 11:38:55.869451 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 152/316] 10.222.0.23 () {60 vars in 1164 bytes} [Sat Sep 10 11:38:55 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:38:55.875787 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-121f955f-9ac2-49ac-ad8f-d99d452806ea tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1037215136"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:55.879515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.aggregate [None req-121f955f-9ac2-49ac-ad8f-d99d452806ea tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Generated uuid 16ac5318-4e3e-4a2b-95a4-51c2960b95da for aggregate {{(pid=128777) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 11:38:55.920603 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-004094c1-d305-4462-a9bc-27b69255dbba req-f8c32f22-7a98-4066-afdc-93aedb1fcbfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "810c2316-10c5-47b4-9118-0298629d94e1", "tag": "c2e4229b-d7db-4aeb-8db4-3f5575cc527f"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:55.931257 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-121f955f-9ac2-49ac-ad8f-d99d452806ea tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.056987 Sep 10 11:38:55.933284 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 165/317] 10.222.0.23 () {60 vars in 1164 bytes} [Sat Sep 10 11:38:55 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:55.938729 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-004094c1-d305-4462-a9bc-27b69255dbba req-f8c32f22-7a98-4066-afdc-93aedb1fcbfd service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:55.938729 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-004094c1-d305-4462-a9bc-27b69255dbba req-f8c32f22-7a98-4066-afdc-93aedb1fcbfd service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:55.938729 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-004094c1-d305-4462-a9bc-27b69255dbba req-f8c32f22-7a98-4066-afdc-93aedb1fcbfd service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:55.944753 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1e5d5638-70c3-4513-86d1-08d99180e292 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1037215136"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:55.957602 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.aggregate [None req-1e5d5638-70c3-4513-86d1-08d99180e292 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Generated uuid c90c357d-dfd5-4342-b38a-bd9b786a7c55 for aggregate {{(pid=128777) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 11:38:55.967765 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-004094c1-d305-4462-a9bc-27b69255dbba req-f8c32f22-7a98-4066-afdc-93aedb1fcbfd service nova] Creating event network-changed:c2e4229b-d7db-4aeb-8db4-3f5575cc527f for instance 810c2316-10c5-47b4-9118-0298629d94e1 on n-h1-856895-1 Sep 10 11:38:55.974500 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-004094c1-d305-4462-a9bc-27b69255dbba req-f8c32f22-7a98-4066-afdc-93aedb1fcbfd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057206 Sep 10 11:38:55.975559 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 153/318] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:38:55.978376 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-1e5d5638-70c3-4513-86d1-08d99180e292 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1037215136 already exists. Sep 10 11:38:55.984135 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1e5d5638-70c3-4513-86d1-08d99180e292 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Request method failure captured: Sep 10 11:38:55.984135 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 10 11:38:55.984135 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:38:55.984135 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:38:55.984135 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:38:55.984135 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 60 Sep 10 11:38:55.984135 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:38:55.984135 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:38:55.984135 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:38:55.984135 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:38:55.984135 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHdMmjmJlORb7Mn9h0LiG6VjGgHzN0KMleJ88MPwntD_3w_8FT4TQGi2Jkk9-1w-yGeOVtrvCBl0CkyNVVCw3ufgJZ3fmryUbNV3QNpo2jJzWbaR3wVY5BdQ-7FEmbTLdjQF9E5Zbbfk5chIheFwEKlGiwp-XfXu3oH47BQ00WZG7Vc Sep 10 11:38:55.984135 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:38:55.984135 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:38:55.984135 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:38:55.984135 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:38:55.984135 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:38:55.984135 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:38:55.984135 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: cee7249e943d467eaec957455ed8a715 Sep 10 11:38:55.984135 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1641762440 Sep 10 11:38:55.984135 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,admin,member Sep 10 11:38:55.984135 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,admin,member Sep 10 11:38:55.985322 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cee7249e943d467eaec957455ed8a715"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cee7249e943d467eaec957455ed8a715"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cee7249e943d467eaec957455ed8a715", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cee7249e943d467eaec957455ed8a715"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:38:55.985322 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1641762440 Sep 10 11:38:55.985322 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: cee7249e943d467eaec957455ed8a715 Sep 10 11:38:55.985322 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1641762440 Sep 10 11:38:55.985322 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin Sep 10 11:38:55.985322 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:38:55.985322 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:38:55.985322 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: e1f7dc2c9dd94b5ebba6126f7d0de5e9 Sep 10 11:38:55.985322 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin Sep 10 11:38:55.985322 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:38:55.985322 n-d-856895-1 devstack@n-api.service[128777]: {"aggregate": {"name": "tempest-test_aggregate-1037215136"}} Sep 10 11:38:55.985322 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:38:55.985322 n-d-856895-1 devstack@n-api.service[128777]: exception: Aggregate tempest-test_aggregate-1037215136 already exists. Sep 10 11:38:55.986061 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1037215136'}}} Sep 10 11:38:55.986061 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:38:55.986061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:55.986061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Sep 10 11:38:55.986061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Sep 10 11:38:55.986061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 11:38:55.986061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 11:38:55.986061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:38:55.986061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:38:55.986061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:38:55.986061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:38:55.986061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 11:38:55.986061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 11:38:55.986061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Sep 10 11:38:55.986061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi aggregate.create() Sep 10 11:38:55.986061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 10 11:38:55.986061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 10 11:38:55.986061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Sep 10 11:38:55.986061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Sep 10 11:38:55.987206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 11:38:55.987206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 11:38:55.987206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Sep 10 11:38:55.987206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Sep 10 11:38:55.987206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1037215136 already exists. Sep 10 11:38:55.987206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:55.987206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:55.987206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:55.987206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:55.987206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:55.987206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:55.987206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:38:55.987206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:38:55.987206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:38:55.987206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:38:55.987206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:38:55.987206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:38:55.987206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:38:55.987206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:38:55.987206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Sep 10 11:38:55.988552 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 10 11:38:55.988552 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1037215136 already exists. Sep 10 11:38:55.988552 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:55.988552 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:55.988552 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:55.988552 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:55.988552 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:55.988552 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:55.988552 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:38:55.988552 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:38:55.988552 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1037215136 already exists. Sep 10 11:38:55.988552 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:55.988552 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1e5d5638-70c3-4513-86d1-08d99180e292 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1037215136 already exists. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:38:55.988552 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1e5d5638-70c3-4513-86d1-08d99180e292 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.044735 Sep 10 11:38:55.990364 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 166/319] 10.222.0.23 () {60 vars in 1164 bytes} [Sat Sep 10 11:38:55 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 10 11:38:56.003905 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b4085f81-65f3-495c-94a5-a5268229ec59 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:56.063698 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b4085f81-65f3-495c-94a5-a5268229ec59 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.069872 Sep 10 11:38:56.066343 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 154/320] 10.222.0.23 () {58 vars in 1155 bytes} [Sat Sep 10 11:38:55 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 11:38:56.077292 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-02792de6-920b-47e9-8214-e9e2f68422a5 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1019248908"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:56.080691 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.aggregate [None req-02792de6-920b-47e9-8214-e9e2f68422a5 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Generated uuid 2f660f72-3a42-43e7-870b-d8a6ac2cd445 for aggregate {{(pid=128777) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 11:38:56.110936 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-02792de6-920b-47e9-8214-e9e2f68422a5 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.038255 Sep 10 11:38:56.115034 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 167/321] 10.222.0.23 () {60 vars in 1164 bytes} [Sat Sep 10 11:38:56 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:56.136153 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6e6fbe2f-c5bc-4559-9845-c9fc75cb5f6f tempest-AggregatesAdminNegativeTestJSON-569853065 tempest-AggregatesAdminNegativeTestJSON-569853065-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:56.137794 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6e6fbe2f-c5bc-4559-9845-c9fc75cb5f6f tempest-AggregatesAdminNegativeTestJSON-569853065 tempest-AggregatesAdminNegativeTestJSON-569853065-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'c24cc606ac0b4cf1a9d591e60f5925b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df299053aef9403d8cba9cb22a5ee84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:56.140164 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6e6fbe2f-c5bc-4559-9845-c9fc75cb5f6f tempest-AggregatesAdminNegativeTestJSON-569853065 tempest-AggregatesAdminNegativeTestJSON-569853065-project] Request method failure captured: Sep 10 11:38:56.140164 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Sep 10 11:38:56.140164 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:38:56.140164 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:38:56.140164 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:38:56.140164 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:38:56.140164 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:38:56.140164 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:38:56.140164 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:38:56.140164 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:38:56.140164 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHdKibWVtQNfpsfGlam6Hs_AhvVQCrvy-4eI4LEMjybGRHR94xwEkNXiP_QktAh6BXegkb0Z_rHoLltcfp2l0gV9h-Tk-fsFfG7J4otG5jNqW_wIpp8ZZyUTAfSura9e7mg70T6j_fSHNmrk8uMa8RDFgeISoHXELaOhd8k0vjCrMXA Sep 10 11:38:56.140164 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:38:56.140164 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:38:56.140164 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:38:56.140164 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:38:56.140164 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:38:56.140164 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:38:56.140164 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: df299053aef9403d8cba9cb22a5ee84f Sep 10 11:38:56.140164 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-569853065 Sep 10 11:38:56.140164 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:38:56.140164 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:38:56.141600 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/df299053aef9403d8cba9cb22a5ee84f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/df299053aef9403d8cba9cb22a5ee84f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_df299053aef9403d8cba9cb22a5ee84f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/df299053aef9403d8cba9cb22a5ee84f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:38:56.141600 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-569853065 Sep 10 11:38:56.141600 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: df299053aef9403d8cba9cb22a5ee84f Sep 10 11:38:56.141600 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-569853065 Sep 10 11:38:56.141600 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-AggregatesAdminNegativeTestJSON-569853065-project Sep 10 11:38:56.141600 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:38:56.141600 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:38:56.141600 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: c24cc606ac0b4cf1a9d591e60f5925b2 Sep 10 11:38:56.141600 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-569853065-project Sep 10 11:38:56.141600 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:38:56.141600 n-d-856895-1 devstack@n-api.service[128776]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 10 11:38:56.141600 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '15'} Sep 10 11:38:56.142308 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:38:56.142308 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:56.142308 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:56.142308 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:56.142308 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:38:56.142308 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:38:56.142308 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:38:56.142308 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:38:56.142308 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Sep 10 11:38:56.142308 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Sep 10 11:38:56.142308 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 11:38:56.142308 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 11:38:56.142308 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 11:38:56.142308 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 11:38:56.142308 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:38:56.142308 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:38:56.142308 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:38:56.142308 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:38:56.142308 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 11:38:56.144197 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 11:38:56.144197 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 11:38:56.144197 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 11:38:56.144197 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 11:38:56.144197 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 11:38:56.144197 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 10 11:38:56.144197 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:56.144197 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:56.144197 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:56.144197 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:56.144197 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:56.144197 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:56.144197 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 11:38:56.144197 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 11:38:56.144197 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 10 11:38:56.144197 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:56.145338 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6e6fbe2f-c5bc-4559-9845-c9fc75cb5f6f tempest-AggregatesAdminNegativeTestJSON-569853065 tempest-AggregatesAdminNegativeTestJSON-569853065-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:38:56.150502 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6e6fbe2f-c5bc-4559-9845-c9fc75cb5f6f tempest-AggregatesAdminNegativeTestJSON-569853065 tempest-AggregatesAdminNegativeTestJSON-569853065-project] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.013599 Sep 10 11:38:56.151480 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 155/322] 10.222.0.23 () {58 vars in 1155 bytes} [Sat Sep 10 11:38:56 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:38:56.158967 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a0d3ecb3-be6f-4618-ac87-4dba0c27a459 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:56.187408 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fc6ef8b8-e754-4067-8ab0-9957c1206f8c tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:56.187965 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a0d3ecb3-be6f-4618-ac87-4dba0c27a459 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.032403 Sep 10 11:38:56.189046 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fc6ef8b8-e754-4067-8ab0-9957c1206f8c tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] [instance: 966031ed-9a06-4a3d-92f7-96adcfa7e364] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:56.189557 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 168/323] 10.222.0.23 () {58 vars in 1155 bytes} [Sat Sep 10 11:38:56 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 11:38:56.198543 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc6ef8b8-e754-4067-8ab0-9957c1206f8c tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:56.199037 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc6ef8b8-e754-4067-8ab0-9957c1206f8c tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:56.199509 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc6ef8b8-e754-4067-8ab0-9957c1206f8c tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:56.200243 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc6ef8b8-e754-4067-8ab0-9957c1206f8c tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:56.200702 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc6ef8b8-e754-4067-8ab0-9957c1206f8c tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:56.201132 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc6ef8b8-e754-4067-8ab0-9957c1206f8c tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:56.204736 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-28cc3338-846f-4713-9874-2af8b93d36e1 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:56.222572 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-28cc3338-846f-4713-9874-2af8b93d36e1 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 10 11:38:56.224977 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-28cc3338-846f-4713-9874-2af8b93d36e1 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Request method failure captured: Sep 10 11:38:56.224977 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 10 11:38:56.224977 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:38:56.224977 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:38:56.224977 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:38:56.224977 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:38:56.224977 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:38:56.224977 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:38:56.224977 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:38:56.224977 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:38:56.224977 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHdMmjmJlORb7Mn9h0LiG6VjGgHzN0KMleJ88MPwntD_3w_8FT4TQGi2Jkk9-1w-yGeOVtrvCBl0CkyNVVCw3ufgJZ3fmryUbNV3QNpo2jJzWbaR3wVY5BdQ-7FEmbTLdjQF9E5Zbbfk5chIheFwEKlGiwp-XfXu3oH47BQ00WZG7Vc Sep 10 11:38:56.224977 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:38:56.224977 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:38:56.224977 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:38:56.224977 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:38:56.224977 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:38:56.224977 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:38:56.224977 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: cee7249e943d467eaec957455ed8a715 Sep 10 11:38:56.224977 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1641762440 Sep 10 11:38:56.224977 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,admin,member Sep 10 11:38:56.224977 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,admin,member Sep 10 11:38:56.226300 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cee7249e943d467eaec957455ed8a715"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cee7249e943d467eaec957455ed8a715"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cee7249e943d467eaec957455ed8a715", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cee7249e943d467eaec957455ed8a715"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:38:56.226300 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1641762440 Sep 10 11:38:56.226300 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: cee7249e943d467eaec957455ed8a715 Sep 10 11:38:56.226300 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1641762440 Sep 10 11:38:56.226300 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin Sep 10 11:38:56.226300 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:38:56.226300 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:38:56.226300 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: e1f7dc2c9dd94b5ebba6126f7d0de5e9 Sep 10 11:38:56.226300 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin Sep 10 11:38:56.226300 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:38:56.226300 n-d-856895-1 devstack@n-api.service[128777]: exception: Aggregate -1 could not be found. Sep 10 11:38:56.226300 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '-1'} Sep 10 11:38:56.226949 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:38:56.226949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:56.226949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 10 11:38:56.226949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 10 11:38:56.226949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 11:38:56.226949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 11:38:56.226949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:38:56.226949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:38:56.226949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:38:56.226949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:38:56.226949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 11:38:56.226949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 11:38:56.226949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 10 11:38:56.226949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 10 11:38:56.226949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 11:38:56.226949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 11:38:56.226949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 10 11:38:56.226949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 10 11:38:56.226949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 11:38:56.232636 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 11:38:56.232636 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 10 11:38:56.232636 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 10 11:38:56.232636 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 10 11:38:56.232636 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:56.232636 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:56.232636 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:56.232636 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:56.232636 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:56.232636 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:56.232636 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:38:56.232636 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:38:56.232636 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:38:56.232636 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:38:56.232636 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 10 11:38:56.232636 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:38:56.232636 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 10 11:38:56.232636 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:56.232636 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:56.232636 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:56.232636 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:56.234156 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:56.234156 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:56.234156 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:38:56.234156 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:38:56.234156 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 10 11:38:56.234156 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:56.234156 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-28cc3338-846f-4713-9874-2af8b93d36e1 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:38:56.234156 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-28cc3338-846f-4713-9874-2af8b93d36e1 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.029522 Sep 10 11:38:56.234156 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 169/324] 10.222.0.23 () {58 vars in 1155 bytes} [Sat Sep 10 11:38:56 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 10 11:38:56.238837 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1f5882a4-5283-443f-9900-f36902df68a8 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1190347416"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:56.243047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.aggregate [None req-1f5882a4-5283-443f-9900-f36902df68a8 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Generated uuid 1bdbae0f-da94-4227-aed0-ce2edb8be0da for aggregate {{(pid=128777) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 11:38:56.272212 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1f5882a4-5283-443f-9900-f36902df68a8 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.038529 Sep 10 11:38:56.273883 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 170/325] 10.222.0.23 () {60 vars in 1164 bytes} [Sat Sep 10 11:38:56 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:38:56.288909 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-70b83879-cd79-4787-adfe-d36fcc3eebb6 tempest-AggregatesAdminNegativeTestJSON-569853065 tempest-AggregatesAdminNegativeTestJSON-569853065-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:56.296263 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-70b83879-cd79-4787-adfe-d36fcc3eebb6 tempest-AggregatesAdminNegativeTestJSON-569853065 tempest-AggregatesAdminNegativeTestJSON-569853065-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'c24cc606ac0b4cf1a9d591e60f5925b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df299053aef9403d8cba9cb22a5ee84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:56.298664 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-70b83879-cd79-4787-adfe-d36fcc3eebb6 tempest-AggregatesAdminNegativeTestJSON-569853065 tempest-AggregatesAdminNegativeTestJSON-569853065-project] Request method failure captured: Sep 10 11:38:56.298664 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Sep 10 11:38:56.298664 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:38:56.298664 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:38:56.298664 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:38:56.298664 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:38:56.298664 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:38:56.298664 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:38:56.298664 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:38:56.298664 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:38:56.298664 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHdKibWVtQNfpsfGlam6Hs_AhvVQCrvy-4eI4LEMjybGRHR94xwEkNXiP_QktAh6BXegkb0Z_rHoLltcfp2l0gV9h-Tk-fsFfG7J4otG5jNqW_wIpp8ZZyUTAfSura9e7mg70T6j_fSHNmrk8uMa8RDFgeISoHXELaOhd8k0vjCrMXA Sep 10 11:38:56.298664 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:38:56.298664 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:38:56.298664 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:38:56.298664 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:38:56.298664 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:38:56.298664 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:38:56.298664 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: df299053aef9403d8cba9cb22a5ee84f Sep 10 11:38:56.298664 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-569853065 Sep 10 11:38:56.298664 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:38:56.298664 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:38:56.300679 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/df299053aef9403d8cba9cb22a5ee84f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/df299053aef9403d8cba9cb22a5ee84f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_df299053aef9403d8cba9cb22a5ee84f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/df299053aef9403d8cba9cb22a5ee84f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:38:56.300679 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-569853065 Sep 10 11:38:56.300679 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: df299053aef9403d8cba9cb22a5ee84f Sep 10 11:38:56.300679 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-569853065 Sep 10 11:38:56.300679 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-AggregatesAdminNegativeTestJSON-569853065-project Sep 10 11:38:56.300679 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:38:56.300679 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:38:56.300679 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: c24cc606ac0b4cf1a9d591e60f5925b2 Sep 10 11:38:56.300679 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-569853065-project Sep 10 11:38:56.300679 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:38:56.300679 n-d-856895-1 devstack@n-api.service[128777]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 10 11:38:56.300679 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '16'} Sep 10 11:38:56.301583 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:38:56.301583 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:56.301583 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:56.301583 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:56.301583 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:38:56.301583 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:38:56.301583 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:38:56.301583 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:38:56.301583 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Sep 10 11:38:56.301583 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Sep 10 11:38:56.301583 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 11:38:56.301583 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 11:38:56.301583 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 11:38:56.301583 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 11:38:56.301583 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:38:56.301583 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:38:56.301583 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:38:56.301583 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:38:56.301583 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 11:38:56.302580 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 11:38:56.302580 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 11:38:56.302580 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 11:38:56.302580 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 11:38:56.302580 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 11:38:56.302580 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 10 11:38:56.302580 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:56.302580 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:56.302580 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:56.302580 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:56.302580 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:56.302580 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:56.302580 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 11:38:56.302580 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 11:38:56.302580 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 10 11:38:56.302580 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:56.305103 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-70b83879-cd79-4787-adfe-d36fcc3eebb6 tempest-AggregatesAdminNegativeTestJSON-569853065 tempest-AggregatesAdminNegativeTestJSON-569853065-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:38:56.308535 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-70b83879-cd79-4787-adfe-d36fcc3eebb6 tempest-AggregatesAdminNegativeTestJSON-569853065 tempest-AggregatesAdminNegativeTestJSON-569853065-project] 10.222.0.23 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.026269 Sep 10 11:38:56.309647 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 171/326] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Sep 10 11:38:56 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:38:56.336581 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fc6ef8b8-e754-4067-8ab0-9957c1206f8c tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c91799a8724c499cd1afe82e3fd657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95726b0caac4b7fb5f0db90d268430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:56.339299 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d08bcf62-c17e-47ec-a456-16373a265b6f tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:56.348429 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fc6ef8b8-e754-4067-8ab0-9957c1206f8c tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] 10.222.0.23 "GET /compute/v2.1/servers/966031ed-9a06-4a3d-92f7-96adcfa7e364" status: 200 len: 1273 microversion: 2.1 time: 0.164940 Sep 10 11:38:56.349193 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 156/327] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:56 2022] GET /compute/v2.1/servers/966031ed-9a06-4a3d-92f7-96adcfa7e364 => generated 1273 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:38:56.380205 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d08bcf62-c17e-47ec-a456-16373a265b6f tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.065329 Sep 10 11:38:56.381845 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 172/328] 10.222.0.23 () {58 vars in 1155 bytes} [Sat Sep 10 11:38:56 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 11:38:56.391221 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f15dac02-6ca3-438f-8d78-2ddefe168eec tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:56.399079 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-f15dac02-6ca3-438f-8d78-2ddefe168eec tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 10 11:38:56.400883 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f15dac02-6ca3-438f-8d78-2ddefe168eec tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Request method failure captured: Sep 10 11:38:56.400883 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 10 11:38:56.400883 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:38:56.400883 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:38:56.400883 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:38:56.400883 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:38:56.400883 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:38:56.400883 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:38:56.400883 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:38:56.400883 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:38:56.400883 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHdMmjmJlORb7Mn9h0LiG6VjGgHzN0KMleJ88MPwntD_3w_8FT4TQGi2Jkk9-1w-yGeOVtrvCBl0CkyNVVCw3ufgJZ3fmryUbNV3QNpo2jJzWbaR3wVY5BdQ-7FEmbTLdjQF9E5Zbbfk5chIheFwEKlGiwp-XfXu3oH47BQ00WZG7Vc Sep 10 11:38:56.400883 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:38:56.400883 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:38:56.400883 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:38:56.400883 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:38:56.400883 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:38:56.400883 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:38:56.400883 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: cee7249e943d467eaec957455ed8a715 Sep 10 11:38:56.400883 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1641762440 Sep 10 11:38:56.400883 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,admin,member Sep 10 11:38:56.400883 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,admin,member Sep 10 11:38:56.402214 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cee7249e943d467eaec957455ed8a715"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cee7249e943d467eaec957455ed8a715"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cee7249e943d467eaec957455ed8a715", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cee7249e943d467eaec957455ed8a715"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:38:56.402214 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1641762440 Sep 10 11:38:56.402214 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: cee7249e943d467eaec957455ed8a715 Sep 10 11:38:56.402214 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1641762440 Sep 10 11:38:56.402214 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin Sep 10 11:38:56.402214 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:38:56.402214 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:38:56.402214 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: e1f7dc2c9dd94b5ebba6126f7d0de5e9 Sep 10 11:38:56.402214 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin Sep 10 11:38:56.402214 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:38:56.402214 n-d-856895-1 devstack@n-api.service[128776]: exception: Aggregate -1 could not be found. Sep 10 11:38:56.402214 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '-1'} Sep 10 11:38:56.402951 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:38:56.402951 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:56.402951 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 10 11:38:56.402951 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 10 11:38:56.402951 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 10 11:38:56.402951 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 10 11:38:56.402951 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 11:38:56.402951 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 11:38:56.402951 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 10 11:38:56.402951 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 10 11:38:56.402951 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 11:38:56.402951 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 11:38:56.402951 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 10 11:38:56.402951 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 10 11:38:56.402951 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 10 11:38:56.402951 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:56.402951 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:56.402951 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:56.402951 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:56.402951 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:56.404069 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:56.404069 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:38:56.404069 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:38:56.404069 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:38:56.404069 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:38:56.404069 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 10 11:38:56.404069 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:38:56.404069 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 10 11:38:56.404069 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:56.404069 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:56.404069 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:56.404069 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:56.404069 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:56.404069 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:56.404069 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:38:56.404069 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:38:56.404069 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 10 11:38:56.404069 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:56.405059 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f15dac02-6ca3-438f-8d78-2ddefe168eec tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:38:56.405059 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f15dac02-6ca3-438f-8d78-2ddefe168eec tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.015688 Sep 10 11:38:56.405059 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 157/329] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Sep 10 11:38:56 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:38:56.413806 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-db66deda-480b-4b38-9a54-4bcbe4e9bc5f tempest-AggregatesAdminNegativeTestJSON-569853065 tempest-AggregatesAdminNegativeTestJSON-569853065-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:56.415357 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-db66deda-480b-4b38-9a54-4bcbe4e9bc5f tempest-AggregatesAdminNegativeTestJSON-569853065 tempest-AggregatesAdminNegativeTestJSON-569853065-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'c24cc606ac0b4cf1a9d591e60f5925b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df299053aef9403d8cba9cb22a5ee84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:56.416961 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-db66deda-480b-4b38-9a54-4bcbe4e9bc5f tempest-AggregatesAdminNegativeTestJSON-569853065 tempest-AggregatesAdminNegativeTestJSON-569853065-project] Request method failure captured: Sep 10 11:38:56.416961 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Sep 10 11:38:56.416961 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:38:56.416961 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:38:56.416961 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:38:56.416961 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:38:56.416961 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:38:56.416961 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:38:56.416961 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:38:56.416961 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:38:56.416961 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHdKibWVtQNfpsfGlam6Hs_AhvVQCrvy-4eI4LEMjybGRHR94xwEkNXiP_QktAh6BXegkb0Z_rHoLltcfp2l0gV9h-Tk-fsFfG7J4otG5jNqW_wIpp8ZZyUTAfSura9e7mg70T6j_fSHNmrk8uMa8RDFgeISoHXELaOhd8k0vjCrMXA Sep 10 11:38:56.416961 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:38:56.416961 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:38:56.416961 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:38:56.416961 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:38:56.416961 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:38:56.416961 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:38:56.416961 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: df299053aef9403d8cba9cb22a5ee84f Sep 10 11:38:56.416961 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-569853065 Sep 10 11:38:56.416961 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:38:56.416961 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:38:56.418171 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/df299053aef9403d8cba9cb22a5ee84f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/df299053aef9403d8cba9cb22a5ee84f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_df299053aef9403d8cba9cb22a5ee84f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/df299053aef9403d8cba9cb22a5ee84f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:38:56.418171 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-569853065 Sep 10 11:38:56.418171 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: df299053aef9403d8cba9cb22a5ee84f Sep 10 11:38:56.418171 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-569853065 Sep 10 11:38:56.418171 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-AggregatesAdminNegativeTestJSON-569853065-project Sep 10 11:38:56.418171 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:38:56.418171 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:38:56.418171 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: c24cc606ac0b4cf1a9d591e60f5925b2 Sep 10 11:38:56.418171 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-569853065-project Sep 10 11:38:56.418171 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:38:56.418171 n-d-856895-1 devstack@n-api.service[128777]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 10 11:38:56.418171 n-d-856895-1 devstack@n-api.service[128777]: action_args: {} Sep 10 11:38:56.419432 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:38:56.419432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:56.419432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:56.419432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:56.419432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:38:56.419432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:38:56.419432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:38:56.419432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:38:56.419432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Sep 10 11:38:56.419432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Sep 10 11:38:56.419432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 11:38:56.419432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 11:38:56.419432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 11:38:56.419432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 11:38:56.419432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:38:56.419432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:38:56.419432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:38:56.419432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:38:56.419432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 11:38:56.420441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 11:38:56.420441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 11:38:56.420441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 11:38:56.420441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 11:38:56.420441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 11:38:56.420441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 10 11:38:56.420441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:56.420441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:56.420441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:56.420441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:56.420441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:56.420441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:56.420441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 11:38:56.420441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 11:38:56.420441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 10 11:38:56.420441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:38:56.422588 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-db66deda-480b-4b38-9a54-4bcbe4e9bc5f tempest-AggregatesAdminNegativeTestJSON-569853065 tempest-AggregatesAdminNegativeTestJSON-569853065-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:38:56.423463 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-db66deda-480b-4b38-9a54-4bcbe4e9bc5f tempest-AggregatesAdminNegativeTestJSON-569853065 tempest-AggregatesAdminNegativeTestJSON-569853065-project] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.014436 Sep 10 11:38:56.424284 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 173/330] 10.222.0.23 () {58 vars in 1143 bytes} [Sat Sep 10 11:38:56 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:38:56.437341 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3b91ab7c-edb0-48dd-918e-7d346d507f1e tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-755822751"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:56.442132 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.aggregate [None req-3b91ab7c-edb0-48dd-918e-7d346d507f1e tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Generated uuid f070aab1-41af-4aa9-b3e9-19b5924cedda for aggregate {{(pid=128776) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 11:38:56.470118 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3b91ab7c-edb0-48dd-918e-7d346d507f1e tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.036183 Sep 10 11:38:56.471924 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 158/331] 10.222.0.23 () {60 vars in 1164 bytes} [Sat Sep 10 11:38:56 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:56.484360 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-952b3a40-700e-4336-8532-0c65c41f988f tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-856895-1"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:56.498792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-952b3a40-700e-4336-8532-0c65c41f988f tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:56.499786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-952b3a40-700e-4336-8532-0c65c41f988f tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:56.500862 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-952b3a40-700e-4336-8532-0c65c41f988f tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:56.519352 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1f5fa1c9-c915-4a1d-93b9-ff14074ee81c tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:56.521704 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1f5fa1c9-c915-4a1d-93b9-ff14074ee81c tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 810c2316-10c5-47b4-9118-0298629d94e1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:56.536433 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f5fa1c9-c915-4a1d-93b9-ff14074ee81c tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:56.537267 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f5fa1c9-c915-4a1d-93b9-ff14074ee81c tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:56.538438 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f5fa1c9-c915-4a1d-93b9-ff14074ee81c tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:56.541201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f5fa1c9-c915-4a1d-93b9-ff14074ee81c tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:56.541987 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f5fa1c9-c915-4a1d-93b9-ff14074ee81c tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:56.542857 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f5fa1c9-c915-4a1d-93b9-ff14074ee81c tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:56.736906 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-952b3a40-700e-4336-8532-0c65c41f988f tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 242 microversion: 2.1 time: 0.254938 Sep 10 11:38:56.738123 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 174/332] 10.222.0.23 () {60 vars in 1194 bytes} [Sat Sep 10 11:38:56 2022] POST /compute/v2.1/os-aggregates/17/action => generated 242 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:56.753153 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1f5fa1c9-c915-4a1d-93b9-ff14074ee81c tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b632d0a5ac48fea0da5aa15632cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a040213a0ea443cd97b346b0d4e79d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:56.765739 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1f5fa1c9-c915-4a1d-93b9-ff14074ee81c tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/810c2316-10c5-47b4-9118-0298629d94e1" status: 200 len: 1320 microversion: 2.1 time: 0.251460 Sep 10 11:38:56.779855 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 159/333] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:56 2022] GET /compute/v2.1/servers/810c2316-10c5-47b4-9118-0298629d94e1 => generated 1320 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:56.787918 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d42aeb88-1411-4be1-80c5-d6cb7ab357aa tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:56.787918 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d42aeb88-1411-4be1-80c5-d6cb7ab357aa tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:56.799371 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d42aeb88-1411-4be1-80c5-d6cb7ab357aa tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:56.804038 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d42aeb88-1411-4be1-80c5-d6cb7ab357aa tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:56.804681 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d42aeb88-1411-4be1-80c5-d6cb7ab357aa tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:56.805405 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d42aeb88-1411-4be1-80c5-d6cb7ab357aa tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:56.805876 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d42aeb88-1411-4be1-80c5-d6cb7ab357aa tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:56.806302 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d42aeb88-1411-4be1-80c5-d6cb7ab357aa tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:57.040352 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d42aeb88-1411-4be1-80c5-d6cb7ab357aa tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:57.050723 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d42aeb88-1411-4be1-80c5-d6cb7ab357aa tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f" status: 200 len: 1310 microversion: 2.1 time: 0.275548 Sep 10 11:38:57.053877 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 160/334] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:56 2022] GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f => generated 1310 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:57.070651 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-493aaacb-8ad1-46ef-884a-d1df74eca551 tempest-AggregatesAdminNegativeTestJSON-569853065 tempest-AggregatesAdminNegativeTestJSON-569853065-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-856895-1"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:57.074698 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-493aaacb-8ad1-46ef-884a-d1df74eca551 tempest-AggregatesAdminNegativeTestJSON-569853065 tempest-AggregatesAdminNegativeTestJSON-569853065-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'c24cc606ac0b4cf1a9d591e60f5925b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df299053aef9403d8cba9cb22a5ee84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:57.077351 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-493aaacb-8ad1-46ef-884a-d1df74eca551 tempest-AggregatesAdminNegativeTestJSON-569853065 tempest-AggregatesAdminNegativeTestJSON-569853065-project] Request method failure captured: Sep 10 11:38:57.077351 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Sep 10 11:38:57.077351 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:38:57.077351 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:38:57.077351 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:38:57.077351 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 42 Sep 10 11:38:57.077351 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:38:57.077351 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:38:57.077351 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:38:57.077351 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:38:57.077351 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHdKibWVtQNfpsfGlam6Hs_AhvVQCrvy-4eI4LEMjybGRHR94xwEkNXiP_QktAh6BXegkb0Z_rHoLltcfp2l0gV9h-Tk-fsFfG7J4otG5jNqW_wIpp8ZZyUTAfSura9e7mg70T6j_fSHNmrk8uMa8RDFgeISoHXELaOhd8k0vjCrMXA Sep 10 11:38:57.077351 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:38:57.077351 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:38:57.077351 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:38:57.077351 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:38:57.077351 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:38:57.077351 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:38:57.077351 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: df299053aef9403d8cba9cb22a5ee84f Sep 10 11:38:57.077351 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-569853065 Sep 10 11:38:57.077351 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:38:57.077351 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:38:57.078764 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/df299053aef9403d8cba9cb22a5ee84f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/df299053aef9403d8cba9cb22a5ee84f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_df299053aef9403d8cba9cb22a5ee84f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/df299053aef9403d8cba9cb22a5ee84f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:38:57.078764 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-569853065 Sep 10 11:38:57.078764 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: df299053aef9403d8cba9cb22a5ee84f Sep 10 11:38:57.078764 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-569853065 Sep 10 11:38:57.078764 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-AggregatesAdminNegativeTestJSON-569853065-project Sep 10 11:38:57.078764 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:38:57.078764 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:38:57.078764 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: c24cc606ac0b4cf1a9d591e60f5925b2 Sep 10 11:38:57.078764 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-569853065-project Sep 10 11:38:57.078764 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 11:38:57.078764 n-d-856895-1 devstack@n-api.service[128776]: {"remove_host": {"host": "n-h2-856895-1"}} Sep 10 11:38:57.078764 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:38:57.078764 n-d-856895-1 devstack@n-api.service[128776]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 10 11:38:57.079751 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h2-856895-1'}}} Sep 10 11:38:57.079751 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:38:57.079751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:57.079751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:57.079751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:57.079751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:38:57.079751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:38:57.079751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:38:57.079751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:38:57.079751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:38:57.079751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:38:57.079751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Sep 10 11:38:57.079751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Sep 10 11:38:57.079751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 11:38:57.079751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 11:38:57.079751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 11:38:57.079751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 11:38:57.079751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:38:57.079751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:38:57.080777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:38:57.080777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:38:57.080777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 11:38:57.080777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 11:38:57.080777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 11:38:57.080777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 11:38:57.080777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 11:38:57.080777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 11:38:57.080777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 10 11:38:57.080777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:57.080777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:57.080777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:57.080777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:57.080777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:57.080777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:57.080777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 11:38:57.080777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 11:38:57.080777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 10 11:38:57.080777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:57.082401 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-493aaacb-8ad1-46ef-884a-d1df74eca551 tempest-AggregatesAdminNegativeTestJSON-569853065 tempest-AggregatesAdminNegativeTestJSON-569853065-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:38:57.082401 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-493aaacb-8ad1-46ef-884a-d1df74eca551 tempest-AggregatesAdminNegativeTestJSON-569853065 tempest-AggregatesAdminNegativeTestJSON-569853065-project] 10.222.0.23 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.024210 Sep 10 11:38:57.082401 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 161/335] 10.222.0.23 () {60 vars in 1194 bytes} [Sat Sep 10 11:38:57 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:38:57.092532 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-fe50e558-85cf-4c7e-aa1a-af9998a3eb2e req-a46c04a0-d5fc-4c19-9808-7e7a61f6cfb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f", "name": "network-vif-plugged", "status": "completed", "tag": "ea955540-4c57-4a66-aec1-116d10e8a2f8"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:57.100433 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c7861e5a-f32c-4db3-a3d8-67565d3167e2 tempest-HypervisorAdminV253TestBase-1471065589 tempest-HypervisorAdminV253TestBase-1471065589-project-admin] Calling method '.version_select at 0x7f40738c39d0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:57.105350 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-fe50e558-85cf-4c7e-aa1a-af9998a3eb2e req-a46c04a0-d5fc-4c19-9808-7e7a61f6cfb1 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:57.105986 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-fe50e558-85cf-4c7e-aa1a-af9998a3eb2e req-a46c04a0-d5fc-4c19-9808-7e7a61f6cfb1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:57.106540 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-fe50e558-85cf-4c7e-aa1a-af9998a3eb2e req-a46c04a0-d5fc-4c19-9808-7e7a61f6cfb1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:57.109096 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7861e5a-f32c-4db3-a3d8-67565d3167e2 tempest-HypervisorAdminV253TestBase-1471065589 tempest-HypervisorAdminV253TestBase-1471065589-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:57.110709 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7861e5a-f32c-4db3-a3d8-67565d3167e2 tempest-HypervisorAdminV253TestBase-1471065589 tempest-HypervisorAdminV253TestBase-1471065589-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:57.111709 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7861e5a-f32c-4db3-a3d8-67565d3167e2 tempest-HypervisorAdminV253TestBase-1471065589 tempest-HypervisorAdminV253TestBase-1471065589-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:57.120261 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-fe50e558-85cf-4c7e-aa1a-af9998a3eb2e req-a46c04a0-d5fc-4c19-9808-7e7a61f6cfb1 service nova] Creating event network-vif-plugged:ea955540-4c57-4a66-aec1-116d10e8a2f8 for instance e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f on n-h2-856895-1 Sep 10 11:38:57.130600 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-fe50e558-85cf-4c7e-aa1a-af9998a3eb2e req-a46c04a0-d5fc-4c19-9808-7e7a61f6cfb1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040859 Sep 10 11:38:57.133419 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 162/336] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:57.143230 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3e4133f5-1aa1-4e6c-a710-b3f4dcd7c0d6 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-856895-1"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:57.149324 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7861e5a-f32c-4db3-a3d8-67565d3167e2 tempest-HypervisorAdminV253TestBase-1471065589 tempest-HypervisorAdminV253TestBase-1471065589-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:57.151826 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7861e5a-f32c-4db3-a3d8-67565d3167e2 tempest-HypervisorAdminV253TestBase-1471065589 tempest-HypervisorAdminV253TestBase-1471065589-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:57.152540 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7861e5a-f32c-4db3-a3d8-67565d3167e2 tempest-HypervisorAdminV253TestBase-1471065589 tempest-HypervisorAdminV253TestBase-1471065589-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:57.163458 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3e4133f5-1aa1-4e6c-a710-b3f4dcd7c0d6 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:57.163966 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3e4133f5-1aa1-4e6c-a710-b3f4dcd7c0d6 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:57.167686 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3e4133f5-1aa1-4e6c-a710-b3f4dcd7c0d6 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:57.185293 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7861e5a-f32c-4db3-a3d8-67565d3167e2 tempest-HypervisorAdminV253TestBase-1471065589 tempest-HypervisorAdminV253TestBase-1471065589-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:57.186261 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7861e5a-f32c-4db3-a3d8-67565d3167e2 tempest-HypervisorAdminV253TestBase-1471065589 tempest-HypervisorAdminV253TestBase-1471065589-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:57.186971 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7861e5a-f32c-4db3-a3d8-67565d3167e2 tempest-HypervisorAdminV253TestBase-1471065589 tempest-HypervisorAdminV253TestBase-1471065589-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:57.204415 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7861e5a-f32c-4db3-a3d8-67565d3167e2 tempest-HypervisorAdminV253TestBase-1471065589 tempest-HypervisorAdminV253TestBase-1471065589-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:57.205275 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7861e5a-f32c-4db3-a3d8-67565d3167e2 tempest-HypervisorAdminV253TestBase-1471065589 tempest-HypervisorAdminV253TestBase-1471065589-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:57.206216 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7861e5a-f32c-4db3-a3d8-67565d3167e2 tempest-HypervisorAdminV253TestBase-1471065589 tempest-HypervisorAdminV253TestBase-1471065589-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:57.250392 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7861e5a-f32c-4db3-a3d8-67565d3167e2 tempest-HypervisorAdminV253TestBase-1471065589 tempest-HypervisorAdminV253TestBase-1471065589-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:57.256187 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7861e5a-f32c-4db3-a3d8-67565d3167e2 tempest-HypervisorAdminV253TestBase-1471065589 tempest-HypervisorAdminV253TestBase-1471065589-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:57.257119 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7861e5a-f32c-4db3-a3d8-67565d3167e2 tempest-HypervisorAdminV253TestBase-1471065589 tempest-HypervisorAdminV253TestBase-1471065589-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:57.278917 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c7861e5a-f32c-4db3-a3d8-67565d3167e2 tempest-HypervisorAdminV253TestBase-1471065589 tempest-HypervisorAdminV253TestBase-1471065589-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1994 microversion: 2.53 time: 0.532084 Sep 10 11:38:57.280232 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 175/337] 10.222.0.23 () {60 vars in 1243 bytes} [Sat Sep 10 11:38:56 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1994 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:38:57.311953 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3700e5a9-f65e-4fa8-a9d2-bbe232121337 tempest-HypervisorAdminV253TestBase-1471065589 tempest-HypervisorAdminV253TestBase-1471065589-project-admin] Calling method '.version_select at 0x7f4073b95ca0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:57.328278 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3700e5a9-f65e-4fa8-a9d2-bbe232121337 tempest-HypervisorAdminV253TestBase-1471065589 tempest-HypervisorAdminV253TestBase-1471065589-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:57.329283 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3700e5a9-f65e-4fa8-a9d2-bbe232121337 tempest-HypervisorAdminV253TestBase-1471065589 tempest-HypervisorAdminV253TestBase-1471065589-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:57.329945 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3700e5a9-f65e-4fa8-a9d2-bbe232121337 tempest-HypervisorAdminV253TestBase-1471065589 tempest-HypervisorAdminV253TestBase-1471065589-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:57.350090 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3700e5a9-f65e-4fa8-a9d2-bbe232121337 tempest-HypervisorAdminV253TestBase-1471065589 tempest-HypervisorAdminV253TestBase-1471065589-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:57.350924 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3700e5a9-f65e-4fa8-a9d2-bbe232121337 tempest-HypervisorAdminV253TestBase-1471065589 tempest-HypervisorAdminV253TestBase-1471065589-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:57.351603 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3700e5a9-f65e-4fa8-a9d2-bbe232121337 tempest-HypervisorAdminV253TestBase-1471065589 tempest-HypervisorAdminV253TestBase-1471065589-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:57.408268 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3e4133f5-1aa1-4e6c-a710-b3f4dcd7c0d6 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 227 microversion: 2.1 time: 0.273460 Sep 10 11:38:57.408882 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 163/338] 10.222.0.23 () {60 vars in 1194 bytes} [Sat Sep 10 11:38:57 2022] POST /compute/v2.1/os-aggregates/17/action => generated 227 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:57.410725 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3700e5a9-f65e-4fa8-a9d2-bbe232121337 tempest-HypervisorAdminV253TestBase-1471065589 tempest-HypervisorAdminV253TestBase-1471065589-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:57.413814 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3700e5a9-f65e-4fa8-a9d2-bbe232121337 tempest-HypervisorAdminV253TestBase-1471065589 tempest-HypervisorAdminV253TestBase-1471065589-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:57.414369 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3700e5a9-f65e-4fa8-a9d2-bbe232121337 tempest-HypervisorAdminV253TestBase-1471065589 tempest-HypervisorAdminV253TestBase-1471065589-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:57.420399 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d26dc4af-8227-4244-807a-6e23a4c0367a tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:57.423606 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d26dc4af-8227-4244-807a-6e23a4c0367a tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] [instance: 966031ed-9a06-4a3d-92f7-96adcfa7e364] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:57.431983 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d26dc4af-8227-4244-807a-6e23a4c0367a tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:57.432483 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d26dc4af-8227-4244-807a-6e23a4c0367a tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:57.432924 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d26dc4af-8227-4244-807a-6e23a4c0367a tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:57.433791 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d26dc4af-8227-4244-807a-6e23a4c0367a tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:57.434256 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d26dc4af-8227-4244-807a-6e23a4c0367a tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:57.434690 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d26dc4af-8227-4244-807a-6e23a4c0367a tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:57.443787 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3700e5a9-f65e-4fa8-a9d2-bbe232121337 tempest-HypervisorAdminV253TestBase-1471065589 tempest-HypervisorAdminV253TestBase-1471065589-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:57.444582 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3700e5a9-f65e-4fa8-a9d2-bbe232121337 tempest-HypervisorAdminV253TestBase-1471065589 tempest-HypervisorAdminV253TestBase-1471065589-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:57.445210 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3700e5a9-f65e-4fa8-a9d2-bbe232121337 tempest-HypervisorAdminV253TestBase-1471065589 tempest-HypervisorAdminV253TestBase-1471065589-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:57.462807 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:38:57.473750 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3700e5a9-f65e-4fa8-a9d2-bbe232121337 tempest-HypervisorAdminV253TestBase-1471065589 tempest-HypervisorAdminV253TestBase-1471065589-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:57.474976 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3700e5a9-f65e-4fa8-a9d2-bbe232121337 tempest-HypervisorAdminV253TestBase-1471065589 tempest-HypervisorAdminV253TestBase-1471065589-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:57.475627 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3700e5a9-f65e-4fa8-a9d2-bbe232121337 tempest-HypervisorAdminV253TestBase-1471065589 tempest-HypervisorAdminV253TestBase-1471065589-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:57.483298 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3700e5a9-f65e-4fa8-a9d2-bbe232121337 tempest-HypervisorAdminV253TestBase-1471065589 tempest-HypervisorAdminV253TestBase-1471065589-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 686 microversion: 2.53 time: 0.187221 Sep 10 11:38:57.484472 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 176/339] 10.222.0.23 () {60 vars in 1222 bytes} [Sat Sep 10 11:38:57 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 686 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:38:57.489894 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-28942e82-21f6-423a-933c-c9d564c7456b tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:57.526840 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-28942e82-21f6-423a-933c-c9d564c7456b tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.040858 Sep 10 11:38:57.527460 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 177/340] 10.222.0.23 () {58 vars in 1155 bytes} [Sat Sep 10 11:38:57 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 11:38:57.533827 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9197234f-7eb5-4bc2-a969-8378a97e4e2d tempest-HypervisorAdminV253TestBase-1471065589 tempest-HypervisorAdminV253TestBase-1471065589-project-admin] Calling method '.version_select at 0x7f40738c3b80>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:57.537756 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9197234f-7eb5-4bc2-a969-8378a97e4e2d tempest-HypervisorAdminV253TestBase-1471065589 tempest-HypervisorAdminV253TestBase-1471065589-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:57.538252 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9197234f-7eb5-4bc2-a969-8378a97e4e2d tempest-HypervisorAdminV253TestBase-1471065589 tempest-HypervisorAdminV253TestBase-1471065589-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:57.538693 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9197234f-7eb5-4bc2-a969-8378a97e4e2d tempest-HypervisorAdminV253TestBase-1471065589 tempest-HypervisorAdminV253TestBase-1471065589-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:57.555988 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9197234f-7eb5-4bc2-a969-8378a97e4e2d tempest-HypervisorAdminV253TestBase-1471065589 tempest-HypervisorAdminV253TestBase-1471065589-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:57.556483 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9197234f-7eb5-4bc2-a969-8378a97e4e2d tempest-HypervisorAdminV253TestBase-1471065589 tempest-HypervisorAdminV253TestBase-1471065589-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:57.556923 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9197234f-7eb5-4bc2-a969-8378a97e4e2d tempest-HypervisorAdminV253TestBase-1471065589 tempest-HypervisorAdminV253TestBase-1471065589-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:57.563268 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9197234f-7eb5-4bc2-a969-8378a97e4e2d tempest-HypervisorAdminV253TestBase-1471065589 tempest-HypervisorAdminV253TestBase-1471065589-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/c991d921-68ec-477f-ad5a-2b7d9ab81491" status: 200 len: 792 microversion: 2.53 time: 0.034474 Sep 10 11:38:57.563899 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 178/341] 10.222.0.23 () {60 vars in 1298 bytes} [Sat Sep 10 11:38:57 2022] GET /compute/v2.1/os-hypervisors/c991d921-68ec-477f-ad5a-2b7d9ab81491 => generated 792 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:38:57.569405 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-46be8409-4aaa-435a-a5ad-a35d7af2d9ce tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1787563488"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:57.572749 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.aggregate [None req-46be8409-4aaa-435a-a5ad-a35d7af2d9ce tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Generated uuid 788e6600-40be-447b-a728-8513b5fc7db1 for aggregate {{(pid=128777) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 11:38:57.576010 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d26dc4af-8227-4244-807a-6e23a4c0367a tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c91799a8724c499cd1afe82e3fd657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95726b0caac4b7fb5f0db90d268430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:57.584438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=7,nova_api:DELETE=13 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:38:57.593139 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d26dc4af-8227-4244-807a-6e23a4c0367a tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] 10.222.0.23 "GET /compute/v2.1/servers/966031ed-9a06-4a3d-92f7-96adcfa7e364" status: 200 len: 1279 microversion: 2.1 time: 0.180846 Sep 10 11:38:57.601741 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 164/342] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:57 2022] GET /compute/v2.1/servers/966031ed-9a06-4a3d-92f7-96adcfa7e364 => generated 1279 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:57.617108 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-46be8409-4aaa-435a-a5ad-a35d7af2d9ce tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.050729 Sep 10 11:38:57.617925 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 179/343] 10.222.0.23 () {60 vars in 1164 bytes} [Sat Sep 10 11:38:57 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:38:57.633607 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-63e7793e-fe15-4f7f-887c-65cded20f5a2 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:38:57.650636 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-63e7793e-fe15-4f7f-887c-65cded20f5a2 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:57.652460 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-63e7793e-fe15-4f7f-887c-65cded20f5a2 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:57.654809 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-63e7793e-fe15-4f7f-887c-65cded20f5a2 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:57.671293 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-63e7793e-fe15-4f7f-887c-65cded20f5a2 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:57.672134 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-63e7793e-fe15-4f7f-887c-65cded20f5a2 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:57.673511 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-63e7793e-fe15-4f7f-887c-65cded20f5a2 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:57.684610 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.compute.aggregates [None req-63e7793e-fe15-4f7f-887c-65cded20f5a2 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 10 11:38:57.685153 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-63e7793e-fe15-4f7f-887c-65cded20f5a2 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Sep 10 11:38:57.687844 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-63e7793e-fe15-4f7f-887c-65cded20f5a2 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Request method failure captured: Sep 10 11:38:57.687844 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Sep 10 11:38:57.687844 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:38:57.687844 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:38:57.687844 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:38:57.687844 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 42 Sep 10 11:38:57.687844 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:38:57.687844 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:38:57.687844 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:38:57.687844 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:38:57.687844 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHdMmjmJlORb7Mn9h0LiG6VjGgHzN0KMleJ88MPwntD_3w_8FT4TQGi2Jkk9-1w-yGeOVtrvCBl0CkyNVVCw3ufgJZ3fmryUbNV3QNpo2jJzWbaR3wVY5BdQ-7FEmbTLdjQF9E5Zbbfk5chIheFwEKlGiwp-XfXu3oH47BQ00WZG7Vc Sep 10 11:38:57.687844 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:38:57.687844 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:38:57.687844 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:38:57.687844 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:38:57.687844 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:38:57.687844 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:38:57.687844 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: cee7249e943d467eaec957455ed8a715 Sep 10 11:38:57.687844 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1641762440 Sep 10 11:38:57.687844 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,admin,member Sep 10 11:38:57.687844 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,admin,member Sep 10 11:38:57.689351 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cee7249e943d467eaec957455ed8a715"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cee7249e943d467eaec957455ed8a715"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cee7249e943d467eaec957455ed8a715", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cee7249e943d467eaec957455ed8a715"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:38:57.689351 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1641762440 Sep 10 11:38:57.689351 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: cee7249e943d467eaec957455ed8a715 Sep 10 11:38:57.689351 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1641762440 Sep 10 11:38:57.689351 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin Sep 10 11:38:57.689351 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:38:57.689351 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:38:57.689351 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: e1f7dc2c9dd94b5ebba6126f7d0de5e9 Sep 10 11:38:57.689351 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin Sep 10 11:38:57.689351 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 11:38:57.689351 n-d-856895-1 devstack@n-api.service[128776]: {"remove_host": {"host": "nonexist_host"}} Sep 10 11:38:57.689351 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:38:57.689351 n-d-856895-1 devstack@n-api.service[128776]: exception: Cannot remove host nonexist_host in aggregate 18 Sep 10 11:38:57.690096 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Sep 10 11:38:57.690096 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:38:57.690096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:57.690096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 10 11:38:57.690096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 10 11:38:57.690096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 11:38:57.690096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 11:38:57.690096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 10 11:38:57.690096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 10 11:38:57.690096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 11:38:57.690096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 11:38:57.690096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 10 11:38:57.690096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 10 11:38:57.690096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Sep 10 11:38:57.690096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:57.690096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:57.690096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:57.690096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:57.690096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 10 11:38:57.690096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 10 11:38:57.691815 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 10 11:38:57.691815 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 10 11:38:57.691815 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 10 11:38:57.691815 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:57.691815 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:57.691815 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:57.691815 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:57.691815 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Sep 10 11:38:57.691815 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Sep 10 11:38:57.691815 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 11:38:57.691815 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 11:38:57.691815 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:38:57.691815 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:38:57.691815 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:38:57.691815 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:38:57.691815 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 11:38:57.691815 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 11:38:57.691815 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Sep 10 11:38:57.691815 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Sep 10 11:38:57.691815 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 10 11:38:57.692877 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 10 11:38:57.692877 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 10 11:38:57.692877 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:57.692877 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:57.692877 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:57.692877 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:57.692877 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:57.692877 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:57.692877 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:38:57.692877 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:38:57.692877 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:38:57.692877 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:38:57.692877 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:38:57.692877 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:38:57.692877 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Sep 10 11:38:57.692877 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 10 11:38:57.692877 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Sep 10 11:38:57.692877 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:57.692877 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:57.692877 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:57.692877 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:57.693959 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:57.693959 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:57.693959 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:38:57.693959 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:38:57.693959 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Sep 10 11:38:57.693959 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:57.696351 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-63e7793e-fe15-4f7f-887c-65cded20f5a2 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:38:57.697531 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-63e7793e-fe15-4f7f-887c-65cded20f5a2 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.071959 Sep 10 11:38:57.701650 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 165/344] 10.222.0.23 () {60 vars in 1194 bytes} [Sat Sep 10 11:38:57 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:38:57.706471 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6c56eda6-ad63-4043-8dc6-b6a1b443bde9 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:57.742570 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6c56eda6-ad63-4043-8dc6-b6a1b443bde9 tempest-AggregatesAdminNegativeTestJSON-1641762440 tempest-AggregatesAdminNegativeTestJSON-1641762440-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.039812 Sep 10 11:38:57.743462 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 180/345] 10.222.0.23 () {58 vars in 1155 bytes} [Sat Sep 10 11:38:57 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 10 11:38:57.795847 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-35c2df8f-eb72-454b-b803-e6bfda2afbba tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:57.796678 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-35c2df8f-eb72-454b-b803-e6bfda2afbba tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 810c2316-10c5-47b4-9118-0298629d94e1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:57.806473 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-35c2df8f-eb72-454b-b803-e6bfda2afbba tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:57.808289 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-35c2df8f-eb72-454b-b803-e6bfda2afbba tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:57.808817 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-35c2df8f-eb72-454b-b803-e6bfda2afbba tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:57.810152 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-35c2df8f-eb72-454b-b803-e6bfda2afbba tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:57.811055 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-35c2df8f-eb72-454b-b803-e6bfda2afbba tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:57.811544 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-35c2df8f-eb72-454b-b803-e6bfda2afbba tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:57.963773 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-93104fad-af46-4f3e-9ecf-174a8881bc2c tempest-AZAdminNegativeTestJSON-1730390126 tempest-AZAdminNegativeTestJSON-1730390126-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:57.965870 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-93104fad-af46-4f3e-9ecf-174a8881bc2c tempest-AZAdminNegativeTestJSON-1730390126 tempest-AZAdminNegativeTestJSON-1730390126-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '957985cf49104812b9b28f8c152815fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a5c635e4534d51a71d0024ec2bcb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:57.968859 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-93104fad-af46-4f3e-9ecf-174a8881bc2c tempest-AZAdminNegativeTestJSON-1730390126 tempest-AZAdminNegativeTestJSON-1730390126-project] Request method failure captured: Sep 10 11:38:57.968859 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Sep 10 11:38:57.968859 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:38:57.968859 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:38:57.968859 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:38:57.968859 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:38:57.968859 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:38:57.968859 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:38:57.968859 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:38:57.968859 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:38:57.968859 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHdQ3vmwb_q9JO2hPc3MRziGBx_mt6H2Ymfhmd2PEAPjNZsViI6bsC7HogTBIaajYIVGq0fqalkgCLAjnm8noF8YldqRCstTeaGlpKgbMiwW5lw4VdXylsILES_TDWTF41CmSB0lnlflAx0zvdPV_7upBxyLTy8TcCJnZJbcC4AWA_A Sep 10 11:38:57.968859 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:38:57.968859 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:38:57.968859 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:38:57.968859 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:38:57.968859 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:38:57.968859 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:38:57.968859 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 76a5c635e4534d51a71d0024ec2bcb4d Sep 10 11:38:57.968859 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1730390126 Sep 10 11:38:57.968859 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:38:57.968859 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:38:57.970261 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/76a5c635e4534d51a71d0024ec2bcb4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/76a5c635e4534d51a71d0024ec2bcb4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_76a5c635e4534d51a71d0024ec2bcb4d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/76a5c635e4534d51a71d0024ec2bcb4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:38:57.970261 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-AZAdminNegativeTestJSON-1730390126 Sep 10 11:38:57.970261 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 76a5c635e4534d51a71d0024ec2bcb4d Sep 10 11:38:57.970261 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1730390126 Sep 10 11:38:57.970261 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-AZAdminNegativeTestJSON-1730390126-project Sep 10 11:38:57.970261 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:38:57.970261 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:38:57.970261 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 957985cf49104812b9b28f8c152815fb Sep 10 11:38:57.970261 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-AZAdminNegativeTestJSON-1730390126-project Sep 10 11:38:57.970261 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:38:57.970261 n-d-856895-1 devstack@n-api.service[128776]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 10 11:38:57.970261 n-d-856895-1 devstack@n-api.service[128776]: action_args: {} Sep 10 11:38:57.971255 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:38:57.971255 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:57.971255 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:57.971255 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:57.971255 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:38:57.971255 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:38:57.971255 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:38:57.971255 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:38:57.971255 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Sep 10 11:38:57.971255 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Sep 10 11:38:57.971255 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 11:38:57.971255 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 11:38:57.971255 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 11:38:57.971255 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 11:38:57.971255 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:38:57.971255 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:38:57.971255 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:38:57.971255 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:38:57.971255 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 11:38:57.973977 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 11:38:57.973977 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 11:38:57.973977 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 11:38:57.973977 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 11:38:57.973977 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 11:38:57.973977 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 10 11:38:57.973977 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:57.973977 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:38:57.973977 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:57.973977 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:38:57.973977 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:38:57.973977 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:38:57.973977 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 11:38:57.973977 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 11:38:57.973977 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 10 11:38:57.973977 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:38:57.977731 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-93104fad-af46-4f3e-9ecf-174a8881bc2c tempest-AZAdminNegativeTestJSON-1730390126 tempest-AZAdminNegativeTestJSON-1730390126-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:38:57.979270 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-93104fad-af46-4f3e-9ecf-174a8881bc2c tempest-AZAdminNegativeTestJSON-1730390126 tempest-AZAdminNegativeTestJSON-1730390126-project] 10.222.0.23 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.256357 Sep 10 11:38:57.981324 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 166/346] 10.222.0.23 () {58 vars in 1185 bytes} [Sat Sep 10 11:38:57 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 260 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:38:58.035941 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-35c2df8f-eb72-454b-b803-e6bfda2afbba tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b632d0a5ac48fea0da5aa15632cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a040213a0ea443cd97b346b0d4e79d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:58.045936 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-35c2df8f-eb72-454b-b803-e6bfda2afbba tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/810c2316-10c5-47b4-9118-0298629d94e1" status: 200 len: 1320 microversion: 2.1 time: 0.255045 Sep 10 11:38:58.047207 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 181/347] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:57 2022] GET /compute/v2.1/servers/810c2316-10c5-47b4-9118-0298629d94e1 => generated 1320 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:38:58.081794 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-aece1e0c-568f-4e2a-a711-41be1983b023 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:58.090057 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-aece1e0c-568f-4e2a-a711-41be1983b023 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:58.104611 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aece1e0c-568f-4e2a-a711-41be1983b023 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:58.105726 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aece1e0c-568f-4e2a-a711-41be1983b023 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:58.106422 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aece1e0c-568f-4e2a-a711-41be1983b023 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:58.107391 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aece1e0c-568f-4e2a-a711-41be1983b023 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:58.108033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aece1e0c-568f-4e2a-a711-41be1983b023 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:58.108550 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aece1e0c-568f-4e2a-a711-41be1983b023 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:58.314161 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-aece1e0c-568f-4e2a-a711-41be1983b023 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:58.324386 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-aece1e0c-568f-4e2a-a711-41be1983b023 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f" status: 200 len: 1310 microversion: 2.1 time: 0.254178 Sep 10 11:38:58.326363 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 167/348] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:58 2022] GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f => generated 1310 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:58.619191 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-65e0d08b-616d-4857-8d0c-c0a1e6e3153e tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:58.620069 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-65e0d08b-616d-4857-8d0c-c0a1e6e3153e tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] [instance: 966031ed-9a06-4a3d-92f7-96adcfa7e364] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:58.629046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-65e0d08b-616d-4857-8d0c-c0a1e6e3153e tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:58.629548 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-65e0d08b-616d-4857-8d0c-c0a1e6e3153e tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:58.630144 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-65e0d08b-616d-4857-8d0c-c0a1e6e3153e tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:58.630863 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-65e0d08b-616d-4857-8d0c-c0a1e6e3153e tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:58.631359 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-65e0d08b-616d-4857-8d0c-c0a1e6e3153e tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:58.631793 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-65e0d08b-616d-4857-8d0c-c0a1e6e3153e tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:58.937960 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-65e0d08b-616d-4857-8d0c-c0a1e6e3153e tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c91799a8724c499cd1afe82e3fd657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95726b0caac4b7fb5f0db90d268430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:58.950409 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-65e0d08b-616d-4857-8d0c-c0a1e6e3153e tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] 10.222.0.23 "GET /compute/v2.1/servers/966031ed-9a06-4a3d-92f7-96adcfa7e364" status: 200 len: 1321 microversion: 2.1 time: 0.335694 Sep 10 11:38:58.951806 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 182/349] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:58 2022] GET /compute/v2.1/servers/966031ed-9a06-4a3d-92f7-96adcfa7e364 => generated 1321 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:59.071436 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-47e206d4-5052-4e9f-a03e-3f1a9c3a6add tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:59.072203 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-47e206d4-5052-4e9f-a03e-3f1a9c3a6add tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 810c2316-10c5-47b4-9118-0298629d94e1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:59.079219 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-47e206d4-5052-4e9f-a03e-3f1a9c3a6add tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:59.083346 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-47e206d4-5052-4e9f-a03e-3f1a9c3a6add tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:59.083483 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-47e206d4-5052-4e9f-a03e-3f1a9c3a6add tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:59.084546 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-47e206d4-5052-4e9f-a03e-3f1a9c3a6add tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:59.085517 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-47e206d4-5052-4e9f-a03e-3f1a9c3a6add tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:59.086091 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-47e206d4-5052-4e9f-a03e-3f1a9c3a6add tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:59.252433 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-47e206d4-5052-4e9f-a03e-3f1a9c3a6add tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b632d0a5ac48fea0da5aa15632cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a040213a0ea443cd97b346b0d4e79d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:59.262929 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-47e206d4-5052-4e9f-a03e-3f1a9c3a6add tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/810c2316-10c5-47b4-9118-0298629d94e1" status: 200 len: 1320 microversion: 2.1 time: 0.196636 Sep 10 11:38:59.263878 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 168/350] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:59 2022] GET /compute/v2.1/servers/810c2316-10c5-47b4-9118-0298629d94e1 => generated 1320 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:38:59.351980 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fca6d124-68af-48d5-b122-9a0b67eb0350 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:59.352727 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fca6d124-68af-48d5-b122-9a0b67eb0350 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:59.360521 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fca6d124-68af-48d5-b122-9a0b67eb0350 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:59.361096 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fca6d124-68af-48d5-b122-9a0b67eb0350 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:59.361991 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fca6d124-68af-48d5-b122-9a0b67eb0350 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:59.362808 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fca6d124-68af-48d5-b122-9a0b67eb0350 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:59.363611 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fca6d124-68af-48d5-b122-9a0b67eb0350 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:59.364275 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fca6d124-68af-48d5-b122-9a0b67eb0350 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:59.649685 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fca6d124-68af-48d5-b122-9a0b67eb0350 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:38:59.665862 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fca6d124-68af-48d5-b122-9a0b67eb0350 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f" status: 200 len: 1494 microversion: 2.1 time: 0.317127 Sep 10 11:38:59.666992 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 183/351] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:59 2022] GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f => generated 1494 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:38:59.974749 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-25cdc1e1-678e-4543-a27b-58fd2ddceae6 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:38:59.975362 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-25cdc1e1-678e-4543-a27b-58fd2ddceae6 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] [instance: 966031ed-9a06-4a3d-92f7-96adcfa7e364] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:38:59.984919 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25cdc1e1-678e-4543-a27b-58fd2ddceae6 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:59.985410 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25cdc1e1-678e-4543-a27b-58fd2ddceae6 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:59.989143 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25cdc1e1-678e-4543-a27b-58fd2ddceae6 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:38:59.992437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25cdc1e1-678e-4543-a27b-58fd2ddceae6 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:38:59.994116 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25cdc1e1-678e-4543-a27b-58fd2ddceae6 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:38:59.997941 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25cdc1e1-678e-4543-a27b-58fd2ddceae6 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:00.077612 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1d619329-c6fc-4812-9e9d-a093d4063ae3 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:00.079428 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1d619329-c6fc-4812-9e9d-a093d4063ae3 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] [instance: e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:00.089009 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=8,nova_api:DELETE=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:39:00.104923 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1d619329-c6fc-4812-9e9d-a093d4063ae3 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:00.108298 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1d619329-c6fc-4812-9e9d-a093d4063ae3 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:00.109997 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1d619329-c6fc-4812-9e9d-a093d4063ae3 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:00.113886 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1d619329-c6fc-4812-9e9d-a093d4063ae3 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:00.114721 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1d619329-c6fc-4812-9e9d-a093d4063ae3 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:00.115360 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1d619329-c6fc-4812-9e9d-a093d4063ae3 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:00.338395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-25cdc1e1-678e-4543-a27b-58fd2ddceae6 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c91799a8724c499cd1afe82e3fd657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95726b0caac4b7fb5f0db90d268430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:00.348215 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-25cdc1e1-678e-4543-a27b-58fd2ddceae6 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] 10.222.0.23 "GET /compute/v2.1/servers/966031ed-9a06-4a3d-92f7-96adcfa7e364" status: 200 len: 1321 microversion: 2.1 time: 0.378069 Sep 10 11:39:00.352574 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 184/352] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:59 2022] GET /compute/v2.1/servers/966031ed-9a06-4a3d-92f7-96adcfa7e364 => generated 1321 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:39:00.360006 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-30f2df20-4d08-4f07-847c-f37218e8f8ec tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:00.361775 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-30f2df20-4d08-4f07-847c-f37218e8f8ec tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 810c2316-10c5-47b4-9118-0298629d94e1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:00.371990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30f2df20-4d08-4f07-847c-f37218e8f8ec tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:00.372621 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30f2df20-4d08-4f07-847c-f37218e8f8ec tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:00.373302 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30f2df20-4d08-4f07-847c-f37218e8f8ec tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:00.374820 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30f2df20-4d08-4f07-847c-f37218e8f8ec tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:00.375511 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30f2df20-4d08-4f07-847c-f37218e8f8ec tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:00.376155 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30f2df20-4d08-4f07-847c-f37218e8f8ec tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:00.635793 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1d619329-c6fc-4812-9e9d-a093d4063ae3 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f" status: 200 len: 1645 microversion: 2.1 time: 0.949284 Sep 10 11:39:00.640806 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 169/353] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:38:59 2022] GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f => generated 1645 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:00.673219 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cb4d31a1-f09d-4d8f-9fa1-ad9b0a1c0819 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:00.674522 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cb4d31a1-f09d-4d8f-9fa1-ad9b0a1c0819 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] [instance: e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:00.688596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb4d31a1-f09d-4d8f-9fa1-ad9b0a1c0819 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:00.689205 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb4d31a1-f09d-4d8f-9fa1-ad9b0a1c0819 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:00.691070 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb4d31a1-f09d-4d8f-9fa1-ad9b0a1c0819 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:00.694322 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb4d31a1-f09d-4d8f-9fa1-ad9b0a1c0819 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:00.694982 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb4d31a1-f09d-4d8f-9fa1-ad9b0a1c0819 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:00.695788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb4d31a1-f09d-4d8f-9fa1-ad9b0a1c0819 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:00.751689 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-30f2df20-4d08-4f07-847c-f37218e8f8ec tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b632d0a5ac48fea0da5aa15632cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a040213a0ea443cd97b346b0d4e79d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:00.765936 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-30f2df20-4d08-4f07-847c-f37218e8f8ec tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/810c2316-10c5-47b4-9118-0298629d94e1" status: 200 len: 1320 microversion: 2.1 time: 0.412363 Sep 10 11:39:00.767642 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 185/354] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:00 2022] GET /compute/v2.1/servers/810c2316-10c5-47b4-9118-0298629d94e1 => generated 1320 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:01.202389 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-8340e727-89e2-4c65-b77f-67f1af5db4b9 req-b0bfbd91-c73e-4cdb-bc3a-b13f3527f2c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "966031ed-9a06-4a3d-92f7-96adcfa7e364", "tag": "cf4f7adf-c397-437b-b09a-56569661c04f"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:01.219684 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8340e727-89e2-4c65-b77f-67f1af5db4b9 req-b0bfbd91-c73e-4cdb-bc3a-b13f3527f2c9 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:01.220690 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8340e727-89e2-4c65-b77f-67f1af5db4b9 req-b0bfbd91-c73e-4cdb-bc3a-b13f3527f2c9 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:01.220928 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8340e727-89e2-4c65-b77f-67f1af5db4b9 req-b0bfbd91-c73e-4cdb-bc3a-b13f3527f2c9 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:01.248284 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-8340e727-89e2-4c65-b77f-67f1af5db4b9 req-b0bfbd91-c73e-4cdb-bc3a-b13f3527f2c9 service nova] Creating event network-changed:cf4f7adf-c397-437b-b09a-56569661c04f for instance 966031ed-9a06-4a3d-92f7-96adcfa7e364 on n-h2-856895-1 Sep 10 11:39:01.260290 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-8340e727-89e2-4c65-b77f-67f1af5db4b9 req-b0bfbd91-c73e-4cdb-bc3a-b13f3527f2c9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059545 Sep 10 11:39:01.267001 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 186/355] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:39:01.310337 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cb4d31a1-f09d-4d8f-9fa1-ad9b0a1c0819 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f" status: 200 len: 1645 microversion: 2.1 time: 0.642775 Sep 10 11:39:01.334576 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 170/356] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:00 2022] GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f => generated 1645 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:39:01.346046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4bf4a439-5110-47d0-9c53-dfb0821ec751 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:01.352629 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4bf4a439-5110-47d0-9c53-dfb0821ec751 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:01.353214 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4bf4a439-5110-47d0-9c53-dfb0821ec751 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:01.353761 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4bf4a439-5110-47d0-9c53-dfb0821ec751 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:01.354506 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4bf4a439-5110-47d0-9c53-dfb0821ec751 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:01.354967 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4bf4a439-5110-47d0-9c53-dfb0821ec751 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:01.355497 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4bf4a439-5110-47d0-9c53-dfb0821ec751 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:01.379755 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fc7d284d-b200-4396-b112-b33477974ea7 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:01.381168 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fc7d284d-b200-4396-b112-b33477974ea7 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] [instance: 966031ed-9a06-4a3d-92f7-96adcfa7e364] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:01.391500 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc7d284d-b200-4396-b112-b33477974ea7 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:01.394978 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc7d284d-b200-4396-b112-b33477974ea7 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:01.398392 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc7d284d-b200-4396-b112-b33477974ea7 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:01.400182 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc7d284d-b200-4396-b112-b33477974ea7 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:01.400829 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc7d284d-b200-4396-b112-b33477974ea7 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:01.404345 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc7d284d-b200-4396-b112-b33477974ea7 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:01.446064 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4bf4a439-5110-47d0-9c53-dfb0821ec751 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.104334 Sep 10 11:39:01.447250 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 187/357] 10.222.0.23 () {58 vars in 1176 bytes} [Sat Sep 10 11:39:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:39:01.460038 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f23835f7-d4f2-45da-9e88-810e848353b5 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-856895-1", "block_migration": true, "disk_over_commit": false}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:01.463215 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f23835f7-d4f2-45da-9e88-810e848353b5 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] [instance: e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:01.470710 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f23835f7-d4f2-45da-9e88-810e848353b5 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:01.471411 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f23835f7-d4f2-45da-9e88-810e848353b5 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:01.472247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f23835f7-d4f2-45da-9e88-810e848353b5 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:01.473402 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f23835f7-d4f2-45da-9e88-810e848353b5 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:01.474012 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f23835f7-d4f2-45da-9e88-810e848353b5 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:01.475462 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f23835f7-d4f2-45da-9e88-810e848353b5 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:01.601744 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-f23835f7-d4f2-45da-9e88-810e848353b5 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lazy-loading 'flavor' on Instance uuid e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:39:01.744924 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f23835f7-d4f2-45da-9e88-810e848353b5 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] [instance: e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f] Going to try to live migrate instance to n-h1-856895-1 {{(pid=128777) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 10 11:39:01.890824 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:39:01.936275 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fc7d284d-b200-4396-b112-b33477974ea7 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c91799a8724c499cd1afe82e3fd657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95726b0caac4b7fb5f0db90d268430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:01.946922 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fc7d284d-b200-4396-b112-b33477974ea7 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] 10.222.0.23 "GET /compute/v2.1/servers/966031ed-9a06-4a3d-92f7-96adcfa7e364" status: 200 len: 1321 microversion: 2.1 time: 0.570621 Sep 10 11:39:01.949981 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 171/358] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:01 2022] GET /compute/v2.1/servers/966031ed-9a06-4a3d-92f7-96adcfa7e364 => generated 1321 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:01.961200 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-10ab5f15-e1ce-4e70-8999-f2a75deba944 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:01.963462 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-10ab5f15-e1ce-4e70-8999-f2a75deba944 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 810c2316-10c5-47b4-9118-0298629d94e1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:01.975002 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10ab5f15-e1ce-4e70-8999-f2a75deba944 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:01.978158 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10ab5f15-e1ce-4e70-8999-f2a75deba944 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:01.979685 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10ab5f15-e1ce-4e70-8999-f2a75deba944 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:01.981639 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10ab5f15-e1ce-4e70-8999-f2a75deba944 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:01.985653 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10ab5f15-e1ce-4e70-8999-f2a75deba944 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:01.986291 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10ab5f15-e1ce-4e70-8999-f2a75deba944 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:02.297181 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-10ab5f15-e1ce-4e70-8999-f2a75deba944 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b632d0a5ac48fea0da5aa15632cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a040213a0ea443cd97b346b0d4e79d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:02.315988 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-10ab5f15-e1ce-4e70-8999-f2a75deba944 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/810c2316-10c5-47b4-9118-0298629d94e1" status: 200 len: 1320 microversion: 2.1 time: 0.364391 Sep 10 11:39:02.318079 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 172/359] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:01 2022] GET /compute/v2.1/servers/810c2316-10c5-47b4-9118-0298629d94e1 => generated 1320 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:02.565002 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-8333541b-5546-4863-8ddf-9daa5edc6d56 req-4a6a3998-480d-4f64-85b5-fb10d159142f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "810c2316-10c5-47b4-9118-0298629d94e1", "name": "network-vif-plugged", "status": "completed", "tag": "c2e4229b-d7db-4aeb-8db4-3f5575cc527f"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:02.580270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-8333541b-5546-4863-8ddf-9daa5edc6d56 req-4a6a3998-480d-4f64-85b5-fb10d159142f service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:02.582733 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-8333541b-5546-4863-8ddf-9daa5edc6d56 req-4a6a3998-480d-4f64-85b5-fb10d159142f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:02.602889 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-8333541b-5546-4863-8ddf-9daa5edc6d56 req-4a6a3998-480d-4f64-85b5-fb10d159142f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:02.658529 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-8333541b-5546-4863-8ddf-9daa5edc6d56 req-4a6a3998-480d-4f64-85b5-fb10d159142f service nova] Creating event network-vif-plugged:c2e4229b-d7db-4aeb-8db4-3f5575cc527f for instance 810c2316-10c5-47b4-9118-0298629d94e1 on n-h1-856895-1 Sep 10 11:39:02.682217 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-8333541b-5546-4863-8ddf-9daa5edc6d56 req-4a6a3998-480d-4f64-85b5-fb10d159142f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112929 Sep 10 11:39:02.682901 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 173/360] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:39:02.975043 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8f5940ce-f919-4d3c-ac35-649a95e126b2 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:02.975914 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8f5940ce-f919-4d3c-ac35-649a95e126b2 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] [instance: 966031ed-9a06-4a3d-92f7-96adcfa7e364] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:02.989379 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8f5940ce-f919-4d3c-ac35-649a95e126b2 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:02.989883 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8f5940ce-f919-4d3c-ac35-649a95e126b2 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:02.990429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8f5940ce-f919-4d3c-ac35-649a95e126b2 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:02.993197 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8f5940ce-f919-4d3c-ac35-649a95e126b2 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:02.994708 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8f5940ce-f919-4d3c-ac35-649a95e126b2 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:02.996330 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8f5940ce-f919-4d3c-ac35-649a95e126b2 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:03.468788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8f5940ce-f919-4d3c-ac35-649a95e126b2 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c91799a8724c499cd1afe82e3fd657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95726b0caac4b7fb5f0db90d268430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:03.484640 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8f5940ce-f919-4d3c-ac35-649a95e126b2 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] 10.222.0.23 "GET /compute/v2.1/servers/966031ed-9a06-4a3d-92f7-96adcfa7e364" status: 200 len: 1321 microversion: 2.1 time: 0.512857 Sep 10 11:39:03.486672 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 174/361] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:02 2022] GET /compute/v2.1/servers/966031ed-9a06-4a3d-92f7-96adcfa7e364 => generated 1321 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:03.498925 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-da3b60fc-b66b-4d52-bc7e-22f04265a7e3 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:03.512574 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-da3b60fc-b66b-4d52-bc7e-22f04265a7e3 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 810c2316-10c5-47b4-9118-0298629d94e1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:03.530801 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da3b60fc-b66b-4d52-bc7e-22f04265a7e3 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:03.532540 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da3b60fc-b66b-4d52-bc7e-22f04265a7e3 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:03.533297 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da3b60fc-b66b-4d52-bc7e-22f04265a7e3 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:03.535470 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da3b60fc-b66b-4d52-bc7e-22f04265a7e3 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:03.536218 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da3b60fc-b66b-4d52-bc7e-22f04265a7e3 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:03.540528 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da3b60fc-b66b-4d52-bc7e-22f04265a7e3 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:03.822270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-da3b60fc-b66b-4d52-bc7e-22f04265a7e3 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b632d0a5ac48fea0da5aa15632cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a040213a0ea443cd97b346b0d4e79d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:03.839623 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-da3b60fc-b66b-4d52-bc7e-22f04265a7e3 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/810c2316-10c5-47b4-9118-0298629d94e1" status: 200 len: 1320 microversion: 2.1 time: 0.346247 Sep 10 11:39:03.852325 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 175/362] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:03 2022] GET /compute/v2.1/servers/810c2316-10c5-47b4-9118-0298629d94e1 => generated 1320 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:04.448211 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d7346582-a7a0-42c2-b70c-23f6e6fe1d4c tempest-KeyPairsV210TestJSON-739387413 tempest-KeyPairsV210TestJSON-739387413-project-admin] Action: 'create', calling method: .version_select at 0x7f4073ec45e0>, body: {"keypair": {"name": "tempest-keypair-1247177623", "type": "ssh", "user_id": "2b82bc328e9c4fe7a4b200ab11681342", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0zdVp5y49VE4r0I0R5mvYqyjMH4XyetufLgJPTMOhbCRio5ZY5CF9x2Zn4LC0Jubw25ZRfofo4uxlzlU0ogD2e+9VVHIvzfvucrTOoMlbvHn2ukTpCvjbiqr40yUUyOA=="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:04.492319 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-d7346582-a7a0-42c2-b70c-23f6e6fe1d4c tempest-KeyPairsV210TestJSON-739387413 tempest-KeyPairsV210TestJSON-739387413-project-admin] Getting quotas for project 55693239bb044861b4aed00b0e499226. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:39:04.509870 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-d7346582-a7a0-42c2-b70c-23f6e6fe1d4c tempest-KeyPairsV210TestJSON-739387413 tempest-KeyPairsV210TestJSON-739387413-project-admin] Getting quotas for user c210af997a9e43679b8cc6efa511c84f and project 55693239bb044861b4aed00b0e499226. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:39:04.550105 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d7346582-a7a0-42c2-b70c-23f6e6fe1d4c tempest-KeyPairsV210TestJSON-739387413 tempest-KeyPairsV210TestJSON-739387413-project-admin] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.545057 Sep 10 11:39:04.559776 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 176/363] 10.222.0.23 () {62 vars in 1200 bytes} [Sat Sep 10 11:39:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 557 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 10 11:39:04.566446 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-430bdda0-cada-450d-b202-cef5848a21d5 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:04.567381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-430bdda0-cada-450d-b202-cef5848a21d5 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] [instance: 966031ed-9a06-4a3d-92f7-96adcfa7e364] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:04.573812 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-430bdda0-cada-450d-b202-cef5848a21d5 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:04.574609 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-430bdda0-cada-450d-b202-cef5848a21d5 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:04.575296 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-430bdda0-cada-450d-b202-cef5848a21d5 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:04.576200 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-430bdda0-cada-450d-b202-cef5848a21d5 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:04.576844 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-430bdda0-cada-450d-b202-cef5848a21d5 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:04.577459 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-430bdda0-cada-450d-b202-cef5848a21d5 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:04.995657 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-430bdda0-cada-450d-b202-cef5848a21d5 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c91799a8724c499cd1afe82e3fd657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95726b0caac4b7fb5f0db90d268430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:05.011683 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-430bdda0-cada-450d-b202-cef5848a21d5 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] 10.222.0.23 "GET /compute/v2.1/servers/966031ed-9a06-4a3d-92f7-96adcfa7e364" status: 200 len: 1321 microversion: 2.1 time: 0.445125 Sep 10 11:39:05.018669 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 177/364] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:04 2022] GET /compute/v2.1/servers/966031ed-9a06-4a3d-92f7-96adcfa7e364 => generated 1321 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:05.028030 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6b6f379d-94f5-4799-8681-2216b2398cf7 tempest-KeyPairsV210TestJSON-739387413 tempest-KeyPairsV210TestJSON-739387413-project-admin] Action: 'create', calling method: .version_select at 0x7f4073f37ee0>, body: {"keypair": {"name": "tempest-keypair-1414657107", "type": "ssh", "user_id": "2b82bc328e9c4fe7a4b200ab11681342", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIDrftS368ulUaQnLsbEwS+jojhanzxbN6jPIS7+24/7VS378t4wbFbnk9AOtzv3MDA7jlc9z8aCuRoq6CM0cJH6jplyxtuvtxOP1cay+tUOxl1/MvlNRml3CSYw2P7ig=="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:05.100758 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-6b6f379d-94f5-4799-8681-2216b2398cf7 tempest-KeyPairsV210TestJSON-739387413 tempest-KeyPairsV210TestJSON-739387413-project-admin] Getting quotas for project 55693239bb044861b4aed00b0e499226. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:39:05.124517 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-6b6f379d-94f5-4799-8681-2216b2398cf7 tempest-KeyPairsV210TestJSON-739387413 tempest-KeyPairsV210TestJSON-739387413-project-admin] Getting quotas for user c210af997a9e43679b8cc6efa511c84f and project 55693239bb044861b4aed00b0e499226. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:39:05.156964 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=10 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:39:05.202104 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6b6f379d-94f5-4799-8681-2216b2398cf7 tempest-KeyPairsV210TestJSON-739387413 tempest-KeyPairsV210TestJSON-739387413-project-admin] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.181678 Sep 10 11:39:05.203398 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 178/365] 10.222.0.23 () {62 vars in 1200 bytes} [Sat Sep 10 11:39:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 184 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 10 11:39:05.209561 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-55082f15-bde7-4295-b69b-1d7c0c24e71e tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:05.212917 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-55082f15-bde7-4295-b69b-1d7c0c24e71e tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 810c2316-10c5-47b4-9118-0298629d94e1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:05.225230 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55082f15-bde7-4295-b69b-1d7c0c24e71e tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:05.227745 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55082f15-bde7-4295-b69b-1d7c0c24e71e tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:05.230138 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55082f15-bde7-4295-b69b-1d7c0c24e71e tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:05.231046 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55082f15-bde7-4295-b69b-1d7c0c24e71e tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:05.234761 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55082f15-bde7-4295-b69b-1d7c0c24e71e tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:05.235410 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55082f15-bde7-4295-b69b-1d7c0c24e71e tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:05.572949 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-55082f15-bde7-4295-b69b-1d7c0c24e71e tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b632d0a5ac48fea0da5aa15632cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a040213a0ea443cd97b346b0d4e79d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:05.586885 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-55082f15-bde7-4295-b69b-1d7c0c24e71e tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/810c2316-10c5-47b4-9118-0298629d94e1" status: 200 len: 1469 microversion: 2.1 time: 0.382130 Sep 10 11:39:05.587827 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 179/366] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:05 2022] GET /compute/v2.1/servers/810c2316-10c5-47b4-9118-0298629d94e1 => generated 1469 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:05.616921 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-828d88df-f837-431e-abaf-df5ab711adcc tempest-KeyPairsV210TestJSON-739387413 tempest-KeyPairsV210TestJSON-739387413-project-admin] Calling method '.version_select at 0x7f4073cda9d0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:05.628453 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-828d88df-f837-431e-abaf-df5ab711adcc tempest-KeyPairsV210TestJSON-739387413 tempest-KeyPairsV210TestJSON-739387413-project-admin] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-1247177623?user_id=2b82bc328e9c4fe7a4b200ab11681342" status: 200 len: 512 microversion: 2.10 time: 0.017475 Sep 10 11:39:05.629650 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 180/367] 10.222.0.23 () {60 vars in 1340 bytes} [Sat Sep 10 11:39:05 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1247177623?user_id=2b82bc328e9c4fe7a4b200ab11681342 => generated 512 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:39:05.634704 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c1c6d92c-7a63-4efe-9e18-ef841351cb4b tempest-DeleteServersAdminTestJSON-685079201 tempest-DeleteServersAdminTestJSON-685079201-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:05.637569 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c1c6d92c-7a63-4efe-9e18-ef841351cb4b tempest-DeleteServersAdminTestJSON-685079201 tempest-DeleteServersAdminTestJSON-685079201-project-admin] [instance: 810c2316-10c5-47b4-9118-0298629d94e1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:05.645451 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1c6d92c-7a63-4efe-9e18-ef841351cb4b tempest-DeleteServersAdminTestJSON-685079201 tempest-DeleteServersAdminTestJSON-685079201-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:05.646119 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1c6d92c-7a63-4efe-9e18-ef841351cb4b tempest-DeleteServersAdminTestJSON-685079201 tempest-DeleteServersAdminTestJSON-685079201-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:05.646714 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1c6d92c-7a63-4efe-9e18-ef841351cb4b tempest-DeleteServersAdminTestJSON-685079201 tempest-DeleteServersAdminTestJSON-685079201-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:05.647700 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1c6d92c-7a63-4efe-9e18-ef841351cb4b tempest-DeleteServersAdminTestJSON-685079201 tempest-DeleteServersAdminTestJSON-685079201-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:05.648406 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1c6d92c-7a63-4efe-9e18-ef841351cb4b tempest-DeleteServersAdminTestJSON-685079201 tempest-DeleteServersAdminTestJSON-685079201-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:05.648981 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1c6d92c-7a63-4efe-9e18-ef841351cb4b tempest-DeleteServersAdminTestJSON-685079201 tempest-DeleteServersAdminTestJSON-685079201-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:05.944708 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c1c6d92c-7a63-4efe-9e18-ef841351cb4b tempest-DeleteServersAdminTestJSON-685079201 tempest-DeleteServersAdminTestJSON-685079201-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/810c2316-10c5-47b4-9118-0298629d94e1/action" status: 202 len: 0 microversion: 2.1 time: 0.313611 Sep 10 11:39:05.949051 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 181/368] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:39:05 2022] POST /compute/v2.1/servers/810c2316-10c5-47b4-9118-0298629d94e1/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:39:05.958735 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-31172908-dbd1-44dc-af35-585c7087be1f tempest-KeyPairsV210TestJSON-739387413 tempest-KeyPairsV210TestJSON-739387413-project-admin] Action: 'create', calling method: .version_select at 0x7f4073f37b80>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-405665636", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQk9/dkeUOEmZUkvunTjj+PCJu/OzMpfjEqzL1QM9Ucrv7ExpNo8kDnjFsfIeGzUekQMgV/Roe6koKhO0pAIVlRwKXw3DHp8Qoends9th6qDjYDLEgSxw78HLVnz+axeg=="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:05.991215 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-31172908-dbd1-44dc-af35-585c7087be1f tempest-KeyPairsV210TestJSON-739387413 tempest-KeyPairsV210TestJSON-739387413-project-admin] Getting quotas for project 55693239bb044861b4aed00b0e499226. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:39:05.996123 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-31172908-dbd1-44dc-af35-585c7087be1f tempest-KeyPairsV210TestJSON-739387413 tempest-KeyPairsV210TestJSON-739387413-project-admin] Getting quotas for user c210af997a9e43679b8cc6efa511c84f and project 55693239bb044861b4aed00b0e499226. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:39:06.048902 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-31172908-dbd1-44dc-af35-585c7087be1f tempest-KeyPairsV210TestJSON-739387413 tempest-KeyPairsV210TestJSON-739387413-project-admin] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.099419 Sep 10 11:39:06.051944 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 182/369] 10.222.0.23 () {62 vars in 1200 bytes} [Sat Sep 10 11:39:05 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 104 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 10 11:39:06.057904 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dd1e9a4a-e107-43bf-8a84-d736f686cbb7 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:06.058913 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-dd1e9a4a-e107-43bf-8a84-d736f686cbb7 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 810c2316-10c5-47b4-9118-0298629d94e1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:06.068483 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dd1e9a4a-e107-43bf-8a84-d736f686cbb7 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:06.069458 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dd1e9a4a-e107-43bf-8a84-d736f686cbb7 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:06.070046 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dd1e9a4a-e107-43bf-8a84-d736f686cbb7 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:06.072268 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dd1e9a4a-e107-43bf-8a84-d736f686cbb7 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:06.073192 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dd1e9a4a-e107-43bf-8a84-d736f686cbb7 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:06.073773 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dd1e9a4a-e107-43bf-8a84-d736f686cbb7 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:06.157136 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dd1e9a4a-e107-43bf-8a84-d736f686cbb7 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:06.159334 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dd1e9a4a-e107-43bf-8a84-d736f686cbb7 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:06.161634 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dd1e9a4a-e107-43bf-8a84-d736f686cbb7 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:06.162469 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-dd1e9a4a-e107-43bf-8a84-d736f686cbb7 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lazy-loading 'fault' on Instance uuid 810c2316-10c5-47b4-9118-0298629d94e1 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:39:06.511385 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-dd1e9a4a-e107-43bf-8a84-d736f686cbb7 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b632d0a5ac48fea0da5aa15632cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a040213a0ea443cd97b346b0d4e79d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:06.523997 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-dd1e9a4a-e107-43bf-8a84-d736f686cbb7 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/810c2316-10c5-47b4-9118-0298629d94e1" status: 200 len: 1452 microversion: 2.1 time: 0.470254 Sep 10 11:39:06.526007 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 183/370] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:06 2022] GET /compute/v2.1/servers/810c2316-10c5-47b4-9118-0298629d94e1 => generated 1452 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:06.563761 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7b425c2d-7c8d-4ff7-9723-9b9ac3e5f638 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:06.564724 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7b425c2d-7c8d-4ff7-9723-9b9ac3e5f638 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] [instance: 966031ed-9a06-4a3d-92f7-96adcfa7e364] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:06.584784 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7b425c2d-7c8d-4ff7-9723-9b9ac3e5f638 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:06.585992 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7b425c2d-7c8d-4ff7-9723-9b9ac3e5f638 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:06.586444 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7b425c2d-7c8d-4ff7-9723-9b9ac3e5f638 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:06.587204 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7b425c2d-7c8d-4ff7-9723-9b9ac3e5f638 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:06.603239 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7b425c2d-7c8d-4ff7-9723-9b9ac3e5f638 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:06.603735 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7b425c2d-7c8d-4ff7-9723-9b9ac3e5f638 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:06.809195 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f23835f7-d4f2-45da-9e88-810e848353b5 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f/action" status: 202 len: 0 microversion: 2.1 time: 5.353215 Sep 10 11:39:06.814781 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 188/371] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:39:01 2022] POST /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f/action => generated 0 bytes in 5360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:39:06.822766 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-13657a62-921e-41d2-8c50-6dea892eac0d tempest-KeyPairsV210TestJSON-739387413 tempest-KeyPairsV210TestJSON-739387413-project-admin] Calling method '.version_select at 0x7f4073ae1040>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:06.828837 n-d-856895-1 devstack@n-api.service[128777]: WARNING oslo_db.sqlalchemy.utils [None req-13657a62-921e-41d2-8c50-6dea892eac0d tempest-KeyPairsV210TestJSON-739387413 tempest-KeyPairsV210TestJSON-739387413-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Sep 10 11:39:06.885626 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-13657a62-921e-41d2-8c50-6dea892eac0d tempest-KeyPairsV210TestJSON-739387413 tempest-KeyPairsV210TestJSON-739387413-project-admin] 10.222.0.23 "GET /compute/v2.1/os-keypairs?user_id=2b82bc328e9c4fe7a4b200ab11681342" status: 200 len: 726 microversion: 2.10 time: 0.068768 Sep 10 11:39:06.888754 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 189/372] 10.222.0.23 () {60 vars in 1259 bytes} [Sat Sep 10 11:39:06 2022] GET /compute/v2.1/os-keypairs?user_id=2b82bc328e9c4fe7a4b200ab11681342 => generated 726 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:39:07.028714 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7b425c2d-7c8d-4ff7-9723-9b9ac3e5f638 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c91799a8724c499cd1afe82e3fd657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95726b0caac4b7fb5f0db90d268430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:07.040893 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7b425c2d-7c8d-4ff7-9723-9b9ac3e5f638 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] 10.222.0.23 "GET /compute/v2.1/servers/966031ed-9a06-4a3d-92f7-96adcfa7e364" status: 200 len: 1321 microversion: 2.1 time: 0.513101 Sep 10 11:39:07.049195 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 184/373] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:06 2022] GET /compute/v2.1/servers/966031ed-9a06-4a3d-92f7-96adcfa7e364 => generated 1321 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:07.058340 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-17e1aa94-ff7e-40e8-96b7-aeeda8b37487 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:07.059006 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-17e1aa94-ff7e-40e8-96b7-aeeda8b37487 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 810c2316-10c5-47b4-9118-0298629d94e1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:07.068504 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17e1aa94-ff7e-40e8-96b7-aeeda8b37487 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:07.069460 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17e1aa94-ff7e-40e8-96b7-aeeda8b37487 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:07.070464 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17e1aa94-ff7e-40e8-96b7-aeeda8b37487 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:07.071568 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17e1aa94-ff7e-40e8-96b7-aeeda8b37487 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:07.072194 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17e1aa94-ff7e-40e8-96b7-aeeda8b37487 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:07.072778 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17e1aa94-ff7e-40e8-96b7-aeeda8b37487 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:07.100838 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:39:07.116820 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-17e1aa94-ff7e-40e8-96b7-aeeda8b37487 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 810c2316-10c5-47b4-9118-0298629d94e1] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:39:07.343375 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5916a653-e360-4fad-8354-82a68bd2a28e tempest-QuotasAdminTestV236-1114939437 tempest-QuotasAdminTestV236-1114939437-project-admin] Action: 'update', calling method: .version_select at 0x7f40738353a0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:07.450977 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-17e1aa94-ff7e-40e8-96b7-aeeda8b37487 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "DELETE /compute/v2.1/servers/810c2316-10c5-47b4-9118-0298629d94e1" status: 204 len: 0 microversion: 2.1 time: 0.397509 Sep 10 11:39:07.455925 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 185/374] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:39:07 2022] DELETE /compute/v2.1/servers/810c2316-10c5-47b4-9118-0298629d94e1 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:39:07.475214 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-85009d3c-05df-444d-9ee8-58a0ee8a21e1 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:07.475963 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-85009d3c-05df-444d-9ee8-58a0ee8a21e1 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:07.485557 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85009d3c-05df-444d-9ee8-58a0ee8a21e1 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:07.486065 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85009d3c-05df-444d-9ee8-58a0ee8a21e1 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:07.486514 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85009d3c-05df-444d-9ee8-58a0ee8a21e1 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:07.488113 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85009d3c-05df-444d-9ee8-58a0ee8a21e1 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:07.488678 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85009d3c-05df-444d-9ee8-58a0ee8a21e1 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:07.489125 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85009d3c-05df-444d-9ee8-58a0ee8a21e1 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:07.664642 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=14 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:39:07.702356 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5916a653-e360-4fad-8354-82a68bd2a28e tempest-QuotasAdminTestV236-1114939437 tempest-QuotasAdminTestV236-1114939437-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:07.703412 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5916a653-e360-4fad-8354-82a68bd2a28e tempest-QuotasAdminTestV236-1114939437 tempest-QuotasAdminTestV236-1114939437-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:07.704218 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5916a653-e360-4fad-8354-82a68bd2a28e tempest-QuotasAdminTestV236-1114939437 tempest-QuotasAdminTestV236-1114939437-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:07.705231 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5916a653-e360-4fad-8354-82a68bd2a28e tempest-QuotasAdminTestV236-1114939437 tempest-QuotasAdminTestV236-1114939437-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:07.706393 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5916a653-e360-4fad-8354-82a68bd2a28e tempest-QuotasAdminTestV236-1114939437 tempest-QuotasAdminTestV236-1114939437-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:07.706921 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5916a653-e360-4fad-8354-82a68bd2a28e tempest-QuotasAdminTestV236-1114939437 tempest-QuotasAdminTestV236-1114939437-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:07.767617 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-85009d3c-05df-444d-9ee8-58a0ee8a21e1 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:07.779747 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-85009d3c-05df-444d-9ee8-58a0ee8a21e1 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f" status: 200 len: 1504 microversion: 2.1 time: 0.324610 Sep 10 11:39:07.780341 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 186/375] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:07 2022] GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f => generated 1504 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:07.787421 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3e88c229-75e6-4163-8f31-0de3f31c1796 tempest-KeyPairsV210TestJSON-739387413 tempest-KeyPairsV210TestJSON-739387413-project-admin] Calling method '.version_select at 0x7f4073cda280>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:07.803212 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5916a653-e360-4fad-8354-82a68bd2a28e tempest-QuotasAdminTestV236-1114939437 tempest-QuotasAdminTestV236-1114939437-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/489a3ee44eb045fab6b42f0d237e86ff" status: 200 len: 240 microversion: 2.36 time: 0.913300 Sep 10 11:39:07.804590 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 190/376] 10.222.0.23 () {62 vars in 1303 bytes} [Sat Sep 10 11:39:06 2022] PUT /compute/v2.1/os-quota-sets/489a3ee44eb045fab6b42f0d237e86ff => generated 240 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:39:07.809604 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-98962d46-62d5-4e7d-b087-e90b930630e9 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:07.810239 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-98962d46-62d5-4e7d-b087-e90b930630e9 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 810c2316-10c5-47b4-9118-0298629d94e1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:07.817026 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98962d46-62d5-4e7d-b087-e90b930630e9 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:07.817767 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98962d46-62d5-4e7d-b087-e90b930630e9 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:07.818234 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98962d46-62d5-4e7d-b087-e90b930630e9 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:07.818944 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98962d46-62d5-4e7d-b087-e90b930630e9 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:07.819425 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98962d46-62d5-4e7d-b087-e90b930630e9 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:07.819853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98962d46-62d5-4e7d-b087-e90b930630e9 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:07.820979 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3e88c229-75e6-4163-8f31-0de3f31c1796 tempest-KeyPairsV210TestJSON-739387413 tempest-KeyPairsV210TestJSON-739387413-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-405665636" status: 204 len: 0 microversion: 2.10 time: 0.039550 Sep 10 11:39:07.822726 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 187/377] 10.222.0.23 () {60 vars in 1322 bytes} [Sat Sep 10 11:39:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-405665636 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 11:39:07.829929 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-08305971-6659-4fcd-b8cc-b763f843e346 req-e13593f2-c73d-46a8-a059-dc4e9e9cd5a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "966031ed-9a06-4a3d-92f7-96adcfa7e364", "name": "network-vif-plugged", "status": "completed", "tag": "cf4f7adf-c397-437b-b09a-56569661c04f"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:07.840863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-08305971-6659-4fcd-b8cc-b763f843e346 req-e13593f2-c73d-46a8-a059-dc4e9e9cd5a0 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:07.841352 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-08305971-6659-4fcd-b8cc-b763f843e346 req-e13593f2-c73d-46a8-a059-dc4e9e9cd5a0 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:07.841790 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-08305971-6659-4fcd-b8cc-b763f843e346 req-e13593f2-c73d-46a8-a059-dc4e9e9cd5a0 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:07.855872 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-08305971-6659-4fcd-b8cc-b763f843e346 req-e13593f2-c73d-46a8-a059-dc4e9e9cd5a0 service nova] Creating event network-vif-plugged:cf4f7adf-c397-437b-b09a-56569661c04f for instance 966031ed-9a06-4a3d-92f7-96adcfa7e364 on n-h2-856895-1 Sep 10 11:39:07.864285 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98962d46-62d5-4e7d-b087-e90b930630e9 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:07.865023 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98962d46-62d5-4e7d-b087-e90b930630e9 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:07.865635 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98962d46-62d5-4e7d-b087-e90b930630e9 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:07.866362 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-98962d46-62d5-4e7d-b087-e90b930630e9 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lazy-loading 'fault' on Instance uuid 810c2316-10c5-47b4-9118-0298629d94e1 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:39:07.867286 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-08305971-6659-4fcd-b8cc-b763f843e346 req-e13593f2-c73d-46a8-a059-dc4e9e9cd5a0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042616 Sep 10 11:39:07.867910 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 188/378] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:39:08.019500 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3d4ffec9-9341-42b9-84ae-20887acd2f0b tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1438697343", "id": 1661620728, "os-flavor-access:is_public": "False"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:08.026756 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-98962d46-62d5-4e7d-b087-e90b930630e9 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b632d0a5ac48fea0da5aa15632cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a040213a0ea443cd97b346b0d4e79d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:08.042225 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-98962d46-62d5-4e7d-b087-e90b930630e9 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/810c2316-10c5-47b4-9118-0298629d94e1" status: 200 len: 1458 microversion: 2.1 time: 0.235953 Sep 10 11:39:08.042710 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3d4ffec9-9341-42b9-84ae-20887acd2f0b tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.169282 Sep 10 11:39:08.043109 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 191/379] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:07 2022] GET /compute/v2.1/servers/810c2316-10c5-47b4-9118-0298629d94e1 => generated 1458 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:08.052462 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 189/380] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:39:07 2022] POST /compute/v2.1/flavors => generated 439 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:39:08.053024 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4221a49f-2fbd-4297-9abc-e585c2f569ee tempest-QuotasAdminTestV236-1114939437 tempest-QuotasAdminTestV236-1114939437-project-admin] Calling method '.version_select at 0x7f407383a310>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:08.071950 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2128b765-42c0-4a52-a630-05b245762513 tempest-KeyPairsV210TestJSON-739387413 tempest-KeyPairsV210TestJSON-739387413-project-admin] Calling method '.version_select at 0x7f4073c14670>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:08.092569 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2128b765-42c0-4a52-a630-05b245762513 tempest-KeyPairsV210TestJSON-739387413 tempest-KeyPairsV210TestJSON-739387413-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1414657107?user_id=2b82bc328e9c4fe7a4b200ab11681342" status: 204 len: 0 microversion: 2.10 time: 0.038965 Sep 10 11:39:08.093164 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 190/381] 10.222.0.23 () {60 vars in 1343 bytes} [Sat Sep 10 11:39:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1414657107?user_id=2b82bc328e9c4fe7a4b200ab11681342 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 11:39:08.127095 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4221a49f-2fbd-4297-9abc-e585c2f569ee tempest-QuotasAdminTestV236-1114939437 tempest-QuotasAdminTestV236-1114939437-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:08.128191 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4221a49f-2fbd-4297-9abc-e585c2f569ee tempest-QuotasAdminTestV236-1114939437 tempest-QuotasAdminTestV236-1114939437-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:08.128633 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4221a49f-2fbd-4297-9abc-e585c2f569ee tempest-QuotasAdminTestV236-1114939437 tempest-QuotasAdminTestV236-1114939437-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:08.129360 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4221a49f-2fbd-4297-9abc-e585c2f569ee tempest-QuotasAdminTestV236-1114939437 tempest-QuotasAdminTestV236-1114939437-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:08.130125 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4221a49f-2fbd-4297-9abc-e585c2f569ee tempest-QuotasAdminTestV236-1114939437 tempest-QuotasAdminTestV236-1114939437-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:08.131138 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4221a49f-2fbd-4297-9abc-e585c2f569ee tempest-QuotasAdminTestV236-1114939437 tempest-QuotasAdminTestV236-1114939437-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:08.152881 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4221a49f-2fbd-4297-9abc-e585c2f569ee tempest-QuotasAdminTestV236-1114939437 tempest-QuotasAdminTestV236-1114939437-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/489a3ee44eb045fab6b42f0d237e86ff/detail" status: 200 len: 672 microversion: 2.36 time: 0.107914 Sep 10 11:39:08.153498 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 192/382] 10.222.0.23 () {60 vars in 1304 bytes} [Sat Sep 10 11:39:08 2022] GET /compute/v2.1/os-quota-sets/489a3ee44eb045fab6b42f0d237e86ff/detail => generated 672 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:39:08.159193 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4e3e398c-d9e2-4b94-aaca-c64aa0844872 tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "d23f676a57d24e7b9722520d8db65258"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:08.180682 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b8dec9db-9c42-4837-892e-de7a6dd4b0f3 tempest-FloatingIPsNegativeTestJSON-938908274 tempest-FloatingIPsNegativeTestJSON-938908274-project] Calling method '.version_select at 0x7f4073ef6040>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:08.251157 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b8dec9db-9c42-4837-892e-de7a6dd4b0f3 tempest-FloatingIPsNegativeTestJSON-938908274 tempest-FloatingIPsNegativeTestJSON-938908274-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.156937 Sep 10 11:39:08.252085 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 191/383] 10.222.0.23 () {58 vars in 1149 bytes} [Sat Sep 10 11:39:08 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:39:08.257220 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-775b7779-38b2-4409-9160-332de04a4e2b tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:08.258141 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-775b7779-38b2-4409-9160-332de04a4e2b tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] [instance: 966031ed-9a06-4a3d-92f7-96adcfa7e364] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:08.265626 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-775b7779-38b2-4409-9160-332de04a4e2b tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:08.266244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-775b7779-38b2-4409-9160-332de04a4e2b tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:08.266776 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-775b7779-38b2-4409-9160-332de04a4e2b tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:08.267611 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-775b7779-38b2-4409-9160-332de04a4e2b tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:08.268296 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-775b7779-38b2-4409-9160-332de04a4e2b tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:08.268802 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-775b7779-38b2-4409-9160-332de04a4e2b tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:08.276067 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4e3e398c-d9e2-4b94-aaca-c64aa0844872 tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1661620728/action" status: 200 len: 97 microversion: 2.1 time: 0.120805 Sep 10 11:39:08.276664 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 193/384] 10.222.0.23 () {60 vars in 1200 bytes} [Sat Sep 10 11:39:08 2022] POST /compute/v2.1/flavors/1661620728/action => generated 97 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:39:08.281224 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-733da4f4-9c97-47ce-b9d5-25db5ecf8121 tempest-KeyPairsV210TestJSON-739387413 tempest-KeyPairsV210TestJSON-739387413-project-admin] Calling method '.version_select at 0x7f4073842dc0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:08.306589 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-733da4f4-9c97-47ce-b9d5-25db5ecf8121 tempest-KeyPairsV210TestJSON-739387413 tempest-KeyPairsV210TestJSON-739387413-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1247177623?user_id=2b82bc328e9c4fe7a4b200ab11681342" status: 204 len: 0 microversion: 2.10 time: 0.028110 Sep 10 11:39:08.306857 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 194/385] 10.222.0.23 () {60 vars in 1343 bytes} [Sat Sep 10 11:39:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1247177623?user_id=2b82bc328e9c4fe7a4b200ab11681342 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 11:39:08.318137 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b9c4e893-c458-46f4-9141-6506f5222be6 tempest-FloatingIPsNegativeTestJSON-938908274 tempest-FloatingIPsNegativeTestJSON-938908274-project] Action: 'create', calling method: .version_select at 0x7f40738daee0>, body: {"pool": "non_exist_pool"} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:08.381061 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-b9c4e893-c458-46f4-9141-6506f5222be6 tempest-FloatingIPsNegativeTestJSON-938908274 tempest-FloatingIPsNegativeTestJSON-938908274-project] HTTP exception thrown: Floating IP pool not found. Sep 10 11:39:08.384748 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b9c4e893-c458-46f4-9141-6506f5222be6 tempest-FloatingIPsNegativeTestJSON-938908274 tempest-FloatingIPsNegativeTestJSON-938908274-project] Request method failure captured: Sep 10 11:39:08.384748 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Sep 10 11:39:08.384748 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:39:08.384748 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:39:08.384748 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:39:08.384748 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 26 Sep 10 11:39:08.384748 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:39:08.384748 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:39:08.384748 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:39:08.384748 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:39:08.384748 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHdbQxjBjASgXWjItUl2PdUXL0QI30IJE6a1PPluCOSOtoGVgkUazJ75IRFkTwq2XStHrEQOAvyfeRZitxafkC04F8LJUw86Gkp_s3EDKeZ_1ZsXdzOVpDowiZdeXvybGEYBRgoEaU0g96AInxilqEGS9wJZZJlU7GEHF7Hnl_taDNQ Sep 10 11:39:08.384748 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:39:08.384748 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:39:08.384748 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:39:08.384748 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:39:08.384748 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:39:08.384748 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:39:08.384748 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 9a152b598d8b4d31aae30676af3a1f7f Sep 10 11:39:08.384748 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-938908274 Sep 10 11:39:08.384748 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:39:08.384748 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:39:08.386224 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9a152b598d8b4d31aae30676af3a1f7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9a152b598d8b4d31aae30676af3a1f7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9a152b598d8b4d31aae30676af3a1f7f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9a152b598d8b4d31aae30676af3a1f7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:39:08.386224 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-938908274 Sep 10 11:39:08.386224 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 9a152b598d8b4d31aae30676af3a1f7f Sep 10 11:39:08.386224 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-938908274 Sep 10 11:39:08.386224 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-FloatingIPsNegativeTestJSON-938908274-project Sep 10 11:39:08.386224 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:39:08.386224 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:39:08.386224 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 43c4531c988c4c6ab807cd31d7d0ab3b Sep 10 11:39:08.386224 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-938908274-project Sep 10 11:39:08.386224 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:39:08.386224 n-d-856895-1 devstack@n-api.service[128777]: {"pool": "non_exist_pool"} Sep 10 11:39:08.386224 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:39:08.386224 n-d-856895-1 devstack@n-api.service[128777]: exception: Floating IP pool not found. Sep 10 11:39:08.386224 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'body': {'pool': 'non_exist_pool'}} Sep 10 11:39:08.386224 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:39:08.387635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:08.387635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Sep 10 11:39:08.387635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Sep 10 11:39:08.387635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Sep 10 11:39:08.387635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Sep 10 11:39:08.387635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Sep 10 11:39:08.387635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Sep 10 11:39:08.387635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Sep 10 11:39:08.387635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:08.387635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:08.387635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:08.387635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:08.387635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:08.387635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:08.387635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:39:08.387635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:39:08.387635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:39:08.387635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:39:08.387635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:39:08.387635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:39:08.388779 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Sep 10 11:39:08.388779 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:39:08.388779 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Sep 10 11:39:08.388779 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:08.388779 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:08.388779 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:08.388779 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:08.388779 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:08.388779 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:08.388779 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:39:08.388779 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:39:08.388779 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Sep 10 11:39:08.388779 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:08.388779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b9c4e893-c458-46f4-9141-6506f5222be6 tempest-FloatingIPsNegativeTestJSON-938908274 tempest-FloatingIPsNegativeTestJSON-938908274-project] Returning 404 to user: Floating IP pool not found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:39:08.388779 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b9c4e893-c458-46f4-9141-6506f5222be6 tempest-FloatingIPsNegativeTestJSON-938908274 tempest-FloatingIPsNegativeTestJSON-938908274-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.078427 Sep 10 11:39:08.389608 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 195/386] 10.222.0.23 () {60 vars in 1170 bytes} [Sat Sep 10 11:39:08 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:39:08.394990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c9906afd-ec1f-41c0-a90c-c04ffdd4bb25 tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "d23f676a57d24e7b9722520d8db65258"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:08.465600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-775b7779-38b2-4409-9160-332de04a4e2b tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c91799a8724c499cd1afe82e3fd657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95726b0caac4b7fb5f0db90d268430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:08.466125 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-c9906afd-ec1f-41c0-a90c-c04ffdd4bb25 tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] HTTP exception thrown: Flavor access already exists for flavor 33 and project d23f676a57d24e7b9722520d8db65258 combination. Sep 10 11:39:08.469487 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c9906afd-ec1f-41c0-a90c-c04ffdd4bb25 tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] Request method failure captured: Sep 10 11:39:08.469487 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/flavors/1661620728/action HTTP/1.1 Sep 10 11:39:08.469487 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:39:08.469487 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:39:08.469487 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:39:08.469487 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 67 Sep 10 11:39:08.469487 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:39:08.469487 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:39:08.469487 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:39:08.469487 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:39:08.469487 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHdaC14shzqtHSSxic-KrmYbsZj4TZ2P8a9VIEi9MkHqsFuKKfS2ftn5J_t80nrxvGWoa7W3T4GFoVfMFAB0uO8uWQUfBZfbeSHYJnSqRjhTGaEbfuzXOnhWB4L_DFulaSchC5zgfBL6EJD34CE8PgLyGHUgqecC_MPgi5ff_MNQqmw Sep 10 11:39:08.469487 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:39:08.469487 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:39:08.469487 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:39:08.469487 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:39:08.469487 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:39:08.469487 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:39:08.469487 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: b6964506f7d64a76bfba5b83826b79ee Sep 10 11:39:08.469487 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-637372514 Sep 10 11:39:08.469487 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,admin,member Sep 10 11:39:08.469487 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,admin,member Sep 10 11:39:08.471110 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b6964506f7d64a76bfba5b83826b79ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b6964506f7d64a76bfba5b83826b79ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b6964506f7d64a76bfba5b83826b79ee", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b6964506f7d64a76bfba5b83826b79ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:39:08.471110 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-637372514 Sep 10 11:39:08.471110 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: b6964506f7d64a76bfba5b83826b79ee Sep 10 11:39:08.471110 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-637372514 Sep 10 11:39:08.471110 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin Sep 10 11:39:08.471110 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:39:08.471110 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:39:08.471110 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 301076575a9047d59731ffcd2ad99759 Sep 10 11:39:08.471110 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin Sep 10 11:39:08.471110 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:39:08.471110 n-d-856895-1 devstack@n-api.service[128777]: {"addTenantAccess": {"tenant": "d23f676a57d24e7b9722520d8db65258"}} Sep 10 11:39:08.471110 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:39:08.472810 n-d-856895-1 devstack@n-api.service[128777]: exception: Flavor access already exists for flavor 33 and project d23f676a57d24e7b9722520d8db65258 combination. Sep 10 11:39:08.472810 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '1661620728', 'body': {'addTenantAccess': {'tenant': 'd23f676a57d24e7b9722520d8db65258'}}} Sep 10 11:39:08.472810 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:39:08.472810 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:08.472810 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 10 11:39:08.472810 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 10 11:39:08.472810 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 10 11:39:08.472810 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 10 11:39:08.472810 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 10 11:39:08.472810 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 10 11:39:08.472810 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 10 11:39:08.472810 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 10 11:39:08.472810 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 10 11:39:08.472810 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 10 11:39:08.472810 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 10 11:39:08.472810 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result.read() Sep 10 11:39:08.472810 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 10 11:39:08.472810 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 10 11:39:08.473930 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 10 11:39:08.473930 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 10 11:39:08.473930 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 10 11:39:08.473930 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 10 11:39:08.473930 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 10 11:39:08.473930 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 10 11:39:08.473930 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '33-d23f676a57d24e7b9722520d8db65258' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 10 11:39:08.473930 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:08.473930 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 10 11:39:08.473930 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:08.473930 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:08.473930 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Sep 10 11:39:08.473930 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi project.save(context.session) Sep 10 11:39:08.473930 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 10 11:39:08.473930 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi session.flush() Sep 10 11:39:08.473930 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 10 11:39:08.473930 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 10 11:39:08.473930 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 10 11:39:08.473930 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 10 11:39:08.475068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 10 11:39:08.475068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 10 11:39:08.475068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 10 11:39:08.475068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception Sep 10 11:39:08.475068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 10 11:39:08.475068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 10 11:39:08.475068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 10 11:39:08.475068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 10 11:39:08.475068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 10 11:39:08.475068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 10 11:39:08.475068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 10 11:39:08.475068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 10 11:39:08.475068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 10 11:39:08.475068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 10 11:39:08.475068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 10 11:39:08.475068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 10 11:39:08.475068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 10 11:39:08.475068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 10 11:39:08.476159 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 10 11:39:08.476159 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 10 11:39:08.476159 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 10 11:39:08.476159 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 10 11:39:08.476159 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 10 11:39:08.476159 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 10 11:39:08.476159 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 10 11:39:08.476159 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception Sep 10 11:39:08.476159 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 10 11:39:08.476159 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 10 11:39:08.476159 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 10 11:39:08.476159 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 10 11:39:08.476159 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 10 11:39:08.476159 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 10 11:39:08.476159 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 10 11:39:08.476159 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 10 11:39:08.476159 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 10 11:39:08.476159 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 10 11:39:08.477380 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 10 11:39:08.477380 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result.read() Sep 10 11:39:08.477380 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 10 11:39:08.477380 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 10 11:39:08.477380 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 10 11:39:08.477380 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 10 11:39:08.477380 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 10 11:39:08.477380 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 10 11:39:08.477380 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 10 11:39:08.477380 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 10 11:39:08.477380 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '33-d23f676a57d24e7b9722520d8db65258' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 10 11:39:08.477380 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Sep 10 11:39:08.477380 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 10, 11, 39, 8, 460515), 'updated_at': None, 'flavor_id': 33, 'project_id': 'd23f676a57d24e7b9722520d8db65258'}] Sep 10 11:39:08.477380 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 10 11:39:08.477380 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:08.477380 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:08.477380 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:08.478556 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:08.478556 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Sep 10 11:39:08.478556 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Sep 10 11:39:08.478556 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 10 11:39:08.478556 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 10 11:39:08.478556 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Sep 10 11:39:08.478556 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Sep 10 11:39:08.478556 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Sep 10 11:39:08.478556 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Sep 10 11:39:08.478556 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Sep 10 11:39:08.478556 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Sep 10 11:39:08.478556 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 11:39:08.478556 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 11:39:08.478556 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Sep 10 11:39:08.478556 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Sep 10 11:39:08.478556 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 33 and project d23f676a57d24e7b9722520d8db65258 combination. Sep 10 11:39:08.478556 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:08.478556 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:08.478556 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:08.479803 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:08.479803 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:08.479803 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:08.479803 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:39:08.479803 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:39:08.479803 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:39:08.479803 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:39:08.479803 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:39:08.479803 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:39:08.479803 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Sep 10 11:39:08.479803 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Sep 10 11:39:08.479803 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 33 and project d23f676a57d24e7b9722520d8db65258 combination. Sep 10 11:39:08.479803 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:08.479803 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:08.479803 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:08.479803 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:08.479803 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:08.479803 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:08.479803 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:39:08.479803 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:39:08.481102 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 33 and project d23f676a57d24e7b9722520d8db65258 combination. Sep 10 11:39:08.481102 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:08.481102 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c9906afd-ec1f-41c0-a90c-c04ffdd4bb25 tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] Returning 409 to user: Flavor access already exists for flavor 33 and project d23f676a57d24e7b9722520d8db65258 combination. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:39:08.481102 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c9906afd-ec1f-41c0-a90c-c04ffdd4bb25 tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1661620728/action" status: 409 len: 152 microversion: 2.1 time: 0.083299 Sep 10 11:39:08.481102 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 196/387] 10.222.0.23 () {60 vars in 1200 bytes} [Sat Sep 10 11:39:08 2022] POST /compute/v2.1/flavors/1661620728/action => generated 152 bytes in 85 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:39:08.481102 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c3bc4883-94d5-4ca1-9921-12fb9c146b8f tempest-QuotasAdminTestV236-1114939437 tempest-QuotasAdminTestV236-1114939437-project-admin] Action: 'update', calling method: .version_select at 0x7f40737afa60>, body: {"quota_set": {"ram": "2048"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:08.488533 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-775b7779-38b2-4409-9160-332de04a4e2b tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] 10.222.0.23 "GET /compute/v2.1/servers/966031ed-9a06-4a3d-92f7-96adcfa7e364" status: 200 len: 1321 microversion: 2.1 time: 0.235236 Sep 10 11:39:08.490495 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 192/388] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:08 2022] GET /compute/v2.1/servers/966031ed-9a06-4a3d-92f7-96adcfa7e364 => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:08.496461 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-756daa71-6c64-4437-886e-2d74c840e032 tempest-FloatingIPsNegativeTestJSON-938908274 tempest-FloatingIPsNegativeTestJSON-938908274-project] Calling method '.version_select at 0x7f4073c14670>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:08.579490 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3bc4883-94d5-4ca1-9921-12fb9c146b8f tempest-QuotasAdminTestV236-1114939437 tempest-QuotasAdminTestV236-1114939437-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:08.580253 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3bc4883-94d5-4ca1-9921-12fb9c146b8f tempest-QuotasAdminTestV236-1114939437 tempest-QuotasAdminTestV236-1114939437-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:08.581944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG neutronclient.v2_0.client [None req-756daa71-6c64-4437-886e-2d74c840e032 tempest-FloatingIPsNegativeTestJSON-938908274 tempest-FloatingIPsNegativeTestJSON-938908274-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 56323f2f-9af4-45d0-8b6b-bf89b773dbe9 could not be found", "detail": ""}} {{(pid=128776) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 11:39:08.582601 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3bc4883-94d5-4ca1-9921-12fb9c146b8f tempest-QuotasAdminTestV236-1114939437 tempest-QuotasAdminTestV236-1114939437-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:08.582720 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-756daa71-6c64-4437-886e-2d74c840e032 tempest-FloatingIPsNegativeTestJSON-938908274 tempest-FloatingIPsNegativeTestJSON-938908274-project] HTTP exception thrown: Floating IP not found for ID 56323f2f-9af4-45d0-8b6b-bf89b773dbe9 Sep 10 11:39:08.583967 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3bc4883-94d5-4ca1-9921-12fb9c146b8f tempest-QuotasAdminTestV236-1114939437 tempest-QuotasAdminTestV236-1114939437-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:08.585861 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3bc4883-94d5-4ca1-9921-12fb9c146b8f tempest-QuotasAdminTestV236-1114939437 tempest-QuotasAdminTestV236-1114939437-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:08.586677 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3bc4883-94d5-4ca1-9921-12fb9c146b8f tempest-QuotasAdminTestV236-1114939437 tempest-QuotasAdminTestV236-1114939437-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:08.595917 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-756daa71-6c64-4437-886e-2d74c840e032 tempest-FloatingIPsNegativeTestJSON-938908274 tempest-FloatingIPsNegativeTestJSON-938908274-project] Request method failure captured: Sep 10 11:39:08.595917 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/os-floating-ips/56323f2f-9af4-45d0-8b6b-bf89b773dbe9 HTTP/1.1 Sep 10 11:39:08.595917 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:39:08.595917 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:39:08.595917 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:39:08.595917 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:39:08.595917 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:39:08.595917 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:39:08.595917 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:39:08.595917 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:39:08.595917 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHdbQxjBjASgXWjItUl2PdUXL0QI30IJE6a1PPluCOSOtoGVgkUazJ75IRFkTwq2XStHrEQOAvyfeRZitxafkC04F8LJUw86Gkp_s3EDKeZ_1ZsXdzOVpDowiZdeXvybGEYBRgoEaU0g96AInxilqEGS9wJZZJlU7GEHF7Hnl_taDNQ Sep 10 11:39:08.595917 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:39:08.595917 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:39:08.595917 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:39:08.595917 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:39:08.595917 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:39:08.595917 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:39:08.595917 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 9a152b598d8b4d31aae30676af3a1f7f Sep 10 11:39:08.595917 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-938908274 Sep 10 11:39:08.595917 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:39:08.595917 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:39:08.597333 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9a152b598d8b4d31aae30676af3a1f7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9a152b598d8b4d31aae30676af3a1f7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9a152b598d8b4d31aae30676af3a1f7f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9a152b598d8b4d31aae30676af3a1f7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:39:08.597333 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-938908274 Sep 10 11:39:08.597333 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 9a152b598d8b4d31aae30676af3a1f7f Sep 10 11:39:08.597333 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-938908274 Sep 10 11:39:08.597333 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-FloatingIPsNegativeTestJSON-938908274-project Sep 10 11:39:08.597333 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:39:08.597333 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:39:08.597333 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 43c4531c988c4c6ab807cd31d7d0ab3b Sep 10 11:39:08.597333 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-938908274-project Sep 10 11:39:08.597333 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:39:08.597333 n-d-856895-1 devstack@n-api.service[128776]: exception: Floating IP not found for ID 56323f2f-9af4-45d0-8b6b-bf89b773dbe9 Sep 10 11:39:08.597333 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '56323f2f-9af4-45d0-8b6b-bf89b773dbe9'} Sep 10 11:39:08.597333 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:39:08.598169 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:08.598169 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 10 11:39:08.598169 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 10 11:39:08.598169 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:39:08.598169 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:39:08.598169 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 10 11:39:08.598169 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 10 11:39:08.598169 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:39:08.598169 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:39:08.598169 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 11:39:08.598169 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 11:39:08.598169 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:39:08.598169 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:39:08.598169 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 11:39:08.598169 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 11:39:08.598169 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:39:08.598169 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:39:08.598169 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 11:39:08.598169 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 11:39:08.599459 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:39:08.599459 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:39:08.599459 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 11:39:08.599459 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 11:39:08.599459 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 11:39:08.599459 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 11:39:08.599459 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 56323f2f-9af4-45d0-8b6b-bf89b773dbe9 could not be found Sep 10 11:39:08.599459 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2b27034-7415-42bb-aa9c-28a21bf98d86'] Sep 10 11:39:08.599459 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:08.599459 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:08.599459 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:08.599459 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:08.599459 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 10 11:39:08.599459 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 10 11:39:08.599459 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 10 11:39:08.599459 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 10 11:39:08.599459 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 56323f2f-9af4-45d0-8b6b-bf89b773dbe9. Sep 10 11:39:08.599459 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:08.599459 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:08.599459 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:08.600780 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:08.600780 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:08.600780 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:08.600780 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:39:08.600780 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:39:08.600780 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:39:08.600780 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:39:08.600780 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:39:08.600780 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:39:08.600780 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 10 11:39:08.600780 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 10 11:39:08.600780 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 56323f2f-9af4-45d0-8b6b-bf89b773dbe9 Sep 10 11:39:08.600780 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:08.600780 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:08.600780 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:08.600780 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:08.600780 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:08.600780 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:08.600780 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:39:08.600780 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:39:08.602010 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 56323f2f-9af4-45d0-8b6b-bf89b773dbe9 Sep 10 11:39:08.602010 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:08.602010 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-756daa71-6c64-4437-886e-2d74c840e032 tempest-FloatingIPsNegativeTestJSON-938908274 tempest-FloatingIPsNegativeTestJSON-938908274-project] Returning 404 to user: Floating IP not found for ID 56323f2f-9af4-45d0-8b6b-bf89b773dbe9 {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:39:08.603409 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-756daa71-6c64-4437-886e-2d74c840e032 tempest-FloatingIPsNegativeTestJSON-938908274 tempest-FloatingIPsNegativeTestJSON-938908274-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/56323f2f-9af4-45d0-8b6b-bf89b773dbe9" status: 404 len: 111 microversion: 2.1 time: 0.108618 Sep 10 11:39:08.604250 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 193/389] 10.222.0.23 () {58 vars in 1263 bytes} [Sat Sep 10 11:39:08 2022] DELETE /compute/v2.1/os-floating-ips/56323f2f-9af4-45d0-8b6b-bf89b773dbe9 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:39:08.617289 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-52fc57b6-bd03-4cbe-9007-49366b57ac8c tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "d23f676a57d24e7b9722520d8db65258"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:08.632415 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3bc4883-94d5-4ca1-9921-12fb9c146b8f tempest-QuotasAdminTestV236-1114939437 tempest-QuotasAdminTestV236-1114939437-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:08.634548 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3bc4883-94d5-4ca1-9921-12fb9c146b8f tempest-QuotasAdminTestV236-1114939437 tempest-QuotasAdminTestV236-1114939437-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:08.635608 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3bc4883-94d5-4ca1-9921-12fb9c146b8f tempest-QuotasAdminTestV236-1114939437 tempest-QuotasAdminTestV236-1114939437-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:08.638069 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3bc4883-94d5-4ca1-9921-12fb9c146b8f tempest-QuotasAdminTestV236-1114939437 tempest-QuotasAdminTestV236-1114939437-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:08.639692 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3bc4883-94d5-4ca1-9921-12fb9c146b8f tempest-QuotasAdminTestV236-1114939437 tempest-QuotasAdminTestV236-1114939437-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:08.641656 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3bc4883-94d5-4ca1-9921-12fb9c146b8f tempest-QuotasAdminTestV236-1114939437 tempest-QuotasAdminTestV236-1114939437-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:08.785978 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c3bc4883-94d5-4ca1-9921-12fb9c146b8f tempest-QuotasAdminTestV236-1114939437 tempest-QuotasAdminTestV236-1114939437-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/489a3ee44eb045fab6b42f0d237e86ff?user_id=1b228035f09a4cf1817d6d7bd2e53851" status: 200 len: 240 microversion: 2.36 time: 0.312487 Sep 10 11:39:08.787766 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 197/390] 10.222.0.23 () {62 vars in 1384 bytes} [Sat Sep 10 11:39:08 2022] PUT /compute/v2.1/os-quota-sets/489a3ee44eb045fab6b42f0d237e86ff?user_id=1b228035f09a4cf1817d6d7bd2e53851 => generated 240 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:39:08.800576 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-77ace9a7-fb4b-4f6b-b565-695818ea0009 tempest-QuotasAdminTestV236-1114939437 tempest-QuotasAdminTestV236-1114939437-project-admin] Calling method '.version_select at 0x7f40737af1f0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:08.999199 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-52fc57b6-bd03-4cbe-9007-49366b57ac8c tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1661620728/action" status: 200 len: 21 microversion: 2.1 time: 0.393061 Sep 10 11:39:09.002060 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 194/391] 10.222.0.23 () {60 vars in 1200 bytes} [Sat Sep 10 11:39:08 2022] POST /compute/v2.1/flavors/1661620728/action => generated 21 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:39:09.015683 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-65f2c874-a4ec-4ead-8a54-7c11584f162a tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:09.020030 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-65f2c874-a4ec-4ead-8a54-7c11584f162a tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:09.035620 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65f2c874-a4ec-4ead-8a54-7c11584f162a tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:09.037702 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65f2c874-a4ec-4ead-8a54-7c11584f162a tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:09.038791 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65f2c874-a4ec-4ead-8a54-7c11584f162a tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:09.041209 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65f2c874-a4ec-4ead-8a54-7c11584f162a tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:09.042930 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65f2c874-a4ec-4ead-8a54-7c11584f162a tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:09.044095 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65f2c874-a4ec-4ead-8a54-7c11584f162a tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:09.093163 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-77ace9a7-fb4b-4f6b-b565-695818ea0009 tempest-QuotasAdminTestV236-1114939437 tempest-QuotasAdminTestV236-1114939437-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/489a3ee44eb045fab6b42f0d237e86ff?user_id=1b228035f09a4cf1817d6d7bd2e53851" status: 200 len: 282 microversion: 2.36 time: 0.297358 Sep 10 11:39:09.094074 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 198/392] 10.222.0.23 () {60 vars in 1364 bytes} [Sat Sep 10 11:39:08 2022] GET /compute/v2.1/os-quota-sets/489a3ee44eb045fab6b42f0d237e86ff?user_id=1b228035f09a4cf1817d6d7bd2e53851 => generated 282 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:39:09.123474 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2a37e6c3-1005-4a41-b4d9-20a814e0e001 tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:09.147844 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=5,nova_api:INSERT=4 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:39:09.170060 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2a37e6c3-1005-4a41-b4d9-20a814e0e001 tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1661620728" status: 202 len: 0 microversion: 2.1 time: 0.074692 Sep 10 11:39:09.178912 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 199/393] 10.222.0.23 () {58 vars in 1161 bytes} [Sat Sep 10 11:39:09 2022] DELETE /compute/v2.1/flavors/1661620728 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:39:09.189414 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4ccd2be3-1614-4e66-a56c-600b945e0ed5 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:09.192772 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4ccd2be3-1614-4e66-a56c-600b945e0ed5 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 810c2316-10c5-47b4-9118-0298629d94e1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:09.203624 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ccd2be3-1614-4e66-a56c-600b945e0ed5 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:09.204124 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ccd2be3-1614-4e66-a56c-600b945e0ed5 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:09.204568 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ccd2be3-1614-4e66-a56c-600b945e0ed5 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:09.205279 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ccd2be3-1614-4e66-a56c-600b945e0ed5 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:09.209333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ccd2be3-1614-4e66-a56c-600b945e0ed5 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:09.215540 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ccd2be3-1614-4e66-a56c-600b945e0ed5 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:09.313667 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ccd2be3-1614-4e66-a56c-600b945e0ed5 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:09.315645 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ccd2be3-1614-4e66-a56c-600b945e0ed5 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:09.316376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ccd2be3-1614-4e66-a56c-600b945e0ed5 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:09.316940 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-4ccd2be3-1614-4e66-a56c-600b945e0ed5 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lazy-loading 'fault' on Instance uuid 810c2316-10c5-47b4-9118-0298629d94e1 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:39:10.012021 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-65f2c874-a4ec-4ead-8a54-7c11584f162a tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:10.020303 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-65f2c874-a4ec-4ead-8a54-7c11584f162a tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f" status: 200 len: 1504 microversion: 2.1 time: 1.015184 Sep 10 11:39:10.042458 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 195/394] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:09 2022] GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f => generated 1504 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:10.050630 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b36dbed9-6e7f-4f75-bfc0-c029337ac3a5 tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:10.083646 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4ccd2be3-1614-4e66-a56c-600b945e0ed5 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b632d0a5ac48fea0da5aa15632cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a040213a0ea443cd97b346b0d4e79d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:10.094447 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4ccd2be3-1614-4e66-a56c-600b945e0ed5 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/810c2316-10c5-47b4-9118-0298629d94e1" status: 200 len: 1458 microversion: 2.1 time: 0.917082 Sep 10 11:39:10.095457 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 200/395] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:09 2022] GET /compute/v2.1/servers/810c2316-10c5-47b4-9118-0298629d94e1 => generated 1458 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:10.099599 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b36dbed9-6e7f-4f75-bfc0-c029337ac3a5 tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.055544 Sep 10 11:39:10.111208 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-76b716b7-56dd-4558-968a-6ccd5439d616 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:10.111208 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-76b716b7-56dd-4558-968a-6ccd5439d616 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] [instance: 966031ed-9a06-4a3d-92f7-96adcfa7e364] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:10.112894 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 196/396] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:39:10 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:10.122393 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-76b716b7-56dd-4558-968a-6ccd5439d616 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:10.122393 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-76b716b7-56dd-4558-968a-6ccd5439d616 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:10.122666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-76b716b7-56dd-4558-968a-6ccd5439d616 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:10.123516 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-76b716b7-56dd-4558-968a-6ccd5439d616 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:10.124085 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-76b716b7-56dd-4558-968a-6ccd5439d616 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:10.124687 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-76b716b7-56dd-4558-968a-6ccd5439d616 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:10.130528 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-95640139-4690-41ba-8c02-736316aac05a tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1256411110", "id": 2047340728, "os-flavor-access:is_public": "True"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:10.155786 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:39:10.179819 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-95640139-4690-41ba-8c02-736316aac05a tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.052252 Sep 10 11:39:10.180700 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 197/397] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:39:10 2022] POST /compute/v2.1/flavors => generated 438 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:39:10.198087 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0352a848-d86d-4653-911c-219c6dfe5a61 tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:10.217446 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-0352a848-d86d-4653-911c-219c6dfe5a61 tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] HTTP exception thrown: Access list not available for public flavors. Sep 10 11:39:10.219307 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0352a848-d86d-4653-911c-219c6dfe5a61 tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] Request method failure captured: Sep 10 11:39:10.219307 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/flavors/2047340728/os-flavor-access HTTP/1.1 Sep 10 11:39:10.219307 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:39:10.219307 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:39:10.219307 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:39:10.219307 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:39:10.219307 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:39:10.219307 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:39:10.219307 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:39:10.219307 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:39:10.219307 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHdaC14shzqtHSSxic-KrmYbsZj4TZ2P8a9VIEi9MkHqsFuKKfS2ftn5J_t80nrxvGWoa7W3T4GFoVfMFAB0uO8uWQUfBZfbeSHYJnSqRjhTGaEbfuzXOnhWB4L_DFulaSchC5zgfBL6EJD34CE8PgLyGHUgqecC_MPgi5ff_MNQqmw Sep 10 11:39:10.219307 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:39:10.219307 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:39:10.219307 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:39:10.219307 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:39:10.219307 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:39:10.219307 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:39:10.219307 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: b6964506f7d64a76bfba5b83826b79ee Sep 10 11:39:10.219307 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-637372514 Sep 10 11:39:10.219307 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,admin,member Sep 10 11:39:10.219307 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,admin,member Sep 10 11:39:10.220580 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b6964506f7d64a76bfba5b83826b79ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b6964506f7d64a76bfba5b83826b79ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b6964506f7d64a76bfba5b83826b79ee", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b6964506f7d64a76bfba5b83826b79ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:39:10.220580 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-637372514 Sep 10 11:39:10.220580 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: b6964506f7d64a76bfba5b83826b79ee Sep 10 11:39:10.220580 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-637372514 Sep 10 11:39:10.220580 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin Sep 10 11:39:10.220580 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:39:10.220580 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:39:10.220580 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 301076575a9047d59731ffcd2ad99759 Sep 10 11:39:10.220580 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin Sep 10 11:39:10.220580 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:39:10.220580 n-d-856895-1 devstack@n-api.service[128776]: exception: Access list not available for public flavors. Sep 10 11:39:10.220580 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'flavor_id': '2047340728'} Sep 10 11:39:10.221976 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:39:10.221976 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:10.221976 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:10.221976 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:10.221976 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:39:10.221976 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:39:10.221976 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:39:10.221976 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:39:10.221976 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Sep 10 11:39:10.221976 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 11:39:10.221976 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Sep 10 11:39:10.221976 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:10.221976 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:10.221976 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:10.221976 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:10.221976 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:10.221976 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:10.221976 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:39:10.221976 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:39:10.221976 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Sep 10 11:39:10.221976 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:10.226457 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0352a848-d86d-4653-911c-219c6dfe5a61 tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:39:10.240441 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0352a848-d86d-4653-911c-219c6dfe5a61 tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/2047340728/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.047157 Sep 10 11:39:10.241381 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 198/398] 10.222.0.23 () {58 vars in 1209 bytes} [Sat Sep 10 11:39:10 2022] GET /compute/v2.1/flavors/2047340728/os-flavor-access => generated 91 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:39:10.250923 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3999c98f-639c-4eaa-b1aa-27f5c9a01d88 tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:10.302550 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3999c98f-639c-4eaa-b1aa-27f5c9a01d88 tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/2047340728" status: 202 len: 0 microversion: 2.1 time: 0.056242 Sep 10 11:39:10.306989 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 199/399] 10.222.0.23 () {58 vars in 1161 bytes} [Sat Sep 10 11:39:10 2022] DELETE /compute/v2.1/flavors/2047340728 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:39:10.312858 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-87597b76-be88-4e3a-ac4d-4d0391c49b30 req-171ccba1-ca0e-423b-b6c4-9f63f3113314 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "810c2316-10c5-47b4-9118-0298629d94e1", "name": "network-vif-deleted", "tag": "c2e4229b-d7db-4aeb-8db4-3f5575cc527f"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:10.336822 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-87597b76-be88-4e3a-ac4d-4d0391c49b30 req-171ccba1-ca0e-423b-b6c4-9f63f3113314 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:10.337733 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-87597b76-be88-4e3a-ac4d-4d0391c49b30 req-171ccba1-ca0e-423b-b6c4-9f63f3113314 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:10.338384 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-87597b76-be88-4e3a-ac4d-4d0391c49b30 req-171ccba1-ca0e-423b-b6c4-9f63f3113314 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:10.365631 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-87597b76-be88-4e3a-ac4d-4d0391c49b30 req-171ccba1-ca0e-423b-b6c4-9f63f3113314 service nova] Creating event network-vif-deleted:c2e4229b-d7db-4aeb-8db4-3f5575cc527f for instance 810c2316-10c5-47b4-9118-0298629d94e1 on n-h1-856895-1 Sep 10 11:39:10.381374 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-87597b76-be88-4e3a-ac4d-4d0391c49b30 req-171ccba1-ca0e-423b-b6c4-9f63f3113314 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072696 Sep 10 11:39:10.382509 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 200/400] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:39:10.387778 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-63c6cdb0-218e-4b04-9c21-0b8d3f376ec0 tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:10.428526 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-63c6cdb0-218e-4b04-9c21-0b8d3f376ec0 tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.044616 Sep 10 11:39:10.433646 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 201/401] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:39:10 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:10.458541 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1fd2eb26-5a48-44bd-bc71-5ee93b1ee99e tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1662323978", "id": 337200832, "os-flavor-access:is_public": "False"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:10.494892 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1fd2eb26-5a48-44bd-bc71-5ee93b1ee99e tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.041186 Sep 10 11:39:10.496263 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 202/402] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:39:10 2022] POST /compute/v2.1/flavors => generated 436 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:39:10.782319 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-76b716b7-56dd-4558-968a-6ccd5439d616 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c91799a8724c499cd1afe82e3fd657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95726b0caac4b7fb5f0db90d268430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:10.790695 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-76b716b7-56dd-4558-968a-6ccd5439d616 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] 10.222.0.23 "GET /compute/v2.1/servers/966031ed-9a06-4a3d-92f7-96adcfa7e364" status: 200 len: 1470 microversion: 2.1 time: 0.694094 Sep 10 11:39:10.807189 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 201/403] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:10 2022] GET /compute/v2.1/servers/966031ed-9a06-4a3d-92f7-96adcfa7e364 => generated 1470 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:10.816035 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9ff4822f-709a-4226-957e-1c8939d404b7 tempest-FlavorsAccessNegativeTestJSON-873102274 tempest-FlavorsAccessNegativeTestJSON-873102274-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "d23f676a57d24e7b9722520d8db65258"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:10.818092 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9ff4822f-709a-4226-957e-1c8939d404b7 tempest-FlavorsAccessNegativeTestJSON-873102274 tempest-FlavorsAccessNegativeTestJSON-873102274-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '488201c8624b465ca1ed5196e907fd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23f676a57d24e7b9722520d8db65258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:10.821628 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-52f60d86-3bf4-4a2a-99fa-4089270264fa tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:10.822333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-52f60d86-3bf4-4a2a-99fa-4089270264fa tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] [instance: 966031ed-9a06-4a3d-92f7-96adcfa7e364] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:10.824400 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9ff4822f-709a-4226-957e-1c8939d404b7 tempest-FlavorsAccessNegativeTestJSON-873102274 tempest-FlavorsAccessNegativeTestJSON-873102274-project] Request method failure captured: Sep 10 11:39:10.824400 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/flavors/337200832/action HTTP/1.1 Sep 10 11:39:10.824400 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:39:10.824400 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:39:10.824400 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:39:10.824400 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 67 Sep 10 11:39:10.824400 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:39:10.824400 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:39:10.824400 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:39:10.824400 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:39:10.824400 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHdYvRerCFkOfXx1cIiR81A5NfPqPJH-fz3sEMFILamwGQCL3Yl9wn2fwYWD1sRmvu3fGEhiCfssblY-WN2YhtGlqIAwT9HGp-zzSG7uqfVbmzJ26jPRFd8VKhZ3XIVmZotRAriVQ1wP_ngUgWoQ4VLjeDMFVE33e1qoKfijqbnp504 Sep 10 11:39:10.824400 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:39:10.824400 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:39:10.824400 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:39:10.824400 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:39:10.824400 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:39:10.824400 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:39:10.824400 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: d23f676a57d24e7b9722520d8db65258 Sep 10 11:39:10.824400 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-873102274 Sep 10 11:39:10.824400 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:39:10.824400 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:39:10.825627 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d23f676a57d24e7b9722520d8db65258"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d23f676a57d24e7b9722520d8db65258"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d23f676a57d24e7b9722520d8db65258", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d23f676a57d24e7b9722520d8db65258"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:39:10.825627 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-873102274 Sep 10 11:39:10.825627 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: d23f676a57d24e7b9722520d8db65258 Sep 10 11:39:10.825627 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-873102274 Sep 10 11:39:10.825627 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-FlavorsAccessNegativeTestJSON-873102274-project Sep 10 11:39:10.825627 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:39:10.825627 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:39:10.825627 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 488201c8624b465ca1ed5196e907fd4e Sep 10 11:39:10.825627 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-873102274-project Sep 10 11:39:10.825627 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 11:39:10.825627 n-d-856895-1 devstack@n-api.service[128776]: {"addTenantAccess": {"tenant": "d23f676a57d24e7b9722520d8db65258"}} Sep 10 11:39:10.825627 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:39:10.826301 n-d-856895-1 devstack@n-api.service[128776]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 10 11:39:10.826301 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '337200832', 'body': {'addTenantAccess': {'tenant': 'd23f676a57d24e7b9722520d8db65258'}}} Sep 10 11:39:10.826301 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:39:10.826301 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:10.826301 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:10.826301 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:10.826301 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:39:10.826301 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:39:10.826301 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:39:10.826301 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:39:10.826301 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:39:10.826301 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:39:10.826301 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Sep 10 11:39:10.826301 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Sep 10 11:39:10.826301 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 11:39:10.826301 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 11:39:10.826301 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 11:39:10.826301 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 11:39:10.826301 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:39:10.827365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:39:10.827365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:39:10.827365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:39:10.827365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 11:39:10.827365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 11:39:10.827365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 11:39:10.827365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 11:39:10.827365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 11:39:10.827365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 11:39:10.827365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 10 11:39:10.827365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:10.827365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:10.827365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:10.827365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:10.827365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:10.827365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:10.827365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 11:39:10.827365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 11:39:10.827365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 10 11:39:10.827365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:10.828831 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9ff4822f-709a-4226-957e-1c8939d404b7 tempest-FlavorsAccessNegativeTestJSON-873102274 tempest-FlavorsAccessNegativeTestJSON-873102274-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:39:10.828831 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9ff4822f-709a-4226-957e-1c8939d404b7 tempest-FlavorsAccessNegativeTestJSON-873102274 tempest-FlavorsAccessNegativeTestJSON-873102274-project] 10.222.0.23 "POST /compute/v2.1/flavors/337200832/action" status: 403 len: 130 microversion: 2.1 time: 0.321297 Sep 10 11:39:10.829247 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 203/404] 10.222.0.23 () {60 vars in 1197 bytes} [Sat Sep 10 11:39:10 2022] POST /compute/v2.1/flavors/337200832/action => generated 130 bytes in 325 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:39:10.837509 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-52f60d86-3bf4-4a2a-99fa-4089270264fa tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:10.838011 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-52f60d86-3bf4-4a2a-99fa-4089270264fa tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:10.838193 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-efbc0680-f9bc-49ec-8d4f-196dffdfea66 tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:10.838455 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-52f60d86-3bf4-4a2a-99fa-4089270264fa tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:10.839186 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-52f60d86-3bf4-4a2a-99fa-4089270264fa tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:10.839636 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-52f60d86-3bf4-4a2a-99fa-4089270264fa tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:10.840061 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-52f60d86-3bf4-4a2a-99fa-4089270264fa tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:10.881100 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-efbc0680-f9bc-49ec-8d4f-196dffdfea66 tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/337200832" status: 202 len: 0 microversion: 2.1 time: 0.047269 Sep 10 11:39:10.882002 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 204/405] 10.222.0.23 () {58 vars in 1158 bytes} [Sat Sep 10 11:39:10 2022] DELETE /compute/v2.1/flavors/337200832 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:39:10.889914 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1ed2e314-a679-4881-89d2-5cb23cc3bb60 tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:10.894192 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-52f60d86-3bf4-4a2a-99fa-4089270264fa tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Lazy-loading 'flavor' on Instance uuid 966031ed-9a06-4a3d-92f7-96adcfa7e364 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:39:10.941267 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1ed2e314-a679-4881-89d2-5cb23cc3bb60 tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.054919 Sep 10 11:39:10.942422 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 205/406] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:39:10 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:10.965207 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-48368b71-7d44-4d50-b3d1-4b46d86257f8 tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-873644337", "id": 1691505865, "os-flavor-access:is_public": "False"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:10.989717 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-48368b71-7d44-4d50-b3d1-4b46d86257f8 tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.028188 Sep 10 11:39:10.990950 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 206/407] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:39:10 2022] POST /compute/v2.1/flavors => generated 438 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:39:11.007496 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f42eb3d2-db77-4c55-96f3-77a63f506258 tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "d23f676a57d24e7b9722520d8db65258"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:11.107976 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-52f60d86-3bf4-4a2a-99fa-4089270264fa tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/966031ed-9a06-4a3d-92f7-96adcfa7e364/action" status: 202 len: 0 microversion: 2.1 time: 0.276269 Sep 10 11:39:11.109628 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 202/408] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:39:10 2022] POST /compute/v2.1/servers/966031ed-9a06-4a3d-92f7-96adcfa7e364/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 11:39:11.138210 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b01a176a-be7e-40e1-9391-9bf71c2412ab tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:11.138942 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b01a176a-be7e-40e1-9391-9bf71c2412ab tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:11.161794 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b01a176a-be7e-40e1-9391-9bf71c2412ab tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:11.162292 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b01a176a-be7e-40e1-9391-9bf71c2412ab tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:11.167922 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b01a176a-be7e-40e1-9391-9bf71c2412ab tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:11.168800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b01a176a-be7e-40e1-9391-9bf71c2412ab tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:11.169547 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b01a176a-be7e-40e1-9391-9bf71c2412ab tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:11.171957 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b01a176a-be7e-40e1-9391-9bf71c2412ab tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:11.508239 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f42eb3d2-db77-4c55-96f3-77a63f506258 tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1691505865/action" status: 200 len: 97 microversion: 2.1 time: 0.506485 Sep 10 11:39:11.509523 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 207/409] 10.222.0.23 () {60 vars in 1200 bytes} [Sat Sep 10 11:39:10 2022] POST /compute/v2.1/flavors/1691505865/action => generated 97 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:39:11.514946 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-254c110b-55d6-4b6b-86a2-7a79081eb418 tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:11.515986 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-254c110b-55d6-4b6b-86a2-7a79081eb418 tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] [instance: 966031ed-9a06-4a3d-92f7-96adcfa7e364] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:11.529760 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-254c110b-55d6-4b6b-86a2-7a79081eb418 tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:11.531613 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-254c110b-55d6-4b6b-86a2-7a79081eb418 tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:11.532239 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-254c110b-55d6-4b6b-86a2-7a79081eb418 tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:11.538293 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-254c110b-55d6-4b6b-86a2-7a79081eb418 tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:11.538970 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-254c110b-55d6-4b6b-86a2-7a79081eb418 tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:11.539623 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-254c110b-55d6-4b6b-86a2-7a79081eb418 tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:11.638806 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b01a176a-be7e-40e1-9391-9bf71c2412ab tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:11.651893 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b01a176a-be7e-40e1-9391-9bf71c2412ab tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f" status: 200 len: 1504 microversion: 2.1 time: 0.538295 Sep 10 11:39:11.667852 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 203/410] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:11 2022] GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f => generated 1504 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:11.689376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b2a83378-ecd1-4242-af76-de6e71be3679 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:11.690874 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b2a83378-ecd1-4242-af76-de6e71be3679 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 810c2316-10c5-47b4-9118-0298629d94e1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:11.697456 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b2a83378-ecd1-4242-af76-de6e71be3679 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:11.698285 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b2a83378-ecd1-4242-af76-de6e71be3679 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:11.698882 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b2a83378-ecd1-4242-af76-de6e71be3679 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:11.699775 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b2a83378-ecd1-4242-af76-de6e71be3679 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:11.701825 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b2a83378-ecd1-4242-af76-de6e71be3679 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:11.704928 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b2a83378-ecd1-4242-af76-de6e71be3679 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:11.741587 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-b2a83378-ecd1-4242-af76-de6e71be3679 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] HTTP exception thrown: Instance 810c2316-10c5-47b4-9118-0298629d94e1 could not be found. Sep 10 11:39:11.743575 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b2a83378-ecd1-4242-af76-de6e71be3679 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Request method failure captured: Sep 10 11:39:11.743575 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/810c2316-10c5-47b4-9118-0298629d94e1 HTTP/1.1 Sep 10 11:39:11.743575 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:39:11.743575 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:39:11.743575 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:39:11.743575 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:39:11.743575 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:39:11.743575 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:39:11.743575 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:39:11.743575 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:39:11.743575 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHcXl-_p7vgI4dby_qITzIhY55KdqBBP_6TYBDe1-vZ3vQLtFhnNKuZafnu4iFHGhqNTOMhJlRV-u1tvuhxUB0IQrpdLW4q9Ju-gqUTkenwnw7mqv5ryGW1KpkQbdTVUYpQYgxFcA7deHFC16m4dRTiLt_WhC-yJSPnJh72fs6TE474 Sep 10 11:39:11.743575 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:39:11.743575 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:39:11.743575 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:39:11.743575 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:39:11.743575 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:39:11.743575 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:39:11.743575 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: a040213a0ea443cd97b346b0d4e79d4d Sep 10 11:39:11.743575 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1489315855 Sep 10 11:39:11.743575 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:39:11.743575 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:39:11.744903 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a040213a0ea443cd97b346b0d4e79d4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a040213a0ea443cd97b346b0d4e79d4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a040213a0ea443cd97b346b0d4e79d4d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a040213a0ea443cd97b346b0d4e79d4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:39:11.744903 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-DeleteServersAdminTestJSON-1489315855 Sep 10 11:39:11.744903 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: a040213a0ea443cd97b346b0d4e79d4d Sep 10 11:39:11.744903 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1489315855 Sep 10 11:39:11.744903 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-DeleteServersAdminTestJSON-1489315855-project Sep 10 11:39:11.744903 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:39:11.744903 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:39:11.744903 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 53b632d0a5ac48fea0da5aa15632cffb Sep 10 11:39:11.744903 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-DeleteServersAdminTestJSON-1489315855-project Sep 10 11:39:11.744903 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:39:11.744903 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 810c2316-10c5-47b4-9118-0298629d94e1 could not be found. Sep 10 11:39:11.744903 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '810c2316-10c5-47b4-9118-0298629d94e1'} Sep 10 11:39:11.745589 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:39:11.745589 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:11.745589 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:39:11.745589 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:39:11.745589 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:39:11.745589 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:39:11.745589 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:39:11.745589 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:39:11.745589 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:39:11.745589 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:39:11.745589 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 810c2316-10c5-47b4-9118-0298629d94e1 could not be found. Sep 10 11:39:11.745589 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:11.745589 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:11.745589 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:11.745589 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:11.745589 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:11.745589 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:11.745589 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:39:11.745589 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:39:11.745589 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:39:11.746735 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:39:11.746735 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:39:11.746735 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:39:11.746735 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:39:11.746735 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:39:11.746735 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:39:11.746735 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:39:11.746735 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 810c2316-10c5-47b4-9118-0298629d94e1 could not be found. Sep 10 11:39:11.746735 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:11.746735 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:11.746735 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:11.746735 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:11.746735 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:11.746735 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:11.746735 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:39:11.746735 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:39:11.746735 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 810c2316-10c5-47b4-9118-0298629d94e1 could not be found. Sep 10 11:39:11.746735 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:11.749220 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b2a83378-ecd1-4242-af76-de6e71be3679 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Returning 404 to user: Instance 810c2316-10c5-47b4-9118-0298629d94e1 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:39:11.750347 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b2a83378-ecd1-4242-af76-de6e71be3679 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/810c2316-10c5-47b4-9118-0298629d94e1" status: 404 len: 111 microversion: 2.1 time: 0.081347 Sep 10 11:39:11.751451 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 204/411] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:11 2022] GET /compute/v2.1/servers/810c2316-10c5-47b4-9118-0298629d94e1 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:39:11.759085 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-aa818aed-f59e-48d5-88f0-c9936927d5c7 tempest-FlavorsAccessNegativeTestJSON-873102274 tempest-FlavorsAccessNegativeTestJSON-873102274-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "d23f676a57d24e7b9722520d8db65258"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:11.780449 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-aa818aed-f59e-48d5-88f0-c9936927d5c7 tempest-FlavorsAccessNegativeTestJSON-873102274 tempest-FlavorsAccessNegativeTestJSON-873102274-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '488201c8624b465ca1ed5196e907fd4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd23f676a57d24e7b9722520d8db65258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:11.782097 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-aa818aed-f59e-48d5-88f0-c9936927d5c7 tempest-FlavorsAccessNegativeTestJSON-873102274 tempest-FlavorsAccessNegativeTestJSON-873102274-project] Request method failure captured: Sep 10 11:39:11.782097 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/flavors/1691505865/action HTTP/1.1 Sep 10 11:39:11.782097 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:39:11.782097 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:39:11.782097 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:39:11.782097 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 70 Sep 10 11:39:11.782097 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:39:11.782097 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:39:11.782097 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:39:11.782097 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:39:11.782097 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHdYvRerCFkOfXx1cIiR81A5NfPqPJH-fz3sEMFILamwGQCL3Yl9wn2fwYWD1sRmvu3fGEhiCfssblY-WN2YhtGlqIAwT9HGp-zzSG7uqfVbmzJ26jPRFd8VKhZ3XIVmZotRAriVQ1wP_ngUgWoQ4VLjeDMFVE33e1qoKfijqbnp504 Sep 10 11:39:11.782097 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:39:11.782097 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:39:11.782097 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:39:11.782097 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:39:11.782097 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:39:11.782097 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:39:11.782097 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: d23f676a57d24e7b9722520d8db65258 Sep 10 11:39:11.782097 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-873102274 Sep 10 11:39:11.782097 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:39:11.782097 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:39:11.784341 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d23f676a57d24e7b9722520d8db65258"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d23f676a57d24e7b9722520d8db65258"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d23f676a57d24e7b9722520d8db65258", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d23f676a57d24e7b9722520d8db65258"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:39:11.784341 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-873102274 Sep 10 11:39:11.784341 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: d23f676a57d24e7b9722520d8db65258 Sep 10 11:39:11.784341 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-873102274 Sep 10 11:39:11.784341 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-FlavorsAccessNegativeTestJSON-873102274-project Sep 10 11:39:11.784341 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:39:11.784341 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:39:11.784341 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 488201c8624b465ca1ed5196e907fd4e Sep 10 11:39:11.784341 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-873102274-project Sep 10 11:39:11.784341 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:39:11.784341 n-d-856895-1 devstack@n-api.service[128777]: {"removeTenantAccess": {"tenant": "d23f676a57d24e7b9722520d8db65258"}} Sep 10 11:39:11.784341 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:39:11.785026 n-d-856895-1 devstack@n-api.service[128777]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 10 11:39:11.785026 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '1691505865', 'body': {'removeTenantAccess': {'tenant': 'd23f676a57d24e7b9722520d8db65258'}}} Sep 10 11:39:11.785026 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:39:11.785026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:11.785026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:11.785026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:11.785026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:39:11.785026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:39:11.785026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:39:11.785026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:39:11.785026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:39:11.785026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:39:11.785026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Sep 10 11:39:11.785026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi context.can( Sep 10 11:39:11.785026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 11:39:11.785026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 11:39:11.785026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 11:39:11.785026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 11:39:11.785026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:39:11.785026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:39:11.786985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:39:11.786985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:39:11.786985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 11:39:11.786985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 11:39:11.786985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 11:39:11.786985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 11:39:11.786985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 11:39:11.786985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 11:39:11.786985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 10 11:39:11.786985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:11.786985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:11.786985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:11.786985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:11.786985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:11.786985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:11.786985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 11:39:11.786985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 11:39:11.786985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 10 11:39:11.786985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:11.788669 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-aa818aed-f59e-48d5-88f0-c9936927d5c7 tempest-FlavorsAccessNegativeTestJSON-873102274 tempest-FlavorsAccessNegativeTestJSON-873102274-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:39:11.788669 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-aa818aed-f59e-48d5-88f0-c9936927d5c7 tempest-FlavorsAccessNegativeTestJSON-873102274 tempest-FlavorsAccessNegativeTestJSON-873102274-project] 10.222.0.23 "POST /compute/v2.1/flavors/1691505865/action" status: 403 len: 133 microversion: 2.1 time: 0.030935 Sep 10 11:39:11.788669 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 205/412] 10.222.0.23 () {60 vars in 1200 bytes} [Sat Sep 10 11:39:11 2022] POST /compute/v2.1/flavors/1691505865/action => generated 133 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:39:11.790317 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9aa19fbf-b38d-40e5-83c1-fa91c4a22c05 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:11.790946 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9aa19fbf-b38d-40e5-83c1-fa91c4a22c05 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 810c2316-10c5-47b4-9118-0298629d94e1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:11.807661 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9aa19fbf-b38d-40e5-83c1-fa91c4a22c05 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:11.808160 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9aa19fbf-b38d-40e5-83c1-fa91c4a22c05 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:11.808608 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9aa19fbf-b38d-40e5-83c1-fa91c4a22c05 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:11.816050 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9aa19fbf-b38d-40e5-83c1-fa91c4a22c05 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:11.816659 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9aa19fbf-b38d-40e5-83c1-fa91c4a22c05 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:11.817112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9aa19fbf-b38d-40e5-83c1-fa91c4a22c05 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:11.848136 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-9aa19fbf-b38d-40e5-83c1-fa91c4a22c05 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] HTTP exception thrown: Instance 810c2316-10c5-47b4-9118-0298629d94e1 could not be found. Sep 10 11:39:11.850908 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9aa19fbf-b38d-40e5-83c1-fa91c4a22c05 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Request method failure captured: Sep 10 11:39:11.850908 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/servers/810c2316-10c5-47b4-9118-0298629d94e1 HTTP/1.1 Sep 10 11:39:11.850908 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:39:11.850908 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:39:11.850908 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:39:11.850908 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:39:11.850908 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:39:11.850908 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:39:11.850908 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:39:11.850908 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:39:11.850908 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHcXl-_p7vgI4dby_qITzIhY55KdqBBP_6TYBDe1-vZ3vQLtFhnNKuZafnu4iFHGhqNTOMhJlRV-u1tvuhxUB0IQrpdLW4q9Ju-gqUTkenwnw7mqv5ryGW1KpkQbdTVUYpQYgxFcA7deHFC16m4dRTiLt_WhC-yJSPnJh72fs6TE474 Sep 10 11:39:11.850908 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:39:11.850908 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:39:11.850908 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:39:11.850908 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:39:11.850908 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:39:11.850908 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:39:11.850908 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: a040213a0ea443cd97b346b0d4e79d4d Sep 10 11:39:11.850908 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1489315855 Sep 10 11:39:11.850908 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:39:11.850908 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:39:11.852659 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a040213a0ea443cd97b346b0d4e79d4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a040213a0ea443cd97b346b0d4e79d4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a040213a0ea443cd97b346b0d4e79d4d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a040213a0ea443cd97b346b0d4e79d4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:39:11.852659 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-DeleteServersAdminTestJSON-1489315855 Sep 10 11:39:11.852659 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: a040213a0ea443cd97b346b0d4e79d4d Sep 10 11:39:11.852659 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1489315855 Sep 10 11:39:11.852659 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-DeleteServersAdminTestJSON-1489315855-project Sep 10 11:39:11.852659 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:39:11.852659 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:39:11.852659 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 53b632d0a5ac48fea0da5aa15632cffb Sep 10 11:39:11.852659 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-DeleteServersAdminTestJSON-1489315855-project Sep 10 11:39:11.852659 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:39:11.852659 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 810c2316-10c5-47b4-9118-0298629d94e1 could not be found. Sep 10 11:39:11.852659 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '810c2316-10c5-47b4-9118-0298629d94e1'} Sep 10 11:39:11.853506 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:39:11.853506 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:11.853506 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:39:11.853506 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:39:11.853506 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:39:11.853506 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:39:11.853506 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:39:11.853506 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:39:11.853506 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:39:11.853506 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:39:11.853506 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 810c2316-10c5-47b4-9118-0298629d94e1 could not be found. Sep 10 11:39:11.853506 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:11.853506 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:11.853506 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:11.853506 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:11.853506 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:11.853506 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:11.853506 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:39:11.853506 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:39:11.853506 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:39:11.854917 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:39:11.854917 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:39:11.854917 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:39:11.854917 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:39:11.854917 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:39:11.854917 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:39:11.854917 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:39:11.854917 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:39:11.854917 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:39:11.854917 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 810c2316-10c5-47b4-9118-0298629d94e1 could not be found. Sep 10 11:39:11.854917 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:11.854917 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:11.854917 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:11.854917 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:11.854917 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:11.854917 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:11.854917 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:39:11.854917 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:39:11.854917 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 810c2316-10c5-47b4-9118-0298629d94e1 could not be found. Sep 10 11:39:11.854917 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:11.860355 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9aa19fbf-b38d-40e5-83c1-fa91c4a22c05 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Returning 404 to user: Instance 810c2316-10c5-47b4-9118-0298629d94e1 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:39:11.860355 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9aa19fbf-b38d-40e5-83c1-fa91c4a22c05 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "DELETE /compute/v2.1/servers/810c2316-10c5-47b4-9118-0298629d94e1" status: 404 len: 111 microversion: 2.1 time: 0.067744 Sep 10 11:39:11.860355 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 206/413] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:39:11 2022] DELETE /compute/v2.1/servers/810c2316-10c5-47b4-9118-0298629d94e1 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:39:11.864777 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1eb79bc2-41b9-464b-abb8-9da82bcef415 tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "d23f676a57d24e7b9722520d8db65258"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:12.147517 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1eb79bc2-41b9-464b-abb8-9da82bcef415 tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1691505865/action" status: 200 len: 21 microversion: 2.1 time: 0.289797 Sep 10 11:39:12.148863 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 207/414] 10.222.0.23 () {60 vars in 1200 bytes} [Sat Sep 10 11:39:11 2022] POST /compute/v2.1/flavors/1691505865/action => generated 21 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:39:12.154826 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c55f6579-a403-416d-a2a1-60c89ae2163f tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:12.155681 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c55f6579-a403-416d-a2a1-60c89ae2163f tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 810c2316-10c5-47b4-9118-0298629d94e1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:12.167052 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c55f6579-a403-416d-a2a1-60c89ae2163f tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:12.184407 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c55f6579-a403-416d-a2a1-60c89ae2163f tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:12.184967 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c55f6579-a403-416d-a2a1-60c89ae2163f tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:12.189651 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c55f6579-a403-416d-a2a1-60c89ae2163f tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:12.192564 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c55f6579-a403-416d-a2a1-60c89ae2163f tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:12.193048 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c55f6579-a403-416d-a2a1-60c89ae2163f tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:12.229080 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-254c110b-55d6-4b6b-86a2-7a79081eb418 tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/966031ed-9a06-4a3d-92f7-96adcfa7e364" status: 200 len: 1629 microversion: 2.1 time: 0.718193 Sep 10 11:39:12.230844 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 208/415] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:11 2022] GET /compute/v2.1/servers/966031ed-9a06-4a3d-92f7-96adcfa7e364 => generated 1629 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:12.234683 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-c55f6579-a403-416d-a2a1-60c89ae2163f tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] HTTP exception thrown: Instance 810c2316-10c5-47b4-9118-0298629d94e1 could not be found. Sep 10 11:39:12.237948 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c55f6579-a403-416d-a2a1-60c89ae2163f tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Request method failure captured: Sep 10 11:39:12.237948 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/810c2316-10c5-47b4-9118-0298629d94e1 HTTP/1.1 Sep 10 11:39:12.237948 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:39:12.237948 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:39:12.237948 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:39:12.237948 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:39:12.237948 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:39:12.237948 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:39:12.237948 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:39:12.237948 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:39:12.237948 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHcXl-_p7vgI4dby_qITzIhY55KdqBBP_6TYBDe1-vZ3vQLtFhnNKuZafnu4iFHGhqNTOMhJlRV-u1tvuhxUB0IQrpdLW4q9Ju-gqUTkenwnw7mqv5ryGW1KpkQbdTVUYpQYgxFcA7deHFC16m4dRTiLt_WhC-yJSPnJh72fs6TE474 Sep 10 11:39:12.237948 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:39:12.237948 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:39:12.237948 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:39:12.237948 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:39:12.237948 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:39:12.237948 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:39:12.237948 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: a040213a0ea443cd97b346b0d4e79d4d Sep 10 11:39:12.237948 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1489315855 Sep 10 11:39:12.237948 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:39:12.237948 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:39:12.239306 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a040213a0ea443cd97b346b0d4e79d4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a040213a0ea443cd97b346b0d4e79d4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a040213a0ea443cd97b346b0d4e79d4d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a040213a0ea443cd97b346b0d4e79d4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:39:12.239306 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-DeleteServersAdminTestJSON-1489315855 Sep 10 11:39:12.239306 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: a040213a0ea443cd97b346b0d4e79d4d Sep 10 11:39:12.239306 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1489315855 Sep 10 11:39:12.239306 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-DeleteServersAdminTestJSON-1489315855-project Sep 10 11:39:12.239306 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:39:12.239306 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:39:12.239306 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 53b632d0a5ac48fea0da5aa15632cffb Sep 10 11:39:12.239306 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-DeleteServersAdminTestJSON-1489315855-project Sep 10 11:39:12.239306 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:39:12.239306 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 810c2316-10c5-47b4-9118-0298629d94e1 could not be found. Sep 10 11:39:12.239306 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '810c2316-10c5-47b4-9118-0298629d94e1'} Sep 10 11:39:12.240364 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:39:12.240364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:12.240364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:39:12.240364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:39:12.240364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:39:12.240364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:39:12.240364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:39:12.240364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:39:12.240364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:39:12.240364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:39:12.240364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 810c2316-10c5-47b4-9118-0298629d94e1 could not be found. Sep 10 11:39:12.240364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:12.240364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:12.240364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:12.240364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:12.240364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:12.240364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:12.240364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:39:12.240364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:39:12.240364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:39:12.241665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:39:12.241665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:39:12.241665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:39:12.241665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:39:12.241665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:39:12.241665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:39:12.241665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:39:12.241665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 810c2316-10c5-47b4-9118-0298629d94e1 could not be found. Sep 10 11:39:12.241665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:12.241665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:12.241665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:12.241665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:12.241665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:12.241665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:12.241665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:39:12.241665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:39:12.241665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 810c2316-10c5-47b4-9118-0298629d94e1 could not be found. Sep 10 11:39:12.241665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:12.242895 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c55f6579-a403-416d-a2a1-60c89ae2163f tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Returning 404 to user: Instance 810c2316-10c5-47b4-9118-0298629d94e1 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:39:12.243343 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c55f6579-a403-416d-a2a1-60c89ae2163f tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/810c2316-10c5-47b4-9118-0298629d94e1" status: 404 len: 111 microversion: 2.1 time: 0.092609 Sep 10 11:39:12.246625 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 208/416] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:12 2022] GET /compute/v2.1/servers/810c2316-10c5-47b4-9118-0298629d94e1 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:39:12.254728 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2898e712-45ed-4de8-ad0a-3da9adcdef67 tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:12.277654 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-749a72c7-c8c6-46eb-8ca0-5f475698b849 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:12.283431 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-749a72c7-c8c6-46eb-8ca0-5f475698b849 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 749908de-9f45-4b7f-9ce5-171d2cf11511] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:12.293509 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2898e712-45ed-4de8-ad0a-3da9adcdef67 tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1691505865" status: 202 len: 0 microversion: 2.1 time: 0.061149 Sep 10 11:39:12.294104 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 209/417] 10.222.0.23 () {58 vars in 1161 bytes} [Sat Sep 10 11:39:12 2022] DELETE /compute/v2.1/flavors/1691505865 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:39:12.298473 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-749a72c7-c8c6-46eb-8ca0-5f475698b849 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:12.299864 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-749a72c7-c8c6-46eb-8ca0-5f475698b849 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:12.300600 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-749a72c7-c8c6-46eb-8ca0-5f475698b849 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:12.301847 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-749a72c7-c8c6-46eb-8ca0-5f475698b849 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:12.302492 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-749a72c7-c8c6-46eb-8ca0-5f475698b849 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:12.303110 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-749a72c7-c8c6-46eb-8ca0-5f475698b849 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:12.305485 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c25c2cdd-a9c1-4668-b6f2-f7f0549b6aff tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:12.331338 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c25c2cdd-a9c1-4668-b6f2-f7f0549b6aff tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.032445 Sep 10 11:39:12.331891 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 210/418] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:39:12 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:39:12.353542 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-749a72c7-c8c6-46eb-8ca0-5f475698b849 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] HTTP exception thrown: Instance 749908de-9f45-4b7f-9ce5-171d2cf11511 could not be found. Sep 10 11:39:12.355804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a8de560f-4dc7-403d-bb58-e3f3c87ba04d tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-902553318", "id": 143736800, "os-flavor-access:is_public": "False"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:12.358225 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-749a72c7-c8c6-46eb-8ca0-5f475698b849 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Request method failure captured: Sep 10 11:39:12.358225 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511 HTTP/1.1 Sep 10 11:39:12.358225 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:39:12.358225 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:39:12.358225 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:39:12.358225 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:39:12.358225 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:39:12.358225 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:39:12.358225 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:39:12.358225 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:39:12.358225 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHcXl-_p7vgI4dby_qITzIhY55KdqBBP_6TYBDe1-vZ3vQLtFhnNKuZafnu4iFHGhqNTOMhJlRV-u1tvuhxUB0IQrpdLW4q9Ju-gqUTkenwnw7mqv5ryGW1KpkQbdTVUYpQYgxFcA7deHFC16m4dRTiLt_WhC-yJSPnJh72fs6TE474 Sep 10 11:39:12.358225 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:39:12.358225 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:39:12.358225 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:39:12.358225 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:39:12.358225 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:39:12.358225 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:39:12.358225 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: a040213a0ea443cd97b346b0d4e79d4d Sep 10 11:39:12.358225 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1489315855 Sep 10 11:39:12.358225 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:39:12.358225 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:39:12.359763 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a040213a0ea443cd97b346b0d4e79d4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a040213a0ea443cd97b346b0d4e79d4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a040213a0ea443cd97b346b0d4e79d4d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a040213a0ea443cd97b346b0d4e79d4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:39:12.359763 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-DeleteServersAdminTestJSON-1489315855 Sep 10 11:39:12.359763 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: a040213a0ea443cd97b346b0d4e79d4d Sep 10 11:39:12.359763 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1489315855 Sep 10 11:39:12.359763 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-DeleteServersAdminTestJSON-1489315855-project Sep 10 11:39:12.359763 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:39:12.359763 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:39:12.359763 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 53b632d0a5ac48fea0da5aa15632cffb Sep 10 11:39:12.359763 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-DeleteServersAdminTestJSON-1489315855-project Sep 10 11:39:12.359763 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:39:12.359763 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 749908de-9f45-4b7f-9ce5-171d2cf11511 could not be found. Sep 10 11:39:12.359763 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '749908de-9f45-4b7f-9ce5-171d2cf11511'} Sep 10 11:39:12.360601 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:39:12.360601 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:12.360601 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:39:12.360601 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:39:12.360601 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:39:12.360601 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:39:12.360601 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:39:12.360601 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:39:12.360601 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:39:12.360601 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:39:12.360601 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 749908de-9f45-4b7f-9ce5-171d2cf11511 could not be found. Sep 10 11:39:12.360601 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:12.360601 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:12.360601 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:12.360601 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:12.360601 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:12.360601 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:12.360601 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:39:12.360601 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:39:12.360601 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:39:12.363236 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:39:12.363236 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:39:12.363236 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:39:12.363236 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:39:12.363236 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:39:12.363236 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:39:12.363236 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:39:12.363236 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:39:12.363236 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:39:12.363236 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 749908de-9f45-4b7f-9ce5-171d2cf11511 could not be found. Sep 10 11:39:12.363236 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:12.363236 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:12.363236 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:12.363236 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:12.363236 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:12.363236 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:12.363236 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:39:12.363236 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:39:12.363236 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 749908de-9f45-4b7f-9ce5-171d2cf11511 could not be found. Sep 10 11:39:12.363236 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:12.364743 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-749a72c7-c8c6-46eb-8ca0-5f475698b849 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Returning 404 to user: Instance 749908de-9f45-4b7f-9ce5-171d2cf11511 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:39:12.367188 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-749a72c7-c8c6-46eb-8ca0-5f475698b849 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "DELETE /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511" status: 404 len: 111 microversion: 2.1 time: 0.099244 Sep 10 11:39:12.369337 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 209/419] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:39:12 2022] DELETE /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:39:12.374710 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ea20f800-3960-454a-8dd4-1ca85ddd4507 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:12.375550 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ea20f800-3960-454a-8dd4-1ca85ddd4507 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] [instance: 749908de-9f45-4b7f-9ce5-171d2cf11511] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:12.382175 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea20f800-3960-454a-8dd4-1ca85ddd4507 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:12.382771 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea20f800-3960-454a-8dd4-1ca85ddd4507 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:12.383306 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea20f800-3960-454a-8dd4-1ca85ddd4507 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:12.384119 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea20f800-3960-454a-8dd4-1ca85ddd4507 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:12.384855 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea20f800-3960-454a-8dd4-1ca85ddd4507 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:12.385526 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea20f800-3960-454a-8dd4-1ca85ddd4507 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:12.398449 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a8de560f-4dc7-403d-bb58-e3f3c87ba04d tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.046896 Sep 10 11:39:12.399872 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 211/420] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:39:12 2022] POST /compute/v2.1/flavors => generated 435 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:39:12.412604 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-ea20f800-3960-454a-8dd4-1ca85ddd4507 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] HTTP exception thrown: Instance 749908de-9f45-4b7f-9ce5-171d2cf11511 could not be found. Sep 10 11:39:12.415983 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f7d270ca-9bfa-4cb6-b269-88828e470237 tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2357d2c1e5b641cd81a6a9ed575b263e"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:12.416966 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ea20f800-3960-454a-8dd4-1ca85ddd4507 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Request method failure captured: Sep 10 11:39:12.416966 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511 HTTP/1.1 Sep 10 11:39:12.416966 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:39:12.416966 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:39:12.416966 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:39:12.416966 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:39:12.416966 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:39:12.416966 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:39:12.416966 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:39:12.416966 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:39:12.416966 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHcXl-_p7vgI4dby_qITzIhY55KdqBBP_6TYBDe1-vZ3vQLtFhnNKuZafnu4iFHGhqNTOMhJlRV-u1tvuhxUB0IQrpdLW4q9Ju-gqUTkenwnw7mqv5ryGW1KpkQbdTVUYpQYgxFcA7deHFC16m4dRTiLt_WhC-yJSPnJh72fs6TE474 Sep 10 11:39:12.416966 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:39:12.416966 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:39:12.416966 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:39:12.416966 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:39:12.416966 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:39:12.416966 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:39:12.416966 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: a040213a0ea443cd97b346b0d4e79d4d Sep 10 11:39:12.416966 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1489315855 Sep 10 11:39:12.416966 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:39:12.416966 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:39:12.418247 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a040213a0ea443cd97b346b0d4e79d4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a040213a0ea443cd97b346b0d4e79d4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a040213a0ea443cd97b346b0d4e79d4d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a040213a0ea443cd97b346b0d4e79d4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:39:12.418247 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-DeleteServersAdminTestJSON-1489315855 Sep 10 11:39:12.418247 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: a040213a0ea443cd97b346b0d4e79d4d Sep 10 11:39:12.418247 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1489315855 Sep 10 11:39:12.418247 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-DeleteServersAdminTestJSON-1489315855-project Sep 10 11:39:12.418247 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:39:12.418247 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:39:12.418247 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 53b632d0a5ac48fea0da5aa15632cffb Sep 10 11:39:12.418247 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-DeleteServersAdminTestJSON-1489315855-project Sep 10 11:39:12.418247 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:39:12.418247 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 749908de-9f45-4b7f-9ce5-171d2cf11511 could not be found. Sep 10 11:39:12.418247 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '749908de-9f45-4b7f-9ce5-171d2cf11511'} Sep 10 11:39:12.418905 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:39:12.418905 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:12.418905 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:39:12.418905 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:39:12.418905 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:39:12.418905 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:39:12.418905 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:39:12.418905 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:39:12.418905 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:39:12.418905 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:39:12.418905 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 749908de-9f45-4b7f-9ce5-171d2cf11511 could not be found. Sep 10 11:39:12.418905 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:12.418905 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:12.418905 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:12.418905 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:12.418905 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:12.418905 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:12.418905 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:39:12.418905 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:39:12.418905 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:39:12.420184 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:39:12.420184 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:39:12.420184 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:39:12.420184 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:39:12.420184 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:39:12.420184 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:39:12.420184 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:39:12.420184 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 749908de-9f45-4b7f-9ce5-171d2cf11511 could not be found. Sep 10 11:39:12.420184 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:12.420184 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:12.420184 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:12.420184 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:12.420184 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:12.420184 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:12.420184 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:39:12.420184 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:39:12.420184 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 749908de-9f45-4b7f-9ce5-171d2cf11511 could not be found. Sep 10 11:39:12.420184 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:12.423109 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ea20f800-3960-454a-8dd4-1ca85ddd4507 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] Returning 404 to user: Instance 749908de-9f45-4b7f-9ce5-171d2cf11511 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:39:12.424855 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ea20f800-3960-454a-8dd4-1ca85ddd4507 tempest-DeleteServersAdminTestJSON-1489315855 tempest-DeleteServersAdminTestJSON-1489315855-project] 10.222.0.23 "GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511" status: 404 len: 111 microversion: 2.1 time: 0.053876 Sep 10 11:39:12.426001 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 210/421] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:12 2022] GET /compute/v2.1/servers/749908de-9f45-4b7f-9ce5-171d2cf11511 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:39:12.526242 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-57495b95-1437-4b01-be19-1603c286a4ff req-2edb52c0-9539-47c8-9ce2-7a5034424298 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f", "name": "network-vif-unplugged", "status": "completed", "tag": "ea955540-4c57-4a66-aec1-116d10e8a2f8"}, {"name": "network-changed", "server_uuid": "e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f", "tag": "ea955540-4c57-4a66-aec1-116d10e8a2f8"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:12.547026 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-57495b95-1437-4b01-be19-1603c286a4ff req-2edb52c0-9539-47c8-9ce2-7a5034424298 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:12.547625 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-57495b95-1437-4b01-be19-1603c286a4ff req-2edb52c0-9539-47c8-9ce2-7a5034424298 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:12.548075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-57495b95-1437-4b01-be19-1603c286a4ff req-2edb52c0-9539-47c8-9ce2-7a5034424298 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:12.580018 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-57495b95-1437-4b01-be19-1603c286a4ff req-2edb52c0-9539-47c8-9ce2-7a5034424298 service nova] Creating event network-vif-unplugged:ea955540-4c57-4a66-aec1-116d10e8a2f8 for instance e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f on n-h2-856895-1 Sep 10 11:39:12.581208 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-57495b95-1437-4b01-be19-1603c286a4ff req-2edb52c0-9539-47c8-9ce2-7a5034424298 service nova] Creating event network-changed:ea955540-4c57-4a66-aec1-116d10e8a2f8 for instance e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f on n-h2-856895-1 Sep 10 11:39:12.594543 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-57495b95-1437-4b01-be19-1603c286a4ff req-2edb52c0-9539-47c8-9ce2-7a5034424298 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.072145 Sep 10 11:39:12.597100 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 211/422] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:39:12.685247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-93d222f8-913c-4da2-ac12-6d6ade91b38b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:12.686076 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-93d222f8-913c-4da2-ac12-6d6ade91b38b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:12.693271 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-93d222f8-913c-4da2-ac12-6d6ade91b38b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:12.693820 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-93d222f8-913c-4da2-ac12-6d6ade91b38b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:12.694295 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-93d222f8-913c-4da2-ac12-6d6ade91b38b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:12.695005 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-93d222f8-913c-4da2-ac12-6d6ade91b38b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:12.702056 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-93d222f8-913c-4da2-ac12-6d6ade91b38b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:12.702560 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-93d222f8-913c-4da2-ac12-6d6ade91b38b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:13.005585 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-93d222f8-913c-4da2-ac12-6d6ade91b38b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:13.021285 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-93d222f8-913c-4da2-ac12-6d6ade91b38b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f" status: 200 len: 1504 microversion: 2.1 time: 0.343357 Sep 10 11:39:13.021996 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 212/423] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:12 2022] GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f => generated 1504 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:39:13.258883 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-63d7c72d-94e8-455c-b449-9026f7705139 tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:13.259686 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-63d7c72d-94e8-455c-b449-9026f7705139 tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] [instance: 966031ed-9a06-4a3d-92f7-96adcfa7e364] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:13.272594 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-63d7c72d-94e8-455c-b449-9026f7705139 tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:13.282929 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-63d7c72d-94e8-455c-b449-9026f7705139 tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:13.283821 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-63d7c72d-94e8-455c-b449-9026f7705139 tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:13.286829 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-63d7c72d-94e8-455c-b449-9026f7705139 tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:13.294326 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-63d7c72d-94e8-455c-b449-9026f7705139 tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:13.297381 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-63d7c72d-94e8-455c-b449-9026f7705139 tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:13.428407 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-f7d270ca-9bfa-4cb6-b269-88828e470237 tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] HTTP exception thrown: Flavor access not found for 37 / 2357d2c1e5b641cd81a6a9ed575b263e combination. Sep 10 11:39:13.435427 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f7d270ca-9bfa-4cb6-b269-88828e470237 tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] Request method failure captured: Sep 10 11:39:13.435427 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/flavors/143736800/action HTTP/1.1 Sep 10 11:39:13.435427 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:39:13.435427 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:39:13.435427 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:39:13.435427 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 70 Sep 10 11:39:13.435427 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:39:13.435427 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:39:13.435427 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:39:13.435427 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:39:13.435427 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHdaC14shzqtHSSxic-KrmYbsZj4TZ2P8a9VIEi9MkHqsFuKKfS2ftn5J_t80nrxvGWoa7W3T4GFoVfMFAB0uO8uWQUfBZfbeSHYJnSqRjhTGaEbfuzXOnhWB4L_DFulaSchC5zgfBL6EJD34CE8PgLyGHUgqecC_MPgi5ff_MNQqmw Sep 10 11:39:13.435427 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:39:13.435427 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:39:13.435427 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:39:13.435427 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:39:13.435427 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:39:13.435427 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:39:13.435427 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: b6964506f7d64a76bfba5b83826b79ee Sep 10 11:39:13.435427 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-637372514 Sep 10 11:39:13.435427 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,admin,member Sep 10 11:39:13.435427 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,admin,member Sep 10 11:39:13.436698 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b6964506f7d64a76bfba5b83826b79ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b6964506f7d64a76bfba5b83826b79ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b6964506f7d64a76bfba5b83826b79ee", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b6964506f7d64a76bfba5b83826b79ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:39:13.436698 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-637372514 Sep 10 11:39:13.436698 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: b6964506f7d64a76bfba5b83826b79ee Sep 10 11:39:13.436698 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-637372514 Sep 10 11:39:13.436698 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin Sep 10 11:39:13.436698 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:39:13.436698 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:39:13.436698 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 301076575a9047d59731ffcd2ad99759 Sep 10 11:39:13.436698 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin Sep 10 11:39:13.436698 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 11:39:13.436698 n-d-856895-1 devstack@n-api.service[128776]: {"removeTenantAccess": {"tenant": "2357d2c1e5b641cd81a6a9ed575b263e"}} Sep 10 11:39:13.436698 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:39:13.437822 n-d-856895-1 devstack@n-api.service[128776]: exception: Flavor access not found for 37 / 2357d2c1e5b641cd81a6a9ed575b263e combination. Sep 10 11:39:13.437822 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '143736800', 'body': {'removeTenantAccess': {'tenant': '2357d2c1e5b641cd81a6a9ed575b263e'}}} Sep 10 11:39:13.437822 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:39:13.437822 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:13.437822 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Sep 10 11:39:13.437822 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Sep 10 11:39:13.437822 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 10 11:39:13.437822 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 10 11:39:13.437822 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Sep 10 11:39:13.437822 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Sep 10 11:39:13.437822 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Sep 10 11:39:13.437822 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Sep 10 11:39:13.437822 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Sep 10 11:39:13.437822 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Sep 10 11:39:13.437822 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 11:39:13.437822 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 11:39:13.437822 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Sep 10 11:39:13.437822 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Sep 10 11:39:13.439140 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 37 / 2357d2c1e5b641cd81a6a9ed575b263e combination. Sep 10 11:39:13.439140 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:13.439140 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:13.439140 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:13.439140 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:13.439140 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:13.439140 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:13.439140 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:39:13.439140 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:39:13.439140 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:39:13.439140 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:39:13.439140 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:39:13.439140 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:39:13.439140 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Sep 10 11:39:13.439140 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:39:13.439140 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 37 / 2357d2c1e5b641cd81a6a9ed575b263e combination. Sep 10 11:39:13.439140 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:13.439140 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:13.439140 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:13.439140 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:13.441511 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:13.441511 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:13.441511 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:39:13.441511 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:39:13.441511 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 37 / 2357d2c1e5b641cd81a6a9ed575b263e combination. Sep 10 11:39:13.441511 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:13.445816 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f7d270ca-9bfa-4cb6-b269-88828e470237 tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] Returning 404 to user: Flavor access not found for 37 / 2357d2c1e5b641cd81a6a9ed575b263e combination. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:39:13.449597 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f7d270ca-9bfa-4cb6-b269-88828e470237 tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/143736800/action" status: 404 len: 124 microversion: 2.1 time: 1.040128 Sep 10 11:39:13.456000 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 212/424] 10.222.0.23 () {60 vars in 1197 bytes} [Sat Sep 10 11:39:12 2022] POST /compute/v2.1/flavors/143736800/action => generated 124 bytes in 1046 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:39:13.465945 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ad2b428e-bfa9-4134-b5ca-720c00d7b91f tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:13.520659 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ad2b428e-bfa9-4134-b5ca-720c00d7b91f tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/143736800" status: 202 len: 0 microversion: 2.1 time: 0.062887 Sep 10 11:39:13.521695 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 213/425] 10.222.0.23 () {58 vars in 1158 bytes} [Sat Sep 10 11:39:13 2022] DELETE /compute/v2.1/flavors/143736800 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:39:13.531608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c99ca317-c955-4239-92ff-90d6a77cfccb tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:13.583334 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-63d7c72d-94e8-455c-b449-9026f7705139 tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/966031ed-9a06-4a3d-92f7-96adcfa7e364" status: 200 len: 1612 microversion: 2.1 time: 0.331817 Sep 10 11:39:13.583978 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c99ca317-c955-4239-92ff-90d6a77cfccb tempest-FlavorsAccessNegativeTestJSON-637372514 tempest-FlavorsAccessNegativeTestJSON-637372514-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.057637 Sep 10 11:39:13.587318 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 213/426] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:13 2022] GET /compute/v2.1/servers/966031ed-9a06-4a3d-92f7-96adcfa7e364 => generated 1612 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:39:13.588351 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 214/427] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:39:13 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:13.613054 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1b7d7990-a5b4-4135-be7c-f4cb66a3d30c tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:13.613633 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1b7d7990-a5b4-4135-be7c-f4cb66a3d30c tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] [instance: 966031ed-9a06-4a3d-92f7-96adcfa7e364] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:13.628684 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b7d7990-a5b4-4135-be7c-f4cb66a3d30c tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:13.629166 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b7d7990-a5b4-4135-be7c-f4cb66a3d30c tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:13.630585 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b7d7990-a5b4-4135-be7c-f4cb66a3d30c tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:13.630585 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b7d7990-a5b4-4135-be7c-f4cb66a3d30c tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:13.630787 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b7d7990-a5b4-4135-be7c-f4cb66a3d30c tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:13.631143 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b7d7990-a5b4-4135-be7c-f4cb66a3d30c tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:13.752927 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-1b7d7990-a5b4-4135-be7c-f4cb66a3d30c tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] HTTP exception thrown: Cannot 'migrate' instance 966031ed-9a06-4a3d-92f7-96adcfa7e364 while it is in vm_state suspended Sep 10 11:39:13.754790 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1b7d7990-a5b4-4135-be7c-f4cb66a3d30c tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Request method failure captured: Sep 10 11:39:13.754790 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers/966031ed-9a06-4a3d-92f7-96adcfa7e364/action HTTP/1.1 Sep 10 11:39:13.754790 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:39:13.754790 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:39:13.754790 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:39:13.754790 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 15 Sep 10 11:39:13.754790 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:39:13.754790 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:39:13.754790 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:39:13.754790 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:39:13.754790 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHc4_F0tNAExskgexgV7fMjvrq1d3bxjxQaj33mc2GLrEkISohR83aFYjnG9kdcXL2x5sr7UdXpgs5WTWdSPum1ob47Pv0AHqX1qH3LoLJINbaKHjymeuJ56ebxv_p5pKSHdT6O5XV77o6-48QSS9f9X2mbEBmLP0JlbgsKMen32P-E Sep 10 11:39:13.754790 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:39:13.754790 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:39:13.754790 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:39:13.754790 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:39:13.754790 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:39:13.754790 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:39:13.754790 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: f42645262cc346ca85abc49a69f5f9b9 Sep 10 11:39:13.754790 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-486642793 Sep 10 11:39:13.754790 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,admin,member Sep 10 11:39:13.754790 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,admin,member Sep 10 11:39:13.756160 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f42645262cc346ca85abc49a69f5f9b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f42645262cc346ca85abc49a69f5f9b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f42645262cc346ca85abc49a69f5f9b9", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f42645262cc346ca85abc49a69f5f9b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:39:13.756160 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersAdminNegativeTestJSON-486642793 Sep 10 11:39:13.756160 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: f42645262cc346ca85abc49a69f5f9b9 Sep 10 11:39:13.756160 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-486642793 Sep 10 11:39:13.756160 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersAdminNegativeTestJSON-486642793-project-admin Sep 10 11:39:13.756160 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:39:13.756160 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:39:13.756160 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: ae71c1cae8744694bbce6d52821438bb Sep 10 11:39:13.756160 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersAdminNegativeTestJSON-486642793-project-admin Sep 10 11:39:13.756160 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:39:13.756160 n-d-856895-1 devstack@n-api.service[128777]: {"migrate": {}} Sep 10 11:39:13.756160 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:39:13.756160 n-d-856895-1 devstack@n-api.service[128777]: exception: Cannot 'migrate' instance 966031ed-9a06-4a3d-92f7-96adcfa7e364 while it is in vm_state suspended Sep 10 11:39:13.757682 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '966031ed-9a06-4a3d-92f7-96adcfa7e364', 'body': {'migrate': {}}} Sep 10 11:39:13.757682 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:39:13.757682 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:13.757682 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Sep 10 11:39:13.757682 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Sep 10 11:39:13.757682 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 10 11:39:13.757682 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 11:39:13.757682 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 10 11:39:13.757682 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 11:39:13.757682 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 10 11:39:13.757682 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 11:39:13.757682 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 11:39:13.757682 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 11:39:13.757682 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 11:39:13.757682 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 11:39:13.757682 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 966031ed-9a06-4a3d-92f7-96adcfa7e364 in vm_state suspended. Cannot resize while the instance is in this state. Sep 10 11:39:13.757682 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:13.757682 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:13.757682 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:13.757682 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:13.759040 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:13.759040 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:13.759040 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:39:13.759040 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:39:13.759040 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:39:13.759040 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:39:13.759040 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:39:13.759040 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:39:13.759040 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Sep 10 11:39:13.759040 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 10 11:39:13.759040 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 11:39:13.759040 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 11:39:13.759040 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 966031ed-9a06-4a3d-92f7-96adcfa7e364 while it is in vm_state suspended Sep 10 11:39:13.759040 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:13.759040 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:13.759040 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:13.759040 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:13.759040 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:13.759040 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:13.760332 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:39:13.760332 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:39:13.760332 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 966031ed-9a06-4a3d-92f7-96adcfa7e364 while it is in vm_state suspended Sep 10 11:39:13.760332 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:13.760332 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1b7d7990-a5b4-4135-be7c-f4cb66a3d30c tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Returning 409 to user: Cannot 'migrate' instance 966031ed-9a06-4a3d-92f7-96adcfa7e364 while it is in vm_state suspended {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:39:13.760332 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1b7d7990-a5b4-4135-be7c-f4cb66a3d30c tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/966031ed-9a06-4a3d-92f7-96adcfa7e364/action" status: 409 len: 148 microversion: 2.1 time: 0.147349 Sep 10 11:39:13.760332 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 214/428] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:39:13 2022] POST /compute/v2.1/servers/966031ed-9a06-4a3d-92f7-96adcfa7e364/action => generated 148 bytes in 149 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:39:13.767807 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c8aaaa18-ac78-4568-8f62-37da0c7529d6 tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:13.771913 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c8aaaa18-ac78-4568-8f62-37da0c7529d6 tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Request method failure captured: Sep 10 11:39:13.771913 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/servers/58290798-70af-44a5-85cc-20871f15c110/action HTTP/1.1 Sep 10 11:39:13.771913 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:39:13.771913 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:39:13.771913 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:39:13.771913 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 39 Sep 10 11:39:13.771913 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:39:13.771913 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:39:13.771913 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:39:13.771913 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:39:13.771913 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHc4_F0tNAExskgexgV7fMjvrq1d3bxjxQaj33mc2GLrEkISohR83aFYjnG9kdcXL2x5sr7UdXpgs5WTWdSPum1ob47Pv0AHqX1qH3LoLJINbaKHjymeuJ56ebxv_p5pKSHdT6O5XV77o6-48QSS9f9X2mbEBmLP0JlbgsKMen32P-E Sep 10 11:39:13.771913 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:39:13.771913 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:39:13.771913 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:39:13.771913 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:39:13.771913 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:39:13.771913 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:39:13.771913 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: f42645262cc346ca85abc49a69f5f9b9 Sep 10 11:39:13.771913 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-486642793 Sep 10 11:39:13.771913 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,admin,member Sep 10 11:39:13.771913 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,admin,member Sep 10 11:39:13.773335 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f42645262cc346ca85abc49a69f5f9b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f42645262cc346ca85abc49a69f5f9b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f42645262cc346ca85abc49a69f5f9b9", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f42645262cc346ca85abc49a69f5f9b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:39:13.773335 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersAdminNegativeTestJSON-486642793 Sep 10 11:39:13.773335 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: f42645262cc346ca85abc49a69f5f9b9 Sep 10 11:39:13.773335 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-486642793 Sep 10 11:39:13.773335 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersAdminNegativeTestJSON-486642793-project-admin Sep 10 11:39:13.773335 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:39:13.773335 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:39:13.773335 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: ae71c1cae8744694bbce6d52821438bb Sep 10 11:39:13.773335 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersAdminNegativeTestJSON-486642793-project-admin Sep 10 11:39:13.773335 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 11:39:13.773335 n-d-856895-1 devstack@n-api.service[128776]: {"os-resetState": {"state": "invalid"}} Sep 10 11:39:13.773335 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:39:13.773989 n-d-856895-1 devstack@n-api.service[128776]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 10 11:39:13.773989 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '58290798-70af-44a5-85cc-20871f15c110', 'body': {'os-resetState': {'state': 'invalid'}}} Sep 10 11:39:13.773989 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:39:13.773989 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:13.773989 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 11:39:13.773989 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 11:39:13.773989 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 11:39:13.773989 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise error Sep 10 11:39:13.773989 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Sep 10 11:39:13.773989 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:13.773989 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Sep 10 11:39:13.773989 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 10 11:39:13.773989 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:13.773989 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 10 11:39:13.773989 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'invalid' Sep 10 11:39:13.773989 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:13.773989 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:13.773989 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:13.773989 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:13.773989 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:13.773989 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:13.773989 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:39:13.775443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:39:13.775443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:39:13.775443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:39:13.775443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 11:39:13.775443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 11:39:13.775443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 11:39:13.775443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 11:39:13.775443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 11:39:13.775443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 11:39:13.775443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 10 11:39:13.775443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:13.775443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:13.775443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:13.775443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:13.775443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:13.775443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:13.775443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 11:39:13.775443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 11:39:13.775443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 10 11:39:13.776680 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:13.777426 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c8aaaa18-ac78-4568-8f62-37da0c7529d6 tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:39:13.779466 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c8aaaa18-ac78-4568-8f62-37da0c7529d6 tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/58290798-70af-44a5-85cc-20871f15c110/action" status: 400 len: 144 microversion: 2.1 time: 0.015397 Sep 10 11:39:13.781793 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 215/429] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:39:13 2022] POST /compute/v2.1/servers/58290798-70af-44a5-85cc-20871f15c110/action => generated 144 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:39:13.793157 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-371bd3dd-1afc-46ee-b89f-bb1331cef6a8 tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:13.796833 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-371bd3dd-1afc-46ee-b89f-bb1331cef6a8 tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Request method failure captured: Sep 10 11:39:13.796833 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers/58290798-70af-44a5-85cc-20871f15c110/action HTTP/1.1 Sep 10 11:39:13.796833 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:39:13.796833 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:39:13.796833 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:39:13.796833 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 31 Sep 10 11:39:13.796833 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:39:13.796833 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:39:13.796833 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:39:13.796833 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:39:13.796833 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHc4_F0tNAExskgexgV7fMjvrq1d3bxjxQaj33mc2GLrEkISohR83aFYjnG9kdcXL2x5sr7UdXpgs5WTWdSPum1ob47Pv0AHqX1qH3LoLJINbaKHjymeuJ56ebxv_p5pKSHdT6O5XV77o6-48QSS9f9X2mbEBmLP0JlbgsKMen32P-E Sep 10 11:39:13.796833 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:39:13.796833 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:39:13.796833 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:39:13.796833 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:39:13.796833 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:39:13.796833 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:39:13.796833 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: f42645262cc346ca85abc49a69f5f9b9 Sep 10 11:39:13.796833 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-486642793 Sep 10 11:39:13.796833 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,admin,member Sep 10 11:39:13.796833 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,admin,member Sep 10 11:39:13.798201 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f42645262cc346ca85abc49a69f5f9b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f42645262cc346ca85abc49a69f5f9b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f42645262cc346ca85abc49a69f5f9b9", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f42645262cc346ca85abc49a69f5f9b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:39:13.798201 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersAdminNegativeTestJSON-486642793 Sep 10 11:39:13.798201 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: f42645262cc346ca85abc49a69f5f9b9 Sep 10 11:39:13.798201 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-486642793 Sep 10 11:39:13.798201 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersAdminNegativeTestJSON-486642793-project-admin Sep 10 11:39:13.798201 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:39:13.798201 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:39:13.798201 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: ae71c1cae8744694bbce6d52821438bb Sep 10 11:39:13.798201 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersAdminNegativeTestJSON-486642793-project-admin Sep 10 11:39:13.798201 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:39:13.798201 n-d-856895-1 devstack@n-api.service[128777]: {"os-resetState": {"state": 1}} Sep 10 11:39:13.798201 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:39:13.798201 n-d-856895-1 devstack@n-api.service[128777]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 10 11:39:13.799035 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '58290798-70af-44a5-85cc-20871f15c110', 'body': {'os-resetState': {'state': 1}}} Sep 10 11:39:13.799035 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:39:13.799035 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:13.799035 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 11:39:13.799035 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 11:39:13.799035 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 11:39:13.799035 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise error Sep 10 11:39:13.799035 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Sep 10 11:39:13.799035 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:13.799035 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Sep 10 11:39:13.799035 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 10 11:39:13.799035 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:13.799035 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 10 11:39:13.799035 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi 1 Sep 10 11:39:13.799035 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:13.799035 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:13.799035 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:13.799035 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:13.799035 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:13.799035 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:13.799035 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:39:13.799035 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:39:13.800407 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:39:13.800407 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:39:13.800407 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 11:39:13.800407 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 11:39:13.800407 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 11:39:13.800407 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 11:39:13.800407 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 11:39:13.800407 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 11:39:13.800407 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 10 11:39:13.800407 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:13.800407 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:13.800407 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:13.800407 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:13.800407 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:13.800407 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:13.800407 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 11:39:13.800407 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 11:39:13.800407 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 10 11:39:13.800407 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:13.802305 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-371bd3dd-1afc-46ee-b89f-bb1331cef6a8 tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:39:13.803343 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-371bd3dd-1afc-46ee-b89f-bb1331cef6a8 tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/58290798-70af-44a5-85cc-20871f15c110/action" status: 400 len: 120 microversion: 2.1 time: 0.013940 Sep 10 11:39:13.810029 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 215/430] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:39:13 2022] POST /compute/v2.1/servers/58290798-70af-44a5-85cc-20871f15c110/action => generated 120 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:39:13.824118 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-576ba450-fb58-4bb6-8191-db7161ea678d tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:13.826811 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-576ba450-fb58-4bb6-8191-db7161ea678d tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Failed to fetch instance by id 999 {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 10 11:39:13.827554 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-576ba450-fb58-4bb6-8191-db7161ea678d tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] HTTP exception thrown: Instance 999 could not be found. Sep 10 11:39:13.837242 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-576ba450-fb58-4bb6-8191-db7161ea678d tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Request method failure captured: Sep 10 11:39:13.837242 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Sep 10 11:39:13.837242 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:39:13.837242 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:39:13.837242 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:39:13.837242 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 37 Sep 10 11:39:13.837242 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:39:13.837242 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:39:13.837242 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:39:13.837242 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:39:13.837242 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHc4_F0tNAExskgexgV7fMjvrq1d3bxjxQaj33mc2GLrEkISohR83aFYjnG9kdcXL2x5sr7UdXpgs5WTWdSPum1ob47Pv0AHqX1qH3LoLJINbaKHjymeuJ56ebxv_p5pKSHdT6O5XV77o6-48QSS9f9X2mbEBmLP0JlbgsKMen32P-E Sep 10 11:39:13.837242 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:39:13.837242 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:39:13.837242 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:39:13.837242 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:39:13.837242 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:39:13.837242 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:39:13.837242 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: f42645262cc346ca85abc49a69f5f9b9 Sep 10 11:39:13.837242 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-486642793 Sep 10 11:39:13.837242 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,admin,member Sep 10 11:39:13.837242 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,admin,member Sep 10 11:39:13.838825 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f42645262cc346ca85abc49a69f5f9b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f42645262cc346ca85abc49a69f5f9b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f42645262cc346ca85abc49a69f5f9b9", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f42645262cc346ca85abc49a69f5f9b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:39:13.838825 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersAdminNegativeTestJSON-486642793 Sep 10 11:39:13.838825 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: f42645262cc346ca85abc49a69f5f9b9 Sep 10 11:39:13.838825 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-486642793 Sep 10 11:39:13.838825 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersAdminNegativeTestJSON-486642793-project-admin Sep 10 11:39:13.838825 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:39:13.838825 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:39:13.838825 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: ae71c1cae8744694bbce6d52821438bb Sep 10 11:39:13.838825 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersAdminNegativeTestJSON-486642793-project-admin Sep 10 11:39:13.838825 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 11:39:13.838825 n-d-856895-1 devstack@n-api.service[128776]: {"os-resetState": {"state": "error"}} Sep 10 11:39:13.838825 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:39:13.838825 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 999 could not be found. Sep 10 11:39:13.839736 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Sep 10 11:39:13.839736 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:39:13.839736 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:13.839736 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:39:13.839736 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:39:13.839736 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 10 11:39:13.839736 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 10 11:39:13.839736 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 10 11:39:13.839736 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:13.839736 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:13.839736 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:13.839736 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:13.839736 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:13.839736 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:13.839736 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:39:13.839736 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:39:13.839736 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:39:13.839736 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:39:13.839736 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:39:13.839736 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:39:13.839736 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Sep 10 11:39:13.841514 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 10 11:39:13.841514 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:39:13.841514 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:39:13.841514 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 10 11:39:13.841514 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:13.841514 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:13.841514 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:13.841514 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:13.841514 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:13.841514 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:13.841514 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:39:13.841514 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:39:13.841514 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 10 11:39:13.841514 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:13.845251 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-576ba450-fb58-4bb6-8191-db7161ea678d tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:39:13.847778 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-576ba450-fb58-4bb6-8191-db7161ea678d tempest-ServersAdminNegativeTestJSON-486642793 tempest-ServersAdminNegativeTestJSON-486642793-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.035830 Sep 10 11:39:13.848924 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 216/431] 10.222.0.23 () {60 vars in 1179 bytes} [Sat Sep 10 11:39:13 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:39:13.860989 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4db1b062-8d05-4f2b-b226-fdc1e51453b8 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:13.862531 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4db1b062-8d05-4f2b-b226-fdc1e51453b8 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] [instance: 966031ed-9a06-4a3d-92f7-96adcfa7e364] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:13.876752 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4db1b062-8d05-4f2b-b226-fdc1e51453b8 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:13.879126 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4db1b062-8d05-4f2b-b226-fdc1e51453b8 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:13.881474 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4db1b062-8d05-4f2b-b226-fdc1e51453b8 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:13.884177 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4db1b062-8d05-4f2b-b226-fdc1e51453b8 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:13.884662 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4db1b062-8d05-4f2b-b226-fdc1e51453b8 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:13.885107 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4db1b062-8d05-4f2b-b226-fdc1e51453b8 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:13.972910 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4db1b062-8d05-4f2b-b226-fdc1e51453b8 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] [instance: 966031ed-9a06-4a3d-92f7-96adcfa7e364] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:39:14.051478 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4f6375ec-1665-49f5-94fb-472b5e56475a tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:14.052376 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4f6375ec-1665-49f5-94fb-472b5e56475a tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:14.065144 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f6375ec-1665-49f5-94fb-472b5e56475a tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:14.066008 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f6375ec-1665-49f5-94fb-472b5e56475a tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:14.066716 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f6375ec-1665-49f5-94fb-472b5e56475a tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:14.067965 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f6375ec-1665-49f5-94fb-472b5e56475a tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:14.068818 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f6375ec-1665-49f5-94fb-472b5e56475a tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:14.069687 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f6375ec-1665-49f5-94fb-472b5e56475a tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:14.120054 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:39:14.232106 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4db1b062-8d05-4f2b-b226-fdc1e51453b8 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] 10.222.0.23 "DELETE /compute/v2.1/servers/966031ed-9a06-4a3d-92f7-96adcfa7e364" status: 204 len: 0 microversion: 2.1 time: 0.377967 Sep 10 11:39:14.232901 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 216/432] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:39:13 2022] DELETE /compute/v2.1/servers/966031ed-9a06-4a3d-92f7-96adcfa7e364 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:39:14.260359 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-06baa60f-4298-41a5-b792-b11e1022dd37 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:14.264731 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-06baa60f-4298-41a5-b792-b11e1022dd37 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] [instance: 966031ed-9a06-4a3d-92f7-96adcfa7e364] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:14.296839 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06baa60f-4298-41a5-b792-b11e1022dd37 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:14.298048 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06baa60f-4298-41a5-b792-b11e1022dd37 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:14.300920 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06baa60f-4298-41a5-b792-b11e1022dd37 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:14.303046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06baa60f-4298-41a5-b792-b11e1022dd37 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:14.313022 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06baa60f-4298-41a5-b792-b11e1022dd37 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:14.313828 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06baa60f-4298-41a5-b792-b11e1022dd37 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:14.321412 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4f6375ec-1665-49f5-94fb-472b5e56475a tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:14.331074 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4f6375ec-1665-49f5-94fb-472b5e56475a tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f" status: 200 len: 1504 microversion: 2.1 time: 0.286343 Sep 10 11:39:14.332038 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 217/433] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:14 2022] GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f => generated 1504 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:39:14.588968 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-06baa60f-4298-41a5-b792-b11e1022dd37 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c91799a8724c499cd1afe82e3fd657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95726b0caac4b7fb5f0db90d268430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:14.612053 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-06baa60f-4298-41a5-b792-b11e1022dd37 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] 10.222.0.23 "GET /compute/v2.1/servers/966031ed-9a06-4a3d-92f7-96adcfa7e364" status: 200 len: 1467 microversion: 2.1 time: 0.373196 Sep 10 11:39:14.613199 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 217/434] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:14 2022] GET /compute/v2.1/servers/966031ed-9a06-4a3d-92f7-96adcfa7e364 => generated 1467 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:15.355394 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-63c4946b-e06c-4d6a-a6c4-a0e66a387859 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:15.357478 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-63c4946b-e06c-4d6a-a6c4-a0e66a387859 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:15.365989 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-63c4946b-e06c-4d6a-a6c4-a0e66a387859 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:15.366943 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-63c4946b-e06c-4d6a-a6c4-a0e66a387859 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:15.367641 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-63c4946b-e06c-4d6a-a6c4-a0e66a387859 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:15.368417 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-63c4946b-e06c-4d6a-a6c4-a0e66a387859 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:15.369123 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-63c4946b-e06c-4d6a-a6c4-a0e66a387859 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:15.369760 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-63c4946b-e06c-4d6a-a6c4-a0e66a387859 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:15.636643 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f7b7f553-490e-4f0f-9156-21958e892806 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:15.637331 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f7b7f553-490e-4f0f-9156-21958e892806 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] [instance: 966031ed-9a06-4a3d-92f7-96adcfa7e364] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:15.646246 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f7b7f553-490e-4f0f-9156-21958e892806 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:15.650426 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f7b7f553-490e-4f0f-9156-21958e892806 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:15.651394 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f7b7f553-490e-4f0f-9156-21958e892806 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:15.652281 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f7b7f553-490e-4f0f-9156-21958e892806 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:15.654044 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f7b7f553-490e-4f0f-9156-21958e892806 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:15.656737 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f7b7f553-490e-4f0f-9156-21958e892806 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:15.699403 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-63c4946b-e06c-4d6a-a6c4-a0e66a387859 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:15.717840 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-63c4946b-e06c-4d6a-a6c4-a0e66a387859 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f" status: 200 len: 1504 microversion: 2.1 time: 0.366356 Sep 10 11:39:15.718420 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 218/435] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:15 2022] GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f => generated 1504 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:15.905548 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f7b7f553-490e-4f0f-9156-21958e892806 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c91799a8724c499cd1afe82e3fd657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95726b0caac4b7fb5f0db90d268430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:15.924070 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f7b7f553-490e-4f0f-9156-21958e892806 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] 10.222.0.23 "GET /compute/v2.1/servers/966031ed-9a06-4a3d-92f7-96adcfa7e364" status: 200 len: 1467 microversion: 2.1 time: 0.290376 Sep 10 11:39:15.939572 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 218/436] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:15 2022] GET /compute/v2.1/servers/966031ed-9a06-4a3d-92f7-96adcfa7e364 => generated 1467 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:39:16.746720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2f9147ee-425f-4d7b-95a6-0bc025b688f4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:16.748221 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2f9147ee-425f-4d7b-95a6-0bc025b688f4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:16.754851 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=26 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:39:16.762732 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f9147ee-425f-4d7b-95a6-0bc025b688f4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:16.764015 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f9147ee-425f-4d7b-95a6-0bc025b688f4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:16.765628 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f9147ee-425f-4d7b-95a6-0bc025b688f4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:16.766815 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f9147ee-425f-4d7b-95a6-0bc025b688f4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:16.768500 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f9147ee-425f-4d7b-95a6-0bc025b688f4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:16.769174 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f9147ee-425f-4d7b-95a6-0bc025b688f4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:16.953200 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1f033a01-39bc-4340-ab40-a6476a1915ba tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:16.953799 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1f033a01-39bc-4340-ab40-a6476a1915ba tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] [instance: 966031ed-9a06-4a3d-92f7-96adcfa7e364] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:16.967534 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1f033a01-39bc-4340-ab40-a6476a1915ba tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:16.972964 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1f033a01-39bc-4340-ab40-a6476a1915ba tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:16.973719 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1f033a01-39bc-4340-ab40-a6476a1915ba tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:16.974459 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1f033a01-39bc-4340-ab40-a6476a1915ba tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:16.974921 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1f033a01-39bc-4340-ab40-a6476a1915ba tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:16.975385 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1f033a01-39bc-4340-ab40-a6476a1915ba tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:17.208415 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2f9147ee-425f-4d7b-95a6-0bc025b688f4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:17.222308 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2f9147ee-425f-4d7b-95a6-0bc025b688f4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f" status: 200 len: 1504 microversion: 2.1 time: 0.481864 Sep 10 11:39:17.222895 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 219/437] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:16 2022] GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f => generated 1504 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:17.247623 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1f033a01-39bc-4340-ab40-a6476a1915ba tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c91799a8724c499cd1afe82e3fd657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95726b0caac4b7fb5f0db90d268430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:17.263947 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1f033a01-39bc-4340-ab40-a6476a1915ba tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] 10.222.0.23 "GET /compute/v2.1/servers/966031ed-9a06-4a3d-92f7-96adcfa7e364" status: 200 len: 1425 microversion: 2.1 time: 0.315001 Sep 10 11:39:17.268699 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 219/438] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:16 2022] GET /compute/v2.1/servers/966031ed-9a06-4a3d-92f7-96adcfa7e364 => generated 1425 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:39:17.541669 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-a16fc8df-15ae-4430-ac71-805e4a0134b1 req-bd7d134a-ea34-4750-9fe1-9107147ecd98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "966031ed-9a06-4a3d-92f7-96adcfa7e364", "name": "network-vif-deleted", "tag": "cf4f7adf-c397-437b-b09a-56569661c04f"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:17.593592 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a16fc8df-15ae-4430-ac71-805e4a0134b1 req-bd7d134a-ea34-4750-9fe1-9107147ecd98 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:17.604100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a16fc8df-15ae-4430-ac71-805e4a0134b1 req-bd7d134a-ea34-4750-9fe1-9107147ecd98 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:17.605151 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a16fc8df-15ae-4430-ac71-805e4a0134b1 req-bd7d134a-ea34-4750-9fe1-9107147ecd98 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:17.641899 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-a16fc8df-15ae-4430-ac71-805e4a0134b1 req-bd7d134a-ea34-4750-9fe1-9107147ecd98 service nova] Creating event network-vif-deleted:cf4f7adf-c397-437b-b09a-56569661c04f for instance 966031ed-9a06-4a3d-92f7-96adcfa7e364 on n-h2-856895-1 Sep 10 11:39:17.653304 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-a16fc8df-15ae-4430-ac71-805e4a0134b1 req-bd7d134a-ea34-4750-9fe1-9107147ecd98 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118966 Sep 10 11:39:17.654067 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 220/439] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:39:18.160075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5d49d75e-ec1e-4d87-9030-589fb9e590b6 tempest-SecurityGroupsTestAdminJSON-1953955293 tempest-SecurityGroupsTestAdminJSON-1953955293-project] Action: 'create', calling method: .version_select at 0x7f4073681310>, body: {"security_group": {"name": "tempest-securitygroup-748116571", "description": "tempest-description-1510780314"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:18.246975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b0e77a90-d882-44b4-8e82-ab28e2090443 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:18.248975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b0e77a90-d882-44b4-8e82-ab28e2090443 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:18.264530 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b0e77a90-d882-44b4-8e82-ab28e2090443 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:18.266526 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b0e77a90-d882-44b4-8e82-ab28e2090443 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:18.266984 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b0e77a90-d882-44b4-8e82-ab28e2090443 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:18.271737 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b0e77a90-d882-44b4-8e82-ab28e2090443 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:18.272427 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b0e77a90-d882-44b4-8e82-ab28e2090443 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:18.273139 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b0e77a90-d882-44b4-8e82-ab28e2090443 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:18.654061 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b0e77a90-d882-44b4-8e82-ab28e2090443 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:18.671874 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b0e77a90-d882-44b4-8e82-ab28e2090443 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f" status: 200 len: 1504 microversion: 2.1 time: 0.426732 Sep 10 11:39:18.675013 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 221/440] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:18 2022] GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f => generated 1504 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:39:18.688162 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=14 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:39:18.697004 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6fc542b3-276c-4119-992b-2a3ebb763bfa tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:18.699725 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6fc542b3-276c-4119-992b-2a3ebb763bfa tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] [instance: 966031ed-9a06-4a3d-92f7-96adcfa7e364] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:18.715826 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6fc542b3-276c-4119-992b-2a3ebb763bfa tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:18.716523 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6fc542b3-276c-4119-992b-2a3ebb763bfa tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:18.717691 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6fc542b3-276c-4119-992b-2a3ebb763bfa tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:18.718567 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6fc542b3-276c-4119-992b-2a3ebb763bfa tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:18.723522 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6fc542b3-276c-4119-992b-2a3ebb763bfa tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:18.724063 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6fc542b3-276c-4119-992b-2a3ebb763bfa tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:18.748582 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-6fc542b3-276c-4119-992b-2a3ebb763bfa tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] HTTP exception thrown: Instance 966031ed-9a06-4a3d-92f7-96adcfa7e364 could not be found. Sep 10 11:39:18.751432 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6fc542b3-276c-4119-992b-2a3ebb763bfa tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Request method failure captured: Sep 10 11:39:18.751432 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/966031ed-9a06-4a3d-92f7-96adcfa7e364 HTTP/1.1 Sep 10 11:39:18.751432 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:39:18.751432 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:39:18.751432 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:39:18.751432 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:39:18.751432 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:39:18.751432 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:39:18.751432 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:39:18.751432 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:39:18.751432 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHc2weIiXuQBp8Wg_jBEA2mC9uglNr2faENChMZgZueuebIPasXRZsZD4PLpWaLfdqChRCuBDW63TiLQPenCqtrEMmHtK7AAyEwj1Rv_ttDvHhG2MAOn-dE1YkiJ_3ujmV375pRx1M9xkaY6Jx5fWsk32Yh06ixWU72IReGe7WYSKA0 Sep 10 11:39:18.751432 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:39:18.751432 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:39:18.751432 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:39:18.751432 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:39:18.751432 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:39:18.751432 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:39:18.751432 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: b95726b0caac4b7fb5f0db90d268430b Sep 10 11:39:18.751432 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1914935354 Sep 10 11:39:18.751432 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:39:18.751432 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:39:18.753591 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b95726b0caac4b7fb5f0db90d268430b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b95726b0caac4b7fb5f0db90d268430b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b95726b0caac4b7fb5f0db90d268430b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b95726b0caac4b7fb5f0db90d268430b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:39:18.753591 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1914935354 Sep 10 11:39:18.753591 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: b95726b0caac4b7fb5f0db90d268430b Sep 10 11:39:18.753591 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1914935354 Sep 10 11:39:18.753591 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersAdminNegativeTestJSON-1914935354-project Sep 10 11:39:18.753591 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:39:18.753591 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:39:18.753591 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 03c91799a8724c499cd1afe82e3fd657 Sep 10 11:39:18.753591 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1914935354-project Sep 10 11:39:18.753591 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:39:18.753591 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 966031ed-9a06-4a3d-92f7-96adcfa7e364 could not be found. Sep 10 11:39:18.753591 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '966031ed-9a06-4a3d-92f7-96adcfa7e364'} Sep 10 11:39:18.754381 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:39:18.754381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:18.754381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:39:18.754381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:39:18.754381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:39:18.754381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:39:18.754381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:39:18.754381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:39:18.754381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:39:18.754381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:39:18.754381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 966031ed-9a06-4a3d-92f7-96adcfa7e364 could not be found. Sep 10 11:39:18.754381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:18.754381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:18.754381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:18.754381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:18.754381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:18.754381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:18.754381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:39:18.754381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:39:18.754381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:39:18.755665 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:39:18.755665 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:39:18.755665 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:39:18.755665 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:39:18.755665 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:39:18.755665 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:39:18.755665 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:39:18.755665 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 966031ed-9a06-4a3d-92f7-96adcfa7e364 could not be found. Sep 10 11:39:18.755665 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:18.755665 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:18.755665 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:18.755665 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:18.755665 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:18.755665 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:18.755665 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:39:18.755665 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:39:18.755665 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 966031ed-9a06-4a3d-92f7-96adcfa7e364 could not be found. Sep 10 11:39:18.755665 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:18.756882 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6fc542b3-276c-4119-992b-2a3ebb763bfa tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Returning 404 to user: Instance 966031ed-9a06-4a3d-92f7-96adcfa7e364 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:39:18.756882 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6fc542b3-276c-4119-992b-2a3ebb763bfa tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] 10.222.0.23 "GET /compute/v2.1/servers/966031ed-9a06-4a3d-92f7-96adcfa7e364" status: 404 len: 111 microversion: 2.1 time: 0.074896 Sep 10 11:39:18.758387 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 222/441] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:18 2022] GET /compute/v2.1/servers/966031ed-9a06-4a3d-92f7-96adcfa7e364 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:39:18.764542 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b65691fa-8753-4ce3-b1b0-cea24a19bdd2 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:18.765150 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b65691fa-8753-4ce3-b1b0-cea24a19bdd2 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] [instance: 58290798-70af-44a5-85cc-20871f15c110] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:18.777139 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b65691fa-8753-4ce3-b1b0-cea24a19bdd2 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:18.777655 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b65691fa-8753-4ce3-b1b0-cea24a19bdd2 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:18.778480 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b65691fa-8753-4ce3-b1b0-cea24a19bdd2 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:18.779405 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b65691fa-8753-4ce3-b1b0-cea24a19bdd2 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:18.779938 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b65691fa-8753-4ce3-b1b0-cea24a19bdd2 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:18.780378 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b65691fa-8753-4ce3-b1b0-cea24a19bdd2 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:18.901156 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b65691fa-8753-4ce3-b1b0-cea24a19bdd2 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] [instance: 58290798-70af-44a5-85cc-20871f15c110] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:39:19.061408 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b65691fa-8753-4ce3-b1b0-cea24a19bdd2 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] 10.222.0.23 "DELETE /compute/v2.1/servers/58290798-70af-44a5-85cc-20871f15c110" status: 204 len: 0 microversion: 2.1 time: 0.300800 Sep 10 11:39:19.063492 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 223/442] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:39:18 2022] DELETE /compute/v2.1/servers/58290798-70af-44a5-85cc-20871f15c110 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:39:19.078228 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a6104c37-8a71-4878-ae02-5fea366dcf7c tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:19.078914 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a6104c37-8a71-4878-ae02-5fea366dcf7c tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] [instance: 58290798-70af-44a5-85cc-20871f15c110] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:19.088253 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=26 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:39:19.091995 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6104c37-8a71-4878-ae02-5fea366dcf7c tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:19.092713 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6104c37-8a71-4878-ae02-5fea366dcf7c tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:19.093396 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6104c37-8a71-4878-ae02-5fea366dcf7c tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:19.095147 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6104c37-8a71-4878-ae02-5fea366dcf7c tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:19.097824 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6104c37-8a71-4878-ae02-5fea366dcf7c tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:19.098721 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6104c37-8a71-4878-ae02-5fea366dcf7c tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:19.099194 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5d49d75e-ec1e-4d87-9030-589fb9e590b6 tempest-SecurityGroupsTestAdminJSON-1953955293 tempest-SecurityGroupsTestAdminJSON-1953955293-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.431274 Sep 10 11:39:19.100501 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 220/443] 10.222.0.23 () {60 vars in 1180 bytes} [Sat Sep 10 11:39:17 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:39:19.123218 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f4059944-9a4b-4d07-ad33-67b67f3dcef3 tempest-SecurityGroupsTestAdminJSON-1953955293 tempest-SecurityGroupsTestAdminJSON-1953955293-project] Action: 'create', calling method: .version_select at 0x7f407369a820>, body: {"security_group": {"name": "tempest-securitygroup-1544294568", "description": "tempest-description-552702063"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:19.484424 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a6104c37-8a71-4878-ae02-5fea366dcf7c tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c91799a8724c499cd1afe82e3fd657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95726b0caac4b7fb5f0db90d268430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:19.498342 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a6104c37-8a71-4878-ae02-5fea366dcf7c tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] 10.222.0.23 "GET /compute/v2.1/servers/58290798-70af-44a5-85cc-20871f15c110" status: 200 len: 1478 microversion: 2.1 time: 0.429679 Sep 10 11:39:19.501347 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 224/444] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:19 2022] GET /compute/v2.1/servers/58290798-70af-44a5-85cc-20871f15c110 => generated 1478 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:19.513818 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e67c7684-9df9-46c4-8a19-107303bf945d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:19.514903 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e67c7684-9df9-46c4-8a19-107303bf945d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: cd42bf97-63e2-4a4b-a5db-d747a478dcbd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:19.534388 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e67c7684-9df9-46c4-8a19-107303bf945d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:19.537802 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e67c7684-9df9-46c4-8a19-107303bf945d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:19.538292 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e67c7684-9df9-46c4-8a19-107303bf945d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:19.539035 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e67c7684-9df9-46c4-8a19-107303bf945d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:19.539553 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e67c7684-9df9-46c4-8a19-107303bf945d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:19.539979 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e67c7684-9df9-46c4-8a19-107303bf945d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:19.588446 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e67c7684-9df9-46c4-8a19-107303bf945d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: cd42bf97-63e2-4a4b-a5db-d747a478dcbd] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:39:19.633940 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:39:19.755133 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e67c7684-9df9-46c4-8a19-107303bf945d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cd42bf97-63e2-4a4b-a5db-d747a478dcbd" status: 204 len: 0 microversion: 2.1 time: 0.249784 Sep 10 11:39:19.764754 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 225/445] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:39:19 2022] DELETE /compute/v2.1/servers/cd42bf97-63e2-4a4b-a5db-d747a478dcbd => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:39:19.781267 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-708e0bb7-af23-4fe6-9724-f80a552569b8 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:19.782080 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-708e0bb7-af23-4fe6-9724-f80a552569b8 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:19.805908 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-708e0bb7-af23-4fe6-9724-f80a552569b8 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:19.806510 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-708e0bb7-af23-4fe6-9724-f80a552569b8 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:19.819332 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-708e0bb7-af23-4fe6-9724-f80a552569b8 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:19.820316 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-708e0bb7-af23-4fe6-9724-f80a552569b8 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:19.820764 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-708e0bb7-af23-4fe6-9724-f80a552569b8 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:19.821273 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-708e0bb7-af23-4fe6-9724-f80a552569b8 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:19.907015 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f4059944-9a4b-4d07-ad33-67b67f3dcef3 tempest-SecurityGroupsTestAdminJSON-1953955293 tempest-SecurityGroupsTestAdminJSON-1953955293-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.796946 Sep 10 11:39:19.907655 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 221/446] 10.222.0.23 () {60 vars in 1180 bytes} [Sat Sep 10 11:39:19 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:39:20.145027 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-708e0bb7-af23-4fe6-9724-f80a552569b8 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:20.153087 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-708e0bb7-af23-4fe6-9724-f80a552569b8 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f" status: 200 len: 1504 microversion: 2.1 time: 0.386640 Sep 10 11:39:20.153916 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 226/447] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:19 2022] GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f => generated 1504 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:20.185568 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9c362e96-e11f-41c5-bb41-398a5d83efa0 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1026497854", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "435889313", "adminPass": "***", "networks": [{"uuid": "d4fb7237-4375-41be-b61d-e67b4c1202ba"}], "security_groups": [{"name": "tempest-securitygroup--1705104674"}], "key_name": "tempest-keypair-567849478", "user_data": "}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:20.210865 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=13,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:39:20.336316 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2b48cf94-7638-448b-842c-d23c5610a0be tempest-SecurityGroupsTestAdminJSON-1451783304 tempest-SecurityGroupsTestAdminJSON-1451783304-project-admin] Action: 'create', calling method: .version_select at 0x7f407369aa60>, body: {"security_group": {"name": "tempest-securitygroup-111956026", "description": "tempest-description-566790250"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:20.661261 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-9c362e96-e11f-41c5-bb41-398a5d83efa0 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] validate_networks() for [('d4fb7237-4375-41be-b61d-e67b4c1202ba', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:39:21.659088 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2b48cf94-7638-448b-842c-d23c5610a0be tempest-SecurityGroupsTestAdminJSON-1451783304 tempest-SecurityGroupsTestAdminJSON-1451783304-project-admin] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.740368 Sep 10 11:39:21.660732 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 222/448] 10.222.0.23 () {60 vars in 1180 bytes} [Sat Sep 10 11:39:19 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1744 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:39:21.960713 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4cb21843-7bbb-48be-b37d-5e5f0c2660b4 tempest-FlavorsExtraSpecsTestJSON-2924597 tempest-FlavorsExtraSpecsTestJSON-2924597-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1958426006", "ram": 512, "vcpus": 1, "disk": 10, "id": 1123441334, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:22.003146 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4cb21843-7bbb-48be-b37d-5e5f0c2660b4 tempest-FlavorsExtraSpecsTestJSON-2924597 tempest-FlavorsExtraSpecsTestJSON-2924597-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.340902 Sep 10 11:39:22.009770 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 223/449] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:39:21 2022] POST /compute/v2.1/flavors => generated 416 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:39:22.023002 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5cd05f2a-e279-497b-841a-dd93997595ed tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:22.026940 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5cd05f2a-e279-497b-841a-dd93997595ed tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] [instance: 58290798-70af-44a5-85cc-20871f15c110] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:22.045462 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5cd05f2a-e279-497b-841a-dd93997595ed tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:22.047861 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5cd05f2a-e279-497b-841a-dd93997595ed tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:22.048701 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5cd05f2a-e279-497b-841a-dd93997595ed tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:22.052058 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5cd05f2a-e279-497b-841a-dd93997595ed tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:22.053582 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5cd05f2a-e279-497b-841a-dd93997595ed tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:22.056639 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5cd05f2a-e279-497b-841a-dd93997595ed tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:22.219679 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-9c362e96-e11f-41c5-bb41-398a5d83efa0 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:39:22.220151 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-9c362e96-e11f-41c5-bb41-398a5d83efa0 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:39:22.220570 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-9c362e96-e11f-41c5-bb41-398a5d83efa0 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:39:22.221748 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-9c362e96-e11f-41c5-bb41-398a5d83efa0 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:39:22.222171 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-9c362e96-e11f-41c5-bb41-398a5d83efa0 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:39:22.237713 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c362e96-e11f-41c5-bb41-398a5d83efa0 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:22.238194 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c362e96-e11f-41c5-bb41-398a5d83efa0 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:22.250026 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c362e96-e11f-41c5-bb41-398a5d83efa0 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:22.250948 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c362e96-e11f-41c5-bb41-398a5d83efa0 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:22.251456 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c362e96-e11f-41c5-bb41-398a5d83efa0 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:22.251921 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c362e96-e11f-41c5-bb41-398a5d83efa0 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:22.294851 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-9c362e96-e11f-41c5-bb41-398a5d83efa0 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Getting quotas for project 2c44e3e2920e48868e1c05f70b1d7639. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:39:22.303432 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-9c362e96-e11f-41c5-bb41-398a5d83efa0 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Getting quotas for user b64e2df030a745de8ae7eda29d2ac30a and project 2c44e3e2920e48868e1c05f70b1d7639. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:39:22.335817 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9c362e96-e11f-41c5-bb41-398a5d83efa0 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:39:22.338446 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9c362e96-e11f-41c5-bb41-398a5d83efa0 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:39:22.369981 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5cd05f2a-e279-497b-841a-dd93997595ed tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c91799a8724c499cd1afe82e3fd657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95726b0caac4b7fb5f0db90d268430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:22.380858 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5cd05f2a-e279-497b-841a-dd93997595ed tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] 10.222.0.23 "GET /compute/v2.1/servers/58290798-70af-44a5-85cc-20871f15c110" status: 200 len: 1478 microversion: 2.1 time: 0.369325 Sep 10 11:39:22.381776 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 224/450] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:22 2022] GET /compute/v2.1/servers/58290798-70af-44a5-85cc-20871f15c110 => generated 1478 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:22.400452 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4c789370-2c8e-4927-87bb-eedb0aa1f074 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:22.401339 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4c789370-2c8e-4927-87bb-eedb0aa1f074 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:22.410380 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4c789370-2c8e-4927-87bb-eedb0aa1f074 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:22.412576 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4c789370-2c8e-4927-87bb-eedb0aa1f074 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:22.413378 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4c789370-2c8e-4927-87bb-eedb0aa1f074 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:22.414315 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4c789370-2c8e-4927-87bb-eedb0aa1f074 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:22.416104 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4c789370-2c8e-4927-87bb-eedb0aa1f074 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:22.416745 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4c789370-2c8e-4927-87bb-eedb0aa1f074 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:22.471347 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9c362e96-e11f-41c5-bb41-398a5d83efa0 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.290439 Sep 10 11:39:22.487578 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 227/451] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:39:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 2333 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:39:22.498841 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5bb7683d-0c14-46b0-ad15-bef6dc31e286 tempest-SecurityGroupsTestAdminJSON-1451783304 tempest-SecurityGroupsTestAdminJSON-1451783304-project-admin] Action: 'create', calling method: .version_select at 0x7f4073af78b0>, body: {"security_group": {"name": "tempest-securitygroup-1625706014", "description": "tempest-description-703872225"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:23.372410 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4c789370-2c8e-4927-87bb-eedb0aa1f074 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:23.386894 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4c789370-2c8e-4927-87bb-eedb0aa1f074 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f" status: 200 len: 1504 microversion: 2.1 time: 1.003718 Sep 10 11:39:23.389980 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 225/452] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:22 2022] GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f => generated 1504 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:23.494753 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f1c79d01-ebd6-4095-bc42-c28155db54d5 tempest-FlavorsExtraSpecsNegativeTestJSON-377166645 tempest-FlavorsExtraSpecsNegativeTestJSON-377166645-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1235981866", "ram": 512, "vcpus": 1, "disk": 10, "id": 1452717476, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:23.522877 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f1c79d01-ebd6-4095-bc42-c28155db54d5 tempest-FlavorsExtraSpecsNegativeTestJSON-377166645 tempest-FlavorsExtraSpecsNegativeTestJSON-377166645-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.130484 Sep 10 11:39:23.524582 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 226/453] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:39:23 2022] POST /compute/v2.1/flavors => generated 416 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:39:23.529085 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5bb7683d-0c14-46b0-ad15-bef6dc31e286 tempest-SecurityGroupsTestAdminJSON-1451783304 tempest-SecurityGroupsTestAdminJSON-1451783304-project-admin] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.039872 Sep 10 11:39:23.529669 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 228/454] 10.222.0.23 () {60 vars in 1180 bytes} [Sat Sep 10 11:39:22 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:39:23.531093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0f142acd-bddc-4060-8e6a-c094fdfee0e8 tempest-FlavorsExtraSpecsTestJSON-2924597 tempest-FlavorsExtraSpecsTestJSON-2924597-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:23.549033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cb971cf7-4a3d-4b17-8427-ac3044059b8e tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:23.561836 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cb971cf7-4a3d-4b17-8427-ac3044059b8e tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:23.578820 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb971cf7-4a3d-4b17-8427-ac3044059b8e tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:23.587777 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb971cf7-4a3d-4b17-8427-ac3044059b8e tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:23.588550 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb971cf7-4a3d-4b17-8427-ac3044059b8e tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:23.589624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb971cf7-4a3d-4b17-8427-ac3044059b8e tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:23.591895 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb971cf7-4a3d-4b17-8427-ac3044059b8e tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:23.593934 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb971cf7-4a3d-4b17-8427-ac3044059b8e tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:23.644355 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0f142acd-bddc-4060-8e6a-c094fdfee0e8 tempest-FlavorsExtraSpecsTestJSON-2924597 tempest-FlavorsExtraSpecsTestJSON-2924597-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1123441334/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.117853 Sep 10 11:39:23.647528 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 227/455] 10.222.0.23 () {60 vars in 1224 bytes} [Sat Sep 10 11:39:23 2022] POST /compute/v2.1/flavors/1123441334/os-extra_specs => generated 66 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:39:23.655245 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-eb67706f-796d-4a64-9db3-1c19b8b463e1 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:23.659219 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-eb67706f-796d-4a64-9db3-1c19b8b463e1 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] [instance: 58290798-70af-44a5-85cc-20871f15c110] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:23.680669 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb67706f-796d-4a64-9db3-1c19b8b463e1 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:23.681513 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb67706f-796d-4a64-9db3-1c19b8b463e1 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:23.682686 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb67706f-796d-4a64-9db3-1c19b8b463e1 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:23.683674 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb67706f-796d-4a64-9db3-1c19b8b463e1 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:23.684527 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb67706f-796d-4a64-9db3-1c19b8b463e1 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:23.685173 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb67706f-796d-4a64-9db3-1c19b8b463e1 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:24.046416 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-cb971cf7-4a3d-4b17-8427-ac3044059b8e tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64e2df030a745de8ae7eda29d2ac30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c44e3e2920e48868e1c05f70b1d7639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:24.058983 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cb971cf7-4a3d-4b17-8427-ac3044059b8e tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "GET /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7" status: 200 len: 1258 microversion: 2.1 time: 0.518779 Sep 10 11:39:24.063709 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 229/456] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:23 2022] GET /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 => generated 1258 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:24.092240 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-eb67706f-796d-4a64-9db3-1c19b8b463e1 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c91799a8724c499cd1afe82e3fd657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95726b0caac4b7fb5f0db90d268430b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:24.107620 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-eb67706f-796d-4a64-9db3-1c19b8b463e1 tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] 10.222.0.23 "GET /compute/v2.1/servers/58290798-70af-44a5-85cc-20871f15c110" status: 200 len: 1436 microversion: 2.1 time: 0.457085 Sep 10 11:39:24.112609 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 228/457] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:23 2022] GET /compute/v2.1/servers/58290798-70af-44a5-85cc-20871f15c110 => generated 1436 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:24.125234 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3d114cc8-d7bc-4576-a493-b66223dad9ab tempest-SecurityGroupsTestAdminJSON-1451783304 tempest-SecurityGroupsTestAdminJSON-1451783304-project-admin] Calling method '.version_select at 0x7f407368b820>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:24.368147 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-56d5b8d3-d607-4734-b4a7-15318a83cc3d tempest-FlavorsExtraSpecsNegativeTestJSON-978180385 tempest-FlavorsExtraSpecsNegativeTestJSON-978180385-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:24.395215 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-56d5b8d3-d607-4734-b4a7-15318a83cc3d tempest-FlavorsExtraSpecsNegativeTestJSON-978180385 tempest-FlavorsExtraSpecsNegativeTestJSON-978180385-project] HTTP exception thrown: Flavor 1452717476 has no extra specs with key hw:cpu_thread_policy. Sep 10 11:39:24.410005 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-56d5b8d3-d607-4734-b4a7-15318a83cc3d tempest-FlavorsExtraSpecsNegativeTestJSON-978180385 tempest-FlavorsExtraSpecsNegativeTestJSON-978180385-project] Request method failure captured: Sep 10 11:39:24.410005 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/flavors/1452717476/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 10 11:39:24.410005 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:39:24.410005 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:39:24.410005 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:39:24.410005 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:39:24.410005 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:39:24.410005 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:39:24.410005 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:39:24.410005 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:39:24.410005 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHdogbGrqEcYZFczXBrtj1srCESnKWe9cWMEJzUmsJWwicefr3iZDb9eruMoPDkD--MUVKimDzzFrUFWrxeTvYm0WbSFunPrZulWwD2i6eUQwVHVrrAQK6hCs0TjZvTWUO6APxr_56RdJ5rPx7FDL4pEqsDGeNAfKXOmek6OoT0daFs Sep 10 11:39:24.410005 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:39:24.410005 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:39:24.410005 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:39:24.410005 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:39:24.410005 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:39:24.410005 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:39:24.410005 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: aa552659ccc6484992e712d512d03a45 Sep 10 11:39:24.410005 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-978180385 Sep 10 11:39:24.410005 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:39:24.410005 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:39:24.411462 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa552659ccc6484992e712d512d03a45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa552659ccc6484992e712d512d03a45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_aa552659ccc6484992e712d512d03a45", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/aa552659ccc6484992e712d512d03a45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:39:24.411462 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-978180385 Sep 10 11:39:24.411462 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: aa552659ccc6484992e712d512d03a45 Sep 10 11:39:24.411462 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-978180385 Sep 10 11:39:24.411462 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-978180385-project Sep 10 11:39:24.411462 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:39:24.411462 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:39:24.411462 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: d6d9f41d43524acaac34bf9930725aa4 Sep 10 11:39:24.411462 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-978180385-project Sep 10 11:39:24.411462 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:39:24.411462 n-d-856895-1 devstack@n-api.service[128776]: exception: Flavor 1452717476 has no extra specs with key hw:cpu_thread_policy. Sep 10 11:39:24.412605 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'flavor_id': '1452717476', 'id': 'hw:cpu_thread_policy'} Sep 10 11:39:24.412605 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:39:24.412605 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:24.412605 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Sep 10 11:39:24.412605 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Sep 10 11:39:24.412605 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 10 11:39:24.412605 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:24.412605 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:24.412605 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:24.412605 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:24.412605 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:24.412605 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:24.412605 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:39:24.412605 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:39:24.412605 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:39:24.412605 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:39:24.412605 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Sep 10 11:39:24.412605 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 10 11:39:24.412605 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1452717476 has no extra specs with key hw:cpu_thread_policy. Sep 10 11:39:24.412605 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:24.412605 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:24.412605 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:24.413826 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:24.413826 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:24.413826 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:24.413826 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:39:24.413826 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:39:24.413826 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1452717476 has no extra specs with key hw:cpu_thread_policy. Sep 10 11:39:24.413826 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:24.413826 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-56d5b8d3-d607-4734-b4a7-15318a83cc3d tempest-FlavorsExtraSpecsNegativeTestJSON-978180385 tempest-FlavorsExtraSpecsNegativeTestJSON-978180385-project] Returning 404 to user: Flavor 1452717476 has no extra specs with key hw:cpu_thread_policy. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:39:24.421102 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-56d5b8d3-d607-4734-b4a7-15318a83cc3d tempest-FlavorsExtraSpecsNegativeTestJSON-978180385 tempest-FlavorsExtraSpecsNegativeTestJSON-978180385-project] 10.222.0.23 "GET /compute/v2.1/flavors/1452717476/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.352638 Sep 10 11:39:24.421739 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 230/458] 10.222.0.23 () {58 vars in 1266 bytes} [Sat Sep 10 11:39:24 2022] GET /compute/v2.1/flavors/1452717476/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 357 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:39:24.769261 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0f33305a-a44b-4f89-bc62-b6122f17103f tempest-FlavorsExtraSpecsTestJSON-676111143 tempest-FlavorsExtraSpecsTestJSON-676111143-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:24.807570 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0f33305a-a44b-4f89-bc62-b6122f17103f tempest-FlavorsExtraSpecsTestJSON-676111143 tempest-FlavorsExtraSpecsTestJSON-676111143-project] 10.222.0.23 "GET /compute/v2.1/flavors/1123441334/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.382628 Sep 10 11:39:24.811539 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 231/459] 10.222.0.23 () {58 vars in 1203 bytes} [Sat Sep 10 11:39:24 2022] GET /compute/v2.1/flavors/1123441334/os-extra_specs => generated 66 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:39:24.827739 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-160a6474-68c6-4ab7-832c-bec0bdc7ebea req-5afffbba-51a5-4d67-9afd-23c304d2297a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58290798-70af-44a5-85cc-20871f15c110", "name": "network-vif-deleted", "tag": "3b3caf11-da53-4207-9580-10640c3c54cb"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:24.841898 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-160a6474-68c6-4ab7-832c-bec0bdc7ebea req-5afffbba-51a5-4d67-9afd-23c304d2297a service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:24.842438 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-160a6474-68c6-4ab7-832c-bec0bdc7ebea req-5afffbba-51a5-4d67-9afd-23c304d2297a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:24.842875 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-160a6474-68c6-4ab7-832c-bec0bdc7ebea req-5afffbba-51a5-4d67-9afd-23c304d2297a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:24.884753 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-160a6474-68c6-4ab7-832c-bec0bdc7ebea req-5afffbba-51a5-4d67-9afd-23c304d2297a service nova] Creating event network-vif-deleted:3b3caf11-da53-4207-9580-10640c3c54cb for instance 58290798-70af-44a5-85cc-20871f15c110 on n-h1-856895-1 Sep 10 11:39:24.898614 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-160a6474-68c6-4ab7-832c-bec0bdc7ebea req-5afffbba-51a5-4d67-9afd-23c304d2297a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085359 Sep 10 11:39:24.904234 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 232/460] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:39:24.913695 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0c105f44-1821-4bc6-8b95-8ecafc89ed50 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:24.917087 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0c105f44-1821-4bc6-8b95-8ecafc89ed50 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:24.929585 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c105f44-1821-4bc6-8b95-8ecafc89ed50 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:24.930240 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c105f44-1821-4bc6-8b95-8ecafc89ed50 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:24.931214 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c105f44-1821-4bc6-8b95-8ecafc89ed50 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:24.932578 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c105f44-1821-4bc6-8b95-8ecafc89ed50 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:24.935706 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c105f44-1821-4bc6-8b95-8ecafc89ed50 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:24.936227 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c105f44-1821-4bc6-8b95-8ecafc89ed50 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:26.340028 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0c105f44-1821-4bc6-8b95-8ecafc89ed50 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:26.353219 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0c105f44-1821-4bc6-8b95-8ecafc89ed50 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f" status: 200 len: 1504 microversion: 2.1 time: 1.447403 Sep 10 11:39:26.356393 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 233/461] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:24 2022] GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f => generated 1504 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:26.377837 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3d794d2d-5906-41a5-96ea-1a6191858130 tempest-FlavorsExtraSpecsNegativeTestJSON-978180385 tempest-FlavorsExtraSpecsNegativeTestJSON-978180385-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:26.387807 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3d794d2d-5906-41a5-96ea-1a6191858130 tempest-FlavorsExtraSpecsNegativeTestJSON-978180385 tempest-FlavorsExtraSpecsNegativeTestJSON-978180385-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'd6d9f41d43524acaac34bf9930725aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa552659ccc6484992e712d512d03a45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:26.395254 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3d794d2d-5906-41a5-96ea-1a6191858130 tempest-FlavorsExtraSpecsNegativeTestJSON-978180385 tempest-FlavorsExtraSpecsNegativeTestJSON-978180385-project] Request method failure captured: Sep 10 11:39:26.395254 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/flavors/1452717476/os-extra_specs HTTP/1.1 Sep 10 11:39:26.395254 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:39:26.395254 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:39:26.395254 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:39:26.395254 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 66 Sep 10 11:39:26.395254 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:39:26.395254 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:39:26.395254 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:39:26.395254 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:39:26.395254 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHdogbGrqEcYZFczXBrtj1srCESnKWe9cWMEJzUmsJWwicefr3iZDb9eruMoPDkD--MUVKimDzzFrUFWrxeTvYm0WbSFunPrZulWwD2i6eUQwVHVrrAQK6hCs0TjZvTWUO6APxr_56RdJ5rPx7FDL4pEqsDGeNAfKXOmek6OoT0daFs Sep 10 11:39:26.395254 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:39:26.395254 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:39:26.395254 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:39:26.395254 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:39:26.395254 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:39:26.395254 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:39:26.395254 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: aa552659ccc6484992e712d512d03a45 Sep 10 11:39:26.395254 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-978180385 Sep 10 11:39:26.395254 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:39:26.395254 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:39:26.396711 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa552659ccc6484992e712d512d03a45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa552659ccc6484992e712d512d03a45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_aa552659ccc6484992e712d512d03a45", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/aa552659ccc6484992e712d512d03a45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:39:26.396711 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-978180385 Sep 10 11:39:26.396711 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: aa552659ccc6484992e712d512d03a45 Sep 10 11:39:26.396711 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-978180385 Sep 10 11:39:26.396711 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-978180385-project Sep 10 11:39:26.396711 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:39:26.396711 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:39:26.396711 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: d6d9f41d43524acaac34bf9930725aa4 Sep 10 11:39:26.396711 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-978180385-project Sep 10 11:39:26.396711 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 11:39:26.396711 n-d-856895-1 devstack@n-api.service[128776]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Sep 10 11:39:26.396711 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:39:26.397454 n-d-856895-1 devstack@n-api.service[128776]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 10 11:39:26.397454 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'flavor_id': '1452717476', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Sep 10 11:39:26.397454 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:39:26.397454 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:26.397454 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:26.397454 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:26.397454 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:39:26.397454 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:39:26.397454 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:39:26.397454 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:39:26.397454 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:39:26.397454 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:39:26.397454 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Sep 10 11:39:26.397454 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Sep 10 11:39:26.397454 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 11:39:26.397454 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 11:39:26.397454 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 11:39:26.397454 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 11:39:26.397454 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:39:26.398714 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:39:26.398714 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:39:26.398714 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:39:26.398714 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 11:39:26.398714 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 11:39:26.398714 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 11:39:26.398714 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 11:39:26.398714 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 11:39:26.398714 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 11:39:26.398714 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 10 11:39:26.398714 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:26.398714 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:26.398714 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:26.398714 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:26.398714 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:26.398714 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:26.398714 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 11:39:26.398714 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 11:39:26.398714 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 10 11:39:26.398714 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:26.402234 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3d794d2d-5906-41a5-96ea-1a6191858130 tempest-FlavorsExtraSpecsNegativeTestJSON-978180385 tempest-FlavorsExtraSpecsNegativeTestJSON-978180385-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:39:26.403447 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3d794d2d-5906-41a5-96ea-1a6191858130 tempest-FlavorsExtraSpecsNegativeTestJSON-978180385 tempest-FlavorsExtraSpecsNegativeTestJSON-978180385-project] 10.222.0.23 "POST /compute/v2.1/flavors/1452717476/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.045830 Sep 10 11:39:26.404609 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 234/462] 10.222.0.23 () {60 vars in 1224 bytes} [Sat Sep 10 11:39:26 2022] POST /compute/v2.1/flavors/1452717476/os-extra_specs => generated 124 bytes in 47 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:39:26.415978 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9ac8a73f-bd52-4dfe-93ee-5110bbd80b99 tempest-FlavorsExtraSpecsTestJSON-2924597 tempest-FlavorsExtraSpecsTestJSON-2924597-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:26.466886 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9ac8a73f-bd52-4dfe-93ee-5110bbd80b99 tempest-FlavorsExtraSpecsTestJSON-2924597 tempest-FlavorsExtraSpecsTestJSON-2924597-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1123441334/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.060930 Sep 10 11:39:26.497580 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 235/463] 10.222.0.23 () {60 vars in 1224 bytes} [Sat Sep 10 11:39:26 2022] POST /compute/v2.1/flavors/1123441334/os-extra_specs => generated 66 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:39:26.505069 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cc617ae7-1ccd-4662-83ad-2746b460b64d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:26.506082 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cc617ae7-1ccd-4662-83ad-2746b460b64d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:26.516654 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cc617ae7-1ccd-4662-83ad-2746b460b64d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:26.518251 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cc617ae7-1ccd-4662-83ad-2746b460b64d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:26.518921 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cc617ae7-1ccd-4662-83ad-2746b460b64d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:26.520019 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cc617ae7-1ccd-4662-83ad-2746b460b64d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:26.520689 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cc617ae7-1ccd-4662-83ad-2746b460b64d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:26.521311 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cc617ae7-1ccd-4662-83ad-2746b460b64d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:27.541058 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-cc617ae7-1ccd-4662-83ad-2746b460b64d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64e2df030a745de8ae7eda29d2ac30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c44e3e2920e48868e1c05f70b1d7639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:27.554220 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cc617ae7-1ccd-4662-83ad-2746b460b64d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "GET /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7" status: 200 len: 1388 microversion: 2.1 time: 1.055303 Sep 10 11:39:27.570017 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 236/464] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:26 2022] GET /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 => generated 1388 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:27.580524 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c713d561-6779-46b0-b53a-86639667665b tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:27.581308 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c713d561-6779-46b0-b53a-86639667665b tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] [instance: 58290798-70af-44a5-85cc-20871f15c110] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:27.588039 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c713d561-6779-46b0-b53a-86639667665b tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:27.588634 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c713d561-6779-46b0-b53a-86639667665b tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:27.589662 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c713d561-6779-46b0-b53a-86639667665b tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:27.590694 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c713d561-6779-46b0-b53a-86639667665b tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:27.591298 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c713d561-6779-46b0-b53a-86639667665b tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:27.591997 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c713d561-6779-46b0-b53a-86639667665b tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:27.610867 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-c713d561-6779-46b0-b53a-86639667665b tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] HTTP exception thrown: Instance 58290798-70af-44a5-85cc-20871f15c110 could not be found. Sep 10 11:39:27.614121 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c713d561-6779-46b0-b53a-86639667665b tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Request method failure captured: Sep 10 11:39:27.614121 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/58290798-70af-44a5-85cc-20871f15c110 HTTP/1.1 Sep 10 11:39:27.614121 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:39:27.614121 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:39:27.614121 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:39:27.614121 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:39:27.614121 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:39:27.614121 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:39:27.614121 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:39:27.614121 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:39:27.614121 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHc2weIiXuQBp8Wg_jBEA2mC9uglNr2faENChMZgZueuebIPasXRZsZD4PLpWaLfdqChRCuBDW63TiLQPenCqtrEMmHtK7AAyEwj1Rv_ttDvHhG2MAOn-dE1YkiJ_3ujmV375pRx1M9xkaY6Jx5fWsk32Yh06ixWU72IReGe7WYSKA0 Sep 10 11:39:27.614121 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:39:27.614121 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:39:27.614121 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:39:27.614121 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:39:27.614121 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:39:27.614121 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:39:27.614121 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: b95726b0caac4b7fb5f0db90d268430b Sep 10 11:39:27.614121 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1914935354 Sep 10 11:39:27.614121 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:39:27.614121 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:39:27.615798 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b95726b0caac4b7fb5f0db90d268430b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b95726b0caac4b7fb5f0db90d268430b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b95726b0caac4b7fb5f0db90d268430b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b95726b0caac4b7fb5f0db90d268430b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:39:27.615798 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1914935354 Sep 10 11:39:27.615798 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: b95726b0caac4b7fb5f0db90d268430b Sep 10 11:39:27.615798 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1914935354 Sep 10 11:39:27.615798 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersAdminNegativeTestJSON-1914935354-project Sep 10 11:39:27.615798 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:39:27.615798 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:39:27.615798 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 03c91799a8724c499cd1afe82e3fd657 Sep 10 11:39:27.615798 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1914935354-project Sep 10 11:39:27.615798 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:39:27.615798 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 58290798-70af-44a5-85cc-20871f15c110 could not be found. Sep 10 11:39:27.615798 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '58290798-70af-44a5-85cc-20871f15c110'} Sep 10 11:39:27.616708 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:39:27.616708 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:27.616708 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:39:27.616708 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:39:27.616708 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:39:27.616708 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:39:27.616708 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:39:27.616708 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:39:27.616708 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:39:27.616708 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:39:27.616708 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58290798-70af-44a5-85cc-20871f15c110 could not be found. Sep 10 11:39:27.616708 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:27.616708 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:27.616708 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:27.616708 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:27.616708 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:27.616708 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:27.616708 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:39:27.616708 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:39:27.616708 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:39:27.618254 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:39:27.618254 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:39:27.618254 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:39:27.618254 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:39:27.618254 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:39:27.618254 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:39:27.618254 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:39:27.618254 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58290798-70af-44a5-85cc-20871f15c110 could not be found. Sep 10 11:39:27.618254 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:27.618254 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:27.618254 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:27.618254 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:27.618254 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:27.618254 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:27.618254 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:39:27.618254 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:39:27.618254 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58290798-70af-44a5-85cc-20871f15c110 could not be found. Sep 10 11:39:27.618254 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:27.619734 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c713d561-6779-46b0-b53a-86639667665b tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] Returning 404 to user: Instance 58290798-70af-44a5-85cc-20871f15c110 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:39:27.621590 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c713d561-6779-46b0-b53a-86639667665b tempest-ServersAdminNegativeTestJSON-1914935354 tempest-ServersAdminNegativeTestJSON-1914935354-project] 10.222.0.23 "GET /compute/v2.1/servers/58290798-70af-44a5-85cc-20871f15c110" status: 404 len: 111 microversion: 2.1 time: 0.049554 Sep 10 11:39:27.626776 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 237/465] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:27 2022] GET /compute/v2.1/servers/58290798-70af-44a5-85cc-20871f15c110 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:39:27.632847 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c3009382-7001-4080-8537-f357fde4dc0c tempest-FlavorsExtraSpecsNegativeTestJSON-377166645 tempest-FlavorsExtraSpecsNegativeTestJSON-377166645-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:27.675993 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c3009382-7001-4080-8537-f357fde4dc0c tempest-FlavorsExtraSpecsNegativeTestJSON-377166645 tempest-FlavorsExtraSpecsNegativeTestJSON-377166645-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1452717476/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.047695 Sep 10 11:39:27.679567 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 238/466] 10.222.0.23 () {60 vars in 1224 bytes} [Sat Sep 10 11:39:27 2022] POST /compute/v2.1/flavors/1452717476/os-extra_specs => generated 66 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:39:27.690234 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4f3013b6-3005-4244-9ac0-6a115ac921bb tempest-FlavorsExtraSpecsTestJSON-676111143 tempest-FlavorsExtraSpecsTestJSON-676111143-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:27.713218 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4f3013b6-3005-4244-9ac0-6a115ac921bb tempest-FlavorsExtraSpecsTestJSON-676111143 tempest-FlavorsExtraSpecsTestJSON-676111143-project] 10.222.0.23 "GET /compute/v2.1/flavors/1123441334/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.030674 Sep 10 11:39:27.722490 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 239/467] 10.222.0.23 () {58 vars in 1245 bytes} [Sat Sep 10 11:39:27 2022] GET /compute/v2.1/flavors/1123441334/os-extra_specs/hw:numa_nodes => generated 22 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:39:27.733754 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-c4c43313-c535-4565-84c9-42296f67f9a9 req-01bb6b70-e331-4ea5-87ad-e562ea1cbff0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd42bf97-63e2-4a4b-a5db-d747a478dcbd", "name": "network-vif-deleted", "tag": "f0809fa9-bdcc-4999-bb5a-18a1f232c5f6"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:27.758378 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-c4c43313-c535-4565-84c9-42296f67f9a9 req-01bb6b70-e331-4ea5-87ad-e562ea1cbff0 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:27.761259 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-c4c43313-c535-4565-84c9-42296f67f9a9 req-01bb6b70-e331-4ea5-87ad-e562ea1cbff0 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:27.763071 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-c4c43313-c535-4565-84c9-42296f67f9a9 req-01bb6b70-e331-4ea5-87ad-e562ea1cbff0 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:27.793322 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-c4c43313-c535-4565-84c9-42296f67f9a9 req-01bb6b70-e331-4ea5-87ad-e562ea1cbff0 service nova] Creating event network-vif-deleted:f0809fa9-bdcc-4999-bb5a-18a1f232c5f6 for instance cd42bf97-63e2-4a4b-a5db-d747a478dcbd on n-h2-856895-1 Sep 10 11:39:27.800328 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-c4c43313-c535-4565-84c9-42296f67f9a9 req-01bb6b70-e331-4ea5-87ad-e562ea1cbff0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076253 Sep 10 11:39:27.801543 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 240/468] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:39:27.808092 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-10e4420a-1b9e-42b7-9891-86d0fe197965 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:27.809297 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-10e4420a-1b9e-42b7-9891-86d0fe197965 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:27.818468 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10e4420a-1b9e-42b7-9891-86d0fe197965 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:27.820244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10e4420a-1b9e-42b7-9891-86d0fe197965 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:27.820882 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10e4420a-1b9e-42b7-9891-86d0fe197965 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:27.821793 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10e4420a-1b9e-42b7-9891-86d0fe197965 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:27.822438 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10e4420a-1b9e-42b7-9891-86d0fe197965 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:27.823050 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10e4420a-1b9e-42b7-9891-86d0fe197965 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:28.589337 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-10e4420a-1b9e-42b7-9891-86d0fe197965 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:28.605725 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-10e4420a-1b9e-42b7-9891-86d0fe197965 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f" status: 200 len: 1494 microversion: 2.1 time: 0.796237 Sep 10 11:39:28.606943 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 241/469] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:27 2022] GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f => generated 1494 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:28.620457 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0a2ff091-13f5-4f33-9745-fd3fe1182e31 tempest-FlavorsExtraSpecsNegativeTestJSON-978180385 tempest-FlavorsExtraSpecsNegativeTestJSON-978180385-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:28.622568 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0a2ff091-13f5-4f33-9745-fd3fe1182e31 tempest-FlavorsExtraSpecsNegativeTestJSON-978180385 tempest-FlavorsExtraSpecsNegativeTestJSON-978180385-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'd6d9f41d43524acaac34bf9930725aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa552659ccc6484992e712d512d03a45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:28.635828 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0a2ff091-13f5-4f33-9745-fd3fe1182e31 tempest-FlavorsExtraSpecsNegativeTestJSON-978180385 tempest-FlavorsExtraSpecsNegativeTestJSON-978180385-project] Request method failure captured: Sep 10 11:39:28.635828 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/flavors/1452717476/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 10 11:39:28.635828 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:39:28.635828 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:39:28.635828 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:39:28.635828 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:39:28.635828 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:39:28.635828 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:39:28.635828 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:39:28.635828 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:39:28.635828 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHdogbGrqEcYZFczXBrtj1srCESnKWe9cWMEJzUmsJWwicefr3iZDb9eruMoPDkD--MUVKimDzzFrUFWrxeTvYm0WbSFunPrZulWwD2i6eUQwVHVrrAQK6hCs0TjZvTWUO6APxr_56RdJ5rPx7FDL4pEqsDGeNAfKXOmek6OoT0daFs Sep 10 11:39:28.635828 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:39:28.635828 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:39:28.635828 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:39:28.635828 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:39:28.635828 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:39:28.635828 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:39:28.635828 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: aa552659ccc6484992e712d512d03a45 Sep 10 11:39:28.635828 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-978180385 Sep 10 11:39:28.635828 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:39:28.635828 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:39:28.637228 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa552659ccc6484992e712d512d03a45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa552659ccc6484992e712d512d03a45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_aa552659ccc6484992e712d512d03a45", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/aa552659ccc6484992e712d512d03a45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:39:28.637228 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-978180385 Sep 10 11:39:28.637228 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: aa552659ccc6484992e712d512d03a45 Sep 10 11:39:28.637228 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-978180385 Sep 10 11:39:28.637228 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-978180385-project Sep 10 11:39:28.637228 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:39:28.637228 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:39:28.637228 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: d6d9f41d43524acaac34bf9930725aa4 Sep 10 11:39:28.637228 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-978180385-project Sep 10 11:39:28.637228 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:39:28.637228 n-d-856895-1 devstack@n-api.service[128776]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 10 11:39:28.637972 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'flavor_id': '1452717476', 'id': 'hw:numa_nodes'} Sep 10 11:39:28.637972 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:39:28.637972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:28.637972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:28.637972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:28.637972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:39:28.637972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:39:28.637972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:39:28.637972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:39:28.637972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Sep 10 11:39:28.637972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Sep 10 11:39:28.637972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 11:39:28.637972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 11:39:28.637972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 11:39:28.637972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 11:39:28.637972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:39:28.637972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:39:28.637972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:39:28.637972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:39:28.637972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 11:39:28.639874 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 11:39:28.639874 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 11:39:28.639874 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 11:39:28.639874 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 11:39:28.639874 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 11:39:28.639874 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 10 11:39:28.639874 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:28.639874 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:28.639874 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:28.639874 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:28.639874 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:28.639874 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:28.639874 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 11:39:28.639874 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 11:39:28.639874 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 10 11:39:28.639874 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:28.639874 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0a2ff091-13f5-4f33-9745-fd3fe1182e31 tempest-FlavorsExtraSpecsNegativeTestJSON-978180385 tempest-FlavorsExtraSpecsNegativeTestJSON-978180385-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:39:28.641046 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0a2ff091-13f5-4f33-9745-fd3fe1182e31 tempest-FlavorsExtraSpecsNegativeTestJSON-978180385 tempest-FlavorsExtraSpecsNegativeTestJSON-978180385-project] 10.222.0.23 "DELETE /compute/v2.1/flavors/1452717476/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.029148 Sep 10 11:39:28.642708 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 242/470] 10.222.0.23 () {58 vars in 1248 bytes} [Sat Sep 10 11:39:28 2022] DELETE /compute/v2.1/flavors/1452717476/os-extra_specs/hw:numa_nodes => generated 124 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:39:28.647687 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-840f296e-78d7-486b-9f15-87aae7fcad09 tempest-FlavorsExtraSpecsTestJSON-2924597 tempest-FlavorsExtraSpecsTestJSON-2924597-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:28.709741 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-840f296e-78d7-486b-9f15-87aae7fcad09 tempest-FlavorsExtraSpecsTestJSON-2924597 tempest-FlavorsExtraSpecsTestJSON-2924597-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1123441334/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.065557 Sep 10 11:39:28.714079 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 243/471] 10.222.0.23 () {60 vars in 1224 bytes} [Sat Sep 10 11:39:28 2022] POST /compute/v2.1/flavors/1123441334/os-extra_specs => generated 66 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:39:28.727447 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-02dccce0-6dbd-40d4-b435-ffd3dfa82a8c tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:28.728235 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-02dccce0-6dbd-40d4-b435-ffd3dfa82a8c tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:28.735086 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02dccce0-6dbd-40d4-b435-ffd3dfa82a8c tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:28.736270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02dccce0-6dbd-40d4-b435-ffd3dfa82a8c tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:28.737055 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02dccce0-6dbd-40d4-b435-ffd3dfa82a8c tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:28.737929 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02dccce0-6dbd-40d4-b435-ffd3dfa82a8c tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:28.738549 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02dccce0-6dbd-40d4-b435-ffd3dfa82a8c tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:28.739303 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02dccce0-6dbd-40d4-b435-ffd3dfa82a8c tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:29.092288 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-02dccce0-6dbd-40d4-b435-ffd3dfa82a8c tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64e2df030a745de8ae7eda29d2ac30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c44e3e2920e48868e1c05f70b1d7639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:29.109393 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-02dccce0-6dbd-40d4-b435-ffd3dfa82a8c tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "GET /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7" status: 200 len: 1388 microversion: 2.1 time: 0.389575 Sep 10 11:39:29.128404 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 244/472] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:28 2022] GET /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 => generated 1388 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:29.136764 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-570fedde-c4a5-48a6-af7b-68fb65072304 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Calling method '.version_select at 0x7f4073aaaee0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:29.151011 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-570fedde-c4a5-48a6-af7b-68fb65072304 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:29.151911 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-570fedde-c4a5-48a6-af7b-68fb65072304 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:29.152536 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-570fedde-c4a5-48a6-af7b-68fb65072304 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:29.188672 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-570fedde-c4a5-48a6-af7b-68fb65072304 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 400 microversion: 2.1 time: 0.058328 Sep 10 11:39:29.190158 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 245/473] 10.222.0.23 () {58 vars in 1143 bytes} [Sat Sep 10 11:39:29 2022] GET /compute/v2.1/os-migrations => generated 400 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:39:29.195101 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5d96e28e-625a-48c5-8657-621b68a0bb34 tempest-FlavorsExtraSpecsNegativeTestJSON-377166645 tempest-FlavorsExtraSpecsNegativeTestJSON-377166645-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:29.257372 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5d96e28e-625a-48c5-8657-621b68a0bb34 tempest-FlavorsExtraSpecsNegativeTestJSON-377166645 tempest-FlavorsExtraSpecsNegativeTestJSON-377166645-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors/1452717476/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.065913 Sep 10 11:39:29.258904 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 246/474] 10.222.0.23 () {60 vars in 1224 bytes} [Sat Sep 10 11:39:29 2022] POST /compute/v2.1/flavors/1452717476/os-extra_specs => generated 66 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:39:29.264455 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f2fed365-beac-4231-913e-cb3637492d56 tempest-FlavorsExtraSpecsTestJSON-2924597 tempest-FlavorsExtraSpecsTestJSON-2924597-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:29.278168 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f2fed365-beac-4231-913e-cb3637492d56 tempest-FlavorsExtraSpecsTestJSON-2924597 tempest-FlavorsExtraSpecsTestJSON-2924597-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/1123441334/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.018018 Sep 10 11:39:29.283716 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 247/475] 10.222.0.23 () {58 vars in 1203 bytes} [Sat Sep 10 11:39:29 2022] GET /compute/v2.1/flavors/1123441334/os-extra_specs => generated 66 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:39:29.287901 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bde98524-cbb4-44fb-9061-def5f115d6e3 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:29.288529 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bde98524-cbb4-44fb-9061-def5f115d6e3 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] [instance: e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:29.296123 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bde98524-cbb4-44fb-9061-def5f115d6e3 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:29.296766 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bde98524-cbb4-44fb-9061-def5f115d6e3 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:29.297407 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bde98524-cbb4-44fb-9061-def5f115d6e3 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:29.298275 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bde98524-cbb4-44fb-9061-def5f115d6e3 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:29.299591 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bde98524-cbb4-44fb-9061-def5f115d6e3 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:29.300234 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bde98524-cbb4-44fb-9061-def5f115d6e3 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:29.866257 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bde98524-cbb4-44fb-9061-def5f115d6e3 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f" status: 200 len: 1645 microversion: 2.1 time: 0.585876 Sep 10 11:39:29.867626 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 248/476] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:29 2022] GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f => generated 1645 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:29.872496 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c23454b2-130a-4e42-b8b2-fd6116751e98 tempest-FlavorsExtraSpecsNegativeTestJSON-978180385 tempest-FlavorsExtraSpecsNegativeTestJSON-978180385-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:29.875769 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c23454b2-130a-4e42-b8b2-fd6116751e98 tempest-FlavorsExtraSpecsNegativeTestJSON-978180385 tempest-FlavorsExtraSpecsNegativeTestJSON-978180385-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'd6d9f41d43524acaac34bf9930725aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa552659ccc6484992e712d512d03a45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:29.878227 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c23454b2-130a-4e42-b8b2-fd6116751e98 tempest-FlavorsExtraSpecsNegativeTestJSON-978180385 tempest-FlavorsExtraSpecsNegativeTestJSON-978180385-project] Request method failure captured: Sep 10 11:39:29.878227 n-d-856895-1 devstack@n-api.service[128776]: request: PUT /compute/v2.1/flavors/1452717476/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 10 11:39:29.878227 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:39:29.878227 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:39:29.878227 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:39:29.878227 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 22 Sep 10 11:39:29.878227 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:39:29.878227 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:39:29.878227 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:39:29.878227 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:39:29.878227 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHdogbGrqEcYZFczXBrtj1srCESnKWe9cWMEJzUmsJWwicefr3iZDb9eruMoPDkD--MUVKimDzzFrUFWrxeTvYm0WbSFunPrZulWwD2i6eUQwVHVrrAQK6hCs0TjZvTWUO6APxr_56RdJ5rPx7FDL4pEqsDGeNAfKXOmek6OoT0daFs Sep 10 11:39:29.878227 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:39:29.878227 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:39:29.878227 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:39:29.878227 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:39:29.878227 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:39:29.878227 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:39:29.878227 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: aa552659ccc6484992e712d512d03a45 Sep 10 11:39:29.878227 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-978180385 Sep 10 11:39:29.878227 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:39:29.878227 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:39:29.879632 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa552659ccc6484992e712d512d03a45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aa552659ccc6484992e712d512d03a45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_aa552659ccc6484992e712d512d03a45", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/aa552659ccc6484992e712d512d03a45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:39:29.879632 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-978180385 Sep 10 11:39:29.879632 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: aa552659ccc6484992e712d512d03a45 Sep 10 11:39:29.879632 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-978180385 Sep 10 11:39:29.879632 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-978180385-project Sep 10 11:39:29.879632 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:39:29.879632 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:39:29.879632 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: d6d9f41d43524acaac34bf9930725aa4 Sep 10 11:39:29.879632 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-978180385-project Sep 10 11:39:29.879632 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 11:39:29.879632 n-d-856895-1 devstack@n-api.service[128776]: {"hw:numa_nodes": "1"} Sep 10 11:39:29.879632 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:39:29.879632 n-d-856895-1 devstack@n-api.service[128776]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 10 11:39:29.880413 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'flavor_id': '1452717476', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Sep 10 11:39:29.880413 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:39:29.880413 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:29.880413 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:29.880413 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:29.880413 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:39:29.880413 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:39:29.880413 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:39:29.880413 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:39:29.880413 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:39:29.880413 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:39:29.880413 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Sep 10 11:39:29.880413 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Sep 10 11:39:29.880413 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 11:39:29.880413 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 11:39:29.880413 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 11:39:29.880413 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 11:39:29.880413 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:39:29.880413 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:39:29.881471 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:39:29.881471 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:39:29.881471 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 11:39:29.881471 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 11:39:29.881471 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 11:39:29.881471 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 11:39:29.881471 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 11:39:29.881471 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 11:39:29.881471 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 10 11:39:29.881471 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:29.881471 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:29.881471 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:29.881471 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:29.881471 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:29.881471 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:29.881471 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 11:39:29.881471 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 11:39:29.881471 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 10 11:39:29.881471 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:29.882519 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c23454b2-130a-4e42-b8b2-fd6116751e98 tempest-FlavorsExtraSpecsNegativeTestJSON-978180385 tempest-FlavorsExtraSpecsNegativeTestJSON-978180385-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:39:29.882519 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c23454b2-130a-4e42-b8b2-fd6116751e98 tempest-FlavorsExtraSpecsNegativeTestJSON-978180385 tempest-FlavorsExtraSpecsNegativeTestJSON-978180385-project] 10.222.0.23 "PUT /compute/v2.1/flavors/1452717476/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.010927 Sep 10 11:39:29.885882 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 249/477] 10.222.0.23 () {60 vars in 1265 bytes} [Sat Sep 10 11:39:29 2022] PUT /compute/v2.1/flavors/1452717476/os-extra_specs/hw:numa_nodes => generated 124 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:39:29.903512 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-214c4246-8630-4ddc-9ebe-31edcd25f2e0 tempest-FlavorsExtraSpecsTestJSON-2924597 tempest-FlavorsExtraSpecsTestJSON-2924597-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:29.947255 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-214c4246-8630-4ddc-9ebe-31edcd25f2e0 tempest-FlavorsExtraSpecsTestJSON-2924597 tempest-FlavorsExtraSpecsTestJSON-2924597-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/1123441334/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.049404 Sep 10 11:39:29.948256 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 250/478] 10.222.0.23 () {60 vars in 1265 bytes} [Sat Sep 10 11:39:29 2022] PUT /compute/v2.1/flavors/1123441334/os-extra_specs/hw:numa_nodes => generated 22 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:39:29.959877 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-89ff3148-ec36-4b53-81a4-d599a4793e1c tempest-FlavorsExtraSpecsNegativeTestJSON-377166645 tempest-FlavorsExtraSpecsNegativeTestJSON-377166645-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:29.972978 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-89ff3148-ec36-4b53-81a4-d599a4793e1c tempest-FlavorsExtraSpecsNegativeTestJSON-377166645 tempest-FlavorsExtraSpecsNegativeTestJSON-377166645-project-admin] HTTP exception thrown: Flavor 1452717476 has no extra specs with key hw:cpu_thread_policy. Sep 10 11:39:29.974905 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-89ff3148-ec36-4b53-81a4-d599a4793e1c tempest-FlavorsExtraSpecsNegativeTestJSON-377166645 tempest-FlavorsExtraSpecsNegativeTestJSON-377166645-project-admin] Request method failure captured: Sep 10 11:39:29.974905 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/flavors/1452717476/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 10 11:39:29.974905 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:39:29.974905 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:39:29.974905 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:39:29.974905 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:39:29.974905 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:39:29.974905 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:39:29.974905 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:39:29.974905 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:39:29.974905 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHdpOzKD2XL_jfHcoUjpEjywBYcHS0M9fCe1jg3klNZZEdze38B6QKCT2bgKkC_H2yJzMNavUD5VCnlOhWMZR0r5Is5XA57J0Li6H03bOqB6TmrNn25TB4U1_ICf5m2lh2vFcFbVq590K-TRUGPYhtJ6UE6tNBExuO_ID3J1epG4kcU Sep 10 11:39:29.974905 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:39:29.974905 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:39:29.974905 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:39:29.974905 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:39:29.974905 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:39:29.974905 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:39:29.974905 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 2423bf0603eb4d0f8e1b022caecd52eb Sep 10 11:39:29.974905 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-377166645 Sep 10 11:39:29.974905 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,admin,member Sep 10 11:39:29.974905 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,admin,member Sep 10 11:39:29.976270 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2423bf0603eb4d0f8e1b022caecd52eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2423bf0603eb4d0f8e1b022caecd52eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2423bf0603eb4d0f8e1b022caecd52eb", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2423bf0603eb4d0f8e1b022caecd52eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:39:29.976270 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-377166645 Sep 10 11:39:29.976270 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 2423bf0603eb4d0f8e1b022caecd52eb Sep 10 11:39:29.976270 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-377166645 Sep 10 11:39:29.976270 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-377166645-project-admin Sep 10 11:39:29.976270 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:39:29.976270 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:39:29.976270 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: a4492231d68f4b95a5f8c5712dbfcc4d Sep 10 11:39:29.976270 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-377166645-project-admin Sep 10 11:39:29.976270 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:39:29.976270 n-d-856895-1 devstack@n-api.service[128776]: exception: Flavor 1452717476 has no extra specs with key hw:cpu_thread_policy. Sep 10 11:39:29.976978 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'flavor_id': '1452717476', 'id': 'hw:cpu_thread_policy'} Sep 10 11:39:29.976978 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:39:29.976978 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:29.976978 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Sep 10 11:39:29.976978 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Sep 10 11:39:29.976978 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 10 11:39:29.976978 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:29.976978 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:29.976978 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:29.976978 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:29.976978 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:29.976978 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:29.976978 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:39:29.976978 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:39:29.976978 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:39:29.976978 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:39:29.976978 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Sep 10 11:39:29.976978 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 10 11:39:29.976978 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1452717476 has no extra specs with key hw:cpu_thread_policy. Sep 10 11:39:29.976978 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:29.976978 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:29.976978 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:29.978198 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:29.978198 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:29.978198 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:29.978198 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:39:29.978198 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:39:29.978198 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1452717476 has no extra specs with key hw:cpu_thread_policy. Sep 10 11:39:29.978198 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:29.981655 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-89ff3148-ec36-4b53-81a4-d599a4793e1c tempest-FlavorsExtraSpecsNegativeTestJSON-377166645 tempest-FlavorsExtraSpecsNegativeTestJSON-377166645-project-admin] Returning 404 to user: Flavor 1452717476 has no extra specs with key hw:cpu_thread_policy. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:39:29.985158 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-89ff3148-ec36-4b53-81a4-d599a4793e1c tempest-FlavorsExtraSpecsNegativeTestJSON-377166645 tempest-FlavorsExtraSpecsNegativeTestJSON-377166645-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1452717476/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.035337 Sep 10 11:39:29.987804 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 251/479] 10.222.0.23 () {58 vars in 1269 bytes} [Sat Sep 10 11:39:29 2022] DELETE /compute/v2.1/flavors/1452717476/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:39:29.999504 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-347ccdb4-b663-456a-a230-9ecfd306f19c req-9851b334-eb93-48d0-84be-c338079661ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7", "tag": "5c65da57-0904-4a32-9c5a-d379b5f6e7cf"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:30.019859 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-347ccdb4-b663-456a-a230-9ecfd306f19c req-9851b334-eb93-48d0-84be-c338079661ea service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:30.020857 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-347ccdb4-b663-456a-a230-9ecfd306f19c req-9851b334-eb93-48d0-84be-c338079661ea service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:30.021503 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-347ccdb4-b663-456a-a230-9ecfd306f19c req-9851b334-eb93-48d0-84be-c338079661ea service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:30.045284 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-347ccdb4-b663-456a-a230-9ecfd306f19c req-9851b334-eb93-48d0-84be-c338079661ea service nova] Creating event network-changed:5c65da57-0904-4a32-9c5a-d379b5f6e7cf for instance 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 on n-h1-856895-1 Sep 10 11:39:30.063342 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-347ccdb4-b663-456a-a230-9ecfd306f19c req-9851b334-eb93-48d0-84be-c338079661ea service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068767 Sep 10 11:39:30.064670 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 252/480] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:39:30.069976 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6a4fae8e-aa0e-4c06-8fc7-88096caece6b tempest-FlavorsExtraSpecsTestJSON-2924597 tempest-FlavorsExtraSpecsTestJSON-2924597-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:30.076888 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=5,nova_api:SAVEPOINT=10,nova_api:RELEASE=10,nova_api:UPDATE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:39:30.089317 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6a4fae8e-aa0e-4c06-8fc7-88096caece6b tempest-FlavorsExtraSpecsTestJSON-2924597 tempest-FlavorsExtraSpecsTestJSON-2924597-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/1123441334/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.022941 Sep 10 11:39:30.090972 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 253/481] 10.222.0.23 () {58 vars in 1203 bytes} [Sat Sep 10 11:39:30 2022] GET /compute/v2.1/flavors/1123441334/os-extra_specs => generated 66 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:39:30.097452 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d7ed5aa8-4e0e-49ee-8532-c6e20bd11da5 tempest-FlavorsExtraSpecsNegativeTestJSON-377166645 tempest-FlavorsExtraSpecsNegativeTestJSON-377166645-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:30.103049 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-d7ed5aa8-4e0e-49ee-8532-c6e20bd11da5 tempest-FlavorsExtraSpecsNegativeTestJSON-377166645 tempest-FlavorsExtraSpecsNegativeTestJSON-377166645-project-admin] HTTP exception thrown: Request body and URI mismatch Sep 10 11:39:30.115810 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d7ed5aa8-4e0e-49ee-8532-c6e20bd11da5 tempest-FlavorsExtraSpecsNegativeTestJSON-377166645 tempest-FlavorsExtraSpecsNegativeTestJSON-377166645-project-admin] Request method failure captured: Sep 10 11:39:30.115810 n-d-856895-1 devstack@n-api.service[128776]: request: PUT /compute/v2.1/flavors/1452717476/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 10 11:39:30.115810 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:39:30.115810 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:39:30.115810 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:39:30.115810 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 27 Sep 10 11:39:30.115810 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:39:30.115810 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:39:30.115810 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:39:30.115810 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:39:30.115810 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHdpOzKD2XL_jfHcoUjpEjywBYcHS0M9fCe1jg3klNZZEdze38B6QKCT2bgKkC_H2yJzMNavUD5VCnlOhWMZR0r5Is5XA57J0Li6H03bOqB6TmrNn25TB4U1_ICf5m2lh2vFcFbVq590K-TRUGPYhtJ6UE6tNBExuO_ID3J1epG4kcU Sep 10 11:39:30.115810 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:39:30.115810 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:39:30.115810 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:39:30.115810 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:39:30.115810 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:39:30.115810 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:39:30.115810 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 2423bf0603eb4d0f8e1b022caecd52eb Sep 10 11:39:30.115810 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-377166645 Sep 10 11:39:30.115810 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,admin,member Sep 10 11:39:30.115810 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,admin,member Sep 10 11:39:30.117516 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2423bf0603eb4d0f8e1b022caecd52eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2423bf0603eb4d0f8e1b022caecd52eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2423bf0603eb4d0f8e1b022caecd52eb", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2423bf0603eb4d0f8e1b022caecd52eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:39:30.117516 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-377166645 Sep 10 11:39:30.117516 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 2423bf0603eb4d0f8e1b022caecd52eb Sep 10 11:39:30.117516 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-377166645 Sep 10 11:39:30.117516 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-377166645-project-admin Sep 10 11:39:30.117516 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:39:30.117516 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:39:30.117516 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: a4492231d68f4b95a5f8c5712dbfcc4d Sep 10 11:39:30.117516 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-377166645-project-admin Sep 10 11:39:30.117516 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 11:39:30.117516 n-d-856895-1 devstack@n-api.service[128776]: {"hw:cpu_policy": "shared"} Sep 10 11:39:30.117516 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:39:30.117516 n-d-856895-1 devstack@n-api.service[128776]: exception: Request body and URI mismatch Sep 10 11:39:30.118422 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'flavor_id': '1452717476', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Sep 10 11:39:30.118422 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:39:30.118422 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:30.118422 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:30.118422 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:30.118422 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:39:30.118422 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:39:30.118422 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:39:30.118422 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:39:30.118422 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:39:30.118422 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:39:30.118422 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Sep 10 11:39:30.118422 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Sep 10 11:39:30.118422 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Sep 10 11:39:30.118422 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:30.118422 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:30.118422 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:30.118422 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:30.118422 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:30.118422 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:30.119832 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:39:30.119832 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:39:30.119832 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Sep 10 11:39:30.119832 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:30.125175 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d7ed5aa8-4e0e-49ee-8532-c6e20bd11da5 tempest-FlavorsExtraSpecsNegativeTestJSON-377166645 tempest-FlavorsExtraSpecsNegativeTestJSON-377166645-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:39:30.126067 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d7ed5aa8-4e0e-49ee-8532-c6e20bd11da5 tempest-FlavorsExtraSpecsNegativeTestJSON-377166645 tempest-FlavorsExtraSpecsNegativeTestJSON-377166645-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/1452717476/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.033797 Sep 10 11:39:30.127037 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 254/482] 10.222.0.23 () {60 vars in 1265 bytes} [Sat Sep 10 11:39:30 2022] PUT /compute/v2.1/flavors/1452717476/os-extra_specs/hw:numa_nodes => generated 73 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 10 11:39:30.154594 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-623f92cb-dd64-4a86-a4d2-df4803eb29bc tempest-FlavorsExtraSpecsTestJSON-2924597 tempest-FlavorsExtraSpecsTestJSON-2924597-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:30.233946 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-623f92cb-dd64-4a86-a4d2-df4803eb29bc tempest-FlavorsExtraSpecsTestJSON-2924597 tempest-FlavorsExtraSpecsTestJSON-2924597-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1123441334/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.104601 Sep 10 11:39:30.234876 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 255/483] 10.222.0.23 () {58 vars in 1248 bytes} [Sat Sep 10 11:39:30 2022] DELETE /compute/v2.1/flavors/1123441334/os-extra_specs/hw:numa_nodes => generated 0 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 11:39:30.241131 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-51033f81-8025-4d3a-9b72-5364614d37a4 tempest-FlavorsExtraSpecsNegativeTestJSON-377166645 tempest-FlavorsExtraSpecsNegativeTestJSON-377166645-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:30.245420 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-51033f81-8025-4d3a-9b72-5364614d37a4 tempest-FlavorsExtraSpecsNegativeTestJSON-377166645 tempest-FlavorsExtraSpecsNegativeTestJSON-377166645-project-admin] Request method failure captured: Sep 10 11:39:30.245420 n-d-856895-1 devstack@n-api.service[128776]: request: PUT /compute/v2.1/flavors/1452717476/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 10 11:39:30.245420 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:39:30.245420 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:39:30.245420 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:39:30.245420 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 49 Sep 10 11:39:30.245420 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:39:30.245420 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:39:30.245420 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:39:30.245420 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:39:30.245420 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHdpOzKD2XL_jfHcoUjpEjywBYcHS0M9fCe1jg3klNZZEdze38B6QKCT2bgKkC_H2yJzMNavUD5VCnlOhWMZR0r5Is5XA57J0Li6H03bOqB6TmrNn25TB4U1_ICf5m2lh2vFcFbVq590K-TRUGPYhtJ6UE6tNBExuO_ID3J1epG4kcU Sep 10 11:39:30.245420 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:39:30.245420 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:39:30.245420 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:39:30.245420 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:39:30.245420 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:39:30.245420 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:39:30.245420 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 2423bf0603eb4d0f8e1b022caecd52eb Sep 10 11:39:30.245420 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-377166645 Sep 10 11:39:30.245420 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,admin,member Sep 10 11:39:30.245420 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,admin,member Sep 10 11:39:30.246670 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2423bf0603eb4d0f8e1b022caecd52eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2423bf0603eb4d0f8e1b022caecd52eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2423bf0603eb4d0f8e1b022caecd52eb", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2423bf0603eb4d0f8e1b022caecd52eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:39:30.246670 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-377166645 Sep 10 11:39:30.246670 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 2423bf0603eb4d0f8e1b022caecd52eb Sep 10 11:39:30.246670 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-377166645 Sep 10 11:39:30.246670 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-377166645-project-admin Sep 10 11:39:30.246670 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:39:30.246670 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:39:30.246670 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: a4492231d68f4b95a5f8c5712dbfcc4d Sep 10 11:39:30.246670 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-377166645-project-admin Sep 10 11:39:30.246670 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 11:39:30.246670 n-d-856895-1 devstack@n-api.service[128776]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Sep 10 11:39:30.246670 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:39:30.247419 n-d-856895-1 devstack@n-api.service[128776]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 10 11:39:30.247419 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'flavor_id': '1452717476', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Sep 10 11:39:30.247419 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:39:30.247419 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:30.247419 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 11:39:30.247419 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 11:39:30.247419 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 11:39:30.247419 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise error Sep 10 11:39:30.247419 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 10 11:39:30.247419 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:30.247419 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Sep 10 11:39:30.247419 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 10 11:39:30.247419 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Sep 10 11:39:30.247419 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Sep 10 11:39:30.247419 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 10 11:39:30.247419 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'type': ['string', Sep 10 11:39:30.247419 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'number']}}, Sep 10 11:39:30.247419 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 10 11:39:30.247419 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:30.247419 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi On instance: Sep 10 11:39:30.247419 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Sep 10 11:39:30.247419 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:30.250846 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:30.250846 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:30.250846 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:30.250846 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:30.250846 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:30.250846 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:39:30.250846 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:39:30.250846 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:39:30.250846 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:39:30.250846 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 11:39:30.250846 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 11:39:30.250846 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 11:39:30.250846 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 11:39:30.250846 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 11:39:30.250846 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 11:39:30.250846 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 10 11:39:30.250846 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:30.250846 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:30.250846 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:30.250846 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:30.252705 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:30.252705 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:30.252705 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 11:39:30.252705 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 11:39:30.252705 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 10 11:39:30.252705 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:30.252705 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-51033f81-8025-4d3a-9b72-5364614d37a4 tempest-FlavorsExtraSpecsNegativeTestJSON-377166645 tempest-FlavorsExtraSpecsNegativeTestJSON-377166645-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:39:30.252705 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-51033f81-8025-4d3a-9b72-5364614d37a4 tempest-FlavorsExtraSpecsNegativeTestJSON-377166645 tempest-FlavorsExtraSpecsNegativeTestJSON-377166645-project-admin] 10.222.0.23 "PUT /compute/v2.1/flavors/1452717476/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.010762 Sep 10 11:39:30.252705 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 256/484] 10.222.0.23 () {60 vars in 1265 bytes} [Sat Sep 10 11:39:30 2022] PUT /compute/v2.1/flavors/1452717476/os-extra_specs/hw:numa_nodes => generated 117 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:39:30.254285 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ed3b9818-d2d3-4958-a424-5b4d88d09dfe tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:30.255235 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ed3b9818-d2d3-4958-a424-5b4d88d09dfe tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:30.263936 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed3b9818-d2d3-4958-a424-5b4d88d09dfe tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:30.264620 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed3b9818-d2d3-4958-a424-5b4d88d09dfe tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:30.265229 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed3b9818-d2d3-4958-a424-5b4d88d09dfe tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:30.266183 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed3b9818-d2d3-4958-a424-5b4d88d09dfe tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:30.266802 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed3b9818-d2d3-4958-a424-5b4d88d09dfe tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:30.267455 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed3b9818-d2d3-4958-a424-5b4d88d09dfe tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:30.628037 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ed3b9818-d2d3-4958-a424-5b4d88d09dfe tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64e2df030a745de8ae7eda29d2ac30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c44e3e2920e48868e1c05f70b1d7639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:30.643191 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ed3b9818-d2d3-4958-a424-5b4d88d09dfe tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "GET /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7" status: 200 len: 1388 microversion: 2.1 time: 0.393889 Sep 10 11:39:30.657625 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 257/485] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:30 2022] GET /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 => generated 1388 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:30.675745 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5649829d-e193-41f6-8c46-f885a70478a2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-130639177", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "71f52e07-83f9-4397-aa4d-2431ed919e89"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:30.678317 n-d-856895-1 devstack@n-api.service[128777]: DEBUG neutronclient.v2_0.client [None req-3d114cc8-d7bc-4576-a493-b66223dad9ab tempest-SecurityGroupsTestAdminJSON-1451783304 tempest-SecurityGroupsTestAdminJSON-1451783304-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ab711183-59d0-4b37-be1d-abfb5d7b2b35 does not exist", "detail": ""}} {{(pid=128777) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 11:39:30.678974 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.security_group_api [None req-3d114cc8-d7bc-4576-a493-b66223dad9ab tempest-SecurityGroupsTestAdminJSON-1451783304 tempest-SecurityGroupsTestAdminJSON-1451783304-project-admin] Neutron security group ab711183-59d0-4b37-be1d-abfb5d7b2b35 not found {{(pid=128777) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 11:39:30.679396 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.compute.security_groups [None req-3d114cc8-d7bc-4576-a493-b66223dad9ab tempest-SecurityGroupsTestAdminJSON-1451783304 tempest-SecurityGroupsTestAdminJSON-1451783304-project-admin] Security Group ID ab711183-59d0-4b37-be1d-abfb5d7b2b35 does not exist {{(pid=128777) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Sep 10 11:39:30.764213 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-5649829d-e193-41f6-8c46-f885a70478a2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] validate_networks() for [('71f52e07-83f9-4397-aa4d-2431ed919e89', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:39:32.129815 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-5649829d-e193-41f6-8c46-f885a70478a2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:39:32.131094 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-5649829d-e193-41f6-8c46-f885a70478a2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:39:32.133305 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-5649829d-e193-41f6-8c46-f885a70478a2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:39:32.134750 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-5649829d-e193-41f6-8c46-f885a70478a2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:39:32.139653 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-5649829d-e193-41f6-8c46-f885a70478a2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:39:32.166663 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5649829d-e193-41f6-8c46-f885a70478a2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:32.168507 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5649829d-e193-41f6-8c46-f885a70478a2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:32.169328 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5649829d-e193-41f6-8c46-f885a70478a2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:32.172078 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5649829d-e193-41f6-8c46-f885a70478a2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:32.174377 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5649829d-e193-41f6-8c46-f885a70478a2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:32.176039 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5649829d-e193-41f6-8c46-f885a70478a2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:32.239653 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-5649829d-e193-41f6-8c46-f885a70478a2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Getting quotas for project 6750367ae6604f798bfd58e2839f83e2. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:39:32.244932 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-5649829d-e193-41f6-8c46-f885a70478a2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Getting quotas for user 805e0c24bd364ac8852387db73b614d9 and project 6750367ae6604f798bfd58e2839f83e2. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:39:32.275433 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5649829d-e193-41f6-8c46-f885a70478a2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:39:32.280221 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5649829d-e193-41f6-8c46-f885a70478a2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: a21897bf-57b5-43df-b83e-0fe0461a589b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:39:32.397282 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5649829d-e193-41f6-8c46-f885a70478a2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.737669 Sep 10 11:39:32.398285 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 258/486] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:39:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:39:32.403030 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4b69ac2c-3fd4-4293-8b22-739de5e46208 tempest-FlavorsExtraSpecsTestJSON-2924597 tempest-FlavorsExtraSpecsTestJSON-2924597-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:32.453200 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4b69ac2c-3fd4-4293-8b22-739de5e46208 tempest-FlavorsExtraSpecsTestJSON-2924597 tempest-FlavorsExtraSpecsTestJSON-2924597-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1123441334/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.052963 Sep 10 11:39:32.457088 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 259/487] 10.222.0.23 () {58 vars in 1248 bytes} [Sat Sep 10 11:39:32 2022] DELETE /compute/v2.1/flavors/1123441334/os-extra_specs/hw:cpu_policy => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 10 11:39:32.468721 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4e40f926-6b49-47ab-aecc-9d59e7171204 tempest-FlavorsExtraSpecsNegativeTestJSON-377166645 tempest-FlavorsExtraSpecsNegativeTestJSON-377166645-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:32.506036 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4e40f926-6b49-47ab-aecc-9d59e7171204 tempest-FlavorsExtraSpecsNegativeTestJSON-377166645 tempest-FlavorsExtraSpecsNegativeTestJSON-377166645-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1452717476" status: 202 len: 0 microversion: 2.1 time: 0.047458 Sep 10 11:39:32.507269 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 260/488] 10.222.0.23 () {58 vars in 1161 bytes} [Sat Sep 10 11:39:32 2022] DELETE /compute/v2.1/flavors/1452717476 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:39:32.516967 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c80730e5-086e-42a5-97af-67aac98c021d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:32.521326 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3d114cc8-d7bc-4576-a493-b66223dad9ab tempest-SecurityGroupsTestAdminJSON-1451783304 tempest-SecurityGroupsTestAdminJSON-1451783304-project-admin] 10.222.0.23 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 10108 microversion: 2.1 time: 8.407342 Sep 10 11:39:32.522478 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 229/489] 10.222.0.23 () {58 vars in 1191 bytes} [Sat Sep 10 11:39:24 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 10108 bytes in 8409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:39:32.527580 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-221fb791-81db-4703-aea2-7cbc1f64e898 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:32.528592 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-221fb791-81db-4703-aea2-7cbc1f64e898 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: a21897bf-57b5-43df-b83e-0fe0461a589b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:32.531823 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c80730e5-086e-42a5-97af-67aac98c021d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:32.551655 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c80730e5-086e-42a5-97af-67aac98c021d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:32.554390 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c80730e5-086e-42a5-97af-67aac98c021d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:32.557265 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c80730e5-086e-42a5-97af-67aac98c021d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:32.558008 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c80730e5-086e-42a5-97af-67aac98c021d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:32.560125 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c80730e5-086e-42a5-97af-67aac98c021d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:32.560763 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c80730e5-086e-42a5-97af-67aac98c021d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:32.726685 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-221fb791-81db-4703-aea2-7cbc1f64e898 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:32.741562 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-221fb791-81db-4703-aea2-7cbc1f64e898 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b" status: 200 len: 1210 microversion: 2.1 time: 0.215245 Sep 10 11:39:32.742187 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 230/490] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:32 2022] GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b => generated 1210 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:32.759357 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-041efbd4-101f-49f2-b8ba-e8ec7761f4da tempest-FlavorsExtraSpecsTestJSON-2924597 tempest-FlavorsExtraSpecsTestJSON-2924597-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:32.778281 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-041efbd4-101f-49f2-b8ba-e8ec7761f4da tempest-FlavorsExtraSpecsTestJSON-2924597 tempest-FlavorsExtraSpecsTestJSON-2924597-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/1123441334/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.031062 Sep 10 11:39:32.781272 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 231/491] 10.222.0.23 () {58 vars in 1203 bytes} [Sat Sep 10 11:39:32 2022] GET /compute/v2.1/flavors/1123441334/os-extra_specs => generated 19 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:39:32.795334 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-627c8042-cfe7-44b1-be8a-c22ec4d729e4 tempest-FlavorsExtraSpecsNegativeTestJSON-377166645 tempest-FlavorsExtraSpecsNegativeTestJSON-377166645-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:32.850886 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-627c8042-cfe7-44b1-be8a-c22ec4d729e4 tempest-FlavorsExtraSpecsNegativeTestJSON-377166645 tempest-FlavorsExtraSpecsNegativeTestJSON-377166645-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 6223 microversion: 2.1 time: 0.067713 Sep 10 11:39:32.853520 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 232/492] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:39:32 2022] GET /compute/v2.1/flavors/detail => generated 6223 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:32.868415 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7aed6fea-f8c0-418b-ad03-fb51380d4f9b tempest-SecurityGroupsTestAdminJSON-1953955293 tempest-SecurityGroupsTestAdminJSON-1953955293-project] Calling method '.version_select at 0x7f407369fdc0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:33.675902 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c80730e5-086e-42a5-97af-67aac98c021d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64e2df030a745de8ae7eda29d2ac30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c44e3e2920e48868e1c05f70b1d7639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:33.690557 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c80730e5-086e-42a5-97af-67aac98c021d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "GET /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7" status: 200 len: 1388 microversion: 2.1 time: 1.180485 Sep 10 11:39:33.692470 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 261/493] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:32 2022] GET /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 => generated 1388 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:33.700845 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f1e830d5-3bc8-44c5-bada-0c647dd14d1d tempest-FlavorsExtraSpecsTestJSON-2924597 tempest-FlavorsExtraSpecsTestJSON-2924597-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:33.737905 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f1e830d5-3bc8-44c5-bada-0c647dd14d1d tempest-FlavorsExtraSpecsTestJSON-2924597 tempest-FlavorsExtraSpecsTestJSON-2924597-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/1123441334" status: 202 len: 0 microversion: 2.1 time: 0.040607 Sep 10 11:39:33.738938 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 262/494] 10.222.0.23 () {58 vars in 1161 bytes} [Sat Sep 10 11:39:33 2022] DELETE /compute/v2.1/flavors/1123441334 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:39:34.098290 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=36 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:39:34.192084 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-34477c74-95b4-4d36-9d16-a20f9652c7c9 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1334382495", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:34.302884 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-34477c74-95b4-4d36-9d16-a20f9652c7c9 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] validate_networks() for None {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:39:34.369544 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7aed6fea-f8c0-418b-ad03-fb51380d4f9b tempest-SecurityGroupsTestAdminJSON-1953955293 tempest-SecurityGroupsTestAdminJSON-1953955293-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 1.514204 Sep 10 11:39:34.370144 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 233/495] 10.222.0.23 () {58 vars in 1191 bytes} [Sat Sep 10 11:39:32 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:34.393587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f07749db-f7e8-4af4-88e4-292e45a81d79 tempest-FlavorsExtraSpecsTestJSON-2924597 tempest-FlavorsExtraSpecsTestJSON-2924597-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:34.499046 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f07749db-f7e8-4af4-88e4-292e45a81d79 tempest-FlavorsExtraSpecsTestJSON-2924597 tempest-FlavorsExtraSpecsTestJSON-2924597-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.119854 Sep 10 11:39:34.502415 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 234/496] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:39:34 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:34.523822 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-06162da4-f0ef-4415-bc40-e8fe278bafc2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:34.529634 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-06162da4-f0ef-4415-bc40-e8fe278bafc2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: a21897bf-57b5-43df-b83e-0fe0461a589b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:34.554289 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06162da4-f0ef-4415-bc40-e8fe278bafc2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:34.578733 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06162da4-f0ef-4415-bc40-e8fe278bafc2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:34.581384 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06162da4-f0ef-4415-bc40-e8fe278bafc2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:34.582337 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06162da4-f0ef-4415-bc40-e8fe278bafc2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:34.593657 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06162da4-f0ef-4415-bc40-e8fe278bafc2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:34.596761 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06162da4-f0ef-4415-bc40-e8fe278bafc2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:35.022722 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-06162da4-f0ef-4415-bc40-e8fe278bafc2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:35.031876 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-06162da4-f0ef-4415-bc40-e8fe278bafc2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b" status: 200 len: 1262 microversion: 2.1 time: 0.523338 Sep 10 11:39:35.038953 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 235/497] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:34 2022] GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b => generated 1262 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:35.049455 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-55275df7-bf09-4da5-bade-03ba00fe43ef tempest-SecurityGroupsTestAdminJSON-1451783304 tempest-SecurityGroupsTestAdminJSON-1451783304-project-admin] Calling method '.version_select at 0x7f407374f3a0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:35.438141 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-34477c74-95b4-4d36-9d16-a20f9652c7c9 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:39:35.439755 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-34477c74-95b4-4d36-9d16-a20f9652c7c9 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:39:35.440619 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-34477c74-95b4-4d36-9d16-a20f9652c7c9 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:39:35.441273 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-34477c74-95b4-4d36-9d16-a20f9652c7c9 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:39:35.441931 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-34477c74-95b4-4d36-9d16-a20f9652c7c9 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:39:35.479690 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-34477c74-95b4-4d36-9d16-a20f9652c7c9 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:35.480183 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-34477c74-95b4-4d36-9d16-a20f9652c7c9 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:35.486694 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-34477c74-95b4-4d36-9d16-a20f9652c7c9 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:35.492911 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-34477c74-95b4-4d36-9d16-a20f9652c7c9 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:35.493407 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-34477c74-95b4-4d36-9d16-a20f9652c7c9 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:35.496543 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-34477c74-95b4-4d36-9d16-a20f9652c7c9 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:35.545605 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-34477c74-95b4-4d36-9d16-a20f9652c7c9 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Getting quotas for project e5f5d40e4bab429cb080f76a3ed3ee9e. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:39:35.559031 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-34477c74-95b4-4d36-9d16-a20f9652c7c9 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Getting quotas for user bb907e8146dc42fc9cc47ff41a424503 and project e5f5d40e4bab429cb080f76a3ed3ee9e. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:39:35.591949 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-34477c74-95b4-4d36-9d16-a20f9652c7c9 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:39:35.601888 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-34477c74-95b4-4d36-9d16-a20f9652c7c9 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] [instance: a734916f-d369-4438-97de-3d0ae408384e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:39:35.742337 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-34477c74-95b4-4d36-9d16-a20f9652c7c9 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.000893 Sep 10 11:39:35.749151 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 263/498] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:39:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:39:35.755967 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-01a3e563-fcce-4ad5-939a-e48874fec7ac tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:35.758310 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-01a3e563-fcce-4ad5-939a-e48874fec7ac tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:35.777132 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01a3e563-fcce-4ad5-939a-e48874fec7ac tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:35.777806 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01a3e563-fcce-4ad5-939a-e48874fec7ac tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:35.778423 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01a3e563-fcce-4ad5-939a-e48874fec7ac tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:35.779345 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01a3e563-fcce-4ad5-939a-e48874fec7ac tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:35.779963 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01a3e563-fcce-4ad5-939a-e48874fec7ac tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:35.780546 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01a3e563-fcce-4ad5-939a-e48874fec7ac tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:36.303654 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-55275df7-bf09-4da5-bade-03ba00fe43ef tempest-SecurityGroupsTestAdminJSON-1451783304 tempest-SecurityGroupsTestAdminJSON-1451783304-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/81b78b6b-5ad3-4413-8e82-9120db8380a7" status: 202 len: 0 microversion: 2.1 time: 1.263034 Sep 10 11:39:36.304832 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 236/499] 10.222.0.23 () {58 vars in 1272 bytes} [Sat Sep 10 11:39:35 2022] DELETE /compute/v2.1/os-security-groups/81b78b6b-5ad3-4413-8e82-9120db8380a7 => generated 0 bytes in 1265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:39:36.311079 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1778342c-912c-46ab-982a-b54e79287ce3 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:36.312063 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1778342c-912c-46ab-982a-b54e79287ce3 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] [instance: a734916f-d369-4438-97de-3d0ae408384e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:36.552019 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1778342c-912c-46ab-982a-b54e79287ce3 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb907e8146dc42fc9cc47ff41a424503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f5d40e4bab429cb080f76a3ed3ee9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:36.562934 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1778342c-912c-46ab-982a-b54e79287ce3 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] 10.222.0.23 "GET /compute/v2.1/servers/a734916f-d369-4438-97de-3d0ae408384e" status: 200 len: 1214 microversion: 2.1 time: 0.256747 Sep 10 11:39:36.565489 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 237/500] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:36 2022] GET /compute/v2.1/servers/a734916f-d369-4438-97de-3d0ae408384e => generated 1214 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:36.594069 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cb6dd04b-5e89-46a2-9b6f-487a4e5a6e8c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:36.602093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cb6dd04b-5e89-46a2-9b6f-487a4e5a6e8c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: a21897bf-57b5-43df-b83e-0fe0461a589b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:36.620219 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb6dd04b-5e89-46a2-9b6f-487a4e5a6e8c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:36.620972 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb6dd04b-5e89-46a2-9b6f-487a4e5a6e8c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:36.621596 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb6dd04b-5e89-46a2-9b6f-487a4e5a6e8c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:36.622531 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb6dd04b-5e89-46a2-9b6f-487a4e5a6e8c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:36.623269 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb6dd04b-5e89-46a2-9b6f-487a4e5a6e8c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:36.624112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb6dd04b-5e89-46a2-9b6f-487a4e5a6e8c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:36.936558 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cb6dd04b-5e89-46a2-9b6f-487a4e5a6e8c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:36.946589 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cb6dd04b-5e89-46a2-9b6f-487a4e5a6e8c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b" status: 200 len: 1268 microversion: 2.1 time: 0.364424 Sep 10 11:39:36.952445 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 238/501] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:36 2022] GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b => generated 1268 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:36.960954 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b7a524de-eb27-4525-9360-00830eecb279 tempest-SecurityGroupsTestAdminJSON-1451783304 tempest-SecurityGroupsTestAdminJSON-1451783304-project-admin] Calling method '.version_select at 0x7f407383adc0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:37.302708 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-01a3e563-fcce-4ad5-939a-e48874fec7ac tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64e2df030a745de8ae7eda29d2ac30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c44e3e2920e48868e1c05f70b1d7639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:37.320738 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-01a3e563-fcce-4ad5-939a-e48874fec7ac tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "GET /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7" status: 200 len: 1388 microversion: 2.1 time: 1.570027 Sep 10 11:39:37.321561 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 264/502] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:35 2022] GET /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 => generated 1388 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:37.590362 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dea36ac4-aea3-4e75-ba7a-99c868b15a2d tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:37.591581 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-dea36ac4-aea3-4e75-ba7a-99c868b15a2d tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] [instance: a734916f-d369-4438-97de-3d0ae408384e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:37.598830 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dea36ac4-aea3-4e75-ba7a-99c868b15a2d tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:37.599618 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dea36ac4-aea3-4e75-ba7a-99c868b15a2d tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:37.600326 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dea36ac4-aea3-4e75-ba7a-99c868b15a2d tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:37.603118 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dea36ac4-aea3-4e75-ba7a-99c868b15a2d tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:37.604109 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dea36ac4-aea3-4e75-ba7a-99c868b15a2d tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:37.604776 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dea36ac4-aea3-4e75-ba7a-99c868b15a2d tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:37.896611 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-dea36ac4-aea3-4e75-ba7a-99c868b15a2d tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb907e8146dc42fc9cc47ff41a424503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f5d40e4bab429cb080f76a3ed3ee9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:37.905146 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-dea36ac4-aea3-4e75-ba7a-99c868b15a2d tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] 10.222.0.23 "GET /compute/v2.1/servers/a734916f-d369-4438-97de-3d0ae408384e" status: 200 len: 1266 microversion: 2.1 time: 0.318613 Sep 10 11:39:37.912308 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 265/503] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:37 2022] GET /compute/v2.1/servers/a734916f-d369-4438-97de-3d0ae408384e => generated 1266 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:37.974156 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-af40e490-fa45-4473-956e-ad8a66fffab4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:37.975727 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-af40e490-fa45-4473-956e-ad8a66fffab4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: a21897bf-57b5-43df-b83e-0fe0461a589b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:37.983618 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af40e490-fa45-4473-956e-ad8a66fffab4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:37.989906 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af40e490-fa45-4473-956e-ad8a66fffab4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:37.993664 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af40e490-fa45-4473-956e-ad8a66fffab4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:37.994653 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af40e490-fa45-4473-956e-ad8a66fffab4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:37.997952 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af40e490-fa45-4473-956e-ad8a66fffab4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:37.998593 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af40e490-fa45-4473-956e-ad8a66fffab4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:38.657234 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-af40e490-fa45-4473-956e-ad8a66fffab4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:38.672387 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-af40e490-fa45-4473-956e-ad8a66fffab4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b" status: 200 len: 1310 microversion: 2.1 time: 0.700259 Sep 10 11:39:38.683203 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 266/504] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:37 2022] GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b => generated 1310 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:38.687700 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-266bee03-bcd0-41a1-9217-376833be49dc tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:38.692687 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-266bee03-bcd0-41a1-9217-376833be49dc tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:38.708835 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-266bee03-bcd0-41a1-9217-376833be49dc tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:38.709862 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-266bee03-bcd0-41a1-9217-376833be49dc tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:38.710590 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-266bee03-bcd0-41a1-9217-376833be49dc tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:38.711229 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-266bee03-bcd0-41a1-9217-376833be49dc tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:38.711688 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-266bee03-bcd0-41a1-9217-376833be49dc tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:38.712118 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-266bee03-bcd0-41a1-9217-376833be49dc tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:38.774286 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b7a524de-eb27-4525-9360-00830eecb279 tempest-SecurityGroupsTestAdminJSON-1451783304 tempest-SecurityGroupsTestAdminJSON-1451783304-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/1dc46000-fecd-46d0-81f5-96b8051fb8bb" status: 202 len: 0 microversion: 2.1 time: 1.820643 Sep 10 11:39:38.775865 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 239/505] 10.222.0.23 () {58 vars in 1272 bytes} [Sat Sep 10 11:39:36 2022] DELETE /compute/v2.1/os-security-groups/1dc46000-fecd-46d0-81f5-96b8051fb8bb => generated 0 bytes in 1823 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:39:39.064804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-266bee03-bcd0-41a1-9217-376833be49dc tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64e2df030a745de8ae7eda29d2ac30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c44e3e2920e48868e1c05f70b1d7639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:39.068656 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:39:39.088564 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-266bee03-bcd0-41a1-9217-376833be49dc tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "GET /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7" status: 200 len: 1388 microversion: 2.1 time: 0.411729 Sep 10 11:39:39.089939 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 267/506] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:38 2022] GET /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 => generated 1388 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:39.106247 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d1453722-f14c-4d3c-b4f3-b70b6f26b10c tempest-SecurityGroupsTestAdminJSON-1953955293 tempest-SecurityGroupsTestAdminJSON-1953955293-project] Calling method '.version_select at 0x7f4073f37dc0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:39.279929 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d9726116-5290-4c7b-aa6b-0298f17f9307 tempest-FloatingIPDetailsNegativeTestJSON-78438850 tempest-FloatingIPDetailsNegativeTestJSON-78438850-project] Calling method '.version_select at 0x7f4073839550>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:39.399561 n-d-856895-1 devstack@n-api.service[128777]: DEBUG neutronclient.v2_0.client [None req-d9726116-5290-4c7b-aa6b-0298f17f9307 tempest-FloatingIPDetailsNegativeTestJSON-78438850 tempest-FloatingIPDetailsNegativeTestJSON-78438850-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP d25bfedd-b01b-41d1-a79f-7df9a0565cf3 could not be found", "detail": ""}} {{(pid=128777) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 11:39:39.400484 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-d9726116-5290-4c7b-aa6b-0298f17f9307 tempest-FloatingIPDetailsNegativeTestJSON-78438850 tempest-FloatingIPDetailsNegativeTestJSON-78438850-project] HTTP exception thrown: Floating IP not found for ID d25bfedd-b01b-41d1-a79f-7df9a0565cf3 Sep 10 11:39:39.404311 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d9726116-5290-4c7b-aa6b-0298f17f9307 tempest-FloatingIPDetailsNegativeTestJSON-78438850 tempest-FloatingIPDetailsNegativeTestJSON-78438850-project] Request method failure captured: Sep 10 11:39:39.404311 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/os-floating-ips/d25bfedd-b01b-41d1-a79f-7df9a0565cf3 HTTP/1.1 Sep 10 11:39:39.404311 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:39:39.404311 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:39:39.404311 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:39:39.404311 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:39:39.404311 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:39:39.404311 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:39:39.404311 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:39:39.404311 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:39:39.404311 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHd6F1KvhvIEdaTZtsUONnWEPXDTnsn85L2BBeLPkZxjO57O4MmoAWKZxUHrtLZ3mQn8nh8MU9XqoXLNNDleL4mi4VZqLn-4-ZWKleXQ0AVpx-STD_s8SFJu_NFIAxUkEFH08qbwdVYb5-BfTsCG14IxDjg2_C_LY0j7JnTaCRcYO8w Sep 10 11:39:39.404311 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:39:39.404311 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:39:39.404311 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:39:39.404311 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:39:39.404311 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:39:39.404311 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:39:39.404311 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 9da6cebc4b1147d3a22f34a55c8cc48c Sep 10 11:39:39.404311 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-78438850 Sep 10 11:39:39.404311 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:39:39.404311 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:39:39.405905 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9da6cebc4b1147d3a22f34a55c8cc48c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9da6cebc4b1147d3a22f34a55c8cc48c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9da6cebc4b1147d3a22f34a55c8cc48c", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9da6cebc4b1147d3a22f34a55c8cc48c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:39:39.405905 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-78438850 Sep 10 11:39:39.405905 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 9da6cebc4b1147d3a22f34a55c8cc48c Sep 10 11:39:39.405905 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-78438850 Sep 10 11:39:39.405905 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-78438850-project Sep 10 11:39:39.405905 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:39:39.405905 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:39:39.405905 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: b94b8f9d510b48ee86e9152dbd31eaf9 Sep 10 11:39:39.405905 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-78438850-project Sep 10 11:39:39.405905 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:39:39.405905 n-d-856895-1 devstack@n-api.service[128777]: exception: Floating IP not found for ID d25bfedd-b01b-41d1-a79f-7df9a0565cf3 Sep 10 11:39:39.405905 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'd25bfedd-b01b-41d1-a79f-7df9a0565cf3'} Sep 10 11:39:39.406744 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:39:39.406744 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:39.406744 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 10 11:39:39.406744 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 10 11:39:39.406744 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:39:39.406744 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:39:39.406744 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 10 11:39:39.406744 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 10 11:39:39.406744 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:39:39.406744 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:39:39.406744 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 11:39:39.406744 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 11:39:39.406744 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:39:39.406744 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:39:39.406744 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 11:39:39.406744 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 11:39:39.406744 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:39:39.406744 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:39:39.406744 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 11:39:39.408761 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 11:39:39.408761 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:39:39.408761 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:39:39.408761 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 11:39:39.408761 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 11:39:39.408761 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 11:39:39.408761 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 11:39:39.408761 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP d25bfedd-b01b-41d1-a79f-7df9a0565cf3 could not be found Sep 10 11:39:39.408761 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2d6407d7-e45d-4ea3-be1e-754517e847e4'] Sep 10 11:39:39.408761 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:39.408761 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:39.408761 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:39.408761 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:39.408761 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 10 11:39:39.408761 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 10 11:39:39.408761 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 10 11:39:39.408761 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 10 11:39:39.408761 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID d25bfedd-b01b-41d1-a79f-7df9a0565cf3. Sep 10 11:39:39.408761 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:39.410207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:39.410207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:39.410207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:39.410207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:39.410207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:39.410207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:39:39.410207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:39:39.410207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:39:39.410207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:39:39.410207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:39:39.410207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:39:39.410207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 10 11:39:39.410207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 10 11:39:39.410207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID d25bfedd-b01b-41d1-a79f-7df9a0565cf3 Sep 10 11:39:39.410207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:39.410207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:39.410207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:39.410207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:39.410207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:39.410207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:39.410207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:39:39.411728 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:39:39.411728 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID d25bfedd-b01b-41d1-a79f-7df9a0565cf3 Sep 10 11:39:39.411728 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:39:39.413592 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d9726116-5290-4c7b-aa6b-0298f17f9307 tempest-FloatingIPDetailsNegativeTestJSON-78438850 tempest-FloatingIPDetailsNegativeTestJSON-78438850-project] Returning 404 to user: Floating IP not found for ID d25bfedd-b01b-41d1-a79f-7df9a0565cf3 {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:39:39.414967 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d9726116-5290-4c7b-aa6b-0298f17f9307 tempest-FloatingIPDetailsNegativeTestJSON-78438850 tempest-FloatingIPDetailsNegativeTestJSON-78438850-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/d25bfedd-b01b-41d1-a79f-7df9a0565cf3" status: 404 len: 111 microversion: 2.1 time: 0.637769 Sep 10 11:39:39.416098 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 240/507] 10.222.0.23 () {58 vars in 1260 bytes} [Sat Sep 10 11:39:38 2022] GET /compute/v2.1/os-floating-ips/d25bfedd-b01b-41d1-a79f-7df9a0565cf3 => generated 111 bytes in 639 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:39:39.437982 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-815e9040-f0ee-45a6-849e-b8d32179c4ee req-95070889-ba0d-4e0d-b914-dacc1acf48b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7", "name": "network-vif-plugged", "status": "completed", "tag": "5c65da57-0904-4a32-9c5a-d379b5f6e7cf"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:39.489499 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:39:39.491491 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-815e9040-f0ee-45a6-849e-b8d32179c4ee req-95070889-ba0d-4e0d-b914-dacc1acf48b6 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:39.492101 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-815e9040-f0ee-45a6-849e-b8d32179c4ee req-95070889-ba0d-4e0d-b914-dacc1acf48b6 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:39.492532 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-815e9040-f0ee-45a6-849e-b8d32179c4ee req-95070889-ba0d-4e0d-b914-dacc1acf48b6 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:39.542120 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-815e9040-f0ee-45a6-849e-b8d32179c4ee req-95070889-ba0d-4e0d-b914-dacc1acf48b6 service nova] Creating event network-vif-plugged:5c65da57-0904-4a32-9c5a-d379b5f6e7cf for instance 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 on n-h1-856895-1 Sep 10 11:39:39.567435 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-815e9040-f0ee-45a6-849e-b8d32179c4ee req-95070889-ba0d-4e0d-b914-dacc1acf48b6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149770 Sep 10 11:39:39.569284 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 241/508] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:39:39.585684 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9024f12a-e136-4440-b077-3f4f52882ab2 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:39.586486 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9024f12a-e136-4440-b077-3f4f52882ab2 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] [instance: a734916f-d369-4438-97de-3d0ae408384e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:39.609718 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d1453722-f14c-4d3c-b4f3-b70b6f26b10c tempest-SecurityGroupsTestAdminJSON-1953955293 tempest-SecurityGroupsTestAdminJSON-1953955293-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/bd9e9143-af07-4ab5-9d94-484ddbe08a44" status: 202 len: 0 microversion: 2.1 time: 0.517888 Sep 10 11:39:39.614347 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 268/509] 10.222.0.23 () {58 vars in 1272 bytes} [Sat Sep 10 11:39:39 2022] DELETE /compute/v2.1/os-security-groups/bd9e9143-af07-4ab5-9d94-484ddbe08a44 => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:39:39.621602 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b5684d2a-54c6-47f0-97e6-7f923b487bae tempest-SecurityGroupsTestAdminJSON-1953955293 tempest-SecurityGroupsTestAdminJSON-1953955293-project] Calling method '.version_select at 0x7f4073a49b80>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:39.633455 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9024f12a-e136-4440-b077-3f4f52882ab2 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:39.634054 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9024f12a-e136-4440-b077-3f4f52882ab2 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:39.639624 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9024f12a-e136-4440-b077-3f4f52882ab2 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:39.643769 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9024f12a-e136-4440-b077-3f4f52882ab2 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:39.644270 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9024f12a-e136-4440-b077-3f4f52882ab2 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:39.644718 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9024f12a-e136-4440-b077-3f4f52882ab2 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:39.881651 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9024f12a-e136-4440-b077-3f4f52882ab2 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb907e8146dc42fc9cc47ff41a424503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f5d40e4bab429cb080f76a3ed3ee9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:39.893896 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9024f12a-e136-4440-b077-3f4f52882ab2 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] 10.222.0.23 "GET /compute/v2.1/servers/a734916f-d369-4438-97de-3d0ae408384e" status: 200 len: 1272 microversion: 2.1 time: 0.321115 Sep 10 11:39:39.894539 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 242/510] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:39 2022] GET /compute/v2.1/servers/a734916f-d369-4438-97de-3d0ae408384e => generated 1272 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:39.917400 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a465d6a8-c147-4f25-8a7d-c7736f4d73c0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:39.918034 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a465d6a8-c147-4f25-8a7d-c7736f4d73c0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: a21897bf-57b5-43df-b83e-0fe0461a589b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:39.925311 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a465d6a8-c147-4f25-8a7d-c7736f4d73c0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:39.925812 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a465d6a8-c147-4f25-8a7d-c7736f4d73c0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:39.926258 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a465d6a8-c147-4f25-8a7d-c7736f4d73c0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:39.927036 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a465d6a8-c147-4f25-8a7d-c7736f4d73c0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:39.927545 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a465d6a8-c147-4f25-8a7d-c7736f4d73c0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:39.927983 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a465d6a8-c147-4f25-8a7d-c7736f4d73c0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:40.737925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a465d6a8-c147-4f25-8a7d-c7736f4d73c0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:40.750429 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a465d6a8-c147-4f25-8a7d-c7736f4d73c0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b" status: 200 len: 1310 microversion: 2.1 time: 0.838132 Sep 10 11:39:40.776788 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 243/511] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:39 2022] GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b => generated 1310 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:40.790427 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f51eb950-3627-471b-8eed-98f3dbf120d8 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:40.795153 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f51eb950-3627-471b-8eed-98f3dbf120d8 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:40.806646 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f51eb950-3627-471b-8eed-98f3dbf120d8 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:40.809670 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f51eb950-3627-471b-8eed-98f3dbf120d8 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:40.811732 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f51eb950-3627-471b-8eed-98f3dbf120d8 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:40.812788 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f51eb950-3627-471b-8eed-98f3dbf120d8 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:40.815041 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f51eb950-3627-471b-8eed-98f3dbf120d8 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:40.815913 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f51eb950-3627-471b-8eed-98f3dbf120d8 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:41.554557 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b5684d2a-54c6-47f0-97e6-7f923b487bae tempest-SecurityGroupsTestAdminJSON-1953955293 tempest-SecurityGroupsTestAdminJSON-1953955293-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/e104ecf3-d508-4fee-aa53-ece887911638" status: 202 len: 0 microversion: 2.1 time: 1.937698 Sep 10 11:39:41.561760 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 269/512] 10.222.0.23 () {58 vars in 1272 bytes} [Sat Sep 10 11:39:39 2022] DELETE /compute/v2.1/os-security-groups/e104ecf3-d508-4fee-aa53-ece887911638 => generated 0 bytes in 1946 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:39:41.569618 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-237d6f13-610b-4893-a02a-d486732f438d tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:41.570529 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-237d6f13-610b-4893-a02a-d486732f438d tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] [instance: a734916f-d369-4438-97de-3d0ae408384e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:41.587629 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-237d6f13-610b-4893-a02a-d486732f438d tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:41.589609 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-237d6f13-610b-4893-a02a-d486732f438d tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:41.591698 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-237d6f13-610b-4893-a02a-d486732f438d tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:41.594430 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-237d6f13-610b-4893-a02a-d486732f438d tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:41.595551 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-237d6f13-610b-4893-a02a-d486732f438d tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:41.596779 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-237d6f13-610b-4893-a02a-d486732f438d tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:41.780579 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-237d6f13-610b-4893-a02a-d486732f438d tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb907e8146dc42fc9cc47ff41a424503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f5d40e4bab429cb080f76a3ed3ee9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:41.808676 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-237d6f13-610b-4893-a02a-d486732f438d tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] 10.222.0.23 "GET /compute/v2.1/servers/a734916f-d369-4438-97de-3d0ae408384e" status: 200 len: 1272 microversion: 2.1 time: 0.242381 Sep 10 11:39:41.810411 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 270/513] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:41 2022] GET /compute/v2.1/servers/a734916f-d369-4438-97de-3d0ae408384e => generated 1272 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:41.828456 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-0616d348-6ad8-49d7-bf23-31112be3825c req-4ad83a05-98f8-468c-8267-0eba3b13d870 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a21897bf-57b5-43df-b83e-0fe0461a589b", "tag": "67cd0369-12ef-4363-bcb5-c9103b512fc1"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:41.866339 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-0616d348-6ad8-49d7-bf23-31112be3825c req-4ad83a05-98f8-468c-8267-0eba3b13d870 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:41.869865 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-0616d348-6ad8-49d7-bf23-31112be3825c req-4ad83a05-98f8-468c-8267-0eba3b13d870 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:41.870543 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-0616d348-6ad8-49d7-bf23-31112be3825c req-4ad83a05-98f8-468c-8267-0eba3b13d870 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:41.922583 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-0616d348-6ad8-49d7-bf23-31112be3825c req-4ad83a05-98f8-468c-8267-0eba3b13d870 service nova] Creating event network-changed:67cd0369-12ef-4363-bcb5-c9103b512fc1 for instance a21897bf-57b5-43df-b83e-0fe0461a589b on n-h2-856895-1 Sep 10 11:39:41.928087 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f51eb950-3627-471b-8eed-98f3dbf120d8 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64e2df030a745de8ae7eda29d2ac30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c44e3e2920e48868e1c05f70b1d7639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:41.930703 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-0616d348-6ad8-49d7-bf23-31112be3825c req-4ad83a05-98f8-468c-8267-0eba3b13d870 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117076 Sep 10 11:39:41.934254 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 271/514] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:39:41.967672 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f51eb950-3627-471b-8eed-98f3dbf120d8 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "GET /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7" status: 200 len: 1388 microversion: 2.1 time: 1.179976 Sep 10 11:39:41.968866 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 244/515] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:40 2022] GET /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 => generated 1388 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:42.001262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-89548e0a-6285-4f45-862c-663a2e58d818 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:42.007636 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-89548e0a-6285-4f45-862c-663a2e58d818 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: a21897bf-57b5-43df-b83e-0fe0461a589b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:42.029355 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-89548e0a-6285-4f45-862c-663a2e58d818 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:42.033597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-89548e0a-6285-4f45-862c-663a2e58d818 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:42.034950 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-89548e0a-6285-4f45-862c-663a2e58d818 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:42.036028 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-89548e0a-6285-4f45-862c-663a2e58d818 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:42.039722 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-89548e0a-6285-4f45-862c-663a2e58d818 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:42.040372 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-89548e0a-6285-4f45-862c-663a2e58d818 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:42.335614 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-67f992ca-3455-4233-9597-3328103df1fb tempest-HypervisorAdminV228Test-443168807 tempest-HypervisorAdminV228Test-443168807-project-admin] Calling method '.version_select at 0x7f4073bac8b0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:42.337464 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67f992ca-3455-4233-9597-3328103df1fb tempest-HypervisorAdminV228Test-443168807 tempest-HypervisorAdminV228Test-443168807-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:42.338114 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67f992ca-3455-4233-9597-3328103df1fb tempest-HypervisorAdminV228Test-443168807 tempest-HypervisorAdminV228Test-443168807-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:42.338559 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67f992ca-3455-4233-9597-3328103df1fb tempest-HypervisorAdminV228Test-443168807 tempest-HypervisorAdminV228Test-443168807-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:42.400515 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67f992ca-3455-4233-9597-3328103df1fb tempest-HypervisorAdminV228Test-443168807 tempest-HypervisorAdminV228Test-443168807-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:42.401694 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67f992ca-3455-4233-9597-3328103df1fb tempest-HypervisorAdminV228Test-443168807 tempest-HypervisorAdminV228Test-443168807-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:42.403447 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67f992ca-3455-4233-9597-3328103df1fb tempest-HypervisorAdminV228Test-443168807 tempest-HypervisorAdminV228Test-443168807-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:42.445164 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67f992ca-3455-4233-9597-3328103df1fb tempest-HypervisorAdminV228Test-443168807 tempest-HypervisorAdminV228Test-443168807-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:42.446548 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67f992ca-3455-4233-9597-3328103df1fb tempest-HypervisorAdminV228Test-443168807 tempest-HypervisorAdminV228Test-443168807-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:42.447591 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67f992ca-3455-4233-9597-3328103df1fb tempest-HypervisorAdminV228Test-443168807 tempest-HypervisorAdminV228Test-443168807-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:42.460124 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-67f992ca-3455-4233-9597-3328103df1fb tempest-HypervisorAdminV228Test-443168807 tempest-HypervisorAdminV228Test-443168807-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.522289 Sep 10 11:39:42.467276 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 272/516] 10.222.0.23 () {60 vars in 1187 bytes} [Sat Sep 10 11:39:41 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:39:42.473738 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cafd3f84-0e81-42d2-bbdc-46e966b7ae2f tempest-HypervisorAdminV228Test-443168807 tempest-HypervisorAdminV228Test-443168807-project-admin] Calling method '.version_select at 0x7f4073ac0ca0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:42.475885 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cafd3f84-0e81-42d2-bbdc-46e966b7ae2f tempest-HypervisorAdminV228Test-443168807 tempest-HypervisorAdminV228Test-443168807-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:42.477427 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cafd3f84-0e81-42d2-bbdc-46e966b7ae2f tempest-HypervisorAdminV228Test-443168807 tempest-HypervisorAdminV228Test-443168807-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:42.478090 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cafd3f84-0e81-42d2-bbdc-46e966b7ae2f tempest-HypervisorAdminV228Test-443168807 tempest-HypervisorAdminV228Test-443168807-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:42.493766 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cafd3f84-0e81-42d2-bbdc-46e966b7ae2f tempest-HypervisorAdminV228Test-443168807 tempest-HypervisorAdminV228Test-443168807-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:42.494518 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cafd3f84-0e81-42d2-bbdc-46e966b7ae2f tempest-HypervisorAdminV228Test-443168807 tempest-HypervisorAdminV228Test-443168807-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:42.495230 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cafd3f84-0e81-42d2-bbdc-46e966b7ae2f tempest-HypervisorAdminV228Test-443168807 tempest-HypervisorAdminV228Test-443168807-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:42.503611 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cafd3f84-0e81-42d2-bbdc-46e966b7ae2f tempest-HypervisorAdminV228Test-443168807 tempest-HypervisorAdminV228Test-443168807-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.035018 Sep 10 11:39:42.515555 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 273/517] 10.222.0.23 () {60 vars in 1193 bytes} [Sat Sep 10 11:39:42 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:39:42.838906 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c5650480-35f2-4065-a765-df266ac461ef tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:42.840728 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c5650480-35f2-4065-a765-df266ac461ef tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] [instance: a734916f-d369-4438-97de-3d0ae408384e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:42.868384 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c5650480-35f2-4065-a765-df266ac461ef tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:42.870724 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c5650480-35f2-4065-a765-df266ac461ef tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:42.871384 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c5650480-35f2-4065-a765-df266ac461ef tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:42.872716 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c5650480-35f2-4065-a765-df266ac461ef tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:42.878479 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c5650480-35f2-4065-a765-df266ac461ef tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:42.880994 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c5650480-35f2-4065-a765-df266ac461ef tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:43.192353 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-89548e0a-6285-4f45-862c-663a2e58d818 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:43.217707 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-89548e0a-6285-4f45-862c-663a2e58d818 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b" status: 200 len: 1310 microversion: 2.1 time: 1.246098 Sep 10 11:39:43.219638 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 245/518] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:41 2022] GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b => generated 1310 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:43.236659 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-03574a99-cd37-4c85-a43b-dbab8f54e1c9 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:43.245318 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-03574a99-cd37-4c85-a43b-dbab8f54e1c9 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:43.272851 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03574a99-cd37-4c85-a43b-dbab8f54e1c9 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:43.273555 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03574a99-cd37-4c85-a43b-dbab8f54e1c9 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:43.274197 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03574a99-cd37-4c85-a43b-dbab8f54e1c9 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:43.275583 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03574a99-cd37-4c85-a43b-dbab8f54e1c9 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:43.277807 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03574a99-cd37-4c85-a43b-dbab8f54e1c9 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:43.279867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03574a99-cd37-4c85-a43b-dbab8f54e1c9 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:43.974860 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c5650480-35f2-4065-a765-df266ac461ef tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb907e8146dc42fc9cc47ff41a424503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f5d40e4bab429cb080f76a3ed3ee9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:44.031310 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c5650480-35f2-4065-a765-df266ac461ef tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] 10.222.0.23 "GET /compute/v2.1/servers/a734916f-d369-4438-97de-3d0ae408384e" status: 200 len: 1314 microversion: 2.1 time: 1.196085 Sep 10 11:39:44.046100 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 274/519] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:42 2022] GET /compute/v2.1/servers/a734916f-d369-4438-97de-3d0ae408384e => generated 1314 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:39:44.244778 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-144628a6-cde9-4403-8a65-7b1ca12a1cbd tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:44.247041 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-144628a6-cde9-4403-8a65-7b1ca12a1cbd tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: a21897bf-57b5-43df-b83e-0fe0461a589b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:44.274962 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-144628a6-cde9-4403-8a65-7b1ca12a1cbd tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:44.276570 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-144628a6-cde9-4403-8a65-7b1ca12a1cbd tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:44.278616 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-144628a6-cde9-4403-8a65-7b1ca12a1cbd tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:44.282461 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-144628a6-cde9-4403-8a65-7b1ca12a1cbd tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:44.283455 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-144628a6-cde9-4403-8a65-7b1ca12a1cbd tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:44.285299 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-144628a6-cde9-4403-8a65-7b1ca12a1cbd tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:44.440779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-03574a99-cd37-4c85-a43b-dbab8f54e1c9 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64e2df030a745de8ae7eda29d2ac30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c44e3e2920e48868e1c05f70b1d7639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:44.472377 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-03574a99-cd37-4c85-a43b-dbab8f54e1c9 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "GET /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7" status: 200 len: 1586 microversion: 2.1 time: 1.244411 Sep 10 11:39:44.475262 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 246/520] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:43 2022] GET /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 => generated 1586 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:44.510638 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2f3d8dfa-ba9f-46ed-b8a8-75129f8f80c1 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:44.518387 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2f3d8dfa-ba9f-46ed-b8a8-75129f8f80c1 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:44.535801 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f3d8dfa-ba9f-46ed-b8a8-75129f8f80c1 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:44.537079 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f3d8dfa-ba9f-46ed-b8a8-75129f8f80c1 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:44.537534 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f3d8dfa-ba9f-46ed-b8a8-75129f8f80c1 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:44.538262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f3d8dfa-ba9f-46ed-b8a8-75129f8f80c1 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:44.538732 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f3d8dfa-ba9f-46ed-b8a8-75129f8f80c1 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:44.539186 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f3d8dfa-ba9f-46ed-b8a8-75129f8f80c1 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:44.871192 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-144628a6-cde9-4403-8a65-7b1ca12a1cbd tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:44.879713 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-144628a6-cde9-4403-8a65-7b1ca12a1cbd tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b" status: 200 len: 1310 microversion: 2.1 time: 0.639345 Sep 10 11:39:44.880294 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 275/521] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:44 2022] GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b => generated 1310 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:44.902284 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2f3d8dfa-ba9f-46ed-b8a8-75129f8f80c1 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "GET /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.404876 Sep 10 11:39:44.902943 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 247/522] 10.222.0.23 () {58 vars in 1275 bytes} [Sat Sep 10 11:39:44 2022] GET /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7/os-interface => generated 284 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:39:45.055803 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c416f8ff-d4a6-42c3-bc9c-f2c6f2a08c5f tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:45.056389 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c416f8ff-d4a6-42c3-bc9c-f2c6f2a08c5f tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] [instance: a734916f-d369-4438-97de-3d0ae408384e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:45.075038 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c416f8ff-d4a6-42c3-bc9c-f2c6f2a08c5f tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:45.075631 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c416f8ff-d4a6-42c3-bc9c-f2c6f2a08c5f tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:45.076078 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c416f8ff-d4a6-42c3-bc9c-f2c6f2a08c5f tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:45.076854 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c416f8ff-d4a6-42c3-bc9c-f2c6f2a08c5f tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:45.077327 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c416f8ff-d4a6-42c3-bc9c-f2c6f2a08c5f tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:45.077761 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c416f8ff-d4a6-42c3-bc9c-f2c6f2a08c5f tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:45.527491 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:39:45.572664 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=18 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:39:46.152120 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ceb8e993-508a-4cf4-a738-92d91295863f tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] Calling method '.version_select at 0x7f40736813a0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:46.156645 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ceb8e993-508a-4cf4-a738-92d91295863f tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:46.158016 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ceb8e993-508a-4cf4-a738-92d91295863f tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:46.160990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ceb8e993-508a-4cf4-a738-92d91295863f tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:46.161868 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ceb8e993-508a-4cf4-a738-92d91295863f tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:46.164061 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ceb8e993-508a-4cf4-a738-92d91295863f tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:46.165598 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ceb8e993-508a-4cf4-a738-92d91295863f tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:46.198326 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ceb8e993-508a-4cf4-a738-92d91295863f tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.512918 Sep 10 11:39:46.199480 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 248/523] 10.222.0.23 () {58 vars in 1128 bytes} [Sat Sep 10 11:39:45 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:39:46.205686 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c4ef1edc-c253-4122-8c2c-fa5b8fc8030d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:46.207325 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c4ef1edc-c253-4122-8c2c-fa5b8fc8030d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: a21897bf-57b5-43df-b83e-0fe0461a589b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:46.214113 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c4ef1edc-c253-4122-8c2c-fa5b8fc8030d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:46.214875 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c4ef1edc-c253-4122-8c2c-fa5b8fc8030d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:46.215565 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c4ef1edc-c253-4122-8c2c-fa5b8fc8030d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:46.216853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c4ef1edc-c253-4122-8c2c-fa5b8fc8030d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:46.217728 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c4ef1edc-c253-4122-8c2c-fa5b8fc8030d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:46.218442 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c4ef1edc-c253-4122-8c2c-fa5b8fc8030d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:46.353064 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c416f8ff-d4a6-42c3-bc9c-f2c6f2a08c5f tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb907e8146dc42fc9cc47ff41a424503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f5d40e4bab429cb080f76a3ed3ee9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:46.363897 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c416f8ff-d4a6-42c3-bc9c-f2c6f2a08c5f tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] 10.222.0.23 "GET /compute/v2.1/servers/a734916f-d369-4438-97de-3d0ae408384e" status: 200 len: 1314 microversion: 2.1 time: 1.311931 Sep 10 11:39:46.367575 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 276/524] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:45 2022] GET /compute/v2.1/servers/a734916f-d369-4438-97de-3d0ae408384e => generated 1314 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:46.559991 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=4 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:39:46.653778 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-47831e75-9b65-4630-bd1b-2b157f6fc521 tempest-HostsAdminNegativeTestJSON-81849952 tempest-HostsAdminNegativeTestJSON-81849952-project] Calling method '.version_select at 0x7f4073a49700>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:46.658034 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-47831e75-9b65-4630-bd1b-2b157f6fc521 tempest-HostsAdminNegativeTestJSON-81849952 tempest-HostsAdminNegativeTestJSON-81849952-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '5762a9d1755f4e5883a8420220afea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389b9e6d2326448cb389d60598bd7ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:46.661826 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-47831e75-9b65-4630-bd1b-2b157f6fc521 tempest-HostsAdminNegativeTestJSON-81849952 tempest-HostsAdminNegativeTestJSON-81849952-project] Request method failure captured: Sep 10 11:39:46.661826 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Sep 10 11:39:46.661826 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:39:46.661826 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:39:46.661826 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:39:46.661826 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:39:46.661826 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:39:46.661826 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:39:46.661826 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:39:46.661826 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:39:46.661826 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHd_p9KoMmChbx1W2qo0T5U9BdeSlw1DHbPfmxWeotzsTxZvbsITy221K4NmAGFS7GXo9Bgjmf2uPXx6R7P6ZDIehNPyqvjwc1vXQueDFkveprwS1RBeCh0_h_TLDrpxr5xWTpU0g-4QznIdvRF2rRUgEfIoWUSzE_Ncr26byyRZSqw Sep 10 11:39:46.661826 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:39:46.661826 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:39:46.661826 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:39:46.661826 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:39:46.661826 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:39:46.661826 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:39:46.661826 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 389b9e6d2326448cb389d60598bd7ef3 Sep 10 11:39:46.661826 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-81849952 Sep 10 11:39:46.661826 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:39:46.661826 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:39:46.663464 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/389b9e6d2326448cb389d60598bd7ef3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/389b9e6d2326448cb389d60598bd7ef3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_389b9e6d2326448cb389d60598bd7ef3", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/389b9e6d2326448cb389d60598bd7ef3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:39:46.663464 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-HostsAdminNegativeTestJSON-81849952 Sep 10 11:39:46.663464 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 389b9e6d2326448cb389d60598bd7ef3 Sep 10 11:39:46.663464 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-81849952 Sep 10 11:39:46.663464 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-HostsAdminNegativeTestJSON-81849952-project Sep 10 11:39:46.663464 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:39:46.663464 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:39:46.663464 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 5762a9d1755f4e5883a8420220afea19 Sep 10 11:39:46.663464 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-HostsAdminNegativeTestJSON-81849952-project Sep 10 11:39:46.663464 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:39:46.663464 n-d-856895-1 devstack@n-api.service[128776]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 10 11:39:46.663464 n-d-856895-1 devstack@n-api.service[128776]: action_args: {} Sep 10 11:39:46.663464 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:39:46.664325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:46.664325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:46.664325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:46.664325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:39:46.664325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:39:46.664325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:39:46.664325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:39:46.664325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 11:39:46.664325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:39:46.664325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:39:46.664325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:39:46.664325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Sep 10 11:39:46.664325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Sep 10 11:39:46.664325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 11:39:46.664325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 11:39:46.664325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 11:39:46.664325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 11:39:46.664325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:39:46.664325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:39:46.665529 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:39:46.665529 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:39:46.665529 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 11:39:46.665529 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 11:39:46.665529 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 11:39:46.665529 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 11:39:46.665529 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 11:39:46.665529 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 11:39:46.665529 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 10 11:39:46.665529 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.665529 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:46.665529 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.665529 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:46.665529 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:46.665529 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:46.665529 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 11:39:46.665529 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 11:39:46.665529 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 10 11:39:46.665529 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.669754 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-47831e75-9b65-4630-bd1b-2b157f6fc521 tempest-HostsAdminNegativeTestJSON-81849952 tempest-HostsAdminNegativeTestJSON-81849952-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:39:46.671332 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-47831e75-9b65-4630-bd1b-2b157f6fc521 tempest-HostsAdminNegativeTestJSON-81849952 tempest-HostsAdminNegativeTestJSON-81849952-project] 10.222.0.23 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.301636 Sep 10 11:39:46.672105 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 277/525] 10.222.0.23 () {58 vars in 1128 bytes} [Sat Sep 10 11:39:46 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 303 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:39:46.683766 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-29184d94-6b7c-45ce-a321-75c02d0bd118 tempest-HostsAdminNegativeTestJSON-81849952 tempest-HostsAdminNegativeTestJSON-81849952-project] Calling method '.version_select at 0x7f4073a7bee0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:46.686208 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-29184d94-6b7c-45ce-a321-75c02d0bd118 tempest-HostsAdminNegativeTestJSON-81849952 tempest-HostsAdminNegativeTestJSON-81849952-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '5762a9d1755f4e5883a8420220afea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389b9e6d2326448cb389d60598bd7ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:46.689734 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-29184d94-6b7c-45ce-a321-75c02d0bd118 tempest-HostsAdminNegativeTestJSON-81849952 tempest-HostsAdminNegativeTestJSON-81849952-project] Request method failure captured: Sep 10 11:39:46.689734 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/os-hosts/n-d-856895-1/reboot HTTP/1.1 Sep 10 11:39:46.689734 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:39:46.689734 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:39:46.689734 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:39:46.689734 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:39:46.689734 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:39:46.689734 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:39:46.689734 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:39:46.689734 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:39:46.689734 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHd_p9KoMmChbx1W2qo0T5U9BdeSlw1DHbPfmxWeotzsTxZvbsITy221K4NmAGFS7GXo9Bgjmf2uPXx6R7P6ZDIehNPyqvjwc1vXQueDFkveprwS1RBeCh0_h_TLDrpxr5xWTpU0g-4QznIdvRF2rRUgEfIoWUSzE_Ncr26byyRZSqw Sep 10 11:39:46.689734 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:39:46.689734 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:39:46.689734 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:39:46.689734 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:39:46.689734 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:39:46.689734 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:39:46.689734 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 389b9e6d2326448cb389d60598bd7ef3 Sep 10 11:39:46.689734 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-81849952 Sep 10 11:39:46.689734 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:39:46.689734 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:39:46.691871 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/389b9e6d2326448cb389d60598bd7ef3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/389b9e6d2326448cb389d60598bd7ef3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_389b9e6d2326448cb389d60598bd7ef3", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/389b9e6d2326448cb389d60598bd7ef3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:39:46.691871 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-HostsAdminNegativeTestJSON-81849952 Sep 10 11:39:46.691871 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 389b9e6d2326448cb389d60598bd7ef3 Sep 10 11:39:46.691871 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-81849952 Sep 10 11:39:46.691871 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-HostsAdminNegativeTestJSON-81849952-project Sep 10 11:39:46.691871 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:39:46.691871 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:39:46.691871 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 5762a9d1755f4e5883a8420220afea19 Sep 10 11:39:46.691871 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-HostsAdminNegativeTestJSON-81849952-project Sep 10 11:39:46.691871 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:39:46.691871 n-d-856895-1 devstack@n-api.service[128776]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 10 11:39:46.691871 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'n-d-856895-1'} Sep 10 11:39:46.691871 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:39:46.693002 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:46.693002 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:46.693002 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:46.693002 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:39:46.693002 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:39:46.693002 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:39:46.693002 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:39:46.693002 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:39:46.693002 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:39:46.693002 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Sep 10 11:39:46.693002 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Sep 10 11:39:46.693002 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 11:39:46.693002 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 11:39:46.693002 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 11:39:46.693002 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 11:39:46.693002 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:39:46.693002 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:39:46.693002 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:39:46.693002 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:39:46.694385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 11:39:46.694385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 11:39:46.694385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 11:39:46.694385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 11:39:46.694385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 11:39:46.694385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 11:39:46.694385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 10 11:39:46.694385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.694385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:46.694385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.694385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:46.694385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:46.694385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:46.694385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 11:39:46.694385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 11:39:46.694385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 10 11:39:46.694385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.697274 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-29184d94-6b7c-45ce-a321-75c02d0bd118 tempest-HostsAdminNegativeTestJSON-81849952 tempest-HostsAdminNegativeTestJSON-81849952-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:39:46.698622 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-29184d94-6b7c-45ce-a321-75c02d0bd118 tempest-HostsAdminNegativeTestJSON-81849952 tempest-HostsAdminNegativeTestJSON-81849952-project] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-d-856895-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.018884 Sep 10 11:39:46.700512 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 278/526] 10.222.0.23 () {58 vars in 1188 bytes} [Sat Sep 10 11:39:46 2022] GET /compute/v2.1/os-hosts/n-d-856895-1/reboot => generated 111 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:39:46.713185 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fb964841-5f07-4167-be2f-4f8c7d92d92a tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] Calling method '.version_select at 0x7f4073ffc550>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:46.734419 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-fb964841-5f07-4167-be2f-4f8c7d92d92a tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 11:39:46.737189 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fb964841-5f07-4167-be2f-4f8c7d92d92a tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] Request method failure captured: Sep 10 11:39:46.737189 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Sep 10 11:39:46.737189 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:39:46.737189 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:39:46.737189 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:39:46.737189 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:39:46.737189 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:39:46.737189 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:39:46.737189 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:39:46.737189 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:39:46.737189 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHeBb7e9KO_ch68xDJPfuoFan6nE6GcBO8u0Q0Qb4WO9SYKV9qKQc18NsDeY4g3qXDNVf9hvIMCVJOfAy_4Ckm_Rgt6gygOp7ywK4ZhfQXrjJQh9tjtoO8l8UoKBtmN6-jX2kCBxa2m9xKcFH5mDKs-2JGF7C7KpH9Y7S3IHFRDW0p4 Sep 10 11:39:46.737189 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:39:46.737189 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:39:46.737189 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:39:46.737189 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:39:46.737189 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:39:46.737189 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:39:46.737189 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: b7c35d2323c34da4a8515a6835b11c47 Sep 10 11:39:46.737189 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1977209348 Sep 10 11:39:46.737189 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,admin,member Sep 10 11:39:46.737189 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,admin,member Sep 10 11:39:46.738782 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b7c35d2323c34da4a8515a6835b11c47"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b7c35d2323c34da4a8515a6835b11c47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b7c35d2323c34da4a8515a6835b11c47", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b7c35d2323c34da4a8515a6835b11c47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:39:46.738782 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1977209348 Sep 10 11:39:46.738782 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: b7c35d2323c34da4a8515a6835b11c47 Sep 10 11:39:46.738782 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1977209348 Sep 10 11:39:46.738782 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-HostsAdminNegativeTestJSON-1977209348-project-admin Sep 10 11:39:46.738782 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:39:46.738782 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:39:46.738782 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 54365c8653fd406082e640475510dfcb Sep 10 11:39:46.738782 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1977209348-project-admin Sep 10 11:39:46.738782 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:39:46.738782 n-d-856895-1 devstack@n-api.service[128776]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 11:39:46.738782 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'nonexistent_hostname'} Sep 10 11:39:46.738782 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:39:46.739963 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:46.739963 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 10 11:39:46.739963 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 10 11:39:46.739963 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 11:39:46.739963 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 11:39:46.739963 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:39:46.739963 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:39:46.739963 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:39:46.739963 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:39:46.739963 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 11:39:46.739963 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 11:39:46.739963 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 10 11:39:46.739963 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 10 11:39:46.739963 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 11:39:46.739963 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 11:39:46.739963 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 10 11:39:46.739963 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 10 11:39:46.739963 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 11:39:46.739963 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 11:39:46.741351 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 10 11:39:46.741351 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 10 11:39:46.741351 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 11:39:46.741351 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.741351 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:46.741351 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.741351 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:46.741351 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:46.741351 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:46.741351 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:39:46.741351 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:39:46.741351 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:39:46.741351 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:39:46.741351 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:39:46.741351 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:39:46.741351 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Sep 10 11:39:46.741351 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Sep 10 11:39:46.741351 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 10 11:39:46.741351 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:39:46.743060 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 11:39:46.743060 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.743060 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:46.743060 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.743060 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:46.743060 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:46.743060 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:46.743060 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:39:46.743060 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:39:46.743060 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 11:39:46.743060 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.747796 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fb964841-5f07-4167-be2f-4f8c7d92d92a tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:39:46.753280 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fb964841-5f07-4167-be2f-4f8c7d92d92a tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.046805 Sep 10 11:39:46.754597 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 279/527] 10.222.0.23 () {58 vars in 1212 bytes} [Sat Sep 10 11:39:46 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:39:46.765158 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a9ab9ef7-987c-4c2a-97a6-b4f9e5425b50 tempest-HostsAdminNegativeTestJSON-81849952 tempest-HostsAdminNegativeTestJSON-81849952-project] Calling method '.version_select at 0x7f4073cdaee0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:46.767369 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a9ab9ef7-987c-4c2a-97a6-b4f9e5425b50 tempest-HostsAdminNegativeTestJSON-81849952 tempest-HostsAdminNegativeTestJSON-81849952-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '5762a9d1755f4e5883a8420220afea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389b9e6d2326448cb389d60598bd7ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:46.769165 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a9ab9ef7-987c-4c2a-97a6-b4f9e5425b50 tempest-HostsAdminNegativeTestJSON-81849952 tempest-HostsAdminNegativeTestJSON-81849952-project] Request method failure captured: Sep 10 11:39:46.769165 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/os-hosts/n-d-856895-1 HTTP/1.1 Sep 10 11:39:46.769165 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:39:46.769165 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:39:46.769165 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:39:46.769165 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:39:46.769165 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:39:46.769165 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:39:46.769165 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:39:46.769165 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:39:46.769165 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHd_p9KoMmChbx1W2qo0T5U9BdeSlw1DHbPfmxWeotzsTxZvbsITy221K4NmAGFS7GXo9Bgjmf2uPXx6R7P6ZDIehNPyqvjwc1vXQueDFkveprwS1RBeCh0_h_TLDrpxr5xWTpU0g-4QznIdvRF2rRUgEfIoWUSzE_Ncr26byyRZSqw Sep 10 11:39:46.769165 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:39:46.769165 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:39:46.769165 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:39:46.769165 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:39:46.769165 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:39:46.769165 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:39:46.769165 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 389b9e6d2326448cb389d60598bd7ef3 Sep 10 11:39:46.769165 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-81849952 Sep 10 11:39:46.769165 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:39:46.769165 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:39:46.770543 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/389b9e6d2326448cb389d60598bd7ef3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/389b9e6d2326448cb389d60598bd7ef3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_389b9e6d2326448cb389d60598bd7ef3", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/389b9e6d2326448cb389d60598bd7ef3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:39:46.770543 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-HostsAdminNegativeTestJSON-81849952 Sep 10 11:39:46.770543 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 389b9e6d2326448cb389d60598bd7ef3 Sep 10 11:39:46.770543 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-81849952 Sep 10 11:39:46.770543 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-HostsAdminNegativeTestJSON-81849952-project Sep 10 11:39:46.770543 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:39:46.770543 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:39:46.770543 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 5762a9d1755f4e5883a8420220afea19 Sep 10 11:39:46.770543 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-HostsAdminNegativeTestJSON-81849952-project Sep 10 11:39:46.770543 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:39:46.770543 n-d-856895-1 devstack@n-api.service[128776]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 10 11:39:46.770543 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'n-d-856895-1'} Sep 10 11:39:46.770543 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:39:46.771351 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:46.771351 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:46.771351 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:46.771351 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:39:46.771351 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:39:46.771351 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:39:46.771351 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:39:46.771351 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:39:46.771351 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:39:46.771351 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Sep 10 11:39:46.771351 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Sep 10 11:39:46.771351 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 11:39:46.771351 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 11:39:46.771351 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 11:39:46.771351 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 11:39:46.771351 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:39:46.771351 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:39:46.771351 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:39:46.771351 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:39:46.772806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 11:39:46.772806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 11:39:46.772806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 11:39:46.772806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 11:39:46.772806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 11:39:46.772806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 11:39:46.772806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 10 11:39:46.772806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.772806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:46.772806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.772806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:46.772806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:46.772806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:46.772806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 11:39:46.772806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 11:39:46.772806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 10 11:39:46.772806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.773831 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a9ab9ef7-987c-4c2a-97a6-b4f9e5425b50 tempest-HostsAdminNegativeTestJSON-81849952 tempest-HostsAdminNegativeTestJSON-81849952-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:39:46.773831 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a9ab9ef7-987c-4c2a-97a6-b4f9e5425b50 tempest-HostsAdminNegativeTestJSON-81849952 tempest-HostsAdminNegativeTestJSON-81849952-project] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-d-856895-1" status: 403 len: 109 microversion: 2.1 time: 0.010649 Sep 10 11:39:46.773831 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 280/528] 10.222.0.23 () {58 vars in 1167 bytes} [Sat Sep 10 11:39:46 2022] GET /compute/v2.1/os-hosts/n-d-856895-1 => generated 109 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:39:46.781157 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-93060d60-8e11-4af5-908e-d5080b3eca76 tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] Calling method '.version_select at 0x7f4073a7bb80>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:46.791323 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-93060d60-8e11-4af5-908e-d5080b3eca76 tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 11:39:46.799894 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-93060d60-8e11-4af5-908e-d5080b3eca76 tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] Request method failure captured: Sep 10 11:39:46.799894 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 10 11:39:46.799894 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:39:46.799894 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:39:46.799894 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:39:46.799894 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:39:46.799894 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:39:46.799894 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:39:46.799894 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:39:46.799894 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:39:46.799894 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHeBb7e9KO_ch68xDJPfuoFan6nE6GcBO8u0Q0Qb4WO9SYKV9qKQc18NsDeY4g3qXDNVf9hvIMCVJOfAy_4Ckm_Rgt6gygOp7ywK4ZhfQXrjJQh9tjtoO8l8UoKBtmN6-jX2kCBxa2m9xKcFH5mDKs-2JGF7C7KpH9Y7S3IHFRDW0p4 Sep 10 11:39:46.799894 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:39:46.799894 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:39:46.799894 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:39:46.799894 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:39:46.799894 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:39:46.799894 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:39:46.799894 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: b7c35d2323c34da4a8515a6835b11c47 Sep 10 11:39:46.799894 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1977209348 Sep 10 11:39:46.799894 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,admin,member Sep 10 11:39:46.799894 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,admin,member Sep 10 11:39:46.801287 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b7c35d2323c34da4a8515a6835b11c47"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b7c35d2323c34da4a8515a6835b11c47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b7c35d2323c34da4a8515a6835b11c47", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b7c35d2323c34da4a8515a6835b11c47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:39:46.801287 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1977209348 Sep 10 11:39:46.801287 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: b7c35d2323c34da4a8515a6835b11c47 Sep 10 11:39:46.801287 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1977209348 Sep 10 11:39:46.801287 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-HostsAdminNegativeTestJSON-1977209348-project-admin Sep 10 11:39:46.801287 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:39:46.801287 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:39:46.801287 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 54365c8653fd406082e640475510dfcb Sep 10 11:39:46.801287 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1977209348-project-admin Sep 10 11:39:46.801287 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:39:46.801287 n-d-856895-1 devstack@n-api.service[128776]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 11:39:46.801287 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'nonexistent_hostname'} Sep 10 11:39:46.801287 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:39:46.802132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:46.802132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Sep 10 11:39:46.802132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 10 11:39:46.802132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 11:39:46.802132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 11:39:46.802132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 10 11:39:46.802132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 10 11:39:46.802132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 11:39:46.802132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 11:39:46.802132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 10 11:39:46.802132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 10 11:39:46.802132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 11:39:46.802132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.802132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:46.802132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.802132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:46.802132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:46.802132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:46.802132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:39:46.803715 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:39:46.803715 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:39:46.803715 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:39:46.803715 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:39:46.803715 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:39:46.803715 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Sep 10 11:39:46.803715 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:39:46.803715 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 11:39:46.803715 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.803715 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:46.803715 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.803715 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:46.803715 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:46.803715 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:46.803715 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:39:46.803715 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:39:46.803715 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 11:39:46.803715 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.806499 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-93060d60-8e11-4af5-908e-d5080b3eca76 tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:39:46.807616 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-93060d60-8e11-4af5-908e-d5080b3eca76 tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.030395 Sep 10 11:39:46.809510 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 281/529] 10.222.0.23 () {58 vars in 1191 bytes} [Sat Sep 10 11:39:46 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:39:46.819421 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ad92eeca-74e6-430f-9726-9146dc841f77 tempest-HostsAdminNegativeTestJSON-81849952 tempest-HostsAdminNegativeTestJSON-81849952-project] Calling method '.version_select at 0x7f4078c2b670>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:46.821847 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ad92eeca-74e6-430f-9726-9146dc841f77 tempest-HostsAdminNegativeTestJSON-81849952 tempest-HostsAdminNegativeTestJSON-81849952-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '5762a9d1755f4e5883a8420220afea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389b9e6d2326448cb389d60598bd7ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:46.823753 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ad92eeca-74e6-430f-9726-9146dc841f77 tempest-HostsAdminNegativeTestJSON-81849952 tempest-HostsAdminNegativeTestJSON-81849952-project] Request method failure captured: Sep 10 11:39:46.823753 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/os-hosts/n-d-856895-1/shutdown HTTP/1.1 Sep 10 11:39:46.823753 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:39:46.823753 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:39:46.823753 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:39:46.823753 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:39:46.823753 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:39:46.823753 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:39:46.823753 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:39:46.823753 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:39:46.823753 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHd_p9KoMmChbx1W2qo0T5U9BdeSlw1DHbPfmxWeotzsTxZvbsITy221K4NmAGFS7GXo9Bgjmf2uPXx6R7P6ZDIehNPyqvjwc1vXQueDFkveprwS1RBeCh0_h_TLDrpxr5xWTpU0g-4QznIdvRF2rRUgEfIoWUSzE_Ncr26byyRZSqw Sep 10 11:39:46.823753 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:39:46.823753 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:39:46.823753 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:39:46.823753 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:39:46.823753 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:39:46.823753 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:39:46.823753 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 389b9e6d2326448cb389d60598bd7ef3 Sep 10 11:39:46.823753 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-81849952 Sep 10 11:39:46.823753 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:39:46.823753 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:39:46.825131 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/389b9e6d2326448cb389d60598bd7ef3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/389b9e6d2326448cb389d60598bd7ef3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_389b9e6d2326448cb389d60598bd7ef3", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/389b9e6d2326448cb389d60598bd7ef3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:39:46.825131 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-HostsAdminNegativeTestJSON-81849952 Sep 10 11:39:46.825131 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 389b9e6d2326448cb389d60598bd7ef3 Sep 10 11:39:46.825131 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-81849952 Sep 10 11:39:46.825131 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-HostsAdminNegativeTestJSON-81849952-project Sep 10 11:39:46.825131 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:39:46.825131 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:39:46.825131 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 5762a9d1755f4e5883a8420220afea19 Sep 10 11:39:46.825131 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-HostsAdminNegativeTestJSON-81849952-project Sep 10 11:39:46.825131 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:39:46.825131 n-d-856895-1 devstack@n-api.service[128776]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 10 11:39:46.825131 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'n-d-856895-1'} Sep 10 11:39:46.825131 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:39:46.825906 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:46.825906 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:46.825906 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:46.825906 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:39:46.825906 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:39:46.825906 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:39:46.825906 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:39:46.825906 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:39:46.825906 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:39:46.825906 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Sep 10 11:39:46.825906 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Sep 10 11:39:46.825906 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 11:39:46.825906 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 11:39:46.825906 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 11:39:46.825906 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 11:39:46.825906 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:39:46.825906 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:39:46.825906 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:39:46.825906 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:39:46.827005 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 11:39:46.827005 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 11:39:46.827005 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 11:39:46.827005 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 11:39:46.827005 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 11:39:46.827005 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 11:39:46.827005 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 10 11:39:46.827005 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.827005 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:46.827005 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.827005 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:46.827005 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:46.827005 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:46.827005 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 11:39:46.827005 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 11:39:46.827005 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 10 11:39:46.827005 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.830039 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ad92eeca-74e6-430f-9726-9146dc841f77 tempest-HostsAdminNegativeTestJSON-81849952 tempest-HostsAdminNegativeTestJSON-81849952-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:39:46.831237 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ad92eeca-74e6-430f-9726-9146dc841f77 tempest-HostsAdminNegativeTestJSON-81849952 tempest-HostsAdminNegativeTestJSON-81849952-project] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-d-856895-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.016059 Sep 10 11:39:46.832301 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 282/530] 10.222.0.23 () {58 vars in 1194 bytes} [Sat Sep 10 11:39:46 2022] GET /compute/v2.1/os-hosts/n-d-856895-1/shutdown => generated 113 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:39:46.841560 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-93bae75d-28bd-42ec-90db-e520abd3a0d2 tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] Calling method '.version_select at 0x7f4073a7b9d0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:46.854797 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-93bae75d-28bd-42ec-90db-e520abd3a0d2 tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 11:39:46.856679 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-93bae75d-28bd-42ec-90db-e520abd3a0d2 tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] Request method failure captured: Sep 10 11:39:46.856679 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Sep 10 11:39:46.856679 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:39:46.856679 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:39:46.856679 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:39:46.856679 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:39:46.856679 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:39:46.856679 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:39:46.856679 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:39:46.856679 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:39:46.856679 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHeBb7e9KO_ch68xDJPfuoFan6nE6GcBO8u0Q0Qb4WO9SYKV9qKQc18NsDeY4g3qXDNVf9hvIMCVJOfAy_4Ckm_Rgt6gygOp7ywK4ZhfQXrjJQh9tjtoO8l8UoKBtmN6-jX2kCBxa2m9xKcFH5mDKs-2JGF7C7KpH9Y7S3IHFRDW0p4 Sep 10 11:39:46.856679 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:39:46.856679 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:39:46.856679 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:39:46.856679 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:39:46.856679 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:39:46.856679 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:39:46.856679 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: b7c35d2323c34da4a8515a6835b11c47 Sep 10 11:39:46.856679 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1977209348 Sep 10 11:39:46.856679 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,admin,member Sep 10 11:39:46.856679 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,admin,member Sep 10 11:39:46.857965 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b7c35d2323c34da4a8515a6835b11c47"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b7c35d2323c34da4a8515a6835b11c47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b7c35d2323c34da4a8515a6835b11c47", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b7c35d2323c34da4a8515a6835b11c47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:39:46.857965 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1977209348 Sep 10 11:39:46.857965 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: b7c35d2323c34da4a8515a6835b11c47 Sep 10 11:39:46.857965 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1977209348 Sep 10 11:39:46.857965 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-HostsAdminNegativeTestJSON-1977209348-project-admin Sep 10 11:39:46.857965 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:39:46.857965 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:39:46.857965 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 54365c8653fd406082e640475510dfcb Sep 10 11:39:46.857965 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1977209348-project-admin Sep 10 11:39:46.857965 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:39:46.857965 n-d-856895-1 devstack@n-api.service[128776]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 11:39:46.857965 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'nonexistent_hostname'} Sep 10 11:39:46.857965 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:39:46.858751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:46.858751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 10 11:39:46.858751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 10 11:39:46.858751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 11:39:46.858751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 11:39:46.858751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:39:46.858751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:39:46.858751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:39:46.858751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:39:46.858751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 11:39:46.858751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 11:39:46.858751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 10 11:39:46.858751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 10 11:39:46.858751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 11:39:46.858751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 11:39:46.858751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 10 11:39:46.858751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 10 11:39:46.858751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 11:39:46.858751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 11:39:46.859847 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 10 11:39:46.859847 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 10 11:39:46.859847 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 11:39:46.859847 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.859847 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:46.859847 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.859847 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:46.859847 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:46.859847 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:46.859847 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:39:46.859847 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:39:46.859847 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:39:46.859847 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:39:46.859847 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:39:46.859847 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:39:46.859847 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Sep 10 11:39:46.859847 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Sep 10 11:39:46.859847 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 10 11:39:46.859847 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:39:46.862127 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 11:39:46.862127 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.862127 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:46.862127 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.862127 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:46.862127 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:46.862127 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:46.862127 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:39:46.862127 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:39:46.862127 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 11:39:46.862127 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.862127 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-93bae75d-28bd-42ec-90db-e520abd3a0d2 tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:39:46.862127 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-93bae75d-28bd-42ec-90db-e520abd3a0d2 tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.021410 Sep 10 11:39:46.862127 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 283/531] 10.222.0.23 () {58 vars in 1218 bytes} [Sat Sep 10 11:39:46 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 10 11:39:46.870710 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a9a3c3c8-04f7-40a5-933d-6688b43ac0ee tempest-HostsAdminNegativeTestJSON-81849952 tempest-HostsAdminNegativeTestJSON-81849952-project] Calling method '.version_select at 0x7f4073c1a040>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:46.872924 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a9a3c3c8-04f7-40a5-933d-6688b43ac0ee tempest-HostsAdminNegativeTestJSON-81849952 tempest-HostsAdminNegativeTestJSON-81849952-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '5762a9d1755f4e5883a8420220afea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389b9e6d2326448cb389d60598bd7ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:46.875143 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a9a3c3c8-04f7-40a5-933d-6688b43ac0ee tempest-HostsAdminNegativeTestJSON-81849952 tempest-HostsAdminNegativeTestJSON-81849952-project] Request method failure captured: Sep 10 11:39:46.875143 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/os-hosts/n-d-856895-1/startup HTTP/1.1 Sep 10 11:39:46.875143 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:39:46.875143 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:39:46.875143 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:39:46.875143 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:39:46.875143 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:39:46.875143 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:39:46.875143 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:39:46.875143 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:39:46.875143 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHd_p9KoMmChbx1W2qo0T5U9BdeSlw1DHbPfmxWeotzsTxZvbsITy221K4NmAGFS7GXo9Bgjmf2uPXx6R7P6ZDIehNPyqvjwc1vXQueDFkveprwS1RBeCh0_h_TLDrpxr5xWTpU0g-4QznIdvRF2rRUgEfIoWUSzE_Ncr26byyRZSqw Sep 10 11:39:46.875143 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:39:46.875143 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:39:46.875143 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:39:46.875143 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:39:46.875143 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:39:46.875143 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:39:46.875143 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 389b9e6d2326448cb389d60598bd7ef3 Sep 10 11:39:46.875143 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-81849952 Sep 10 11:39:46.875143 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:39:46.875143 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:39:46.876631 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/389b9e6d2326448cb389d60598bd7ef3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/389b9e6d2326448cb389d60598bd7ef3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_389b9e6d2326448cb389d60598bd7ef3", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/389b9e6d2326448cb389d60598bd7ef3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:39:46.876631 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-HostsAdminNegativeTestJSON-81849952 Sep 10 11:39:46.876631 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 389b9e6d2326448cb389d60598bd7ef3 Sep 10 11:39:46.876631 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-81849952 Sep 10 11:39:46.876631 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-HostsAdminNegativeTestJSON-81849952-project Sep 10 11:39:46.876631 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:39:46.876631 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:39:46.876631 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 5762a9d1755f4e5883a8420220afea19 Sep 10 11:39:46.876631 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-HostsAdminNegativeTestJSON-81849952-project Sep 10 11:39:46.876631 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:39:46.876631 n-d-856895-1 devstack@n-api.service[128776]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 10 11:39:46.876631 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'n-d-856895-1'} Sep 10 11:39:46.876631 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:39:46.877378 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:46.877378 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:46.877378 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:46.877378 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:39:46.877378 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:39:46.877378 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:39:46.877378 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:39:46.877378 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:39:46.877378 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:39:46.877378 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Sep 10 11:39:46.877378 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Sep 10 11:39:46.877378 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 11:39:46.877378 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 11:39:46.877378 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 11:39:46.877378 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 11:39:46.877378 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:39:46.877378 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:39:46.877378 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:39:46.877378 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:39:46.878433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 11:39:46.878433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 11:39:46.878433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 11:39:46.878433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 11:39:46.878433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 11:39:46.878433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 11:39:46.878433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 10 11:39:46.878433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.878433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:46.878433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.878433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:46.878433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:46.878433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:46.878433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 11:39:46.878433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 11:39:46.878433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 10 11:39:46.878433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.879434 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a9a3c3c8-04f7-40a5-933d-6688b43ac0ee tempest-HostsAdminNegativeTestJSON-81849952 tempest-HostsAdminNegativeTestJSON-81849952-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:39:46.879434 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a9a3c3c8-04f7-40a5-933d-6688b43ac0ee tempest-HostsAdminNegativeTestJSON-81849952 tempest-HostsAdminNegativeTestJSON-81849952-project] 10.222.0.23 "GET /compute/v2.1/os-hosts/n-d-856895-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.011026 Sep 10 11:39:46.879434 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 284/532] 10.222.0.23 () {58 vars in 1191 bytes} [Sat Sep 10 11:39:46 2022] GET /compute/v2.1/os-hosts/n-d-856895-1/startup => generated 110 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:39:46.888373 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-49772895-1d1a-4682-91b2-23af0f26166c tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] Calling method '.version_select at 0x7f4073a7b0d0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:46.898652 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-49772895-1d1a-4682-91b2-23af0f26166c tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 11:39:46.900642 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-49772895-1d1a-4682-91b2-23af0f26166c tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] Request method failure captured: Sep 10 11:39:46.900642 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Sep 10 11:39:46.900642 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:39:46.900642 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:39:46.900642 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:39:46.900642 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:39:46.900642 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:39:46.900642 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:39:46.900642 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:39:46.900642 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:39:46.900642 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHeBb7e9KO_ch68xDJPfuoFan6nE6GcBO8u0Q0Qb4WO9SYKV9qKQc18NsDeY4g3qXDNVf9hvIMCVJOfAy_4Ckm_Rgt6gygOp7ywK4ZhfQXrjJQh9tjtoO8l8UoKBtmN6-jX2kCBxa2m9xKcFH5mDKs-2JGF7C7KpH9Y7S3IHFRDW0p4 Sep 10 11:39:46.900642 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:39:46.900642 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:39:46.900642 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:39:46.900642 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:39:46.900642 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:39:46.900642 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:39:46.900642 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: b7c35d2323c34da4a8515a6835b11c47 Sep 10 11:39:46.900642 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1977209348 Sep 10 11:39:46.900642 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,admin,member Sep 10 11:39:46.900642 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,admin,member Sep 10 11:39:46.901885 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b7c35d2323c34da4a8515a6835b11c47"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b7c35d2323c34da4a8515a6835b11c47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b7c35d2323c34da4a8515a6835b11c47", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b7c35d2323c34da4a8515a6835b11c47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:39:46.901885 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1977209348 Sep 10 11:39:46.901885 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: b7c35d2323c34da4a8515a6835b11c47 Sep 10 11:39:46.901885 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1977209348 Sep 10 11:39:46.901885 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-HostsAdminNegativeTestJSON-1977209348-project-admin Sep 10 11:39:46.901885 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:39:46.901885 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:39:46.901885 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 54365c8653fd406082e640475510dfcb Sep 10 11:39:46.901885 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1977209348-project-admin Sep 10 11:39:46.901885 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:39:46.901885 n-d-856895-1 devstack@n-api.service[128776]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 11:39:46.901885 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'nonexistent_hostname'} Sep 10 11:39:46.901885 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:39:46.903398 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:46.903398 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 10 11:39:46.903398 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 10 11:39:46.903398 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 11:39:46.903398 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 11:39:46.903398 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:39:46.903398 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:39:46.903398 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:39:46.903398 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:39:46.903398 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 11:39:46.903398 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 11:39:46.903398 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 10 11:39:46.903398 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 10 11:39:46.903398 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 11:39:46.903398 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 11:39:46.903398 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 10 11:39:46.903398 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 10 11:39:46.903398 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 11:39:46.903398 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 11:39:46.904493 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 10 11:39:46.904493 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 10 11:39:46.904493 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 11:39:46.904493 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.904493 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:46.904493 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.904493 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:46.904493 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:46.904493 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:46.904493 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:39:46.904493 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:39:46.904493 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:39:46.904493 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:39:46.904493 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:39:46.904493 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:39:46.904493 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Sep 10 11:39:46.904493 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Sep 10 11:39:46.904493 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 10 11:39:46.904493 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:39:46.905692 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 11:39:46.905692 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.905692 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:46.905692 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.905692 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:46.905692 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:46.905692 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:46.905692 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:39:46.905692 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:39:46.905692 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 11:39:46.905692 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.905692 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-49772895-1d1a-4682-91b2-23af0f26166c tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:39:46.905692 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-49772895-1d1a-4682-91b2-23af0f26166c tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.019315 Sep 10 11:39:46.905692 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 285/533] 10.222.0.23 () {58 vars in 1215 bytes} [Sat Sep 10 11:39:46 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:39:46.915453 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b6df6cff-5e72-427c-ac64-1fe6d5a30f28 tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] Action: 'update', calling method: .version_select at 0x7f4073cdaee0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:46.922032 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b6df6cff-5e72-427c-ac64-1fe6d5a30f28 tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] Request method failure captured: Sep 10 11:39:46.922032 n-d-856895-1 devstack@n-api.service[128776]: request: PUT /compute/v2.1/os-hosts/n-d-856895-1 HTTP/1.1 Sep 10 11:39:46.922032 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:39:46.922032 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:39:46.922032 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:39:46.922032 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 51 Sep 10 11:39:46.922032 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:39:46.922032 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:39:46.922032 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:39:46.922032 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:39:46.922032 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHeBb7e9KO_ch68xDJPfuoFan6nE6GcBO8u0Q0Qb4WO9SYKV9qKQc18NsDeY4g3qXDNVf9hvIMCVJOfAy_4Ckm_Rgt6gygOp7ywK4ZhfQXrjJQh9tjtoO8l8UoKBtmN6-jX2kCBxa2m9xKcFH5mDKs-2JGF7C7KpH9Y7S3IHFRDW0p4 Sep 10 11:39:46.922032 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:39:46.922032 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:39:46.922032 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:39:46.922032 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:39:46.922032 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:39:46.922032 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:39:46.922032 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: b7c35d2323c34da4a8515a6835b11c47 Sep 10 11:39:46.922032 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1977209348 Sep 10 11:39:46.922032 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,admin,member Sep 10 11:39:46.922032 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,admin,member Sep 10 11:39:46.923448 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b7c35d2323c34da4a8515a6835b11c47"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b7c35d2323c34da4a8515a6835b11c47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b7c35d2323c34da4a8515a6835b11c47", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b7c35d2323c34da4a8515a6835b11c47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:39:46.923448 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1977209348 Sep 10 11:39:46.923448 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: b7c35d2323c34da4a8515a6835b11c47 Sep 10 11:39:46.923448 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1977209348 Sep 10 11:39:46.923448 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-HostsAdminNegativeTestJSON-1977209348-project-admin Sep 10 11:39:46.923448 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:39:46.923448 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:39:46.923448 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 54365c8653fd406082e640475510dfcb Sep 10 11:39:46.923448 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1977209348-project-admin Sep 10 11:39:46.923448 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 11:39:46.923448 n-d-856895-1 devstack@n-api.service[128776]: {"status": "enable", "maintenance_mode": "invalid"} Sep 10 11:39:46.923448 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:39:46.923448 n-d-856895-1 devstack@n-api.service[128776]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 10 11:39:46.924227 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'n-d-856895-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Sep 10 11:39:46.924227 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:39:46.924227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:46.924227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 11:39:46.924227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 11:39:46.924227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 11:39:46.924227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise error Sep 10 11:39:46.924227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 10 11:39:46.924227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.924227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Sep 10 11:39:46.924227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 10 11:39:46.924227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'disable', Sep 10 11:39:46.924227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'Enable', Sep 10 11:39:46.924227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'Disable', Sep 10 11:39:46.924227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 10 11:39:46.924227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 10 11:39:46.924227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 10 11:39:46.924227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.924227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi On instance: Sep 10 11:39:46.924227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'invalid' Sep 10 11:39:46.924227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.924227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:46.924227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.924227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:46.924227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:46.930633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:46.930633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:39:46.930633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:39:46.930633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:39:46.930633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:39:46.930633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:39:46.930633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:39:46.930633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 11:39:46.930633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 11:39:46.930633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 11:39:46.930633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 11:39:46.930633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 11:39:46.930633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 11:39:46.930633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 10 11:39:46.930633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.930633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:46.930633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.930633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:46.930633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:46.931758 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:46.931758 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 11:39:46.931758 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 11:39:46.931758 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 10 11:39:46.931758 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.931758 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b6df6cff-5e72-427c-ac64-1fe6d5a30f28 tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:39:46.931758 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b6df6cff-5e72-427c-ac64-1fe6d5a30f28 tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-hosts/n-d-856895-1" status: 400 len: 199 microversion: 2.1 time: 0.012252 Sep 10 11:39:46.931758 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 286/534] 10.222.0.23 () {60 vars in 1187 bytes} [Sat Sep 10 11:39:46 2022] PUT /compute/v2.1/os-hosts/n-d-856895-1 => generated 199 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:39:46.939931 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e98696a3-df3f-4b95-9e4d-8718f41fb19d tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] Action: 'update', calling method: .version_select at 0x7f4073a49700>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:46.945076 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e98696a3-df3f-4b95-9e4d-8718f41fb19d tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] Request method failure captured: Sep 10 11:39:46.945076 n-d-856895-1 devstack@n-api.service[128776]: request: PUT /compute/v2.1/os-hosts/n-d-856895-1 HTTP/1.1 Sep 10 11:39:46.945076 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:39:46.945076 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:39:46.945076 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:39:46.945076 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 51 Sep 10 11:39:46.945076 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:39:46.945076 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:39:46.945076 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:39:46.945076 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:39:46.945076 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHeBb7e9KO_ch68xDJPfuoFan6nE6GcBO8u0Q0Qb4WO9SYKV9qKQc18NsDeY4g3qXDNVf9hvIMCVJOfAy_4Ckm_Rgt6gygOp7ywK4ZhfQXrjJQh9tjtoO8l8UoKBtmN6-jX2kCBxa2m9xKcFH5mDKs-2JGF7C7KpH9Y7S3IHFRDW0p4 Sep 10 11:39:46.945076 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:39:46.945076 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:39:46.945076 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:39:46.945076 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:39:46.945076 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:39:46.945076 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:39:46.945076 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: b7c35d2323c34da4a8515a6835b11c47 Sep 10 11:39:46.945076 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1977209348 Sep 10 11:39:46.945076 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,admin,member Sep 10 11:39:46.945076 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,admin,member Sep 10 11:39:46.946671 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b7c35d2323c34da4a8515a6835b11c47"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b7c35d2323c34da4a8515a6835b11c47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b7c35d2323c34da4a8515a6835b11c47", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b7c35d2323c34da4a8515a6835b11c47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:39:46.946671 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1977209348 Sep 10 11:39:46.946671 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: b7c35d2323c34da4a8515a6835b11c47 Sep 10 11:39:46.946671 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1977209348 Sep 10 11:39:46.946671 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-HostsAdminNegativeTestJSON-1977209348-project-admin Sep 10 11:39:46.946671 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:39:46.946671 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:39:46.946671 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 54365c8653fd406082e640475510dfcb Sep 10 11:39:46.946671 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1977209348-project-admin Sep 10 11:39:46.946671 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 11:39:46.946671 n-d-856895-1 devstack@n-api.service[128776]: {"status": "invalid", "maintenance_mode": "enable"} Sep 10 11:39:46.946671 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:39:46.946671 n-d-856895-1 devstack@n-api.service[128776]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 10 11:39:46.947692 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'n-d-856895-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Sep 10 11:39:46.947692 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:39:46.947692 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:46.947692 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 11:39:46.947692 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 11:39:46.947692 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 11:39:46.947692 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise error Sep 10 11:39:46.947692 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 10 11:39:46.947692 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.947692 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Sep 10 11:39:46.947692 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 10 11:39:46.947692 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'disable', Sep 10 11:39:46.947692 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'Enable', Sep 10 11:39:46.947692 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'Disable', Sep 10 11:39:46.947692 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 10 11:39:46.947692 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 10 11:39:46.947692 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 10 11:39:46.947692 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.947692 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi On instance: Sep 10 11:39:46.947692 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'invalid' Sep 10 11:39:46.947692 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.947692 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:46.947692 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.947692 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:46.947692 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:46.949454 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:46.949454 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:39:46.949454 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:39:46.949454 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:39:46.949454 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:39:46.949454 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:39:46.949454 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:39:46.949454 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 11:39:46.949454 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 11:39:46.949454 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 11:39:46.949454 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 11:39:46.949454 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 11:39:46.949454 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 11:39:46.949454 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 10 11:39:46.949454 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.949454 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:46.949454 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.949454 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:46.949454 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:46.950748 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:46.950748 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 11:39:46.950748 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 11:39:46.950748 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 10 11:39:46.950748 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.950748 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e98696a3-df3f-4b95-9e4d-8718f41fb19d tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:39:46.952479 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e98696a3-df3f-4b95-9e4d-8718f41fb19d tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-hosts/n-d-856895-1" status: 400 len: 189 microversion: 2.1 time: 0.020299 Sep 10 11:39:46.958603 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 287/535] 10.222.0.23 () {60 vars in 1187 bytes} [Sat Sep 10 11:39:46 2022] PUT /compute/v2.1/os-hosts/n-d-856895-1 => generated 189 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:39:46.964038 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-46abadf2-4f8d-42d2-b157-2bbf45ff6c2d tempest-HostsAdminNegativeTestJSON-81849952 tempest-HostsAdminNegativeTestJSON-81849952-project] Action: 'update', calling method: .version_select at 0x7f4073a49430>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:46.967924 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-46abadf2-4f8d-42d2-b157-2bbf45ff6c2d tempest-HostsAdminNegativeTestJSON-81849952 tempest-HostsAdminNegativeTestJSON-81849952-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '5762a9d1755f4e5883a8420220afea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '389b9e6d2326448cb389d60598bd7ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:46.970772 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-46abadf2-4f8d-42d2-b157-2bbf45ff6c2d tempest-HostsAdminNegativeTestJSON-81849952 tempest-HostsAdminNegativeTestJSON-81849952-project] Request method failure captured: Sep 10 11:39:46.970772 n-d-856895-1 devstack@n-api.service[128776]: request: PUT /compute/v2.1/os-hosts/n-d-856895-1 HTTP/1.1 Sep 10 11:39:46.970772 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:39:46.970772 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:39:46.970772 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:39:46.970772 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 50 Sep 10 11:39:46.970772 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:39:46.970772 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:39:46.970772 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:39:46.970772 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:39:46.970772 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHd_p9KoMmChbx1W2qo0T5U9BdeSlw1DHbPfmxWeotzsTxZvbsITy221K4NmAGFS7GXo9Bgjmf2uPXx6R7P6ZDIehNPyqvjwc1vXQueDFkveprwS1RBeCh0_h_TLDrpxr5xWTpU0g-4QznIdvRF2rRUgEfIoWUSzE_Ncr26byyRZSqw Sep 10 11:39:46.970772 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:39:46.970772 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:39:46.970772 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:39:46.970772 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:39:46.970772 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:39:46.970772 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:39:46.970772 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 389b9e6d2326448cb389d60598bd7ef3 Sep 10 11:39:46.970772 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-81849952 Sep 10 11:39:46.970772 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:39:46.970772 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:39:46.972368 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/389b9e6d2326448cb389d60598bd7ef3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/389b9e6d2326448cb389d60598bd7ef3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_389b9e6d2326448cb389d60598bd7ef3", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/389b9e6d2326448cb389d60598bd7ef3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:39:46.972368 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-HostsAdminNegativeTestJSON-81849952 Sep 10 11:39:46.972368 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 389b9e6d2326448cb389d60598bd7ef3 Sep 10 11:39:46.972368 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-81849952 Sep 10 11:39:46.972368 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-HostsAdminNegativeTestJSON-81849952-project Sep 10 11:39:46.972368 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:39:46.972368 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:39:46.972368 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 5762a9d1755f4e5883a8420220afea19 Sep 10 11:39:46.972368 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-HostsAdminNegativeTestJSON-81849952-project Sep 10 11:39:46.972368 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 11:39:46.972368 n-d-856895-1 devstack@n-api.service[128776]: {"status": "enable", "maintenance_mode": "enable"} Sep 10 11:39:46.972368 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:39:46.972368 n-d-856895-1 devstack@n-api.service[128776]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 10 11:39:46.972368 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'n-d-856895-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 10 11:39:46.973365 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:39:46.973365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:46.973365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:46.973365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:46.973365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:39:46.973365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:39:46.973365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:39:46.973365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:39:46.973365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:39:46.973365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:39:46.973365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:39:46.973365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:39:46.973365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Sep 10 11:39:46.973365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Sep 10 11:39:46.973365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 11:39:46.973365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 11:39:46.973365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 11:39:46.973365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 11:39:46.973365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:39:46.973365 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:39:46.974753 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:39:46.974753 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:39:46.974753 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 11:39:46.974753 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 11:39:46.974753 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 11:39:46.974753 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 11:39:46.974753 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 11:39:46.974753 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 11:39:46.974753 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 10 11:39:46.974753 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.974753 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:46.974753 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.974753 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:46.974753 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:46.974753 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:46.974753 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 11:39:46.974753 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 11:39:46.974753 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 10 11:39:46.974753 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.976118 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-46abadf2-4f8d-42d2-b157-2bbf45ff6c2d tempest-HostsAdminNegativeTestJSON-81849952 tempest-HostsAdminNegativeTestJSON-81849952-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:39:46.978873 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-46abadf2-4f8d-42d2-b157-2bbf45ff6c2d tempest-HostsAdminNegativeTestJSON-81849952 tempest-HostsAdminNegativeTestJSON-81849952-project] 10.222.0.23 "PUT /compute/v2.1/os-hosts/n-d-856895-1" status: 403 len: 111 microversion: 2.1 time: 0.016888 Sep 10 11:39:46.982862 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 288/536] 10.222.0.23 () {60 vars in 1187 bytes} [Sat Sep 10 11:39:46 2022] PUT /compute/v2.1/os-hosts/n-d-856895-1 => generated 111 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:39:46.988157 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2676be7e-9b27-4d83-82bc-66e9bcdba54b tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] Action: 'update', calling method: .version_select at 0x7f4073a7b940>, body: {"status": null, "maintenance_mode": null} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:46.992506 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2676be7e-9b27-4d83-82bc-66e9bcdba54b tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] Request method failure captured: Sep 10 11:39:46.992506 n-d-856895-1 devstack@n-api.service[128776]: request: PUT /compute/v2.1/os-hosts/n-d-856895-1 HTTP/1.1 Sep 10 11:39:46.992506 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:39:46.992506 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:39:46.992506 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:39:46.992506 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 42 Sep 10 11:39:46.992506 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:39:46.992506 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:39:46.992506 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:39:46.992506 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:39:46.992506 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHeBb7e9KO_ch68xDJPfuoFan6nE6GcBO8u0Q0Qb4WO9SYKV9qKQc18NsDeY4g3qXDNVf9hvIMCVJOfAy_4Ckm_Rgt6gygOp7ywK4ZhfQXrjJQh9tjtoO8l8UoKBtmN6-jX2kCBxa2m9xKcFH5mDKs-2JGF7C7KpH9Y7S3IHFRDW0p4 Sep 10 11:39:46.992506 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:39:46.992506 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:39:46.992506 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:39:46.992506 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:39:46.992506 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:39:46.992506 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:39:46.992506 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: b7c35d2323c34da4a8515a6835b11c47 Sep 10 11:39:46.992506 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1977209348 Sep 10 11:39:46.992506 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,admin,member Sep 10 11:39:46.992506 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,admin,member Sep 10 11:39:46.994168 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b7c35d2323c34da4a8515a6835b11c47"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b7c35d2323c34da4a8515a6835b11c47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b7c35d2323c34da4a8515a6835b11c47", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b7c35d2323c34da4a8515a6835b11c47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:39:46.994168 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1977209348 Sep 10 11:39:46.994168 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: b7c35d2323c34da4a8515a6835b11c47 Sep 10 11:39:46.994168 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1977209348 Sep 10 11:39:46.994168 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-HostsAdminNegativeTestJSON-1977209348-project-admin Sep 10 11:39:46.994168 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:39:46.994168 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:39:46.994168 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 54365c8653fd406082e640475510dfcb Sep 10 11:39:46.994168 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1977209348-project-admin Sep 10 11:39:46.994168 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 11:39:46.994168 n-d-856895-1 devstack@n-api.service[128776]: {"status": null, "maintenance_mode": null} Sep 10 11:39:46.994168 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:39:46.994168 n-d-856895-1 devstack@n-api.service[128776]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 10 11:39:46.994168 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'n-d-856895-1', 'body': {'status': None, 'maintenance_mode': None}} Sep 10 11:39:46.995177 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:39:46.995177 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:46.995177 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 11:39:46.995177 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 11:39:46.995177 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 11:39:46.995177 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise error Sep 10 11:39:46.995177 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Sep 10 11:39:46.995177 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.995177 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Sep 10 11:39:46.995177 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 10 11:39:46.995177 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'disable', Sep 10 11:39:46.995177 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'Enable', Sep 10 11:39:46.995177 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'Disable', Sep 10 11:39:46.995177 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 10 11:39:46.995177 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 10 11:39:46.995177 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 10 11:39:46.995177 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.995177 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi On instance: Sep 10 11:39:46.995177 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi None Sep 10 11:39:46.995177 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.995177 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:46.995177 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.995177 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:46.995177 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:46.995177 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:46.996945 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:39:46.996945 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:39:46.996945 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:39:46.996945 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:39:46.996945 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:39:46.996945 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:39:46.996945 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 11:39:46.996945 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 11:39:46.996945 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 11:39:46.996945 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 11:39:46.996945 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 11:39:46.996945 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 11:39:46.996945 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 10 11:39:46.996945 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.996945 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:46.996945 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.996945 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:46.996945 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:46.996945 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:46.998335 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 11:39:46.998335 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 11:39:46.998335 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 10 11:39:46.998335 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:46.998335 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2676be7e-9b27-4d83-82bc-66e9bcdba54b tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:39:47.001547 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2676be7e-9b27-4d83-82bc-66e9bcdba54b tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-hosts/n-d-856895-1" status: 400 len: 127 microversion: 2.1 time: 0.015474 Sep 10 11:39:47.004735 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 289/537] 10.222.0.23 () {60 vars in 1187 bytes} [Sat Sep 10 11:39:46 2022] PUT /compute/v2.1/os-hosts/n-d-856895-1 => generated 127 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:39:47.010577 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dd94709a-5715-4331-acff-8da514126df1 tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] Action: 'update', calling method: .version_select at 0x7f4073c1a040>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:47.013968 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.hosts [None req-dd94709a-5715-4331-acff-8da514126df1 tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] Enabling host nonexistent_hostname. Sep 10 11:39:47.020178 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=84,nova_api:SAVEPOINT=1,nova_api:RELEASE=1,nova_api:DELETE=8,nova_api:INSERT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:39:47.024090 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-dd94709a-5715-4331-acff-8da514126df1 tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 11:39:47.029202 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dd94709a-5715-4331-acff-8da514126df1 tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] Request method failure captured: Sep 10 11:39:47.029202 n-d-856895-1 devstack@n-api.service[128776]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 10 11:39:47.029202 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:39:47.029202 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:39:47.029202 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:39:47.029202 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 50 Sep 10 11:39:47.029202 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:39:47.029202 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:39:47.029202 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:39:47.029202 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:39:47.029202 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHeBb7e9KO_ch68xDJPfuoFan6nE6GcBO8u0Q0Qb4WO9SYKV9qKQc18NsDeY4g3qXDNVf9hvIMCVJOfAy_4Ckm_Rgt6gygOp7ywK4ZhfQXrjJQh9tjtoO8l8UoKBtmN6-jX2kCBxa2m9xKcFH5mDKs-2JGF7C7KpH9Y7S3IHFRDW0p4 Sep 10 11:39:47.029202 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:39:47.029202 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:39:47.029202 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:39:47.029202 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:39:47.029202 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:39:47.029202 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:39:47.029202 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: b7c35d2323c34da4a8515a6835b11c47 Sep 10 11:39:47.029202 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1977209348 Sep 10 11:39:47.029202 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,admin,member Sep 10 11:39:47.029202 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,admin,member Sep 10 11:39:47.030805 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b7c35d2323c34da4a8515a6835b11c47"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b7c35d2323c34da4a8515a6835b11c47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b7c35d2323c34da4a8515a6835b11c47", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b7c35d2323c34da4a8515a6835b11c47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:39:47.030805 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1977209348 Sep 10 11:39:47.030805 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: b7c35d2323c34da4a8515a6835b11c47 Sep 10 11:39:47.030805 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1977209348 Sep 10 11:39:47.030805 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-HostsAdminNegativeTestJSON-1977209348-project-admin Sep 10 11:39:47.030805 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:39:47.030805 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:39:47.030805 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 54365c8653fd406082e640475510dfcb Sep 10 11:39:47.030805 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1977209348-project-admin Sep 10 11:39:47.030805 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 11:39:47.030805 n-d-856895-1 devstack@n-api.service[128776]: {"status": "enable", "maintenance_mode": "enable"} Sep 10 11:39:47.030805 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:39:47.030805 n-d-856895-1 devstack@n-api.service[128776]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 11:39:47.030805 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 10 11:39:47.033949 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:39:47.033949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:47.033949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Sep 10 11:39:47.033949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Sep 10 11:39:47.033949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 11:39:47.033949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 11:39:47.033949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:39:47.033949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:39:47.033949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:39:47.033949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:39:47.033949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 11:39:47.033949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 11:39:47.033949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 10 11:39:47.033949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 10 11:39:47.033949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 11:39:47.033949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 11:39:47.033949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 10 11:39:47.033949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 10 11:39:47.035193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 11:39:47.035193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 11:39:47.035193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 10 11:39:47.035193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 10 11:39:47.035193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 11:39:47.035193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:47.035193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:47.035193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:47.035193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:47.035193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:47.035193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:47.035193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:39:47.035193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:39:47.035193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:39:47.035193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:39:47.035193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:39:47.035193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:39:47.035193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:39:47.035193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:39:47.035193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Sep 10 11:39:47.036725 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Sep 10 11:39:47.036725 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Sep 10 11:39:47.036725 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:39:47.036725 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 11:39:47.036725 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:47.036725 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:39:47.036725 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:47.036725 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:39:47.036725 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:39:47.036725 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:39:47.036725 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:39:47.036725 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:39:47.036725 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 10 11:39:47.036725 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:39:47.036725 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dd94709a-5715-4331-acff-8da514126df1 tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:39:47.037741 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-dd94709a-5715-4331-acff-8da514126df1 tempest-HostsAdminNegativeTestJSON-1977209348 tempest-HostsAdminNegativeTestJSON-1977209348-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.028785 Sep 10 11:39:47.050086 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 290/538] 10.222.0.23 () {60 vars in 1211 bytes} [Sat Sep 10 11:39:47 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:39:47.091747 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c4ef1edc-c253-4122-8c2c-fa5b8fc8030d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:47.109916 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c4ef1edc-c253-4122-8c2c-fa5b8fc8030d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b" status: 200 len: 1310 microversion: 2.1 time: 0.905766 Sep 10 11:39:47.121533 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 249/539] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:46 2022] GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b => generated 1310 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:47.396010 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-be91444e-52ac-4eda-af41-ec045c964eea tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:47.396752 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-be91444e-52ac-4eda-af41-ec045c964eea tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] [instance: a734916f-d369-4438-97de-3d0ae408384e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:47.405679 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-be91444e-52ac-4eda-af41-ec045c964eea tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:47.412089 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-be91444e-52ac-4eda-af41-ec045c964eea tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:47.412861 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-be91444e-52ac-4eda-af41-ec045c964eea tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:47.413817 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-be91444e-52ac-4eda-af41-ec045c964eea tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:47.414485 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-be91444e-52ac-4eda-af41-ec045c964eea tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:47.415142 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-be91444e-52ac-4eda-af41-ec045c964eea tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:47.840612 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-83e13f7d-0086-46c5-8fe7-7758ee817ac8 req-9a749e6e-541e-443d-8564-823fc3d5e5cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a734916f-d369-4438-97de-3d0ae408384e", "tag": "8ec1c9d9-f1a5-4b41-8a35-5e11629ee03b"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:47.871264 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-83e13f7d-0086-46c5-8fe7-7758ee817ac8 req-9a749e6e-541e-443d-8564-823fc3d5e5cc service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:47.871797 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-83e13f7d-0086-46c5-8fe7-7758ee817ac8 req-9a749e6e-541e-443d-8564-823fc3d5e5cc service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:47.872224 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-83e13f7d-0086-46c5-8fe7-7758ee817ac8 req-9a749e6e-541e-443d-8564-823fc3d5e5cc service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:47.910619 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-83e13f7d-0086-46c5-8fe7-7758ee817ac8 req-9a749e6e-541e-443d-8564-823fc3d5e5cc service nova] Creating event network-changed:8ec1c9d9-f1a5-4b41-8a35-5e11629ee03b for instance a734916f-d369-4438-97de-3d0ae408384e on n-h2-856895-1 Sep 10 11:39:47.921522 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-83e13f7d-0086-46c5-8fe7-7758ee817ac8 req-9a749e6e-541e-443d-8564-823fc3d5e5cc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.434550 Sep 10 11:39:47.923637 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 250/540] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:39:48.141881 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3395c275-d8b7-4a92-a270-25c35050cf9e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:48.142948 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3395c275-d8b7-4a92-a270-25c35050cf9e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: a21897bf-57b5-43df-b83e-0fe0461a589b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:48.153788 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3395c275-d8b7-4a92-a270-25c35050cf9e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:48.154282 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3395c275-d8b7-4a92-a270-25c35050cf9e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:48.155871 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3395c275-d8b7-4a92-a270-25c35050cf9e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:48.161336 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3395c275-d8b7-4a92-a270-25c35050cf9e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:48.162051 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3395c275-d8b7-4a92-a270-25c35050cf9e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:48.163853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3395c275-d8b7-4a92-a270-25c35050cf9e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:48.507711 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-be91444e-52ac-4eda-af41-ec045c964eea tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb907e8146dc42fc9cc47ff41a424503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f5d40e4bab429cb080f76a3ed3ee9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:48.525642 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-be91444e-52ac-4eda-af41-ec045c964eea tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] 10.222.0.23 "GET /compute/v2.1/servers/a734916f-d369-4438-97de-3d0ae408384e" status: 200 len: 1314 microversion: 2.1 time: 1.133888 Sep 10 11:39:48.540483 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 291/541] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:47 2022] GET /compute/v2.1/servers/a734916f-d369-4438-97de-3d0ae408384e => generated 1314 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:48.860352 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3395c275-d8b7-4a92-a270-25c35050cf9e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:48.879689 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3395c275-d8b7-4a92-a270-25c35050cf9e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b" status: 200 len: 1310 microversion: 2.1 time: 0.743045 Sep 10 11:39:48.881004 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 251/542] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:48 2022] GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b => generated 1310 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:49.383469 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-e8955941-c7fd-49ba-be0a-54aca64ab22d req-3046b25a-bdbc-4fd4-b965-c23db53712ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a21897bf-57b5-43df-b83e-0fe0461a589b", "name": "network-vif-plugged", "status": "completed", "tag": "67cd0369-12ef-4363-bcb5-c9103b512fc1"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:49.411145 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e8955941-c7fd-49ba-be0a-54aca64ab22d req-3046b25a-bdbc-4fd4-b965-c23db53712ff service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:49.411661 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e8955941-c7fd-49ba-be0a-54aca64ab22d req-3046b25a-bdbc-4fd4-b965-c23db53712ff service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:49.412093 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e8955941-c7fd-49ba-be0a-54aca64ab22d req-3046b25a-bdbc-4fd4-b965-c23db53712ff service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:49.443393 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-e8955941-c7fd-49ba-be0a-54aca64ab22d req-3046b25a-bdbc-4fd4-b965-c23db53712ff service nova] Creating event network-vif-plugged:67cd0369-12ef-4363-bcb5-c9103b512fc1 for instance a21897bf-57b5-43df-b83e-0fe0461a589b on n-h2-856895-1 Sep 10 11:39:49.467290 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-e8955941-c7fd-49ba-be0a-54aca64ab22d req-3046b25a-bdbc-4fd4-b965-c23db53712ff service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085533 Sep 10 11:39:49.471845 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 292/543] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:39:49.555372 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a1b057bb-599f-437a-a1a0-ebc78ed4bba8 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:49.556701 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a1b057bb-599f-437a-a1a0-ebc78ed4bba8 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] [instance: a734916f-d369-4438-97de-3d0ae408384e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:49.563191 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a1b057bb-599f-437a-a1a0-ebc78ed4bba8 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:49.568447 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a1b057bb-599f-437a-a1a0-ebc78ed4bba8 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:49.569193 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a1b057bb-599f-437a-a1a0-ebc78ed4bba8 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:49.570211 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a1b057bb-599f-437a-a1a0-ebc78ed4bba8 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:49.570872 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a1b057bb-599f-437a-a1a0-ebc78ed4bba8 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:49.571522 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a1b057bb-599f-437a-a1a0-ebc78ed4bba8 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:50.061488 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-48e1b9fa-af90-4366-a717-864c1308963f tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1335445096", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": "none"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:50.121030 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a1b057bb-599f-437a-a1a0-ebc78ed4bba8 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb907e8146dc42fc9cc47ff41a424503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f5d40e4bab429cb080f76a3ed3ee9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:50.141943 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a1b057bb-599f-437a-a1a0-ebc78ed4bba8 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] 10.222.0.23 "GET /compute/v2.1/servers/a734916f-d369-4438-97de-3d0ae408384e" status: 200 len: 1314 microversion: 2.1 time: 0.594338 Sep 10 11:39:50.146683 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 293/544] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:49 2022] GET /compute/v2.1/servers/a734916f-d369-4438-97de-3d0ae408384e => generated 1314 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:39:50.161535 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a12471e3-8b8b-4bdf-95cc-d7ae9650715f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:50.162162 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a12471e3-8b8b-4bdf-95cc-d7ae9650715f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: a21897bf-57b5-43df-b83e-0fe0461a589b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:50.213692 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-48e1b9fa-af90-4366-a717-864c1308963f tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:39:50.215639 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-48e1b9fa-af90-4366-a717-864c1308963f tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:39:50.216213 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-48e1b9fa-af90-4366-a717-864c1308963f tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:39:50.223323 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-48e1b9fa-af90-4366-a717-864c1308963f tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:39:50.225558 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a12471e3-8b8b-4bdf-95cc-d7ae9650715f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:50.229155 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-48e1b9fa-af90-4366-a717-864c1308963f tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:39:50.232727 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a12471e3-8b8b-4bdf-95cc-d7ae9650715f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:50.236788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a12471e3-8b8b-4bdf-95cc-d7ae9650715f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:50.238948 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a12471e3-8b8b-4bdf-95cc-d7ae9650715f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:50.239683 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a12471e3-8b8b-4bdf-95cc-d7ae9650715f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:50.240622 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a12471e3-8b8b-4bdf-95cc-d7ae9650715f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:50.259302 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48e1b9fa-af90-4366-a717-864c1308963f tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:50.261763 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48e1b9fa-af90-4366-a717-864c1308963f tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:50.263431 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48e1b9fa-af90-4366-a717-864c1308963f tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:50.266411 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48e1b9fa-af90-4366-a717-864c1308963f tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:50.269742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48e1b9fa-af90-4366-a717-864c1308963f tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:50.270529 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48e1b9fa-af90-4366-a717-864c1308963f tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:50.320417 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-48e1b9fa-af90-4366-a717-864c1308963f tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Getting quotas for project 1c541e81d1d1431a9b204d413b9a7365. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:39:50.332629 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-48e1b9fa-af90-4366-a717-864c1308963f tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Getting quotas for user 15ee4fc3ab324539a78b2bf4e20b36dc and project 1c541e81d1d1431a9b204d413b9a7365. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:39:50.352483 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-48e1b9fa-af90-4366-a717-864c1308963f tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:39:50.360923 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-48e1b9fa-af90-4366-a717-864c1308963f tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:39:50.468357 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-48e1b9fa-af90-4366-a717-864c1308963f tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.932650 Sep 10 11:39:50.469030 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 252/545] 10.222.0.23 () {62 vars in 1188 bytes} [Sat Sep 10 11:39:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 934 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 10 11:39:50.481390 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c1000973-f9fd-43de-b211-4d3e203f940d tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:50.493730 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c1000973-f9fd-43de-b211-4d3e203f940d tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:51.151837 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c1000973-f9fd-43de-b211-4d3e203f940d tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:51.164219 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c1000973-f9fd-43de-b211-4d3e203f940d tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:51.166386 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c1000973-f9fd-43de-b211-4d3e203f940d tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:51.188193 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c1000973-f9fd-43de-b211-4d3e203f940d tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] 10.222.0.23 "PUT /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1359 microversion: 2.75 time: 0.710528 Sep 10 11:39:51.190622 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 253/546] 10.222.0.23 () {62 vars in 1297 bytes} [Sat Sep 10 11:39:50 2022] PUT /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1359 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:39:51.202134 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0e8ee2ef-d3b1-46f7-8220-55c3f8d76a43 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:51.203798 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0e8ee2ef-d3b1-46f7-8220-55c3f8d76a43 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:51.219928 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e8ee2ef-d3b1-46f7-8220-55c3f8d76a43 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:51.222286 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e8ee2ef-d3b1-46f7-8220-55c3f8d76a43 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:51.223456 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e8ee2ef-d3b1-46f7-8220-55c3f8d76a43 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:51.225423 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e8ee2ef-d3b1-46f7-8220-55c3f8d76a43 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:51.227210 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e8ee2ef-d3b1-46f7-8220-55c3f8d76a43 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:51.229956 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e8ee2ef-d3b1-46f7-8220-55c3f8d76a43 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:51.305710 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a12471e3-8b8b-4bdf-95cc-d7ae9650715f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:51.323364 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a12471e3-8b8b-4bdf-95cc-d7ae9650715f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b" status: 200 len: 1310 microversion: 2.1 time: 1.173432 Sep 10 11:39:51.339966 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 294/547] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:50 2022] GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b => generated 1310 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:51.347602 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-b07f758c-646d-420c-9eb2-6e8aa9529e39 req-1bcb015f-3291-4b0e-8a33-db3aaaa81514 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7", "tag": "5c65da57-0904-4a32-9c5a-d379b5f6e7cf"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:51.373952 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-b07f758c-646d-420c-9eb2-6e8aa9529e39 req-1bcb015f-3291-4b0e-8a33-db3aaaa81514 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:51.374806 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-b07f758c-646d-420c-9eb2-6e8aa9529e39 req-1bcb015f-3291-4b0e-8a33-db3aaaa81514 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:51.375484 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-b07f758c-646d-420c-9eb2-6e8aa9529e39 req-1bcb015f-3291-4b0e-8a33-db3aaaa81514 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:51.390097 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-b07f758c-646d-420c-9eb2-6e8aa9529e39 req-1bcb015f-3291-4b0e-8a33-db3aaaa81514 service nova] Creating event network-changed:5c65da57-0904-4a32-9c5a-d379b5f6e7cf for instance 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 on n-h1-856895-1 Sep 10 11:39:51.396217 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-b07f758c-646d-420c-9eb2-6e8aa9529e39 req-1bcb015f-3291-4b0e-8a33-db3aaaa81514 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054754 Sep 10 11:39:51.397638 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 295/548] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:39:51.892236 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0e8ee2ef-d3b1-46f7-8220-55c3f8d76a43 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64e2df030a745de8ae7eda29d2ac30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c44e3e2920e48868e1c05f70b1d7639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:51.913982 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0e8ee2ef-d3b1-46f7-8220-55c3f8d76a43 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "GET /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7" status: 200 len: 1586 microversion: 2.1 time: 0.720523 Sep 10 11:39:51.924445 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 254/549] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:51 2022] GET /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 => generated 1586 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:51.930629 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-370f335d-c4b4-4b20-88a5-bad497029095 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:51.938158 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-370f335d-c4b4-4b20-88a5-bad497029095 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] [instance: a734916f-d369-4438-97de-3d0ae408384e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:51.953378 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-370f335d-c4b4-4b20-88a5-bad497029095 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:51.953896 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-370f335d-c4b4-4b20-88a5-bad497029095 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:51.965057 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-370f335d-c4b4-4b20-88a5-bad497029095 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:51.966588 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-370f335d-c4b4-4b20-88a5-bad497029095 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:51.967259 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-370f335d-c4b4-4b20-88a5-bad497029095 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:51.967877 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-370f335d-c4b4-4b20-88a5-bad497029095 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:51.969117 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dbadb523-98e5-4f4c-a769-7f9f7d259791 tempest-InstanceUsageAuditLogTestJSON-1072857816 tempest-InstanceUsageAuditLogTestJSON-1072857816-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:52.055367 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-dbadb523-98e5-4f4c-a769-7f9f7d259791 tempest-InstanceUsageAuditLogTestJSON-1072857816 tempest-InstanceUsageAuditLogTestJSON-1072857816-project-admin] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-10 11:39:50" status: 200 len: 318 microversion: 2.1 time: 0.656204 Sep 10 11:39:52.056223 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 296/550] 10.222.0.23 () {58 vars in 1251 bytes} [Sat Sep 10 11:39:51 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-10%2011%3A39%3A50 => generated 318 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:39:52.064482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-757000c7-7c30-4604-b5f9-f5564c219708 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:52.068142 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-757000c7-7c30-4604-b5f9-f5564c219708 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:52.093247 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-757000c7-7c30-4604-b5f9-f5564c219708 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:52.097058 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-757000c7-7c30-4604-b5f9-f5564c219708 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:52.097698 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-757000c7-7c30-4604-b5f9-f5564c219708 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:52.098682 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-757000c7-7c30-4604-b5f9-f5564c219708 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:52.102292 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-757000c7-7c30-4604-b5f9-f5564c219708 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:52.102908 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-757000c7-7c30-4604-b5f9-f5564c219708 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:52.355965 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-757000c7-7c30-4604-b5f9-f5564c219708 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:52.367413 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-757000c7-7c30-4604-b5f9-f5564c219708 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:52.370357 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-757000c7-7c30-4604-b5f9-f5564c219708 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:52.382862 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-757000c7-7c30-4604-b5f9-f5564c219708 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1411 microversion: 2.75 time: 0.325376 Sep 10 11:39:52.388163 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 297/551] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:39:52 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1411 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:39:52.393049 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6597b27d-eeb0-4fcf-8536-9892245689d4 tempest-InstanceUsageAuditLogTestJSON-1072857816 tempest-InstanceUsageAuditLogTestJSON-1072857816-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:52.427342 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6597b27d-eeb0-4fcf-8536-9892245689d4 tempest-InstanceUsageAuditLogTestJSON-1072857816 tempest-InstanceUsageAuditLogTestJSON-1072857816-project-admin] 10.222.0.23 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.037651 Sep 10 11:39:52.428682 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 298/552] 10.222.0.23 () {58 vars in 1185 bytes} [Sat Sep 10 11:39:52 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:39:52.440978 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f0b3b411-52fd-43c6-88b1-ed1a1d651548 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:52.441599 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f0b3b411-52fd-43c6-88b1-ed1a1d651548 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: a21897bf-57b5-43df-b83e-0fe0461a589b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:52.461554 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f0b3b411-52fd-43c6-88b1-ed1a1d651548 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:52.462080 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f0b3b411-52fd-43c6-88b1-ed1a1d651548 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:52.462636 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f0b3b411-52fd-43c6-88b1-ed1a1d651548 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:52.463395 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f0b3b411-52fd-43c6-88b1-ed1a1d651548 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:52.463856 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f0b3b411-52fd-43c6-88b1-ed1a1d651548 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:52.464283 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f0b3b411-52fd-43c6-88b1-ed1a1d651548 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:52.820786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-370f335d-c4b4-4b20-88a5-bad497029095 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb907e8146dc42fc9cc47ff41a424503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f5d40e4bab429cb080f76a3ed3ee9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:52.829518 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-370f335d-c4b4-4b20-88a5-bad497029095 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] 10.222.0.23 "GET /compute/v2.1/servers/a734916f-d369-4438-97de-3d0ae408384e" status: 200 len: 1314 microversion: 2.1 time: 0.902817 Sep 10 11:39:52.836584 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 255/553] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:51 2022] GET /compute/v2.1/servers/a734916f-d369-4438-97de-3d0ae408384e => generated 1314 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:53.104657 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f0b3b411-52fd-43c6-88b1-ed1a1d651548 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:53.122356 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f0b3b411-52fd-43c6-88b1-ed1a1d651548 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b" status: 200 len: 1493 microversion: 2.1 time: 0.692419 Sep 10 11:39:53.127046 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 299/554] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:52 2022] GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b => generated 1493 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:53.149292 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fef878dc-4dec-4c37-b2de-3030acb22d14 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:53.150028 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fef878dc-4dec-4c37-b2de-3030acb22d14 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] [instance: a21897bf-57b5-43df-b83e-0fe0461a589b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:53.156367 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fef878dc-4dec-4c37-b2de-3030acb22d14 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:53.156986 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fef878dc-4dec-4c37-b2de-3030acb22d14 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:53.157838 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fef878dc-4dec-4c37-b2de-3030acb22d14 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:53.159539 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fef878dc-4dec-4c37-b2de-3030acb22d14 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:53.160201 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fef878dc-4dec-4c37-b2de-3030acb22d14 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:53.160828 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fef878dc-4dec-4c37-b2de-3030acb22d14 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:53.410258 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ffa92ce3-0e27-4ece-92f2-6fc4c91a1812 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:53.410875 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ffa92ce3-0e27-4ece-92f2-6fc4c91a1812 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:53.425008 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ffa92ce3-0e27-4ece-92f2-6fc4c91a1812 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:53.425508 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ffa92ce3-0e27-4ece-92f2-6fc4c91a1812 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:53.428123 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ffa92ce3-0e27-4ece-92f2-6fc4c91a1812 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:53.429112 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ffa92ce3-0e27-4ece-92f2-6fc4c91a1812 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:53.429802 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ffa92ce3-0e27-4ece-92f2-6fc4c91a1812 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:53.430797 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ffa92ce3-0e27-4ece-92f2-6fc4c91a1812 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:53.630654 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ffa92ce3-0e27-4ece-92f2-6fc4c91a1812 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:53.635874 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fef878dc-4dec-4c37-b2de-3030acb22d14 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b" status: 200 len: 1644 microversion: 2.1 time: 0.485710 Sep 10 11:39:53.647275 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 256/555] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:53 2022] GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b => generated 1644 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:53.647472 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ffa92ce3-0e27-4ece-92f2-6fc4c91a1812 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:53.647472 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ffa92ce3-0e27-4ece-92f2-6fc4c91a1812 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:53.661375 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ffa92ce3-0e27-4ece-92f2-6fc4c91a1812 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1417 microversion: 2.75 time: 0.255056 Sep 10 11:39:53.663664 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-009c059a-a193-4906-8b62-8de94140f118 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:53.664182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-009c059a-a193-4906-8b62-8de94140f118 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] [instance: a21897bf-57b5-43df-b83e-0fe0461a589b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:53.667626 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 300/556] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:39:53 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1417 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:39:53.677244 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-009c059a-a193-4906-8b62-8de94140f118 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:53.679273 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-009c059a-a193-4906-8b62-8de94140f118 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:53.679754 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-009c059a-a193-4906-8b62-8de94140f118 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:53.680490 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-009c059a-a193-4906-8b62-8de94140f118 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:53.685268 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-009c059a-a193-4906-8b62-8de94140f118 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:53.685742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-009c059a-a193-4906-8b62-8de94140f118 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:53.863915 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-882d2089-f39a-478b-adc8-1deda7993f96 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:53.865028 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-882d2089-f39a-478b-adc8-1deda7993f96 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] [instance: a734916f-d369-4438-97de-3d0ae408384e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:53.885838 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-882d2089-f39a-478b-adc8-1deda7993f96 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:53.886756 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-882d2089-f39a-478b-adc8-1deda7993f96 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:53.904640 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-882d2089-f39a-478b-adc8-1deda7993f96 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:53.905932 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-882d2089-f39a-478b-adc8-1deda7993f96 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:53.906678 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-882d2089-f39a-478b-adc8-1deda7993f96 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:53.908066 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-882d2089-f39a-478b-adc8-1deda7993f96 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:53.975448 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-009c059a-a193-4906-8b62-8de94140f118 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b" status: 200 len: 1644 microversion: 2.1 time: 0.316729 Sep 10 11:39:53.976050 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 257/557] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:53 2022] GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b => generated 1644 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:53.998910 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7167f41d-d1b8-4103-84bb-69924e6b422e tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:54.005064 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7167f41d-d1b8-4103-84bb-69924e6b422e tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:54.005909 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7167f41d-d1b8-4103-84bb-69924e6b422e tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:54.006549 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7167f41d-d1b8-4103-84bb-69924e6b422e tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:54.007670 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7167f41d-d1b8-4103-84bb-69924e6b422e tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:54.008459 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7167f41d-d1b8-4103-84bb-69924e6b422e tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:54.009440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7167f41d-d1b8-4103-84bb-69924e6b422e tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:54.115817 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7167f41d-d1b8-4103-84bb-69924e6b422e tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.119736 Sep 10 11:39:54.130749 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 258/558] 10.222.0.23 () {58 vars in 1176 bytes} [Sat Sep 10 11:39:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:39:54.142541 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9a076e31-914f-4a68-9c55-11b67f469a5f tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:54.146339 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9a076e31-914f-4a68-9c55-11b67f469a5f tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] [instance: a21897bf-57b5-43df-b83e-0fe0461a589b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:54.159457 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9a076e31-914f-4a68-9c55-11b67f469a5f tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:54.165849 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9a076e31-914f-4a68-9c55-11b67f469a5f tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:54.167580 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9a076e31-914f-4a68-9c55-11b67f469a5f tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:54.170701 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9a076e31-914f-4a68-9c55-11b67f469a5f tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:54.173281 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9a076e31-914f-4a68-9c55-11b67f469a5f tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:54.175116 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9a076e31-914f-4a68-9c55-11b67f469a5f tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:54.278331 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-882d2089-f39a-478b-adc8-1deda7993f96 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb907e8146dc42fc9cc47ff41a424503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f5d40e4bab429cb080f76a3ed3ee9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:54.286778 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=100 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:39:54.290199 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-882d2089-f39a-478b-adc8-1deda7993f96 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] 10.222.0.23 "GET /compute/v2.1/servers/a734916f-d369-4438-97de-3d0ae408384e" status: 200 len: 1314 microversion: 2.1 time: 0.430000 Sep 10 11:39:54.290875 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 301/559] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:53 2022] GET /compute/v2.1/servers/a734916f-d369-4438-97de-3d0ae408384e => generated 1314 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:54.364399 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9a076e31-914f-4a68-9c55-11b67f469a5f tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b/action" status: 202 len: 0 microversion: 2.1 time: 0.231099 Sep 10 11:39:54.371045 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 259/560] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:39:54 2022] POST /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:39:54.374570 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9c8091f4-4e24-47b0-a5a3-16bf442a857c tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:54.376249 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9c8091f4-4e24-47b0-a5a3-16bf442a857c tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] [instance: a21897bf-57b5-43df-b83e-0fe0461a589b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:54.387975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c8091f4-4e24-47b0-a5a3-16bf442a857c tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:54.390082 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c8091f4-4e24-47b0-a5a3-16bf442a857c tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:54.391016 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c8091f4-4e24-47b0-a5a3-16bf442a857c tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:54.393550 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c8091f4-4e24-47b0-a5a3-16bf442a857c tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:54.395336 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c8091f4-4e24-47b0-a5a3-16bf442a857c tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:54.398963 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c8091f4-4e24-47b0-a5a3-16bf442a857c tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:54.697501 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-af52efa0-57a1-4bba-8693-3e2c1693af16 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:54.698252 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-af52efa0-57a1-4bba-8693-3e2c1693af16 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:54.713725 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-af52efa0-57a1-4bba-8693-3e2c1693af16 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:54.714235 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-af52efa0-57a1-4bba-8693-3e2c1693af16 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:54.714683 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-af52efa0-57a1-4bba-8693-3e2c1693af16 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:54.715437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-af52efa0-57a1-4bba-8693-3e2c1693af16 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:54.715902 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-af52efa0-57a1-4bba-8693-3e2c1693af16 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:54.716332 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-af52efa0-57a1-4bba-8693-3e2c1693af16 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:54.795818 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9c8091f4-4e24-47b0-a5a3-16bf442a857c tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b" status: 200 len: 1649 microversion: 2.1 time: 0.425115 Sep 10 11:39:54.811539 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 302/561] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:54 2022] GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b => generated 1649 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:39:54.915706 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-af52efa0-57a1-4bba-8693-3e2c1693af16 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:54.928402 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-af52efa0-57a1-4bba-8693-3e2c1693af16 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:54.930799 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-af52efa0-57a1-4bba-8693-3e2c1693af16 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:54.938508 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-af52efa0-57a1-4bba-8693-3e2c1693af16 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1417 microversion: 2.75 time: 0.249547 Sep 10 11:39:54.939871 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 260/562] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:39:54 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1417 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:39:55.316241 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2624a376-a511-4af0-9a17-03c434970437 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:55.317159 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2624a376-a511-4af0-9a17-03c434970437 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] [instance: a734916f-d369-4438-97de-3d0ae408384e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:55.329427 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2624a376-a511-4af0-9a17-03c434970437 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:55.332492 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2624a376-a511-4af0-9a17-03c434970437 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:55.333220 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2624a376-a511-4af0-9a17-03c434970437 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:55.335588 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2624a376-a511-4af0-9a17-03c434970437 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:55.336176 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2624a376-a511-4af0-9a17-03c434970437 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:55.336917 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2624a376-a511-4af0-9a17-03c434970437 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:55.667742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2624a376-a511-4af0-9a17-03c434970437 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb907e8146dc42fc9cc47ff41a424503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f5d40e4bab429cb080f76a3ed3ee9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:55.678800 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2624a376-a511-4af0-9a17-03c434970437 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] 10.222.0.23 "GET /compute/v2.1/servers/a734916f-d369-4438-97de-3d0ae408384e" status: 200 len: 1314 microversion: 2.1 time: 0.369220 Sep 10 11:39:55.691709 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 261/563] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:55 2022] GET /compute/v2.1/servers/a734916f-d369-4438-97de-3d0ae408384e => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:39:55.708397 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-334c3c22-ffcb-46b8-abfb-052fa2f3efb6 req-3c873d5c-71a4-4930-9429-a2a46cdf564e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a734916f-d369-4438-97de-3d0ae408384e", "name": "network-vif-plugged", "status": "completed", "tag": "8ec1c9d9-f1a5-4b41-8a35-5e11629ee03b"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:55.741106 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-334c3c22-ffcb-46b8-abfb-052fa2f3efb6 req-3c873d5c-71a4-4930-9429-a2a46cdf564e service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:55.742112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-334c3c22-ffcb-46b8-abfb-052fa2f3efb6 req-3c873d5c-71a4-4930-9429-a2a46cdf564e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:55.742983 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-334c3c22-ffcb-46b8-abfb-052fa2f3efb6 req-3c873d5c-71a4-4930-9429-a2a46cdf564e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:55.763444 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-334c3c22-ffcb-46b8-abfb-052fa2f3efb6 req-3c873d5c-71a4-4930-9429-a2a46cdf564e service nova] Creating event network-vif-plugged:8ec1c9d9-f1a5-4b41-8a35-5e11629ee03b for instance a734916f-d369-4438-97de-3d0ae408384e on n-h2-856895-1 Sep 10 11:39:55.773886 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-334c3c22-ffcb-46b8-abfb-052fa2f3efb6 req-3c873d5c-71a4-4930-9429-a2a46cdf564e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080570 Sep 10 11:39:55.776690 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5d7586f9-44a8-46d4-9c5e-5ba53149c5f9 tempest-HypervisorAdminUnderV252Test-120830565 tempest-HypervisorAdminUnderV252Test-120830565-project-admin] Calling method '.version_select at 0x7f4073f37f70>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:55.778354 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5d7586f9-44a8-46d4-9c5e-5ba53149c5f9 tempest-HypervisorAdminUnderV252Test-120830565 tempest-HypervisorAdminUnderV252Test-120830565-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:55.778909 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5d7586f9-44a8-46d4-9c5e-5ba53149c5f9 tempest-HypervisorAdminUnderV252Test-120830565 tempest-HypervisorAdminUnderV252Test-120830565-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:55.780912 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5d7586f9-44a8-46d4-9c5e-5ba53149c5f9 tempest-HypervisorAdminUnderV252Test-120830565 tempest-HypervisorAdminUnderV252Test-120830565-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:55.800303 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 262/564] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:39:55.807991 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5d7586f9-44a8-46d4-9c5e-5ba53149c5f9 tempest-HypervisorAdminUnderV252Test-120830565 tempest-HypervisorAdminUnderV252Test-120830565-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:55.808689 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5d7586f9-44a8-46d4-9c5e-5ba53149c5f9 tempest-HypervisorAdminUnderV252Test-120830565 tempest-HypervisorAdminUnderV252Test-120830565-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:55.808944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5d7586f9-44a8-46d4-9c5e-5ba53149c5f9 tempest-HypervisorAdminUnderV252Test-120830565 tempest-HypervisorAdminUnderV252Test-120830565-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:55.823629 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4a0fc707-d5a6-4fd5-8fe7-f0b5a5e5bb54 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:55.828781 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4a0fc707-d5a6-4fd5-8fe7-f0b5a5e5bb54 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] [instance: a21897bf-57b5-43df-b83e-0fe0461a589b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:55.837365 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5d7586f9-44a8-46d4-9c5e-5ba53149c5f9 tempest-HypervisorAdminUnderV252Test-120830565 tempest-HypervisorAdminUnderV252Test-120830565-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:55.838095 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5d7586f9-44a8-46d4-9c5e-5ba53149c5f9 tempest-HypervisorAdminUnderV252Test-120830565 tempest-HypervisorAdminUnderV252Test-120830565-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:55.838686 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5d7586f9-44a8-46d4-9c5e-5ba53149c5f9 tempest-HypervisorAdminUnderV252Test-120830565 tempest-HypervisorAdminUnderV252Test-120830565-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:55.847439 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a0fc707-d5a6-4fd5-8fe7-f0b5a5e5bb54 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:55.847928 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a0fc707-d5a6-4fd5-8fe7-f0b5a5e5bb54 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:55.849505 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a0fc707-d5a6-4fd5-8fe7-f0b5a5e5bb54 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:55.853416 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a0fc707-d5a6-4fd5-8fe7-f0b5a5e5bb54 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:55.854118 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a0fc707-d5a6-4fd5-8fe7-f0b5a5e5bb54 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:55.855532 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5d7586f9-44a8-46d4-9c5e-5ba53149c5f9 tempest-HypervisorAdminUnderV252Test-120830565 tempest-HypervisorAdminUnderV252Test-120830565-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.554560 Sep 10 11:39:55.856158 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a0fc707-d5a6-4fd5-8fe7-f0b5a5e5bb54 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:55.869359 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 303/565] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:39:55 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:39:55.875652 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1914a92e-8e23-4a1e-845e-b6fea3688ce1 tempest-HypervisorAdminUnderV252Test-120830565 tempest-HypervisorAdminUnderV252Test-120830565-project-admin] Calling method '.version_select at 0x7f4073ffc280>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:55.880361 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1914a92e-8e23-4a1e-845e-b6fea3688ce1 tempest-HypervisorAdminUnderV252Test-120830565 tempest-HypervisorAdminUnderV252Test-120830565-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:55.880836 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1914a92e-8e23-4a1e-845e-b6fea3688ce1 tempest-HypervisorAdminUnderV252Test-120830565 tempest-HypervisorAdminUnderV252Test-120830565-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:55.881320 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1914a92e-8e23-4a1e-845e-b6fea3688ce1 tempest-HypervisorAdminUnderV252Test-120830565 tempest-HypervisorAdminUnderV252Test-120830565-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:55.915771 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1914a92e-8e23-4a1e-845e-b6fea3688ce1 tempest-HypervisorAdminUnderV252Test-120830565 tempest-HypervisorAdminUnderV252Test-120830565-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:55.916276 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1914a92e-8e23-4a1e-845e-b6fea3688ce1 tempest-HypervisorAdminUnderV252Test-120830565 tempest-HypervisorAdminUnderV252Test-120830565-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:55.916711 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1914a92e-8e23-4a1e-845e-b6fea3688ce1 tempest-HypervisorAdminUnderV252Test-120830565 tempest-HypervisorAdminUnderV252Test-120830565-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:55.958167 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:39:55.974072 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1914a92e-8e23-4a1e-845e-b6fea3688ce1 tempest-HypervisorAdminUnderV252Test-120830565 tempest-HypervisorAdminUnderV252Test-120830565-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:55.974561 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1914a92e-8e23-4a1e-845e-b6fea3688ce1 tempest-HypervisorAdminUnderV252Test-120830565 tempest-HypervisorAdminUnderV252Test-120830565-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:55.975441 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1914a92e-8e23-4a1e-845e-b6fea3688ce1 tempest-HypervisorAdminUnderV252Test-120830565 tempest-HypervisorAdminUnderV252Test-120830565-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:55.988145 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1914a92e-8e23-4a1e-845e-b6fea3688ce1 tempest-HypervisorAdminUnderV252Test-120830565 tempest-HypervisorAdminUnderV252Test-120830565-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/n-h2-856895-1/servers" status: 200 len: 275 microversion: 2.1 time: 0.117200 Sep 10 11:39:55.996604 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 304/566] 10.222.0.23 () {58 vars in 1212 bytes} [Sat Sep 10 11:39:55 2022] GET /compute/v2.1/os-hypervisors/n-h2-856895-1/servers => generated 275 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:39:56.003466 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-78387742-2d4a-471e-8310-c6b3e25c8b7a tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:56.004298 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-78387742-2d4a-471e-8310-c6b3e25c8b7a tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:56.011783 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-78387742-2d4a-471e-8310-c6b3e25c8b7a tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:56.012425 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-78387742-2d4a-471e-8310-c6b3e25c8b7a tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:56.013013 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-78387742-2d4a-471e-8310-c6b3e25c8b7a tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:56.013857 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-78387742-2d4a-471e-8310-c6b3e25c8b7a tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:56.014624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-78387742-2d4a-471e-8310-c6b3e25c8b7a tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:56.015532 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-78387742-2d4a-471e-8310-c6b3e25c8b7a tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:56.126380 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-78387742-2d4a-471e-8310-c6b3e25c8b7a tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:56.149942 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-78387742-2d4a-471e-8310-c6b3e25c8b7a tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:56.152129 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-78387742-2d4a-471e-8310-c6b3e25c8b7a tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:56.158088 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-78387742-2d4a-471e-8310-c6b3e25c8b7a tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1417 microversion: 2.75 time: 0.164160 Sep 10 11:39:56.159028 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 305/567] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:39:55 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1417 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:39:56.166328 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8a0710a1-618c-49ec-82e8-65e5d3e35d4c tempest-HypervisorAdminUnderV252Test-120830565 tempest-HypervisorAdminUnderV252Test-120830565-project-admin] Calling method '.version_select at 0x7f40739e94c0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:56.168404 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a0710a1-618c-49ec-82e8-65e5d3e35d4c tempest-HypervisorAdminUnderV252Test-120830565 tempest-HypervisorAdminUnderV252Test-120830565-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:56.169139 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a0710a1-618c-49ec-82e8-65e5d3e35d4c tempest-HypervisorAdminUnderV252Test-120830565 tempest-HypervisorAdminUnderV252Test-120830565-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:56.169801 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a0710a1-618c-49ec-82e8-65e5d3e35d4c tempest-HypervisorAdminUnderV252Test-120830565 tempest-HypervisorAdminUnderV252Test-120830565-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:56.176286 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4a0fc707-d5a6-4fd5-8fe7-f0b5a5e5bb54 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b" status: 200 len: 1629 microversion: 2.1 time: 0.359481 Sep 10 11:39:56.182197 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 263/568] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:55 2022] GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b => generated 1629 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:56.191645 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a0710a1-618c-49ec-82e8-65e5d3e35d4c tempest-HypervisorAdminUnderV252Test-120830565 tempest-HypervisorAdminUnderV252Test-120830565-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:56.192224 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a0710a1-618c-49ec-82e8-65e5d3e35d4c tempest-HypervisorAdminUnderV252Test-120830565 tempest-HypervisorAdminUnderV252Test-120830565-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:56.192885 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a0710a1-618c-49ec-82e8-65e5d3e35d4c tempest-HypervisorAdminUnderV252Test-120830565 tempest-HypervisorAdminUnderV252Test-120830565-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:56.205542 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2c7c5d52-8c88-4542-8c98-ec4a4ce638a2 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-856895-1", "block_migration": true, "disk_over_commit": false}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:56.208322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2c7c5d52-8c88-4542-8c98-ec4a4ce638a2 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] [instance: a21897bf-57b5-43df-b83e-0fe0461a589b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:56.226437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c7c5d52-8c88-4542-8c98-ec4a4ce638a2 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:56.227853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c7c5d52-8c88-4542-8c98-ec4a4ce638a2 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:56.228322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c7c5d52-8c88-4542-8c98-ec4a4ce638a2 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:56.229722 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c7c5d52-8c88-4542-8c98-ec4a4ce638a2 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:56.233208 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c7c5d52-8c88-4542-8c98-ec4a4ce638a2 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:56.234588 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c7c5d52-8c88-4542-8c98-ec4a4ce638a2 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:56.241536 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a0710a1-618c-49ec-82e8-65e5d3e35d4c tempest-HypervisorAdminUnderV252Test-120830565 tempest-HypervisorAdminUnderV252Test-120830565-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:56.241536 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a0710a1-618c-49ec-82e8-65e5d3e35d4c tempest-HypervisorAdminUnderV252Test-120830565 tempest-HypervisorAdminUnderV252Test-120830565-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:56.241536 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a0710a1-618c-49ec-82e8-65e5d3e35d4c tempest-HypervisorAdminUnderV252Test-120830565 tempest-HypervisorAdminUnderV252Test-120830565-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:56.248040 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8a0710a1-618c-49ec-82e8-65e5d3e35d4c tempest-HypervisorAdminUnderV252Test-120830565 tempest-HypervisorAdminUnderV252Test-120830565-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.087170 Sep 10 11:39:56.248645 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 306/569] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:39:56 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:39:56.260516 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dcfded2f-5a45-4cd9-9ff5-46e059f9f593 tempest-HypervisorAdminUnderV252Test-120830565 tempest-HypervisorAdminUnderV252Test-120830565-project-admin] Calling method '.version_select at 0x7f4073a7bd30>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:56.262465 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dcfded2f-5a45-4cd9-9ff5-46e059f9f593 tempest-HypervisorAdminUnderV252Test-120830565 tempest-HypervisorAdminUnderV252Test-120830565-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:56.263438 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dcfded2f-5a45-4cd9-9ff5-46e059f9f593 tempest-HypervisorAdminUnderV252Test-120830565 tempest-HypervisorAdminUnderV252Test-120830565-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:56.264224 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dcfded2f-5a45-4cd9-9ff5-46e059f9f593 tempest-HypervisorAdminUnderV252Test-120830565 tempest-HypervisorAdminUnderV252Test-120830565-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:56.271650 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-2c7c5d52-8c88-4542-8c98-ec4a4ce638a2 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lazy-loading 'flavor' on Instance uuid a21897bf-57b5-43df-b83e-0fe0461a589b {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:39:56.279287 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dcfded2f-5a45-4cd9-9ff5-46e059f9f593 tempest-HypervisorAdminUnderV252Test-120830565 tempest-HypervisorAdminUnderV252Test-120830565-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:56.279864 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dcfded2f-5a45-4cd9-9ff5-46e059f9f593 tempest-HypervisorAdminUnderV252Test-120830565 tempest-HypervisorAdminUnderV252Test-120830565-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:56.280403 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dcfded2f-5a45-4cd9-9ff5-46e059f9f593 tempest-HypervisorAdminUnderV252Test-120830565 tempest-HypervisorAdminUnderV252Test-120830565-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:56.289343 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2c7c5d52-8c88-4542-8c98-ec4a4ce638a2 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] [instance: a21897bf-57b5-43df-b83e-0fe0461a589b] Going to try to live migrate instance to n-h1-856895-1 {{(pid=128777) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 10 11:39:56.290830 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-dcfded2f-5a45-4cd9-9ff5-46e059f9f593 tempest-HypervisorAdminUnderV252Test-120830565 tempest-HypervisorAdminUnderV252Test-120830565-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors/n-h2-856895-1/search" status: 200 len: 104 microversion: 2.1 time: 0.034913 Sep 10 11:39:56.291854 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 307/570] 10.222.0.23 () {58 vars in 1209 bytes} [Sat Sep 10 11:39:56 2022] GET /compute/v2.1/os-hypervisors/n-h2-856895-1/search => generated 104 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:39:56.706788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-990d9fac-3c2f-4708-8308-9829d5de8d80 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:56.707438 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-990d9fac-3c2f-4708-8308-9829d5de8d80 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] [instance: a734916f-d369-4438-97de-3d0ae408384e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:56.718518 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-990d9fac-3c2f-4708-8308-9829d5de8d80 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:56.718518 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-990d9fac-3c2f-4708-8308-9829d5de8d80 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:56.718518 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-990d9fac-3c2f-4708-8308-9829d5de8d80 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:56.725933 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-990d9fac-3c2f-4708-8308-9829d5de8d80 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:56.726441 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-990d9fac-3c2f-4708-8308-9829d5de8d80 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:56.727095 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-990d9fac-3c2f-4708-8308-9829d5de8d80 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:57.055610 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-990d9fac-3c2f-4708-8308-9829d5de8d80 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb907e8146dc42fc9cc47ff41a424503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f5d40e4bab429cb080f76a3ed3ee9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:57.065590 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-990d9fac-3c2f-4708-8308-9829d5de8d80 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] 10.222.0.23 "GET /compute/v2.1/servers/a734916f-d369-4438-97de-3d0ae408384e" status: 200 len: 1314 microversion: 2.1 time: 0.363912 Sep 10 11:39:57.070556 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 308/571] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:56 2022] GET /compute/v2.1/servers/a734916f-d369-4438-97de-3d0ae408384e => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:39:57.186731 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-941fbefc-95cd-4537-8c9d-edf637c2a925 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:57.187369 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-941fbefc-95cd-4537-8c9d-edf637c2a925 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:57.194829 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-941fbefc-95cd-4537-8c9d-edf637c2a925 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:57.195369 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-941fbefc-95cd-4537-8c9d-edf637c2a925 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:57.195805 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-941fbefc-95cd-4537-8c9d-edf637c2a925 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:57.202397 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-941fbefc-95cd-4537-8c9d-edf637c2a925 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:57.202913 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-941fbefc-95cd-4537-8c9d-edf637c2a925 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:57.203566 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-941fbefc-95cd-4537-8c9d-edf637c2a925 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:57.750293 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-941fbefc-95cd-4537-8c9d-edf637c2a925 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:57.764424 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-941fbefc-95cd-4537-8c9d-edf637c2a925 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:57.766529 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-941fbefc-95cd-4537-8c9d-edf637c2a925 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:57.777018 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-941fbefc-95cd-4537-8c9d-edf637c2a925 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1417 microversion: 2.75 time: 0.593533 Sep 10 11:39:57.778144 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 309/572] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:39:57 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1417 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:39:58.202684 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-37e8c5ba-fc18-4d41-a916-3424c8013211 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-150086418", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:39:58.283551 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-37e8c5ba-fc18-4d41-a916-3424c8013211 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] validate_networks() for None {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:39:58.533208 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-37e8c5ba-fc18-4d41-a916-3424c8013211 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:39:58.533885 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-37e8c5ba-fc18-4d41-a916-3424c8013211 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:39:58.535033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-37e8c5ba-fc18-4d41-a916-3424c8013211 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:39:58.535697 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-37e8c5ba-fc18-4d41-a916-3424c8013211 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:39:58.536328 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-37e8c5ba-fc18-4d41-a916-3424c8013211 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:39:58.546973 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-37e8c5ba-fc18-4d41-a916-3424c8013211 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:58.548428 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-37e8c5ba-fc18-4d41-a916-3424c8013211 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:58.549488 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-37e8c5ba-fc18-4d41-a916-3424c8013211 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:58.550499 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-37e8c5ba-fc18-4d41-a916-3424c8013211 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:58.552586 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-37e8c5ba-fc18-4d41-a916-3424c8013211 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:58.553385 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-37e8c5ba-fc18-4d41-a916-3424c8013211 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:58.576011 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-37e8c5ba-fc18-4d41-a916-3424c8013211 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Getting quotas for project d5765e50afa045569700eab4616a6a43. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:39:58.583711 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-37e8c5ba-fc18-4d41-a916-3424c8013211 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Getting quotas for user cf661b110ecc4f36b795a980d29f312a and project d5765e50afa045569700eab4616a6a43. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:39:58.598218 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-37e8c5ba-fc18-4d41-a916-3424c8013211 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:39:58.600914 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-37e8c5ba-fc18-4d41-a916-3424c8013211 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] [instance: 4c806b91-1302-494f-b4eb-a0b7ba04baf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:39:58.670412 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-37e8c5ba-fc18-4d41-a916-3424c8013211 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.890932 Sep 10 11:39:58.671853 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 310/573] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:39:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:39:58.677052 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a55a3668-dcff-4507-8147-36580b926311 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:58.677818 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a55a3668-dcff-4507-8147-36580b926311 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] [instance: a734916f-d369-4438-97de-3d0ae408384e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:58.685330 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a55a3668-dcff-4507-8147-36580b926311 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:58.686645 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a55a3668-dcff-4507-8147-36580b926311 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:58.687434 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a55a3668-dcff-4507-8147-36580b926311 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:58.689054 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a55a3668-dcff-4507-8147-36580b926311 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:58.690467 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a55a3668-dcff-4507-8147-36580b926311 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:58.691116 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a55a3668-dcff-4507-8147-36580b926311 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:58.957337 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a55a3668-dcff-4507-8147-36580b926311 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb907e8146dc42fc9cc47ff41a424503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f5d40e4bab429cb080f76a3ed3ee9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:58.966265 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a55a3668-dcff-4507-8147-36580b926311 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] 10.222.0.23 "GET /compute/v2.1/servers/a734916f-d369-4438-97de-3d0ae408384e" status: 200 len: 1464 microversion: 2.1 time: 0.293080 Sep 10 11:39:58.967409 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 311/574] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:58 2022] GET /compute/v2.1/servers/a734916f-d369-4438-97de-3d0ae408384e => generated 1464 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:59.401685 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8bf5e874-6db4-4474-9297-474d0e7150f3 tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:59.405394 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8bf5e874-6db4-4474-9297-474d0e7150f3 tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:59.406550 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8bf5e874-6db4-4474-9297-474d0e7150f3 tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:59.407798 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8bf5e874-6db4-4474-9297-474d0e7150f3 tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:59.408925 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8bf5e874-6db4-4474-9297-474d0e7150f3 tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:59.409601 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8bf5e874-6db4-4474-9297-474d0e7150f3 tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:59.410230 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8bf5e874-6db4-4474-9297-474d0e7150f3 tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:59.446315 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8bf5e874-6db4-4474-9297-474d0e7150f3 tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.477623 Sep 10 11:39:59.446915 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 312/575] 10.222.0.23 () {58 vars in 1137 bytes} [Sat Sep 10 11:39:58 2022] GET /compute/v2.1/os-services => generated 944 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:39:59.462459 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1be8c9f5-c4bf-4a25-a196-0629bacc216e tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:59.463473 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1be8c9f5-c4bf-4a25-a196-0629bacc216e tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] [instance: 4c806b91-1302-494f-b4eb-a0b7ba04baf4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:59.471076 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1be8c9f5-c4bf-4a25-a196-0629bacc216e tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:59.471898 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1be8c9f5-c4bf-4a25-a196-0629bacc216e tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:59.472595 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1be8c9f5-c4bf-4a25-a196-0629bacc216e tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:59.473525 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1be8c9f5-c4bf-4a25-a196-0629bacc216e tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:59.474207 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1be8c9f5-c4bf-4a25-a196-0629bacc216e tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:59.474871 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1be8c9f5-c4bf-4a25-a196-0629bacc216e tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:59.486625 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2c7c5d52-8c88-4542-8c98-ec4a4ce638a2 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b/action" status: 202 len: 0 microversion: 2.1 time: 3.286019 Sep 10 11:39:59.488232 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 264/576] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:39:56 2022] POST /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b/action => generated 0 bytes in 3288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 11:39:59.496929 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9c50e361-9118-4f99-873d-ad465abda8b8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:59.500343 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9c50e361-9118-4f99-873d-ad465abda8b8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:59.526962 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9c50e361-9118-4f99-873d-ad465abda8b8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:59.534476 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9c50e361-9118-4f99-873d-ad465abda8b8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:59.535404 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9c50e361-9118-4f99-873d-ad465abda8b8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:59.538355 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9c50e361-9118-4f99-873d-ad465abda8b8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:59.540259 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9c50e361-9118-4f99-873d-ad465abda8b8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:59.544792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9c50e361-9118-4f99-873d-ad465abda8b8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:59.549525 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1be8c9f5-c4bf-4a25-a196-0629bacc216e tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf661b110ecc4f36b795a980d29f312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5765e50afa045569700eab4616a6a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:59.570065 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1be8c9f5-c4bf-4a25-a196-0629bacc216e tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/servers/4c806b91-1302-494f-b4eb-a0b7ba04baf4" status: 200 len: 1220 microversion: 2.1 time: 0.121811 Sep 10 11:39:59.572683 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 313/577] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:59 2022] GET /compute/v2.1/servers/4c806b91-1302-494f-b4eb-a0b7ba04baf4 => generated 1220 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:39:59.775659 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9c50e361-9118-4f99-873d-ad465abda8b8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:59.787115 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9c50e361-9118-4f99-873d-ad465abda8b8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:59.789890 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9c50e361-9118-4f99-873d-ad465abda8b8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:39:59.804231 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9c50e361-9118-4f99-873d-ad465abda8b8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1438 microversion: 2.75 time: 0.314262 Sep 10 11:39:59.805354 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 265/578] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:39:59 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1438 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:39:59.813020 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b6cf0173-7ed2-48c6-bd6f-c71e2dec8a31 tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:59.833628 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b6cf0173-7ed2-48c6-bd6f-c71e2dec8a31 tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:59.835552 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b6cf0173-7ed2-48c6-bd6f-c71e2dec8a31 tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:59.836614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b6cf0173-7ed2-48c6-bd6f-c71e2dec8a31 tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:59.838399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b6cf0173-7ed2-48c6-bd6f-c71e2dec8a31 tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:59.840883 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b6cf0173-7ed2-48c6-bd6f-c71e2dec8a31 tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:59.843697 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b6cf0173-7ed2-48c6-bd6f-c71e2dec8a31 tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:59.914398 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b6cf0173-7ed2-48c6-bd6f-c71e2dec8a31 tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.107548 Sep 10 11:39:59.915362 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 266/579] 10.222.0.23 () {58 vars in 1170 bytes} [Sat Sep 10 11:39:59 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:39:59.920660 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d1fdce10-7703-4369-9da3-5950d4de1f29 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:39:59.921794 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d1fdce10-7703-4369-9da3-5950d4de1f29 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: a21897bf-57b5-43df-b83e-0fe0461a589b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:39:59.933470 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1fdce10-7703-4369-9da3-5950d4de1f29 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:59.934153 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1fdce10-7703-4369-9da3-5950d4de1f29 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:59.934751 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1fdce10-7703-4369-9da3-5950d4de1f29 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:39:59.936635 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1fdce10-7703-4369-9da3-5950d4de1f29 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:39:59.937392 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1fdce10-7703-4369-9da3-5950d4de1f29 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:39:59.938323 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1fdce10-7703-4369-9da3-5950d4de1f29 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:00.001714 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a2039121-817f-4c52-883c-93846ffe63f4 tempest-TenantUsagesTestJSON-1248006308 tempest-TenantUsagesTestJSON-1248006308-project-admin] Calling method '.version_select at 0x7f407396e820>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:00.018887 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2039121-817f-4c52-883c-93846ffe63f4 tempest-TenantUsagesTestJSON-1248006308 tempest-TenantUsagesTestJSON-1248006308-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:00.019769 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2039121-817f-4c52-883c-93846ffe63f4 tempest-TenantUsagesTestJSON-1248006308 tempest-TenantUsagesTestJSON-1248006308-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:00.020594 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2039121-817f-4c52-883c-93846ffe63f4 tempest-TenantUsagesTestJSON-1248006308 tempest-TenantUsagesTestJSON-1248006308-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:00.048523 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2039121-817f-4c52-883c-93846ffe63f4 tempest-TenantUsagesTestJSON-1248006308 tempest-TenantUsagesTestJSON-1248006308-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:00.049267 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2039121-817f-4c52-883c-93846ffe63f4 tempest-TenantUsagesTestJSON-1248006308 tempest-TenantUsagesTestJSON-1248006308-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:00.049945 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2039121-817f-4c52-883c-93846ffe63f4 tempest-TenantUsagesTestJSON-1248006308 tempest-TenantUsagesTestJSON-1248006308-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:00.073270 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a2039121-817f-4c52-883c-93846ffe63f4 tempest-TenantUsagesTestJSON-1248006308 tempest-TenantUsagesTestJSON-1248006308-project-admin] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage/e5f5d40e4bab429cb080f76a3ed3ee9e?start=2022-09-09T11%3A39%3A58.986329&end=2022-09-11T11%3A39%3A58.986329" status: 200 len: 695 microversion: 2.1 time: 0.494989 Sep 10 11:40:00.074403 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 314/580] 10.222.0.23 () {58 vars in 1412 bytes} [Sat Sep 10 11:39:59 2022] GET /compute/v2.1/os-simple-tenant-usage/e5f5d40e4bab429cb080f76a3ed3ee9e?start=2022-09-09T11%3A39%3A58.986329&end=2022-09-11T11%3A39%3A58.986329 => generated 695 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:40:00.097243 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f1666ea2-8a97-4c78-88b7-9cd506f73e18 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:40:00.107752 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f1666ea2-8a97-4c78-88b7-9cd506f73e18 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:00.115658 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1666ea2-8a97-4c78-88b7-9cd506f73e18 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:00.116272 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1666ea2-8a97-4c78-88b7-9cd506f73e18 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:00.116813 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1666ea2-8a97-4c78-88b7-9cd506f73e18 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:00.117521 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1666ea2-8a97-4c78-88b7-9cd506f73e18 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:00.118133 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1666ea2-8a97-4c78-88b7-9cd506f73e18 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:00.118569 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1666ea2-8a97-4c78-88b7-9cd506f73e18 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:00.200072 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d1fdce10-7703-4369-9da3-5950d4de1f29 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:00.215245 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d1fdce10-7703-4369-9da3-5950d4de1f29 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b" status: 200 len: 1503 microversion: 2.1 time: 0.298210 Sep 10 11:40:00.216739 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 267/581] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:39:59 2022] GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b => generated 1503 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:00.232235 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2f8b3c0f-6c6a-4796-939c-0894630808be tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:00.256948 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-f1666ea2-8a97-4c78-88b7-9cd506f73e18 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:40:00.257748 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-f1666ea2-8a97-4c78-88b7-9cd506f73e18 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:40:00.258256 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f8b3c0f-6c6a-4796-939c-0894630808be tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:00.258870 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-f1666ea2-8a97-4c78-88b7-9cd506f73e18 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:40:00.259462 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-f1666ea2-8a97-4c78-88b7-9cd506f73e18 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:40:00.259595 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f8b3c0f-6c6a-4796-939c-0894630808be tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:00.260023 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f8b3c0f-6c6a-4796-939c-0894630808be tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:00.260354 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-f1666ea2-8a97-4c78-88b7-9cd506f73e18 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:40:00.260768 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f8b3c0f-6c6a-4796-939c-0894630808be tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:00.261224 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f8b3c0f-6c6a-4796-939c-0894630808be tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:00.261648 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f8b3c0f-6c6a-4796-939c-0894630808be tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:00.312538 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2f8b3c0f-6c6a-4796-939c-0894630808be tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.094450 Sep 10 11:40:00.314321 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 268/582] 10.222.0.23 () {58 vars in 1137 bytes} [Sat Sep 10 11:40:00 2022] GET /compute/v2.1/os-services => generated 944 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:40:00.325831 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-465eee47-c299-4973-9c66-7580558b21ba tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Calling method '.version_select at 0x7f40735913a0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:00.346591 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-465eee47-c299-4973-9c66-7580558b21ba tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:00.347837 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-465eee47-c299-4973-9c66-7580558b21ba tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:00.351715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-465eee47-c299-4973-9c66-7580558b21ba tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:00.383359 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-465eee47-c299-4973-9c66-7580558b21ba tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:00.384116 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-465eee47-c299-4973-9c66-7580558b21ba tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:00.384858 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-465eee47-c299-4973-9c66-7580558b21ba tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:00.395948 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f1666ea2-8a97-4c78-88b7-9cd506f73e18 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:00.412783 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-465eee47-c299-4973-9c66-7580558b21ba tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage/e5f5d40e4bab429cb080f76a3ed3ee9e?start=2022-09-09T11%3A39%3A58.986329&end=2022-09-11T11%3A39%3A58.986329" status: 200 len: 695 microversion: 2.1 time: 0.096597 Sep 10 11:40:00.414471 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 269/583] 10.222.0.23 () {58 vars in 1412 bytes} [Sat Sep 10 11:40:00 2022] GET /compute/v2.1/os-simple-tenant-usage/e5f5d40e4bab429cb080f76a3ed3ee9e?start=2022-09-09T11%3A39%3A58.986329&end=2022-09-11T11%3A39%3A58.986329 => generated 695 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:40:00.428091 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-19a722b3-d48f-4fe1-9456-3d3f7ed27f20 tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:00.432619 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-19a722b3-d48f-4fe1-9456-3d3f7ed27f20 tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:00.432928 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1666ea2-8a97-4c78-88b7-9cd506f73e18 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:00.433966 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-19a722b3-d48f-4fe1-9456-3d3f7ed27f20 tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:00.434332 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1666ea2-8a97-4c78-88b7-9cd506f73e18 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:00.435328 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-19a722b3-d48f-4fe1-9456-3d3f7ed27f20 tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:00.435716 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1666ea2-8a97-4c78-88b7-9cd506f73e18 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:00.436704 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-19a722b3-d48f-4fe1-9456-3d3f7ed27f20 tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:00.437703 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-19a722b3-d48f-4fe1-9456-3d3f7ed27f20 tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:00.438355 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1666ea2-8a97-4c78-88b7-9cd506f73e18 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:00.438955 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-19a722b3-d48f-4fe1-9456-3d3f7ed27f20 tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:00.439592 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1666ea2-8a97-4c78-88b7-9cd506f73e18 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:00.440705 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1666ea2-8a97-4c78-88b7-9cd506f73e18 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:00.470700 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-19a722b3-d48f-4fe1-9456-3d3f7ed27f20 tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=n-d-856895-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.053439 Sep 10 11:40:00.474033 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 270/584] 10.222.0.23 () {58 vars in 1194 bytes} [Sat Sep 10 11:40:00 2022] GET /compute/v2.1/os-services?host=n-d-856895-1&binary=xxx => generated 16 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:40:00.491299 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-db6e80d5-497d-48da-ac8b-a0132543b8f7 tempest-TenantUsagesTestJSON-1248006308 tempest-TenantUsagesTestJSON-1248006308-project-admin] Calling method '.version_select at 0x7f407369fca0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:00.503194 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db6e80d5-497d-48da-ac8b-a0132543b8f7 tempest-TenantUsagesTestJSON-1248006308 tempest-TenantUsagesTestJSON-1248006308-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:00.504125 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db6e80d5-497d-48da-ac8b-a0132543b8f7 tempest-TenantUsagesTestJSON-1248006308 tempest-TenantUsagesTestJSON-1248006308-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:00.504720 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db6e80d5-497d-48da-ac8b-a0132543b8f7 tempest-TenantUsagesTestJSON-1248006308 tempest-TenantUsagesTestJSON-1248006308-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:00.541898 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db6e80d5-497d-48da-ac8b-a0132543b8f7 tempest-TenantUsagesTestJSON-1248006308 tempest-TenantUsagesTestJSON-1248006308-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:00.542658 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db6e80d5-497d-48da-ac8b-a0132543b8f7 tempest-TenantUsagesTestJSON-1248006308 tempest-TenantUsagesTestJSON-1248006308-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:00.543466 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db6e80d5-497d-48da-ac8b-a0132543b8f7 tempest-TenantUsagesTestJSON-1248006308 tempest-TenantUsagesTestJSON-1248006308-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:00.587731 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-db6e80d5-497d-48da-ac8b-a0132543b8f7 tempest-TenantUsagesTestJSON-1248006308 tempest-TenantUsagesTestJSON-1248006308-project-admin] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-09T11%3A39%3A58.986329&end=2022-09-11T11%3A39%3A58.986329&detailed=1" status: 200 len: 6468 microversion: 2.1 time: 0.111409 Sep 10 11:40:00.588870 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 271/585] 10.222.0.23 () {58 vars in 1335 bytes} [Sat Sep 10 11:40:00 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-09T11%3A39%3A58.986329&end=2022-09-11T11%3A39%3A58.986329&detailed=1 => generated 6468 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:00.610570 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2f4dcb69-6ff4-4729-9167-9149fddb6df6 tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:00.617379 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f4dcb69-6ff4-4729-9167-9149fddb6df6 tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:00.618883 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f4dcb69-6ff4-4729-9167-9149fddb6df6 tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:00.619447 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f4dcb69-6ff4-4729-9167-9149fddb6df6 tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:00.620298 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f4dcb69-6ff4-4729-9167-9149fddb6df6 tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:00.621409 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f4dcb69-6ff4-4729-9167-9149fddb6df6 tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:00.622580 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f4dcb69-6ff4-4729-9167-9149fddb6df6 tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:00.644150 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:40:00.665832 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2f4dcb69-6ff4-4729-9167-9149fddb6df6 tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.075028 Sep 10 11:40:00.674377 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 272/586] 10.222.0.23 () {58 vars in 1137 bytes} [Sat Sep 10 11:40:00 2022] GET /compute/v2.1/os-services => generated 944 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:40:00.686041 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ce11e285-fda5-4c32-b853-7e6fd55d1813 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:00.686582 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ce11e285-fda5-4c32-b853-7e6fd55d1813 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] [instance: 4c806b91-1302-494f-b4eb-a0b7ba04baf4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:00.696182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ce11e285-fda5-4c32-b853-7e6fd55d1813 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:00.697082 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ce11e285-fda5-4c32-b853-7e6fd55d1813 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:00.697556 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ce11e285-fda5-4c32-b853-7e6fd55d1813 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:00.698872 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ce11e285-fda5-4c32-b853-7e6fd55d1813 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:00.699595 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ce11e285-fda5-4c32-b853-7e6fd55d1813 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:00.699973 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ce11e285-fda5-4c32-b853-7e6fd55d1813 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:00.721743 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f1666ea2-8a97-4c78-88b7-9cd506f73e18 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:00.736702 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f1666ea2-8a97-4c78-88b7-9cd506f73e18 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:00.738581 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f1666ea2-8a97-4c78-88b7-9cd506f73e18 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:00.754155 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f1666ea2-8a97-4c78-88b7-9cd506f73e18 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] 10.222.0.23 "POST /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f/action" status: 202 len: 1495 microversion: 2.75 time: 0.676452 Sep 10 11:40:00.755133 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 315/587] 10.222.0.23 () {62 vars in 1319 bytes} [Sat Sep 10 11:40:00 2022] POST /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f/action => generated 1495 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 10 11:40:00.765320 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-03400ad7-036c-4d84-b50f-c94fded7d6d7 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:00.765743 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-03400ad7-036c-4d84-b50f-c94fded7d6d7 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] [instance: a734916f-d369-4438-97de-3d0ae408384e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:00.788296 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-03400ad7-036c-4d84-b50f-c94fded7d6d7 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:00.788686 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-03400ad7-036c-4d84-b50f-c94fded7d6d7 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:00.789129 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-03400ad7-036c-4d84-b50f-c94fded7d6d7 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:00.789838 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-03400ad7-036c-4d84-b50f-c94fded7d6d7 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:00.790287 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-03400ad7-036c-4d84-b50f-c94fded7d6d7 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:00.790709 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-03400ad7-036c-4d84-b50f-c94fded7d6d7 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:00.835472 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ce11e285-fda5-4c32-b853-7e6fd55d1813 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf661b110ecc4f36b795a980d29f312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5765e50afa045569700eab4616a6a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:00.842569 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-03400ad7-036c-4d84-b50f-c94fded7d6d7 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] [instance: a734916f-d369-4438-97de-3d0ae408384e] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:40:00.850961 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ce11e285-fda5-4c32-b853-7e6fd55d1813 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/servers/4c806b91-1302-494f-b4eb-a0b7ba04baf4" status: 200 len: 1274 microversion: 2.1 time: 0.172342 Sep 10 11:40:00.854922 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 273/588] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:00 2022] GET /compute/v2.1/servers/4c806b91-1302-494f-b4eb-a0b7ba04baf4 => generated 1274 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:00.868732 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9cbc2481-1eb1-4652-b55c-fd32e01f4729 tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:00.879516 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9cbc2481-1eb1-4652-b55c-fd32e01f4729 tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:00.880919 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9cbc2481-1eb1-4652-b55c-fd32e01f4729 tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:00.885645 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9cbc2481-1eb1-4652-b55c-fd32e01f4729 tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:00.888640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9cbc2481-1eb1-4652-b55c-fd32e01f4729 tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:00.891590 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9cbc2481-1eb1-4652-b55c-fd32e01f4729 tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:00.892744 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9cbc2481-1eb1-4652-b55c-fd32e01f4729 tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:00.962421 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9cbc2481-1eb1-4652-b55c-fd32e01f4729 tempest-ServicesAdminNegativeTestJSON-680856011 tempest-ServicesAdminNegativeTestJSON-680856011-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.106239 Sep 10 11:40:00.966332 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 274/589] 10.222.0.23 () {58 vars in 1198 bytes} [Sat Sep 10 11:40:00 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:40:00.979467 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3bb97561-a65f-4996-b355-93ee66d86ea8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:00.982498 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3bb97561-a65f-4996-b355-93ee66d86ea8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:00.994399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3bb97561-a65f-4996-b355-93ee66d86ea8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:00.998023 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3bb97561-a65f-4996-b355-93ee66d86ea8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:00.998739 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3bb97561-a65f-4996-b355-93ee66d86ea8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:00.999591 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3bb97561-a65f-4996-b355-93ee66d86ea8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:01.002553 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3bb97561-a65f-4996-b355-93ee66d86ea8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:01.003227 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3bb97561-a65f-4996-b355-93ee66d86ea8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:01.008609 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-03400ad7-036c-4d84-b50f-c94fded7d6d7 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a734916f-d369-4438-97de-3d0ae408384e" status: 204 len: 0 microversion: 2.1 time: 0.250550 Sep 10 11:40:01.014695 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 316/590] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:40:00 2022] DELETE /compute/v2.1/servers/a734916f-d369-4438-97de-3d0ae408384e => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:40:01.137207 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3bb97561-a65f-4996-b355-93ee66d86ea8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:01.150329 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3bb97561-a65f-4996-b355-93ee66d86ea8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:01.152455 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3bb97561-a65f-4996-b355-93ee66d86ea8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:01.155338 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=8 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:40:01.160770 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3bb97561-a65f-4996-b355-93ee66d86ea8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1447 microversion: 2.75 time: 0.188112 Sep 10 11:40:01.161657 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 275/591] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:00 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1447 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:01.167047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9cccb5d7-4ce9-4582-a81d-43daeadb10e5 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:01.167873 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9cccb5d7-4ce9-4582-a81d-43daeadb10e5 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] [instance: a734916f-d369-4438-97de-3d0ae408384e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:01.174805 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9cccb5d7-4ce9-4582-a81d-43daeadb10e5 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:01.175558 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9cccb5d7-4ce9-4582-a81d-43daeadb10e5 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:01.176149 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9cccb5d7-4ce9-4582-a81d-43daeadb10e5 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:01.176997 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9cccb5d7-4ce9-4582-a81d-43daeadb10e5 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:01.177590 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9cccb5d7-4ce9-4582-a81d-43daeadb10e5 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:01.178163 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9cccb5d7-4ce9-4582-a81d-43daeadb10e5 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:01.549668 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4653158a-e84a-4ab0-941b-0cf1b8f8bd7d tempest-ServicesAdminNegativeTestJSON-2117487900 tempest-ServicesAdminNegativeTestJSON-2117487900-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:01.554244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4653158a-e84a-4ab0-941b-0cf1b8f8bd7d tempest-ServicesAdminNegativeTestJSON-2117487900 tempest-ServicesAdminNegativeTestJSON-2117487900-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'dd94ec17fefb426db428c0a0c3e5db41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53dd0ff856d045f398a37db87e7f23b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:01.556288 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4653158a-e84a-4ab0-941b-0cf1b8f8bd7d tempest-ServicesAdminNegativeTestJSON-2117487900 tempest-ServicesAdminNegativeTestJSON-2117487900-project] Request method failure captured: Sep 10 11:40:01.556288 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 10 11:40:01.556288 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:40:01.556288 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:40:01.556288 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:40:01.556288 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:40:01.556288 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:40:01.556288 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:40:01.556288 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:40:01.556288 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:40:01.556288 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHeMayHjBPRK1XpmZtDv8huuoLyk7LGDBIShGE8j3JU6me_ceL3VJlqFHtq-lVWPgFj-UYC_N6-OySTRS2oAk4iJLHsUIysPzH6fV4l7g-DKbtQI35O4krvGvB_XWeBv9zcWNViti1HCY1w-9HGqLWwxXG-XJX_i1gLSvEaRubGRjAA Sep 10 11:40:01.556288 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:40:01.556288 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:40:01.556288 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:40:01.556288 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:40:01.556288 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:40:01.556288 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:40:01.556288 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 53dd0ff856d045f398a37db87e7f23b5 Sep 10 11:40:01.556288 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-2117487900 Sep 10 11:40:01.556288 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:40:01.556288 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:40:01.557663 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/53dd0ff856d045f398a37db87e7f23b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/53dd0ff856d045f398a37db87e7f23b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_53dd0ff856d045f398a37db87e7f23b5", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/53dd0ff856d045f398a37db87e7f23b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:40:01.557663 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-2117487900 Sep 10 11:40:01.557663 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 53dd0ff856d045f398a37db87e7f23b5 Sep 10 11:40:01.557663 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-2117487900 Sep 10 11:40:01.557663 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServicesAdminNegativeTestJSON-2117487900-project Sep 10 11:40:01.557663 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:40:01.557663 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:40:01.557663 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: dd94ec17fefb426db428c0a0c3e5db41 Sep 10 11:40:01.557663 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-2117487900-project Sep 10 11:40:01.557663 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:40:01.557663 n-d-856895-1 devstack@n-api.service[128776]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 10 11:40:01.557663 n-d-856895-1 devstack@n-api.service[128776]: action_args: {} Sep 10 11:40:01.558468 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:40:01.558468 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:40:01.558468 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:40:01.558468 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:40:01.558468 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:40:01.558468 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:40:01.558468 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 11:40:01.558468 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:40:01.558468 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 11:40:01.558468 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:40:01.558468 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:40:01.558468 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:40:01.558468 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 10 11:40:01.558468 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 10 11:40:01.558468 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 11:40:01.558468 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 11:40:01.558468 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 11:40:01.558468 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 11:40:01.558468 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:40:01.559780 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:40:01.559780 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:40:01.559780 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:40:01.559780 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 11:40:01.559780 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 11:40:01.559780 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 11:40:01.559780 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 11:40:01.559780 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 11:40:01.559780 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 11:40:01.559780 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 10 11:40:01.559780 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:40:01.559780 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:40:01.559780 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:40:01.559780 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:40:01.559780 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:40:01.559780 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:40:01.559780 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 11:40:01.559780 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 11:40:01.559780 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 10 11:40:01.559780 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:40:01.562617 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4653158a-e84a-4ab0-941b-0cf1b8f8bd7d tempest-ServicesAdminNegativeTestJSON-2117487900 tempest-ServicesAdminNegativeTestJSON-2117487900-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:40:01.564424 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4653158a-e84a-4ab0-941b-0cf1b8f8bd7d tempest-ServicesAdminNegativeTestJSON-2117487900 tempest-ServicesAdminNegativeTestJSON-2117487900-project] 10.222.0.23 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.548214 Sep 10 11:40:01.565573 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 317/592] 10.222.0.23 () {58 vars in 1137 bytes} [Sat Sep 10 11:40:01 2022] GET /compute/v2.1/os-services => generated 112 bytes in 550 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:40:01.575623 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c7d90a18-a067-4fe8-9624-b08b65699a18 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:01.578180 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c7d90a18-a067-4fe8-9624-b08b65699a18 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: a21897bf-57b5-43df-b83e-0fe0461a589b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:01.585007 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9cccb5d7-4ce9-4582-a81d-43daeadb10e5 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb907e8146dc42fc9cc47ff41a424503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f5d40e4bab429cb080f76a3ed3ee9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:01.599832 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c7d90a18-a067-4fe8-9624-b08b65699a18 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:01.600753 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9cccb5d7-4ce9-4582-a81d-43daeadb10e5 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] 10.222.0.23 "GET /compute/v2.1/servers/a734916f-d369-4438-97de-3d0ae408384e" status: 200 len: 1470 microversion: 2.1 time: 0.436447 Sep 10 11:40:01.602353 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 276/593] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:01 2022] GET /compute/v2.1/servers/a734916f-d369-4438-97de-3d0ae408384e => generated 1470 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:01.610994 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-0aec15a1-3fb1-4f6f-99ce-11fd6c160374 req-81750c1b-d6eb-4a56-8467-e844deb61d89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a21897bf-57b5-43df-b83e-0fe0461a589b", "name": "network-vif-unplugged", "status": "completed", "tag": "67cd0369-12ef-4363-bcb5-c9103b512fc1"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:40:01.618889 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c7d90a18-a067-4fe8-9624-b08b65699a18 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:01.619614 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c7d90a18-a067-4fe8-9624-b08b65699a18 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:01.620500 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c7d90a18-a067-4fe8-9624-b08b65699a18 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:01.627303 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c7d90a18-a067-4fe8-9624-b08b65699a18 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:01.629165 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c7d90a18-a067-4fe8-9624-b08b65699a18 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:01.647010 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0aec15a1-3fb1-4f6f-99ce-11fd6c160374 req-81750c1b-d6eb-4a56-8467-e844deb61d89 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:01.652064 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0aec15a1-3fb1-4f6f-99ce-11fd6c160374 req-81750c1b-d6eb-4a56-8467-e844deb61d89 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:01.653723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0aec15a1-3fb1-4f6f-99ce-11fd6c160374 req-81750c1b-d6eb-4a56-8467-e844deb61d89 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:01.683496 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-0aec15a1-3fb1-4f6f-99ce-11fd6c160374 req-81750c1b-d6eb-4a56-8467-e844deb61d89 service nova] Creating event network-vif-unplugged:67cd0369-12ef-4363-bcb5-c9103b512fc1 for instance a21897bf-57b5-43df-b83e-0fe0461a589b on n-h2-856895-1 Sep 10 11:40:01.700280 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-0aec15a1-3fb1-4f6f-99ce-11fd6c160374 req-81750c1b-d6eb-4a56-8467-e844deb61d89 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096349 Sep 10 11:40:01.702054 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 277/594] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:40:01.878339 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-34384bdc-d054-4976-9174-d91ea3cb99be tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:01.879045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-34384bdc-d054-4976-9174-d91ea3cb99be tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] [instance: 4c806b91-1302-494f-b4eb-a0b7ba04baf4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:01.887211 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-34384bdc-d054-4976-9174-d91ea3cb99be tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:01.888157 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-34384bdc-d054-4976-9174-d91ea3cb99be tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:01.889308 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-34384bdc-d054-4976-9174-d91ea3cb99be tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:01.891529 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-34384bdc-d054-4976-9174-d91ea3cb99be tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:01.892200 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-34384bdc-d054-4976-9174-d91ea3cb99be tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:01.892822 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-34384bdc-d054-4976-9174-d91ea3cb99be tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:02.008702 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c7d90a18-a067-4fe8-9624-b08b65699a18 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:02.033467 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c7d90a18-a067-4fe8-9624-b08b65699a18 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b" status: 200 len: 1503 microversion: 2.1 time: 0.466435 Sep 10 11:40:02.036209 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 318/595] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:01 2022] GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b => generated 1503 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:02.092319 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-34384bdc-d054-4976-9174-d91ea3cb99be tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf661b110ecc4f36b795a980d29f312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5765e50afa045569700eab4616a6a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:02.101323 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-34384bdc-d054-4976-9174-d91ea3cb99be tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/servers/4c806b91-1302-494f-b4eb-a0b7ba04baf4" status: 200 len: 1274 microversion: 2.1 time: 0.227927 Sep 10 11:40:02.135857 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 278/596] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:01 2022] GET /compute/v2.1/servers/4c806b91-1302-494f-b4eb-a0b7ba04baf4 => generated 1274 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:02.193156 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e49075e7-29ee-4f34-84f3-b33a33dbb2b1 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:02.193779 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e49075e7-29ee-4f34-84f3-b33a33dbb2b1 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:02.211521 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e49075e7-29ee-4f34-84f3-b33a33dbb2b1 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:02.212019 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e49075e7-29ee-4f34-84f3-b33a33dbb2b1 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:02.212742 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e49075e7-29ee-4f34-84f3-b33a33dbb2b1 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:02.213152 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e49075e7-29ee-4f34-84f3-b33a33dbb2b1 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:02.213608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e49075e7-29ee-4f34-84f3-b33a33dbb2b1 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:02.214015 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e49075e7-29ee-4f34-84f3-b33a33dbb2b1 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:02.372658 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e49075e7-29ee-4f34-84f3-b33a33dbb2b1 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:02.382820 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e49075e7-29ee-4f34-84f3-b33a33dbb2b1 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:02.384404 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e49075e7-29ee-4f34-84f3-b33a33dbb2b1 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:02.391664 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e49075e7-29ee-4f34-84f3-b33a33dbb2b1 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1447 microversion: 2.75 time: 0.201703 Sep 10 11:40:02.408292 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 319/597] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:02 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1447 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:02.633237 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-df9846b6-a52f-41b1-98f3-6e88c20b8aa5 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:02.634112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-df9846b6-a52f-41b1-98f3-6e88c20b8aa5 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] [instance: a734916f-d369-4438-97de-3d0ae408384e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:02.641347 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-df9846b6-a52f-41b1-98f3-6e88c20b8aa5 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:02.642302 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-df9846b6-a52f-41b1-98f3-6e88c20b8aa5 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:02.642934 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-df9846b6-a52f-41b1-98f3-6e88c20b8aa5 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:02.643839 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-df9846b6-a52f-41b1-98f3-6e88c20b8aa5 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:02.644618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-df9846b6-a52f-41b1-98f3-6e88c20b8aa5 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:02.645320 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-df9846b6-a52f-41b1-98f3-6e88c20b8aa5 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:02.907416 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-df9846b6-a52f-41b1-98f3-6e88c20b8aa5 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb907e8146dc42fc9cc47ff41a424503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f5d40e4bab429cb080f76a3ed3ee9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:02.910975 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:40:02.917233 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-df9846b6-a52f-41b1-98f3-6e88c20b8aa5 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] 10.222.0.23 "GET /compute/v2.1/servers/a734916f-d369-4438-97de-3d0ae408384e" status: 200 len: 1470 microversion: 2.1 time: 0.289333 Sep 10 11:40:02.918501 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 279/598] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:02 2022] GET /compute/v2.1/servers/a734916f-d369-4438-97de-3d0ae408384e => generated 1470 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:03.057720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-60ac5fb4-b01d-4fad-a2c1-3a4cca0a0e74 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:03.058340 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-60ac5fb4-b01d-4fad-a2c1-3a4cca0a0e74 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: a21897bf-57b5-43df-b83e-0fe0461a589b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:03.076322 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60ac5fb4-b01d-4fad-a2c1-3a4cca0a0e74 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:03.076884 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60ac5fb4-b01d-4fad-a2c1-3a4cca0a0e74 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:03.081448 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60ac5fb4-b01d-4fad-a2c1-3a4cca0a0e74 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:03.083459 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60ac5fb4-b01d-4fad-a2c1-3a4cca0a0e74 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:03.084367 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60ac5fb4-b01d-4fad-a2c1-3a4cca0a0e74 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:03.084818 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60ac5fb4-b01d-4fad-a2c1-3a4cca0a0e74 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:03.141337 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4fb9f8ec-03e1-463a-9872-1b8df8fd4e4b tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:03.145899 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4fb9f8ec-03e1-463a-9872-1b8df8fd4e4b tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] [instance: 4c806b91-1302-494f-b4eb-a0b7ba04baf4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:03.169960 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:40:03.190599 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4fb9f8ec-03e1-463a-9872-1b8df8fd4e4b tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:03.191868 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4fb9f8ec-03e1-463a-9872-1b8df8fd4e4b tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:03.193764 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4fb9f8ec-03e1-463a-9872-1b8df8fd4e4b tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:03.196282 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4fb9f8ec-03e1-463a-9872-1b8df8fd4e4b tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:03.198765 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4fb9f8ec-03e1-463a-9872-1b8df8fd4e4b tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:03.200460 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4fb9f8ec-03e1-463a-9872-1b8df8fd4e4b tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:03.896210 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4fb9f8ec-03e1-463a-9872-1b8df8fd4e4b tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf661b110ecc4f36b795a980d29f312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5765e50afa045569700eab4616a6a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:03.913352 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4fb9f8ec-03e1-463a-9872-1b8df8fd4e4b tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/servers/4c806b91-1302-494f-b4eb-a0b7ba04baf4" status: 200 len: 1316 microversion: 2.1 time: 0.774708 Sep 10 11:40:03.914286 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 280/599] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:03 2022] GET /compute/v2.1/servers/4c806b91-1302-494f-b4eb-a0b7ba04baf4 => generated 1316 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:03.921037 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-60ac5fb4-b01d-4fad-a2c1-3a4cca0a0e74 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:03.940477 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-60ac5fb4-b01d-4fad-a2c1-3a4cca0a0e74 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b" status: 200 len: 1503 microversion: 2.1 time: 0.882203 Sep 10 11:40:03.944085 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 320/600] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:03 2022] GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b => generated 1503 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:03.945874 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-524c2fda-84b5-4fb3-a161-ae83c6ab90d4 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:03.946530 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-524c2fda-84b5-4fb3-a161-ae83c6ab90d4 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:03.972769 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-2c1f83db-11bc-4dc9-89b7-457a2d73a5e4 req-308c3756-cf48-4d66-84f2-0689da1b3558 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a21897bf-57b5-43df-b83e-0fe0461a589b", "tag": "67cd0369-12ef-4363-bcb5-c9103b512fc1"}, {"server_uuid": "a734916f-d369-4438-97de-3d0ae408384e", "name": "network-vif-deleted", "tag": "8ec1c9d9-f1a5-4b41-8a35-5e11629ee03b"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:40:03.979977 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-524c2fda-84b5-4fb3-a161-ae83c6ab90d4 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:03.982440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-524c2fda-84b5-4fb3-a161-ae83c6ab90d4 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:03.983145 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-524c2fda-84b5-4fb3-a161-ae83c6ab90d4 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:03.988331 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-524c2fda-84b5-4fb3-a161-ae83c6ab90d4 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:03.991380 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-524c2fda-84b5-4fb3-a161-ae83c6ab90d4 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:03.991830 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-524c2fda-84b5-4fb3-a161-ae83c6ab90d4 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:04.003606 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:40:04.005877 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-2c1f83db-11bc-4dc9-89b7-457a2d73a5e4 req-308c3756-cf48-4d66-84f2-0689da1b3558 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:04.020542 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-2c1f83db-11bc-4dc9-89b7-457a2d73a5e4 req-308c3756-cf48-4d66-84f2-0689da1b3558 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:04.021289 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-2c1f83db-11bc-4dc9-89b7-457a2d73a5e4 req-308c3756-cf48-4d66-84f2-0689da1b3558 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:04.052342 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-2c1f83db-11bc-4dc9-89b7-457a2d73a5e4 req-308c3756-cf48-4d66-84f2-0689da1b3558 service nova] Creating event network-changed:67cd0369-12ef-4363-bcb5-c9103b512fc1 for instance a21897bf-57b5-43df-b83e-0fe0461a589b on n-h2-856895-1 Sep 10 11:40:04.056382 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-2c1f83db-11bc-4dc9-89b7-457a2d73a5e4 req-308c3756-cf48-4d66-84f2-0689da1b3558 service nova] Creating event network-vif-deleted:8ec1c9d9-f1a5-4b41-8a35-5e11629ee03b for instance a734916f-d369-4438-97de-3d0ae408384e on n-h2-856895-1 Sep 10 11:40:04.072972 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-2c1f83db-11bc-4dc9-89b7-457a2d73a5e4 req-308c3756-cf48-4d66-84f2-0689da1b3558 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.127518 Sep 10 11:40:04.075499 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 321/601] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:40:04.084224 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c3108168-dd5f-4779-8817-6edf263ff697 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:04.085336 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c3108168-dd5f-4779-8817-6edf263ff697 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] [instance: a734916f-d369-4438-97de-3d0ae408384e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:04.092702 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3108168-dd5f-4779-8817-6edf263ff697 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:04.093715 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3108168-dd5f-4779-8817-6edf263ff697 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:04.094916 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3108168-dd5f-4779-8817-6edf263ff697 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:04.096764 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3108168-dd5f-4779-8817-6edf263ff697 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:04.097561 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3108168-dd5f-4779-8817-6edf263ff697 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:04.098259 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3108168-dd5f-4779-8817-6edf263ff697 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:04.117768 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-524c2fda-84b5-4fb3-a161-ae83c6ab90d4 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:04.137516 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-524c2fda-84b5-4fb3-a161-ae83c6ab90d4 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:04.144842 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-524c2fda-84b5-4fb3-a161-ae83c6ab90d4 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:04.145271 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3108168-dd5f-4779-8817-6edf263ff697 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:04.145840 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3108168-dd5f-4779-8817-6edf263ff697 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:04.146391 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3108168-dd5f-4779-8817-6edf263ff697 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:04.147709 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-c3108168-dd5f-4779-8817-6edf263ff697 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lazy-loading 'fault' on Instance uuid a734916f-d369-4438-97de-3d0ae408384e {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:40:04.158592 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-524c2fda-84b5-4fb3-a161-ae83c6ab90d4 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1447 microversion: 2.75 time: 0.240304 Sep 10 11:40:04.160057 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 281/602] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:03 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1447 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:04.272206 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c3108168-dd5f-4779-8817-6edf263ff697 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb907e8146dc42fc9cc47ff41a424503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f5d40e4bab429cb080f76a3ed3ee9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:04.283572 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c3108168-dd5f-4779-8817-6edf263ff697 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] 10.222.0.23 "GET /compute/v2.1/servers/a734916f-d369-4438-97de-3d0ae408384e" status: 200 len: 1304 microversion: 2.1 time: 0.205853 Sep 10 11:40:04.284162 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 322/603] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:04 2022] GET /compute/v2.1/servers/a734916f-d369-4438-97de-3d0ae408384e => generated 1304 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:04.469805 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-80a1b6fb-e184-414e-99d0-488de8c10573 req-5b6f6482-e6a6-47ae-9b4c-92c93dd0bbc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c806b91-1302-494f-b4eb-a0b7ba04baf4", "tag": "3488be85-30de-46d4-a138-f4f55f4c37ce"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:40:04.490876 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-80a1b6fb-e184-414e-99d0-488de8c10573 req-5b6f6482-e6a6-47ae-9b4c-92c93dd0bbc9 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:04.492959 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-80a1b6fb-e184-414e-99d0-488de8c10573 req-5b6f6482-e6a6-47ae-9b4c-92c93dd0bbc9 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:04.493602 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-80a1b6fb-e184-414e-99d0-488de8c10573 req-5b6f6482-e6a6-47ae-9b4c-92c93dd0bbc9 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:04.520524 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-80a1b6fb-e184-414e-99d0-488de8c10573 req-5b6f6482-e6a6-47ae-9b4c-92c93dd0bbc9 service nova] Creating event network-changed:3488be85-30de-46d4-a138-f4f55f4c37ce for instance 4c806b91-1302-494f-b4eb-a0b7ba04baf4 on n-h2-856895-1 Sep 10 11:40:04.529681 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-80a1b6fb-e184-414e-99d0-488de8c10573 req-5b6f6482-e6a6-47ae-9b4c-92c93dd0bbc9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070266 Sep 10 11:40:04.530779 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 323/604] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:40:04.531275 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-dabbd4e0-e131-42ac-88d1-6d8e2d86fa74 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-729090598", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:40:04.617704 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-dabbd4e0-e131-42ac-88d1-6d8e2d86fa74 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] validate_networks() for None {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:40:04.941258 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4f2f5ced-f239-42b9-b8a1-c262fa453d1c tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:04.943040 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4f2f5ced-f239-42b9-b8a1-c262fa453d1c tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] [instance: 4c806b91-1302-494f-b4eb-a0b7ba04baf4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:04.953813 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f2f5ced-f239-42b9-b8a1-c262fa453d1c tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:04.955314 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f2f5ced-f239-42b9-b8a1-c262fa453d1c tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:04.956032 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f2f5ced-f239-42b9-b8a1-c262fa453d1c tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:04.957744 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f2f5ced-f239-42b9-b8a1-c262fa453d1c tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:04.958449 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f2f5ced-f239-42b9-b8a1-c262fa453d1c tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:04.959498 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f2f5ced-f239-42b9-b8a1-c262fa453d1c tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:05.016814 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-dabbd4e0-e131-42ac-88d1-6d8e2d86fa74 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:40:05.018504 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-dabbd4e0-e131-42ac-88d1-6d8e2d86fa74 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:40:05.019318 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-dabbd4e0-e131-42ac-88d1-6d8e2d86fa74 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:40:05.020032 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-dabbd4e0-e131-42ac-88d1-6d8e2d86fa74 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:40:05.020659 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-dabbd4e0-e131-42ac-88d1-6d8e2d86fa74 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:40:05.035449 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dabbd4e0-e131-42ac-88d1-6d8e2d86fa74 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:05.036317 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dabbd4e0-e131-42ac-88d1-6d8e2d86fa74 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:05.036999 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dabbd4e0-e131-42ac-88d1-6d8e2d86fa74 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:05.038411 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dabbd4e0-e131-42ac-88d1-6d8e2d86fa74 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:05.040144 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dabbd4e0-e131-42ac-88d1-6d8e2d86fa74 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:05.040759 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dabbd4e0-e131-42ac-88d1-6d8e2d86fa74 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:05.070051 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-dabbd4e0-e131-42ac-88d1-6d8e2d86fa74 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Getting quotas for project b23bf60ed08b4adca30b90ecfb9e540d. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:40:05.075995 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-dabbd4e0-e131-42ac-88d1-6d8e2d86fa74 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Getting quotas for user 73f8ba457fba4e67a97dd156c2bfaa0f and project b23bf60ed08b4adca30b90ecfb9e540d. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:40:05.090835 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-dabbd4e0-e131-42ac-88d1-6d8e2d86fa74 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:40:05.093537 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-dabbd4e0-e131-42ac-88d1-6d8e2d86fa74 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: c0cd6b34-210f-4113-b870-f402c588801c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:40:05.162212 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-dabbd4e0-e131-42ac-88d1-6d8e2d86fa74 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.000823 Sep 10 11:40:05.163682 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 282/605] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:40:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:40:05.174707 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-be753a14-c187-4133-a88f-2558adec6ea4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:05.175620 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-be753a14-c187-4133-a88f-2558adec6ea4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: a21897bf-57b5-43df-b83e-0fe0461a589b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:05.189934 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be753a14-c187-4133-a88f-2558adec6ea4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:05.194809 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be753a14-c187-4133-a88f-2558adec6ea4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:05.196189 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be753a14-c187-4133-a88f-2558adec6ea4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:05.196377 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be753a14-c187-4133-a88f-2558adec6ea4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:05.196855 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be753a14-c187-4133-a88f-2558adec6ea4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:05.197985 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be753a14-c187-4133-a88f-2558adec6ea4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:05.835939 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4f2f5ced-f239-42b9-b8a1-c262fa453d1c tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf661b110ecc4f36b795a980d29f312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5765e50afa045569700eab4616a6a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:05.850566 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4f2f5ced-f239-42b9-b8a1-c262fa453d1c tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/servers/4c806b91-1302-494f-b4eb-a0b7ba04baf4" status: 200 len: 1316 microversion: 2.1 time: 0.915483 Sep 10 11:40:05.856166 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-be753a14-c187-4133-a88f-2558adec6ea4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:05.864286 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 324/606] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:04 2022] GET /compute/v2.1/servers/4c806b91-1302-494f-b4eb-a0b7ba04baf4 => generated 1316 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:40:05.871644 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-be753a14-c187-4133-a88f-2558adec6ea4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b" status: 200 len: 1503 microversion: 2.1 time: 0.700581 Sep 10 11:40:05.871644 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 283/607] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:05 2022] GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b => generated 1503 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:05.896794 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5fdcf3a3-4eb7-450d-b19b-781a166100ea tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:05.897643 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5fdcf3a3-4eb7-450d-b19b-781a166100ea tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: c0cd6b34-210f-4113-b870-f402c588801c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:05.899816 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c75c9ce0-baae-437b-908b-ab4189e029d0 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:05.901174 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c75c9ce0-baae-437b-908b-ab4189e029d0 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:05.919520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c75c9ce0-baae-437b-908b-ab4189e029d0 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:05.920223 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c75c9ce0-baae-437b-908b-ab4189e029d0 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:05.922992 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c75c9ce0-baae-437b-908b-ab4189e029d0 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:05.923941 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c75c9ce0-baae-437b-908b-ab4189e029d0 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:05.924558 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c75c9ce0-baae-437b-908b-ab4189e029d0 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:05.926488 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c75c9ce0-baae-437b-908b-ab4189e029d0 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:06.013406 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5fdcf3a3-4eb7-450d-b19b-781a166100ea tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:06.025038 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5fdcf3a3-4eb7-450d-b19b-781a166100ea tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c" status: 200 len: 1218 microversion: 2.1 time: 0.159155 Sep 10 11:40:06.025701 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 325/608] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:05 2022] GET /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c => generated 1218 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:06.037777 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-de8d4d7b-6e7a-4cf5-9cc2-ad5be0c69086 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:06.039993 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-de8d4d7b-6e7a-4cf5-9cc2-ad5be0c69086 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] [instance: a734916f-d369-4438-97de-3d0ae408384e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:06.055145 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de8d4d7b-6e7a-4cf5-9cc2-ad5be0c69086 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:06.055734 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de8d4d7b-6e7a-4cf5-9cc2-ad5be0c69086 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:06.056263 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de8d4d7b-6e7a-4cf5-9cc2-ad5be0c69086 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:06.057270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de8d4d7b-6e7a-4cf5-9cc2-ad5be0c69086 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:06.057854 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de8d4d7b-6e7a-4cf5-9cc2-ad5be0c69086 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:06.058365 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de8d4d7b-6e7a-4cf5-9cc2-ad5be0c69086 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:06.074040 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-de8d4d7b-6e7a-4cf5-9cc2-ad5be0c69086 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] HTTP exception thrown: Instance a734916f-d369-4438-97de-3d0ae408384e could not be found. Sep 10 11:40:06.076106 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-de8d4d7b-6e7a-4cf5-9cc2-ad5be0c69086 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Request method failure captured: Sep 10 11:40:06.076106 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/a734916f-d369-4438-97de-3d0ae408384e HTTP/1.1 Sep 10 11:40:06.076106 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:40:06.076106 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:40:06.076106 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:40:06.076106 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:40:06.076106 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:40:06.076106 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:40:06.076106 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:40:06.076106 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:40:06.076106 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHdzY302-KyO9TI6xBpU2mVhTIMrg0thaqmKNZIfwH-iHGyeBdj_x4EUoiNnCYiGqzB_ESCA3bDv-LzAY_a_mlR2wAIPcWxzBi_eef7hY22ZzAvTlEoMHweiUXp4TDzb-0nOsP868ssTSopwzzZif_vJHhUkSOXxzeq6xwy4YfKfooM Sep 10 11:40:06.076106 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:40:06.076106 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:40:06.076106 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:40:06.076106 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:40:06.076106 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:40:06.076106 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:40:06.076106 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: e5f5d40e4bab429cb080f76a3ed3ee9e Sep 10 11:40:06.076106 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-TenantUsagesTestJSON-1389554781 Sep 10 11:40:06.076106 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:40:06.076106 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:40:06.077401 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5f5d40e4bab429cb080f76a3ed3ee9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5f5d40e4bab429cb080f76a3ed3ee9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e5f5d40e4bab429cb080f76a3ed3ee9e", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e5f5d40e4bab429cb080f76a3ed3ee9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:40:06.077401 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-TenantUsagesTestJSON-1389554781 Sep 10 11:40:06.077401 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: e5f5d40e4bab429cb080f76a3ed3ee9e Sep 10 11:40:06.077401 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1389554781 Sep 10 11:40:06.077401 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-TenantUsagesTestJSON-1389554781-project Sep 10 11:40:06.077401 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:40:06.077401 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:40:06.077401 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: bb907e8146dc42fc9cc47ff41a424503 Sep 10 11:40:06.077401 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-TenantUsagesTestJSON-1389554781-project Sep 10 11:40:06.077401 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:40:06.077401 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance a734916f-d369-4438-97de-3d0ae408384e could not be found. Sep 10 11:40:06.077401 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'a734916f-d369-4438-97de-3d0ae408384e'} Sep 10 11:40:06.078143 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:40:06.078143 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:40:06.078143 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:40:06.078143 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:40:06.078143 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:40:06.078143 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:40:06.078143 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:40:06.078143 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:40:06.078143 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:40:06.078143 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:40:06.078143 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a734916f-d369-4438-97de-3d0ae408384e could not be found. Sep 10 11:40:06.078143 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:40:06.078143 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:40:06.078143 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:40:06.078143 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:40:06.078143 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:40:06.078143 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:40:06.078143 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:40:06.078143 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:40:06.078143 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:40:06.079578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:40:06.079578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:40:06.079578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:40:06.079578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:40:06.079578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:40:06.079578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:40:06.079578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:40:06.079578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a734916f-d369-4438-97de-3d0ae408384e could not be found. Sep 10 11:40:06.079578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:40:06.079578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:40:06.079578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:40:06.079578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:40:06.079578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:40:06.079578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:40:06.079578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:40:06.079578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:40:06.079578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a734916f-d369-4438-97de-3d0ae408384e could not be found. Sep 10 11:40:06.079578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:40:06.081444 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c75c9ce0-baae-437b-908b-ab4189e029d0 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:06.082766 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-de8d4d7b-6e7a-4cf5-9cc2-ad5be0c69086 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] Returning 404 to user: Instance a734916f-d369-4438-97de-3d0ae408384e could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:40:06.083688 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-de8d4d7b-6e7a-4cf5-9cc2-ad5be0c69086 tempest-TenantUsagesTestJSON-1389554781 tempest-TenantUsagesTestJSON-1389554781-project] 10.222.0.23 "GET /compute/v2.1/servers/a734916f-d369-4438-97de-3d0ae408384e" status: 404 len: 111 microversion: 2.1 time: 0.056637 Sep 10 11:40:06.090936 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 326/609] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:06 2022] GET /compute/v2.1/servers/a734916f-d369-4438-97de-3d0ae408384e => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:40:06.091654 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c75c9ce0-baae-437b-908b-ab4189e029d0 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:06.096288 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c75c9ce0-baae-437b-908b-ab4189e029d0 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:06.105332 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c75c9ce0-baae-437b-908b-ab4189e029d0 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1447 microversion: 2.75 time: 0.232221 Sep 10 11:40:06.105933 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 284/610] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:05 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1447 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:06.806988 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-52903a9b-a2ff-49b3-aed2-275a6d513b10 tempest-FlavorsV2TestJSON-163549585 tempest-FlavorsV2TestJSON-163549585-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:06.816317 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-52903a9b-a2ff-49b3-aed2-275a6d513b10 tempest-FlavorsV2TestJSON-163549585 tempest-FlavorsV2TestJSON-163549585-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.279988 Sep 10 11:40:06.826412 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 327/611] 10.222.0.23 () {58 vars in 1137 bytes} [Sat Sep 10 11:40:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:40:06.832584 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-77cc0ee2-701d-4aed-aa86-48dbad1fe69b tempest-FlavorsV2TestJSON-163549585 tempest-FlavorsV2TestJSON-163549585-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:06.867027 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-77cc0ee2-701d-4aed-aa86-48dbad1fe69b tempest-FlavorsV2TestJSON-163549585 tempest-FlavorsV2TestJSON-163549585-project] 10.222.0.23 "GET /compute/v2.1/flavors" status: 200 len: 3078 microversion: 2.1 time: 0.039978 Sep 10 11:40:06.867651 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 285/612] 10.222.0.23 () {58 vars in 1125 bytes} [Sat Sep 10 11:40:06 2022] GET /compute/v2.1/flavors => generated 3078 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:40:06.884805 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-be39bce4-3f7e-45b7-9c67-c580f23f74f2 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:06.885310 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4fa16e2a-f6de-4d18-ac35-7b52df22372b tempest-FlavorsV2TestJSON-163549585 tempest-FlavorsV2TestJSON-163549585-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:06.886093 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-be39bce4-3f7e-45b7-9c67-c580f23f74f2 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] [instance: 4c806b91-1302-494f-b4eb-a0b7ba04baf4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:06.896674 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4fa16e2a-f6de-4d18-ac35-7b52df22372b tempest-FlavorsV2TestJSON-163549585 tempest-FlavorsV2TestJSON-163549585-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015805 Sep 10 11:40:06.897452 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 286/613] 10.222.0.23 () {58 vars in 1137 bytes} [Sat Sep 10 11:40:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:40:06.903789 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3743f8b0-f836-4a1e-b6c4-7a2473d2e2f0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:06.904523 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3743f8b0-f836-4a1e-b6c4-7a2473d2e2f0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: a21897bf-57b5-43df-b83e-0fe0461a589b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:06.909095 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-be39bce4-3f7e-45b7-9c67-c580f23f74f2 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:06.909657 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-be39bce4-3f7e-45b7-9c67-c580f23f74f2 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:06.910113 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-be39bce4-3f7e-45b7-9c67-c580f23f74f2 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:06.910849 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-be39bce4-3f7e-45b7-9c67-c580f23f74f2 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:06.911415 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-be39bce4-3f7e-45b7-9c67-c580f23f74f2 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:06.911841 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-be39bce4-3f7e-45b7-9c67-c580f23f74f2 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:06.914058 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3743f8b0-f836-4a1e-b6c4-7a2473d2e2f0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:06.914623 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3743f8b0-f836-4a1e-b6c4-7a2473d2e2f0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:06.915268 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3743f8b0-f836-4a1e-b6c4-7a2473d2e2f0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:06.916335 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3743f8b0-f836-4a1e-b6c4-7a2473d2e2f0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:06.917094 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3743f8b0-f836-4a1e-b6c4-7a2473d2e2f0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:06.917729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3743f8b0-f836-4a1e-b6c4-7a2473d2e2f0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:07.253382 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3743f8b0-f836-4a1e-b6c4-7a2473d2e2f0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:07.261840 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3743f8b0-f836-4a1e-b6c4-7a2473d2e2f0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b" status: 200 len: 1503 microversion: 2.1 time: 0.362196 Sep 10 11:40:07.262537 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 287/614] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:06 2022] GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b => generated 1503 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:07.268626 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b2f724eb-63d9-453e-8e64-ac6408abc590 tempest-FlavorsV2TestJSON-163549585 tempest-FlavorsV2TestJSON-163549585-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:07.270961 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-be39bce4-3f7e-45b7-9c67-c580f23f74f2 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf661b110ecc4f36b795a980d29f312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5765e50afa045569700eab4616a6a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:07.279140 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-be39bce4-3f7e-45b7-9c67-c580f23f74f2 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/servers/4c806b91-1302-494f-b4eb-a0b7ba04baf4" status: 200 len: 1316 microversion: 2.1 time: 0.398243 Sep 10 11:40:07.279842 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b2f724eb-63d9-453e-8e64-ac6408abc590 tempest-FlavorsV2TestJSON-163549585 tempest-FlavorsV2TestJSON-163549585-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014874 Sep 10 11:40:07.280929 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 288/615] 10.222.0.23 () {58 vars in 1137 bytes} [Sat Sep 10 11:40:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:40:07.285043 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 328/616] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:06 2022] GET /compute/v2.1/servers/4c806b91-1302-494f-b4eb-a0b7ba04baf4 => generated 1316 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:07.290210 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4c3ab656-75b0-40b0-aab6-39c3cd7a66e3 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:07.295402 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b9d53359-5df9-4c9c-91c1-8a382e1cd7d9 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:07.296395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b9d53359-5df9-4c9c-91c1-8a382e1cd7d9 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: c0cd6b34-210f-4113-b870-f402c588801c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:07.300781 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4c3ab656-75b0-40b0-aab6-39c3cd7a66e3 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:07.306325 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9d53359-5df9-4c9c-91c1-8a382e1cd7d9 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:07.307249 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9d53359-5df9-4c9c-91c1-8a382e1cd7d9 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:07.307402 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4c3ab656-75b0-40b0-aab6-39c3cd7a66e3 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:07.308002 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9d53359-5df9-4c9c-91c1-8a382e1cd7d9 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:07.308831 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9d53359-5df9-4c9c-91c1-8a382e1cd7d9 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:07.309137 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4c3ab656-75b0-40b0-aab6-39c3cd7a66e3 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:07.309525 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9d53359-5df9-4c9c-91c1-8a382e1cd7d9 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:07.309787 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4c3ab656-75b0-40b0-aab6-39c3cd7a66e3 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:07.310535 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4c3ab656-75b0-40b0-aab6-39c3cd7a66e3 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:07.311008 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4c3ab656-75b0-40b0-aab6-39c3cd7a66e3 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:07.311449 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9d53359-5df9-4c9c-91c1-8a382e1cd7d9 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:07.311586 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4c3ab656-75b0-40b0-aab6-39c3cd7a66e3 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:07.439795 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4c3ab656-75b0-40b0-aab6-39c3cd7a66e3 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:07.448460 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b9d53359-5df9-4c9c-91c1-8a382e1cd7d9 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:07.462698 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4c3ab656-75b0-40b0-aab6-39c3cd7a66e3 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:07.468438 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b9d53359-5df9-4c9c-91c1-8a382e1cd7d9 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c" status: 200 len: 1270 microversion: 2.1 time: 0.177258 Sep 10 11:40:07.469964 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 289/617] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:07 2022] GET /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c => generated 1270 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:07.479439 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9844294e-3991-4606-8b80-8b72e240ee58 tempest-FlavorsV2TestJSON-163549585 tempest-FlavorsV2TestJSON-163549585-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:07.481140 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4c3ab656-75b0-40b0-aab6-39c3cd7a66e3 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:07.499230 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4c3ab656-75b0-40b0-aab6-39c3cd7a66e3 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1447 microversion: 2.75 time: 0.212457 Sep 10 11:40:07.506324 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 329/618] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:07 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1447 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:07.553467 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9844294e-3991-4606-8b80-8b72e240ee58 tempest-FlavorsV2TestJSON-163549585 tempest-FlavorsV2TestJSON-163549585-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.080939 Sep 10 11:40:07.555014 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 290/619] 10.222.0.23 () {58 vars in 1165 bytes} [Sat Sep 10 11:40:07 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:07.591672 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1f44a099-aef7-4b12-a827-5f351ba8049e tempest-FlavorsV2TestJSON-163549585 tempest-FlavorsV2TestJSON-163549585-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:07.602583 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1f44a099-aef7-4b12-a827-5f351ba8049e tempest-FlavorsV2TestJSON-163549585 tempest-FlavorsV2TestJSON-163549585-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020141 Sep 10 11:40:07.617532 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cb3b0bce-f6d2-45bb-bdb9-56dd9f2234ee tempest-FlavorsV2TestJSON-163549585 tempest-FlavorsV2TestJSON-163549585-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:07.622686 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 330/620] 10.222.0.23 () {58 vars in 1137 bytes} [Sat Sep 10 11:40:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:40:07.651124 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cb3b0bce-f6d2-45bb-bdb9-56dd9f2234ee tempest-FlavorsV2TestJSON-163549585 tempest-FlavorsV2TestJSON-163549585-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.037868 Sep 10 11:40:07.656993 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 291/621] 10.222.0.23 () {58 vars in 1169 bytes} [Sat Sep 10 11:40:07 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:07.669802 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-be24f61b-e0af-44b1-96a7-8637e2cac24f tempest-FlavorsV2TestJSON-163549585 tempest-FlavorsV2TestJSON-163549585-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:07.696644 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-be24f61b-e0af-44b1-96a7-8637e2cac24f tempest-FlavorsV2TestJSON-163549585 tempest-FlavorsV2TestJSON-163549585-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.031523 Sep 10 11:40:07.699920 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 331/622] 10.222.0.23 () {58 vars in 1161 bytes} [Sat Sep 10 11:40:07 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:40:07.714782 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7c569927-93bd-4f74-b49a-b70cfae36857 tempest-FlavorsV2TestJSON-163549585 tempest-FlavorsV2TestJSON-163549585-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:07.726728 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7c569927-93bd-4f74-b49a-b70cfae36857 tempest-FlavorsV2TestJSON-163549585 tempest-FlavorsV2TestJSON-163549585-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015760 Sep 10 11:40:07.740743 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b38b7552-a07f-4a69-ab12-a91bc8785263 tempest-FlavorsV2TestJSON-163549585 tempest-FlavorsV2TestJSON-163549585-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:07.748296 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 292/623] 10.222.0.23 () {58 vars in 1137 bytes} [Sat Sep 10 11:40:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:40:07.789478 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b38b7552-a07f-4a69-ab12-a91bc8785263 tempest-FlavorsV2TestJSON-163549585 tempest-FlavorsV2TestJSON-163549585-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.052011 Sep 10 11:40:07.801240 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 332/624] 10.222.0.23 () {58 vars in 1167 bytes} [Sat Sep 10 11:40:07 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:07.811017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-aac2506d-272a-4bf7-85c5-3b3dda384e20 tempest-FlavorsV2TestJSON-163549585 tempest-FlavorsV2TestJSON-163549585-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:07.831101 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-aac2506d-272a-4bf7-85c5-3b3dda384e20 tempest-FlavorsV2TestJSON-163549585 tempest-FlavorsV2TestJSON-163549585-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021097 Sep 10 11:40:07.852245 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9cc4b2f6-7519-4357-8280-8a348d290331 tempest-FlavorsV2TestJSON-163549585 tempest-FlavorsV2TestJSON-163549585-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:07.854495 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 293/625] 10.222.0.23 () {58 vars in 1137 bytes} [Sat Sep 10 11:40:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:40:08.015619 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9cc4b2f6-7519-4357-8280-8a348d290331 tempest-FlavorsV2TestJSON-163549585 tempest-FlavorsV2TestJSON-163549585-project] 10.222.0.23 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.168324 Sep 10 11:40:08.016857 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 333/626] 10.222.0.23 () {58 vars in 1144 bytes} [Sat Sep 10 11:40:07 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:40:08.034534 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-154a39dd-5404-4a61-99d8-74ffbb49db10 tempest-FlavorsV2TestJSON-163549585 tempest-FlavorsV2TestJSON-163549585-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:08.056845 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-154a39dd-5404-4a61-99d8-74ffbb49db10 tempest-FlavorsV2TestJSON-163549585 tempest-FlavorsV2TestJSON-163549585-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027166 Sep 10 11:40:08.062353 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 294/627] 10.222.0.23 () {58 vars in 1137 bytes} [Sat Sep 10 11:40:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:40:08.077960 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7d050588-43e1-43e1-a8b7-1f86db9fc576 tempest-FlavorsV2TestJSON-163549585 tempest-FlavorsV2TestJSON-163549585-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:08.162662 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7d050588-43e1-43e1-a8b7-1f86db9fc576 tempest-FlavorsV2TestJSON-163549585 tempest-FlavorsV2TestJSON-163549585-project] 10.222.0.23 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.091307 Sep 10 11:40:08.163553 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 334/628] 10.222.0.23 () {58 vars in 1148 bytes} [Sat Sep 10 11:40:08 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:40:08.179107 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1fde5156-9d45-4c4d-bc82-92df274cd953 tempest-FlavorsV2TestJSON-163549585 tempest-FlavorsV2TestJSON-163549585-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:08.241975 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1fde5156-9d45-4c4d-bc82-92df274cd953 tempest-FlavorsV2TestJSON-163549585 tempest-FlavorsV2TestJSON-163549585-project] 10.222.0.23 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.067561 Sep 10 11:40:08.247151 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 295/629] 10.222.0.23 () {58 vars in 1140 bytes} [Sat Sep 10 11:40:08 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:40:08.262338 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a45c46b5-5c61-4770-819b-abe9682ed6d7 tempest-FlavorsV2TestJSON-163549585 tempest-FlavorsV2TestJSON-163549585-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:08.275495 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a45c46b5-5c61-4770-819b-abe9682ed6d7 tempest-FlavorsV2TestJSON-163549585 tempest-FlavorsV2TestJSON-163549585-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016189 Sep 10 11:40:08.277457 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 335/630] 10.222.0.23 () {58 vars in 1137 bytes} [Sat Sep 10 11:40:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:40:08.290633 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bac24d08-f1bc-4a44-a8fb-93a28cf03117 tempest-FlavorsV2TestJSON-163549585 tempest-FlavorsV2TestJSON-163549585-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:08.291741 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ea18a188-efbf-4243-b8a2-c3ea1d5de45d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:08.293173 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ea18a188-efbf-4243-b8a2-c3ea1d5de45d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: a21897bf-57b5-43df-b83e-0fe0461a589b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:08.331589 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea18a188-efbf-4243-b8a2-c3ea1d5de45d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:08.332377 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea18a188-efbf-4243-b8a2-c3ea1d5de45d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:08.335727 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea18a188-efbf-4243-b8a2-c3ea1d5de45d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:08.345118 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea18a188-efbf-4243-b8a2-c3ea1d5de45d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:08.346546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea18a188-efbf-4243-b8a2-c3ea1d5de45d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:08.347502 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea18a188-efbf-4243-b8a2-c3ea1d5de45d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:08.349524 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bac24d08-f1bc-4a44-a8fb-93a28cf03117 tempest-FlavorsV2TestJSON-163549585 tempest-FlavorsV2TestJSON-163549585-project] 10.222.0.23 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.062557 Sep 10 11:40:08.352418 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 336/631] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:40:08 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:40:08.382277 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8f007d91-294f-4aec-a575-44dc1223c62f tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:08.384787 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8f007d91-294f-4aec-a575-44dc1223c62f tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] [instance: 4c806b91-1302-494f-b4eb-a0b7ba04baf4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:08.393833 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8f007d91-294f-4aec-a575-44dc1223c62f tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:08.413827 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8f007d91-294f-4aec-a575-44dc1223c62f tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:08.415965 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8f007d91-294f-4aec-a575-44dc1223c62f tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:08.418322 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8f007d91-294f-4aec-a575-44dc1223c62f tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:08.418901 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8f007d91-294f-4aec-a575-44dc1223c62f tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:08.427593 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8f007d91-294f-4aec-a575-44dc1223c62f tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:08.803872 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8f007d91-294f-4aec-a575-44dc1223c62f tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf661b110ecc4f36b795a980d29f312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5765e50afa045569700eab4616a6a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:08.829267 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8f007d91-294f-4aec-a575-44dc1223c62f tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/servers/4c806b91-1302-494f-b4eb-a0b7ba04baf4" status: 200 len: 1316 microversion: 2.1 time: 0.469549 Sep 10 11:40:08.830476 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 337/632] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:08 2022] GET /compute/v2.1/servers/4c806b91-1302-494f-b4eb-a0b7ba04baf4 => generated 1316 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:08.835501 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8adcd4ef-6a5d-4ab5-affb-d7f4c196d0fe tempest-FlavorsV2TestJSON-163549585 tempest-FlavorsV2TestJSON-163549585-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:08.874059 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8adcd4ef-6a5d-4ab5-affb-d7f4c196d0fe tempest-FlavorsV2TestJSON-163549585 tempest-FlavorsV2TestJSON-163549585-project] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.042312 Sep 10 11:40:08.874886 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 338/633] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:40:08 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:08.894000 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-121a1d99-629c-4752-aa5e-92ab3d56d4d7 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:08.894928 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-121a1d99-629c-4752-aa5e-92ab3d56d4d7 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: c0cd6b34-210f-4113-b870-f402c588801c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:08.916918 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-121a1d99-629c-4752-aa5e-92ab3d56d4d7 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:08.917705 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-121a1d99-629c-4752-aa5e-92ab3d56d4d7 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:08.918357 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-121a1d99-629c-4752-aa5e-92ab3d56d4d7 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:08.919304 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-121a1d99-629c-4752-aa5e-92ab3d56d4d7 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:08.919926 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-121a1d99-629c-4752-aa5e-92ab3d56d4d7 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:08.920501 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-121a1d99-629c-4752-aa5e-92ab3d56d4d7 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:08.939623 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ea18a188-efbf-4243-b8a2-c3ea1d5de45d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:08.958873 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ea18a188-efbf-4243-b8a2-c3ea1d5de45d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b" status: 200 len: 1503 microversion: 2.1 time: 0.672475 Sep 10 11:40:08.962713 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 296/634] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:08 2022] GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b => generated 1503 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:08.969092 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b3341925-ca83-4177-b73d-eb922e32c617 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:08.971091 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b3341925-ca83-4177-b73d-eb922e32c617 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:08.980790 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b3341925-ca83-4177-b73d-eb922e32c617 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:08.981352 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b3341925-ca83-4177-b73d-eb922e32c617 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:08.981833 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b3341925-ca83-4177-b73d-eb922e32c617 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:08.982602 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b3341925-ca83-4177-b73d-eb922e32c617 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:08.983079 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b3341925-ca83-4177-b73d-eb922e32c617 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:08.983531 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b3341925-ca83-4177-b73d-eb922e32c617 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:09.172366 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b3341925-ca83-4177-b73d-eb922e32c617 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:09.178010 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-121a1d99-629c-4752-aa5e-92ab3d56d4d7 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:09.205289 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-121a1d99-629c-4752-aa5e-92ab3d56d4d7 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c" status: 200 len: 1276 microversion: 2.1 time: 0.328017 Sep 10 11:40:09.207268 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 339/635] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:08 2022] GET /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c => generated 1276 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:09.214674 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b3341925-ca83-4177-b73d-eb922e32c617 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:09.216273 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b3341925-ca83-4177-b73d-eb922e32c617 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:09.222111 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0fe1f0db-f700-486a-89b0-384e799c7727 tempest-FlavorsV2TestJSON-163549585 tempest-FlavorsV2TestJSON-163549585-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:09.231482 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b3341925-ca83-4177-b73d-eb922e32c617 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1447 microversion: 2.75 time: 0.267172 Sep 10 11:40:09.232581 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 297/636] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:08 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1447 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:09.256881 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0fe1f0db-f700-486a-89b0-384e799c7727 tempest-FlavorsV2TestJSON-163549585 tempest-FlavorsV2TestJSON-163549585-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.046906 Sep 10 11:40:09.259089 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 340/637] 10.222.0.23 () {58 vars in 1137 bytes} [Sat Sep 10 11:40:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:40:09.856142 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-47af52d6-673a-4f5b-86f0-36eae73d4dc2 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:09.858260 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-47af52d6-673a-4f5b-86f0-36eae73d4dc2 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] [instance: 4c806b91-1302-494f-b4eb-a0b7ba04baf4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:09.874836 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47af52d6-673a-4f5b-86f0-36eae73d4dc2 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:09.875659 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47af52d6-673a-4f5b-86f0-36eae73d4dc2 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:09.876419 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47af52d6-673a-4f5b-86f0-36eae73d4dc2 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:09.877681 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47af52d6-673a-4f5b-86f0-36eae73d4dc2 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:09.884584 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47af52d6-673a-4f5b-86f0-36eae73d4dc2 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:09.886499 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47af52d6-673a-4f5b-86f0-36eae73d4dc2 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:09.987281 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a6e0ff86-c0af-46a8-89a9-c6f10f1cc296 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:09.988147 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a6e0ff86-c0af-46a8-89a9-c6f10f1cc296 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: a21897bf-57b5-43df-b83e-0fe0461a589b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:10.002403 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6e0ff86-c0af-46a8-89a9-c6f10f1cc296 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:10.003265 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6e0ff86-c0af-46a8-89a9-c6f10f1cc296 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:10.003885 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6e0ff86-c0af-46a8-89a9-c6f10f1cc296 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:10.004773 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6e0ff86-c0af-46a8-89a9-c6f10f1cc296 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:10.005394 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6e0ff86-c0af-46a8-89a9-c6f10f1cc296 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:10.005985 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6e0ff86-c0af-46a8-89a9-c6f10f1cc296 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:10.055550 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:40:10.557265 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-47af52d6-673a-4f5b-86f0-36eae73d4dc2 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf661b110ecc4f36b795a980d29f312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5765e50afa045569700eab4616a6a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:10.575084 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a6e0ff86-c0af-46a8-89a9-c6f10f1cc296 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:10.580307 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-47af52d6-673a-4f5b-86f0-36eae73d4dc2 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/servers/4c806b91-1302-494f-b4eb-a0b7ba04baf4" status: 200 len: 1316 microversion: 2.1 time: 0.729394 Sep 10 11:40:10.581412 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 298/638] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:09 2022] GET /compute/v2.1/servers/4c806b91-1302-494f-b4eb-a0b7ba04baf4 => generated 1316 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:10.594757 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a6e0ff86-c0af-46a8-89a9-c6f10f1cc296 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b" status: 200 len: 1503 microversion: 2.1 time: 0.606132 Sep 10 11:40:10.601175 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3a437515-0604-4e9b-8caf-78ba5fee7c89 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:10.602212 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3a437515-0604-4e9b-8caf-78ba5fee7c89 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: c0cd6b34-210f-4113-b870-f402c588801c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:10.611520 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 341/639] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:09 2022] GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b => generated 1503 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:40:10.617733 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-970dc9e2-4126-4c73-b2bf-a8798a46c588 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:10.619961 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a437515-0604-4e9b-8caf-78ba5fee7c89 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:10.620679 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a437515-0604-4e9b-8caf-78ba5fee7c89 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:10.622076 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a437515-0604-4e9b-8caf-78ba5fee7c89 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:10.622218 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-970dc9e2-4126-4c73-b2bf-a8798a46c588 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:10.624723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a437515-0604-4e9b-8caf-78ba5fee7c89 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:10.627620 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a437515-0604-4e9b-8caf-78ba5fee7c89 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:10.628752 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a437515-0604-4e9b-8caf-78ba5fee7c89 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:10.636580 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-970dc9e2-4126-4c73-b2bf-a8798a46c588 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:10.637345 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-970dc9e2-4126-4c73-b2bf-a8798a46c588 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:10.637960 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-970dc9e2-4126-4c73-b2bf-a8798a46c588 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:10.638869 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-970dc9e2-4126-4c73-b2bf-a8798a46c588 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:10.639514 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-970dc9e2-4126-4c73-b2bf-a8798a46c588 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:10.640106 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-970dc9e2-4126-4c73-b2bf-a8798a46c588 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:10.810360 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-970dc9e2-4126-4c73-b2bf-a8798a46c588 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:10.827991 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-970dc9e2-4126-4c73-b2bf-a8798a46c588 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:10.829897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-970dc9e2-4126-4c73-b2bf-a8798a46c588 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:10.836741 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-970dc9e2-4126-4c73-b2bf-a8798a46c588 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1447 microversion: 2.75 time: 0.223399 Sep 10 11:40:10.865534 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 342/640] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:10 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1447 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:11.220207 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3a437515-0604-4e9b-8caf-78ba5fee7c89 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:11.232635 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3a437515-0604-4e9b-8caf-78ba5fee7c89 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c" status: 200 len: 1318 microversion: 2.1 time: 0.649893 Sep 10 11:40:11.236666 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 299/641] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:10 2022] GET /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c => generated 1318 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:11.418940 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-a7efe541-9daf-45be-933a-4ccfa2fad405 req-7f2c67b7-8cc4-449b-add2-bc39c8d3c3b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c806b91-1302-494f-b4eb-a0b7ba04baf4", "name": "network-vif-plugged", "status": "completed", "tag": "3488be85-30de-46d4-a138-f4f55f4c37ce"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:40:11.433933 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a7efe541-9daf-45be-933a-4ccfa2fad405 req-7f2c67b7-8cc4-449b-add2-bc39c8d3c3b9 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:11.434609 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a7efe541-9daf-45be-933a-4ccfa2fad405 req-7f2c67b7-8cc4-449b-add2-bc39c8d3c3b9 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:11.435197 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a7efe541-9daf-45be-933a-4ccfa2fad405 req-7f2c67b7-8cc4-449b-add2-bc39c8d3c3b9 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:11.451707 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-a7efe541-9daf-45be-933a-4ccfa2fad405 req-7f2c67b7-8cc4-449b-add2-bc39c8d3c3b9 service nova] Creating event network-vif-plugged:3488be85-30de-46d4-a138-f4f55f4c37ce for instance 4c806b91-1302-494f-b4eb-a0b7ba04baf4 on n-h2-856895-1 Sep 10 11:40:11.460963 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-a7efe541-9daf-45be-933a-4ccfa2fad405 req-7f2c67b7-8cc4-449b-add2-bc39c8d3c3b9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045880 Sep 10 11:40:11.463152 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 343/642] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:40:11.606273 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-dd798c96-b84a-48b6-992d-bb5ea09a7dea tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:11.607111 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-dd798c96-b84a-48b6-992d-bb5ea09a7dea tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] [instance: 4c806b91-1302-494f-b4eb-a0b7ba04baf4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:11.615729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd798c96-b84a-48b6-992d-bb5ea09a7dea tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:11.617232 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd798c96-b84a-48b6-992d-bb5ea09a7dea tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:11.617946 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd798c96-b84a-48b6-992d-bb5ea09a7dea tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:11.619064 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd798c96-b84a-48b6-992d-bb5ea09a7dea tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:11.622512 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd798c96-b84a-48b6-992d-bb5ea09a7dea tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:11.623362 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd798c96-b84a-48b6-992d-bb5ea09a7dea tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:11.632706 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bdbfd382-a8e8-435b-bdb0-9603dfb2e138 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:11.633708 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bdbfd382-a8e8-435b-bdb0-9603dfb2e138 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: a21897bf-57b5-43df-b83e-0fe0461a589b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:11.653098 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bdbfd382-a8e8-435b-bdb0-9603dfb2e138 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:11.653618 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bdbfd382-a8e8-435b-bdb0-9603dfb2e138 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:11.654061 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bdbfd382-a8e8-435b-bdb0-9603dfb2e138 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:11.656046 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bdbfd382-a8e8-435b-bdb0-9603dfb2e138 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:11.657306 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bdbfd382-a8e8-435b-bdb0-9603dfb2e138 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:11.657961 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bdbfd382-a8e8-435b-bdb0-9603dfb2e138 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:12.441043 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bdbfd382-a8e8-435b-bdb0-9603dfb2e138 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:12.449052 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-dd798c96-b84a-48b6-992d-bb5ea09a7dea tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf661b110ecc4f36b795a980d29f312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5765e50afa045569700eab4616a6a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:12.458562 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-dd798c96-b84a-48b6-992d-bb5ea09a7dea tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/servers/4c806b91-1302-494f-b4eb-a0b7ba04baf4" status: 200 len: 1316 microversion: 2.1 time: 0.856205 Sep 10 11:40:12.460425 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 300/643] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:11 2022] GET /compute/v2.1/servers/4c806b91-1302-494f-b4eb-a0b7ba04baf4 => generated 1316 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:12.465618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9c92cf05-4490-459b-8ee3-bb0654cbfd4c tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:12.466470 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9c92cf05-4490-459b-8ee3-bb0654cbfd4c tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:12.472925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9c92cf05-4490-459b-8ee3-bb0654cbfd4c tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:12.473765 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9c92cf05-4490-459b-8ee3-bb0654cbfd4c tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:12.474454 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9c92cf05-4490-459b-8ee3-bb0654cbfd4c tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:12.475458 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9c92cf05-4490-459b-8ee3-bb0654cbfd4c tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:12.476366 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9c92cf05-4490-459b-8ee3-bb0654cbfd4c tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:12.477027 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9c92cf05-4490-459b-8ee3-bb0654cbfd4c tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:12.512787 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bdbfd382-a8e8-435b-bdb0-9603dfb2e138 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b" status: 200 len: 1478 microversion: 2.1 time: 0.866371 Sep 10 11:40:12.515579 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 344/644] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:11 2022] GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b => generated 1478 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:12.533588 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-c8a531c5-6353-44cc-969a-4a26d5703387 req-7c79ae6e-b4d0-4e5f-8f4a-3eb6ffccdd91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0cd6b34-210f-4113-b870-f402c588801c", "tag": "f33545ba-898c-40db-b80a-66a1332af80f"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:40:12.586001 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-c8a531c5-6353-44cc-969a-4a26d5703387 req-7c79ae6e-b4d0-4e5f-8f4a-3eb6ffccdd91 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:12.588270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-c8a531c5-6353-44cc-969a-4a26d5703387 req-7c79ae6e-b4d0-4e5f-8f4a-3eb6ffccdd91 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:12.589021 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-c8a531c5-6353-44cc-969a-4a26d5703387 req-7c79ae6e-b4d0-4e5f-8f4a-3eb6ffccdd91 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:12.604188 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-c8a531c5-6353-44cc-969a-4a26d5703387 req-7c79ae6e-b4d0-4e5f-8f4a-3eb6ffccdd91 service nova] Creating event network-changed:f33545ba-898c-40db-b80a-66a1332af80f for instance c0cd6b34-210f-4113-b870-f402c588801c on n-h2-856895-1 Sep 10 11:40:12.629905 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-c8a531c5-6353-44cc-969a-4a26d5703387 req-7c79ae6e-b4d0-4e5f-8f4a-3eb6ffccdd91 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105604 Sep 10 11:40:12.634648 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 345/645] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:40:12.656381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8230a2c8-3cb3-4de4-a3d8-c5ab4b3cbbd2 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:12.660129 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8230a2c8-3cb3-4de4-a3d8-c5ab4b3cbbd2 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: c0cd6b34-210f-4113-b870-f402c588801c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:12.678729 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8230a2c8-3cb3-4de4-a3d8-c5ab4b3cbbd2 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:12.679243 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8230a2c8-3cb3-4de4-a3d8-c5ab4b3cbbd2 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:12.679870 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8230a2c8-3cb3-4de4-a3d8-c5ab4b3cbbd2 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:12.680894 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8230a2c8-3cb3-4de4-a3d8-c5ab4b3cbbd2 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:12.682942 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8230a2c8-3cb3-4de4-a3d8-c5ab4b3cbbd2 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:12.683636 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8230a2c8-3cb3-4de4-a3d8-c5ab4b3cbbd2 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:12.845768 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9c92cf05-4490-459b-8ee3-bb0654cbfd4c tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:12.857650 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9c92cf05-4490-459b-8ee3-bb0654cbfd4c tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:12.859117 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9c92cf05-4490-459b-8ee3-bb0654cbfd4c tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:12.875640 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9c92cf05-4490-459b-8ee3-bb0654cbfd4c tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1447 microversion: 2.75 time: 0.413654 Sep 10 11:40:12.876245 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 301/646] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:12 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1447 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:12.888708 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a6bddf3a-6168-4eb0-88f8-75e933779292 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Calling method '.version_select at 0x7f407355f040>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:12.898784 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a6bddf3a-6168-4eb0-88f8-75e933779292 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:12.901834 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a6bddf3a-6168-4eb0-88f8-75e933779292 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:12.902557 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a6bddf3a-6168-4eb0-88f8-75e933779292 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:12.942453 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a6bddf3a-6168-4eb0-88f8-75e933779292 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 782 microversion: 2.1 time: 0.065114 Sep 10 11:40:12.943336 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 302/647] 10.222.0.23 () {58 vars in 1143 bytes} [Sat Sep 10 11:40:12 2022] GET /compute/v2.1/os-migrations => generated 782 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:40:12.959911 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cc764c31-f22d-4b82-b971-5bf6e5ccc8b7 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:12.960592 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cc764c31-f22d-4b82-b971-5bf6e5ccc8b7 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] [instance: a21897bf-57b5-43df-b83e-0fe0461a589b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:12.984021 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc764c31-f22d-4b82-b971-5bf6e5ccc8b7 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:12.985440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc764c31-f22d-4b82-b971-5bf6e5ccc8b7 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:12.986066 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc764c31-f22d-4b82-b971-5bf6e5ccc8b7 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:12.986948 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc764c31-f22d-4b82-b971-5bf6e5ccc8b7 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:12.988915 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc764c31-f22d-4b82-b971-5bf6e5ccc8b7 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:12.989530 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc764c31-f22d-4b82-b971-5bf6e5ccc8b7 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:13.250029 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8230a2c8-3cb3-4de4-a3d8-c5ab4b3cbbd2 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:13.294977 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8230a2c8-3cb3-4de4-a3d8-c5ab4b3cbbd2 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c" status: 200 len: 1318 microversion: 2.1 time: 0.655712 Sep 10 11:40:13.296323 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 346/648] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:12 2022] GET /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c => generated 1318 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:13.373284 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cc764c31-f22d-4b82-b971-5bf6e5ccc8b7 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b" status: 200 len: 1629 microversion: 2.1 time: 0.417666 Sep 10 11:40:13.382269 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 303/649] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:12 2022] GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b => generated 1629 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:13.420271 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d36eb649-9bd1-479f-b556-5551f643d670 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Action: 'create', calling method: .version_select at 0x7f4073f37ee0>, body: {"keypair": {"name": "tempest-keypair-1660230733", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdBrXMEpngm6Nv9XCnBQCxC2x8+La0yOlIXAG7abzQ6uZr3g3GnK7WXKG111gMRH9ePHjtI/YXUivTkVDnecO4/GXqRzolgoBTTdUPliNi2MV3DluuwBZxZMJVmvNaW1g=="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:40:13.446511 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-d36eb649-9bd1-479f-b556-5551f643d670 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Getting quotas for project 6750367ae6604f798bfd58e2839f83e2. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:40:13.452436 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-d36eb649-9bd1-479f-b556-5551f643d670 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Getting quotas for user 805e0c24bd364ac8852387db73b614d9 and project 6750367ae6604f798bfd58e2839f83e2. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:40:13.483506 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-47262fa7-41e1-4943-8bfc-0e6c8170c6a4 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:13.484165 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-47262fa7-41e1-4943-8bfc-0e6c8170c6a4 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] [instance: 4c806b91-1302-494f-b4eb-a0b7ba04baf4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:13.489357 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d36eb649-9bd1-479f-b556-5551f643d670 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.075982 Sep 10 11:40:13.490596 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 347/650] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 11:40:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:40:13.497415 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47262fa7-41e1-4943-8bfc-0e6c8170c6a4 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:13.498164 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47262fa7-41e1-4943-8bfc-0e6c8170c6a4 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:13.498612 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47262fa7-41e1-4943-8bfc-0e6c8170c6a4 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:13.500498 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47262fa7-41e1-4943-8bfc-0e6c8170c6a4 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:13.501400 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47262fa7-41e1-4943-8bfc-0e6c8170c6a4 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:13.501829 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47262fa7-41e1-4943-8bfc-0e6c8170c6a4 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:13.857092 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-47262fa7-41e1-4943-8bfc-0e6c8170c6a4 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf661b110ecc4f36b795a980d29f312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5765e50afa045569700eab4616a6a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:13.874398 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-47262fa7-41e1-4943-8bfc-0e6c8170c6a4 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/servers/4c806b91-1302-494f-b4eb-a0b7ba04baf4" status: 200 len: 1466 microversion: 2.1 time: 0.394719 Sep 10 11:40:13.878113 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 304/651] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:13 2022] GET /compute/v2.1/servers/4c806b91-1302-494f-b4eb-a0b7ba04baf4 => generated 1466 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:40:13.893265 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-921702fc-97b6-4d2b-8b17-4cc2d1720c06 tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] Calling method '.version_select at 0x7f40738d83a0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:13.907518 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5f77baac-7a78-43af-8db2-0371b675efe8 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1071076637", "metadata": {"image_type": "test"}}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:40:13.910692 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5f77baac-7a78-43af-8db2-0371b675efe8 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] [instance: 4c806b91-1302-494f-b4eb-a0b7ba04baf4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:13.919828 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5f77baac-7a78-43af-8db2-0371b675efe8 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:13.920444 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5f77baac-7a78-43af-8db2-0371b675efe8 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:13.920972 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5f77baac-7a78-43af-8db2-0371b675efe8 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:13.922226 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5f77baac-7a78-43af-8db2-0371b675efe8 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:13.923068 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5f77baac-7a78-43af-8db2-0371b675efe8 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:13.923768 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5f77baac-7a78-43af-8db2-0371b675efe8 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:13.970835 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-921702fc-97b6-4d2b-8b17-4cc2d1720c06 tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] 10.222.0.23 "GET /compute/v2.1/images/bf4f361c-0998-4388-b335-968fcd3f88a9" status: 200 len: 637 microversion: 2.1 time: 0.088008 Sep 10 11:40:13.981762 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 348/652] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:40:13 2022] GET /compute/v2.1/images/bf4f361c-0998-4388-b335-968fcd3f88a9 => generated 637 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:40:13.993637 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-687b9763-af73-42a7-889b-4423d27c7949 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:13.995270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-687b9763-af73-42a7-889b-4423d27c7949 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:14.021881 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-687b9763-af73-42a7-889b-4423d27c7949 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:14.022874 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-687b9763-af73-42a7-889b-4423d27c7949 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:14.023524 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-687b9763-af73-42a7-889b-4423d27c7949 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:14.028007 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-687b9763-af73-42a7-889b-4423d27c7949 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:14.029212 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-5f77baac-7a78-43af-8db2-0371b675efe8 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Getting quotas for project d5765e50afa045569700eab4616a6a43. Resources: dict_keys(['metadata_items']) {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:40:14.030056 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-687b9763-af73-42a7-889b-4423d27c7949 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:14.032363 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-687b9763-af73-42a7-889b-4423d27c7949 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:14.043814 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-5f77baac-7a78-43af-8db2-0371b675efe8 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Getting quotas for user cf661b110ecc4f36b795a980d29f312a and project d5765e50afa045569700eab4616a6a43. Resources: dict_keys(['metadata_items']) {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:40:14.069558 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:40:14.161198 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-687b9763-af73-42a7-889b-4423d27c7949 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:14.173666 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-687b9763-af73-42a7-889b-4423d27c7949 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:14.176151 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-687b9763-af73-42a7-889b-4423d27c7949 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:14.184955 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-687b9763-af73-42a7-889b-4423d27c7949 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1447 microversion: 2.75 time: 0.203087 Sep 10 11:40:14.186412 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 349/653] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:13 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1447 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:14.192567 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cd0f7c5c-702d-4873-bbf9-eeeea969b035 tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] Action: 'update_all', calling method: .version_select at 0x7f40738d8ca0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:40:14.260478 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-cd0f7c5c-702d-4873-bbf9-eeeea969b035 tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] Getting quotas for project 4c2d721bb0bd4d809f4d178ab99d8f1e. Resources: dict_keys(['metadata_items']) {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:40:14.266782 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-cd0f7c5c-702d-4873-bbf9-eeeea969b035 tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] Getting quotas for user abce5f7c12884a488c32f4472ed9d5c9 and project 4c2d721bb0bd4d809f4d178ab99d8f1e. Resources: dict_keys(['metadata_items']) {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:40:14.332716 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=100 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:40:14.479705 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5f77baac-7a78-43af-8db2-0371b675efe8 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "POST /compute/v2.1/servers/4c806b91-1302-494f-b4eb-a0b7ba04baf4/action" status: 202 len: 0 microversion: 2.1 time: 0.576474 Sep 10 11:40:14.483992 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 305/654] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:40:13 2022] POST /compute/v2.1/servers/4c806b91-1302-494f-b4eb-a0b7ba04baf4/action => generated 0 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 10 11:40:14.508661 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bd0159c5-9b75-43eb-9aef-2992bf6b6275 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:14.511984 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bd0159c5-9b75-43eb-9aef-2992bf6b6275 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: c0cd6b34-210f-4113-b870-f402c588801c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:14.534178 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd0159c5-9b75-43eb-9aef-2992bf6b6275 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:14.535993 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd0159c5-9b75-43eb-9aef-2992bf6b6275 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:14.539568 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd0159c5-9b75-43eb-9aef-2992bf6b6275 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:14.541954 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd0159c5-9b75-43eb-9aef-2992bf6b6275 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:14.544977 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd0159c5-9b75-43eb-9aef-2992bf6b6275 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:14.545757 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd0159c5-9b75-43eb-9aef-2992bf6b6275 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:14.724025 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cd0f7c5c-702d-4873-bbf9-eeeea969b035 tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] 10.222.0.23 "PUT /compute/v2.1/images/bf4f361c-0998-4388-b335-968fcd3f88a9/metadata" status: 200 len: 61 microversion: 2.1 time: 0.536294 Sep 10 11:40:14.725337 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 350/655] 10.222.0.23 () {60 vars in 1280 bytes} [Sat Sep 10 11:40:14 2022] PUT /compute/v2.1/images/bf4f361c-0998-4388-b335-968fcd3f88a9/metadata => generated 61 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:40:14.730497 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d3f786ce-3d6d-44e5-a98f-72d752cd5481 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '.version_select at 0x7f40738a23a0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:14.791313 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d3f786ce-3d6d-44e5-a98f-72d752cd5481 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62" status: 200 len: 1422 microversion: 2.1 time: 0.064677 Sep 10 11:40:14.792539 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 351/656] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:40:14 2022] GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62 => generated 1422 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:14.798686 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9e901258-5b7d-4ffd-8efe-22fa07e07a73 tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] Calling method '.version_select at 0x7f407397bf70>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:14.913807 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bd0159c5-9b75-43eb-9aef-2992bf6b6275 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:14.931054 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bd0159c5-9b75-43eb-9aef-2992bf6b6275 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c" status: 200 len: 1318 microversion: 2.1 time: 0.441060 Sep 10 11:40:14.932252 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 306/657] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:14 2022] GET /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c => generated 1318 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:15.124107 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9e901258-5b7d-4ffd-8efe-22fa07e07a73 tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] 10.222.0.23 "DELETE /compute/v2.1/images/bf4f361c-0998-4388-b335-968fcd3f88a9/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.330203 Sep 10 11:40:15.125296 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 352/658] 10.222.0.23 () {58 vars in 1296 bytes} [Sat Sep 10 11:40:14 2022] DELETE /compute/v2.1/images/bf4f361c-0998-4388-b335-968fcd3f88a9/metadata/os_version => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:40:15.140238 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e8b1f690-bec8-45fc-b465-a07e84888470 tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] Calling method '.version_select at 0x7f40734e51f0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:15.161569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=22 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:40:15.164770 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:40:15.216692 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b33d1879-1964-49f0-ac3b-a809b892de6e tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:15.217312 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b33d1879-1964-49f0-ac3b-a809b892de6e tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:15.230938 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b33d1879-1964-49f0-ac3b-a809b892de6e tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:15.231745 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b33d1879-1964-49f0-ac3b-a809b892de6e tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:15.233025 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b33d1879-1964-49f0-ac3b-a809b892de6e tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:15.234386 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b33d1879-1964-49f0-ac3b-a809b892de6e tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:15.235191 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b33d1879-1964-49f0-ac3b-a809b892de6e tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:15.235851 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b33d1879-1964-49f0-ac3b-a809b892de6e tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:15.243004 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e8b1f690-bec8-45fc-b465-a07e84888470 tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] 10.222.0.23 "GET /compute/v2.1/images/bf4f361c-0998-4388-b335-968fcd3f88a9/metadata" status: 200 len: 37 microversion: 2.1 time: 0.110180 Sep 10 11:40:15.250295 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 307/659] 10.222.0.23 () {58 vars in 1260 bytes} [Sat Sep 10 11:40:15 2022] GET /compute/v2.1/images/bf4f361c-0998-4388-b335-968fcd3f88a9/metadata => generated 37 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:40:15.268044 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5305dde2-4634-4b61-b4b1-c37d19d88d2c tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] Action: 'update_all', calling method: .version_select at 0x7f407348b280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:40:15.341436 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-5305dde2-4634-4b61-b4b1-c37d19d88d2c tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] Getting quotas for project 4c2d721bb0bd4d809f4d178ab99d8f1e. Resources: dict_keys(['metadata_items']) {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:40:15.347352 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-5305dde2-4634-4b61-b4b1-c37d19d88d2c tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] Getting quotas for user abce5f7c12884a488c32f4472ed9d5c9 and project 4c2d721bb0bd4d809f4d178ab99d8f1e. Resources: dict_keys(['metadata_items']) {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:40:15.403099 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b33d1879-1964-49f0-ac3b-a809b892de6e tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:15.414059 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b33d1879-1964-49f0-ac3b-a809b892de6e tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:15.419735 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b33d1879-1964-49f0-ac3b-a809b892de6e tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:15.432176 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b33d1879-1964-49f0-ac3b-a809b892de6e tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1447 microversion: 2.75 time: 0.219358 Sep 10 11:40:15.451065 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 353/660] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:15 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1447 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:40:15.775658 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5305dde2-4634-4b61-b4b1-c37d19d88d2c tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] 10.222.0.23 "PUT /compute/v2.1/images/bf4f361c-0998-4388-b335-968fcd3f88a9/metadata" status: 200 len: 61 microversion: 2.1 time: 0.513677 Sep 10 11:40:15.777976 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 308/661] 10.222.0.23 () {60 vars in 1280 bytes} [Sat Sep 10 11:40:15 2022] PUT /compute/v2.1/images/bf4f361c-0998-4388-b335-968fcd3f88a9/metadata => generated 61 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:40:15.791287 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c35cf1ad-b585-489b-88eb-7f39217c10b0 tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] Calling method '.version_select at 0x7f40739fd310>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:15.817381 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-efa9985a-e7b5-42e7-839b-b39385aaf4d0 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '.version_select at 0x7f407348b9d0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:15.879140 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c35cf1ad-b585-489b-88eb-7f39217c10b0 tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] 10.222.0.23 "GET /compute/v2.1/images/bf4f361c-0998-4388-b335-968fcd3f88a9/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.092178 Sep 10 11:40:15.889161 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 354/662] 10.222.0.23 () {58 vars in 1290 bytes} [Sat Sep 10 11:40:15 2022] GET /compute/v2.1/images/bf4f361c-0998-4388-b335-968fcd3f88a9/metadata/os_distro => generated 33 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:40:15.899098 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c51e5af2-4bcb-4881-9fed-c34882abda48 tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] Action: 'update_all', calling method: .version_select at 0x7f40738a2790>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:40:15.927066 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-efa9985a-e7b5-42e7-839b-b39385aaf4d0 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62" status: 200 len: 1422 microversion: 2.1 time: 0.123322 Sep 10 11:40:15.928506 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 309/663] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:40:15 2022] GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62 => generated 1422 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:15.958437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9966c416-64f2-4157-8169-b2a3294e91e4 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:15.963480 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9966c416-64f2-4157-8169-b2a3294e91e4 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: c0cd6b34-210f-4113-b870-f402c588801c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:15.974848 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9966c416-64f2-4157-8169-b2a3294e91e4 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:15.976734 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9966c416-64f2-4157-8169-b2a3294e91e4 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:15.978308 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9966c416-64f2-4157-8169-b2a3294e91e4 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:15.979336 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9966c416-64f2-4157-8169-b2a3294e91e4 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:15.980881 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9966c416-64f2-4157-8169-b2a3294e91e4 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:15.981546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9966c416-64f2-4157-8169-b2a3294e91e4 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:15.983223 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=25 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:40:15.991667 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-c51e5af2-4bcb-4881-9fed-c34882abda48 tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] Getting quotas for project 4c2d721bb0bd4d809f4d178ab99d8f1e. Resources: dict_keys(['metadata_items']) {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:40:16.003523 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-c51e5af2-4bcb-4881-9fed-c34882abda48 tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] Getting quotas for user abce5f7c12884a488c32f4472ed9d5c9 and project 4c2d721bb0bd4d809f4d178ab99d8f1e. Resources: dict_keys(['metadata_items']) {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:40:16.228394 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c51e5af2-4bcb-4881-9fed-c34882abda48 tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] 10.222.0.23 "PUT /compute/v2.1/images/bf4f361c-0998-4388-b335-968fcd3f88a9/metadata" status: 200 len: 61 microversion: 2.1 time: 0.336478 Sep 10 11:40:16.229023 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 355/664] 10.222.0.23 () {60 vars in 1280 bytes} [Sat Sep 10 11:40:15 2022] PUT /compute/v2.1/images/bf4f361c-0998-4388-b335-968fcd3f88a9/metadata => generated 61 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:40:16.239642 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2136cd37-3fdc-42de-b8d2-4771de4728f3 tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] Calling method '.version_select at 0x7f4073880d30>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:16.285272 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2136cd37-3fdc-42de-b8d2-4771de4728f3 tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] 10.222.0.23 "GET /compute/v2.1/images/bf4f361c-0998-4388-b335-968fcd3f88a9/metadata" status: 200 len: 61 microversion: 2.1 time: 0.050169 Sep 10 11:40:16.286117 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 356/665] 10.222.0.23 () {58 vars in 1260 bytes} [Sat Sep 10 11:40:16 2022] GET /compute/v2.1/images/bf4f361c-0998-4388-b335-968fcd3f88a9/metadata => generated 61 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:40:16.302209 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e01ed1ca-a2c6-4f12-9da0-4d6b7cc76701 tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] Action: 'update_all', calling method: .version_select at 0x7f40738d8550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:40:16.431065 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-e01ed1ca-a2c6-4f12-9da0-4d6b7cc76701 tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] Getting quotas for project 4c2d721bb0bd4d809f4d178ab99d8f1e. Resources: dict_keys(['metadata_items']) {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:40:16.436140 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:40:16.437124 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-e01ed1ca-a2c6-4f12-9da0-4d6b7cc76701 tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] Getting quotas for user abce5f7c12884a488c32f4472ed9d5c9 and project 4c2d721bb0bd4d809f4d178ab99d8f1e. Resources: dict_keys(['metadata_items']) {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:40:16.599083 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9966c416-64f2-4157-8169-b2a3294e91e4 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:16.612088 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9966c416-64f2-4157-8169-b2a3294e91e4 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c" status: 200 len: 1318 microversion: 2.1 time: 0.661396 Sep 10 11:40:16.619756 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 310/666] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:15 2022] GET /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c => generated 1318 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:16.629415 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4b5e03f3-3f0e-4e30-a162-255b99419fb6 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:16.630989 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4b5e03f3-3f0e-4e30-a162-255b99419fb6 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:16.657531 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b5e03f3-3f0e-4e30-a162-255b99419fb6 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:16.659543 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b5e03f3-3f0e-4e30-a162-255b99419fb6 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:16.660422 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b5e03f3-3f0e-4e30-a162-255b99419fb6 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:16.662559 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b5e03f3-3f0e-4e30-a162-255b99419fb6 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:16.663230 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b5e03f3-3f0e-4e30-a162-255b99419fb6 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:16.663851 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b5e03f3-3f0e-4e30-a162-255b99419fb6 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:16.776219 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e01ed1ca-a2c6-4f12-9da0-4d6b7cc76701 tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] 10.222.0.23 "PUT /compute/v2.1/images/bf4f361c-0998-4388-b335-968fcd3f88a9/metadata" status: 200 len: 61 microversion: 2.1 time: 0.483084 Sep 10 11:40:16.785593 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 357/667] 10.222.0.23 () {60 vars in 1280 bytes} [Sat Sep 10 11:40:16 2022] PUT /compute/v2.1/images/bf4f361c-0998-4388-b335-968fcd3f88a9/metadata => generated 61 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:40:16.826712 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-47641bd4-e5e0-474b-aa34-e235a32118e6 tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] Action: 'update_all', calling method: .version_select at 0x7f40738a2d30>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:40:16.950473 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4b5e03f3-3f0e-4e30-a162-255b99419fb6 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:16.956335 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-47641bd4-e5e0-474b-aa34-e235a32118e6 tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] Getting quotas for project 4c2d721bb0bd4d809f4d178ab99d8f1e. Resources: dict_keys(['metadata_items']) {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:40:16.960266 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4b5e03f3-3f0e-4e30-a162-255b99419fb6 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:16.966469 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4b5e03f3-3f0e-4e30-a162-255b99419fb6 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:16.968595 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-47641bd4-e5e0-474b-aa34-e235a32118e6 tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] Getting quotas for user abce5f7c12884a488c32f4472ed9d5c9 and project 4c2d721bb0bd4d809f4d178ab99d8f1e. Resources: dict_keys(['metadata_items']) {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:40:16.987849 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4b5e03f3-3f0e-4e30-a162-255b99419fb6 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1447 microversion: 2.75 time: 0.366130 Sep 10 11:40:16.988703 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 311/668] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:16 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1447 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:16.999339 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3c846c40-c152-41dd-b2df-c439326fa9c9 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '.version_select at 0x7f4073681790>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:17.135119 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3c846c40-c152-41dd-b2df-c439326fa9c9 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62" status: 200 len: 1422 microversion: 2.1 time: 0.145136 Sep 10 11:40:17.136838 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 312/669] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:40:16 2022] GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62 => generated 1422 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:17.647900 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cf2f5a06-e24f-4668-9683-aecd1aacf3c2 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:17.648599 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cf2f5a06-e24f-4668-9683-aecd1aacf3c2 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: c0cd6b34-210f-4113-b870-f402c588801c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:17.678124 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cf2f5a06-e24f-4668-9683-aecd1aacf3c2 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:17.678978 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cf2f5a06-e24f-4668-9683-aecd1aacf3c2 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:17.679686 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cf2f5a06-e24f-4668-9683-aecd1aacf3c2 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:17.680763 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cf2f5a06-e24f-4668-9683-aecd1aacf3c2 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:17.681492 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cf2f5a06-e24f-4668-9683-aecd1aacf3c2 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:17.682123 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cf2f5a06-e24f-4668-9683-aecd1aacf3c2 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:17.700238 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-47641bd4-e5e0-474b-aa34-e235a32118e6 tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] 10.222.0.23 "PUT /compute/v2.1/images/bf4f361c-0998-4388-b335-968fcd3f88a9/metadata" status: 200 len: 64 microversion: 2.1 time: 0.905687 Sep 10 11:40:17.701074 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 358/670] 10.222.0.23 () {60 vars in 1280 bytes} [Sat Sep 10 11:40:16 2022] PUT /compute/v2.1/images/bf4f361c-0998-4388-b335-968fcd3f88a9/metadata => generated 64 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 10 11:40:17.711572 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c1143b19-748a-4fd0-b204-9015970616f9 tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] Calling method '.version_select at 0x7f4073880d30>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:17.827297 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c1143b19-748a-4fd0-b204-9015970616f9 tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] 10.222.0.23 "GET /compute/v2.1/images/bf4f361c-0998-4388-b335-968fcd3f88a9/metadata" status: 200 len: 64 microversion: 2.1 time: 0.119848 Sep 10 11:40:17.828701 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 359/671] 10.222.0.23 () {58 vars in 1260 bytes} [Sat Sep 10 11:40:17 2022] GET /compute/v2.1/images/bf4f361c-0998-4388-b335-968fcd3f88a9/metadata => generated 64 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 10 11:40:17.842693 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f40c6ef6-022f-42f8-b8e0-dccde79bd157 tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] Action: 'update_all', calling method: .version_select at 0x7f407397b9d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:40:17.974264 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-f40c6ef6-022f-42f8-b8e0-dccde79bd157 tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] Getting quotas for project 4c2d721bb0bd4d809f4d178ab99d8f1e. Resources: dict_keys(['metadata_items']) {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:40:17.988184 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-f40c6ef6-022f-42f8-b8e0-dccde79bd157 tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] Getting quotas for user abce5f7c12884a488c32f4472ed9d5c9 and project 4c2d721bb0bd4d809f4d178ab99d8f1e. Resources: dict_keys(['metadata_items']) {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:40:18.066863 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cf2f5a06-e24f-4668-9683-aecd1aacf3c2 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:18.081322 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cf2f5a06-e24f-4668-9683-aecd1aacf3c2 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c" status: 200 len: 1318 microversion: 2.1 time: 0.442496 Sep 10 11:40:18.082557 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 313/672] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:17 2022] GET /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c => generated 1318 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:18.090215 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8c7b6b83-2fc4-4bcc-800a-1608fa76f0b0 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:18.091076 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8c7b6b83-2fc4-4bcc-800a-1608fa76f0b0 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:18.103757 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c7b6b83-2fc4-4bcc-800a-1608fa76f0b0 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:18.104694 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c7b6b83-2fc4-4bcc-800a-1608fa76f0b0 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:18.105309 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c7b6b83-2fc4-4bcc-800a-1608fa76f0b0 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:18.107142 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c7b6b83-2fc4-4bcc-800a-1608fa76f0b0 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:18.107927 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c7b6b83-2fc4-4bcc-800a-1608fa76f0b0 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:18.108524 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c7b6b83-2fc4-4bcc-800a-1608fa76f0b0 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:18.250041 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8c7b6b83-2fc4-4bcc-800a-1608fa76f0b0 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:18.260040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8c7b6b83-2fc4-4bcc-800a-1608fa76f0b0 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:18.262239 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8c7b6b83-2fc4-4bcc-800a-1608fa76f0b0 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:18.269426 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8c7b6b83-2fc4-4bcc-800a-1608fa76f0b0 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1447 microversion: 2.75 time: 0.184629 Sep 10 11:40:18.294883 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 314/673] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:18 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1447 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:18.307001 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d379cb4e-ed3c-47e7-9ec1-72021d70ee8f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1925204592", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "71f52e07-83f9-4397-aa4d-2431ed919e89"}], "security_groups": [{"name": "tempest-securitygroup--1295916624"}], "key_name": "tempest-keypair-1660230733", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:40:18.574221 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f40c6ef6-022f-42f8-b8e0-dccde79bd157 tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] 10.222.0.23 "PUT /compute/v2.1/images/bf4f361c-0998-4388-b335-968fcd3f88a9/metadata" status: 200 len: 61 microversion: 2.1 time: 0.737412 Sep 10 11:40:18.574821 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 360/674] 10.222.0.23 () {60 vars in 1280 bytes} [Sat Sep 10 11:40:17 2022] PUT /compute/v2.1/images/bf4f361c-0998-4388-b335-968fcd3f88a9/metadata => generated 61 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:40:18.584808 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7a3ae2f0-adb6-4c50-83b5-7680b49ae9f2 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '.version_select at 0x7f40738a2160>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:18.731143 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7a3ae2f0-adb6-4c50-83b5-7680b49ae9f2 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62" status: 200 len: 1422 microversion: 2.1 time: 0.155050 Sep 10 11:40:18.731794 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 361/675] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:40:18 2022] GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62 => generated 1422 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:18.737705 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-de3be43c-d0de-44e7-b96b-678b0d60103c tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] Action: 'update', calling method: .version_select at 0x7f40738d8d30>, body: {"meta": {"os_version": "alt"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:40:18.869319 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-de3be43c-d0de-44e7-b96b-678b0d60103c tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] Getting quotas for project 4c2d721bb0bd4d809f4d178ab99d8f1e. Resources: dict_keys(['metadata_items']) {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:40:18.879341 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-de3be43c-d0de-44e7-b96b-678b0d60103c tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] Getting quotas for user abce5f7c12884a488c32f4472ed9d5c9 and project 4c2d721bb0bd4d809f4d178ab99d8f1e. Resources: dict_keys(['metadata_items']) {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:40:18.901510 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-d379cb4e-ed3c-47e7-9ec1-72021d70ee8f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] validate_networks() for [('71f52e07-83f9-4397-aa4d-2431ed919e89', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:40:19.353562 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-de3be43c-d0de-44e7-b96b-678b0d60103c tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] 10.222.0.23 "PUT /compute/v2.1/images/bf4f361c-0998-4388-b335-968fcd3f88a9/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.620633 Sep 10 11:40:19.354302 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 362/676] 10.222.0.23 () {60 vars in 1313 bytes} [Sat Sep 10 11:40:18 2022] PUT /compute/v2.1/images/bf4f361c-0998-4388-b335-968fcd3f88a9/metadata/os_version => generated 31 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:40:19.364264 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-04a4bed3-1189-4d35-87c4-ae4629448a94 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:19.365364 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-04a4bed3-1189-4d35-87c4-ae4629448a94 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: c0cd6b34-210f-4113-b870-f402c588801c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:19.375787 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-04a4bed3-1189-4d35-87c4-ae4629448a94 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:19.376692 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-04a4bed3-1189-4d35-87c4-ae4629448a94 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:19.377454 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-04a4bed3-1189-4d35-87c4-ae4629448a94 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:19.378477 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-04a4bed3-1189-4d35-87c4-ae4629448a94 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:19.379242 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-04a4bed3-1189-4d35-87c4-ae4629448a94 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:19.379985 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-04a4bed3-1189-4d35-87c4-ae4629448a94 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:20.321311 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-04a4bed3-1189-4d35-87c4-ae4629448a94 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:20.334854 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-04a4bed3-1189-4d35-87c4-ae4629448a94 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c" status: 200 len: 1318 microversion: 2.1 time: 0.979216 Sep 10 11:40:20.335472 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 363/677] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:19 2022] GET /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c => generated 1318 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:20.365019 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6447f6d3-2839-4046-b3ac-3539b5103cc3 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:20.369047 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6447f6d3-2839-4046-b3ac-3539b5103cc3 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:20.393370 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6447f6d3-2839-4046-b3ac-3539b5103cc3 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:20.394154 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6447f6d3-2839-4046-b3ac-3539b5103cc3 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:20.394754 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6447f6d3-2839-4046-b3ac-3539b5103cc3 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:20.395677 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6447f6d3-2839-4046-b3ac-3539b5103cc3 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:20.400318 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6447f6d3-2839-4046-b3ac-3539b5103cc3 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:20.406390 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6447f6d3-2839-4046-b3ac-3539b5103cc3 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:20.641901 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6447f6d3-2839-4046-b3ac-3539b5103cc3 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:20.656163 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6447f6d3-2839-4046-b3ac-3539b5103cc3 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:20.663990 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6447f6d3-2839-4046-b3ac-3539b5103cc3 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:20.689112 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6447f6d3-2839-4046-b3ac-3539b5103cc3 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1447 microversion: 2.75 time: 0.331969 Sep 10 11:40:20.690383 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 364/678] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:20 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1447 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:20.701493 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-26fabc05-1b82-4643-8936-f2fac951eaba tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] Calling method '.version_select at 0x7f4073880430>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:20.783292 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-26fabc05-1b82-4643-8936-f2fac951eaba tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] 10.222.0.23 "GET /compute/v2.1/images/bf4f361c-0998-4388-b335-968fcd3f88a9/metadata" status: 200 len: 58 microversion: 2.1 time: 0.091427 Sep 10 11:40:20.783983 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 365/679] 10.222.0.23 () {58 vars in 1260 bytes} [Sat Sep 10 11:40:20 2022] GET /compute/v2.1/images/bf4f361c-0998-4388-b335-968fcd3f88a9/metadata => generated 58 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:40:20.795305 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-53ba6416-cac7-403f-806b-3cb37767638a tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '.version_select at 0x7f40738d8ee0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:20.872004 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-53ba6416-cac7-403f-806b-3cb37767638a tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62" status: 200 len: 1422 microversion: 2.1 time: 0.086862 Sep 10 11:40:20.873592 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 366/680] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:40:20 2022] GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62 => generated 1422 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:20.887427 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9455c571-1bfc-44b6-8e30-052b36c225d2 tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] Action: 'update_all', calling method: .version_select at 0x7f40738a23a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:40:21.036726 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-9455c571-1bfc-44b6-8e30-052b36c225d2 tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] Getting quotas for project 4c2d721bb0bd4d809f4d178ab99d8f1e. Resources: dict_keys(['metadata_items']) {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:40:21.048025 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-9455c571-1bfc-44b6-8e30-052b36c225d2 tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] Getting quotas for user abce5f7c12884a488c32f4472ed9d5c9 and project 4c2d721bb0bd4d809f4d178ab99d8f1e. Resources: dict_keys(['metadata_items']) {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:40:21.595356 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d379cb4e-ed3c-47e7-9ec1-72021d70ee8f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:40:21.596513 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d379cb4e-ed3c-47e7-9ec1-72021d70ee8f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:40:21.597310 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d379cb4e-ed3c-47e7-9ec1-72021d70ee8f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:40:21.597925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d379cb4e-ed3c-47e7-9ec1-72021d70ee8f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:40:21.598543 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d379cb4e-ed3c-47e7-9ec1-72021d70ee8f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:40:21.624245 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d379cb4e-ed3c-47e7-9ec1-72021d70ee8f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:21.644533 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d379cb4e-ed3c-47e7-9ec1-72021d70ee8f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:21.645214 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d379cb4e-ed3c-47e7-9ec1-72021d70ee8f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:21.646169 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d379cb4e-ed3c-47e7-9ec1-72021d70ee8f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:21.650314 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d379cb4e-ed3c-47e7-9ec1-72021d70ee8f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:21.651400 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d379cb4e-ed3c-47e7-9ec1-72021d70ee8f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:21.715513 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-d379cb4e-ed3c-47e7-9ec1-72021d70ee8f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Getting quotas for project 6750367ae6604f798bfd58e2839f83e2. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:40:21.736754 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-d379cb4e-ed3c-47e7-9ec1-72021d70ee8f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Getting quotas for user 805e0c24bd364ac8852387db73b614d9 and project 6750367ae6604f798bfd58e2839f83e2. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:40:21.778247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d379cb4e-ed3c-47e7-9ec1-72021d70ee8f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:40:21.787540 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d379cb4e-ed3c-47e7-9ec1-72021d70ee8f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:40:21.965120 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9455c571-1bfc-44b6-8e30-052b36c225d2 tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] 10.222.0.23 "PUT /compute/v2.1/images/bf4f361c-0998-4388-b335-968fcd3f88a9/metadata" status: 200 len: 61 microversion: 2.1 time: 1.090168 Sep 10 11:40:21.965715 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 367/681] 10.222.0.23 () {60 vars in 1280 bytes} [Sat Sep 10 11:40:20 2022] PUT /compute/v2.1/images/bf4f361c-0998-4388-b335-968fcd3f88a9/metadata => generated 61 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:40:21.972538 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d3e90238-57f4-4418-8237-f92ea23fc89d tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:21.973396 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d3e90238-57f4-4418-8237-f92ea23fc89d tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: c0cd6b34-210f-4113-b870-f402c588801c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:21.987051 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d379cb4e-ed3c-47e7-9ec1-72021d70ee8f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.690837 Sep 10 11:40:21.989554 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 315/682] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:40:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 3694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:40:21.994803 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d3e90238-57f4-4418-8237-f92ea23fc89d tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:22.001412 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d3e90238-57f4-4418-8237-f92ea23fc89d tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:22.001983 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d3e90238-57f4-4418-8237-f92ea23fc89d tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:22.002736 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d3e90238-57f4-4418-8237-f92ea23fc89d tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:22.003013 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a51c9f5b-9a95-4ff7-a8e6-16b8c3b1ccb4 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:22.003226 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d3e90238-57f4-4418-8237-f92ea23fc89d tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:22.003972 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a51c9f5b-9a95-4ff7-a8e6-16b8c3b1ccb4 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:22.015246 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d3e90238-57f4-4418-8237-f92ea23fc89d tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:22.019629 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:40:22.062251 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a51c9f5b-9a95-4ff7-a8e6-16b8c3b1ccb4 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:22.067322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a51c9f5b-9a95-4ff7-a8e6-16b8c3b1ccb4 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:22.069532 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a51c9f5b-9a95-4ff7-a8e6-16b8c3b1ccb4 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:22.071966 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a51c9f5b-9a95-4ff7-a8e6-16b8c3b1ccb4 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:22.076677 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a51c9f5b-9a95-4ff7-a8e6-16b8c3b1ccb4 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:22.078384 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a51c9f5b-9a95-4ff7-a8e6-16b8c3b1ccb4 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:22.455514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a51c9f5b-9a95-4ff7-a8e6-16b8c3b1ccb4 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:22.476038 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a51c9f5b-9a95-4ff7-a8e6-16b8c3b1ccb4 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:22.490724 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a51c9f5b-9a95-4ff7-a8e6-16b8c3b1ccb4 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:22.506937 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a51c9f5b-9a95-4ff7-a8e6-16b8c3b1ccb4 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1447 microversion: 2.75 time: 0.509707 Sep 10 11:40:22.507576 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 316/683] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:21 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1447 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:22.524687 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a0f26415-112a-4f61-af5f-605f0154b235 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '.version_select at 0x7f40734af1f0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:22.657106 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a0f26415-112a-4f61-af5f-605f0154b235 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62" status: 200 len: 1422 microversion: 2.1 time: 0.144517 Sep 10 11:40:22.657859 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 317/684] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:40:22 2022] GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62 => generated 1422 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:22.695497 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-787bcb23-f084-41fc-ae72-6ef2c1055063 tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] Action: 'create', calling method: .version_select at 0x7f407368b1f0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:40:22.855358 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-787bcb23-f084-41fc-ae72-6ef2c1055063 tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] Getting quotas for project 4c2d721bb0bd4d809f4d178ab99d8f1e. Resources: dict_keys(['metadata_items']) {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:40:22.881652 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-787bcb23-f084-41fc-ae72-6ef2c1055063 tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] Getting quotas for user abce5f7c12884a488c32f4472ed9d5c9 and project 4c2d721bb0bd4d809f4d178ab99d8f1e. Resources: dict_keys(['metadata_items']) {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:40:22.961867 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d3e90238-57f4-4418-8237-f92ea23fc89d tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:22.972397 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d3e90238-57f4-4418-8237-f92ea23fc89d tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c" status: 200 len: 1318 microversion: 2.1 time: 1.004768 Sep 10 11:40:22.979236 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 368/685] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:21 2022] GET /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c => generated 1318 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:23.006775 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3a38e164-ac6e-4a6f-b609-34e5704a6cfa tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:23.007830 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3a38e164-ac6e-4a6f-b609-34e5704a6cfa tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:23.449418 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3a38e164-ac6e-4a6f-b609-34e5704a6cfa tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:23.458784 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3a38e164-ac6e-4a6f-b609-34e5704a6cfa tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1235 microversion: 2.1 time: 0.478076 Sep 10 11:40:23.462877 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 369/686] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:22 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1235 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:23.538335 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-00e2c2e7-a2b3-4104-9acc-2e6b8cc271ba tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:23.540824 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-00e2c2e7-a2b3-4104-9acc-2e6b8cc271ba tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:23.560018 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00e2c2e7-a2b3-4104-9acc-2e6b8cc271ba tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:23.560594 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00e2c2e7-a2b3-4104-9acc-2e6b8cc271ba tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:23.561044 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00e2c2e7-a2b3-4104-9acc-2e6b8cc271ba tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:23.563632 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00e2c2e7-a2b3-4104-9acc-2e6b8cc271ba tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:23.564119 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00e2c2e7-a2b3-4104-9acc-2e6b8cc271ba tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:23.564552 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00e2c2e7-a2b3-4104-9acc-2e6b8cc271ba tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:23.727776 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-00e2c2e7-a2b3-4104-9acc-2e6b8cc271ba tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:23.744026 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-00e2c2e7-a2b3-4104-9acc-2e6b8cc271ba tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:23.745568 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-00e2c2e7-a2b3-4104-9acc-2e6b8cc271ba tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:23.773821 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-00e2c2e7-a2b3-4104-9acc-2e6b8cc271ba tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1447 microversion: 2.75 time: 0.230806 Sep 10 11:40:23.777035 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 370/687] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:23 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1447 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:40:23.785838 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-787bcb23-f084-41fc-ae72-6ef2c1055063 tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] 10.222.0.23 "POST /compute/v2.1/images/bf4f361c-0998-4388-b335-968fcd3f88a9/metadata" status: 200 len: 85 microversion: 2.1 time: 1.115709 Sep 10 11:40:23.793072 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-38f28eb9-b0b8-4bfa-aa74-67b2bfc4db02 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '.version_select at 0x7f40738d8160>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:23.797041 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 318/688] 10.222.0.23 () {60 vars in 1281 bytes} [Sat Sep 10 11:40:22 2022] POST /compute/v2.1/images/bf4f361c-0998-4388-b335-968fcd3f88a9/metadata => generated 85 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:40:23.814779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ca1b07bb-9bd5-433f-bab2-9d7513922b5a tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] Calling method '.version_select at 0x7f407369adc0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:24.002790 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-38f28eb9-b0b8-4bfa-aa74-67b2bfc4db02 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62" status: 200 len: 1422 microversion: 2.1 time: 0.222936 Sep 10 11:40:24.005587 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 371/689] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:40:23 2022] GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62 => generated 1422 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:24.016480 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ca1b07bb-9bd5-433f-bab2-9d7513922b5a tempest-ImagesMetadataTestJSON-1298414610 tempest-ImagesMetadataTestJSON-1298414610-project] 10.222.0.23 "GET /compute/v2.1/images/bf4f361c-0998-4388-b335-968fcd3f88a9/metadata" status: 200 len: 85 microversion: 2.1 time: 0.217923 Sep 10 11:40:24.023375 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 319/690] 10.222.0.23 () {58 vars in 1260 bytes} [Sat Sep 10 11:40:23 2022] GET /compute/v2.1/images/bf4f361c-0998-4388-b335-968fcd3f88a9/metadata => generated 85 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:40:24.032412 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-af4cc870-ebb7-4e87-a796-5ea373b59a86 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:24.048918 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-af4cc870-ebb7-4e87-a796-5ea373b59a86 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: c0cd6b34-210f-4113-b870-f402c588801c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:24.068374 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af4cc870-ebb7-4e87-a796-5ea373b59a86 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:24.071819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af4cc870-ebb7-4e87-a796-5ea373b59a86 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:24.072776 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af4cc870-ebb7-4e87-a796-5ea373b59a86 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:24.073896 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af4cc870-ebb7-4e87-a796-5ea373b59a86 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:24.074684 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af4cc870-ebb7-4e87-a796-5ea373b59a86 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:24.076019 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af4cc870-ebb7-4e87-a796-5ea373b59a86 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:24.486281 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-dc115d4f-9805-4760-812d-a52a96f2ccf8 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:24.486904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-dc115d4f-9805-4760-812d-a52a96f2ccf8 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:24.498207 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dc115d4f-9805-4760-812d-a52a96f2ccf8 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:24.498708 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dc115d4f-9805-4760-812d-a52a96f2ccf8 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:24.504534 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dc115d4f-9805-4760-812d-a52a96f2ccf8 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:24.507466 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dc115d4f-9805-4760-812d-a52a96f2ccf8 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:24.515899 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dc115d4f-9805-4760-812d-a52a96f2ccf8 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:24.524606 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dc115d4f-9805-4760-812d-a52a96f2ccf8 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:24.746780 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-af4cc870-ebb7-4e87-a796-5ea373b59a86 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:24.789851 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-af4cc870-ebb7-4e87-a796-5ea373b59a86 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c" status: 200 len: 1318 microversion: 2.1 time: 0.779693 Sep 10 11:40:24.792636 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 372/691] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:24 2022] GET /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c => generated 1318 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:24.817339 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6f84966f-ed4f-4a62-8a58-2ed43c146ee7 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:24.830477 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6f84966f-ed4f-4a62-8a58-2ed43c146ee7 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:24.853984 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f84966f-ed4f-4a62-8a58-2ed43c146ee7 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:24.856884 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f84966f-ed4f-4a62-8a58-2ed43c146ee7 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:24.860278 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f84966f-ed4f-4a62-8a58-2ed43c146ee7 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:24.861373 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f84966f-ed4f-4a62-8a58-2ed43c146ee7 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:24.863745 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f84966f-ed4f-4a62-8a58-2ed43c146ee7 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:24.864358 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f84966f-ed4f-4a62-8a58-2ed43c146ee7 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:24.878749 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-dc115d4f-9805-4760-812d-a52a96f2ccf8 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:24.894051 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-dc115d4f-9805-4760-812d-a52a96f2ccf8 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1287 microversion: 2.1 time: 0.411400 Sep 10 11:40:24.911190 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 320/692] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:24 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1287 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:40:25.019372 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8421652a-7cd1-4517-b14a-66d5d3c72e33 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '.version_select at 0x7f407348b310>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:25.071668 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6f84966f-ed4f-4a62-8a58-2ed43c146ee7 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:25.090345 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6f84966f-ed4f-4a62-8a58-2ed43c146ee7 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:25.091889 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6f84966f-ed4f-4a62-8a58-2ed43c146ee7 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:25.121434 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6f84966f-ed4f-4a62-8a58-2ed43c146ee7 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1447 microversion: 2.75 time: 0.316384 Sep 10 11:40:25.122873 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8421652a-7cd1-4517-b14a-66d5d3c72e33 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62" status: 200 len: 1422 microversion: 2.1 time: 0.104339 Sep 10 11:40:25.144492 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 321/693] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:40:25 2022] GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62 => generated 1422 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:25.149693 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 373/694] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:24 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1447 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:25.819250 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-77e71d75-54ee-4bae-b977-6b93b2841c0a tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:25.819875 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-77e71d75-54ee-4bae-b977-6b93b2841c0a tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: c0cd6b34-210f-4113-b870-f402c588801c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:25.842374 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-77e71d75-54ee-4bae-b977-6b93b2841c0a tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:25.849175 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-77e71d75-54ee-4bae-b977-6b93b2841c0a tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:25.851867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-77e71d75-54ee-4bae-b977-6b93b2841c0a tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:25.855272 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-77e71d75-54ee-4bae-b977-6b93b2841c0a tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:25.858640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-77e71d75-54ee-4bae-b977-6b93b2841c0a tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:25.860595 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-77e71d75-54ee-4bae-b977-6b93b2841c0a tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:25.923992 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2cb2a1d0-acc4-49ee-9896-849cdfd44ede tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:25.924783 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2cb2a1d0-acc4-49ee-9896-849cdfd44ede tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:25.937304 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2cb2a1d0-acc4-49ee-9896-849cdfd44ede tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:25.941570 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2cb2a1d0-acc4-49ee-9896-849cdfd44ede tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:25.943678 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2cb2a1d0-acc4-49ee-9896-849cdfd44ede tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:25.947122 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2cb2a1d0-acc4-49ee-9896-849cdfd44ede tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:25.948089 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2cb2a1d0-acc4-49ee-9896-849cdfd44ede tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:25.948754 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2cb2a1d0-acc4-49ee-9896-849cdfd44ede tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:26.156966 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2cb2a1d0-acc4-49ee-9896-849cdfd44ede tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:26.171859 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2cb2a1d0-acc4-49ee-9896-849cdfd44ede tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1293 microversion: 2.1 time: 0.253171 Sep 10 11:40:26.173913 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 374/695] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:25 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1293 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:26.204372 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bdd1e3c9-e3ee-4970-bb19-4f608e5d01dc tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '.version_select at 0x7f407396e820>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:26.295097 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bdd1e3c9-e3ee-4970-bb19-4f608e5d01dc tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62" status: 200 len: 1422 microversion: 2.1 time: 0.120093 Sep 10 11:40:26.296968 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 375/696] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:40:26 2022] GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62 => generated 1422 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:26.315686 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-13d84c46-d3a1-4d74-acb0-53f3db30b9b8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:26.324174 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-13d84c46-d3a1-4d74-acb0-53f3db30b9b8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:26.348212 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13d84c46-d3a1-4d74-acb0-53f3db30b9b8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:26.356500 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13d84c46-d3a1-4d74-acb0-53f3db30b9b8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:26.360098 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13d84c46-d3a1-4d74-acb0-53f3db30b9b8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:26.360957 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13d84c46-d3a1-4d74-acb0-53f3db30b9b8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:26.364126 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13d84c46-d3a1-4d74-acb0-53f3db30b9b8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:26.366944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13d84c46-d3a1-4d74-acb0-53f3db30b9b8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:26.523324 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-13d84c46-d3a1-4d74-acb0-53f3db30b9b8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:26.540070 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-13d84c46-d3a1-4d74-acb0-53f3db30b9b8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:26.543647 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-13d84c46-d3a1-4d74-acb0-53f3db30b9b8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:26.560397 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-13d84c46-d3a1-4d74-acb0-53f3db30b9b8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1447 microversion: 2.75 time: 0.260911 Sep 10 11:40:26.561392 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 376/697] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:26 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1447 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:26.582332 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-77e71d75-54ee-4bae-b977-6b93b2841c0a tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:26.592169 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-77e71d75-54ee-4bae-b977-6b93b2841c0a tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c" status: 200 len: 1318 microversion: 2.1 time: 0.778888 Sep 10 11:40:26.592902 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 322/698] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:25 2022] GET /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c => generated 1318 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:27.125523 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-fc338931-0a26-4852-a8a7-9449135e92c6 req-c41fd88f-9157-4141-8544-543d1bddca6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0cd6b34-210f-4113-b870-f402c588801c", "name": "network-vif-plugged", "status": "completed", "tag": "f33545ba-898c-40db-b80a-66a1332af80f"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:40:27.157728 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-fc338931-0a26-4852-a8a7-9449135e92c6 req-c41fd88f-9157-4141-8544-543d1bddca6a service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:27.159061 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-fc338931-0a26-4852-a8a7-9449135e92c6 req-c41fd88f-9157-4141-8544-543d1bddca6a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:27.159832 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-fc338931-0a26-4852-a8a7-9449135e92c6 req-c41fd88f-9157-4141-8544-543d1bddca6a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:27.186271 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-fc338931-0a26-4852-a8a7-9449135e92c6 req-c41fd88f-9157-4141-8544-543d1bddca6a service nova] Creating event network-vif-plugged:f33545ba-898c-40db-b80a-66a1332af80f for instance c0cd6b34-210f-4113-b870-f402c588801c on n-h2-856895-1 Sep 10 11:40:27.194326 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-fc338931-0a26-4852-a8a7-9449135e92c6 req-c41fd88f-9157-4141-8544-543d1bddca6a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080262 Sep 10 11:40:27.202008 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-49d4ce32-1c9b-4127-933b-79c5e2e4b594 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:27.202706 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-49d4ce32-1c9b-4127-933b-79c5e2e4b594 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:27.217509 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 377/699] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:40:27.239931 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-49d4ce32-1c9b-4127-933b-79c5e2e4b594 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:27.258236 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-49d4ce32-1c9b-4127-933b-79c5e2e4b594 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:27.258719 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-49d4ce32-1c9b-4127-933b-79c5e2e4b594 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:27.259502 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-49d4ce32-1c9b-4127-933b-79c5e2e4b594 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:27.259969 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-49d4ce32-1c9b-4127-933b-79c5e2e4b594 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:27.260394 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-49d4ce32-1c9b-4127-933b-79c5e2e4b594 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:27.315649 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9d0d318e-c44c-4ac7-b9cf-fd433cac5d80 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '.version_select at 0x7f40738a24c0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:27.397908 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9d0d318e-c44c-4ac7-b9cf-fd433cac5d80 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62" status: 200 len: 1422 microversion: 2.1 time: 0.087154 Sep 10 11:40:27.409930 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 378/700] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:40:27 2022] GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62 => generated 1422 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:27.472309 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-49d4ce32-1c9b-4127-933b-79c5e2e4b594 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:27.481208 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-49d4ce32-1c9b-4127-933b-79c5e2e4b594 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1293 microversion: 2.1 time: 0.285114 Sep 10 11:40:27.488098 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 323/701] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:27 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1293 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:27.603801 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1d1dff0b-930c-44a9-a5ba-224fdcc88133 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:27.605672 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1d1dff0b-930c-44a9-a5ba-224fdcc88133 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:27.614092 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d1dff0b-930c-44a9-a5ba-224fdcc88133 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:27.615517 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d1dff0b-930c-44a9-a5ba-224fdcc88133 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:27.616270 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d1dff0b-930c-44a9-a5ba-224fdcc88133 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:27.617240 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d1dff0b-930c-44a9-a5ba-224fdcc88133 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:27.627500 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d1dff0b-930c-44a9-a5ba-224fdcc88133 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:27.628292 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d1dff0b-930c-44a9-a5ba-224fdcc88133 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:27.846497 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1d1dff0b-930c-44a9-a5ba-224fdcc88133 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:27.879541 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1d1dff0b-930c-44a9-a5ba-224fdcc88133 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:27.894045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1d1dff0b-930c-44a9-a5ba-224fdcc88133 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:27.945405 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1d1dff0b-930c-44a9-a5ba-224fdcc88133 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1447 microversion: 2.75 time: 0.352478 Sep 10 11:40:27.970375 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 324/702] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:27 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1447 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:27.984405 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e227d525-06a2-43e7-83b0-4907253afda7 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1947323", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "9d0f720d-8913-424b-864d-897845ccb4e7"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:40:27.993654 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-435b7be2-fef1-4ae7-8cb9-17407f45e958 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:27.994291 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-435b7be2-fef1-4ae7-8cb9-17407f45e958 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: c0cd6b34-210f-4113-b870-f402c588801c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:28.019792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-435b7be2-fef1-4ae7-8cb9-17407f45e958 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:28.020305 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-435b7be2-fef1-4ae7-8cb9-17407f45e958 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:28.020749 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-435b7be2-fef1-4ae7-8cb9-17407f45e958 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:28.027603 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-435b7be2-fef1-4ae7-8cb9-17407f45e958 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:28.028101 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-435b7be2-fef1-4ae7-8cb9-17407f45e958 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:28.032823 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-435b7be2-fef1-4ae7-8cb9-17407f45e958 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:28.188705 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-e227d525-06a2-43e7-83b0-4907253afda7 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] validate_networks() for [('9d0f720d-8913-424b-864d-897845ccb4e7', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:40:28.954808 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-435b7be2-fef1-4ae7-8cb9-17407f45e958 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:28.965997 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-435b7be2-fef1-4ae7-8cb9-17407f45e958 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c" status: 200 len: 1318 microversion: 2.1 time: 0.994092 Sep 10 11:40:28.978142 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 325/703] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:27 2022] GET /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c => generated 1318 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:28.992226 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ee517e90-e882-4fce-923b-01cfe8a93112 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '.version_select at 0x7f4073462280>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:29.067118 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ee517e90-e882-4fce-923b-01cfe8a93112 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62" status: 200 len: 1422 microversion: 2.1 time: 0.087507 Sep 10 11:40:29.076663 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 326/704] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:40:28 2022] GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62 => generated 1422 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:29.090936 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8e1614b9-b5a8-45aa-86f1-678c18bb3e35 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:29.091737 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8e1614b9-b5a8-45aa-86f1-678c18bb3e35 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:29.106659 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e1614b9-b5a8-45aa-86f1-678c18bb3e35 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:29.113640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e1614b9-b5a8-45aa-86f1-678c18bb3e35 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:29.114337 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e1614b9-b5a8-45aa-86f1-678c18bb3e35 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:29.115432 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e1614b9-b5a8-45aa-86f1-678c18bb3e35 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:29.116121 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e1614b9-b5a8-45aa-86f1-678c18bb3e35 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:29.116895 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e1614b9-b5a8-45aa-86f1-678c18bb3e35 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:30.268826 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8e1614b9-b5a8-45aa-86f1-678c18bb3e35 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:30.281120 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8e1614b9-b5a8-45aa-86f1-678c18bb3e35 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1361 microversion: 2.1 time: 1.197435 Sep 10 11:40:30.286706 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 327/705] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:29 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1361 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:30.299086 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2c671e4b-a0c7-48be-b737-f4516219915a tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:30.300294 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2c671e4b-a0c7-48be-b737-f4516219915a tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:30.316452 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c671e4b-a0c7-48be-b737-f4516219915a tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:30.317510 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c671e4b-a0c7-48be-b737-f4516219915a tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:30.318101 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c671e4b-a0c7-48be-b737-f4516219915a tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:30.318959 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c671e4b-a0c7-48be-b737-f4516219915a tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:30.320515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c671e4b-a0c7-48be-b737-f4516219915a tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:30.322044 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c671e4b-a0c7-48be-b737-f4516219915a tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:30.553511 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-e227d525-06a2-43e7-83b0-4907253afda7 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:40:30.554030 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-e227d525-06a2-43e7-83b0-4907253afda7 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:40:30.554427 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-e227d525-06a2-43e7-83b0-4907253afda7 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:40:30.554844 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-e227d525-06a2-43e7-83b0-4907253afda7 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:40:30.555294 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-e227d525-06a2-43e7-83b0-4907253afda7 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:40:30.597524 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e227d525-06a2-43e7-83b0-4907253afda7 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:30.598552 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e227d525-06a2-43e7-83b0-4907253afda7 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:30.599020 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e227d525-06a2-43e7-83b0-4907253afda7 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:30.602127 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e227d525-06a2-43e7-83b0-4907253afda7 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:30.611516 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e227d525-06a2-43e7-83b0-4907253afda7 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:30.612018 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e227d525-06a2-43e7-83b0-4907253afda7 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:30.681493 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2c671e4b-a0c7-48be-b737-f4516219915a tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:30.690439 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-e227d525-06a2-43e7-83b0-4907253afda7 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Getting quotas for project c8c0800673e247fb8b3b3718512233c0. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:40:30.717027 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-e227d525-06a2-43e7-83b0-4907253afda7 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Getting quotas for user 1106bb2c5ce14c21a15ad62942745b62 and project c8c0800673e247fb8b3b3718512233c0. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:40:30.742523 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2c671e4b-a0c7-48be-b737-f4516219915a tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:30.745335 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e227d525-06a2-43e7-83b0-4907253afda7 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:40:30.754791 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2c671e4b-a0c7-48be-b737-f4516219915a tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:30.758281 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e227d525-06a2-43e7-83b0-4907253afda7 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: f600488a-7c52-4a96-9375-2723bf42cf83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:40:30.777115 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2c671e4b-a0c7-48be-b737-f4516219915a tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1453 microversion: 2.75 time: 0.487547 Sep 10 11:40:30.807576 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 328/706] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:30 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1453 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:30.830407 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-85082eff-69e0-443e-b045-afe8a90ccb7c req-3f38a26a-6641-4535-8732-ff0871e2ed9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c806b91-1302-494f-b4eb-a0b7ba04baf4", "name": "network-vif-plugged", "status": "completed", "tag": "3488be85-30de-46d4-a138-f4f55f4c37ce"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:40:30.866029 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-85082eff-69e0-443e-b045-afe8a90ccb7c req-3f38a26a-6641-4535-8732-ff0871e2ed9e service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:30.866935 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-85082eff-69e0-443e-b045-afe8a90ccb7c req-3f38a26a-6641-4535-8732-ff0871e2ed9e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:30.867656 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-85082eff-69e0-443e-b045-afe8a90ccb7c req-3f38a26a-6641-4535-8732-ff0871e2ed9e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:30.895037 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-85082eff-69e0-443e-b045-afe8a90ccb7c req-3f38a26a-6641-4535-8732-ff0871e2ed9e service nova] Creating event network-vif-plugged:3488be85-30de-46d4-a138-f4f55f4c37ce for instance 4c806b91-1302-494f-b4eb-a0b7ba04baf4 on n-h2-856895-1 Sep 10 11:40:30.903620 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-85082eff-69e0-443e-b045-afe8a90ccb7c req-3f38a26a-6641-4535-8732-ff0871e2ed9e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094208 Sep 10 11:40:30.904930 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 329/707] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:40:30.913428 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-f61ef4cf-44ce-4cd5-81aa-cb97b53c032e req-c0de5020-5191-4cf3-a05e-3eee616fa6c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53e36757-9924-4d03-a8c0-fe52a166ffc1", "tag": "42683686-90d1-4e9e-9012-b0ee66c9e930"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:40:30.928413 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-f61ef4cf-44ce-4cd5-81aa-cb97b53c032e req-c0de5020-5191-4cf3-a05e-3eee616fa6c4 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:30.929515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-f61ef4cf-44ce-4cd5-81aa-cb97b53c032e req-c0de5020-5191-4cf3-a05e-3eee616fa6c4 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:30.930292 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-f61ef4cf-44ce-4cd5-81aa-cb97b53c032e req-c0de5020-5191-4cf3-a05e-3eee616fa6c4 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:30.946424 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-f61ef4cf-44ce-4cd5-81aa-cb97b53c032e req-c0de5020-5191-4cf3-a05e-3eee616fa6c4 service nova] Creating event network-changed:42683686-90d1-4e9e-9012-b0ee66c9e930 for instance 53e36757-9924-4d03-a8c0-fe52a166ffc1 on n-h1-856895-1 Sep 10 11:40:30.948459 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e227d525-06a2-43e7-83b0-4907253afda7 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.368938 Sep 10 11:40:30.951187 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 379/708] 10.222.0.23 () {62 vars in 1188 bytes} [Sat Sep 10 11:40:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 3377 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 10 11:40:30.964992 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-f61ef4cf-44ce-4cd5-81aa-cb97b53c032e req-c0de5020-5191-4cf3-a05e-3eee616fa6c4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057929 Sep 10 11:40:30.966051 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 330/709] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:40:30.969439 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f7c23b01-4968-4594-91b7-e0423df3fbf7 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:30.979822 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f7c23b01-4968-4594-91b7-e0423df3fbf7 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: c0cd6b34-210f-4113-b870-f402c588801c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:30.981381 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fbc70b4d-8b98-4b9c-bb67-68b077dfb285 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '.version_select at 0x7f407344ee50>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:31.003704 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f7c23b01-4968-4594-91b7-e0423df3fbf7 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:31.005348 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f7c23b01-4968-4594-91b7-e0423df3fbf7 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:31.005744 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f7c23b01-4968-4594-91b7-e0423df3fbf7 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:31.014400 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f7c23b01-4968-4594-91b7-e0423df3fbf7 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:31.015719 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f7c23b01-4968-4594-91b7-e0423df3fbf7 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:31.016181 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f7c23b01-4968-4594-91b7-e0423df3fbf7 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:31.068756 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fbc70b4d-8b98-4b9c-bb67-68b077dfb285 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62" status: 200 len: 1422 microversion: 2.1 time: 0.095485 Sep 10 11:40:31.086730 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 331/710] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:40:30 2022] GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62 => generated 1422 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:31.095892 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d24ea81e-7ee2-4df4-a12b-4166ef9b09c4 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:31.097639 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d24ea81e-7ee2-4df4-a12b-4166ef9b09c4 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: f600488a-7c52-4a96-9375-2723bf42cf83] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:31.438125 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d24ea81e-7ee2-4df4-a12b-4166ef9b09c4 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:31.460494 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d24ea81e-7ee2-4df4-a12b-4166ef9b09c4 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:31.462548 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d24ea81e-7ee2-4df4-a12b-4166ef9b09c4 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:31.463834 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d24ea81e-7ee2-4df4-a12b-4166ef9b09c4 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83" status: 200 len: 1259 microversion: 2.25 time: 0.375369 Sep 10 11:40:31.464618 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 332/711] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:31 2022] GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83 => generated 1259 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:31.469747 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d7dcac4c-f441-4948-8a14-3148b17c70fb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:31.470421 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d7dcac4c-f441-4948-8a14-3148b17c70fb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:31.478867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d7dcac4c-f441-4948-8a14-3148b17c70fb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:31.479559 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d7dcac4c-f441-4948-8a14-3148b17c70fb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:31.480263 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d7dcac4c-f441-4948-8a14-3148b17c70fb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:31.480914 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d7dcac4c-f441-4948-8a14-3148b17c70fb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:31.481438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d7dcac4c-f441-4948-8a14-3148b17c70fb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:31.481868 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d7dcac4c-f441-4948-8a14-3148b17c70fb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:31.689879 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:40:32.465645 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f7c23b01-4968-4594-91b7-e0423df3fbf7 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:32.480001 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f7c23b01-4968-4594-91b7-e0423df3fbf7 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c" status: 200 len: 1468 microversion: 2.1 time: 1.522134 Sep 10 11:40:32.481469 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 380/712] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:30 2022] GET /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c => generated 1468 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:32.496203 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-69ad4ce2-d2a7-479e-abe3-acdf4ae26e4b tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:32.497108 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-69ad4ce2-d2a7-479e-abe3-acdf4ae26e4b tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:32.516253 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-69ad4ce2-d2a7-479e-abe3-acdf4ae26e4b tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:32.517234 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-69ad4ce2-d2a7-479e-abe3-acdf4ae26e4b tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:32.517888 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-69ad4ce2-d2a7-479e-abe3-acdf4ae26e4b tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:32.518855 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-69ad4ce2-d2a7-479e-abe3-acdf4ae26e4b tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:32.519727 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-69ad4ce2-d2a7-479e-abe3-acdf4ae26e4b tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:32.520342 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-69ad4ce2-d2a7-479e-abe3-acdf4ae26e4b tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:32.933979 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-69ad4ce2-d2a7-479e-abe3-acdf4ae26e4b tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:32.958573 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d7dcac4c-f441-4948-8a14-3148b17c70fb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:32.968799 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d7dcac4c-f441-4948-8a14-3148b17c70fb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1361 microversion: 2.1 time: 1.502418 Sep 10 11:40:32.970452 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-69ad4ce2-d2a7-479e-abe3-acdf4ae26e4b tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:32.972064 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 333/713] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:31 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1361 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:32.973157 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-69ad4ce2-d2a7-479e-abe3-acdf4ae26e4b tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:32.981151 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-face518e-fd74-41ba-998d-6ca122c3cd64 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '.version_select at 0x7f407357ec10>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:32.998524 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-69ad4ce2-d2a7-479e-abe3-acdf4ae26e4b tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1453 microversion: 2.75 time: 0.514859 Sep 10 11:40:33.000357 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 381/714] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:32 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1453 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:33.023547 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-841f545d-5116-46af-a241-04e139d276dc tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:33.024430 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-841f545d-5116-46af-a241-04e139d276dc tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: f600488a-7c52-4a96-9375-2723bf42cf83] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:33.040288 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-841f545d-5116-46af-a241-04e139d276dc tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:33.042609 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-841f545d-5116-46af-a241-04e139d276dc tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:33.043361 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-841f545d-5116-46af-a241-04e139d276dc tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:33.044811 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-841f545d-5116-46af-a241-04e139d276dc tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:33.047818 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-841f545d-5116-46af-a241-04e139d276dc tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:33.048559 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-841f545d-5116-46af-a241-04e139d276dc tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:33.108285 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-face518e-fd74-41ba-998d-6ca122c3cd64 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62" status: 200 len: 1422 microversion: 2.1 time: 0.133748 Sep 10 11:40:33.127602 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 334/715] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:40:32 2022] GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62 => generated 1422 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:33.211245 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-841f545d-5116-46af-a241-04e139d276dc tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:33.232581 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-841f545d-5116-46af-a241-04e139d276dc tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:33.239002 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-841f545d-5116-46af-a241-04e139d276dc tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:33.243943 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-841f545d-5116-46af-a241-04e139d276dc tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83" status: 200 len: 1311 microversion: 2.25 time: 0.235351 Sep 10 11:40:33.244698 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 382/716] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:33 2022] GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83 => generated 1311 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:33.660217 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-da38c325-05a4-44ae-a176-21c507c24ed5 tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-47840462", "block_migration": true, "disk_over_commit": false}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:40:33.662772 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-da38c325-05a4-44ae-a176-21c507c24ed5 tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] [instance: c0cd6b34-210f-4113-b870-f402c588801c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:33.695815 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-da38c325-05a4-44ae-a176-21c507c24ed5 tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:33.697456 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-da38c325-05a4-44ae-a176-21c507c24ed5 tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:33.700371 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-da38c325-05a4-44ae-a176-21c507c24ed5 tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:33.701589 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-da38c325-05a4-44ae-a176-21c507c24ed5 tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:33.702047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-da38c325-05a4-44ae-a176-21c507c24ed5 tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:33.707669 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-da38c325-05a4-44ae-a176-21c507c24ed5 tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:33.736418 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:40:33.761273 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-da38c325-05a4-44ae-a176-21c507c24ed5 tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] Lazy-loading 'flavor' on Instance uuid c0cd6b34-210f-4113-b870-f402c588801c {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:40:33.776845 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-da38c325-05a4-44ae-a176-21c507c24ed5 tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] [instance: c0cd6b34-210f-4113-b870-f402c588801c] Going to try to live migrate instance to tempest-host-47840462 {{(pid=128777) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 10 11:40:33.793585 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-da38c325-05a4-44ae-a176-21c507c24ed5 tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] HTTP exception thrown: Compute host tempest-host-47840462 could not be found. Sep 10 11:40:33.799087 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-da38c325-05a4-44ae-a176-21c507c24ed5 tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] Request method failure captured: Sep 10 11:40:33.799087 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c/action HTTP/1.1 Sep 10 11:40:33.799087 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:40:33.799087 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:40:33.799087 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:40:33.799087 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 105 Sep 10 11:40:33.799087 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:40:33.799087 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:40:33.799087 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:40:33.799087 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:40:33.799087 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHeTjFaCblyZgvOKMuwHu5midDQtzDm8ZkmozIv9002vcuNd9RVVDBf4pjC_EQTcfdTCv0A8GAV87GoKgb2LZBlzNg7fyTeBwOs7t755oLWW_D5lmud1aXff7kCSmqPPhQ19wepdTn01U9Ey9DstktpOsry2_GLX_OnyIYVUAL1--Ik Sep 10 11:40:33.799087 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:40:33.799087 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:40:33.799087 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:40:33.799087 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:40:33.799087 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:40:33.799087 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:40:33.799087 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 2ecc9e2891fd47e1b86688b138756e4f Sep 10 11:40:33.799087 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-LiveMigrationNegativeTest-1341960967 Sep 10 11:40:33.799087 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,admin,member Sep 10 11:40:33.799087 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,admin,member Sep 10 11:40:33.800641 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2ecc9e2891fd47e1b86688b138756e4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2ecc9e2891fd47e1b86688b138756e4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2ecc9e2891fd47e1b86688b138756e4f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2ecc9e2891fd47e1b86688b138756e4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:40:33.800641 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-LiveMigrationNegativeTest-1341960967 Sep 10 11:40:33.800641 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 2ecc9e2891fd47e1b86688b138756e4f Sep 10 11:40:33.800641 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1341960967 Sep 10 11:40:33.800641 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-LiveMigrationNegativeTest-1341960967-project-admin Sep 10 11:40:33.800641 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:40:33.800641 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:40:33.800641 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 9b4fc7a6b7be487badd3f4d7c51e608c Sep 10 11:40:33.800641 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-LiveMigrationNegativeTest-1341960967-project-admin Sep 10 11:40:33.800641 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:40:33.800641 n-d-856895-1 devstack@n-api.service[128777]: {"os-migrateLive": {"host": "tempest-host-47840462", "block_migration": true, "disk_over_commit": false}} Sep 10 11:40:33.800641 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:40:33.801406 n-d-856895-1 devstack@n-api.service[128777]: exception: Compute host tempest-host-47840462 could not be found. Sep 10 11:40:33.801406 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'c0cd6b34-210f-4113-b870-f402c588801c', 'body': {'os-migrateLive': {'host': 'tempest-host-47840462', 'block_migration': True, 'disk_over_commit': False}}} Sep 10 11:40:33.801406 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:40:33.801406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:40:33.801406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 10 11:40:33.801406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 10 11:40:33.801406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 10 11:40:33.801406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 11:40:33.801406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 10 11:40:33.801406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 11:40:33.801406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 10 11:40:33.801406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 11:40:33.801406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 10 11:40:33.801406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 11:40:33.801406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 10 11:40:33.801406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 11:40:33.801406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 10 11:40:33.801406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 11:40:33.801406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 11:40:33.802559 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 11:40:33.802559 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 10 11:40:33.802559 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 11:40:33.802559 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Sep 10 11:40:33.802559 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Sep 10 11:40:33.802559 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 11:40:33.802559 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 11:40:33.802559 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Sep 10 11:40:33.802559 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Sep 10 11:40:33.802559 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Sep 10 11:40:33.802559 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:40:33.802559 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Sep 10 11:40:33.802559 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Sep 10 11:40:33.802559 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Sep 10 11:40:33.802559 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Sep 10 11:40:33.802559 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Sep 10 11:40:33.802559 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Sep 10 11:40:33.802559 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-47840462 could not be found. Sep 10 11:40:33.802559 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:40:33.804754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:40:33.804754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:40:33.804754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:40:33.804754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:40:33.804754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:40:33.804754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:40:33.804754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:40:33.804754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:40:33.804754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:40:33.804754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:40:33.804754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:40:33.804754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:40:33.804754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:40:33.804754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:40:33.804754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:40:33.804754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 10 11:40:33.804754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Sep 10 11:40:33.804754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 10 11:40:33.804754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-47840462 could not be found. Sep 10 11:40:33.804754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:40:33.807101 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:40:33.807101 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:40:33.807101 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:40:33.807101 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:40:33.807101 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:40:33.807101 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:40:33.807101 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:40:33.807101 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-47840462 could not be found. Sep 10 11:40:33.807101 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:40:33.809637 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-da38c325-05a4-44ae-a176-21c507c24ed5 tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] Returning 400 to user: Compute host tempest-host-47840462 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:40:33.810784 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-da38c325-05a4-44ae-a176-21c507c24ed5 tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c/action" status: 400 len: 98 microversion: 2.1 time: 0.681965 Sep 10 11:40:33.812053 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 335/717] 10.222.0.23 () {60 vars in 1279 bytes} [Sat Sep 10 11:40:33 2022] POST /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c/action => generated 98 bytes in 684 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 10 11:40:33.840913 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5fbb85a7-0e2e-485a-8b8a-0fc5836d1cab tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:33.843502 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5fbb85a7-0e2e-485a-8b8a-0fc5836d1cab tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: c0cd6b34-210f-4113-b870-f402c588801c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:33.856585 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5fbb85a7-0e2e-485a-8b8a-0fc5836d1cab tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:33.857345 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5fbb85a7-0e2e-485a-8b8a-0fc5836d1cab tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:33.858002 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5fbb85a7-0e2e-485a-8b8a-0fc5836d1cab tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:33.860216 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5fbb85a7-0e2e-485a-8b8a-0fc5836d1cab tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:33.860897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5fbb85a7-0e2e-485a-8b8a-0fc5836d1cab tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:33.861533 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5fbb85a7-0e2e-485a-8b8a-0fc5836d1cab tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:33.996594 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9a54e491-3f01-4dfd-8bd3-8b53989aa995 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:33.997214 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9a54e491-3f01-4dfd-8bd3-8b53989aa995 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:34.256921 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9a54e491-3f01-4dfd-8bd3-8b53989aa995 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:34.257680 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9a54e491-3f01-4dfd-8bd3-8b53989aa995 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:34.258267 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9a54e491-3f01-4dfd-8bd3-8b53989aa995 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:34.259126 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9a54e491-3f01-4dfd-8bd3-8b53989aa995 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:34.259832 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9a54e491-3f01-4dfd-8bd3-8b53989aa995 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:34.260412 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9a54e491-3f01-4dfd-8bd3-8b53989aa995 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:34.455004 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5fbb85a7-0e2e-485a-8b8a-0fc5836d1cab tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:34.463717 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5fbb85a7-0e2e-485a-8b8a-0fc5836d1cab tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c" status: 200 len: 1468 microversion: 2.1 time: 0.637472 Sep 10 11:40:34.468880 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 383/718] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:33 2022] GET /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c => generated 1468 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:34.496220 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-11e34332-bfbb-4de8-a329-b2992df9bdc8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:34.498624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-11e34332-bfbb-4de8-a329-b2992df9bdc8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:34.513248 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-11e34332-bfbb-4de8-a329-b2992df9bdc8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:34.516610 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-11e34332-bfbb-4de8-a329-b2992df9bdc8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:34.518833 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-11e34332-bfbb-4de8-a329-b2992df9bdc8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:34.519842 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-11e34332-bfbb-4de8-a329-b2992df9bdc8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:34.523700 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-11e34332-bfbb-4de8-a329-b2992df9bdc8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:34.524426 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-11e34332-bfbb-4de8-a329-b2992df9bdc8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:34.713615 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9a54e491-3f01-4dfd-8bd3-8b53989aa995 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:34.723788 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9a54e491-3f01-4dfd-8bd3-8b53989aa995 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1361 microversion: 2.1 time: 0.731984 Sep 10 11:40:34.734359 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 336/719] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:33 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1361 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:34.741687 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ae94784f-7b0d-4645-b35a-3e37552f08b9 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '.version_select at 0x7f407348b1f0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:34.825355 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-11e34332-bfbb-4de8-a329-b2992df9bdc8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:34.847000 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-11e34332-bfbb-4de8-a329-b2992df9bdc8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:34.850659 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-11e34332-bfbb-4de8-a329-b2992df9bdc8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:34.854925 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ae94784f-7b0d-4645-b35a-3e37552f08b9 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62" status: 200 len: 1422 microversion: 2.1 time: 0.119291 Sep 10 11:40:34.868415 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 337/720] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:40:34 2022] GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62 => generated 1422 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:34.876285 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-296c2fc5-72ab-4a2d-b5ea-e037105bc9a5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:34.876846 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-11e34332-bfbb-4de8-a329-b2992df9bdc8 tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1438 microversion: 2.75 time: 0.405522 Sep 10 11:40:34.878012 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 384/721] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:34 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1438 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:34.883353 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2ea17cd7-3551-4faa-89ac-bbb457932f06 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-14766814", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:40:34.893069 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-296c2fc5-72ab-4a2d-b5ea-e037105bc9a5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: f600488a-7c52-4a96-9375-2723bf42cf83] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:34.921038 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-296c2fc5-72ab-4a2d-b5ea-e037105bc9a5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:34.921792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-296c2fc5-72ab-4a2d-b5ea-e037105bc9a5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:34.922375 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-296c2fc5-72ab-4a2d-b5ea-e037105bc9a5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:34.923113 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-296c2fc5-72ab-4a2d-b5ea-e037105bc9a5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:34.927813 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-296c2fc5-72ab-4a2d-b5ea-e037105bc9a5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:34.929735 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-296c2fc5-72ab-4a2d-b5ea-e037105bc9a5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:35.036836 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-2ea17cd7-3551-4faa-89ac-bbb457932f06 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] validate_networks() for None {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:40:35.181295 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-296c2fc5-72ab-4a2d-b5ea-e037105bc9a5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:35.194677 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-296c2fc5-72ab-4a2d-b5ea-e037105bc9a5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:35.203704 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-296c2fc5-72ab-4a2d-b5ea-e037105bc9a5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:35.204896 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-296c2fc5-72ab-4a2d-b5ea-e037105bc9a5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83" status: 200 len: 1317 microversion: 2.25 time: 0.340200 Sep 10 11:40:35.205453 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 338/722] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:34 2022] GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83 => generated 1317 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:35.557830 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-79e0bd3c-f72b-440b-a1be-d0bef15214d8 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:40:35.560866 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-79e0bd3c-f72b-440b-a1be-d0bef15214d8 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:35.583358 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-79e0bd3c-f72b-440b-a1be-d0bef15214d8 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:35.586147 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-79e0bd3c-f72b-440b-a1be-d0bef15214d8 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:35.586759 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-79e0bd3c-f72b-440b-a1be-d0bef15214d8 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:35.587710 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-79e0bd3c-f72b-440b-a1be-d0bef15214d8 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:35.590669 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-79e0bd3c-f72b-440b-a1be-d0bef15214d8 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:35.591339 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-79e0bd3c-f72b-440b-a1be-d0bef15214d8 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:35.851205 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-79e0bd3c-f72b-440b-a1be-d0bef15214d8 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:40:35.851887 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-79e0bd3c-f72b-440b-a1be-d0bef15214d8 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:40:35.852558 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-79e0bd3c-f72b-440b-a1be-d0bef15214d8 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:40:35.853161 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-79e0bd3c-f72b-440b-a1be-d0bef15214d8 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:40:35.853884 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-79e0bd3c-f72b-440b-a1be-d0bef15214d8 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:40:35.960110 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-2ea17cd7-3551-4faa-89ac-bbb457932f06 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:40:35.960629 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-2ea17cd7-3551-4faa-89ac-bbb457932f06 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:40:35.961209 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-2ea17cd7-3551-4faa-89ac-bbb457932f06 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:40:35.969782 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-2ea17cd7-3551-4faa-89ac-bbb457932f06 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:40:35.970392 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-2ea17cd7-3551-4faa-89ac-bbb457932f06 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:40:36.019621 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:40:36.032308 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-79e0bd3c-f72b-440b-a1be-d0bef15214d8 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:36.040376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-79e0bd3c-f72b-440b-a1be-d0bef15214d8 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:36.041120 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-79e0bd3c-f72b-440b-a1be-d0bef15214d8 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:36.041727 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-79e0bd3c-f72b-440b-a1be-d0bef15214d8 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:36.042674 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-79e0bd3c-f72b-440b-a1be-d0bef15214d8 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:36.049743 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-79e0bd3c-f72b-440b-a1be-d0bef15214d8 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:36.050207 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-79e0bd3c-f72b-440b-a1be-d0bef15214d8 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:36.069877 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2ea17cd7-3551-4faa-89ac-bbb457932f06 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:36.085151 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2ea17cd7-3551-4faa-89ac-bbb457932f06 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:36.085860 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2ea17cd7-3551-4faa-89ac-bbb457932f06 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:36.086766 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2ea17cd7-3551-4faa-89ac-bbb457932f06 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:36.091666 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2ea17cd7-3551-4faa-89ac-bbb457932f06 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:36.095508 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2ea17cd7-3551-4faa-89ac-bbb457932f06 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:36.185695 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-2ea17cd7-3551-4faa-89ac-bbb457932f06 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Getting quotas for project b23bf60ed08b4adca30b90ecfb9e540d. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:40:36.209668 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-2ea17cd7-3551-4faa-89ac-bbb457932f06 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Getting quotas for user 73f8ba457fba4e67a97dd156c2bfaa0f and project b23bf60ed08b4adca30b90ecfb9e540d. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:40:36.258927 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2ea17cd7-3551-4faa-89ac-bbb457932f06 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:40:36.267271 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2ea17cd7-3551-4faa-89ac-bbb457932f06 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: 3bb65ae3-44e9-4803-b00c-132423b2fd8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:40:36.386163 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2ea17cd7-3551-4faa-89ac-bbb457932f06 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.506853 Sep 10 11:40:36.389322 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 385/723] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:40:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:40:36.406661 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c171bf7b-54f8-448f-833c-db8c5562cdfc tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:36.411151 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c171bf7b-54f8-448f-833c-db8c5562cdfc tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:36.431530 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c171bf7b-54f8-448f-833c-db8c5562cdfc tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:36.432068 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c171bf7b-54f8-448f-833c-db8c5562cdfc tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:36.432475 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c171bf7b-54f8-448f-833c-db8c5562cdfc tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:36.433197 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c171bf7b-54f8-448f-833c-db8c5562cdfc tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:36.437034 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-79e0bd3c-f72b-440b-a1be-d0bef15214d8 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lazy-loading 'services' on Instance uuid 89c9187c-06d0-490a-ad42-8c632924689f {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:40:36.441857 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c171bf7b-54f8-448f-833c-db8c5562cdfc tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:36.442482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c171bf7b-54f8-448f-833c-db8c5562cdfc tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:36.638099 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-79e0bd3c-f72b-440b-a1be-d0bef15214d8 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f/action" status: 202 len: 1942 microversion: 2.75 time: 1.431548 Sep 10 11:40:36.638999 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 339/724] 10.222.0.23 () {62 vars in 1319 bytes} [Sat Sep 10 11:40:35 2022] POST /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f/action => generated 1942 bytes in 1433 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 10 11:40:36.650157 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-544963c0-4c6e-4a41-be24-e566b27ec1f9 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '.version_select at 0x7f40734e5670>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:36.762845 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-544963c0-4c6e-4a41-be24-e566b27ec1f9 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62" status: 200 len: 1422 microversion: 2.1 time: 0.122477 Sep 10 11:40:36.775323 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 340/725] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:40:36 2022] GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62 => generated 1422 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:36.808376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e4c51076-7c5e-4b63-822b-8ba61553bb61 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:36.815239 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e4c51076-7c5e-4b63-822b-8ba61553bb61 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: f600488a-7c52-4a96-9375-2723bf42cf83] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:36.856662 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e4c51076-7c5e-4b63-822b-8ba61553bb61 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:36.857166 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e4c51076-7c5e-4b63-822b-8ba61553bb61 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:36.857618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e4c51076-7c5e-4b63-822b-8ba61553bb61 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:36.858476 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e4c51076-7c5e-4b63-822b-8ba61553bb61 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:36.859130 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e4c51076-7c5e-4b63-822b-8ba61553bb61 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:36.878854 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e4c51076-7c5e-4b63-822b-8ba61553bb61 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:37.108010 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c171bf7b-54f8-448f-833c-db8c5562cdfc tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:37.121713 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c171bf7b-54f8-448f-833c-db8c5562cdfc tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1361 microversion: 2.1 time: 0.729800 Sep 10 11:40:37.122303 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 386/726] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:36 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1361 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:37.142707 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-195e57d1-d150-4c51-b8c1-01f0c1f12008 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:37.156383 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-195e57d1-d150-4c51-b8c1-01f0c1f12008 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: 3bb65ae3-44e9-4803-b00c-132423b2fd8d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:37.337073 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-195e57d1-d150-4c51-b8c1-01f0c1f12008 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:37.345482 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-195e57d1-d150-4c51-b8c1-01f0c1f12008 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d" status: 200 len: 1217 microversion: 2.1 time: 0.216767 Sep 10 11:40:37.346082 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 387/727] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:37 2022] GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d => generated 1217 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:37.369427 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a8a1d0e8-7c7b-45c2-adbe-93b6ed33f575 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:37.373144 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a8a1d0e8-7c7b-45c2-adbe-93b6ed33f575 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:37.400279 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8a1d0e8-7c7b-45c2-adbe-93b6ed33f575 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:37.404538 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8a1d0e8-7c7b-45c2-adbe-93b6ed33f575 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:37.407236 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8a1d0e8-7c7b-45c2-adbe-93b6ed33f575 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:37.415308 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8a1d0e8-7c7b-45c2-adbe-93b6ed33f575 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:37.416292 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8a1d0e8-7c7b-45c2-adbe-93b6ed33f575 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:37.419113 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8a1d0e8-7c7b-45c2-adbe-93b6ed33f575 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:37.494525 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e4c51076-7c5e-4b63-822b-8ba61553bb61 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:37.510707 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e4c51076-7c5e-4b63-822b-8ba61553bb61 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:37.512847 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e4c51076-7c5e-4b63-822b-8ba61553bb61 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:37.517137 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e4c51076-7c5e-4b63-822b-8ba61553bb61 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83" status: 200 len: 1359 microversion: 2.25 time: 0.736622 Sep 10 11:40:37.519938 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 341/728] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:36 2022] GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83 => generated 1359 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:37.786973 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-eeadfbd8-ddd8-4a75-b5ea-a35af5635bdd tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '.version_select at 0x7f407348b820>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:37.875627 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-eeadfbd8-ddd8-4a75-b5ea-a35af5635bdd tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62" status: 200 len: 1422 microversion: 2.1 time: 0.096210 Sep 10 11:40:37.876626 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 342/729] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:40:37 2022] GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62 => generated 1422 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:38.010253 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-a8a1d0e8-7c7b-45c2-adbe-93b6ed33f575 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lazy-loading 'services' on Instance uuid 89c9187c-06d0-490a-ad42-8c632924689f {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:40:38.156185 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-77189fb2-03ec-4621-86ea-d1c0d67a695b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:38.158093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-77189fb2-03ec-4621-86ea-d1c0d67a695b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:38.184412 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-77189fb2-03ec-4621-86ea-d1c0d67a695b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:38.185335 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-77189fb2-03ec-4621-86ea-d1c0d67a695b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:38.187097 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-77189fb2-03ec-4621-86ea-d1c0d67a695b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:38.191657 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-77189fb2-03ec-4621-86ea-d1c0d67a695b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:38.192378 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-77189fb2-03ec-4621-86ea-d1c0d67a695b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:38.193062 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-77189fb2-03ec-4621-86ea-d1c0d67a695b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:38.231139 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a8a1d0e8-7c7b-45c2-adbe-93b6ed33f575 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1929 microversion: 2.75 time: 0.877510 Sep 10 11:40:38.249677 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 388/730] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:37 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1929 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:38.373129 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-26a7e4bd-1deb-4108-8cd6-c4e35ecc5c46 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:38.375110 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-26a7e4bd-1deb-4108-8cd6-c4e35ecc5c46 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: 3bb65ae3-44e9-4803-b00c-132423b2fd8d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:38.385097 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-26a7e4bd-1deb-4108-8cd6-c4e35ecc5c46 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:38.386830 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-26a7e4bd-1deb-4108-8cd6-c4e35ecc5c46 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:38.394055 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-26a7e4bd-1deb-4108-8cd6-c4e35ecc5c46 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:38.395052 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-26a7e4bd-1deb-4108-8cd6-c4e35ecc5c46 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:38.396526 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-26a7e4bd-1deb-4108-8cd6-c4e35ecc5c46 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:38.397171 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-26a7e4bd-1deb-4108-8cd6-c4e35ecc5c46 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:38.534293 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-26a7e4bd-1deb-4108-8cd6-c4e35ecc5c46 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:38.543935 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-26a7e4bd-1deb-4108-8cd6-c4e35ecc5c46 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d" status: 200 len: 1269 microversion: 2.1 time: 0.173619 Sep 10 11:40:38.547511 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 389/731] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:38 2022] GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d => generated 1269 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:40:38.558624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d52e3251-d28b-44ea-8539-106395f6db2e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:38.559615 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d52e3251-d28b-44ea-8539-106395f6db2e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: f600488a-7c52-4a96-9375-2723bf42cf83] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:38.580852 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d52e3251-d28b-44ea-8539-106395f6db2e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:38.582715 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d52e3251-d28b-44ea-8539-106395f6db2e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:38.591596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d52e3251-d28b-44ea-8539-106395f6db2e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:38.598824 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d52e3251-d28b-44ea-8539-106395f6db2e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:38.603856 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d52e3251-d28b-44ea-8539-106395f6db2e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:38.604566 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d52e3251-d28b-44ea-8539-106395f6db2e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:38.990843 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-77189fb2-03ec-4621-86ea-d1c0d67a695b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:39.000665 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-77189fb2-03ec-4621-86ea-d1c0d67a695b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1361 microversion: 2.1 time: 0.855484 Sep 10 11:40:39.020272 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 343/732] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:38 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1361 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:39.025918 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7f8a686a-d7b9-4c09-b1fe-488b1c694e7f tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '.version_select at 0x7f407355f9d0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:39.147025 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7f8a686a-d7b9-4c09-b1fe-488b1c694e7f tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62" status: 200 len: 1422 microversion: 2.1 time: 0.125250 Sep 10 11:40:39.147986 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 344/733] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:40:39 2022] GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62 => generated 1422 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:39.265767 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d52e3251-d28b-44ea-8539-106395f6db2e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:39.275757 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9dce3a12-6bfb-4b52-bf77-7d37bcb2d706 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:39.276713 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9dce3a12-6bfb-4b52-bf77-7d37bcb2d706 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:39.284637 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d52e3251-d28b-44ea-8539-106395f6db2e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:39.293747 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d52e3251-d28b-44ea-8539-106395f6db2e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:39.298973 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:40:39.300643 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d52e3251-d28b-44ea-8539-106395f6db2e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83" status: 200 len: 1359 microversion: 2.25 time: 0.751888 Sep 10 11:40:39.309824 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 390/734] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:38 2022] GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83 => generated 1359 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:39.310917 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9dce3a12-6bfb-4b52-bf77-7d37bcb2d706 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:39.311755 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9dce3a12-6bfb-4b52-bf77-7d37bcb2d706 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:39.312440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9dce3a12-6bfb-4b52-bf77-7d37bcb2d706 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:39.313402 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9dce3a12-6bfb-4b52-bf77-7d37bcb2d706 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:39.314084 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9dce3a12-6bfb-4b52-bf77-7d37bcb2d706 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:39.314744 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9dce3a12-6bfb-4b52-bf77-7d37bcb2d706 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:39.519299 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-9dce3a12-6bfb-4b52-bf77-7d37bcb2d706 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lazy-loading 'services' on Instance uuid 89c9187c-06d0-490a-ad42-8c632924689f {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:40:39.567268 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9dce3a12-6bfb-4b52-bf77-7d37bcb2d706 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1929 microversion: 2.75 time: 0.300704 Sep 10 11:40:39.571860 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d899e9d4-bc02-4304-ad1d-4d7ea2afa269 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:39.572486 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d899e9d4-bc02-4304-ad1d-4d7ea2afa269 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: 3bb65ae3-44e9-4803-b00c-132423b2fd8d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:39.587927 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 345/735] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:39 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1929 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:39.593277 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d899e9d4-bc02-4304-ad1d-4d7ea2afa269 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:39.599418 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d899e9d4-bc02-4304-ad1d-4d7ea2afa269 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:39.600148 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d899e9d4-bc02-4304-ad1d-4d7ea2afa269 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:39.601060 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d899e9d4-bc02-4304-ad1d-4d7ea2afa269 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:39.601853 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d899e9d4-bc02-4304-ad1d-4d7ea2afa269 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:39.602457 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d899e9d4-bc02-4304-ad1d-4d7ea2afa269 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:39.657457 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:40:39.841894 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d899e9d4-bc02-4304-ad1d-4d7ea2afa269 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:39.856227 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d899e9d4-bc02-4304-ad1d-4d7ea2afa269 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d" status: 200 len: 1275 microversion: 2.1 time: 0.288391 Sep 10 11:40:39.857548 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 391/736] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:39 2022] GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d => generated 1275 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:40:40.046853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0c390643-ce14-49ed-9219-d7d3e2a726bf tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:40.047721 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0c390643-ce14-49ed-9219-d7d3e2a726bf tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:40.064086 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c390643-ce14-49ed-9219-d7d3e2a726bf tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:40.064877 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c390643-ce14-49ed-9219-d7d3e2a726bf tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:40.065424 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c390643-ce14-49ed-9219-d7d3e2a726bf tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:40.066426 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c390643-ce14-49ed-9219-d7d3e2a726bf tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:40.067141 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c390643-ce14-49ed-9219-d7d3e2a726bf tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:40.069487 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c390643-ce14-49ed-9219-d7d3e2a726bf tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:40.167614 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8308695e-66f6-4a0d-b2b0-ae8523546e17 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '.version_select at 0x7f40739fddc0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:40.277917 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8308695e-66f6-4a0d-b2b0-ae8523546e17 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62" status: 200 len: 1422 microversion: 2.1 time: 0.119102 Sep 10 11:40:40.292593 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 392/737] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:40:40 2022] GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62 => generated 1422 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:40.347895 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bf4c70d9-319e-4bc0-a48e-125de5598a4f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:40.349234 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bf4c70d9-319e-4bc0-a48e-125de5598a4f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: f600488a-7c52-4a96-9375-2723bf42cf83] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:40.365375 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bf4c70d9-319e-4bc0-a48e-125de5598a4f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:40.367920 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bf4c70d9-319e-4bc0-a48e-125de5598a4f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:40.368571 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bf4c70d9-319e-4bc0-a48e-125de5598a4f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:40.371411 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bf4c70d9-319e-4bc0-a48e-125de5598a4f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:40.372949 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bf4c70d9-319e-4bc0-a48e-125de5598a4f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:40.374454 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bf4c70d9-319e-4bc0-a48e-125de5598a4f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:40.817335 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0c390643-ce14-49ed-9219-d7d3e2a726bf tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:40.825683 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0c390643-ce14-49ed-9219-d7d3e2a726bf tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1361 microversion: 2.1 time: 0.783552 Sep 10 11:40:40.826286 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 346/738] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:40 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1361 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:40.847491 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f51a9998-7ead-4c96-bd40-a167c5e0436d tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:40.848390 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f51a9998-7ead-4c96-bd40-a167c5e0436d tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:40.867118 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f51a9998-7ead-4c96-bd40-a167c5e0436d tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:40.867683 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f51a9998-7ead-4c96-bd40-a167c5e0436d tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:40.868132 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f51a9998-7ead-4c96-bd40-a167c5e0436d tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:40.868867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f51a9998-7ead-4c96-bd40-a167c5e0436d tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:40.869338 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f51a9998-7ead-4c96-bd40-a167c5e0436d tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:40.869773 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f51a9998-7ead-4c96-bd40-a167c5e0436d tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:41.173257 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-f51a9998-7ead-4c96-bd40-a167c5e0436d tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lazy-loading 'services' on Instance uuid 89c9187c-06d0-490a-ad42-8c632924689f {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:40:41.221363 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f51a9998-7ead-4c96-bd40-a167c5e0436d tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1929 microversion: 2.75 time: 0.393976 Sep 10 11:40:41.221964 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 347/739] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:40 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1929 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:41.251106 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1c0b38b9-d4a6-440f-b3b2-3b8874592379 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:41.259679 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bf4c70d9-319e-4bc0-a48e-125de5598a4f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:41.260343 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1c0b38b9-d4a6-440f-b3b2-3b8874592379 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: 3bb65ae3-44e9-4803-b00c-132423b2fd8d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:41.267924 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c0b38b9-d4a6-440f-b3b2-3b8874592379 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:41.276198 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c0b38b9-d4a6-440f-b3b2-3b8874592379 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:41.276861 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c0b38b9-d4a6-440f-b3b2-3b8874592379 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:41.277788 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c0b38b9-d4a6-440f-b3b2-3b8874592379 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:41.278414 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c0b38b9-d4a6-440f-b3b2-3b8874592379 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:41.279008 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c0b38b9-d4a6-440f-b3b2-3b8874592379 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:41.283087 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bf4c70d9-319e-4bc0-a48e-125de5598a4f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:41.294951 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bf4c70d9-319e-4bc0-a48e-125de5598a4f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:41.298915 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bf4c70d9-319e-4bc0-a48e-125de5598a4f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83" status: 200 len: 1359 microversion: 2.25 time: 0.960828 Sep 10 11:40:41.301270 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 393/740] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:40 2022] GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83 => generated 1359 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:40:41.322674 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-97693579-02fb-4583-a412-f55a841c8520 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '.version_select at 0x7f40738d80d0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:41.432103 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-97693579-02fb-4583-a412-f55a841c8520 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62" status: 200 len: 1422 microversion: 2.1 time: 0.124258 Sep 10 11:40:41.440845 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 394/741] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:40:41 2022] GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62 => generated 1422 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:41.443403 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=16 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:40:41.850600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e72300a9-e610-4443-be44-abccb3475d8f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:41.851445 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e72300a9-e610-4443-be44-abccb3475d8f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:41.865678 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e72300a9-e610-4443-be44-abccb3475d8f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:41.866543 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e72300a9-e610-4443-be44-abccb3475d8f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:41.867264 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e72300a9-e610-4443-be44-abccb3475d8f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:41.869967 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e72300a9-e610-4443-be44-abccb3475d8f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:41.874969 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e72300a9-e610-4443-be44-abccb3475d8f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:41.880192 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e72300a9-e610-4443-be44-abccb3475d8f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:42.262580 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1c0b38b9-d4a6-440f-b3b2-3b8874592379 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:42.277762 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1c0b38b9-d4a6-440f-b3b2-3b8874592379 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d" status: 200 len: 1317 microversion: 2.1 time: 1.030597 Sep 10 11:40:42.278349 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 348/742] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:41 2022] GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d => generated 1317 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:42.296401 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-076d9b63-a903-4dc2-8890-b3eea74afc29 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:42.297731 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-076d9b63-a903-4dc2-8890-b3eea74afc29 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:42.305870 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-076d9b63-a903-4dc2-8890-b3eea74afc29 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:42.306783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-076d9b63-a903-4dc2-8890-b3eea74afc29 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:42.318168 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-076d9b63-a903-4dc2-8890-b3eea74afc29 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:42.321269 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-076d9b63-a903-4dc2-8890-b3eea74afc29 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:42.322244 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-076d9b63-a903-4dc2-8890-b3eea74afc29 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:42.323093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-076d9b63-a903-4dc2-8890-b3eea74afc29 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:42.603131 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-076d9b63-a903-4dc2-8890-b3eea74afc29 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lazy-loading 'services' on Instance uuid 89c9187c-06d0-490a-ad42-8c632924689f {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:40:42.640471 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e72300a9-e610-4443-be44-abccb3475d8f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:42.682057 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e72300a9-e610-4443-be44-abccb3475d8f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1361 microversion: 2.1 time: 0.830286 Sep 10 11:40:42.685145 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-076d9b63-a903-4dc2-8890-b3eea74afc29 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1929 microversion: 2.75 time: 0.400878 Sep 10 11:40:42.685331 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 395/743] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:41 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1361 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:40:42.694324 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 349/744] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:42 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1929 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:42.704082 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e6c3ff00-5cdf-4cf9-ab72-f03734790fd1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:42.711402 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e32bcab9-1df2-41af-ad6b-79fbf9b9a052 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '.version_select at 0x7f407357e820>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:42.715009 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e6c3ff00-5cdf-4cf9-ab72-f03734790fd1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: f600488a-7c52-4a96-9375-2723bf42cf83] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:42.751512 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6c3ff00-5cdf-4cf9-ab72-f03734790fd1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:42.758794 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6c3ff00-5cdf-4cf9-ab72-f03734790fd1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:42.761382 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6c3ff00-5cdf-4cf9-ab72-f03734790fd1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:42.762399 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6c3ff00-5cdf-4cf9-ab72-f03734790fd1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:42.764273 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6c3ff00-5cdf-4cf9-ab72-f03734790fd1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:42.766519 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6c3ff00-5cdf-4cf9-ab72-f03734790fd1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:42.809791 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e32bcab9-1df2-41af-ad6b-79fbf9b9a052 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62" status: 200 len: 1422 microversion: 2.1 time: 0.113280 Sep 10 11:40:42.819994 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 350/745] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:40:42 2022] GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62 => generated 1422 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:42.832152 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-29823984-e82b-4066-b5ec-7012a34a6dc2 req-d4f564da-e685-47f3-bf38-22828339e406 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f600488a-7c52-4a96-9375-2723bf42cf83", "tag": "b17980fa-cb4b-4dcc-8ee5-cbb901783cfd"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:40:42.859724 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-29823984-e82b-4066-b5ec-7012a34a6dc2 req-d4f564da-e685-47f3-bf38-22828339e406 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:42.860900 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-29823984-e82b-4066-b5ec-7012a34a6dc2 req-d4f564da-e685-47f3-bf38-22828339e406 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:42.861770 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-29823984-e82b-4066-b5ec-7012a34a6dc2 req-d4f564da-e685-47f3-bf38-22828339e406 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:42.895950 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-29823984-e82b-4066-b5ec-7012a34a6dc2 req-d4f564da-e685-47f3-bf38-22828339e406 service nova] Creating event network-changed:b17980fa-cb4b-4dcc-8ee5-cbb901783cfd for instance f600488a-7c52-4a96-9375-2723bf42cf83 on n-h2-856895-1 Sep 10 11:40:42.916788 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-29823984-e82b-4066-b5ec-7012a34a6dc2 req-d4f564da-e685-47f3-bf38-22828339e406 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094970 Sep 10 11:40:42.918012 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 351/746] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:40:43.292205 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e6c3ff00-5cdf-4cf9-ab72-f03734790fd1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:43.303119 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e6c3ff00-5cdf-4cf9-ab72-f03734790fd1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:43.308426 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8d9d32ae-f475-4a57-91b0-79980e7a9f2b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:43.309133 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e6c3ff00-5cdf-4cf9-ab72-f03734790fd1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:43.310123 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8d9d32ae-f475-4a57-91b0-79980e7a9f2b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: 3bb65ae3-44e9-4803-b00c-132423b2fd8d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:43.310241 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e6c3ff00-5cdf-4cf9-ab72-f03734790fd1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83" status: 200 len: 1359 microversion: 2.25 time: 0.622060 Sep 10 11:40:43.310803 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 396/747] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:42 2022] GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83 => generated 1359 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:43.331427 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8d9d32ae-f475-4a57-91b0-79980e7a9f2b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:43.335919 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8d9d32ae-f475-4a57-91b0-79980e7a9f2b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:43.339470 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8d9d32ae-f475-4a57-91b0-79980e7a9f2b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:43.341841 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8d9d32ae-f475-4a57-91b0-79980e7a9f2b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:43.352177 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8d9d32ae-f475-4a57-91b0-79980e7a9f2b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:43.353109 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8d9d32ae-f475-4a57-91b0-79980e7a9f2b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:43.711274 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8d9d32ae-f475-4a57-91b0-79980e7a9f2b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:43.713886 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e94bf641-d86a-4b0d-82fa-0b449cef2947 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:43.714791 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e94bf641-d86a-4b0d-82fa-0b449cef2947 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:43.725441 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8d9d32ae-f475-4a57-91b0-79980e7a9f2b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d" status: 200 len: 1317 microversion: 2.1 time: 0.423016 Sep 10 11:40:43.728697 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e94bf641-d86a-4b0d-82fa-0b449cef2947 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:43.729466 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e94bf641-d86a-4b0d-82fa-0b449cef2947 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:43.730107 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e94bf641-d86a-4b0d-82fa-0b449cef2947 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:43.732004 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e94bf641-d86a-4b0d-82fa-0b449cef2947 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:43.734600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e94bf641-d86a-4b0d-82fa-0b449cef2947 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:43.735458 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e94bf641-d86a-4b0d-82fa-0b449cef2947 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:43.740914 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 352/748] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:43 2022] GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d => generated 1317 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:43.761642 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fdb86b06-14f2-4f40-ae38-f3fba41e16f4 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:43.762265 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fdb86b06-14f2-4f40-ae38-f3fba41e16f4 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:43.769393 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdb86b06-14f2-4f40-ae38-f3fba41e16f4 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:43.769883 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdb86b06-14f2-4f40-ae38-f3fba41e16f4 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:43.770510 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdb86b06-14f2-4f40-ae38-f3fba41e16f4 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:43.771404 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdb86b06-14f2-4f40-ae38-f3fba41e16f4 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:43.776222 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdb86b06-14f2-4f40-ae38-f3fba41e16f4 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:43.777231 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdb86b06-14f2-4f40-ae38-f3fba41e16f4 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:43.944197 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:40:43.949825 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-fdb86b06-14f2-4f40-ae38-f3fba41e16f4 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lazy-loading 'services' on Instance uuid 89c9187c-06d0-490a-ad42-8c632924689f {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:40:43.997558 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fdb86b06-14f2-4f40-ae38-f3fba41e16f4 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1929 microversion: 2.75 time: 0.254907 Sep 10 11:40:43.999352 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 353/749] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:43 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1929 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:44.018673 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a7ec716f-5319-4544-927b-e4455c12bff7 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '.version_select at 0x7f4073681790>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:44.109083 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a7ec716f-5319-4544-927b-e4455c12bff7 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62" status: 200 len: 1422 microversion: 2.1 time: 0.106502 Sep 10 11:40:44.112811 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 354/750] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:40:43 2022] GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62 => generated 1422 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:44.290456 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e94bf641-d86a-4b0d-82fa-0b449cef2947 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:44.300787 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e94bf641-d86a-4b0d-82fa-0b449cef2947 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1361 microversion: 2.1 time: 0.591976 Sep 10 11:40:44.301878 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 397/751] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:43 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1361 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:44.335965 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cc0e0cfe-a167-47b8-b54e-45fe477a31c7 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:44.336557 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cc0e0cfe-a167-47b8-b54e-45fe477a31c7 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: f600488a-7c52-4a96-9375-2723bf42cf83] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:44.346987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc0e0cfe-a167-47b8-b54e-45fe477a31c7 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:44.347502 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc0e0cfe-a167-47b8-b54e-45fe477a31c7 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:44.348000 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc0e0cfe-a167-47b8-b54e-45fe477a31c7 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:44.348642 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc0e0cfe-a167-47b8-b54e-45fe477a31c7 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:44.349097 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc0e0cfe-a167-47b8-b54e-45fe477a31c7 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:44.349519 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc0e0cfe-a167-47b8-b54e-45fe477a31c7 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:44.751224 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6840aed4-5977-4d63-9722-f4a2d60b4cf4 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:44.751931 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cc0e0cfe-a167-47b8-b54e-45fe477a31c7 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:44.752041 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6840aed4-5977-4d63-9722-f4a2d60b4cf4 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: 3bb65ae3-44e9-4803-b00c-132423b2fd8d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:44.766201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6840aed4-5977-4d63-9722-f4a2d60b4cf4 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:44.770762 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6840aed4-5977-4d63-9722-f4a2d60b4cf4 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:44.771267 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6840aed4-5977-4d63-9722-f4a2d60b4cf4 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:44.771817 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cc0e0cfe-a167-47b8-b54e-45fe477a31c7 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:44.774403 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6840aed4-5977-4d63-9722-f4a2d60b4cf4 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:44.774881 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6840aed4-5977-4d63-9722-f4a2d60b4cf4 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:44.776403 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cc0e0cfe-a167-47b8-b54e-45fe477a31c7 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:44.781235 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cc0e0cfe-a167-47b8-b54e-45fe477a31c7 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83" status: 200 len: 1359 microversion: 2.25 time: 0.447740 Sep 10 11:40:44.784384 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6840aed4-5977-4d63-9722-f4a2d60b4cf4 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:44.797340 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 355/752] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:44 2022] GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83 => generated 1359 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:40:44.849786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-4383a7a0-43e7-42eb-b4ef-1eb9c79419d9 req-79960d75-0f4a-408e-8d12-e2b6fbda58a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53e36757-9924-4d03-a8c0-fe52a166ffc1", "name": "network-vif-plugged", "status": "completed", "tag": "42683686-90d1-4e9e-9012-b0ee66c9e930"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:40:44.877442 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-4383a7a0-43e7-42eb-b4ef-1eb9c79419d9 req-79960d75-0f4a-408e-8d12-e2b6fbda58a2 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:44.880311 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-4383a7a0-43e7-42eb-b4ef-1eb9c79419d9 req-79960d75-0f4a-408e-8d12-e2b6fbda58a2 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:44.880788 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-4383a7a0-43e7-42eb-b4ef-1eb9c79419d9 req-79960d75-0f4a-408e-8d12-e2b6fbda58a2 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:44.936815 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-4383a7a0-43e7-42eb-b4ef-1eb9c79419d9 req-79960d75-0f4a-408e-8d12-e2b6fbda58a2 service nova] Creating event network-vif-plugged:42683686-90d1-4e9e-9012-b0ee66c9e930 for instance 53e36757-9924-4d03-a8c0-fe52a166ffc1 on n-h1-856895-1 Sep 10 11:40:44.953948 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-4383a7a0-43e7-42eb-b4ef-1eb9c79419d9 req-79960d75-0f4a-408e-8d12-e2b6fbda58a2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105304 Sep 10 11:40:44.957442 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 356/753] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:40:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:40:44.998489 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-c24e2e8c-41bd-481f-b46f-ac6a144d30a9 req-11cb1ddb-81f4-428e-ad60-b3bae551ce84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bb65ae3-44e9-4803-b00c-132423b2fd8d", "tag": "b5615556-cec7-42af-9601-2d0e112e6b17"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:40:45.046987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-c24e2e8c-41bd-481f-b46f-ac6a144d30a9 req-11cb1ddb-81f4-428e-ad60-b3bae551ce84 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:45.047507 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-c24e2e8c-41bd-481f-b46f-ac6a144d30a9 req-11cb1ddb-81f4-428e-ad60-b3bae551ce84 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:45.047946 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-c24e2e8c-41bd-481f-b46f-ac6a144d30a9 req-11cb1ddb-81f4-428e-ad60-b3bae551ce84 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:45.106296 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-c24e2e8c-41bd-481f-b46f-ac6a144d30a9 req-11cb1ddb-81f4-428e-ad60-b3bae551ce84 service nova] Creating event network-changed:b5615556-cec7-42af-9601-2d0e112e6b17 for instance 3bb65ae3-44e9-4803-b00c-132423b2fd8d on n-h1-856895-1 Sep 10 11:40:45.149339 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-c24e2e8c-41bd-481f-b46f-ac6a144d30a9 req-11cb1ddb-81f4-428e-ad60-b3bae551ce84 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154641 Sep 10 11:40:45.150055 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 357/754] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:40:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:40:45.172810 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4310e2b4-3061-4467-9b7a-77cec65cce04 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:45.173712 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4310e2b4-3061-4467-9b7a-77cec65cce04 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:45.187798 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4310e2b4-3061-4467-9b7a-77cec65cce04 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:45.197244 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4310e2b4-3061-4467-9b7a-77cec65cce04 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:45.197758 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4310e2b4-3061-4467-9b7a-77cec65cce04 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:45.198621 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4310e2b4-3061-4467-9b7a-77cec65cce04 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:45.202804 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4310e2b4-3061-4467-9b7a-77cec65cce04 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:45.206076 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4310e2b4-3061-4467-9b7a-77cec65cce04 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:45.592662 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-4310e2b4-3061-4467-9b7a-77cec65cce04 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lazy-loading 'services' on Instance uuid 89c9187c-06d0-490a-ad42-8c632924689f {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:40:45.605076 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6840aed4-5977-4d63-9722-f4a2d60b4cf4 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:45.624576 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6840aed4-5977-4d63-9722-f4a2d60b4cf4 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d" status: 200 len: 1317 microversion: 2.1 time: 0.879976 Sep 10 11:40:45.625441 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 398/755] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:44 2022] GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d => generated 1317 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:45.639768 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1933a11b-ceca-4fe7-b9b0-8c6cab5641e4 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '.version_select at 0x7f407397bf70>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:45.663746 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4310e2b4-3061-4467-9b7a-77cec65cce04 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1929 microversion: 2.75 time: 0.510525 Sep 10 11:40:45.677058 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 358/756] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:45 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1929 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:45.699531 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b305d03f-c28f-4e05-a0bb-33d81ae39ddb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:45.700643 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b305d03f-c28f-4e05-a0bb-33d81ae39ddb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:45.722922 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b305d03f-c28f-4e05-a0bb-33d81ae39ddb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:45.723835 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b305d03f-c28f-4e05-a0bb-33d81ae39ddb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:45.724583 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b305d03f-c28f-4e05-a0bb-33d81ae39ddb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:45.725641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b305d03f-c28f-4e05-a0bb-33d81ae39ddb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:45.726401 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b305d03f-c28f-4e05-a0bb-33d81ae39ddb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:45.727639 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b305d03f-c28f-4e05-a0bb-33d81ae39ddb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:46.145975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=4 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:40:46.203389 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b305d03f-c28f-4e05-a0bb-33d81ae39ddb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:46.223791 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b305d03f-c28f-4e05-a0bb-33d81ae39ddb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1361 microversion: 2.1 time: 0.543727 Sep 10 11:40:46.228867 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 359/757] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:45 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1361 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:46.252362 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2ec3ee3f-753c-427b-8b9a-c047e64003a0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:46.254281 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2ec3ee3f-753c-427b-8b9a-c047e64003a0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: f600488a-7c52-4a96-9375-2723bf42cf83] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:46.275580 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ec3ee3f-753c-427b-8b9a-c047e64003a0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:46.277297 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ec3ee3f-753c-427b-8b9a-c047e64003a0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:46.277853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ec3ee3f-753c-427b-8b9a-c047e64003a0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:46.279047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ec3ee3f-753c-427b-8b9a-c047e64003a0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:46.280160 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ec3ee3f-753c-427b-8b9a-c047e64003a0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:46.280698 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ec3ee3f-753c-427b-8b9a-c047e64003a0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:46.576342 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2ec3ee3f-753c-427b-8b9a-c047e64003a0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:46.592620 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2ec3ee3f-753c-427b-8b9a-c047e64003a0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:46.604881 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2ec3ee3f-753c-427b-8b9a-c047e64003a0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:46.609641 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2ec3ee3f-753c-427b-8b9a-c047e64003a0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83" status: 200 len: 1359 microversion: 2.25 time: 0.379349 Sep 10 11:40:46.615283 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 360/758] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:46 2022] GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83 => generated 1359 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:46.649803 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-56d7abc6-7971-4ec7-8a52-70d2041cd752 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:46.652119 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-56d7abc6-7971-4ec7-8a52-70d2041cd752 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: 3bb65ae3-44e9-4803-b00c-132423b2fd8d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:46.658424 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-56d7abc6-7971-4ec7-8a52-70d2041cd752 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:46.659355 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-56d7abc6-7971-4ec7-8a52-70d2041cd752 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:46.660872 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-56d7abc6-7971-4ec7-8a52-70d2041cd752 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:46.667420 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-56d7abc6-7971-4ec7-8a52-70d2041cd752 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:46.670826 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-56d7abc6-7971-4ec7-8a52-70d2041cd752 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:46.671573 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-56d7abc6-7971-4ec7-8a52-70d2041cd752 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:47.129119 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-56d7abc6-7971-4ec7-8a52-70d2041cd752 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:47.150080 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-56d7abc6-7971-4ec7-8a52-70d2041cd752 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d" status: 200 len: 1317 microversion: 2.1 time: 0.504161 Sep 10 11:40:47.163872 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 361/759] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:46 2022] GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d => generated 1317 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:47.173605 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ee75f77a-cd09-456d-9aac-d3a9082c8c06 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:47.174394 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ee75f77a-cd09-456d-9aac-d3a9082c8c06 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:47.186370 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee75f77a-cd09-456d-9aac-d3a9082c8c06 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:47.190800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee75f77a-cd09-456d-9aac-d3a9082c8c06 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:47.191285 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee75f77a-cd09-456d-9aac-d3a9082c8c06 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:47.192112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee75f77a-cd09-456d-9aac-d3a9082c8c06 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:47.192545 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee75f77a-cd09-456d-9aac-d3a9082c8c06 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:47.192980 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee75f77a-cd09-456d-9aac-d3a9082c8c06 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:47.345116 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=39 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:40:47.475804 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-ee75f77a-cd09-456d-9aac-d3a9082c8c06 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lazy-loading 'services' on Instance uuid 89c9187c-06d0-490a-ad42-8c632924689f {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:40:47.558830 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ee75f77a-cd09-456d-9aac-d3a9082c8c06 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1929 microversion: 2.75 time: 0.393618 Sep 10 11:40:47.581466 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 362/760] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:47 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1929 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:47.596107 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-864febfe-5612-460b-9bb8-ee72bee575cc tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:47.596738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-864febfe-5612-460b-9bb8-ee72bee575cc tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:47.603746 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-864febfe-5612-460b-9bb8-ee72bee575cc tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:47.604380 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-864febfe-5612-460b-9bb8-ee72bee575cc tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:47.605435 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-864febfe-5612-460b-9bb8-ee72bee575cc tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:47.606180 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-864febfe-5612-460b-9bb8-ee72bee575cc tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:47.606653 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-864febfe-5612-460b-9bb8-ee72bee575cc tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:47.607108 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-864febfe-5612-460b-9bb8-ee72bee575cc tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:47.989973 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-864febfe-5612-460b-9bb8-ee72bee575cc tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:48.002979 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-864febfe-5612-460b-9bb8-ee72bee575cc tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1361 microversion: 2.1 time: 0.420265 Sep 10 11:40:48.004200 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 363/761] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:47 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1361 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:48.009171 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0618ab90-f2db-47d5-82b9-7c5770468ece tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:48.016152 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0618ab90-f2db-47d5-82b9-7c5770468ece tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: f600488a-7c52-4a96-9375-2723bf42cf83] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:48.028240 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0618ab90-f2db-47d5-82b9-7c5770468ece tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:48.031914 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0618ab90-f2db-47d5-82b9-7c5770468ece tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:48.032627 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0618ab90-f2db-47d5-82b9-7c5770468ece tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:48.033596 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0618ab90-f2db-47d5-82b9-7c5770468ece tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:48.054475 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0618ab90-f2db-47d5-82b9-7c5770468ece tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:48.054926 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0618ab90-f2db-47d5-82b9-7c5770468ece tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:48.484600 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0618ab90-f2db-47d5-82b9-7c5770468ece tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:48.498147 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0618ab90-f2db-47d5-82b9-7c5770468ece tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:48.500122 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0618ab90-f2db-47d5-82b9-7c5770468ece tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:48.501301 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0618ab90-f2db-47d5-82b9-7c5770468ece tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83" status: 200 len: 1359 microversion: 2.25 time: 0.495859 Sep 10 11:40:48.513908 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 364/762] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:48 2022] GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83 => generated 1359 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:48.513908 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f708fcc7-48f5-40b0-afbe-6036d3c35259 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:48.513908 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f708fcc7-48f5-40b0-afbe-6036d3c35259 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: 3bb65ae3-44e9-4803-b00c-132423b2fd8d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:48.531469 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f708fcc7-48f5-40b0-afbe-6036d3c35259 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:48.534019 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f708fcc7-48f5-40b0-afbe-6036d3c35259 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:48.534470 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f708fcc7-48f5-40b0-afbe-6036d3c35259 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:48.535228 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f708fcc7-48f5-40b0-afbe-6036d3c35259 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:48.535688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f708fcc7-48f5-40b0-afbe-6036d3c35259 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:48.536118 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f708fcc7-48f5-40b0-afbe-6036d3c35259 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:48.917786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f708fcc7-48f5-40b0-afbe-6036d3c35259 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:48.930152 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f708fcc7-48f5-40b0-afbe-6036d3c35259 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d" status: 200 len: 1317 microversion: 2.1 time: 0.422244 Sep 10 11:40:48.930739 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 365/763] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:48 2022] GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d => generated 1317 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:48.968860 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-47690fab-fb33-43e9-b4b7-fa8aaf4b0fea tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:48.969543 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-47690fab-fb33-43e9-b4b7-fa8aaf4b0fea tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:48.986954 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47690fab-fb33-43e9-b4b7-fa8aaf4b0fea tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:48.987465 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47690fab-fb33-43e9-b4b7-fa8aaf4b0fea tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:48.987901 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47690fab-fb33-43e9-b4b7-fa8aaf4b0fea tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:48.988598 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47690fab-fb33-43e9-b4b7-fa8aaf4b0fea tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:48.994105 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47690fab-fb33-43e9-b4b7-fa8aaf4b0fea tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:48.994622 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47690fab-fb33-43e9-b4b7-fa8aaf4b0fea tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:49.178413 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-47690fab-fb33-43e9-b4b7-fa8aaf4b0fea tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lazy-loading 'services' on Instance uuid 89c9187c-06d0-490a-ad42-8c632924689f {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:40:49.220570 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-47690fab-fb33-43e9-b4b7-fa8aaf4b0fea tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1929 microversion: 2.75 time: 0.288424 Sep 10 11:40:49.231596 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 366/764] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:48 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1929 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:49.252386 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4176c274-5cfd-4e9d-8f30-af0d9cc48f3b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:49.253127 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4176c274-5cfd-4e9d-8f30-af0d9cc48f3b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:49.294396 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4176c274-5cfd-4e9d-8f30-af0d9cc48f3b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:49.295108 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4176c274-5cfd-4e9d-8f30-af0d9cc48f3b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:49.296319 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4176c274-5cfd-4e9d-8f30-af0d9cc48f3b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:49.297515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4176c274-5cfd-4e9d-8f30-af0d9cc48f3b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:49.302296 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4176c274-5cfd-4e9d-8f30-af0d9cc48f3b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:49.302752 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4176c274-5cfd-4e9d-8f30-af0d9cc48f3b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:49.797929 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4176c274-5cfd-4e9d-8f30-af0d9cc48f3b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:49.808453 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4176c274-5cfd-4e9d-8f30-af0d9cc48f3b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1544 microversion: 2.1 time: 0.575390 Sep 10 11:40:49.815840 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 367/765] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:49 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1544 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:49.828789 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5871a431-679b-46ed-813a-2b59334e8090 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:49.836312 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5871a431-679b-46ed-813a-2b59334e8090 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: f600488a-7c52-4a96-9375-2723bf42cf83] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:49.849785 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5871a431-679b-46ed-813a-2b59334e8090 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:49.853852 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5871a431-679b-46ed-813a-2b59334e8090 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:49.855694 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5871a431-679b-46ed-813a-2b59334e8090 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:49.861462 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5871a431-679b-46ed-813a-2b59334e8090 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:49.862185 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5871a431-679b-46ed-813a-2b59334e8090 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:49.862849 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5871a431-679b-46ed-813a-2b59334e8090 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:50.058811 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1933a11b-ceca-4fe7-b9b0-8c6cab5641e4 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62" status: 200 len: 1422 microversion: 2.1 time: 4.425517 Sep 10 11:40:50.068132 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 399/766] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:40:45 2022] GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62 => generated 1422 bytes in 4436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:50.073277 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-35d24484-2ab0-47b4-a828-67d0dfcde095 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:50.089782 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-35d24484-2ab0-47b4-a828-67d0dfcde095 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:50.115665 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-35d24484-2ab0-47b4-a828-67d0dfcde095 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:50.116591 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-35d24484-2ab0-47b4-a828-67d0dfcde095 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:50.120793 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-35d24484-2ab0-47b4-a828-67d0dfcde095 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:50.122054 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-35d24484-2ab0-47b4-a828-67d0dfcde095 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:50.125529 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-35d24484-2ab0-47b4-a828-67d0dfcde095 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:50.129261 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-35d24484-2ab0-47b4-a828-67d0dfcde095 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:50.379498 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-35d24484-2ab0-47b4-a828-67d0dfcde095 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.310101 Sep 10 11:40:50.381338 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 400/767] 10.222.0.23 () {58 vars in 1275 bytes} [Sat Sep 10 11:40:50 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1/os-interface => generated 284 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:40:50.386927 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d1a5a904-8839-4029-a951-18305036f02e tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:50.387882 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d1a5a904-8839-4029-a951-18305036f02e tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: 3bb65ae3-44e9-4803-b00c-132423b2fd8d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:50.410133 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d1a5a904-8839-4029-a951-18305036f02e tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:50.424034 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d1a5a904-8839-4029-a951-18305036f02e tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:50.427871 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d1a5a904-8839-4029-a951-18305036f02e tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:50.432076 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d1a5a904-8839-4029-a951-18305036f02e tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:50.435600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d1a5a904-8839-4029-a951-18305036f02e tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:50.441483 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d1a5a904-8839-4029-a951-18305036f02e tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:50.920721 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5871a431-679b-46ed-813a-2b59334e8090 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:50.941702 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5871a431-679b-46ed-813a-2b59334e8090 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:50.948750 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5871a431-679b-46ed-813a-2b59334e8090 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:50.950245 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5871a431-679b-46ed-813a-2b59334e8090 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83" status: 200 len: 1359 microversion: 2.25 time: 1.133127 Sep 10 11:40:50.954996 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 368/768] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:49 2022] GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83 => generated 1359 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:50.960676 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-82c14b4d-0e6b-49b1-8aae-f23f50f7e232 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:50.968136 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-82c14b4d-0e6b-49b1-8aae-f23f50f7e232 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:50.988351 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82c14b4d-0e6b-49b1-8aae-f23f50f7e232 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:50.989084 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82c14b4d-0e6b-49b1-8aae-f23f50f7e232 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:50.989733 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82c14b4d-0e6b-49b1-8aae-f23f50f7e232 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:51.007554 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82c14b4d-0e6b-49b1-8aae-f23f50f7e232 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:51.008716 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82c14b4d-0e6b-49b1-8aae-f23f50f7e232 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:51.011909 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82c14b4d-0e6b-49b1-8aae-f23f50f7e232 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:51.361226 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d1a5a904-8839-4029-a951-18305036f02e tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:51.369931 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d1a5a904-8839-4029-a951-18305036f02e tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d" status: 200 len: 1317 microversion: 2.1 time: 0.987204 Sep 10 11:40:51.379861 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 401/769] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:50 2022] GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d => generated 1317 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:51.390491 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5c7a7900-adc7-427f-b265-76810971eef7 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '.version_select at 0x7f40738a2700>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:51.467883 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-82c14b4d-0e6b-49b1-8aae-f23f50f7e232 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lazy-loading 'services' on Instance uuid 89c9187c-06d0-490a-ad42-8c632924689f {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:40:51.494813 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5c7a7900-adc7-427f-b265-76810971eef7 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62" status: 200 len: 1422 microversion: 2.1 time: 0.113612 Sep 10 11:40:51.495720 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 402/770] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:40:51 2022] GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62 => generated 1422 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:51.543709 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-82c14b4d-0e6b-49b1-8aae-f23f50f7e232 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1929 microversion: 2.75 time: 0.586900 Sep 10 11:40:51.564826 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 369/771] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:50 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1929 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:51.993487 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-94288455-542d-4034-bef8-5bb5c99ab944 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:51.994576 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-94288455-542d-4034-bef8-5bb5c99ab944 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: f600488a-7c52-4a96-9375-2723bf42cf83] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:52.006920 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-94288455-542d-4034-bef8-5bb5c99ab944 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:52.007999 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-94288455-542d-4034-bef8-5bb5c99ab944 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:52.009302 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-94288455-542d-4034-bef8-5bb5c99ab944 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:52.010343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-94288455-542d-4034-bef8-5bb5c99ab944 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:52.011121 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-94288455-542d-4034-bef8-5bb5c99ab944 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:52.011797 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-94288455-542d-4034-bef8-5bb5c99ab944 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:52.482230 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d818a639-9416-4b14-9d60-d0d6bdef0bfc tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-2082384831", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "7960e1ed-6ebb-4a86-9217-98d61d2ba7ab"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:40:52.557185 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-94288455-542d-4034-bef8-5bb5c99ab944 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:52.587111 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-94288455-542d-4034-bef8-5bb5c99ab944 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:52.605297 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-94288455-542d-4034-bef8-5bb5c99ab944 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:52.608113 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-d818a639-9416-4b14-9d60-d0d6bdef0bfc tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] validate_networks() for [('7960e1ed-6ebb-4a86-9217-98d61d2ba7ab', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:40:52.609584 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-94288455-542d-4034-bef8-5bb5c99ab944 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83" status: 200 len: 1359 microversion: 2.25 time: 0.619967 Sep 10 11:40:52.628753 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 403/772] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:51 2022] GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83 => generated 1359 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:52.658094 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f22dff80-55f8-46f3-9060-0044e6284d01 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:52.661712 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f22dff80-55f8-46f3-9060-0044e6284d01 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: 3bb65ae3-44e9-4803-b00c-132423b2fd8d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:52.689497 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f22dff80-55f8-46f3-9060-0044e6284d01 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:52.690311 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f22dff80-55f8-46f3-9060-0044e6284d01 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:52.692957 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f22dff80-55f8-46f3-9060-0044e6284d01 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:52.695733 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f22dff80-55f8-46f3-9060-0044e6284d01 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:52.701921 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f22dff80-55f8-46f3-9060-0044e6284d01 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:52.702718 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f22dff80-55f8-46f3-9060-0044e6284d01 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:53.424631 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f22dff80-55f8-46f3-9060-0044e6284d01 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:53.433058 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f22dff80-55f8-46f3-9060-0044e6284d01 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d" status: 200 len: 1317 microversion: 2.1 time: 0.802999 Sep 10 11:40:53.436393 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 404/773] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:52 2022] GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d => generated 1317 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:53.447843 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a70999d8-f767-4e2e-b08f-44855999381a tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '.version_select at 0x7f4073a7bd30>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:53.500442 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a70999d8-f767-4e2e-b08f-44855999381a tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62" status: 200 len: 1431 microversion: 2.1 time: 0.056304 Sep 10 11:40:53.501154 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 405/774] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:40:53 2022] GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62 => generated 1431 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:53.515507 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e3d50d15-dfbb-4628-a7b9-26014d28063e tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:53.516511 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e3d50d15-dfbb-4628-a7b9-26014d28063e tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:53.526706 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e3d50d15-dfbb-4628-a7b9-26014d28063e tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:53.534469 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e3d50d15-dfbb-4628-a7b9-26014d28063e tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:53.544926 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e3d50d15-dfbb-4628-a7b9-26014d28063e tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:53.545915 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e3d50d15-dfbb-4628-a7b9-26014d28063e tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:53.546562 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e3d50d15-dfbb-4628-a7b9-26014d28063e tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:53.547210 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e3d50d15-dfbb-4628-a7b9-26014d28063e tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:53.662474 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-e3d50d15-dfbb-4628-a7b9-26014d28063e tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lazy-loading 'services' on Instance uuid 89c9187c-06d0-490a-ad42-8c632924689f {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:40:53.684495 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e3d50d15-dfbb-4628-a7b9-26014d28063e tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1929 microversion: 2.75 time: 0.181894 Sep 10 11:40:53.685782 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 406/775] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:53 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1929 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:53.691901 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-47d33bb5-555e-4369-8a2d-a28c653ad5d4 req-0de95bf5-9ac0-440f-a6a9-cc8a79f82d54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f600488a-7c52-4a96-9375-2723bf42cf83", "name": "network-vif-plugged", "status": "completed", "tag": "b17980fa-cb4b-4dcc-8ee5-cbb901783cfd"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:40:53.703819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-47d33bb5-555e-4369-8a2d-a28c653ad5d4 req-0de95bf5-9ac0-440f-a6a9-cc8a79f82d54 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:53.704605 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-47d33bb5-555e-4369-8a2d-a28c653ad5d4 req-0de95bf5-9ac0-440f-a6a9-cc8a79f82d54 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:53.705227 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-47d33bb5-555e-4369-8a2d-a28c653ad5d4 req-0de95bf5-9ac0-440f-a6a9-cc8a79f82d54 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:53.720699 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-47d33bb5-555e-4369-8a2d-a28c653ad5d4 req-0de95bf5-9ac0-440f-a6a9-cc8a79f82d54 service nova] Creating event network-vif-plugged:b17980fa-cb4b-4dcc-8ee5-cbb901783cfd for instance f600488a-7c52-4a96-9375-2723bf42cf83 on n-h2-856895-1 Sep 10 11:40:53.726293 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-47d33bb5-555e-4369-8a2d-a28c653ad5d4 req-0de95bf5-9ac0-440f-a6a9-cc8a79f82d54 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038242 Sep 10 11:40:53.727681 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 407/776] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:40:53.747336 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4c87bbe8-264a-47e2-b1a8-2cd9df576c2a tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '.version_select at 0x7f40739aef70>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:53.836784 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4c87bbe8-264a-47e2-b1a8-2cd9df576c2a tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62" status: 200 len: 1431 microversion: 2.1 time: 0.106853 Sep 10 11:40:53.846559 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 408/777] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:40:53 2022] GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62 => generated 1431 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:53.858466 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a469b4c6-2a9d-49e6-a2c6-898dd152b41b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:53.859503 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a469b4c6-2a9d-49e6-a2c6-898dd152b41b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: f600488a-7c52-4a96-9375-2723bf42cf83] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:53.870995 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a469b4c6-2a9d-49e6-a2c6-898dd152b41b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:53.871871 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a469b4c6-2a9d-49e6-a2c6-898dd152b41b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:53.872530 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a469b4c6-2a9d-49e6-a2c6-898dd152b41b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:53.874181 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a469b4c6-2a9d-49e6-a2c6-898dd152b41b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:53.874849 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a469b4c6-2a9d-49e6-a2c6-898dd152b41b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:53.876703 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a469b4c6-2a9d-49e6-a2c6-898dd152b41b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:54.039805 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d818a639-9416-4b14-9d60-d0d6bdef0bfc tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:40:54.040434 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d818a639-9416-4b14-9d60-d0d6bdef0bfc tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:40:54.040698 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d818a639-9416-4b14-9d60-d0d6bdef0bfc tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:40:54.041114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d818a639-9416-4b14-9d60-d0d6bdef0bfc tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:40:54.041535 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d818a639-9416-4b14-9d60-d0d6bdef0bfc tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:40:54.056610 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d818a639-9416-4b14-9d60-d0d6bdef0bfc tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:54.057104 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d818a639-9416-4b14-9d60-d0d6bdef0bfc tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:54.057546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d818a639-9416-4b14-9d60-d0d6bdef0bfc tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:54.058287 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d818a639-9416-4b14-9d60-d0d6bdef0bfc tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:54.058751 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d818a639-9416-4b14-9d60-d0d6bdef0bfc tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:54.059253 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d818a639-9416-4b14-9d60-d0d6bdef0bfc tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:54.109166 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-d818a639-9416-4b14-9d60-d0d6bdef0bfc tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Getting quotas for project 2b9f89062992414395b683e882194649. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:40:54.127519 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a469b4c6-2a9d-49e6-a2c6-898dd152b41b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:54.128438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-d818a639-9416-4b14-9d60-d0d6bdef0bfc tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Getting quotas for user e4d20eac7b074cc9bee7e8ffb769aa34 and project 2b9f89062992414395b683e882194649. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:40:54.157126 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a469b4c6-2a9d-49e6-a2c6-898dd152b41b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:54.162255 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d818a639-9416-4b14-9d60-d0d6bdef0bfc tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:40:54.163154 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a469b4c6-2a9d-49e6-a2c6-898dd152b41b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:54.165514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d818a639-9416-4b14-9d60-d0d6bdef0bfc tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] [instance: 43593b13-c486-4931-92c8-7ec46c27f6f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:40:54.168914 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a469b4c6-2a9d-49e6-a2c6-898dd152b41b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83" status: 200 len: 1359 microversion: 2.25 time: 0.320852 Sep 10 11:40:54.170977 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 409/778] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:53 2022] GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83 => generated 1359 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:54.202925 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-40c638ce-61cf-4c90-b268-039f4cf251c9 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:54.205385 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-40c638ce-61cf-4c90-b268-039f4cf251c9 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] [instance: 4c806b91-1302-494f-b4eb-a0b7ba04baf4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:54.223684 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-40c638ce-61cf-4c90-b268-039f4cf251c9 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:54.224587 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-40c638ce-61cf-4c90-b268-039f4cf251c9 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:54.225249 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-40c638ce-61cf-4c90-b268-039f4cf251c9 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:54.226218 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-40c638ce-61cf-4c90-b268-039f4cf251c9 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:54.226896 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-40c638ce-61cf-4c90-b268-039f4cf251c9 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:54.227570 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-40c638ce-61cf-4c90-b268-039f4cf251c9 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:54.228409 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d818a639-9416-4b14-9d60-d0d6bdef0bfc tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.880517 Sep 10 11:40:54.229622 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 370/779] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:40:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1883 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 11:40:54.235873 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-ebdf2d3a-54cc-4b17-b76b-ea3ca8b236cf req-03a4d584-be5d-4d8e-bd00-20ab5b21ded6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53e36757-9924-4d03-a8c0-fe52a166ffc1", "tag": "42683686-90d1-4e9e-9012-b0ee66c9e930"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:40:54.247867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-ebdf2d3a-54cc-4b17-b76b-ea3ca8b236cf req-03a4d584-be5d-4d8e-bd00-20ab5b21ded6 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:54.248860 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-ebdf2d3a-54cc-4b17-b76b-ea3ca8b236cf req-03a4d584-be5d-4d8e-bd00-20ab5b21ded6 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:54.249546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-ebdf2d3a-54cc-4b17-b76b-ea3ca8b236cf req-03a4d584-be5d-4d8e-bd00-20ab5b21ded6 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:54.263571 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-ebdf2d3a-54cc-4b17-b76b-ea3ca8b236cf req-03a4d584-be5d-4d8e-bd00-20ab5b21ded6 service nova] Creating event network-changed:42683686-90d1-4e9e-9012-b0ee66c9e930 for instance 53e36757-9924-4d03-a8c0-fe52a166ffc1 on n-h1-856895-1 Sep 10 11:40:54.287347 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-ebdf2d3a-54cc-4b17-b76b-ea3ca8b236cf req-03a4d584-be5d-4d8e-bd00-20ab5b21ded6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054589 Sep 10 11:40:54.288452 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 371/780] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:40:54.315546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-89172825-90e5-40cf-bc0e-93398550cb36 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:54.316426 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-89172825-90e5-40cf-bc0e-93398550cb36 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] [instance: 43593b13-c486-4931-92c8-7ec46c27f6f1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:54.477095 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-89172825-90e5-40cf-bc0e-93398550cb36 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d20eac7b074cc9bee7e8ffb769aa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9f89062992414395b683e882194649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:54.492861 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-89172825-90e5-40cf-bc0e-93398550cb36 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] 10.222.0.23 "GET /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1" status: 200 len: 1216 microversion: 2.1 time: 0.202693 Sep 10 11:40:54.499355 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 372/781] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:54 2022] GET /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1 => generated 1216 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:54.507343 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2c4258b6-ff14-4cfd-816f-8b1d9359f05b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:54.513585 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2c4258b6-ff14-4cfd-816f-8b1d9359f05b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: 3bb65ae3-44e9-4803-b00c-132423b2fd8d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:54.543453 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c4258b6-ff14-4cfd-816f-8b1d9359f05b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:54.544087 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c4258b6-ff14-4cfd-816f-8b1d9359f05b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:54.544546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c4258b6-ff14-4cfd-816f-8b1d9359f05b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:54.545426 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c4258b6-ff14-4cfd-816f-8b1d9359f05b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:54.545947 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c4258b6-ff14-4cfd-816f-8b1d9359f05b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:54.553846 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c4258b6-ff14-4cfd-816f-8b1d9359f05b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:54.583529 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-40c638ce-61cf-4c90-b268-039f4cf251c9 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf661b110ecc4f36b795a980d29f312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5765e50afa045569700eab4616a6a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:54.598506 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-40c638ce-61cf-4c90-b268-039f4cf251c9 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/servers/4c806b91-1302-494f-b4eb-a0b7ba04baf4" status: 200 len: 1466 microversion: 2.1 time: 0.414693 Sep 10 11:40:54.600109 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 410/782] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:54 2022] GET /compute/v2.1/servers/4c806b91-1302-494f-b4eb-a0b7ba04baf4 => generated 1466 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:54.618614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=100 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:40:54.622854 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-141a49a9-1ff4-4cc0-8793-0f294bac6fed tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '.version_select at 0x7f40738a2280>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:54.715294 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-141a49a9-1ff4-4cc0-8793-0f294bac6fed tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/images/c23d4d62-7ab9-4623-9273-7f44582aa2e1" status: 200 len: 784 microversion: 2.1 time: 0.096834 Sep 10 11:40:54.735143 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 411/783] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:40:54 2022] GET /compute/v2.1/images/c23d4d62-7ab9-4623-9273-7f44582aa2e1 => generated 784 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:40:54.741060 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b12d0ba7-c4d1-4179-bb93-6cff13bffbb1 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:54.741826 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b12d0ba7-c4d1-4179-bb93-6cff13bffbb1 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:54.756520 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b12d0ba7-c4d1-4179-bb93-6cff13bffbb1 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:54.760411 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b12d0ba7-c4d1-4179-bb93-6cff13bffbb1 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:54.760988 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b12d0ba7-c4d1-4179-bb93-6cff13bffbb1 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:54.761847 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b12d0ba7-c4d1-4179-bb93-6cff13bffbb1 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:54.764122 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b12d0ba7-c4d1-4179-bb93-6cff13bffbb1 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:54.765771 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b12d0ba7-c4d1-4179-bb93-6cff13bffbb1 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:54.895662 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2c4258b6-ff14-4cfd-816f-8b1d9359f05b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:54.904191 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2c4258b6-ff14-4cfd-816f-8b1d9359f05b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d" status: 200 len: 1317 microversion: 2.1 time: 0.403440 Sep 10 11:40:54.916451 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 373/784] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:54 2022] GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d => generated 1317 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:54.926762 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b5ecccf8-741b-439a-b7d2-71155d0543e1 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:54.938684 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b5ecccf8-741b-439a-b7d2-71155d0543e1 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018331 Sep 10 11:40:54.971104 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 374/785] 10.222.0.23 () {58 vars in 1137 bytes} [Sat Sep 10 11:40:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:40:54.976271 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a5e2c827-4aa8-4073-a1f7-53c5e07eec0b tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '.version_select at 0x7f407369fd30>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:55.040319 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-b12d0ba7-c4d1-4179-bb93-6cff13bffbb1 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lazy-loading 'services' on Instance uuid 89c9187c-06d0-490a-ad42-8c632924689f {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:40:55.144927 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b12d0ba7-c4d1-4179-bb93-6cff13bffbb1 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1929 microversion: 2.75 time: 0.407584 Sep 10 11:40:55.146694 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 412/786] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:54 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1929 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:55.207519 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8908eea1-20d7-4334-a861-95e8a5a39cbf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:55.208309 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8908eea1-20d7-4334-a861-95e8a5a39cbf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: f600488a-7c52-4a96-9375-2723bf42cf83] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:55.225662 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8908eea1-20d7-4334-a861-95e8a5a39cbf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:55.230482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8908eea1-20d7-4334-a861-95e8a5a39cbf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:55.233587 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8908eea1-20d7-4334-a861-95e8a5a39cbf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:55.244135 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8908eea1-20d7-4334-a861-95e8a5a39cbf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:55.245008 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8908eea1-20d7-4334-a861-95e8a5a39cbf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:55.249134 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8908eea1-20d7-4334-a861-95e8a5a39cbf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:55.681619 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8908eea1-20d7-4334-a861-95e8a5a39cbf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:55.698433 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8908eea1-20d7-4334-a861-95e8a5a39cbf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:55.700489 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8908eea1-20d7-4334-a861-95e8a5a39cbf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:55.703002 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8908eea1-20d7-4334-a861-95e8a5a39cbf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83" status: 200 len: 1554 microversion: 2.25 time: 0.500098 Sep 10 11:40:55.704122 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 413/787] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:55 2022] GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83 => generated 1554 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:55.709946 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a2cd0565-30d8-4885-8443-6e97d230de5d tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:55.712141 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a2cd0565-30d8-4885-8443-6e97d230de5d tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] [instance: 43593b13-c486-4931-92c8-7ec46c27f6f1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:55.722979 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2cd0565-30d8-4885-8443-6e97d230de5d tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:55.724492 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2cd0565-30d8-4885-8443-6e97d230de5d tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:55.725436 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2cd0565-30d8-4885-8443-6e97d230de5d tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:55.726588 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2cd0565-30d8-4885-8443-6e97d230de5d tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:55.727475 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2cd0565-30d8-4885-8443-6e97d230de5d tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:55.728610 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2cd0565-30d8-4885-8443-6e97d230de5d tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:55.873990 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a2cd0565-30d8-4885-8443-6e97d230de5d tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d20eac7b074cc9bee7e8ffb769aa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9f89062992414395b683e882194649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:55.897146 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a2cd0565-30d8-4885-8443-6e97d230de5d tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] 10.222.0.23 "GET /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1" status: 200 len: 1212 microversion: 2.1 time: 0.188549 Sep 10 11:40:55.909615 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 414/788] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:55 2022] GET /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1 => generated 1212 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:56.194381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cca2d0b1-ae48-40c9-992d-808a393969e9 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:56.196624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cca2d0b1-ae48-40c9-992d-808a393969e9 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] [instance: f600488a-7c52-4a96-9375-2723bf42cf83] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:56.209519 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cca2d0b1-ae48-40c9-992d-808a393969e9 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:56.211725 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cca2d0b1-ae48-40c9-992d-808a393969e9 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:56.212795 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cca2d0b1-ae48-40c9-992d-808a393969e9 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:56.215996 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cca2d0b1-ae48-40c9-992d-808a393969e9 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:56.216633 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cca2d0b1-ae48-40c9-992d-808a393969e9 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:56.218844 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cca2d0b1-ae48-40c9-992d-808a393969e9 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:56.261619 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:40:56.446947 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a5e2c827-4aa8-4073-a1f7-53c5e07eec0b tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "DELETE /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62" status: 204 len: 0 microversion: 2.1 time: 1.474236 Sep 10 11:40:56.447589 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 375/789] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:54 2022] DELETE /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62 => generated 0 bytes in 1476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:40:56.454056 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-36bb21e4-63f6-45f2-ab82-40d22c7ce47f tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:56.454892 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-36bb21e4-63f6-45f2-ab82-40d22c7ce47f tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: 3bb65ae3-44e9-4803-b00c-132423b2fd8d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:56.473869 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36bb21e4-63f6-45f2-ab82-40d22c7ce47f tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:56.474407 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36bb21e4-63f6-45f2-ab82-40d22c7ce47f tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:56.474853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36bb21e4-63f6-45f2-ab82-40d22c7ce47f tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:56.479597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36bb21e4-63f6-45f2-ab82-40d22c7ce47f tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:56.480317 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36bb21e4-63f6-45f2-ab82-40d22c7ce47f tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:56.480916 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36bb21e4-63f6-45f2-ab82-40d22c7ce47f tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:56.493552 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-cca2d0b1-ae48-40c9-992d-808a393969e9 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lazy-loading 'services' on Instance uuid f600488a-7c52-4a96-9375-2723bf42cf83 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:40:56.511459 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cca2d0b1-ae48-40c9-992d-808a393969e9 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83" status: 200 len: 2044 microversion: 2.25 time: 0.600353 Sep 10 11:40:56.523198 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 415/790] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:55 2022] GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83 => generated 2044 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:56.523198 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e88fc940-c1bd-40b2-9752-24bad5826b15 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:56.523198 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e88fc940-c1bd-40b2-9752-24bad5826b15 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:56.526127 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e88fc940-c1bd-40b2-9752-24bad5826b15 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:56.526732 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e88fc940-c1bd-40b2-9752-24bad5826b15 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:56.527313 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e88fc940-c1bd-40b2-9752-24bad5826b15 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:56.528578 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e88fc940-c1bd-40b2-9752-24bad5826b15 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:56.529169 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e88fc940-c1bd-40b2-9752-24bad5826b15 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:56.529990 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e88fc940-c1bd-40b2-9752-24bad5826b15 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:56.654107 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-e88fc940-c1bd-40b2-9752-24bad5826b15 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lazy-loading 'services' on Instance uuid 89c9187c-06d0-490a-ad42-8c632924689f {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:40:56.691246 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e88fc940-c1bd-40b2-9752-24bad5826b15 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1929 microversion: 2.75 time: 0.177507 Sep 10 11:40:56.692573 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 416/791] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:56 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1929 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:56.697834 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6c0bc81f-d551-4706-ad68-2748f83005ce tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '.version_select at 0x7f4078c2b670>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:56.737873 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-6c0bc81f-d551-4706-ad68-2748f83005ce tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] HTTP exception thrown: Image not found. Sep 10 11:40:56.763271 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6c0bc81f-d551-4706-ad68-2748f83005ce tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Request method failure captured: Sep 10 11:40:56.763271 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62 HTTP/1.1 Sep 10 11:40:56.763271 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:40:56.763271 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:40:56.763271 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:40:56.763271 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:40:56.763271 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:40:56.763271 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:40:56.763271 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:40:56.763271 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:40:56.763271 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHeNZh0QsKAWCri91V-XMNBwVyxCngmCDeOu57JghGMX0SdTAhjYXC-vR2THqetjhfs7l1FgyGX-IA3A_GwYS8xxZndnjNDFjnU2duWH_9QvpHXc2SSZe4-4m4gx_aWPfm1_tQNvJ2Qck3faUpPuLXwa9CvGlianXQAQkKT7n56Ekc0 Sep 10 11:40:56.763271 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:40:56.763271 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:40:56.763271 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:40:56.763271 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:40:56.763271 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:40:56.763271 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:40:56.763271 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: d5765e50afa045569700eab4616a6a43 Sep 10 11:40:56.763271 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ImagesOneServerTestJSON-621761848 Sep 10 11:40:56.763271 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:40:56.763271 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:40:56.765683 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d5765e50afa045569700eab4616a6a43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d5765e50afa045569700eab4616a6a43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d5765e50afa045569700eab4616a6a43", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d5765e50afa045569700eab4616a6a43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:40:56.765683 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ImagesOneServerTestJSON-621761848 Sep 10 11:40:56.765683 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: d5765e50afa045569700eab4616a6a43 Sep 10 11:40:56.765683 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-621761848 Sep 10 11:40:56.765683 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ImagesOneServerTestJSON-621761848-project Sep 10 11:40:56.765683 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:40:56.765683 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:40:56.765683 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: cf661b110ecc4f36b795a980d29f312a Sep 10 11:40:56.765683 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ImagesOneServerTestJSON-621761848-project Sep 10 11:40:56.765683 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:40:56.765683 n-d-856895-1 devstack@n-api.service[128776]: exception: Image not found. Sep 10 11:40:56.765683 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '65eff672-4353-4584-b751-ee21b0a4af62'} Sep 10 11:40:56.765683 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:40:56.766694 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:40:56.766694 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 11:40:56.766694 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 11:40:56.766694 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 11:40:56.766694 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 11:40:56.766694 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 11:40:56.766694 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 11:40:56.766694 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 11:40:56.766694 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 11:40:56.766694 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 11:40:56.766694 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 11:40:56.766694 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 11:40:56.766694 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 11:40:56.766694 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 11:40:56.766694 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 11:40:56.766694 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 11:40:56.766694 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 11:40:56.766694 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 65eff672-4353-4584-b751-ee21b0a4af62 Sep 10 11:40:56.768049 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:40:56.768049 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:40:56.768049 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:40:56.768049 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:40:56.768049 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 10 11:40:56.768049 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 10 11:40:56.768049 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 10 11:40:56.768049 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 10 11:40:56.768049 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 10 11:40:56.768049 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 10 11:40:56.768049 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 10 11:40:56.768049 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 10 11:40:56.768049 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 11:40:56.768049 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 11:40:56.768049 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 11:40:56.768049 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 11:40:56.768049 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 11:40:56.768049 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 11:40:56.768049 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 11:40:56.768049 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 11:40:56.769548 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 11:40:56.769548 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 11:40:56.769548 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 11:40:56.769548 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 11:40:56.769548 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 11:40:56.769548 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 11:40:56.769548 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 11:40:56.769548 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 11:40:56.769548 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 65eff672-4353-4584-b751-ee21b0a4af62 could not be found. Sep 10 11:40:56.769548 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:40:56.769548 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:40:56.769548 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:40:56.769548 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:40:56.769548 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:40:56.769548 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:40:56.769548 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:40:56.769548 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:40:56.769548 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:40:56.769548 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:40:56.770898 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:40:56.770898 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:40:56.770898 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 10 11:40:56.770898 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 11:40:56.770898 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 11:40:56.770898 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:40:56.770898 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:40:56.770898 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:40:56.770898 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:40:56.770898 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:40:56.770898 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:40:56.770898 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:40:56.770898 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:40:56.770898 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 11:40:56.770898 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:40:56.774265 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6c0bc81f-d551-4706-ad68-2748f83005ce tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Returning 404 to user: Image not found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:40:56.774265 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6c0bc81f-d551-4706-ad68-2748f83005ce tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62" status: 404 len: 62 microversion: 2.1 time: 0.080532 Sep 10 11:40:56.775850 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-36bb21e4-63f6-45f2-ab82-40d22c7ce47f tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:56.784099 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 417/792] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:40:56 2022] GET /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62 => generated 62 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:40:56.789297 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-36bb21e4-63f6-45f2-ab82-40d22c7ce47f tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d" status: 200 len: 1317 microversion: 2.1 time: 0.340011 Sep 10 11:40:56.794563 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-751dd055-40b5-4975-a7d9-8c04230ecc2c tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:56.795515 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-751dd055-40b5-4975-a7d9-8c04230ecc2c tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] [instance: f600488a-7c52-4a96-9375-2723bf42cf83] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:56.797035 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 376/793] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:56 2022] GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d => generated 1317 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:56.811218 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8485447c-7dd7-4f1d-9b7d-44e452300696 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1539209908"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:40:56.811690 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-751dd055-40b5-4975-a7d9-8c04230ecc2c tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:56.811690 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-751dd055-40b5-4975-a7d9-8c04230ecc2c tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:56.811690 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-751dd055-40b5-4975-a7d9-8c04230ecc2c tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:56.817261 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-751dd055-40b5-4975-a7d9-8c04230ecc2c tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:56.817838 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-751dd055-40b5-4975-a7d9-8c04230ecc2c tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:56.818297 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-751dd055-40b5-4975-a7d9-8c04230ecc2c tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:56.819250 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8485447c-7dd7-4f1d-9b7d-44e452300696 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] [instance: 4c806b91-1302-494f-b4eb-a0b7ba04baf4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:56.834849 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8485447c-7dd7-4f1d-9b7d-44e452300696 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:56.835708 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8485447c-7dd7-4f1d-9b7d-44e452300696 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:56.836511 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8485447c-7dd7-4f1d-9b7d-44e452300696 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:56.839869 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8485447c-7dd7-4f1d-9b7d-44e452300696 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:56.840830 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8485447c-7dd7-4f1d-9b7d-44e452300696 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:56.841599 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8485447c-7dd7-4f1d-9b7d-44e452300696 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:56.978518 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-751dd055-40b5-4975-a7d9-8c04230ecc2c tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lazy-loading 'services' on Instance uuid f600488a-7c52-4a96-9375-2723bf42cf83 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:40:56.993985 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-751dd055-40b5-4975-a7d9-8c04230ecc2c tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83" status: 200 len: 2044 microversion: 2.25 time: 0.208352 Sep 10 11:40:56.995153 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 418/794] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:56 2022] GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83 => generated 2044 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:40:57.000917 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2cca966f-365d-49b9-a217-4c460e01ae1c tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:57.001767 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2cca966f-365d-49b9-a217-4c460e01ae1c tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] [instance: 43593b13-c486-4931-92c8-7ec46c27f6f1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:57.008221 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2cca966f-365d-49b9-a217-4c460e01ae1c tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:57.008925 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2cca966f-365d-49b9-a217-4c460e01ae1c tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:57.009550 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2cca966f-365d-49b9-a217-4c460e01ae1c tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:57.010411 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2cca966f-365d-49b9-a217-4c460e01ae1c tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:57.011015 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2cca966f-365d-49b9-a217-4c460e01ae1c tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:57.011642 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2cca966f-365d-49b9-a217-4c460e01ae1c tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:57.126114 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2cca966f-365d-49b9-a217-4c460e01ae1c tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d20eac7b074cc9bee7e8ffb769aa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9f89062992414395b683e882194649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:57.136284 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2cca966f-365d-49b9-a217-4c460e01ae1c tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] 10.222.0.23 "GET /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1" status: 200 len: 1268 microversion: 2.1 time: 0.139894 Sep 10 11:40:57.139181 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 419/795] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:56 2022] GET /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1 => generated 1268 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:57.144798 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f4a11d71-f207-4cb4-8001-6e1f528736e0 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:57.156545 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4a11d71-f207-4cb4-8001-6e1f528736e0 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:57.157590 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4a11d71-f207-4cb4-8001-6e1f528736e0 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:57.159333 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4a11d71-f207-4cb4-8001-6e1f528736e0 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:57.168558 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4a11d71-f207-4cb4-8001-6e1f528736e0 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:57.169857 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4a11d71-f207-4cb4-8001-6e1f528736e0 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:57.173618 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4a11d71-f207-4cb4-8001-6e1f528736e0 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:57.181698 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8485447c-7dd7-4f1d-9b7d-44e452300696 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "POST /compute/v2.1/servers/4c806b91-1302-494f-b4eb-a0b7ba04baf4/action" status: 202 len: 0 microversion: 2.1 time: 0.382432 Sep 10 11:40:57.186202 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 377/796] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:40:56 2022] POST /compute/v2.1/servers/4c806b91-1302-494f-b4eb-a0b7ba04baf4/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 10 11:40:57.200484 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-57adef78-0802-4e26-bd6d-11bf6636f000 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '.version_select at 0x7f40738cfd30>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:57.235462 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f4a11d71-f207-4cb4-8001-6e1f528736e0 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.093951 Sep 10 11:40:57.236437 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 420/797] 10.222.0.23 () {60 vars in 1217 bytes} [Sat Sep 10 11:40:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:40:57.250219 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-af6be9dc-54d6-445b-a0c1-ed29b0023822 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-856895-1", "block_migration": "auto"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:40:57.253321 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-af6be9dc-54d6-445b-a0c1-ed29b0023822 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] [instance: f600488a-7c52-4a96-9375-2723bf42cf83] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:57.260372 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af6be9dc-54d6-445b-a0c1-ed29b0023822 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:57.261199 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af6be9dc-54d6-445b-a0c1-ed29b0023822 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:57.261864 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af6be9dc-54d6-445b-a0c1-ed29b0023822 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:57.262956 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af6be9dc-54d6-445b-a0c1-ed29b0023822 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:57.263845 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af6be9dc-54d6-445b-a0c1-ed29b0023822 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:57.264885 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af6be9dc-54d6-445b-a0c1-ed29b0023822 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:57.301295 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-57adef78-0802-4e26-bd6d-11bf6636f000 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/images/84d5e2a0-f60b-46aa-8df1-91f5ffdf5351" status: 200 len: 1427 microversion: 2.1 time: 0.104720 Sep 10 11:40:57.302287 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 378/798] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:40:57 2022] GET /compute/v2.1/images/84d5e2a0-f60b-46aa-8df1-91f5ffdf5351 => generated 1427 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:40:57.354838 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-4fb44743-b136-4d62-89d3-900c30f58052 req-c6dd4454-17bc-4722-8343-592472da34b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c806b91-1302-494f-b4eb-a0b7ba04baf4", "name": "network-vif-unplugged", "status": "completed", "tag": "3488be85-30de-46d4-a138-f4f55f4c37ce"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:40:57.387767 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-4fb44743-b136-4d62-89d3-900c30f58052 req-c6dd4454-17bc-4722-8343-592472da34b5 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:57.391857 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-4fb44743-b136-4d62-89d3-900c30f58052 req-c6dd4454-17bc-4722-8343-592472da34b5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:57.396488 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-4fb44743-b136-4d62-89d3-900c30f58052 req-c6dd4454-17bc-4722-8343-592472da34b5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:57.437361 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-4fb44743-b136-4d62-89d3-900c30f58052 req-c6dd4454-17bc-4722-8343-592472da34b5 service nova] Creating event network-vif-unplugged:3488be85-30de-46d4-a138-f4f55f4c37ce for instance 4c806b91-1302-494f-b4eb-a0b7ba04baf4 on n-h2-856895-1 Sep 10 11:40:57.448603 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-4fb44743-b136-4d62-89d3-900c30f58052 req-c6dd4454-17bc-4722-8343-592472da34b5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097259 Sep 10 11:40:57.458263 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 379/799] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:40:57.517058 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-af6be9dc-54d6-445b-a0c1-ed29b0023822 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lazy-loading 'flavor' on Instance uuid f600488a-7c52-4a96-9375-2723bf42cf83 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:40:57.620434 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-af6be9dc-54d6-445b-a0c1-ed29b0023822 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] [instance: f600488a-7c52-4a96-9375-2723bf42cf83] Going to try to live migrate instance to n-h1-856895-1 {{(pid=128776) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 10 11:40:57.725159 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-99b9851a-5834-45c0-ab97-538137bdb5dd tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:57.726823 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-99b9851a-5834-45c0-ab97-538137bdb5dd tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:57.741130 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99b9851a-5834-45c0-ab97-538137bdb5dd tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:57.742021 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99b9851a-5834-45c0-ab97-538137bdb5dd tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:57.742537 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99b9851a-5834-45c0-ab97-538137bdb5dd tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:57.743278 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99b9851a-5834-45c0-ab97-538137bdb5dd tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:57.743742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99b9851a-5834-45c0-ab97-538137bdb5dd tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:57.744185 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99b9851a-5834-45c0-ab97-538137bdb5dd tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:57.916504 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-99b9851a-5834-45c0-ab97-538137bdb5dd tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lazy-loading 'services' on Instance uuid 89c9187c-06d0-490a-ad42-8c632924689f {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:40:57.978918 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-99b9851a-5834-45c0-ab97-538137bdb5dd tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1929 microversion: 2.75 time: 0.257569 Sep 10 11:40:57.990808 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 380/800] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:57 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1929 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:40:58.007989 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7f8efb8d-6180-4da0-80a9-918b53e17273 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:58.009327 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7f8efb8d-6180-4da0-80a9-918b53e17273 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: 3bb65ae3-44e9-4803-b00c-132423b2fd8d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:58.025270 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f8efb8d-6180-4da0-80a9-918b53e17273 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:58.026101 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f8efb8d-6180-4da0-80a9-918b53e17273 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:58.026810 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f8efb8d-6180-4da0-80a9-918b53e17273 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:58.027917 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f8efb8d-6180-4da0-80a9-918b53e17273 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:58.029093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f8efb8d-6180-4da0-80a9-918b53e17273 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:58.029894 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f8efb8d-6180-4da0-80a9-918b53e17273 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:58.410612 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7f8efb8d-6180-4da0-80a9-918b53e17273 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:58.424945 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7f8efb8d-6180-4da0-80a9-918b53e17273 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d" status: 200 len: 1317 microversion: 2.1 time: 0.432347 Sep 10 11:40:58.426621 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 381/801] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:57 2022] GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d => generated 1317 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:58.452266 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0e73579b-c7f0-4936-9eeb-f8afc09e2b8a tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:58.456556 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0e73579b-c7f0-4936-9eeb-f8afc09e2b8a tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] [instance: 43593b13-c486-4931-92c8-7ec46c27f6f1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:58.464429 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:40:58.466483 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e73579b-c7f0-4936-9eeb-f8afc09e2b8a tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:58.467541 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e73579b-c7f0-4936-9eeb-f8afc09e2b8a tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:58.468166 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e73579b-c7f0-4936-9eeb-f8afc09e2b8a tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:58.469062 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e73579b-c7f0-4936-9eeb-f8afc09e2b8a tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:58.469690 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e73579b-c7f0-4936-9eeb-f8afc09e2b8a tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:58.470333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e73579b-c7f0-4936-9eeb-f8afc09e2b8a tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:58.623861 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0e73579b-c7f0-4936-9eeb-f8afc09e2b8a tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d20eac7b074cc9bee7e8ffb769aa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9f89062992414395b683e882194649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:58.638977 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0e73579b-c7f0-4936-9eeb-f8afc09e2b8a tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] 10.222.0.23 "GET /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1" status: 200 len: 1274 microversion: 2.1 time: 0.200907 Sep 10 11:40:58.664151 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 382/802] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:58 2022] GET /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1 => generated 1274 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:58.674720 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1dfcd53d-9206-4d24-86f8-eb6682af989b tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '.version_select at 0x7f407374fd30>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:58.780116 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1dfcd53d-9206-4d24-86f8-eb6682af989b tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/images/84d5e2a0-f60b-46aa-8df1-91f5ffdf5351" status: 200 len: 1427 microversion: 2.1 time: 0.113770 Sep 10 11:40:58.802186 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 383/803] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:40:58 2022] GET /compute/v2.1/images/84d5e2a0-f60b-46aa-8df1-91f5ffdf5351 => generated 1427 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:59.030257 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b2e3ed94-6710-4d53-aff8-a5583be4300a tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:59.032595 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b2e3ed94-6710-4d53-aff8-a5583be4300a tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:59.066768 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b2e3ed94-6710-4d53-aff8-a5583be4300a tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:59.067457 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b2e3ed94-6710-4d53-aff8-a5583be4300a tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:59.068163 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b2e3ed94-6710-4d53-aff8-a5583be4300a tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:59.069945 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b2e3ed94-6710-4d53-aff8-a5583be4300a tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:59.070809 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b2e3ed94-6710-4d53-aff8-a5583be4300a tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:59.071510 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b2e3ed94-6710-4d53-aff8-a5583be4300a tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:59.179368 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-b2e3ed94-6710-4d53-aff8-a5583be4300a tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lazy-loading 'services' on Instance uuid 89c9187c-06d0-490a-ad42-8c632924689f {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:40:59.219155 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b2e3ed94-6710-4d53-aff8-a5583be4300a tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1929 microversion: 2.75 time: 0.198567 Sep 10 11:40:59.222612 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 384/804] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:40:59 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1929 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:40:59.455273 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e974254c-2363-4767-b4f9-e228d12563c0 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:59.456112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e974254c-2363-4767-b4f9-e228d12563c0 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: 3bb65ae3-44e9-4803-b00c-132423b2fd8d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:59.462957 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e974254c-2363-4767-b4f9-e228d12563c0 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:59.463486 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e974254c-2363-4767-b4f9-e228d12563c0 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:59.463930 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e974254c-2363-4767-b4f9-e228d12563c0 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:59.464643 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e974254c-2363-4767-b4f9-e228d12563c0 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:59.465109 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e974254c-2363-4767-b4f9-e228d12563c0 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:59.465601 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e974254c-2363-4767-b4f9-e228d12563c0 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:59.634367 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e974254c-2363-4767-b4f9-e228d12563c0 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:59.645579 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e974254c-2363-4767-b4f9-e228d12563c0 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d" status: 200 len: 1317 microversion: 2.1 time: 0.194874 Sep 10 11:40:59.655195 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 385/805] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:59 2022] GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:59.655195 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-3a0beb3a-fe6a-40b3-bf70-2ed9cd26058e req-d0808d97-b59f-4d5a-8a39-7cbcc9053ea7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bb65ae3-44e9-4803-b00c-132423b2fd8d", "name": "network-vif-plugged", "status": "completed", "tag": "b5615556-cec7-42af-9601-2d0e112e6b17"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:40:59.663008 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-3a0beb3a-fe6a-40b3-bf70-2ed9cd26058e req-d0808d97-b59f-4d5a-8a39-7cbcc9053ea7 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:59.664216 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-3a0beb3a-fe6a-40b3-bf70-2ed9cd26058e req-d0808d97-b59f-4d5a-8a39-7cbcc9053ea7 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:59.664961 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-3a0beb3a-fe6a-40b3-bf70-2ed9cd26058e req-d0808d97-b59f-4d5a-8a39-7cbcc9053ea7 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:59.681714 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-3a0beb3a-fe6a-40b3-bf70-2ed9cd26058e req-d0808d97-b59f-4d5a-8a39-7cbcc9053ea7 service nova] Creating event network-vif-plugged:b5615556-cec7-42af-9601-2d0e112e6b17 for instance 3bb65ae3-44e9-4803-b00c-132423b2fd8d on n-h1-856895-1 Sep 10 11:40:59.688993 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-3a0beb3a-fe6a-40b3-bf70-2ed9cd26058e req-d0808d97-b59f-4d5a-8a39-7cbcc9053ea7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040303 Sep 10 11:40:59.691540 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 386/806] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:40:59.704501 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-28fda83b-1cbf-4444-acf9-1781ce149a40 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:40:59.705509 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-28fda83b-1cbf-4444-acf9-1781ce149a40 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] [instance: 43593b13-c486-4931-92c8-7ec46c27f6f1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:40:59.715931 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28fda83b-1cbf-4444-acf9-1781ce149a40 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:59.716437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28fda83b-1cbf-4444-acf9-1781ce149a40 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:59.716987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28fda83b-1cbf-4444-acf9-1781ce149a40 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:59.718667 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28fda83b-1cbf-4444-acf9-1781ce149a40 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:40:59.719539 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28fda83b-1cbf-4444-acf9-1781ce149a40 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:40:59.720259 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28fda83b-1cbf-4444-acf9-1781ce149a40 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:40:59.964709 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-28fda83b-1cbf-4444-acf9-1781ce149a40 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d20eac7b074cc9bee7e8ffb769aa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9f89062992414395b683e882194649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:40:59.976089 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-28fda83b-1cbf-4444-acf9-1781ce149a40 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] 10.222.0.23 "GET /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1" status: 200 len: 1316 microversion: 2.1 time: 0.282232 Sep 10 11:40:59.991656 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 387/807] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:40:59 2022] GET /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1 => generated 1316 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:40:59.999790 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f2c56029-ee75-445f-bd1a-7bb821f60d1d tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '.version_select at 0x7f407357eb80>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:00.080755 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-af6be9dc-54d6-445b-a0c1-ed29b0023822 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83/action" status: 202 len: 0 microversion: 2.25 time: 2.835049 Sep 10 11:41:00.084077 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 421/808] 10.222.0.23 () {62 vars in 1319 bytes} [Sat Sep 10 11:40:57 2022] POST /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83/action => generated 0 bytes in 2838 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 10 11:41:00.088300 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f2c56029-ee75-445f-bd1a-7bb821f60d1d tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/images/84d5e2a0-f60b-46aa-8df1-91f5ffdf5351" status: 200 len: 1427 microversion: 2.1 time: 0.094974 Sep 10 11:41:00.093291 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7ecaaeeb-b1e1-47f5-b981-8f3702347011 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:00.094922 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7ecaaeeb-b1e1-47f5-b981-8f3702347011 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: f600488a-7c52-4a96-9375-2723bf42cf83] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:00.102542 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 388/809] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:40:59 2022] GET /compute/v2.1/images/84d5e2a0-f60b-46aa-8df1-91f5ffdf5351 => generated 1427 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:00.104213 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7ecaaeeb-b1e1-47f5-b981-8f3702347011 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:00.105053 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7ecaaeeb-b1e1-47f5-b981-8f3702347011 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:00.105750 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7ecaaeeb-b1e1-47f5-b981-8f3702347011 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:00.107334 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7ecaaeeb-b1e1-47f5-b981-8f3702347011 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:00.107962 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7ecaaeeb-b1e1-47f5-b981-8f3702347011 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:00.108574 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7ecaaeeb-b1e1-47f5-b981-8f3702347011 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:00.251940 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f8a3b80f-79a1-452d-ae8c-138f3bd05cd7 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:00.252567 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f8a3b80f-79a1-452d-ae8c-138f3bd05cd7 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:00.264363 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8a3b80f-79a1-452d-ae8c-138f3bd05cd7 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:00.267923 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8a3b80f-79a1-452d-ae8c-138f3bd05cd7 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:00.268607 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8a3b80f-79a1-452d-ae8c-138f3bd05cd7 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:00.269547 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8a3b80f-79a1-452d-ae8c-138f3bd05cd7 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:00.278113 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8a3b80f-79a1-452d-ae8c-138f3bd05cd7 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:00.278818 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8a3b80f-79a1-452d-ae8c-138f3bd05cd7 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:00.406372 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-f8a3b80f-79a1-452d-ae8c-138f3bd05cd7 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lazy-loading 'services' on Instance uuid 89c9187c-06d0-490a-ad42-8c632924689f {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:41:00.438643 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f8a3b80f-79a1-452d-ae8c-138f3bd05cd7 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1929 microversion: 2.75 time: 0.192020 Sep 10 11:41:00.453092 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 389/810] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:00 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1929 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:00.552563 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7ecaaeeb-b1e1-47f5-b981-8f3702347011 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:00.563674 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7ecaaeeb-b1e1-47f5-b981-8f3702347011 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:00.566897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7ecaaeeb-b1e1-47f5-b981-8f3702347011 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:00.568492 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7ecaaeeb-b1e1-47f5-b981-8f3702347011 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83" status: 200 len: 1564 microversion: 2.25 time: 0.481050 Sep 10 11:41:00.585330 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 422/811] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:00 2022] GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83 => generated 1564 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:00.683253 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0b280532-396d-434f-bf0e-2f68a6dd6021 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:00.683794 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0b280532-396d-434f-bf0e-2f68a6dd6021 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: 3bb65ae3-44e9-4803-b00c-132423b2fd8d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:00.692538 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0b280532-396d-434f-bf0e-2f68a6dd6021 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:00.693050 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0b280532-396d-434f-bf0e-2f68a6dd6021 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:00.694094 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0b280532-396d-434f-bf0e-2f68a6dd6021 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:00.695254 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0b280532-396d-434f-bf0e-2f68a6dd6021 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:00.695671 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0b280532-396d-434f-bf0e-2f68a6dd6021 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:00.696100 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0b280532-396d-434f-bf0e-2f68a6dd6021 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:00.874065 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0b280532-396d-434f-bf0e-2f68a6dd6021 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:00.883806 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0b280532-396d-434f-bf0e-2f68a6dd6021 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d" status: 200 len: 1317 microversion: 2.1 time: 0.217532 Sep 10 11:41:00.884936 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 390/812] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:00 2022] GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d => generated 1317 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:00.947017 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-a512f9f8-87a2-447b-af69-df9264a43a54 req-fb418c78-73c6-480e-8ca0-d4b3beef1aba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43593b13-c486-4931-92c8-7ec46c27f6f1", "tag": "bf9bc2c7-0d4f-4718-afea-ea1a5bf9ee42"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:00.980569 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a512f9f8-87a2-447b-af69-df9264a43a54 req-fb418c78-73c6-480e-8ca0-d4b3beef1aba service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:00.982214 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a512f9f8-87a2-447b-af69-df9264a43a54 req-fb418c78-73c6-480e-8ca0-d4b3beef1aba service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:00.984198 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a512f9f8-87a2-447b-af69-df9264a43a54 req-fb418c78-73c6-480e-8ca0-d4b3beef1aba service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:01.001113 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c79a566e-5283-4bf4-af83-466fe82eee02 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:01.001739 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c79a566e-5283-4bf4-af83-466fe82eee02 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] [instance: 43593b13-c486-4931-92c8-7ec46c27f6f1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:01.025330 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-a512f9f8-87a2-447b-af69-df9264a43a54 req-fb418c78-73c6-480e-8ca0-d4b3beef1aba service nova] Creating event network-changed:bf9bc2c7-0d4f-4718-afea-ea1a5bf9ee42 for instance 43593b13-c486-4931-92c8-7ec46c27f6f1 on n-h2-856895-1 Sep 10 11:41:01.025556 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c79a566e-5283-4bf4-af83-466fe82eee02 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:01.026053 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c79a566e-5283-4bf4-af83-466fe82eee02 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:01.026513 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c79a566e-5283-4bf4-af83-466fe82eee02 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:01.027279 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c79a566e-5283-4bf4-af83-466fe82eee02 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:01.027752 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c79a566e-5283-4bf4-af83-466fe82eee02 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:01.028187 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c79a566e-5283-4bf4-af83-466fe82eee02 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:01.044189 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-a512f9f8-87a2-447b-af69-df9264a43a54 req-fb418c78-73c6-480e-8ca0-d4b3beef1aba service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097985 Sep 10 11:41:01.047257 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 423/813] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:41:01.110877 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b7bdc774-dc88-4d53-bfed-feaf2ab106b2 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '.version_select at 0x7f407383ce50>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:01.231472 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b7bdc774-dc88-4d53-bfed-feaf2ab106b2 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/images/84d5e2a0-f60b-46aa-8df1-91f5ffdf5351" status: 200 len: 1427 microversion: 2.1 time: 0.128264 Sep 10 11:41:01.232045 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 424/814] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:41:01 2022] GET /compute/v2.1/images/84d5e2a0-f60b-46aa-8df1-91f5ffdf5351 => generated 1427 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:01.350302 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c79a566e-5283-4bf4-af83-466fe82eee02 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d20eac7b074cc9bee7e8ffb769aa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9f89062992414395b683e882194649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:01.361267 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c79a566e-5283-4bf4-af83-466fe82eee02 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] 10.222.0.23 "GET /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1" status: 200 len: 1316 microversion: 2.1 time: 0.364179 Sep 10 11:41:01.379736 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 391/815] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:00 2022] GET /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1 => generated 1316 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:41:01.468541 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-04922cb4-0901-4cb3-9bf6-43098cb563d5 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:01.470031 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-04922cb4-0901-4cb3-9bf6-43098cb563d5 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:01.498815 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-04922cb4-0901-4cb3-9bf6-43098cb563d5 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:01.503553 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-04922cb4-0901-4cb3-9bf6-43098cb563d5 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:01.504074 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-04922cb4-0901-4cb3-9bf6-43098cb563d5 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:01.507530 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-04922cb4-0901-4cb3-9bf6-43098cb563d5 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:01.509698 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-04922cb4-0901-4cb3-9bf6-43098cb563d5 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:01.510164 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-04922cb4-0901-4cb3-9bf6-43098cb563d5 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:01.605564 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8fc4f50d-f2d3-40bf-8c98-79f2fce8faae tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:01.608712 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8fc4f50d-f2d3-40bf-8c98-79f2fce8faae tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: f600488a-7c52-4a96-9375-2723bf42cf83] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:01.641716 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8fc4f50d-f2d3-40bf-8c98-79f2fce8faae tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:01.644032 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8fc4f50d-f2d3-40bf-8c98-79f2fce8faae tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:01.644654 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8fc4f50d-f2d3-40bf-8c98-79f2fce8faae tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:01.647014 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8fc4f50d-f2d3-40bf-8c98-79f2fce8faae tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:01.649440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8fc4f50d-f2d3-40bf-8c98-79f2fce8faae tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:01.650302 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8fc4f50d-f2d3-40bf-8c98-79f2fce8faae tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:01.721595 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-04922cb4-0901-4cb3-9bf6-43098cb563d5 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lazy-loading 'services' on Instance uuid 89c9187c-06d0-490a-ad42-8c632924689f {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:41:01.774923 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-04922cb4-0901-4cb3-9bf6-43098cb563d5 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1929 microversion: 2.75 time: 0.312692 Sep 10 11:41:01.777694 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 425/816] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:01 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1929 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:01.909006 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d2e4e2b8-0696-47e7-8609-0616c982e277 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:01.909620 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d2e4e2b8-0696-47e7-8609-0616c982e277 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: 3bb65ae3-44e9-4803-b00c-132423b2fd8d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:01.916865 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2e4e2b8-0696-47e7-8609-0616c982e277 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:01.917357 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2e4e2b8-0696-47e7-8609-0616c982e277 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:01.917791 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2e4e2b8-0696-47e7-8609-0616c982e277 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:01.918492 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2e4e2b8-0696-47e7-8609-0616c982e277 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:01.918943 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2e4e2b8-0696-47e7-8609-0616c982e277 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:01.919396 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2e4e2b8-0696-47e7-8609-0616c982e277 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:02.011004 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8fc4f50d-f2d3-40bf-8c98-79f2fce8faae tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:02.029492 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8fc4f50d-f2d3-40bf-8c98-79f2fce8faae tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:02.039077 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8fc4f50d-f2d3-40bf-8c98-79f2fce8faae tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:02.041088 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8fc4f50d-f2d3-40bf-8c98-79f2fce8faae tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83" status: 200 len: 1564 microversion: 2.25 time: 0.444831 Sep 10 11:41:02.041875 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 392/817] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:01 2022] GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83 => generated 1564 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:02.183850 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d2e4e2b8-0696-47e7-8609-0616c982e277 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:02.196646 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d2e4e2b8-0696-47e7-8609-0616c982e277 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d" status: 200 len: 1466 microversion: 2.1 time: 0.292814 Sep 10 11:41:02.198061 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 426/818] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:01 2022] GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d => generated 1466 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:02.225639 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6729e989-0a6a-42d7-97ac-3cb080fdacfc tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:02.226540 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6729e989-0a6a-42d7-97ac-3cb080fdacfc tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] [instance: 3bb65ae3-44e9-4803-b00c-132423b2fd8d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:02.240245 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6729e989-0a6a-42d7-97ac-3cb080fdacfc tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:02.240731 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6729e989-0a6a-42d7-97ac-3cb080fdacfc tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:02.241168 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6729e989-0a6a-42d7-97ac-3cb080fdacfc tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:02.241872 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6729e989-0a6a-42d7-97ac-3cb080fdacfc tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:02.242497 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6729e989-0a6a-42d7-97ac-3cb080fdacfc tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:02.248910 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a46dcf11-44df-4f91-82ce-164197213f59 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '.version_select at 0x7f407380d550>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:02.254549 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6729e989-0a6a-42d7-97ac-3cb080fdacfc tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:02.291663 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-6729e989-0a6a-42d7-97ac-3cb080fdacfc tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] Lazy-loading 'flavor' on Instance uuid 3bb65ae3-44e9-4803-b00c-132423b2fd8d {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:41:02.327286 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:41:02.409831 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6729e989-0a6a-42d7-97ac-3cb080fdacfc tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d/action" status: 202 len: 0 microversion: 2.1 time: 0.182347 Sep 10 11:41:02.413644 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 393/819] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:41:02 2022] POST /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:41:02.421752 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ee18cab2-c42f-4c66-ba99-868701cfd7dc tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:02.424163 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ee18cab2-c42f-4c66-ba99-868701cfd7dc tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] [instance: 43593b13-c486-4931-92c8-7ec46c27f6f1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:02.431361 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee18cab2-c42f-4c66-ba99-868701cfd7dc tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:02.431937 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee18cab2-c42f-4c66-ba99-868701cfd7dc tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:02.432482 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee18cab2-c42f-4c66-ba99-868701cfd7dc tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:02.435865 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee18cab2-c42f-4c66-ba99-868701cfd7dc tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:02.439514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee18cab2-c42f-4c66-ba99-868701cfd7dc tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:02.440630 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee18cab2-c42f-4c66-ba99-868701cfd7dc tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:02.657313 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ee18cab2-c42f-4c66-ba99-868701cfd7dc tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d20eac7b074cc9bee7e8ffb769aa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9f89062992414395b683e882194649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:02.667977 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ee18cab2-c42f-4c66-ba99-868701cfd7dc tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] 10.222.0.23 "GET /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1" status: 200 len: 1316 microversion: 2.1 time: 0.252735 Sep 10 11:41:02.669284 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 394/820] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:02 2022] GET /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1 => generated 1316 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:02.675069 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ba209d10-d0c0-4c6d-b74d-56e5a59c6595 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:02.676121 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ba209d10-d0c0-4c6d-b74d-56e5a59c6595 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: 3bb65ae3-44e9-4803-b00c-132423b2fd8d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:02.683704 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba209d10-d0c0-4c6d-b74d-56e5a59c6595 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:02.693408 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba209d10-d0c0-4c6d-b74d-56e5a59c6595 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:02.699382 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba209d10-d0c0-4c6d-b74d-56e5a59c6595 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:02.700894 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba209d10-d0c0-4c6d-b74d-56e5a59c6595 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:02.702623 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba209d10-d0c0-4c6d-b74d-56e5a59c6595 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:02.705580 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba209d10-d0c0-4c6d-b74d-56e5a59c6595 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:02.919446 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ba209d10-d0c0-4c6d-b74d-56e5a59c6595 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:02.930855 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ba209d10-d0c0-4c6d-b74d-56e5a59c6595 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d" status: 200 len: 1474 microversion: 2.1 time: 0.259641 Sep 10 11:41:02.943270 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 395/821] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:02 2022] GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d => generated 1474 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:02.950496 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-03ab5a59-a961-4af2-b926-2848fa2aae99 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:02.950496 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-03ab5a59-a961-4af2-b926-2848fa2aae99 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:02.962249 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03ab5a59-a961-4af2-b926-2848fa2aae99 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:02.963078 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03ab5a59-a961-4af2-b926-2848fa2aae99 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:02.963589 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03ab5a59-a961-4af2-b926-2848fa2aae99 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:02.964320 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03ab5a59-a961-4af2-b926-2848fa2aae99 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:02.964852 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03ab5a59-a961-4af2-b926-2848fa2aae99 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:02.965304 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03ab5a59-a961-4af2-b926-2848fa2aae99 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:03.075565 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-03ab5a59-a961-4af2-b926-2848fa2aae99 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lazy-loading 'services' on Instance uuid 89c9187c-06d0-490a-ad42-8c632924689f {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:41:03.110953 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-03ab5a59-a961-4af2-b926-2848fa2aae99 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1929 microversion: 2.75 time: 0.177856 Sep 10 11:41:03.117444 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 396/822] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:02 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1929 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:03.137669 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-46a0c4d4-ffef-4ee4-9829-fa4e5dcd42d1 req-e6528496-bf72-413b-a371-4a548119d785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c806b91-1302-494f-b4eb-a0b7ba04baf4", "name": "network-vif-plugged", "status": "completed", "tag": "3488be85-30de-46d4-a138-f4f55f4c37ce"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:03.155254 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-46a0c4d4-ffef-4ee4-9829-fa4e5dcd42d1 req-e6528496-bf72-413b-a371-4a548119d785 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:03.155748 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-46a0c4d4-ffef-4ee4-9829-fa4e5dcd42d1 req-e6528496-bf72-413b-a371-4a548119d785 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:03.156181 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-46a0c4d4-ffef-4ee4-9829-fa4e5dcd42d1 req-e6528496-bf72-413b-a371-4a548119d785 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:03.190384 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-46a0c4d4-ffef-4ee4-9829-fa4e5dcd42d1 req-e6528496-bf72-413b-a371-4a548119d785 service nova] Creating event network-vif-plugged:3488be85-30de-46d4-a138-f4f55f4c37ce for instance 4c806b91-1302-494f-b4eb-a0b7ba04baf4 on n-h2-856895-1 Sep 10 11:41:03.205321 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-46a0c4d4-ffef-4ee4-9829-fa4e5dcd42d1 req-e6528496-bf72-413b-a371-4a548119d785 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079771 Sep 10 11:41:03.206274 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 397/823] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:41:03.220725 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-014b4922-40e6-4ff8-ad53-863ef3157547 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:03.221450 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-014b4922-40e6-4ff8-ad53-863ef3157547 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: f600488a-7c52-4a96-9375-2723bf42cf83] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:03.232031 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-014b4922-40e6-4ff8-ad53-863ef3157547 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:03.232786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-014b4922-40e6-4ff8-ad53-863ef3157547 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:03.233276 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-014b4922-40e6-4ff8-ad53-863ef3157547 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:03.233994 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-014b4922-40e6-4ff8-ad53-863ef3157547 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:03.234455 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-014b4922-40e6-4ff8-ad53-863ef3157547 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:03.234885 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-014b4922-40e6-4ff8-ad53-863ef3157547 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:03.546686 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-014b4922-40e6-4ff8-ad53-863ef3157547 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:03.564710 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-014b4922-40e6-4ff8-ad53-863ef3157547 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:03.567817 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-014b4922-40e6-4ff8-ad53-863ef3157547 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:03.569801 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-014b4922-40e6-4ff8-ad53-863ef3157547 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83" status: 200 len: 1564 microversion: 2.25 time: 0.362412 Sep 10 11:41:03.571345 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 398/824] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:03 2022] GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83 => generated 1564 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:03.693710 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-079cf8ec-bdf0-4537-bb04-833947c530a3 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:03.694685 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-079cf8ec-bdf0-4537-bb04-833947c530a3 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] [instance: 43593b13-c486-4931-92c8-7ec46c27f6f1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:03.704756 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-079cf8ec-bdf0-4537-bb04-833947c530a3 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:03.705587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-079cf8ec-bdf0-4537-bb04-833947c530a3 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:03.713045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-079cf8ec-bdf0-4537-bb04-833947c530a3 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:03.713825 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-079cf8ec-bdf0-4537-bb04-833947c530a3 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:03.714308 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-079cf8ec-bdf0-4537-bb04-833947c530a3 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:03.714761 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-079cf8ec-bdf0-4537-bb04-833947c530a3 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:04.018801 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-079cf8ec-bdf0-4537-bb04-833947c530a3 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d20eac7b074cc9bee7e8ffb769aa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9f89062992414395b683e882194649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:04.038039 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-079cf8ec-bdf0-4537-bb04-833947c530a3 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] 10.222.0.23 "GET /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1" status: 200 len: 1316 microversion: 2.1 time: 0.345566 Sep 10 11:41:04.063801 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 399/825] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:03 2022] GET /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1 => generated 1316 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:04.063801 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9df1e66d-06cd-45a3-b1d5-d3f020c2455e tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:04.063801 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9df1e66d-06cd-45a3-b1d5-d3f020c2455e tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:04.088595 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9df1e66d-06cd-45a3-b1d5-d3f020c2455e tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:04.088595 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9df1e66d-06cd-45a3-b1d5-d3f020c2455e tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:04.088595 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9df1e66d-06cd-45a3-b1d5-d3f020c2455e tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:04.088595 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9df1e66d-06cd-45a3-b1d5-d3f020c2455e tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:04.088962 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9df1e66d-06cd-45a3-b1d5-d3f020c2455e tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:04.088962 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9df1e66d-06cd-45a3-b1d5-d3f020c2455e tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:04.088962 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:41:04.150361 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9df1e66d-06cd-45a3-b1d5-d3f020c2455e tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:41:04.316547 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9df1e66d-06cd-45a3-b1d5-d3f020c2455e tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7" status: 204 len: 0 microversion: 2.1 time: 0.259712 Sep 10 11:41:04.329091 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 400/826] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:41:04 2022] DELETE /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:41:04.343245 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2c189e3e-45f6-41ed-ba49-6a0ad5e77736 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:04.343970 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2c189e3e-45f6-41ed-ba49-6a0ad5e77736 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: 3bb65ae3-44e9-4803-b00c-132423b2fd8d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:04.360718 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c189e3e-45f6-41ed-ba49-6a0ad5e77736 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:04.361595 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c189e3e-45f6-41ed-ba49-6a0ad5e77736 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:04.362142 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c189e3e-45f6-41ed-ba49-6a0ad5e77736 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:04.365320 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c189e3e-45f6-41ed-ba49-6a0ad5e77736 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:04.365803 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c189e3e-45f6-41ed-ba49-6a0ad5e77736 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:04.366731 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c189e3e-45f6-41ed-ba49-6a0ad5e77736 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:04.487258 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=8 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:41:04.658342 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2c189e3e-45f6-41ed-ba49-6a0ad5e77736 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:04.675020 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2c189e3e-45f6-41ed-ba49-6a0ad5e77736 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d" status: 200 len: 1474 microversion: 2.1 time: 0.344373 Sep 10 11:41:04.676030 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 401/827] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:04 2022] GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d => generated 1474 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:04.689825 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-234b3f19-3494-4b7e-99bd-3b88d52336ce tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:04.690514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-234b3f19-3494-4b7e-99bd-3b88d52336ce tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:04.702922 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-234b3f19-3494-4b7e-99bd-3b88d52336ce tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:04.703512 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-234b3f19-3494-4b7e-99bd-3b88d52336ce tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:04.703943 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-234b3f19-3494-4b7e-99bd-3b88d52336ce tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:04.704671 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-234b3f19-3494-4b7e-99bd-3b88d52336ce tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:04.705137 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-234b3f19-3494-4b7e-99bd-3b88d52336ce tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:04.705567 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-234b3f19-3494-4b7e-99bd-3b88d52336ce tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:04.847028 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-234b3f19-3494-4b7e-99bd-3b88d52336ce tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lazy-loading 'services' on Instance uuid 89c9187c-06d0-490a-ad42-8c632924689f {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:41:04.899551 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-234b3f19-3494-4b7e-99bd-3b88d52336ce tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1935 microversion: 2.75 time: 0.220695 Sep 10 11:41:04.903518 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 402/828] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:04 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1935 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:04.912268 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ebc681f5-b3c5-4379-8b6e-4d7686162885 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:04.912909 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ebc681f5-b3c5-4379-8b6e-4d7686162885 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:04.933931 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ebc681f5-b3c5-4379-8b6e-4d7686162885 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:04.934435 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ebc681f5-b3c5-4379-8b6e-4d7686162885 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:04.934885 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ebc681f5-b3c5-4379-8b6e-4d7686162885 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:04.939095 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ebc681f5-b3c5-4379-8b6e-4d7686162885 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:04.939639 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ebc681f5-b3c5-4379-8b6e-4d7686162885 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:04.940094 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ebc681f5-b3c5-4379-8b6e-4d7686162885 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:05.216330 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ebc681f5-b3c5-4379-8b6e-4d7686162885 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64e2df030a745de8ae7eda29d2ac30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c44e3e2920e48868e1c05f70b1d7639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:05.227673 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ebc681f5-b3c5-4379-8b6e-4d7686162885 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "GET /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7" status: 200 len: 1711 microversion: 2.1 time: 0.322383 Sep 10 11:41:05.228276 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 403/829] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:04 2022] GET /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 => generated 1711 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:05.267777 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-01fe3e43-dc60-4cce-b271-ac7cc5161feb tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:05.268524 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-01fe3e43-dc60-4cce-b271-ac7cc5161feb tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: f600488a-7c52-4a96-9375-2723bf42cf83] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:05.293008 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-01fe3e43-dc60-4cce-b271-ac7cc5161feb tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:05.293510 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-01fe3e43-dc60-4cce-b271-ac7cc5161feb tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:05.293948 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-01fe3e43-dc60-4cce-b271-ac7cc5161feb tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:05.295376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-01fe3e43-dc60-4cce-b271-ac7cc5161feb tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:05.295893 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-01fe3e43-dc60-4cce-b271-ac7cc5161feb tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:05.296320 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-01fe3e43-dc60-4cce-b271-ac7cc5161feb tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:05.635384 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-01fe3e43-dc60-4cce-b271-ac7cc5161feb tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:05.650825 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-01fe3e43-dc60-4cce-b271-ac7cc5161feb tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:05.656195 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-01fe3e43-dc60-4cce-b271-ac7cc5161feb tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:05.660038 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-01fe3e43-dc60-4cce-b271-ac7cc5161feb tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83" status: 200 len: 1564 microversion: 2.25 time: 0.411153 Sep 10 11:41:05.673241 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 404/830] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:05 2022] GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83 => generated 1564 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:05.690589 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-427c5217-daae-47c9-b41b-381916e96383 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:05.695305 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-427c5217-daae-47c9-b41b-381916e96383 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] [instance: 43593b13-c486-4931-92c8-7ec46c27f6f1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:05.707839 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-427c5217-daae-47c9-b41b-381916e96383 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:05.711935 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-427c5217-daae-47c9-b41b-381916e96383 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:05.713302 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-427c5217-daae-47c9-b41b-381916e96383 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:05.716045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-427c5217-daae-47c9-b41b-381916e96383 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:05.718571 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-427c5217-daae-47c9-b41b-381916e96383 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:05.719128 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-427c5217-daae-47c9-b41b-381916e96383 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:05.936656 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-427c5217-daae-47c9-b41b-381916e96383 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d20eac7b074cc9bee7e8ffb769aa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9f89062992414395b683e882194649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:05.962268 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-427c5217-daae-47c9-b41b-381916e96383 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] 10.222.0.23 "GET /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1" status: 200 len: 1316 microversion: 2.1 time: 0.287651 Sep 10 11:41:05.975602 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 405/831] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:05 2022] GET /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1 => generated 1316 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:05.975602 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5af7c54d-088b-46f8-8606-7a860a37f68b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:05.975602 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5af7c54d-088b-46f8-8606-7a860a37f68b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: 3bb65ae3-44e9-4803-b00c-132423b2fd8d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:05.983995 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5af7c54d-088b-46f8-8606-7a860a37f68b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:05.984785 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5af7c54d-088b-46f8-8606-7a860a37f68b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:05.985432 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5af7c54d-088b-46f8-8606-7a860a37f68b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:05.986152 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5af7c54d-088b-46f8-8606-7a860a37f68b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:05.986617 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5af7c54d-088b-46f8-8606-7a860a37f68b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:05.987044 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5af7c54d-088b-46f8-8606-7a860a37f68b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:06.176104 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5af7c54d-088b-46f8-8606-7a860a37f68b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:06.189984 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5af7c54d-088b-46f8-8606-7a860a37f68b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d" status: 200 len: 1474 microversion: 2.1 time: 0.225367 Sep 10 11:41:06.194453 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 406/832] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:05 2022] GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d => generated 1474 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:06.200531 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3e092f18-a780-43ad-9104-750d260c7585 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:06.201956 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3e092f18-a780-43ad-9104-750d260c7585 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:06.218532 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e092f18-a780-43ad-9104-750d260c7585 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:06.219126 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e092f18-a780-43ad-9104-750d260c7585 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:06.219732 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e092f18-a780-43ad-9104-750d260c7585 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:06.221022 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e092f18-a780-43ad-9104-750d260c7585 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:06.221572 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e092f18-a780-43ad-9104-750d260c7585 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:06.222090 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e092f18-a780-43ad-9104-750d260c7585 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:06.251902 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:41:06.330180 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-3e092f18-a780-43ad-9104-750d260c7585 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lazy-loading 'services' on Instance uuid 89c9187c-06d0-490a-ad42-8c632924689f {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:41:06.358044 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3e092f18-a780-43ad-9104-750d260c7585 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1935 microversion: 2.75 time: 0.162015 Sep 10 11:41:06.359233 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 407/833] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:06 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1935 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:06.389096 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bb47bca2-1bcf-47bf-ba58-4d2559db77c7 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:06.389911 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bb47bca2-1bcf-47bf-ba58-4d2559db77c7 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:06.396518 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bb47bca2-1bcf-47bf-ba58-4d2559db77c7 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:06.397158 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bb47bca2-1bcf-47bf-ba58-4d2559db77c7 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:06.398744 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bb47bca2-1bcf-47bf-ba58-4d2559db77c7 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:06.399569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bb47bca2-1bcf-47bf-ba58-4d2559db77c7 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:06.400142 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bb47bca2-1bcf-47bf-ba58-4d2559db77c7 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:06.400681 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bb47bca2-1bcf-47bf-ba58-4d2559db77c7 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:06.577957 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bb47bca2-1bcf-47bf-ba58-4d2559db77c7 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64e2df030a745de8ae7eda29d2ac30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c44e3e2920e48868e1c05f70b1d7639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:06.588499 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bb47bca2-1bcf-47bf-ba58-4d2559db77c7 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "GET /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7" status: 200 len: 1711 microversion: 2.1 time: 0.210054 Sep 10 11:41:06.605173 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 408/834] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:06 2022] GET /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 => generated 1711 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:06.692833 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ebcaa588-bd61-4e9d-9e19-f738b913710b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:06.693580 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ebcaa588-bd61-4e9d-9e19-f738b913710b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: f600488a-7c52-4a96-9375-2723bf42cf83] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:06.718092 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ebcaa588-bd61-4e9d-9e19-f738b913710b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:06.721581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ebcaa588-bd61-4e9d-9e19-f738b913710b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:06.722122 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ebcaa588-bd61-4e9d-9e19-f738b913710b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:06.722923 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ebcaa588-bd61-4e9d-9e19-f738b913710b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:06.723514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ebcaa588-bd61-4e9d-9e19-f738b913710b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:06.725204 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ebcaa588-bd61-4e9d-9e19-f738b913710b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:07.052684 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ebcaa588-bd61-4e9d-9e19-f738b913710b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:07.067904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ebcaa588-bd61-4e9d-9e19-f738b913710b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:07.069596 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ebcaa588-bd61-4e9d-9e19-f738b913710b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:07.082007 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ebcaa588-bd61-4e9d-9e19-f738b913710b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83" status: 200 len: 1564 microversion: 2.25 time: 0.393808 Sep 10 11:41:07.095677 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 409/835] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:06 2022] GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83 => generated 1564 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:07.106669 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-94f66b2d-9380-4869-a66b-0b6194ae149a tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:07.108482 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-94f66b2d-9380-4869-a66b-0b6194ae149a tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] [instance: 43593b13-c486-4931-92c8-7ec46c27f6f1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:07.151124 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94f66b2d-9380-4869-a66b-0b6194ae149a tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:07.152318 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94f66b2d-9380-4869-a66b-0b6194ae149a tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:07.152644 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94f66b2d-9380-4869-a66b-0b6194ae149a tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:07.153381 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94f66b2d-9380-4869-a66b-0b6194ae149a tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:07.153848 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94f66b2d-9380-4869-a66b-0b6194ae149a tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:07.154345 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94f66b2d-9380-4869-a66b-0b6194ae149a tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:07.210354 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:41:07.402653 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-94f66b2d-9380-4869-a66b-0b6194ae149a tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d20eac7b074cc9bee7e8ffb769aa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9f89062992414395b683e882194649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:07.415929 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-94f66b2d-9380-4869-a66b-0b6194ae149a tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] 10.222.0.23 "GET /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1" status: 200 len: 1316 microversion: 2.1 time: 0.318651 Sep 10 11:41:07.428620 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 410/836] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:07 2022] GET /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1 => generated 1316 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:07.449111 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-01f550fa-d71a-4f1d-ac54-92f3e6ab6cb2 req-4bfb3fdf-28de-49da-a176-dc99fd736597 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43593b13-c486-4931-92c8-7ec46c27f6f1", "name": "network-vif-plugged", "status": "completed", "tag": "bf9bc2c7-0d4f-4718-afea-ea1a5bf9ee42"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:07.461279 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-01f550fa-d71a-4f1d-ac54-92f3e6ab6cb2 req-4bfb3fdf-28de-49da-a176-dc99fd736597 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:07.461937 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-01f550fa-d71a-4f1d-ac54-92f3e6ab6cb2 req-4bfb3fdf-28de-49da-a176-dc99fd736597 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:07.462546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-01f550fa-d71a-4f1d-ac54-92f3e6ab6cb2 req-4bfb3fdf-28de-49da-a176-dc99fd736597 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:07.476538 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-01f550fa-d71a-4f1d-ac54-92f3e6ab6cb2 req-4bfb3fdf-28de-49da-a176-dc99fd736597 service nova] Creating event network-vif-plugged:bf9bc2c7-0d4f-4718-afea-ea1a5bf9ee42 for instance 43593b13-c486-4931-92c8-7ec46c27f6f1 on n-h2-856895-1 Sep 10 11:41:07.485015 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-01f550fa-d71a-4f1d-ac54-92f3e6ab6cb2 req-4bfb3fdf-28de-49da-a176-dc99fd736597 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053204 Sep 10 11:41:07.486043 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 411/837] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:41:07.493070 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-99fa8341-ca03-4bee-8416-a015871809ee tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:07.503010 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-99fa8341-ca03-4bee-8416-a015871809ee tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: 3bb65ae3-44e9-4803-b00c-132423b2fd8d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:07.526773 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99fa8341-ca03-4bee-8416-a015871809ee tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:07.528230 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99fa8341-ca03-4bee-8416-a015871809ee tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:07.528698 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99fa8341-ca03-4bee-8416-a015871809ee tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:07.529972 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99fa8341-ca03-4bee-8416-a015871809ee tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:07.543008 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99fa8341-ca03-4bee-8416-a015871809ee tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:07.543618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99fa8341-ca03-4bee-8416-a015871809ee tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:07.856416 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-99fa8341-ca03-4bee-8416-a015871809ee tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:07.877924 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-99fa8341-ca03-4bee-8416-a015871809ee tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d" status: 200 len: 1457 microversion: 2.1 time: 0.390620 Sep 10 11:41:07.882591 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 412/838] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:07 2022] GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d => generated 1457 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:07.901389 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1bef4345-d461-4d18-9686-2d86cc5f9748 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:07.907878 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1bef4345-d461-4d18-9686-2d86cc5f9748 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:07.929144 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1bef4345-d461-4d18-9686-2d86cc5f9748 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:07.930701 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1bef4345-d461-4d18-9686-2d86cc5f9748 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:07.934582 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1bef4345-d461-4d18-9686-2d86cc5f9748 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:07.936142 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1bef4345-d461-4d18-9686-2d86cc5f9748 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:07.936930 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1bef4345-d461-4d18-9686-2d86cc5f9748 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:07.937691 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1bef4345-d461-4d18-9686-2d86cc5f9748 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:08.131490 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-1bef4345-d461-4d18-9686-2d86cc5f9748 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lazy-loading 'services' on Instance uuid 89c9187c-06d0-490a-ad42-8c632924689f {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:41:08.158810 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1bef4345-d461-4d18-9686-2d86cc5f9748 tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1935 microversion: 2.75 time: 0.273107 Sep 10 11:41:08.188907 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 413/839] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:07 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1935 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:08.195623 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2029b39b-8f74-4153-8c5a-45fb6804940d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:08.196652 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2029b39b-8f74-4153-8c5a-45fb6804940d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:08.205992 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2029b39b-8f74-4153-8c5a-45fb6804940d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:08.206788 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2029b39b-8f74-4153-8c5a-45fb6804940d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:08.207365 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2029b39b-8f74-4153-8c5a-45fb6804940d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:08.208183 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2029b39b-8f74-4153-8c5a-45fb6804940d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:08.209007 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2029b39b-8f74-4153-8c5a-45fb6804940d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:08.209752 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2029b39b-8f74-4153-8c5a-45fb6804940d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:08.471436 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2029b39b-8f74-4153-8c5a-45fb6804940d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64e2df030a745de8ae7eda29d2ac30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c44e3e2920e48868e1c05f70b1d7639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:08.485929 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2029b39b-8f74-4153-8c5a-45fb6804940d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "GET /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7" status: 200 len: 1711 microversion: 2.1 time: 0.295469 Sep 10 11:41:08.486915 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 414/840] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:08 2022] GET /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 => generated 1711 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:08.509378 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-801bbab6-b678-49fd-abc6-9507d701d55d tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:08.510534 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-801bbab6-b678-49fd-abc6-9507d701d55d tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] [instance: 3bb65ae3-44e9-4803-b00c-132423b2fd8d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:08.517040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-801bbab6-b678-49fd-abc6-9507d701d55d tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:08.517881 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-801bbab6-b678-49fd-abc6-9507d701d55d tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:08.518568 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-801bbab6-b678-49fd-abc6-9507d701d55d tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:08.519527 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-801bbab6-b678-49fd-abc6-9507d701d55d tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:08.520358 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-801bbab6-b678-49fd-abc6-9507d701d55d tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:08.521009 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-801bbab6-b678-49fd-abc6-9507d701d55d tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:08.937749 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-801bbab6-b678-49fd-abc6-9507d701d55d tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d" status: 200 len: 1608 microversion: 2.1 time: 0.434652 Sep 10 11:41:08.939719 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 415/841] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:08 2022] GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d => generated 1608 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:08.950512 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-14fa3403-d0c9-4715-845c-5bb255ad828b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:08.953021 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-14fa3403-d0c9-4715-845c-5bb255ad828b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: f600488a-7c52-4a96-9375-2723bf42cf83] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:08.965718 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-14fa3403-d0c9-4715-845c-5bb255ad828b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:08.966215 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-14fa3403-d0c9-4715-845c-5bb255ad828b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:08.967440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-14fa3403-d0c9-4715-845c-5bb255ad828b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:08.968155 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-14fa3403-d0c9-4715-845c-5bb255ad828b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:08.971739 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-14fa3403-d0c9-4715-845c-5bb255ad828b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:08.972203 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-14fa3403-d0c9-4715-845c-5bb255ad828b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:09.220824 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-14fa3403-d0c9-4715-845c-5bb255ad828b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:09.233962 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-14fa3403-d0c9-4715-845c-5bb255ad828b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:09.240140 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-14fa3403-d0c9-4715-845c-5bb255ad828b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:09.241733 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-14fa3403-d0c9-4715-845c-5bb255ad828b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83" status: 200 len: 1564 microversion: 2.25 time: 0.301172 Sep 10 11:41:09.242511 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 416/842] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:08 2022] GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83 => generated 1564 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:09.250745 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-83cc5ed6-5c23-4163-980a-d1e1d2eef3a7 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:09.261028 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-83cc5ed6-5c23-4163-980a-d1e1d2eef3a7 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] [instance: 43593b13-c486-4931-92c8-7ec46c27f6f1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:09.269794 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-83cc5ed6-5c23-4163-980a-d1e1d2eef3a7 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:09.270300 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-83cc5ed6-5c23-4163-980a-d1e1d2eef3a7 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:09.270743 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-83cc5ed6-5c23-4163-980a-d1e1d2eef3a7 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:09.271918 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-83cc5ed6-5c23-4163-980a-d1e1d2eef3a7 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:09.271918 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-83cc5ed6-5c23-4163-980a-d1e1d2eef3a7 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:09.272365 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-83cc5ed6-5c23-4163-980a-d1e1d2eef3a7 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:09.571025 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-83cc5ed6-5c23-4163-980a-d1e1d2eef3a7 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d20eac7b074cc9bee7e8ffb769aa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9f89062992414395b683e882194649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:09.583055 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-83cc5ed6-5c23-4163-980a-d1e1d2eef3a7 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] 10.222.0.23 "GET /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1" status: 200 len: 1316 microversion: 2.1 time: 0.339028 Sep 10 11:41:09.590146 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 417/843] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:09 2022] GET /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1 => generated 1316 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:09.610455 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-a5e53f00-cabc-4ce9-956e-fe3e663a26f3 req-309242b5-8b1e-4cab-944a-7da751b22482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f600488a-7c52-4a96-9375-2723bf42cf83", "name": "network-vif-unplugged", "status": "completed", "tag": "b17980fa-cb4b-4dcc-8ee5-cbb901783cfd"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:09.632254 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a5e53f00-cabc-4ce9-956e-fe3e663a26f3 req-309242b5-8b1e-4cab-944a-7da751b22482 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:09.632774 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a5e53f00-cabc-4ce9-956e-fe3e663a26f3 req-309242b5-8b1e-4cab-944a-7da751b22482 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:09.633272 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a5e53f00-cabc-4ce9-956e-fe3e663a26f3 req-309242b5-8b1e-4cab-944a-7da751b22482 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:09.659030 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-a5e53f00-cabc-4ce9-956e-fe3e663a26f3 req-309242b5-8b1e-4cab-944a-7da751b22482 service nova] Creating event network-vif-unplugged:b17980fa-cb4b-4dcc-8ee5-cbb901783cfd for instance f600488a-7c52-4a96-9375-2723bf42cf83 on n-h2-856895-1 Sep 10 11:41:09.668524 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-a5e53f00-cabc-4ce9-956e-fe3e663a26f3 req-309242b5-8b1e-4cab-944a-7da751b22482 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077022 Sep 10 11:41:09.669298 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 418/844] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:41:09.678744 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-31597192-74f7-41ae-9601-ac51be705596 tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:09.682452 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-31597192-74f7-41ae-9601-ac51be705596 tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:09.682947 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-31597192-74f7-41ae-9601-ac51be705596 tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:09.691779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-31597192-74f7-41ae-9601-ac51be705596 tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:09.692632 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-31597192-74f7-41ae-9601-ac51be705596 tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:09.693115 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-31597192-74f7-41ae-9601-ac51be705596 tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:09.699566 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-31597192-74f7-41ae-9601-ac51be705596 tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:09.754469 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-31597192-74f7-41ae-9601-ac51be705596 tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.080376 Sep 10 11:41:09.756504 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 419/845] 10.222.0.23 () {58 vars in 1176 bytes} [Sat Sep 10 11:41:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:41:09.771426 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-25a1b7f0-ab11-4ae2-adc4-2282e881c2bc tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:09.780971 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-25a1b7f0-ab11-4ae2-adc4-2282e881c2bc tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:09.790523 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25a1b7f0-ab11-4ae2-adc4-2282e881c2bc tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:09.791026 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25a1b7f0-ab11-4ae2-adc4-2282e881c2bc tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:09.796716 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25a1b7f0-ab11-4ae2-adc4-2282e881c2bc tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:09.797478 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25a1b7f0-ab11-4ae2-adc4-2282e881c2bc tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:09.797954 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25a1b7f0-ab11-4ae2-adc4-2282e881c2bc tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:09.798393 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25a1b7f0-ab11-4ae2-adc4-2282e881c2bc tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:09.979551 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-25a1b7f0-ab11-4ae2-adc4-2282e881c2bc tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] Lazy-loading 'services' on Instance uuid 89c9187c-06d0-490a-ad42-8c632924689f {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:41:10.040961 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-25a1b7f0-ab11-4ae2-adc4-2282e881c2bc tempest-ServersAdmin275Test-700369848 tempest-ServersAdmin275Test-700369848-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1920 microversion: 2.75 time: 0.274039 Sep 10 11:41:10.041680 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 420/846] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:09 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1920 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:10.066062 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c221eed3-3e44-4a59-a131-9f5c334bf7f6 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:10.066697 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c221eed3-3e44-4a59-a131-9f5c334bf7f6 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:10.082816 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c221eed3-3e44-4a59-a131-9f5c334bf7f6 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:10.086742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c221eed3-3e44-4a59-a131-9f5c334bf7f6 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:10.087289 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c221eed3-3e44-4a59-a131-9f5c334bf7f6 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:10.088963 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c221eed3-3e44-4a59-a131-9f5c334bf7f6 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:10.089436 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c221eed3-3e44-4a59-a131-9f5c334bf7f6 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:10.089873 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c221eed3-3e44-4a59-a131-9f5c334bf7f6 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:10.417266 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c221eed3-3e44-4a59-a131-9f5c334bf7f6 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64e2df030a745de8ae7eda29d2ac30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c44e3e2920e48868e1c05f70b1d7639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:10.443860 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c221eed3-3e44-4a59-a131-9f5c334bf7f6 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "GET /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7" status: 200 len: 1711 microversion: 2.1 time: 0.401096 Sep 10 11:41:10.455191 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 421/847] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:10 2022] GET /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 => generated 1711 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:10.455191 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-21424bb9-0600-42b7-a2d3-cb9f196b6777 tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-856895-1", "block_migration": true, "disk_over_commit": false}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:10.455191 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-21424bb9-0600-42b7-a2d3-cb9f196b6777 tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] [instance: 3bb65ae3-44e9-4803-b00c-132423b2fd8d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:10.477124 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-21424bb9-0600-42b7-a2d3-cb9f196b6777 tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:10.479218 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-21424bb9-0600-42b7-a2d3-cb9f196b6777 tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:10.479899 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-21424bb9-0600-42b7-a2d3-cb9f196b6777 tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:10.480669 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-21424bb9-0600-42b7-a2d3-cb9f196b6777 tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:10.484296 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-21424bb9-0600-42b7-a2d3-cb9f196b6777 tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:10.484905 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-21424bb9-0600-42b7-a2d3-cb9f196b6777 tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:10.538441 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-21424bb9-0600-42b7-a2d3-cb9f196b6777 tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] Lazy-loading 'flavor' on Instance uuid 3bb65ae3-44e9-4803-b00c-132423b2fd8d {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:41:10.560781 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-21424bb9-0600-42b7-a2d3-cb9f196b6777 tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 3bb65ae3-44e9-4803-b00c-132423b2fd8d while it is in vm_state suspended Sep 10 11:41:10.562679 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-21424bb9-0600-42b7-a2d3-cb9f196b6777 tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] Request method failure captured: Sep 10 11:41:10.562679 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d/action HTTP/1.1 Sep 10 11:41:10.562679 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:41:10.562679 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:41:10.562679 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:41:10.562679 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 97 Sep 10 11:41:10.562679 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:41:10.562679 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:41:10.562679 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:41:10.562679 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:41:10.562679 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHeTjFaCblyZgvOKMuwHu5midDQtzDm8ZkmozIv9002vcuNd9RVVDBf4pjC_EQTcfdTCv0A8GAV87GoKgb2LZBlzNg7fyTeBwOs7t755oLWW_D5lmud1aXff7kCSmqPPhQ19wepdTn01U9Ey9DstktpOsry2_GLX_OnyIYVUAL1--Ik Sep 10 11:41:10.562679 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:41:10.562679 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:41:10.562679 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:41:10.562679 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:41:10.562679 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:41:10.562679 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:41:10.562679 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 2ecc9e2891fd47e1b86688b138756e4f Sep 10 11:41:10.562679 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-LiveMigrationNegativeTest-1341960967 Sep 10 11:41:10.562679 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,admin,member Sep 10 11:41:10.562679 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,admin,member Sep 10 11:41:10.564427 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2ecc9e2891fd47e1b86688b138756e4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2ecc9e2891fd47e1b86688b138756e4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2ecc9e2891fd47e1b86688b138756e4f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2ecc9e2891fd47e1b86688b138756e4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:41:10.564427 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-LiveMigrationNegativeTest-1341960967 Sep 10 11:41:10.564427 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 2ecc9e2891fd47e1b86688b138756e4f Sep 10 11:41:10.564427 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1341960967 Sep 10 11:41:10.564427 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-LiveMigrationNegativeTest-1341960967-project-admin Sep 10 11:41:10.564427 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:41:10.564427 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:41:10.564427 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 9b4fc7a6b7be487badd3f4d7c51e608c Sep 10 11:41:10.564427 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-LiveMigrationNegativeTest-1341960967-project-admin Sep 10 11:41:10.564427 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:41:10.564427 n-d-856895-1 devstack@n-api.service[128777]: {"os-migrateLive": {"host": "n-h2-856895-1", "block_migration": true, "disk_over_commit": false}} Sep 10 11:41:10.564427 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:41:10.565459 n-d-856895-1 devstack@n-api.service[128777]: exception: Cannot 'os-migrateLive' instance 3bb65ae3-44e9-4803-b00c-132423b2fd8d while it is in vm_state suspended Sep 10 11:41:10.565459 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '3bb65ae3-44e9-4803-b00c-132423b2fd8d', 'body': {'os-migrateLive': {'host': 'n-h2-856895-1', 'block_migration': True, 'disk_over_commit': False}}} Sep 10 11:41:10.565459 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:41:10.565459 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:10.565459 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 10 11:41:10.565459 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 10 11:41:10.565459 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 10 11:41:10.565459 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 11:41:10.565459 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 10 11:41:10.565459 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 11:41:10.565459 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 10 11:41:10.565459 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 11:41:10.565459 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 10 11:41:10.565459 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 11:41:10.565459 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 10 11:41:10.565459 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 11:41:10.565459 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 10 11:41:10.565459 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 11:41:10.571972 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 11:41:10.571972 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 11:41:10.571972 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 11:41:10.571972 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 11:41:10.571972 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3bb65ae3-44e9-4803-b00c-132423b2fd8d in vm_state suspended. Cannot live_migrate while the instance is in this state. Sep 10 11:41:10.571972 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:10.571972 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:10.571972 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:10.571972 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:10.571972 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:10.571972 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:10.571972 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:41:10.571972 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:41:10.571972 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:41:10.571972 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:41:10.571972 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:41:10.571972 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:41:10.571972 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:41:10.571972 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:41:10.571972 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:41:10.574805 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:41:10.574805 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 10 11:41:10.574805 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Sep 10 11:41:10.574805 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 10 11:41:10.574805 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 11:41:10.574805 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 11:41:10.574805 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 3bb65ae3-44e9-4803-b00c-132423b2fd8d while it is in vm_state suspended Sep 10 11:41:10.574805 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:10.574805 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:10.574805 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:10.574805 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:10.574805 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:10.574805 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:10.574805 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:41:10.574805 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:41:10.574805 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 3bb65ae3-44e9-4803-b00c-132423b2fd8d while it is in vm_state suspended Sep 10 11:41:10.574805 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:10.577176 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-21424bb9-0600-42b7-a2d3-cb9f196b6777 tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 3bb65ae3-44e9-4803-b00c-132423b2fd8d while it is in vm_state suspended {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:41:10.577176 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-21424bb9-0600-42b7-a2d3-cb9f196b6777 tempest-LiveMigrationNegativeTest-1341960967 tempest-LiveMigrationNegativeTest-1341960967-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d/action" status: 409 len: 155 microversion: 2.1 time: 0.120734 Sep 10 11:41:10.577176 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 422/848] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:41:10 2022] POST /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d/action => generated 155 bytes in 122 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:41:10.577176 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7344374f-a50e-490f-8170-61603d0724ab tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:10.577176 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7344374f-a50e-490f-8170-61603d0724ab tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:10.600431 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:41:10.601939 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7344374f-a50e-490f-8170-61603d0724ab tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:10.602515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7344374f-a50e-490f-8170-61603d0724ab tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:10.602925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7344374f-a50e-490f-8170-61603d0724ab tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:10.603743 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7344374f-a50e-490f-8170-61603d0724ab tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:10.604207 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7344374f-a50e-490f-8170-61603d0724ab tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:10.604642 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7344374f-a50e-490f-8170-61603d0724ab tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:10.674311 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7344374f-a50e-490f-8170-61603d0724ab tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:41:10.787253 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:41:10.853060 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7344374f-a50e-490f-8170-61603d0724ab tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] 10.222.0.23 "DELETE /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 204 len: 0 microversion: 2.75 time: 0.283838 Sep 10 11:41:10.853662 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 423/849] 10.222.0.23 () {60 vars in 1280 bytes} [Sat Sep 10 11:41:10 2022] DELETE /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 11:41:10.864188 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-287d370d-8cb7-4da4-adb4-2e1b37643386 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:10.865198 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-287d370d-8cb7-4da4-adb4-2e1b37643386 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: f600488a-7c52-4a96-9375-2723bf42cf83] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:10.875723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-287d370d-8cb7-4da4-adb4-2e1b37643386 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:10.875723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-287d370d-8cb7-4da4-adb4-2e1b37643386 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:10.876077 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-287d370d-8cb7-4da4-adb4-2e1b37643386 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:10.877304 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-287d370d-8cb7-4da4-adb4-2e1b37643386 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:10.877921 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-287d370d-8cb7-4da4-adb4-2e1b37643386 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:10.878515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-287d370d-8cb7-4da4-adb4-2e1b37643386 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:11.047980 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-287d370d-8cb7-4da4-adb4-2e1b37643386 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:11.058199 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-287d370d-8cb7-4da4-adb4-2e1b37643386 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:11.060022 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-287d370d-8cb7-4da4-adb4-2e1b37643386 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:11.061372 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-287d370d-8cb7-4da4-adb4-2e1b37643386 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83" status: 200 len: 1564 microversion: 2.25 time: 0.202387 Sep 10 11:41:11.061961 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 424/850] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:10 2022] GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83 => generated 1564 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:11.066931 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6499b95d-2be5-4c27-b093-e1d94cb18c0c tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:11.067532 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6499b95d-2be5-4c27-b093-e1d94cb18c0c tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: 3bb65ae3-44e9-4803-b00c-132423b2fd8d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:11.088360 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6499b95d-2be5-4c27-b093-e1d94cb18c0c tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:11.089217 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6499b95d-2be5-4c27-b093-e1d94cb18c0c tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:11.089856 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6499b95d-2be5-4c27-b093-e1d94cb18c0c tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:11.090790 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6499b95d-2be5-4c27-b093-e1d94cb18c0c tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:11.091578 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6499b95d-2be5-4c27-b093-e1d94cb18c0c tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:11.092179 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6499b95d-2be5-4c27-b093-e1d94cb18c0c tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:11.169675 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6499b95d-2be5-4c27-b093-e1d94cb18c0c tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: 3bb65ae3-44e9-4803-b00c-132423b2fd8d] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:41:11.324540 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6499b95d-2be5-4c27-b093-e1d94cb18c0c tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d" status: 204 len: 0 microversion: 2.1 time: 0.261164 Sep 10 11:41:11.329486 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 425/851] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:41:11 2022] DELETE /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:41:11.336618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a5500370-01fd-425f-b762-6ad36abc35d6 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:11.337575 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a5500370-01fd-425f-b762-6ad36abc35d6 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] [instance: 43593b13-c486-4931-92c8-7ec46c27f6f1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:11.345384 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5500370-01fd-425f-b762-6ad36abc35d6 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:11.346134 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5500370-01fd-425f-b762-6ad36abc35d6 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:11.346780 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5500370-01fd-425f-b762-6ad36abc35d6 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:11.347670 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5500370-01fd-425f-b762-6ad36abc35d6 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:11.348282 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5500370-01fd-425f-b762-6ad36abc35d6 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:11.348876 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5500370-01fd-425f-b762-6ad36abc35d6 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:11.674470 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a5500370-01fd-425f-b762-6ad36abc35d6 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d20eac7b074cc9bee7e8ffb769aa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9f89062992414395b683e882194649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:11.684088 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a5500370-01fd-425f-b762-6ad36abc35d6 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] 10.222.0.23 "GET /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1" status: 200 len: 1505 microversion: 2.1 time: 0.352289 Sep 10 11:41:11.684088 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 426/852] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:11 2022] GET /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1 => generated 1505 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:11.712827 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0e296e61-5d2e-4556-880b-fa80be7ad11a tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:11.713602 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0e296e61-5d2e-4556-880b-fa80be7ad11a tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:11.720510 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e296e61-5d2e-4556-880b-fa80be7ad11a tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:11.721288 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e296e61-5d2e-4556-880b-fa80be7ad11a tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:11.721828 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e296e61-5d2e-4556-880b-fa80be7ad11a tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:11.722636 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e296e61-5d2e-4556-880b-fa80be7ad11a tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:11.723258 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e296e61-5d2e-4556-880b-fa80be7ad11a tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:11.723808 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e296e61-5d2e-4556-880b-fa80be7ad11a tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:11.813312 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0e296e61-5d2e-4556-880b-fa80be7ad11a tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:11.828880 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0e296e61-5d2e-4556-880b-fa80be7ad11a tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:11.830458 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0e296e61-5d2e-4556-880b-fa80be7ad11a tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:11.836760 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0e296e61-5d2e-4556-880b-fa80be7ad11a tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1444 microversion: 2.75 time: 0.135346 Sep 10 11:41:11.837786 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 427/853] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:11 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1444 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:11.848448 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c1db2668-5d64-4b9b-af86-0e29735e6306 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:11.850175 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c1db2668-5d64-4b9b-af86-0e29735e6306 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: 3bb65ae3-44e9-4803-b00c-132423b2fd8d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:11.855626 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1db2668-5d64-4b9b-af86-0e29735e6306 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:11.856250 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1db2668-5d64-4b9b-af86-0e29735e6306 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:11.856828 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1db2668-5d64-4b9b-af86-0e29735e6306 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:11.857654 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1db2668-5d64-4b9b-af86-0e29735e6306 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:11.858852 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1db2668-5d64-4b9b-af86-0e29735e6306 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:11.859421 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1db2668-5d64-4b9b-af86-0e29735e6306 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:11.917097 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:41:12.061275 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c1db2668-5d64-4b9b-af86-0e29735e6306 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:12.072020 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c1db2668-5d64-4b9b-af86-0e29735e6306 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d" status: 200 len: 1463 microversion: 2.1 time: 0.232686 Sep 10 11:41:12.073368 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 428/854] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:11 2022] GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d => generated 1463 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:12.079412 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6673da36-f534-4761-8c50-0deff55b3f47 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:12.082874 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6673da36-f534-4761-8c50-0deff55b3f47 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:12.089848 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6673da36-f534-4761-8c50-0deff55b3f47 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:12.090471 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6673da36-f534-4761-8c50-0deff55b3f47 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:12.091131 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6673da36-f534-4761-8c50-0deff55b3f47 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:12.092990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6673da36-f534-4761-8c50-0deff55b3f47 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:12.093916 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6673da36-f534-4761-8c50-0deff55b3f47 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:12.094449 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6673da36-f534-4761-8c50-0deff55b3f47 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:12.176986 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6673da36-f534-4761-8c50-0deff55b3f47 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64e2df030a745de8ae7eda29d2ac30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c44e3e2920e48868e1c05f70b1d7639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:12.190618 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6673da36-f534-4761-8c50-0deff55b3f47 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "GET /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7" status: 200 len: 1643 microversion: 2.1 time: 0.116005 Sep 10 11:41:12.206934 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:41:12.209438 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 429/855] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:12 2022] GET /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 => generated 1643 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:12.214313 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-00cfb907-5dfc-418c-9877-13dada744876 req-133395b6-39ea-42cd-b113-658667758211 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f600488a-7c52-4a96-9375-2723bf42cf83", "tag": "b17980fa-cb4b-4dcc-8ee5-cbb901783cfd"}, {"server_uuid": "6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7", "name": "network-vif-deleted", "tag": "5c65da57-0904-4a32-9c5a-d379b5f6e7cf"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:12.235556 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-00cfb907-5dfc-418c-9877-13dada744876 req-133395b6-39ea-42cd-b113-658667758211 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:12.236226 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-00cfb907-5dfc-418c-9877-13dada744876 req-133395b6-39ea-42cd-b113-658667758211 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:12.236767 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-00cfb907-5dfc-418c-9877-13dada744876 req-133395b6-39ea-42cd-b113-658667758211 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:12.253724 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-00cfb907-5dfc-418c-9877-13dada744876 req-133395b6-39ea-42cd-b113-658667758211 service nova] Creating event network-changed:b17980fa-cb4b-4dcc-8ee5-cbb901783cfd for instance f600488a-7c52-4a96-9375-2723bf42cf83 on n-h2-856895-1 Sep 10 11:41:12.254377 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-00cfb907-5dfc-418c-9877-13dada744876 req-133395b6-39ea-42cd-b113-658667758211 service nova] Creating event network-vif-deleted:5c65da57-0904-4a32-9c5a-d379b5f6e7cf for instance 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 on n-h1-856895-1 Sep 10 11:41:12.264296 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-00cfb907-5dfc-418c-9877-13dada744876 req-133395b6-39ea-42cd-b113-658667758211 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.053432 Sep 10 11:41:12.269110 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 430/856] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:41:12.286441 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3039ae3e-1f88-4934-81c5-baa7937cbd06 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:12.289713 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3039ae3e-1f88-4934-81c5-baa7937cbd06 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] [instance: 43593b13-c486-4931-92c8-7ec46c27f6f1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:12.321159 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3039ae3e-1f88-4934-81c5-baa7937cbd06 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:12.328552 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3039ae3e-1f88-4934-81c5-baa7937cbd06 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:12.329244 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3039ae3e-1f88-4934-81c5-baa7937cbd06 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:12.330099 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3039ae3e-1f88-4934-81c5-baa7937cbd06 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:12.330674 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3039ae3e-1f88-4934-81c5-baa7937cbd06 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:12.331504 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3039ae3e-1f88-4934-81c5-baa7937cbd06 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:12.394839 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3039ae3e-1f88-4934-81c5-baa7937cbd06 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] [instance: 43593b13-c486-4931-92c8-7ec46c27f6f1] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:41:12.553148 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3039ae3e-1f88-4934-81c5-baa7937cbd06 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] 10.222.0.23 "DELETE /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1" status: 204 len: 0 microversion: 2.1 time: 0.280763 Sep 10 11:41:12.557942 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 431/857] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:41:12 2022] DELETE /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:41:12.565372 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d155c967-4830-43fc-a047-64677254d0ef tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:12.566987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d155c967-4830-43fc-a047-64677254d0ef tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: f600488a-7c52-4a96-9375-2723bf42cf83] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:12.574852 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d155c967-4830-43fc-a047-64677254d0ef tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:12.575591 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d155c967-4830-43fc-a047-64677254d0ef tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:12.576156 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d155c967-4830-43fc-a047-64677254d0ef tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:12.576996 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d155c967-4830-43fc-a047-64677254d0ef tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:12.577560 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d155c967-4830-43fc-a047-64677254d0ef tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:12.578096 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d155c967-4830-43fc-a047-64677254d0ef tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:12.779672 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d155c967-4830-43fc-a047-64677254d0ef tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:12.793948 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d155c967-4830-43fc-a047-64677254d0ef tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:12.797429 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d155c967-4830-43fc-a047-64677254d0ef tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:12.800219 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d155c967-4830-43fc-a047-64677254d0ef tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83" status: 200 len: 1564 microversion: 2.25 time: 0.240272 Sep 10 11:41:12.813141 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 432/858] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:12 2022] GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83 => generated 1564 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:12.827311 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f661a60e-a744-4c46-8661-208a4612c485 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:12.827949 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f661a60e-a744-4c46-8661-208a4612c485 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] [instance: 43593b13-c486-4931-92c8-7ec46c27f6f1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:12.842449 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f661a60e-a744-4c46-8661-208a4612c485 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:12.847473 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f661a60e-a744-4c46-8661-208a4612c485 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:12.847937 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f661a60e-a744-4c46-8661-208a4612c485 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:12.853035 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f661a60e-a744-4c46-8661-208a4612c485 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:12.854108 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f661a60e-a744-4c46-8661-208a4612c485 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:12.854108 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f661a60e-a744-4c46-8661-208a4612c485 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:13.101206 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f661a60e-a744-4c46-8661-208a4612c485 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d20eac7b074cc9bee7e8ffb769aa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9f89062992414395b683e882194649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:13.120753 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f661a60e-a744-4c46-8661-208a4612c485 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] 10.222.0.23 "GET /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1" status: 200 len: 1511 microversion: 2.1 time: 0.303997 Sep 10 11:41:13.121594 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 433/859] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:12 2022] GET /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1 => generated 1511 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:13.135209 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-aec5eee0-c8ea-4ae1-9389-89ff1a5cecaf tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:13.140538 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-aec5eee0-c8ea-4ae1-9389-89ff1a5cecaf tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:13.156867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aec5eee0-c8ea-4ae1-9389-89ff1a5cecaf tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:13.157650 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aec5eee0-c8ea-4ae1-9389-89ff1a5cecaf tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:13.160002 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aec5eee0-c8ea-4ae1-9389-89ff1a5cecaf tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:13.160974 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aec5eee0-c8ea-4ae1-9389-89ff1a5cecaf tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:13.163793 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aec5eee0-c8ea-4ae1-9389-89ff1a5cecaf tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:13.164405 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aec5eee0-c8ea-4ae1-9389-89ff1a5cecaf tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:13.317169 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-aec5eee0-c8ea-4ae1-9389-89ff1a5cecaf tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:13.327798 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-aec5eee0-c8ea-4ae1-9389-89ff1a5cecaf tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:13.329355 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-aec5eee0-c8ea-4ae1-9389-89ff1a5cecaf tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:13.344775 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-aec5eee0-c8ea-4ae1-9389-89ff1a5cecaf tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1444 microversion: 2.75 time: 0.219675 Sep 10 11:41:13.345321 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 434/860] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:13 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1444 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:13.356234 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-792857f5-8afe-4a2f-bd95-043b234c8b1b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:13.359577 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-792857f5-8afe-4a2f-bd95-043b234c8b1b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: 3bb65ae3-44e9-4803-b00c-132423b2fd8d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:13.375081 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-792857f5-8afe-4a2f-bd95-043b234c8b1b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:13.375605 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-792857f5-8afe-4a2f-bd95-043b234c8b1b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:13.376052 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-792857f5-8afe-4a2f-bd95-043b234c8b1b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:13.376775 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-792857f5-8afe-4a2f-bd95-043b234c8b1b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:13.377233 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-792857f5-8afe-4a2f-bd95-043b234c8b1b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:13.377665 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-792857f5-8afe-4a2f-bd95-043b234c8b1b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:13.587981 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-792857f5-8afe-4a2f-bd95-043b234c8b1b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:13.597990 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-792857f5-8afe-4a2f-bd95-043b234c8b1b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d" status: 200 len: 1463 microversion: 2.1 time: 0.250760 Sep 10 11:41:13.615520 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 435/861] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:13 2022] GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d => generated 1463 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:13.621666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f3a836ca-2d8c-4414-87c3-39da9391b381 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:13.622460 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f3a836ca-2d8c-4414-87c3-39da9391b381 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:13.633321 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f3a836ca-2d8c-4414-87c3-39da9391b381 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:13.634532 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f3a836ca-2d8c-4414-87c3-39da9391b381 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:13.635155 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f3a836ca-2d8c-4414-87c3-39da9391b381 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:13.639322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f3a836ca-2d8c-4414-87c3-39da9391b381 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:13.640046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f3a836ca-2d8c-4414-87c3-39da9391b381 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:13.640801 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f3a836ca-2d8c-4414-87c3-39da9391b381 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:13.725927 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f3a836ca-2d8c-4414-87c3-39da9391b381 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64e2df030a745de8ae7eda29d2ac30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c44e3e2920e48868e1c05f70b1d7639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:13.738896 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f3a836ca-2d8c-4414-87c3-39da9391b381 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "GET /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7" status: 200 len: 1347 microversion: 2.1 time: 0.122218 Sep 10 11:41:13.739962 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 436/862] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:13 2022] GET /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 => generated 1347 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:13.829360 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-479172bd-34ce-4cbc-a36e-b1e3d635676a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:13.830600 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-479172bd-34ce-4cbc-a36e-b1e3d635676a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: f600488a-7c52-4a96-9375-2723bf42cf83] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:13.839372 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-479172bd-34ce-4cbc-a36e-b1e3d635676a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:13.840163 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-479172bd-34ce-4cbc-a36e-b1e3d635676a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:13.840847 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-479172bd-34ce-4cbc-a36e-b1e3d635676a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:13.842376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-479172bd-34ce-4cbc-a36e-b1e3d635676a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:13.843017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-479172bd-34ce-4cbc-a36e-b1e3d635676a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:13.843483 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-479172bd-34ce-4cbc-a36e-b1e3d635676a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:13.889677 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:41:14.022906 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-479172bd-34ce-4cbc-a36e-b1e3d635676a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:14.032197 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-479172bd-34ce-4cbc-a36e-b1e3d635676a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:14.034912 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-479172bd-34ce-4cbc-a36e-b1e3d635676a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:14.036268 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-479172bd-34ce-4cbc-a36e-b1e3d635676a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83" status: 200 len: 1564 microversion: 2.25 time: 0.211871 Sep 10 11:41:14.050786 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 437/863] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:13 2022] GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83 => generated 1564 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:41:14.149446 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7854805e-a5d8-4573-90cb-fe934ea78b5c tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:14.150258 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7854805e-a5d8-4573-90cb-fe934ea78b5c tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] [instance: 43593b13-c486-4931-92c8-7ec46c27f6f1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:14.169543 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7854805e-a5d8-4573-90cb-fe934ea78b5c tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:14.170915 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7854805e-a5d8-4573-90cb-fe934ea78b5c tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:14.172477 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7854805e-a5d8-4573-90cb-fe934ea78b5c tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:14.174939 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7854805e-a5d8-4573-90cb-fe934ea78b5c tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:14.176002 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7854805e-a5d8-4573-90cb-fe934ea78b5c tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:14.177078 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7854805e-a5d8-4573-90cb-fe934ea78b5c tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:14.474936 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7854805e-a5d8-4573-90cb-fe934ea78b5c tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d20eac7b074cc9bee7e8ffb769aa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9f89062992414395b683e882194649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:14.490759 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7854805e-a5d8-4573-90cb-fe934ea78b5c tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] 10.222.0.23 "GET /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1" status: 200 len: 1511 microversion: 2.1 time: 0.345101 Sep 10 11:41:14.491803 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 438/864] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:14 2022] GET /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1 => generated 1511 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:14.496569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-85f8c048-a32c-4335-93bd-23f112e26fca tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:14.497165 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-85f8c048-a32c-4335-93bd-23f112e26fca tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:14.517333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-85f8c048-a32c-4335-93bd-23f112e26fca tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:14.517974 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-85f8c048-a32c-4335-93bd-23f112e26fca tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:14.518714 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-85f8c048-a32c-4335-93bd-23f112e26fca tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:14.519983 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-85f8c048-a32c-4335-93bd-23f112e26fca tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:14.520523 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-85f8c048-a32c-4335-93bd-23f112e26fca tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:14.523939 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-85f8c048-a32c-4335-93bd-23f112e26fca tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:14.608661 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-85f8c048-a32c-4335-93bd-23f112e26fca tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:14.626474 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-85f8c048-a32c-4335-93bd-23f112e26fca tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:14.629270 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-85f8c048-a32c-4335-93bd-23f112e26fca tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:14.636888 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-85f8c048-a32c-4335-93bd-23f112e26fca tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1444 microversion: 2.75 time: 0.143922 Sep 10 11:41:14.652093 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 439/865] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:14 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1444 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:14.665587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f9597648-c674-48b8-be75-cc87248e105a tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:14.666750 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f9597648-c674-48b8-be75-cc87248e105a tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: 3bb65ae3-44e9-4803-b00c-132423b2fd8d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:14.673897 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f9597648-c674-48b8-be75-cc87248e105a tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:14.674575 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f9597648-c674-48b8-be75-cc87248e105a tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:14.675128 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f9597648-c674-48b8-be75-cc87248e105a tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:14.676172 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f9597648-c674-48b8-be75-cc87248e105a tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:14.677089 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f9597648-c674-48b8-be75-cc87248e105a tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:14.677908 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f9597648-c674-48b8-be75-cc87248e105a tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:14.768746 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a46dcf11-44df-4f91-82ce-164197213f59 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/images/84d5e2a0-f60b-46aa-8df1-91f5ffdf5351" status: 200 len: 1427 microversion: 2.1 time: 12.524097 Sep 10 11:41:14.771949 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 427/866] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:41:02 2022] GET /compute/v2.1/images/84d5e2a0-f60b-46aa-8df1-91f5ffdf5351 => generated 1427 bytes in 12528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:41:14.938099 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-83517bf0-7a70-486a-a0e3-a097503f065b tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Action: 'create', calling method: .version_select at 0x7f40736ff160>, body: {"keypair": {"name": "tempest-keypair-1683082546", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXtq7brrT8gipd6hp2Xhob+qR+VMUmgBXBzp4t9TH9LEH3B2RFcMcP9rMcYl/ZKtIb+aHWeGUrGQCKE4rvK0r8I8hKRU0ZC/IeF/VLH5eiF72xAboG2BMXVQuToBsCTew=="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:14.974607 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f9597648-c674-48b8-be75-cc87248e105a tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:14.984764 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f9597648-c674-48b8-be75-cc87248e105a tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d" status: 200 len: 1463 microversion: 2.1 time: 0.330797 Sep 10 11:41:14.985513 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 440/867] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:14 2022] GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d => generated 1463 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:14.986288 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-83517bf0-7a70-486a-a0e3-a097503f065b tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Getting quotas for project 74d3ca9bcf514a8b9844377fc53143ee. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:41:14.990128 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-985a517e-18b6-4c21-968f-486e30a0eedf tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:14.990738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-985a517e-18b6-4c21-968f-486e30a0eedf tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:15.002813 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-83517bf0-7a70-486a-a0e3-a097503f065b tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Getting quotas for user dc1e51accd4241b497623f18f0d2967d and project 74d3ca9bcf514a8b9844377fc53143ee. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:41:15.033534 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-985a517e-18b6-4c21-968f-486e30a0eedf tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:15.034037 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-985a517e-18b6-4c21-968f-486e30a0eedf tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:15.034477 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-985a517e-18b6-4c21-968f-486e30a0eedf tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:15.038597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-985a517e-18b6-4c21-968f-486e30a0eedf tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:15.039865 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-985a517e-18b6-4c21-968f-486e30a0eedf tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:15.040302 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-985a517e-18b6-4c21-968f-486e30a0eedf tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:15.080109 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-83517bf0-7a70-486a-a0e3-a097503f065b tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.306371 Sep 10 11:41:15.085379 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 428/868] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 11:41:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:41:15.108166 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dd0c3f40-ebc8-448a-8e67-a458e81cb03e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:15.109242 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-dd0c3f40-ebc8-448a-8e67-a458e81cb03e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: f600488a-7c52-4a96-9375-2723bf42cf83] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:15.121861 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-985a517e-18b6-4c21-968f-486e30a0eedf tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:15.122696 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dd0c3f40-ebc8-448a-8e67-a458e81cb03e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:15.122878 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-985a517e-18b6-4c21-968f-486e30a0eedf tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:15.123247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-985a517e-18b6-4c21-968f-486e30a0eedf tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:15.123715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-985a517e-18b6-4c21-968f-486e30a0eedf tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lazy-loading 'fault' on Instance uuid 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:41:15.124593 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dd0c3f40-ebc8-448a-8e67-a458e81cb03e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:15.125944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dd0c3f40-ebc8-448a-8e67-a458e81cb03e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:15.128108 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dd0c3f40-ebc8-448a-8e67-a458e81cb03e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:15.131867 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dd0c3f40-ebc8-448a-8e67-a458e81cb03e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:15.134593 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dd0c3f40-ebc8-448a-8e67-a458e81cb03e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:15.244806 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-985a517e-18b6-4c21-968f-486e30a0eedf tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64e2df030a745de8ae7eda29d2ac30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c44e3e2920e48868e1c05f70b1d7639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:15.253746 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-985a517e-18b6-4c21-968f-486e30a0eedf tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "GET /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7" status: 200 len: 1352 microversion: 2.1 time: 0.267100 Sep 10 11:41:15.271917 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 441/869] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:14 2022] GET /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 => generated 1352 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:15.464723 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-dd0c3f40-ebc8-448a-8e67-a458e81cb03e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:15.478726 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-dd0c3f40-ebc8-448a-8e67-a458e81cb03e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:15.481151 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-dd0c3f40-ebc8-448a-8e67-a458e81cb03e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:15.482931 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-dd0c3f40-ebc8-448a-8e67-a458e81cb03e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83" status: 200 len: 1564 microversion: 2.25 time: 0.393719 Sep 10 11:41:15.484124 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 429/870] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:15 2022] GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83 => generated 1564 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:15.520817 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e563d97d-d4fc-4f31-bad9-c004877da173 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:15.521357 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e563d97d-d4fc-4f31-bad9-c004877da173 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] [instance: 43593b13-c486-4931-92c8-7ec46c27f6f1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:15.536878 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e563d97d-d4fc-4f31-bad9-c004877da173 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:15.537374 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e563d97d-d4fc-4f31-bad9-c004877da173 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:15.538208 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e563d97d-d4fc-4f31-bad9-c004877da173 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:15.538546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e563d97d-d4fc-4f31-bad9-c004877da173 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:15.538955 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e563d97d-d4fc-4f31-bad9-c004877da173 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:15.539405 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e563d97d-d4fc-4f31-bad9-c004877da173 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:15.669191 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-86ac75c9-dad7-43dd-8a87-7e2979397d2b tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:15.670795 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-86ac75c9-dad7-43dd-8a87-7e2979397d2b tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:15.682748 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86ac75c9-dad7-43dd-8a87-7e2979397d2b tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:15.683662 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86ac75c9-dad7-43dd-8a87-7e2979397d2b tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:15.686299 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86ac75c9-dad7-43dd-8a87-7e2979397d2b tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:15.687509 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86ac75c9-dad7-43dd-8a87-7e2979397d2b tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:15.688164 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86ac75c9-dad7-43dd-8a87-7e2979397d2b tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:15.692293 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86ac75c9-dad7-43dd-8a87-7e2979397d2b tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:15.801560 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86ac75c9-dad7-43dd-8a87-7e2979397d2b tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:15.803445 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86ac75c9-dad7-43dd-8a87-7e2979397d2b tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:15.804261 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86ac75c9-dad7-43dd-8a87-7e2979397d2b tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:15.805520 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-86ac75c9-dad7-43dd-8a87-7e2979397d2b tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lazy-loading 'fault' on Instance uuid 89c9187c-06d0-490a-ad42-8c632924689f {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:41:15.971025 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e563d97d-d4fc-4f31-bad9-c004877da173 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d20eac7b074cc9bee7e8ffb769aa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9f89062992414395b683e882194649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:15.991679 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e563d97d-d4fc-4f31-bad9-c004877da173 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] 10.222.0.23 "GET /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1" status: 200 len: 1511 microversion: 2.1 time: 0.475856 Sep 10 11:41:15.994020 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-86ac75c9-dad7-43dd-8a87-7e2979397d2b tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:15.994514 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 442/871] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:15 2022] GET /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1 => generated 1511 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:16.002737 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5da9af31-b777-4e43-b908-811a4ce4dc51 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '.version_select at 0x7f40738da8b0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:16.040365 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-86ac75c9-dad7-43dd-8a87-7e2979397d2b tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:16.048709 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-86ac75c9-dad7-43dd-8a87-7e2979397d2b tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ee4fc3ab324539a78b2bf4e20b36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c541e81d1d1431a9b204d413b9a7365', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:16.077717 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-86ac75c9-dad7-43dd-8a87-7e2979397d2b tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 200 len: 1449 microversion: 2.75 time: 0.412277 Sep 10 11:41:16.124278 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 430/872] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:15 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 1449 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:16.141319 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5da9af31-b777-4e43-b908-811a4ce4dc51 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/images/84d5e2a0-f60b-46aa-8df1-91f5ffdf5351" status: 200 len: 1427 microversion: 2.1 time: 0.145391 Sep 10 11:41:16.142050 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1572d9c9-1cc7-436a-8003-c7ecba0fb23e tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:16.143465 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1572d9c9-1cc7-436a-8003-c7ecba0fb23e tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: 3bb65ae3-44e9-4803-b00c-132423b2fd8d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:16.151608 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 443/873] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:41:15 2022] GET /compute/v2.1/images/84d5e2a0-f60b-46aa-8df1-91f5ffdf5351 => generated 1427 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:16.163263 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1572d9c9-1cc7-436a-8003-c7ecba0fb23e tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:16.164065 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1572d9c9-1cc7-436a-8003-c7ecba0fb23e tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:16.164675 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1572d9c9-1cc7-436a-8003-c7ecba0fb23e tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:16.166363 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1572d9c9-1cc7-436a-8003-c7ecba0fb23e tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:16.166833 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1572d9c9-1cc7-436a-8003-c7ecba0fb23e tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:16.167328 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1572d9c9-1cc7-436a-8003-c7ecba0fb23e tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:16.286025 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-59c1c235-e440-4b9e-9e4b-6880fe81a309 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:16.287151 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-59c1c235-e440-4b9e-9e4b-6880fe81a309 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:16.302209 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59c1c235-e440-4b9e-9e4b-6880fe81a309 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:16.305490 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59c1c235-e440-4b9e-9e4b-6880fe81a309 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:16.306523 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59c1c235-e440-4b9e-9e4b-6880fe81a309 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:16.308469 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59c1c235-e440-4b9e-9e4b-6880fe81a309 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:16.309231 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59c1c235-e440-4b9e-9e4b-6880fe81a309 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:16.310494 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59c1c235-e440-4b9e-9e4b-6880fe81a309 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:16.328946 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-59c1c235-e440-4b9e-9e4b-6880fe81a309 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] HTTP exception thrown: Instance 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 could not be found. Sep 10 11:41:16.330959 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-59c1c235-e440-4b9e-9e4b-6880fe81a309 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Request method failure captured: Sep 10 11:41:16.330959 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 HTTP/1.1 Sep 10 11:41:16.330959 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:41:16.330959 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:41:16.330959 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:41:16.330959 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:41:16.330959 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:41:16.330959 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:41:16.330959 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:41:16.330959 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:41:16.330959 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHcU1B0Vnhoehy7U99Bxqdtr_k8hA2h6jGyomYMoHKCCpTmmpWUZgxPrvlbChKM3TJJpNBQrlI9zcMNlrrPIEYh7sOPNHkSMpG60Nh78QQWEM1YDlbSgieGZGdi-iF-93cnaXZSf9UJNauyZCqYMeb-4VSMvGxkikKg-5Wl9OARowM8 Sep 10 11:41:16.330959 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:41:16.330959 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:41:16.330959 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:41:16.330959 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:41:16.330959 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:41:16.330959 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:41:16.330959 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 2c44e3e2920e48868e1c05f70b1d7639 Sep 10 11:41:16.330959 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1547806860 Sep 10 11:41:16.330959 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:41:16.330959 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:41:16.332736 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c44e3e2920e48868e1c05f70b1d7639"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c44e3e2920e48868e1c05f70b1d7639"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2c44e3e2920e48868e1c05f70b1d7639", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2c44e3e2920e48868e1c05f70b1d7639"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:41:16.332736 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1547806860 Sep 10 11:41:16.332736 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 2c44e3e2920e48868e1c05f70b1d7639 Sep 10 11:41:16.332736 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1547806860 Sep 10 11:41:16.332736 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1547806860-project Sep 10 11:41:16.332736 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:41:16.332736 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:41:16.332736 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: b64e2df030a745de8ae7eda29d2ac30a Sep 10 11:41:16.332736 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1547806860-project Sep 10 11:41:16.332736 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:41:16.332736 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 could not be found. Sep 10 11:41:16.332736 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7'} Sep 10 11:41:16.333667 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:41:16.333667 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:16.333667 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:41:16.333667 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:41:16.333667 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:41:16.333667 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:41:16.333667 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:41:16.333667 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:41:16.333667 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:41:16.333667 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:41:16.333667 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 could not be found. Sep 10 11:41:16.333667 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:16.333667 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:16.333667 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:16.333667 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:16.333667 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:16.333667 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:16.333667 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:41:16.333667 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:41:16.333667 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:41:16.335472 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:41:16.335472 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:41:16.335472 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:41:16.335472 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:41:16.335472 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:41:16.335472 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:41:16.335472 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:41:16.335472 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 could not be found. Sep 10 11:41:16.335472 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:16.335472 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:16.335472 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:16.335472 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:16.335472 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:16.335472 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:16.335472 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:41:16.335472 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:41:16.335472 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 could not be found. Sep 10 11:41:16.335472 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:16.338061 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-59c1c235-e440-4b9e-9e4b-6880fe81a309 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Returning 404 to user: Instance 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:41:16.339035 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-59c1c235-e440-4b9e-9e4b-6880fe81a309 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "GET /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7" status: 404 len: 111 microversion: 2.1 time: 0.056905 Sep 10 11:41:16.340026 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 444/874] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:16 2022] GET /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:41:16.349383 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-77d81b97-db3d-4772-a097-19df35714035 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:16.350198 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-77d81b97-db3d-4772-a097-19df35714035 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: cd42bf97-63e2-4a4b-a5db-d747a478dcbd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:16.358326 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-77d81b97-db3d-4772-a097-19df35714035 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:16.359111 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-77d81b97-db3d-4772-a097-19df35714035 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:16.359934 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-77d81b97-db3d-4772-a097-19df35714035 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:16.360916 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-77d81b97-db3d-4772-a097-19df35714035 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:16.361605 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-77d81b97-db3d-4772-a097-19df35714035 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:16.362207 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-77d81b97-db3d-4772-a097-19df35714035 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:16.378104 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-77d81b97-db3d-4772-a097-19df35714035 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] HTTP exception thrown: Instance cd42bf97-63e2-4a4b-a5db-d747a478dcbd could not be found. Sep 10 11:41:16.380511 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-77d81b97-db3d-4772-a097-19df35714035 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Request method failure captured: Sep 10 11:41:16.380511 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/servers/cd42bf97-63e2-4a4b-a5db-d747a478dcbd HTTP/1.1 Sep 10 11:41:16.380511 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:41:16.380511 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:41:16.380511 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:41:16.380511 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:41:16.380511 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:41:16.380511 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:41:16.380511 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:41:16.380511 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:41:16.380511 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHcU1B0Vnhoehy7U99Bxqdtr_k8hA2h6jGyomYMoHKCCpTmmpWUZgxPrvlbChKM3TJJpNBQrlI9zcMNlrrPIEYh7sOPNHkSMpG60Nh78QQWEM1YDlbSgieGZGdi-iF-93cnaXZSf9UJNauyZCqYMeb-4VSMvGxkikKg-5Wl9OARowM8 Sep 10 11:41:16.380511 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:41:16.380511 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:41:16.380511 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:41:16.380511 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:41:16.380511 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:41:16.380511 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:41:16.380511 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 2c44e3e2920e48868e1c05f70b1d7639 Sep 10 11:41:16.380511 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1547806860 Sep 10 11:41:16.380511 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:41:16.380511 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:41:16.382127 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c44e3e2920e48868e1c05f70b1d7639"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c44e3e2920e48868e1c05f70b1d7639"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2c44e3e2920e48868e1c05f70b1d7639", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2c44e3e2920e48868e1c05f70b1d7639"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:41:16.382127 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1547806860 Sep 10 11:41:16.382127 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 2c44e3e2920e48868e1c05f70b1d7639 Sep 10 11:41:16.382127 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1547806860 Sep 10 11:41:16.382127 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1547806860-project Sep 10 11:41:16.382127 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:41:16.382127 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:41:16.382127 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: b64e2df030a745de8ae7eda29d2ac30a Sep 10 11:41:16.382127 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1547806860-project Sep 10 11:41:16.382127 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:41:16.382127 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance cd42bf97-63e2-4a4b-a5db-d747a478dcbd could not be found. Sep 10 11:41:16.382127 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'cd42bf97-63e2-4a4b-a5db-d747a478dcbd'} Sep 10 11:41:16.383037 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:41:16.383037 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:16.383037 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:41:16.383037 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:41:16.383037 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:41:16.383037 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:41:16.383037 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:41:16.383037 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:41:16.383037 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:41:16.383037 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:41:16.383037 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd42bf97-63e2-4a4b-a5db-d747a478dcbd could not be found. Sep 10 11:41:16.383037 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:16.383037 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:16.383037 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:16.383037 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:16.383037 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:16.383037 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:16.383037 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:41:16.383037 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:41:16.383037 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:41:16.384478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:41:16.384478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:41:16.384478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:41:16.384478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:41:16.384478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:41:16.384478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:41:16.384478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:41:16.384478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:41:16.384478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:41:16.384478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd42bf97-63e2-4a4b-a5db-d747a478dcbd could not be found. Sep 10 11:41:16.384478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:16.384478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:16.384478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:16.384478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:16.384478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:16.384478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:16.384478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:41:16.384478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:41:16.384478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd42bf97-63e2-4a4b-a5db-d747a478dcbd could not be found. Sep 10 11:41:16.384478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:16.386890 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-77d81b97-db3d-4772-a097-19df35714035 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Returning 404 to user: Instance cd42bf97-63e2-4a4b-a5db-d747a478dcbd could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:41:16.389297 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-77d81b97-db3d-4772-a097-19df35714035 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cd42bf97-63e2-4a4b-a5db-d747a478dcbd" status: 404 len: 111 microversion: 2.1 time: 0.043320 Sep 10 11:41:16.390408 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 445/875] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:41:16 2022] DELETE /compute/v2.1/servers/cd42bf97-63e2-4a4b-a5db-d747a478dcbd => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:41:16.401623 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-20ee768d-bea0-4c14-a242-07a3127ea0d4 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:16.402254 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-20ee768d-bea0-4c14-a242-07a3127ea0d4 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: cd42bf97-63e2-4a4b-a5db-d747a478dcbd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:16.409694 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-20ee768d-bea0-4c14-a242-07a3127ea0d4 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:16.410256 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-20ee768d-bea0-4c14-a242-07a3127ea0d4 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:16.410699 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-20ee768d-bea0-4c14-a242-07a3127ea0d4 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:16.411642 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-20ee768d-bea0-4c14-a242-07a3127ea0d4 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:16.412359 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-20ee768d-bea0-4c14-a242-07a3127ea0d4 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:16.412982 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-20ee768d-bea0-4c14-a242-07a3127ea0d4 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:16.446722 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-20ee768d-bea0-4c14-a242-07a3127ea0d4 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] HTTP exception thrown: Instance cd42bf97-63e2-4a4b-a5db-d747a478dcbd could not be found. Sep 10 11:41:16.448910 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-20ee768d-bea0-4c14-a242-07a3127ea0d4 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Request method failure captured: Sep 10 11:41:16.448910 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/cd42bf97-63e2-4a4b-a5db-d747a478dcbd HTTP/1.1 Sep 10 11:41:16.448910 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:41:16.448910 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:41:16.448910 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:41:16.448910 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:41:16.448910 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:41:16.448910 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:41:16.448910 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:41:16.448910 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:41:16.448910 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHcU1B0Vnhoehy7U99Bxqdtr_k8hA2h6jGyomYMoHKCCpTmmpWUZgxPrvlbChKM3TJJpNBQrlI9zcMNlrrPIEYh7sOPNHkSMpG60Nh78QQWEM1YDlbSgieGZGdi-iF-93cnaXZSf9UJNauyZCqYMeb-4VSMvGxkikKg-5Wl9OARowM8 Sep 10 11:41:16.448910 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:41:16.448910 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:41:16.448910 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:41:16.448910 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:41:16.448910 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:41:16.448910 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:41:16.448910 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 2c44e3e2920e48868e1c05f70b1d7639 Sep 10 11:41:16.448910 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1547806860 Sep 10 11:41:16.448910 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:41:16.448910 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:41:16.450263 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c44e3e2920e48868e1c05f70b1d7639"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c44e3e2920e48868e1c05f70b1d7639"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2c44e3e2920e48868e1c05f70b1d7639", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2c44e3e2920e48868e1c05f70b1d7639"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:41:16.450263 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1547806860 Sep 10 11:41:16.450263 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 2c44e3e2920e48868e1c05f70b1d7639 Sep 10 11:41:16.450263 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1547806860 Sep 10 11:41:16.450263 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1547806860-project Sep 10 11:41:16.450263 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:41:16.450263 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:41:16.450263 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: b64e2df030a745de8ae7eda29d2ac30a Sep 10 11:41:16.450263 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1547806860-project Sep 10 11:41:16.450263 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:41:16.450263 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance cd42bf97-63e2-4a4b-a5db-d747a478dcbd could not be found. Sep 10 11:41:16.450263 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'cd42bf97-63e2-4a4b-a5db-d747a478dcbd'} Sep 10 11:41:16.451059 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:41:16.451059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:16.451059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:41:16.451059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:41:16.451059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:41:16.451059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:41:16.451059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:41:16.451059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:41:16.451059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:41:16.451059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:41:16.451059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd42bf97-63e2-4a4b-a5db-d747a478dcbd could not be found. Sep 10 11:41:16.451059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:16.451059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:16.451059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:16.451059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:16.451059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:16.451059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:16.451059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:41:16.451059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:41:16.451059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:41:16.452405 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:41:16.452405 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:41:16.452405 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:41:16.452405 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:41:16.452405 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:41:16.452405 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:41:16.452405 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:41:16.452405 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd42bf97-63e2-4a4b-a5db-d747a478dcbd could not be found. Sep 10 11:41:16.452405 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:16.452405 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:16.452405 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:16.452405 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:16.452405 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:16.452405 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:16.452405 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:41:16.452405 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:41:16.452405 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd42bf97-63e2-4a4b-a5db-d747a478dcbd could not be found. Sep 10 11:41:16.452405 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:16.455995 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-20ee768d-bea0-4c14-a242-07a3127ea0d4 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Returning 404 to user: Instance cd42bf97-63e2-4a4b-a5db-d747a478dcbd could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:41:16.457482 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-20ee768d-bea0-4c14-a242-07a3127ea0d4 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "GET /compute/v2.1/servers/cd42bf97-63e2-4a4b-a5db-d747a478dcbd" status: 404 len: 111 microversion: 2.1 time: 0.062973 Sep 10 11:41:16.459113 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 446/876] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:16 2022] GET /compute/v2.1/servers/cd42bf97-63e2-4a4b-a5db-d747a478dcbd => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:41:16.472769 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8d7bcf8e-cf6c-43fd-ad42-1ac39dffa58d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Calling method '.version_select at 0x7f407369f550>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:16.507944 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8d7bcf8e-cf6c-43fd-ad42-1ac39dffa58d tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-567849478" status: 202 len: 0 microversion: 2.1 time: 0.039622 Sep 10 11:41:16.510114 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 447/877] 10.222.0.23 () {58 vars in 1218 bytes} [Sat Sep 10 11:41:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-567849478 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:41:16.518218 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4dcad622-c003-4e9a-8f9d-4eec1303ff5b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:16.519362 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4dcad622-c003-4e9a-8f9d-4eec1303ff5b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: f600488a-7c52-4a96-9375-2723bf42cf83] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:16.535050 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4dcad622-c003-4e9a-8f9d-4eec1303ff5b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:16.536692 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1572d9c9-1cc7-436a-8003-c7ecba0fb23e tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:16.542159 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4dcad622-c003-4e9a-8f9d-4eec1303ff5b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:16.542627 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4dcad622-c003-4e9a-8f9d-4eec1303ff5b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:16.543412 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4dcad622-c003-4e9a-8f9d-4eec1303ff5b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:16.544130 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4dcad622-c003-4e9a-8f9d-4eec1303ff5b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:16.545474 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4dcad622-c003-4e9a-8f9d-4eec1303ff5b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:16.562379 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1572d9c9-1cc7-436a-8003-c7ecba0fb23e tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d" status: 200 len: 1463 microversion: 2.1 time: 0.419339 Sep 10 11:41:16.563358 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 431/878] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:16 2022] GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d => generated 1463 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:16.720523 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-d57cb136-fbd9-466b-93e2-6d75362e8a58 req-d4bdd774-c11f-4a79-8a5c-f3702cef90e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bb65ae3-44e9-4803-b00c-132423b2fd8d", "name": "network-vif-deleted", "tag": "b5615556-cec7-42af-9601-2d0e112e6b17"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:16.748693 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d57cb136-fbd9-466b-93e2-6d75362e8a58 req-d4bdd774-c11f-4a79-8a5c-f3702cef90e8 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:16.755107 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d57cb136-fbd9-466b-93e2-6d75362e8a58 req-d4bdd774-c11f-4a79-8a5c-f3702cef90e8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:16.755840 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d57cb136-fbd9-466b-93e2-6d75362e8a58 req-d4bdd774-c11f-4a79-8a5c-f3702cef90e8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:16.778415 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-d57cb136-fbd9-466b-93e2-6d75362e8a58 req-d4bdd774-c11f-4a79-8a5c-f3702cef90e8 service nova] Creating event network-vif-deleted:b5615556-cec7-42af-9601-2d0e112e6b17 for instance 3bb65ae3-44e9-4803-b00c-132423b2fd8d on n-h1-856895-1 Sep 10 11:41:16.790440 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-d57cb136-fbd9-466b-93e2-6d75362e8a58 req-d4bdd774-c11f-4a79-8a5c-f3702cef90e8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078457 Sep 10 11:41:16.801129 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 432/879] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:41:17.022189 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3c7b4e00-85f9-41f4-914a-d12eb996bd6a tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:17.023217 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3c7b4e00-85f9-41f4-914a-d12eb996bd6a tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] [instance: 43593b13-c486-4931-92c8-7ec46c27f6f1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:17.033972 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3c7b4e00-85f9-41f4-914a-d12eb996bd6a tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:17.035065 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3c7b4e00-85f9-41f4-914a-d12eb996bd6a tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:17.035319 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3c7b4e00-85f9-41f4-914a-d12eb996bd6a tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:17.035846 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3c7b4e00-85f9-41f4-914a-d12eb996bd6a tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:17.036302 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3c7b4e00-85f9-41f4-914a-d12eb996bd6a tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:17.036727 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3c7b4e00-85f9-41f4-914a-d12eb996bd6a tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:17.049821 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4dcad622-c003-4e9a-8f9d-4eec1303ff5b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:17.062592 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4dcad622-c003-4e9a-8f9d-4eec1303ff5b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:17.067830 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4dcad622-c003-4e9a-8f9d-4eec1303ff5b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:17.069552 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4dcad622-c003-4e9a-8f9d-4eec1303ff5b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83" status: 200 len: 1564 microversion: 2.25 time: 0.557917 Sep 10 11:41:17.070704 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 448/880] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:16 2022] GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83 => generated 1564 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:17.140544 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-406467c8-dcf5-4c9d-beae-106d3cc5f0fe tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:17.141185 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-406467c8-dcf5-4c9d-beae-106d3cc5f0fe tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] [instance: 89c9187c-06d0-490a-ad42-8c632924689f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:17.148154 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-406467c8-dcf5-4c9d-beae-106d3cc5f0fe tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:17.149846 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-406467c8-dcf5-4c9d-beae-106d3cc5f0fe tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:17.150467 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-406467c8-dcf5-4c9d-beae-106d3cc5f0fe tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:17.151402 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-406467c8-dcf5-4c9d-beae-106d3cc5f0fe tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:17.152406 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-406467c8-dcf5-4c9d-beae-106d3cc5f0fe tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:17.153233 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-406467c8-dcf5-4c9d-beae-106d3cc5f0fe tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:17.177360 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-406467c8-dcf5-4c9d-beae-106d3cc5f0fe tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] HTTP exception thrown: Instance 89c9187c-06d0-490a-ad42-8c632924689f could not be found. Sep 10 11:41:17.184181 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-406467c8-dcf5-4c9d-beae-106d3cc5f0fe tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Request method failure captured: Sep 10 11:41:17.184181 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f HTTP/1.1 Sep 10 11:41:17.184181 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:41:17.184181 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:41:17.184181 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:41:17.184181 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:41:17.184181 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:41:17.184181 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:41:17.184181 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:41:17.184181 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:41:17.184181 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHeDwMNDKi7RYErUSpEvdYvDZE9DkAiJUecqs5N26SnYUmKyXw48ZE1NKmz60-q04O7RoYubVfZ0VxcK-jKeFltB6yeyL7NQiqHIsgR7dP31fYut7HOQERJmcO-avujBfOfMQ3Ew2KUOeZK8TN3L-NjFRk60Tyl67ituNFL-p9oBkn8 Sep 10 11:41:17.184181 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:41:17.184181 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:41:17.184181 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:41:17.184181 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:41:17.184181 n-d-856895-1 devstack@n-api.service[128777]: X-Openstack-Nova-Api-Version: 2.75 Sep 10 11:41:17.184181 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:41:17.184181 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:41:17.184181 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 1c541e81d1d1431a9b204d413b9a7365 Sep 10 11:41:17.184181 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersAdmin275Test-1295092089 Sep 10 11:41:17.184181 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:41:17.184181 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:41:17.186534 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c541e81d1d1431a9b204d413b9a7365"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c541e81d1d1431a9b204d413b9a7365"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1c541e81d1d1431a9b204d413b9a7365", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1c541e81d1d1431a9b204d413b9a7365"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:41:17.186534 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersAdmin275Test-1295092089 Sep 10 11:41:17.186534 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 1c541e81d1d1431a9b204d413b9a7365 Sep 10 11:41:17.186534 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersAdmin275Test-1295092089 Sep 10 11:41:17.186534 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersAdmin275Test-1295092089-project Sep 10 11:41:17.186534 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:41:17.186534 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:41:17.186534 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 15ee4fc3ab324539a78b2bf4e20b36dc Sep 10 11:41:17.186534 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersAdmin275Test-1295092089-project Sep 10 11:41:17.186534 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:41:17.186534 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 89c9187c-06d0-490a-ad42-8c632924689f could not be found. Sep 10 11:41:17.186534 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '89c9187c-06d0-490a-ad42-8c632924689f'} Sep 10 11:41:17.189523 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:41:17.189523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:17.189523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:41:17.189523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:41:17.189523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:41:17.189523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:41:17.189523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:41:17.189523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:41:17.189523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:41:17.189523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:41:17.189523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89c9187c-06d0-490a-ad42-8c632924689f could not be found. Sep 10 11:41:17.189523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:17.189523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:17.189523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:17.189523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:17.189523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:17.189523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:17.189523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:41:17.189523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:41:17.189523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:41:17.191951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:41:17.191951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:41:17.191951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:41:17.191951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:41:17.191951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:41:17.191951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:41:17.191951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:41:17.191951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89c9187c-06d0-490a-ad42-8c632924689f could not be found. Sep 10 11:41:17.191951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:17.191951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:17.191951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:17.191951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:17.191951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:17.191951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:17.191951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:41:17.191951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:41:17.191951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89c9187c-06d0-490a-ad42-8c632924689f could not be found. Sep 10 11:41:17.191951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:17.196885 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-406467c8-dcf5-4c9d-beae-106d3cc5f0fe tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] Returning 404 to user: Instance 89c9187c-06d0-490a-ad42-8c632924689f could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:41:17.197815 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-406467c8-dcf5-4c9d-beae-106d3cc5f0fe tempest-ServersAdmin275Test-1295092089 tempest-ServersAdmin275Test-1295092089-project] 10.222.0.23 "GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f" status: 404 len: 111 microversion: 2.75 time: 0.070251 Sep 10 11:41:17.198838 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 449/881] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:17 2022] GET /compute/v2.1/servers/89c9187c-06d0-490a-ad42-8c632924689f => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:41:17.204819 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-577d849c-4b71-4db9-aca9-d61fc990c54d tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '.version_select at 0x7f4073dd4a60>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:17.258036 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3c7b4e00-85f9-41f4-914a-d12eb996bd6a tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4d20eac7b074cc9bee7e8ffb769aa34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9f89062992414395b683e882194649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:17.272208 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-577d849c-4b71-4db9-aca9-d61fc990c54d tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/images/84d5e2a0-f60b-46aa-8df1-91f5ffdf5351" status: 200 len: 1436 microversion: 2.1 time: 0.072054 Sep 10 11:41:17.276888 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3c7b4e00-85f9-41f4-914a-d12eb996bd6a tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] 10.222.0.23 "GET /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1" status: 200 len: 1469 microversion: 2.1 time: 0.260084 Sep 10 11:41:17.278003 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 450/882] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:41:17 2022] GET /compute/v2.1/images/84d5e2a0-f60b-46aa-8df1-91f5ffdf5351 => generated 1436 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:17.280060 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 433/883] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:17 2022] GET /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1 => generated 1469 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:17.288640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8e5afdd2-4942-472c-a7bf-259d227e7eca tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '.version_select at 0x7f4073b66d30>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:17.363702 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8e5afdd2-4942-472c-a7bf-259d227e7eca tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/images/84d5e2a0-f60b-46aa-8df1-91f5ffdf5351" status: 200 len: 1436 microversion: 2.1 time: 0.079291 Sep 10 11:41:17.366287 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 451/884] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:41:17 2022] GET /compute/v2.1/images/84d5e2a0-f60b-46aa-8df1-91f5ffdf5351 => generated 1436 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:17.382109 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3bfc9e3a-15f7-4a4c-b464-fa1160669211 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:17.382777 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3bfc9e3a-15f7-4a4c-b464-fa1160669211 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] [instance: 4c806b91-1302-494f-b4eb-a0b7ba04baf4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:17.396464 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3bfc9e3a-15f7-4a4c-b464-fa1160669211 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:17.399236 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3bfc9e3a-15f7-4a4c-b464-fa1160669211 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:17.401819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3bfc9e3a-15f7-4a4c-b464-fa1160669211 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:17.403589 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3bfc9e3a-15f7-4a4c-b464-fa1160669211 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:17.408372 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3bfc9e3a-15f7-4a4c-b464-fa1160669211 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:17.409422 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3bfc9e3a-15f7-4a4c-b464-fa1160669211 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:17.593455 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9d9ed3b6-bf6c-49c8-9ffa-6aa28313a5ea tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:17.594296 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9d9ed3b6-bf6c-49c8-9ffa-6aa28313a5ea tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: 3bb65ae3-44e9-4803-b00c-132423b2fd8d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:17.610384 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9d9ed3b6-bf6c-49c8-9ffa-6aa28313a5ea tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:17.611070 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9d9ed3b6-bf6c-49c8-9ffa-6aa28313a5ea tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:17.613012 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9d9ed3b6-bf6c-49c8-9ffa-6aa28313a5ea tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:17.615508 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9d9ed3b6-bf6c-49c8-9ffa-6aa28313a5ea tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:17.617331 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9d9ed3b6-bf6c-49c8-9ffa-6aa28313a5ea tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:17.617935 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9d9ed3b6-bf6c-49c8-9ffa-6aa28313a5ea tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:17.690443 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9d9ed3b6-bf6c-49c8-9ffa-6aa28313a5ea tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:17.691848 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9d9ed3b6-bf6c-49c8-9ffa-6aa28313a5ea tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:17.692540 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9d9ed3b6-bf6c-49c8-9ffa-6aa28313a5ea tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:17.693359 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-9d9ed3b6-bf6c-49c8-9ffa-6aa28313a5ea tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lazy-loading 'fault' on Instance uuid 3bb65ae3-44e9-4803-b00c-132423b2fd8d {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:41:18.053364 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9d9ed3b6-bf6c-49c8-9ffa-6aa28313a5ea tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:18.068086 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9d9ed3b6-bf6c-49c8-9ffa-6aa28313a5ea tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d" status: 200 len: 1307 microversion: 2.1 time: 0.481708 Sep 10 11:41:18.068960 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 452/885] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:17 2022] GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d => generated 1307 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:18.104882 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c37fcb22-8893-4f15-a481-c1887d031e32 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:18.105785 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c37fcb22-8893-4f15-a481-c1887d031e32 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: f600488a-7c52-4a96-9375-2723bf42cf83] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:18.117490 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c37fcb22-8893-4f15-a481-c1887d031e32 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:18.118606 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c37fcb22-8893-4f15-a481-c1887d031e32 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:18.119256 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c37fcb22-8893-4f15-a481-c1887d031e32 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:18.120472 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c37fcb22-8893-4f15-a481-c1887d031e32 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:18.121363 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c37fcb22-8893-4f15-a481-c1887d031e32 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:18.123055 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c37fcb22-8893-4f15-a481-c1887d031e32 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:18.314452 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3bfc9e3a-15f7-4a4c-b464-fa1160669211 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf661b110ecc4f36b795a980d29f312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5765e50afa045569700eab4616a6a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:18.328342 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3bfc9e3a-15f7-4a4c-b464-fa1160669211 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/servers/4c806b91-1302-494f-b4eb-a0b7ba04baf4" status: 200 len: 1466 microversion: 2.1 time: 0.951596 Sep 10 11:41:18.329375 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 434/886] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:17 2022] GET /compute/v2.1/servers/4c806b91-1302-494f-b4eb-a0b7ba04baf4 => generated 1466 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:18.334480 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-de8df26a-013e-48fc-b903-06d7b4dbd024 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:18.335383 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-de8df26a-013e-48fc-b903-06d7b4dbd024 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] [instance: 43593b13-c486-4931-92c8-7ec46c27f6f1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:18.342255 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de8df26a-013e-48fc-b903-06d7b4dbd024 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:18.342813 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de8df26a-013e-48fc-b903-06d7b4dbd024 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:18.343521 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de8df26a-013e-48fc-b903-06d7b4dbd024 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:18.344428 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de8df26a-013e-48fc-b903-06d7b4dbd024 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:18.345084 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de8df26a-013e-48fc-b903-06d7b4dbd024 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:18.345732 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de8df26a-013e-48fc-b903-06d7b4dbd024 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:18.362986 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-de8df26a-013e-48fc-b903-06d7b4dbd024 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] HTTP exception thrown: Instance 43593b13-c486-4931-92c8-7ec46c27f6f1 could not be found. Sep 10 11:41:18.365136 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-de8df26a-013e-48fc-b903-06d7b4dbd024 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Request method failure captured: Sep 10 11:41:18.365136 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1 HTTP/1.1 Sep 10 11:41:18.365136 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:41:18.365136 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:41:18.365136 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:41:18.365136 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:41:18.365136 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:41:18.365136 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:41:18.365136 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:41:18.365136 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:41:18.365136 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHfEAslujILX3T9QWriOc8APXZit5soPy3wswDlRvWXPAHk63A47FFqZ_JCqxmv_ZY8It34nmY9fZzeLDepfdlHWCMzSC-lkvpzHfuts4JXASXpxBnUzfS0T18wVXL_WpZiJJSQcAZMLrbS64V0oyrXzmvnbqP18C7DQy5N9T-acvlI Sep 10 11:41:18.365136 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:41:18.365136 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:41:18.365136 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:41:18.365136 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:41:18.365136 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:41:18.365136 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:41:18.365136 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 2b9f89062992414395b683e882194649 Sep 10 11:41:18.365136 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ImagesNegativeTestJSON-1893424837 Sep 10 11:41:18.365136 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:41:18.365136 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:41:18.366783 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b9f89062992414395b683e882194649"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b9f89062992414395b683e882194649"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2b9f89062992414395b683e882194649", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2b9f89062992414395b683e882194649"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:41:18.366783 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ImagesNegativeTestJSON-1893424837 Sep 10 11:41:18.366783 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 2b9f89062992414395b683e882194649 Sep 10 11:41:18.366783 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1893424837 Sep 10 11:41:18.366783 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ImagesNegativeTestJSON-1893424837-project Sep 10 11:41:18.366783 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:41:18.366783 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:41:18.366783 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: e4d20eac7b074cc9bee7e8ffb769aa34 Sep 10 11:41:18.366783 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ImagesNegativeTestJSON-1893424837-project Sep 10 11:41:18.366783 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:41:18.366783 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 43593b13-c486-4931-92c8-7ec46c27f6f1 could not be found. Sep 10 11:41:18.366783 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '43593b13-c486-4931-92c8-7ec46c27f6f1'} Sep 10 11:41:18.367775 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:41:18.367775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:18.367775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:41:18.367775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:41:18.367775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:41:18.367775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:41:18.367775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:41:18.367775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:41:18.367775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:41:18.367775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:41:18.367775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43593b13-c486-4931-92c8-7ec46c27f6f1 could not be found. Sep 10 11:41:18.367775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:18.367775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:18.367775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:18.367775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:18.367775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:18.367775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:18.367775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:41:18.367775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:41:18.367775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:41:18.369238 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:41:18.369238 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:41:18.369238 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:41:18.369238 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:41:18.369238 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:41:18.369238 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:41:18.369238 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:41:18.369238 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43593b13-c486-4931-92c8-7ec46c27f6f1 could not be found. Sep 10 11:41:18.369238 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:18.369238 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:18.369238 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:18.369238 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:18.369238 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:18.369238 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:18.369238 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:41:18.369238 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:41:18.369238 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43593b13-c486-4931-92c8-7ec46c27f6f1 could not be found. Sep 10 11:41:18.369238 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:18.371581 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-de8df26a-013e-48fc-b903-06d7b4dbd024 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Returning 404 to user: Instance 43593b13-c486-4931-92c8-7ec46c27f6f1 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:41:18.372675 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-de8df26a-013e-48fc-b903-06d7b4dbd024 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] 10.222.0.23 "GET /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1" status: 404 len: 111 microversion: 2.1 time: 0.042031 Sep 10 11:41:18.376973 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 435/887] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:18 2022] GET /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:41:18.382139 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e9c18469-fc62-4f8a-9c19-a8d62e9be397 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '.version_select at 0x7f4073ffc280>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:18.511817 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c37fcb22-8893-4f15-a481-c1887d031e32 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:18.529558 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c37fcb22-8893-4f15-a481-c1887d031e32 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:18.532802 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c37fcb22-8893-4f15-a481-c1887d031e32 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:18.534517 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c37fcb22-8893-4f15-a481-c1887d031e32 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83" status: 200 len: 1564 microversion: 2.25 time: 0.437542 Sep 10 11:41:18.551105 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 453/888] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:18 2022] GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83 => generated 1564 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:18.560631 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-165a6b10-2c92-42ec-ad9d-9ce4ea86b47b tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-144527785", "metadata": {"image_type": "test"}}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:18.563575 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-165a6b10-2c92-42ec-ad9d-9ce4ea86b47b tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] [instance: 43593b13-c486-4931-92c8-7ec46c27f6f1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:18.569895 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-165a6b10-2c92-42ec-ad9d-9ce4ea86b47b tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:18.570592 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-165a6b10-2c92-42ec-ad9d-9ce4ea86b47b tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:18.571938 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-165a6b10-2c92-42ec-ad9d-9ce4ea86b47b tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:18.572722 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-165a6b10-2c92-42ec-ad9d-9ce4ea86b47b tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:18.573287 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-165a6b10-2c92-42ec-ad9d-9ce4ea86b47b tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:18.573822 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-165a6b10-2c92-42ec-ad9d-9ce4ea86b47b tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:18.592544 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-165a6b10-2c92-42ec-ad9d-9ce4ea86b47b tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] HTTP exception thrown: Instance 43593b13-c486-4931-92c8-7ec46c27f6f1 could not be found. Sep 10 11:41:18.596101 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-165a6b10-2c92-42ec-ad9d-9ce4ea86b47b tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Request method failure captured: Sep 10 11:41:18.596101 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1/action HTTP/1.1 Sep 10 11:41:18.596101 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:41:18.596101 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:41:18.596101 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:41:18.596101 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 111 Sep 10 11:41:18.596101 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:41:18.596101 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:41:18.596101 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:41:18.596101 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:41:18.596101 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHfEAslujILX3T9QWriOc8APXZit5soPy3wswDlRvWXPAHk63A47FFqZ_JCqxmv_ZY8It34nmY9fZzeLDepfdlHWCMzSC-lkvpzHfuts4JXASXpxBnUzfS0T18wVXL_WpZiJJSQcAZMLrbS64V0oyrXzmvnbqP18C7DQy5N9T-acvlI Sep 10 11:41:18.596101 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:41:18.596101 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:41:18.596101 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:41:18.596101 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:41:18.596101 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:41:18.596101 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:41:18.596101 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 2b9f89062992414395b683e882194649 Sep 10 11:41:18.596101 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ImagesNegativeTestJSON-1893424837 Sep 10 11:41:18.596101 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:41:18.596101 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:41:18.597410 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b9f89062992414395b683e882194649"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b9f89062992414395b683e882194649"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2b9f89062992414395b683e882194649", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2b9f89062992414395b683e882194649"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:41:18.597410 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ImagesNegativeTestJSON-1893424837 Sep 10 11:41:18.597410 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 2b9f89062992414395b683e882194649 Sep 10 11:41:18.597410 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1893424837 Sep 10 11:41:18.597410 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ImagesNegativeTestJSON-1893424837-project Sep 10 11:41:18.597410 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:41:18.597410 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:41:18.597410 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: e4d20eac7b074cc9bee7e8ffb769aa34 Sep 10 11:41:18.597410 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ImagesNegativeTestJSON-1893424837-project Sep 10 11:41:18.597410 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:41:18.597410 n-d-856895-1 devstack@n-api.service[128777]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-144527785", "metadata": {"image_type": "test"}}} Sep 10 11:41:18.597410 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:41:18.598143 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 43593b13-c486-4931-92c8-7ec46c27f6f1 could not be found. Sep 10 11:41:18.598143 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '43593b13-c486-4931-92c8-7ec46c27f6f1', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-144527785', 'metadata': {'image_type': 'test'}}}} Sep 10 11:41:18.598143 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:41:18.598143 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:18.598143 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:41:18.598143 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:41:18.598143 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:41:18.598143 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:41:18.598143 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:41:18.598143 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:41:18.598143 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:41:18.598143 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:41:18.598143 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43593b13-c486-4931-92c8-7ec46c27f6f1 could not be found. Sep 10 11:41:18.598143 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:18.598143 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:18.598143 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:18.598143 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:18.598143 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:18.598143 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:18.599368 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:41:18.599368 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:41:18.599368 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:41:18.599368 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:41:18.599368 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:41:18.599368 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:41:18.599368 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:41:18.599368 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:41:18.599368 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 10 11:41:18.599368 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 10 11:41:18.599368 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:41:18.599368 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:41:18.599368 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:41:18.599368 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:41:18.599368 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43593b13-c486-4931-92c8-7ec46c27f6f1 could not be found. Sep 10 11:41:18.599368 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:18.599368 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:18.599368 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:18.599368 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:18.599368 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:18.600577 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:18.600577 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:41:18.600577 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:41:18.600577 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43593b13-c486-4931-92c8-7ec46c27f6f1 could not be found. Sep 10 11:41:18.600577 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:18.606758 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-165a6b10-2c92-42ec-ad9d-9ce4ea86b47b tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Returning 404 to user: Instance 43593b13-c486-4931-92c8-7ec46c27f6f1 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:41:18.608066 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-165a6b10-2c92-42ec-ad9d-9ce4ea86b47b tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] 10.222.0.23 "POST /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1/action" status: 404 len: 111 microversion: 2.1 time: 0.055779 Sep 10 11:41:18.624226 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 454/889] 10.222.0.23 () {60 vars in 1279 bytes} [Sat Sep 10 11:41:18 2022] POST /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1/action => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:41:18.631819 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-422e2571-2379-464a-a052-3fd774762e12 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1957380105", "metadata": {"image_type": "test"}}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:18.634731 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-422e2571-2379-464a-a052-3fd774762e12 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Failed to fetch instance by id tempest-invalid-1194569428 {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 10 11:41:18.635402 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-422e2571-2379-464a-a052-3fd774762e12 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] HTTP exception thrown: Instance tempest-invalid-1194569428 could not be found. Sep 10 11:41:18.637573 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-422e2571-2379-464a-a052-3fd774762e12 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Request method failure captured: Sep 10 11:41:18.637573 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers/tempest-invalid-1194569428/action HTTP/1.1 Sep 10 11:41:18.637573 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:41:18.637573 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:41:18.637573 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:41:18.637573 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 112 Sep 10 11:41:18.637573 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:41:18.637573 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:41:18.637573 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:41:18.637573 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:41:18.637573 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHfEAslujILX3T9QWriOc8APXZit5soPy3wswDlRvWXPAHk63A47FFqZ_JCqxmv_ZY8It34nmY9fZzeLDepfdlHWCMzSC-lkvpzHfuts4JXASXpxBnUzfS0T18wVXL_WpZiJJSQcAZMLrbS64V0oyrXzmvnbqP18C7DQy5N9T-acvlI Sep 10 11:41:18.637573 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:41:18.637573 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:41:18.637573 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:41:18.637573 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:41:18.637573 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:41:18.637573 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:41:18.637573 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 2b9f89062992414395b683e882194649 Sep 10 11:41:18.637573 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ImagesNegativeTestJSON-1893424837 Sep 10 11:41:18.637573 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:41:18.637573 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:41:18.639646 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b9f89062992414395b683e882194649"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b9f89062992414395b683e882194649"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2b9f89062992414395b683e882194649", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2b9f89062992414395b683e882194649"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:41:18.639646 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ImagesNegativeTestJSON-1893424837 Sep 10 11:41:18.639646 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 2b9f89062992414395b683e882194649 Sep 10 11:41:18.639646 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1893424837 Sep 10 11:41:18.639646 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ImagesNegativeTestJSON-1893424837-project Sep 10 11:41:18.639646 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:41:18.639646 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:41:18.639646 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: e4d20eac7b074cc9bee7e8ffb769aa34 Sep 10 11:41:18.639646 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ImagesNegativeTestJSON-1893424837-project Sep 10 11:41:18.639646 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:41:18.639646 n-d-856895-1 devstack@n-api.service[128777]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1957380105", "metadata": {"image_type": "test"}}} Sep 10 11:41:18.639646 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:41:18.640500 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance tempest-invalid-1194569428 could not be found. Sep 10 11:41:18.640500 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'tempest-invalid-1194569428', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1957380105', 'metadata': {'image_type': 'test'}}}} Sep 10 11:41:18.640500 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:41:18.640500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:18.640500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:41:18.640500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:41:18.640500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 10 11:41:18.640500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 10 11:41:18.640500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1194569428 could not be found. Sep 10 11:41:18.640500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:18.640500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:18.640500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:18.640500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:18.640500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:18.640500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:18.640500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:41:18.640500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:41:18.640500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:41:18.640500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:41:18.640500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:41:18.641979 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:41:18.641979 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:41:18.641979 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:41:18.641979 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 10 11:41:18.641979 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 10 11:41:18.641979 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:41:18.641979 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:41:18.641979 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:41:18.641979 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:41:18.641979 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1194569428 could not be found. Sep 10 11:41:18.641979 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:18.641979 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:18.641979 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:18.641979 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:18.641979 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:18.641979 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:18.641979 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:41:18.641979 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:41:18.641979 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1194569428 could not be found. Sep 10 11:41:18.641979 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:18.643836 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-422e2571-2379-464a-a052-3fd774762e12 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Returning 404 to user: Instance tempest-invalid-1194569428 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:41:18.645633 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-422e2571-2379-464a-a052-3fd774762e12 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] 10.222.0.23 "POST /compute/v2.1/servers/tempest-invalid-1194569428/action" status: 404 len: 101 microversion: 2.1 time: 0.019556 Sep 10 11:41:18.651363 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 455/890] 10.222.0.23 () {60 vars in 1249 bytes} [Sat Sep 10 11:41:18 2022] POST /compute/v2.1/servers/tempest-invalid-1194569428/action => generated 101 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:41:18.658638 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ff32b1c7-dbe3-4919-bc5d-32da766e5b97 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1956234295"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:18.662661 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ff32b1c7-dbe3-4919-bc5d-32da766e5b97 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 10 11:41:18.663431 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-ff32b1c7-dbe3-4919-bc5d-32da766e5b97 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 10 11:41:18.665325 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ff32b1c7-dbe3-4919-bc5d-32da766e5b97 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Request method failure captured: Sep 10 11:41:18.665325 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 10 11:41:18.665325 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:41:18.665325 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:41:18.665325 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:41:18.665325 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 57 Sep 10 11:41:18.665325 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:41:18.665325 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:41:18.665325 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:41:18.665325 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:41:18.665325 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHfEAslujILX3T9QWriOc8APXZit5soPy3wswDlRvWXPAHk63A47FFqZ_JCqxmv_ZY8It34nmY9fZzeLDepfdlHWCMzSC-lkvpzHfuts4JXASXpxBnUzfS0T18wVXL_WpZiJJSQcAZMLrbS64V0oyrXzmvnbqP18C7DQy5N9T-acvlI Sep 10 11:41:18.665325 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:41:18.665325 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:41:18.665325 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:41:18.665325 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:41:18.665325 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:41:18.665325 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:41:18.665325 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 2b9f89062992414395b683e882194649 Sep 10 11:41:18.665325 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ImagesNegativeTestJSON-1893424837 Sep 10 11:41:18.665325 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:41:18.665325 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:41:18.666886 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b9f89062992414395b683e882194649"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b9f89062992414395b683e882194649"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2b9f89062992414395b683e882194649", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2b9f89062992414395b683e882194649"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:41:18.666886 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ImagesNegativeTestJSON-1893424837 Sep 10 11:41:18.666886 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 2b9f89062992414395b683e882194649 Sep 10 11:41:18.666886 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1893424837 Sep 10 11:41:18.666886 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ImagesNegativeTestJSON-1893424837-project Sep 10 11:41:18.666886 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:41:18.666886 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:41:18.666886 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: e4d20eac7b074cc9bee7e8ffb769aa34 Sep 10 11:41:18.666886 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ImagesNegativeTestJSON-1893424837-project Sep 10 11:41:18.666886 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:41:18.666886 n-d-856895-1 devstack@n-api.service[128777]: {"createImage": {"name": "tempest-test-snap-1956234295"}} Sep 10 11:41:18.666886 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:41:18.666886 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 10 11:41:18.667887 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1956234295'}}} Sep 10 11:41:18.667887 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:41:18.667887 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:18.667887 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:41:18.667887 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:41:18.667887 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 10 11:41:18.667887 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 10 11:41:18.667887 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 10 11:41:18.667887 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:18.667887 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:18.667887 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:18.667887 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:18.667887 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:18.667887 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:18.667887 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:41:18.667887 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:41:18.667887 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:41:18.667887 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:41:18.667887 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:41:18.667887 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:41:18.669879 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:41:18.669879 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:41:18.669879 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 10 11:41:18.669879 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 10 11:41:18.669879 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:41:18.669879 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:41:18.669879 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:41:18.669879 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:41:18.669879 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 10 11:41:18.669879 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:18.669879 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:18.669879 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:18.669879 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:18.669879 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:18.669879 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:18.669879 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:41:18.669879 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:41:18.669879 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 10 11:41:18.669879 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:18.671920 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ff32b1c7-dbe3-4919-bc5d-32da766e5b97 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:41:18.672939 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ff32b1c7-dbe3-4919-bc5d-32da766e5b97 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] 10.222.0.23 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.020376 Sep 10 11:41:18.678093 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 456/891] 10.222.0.23 () {60 vars in 1275 bytes} [Sat Sep 10 11:41:18 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:41:18.687743 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-28aa37fb-d0f1-4190-9bcf-00bc04631f7f tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-235951450"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:18.691096 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-28aa37fb-d0f1-4190-9bcf-00bc04631f7f tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 10 11:41:18.691842 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-28aa37fb-d0f1-4190-9bcf-00bc04631f7f tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 10 11:41:18.693559 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-28aa37fb-d0f1-4190-9bcf-00bc04631f7f tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Request method failure captured: Sep 10 11:41:18.693559 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 10 11:41:18.693559 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:41:18.693559 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:41:18.693559 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:41:18.693559 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 56 Sep 10 11:41:18.693559 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:41:18.693559 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:41:18.693559 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:41:18.693559 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:41:18.693559 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHfEAslujILX3T9QWriOc8APXZit5soPy3wswDlRvWXPAHk63A47FFqZ_JCqxmv_ZY8It34nmY9fZzeLDepfdlHWCMzSC-lkvpzHfuts4JXASXpxBnUzfS0T18wVXL_WpZiJJSQcAZMLrbS64V0oyrXzmvnbqP18C7DQy5N9T-acvlI Sep 10 11:41:18.693559 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:41:18.693559 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:41:18.693559 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:41:18.693559 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:41:18.693559 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:41:18.693559 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:41:18.693559 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 2b9f89062992414395b683e882194649 Sep 10 11:41:18.693559 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ImagesNegativeTestJSON-1893424837 Sep 10 11:41:18.693559 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:41:18.693559 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:41:18.695136 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b9f89062992414395b683e882194649"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b9f89062992414395b683e882194649"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2b9f89062992414395b683e882194649", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2b9f89062992414395b683e882194649"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:41:18.695136 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ImagesNegativeTestJSON-1893424837 Sep 10 11:41:18.695136 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 2b9f89062992414395b683e882194649 Sep 10 11:41:18.695136 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1893424837 Sep 10 11:41:18.695136 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ImagesNegativeTestJSON-1893424837-project Sep 10 11:41:18.695136 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:41:18.695136 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:41:18.695136 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: e4d20eac7b074cc9bee7e8ffb769aa34 Sep 10 11:41:18.695136 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ImagesNegativeTestJSON-1893424837-project Sep 10 11:41:18.695136 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:41:18.695136 n-d-856895-1 devstack@n-api.service[128777]: {"createImage": {"name": "tempest-test-snap-235951450"}} Sep 10 11:41:18.695136 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:41:18.695136 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 10 11:41:18.696157 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-235951450'}}} Sep 10 11:41:18.696157 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:41:18.696157 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:18.696157 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:41:18.696157 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:41:18.696157 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 10 11:41:18.696157 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 10 11:41:18.696157 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 10 11:41:18.696157 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:18.696157 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:18.696157 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:18.696157 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:18.696157 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:18.696157 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:18.696157 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:41:18.696157 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:41:18.696157 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:41:18.696157 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:41:18.696157 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:41:18.696157 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:41:18.697718 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:41:18.697718 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:41:18.697718 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 10 11:41:18.697718 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 10 11:41:18.697718 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:41:18.697718 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:41:18.697718 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:41:18.697718 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:41:18.697718 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 10 11:41:18.697718 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:18.697718 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:18.697718 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:18.697718 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:18.697718 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:18.697718 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:18.697718 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:41:18.697718 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:41:18.697718 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 10 11:41:18.697718 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:18.700537 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-28aa37fb-d0f1-4190-9bcf-00bc04631f7f tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:41:18.701613 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-28aa37fb-d0f1-4190-9bcf-00bc04631f7f tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] 10.222.0.23 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.021112 Sep 10 11:41:18.706570 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 457/892] 10.222.0.23 () {60 vars in 1281 bytes} [Sat Sep 10 11:41:18 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:41:18.712082 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2822e623-1b28-4b34-b464-23097593dbf5 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:18.715689 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2822e623-1b28-4b34-b464-23097593dbf5 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] [instance: 43593b13-c486-4931-92c8-7ec46c27f6f1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:18.724847 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2822e623-1b28-4b34-b464-23097593dbf5 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:18.725965 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2822e623-1b28-4b34-b464-23097593dbf5 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:18.726667 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2822e623-1b28-4b34-b464-23097593dbf5 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:18.727574 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2822e623-1b28-4b34-b464-23097593dbf5 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:18.728189 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2822e623-1b28-4b34-b464-23097593dbf5 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:18.728925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2822e623-1b28-4b34-b464-23097593dbf5 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:18.750736 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-2822e623-1b28-4b34-b464-23097593dbf5 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] HTTP exception thrown: Instance 43593b13-c486-4931-92c8-7ec46c27f6f1 could not be found. Sep 10 11:41:18.754991 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2822e623-1b28-4b34-b464-23097593dbf5 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Request method failure captured: Sep 10 11:41:18.754991 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1 HTTP/1.1 Sep 10 11:41:18.754991 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:41:18.754991 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:41:18.754991 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:41:18.754991 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:41:18.754991 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:41:18.754991 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:41:18.754991 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:41:18.754991 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:41:18.754991 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHfEAslujILX3T9QWriOc8APXZit5soPy3wswDlRvWXPAHk63A47FFqZ_JCqxmv_ZY8It34nmY9fZzeLDepfdlHWCMzSC-lkvpzHfuts4JXASXpxBnUzfS0T18wVXL_WpZiJJSQcAZMLrbS64V0oyrXzmvnbqP18C7DQy5N9T-acvlI Sep 10 11:41:18.754991 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:41:18.754991 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:41:18.754991 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:41:18.754991 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:41:18.754991 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:41:18.754991 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:41:18.754991 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 2b9f89062992414395b683e882194649 Sep 10 11:41:18.754991 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ImagesNegativeTestJSON-1893424837 Sep 10 11:41:18.754991 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:41:18.754991 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:41:18.756827 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b9f89062992414395b683e882194649"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b9f89062992414395b683e882194649"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2b9f89062992414395b683e882194649", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2b9f89062992414395b683e882194649"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:41:18.756827 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ImagesNegativeTestJSON-1893424837 Sep 10 11:41:18.756827 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 2b9f89062992414395b683e882194649 Sep 10 11:41:18.756827 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1893424837 Sep 10 11:41:18.756827 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ImagesNegativeTestJSON-1893424837-project Sep 10 11:41:18.756827 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:41:18.756827 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:41:18.756827 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: e4d20eac7b074cc9bee7e8ffb769aa34 Sep 10 11:41:18.756827 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ImagesNegativeTestJSON-1893424837-project Sep 10 11:41:18.756827 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:41:18.756827 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 43593b13-c486-4931-92c8-7ec46c27f6f1 could not be found. Sep 10 11:41:18.756827 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '43593b13-c486-4931-92c8-7ec46c27f6f1'} Sep 10 11:41:18.757922 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:41:18.757922 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:18.757922 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:41:18.757922 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:41:18.757922 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:41:18.757922 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:41:18.757922 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:41:18.757922 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:41:18.757922 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:41:18.757922 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:41:18.757922 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43593b13-c486-4931-92c8-7ec46c27f6f1 could not be found. Sep 10 11:41:18.757922 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:18.757922 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:18.757922 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:18.757922 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:18.757922 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:18.757922 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:18.757922 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:41:18.757922 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:41:18.757922 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:41:18.759770 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:41:18.759770 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:41:18.759770 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:41:18.759770 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:41:18.759770 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:41:18.759770 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:41:18.759770 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:41:18.759770 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:41:18.759770 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:41:18.759770 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43593b13-c486-4931-92c8-7ec46c27f6f1 could not be found. Sep 10 11:41:18.759770 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:18.759770 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:18.759770 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:18.759770 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:18.759770 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:18.759770 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:18.759770 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:41:18.759770 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:41:18.759770 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43593b13-c486-4931-92c8-7ec46c27f6f1 could not be found. Sep 10 11:41:18.759770 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:18.768216 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2822e623-1b28-4b34-b464-23097593dbf5 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Returning 404 to user: Instance 43593b13-c486-4931-92c8-7ec46c27f6f1 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:41:18.769497 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2822e623-1b28-4b34-b464-23097593dbf5 tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] 10.222.0.23 "DELETE /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1" status: 404 len: 111 microversion: 2.1 time: 0.062388 Sep 10 11:41:18.770381 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 458/893] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:41:18 2022] DELETE /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:41:18.780005 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-99f8bfde-c331-40c4-98b7-c18f928a796d tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:18.781097 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-99f8bfde-c331-40c4-98b7-c18f928a796d tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] [instance: 43593b13-c486-4931-92c8-7ec46c27f6f1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:18.787215 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99f8bfde-c331-40c4-98b7-c18f928a796d tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:18.787940 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99f8bfde-c331-40c4-98b7-c18f928a796d tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:18.788555 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99f8bfde-c331-40c4-98b7-c18f928a796d tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:18.789430 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99f8bfde-c331-40c4-98b7-c18f928a796d tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:18.790116 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99f8bfde-c331-40c4-98b7-c18f928a796d tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:18.790638 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99f8bfde-c331-40c4-98b7-c18f928a796d tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:18.807960 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-99f8bfde-c331-40c4-98b7-c18f928a796d tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] HTTP exception thrown: Instance 43593b13-c486-4931-92c8-7ec46c27f6f1 could not be found. Sep 10 11:41:18.809792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-99f8bfde-c331-40c4-98b7-c18f928a796d tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Request method failure captured: Sep 10 11:41:18.809792 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1 HTTP/1.1 Sep 10 11:41:18.809792 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:41:18.809792 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:41:18.809792 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:41:18.809792 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:41:18.809792 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:41:18.809792 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:41:18.809792 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:41:18.809792 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:41:18.809792 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHfEAslujILX3T9QWriOc8APXZit5soPy3wswDlRvWXPAHk63A47FFqZ_JCqxmv_ZY8It34nmY9fZzeLDepfdlHWCMzSC-lkvpzHfuts4JXASXpxBnUzfS0T18wVXL_WpZiJJSQcAZMLrbS64V0oyrXzmvnbqP18C7DQy5N9T-acvlI Sep 10 11:41:18.809792 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:41:18.809792 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:41:18.809792 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:41:18.809792 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:41:18.809792 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:41:18.809792 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:41:18.809792 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 2b9f89062992414395b683e882194649 Sep 10 11:41:18.809792 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ImagesNegativeTestJSON-1893424837 Sep 10 11:41:18.809792 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:41:18.809792 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:41:18.811079 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b9f89062992414395b683e882194649"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2b9f89062992414395b683e882194649"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2b9f89062992414395b683e882194649", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2b9f89062992414395b683e882194649"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:41:18.811079 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ImagesNegativeTestJSON-1893424837 Sep 10 11:41:18.811079 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 2b9f89062992414395b683e882194649 Sep 10 11:41:18.811079 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1893424837 Sep 10 11:41:18.811079 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ImagesNegativeTestJSON-1893424837-project Sep 10 11:41:18.811079 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:41:18.811079 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:41:18.811079 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: e4d20eac7b074cc9bee7e8ffb769aa34 Sep 10 11:41:18.811079 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ImagesNegativeTestJSON-1893424837-project Sep 10 11:41:18.811079 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:41:18.811079 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 43593b13-c486-4931-92c8-7ec46c27f6f1 could not be found. Sep 10 11:41:18.811079 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '43593b13-c486-4931-92c8-7ec46c27f6f1'} Sep 10 11:41:18.811832 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:41:18.811832 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:18.811832 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:41:18.811832 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:41:18.811832 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:41:18.811832 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:41:18.811832 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:41:18.811832 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:41:18.811832 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:41:18.811832 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:41:18.811832 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43593b13-c486-4931-92c8-7ec46c27f6f1 could not be found. Sep 10 11:41:18.811832 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:18.811832 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:18.811832 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:18.811832 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:18.811832 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:18.811832 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:18.811832 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:41:18.811832 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:41:18.811832 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:41:18.813976 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:41:18.813976 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:41:18.813976 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:41:18.813976 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:41:18.813976 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:41:18.813976 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:41:18.813976 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:41:18.813976 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43593b13-c486-4931-92c8-7ec46c27f6f1 could not be found. Sep 10 11:41:18.813976 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:18.813976 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:18.813976 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:18.813976 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:18.813976 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:18.813976 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:18.813976 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:41:18.813976 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:41:18.813976 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43593b13-c486-4931-92c8-7ec46c27f6f1 could not be found. Sep 10 11:41:18.813976 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:18.820207 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-99f8bfde-c331-40c4-98b7-c18f928a796d tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] Returning 404 to user: Instance 43593b13-c486-4931-92c8-7ec46c27f6f1 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:41:18.821430 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-99f8bfde-c331-40c4-98b7-c18f928a796d tempest-ImagesNegativeTestJSON-1893424837 tempest-ImagesNegativeTestJSON-1893424837-project] 10.222.0.23 "GET /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1" status: 404 len: 111 microversion: 2.1 time: 0.046689 Sep 10 11:41:18.827329 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 459/894] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:18 2022] GET /compute/v2.1/servers/43593b13-c486-4931-92c8-7ec46c27f6f1 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 11:41:18.929453 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-1e8d3027-d549-4ad5-9e8d-de3950267b73 req-d5d27ed1-aff7-453a-b645-55868dd07917 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43593b13-c486-4931-92c8-7ec46c27f6f1", "name": "network-vif-deleted", "tag": "bf9bc2c7-0d4f-4718-afea-ea1a5bf9ee42"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:18.941056 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-1e8d3027-d549-4ad5-9e8d-de3950267b73 req-d5d27ed1-aff7-453a-b645-55868dd07917 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:18.942770 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-1e8d3027-d549-4ad5-9e8d-de3950267b73 req-d5d27ed1-aff7-453a-b645-55868dd07917 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:18.943268 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-1e8d3027-d549-4ad5-9e8d-de3950267b73 req-d5d27ed1-aff7-453a-b645-55868dd07917 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:18.959111 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-1e8d3027-d549-4ad5-9e8d-de3950267b73 req-d5d27ed1-aff7-453a-b645-55868dd07917 service nova] Creating event network-vif-deleted:bf9bc2c7-0d4f-4718-afea-ea1a5bf9ee42 for instance 43593b13-c486-4931-92c8-7ec46c27f6f1 on n-h2-856895-1 Sep 10 11:41:18.965379 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-1e8d3027-d549-4ad5-9e8d-de3950267b73 req-d5d27ed1-aff7-453a-b645-55868dd07917 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040421 Sep 10 11:41:18.973749 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 460/895] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:41:19.066955 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-e9dd9de9-4fde-4870-b1f7-996653149d33 req-2a9883ae-4e57-4c7d-8bea-35ba159bff19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c806b91-1302-494f-b4eb-a0b7ba04baf4", "name": "network-vif-unplugged", "status": "completed", "tag": "3488be85-30de-46d4-a138-f4f55f4c37ce"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:19.083015 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e9dd9de9-4fde-4870-b1f7-996653149d33 req-2a9883ae-4e57-4c7d-8bea-35ba159bff19 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:19.084269 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e9dd9de9-4fde-4870-b1f7-996653149d33 req-2a9883ae-4e57-4c7d-8bea-35ba159bff19 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:19.085437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e9dd9de9-4fde-4870-b1f7-996653149d33 req-2a9883ae-4e57-4c7d-8bea-35ba159bff19 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:19.113162 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-e9dd9de9-4fde-4870-b1f7-996653149d33 req-2a9883ae-4e57-4c7d-8bea-35ba159bff19 service nova] Creating event network-vif-unplugged:3488be85-30de-46d4-a138-f4f55f4c37ce for instance 4c806b91-1302-494f-b4eb-a0b7ba04baf4 on n-h2-856895-1 Sep 10 11:41:19.120976 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-e9dd9de9-4fde-4870-b1f7-996653149d33 req-2a9883ae-4e57-4c7d-8bea-35ba159bff19 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065178 Sep 10 11:41:19.122045 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 461/896] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:41:19.132282 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-95cabf6d-35ee-40bf-94d0-909f3dc39e7b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:19.133149 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-95cabf6d-35ee-40bf-94d0-909f3dc39e7b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: 3bb65ae3-44e9-4803-b00c-132423b2fd8d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:19.152726 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-95cabf6d-35ee-40bf-94d0-909f3dc39e7b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:19.159102 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-95cabf6d-35ee-40bf-94d0-909f3dc39e7b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:19.159710 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-95cabf6d-35ee-40bf-94d0-909f3dc39e7b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:19.162298 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-95cabf6d-35ee-40bf-94d0-909f3dc39e7b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:19.163177 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-95cabf6d-35ee-40bf-94d0-909f3dc39e7b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:19.164214 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-95cabf6d-35ee-40bf-94d0-909f3dc39e7b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:19.199400 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e9c18469-fc62-4f8a-9c19-a8d62e9be397 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "DELETE /compute/v2.1/images/84d5e2a0-f60b-46aa-8df1-91f5ffdf5351" status: 204 len: 0 microversion: 2.1 time: 0.820566 Sep 10 11:41:19.201551 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 436/897] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:18 2022] DELETE /compute/v2.1/images/84d5e2a0-f60b-46aa-8df1-91f5ffdf5351 => generated 0 bytes in 824 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:41:19.209285 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-338a38ae-1700-4e51-a04a-842b83353a65 tempest-ServersWithSpecificFlavorTestJSON-657795576 tempest-ServersWithSpecificFlavorTestJSON-657795576-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:19.210393 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-95cabf6d-35ee-40bf-94d0-909f3dc39e7b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] HTTP exception thrown: Instance 3bb65ae3-44e9-4803-b00c-132423b2fd8d could not be found. Sep 10 11:41:19.219254 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-95cabf6d-35ee-40bf-94d0-909f3dc39e7b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Request method failure captured: Sep 10 11:41:19.219254 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d HTTP/1.1 Sep 10 11:41:19.219254 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:41:19.219254 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:41:19.219254 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:41:19.219254 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:41:19.219254 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:41:19.219254 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:41:19.219254 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:41:19.219254 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:41:19.219254 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHeSNW7_f7LDDJrVeYQQbVmE7FX0ZnkA6aK_zgWBduWc9TcLvMfRz0s6RZ72ejJdgD5a9tTzrc_f7sx7Q5c4egckCAwk6fuoCPuUKQ6-KujA215bl8IZ1ir0CX1amIit8NWRLTdHZg7dCXx2jwTwTLfYOzf6xDSAAMwU9Bu1o4JscYc Sep 10 11:41:19.219254 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:41:19.219254 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:41:19.219254 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:41:19.219254 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:41:19.219254 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:41:19.219254 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:41:19.219254 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: b23bf60ed08b4adca30b90ecfb9e540d Sep 10 11:41:19.219254 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-LiveMigrationNegativeTest-1921585268 Sep 10 11:41:19.219254 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:41:19.219254 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:41:19.221054 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b23bf60ed08b4adca30b90ecfb9e540d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b23bf60ed08b4adca30b90ecfb9e540d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b23bf60ed08b4adca30b90ecfb9e540d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b23bf60ed08b4adca30b90ecfb9e540d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:41:19.221054 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-LiveMigrationNegativeTest-1921585268 Sep 10 11:41:19.221054 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: b23bf60ed08b4adca30b90ecfb9e540d Sep 10 11:41:19.221054 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1921585268 Sep 10 11:41:19.221054 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-LiveMigrationNegativeTest-1921585268-project Sep 10 11:41:19.221054 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:41:19.221054 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:41:19.221054 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 73f8ba457fba4e67a97dd156c2bfaa0f Sep 10 11:41:19.221054 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-LiveMigrationNegativeTest-1921585268-project Sep 10 11:41:19.221054 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:41:19.221054 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 3bb65ae3-44e9-4803-b00c-132423b2fd8d could not be found. Sep 10 11:41:19.221054 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '3bb65ae3-44e9-4803-b00c-132423b2fd8d'} Sep 10 11:41:19.221985 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:41:19.221985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:19.221985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:41:19.221985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:41:19.221985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:41:19.221985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:41:19.221985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:41:19.221985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:41:19.221985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:41:19.221985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:41:19.221985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bb65ae3-44e9-4803-b00c-132423b2fd8d could not be found. Sep 10 11:41:19.221985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:19.221985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:19.221985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:19.221985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:19.221985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:19.221985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:19.221985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:41:19.221985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:41:19.221985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:41:19.223441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:41:19.223441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:41:19.223441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:41:19.223441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:41:19.223441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:41:19.223441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:41:19.223441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:41:19.223441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bb65ae3-44e9-4803-b00c-132423b2fd8d could not be found. Sep 10 11:41:19.223441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:19.223441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:19.223441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:19.223441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:19.223441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:19.223441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:19.223441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:41:19.223441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:41:19.223441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bb65ae3-44e9-4803-b00c-132423b2fd8d could not be found. Sep 10 11:41:19.223441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:19.224730 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-95cabf6d-35ee-40bf-94d0-909f3dc39e7b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Returning 404 to user: Instance 3bb65ae3-44e9-4803-b00c-132423b2fd8d could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:41:19.224730 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-95cabf6d-35ee-40bf-94d0-909f3dc39e7b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d" status: 404 len: 111 microversion: 2.1 time: 0.098099 Sep 10 11:41:19.225816 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 462/898] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:19 2022] GET /compute/v2.1/servers/3bb65ae3-44e9-4803-b00c-132423b2fd8d => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:41:19.230750 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-74ed994c-0d90-4007-a237-ef799c12d660 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '.version_select at 0x7f40734af820>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:19.237354 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-338a38ae-1700-4e51-a04a-842b83353a65 tempest-ServersWithSpecificFlavorTestJSON-657795576 tempest-ServersWithSpecificFlavorTestJSON-657795576-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/2057106990" status: 202 len: 0 microversion: 2.1 time: 0.034492 Sep 10 11:41:19.238258 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 437/899] 10.222.0.23 () {58 vars in 1161 bytes} [Sat Sep 10 11:41:19 2022] DELETE /compute/v2.1/flavors/2057106990 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:41:19.244452 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d80e4efc-4b8a-4a6b-b8c2-7ee99238baa8 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:19.245524 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d80e4efc-4b8a-4a6b-b8c2-7ee99238baa8 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: c0cd6b34-210f-4113-b870-f402c588801c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:19.252074 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d80e4efc-4b8a-4a6b-b8c2-7ee99238baa8 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:19.252946 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d80e4efc-4b8a-4a6b-b8c2-7ee99238baa8 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:19.253629 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d80e4efc-4b8a-4a6b-b8c2-7ee99238baa8 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:19.254639 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d80e4efc-4b8a-4a6b-b8c2-7ee99238baa8 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:19.256710 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d80e4efc-4b8a-4a6b-b8c2-7ee99238baa8 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:19.257357 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d80e4efc-4b8a-4a6b-b8c2-7ee99238baa8 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:19.289526 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d80e4efc-4b8a-4a6b-b8c2-7ee99238baa8 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: c0cd6b34-210f-4113-b870-f402c588801c] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:41:19.315501 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-74ed994c-0d90-4007-a237-ef799c12d660 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] HTTP exception thrown: Image not found. Sep 10 11:41:19.343641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-74ed994c-0d90-4007-a237-ef799c12d660 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Request method failure captured: Sep 10 11:41:19.343641 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62 HTTP/1.1 Sep 10 11:41:19.343641 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:41:19.343641 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:41:19.343641 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:41:19.343641 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:41:19.343641 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:41:19.343641 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:41:19.343641 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:41:19.343641 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:41:19.343641 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHeNZh0QsKAWCri91V-XMNBwVyxCngmCDeOu57JghGMX0SdTAhjYXC-vR2THqetjhfs7l1FgyGX-IA3A_GwYS8xxZndnjNDFjnU2duWH_9QvpHXc2SSZe4-4m4gx_aWPfm1_tQNvJ2Qck3faUpPuLXwa9CvGlianXQAQkKT7n56Ekc0 Sep 10 11:41:19.343641 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:41:19.343641 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:41:19.343641 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:41:19.343641 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:41:19.343641 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:41:19.343641 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:41:19.343641 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: d5765e50afa045569700eab4616a6a43 Sep 10 11:41:19.343641 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ImagesOneServerTestJSON-621761848 Sep 10 11:41:19.343641 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:41:19.343641 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:41:19.345315 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d5765e50afa045569700eab4616a6a43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d5765e50afa045569700eab4616a6a43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d5765e50afa045569700eab4616a6a43", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d5765e50afa045569700eab4616a6a43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:41:19.345315 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ImagesOneServerTestJSON-621761848 Sep 10 11:41:19.345315 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: d5765e50afa045569700eab4616a6a43 Sep 10 11:41:19.345315 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-621761848 Sep 10 11:41:19.345315 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ImagesOneServerTestJSON-621761848-project Sep 10 11:41:19.345315 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:41:19.345315 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:41:19.345315 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: cf661b110ecc4f36b795a980d29f312a Sep 10 11:41:19.345315 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ImagesOneServerTestJSON-621761848-project Sep 10 11:41:19.345315 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:41:19.345315 n-d-856895-1 devstack@n-api.service[128777]: exception: Image not found. Sep 10 11:41:19.345315 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '65eff672-4353-4584-b751-ee21b0a4af62'} Sep 10 11:41:19.345315 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:41:19.346316 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:19.346316 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 10 11:41:19.346316 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 10 11:41:19.346316 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 11:41:19.346316 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 11:41:19.346316 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 11:41:19.346316 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 11:41:19.346316 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 10 11:41:19.346316 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 10 11:41:19.346316 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 10 11:41:19.346316 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 10 11:41:19.346316 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 11:41:19.346316 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 11:41:19.346316 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 11:41:19.346316 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 11:41:19.346316 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 65eff672-4353-4584-b751-ee21b0a4af62 to delete Sep 10 11:41:19.346316 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:19.346316 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:19.346316 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:19.347747 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:19.347747 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 10 11:41:19.347747 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 10 11:41:19.347747 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 10 11:41:19.347747 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 10 11:41:19.347747 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 10 11:41:19.347747 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 10 11:41:19.347747 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 65eff672-4353-4584-b751-ee21b0a4af62 could not be found. Sep 10 11:41:19.347747 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:19.347747 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:19.347747 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:19.347747 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:19.347747 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:19.347747 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:19.347747 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:41:19.347747 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:41:19.347747 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:41:19.347747 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:41:19.347747 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:41:19.347747 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:41:19.349113 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 10 11:41:19.349113 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 11:41:19.349113 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 11:41:19.349113 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:19.349113 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:19.349113 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:19.349113 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:19.349113 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:19.349113 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:19.349113 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:41:19.349113 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:41:19.349113 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 11:41:19.349113 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:19.349113 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-74ed994c-0d90-4007-a237-ef799c12d660 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Returning 404 to user: Image not found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:41:19.349113 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-74ed994c-0d90-4007-a237-ef799c12d660 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "DELETE /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62" status: 404 len: 62 microversion: 2.1 time: 0.118842 Sep 10 11:41:19.350664 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 463/900] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:19 2022] DELETE /compute/v2.1/images/65eff672-4353-4584-b751-ee21b0a4af62 => generated 62 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:41:19.352503 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5e15fbf0-c13f-46d5-a828-b4a9db102114 tempest-ServersWithSpecificFlavorTestJSON-657795576 tempest-ServersWithSpecificFlavorTestJSON-657795576-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:19.409614 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5e15fbf0-c13f-46d5-a828-b4a9db102114 tempest-ServersWithSpecificFlavorTestJSON-657795576 tempest-ServersWithSpecificFlavorTestJSON-657795576-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5403 microversion: 2.1 time: 0.060553 Sep 10 11:41:19.411569 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 464/901] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:41:19 2022] GET /compute/v2.1/flavors/detail => generated 5403 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:19.411889 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d80e4efc-4b8a-4a6b-b8c2-7ee99238baa8 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c" status: 204 len: 0 microversion: 2.1 time: 0.172057 Sep 10 11:41:19.417024 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 438/902] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:41:19 2022] DELETE /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:41:19.430386 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7d74581f-1957-4b0a-becf-057fea67a41f tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:19.431833 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7d74581f-1957-4b0a-becf-057fea67a41f tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: c0cd6b34-210f-4113-b870-f402c588801c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:19.437333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8e7971ef-3c94-4410-a073-8defd541f016 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:19.437867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8e7971ef-3c94-4410-a073-8defd541f016 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] [instance: 4c806b91-1302-494f-b4eb-a0b7ba04baf4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:19.442093 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d74581f-1957-4b0a-becf-057fea67a41f tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:19.443901 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d74581f-1957-4b0a-becf-057fea67a41f tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:19.444358 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d74581f-1957-4b0a-becf-057fea67a41f tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:19.445096 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d74581f-1957-4b0a-becf-057fea67a41f tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:19.445398 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:41:19.445584 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d74581f-1957-4b0a-becf-057fea67a41f tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:19.445987 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d74581f-1957-4b0a-becf-057fea67a41f tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:19.455089 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e7971ef-3c94-4410-a073-8defd541f016 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:19.459362 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e7971ef-3c94-4410-a073-8defd541f016 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:19.461738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e7971ef-3c94-4410-a073-8defd541f016 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:19.463863 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e7971ef-3c94-4410-a073-8defd541f016 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:19.466293 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e7971ef-3c94-4410-a073-8defd541f016 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:19.467839 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e7971ef-3c94-4410-a073-8defd541f016 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:19.515699 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8e7971ef-3c94-4410-a073-8defd541f016 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] [instance: 4c806b91-1302-494f-b4eb-a0b7ba04baf4] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:41:19.602947 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8e7971ef-3c94-4410-a073-8defd541f016 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4c806b91-1302-494f-b4eb-a0b7ba04baf4" status: 204 len: 0 microversion: 2.1 time: 0.189322 Sep 10 11:41:19.603697 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 465/903] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:41:19 2022] DELETE /compute/v2.1/servers/4c806b91-1302-494f-b4eb-a0b7ba04baf4 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:41:19.609352 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8ec186fb-4109-4f36-bd2a-b42b3daa3dcb tempest-ServersWithSpecificFlavorTestJSON-657795576 tempest-ServersWithSpecificFlavorTestJSON-657795576-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:19.630936 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8ec186fb-4109-4f36-bd2a-b42b3daa3dcb tempest-ServersWithSpecificFlavorTestJSON-657795576 tempest-ServersWithSpecificFlavorTestJSON-657795576-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/435889313" status: 202 len: 0 microversion: 2.1 time: 0.025817 Sep 10 11:41:19.631636 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 466/904] 10.222.0.23 () {58 vars in 1158 bytes} [Sat Sep 10 11:41:19 2022] DELETE /compute/v2.1/flavors/435889313 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:41:19.637300 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c97b10c0-8fec-4b67-a3cf-2d9bf41ffc15 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:19.638687 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c97b10c0-8fec-4b67-a3cf-2d9bf41ffc15 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: f600488a-7c52-4a96-9375-2723bf42cf83] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:19.644699 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c97b10c0-8fec-4b67-a3cf-2d9bf41ffc15 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:19.645189 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c97b10c0-8fec-4b67-a3cf-2d9bf41ffc15 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:19.645618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c97b10c0-8fec-4b67-a3cf-2d9bf41ffc15 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:19.646528 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c97b10c0-8fec-4b67-a3cf-2d9bf41ffc15 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:19.646980 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c97b10c0-8fec-4b67-a3cf-2d9bf41ffc15 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:19.647615 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c97b10c0-8fec-4b67-a3cf-2d9bf41ffc15 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:19.715275 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:41:19.812510 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7d74581f-1957-4b0a-becf-057fea67a41f tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:19.827979 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7d74581f-1957-4b0a-becf-057fea67a41f tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c" status: 200 len: 1474 microversion: 2.1 time: 0.399182 Sep 10 11:41:19.827979 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 439/905] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:19 2022] GET /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c => generated 1474 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:19.844270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6ed66a16-2db5-4587-8280-0a39005ec100 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:19.845306 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6ed66a16-2db5-4587-8280-0a39005ec100 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] [instance: 4c806b91-1302-494f-b4eb-a0b7ba04baf4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:19.852427 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6ed66a16-2db5-4587-8280-0a39005ec100 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:19.853227 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6ed66a16-2db5-4587-8280-0a39005ec100 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:19.853834 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6ed66a16-2db5-4587-8280-0a39005ec100 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:19.854997 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6ed66a16-2db5-4587-8280-0a39005ec100 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:19.855773 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6ed66a16-2db5-4587-8280-0a39005ec100 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:19.856355 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6ed66a16-2db5-4587-8280-0a39005ec100 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:20.017757 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c97b10c0-8fec-4b67-a3cf-2d9bf41ffc15 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:20.034850 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c97b10c0-8fec-4b67-a3cf-2d9bf41ffc15 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:20.037114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c97b10c0-8fec-4b67-a3cf-2d9bf41ffc15 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:20.038546 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c97b10c0-8fec-4b67-a3cf-2d9bf41ffc15 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83" status: 200 len: 1554 microversion: 2.25 time: 0.405976 Sep 10 11:41:20.039460 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 467/906] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:19 2022] GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83 => generated 1554 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:20.044272 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-817b4408-b3e8-4457-a9aa-ff0ac6226da1 tempest-ServersWithSpecificFlavorTestJSON-657795576 tempest-ServersWithSpecificFlavorTestJSON-657795576-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:20.077264 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-817b4408-b3e8-4457-a9aa-ff0ac6226da1 tempest-ServersWithSpecificFlavorTestJSON-657795576 tempest-ServersWithSpecificFlavorTestJSON-657795576-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036291 Sep 10 11:41:20.087442 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 468/907] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:41:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:20.087442 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d2b8a686-2b7b-4127-9011-887efb8e6b5a tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-441679333", "imageRef": "98b9382a-f5f3-409c-a32d-669f5695c02a", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "93d390ea-35b7-440b-b9f8-496509428757"}], "security_groups": [{"name": "tempest-securitygroup--2122716369"}], "key_name": "tempest-keypair-1683082546", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:20.164935 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6ed66a16-2db5-4587-8280-0a39005ec100 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf661b110ecc4f36b795a980d29f312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5765e50afa045569700eab4616a6a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:20.189568 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6ed66a16-2db5-4587-8280-0a39005ec100 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/servers/4c806b91-1302-494f-b4eb-a0b7ba04baf4" status: 200 len: 1472 microversion: 2.1 time: 0.365721 Sep 10 11:41:20.190984 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 440/908] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:19 2022] GET /compute/v2.1/servers/4c806b91-1302-494f-b4eb-a0b7ba04baf4 => generated 1472 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:20.195749 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9835b9be-f6e7-417a-b2f7-19b4affb0913 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Calling method '.version_select at 0x7f4073ffcca0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:20.199598 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9835b9be-f6e7-417a-b2f7-19b4affb0913 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:20.201214 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9835b9be-f6e7-417a-b2f7-19b4affb0913 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:20.202663 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9835b9be-f6e7-417a-b2f7-19b4affb0913 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:20.214903 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9835b9be-f6e7-417a-b2f7-19b4affb0913 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 1520 microversion: 2.25 time: 0.022624 Sep 10 11:41:20.215592 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 441/909] 10.222.0.23 () {60 vars in 1184 bytes} [Sat Sep 10 11:41:20 2022] GET /compute/v2.1/os-migrations => generated 1520 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:20.221304 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d4de99ed-b5ea-4e2b-96b7-2637dc1069a0 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:20.221805 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d4de99ed-b5ea-4e2b-96b7-2637dc1069a0 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:20.228076 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d4de99ed-b5ea-4e2b-96b7-2637dc1069a0 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:20.228569 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d4de99ed-b5ea-4e2b-96b7-2637dc1069a0 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:20.229005 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d4de99ed-b5ea-4e2b-96b7-2637dc1069a0 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:20.229703 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d4de99ed-b5ea-4e2b-96b7-2637dc1069a0 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:20.230341 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d4de99ed-b5ea-4e2b-96b7-2637dc1069a0 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:20.230772 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d4de99ed-b5ea-4e2b-96b7-2637dc1069a0 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:20.245091 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-d4de99ed-b5ea-4e2b-96b7-2637dc1069a0 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] HTTP exception thrown: Instance 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 could not be found. Sep 10 11:41:20.246794 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d4de99ed-b5ea-4e2b-96b7-2637dc1069a0 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Request method failure captured: Sep 10 11:41:20.246794 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 HTTP/1.1 Sep 10 11:41:20.246794 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:41:20.246794 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:41:20.246794 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:41:20.246794 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:41:20.246794 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:41:20.246794 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:41:20.246794 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:41:20.246794 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:41:20.246794 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHcU1B0Vnhoehy7U99Bxqdtr_k8hA2h6jGyomYMoHKCCpTmmpWUZgxPrvlbChKM3TJJpNBQrlI9zcMNlrrPIEYh7sOPNHkSMpG60Nh78QQWEM1YDlbSgieGZGdi-iF-93cnaXZSf9UJNauyZCqYMeb-4VSMvGxkikKg-5Wl9OARowM8 Sep 10 11:41:20.246794 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:41:20.246794 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:41:20.246794 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:41:20.246794 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:41:20.246794 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:41:20.246794 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:41:20.246794 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 2c44e3e2920e48868e1c05f70b1d7639 Sep 10 11:41:20.246794 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1547806860 Sep 10 11:41:20.246794 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:41:20.246794 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:41:20.248964 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c44e3e2920e48868e1c05f70b1d7639"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c44e3e2920e48868e1c05f70b1d7639"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2c44e3e2920e48868e1c05f70b1d7639", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2c44e3e2920e48868e1c05f70b1d7639"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:41:20.248964 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1547806860 Sep 10 11:41:20.248964 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 2c44e3e2920e48868e1c05f70b1d7639 Sep 10 11:41:20.248964 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1547806860 Sep 10 11:41:20.248964 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1547806860-project Sep 10 11:41:20.248964 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:41:20.248964 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:41:20.248964 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: b64e2df030a745de8ae7eda29d2ac30a Sep 10 11:41:20.248964 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1547806860-project Sep 10 11:41:20.248964 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:41:20.248964 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 could not be found. Sep 10 11:41:20.248964 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7'} Sep 10 11:41:20.249845 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:41:20.249845 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:20.249845 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:41:20.249845 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:41:20.249845 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:41:20.249845 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:41:20.249845 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:41:20.249845 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:41:20.249845 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:41:20.249845 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:41:20.249845 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 could not be found. Sep 10 11:41:20.249845 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:20.249845 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:20.249845 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:20.249845 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:20.249845 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:20.249845 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:20.249845 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:41:20.249845 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:41:20.249845 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:41:20.251152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:41:20.251152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:41:20.251152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:41:20.251152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:41:20.251152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:41:20.251152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:41:20.251152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:41:20.251152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:41:20.251152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:41:20.251152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 could not be found. Sep 10 11:41:20.251152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:20.251152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:20.251152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:20.251152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:20.251152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:20.251152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:20.251152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:41:20.251152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:41:20.251152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 could not be found. Sep 10 11:41:20.251152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:20.252859 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d4de99ed-b5ea-4e2b-96b7-2637dc1069a0 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Returning 404 to user: Instance 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:41:20.252859 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d4de99ed-b5ea-4e2b-96b7-2637dc1069a0 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7" status: 404 len: 111 microversion: 2.1 time: 0.031498 Sep 10 11:41:20.252859 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 442/910] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:41:20 2022] DELETE /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:41:20.254288 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a11ef36d-1422-49ea-aa4c-878852e1352c tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:20.254905 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a11ef36d-1422-49ea-aa4c-878852e1352c tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] [instance: f600488a-7c52-4a96-9375-2723bf42cf83] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:20.261006 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a11ef36d-1422-49ea-aa4c-878852e1352c tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:20.261509 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a11ef36d-1422-49ea-aa4c-878852e1352c tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:20.262131 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a11ef36d-1422-49ea-aa4c-878852e1352c tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:20.263629 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a11ef36d-1422-49ea-aa4c-878852e1352c tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:20.264347 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a11ef36d-1422-49ea-aa4c-878852e1352c tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:20.264975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a11ef36d-1422-49ea-aa4c-878852e1352c tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:20.318669 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-d2b8a686-2b7b-4127-9011-887efb8e6b5a tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] validate_networks() for [('93d390ea-35b7-440b-b9f8-496509428757', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:41:20.601681 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-a11ef36d-1422-49ea-aa4c-878852e1352c tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lazy-loading 'services' on Instance uuid f600488a-7c52-4a96-9375-2723bf42cf83 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:41:20.622852 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a11ef36d-1422-49ea-aa4c-878852e1352c tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83" status: 200 len: 2044 microversion: 2.25 time: 0.371207 Sep 10 11:41:20.623842 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 443/911] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:20 2022] GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83 => generated 2044 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:20.630953 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9737e91f-3d93-4d40-9523-59f2e3ca7fc8 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:20.631684 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9737e91f-3d93-4d40-9523-59f2e3ca7fc8 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:20.640497 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9737e91f-3d93-4d40-9523-59f2e3ca7fc8 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:20.642220 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9737e91f-3d93-4d40-9523-59f2e3ca7fc8 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:20.642845 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9737e91f-3d93-4d40-9523-59f2e3ca7fc8 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:20.643764 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9737e91f-3d93-4d40-9523-59f2e3ca7fc8 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:20.645707 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9737e91f-3d93-4d40-9523-59f2e3ca7fc8 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:20.646300 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9737e91f-3d93-4d40-9523-59f2e3ca7fc8 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:20.680385 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-9737e91f-3d93-4d40-9523-59f2e3ca7fc8 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] HTTP exception thrown: Instance 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 could not be found. Sep 10 11:41:20.682367 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9737e91f-3d93-4d40-9523-59f2e3ca7fc8 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Request method failure captured: Sep 10 11:41:20.682367 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 HTTP/1.1 Sep 10 11:41:20.682367 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:41:20.682367 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:41:20.682367 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:41:20.682367 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:41:20.682367 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:41:20.682367 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:41:20.682367 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:41:20.682367 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:41:20.682367 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHcU1B0Vnhoehy7U99Bxqdtr_k8hA2h6jGyomYMoHKCCpTmmpWUZgxPrvlbChKM3TJJpNBQrlI9zcMNlrrPIEYh7sOPNHkSMpG60Nh78QQWEM1YDlbSgieGZGdi-iF-93cnaXZSf9UJNauyZCqYMeb-4VSMvGxkikKg-5Wl9OARowM8 Sep 10 11:41:20.682367 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:41:20.682367 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:41:20.682367 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:41:20.682367 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:41:20.682367 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:41:20.682367 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:41:20.682367 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 2c44e3e2920e48868e1c05f70b1d7639 Sep 10 11:41:20.682367 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1547806860 Sep 10 11:41:20.682367 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:41:20.682367 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:41:20.684286 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c44e3e2920e48868e1c05f70b1d7639"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c44e3e2920e48868e1c05f70b1d7639"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2c44e3e2920e48868e1c05f70b1d7639", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2c44e3e2920e48868e1c05f70b1d7639"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:41:20.684286 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1547806860 Sep 10 11:41:20.684286 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 2c44e3e2920e48868e1c05f70b1d7639 Sep 10 11:41:20.684286 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1547806860 Sep 10 11:41:20.684286 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1547806860-project Sep 10 11:41:20.684286 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:41:20.684286 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:41:20.684286 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: b64e2df030a745de8ae7eda29d2ac30a Sep 10 11:41:20.684286 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1547806860-project Sep 10 11:41:20.684286 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:41:20.684286 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 could not be found. Sep 10 11:41:20.684286 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7'} Sep 10 11:41:20.686001 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:41:20.686001 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:20.686001 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:41:20.686001 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:41:20.686001 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:41:20.686001 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:41:20.686001 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:41:20.686001 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:41:20.686001 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:41:20.686001 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:41:20.686001 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 could not be found. Sep 10 11:41:20.686001 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:20.686001 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:20.686001 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:20.686001 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:20.686001 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:20.686001 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:20.686001 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:41:20.686001 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:41:20.686001 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:41:20.687441 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:41:20.687441 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:41:20.687441 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:41:20.687441 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:41:20.687441 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:41:20.687441 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:41:20.687441 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:41:20.687441 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 could not be found. Sep 10 11:41:20.687441 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:20.687441 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:20.687441 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:20.687441 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:20.687441 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:20.687441 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:20.687441 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:41:20.687441 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:41:20.687441 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 could not be found. Sep 10 11:41:20.687441 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:20.691645 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9737e91f-3d93-4d40-9523-59f2e3ca7fc8 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Returning 404 to user: Instance 6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:41:20.693586 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9737e91f-3d93-4d40-9523-59f2e3ca7fc8 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "GET /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7" status: 404 len: 111 microversion: 2.1 time: 0.067635 Sep 10 11:41:20.701649 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 444/912] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:20 2022] GET /compute/v2.1/servers/6ac87002-73f3-4b5f-9a5f-3812cb4e5ad7 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:41:20.710273 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bbe4ae23-7f2e-45ac-80af-b46f38281213 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:20.711541 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bbe4ae23-7f2e-45ac-80af-b46f38281213 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: cd42bf97-63e2-4a4b-a5db-d747a478dcbd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:20.719918 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bbe4ae23-7f2e-45ac-80af-b46f38281213 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:20.720699 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bbe4ae23-7f2e-45ac-80af-b46f38281213 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:20.722136 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bbe4ae23-7f2e-45ac-80af-b46f38281213 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:20.734211 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bbe4ae23-7f2e-45ac-80af-b46f38281213 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:20.735735 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bbe4ae23-7f2e-45ac-80af-b46f38281213 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:20.736386 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bbe4ae23-7f2e-45ac-80af-b46f38281213 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:20.759650 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-bbe4ae23-7f2e-45ac-80af-b46f38281213 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] HTTP exception thrown: Instance cd42bf97-63e2-4a4b-a5db-d747a478dcbd could not be found. Sep 10 11:41:20.764859 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bbe4ae23-7f2e-45ac-80af-b46f38281213 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Request method failure captured: Sep 10 11:41:20.764859 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/servers/cd42bf97-63e2-4a4b-a5db-d747a478dcbd HTTP/1.1 Sep 10 11:41:20.764859 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:41:20.764859 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:41:20.764859 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:41:20.764859 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:41:20.764859 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:41:20.764859 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:41:20.764859 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:41:20.764859 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:41:20.764859 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHcU1B0Vnhoehy7U99Bxqdtr_k8hA2h6jGyomYMoHKCCpTmmpWUZgxPrvlbChKM3TJJpNBQrlI9zcMNlrrPIEYh7sOPNHkSMpG60Nh78QQWEM1YDlbSgieGZGdi-iF-93cnaXZSf9UJNauyZCqYMeb-4VSMvGxkikKg-5Wl9OARowM8 Sep 10 11:41:20.764859 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:41:20.764859 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:41:20.764859 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:41:20.764859 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:41:20.764859 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:41:20.764859 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:41:20.764859 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 2c44e3e2920e48868e1c05f70b1d7639 Sep 10 11:41:20.764859 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1547806860 Sep 10 11:41:20.764859 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:41:20.764859 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:41:20.766426 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c44e3e2920e48868e1c05f70b1d7639"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c44e3e2920e48868e1c05f70b1d7639"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2c44e3e2920e48868e1c05f70b1d7639", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2c44e3e2920e48868e1c05f70b1d7639"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:41:20.766426 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1547806860 Sep 10 11:41:20.766426 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 2c44e3e2920e48868e1c05f70b1d7639 Sep 10 11:41:20.766426 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1547806860 Sep 10 11:41:20.766426 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1547806860-project Sep 10 11:41:20.766426 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:41:20.766426 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:41:20.766426 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: b64e2df030a745de8ae7eda29d2ac30a Sep 10 11:41:20.766426 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1547806860-project Sep 10 11:41:20.766426 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:41:20.766426 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance cd42bf97-63e2-4a4b-a5db-d747a478dcbd could not be found. Sep 10 11:41:20.766426 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'cd42bf97-63e2-4a4b-a5db-d747a478dcbd'} Sep 10 11:41:20.767240 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:41:20.767240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:20.767240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:41:20.767240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:41:20.767240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:41:20.767240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:41:20.767240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:41:20.767240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:41:20.767240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:41:20.767240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:41:20.767240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd42bf97-63e2-4a4b-a5db-d747a478dcbd could not be found. Sep 10 11:41:20.767240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:20.767240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:20.767240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:20.767240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:20.767240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:20.767240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:20.767240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:41:20.767240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:41:20.767240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:41:20.768490 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:41:20.768490 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:41:20.768490 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:41:20.768490 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:41:20.768490 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:41:20.768490 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:41:20.768490 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:41:20.768490 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:41:20.768490 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:41:20.768490 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd42bf97-63e2-4a4b-a5db-d747a478dcbd could not be found. Sep 10 11:41:20.768490 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:20.768490 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:20.768490 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:20.768490 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:20.768490 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:20.768490 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:20.768490 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:41:20.768490 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:41:20.768490 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd42bf97-63e2-4a4b-a5db-d747a478dcbd could not be found. Sep 10 11:41:20.768490 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:20.770105 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bbe4ae23-7f2e-45ac-80af-b46f38281213 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Returning 404 to user: Instance cd42bf97-63e2-4a4b-a5db-d747a478dcbd could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:41:20.770105 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bbe4ae23-7f2e-45ac-80af-b46f38281213 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cd42bf97-63e2-4a4b-a5db-d747a478dcbd" status: 404 len: 111 microversion: 2.1 time: 0.061016 Sep 10 11:41:20.770105 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 445/913] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:41:20 2022] DELETE /compute/v2.1/servers/cd42bf97-63e2-4a4b-a5db-d747a478dcbd => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:41:20.775827 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-555a0995-3f24-49c9-8570-8d77efaa7430 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:20.776447 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-555a0995-3f24-49c9-8570-8d77efaa7430 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] [instance: cd42bf97-63e2-4a4b-a5db-d747a478dcbd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:20.783896 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-555a0995-3f24-49c9-8570-8d77efaa7430 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:20.784703 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-555a0995-3f24-49c9-8570-8d77efaa7430 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:20.785151 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-555a0995-3f24-49c9-8570-8d77efaa7430 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:20.785939 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-555a0995-3f24-49c9-8570-8d77efaa7430 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:20.786400 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-555a0995-3f24-49c9-8570-8d77efaa7430 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:20.786832 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-555a0995-3f24-49c9-8570-8d77efaa7430 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:20.804089 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-555a0995-3f24-49c9-8570-8d77efaa7430 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] HTTP exception thrown: Instance cd42bf97-63e2-4a4b-a5db-d747a478dcbd could not be found. Sep 10 11:41:20.805941 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-555a0995-3f24-49c9-8570-8d77efaa7430 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Request method failure captured: Sep 10 11:41:20.805941 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/cd42bf97-63e2-4a4b-a5db-d747a478dcbd HTTP/1.1 Sep 10 11:41:20.805941 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:41:20.805941 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:41:20.805941 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:41:20.805941 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:41:20.805941 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:41:20.805941 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:41:20.805941 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:41:20.805941 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:41:20.805941 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHcU1B0Vnhoehy7U99Bxqdtr_k8hA2h6jGyomYMoHKCCpTmmpWUZgxPrvlbChKM3TJJpNBQrlI9zcMNlrrPIEYh7sOPNHkSMpG60Nh78QQWEM1YDlbSgieGZGdi-iF-93cnaXZSf9UJNauyZCqYMeb-4VSMvGxkikKg-5Wl9OARowM8 Sep 10 11:41:20.805941 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:41:20.805941 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:41:20.805941 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:41:20.805941 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:41:20.805941 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:41:20.805941 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:41:20.805941 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 2c44e3e2920e48868e1c05f70b1d7639 Sep 10 11:41:20.805941 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1547806860 Sep 10 11:41:20.805941 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:41:20.805941 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:41:20.807314 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c44e3e2920e48868e1c05f70b1d7639"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2c44e3e2920e48868e1c05f70b1d7639"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2c44e3e2920e48868e1c05f70b1d7639", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2c44e3e2920e48868e1c05f70b1d7639"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:41:20.807314 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1547806860 Sep 10 11:41:20.807314 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 2c44e3e2920e48868e1c05f70b1d7639 Sep 10 11:41:20.807314 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1547806860 Sep 10 11:41:20.807314 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1547806860-project Sep 10 11:41:20.807314 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:41:20.807314 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:41:20.807314 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: b64e2df030a745de8ae7eda29d2ac30a Sep 10 11:41:20.807314 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1547806860-project Sep 10 11:41:20.807314 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:41:20.807314 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance cd42bf97-63e2-4a4b-a5db-d747a478dcbd could not be found. Sep 10 11:41:20.807314 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'cd42bf97-63e2-4a4b-a5db-d747a478dcbd'} Sep 10 11:41:20.808034 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:41:20.808034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:20.808034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:41:20.808034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:41:20.808034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:41:20.808034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:41:20.808034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:41:20.808034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:41:20.808034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:41:20.808034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:41:20.808034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd42bf97-63e2-4a4b-a5db-d747a478dcbd could not be found. Sep 10 11:41:20.808034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:20.808034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:20.808034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:20.808034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:20.808034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:20.808034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:20.808034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:41:20.808034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:41:20.808034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:41:20.809179 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:41:20.809179 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:41:20.809179 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:41:20.809179 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:41:20.809179 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:41:20.809179 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:41:20.809179 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:41:20.809179 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd42bf97-63e2-4a4b-a5db-d747a478dcbd could not be found. Sep 10 11:41:20.809179 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:20.809179 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:20.809179 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:20.809179 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:20.809179 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:20.809179 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:20.809179 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:41:20.809179 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:41:20.809179 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd42bf97-63e2-4a4b-a5db-d747a478dcbd could not be found. Sep 10 11:41:20.809179 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:20.810278 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-555a0995-3f24-49c9-8570-8d77efaa7430 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] Returning 404 to user: Instance cd42bf97-63e2-4a4b-a5db-d747a478dcbd could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:41:20.810278 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-555a0995-3f24-49c9-8570-8d77efaa7430 tempest-ServersWithSpecificFlavorTestJSON-1547806860 tempest-ServersWithSpecificFlavorTestJSON-1547806860-project] 10.222.0.23 "GET /compute/v2.1/servers/cd42bf97-63e2-4a4b-a5db-d747a478dcbd" status: 404 len: 111 microversion: 2.1 time: 0.036380 Sep 10 11:41:20.810278 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 446/914] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:20 2022] GET /compute/v2.1/servers/cd42bf97-63e2-4a4b-a5db-d747a478dcbd => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 11:41:20.827342 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-12ea70a9-e573-4982-b6f0-8ab51d06d7e1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1554478703", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "9d0f720d-8913-424b-864d-897845ccb4e7"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:20.942415 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-12ea70a9-e573-4982-b6f0-8ab51d06d7e1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] validate_networks() for [('9d0f720d-8913-424b-864d-897845ccb4e7', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:41:21.461492 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d2b8a686-2b7b-4127-9011-887efb8e6b5a tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:41:21.461964 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d2b8a686-2b7b-4127-9011-887efb8e6b5a tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:41:21.462386 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d2b8a686-2b7b-4127-9011-887efb8e6b5a tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:41:21.462804 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d2b8a686-2b7b-4127-9011-887efb8e6b5a tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:41:21.463237 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d2b8a686-2b7b-4127-9011-887efb8e6b5a tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:41:21.490636 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d2b8a686-2b7b-4127-9011-887efb8e6b5a tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:21.491421 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d2b8a686-2b7b-4127-9011-887efb8e6b5a tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:21.492019 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d2b8a686-2b7b-4127-9011-887efb8e6b5a tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:21.492941 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d2b8a686-2b7b-4127-9011-887efb8e6b5a tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:21.493566 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d2b8a686-2b7b-4127-9011-887efb8e6b5a tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:21.494174 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d2b8a686-2b7b-4127-9011-887efb8e6b5a tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:21.525522 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-d2b8a686-2b7b-4127-9011-887efb8e6b5a tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Getting quotas for project 74d3ca9bcf514a8b9844377fc53143ee. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:41:21.536616 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-d2b8a686-2b7b-4127-9011-887efb8e6b5a tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Getting quotas for user dc1e51accd4241b497623f18f0d2967d and project 74d3ca9bcf514a8b9844377fc53143ee. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:41:21.562596 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d2b8a686-2b7b-4127-9011-887efb8e6b5a tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:41:21.565348 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d2b8a686-2b7b-4127-9011-887efb8e6b5a tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] [instance: afb1a503-7e9a-474c-8dfe-b0e5838b7398] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98b9382a-f5f3-409c-a32d-669f5695c02a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:41:21.620084 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d2b8a686-2b7b-4127-9011-887efb8e6b5a tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.540320 Sep 10 11:41:21.627876 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 469/915] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:41:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 1542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:41:21.634943 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1670e99b-f13b-45ac-8ec2-2700b55165d8 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:21.636246 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1670e99b-f13b-45ac-8ec2-2700b55165d8 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: c0cd6b34-210f-4113-b870-f402c588801c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:21.645020 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1670e99b-f13b-45ac-8ec2-2700b55165d8 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:21.646042 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1670e99b-f13b-45ac-8ec2-2700b55165d8 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:21.646651 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1670e99b-f13b-45ac-8ec2-2700b55165d8 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:21.647554 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1670e99b-f13b-45ac-8ec2-2700b55165d8 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:21.648170 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1670e99b-f13b-45ac-8ec2-2700b55165d8 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:21.648758 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1670e99b-f13b-45ac-8ec2-2700b55165d8 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:21.653403 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:41:21.963257 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1670e99b-f13b-45ac-8ec2-2700b55165d8 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:21.978239 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1670e99b-f13b-45ac-8ec2-2700b55165d8 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c" status: 200 len: 1474 microversion: 2.1 time: 0.347829 Sep 10 11:41:21.995109 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 470/916] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:21 2022] GET /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c => generated 1474 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:22.252841 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-aeccf4fc-41d8-43e0-8819-97bc98ff2b55 tempest-ImagesDeleteNegativeTestJSON-1525834894 tempest-ImagesDeleteNegativeTestJSON-1525834894-project] 10.222.0.23 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.255957 Sep 10 11:41:22.253790 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 471/917] 10.222.0.23 () {58 vars in 1128 bytes} [Sat Sep 10 11:41:21 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 10 11:41:22.261515 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-12ea70a9-e573-4982-b6f0-8ab51d06d7e1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:41:22.261959 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-12ea70a9-e573-4982-b6f0-8ab51d06d7e1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:41:22.266020 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0d0805b4-1c13-4727-8e7c-84b985608fb4 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:22.267076 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0d0805b4-1c13-4727-8e7c-84b985608fb4 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] [instance: 4c806b91-1302-494f-b4eb-a0b7ba04baf4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:22.269804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-12ea70a9-e573-4982-b6f0-8ab51d06d7e1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:41:22.270336 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-12ea70a9-e573-4982-b6f0-8ab51d06d7e1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:41:22.271388 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-12ea70a9-e573-4982-b6f0-8ab51d06d7e1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:41:22.275536 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d0805b4-1c13-4727-8e7c-84b985608fb4 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:22.276723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d0805b4-1c13-4727-8e7c-84b985608fb4 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:22.277346 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d0805b4-1c13-4727-8e7c-84b985608fb4 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:22.279187 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d0805b4-1c13-4727-8e7c-84b985608fb4 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:22.280139 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d0805b4-1c13-4727-8e7c-84b985608fb4 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:22.281048 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d0805b4-1c13-4727-8e7c-84b985608fb4 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:22.302126 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-12ea70a9-e573-4982-b6f0-8ab51d06d7e1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:22.304018 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-12ea70a9-e573-4982-b6f0-8ab51d06d7e1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:22.309471 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-12ea70a9-e573-4982-b6f0-8ab51d06d7e1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:22.310490 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-12ea70a9-e573-4982-b6f0-8ab51d06d7e1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:22.311075 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-12ea70a9-e573-4982-b6f0-8ab51d06d7e1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:22.313917 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-12ea70a9-e573-4982-b6f0-8ab51d06d7e1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:22.355828 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-12ea70a9-e573-4982-b6f0-8ab51d06d7e1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Getting quotas for project c8c0800673e247fb8b3b3718512233c0. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:41:22.369754 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-12ea70a9-e573-4982-b6f0-8ab51d06d7e1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Getting quotas for user 1106bb2c5ce14c21a15ad62942745b62 and project c8c0800673e247fb8b3b3718512233c0. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:41:22.398234 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-12ea70a9-e573-4982-b6f0-8ab51d06d7e1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:41:22.402686 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-12ea70a9-e573-4982-b6f0-8ab51d06d7e1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: ebff5197-fc62-4ee6-a688-6e12f04645b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:41:22.532317 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-12ea70a9-e573-4982-b6f0-8ab51d06d7e1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.722875 Sep 10 11:41:22.542011 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 447/918] 10.222.0.23 () {62 vars in 1188 bytes} [Sat Sep 10 11:41:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1733 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 10 11:41:22.547979 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f3decedf-fd85-43e5-a603-7f4fb13524cb tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:22.548610 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f3decedf-fd85-43e5-a603-7f4fb13524cb tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] [instance: afb1a503-7e9a-474c-8dfe-b0e5838b7398] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:22.556533 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3decedf-fd85-43e5-a603-7f4fb13524cb tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:22.557028 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3decedf-fd85-43e5-a603-7f4fb13524cb tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:22.557473 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3decedf-fd85-43e5-a603-7f4fb13524cb tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:22.558186 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3decedf-fd85-43e5-a603-7f4fb13524cb tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:22.558650 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3decedf-fd85-43e5-a603-7f4fb13524cb tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:22.559083 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3decedf-fd85-43e5-a603-7f4fb13524cb tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:22.739977 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0d0805b4-1c13-4727-8e7c-84b985608fb4 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf661b110ecc4f36b795a980d29f312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5765e50afa045569700eab4616a6a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:22.749382 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0d0805b4-1c13-4727-8e7c-84b985608fb4 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/servers/4c806b91-1302-494f-b4eb-a0b7ba04baf4" status: 200 len: 1472 microversion: 2.1 time: 0.493204 Sep 10 11:41:22.756121 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 472/919] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:22 2022] GET /compute/v2.1/servers/4c806b91-1302-494f-b4eb-a0b7ba04baf4 => generated 1472 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:22.785656 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-70e2ed87-450f-4ba0-954d-31c137f60d07 tempest-ImagesDeleteNegativeTestJSON-1525834894 tempest-ImagesDeleteNegativeTestJSON-1525834894-project] Calling method '.version_select at 0x7f4073b66d30>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:22.820814 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f3decedf-fd85-43e5-a603-7f4fb13524cb tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1e51accd4241b497623f18f0d2967d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d3ca9bcf514a8b9844377fc53143ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:22.828234 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-70e2ed87-450f-4ba0-954d-31c137f60d07 tempest-ImagesDeleteNegativeTestJSON-1525834894 tempest-ImagesDeleteNegativeTestJSON-1525834894-project] HTTP exception thrown: Image not found. Sep 10 11:41:22.830627 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-70e2ed87-450f-4ba0-954d-31c137f60d07 tempest-ImagesDeleteNegativeTestJSON-1525834894 tempest-ImagesDeleteNegativeTestJSON-1525834894-project] Request method failure captured: Sep 10 11:41:22.830627 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Sep 10 11:41:22.830627 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:41:22.830627 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:41:22.830627 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:41:22.830627 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:41:22.830627 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:41:22.830627 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:41:22.830627 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:41:22.830627 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:41:22.830627 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHfgMCiXI2k-o8Nl0BdzQN96fFXqDdMpWRIcBd9bfWviiGnKeygUyDjclboCNR8H7cy9EJn2d6iizGrwgr5pQHTJGB14cduky_G2y9CBYHUlUx3glKyJ45icsCu4ksbOQ4FTbaMd6QpOgKXXN63rWvN5w367pF4PAJFJQgA3tSxcIHQ Sep 10 11:41:22.830627 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:41:22.830627 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:41:22.830627 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:41:22.830627 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:41:22.830627 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:41:22.830627 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:41:22.830627 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: aef79b76e5b2467c9f7d7e22342fe0ff Sep 10 11:41:22.830627 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1525834894 Sep 10 11:41:22.830627 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:41:22.830627 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:41:22.831983 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aef79b76e5b2467c9f7d7e22342fe0ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aef79b76e5b2467c9f7d7e22342fe0ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_aef79b76e5b2467c9f7d7e22342fe0ff", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/aef79b76e5b2467c9f7d7e22342fe0ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:41:22.831983 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1525834894 Sep 10 11:41:22.831983 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: aef79b76e5b2467c9f7d7e22342fe0ff Sep 10 11:41:22.831983 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1525834894 Sep 10 11:41:22.831983 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ImagesDeleteNegativeTestJSON-1525834894-project Sep 10 11:41:22.831983 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:41:22.831983 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:41:22.831983 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 5219a53f5acf49deb2ce271e193f0882 Sep 10 11:41:22.831983 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1525834894-project Sep 10 11:41:22.831983 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:41:22.831983 n-d-856895-1 devstack@n-api.service[128777]: exception: Image not found. Sep 10 11:41:22.831983 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '-1'} Sep 10 11:41:22.831983 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:41:22.831983 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:22.832887 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 10 11:41:22.832887 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 10 11:41:22.832887 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 11:41:22.832887 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 11:41:22.832887 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 11:41:22.832887 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 11:41:22.832887 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 10 11:41:22.832887 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 10 11:41:22.832887 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 10 11:41:22.832887 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 10 11:41:22.832887 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 11:41:22.832887 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 11:41:22.832887 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 11:41:22.832887 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 11:41:22.832887 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Sep 10 11:41:22.832887 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:22.832887 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:22.832887 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:22.832887 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:22.834566 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 10 11:41:22.834566 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 10 11:41:22.834566 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 10 11:41:22.834566 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 10 11:41:22.834566 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 10 11:41:22.834566 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 10 11:41:22.834566 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Sep 10 11:41:22.834566 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:22.834566 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:22.834566 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:22.834566 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:22.834566 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:22.834566 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:22.834566 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:41:22.834566 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:41:22.834566 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:41:22.834566 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:41:22.834566 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:41:22.834566 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:41:22.834566 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 10 11:41:22.835866 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 11:41:22.835866 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 11:41:22.835866 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:22.835866 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:22.835866 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:22.835866 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:22.835866 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:22.835866 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:22.835866 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:41:22.835866 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:41:22.835866 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 11:41:22.835866 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:22.838405 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-70e2ed87-450f-4ba0-954d-31c137f60d07 tempest-ImagesDeleteNegativeTestJSON-1525834894 tempest-ImagesDeleteNegativeTestJSON-1525834894-project] Returning 404 to user: Image not found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:41:22.839713 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-70e2ed87-450f-4ba0-954d-31c137f60d07 tempest-ImagesDeleteNegativeTestJSON-1525834894 tempest-ImagesDeleteNegativeTestJSON-1525834894-project] 10.222.0.23 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.071138 Sep 10 11:41:22.845765 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 473/920] 10.222.0.23 () {58 vars in 1134 bytes} [Sat Sep 10 11:41:22 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:41:22.849776 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f3decedf-fd85-43e5-a603-7f4fb13524cb tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] 10.222.0.23 "GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398" status: 200 len: 1249 microversion: 2.1 time: 0.306426 Sep 10 11:41:22.850825 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-983588ff-949f-469f-91ad-4bc3e4d05ecb tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:22.851528 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-983588ff-949f-469f-91ad-4bc3e4d05ecb tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: ebff5197-fc62-4ee6-a688-6e12f04645b5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:22.853960 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 448/921] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:22 2022] GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398 => generated 1249 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:22.868611 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4eb7d677-b83f-4903-91dc-b98e12aeab52 tempest-ImagesDeleteNegativeTestJSON-1525834894 tempest-ImagesDeleteNegativeTestJSON-1525834894-project] Calling method '.version_select at 0x7f4073a7b160>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:22.936035 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-4eb7d677-b83f-4903-91dc-b98e12aeab52 tempest-ImagesDeleteNegativeTestJSON-1525834894 tempest-ImagesDeleteNegativeTestJSON-1525834894-project] HTTP exception thrown: Image not found. Sep 10 11:41:22.939827 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4eb7d677-b83f-4903-91dc-b98e12aeab52 tempest-ImagesDeleteNegativeTestJSON-1525834894 tempest-ImagesDeleteNegativeTestJSON-1525834894-project] Request method failure captured: Sep 10 11:41:22.939827 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/images/4b9b7456-71b4-4afd-8085-985ea927c69j HTTP/1.1 Sep 10 11:41:22.939827 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:41:22.939827 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:41:22.939827 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:41:22.939827 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:41:22.939827 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:41:22.939827 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:41:22.939827 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:41:22.939827 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:41:22.939827 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHfgMCiXI2k-o8Nl0BdzQN96fFXqDdMpWRIcBd9bfWviiGnKeygUyDjclboCNR8H7cy9EJn2d6iizGrwgr5pQHTJGB14cduky_G2y9CBYHUlUx3glKyJ45icsCu4ksbOQ4FTbaMd6QpOgKXXN63rWvN5w367pF4PAJFJQgA3tSxcIHQ Sep 10 11:41:22.939827 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:41:22.939827 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:41:22.939827 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:41:22.939827 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:41:22.939827 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:41:22.939827 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:41:22.939827 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: aef79b76e5b2467c9f7d7e22342fe0ff Sep 10 11:41:22.939827 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1525834894 Sep 10 11:41:22.939827 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:41:22.939827 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:41:22.941418 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aef79b76e5b2467c9f7d7e22342fe0ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aef79b76e5b2467c9f7d7e22342fe0ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_aef79b76e5b2467c9f7d7e22342fe0ff", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/aef79b76e5b2467c9f7d7e22342fe0ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:41:22.941418 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1525834894 Sep 10 11:41:22.941418 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: aef79b76e5b2467c9f7d7e22342fe0ff Sep 10 11:41:22.941418 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1525834894 Sep 10 11:41:22.941418 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ImagesDeleteNegativeTestJSON-1525834894-project Sep 10 11:41:22.941418 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:41:22.941418 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:41:22.941418 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 5219a53f5acf49deb2ce271e193f0882 Sep 10 11:41:22.941418 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1525834894-project Sep 10 11:41:22.941418 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:41:22.941418 n-d-856895-1 devstack@n-api.service[128776]: exception: Image not found. Sep 10 11:41:22.941418 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '4b9b7456-71b4-4afd-8085-985ea927c69j'} Sep 10 11:41:22.941418 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:41:22.942352 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:22.942352 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 10 11:41:22.942352 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 10 11:41:22.942352 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 11:41:22.942352 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 11:41:22.942352 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 11:41:22.942352 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 11:41:22.942352 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 10 11:41:22.942352 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 10 11:41:22.942352 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 10 11:41:22.942352 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 10 11:41:22.942352 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 11:41:22.942352 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 11:41:22.942352 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 11:41:22.942352 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 11:41:22.942352 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4b9b7456-71b4-4afd-8085-985ea927c69j to delete Sep 10 11:41:22.942352 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:22.942352 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:22.942352 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:22.944530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:22.944530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 10 11:41:22.944530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 10 11:41:22.944530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 10 11:41:22.944530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 10 11:41:22.944530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 10 11:41:22.944530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 10 11:41:22.944530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4b9b7456-71b4-4afd-8085-985ea927c69j could not be found. Sep 10 11:41:22.944530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:22.944530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:22.944530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:22.944530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:22.944530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:22.944530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:22.944530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:41:22.944530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:41:22.944530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:41:22.944530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:41:22.944530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:41:22.944530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:41:22.948043 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 10 11:41:22.948043 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 11:41:22.948043 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 11:41:22.948043 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:22.948043 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:22.948043 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:22.948043 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:22.948043 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:22.948043 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:22.948043 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:41:22.948043 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:41:22.948043 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 11:41:22.948043 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:22.948043 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4eb7d677-b83f-4903-91dc-b98e12aeab52 tempest-ImagesDeleteNegativeTestJSON-1525834894 tempest-ImagesDeleteNegativeTestJSON-1525834894-project] Returning 404 to user: Image not found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:41:22.948043 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4eb7d677-b83f-4903-91dc-b98e12aeab52 tempest-ImagesDeleteNegativeTestJSON-1525834894 tempest-ImagesDeleteNegativeTestJSON-1525834894-project] 10.222.0.23 "DELETE /compute/v2.1/images/4b9b7456-71b4-4afd-8085-985ea927c69j" status: 404 len: 62 microversion: 2.1 time: 0.087216 Sep 10 11:41:22.949125 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 449/922] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:22 2022] DELETE /compute/v2.1/images/4b9b7456-71b4-4afd-8085-985ea927c69j => generated 62 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:41:22.957521 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9c175f51-366c-4a88-8c6a-0732ac161b1f tempest-ImagesDeleteNegativeTestJSON-1525834894 tempest-ImagesDeleteNegativeTestJSON-1525834894-project] Calling method '.version_select at 0x7f4078c2b670>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:22.996767 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-9c175f51-366c-4a88-8c6a-0732ac161b1f tempest-ImagesDeleteNegativeTestJSON-1525834894 tempest-ImagesDeleteNegativeTestJSON-1525834894-project] HTTP exception thrown: Image not found. Sep 10 11:41:22.998964 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9c175f51-366c-4a88-8c6a-0732ac161b1f tempest-ImagesDeleteNegativeTestJSON-1525834894 tempest-ImagesDeleteNegativeTestJSON-1525834894-project] Request method failure captured: Sep 10 11:41:22.998964 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/images/b26cb4d6-2437-4130-bbdc-10187c9a39621 HTTP/1.1 Sep 10 11:41:22.998964 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:41:22.998964 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:41:22.998964 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:41:22.998964 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:41:22.998964 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:41:22.998964 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:41:22.998964 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:41:22.998964 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:41:22.998964 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHfgMCiXI2k-o8Nl0BdzQN96fFXqDdMpWRIcBd9bfWviiGnKeygUyDjclboCNR8H7cy9EJn2d6iizGrwgr5pQHTJGB14cduky_G2y9CBYHUlUx3glKyJ45icsCu4ksbOQ4FTbaMd6QpOgKXXN63rWvN5w367pF4PAJFJQgA3tSxcIHQ Sep 10 11:41:22.998964 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:41:22.998964 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:41:22.998964 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:41:22.998964 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:41:22.998964 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:41:22.998964 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:41:22.998964 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: aef79b76e5b2467c9f7d7e22342fe0ff Sep 10 11:41:22.998964 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1525834894 Sep 10 11:41:22.998964 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:41:22.998964 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:41:23.000588 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aef79b76e5b2467c9f7d7e22342fe0ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aef79b76e5b2467c9f7d7e22342fe0ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_aef79b76e5b2467c9f7d7e22342fe0ff", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/aef79b76e5b2467c9f7d7e22342fe0ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:41:23.000588 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1525834894 Sep 10 11:41:23.000588 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: aef79b76e5b2467c9f7d7e22342fe0ff Sep 10 11:41:23.000588 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1525834894 Sep 10 11:41:23.000588 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ImagesDeleteNegativeTestJSON-1525834894-project Sep 10 11:41:23.000588 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:41:23.000588 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:41:23.000588 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 5219a53f5acf49deb2ce271e193f0882 Sep 10 11:41:23.000588 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1525834894-project Sep 10 11:41:23.000588 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:41:23.000588 n-d-856895-1 devstack@n-api.service[128776]: exception: Image not found. Sep 10 11:41:23.000588 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'b26cb4d6-2437-4130-bbdc-10187c9a39621'} Sep 10 11:41:23.000588 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:41:23.001544 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:23.001544 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 10 11:41:23.001544 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 10 11:41:23.001544 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 11:41:23.001544 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 11:41:23.001544 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 11:41:23.001544 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 11:41:23.001544 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 10 11:41:23.001544 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 10 11:41:23.001544 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 10 11:41:23.001544 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 10 11:41:23.001544 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 11:41:23.001544 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 11:41:23.001544 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 11:41:23.001544 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 11:41:23.001544 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b26cb4d6-2437-4130-bbdc-10187c9a39621 to delete Sep 10 11:41:23.001544 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:23.001544 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:23.001544 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:23.002916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:23.002916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 10 11:41:23.002916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 10 11:41:23.002916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 10 11:41:23.002916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 10 11:41:23.002916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 10 11:41:23.002916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 10 11:41:23.002916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b26cb4d6-2437-4130-bbdc-10187c9a39621 could not be found. Sep 10 11:41:23.002916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:23.002916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:23.002916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:23.002916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:23.002916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:23.002916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:23.002916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:41:23.002916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:41:23.002916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:41:23.002916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:41:23.002916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:41:23.002916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:41:23.005212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 10 11:41:23.005212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 11:41:23.005212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 11:41:23.005212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:23.005212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:23.005212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:23.005212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:23.005212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:23.005212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:23.005212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:41:23.005212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:41:23.005212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 11:41:23.005212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:23.005212 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9c175f51-366c-4a88-8c6a-0732ac161b1f tempest-ImagesDeleteNegativeTestJSON-1525834894 tempest-ImagesDeleteNegativeTestJSON-1525834894-project] Returning 404 to user: Image not found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:41:23.005212 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9c175f51-366c-4a88-8c6a-0732ac161b1f tempest-ImagesDeleteNegativeTestJSON-1525834894 tempest-ImagesDeleteNegativeTestJSON-1525834894-project] 10.222.0.23 "DELETE /compute/v2.1/images/b26cb4d6-2437-4130-bbdc-10187c9a39621" status: 404 len: 62 microversion: 2.1 time: 0.055377 Sep 10 11:41:23.007707 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 450/923] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:41:22 2022] DELETE /compute/v2.1/images/b26cb4d6-2437-4130-bbdc-10187c9a39621 => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:41:23.023002 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9c2035cf-e303-4745-8fcf-cdb8d00c1994 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:23.023674 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9c2035cf-e303-4745-8fcf-cdb8d00c1994 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: c0cd6b34-210f-4113-b870-f402c588801c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:23.039004 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c2035cf-e303-4745-8fcf-cdb8d00c1994 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:23.041943 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c2035cf-e303-4745-8fcf-cdb8d00c1994 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:23.042562 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c2035cf-e303-4745-8fcf-cdb8d00c1994 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:23.045357 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c2035cf-e303-4745-8fcf-cdb8d00c1994 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:23.046019 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c2035cf-e303-4745-8fcf-cdb8d00c1994 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:23.048831 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c2035cf-e303-4745-8fcf-cdb8d00c1994 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:23.062616 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-983588ff-949f-469f-91ad-4bc3e4d05ecb tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:23.074431 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-983588ff-949f-469f-91ad-4bc3e4d05ecb tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:23.078369 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-983588ff-949f-469f-91ad-4bc3e4d05ecb tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:23.082640 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-983588ff-949f-469f-91ad-4bc3e4d05ecb tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5" status: 200 len: 1262 microversion: 2.25 time: 0.235292 Sep 10 11:41:23.100201 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 474/924] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:22 2022] GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5 => generated 1262 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:23.108327 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1101717e-3582-44b8-9b67-9e4a150bc93e tempest-ImagesDeleteNegativeTestJSON-1525834894 tempest-ImagesDeleteNegativeTestJSON-1525834894-project] Calling method '.version_select at 0x7f4073842c10>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:23.164966 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-1101717e-3582-44b8-9b67-9e4a150bc93e tempest-ImagesDeleteNegativeTestJSON-1525834894 tempest-ImagesDeleteNegativeTestJSON-1525834894-project] HTTP exception thrown: Image not found. Sep 10 11:41:23.170495 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1101717e-3582-44b8-9b67-9e4a150bc93e tempest-ImagesDeleteNegativeTestJSON-1525834894 tempest-ImagesDeleteNegativeTestJSON-1525834894-project] Request method failure captured: Sep 10 11:41:23.170495 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/images/tempest-invalid-1708898673 HTTP/1.1 Sep 10 11:41:23.170495 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:41:23.170495 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:41:23.170495 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:41:23.170495 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:41:23.170495 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:41:23.170495 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:41:23.170495 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:41:23.170495 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:41:23.170495 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHfgMCiXI2k-o8Nl0BdzQN96fFXqDdMpWRIcBd9bfWviiGnKeygUyDjclboCNR8H7cy9EJn2d6iizGrwgr5pQHTJGB14cduky_G2y9CBYHUlUx3glKyJ45icsCu4ksbOQ4FTbaMd6QpOgKXXN63rWvN5w367pF4PAJFJQgA3tSxcIHQ Sep 10 11:41:23.170495 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:41:23.170495 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:41:23.170495 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:41:23.170495 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:41:23.170495 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:41:23.170495 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:41:23.170495 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: aef79b76e5b2467c9f7d7e22342fe0ff Sep 10 11:41:23.170495 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1525834894 Sep 10 11:41:23.170495 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:41:23.170495 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:41:23.172200 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aef79b76e5b2467c9f7d7e22342fe0ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aef79b76e5b2467c9f7d7e22342fe0ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_aef79b76e5b2467c9f7d7e22342fe0ff", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/aef79b76e5b2467c9f7d7e22342fe0ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:41:23.172200 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1525834894 Sep 10 11:41:23.172200 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: aef79b76e5b2467c9f7d7e22342fe0ff Sep 10 11:41:23.172200 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1525834894 Sep 10 11:41:23.172200 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ImagesDeleteNegativeTestJSON-1525834894-project Sep 10 11:41:23.172200 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:41:23.172200 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:41:23.172200 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 5219a53f5acf49deb2ce271e193f0882 Sep 10 11:41:23.172200 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1525834894-project Sep 10 11:41:23.172200 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:41:23.172200 n-d-856895-1 devstack@n-api.service[128777]: exception: Image not found. Sep 10 11:41:23.172200 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'tempest-invalid-1708898673'} Sep 10 11:41:23.172200 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:41:23.172995 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:23.172995 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 10 11:41:23.172995 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 10 11:41:23.172995 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 11:41:23.172995 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 11:41:23.172995 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 11:41:23.172995 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 11:41:23.172995 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 10 11:41:23.172995 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 10 11:41:23.172995 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 10 11:41:23.172995 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 10 11:41:23.172995 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 11:41:23.172995 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 11:41:23.172995 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 11:41:23.172995 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 11:41:23.172995 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1708898673 to delete Sep 10 11:41:23.172995 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:23.172995 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:23.172995 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:23.174101 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:23.174101 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 10 11:41:23.174101 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 10 11:41:23.174101 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 10 11:41:23.174101 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 10 11:41:23.174101 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 10 11:41:23.174101 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 10 11:41:23.174101 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1708898673 could not be found. Sep 10 11:41:23.174101 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:23.174101 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:23.174101 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:23.174101 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:23.174101 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:23.174101 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:23.174101 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:41:23.174101 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:41:23.174101 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:41:23.174101 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:41:23.174101 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:41:23.174101 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:41:23.176405 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 10 11:41:23.176405 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 11:41:23.176405 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 11:41:23.176405 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:23.176405 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:23.176405 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:23.176405 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:23.176405 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:23.176405 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:23.176405 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:41:23.176405 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:41:23.176405 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 11:41:23.176405 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:23.179940 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1101717e-3582-44b8-9b67-9e4a150bc93e tempest-ImagesDeleteNegativeTestJSON-1525834894 tempest-ImagesDeleteNegativeTestJSON-1525834894-project] Returning 404 to user: Image not found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:41:23.181026 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1101717e-3582-44b8-9b67-9e4a150bc93e tempest-ImagesDeleteNegativeTestJSON-1525834894 tempest-ImagesDeleteNegativeTestJSON-1525834894-project] 10.222.0.23 "DELETE /compute/v2.1/images/tempest-invalid-1708898673" status: 404 len: 62 microversion: 2.1 time: 0.079555 Sep 10 11:41:23.213742 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 475/925] 10.222.0.23 () {58 vars in 1206 bytes} [Sat Sep 10 11:41:23 2022] DELETE /compute/v2.1/images/tempest-invalid-1708898673 => generated 62 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:41:23.228130 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-632442cf-2549-4f70-9db9-0a681d6a667a tempest-ImagesDeleteNegativeTestJSON-1525834894 tempest-ImagesDeleteNegativeTestJSON-1525834894-project] Calling method '.version_select at 0x7f4073eabd30>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:23.296462 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-632442cf-2549-4f70-9db9-0a681d6a667a tempest-ImagesDeleteNegativeTestJSON-1525834894 tempest-ImagesDeleteNegativeTestJSON-1525834894-project] HTTP exception thrown: Image not found. Sep 10 11:41:23.299549 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-632442cf-2549-4f70-9db9-0a681d6a667a tempest-ImagesDeleteNegativeTestJSON-1525834894 tempest-ImagesDeleteNegativeTestJSON-1525834894-project] Request method failure captured: Sep 10 11:41:23.299549 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/images/14f22edb-1af1-495e-92cf-c3cbcb180ae3 HTTP/1.1 Sep 10 11:41:23.299549 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:41:23.299549 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:41:23.299549 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:41:23.299549 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:41:23.299549 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:41:23.299549 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:41:23.299549 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:41:23.299549 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:41:23.299549 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHfgMCiXI2k-o8Nl0BdzQN96fFXqDdMpWRIcBd9bfWviiGnKeygUyDjclboCNR8H7cy9EJn2d6iizGrwgr5pQHTJGB14cduky_G2y9CBYHUlUx3glKyJ45icsCu4ksbOQ4FTbaMd6QpOgKXXN63rWvN5w367pF4PAJFJQgA3tSxcIHQ Sep 10 11:41:23.299549 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:41:23.299549 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:41:23.299549 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:41:23.299549 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:41:23.299549 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:41:23.299549 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:41:23.299549 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: aef79b76e5b2467c9f7d7e22342fe0ff Sep 10 11:41:23.299549 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1525834894 Sep 10 11:41:23.299549 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:41:23.299549 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:41:23.301179 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aef79b76e5b2467c9f7d7e22342fe0ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/aef79b76e5b2467c9f7d7e22342fe0ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_aef79b76e5b2467c9f7d7e22342fe0ff", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/aef79b76e5b2467c9f7d7e22342fe0ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:41:23.301179 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1525834894 Sep 10 11:41:23.301179 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: aef79b76e5b2467c9f7d7e22342fe0ff Sep 10 11:41:23.301179 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1525834894 Sep 10 11:41:23.301179 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ImagesDeleteNegativeTestJSON-1525834894-project Sep 10 11:41:23.301179 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:41:23.301179 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:41:23.301179 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 5219a53f5acf49deb2ce271e193f0882 Sep 10 11:41:23.301179 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1525834894-project Sep 10 11:41:23.301179 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:41:23.301179 n-d-856895-1 devstack@n-api.service[128777]: exception: Image not found. Sep 10 11:41:23.301179 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '14f22edb-1af1-495e-92cf-c3cbcb180ae3'} Sep 10 11:41:23.301179 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:41:23.302162 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:23.302162 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 10 11:41:23.302162 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 10 11:41:23.302162 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 11:41:23.302162 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 11:41:23.302162 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 11:41:23.302162 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 11:41:23.302162 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 10 11:41:23.302162 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 10 11:41:23.302162 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 10 11:41:23.302162 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 10 11:41:23.302162 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 11:41:23.302162 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 11:41:23.302162 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 11:41:23.302162 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 11:41:23.302162 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 14f22edb-1af1-495e-92cf-c3cbcb180ae3 to delete Sep 10 11:41:23.302162 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:23.302162 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:23.302162 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:23.303681 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:23.303681 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 10 11:41:23.303681 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 10 11:41:23.303681 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 10 11:41:23.303681 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 10 11:41:23.303681 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 10 11:41:23.303681 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 10 11:41:23.303681 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 14f22edb-1af1-495e-92cf-c3cbcb180ae3 could not be found. Sep 10 11:41:23.303681 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:23.303681 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:23.303681 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:23.303681 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:23.303681 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:23.303681 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:23.303681 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:41:23.303681 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:41:23.303681 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:41:23.303681 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:41:23.303681 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:41:23.303681 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:41:23.305231 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 10 11:41:23.305231 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 11:41:23.305231 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 11:41:23.305231 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:23.305231 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:23.305231 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:23.305231 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:23.305231 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:23.305231 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:23.305231 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:41:23.305231 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:41:23.305231 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 11:41:23.305231 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:23.307445 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-632442cf-2549-4f70-9db9-0a681d6a667a tempest-ImagesDeleteNegativeTestJSON-1525834894 tempest-ImagesDeleteNegativeTestJSON-1525834894-project] Returning 404 to user: Image not found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:41:23.308616 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-632442cf-2549-4f70-9db9-0a681d6a667a tempest-ImagesDeleteNegativeTestJSON-1525834894 tempest-ImagesDeleteNegativeTestJSON-1525834894-project] 10.222.0.23 "DELETE /compute/v2.1/images/14f22edb-1af1-495e-92cf-c3cbcb180ae3" status: 404 len: 62 microversion: 2.1 time: 0.093143 Sep 10 11:41:23.313433 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 476/926] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:23 2022] DELETE /compute/v2.1/images/14f22edb-1af1-495e-92cf-c3cbcb180ae3 => generated 62 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:41:23.438459 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9c2035cf-e303-4745-8fcf-cdb8d00c1994 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:23.450022 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9c2035cf-e303-4745-8fcf-cdb8d00c1994 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c" status: 200 len: 1474 microversion: 2.1 time: 0.435849 Sep 10 11:41:23.452588 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 451/927] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:23 2022] GET /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c => generated 1474 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:23.784133 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8a1949c1-9fda-411a-a817-0754fa6ce87f tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:23.785619 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8a1949c1-9fda-411a-a817-0754fa6ce87f tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] [instance: 4c806b91-1302-494f-b4eb-a0b7ba04baf4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:23.800896 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a1949c1-9fda-411a-a817-0754fa6ce87f tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:23.804886 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a1949c1-9fda-411a-a817-0754fa6ce87f tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:23.806412 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a1949c1-9fda-411a-a817-0754fa6ce87f tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:23.807939 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a1949c1-9fda-411a-a817-0754fa6ce87f tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:23.809289 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a1949c1-9fda-411a-a817-0754fa6ce87f tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:23.811274 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a1949c1-9fda-411a-a817-0754fa6ce87f tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:23.877732 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c1951359-d995-4e4d-9bd2-9b2465af2952 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:23.878357 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c1951359-d995-4e4d-9bd2-9b2465af2952 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] [instance: afb1a503-7e9a-474c-8dfe-b0e5838b7398] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:23.889754 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1951359-d995-4e4d-9bd2-9b2465af2952 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:23.890263 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1951359-d995-4e4d-9bd2-9b2465af2952 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:23.890712 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1951359-d995-4e4d-9bd2-9b2465af2952 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:23.893033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1951359-d995-4e4d-9bd2-9b2465af2952 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:23.897254 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1951359-d995-4e4d-9bd2-9b2465af2952 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:23.898142 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1951359-d995-4e4d-9bd2-9b2465af2952 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:23.940689 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:41:23.999155 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c1951359-d995-4e4d-9bd2-9b2465af2952 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1e51accd4241b497623f18f0d2967d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d3ca9bcf514a8b9844377fc53143ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:24.012159 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c1951359-d995-4e4d-9bd2-9b2465af2952 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] 10.222.0.23 "GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398" status: 200 len: 1305 microversion: 2.1 time: 0.138353 Sep 10 11:41:24.013994 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 452/928] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:23 2022] GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398 => generated 1305 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:24.095770 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8a1949c1-9fda-411a-a817-0754fa6ce87f tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf661b110ecc4f36b795a980d29f312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5765e50afa045569700eab4616a6a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:24.117149 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-75b3d941-5ecd-4623-a871-59a4d5169002 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:24.118210 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-75b3d941-5ecd-4623-a871-59a4d5169002 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: ebff5197-fc62-4ee6-a688-6e12f04645b5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:24.131414 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75b3d941-5ecd-4623-a871-59a4d5169002 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:24.140166 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8a1949c1-9fda-411a-a817-0754fa6ce87f tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/servers/4c806b91-1302-494f-b4eb-a0b7ba04baf4" status: 200 len: 1472 microversion: 2.1 time: 0.361891 Sep 10 11:41:24.149920 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 477/929] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:23 2022] GET /compute/v2.1/servers/4c806b91-1302-494f-b4eb-a0b7ba04baf4 => generated 1472 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:24.150292 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75b3d941-5ecd-4623-a871-59a4d5169002 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:24.150864 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75b3d941-5ecd-4623-a871-59a4d5169002 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:24.151670 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75b3d941-5ecd-4623-a871-59a4d5169002 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:24.152153 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75b3d941-5ecd-4623-a871-59a4d5169002 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:24.152586 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75b3d941-5ecd-4623-a871-59a4d5169002 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:24.481506 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6ed0ce36-85cc-4c5a-b736-625674d7e105 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:24.482266 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6ed0ce36-85cc-4c5a-b736-625674d7e105 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: c0cd6b34-210f-4113-b870-f402c588801c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:24.508798 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6ed0ce36-85cc-4c5a-b736-625674d7e105 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:24.511915 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6ed0ce36-85cc-4c5a-b736-625674d7e105 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:24.515690 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6ed0ce36-85cc-4c5a-b736-625674d7e105 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:24.518184 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-75b3d941-5ecd-4623-a871-59a4d5169002 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:24.518945 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6ed0ce36-85cc-4c5a-b736-625674d7e105 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:24.519559 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6ed0ce36-85cc-4c5a-b736-625674d7e105 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:24.520082 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6ed0ce36-85cc-4c5a-b736-625674d7e105 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:24.529131 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-75b3d941-5ecd-4623-a871-59a4d5169002 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:24.530934 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-75b3d941-5ecd-4623-a871-59a4d5169002 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:24.532278 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-75b3d941-5ecd-4623-a871-59a4d5169002 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5" status: 200 len: 1314 microversion: 2.25 time: 0.420135 Sep 10 11:41:24.533335 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 453/930] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:24 2022] GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5 => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:41:25.007625 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6ed0ce36-85cc-4c5a-b736-625674d7e105 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:25.021176 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6ed0ce36-85cc-4c5a-b736-625674d7e105 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c" status: 200 len: 1432 microversion: 2.1 time: 0.544944 Sep 10 11:41:25.022424 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 478/931] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:24 2022] GET /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c => generated 1432 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:41:25.038998 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5ec0f7eb-fa8d-4443-a1db-882279acc3cc tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:25.040515 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5ec0f7eb-fa8d-4443-a1db-882279acc3cc tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] [instance: afb1a503-7e9a-474c-8dfe-b0e5838b7398] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:25.057201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ec0f7eb-fa8d-4443-a1db-882279acc3cc tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:25.057855 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ec0f7eb-fa8d-4443-a1db-882279acc3cc tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:25.058415 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ec0f7eb-fa8d-4443-a1db-882279acc3cc tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:25.059361 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ec0f7eb-fa8d-4443-a1db-882279acc3cc tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:25.060469 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ec0f7eb-fa8d-4443-a1db-882279acc3cc tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:25.061074 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ec0f7eb-fa8d-4443-a1db-882279acc3cc tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:25.171307 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-30db2013-31c1-48a7-95e8-3297dd49841f tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:25.172218 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-30db2013-31c1-48a7-95e8-3297dd49841f tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] [instance: 4c806b91-1302-494f-b4eb-a0b7ba04baf4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:25.187818 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30db2013-31c1-48a7-95e8-3297dd49841f tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:25.188495 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30db2013-31c1-48a7-95e8-3297dd49841f tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:25.189167 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30db2013-31c1-48a7-95e8-3297dd49841f tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:25.191743 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30db2013-31c1-48a7-95e8-3297dd49841f tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:25.192437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30db2013-31c1-48a7-95e8-3297dd49841f tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:25.196619 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30db2013-31c1-48a7-95e8-3297dd49841f tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:25.246681 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5ec0f7eb-fa8d-4443-a1db-882279acc3cc tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1e51accd4241b497623f18f0d2967d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d3ca9bcf514a8b9844377fc53143ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:25.259649 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5ec0f7eb-fa8d-4443-a1db-882279acc3cc tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] 10.222.0.23 "GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398" status: 200 len: 1303 microversion: 2.1 time: 0.226440 Sep 10 11:41:25.276624 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 454/932] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:25 2022] GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398 => generated 1303 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:25.376392 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-30db2013-31c1-48a7-95e8-3297dd49841f tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf661b110ecc4f36b795a980d29f312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5765e50afa045569700eab4616a6a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:25.385256 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-30db2013-31c1-48a7-95e8-3297dd49841f tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/servers/4c806b91-1302-494f-b4eb-a0b7ba04baf4" status: 200 len: 1430 microversion: 2.1 time: 0.221143 Sep 10 11:41:25.394629 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 479/933] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:25 2022] GET /compute/v2.1/servers/4c806b91-1302-494f-b4eb-a0b7ba04baf4 => generated 1430 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:25.558064 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f07650fe-9741-4cb8-81ef-63ff8cc9b97f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:25.558575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f07650fe-9741-4cb8-81ef-63ff8cc9b97f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: ebff5197-fc62-4ee6-a688-6e12f04645b5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:25.579922 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f07650fe-9741-4cb8-81ef-63ff8cc9b97f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:25.580430 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f07650fe-9741-4cb8-81ef-63ff8cc9b97f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:25.581023 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f07650fe-9741-4cb8-81ef-63ff8cc9b97f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:25.581765 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f07650fe-9741-4cb8-81ef-63ff8cc9b97f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:25.582228 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f07650fe-9741-4cb8-81ef-63ff8cc9b97f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:25.582662 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f07650fe-9741-4cb8-81ef-63ff8cc9b97f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:25.820152 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f07650fe-9741-4cb8-81ef-63ff8cc9b97f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:25.837717 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f07650fe-9741-4cb8-81ef-63ff8cc9b97f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:25.839435 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f07650fe-9741-4cb8-81ef-63ff8cc9b97f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:25.846193 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f07650fe-9741-4cb8-81ef-63ff8cc9b97f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5" status: 200 len: 1320 microversion: 2.25 time: 0.292108 Sep 10 11:41:25.852286 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 455/934] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:25 2022] GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5 => generated 1320 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:25.920887 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-380a3e8b-47a3-4213-a7d7-b56d751b003a req-a862c02d-2ed2-4100-a469-6c38cd1159a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0cd6b34-210f-4113-b870-f402c588801c", "name": "network-vif-deleted", "tag": "f33545ba-898c-40db-b80a-66a1332af80f"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:25.937217 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-380a3e8b-47a3-4213-a7d7-b56d751b003a req-a862c02d-2ed2-4100-a469-6c38cd1159a8 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:25.946078 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-380a3e8b-47a3-4213-a7d7-b56d751b003a req-a862c02d-2ed2-4100-a469-6c38cd1159a8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:25.949810 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-380a3e8b-47a3-4213-a7d7-b56d751b003a req-a862c02d-2ed2-4100-a469-6c38cd1159a8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:26.007959 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-380a3e8b-47a3-4213-a7d7-b56d751b003a req-a862c02d-2ed2-4100-a469-6c38cd1159a8 service nova] Creating event network-vif-deleted:f33545ba-898c-40db-b80a-66a1332af80f for instance c0cd6b34-210f-4113-b870-f402c588801c on n-h2-856895-1 Sep 10 11:41:26.021723 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-380a3e8b-47a3-4213-a7d7-b56d751b003a req-a862c02d-2ed2-4100-a469-6c38cd1159a8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102844 Sep 10 11:41:26.023684 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 480/935] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:41:26.047237 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d2d5d401-28a7-42dd-8abd-fbab4eea2d7b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:26.048643 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d2d5d401-28a7-42dd-8abd-fbab4eea2d7b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: c0cd6b34-210f-4113-b870-f402c588801c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:26.071873 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2d5d401-28a7-42dd-8abd-fbab4eea2d7b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:26.072734 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2d5d401-28a7-42dd-8abd-fbab4eea2d7b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:26.073365 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2d5d401-28a7-42dd-8abd-fbab4eea2d7b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:26.080746 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2d5d401-28a7-42dd-8abd-fbab4eea2d7b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:26.081345 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2d5d401-28a7-42dd-8abd-fbab4eea2d7b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:26.082017 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2d5d401-28a7-42dd-8abd-fbab4eea2d7b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:26.210399 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2d5d401-28a7-42dd-8abd-fbab4eea2d7b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:26.210805 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2d5d401-28a7-42dd-8abd-fbab4eea2d7b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:26.211271 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2d5d401-28a7-42dd-8abd-fbab4eea2d7b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:26.211735 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-d2d5d401-28a7-42dd-8abd-fbab4eea2d7b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lazy-loading 'fault' on Instance uuid c0cd6b34-210f-4113-b870-f402c588801c {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:41:26.290788 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-20e15f0e-d202-4c41-a567-554018339981 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:26.291575 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-20e15f0e-d202-4c41-a567-554018339981 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] [instance: afb1a503-7e9a-474c-8dfe-b0e5838b7398] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:26.311659 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-20e15f0e-d202-4c41-a567-554018339981 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:26.312093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-20e15f0e-d202-4c41-a567-554018339981 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:26.314587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-20e15f0e-d202-4c41-a567-554018339981 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:26.315567 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-20e15f0e-d202-4c41-a567-554018339981 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:26.317041 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-20e15f0e-d202-4c41-a567-554018339981 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:26.327196 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-20e15f0e-d202-4c41-a567-554018339981 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:26.414598 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d2d5d401-28a7-42dd-8abd-fbab4eea2d7b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f8ba457fba4e67a97dd156c2bfaa0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23bf60ed08b4adca30b90ecfb9e540d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:26.426427 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d2d5d401-28a7-42dd-8abd-fbab4eea2d7b tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c" status: 200 len: 1308 microversion: 2.1 time: 0.382996 Sep 10 11:41:26.426977 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 456/936] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:26 2022] GET /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c => generated 1308 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:26.475372 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-57f87d39-b4ce-4e96-9f7a-4ae141a10f21 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:26.477470 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-57f87d39-b4ce-4e96-9f7a-4ae141a10f21 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] [instance: 4c806b91-1302-494f-b4eb-a0b7ba04baf4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:26.507881 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-57f87d39-b4ce-4e96-9f7a-4ae141a10f21 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:26.510598 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-57f87d39-b4ce-4e96-9f7a-4ae141a10f21 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:26.512652 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-57f87d39-b4ce-4e96-9f7a-4ae141a10f21 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:26.517151 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-57f87d39-b4ce-4e96-9f7a-4ae141a10f21 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:26.517935 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-57f87d39-b4ce-4e96-9f7a-4ae141a10f21 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:26.520093 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-57f87d39-b4ce-4e96-9f7a-4ae141a10f21 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:26.646181 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-20e15f0e-d202-4c41-a567-554018339981 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1e51accd4241b497623f18f0d2967d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d3ca9bcf514a8b9844377fc53143ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:26.657773 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-20e15f0e-d202-4c41-a567-554018339981 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] 10.222.0.23 "GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398" status: 200 len: 1303 microversion: 2.1 time: 0.371439 Sep 10 11:41:26.663646 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 481/937] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:26 2022] GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398 => generated 1303 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:26.727442 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-57f87d39-b4ce-4e96-9f7a-4ae141a10f21 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf661b110ecc4f36b795a980d29f312a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5765e50afa045569700eab4616a6a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:26.741087 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-57f87d39-b4ce-4e96-9f7a-4ae141a10f21 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/servers/4c806b91-1302-494f-b4eb-a0b7ba04baf4" status: 200 len: 1301 microversion: 2.1 time: 0.293564 Sep 10 11:41:26.755525 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 457/938] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:26 2022] GET /compute/v2.1/servers/4c806b91-1302-494f-b4eb-a0b7ba04baf4 => generated 1301 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:26.879506 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a1346bf9-3d9e-431b-aad8-3708f491077f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:26.880125 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a1346bf9-3d9e-431b-aad8-3708f491077f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: ebff5197-fc62-4ee6-a688-6e12f04645b5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:26.907302 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a1346bf9-3d9e-431b-aad8-3708f491077f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:26.907817 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a1346bf9-3d9e-431b-aad8-3708f491077f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:26.909405 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a1346bf9-3d9e-431b-aad8-3708f491077f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:26.910953 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a1346bf9-3d9e-431b-aad8-3708f491077f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:26.912929 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a1346bf9-3d9e-431b-aad8-3708f491077f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:26.921592 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a1346bf9-3d9e-431b-aad8-3708f491077f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:27.181935 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a1346bf9-3d9e-431b-aad8-3708f491077f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:27.204649 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a1346bf9-3d9e-431b-aad8-3708f491077f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:27.206396 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a1346bf9-3d9e-431b-aad8-3708f491077f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:27.207808 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a1346bf9-3d9e-431b-aad8-3708f491077f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5" status: 200 len: 1320 microversion: 2.25 time: 0.332329 Sep 10 11:41:27.209673 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 482/939] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:26 2022] GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5 => generated 1320 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:27.455456 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-986a2979-45bc-4737-996a-97407eb2e1a2 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:27.457092 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-986a2979-45bc-4737-996a-97407eb2e1a2 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] [instance: c0cd6b34-210f-4113-b870-f402c588801c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:27.486844 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-986a2979-45bc-4737-996a-97407eb2e1a2 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:27.487495 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-986a2979-45bc-4737-996a-97407eb2e1a2 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:27.487946 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-986a2979-45bc-4737-996a-97407eb2e1a2 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:27.490020 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-986a2979-45bc-4737-996a-97407eb2e1a2 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:27.491804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-986a2979-45bc-4737-996a-97407eb2e1a2 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:27.493087 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-986a2979-45bc-4737-996a-97407eb2e1a2 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:27.524167 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-986a2979-45bc-4737-996a-97407eb2e1a2 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] HTTP exception thrown: Instance c0cd6b34-210f-4113-b870-f402c588801c could not be found. Sep 10 11:41:27.527899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-986a2979-45bc-4737-996a-97407eb2e1a2 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Request method failure captured: Sep 10 11:41:27.527899 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c HTTP/1.1 Sep 10 11:41:27.527899 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:41:27.527899 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:41:27.527899 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:41:27.527899 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:41:27.527899 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:41:27.527899 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:41:27.527899 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:41:27.527899 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:41:27.527899 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHeSNW7_f7LDDJrVeYQQbVmE7FX0ZnkA6aK_zgWBduWc9TcLvMfRz0s6RZ72ejJdgD5a9tTzrc_f7sx7Q5c4egckCAwk6fuoCPuUKQ6-KujA215bl8IZ1ir0CX1amIit8NWRLTdHZg7dCXx2jwTwTLfYOzf6xDSAAMwU9Bu1o4JscYc Sep 10 11:41:27.527899 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:41:27.527899 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:41:27.527899 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:41:27.527899 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:41:27.527899 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:41:27.527899 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:41:27.527899 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: b23bf60ed08b4adca30b90ecfb9e540d Sep 10 11:41:27.527899 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-LiveMigrationNegativeTest-1921585268 Sep 10 11:41:27.527899 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:41:27.527899 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:41:27.529909 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b23bf60ed08b4adca30b90ecfb9e540d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b23bf60ed08b4adca30b90ecfb9e540d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b23bf60ed08b4adca30b90ecfb9e540d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b23bf60ed08b4adca30b90ecfb9e540d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:41:27.529909 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-LiveMigrationNegativeTest-1921585268 Sep 10 11:41:27.529909 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: b23bf60ed08b4adca30b90ecfb9e540d Sep 10 11:41:27.529909 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1921585268 Sep 10 11:41:27.529909 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-LiveMigrationNegativeTest-1921585268-project Sep 10 11:41:27.529909 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:41:27.529909 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:41:27.529909 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 73f8ba457fba4e67a97dd156c2bfaa0f Sep 10 11:41:27.529909 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-LiveMigrationNegativeTest-1921585268-project Sep 10 11:41:27.529909 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:41:27.529909 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance c0cd6b34-210f-4113-b870-f402c588801c could not be found. Sep 10 11:41:27.529909 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'c0cd6b34-210f-4113-b870-f402c588801c'} Sep 10 11:41:27.530721 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:41:27.530721 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:27.530721 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:41:27.530721 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:41:27.530721 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:41:27.530721 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:41:27.530721 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:41:27.530721 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:41:27.530721 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:41:27.530721 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:41:27.530721 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0cd6b34-210f-4113-b870-f402c588801c could not be found. Sep 10 11:41:27.530721 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:27.530721 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:27.530721 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:27.530721 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:27.530721 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:27.530721 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:27.530721 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:41:27.530721 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:41:27.530721 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:41:27.532436 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:41:27.532436 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:41:27.532436 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:41:27.532436 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:41:27.532436 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:41:27.532436 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:41:27.532436 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:41:27.532436 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0cd6b34-210f-4113-b870-f402c588801c could not be found. Sep 10 11:41:27.532436 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:27.532436 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:27.532436 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:27.532436 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:27.532436 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:27.532436 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:27.532436 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:41:27.532436 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:41:27.532436 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0cd6b34-210f-4113-b870-f402c588801c could not be found. Sep 10 11:41:27.532436 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:27.533501 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-986a2979-45bc-4737-996a-97407eb2e1a2 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] Returning 404 to user: Instance c0cd6b34-210f-4113-b870-f402c588801c could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:41:27.533501 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-986a2979-45bc-4737-996a-97407eb2e1a2 tempest-LiveMigrationNegativeTest-1921585268 tempest-LiveMigrationNegativeTest-1921585268-project] 10.222.0.23 "GET /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c" status: 404 len: 111 microversion: 2.1 time: 0.082059 Sep 10 11:41:27.533635 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 458/940] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:27 2022] GET /compute/v2.1/servers/c0cd6b34-210f-4113-b870-f402c588801c => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:41:27.690560 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bdda6628-73b8-424f-8c2d-e1bf82b6c9d7 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:27.692776 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bdda6628-73b8-424f-8c2d-e1bf82b6c9d7 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] [instance: afb1a503-7e9a-474c-8dfe-b0e5838b7398] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:27.706690 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bdda6628-73b8-424f-8c2d-e1bf82b6c9d7 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:27.709498 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bdda6628-73b8-424f-8c2d-e1bf82b6c9d7 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:27.710240 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bdda6628-73b8-424f-8c2d-e1bf82b6c9d7 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:27.713122 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bdda6628-73b8-424f-8c2d-e1bf82b6c9d7 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:27.716341 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bdda6628-73b8-424f-8c2d-e1bf82b6c9d7 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:27.717833 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bdda6628-73b8-424f-8c2d-e1bf82b6c9d7 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:27.780440 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6d46cde5-120f-4cac-bca4-99f17effd780 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:27.781071 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6d46cde5-120f-4cac-bca4-99f17effd780 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] [instance: 4c806b91-1302-494f-b4eb-a0b7ba04baf4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:27.804517 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6d46cde5-120f-4cac-bca4-99f17effd780 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:27.805492 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6d46cde5-120f-4cac-bca4-99f17effd780 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:27.806144 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6d46cde5-120f-4cac-bca4-99f17effd780 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:27.807151 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6d46cde5-120f-4cac-bca4-99f17effd780 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:27.807831 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6d46cde5-120f-4cac-bca4-99f17effd780 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:27.808475 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6d46cde5-120f-4cac-bca4-99f17effd780 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:27.855727 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-6d46cde5-120f-4cac-bca4-99f17effd780 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] HTTP exception thrown: Instance 4c806b91-1302-494f-b4eb-a0b7ba04baf4 could not be found. Sep 10 11:41:27.858830 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6d46cde5-120f-4cac-bca4-99f17effd780 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Request method failure captured: Sep 10 11:41:27.858830 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/4c806b91-1302-494f-b4eb-a0b7ba04baf4 HTTP/1.1 Sep 10 11:41:27.858830 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:41:27.858830 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:41:27.858830 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:41:27.858830 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:41:27.858830 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:41:27.858830 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:41:27.858830 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:41:27.858830 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:41:27.858830 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHeNZh0QsKAWCri91V-XMNBwVyxCngmCDeOu57JghGMX0SdTAhjYXC-vR2THqetjhfs7l1FgyGX-IA3A_GwYS8xxZndnjNDFjnU2duWH_9QvpHXc2SSZe4-4m4gx_aWPfm1_tQNvJ2Qck3faUpPuLXwa9CvGlianXQAQkKT7n56Ekc0 Sep 10 11:41:27.858830 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:41:27.858830 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:41:27.858830 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:41:27.858830 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:41:27.858830 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:41:27.858830 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:41:27.858830 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: d5765e50afa045569700eab4616a6a43 Sep 10 11:41:27.858830 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ImagesOneServerTestJSON-621761848 Sep 10 11:41:27.858830 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:41:27.858830 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:41:27.860237 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d5765e50afa045569700eab4616a6a43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d5765e50afa045569700eab4616a6a43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d5765e50afa045569700eab4616a6a43", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d5765e50afa045569700eab4616a6a43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:41:27.860237 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ImagesOneServerTestJSON-621761848 Sep 10 11:41:27.860237 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: d5765e50afa045569700eab4616a6a43 Sep 10 11:41:27.860237 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-621761848 Sep 10 11:41:27.860237 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ImagesOneServerTestJSON-621761848-project Sep 10 11:41:27.860237 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:41:27.860237 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:41:27.860237 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: cf661b110ecc4f36b795a980d29f312a Sep 10 11:41:27.860237 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ImagesOneServerTestJSON-621761848-project Sep 10 11:41:27.860237 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:41:27.860237 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 4c806b91-1302-494f-b4eb-a0b7ba04baf4 could not be found. Sep 10 11:41:27.860237 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '4c806b91-1302-494f-b4eb-a0b7ba04baf4'} Sep 10 11:41:27.860988 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:41:27.860988 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:27.860988 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:41:27.860988 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:41:27.860988 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:41:27.860988 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:41:27.860988 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:41:27.860988 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:41:27.860988 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:41:27.860988 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:41:27.860988 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c806b91-1302-494f-b4eb-a0b7ba04baf4 could not be found. Sep 10 11:41:27.860988 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:27.860988 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:27.860988 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:27.860988 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:27.860988 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:27.860988 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:27.860988 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:41:27.860988 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:41:27.860988 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:41:27.862183 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:41:27.862183 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:41:27.862183 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:41:27.862183 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:41:27.862183 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:41:27.862183 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:41:27.862183 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:41:27.862183 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c806b91-1302-494f-b4eb-a0b7ba04baf4 could not be found. Sep 10 11:41:27.862183 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:27.862183 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:27.862183 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:27.862183 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:27.862183 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:27.862183 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:27.862183 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:41:27.862183 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:41:27.862183 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c806b91-1302-494f-b4eb-a0b7ba04baf4 could not be found. Sep 10 11:41:27.862183 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:41:27.869591 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6d46cde5-120f-4cac-bca4-99f17effd780 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] Returning 404 to user: Instance 4c806b91-1302-494f-b4eb-a0b7ba04baf4 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:41:27.875495 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6d46cde5-120f-4cac-bca4-99f17effd780 tempest-ImagesOneServerTestJSON-621761848 tempest-ImagesOneServerTestJSON-621761848-project] 10.222.0.23 "GET /compute/v2.1/servers/4c806b91-1302-494f-b4eb-a0b7ba04baf4" status: 404 len: 111 microversion: 2.1 time: 0.104214 Sep 10 11:41:27.877900 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 459/941] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:27 2022] GET /compute/v2.1/servers/4c806b91-1302-494f-b4eb-a0b7ba04baf4 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:41:27.987607 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bdda6628-73b8-424f-8c2d-e1bf82b6c9d7 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1e51accd4241b497623f18f0d2967d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d3ca9bcf514a8b9844377fc53143ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:28.008080 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bdda6628-73b8-424f-8c2d-e1bf82b6c9d7 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] 10.222.0.23 "GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398" status: 200 len: 1303 microversion: 2.1 time: 0.322575 Sep 10 11:41:28.010152 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 483/942] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:27 2022] GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398 => generated 1303 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:28.243370 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6fd10f5e-89c9-4a7a-9ccc-7a992fe310be tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:28.244627 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6fd10f5e-89c9-4a7a-9ccc-7a992fe310be tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: ebff5197-fc62-4ee6-a688-6e12f04645b5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:28.258657 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6fd10f5e-89c9-4a7a-9ccc-7a992fe310be tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:28.259519 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6fd10f5e-89c9-4a7a-9ccc-7a992fe310be tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:28.260739 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6fd10f5e-89c9-4a7a-9ccc-7a992fe310be tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:28.261702 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6fd10f5e-89c9-4a7a-9ccc-7a992fe310be tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:28.262683 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6fd10f5e-89c9-4a7a-9ccc-7a992fe310be tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:28.263556 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6fd10f5e-89c9-4a7a-9ccc-7a992fe310be tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:28.337461 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-33f65657-837e-46d0-812c-0f99fb2889d0 req-d1d3168e-da00-4f15-8c78-bcfd90fd4fdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c806b91-1302-494f-b4eb-a0b7ba04baf4", "name": "network-vif-deleted", "tag": "3488be85-30de-46d4-a138-f4f55f4c37ce"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:28.365139 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-33f65657-837e-46d0-812c-0f99fb2889d0 req-d1d3168e-da00-4f15-8c78-bcfd90fd4fdf service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:28.370212 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-33f65657-837e-46d0-812c-0f99fb2889d0 req-d1d3168e-da00-4f15-8c78-bcfd90fd4fdf service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:28.372616 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-33f65657-837e-46d0-812c-0f99fb2889d0 req-d1d3168e-da00-4f15-8c78-bcfd90fd4fdf service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:28.402203 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-33f65657-837e-46d0-812c-0f99fb2889d0 req-d1d3168e-da00-4f15-8c78-bcfd90fd4fdf service nova] Creating event network-vif-deleted:3488be85-30de-46d4-a138-f4f55f4c37ce for instance 4c806b91-1302-494f-b4eb-a0b7ba04baf4 on n-h2-856895-1 Sep 10 11:41:28.416888 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-33f65657-837e-46d0-812c-0f99fb2889d0 req-d1d3168e-da00-4f15-8c78-bcfd90fd4fdf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082520 Sep 10 11:41:28.419603 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 484/943] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:41:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:41:28.577206 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6fd10f5e-89c9-4a7a-9ccc-7a992fe310be tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:28.596157 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6fd10f5e-89c9-4a7a-9ccc-7a992fe310be tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:28.599152 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6fd10f5e-89c9-4a7a-9ccc-7a992fe310be tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:28.600923 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6fd10f5e-89c9-4a7a-9ccc-7a992fe310be tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5" status: 200 len: 1362 microversion: 2.25 time: 0.366570 Sep 10 11:41:28.615992 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 460/944] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:28 2022] GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5 => generated 1362 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:29.041277 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-71eb0c5b-4c24-4db0-be09-ae31cd2d1431 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:29.042352 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-71eb0c5b-4c24-4db0-be09-ae31cd2d1431 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] [instance: afb1a503-7e9a-474c-8dfe-b0e5838b7398] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:29.067829 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71eb0c5b-4c24-4db0-be09-ae31cd2d1431 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:29.070425 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71eb0c5b-4c24-4db0-be09-ae31cd2d1431 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:29.071326 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71eb0c5b-4c24-4db0-be09-ae31cd2d1431 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:29.073102 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71eb0c5b-4c24-4db0-be09-ae31cd2d1431 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:29.076003 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71eb0c5b-4c24-4db0-be09-ae31cd2d1431 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:29.076686 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71eb0c5b-4c24-4db0-be09-ae31cd2d1431 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:29.548376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-71eb0c5b-4c24-4db0-be09-ae31cd2d1431 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1e51accd4241b497623f18f0d2967d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d3ca9bcf514a8b9844377fc53143ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:29.571317 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-71eb0c5b-4c24-4db0-be09-ae31cd2d1431 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] 10.222.0.23 "GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398" status: 200 len: 1371 microversion: 2.1 time: 0.535421 Sep 10 11:41:29.605912 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 485/945] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:29 2022] GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398 => generated 1371 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:29.632557 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b2a39010-30c8-43f5-9d99-8e6d6d9648d1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:29.633237 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b2a39010-30c8-43f5-9d99-8e6d6d9648d1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: ebff5197-fc62-4ee6-a688-6e12f04645b5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:29.636134 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:41:29.651564 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2a39010-30c8-43f5-9d99-8e6d6d9648d1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:29.652072 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2a39010-30c8-43f5-9d99-8e6d6d9648d1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:29.655919 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2a39010-30c8-43f5-9d99-8e6d6d9648d1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:29.656881 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2a39010-30c8-43f5-9d99-8e6d6d9648d1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:29.658163 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2a39010-30c8-43f5-9d99-8e6d6d9648d1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:29.663649 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2a39010-30c8-43f5-9d99-8e6d6d9648d1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:29.807730 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-5492fb35-1e7f-4109-9836-9b9801412c51 req-8ccef37d-0ae1-47e1-aefe-149ff091e292 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebff5197-fc62-4ee6-a688-6e12f04645b5", "tag": "cbd26a57-8480-4427-a718-f5ccf1736f8d"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:29.833075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-5492fb35-1e7f-4109-9836-9b9801412c51 req-8ccef37d-0ae1-47e1-aefe-149ff091e292 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:29.835733 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-5492fb35-1e7f-4109-9836-9b9801412c51 req-8ccef37d-0ae1-47e1-aefe-149ff091e292 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:29.836380 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-5492fb35-1e7f-4109-9836-9b9801412c51 req-8ccef37d-0ae1-47e1-aefe-149ff091e292 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:29.871307 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-5492fb35-1e7f-4109-9836-9b9801412c51 req-8ccef37d-0ae1-47e1-aefe-149ff091e292 service nova] Creating event network-changed:cbd26a57-8480-4427-a718-f5ccf1736f8d for instance ebff5197-fc62-4ee6-a688-6e12f04645b5 on n-h2-856895-1 Sep 10 11:41:29.883753 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-5492fb35-1e7f-4109-9836-9b9801412c51 req-8ccef37d-0ae1-47e1-aefe-149ff091e292 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080998 Sep 10 11:41:29.885029 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 486/946] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:41:30.300113 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b2a39010-30c8-43f5-9d99-8e6d6d9648d1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:30.317413 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b2a39010-30c8-43f5-9d99-8e6d6d9648d1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:30.321970 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b2a39010-30c8-43f5-9d99-8e6d6d9648d1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:30.327123 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b2a39010-30c8-43f5-9d99-8e6d6d9648d1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5" status: 200 len: 1362 microversion: 2.25 time: 0.696670 Sep 10 11:41:30.330684 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 461/947] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:29 2022] GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5 => generated 1362 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:30.612112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ed69ef98-6391-41e4-a8d4-7a80bb0f5eab tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:30.612830 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ed69ef98-6391-41e4-a8d4-7a80bb0f5eab tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] [instance: afb1a503-7e9a-474c-8dfe-b0e5838b7398] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:30.626500 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ed69ef98-6391-41e4-a8d4-7a80bb0f5eab tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:30.627672 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ed69ef98-6391-41e4-a8d4-7a80bb0f5eab tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:30.628128 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ed69ef98-6391-41e4-a8d4-7a80bb0f5eab tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:30.628871 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ed69ef98-6391-41e4-a8d4-7a80bb0f5eab tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:30.629335 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ed69ef98-6391-41e4-a8d4-7a80bb0f5eab tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:30.631423 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ed69ef98-6391-41e4-a8d4-7a80bb0f5eab tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:31.125661 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ed69ef98-6391-41e4-a8d4-7a80bb0f5eab tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1e51accd4241b497623f18f0d2967d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d3ca9bcf514a8b9844377fc53143ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:31.148451 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ed69ef98-6391-41e4-a8d4-7a80bb0f5eab tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] 10.222.0.23 "GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398" status: 200 len: 1371 microversion: 2.1 time: 0.540387 Sep 10 11:41:31.154524 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 487/948] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:30 2022] GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398 => generated 1371 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:41:31.355252 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7ca2556c-a91a-408b-b062-2072236e5e98 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:31.356723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7ca2556c-a91a-408b-b062-2072236e5e98 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: ebff5197-fc62-4ee6-a688-6e12f04645b5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:31.379582 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ca2556c-a91a-408b-b062-2072236e5e98 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:31.380885 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ca2556c-a91a-408b-b062-2072236e5e98 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:31.381538 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ca2556c-a91a-408b-b062-2072236e5e98 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:31.382465 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ca2556c-a91a-408b-b062-2072236e5e98 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:31.383124 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ca2556c-a91a-408b-b062-2072236e5e98 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:31.383809 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ca2556c-a91a-408b-b062-2072236e5e98 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:31.511122 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:41:31.867790 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5c8bdb80-946e-4b92-95dc-6f9e30d9e65d tempest-ListImagesTestJSON-1283484247 tempest-ListImagesTestJSON-1283484247-project] Calling method '.version_select at 0x7f40736659d0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:31.964177 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7ca2556c-a91a-408b-b062-2072236e5e98 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:31.976156 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7ca2556c-a91a-408b-b062-2072236e5e98 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:31.980849 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7ca2556c-a91a-408b-b062-2072236e5e98 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:31.982992 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7ca2556c-a91a-408b-b062-2072236e5e98 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5" status: 200 len: 1362 microversion: 2.25 time: 0.631544 Sep 10 11:41:31.988139 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 488/949] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:31 2022] GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5 => generated 1362 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:31.989170 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5c8bdb80-946e-4b92-95dc-6f9e30d9e65d tempest-ListImagesTestJSON-1283484247 tempest-ListImagesTestJSON-1283484247-project] 10.222.0.23 "GET /compute/v2.1/images/c23d4d62-7ab9-4623-9273-7f44582aa2e1" status: 200 len: 784 microversion: 2.1 time: 0.835118 Sep 10 11:41:31.990245 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 462/950] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:41:31 2022] GET /compute/v2.1/images/c23d4d62-7ab9-4623-9273-7f44582aa2e1 => generated 784 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:41:32.005603 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2555e2cc-9560-4608-b298-1673969f8115 tempest-ListImagesTestJSON-1283484247 tempest-ListImagesTestJSON-1283484247-project] Calling method '.version_select at 0x7f4073842dc0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:32.183136 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c548e127-99f0-4c25-8968-3162a28cb5d6 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:32.183859 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c548e127-99f0-4c25-8968-3162a28cb5d6 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] [instance: afb1a503-7e9a-474c-8dfe-b0e5838b7398] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:32.216942 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c548e127-99f0-4c25-8968-3162a28cb5d6 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:32.218059 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c548e127-99f0-4c25-8968-3162a28cb5d6 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:32.224069 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c548e127-99f0-4c25-8968-3162a28cb5d6 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:32.226108 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c548e127-99f0-4c25-8968-3162a28cb5d6 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:32.227393 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c548e127-99f0-4c25-8968-3162a28cb5d6 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:32.228723 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c548e127-99f0-4c25-8968-3162a28cb5d6 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:32.233471 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2555e2cc-9560-4608-b298-1673969f8115 tempest-ListImagesTestJSON-1283484247 tempest-ListImagesTestJSON-1283484247-project] 10.222.0.23 "GET /compute/v2.1/images" status: 200 len: 871 microversion: 2.1 time: 0.231721 Sep 10 11:41:32.240134 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 489/951] 10.222.0.23 () {58 vars in 1122 bytes} [Sat Sep 10 11:41:32 2022] GET /compute/v2.1/images => generated 871 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:41:32.249680 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-510e18b1-6a87-499d-84c3-7604f8ceb6fa tempest-ListImagesTestJSON-1283484247 tempest-ListImagesTestJSON-1283484247-project] Calling method '.version_select at 0x7f407328e4c0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:32.347152 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:41:32.387391 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=10 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:41:32.391357 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-510e18b1-6a87-499d-84c3-7604f8ceb6fa tempest-ListImagesTestJSON-1283484247 tempest-ListImagesTestJSON-1283484247-project] 10.222.0.23 "GET /compute/v2.1/images/detail" status: 200 len: 1475 microversion: 2.1 time: 0.143924 Sep 10 11:41:32.391357 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 490/952] 10.222.0.23 () {58 vars in 1143 bytes} [Sat Sep 10 11:41:32 2022] GET /compute/v2.1/images/detail => generated 1475 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:32.944286 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c548e127-99f0-4c25-8968-3162a28cb5d6 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1e51accd4241b497623f18f0d2967d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d3ca9bcf514a8b9844377fc53143ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:32.958044 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c548e127-99f0-4c25-8968-3162a28cb5d6 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] 10.222.0.23 "GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398" status: 200 len: 1371 microversion: 2.1 time: 0.781417 Sep 10 11:41:32.982093 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 463/953] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:32 2022] GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398 => generated 1371 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:41:33.015822 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1a1e9df9-b98a-4b7b-b925-baac70dbbdb4 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:33.016434 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1a1e9df9-b98a-4b7b-b925-baac70dbbdb4 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: ebff5197-fc62-4ee6-a688-6e12f04645b5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:33.040727 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1a1e9df9-b98a-4b7b-b925-baac70dbbdb4 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:33.041653 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1a1e9df9-b98a-4b7b-b925-baac70dbbdb4 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:33.042259 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1a1e9df9-b98a-4b7b-b925-baac70dbbdb4 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:33.043183 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1a1e9df9-b98a-4b7b-b925-baac70dbbdb4 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:33.043894 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1a1e9df9-b98a-4b7b-b925-baac70dbbdb4 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:33.044613 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1a1e9df9-b98a-4b7b-b925-baac70dbbdb4 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:33.098168 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=8 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:41:33.166421 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-61de9ed6-4142-43fc-ace1-5e994faaa9c9 req-e7933d9c-024a-479f-bec5-dc500fd9c08e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afb1a503-7e9a-474c-8dfe-b0e5838b7398", "tag": "8e001c1d-f9ea-4023-b007-0e7a4da45c81"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:33.189772 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-61de9ed6-4142-43fc-ace1-5e994faaa9c9 req-e7933d9c-024a-479f-bec5-dc500fd9c08e service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:33.190513 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-61de9ed6-4142-43fc-ace1-5e994faaa9c9 req-e7933d9c-024a-479f-bec5-dc500fd9c08e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:33.195479 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-61de9ed6-4142-43fc-ace1-5e994faaa9c9 req-e7933d9c-024a-479f-bec5-dc500fd9c08e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:33.224952 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-61de9ed6-4142-43fc-ace1-5e994faaa9c9 req-e7933d9c-024a-479f-bec5-dc500fd9c08e service nova] Creating event network-changed:8e001c1d-f9ea-4023-b007-0e7a4da45c81 for instance afb1a503-7e9a-474c-8dfe-b0e5838b7398 on n-h1-856895-1 Sep 10 11:41:33.238201 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-61de9ed6-4142-43fc-ace1-5e994faaa9c9 req-e7933d9c-024a-479f-bec5-dc500fd9c08e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075966 Sep 10 11:41:33.244261 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 464/954] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:41:33.873865 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1a1e9df9-b98a-4b7b-b925-baac70dbbdb4 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:33.885959 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1a1e9df9-b98a-4b7b-b925-baac70dbbdb4 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:33.900556 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1a1e9df9-b98a-4b7b-b925-baac70dbbdb4 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:33.902316 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1a1e9df9-b98a-4b7b-b925-baac70dbbdb4 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5" status: 200 len: 1362 microversion: 2.25 time: 0.891244 Sep 10 11:41:33.910870 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 491/955] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:33 2022] GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5 => generated 1362 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:33.987563 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f56a8aa9-3885-4449-925a-5d7f7270d5c6 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:33.989101 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f56a8aa9-3885-4449-925a-5d7f7270d5c6 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] [instance: afb1a503-7e9a-474c-8dfe-b0e5838b7398] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:34.034986 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f56a8aa9-3885-4449-925a-5d7f7270d5c6 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:34.035659 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f56a8aa9-3885-4449-925a-5d7f7270d5c6 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:34.036392 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f56a8aa9-3885-4449-925a-5d7f7270d5c6 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:34.037500 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f56a8aa9-3885-4449-925a-5d7f7270d5c6 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:34.038204 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f56a8aa9-3885-4449-925a-5d7f7270d5c6 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:34.038860 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f56a8aa9-3885-4449-925a-5d7f7270d5c6 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:34.820392 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0f6087d0-8aac-4460-8957-30764a996243 tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] Action: 'create', calling method: .version_select at 0x7f4073dfb700>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYfWAx+ommOevELwzQArW3ZF5XF5Uh6aFesKCBRCRxgPxXgo8wHzOyGS/cFoyFF4vaJF5yHxSYgp2UINS5KDdV95YhBt3/3xCrjPjZUd5X08CC4B7rQo2hLVkbc6Cs0Rw=="}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:34.835529 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0f6087d0-8aac-4460-8957-30764a996243 tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] Request method failure captured: Sep 10 11:41:34.835529 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 10 11:41:34.835529 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:41:34.835529 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:41:34.835529 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:41:34.835529 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 257 Sep 10 11:41:34.835529 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:41:34.835529 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:41:34.835529 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:41:34.835529 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:41:34.835529 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHfti-3Vf4NGaH1KwuRm8Nc6-eVbMKEfsJxPI4L-SQQ4oqndZE-BckWgsvhmGI7GziE1PoM8Mg8dvDMIqD8drhPcfEjkI0QoJGT_9bOMLsg92CTIpC6ttuAU3Oql44TVBJcOkXvVZ71kuklAXR7R7Ha6EYOn48mNTowZC66QkXFcubE Sep 10 11:41:34.835529 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:41:34.835529 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:41:34.835529 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:41:34.835529 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:41:34.835529 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:41:34.835529 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:41:34.835529 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 707465bd369546489d0c0ecefdf9e4da Sep 10 11:41:34.835529 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1189804488 Sep 10 11:41:34.835529 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:41:34.835529 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:41:34.836992 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/707465bd369546489d0c0ecefdf9e4da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/707465bd369546489d0c0ecefdf9e4da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_707465bd369546489d0c0ecefdf9e4da", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/707465bd369546489d0c0ecefdf9e4da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:41:34.836992 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1189804488 Sep 10 11:41:34.836992 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 707465bd369546489d0c0ecefdf9e4da Sep 10 11:41:34.836992 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1189804488 Sep 10 11:41:34.836992 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-KeyPairsNegativeTestJSON-1189804488-project Sep 10 11:41:34.836992 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:41:34.836992 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:41:34.836992 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 7ed6d0401bea4e5e99b0d73ce3b84328 Sep 10 11:41:34.836992 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1189804488-project Sep 10 11:41:34.836992 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:41:34.836992 n-d-856895-1 devstack@n-api.service[128777]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYfWAx+ommOevELwzQArW3ZF5XF5Uh6aFesKCBRCRxgPxXgo8wHzOyGS/cFoyFF4vaJF5yHxSYgp2UINS5KDdV95YhBt3/3xCrjPjZUd5X08CC4B7rQo2hLVkbc6Cs0Rw=="}} Sep 10 11:41:34.837713 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:41:34.837713 n-d-856895-1 devstack@n-api.service[128777]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 10 11:41:34.837713 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYfWAx+ommOevELwzQArW3ZF5XF5Uh6aFesKCBRCRxgPxXgo8wHzOyGS/cFoyFF4vaJF5yHxSYgp2UINS5KDdV95YhBt3/3xCrjPjZUd5X08CC4B7rQo2hLVkbc6Cs0Rw=='}}} Sep 10 11:41:34.837713 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:41:34.837713 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:34.837713 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 10 11:41:34.837713 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 10 11:41:34.837713 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Sep 10 11:41:34.837713 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Sep 10 11:41:34.837713 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Sep 10 11:41:34.837713 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Sep 10 11:41:34.837713 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 10 11:41:34.837713 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:34.837713 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 10 11:41:34.837713 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:34.837713 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:34.837713 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 11:41:34.838823 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 11:41:34.838823 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 11:41:34.838823 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise error Sep 10 11:41:34.838823 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Sep 10 11:41:34.838823 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:34.838823 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Sep 10 11:41:34.838823 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Sep 10 11:41:34.838823 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Sep 10 11:41:34.838823 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi 'minLength': 1, Sep 10 11:41:34.838823 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 10 11:41:34.838823 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:34.838823 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Sep 10 11:41:34.838823 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Sep 10 11:41:34.838823 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:34.838823 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:34.838823 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:34.838823 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:34.838823 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:34.838823 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:34.838823 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:41:34.838823 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:41:34.838823 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:41:34.838823 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:41:34.840346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:41:34.840346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:41:34.840346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:41:34.840346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:41:34.840346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 11:41:34.840346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 11:41:34.840346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 11:41:34.840346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 11:41:34.840346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 11:41:34.840346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 11:41:34.840346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 10 11:41:34.840346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:34.840346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:34.840346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:34.840346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:34.840346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:34.840346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:34.840346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 11:41:34.840346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 11:41:34.841551 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 10 11:41:34.841551 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:34.841551 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0f6087d0-8aac-4460-8957-30764a996243 tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:41:34.841551 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0f6087d0-8aac-4460-8957-30764a996243 tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.697508 Sep 10 11:41:34.841551 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 492/956] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 11:41:34 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 703 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:41:34.852627 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f7dfe724-ac49-4e63-82b8-058746b4d814 tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] Action: 'create', calling method: .version_select at 0x7f40734628b0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1425607233", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:34.881350 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f56a8aa9-3885-4449-925a-5d7f7270d5c6 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1e51accd4241b497623f18f0d2967d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d3ca9bcf514a8b9844377fc53143ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:34.896654 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f56a8aa9-3885-4449-925a-5d7f7270d5c6 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] 10.222.0.23 "GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398" status: 200 len: 1371 microversion: 2.1 time: 0.911594 Sep 10 11:41:34.898541 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 465/957] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:33 2022] GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398 => generated 1371 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:34.907840 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-f7dfe724-ac49-4e63-82b8-058746b4d814 tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] Getting quotas for project 707465bd369546489d0c0ecefdf9e4da. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:41:34.917223 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-f7dfe724-ac49-4e63-82b8-058746b4d814 tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] Getting quotas for user 7ed6d0401bea4e5e99b0d73ce3b84328 and project 707465bd369546489d0c0ecefdf9e4da. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:41:34.943124 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2c0a59c0-53b2-4afc-9c46-013462baaf78 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:34.944045 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2c0a59c0-53b2-4afc-9c46-013462baaf78 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: ebff5197-fc62-4ee6-a688-6e12f04645b5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:34.959226 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2c0a59c0-53b2-4afc-9c46-013462baaf78 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:34.961585 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2c0a59c0-53b2-4afc-9c46-013462baaf78 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:34.963143 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2c0a59c0-53b2-4afc-9c46-013462baaf78 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:34.964541 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2c0a59c0-53b2-4afc-9c46-013462baaf78 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:34.966655 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-f7dfe724-ac49-4e63-82b8-058746b4d814 tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 10 11:41:34.967562 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2c0a59c0-53b2-4afc-9c46-013462baaf78 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:34.968276 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2c0a59c0-53b2-4afc-9c46-013462baaf78 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:34.980670 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f7dfe724-ac49-4e63-82b8-058746b4d814 tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] Request method failure captured: Sep 10 11:41:34.980670 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 10 11:41:34.980670 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:41:34.980670 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:41:34.980670 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:41:34.980670 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 2167 Sep 10 11:41:34.980670 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:41:34.980670 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:41:34.980670 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:41:34.980670 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:41:34.980670 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHfti-3Vf4NGaH1KwuRm8Nc6-eVbMKEfsJxPI4L-SQQ4oqndZE-BckWgsvhmGI7GziE1PoM8Mg8dvDMIqD8drhPcfEjkI0QoJGT_9bOMLsg92CTIpC6ttuAU3Oql44TVBJcOkXvVZ71kuklAXR7R7Ha6EYOn48mNTowZC66QkXFcubE Sep 10 11:41:34.980670 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:41:34.980670 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:41:34.980670 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:41:34.980670 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:41:34.980670 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:41:34.980670 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:41:34.980670 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 707465bd369546489d0c0ecefdf9e4da Sep 10 11:41:34.980670 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1189804488 Sep 10 11:41:34.980670 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:41:34.980670 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:41:34.980670 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/707465bd369546489d0c0ecefdf9e4da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/707465bd369546489d0c0ecefdf9e4da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_707465bd369546489d0c0ecefdf9e4da", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/707465bd369546489d0c0ecefdf9e4da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:41:34.980670 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1189804488 Sep 10 11:41:34.980670 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 707465bd369546489d0c0ecefdf9e4da Sep 10 11:41:34.980670 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1189804488 Sep 10 11:41:34.980670 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-KeyPairsNegativeTestJSON-1189804488-project Sep 10 11:41:34.980670 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:41:34.980670 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:41:34.980670 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 7ed6d0401bea4e5e99b0d73ce3b84328 Sep 10 11:41:34.980670 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1189804488-project Sep 10 11:41:34.980670 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:41:34.980670 n-d-856895-1 devstack@n-api.service[128777]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1425607233", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Sep 10 11:41:34.980670 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:41:34.980670 n-d-856895-1 devstack@n-api.service[128777]: exception: Keypair data is invalid: failed to generate fingerprint Sep 10 11:41:34.983940 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1425607233', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Sep 10 11:41:34.983940 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:41:34.983940 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:34.983940 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 10 11:41:34.983940 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 10 11:41:34.983940 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Sep 10 11:41:34.983940 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Sep 10 11:41:34.983940 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Sep 10 11:41:34.983940 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:34.983940 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:34.983940 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:34.983940 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:34.983940 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 10 11:41:34.983940 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 10 11:41:34.983940 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 11:41:34.983940 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 11:41:34.983940 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:41:34.983940 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:41:34.983940 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:41:34.983940 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:41:34.983940 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 11:41:34.983940 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 11:41:34.983940 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 10 11:41:34.983940 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 10 11:41:34.983940 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 10 11:41:34.983940 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 10 11:41:34.983940 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 10 11:41:34.983940 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 10 11:41:34.983940 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 10 11:41:34.983940 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:34.983940 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:34.983940 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:34.983940 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:34.983940 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:34.983940 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:34.983940 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:41:34.983940 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:41:34.983940 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:41:34.983940 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:41:34.983940 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:41:34.983940 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:41:34.986577 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:41:34.986577 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:41:34.986577 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:41:34.986577 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:41:34.986577 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 10 11:41:34.986577 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 10 11:41:34.986577 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 10 11:41:34.986577 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 10 11:41:34.986577 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 10 11:41:34.986577 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:34.986577 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:34.986577 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:34.986577 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:34.986577 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:34.986577 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:34.986577 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:41:34.986577 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:41:34.986577 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 10 11:41:34.986577 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:34.989023 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f7dfe724-ac49-4e63-82b8-058746b4d814 tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:41:34.990072 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f7dfe724-ac49-4e63-82b8-058746b4d814 tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.144500 Sep 10 11:41:34.991182 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 493/958] 10.222.0.23 () {60 vars in 1160 bytes} [Sat Sep 10 11:41:34 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 146 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 10 11:41:35.004313 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2a53c0b7-cbb2-4ee2-af63-8e831899ba3a tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] Action: 'create', calling method: .version_select at 0x7f4073842430>, body: {"keypair": {"name": "tempest-keypair-748474248", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2bcg3ev71GtMDAu6FrNwsKNJlVw1iQX5GhYLEzkXblT07SJbUfN5lUd9zsu15B19UNunDtA1pz54LhQzv3cc29Kg+cWdpWjtKG+AQO4G1KQLmD2eTA4AIoTCcuiFhpJw=="}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:35.046966 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-2a53c0b7-cbb2-4ee2-af63-8e831899ba3a tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] Getting quotas for project 707465bd369546489d0c0ecefdf9e4da. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:41:35.057458 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-2a53c0b7-cbb2-4ee2-af63-8e831899ba3a tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] Getting quotas for user 7ed6d0401bea4e5e99b0d73ce3b84328 and project 707465bd369546489d0c0ecefdf9e4da. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:41:35.110721 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2a53c0b7-cbb2-4ee2-af63-8e831899ba3a tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.109176 Sep 10 11:41:35.113709 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 494/959] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 11:41:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:41:35.128119 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-49457908-b3fc-4ab2-887b-dcca670c6558 tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] Action: 'create', calling method: .version_select at 0x7f40732f2c10>, body: {"keypair": {"name": "tempest-keypair-748474248", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+1g85WWhA1QjiBxZuw6+8Liku2AR/+uO/tLMz2Q741yVJs3VZcF1CXRgyeVfhbQRO0/vL/VWvxQ705lLuHXlpJBgN0MeZXpLxDarVg/bg+fyWbJDvPjX8uZ88YMIC/sQ=="}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:35.181673 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-49457908-b3fc-4ab2-887b-dcca670c6558 tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] Getting quotas for project 707465bd369546489d0c0ecefdf9e4da. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:41:35.191718 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-49457908-b3fc-4ab2-887b-dcca670c6558 tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] Getting quotas for user 7ed6d0401bea4e5e99b0d73ce3b84328 and project 707465bd369546489d0c0ecefdf9e4da. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:41:35.203404 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:41:35.260520 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-49457908-b3fc-4ab2-887b-dcca670c6558 tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] HTTP exception thrown: Key pair 'tempest-keypair-748474248' already exists. Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-49457908-b3fc-4ab2-887b-dcca670c6558 tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] Request method failure captured: Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 272 Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHfti-3Vf4NGaH1KwuRm8Nc6-eVbMKEfsJxPI4L-SQQ4oqndZE-BckWgsvhmGI7GziE1PoM8Mg8dvDMIqD8drhPcfEjkI0QoJGT_9bOMLsg92CTIpC6ttuAU3Oql44TVBJcOkXvVZ71kuklAXR7R7Ha6EYOn48mNTowZC66QkXFcubE Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 707465bd369546489d0c0ecefdf9e4da Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1189804488 Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/707465bd369546489d0c0ecefdf9e4da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/707465bd369546489d0c0ecefdf9e4da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_707465bd369546489d0c0ecefdf9e4da", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/707465bd369546489d0c0ecefdf9e4da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1189804488 Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 707465bd369546489d0c0ecefdf9e4da Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1189804488 Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-KeyPairsNegativeTestJSON-1189804488-project Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 7ed6d0401bea4e5e99b0d73ce3b84328 Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1189804488-project Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: {"keypair": {"name": "tempest-keypair-748474248", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+1g85WWhA1QjiBxZuw6+8Liku2AR/+uO/tLMz2Q741yVJs3VZcF1CXRgyeVfhbQRO0/vL/VWvxQ705lLuHXlpJBgN0MeZXpLxDarVg/bg+fyWbJDvPjX8uZ88YMIC/sQ=="}} Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: exception: Key pair 'tempest-keypair-748474248' already exists. Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-748474248', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+1g85WWhA1QjiBxZuw6+8Liku2AR/+uO/tLMz2Q741yVJs3VZcF1CXRgyeVfhbQRO0/vL/VWvxQ705lLuHXlpJBgN0MeZXpLxDarVg/bg+fyWbJDvPjX8uZ88YMIC/sQ=='}}} Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result.read() Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '7ed6d0401bea4e5e99b0d73ce3b84328-tempest-keypair-748474248' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 10 11:41:35.269858 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi kp.save(context.session) Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi session.flush() Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result.read() Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 10 11:41:35.274068 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '7ed6d0401bea4e5e99b0d73ce3b84328-tempest-keypair-748474248' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 10, 11, 41, 35, 244107), 'updated_at': None, 'name': 'tempest-keypair-748474248', 'user_id': '7ed6d0401bea4e5e99b0d73ce3b84328', 'fingerprint': '38:0a:bf:20:6a:7d:bd:c2:2c:15:fd:17:f2:2c:06:36', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+1g85WWhA1QjiBxZuw6+8Liku2AR/+uO/tLMz2Q741yVJs3VZcF1CXRgyeVfhbQRO0/vL/VWvxQ705lLuHXlpJBgN0MeZXpLxDarVg/bg+fyWbJDvPjX8uZ88YMIC/sQ==', 'type': 'ssh'}] Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi keypair.create() Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._create() Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-748474248' already exists. Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Sep 10 11:41:35.284100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-748474248' already exists. Sep 10 11:41:35.291896 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:35.291896 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:35.291896 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:35.291896 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:35.291896 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:35.291896 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:35.291896 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:41:35.291896 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:41:35.291896 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-748474248' already exists. Sep 10 11:41:35.291896 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:35.291896 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-49457908-b3fc-4ab2-887b-dcca670c6558 tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] Returning 409 to user: Key pair 'tempest-keypair-748474248' already exists. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:41:35.291896 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-49457908-b3fc-4ab2-887b-dcca670c6558 tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.159455 Sep 10 11:41:35.291896 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 495/960] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 11:41:35 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 162 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 10 11:41:35.310592 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ba24aa2e-2489-430f-beb8-6e6ecc09418c tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] Calling method '.version_select at 0x7f4073ec7430>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:35.374834 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ba24aa2e-2489-430f-beb8-6e6ecc09418c tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-748474248" status: 202 len: 0 microversion: 2.1 time: 0.084246 Sep 10 11:41:35.375878 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 496/961] 10.222.0.23 () {58 vars in 1218 bytes} [Sat Sep 10 11:41:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-748474248 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:41:35.405808 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cd68aab5-5dba-44ba-916b-f34fad5fa13c tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] Action: 'create', calling method: .version_select at 0x7f40732be790>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMt0vGhtdqa9pyBWCApcbbhV99lhx8qCU7YxoDSvawhGNu7nqtlRJGQmJ2c4BudQDxi4iQO1c8X41hKyEXt0y3ZSH7OTy3GuyhCI9+EY/Vapgw+1CtfmsDIi1Y3FwXXRaw=="}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cd68aab5-5dba-44ba-916b-f34fad5fa13c tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] Request method failure captured: Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 247 Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHfti-3Vf4NGaH1KwuRm8Nc6-eVbMKEfsJxPI4L-SQQ4oqndZE-BckWgsvhmGI7GziE1PoM8Mg8dvDMIqD8drhPcfEjkI0QoJGT_9bOMLsg92CTIpC6ttuAU3Oql44TVBJcOkXvVZ71kuklAXR7R7Ha6EYOn48mNTowZC66QkXFcubE Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 707465bd369546489d0c0ecefdf9e4da Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1189804488 Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/707465bd369546489d0c0ecefdf9e4da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/707465bd369546489d0c0ecefdf9e4da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_707465bd369546489d0c0ecefdf9e4da", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/707465bd369546489d0c0ecefdf9e4da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1189804488 Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 707465bd369546489d0c0ecefdf9e4da Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1189804488 Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-KeyPairsNegativeTestJSON-1189804488-project Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 7ed6d0401bea4e5e99b0d73ce3b84328 Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1189804488-project Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMt0vGhtdqa9pyBWCApcbbhV99lhx8qCU7YxoDSvawhGNu7nqtlRJGQmJ2c4BudQDxi4iQO1c8X41hKyEXt0y3ZSH7OTy3GuyhCI9+EY/Vapgw+1CtfmsDIi1Y3FwXXRaw=="}} Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMt0vGhtdqa9pyBWCApcbbhV99lhx8qCU7YxoDSvawhGNu7nqtlRJGQmJ2c4BudQDxi4iQO1c8X41hKyEXt0y3ZSH7OTy3GuyhCI9+EY/Vapgw+1CtfmsDIi1Y3FwXXRaw=='}}} Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise error Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi '' Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 11:41:35.430695 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 11:41:35.435132 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 11:41:35.435132 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 11:41:35.435132 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 11:41:35.435132 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 11:41:35.435132 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 10 11:41:35.435132 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:35.435132 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:35.435132 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:35.435132 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:35.435132 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:35.435132 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:35.435132 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 11:41:35.435132 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 11:41:35.435132 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 10 11:41:35.435132 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:35.438532 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cd68aab5-5dba-44ba-916b-f34fad5fa13c tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:41:35.439669 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cd68aab5-5dba-44ba-916b-f34fad5fa13c tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.048391 Sep 10 11:41:35.440595 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 497/962] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 11:41:35 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:41:35.456370 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-caf310c9-22e8-4c11-b592-c6199bf6e012 tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] Action: 'create', calling method: .version_select at 0x7f4073244670>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-352811969", "public_key": " "}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:35.518080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-caf310c9-22e8-4c11-b592-c6199bf6e012 tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] Getting quotas for project 707465bd369546489d0c0ecefdf9e4da. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:41:35.545143 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-caf310c9-22e8-4c11-b592-c6199bf6e012 tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] Getting quotas for user 7ed6d0401bea4e5e99b0d73ce3b84328 and project 707465bd369546489d0c0ecefdf9e4da. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:41:35.609903 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-caf310c9-22e8-4c11-b592-c6199bf6e012 tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-caf310c9-22e8-4c11-b592-c6199bf6e012 tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] Request method failure captured: Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 94 Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHfti-3Vf4NGaH1KwuRm8Nc6-eVbMKEfsJxPI4L-SQQ4oqndZE-BckWgsvhmGI7GziE1PoM8Mg8dvDMIqD8drhPcfEjkI0QoJGT_9bOMLsg92CTIpC6ttuAU3Oql44TVBJcOkXvVZ71kuklAXR7R7Ha6EYOn48mNTowZC66QkXFcubE Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 707465bd369546489d0c0ecefdf9e4da Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1189804488 Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/707465bd369546489d0c0ecefdf9e4da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/707465bd369546489d0c0ecefdf9e4da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_707465bd369546489d0c0ecefdf9e4da", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/707465bd369546489d0c0ecefdf9e4da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1189804488 Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 707465bd369546489d0c0ecefdf9e4da Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1189804488 Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-KeyPairsNegativeTestJSON-1189804488-project Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 7ed6d0401bea4e5e99b0d73ce3b84328 Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1189804488-project Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-352811969", "public_key": " "}} Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: exception: Keypair data is invalid: failed to generate fingerprint Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-352811969', 'public_key': ' '}}} Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:35.611891 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:35.615895 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:35.615895 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:35.615895 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:35.615895 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:41:35.615895 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:41:35.615895 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:41:35.615895 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:41:35.615895 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:41:35.615895 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:41:35.615895 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:41:35.615895 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:41:35.615895 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:41:35.615895 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:41:35.615895 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 10 11:41:35.615895 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 10 11:41:35.615895 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 10 11:41:35.615895 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 10 11:41:35.615895 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 10 11:41:35.615895 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:35.615895 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:35.615895 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:35.615895 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:35.615895 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:35.615895 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:35.615895 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:41:35.615895 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:41:35.615895 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 10 11:41:35.615895 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:35.615895 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-caf310c9-22e8-4c11-b592-c6199bf6e012 tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:41:35.621468 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-caf310c9-22e8-4c11-b592-c6199bf6e012 tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.174482 Sep 10 11:41:35.623954 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 498/963] 10.222.0.23 () {60 vars in 1158 bytes} [Sat Sep 10 11:41:35 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 178 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 10 11:41:35.643481 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c9ba5387-1376-4c18-b46e-1043cd56f7c2 tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] Action: 'create', calling method: .version_select at 0x7f40732beee0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqcQ5BYYkSK5Kuy/V/KY+p1Gd0V5+3ttPIZfrZOzWya5GMOZyfXMJFywfEl97GtuLJ4Ym5dsumEuZnOa/JEcCFTNCpxxHeAnLdmwnSZSp5lDSEtMcs3L0QdbBpz9vqq7g=="}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c9ba5387-1376-4c18-b46e-1043cd56f7c2 tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] Request method failure captured: Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 507 Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHfti-3Vf4NGaH1KwuRm8Nc6-eVbMKEfsJxPI4L-SQQ4oqndZE-BckWgsvhmGI7GziE1PoM8Mg8dvDMIqD8drhPcfEjkI0QoJGT_9bOMLsg92CTIpC6ttuAU3Oql44TVBJcOkXvVZ71kuklAXR7R7Ha6EYOn48mNTowZC66QkXFcubE Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 707465bd369546489d0c0ecefdf9e4da Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1189804488 Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/707465bd369546489d0c0ecefdf9e4da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/707465bd369546489d0c0ecefdf9e4da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_707465bd369546489d0c0ecefdf9e4da", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/707465bd369546489d0c0ecefdf9e4da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1189804488 Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 707465bd369546489d0c0ecefdf9e4da Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1189804488 Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-KeyPairsNegativeTestJSON-1189804488-project Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 7ed6d0401bea4e5e99b0d73ce3b84328 Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1189804488-project Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqcQ5BYYkSK5Kuy/V/KY+p1Gd0V5+3ttPIZfrZOzWya5GMOZyfXMJFywfEl97GtuLJ4Ym5dsumEuZnOa/JEcCFTNCpxxHeAnLdmwnSZSp5lDSEtMcs3L0QdbBpz9vqq7g=="}} Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqcQ5BYYkSK5Kuy/V/KY+p1Gd0V5+3ttPIZfrZOzWya5GMOZyfXMJFywfEl97GtuLJ4Ym5dsumEuZnOa/JEcCFTNCpxxHeAnLdmwnSZSp5lDSEtMcs3L0QdbBpz9vqq7g=='}}} Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise error Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 10 11:41:35.657193 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Sep 10 11:41:35.661197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:35.661197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:35.661197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:35.661197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:35.661197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:35.661197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:35.661197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:41:35.661197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:41:35.661197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:41:35.661197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:41:35.661197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:41:35.661197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:41:35.661197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:41:35.661197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:41:35.661197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 11:41:35.661197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 11:41:35.661197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 11:41:35.661197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 11:41:35.661197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 11:41:35.661197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 11:41:35.661197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 10 11:41:35.661197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:35.661197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:35.661197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:35.661197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:35.661197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:35.661197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:35.661197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 11:41:35.661197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 11:41:35.661197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 10 11:41:35.661197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:35.671144 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c9ba5387-1376-4c18-b46e-1043cd56f7c2 tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:41:35.675355 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c9ba5387-1376-4c18-b46e-1043cd56f7c2 tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.045230 Sep 10 11:41:35.691703 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 499/964] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 11:41:35 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 62 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:41:35.720037 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-05fbdae4-7b28-4aa7-b782-dbe6f22fa213 tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] Action: 'create', calling method: .version_select at 0x7f40732f2160>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1908664012", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:35.800246 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-05fbdae4-7b28-4aa7-b782-dbe6f22fa213 tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] Getting quotas for project 707465bd369546489d0c0ecefdf9e4da. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:41:35.811102 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-05fbdae4-7b28-4aa7-b782-dbe6f22fa213 tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] Getting quotas for user 7ed6d0401bea4e5e99b0d73ce3b84328 and project 707465bd369546489d0c0ecefdf9e4da. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:41:35.860753 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-05fbdae4-7b28-4aa7-b782-dbe6f22fa213 tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-05fbdae4-7b28-4aa7-b782-dbe6f22fa213 tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] Request method failure captured: Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 118 Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHfti-3Vf4NGaH1KwuRm8Nc6-eVbMKEfsJxPI4L-SQQ4oqndZE-BckWgsvhmGI7GziE1PoM8Mg8dvDMIqD8drhPcfEjkI0QoJGT_9bOMLsg92CTIpC6ttuAU3Oql44TVBJcOkXvVZ71kuklAXR7R7Ha6EYOn48mNTowZC66QkXFcubE Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 707465bd369546489d0c0ecefdf9e4da Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1189804488 Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/707465bd369546489d0c0ecefdf9e4da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/707465bd369546489d0c0ecefdf9e4da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_707465bd369546489d0c0ecefdf9e4da", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/707465bd369546489d0c0ecefdf9e4da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1189804488 Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 707465bd369546489d0c0ecefdf9e4da Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1189804488 Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-KeyPairsNegativeTestJSON-1189804488-project Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 7ed6d0401bea4e5e99b0d73ce3b84328 Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1189804488-project Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1908664012", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: exception: Keypair data is invalid: failed to generate fingerprint Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1908664012', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 10 11:41:35.863705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 10 11:41:35.868935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 10 11:41:35.868935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 10 11:41:35.868935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 10 11:41:35.868935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:35.868935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:35.868935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:35.868935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:35.868935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:35.868935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:35.868935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:41:35.868935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:41:35.868935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:41:35.868935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:41:35.868935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:41:35.868935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:41:35.868935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:41:35.868935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:41:35.868935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:41:35.868935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:41:35.868935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 10 11:41:35.868935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 10 11:41:35.868935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 10 11:41:35.868935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 10 11:41:35.868935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 10 11:41:35.868935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:35.868935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:35.868935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:35.868935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:35.868935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:35.868935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:35.868935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:41:35.868935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:41:35.868935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 10 11:41:35.868935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:35.879213 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-05fbdae4-7b28-4aa7-b782-dbe6f22fa213 tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:41:35.884349 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-05fbdae4-7b28-4aa7-b782-dbe6f22fa213 tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.191264 Sep 10 11:41:35.885819 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 500/965] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 11:41:35 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 193 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 10 11:41:35.894907 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c4c861db-f5be-4c51-9a2d-0c5cc7cd4e5b tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] Calling method '.version_select at 0x7f4073244ee0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:35.931738 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-c4c861db-f5be-4c51-9a2d-0c5cc7cd4e5b tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-910042845 not found for user 7ed6d0401bea4e5e99b0d73ce3b84328 Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c4c861db-f5be-4c51-9a2d-0c5cc7cd4e5b tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] Request method failure captured: Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-910042845 HTTP/1.1 Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHfti-3Vf4NGaH1KwuRm8Nc6-eVbMKEfsJxPI4L-SQQ4oqndZE-BckWgsvhmGI7GziE1PoM8Mg8dvDMIqD8drhPcfEjkI0QoJGT_9bOMLsg92CTIpC6ttuAU3Oql44TVBJcOkXvVZ71kuklAXR7R7Ha6EYOn48mNTowZC66QkXFcubE Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 707465bd369546489d0c0ecefdf9e4da Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1189804488 Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/707465bd369546489d0c0ecefdf9e4da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/707465bd369546489d0c0ecefdf9e4da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_707465bd369546489d0c0ecefdf9e4da", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/707465bd369546489d0c0ecefdf9e4da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1189804488 Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 707465bd369546489d0c0ecefdf9e4da Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1189804488 Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-KeyPairsNegativeTestJSON-1189804488-project Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 7ed6d0401bea4e5e99b0d73ce3b84328 Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1189804488-project Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: exception: Keypair tempest-keypair-non-existent-910042845 not found for user 7ed6d0401bea4e5e99b0d73ce3b84328 Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'tempest-keypair-non-existent-910042845'} Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-910042845 not found for user 7ed6d0401bea4e5e99b0d73ce3b84328 Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:35.936207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:35.940498 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:35.940498 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:35.940498 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:35.940498 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:35.940498 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:41:35.940498 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:41:35.940498 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:41:35.940498 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:41:35.940498 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 11:41:35.940498 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:41:35.940498 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:41:35.940498 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:41:35.940498 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Sep 10 11:41:35.940498 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._delete(req, id) Sep 10 11:41:35.940498 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Sep 10 11:41:35.940498 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Sep 10 11:41:35.940498 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-910042845 not found for user 7ed6d0401bea4e5e99b0d73ce3b84328 Sep 10 11:41:35.940498 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:35.940498 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:35.940498 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:35.940498 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:35.940498 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:35.940498 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:35.940498 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:41:35.940498 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:41:35.940498 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-910042845 not found for user 7ed6d0401bea4e5e99b0d73ce3b84328 Sep 10 11:41:35.940498 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:35.946520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c4c861db-f5be-4c51-9a2d-0c5cc7cd4e5b tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] Returning 404 to user: Keypair tempest-keypair-non-existent-910042845 not found for user 7ed6d0401bea4e5e99b0d73ce3b84328 {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:41:35.949227 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c4c861db-f5be-4c51-9a2d-0c5cc7cd4e5b tempest-KeyPairsNegativeTestJSON-1189804488 tempest-KeyPairsNegativeTestJSON-1189804488-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-910042845" status: 404 len: 144 microversion: 2.1 time: 0.058120 Sep 10 11:41:35.952832 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 501/966] 10.222.0.23 () {58 vars in 1257 bytes} [Sat Sep 10 11:41:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-910042845 => generated 144 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:41:35.968304 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-a51022d1-2708-463a-9a81-8f684c2e3e95 req-4df7de24-17b9-4b82-ac53-f86e9881350d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebff5197-fc62-4ee6-a688-6e12f04645b5", "name": "network-vif-plugged", "status": "completed", "tag": "cbd26a57-8480-4427-a718-f5ccf1736f8d"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:35.991661 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a51022d1-2708-463a-9a81-8f684c2e3e95 req-4df7de24-17b9-4b82-ac53-f86e9881350d service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:35.994017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a51022d1-2708-463a-9a81-8f684c2e3e95 req-4df7de24-17b9-4b82-ac53-f86e9881350d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:35.996044 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a51022d1-2708-463a-9a81-8f684c2e3e95 req-4df7de24-17b9-4b82-ac53-f86e9881350d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:36.029937 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-a51022d1-2708-463a-9a81-8f684c2e3e95 req-4df7de24-17b9-4b82-ac53-f86e9881350d service nova] Creating event network-vif-plugged:cbd26a57-8480-4427-a718-f5ccf1736f8d for instance ebff5197-fc62-4ee6-a688-6e12f04645b5 on n-h2-856895-1 Sep 10 11:41:36.057165 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-a51022d1-2708-463a-9a81-8f684c2e3e95 req-4df7de24-17b9-4b82-ac53-f86e9881350d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096665 Sep 10 11:41:36.058089 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 502/967] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:41:36.086587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-dd1d4928-df99-4ea9-9e6d-d2fa1bdc04b8 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:36.087345 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-dd1d4928-df99-4ea9-9e6d-d2fa1bdc04b8 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] [instance: afb1a503-7e9a-474c-8dfe-b0e5838b7398] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:36.109645 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd1d4928-df99-4ea9-9e6d-d2fa1bdc04b8 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:36.127114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd1d4928-df99-4ea9-9e6d-d2fa1bdc04b8 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:36.128109 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd1d4928-df99-4ea9-9e6d-d2fa1bdc04b8 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:36.131423 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd1d4928-df99-4ea9-9e6d-d2fa1bdc04b8 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:36.132578 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd1d4928-df99-4ea9-9e6d-d2fa1bdc04b8 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:36.138455 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd1d4928-df99-4ea9-9e6d-d2fa1bdc04b8 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:36.271129 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2c0a59c0-53b2-4afc-9c46-013462baaf78 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:36.298154 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2c0a59c0-53b2-4afc-9c46-013462baaf78 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:36.299835 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2c0a59c0-53b2-4afc-9c46-013462baaf78 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:36.308441 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2c0a59c0-53b2-4afc-9c46-013462baaf78 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5" status: 200 len: 1362 microversion: 2.25 time: 1.370537 Sep 10 11:41:36.319890 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 466/968] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:34 2022] GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5 => generated 1362 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:36.814882 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-dd1d4928-df99-4ea9-9e6d-d2fa1bdc04b8 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1e51accd4241b497623f18f0d2967d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d3ca9bcf514a8b9844377fc53143ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:36.839528 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-dd1d4928-df99-4ea9-9e6d-d2fa1bdc04b8 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] 10.222.0.23 "GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398" status: 200 len: 1371 microversion: 2.1 time: 0.772892 Sep 10 11:41:36.858897 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 503/969] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:36 2022] GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398 => generated 1371 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:37.336328 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1e7552d1-3978-4aca-adc7-77794c15964e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:37.336959 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1e7552d1-3978-4aca-adc7-77794c15964e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: ebff5197-fc62-4ee6-a688-6e12f04645b5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:37.344144 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1e7552d1-3978-4aca-adc7-77794c15964e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:37.344642 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1e7552d1-3978-4aca-adc7-77794c15964e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:37.345085 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1e7552d1-3978-4aca-adc7-77794c15964e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:37.345796 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1e7552d1-3978-4aca-adc7-77794c15964e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:37.346261 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1e7552d1-3978-4aca-adc7-77794c15964e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:37.346689 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1e7552d1-3978-4aca-adc7-77794c15964e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:37.745632 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1e7552d1-3978-4aca-adc7-77794c15964e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:37.765863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1e7552d1-3978-4aca-adc7-77794c15964e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:37.771016 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1e7552d1-3978-4aca-adc7-77794c15964e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:37.780317 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1e7552d1-3978-4aca-adc7-77794c15964e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5" status: 200 len: 1362 microversion: 2.25 time: 0.447671 Sep 10 11:41:37.780946 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 467/970] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:37 2022] GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5 => generated 1362 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:37.868348 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-406134b8-a83c-43f6-a783-781d7e236e79 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:37.868975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-406134b8-a83c-43f6-a783-781d7e236e79 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] [instance: afb1a503-7e9a-474c-8dfe-b0e5838b7398] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:37.882449 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-406134b8-a83c-43f6-a783-781d7e236e79 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:37.883185 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-406134b8-a83c-43f6-a783-781d7e236e79 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:37.883640 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-406134b8-a83c-43f6-a783-781d7e236e79 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:37.884354 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-406134b8-a83c-43f6-a783-781d7e236e79 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:37.885001 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-406134b8-a83c-43f6-a783-781d7e236e79 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:37.886584 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-406134b8-a83c-43f6-a783-781d7e236e79 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:38.049786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cdcb7be7-08fb-4b72-a106-9e0d4ba14de4 tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Calling method '.version_select at 0x7f40732f2160>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:38.172190 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cdcb7be7-08fb-4b72-a106-9e0d4ba14de4 tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/89b9822c99de493b94eb4cd5c26dde60" status: 200 len: 371 microversion: 2.1 time: 0.567784 Sep 10 11:41:38.173601 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 504/971] 10.222.0.23 () {58 vars in 1242 bytes} [Sat Sep 10 11:41:37 2022] GET /compute/v2.1/os-quota-sets/89b9822c99de493b94eb4cd5c26dde60 => generated 371 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:41:38.194127 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-483cfc57-54bb-490b-b500-d6737143bb0e tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Action: 'update', calling method: .version_select at 0x7f40732be820>, body: {"quota_set": {"ram": "5120"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:38.348807 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-483cfc57-54bb-490b-b500-d6737143bb0e tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:38.349441 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-483cfc57-54bb-490b-b500-d6737143bb0e tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:38.349991 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-483cfc57-54bb-490b-b500-d6737143bb0e tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:38.350819 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-483cfc57-54bb-490b-b500-d6737143bb0e tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:38.355664 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-483cfc57-54bb-490b-b500-d6737143bb0e tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:38.356934 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-483cfc57-54bb-490b-b500-d6737143bb0e tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:38.426866 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-406134b8-a83c-43f6-a783-781d7e236e79 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1e51accd4241b497623f18f0d2967d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d3ca9bcf514a8b9844377fc53143ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:38.437626 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-406134b8-a83c-43f6-a783-781d7e236e79 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] 10.222.0.23 "GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398" status: 200 len: 1371 microversion: 2.1 time: 0.573038 Sep 10 11:41:38.454913 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 468/972] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:37 2022] GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398 => generated 1371 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:38.470370 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-483cfc57-54bb-490b-b500-d6737143bb0e tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/89b9822c99de493b94eb4cd5c26dde60" status: 200 len: 328 microversion: 2.1 time: 0.288412 Sep 10 11:41:38.471499 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 505/973] 10.222.0.23 () {60 vars in 1262 bytes} [Sat Sep 10 11:41:38 2022] PUT /compute/v2.1/os-quota-sets/89b9822c99de493b94eb4cd5c26dde60 => generated 328 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:41:38.485256 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-799d303a-d78d-46e6-8355-0521da3a2f46 tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:38.506725 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-799d303a-d78d-46e6-8355-0521da3a2f46 tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-quota-sets/89b9822c99de493b94eb4cd5c26dde60" status: 202 len: 0 microversion: 2.1 time: 0.026569 Sep 10 11:41:38.507699 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 469/974] 10.222.0.23 () {58 vars in 1245 bytes} [Sat Sep 10 11:41:38 2022] DELETE /compute/v2.1/os-quota-sets/89b9822c99de493b94eb4cd5c26dde60 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:41:38.516247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bc4e0c93-b8ca-44f1-8657-ece5d900086f tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Calling method '.version_select at 0x7f4073ae13a0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:38.811348 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e54852d7-0759-43c4-8540-91c0b8d62f31 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:38.812546 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e54852d7-0759-43c4-8540-91c0b8d62f31 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: ebff5197-fc62-4ee6-a688-6e12f04645b5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:38.825294 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e54852d7-0759-43c4-8540-91c0b8d62f31 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:38.825976 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e54852d7-0759-43c4-8540-91c0b8d62f31 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:38.826440 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e54852d7-0759-43c4-8540-91c0b8d62f31 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:38.827957 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e54852d7-0759-43c4-8540-91c0b8d62f31 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:38.828793 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e54852d7-0759-43c4-8540-91c0b8d62f31 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:38.833291 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e54852d7-0759-43c4-8540-91c0b8d62f31 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:39.099351 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bc4e0c93-b8ca-44f1-8657-ece5d900086f tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/89b9822c99de493b94eb4cd5c26dde60" status: 200 len: 371 microversion: 2.1 time: 0.586738 Sep 10 11:41:39.101562 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 506/975] 10.222.0.23 () {58 vars in 1242 bytes} [Sat Sep 10 11:41:38 2022] GET /compute/v2.1/os-quota-sets/89b9822c99de493b94eb4cd5c26dde60 => generated 371 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:41:39.283116 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3768e012-7804-428f-bbcb-be433c623e46 tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Calling method '.version_select at 0x7f40732449d0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:39.583524 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e54852d7-0759-43c4-8540-91c0b8d62f31 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:39.593130 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e54852d7-0759-43c4-8540-91c0b8d62f31 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:39.594614 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e54852d7-0759-43c4-8540-91c0b8d62f31 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:39.595836 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e54852d7-0759-43c4-8540-91c0b8d62f31 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5" status: 200 len: 1557 microversion: 2.25 time: 0.792701 Sep 10 11:41:39.605305 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 470/976] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:38 2022] GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5 => generated 1557 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:41:39.611561 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3de98416-a681-4032-a4a0-938bcd88faf0 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:39.618982 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3de98416-a681-4032-a4a0-938bcd88faf0 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] [instance: afb1a503-7e9a-474c-8dfe-b0e5838b7398] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:39.635329 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3de98416-a681-4032-a4a0-938bcd88faf0 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:39.635852 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3de98416-a681-4032-a4a0-938bcd88faf0 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:39.636586 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3de98416-a681-4032-a4a0-938bcd88faf0 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:39.637193 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3de98416-a681-4032-a4a0-938bcd88faf0 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:39.637656 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3de98416-a681-4032-a4a0-938bcd88faf0 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:39.638160 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3de98416-a681-4032-a4a0-938bcd88faf0 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:39.739514 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3768e012-7804-428f-bbcb-be433c623e46 tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/f07d4b0e0a684934a690e4392bd308b1/defaults" status: 200 len: 371 microversion: 2.1 time: 0.462039 Sep 10 11:41:39.753713 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 507/977] 10.222.0.23 () {58 vars in 1269 bytes} [Sat Sep 10 11:41:39 2022] GET /compute/v2.1/os-quota-sets/f07d4b0e0a684934a690e4392bd308b1/defaults => generated 371 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:41:39.764936 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-79c4eac9-cbaa-48a3-9bfd-29c4daad7980 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:39.765569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-79c4eac9-cbaa-48a3-9bfd-29c4daad7980 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] [instance: ebff5197-fc62-4ee6-a688-6e12f04645b5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:39.786522 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-79c4eac9-cbaa-48a3-9bfd-29c4daad7980 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:39.787007 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-79c4eac9-cbaa-48a3-9bfd-29c4daad7980 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:39.787489 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-79c4eac9-cbaa-48a3-9bfd-29c4daad7980 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:39.796085 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-79c4eac9-cbaa-48a3-9bfd-29c4daad7980 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:39.796717 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-79c4eac9-cbaa-48a3-9bfd-29c4daad7980 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:39.797178 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-79c4eac9-cbaa-48a3-9bfd-29c4daad7980 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:40.030305 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3de98416-a681-4032-a4a0-938bcd88faf0 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1e51accd4241b497623f18f0d2967d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d3ca9bcf514a8b9844377fc53143ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:40.043080 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3de98416-a681-4032-a4a0-938bcd88faf0 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] 10.222.0.23 "GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398" status: 200 len: 1371 microversion: 2.1 time: 0.433860 Sep 10 11:41:40.050245 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 471/978] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:39 2022] GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398 => generated 1371 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:40.160977 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-79c4eac9-cbaa-48a3-9bfd-29c4daad7980 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lazy-loading 'services' on Instance uuid ebff5197-fc62-4ee6-a688-6e12f04645b5 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:41:40.215451 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-79c4eac9-cbaa-48a3-9bfd-29c4daad7980 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5" status: 200 len: 2050 microversion: 2.25 time: 0.466446 Sep 10 11:41:40.216783 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 508/979] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:39 2022] GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5 => generated 2050 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:40.251058 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-92ce3310-f0c5-4d32-854d-b56be46ac00e tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Action: 'update', calling method: .version_select at 0x7f4073b66550>, body: {"quota_set": {"ram": "5120"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:40.401321 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92ce3310-f0c5-4d32-854d-b56be46ac00e tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:40.401811 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92ce3310-f0c5-4d32-854d-b56be46ac00e tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:40.402248 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92ce3310-f0c5-4d32-854d-b56be46ac00e tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:40.403653 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92ce3310-f0c5-4d32-854d-b56be46ac00e tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:40.404302 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6f76763b-41a0-466e-9442-e59aa359dd20 tempest-AbsoluteLimitsTestJSON-1038063239 tempest-AbsoluteLimitsTestJSON-1038063239-project] Calling method '.version_select at 0x7f40736ffa60>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:40.406525 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92ce3310-f0c5-4d32-854d-b56be46ac00e tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:40.407035 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92ce3310-f0c5-4d32-854d-b56be46ac00e tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:40.426974 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f76763b-41a0-466e-9442-e59aa359dd20 tempest-AbsoluteLimitsTestJSON-1038063239 tempest-AbsoluteLimitsTestJSON-1038063239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:40.427495 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f76763b-41a0-466e-9442-e59aa359dd20 tempest-AbsoluteLimitsTestJSON-1038063239 tempest-AbsoluteLimitsTestJSON-1038063239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:40.427936 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f76763b-41a0-466e-9442-e59aa359dd20 tempest-AbsoluteLimitsTestJSON-1038063239 tempest-AbsoluteLimitsTestJSON-1038063239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:40.428670 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f76763b-41a0-466e-9442-e59aa359dd20 tempest-AbsoluteLimitsTestJSON-1038063239 tempest-AbsoluteLimitsTestJSON-1038063239-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:40.429130 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f76763b-41a0-466e-9442-e59aa359dd20 tempest-AbsoluteLimitsTestJSON-1038063239 tempest-AbsoluteLimitsTestJSON-1038063239-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:40.429558 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f76763b-41a0-466e-9442-e59aa359dd20 tempest-AbsoluteLimitsTestJSON-1038063239 tempest-AbsoluteLimitsTestJSON-1038063239-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:40.475535 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6f76763b-41a0-466e-9442-e59aa359dd20 tempest-AbsoluteLimitsTestJSON-1038063239 tempest-AbsoluteLimitsTestJSON-1038063239-project] 10.222.0.23 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.423709 Sep 10 11:41:40.479115 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 472/980] 10.222.0.23 () {58 vars in 1122 bytes} [Sat Sep 10 11:41:40 2022] GET /compute/v2.1/limits => generated 511 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:41:40.494181 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-61211b78-27b1-4e9d-876b-b6e580d131c5 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:40.495762 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-61211b78-27b1-4e9d-876b-b6e580d131c5 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] [instance: ebff5197-fc62-4ee6-a688-6e12f04645b5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:40.516034 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-61211b78-27b1-4e9d-876b-b6e580d131c5 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:40.519206 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-61211b78-27b1-4e9d-876b-b6e580d131c5 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:40.521113 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-61211b78-27b1-4e9d-876b-b6e580d131c5 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:40.522575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-61211b78-27b1-4e9d-876b-b6e580d131c5 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:40.524553 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-61211b78-27b1-4e9d-876b-b6e580d131c5 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:40.526688 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-61211b78-27b1-4e9d-876b-b6e580d131c5 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:40.535363 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-92ce3310-f0c5-4d32-854d-b56be46ac00e tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/94d1e29514bb468392a7eb5f61c0b55c" status: 200 len: 328 microversion: 2.1 time: 0.287734 Sep 10 11:41:40.536950 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 509/981] 10.222.0.23 () {60 vars in 1262 bytes} [Sat Sep 10 11:41:40 2022] PUT /compute/v2.1/os-quota-sets/94d1e29514bb468392a7eb5f61c0b55c => generated 328 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:41:40.551141 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0ba78ce7-cd2b-49c0-aac8-a1639283588b tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Calling method '.version_select at 0x7f4073e6d670>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:40.573656 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:41:40.705009 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ba78ce7-cd2b-49c0-aac8-a1639283588b tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:40.705512 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ba78ce7-cd2b-49c0-aac8-a1639283588b tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:40.709549 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ba78ce7-cd2b-49c0-aac8-a1639283588b tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:40.710344 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ba78ce7-cd2b-49c0-aac8-a1639283588b tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:40.710826 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ba78ce7-cd2b-49c0-aac8-a1639283588b tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:40.711297 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ba78ce7-cd2b-49c0-aac8-a1639283588b tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:40.798452 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0ba78ce7-cd2b-49c0-aac8-a1639283588b tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/94d1e29514bb468392a7eb5f61c0b55c/detail" status: 200 len: 916 microversion: 2.1 time: 0.244828 Sep 10 11:41:40.799154 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 510/982] 10.222.0.23 () {58 vars in 1263 bytes} [Sat Sep 10 11:41:40 2022] GET /compute/v2.1/os-quota-sets/94d1e29514bb468392a7eb5f61c0b55c/detail => generated 916 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:41:41.074538 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cb307813-887b-4590-944d-e491cb12b5e5 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:41.075054 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cb307813-887b-4590-944d-e491cb12b5e5 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] [instance: afb1a503-7e9a-474c-8dfe-b0e5838b7398] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:41.088001 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb307813-887b-4590-944d-e491cb12b5e5 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:41.091362 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb307813-887b-4590-944d-e491cb12b5e5 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:41.101554 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb307813-887b-4590-944d-e491cb12b5e5 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:41.102558 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb307813-887b-4590-944d-e491cb12b5e5 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:41.103048 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-61211b78-27b1-4e9d-876b-b6e580d131c5 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lazy-loading 'services' on Instance uuid ebff5197-fc62-4ee6-a688-6e12f04645b5 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:41:41.104739 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb307813-887b-4590-944d-e491cb12b5e5 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:41.105188 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb307813-887b-4590-944d-e491cb12b5e5 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:41.115181 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=100 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:41:41.146627 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-61211b78-27b1-4e9d-876b-b6e580d131c5 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5" status: 200 len: 2050 microversion: 2.25 time: 0.666178 Sep 10 11:41:41.150839 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 473/983] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:40 2022] GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5 => generated 2050 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:41.172336 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f5a284f1-8e1a-4d46-ad5f-1264226d0d7b tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Action: 'update', calling method: .version_select at 0x7f40738d8f70>, body: {"quota_set": {"ram": "2048"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:41.533709 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f5a284f1-8e1a-4d46-ad5f-1264226d0d7b tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:41.534709 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f5a284f1-8e1a-4d46-ad5f-1264226d0d7b tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:41.535761 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f5a284f1-8e1a-4d46-ad5f-1264226d0d7b tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:41.536738 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f5a284f1-8e1a-4d46-ad5f-1264226d0d7b tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:41.537428 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f5a284f1-8e1a-4d46-ad5f-1264226d0d7b tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:41.538294 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f5a284f1-8e1a-4d46-ad5f-1264226d0d7b tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:41.608534 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f5a284f1-8e1a-4d46-ad5f-1264226d0d7b tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:41.609532 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f5a284f1-8e1a-4d46-ad5f-1264226d0d7b tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:41.610165 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f5a284f1-8e1a-4d46-ad5f-1264226d0d7b tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:41.611539 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f5a284f1-8e1a-4d46-ad5f-1264226d0d7b tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:41.612175 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f5a284f1-8e1a-4d46-ad5f-1264226d0d7b tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:41.612767 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f5a284f1-8e1a-4d46-ad5f-1264226d0d7b tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:41.702624 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f5a284f1-8e1a-4d46-ad5f-1264226d0d7b tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/94d1e29514bb468392a7eb5f61c0b55c?user_id=e8e76e7aa4724b3f8e93c4de7f0b563f" status: 200 len: 328 microversion: 2.1 time: 0.535566 Sep 10 11:41:41.713229 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 474/984] 10.222.0.23 () {60 vars in 1343 bytes} [Sat Sep 10 11:41:41 2022] PUT /compute/v2.1/os-quota-sets/94d1e29514bb468392a7eb5f61c0b55c?user_id=e8e76e7aa4724b3f8e93c4de7f0b563f => generated 328 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:41:41.722279 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3f1d737b-7e9a-4b2c-9723-1c3eed4aa066 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:41.727033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3f1d737b-7e9a-4b2c-9723-1c3eed4aa066 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:41.727795 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3f1d737b-7e9a-4b2c-9723-1c3eed4aa066 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:41.728386 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3f1d737b-7e9a-4b2c-9723-1c3eed4aa066 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:41.729311 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3f1d737b-7e9a-4b2c-9723-1c3eed4aa066 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:41.729941 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3f1d737b-7e9a-4b2c-9723-1c3eed4aa066 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:41.730539 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3f1d737b-7e9a-4b2c-9723-1c3eed4aa066 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:41.763407 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3f1d737b-7e9a-4b2c-9723-1c3eed4aa066 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.047180 Sep 10 11:41:41.764691 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 475/985] 10.222.0.23 () {60 vars in 1217 bytes} [Sat Sep 10 11:41:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:41:41.770130 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-244c5d27-c7af-4320-812e-3608440c9fa3 tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Calling method '.version_select at 0x7f4073e12550>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:41.775994 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cb307813-887b-4590-944d-e491cb12b5e5 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1e51accd4241b497623f18f0d2967d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d3ca9bcf514a8b9844377fc53143ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:41.785993 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cb307813-887b-4590-944d-e491cb12b5e5 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] 10.222.0.23 "GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398" status: 200 len: 1371 microversion: 2.1 time: 0.716645 Sep 10 11:41:41.790773 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 511/986] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:41 2022] GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398 => generated 1371 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:41:41.807248 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-05f100c0-340f-4463-bfb6-e3dd3202a1b3 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:41.808060 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-05f100c0-340f-4463-bfb6-e3dd3202a1b3 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] [instance: ebff5197-fc62-4ee6-a688-6e12f04645b5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:41.817443 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-05f100c0-340f-4463-bfb6-e3dd3202a1b3 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:41.818315 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-05f100c0-340f-4463-bfb6-e3dd3202a1b3 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:41.819028 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-05f100c0-340f-4463-bfb6-e3dd3202a1b3 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:41.820041 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-05f100c0-340f-4463-bfb6-e3dd3202a1b3 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:41.820951 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-05f100c0-340f-4463-bfb6-e3dd3202a1b3 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:41.821815 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-05f100c0-340f-4463-bfb6-e3dd3202a1b3 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:41.930938 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-05f100c0-340f-4463-bfb6-e3dd3202a1b3 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5/action" status: 202 len: 0 microversion: 2.25 time: 0.138487 Sep 10 11:41:41.932463 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 512/987] 10.222.0.23 () {62 vars in 1319 bytes} [Sat Sep 10 11:41:41 2022] POST /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:41:41.943611 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-244c5d27-c7af-4320-812e-3608440c9fa3 tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/94d1e29514bb468392a7eb5f61c0b55c?user_id=e8e76e7aa4724b3f8e93c4de7f0b563f" status: 200 len: 370 microversion: 2.1 time: 0.162364 Sep 10 11:41:41.943897 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2dcf0a39-e759-41bb-9ad9-48a5b82379fb tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:41.944262 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 476/988] 10.222.0.23 () {58 vars in 1323 bytes} [Sat Sep 10 11:41:41 2022] GET /compute/v2.1/os-quota-sets/94d1e29514bb468392a7eb5f61c0b55c?user_id=e8e76e7aa4724b3f8e93c4de7f0b563f => generated 370 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:41:41.951708 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2dcf0a39-e759-41bb-9ad9-48a5b82379fb tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] [instance: ebff5197-fc62-4ee6-a688-6e12f04645b5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:41.970694 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2dcf0a39-e759-41bb-9ad9-48a5b82379fb tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:41.971540 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2dcf0a39-e759-41bb-9ad9-48a5b82379fb tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:41.972192 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2dcf0a39-e759-41bb-9ad9-48a5b82379fb tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:41.973485 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2dcf0a39-e759-41bb-9ad9-48a5b82379fb tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:41.975720 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2dcf0a39-e759-41bb-9ad9-48a5b82379fb tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:41.977040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2dcf0a39-e759-41bb-9ad9-48a5b82379fb tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:42.522334 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-2dcf0a39-e759-41bb-9ad9-48a5b82379fb tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lazy-loading 'services' on Instance uuid ebff5197-fc62-4ee6-a688-6e12f04645b5 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:41:42.550756 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2dcf0a39-e759-41bb-9ad9-48a5b82379fb tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5" status: 200 len: 2055 microversion: 2.25 time: 0.611654 Sep 10 11:41:42.564487 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 513/989] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:41 2022] GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5 => generated 2055 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:42.682745 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2707284f-d414-4caf-8ddb-88713fbd3220 tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Calling method '.version_select at 0x7f4073bd6e50>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:42.818222 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-447d29c9-27c8-4b6b-b180-25555092c223 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:42.818839 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-447d29c9-27c8-4b6b-b180-25555092c223 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] [instance: afb1a503-7e9a-474c-8dfe-b0e5838b7398] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:42.831654 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-447d29c9-27c8-4b6b-b180-25555092c223 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:42.834170 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-447d29c9-27c8-4b6b-b180-25555092c223 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:42.834786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-447d29c9-27c8-4b6b-b180-25555092c223 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:42.835733 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-447d29c9-27c8-4b6b-b180-25555092c223 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:42.837168 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-447d29c9-27c8-4b6b-b180-25555092c223 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:42.838759 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-447d29c9-27c8-4b6b-b180-25555092c223 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:42.955443 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2707284f-d414-4caf-8ddb-88713fbd3220 tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/f07d4b0e0a684934a690e4392bd308b1/defaults" status: 200 len: 371 microversion: 2.1 time: 0.276105 Sep 10 11:41:42.963555 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 477/990] 10.222.0.23 () {58 vars in 1269 bytes} [Sat Sep 10 11:41:42 2022] GET /compute/v2.1/os-quota-sets/f07d4b0e0a684934a690e4392bd308b1/defaults => generated 371 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:41:42.973498 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1d3fb1a1-b5c8-491a-b508-76da2d9e99f7 tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Action: 'update', calling method: .version_select at 0x7f4073cda4c0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:43.063225 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1d3fb1a1-b5c8-491a-b508-76da2d9e99f7 tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:43.064311 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1d3fb1a1-b5c8-491a-b508-76da2d9e99f7 tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:43.064974 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1d3fb1a1-b5c8-491a-b508-76da2d9e99f7 tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:43.070659 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1d3fb1a1-b5c8-491a-b508-76da2d9e99f7 tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:43.071456 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1d3fb1a1-b5c8-491a-b508-76da2d9e99f7 tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:43.072701 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1d3fb1a1-b5c8-491a-b508-76da2d9e99f7 tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:43.422792 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=2,nova_api:INSERT=15 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:41:43.450682 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1d3fb1a1-b5c8-491a-b508-76da2d9e99f7 tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/f07d4b0e0a684934a690e4392bd308b1" status: 200 len: 329 microversion: 2.1 time: 0.481465 Sep 10 11:41:43.463027 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 478/991] 10.222.0.23 () {60 vars in 1263 bytes} [Sat Sep 10 11:41:42 2022] PUT /compute/v2.1/os-quota-sets/f07d4b0e0a684934a690e4392bd308b1 => generated 329 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:41:43.478549 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e331f105-3f84-4a1b-bfae-b95933fbaf3c tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Action: 'update', calling method: .version_select at 0x7f4073aa6940>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:43.556909 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-447d29c9-27c8-4b6b-b180-25555092c223 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1e51accd4241b497623f18f0d2967d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d3ca9bcf514a8b9844377fc53143ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:43.574427 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-447d29c9-27c8-4b6b-b180-25555092c223 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] 10.222.0.23 "GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398" status: 200 len: 1371 microversion: 2.1 time: 0.760092 Sep 10 11:41:43.591802 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 514/992] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:42 2022] GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398 => generated 1371 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:41:43.598963 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d5ba6918-78be-4b0d-8761-c255f86a1ac1 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:43.601125 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d5ba6918-78be-4b0d-8761-c255f86a1ac1 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] [instance: ebff5197-fc62-4ee6-a688-6e12f04645b5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:43.632925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d5ba6918-78be-4b0d-8761-c255f86a1ac1 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:43.633610 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d5ba6918-78be-4b0d-8761-c255f86a1ac1 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:43.636936 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d5ba6918-78be-4b0d-8761-c255f86a1ac1 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:43.641970 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d5ba6918-78be-4b0d-8761-c255f86a1ac1 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:43.655807 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d5ba6918-78be-4b0d-8761-c255f86a1ac1 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:43.658457 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d5ba6918-78be-4b0d-8761-c255f86a1ac1 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:43.662719 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e331f105-3f84-4a1b-bfae-b95933fbaf3c tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:43.673141 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e331f105-3f84-4a1b-bfae-b95933fbaf3c tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:43.678591 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e331f105-3f84-4a1b-bfae-b95933fbaf3c tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:43.680204 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e331f105-3f84-4a1b-bfae-b95933fbaf3c tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:43.691221 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e331f105-3f84-4a1b-bfae-b95933fbaf3c tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:43.693247 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e331f105-3f84-4a1b-bfae-b95933fbaf3c tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:44.295269 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-d5ba6918-78be-4b0d-8761-c255f86a1ac1 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lazy-loading 'services' on Instance uuid ebff5197-fc62-4ee6-a688-6e12f04645b5 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:41:44.321556 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d5ba6918-78be-4b0d-8761-c255f86a1ac1 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5" status: 200 len: 2035 microversion: 2.25 time: 0.728434 Sep 10 11:41:44.342466 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 515/993] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:43 2022] GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5 => generated 2035 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:44.371124 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3e5cd6a3-c554-498c-998e-59bcd4191c81 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-856895-1", "block_migration": "auto"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:44.374697 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3e5cd6a3-c554-498c-998e-59bcd4191c81 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] [instance: ebff5197-fc62-4ee6-a688-6e12f04645b5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:44.384987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e5cd6a3-c554-498c-998e-59bcd4191c81 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:44.385465 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e5cd6a3-c554-498c-998e-59bcd4191c81 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:44.389845 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e5cd6a3-c554-498c-998e-59bcd4191c81 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:44.390841 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e5cd6a3-c554-498c-998e-59bcd4191c81 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:44.391499 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e5cd6a3-c554-498c-998e-59bcd4191c81 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:44.396285 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e5cd6a3-c554-498c-998e-59bcd4191c81 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:44.471590 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-3e5cd6a3-c554-498c-998e-59bcd4191c81 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lazy-loading 'flavor' on Instance uuid ebff5197-fc62-4ee6-a688-6e12f04645b5 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:41:44.504408 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3e5cd6a3-c554-498c-998e-59bcd4191c81 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] [instance: ebff5197-fc62-4ee6-a688-6e12f04645b5] Going to try to live migrate instance to n-h1-856895-1 {{(pid=128777) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 10 11:41:44.505543 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e331f105-3f84-4a1b-bfae-b95933fbaf3c tempest-QuotasAdminTestJSON-617950402 tempest-QuotasAdminTestJSON-617950402-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/f07d4b0e0a684934a690e4392bd308b1" status: 200 len: 329 microversion: 2.1 time: 1.041268 Sep 10 11:41:44.509950 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 479/994] 10.222.0.23 () {60 vars in 1263 bytes} [Sat Sep 10 11:41:43 2022] PUT /compute/v2.1/os-quota-sets/f07d4b0e0a684934a690e4392bd308b1 => generated 329 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:41:44.610278 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-76102609-dfa8-4c0b-962a-c62dfa22e28f tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:44.613741 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-76102609-dfa8-4c0b-962a-c62dfa22e28f tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] [instance: afb1a503-7e9a-474c-8dfe-b0e5838b7398] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:44.622868 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-76102609-dfa8-4c0b-962a-c62dfa22e28f tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:44.623626 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-76102609-dfa8-4c0b-962a-c62dfa22e28f tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:44.624220 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-76102609-dfa8-4c0b-962a-c62dfa22e28f tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:44.627313 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-76102609-dfa8-4c0b-962a-c62dfa22e28f tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:44.628642 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-76102609-dfa8-4c0b-962a-c62dfa22e28f tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:44.631759 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-76102609-dfa8-4c0b-962a-c62dfa22e28f tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:45.286675 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-76102609-dfa8-4c0b-962a-c62dfa22e28f tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1e51accd4241b497623f18f0d2967d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d3ca9bcf514a8b9844377fc53143ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:45.297541 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-76102609-dfa8-4c0b-962a-c62dfa22e28f tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] 10.222.0.23 "GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398" status: 200 len: 1371 microversion: 2.1 time: 0.696279 Sep 10 11:41:45.303205 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 480/995] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:44 2022] GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398 => generated 1371 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:46.523876 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-90cf7cfa-b5f9-43e5-98ce-7a04fa49bc7f tempest-AbsoluteLimitsNegativeTestJSON-1535276786 tempest-AbsoluteLimitsNegativeTestJSON-1535276786-project] Calling method '.version_select at 0x7f40736b1280>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:46.540105 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90cf7cfa-b5f9-43e5-98ce-7a04fa49bc7f tempest-AbsoluteLimitsNegativeTestJSON-1535276786 tempest-AbsoluteLimitsNegativeTestJSON-1535276786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:46.540944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90cf7cfa-b5f9-43e5-98ce-7a04fa49bc7f tempest-AbsoluteLimitsNegativeTestJSON-1535276786 tempest-AbsoluteLimitsNegativeTestJSON-1535276786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:46.542010 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90cf7cfa-b5f9-43e5-98ce-7a04fa49bc7f tempest-AbsoluteLimitsNegativeTestJSON-1535276786 tempest-AbsoluteLimitsNegativeTestJSON-1535276786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:46.543995 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90cf7cfa-b5f9-43e5-98ce-7a04fa49bc7f tempest-AbsoluteLimitsNegativeTestJSON-1535276786 tempest-AbsoluteLimitsNegativeTestJSON-1535276786-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:46.544665 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90cf7cfa-b5f9-43e5-98ce-7a04fa49bc7f tempest-AbsoluteLimitsNegativeTestJSON-1535276786 tempest-AbsoluteLimitsNegativeTestJSON-1535276786-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:46.545596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90cf7cfa-b5f9-43e5-98ce-7a04fa49bc7f tempest-AbsoluteLimitsNegativeTestJSON-1535276786 tempest-AbsoluteLimitsNegativeTestJSON-1535276786-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:46.568591 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-90cf7cfa-b5f9-43e5-98ce-7a04fa49bc7f tempest-AbsoluteLimitsNegativeTestJSON-1535276786 tempest-AbsoluteLimitsNegativeTestJSON-1535276786-project] 10.222.0.23 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.729078 Sep 10 11:41:46.580564 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 481/996] 10.222.0.23 () {58 vars in 1122 bytes} [Sat Sep 10 11:41:45 2022] GET /compute/v2.1/limits => generated 511 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:41:46.621323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e3fae043-17e8-4949-8530-ca3016d291c9 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:46.630877 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e3fae043-17e8-4949-8530-ca3016d291c9 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] [instance: afb1a503-7e9a-474c-8dfe-b0e5838b7398] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:46.662084 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e3fae043-17e8-4949-8530-ca3016d291c9 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:46.666099 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e3fae043-17e8-4949-8530-ca3016d291c9 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:46.666710 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e3fae043-17e8-4949-8530-ca3016d291c9 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:46.672302 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e3fae043-17e8-4949-8530-ca3016d291c9 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:46.676402 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e3fae043-17e8-4949-8530-ca3016d291c9 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:46.677143 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e3fae043-17e8-4949-8530-ca3016d291c9 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:47.276888 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3e5cd6a3-c554-498c-998e-59bcd4191c81 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5/action" status: 202 len: 0 microversion: 2.25 time: 2.906370 Sep 10 11:41:47.282141 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 516/997] 10.222.0.23 () {62 vars in 1319 bytes} [Sat Sep 10 11:41:44 2022] POST /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5/action => generated 0 bytes in 2917 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:41:47.292210 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-87699969-f8cc-4b21-aca8-fa319a37bf25 tempest-AbsoluteLimitsNegativeTestJSON-1535276786 tempest-AbsoluteLimitsNegativeTestJSON-1535276786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1295301115", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:47.394136 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e3fae043-17e8-4949-8530-ca3016d291c9 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1e51accd4241b497623f18f0d2967d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d3ca9bcf514a8b9844377fc53143ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:47.406667 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e3fae043-17e8-4949-8530-ca3016d291c9 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] 10.222.0.23 "GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398" status: 200 len: 1371 microversion: 2.1 time: 0.799800 Sep 10 11:41:47.407730 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 482/998] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:46 2022] GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398 => generated 1371 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:47.423794 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-70216527-1070-49b5-970e-3d577346fa63 req-e7ffd104-cdd8-457e-815a-3eccc2bf8fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afb1a503-7e9a-474c-8dfe-b0e5838b7398", "name": "network-vif-plugged", "status": "completed", "tag": "8e001c1d-f9ea-4023-b007-0e7a4da45c81"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:47.451762 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-70216527-1070-49b5-970e-3d577346fa63 req-e7ffd104-cdd8-457e-815a-3eccc2bf8fa1 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:47.452690 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-70216527-1070-49b5-970e-3d577346fa63 req-e7ffd104-cdd8-457e-815a-3eccc2bf8fa1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:47.454836 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-70216527-1070-49b5-970e-3d577346fa63 req-e7ffd104-cdd8-457e-815a-3eccc2bf8fa1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:47.505620 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-70216527-1070-49b5-970e-3d577346fa63 req-e7ffd104-cdd8-457e-815a-3eccc2bf8fa1 service nova] Creating event network-vif-plugged:8e001c1d-f9ea-4023-b007-0e7a4da45c81 for instance afb1a503-7e9a-474c-8dfe-b0e5838b7398 on n-h1-856895-1 Sep 10 11:41:47.519774 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-70216527-1070-49b5-970e-3d577346fa63 req-e7ffd104-cdd8-457e-815a-3eccc2bf8fa1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107123 Sep 10 11:41:47.520580 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 483/999] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:41:47.527288 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-384e3f1b-5e30-4f8d-90d0-161a1038c931 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:47.529064 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-384e3f1b-5e30-4f8d-90d0-161a1038c931 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: ebff5197-fc62-4ee6-a688-6e12f04645b5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:47.541992 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-87699969-f8cc-4b21-aca8-fa319a37bf25 tempest-AbsoluteLimitsNegativeTestJSON-1535276786 tempest-AbsoluteLimitsNegativeTestJSON-1535276786-project] validate_networks() for None {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:41:47.546512 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-384e3f1b-5e30-4f8d-90d0-161a1038c931 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:47.547444 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-384e3f1b-5e30-4f8d-90d0-161a1038c931 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:47.548145 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-384e3f1b-5e30-4f8d-90d0-161a1038c931 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:47.549106 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-384e3f1b-5e30-4f8d-90d0-161a1038c931 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:47.549903 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-384e3f1b-5e30-4f8d-90d0-161a1038c931 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:47.550641 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-384e3f1b-5e30-4f8d-90d0-161a1038c931 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:48.289242 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-384e3f1b-5e30-4f8d-90d0-161a1038c931 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:48.313488 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-384e3f1b-5e30-4f8d-90d0-161a1038c931 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:48.319484 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-384e3f1b-5e30-4f8d-90d0-161a1038c931 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:48.327833 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-384e3f1b-5e30-4f8d-90d0-161a1038c931 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5" status: 200 len: 1567 microversion: 2.25 time: 0.803467 Sep 10 11:41:48.328485 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 484/1000] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:47 2022] GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5 => generated 1567 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:48.436335 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b1ae0ee6-4705-48df-b7a1-7b91595711b7 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:48.437178 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b1ae0ee6-4705-48df-b7a1-7b91595711b7 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] [instance: afb1a503-7e9a-474c-8dfe-b0e5838b7398] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:48.452570 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b1ae0ee6-4705-48df-b7a1-7b91595711b7 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:48.453547 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b1ae0ee6-4705-48df-b7a1-7b91595711b7 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:48.454709 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b1ae0ee6-4705-48df-b7a1-7b91595711b7 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:48.457760 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b1ae0ee6-4705-48df-b7a1-7b91595711b7 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:48.461000 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b1ae0ee6-4705-48df-b7a1-7b91595711b7 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:48.461677 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b1ae0ee6-4705-48df-b7a1-7b91595711b7 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:48.887756 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b1ae0ee6-4705-48df-b7a1-7b91595711b7 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1e51accd4241b497623f18f0d2967d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d3ca9bcf514a8b9844377fc53143ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:48.898729 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b1ae0ee6-4705-48df-b7a1-7b91595711b7 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] 10.222.0.23 "GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398" status: 200 len: 1371 microversion: 2.1 time: 0.467794 Sep 10 11:41:48.899558 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 485/1001] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:48 2022] GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398 => generated 1371 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:49.037636 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-87699969-f8cc-4b21-aca8-fa319a37bf25 tempest-AbsoluteLimitsNegativeTestJSON-1535276786 tempest-AbsoluteLimitsNegativeTestJSON-1535276786-project] Getting quotas for project d94a8f9859d34c0a89d4676ce64cea22. Resources: dict_keys(['metadata_items']) {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:41:49.060092 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:41:49.070980 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-87699969-f8cc-4b21-aca8-fa319a37bf25 tempest-AbsoluteLimitsNegativeTestJSON-1535276786 tempest-AbsoluteLimitsNegativeTestJSON-1535276786-project] Getting quotas for user 9c6e352c94284d0c87f4859f6d906e86 and project d94a8f9859d34c0a89d4676ce64cea22. Resources: dict_keys(['metadata_items']) {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:41:49.113764 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-87699969-f8cc-4b21-aca8-fa319a37bf25 tempest-AbsoluteLimitsNegativeTestJSON-1535276786 tempest-AbsoluteLimitsNegativeTestJSON-1535276786-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Sep 10 11:41:49.132675 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-87699969-f8cc-4b21-aca8-fa319a37bf25 tempest-AbsoluteLimitsNegativeTestJSON-1535276786 tempest-AbsoluteLimitsNegativeTestJSON-1535276786-project] Request method failure captured: Sep 10 11:41:49.132675 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 11:41:49.132675 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:41:49.132675 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:41:49.132675 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:41:49.132675 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 1752 Sep 10 11:41:49.132675 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:41:49.132675 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:41:49.132675 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:41:49.132675 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:41:49.132675 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHf5BSeN7K_IaR7VOItgG2mRRZfMBDPrh0IMzdjdVrjr0Mpmr3IN3ysvOqogi9rFCMtK75OhdkbmrYxYkB_AUgRz4xOAL7GDulIJxLW2x7Ga8-G0qikyTnq06-vfbuMZo_dmdOkPNGGqEIXx6cj-4Kx1q4ohp65v7xGoF42rP9JQWvE Sep 10 11:41:49.132675 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:41:49.132675 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:41:49.132675 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:41:49.132675 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:41:49.132675 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:41:49.132675 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:41:49.132675 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: d94a8f9859d34c0a89d4676ce64cea22 Sep 10 11:41:49.132675 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1535276786 Sep 10 11:41:49.132675 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:41:49.132675 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:41:49.132675 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d94a8f9859d34c0a89d4676ce64cea22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d94a8f9859d34c0a89d4676ce64cea22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d94a8f9859d34c0a89d4676ce64cea22", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d94a8f9859d34c0a89d4676ce64cea22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:41:49.132675 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1535276786 Sep 10 11:41:49.132675 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: d94a8f9859d34c0a89d4676ce64cea22 Sep 10 11:41:49.132675 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1535276786 Sep 10 11:41:49.132675 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1535276786-project Sep 10 11:41:49.132675 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:41:49.132675 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:41:49.132675 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 9c6e352c94284d0c87f4859f6d906e86 Sep 10 11:41:49.132675 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1535276786-project Sep 10 11:41:49.132675 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:41:49.132675 n-d-856895-1 devstack@n-api.service[128777]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1295301115", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Sep 10 11:41:49.132675 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:41:49.132675 n-d-856895-1 devstack@n-api.service[128777]: exception: Maximum number of metadata items exceeds 128 Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1295301115', 'imageRef': 'c23d4d62-7ab9-4623-9273-7f44582aa2e1', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:41:49.135018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:41:49.140825 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:41:49.140825 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 10 11:41:49.140825 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 10 11:41:49.140825 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 10 11:41:49.140825 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Sep 10 11:41:49.140825 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:49.140825 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:41:49.140825 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:49.140825 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:41:49.140825 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:41:49.140825 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:41:49.140825 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:41:49.140825 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:41:49.140825 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Sep 10 11:41:49.140825 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:41:49.144633 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-87699969-f8cc-4b21-aca8-fa319a37bf25 tempest-AbsoluteLimitsNegativeTestJSON-1535276786 tempest-AbsoluteLimitsNegativeTestJSON-1535276786-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:41:49.145766 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-87699969-f8cc-4b21-aca8-fa319a37bf25 tempest-AbsoluteLimitsNegativeTestJSON-1535276786 tempest-AbsoluteLimitsNegativeTestJSON-1535276786-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.861099 Sep 10 11:41:49.146599 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 517/1002] 10.222.0.23 () {60 vars in 1148 bytes} [Sat Sep 10 11:41:47 2022] POST /compute/v2.1/servers => generated 87 bytes in 1864 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:41:49.398975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-eddc25bb-bf91-4b6d-a010-4a698a0bbc73 tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] Action: 'create', calling method: .version_select at 0x7f40736b1700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-510983830", "description": "tempest-description-1128063133"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:49.514581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ede0175c-1071-466a-ab02-e930aef2cc86 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-631286557", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:49.627270 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-ede0175c-1071-466a-ab02-e930aef2cc86 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] validate_networks() for None {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:41:50.220495 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-eddc25bb-bf91-4b6d-a010-4a698a0bbc73 tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.319774 Sep 10 11:41:50.221340 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 486/1003] 10.222.0.23 () {60 vars in 1180 bytes} [Sat Sep 10 11:41:48 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:41:50.226953 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-731f9196-8f40-4156-94aa-ee32f679b006 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:50.227775 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-731f9196-8f40-4156-94aa-ee32f679b006 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: ebff5197-fc62-4ee6-a688-6e12f04645b5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:50.244676 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-731f9196-8f40-4156-94aa-ee32f679b006 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:50.249902 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-731f9196-8f40-4156-94aa-ee32f679b006 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:50.261114 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-731f9196-8f40-4156-94aa-ee32f679b006 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:50.262490 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-731f9196-8f40-4156-94aa-ee32f679b006 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:50.263047 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-731f9196-8f40-4156-94aa-ee32f679b006 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:50.263554 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-731f9196-8f40-4156-94aa-ee32f679b006 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:50.609271 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-ede0175c-1071-466a-ab02-e930aef2cc86 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:41:50.609747 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-ede0175c-1071-466a-ab02-e930aef2cc86 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:41:50.610174 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-ede0175c-1071-466a-ab02-e930aef2cc86 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:41:50.610589 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-ede0175c-1071-466a-ab02-e930aef2cc86 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:41:50.611005 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-ede0175c-1071-466a-ab02-e930aef2cc86 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:41:50.630856 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ede0175c-1071-466a-ab02-e930aef2cc86 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:50.631385 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ede0175c-1071-466a-ab02-e930aef2cc86 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:50.632884 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ede0175c-1071-466a-ab02-e930aef2cc86 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:50.633650 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ede0175c-1071-466a-ab02-e930aef2cc86 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:50.634223 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ede0175c-1071-466a-ab02-e930aef2cc86 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:50.634543 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ede0175c-1071-466a-ab02-e930aef2cc86 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:50.674984 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-ede0175c-1071-466a-ab02-e930aef2cc86 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Getting quotas for project 7b37b36096cd42f6b6568ff9eee2751c. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:41:50.680692 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-731f9196-8f40-4156-94aa-ee32f679b006 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:50.682931 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-ede0175c-1071-466a-ab02-e930aef2cc86 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Getting quotas for user 77d854474f4c4481ac407a76b4627c69 and project 7b37b36096cd42f6b6568ff9eee2751c. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:41:50.704344 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-731f9196-8f40-4156-94aa-ee32f679b006 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:50.708422 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-731f9196-8f40-4156-94aa-ee32f679b006 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:50.711129 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ede0175c-1071-466a-ab02-e930aef2cc86 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:41:50.713939 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-731f9196-8f40-4156-94aa-ee32f679b006 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5" status: 200 len: 1567 microversion: 2.25 time: 0.487460 Sep 10 11:41:50.717380 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ede0175c-1071-466a-ab02-e930aef2cc86 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:41:50.718460 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 487/1004] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:50 2022] GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5 => generated 1567 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:50.725444 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-30ad07ea-4a5f-4929-8c44-5b970beefed2 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:50.747453 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-30ad07ea-4a5f-4929-8c44-5b970beefed2 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] [instance: afb1a503-7e9a-474c-8dfe-b0e5838b7398] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:50.772040 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-30ad07ea-4a5f-4929-8c44-5b970beefed2 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:50.774953 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-30ad07ea-4a5f-4929-8c44-5b970beefed2 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:50.776039 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-30ad07ea-4a5f-4929-8c44-5b970beefed2 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:50.779810 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-30ad07ea-4a5f-4929-8c44-5b970beefed2 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:50.782448 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-30ad07ea-4a5f-4929-8c44-5b970beefed2 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:50.784257 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-30ad07ea-4a5f-4929-8c44-5b970beefed2 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:50.864509 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ede0175c-1071-466a-ab02-e930aef2cc86 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.715746 Sep 10 11:41:50.865515 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 518/1005] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:41:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:41:50.879978 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-17f9f33c-4d5c-44e9-b9af-ac2117cd3e74 tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] Action: 'create', calling method: .version_select at 0x7f4073244dc0>, body: {"security_group_rule": {"parent_group_id": "3e8b3651-dce7-46a3-8a48-4940c1bf59b3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:51.542325 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-30ad07ea-4a5f-4929-8c44-5b970beefed2 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1e51accd4241b497623f18f0d2967d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d3ca9bcf514a8b9844377fc53143ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:51.561624 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-30ad07ea-4a5f-4929-8c44-5b970beefed2 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] 10.222.0.23 "GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398" status: 200 len: 1557 microversion: 2.1 time: 0.840730 Sep 10 11:41:51.569965 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 488/1006] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:50 2022] GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398 => generated 1557 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:51.605878 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-1ddd149f-92d2-431f-aa54-7c6aab644f8b req-4ae9f1c4-0db5-4bb5-9be6-b276badb4961 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebff5197-fc62-4ee6-a688-6e12f04645b5", "name": "network-vif-unplugged", "status": "completed", "tag": "cbd26a57-8480-4427-a718-f5ccf1736f8d"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:51.619810 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-1ddd149f-92d2-431f-aa54-7c6aab644f8b req-4ae9f1c4-0db5-4bb5-9be6-b276badb4961 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:51.620667 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-1ddd149f-92d2-431f-aa54-7c6aab644f8b req-4ae9f1c4-0db5-4bb5-9be6-b276badb4961 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:51.622127 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-1ddd149f-92d2-431f-aa54-7c6aab644f8b req-4ae9f1c4-0db5-4bb5-9be6-b276badb4961 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:51.656255 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-1ddd149f-92d2-431f-aa54-7c6aab644f8b req-4ae9f1c4-0db5-4bb5-9be6-b276badb4961 service nova] Creating event network-vif-unplugged:cbd26a57-8480-4427-a718-f5ccf1736f8d for instance ebff5197-fc62-4ee6-a688-6e12f04645b5 on n-h2-856895-1 Sep 10 11:41:51.666846 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-1ddd149f-92d2-431f-aa54-7c6aab644f8b req-4ae9f1c4-0db5-4bb5-9be6-b276badb4961 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079050 Sep 10 11:41:51.669805 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 489/1007] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:41:51.680439 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-eb978ed6-0695-4f41-b178-8d411c15deb9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:51.681903 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-eb978ed6-0695-4f41-b178-8d411c15deb9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:51.860676 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-eb978ed6-0695-4f41-b178-8d411c15deb9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:51.871830 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-eb978ed6-0695-4f41-b178-8d411c15deb9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1212 microversion: 2.1 time: 0.198667 Sep 10 11:41:51.873214 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 490/1008] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:51 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1212 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:51.903683 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8d2569fc-edeb-4520-ad15-575cf15f89fe tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:51.913279 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8d2569fc-edeb-4520-ad15-575cf15f89fe tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] [instance: afb1a503-7e9a-474c-8dfe-b0e5838b7398] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:51.932687 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8d2569fc-edeb-4520-ad15-575cf15f89fe tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:51.933124 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8d2569fc-edeb-4520-ad15-575cf15f89fe tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:51.943184 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8d2569fc-edeb-4520-ad15-575cf15f89fe tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:51.949433 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8d2569fc-edeb-4520-ad15-575cf15f89fe tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:51.949971 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8d2569fc-edeb-4520-ad15-575cf15f89fe tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:51.950429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8d2569fc-edeb-4520-ad15-575cf15f89fe tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:52.023535 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-17f9f33c-4d5c-44e9-b9af-ac2117cd3e74 tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.147943 Sep 10 11:41:52.024704 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 519/1009] 10.222.0.23 () {60 vars in 1195 bytes} [Sat Sep 10 11:41:50 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:41:52.033129 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-26e65191-94a7-465a-b0b2-4443a667bf08 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:52.034057 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-26e65191-94a7-465a-b0b2-4443a667bf08 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: ebff5197-fc62-4ee6-a688-6e12f04645b5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:52.045324 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-26e65191-94a7-465a-b0b2-4443a667bf08 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:52.048070 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-26e65191-94a7-465a-b0b2-4443a667bf08 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:52.049801 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-26e65191-94a7-465a-b0b2-4443a667bf08 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:52.052413 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-26e65191-94a7-465a-b0b2-4443a667bf08 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:52.054370 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-26e65191-94a7-465a-b0b2-4443a667bf08 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:52.054987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-26e65191-94a7-465a-b0b2-4443a667bf08 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:52.392206 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8d2569fc-edeb-4520-ad15-575cf15f89fe tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] 10.222.0.23 "GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.506266 Sep 10 11:41:52.401163 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 491/1010] 10.222.0.23 () {58 vars in 1275 bytes} [Sat Sep 10 11:41:51 2022] GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398/os-interface => generated 284 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:41:52.413298 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a91ea448-ab08-4867-b100-c3f5cc3bb82a tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] Action: 'create', calling method: .version_select at 0x7f4073a49820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-683422958", "description": "tempest-description-531949248"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:53.177383 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-26e65191-94a7-465a-b0b2-4443a667bf08 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:53.193323 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-26e65191-94a7-465a-b0b2-4443a667bf08 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:53.202837 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-26e65191-94a7-465a-b0b2-4443a667bf08 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:53.207641 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-26e65191-94a7-465a-b0b2-4443a667bf08 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5" status: 200 len: 1567 microversion: 2.25 time: 1.181050 Sep 10 11:41:53.211879 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 520/1011] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:52 2022] GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5 => generated 1567 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:53.242357 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-29f75b18-0141-48bb-92f3-494d83f60471 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:53.243088 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-29f75b18-0141-48bb-92f3-494d83f60471 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:53.252858 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29f75b18-0141-48bb-92f3-494d83f60471 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:53.253354 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29f75b18-0141-48bb-92f3-494d83f60471 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:53.253792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29f75b18-0141-48bb-92f3-494d83f60471 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:53.254863 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29f75b18-0141-48bb-92f3-494d83f60471 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:53.255357 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29f75b18-0141-48bb-92f3-494d83f60471 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:53.256039 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29f75b18-0141-48bb-92f3-494d83f60471 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:53.361988 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-29f75b18-0141-48bb-92f3-494d83f60471 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:53.375298 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-29f75b18-0141-48bb-92f3-494d83f60471 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1270 microversion: 2.1 time: 0.140471 Sep 10 11:41:53.377479 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 521/1012] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:53 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1270 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:53.379498 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-29f75b18-0141-48bb-92f3-494d83f60471 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:53.383843 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-29f75b18-0141-48bb-92f3-494d83f60471 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003762 Sep 10 11:41:53.384914 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 522/1013] 10.222.0.23 () {56 vars in 886 bytes} [Sat Sep 10 11:41:53 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 10 11:41:53.511002 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a91ea448-ab08-4867-b100-c3f5cc3bb82a tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.107671 Sep 10 11:41:53.512798 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 492/1014] 10.222.0.23 () {60 vars in 1180 bytes} [Sat Sep 10 11:41:52 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:41:53.528121 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-50390f08-0fbe-469f-9c1b-3091c217e279 tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] Action: 'create', calling method: .version_select at 0x7f407328e4c0>, body: {"security_group_rule": {"parent_group_id": "be52c45c-3578-4e18-9e05-ffc33492e07f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:53.722722 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-01abb178-18b1-4271-82c1-f82f80789edf req-9f3c6722-a31f-4ede-8603-fd4cb4ce5df7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebff5197-fc62-4ee6-a688-6e12f04645b5", "tag": "cbd26a57-8480-4427-a718-f5ccf1736f8d"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:53.741904 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=14,nova_api:UPDATE=14 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:41:53.779455 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-01abb178-18b1-4271-82c1-f82f80789edf req-9f3c6722-a31f-4ede-8603-fd4cb4ce5df7 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:53.779997 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-01abb178-18b1-4271-82c1-f82f80789edf req-9f3c6722-a31f-4ede-8603-fd4cb4ce5df7 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:53.780445 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-01abb178-18b1-4271-82c1-f82f80789edf req-9f3c6722-a31f-4ede-8603-fd4cb4ce5df7 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:53.852109 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-01abb178-18b1-4271-82c1-f82f80789edf req-9f3c6722-a31f-4ede-8603-fd4cb4ce5df7 service nova] Creating event network-changed:cbd26a57-8480-4427-a718-f5ccf1736f8d for instance ebff5197-fc62-4ee6-a688-6e12f04645b5 on n-h2-856895-1 Sep 10 11:41:53.866244 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-01abb178-18b1-4271-82c1-f82f80789edf req-9f3c6722-a31f-4ede-8603-fd4cb4ce5df7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154162 Sep 10 11:41:53.870429 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 493/1015] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:41:54.080029 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8563728f-dd61-4b24-9c2b-b56dd83baec5 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Action: 'create', calling method: .version_select at 0x7f40736b14c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-286358105", "description": "tempest-description-1645501969"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:54.513532 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-50390f08-0fbe-469f-9c1b-3091c217e279 tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.991851 Sep 10 11:41:54.515806 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 523/1016] 10.222.0.23 () {60 vars in 1195 bytes} [Sat Sep 10 11:41:53 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:41:54.520853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1e69358b-3144-4c44-96a7-ac6bf34c79a2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:54.524194 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1e69358b-3144-4c44-96a7-ac6bf34c79a2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: ebff5197-fc62-4ee6-a688-6e12f04645b5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:54.545537 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1e69358b-3144-4c44-96a7-ac6bf34c79a2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:54.546040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1e69358b-3144-4c44-96a7-ac6bf34c79a2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:54.546481 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1e69358b-3144-4c44-96a7-ac6bf34c79a2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:54.547217 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1e69358b-3144-4c44-96a7-ac6bf34c79a2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:54.547682 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1e69358b-3144-4c44-96a7-ac6bf34c79a2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:54.548110 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1e69358b-3144-4c44-96a7-ac6bf34c79a2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:54.983217 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1e69358b-3144-4c44-96a7-ac6bf34c79a2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:55.003852 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1e69358b-3144-4c44-96a7-ac6bf34c79a2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:55.007440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1e69358b-3144-4c44-96a7-ac6bf34c79a2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:55.012150 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1e69358b-3144-4c44-96a7-ac6bf34c79a2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5" status: 200 len: 1567 microversion: 2.25 time: 0.494958 Sep 10 11:41:55.035564 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 524/1017] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:54 2022] GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5 => generated 1567 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:55.054454 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f572d959-d13f-4ee7-bd06-763f98feb57d tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:55.059522 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f572d959-d13f-4ee7-bd06-763f98feb57d tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:55.073144 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f572d959-d13f-4ee7-bd06-763f98feb57d tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:55.078050 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f572d959-d13f-4ee7-bd06-763f98feb57d tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:55.078937 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f572d959-d13f-4ee7-bd06-763f98feb57d tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:55.084743 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f572d959-d13f-4ee7-bd06-763f98feb57d tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:55.085796 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f572d959-d13f-4ee7-bd06-763f98feb57d tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:55.087982 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f572d959-d13f-4ee7-bd06-763f98feb57d tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:55.613473 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f572d959-d13f-4ee7-bd06-763f98feb57d tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:55.630577 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f572d959-d13f-4ee7-bd06-763f98feb57d tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1312 microversion: 2.1 time: 0.592325 Sep 10 11:41:55.634392 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 525/1018] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:55 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1312 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:55.643604 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fe8cd560-ff5e-4ec7-976f-844dcc3162d5 tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] Action: 'create', calling method: .version_select at 0x7f40732f2430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-968281380", "description": "tempest-description-1447051137"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:55.795231 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8563728f-dd61-4b24-9c2b-b56dd83baec5 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.905143 Sep 10 11:41:55.796501 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 494/1019] 10.222.0.23 () {60 vars in 1180 bytes} [Sat Sep 10 11:41:53 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1908 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:41:55.814140 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c4abd9e8-228d-4811-84cd-37a9809fbb86 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Action: 'create', calling method: .version_select at 0x7f40739ae9d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-728887220", "description": "tempest-description-1048588458"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:56.315777 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fe8cd560-ff5e-4ec7-976f-844dcc3162d5 tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.680075 Sep 10 11:41:56.316580 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 526/1020] 10.222.0.23 () {60 vars in 1180 bytes} [Sat Sep 10 11:41:55 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:41:56.321612 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-d5201de3-7f27-4708-b109-a4efa1d30c0e req-50f8a071-3491-4589-bc51-0ffe27faf775 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afb1a503-7e9a-474c-8dfe-b0e5838b7398", "tag": "8e001c1d-f9ea-4023-b007-0e7a4da45c81"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:56.337918 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d5201de3-7f27-4708-b109-a4efa1d30c0e req-50f8a071-3491-4589-bc51-0ffe27faf775 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:56.341754 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d5201de3-7f27-4708-b109-a4efa1d30c0e req-50f8a071-3491-4589-bc51-0ffe27faf775 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:56.345185 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d5201de3-7f27-4708-b109-a4efa1d30c0e req-50f8a071-3491-4589-bc51-0ffe27faf775 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:56.370951 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-d5201de3-7f27-4708-b109-a4efa1d30c0e req-50f8a071-3491-4589-bc51-0ffe27faf775 service nova] Creating event network-changed:8e001c1d-f9ea-4023-b007-0e7a4da45c81 for instance afb1a503-7e9a-474c-8dfe-b0e5838b7398 on n-h1-856895-1 Sep 10 11:41:56.378759 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-d5201de3-7f27-4708-b109-a4efa1d30c0e req-50f8a071-3491-4589-bc51-0ffe27faf775 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060401 Sep 10 11:41:56.380114 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 527/1021] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:41:56.392172 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-94009248-68d3-4d67-89ae-1d307b32b527 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:56.398690 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-94009248-68d3-4d67-89ae-1d307b32b527 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: ebff5197-fc62-4ee6-a688-6e12f04645b5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:56.413700 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94009248-68d3-4d67-89ae-1d307b32b527 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:56.414381 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94009248-68d3-4d67-89ae-1d307b32b527 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:56.415695 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94009248-68d3-4d67-89ae-1d307b32b527 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:56.417537 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94009248-68d3-4d67-89ae-1d307b32b527 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:56.419142 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94009248-68d3-4d67-89ae-1d307b32b527 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:56.420013 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94009248-68d3-4d67-89ae-1d307b32b527 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:56.502030 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c4abd9e8-228d-4811-84cd-37a9809fbb86 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.684522 Sep 10 11:41:56.503183 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 495/1022] 10.222.0.23 () {60 vars in 1180 bytes} [Sat Sep 10 11:41:55 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:41:56.523105 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bd86fb17-d322-40e1-9ded-4028dbd1fe94 tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] Action: 'create', calling method: .version_select at 0x7f4073679b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1912998336", "description": "tempest-description-2021280972"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:56.560259 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=15 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:41:57.057263 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-94009248-68d3-4d67-89ae-1d307b32b527 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:57.069670 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-94009248-68d3-4d67-89ae-1d307b32b527 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:57.075246 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-94009248-68d3-4d67-89ae-1d307b32b527 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:57.076485 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-94009248-68d3-4d67-89ae-1d307b32b527 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5" status: 200 len: 1567 microversion: 2.25 time: 0.693800 Sep 10 11:41:57.077066 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 528/1023] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:56 2022] GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5 => generated 1567 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:57.114914 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5f567062-c3ef-4bd5-869e-a76ee493f214 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:57.116118 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5f567062-c3ef-4bd5-869e-a76ee493f214 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:57.133971 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5f567062-c3ef-4bd5-869e-a76ee493f214 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:57.134880 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5f567062-c3ef-4bd5-869e-a76ee493f214 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:57.138068 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5f567062-c3ef-4bd5-869e-a76ee493f214 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:57.138883 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5f567062-c3ef-4bd5-869e-a76ee493f214 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:57.140351 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5f567062-c3ef-4bd5-869e-a76ee493f214 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:57.141821 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5f567062-c3ef-4bd5-869e-a76ee493f214 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:57.588095 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5f567062-c3ef-4bd5-869e-a76ee493f214 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:57.608576 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5f567062-c3ef-4bd5-869e-a76ee493f214 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1312 microversion: 2.1 time: 0.506306 Sep 10 11:41:57.610432 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 529/1024] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:57 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1312 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:57.642995 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d949eaf7-138a-4500-93a9-f12ecf6b8b42 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-811114104", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "28b67fe2-5503-41de-b65a-9b3158a1792c"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:57.764534 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bd86fb17-d322-40e1-9ded-4028dbd1fe94 tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.249753 Sep 10 11:41:57.766518 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 496/1025] 10.222.0.23 () {60 vars in 1180 bytes} [Sat Sep 10 11:41:56 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:41:57.779505 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3a34cb94-5fff-4ad7-ac34-0858bc06c43a tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] Action: 'create', calling method: .version_select at 0x7f407365e8b0>, body: {"security_group_rule": {"parent_group_id": "fd9f0250-eb1c-4060-8ba7-73d0ecd1377f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "9b81e2f8-82fe-4dc4-8349-92e4c8553270"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:57.818285 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-d949eaf7-138a-4500-93a9-f12ecf6b8b42 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] validate_networks() for [('28b67fe2-5503-41de-b65a-9b3158a1792c', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:41:59.037944 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3a34cb94-5fff-4ad7-ac34-0858bc06c43a tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.262952 Sep 10 11:41:59.039721 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 497/1026] 10.222.0.23 () {60 vars in 1195 bytes} [Sat Sep 10 11:41:57 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:41:59.092439 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d949eaf7-138a-4500-93a9-f12ecf6b8b42 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:41:59.093160 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d949eaf7-138a-4500-93a9-f12ecf6b8b42 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:41:59.093873 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d949eaf7-138a-4500-93a9-f12ecf6b8b42 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:41:59.094080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d949eaf7-138a-4500-93a9-f12ecf6b8b42 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:41:59.094459 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d949eaf7-138a-4500-93a9-f12ecf6b8b42 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:41:59.111766 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d949eaf7-138a-4500-93a9-f12ecf6b8b42 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:59.112435 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d949eaf7-138a-4500-93a9-f12ecf6b8b42 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:59.113069 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d949eaf7-138a-4500-93a9-f12ecf6b8b42 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:59.113978 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d949eaf7-138a-4500-93a9-f12ecf6b8b42 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:59.114681 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d949eaf7-138a-4500-93a9-f12ecf6b8b42 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:59.115338 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d949eaf7-138a-4500-93a9-f12ecf6b8b42 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:59.140380 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-d949eaf7-138a-4500-93a9-f12ecf6b8b42 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Getting quotas for project 91ad59d8440a49c496acbede9848e944. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:41:59.147869 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-d949eaf7-138a-4500-93a9-f12ecf6b8b42 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Getting quotas for user 080c97b7605a40ebac26884a59ea3902 and project 91ad59d8440a49c496acbede9848e944. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:41:59.163292 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d949eaf7-138a-4500-93a9-f12ecf6b8b42 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:41:59.166441 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d949eaf7-138a-4500-93a9-f12ecf6b8b42 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: f86661f1-aaad-445e-a762-12d85ccd0340] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:41:59.222402 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d949eaf7-138a-4500-93a9-f12ecf6b8b42 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.609399 Sep 10 11:41:59.228716 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 530/1027] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:41:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:41:59.234577 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9d5824a2-8021-4b29-947d-337b0704cabd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:59.236181 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9d5824a2-8021-4b29-947d-337b0704cabd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: ebff5197-fc62-4ee6-a688-6e12f04645b5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:59.248875 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9d5824a2-8021-4b29-947d-337b0704cabd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:59.249458 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9d5824a2-8021-4b29-947d-337b0704cabd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:59.249964 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9d5824a2-8021-4b29-947d-337b0704cabd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:59.250631 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9d5824a2-8021-4b29-947d-337b0704cabd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:59.250974 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9d5824a2-8021-4b29-947d-337b0704cabd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:59.251438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9d5824a2-8021-4b29-947d-337b0704cabd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:59.274275 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:41:59.294587 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-efe22cdd-0da1-4dcf-9484-9ffd6287fb69 tempest-ExtensionsTest-604567628 tempest-ExtensionsTest-604567628-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:59.296471 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-efe22cdd-0da1-4dcf-9484-9ffd6287fb69 tempest-ExtensionsTest-604567628 tempest-ExtensionsTest-604567628-project] 10.222.0.23 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.255356 Sep 10 11:41:59.297020 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 498/1028] 10.222.0.23 () {58 vars in 1170 bytes} [Sat Sep 10 11:41:59 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:41:59.315481 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-2e14f995-f0b8-4e0b-a280-e3106f821cea req-b7fcfafb-5284-4d89-8ffb-d779a1363347 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3606a9e-e02c-451e-98b9-2e6395c6af17", "tag": "f498d2de-3776-434f-9d82-c17325598f02"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:59.326409 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-2e14f995-f0b8-4e0b-a280-e3106f821cea req-b7fcfafb-5284-4d89-8ffb-d779a1363347 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:59.326976 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-2e14f995-f0b8-4e0b-a280-e3106f821cea req-b7fcfafb-5284-4d89-8ffb-d779a1363347 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:59.327506 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-2e14f995-f0b8-4e0b-a280-e3106f821cea req-b7fcfafb-5284-4d89-8ffb-d779a1363347 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:59.339932 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-2e14f995-f0b8-4e0b-a280-e3106f821cea req-b7fcfafb-5284-4d89-8ffb-d779a1363347 service nova] Creating event network-changed:f498d2de-3776-434f-9d82-c17325598f02 for instance e3606a9e-e02c-451e-98b9-2e6395c6af17 on n-h2-856895-1 Sep 10 11:41:59.345731 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-2e14f995-f0b8-4e0b-a280-e3106f821cea req-b7fcfafb-5284-4d89-8ffb-d779a1363347 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047341 Sep 10 11:41:59.346423 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 499/1029] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:41:59.351839 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dcc00255-be63-43df-b7d2-6066d351b1c8 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:41:59.352609 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-dcc00255-be63-43df-b7d2-6066d351b1c8 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:41:59.359082 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dcc00255-be63-43df-b7d2-6066d351b1c8 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:59.359623 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dcc00255-be63-43df-b7d2-6066d351b1c8 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:59.360061 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dcc00255-be63-43df-b7d2-6066d351b1c8 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:59.360889 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dcc00255-be63-43df-b7d2-6066d351b1c8 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:41:59.361218 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dcc00255-be63-43df-b7d2-6066d351b1c8 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:41:59.361647 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dcc00255-be63-43df-b7d2-6066d351b1c8 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:41:59.458268 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9d5824a2-8021-4b29-947d-337b0704cabd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:59.470968 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9d5824a2-8021-4b29-947d-337b0704cabd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:59.472626 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9d5824a2-8021-4b29-947d-337b0704cabd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:59.480981 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9d5824a2-8021-4b29-947d-337b0704cabd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5" status: 200 len: 1567 microversion: 2.25 time: 0.255845 Sep 10 11:41:59.481563 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 531/1030] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:41:59 2022] GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5 => generated 1567 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:41:59.567773 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-dcc00255-be63-43df-b7d2-6066d351b1c8 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:41:59.577072 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-dcc00255-be63-43df-b7d2-6066d351b1c8 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1312 microversion: 2.1 time: 0.229313 Sep 10 11:41:59.577716 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 500/1031] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:41:59 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1312 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:41:59.582982 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e29a869b-e362-4cd4-a51f-ee37a0b4391d tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] Action: 'create', calling method: .version_select at 0x7f4073a495e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1177551481", "description": "tempest-description-266146286"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:59.584143 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fb646ef7-5181-4336-8136-ffdd5d315852 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-933774305", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:41:59.659326 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-fb646ef7-5181-4336-8136-ffdd5d315852 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] validate_networks() for None {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:42:00.150766 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e29a869b-e362-4cd4-a51f-ee37a0b4391d tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.571729 Sep 10 11:42:00.155407 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 501/1032] 10.222.0.23 () {60 vars in 1180 bytes} [Sat Sep 10 11:41:59 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:42:00.157538 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-54a10c64-8eaf-4468-b67a-5054c07b7e54 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:00.158379 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-54a10c64-8eaf-4468-b67a-5054c07b7e54 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: f86661f1-aaad-445e-a762-12d85ccd0340] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:00.165493 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-54a10c64-8eaf-4468-b67a-5054c07b7e54 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:00.166591 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-54a10c64-8eaf-4468-b67a-5054c07b7e54 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:00.167131 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-54a10c64-8eaf-4468-b67a-5054c07b7e54 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:00.168278 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-54a10c64-8eaf-4468-b67a-5054c07b7e54 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:00.168965 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-54a10c64-8eaf-4468-b67a-5054c07b7e54 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:00.169460 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-54a10c64-8eaf-4468-b67a-5054c07b7e54 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:00.260242 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-54a10c64-8eaf-4468-b67a-5054c07b7e54 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c97b7605a40ebac26884a59ea3902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ad59d8440a49c496acbede9848e944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:00.270037 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-54a10c64-8eaf-4468-b67a-5054c07b7e54 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/servers/f86661f1-aaad-445e-a762-12d85ccd0340" status: 200 len: 1267 microversion: 2.1 time: 0.116678 Sep 10 11:42:00.270620 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 502/1033] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:00 2022] GET /compute/v2.1/servers/f86661f1-aaad-445e-a762-12d85ccd0340 => generated 1267 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:00.275310 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8480b820-c563-412e-9428-ac87a4bd2e68 tempest-ExtensionsTest-604567628 tempest-ExtensionsTest-604567628-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:00.278051 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8480b820-c563-412e-9428-ac87a4bd2e68 tempest-ExtensionsTest-604567628 tempest-ExtensionsTest-604567628-project] 10.222.0.23 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.006226 Sep 10 11:42:00.278791 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 503/1034] 10.222.0.23 () {58 vars in 1134 bytes} [Sat Sep 10 11:42:00 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:42:00.295662 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3e9b2520-d69c-4240-a319-3ea50eb6114d tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] Action: 'create', calling method: .version_select at 0x7f4073e12e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-861391841", "description": "tempest-description-976310200"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:00.340882 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-fb646ef7-5181-4336-8136-ffdd5d315852 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:42:00.341410 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-fb646ef7-5181-4336-8136-ffdd5d315852 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:42:00.341896 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-fb646ef7-5181-4336-8136-ffdd5d315852 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:42:00.342519 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-fb646ef7-5181-4336-8136-ffdd5d315852 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:42:00.343150 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-fb646ef7-5181-4336-8136-ffdd5d315852 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:42:00.352815 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fb646ef7-5181-4336-8136-ffdd5d315852 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:00.353439 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fb646ef7-5181-4336-8136-ffdd5d315852 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:00.354320 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fb646ef7-5181-4336-8136-ffdd5d315852 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:00.356186 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fb646ef7-5181-4336-8136-ffdd5d315852 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:00.357417 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fb646ef7-5181-4336-8136-ffdd5d315852 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:00.357961 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fb646ef7-5181-4336-8136-ffdd5d315852 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:00.376486 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-fb646ef7-5181-4336-8136-ffdd5d315852 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Getting quotas for project 6d5c910e1e6f4908b9fdaccb78b7bbf8. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:42:00.382431 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-fb646ef7-5181-4336-8136-ffdd5d315852 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Getting quotas for user 6f8e5cb8e9514546baf5851768123fc7 and project 6d5c910e1e6f4908b9fdaccb78b7bbf8. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:42:00.397575 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fb646ef7-5181-4336-8136-ffdd5d315852 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:42:00.400391 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fb646ef7-5181-4336-8136-ffdd5d315852 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] [instance: 3d45797b-af5c-4942-9ee3-d662e43a8d06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:42:00.449241 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fb646ef7-5181-4336-8136-ffdd5d315852 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.966388 Sep 10 11:42:00.456346 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 532/1035] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:41:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 968 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:42:00.462557 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-da44fb58-8b32-4b0c-8b18-fec492d74416 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:00.463346 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-da44fb58-8b32-4b0c-8b18-fec492d74416 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] [instance: 3d45797b-af5c-4942-9ee3-d662e43a8d06] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:00.479622 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3e9b2520-d69c-4240-a319-3ea50eb6114d tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.199548 Sep 10 11:42:00.480833 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 504/1036] 10.222.0.23 () {60 vars in 1180 bytes} [Sat Sep 10 11:42:00 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:42:00.493988 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ad0f0fea-a509-435e-b546-4b29133321da tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] Action: 'create', calling method: .version_select at 0x7f40736ff3a0>, body: {"security_group_rule": {"parent_group_id": "a99e4590-c70f-4217-918e-41f5e88d0703", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "ecc71524-bc5e-42cc-88d5-c43c402b2e6a"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:00.662768 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-da44fb58-8b32-4b0c-8b18-fec492d74416 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8e5cb8e9514546baf5851768123fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5c910e1e6f4908b9fdaccb78b7bbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:00.673543 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-da44fb58-8b32-4b0c-8b18-fec492d74416 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] 10.222.0.23 "GET /compute/v2.1/servers/3d45797b-af5c-4942-9ee3-d662e43a8d06" status: 200 len: 1222 microversion: 2.1 time: 0.215188 Sep 10 11:42:00.679361 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 533/1037] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:00 2022] GET /compute/v2.1/servers/3d45797b-af5c-4942-9ee3-d662e43a8d06 => generated 1222 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:00.679843 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5242f8c6-9a18-4dc4-8e0b-f24cb454153c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:00.680460 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5242f8c6-9a18-4dc4-8e0b-f24cb454153c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: ebff5197-fc62-4ee6-a688-6e12f04645b5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:00.686902 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5242f8c6-9a18-4dc4-8e0b-f24cb454153c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:00.687413 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5242f8c6-9a18-4dc4-8e0b-f24cb454153c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:00.688109 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5242f8c6-9a18-4dc4-8e0b-f24cb454153c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:00.688967 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5242f8c6-9a18-4dc4-8e0b-f24cb454153c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:00.689412 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5242f8c6-9a18-4dc4-8e0b-f24cb454153c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:00.689835 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5242f8c6-9a18-4dc4-8e0b-f24cb454153c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:01.141017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5242f8c6-9a18-4dc4-8e0b-f24cb454153c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:01.159001 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5242f8c6-9a18-4dc4-8e0b-f24cb454153c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:01.163508 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5242f8c6-9a18-4dc4-8e0b-f24cb454153c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:01.169704 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5242f8c6-9a18-4dc4-8e0b-f24cb454153c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5" status: 200 len: 1542 microversion: 2.25 time: 0.492223 Sep 10 11:42:01.185756 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 534/1038] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:42:00 2022] GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5 => generated 1542 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:42:01.194783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-878de508-38c4-4904-bdfc-aa8e812ba38f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:01.195855 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-878de508-38c4-4904-bdfc-aa8e812ba38f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:01.206228 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-878de508-38c4-4904-bdfc-aa8e812ba38f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:01.207256 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-878de508-38c4-4904-bdfc-aa8e812ba38f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:01.208391 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-878de508-38c4-4904-bdfc-aa8e812ba38f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:01.209641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-878de508-38c4-4904-bdfc-aa8e812ba38f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:01.211410 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-878de508-38c4-4904-bdfc-aa8e812ba38f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:01.211916 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-878de508-38c4-4904-bdfc-aa8e812ba38f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:01.490807 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-878de508-38c4-4904-bdfc-aa8e812ba38f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:01.504155 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ad0f0fea-a509-435e-b546-4b29133321da tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.014378 Sep 10 11:42:01.505662 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 505/1039] 10.222.0.23 () {60 vars in 1195 bytes} [Sat Sep 10 11:42:00 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:42:01.510463 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4e624fb0-4019-4a20-8160-32065e495ba1 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Calling method '.version_select at 0x7f407383c4c0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:01.517335 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e624fb0-4019-4a20-8160-32065e495ba1 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:01.517828 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e624fb0-4019-4a20-8160-32065e495ba1 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:01.518264 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e624fb0-4019-4a20-8160-32065e495ba1 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:01.529529 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-878de508-38c4-4904-bdfc-aa8e812ba38f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1312 microversion: 2.1 time: 0.349670 Sep 10 11:42:01.529797 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4e624fb0-4019-4a20-8160-32065e495ba1 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 1696 microversion: 2.25 time: 0.022959 Sep 10 11:42:01.530128 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 535/1040] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:01 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1312 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:01.546465 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-706ee64c-a92b-45ef-8d05-a2f4971c9d27 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:01.547088 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-706ee64c-a92b-45ef-8d05-a2f4971c9d27 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: f86661f1-aaad-445e-a762-12d85ccd0340] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:01.548390 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 506/1041] 10.222.0.23 () {60 vars in 1184 bytes} [Sat Sep 10 11:42:01 2022] GET /compute/v2.1/os-migrations => generated 1696 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:42:01.554347 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-706ee64c-a92b-45ef-8d05-a2f4971c9d27 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:01.554853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-706ee64c-a92b-45ef-8d05-a2f4971c9d27 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:01.555322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-706ee64c-a92b-45ef-8d05-a2f4971c9d27 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:01.556030 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-706ee64c-a92b-45ef-8d05-a2f4971c9d27 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:01.556487 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-706ee64c-a92b-45ef-8d05-a2f4971c9d27 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:01.556912 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-706ee64c-a92b-45ef-8d05-a2f4971c9d27 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:01.559295 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ead90ff3-b9eb-4aa8-8d0e-7f8026dcfa88 tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] Calling method '.version_select at 0x7f40736b1430>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:01.717752 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-706ee64c-a92b-45ef-8d05-a2f4971c9d27 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c97b7605a40ebac26884a59ea3902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ad59d8440a49c496acbede9848e944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:01.750174 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-706ee64c-a92b-45ef-8d05-a2f4971c9d27 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/servers/f86661f1-aaad-445e-a762-12d85ccd0340" status: 200 len: 1273 microversion: 2.1 time: 0.218959 Sep 10 11:42:01.771121 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 536/1042] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:01 2022] GET /compute/v2.1/servers/f86661f1-aaad-445e-a762-12d85ccd0340 => generated 1273 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:01.807010 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d138bec1-a229-45de-b4a2-cebdf4bfd6e0 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:01.807714 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d138bec1-a229-45de-b4a2-cebdf4bfd6e0 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] [instance: ebff5197-fc62-4ee6-a688-6e12f04645b5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:01.828321 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d138bec1-a229-45de-b4a2-cebdf4bfd6e0 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:01.828817 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d138bec1-a229-45de-b4a2-cebdf4bfd6e0 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:01.829270 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d138bec1-a229-45de-b4a2-cebdf4bfd6e0 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:01.831498 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d138bec1-a229-45de-b4a2-cebdf4bfd6e0 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:01.832344 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d138bec1-a229-45de-b4a2-cebdf4bfd6e0 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:01.836204 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d138bec1-a229-45de-b4a2-cebdf4bfd6e0 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:01.865803 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=90 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:42:02.056269 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ead90ff3-b9eb-4aa8-8d0e-7f8026dcfa88 tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/ecc71524-bc5e-42cc-88d5-c43c402b2e6a" status: 202 len: 0 microversion: 2.1 time: 0.505565 Sep 10 11:42:02.057635 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 507/1043] 10.222.0.23 () {58 vars in 1272 bytes} [Sat Sep 10 11:42:01 2022] DELETE /compute/v2.1/os-security-groups/ecc71524-bc5e-42cc-88d5-c43c402b2e6a => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:42:02.064406 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4573d852-ae2c-401b-a57f-3d49ebee57c9 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:02.065325 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4573d852-ae2c-401b-a57f-3d49ebee57c9 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] [instance: 3d45797b-af5c-4942-9ee3-d662e43a8d06] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:02.085986 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4573d852-ae2c-401b-a57f-3d49ebee57c9 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:02.087196 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4573d852-ae2c-401b-a57f-3d49ebee57c9 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:02.088448 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4573d852-ae2c-401b-a57f-3d49ebee57c9 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:02.091248 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4573d852-ae2c-401b-a57f-3d49ebee57c9 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:02.092434 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4573d852-ae2c-401b-a57f-3d49ebee57c9 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:02.106175 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4573d852-ae2c-401b-a57f-3d49ebee57c9 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:02.107581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-d138bec1-a229-45de-b4a2-cebdf4bfd6e0 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lazy-loading 'services' on Instance uuid ebff5197-fc62-4ee6-a688-6e12f04645b5 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:42:02.129297 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d138bec1-a229-45de-b4a2-cebdf4bfd6e0 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5" status: 200 len: 2035 microversion: 2.25 time: 0.342174 Sep 10 11:42:02.135201 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 537/1044] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:42:01 2022] GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5 => generated 2035 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:42:02.141155 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4702c4ba-1e20-4243-b223-008efd976b0c tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] Calling method '.version_select at 0x7f4073ae13a0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:02.215123 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4702c4ba-1e20-4243-b223-008efd976b0c tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/a99e4590-c70f-4217-918e-41f5e88d0703" status: 200 len: 247 microversion: 2.1 time: 0.078966 Sep 10 11:42:02.215919 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 538/1045] 10.222.0.23 () {58 vars in 1269 bytes} [Sat Sep 10 11:42:02 2022] GET /compute/v2.1/os-security-groups/a99e4590-c70f-4217-918e-41f5e88d0703 => generated 247 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:42:02.221015 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8b6ef920-7b41-42bd-911c-2a7e45484113 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Action: 'create', calling method: .version_select at 0x7f407325cee0>, body: {"keypair": {"name": "tempest-keypair-1655694967", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTc5R5RftvbL7MmuZDAz6RfxTZBVlMkoZh0RlLElq+aJPk0D8Q+DwTL5ByC/MM2/y5lxL9sPiSP8YfnROkA4Sy/3lZQ4Am9CuzabBsUV9gJIIQ3pddGgzy76FUJ9JUGeQ=="}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:02.251509 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-8b6ef920-7b41-42bd-911c-2a7e45484113 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Getting quotas for project c8c0800673e247fb8b3b3718512233c0. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:42:02.254090 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4573d852-ae2c-401b-a57f-3d49ebee57c9 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8e5cb8e9514546baf5851768123fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5c910e1e6f4908b9fdaccb78b7bbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:02.257202 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-8b6ef920-7b41-42bd-911c-2a7e45484113 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Getting quotas for user 1106bb2c5ce14c21a15ad62942745b62 and project c8c0800673e247fb8b3b3718512233c0. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:42:02.265469 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4573d852-ae2c-401b-a57f-3d49ebee57c9 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] 10.222.0.23 "GET /compute/v2.1/servers/3d45797b-af5c-4942-9ee3-d662e43a8d06" status: 200 len: 1274 microversion: 2.1 time: 0.205773 Sep 10 11:42:02.282879 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 508/1046] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:02 2022] GET /compute/v2.1/servers/3d45797b-af5c-4942-9ee3-d662e43a8d06 => generated 1274 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:02.289340 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-49b03955-2a48-435e-8cb8-5259899fa95c tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] Action: 'create', calling method: .version_select at 0x7f40737721f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1199836616", "description": "tempest-description-294320926"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:02.295761 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8b6ef920-7b41-42bd-911c-2a7e45484113 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.078557 Sep 10 11:42:02.296841 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 539/1047] 10.222.0.23 () {62 vars in 1200 bytes} [Sat Sep 10 11:42:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 80 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 10 11:42:02.558528 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ec1bbef7-e2b7-476f-b240-8b551d9e2db5 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:02.560126 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ec1bbef7-e2b7-476f-b240-8b551d9e2db5 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:02.586882 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-49b03955-2a48-435e-8cb8-5259899fa95c tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.302536 Sep 10 11:42:02.597671 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 509/1048] 10.222.0.23 () {60 vars in 1180 bytes} [Sat Sep 10 11:42:02 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:42:02.602189 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f601194c-7563-4883-9762-1840844a91c7 tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] Action: 'create', calling method: .version_select at 0x7f40736b1550>, body: {"security_group_rule": {"parent_group_id": "a46abdca-fa81-4258-a093-4c7a7379a08e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:02.602950 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec1bbef7-e2b7-476f-b240-8b551d9e2db5 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:02.604386 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec1bbef7-e2b7-476f-b240-8b551d9e2db5 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:02.606209 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec1bbef7-e2b7-476f-b240-8b551d9e2db5 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:02.608359 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec1bbef7-e2b7-476f-b240-8b551d9e2db5 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:02.609397 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec1bbef7-e2b7-476f-b240-8b551d9e2db5 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:02.610842 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec1bbef7-e2b7-476f-b240-8b551d9e2db5 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:02.906760 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ec1bbef7-e2b7-476f-b240-8b551d9e2db5 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:02.915911 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ec1bbef7-e2b7-476f-b240-8b551d9e2db5 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1312 microversion: 2.1 time: 0.365376 Sep 10 11:42:02.916492 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 540/1049] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:02 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1312 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:42:02.939856 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ba2a9e33-391d-4a9a-a2bc-e08ec8acf06c tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:02.941744 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ba2a9e33-391d-4a9a-a2bc-e08ec8acf06c tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: f86661f1-aaad-445e-a762-12d85ccd0340] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:02.950961 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba2a9e33-391d-4a9a-a2bc-e08ec8acf06c tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:02.951487 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba2a9e33-391d-4a9a-a2bc-e08ec8acf06c tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:02.951923 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba2a9e33-391d-4a9a-a2bc-e08ec8acf06c tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:02.952624 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba2a9e33-391d-4a9a-a2bc-e08ec8acf06c tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:02.953254 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba2a9e33-391d-4a9a-a2bc-e08ec8acf06c tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:02.954297 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba2a9e33-391d-4a9a-a2bc-e08ec8acf06c tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:03.047083 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f601194c-7563-4883-9762-1840844a91c7 tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.449643 Sep 10 11:42:03.048215 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 510/1050] 10.222.0.23 () {60 vars in 1195 bytes} [Sat Sep 10 11:42:02 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:42:03.051360 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f601194c-7563-4883-9762-1840844a91c7 tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:03.053482 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f601194c-7563-4883-9762-1840844a91c7 tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002902 Sep 10 11:42:03.055234 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 511/1051] 10.222.0.23 () {56 vars in 886 bytes} [Sat Sep 10 11:42:03 2022] GET /compute/ => generated 377 bytes in 6 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 10 11:42:03.063874 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5c30850c-c545-46bf-888a-29e43b60b52a tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] Action: 'create', calling method: .version_select at 0x7f40739ae4c0>, body: {"security_group_rule": {"parent_group_id": "a46abdca-fa81-4258-a093-4c7a7379a08e", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:03.310757 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ba2a9e33-391d-4a9a-a2bc-e08ec8acf06c tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c97b7605a40ebac26884a59ea3902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ad59d8440a49c496acbede9848e944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:03.324911 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ba2a9e33-391d-4a9a-a2bc-e08ec8acf06c tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/servers/f86661f1-aaad-445e-a762-12d85ccd0340" status: 200 len: 1315 microversion: 2.1 time: 0.399812 Sep 10 11:42:03.326679 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 541/1052] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:02 2022] GET /compute/v2.1/servers/f86661f1-aaad-445e-a762-12d85ccd0340 => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:03.337461 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ba2a9e33-391d-4a9a-a2bc-e08ec8acf06c tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:03.340024 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ba2a9e33-391d-4a9a-a2bc-e08ec8acf06c tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.011441 Sep 10 11:42:03.361937 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 542/1053] 10.222.0.23 () {54 vars in 1035 bytes} [Sat Sep 10 11:42:03 2022] GET /compute/v2/ => generated 379 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Sep 10 11:42:03.372131 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7ab56321-6ed8-45f8-8156-98df290f62ee tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:03.372937 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7ab56321-6ed8-45f8-8156-98df290f62ee tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] [instance: 3d45797b-af5c-4942-9ee3-d662e43a8d06] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:03.381394 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ab56321-6ed8-45f8-8156-98df290f62ee tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:03.383211 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ab56321-6ed8-45f8-8156-98df290f62ee tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:03.383830 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ab56321-6ed8-45f8-8156-98df290f62ee tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:03.384864 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ab56321-6ed8-45f8-8156-98df290f62ee tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:03.385532 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ab56321-6ed8-45f8-8156-98df290f62ee tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:03.386388 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ab56321-6ed8-45f8-8156-98df290f62ee tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:03.555095 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7ab56321-6ed8-45f8-8156-98df290f62ee tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8e5cb8e9514546baf5851768123fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5c910e1e6f4908b9fdaccb78b7bbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:03.566245 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7ab56321-6ed8-45f8-8156-98df290f62ee tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] 10.222.0.23 "GET /compute/v2.1/servers/3d45797b-af5c-4942-9ee3-d662e43a8d06" status: 200 len: 1280 microversion: 2.1 time: 0.202465 Sep 10 11:42:03.567153 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 543/1054] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:03 2022] GET /compute/v2.1/servers/3d45797b-af5c-4942-9ee3-d662e43a8d06 => generated 1280 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:03.572273 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-02828413-3875-4cba-a1d6-87c6e4e44034 req-692e21ad-fe3f-4a1d-9354-6bb84c699b00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f86661f1-aaad-445e-a762-12d85ccd0340", "tag": "e6ae3a2a-28cf-436d-89cc-e8fa6fa8266c"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:03.582316 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:42:03.584911 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-02828413-3875-4cba-a1d6-87c6e4e44034 req-692e21ad-fe3f-4a1d-9354-6bb84c699b00 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:03.585384 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-02828413-3875-4cba-a1d6-87c6e4e44034 req-692e21ad-fe3f-4a1d-9354-6bb84c699b00 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:03.585818 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-02828413-3875-4cba-a1d6-87c6e4e44034 req-692e21ad-fe3f-4a1d-9354-6bb84c699b00 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:03.602847 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-02828413-3875-4cba-a1d6-87c6e4e44034 req-692e21ad-fe3f-4a1d-9354-6bb84c699b00 service nova] Creating event network-changed:e6ae3a2a-28cf-436d-89cc-e8fa6fa8266c for instance f86661f1-aaad-445e-a762-12d85ccd0340 on n-h2-856895-1 Sep 10 11:42:03.612876 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-02828413-3875-4cba-a1d6-87c6e4e44034 req-692e21ad-fe3f-4a1d-9354-6bb84c699b00 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044015 Sep 10 11:42:03.613726 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 544/1055] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:42:03.616455 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-02828413-3875-4cba-a1d6-87c6e4e44034 req-692e21ad-fe3f-4a1d-9354-6bb84c699b00 service nova] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:03.617813 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-02828413-3875-4cba-a1d6-87c6e4e44034 req-692e21ad-fe3f-4a1d-9354-6bb84c699b00 service nova] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002787 Sep 10 11:42:03.619690 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 545/1056] 10.222.0.23 () {54 vars in 1041 bytes} [Sat Sep 10 11:42:03 2022] GET /compute/v2.1/ => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:42:03.628650 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-e1c8f34d-f827-4c2d-9b05-d0fab36596e3 req-3076866a-97e8-4a2f-a8c8-dd11364b2023 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3606a9e-e02c-451e-98b9-2e6395c6af17", "name": "network-vif-plugged", "status": "completed", "tag": "f498d2de-3776-434f-9d82-c17325598f02"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:03.645414 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e1c8f34d-f827-4c2d-9b05-d0fab36596e3 req-3076866a-97e8-4a2f-a8c8-dd11364b2023 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:03.645549 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e1c8f34d-f827-4c2d-9b05-d0fab36596e3 req-3076866a-97e8-4a2f-a8c8-dd11364b2023 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:03.646734 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e1c8f34d-f827-4c2d-9b05-d0fab36596e3 req-3076866a-97e8-4a2f-a8c8-dd11364b2023 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:03.658916 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5c30850c-c545-46bf-888a-29e43b60b52a tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.602360 Sep 10 11:42:03.660690 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 512/1057] 10.222.0.23 () {60 vars in 1195 bytes} [Sat Sep 10 11:42:03 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:42:03.662015 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5c30850c-c545-46bf-888a-29e43b60b52a tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:03.663196 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5c30850c-c545-46bf-888a-29e43b60b52a tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001151 Sep 10 11:42:03.672175 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 513/1058] 10.222.0.23 () {56 vars in 886 bytes} [Sat Sep 10 11:42:03 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 10 11:42:03.674450 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-e1c8f34d-f827-4c2d-9b05-d0fab36596e3 req-3076866a-97e8-4a2f-a8c8-dd11364b2023 service nova] Creating event network-vif-plugged:f498d2de-3776-434f-9d82-c17325598f02 for instance e3606a9e-e02c-451e-98b9-2e6395c6af17 on n-h2-856895-1 Sep 10 11:42:03.680001 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-e1c8f34d-f827-4c2d-9b05-d0fab36596e3 req-3076866a-97e8-4a2f-a8c8-dd11364b2023 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056174 Sep 10 11:42:03.680912 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 546/1059] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:42:03.699264 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8027917d-a393-4aa4-bac1-f250fc56ee6d tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] Calling method '.version_select at 0x7f4073679430>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:03.858262 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8027917d-a393-4aa4-bac1-f250fc56ee6d tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/a46abdca-fa81-4258-a093-4c7a7379a08e" status: 200 len: 664 microversion: 2.1 time: 0.189132 Sep 10 11:42:03.859327 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 514/1060] 10.222.0.23 () {58 vars in 1269 bytes} [Sat Sep 10 11:42:03 2022] GET /compute/v2.1/os-security-groups/a46abdca-fa81-4258-a093-4c7a7379a08e => generated 664 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:42:03.873973 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1c844a69-8ede-4d1c-9605-3617cdedbdbf tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] Calling method '.version_select at 0x7f40734af700>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:03.940705 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cec6135d-87e9-48ab-9987-7b9446d2b722 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:03.941329 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cec6135d-87e9-48ab-9987-7b9446d2b722 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:03.948853 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cec6135d-87e9-48ab-9987-7b9446d2b722 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:03.949761 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cec6135d-87e9-48ab-9987-7b9446d2b722 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:03.950539 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cec6135d-87e9-48ab-9987-7b9446d2b722 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:03.951517 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cec6135d-87e9-48ab-9987-7b9446d2b722 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:03.952161 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cec6135d-87e9-48ab-9987-7b9446d2b722 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:03.952793 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cec6135d-87e9-48ab-9987-7b9446d2b722 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:04.288881 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-cec6135d-87e9-48ab-9987-7b9446d2b722 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:04.311839 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1c844a69-8ede-4d1c-9605-3617cdedbdbf tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-group-rules/292588b5-9aed-4372-a96d-f16e7cacda03" status: 202 len: 0 microversion: 2.1 time: 0.442752 Sep 10 11:42:04.312428 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 547/1061] 10.222.0.23 () {58 vars in 1287 bytes} [Sat Sep 10 11:42:03 2022] DELETE /compute/v2.1/os-security-group-rules/292588b5-9aed-4372-a96d-f16e7cacda03 => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:42:04.321431 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f75b2eaa-0bd8-4018-ae44-f85170a42c88 tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] Calling method '.version_select at 0x7f407324ed30>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:04.325831 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cec6135d-87e9-48ab-9987-7b9446d2b722 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1312 microversion: 2.1 time: 0.386627 Sep 10 11:42:04.326955 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 515/1062] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:03 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1312 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:04.349055 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ec927aff-75af-4c27-91bf-0913fab543e7 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:04.350086 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ec927aff-75af-4c27-91bf-0913fab543e7 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: f86661f1-aaad-445e-a762-12d85ccd0340] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:04.358365 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec927aff-75af-4c27-91bf-0913fab543e7 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:04.359119 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec927aff-75af-4c27-91bf-0913fab543e7 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:04.360347 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec927aff-75af-4c27-91bf-0913fab543e7 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:04.361243 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec927aff-75af-4c27-91bf-0913fab543e7 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:04.361875 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec927aff-75af-4c27-91bf-0913fab543e7 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:04.362482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec927aff-75af-4c27-91bf-0913fab543e7 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:04.696750 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ec927aff-75af-4c27-91bf-0913fab543e7 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c97b7605a40ebac26884a59ea3902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ad59d8440a49c496acbede9848e944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:04.707386 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ec927aff-75af-4c27-91bf-0913fab543e7 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/servers/f86661f1-aaad-445e-a762-12d85ccd0340" status: 200 len: 1315 microversion: 2.1 time: 0.362123 Sep 10 11:42:04.708251 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 516/1063] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:04 2022] GET /compute/v2.1/servers/f86661f1-aaad-445e-a762-12d85ccd0340 => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:42:04.722943 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ad2f82bd-e61d-4068-825f-eb02e09db321 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:04.723958 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ad2f82bd-e61d-4068-825f-eb02e09db321 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] [instance: 3d45797b-af5c-4942-9ee3-d662e43a8d06] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:04.732524 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad2f82bd-e61d-4068-825f-eb02e09db321 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:04.733772 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad2f82bd-e61d-4068-825f-eb02e09db321 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:04.735999 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad2f82bd-e61d-4068-825f-eb02e09db321 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:04.737119 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad2f82bd-e61d-4068-825f-eb02e09db321 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:04.738860 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad2f82bd-e61d-4068-825f-eb02e09db321 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:04.739582 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad2f82bd-e61d-4068-825f-eb02e09db321 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:04.763578 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:42:04.969810 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f75b2eaa-0bd8-4018-ae44-f85170a42c88 tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/a46abdca-fa81-4258-a093-4c7a7379a08e" status: 202 len: 0 microversion: 2.1 time: 0.652076 Sep 10 11:42:04.970395 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 548/1064] 10.222.0.23 () {58 vars in 1272 bytes} [Sat Sep 10 11:42:04 2022] DELETE /compute/v2.1/os-security-groups/a46abdca-fa81-4258-a093-4c7a7379a08e => generated 0 bytes in 653 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 11:42:04.978109 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-869ddc58-2760-4677-9723-1ca402813a97 tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] Calling method '.version_select at 0x7f407325ce50>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:05.046879 n-d-856895-1 devstack@n-api.service[128777]: DEBUG neutronclient.v2_0.client [None req-869ddc58-2760-4677-9723-1ca402813a97 tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ecc71524-bc5e-42cc-88d5-c43c402b2e6a does not exist", "detail": ""}} {{(pid=128777) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 11:42:05.047415 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.security_group_api [None req-869ddc58-2760-4677-9723-1ca402813a97 tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] Neutron security group ecc71524-bc5e-42cc-88d5-c43c402b2e6a not found {{(pid=128777) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 11:42:05.047974 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-869ddc58-2760-4677-9723-1ca402813a97 tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] HTTP exception thrown: Security group ecc71524-bc5e-42cc-88d5-c43c402b2e6a does not exist Sep 10 11:42:05.047974 n-d-856895-1 devstack@n-api.service[128777]: Neutron server returns request_ids: ['req-f4dca827-fd84-4a3f-9657-af750c602f1c'] Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-869ddc58-2760-4677-9723-1ca402813a97 tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] Request method failure captured: Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/os-security-groups/ecc71524-bc5e-42cc-88d5-c43c402b2e6a HTTP/1.1 Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHf8FQyN1pX4OSW50UvsEs8GGJbnGEmjIIkwUttDIvz7SWL6O_HfPlCwCuDQIHxRb_hbuKg-mrwd1vldD4ZYXPXek9e4yC0HzMqrGpyC9OFFCHUsdXpxwih-SJz0_3NQza0EDDexN2DPCrWZYqQ4KADzRJUAAUPMoU4n0XTrYqVhJ0A Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: e593e19d6a50414eb4dc6659c899ce88 Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-2032931260 Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e593e19d6a50414eb4dc6659c899ce88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e593e19d6a50414eb4dc6659c899ce88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e593e19d6a50414eb4dc6659c899ce88", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e593e19d6a50414eb4dc6659c899ce88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-SecurityGroupRulesTestJSON-2032931260 Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: e593e19d6a50414eb4dc6659c899ce88 Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-2032931260 Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-SecurityGroupRulesTestJSON-2032931260-project Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 63f0f37a47e148d1852000f137e7f53f Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-SecurityGroupRulesTestJSON-2032931260-project Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: exception: Security group ecc71524-bc5e-42cc-88d5-c43c402b2e6a does not exist Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: Neutron server returns request_ids: ['req-f4dca827-fd84-4a3f-9657-af750c602f1c'] Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'ecc71524-bc5e-42cc-88d5-c43c402b2e6a'} Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 11:42:05.064947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ecc71524-bc5e-42cc-88d5-c43c402b2e6a does not exist Sep 10 11:42:05.069840 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4dca827-fd84-4a3f-9657-af750c602f1c'] Sep 10 11:42:05.069840 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:42:05.069840 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:42:05.069840 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:42:05.069840 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:42:05.069840 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 10 11:42:05.069840 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 10 11:42:05.069840 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 11:42:05.069840 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 11:42:05.069840 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ecc71524-bc5e-42cc-88d5-c43c402b2e6a does not exist Sep 10 11:42:05.069840 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4dca827-fd84-4a3f-9657-af750c602f1c'] Sep 10 11:42:05.069840 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:42:05.069840 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:42:05.069840 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:42:05.069840 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:42:05.069840 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:42:05.069840 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:42:05.069840 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:42:05.069840 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:42:05.069840 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:42:05.069840 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:42:05.069840 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:42:05.069840 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:42:05.069840 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 10 11:42:05.069840 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 11:42:05.069840 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ecc71524-bc5e-42cc-88d5-c43c402b2e6a does not exist Sep 10 11:42:05.069840 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4dca827-fd84-4a3f-9657-af750c602f1c'] Sep 10 11:42:05.069840 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:42:05.069840 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:42:05.069840 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:42:05.069840 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:42:05.069840 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:42:05.069840 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:42:05.069840 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:42:05.069840 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:42:05.069840 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ecc71524-bc5e-42cc-88d5-c43c402b2e6a does not exist Sep 10 11:42:05.069840 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4dca827-fd84-4a3f-9657-af750c602f1c'] Sep 10 11:42:05.069840 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:42:05.073417 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ad2f82bd-e61d-4068-825f-eb02e09db321 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8e5cb8e9514546baf5851768123fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5c910e1e6f4908b9fdaccb78b7bbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:05.075203 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-869ddc58-2760-4677-9723-1ca402813a97 tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] Returning 404 to user: Security group ecc71524-bc5e-42cc-88d5-c43c402b2e6a does not exist Sep 10 11:42:05.075203 n-d-856895-1 devstack@n-api.service[128777]: Neutron server returns request_ids: ['req-f4dca827-fd84-4a3f-9657-af750c602f1c'] {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:42:05.076340 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-869ddc58-2760-4677-9723-1ca402813a97 tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/ecc71524-bc5e-42cc-88d5-c43c402b2e6a" status: 404 len: 194 microversion: 2.1 time: 0.101993 Sep 10 11:42:05.077562 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 549/1065] 10.222.0.23 () {58 vars in 1272 bytes} [Sat Sep 10 11:42:04 2022] DELETE /compute/v2.1/os-security-groups/ecc71524-bc5e-42cc-88d5-c43c402b2e6a => generated 194 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 11:42:05.082697 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ad2f82bd-e61d-4068-825f-eb02e09db321 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] 10.222.0.23 "GET /compute/v2.1/servers/3d45797b-af5c-4942-9ee3-d662e43a8d06" status: 200 len: 1322 microversion: 2.1 time: 0.372828 Sep 10 11:42:05.085998 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 517/1066] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:04 2022] GET /compute/v2.1/servers/3d45797b-af5c-4942-9ee3-d662e43a8d06 => generated 1322 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:05.089960 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9666acca-33b5-4df0-9f5c-db14ba10cf18 tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] Calling method '.version_select at 0x7f407325cd30>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:05.351450 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2ebfce05-4c09-431c-83a0-ff0d660e825f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:05.352350 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2ebfce05-4c09-431c-83a0-ff0d660e825f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:05.361310 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2ebfce05-4c09-431c-83a0-ff0d660e825f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:05.363079 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2ebfce05-4c09-431c-83a0-ff0d660e825f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:05.364089 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2ebfce05-4c09-431c-83a0-ff0d660e825f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:05.367022 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2ebfce05-4c09-431c-83a0-ff0d660e825f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:05.367537 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2ebfce05-4c09-431c-83a0-ff0d660e825f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:05.367984 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2ebfce05-4c09-431c-83a0-ff0d660e825f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:05.421788 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9666acca-33b5-4df0-9f5c-db14ba10cf18 tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/a99e4590-c70f-4217-918e-41f5e88d0703" status: 202 len: 0 microversion: 2.1 time: 0.339143 Sep 10 11:42:05.422384 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 550/1067] 10.222.0.23 () {58 vars in 1272 bytes} [Sat Sep 10 11:42:05 2022] DELETE /compute/v2.1/os-security-groups/a99e4590-c70f-4217-918e-41f5e88d0703 => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:42:05.430285 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e152d979-318a-4154-bbcb-86d26b0cfbdb tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] Calling method '.version_select at 0x7f407323d820>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:05.653398 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2ebfce05-4c09-431c-83a0-ff0d660e825f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:05.665717 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2ebfce05-4c09-431c-83a0-ff0d660e825f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1312 microversion: 2.1 time: 0.318714 Sep 10 11:42:05.666869 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 518/1068] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:05 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1312 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:05.672794 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7fdaae02-faf7-4c3f-9125-f86f452d531a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-693955772", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "9d0f720d-8913-424b-864d-897845ccb4e7"}], "security_groups": [{"name": "tempest-securitygroup--1404560947"}], "key_name": "tempest-keypair-1655694967", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:05.821033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-7fdaae02-faf7-4c3f-9125-f86f452d531a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] validate_networks() for [('9d0f720d-8913-424b-864d-897845ccb4e7', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:42:05.898177 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e152d979-318a-4154-bbcb-86d26b0cfbdb tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/9b81e2f8-82fe-4dc4-8349-92e4c8553270" status: 202 len: 0 microversion: 2.1 time: 0.470806 Sep 10 11:42:05.900358 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 551/1069] 10.222.0.23 () {58 vars in 1272 bytes} [Sat Sep 10 11:42:05 2022] DELETE /compute/v2.1/os-security-groups/9b81e2f8-82fe-4dc4-8349-92e4c8553270 => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 11:42:05.909168 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-7ad27611-ef1b-4f31-91f3-2c714dad8e27 req-a692006f-2ff1-4dcd-953f-31892799fefc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d45797b-af5c-4942-9ee3-d662e43a8d06", "tag": "dfb5de02-77c3-4135-8a4d-77c9a2ac1fa6"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:05.941229 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-7ad27611-ef1b-4f31-91f3-2c714dad8e27 req-a692006f-2ff1-4dcd-953f-31892799fefc service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:05.941725 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-7ad27611-ef1b-4f31-91f3-2c714dad8e27 req-a692006f-2ff1-4dcd-953f-31892799fefc service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:05.942160 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-7ad27611-ef1b-4f31-91f3-2c714dad8e27 req-a692006f-2ff1-4dcd-953f-31892799fefc service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:05.970733 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-7ad27611-ef1b-4f31-91f3-2c714dad8e27 req-a692006f-2ff1-4dcd-953f-31892799fefc service nova] Creating event network-changed:dfb5de02-77c3-4135-8a4d-77c9a2ac1fa6 for instance 3d45797b-af5c-4942-9ee3-d662e43a8d06 on n-h1-856895-1 Sep 10 11:42:05.982030 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-7ad27611-ef1b-4f31-91f3-2c714dad8e27 req-a692006f-2ff1-4dcd-953f-31892799fefc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079860 Sep 10 11:42:05.983654 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 552/1070] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:42:05.991641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b873b2e0-0108-45d9-b39b-f5c40818b6a2 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:05.993509 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b873b2e0-0108-45d9-b39b-f5c40818b6a2 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: f86661f1-aaad-445e-a762-12d85ccd0340] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:06.002865 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b873b2e0-0108-45d9-b39b-f5c40818b6a2 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:06.003781 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b873b2e0-0108-45d9-b39b-f5c40818b6a2 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:06.004782 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b873b2e0-0108-45d9-b39b-f5c40818b6a2 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:06.006802 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b873b2e0-0108-45d9-b39b-f5c40818b6a2 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:06.007479 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b873b2e0-0108-45d9-b39b-f5c40818b6a2 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:06.008577 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b873b2e0-0108-45d9-b39b-f5c40818b6a2 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:06.277565 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b873b2e0-0108-45d9-b39b-f5c40818b6a2 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c97b7605a40ebac26884a59ea3902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ad59d8440a49c496acbede9848e944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:06.287357 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b873b2e0-0108-45d9-b39b-f5c40818b6a2 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/servers/f86661f1-aaad-445e-a762-12d85ccd0340" status: 200 len: 1315 microversion: 2.1 time: 0.302134 Sep 10 11:42:06.287979 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 553/1071] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:05 2022] GET /compute/v2.1/servers/f86661f1-aaad-445e-a762-12d85ccd0340 => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:06.292793 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e9a7d566-2282-4765-b091-d399fd67f9dd tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] Calling method '.version_select at 0x7f40738da8b0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:06.474749 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-7fdaae02-faf7-4c3f-9125-f86f452d531a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:42:06.475979 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-7fdaae02-faf7-4c3f-9125-f86f452d531a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:42:06.477061 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-7fdaae02-faf7-4c3f-9125-f86f452d531a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:42:06.477662 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-7fdaae02-faf7-4c3f-9125-f86f452d531a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:42:06.478351 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-7fdaae02-faf7-4c3f-9125-f86f452d531a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:42:06.493940 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7fdaae02-faf7-4c3f-9125-f86f452d531a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:06.495243 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7fdaae02-faf7-4c3f-9125-f86f452d531a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:06.496031 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7fdaae02-faf7-4c3f-9125-f86f452d531a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:06.497745 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7fdaae02-faf7-4c3f-9125-f86f452d531a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:06.498547 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7fdaae02-faf7-4c3f-9125-f86f452d531a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:06.499004 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7fdaae02-faf7-4c3f-9125-f86f452d531a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:06.527591 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-7fdaae02-faf7-4c3f-9125-f86f452d531a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Getting quotas for project c8c0800673e247fb8b3b3718512233c0. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:42:06.533774 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-7fdaae02-faf7-4c3f-9125-f86f452d531a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Getting quotas for user 1106bb2c5ce14c21a15ad62942745b62 and project c8c0800673e247fb8b3b3718512233c0. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:42:06.552276 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7fdaae02-faf7-4c3f-9125-f86f452d531a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:42:06.555821 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7fdaae02-faf7-4c3f-9125-f86f452d531a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:42:06.581624 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e9a7d566-2282-4765-b091-d399fd67f9dd tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/fd9f0250-eb1c-4060-8ba7-73d0ecd1377f" status: 202 len: 0 microversion: 2.1 time: 0.292217 Sep 10 11:42:06.585437 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 554/1072] 10.222.0.23 () {58 vars in 1272 bytes} [Sat Sep 10 11:42:06 2022] DELETE /compute/v2.1/os-security-groups/fd9f0250-eb1c-4060-8ba7-73d0ecd1377f => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:42:06.587570 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a0d9cf46-ee5c-494b-81e0-cc9c3b7d2a18 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:06.588186 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a0d9cf46-ee5c-494b-81e0-cc9c3b7d2a18 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] [instance: 3d45797b-af5c-4942-9ee3-d662e43a8d06] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:06.612433 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a0d9cf46-ee5c-494b-81e0-cc9c3b7d2a18 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:06.612928 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a0d9cf46-ee5c-494b-81e0-cc9c3b7d2a18 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:06.613360 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a0d9cf46-ee5c-494b-81e0-cc9c3b7d2a18 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:06.614094 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a0d9cf46-ee5c-494b-81e0-cc9c3b7d2a18 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:06.619375 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a0d9cf46-ee5c-494b-81e0-cc9c3b7d2a18 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:06.620524 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a0d9cf46-ee5c-494b-81e0-cc9c3b7d2a18 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:06.633512 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7fdaae02-faf7-4c3f-9125-f86f452d531a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 0.964632 Sep 10 11:42:06.642684 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 519/1073] 10.222.0.23 () {62 vars in 1188 bytes} [Sat Sep 10 11:42:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 975 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 10 11:42:06.649732 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1195b832-9bfa-412b-b281-300c44b37a67 tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] Calling method '.version_select at 0x7f40736785e0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:07.130469 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a0d9cf46-ee5c-494b-81e0-cc9c3b7d2a18 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8e5cb8e9514546baf5851768123fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5c910e1e6f4908b9fdaccb78b7bbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:07.145745 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a0d9cf46-ee5c-494b-81e0-cc9c3b7d2a18 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] 10.222.0.23 "GET /compute/v2.1/servers/3d45797b-af5c-4942-9ee3-d662e43a8d06" status: 200 len: 1322 microversion: 2.1 time: 0.561857 Sep 10 11:42:07.148885 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 555/1074] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:06 2022] GET /compute/v2.1/servers/3d45797b-af5c-4942-9ee3-d662e43a8d06 => generated 1322 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:07.163604 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e4d8985e-9629-46ba-b433-2a1921d1cbc0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:07.164422 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e4d8985e-9629-46ba-b433-2a1921d1cbc0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:07.241328 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e4d8985e-9629-46ba-b433-2a1921d1cbc0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:07.245276 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=71 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:42:07.259150 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e4d8985e-9629-46ba-b433-2a1921d1cbc0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:07.268260 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e4d8985e-9629-46ba-b433-2a1921d1cbc0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:07.269597 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e4d8985e-9629-46ba-b433-2a1921d1cbc0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1285 microversion: 2.25 time: 0.119613 Sep 10 11:42:07.270451 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 556/1075] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:42:07 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:42:07.276226 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6cbe776c-87c8-4257-9d34-92e49bdeef68 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:07.277805 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6cbe776c-87c8-4257-9d34-92e49bdeef68 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:07.291182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6cbe776c-87c8-4257-9d34-92e49bdeef68 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:07.293293 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6cbe776c-87c8-4257-9d34-92e49bdeef68 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:07.294173 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6cbe776c-87c8-4257-9d34-92e49bdeef68 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:07.295752 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6cbe776c-87c8-4257-9d34-92e49bdeef68 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:07.296411 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6cbe776c-87c8-4257-9d34-92e49bdeef68 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:07.297007 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6cbe776c-87c8-4257-9d34-92e49bdeef68 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:07.313145 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1195b832-9bfa-412b-b281-300c44b37a67 tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/be52c45c-3578-4e18-9e05-ffc33492e07f" status: 202 len: 0 microversion: 2.1 time: 0.668307 Sep 10 11:42:07.313997 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 520/1076] 10.222.0.23 () {58 vars in 1272 bytes} [Sat Sep 10 11:42:06 2022] DELETE /compute/v2.1/os-security-groups/be52c45c-3578-4e18-9e05-ffc33492e07f => generated 0 bytes in 671 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:42:07.322723 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6e098921-3bf8-46d2-8fb9-9c3707bded9d tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:07.323611 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6e098921-3bf8-46d2-8fb9-9c3707bded9d tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: f86661f1-aaad-445e-a762-12d85ccd0340] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:07.336841 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e098921-3bf8-46d2-8fb9-9c3707bded9d tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:07.340991 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e098921-3bf8-46d2-8fb9-9c3707bded9d tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:07.340991 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e098921-3bf8-46d2-8fb9-9c3707bded9d tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:07.344193 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e098921-3bf8-46d2-8fb9-9c3707bded9d tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:07.348141 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e098921-3bf8-46d2-8fb9-9c3707bded9d tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:07.348823 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e098921-3bf8-46d2-8fb9-9c3707bded9d tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:07.610230 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6cbe776c-87c8-4257-9d34-92e49bdeef68 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:07.625549 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6cbe776c-87c8-4257-9d34-92e49bdeef68 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1461 microversion: 2.1 time: 0.353481 Sep 10 11:42:07.626523 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 557/1077] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:07 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1461 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:07.626660 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6e098921-3bf8-46d2-8fb9-9c3707bded9d tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c97b7605a40ebac26884a59ea3902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ad59d8440a49c496acbede9848e944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:07.635120 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c0d18f71-e6ad-416e-9d32-051e0b3d54d4 tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] Calling method '.version_select at 0x7f4073271670>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:07.642592 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6e098921-3bf8-46d2-8fb9-9c3707bded9d tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/servers/f86661f1-aaad-445e-a762-12d85ccd0340" status: 200 len: 1315 microversion: 2.1 time: 0.327094 Sep 10 11:42:07.656313 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 521/1078] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:07 2022] GET /compute/v2.1/servers/f86661f1-aaad-445e-a762-12d85ccd0340 => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:07.926418 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c0d18f71-e6ad-416e-9d32-051e0b3d54d4 tempest-SecurityGroupRulesTestJSON-2032931260 tempest-SecurityGroupRulesTestJSON-2032931260-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/3e8b3651-dce7-46a3-8a48-4940c1bf59b3" status: 202 len: 0 microversion: 2.1 time: 0.297963 Sep 10 11:42:07.927487 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 558/1079] 10.222.0.23 () {58 vars in 1272 bytes} [Sat Sep 10 11:42:07 2022] DELETE /compute/v2.1/os-security-groups/3e8b3651-dce7-46a3-8a48-4940c1bf59b3 => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:42:08.111615 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0503e6c7-f671-45c0-ae09-ce3c85b7c638 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:08.122425 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0503e6c7-f671-45c0-ae09-ce3c85b7c638 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:08.140725 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0503e6c7-f671-45c0-ae09-ce3c85b7c638 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:08.141736 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0503e6c7-f671-45c0-ae09-ce3c85b7c638 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:08.142593 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0503e6c7-f671-45c0-ae09-ce3c85b7c638 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:08.143757 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0503e6c7-f671-45c0-ae09-ce3c85b7c638 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:08.144519 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0503e6c7-f671-45c0-ae09-ce3c85b7c638 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:08.145260 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0503e6c7-f671-45c0-ae09-ce3c85b7c638 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:08.170009 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cc4b5698-16a2-4e51-8e9e-3ecb65d72984 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:08.171271 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cc4b5698-16a2-4e51-8e9e-3ecb65d72984 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] [instance: 3d45797b-af5c-4942-9ee3-d662e43a8d06] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:08.178692 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc4b5698-16a2-4e51-8e9e-3ecb65d72984 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:08.179578 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc4b5698-16a2-4e51-8e9e-3ecb65d72984 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:08.180305 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc4b5698-16a2-4e51-8e9e-3ecb65d72984 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:08.181417 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc4b5698-16a2-4e51-8e9e-3ecb65d72984 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:08.182151 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc4b5698-16a2-4e51-8e9e-3ecb65d72984 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:08.182866 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc4b5698-16a2-4e51-8e9e-3ecb65d72984 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:08.379271 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cc4b5698-16a2-4e51-8e9e-3ecb65d72984 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8e5cb8e9514546baf5851768123fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5c910e1e6f4908b9fdaccb78b7bbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:08.390180 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cc4b5698-16a2-4e51-8e9e-3ecb65d72984 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] 10.222.0.23 "GET /compute/v2.1/servers/3d45797b-af5c-4942-9ee3-d662e43a8d06" status: 200 len: 1322 microversion: 2.1 time: 0.223797 Sep 10 11:42:08.391352 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 559/1080] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:08 2022] GET /compute/v2.1/servers/3d45797b-af5c-4942-9ee3-d662e43a8d06 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:08.399122 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0246171e-83cd-4ac6-9d79-3722456e7099 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:08.400997 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0246171e-83cd-4ac6-9d79-3722456e7099 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:08.407944 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0246171e-83cd-4ac6-9d79-3722456e7099 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:08.408657 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0246171e-83cd-4ac6-9d79-3722456e7099 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:08.409277 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0246171e-83cd-4ac6-9d79-3722456e7099 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:08.410709 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0246171e-83cd-4ac6-9d79-3722456e7099 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:08.411378 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0246171e-83cd-4ac6-9d79-3722456e7099 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:08.411972 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0246171e-83cd-4ac6-9d79-3722456e7099 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:08.641544 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0503e6c7-f671-45c0-ae09-ce3c85b7c638 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1612 microversion: 2.1 time: 0.981879 Sep 10 11:42:08.642216 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 522/1081] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:07 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1612 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:08.647352 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9fd936e8-1708-45c0-b615-9de540630151 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:08.648077 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9fd936e8-1708-45c0-b615-9de540630151 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:08.655193 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fd936e8-1708-45c0-b615-9de540630151 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:08.655712 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fd936e8-1708-45c0-b615-9de540630151 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:08.656147 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fd936e8-1708-45c0-b615-9de540630151 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:08.656944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fd936e8-1708-45c0-b615-9de540630151 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:08.657684 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fd936e8-1708-45c0-b615-9de540630151 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:08.658442 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fd936e8-1708-45c0-b615-9de540630151 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:08.659149 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0246171e-83cd-4ac6-9d79-3722456e7099 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1814 microversion: 2.1 time: 0.265851 Sep 10 11:42:08.665175 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 560/1082] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:08 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1814 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:08.678204 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8b2e34b1-2b1c-49e7-bc1d-bc52bab5e0c7 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:08.678891 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8b2e34b1-2b1c-49e7-bc1d-bc52bab5e0c7 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:08.688972 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b2e34b1-2b1c-49e7-bc1d-bc52bab5e0c7 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:08.689616 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b2e34b1-2b1c-49e7-bc1d-bc52bab5e0c7 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:08.690155 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b2e34b1-2b1c-49e7-bc1d-bc52bab5e0c7 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:08.690964 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b2e34b1-2b1c-49e7-bc1d-bc52bab5e0c7 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:08.691555 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b2e34b1-2b1c-49e7-bc1d-bc52bab5e0c7 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:08.692076 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b2e34b1-2b1c-49e7-bc1d-bc52bab5e0c7 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:08.724368 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8b2e34b1-2b1c-49e7-bc1d-bc52bab5e0c7 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4e6e722c23a9413a944f958f6c5a10ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76761c4a83844f4caefb9c72f0d91774', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:08.725290 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8b2e34b1-2b1c-49e7-bc1d-bc52bab5e0c7 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] flavor_id is None. Assuming migration. {{(pid=128777) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 10 11:42:08.725960 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8b2e34b1-2b1c-49e7-bc1d-bc52bab5e0c7 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128777) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 11:42:08.733052 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9fd936e8-1708-45c0-b615-9de540630151 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:08.743341 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9fd936e8-1708-45c0-b615-9de540630151 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:08.745149 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9fd936e8-1708-45c0-b615-9de540630151 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:08.746284 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9fd936e8-1708-45c0-b615-9de540630151 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1343 microversion: 2.25 time: 0.102950 Sep 10 11:42:08.747270 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 523/1083] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:42:08 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1343 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:42:08.753546 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-229cc40b-9c9f-43b9-a1ea-01e914a65d16 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:08.754671 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-229cc40b-9c9f-43b9-a1ea-01e914a65d16 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: f86661f1-aaad-445e-a762-12d85ccd0340] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:08.767498 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-229cc40b-9c9f-43b9-a1ea-01e914a65d16 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:08.768113 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-229cc40b-9c9f-43b9-a1ea-01e914a65d16 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:08.768583 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-229cc40b-9c9f-43b9-a1ea-01e914a65d16 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:08.769518 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-229cc40b-9c9f-43b9-a1ea-01e914a65d16 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:08.769978 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-229cc40b-9c9f-43b9-a1ea-01e914a65d16 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:08.770402 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-229cc40b-9c9f-43b9-a1ea-01e914a65d16 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:08.899377 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:42:08.921361 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-229cc40b-9c9f-43b9-a1ea-01e914a65d16 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c97b7605a40ebac26884a59ea3902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ad59d8440a49c496acbede9848e944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:08.929757 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8b2e34b1-2b1c-49e7-bc1d-bc52bab5e0c7 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17/action" status: 202 len: 0 microversion: 2.1 time: 0.263897 Sep 10 11:42:08.929953 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-229cc40b-9c9f-43b9-a1ea-01e914a65d16 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/servers/f86661f1-aaad-445e-a762-12d85ccd0340" status: 200 len: 1315 microversion: 2.1 time: 0.180301 Sep 10 11:42:08.930744 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 561/1084] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:42:08 2022] POST /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:42:08.930983 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 524/1085] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:08 2022] GET /compute/v2.1/servers/f86661f1-aaad-445e-a762-12d85ccd0340 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:08.952170 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cbac9df8-a5da-47b8-914d-5268b3147446 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:08.953253 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cbac9df8-a5da-47b8-914d-5268b3147446 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:08.955989 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7498a7f6-55d7-4bfe-a2d8-e010154bfc80 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:08.960390 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7498a7f6-55d7-4bfe-a2d8-e010154bfc80 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:08.961131 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7498a7f6-55d7-4bfe-a2d8-e010154bfc80 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:08.961791 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7498a7f6-55d7-4bfe-a2d8-e010154bfc80 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:08.962276 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cbac9df8-a5da-47b8-914d-5268b3147446 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:08.962853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cbac9df8-a5da-47b8-914d-5268b3147446 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:08.963208 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7498a7f6-55d7-4bfe-a2d8-e010154bfc80 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:08.963641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cbac9df8-a5da-47b8-914d-5268b3147446 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:08.964339 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7498a7f6-55d7-4bfe-a2d8-e010154bfc80 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:08.964895 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cbac9df8-a5da-47b8-914d-5268b3147446 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:08.965154 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7498a7f6-55d7-4bfe-a2d8-e010154bfc80 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:08.965363 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cbac9df8-a5da-47b8-914d-5268b3147446 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:08.966146 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cbac9df8-a5da-47b8-914d-5268b3147446 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:08.991417 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7498a7f6-55d7-4bfe-a2d8-e010154bfc80 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.046411 Sep 10 11:42:08.992340 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 525/1086] 10.222.0.23 () {58 vars in 1176 bytes} [Sat Sep 10 11:42:08 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:42:09.115467 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cbac9df8-a5da-47b8-914d-5268b3147446 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:09.125082 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cbac9df8-a5da-47b8-914d-5268b3147446 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1470 microversion: 2.1 time: 0.179914 Sep 10 11:42:09.125771 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 562/1087] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:08 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1470 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:09.380525 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-bb18ea47-bf75-4b3b-8e6c-dff3e8498fc8 req-f21d3a64-a3d5-4e63-afea-6b3d28e9b880 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f86661f1-aaad-445e-a762-12d85ccd0340", "name": "network-vif-plugged", "status": "completed", "tag": "e6ae3a2a-28cf-436d-89cc-e8fa6fa8266c"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:09.405753 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-bb18ea47-bf75-4b3b-8e6c-dff3e8498fc8 req-f21d3a64-a3d5-4e63-afea-6b3d28e9b880 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:09.411306 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-bb18ea47-bf75-4b3b-8e6c-dff3e8498fc8 req-f21d3a64-a3d5-4e63-afea-6b3d28e9b880 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:09.411856 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-bb18ea47-bf75-4b3b-8e6c-dff3e8498fc8 req-f21d3a64-a3d5-4e63-afea-6b3d28e9b880 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:09.414142 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b361bf14-b3e2-4268-8581-f0a4a195403f tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:09.414986 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b361bf14-b3e2-4268-8581-f0a4a195403f tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] [instance: 3d45797b-af5c-4942-9ee3-d662e43a8d06] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:09.428466 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b361bf14-b3e2-4268-8581-f0a4a195403f tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:09.428994 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b361bf14-b3e2-4268-8581-f0a4a195403f tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:09.429445 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b361bf14-b3e2-4268-8581-f0a4a195403f tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:09.433142 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b361bf14-b3e2-4268-8581-f0a4a195403f tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:09.433945 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b361bf14-b3e2-4268-8581-f0a4a195403f tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:09.435710 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b361bf14-b3e2-4268-8581-f0a4a195403f tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:09.441163 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-bb18ea47-bf75-4b3b-8e6c-dff3e8498fc8 req-f21d3a64-a3d5-4e63-afea-6b3d28e9b880 service nova] Creating event network-vif-plugged:e6ae3a2a-28cf-436d-89cc-e8fa6fa8266c for instance f86661f1-aaad-445e-a762-12d85ccd0340 on n-h2-856895-1 Sep 10 11:42:09.452498 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-bb18ea47-bf75-4b3b-8e6c-dff3e8498fc8 req-f21d3a64-a3d5-4e63-afea-6b3d28e9b880 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076324 Sep 10 11:42:09.454863 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 526/1088] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:42:09.773827 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5a023e91-205b-49de-b646-5d005e8f637c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:09.774547 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5a023e91-205b-49de-b646-5d005e8f637c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:09.782297 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5a023e91-205b-49de-b646-5d005e8f637c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:09.782793 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5a023e91-205b-49de-b646-5d005e8f637c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:09.783265 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5a023e91-205b-49de-b646-5d005e8f637c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:09.784272 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5a023e91-205b-49de-b646-5d005e8f637c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:09.784902 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5a023e91-205b-49de-b646-5d005e8f637c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:09.785502 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5a023e91-205b-49de-b646-5d005e8f637c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:09.976122 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b361bf14-b3e2-4268-8581-f0a4a195403f tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8e5cb8e9514546baf5851768123fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5c910e1e6f4908b9fdaccb78b7bbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:09.985181 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b361bf14-b3e2-4268-8581-f0a4a195403f tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] 10.222.0.23 "GET /compute/v2.1/servers/3d45797b-af5c-4942-9ee3-d662e43a8d06" status: 200 len: 1322 microversion: 2.1 time: 0.576126 Sep 10 11:42:09.999198 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 563/1089] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:09 2022] GET /compute/v2.1/servers/3d45797b-af5c-4942-9ee3-d662e43a8d06 => generated 1322 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:10.004678 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4801ea16-0a9a-4ffb-935d-4e9dfa7ac510 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:10.008679 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4801ea16-0a9a-4ffb-935d-4e9dfa7ac510 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: f86661f1-aaad-445e-a762-12d85ccd0340] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:10.022514 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5a023e91-205b-49de-b646-5d005e8f637c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:10.022668 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4801ea16-0a9a-4ffb-935d-4e9dfa7ac510 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:10.024386 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4801ea16-0a9a-4ffb-935d-4e9dfa7ac510 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:10.027437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4801ea16-0a9a-4ffb-935d-4e9dfa7ac510 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:10.029326 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4801ea16-0a9a-4ffb-935d-4e9dfa7ac510 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:10.030445 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4801ea16-0a9a-4ffb-935d-4e9dfa7ac510 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:10.031059 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5a023e91-205b-49de-b646-5d005e8f637c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:10.031248 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4801ea16-0a9a-4ffb-935d-4e9dfa7ac510 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:10.032567 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5a023e91-205b-49de-b646-5d005e8f637c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:10.036461 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5a023e91-205b-49de-b646-5d005e8f637c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1343 microversion: 2.25 time: 0.266905 Sep 10 11:42:10.047439 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 527/1090] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:42:09 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1343 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:42:10.148974 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dbc483d7-ec9d-4ade-bcc8-c53a5639ca2c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:10.149596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-dbc483d7-ec9d-4ade-bcc8-c53a5639ca2c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:10.161089 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dbc483d7-ec9d-4ade-bcc8-c53a5639ca2c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:10.161599 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dbc483d7-ec9d-4ade-bcc8-c53a5639ca2c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:10.162046 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dbc483d7-ec9d-4ade-bcc8-c53a5639ca2c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:10.162790 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dbc483d7-ec9d-4ade-bcc8-c53a5639ca2c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:10.163277 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dbc483d7-ec9d-4ade-bcc8-c53a5639ca2c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:10.176004 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dbc483d7-ec9d-4ade-bcc8-c53a5639ca2c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:10.366361 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=12 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:42:10.581920 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4801ea16-0a9a-4ffb-935d-4e9dfa7ac510 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c97b7605a40ebac26884a59ea3902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ad59d8440a49c496acbede9848e944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:10.593552 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4801ea16-0a9a-4ffb-935d-4e9dfa7ac510 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/servers/f86661f1-aaad-445e-a762-12d85ccd0340" status: 200 len: 1315 microversion: 2.1 time: 0.602571 Sep 10 11:42:10.612184 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 564/1091] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:09 2022] GET /compute/v2.1/servers/f86661f1-aaad-445e-a762-12d85ccd0340 => generated 1315 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:10.770269 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-dbc483d7-ec9d-4ade-bcc8-c53a5639ca2c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:10.778976 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-dbc483d7-ec9d-4ade-bcc8-c53a5639ca2c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1470 microversion: 2.1 time: 0.634153 Sep 10 11:42:10.786619 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 528/1092] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:10 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1470 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:42:11.009866 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-32e30078-db72-4773-b8ae-55df7ad0dbbf tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:11.012561 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-32e30078-db72-4773-b8ae-55df7ad0dbbf tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] [instance: 3d45797b-af5c-4942-9ee3-d662e43a8d06] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:11.036558 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32e30078-db72-4773-b8ae-55df7ad0dbbf tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:11.037644 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32e30078-db72-4773-b8ae-55df7ad0dbbf tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:11.038858 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32e30078-db72-4773-b8ae-55df7ad0dbbf tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:11.039977 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32e30078-db72-4773-b8ae-55df7ad0dbbf tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:11.041019 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32e30078-db72-4773-b8ae-55df7ad0dbbf tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:11.043091 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32e30078-db72-4773-b8ae-55df7ad0dbbf tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:11.069194 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e8a7f5ba-4017-41fc-8798-fa2ae472a7c6 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:11.070048 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e8a7f5ba-4017-41fc-8798-fa2ae472a7c6 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:11.088762 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e8a7f5ba-4017-41fc-8798-fa2ae472a7c6 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:11.098107 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e8a7f5ba-4017-41fc-8798-fa2ae472a7c6 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:11.099471 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e8a7f5ba-4017-41fc-8798-fa2ae472a7c6 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:11.101235 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e8a7f5ba-4017-41fc-8798-fa2ae472a7c6 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:11.103922 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e8a7f5ba-4017-41fc-8798-fa2ae472a7c6 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:11.105611 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e8a7f5ba-4017-41fc-8798-fa2ae472a7c6 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:11.454867 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e8a7f5ba-4017-41fc-8798-fa2ae472a7c6 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:11.474634 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e8a7f5ba-4017-41fc-8798-fa2ae472a7c6 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:11.476024 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e8a7f5ba-4017-41fc-8798-fa2ae472a7c6 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:11.476646 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-32e30078-db72-4773-b8ae-55df7ad0dbbf tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8e5cb8e9514546baf5851768123fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5c910e1e6f4908b9fdaccb78b7bbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:11.477180 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e8a7f5ba-4017-41fc-8798-fa2ae472a7c6 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1411 microversion: 2.25 time: 0.412916 Sep 10 11:42:11.479308 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 529/1093] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:42:11 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1411 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:42:11.500966 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-32e30078-db72-4773-b8ae-55df7ad0dbbf tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] 10.222.0.23 "GET /compute/v2.1/servers/3d45797b-af5c-4942-9ee3-d662e43a8d06" status: 200 len: 1322 microversion: 2.1 time: 0.496003 Sep 10 11:42:11.504083 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 565/1094] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:11 2022] GET /compute/v2.1/servers/3d45797b-af5c-4942-9ee3-d662e43a8d06 => generated 1322 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:11.625027 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e3b64421-2376-446f-ac1c-ae1b73a58063 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:11.625905 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e3b64421-2376-446f-ac1c-ae1b73a58063 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: f86661f1-aaad-445e-a762-12d85ccd0340] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:11.634198 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e3b64421-2376-446f-ac1c-ae1b73a58063 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:11.634921 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e3b64421-2376-446f-ac1c-ae1b73a58063 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:11.635437 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e3b64421-2376-446f-ac1c-ae1b73a58063 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:11.637208 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e3b64421-2376-446f-ac1c-ae1b73a58063 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:11.637897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e3b64421-2376-446f-ac1c-ae1b73a58063 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:11.638538 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e3b64421-2376-446f-ac1c-ae1b73a58063 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:11.821333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6f960df6-2e13-4218-a1dc-7982e9954e1a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:11.822095 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6f960df6-2e13-4218-a1dc-7982e9954e1a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:11.836577 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6f960df6-2e13-4218-a1dc-7982e9954e1a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:11.837636 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6f960df6-2e13-4218-a1dc-7982e9954e1a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:11.838374 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6f960df6-2e13-4218-a1dc-7982e9954e1a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:11.840678 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6f960df6-2e13-4218-a1dc-7982e9954e1a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:11.841421 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6f960df6-2e13-4218-a1dc-7982e9954e1a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:11.842149 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6f960df6-2e13-4218-a1dc-7982e9954e1a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:11.882210 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e3b64421-2376-446f-ac1c-ae1b73a58063 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c97b7605a40ebac26884a59ea3902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ad59d8440a49c496acbede9848e944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:11.893350 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e3b64421-2376-446f-ac1c-ae1b73a58063 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/servers/f86661f1-aaad-445e-a762-12d85ccd0340" status: 200 len: 1503 microversion: 2.1 time: 0.271413 Sep 10 11:42:11.907188 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 530/1095] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:11 2022] GET /compute/v2.1/servers/f86661f1-aaad-445e-a762-12d85ccd0340 => generated 1503 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:11.919803 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-07259f1e-83da-443b-8561-512b3d618813 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-286358105"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:11.920452 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-07259f1e-83da-443b-8561-512b3d618813 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: f86661f1-aaad-445e-a762-12d85ccd0340] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:11.930532 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-07259f1e-83da-443b-8561-512b3d618813 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:11.931027 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-07259f1e-83da-443b-8561-512b3d618813 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:11.931502 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-07259f1e-83da-443b-8561-512b3d618813 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:11.932222 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-07259f1e-83da-443b-8561-512b3d618813 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:11.932902 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-07259f1e-83da-443b-8561-512b3d618813 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:11.933422 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-07259f1e-83da-443b-8561-512b3d618813 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:12.419755 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6f960df6-2e13-4218-a1dc-7982e9954e1a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:12.432792 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6f960df6-2e13-4218-a1dc-7982e9954e1a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1470 microversion: 2.1 time: 0.616447 Sep 10 11:42:12.433444 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 566/1096] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:11 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1470 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:12.449709 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.network.security_group_api [None req-07259f1e-83da-443b-8561-512b3d618813 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Adding security group d59e9d31-bc54-4707-87db-5d9c771f3cd8 to port e6ae3a2a-28cf-436d-89cc-e8fa6fa8266c Sep 10 11:42:12.503133 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7e56f8c7-5cc7-4ee1-8a88-b2d2cf20bcc1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:12.504114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7e56f8c7-5cc7-4ee1-8a88-b2d2cf20bcc1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:12.515274 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e56f8c7-5cc7-4ee1-8a88-b2d2cf20bcc1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:12.517105 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e56f8c7-5cc7-4ee1-8a88-b2d2cf20bcc1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:12.517550 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e56f8c7-5cc7-4ee1-8a88-b2d2cf20bcc1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:12.518273 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e56f8c7-5cc7-4ee1-8a88-b2d2cf20bcc1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:12.521913 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e56f8c7-5cc7-4ee1-8a88-b2d2cf20bcc1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:12.522596 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e56f8c7-5cc7-4ee1-8a88-b2d2cf20bcc1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:13.144926 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7e56f8c7-5cc7-4ee1-8a88-b2d2cf20bcc1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:13.155409 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7e56f8c7-5cc7-4ee1-8a88-b2d2cf20bcc1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:13.170948 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7e56f8c7-5cc7-4ee1-8a88-b2d2cf20bcc1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:13.173393 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7e56f8c7-5cc7-4ee1-8a88-b2d2cf20bcc1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1411 microversion: 2.25 time: 0.675298 Sep 10 11:42:13.188728 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 567/1097] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:42:12 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1411 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:42:13.200995 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c7c88a7e-5cdd-4d35-9f12-9f5782223308 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:13.202014 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c7c88a7e-5cdd-4d35-9f12-9f5782223308 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] [instance: 3d45797b-af5c-4942-9ee3-d662e43a8d06] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:13.210639 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7c88a7e-5cdd-4d35-9f12-9f5782223308 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:13.211593 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7c88a7e-5cdd-4d35-9f12-9f5782223308 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:13.212611 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7c88a7e-5cdd-4d35-9f12-9f5782223308 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:13.214680 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7c88a7e-5cdd-4d35-9f12-9f5782223308 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:13.215420 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7c88a7e-5cdd-4d35-9f12-9f5782223308 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:13.216085 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7c88a7e-5cdd-4d35-9f12-9f5782223308 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:13.558597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c7c88a7e-5cdd-4d35-9f12-9f5782223308 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8e5cb8e9514546baf5851768123fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5c910e1e6f4908b9fdaccb78b7bbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:13.572165 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-07259f1e-83da-443b-8561-512b3d618813 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "POST /compute/v2.1/servers/f86661f1-aaad-445e-a762-12d85ccd0340/action" status: 202 len: 0 microversion: 2.1 time: 1.657087 Sep 10 11:42:13.578515 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c7c88a7e-5cdd-4d35-9f12-9f5782223308 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] 10.222.0.23 "GET /compute/v2.1/servers/3d45797b-af5c-4942-9ee3-d662e43a8d06" status: 200 len: 1322 microversion: 2.1 time: 0.386128 Sep 10 11:42:13.579732 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 568/1098] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:13 2022] GET /compute/v2.1/servers/3d45797b-af5c-4942-9ee3-d662e43a8d06 => generated 1322 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:13.584044 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 531/1099] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:42:11 2022] POST /compute/v2.1/servers/f86661f1-aaad-445e-a762-12d85ccd0340/action => generated 0 bytes in 1670 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:42:13.586288 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-7607a124-c5c8-4541-8902-27441fec03d3 req-33639260-7539-43be-bb18-6f1d1611f339 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50d20272-889d-4b72-b33d-73094c78c7b4", "tag": "4a6239c6-5b04-4a27-9109-707d2bf0a4ed"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:13.592135 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7a611fe4-d36c-4c41-838c-98a6be59c7a9 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "853af92f-2654-49a7-9b94-05c9e4dc9ceb", "device": "/dev/xvdb"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:13.597867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-7607a124-c5c8-4541-8902-27441fec03d3 req-33639260-7539-43be-bb18-6f1d1611f339 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:13.599080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-7607a124-c5c8-4541-8902-27441fec03d3 req-33639260-7539-43be-bb18-6f1d1611f339 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:13.599839 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7a611fe4-d36c-4c41-838c-98a6be59c7a9 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:13.600186 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-7607a124-c5c8-4541-8902-27441fec03d3 req-33639260-7539-43be-bb18-6f1d1611f339 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:13.613352 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-7607a124-c5c8-4541-8902-27441fec03d3 req-33639260-7539-43be-bb18-6f1d1611f339 service nova] Creating event network-changed:4a6239c6-5b04-4a27-9109-707d2bf0a4ed for instance 50d20272-889d-4b72-b33d-73094c78c7b4 on n-h2-856895-1 Sep 10 11:42:13.621718 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-7607a124-c5c8-4541-8902-27441fec03d3 req-33639260-7539-43be-bb18-6f1d1611f339 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040413 Sep 10 11:42:13.623855 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 569/1100] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:42:13.634894 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a611fe4-d36c-4c41-838c-98a6be59c7a9 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:13.636595 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e0af0d04-5069-49c0-840d-2069bf05f874 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:13.640003 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e0af0d04-5069-49c0-840d-2069bf05f874 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:13.640672 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a611fe4-d36c-4c41-838c-98a6be59c7a9 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:13.642905 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a611fe4-d36c-4c41-838c-98a6be59c7a9 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:13.647403 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a611fe4-d36c-4c41-838c-98a6be59c7a9 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:13.647922 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a611fe4-d36c-4c41-838c-98a6be59c7a9 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:13.648378 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a611fe4-d36c-4c41-838c-98a6be59c7a9 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:13.670738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0af0d04-5069-49c0-840d-2069bf05f874 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:13.675640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0af0d04-5069-49c0-840d-2069bf05f874 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:13.676800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0af0d04-5069-49c0-840d-2069bf05f874 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:13.678949 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0af0d04-5069-49c0-840d-2069bf05f874 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:13.679903 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0af0d04-5069-49c0-840d-2069bf05f874 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:13.680572 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0af0d04-5069-49c0-840d-2069bf05f874 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:13.966093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e0af0d04-5069-49c0-840d-2069bf05f874 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:13.976552 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e0af0d04-5069-49c0-840d-2069bf05f874 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1470 microversion: 2.1 time: 0.350516 Sep 10 11:42:13.977540 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 570/1101] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:13 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1470 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:13.983122 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-5c613480-2f45-4c27-9273-2ba592d2fb2d req-af6395a3-6228-4f83-9193-4a8f81f01292 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f86661f1-aaad-445e-a762-12d85ccd0340", "tag": "e6ae3a2a-28cf-436d-89cc-e8fa6fa8266c"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:13.995348 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-5c613480-2f45-4c27-9273-2ba592d2fb2d req-af6395a3-6228-4f83-9193-4a8f81f01292 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:13.996931 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-5c613480-2f45-4c27-9273-2ba592d2fb2d req-af6395a3-6228-4f83-9193-4a8f81f01292 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:13.999643 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-5c613480-2f45-4c27-9273-2ba592d2fb2d req-af6395a3-6228-4f83-9193-4a8f81f01292 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:14.014271 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-5c613480-2f45-4c27-9273-2ba592d2fb2d req-af6395a3-6228-4f83-9193-4a8f81f01292 service nova] Creating event network-changed:e6ae3a2a-28cf-436d-89cc-e8fa6fa8266c for instance f86661f1-aaad-445e-a762-12d85ccd0340 on n-h2-856895-1 Sep 10 11:42:14.021199 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-5c613480-2f45-4c27-9273-2ba592d2fb2d req-af6395a3-6228-4f83-9193-4a8f81f01292 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042186 Sep 10 11:42:14.023035 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 571/1102] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:42:14.030678 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cec8fd0a-10b8-444b-a011-9758358b1e8a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-728887220"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:14.031717 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cec8fd0a-10b8-444b-a011-9758358b1e8a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: f86661f1-aaad-445e-a762-12d85ccd0340] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:14.038263 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cec8fd0a-10b8-444b-a011-9758358b1e8a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:14.039071 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cec8fd0a-10b8-444b-a011-9758358b1e8a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:14.039786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cec8fd0a-10b8-444b-a011-9758358b1e8a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:14.040771 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cec8fd0a-10b8-444b-a011-9758358b1e8a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:14.041506 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cec8fd0a-10b8-444b-a011-9758358b1e8a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:14.042831 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cec8fd0a-10b8-444b-a011-9758358b1e8a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:14.388425 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7a611fe4-d36c-4c41-838c-98a6be59c7a9 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "POST /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.803045 Sep 10 11:42:14.395492 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 532/1103] 10.222.0.23 () {60 vars in 1323 bytes} [Sat Sep 10 11:42:13 2022] POST /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1/os-volume_attachments => generated 194 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:42:14.406752 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e55f9f4d-9405-49a2-9239-92e255034354 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:14.412014 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e55f9f4d-9405-49a2-9239-92e255034354 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:14.426376 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e55f9f4d-9405-49a2-9239-92e255034354 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:14.433031 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e55f9f4d-9405-49a2-9239-92e255034354 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:14.434135 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e55f9f4d-9405-49a2-9239-92e255034354 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:14.435129 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e55f9f4d-9405-49a2-9239-92e255034354 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:14.435828 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e55f9f4d-9405-49a2-9239-92e255034354 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:14.440278 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e55f9f4d-9405-49a2-9239-92e255034354 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:14.549816 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.network.security_group_api [None req-cec8fd0a-10b8-444b-a011-9758358b1e8a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Adding security group 1065ddc0-2e7c-461c-9c22-7a76dc27300e to port e6ae3a2a-28cf-436d-89cc-e8fa6fa8266c Sep 10 11:42:14.867780 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e55f9f4d-9405-49a2-9239-92e255034354 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:14.878337 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e55f9f4d-9405-49a2-9239-92e255034354 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:14.879812 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e55f9f4d-9405-49a2-9239-92e255034354 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:14.881203 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e55f9f4d-9405-49a2-9239-92e255034354 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1411 microversion: 2.25 time: 0.484641 Sep 10 11:42:14.899143 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 533/1104] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:42:14 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1411 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:42:14.906864 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7b3e0cb9-b08d-4eb5-8b27-9e619508d9d4 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:14.908497 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7b3e0cb9-b08d-4eb5-8b27-9e619508d9d4 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] [instance: 3d45797b-af5c-4942-9ee3-d662e43a8d06] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:14.915826 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7b3e0cb9-b08d-4eb5-8b27-9e619508d9d4 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:14.916622 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7b3e0cb9-b08d-4eb5-8b27-9e619508d9d4 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:14.917326 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7b3e0cb9-b08d-4eb5-8b27-9e619508d9d4 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:14.918330 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7b3e0cb9-b08d-4eb5-8b27-9e619508d9d4 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:14.919634 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7b3e0cb9-b08d-4eb5-8b27-9e619508d9d4 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:14.920343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7b3e0cb9-b08d-4eb5-8b27-9e619508d9d4 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:15.581613 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7b3e0cb9-b08d-4eb5-8b27-9e619508d9d4 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8e5cb8e9514546baf5851768123fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5c910e1e6f4908b9fdaccb78b7bbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:15.600840 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7b3e0cb9-b08d-4eb5-8b27-9e619508d9d4 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] 10.222.0.23 "GET /compute/v2.1/servers/3d45797b-af5c-4942-9ee3-d662e43a8d06" status: 200 len: 1322 microversion: 2.1 time: 0.700211 Sep 10 11:42:15.601670 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 534/1105] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:14 2022] GET /compute/v2.1/servers/3d45797b-af5c-4942-9ee3-d662e43a8d06 => generated 1322 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:15.608313 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1c2b1c11-6c35-4b53-b6cd-5fcd54623df3 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:15.617294 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1c2b1c11-6c35-4b53-b6cd-5fcd54623df3 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:15.627579 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1c2b1c11-6c35-4b53-b6cd-5fcd54623df3 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:15.628138 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1c2b1c11-6c35-4b53-b6cd-5fcd54623df3 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:15.629941 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1c2b1c11-6c35-4b53-b6cd-5fcd54623df3 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:15.631124 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1c2b1c11-6c35-4b53-b6cd-5fcd54623df3 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:15.631822 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1c2b1c11-6c35-4b53-b6cd-5fcd54623df3 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:15.632842 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1c2b1c11-6c35-4b53-b6cd-5fcd54623df3 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:15.935253 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cec8fd0a-10b8-444b-a011-9758358b1e8a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "POST /compute/v2.1/servers/f86661f1-aaad-445e-a762-12d85ccd0340/action" status: 202 len: 0 microversion: 2.1 time: 1.909870 Sep 10 11:42:15.935998 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 572/1106] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:42:14 2022] POST /compute/v2.1/servers/f86661f1-aaad-445e-a762-12d85ccd0340/action => generated 0 bytes in 1912 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:42:15.940505 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5f58e1be-d180-46dd-b03d-2ef12974ec9e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:15.941115 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5f58e1be-d180-46dd-b03d-2ef12974ec9e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:15.960553 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5f58e1be-d180-46dd-b03d-2ef12974ec9e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:15.961238 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5f58e1be-d180-46dd-b03d-2ef12974ec9e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:15.962057 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5f58e1be-d180-46dd-b03d-2ef12974ec9e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:15.962954 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5f58e1be-d180-46dd-b03d-2ef12974ec9e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:15.964231 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5f58e1be-d180-46dd-b03d-2ef12974ec9e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:15.965180 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5f58e1be-d180-46dd-b03d-2ef12974ec9e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:16.164497 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1c2b1c11-6c35-4b53-b6cd-5fcd54623df3 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:16.174286 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1c2b1c11-6c35-4b53-b6cd-5fcd54623df3 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1475 microversion: 2.1 time: 0.571354 Sep 10 11:42:16.180886 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 535/1107] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:15 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1475 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:16.197820 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fe7ef2bf-0a47-4613-8d77-bda2f5d420f3 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:16.199182 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fe7ef2bf-0a47-4613-8d77-bda2f5d420f3 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: f86661f1-aaad-445e-a762-12d85ccd0340] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:16.216270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe7ef2bf-0a47-4613-8d77-bda2f5d420f3 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:16.217216 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe7ef2bf-0a47-4613-8d77-bda2f5d420f3 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:16.218058 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe7ef2bf-0a47-4613-8d77-bda2f5d420f3 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:16.220642 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe7ef2bf-0a47-4613-8d77-bda2f5d420f3 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:16.222011 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe7ef2bf-0a47-4613-8d77-bda2f5d420f3 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:16.222720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe7ef2bf-0a47-4613-8d77-bda2f5d420f3 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:16.230856 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:42:16.542921 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fe7ef2bf-0a47-4613-8d77-bda2f5d420f3 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/servers/f86661f1-aaad-445e-a762-12d85ccd0340/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.358710 Sep 10 11:42:16.543555 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 536/1108] 10.222.0.23 () {58 vars in 1293 bytes} [Sat Sep 10 11:42:16 2022] GET /compute/v2.1/servers/f86661f1-aaad-445e-a762-12d85ccd0340/os-security-groups => generated 1157 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:16.545250 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:42:16.551702 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-f339ac01-64a0-417f-91a7-e1788b3c305e req-d714862b-b152-4a53-b876-25ee8790e5d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f86661f1-aaad-445e-a762-12d85ccd0340", "tag": "e6ae3a2a-28cf-436d-89cc-e8fa6fa8266c"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:16.586893 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f339ac01-64a0-417f-91a7-e1788b3c305e req-d714862b-b152-4a53-b876-25ee8790e5d5 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:16.588493 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f339ac01-64a0-417f-91a7-e1788b3c305e req-d714862b-b152-4a53-b876-25ee8790e5d5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:16.590953 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f339ac01-64a0-417f-91a7-e1788b3c305e req-d714862b-b152-4a53-b876-25ee8790e5d5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:16.622964 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-f339ac01-64a0-417f-91a7-e1788b3c305e req-d714862b-b152-4a53-b876-25ee8790e5d5 service nova] Creating event network-changed:e6ae3a2a-28cf-436d-89cc-e8fa6fa8266c for instance f86661f1-aaad-445e-a762-12d85ccd0340 on n-h2-856895-1 Sep 10 11:42:16.632385 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-f339ac01-64a0-417f-91a7-e1788b3c305e req-d714862b-b152-4a53-b876-25ee8790e5d5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087214 Sep 10 11:42:16.636725 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 537/1109] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:42:16.647369 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-efcc4fe0-447f-49f1-b1fd-ac6ee49745fd tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Action: 'create', calling method: .version_select at 0x7f40735f8ee0>, body: {"security_group": {"name": " tempest-securitygroup -190191954 ", "description": "tempest-description-1137540109"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:16.799237 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5f58e1be-d180-46dd-b03d-2ef12974ec9e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:16.809070 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5f58e1be-d180-46dd-b03d-2ef12974ec9e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:16.810543 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5f58e1be-d180-46dd-b03d-2ef12974ec9e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:16.811802 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5f58e1be-d180-46dd-b03d-2ef12974ec9e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1411 microversion: 2.25 time: 0.874954 Sep 10 11:42:16.812380 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 573/1110] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:42:15 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1411 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:42:16.845662 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fecdca61-892c-45a4-a9e1-ce298154198d tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:16.846400 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fecdca61-892c-45a4-a9e1-ce298154198d tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] [instance: 3d45797b-af5c-4942-9ee3-d662e43a8d06] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:16.859793 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fecdca61-892c-45a4-a9e1-ce298154198d tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:16.864079 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fecdca61-892c-45a4-a9e1-ce298154198d tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:16.864746 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fecdca61-892c-45a4-a9e1-ce298154198d tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:16.865655 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fecdca61-892c-45a4-a9e1-ce298154198d tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:16.866307 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fecdca61-892c-45a4-a9e1-ce298154198d tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:16.867641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fecdca61-892c-45a4-a9e1-ce298154198d tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:17.250971 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:42:17.268950 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-efcc4fe0-447f-49f1-b1fd-ac6ee49745fd tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.630521 Sep 10 11:42:17.270137 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 538/1111] 10.222.0.23 () {60 vars in 1180 bytes} [Sat Sep 10 11:42:16 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:42:17.290355 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-d5ba0876-9b78-425e-9a4d-5ce29a01f7e4 req-cb633264-0d47-472f-8373-54be79c14b4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d45797b-af5c-4942-9ee3-d662e43a8d06", "name": "network-vif-plugged", "status": "completed", "tag": "dfb5de02-77c3-4135-8a4d-77c9a2ac1fa6"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:17.306884 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fecdca61-892c-45a4-a9e1-ce298154198d tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8e5cb8e9514546baf5851768123fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5c910e1e6f4908b9fdaccb78b7bbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:17.318636 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fecdca61-892c-45a4-a9e1-ce298154198d tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] 10.222.0.23 "GET /compute/v2.1/servers/3d45797b-af5c-4942-9ee3-d662e43a8d06" status: 200 len: 1322 microversion: 2.1 time: 0.484586 Sep 10 11:42:17.320665 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 574/1112] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:16 2022] GET /compute/v2.1/servers/3d45797b-af5c-4942-9ee3-d662e43a8d06 => generated 1322 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:17.325683 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d5ba0876-9b78-425e-9a4d-5ce29a01f7e4 req-cb633264-0d47-472f-8373-54be79c14b4f service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:17.326185 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d5ba0876-9b78-425e-9a4d-5ce29a01f7e4 req-cb633264-0d47-472f-8373-54be79c14b4f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:17.326689 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d5ba0876-9b78-425e-9a4d-5ce29a01f7e4 req-cb633264-0d47-472f-8373-54be79c14b4f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:17.327990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-54c3362d-3415-4a1c-8698-c8b1f1536bc1 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:17.329018 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-54c3362d-3415-4a1c-8698-c8b1f1536bc1 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:17.338188 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54c3362d-3415-4a1c-8698-c8b1f1536bc1 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:17.341639 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54c3362d-3415-4a1c-8698-c8b1f1536bc1 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:17.344614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54c3362d-3415-4a1c-8698-c8b1f1536bc1 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:17.345890 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54c3362d-3415-4a1c-8698-c8b1f1536bc1 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:17.347627 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54c3362d-3415-4a1c-8698-c8b1f1536bc1 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:17.348538 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54c3362d-3415-4a1c-8698-c8b1f1536bc1 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:17.360872 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-d5ba0876-9b78-425e-9a4d-5ce29a01f7e4 req-cb633264-0d47-472f-8373-54be79c14b4f service nova] Creating event network-vif-plugged:dfb5de02-77c3-4135-8a4d-77c9a2ac1fa6 for instance 3d45797b-af5c-4942-9ee3-d662e43a8d06 on n-h1-856895-1 Sep 10 11:42:17.371724 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-d5ba0876-9b78-425e-9a4d-5ce29a01f7e4 req-cb633264-0d47-472f-8373-54be79c14b4f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098423 Sep 10 11:42:17.372642 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 539/1113] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:42:17.386623 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a020c27f-abc7-4661-b419-99cf511563d3 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '.version_select at 0x7f40735f8c10>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:17.668238 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a020c27f-abc7-4661-b419-99cf511563d3 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/92bc7684-c6b0-4f3e-a17a-b6146dc227c7" status: 200 len: 223 microversion: 2.1 time: 0.294113 Sep 10 11:42:17.669481 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 540/1114] 10.222.0.23 () {58 vars in 1269 bytes} [Sat Sep 10 11:42:17 2022] GET /compute/v2.1/os-security-groups/92bc7684-c6b0-4f3e-a17a-b6146dc227c7 => generated 223 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:42:17.684199 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-498d223a-37c7-4dfb-8cd6-61847c1121e0 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '.version_select at 0x7f40735f8f70>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:17.921399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-54c3362d-3415-4a1c-8698-c8b1f1536bc1 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:17.933662 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-54c3362d-3415-4a1c-8698-c8b1f1536bc1 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1475 microversion: 2.1 time: 0.609541 Sep 10 11:42:17.934631 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 575/1115] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:17 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1475 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:17.946212 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3a0091ea-b0c9-4328-b2d8-51af7deb73fc tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:17.952326 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3a0091ea-b0c9-4328-b2d8-51af7deb73fc tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:17.966335 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a0091ea-b0c9-4328-b2d8-51af7deb73fc tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:17.966888 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a0091ea-b0c9-4328-b2d8-51af7deb73fc tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:17.967510 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a0091ea-b0c9-4328-b2d8-51af7deb73fc tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:17.968541 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a0091ea-b0c9-4328-b2d8-51af7deb73fc tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:17.969065 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a0091ea-b0c9-4328-b2d8-51af7deb73fc tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:17.969653 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a0091ea-b0c9-4328-b2d8-51af7deb73fc tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:18.397264 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3a0091ea-b0c9-4328-b2d8-51af7deb73fc tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:18.408810 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-498d223a-37c7-4dfb-8cd6-61847c1121e0 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/92bc7684-c6b0-4f3e-a17a-b6146dc227c7" status: 202 len: 0 microversion: 2.1 time: 0.729475 Sep 10 11:42:18.412366 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 541/1116] 10.222.0.23 () {58 vars in 1272 bytes} [Sat Sep 10 11:42:17 2022] DELETE /compute/v2.1/os-security-groups/92bc7684-c6b0-4f3e-a17a-b6146dc227c7 => generated 0 bytes in 731 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:42:18.412526 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3a0091ea-b0c9-4328-b2d8-51af7deb73fc tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:18.413663 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3a0091ea-b0c9-4328-b2d8-51af7deb73fc tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:18.414458 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fed6b20b-6955-42e3-91f8-2ce755422dd9 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:18.414819 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3a0091ea-b0c9-4328-b2d8-51af7deb73fc tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1411 microversion: 2.25 time: 0.478645 Sep 10 11:42:18.415218 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fed6b20b-6955-42e3-91f8-2ce755422dd9 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] [instance: 3d45797b-af5c-4942-9ee3-d662e43a8d06] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:18.421336 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 576/1117] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:42:17 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1411 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:42:18.430832 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ee36f474-3c3c-4e35-aa5a-a6f5cb501d73 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '.version_select at 0x7f40731e3160>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:18.434891 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fed6b20b-6955-42e3-91f8-2ce755422dd9 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:18.435631 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fed6b20b-6955-42e3-91f8-2ce755422dd9 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:18.436236 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fed6b20b-6955-42e3-91f8-2ce755422dd9 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:18.437118 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fed6b20b-6955-42e3-91f8-2ce755422dd9 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:18.437787 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fed6b20b-6955-42e3-91f8-2ce755422dd9 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:18.438368 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fed6b20b-6955-42e3-91f8-2ce755422dd9 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:18.502523 n-d-856895-1 devstack@n-api.service[128777]: DEBUG neutronclient.v2_0.client [None req-ee36f474-3c3c-4e35-aa5a-a6f5cb501d73 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 92bc7684-c6b0-4f3e-a17a-b6146dc227c7 does not exist", "detail": ""}} {{(pid=128777) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 11:42:18.504390 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.security_group_api [None req-ee36f474-3c3c-4e35-aa5a-a6f5cb501d73 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Neutron security group 92bc7684-c6b0-4f3e-a17a-b6146dc227c7 not found {{(pid=128777) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 11:42:18.505174 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-ee36f474-3c3c-4e35-aa5a-a6f5cb501d73 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] HTTP exception thrown: Security group 92bc7684-c6b0-4f3e-a17a-b6146dc227c7 does not exist Sep 10 11:42:18.505174 n-d-856895-1 devstack@n-api.service[128777]: Neutron server returns request_ids: ['req-b883933f-ddff-4bf9-8286-8c9db068b996'] Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ee36f474-3c3c-4e35-aa5a-a6f5cb501d73 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Request method failure captured: Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/os-security-groups/92bc7684-c6b0-4f3e-a17a-b6146dc227c7 HTTP/1.1 Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHgBU0aZ9PqJpGA422fKNy27Wjo5sOCfo4CIswXFFfdPv36WiPjLOYw_neMbOsaeYNKIXkVSp0pEYCo9771BWqsl0fjBWyX6S3skhskK7a85wRu3ZuO-FXP422rQwCRC9xzOeesr0UvY-AFVf9_IuIXQit7YUH71vPa-NVExdrtG-MY Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 91ad59d8440a49c496acbede9848e944 Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ad59d8440a49c496acbede9848e944"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ad59d8440a49c496acbede9848e944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_91ad59d8440a49c496acbede9848e944", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/91ad59d8440a49c496acbede9848e944"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 91ad59d8440a49c496acbede9848e944 Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-SecurityGroupsTestJSON-1578123858-project Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 080c97b7605a40ebac26884a59ea3902 Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-SecurityGroupsTestJSON-1578123858-project Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: exception: Security group 92bc7684-c6b0-4f3e-a17a-b6146dc227c7 does not exist Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: Neutron server returns request_ids: ['req-b883933f-ddff-4bf9-8286-8c9db068b996'] Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '92bc7684-c6b0-4f3e-a17a-b6146dc227c7'} Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 11:42:18.507539 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 92bc7684-c6b0-4f3e-a17a-b6146dc227c7 does not exist Sep 10 11:42:18.512842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b883933f-ddff-4bf9-8286-8c9db068b996'] Sep 10 11:42:18.512842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:42:18.512842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:42:18.512842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:42:18.512842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:42:18.512842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 10 11:42:18.512842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 10 11:42:18.512842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 11:42:18.512842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 11:42:18.512842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 92bc7684-c6b0-4f3e-a17a-b6146dc227c7 does not exist Sep 10 11:42:18.512842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b883933f-ddff-4bf9-8286-8c9db068b996'] Sep 10 11:42:18.512842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:42:18.512842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:42:18.512842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:42:18.512842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:42:18.512842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:42:18.512842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:42:18.512842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:42:18.512842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:42:18.512842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:42:18.512842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:42:18.512842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:42:18.512842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:42:18.512842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 10 11:42:18.512842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 11:42:18.512842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 92bc7684-c6b0-4f3e-a17a-b6146dc227c7 does not exist Sep 10 11:42:18.512842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b883933f-ddff-4bf9-8286-8c9db068b996'] Sep 10 11:42:18.512842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:42:18.512842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:42:18.512842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:42:18.512842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:42:18.512842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:42:18.512842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:42:18.512842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:42:18.512842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:42:18.512842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 92bc7684-c6b0-4f3e-a17a-b6146dc227c7 does not exist Sep 10 11:42:18.512842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b883933f-ddff-4bf9-8286-8c9db068b996'] Sep 10 11:42:18.512842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:42:18.515805 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ee36f474-3c3c-4e35-aa5a-a6f5cb501d73 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Returning 404 to user: Security group 92bc7684-c6b0-4f3e-a17a-b6146dc227c7 does not exist Sep 10 11:42:18.515805 n-d-856895-1 devstack@n-api.service[128777]: Neutron server returns request_ids: ['req-b883933f-ddff-4bf9-8286-8c9db068b996'] {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:42:18.517368 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ee36f474-3c3c-4e35-aa5a-a6f5cb501d73 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/92bc7684-c6b0-4f3e-a17a-b6146dc227c7" status: 404 len: 194 microversion: 2.1 time: 0.093361 Sep 10 11:42:18.517368 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 577/1118] 10.222.0.23 () {58 vars in 1269 bytes} [Sat Sep 10 11:42:18 2022] GET /compute/v2.1/os-security-groups/92bc7684-c6b0-4f3e-a17a-b6146dc227c7 => generated 194 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:42:18.532886 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ddc1b4ab-8d23-423b-a3dc-057f3abaf814 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Action: 'create', calling method: .version_select at 0x7f4073114040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-359589985", "description": "tempest-description-492229102"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:18.806663 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fed6b20b-6955-42e3-91f8-2ce755422dd9 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8e5cb8e9514546baf5851768123fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5c910e1e6f4908b9fdaccb78b7bbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:18.816049 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fed6b20b-6955-42e3-91f8-2ce755422dd9 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] 10.222.0.23 "GET /compute/v2.1/servers/3d45797b-af5c-4942-9ee3-d662e43a8d06" status: 200 len: 1322 microversion: 2.1 time: 0.405179 Sep 10 11:42:18.816635 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 542/1119] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:18 2022] GET /compute/v2.1/servers/3d45797b-af5c-4942-9ee3-d662e43a8d06 => generated 1322 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:18.962067 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e93af662-f4ff-4fbe-b3de-a4195b3b0169 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:18.962682 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e93af662-f4ff-4fbe-b3de-a4195b3b0169 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:18.969439 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e93af662-f4ff-4fbe-b3de-a4195b3b0169 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:18.971401 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e93af662-f4ff-4fbe-b3de-a4195b3b0169 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:18.976085 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e93af662-f4ff-4fbe-b3de-a4195b3b0169 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:18.976830 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e93af662-f4ff-4fbe-b3de-a4195b3b0169 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:18.977345 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e93af662-f4ff-4fbe-b3de-a4195b3b0169 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:18.977730 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e93af662-f4ff-4fbe-b3de-a4195b3b0169 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:18.978319 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=4 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:42:19.023787 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ddc1b4ab-8d23-423b-a3dc-057f3abaf814 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.500074 Sep 10 11:42:19.024559 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 578/1120] 10.222.0.23 () {60 vars in 1180 bytes} [Sat Sep 10 11:42:18 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:42:19.044352 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f90e054c-7315-495c-91d8-5c04094a64af tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Action: 'create', calling method: .version_select at 0x7f4073b66d30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-680943848", "description": "tempest-description-1207640666"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:19.272442 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e93af662-f4ff-4fbe-b3de-a4195b3b0169 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:19.283932 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e93af662-f4ff-4fbe-b3de-a4195b3b0169 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1475 microversion: 2.1 time: 0.325877 Sep 10 11:42:19.289354 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 543/1121] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:18 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1475 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:42:19.448303 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-31bed67c-a390-445b-885b-026d40ff6173 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:19.450314 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-31bed67c-a390-445b-885b-026d40ff6173 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:19.457313 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f90e054c-7315-495c-91d8-5c04094a64af tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.421000 Sep 10 11:42:19.461115 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 579/1122] 10.222.0.23 () {60 vars in 1180 bytes} [Sat Sep 10 11:42:19 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:42:19.461760 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-31bed67c-a390-445b-885b-026d40ff6173 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:19.462520 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-31bed67c-a390-445b-885b-026d40ff6173 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:19.465588 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-31bed67c-a390-445b-885b-026d40ff6173 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:19.471059 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-31bed67c-a390-445b-885b-026d40ff6173 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:19.472400 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-31bed67c-a390-445b-885b-026d40ff6173 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:19.473430 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-31bed67c-a390-445b-885b-026d40ff6173 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:19.477487 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6fd4e85a-3630-4cc6-93ac-6fb87881c18a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Action: 'create', calling method: .version_select at 0x7f407325c4c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1681901762", "description": "tempest-description-1609192141"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:19.835448 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-31bed67c-a390-445b-885b-026d40ff6173 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:19.857591 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-31bed67c-a390-445b-885b-026d40ff6173 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:19.859541 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-31bed67c-a390-445b-885b-026d40ff6173 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:19.860863 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-31bed67c-a390-445b-885b-026d40ff6173 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1411 microversion: 2.25 time: 0.417282 Sep 10 11:42:19.864093 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 544/1123] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:42:19 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1411 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:42:19.873334 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-81fc851b-d140-40a0-bf0a-926c55218027 req-015af8e8-8ce4-4005-814e-bbdc71220fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50d20272-889d-4b72-b33d-73094c78c7b4", "name": "network-vif-plugged", "status": "completed", "tag": "4a6239c6-5b04-4a27-9109-707d2bf0a4ed"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:19.890416 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-81fc851b-d140-40a0-bf0a-926c55218027 req-015af8e8-8ce4-4005-814e-bbdc71220fe2 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:19.890892 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-81fc851b-d140-40a0-bf0a-926c55218027 req-015af8e8-8ce4-4005-814e-bbdc71220fe2 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:19.891586 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-81fc851b-d140-40a0-bf0a-926c55218027 req-015af8e8-8ce4-4005-814e-bbdc71220fe2 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:19.904653 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-81fc851b-d140-40a0-bf0a-926c55218027 req-015af8e8-8ce4-4005-814e-bbdc71220fe2 service nova] Creating event network-vif-plugged:4a6239c6-5b04-4a27-9109-707d2bf0a4ed for instance 50d20272-889d-4b72-b33d-73094c78c7b4 on n-h2-856895-1 Sep 10 11:42:19.910840 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-81fc851b-d140-40a0-bf0a-926c55218027 req-015af8e8-8ce4-4005-814e-bbdc71220fe2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044150 Sep 10 11:42:19.911952 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 545/1124] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:42:19.934641 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f74e0c33-617f-4618-9f1e-c702d8ecfe41 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:19.938587 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f74e0c33-617f-4618-9f1e-c702d8ecfe41 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] [instance: 3d45797b-af5c-4942-9ee3-d662e43a8d06] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:19.947349 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f74e0c33-617f-4618-9f1e-c702d8ecfe41 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:19.950338 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f74e0c33-617f-4618-9f1e-c702d8ecfe41 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:19.950676 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f74e0c33-617f-4618-9f1e-c702d8ecfe41 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:19.954462 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f74e0c33-617f-4618-9f1e-c702d8ecfe41 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:19.955093 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f74e0c33-617f-4618-9f1e-c702d8ecfe41 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:19.955567 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f74e0c33-617f-4618-9f1e-c702d8ecfe41 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:20.045156 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6fd4e85a-3630-4cc6-93ac-6fb87881c18a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.573877 Sep 10 11:42:20.046381 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 580/1125] 10.222.0.23 () {60 vars in 1180 bytes} [Sat Sep 10 11:42:19 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:42:20.059262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-60bce26f-608c-460b-8ecb-c414aca14696 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '.version_select at 0x7f407344e4c0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:20.394863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f74e0c33-617f-4618-9f1e-c702d8ecfe41 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8e5cb8e9514546baf5851768123fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5c910e1e6f4908b9fdaccb78b7bbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:20.411010 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f74e0c33-617f-4618-9f1e-c702d8ecfe41 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] 10.222.0.23 "GET /compute/v2.1/servers/3d45797b-af5c-4942-9ee3-d662e43a8d06" status: 200 len: 1472 microversion: 2.1 time: 0.497370 Sep 10 11:42:20.411953 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 546/1126] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:19 2022] GET /compute/v2.1/servers/3d45797b-af5c-4942-9ee3-d662e43a8d06 => generated 1472 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:20.419952 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b2cb693f-831c-4e90-85aa-f8abbb59a7e9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:20.423956 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b2cb693f-831c-4e90-85aa-f8abbb59a7e9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:20.440051 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2cb693f-831c-4e90-85aa-f8abbb59a7e9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:20.440898 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2cb693f-831c-4e90-85aa-f8abbb59a7e9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:20.441588 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2cb693f-831c-4e90-85aa-f8abbb59a7e9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:20.443967 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2cb693f-831c-4e90-85aa-f8abbb59a7e9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:20.444706 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2cb693f-831c-4e90-85aa-f8abbb59a7e9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:20.447474 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2cb693f-831c-4e90-85aa-f8abbb59a7e9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:20.766779 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-60bce26f-608c-460b-8ecb-c414aca14696 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups" status: 200 len: 1832 microversion: 2.1 time: 0.711289 Sep 10 11:42:20.768903 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 581/1127] 10.222.0.23 () {58 vars in 1158 bytes} [Sat Sep 10 11:42:20 2022] GET /compute/v2.1/os-security-groups => generated 1832 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:42:20.771680 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b2cb693f-831c-4e90-85aa-f8abbb59a7e9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:20.776753 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c3176721-a514-43da-8af6-20de8ce32615 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:20.777523 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c3176721-a514-43da-8af6-20de8ce32615 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] [instance: 3d45797b-af5c-4942-9ee3-d662e43a8d06] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:20.780410 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b2cb693f-831c-4e90-85aa-f8abbb59a7e9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1475 microversion: 2.1 time: 0.367210 Sep 10 11:42:20.783843 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 547/1128] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:20 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1475 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:20.787279 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3176721-a514-43da-8af6-20de8ce32615 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:20.788004 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3176721-a514-43da-8af6-20de8ce32615 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:20.788725 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3176721-a514-43da-8af6-20de8ce32615 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:20.790062 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3176721-a514-43da-8af6-20de8ce32615 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:20.793066 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3176721-a514-43da-8af6-20de8ce32615 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:20.793551 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4eb0cf84-c09e-4690-bea9-87f4603e4000 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '.version_select at 0x7f40735c9940>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:20.794133 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3176721-a514-43da-8af6-20de8ce32615 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:20.827664 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c3176721-a514-43da-8af6-20de8ce32615 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '6f8e5cb8e9514546baf5851768123fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5c910e1e6f4908b9fdaccb78b7bbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c3176721-a514-43da-8af6-20de8ce32615 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Request method failure captured: Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/3d45797b-af5c-4942-9ee3-d662e43a8d06/diagnostics HTTP/1.1 Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHgFLrB9Tvf_FF2nKJoNPHNG5Uwv-K_fB4rQengiJT1Kj3qOFlnX_0l37_mfL0Rmkc7ZkDYNjXCHow0hFM-asL93vMUxIeKQNrXGTUIdHDb4MBGTeHJi8tvFtv_wXWuIC6hDITZGsjC-WusUyRyz6fxcYE3nPja54UqbI8FR2JI5xEI Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 6d5c910e1e6f4908b9fdaccb78b7bbf8 Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1180383994 Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6d5c910e1e6f4908b9fdaccb78b7bbf8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6d5c910e1e6f4908b9fdaccb78b7bbf8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6d5c910e1e6f4908b9fdaccb78b7bbf8", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6d5c910e1e6f4908b9fdaccb78b7bbf8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1180383994 Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 6d5c910e1e6f4908b9fdaccb78b7bbf8 Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1180383994 Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServerDiagnosticsNegativeTest-1180383994-project Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 6f8e5cb8e9514546baf5851768123fc7 Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1180383994-project Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'server_id': '3d45797b-af5c-4942-9ee3-d662e43a8d06'} Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:42:20.830207 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:42:20.835283 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:42:20.835283 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:42:20.835283 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 11:42:20.835283 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 11:42:20.835283 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 10 11:42:20.835283 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:42:20.836923 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c3176721-a514-43da-8af6-20de8ce32615 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:42:20.837952 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c3176721-a514-43da-8af6-20de8ce32615 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] 10.222.0.23 "GET /compute/v2.1/servers/3d45797b-af5c-4942-9ee3-d662e43a8d06/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.067647 Sep 10 11:42:20.841133 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 582/1129] 10.222.0.23 () {58 vars in 1272 bytes} [Sat Sep 10 11:42:20 2022] GET /compute/v2.1/servers/3d45797b-af5c-4942-9ee3-d662e43a8d06/diagnostics => generated 117 bytes in 71 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:42:20.851277 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-60d4728a-18e2-4e9c-93a0-5c3c9f1bd417 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:20.852774 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-60d4728a-18e2-4e9c-93a0-5c3c9f1bd417 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] [instance: 3d45797b-af5c-4942-9ee3-d662e43a8d06] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:20.860953 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-60d4728a-18e2-4e9c-93a0-5c3c9f1bd417 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:20.861682 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-60d4728a-18e2-4e9c-93a0-5c3c9f1bd417 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:20.862323 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-60d4728a-18e2-4e9c-93a0-5c3c9f1bd417 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:20.863221 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-60d4728a-18e2-4e9c-93a0-5c3c9f1bd417 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:20.863841 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-60d4728a-18e2-4e9c-93a0-5c3c9f1bd417 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:20.864490 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-60d4728a-18e2-4e9c-93a0-5c3c9f1bd417 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:20.924030 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-60d4728a-18e2-4e9c-93a0-5c3c9f1bd417 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] [instance: 3d45797b-af5c-4942-9ee3-d662e43a8d06] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:42:21.023610 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:42:21.127784 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-60d4728a-18e2-4e9c-93a0-5c3c9f1bd417 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3d45797b-af5c-4942-9ee3-d662e43a8d06" status: 204 len: 0 microversion: 2.1 time: 0.280418 Sep 10 11:42:21.129901 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 583/1130] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:42:20 2022] DELETE /compute/v2.1/servers/3d45797b-af5c-4942-9ee3-d662e43a8d06 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 11:42:21.153726 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-18fe5e82-49e2-41b0-a728-481ddf54fb0e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:21.155407 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-18fe5e82-49e2-41b0-a728-481ddf54fb0e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:21.167247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-18fe5e82-49e2-41b0-a728-481ddf54fb0e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:21.168838 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-18fe5e82-49e2-41b0-a728-481ddf54fb0e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:21.170014 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-18fe5e82-49e2-41b0-a728-481ddf54fb0e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:21.171453 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-18fe5e82-49e2-41b0-a728-481ddf54fb0e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:21.197330 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-18fe5e82-49e2-41b0-a728-481ddf54fb0e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:21.198294 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-18fe5e82-49e2-41b0-a728-481ddf54fb0e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:21.236056 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4eb0cf84-c09e-4690-bea9-87f4603e4000 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/6e410a8e-44e0-4cd2-8db9-d637cc02adf1" status: 202 len: 0 microversion: 2.1 time: 0.447877 Sep 10 11:42:21.237364 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 548/1131] 10.222.0.23 () {58 vars in 1272 bytes} [Sat Sep 10 11:42:20 2022] DELETE /compute/v2.1/os-security-groups/6e410a8e-44e0-4cd2-8db9-d637cc02adf1 => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:42:21.242421 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b361401b-7b2d-4db3-b5a5-447f8ca04c05 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:21.243343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b361401b-7b2d-4db3-b5a5-447f8ca04c05 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] [instance: 3d45797b-af5c-4942-9ee3-d662e43a8d06] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:21.266862 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b361401b-7b2d-4db3-b5a5-447f8ca04c05 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:21.272956 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b361401b-7b2d-4db3-b5a5-447f8ca04c05 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:21.273401 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b361401b-7b2d-4db3-b5a5-447f8ca04c05 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:21.274143 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b361401b-7b2d-4db3-b5a5-447f8ca04c05 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:21.274606 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b361401b-7b2d-4db3-b5a5-447f8ca04c05 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:21.283517 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b361401b-7b2d-4db3-b5a5-447f8ca04c05 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:21.583394 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b361401b-7b2d-4db3-b5a5-447f8ca04c05 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8e5cb8e9514546baf5851768123fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5c910e1e6f4908b9fdaccb78b7bbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:21.595575 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b361401b-7b2d-4db3-b5a5-447f8ca04c05 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] 10.222.0.23 "GET /compute/v2.1/servers/3d45797b-af5c-4942-9ee3-d662e43a8d06" status: 200 len: 1478 microversion: 2.1 time: 0.357071 Sep 10 11:42:21.598375 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 549/1132] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:21 2022] GET /compute/v2.1/servers/3d45797b-af5c-4942-9ee3-d662e43a8d06 => generated 1478 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:21.616018 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-260adb63-77e0-4738-aea0-65ce67219034 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '.version_select at 0x7f40735c9d30>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:21.714198 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-18fe5e82-49e2-41b0-a728-481ddf54fb0e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:21.734157 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-18fe5e82-49e2-41b0-a728-481ddf54fb0e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:21.737497 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-18fe5e82-49e2-41b0-a728-481ddf54fb0e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:21.741947 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-18fe5e82-49e2-41b0-a728-481ddf54fb0e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1411 microversion: 2.25 time: 0.595804 Sep 10 11:42:21.746262 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 584/1133] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:42:21 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1411 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:42:21.750840 n-d-856895-1 devstack@n-api.service[128776]: DEBUG neutronclient.v2_0.client [None req-260adb63-77e0-4738-aea0-65ce67219034 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6e410a8e-44e0-4cd2-8db9-d637cc02adf1 does not exist", "detail": ""}} {{(pid=128776) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 11:42:21.751562 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.security_group_api [None req-260adb63-77e0-4738-aea0-65ce67219034 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Neutron security group 6e410a8e-44e0-4cd2-8db9-d637cc02adf1 not found {{(pid=128776) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 11:42:21.752144 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-260adb63-77e0-4738-aea0-65ce67219034 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] HTTP exception thrown: Security group 6e410a8e-44e0-4cd2-8db9-d637cc02adf1 does not exist Sep 10 11:42:21.752144 n-d-856895-1 devstack@n-api.service[128776]: Neutron server returns request_ids: ['req-e36cb073-a447-40f6-9c69-ae4b4359d6c6'] Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-260adb63-77e0-4738-aea0-65ce67219034 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Request method failure captured: Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/os-security-groups/6e410a8e-44e0-4cd2-8db9-d637cc02adf1 HTTP/1.1 Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHgBU0aZ9PqJpGA422fKNy27Wjo5sOCfo4CIswXFFfdPv36WiPjLOYw_neMbOsaeYNKIXkVSp0pEYCo9771BWqsl0fjBWyX6S3skhskK7a85wRu3ZuO-FXP422rQwCRC9xzOeesr0UvY-AFVf9_IuIXQit7YUH71vPa-NVExdrtG-MY Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 91ad59d8440a49c496acbede9848e944 Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ad59d8440a49c496acbede9848e944"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ad59d8440a49c496acbede9848e944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_91ad59d8440a49c496acbede9848e944", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/91ad59d8440a49c496acbede9848e944"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 91ad59d8440a49c496acbede9848e944 Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-SecurityGroupsTestJSON-1578123858-project Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 080c97b7605a40ebac26884a59ea3902 Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-SecurityGroupsTestJSON-1578123858-project Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: exception: Security group 6e410a8e-44e0-4cd2-8db9-d637cc02adf1 does not exist Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: Neutron server returns request_ids: ['req-e36cb073-a447-40f6-9c69-ae4b4359d6c6'] Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '6e410a8e-44e0-4cd2-8db9-d637cc02adf1'} Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 11:42:21.758156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6e410a8e-44e0-4cd2-8db9-d637cc02adf1 does not exist Sep 10 11:42:21.767488 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e36cb073-a447-40f6-9c69-ae4b4359d6c6'] Sep 10 11:42:21.767488 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:42:21.767488 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:42:21.767488 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:42:21.767488 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:42:21.767488 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 10 11:42:21.767488 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 10 11:42:21.767488 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 11:42:21.767488 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 11:42:21.767488 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6e410a8e-44e0-4cd2-8db9-d637cc02adf1 does not exist Sep 10 11:42:21.767488 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e36cb073-a447-40f6-9c69-ae4b4359d6c6'] Sep 10 11:42:21.767488 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:42:21.767488 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:42:21.767488 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:42:21.767488 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:42:21.767488 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:42:21.767488 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:42:21.767488 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:42:21.767488 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:42:21.767488 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:42:21.767488 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:42:21.767488 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:42:21.767488 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:42:21.767488 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 10 11:42:21.767488 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 11:42:21.767488 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6e410a8e-44e0-4cd2-8db9-d637cc02adf1 does not exist Sep 10 11:42:21.767488 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e36cb073-a447-40f6-9c69-ae4b4359d6c6'] Sep 10 11:42:21.767488 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:42:21.767488 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:42:21.767488 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:42:21.767488 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:42:21.767488 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:42:21.767488 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:42:21.767488 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:42:21.767488 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:42:21.767488 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6e410a8e-44e0-4cd2-8db9-d637cc02adf1 does not exist Sep 10 11:42:21.767488 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e36cb073-a447-40f6-9c69-ae4b4359d6c6'] Sep 10 11:42:21.767488 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:42:21.779096 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-260adb63-77e0-4738-aea0-65ce67219034 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Returning 404 to user: Security group 6e410a8e-44e0-4cd2-8db9-d637cc02adf1 does not exist Sep 10 11:42:21.779096 n-d-856895-1 devstack@n-api.service[128776]: Neutron server returns request_ids: ['req-e36cb073-a447-40f6-9c69-ae4b4359d6c6'] {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:42:21.779096 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-260adb63-77e0-4738-aea0-65ce67219034 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/6e410a8e-44e0-4cd2-8db9-d637cc02adf1" status: 404 len: 194 microversion: 2.1 time: 0.175213 Sep 10 11:42:21.780266 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 550/1134] 10.222.0.23 () {58 vars in 1269 bytes} [Sat Sep 10 11:42:21 2022] GET /compute/v2.1/os-security-groups/6e410a8e-44e0-4cd2-8db9-d637cc02adf1 => generated 194 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:42:21.784670 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-be7b0f7c-18ac-4734-ab16-72923b71715d tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '.version_select at 0x7f4073102550>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:21.812332 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-27c027d0-fcea-4bf7-bf4e-56a41be9bfc9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:21.813490 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-27c027d0-fcea-4bf7-bf4e-56a41be9bfc9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:21.827574 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27c027d0-fcea-4bf7-bf4e-56a41be9bfc9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:21.828417 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27c027d0-fcea-4bf7-bf4e-56a41be9bfc9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:21.828864 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27c027d0-fcea-4bf7-bf4e-56a41be9bfc9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:21.833370 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27c027d0-fcea-4bf7-bf4e-56a41be9bfc9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:21.834092 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27c027d0-fcea-4bf7-bf4e-56a41be9bfc9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:21.834549 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27c027d0-fcea-4bf7-bf4e-56a41be9bfc9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:22.466000 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-be7b0f7c-18ac-4734-ab16-72923b71715d tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/30b77978-2489-4c33-ab03-c7be19f1d46c" status: 202 len: 0 microversion: 2.1 time: 0.685358 Sep 10 11:42:22.466596 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 585/1135] 10.222.0.23 () {58 vars in 1272 bytes} [Sat Sep 10 11:42:21 2022] DELETE /compute/v2.1/os-security-groups/30b77978-2489-4c33-ab03-c7be19f1d46c => generated 0 bytes in 687 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:42:22.475556 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7301486d-bd22-49ee-96b2-a68427d8025c tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '.version_select at 0x7f40731c9a60>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:22.537185 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-27c027d0-fcea-4bf7-bf4e-56a41be9bfc9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:22.547099 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-27c027d0-fcea-4bf7-bf4e-56a41be9bfc9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1475 microversion: 2.1 time: 0.739680 Sep 10 11:42:22.552277 n-d-856895-1 devstack@n-api.service[128777]: DEBUG neutronclient.v2_0.client [None req-7301486d-bd22-49ee-96b2-a68427d8025c tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 30b77978-2489-4c33-ab03-c7be19f1d46c does not exist", "detail": ""}} {{(pid=128777) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 11:42:22.553247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.security_group_api [None req-7301486d-bd22-49ee-96b2-a68427d8025c tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Neutron security group 30b77978-2489-4c33-ab03-c7be19f1d46c not found {{(pid=128777) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 11:42:22.553604 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-7301486d-bd22-49ee-96b2-a68427d8025c tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] HTTP exception thrown: Security group 30b77978-2489-4c33-ab03-c7be19f1d46c does not exist Sep 10 11:42:22.553604 n-d-856895-1 devstack@n-api.service[128777]: Neutron server returns request_ids: ['req-a3a8bff5-a316-4dcb-a8ab-f302b46d589a'] Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7301486d-bd22-49ee-96b2-a68427d8025c tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Request method failure captured: Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/os-security-groups/30b77978-2489-4c33-ab03-c7be19f1d46c HTTP/1.1 Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHgBU0aZ9PqJpGA422fKNy27Wjo5sOCfo4CIswXFFfdPv36WiPjLOYw_neMbOsaeYNKIXkVSp0pEYCo9771BWqsl0fjBWyX6S3skhskK7a85wRu3ZuO-FXP422rQwCRC9xzOeesr0UvY-AFVf9_IuIXQit7YUH71vPa-NVExdrtG-MY Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 91ad59d8440a49c496acbede9848e944 Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ad59d8440a49c496acbede9848e944"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ad59d8440a49c496acbede9848e944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_91ad59d8440a49c496acbede9848e944", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/91ad59d8440a49c496acbede9848e944"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 91ad59d8440a49c496acbede9848e944 Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-SecurityGroupsTestJSON-1578123858-project Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 080c97b7605a40ebac26884a59ea3902 Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-SecurityGroupsTestJSON-1578123858-project Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: exception: Security group 30b77978-2489-4c33-ab03-c7be19f1d46c does not exist Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: Neutron server returns request_ids: ['req-a3a8bff5-a316-4dcb-a8ab-f302b46d589a'] Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '30b77978-2489-4c33-ab03-c7be19f1d46c'} Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 11:42:22.555688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 30b77978-2489-4c33-ab03-c7be19f1d46c does not exist Sep 10 11:42:22.561801 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a3a8bff5-a316-4dcb-a8ab-f302b46d589a'] Sep 10 11:42:22.561801 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:42:22.561801 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:42:22.561801 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:42:22.561801 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:42:22.561801 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 10 11:42:22.561801 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 10 11:42:22.561801 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 11:42:22.561801 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 11:42:22.561801 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 30b77978-2489-4c33-ab03-c7be19f1d46c does not exist Sep 10 11:42:22.561801 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a3a8bff5-a316-4dcb-a8ab-f302b46d589a'] Sep 10 11:42:22.561801 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:42:22.561801 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:42:22.561801 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:42:22.561801 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:42:22.561801 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:42:22.561801 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:42:22.561801 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:42:22.561801 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:42:22.561801 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:42:22.561801 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:42:22.561801 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:42:22.561801 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:42:22.561801 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 10 11:42:22.561801 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 11:42:22.561801 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 30b77978-2489-4c33-ab03-c7be19f1d46c does not exist Sep 10 11:42:22.561801 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a3a8bff5-a316-4dcb-a8ab-f302b46d589a'] Sep 10 11:42:22.561801 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:42:22.561801 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:42:22.561801 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:42:22.561801 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:42:22.561801 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:42:22.561801 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:42:22.561801 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:42:22.561801 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:42:22.561801 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 30b77978-2489-4c33-ab03-c7be19f1d46c does not exist Sep 10 11:42:22.561801 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a3a8bff5-a316-4dcb-a8ab-f302b46d589a'] Sep 10 11:42:22.561801 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:42:22.561801 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7301486d-bd22-49ee-96b2-a68427d8025c tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Returning 404 to user: Security group 30b77978-2489-4c33-ab03-c7be19f1d46c does not exist Sep 10 11:42:22.561801 n-d-856895-1 devstack@n-api.service[128777]: Neutron server returns request_ids: ['req-a3a8bff5-a316-4dcb-a8ab-f302b46d589a'] {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:42:22.561801 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7301486d-bd22-49ee-96b2-a68427d8025c tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/30b77978-2489-4c33-ab03-c7be19f1d46c" status: 404 len: 194 microversion: 2.1 time: 0.087418 Sep 10 11:42:22.564582 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 551/1136] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:21 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1475 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:42:22.568917 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 586/1137] 10.222.0.23 () {58 vars in 1269 bytes} [Sat Sep 10 11:42:22 2022] GET /compute/v2.1/os-security-groups/30b77978-2489-4c33-ab03-c7be19f1d46c => generated 194 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 11:42:22.578250 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ab730f23-3a55-479f-95a3-53348feb7222 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '.version_select at 0x7f40735c9ca0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:22.630148 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f6538f01-fe40-41b9-8699-390b241fafee tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:22.630809 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f6538f01-fe40-41b9-8699-390b241fafee tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] [instance: 3d45797b-af5c-4942-9ee3-d662e43a8d06] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:22.651893 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f6538f01-fe40-41b9-8699-390b241fafee tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:22.652610 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f6538f01-fe40-41b9-8699-390b241fafee tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:22.654380 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f6538f01-fe40-41b9-8699-390b241fafee tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:22.655325 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f6538f01-fe40-41b9-8699-390b241fafee tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:22.659399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f6538f01-fe40-41b9-8699-390b241fafee tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:22.662082 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f6538f01-fe40-41b9-8699-390b241fafee tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:23.008226 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f6538f01-fe40-41b9-8699-390b241fafee tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8e5cb8e9514546baf5851768123fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5c910e1e6f4908b9fdaccb78b7bbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:23.018513 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f6538f01-fe40-41b9-8699-390b241fafee tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] 10.222.0.23 "GET /compute/v2.1/servers/3d45797b-af5c-4942-9ee3-d662e43a8d06" status: 200 len: 1478 microversion: 2.1 time: 0.393434 Sep 10 11:42:23.020162 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 587/1138] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:22 2022] GET /compute/v2.1/servers/3d45797b-af5c-4942-9ee3-d662e43a8d06 => generated 1478 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:23.027359 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f75923fd-fbda-4089-896b-e6b29a23ca6f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:23.028224 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f75923fd-fbda-4089-896b-e6b29a23ca6f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:23.035338 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f75923fd-fbda-4089-896b-e6b29a23ca6f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:23.036959 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f75923fd-fbda-4089-896b-e6b29a23ca6f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:23.037723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f75923fd-fbda-4089-896b-e6b29a23ca6f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:23.038980 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f75923fd-fbda-4089-896b-e6b29a23ca6f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:23.039485 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f75923fd-fbda-4089-896b-e6b29a23ca6f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:23.039912 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f75923fd-fbda-4089-896b-e6b29a23ca6f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:23.153737 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ab730f23-3a55-479f-95a3-53348feb7222 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/7f27ae31-e722-4e46-b08c-1be36ad37b02" status: 202 len: 0 microversion: 2.1 time: 0.580806 Sep 10 11:42:23.155266 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 552/1139] 10.222.0.23 () {58 vars in 1272 bytes} [Sat Sep 10 11:42:22 2022] DELETE /compute/v2.1/os-security-groups/7f27ae31-e722-4e46-b08c-1be36ad37b02 => generated 0 bytes in 583 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 11:42:23.165286 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bd70bac9-8342-4d92-9ee0-6e92a7ffc10b tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '.version_select at 0x7f40735c0b80>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:23.216330 n-d-856895-1 devstack@n-api.service[128776]: DEBUG neutronclient.v2_0.client [None req-bd70bac9-8342-4d92-9ee0-6e92a7ffc10b tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7f27ae31-e722-4e46-b08c-1be36ad37b02 does not exist", "detail": ""}} {{(pid=128776) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 11:42:23.217079 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.security_group_api [None req-bd70bac9-8342-4d92-9ee0-6e92a7ffc10b tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Neutron security group 7f27ae31-e722-4e46-b08c-1be36ad37b02 not found {{(pid=128776) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 11:42:23.217872 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-bd70bac9-8342-4d92-9ee0-6e92a7ffc10b tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] HTTP exception thrown: Security group 7f27ae31-e722-4e46-b08c-1be36ad37b02 does not exist Sep 10 11:42:23.217872 n-d-856895-1 devstack@n-api.service[128776]: Neutron server returns request_ids: ['req-b1700105-61fb-4142-a741-c87e9621c25a'] Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bd70bac9-8342-4d92-9ee0-6e92a7ffc10b tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Request method failure captured: Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/os-security-groups/7f27ae31-e722-4e46-b08c-1be36ad37b02 HTTP/1.1 Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHgBU0aZ9PqJpGA422fKNy27Wjo5sOCfo4CIswXFFfdPv36WiPjLOYw_neMbOsaeYNKIXkVSp0pEYCo9771BWqsl0fjBWyX6S3skhskK7a85wRu3ZuO-FXP422rQwCRC9xzOeesr0UvY-AFVf9_IuIXQit7YUH71vPa-NVExdrtG-MY Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 91ad59d8440a49c496acbede9848e944 Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ad59d8440a49c496acbede9848e944"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ad59d8440a49c496acbede9848e944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_91ad59d8440a49c496acbede9848e944", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/91ad59d8440a49c496acbede9848e944"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 91ad59d8440a49c496acbede9848e944 Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-SecurityGroupsTestJSON-1578123858-project Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 080c97b7605a40ebac26884a59ea3902 Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-SecurityGroupsTestJSON-1578123858-project Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: exception: Security group 7f27ae31-e722-4e46-b08c-1be36ad37b02 does not exist Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: Neutron server returns request_ids: ['req-b1700105-61fb-4142-a741-c87e9621c25a'] Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '7f27ae31-e722-4e46-b08c-1be36ad37b02'} Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 11:42:23.221385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7f27ae31-e722-4e46-b08c-1be36ad37b02 does not exist Sep 10 11:42:23.231557 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1700105-61fb-4142-a741-c87e9621c25a'] Sep 10 11:42:23.231557 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:42:23.231557 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:42:23.231557 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:42:23.231557 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:42:23.231557 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 10 11:42:23.231557 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 10 11:42:23.231557 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 11:42:23.231557 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 11:42:23.231557 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7f27ae31-e722-4e46-b08c-1be36ad37b02 does not exist Sep 10 11:42:23.231557 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1700105-61fb-4142-a741-c87e9621c25a'] Sep 10 11:42:23.231557 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:42:23.231557 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:42:23.231557 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:42:23.231557 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:42:23.231557 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:42:23.231557 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:42:23.231557 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:42:23.231557 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:42:23.231557 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:42:23.231557 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:42:23.231557 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:42:23.231557 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:42:23.231557 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 10 11:42:23.231557 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 11:42:23.231557 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7f27ae31-e722-4e46-b08c-1be36ad37b02 does not exist Sep 10 11:42:23.231557 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1700105-61fb-4142-a741-c87e9621c25a'] Sep 10 11:42:23.231557 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:42:23.231557 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:42:23.231557 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:42:23.231557 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:42:23.231557 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:42:23.231557 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:42:23.231557 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:42:23.231557 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:42:23.231557 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7f27ae31-e722-4e46-b08c-1be36ad37b02 does not exist Sep 10 11:42:23.231557 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1700105-61fb-4142-a741-c87e9621c25a'] Sep 10 11:42:23.231557 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:42:23.231557 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bd70bac9-8342-4d92-9ee0-6e92a7ffc10b tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Returning 404 to user: Security group 7f27ae31-e722-4e46-b08c-1be36ad37b02 does not exist Sep 10 11:42:23.231557 n-d-856895-1 devstack@n-api.service[128776]: Neutron server returns request_ids: ['req-b1700105-61fb-4142-a741-c87e9621c25a'] {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:42:23.231557 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bd70bac9-8342-4d92-9ee0-6e92a7ffc10b tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/7f27ae31-e722-4e46-b08c-1be36ad37b02" status: 404 len: 194 microversion: 2.1 time: 0.062742 Sep 10 11:42:23.231557 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 553/1140] 10.222.0.23 () {58 vars in 1269 bytes} [Sat Sep 10 11:42:23 2022] GET /compute/v2.1/os-security-groups/7f27ae31-e722-4e46-b08c-1be36ad37b02 => generated 194 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:42:23.241654 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f5d5cf2e-43cb-4e21-b19b-963cc1d4d9ab tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '.version_select at 0x7f40735c98b0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:23.263654 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f75923fd-fbda-4089-896b-e6b29a23ca6f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:23.274435 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f75923fd-fbda-4089-896b-e6b29a23ca6f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:23.276615 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f75923fd-fbda-4089-896b-e6b29a23ca6f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:23.278406 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f75923fd-fbda-4089-896b-e6b29a23ca6f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1606 microversion: 2.25 time: 0.256305 Sep 10 11:42:23.279509 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 588/1141] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:42:23 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1606 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:42:23.309144 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ddf8d928-fd81-4224-854e-1728574d616a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:23.309901 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ddf8d928-fd81-4224-854e-1728574d616a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:23.316334 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ddf8d928-fd81-4224-854e-1728574d616a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:23.317004 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ddf8d928-fd81-4224-854e-1728574d616a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:23.317648 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ddf8d928-fd81-4224-854e-1728574d616a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:23.318564 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ddf8d928-fd81-4224-854e-1728574d616a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:23.319035 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ddf8d928-fd81-4224-854e-1728574d616a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:23.319514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ddf8d928-fd81-4224-854e-1728574d616a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:23.431405 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ddf8d928-fd81-4224-854e-1728574d616a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.126421 Sep 10 11:42:23.432548 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 589/1142] 10.222.0.23 () {60 vars in 1316 bytes} [Sat Sep 10 11:42:23 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4/os-interface => generated 284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 10 11:42:23.590887 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e23c692f-1a2d-434d-8bbc-01253fc0a638 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:23.591860 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e23c692f-1a2d-434d-8bbc-01253fc0a638 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:23.598670 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e23c692f-1a2d-434d-8bbc-01253fc0a638 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:23.599487 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e23c692f-1a2d-434d-8bbc-01253fc0a638 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:23.600170 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e23c692f-1a2d-434d-8bbc-01253fc0a638 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:23.601137 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e23c692f-1a2d-434d-8bbc-01253fc0a638 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:23.601818 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e23c692f-1a2d-434d-8bbc-01253fc0a638 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:23.602426 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e23c692f-1a2d-434d-8bbc-01253fc0a638 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:24.089844 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f5d5cf2e-43cb-4e21-b19b-963cc1d4d9ab tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.861769 Sep 10 11:42:24.090633 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 554/1143] 10.222.0.23 () {58 vars in 1158 bytes} [Sat Sep 10 11:42:23 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:24.095340 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-f33fd260-9e0a-41cf-aa6f-324af202e017 req-dac16231-645d-492a-a4ec-d8a22f2e7ea4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d45797b-af5c-4942-9ee3-d662e43a8d06", "name": "network-vif-deleted", "tag": "dfb5de02-77c3-4135-8a4d-77c9a2ac1fa6"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:24.111383 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:42:24.113472 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f33fd260-9e0a-41cf-aa6f-324af202e017 req-dac16231-645d-492a-a4ec-d8a22f2e7ea4 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:24.114148 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f33fd260-9e0a-41cf-aa6f-324af202e017 req-dac16231-645d-492a-a4ec-d8a22f2e7ea4 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:24.114746 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f33fd260-9e0a-41cf-aa6f-324af202e017 req-dac16231-645d-492a-a4ec-d8a22f2e7ea4 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:24.145983 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-f33fd260-9e0a-41cf-aa6f-324af202e017 req-dac16231-645d-492a-a4ec-d8a22f2e7ea4 service nova] Creating event network-vif-deleted:dfb5de02-77c3-4135-8a4d-77c9a2ac1fa6 for instance 3d45797b-af5c-4942-9ee3-d662e43a8d06 on n-h1-856895-1 Sep 10 11:42:24.160874 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-f33fd260-9e0a-41cf-aa6f-324af202e017 req-dac16231-645d-492a-a4ec-d8a22f2e7ea4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068626 Sep 10 11:42:24.162453 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 555/1144] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:42:24.187658 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-551065d2-3a82-47b4-8813-704b9636d8a9 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:24.189282 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-551065d2-3a82-47b4-8813-704b9636d8a9 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] [instance: 3d45797b-af5c-4942-9ee3-d662e43a8d06] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:24.196279 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-551065d2-3a82-47b4-8813-704b9636d8a9 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:24.197045 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-551065d2-3a82-47b4-8813-704b9636d8a9 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:24.197952 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-551065d2-3a82-47b4-8813-704b9636d8a9 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:24.199965 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-551065d2-3a82-47b4-8813-704b9636d8a9 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:24.207903 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-551065d2-3a82-47b4-8813-704b9636d8a9 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:24.209062 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-551065d2-3a82-47b4-8813-704b9636d8a9 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:24.293620 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-551065d2-3a82-47b4-8813-704b9636d8a9 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:24.294304 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-551065d2-3a82-47b4-8813-704b9636d8a9 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:24.294848 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-551065d2-3a82-47b4-8813-704b9636d8a9 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:24.295475 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-551065d2-3a82-47b4-8813-704b9636d8a9 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lazy-loading 'fault' on Instance uuid 3d45797b-af5c-4942-9ee3-d662e43a8d06 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:42:24.440456 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e23c692f-1a2d-434d-8bbc-01253fc0a638 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:24.465197 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e23c692f-1a2d-434d-8bbc-01253fc0a638 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1475 microversion: 2.1 time: 0.874828 Sep 10 11:42:24.467711 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 590/1145] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:23 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1475 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:24.486194 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-aca08a44-c1ab-4033-8f13-abccffc8ed9d tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Action: 'create', calling method: .version_select at 0x7f4073114790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-6062969", "description": "tempest-description-1034684972"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:24.617193 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-551065d2-3a82-47b4-8813-704b9636d8a9 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f8e5cb8e9514546baf5851768123fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5c910e1e6f4908b9fdaccb78b7bbf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:24.626791 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-551065d2-3a82-47b4-8813-704b9636d8a9 tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] 10.222.0.23 "GET /compute/v2.1/servers/3d45797b-af5c-4942-9ee3-d662e43a8d06" status: 200 len: 1312 microversion: 2.1 time: 0.462831 Sep 10 11:42:24.630428 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 556/1146] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:24 2022] GET /compute/v2.1/servers/3d45797b-af5c-4942-9ee3-d662e43a8d06 => generated 1312 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:25.071627 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-aca08a44-c1ab-4033-8f13-abccffc8ed9d tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.602504 Sep 10 11:42:25.072281 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 591/1147] 10.222.0.23 () {60 vars in 1180 bytes} [Sat Sep 10 11:42:24 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:42:25.089271 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b3940730-4e6d-4cd3-9d63-d5bf9d78a245 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Action: 'create', calling method: .version_select at 0x7f40735c99d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-866133115", "description": "tempest-description-959272719"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:25.489131 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7551471a-b4ec-46fc-b99e-799a56b587a0 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:25.490381 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7551471a-b4ec-46fc-b99e-799a56b587a0 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:25.505164 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7551471a-b4ec-46fc-b99e-799a56b587a0 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:25.505939 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7551471a-b4ec-46fc-b99e-799a56b587a0 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:25.508726 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7551471a-b4ec-46fc-b99e-799a56b587a0 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:25.509668 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7551471a-b4ec-46fc-b99e-799a56b587a0 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:25.510207 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7551471a-b4ec-46fc-b99e-799a56b587a0 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:25.510645 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7551471a-b4ec-46fc-b99e-799a56b587a0 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:25.776373 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b3940730-4e6d-4cd3-9d63-d5bf9d78a245 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.691276 Sep 10 11:42:25.776938 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 557/1148] 10.222.0.23 () {60 vars in 1180 bytes} [Sat Sep 10 11:42:25 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:42:25.780506 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7551471a-b4ec-46fc-b99e-799a56b587a0 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:25.782563 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0f4a6645-9b52-4d7d-9249-04b44060693a tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:25.783391 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0f4a6645-9b52-4d7d-9249-04b44060693a tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] [instance: 3d45797b-af5c-4942-9ee3-d662e43a8d06] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:25.789229 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7551471a-b4ec-46fc-b99e-799a56b587a0 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1475 microversion: 2.1 time: 0.304175 Sep 10 11:42:25.793758 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 592/1149] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:25 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1475 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:25.819932 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f4a6645-9b52-4d7d-9249-04b44060693a tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:25.820431 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f4a6645-9b52-4d7d-9249-04b44060693a tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:25.820868 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f4a6645-9b52-4d7d-9249-04b44060693a tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:25.821579 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f4a6645-9b52-4d7d-9249-04b44060693a tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:25.822033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f4a6645-9b52-4d7d-9249-04b44060693a tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:25.822482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f4a6645-9b52-4d7d-9249-04b44060693a tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:25.858604 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-0f4a6645-9b52-4d7d-9249-04b44060693a tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] HTTP exception thrown: Instance 3d45797b-af5c-4942-9ee3-d662e43a8d06 could not be found. Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0f4a6645-9b52-4d7d-9249-04b44060693a tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Request method failure captured: Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/3d45797b-af5c-4942-9ee3-d662e43a8d06 HTTP/1.1 Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHgFLrB9Tvf_FF2nKJoNPHNG5Uwv-K_fB4rQengiJT1Kj3qOFlnX_0l37_mfL0Rmkc7ZkDYNjXCHow0hFM-asL93vMUxIeKQNrXGTUIdHDb4MBGTeHJi8tvFtv_wXWuIC6hDITZGsjC-WusUyRyz6fxcYE3nPja54UqbI8FR2JI5xEI Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 6d5c910e1e6f4908b9fdaccb78b7bbf8 Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1180383994 Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6d5c910e1e6f4908b9fdaccb78b7bbf8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6d5c910e1e6f4908b9fdaccb78b7bbf8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6d5c910e1e6f4908b9fdaccb78b7bbf8", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6d5c910e1e6f4908b9fdaccb78b7bbf8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1180383994 Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 6d5c910e1e6f4908b9fdaccb78b7bbf8 Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1180383994 Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServerDiagnosticsNegativeTest-1180383994-project Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 6f8e5cb8e9514546baf5851768123fc7 Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1180383994-project Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 3d45797b-af5c-4942-9ee3-d662e43a8d06 could not be found. Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '3d45797b-af5c-4942-9ee3-d662e43a8d06'} Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d45797b-af5c-4942-9ee3-d662e43a8d06 could not be found. Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d45797b-af5c-4942-9ee3-d662e43a8d06 could not be found. Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:42:25.862537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:42:25.867127 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:42:25.867127 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:42:25.867127 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:42:25.867127 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:42:25.867127 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:42:25.867127 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:42:25.867127 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d45797b-af5c-4942-9ee3-d662e43a8d06 could not be found. Sep 10 11:42:25.867127 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:42:25.870717 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0f4a6645-9b52-4d7d-9249-04b44060693a tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] Returning 404 to user: Instance 3d45797b-af5c-4942-9ee3-d662e43a8d06 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:42:25.875007 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0f4a6645-9b52-4d7d-9249-04b44060693a tempest-ServerDiagnosticsNegativeTest-1180383994 tempest-ServerDiagnosticsNegativeTest-1180383994-project] 10.222.0.23 "GET /compute/v2.1/servers/3d45797b-af5c-4942-9ee3-d662e43a8d06" status: 404 len: 111 microversion: 2.1 time: 0.096191 Sep 10 11:42:25.876261 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 558/1150] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:25 2022] GET /compute/v2.1/servers/3d45797b-af5c-4942-9ee3-d662e43a8d06 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:42:25.964024 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-019ae386-005a-4964-b5c0-9db8dc0bc2a4 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-662334954", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "28b67fe2-5503-41de-b65a-9b3158a1792c"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:26.058500 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-68e781e7-941c-475f-a311-65f1172d1b7e req-991eb1f1-6f3c-49b4-99ea-1855c4bec144 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50d20272-889d-4b72-b33d-73094c78c7b4", "tag": "4a6239c6-5b04-4a27-9109-707d2bf0a4ed"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:26.070958 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-019ae386-005a-4964-b5c0-9db8dc0bc2a4 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] validate_networks() for [('28b67fe2-5503-41de-b65a-9b3158a1792c', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:42:26.074553 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-68e781e7-941c-475f-a311-65f1172d1b7e req-991eb1f1-6f3c-49b4-99ea-1855c4bec144 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:26.075311 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-68e781e7-941c-475f-a311-65f1172d1b7e req-991eb1f1-6f3c-49b4-99ea-1855c4bec144 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:26.082843 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-68e781e7-941c-475f-a311-65f1172d1b7e req-991eb1f1-6f3c-49b4-99ea-1855c4bec144 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:26.111081 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-68e781e7-941c-475f-a311-65f1172d1b7e req-991eb1f1-6f3c-49b4-99ea-1855c4bec144 service nova] Creating event network-changed:4a6239c6-5b04-4a27-9109-707d2bf0a4ed for instance 50d20272-889d-4b72-b33d-73094c78c7b4 on n-h2-856895-1 Sep 10 11:42:26.131276 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-68e781e7-941c-475f-a311-65f1172d1b7e req-991eb1f1-6f3c-49b4-99ea-1855c4bec144 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079483 Sep 10 11:42:26.133184 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 559/1151] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:42:26.822386 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a6fa787d-0a08-4004-956c-4163b32cad30 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:26.824666 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a6fa787d-0a08-4004-956c-4163b32cad30 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:26.845970 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6fa787d-0a08-4004-956c-4163b32cad30 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:26.847227 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6fa787d-0a08-4004-956c-4163b32cad30 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:26.848117 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6fa787d-0a08-4004-956c-4163b32cad30 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:26.849247 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6fa787d-0a08-4004-956c-4163b32cad30 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:26.849882 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6fa787d-0a08-4004-956c-4163b32cad30 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:26.850479 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6fa787d-0a08-4004-956c-4163b32cad30 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:27.523646 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a6fa787d-0a08-4004-956c-4163b32cad30 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:27.535078 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a6fa787d-0a08-4004-956c-4163b32cad30 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1475 microversion: 2.1 time: 0.716753 Sep 10 11:42:27.549596 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 560/1152] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:26 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1475 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:42:27.737400 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-019ae386-005a-4964-b5c0-9db8dc0bc2a4 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:42:27.737900 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-019ae386-005a-4964-b5c0-9db8dc0bc2a4 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:42:27.738238 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-019ae386-005a-4964-b5c0-9db8dc0bc2a4 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:42:27.738985 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-019ae386-005a-4964-b5c0-9db8dc0bc2a4 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:42:27.739598 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-019ae386-005a-4964-b5c0-9db8dc0bc2a4 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:42:27.771697 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-019ae386-005a-4964-b5c0-9db8dc0bc2a4 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:27.772367 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-019ae386-005a-4964-b5c0-9db8dc0bc2a4 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:27.773799 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-019ae386-005a-4964-b5c0-9db8dc0bc2a4 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:27.777199 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-019ae386-005a-4964-b5c0-9db8dc0bc2a4 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:27.779067 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-019ae386-005a-4964-b5c0-9db8dc0bc2a4 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:27.779544 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-019ae386-005a-4964-b5c0-9db8dc0bc2a4 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:27.819104 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-019ae386-005a-4964-b5c0-9db8dc0bc2a4 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Getting quotas for project 91ad59d8440a49c496acbede9848e944. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:42:27.825619 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-019ae386-005a-4964-b5c0-9db8dc0bc2a4 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Getting quotas for user 080c97b7605a40ebac26884a59ea3902 and project 91ad59d8440a49c496acbede9848e944. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:42:27.840306 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-019ae386-005a-4964-b5c0-9db8dc0bc2a4 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:42:27.843951 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-019ae386-005a-4964-b5c0-9db8dc0bc2a4 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:42:27.940458 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-019ae386-005a-4964-b5c0-9db8dc0bc2a4 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.988889 Sep 10 11:42:27.941132 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 593/1153] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:42:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:42:27.953456 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fa4517cb-9ccc-4928-8833-3fc1a5117a6f tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:27.955005 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fa4517cb-9ccc-4928-8833-3fc1a5117a6f tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:28.570799 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fa4517cb-9ccc-4928-8833-3fc1a5117a6f tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c97b7605a40ebac26884a59ea3902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ad59d8440a49c496acbede9848e944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:28.573608 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-033bc48b-23aa-4e60-b978-76260b8954fe tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:28.574234 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-033bc48b-23aa-4e60-b978-76260b8954fe tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:28.584337 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-033bc48b-23aa-4e60-b978-76260b8954fe tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:28.586617 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fa4517cb-9ccc-4928-8833-3fc1a5117a6f tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b" status: 200 len: 1215 microversion: 2.1 time: 0.635183 Sep 10 11:42:28.590158 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 561/1154] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:27 2022] GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b => generated 1215 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:42:28.594367 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-033bc48b-23aa-4e60-b978-76260b8954fe tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:28.595435 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-033bc48b-23aa-4e60-b978-76260b8954fe tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:28.597365 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-033bc48b-23aa-4e60-b978-76260b8954fe tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:28.599719 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-033bc48b-23aa-4e60-b978-76260b8954fe tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:28.607940 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-033bc48b-23aa-4e60-b978-76260b8954fe tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:29.010642 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-033bc48b-23aa-4e60-b978-76260b8954fe tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:29.019624 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-033bc48b-23aa-4e60-b978-76260b8954fe tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1475 microversion: 2.1 time: 0.449916 Sep 10 11:42:29.020967 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 594/1155] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:28 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1475 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:29.623706 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-36dd1bb7-9e62-4d13-a2fb-38f3657a6ae1 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:29.625133 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-36dd1bb7-9e62-4d13-a2fb-38f3657a6ae1 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:29.643312 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-36dd1bb7-9e62-4d13-a2fb-38f3657a6ae1 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:29.644564 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-36dd1bb7-9e62-4d13-a2fb-38f3657a6ae1 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:29.645237 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-36dd1bb7-9e62-4d13-a2fb-38f3657a6ae1 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:29.647084 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-36dd1bb7-9e62-4d13-a2fb-38f3657a6ae1 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:29.647952 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-36dd1bb7-9e62-4d13-a2fb-38f3657a6ae1 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:29.648556 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-36dd1bb7-9e62-4d13-a2fb-38f3657a6ae1 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:29.858532 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-36dd1bb7-9e62-4d13-a2fb-38f3657a6ae1 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c97b7605a40ebac26884a59ea3902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ad59d8440a49c496acbede9848e944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:29.905457 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-36dd1bb7-9e62-4d13-a2fb-38f3657a6ae1 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b" status: 200 len: 1267 microversion: 2.1 time: 0.289579 Sep 10 11:42:29.908509 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 562/1156] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:29 2022] GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b => generated 1267 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:30.054569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3481c1fd-c35a-466e-bd41-529df85f1f69 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:30.056529 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3481c1fd-c35a-466e-bd41-529df85f1f69 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:30.099993 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3481c1fd-c35a-466e-bd41-529df85f1f69 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:30.100547 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3481c1fd-c35a-466e-bd41-529df85f1f69 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:30.101001 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3481c1fd-c35a-466e-bd41-529df85f1f69 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:30.101742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3481c1fd-c35a-466e-bd41-529df85f1f69 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:30.111407 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3481c1fd-c35a-466e-bd41-529df85f1f69 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:30.111971 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3481c1fd-c35a-466e-bd41-529df85f1f69 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:30.177486 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-55d27a07-d96d-4ea2-9008-cf3bcafab142 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:30.178255 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-55d27a07-d96d-4ea2-9008-cf3bcafab142 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:30.188755 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55d27a07-d96d-4ea2-9008-cf3bcafab142 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:30.190824 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55d27a07-d96d-4ea2-9008-cf3bcafab142 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:30.191337 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55d27a07-d96d-4ea2-9008-cf3bcafab142 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:30.192073 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55d27a07-d96d-4ea2-9008-cf3bcafab142 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:30.192542 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55d27a07-d96d-4ea2-9008-cf3bcafab142 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:30.192973 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55d27a07-d96d-4ea2-9008-cf3bcafab142 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:30.521873 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3481c1fd-c35a-466e-bd41-529df85f1f69 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:30.531787 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-55d27a07-d96d-4ea2-9008-cf3bcafab142 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1860 microversion: 2.1 time: 0.355234 Sep 10 11:42:30.534872 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 563/1157] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:30 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1860 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:42:30.542779 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3481c1fd-c35a-466e-bd41-529df85f1f69 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1475 microversion: 2.1 time: 0.498835 Sep 10 11:42:30.543549 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 595/1158] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:30 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1475 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:30.566323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-715a4950-2d35-4ca8-b957-7bf6903f7c44 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-856895-1", "block_migration": true, "disk_over_commit": false}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:30.571980 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-715a4950-2d35-4ca8-b957-7bf6903f7c44 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:30.587046 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-715a4950-2d35-4ca8-b957-7bf6903f7c44 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:30.587583 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-715a4950-2d35-4ca8-b957-7bf6903f7c44 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:30.588721 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-715a4950-2d35-4ca8-b957-7bf6903f7c44 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:30.591138 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-715a4950-2d35-4ca8-b957-7bf6903f7c44 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:30.591650 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-715a4950-2d35-4ca8-b957-7bf6903f7c44 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:30.592107 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-715a4950-2d35-4ca8-b957-7bf6903f7c44 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:30.658605 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-715a4950-2d35-4ca8-b957-7bf6903f7c44 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lazy-loading 'flavor' on Instance uuid 53e36757-9924-4d03-a8c0-fe52a166ffc1 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:42:30.686738 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-715a4950-2d35-4ca8-b957-7bf6903f7c44 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Going to try to live migrate instance to n-h2-856895-1 {{(pid=128776) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 10 11:42:30.830734 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:42:30.935004 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1d46cddc-f1a7-4bac-ba0b-62d72203cea6 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:30.935772 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1d46cddc-f1a7-4bac-ba0b-62d72203cea6 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:30.946306 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d46cddc-f1a7-4bac-ba0b-62d72203cea6 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:30.946806 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d46cddc-f1a7-4bac-ba0b-62d72203cea6 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:30.947321 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d46cddc-f1a7-4bac-ba0b-62d72203cea6 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:30.953095 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d46cddc-f1a7-4bac-ba0b-62d72203cea6 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:30.955382 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d46cddc-f1a7-4bac-ba0b-62d72203cea6 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:30.955858 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d46cddc-f1a7-4bac-ba0b-62d72203cea6 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:31.152828 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1d46cddc-f1a7-4bac-ba0b-62d72203cea6 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c97b7605a40ebac26884a59ea3902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ad59d8440a49c496acbede9848e944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:31.164814 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1d46cddc-f1a7-4bac-ba0b-62d72203cea6 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b" status: 200 len: 1273 microversion: 2.1 time: 0.233458 Sep 10 11:42:31.165848 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 596/1159] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:30 2022] GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b => generated 1273 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:31.571064 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-17288e12-4533-4498-8ff1-811abbf60c0e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:31.571723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-17288e12-4533-4498-8ff1-811abbf60c0e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:31.596196 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17288e12-4533-4498-8ff1-811abbf60c0e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:31.596694 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17288e12-4533-4498-8ff1-811abbf60c0e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:31.597139 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17288e12-4533-4498-8ff1-811abbf60c0e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:31.597849 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17288e12-4533-4498-8ff1-811abbf60c0e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:31.598308 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17288e12-4533-4498-8ff1-811abbf60c0e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:31.598737 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17288e12-4533-4498-8ff1-811abbf60c0e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:31.820251 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-17288e12-4533-4498-8ff1-811abbf60c0e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:31.837273 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-17288e12-4533-4498-8ff1-811abbf60c0e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1475 microversion: 2.1 time: 0.271157 Sep 10 11:42:31.839613 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 597/1160] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:31 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1475 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:32.235933 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4d4b02a2-57ed-4c5f-a510-36dad55515d9 tempest-TenantUsagesNegativeTestJSON-1909580767 tempest-TenantUsagesNegativeTestJSON-1909580767-project-admin] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-09T11%3A42%3A31.694359&end=2022-09-11T11%3A42%3A31.694359" status: 404 len: 112 microversion: - time: 0.393829 Sep 10 11:42:32.236517 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 598/1161] 10.222.0.23 () {58 vars in 1316 bytes} [Sat Sep 10 11:42:31 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-09T11%3A42%3A31.694359&end=2022-09-11T11%3A42%3A31.694359 => generated 112 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 10 11:42:32.244653 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-613124d0-fea2-4320-8305-38443850c3fd tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:32.245283 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-613124d0-fea2-4320-8305-38443850c3fd tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:32.248394 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:42:32.253975 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-613124d0-fea2-4320-8305-38443850c3fd tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:32.254811 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-613124d0-fea2-4320-8305-38443850c3fd tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:32.255592 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-613124d0-fea2-4320-8305-38443850c3fd tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:32.256468 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-613124d0-fea2-4320-8305-38443850c3fd tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:32.257075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-613124d0-fea2-4320-8305-38443850c3fd tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:32.257752 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-613124d0-fea2-4320-8305-38443850c3fd tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:32.334152 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-613124d0-fea2-4320-8305-38443850c3fd tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c97b7605a40ebac26884a59ea3902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ad59d8440a49c496acbede9848e944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:32.345480 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-613124d0-fea2-4320-8305-38443850c3fd tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b" status: 200 len: 1273 microversion: 2.1 time: 0.107763 Sep 10 11:42:32.347126 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 599/1162] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:32 2022] GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b => generated 1273 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:32.352480 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1253282d-5adc-4e73-b887-83d87a35c1f0 tempest-TenantUsagesNegativeTestJSON-1909580767 tempest-TenantUsagesNegativeTestJSON-1909580767-project-admin] Calling method '.version_select at 0x7f40738dac10>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:32.360437 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-1253282d-5adc-4e73-b887-83d87a35c1f0 tempest-TenantUsagesNegativeTestJSON-1909580767 tempest-TenantUsagesNegativeTestJSON-1909580767-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1253282d-5adc-4e73-b887-83d87a35c1f0 tempest-TenantUsagesNegativeTestJSON-1909580767 tempest-TenantUsagesNegativeTestJSON-1909580767-project-admin] Request method failure captured: Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/os-simple-tenant-usage/409fa55392494736897d685c663a4ca6?start=2022-09-11T11%3A42%3A31.694359&end=2022-09-09T11%3A42%3A31.694359 HTTP/1.1 Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHgnR89GCnfJVD_7ytcjeu6knuSMFQOopWP7QFrBooNs8Jrd1jye3P-ym3r7mu07GrEe7p5vpQyyizaBHIYL0St8zH5ACs6jXuUAJbv4HKhb_XwaVlkEDIvZK-3QfhmpVWn8G9Duy_seh_ekypRpf_piMddE7LseZdNJxp-OWa6Dg5Y Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: ec4fdfb0c5584cea877712993645460e Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1909580767 Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,admin,member Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,admin,member Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ec4fdfb0c5584cea877712993645460e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ec4fdfb0c5584cea877712993645460e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ec4fdfb0c5584cea877712993645460e", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ec4fdfb0c5584cea877712993645460e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1909580767 Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: ec4fdfb0c5584cea877712993645460e Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1909580767 Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-TenantUsagesNegativeTestJSON-1909580767-project-admin Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 405f285c980a4f4db76951528beabdd3 Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1909580767-project-admin Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: exception: Invalid start time. The start time cannot occur after the end time. Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '409fa55392494736897d685c663a4ca6'} Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Sep 10 11:42:32.368481 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:42:32.373976 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1253282d-5adc-4e73-b887-83d87a35c1f0 tempest-TenantUsagesNegativeTestJSON-1909580767 tempest-TenantUsagesNegativeTestJSON-1909580767-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:42:32.375434 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1253282d-5adc-4e73-b887-83d87a35c1f0 tempest-TenantUsagesNegativeTestJSON-1909580767 tempest-TenantUsagesNegativeTestJSON-1909580767-project-admin] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage/409fa55392494736897d685c663a4ca6?start=2022-09-11T11%3A42%3A31.694359&end=2022-09-09T11%3A42%3A31.694359" status: 400 len: 111 microversion: 2.1 time: 0.026950 Sep 10 11:42:32.376681 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 600/1163] 10.222.0.23 () {58 vars in 1412 bytes} [Sat Sep 10 11:42:32 2022] GET /compute/v2.1/os-simple-tenant-usage/409fa55392494736897d685c663a4ca6?start=2022-09-11T11%3A42%3A31.694359&end=2022-09-09T11%3A42%3A31.694359 => generated 111 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:42:32.748436 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ce7d01ed-e126-407c-b60b-5d0a856d8abb tempest-TenantUsagesNegativeTestJSON-587453053 tempest-TenantUsagesNegativeTestJSON-587453053-project] Calling method '.version_select at 0x7f40731148b0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:32.756742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ce7d01ed-e126-407c-b60b-5d0a856d8abb tempest-TenantUsagesNegativeTestJSON-587453053 tempest-TenantUsagesNegativeTestJSON-587453053-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '9bb8805a7ebd4e57a448e7c8e37f54bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409fa55392494736897d685c663a4ca6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ce7d01ed-e126-407c-b60b-5d0a856d8abb tempest-TenantUsagesNegativeTestJSON-587453053 tempest-TenantUsagesNegativeTestJSON-587453053-project] Request method failure captured: Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-09T11%3A42%3A31.694359&end=2022-09-11T11%3A42%3A31.694359&detailed=1 HTTP/1.1 Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHgm2Ac_ywlLRM-SbdNK-YjC_W9271i-wl1EVVsDIGwbpE-RiV4bNWnerWpOBJ__8BkqC7VhP7QmtwmbZNhQkSKnFMJxwWj_dLbaykJ4iVagwxOSjVSo9LjVUaRJXEX7Ze2L0vVIfQOj8vNpNSUTbr5qEjTIqIyHn9YN1e-oU1P3cp4 Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 409fa55392494736897d685c663a4ca6 Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-587453053 Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/409fa55392494736897d685c663a4ca6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/409fa55392494736897d685c663a4ca6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_409fa55392494736897d685c663a4ca6", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/409fa55392494736897d685c663a4ca6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-587453053 Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 409fa55392494736897d685c663a4ca6 Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-587453053 Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-TenantUsagesNegativeTestJSON-587453053-project Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 9bb8805a7ebd4e57a448e7c8e37f54bf Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-587453053-project Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: action_args: {} Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 11:42:32.761268 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 11:42:32.766271 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 10 11:42:32.766271 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:42:32.766271 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:42:32.766271 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:42:32.766271 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:42:32.766271 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:42:32.766271 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:42:32.766271 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 11:42:32.766271 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 11:42:32.766271 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 10 11:42:32.766271 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:42:32.770779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ce7d01ed-e126-407c-b60b-5d0a856d8abb tempest-TenantUsagesNegativeTestJSON-587453053 tempest-TenantUsagesNegativeTestJSON-587453053-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:42:32.771808 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ce7d01ed-e126-407c-b60b-5d0a856d8abb tempest-TenantUsagesNegativeTestJSON-587453053 tempest-TenantUsagesNegativeTestJSON-587453053-project] 10.222.0.23 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-09T11%3A42%3A31.694359&end=2022-09-11T11%3A42%3A31.694359&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.389310 Sep 10 11:42:32.776335 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 601/1164] 10.222.0.23 () {58 vars in 1335 bytes} [Sat Sep 10 11:42:32 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-09T11%3A42%3A31.694359&end=2022-09-11T11%3A42%3A31.694359&detailed=1 => generated 123 bytes in 391 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:42:32.868408 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6441f583-1895-4dfe-afaf-160661ef3022 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:32.870104 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6441f583-1895-4dfe-afaf-160661ef3022 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:32.882962 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6441f583-1895-4dfe-afaf-160661ef3022 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:32.883628 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6441f583-1895-4dfe-afaf-160661ef3022 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:32.884230 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6441f583-1895-4dfe-afaf-160661ef3022 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:32.887964 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6441f583-1895-4dfe-afaf-160661ef3022 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:32.888627 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6441f583-1895-4dfe-afaf-160661ef3022 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:32.890405 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6441f583-1895-4dfe-afaf-160661ef3022 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:33.211622 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6441f583-1895-4dfe-afaf-160661ef3022 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:33.226146 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6441f583-1895-4dfe-afaf-160661ef3022 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1475 microversion: 2.1 time: 0.362323 Sep 10 11:42:33.228603 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 602/1165] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:32 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1475 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:42:33.371134 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ac4c8295-c248-4dd5-9880-597c47284f8c tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:33.371948 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ac4c8295-c248-4dd5-9880-597c47284f8c tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:33.389340 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac4c8295-c248-4dd5-9880-597c47284f8c tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:33.390035 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac4c8295-c248-4dd5-9880-597c47284f8c tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:33.390671 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac4c8295-c248-4dd5-9880-597c47284f8c tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:33.400920 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac4c8295-c248-4dd5-9880-597c47284f8c tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:33.403493 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac4c8295-c248-4dd5-9880-597c47284f8c tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:33.404939 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac4c8295-c248-4dd5-9880-597c47284f8c tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:33.575273 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-715a4950-2d35-4ca8-b957-7bf6903f7c44 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1/action" status: 202 len: 0 microversion: 2.1 time: 3.013586 Sep 10 11:42:33.582318 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 564/1166] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:42:30 2022] POST /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1/action => generated 0 bytes in 3022 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:42:33.592141 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-627de6bf-c58a-4579-a0c5-592e53addcf0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:33.593657 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-627de6bf-c58a-4579-a0c5-592e53addcf0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:33.609290 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-627de6bf-c58a-4579-a0c5-592e53addcf0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:33.610097 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-627de6bf-c58a-4579-a0c5-592e53addcf0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:33.611912 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-627de6bf-c58a-4579-a0c5-592e53addcf0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:33.612879 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-627de6bf-c58a-4579-a0c5-592e53addcf0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:33.613660 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-627de6bf-c58a-4579-a0c5-592e53addcf0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:33.614335 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-627de6bf-c58a-4579-a0c5-592e53addcf0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:34.341544 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ac4c8295-c248-4dd5-9880-597c47284f8c tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c97b7605a40ebac26884a59ea3902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ad59d8440a49c496acbede9848e944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:34.351001 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-627de6bf-c58a-4579-a0c5-592e53addcf0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:34.385788 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ac4c8295-c248-4dd5-9880-597c47284f8c tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b" status: 200 len: 1315 microversion: 2.1 time: 1.016970 Sep 10 11:42:34.387592 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-627de6bf-c58a-4579-a0c5-592e53addcf0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1719 microversion: 2.1 time: 0.799754 Sep 10 11:42:34.388052 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 603/1167] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:33 2022] GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b => generated 1315 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:34.391537 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 565/1168] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:33 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1719 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:34.396950 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7e146e63-bf00-4b49-bd5f-e10fd0af9877 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:34.398098 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7e146e63-bf00-4b49-bd5f-e10fd0af9877 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:34.406077 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e146e63-bf00-4b49-bd5f-e10fd0af9877 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:34.406880 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e146e63-bf00-4b49-bd5f-e10fd0af9877 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:34.407502 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e146e63-bf00-4b49-bd5f-e10fd0af9877 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:34.408390 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e146e63-bf00-4b49-bd5f-e10fd0af9877 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:34.409023 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e146e63-bf00-4b49-bd5f-e10fd0af9877 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:34.409641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e146e63-bf00-4b49-bd5f-e10fd0af9877 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:34.812330 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7e146e63-bf00-4b49-bd5f-e10fd0af9877 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:34.825216 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7e146e63-bf00-4b49-bd5f-e10fd0af9877 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1475 microversion: 2.1 time: 0.432673 Sep 10 11:42:34.826061 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 604/1169] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:34 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1475 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:35.410923 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-22290924-a212-4a10-8a3e-2a9dac34ce68 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:35.411581 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-22290924-a212-4a10-8a3e-2a9dac34ce68 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:35.424972 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6330a95e-2a0c-40be-ba2b-94dc71d5b6a3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:35.426426 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6330a95e-2a0c-40be-ba2b-94dc71d5b6a3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:35.444841 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-22290924-a212-4a10-8a3e-2a9dac34ce68 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:35.445475 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-22290924-a212-4a10-8a3e-2a9dac34ce68 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:35.448792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6330a95e-2a0c-40be-ba2b-94dc71d5b6a3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:35.449244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-22290924-a212-4a10-8a3e-2a9dac34ce68 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:35.450170 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-22290924-a212-4a10-8a3e-2a9dac34ce68 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:35.450819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-22290924-a212-4a10-8a3e-2a9dac34ce68 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:35.451473 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-22290924-a212-4a10-8a3e-2a9dac34ce68 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:35.455527 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6330a95e-2a0c-40be-ba2b-94dc71d5b6a3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:35.455988 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6330a95e-2a0c-40be-ba2b-94dc71d5b6a3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:35.456931 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6330a95e-2a0c-40be-ba2b-94dc71d5b6a3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:35.459455 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6330a95e-2a0c-40be-ba2b-94dc71d5b6a3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:35.460156 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6330a95e-2a0c-40be-ba2b-94dc71d5b6a3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:35.923278 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6330a95e-2a0c-40be-ba2b-94dc71d5b6a3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:35.939015 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6330a95e-2a0c-40be-ba2b-94dc71d5b6a3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1719 microversion: 2.1 time: 0.518048 Sep 10 11:42:35.940200 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 605/1170] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:35 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1719 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:42:35.948009 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a9f993cc-8b4d-4f50-abbe-be36a3eb3587 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:35.949128 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a9f993cc-8b4d-4f50-abbe-be36a3eb3587 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:35.969076 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9f993cc-8b4d-4f50-abbe-be36a3eb3587 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:35.969836 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9f993cc-8b4d-4f50-abbe-be36a3eb3587 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:35.970447 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9f993cc-8b4d-4f50-abbe-be36a3eb3587 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:35.971380 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9f993cc-8b4d-4f50-abbe-be36a3eb3587 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:35.974977 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9f993cc-8b4d-4f50-abbe-be36a3eb3587 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:35.975654 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9f993cc-8b4d-4f50-abbe-be36a3eb3587 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:36.148257 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-22290924-a212-4a10-8a3e-2a9dac34ce68 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c97b7605a40ebac26884a59ea3902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ad59d8440a49c496acbede9848e944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:36.161961 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-22290924-a212-4a10-8a3e-2a9dac34ce68 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b" status: 200 len: 1315 microversion: 2.1 time: 0.750681 Sep 10 11:42:36.166326 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 566/1171] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:35 2022] GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b => generated 1315 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:36.394683 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a9f993cc-8b4d-4f50-abbe-be36a3eb3587 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:36.412616 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a9f993cc-8b4d-4f50-abbe-be36a3eb3587 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1475 microversion: 2.1 time: 0.471179 Sep 10 11:42:36.413507 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 606/1172] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:35 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1475 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:36.815519 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-e2228859-9e3d-41dd-8f00-4ce36aab63c6 req-ff77e0f4-eb4b-4866-bace-fb7a5549d554 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b", "tag": "c20fba89-fdc5-478a-a6aa-9199ad9ddcce"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:36.834117 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e2228859-9e3d-41dd-8f00-4ce36aab63c6 req-ff77e0f4-eb4b-4866-bace-fb7a5549d554 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:36.834605 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e2228859-9e3d-41dd-8f00-4ce36aab63c6 req-ff77e0f4-eb4b-4866-bace-fb7a5549d554 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:36.837348 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e2228859-9e3d-41dd-8f00-4ce36aab63c6 req-ff77e0f4-eb4b-4866-bace-fb7a5549d554 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:36.857463 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-e2228859-9e3d-41dd-8f00-4ce36aab63c6 req-ff77e0f4-eb4b-4866-bace-fb7a5549d554 service nova] Creating event network-changed:c20fba89-fdc5-478a-a6aa-9199ad9ddcce for instance 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b on n-h1-856895-1 Sep 10 11:42:36.863447 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-e2228859-9e3d-41dd-8f00-4ce36aab63c6 req-ff77e0f4-eb4b-4866-bace-fb7a5549d554 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051643 Sep 10 11:42:36.864353 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 567/1173] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:42:36.972169 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-aa556584-325e-48ff-8176-7b5d68910f1e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:36.973314 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-aa556584-325e-48ff-8176-7b5d68910f1e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:36.981081 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa556584-325e-48ff-8176-7b5d68910f1e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:36.990491 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa556584-325e-48ff-8176-7b5d68910f1e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:36.991589 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa556584-325e-48ff-8176-7b5d68910f1e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:36.992737 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa556584-325e-48ff-8176-7b5d68910f1e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:36.996226 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa556584-325e-48ff-8176-7b5d68910f1e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:36.998672 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa556584-325e-48ff-8176-7b5d68910f1e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:37.060510 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:42:37.194097 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-05c6b90b-1c50-4d85-9306-94e6d2581d41 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:37.194819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-05c6b90b-1c50-4d85-9306-94e6d2581d41 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:37.214361 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05c6b90b-1c50-4d85-9306-94e6d2581d41 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:37.214876 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05c6b90b-1c50-4d85-9306-94e6d2581d41 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:37.221590 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05c6b90b-1c50-4d85-9306-94e6d2581d41 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:37.224415 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05c6b90b-1c50-4d85-9306-94e6d2581d41 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:37.224916 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05c6b90b-1c50-4d85-9306-94e6d2581d41 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:37.225370 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05c6b90b-1c50-4d85-9306-94e6d2581d41 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:37.385410 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-aa556584-325e-48ff-8176-7b5d68910f1e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:37.399880 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-aa556584-325e-48ff-8176-7b5d68910f1e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1719 microversion: 2.1 time: 0.427099 Sep 10 11:42:37.401673 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 607/1174] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:36 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1719 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:37.440297 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cc0a418a-0a57-4090-ab80-1c2443b3a61a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:37.441300 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cc0a418a-0a57-4090-ab80-1c2443b3a61a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:37.460016 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc0a418a-0a57-4090-ab80-1c2443b3a61a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:37.460897 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc0a418a-0a57-4090-ab80-1c2443b3a61a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:37.461733 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc0a418a-0a57-4090-ab80-1c2443b3a61a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:37.462848 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc0a418a-0a57-4090-ab80-1c2443b3a61a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:37.464679 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc0a418a-0a57-4090-ab80-1c2443b3a61a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:37.465345 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc0a418a-0a57-4090-ab80-1c2443b3a61a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:37.806449 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:42:37.834161 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:42:37.839735 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-05c6b90b-1c50-4d85-9306-94e6d2581d41 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c97b7605a40ebac26884a59ea3902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ad59d8440a49c496acbede9848e944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:37.861435 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-05c6b90b-1c50-4d85-9306-94e6d2581d41 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b" status: 200 len: 1315 microversion: 2.1 time: 0.672341 Sep 10 11:42:37.863873 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 568/1175] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:37 2022] GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b => generated 1315 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:42:37.916111 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cc0a418a-0a57-4090-ab80-1c2443b3a61a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:37.933777 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cc0a418a-0a57-4090-ab80-1c2443b3a61a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1474 microversion: 2.1 time: 0.498297 Sep 10 11:42:37.939990 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 608/1176] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:37 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1474 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:38.429863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-46d1220f-55d1-41f6-ac8a-8de866ced8a3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:38.430485 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-46d1220f-55d1-41f6-ac8a-8de866ced8a3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:38.440085 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-46d1220f-55d1-41f6-ac8a-8de866ced8a3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:38.444756 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-46d1220f-55d1-41f6-ac8a-8de866ced8a3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:38.445387 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-46d1220f-55d1-41f6-ac8a-8de866ced8a3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:38.446300 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-46d1220f-55d1-41f6-ac8a-8de866ced8a3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:38.446962 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-46d1220f-55d1-41f6-ac8a-8de866ced8a3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:38.448309 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-46d1220f-55d1-41f6-ac8a-8de866ced8a3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:38.584252 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:42:38.686642 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-46d1220f-55d1-41f6-ac8a-8de866ced8a3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:38.699818 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-46d1220f-55d1-41f6-ac8a-8de866ced8a3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1719 microversion: 2.1 time: 0.273705 Sep 10 11:42:38.700736 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 569/1177] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:38 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1719 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:38.892979 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b0c71a1b-e8af-43c7-8299-7b160f95dd34 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:38.893591 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b0c71a1b-e8af-43c7-8299-7b160f95dd34 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:38.905688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0c71a1b-e8af-43c7-8299-7b160f95dd34 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:38.908397 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0c71a1b-e8af-43c7-8299-7b160f95dd34 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:38.909639 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0c71a1b-e8af-43c7-8299-7b160f95dd34 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:38.912289 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0c71a1b-e8af-43c7-8299-7b160f95dd34 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:38.913170 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0c71a1b-e8af-43c7-8299-7b160f95dd34 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:38.920500 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0c71a1b-e8af-43c7-8299-7b160f95dd34 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:38.970980 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c9862f48-46a4-48e2-a2fe-4eda808c5cec tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:38.972479 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c9862f48-46a4-48e2-a2fe-4eda808c5cec tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:38.990770 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9862f48-46a4-48e2-a2fe-4eda808c5cec tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:38.991703 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9862f48-46a4-48e2-a2fe-4eda808c5cec tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:38.995123 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9862f48-46a4-48e2-a2fe-4eda808c5cec tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:38.996223 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9862f48-46a4-48e2-a2fe-4eda808c5cec tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:38.997090 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9862f48-46a4-48e2-a2fe-4eda808c5cec tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:38.998441 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9862f48-46a4-48e2-a2fe-4eda808c5cec tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:39.417188 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c9862f48-46a4-48e2-a2fe-4eda808c5cec tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:39.427473 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c9862f48-46a4-48e2-a2fe-4eda808c5cec tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1474 microversion: 2.1 time: 0.464785 Sep 10 11:42:39.439623 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 570/1178] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:38 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1474 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:39.445821 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b0c71a1b-e8af-43c7-8299-7b160f95dd34 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c97b7605a40ebac26884a59ea3902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ad59d8440a49c496acbede9848e944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:39.452287 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-eefc8bfb-57b5-4299-8e9e-6c3fe8d8af9d req-79f00f30-0e1b-4e60-9c52-93981065fea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3606a9e-e02c-451e-98b9-2e6395c6af17", "name": "network-vif-unplugged", "status": "completed", "tag": "f498d2de-3776-434f-9d82-c17325598f02"}, {"name": "network-changed", "server_uuid": "e3606a9e-e02c-451e-98b9-2e6395c6af17", "tag": "f498d2de-3776-434f-9d82-c17325598f02"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:39.463363 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-eefc8bfb-57b5-4299-8e9e-6c3fe8d8af9d req-79f00f30-0e1b-4e60-9c52-93981065fea3 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:39.463913 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b0c71a1b-e8af-43c7-8299-7b160f95dd34 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b" status: 200 len: 1315 microversion: 2.1 time: 0.574050 Sep 10 11:42:39.464305 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-eefc8bfb-57b5-4299-8e9e-6c3fe8d8af9d req-79f00f30-0e1b-4e60-9c52-93981065fea3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:39.464909 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-eefc8bfb-57b5-4299-8e9e-6c3fe8d8af9d req-79f00f30-0e1b-4e60-9c52-93981065fea3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:39.466041 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 609/1179] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:38 2022] GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b => generated 1315 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:39.480473 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-eefc8bfb-57b5-4299-8e9e-6c3fe8d8af9d req-79f00f30-0e1b-4e60-9c52-93981065fea3 service nova] Creating event network-vif-unplugged:f498d2de-3776-434f-9d82-c17325598f02 for instance e3606a9e-e02c-451e-98b9-2e6395c6af17 on n-h1-856895-1 Sep 10 11:42:39.481042 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-eefc8bfb-57b5-4299-8e9e-6c3fe8d8af9d req-79f00f30-0e1b-4e60-9c52-93981065fea3 service nova] Creating event network-changed:f498d2de-3776-434f-9d82-c17325598f02 for instance e3606a9e-e02c-451e-98b9-2e6395c6af17 on n-h1-856895-1 Sep 10 11:42:39.490491 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [req-eefc8bfb-57b5-4299-8e9e-6c3fe8d8af9d req-79f00f30-0e1b-4e60-9c52-93981065fea3 service nova] Instance e3606a9e-e02c-451e-98b9-2e6395c6af17 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856895-1', 'n-h1-856895-1'} {{(pid=128776) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 11:42:39.504994 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-eefc8bfb-57b5-4299-8e9e-6c3fe8d8af9d req-79f00f30-0e1b-4e60-9c52-93981065fea3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.063649 Sep 10 11:42:39.505800 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 571/1180] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:42:39.730652 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ee741d0c-9a20-4ee7-a63b-84c21c55b3cc tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:39.731700 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ee741d0c-9a20-4ee7-a63b-84c21c55b3cc tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:39.750292 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee741d0c-9a20-4ee7-a63b-84c21c55b3cc tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:39.752783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee741d0c-9a20-4ee7-a63b-84c21c55b3cc tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:39.761246 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee741d0c-9a20-4ee7-a63b-84c21c55b3cc tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:39.762375 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee741d0c-9a20-4ee7-a63b-84c21c55b3cc tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:39.763069 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee741d0c-9a20-4ee7-a63b-84c21c55b3cc tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:39.763864 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee741d0c-9a20-4ee7-a63b-84c21c55b3cc tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:40.059732 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ee741d0c-9a20-4ee7-a63b-84c21c55b3cc tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:40.073253 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ee741d0c-9a20-4ee7-a63b-84c21c55b3cc tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1719 microversion: 2.1 time: 0.347186 Sep 10 11:42:40.079333 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 610/1181] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:39 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1719 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:40.459463 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-74c8388b-cf10-46d1-be96-0c4a1d7926b0 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:40.461031 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-74c8388b-cf10-46d1-be96-0c4a1d7926b0 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:40.491664 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-820b0879-4123-44c9-aad9-fe00f7019f36 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:40.492552 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-820b0879-4123-44c9-aad9-fe00f7019f36 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:40.500847 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-74c8388b-cf10-46d1-be96-0c4a1d7926b0 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:40.501936 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-74c8388b-cf10-46d1-be96-0c4a1d7926b0 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:40.502880 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-74c8388b-cf10-46d1-be96-0c4a1d7926b0 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:40.504183 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-820b0879-4123-44c9-aad9-fe00f7019f36 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:40.506906 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-74c8388b-cf10-46d1-be96-0c4a1d7926b0 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:40.511640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-820b0879-4123-44c9-aad9-fe00f7019f36 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:40.512772 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-74c8388b-cf10-46d1-be96-0c4a1d7926b0 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:40.513220 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-820b0879-4123-44c9-aad9-fe00f7019f36 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:40.513582 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-74c8388b-cf10-46d1-be96-0c4a1d7926b0 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:40.514047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-820b0879-4123-44c9-aad9-fe00f7019f36 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:40.516409 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-820b0879-4123-44c9-aad9-fe00f7019f36 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:40.516924 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-820b0879-4123-44c9-aad9-fe00f7019f36 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:41.349160 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-820b0879-4123-44c9-aad9-fe00f7019f36 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c97b7605a40ebac26884a59ea3902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ad59d8440a49c496acbede9848e944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:41.360330 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-820b0879-4123-44c9-aad9-fe00f7019f36 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b" status: 200 len: 1315 microversion: 2.1 time: 0.872836 Sep 10 11:42:41.376962 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 611/1182] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:40 2022] GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b => generated 1315 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:42:41.376962 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-457f29ea-28f1-4a27-965a-1d2d7cebf489 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:41.376962 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-457f29ea-28f1-4a27-965a-1d2d7cebf489 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:41.390070 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-457f29ea-28f1-4a27-965a-1d2d7cebf489 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:41.392297 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-457f29ea-28f1-4a27-965a-1d2d7cebf489 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:41.392820 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-457f29ea-28f1-4a27-965a-1d2d7cebf489 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:41.393561 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-457f29ea-28f1-4a27-965a-1d2d7cebf489 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:41.394035 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-457f29ea-28f1-4a27-965a-1d2d7cebf489 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:41.396599 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-457f29ea-28f1-4a27-965a-1d2d7cebf489 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:41.480898 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-74c8388b-cf10-46d1-be96-0c4a1d7926b0 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:41.490902 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-74c8388b-cf10-46d1-be96-0c4a1d7926b0 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1474 microversion: 2.1 time: 1.037975 Sep 10 11:42:41.496129 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 572/1183] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:40 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1474 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:41.915964 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-457f29ea-28f1-4a27-965a-1d2d7cebf489 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:41.928893 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-457f29ea-28f1-4a27-965a-1d2d7cebf489 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1719 microversion: 2.1 time: 0.560669 Sep 10 11:42:41.929531 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 612/1184] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:41 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1719 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:42.389564 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7df19579-4265-4f29-ba10-716c3c9c4cfc tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:42.390857 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7df19579-4265-4f29-ba10-716c3c9c4cfc tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:42.403623 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7df19579-4265-4f29-ba10-716c3c9c4cfc tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:42.408983 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7df19579-4265-4f29-ba10-716c3c9c4cfc tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:42.413168 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7df19579-4265-4f29-ba10-716c3c9c4cfc tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:42.414195 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7df19579-4265-4f29-ba10-716c3c9c4cfc tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:42.418577 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7df19579-4265-4f29-ba10-716c3c9c4cfc tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:42.420617 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7df19579-4265-4f29-ba10-716c3c9c4cfc tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:42.522679 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7a6d5be7-289b-4393-a005-5a93c4ad0732 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:42.524289 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7a6d5be7-289b-4393-a005-5a93c4ad0732 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:42.535119 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7a6d5be7-289b-4393-a005-5a93c4ad0732 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:42.536823 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7a6d5be7-289b-4393-a005-5a93c4ad0732 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:42.538256 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7a6d5be7-289b-4393-a005-5a93c4ad0732 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:42.541182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7a6d5be7-289b-4393-a005-5a93c4ad0732 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:42.554631 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7a6d5be7-289b-4393-a005-5a93c4ad0732 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:42.555799 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7a6d5be7-289b-4393-a005-5a93c4ad0732 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:42.937459 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7df19579-4265-4f29-ba10-716c3c9c4cfc tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c97b7605a40ebac26884a59ea3902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ad59d8440a49c496acbede9848e944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:42.953026 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7df19579-4265-4f29-ba10-716c3c9c4cfc tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b" status: 200 len: 1315 microversion: 2.1 time: 0.564400 Sep 10 11:42:42.954804 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 573/1185] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:42 2022] GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b => generated 1315 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:42.970975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9ba718fb-d93c-4079-ba96-d414300bc485 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:42.980371 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9ba718fb-d93c-4079-ba96-d414300bc485 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:43.010955 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ba718fb-d93c-4079-ba96-d414300bc485 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:43.011729 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ba718fb-d93c-4079-ba96-d414300bc485 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:43.013944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ba718fb-d93c-4079-ba96-d414300bc485 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:43.016181 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ba718fb-d93c-4079-ba96-d414300bc485 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:43.017198 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ba718fb-d93c-4079-ba96-d414300bc485 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:43.019398 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ba718fb-d93c-4079-ba96-d414300bc485 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:43.033403 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7a6d5be7-289b-4393-a005-5a93c4ad0732 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:43.048535 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7a6d5be7-289b-4393-a005-5a93c4ad0732 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1474 microversion: 2.1 time: 0.530734 Sep 10 11:42:43.069368 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 613/1186] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:42 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1474 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:43.982725 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-efd7e3f0-54a2-4531-a971-671a181ab234 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:43.983766 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-efd7e3f0-54a2-4531-a971-671a181ab234 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:44.003334 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-efd7e3f0-54a2-4531-a971-671a181ab234 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:44.003821 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-efd7e3f0-54a2-4531-a971-671a181ab234 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:44.004278 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-efd7e3f0-54a2-4531-a971-671a181ab234 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:44.008317 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-efd7e3f0-54a2-4531-a971-671a181ab234 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:44.008835 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-efd7e3f0-54a2-4531-a971-671a181ab234 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:44.010496 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-efd7e3f0-54a2-4531-a971-671a181ab234 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:44.231997 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9ba718fb-d93c-4079-ba96-d414300bc485 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:44.252381 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9ba718fb-d93c-4079-ba96-d414300bc485 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1719 microversion: 2.1 time: 1.288737 Sep 10 11:42:44.252981 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 574/1187] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:42 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1719 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:44.273260 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2eb7dc46-a64f-4a5a-a183-550aeb9c97ea tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:44.273952 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2eb7dc46-a64f-4a5a-a183-550aeb9c97ea tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:44.294688 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2eb7dc46-a64f-4a5a-a183-550aeb9c97ea tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:44.295218 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2eb7dc46-a64f-4a5a-a183-550aeb9c97ea tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:44.295666 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2eb7dc46-a64f-4a5a-a183-550aeb9c97ea tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:44.296382 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2eb7dc46-a64f-4a5a-a183-550aeb9c97ea tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:44.303420 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2eb7dc46-a64f-4a5a-a183-550aeb9c97ea tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:44.313946 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2eb7dc46-a64f-4a5a-a183-550aeb9c97ea tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:44.552126 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-efd7e3f0-54a2-4531-a971-671a181ab234 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c97b7605a40ebac26884a59ea3902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ad59d8440a49c496acbede9848e944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:44.560683 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-efd7e3f0-54a2-4531-a971-671a181ab234 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b" status: 200 len: 1315 microversion: 2.1 time: 0.583819 Sep 10 11:42:44.565348 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 614/1188] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:43 2022] GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b => generated 1315 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:44.808686 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2eb7dc46-a64f-4a5a-a183-550aeb9c97ea tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:44.818246 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2eb7dc46-a64f-4a5a-a183-550aeb9c97ea tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1472 microversion: 2.1 time: 0.562469 Sep 10 11:42:44.823938 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 575/1189] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:44 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1472 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:45.277085 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cd0c9593-9b65-4f3a-891b-0cd3977b1a34 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:45.277840 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cd0c9593-9b65-4f3a-891b-0cd3977b1a34 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:45.294610 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd0c9593-9b65-4f3a-891b-0cd3977b1a34 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:45.296418 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd0c9593-9b65-4f3a-891b-0cd3977b1a34 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:45.297122 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd0c9593-9b65-4f3a-891b-0cd3977b1a34 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:45.300183 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd0c9593-9b65-4f3a-891b-0cd3977b1a34 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:45.301270 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd0c9593-9b65-4f3a-891b-0cd3977b1a34 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:45.304581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd0c9593-9b65-4f3a-891b-0cd3977b1a34 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:45.590640 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-66271c2d-bcb9-4bef-92fd-6b3842e6d972 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:45.591656 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-66271c2d-bcb9-4bef-92fd-6b3842e6d972 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:45.605269 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-66271c2d-bcb9-4bef-92fd-6b3842e6d972 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:45.605895 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-66271c2d-bcb9-4bef-92fd-6b3842e6d972 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:45.611523 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-66271c2d-bcb9-4bef-92fd-6b3842e6d972 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:45.615738 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-66271c2d-bcb9-4bef-92fd-6b3842e6d972 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:45.616383 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-66271c2d-bcb9-4bef-92fd-6b3842e6d972 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:45.617046 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-66271c2d-bcb9-4bef-92fd-6b3842e6d972 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:45.898262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cd0c9593-9b65-4f3a-891b-0cd3977b1a34 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:45.926236 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cd0c9593-9b65-4f3a-891b-0cd3977b1a34 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1719 microversion: 2.1 time: 0.653795 Sep 10 11:42:45.947270 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 615/1190] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:45 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1719 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:45.958189 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a9f87dc8-a525-4f6c-8b6f-cfcb5cba712b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:45.959081 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a9f87dc8-a525-4f6c-8b6f-cfcb5cba712b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:45.968244 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9f87dc8-a525-4f6c-8b6f-cfcb5cba712b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:45.968963 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9f87dc8-a525-4f6c-8b6f-cfcb5cba712b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:45.969572 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9f87dc8-a525-4f6c-8b6f-cfcb5cba712b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:45.970452 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9f87dc8-a525-4f6c-8b6f-cfcb5cba712b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:45.971067 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9f87dc8-a525-4f6c-8b6f-cfcb5cba712b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:45.971670 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9f87dc8-a525-4f6c-8b6f-cfcb5cba712b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:46.054193 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-66271c2d-bcb9-4bef-92fd-6b3842e6d972 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c97b7605a40ebac26884a59ea3902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ad59d8440a49c496acbede9848e944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:46.064429 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-66271c2d-bcb9-4bef-92fd-6b3842e6d972 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b" status: 200 len: 1315 microversion: 2.1 time: 0.478077 Sep 10 11:42:46.073073 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 576/1191] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:45 2022] GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b => generated 1315 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:46.337870 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a9f87dc8-a525-4f6c-8b6f-cfcb5cba712b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:46.352598 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a9f87dc8-a525-4f6c-8b6f-cfcb5cba712b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1472 microversion: 2.1 time: 0.400364 Sep 10 11:42:46.359512 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 616/1192] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:45 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1472 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:46.958100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c0f85344-9d88-451e-8b44-d0fb9f3cceb4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:46.958981 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c0f85344-9d88-451e-8b44-d0fb9f3cceb4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:46.972741 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0f85344-9d88-451e-8b44-d0fb9f3cceb4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:46.973334 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0f85344-9d88-451e-8b44-d0fb9f3cceb4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:46.975463 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0f85344-9d88-451e-8b44-d0fb9f3cceb4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:46.976499 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0f85344-9d88-451e-8b44-d0fb9f3cceb4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:46.983023 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0f85344-9d88-451e-8b44-d0fb9f3cceb4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:46.983541 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0f85344-9d88-451e-8b44-d0fb9f3cceb4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:47.099091 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d0741ff7-460e-4a75-998f-7fc54b3555b0 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:47.099747 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d0741ff7-460e-4a75-998f-7fc54b3555b0 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:47.115832 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d0741ff7-460e-4a75-998f-7fc54b3555b0 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:47.122224 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d0741ff7-460e-4a75-998f-7fc54b3555b0 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:47.137153 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d0741ff7-460e-4a75-998f-7fc54b3555b0 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:47.139486 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d0741ff7-460e-4a75-998f-7fc54b3555b0 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:47.140611 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d0741ff7-460e-4a75-998f-7fc54b3555b0 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:47.143807 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d0741ff7-460e-4a75-998f-7fc54b3555b0 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:47.587420 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c0f85344-9d88-451e-8b44-d0fb9f3cceb4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:47.602231 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c0f85344-9d88-451e-8b44-d0fb9f3cceb4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1719 microversion: 2.1 time: 0.647605 Sep 10 11:42:47.604281 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 577/1193] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:46 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1719 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:47.609887 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3d87239b-1bd6-4eb0-bbab-d5ec364cb20d tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:47.610801 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3d87239b-1bd6-4eb0-bbab-d5ec364cb20d tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:47.617338 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3d87239b-1bd6-4eb0-bbab-d5ec364cb20d tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:47.619108 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3d87239b-1bd6-4eb0-bbab-d5ec364cb20d tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:47.621764 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3d87239b-1bd6-4eb0-bbab-d5ec364cb20d tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:47.622768 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3d87239b-1bd6-4eb0-bbab-d5ec364cb20d tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:47.624656 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3d87239b-1bd6-4eb0-bbab-d5ec364cb20d tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:47.627730 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3d87239b-1bd6-4eb0-bbab-d5ec364cb20d tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:47.894374 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d0741ff7-460e-4a75-998f-7fc54b3555b0 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c97b7605a40ebac26884a59ea3902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ad59d8440a49c496acbede9848e944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:47.904581 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d0741ff7-460e-4a75-998f-7fc54b3555b0 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b" status: 200 len: 1315 microversion: 2.1 time: 0.810416 Sep 10 11:42:47.910488 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 617/1194] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:47 2022] GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b => generated 1315 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:48.170738 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3d87239b-1bd6-4eb0-bbab-d5ec364cb20d tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:48.181955 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3d87239b-1bd6-4eb0-bbab-d5ec364cb20d tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1469 microversion: 2.1 time: 0.576090 Sep 10 11:42:48.186671 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 578/1195] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:47 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1469 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:48.209215 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2da90fb8-821c-4788-be9c-0388f5956d1a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:48.210147 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2da90fb8-821c-4788-be9c-0388f5956d1a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:48.229542 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2da90fb8-821c-4788-be9c-0388f5956d1a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:48.230319 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2da90fb8-821c-4788-be9c-0388f5956d1a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:48.230986 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2da90fb8-821c-4788-be9c-0388f5956d1a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:48.232762 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2da90fb8-821c-4788-be9c-0388f5956d1a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:48.233433 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2da90fb8-821c-4788-be9c-0388f5956d1a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:48.234316 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2da90fb8-821c-4788-be9c-0388f5956d1a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:48.376551 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2da90fb8-821c-4788-be9c-0388f5956d1a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "POST /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17/action" status: 204 len: 0 microversion: 2.1 time: 0.172379 Sep 10 11:42:48.377940 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 618/1196] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:42:48 2022] POST /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17/action => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:42:48.387457 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-99aec602-f057-4eb8-9c45-3580f8ba0420 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:48.388171 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-99aec602-f057-4eb8-9c45-3580f8ba0420 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:48.410953 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-99aec602-f057-4eb8-9c45-3580f8ba0420 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:48.411786 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-99aec602-f057-4eb8-9c45-3580f8ba0420 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:48.412835 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-99aec602-f057-4eb8-9c45-3580f8ba0420 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:48.415866 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-99aec602-f057-4eb8-9c45-3580f8ba0420 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:48.426632 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-99aec602-f057-4eb8-9c45-3580f8ba0420 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:48.427454 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-99aec602-f057-4eb8-9c45-3580f8ba0420 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:48.632964 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bd10e6d5-6e75-4a19-8518-e2182403d569 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:48.633686 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bd10e6d5-6e75-4a19-8518-e2182403d569 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:48.656805 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd10e6d5-6e75-4a19-8518-e2182403d569 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:48.657310 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd10e6d5-6e75-4a19-8518-e2182403d569 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:48.657759 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd10e6d5-6e75-4a19-8518-e2182403d569 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:48.658483 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd10e6d5-6e75-4a19-8518-e2182403d569 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:48.666535 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd10e6d5-6e75-4a19-8518-e2182403d569 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:48.667567 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd10e6d5-6e75-4a19-8518-e2182403d569 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:48.941961 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-99aec602-f057-4eb8-9c45-3580f8ba0420 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:48.956408 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-99aec602-f057-4eb8-9c45-3580f8ba0420 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1469 microversion: 2.1 time: 0.574007 Sep 10 11:42:48.976663 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 579/1197] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:48 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1469 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:48.987463 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d6a1bef2-ee26-409a-b03d-d01d10b83f38 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:48.988523 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d6a1bef2-ee26-409a-b03d-d01d10b83f38 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:48.997628 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d6a1bef2-ee26-409a-b03d-d01d10b83f38 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:48.998491 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d6a1bef2-ee26-409a-b03d-d01d10b83f38 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:48.999456 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d6a1bef2-ee26-409a-b03d-d01d10b83f38 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:49.000412 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d6a1bef2-ee26-409a-b03d-d01d10b83f38 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:49.001417 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d6a1bef2-ee26-409a-b03d-d01d10b83f38 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:49.002053 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d6a1bef2-ee26-409a-b03d-d01d10b83f38 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:49.407778 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bd10e6d5-6e75-4a19-8518-e2182403d569 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:49.417640 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bd10e6d5-6e75-4a19-8518-e2182403d569 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1719 microversion: 2.1 time: 0.789184 Sep 10 11:42:49.431463 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 619/1198] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:48 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1719 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:49.558899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d6a1bef2-ee26-409a-b03d-d01d10b83f38 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c97b7605a40ebac26884a59ea3902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ad59d8440a49c496acbede9848e944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:49.580818 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d6a1bef2-ee26-409a-b03d-d01d10b83f38 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b" status: 200 len: 1315 microversion: 2.1 time: 0.596975 Sep 10 11:42:49.587242 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 580/1199] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:48 2022] GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b => generated 1315 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:49.656964 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-467d0861-b69b-40ee-b73f-1ab2de20e9f1 req-453113c2-0d4a-447a-a8d4-639e4c0fe515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b", "name": "network-vif-plugged", "status": "completed", "tag": "c20fba89-fdc5-478a-a6aa-9199ad9ddcce"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:49.684173 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-467d0861-b69b-40ee-b73f-1ab2de20e9f1 req-453113c2-0d4a-447a-a8d4-639e4c0fe515 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:49.684661 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-467d0861-b69b-40ee-b73f-1ab2de20e9f1 req-453113c2-0d4a-447a-a8d4-639e4c0fe515 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:49.685100 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-467d0861-b69b-40ee-b73f-1ab2de20e9f1 req-453113c2-0d4a-447a-a8d4-639e4c0fe515 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:49.735189 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-467d0861-b69b-40ee-b73f-1ab2de20e9f1 req-453113c2-0d4a-447a-a8d4-639e4c0fe515 service nova] Creating event network-vif-plugged:c20fba89-fdc5-478a-a6aa-9199ad9ddcce for instance 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b on n-h1-856895-1 Sep 10 11:42:49.752167 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-467d0861-b69b-40ee-b73f-1ab2de20e9f1 req-453113c2-0d4a-447a-a8d4-639e4c0fe515 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099325 Sep 10 11:42:49.759440 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 620/1200] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:42:49.985505 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e7a28fd9-0018-4dbd-a9cf-4962f883b583 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:49.986117 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e7a28fd9-0018-4dbd-a9cf-4962f883b583 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:49.998162 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7a28fd9-0018-4dbd-a9cf-4962f883b583 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:49.999190 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7a28fd9-0018-4dbd-a9cf-4962f883b583 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:49.999863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7a28fd9-0018-4dbd-a9cf-4962f883b583 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:50.002717 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7a28fd9-0018-4dbd-a9cf-4962f883b583 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:50.003452 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7a28fd9-0018-4dbd-a9cf-4962f883b583 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:50.004368 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7a28fd9-0018-4dbd-a9cf-4962f883b583 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:50.235491 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e7a28fd9-0018-4dbd-a9cf-4962f883b583 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:50.245141 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e7a28fd9-0018-4dbd-a9cf-4962f883b583 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1469 microversion: 2.1 time: 0.264785 Sep 10 11:42:50.246445 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 581/1201] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:49 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1469 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:50.459240 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c60c42a6-4966-46ce-93d6-3ac6fb6dd791 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:50.460178 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c60c42a6-4966-46ce-93d6-3ac6fb6dd791 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:50.479794 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c60c42a6-4966-46ce-93d6-3ac6fb6dd791 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:50.480299 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c60c42a6-4966-46ce-93d6-3ac6fb6dd791 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:50.480744 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c60c42a6-4966-46ce-93d6-3ac6fb6dd791 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:50.481542 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c60c42a6-4966-46ce-93d6-3ac6fb6dd791 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:50.482001 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c60c42a6-4966-46ce-93d6-3ac6fb6dd791 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:50.482678 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c60c42a6-4966-46ce-93d6-3ac6fb6dd791 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:50.610201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bda65f16-4a25-4c6c-850f-498492d02c9a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:50.610747 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bda65f16-4a25-4c6c-850f-498492d02c9a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:50.623138 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bda65f16-4a25-4c6c-850f-498492d02c9a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:50.623673 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bda65f16-4a25-4c6c-850f-498492d02c9a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:50.624120 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bda65f16-4a25-4c6c-850f-498492d02c9a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:50.624846 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bda65f16-4a25-4c6c-850f-498492d02c9a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:50.625305 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bda65f16-4a25-4c6c-850f-498492d02c9a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:50.631645 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bda65f16-4a25-4c6c-850f-498492d02c9a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:50.664261 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:42:51.000841 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bda65f16-4a25-4c6c-850f-498492d02c9a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c97b7605a40ebac26884a59ea3902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ad59d8440a49c496acbede9848e944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:51.020519 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c60c42a6-4966-46ce-93d6-3ac6fb6dd791 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:51.047584 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bda65f16-4a25-4c6c-850f-498492d02c9a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b" status: 200 len: 1315 microversion: 2.1 time: 0.439305 Sep 10 11:42:51.050507 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 582/1202] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:50 2022] GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:42:51.069755 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c60c42a6-4966-46ce-93d6-3ac6fb6dd791 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1719 microversion: 2.1 time: 0.615794 Sep 10 11:42:51.079020 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 621/1203] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:50 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1719 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:51.270584 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b872177f-1b17-4891-805a-d6df3798a5dd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:51.271531 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b872177f-1b17-4891-805a-d6df3798a5dd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:51.284588 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b872177f-1b17-4891-805a-d6df3798a5dd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:51.290798 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b872177f-1b17-4891-805a-d6df3798a5dd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:51.292461 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b872177f-1b17-4891-805a-d6df3798a5dd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:51.294228 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b872177f-1b17-4891-805a-d6df3798a5dd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:51.294709 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b872177f-1b17-4891-805a-d6df3798a5dd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:51.295137 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b872177f-1b17-4891-805a-d6df3798a5dd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:51.480669 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b872177f-1b17-4891-805a-d6df3798a5dd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:51.489052 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b872177f-1b17-4891-805a-d6df3798a5dd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1469 microversion: 2.1 time: 0.223591 Sep 10 11:42:51.491114 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 583/1204] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:51 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1469 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:51.572456 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cd97715c-0b25-4c14-a795-61203afa015a tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-2115490829", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "b3bcc041-d1d1-4032-9b43-61f3a0a3c9fc"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:51.661416 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-cd97715c-0b25-4c14-a795-61203afa015a tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] validate_networks() for [('b3bcc041-d1d1-4032-9b43-61f3a0a3c9fc', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:42:52.074679 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dff2dfc6-4b0b-4227-b91f-da7ddef291a9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:52.078308 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-dff2dfc6-4b0b-4227-b91f-da7ddef291a9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:52.097754 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dff2dfc6-4b0b-4227-b91f-da7ddef291a9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:52.098257 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dff2dfc6-4b0b-4227-b91f-da7ddef291a9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:52.100342 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dff2dfc6-4b0b-4227-b91f-da7ddef291a9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:52.101852 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dff2dfc6-4b0b-4227-b91f-da7ddef291a9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:52.103676 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dff2dfc6-4b0b-4227-b91f-da7ddef291a9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:52.105904 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dff2dfc6-4b0b-4227-b91f-da7ddef291a9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:52.303528 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-cd97715c-0b25-4c14-a795-61203afa015a tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:42:52.304206 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-cd97715c-0b25-4c14-a795-61203afa015a tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:42:52.305162 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-cd97715c-0b25-4c14-a795-61203afa015a tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:42:52.305874 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-cd97715c-0b25-4c14-a795-61203afa015a tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:42:52.307044 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-cd97715c-0b25-4c14-a795-61203afa015a tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:42:52.323191 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd97715c-0b25-4c14-a795-61203afa015a tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:52.324012 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd97715c-0b25-4c14-a795-61203afa015a tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:52.324708 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd97715c-0b25-4c14-a795-61203afa015a tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:52.325990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd97715c-0b25-4c14-a795-61203afa015a tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:52.326685 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd97715c-0b25-4c14-a795-61203afa015a tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:52.327420 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd97715c-0b25-4c14-a795-61203afa015a tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:52.356581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-cd97715c-0b25-4c14-a795-61203afa015a tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Getting quotas for project 513f3ad4f9d147a5b9ac652fa5fcde04. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:42:52.363112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-cd97715c-0b25-4c14-a795-61203afa015a tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Getting quotas for user fa1592ac1d534dc283392ff5d68765ef and project 513f3ad4f9d147a5b9ac652fa5fcde04. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:42:52.382859 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-dff2dfc6-4b0b-4227-b91f-da7ddef291a9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c97b7605a40ebac26884a59ea3902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ad59d8440a49c496acbede9848e944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:52.391330 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cd97715c-0b25-4c14-a795-61203afa015a tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:42:52.393373 n-d-856895-1 devstack@n-api.service[128777]: WARNING nova.utils [None req-cd97715c-0b25-4c14-a795-61203afa015a tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-2115490829 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-211549082 Sep 10 11:42:52.394117 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cd97715c-0b25-4c14-a795-61203afa015a tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] [instance: 10efe0de-fffd-415e-af3d-06d750fea3d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:42:52.396281 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-dff2dfc6-4b0b-4227-b91f-da7ddef291a9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b" status: 200 len: 1503 microversion: 2.1 time: 0.327693 Sep 10 11:42:52.397166 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 584/1205] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:52 2022] GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b => generated 1503 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:52.403958 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-01fd6982-095b-4863-b0ce-fb70db4e2a39 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:52.404816 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-01fd6982-095b-4863-b0ce-fb70db4e2a39 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:52.411465 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01fd6982-095b-4863-b0ce-fb70db4e2a39 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:52.412343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01fd6982-095b-4863-b0ce-fb70db4e2a39 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:52.413281 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01fd6982-095b-4863-b0ce-fb70db4e2a39 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:52.414218 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01fd6982-095b-4863-b0ce-fb70db4e2a39 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:52.414882 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01fd6982-095b-4863-b0ce-fb70db4e2a39 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:52.416440 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01fd6982-095b-4863-b0ce-fb70db4e2a39 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:52.465768 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cd97715c-0b25-4c14-a795-61203afa015a tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.102319 Sep 10 11:42:52.466419 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 622/1206] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:42:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1104 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:42:52.493236 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e2559e93-5d0e-4a44-80a9-f93a7827ce01 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-6062969"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:52.495646 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e2559e93-5d0e-4a44-80a9-f93a7827ce01 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:52.515402 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e2559e93-5d0e-4a44-80a9-f93a7827ce01 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:52.517372 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e2559e93-5d0e-4a44-80a9-f93a7827ce01 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:52.517938 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e2559e93-5d0e-4a44-80a9-f93a7827ce01 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:52.518765 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e2559e93-5d0e-4a44-80a9-f93a7827ce01 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:52.520741 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e2559e93-5d0e-4a44-80a9-f93a7827ce01 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:52.522734 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e2559e93-5d0e-4a44-80a9-f93a7827ce01 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:52.856903 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-01fd6982-095b-4863-b0ce-fb70db4e2a39 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:52.870953 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-01fd6982-095b-4863-b0ce-fb70db4e2a39 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1719 microversion: 2.1 time: 0.472115 Sep 10 11:42:52.884533 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.network.security_group_api [None req-e2559e93-5d0e-4a44-80a9-f93a7827ce01 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Adding security group 0e030344-f246-4c29-acf5-2fe1ad5b2ef9 to port c20fba89-fdc5-478a-a6aa-9199ad9ddcce Sep 10 11:42:52.890144 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 585/1207] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:52 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1719 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:52.898591 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c50df589-1c2d-4b5b-890b-0650b7e64aa4 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:52.900136 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c50df589-1c2d-4b5b-890b-0650b7e64aa4 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] [instance: 10efe0de-fffd-415e-af3d-06d750fea3d4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:53.023663 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c50df589-1c2d-4b5b-890b-0650b7e64aa4 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1592ac1d534dc283392ff5d68765ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513f3ad4f9d147a5b9ac652fa5fcde04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:53.040246 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c50df589-1c2d-4b5b-890b-0650b7e64aa4 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] 10.222.0.23 "GET /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4" status: 200 len: 1232 microversion: 2.1 time: 0.146490 Sep 10 11:42:53.060706 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 586/1208] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:52 2022] GET /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4 => generated 1232 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:53.069083 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ca0ad662-873b-4263-9d5c-50a5c61b7ea1 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:53.069716 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ca0ad662-873b-4263-9d5c-50a5c61b7ea1 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:53.097180 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca0ad662-873b-4263-9d5c-50a5c61b7ea1 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:53.099620 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca0ad662-873b-4263-9d5c-50a5c61b7ea1 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:53.100243 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca0ad662-873b-4263-9d5c-50a5c61b7ea1 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:53.101110 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca0ad662-873b-4263-9d5c-50a5c61b7ea1 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:53.101765 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca0ad662-873b-4263-9d5c-50a5c61b7ea1 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:53.106605 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca0ad662-873b-4263-9d5c-50a5c61b7ea1 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:53.467060 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ca0ad662-873b-4263-9d5c-50a5c61b7ea1 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:53.475450 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ca0ad662-873b-4263-9d5c-50a5c61b7ea1 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1469 microversion: 2.1 time: 0.411786 Sep 10 11:42:53.479128 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 587/1209] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:53 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1469 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:53.521419 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-352c357b-c98d-469d-af5c-a1dcf797c612 req-e62ad72a-8c15-40e7-afee-6130c8707531 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3606a9e-e02c-451e-98b9-2e6395c6af17", "name": "network-vif-plugged", "status": "completed", "tag": "f498d2de-3776-434f-9d82-c17325598f02"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:53.544909 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-352c357b-c98d-469d-af5c-a1dcf797c612 req-e62ad72a-8c15-40e7-afee-6130c8707531 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:53.544909 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-352c357b-c98d-469d-af5c-a1dcf797c612 req-e62ad72a-8c15-40e7-afee-6130c8707531 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:53.544909 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-352c357b-c98d-469d-af5c-a1dcf797c612 req-e62ad72a-8c15-40e7-afee-6130c8707531 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:53.558217 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-352c357b-c98d-469d-af5c-a1dcf797c612 req-e62ad72a-8c15-40e7-afee-6130c8707531 service nova] Creating event network-vif-plugged:f498d2de-3776-434f-9d82-c17325598f02 for instance e3606a9e-e02c-451e-98b9-2e6395c6af17 on n-h1-856895-1 Sep 10 11:42:53.565307 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-352c357b-c98d-469d-af5c-a1dcf797c612 req-e62ad72a-8c15-40e7-afee-6130c8707531 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082470 Sep 10 11:42:53.566219 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 588/1210] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:42:53.584254 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e2559e93-5d0e-4a44-80a9-f93a7827ce01 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "POST /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b/action" status: 202 len: 0 microversion: 2.1 time: 1.106324 Sep 10 11:42:53.585403 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 623/1211] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:42:52 2022] POST /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b/action => generated 0 bytes in 1118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:42:53.602388 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d14c2e64-da4c-4263-9274-8b0f03e864c3 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '.version_select at 0x7f4073aaa550>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:53.658295 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-a1594675-6afa-42d5-9e60-ee384f51ffd8 req-37f917cc-585e-4512-b5a8-62e21d84d491 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b", "tag": "c20fba89-fdc5-478a-a6aa-9199ad9ddcce"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:53.707027 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a1594675-6afa-42d5-9e60-ee384f51ffd8 req-37f917cc-585e-4512-b5a8-62e21d84d491 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:53.708137 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a1594675-6afa-42d5-9e60-ee384f51ffd8 req-37f917cc-585e-4512-b5a8-62e21d84d491 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:53.709033 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a1594675-6afa-42d5-9e60-ee384f51ffd8 req-37f917cc-585e-4512-b5a8-62e21d84d491 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:53.742800 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-a1594675-6afa-42d5-9e60-ee384f51ffd8 req-37f917cc-585e-4512-b5a8-62e21d84d491 service nova] Creating event network-changed:c20fba89-fdc5-478a-a6aa-9199ad9ddcce for instance 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b on n-h1-856895-1 Sep 10 11:42:53.761278 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-a1594675-6afa-42d5-9e60-ee384f51ffd8 req-37f917cc-585e-4512-b5a8-62e21d84d491 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108569 Sep 10 11:42:53.762274 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 624/1212] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:42:53.898655 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7517a67a-8154-4487-bc46-a173f7ada90d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:53.900378 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7517a67a-8154-4487-bc46-a173f7ada90d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:53.932494 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7517a67a-8154-4487-bc46-a173f7ada90d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:53.933501 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7517a67a-8154-4487-bc46-a173f7ada90d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:53.934393 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7517a67a-8154-4487-bc46-a173f7ada90d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:53.935305 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7517a67a-8154-4487-bc46-a173f7ada90d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:53.935922 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7517a67a-8154-4487-bc46-a173f7ada90d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:53.936916 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7517a67a-8154-4487-bc46-a173f7ada90d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:53.946060 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:42:53.991194 n-d-856895-1 devstack@n-api.service[128776]: DEBUG neutronclient.v2_0.client [None req-d14c2e64-da4c-4263-9274-8b0f03e864c3 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 0e030344-f246-4c29-acf5-2fe1ad5b2ef9 in use.", "detail": ""}} {{(pid=128776) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 11:42:53.992725 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-d14c2e64-da4c-4263-9274-8b0f03e864c3 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] HTTP exception thrown: Security Group 0e030344-f246-4c29-acf5-2fe1ad5b2ef9 in use. Sep 10 11:42:53.992725 n-d-856895-1 devstack@n-api.service[128776]: Neutron server returns request_ids: ['req-77d6ddf3-2d47-4efd-95c2-1c08bbeca23d'] Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d14c2e64-da4c-4263-9274-8b0f03e864c3 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Request method failure captured: Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/os-security-groups/0e030344-f246-4c29-acf5-2fe1ad5b2ef9 HTTP/1.1 Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHgBU0aZ9PqJpGA422fKNy27Wjo5sOCfo4CIswXFFfdPv36WiPjLOYw_neMbOsaeYNKIXkVSp0pEYCo9771BWqsl0fjBWyX6S3skhskK7a85wRu3ZuO-FXP422rQwCRC9xzOeesr0UvY-AFVf9_IuIXQit7YUH71vPa-NVExdrtG-MY Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 91ad59d8440a49c496acbede9848e944 Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ad59d8440a49c496acbede9848e944"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ad59d8440a49c496acbede9848e944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_91ad59d8440a49c496acbede9848e944", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/91ad59d8440a49c496acbede9848e944"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 91ad59d8440a49c496acbede9848e944 Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-SecurityGroupsTestJSON-1578123858-project Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 080c97b7605a40ebac26884a59ea3902 Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-SecurityGroupsTestJSON-1578123858-project Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: exception: Security Group 0e030344-f246-4c29-acf5-2fe1ad5b2ef9 in use. Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: Neutron server returns request_ids: ['req-77d6ddf3-2d47-4efd-95c2-1c08bbeca23d'] Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '0e030344-f246-4c29-acf5-2fe1ad5b2ef9'} Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 11:42:53.995717 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 0e030344-f246-4c29-acf5-2fe1ad5b2ef9 in use. Sep 10 11:42:54.000578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-77d6ddf3-2d47-4efd-95c2-1c08bbeca23d'] Sep 10 11:42:54.000578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:42:54.000578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:42:54.000578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:42:54.000578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:42:54.000578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 10 11:42:54.000578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 10 11:42:54.000578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 10 11:42:54.000578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 10 11:42:54.000578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 0e030344-f246-4c29-acf5-2fe1ad5b2ef9 in use. Sep 10 11:42:54.000578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-77d6ddf3-2d47-4efd-95c2-1c08bbeca23d'] Sep 10 11:42:54.000578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:42:54.000578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:42:54.000578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:42:54.000578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:42:54.000578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:42:54.000578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:42:54.000578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:42:54.000578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:42:54.000578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:42:54.000578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:42:54.000578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:42:54.000578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:42:54.000578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 10 11:42:54.000578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 10 11:42:54.000578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 0e030344-f246-4c29-acf5-2fe1ad5b2ef9 in use. Sep 10 11:42:54.000578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-77d6ddf3-2d47-4efd-95c2-1c08bbeca23d'] Sep 10 11:42:54.000578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:42:54.000578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:42:54.000578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:42:54.000578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:42:54.000578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:42:54.000578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:42:54.000578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:42:54.000578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:42:54.000578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 0e030344-f246-4c29-acf5-2fe1ad5b2ef9 in use. Sep 10 11:42:54.000578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-77d6ddf3-2d47-4efd-95c2-1c08bbeca23d'] Sep 10 11:42:54.000578 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:42:54.000578 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d14c2e64-da4c-4263-9274-8b0f03e864c3 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Returning 400 to user: Security Group 0e030344-f246-4c29-acf5-2fe1ad5b2ef9 in use. Sep 10 11:42:54.000578 n-d-856895-1 devstack@n-api.service[128776]: Neutron server returns request_ids: ['req-77d6ddf3-2d47-4efd-95c2-1c08bbeca23d'] {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:42:54.000578 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d14c2e64-da4c-4263-9274-8b0f03e864c3 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/0e030344-f246-4c29-acf5-2fe1ad5b2ef9" status: 400 len: 185 microversion: 2.1 time: 0.406290 Sep 10 11:42:54.000578 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 589/1213] 10.222.0.23 () {58 vars in 1272 bytes} [Sat Sep 10 11:42:53 2022] DELETE /compute/v2.1/os-security-groups/0e030344-f246-4c29-acf5-2fe1ad5b2ef9 => generated 185 bytes in 408 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 10 11:42:54.013851 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2d02f78d-290a-4d80-b4fd-1c02f9e3c04a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:54.021795 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2d02f78d-290a-4d80-b4fd-1c02f9e3c04a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:54.042191 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d02f78d-290a-4d80-b4fd-1c02f9e3c04a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:54.043646 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d02f78d-290a-4d80-b4fd-1c02f9e3c04a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:54.044281 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d02f78d-290a-4d80-b4fd-1c02f9e3c04a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:54.045226 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d02f78d-290a-4d80-b4fd-1c02f9e3c04a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:54.045842 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d02f78d-290a-4d80-b4fd-1c02f9e3c04a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:54.046428 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d02f78d-290a-4d80-b4fd-1c02f9e3c04a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:54.300020 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2d02f78d-290a-4d80-b4fd-1c02f9e3c04a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "POST /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b/action" status: 202 len: 0 microversion: 2.1 time: 0.293847 Sep 10 11:42:54.304791 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 590/1214] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:42:54 2022] POST /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:42:54.329961 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b4ad356a-e616-4d44-a5ff-f79575e4ed79 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:54.339531 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b4ad356a-e616-4d44-a5ff-f79575e4ed79 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] [instance: 10efe0de-fffd-415e-af3d-06d750fea3d4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:54.342111 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7517a67a-8154-4487-bc46-a173f7ada90d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:54.355245 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7517a67a-8154-4487-bc46-a173f7ada90d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1719 microversion: 2.1 time: 0.460940 Sep 10 11:42:54.355818 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=76 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:42:54.359188 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 625/1215] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:53 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1719 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:42:54.360259 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b4ad356a-e616-4d44-a5ff-f79575e4ed79 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:54.361115 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b4ad356a-e616-4d44-a5ff-f79575e4ed79 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:54.363055 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b4ad356a-e616-4d44-a5ff-f79575e4ed79 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:54.364426 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b4ad356a-e616-4d44-a5ff-f79575e4ed79 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:54.365178 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b4ad356a-e616-4d44-a5ff-f79575e4ed79 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:54.366076 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b4ad356a-e616-4d44-a5ff-f79575e4ed79 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:54.380543 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d14b4f09-744e-4666-83e9-085ba9349937 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:54.381179 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d14b4f09-744e-4666-83e9-085ba9349937 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:54.406204 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d14b4f09-744e-4666-83e9-085ba9349937 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:54.407469 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d14b4f09-744e-4666-83e9-085ba9349937 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:54.409568 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d14b4f09-744e-4666-83e9-085ba9349937 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:54.412009 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d14b4f09-744e-4666-83e9-085ba9349937 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:54.412830 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d14b4f09-744e-4666-83e9-085ba9349937 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:54.414265 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d14b4f09-744e-4666-83e9-085ba9349937 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:54.594159 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b4ad356a-e616-4d44-a5ff-f79575e4ed79 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1592ac1d534dc283392ff5d68765ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513f3ad4f9d147a5b9ac652fa5fcde04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:54.607847 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b4ad356a-e616-4d44-a5ff-f79575e4ed79 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] 10.222.0.23 "GET /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4" status: 200 len: 1236 microversion: 2.1 time: 0.304446 Sep 10 11:42:54.615114 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 591/1216] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:54 2022] GET /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4 => generated 1236 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:54.633605 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-62665359-bb32-444f-8bb4-5f7c84578122 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:54.634592 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-62665359-bb32-444f-8bb4-5f7c84578122 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:54.651097 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-62665359-bb32-444f-8bb4-5f7c84578122 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:54.667294 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-62665359-bb32-444f-8bb4-5f7c84578122 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:54.667713 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-62665359-bb32-444f-8bb4-5f7c84578122 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:54.675417 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-62665359-bb32-444f-8bb4-5f7c84578122 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:54.675928 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-62665359-bb32-444f-8bb4-5f7c84578122 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:54.676381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-62665359-bb32-444f-8bb4-5f7c84578122 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:54.976357 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d14b4f09-744e-4666-83e9-085ba9349937 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c97b7605a40ebac26884a59ea3902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ad59d8440a49c496acbede9848e944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:54.986607 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d14b4f09-744e-4666-83e9-085ba9349937 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b" status: 200 len: 1571 microversion: 2.1 time: 0.622575 Sep 10 11:42:54.991415 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 626/1217] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:54 2022] GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b => generated 1571 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:55.117682 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-62665359-bb32-444f-8bb4-5f7c84578122 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:55.127662 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-62665359-bb32-444f-8bb4-5f7c84578122 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1461 microversion: 2.1 time: 0.511001 Sep 10 11:42:55.128507 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 592/1218] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:54 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1461 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:55.153874 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f17d9641-34c9-4977-9791-fa36d3f0976b tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:55.154693 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f17d9641-34c9-4977-9791-fa36d3f0976b tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:55.162302 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f17d9641-34c9-4977-9791-fa36d3f0976b tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:55.163337 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f17d9641-34c9-4977-9791-fa36d3f0976b tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:55.164079 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f17d9641-34c9-4977-9791-fa36d3f0976b tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:55.165081 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f17d9641-34c9-4977-9791-fa36d3f0976b tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:55.166248 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f17d9641-34c9-4977-9791-fa36d3f0976b tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:55.166851 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f17d9641-34c9-4977-9791-fa36d3f0976b tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:55.390532 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ae308c16-a0f0-46cd-beb8-d1351cb2fcbb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:55.393338 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ae308c16-a0f0-46cd-beb8-d1351cb2fcbb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:55.423632 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ae308c16-a0f0-46cd-beb8-d1351cb2fcbb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:55.423916 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ae308c16-a0f0-46cd-beb8-d1351cb2fcbb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:55.425256 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ae308c16-a0f0-46cd-beb8-d1351cb2fcbb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:55.426223 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ae308c16-a0f0-46cd-beb8-d1351cb2fcbb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:55.430438 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ae308c16-a0f0-46cd-beb8-d1351cb2fcbb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:55.432103 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ae308c16-a0f0-46cd-beb8-d1351cb2fcbb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:55.543882 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f17d9641-34c9-4977-9791-fa36d3f0976b tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1612 microversion: 2.1 time: 0.395544 Sep 10 11:42:55.547903 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 627/1219] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:55 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1612 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:55.577844 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-27c4187d-5b87-4ce6-8d5d-e6c2d3a4dee5 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Calling method '.version_select at 0x7f4073131dc0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:55.588693 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-27c4187d-5b87-4ce6-8d5d-e6c2d3a4dee5 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:55.589309 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-27c4187d-5b87-4ce6-8d5d-e6c2d3a4dee5 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:55.589776 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-27c4187d-5b87-4ce6-8d5d-e6c2d3a4dee5 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:55.643376 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-27c4187d-5b87-4ce6-8d5d-e6c2d3a4dee5 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 2329 microversion: 2.1 time: 0.067809 Sep 10 11:42:55.651922 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 628/1220] 10.222.0.23 () {58 vars in 1143 bytes} [Sat Sep 10 11:42:55 2022] GET /compute/v2.1/os-migrations => generated 2329 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:55.666854 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-03c920bb-26a5-413d-bb6e-57aa4b75cc92 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:55.668977 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-03c920bb-26a5-413d-bb6e-57aa4b75cc92 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] [instance: 10efe0de-fffd-415e-af3d-06d750fea3d4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:55.692299 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03c920bb-26a5-413d-bb6e-57aa4b75cc92 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:55.695234 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03c920bb-26a5-413d-bb6e-57aa4b75cc92 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:55.695864 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03c920bb-26a5-413d-bb6e-57aa4b75cc92 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:55.697859 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03c920bb-26a5-413d-bb6e-57aa4b75cc92 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:55.699880 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03c920bb-26a5-413d-bb6e-57aa4b75cc92 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:55.700899 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03c920bb-26a5-413d-bb6e-57aa4b75cc92 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:55.926874 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-03c920bb-26a5-413d-bb6e-57aa4b75cc92 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1592ac1d534dc283392ff5d68765ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513f3ad4f9d147a5b9ac652fa5fcde04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:55.938706 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-03c920bb-26a5-413d-bb6e-57aa4b75cc92 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] 10.222.0.23 "GET /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4" status: 200 len: 1290 microversion: 2.1 time: 0.285272 Sep 10 11:42:55.951187 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 629/1221] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:55 2022] GET /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4 => generated 1290 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:55.951187 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-efc0b86d-4144-46f3-b7ee-94996707d792 req-5550dee6-5a3d-4011-a605-a49e3251f496 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53e36757-9924-4d03-a8c0-fe52a166ffc1", "name": "network-vif-unplugged", "status": "completed", "tag": "42683686-90d1-4e9e-9012-b0ee66c9e930"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:55.959202 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-efc0b86d-4144-46f3-b7ee-94996707d792 req-5550dee6-5a3d-4011-a605-a49e3251f496 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:55.959436 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-efc0b86d-4144-46f3-b7ee-94996707d792 req-5550dee6-5a3d-4011-a605-a49e3251f496 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:55.962813 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-efc0b86d-4144-46f3-b7ee-94996707d792 req-5550dee6-5a3d-4011-a605-a49e3251f496 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:55.990968 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-efc0b86d-4144-46f3-b7ee-94996707d792 req-5550dee6-5a3d-4011-a605-a49e3251f496 service nova] Creating event network-vif-unplugged:42683686-90d1-4e9e-9012-b0ee66c9e930 for instance 53e36757-9924-4d03-a8c0-fe52a166ffc1 on n-h1-856895-1 Sep 10 11:42:55.997219 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-efc0b86d-4144-46f3-b7ee-94996707d792 req-5550dee6-5a3d-4011-a605-a49e3251f496 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054859 Sep 10 11:42:55.997833 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 630/1222] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:42:56.003144 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-da8dc70f-e573-406b-ae74-60651a001da9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-971382730", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:56.030231 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ae308c16-a0f0-46cd-beb8-d1351cb2fcbb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:56.042495 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ae308c16-a0f0-46cd-beb8-d1351cb2fcbb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1719 microversion: 2.1 time: 0.662861 Sep 10 11:42:56.047953 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 593/1223] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:55 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1719 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:56.069806 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-242e3461-42bf-4b80-a694-770976125f84 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:56.070746 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-242e3461-42bf-4b80-a694-770976125f84 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:56.086074 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-da8dc70f-e573-406b-ae74-60651a001da9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] validate_networks() for None {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:42:56.093105 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-242e3461-42bf-4b80-a694-770976125f84 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:56.093615 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-242e3461-42bf-4b80-a694-770976125f84 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:56.094523 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-242e3461-42bf-4b80-a694-770976125f84 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:56.096992 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-242e3461-42bf-4b80-a694-770976125f84 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:56.097613 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-242e3461-42bf-4b80-a694-770976125f84 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:56.098726 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-242e3461-42bf-4b80-a694-770976125f84 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:56.663884 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-242e3461-42bf-4b80-a694-770976125f84 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c97b7605a40ebac26884a59ea3902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ad59d8440a49c496acbede9848e944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:56.679881 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-242e3461-42bf-4b80-a694-770976125f84 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b" status: 200 len: 1571 microversion: 2.1 time: 0.630787 Sep 10 11:42:56.680475 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 594/1224] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:56 2022] GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b => generated 1571 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:56.710476 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-da8dc70f-e573-406b-ae74-60651a001da9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:42:56.710901 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-da8dc70f-e573-406b-ae74-60651a001da9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:42:56.711567 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-da8dc70f-e573-406b-ae74-60651a001da9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:42:56.712540 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-da8dc70f-e573-406b-ae74-60651a001da9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:42:56.713151 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-da8dc70f-e573-406b-ae74-60651a001da9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:42:56.722775 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-da8dc70f-e573-406b-ae74-60651a001da9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:56.723554 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-da8dc70f-e573-406b-ae74-60651a001da9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:56.724169 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-da8dc70f-e573-406b-ae74-60651a001da9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:56.725355 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-da8dc70f-e573-406b-ae74-60651a001da9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:56.725985 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-da8dc70f-e573-406b-ae74-60651a001da9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:56.727236 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-da8dc70f-e573-406b-ae74-60651a001da9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:56.749798 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-da8dc70f-e573-406b-ae74-60651a001da9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Getting quotas for project 7b37b36096cd42f6b6568ff9eee2751c. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:42:56.772149 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-da8dc70f-e573-406b-ae74-60651a001da9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Getting quotas for user 77d854474f4c4481ac407a76b4627c69 and project 7b37b36096cd42f6b6568ff9eee2751c. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:42:56.797864 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-da8dc70f-e573-406b-ae74-60651a001da9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:42:56.804219 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-da8dc70f-e573-406b-ae74-60651a001da9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:42:56.897974 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-da8dc70f-e573-406b-ae74-60651a001da9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.898704 Sep 10 11:42:56.902938 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 631/1225] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:42:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:42:56.914147 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7ace7a52-86d3-43b7-84c4-f819aa10f4b7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:56.915545 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7ace7a52-86d3-43b7-84c4-f819aa10f4b7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:56.967913 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5c9ddf19-a2e7-4de4-a765-379be0d0c6b0 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:56.968649 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5c9ddf19-a2e7-4de4-a765-379be0d0c6b0 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] [instance: 10efe0de-fffd-415e-af3d-06d750fea3d4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:56.977803 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c9ddf19-a2e7-4de4-a765-379be0d0c6b0 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:56.978573 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c9ddf19-a2e7-4de4-a765-379be0d0c6b0 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:56.979285 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c9ddf19-a2e7-4de4-a765-379be0d0c6b0 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:56.980220 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c9ddf19-a2e7-4de4-a765-379be0d0c6b0 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:56.980936 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c9ddf19-a2e7-4de4-a765-379be0d0c6b0 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:56.981601 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c9ddf19-a2e7-4de4-a765-379be0d0c6b0 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:57.369838 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7ace7a52-86d3-43b7-84c4-f819aa10f4b7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:57.378889 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7ace7a52-86d3-43b7-84c4-f819aa10f4b7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 200 len: 1212 microversion: 2.1 time: 0.468791 Sep 10 11:42:57.379578 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 595/1226] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:56 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 1212 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:57.396387 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4292340b-8f06-48ef-845d-551b3158b634 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:57.397269 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4292340b-8f06-48ef-845d-551b3158b634 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:57.423211 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4292340b-8f06-48ef-845d-551b3158b634 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:57.427036 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4292340b-8f06-48ef-845d-551b3158b634 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:57.428467 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4292340b-8f06-48ef-845d-551b3158b634 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:57.432351 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4292340b-8f06-48ef-845d-551b3158b634 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:57.435899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4292340b-8f06-48ef-845d-551b3158b634 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:57.440383 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4292340b-8f06-48ef-845d-551b3158b634 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:57.685068 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5c9ddf19-a2e7-4de4-a765-379be0d0c6b0 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1592ac1d534dc283392ff5d68765ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513f3ad4f9d147a5b9ac652fa5fcde04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:57.699439 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5c9ddf19-a2e7-4de4-a765-379be0d0c6b0 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] 10.222.0.23 "GET /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4" status: 200 len: 1332 microversion: 2.1 time: 0.733702 Sep 10 11:42:57.701854 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 632/1227] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:56 2022] GET /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4 => generated 1332 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:57.724248 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-14cb21bf-e803-4d83-b629-96118efedbbe tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:57.725098 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-14cb21bf-e803-4d83-b629-96118efedbbe tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:57.751788 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-14cb21bf-e803-4d83-b629-96118efedbbe tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:57.755567 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-14cb21bf-e803-4d83-b629-96118efedbbe tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:57.758345 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-14cb21bf-e803-4d83-b629-96118efedbbe tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:57.761777 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-14cb21bf-e803-4d83-b629-96118efedbbe tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:57.763386 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-14cb21bf-e803-4d83-b629-96118efedbbe tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:57.765601 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-14cb21bf-e803-4d83-b629-96118efedbbe tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:58.259410 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-14cb21bf-e803-4d83-b629-96118efedbbe tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c97b7605a40ebac26884a59ea3902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ad59d8440a49c496acbede9848e944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:58.267579 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-14cb21bf-e803-4d83-b629-96118efedbbe tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b" status: 200 len: 1576 microversion: 2.1 time: 0.564328 Sep 10 11:42:58.268383 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 633/1228] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:57 2022] GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b => generated 1576 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:58.292402 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-88e3a468-ad2f-4833-8acf-93f1e08a99e4 req-ddd761d6-e699-4fe6-b485-27ef4560ff78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53e36757-9924-4d03-a8c0-fe52a166ffc1", "tag": "42683686-90d1-4e9e-9012-b0ee66c9e930"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:58.307115 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-88e3a468-ad2f-4833-8acf-93f1e08a99e4 req-ddd761d6-e699-4fe6-b485-27ef4560ff78 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:58.307892 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-88e3a468-ad2f-4833-8acf-93f1e08a99e4 req-ddd761d6-e699-4fe6-b485-27ef4560ff78 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:58.308762 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-88e3a468-ad2f-4833-8acf-93f1e08a99e4 req-ddd761d6-e699-4fe6-b485-27ef4560ff78 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:58.321943 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-88e3a468-ad2f-4833-8acf-93f1e08a99e4 req-ddd761d6-e699-4fe6-b485-27ef4560ff78 service nova] Creating event network-changed:42683686-90d1-4e9e-9012-b0ee66c9e930 for instance 53e36757-9924-4d03-a8c0-fe52a166ffc1 on n-h1-856895-1 Sep 10 11:42:58.331600 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-88e3a468-ad2f-4833-8acf-93f1e08a99e4 req-ddd761d6-e699-4fe6-b485-27ef4560ff78 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057933 Sep 10 11:42:58.336094 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 634/1229] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:42:58.407536 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2b026012-8a2a-4ff0-8d0f-ec33eb64bfbd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:58.408839 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2b026012-8a2a-4ff0-8d0f-ec33eb64bfbd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:58.416609 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b026012-8a2a-4ff0-8d0f-ec33eb64bfbd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:58.417427 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b026012-8a2a-4ff0-8d0f-ec33eb64bfbd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:58.418036 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b026012-8a2a-4ff0-8d0f-ec33eb64bfbd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:58.419292 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b026012-8a2a-4ff0-8d0f-ec33eb64bfbd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:58.419905 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b026012-8a2a-4ff0-8d0f-ec33eb64bfbd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:58.420688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b026012-8a2a-4ff0-8d0f-ec33eb64bfbd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:58.497109 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4292340b-8f06-48ef-845d-551b3158b634 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:58.514599 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4292340b-8f06-48ef-845d-551b3158b634 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1719 microversion: 2.1 time: 1.133919 Sep 10 11:42:58.517590 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 596/1230] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:57 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1719 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:58.608739 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2b026012-8a2a-4ff0-8d0f-ec33eb64bfbd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:58.624172 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2b026012-8a2a-4ff0-8d0f-ec33eb64bfbd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 200 len: 1264 microversion: 2.1 time: 0.220323 Sep 10 11:42:58.626021 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 635/1231] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:58 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 1264 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:58.723111 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c03f8c19-38d5-4cd5-a334-98ab05dcf837 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:58.723813 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c03f8c19-38d5-4cd5-a334-98ab05dcf837 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] [instance: 10efe0de-fffd-415e-af3d-06d750fea3d4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:58.732995 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c03f8c19-38d5-4cd5-a334-98ab05dcf837 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:58.734196 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c03f8c19-38d5-4cd5-a334-98ab05dcf837 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:58.734993 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c03f8c19-38d5-4cd5-a334-98ab05dcf837 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:58.735928 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c03f8c19-38d5-4cd5-a334-98ab05dcf837 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:58.736566 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c03f8c19-38d5-4cd5-a334-98ab05dcf837 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:58.737169 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c03f8c19-38d5-4cd5-a334-98ab05dcf837 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:59.294622 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a47b68b6-4f9b-465e-948f-055e1258817d tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:59.295541 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a47b68b6-4f9b-465e-948f-055e1258817d tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:59.308185 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a47b68b6-4f9b-465e-948f-055e1258817d tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:59.308947 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a47b68b6-4f9b-465e-948f-055e1258817d tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:59.309398 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a47b68b6-4f9b-465e-948f-055e1258817d tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:59.310115 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a47b68b6-4f9b-465e-948f-055e1258817d tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:59.310577 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a47b68b6-4f9b-465e-948f-055e1258817d tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:59.311008 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a47b68b6-4f9b-465e-948f-055e1258817d tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:59.317947 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c03f8c19-38d5-4cd5-a334-98ab05dcf837 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1592ac1d534dc283392ff5d68765ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513f3ad4f9d147a5b9ac652fa5fcde04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:59.330541 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c03f8c19-38d5-4cd5-a334-98ab05dcf837 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] 10.222.0.23 "GET /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4" status: 200 len: 1332 microversion: 2.1 time: 0.611844 Sep 10 11:42:59.346681 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 597/1232] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:58 2022] GET /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4 => generated 1332 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:59.524895 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-cda48531-12b2-47ca-b7fb-20c4755b64ed req-96c8096b-455f-481c-bc93-ad1fed5f22f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10efe0de-fffd-415e-af3d-06d750fea3d4", "tag": "8551ac91-90ed-4c01-9cfa-ec23da24cb18"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:59.549804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-cda48531-12b2-47ca-b7fb-20c4755b64ed req-96c8096b-455f-481c-bc93-ad1fed5f22f6 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:59.550533 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-cda48531-12b2-47ca-b7fb-20c4755b64ed req-96c8096b-455f-481c-bc93-ad1fed5f22f6 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:59.551143 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-cda48531-12b2-47ca-b7fb-20c4755b64ed req-96c8096b-455f-481c-bc93-ad1fed5f22f6 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:59.579767 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-cda48531-12b2-47ca-b7fb-20c4755b64ed req-96c8096b-455f-481c-bc93-ad1fed5f22f6 service nova] Creating event network-changed:8551ac91-90ed-4c01-9cfa-ec23da24cb18 for instance 10efe0de-fffd-415e-af3d-06d750fea3d4 on n-h2-856895-1 Sep 10 11:42:59.588392 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-cda48531-12b2-47ca-b7fb-20c4755b64ed req-96c8096b-455f-481c-bc93-ad1fed5f22f6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069470 Sep 10 11:42:59.589154 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 598/1233] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:42:59.601696 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-393be991-84a0-408f-8eb1-0a8d04d96230 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:59.603258 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-393be991-84a0-408f-8eb1-0a8d04d96230 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:59.612978 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-393be991-84a0-408f-8eb1-0a8d04d96230 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:59.628087 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-393be991-84a0-408f-8eb1-0a8d04d96230 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:59.628454 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-393be991-84a0-408f-8eb1-0a8d04d96230 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:59.629204 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-393be991-84a0-408f-8eb1-0a8d04d96230 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:59.629850 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-393be991-84a0-408f-8eb1-0a8d04d96230 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:59.630465 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-393be991-84a0-408f-8eb1-0a8d04d96230 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:59.742773 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a47b68b6-4f9b-465e-948f-055e1258817d tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c97b7605a40ebac26884a59ea3902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ad59d8440a49c496acbede9848e944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:59.757681 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a47b68b6-4f9b-465e-948f-055e1258817d tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b" status: 200 len: 1569 microversion: 2.1 time: 0.467407 Sep 10 11:42:59.771743 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 636/1234] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:59 2022] GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b => generated 1569 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:42:59.784224 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6033b59b-f9a3-4775-b058-327a3c2db5e5 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:42:59.785115 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6033b59b-f9a3-4775-b058-327a3c2db5e5 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:59.793168 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6033b59b-f9a3-4775-b058-327a3c2db5e5 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:59.794001 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6033b59b-f9a3-4775-b058-327a3c2db5e5 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:59.794661 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6033b59b-f9a3-4775-b058-327a3c2db5e5 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:59.795635 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6033b59b-f9a3-4775-b058-327a3c2db5e5 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:42:59.796301 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6033b59b-f9a3-4775-b058-327a3c2db5e5 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:42:59.796944 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6033b59b-f9a3-4775-b058-327a3c2db5e5 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:42:59.952819 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6033b59b-f9a3-4775-b058-327a3c2db5e5 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:42:59.963760 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6033b59b-f9a3-4775-b058-327a3c2db5e5 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 200 len: 1270 microversion: 2.1 time: 0.190686 Sep 10 11:42:59.981452 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 637/1235] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:59 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 1270 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:42:59.989738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-41decedb-e2ac-4b1d-bf4e-36a6f16b2897 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-866133115"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:42:59.990580 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-41decedb-e2ac-4b1d-bf4e-36a6f16b2897 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:42:59.999632 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:43:00.001285 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-41decedb-e2ac-4b1d-bf4e-36a6f16b2897 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:00.002380 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-41decedb-e2ac-4b1d-bf4e-36a6f16b2897 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:00.003145 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-41decedb-e2ac-4b1d-bf4e-36a6f16b2897 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:00.005037 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-41decedb-e2ac-4b1d-bf4e-36a6f16b2897 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:00.005515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-41decedb-e2ac-4b1d-bf4e-36a6f16b2897 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:00.005953 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-41decedb-e2ac-4b1d-bf4e-36a6f16b2897 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:00.070536 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-393be991-84a0-408f-8eb1-0a8d04d96230 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:00.081744 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-393be991-84a0-408f-8eb1-0a8d04d96230 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1719 microversion: 2.1 time: 0.491200 Sep 10 11:43:00.091926 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 599/1236] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:42:59 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1719 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:00.277549 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.network.security_group_api [None req-41decedb-e2ac-4b1d-bf4e-36a6f16b2897 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Adding security group b8977a68-f4a5-4b6c-97dc-b77ddd7ea5db to port c20fba89-fdc5-478a-a6aa-9199ad9ddcce Sep 10 11:43:00.359576 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-84378d62-f975-4a55-af06-059611754a0e tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:00.360200 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-84378d62-f975-4a55-af06-059611754a0e tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] [instance: 10efe0de-fffd-415e-af3d-06d750fea3d4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:00.370559 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-84378d62-f975-4a55-af06-059611754a0e tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:00.371073 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-84378d62-f975-4a55-af06-059611754a0e tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:00.375730 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-84378d62-f975-4a55-af06-059611754a0e tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:00.377246 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-84378d62-f975-4a55-af06-059611754a0e tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:00.378872 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-84378d62-f975-4a55-af06-059611754a0e tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:00.380368 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-84378d62-f975-4a55-af06-059611754a0e tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:00.738935 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-84378d62-f975-4a55-af06-059611754a0e tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1592ac1d534dc283392ff5d68765ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513f3ad4f9d147a5b9ac652fa5fcde04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:00.778837 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-84378d62-f975-4a55-af06-059611754a0e tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] 10.222.0.23 "GET /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4" status: 200 len: 1332 microversion: 2.1 time: 0.422908 Sep 10 11:43:00.783816 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 600/1237] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:00 2022] GET /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4 => generated 1332 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:00.987454 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ace5bd16-0714-4f57-8982-e33f15474e42 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:00.991503 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ace5bd16-0714-4f57-8982-e33f15474e42 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:00.995122 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ace5bd16-0714-4f57-8982-e33f15474e42 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:00.995982 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ace5bd16-0714-4f57-8982-e33f15474e42 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:00.996611 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ace5bd16-0714-4f57-8982-e33f15474e42 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:00.997509 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ace5bd16-0714-4f57-8982-e33f15474e42 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:00.998168 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ace5bd16-0714-4f57-8982-e33f15474e42 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:00.998791 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ace5bd16-0714-4f57-8982-e33f15474e42 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:01.041913 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-41decedb-e2ac-4b1d-bf4e-36a6f16b2897 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "POST /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b/action" status: 202 len: 0 microversion: 2.1 time: 1.057890 Sep 10 11:43:01.042532 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 638/1238] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:42:59 2022] POST /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b/action => generated 0 bytes in 1060 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:43:01.053936 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a66df5d9-aa0f-48c8-b6b3-2261da09d64c tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '.version_select at 0x7f40731020d0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:01.324993 n-d-856895-1 devstack@n-api.service[128777]: DEBUG neutronclient.v2_0.client [None req-a66df5d9-aa0f-48c8-b6b3-2261da09d64c tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group b8977a68-f4a5-4b6c-97dc-b77ddd7ea5db in use.", "detail": ""}} {{(pid=128777) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 11:43:01.325693 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-a66df5d9-aa0f-48c8-b6b3-2261da09d64c tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] HTTP exception thrown: Security Group b8977a68-f4a5-4b6c-97dc-b77ddd7ea5db in use. Sep 10 11:43:01.325693 n-d-856895-1 devstack@n-api.service[128777]: Neutron server returns request_ids: ['req-c6bdad8e-7e3d-419f-9cd0-bd12056e22a3'] Sep 10 11:43:01.325939 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ace5bd16-0714-4f57-8982-e33f15474e42 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a66df5d9-aa0f-48c8-b6b3-2261da09d64c tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Request method failure captured: Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/os-security-groups/b8977a68-f4a5-4b6c-97dc-b77ddd7ea5db HTTP/1.1 Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHgBU0aZ9PqJpGA422fKNy27Wjo5sOCfo4CIswXFFfdPv36WiPjLOYw_neMbOsaeYNKIXkVSp0pEYCo9771BWqsl0fjBWyX6S3skhskK7a85wRu3ZuO-FXP422rQwCRC9xzOeesr0UvY-AFVf9_IuIXQit7YUH71vPa-NVExdrtG-MY Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 91ad59d8440a49c496acbede9848e944 Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ad59d8440a49c496acbede9848e944"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ad59d8440a49c496acbede9848e944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_91ad59d8440a49c496acbede9848e944", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/91ad59d8440a49c496acbede9848e944"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 91ad59d8440a49c496acbede9848e944 Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-SecurityGroupsTestJSON-1578123858-project Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 080c97b7605a40ebac26884a59ea3902 Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-SecurityGroupsTestJSON-1578123858-project Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: exception: Security Group b8977a68-f4a5-4b6c-97dc-b77ddd7ea5db in use. Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: Neutron server returns request_ids: ['req-c6bdad8e-7e3d-419f-9cd0-bd12056e22a3'] Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'b8977a68-f4a5-4b6c-97dc-b77ddd7ea5db'} Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 11:43:01.327738 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group b8977a68-f4a5-4b6c-97dc-b77ddd7ea5db in use. Sep 10 11:43:01.332745 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6bdad8e-7e3d-419f-9cd0-bd12056e22a3'] Sep 10 11:43:01.332745 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:01.332745 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:01.332745 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:01.332745 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:01.332745 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 10 11:43:01.332745 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 10 11:43:01.332745 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 10 11:43:01.332745 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 10 11:43:01.332745 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group b8977a68-f4a5-4b6c-97dc-b77ddd7ea5db in use. Sep 10 11:43:01.332745 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6bdad8e-7e3d-419f-9cd0-bd12056e22a3'] Sep 10 11:43:01.332745 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:01.332745 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:01.332745 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:01.332745 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:01.332745 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:43:01.332745 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:43:01.332745 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:43:01.332745 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:43:01.332745 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:43:01.332745 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:43:01.332745 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:43:01.332745 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:43:01.332745 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 10 11:43:01.332745 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 10 11:43:01.332745 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group b8977a68-f4a5-4b6c-97dc-b77ddd7ea5db in use. Sep 10 11:43:01.332745 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6bdad8e-7e3d-419f-9cd0-bd12056e22a3'] Sep 10 11:43:01.332745 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:01.332745 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:01.332745 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:01.332745 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:01.332745 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:43:01.332745 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:43:01.332745 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:43:01.332745 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:43:01.332745 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group b8977a68-f4a5-4b6c-97dc-b77ddd7ea5db in use. Sep 10 11:43:01.332745 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6bdad8e-7e3d-419f-9cd0-bd12056e22a3'] Sep 10 11:43:01.332745 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:01.332745 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a66df5d9-aa0f-48c8-b6b3-2261da09d64c tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Returning 400 to user: Security Group b8977a68-f4a5-4b6c-97dc-b77ddd7ea5db in use. Sep 10 11:43:01.332745 n-d-856895-1 devstack@n-api.service[128777]: Neutron server returns request_ids: ['req-c6bdad8e-7e3d-419f-9cd0-bd12056e22a3'] {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:43:01.332745 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a66df5d9-aa0f-48c8-b6b3-2261da09d64c tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/b8977a68-f4a5-4b6c-97dc-b77ddd7ea5db" status: 400 len: 185 microversion: 2.1 time: 0.282650 Sep 10 11:43:01.332745 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 639/1239] 10.222.0.23 () {58 vars in 1272 bytes} [Sat Sep 10 11:43:01 2022] DELETE /compute/v2.1/os-security-groups/b8977a68-f4a5-4b6c-97dc-b77ddd7ea5db => generated 185 bytes in 284 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:43:01.337765 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1a78ae95-0701-4544-99d8-593a86aa94f5 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:01.341683 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1a78ae95-0701-4544-99d8-593a86aa94f5 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:01.344057 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ace5bd16-0714-4f57-8982-e33f15474e42 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 200 len: 1312 microversion: 2.1 time: 0.360282 Sep 10 11:43:01.345631 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 601/1240] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:00 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 1312 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:01.353877 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1a78ae95-0701-4544-99d8-593a86aa94f5 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:01.354376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1a78ae95-0701-4544-99d8-593a86aa94f5 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:01.354847 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1a78ae95-0701-4544-99d8-593a86aa94f5 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:01.355599 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1a78ae95-0701-4544-99d8-593a86aa94f5 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:01.356063 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1a78ae95-0701-4544-99d8-593a86aa94f5 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:01.356496 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1a78ae95-0701-4544-99d8-593a86aa94f5 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:01.364291 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-90a88e9b-9186-48c7-b304-70a8dc0df40c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:01.364998 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-90a88e9b-9186-48c7-b304-70a8dc0df40c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:01.373917 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90a88e9b-9186-48c7-b304-70a8dc0df40c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:01.374555 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90a88e9b-9186-48c7-b304-70a8dc0df40c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:01.375113 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90a88e9b-9186-48c7-b304-70a8dc0df40c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:01.376263 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90a88e9b-9186-48c7-b304-70a8dc0df40c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:01.376944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90a88e9b-9186-48c7-b304-70a8dc0df40c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:01.377597 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90a88e9b-9186-48c7-b304-70a8dc0df40c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:01.422217 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:43:01.623555 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-1a78ae95-0701-4544-99d8-593a86aa94f5 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lazy-loading 'services' on Instance uuid 50d20272-889d-4b72-b33d-73094c78c7b4 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:43:01.657687 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1a78ae95-0701-4544-99d8-593a86aa94f5 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 2341 microversion: 2.25 time: 0.326641 Sep 10 11:43:01.670173 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 640/1241] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:43:01 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 2341 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:43:01.680155 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fdeeaea2-363c-4899-a8b0-bdfdc6a91e99 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:01.688619 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fdeeaea2-363c-4899-a8b0-bdfdc6a91e99 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:01.706228 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdeeaea2-363c-4899-a8b0-bdfdc6a91e99 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:01.708190 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdeeaea2-363c-4899-a8b0-bdfdc6a91e99 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:01.710512 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdeeaea2-363c-4899-a8b0-bdfdc6a91e99 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:01.711589 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdeeaea2-363c-4899-a8b0-bdfdc6a91e99 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:01.712326 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdeeaea2-363c-4899-a8b0-bdfdc6a91e99 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:01.713875 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-90a88e9b-9186-48c7-b304-70a8dc0df40c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:01.714043 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdeeaea2-363c-4899-a8b0-bdfdc6a91e99 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:01.725079 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-90a88e9b-9186-48c7-b304-70a8dc0df40c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1719 microversion: 2.1 time: 0.378246 Sep 10 11:43:01.725655 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 602/1242] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:01 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1719 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:01.749228 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-2cea760c-8aa2-4563-9555-b207b87647a2 req-26cfa8ed-8527-4ab6-ae6a-dbb1d64f6667 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b", "tag": "c20fba89-fdc5-478a-a6aa-9199ad9ddcce"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:43:01.755681 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fdeeaea2-363c-4899-a8b0-bdfdc6a91e99 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:43:01.764588 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-2cea760c-8aa2-4563-9555-b207b87647a2 req-26cfa8ed-8527-4ab6-ae6a-dbb1d64f6667 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:01.765368 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-2cea760c-8aa2-4563-9555-b207b87647a2 req-26cfa8ed-8527-4ab6-ae6a-dbb1d64f6667 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:01.766333 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-2cea760c-8aa2-4563-9555-b207b87647a2 req-26cfa8ed-8527-4ab6-ae6a-dbb1d64f6667 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:01.802018 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-2cea760c-8aa2-4563-9555-b207b87647a2 req-26cfa8ed-8527-4ab6-ae6a-dbb1d64f6667 service nova] Creating event network-changed:c20fba89-fdc5-478a-a6aa-9199ad9ddcce for instance 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b on n-h1-856895-1 Sep 10 11:43:01.810653 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-2cea760c-8aa2-4563-9555-b207b87647a2 req-26cfa8ed-8527-4ab6-ae6a-dbb1d64f6667 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068385 Sep 10 11:43:01.811862 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 603/1243] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:43:01.818867 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a02d14a0-3bef-4715-b4a3-4ebac7c72768 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:01.824858 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a02d14a0-3bef-4715-b4a3-4ebac7c72768 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:01.826242 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a02d14a0-3bef-4715-b4a3-4ebac7c72768 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:01.826863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a02d14a0-3bef-4715-b4a3-4ebac7c72768 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:01.828388 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a02d14a0-3bef-4715-b4a3-4ebac7c72768 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:01.829130 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a02d14a0-3bef-4715-b4a3-4ebac7c72768 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:01.829975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a02d14a0-3bef-4715-b4a3-4ebac7c72768 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:01.903989 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fdeeaea2-363c-4899-a8b0-bdfdc6a91e99 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b" status: 204 len: 0 microversion: 2.1 time: 0.228971 Sep 10 11:43:01.907031 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 641/1244] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:43:01 2022] DELETE /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:43:01.910167 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a02d14a0-3bef-4715-b4a3-4ebac7c72768 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.093146 Sep 10 11:43:01.928104 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7fd48e64-ef08-488e-9d20-c44732b52ea8 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:01.928904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7fd48e64-ef08-488e-9d20-c44732b52ea8 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] [instance: 10efe0de-fffd-415e-af3d-06d750fea3d4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:01.934351 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 604/1245] 10.222.0.23 () {60 vars in 1217 bytes} [Sat Sep 10 11:43:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:43:01.940766 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f49c6675-e2f7-4cc3-9fba-6e0ea542a6b9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:01.943354 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f49c6675-e2f7-4cc3-9fba-6e0ea542a6b9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:01.950795 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7fd48e64-ef08-488e-9d20-c44732b52ea8 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:01.952809 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7fd48e64-ef08-488e-9d20-c44732b52ea8 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:01.953287 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7fd48e64-ef08-488e-9d20-c44732b52ea8 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:01.957512 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7fd48e64-ef08-488e-9d20-c44732b52ea8 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:01.958227 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7fd48e64-ef08-488e-9d20-c44732b52ea8 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:01.958939 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7fd48e64-ef08-488e-9d20-c44732b52ea8 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:01.966745 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f49c6675-e2f7-4cc3-9fba-6e0ea542a6b9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:01.967296 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f49c6675-e2f7-4cc3-9fba-6e0ea542a6b9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:01.967735 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f49c6675-e2f7-4cc3-9fba-6e0ea542a6b9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:01.968648 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f49c6675-e2f7-4cc3-9fba-6e0ea542a6b9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:01.970847 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f49c6675-e2f7-4cc3-9fba-6e0ea542a6b9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:01.971915 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f49c6675-e2f7-4cc3-9fba-6e0ea542a6b9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:02.443297 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7fd48e64-ef08-488e-9d20-c44732b52ea8 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1592ac1d534dc283392ff5d68765ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513f3ad4f9d147a5b9ac652fa5fcde04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:02.460963 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7fd48e64-ef08-488e-9d20-c44732b52ea8 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] 10.222.0.23 "GET /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4" status: 200 len: 1332 microversion: 2.1 time: 0.549428 Sep 10 11:43:02.471791 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 642/1246] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:01 2022] GET /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4 => generated 1332 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:02.489063 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9139e071-acc8-47b3-b770-a7f22e21bc8a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:02.489717 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9139e071-acc8-47b3-b770-a7f22e21bc8a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:02.503346 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9139e071-acc8-47b3-b770-a7f22e21bc8a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:02.503853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9139e071-acc8-47b3-b770-a7f22e21bc8a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:02.504296 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9139e071-acc8-47b3-b770-a7f22e21bc8a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:02.505629 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9139e071-acc8-47b3-b770-a7f22e21bc8a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:02.506097 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9139e071-acc8-47b3-b770-a7f22e21bc8a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:02.506599 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9139e071-acc8-47b3-b770-a7f22e21bc8a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:02.583615 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f49c6675-e2f7-4cc3-9fba-6e0ea542a6b9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c97b7605a40ebac26884a59ea3902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ad59d8440a49c496acbede9848e944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:02.600193 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f49c6675-e2f7-4cc3-9fba-6e0ea542a6b9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b" status: 200 len: 1643 microversion: 2.1 time: 0.664454 Sep 10 11:43:02.611615 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 605/1247] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:01 2022] GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b => generated 1643 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:02.752610 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fd66c61c-c486-402a-80e2-5351a61c246b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:02.754224 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fd66c61c-c486-402a-80e2-5351a61c246b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:02.761825 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fd66c61c-c486-402a-80e2-5351a61c246b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:02.762604 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fd66c61c-c486-402a-80e2-5351a61c246b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:02.763267 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fd66c61c-c486-402a-80e2-5351a61c246b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:02.764161 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fd66c61c-c486-402a-80e2-5351a61c246b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:02.764795 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fd66c61c-c486-402a-80e2-5351a61c246b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:02.765452 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fd66c61c-c486-402a-80e2-5351a61c246b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:02.898110 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9139e071-acc8-47b3-b770-a7f22e21bc8a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:02.904999 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:43:02.907952 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9139e071-acc8-47b3-b770-a7f22e21bc8a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 200 len: 1312 microversion: 2.1 time: 0.434843 Sep 10 11:43:02.908553 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 643/1248] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:02 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 1312 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:03.056123 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fd66c61c-c486-402a-80e2-5351a61c246b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:03.080455 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fd66c61c-c486-402a-80e2-5351a61c246b tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1719 microversion: 2.1 time: 0.331469 Sep 10 11:43:03.081360 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 606/1249] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:02 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1719 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:43:03.487908 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7b55665a-387f-41dc-ace4-c6832e33b895 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:03.490067 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7b55665a-387f-41dc-ace4-c6832e33b895 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] [instance: 10efe0de-fffd-415e-af3d-06d750fea3d4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:03.516888 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b55665a-387f-41dc-ace4-c6832e33b895 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:03.521349 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b55665a-387f-41dc-ace4-c6832e33b895 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:03.528186 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b55665a-387f-41dc-ace4-c6832e33b895 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:03.529057 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b55665a-387f-41dc-ace4-c6832e33b895 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:03.530151 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b55665a-387f-41dc-ace4-c6832e33b895 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:03.532119 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b55665a-387f-41dc-ace4-c6832e33b895 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:03.633316 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-02084c39-3d8c-4f9c-9273-3c8c7360a89a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:03.634424 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-02084c39-3d8c-4f9c-9273-3c8c7360a89a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:03.678019 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02084c39-3d8c-4f9c-9273-3c8c7360a89a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:03.678775 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02084c39-3d8c-4f9c-9273-3c8c7360a89a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:03.684017 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02084c39-3d8c-4f9c-9273-3c8c7360a89a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:03.684886 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02084c39-3d8c-4f9c-9273-3c8c7360a89a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:03.685449 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02084c39-3d8c-4f9c-9273-3c8c7360a89a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:03.686006 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02084c39-3d8c-4f9c-9273-3c8c7360a89a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:04.322161 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-02084c39-3d8c-4f9c-9273-3c8c7360a89a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c97b7605a40ebac26884a59ea3902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ad59d8440a49c496acbede9848e944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:04.330198 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-02084c39-3d8c-4f9c-9273-3c8c7360a89a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b" status: 200 len: 1643 microversion: 2.1 time: 0.703672 Sep 10 11:43:04.330785 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 607/1250] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:03 2022] GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b => generated 1643 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:04.353210 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-15f0546d-9fc8-4e6f-8c83-6f287b3d0a93 req-6e259d4f-2618-4d2c-8344-345dd5405fda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68861799-4265-42f8-a24a-dd78f3d6745a", "tag": "588ba4ca-8af7-4faa-a475-eb41a709948d"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:43:04.370727 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-15f0546d-9fc8-4e6f-8c83-6f287b3d0a93 req-6e259d4f-2618-4d2c-8344-345dd5405fda service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:04.373445 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-15f0546d-9fc8-4e6f-8c83-6f287b3d0a93 req-6e259d4f-2618-4d2c-8344-345dd5405fda service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:04.374139 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-15f0546d-9fc8-4e6f-8c83-6f287b3d0a93 req-6e259d4f-2618-4d2c-8344-345dd5405fda service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:04.411468 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-15f0546d-9fc8-4e6f-8c83-6f287b3d0a93 req-6e259d4f-2618-4d2c-8344-345dd5405fda service nova] Creating event network-changed:588ba4ca-8af7-4faa-a475-eb41a709948d for instance 68861799-4265-42f8-a24a-dd78f3d6745a on n-h2-856895-1 Sep 10 11:43:04.419621 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-15f0546d-9fc8-4e6f-8c83-6f287b3d0a93 req-6e259d4f-2618-4d2c-8344-345dd5405fda service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077066 Sep 10 11:43:04.424722 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 608/1251] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:43:04.438338 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cc353456-52b8-4342-9845-f5867eddd736 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:04.439485 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cc353456-52b8-4342-9845-f5867eddd736 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:04.454260 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cc353456-52b8-4342-9845-f5867eddd736 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:04.456831 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cc353456-52b8-4342-9845-f5867eddd736 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:04.459837 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cc353456-52b8-4342-9845-f5867eddd736 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:04.460954 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cc353456-52b8-4342-9845-f5867eddd736 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:04.461772 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cc353456-52b8-4342-9845-f5867eddd736 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:04.463062 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cc353456-52b8-4342-9845-f5867eddd736 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:04.699455 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7b55665a-387f-41dc-ace4-c6832e33b895 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1592ac1d534dc283392ff5d68765ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513f3ad4f9d147a5b9ac652fa5fcde04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:04.716766 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7b55665a-387f-41dc-ace4-c6832e33b895 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] 10.222.0.23 "GET /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4" status: 200 len: 1332 microversion: 2.1 time: 1.233078 Sep 10 11:43:04.719242 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 644/1252] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:03 2022] GET /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4 => generated 1332 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:04.725236 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6e293377-2d29-4060-a23d-cb1c2c54d4c0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:04.731100 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6e293377-2d29-4060-a23d-cb1c2c54d4c0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:04.738062 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6e293377-2d29-4060-a23d-cb1c2c54d4c0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:04.738809 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6e293377-2d29-4060-a23d-cb1c2c54d4c0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:04.739498 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6e293377-2d29-4060-a23d-cb1c2c54d4c0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:04.740410 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6e293377-2d29-4060-a23d-cb1c2c54d4c0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:04.741486 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6e293377-2d29-4060-a23d-cb1c2c54d4c0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:04.742119 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6e293377-2d29-4060-a23d-cb1c2c54d4c0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:04.885501 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-cc353456-52b8-4342-9845-f5867eddd736 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:04.900718 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cc353456-52b8-4342-9845-f5867eddd736 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 200 len: 1312 microversion: 2.1 time: 0.474282 Sep 10 11:43:04.901720 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 609/1253] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:04 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 1312 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:04.917845 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-70baaae9-559e-4bb7-af47-3d1c1e392a4d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2bbf3154-b7dc-4f5d-be37-74a2b6035fec", "device": "/dev/xvdb"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:43:04.929882 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-70baaae9-559e-4bb7-af47-3d1c1e392a4d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:04.937298 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-70baaae9-559e-4bb7-af47-3d1c1e392a4d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:04.938072 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-70baaae9-559e-4bb7-af47-3d1c1e392a4d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:04.938740 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-70baaae9-559e-4bb7-af47-3d1c1e392a4d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:04.939898 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-70baaae9-559e-4bb7-af47-3d1c1e392a4d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:04.940563 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-70baaae9-559e-4bb7-af47-3d1c1e392a4d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:04.941334 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-70baaae9-559e-4bb7-af47-3d1c1e392a4d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:05.359036 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6e293377-2d29-4060-a23d-cb1c2c54d4c0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:05.412940 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-70baaae9-559e-4bb7-af47-3d1c1e392a4d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "POST /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.475834 Sep 10 11:43:05.415153 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 610/1254] 10.222.0.23 () {62 vars in 1364 bytes} [Sat Sep 10 11:43:04 2022] POST /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4/os-volume_attachments => generated 194 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:43:05.416482 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6e293377-2d29-4060-a23d-cb1c2c54d4c0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1719 microversion: 2.1 time: 0.695383 Sep 10 11:43:05.422897 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 645/1255] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:04 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1719 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:05.452469 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4de10432-f0ec-4bb8-aeda-7483563eba24 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:05.453676 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4de10432-f0ec-4bb8-aeda-7483563eba24 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:05.482649 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4de10432-f0ec-4bb8-aeda-7483563eba24 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:05.497835 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4de10432-f0ec-4bb8-aeda-7483563eba24 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:05.500412 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4de10432-f0ec-4bb8-aeda-7483563eba24 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:05.505888 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4de10432-f0ec-4bb8-aeda-7483563eba24 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:05.507411 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4de10432-f0ec-4bb8-aeda-7483563eba24 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:05.509011 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4de10432-f0ec-4bb8-aeda-7483563eba24 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:05.738007 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4de10432-f0ec-4bb8-aeda-7483563eba24 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c97b7605a40ebac26884a59ea3902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ad59d8440a49c496acbede9848e944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:05.745777 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7497cd7d-aff4-4897-a21f-c9759d7dc4cf tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:05.746508 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7497cd7d-aff4-4897-a21f-c9759d7dc4cf tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] [instance: 10efe0de-fffd-415e-af3d-06d750fea3d4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:05.749460 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4de10432-f0ec-4bb8-aeda-7483563eba24 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b" status: 200 len: 1467 microversion: 2.1 time: 0.331068 Sep 10 11:43:05.753280 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 611/1256] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:05 2022] GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b => generated 1467 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:05.760044 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7497cd7d-aff4-4897-a21f-c9759d7dc4cf tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:05.760669 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7497cd7d-aff4-4897-a21f-c9759d7dc4cf tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:05.775849 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7497cd7d-aff4-4897-a21f-c9759d7dc4cf tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:05.781462 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7497cd7d-aff4-4897-a21f-c9759d7dc4cf tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:05.782485 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7497cd7d-aff4-4897-a21f-c9759d7dc4cf tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:05.783149 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7497cd7d-aff4-4897-a21f-c9759d7dc4cf tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:05.844527 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-83894a25-4652-4fb3-b39b-f381517531a9 req-6fe9df02-7001-4ed7-8124-9508376606ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10efe0de-fffd-415e-af3d-06d750fea3d4", "name": "network-vif-plugged", "status": "completed", "tag": "8551ac91-90ed-4c01-9cfa-ec23da24cb18"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:43:05.856858 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-83894a25-4652-4fb3-b39b-f381517531a9 req-6fe9df02-7001-4ed7-8124-9508376606ae service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:05.859639 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-83894a25-4652-4fb3-b39b-f381517531a9 req-6fe9df02-7001-4ed7-8124-9508376606ae service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:05.862859 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-83894a25-4652-4fb3-b39b-f381517531a9 req-6fe9df02-7001-4ed7-8124-9508376606ae service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:05.888298 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-83894a25-4652-4fb3-b39b-f381517531a9 req-6fe9df02-7001-4ed7-8124-9508376606ae service nova] Creating event network-vif-plugged:8551ac91-90ed-4c01-9cfa-ec23da24cb18 for instance 10efe0de-fffd-415e-af3d-06d750fea3d4 on n-h2-856895-1 Sep 10 11:43:05.901567 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-83894a25-4652-4fb3-b39b-f381517531a9 req-6fe9df02-7001-4ed7-8124-9508376606ae service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076151 Sep 10 11:43:05.908670 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 612/1257] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 10 11:43:05.924966 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ffc36005-bab0-45c1-856a-37658c82a84a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:05.925677 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ffc36005-bab0-45c1-856a-37658c82a84a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:05.938960 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ffc36005-bab0-45c1-856a-37658c82a84a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:05.939733 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ffc36005-bab0-45c1-856a-37658c82a84a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:05.943643 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ffc36005-bab0-45c1-856a-37658c82a84a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:05.944699 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ffc36005-bab0-45c1-856a-37658c82a84a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:05.945424 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ffc36005-bab0-45c1-856a-37658c82a84a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:05.946873 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ffc36005-bab0-45c1-856a-37658c82a84a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:06.544814 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7497cd7d-aff4-4897-a21f-c9759d7dc4cf tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1592ac1d534dc283392ff5d68765ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513f3ad4f9d147a5b9ac652fa5fcde04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:06.559413 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7497cd7d-aff4-4897-a21f-c9759d7dc4cf tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] 10.222.0.23 "GET /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4" status: 200 len: 1332 microversion: 2.1 time: 0.819011 Sep 10 11:43:06.571546 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 646/1258] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:05 2022] GET /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4 => generated 1332 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:06.586033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ffc36005-bab0-45c1-856a-37658c82a84a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:06.614390 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-e0401777-6ff4-4f8e-bc87-153a5b6c065c req-5905de82-b39c-4162-a611-75a26336f421 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b", "name": "network-vif-deleted", "tag": "c20fba89-fdc5-478a-a6aa-9199ad9ddcce"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:43:06.615708 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ffc36005-bab0-45c1-856a-37658c82a84a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 200 len: 1312 microversion: 2.1 time: 0.694877 Sep 10 11:43:06.617093 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 613/1259] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:05 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 1312 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:06.631100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6a35c1dc-ce95-4c59-a5f4-93183e323300 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:06.632157 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6a35c1dc-ce95-4c59-a5f4-93183e323300 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:06.637549 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e0401777-6ff4-4f8e-bc87-153a5b6c065c req-5905de82-b39c-4162-a611-75a26336f421 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:06.637786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e0401777-6ff4-4f8e-bc87-153a5b6c065c req-5905de82-b39c-4162-a611-75a26336f421 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:06.638080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e0401777-6ff4-4f8e-bc87-153a5b6c065c req-5905de82-b39c-4162-a611-75a26336f421 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:06.655501 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6a35c1dc-ce95-4c59-a5f4-93183e323300 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:06.656529 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6a35c1dc-ce95-4c59-a5f4-93183e323300 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:06.660560 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6a35c1dc-ce95-4c59-a5f4-93183e323300 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:06.661648 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6a35c1dc-ce95-4c59-a5f4-93183e323300 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:06.662357 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6a35c1dc-ce95-4c59-a5f4-93183e323300 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:06.663008 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6a35c1dc-ce95-4c59-a5f4-93183e323300 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:06.666788 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-e0401777-6ff4-4f8e-bc87-153a5b6c065c req-5905de82-b39c-4162-a611-75a26336f421 service nova] Creating event network-vif-deleted:c20fba89-fdc5-478a-a6aa-9199ad9ddcce for instance 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b on n-h1-856895-1 Sep 10 11:43:06.678205 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-e0401777-6ff4-4f8e-bc87-153a5b6c065c req-5905de82-b39c-4162-a611-75a26336f421 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108595 Sep 10 11:43:06.682935 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 647/1260] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:43:06.777955 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=4 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:43:06.783845 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d7d59b35-7b34-47e2-996d-b2248f24e9e9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:06.784553 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d7d59b35-7b34-47e2-996d-b2248f24e9e9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:06.798952 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=12 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:43:06.804439 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d7d59b35-7b34-47e2-996d-b2248f24e9e9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:06.807610 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d7d59b35-7b34-47e2-996d-b2248f24e9e9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:06.809611 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d7d59b35-7b34-47e2-996d-b2248f24e9e9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:06.810803 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d7d59b35-7b34-47e2-996d-b2248f24e9e9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:06.812996 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d7d59b35-7b34-47e2-996d-b2248f24e9e9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:06.813640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d7d59b35-7b34-47e2-996d-b2248f24e9e9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:06.889482 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d7d59b35-7b34-47e2-996d-b2248f24e9e9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:06.890355 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d7d59b35-7b34-47e2-996d-b2248f24e9e9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:06.891014 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d7d59b35-7b34-47e2-996d-b2248f24e9e9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:06.891716 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-d7d59b35-7b34-47e2-996d-b2248f24e9e9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lazy-loading 'fault' on Instance uuid 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:43:07.083228 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d7d59b35-7b34-47e2-996d-b2248f24e9e9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c97b7605a40ebac26884a59ea3902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ad59d8440a49c496acbede9848e944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:07.092297 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d7d59b35-7b34-47e2-996d-b2248f24e9e9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b" status: 200 len: 1305 microversion: 2.1 time: 0.315196 Sep 10 11:43:07.097321 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 648/1261] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:06 2022] GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b => generated 1305 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:43:07.160659 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6a35c1dc-ce95-4c59-a5f4-93183e323300 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:07.176308 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6a35c1dc-ce95-4c59-a5f4-93183e323300 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1719 microversion: 2.1 time: 0.556339 Sep 10 11:43:07.179198 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 614/1262] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:06 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1719 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:07.592136 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c890e5e4-ed46-4ddc-9a47-174b86333dbd tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:07.592322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c890e5e4-ed46-4ddc-9a47-174b86333dbd tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] [instance: 10efe0de-fffd-415e-af3d-06d750fea3d4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:07.598692 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c890e5e4-ed46-4ddc-9a47-174b86333dbd tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:07.599634 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c890e5e4-ed46-4ddc-9a47-174b86333dbd tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:07.600246 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c890e5e4-ed46-4ddc-9a47-174b86333dbd tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:07.601156 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c890e5e4-ed46-4ddc-9a47-174b86333dbd tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:07.601800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c890e5e4-ed46-4ddc-9a47-174b86333dbd tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:07.603116 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c890e5e4-ed46-4ddc-9a47-174b86333dbd tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:07.646057 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a8da279b-d9a6-4793-8175-0b2d675e769e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:07.647679 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a8da279b-d9a6-4793-8175-0b2d675e769e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:07.674569 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=4 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:43:07.679087 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8da279b-d9a6-4793-8175-0b2d675e769e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:07.688686 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8da279b-d9a6-4793-8175-0b2d675e769e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:07.690596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8da279b-d9a6-4793-8175-0b2d675e769e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:07.699625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8da279b-d9a6-4793-8175-0b2d675e769e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:07.700310 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8da279b-d9a6-4793-8175-0b2d675e769e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:07.701251 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8da279b-d9a6-4793-8175-0b2d675e769e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:07.989098 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c890e5e4-ed46-4ddc-9a47-174b86333dbd tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1592ac1d534dc283392ff5d68765ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513f3ad4f9d147a5b9ac652fa5fcde04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:08.005631 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c890e5e4-ed46-4ddc-9a47-174b86333dbd tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] 10.222.0.23 "GET /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4" status: 200 len: 1332 microversion: 2.1 time: 0.418396 Sep 10 11:43:08.025575 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 649/1263] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:07 2022] GET /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4 => generated 1332 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:08.081965 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a8da279b-d9a6-4793-8175-0b2d675e769e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:08.096998 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a8da279b-d9a6-4793-8175-0b2d675e769e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 200 len: 1312 microversion: 2.1 time: 0.453002 Sep 10 11:43:08.099635 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 615/1264] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:07 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 1312 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:08.127179 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1c99bde9-add5-4c32-853a-4c29a47ede48 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:08.128065 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1c99bde9-add5-4c32-853a-4c29a47ede48 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:08.151835 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c99bde9-add5-4c32-853a-4c29a47ede48 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:08.154686 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c99bde9-add5-4c32-853a-4c29a47ede48 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:08.155967 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c99bde9-add5-4c32-853a-4c29a47ede48 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:08.159358 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c99bde9-add5-4c32-853a-4c29a47ede48 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:08.160549 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c99bde9-add5-4c32-853a-4c29a47ede48 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:08.161519 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c99bde9-add5-4c32-853a-4c29a47ede48 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:08.182522 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-1c99bde9-add5-4c32-853a-4c29a47ede48 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] HTTP exception thrown: Instance 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b could not be found. Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1c99bde9-add5-4c32-853a-4c29a47ede48 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Request method failure captured: Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b HTTP/1.1 Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHgBU0aZ9PqJpGA422fKNy27Wjo5sOCfo4CIswXFFfdPv36WiPjLOYw_neMbOsaeYNKIXkVSp0pEYCo9771BWqsl0fjBWyX6S3skhskK7a85wRu3ZuO-FXP422rQwCRC9xzOeesr0UvY-AFVf9_IuIXQit7YUH71vPa-NVExdrtG-MY Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 91ad59d8440a49c496acbede9848e944 Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ad59d8440a49c496acbede9848e944"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ad59d8440a49c496acbede9848e944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_91ad59d8440a49c496acbede9848e944", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/91ad59d8440a49c496acbede9848e944"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 91ad59d8440a49c496acbede9848e944 Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-SecurityGroupsTestJSON-1578123858-project Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 080c97b7605a40ebac26884a59ea3902 Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-SecurityGroupsTestJSON-1578123858-project Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b could not be found. Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b'} Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b could not be found. Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b could not be found. Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:08.184871 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:08.189231 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:08.189231 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:43:08.189231 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:43:08.189231 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:43:08.189231 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:43:08.189231 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b could not be found. Sep 10 11:43:08.189231 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:08.190962 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1c99bde9-add5-4c32-853a-4c29a47ede48 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Returning 404 to user: Instance 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:43:08.192043 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1c99bde9-add5-4c32-853a-4c29a47ede48 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b" status: 404 len: 111 microversion: 2.1 time: 0.069691 Sep 10 11:43:08.197156 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 650/1265] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:08 2022] GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:43:08.202701 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0a15de9b-13ce-4fed-bb05-1681489609ff tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '.version_select at 0x7f40735f8820>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:08.214919 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-163ec7ac-7482-4e6a-b288-63bc4a8eb0d1 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:08.215899 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-163ec7ac-7482-4e6a-b288-63bc4a8eb0d1 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:08.231518 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-163ec7ac-7482-4e6a-b288-63bc4a8eb0d1 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:08.232440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-163ec7ac-7482-4e6a-b288-63bc4a8eb0d1 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:08.233047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-163ec7ac-7482-4e6a-b288-63bc4a8eb0d1 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:08.233971 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-163ec7ac-7482-4e6a-b288-63bc4a8eb0d1 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:08.235729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-163ec7ac-7482-4e6a-b288-63bc4a8eb0d1 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:08.236349 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-163ec7ac-7482-4e6a-b288-63bc4a8eb0d1 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:08.715797 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-163ec7ac-7482-4e6a-b288-63bc4a8eb0d1 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:08.739375 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-163ec7ac-7482-4e6a-b288-63bc4a8eb0d1 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1719 microversion: 2.1 time: 0.538177 Sep 10 11:43:08.742260 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 651/1266] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:08 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1719 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:09.019133 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0a15de9b-13ce-4fed-bb05-1681489609ff tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/0e030344-f246-4c29-acf5-2fe1ad5b2ef9" status: 202 len: 0 microversion: 2.1 time: 0.821283 Sep 10 11:43:09.022651 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 616/1267] 10.222.0.23 () {58 vars in 1272 bytes} [Sat Sep 10 11:43:08 2022] DELETE /compute/v2.1/os-security-groups/0e030344-f246-4c29-acf5-2fe1ad5b2ef9 => generated 0 bytes in 823 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:43:09.033306 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cb2bf4c9-fbca-46c9-bd0a-f5d9de66b923 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '.version_select at 0x7f407308a670>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:09.034244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c3188633-7856-4cf9-8ef0-e64ea8a4646c tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:09.034874 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c3188633-7856-4cf9-8ef0-e64ea8a4646c tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] [instance: 10efe0de-fffd-415e-af3d-06d750fea3d4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:09.060667 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3188633-7856-4cf9-8ef0-e64ea8a4646c tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:09.061174 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3188633-7856-4cf9-8ef0-e64ea8a4646c tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:09.061626 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3188633-7856-4cf9-8ef0-e64ea8a4646c tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:09.071201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3188633-7856-4cf9-8ef0-e64ea8a4646c tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:09.072698 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3188633-7856-4cf9-8ef0-e64ea8a4646c tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:09.073185 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3188633-7856-4cf9-8ef0-e64ea8a4646c tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:09.682136 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c3188633-7856-4cf9-8ef0-e64ea8a4646c tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1592ac1d534dc283392ff5d68765ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513f3ad4f9d147a5b9ac652fa5fcde04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:09.696565 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c3188633-7856-4cf9-8ef0-e64ea8a4646c tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] 10.222.0.23 "GET /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4" status: 200 len: 1535 microversion: 2.1 time: 0.667326 Sep 10 11:43:09.699649 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 617/1268] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:09 2022] GET /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4 => generated 1535 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:43:09.704716 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f5636d0b-1c9e-4a4b-9493-d13bf83aaf26 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:09.705640 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f5636d0b-1c9e-4a4b-9493-d13bf83aaf26 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:09.713379 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f5636d0b-1c9e-4a4b-9493-d13bf83aaf26 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:09.714228 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f5636d0b-1c9e-4a4b-9493-d13bf83aaf26 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:09.715152 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f5636d0b-1c9e-4a4b-9493-d13bf83aaf26 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:09.716154 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f5636d0b-1c9e-4a4b-9493-d13bf83aaf26 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:09.717039 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f5636d0b-1c9e-4a4b-9493-d13bf83aaf26 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:09.717949 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f5636d0b-1c9e-4a4b-9493-d13bf83aaf26 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:10.190397 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f5636d0b-1c9e-4a4b-9493-d13bf83aaf26 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:10.226664 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f5636d0b-1c9e-4a4b-9493-d13bf83aaf26 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 200 len: 1312 microversion: 2.1 time: 0.523463 Sep 10 11:43:10.240692 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 618/1269] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:09 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 1312 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:10.249431 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7feb69d4-298a-41be-9aba-4eab66f61192 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Action: 'create', calling method: .version_select at 0x7f40734c40d0>, body: {"pool": "9626420b-79de-41a5-9c99-74681e351ad0"} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:43:10.354046 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cb2bf4c9-fbca-46c9-bd0a-f5d9de66b923 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/b8977a68-f4a5-4b6c-97dc-b77ddd7ea5db" status: 202 len: 0 microversion: 2.1 time: 1.329931 Sep 10 11:43:10.354954 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 652/1270] 10.222.0.23 () {58 vars in 1272 bytes} [Sat Sep 10 11:43:09 2022] DELETE /compute/v2.1/os-security-groups/b8977a68-f4a5-4b6c-97dc-b77ddd7ea5db => generated 0 bytes in 1331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:43:10.359678 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-19edc109-4fce-4f4c-8feb-053f9438e362 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:10.360297 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-19edc109-4fce-4f4c-8feb-053f9438e362 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:10.380995 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-19edc109-4fce-4f4c-8feb-053f9438e362 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:10.381596 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-19edc109-4fce-4f4c-8feb-053f9438e362 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:10.382040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-19edc109-4fce-4f4c-8feb-053f9438e362 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:10.382812 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-19edc109-4fce-4f4c-8feb-053f9438e362 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:10.384661 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-19edc109-4fce-4f4c-8feb-053f9438e362 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:10.386688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-19edc109-4fce-4f4c-8feb-053f9438e362 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:10.978071 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-19edc109-4fce-4f4c-8feb-053f9438e362 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:10.994411 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-19edc109-4fce-4f4c-8feb-053f9438e362 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1719 microversion: 2.1 time: 0.638215 Sep 10 11:43:10.995566 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 653/1271] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:10 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1719 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:11.011893 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-be56c7a0-f69d-4249-8b7b-f9acfe4043c2 req-767820b0-0d2e-4c5e-96ad-58c81af56f1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68861799-4265-42f8-a24a-dd78f3d6745a", "name": "network-vif-plugged", "status": "completed", "tag": "588ba4ca-8af7-4faa-a475-eb41a709948d"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:43:11.031629 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-be56c7a0-f69d-4249-8b7b-f9acfe4043c2 req-767820b0-0d2e-4c5e-96ad-58c81af56f1a service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:11.032226 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-be56c7a0-f69d-4249-8b7b-f9acfe4043c2 req-767820b0-0d2e-4c5e-96ad-58c81af56f1a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:11.032725 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-be56c7a0-f69d-4249-8b7b-f9acfe4043c2 req-767820b0-0d2e-4c5e-96ad-58c81af56f1a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:11.060197 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-be56c7a0-f69d-4249-8b7b-f9acfe4043c2 req-767820b0-0d2e-4c5e-96ad-58c81af56f1a service nova] Creating event network-vif-plugged:588ba4ca-8af7-4faa-a475-eb41a709948d for instance 68861799-4265-42f8-a24a-dd78f3d6745a on n-h2-856895-1 Sep 10 11:43:11.068724 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-be56c7a0-f69d-4249-8b7b-f9acfe4043c2 req-767820b0-0d2e-4c5e-96ad-58c81af56f1a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071544 Sep 10 11:43:11.079601 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 654/1272] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:43:11.086677 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9530f74d-49c9-4d91-b4c0-1f7e2d02e457 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Action: 'create', calling method: .version_select at 0x7f4073102280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1601631195", "description": "tempest-description-1820515706"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:43:11.839137 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:43:12.018358 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9530f74d-49c9-4d91-b4c0-1f7e2d02e457 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.937306 Sep 10 11:43:12.019268 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 655/1273] 10.222.0.23 () {60 vars in 1180 bytes} [Sat Sep 10 11:43:11 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:43:12.024495 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8a20b277-2944-49fc-84d5-b0d612cb1186 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:12.025656 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8a20b277-2944-49fc-84d5-b0d612cb1186 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:12.046141 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a20b277-2944-49fc-84d5-b0d612cb1186 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:12.052090 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a20b277-2944-49fc-84d5-b0d612cb1186 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:12.053049 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a20b277-2944-49fc-84d5-b0d612cb1186 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:12.054319 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a20b277-2944-49fc-84d5-b0d612cb1186 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:12.055078 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a20b277-2944-49fc-84d5-b0d612cb1186 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:12.056284 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a20b277-2944-49fc-84d5-b0d612cb1186 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:12.796411 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8a20b277-2944-49fc-84d5-b0d612cb1186 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:12.813513 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8a20b277-2944-49fc-84d5-b0d612cb1186 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 200 len: 1312 microversion: 2.1 time: 0.793174 Sep 10 11:43:12.815456 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 656/1274] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:12 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 1312 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:12.837512 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-67ca1193-cfd9-47bd-bf70-bb6fae29b8d4 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b718fd20-403b-4f61-804a-7586bdbb832a"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:43:12.840501 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-67ca1193-cfd9-47bd-bf70-bb6fae29b8d4 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] [instance: afb1a503-7e9a-474c-8dfe-b0e5838b7398] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:12.849156 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-67ca1193-cfd9-47bd-bf70-bb6fae29b8d4 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:12.851810 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-67ca1193-cfd9-47bd-bf70-bb6fae29b8d4 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:12.852969 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-67ca1193-cfd9-47bd-bf70-bb6fae29b8d4 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:12.857852 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-67ca1193-cfd9-47bd-bf70-bb6fae29b8d4 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:12.860006 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-67ca1193-cfd9-47bd-bf70-bb6fae29b8d4 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:12.867595 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-67ca1193-cfd9-47bd-bf70-bb6fae29b8d4 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:13.405154 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-67ca1193-cfd9-47bd-bf70-bb6fae29b8d4 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] 10.222.0.23 "POST /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.588211 Sep 10 11:43:13.406141 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 657/1275] 10.222.0.23 () {60 vars in 1323 bytes} [Sat Sep 10 11:43:12 2022] POST /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398/os-volume_attachments => generated 194 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:43:13.422954 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-39fb00ee-b497-4e6e-ac87-1a0a439e3807 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:13.427682 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-39fb00ee-b497-4e6e-ac87-1a0a439e3807 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:13.443142 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-39fb00ee-b497-4e6e-ac87-1a0a439e3807 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:13.443948 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-39fb00ee-b497-4e6e-ac87-1a0a439e3807 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:13.444547 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-39fb00ee-b497-4e6e-ac87-1a0a439e3807 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:13.445963 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-39fb00ee-b497-4e6e-ac87-1a0a439e3807 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:13.448498 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-39fb00ee-b497-4e6e-ac87-1a0a439e3807 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:13.449168 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-39fb00ee-b497-4e6e-ac87-1a0a439e3807 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:14.278810 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-39fb00ee-b497-4e6e-ac87-1a0a439e3807 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:14.297774 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-39fb00ee-b497-4e6e-ac87-1a0a439e3807 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1719 microversion: 2.1 time: 0.890372 Sep 10 11:43:14.298351 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 658/1276] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:13 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1719 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:14.303372 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6bef3c45-e046-4447-b605-5cc3420307dd tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Action: 'update', calling method: .version_select at 0x7f407306ddc0>, body: {"security_group": {"name": "tempest-sg-hth-717761732", "description": "tempest-description-hth-1739007600"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:43:15.156785 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6bef3c45-e046-4447-b605-5cc3420307dd tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "PUT /compute/v2.1/os-security-groups/f5e3f98b-4d3c-4e82-b55e-4958ed7153de" status: 200 len: 217 microversion: 2.1 time: 0.857344 Sep 10 11:43:15.158137 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 659/1277] 10.222.0.23 () {60 vars in 1290 bytes} [Sat Sep 10 11:43:14 2022] PUT /compute/v2.1/os-security-groups/f5e3f98b-4d3c-4e82-b55e-4958ed7153de => generated 217 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:43:15.173078 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fc41173a-ac2a-4ef3-bc51-64e04ba3b787 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:15.173984 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fc41173a-ac2a-4ef3-bc51-64e04ba3b787 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:15.182913 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc41173a-ac2a-4ef3-bc51-64e04ba3b787 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:15.183702 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc41173a-ac2a-4ef3-bc51-64e04ba3b787 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:15.184406 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc41173a-ac2a-4ef3-bc51-64e04ba3b787 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:15.185269 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc41173a-ac2a-4ef3-bc51-64e04ba3b787 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:15.185968 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc41173a-ac2a-4ef3-bc51-64e04ba3b787 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:15.186544 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc41173a-ac2a-4ef3-bc51-64e04ba3b787 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:15.256124 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7feb69d4-298a-41be-9aba-4eab66f61192 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.013826 Sep 10 11:43:15.257228 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 619/1278] 10.222.0.23 () {60 vars in 1170 bytes} [Sat Sep 10 11:43:10 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5016 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:43:15.262867 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2f780cf0-d4aa-4416-b8e7-39a937141dc8 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '.version_select at 0x7f40735ff670>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:15.393832 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2f780cf0-d4aa-4416-b8e7-39a937141dc8 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/f5e3f98b-4d3c-4e82-b55e-4958ed7153de" status: 200 len: 217 microversion: 2.1 time: 0.135376 Sep 10 11:43:15.395860 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 620/1279] 10.222.0.23 () {58 vars in 1269 bytes} [Sat Sep 10 11:43:15 2022] GET /compute/v2.1/os-security-groups/f5e3f98b-4d3c-4e82-b55e-4958ed7153de => generated 217 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:43:15.402710 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7b7015eb-045d-437a-9ac9-5014d53479f4 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Action: 'action', calling method: .version_select at 0x7f4078e67310>, body: {"addFloatingIp": {"address": "172.25.5.158"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:43:15.407496 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7b7015eb-045d-437a-9ac9-5014d53479f4 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] [instance: 10efe0de-fffd-415e-af3d-06d750fea3d4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:15.418368 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7b7015eb-045d-437a-9ac9-5014d53479f4 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:15.419087 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7b7015eb-045d-437a-9ac9-5014d53479f4 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:15.419627 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7b7015eb-045d-437a-9ac9-5014d53479f4 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:15.420462 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7b7015eb-045d-437a-9ac9-5014d53479f4 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:15.420981 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7b7015eb-045d-437a-9ac9-5014d53479f4 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:15.421477 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7b7015eb-045d-437a-9ac9-5014d53479f4 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:15.458743 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fc41173a-ac2a-4ef3-bc51-64e04ba3b787 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:15.470048 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fc41173a-ac2a-4ef3-bc51-64e04ba3b787 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 200 len: 1462 microversion: 2.1 time: 0.301444 Sep 10 11:43:15.493105 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 660/1280] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:15 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 1462 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:15.498641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-17312855-f40a-4f6b-a44b-eafb8214893a tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:15.501073 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-17312855-f40a-4f6b-a44b-eafb8214893a tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:15.508836 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17312855-f40a-4f6b-a44b-eafb8214893a tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:15.509843 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17312855-f40a-4f6b-a44b-eafb8214893a tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:15.510694 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17312855-f40a-4f6b-a44b-eafb8214893a tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:15.511742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17312855-f40a-4f6b-a44b-eafb8214893a tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:15.512460 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17312855-f40a-4f6b-a44b-eafb8214893a tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:15.513226 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17312855-f40a-4f6b-a44b-eafb8214893a tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:15.514896 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7b7015eb-045d-437a-9ac9-5014d53479f4 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "refresh_cache-10efe0de-fffd-415e-af3d-06d750fea3d4" {{(pid=128776) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 10 11:43:15.515603 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7b7015eb-045d-437a-9ac9-5014d53479f4 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquired lock "refresh_cache-10efe0de-fffd-415e-af3d-06d750fea3d4" {{(pid=128776) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 10 11:43:16.010361 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-17312855-f40a-4f6b-a44b-eafb8214893a tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:16.021647 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-17312855-f40a-4f6b-a44b-eafb8214893a tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1709 microversion: 2.1 time: 0.526970 Sep 10 11:43:16.024502 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 661/1281] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:15 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1709 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:16.041858 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5b25ea7e-79fc-4cdd-87e2-9a9904dafdf8 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '.version_select at 0x7f4073053430>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:16.422075 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5b25ea7e-79fc-4cdd-87e2-9a9904dafdf8 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/f5e3f98b-4d3c-4e82-b55e-4958ed7153de" status: 202 len: 0 microversion: 2.1 time: 0.396446 Sep 10 11:43:16.423038 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 662/1282] 10.222.0.23 () {58 vars in 1272 bytes} [Sat Sep 10 11:43:16 2022] DELETE /compute/v2.1/os-security-groups/f5e3f98b-4d3c-4e82-b55e-4958ed7153de => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:43:16.429598 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-50068412-1dd1-4198-aa78-a08981202b10 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:43:16.437008 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-50068412-1dd1-4198-aa78-a08981202b10 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:16.458858 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-50068412-1dd1-4198-aa78-a08981202b10 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:16.459463 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-50068412-1dd1-4198-aa78-a08981202b10 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:16.459951 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-50068412-1dd1-4198-aa78-a08981202b10 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:16.470318 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-50068412-1dd1-4198-aa78-a08981202b10 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:16.473204 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-50068412-1dd1-4198-aa78-a08981202b10 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:16.473864 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-50068412-1dd1-4198-aa78-a08981202b10 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:16.670675 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-50068412-1dd1-4198-aa78-a08981202b10 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:16.682714 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-50068412-1dd1-4198-aa78-a08981202b10 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Old instance type m1.heat2, new instance type m1.heat {{(pid=128777) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 11:43:16.692331 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-50068412-1dd1-4198-aa78-a08981202b10 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:43:16.693012 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-50068412-1dd1-4198-aa78-a08981202b10 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:43:16.693682 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-50068412-1dd1-4198-aa78-a08981202b10 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:43:16.694273 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-50068412-1dd1-4198-aa78-a08981202b10 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:43:16.695000 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-50068412-1dd1-4198-aa78-a08981202b10 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:43:16.858381 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:43:16.920288 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-50068412-1dd1-4198-aa78-a08981202b10 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "POST /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a/action" status: 202 len: 0 microversion: 2.1 time: 0.495790 Sep 10 11:43:16.922848 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 663/1283] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:43:16 2022] POST /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a/action => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:43:16.935785 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7e68a119-0257-47e2-afe9-aa36c753cbdd tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Calling method '.version_select at 0x7f4073053ca0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:16.944221 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e68a119-0257-47e2-afe9-aa36c753cbdd tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:16.944715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e68a119-0257-47e2-afe9-aa36c753cbdd tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:16.945155 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e68a119-0257-47e2-afe9-aa36c753cbdd tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:16.981922 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7e68a119-0257-47e2-afe9-aa36c753cbdd tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 2329 microversion: 2.1 time: 0.052490 Sep 10 11:43:16.982863 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 664/1284] 10.222.0.23 () {58 vars in 1143 bytes} [Sat Sep 10 11:43:16 2022] GET /compute/v2.1/os-migrations => generated 2329 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:16.990410 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ba405d89-4958-4ad8-9e30-b45298a606e9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:16.994408 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ba405d89-4958-4ad8-9e30-b45298a606e9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:17.004531 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba405d89-4958-4ad8-9e30-b45298a606e9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:17.005256 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba405d89-4958-4ad8-9e30-b45298a606e9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:17.005931 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba405d89-4958-4ad8-9e30-b45298a606e9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:17.007866 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba405d89-4958-4ad8-9e30-b45298a606e9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:17.008629 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba405d89-4958-4ad8-9e30-b45298a606e9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:17.009846 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba405d89-4958-4ad8-9e30-b45298a606e9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:17.257176 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-ba405d89-4958-4ad8-9e30-b45298a606e9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] HTTP exception thrown: Instance 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b could not be found. Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ba405d89-4958-4ad8-9e30-b45298a606e9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Request method failure captured: Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b HTTP/1.1 Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHgBU0aZ9PqJpGA422fKNy27Wjo5sOCfo4CIswXFFfdPv36WiPjLOYw_neMbOsaeYNKIXkVSp0pEYCo9771BWqsl0fjBWyX6S3skhskK7a85wRu3ZuO-FXP422rQwCRC9xzOeesr0UvY-AFVf9_IuIXQit7YUH71vPa-NVExdrtG-MY Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 91ad59d8440a49c496acbede9848e944 Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ad59d8440a49c496acbede9848e944"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ad59d8440a49c496acbede9848e944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_91ad59d8440a49c496acbede9848e944", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/91ad59d8440a49c496acbede9848e944"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 91ad59d8440a49c496acbede9848e944 Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-SecurityGroupsTestJSON-1578123858-project Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 080c97b7605a40ebac26884a59ea3902 Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-SecurityGroupsTestJSON-1578123858-project Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b could not be found. Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b'} Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b could not be found. Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:43:17.259437 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:43:17.264301 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b could not be found. Sep 10 11:43:17.264301 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:17.264301 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:17.264301 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:17.264301 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:17.264301 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:43:17.264301 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:43:17.264301 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:43:17.264301 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:43:17.264301 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b could not be found. Sep 10 11:43:17.264301 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:17.266284 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ba405d89-4958-4ad8-9e30-b45298a606e9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Returning 404 to user: Instance 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:43:17.267504 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ba405d89-4958-4ad8-9e30-b45298a606e9 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b" status: 404 len: 111 microversion: 2.1 time: 0.283436 Sep 10 11:43:17.268762 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 665/1285] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:43:16 2022] DELETE /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b => generated 111 bytes in 285 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:43:17.274612 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-566f25a6-3db5-4fdb-a335-db8616b05ab1 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:17.275557 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-566f25a6-3db5-4fdb-a335-db8616b05ab1 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:17.295199 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-566f25a6-3db5-4fdb-a335-db8616b05ab1 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:17.295910 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-566f25a6-3db5-4fdb-a335-db8616b05ab1 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:17.296529 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-566f25a6-3db5-4fdb-a335-db8616b05ab1 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:17.297412 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-566f25a6-3db5-4fdb-a335-db8616b05ab1 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:17.298045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-566f25a6-3db5-4fdb-a335-db8616b05ab1 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:17.298637 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-566f25a6-3db5-4fdb-a335-db8616b05ab1 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:17.591667 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-566f25a6-3db5-4fdb-a335-db8616b05ab1 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:17.606103 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-566f25a6-3db5-4fdb-a335-db8616b05ab1 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 200 len: 1471 microversion: 2.1 time: 0.335732 Sep 10 11:43:17.607477 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 666/1286] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:17 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 1471 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:17.616130 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8a1c4170-6172-458f-ad7a-7b86257f5921 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:17.617725 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8a1c4170-6172-458f-ad7a-7b86257f5921 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:17.636938 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a1c4170-6172-458f-ad7a-7b86257f5921 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:17.640302 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a1c4170-6172-458f-ad7a-7b86257f5921 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:17.640763 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a1c4170-6172-458f-ad7a-7b86257f5921 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:17.641525 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a1c4170-6172-458f-ad7a-7b86257f5921 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:17.644832 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a1c4170-6172-458f-ad7a-7b86257f5921 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:17.648173 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a1c4170-6172-458f-ad7a-7b86257f5921 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:18.106427 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8a1c4170-6172-458f-ad7a-7b86257f5921 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1860 microversion: 2.1 time: 0.497442 Sep 10 11:43:18.146328 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 667/1287] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:17 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1860 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:18.154058 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9ce1a53a-5788-41e5-97fd-d542ac35713d tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:18.155106 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9ce1a53a-5788-41e5-97fd-d542ac35713d tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:18.161975 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9ce1a53a-5788-41e5-97fd-d542ac35713d tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:18.162769 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9ce1a53a-5788-41e5-97fd-d542ac35713d tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:18.163483 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9ce1a53a-5788-41e5-97fd-d542ac35713d tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:18.164437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9ce1a53a-5788-41e5-97fd-d542ac35713d tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:18.165104 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9ce1a53a-5788-41e5-97fd-d542ac35713d tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:18.165737 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9ce1a53a-5788-41e5-97fd-d542ac35713d tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:18.184248 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-9ce1a53a-5788-41e5-97fd-d542ac35713d tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] HTTP exception thrown: Instance 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b could not be found. Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9ce1a53a-5788-41e5-97fd-d542ac35713d tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Request method failure captured: Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b HTTP/1.1 Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHgBU0aZ9PqJpGA422fKNy27Wjo5sOCfo4CIswXFFfdPv36WiPjLOYw_neMbOsaeYNKIXkVSp0pEYCo9771BWqsl0fjBWyX6S3skhskK7a85wRu3ZuO-FXP422rQwCRC9xzOeesr0UvY-AFVf9_IuIXQit7YUH71vPa-NVExdrtG-MY Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 91ad59d8440a49c496acbede9848e944 Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ad59d8440a49c496acbede9848e944"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ad59d8440a49c496acbede9848e944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_91ad59d8440a49c496acbede9848e944", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/91ad59d8440a49c496acbede9848e944"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 91ad59d8440a49c496acbede9848e944 Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-SecurityGroupsTestJSON-1578123858-project Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 080c97b7605a40ebac26884a59ea3902 Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-SecurityGroupsTestJSON-1578123858-project Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b could not be found. Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b'} Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b could not be found. Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b could not be found. Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:18.186302 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:18.190474 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:18.190474 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:43:18.190474 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:43:18.190474 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:43:18.190474 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:43:18.190474 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b could not be found. Sep 10 11:43:18.190474 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:18.192674 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9ce1a53a-5788-41e5-97fd-d542ac35713d tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Returning 404 to user: Instance 9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:43:18.194376 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9ce1a53a-5788-41e5-97fd-d542ac35713d tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b" status: 404 len: 111 microversion: 2.1 time: 0.045959 Sep 10 11:43:18.195040 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 668/1288] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:18 2022] GET /compute/v2.1/servers/9fc3bc2f-c46a-40c3-856c-ec3cc3c8397b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:43:18.201198 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-78804c95-4d83-4af7-9191-229074885c61 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:18.202863 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-78804c95-4d83-4af7-9191-229074885c61 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:18.210098 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78804c95-4d83-4af7-9191-229074885c61 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:18.210811 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78804c95-4d83-4af7-9191-229074885c61 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:18.211694 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78804c95-4d83-4af7-9191-229074885c61 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:18.212875 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78804c95-4d83-4af7-9191-229074885c61 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:18.213508 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78804c95-4d83-4af7-9191-229074885c61 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:18.214317 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78804c95-4d83-4af7-9191-229074885c61 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:19.037509 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-78804c95-4d83-4af7-9191-229074885c61 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1860 microversion: 2.1 time: 0.840714 Sep 10 11:43:19.055808 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 669/1289] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:18 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1860 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:19.081806 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-09eb7802-88b0-4171-8c5c-e99ce81a6836 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '.version_select at 0x7f4073053310>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:19.174054 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-7b7015eb-045d-437a-9ac9-5014d53479f4 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] [instance: 10efe0de-fffd-415e-af3d-06d750fea3d4] Building network info cache for instance {{(pid=128776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 10 11:43:19.204756 n-d-856895-1 devstack@n-api.service[128777]: DEBUG neutronclient.v2_0.client [None req-09eb7802-88b0-4171-8c5c-e99ce81a6836 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b8977a68-f4a5-4b6c-97dc-b77ddd7ea5db does not exist", "detail": ""}} {{(pid=128777) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 11:43:19.205982 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.security_group_api [None req-09eb7802-88b0-4171-8c5c-e99ce81a6836 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Neutron security group b8977a68-f4a5-4b6c-97dc-b77ddd7ea5db not found {{(pid=128777) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 11:43:19.206817 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-09eb7802-88b0-4171-8c5c-e99ce81a6836 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] HTTP exception thrown: Security group b8977a68-f4a5-4b6c-97dc-b77ddd7ea5db does not exist Sep 10 11:43:19.206817 n-d-856895-1 devstack@n-api.service[128777]: Neutron server returns request_ids: ['req-5cdc45d4-7abf-4a02-8f8d-3fc3cfa9e981'] Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-09eb7802-88b0-4171-8c5c-e99ce81a6836 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Request method failure captured: Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/os-security-groups/b8977a68-f4a5-4b6c-97dc-b77ddd7ea5db HTTP/1.1 Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHgBU0aZ9PqJpGA422fKNy27Wjo5sOCfo4CIswXFFfdPv36WiPjLOYw_neMbOsaeYNKIXkVSp0pEYCo9771BWqsl0fjBWyX6S3skhskK7a85wRu3ZuO-FXP422rQwCRC9xzOeesr0UvY-AFVf9_IuIXQit7YUH71vPa-NVExdrtG-MY Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 91ad59d8440a49c496acbede9848e944 Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ad59d8440a49c496acbede9848e944"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ad59d8440a49c496acbede9848e944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_91ad59d8440a49c496acbede9848e944", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/91ad59d8440a49c496acbede9848e944"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 91ad59d8440a49c496acbede9848e944 Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-SecurityGroupsTestJSON-1578123858-project Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 080c97b7605a40ebac26884a59ea3902 Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-SecurityGroupsTestJSON-1578123858-project Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: exception: Security group b8977a68-f4a5-4b6c-97dc-b77ddd7ea5db does not exist Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: Neutron server returns request_ids: ['req-5cdc45d4-7abf-4a02-8f8d-3fc3cfa9e981'] Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'b8977a68-f4a5-4b6c-97dc-b77ddd7ea5db'} Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 11:43:19.209811 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b8977a68-f4a5-4b6c-97dc-b77ddd7ea5db does not exist Sep 10 11:43:19.215152 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5cdc45d4-7abf-4a02-8f8d-3fc3cfa9e981'] Sep 10 11:43:19.215152 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:19.215152 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:19.215152 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:19.215152 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:19.215152 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 10 11:43:19.215152 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 10 11:43:19.215152 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 11:43:19.215152 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 11:43:19.215152 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b8977a68-f4a5-4b6c-97dc-b77ddd7ea5db does not exist Sep 10 11:43:19.215152 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5cdc45d4-7abf-4a02-8f8d-3fc3cfa9e981'] Sep 10 11:43:19.215152 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:19.215152 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:19.215152 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:19.215152 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:19.215152 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:43:19.215152 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:43:19.215152 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:43:19.215152 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:43:19.215152 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:43:19.215152 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:43:19.215152 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:43:19.215152 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:43:19.215152 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 10 11:43:19.215152 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 11:43:19.215152 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b8977a68-f4a5-4b6c-97dc-b77ddd7ea5db does not exist Sep 10 11:43:19.215152 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5cdc45d4-7abf-4a02-8f8d-3fc3cfa9e981'] Sep 10 11:43:19.215152 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:19.215152 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:19.215152 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:19.215152 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:19.215152 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:43:19.215152 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:43:19.215152 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:43:19.215152 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:43:19.215152 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b8977a68-f4a5-4b6c-97dc-b77ddd7ea5db does not exist Sep 10 11:43:19.215152 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5cdc45d4-7abf-4a02-8f8d-3fc3cfa9e981'] Sep 10 11:43:19.215152 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:19.223821 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-09eb7802-88b0-4171-8c5c-e99ce81a6836 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Returning 404 to user: Security group b8977a68-f4a5-4b6c-97dc-b77ddd7ea5db does not exist Sep 10 11:43:19.223821 n-d-856895-1 devstack@n-api.service[128777]: Neutron server returns request_ids: ['req-5cdc45d4-7abf-4a02-8f8d-3fc3cfa9e981'] {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:43:19.225146 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-09eb7802-88b0-4171-8c5c-e99ce81a6836 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/b8977a68-f4a5-4b6c-97dc-b77ddd7ea5db" status: 404 len: 194 microversion: 2.1 time: 0.167981 Sep 10 11:43:19.226013 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 670/1290] 10.222.0.23 () {58 vars in 1272 bytes} [Sat Sep 10 11:43:19 2022] DELETE /compute/v2.1/os-security-groups/b8977a68-f4a5-4b6c-97dc-b77ddd7ea5db => generated 194 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:43:19.239882 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-db084428-dac7-46d9-ad93-e978332b6c06 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:19.241129 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-db084428-dac7-46d9-ad93-e978332b6c06 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:19.255451 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db084428-dac7-46d9-ad93-e978332b6c06 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:19.261515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db084428-dac7-46d9-ad93-e978332b6c06 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:19.262578 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db084428-dac7-46d9-ad93-e978332b6c06 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:19.264131 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db084428-dac7-46d9-ad93-e978332b6c06 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:19.271669 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db084428-dac7-46d9-ad93-e978332b6c06 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:19.272890 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db084428-dac7-46d9-ad93-e978332b6c06 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:19.634896 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-db084428-dac7-46d9-ad93-e978332b6c06 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:19.645549 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-db084428-dac7-46d9-ad93-e978332b6c06 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 200 len: 1471 microversion: 2.1 time: 0.416679 Sep 10 11:43:19.646126 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 671/1291] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:19 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 1471 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:19.678288 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e69c223b-f5c1-424a-90a2-e64daa44542c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:19.680766 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e69c223b-f5c1-424a-90a2-e64daa44542c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:19.698364 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e69c223b-f5c1-424a-90a2-e64daa44542c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:19.699988 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e69c223b-f5c1-424a-90a2-e64daa44542c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:19.702258 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e69c223b-f5c1-424a-90a2-e64daa44542c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:19.704377 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e69c223b-f5c1-424a-90a2-e64daa44542c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:19.705558 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e69c223b-f5c1-424a-90a2-e64daa44542c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:19.707858 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e69c223b-f5c1-424a-90a2-e64daa44542c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:20.232544 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-e69c223b-f5c1-424a-90a2-e64daa44542c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lazy-loading 'services' on Instance uuid 53e36757-9924-4d03-a8c0-fe52a166ffc1 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:43:20.525482 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e69c223b-f5c1-424a-90a2-e64daa44542c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "DELETE /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1/os-volume_attachments/853af92f-2654-49a7-9b94-05c9e4dc9ceb" status: 202 len: 0 microversion: 2.1 time: 0.856182 Sep 10 11:43:20.526583 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 672/1292] 10.222.0.23 () {58 vars in 1416 bytes} [Sat Sep 10 11:43:19 2022] DELETE /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1/os-volume_attachments/853af92f-2654-49a7-9b94-05c9e4dc9ceb => generated 0 bytes in 860 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:43:20.535884 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-b3af9e7e-7825-425d-a510-985e2a91c1a8 req-c9b1e43b-3b4e-48b6-ae32-3cbcd2fae112 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10efe0de-fffd-415e-af3d-06d750fea3d4", "tag": "8551ac91-90ed-4c01-9cfa-ec23da24cb18"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:43:20.558191 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-b3af9e7e-7825-425d-a510-985e2a91c1a8 req-c9b1e43b-3b4e-48b6-ae32-3cbcd2fae112 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:20.559073 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-b3af9e7e-7825-425d-a510-985e2a91c1a8 req-c9b1e43b-3b4e-48b6-ae32-3cbcd2fae112 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:20.559778 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-b3af9e7e-7825-425d-a510-985e2a91c1a8 req-c9b1e43b-3b4e-48b6-ae32-3cbcd2fae112 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:20.594446 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-b3af9e7e-7825-425d-a510-985e2a91c1a8 req-c9b1e43b-3b4e-48b6-ae32-3cbcd2fae112 service nova] Creating event network-changed:8551ac91-90ed-4c01-9cfa-ec23da24cb18 for instance 10efe0de-fffd-415e-af3d-06d750fea3d4 on n-h2-856895-1 Sep 10 11:43:20.611154 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-b3af9e7e-7825-425d-a510-985e2a91c1a8 req-c9b1e43b-3b4e-48b6-ae32-3cbcd2fae112 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082836 Sep 10 11:43:20.612287 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 673/1293] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:43:20.618483 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-64e33f3e-2826-4009-8e75-795956e7f94a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '.version_select at 0x7f40730e0ca0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:20.781748 n-d-856895-1 devstack@n-api.service[128777]: DEBUG neutronclient.v2_0.client [None req-64e33f3e-2826-4009-8e75-795956e7f94a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0e030344-f246-4c29-acf5-2fe1ad5b2ef9 does not exist", "detail": ""}} {{(pid=128777) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 11:43:20.782363 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.security_group_api [None req-64e33f3e-2826-4009-8e75-795956e7f94a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Neutron security group 0e030344-f246-4c29-acf5-2fe1ad5b2ef9 not found {{(pid=128777) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 11:43:20.782899 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-64e33f3e-2826-4009-8e75-795956e7f94a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] HTTP exception thrown: Security group 0e030344-f246-4c29-acf5-2fe1ad5b2ef9 does not exist Sep 10 11:43:20.782899 n-d-856895-1 devstack@n-api.service[128777]: Neutron server returns request_ids: ['req-f91da89d-e137-4cb2-b12a-becb207454d8'] Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-64e33f3e-2826-4009-8e75-795956e7f94a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Request method failure captured: Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/os-security-groups/0e030344-f246-4c29-acf5-2fe1ad5b2ef9 HTTP/1.1 Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHgBU0aZ9PqJpGA422fKNy27Wjo5sOCfo4CIswXFFfdPv36WiPjLOYw_neMbOsaeYNKIXkVSp0pEYCo9771BWqsl0fjBWyX6S3skhskK7a85wRu3ZuO-FXP422rQwCRC9xzOeesr0UvY-AFVf9_IuIXQit7YUH71vPa-NVExdrtG-MY Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 91ad59d8440a49c496acbede9848e944 Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ad59d8440a49c496acbede9848e944"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ad59d8440a49c496acbede9848e944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_91ad59d8440a49c496acbede9848e944", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/91ad59d8440a49c496acbede9848e944"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 91ad59d8440a49c496acbede9848e944 Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-SecurityGroupsTestJSON-1578123858-project Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 080c97b7605a40ebac26884a59ea3902 Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-SecurityGroupsTestJSON-1578123858-project Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: exception: Security group 0e030344-f246-4c29-acf5-2fe1ad5b2ef9 does not exist Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: Neutron server returns request_ids: ['req-f91da89d-e137-4cb2-b12a-becb207454d8'] Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '0e030344-f246-4c29-acf5-2fe1ad5b2ef9'} Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 11:43:20.789494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0e030344-f246-4c29-acf5-2fe1ad5b2ef9 does not exist Sep 10 11:43:20.793646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f91da89d-e137-4cb2-b12a-becb207454d8'] Sep 10 11:43:20.793646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:20.793646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:20.793646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:20.793646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:20.793646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 10 11:43:20.793646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 10 11:43:20.793646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 11:43:20.793646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 11:43:20.793646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0e030344-f246-4c29-acf5-2fe1ad5b2ef9 does not exist Sep 10 11:43:20.793646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f91da89d-e137-4cb2-b12a-becb207454d8'] Sep 10 11:43:20.793646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:20.793646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:20.793646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:20.793646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:20.793646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:43:20.793646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:43:20.793646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:43:20.793646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:43:20.793646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:43:20.793646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:43:20.793646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:43:20.793646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:43:20.793646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 10 11:43:20.793646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 11:43:20.793646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0e030344-f246-4c29-acf5-2fe1ad5b2ef9 does not exist Sep 10 11:43:20.793646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f91da89d-e137-4cb2-b12a-becb207454d8'] Sep 10 11:43:20.793646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:20.793646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:20.793646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:20.793646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:20.793646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:43:20.793646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:43:20.793646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:43:20.793646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:43:20.793646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0e030344-f246-4c29-acf5-2fe1ad5b2ef9 does not exist Sep 10 11:43:20.793646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f91da89d-e137-4cb2-b12a-becb207454d8'] Sep 10 11:43:20.793646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:20.793646 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-64e33f3e-2826-4009-8e75-795956e7f94a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Returning 404 to user: Security group 0e030344-f246-4c29-acf5-2fe1ad5b2ef9 does not exist Sep 10 11:43:20.793646 n-d-856895-1 devstack@n-api.service[128777]: Neutron server returns request_ids: ['req-f91da89d-e137-4cb2-b12a-becb207454d8'] {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:43:20.793646 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-64e33f3e-2826-4009-8e75-795956e7f94a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/0e030344-f246-4c29-acf5-2fe1ad5b2ef9" status: 404 len: 194 microversion: 2.1 time: 0.177581 Sep 10 11:43:20.798434 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 674/1294] 10.222.0.23 () {58 vars in 1272 bytes} [Sat Sep 10 11:43:20 2022] DELETE /compute/v2.1/os-security-groups/0e030344-f246-4c29-acf5-2fe1ad5b2ef9 => generated 194 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:43:20.800003 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-92b4a165-712b-4b44-9032-2d57adafbd0e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:20.802297 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-92b4a165-712b-4b44-9032-2d57adafbd0e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:20.831938 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92b4a165-712b-4b44-9032-2d57adafbd0e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:20.832443 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92b4a165-712b-4b44-9032-2d57adafbd0e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:20.832901 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92b4a165-712b-4b44-9032-2d57adafbd0e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:20.833894 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92b4a165-712b-4b44-9032-2d57adafbd0e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:20.834366 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92b4a165-712b-4b44-9032-2d57adafbd0e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:20.834799 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92b4a165-712b-4b44-9032-2d57adafbd0e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:20.880824 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-7b7015eb-045d-437a-9ac9-5014d53479f4 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] [instance: 10efe0de-fffd-415e-af3d-06d750fea3d4] Updating instance_info_cache with network_info: [{"id": "8551ac91-90ed-4c01-9cfa-ec23da24cb18", "address": "fa:16:3e:93:48:68", "network": {"id": "b3bcc041-d1d1-4032-9b43-61f3a0a3c9fc", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-169954194-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "513f3ad4f9d147a5b9ac652fa5fcde04", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8551ac91-90", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 10 11:43:20.897380 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-92b4a165-712b-4b44-9032-2d57adafbd0e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101079 Sep 10 11:43:20.898193 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 675/1295] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 11:43:20 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:43:20.903054 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-084450ad-88eb-4ff6-b672-671e95a25f36 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:20.903724 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-084450ad-88eb-4ff6-b672-671e95a25f36 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:20.914785 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-084450ad-88eb-4ff6-b672-671e95a25f36 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:20.915407 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-084450ad-88eb-4ff6-b672-671e95a25f36 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:20.916045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-084450ad-88eb-4ff6-b672-671e95a25f36 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:20.917201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7b7015eb-045d-437a-9ac9-5014d53479f4 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Releasing lock "refresh_cache-10efe0de-fffd-415e-af3d-06d750fea3d4" {{(pid=128776) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 10 11:43:20.917420 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-084450ad-88eb-4ff6-b672-671e95a25f36 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:20.918070 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-084450ad-88eb-4ff6-b672-671e95a25f36 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:20.918200 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7b7015eb-045d-437a-9ac9-5014d53479f4 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] 10.222.0.23 "POST /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4/action" status: 202 len: 0 microversion: 2.1 time: 5.521113 Sep 10 11:43:20.918831 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-084450ad-88eb-4ff6-b672-671e95a25f36 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:20.921989 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 621/1296] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:43:15 2022] POST /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4/action => generated 0 bytes in 5522 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 10 11:43:20.932203 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6276aa49-acc2-43ba-9d2e-a78c05d0aabe tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '.version_select at 0x7f40734de4c0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:20.978037 n-d-856895-1 devstack@n-api.service[128776]: DEBUG neutronclient.v2_0.client [None req-6276aa49-acc2-43ba-9d2e-a78c05d0aabe tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7f27ae31-e722-4e46-b08c-1be36ad37b02 does not exist", "detail": ""}} {{(pid=128776) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 11:43:20.978591 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.security_group_api [None req-6276aa49-acc2-43ba-9d2e-a78c05d0aabe tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Neutron security group 7f27ae31-e722-4e46-b08c-1be36ad37b02 not found {{(pid=128776) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 11:43:20.979125 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-6276aa49-acc2-43ba-9d2e-a78c05d0aabe tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] HTTP exception thrown: Security group 7f27ae31-e722-4e46-b08c-1be36ad37b02 does not exist Sep 10 11:43:20.979125 n-d-856895-1 devstack@n-api.service[128776]: Neutron server returns request_ids: ['req-0db247c6-5423-4513-b8e0-df0981b7654d'] Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6276aa49-acc2-43ba-9d2e-a78c05d0aabe tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Request method failure captured: Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/os-security-groups/7f27ae31-e722-4e46-b08c-1be36ad37b02 HTTP/1.1 Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHgBU0aZ9PqJpGA422fKNy27Wjo5sOCfo4CIswXFFfdPv36WiPjLOYw_neMbOsaeYNKIXkVSp0pEYCo9771BWqsl0fjBWyX6S3skhskK7a85wRu3ZuO-FXP422rQwCRC9xzOeesr0UvY-AFVf9_IuIXQit7YUH71vPa-NVExdrtG-MY Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 91ad59d8440a49c496acbede9848e944 Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ad59d8440a49c496acbede9848e944"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ad59d8440a49c496acbede9848e944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_91ad59d8440a49c496acbede9848e944", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/91ad59d8440a49c496acbede9848e944"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 91ad59d8440a49c496acbede9848e944 Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-SecurityGroupsTestJSON-1578123858-project Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 080c97b7605a40ebac26884a59ea3902 Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-SecurityGroupsTestJSON-1578123858-project Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: exception: Security group 7f27ae31-e722-4e46-b08c-1be36ad37b02 does not exist Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: Neutron server returns request_ids: ['req-0db247c6-5423-4513-b8e0-df0981b7654d'] Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '7f27ae31-e722-4e46-b08c-1be36ad37b02'} Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 11:43:20.981132 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7f27ae31-e722-4e46-b08c-1be36ad37b02 does not exist Sep 10 11:43:20.988854 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0db247c6-5423-4513-b8e0-df0981b7654d'] Sep 10 11:43:20.988854 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:43:20.988854 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:20.988854 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:43:20.988854 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:20.988854 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 10 11:43:20.988854 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 10 11:43:20.988854 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 11:43:20.988854 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 11:43:20.988854 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7f27ae31-e722-4e46-b08c-1be36ad37b02 does not exist Sep 10 11:43:20.988854 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0db247c6-5423-4513-b8e0-df0981b7654d'] Sep 10 11:43:20.988854 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:43:20.988854 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:20.988854 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:43:20.988854 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:20.988854 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:43:20.988854 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:43:20.988854 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:43:20.988854 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:43:20.988854 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:43:20.988854 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:43:20.988854 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:43:20.988854 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:43:20.988854 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 10 11:43:20.988854 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 11:43:20.988854 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7f27ae31-e722-4e46-b08c-1be36ad37b02 does not exist Sep 10 11:43:20.988854 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0db247c6-5423-4513-b8e0-df0981b7654d'] Sep 10 11:43:20.988854 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:43:20.988854 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:20.988854 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:43:20.988854 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:20.988854 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:43:20.988854 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:43:20.988854 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:43:20.988854 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:43:20.988854 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7f27ae31-e722-4e46-b08c-1be36ad37b02 does not exist Sep 10 11:43:20.988854 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0db247c6-5423-4513-b8e0-df0981b7654d'] Sep 10 11:43:20.988854 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:43:20.988854 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6276aa49-acc2-43ba-9d2e-a78c05d0aabe tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Returning 404 to user: Security group 7f27ae31-e722-4e46-b08c-1be36ad37b02 does not exist Sep 10 11:43:20.988854 n-d-856895-1 devstack@n-api.service[128776]: Neutron server returns request_ids: ['req-0db247c6-5423-4513-b8e0-df0981b7654d'] {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:43:20.988854 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6276aa49-acc2-43ba-9d2e-a78c05d0aabe tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/7f27ae31-e722-4e46-b08c-1be36ad37b02" status: 404 len: 194 microversion: 2.1 time: 0.062578 Sep 10 11:43:20.988854 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 622/1297] 10.222.0.23 () {58 vars in 1272 bytes} [Sat Sep 10 11:43:20 2022] DELETE /compute/v2.1/os-security-groups/7f27ae31-e722-4e46-b08c-1be36ad37b02 => generated 194 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:43:20.992660 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0d275b9b-9ff2-4a9a-8d1d-5b05efe9159b tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Action: 'create', calling method: .version_select at 0x7f4073541d30>, body: {"pool": "9626420b-79de-41a5-9c99-74681e351ad0"} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:43:21.574119 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-084450ad-88eb-4ff6-b672-671e95a25f36 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:21.584241 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-084450ad-88eb-4ff6-b672-671e95a25f36 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 200 len: 1471 microversion: 2.1 time: 0.684949 Sep 10 11:43:21.598812 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 676/1298] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:20 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 1471 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:21.598812 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d0e5f134-35ad-468f-99af-fcc95f71bc3c tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '.version_select at 0x7f4073065ca0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:21.641272 n-d-856895-1 devstack@n-api.service[128777]: DEBUG neutronclient.v2_0.client [None req-d0e5f134-35ad-468f-99af-fcc95f71bc3c tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 30b77978-2489-4c33-ab03-c7be19f1d46c does not exist", "detail": ""}} {{(pid=128777) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 11:43:21.642913 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.security_group_api [None req-d0e5f134-35ad-468f-99af-fcc95f71bc3c tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Neutron security group 30b77978-2489-4c33-ab03-c7be19f1d46c not found {{(pid=128777) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 11:43:21.643675 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-d0e5f134-35ad-468f-99af-fcc95f71bc3c tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] HTTP exception thrown: Security group 30b77978-2489-4c33-ab03-c7be19f1d46c does not exist Sep 10 11:43:21.643675 n-d-856895-1 devstack@n-api.service[128777]: Neutron server returns request_ids: ['req-bc8313e9-8ca0-4a56-8ea6-f967e58e6fb3'] Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d0e5f134-35ad-468f-99af-fcc95f71bc3c tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Request method failure captured: Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/os-security-groups/30b77978-2489-4c33-ab03-c7be19f1d46c HTTP/1.1 Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHgBU0aZ9PqJpGA422fKNy27Wjo5sOCfo4CIswXFFfdPv36WiPjLOYw_neMbOsaeYNKIXkVSp0pEYCo9771BWqsl0fjBWyX6S3skhskK7a85wRu3ZuO-FXP422rQwCRC9xzOeesr0UvY-AFVf9_IuIXQit7YUH71vPa-NVExdrtG-MY Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 91ad59d8440a49c496acbede9848e944 Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ad59d8440a49c496acbede9848e944"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ad59d8440a49c496acbede9848e944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_91ad59d8440a49c496acbede9848e944", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/91ad59d8440a49c496acbede9848e944"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 91ad59d8440a49c496acbede9848e944 Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-SecurityGroupsTestJSON-1578123858-project Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 080c97b7605a40ebac26884a59ea3902 Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-SecurityGroupsTestJSON-1578123858-project Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: exception: Security group 30b77978-2489-4c33-ab03-c7be19f1d46c does not exist Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: Neutron server returns request_ids: ['req-bc8313e9-8ca0-4a56-8ea6-f967e58e6fb3'] Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '30b77978-2489-4c33-ab03-c7be19f1d46c'} Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 11:43:21.670325 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 30b77978-2489-4c33-ab03-c7be19f1d46c does not exist Sep 10 11:43:21.674764 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bc8313e9-8ca0-4a56-8ea6-f967e58e6fb3'] Sep 10 11:43:21.674764 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:21.674764 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:21.674764 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:21.674764 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:21.674764 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 10 11:43:21.674764 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 10 11:43:21.674764 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 11:43:21.674764 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 11:43:21.674764 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 30b77978-2489-4c33-ab03-c7be19f1d46c does not exist Sep 10 11:43:21.674764 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bc8313e9-8ca0-4a56-8ea6-f967e58e6fb3'] Sep 10 11:43:21.674764 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:21.674764 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:21.674764 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:21.674764 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:21.674764 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:43:21.674764 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:43:21.674764 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:43:21.674764 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:43:21.674764 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:43:21.674764 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:43:21.674764 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:43:21.674764 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:43:21.674764 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 10 11:43:21.674764 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 11:43:21.674764 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 30b77978-2489-4c33-ab03-c7be19f1d46c does not exist Sep 10 11:43:21.674764 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bc8313e9-8ca0-4a56-8ea6-f967e58e6fb3'] Sep 10 11:43:21.674764 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:21.674764 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:21.674764 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:21.674764 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:21.674764 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:43:21.674764 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:43:21.674764 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:43:21.674764 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:43:21.674764 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 30b77978-2489-4c33-ab03-c7be19f1d46c does not exist Sep 10 11:43:21.674764 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bc8313e9-8ca0-4a56-8ea6-f967e58e6fb3'] Sep 10 11:43:21.674764 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:21.681726 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d0e5f134-35ad-468f-99af-fcc95f71bc3c tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Returning 404 to user: Security group 30b77978-2489-4c33-ab03-c7be19f1d46c does not exist Sep 10 11:43:21.681726 n-d-856895-1 devstack@n-api.service[128777]: Neutron server returns request_ids: ['req-bc8313e9-8ca0-4a56-8ea6-f967e58e6fb3'] {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:43:21.684263 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d0e5f134-35ad-468f-99af-fcc95f71bc3c tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/30b77978-2489-4c33-ab03-c7be19f1d46c" status: 404 len: 194 microversion: 2.1 time: 0.091893 Sep 10 11:43:21.686761 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 677/1299] 10.222.0.23 () {58 vars in 1272 bytes} [Sat Sep 10 11:43:21 2022] DELETE /compute/v2.1/os-security-groups/30b77978-2489-4c33-ab03-c7be19f1d46c => generated 194 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:43:21.699791 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a190d9d2-d88e-486d-b21e-b91e2a29d260 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '.version_select at 0x7f407310bf70>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:21.741003 n-d-856895-1 devstack@n-api.service[128777]: DEBUG neutronclient.v2_0.client [None req-a190d9d2-d88e-486d-b21e-b91e2a29d260 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6e410a8e-44e0-4cd2-8db9-d637cc02adf1 does not exist", "detail": ""}} {{(pid=128777) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 11:43:21.741647 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.security_group_api [None req-a190d9d2-d88e-486d-b21e-b91e2a29d260 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Neutron security group 6e410a8e-44e0-4cd2-8db9-d637cc02adf1 not found {{(pid=128777) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 11:43:21.742786 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-a190d9d2-d88e-486d-b21e-b91e2a29d260 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] HTTP exception thrown: Security group 6e410a8e-44e0-4cd2-8db9-d637cc02adf1 does not exist Sep 10 11:43:21.742786 n-d-856895-1 devstack@n-api.service[128777]: Neutron server returns request_ids: ['req-66301cae-6a33-4af2-b8e8-2078079977c3'] Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a190d9d2-d88e-486d-b21e-b91e2a29d260 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Request method failure captured: Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/os-security-groups/6e410a8e-44e0-4cd2-8db9-d637cc02adf1 HTTP/1.1 Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHgBU0aZ9PqJpGA422fKNy27Wjo5sOCfo4CIswXFFfdPv36WiPjLOYw_neMbOsaeYNKIXkVSp0pEYCo9771BWqsl0fjBWyX6S3skhskK7a85wRu3ZuO-FXP422rQwCRC9xzOeesr0UvY-AFVf9_IuIXQit7YUH71vPa-NVExdrtG-MY Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 91ad59d8440a49c496acbede9848e944 Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ad59d8440a49c496acbede9848e944"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ad59d8440a49c496acbede9848e944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_91ad59d8440a49c496acbede9848e944", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/91ad59d8440a49c496acbede9848e944"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 91ad59d8440a49c496acbede9848e944 Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-SecurityGroupsTestJSON-1578123858-project Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 080c97b7605a40ebac26884a59ea3902 Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-SecurityGroupsTestJSON-1578123858-project Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: exception: Security group 6e410a8e-44e0-4cd2-8db9-d637cc02adf1 does not exist Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: Neutron server returns request_ids: ['req-66301cae-6a33-4af2-b8e8-2078079977c3'] Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '6e410a8e-44e0-4cd2-8db9-d637cc02adf1'} Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 11:43:21.744757 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6e410a8e-44e0-4cd2-8db9-d637cc02adf1 does not exist Sep 10 11:43:21.753026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66301cae-6a33-4af2-b8e8-2078079977c3'] Sep 10 11:43:21.753026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:21.753026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:21.753026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:21.753026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:21.753026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 10 11:43:21.753026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 10 11:43:21.753026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 11:43:21.753026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 11:43:21.753026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6e410a8e-44e0-4cd2-8db9-d637cc02adf1 does not exist Sep 10 11:43:21.753026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66301cae-6a33-4af2-b8e8-2078079977c3'] Sep 10 11:43:21.753026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:21.753026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:21.753026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:21.753026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:21.753026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:43:21.753026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:43:21.753026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:43:21.753026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:43:21.753026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:43:21.753026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:43:21.753026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:43:21.753026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:43:21.753026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 10 11:43:21.753026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 11:43:21.753026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6e410a8e-44e0-4cd2-8db9-d637cc02adf1 does not exist Sep 10 11:43:21.753026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66301cae-6a33-4af2-b8e8-2078079977c3'] Sep 10 11:43:21.753026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:21.753026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:21.753026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:21.753026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:21.753026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:43:21.753026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:43:21.753026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:43:21.753026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:43:21.753026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6e410a8e-44e0-4cd2-8db9-d637cc02adf1 does not exist Sep 10 11:43:21.753026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66301cae-6a33-4af2-b8e8-2078079977c3'] Sep 10 11:43:21.753026 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:21.753026 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a190d9d2-d88e-486d-b21e-b91e2a29d260 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Returning 404 to user: Security group 6e410a8e-44e0-4cd2-8db9-d637cc02adf1 does not exist Sep 10 11:43:21.753026 n-d-856895-1 devstack@n-api.service[128777]: Neutron server returns request_ids: ['req-66301cae-6a33-4af2-b8e8-2078079977c3'] {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:43:21.753026 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a190d9d2-d88e-486d-b21e-b91e2a29d260 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/6e410a8e-44e0-4cd2-8db9-d637cc02adf1" status: 404 len: 194 microversion: 2.1 time: 0.056221 Sep 10 11:43:21.753026 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 678/1300] 10.222.0.23 () {58 vars in 1272 bytes} [Sat Sep 10 11:43:21 2022] DELETE /compute/v2.1/os-security-groups/6e410a8e-44e0-4cd2-8db9-d637cc02adf1 => generated 194 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:43:21.756732 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4c3dc857-01c6-4825-82a6-15ebcae1ab6f tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '.version_select at 0x7f407310b9d0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:21.864455 n-d-856895-1 devstack@n-api.service[128777]: DEBUG neutronclient.v2_0.client [None req-4c3dc857-01c6-4825-82a6-15ebcae1ab6f tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 92bc7684-c6b0-4f3e-a17a-b6146dc227c7 does not exist", "detail": ""}} {{(pid=128777) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 11:43:21.865062 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.security_group_api [None req-4c3dc857-01c6-4825-82a6-15ebcae1ab6f tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Neutron security group 92bc7684-c6b0-4f3e-a17a-b6146dc227c7 not found {{(pid=128777) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 11:43:21.865588 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-4c3dc857-01c6-4825-82a6-15ebcae1ab6f tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] HTTP exception thrown: Security group 92bc7684-c6b0-4f3e-a17a-b6146dc227c7 does not exist Sep 10 11:43:21.865588 n-d-856895-1 devstack@n-api.service[128777]: Neutron server returns request_ids: ['req-4ecb1848-ee4e-41c9-8d01-a93ac36763bf'] Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4c3dc857-01c6-4825-82a6-15ebcae1ab6f tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Request method failure captured: Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/os-security-groups/92bc7684-c6b0-4f3e-a17a-b6146dc227c7 HTTP/1.1 Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHgBU0aZ9PqJpGA422fKNy27Wjo5sOCfo4CIswXFFfdPv36WiPjLOYw_neMbOsaeYNKIXkVSp0pEYCo9771BWqsl0fjBWyX6S3skhskK7a85wRu3ZuO-FXP422rQwCRC9xzOeesr0UvY-AFVf9_IuIXQit7YUH71vPa-NVExdrtG-MY Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 91ad59d8440a49c496acbede9848e944 Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ad59d8440a49c496acbede9848e944"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ad59d8440a49c496acbede9848e944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_91ad59d8440a49c496acbede9848e944", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/91ad59d8440a49c496acbede9848e944"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 91ad59d8440a49c496acbede9848e944 Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-SecurityGroupsTestJSON-1578123858-project Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 080c97b7605a40ebac26884a59ea3902 Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-SecurityGroupsTestJSON-1578123858-project Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: exception: Security group 92bc7684-c6b0-4f3e-a17a-b6146dc227c7 does not exist Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: Neutron server returns request_ids: ['req-4ecb1848-ee4e-41c9-8d01-a93ac36763bf'] Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '92bc7684-c6b0-4f3e-a17a-b6146dc227c7'} Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 11:43:21.867951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 92bc7684-c6b0-4f3e-a17a-b6146dc227c7 does not exist Sep 10 11:43:21.871932 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ecb1848-ee4e-41c9-8d01-a93ac36763bf'] Sep 10 11:43:21.871932 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:21.871932 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:21.871932 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:21.871932 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:21.871932 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 10 11:43:21.871932 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 10 11:43:21.871932 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 11:43:21.871932 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 11:43:21.871932 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 92bc7684-c6b0-4f3e-a17a-b6146dc227c7 does not exist Sep 10 11:43:21.871932 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ecb1848-ee4e-41c9-8d01-a93ac36763bf'] Sep 10 11:43:21.871932 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:21.871932 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:21.871932 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:21.871932 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:21.871932 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:43:21.871932 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:43:21.871932 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:43:21.871932 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:43:21.871932 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:43:21.871932 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:43:21.871932 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:43:21.871932 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:43:21.871932 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 10 11:43:21.871932 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 11:43:21.871932 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 92bc7684-c6b0-4f3e-a17a-b6146dc227c7 does not exist Sep 10 11:43:21.871932 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ecb1848-ee4e-41c9-8d01-a93ac36763bf'] Sep 10 11:43:21.871932 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:21.871932 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:21.871932 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:21.871932 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:21.871932 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:43:21.871932 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:43:21.871932 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:43:21.871932 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:43:21.871932 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 92bc7684-c6b0-4f3e-a17a-b6146dc227c7 does not exist Sep 10 11:43:21.871932 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ecb1848-ee4e-41c9-8d01-a93ac36763bf'] Sep 10 11:43:21.871932 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:21.871932 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4c3dc857-01c6-4825-82a6-15ebcae1ab6f tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Returning 404 to user: Security group 92bc7684-c6b0-4f3e-a17a-b6146dc227c7 does not exist Sep 10 11:43:21.871932 n-d-856895-1 devstack@n-api.service[128777]: Neutron server returns request_ids: ['req-4ecb1848-ee4e-41c9-8d01-a93ac36763bf'] {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:43:21.871932 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4c3dc857-01c6-4825-82a6-15ebcae1ab6f tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/92bc7684-c6b0-4f3e-a17a-b6146dc227c7" status: 404 len: 194 microversion: 2.1 time: 0.118522 Sep 10 11:43:21.871932 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 679/1301] 10.222.0.23 () {58 vars in 1272 bytes} [Sat Sep 10 11:43:21 2022] DELETE /compute/v2.1/os-security-groups/92bc7684-c6b0-4f3e-a17a-b6146dc227c7 => generated 194 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 11:43:21.878665 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5274a593-0301-43e6-b6c6-37fdf74ce122 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:21.879098 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5274a593-0301-43e6-b6c6-37fdf74ce122 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: f86661f1-aaad-445e-a762-12d85ccd0340] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:21.886388 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5274a593-0301-43e6-b6c6-37fdf74ce122 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:21.886890 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5274a593-0301-43e6-b6c6-37fdf74ce122 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:21.887364 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5274a593-0301-43e6-b6c6-37fdf74ce122 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:21.888075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5274a593-0301-43e6-b6c6-37fdf74ce122 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:21.888717 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5274a593-0301-43e6-b6c6-37fdf74ce122 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:21.889333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5274a593-0301-43e6-b6c6-37fdf74ce122 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:21.979777 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5274a593-0301-43e6-b6c6-37fdf74ce122 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: f86661f1-aaad-445e-a762-12d85ccd0340] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:43:22.153679 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5274a593-0301-43e6-b6c6-37fdf74ce122 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f86661f1-aaad-445e-a762-12d85ccd0340" status: 204 len: 0 microversion: 2.1 time: 0.279066 Sep 10 11:43:22.155504 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 680/1302] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:43:21 2022] DELETE /compute/v2.1/servers/f86661f1-aaad-445e-a762-12d85ccd0340 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:43:22.175189 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-37ebd855-dce1-4981-9ebd-0e53a6debe26 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:22.184064 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-37ebd855-dce1-4981-9ebd-0e53a6debe26 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:22.196065 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-37ebd855-dce1-4981-9ebd-0e53a6debe26 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:22.196663 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-37ebd855-dce1-4981-9ebd-0e53a6debe26 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:22.197110 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-37ebd855-dce1-4981-9ebd-0e53a6debe26 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:22.197832 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-37ebd855-dce1-4981-9ebd-0e53a6debe26 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:22.198292 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-37ebd855-dce1-4981-9ebd-0e53a6debe26 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:22.198723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-37ebd855-dce1-4981-9ebd-0e53a6debe26 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:22.244997 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-37ebd855-dce1-4981-9ebd-0e53a6debe26 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087688 Sep 10 11:43:22.246244 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 681/1303] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 11:43:22 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:43:22.255508 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9b05f918-0205-408f-8004-e71cf01f3379 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:22.256266 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9b05f918-0205-408f-8004-e71cf01f3379 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: f86661f1-aaad-445e-a762-12d85ccd0340] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:22.264834 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9b05f918-0205-408f-8004-e71cf01f3379 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:22.265595 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9b05f918-0205-408f-8004-e71cf01f3379 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:22.266545 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9b05f918-0205-408f-8004-e71cf01f3379 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:22.268220 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9b05f918-0205-408f-8004-e71cf01f3379 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:22.269151 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9b05f918-0205-408f-8004-e71cf01f3379 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:22.269773 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9b05f918-0205-408f-8004-e71cf01f3379 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:22.644091 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9b05f918-0205-408f-8004-e71cf01f3379 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c97b7605a40ebac26884a59ea3902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ad59d8440a49c496acbede9848e944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:22.662317 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9b05f918-0205-408f-8004-e71cf01f3379 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/servers/f86661f1-aaad-445e-a762-12d85ccd0340" status: 200 len: 1645 microversion: 2.1 time: 0.414334 Sep 10 11:43:22.664047 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 682/1304] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:22 2022] GET /compute/v2.1/servers/f86661f1-aaad-445e-a762-12d85ccd0340 => generated 1645 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:22.688241 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4a7dc014-acfe-47a8-a062-b4fd2716db91 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:22.689986 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4a7dc014-acfe-47a8-a062-b4fd2716db91 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:22.700332 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a7dc014-acfe-47a8-a062-b4fd2716db91 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:22.702232 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a7dc014-acfe-47a8-a062-b4fd2716db91 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:22.704454 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a7dc014-acfe-47a8-a062-b4fd2716db91 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:22.705701 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a7dc014-acfe-47a8-a062-b4fd2716db91 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:22.708761 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a7dc014-acfe-47a8-a062-b4fd2716db91 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:22.709604 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a7dc014-acfe-47a8-a062-b4fd2716db91 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:23.064531 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4a7dc014-acfe-47a8-a062-b4fd2716db91 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:23.073907 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4a7dc014-acfe-47a8-a062-b4fd2716db91 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 200 len: 1471 microversion: 2.1 time: 0.408399 Sep 10 11:43:23.074615 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 683/1305] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:22 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 1471 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:23.261198 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d06799e2-11b6-49b4-a646-bdc4561aec2d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:23.264341 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d06799e2-11b6-49b4-a646-bdc4561aec2d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:23.271835 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d06799e2-11b6-49b4-a646-bdc4561aec2d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:23.272699 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d06799e2-11b6-49b4-a646-bdc4561aec2d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:23.274070 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d06799e2-11b6-49b4-a646-bdc4561aec2d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:23.275396 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d06799e2-11b6-49b4-a646-bdc4561aec2d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:23.276106 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d06799e2-11b6-49b4-a646-bdc4561aec2d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:23.276778 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d06799e2-11b6-49b4-a646-bdc4561aec2d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:23.329470 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d06799e2-11b6-49b4-a646-bdc4561aec2d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072874 Sep 10 11:43:23.333502 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 684/1306] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 11:43:23 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:43:23.588309 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0d275b9b-9ff2-4a9a-8d1d-5b05efe9159b tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.603792 Sep 10 11:43:23.589066 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 623/1307] 10.222.0.23 () {60 vars in 1170 bytes} [Sat Sep 10 11:43:20 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:43:23.604186 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-eb202a25-306c-4516-98bc-7bf89b732a80 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Action: 'action', calling method: .version_select at 0x7f4078e685e0>, body: {"addFloatingIp": {"address": "172.25.5.213"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:43:23.607134 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-eb202a25-306c-4516-98bc-7bf89b732a80 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] [instance: 10efe0de-fffd-415e-af3d-06d750fea3d4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:23.615109 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb202a25-306c-4516-98bc-7bf89b732a80 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:23.615637 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb202a25-306c-4516-98bc-7bf89b732a80 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:23.616074 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb202a25-306c-4516-98bc-7bf89b732a80 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:23.616942 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb202a25-306c-4516-98bc-7bf89b732a80 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:23.617406 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb202a25-306c-4516-98bc-7bf89b732a80 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:23.617879 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb202a25-306c-4516-98bc-7bf89b732a80 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:23.691694 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cdc4b9a7-18ee-4a21-8f7f-be43297dc99b tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:23.692786 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cdc4b9a7-18ee-4a21-8f7f-be43297dc99b tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: f86661f1-aaad-445e-a762-12d85ccd0340] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:23.704558 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cdc4b9a7-18ee-4a21-8f7f-be43297dc99b tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:23.709901 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cdc4b9a7-18ee-4a21-8f7f-be43297dc99b tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:23.710656 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cdc4b9a7-18ee-4a21-8f7f-be43297dc99b tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:23.712437 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cdc4b9a7-18ee-4a21-8f7f-be43297dc99b tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:23.712572 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:43:23.713839 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cdc4b9a7-18ee-4a21-8f7f-be43297dc99b tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:23.714884 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cdc4b9a7-18ee-4a21-8f7f-be43297dc99b tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:23.717732 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb202a25-306c-4516-98bc-7bf89b732a80 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "refresh_cache-10efe0de-fffd-415e-af3d-06d750fea3d4" {{(pid=128777) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 10 11:43:23.718396 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb202a25-306c-4516-98bc-7bf89b732a80 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquired lock "refresh_cache-10efe0de-fffd-415e-af3d-06d750fea3d4" {{(pid=128777) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 10 11:43:23.791459 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:43:24.239626 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-cdc4b9a7-18ee-4a21-8f7f-be43297dc99b tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '080c97b7605a40ebac26884a59ea3902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ad59d8440a49c496acbede9848e944', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:24.255985 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cdc4b9a7-18ee-4a21-8f7f-be43297dc99b tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/servers/f86661f1-aaad-445e-a762-12d85ccd0340" status: 200 len: 1645 microversion: 2.1 time: 0.568508 Sep 10 11:43:24.256581 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 624/1308] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:23 2022] GET /compute/v2.1/servers/f86661f1-aaad-445e-a762-12d85ccd0340 => generated 1645 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:43:24.276788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2f9185fe-1738-4c53-8b32-57abd1694de7 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:24.277417 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2f9185fe-1738-4c53-8b32-57abd1694de7 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:24.299000 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f9185fe-1738-4c53-8b32-57abd1694de7 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:24.299528 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f9185fe-1738-4c53-8b32-57abd1694de7 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:24.299988 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f9185fe-1738-4c53-8b32-57abd1694de7 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:24.300695 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f9185fe-1738-4c53-8b32-57abd1694de7 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:24.301257 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f9185fe-1738-4c53-8b32-57abd1694de7 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:24.301982 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f9185fe-1738-4c53-8b32-57abd1694de7 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:24.989972 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-2f9185fe-1738-4c53-8b32-57abd1694de7 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lazy-loading 'services' on Instance uuid 50d20272-889d-4b72-b33d-73094c78c7b4 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:43:25.008322 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2f9185fe-1738-4c53-8b32-57abd1694de7 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 2419 microversion: 2.25 time: 0.735325 Sep 10 11:43:25.009405 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 625/1309] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:43:24 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 2419 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:43:25.014391 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a7f35844-d8f3-42b4-8228-95cf5d7faec4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:25.015026 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a7f35844-d8f3-42b4-8228-95cf5d7faec4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:25.020461 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=64 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:43:25.022512 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a7f35844-d8f3-42b4-8228-95cf5d7faec4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:25.023016 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a7f35844-d8f3-42b4-8228-95cf5d7faec4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:25.023751 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a7f35844-d8f3-42b4-8228-95cf5d7faec4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:25.025205 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a7f35844-d8f3-42b4-8228-95cf5d7faec4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:25.025681 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a7f35844-d8f3-42b4-8228-95cf5d7faec4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:25.026110 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a7f35844-d8f3-42b4-8228-95cf5d7faec4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:25.068829 n-d-856895-1 devstack@n-api.service[128777]: DEBUG neutronclient.v2_0.client [None req-eb202a25-306c-4516-98bc-7bf89b732a80 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.5.213 (68a05a57-08ee-4546-8470-86883af21aef) with port 8551ac91-90ed-4c01-9cfa-ec23da24cb18 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 9626420b-79de-41a5-9c99-74681e351ad0.", "detail": ""}} {{(pid=128777) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 11:43:25.070008 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb202a25-306c-4516-98bc-7bf89b732a80 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Releasing lock "refresh_cache-10efe0de-fffd-415e-af3d-06d750fea3d4" {{(pid=128777) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 10 11:43:25.072166 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-eb202a25-306c-4516-98bc-7bf89b732a80 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] HTTP exception thrown: Cannot associate floating IP 172.25.5.213 (68a05a57-08ee-4546-8470-86883af21aef) with port 8551ac91-90ed-4c01-9cfa-ec23da24cb18 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 9626420b-79de-41a5-9c99-74681e351ad0. Sep 10 11:43:25.072166 n-d-856895-1 devstack@n-api.service[128777]: Neutron server returns request_ids: ['req-941a149f-1f3e-4ea6-9ddf-2424c67109bb'] Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-eb202a25-306c-4516-98bc-7bf89b732a80 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Request method failure captured: Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4/action HTTP/1.1 Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 46 Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHg7i2VXRU_is7QgDeJQgfmUaY96gAJ8CC02J9SiCRe06Z2uFfLLsxu2uIK_zHSkG3Hs5vqCRIw2QoP7lKMLjcx9gq71pztc6-B81S8wLlSUmTPhhoxC7O1uzuR8sJ5yP74X0cmSArSoiRB-h9oB2fQugiOGmJqFxEbOlDxCQ5jVlHQ Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 513f3ad4f9d147a5b9ac652fa5fcde04 Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/513f3ad4f9d147a5b9ac652fa5fcde04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/513f3ad4f9d147a5b9ac652fa5fcde04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_513f3ad4f9d147a5b9ac652fa5fcde04", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/513f3ad4f9d147a5b9ac652fa5fcde04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 513f3ad4f9d147a5b9ac652fa5fcde04 Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: fa1592ac1d534dc283392ff5d68765ef Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: {"addFloatingIp": {"address": "172.25.5.213"}} Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: exception: Cannot associate floating IP 172.25.5.213 (68a05a57-08ee-4546-8470-86883af21aef) with port 8551ac91-90ed-4c01-9cfa-ec23da24cb18 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 9626420b-79de-41a5-9c99-74681e351ad0. Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: Neutron server returns request_ids: ['req-941a149f-1f3e-4ea6-9ddf-2424c67109bb'] Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '10efe0de-fffd-415e-af3d-06d750fea3d4', 'body': {'addFloatingIp': {'address': '172.25.5.213'}}} Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 11:43:25.075209 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.5.213 (68a05a57-08ee-4546-8470-86883af21aef) with port 8551ac91-90ed-4c01-9cfa-ec23da24cb18 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 9626420b-79de-41a5-9c99-74681e351ad0. Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-941a149f-1f3e-4ea6-9ddf-2424c67109bb'] Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.5.213 (68a05a57-08ee-4546-8470-86883af21aef) with port 8551ac91-90ed-4c01-9cfa-ec23da24cb18 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 9626420b-79de-41a5-9c99-74681e351ad0. Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-941a149f-1f3e-4ea6-9ddf-2424c67109bb'] Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.5.213 (68a05a57-08ee-4546-8470-86883af21aef) with port 8551ac91-90ed-4c01-9cfa-ec23da24cb18 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 9626420b-79de-41a5-9c99-74681e351ad0. Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-941a149f-1f3e-4ea6-9ddf-2424c67109bb'] Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.5.213 (68a05a57-08ee-4546-8470-86883af21aef) with port 8551ac91-90ed-4c01-9cfa-ec23da24cb18 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 9626420b-79de-41a5-9c99-74681e351ad0. Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-941a149f-1f3e-4ea6-9ddf-2424c67109bb'] Sep 10 11:43:25.082406 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:25.090631 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-eb202a25-306c-4516-98bc-7bf89b732a80 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Returning 400 to user: Cannot associate floating IP 172.25.5.213 (68a05a57-08ee-4546-8470-86883af21aef) with port 8551ac91-90ed-4c01-9cfa-ec23da24cb18 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 9626420b-79de-41a5-9c99-74681e351ad0. Sep 10 11:43:25.090631 n-d-856895-1 devstack@n-api.service[128777]: Neutron server returns request_ids: ['req-941a149f-1f3e-4ea6-9ddf-2424c67109bb'] {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:43:25.090631 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-eb202a25-306c-4516-98bc-7bf89b732a80 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] 10.222.0.23 "POST /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4/action" status: 400 len: 381 microversion: 2.1 time: 1.490958 Sep 10 11:43:25.090631 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 685/1310] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:43:23 2022] POST /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4/action => generated 381 bytes in 1492 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:43:25.104458 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-02dee38a-f244-4e64-b011-a5b079016c19 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:25.107470 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-02dee38a-f244-4e64-b011-a5b079016c19 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:25.115721 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02dee38a-f244-4e64-b011-a5b079016c19 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:25.116579 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02dee38a-f244-4e64-b011-a5b079016c19 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:25.118065 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02dee38a-f244-4e64-b011-a5b079016c19 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:25.119021 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02dee38a-f244-4e64-b011-a5b079016c19 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:25.119721 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02dee38a-f244-4e64-b011-a5b079016c19 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:25.120364 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02dee38a-f244-4e64-b011-a5b079016c19 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:25.166503 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-02dee38a-f244-4e64-b011-a5b079016c19 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075910 Sep 10 11:43:25.167843 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 686/1311] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 11:43:25 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:43:25.184594 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8b35f486-5644-4beb-b99d-1c51ee4e5e8e tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-856895-1", "block_migration": "auto"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:43:25.187987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8b35f486-5644-4beb-b99d-1c51ee4e5e8e tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:25.195767 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b35f486-5644-4beb-b99d-1c51ee4e5e8e tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:25.196812 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b35f486-5644-4beb-b99d-1c51ee4e5e8e tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:25.197479 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b35f486-5644-4beb-b99d-1c51ee4e5e8e tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:25.198499 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b35f486-5644-4beb-b99d-1c51ee4e5e8e tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:25.199244 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b35f486-5644-4beb-b99d-1c51ee4e5e8e tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:25.199981 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b35f486-5644-4beb-b99d-1c51ee4e5e8e tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:25.239249 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-8b35f486-5644-4beb-b99d-1c51ee4e5e8e tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lazy-loading 'flavor' on Instance uuid 50d20272-889d-4b72-b33d-73094c78c7b4 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:43:25.256919 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8b35f486-5644-4beb-b99d-1c51ee4e5e8e tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Going to try to live migrate instance to n-h1-856895-1 {{(pid=128777) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 10 11:43:25.473696 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a7f35844-d8f3-42b4-8228-95cf5d7faec4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:25.485641 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a7f35844-d8f3-42b4-8228-95cf5d7faec4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 200 len: 1476 microversion: 2.1 time: 0.473918 Sep 10 11:43:25.490082 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 626/1312] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:25 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 1476 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:25.503724 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5cf3bdab-e5c7-464a-aa81-60e35af7fea2 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Calling method '.version_select at 0x7f407349e430>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:26.765880 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5cf3bdab-e5c7-464a-aa81-60e35af7fea2 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/68a05a57-08ee-4546-8470-86883af21aef" status: 202 len: 0 microversion: 2.1 time: 1.272495 Sep 10 11:43:26.766901 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 627/1313] 10.222.0.23 () {58 vars in 1263 bytes} [Sat Sep 10 11:43:25 2022] DELETE /compute/v2.1/os-floating-ips/68a05a57-08ee-4546-8470-86883af21aef => generated 0 bytes in 1276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:43:26.772304 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5d9afdee-1891-4d5b-8425-b81619c980cb tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:26.773385 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5d9afdee-1891-4d5b-8425-b81619c980cb tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] [instance: f86661f1-aaad-445e-a762-12d85ccd0340] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:26.784151 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5d9afdee-1891-4d5b-8425-b81619c980cb tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:26.785163 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5d9afdee-1891-4d5b-8425-b81619c980cb tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:26.785788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5d9afdee-1891-4d5b-8425-b81619c980cb tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:26.786705 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5d9afdee-1891-4d5b-8425-b81619c980cb tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:26.787718 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5d9afdee-1891-4d5b-8425-b81619c980cb tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:26.789820 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5d9afdee-1891-4d5b-8425-b81619c980cb tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:26.818028 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-5d9afdee-1891-4d5b-8425-b81619c980cb tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] HTTP exception thrown: Instance f86661f1-aaad-445e-a762-12d85ccd0340 could not be found. Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5d9afdee-1891-4d5b-8425-b81619c980cb tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Request method failure captured: Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/f86661f1-aaad-445e-a762-12d85ccd0340 HTTP/1.1 Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHgBU0aZ9PqJpGA422fKNy27Wjo5sOCfo4CIswXFFfdPv36WiPjLOYw_neMbOsaeYNKIXkVSp0pEYCo9771BWqsl0fjBWyX6S3skhskK7a85wRu3ZuO-FXP422rQwCRC9xzOeesr0UvY-AFVf9_IuIXQit7YUH71vPa-NVExdrtG-MY Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 91ad59d8440a49c496acbede9848e944 Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ad59d8440a49c496acbede9848e944"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/91ad59d8440a49c496acbede9848e944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_91ad59d8440a49c496acbede9848e944", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/91ad59d8440a49c496acbede9848e944"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 91ad59d8440a49c496acbede9848e944 Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1578123858 Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-SecurityGroupsTestJSON-1578123858-project Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 080c97b7605a40ebac26884a59ea3902 Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-SecurityGroupsTestJSON-1578123858-project Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance f86661f1-aaad-445e-a762-12d85ccd0340 could not be found. Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'f86661f1-aaad-445e-a762-12d85ccd0340'} Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f86661f1-aaad-445e-a762-12d85ccd0340 could not be found. Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f86661f1-aaad-445e-a762-12d85ccd0340 could not be found. Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:26.820061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:43:26.826271 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:26.826271 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:43:26.826271 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:43:26.826271 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:43:26.826271 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:43:26.826271 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f86661f1-aaad-445e-a762-12d85ccd0340 could not be found. Sep 10 11:43:26.826271 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:43:26.828955 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5d9afdee-1891-4d5b-8425-b81619c980cb tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Returning 404 to user: Instance f86661f1-aaad-445e-a762-12d85ccd0340 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:43:26.830085 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5d9afdee-1891-4d5b-8425-b81619c980cb tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "GET /compute/v2.1/servers/f86661f1-aaad-445e-a762-12d85ccd0340" status: 404 len: 111 microversion: 2.1 time: 0.061894 Sep 10 11:43:26.834379 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 628/1314] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:26 2022] GET /compute/v2.1/servers/f86661f1-aaad-445e-a762-12d85ccd0340 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:43:27.007262 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-854d9071-4b05-4371-8a9e-b02f04428624 req-bee90a71-c407-47eb-a2c8-9e14bfe2da03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f86661f1-aaad-445e-a762-12d85ccd0340", "name": "network-vif-deleted", "tag": "e6ae3a2a-28cf-436d-89cc-e8fa6fa8266c"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:43:27.019230 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-854d9071-4b05-4371-8a9e-b02f04428624 req-bee90a71-c407-47eb-a2c8-9e14bfe2da03 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:27.019969 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-854d9071-4b05-4371-8a9e-b02f04428624 req-bee90a71-c407-47eb-a2c8-9e14bfe2da03 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:27.020626 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-854d9071-4b05-4371-8a9e-b02f04428624 req-bee90a71-c407-47eb-a2c8-9e14bfe2da03 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:27.033113 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-854d9071-4b05-4371-8a9e-b02f04428624 req-bee90a71-c407-47eb-a2c8-9e14bfe2da03 service nova] Creating event network-vif-deleted:e6ae3a2a-28cf-436d-89cc-e8fa6fa8266c for instance f86661f1-aaad-445e-a762-12d85ccd0340 on n-h2-856895-1 Sep 10 11:43:27.039232 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-854d9071-4b05-4371-8a9e-b02f04428624 req-bee90a71-c407-47eb-a2c8-9e14bfe2da03 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203049 Sep 10 11:43:27.040639 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 629/1315] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:43:27.050311 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2b21f278-c404-457c-b60d-11399da14efd tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:27.056086 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2b21f278-c404-457c-b60d-11399da14efd tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:27.065208 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2b21f278-c404-457c-b60d-11399da14efd tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:27.066280 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2b21f278-c404-457c-b60d-11399da14efd tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:27.066954 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2b21f278-c404-457c-b60d-11399da14efd tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:27.068124 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2b21f278-c404-457c-b60d-11399da14efd tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:27.068826 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2b21f278-c404-457c-b60d-11399da14efd tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:27.069499 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2b21f278-c404-457c-b60d-11399da14efd tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:27.107088 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2b21f278-c404-457c-b60d-11399da14efd tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064776 Sep 10 11:43:27.108253 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 630/1316] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 11:43:27 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:43:27.114946 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6252beee-a8ee-4a0d-8644-797b45d2141b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:27.116002 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6252beee-a8ee-4a0d-8644-797b45d2141b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:27.124298 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6252beee-a8ee-4a0d-8644-797b45d2141b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:27.125127 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6252beee-a8ee-4a0d-8644-797b45d2141b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:27.126336 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6252beee-a8ee-4a0d-8644-797b45d2141b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:27.127342 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6252beee-a8ee-4a0d-8644-797b45d2141b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:27.128084 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6252beee-a8ee-4a0d-8644-797b45d2141b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:27.128746 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6252beee-a8ee-4a0d-8644-797b45d2141b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:27.306326 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6252beee-a8ee-4a0d-8644-797b45d2141b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:27.316796 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6252beee-a8ee-4a0d-8644-797b45d2141b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 200 len: 1476 microversion: 2.1 time: 0.207382 Sep 10 11:43:27.318282 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 631/1317] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:27 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 1476 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:27.340866 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e4535442-3144-4fe9-bf05-e5b36e85a78e tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Action: 'action', calling method: .version_select at 0x7f40798ee820>, body: {"removeFloatingIp": {"address": "172.25.5.158"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:43:27.524138 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e4535442-3144-4fe9-bf05-e5b36e85a78e tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] [instance: 10efe0de-fffd-415e-af3d-06d750fea3d4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:27.535851 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4535442-3144-4fe9-bf05-e5b36e85a78e tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:27.536595 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4535442-3144-4fe9-bf05-e5b36e85a78e tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:27.537233 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4535442-3144-4fe9-bf05-e5b36e85a78e tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:27.538283 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4535442-3144-4fe9-bf05-e5b36e85a78e tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:27.539220 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4535442-3144-4fe9-bf05-e5b36e85a78e tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:27.539845 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4535442-3144-4fe9-bf05-e5b36e85a78e tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:27.890448 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8b35f486-5644-4beb-b99d-1c51ee4e5e8e tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4/action" status: 202 len: 0 microversion: 2.25 time: 2.720812 Sep 10 11:43:27.891132 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 687/1318] 10.222.0.23 () {62 vars in 1319 bytes} [Sat Sep 10 11:43:25 2022] POST /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4/action => generated 0 bytes in 2723 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:43:27.897009 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-02755a7f-8c03-43f0-bc65-b658a30e95c0 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '.version_select at 0x7f4073842b80>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:28.377058 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4535442-3144-4fe9-bf05-e5b36e85a78e tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "refresh_cache-10efe0de-fffd-415e-af3d-06d750fea3d4" {{(pid=128776) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 10 11:43:28.377543 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4535442-3144-4fe9-bf05-e5b36e85a78e tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquired lock "refresh_cache-10efe0de-fffd-415e-af3d-06d750fea3d4" {{(pid=128776) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 10 11:43:29.690054 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-02755a7f-8c03-43f0-bc65-b658a30e95c0 tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/1065ddc0-2e7c-461c-9c22-7a76dc27300e" status: 202 len: 0 microversion: 2.1 time: 1.797567 Sep 10 11:43:29.691251 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 688/1319] 10.222.0.23 () {58 vars in 1272 bytes} [Sat Sep 10 11:43:27 2022] DELETE /compute/v2.1/os-security-groups/1065ddc0-2e7c-461c-9c22-7a76dc27300e => generated 0 bytes in 1799 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:43:29.700311 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7ccbe36e-3252-4651-93a2-32c61053963f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:29.701250 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7ccbe36e-3252-4651-93a2-32c61053963f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:29.745509 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ccbe36e-3252-4651-93a2-32c61053963f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:29.746274 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ccbe36e-3252-4651-93a2-32c61053963f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:29.746904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ccbe36e-3252-4651-93a2-32c61053963f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:29.747885 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ccbe36e-3252-4651-93a2-32c61053963f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:29.749723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ccbe36e-3252-4651-93a2-32c61053963f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:29.751482 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ccbe36e-3252-4651-93a2-32c61053963f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:30.494970 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7ccbe36e-3252-4651-93a2-32c61053963f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:30.505095 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7ccbe36e-3252-4651-93a2-32c61053963f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:30.506977 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7ccbe36e-3252-4651-93a2-32c61053963f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:30.509743 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7ccbe36e-3252-4651-93a2-32c61053963f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1811 microversion: 2.25 time: 0.814204 Sep 10 11:43:30.510743 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 689/1320] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:43:29 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1811 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:43:30.518510 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e741af94-66ec-4998-aa23-6f948c9eacb6 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:30.521395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e741af94-66ec-4998-aa23-6f948c9eacb6 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:30.530330 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:43:30.532059 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e741af94-66ec-4998-aa23-6f948c9eacb6 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:30.533039 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e741af94-66ec-4998-aa23-6f948c9eacb6 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:30.533741 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e741af94-66ec-4998-aa23-6f948c9eacb6 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:30.534928 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e741af94-66ec-4998-aa23-6f948c9eacb6 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:30.535822 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e741af94-66ec-4998-aa23-6f948c9eacb6 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:30.536545 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e741af94-66ec-4998-aa23-6f948c9eacb6 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:30.574079 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e741af94-66ec-4998-aa23-6f948c9eacb6 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061882 Sep 10 11:43:30.574667 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 690/1321] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 11:43:30 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:43:30.579724 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3aa4873b-3bf7-4666-8233-9fabbb9abd8c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:30.580641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3aa4873b-3bf7-4666-8233-9fabbb9abd8c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:30.587892 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3aa4873b-3bf7-4666-8233-9fabbb9abd8c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:30.588379 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3aa4873b-3bf7-4666-8233-9fabbb9abd8c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:30.589023 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3aa4873b-3bf7-4666-8233-9fabbb9abd8c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:30.589725 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3aa4873b-3bf7-4666-8233-9fabbb9abd8c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:30.590183 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3aa4873b-3bf7-4666-8233-9fabbb9abd8c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:30.590629 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3aa4873b-3bf7-4666-8233-9fabbb9abd8c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:30.996235 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3aa4873b-3bf7-4666-8233-9fabbb9abd8c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:31.009310 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3aa4873b-3bf7-4666-8233-9fabbb9abd8c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 200 len: 1476 microversion: 2.1 time: 0.432895 Sep 10 11:43:31.024604 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 691/1322] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:30 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 1476 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:31.032219 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5b232b21-54f2-4733-bb2f-a96005e4079d tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:31.035624 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5b232b21-54f2-4733-bb2f-a96005e4079d tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] [instance: afb1a503-7e9a-474c-8dfe-b0e5838b7398] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:31.042208 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5b232b21-54f2-4733-bb2f-a96005e4079d tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:31.042979 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5b232b21-54f2-4733-bb2f-a96005e4079d tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:31.043649 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5b232b21-54f2-4733-bb2f-a96005e4079d tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:31.044926 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5b232b21-54f2-4733-bb2f-a96005e4079d tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:31.045595 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5b232b21-54f2-4733-bb2f-a96005e4079d tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:31.046027 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5b232b21-54f2-4733-bb2f-a96005e4079d tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:31.082324 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5b232b21-54f2-4733-bb2f-a96005e4079d tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] 10.222.0.23 "GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056180 Sep 10 11:43:31.082949 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 692/1323] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 11:43:31 2022] GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:43:31.088339 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-11f7d6a5-9731-40a9-9682-8b676fc9f47a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] Calling method '.version_select at 0x7f40730e09d0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:31.905548 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-e4535442-3144-4fe9-bf05-e5b36e85a78e tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] [instance: 10efe0de-fffd-415e-af3d-06d750fea3d4] Building network info cache for instance {{(pid=128776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 10 11:43:32.017962 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-11f7d6a5-9731-40a9-9682-8b676fc9f47a tempest-SecurityGroupsTestJSON-1578123858 tempest-SecurityGroupsTestJSON-1578123858-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/d59e9d31-bc54-4707-87db-5d9c771f3cd8" status: 202 len: 0 microversion: 2.1 time: 0.933397 Sep 10 11:43:32.019698 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 693/1324] 10.222.0.23 () {58 vars in 1272 bytes} [Sat Sep 10 11:43:31 2022] DELETE /compute/v2.1/os-security-groups/d59e9d31-bc54-4707-87db-5d9c771f3cd8 => generated 0 bytes in 936 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:43:32.062545 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-dc750dcb-10fe-40f6-875c-86da88290e0f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Action: 'create', calling method: .version_select at 0x7f407323d160>, body: {"keypair": {"name": "tempest-keypair-1715265238", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINJrk5qIBvcBJQcYgXBHcWf6BG7d2ak6ZV1ekb93qSS0sORRSe+tVNjFB8zJ3d1cAqtTJ4JWjSKR7WqoDZhyz5lSyaZP9K8vtE1gsVdElm1CDY8nbo4gwJ25EHxZSzPwg=="}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:43:32.109264 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-dc750dcb-10fe-40f6-875c-86da88290e0f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Getting quotas for project 125ad66541dd4acdb35af09b28001e39. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:43:32.128075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-dc750dcb-10fe-40f6-875c-86da88290e0f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Getting quotas for user 07d1c7718856439a8e76ed07ca5278b8 and project 125ad66541dd4acdb35af09b28001e39. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:43:32.198184 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-dc750dcb-10fe-40f6-875c-86da88290e0f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.175792 Sep 10 11:43:32.201323 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 694/1325] 10.222.0.23 () {62 vars in 1200 bytes} [Sat Sep 10 11:43:32 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 181 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 10 11:43:32.218859 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c6e2b11c-574b-42bc-883d-d87367cf5eb9 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:32.219802 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c6e2b11c-574b-42bc-883d-d87367cf5eb9 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] [instance: afb1a503-7e9a-474c-8dfe-b0e5838b7398] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:32.243077 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c6e2b11c-574b-42bc-883d-d87367cf5eb9 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:32.243883 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c6e2b11c-574b-42bc-883d-d87367cf5eb9 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:32.244514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c6e2b11c-574b-42bc-883d-d87367cf5eb9 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:32.246603 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c6e2b11c-574b-42bc-883d-d87367cf5eb9 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:32.247082 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c6e2b11c-574b-42bc-883d-d87367cf5eb9 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:32.247536 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c6e2b11c-574b-42bc-883d-d87367cf5eb9 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:32.424949 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-c6e2b11c-574b-42bc-883d-d87367cf5eb9 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lazy-loading 'services' on Instance uuid afb1a503-7e9a-474c-8dfe-b0e5838b7398 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:43:32.632438 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c6e2b11c-574b-42bc-883d-d87367cf5eb9 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] 10.222.0.23 "DELETE /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398/os-volume_attachments/b718fd20-403b-4f61-804a-7586bdbb832a" status: 202 len: 0 microversion: 2.1 time: 0.429253 Sep 10 11:43:32.636658 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 695/1326] 10.222.0.23 () {58 vars in 1416 bytes} [Sat Sep 10 11:43:32 2022] DELETE /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398/os-volume_attachments/b718fd20-403b-4f61-804a-7586bdbb832a => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:43:32.688489 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c2d3c49d-e3ca-454f-a523-71733c8c1bc6 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:32.689353 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c2d3c49d-e3ca-454f-a523-71733c8c1bc6 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:32.706835 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c2d3c49d-e3ca-454f-a523-71733c8c1bc6 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:32.708633 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c2d3c49d-e3ca-454f-a523-71733c8c1bc6 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:32.709934 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c2d3c49d-e3ca-454f-a523-71733c8c1bc6 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:32.712438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c2d3c49d-e3ca-454f-a523-71733c8c1bc6 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:32.713732 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c2d3c49d-e3ca-454f-a523-71733c8c1bc6 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:32.715742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c2d3c49d-e3ca-454f-a523-71733c8c1bc6 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:33.783187 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c2d3c49d-e3ca-454f-a523-71733c8c1bc6 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:33.801600 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c2d3c49d-e3ca-454f-a523-71733c8c1bc6 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:33.803265 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c2d3c49d-e3ca-454f-a523-71733c8c1bc6 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:33.804634 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c2d3c49d-e3ca-454f-a523-71733c8c1bc6 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1811 microversion: 2.25 time: 1.146771 Sep 10 11:43:33.807598 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 696/1327] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:43:32 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1811 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:43:33.815026 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-4db48839-dc34-41cf-8918-325ed2c428ec req-ea709295-c186-41ea-8c1c-e3f13173fa2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10efe0de-fffd-415e-af3d-06d750fea3d4", "tag": "8551ac91-90ed-4c01-9cfa-ec23da24cb18"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:43:33.827372 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-4db48839-dc34-41cf-8918-325ed2c428ec req-ea709295-c186-41ea-8c1c-e3f13173fa2f service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:33.828269 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-4db48839-dc34-41cf-8918-325ed2c428ec req-ea709295-c186-41ea-8c1c-e3f13173fa2f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:33.828937 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-4db48839-dc34-41cf-8918-325ed2c428ec req-ea709295-c186-41ea-8c1c-e3f13173fa2f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:33.884179 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-4db48839-dc34-41cf-8918-325ed2c428ec req-ea709295-c186-41ea-8c1c-e3f13173fa2f service nova] Creating event network-changed:8551ac91-90ed-4c01-9cfa-ec23da24cb18 for instance 10efe0de-fffd-415e-af3d-06d750fea3d4 on n-h2-856895-1 Sep 10 11:43:33.899431 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-4db48839-dc34-41cf-8918-325ed2c428ec req-ea709295-c186-41ea-8c1c-e3f13173fa2f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089866 Sep 10 11:43:33.906236 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 697/1328] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:43:33.923643 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6346089a-9120-4ebc-9e9c-5e58c20b92a2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:33.924725 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6346089a-9120-4ebc-9e9c-5e58c20b92a2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:33.937387 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6346089a-9120-4ebc-9e9c-5e58c20b92a2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:33.940126 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6346089a-9120-4ebc-9e9c-5e58c20b92a2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:33.940859 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6346089a-9120-4ebc-9e9c-5e58c20b92a2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:33.944039 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6346089a-9120-4ebc-9e9c-5e58c20b92a2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:33.948814 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6346089a-9120-4ebc-9e9c-5e58c20b92a2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:33.949886 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6346089a-9120-4ebc-9e9c-5e58c20b92a2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:34.702084 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-e4535442-3144-4fe9-bf05-e5b36e85a78e tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] [instance: 10efe0de-fffd-415e-af3d-06d750fea3d4] Updating instance_info_cache with network_info: [{"id": "8551ac91-90ed-4c01-9cfa-ec23da24cb18", "address": "fa:16:3e:93:48:68", "network": {"id": "b3bcc041-d1d1-4032-9b43-61f3a0a3c9fc", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-169954194-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "513f3ad4f9d147a5b9ac652fa5fcde04", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8551ac91-90", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 10 11:43:34.719871 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4535442-3144-4fe9-bf05-e5b36e85a78e tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Releasing lock "refresh_cache-10efe0de-fffd-415e-af3d-06d750fea3d4" {{(pid=128776) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 10 11:43:34.721088 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e4535442-3144-4fe9-bf05-e5b36e85a78e tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] 10.222.0.23 "POST /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4/action" status: 202 len: 0 microversion: 2.1 time: 7.388367 Sep 10 11:43:34.722489 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 632/1329] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:43:27 2022] POST /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4/action => generated 0 bytes in 7403 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 10 11:43:34.734513 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3609d3d3-5cc9-4c45-91c7-4d7947018267 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Calling method '.version_select at 0x7f40734de9d0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:34.739532 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6346089a-9120-4ebc-9e9c-5e58c20b92a2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:34.752384 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6346089a-9120-4ebc-9e9c-5e58c20b92a2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 200 len: 1476 microversion: 2.1 time: 0.842115 Sep 10 11:43:34.753285 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 698/1330] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:33 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 1476 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:34.842640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5729caae-71ba-41e9-b2a0-5c2cad750bf1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:34.844543 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5729caae-71ba-41e9-b2a0-5c2cad750bf1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:34.857896 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5729caae-71ba-41e9-b2a0-5c2cad750bf1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:34.858873 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5729caae-71ba-41e9-b2a0-5c2cad750bf1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:34.859745 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5729caae-71ba-41e9-b2a0-5c2cad750bf1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:34.863527 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5729caae-71ba-41e9-b2a0-5c2cad750bf1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:34.864292 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5729caae-71ba-41e9-b2a0-5c2cad750bf1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:34.865039 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5729caae-71ba-41e9-b2a0-5c2cad750bf1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:35.281612 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5729caae-71ba-41e9-b2a0-5c2cad750bf1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:35.297390 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5729caae-71ba-41e9-b2a0-5c2cad750bf1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:35.300031 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5729caae-71ba-41e9-b2a0-5c2cad750bf1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:35.302504 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5729caae-71ba-41e9-b2a0-5c2cad750bf1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1811 microversion: 2.25 time: 0.470531 Sep 10 11:43:35.306756 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 699/1331] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:43:34 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1811 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:43:35.777469 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7e6cbfdf-a363-4b49-8897-65b57d93cffb tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:35.778335 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7e6cbfdf-a363-4b49-8897-65b57d93cffb tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:35.786495 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e6cbfdf-a363-4b49-8897-65b57d93cffb tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:35.797000 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e6cbfdf-a363-4b49-8897-65b57d93cffb tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:35.798745 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e6cbfdf-a363-4b49-8897-65b57d93cffb tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:35.799712 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e6cbfdf-a363-4b49-8897-65b57d93cffb tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:35.803649 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e6cbfdf-a363-4b49-8897-65b57d93cffb tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:35.806063 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e6cbfdf-a363-4b49-8897-65b57d93cffb tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:36.201554 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7e6cbfdf-a363-4b49-8897-65b57d93cffb tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:36.224621 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7e6cbfdf-a363-4b49-8897-65b57d93cffb tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 200 len: 1476 microversion: 2.1 time: 0.449685 Sep 10 11:43:36.228061 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 700/1332] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:35 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 1476 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:43:36.337233 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-48bd83c2-ebee-4d6e-9d09-22c0e0e15be2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:36.337853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-48bd83c2-ebee-4d6e-9d09-22c0e0e15be2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:36.349975 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48bd83c2-ebee-4d6e-9d09-22c0e0e15be2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:36.351994 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48bd83c2-ebee-4d6e-9d09-22c0e0e15be2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:36.352571 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48bd83c2-ebee-4d6e-9d09-22c0e0e15be2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:36.353330 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48bd83c2-ebee-4d6e-9d09-22c0e0e15be2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:36.358591 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48bd83c2-ebee-4d6e-9d09-22c0e0e15be2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:36.359063 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48bd83c2-ebee-4d6e-9d09-22c0e0e15be2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:36.437126 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3609d3d3-5cc9-4c45-91c7-4d7947018267 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/0b30a71b-6bf5-49db-af9b-9313173bc0e2" status: 202 len: 0 microversion: 2.1 time: 1.710844 Sep 10 11:43:36.440337 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 633/1333] 10.222.0.23 () {58 vars in 1263 bytes} [Sat Sep 10 11:43:34 2022] DELETE /compute/v2.1/os-floating-ips/0b30a71b-6bf5-49db-af9b-9313173bc0e2 => generated 0 bytes in 1713 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:43:36.449750 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-00d7746a-9e8c-4d2c-8521-b8be221e6bbc tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-00d7746a-9e8c-4d2c-8521-b8be221e6bbc tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Request method failure captured: Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4/action HTTP/1.1 Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 34 Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHg7i2VXRU_is7QgDeJQgfmUaY96gAJ8CC02J9SiCRe06Z2uFfLLsxu2uIK_zHSkG3Hs5vqCRIw2QoP7lKMLjcx9gq71pztc6-B81S8wLlSUmTPhhoxC7O1uzuR8sJ5yP74X0cmSArSoiRB-h9oB2fQugiOGmJqFxEbOlDxCQ5jVlHQ Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 513f3ad4f9d147a5b9ac652fa5fcde04 Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/513f3ad4f9d147a5b9ac652fa5fcde04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/513f3ad4f9d147a5b9ac652fa5fcde04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_513f3ad4f9d147a5b9ac652fa5fcde04", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/513f3ad4f9d147a5b9ac652fa5fcde04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 513f3ad4f9d147a5b9ac652fa5fcde04 Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: fa1592ac1d534dc283392ff5d68765ef Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: {"addFloatingIp": {"address": ""}} Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '10efe0de-fffd-415e-af3d-06d750fea3d4', 'body': {'addFloatingIp': {'address': ''}}} Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise error Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi '' Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 11:43:36.468346 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 11:43:36.473889 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 11:43:36.473889 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 10 11:43:36.473889 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:43:36.473889 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:36.473889 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:43:36.473889 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:36.473889 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:43:36.473889 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:43:36.473889 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 11:43:36.473889 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 11:43:36.473889 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 10 11:43:36.473889 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:43:36.476184 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-00d7746a-9e8c-4d2c-8521-b8be221e6bbc tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:43:36.479347 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-00d7746a-9e8c-4d2c-8521-b8be221e6bbc tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] 10.222.0.23 "POST /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4/action" status: 400 len: 142 microversion: 2.1 time: 0.035314 Sep 10 11:43:36.482008 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 634/1334] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:43:36 2022] POST /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4/action => generated 142 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:43:36.498681 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-91b4045d-99b0-404f-985f-63489d33a41b tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:43:36.503446 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-91b4045d-99b0-404f-985f-63489d33a41b tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] [instance: 10efe0de-fffd-415e-af3d-06d750fea3d4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:36.537590 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-91b4045d-99b0-404f-985f-63489d33a41b tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:36.538115 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-91b4045d-99b0-404f-985f-63489d33a41b tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:36.538637 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-91b4045d-99b0-404f-985f-63489d33a41b tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:36.539697 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-91b4045d-99b0-404f-985f-63489d33a41b tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:36.545592 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-91b4045d-99b0-404f-985f-63489d33a41b tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:36.547578 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-91b4045d-99b0-404f-985f-63489d33a41b tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:36.613633 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-91b4045d-99b0-404f-985f-63489d33a41b tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "refresh_cache-10efe0de-fffd-415e-af3d-06d750fea3d4" {{(pid=128776) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 10 11:43:36.614036 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-91b4045d-99b0-404f-985f-63489d33a41b tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquired lock "refresh_cache-10efe0de-fffd-415e-af3d-06d750fea3d4" {{(pid=128776) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 10 11:43:36.854913 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-91b4045d-99b0-404f-985f-63489d33a41b tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Releasing lock "refresh_cache-10efe0de-fffd-415e-af3d-06d750fea3d4" {{(pid=128776) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 10 11:43:36.856267 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-91b4045d-99b0-404f-985f-63489d33a41b tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] HTTP exception thrown: floating IP not found Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-91b4045d-99b0-404f-985f-63489d33a41b tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Request method failure captured: Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4/action HTTP/1.1 Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 41 Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHg7i2VXRU_is7QgDeJQgfmUaY96gAJ8CC02J9SiCRe06Z2uFfLLsxu2uIK_zHSkG3Hs5vqCRIw2QoP7lKMLjcx9gq71pztc6-B81S8wLlSUmTPhhoxC7O1uzuR8sJ5yP74X0cmSArSoiRB-h9oB2fQugiOGmJqFxEbOlDxCQ5jVlHQ Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 513f3ad4f9d147a5b9ac652fa5fcde04 Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/513f3ad4f9d147a5b9ac652fa5fcde04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/513f3ad4f9d147a5b9ac652fa5fcde04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_513f3ad4f9d147a5b9ac652fa5fcde04", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/513f3ad4f9d147a5b9ac652fa5fcde04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 513f3ad4f9d147a5b9ac652fa5fcde04 Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: fa1592ac1d534dc283392ff5d68765ef Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: {"addFloatingIp": {"address": "0.0.0.0"}} Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: exception: floating IP not found Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '10efe0de-fffd-415e-af3d-06d750fea3d4', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Sep 10 11:43:36.859416 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:43:36.865911 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:36.865911 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:43:36.865911 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:36.865911 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:43:36.865911 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:43:36.865911 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:43:36.865911 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:43:36.865911 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Sep 10 11:43:36.865911 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:43:36.876904 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-91b4045d-99b0-404f-985f-63489d33a41b tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Returning 404 to user: floating IP not found {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:43:36.876904 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-91b4045d-99b0-404f-985f-63489d33a41b tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] 10.222.0.23 "POST /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4/action" status: 404 len: 67 microversion: 2.1 time: 0.381193 Sep 10 11:43:36.876904 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 635/1335] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:43:36 2022] POST /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4/action => generated 67 bytes in 382 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 10 11:43:36.881979 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b2e67840-911d-4b22-86a2-29ebe983b7ef tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:43:36.890969 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-48bd83c2-ebee-4d6e-9d09-22c0e0e15be2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:36.906868 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-48bd83c2-ebee-4d6e-9d09-22c0e0e15be2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:36.909115 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-48bd83c2-ebee-4d6e-9d09-22c0e0e15be2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:36.911051 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-48bd83c2-ebee-4d6e-9d09-22c0e0e15be2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1811 microversion: 2.25 time: 0.579757 Sep 10 11:43:36.911897 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 701/1336] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:43:36 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1811 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:43:37.011637 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-b2e67840-911d-4b22-86a2-29ebe983b7ef tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b2e67840-911d-4b22-86a2-29ebe983b7ef tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Request method failure captured: Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4/action HTTP/1.1 Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 44 Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHg7i2VXRU_is7QgDeJQgfmUaY96gAJ8CC02J9SiCRe06Z2uFfLLsxu2uIK_zHSkG3Hs5vqCRIw2QoP7lKMLjcx9gq71pztc6-B81S8wLlSUmTPhhoxC7O1uzuR8sJ5yP74X0cmSArSoiRB-h9oB2fQugiOGmJqFxEbOlDxCQ5jVlHQ Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 513f3ad4f9d147a5b9ac652fa5fcde04 Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/513f3ad4f9d147a5b9ac652fa5fcde04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/513f3ad4f9d147a5b9ac652fa5fcde04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_513f3ad4f9d147a5b9ac652fa5fcde04", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/513f3ad4f9d147a5b9ac652fa5fcde04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 513f3ad4f9d147a5b9ac652fa5fcde04 Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: fa1592ac1d534dc283392ff5d68765ef Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: {"removeFloatingIp": {"address": "0.0.0.0"}} Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: exception: Floating IP not found for address 0.0.0.0. Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '10efe0de-fffd-415e-af3d-06d750fea3d4', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Sep 10 11:43:37.013202 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Sep 10 11:43:37.018979 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Sep 10 11:43:37.018979 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:43:37.018979 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:37.018979 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:43:37.018979 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:37.018979 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:43:37.018979 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:43:37.018979 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:43:37.018979 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:43:37.018979 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Sep 10 11:43:37.018979 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:43:37.018979 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b2e67840-911d-4b22-86a2-29ebe983b7ef tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:43:37.018979 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b2e67840-911d-4b22-86a2-29ebe983b7ef tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] 10.222.0.23 "POST /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4/action" status: 404 len: 88 microversion: 2.1 time: 0.137190 Sep 10 11:43:37.018979 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 636/1337] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:43:36 2022] POST /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4/action => generated 88 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 10 11:43:37.026555 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c015bb68-54ce-46d9-8950-5ef907468f40 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:37.027061 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c015bb68-54ce-46d9-8950-5ef907468f40 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] [instance: 10efe0de-fffd-415e-af3d-06d750fea3d4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:37.042092 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c015bb68-54ce-46d9-8950-5ef907468f40 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:37.042653 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c015bb68-54ce-46d9-8950-5ef907468f40 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:37.043110 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c015bb68-54ce-46d9-8950-5ef907468f40 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:37.043908 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c015bb68-54ce-46d9-8950-5ef907468f40 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:37.044373 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c015bb68-54ce-46d9-8950-5ef907468f40 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:37.044802 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c015bb68-54ce-46d9-8950-5ef907468f40 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:37.080936 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c015bb68-54ce-46d9-8950-5ef907468f40 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] [instance: 10efe0de-fffd-415e-af3d-06d750fea3d4] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:43:37.124911 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:43:37.256504 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8d4ecf36-b283-4110-b93e-261a7703749c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:37.258100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8d4ecf36-b283-4110-b93e-261a7703749c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:37.262065 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c015bb68-54ce-46d9-8950-5ef907468f40 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] 10.222.0.23 "DELETE /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4" status: 204 len: 0 microversion: 2.1 time: 0.238521 Sep 10 11:43:37.262972 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 702/1338] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:43:37 2022] DELETE /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:43:37.268310 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8d4ecf36-b283-4110-b93e-261a7703749c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:37.269606 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8d4ecf36-b283-4110-b93e-261a7703749c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:37.270467 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8d4ecf36-b283-4110-b93e-261a7703749c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:37.271667 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8d4ecf36-b283-4110-b93e-261a7703749c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:37.272301 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8d4ecf36-b283-4110-b93e-261a7703749c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:37.273537 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8d4ecf36-b283-4110-b93e-261a7703749c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:37.276957 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9cd32cf1-f8c2-4b71-b79e-4be5de8cdc16 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:37.278792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9cd32cf1-f8c2-4b71-b79e-4be5de8cdc16 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] [instance: 10efe0de-fffd-415e-af3d-06d750fea3d4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:37.297217 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9cd32cf1-f8c2-4b71-b79e-4be5de8cdc16 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:37.300308 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9cd32cf1-f8c2-4b71-b79e-4be5de8cdc16 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:37.303806 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9cd32cf1-f8c2-4b71-b79e-4be5de8cdc16 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:37.305604 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9cd32cf1-f8c2-4b71-b79e-4be5de8cdc16 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:37.307447 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9cd32cf1-f8c2-4b71-b79e-4be5de8cdc16 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:37.308860 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9cd32cf1-f8c2-4b71-b79e-4be5de8cdc16 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:37.532932 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8d4ecf36-b283-4110-b93e-261a7703749c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:37.541749 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8d4ecf36-b283-4110-b93e-261a7703749c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 200 len: 1476 microversion: 2.1 time: 0.292203 Sep 10 11:43:37.542318 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 637/1339] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:37 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 1476 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:43:37.582412 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9cd32cf1-f8c2-4b71-b79e-4be5de8cdc16 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1592ac1d534dc283392ff5d68765ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513f3ad4f9d147a5b9ac652fa5fcde04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:37.594504 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9cd32cf1-f8c2-4b71-b79e-4be5de8cdc16 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] 10.222.0.23 "GET /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4" status: 200 len: 1541 microversion: 2.1 time: 0.326823 Sep 10 11:43:37.599070 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 703/1340] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:37 2022] GET /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4 => generated 1541 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:37.940228 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d63e3713-4bde-4263-850a-0438cadb8f3b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:37.940838 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d63e3713-4bde-4263-850a-0438cadb8f3b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:37.948871 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d63e3713-4bde-4263-850a-0438cadb8f3b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:37.949362 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d63e3713-4bde-4263-850a-0438cadb8f3b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:37.950014 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d63e3713-4bde-4263-850a-0438cadb8f3b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:37.950910 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d63e3713-4bde-4263-850a-0438cadb8f3b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:37.951394 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d63e3713-4bde-4263-850a-0438cadb8f3b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:37.951986 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d63e3713-4bde-4263-850a-0438cadb8f3b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:38.165524 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d63e3713-4bde-4263-850a-0438cadb8f3b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:38.182066 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d63e3713-4bde-4263-850a-0438cadb8f3b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:38.183914 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d63e3713-4bde-4263-850a-0438cadb8f3b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:38.185435 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d63e3713-4bde-4263-850a-0438cadb8f3b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1811 microversion: 2.25 time: 0.249109 Sep 10 11:43:38.187222 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 638/1341] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:43:37 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1811 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:43:38.568024 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ca6c66ce-6d27-441a-b5f5-730fabd03bf9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:38.569262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ca6c66ce-6d27-441a-b5f5-730fabd03bf9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:38.582316 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca6c66ce-6d27-441a-b5f5-730fabd03bf9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:38.584782 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca6c66ce-6d27-441a-b5f5-730fabd03bf9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:38.585440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca6c66ce-6d27-441a-b5f5-730fabd03bf9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:38.588615 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca6c66ce-6d27-441a-b5f5-730fabd03bf9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:38.591265 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca6c66ce-6d27-441a-b5f5-730fabd03bf9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:38.592295 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca6c66ce-6d27-441a-b5f5-730fabd03bf9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:38.619950 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a5dc7a6c-5c26-4691-b0d1-7b1ac08ca305 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-491967087", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "f3904a4e-5583-4e53-b085-ae6cfc5bd249"}, {"port": "1fe87fac-c7e8-4ff7-858b-ab19c862196d", "tag": "port-1"}, {"port": "22d4e712-b79b-4d38-8916-a0128c576b77", "tag": "port-2"}, {"uuid": "0ffa97dc-a421-4632-8a03-4dcbb81edf6e", "tag": "net-1"}, {"uuid": "0ffa97dc-a421-4632-8a03-4dcbb81edf6e"}, {"uuid": "ce674bf1-e9e0-4f96-93f0-f6813e0ff944", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "ce674bf1-e9e0-4f96-93f0-f6813e0ff944", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "cdcca33f-1614-4a78-9d08-876791eccb37", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "a6beb535-c7ac-419a-a7e5-2c00f94178de", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "67ccae92-ef8e-4df9-8333-3b307794d5c3", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1306414176"}], "key_name": "tempest-keypair-1715265238", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:43:38.853696 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-a5dc7a6c-5c26-4691-b0d1-7b1ac08ca305 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] validate_networks() for [('f3904a4e-5583-4e53-b085-ae6cfc5bd249', None, None, None, None, None), (None, None, '1fe87fac-c7e8-4ff7-858b-ab19c862196d', None, None, None), (None, None, '22d4e712-b79b-4d38-8916-a0128c576b77', None, None, None), ('0ffa97dc-a421-4632-8a03-4dcbb81edf6e', None, None, None, None, None), ('0ffa97dc-a421-4632-8a03-4dcbb81edf6e', None, None, None, None, None), ('ce674bf1-e9e0-4f96-93f0-f6813e0ff944', '10.2.2.100', None, None, None, None), ('ce674bf1-e9e0-4f96-93f0-f6813e0ff944', '10.2.2.200', None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:43:38.860784 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ca6c66ce-6d27-441a-b5f5-730fabd03bf9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:38.871917 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ca6c66ce-6d27-441a-b5f5-730fabd03bf9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 200 len: 1476 microversion: 2.1 time: 0.308099 Sep 10 11:43:38.873398 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 704/1342] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:38 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 1476 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:38.878249 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d79659fd-42da-42ee-8413-f188a3bfc69d tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:38.879133 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d79659fd-42da-42ee-8413-f188a3bfc69d tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] [instance: 10efe0de-fffd-415e-af3d-06d750fea3d4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:38.887027 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d79659fd-42da-42ee-8413-f188a3bfc69d tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:38.887840 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d79659fd-42da-42ee-8413-f188a3bfc69d tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:38.888458 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d79659fd-42da-42ee-8413-f188a3bfc69d tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:38.889419 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d79659fd-42da-42ee-8413-f188a3bfc69d tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:38.891992 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d79659fd-42da-42ee-8413-f188a3bfc69d tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:38.892675 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d79659fd-42da-42ee-8413-f188a3bfc69d tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:39.146012 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d79659fd-42da-42ee-8413-f188a3bfc69d tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1592ac1d534dc283392ff5d68765ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513f3ad4f9d147a5b9ac652fa5fcde04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:39.160338 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d79659fd-42da-42ee-8413-f188a3bfc69d tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] 10.222.0.23 "GET /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4" status: 200 len: 1541 microversion: 2.1 time: 0.285611 Sep 10 11:43:39.161681 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 705/1343] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:38 2022] GET /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4 => generated 1541 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:39.217886 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5ef63675-c30e-4d9d-9b5e-6a4a78c24ebd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:39.218692 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5ef63675-c30e-4d9d-9b5e-6a4a78c24ebd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:39.226770 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ef63675-c30e-4d9d-9b5e-6a4a78c24ebd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:39.233138 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ef63675-c30e-4d9d-9b5e-6a4a78c24ebd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:39.233805 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ef63675-c30e-4d9d-9b5e-6a4a78c24ebd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:39.234827 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ef63675-c30e-4d9d-9b5e-6a4a78c24ebd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:39.235745 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ef63675-c30e-4d9d-9b5e-6a4a78c24ebd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:39.236935 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ef63675-c30e-4d9d-9b5e-6a4a78c24ebd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:39.618232 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5ef63675-c30e-4d9d-9b5e-6a4a78c24ebd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:39.633617 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5ef63675-c30e-4d9d-9b5e-6a4a78c24ebd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:39.635253 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5ef63675-c30e-4d9d-9b5e-6a4a78c24ebd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:39.636469 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5ef63675-c30e-4d9d-9b5e-6a4a78c24ebd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1811 microversion: 2.25 time: 0.422851 Sep 10 11:43:39.637586 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 706/1344] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:43:39 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1811 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:43:39.904279 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3415516e-77be-4c8f-b16b-571ee582e266 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:39.905077 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3415516e-77be-4c8f-b16b-571ee582e266 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:39.920065 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3415516e-77be-4c8f-b16b-571ee582e266 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:39.920710 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3415516e-77be-4c8f-b16b-571ee582e266 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:39.921731 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3415516e-77be-4c8f-b16b-571ee582e266 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:39.922942 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3415516e-77be-4c8f-b16b-571ee582e266 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:39.923904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3415516e-77be-4c8f-b16b-571ee582e266 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:39.924565 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3415516e-77be-4c8f-b16b-571ee582e266 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:40.796562 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3415516e-77be-4c8f-b16b-571ee582e266 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:40.824799 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3415516e-77be-4c8f-b16b-571ee582e266 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 200 len: 1476 microversion: 2.1 time: 0.927873 Sep 10 11:43:40.829989 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 707/1345] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:39 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 1476 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:40.843357 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-189863a5-adb4-4fcf-b1e6-9fc04abf3b75 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:40.844658 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-189863a5-adb4-4fcf-b1e6-9fc04abf3b75 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] [instance: 10efe0de-fffd-415e-af3d-06d750fea3d4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:40.863556 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-189863a5-adb4-4fcf-b1e6-9fc04abf3b75 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:40.865957 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-189863a5-adb4-4fcf-b1e6-9fc04abf3b75 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:40.869129 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-189863a5-adb4-4fcf-b1e6-9fc04abf3b75 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:40.870170 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-189863a5-adb4-4fcf-b1e6-9fc04abf3b75 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:40.874875 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-189863a5-adb4-4fcf-b1e6-9fc04abf3b75 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:40.875683 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-189863a5-adb4-4fcf-b1e6-9fc04abf3b75 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:40.940466 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-189863a5-adb4-4fcf-b1e6-9fc04abf3b75 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:40.940957 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-189863a5-adb4-4fcf-b1e6-9fc04abf3b75 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:40.941606 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-189863a5-adb4-4fcf-b1e6-9fc04abf3b75 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:40.942241 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-189863a5-adb4-4fcf-b1e6-9fc04abf3b75 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lazy-loading 'fault' on Instance uuid 10efe0de-fffd-415e-af3d-06d750fea3d4 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:43:41.126484 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-189863a5-adb4-4fcf-b1e6-9fc04abf3b75 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1592ac1d534dc283392ff5d68765ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513f3ad4f9d147a5b9ac652fa5fcde04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:41.138323 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-189863a5-adb4-4fcf-b1e6-9fc04abf3b75 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] 10.222.0.23 "GET /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4" status: 200 len: 1322 microversion: 2.1 time: 0.306335 Sep 10 11:43:41.144324 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 708/1346] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:40 2022] GET /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4 => generated 1322 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:41.157048 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-063be99a-624d-44d0-98f2-3c1e29dede1e req-08cc357e-5c58-47bb-86c8-7f9ea0e51609 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10efe0de-fffd-415e-af3d-06d750fea3d4", "name": "network-vif-deleted", "tag": "8551ac91-90ed-4c01-9cfa-ec23da24cb18"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:43:41.181714 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-063be99a-624d-44d0-98f2-3c1e29dede1e req-08cc357e-5c58-47bb-86c8-7f9ea0e51609 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:41.186096 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-063be99a-624d-44d0-98f2-3c1e29dede1e req-08cc357e-5c58-47bb-86c8-7f9ea0e51609 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:41.186096 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-063be99a-624d-44d0-98f2-3c1e29dede1e req-08cc357e-5c58-47bb-86c8-7f9ea0e51609 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:41.208690 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-063be99a-624d-44d0-98f2-3c1e29dede1e req-08cc357e-5c58-47bb-86c8-7f9ea0e51609 service nova] Creating event network-vif-deleted:8551ac91-90ed-4c01-9cfa-ec23da24cb18 for instance 10efe0de-fffd-415e-af3d-06d750fea3d4 on n-h2-856895-1 Sep 10 11:43:41.214660 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-063be99a-624d-44d0-98f2-3c1e29dede1e req-08cc357e-5c58-47bb-86c8-7f9ea0e51609 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068021 Sep 10 11:43:41.221868 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 709/1347] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:43:41.228058 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-710a7327-8275-40ba-bd1f-eea84e964c6e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:41.228767 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-710a7327-8275-40ba-bd1f-eea84e964c6e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:41.248056 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-710a7327-8275-40ba-bd1f-eea84e964c6e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:41.248674 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-710a7327-8275-40ba-bd1f-eea84e964c6e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:41.249371 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-710a7327-8275-40ba-bd1f-eea84e964c6e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:41.250490 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-710a7327-8275-40ba-bd1f-eea84e964c6e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:41.251060 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-710a7327-8275-40ba-bd1f-eea84e964c6e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:41.251852 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-710a7327-8275-40ba-bd1f-eea84e964c6e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:41.498989 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-710a7327-8275-40ba-bd1f-eea84e964c6e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:41.511842 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-710a7327-8275-40ba-bd1f-eea84e964c6e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:41.514887 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-710a7327-8275-40ba-bd1f-eea84e964c6e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:41.518152 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-710a7327-8275-40ba-bd1f-eea84e964c6e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1811 microversion: 2.25 time: 0.294983 Sep 10 11:43:41.532351 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 710/1348] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:43:41 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1811 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:43:41.856899 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f8829fbf-92ab-4a1c-b350-0f10abb7f356 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:41.857793 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f8829fbf-92ab-4a1c-b350-0f10abb7f356 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:41.873517 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8829fbf-92ab-4a1c-b350-0f10abb7f356 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:41.874022 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8829fbf-92ab-4a1c-b350-0f10abb7f356 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:41.874461 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8829fbf-92ab-4a1c-b350-0f10abb7f356 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:41.875202 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8829fbf-92ab-4a1c-b350-0f10abb7f356 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:41.875665 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8829fbf-92ab-4a1c-b350-0f10abb7f356 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:41.878213 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8829fbf-92ab-4a1c-b350-0f10abb7f356 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:42.155878 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=4 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:43:42.230455 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f8829fbf-92ab-4a1c-b350-0f10abb7f356 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:42.247510 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f8829fbf-92ab-4a1c-b350-0f10abb7f356 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 200 len: 1476 microversion: 2.1 time: 0.393733 Sep 10 11:43:42.260901 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 711/1349] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:41 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 1476 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:43:42.278010 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cd85e7f9-18e9-4975-9ca9-600e84d9ea63 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:42.278933 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cd85e7f9-18e9-4975-9ca9-600e84d9ea63 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] [instance: 10efe0de-fffd-415e-af3d-06d750fea3d4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:42.285635 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd85e7f9-18e9-4975-9ca9-600e84d9ea63 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:42.286458 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd85e7f9-18e9-4975-9ca9-600e84d9ea63 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:42.287095 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd85e7f9-18e9-4975-9ca9-600e84d9ea63 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:42.288068 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd85e7f9-18e9-4975-9ca9-600e84d9ea63 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:42.289320 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd85e7f9-18e9-4975-9ca9-600e84d9ea63 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:42.289927 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd85e7f9-18e9-4975-9ca9-600e84d9ea63 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:42.310563 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-cd85e7f9-18e9-4975-9ca9-600e84d9ea63 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] HTTP exception thrown: Instance 10efe0de-fffd-415e-af3d-06d750fea3d4 could not be found. Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cd85e7f9-18e9-4975-9ca9-600e84d9ea63 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Request method failure captured: Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4 HTTP/1.1 Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHg7i2VXRU_is7QgDeJQgfmUaY96gAJ8CC02J9SiCRe06Z2uFfLLsxu2uIK_zHSkG3Hs5vqCRIw2QoP7lKMLjcx9gq71pztc6-B81S8wLlSUmTPhhoxC7O1uzuR8sJ5yP74X0cmSArSoiRB-h9oB2fQugiOGmJqFxEbOlDxCQ5jVlHQ Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 513f3ad4f9d147a5b9ac652fa5fcde04 Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/513f3ad4f9d147a5b9ac652fa5fcde04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/513f3ad4f9d147a5b9ac652fa5fcde04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_513f3ad4f9d147a5b9ac652fa5fcde04", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/513f3ad4f9d147a5b9ac652fa5fcde04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 513f3ad4f9d147a5b9ac652fa5fcde04 Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: fa1592ac1d534dc283392ff5d68765ef Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 10efe0de-fffd-415e-af3d-06d750fea3d4 could not be found. Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '10efe0de-fffd-415e-af3d-06d750fea3d4'} Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10efe0de-fffd-415e-af3d-06d750fea3d4 could not be found. Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10efe0de-fffd-415e-af3d-06d750fea3d4 could not be found. Sep 10 11:43:42.312421 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:42.317778 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:42.317778 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:42.317778 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:42.317778 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:43:42.317778 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:43:42.317778 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:43:42.317778 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:43:42.317778 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10efe0de-fffd-415e-af3d-06d750fea3d4 could not be found. Sep 10 11:43:42.317778 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:42.320711 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cd85e7f9-18e9-4975-9ca9-600e84d9ea63 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] Returning 404 to user: Instance 10efe0de-fffd-415e-af3d-06d750fea3d4 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:43:42.321939 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cd85e7f9-18e9-4975-9ca9-600e84d9ea63 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960 tempest-FloatingIPsAssociationNegativeTestJSON-1763781960-project] 10.222.0.23 "GET /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4" status: 404 len: 111 microversion: 2.1 time: 0.059588 Sep 10 11:43:42.323039 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 712/1350] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:42 2022] GET /compute/v2.1/servers/10efe0de-fffd-415e-af3d-06d750fea3d4 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:43:42.550101 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-41daf0c4-5ddc-4a4e-91b5-aebf17d20803 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:42.551259 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-41daf0c4-5ddc-4a4e-91b5-aebf17d20803 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:42.582272 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-41daf0c4-5ddc-4a4e-91b5-aebf17d20803 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:42.583011 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-41daf0c4-5ddc-4a4e-91b5-aebf17d20803 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:42.588378 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-41daf0c4-5ddc-4a4e-91b5-aebf17d20803 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:42.590815 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-41daf0c4-5ddc-4a4e-91b5-aebf17d20803 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:42.592914 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-41daf0c4-5ddc-4a4e-91b5-aebf17d20803 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:42.593853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-41daf0c4-5ddc-4a4e-91b5-aebf17d20803 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:42.931760 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-41daf0c4-5ddc-4a4e-91b5-aebf17d20803 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:42.946613 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-41daf0c4-5ddc-4a4e-91b5-aebf17d20803 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:42.950524 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-41daf0c4-5ddc-4a4e-91b5-aebf17d20803 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:42.954617 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-41daf0c4-5ddc-4a4e-91b5-aebf17d20803 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1811 microversion: 2.25 time: 0.409936 Sep 10 11:43:42.957774 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 713/1351] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:43:42 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1811 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:43:42.968356 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-174d0f0d-61d2-48ed-8b79-d0c24e2bf67c tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:42.970971 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-174d0f0d-61d2-48ed-8b79-d0c24e2bf67c tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] [instance: afb1a503-7e9a-474c-8dfe-b0e5838b7398] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:42.991004 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-174d0f0d-61d2-48ed-8b79-d0c24e2bf67c tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:42.994587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-174d0f0d-61d2-48ed-8b79-d0c24e2bf67c tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:42.995033 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-174d0f0d-61d2-48ed-8b79-d0c24e2bf67c tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:42.995783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-174d0f0d-61d2-48ed-8b79-d0c24e2bf67c tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:42.996993 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-174d0f0d-61d2-48ed-8b79-d0c24e2bf67c tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:42.998377 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-174d0f0d-61d2-48ed-8b79-d0c24e2bf67c tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:43.066860 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-a5dc7a6c-5c26-4691-b0d1-7b1ac08ca305 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:43:43.067422 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-a5dc7a6c-5c26-4691-b0d1-7b1ac08ca305 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:43:43.067818 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-a5dc7a6c-5c26-4691-b0d1-7b1ac08ca305 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:43:43.068227 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-a5dc7a6c-5c26-4691-b0d1-7b1ac08ca305 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:43:43.068634 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-a5dc7a6c-5c26-4691-b0d1-7b1ac08ca305 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:43:43.072825 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-174d0f0d-61d2-48ed-8b79-d0c24e2bf67c tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] 10.222.0.23 "GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.112456 Sep 10 11:43:43.073635 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 714/1352] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 11:43:42 2022] GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398/os-volume_attachments => generated 25 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:43:43.092612 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a5dc7a6c-5c26-4691-b0d1-7b1ac08ca305 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:43.095206 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a5dc7a6c-5c26-4691-b0d1-7b1ac08ca305 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:43.096842 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a5dc7a6c-5c26-4691-b0d1-7b1ac08ca305 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:43.099901 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a5dc7a6c-5c26-4691-b0d1-7b1ac08ca305 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:43.101272 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a5dc7a6c-5c26-4691-b0d1-7b1ac08ca305 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:43.101770 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a5dc7a6c-5c26-4691-b0d1-7b1ac08ca305 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:43.162379 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-a5dc7a6c-5c26-4691-b0d1-7b1ac08ca305 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Getting quotas for project 125ad66541dd4acdb35af09b28001e39. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:43:43.165860 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-a5dc7a6c-5c26-4691-b0d1-7b1ac08ca305 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Getting quotas for user 07d1c7718856439a8e76ed07ca5278b8 and project 125ad66541dd4acdb35af09b28001e39. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:43:43.183073 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e8dad885-96d7-47d6-88bb-cd141949b2a4 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:43.185883 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e8dad885-96d7-47d6-88bb-cd141949b2a4 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] [instance: afb1a503-7e9a-474c-8dfe-b0e5838b7398] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:43.192084 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e8dad885-96d7-47d6-88bb-cd141949b2a4 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:43.192764 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e8dad885-96d7-47d6-88bb-cd141949b2a4 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:43.192998 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e8dad885-96d7-47d6-88bb-cd141949b2a4 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:43.193710 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e8dad885-96d7-47d6-88bb-cd141949b2a4 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:43.194223 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e8dad885-96d7-47d6-88bb-cd141949b2a4 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:43.194597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e8dad885-96d7-47d6-88bb-cd141949b2a4 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:43.296735 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e8dad885-96d7-47d6-88bb-cd141949b2a4 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] 10.222.0.23 "GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.121669 Sep 10 11:43:43.306515 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 715/1353] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 11:43:43 2022] GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398/os-volume_attachments => generated 25 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:43:43.324579 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ec96367a-8745-420a-816f-3ef9e775b854 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:43.327322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ec96367a-8745-420a-816f-3ef9e775b854 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:43.338330 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec96367a-8745-420a-816f-3ef9e775b854 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:43.338815 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec96367a-8745-420a-816f-3ef9e775b854 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:43.339320 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec96367a-8745-420a-816f-3ef9e775b854 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:43.339984 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec96367a-8745-420a-816f-3ef9e775b854 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:43.340434 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec96367a-8745-420a-816f-3ef9e775b854 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:43.343448 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec96367a-8745-420a-816f-3ef9e775b854 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:43.528432 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a5dc7a6c-5c26-4691-b0d1-7b1ac08ca305 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:43:43.531845 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a5dc7a6c-5c26-4691-b0d1-7b1ac08ca305 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='cdcca33f-1614-4a78-9d08-876791eccb37',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='a6beb535-c7ac-419a-a7e5-2c00f94178de',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='67ccae92-ef8e-4df9-8333-3b307794d5c3',volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:43:43.690603 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ec96367a-8745-420a-816f-3ef9e775b854 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:43.699157 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ec96367a-8745-420a-816f-3ef9e775b854 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 200 len: 1476 microversion: 2.1 time: 0.391532 Sep 10 11:43:43.707514 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 716/1354] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:43 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 1476 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:43.713210 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-06fa24bb-1ce3-46d6-9433-c76c92bbe4cf tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:43.713773 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-06fa24bb-1ce3-46d6-9433-c76c92bbe4cf tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] [instance: afb1a503-7e9a-474c-8dfe-b0e5838b7398] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:43.733049 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06fa24bb-1ce3-46d6-9433-c76c92bbe4cf tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:43.733557 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06fa24bb-1ce3-46d6-9433-c76c92bbe4cf tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:43.733997 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06fa24bb-1ce3-46d6-9433-c76c92bbe4cf tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:43.734715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06fa24bb-1ce3-46d6-9433-c76c92bbe4cf tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:43.735188 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06fa24bb-1ce3-46d6-9433-c76c92bbe4cf tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:43.735630 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06fa24bb-1ce3-46d6-9433-c76c92bbe4cf tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:43.780722 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-06fa24bb-1ce3-46d6-9433-c76c92bbe4cf tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] [instance: afb1a503-7e9a-474c-8dfe-b0e5838b7398] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:43:43.899312 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:43:43.970702 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-06fa24bb-1ce3-46d6-9433-c76c92bbe4cf tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] 10.222.0.23 "DELETE /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398" status: 204 len: 0 microversion: 2.1 time: 0.261541 Sep 10 11:43:43.972339 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 717/1355] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:43:43 2022] DELETE /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:43:43.985767 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c5488b6a-0bea-4b06-a3e6-f1e0d80b1774 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:43.990446 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c5488b6a-0bea-4b06-a3e6-f1e0d80b1774 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] [instance: afb1a503-7e9a-474c-8dfe-b0e5838b7398] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:44.004824 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c5488b6a-0bea-4b06-a3e6-f1e0d80b1774 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:44.005530 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c5488b6a-0bea-4b06-a3e6-f1e0d80b1774 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:44.007711 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c5488b6a-0bea-4b06-a3e6-f1e0d80b1774 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:44.008700 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c5488b6a-0bea-4b06-a3e6-f1e0d80b1774 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:44.011411 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c5488b6a-0bea-4b06-a3e6-f1e0d80b1774 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:44.012300 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c5488b6a-0bea-4b06-a3e6-f1e0d80b1774 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:44.296734 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c5488b6a-0bea-4b06-a3e6-f1e0d80b1774 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1e51accd4241b497623f18f0d2967d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d3ca9bcf514a8b9844377fc53143ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:44.313438 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c5488b6a-0bea-4b06-a3e6-f1e0d80b1774 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] 10.222.0.23 "GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398" status: 200 len: 1682 microversion: 2.1 time: 0.336511 Sep 10 11:43:44.313640 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 718/1356] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:43 2022] GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398 => generated 1682 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:43:44.340063 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1295c454-f478-4504-9c0a-fe3011fa80cc tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:44.340714 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1295c454-f478-4504-9c0a-fe3011fa80cc tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:44.354093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1295c454-f478-4504-9c0a-fe3011fa80cc tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:44.354617 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1295c454-f478-4504-9c0a-fe3011fa80cc tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:44.355219 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1295c454-f478-4504-9c0a-fe3011fa80cc tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:44.360470 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1295c454-f478-4504-9c0a-fe3011fa80cc tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:44.364019 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1295c454-f478-4504-9c0a-fe3011fa80cc tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:44.365916 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1295c454-f478-4504-9c0a-fe3011fa80cc tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:44.524425 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a5dc7a6c-5c26-4691-b0d1-7b1ac08ca305 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 5.909371 Sep 10 11:43:44.542534 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 639/1357] 10.222.0.23 () {62 vars in 1189 bytes} [Sat Sep 10 11:43:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 5926 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 10 11:43:44.560489 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6464ea99-de2f-47f0-bc0e-5ee3f400fc37 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:44.561551 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6464ea99-de2f-47f0-bc0e-5ee3f400fc37 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:44.640986 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6464ea99-de2f-47f0-bc0e-5ee3f400fc37 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:44.670678 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6464ea99-de2f-47f0-bc0e-5ee3f400fc37 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:44.676371 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6464ea99-de2f-47f0-bc0e-5ee3f400fc37 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:44.680490 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6464ea99-de2f-47f0-bc0e-5ee3f400fc37 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1285 microversion: 2.42 time: 0.133470 Sep 10 11:43:44.681593 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 640/1358] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:43:44 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1285 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:43:44.706846 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1295c454-f478-4504-9c0a-fe3011fa80cc tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:44.726597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1295c454-f478-4504-9c0a-fe3011fa80cc tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:44.728912 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9980b68e-db1f-448a-b6f6-6b29a86b71da tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:44.729440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1295c454-f478-4504-9c0a-fe3011fa80cc tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:44.731818 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1295c454-f478-4504-9c0a-fe3011fa80cc tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1811 microversion: 2.25 time: 0.401898 Sep 10 11:43:44.745571 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9980b68e-db1f-448a-b6f6-6b29a86b71da tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:44.745707 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 719/1359] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:43:44 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1811 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:43:44.760572 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9980b68e-db1f-448a-b6f6-6b29a86b71da tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:44.761204 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9980b68e-db1f-448a-b6f6-6b29a86b71da tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:44.762762 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9980b68e-db1f-448a-b6f6-6b29a86b71da tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:44.765190 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9980b68e-db1f-448a-b6f6-6b29a86b71da tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:44.766332 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9980b68e-db1f-448a-b6f6-6b29a86b71da tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:44.767723 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9980b68e-db1f-448a-b6f6-6b29a86b71da tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:45.189275 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9980b68e-db1f-448a-b6f6-6b29a86b71da tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:45.200795 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9980b68e-db1f-448a-b6f6-6b29a86b71da tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 200 len: 1476 microversion: 2.1 time: 0.479270 Sep 10 11:43:45.215848 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 641/1360] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:44 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 1476 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:45.343970 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-10dbfed3-36aa-4577-975d-b27ff8dfb610 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:45.346514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-10dbfed3-36aa-4577-975d-b27ff8dfb610 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] [instance: afb1a503-7e9a-474c-8dfe-b0e5838b7398] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:45.357715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-10dbfed3-36aa-4577-975d-b27ff8dfb610 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:45.358446 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-10dbfed3-36aa-4577-975d-b27ff8dfb610 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:45.359643 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-10dbfed3-36aa-4577-975d-b27ff8dfb610 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:45.360997 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-10dbfed3-36aa-4577-975d-b27ff8dfb610 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:45.361910 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-10dbfed3-36aa-4577-975d-b27ff8dfb610 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:45.362523 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-10dbfed3-36aa-4577-975d-b27ff8dfb610 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:45.706660 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e9719fe9-fcc0-42c7-9ae1-7ba50cf18a5e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:45.707464 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e9719fe9-fcc0-42c7-9ae1-7ba50cf18a5e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:45.724764 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-10dbfed3-36aa-4577-975d-b27ff8dfb610 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1e51accd4241b497623f18f0d2967d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d3ca9bcf514a8b9844377fc53143ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:45.736030 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-10dbfed3-36aa-4577-975d-b27ff8dfb610 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] 10.222.0.23 "GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398" status: 200 len: 1682 microversion: 2.1 time: 0.399130 Sep 10 11:43:45.737248 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 720/1361] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:45 2022] GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398 => generated 1682 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:45.766690 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-afd8cc19-9c41-4175-9926-e40ccb41b7b4 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:45.768167 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-afd8cc19-9c41-4175-9926-e40ccb41b7b4 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:45.777019 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-afd8cc19-9c41-4175-9926-e40ccb41b7b4 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:45.777583 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-afd8cc19-9c41-4175-9926-e40ccb41b7b4 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:45.777942 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-afd8cc19-9c41-4175-9926-e40ccb41b7b4 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:45.778645 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-afd8cc19-9c41-4175-9926-e40ccb41b7b4 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:45.779089 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-afd8cc19-9c41-4175-9926-e40ccb41b7b4 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:45.783430 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-afd8cc19-9c41-4175-9926-e40ccb41b7b4 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:45.845647 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e9719fe9-fcc0-42c7-9ae1-7ba50cf18a5e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:45.886944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e9719fe9-fcc0-42c7-9ae1-7ba50cf18a5e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:45.902009 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e9719fe9-fcc0-42c7-9ae1-7ba50cf18a5e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:45.906617 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e9719fe9-fcc0-42c7-9ae1-7ba50cf18a5e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1285 microversion: 2.42 time: 0.202674 Sep 10 11:43:45.920314 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 642/1362] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:43:45 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1285 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:43:46.226572 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c07ffad2-adba-4c77-82c1-172fa3d74b5a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:46.227614 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c07ffad2-adba-4c77-82c1-172fa3d74b5a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:46.244101 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c07ffad2-adba-4c77-82c1-172fa3d74b5a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:46.244715 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c07ffad2-adba-4c77-82c1-172fa3d74b5a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:46.245250 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c07ffad2-adba-4c77-82c1-172fa3d74b5a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:46.246178 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c07ffad2-adba-4c77-82c1-172fa3d74b5a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:46.246760 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c07ffad2-adba-4c77-82c1-172fa3d74b5a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:46.247442 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c07ffad2-adba-4c77-82c1-172fa3d74b5a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:46.291363 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-afd8cc19-9c41-4175-9926-e40ccb41b7b4 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:46.305344 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-afd8cc19-9c41-4175-9926-e40ccb41b7b4 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:46.313631 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-afd8cc19-9c41-4175-9926-e40ccb41b7b4 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:46.315402 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-afd8cc19-9c41-4175-9926-e40ccb41b7b4 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1811 microversion: 2.25 time: 0.559449 Sep 10 11:43:46.316528 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 721/1363] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:43:45 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1811 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:43:46.663698 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c07ffad2-adba-4c77-82c1-172fa3d74b5a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:46.682797 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c07ffad2-adba-4c77-82c1-172fa3d74b5a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 200 len: 1475 microversion: 2.1 time: 0.461004 Sep 10 11:43:46.683393 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 643/1364] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:46 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 1475 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:46.761185 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-92796abb-2d91-46e0-81eb-b97b716ccf04 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:46.762598 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-92796abb-2d91-46e0-81eb-b97b716ccf04 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] [instance: afb1a503-7e9a-474c-8dfe-b0e5838b7398] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:46.773558 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92796abb-2d91-46e0-81eb-b97b716ccf04 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:46.776414 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92796abb-2d91-46e0-81eb-b97b716ccf04 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:46.776938 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92796abb-2d91-46e0-81eb-b97b716ccf04 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:46.778579 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92796abb-2d91-46e0-81eb-b97b716ccf04 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:46.779985 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92796abb-2d91-46e0-81eb-b97b716ccf04 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:46.780451 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92796abb-2d91-46e0-81eb-b97b716ccf04 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:46.937051 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0ae416b5-1d8b-4fb3-9c30-d01739a3fe7c tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:46.939620 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0ae416b5-1d8b-4fb3-9c30-d01739a3fe7c tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:46.952275 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ae416b5-1d8b-4fb3-9c30-d01739a3fe7c tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:46.955477 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ae416b5-1d8b-4fb3-9c30-d01739a3fe7c tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:46.956230 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ae416b5-1d8b-4fb3-9c30-d01739a3fe7c tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:46.960085 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ae416b5-1d8b-4fb3-9c30-d01739a3fe7c tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:46.961952 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ae416b5-1d8b-4fb3-9c30-d01739a3fe7c tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:46.962505 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ae416b5-1d8b-4fb3-9c30-d01739a3fe7c tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:47.272221 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-92796abb-2d91-46e0-81eb-b97b716ccf04 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1e51accd4241b497623f18f0d2967d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d3ca9bcf514a8b9844377fc53143ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:47.284429 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-92796abb-2d91-46e0-81eb-b97b716ccf04 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] 10.222.0.23 "GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398" status: 200 len: 1682 microversion: 2.1 time: 0.527777 Sep 10 11:43:47.286414 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 722/1365] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:46 2022] GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398 => generated 1682 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:43:47.347707 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a152d513-520b-440d-bf46-01baf92f2a3d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:47.348728 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a152d513-520b-440d-bf46-01baf92f2a3d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:47.360248 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a152d513-520b-440d-bf46-01baf92f2a3d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:47.362438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a152d513-520b-440d-bf46-01baf92f2a3d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:47.364490 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a152d513-520b-440d-bf46-01baf92f2a3d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:47.365548 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a152d513-520b-440d-bf46-01baf92f2a3d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:47.369330 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a152d513-520b-440d-bf46-01baf92f2a3d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:47.370053 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a152d513-520b-440d-bf46-01baf92f2a3d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:47.382255 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0ae416b5-1d8b-4fb3-9c30-d01739a3fe7c tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:47.407325 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0ae416b5-1d8b-4fb3-9c30-d01739a3fe7c tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:47.414417 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0ae416b5-1d8b-4fb3-9c30-d01739a3fe7c tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:47.420009 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0ae416b5-1d8b-4fb3-9c30-d01739a3fe7c tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1519 microversion: 2.42 time: 0.484986 Sep 10 11:43:47.423011 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 644/1366] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:43:46 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1519 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:43:47.710756 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8129f77a-82a2-4223-8b57-d76649713054 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:47.711420 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8129f77a-82a2-4223-8b57-d76649713054 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:47.724579 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8129f77a-82a2-4223-8b57-d76649713054 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:47.725084 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8129f77a-82a2-4223-8b57-d76649713054 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:47.726073 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8129f77a-82a2-4223-8b57-d76649713054 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:47.729611 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8129f77a-82a2-4223-8b57-d76649713054 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:47.730109 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8129f77a-82a2-4223-8b57-d76649713054 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:47.730554 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8129f77a-82a2-4223-8b57-d76649713054 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:48.079253 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a152d513-520b-440d-bf46-01baf92f2a3d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:48.102426 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a152d513-520b-440d-bf46-01baf92f2a3d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:48.104278 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a152d513-520b-440d-bf46-01baf92f2a3d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:48.110928 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a152d513-520b-440d-bf46-01baf92f2a3d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1811 microversion: 2.25 time: 0.764821 Sep 10 11:43:48.122945 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 723/1367] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:43:47 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1811 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:43:48.318143 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ebb0f8c9-c02f-47b1-bf4c-330d859e96e9 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:48.319706 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ebb0f8c9-c02f-47b1-bf4c-330d859e96e9 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] [instance: afb1a503-7e9a-474c-8dfe-b0e5838b7398] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:48.361816 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ebb0f8c9-c02f-47b1-bf4c-330d859e96e9 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:48.365191 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ebb0f8c9-c02f-47b1-bf4c-330d859e96e9 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:48.367570 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ebb0f8c9-c02f-47b1-bf4c-330d859e96e9 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:48.370005 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ebb0f8c9-c02f-47b1-bf4c-330d859e96e9 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:48.370703 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ebb0f8c9-c02f-47b1-bf4c-330d859e96e9 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:48.374871 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ebb0f8c9-c02f-47b1-bf4c-330d859e96e9 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:48.647872 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ebb0f8c9-c02f-47b1-bf4c-330d859e96e9 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1e51accd4241b497623f18f0d2967d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d3ca9bcf514a8b9844377fc53143ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:48.660808 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ebb0f8c9-c02f-47b1-bf4c-330d859e96e9 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] 10.222.0.23 "GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398" status: 200 len: 1614 microversion: 2.1 time: 0.346471 Sep 10 11:43:48.663608 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 724/1368] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:48 2022] GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398 => generated 1614 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:43:48.673873 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-b55a9a38-54ea-43f3-a0a6-172adb24ab52 req-d449c80b-b64c-4128-bac8-dc9bb08fe5ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68861799-4265-42f8-a24a-dd78f3d6745a", "name": "network-vif-unplugged", "status": "completed", "tag": "588ba4ca-8af7-4faa-a475-eb41a709948d"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:43:48.701475 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-b55a9a38-54ea-43f3-a0a6-172adb24ab52 req-d449c80b-b64c-4128-bac8-dc9bb08fe5ea service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:48.702319 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-b55a9a38-54ea-43f3-a0a6-172adb24ab52 req-d449c80b-b64c-4128-bac8-dc9bb08fe5ea service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:48.703048 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-b55a9a38-54ea-43f3-a0a6-172adb24ab52 req-d449c80b-b64c-4128-bac8-dc9bb08fe5ea service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:48.728974 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-b55a9a38-54ea-43f3-a0a6-172adb24ab52 req-d449c80b-b64c-4128-bac8-dc9bb08fe5ea service nova] Creating event network-vif-unplugged:588ba4ca-8af7-4faa-a475-eb41a709948d for instance 68861799-4265-42f8-a24a-dd78f3d6745a on n-h1-856895-1 Sep 10 11:43:48.749168 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [req-b55a9a38-54ea-43f3-a0a6-172adb24ab52 req-d449c80b-b64c-4128-bac8-dc9bb08fe5ea service nova] Instance 68861799-4265-42f8-a24a-dd78f3d6745a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856895-1', 'n-h1-856895-1'} {{(pid=128777) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 11:43:48.775696 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-b55a9a38-54ea-43f3-a0a6-172adb24ab52 req-d449c80b-b64c-4128-bac8-dc9bb08fe5ea service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110494 Sep 10 11:43:48.776858 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 725/1369] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:43:48.782560 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5afdcf39-e7c6-4857-80e0-ae3c3d81bbc5 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:48.788956 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5afdcf39-e7c6-4857-80e0-ae3c3d81bbc5 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:48.809270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8129f77a-82a2-4223-8b57-d76649713054 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:48.814261 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5afdcf39-e7c6-4857-80e0-ae3c3d81bbc5 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:48.822668 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8129f77a-82a2-4223-8b57-d76649713054 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 200 len: 1475 microversion: 2.1 time: 1.117934 Sep 10 11:43:48.823483 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5afdcf39-e7c6-4857-80e0-ae3c3d81bbc5 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:48.824041 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5afdcf39-e7c6-4857-80e0-ae3c3d81bbc5 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:48.824878 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5afdcf39-e7c6-4857-80e0-ae3c3d81bbc5 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:48.855768 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 645/1370] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:47 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 1475 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:43:48.856219 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5afdcf39-e7c6-4857-80e0-ae3c3d81bbc5 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:48.856948 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5afdcf39-e7c6-4857-80e0-ae3c3d81bbc5 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:49.145614 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c3234cff-80f5-4131-ac54-3705a4d98bd6 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:49.149287 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c3234cff-80f5-4131-ac54-3705a4d98bd6 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:49.164934 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3234cff-80f5-4131-ac54-3705a4d98bd6 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:49.167264 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3234cff-80f5-4131-ac54-3705a4d98bd6 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:49.168827 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3234cff-80f5-4131-ac54-3705a4d98bd6 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:49.171526 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3234cff-80f5-4131-ac54-3705a4d98bd6 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:49.172307 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3234cff-80f5-4131-ac54-3705a4d98bd6 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:49.175276 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3234cff-80f5-4131-ac54-3705a4d98bd6 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:49.543047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5afdcf39-e7c6-4857-80e0-ae3c3d81bbc5 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:49.554797 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5afdcf39-e7c6-4857-80e0-ae3c3d81bbc5 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:49.565519 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5afdcf39-e7c6-4857-80e0-ae3c3d81bbc5 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:49.568527 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5afdcf39-e7c6-4857-80e0-ae3c3d81bbc5 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1593 microversion: 2.42 time: 0.790370 Sep 10 11:43:49.571373 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 726/1371] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:43:48 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1593 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:43:49.686365 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-46d405c0-380a-4bc0-bd2e-43b6f2efcf8a tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:49.687065 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-46d405c0-380a-4bc0-bd2e-43b6f2efcf8a tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] [instance: afb1a503-7e9a-474c-8dfe-b0e5838b7398] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:49.696936 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46d405c0-380a-4bc0-bd2e-43b6f2efcf8a tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:49.705245 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46d405c0-380a-4bc0-bd2e-43b6f2efcf8a tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:49.705929 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46d405c0-380a-4bc0-bd2e-43b6f2efcf8a tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:49.706923 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46d405c0-380a-4bc0-bd2e-43b6f2efcf8a tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:49.707647 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46d405c0-380a-4bc0-bd2e-43b6f2efcf8a tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:49.708584 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46d405c0-380a-4bc0-bd2e-43b6f2efcf8a tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:50.068176 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-46d405c0-380a-4bc0-bd2e-43b6f2efcf8a tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1e51accd4241b497623f18f0d2967d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d3ca9bcf514a8b9844377fc53143ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:50.078563 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-46d405c0-380a-4bc0-bd2e-43b6f2efcf8a tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] 10.222.0.23 "GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398" status: 200 len: 1614 microversion: 2.1 time: 0.396202 Sep 10 11:43:50.094033 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 727/1372] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:49 2022] GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398 => generated 1614 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:50.104941 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2e9d59ce-092b-46e7-b9f7-500a98933326 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:50.105931 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2e9d59ce-092b-46e7-b9f7-500a98933326 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:50.121072 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2e9d59ce-092b-46e7-b9f7-500a98933326 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:50.124306 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2e9d59ce-092b-46e7-b9f7-500a98933326 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:50.126015 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2e9d59ce-092b-46e7-b9f7-500a98933326 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:50.129702 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2e9d59ce-092b-46e7-b9f7-500a98933326 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:50.130574 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2e9d59ce-092b-46e7-b9f7-500a98933326 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:50.131440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2e9d59ce-092b-46e7-b9f7-500a98933326 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:51.076226 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2e9d59ce-092b-46e7-b9f7-500a98933326 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:51.085971 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2e9d59ce-092b-46e7-b9f7-500a98933326 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 200 len: 1475 microversion: 2.1 time: 0.990053 Sep 10 11:43:51.088091 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 728/1373] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:50 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 1475 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:51.101064 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-722efb97-6039-47d8-beea-cbf5cea2a2ce req-7d47b377-164a-4af3-84bd-72db92beaecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afb1a503-7e9a-474c-8dfe-b0e5838b7398", "name": "network-vif-deleted", "tag": "8e001c1d-f9ea-4023-b007-0e7a4da45c81"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:43:51.124185 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:43:51.129744 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-722efb97-6039-47d8-beea-cbf5cea2a2ce req-7d47b377-164a-4af3-84bd-72db92beaecb service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:51.131855 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-722efb97-6039-47d8-beea-cbf5cea2a2ce req-7d47b377-164a-4af3-84bd-72db92beaecb service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:51.132529 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-722efb97-6039-47d8-beea-cbf5cea2a2ce req-7d47b377-164a-4af3-84bd-72db92beaecb service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:51.172149 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-722efb97-6039-47d8-beea-cbf5cea2a2ce req-7d47b377-164a-4af3-84bd-72db92beaecb service nova] Creating event network-vif-deleted:8e001c1d-f9ea-4023-b007-0e7a4da45c81 for instance afb1a503-7e9a-474c-8dfe-b0e5838b7398 on n-h1-856895-1 Sep 10 11:43:51.192573 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-722efb97-6039-47d8-beea-cbf5cea2a2ce req-7d47b377-164a-4af3-84bd-72db92beaecb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101242 Sep 10 11:43:51.196196 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 729/1374] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:43:51.214335 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-138ab6aa-9e41-431b-a80e-fedd86458369 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:51.216973 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-138ab6aa-9e41-431b-a80e-fedd86458369 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:51.237877 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-138ab6aa-9e41-431b-a80e-fedd86458369 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:51.242057 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-138ab6aa-9e41-431b-a80e-fedd86458369 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:51.243990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-138ab6aa-9e41-431b-a80e-fedd86458369 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:51.244938 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-138ab6aa-9e41-431b-a80e-fedd86458369 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:51.246663 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-138ab6aa-9e41-431b-a80e-fedd86458369 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:51.248677 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-138ab6aa-9e41-431b-a80e-fedd86458369 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:51.356354 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c3234cff-80f5-4131-ac54-3705a4d98bd6 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:51.377773 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c3234cff-80f5-4131-ac54-3705a4d98bd6 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:51.391745 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c3234cff-80f5-4131-ac54-3705a4d98bd6 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:51.401765 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c3234cff-80f5-4131-ac54-3705a4d98bd6 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1811 microversion: 2.25 time: 2.256920 Sep 10 11:43:51.416564 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 646/1375] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:43:49 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1811 bytes in 2281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:43:51.427986 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2127e3bb-cfde-42f1-9463-b6dc9da37259 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:51.429462 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2127e3bb-cfde-42f1-9463-b6dc9da37259 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] [instance: afb1a503-7e9a-474c-8dfe-b0e5838b7398] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:51.439368 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2127e3bb-cfde-42f1-9463-b6dc9da37259 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:51.440105 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2127e3bb-cfde-42f1-9463-b6dc9da37259 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:51.440744 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2127e3bb-cfde-42f1-9463-b6dc9da37259 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:51.441655 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2127e3bb-cfde-42f1-9463-b6dc9da37259 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:51.442292 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2127e3bb-cfde-42f1-9463-b6dc9da37259 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:51.442899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2127e3bb-cfde-42f1-9463-b6dc9da37259 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:51.486480 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2127e3bb-cfde-42f1-9463-b6dc9da37259 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:51.488059 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2127e3bb-cfde-42f1-9463-b6dc9da37259 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:51.488716 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2127e3bb-cfde-42f1-9463-b6dc9da37259 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:51.489386 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-2127e3bb-cfde-42f1-9463-b6dc9da37259 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lazy-loading 'fault' on Instance uuid afb1a503-7e9a-474c-8dfe-b0e5838b7398 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:43:52.065088 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2127e3bb-cfde-42f1-9463-b6dc9da37259 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1e51accd4241b497623f18f0d2967d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74d3ca9bcf514a8b9844377fc53143ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:52.072772 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2127e3bb-cfde-42f1-9463-b6dc9da37259 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] 10.222.0.23 "GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398" status: 200 len: 1331 microversion: 2.1 time: 0.654986 Sep 10 11:43:52.091190 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 647/1376] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:51 2022] GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398 => generated 1331 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:52.091190 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-3e0d2b0c-e6f5-42e3-afcd-c8765a24fe86 req-f73516f4-e520-4725-ae05-57e8106a05d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68861799-4265-42f8-a24a-dd78f3d6745a", "tag": "588ba4ca-8af7-4faa-a475-eb41a709948d"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:43:52.108818 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-3e0d2b0c-e6f5-42e3-afcd-c8765a24fe86 req-f73516f4-e520-4725-ae05-57e8106a05d4 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:52.111039 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-3e0d2b0c-e6f5-42e3-afcd-c8765a24fe86 req-f73516f4-e520-4725-ae05-57e8106a05d4 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:52.123348 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-3e0d2b0c-e6f5-42e3-afcd-c8765a24fe86 req-f73516f4-e520-4725-ae05-57e8106a05d4 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:52.125984 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-138ab6aa-9e41-431b-a80e-fedd86458369 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:52.144796 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-138ab6aa-9e41-431b-a80e-fedd86458369 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:52.146619 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-138ab6aa-9e41-431b-a80e-fedd86458369 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:52.152460 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-138ab6aa-9e41-431b-a80e-fedd86458369 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1593 microversion: 2.42 time: 0.954656 Sep 10 11:43:52.153453 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 730/1377] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:43:51 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1593 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:43:52.161903 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:43:52.166672 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-3e0d2b0c-e6f5-42e3-afcd-c8765a24fe86 req-f73516f4-e520-4725-ae05-57e8106a05d4 service nova] Creating event network-changed:588ba4ca-8af7-4faa-a475-eb41a709948d for instance 68861799-4265-42f8-a24a-dd78f3d6745a on n-h1-856895-1 Sep 10 11:43:52.167580 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0fa44782-91e2-474f-b97d-76618632222e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:52.168639 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0fa44782-91e2-474f-b97d-76618632222e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:52.179128 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0fa44782-91e2-474f-b97d-76618632222e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:52.182074 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0fa44782-91e2-474f-b97d-76618632222e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:52.182759 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0fa44782-91e2-474f-b97d-76618632222e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:52.185943 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0fa44782-91e2-474f-b97d-76618632222e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:52.186135 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [req-3e0d2b0c-e6f5-42e3-afcd-c8765a24fe86 req-f73516f4-e520-4725-ae05-57e8106a05d4 service nova] Instance 68861799-4265-42f8-a24a-dd78f3d6745a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856895-1', 'n-h1-856895-1'} {{(pid=128776) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 11:43:52.186901 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0fa44782-91e2-474f-b97d-76618632222e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:52.190139 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0fa44782-91e2-474f-b97d-76618632222e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:52.223545 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-3e0d2b0c-e6f5-42e3-afcd-c8765a24fe86 req-f73516f4-e520-4725-ae05-57e8106a05d4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144692 Sep 10 11:43:52.223545 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 648/1378] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:43:52.432868 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f210a67f-fd76-4bb2-9189-c8d6af4a444a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:52.434398 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f210a67f-fd76-4bb2-9189-c8d6af4a444a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:52.449885 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f210a67f-fd76-4bb2-9189-c8d6af4a444a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:52.451762 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f210a67f-fd76-4bb2-9189-c8d6af4a444a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:52.456520 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f210a67f-fd76-4bb2-9189-c8d6af4a444a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:52.457459 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f210a67f-fd76-4bb2-9189-c8d6af4a444a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:52.457934 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f210a67f-fd76-4bb2-9189-c8d6af4a444a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:52.458637 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f210a67f-fd76-4bb2-9189-c8d6af4a444a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:53.138923 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:43:53.391943 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0fa44782-91e2-474f-b97d-76618632222e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:53.405166 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0fa44782-91e2-474f-b97d-76618632222e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 200 len: 1475 microversion: 2.1 time: 1.242322 Sep 10 11:43:53.422238 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 731/1379] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:52 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 1475 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:53.437328 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2ef7fe0a-2f8d-47ac-805e-9dd46127fee6 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:53.438326 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2ef7fe0a-2f8d-47ac-805e-9dd46127fee6 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] [instance: afb1a503-7e9a-474c-8dfe-b0e5838b7398] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:53.450427 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ef7fe0a-2f8d-47ac-805e-9dd46127fee6 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:53.451417 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ef7fe0a-2f8d-47ac-805e-9dd46127fee6 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:53.452813 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ef7fe0a-2f8d-47ac-805e-9dd46127fee6 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:53.456215 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ef7fe0a-2f8d-47ac-805e-9dd46127fee6 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:53.457015 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ef7fe0a-2f8d-47ac-805e-9dd46127fee6 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:53.457697 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ef7fe0a-2f8d-47ac-805e-9dd46127fee6 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:53.490888 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-2ef7fe0a-2f8d-47ac-805e-9dd46127fee6 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] HTTP exception thrown: Instance afb1a503-7e9a-474c-8dfe-b0e5838b7398 could not be found. Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2ef7fe0a-2f8d-47ac-805e-9dd46127fee6 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Request method failure captured: Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398 HTTP/1.1 Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHepLuSL5DNkzCEGtGdcG2LiCZb9djLgNwwK4DKmibrNMimLRGGfCLf4jb6cyPbQ42ClITrJrpBMeMxVdZTEfTlC8B2BdQYNyJSG41Jk1MChvNDMPlxj4_j5eQGo3Q03D1DWJOt0umW-LmNfRVqPE3g5KOsubXNsZJAFZHbwjPecYSI Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 74d3ca9bcf514a8b9844377fc53143ee Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1742250776 Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/74d3ca9bcf514a8b9844377fc53143ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/74d3ca9bcf514a8b9844377fc53143ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_74d3ca9bcf514a8b9844377fc53143ee", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/74d3ca9bcf514a8b9844377fc53143ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1742250776 Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 74d3ca9bcf514a8b9844377fc53143ee Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1742250776 Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-AttachSCSIVolumeTestJSON-1742250776-project Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: dc1e51accd4241b497623f18f0d2967d Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1742250776-project Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance afb1a503-7e9a-474c-8dfe-b0e5838b7398 could not be found. Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'afb1a503-7e9a-474c-8dfe-b0e5838b7398'} Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afb1a503-7e9a-474c-8dfe-b0e5838b7398 could not be found. Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afb1a503-7e9a-474c-8dfe-b0e5838b7398 could not be found. Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:43:53.500438 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:53.505307 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:43:53.505307 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:43:53.505307 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:43:53.505307 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:43:53.505307 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:43:53.505307 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afb1a503-7e9a-474c-8dfe-b0e5838b7398 could not be found. Sep 10 11:43:53.505307 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:43:53.507715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2ef7fe0a-2f8d-47ac-805e-9dd46127fee6 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Returning 404 to user: Instance afb1a503-7e9a-474c-8dfe-b0e5838b7398 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:43:53.508929 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2ef7fe0a-2f8d-47ac-805e-9dd46127fee6 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] 10.222.0.23 "GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398" status: 404 len: 111 microversion: 2.1 time: 0.085737 Sep 10 11:43:53.511345 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 732/1380] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:53 2022] GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:43:53.517104 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ce46f132-42da-4693-92cf-565a134aafc2 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:53.518183 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ce46f132-42da-4693-92cf-565a134aafc2 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:53.525438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ce46f132-42da-4693-92cf-565a134aafc2 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:53.526298 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ce46f132-42da-4693-92cf-565a134aafc2 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:53.526995 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ce46f132-42da-4693-92cf-565a134aafc2 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:53.528051 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ce46f132-42da-4693-92cf-565a134aafc2 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:53.528774 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ce46f132-42da-4693-92cf-565a134aafc2 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:53.529469 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ce46f132-42da-4693-92cf-565a134aafc2 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:54.189226 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f210a67f-fd76-4bb2-9189-c8d6af4a444a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:54.204456 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f210a67f-fd76-4bb2-9189-c8d6af4a444a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:54.205921 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f210a67f-fd76-4bb2-9189-c8d6af4a444a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:54.211720 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f210a67f-fd76-4bb2-9189-c8d6af4a444a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1811 microversion: 2.25 time: 1.779748 Sep 10 11:43:54.214021 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 649/1381] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:43:52 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1811 bytes in 1787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:43:54.219467 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-92ef0b2c-94b9-4511-b14f-8561037982aa tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Calling method '.version_select at 0x7f4073541ee0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:54.233482 n-d-856895-1 devstack@n-api.service[128776]: ERROR oslo.messaging._drivers.impl_rabbit [None req-92ef0b2c-94b9-4511-b14f-8561037982aa tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] [191798a7-2c5e-4d74-b865-4708090abecb] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 10 11:43:54.285416 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ce46f132-42da-4693-92cf-565a134aafc2 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:54.300867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ce46f132-42da-4693-92cf-565a134aafc2 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:54.303924 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ce46f132-42da-4693-92cf-565a134aafc2 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:54.305439 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ce46f132-42da-4693-92cf-565a134aafc2 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1661 microversion: 2.42 time: 0.792808 Sep 10 11:43:54.307743 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 733/1382] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:43:53 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1661 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:43:54.430739 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-03d7098b-24c2-4bac-91cc-163908bbdce7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:54.432150 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-03d7098b-24c2-4bac-91cc-163908bbdce7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:54.446805 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03d7098b-24c2-4bac-91cc-163908bbdce7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:54.448706 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03d7098b-24c2-4bac-91cc-163908bbdce7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:54.449342 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03d7098b-24c2-4bac-91cc-163908bbdce7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:54.450984 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03d7098b-24c2-4bac-91cc-163908bbdce7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:54.453286 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03d7098b-24c2-4bac-91cc-163908bbdce7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:54.456511 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03d7098b-24c2-4bac-91cc-163908bbdce7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:55.263408 n-d-856895-1 devstack@n-api.service[128776]: INFO oslo.messaging._drivers.impl_rabbit [None req-92ef0b2c-94b9-4511-b14f-8561037982aa tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] [191798a7-2c5e-4d74-b865-4708090abecb] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 35766. Sep 10 11:43:55.283249 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:43:55.301036 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-92ef0b2c-94b9-4511-b14f-8561037982aa tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1683082546" status: 202 len: 0 microversion: 2.1 time: 1.085716 Sep 10 11:43:55.304728 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 650/1383] 10.222.0.23 () {58 vars in 1221 bytes} [Sat Sep 10 11:43:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1683082546 => generated 0 bytes in 1090 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:43:55.321577 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a9b64624-506d-483d-be3a-af122b058663 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:55.322339 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a9b64624-506d-483d-be3a-af122b058663 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:55.328611 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9b64624-506d-483d-be3a-af122b058663 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:55.329413 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9b64624-506d-483d-be3a-af122b058663 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:55.330107 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9b64624-506d-483d-be3a-af122b058663 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:55.331065 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9b64624-506d-483d-be3a-af122b058663 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:55.331834 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9b64624-506d-483d-be3a-af122b058663 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:55.332791 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9b64624-506d-483d-be3a-af122b058663 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:55.860522 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=10 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:43:56.152604 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-03d7098b-24c2-4bac-91cc-163908bbdce7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:56.188841 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-03d7098b-24c2-4bac-91cc-163908bbdce7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 200 len: 1473 microversion: 2.1 time: 1.762872 Sep 10 11:43:56.197101 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 734/1384] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:54 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 1473 bytes in 1772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:56.211283 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a82d0b3e-5126-4904-a25c-95ddb10841cd tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:56.223248 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a82d0b3e-5126-4904-a25c-95ddb10841cd tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:56.254396 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a82d0b3e-5126-4904-a25c-95ddb10841cd tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:56.271053 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a82d0b3e-5126-4904-a25c-95ddb10841cd tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:56.271580 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a82d0b3e-5126-4904-a25c-95ddb10841cd tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:56.273014 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a82d0b3e-5126-4904-a25c-95ddb10841cd tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:56.281383 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a82d0b3e-5126-4904-a25c-95ddb10841cd tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:56.284715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a82d0b3e-5126-4904-a25c-95ddb10841cd tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:56.718800 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a9b64624-506d-483d-be3a-af122b058663 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:56.743308 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a9b64624-506d-483d-be3a-af122b058663 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:56.746658 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a9b64624-506d-483d-be3a-af122b058663 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:56.761203 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a9b64624-506d-483d-be3a-af122b058663 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1811 microversion: 2.25 time: 1.454950 Sep 10 11:43:56.765526 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 651/1385] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:43:55 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1811 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:43:56.795102 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-0a35bc48-97f3-476f-83e0-fe0f35fbe191 req-5e6f6a2b-d6a3-4ac9-987c-d269eade859e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50d20272-889d-4b72-b33d-73094c78c7b4", "name": "network-vif-unplugged", "status": "completed", "tag": "4a6239c6-5b04-4a27-9109-707d2bf0a4ed"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:43:56.840101 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-0a35bc48-97f3-476f-83e0-fe0f35fbe191 req-5e6f6a2b-d6a3-4ac9-987c-d269eade859e service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:56.844699 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-0a35bc48-97f3-476f-83e0-fe0f35fbe191 req-5e6f6a2b-d6a3-4ac9-987c-d269eade859e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:56.846247 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-0a35bc48-97f3-476f-83e0-fe0f35fbe191 req-5e6f6a2b-d6a3-4ac9-987c-d269eade859e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:56.888177 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-0a35bc48-97f3-476f-83e0-fe0f35fbe191 req-5e6f6a2b-d6a3-4ac9-987c-d269eade859e service nova] Creating event network-vif-unplugged:4a6239c6-5b04-4a27-9109-707d2bf0a4ed for instance 50d20272-889d-4b72-b33d-73094c78c7b4 on n-h2-856895-1 Sep 10 11:43:56.914450 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-0a35bc48-97f3-476f-83e0-fe0f35fbe191 req-5e6f6a2b-d6a3-4ac9-987c-d269eade859e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.142243 Sep 10 11:43:56.922162 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 652/1386] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:43:57.219455 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-edd99d0c-3d76-4d79-afe3-5a05b2e1989a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:57.220345 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-edd99d0c-3d76-4d79-afe3-5a05b2e1989a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:57.233810 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-edd99d0c-3d76-4d79-afe3-5a05b2e1989a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:57.237027 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-edd99d0c-3d76-4d79-afe3-5a05b2e1989a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:57.237752 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-edd99d0c-3d76-4d79-afe3-5a05b2e1989a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:57.238607 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-edd99d0c-3d76-4d79-afe3-5a05b2e1989a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:57.240238 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-edd99d0c-3d76-4d79-afe3-5a05b2e1989a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:57.241555 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-edd99d0c-3d76-4d79-afe3-5a05b2e1989a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:58.673624 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a82d0b3e-5126-4904-a25c-95ddb10841cd tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:58.746306 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a82d0b3e-5126-4904-a25c-95ddb10841cd tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:58.754021 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a82d0b3e-5126-4904-a25c-95ddb10841cd tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:58.755691 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a82d0b3e-5126-4904-a25c-95ddb10841cd tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1708 microversion: 2.42 time: 2.557338 Sep 10 11:43:58.758200 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 735/1387] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:43:56 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1708 bytes in 2561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:43:58.774628 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-974808e1-0058-4019-bd64-5c3a7745d869 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:58.780357 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-974808e1-0058-4019-bd64-5c3a7745d869 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:58.804574 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-974808e1-0058-4019-bd64-5c3a7745d869 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:58.810529 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-974808e1-0058-4019-bd64-5c3a7745d869 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:58.811217 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-974808e1-0058-4019-bd64-5c3a7745d869 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:58.812151 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-974808e1-0058-4019-bd64-5c3a7745d869 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:58.820662 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-974808e1-0058-4019-bd64-5c3a7745d869 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:58.824165 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-974808e1-0058-4019-bd64-5c3a7745d869 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:58.835553 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:43:59.093542 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-edd99d0c-3d76-4d79-afe3-5a05b2e1989a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:59.118600 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-edd99d0c-3d76-4d79-afe3-5a05b2e1989a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 200 len: 1473 microversion: 2.1 time: 1.901082 Sep 10 11:43:59.120453 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 653/1388] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:43:57 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 1473 bytes in 1908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:43:59.706879 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-974808e1-0058-4019-bd64-5c3a7745d869 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:59.724318 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-974808e1-0058-4019-bd64-5c3a7745d869 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:59.734641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-974808e1-0058-4019-bd64-5c3a7745d869 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:43:59.740277 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-974808e1-0058-4019-bd64-5c3a7745d869 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1811 microversion: 2.25 time: 0.976085 Sep 10 11:43:59.766936 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 736/1389] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:43:58 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1811 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:43:59.793943 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8e691323-95d8-41a2-9f65-e6d9435800dc tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:43:59.794974 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8e691323-95d8-41a2-9f65-e6d9435800dc tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:43:59.808979 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e691323-95d8-41a2-9f65-e6d9435800dc tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:59.810114 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e691323-95d8-41a2-9f65-e6d9435800dc tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:59.810819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e691323-95d8-41a2-9f65-e6d9435800dc tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:43:59.814581 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e691323-95d8-41a2-9f65-e6d9435800dc tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:43:59.815401 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e691323-95d8-41a2-9f65-e6d9435800dc tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:43:59.818687 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e691323-95d8-41a2-9f65-e6d9435800dc tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:00.148328 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-aaa0abaa-8ea1-4f24-9cdc-7aef5070335e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:00.148958 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-aaa0abaa-8ea1-4f24-9cdc-7aef5070335e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:00.161378 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aaa0abaa-8ea1-4f24-9cdc-7aef5070335e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:00.161885 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aaa0abaa-8ea1-4f24-9cdc-7aef5070335e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:00.175382 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aaa0abaa-8ea1-4f24-9cdc-7aef5070335e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:00.177651 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aaa0abaa-8ea1-4f24-9cdc-7aef5070335e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:00.183870 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aaa0abaa-8ea1-4f24-9cdc-7aef5070335e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:00.185389 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aaa0abaa-8ea1-4f24-9cdc-7aef5070335e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:00.723757 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8e691323-95d8-41a2-9f65-e6d9435800dc tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:00.746528 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8e691323-95d8-41a2-9f65-e6d9435800dc tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:00.754058 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8e691323-95d8-41a2-9f65-e6d9435800dc tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:00.755744 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8e691323-95d8-41a2-9f65-e6d9435800dc tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1708 microversion: 2.42 time: 0.967222 Sep 10 11:44:00.759683 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 654/1390] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:43:59 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1708 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:44:00.767376 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-ad8d139e-69fa-48e9-9ca8-e25b0a94132a req-51046171-16fa-4fb8-91f5-f7be49cdb327 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50d20272-889d-4b72-b33d-73094c78c7b4", "tag": "4a6239c6-5b04-4a27-9109-707d2bf0a4ed"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:00.793520 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ad8d139e-69fa-48e9-9ca8-e25b0a94132a req-51046171-16fa-4fb8-91f5-f7be49cdb327 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:00.795866 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ad8d139e-69fa-48e9-9ca8-e25b0a94132a req-51046171-16fa-4fb8-91f5-f7be49cdb327 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:00.796301 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ad8d139e-69fa-48e9-9ca8-e25b0a94132a req-51046171-16fa-4fb8-91f5-f7be49cdb327 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:00.831558 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-ad8d139e-69fa-48e9-9ca8-e25b0a94132a req-51046171-16fa-4fb8-91f5-f7be49cdb327 service nova] Creating event network-changed:4a6239c6-5b04-4a27-9109-707d2bf0a4ed for instance 50d20272-889d-4b72-b33d-73094c78c7b4 on n-h2-856895-1 Sep 10 11:44:00.846332 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-ad8d139e-69fa-48e9-9ca8-e25b0a94132a req-51046171-16fa-4fb8-91f5-f7be49cdb327 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084957 Sep 10 11:44:00.848150 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 655/1391] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:44:00.858872 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e6b21d9b-8d25-43c1-b758-d8e133713412 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:00.863099 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e6b21d9b-8d25-43c1-b758-d8e133713412 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:00.879530 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6b21d9b-8d25-43c1-b758-d8e133713412 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:00.883799 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6b21d9b-8d25-43c1-b758-d8e133713412 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:00.884383 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6b21d9b-8d25-43c1-b758-d8e133713412 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:00.885230 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6b21d9b-8d25-43c1-b758-d8e133713412 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:00.885806 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6b21d9b-8d25-43c1-b758-d8e133713412 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:00.886376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-aaa0abaa-8ea1-4f24-9cdc-7aef5070335e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:00.887427 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6b21d9b-8d25-43c1-b758-d8e133713412 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:00.904560 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-aaa0abaa-8ea1-4f24-9cdc-7aef5070335e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 200 len: 1470 microversion: 2.1 time: 0.758726 Sep 10 11:44:00.905582 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 737/1392] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:00 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 1470 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:00.932369 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-858ceeac-d34d-4691-b780-f482f7596204 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:00.934109 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-858ceeac-d34d-4691-b780-f482f7596204 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:00.952720 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-858ceeac-d34d-4691-b780-f482f7596204 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:00.954077 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-858ceeac-d34d-4691-b780-f482f7596204 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:00.956172 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-858ceeac-d34d-4691-b780-f482f7596204 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:00.959726 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-858ceeac-d34d-4691-b780-f482f7596204 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:00.963541 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-858ceeac-d34d-4691-b780-f482f7596204 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:00.964017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-858ceeac-d34d-4691-b780-f482f7596204 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:01.169883 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-858ceeac-d34d-4691-b780-f482f7596204 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "POST /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a/action" status: 204 len: 0 microversion: 2.1 time: 0.241940 Sep 10 11:44:01.171580 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 738/1393] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:44:00 2022] POST /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a/action => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 11:44:01.183638 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-358ff701-fec2-4eea-b366-d154883cc0c0 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:01.185417 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-358ff701-fec2-4eea-b366-d154883cc0c0 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:01.195645 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-358ff701-fec2-4eea-b366-d154883cc0c0 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:01.196462 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-358ff701-fec2-4eea-b366-d154883cc0c0 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:01.198367 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-358ff701-fec2-4eea-b366-d154883cc0c0 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:01.199424 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-358ff701-fec2-4eea-b366-d154883cc0c0 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:01.200712 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-358ff701-fec2-4eea-b366-d154883cc0c0 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:01.201479 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-358ff701-fec2-4eea-b366-d154883cc0c0 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:01.601022 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e6b21d9b-8d25-43c1-b758-d8e133713412 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:01.628151 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e6b21d9b-8d25-43c1-b758-d8e133713412 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:01.637898 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e6b21d9b-8d25-43c1-b758-d8e133713412 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:01.645443 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e6b21d9b-8d25-43c1-b758-d8e133713412 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1811 microversion: 2.25 time: 0.791646 Sep 10 11:44:01.649217 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 656/1394] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:00 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1811 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:44:01.712270 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-358ff701-fec2-4eea-b366-d154883cc0c0 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:01.721411 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-358ff701-fec2-4eea-b366-d154883cc0c0 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 200 len: 1470 microversion: 2.1 time: 0.544669 Sep 10 11:44:01.724525 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 739/1395] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:01 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 1470 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:01.788629 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ac2dec0f-1ef9-48c8-9f2a-a0354e509ef1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:01.790225 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ac2dec0f-1ef9-48c8-9f2a-a0354e509ef1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:01.802425 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac2dec0f-1ef9-48c8-9f2a-a0354e509ef1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:01.804204 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac2dec0f-1ef9-48c8-9f2a-a0354e509ef1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:01.811864 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac2dec0f-1ef9-48c8-9f2a-a0354e509ef1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:01.812868 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac2dec0f-1ef9-48c8-9f2a-a0354e509ef1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:01.813502 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac2dec0f-1ef9-48c8-9f2a-a0354e509ef1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:01.814092 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac2dec0f-1ef9-48c8-9f2a-a0354e509ef1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:02.305451 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-63977af4-b34f-4a00-96bb-8ba05290e1c3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-768514446", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "71f52e07-83f9-4397-aa4d-2431ed919e89"}], "block_device_mapping_v2": [{"uuid": "1c0d06ba-5f8a-4d26-9577-d0f22a747ba9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:02.488857 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-63977af4-b34f-4a00-96bb-8ba05290e1c3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] validate_networks() for [('71f52e07-83f9-4397-aa4d-2431ed919e89', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:44:02.505405 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ac2dec0f-1ef9-48c8-9f2a-a0354e509ef1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:02.527689 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ac2dec0f-1ef9-48c8-9f2a-a0354e509ef1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:02.532525 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ac2dec0f-1ef9-48c8-9f2a-a0354e509ef1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:02.534847 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ac2dec0f-1ef9-48c8-9f2a-a0354e509ef1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1755 microversion: 2.42 time: 0.750619 Sep 10 11:44:02.535771 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 657/1396] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:01 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1755 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:44:02.682820 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a3644271-e408-46c9-b065-359403321b18 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:02.686420 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a3644271-e408-46c9-b065-359403321b18 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:02.704304 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a3644271-e408-46c9-b065-359403321b18 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:02.705747 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a3644271-e408-46c9-b065-359403321b18 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:02.709482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a3644271-e408-46c9-b065-359403321b18 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:02.712242 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a3644271-e408-46c9-b065-359403321b18 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:02.713656 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a3644271-e408-46c9-b065-359403321b18 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:02.716191 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a3644271-e408-46c9-b065-359403321b18 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:03.477451 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a3644271-e408-46c9-b065-359403321b18 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:03.493879 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a3644271-e408-46c9-b065-359403321b18 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:03.496798 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a3644271-e408-46c9-b065-359403321b18 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:03.498340 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a3644271-e408-46c9-b065-359403321b18 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1811 microversion: 2.25 time: 0.824368 Sep 10 11:44:03.517882 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 658/1397] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:02 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1811 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:44:03.523679 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-199252a9-605c-49ce-9176-65a5385f0dd6 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:03.524583 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-199252a9-605c-49ce-9176-65a5385f0dd6 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:03.548193 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-199252a9-605c-49ce-9176-65a5385f0dd6 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:03.550110 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-199252a9-605c-49ce-9176-65a5385f0dd6 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:03.550839 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-199252a9-605c-49ce-9176-65a5385f0dd6 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:03.552129 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-199252a9-605c-49ce-9176-65a5385f0dd6 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:03.553815 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-199252a9-605c-49ce-9176-65a5385f0dd6 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:03.554717 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-199252a9-605c-49ce-9176-65a5385f0dd6 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:03.872100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-199252a9-605c-49ce-9176-65a5385f0dd6 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:03.883220 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-199252a9-605c-49ce-9176-65a5385f0dd6 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 200 len: 1470 microversion: 2.1 time: 0.362922 Sep 10 11:44:03.884409 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 659/1398] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:03 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 1470 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:04.118489 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-63977af4-b34f-4a00-96bb-8ba05290e1c3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:44:04.119882 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-63977af4-b34f-4a00-96bb-8ba05290e1c3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:44:04.120364 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-63977af4-b34f-4a00-96bb-8ba05290e1c3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:44:04.121363 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-63977af4-b34f-4a00-96bb-8ba05290e1c3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:44:04.121363 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-63977af4-b34f-4a00-96bb-8ba05290e1c3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:44:04.138576 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-63977af4-b34f-4a00-96bb-8ba05290e1c3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:04.139072 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-63977af4-b34f-4a00-96bb-8ba05290e1c3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:04.140046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-63977af4-b34f-4a00-96bb-8ba05290e1c3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:04.144771 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-63977af4-b34f-4a00-96bb-8ba05290e1c3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:04.145273 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-63977af4-b34f-4a00-96bb-8ba05290e1c3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:04.147603 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-da8167be-a269-4dfa-900a-696995569aaf tempest-ImagesMetadataNegativeTestJSON-679260902 tempest-ImagesMetadataNegativeTestJSON-679260902-project] Calling method '.version_select at 0x7f4073541820>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:04.149931 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-63977af4-b34f-4a00-96bb-8ba05290e1c3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:04.172115 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-da8167be-a269-4dfa-900a-696995569aaf tempest-ImagesMetadataNegativeTestJSON-679260902 tempest-ImagesMetadataNegativeTestJSON-679260902-project] HTTP exception thrown: Image not found. Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-da8167be-a269-4dfa-900a-696995569aaf tempest-ImagesMetadataNegativeTestJSON-679260902 tempest-ImagesMetadataNegativeTestJSON-679260902-project] Request method failure captured: Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/images/3a55a6d8-d3c5-429d-8e26-d04f4db6cf8d/metadata/os_distro HTTP/1.1 Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHiCMJ-MXrhaYgfvfqeeRQfPsfY6YWNmwdoV9ND4wjr8brNM5dUddhJUYrjRNiZuj4sA3cRoK-R4EfTSmmT8iocLHsWMHFYjUUzxNLq95LN9UM8NbXHb2v2k8q-cgLWfaoV-iZCvopLyM_RC59Ryup6xiYOcM_XFqCxiouyElICi4QI Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 58240729e3e24030bdad0811519aecac Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-679260902 Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/58240729e3e24030bdad0811519aecac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/58240729e3e24030bdad0811519aecac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_58240729e3e24030bdad0811519aecac", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/58240729e3e24030bdad0811519aecac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-679260902 Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 58240729e3e24030bdad0811519aecac Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-679260902 Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ImagesMetadataNegativeTestJSON-679260902-project Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 2cb4978c95854177bf5864a4156d6c23 Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-679260902-project Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: exception: Image not found. Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'image_id': '3a55a6d8-d3c5-429d-8e26-d04f4db6cf8d', 'id': 'os_distro'} Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3a55a6d8-d3c5-429d-8e26-d04f4db6cf8d Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 10 11:44:04.182284 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3a55a6d8-d3c5-429d-8e26-d04f4db6cf8d could not be found. Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-da8167be-a269-4dfa-900a-696995569aaf tempest-ImagesMetadataNegativeTestJSON-679260902 tempest-ImagesMetadataNegativeTestJSON-679260902-project] Returning 404 to user: Image not found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-da8167be-a269-4dfa-900a-696995569aaf tempest-ImagesMetadataNegativeTestJSON-679260902 tempest-ImagesMetadataNegativeTestJSON-679260902-project] 10.222.0.23 "DELETE /compute/v2.1/images/3a55a6d8-d3c5-429d-8e26-d04f4db6cf8d/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.298531 Sep 10 11:44:04.188126 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 660/1399] 10.222.0.23 () {58 vars in 1293 bytes} [Sat Sep 10 11:44:03 2022] DELETE /compute/v2.1/images/3a55a6d8-d3c5-429d-8e26-d04f4db6cf8d/metadata/os_distro => generated 62 bytes in 301 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:44:04.219963 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-63977af4-b34f-4a00-96bb-8ba05290e1c3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Getting quotas for project 6750367ae6604f798bfd58e2839f83e2. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:44:04.232697 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-63977af4-b34f-4a00-96bb-8ba05290e1c3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Getting quotas for user 805e0c24bd364ac8852387db73b614d9 and project 6750367ae6604f798bfd58e2839f83e2. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:44:04.268677 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-12e8ac3e-7409-4996-937f-677e8a03a439 req-83851180-2676-4634-8a37-e2e1cd6f0355 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68861799-4265-42f8-a24a-dd78f3d6745a", "name": "network-vif-plugged", "status": "completed", "tag": "588ba4ca-8af7-4faa-a475-eb41a709948d"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:04.285200 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-12e8ac3e-7409-4996-937f-677e8a03a439 req-83851180-2676-4634-8a37-e2e1cd6f0355 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:04.285935 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-12e8ac3e-7409-4996-937f-677e8a03a439 req-83851180-2676-4634-8a37-e2e1cd6f0355 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:04.286676 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-12e8ac3e-7409-4996-937f-677e8a03a439 req-83851180-2676-4634-8a37-e2e1cd6f0355 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:04.301998 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-12e8ac3e-7409-4996-937f-677e8a03a439 req-83851180-2676-4634-8a37-e2e1cd6f0355 service nova] Creating event network-vif-plugged:588ba4ca-8af7-4faa-a475-eb41a709948d for instance 68861799-4265-42f8-a24a-dd78f3d6745a on n-h1-856895-1 Sep 10 11:44:04.311037 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [req-12e8ac3e-7409-4996-937f-677e8a03a439 req-83851180-2676-4634-8a37-e2e1cd6f0355 service nova] Instance 68861799-4265-42f8-a24a-dd78f3d6745a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856895-1', 'n-h1-856895-1'} {{(pid=128776) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 11:44:04.329379 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-12e8ac3e-7409-4996-937f-677e8a03a439 req-83851180-2676-4634-8a37-e2e1cd6f0355 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141118 Sep 10 11:44:04.330068 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 661/1400] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:44:04.337047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-63977af4-b34f-4a00-96bb-8ba05290e1c3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:44:04.339444 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-63977af4-b34f-4a00-96bb-8ba05290e1c3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1c0d06ba-5f8a-4d26-9577-d0f22a747ba9',volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:44:04.341398 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d5eb3e66-cf72-4e07-a080-e7eb5963c961 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:04.342137 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d5eb3e66-cf72-4e07-a080-e7eb5963c961 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:04.357143 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d5eb3e66-cf72-4e07-a080-e7eb5963c961 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:04.358055 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d5eb3e66-cf72-4e07-a080-e7eb5963c961 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:04.358671 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d5eb3e66-cf72-4e07-a080-e7eb5963c961 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:04.362111 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d5eb3e66-cf72-4e07-a080-e7eb5963c961 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:04.362789 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d5eb3e66-cf72-4e07-a080-e7eb5963c961 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:04.363422 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d5eb3e66-cf72-4e07-a080-e7eb5963c961 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:04.589289 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-63977af4-b34f-4a00-96bb-8ba05290e1c3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.288685 Sep 10 11:44:04.594920 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 740/1401] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:44:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2295 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:44:04.607313 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d5eb3e66-cf72-4e07-a080-e7eb5963c961 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:04.609149 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d8846d21-2763-4ff5-957b-849a18882998 tempest-ImagesMetadataNegativeTestJSON-679260902 tempest-ImagesMetadataNegativeTestJSON-679260902-project] Calling method '.version_select at 0x7f407329a820>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:04.619931 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d5eb3e66-cf72-4e07-a080-e7eb5963c961 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:04.621990 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d5eb3e66-cf72-4e07-a080-e7eb5963c961 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:04.624468 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d5eb3e66-cf72-4e07-a080-e7eb5963c961 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1755 microversion: 2.42 time: 0.292951 Sep 10 11:44:04.625676 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 662/1402] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:04 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1755 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:44:04.652073 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-d8846d21-2763-4ff5-957b-849a18882998 tempest-ImagesMetadataNegativeTestJSON-679260902 tempest-ImagesMetadataNegativeTestJSON-679260902-project] HTTP exception thrown: Image not found. Sep 10 11:44:04.653515 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b31bf79c-f24c-4836-8d42-1b82fdf4fdfd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:04.654640 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b31bf79c-f24c-4836-8d42-1b82fdf4fdfd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d8846d21-2763-4ff5-957b-849a18882998 tempest-ImagesMetadataNegativeTestJSON-679260902 tempest-ImagesMetadataNegativeTestJSON-679260902-project] Request method failure captured: Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/images/83569d95-5a67-4fc5-8c55-cf0ba7a6c87a/metadata/os_version HTTP/1.1 Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHiCMJ-MXrhaYgfvfqeeRQfPsfY6YWNmwdoV9ND4wjr8brNM5dUddhJUYrjRNiZuj4sA3cRoK-R4EfTSmmT8iocLHsWMHFYjUUzxNLq95LN9UM8NbXHb2v2k8q-cgLWfaoV-iZCvopLyM_RC59Ryup6xiYOcM_XFqCxiouyElICi4QI Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 58240729e3e24030bdad0811519aecac Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-679260902 Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/58240729e3e24030bdad0811519aecac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/58240729e3e24030bdad0811519aecac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_58240729e3e24030bdad0811519aecac", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/58240729e3e24030bdad0811519aecac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-679260902 Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 58240729e3e24030bdad0811519aecac Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-679260902 Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ImagesMetadataNegativeTestJSON-679260902-project Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 2cb4978c95854177bf5864a4156d6c23 Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-679260902-project Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: exception: Image not found. Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'image_id': '83569d95-5a67-4fc5-8c55-cf0ba7a6c87a', 'id': 'os_version'} Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 83569d95-5a67-4fc5-8c55-cf0ba7a6c87a Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 10 11:44:04.655731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 83569d95-5a67-4fc5-8c55-cf0ba7a6c87a could not be found. Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 11:44:04.660071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:04.669225 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b31bf79c-f24c-4836-8d42-1b82fdf4fdfd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:04.669413 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d8846d21-2763-4ff5-957b-849a18882998 tempest-ImagesMetadataNegativeTestJSON-679260902 tempest-ImagesMetadataNegativeTestJSON-679260902-project] Returning 404 to user: Image not found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:44:04.669598 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b31bf79c-f24c-4836-8d42-1b82fdf4fdfd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:04.669598 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b31bf79c-f24c-4836-8d42-1b82fdf4fdfd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:04.669923 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d8846d21-2763-4ff5-957b-849a18882998 tempest-ImagesMetadataNegativeTestJSON-679260902 tempest-ImagesMetadataNegativeTestJSON-679260902-project] 10.222.0.23 "GET /compute/v2.1/images/83569d95-5a67-4fc5-8c55-cf0ba7a6c87a/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.070945 Sep 10 11:44:04.669923 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 741/1403] 10.222.0.23 () {58 vars in 1293 bytes} [Sat Sep 10 11:44:04 2022] GET /compute/v2.1/images/83569d95-5a67-4fc5-8c55-cf0ba7a6c87a/metadata/os_version => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:44:04.671686 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b31bf79c-f24c-4836-8d42-1b82fdf4fdfd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:04.675544 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e8dd5c7b-81f7-430b-ac96-ff64e6360838 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:04.676532 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e8dd5c7b-81f7-430b-ac96-ff64e6360838 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] [instance: afb1a503-7e9a-474c-8dfe-b0e5838b7398] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:04.678046 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b31bf79c-f24c-4836-8d42-1b82fdf4fdfd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:04.678720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b31bf79c-f24c-4836-8d42-1b82fdf4fdfd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:04.684963 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e8dd5c7b-81f7-430b-ac96-ff64e6360838 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:04.685800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e8dd5c7b-81f7-430b-ac96-ff64e6360838 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:04.686690 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e8dd5c7b-81f7-430b-ac96-ff64e6360838 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:04.687664 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e8dd5c7b-81f7-430b-ac96-ff64e6360838 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:04.688342 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e8dd5c7b-81f7-430b-ac96-ff64e6360838 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:04.688987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e8dd5c7b-81f7-430b-ac96-ff64e6360838 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:04.717787 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-e8dd5c7b-81f7-430b-ac96-ff64e6360838 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] HTTP exception thrown: Instance afb1a503-7e9a-474c-8dfe-b0e5838b7398 could not be found. Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e8dd5c7b-81f7-430b-ac96-ff64e6360838 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Request method failure captured: Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398 HTTP/1.1 Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHepLuSL5DNkzCEGtGdcG2LiCZb9djLgNwwK4DKmibrNMimLRGGfCLf4jb6cyPbQ42ClITrJrpBMeMxVdZTEfTlC8B2BdQYNyJSG41Jk1MChvNDMPlxj4_j5eQGo3Q03D1DWJOt0umW-LmNfRVqPE3g5KOsubXNsZJAFZHbwjPecYSI Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 74d3ca9bcf514a8b9844377fc53143ee Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1742250776 Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/74d3ca9bcf514a8b9844377fc53143ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/74d3ca9bcf514a8b9844377fc53143ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_74d3ca9bcf514a8b9844377fc53143ee", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/74d3ca9bcf514a8b9844377fc53143ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1742250776 Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 74d3ca9bcf514a8b9844377fc53143ee Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1742250776 Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-AttachSCSIVolumeTestJSON-1742250776-project Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: dc1e51accd4241b497623f18f0d2967d Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1742250776-project Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance afb1a503-7e9a-474c-8dfe-b0e5838b7398 could not be found. Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'afb1a503-7e9a-474c-8dfe-b0e5838b7398'} Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afb1a503-7e9a-474c-8dfe-b0e5838b7398 could not be found. Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:44:04.723875 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:44:04.729347 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afb1a503-7e9a-474c-8dfe-b0e5838b7398 could not be found. Sep 10 11:44:04.729347 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:04.729347 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:44:04.729347 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:04.729347 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:04.729347 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:44:04.729347 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:44:04.729347 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:44:04.729347 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:44:04.729347 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afb1a503-7e9a-474c-8dfe-b0e5838b7398 could not be found. Sep 10 11:44:04.729347 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:04.734536 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e8dd5c7b-81f7-430b-ac96-ff64e6360838 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Returning 404 to user: Instance afb1a503-7e9a-474c-8dfe-b0e5838b7398 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:44:04.735702 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e8dd5c7b-81f7-430b-ac96-ff64e6360838 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] 10.222.0.23 "DELETE /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398" status: 404 len: 111 microversion: 2.1 time: 0.066798 Sep 10 11:44:04.739102 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 742/1404] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:44:04 2022] DELETE /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:44:04.749986 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f2b47d9d-3d75-416c-aa00-aa07cbe31ade tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:04.751772 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f2b47d9d-3d75-416c-aa00-aa07cbe31ade tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:04.817715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f2b47d9d-3d75-416c-aa00-aa07cbe31ade tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:04.830233 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f2b47d9d-3d75-416c-aa00-aa07cbe31ade tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1052 microversion: 2.1 time: 0.089845 Sep 10 11:44:04.836738 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 743/1405] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:04 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1052 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:04.851669 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-19b1c607-b869-4214-b1a9-e4bda4eaf0e2 tempest-ImagesMetadataNegativeTestJSON-679260902 tempest-ImagesMetadataNegativeTestJSON-679260902-project] Calling method '.version_select at 0x7f4073e7ea60>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:04.878809 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-19b1c607-b869-4214-b1a9-e4bda4eaf0e2 tempest-ImagesMetadataNegativeTestJSON-679260902 tempest-ImagesMetadataNegativeTestJSON-679260902-project] HTTP exception thrown: Image not found. Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-19b1c607-b869-4214-b1a9-e4bda4eaf0e2 tempest-ImagesMetadataNegativeTestJSON-679260902 tempest-ImagesMetadataNegativeTestJSON-679260902-project] Request method failure captured: Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/images/748594eb-5070-4c16-8c4e-a74ec3b9a909/metadata HTTP/1.1 Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHiCMJ-MXrhaYgfvfqeeRQfPsfY6YWNmwdoV9ND4wjr8brNM5dUddhJUYrjRNiZuj4sA3cRoK-R4EfTSmmT8iocLHsWMHFYjUUzxNLq95LN9UM8NbXHb2v2k8q-cgLWfaoV-iZCvopLyM_RC59Ryup6xiYOcM_XFqCxiouyElICi4QI Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 58240729e3e24030bdad0811519aecac Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-679260902 Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/58240729e3e24030bdad0811519aecac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/58240729e3e24030bdad0811519aecac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_58240729e3e24030bdad0811519aecac", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/58240729e3e24030bdad0811519aecac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-679260902 Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 58240729e3e24030bdad0811519aecac Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-679260902 Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ImagesMetadataNegativeTestJSON-679260902-project Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 2cb4978c95854177bf5864a4156d6c23 Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-679260902-project Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: exception: Image not found. Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'image_id': '748594eb-5070-4c16-8c4e-a74ec3b9a909'} Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 748594eb-5070-4c16-8c4e-a74ec3b9a909 Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 10 11:44:04.883997 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 748594eb-5070-4c16-8c4e-a74ec3b9a909 could not be found. Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 11:44:04.888800 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:04.894898 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-19b1c607-b869-4214-b1a9-e4bda4eaf0e2 tempest-ImagesMetadataNegativeTestJSON-679260902 tempest-ImagesMetadataNegativeTestJSON-679260902-project] Returning 404 to user: Image not found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:44:04.896023 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-19b1c607-b869-4214-b1a9-e4bda4eaf0e2 tempest-ImagesMetadataNegativeTestJSON-679260902 tempest-ImagesMetadataNegativeTestJSON-679260902-project] 10.222.0.23 "GET /compute/v2.1/images/748594eb-5070-4c16-8c4e-a74ec3b9a909/metadata" status: 404 len: 62 microversion: 2.1 time: 0.058020 Sep 10 11:44:04.897042 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 744/1406] 10.222.0.23 () {58 vars in 1260 bytes} [Sat Sep 10 11:44:04 2022] GET /compute/v2.1/images/748594eb-5070-4c16-8c4e-a74ec3b9a909/metadata => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:44:04.905578 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cf8a55ae-b670-4375-82b3-98a5b9758d31 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:04.906524 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cf8a55ae-b670-4375-82b3-98a5b9758d31 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] [instance: afb1a503-7e9a-474c-8dfe-b0e5838b7398] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:04.915537 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cf8a55ae-b670-4375-82b3-98a5b9758d31 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:04.916267 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cf8a55ae-b670-4375-82b3-98a5b9758d31 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:04.916926 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cf8a55ae-b670-4375-82b3-98a5b9758d31 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:04.917844 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cf8a55ae-b670-4375-82b3-98a5b9758d31 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:04.918517 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cf8a55ae-b670-4375-82b3-98a5b9758d31 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:04.919176 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cf8a55ae-b670-4375-82b3-98a5b9758d31 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:04.946547 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-cf8a55ae-b670-4375-82b3-98a5b9758d31 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] HTTP exception thrown: Instance afb1a503-7e9a-474c-8dfe-b0e5838b7398 could not be found. Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cf8a55ae-b670-4375-82b3-98a5b9758d31 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Request method failure captured: Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398 HTTP/1.1 Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHepLuSL5DNkzCEGtGdcG2LiCZb9djLgNwwK4DKmibrNMimLRGGfCLf4jb6cyPbQ42ClITrJrpBMeMxVdZTEfTlC8B2BdQYNyJSG41Jk1MChvNDMPlxj4_j5eQGo3Q03D1DWJOt0umW-LmNfRVqPE3g5KOsubXNsZJAFZHbwjPecYSI Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 74d3ca9bcf514a8b9844377fc53143ee Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1742250776 Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/74d3ca9bcf514a8b9844377fc53143ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/74d3ca9bcf514a8b9844377fc53143ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_74d3ca9bcf514a8b9844377fc53143ee", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/74d3ca9bcf514a8b9844377fc53143ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1742250776 Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 74d3ca9bcf514a8b9844377fc53143ee Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1742250776 Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-AttachSCSIVolumeTestJSON-1742250776-project Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: dc1e51accd4241b497623f18f0d2967d Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1742250776-project Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance afb1a503-7e9a-474c-8dfe-b0e5838b7398 could not be found. Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'afb1a503-7e9a-474c-8dfe-b0e5838b7398'} Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afb1a503-7e9a-474c-8dfe-b0e5838b7398 could not be found. Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afb1a503-7e9a-474c-8dfe-b0e5838b7398 could not be found. Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:44:04.949253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:04.953612 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:04.953612 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:44:04.953612 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:44:04.953612 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:44:04.953612 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:44:04.953612 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afb1a503-7e9a-474c-8dfe-b0e5838b7398 could not be found. Sep 10 11:44:04.953612 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:04.955601 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cf8a55ae-b670-4375-82b3-98a5b9758d31 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] Returning 404 to user: Instance afb1a503-7e9a-474c-8dfe-b0e5838b7398 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:44:04.956732 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cf8a55ae-b670-4375-82b3-98a5b9758d31 tempest-AttachSCSIVolumeTestJSON-1742250776 tempest-AttachSCSIVolumeTestJSON-1742250776-project] 10.222.0.23 "GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398" status: 404 len: 111 microversion: 2.1 time: 0.058377 Sep 10 11:44:04.958599 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 745/1407] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:04 2022] GET /compute/v2.1/servers/afb1a503-7e9a-474c-8dfe-b0e5838b7398 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:44:04.964988 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-afc36c80-4287-4837-8ecc-cb270fa4bf44 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:04.966071 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-afc36c80-4287-4837-8ecc-cb270fa4bf44 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:04.973489 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-afc36c80-4287-4837-8ecc-cb270fa4bf44 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:04.974299 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-afc36c80-4287-4837-8ecc-cb270fa4bf44 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:04.976082 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-afc36c80-4287-4837-8ecc-cb270fa4bf44 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:04.977154 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-afc36c80-4287-4837-8ecc-cb270fa4bf44 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:04.977843 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-afc36c80-4287-4837-8ecc-cb270fa4bf44 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:04.986841 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-afc36c80-4287-4837-8ecc-cb270fa4bf44 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:05.463696 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b31bf79c-f24c-4836-8d42-1b82fdf4fdfd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:05.474330 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b31bf79c-f24c-4836-8d42-1b82fdf4fdfd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:05.489205 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b31bf79c-f24c-4836-8d42-1b82fdf4fdfd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:05.490985 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b31bf79c-f24c-4836-8d42-1b82fdf4fdfd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1811 microversion: 2.25 time: 0.863797 Sep 10 11:44:05.492241 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 663/1408] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:04 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1811 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:44:05.498484 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a6283109-43bf-439d-826c-28f9dbc12a83 tempest-ImagesMetadataNegativeTestJSON-679260902 tempest-ImagesMetadataNegativeTestJSON-679260902-project] Action: 'update_all', calling method: .version_select at 0x7f40735f8dc0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:05.557103 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-a6283109-43bf-439d-826c-28f9dbc12a83 tempest-ImagesMetadataNegativeTestJSON-679260902 tempest-ImagesMetadataNegativeTestJSON-679260902-project] HTTP exception thrown: Image not found. Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a6283109-43bf-439d-826c-28f9dbc12a83 tempest-ImagesMetadataNegativeTestJSON-679260902 tempest-ImagesMetadataNegativeTestJSON-679260902-project] Request method failure captured: Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: request: PUT /compute/v2.1/images/54e7a8e0-4742-4aa6-92bd-6ef7e20ca825/metadata HTTP/1.1 Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 57 Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHiCMJ-MXrhaYgfvfqeeRQfPsfY6YWNmwdoV9ND4wjr8brNM5dUddhJUYrjRNiZuj4sA3cRoK-R4EfTSmmT8iocLHsWMHFYjUUzxNLq95LN9UM8NbXHb2v2k8q-cgLWfaoV-iZCvopLyM_RC59Ryup6xiYOcM_XFqCxiouyElICi4QI Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 58240729e3e24030bdad0811519aecac Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-679260902 Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/58240729e3e24030bdad0811519aecac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/58240729e3e24030bdad0811519aecac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_58240729e3e24030bdad0811519aecac", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/58240729e3e24030bdad0811519aecac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-679260902 Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 58240729e3e24030bdad0811519aecac Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-679260902 Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ImagesMetadataNegativeTestJSON-679260902-project Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 2cb4978c95854177bf5864a4156d6c23 Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-679260902-project Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: exception: Image not found. Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'image_id': '54e7a8e0-4742-4aa6-92bd-6ef7e20ca825', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 54e7a8e0-4742-4aa6-92bd-6ef7e20ca825 Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 10 11:44:05.559751 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 54e7a8e0-4742-4aa6-92bd-6ef7e20ca825 could not be found. Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a6283109-43bf-439d-826c-28f9dbc12a83 tempest-ImagesMetadataNegativeTestJSON-679260902 tempest-ImagesMetadataNegativeTestJSON-679260902-project] Returning 404 to user: Image not found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a6283109-43bf-439d-826c-28f9dbc12a83 tempest-ImagesMetadataNegativeTestJSON-679260902 tempest-ImagesMetadataNegativeTestJSON-679260902-project] 10.222.0.23 "PUT /compute/v2.1/images/54e7a8e0-4742-4aa6-92bd-6ef7e20ca825/metadata" status: 404 len: 62 microversion: 2.1 time: 0.067796 Sep 10 11:44:05.569967 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 664/1409] 10.222.0.23 () {60 vars in 1280 bytes} [Sat Sep 10 11:44:05 2022] PUT /compute/v2.1/images/54e7a8e0-4742-4aa6-92bd-6ef7e20ca825/metadata => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:44:05.580673 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-111cf3db-8a03-46e1-90d3-48a419c7435a tempest-ImagesMetadataNegativeTestJSON-679260902 tempest-ImagesMetadataNegativeTestJSON-679260902-project] Action: 'update', calling method: .version_select at 0x7f40733e80d0>, body: {"meta": {"os_distro": "alt"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:05.581012 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-afc36c80-4287-4837-8ecc-cb270fa4bf44 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:05.589989 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-afc36c80-4287-4837-8ecc-cb270fa4bf44 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 200 len: 1470 microversion: 2.1 time: 0.629666 Sep 10 11:44:05.597669 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 746/1410] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:04 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 1470 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:05.629639 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-111cf3db-8a03-46e1-90d3-48a419c7435a tempest-ImagesMetadataNegativeTestJSON-679260902 tempest-ImagesMetadataNegativeTestJSON-679260902-project] HTTP exception thrown: Image not found. Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-111cf3db-8a03-46e1-90d3-48a419c7435a tempest-ImagesMetadataNegativeTestJSON-679260902 tempest-ImagesMetadataNegativeTestJSON-679260902-project] Request method failure captured: Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: request: PUT /compute/v2.1/images/a96d3631-5e5c-479c-b478-7ba20e09d577/metadata/os_distro HTTP/1.1 Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 30 Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHiCMJ-MXrhaYgfvfqeeRQfPsfY6YWNmwdoV9ND4wjr8brNM5dUddhJUYrjRNiZuj4sA3cRoK-R4EfTSmmT8iocLHsWMHFYjUUzxNLq95LN9UM8NbXHb2v2k8q-cgLWfaoV-iZCvopLyM_RC59Ryup6xiYOcM_XFqCxiouyElICi4QI Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 58240729e3e24030bdad0811519aecac Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-679260902 Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/58240729e3e24030bdad0811519aecac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/58240729e3e24030bdad0811519aecac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_58240729e3e24030bdad0811519aecac", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/58240729e3e24030bdad0811519aecac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-679260902 Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 58240729e3e24030bdad0811519aecac Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-679260902 Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ImagesMetadataNegativeTestJSON-679260902-project Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 2cb4978c95854177bf5864a4156d6c23 Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-679260902-project Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: {"meta": {"os_distro": "alt"}} Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: exception: Image not found. Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'image_id': 'a96d3631-5e5c-479c-b478-7ba20e09d577', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a96d3631-5e5c-479c-b478-7ba20e09d577 Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 10 11:44:05.642249 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a96d3631-5e5c-479c-b478-7ba20e09d577 could not be found. Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 11:44:05.655009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:05.664498 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a3894c18-bff6-46c6-acb8-64b59e5ac4d5 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:05.664498 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a3894c18-bff6-46c6-acb8-64b59e5ac4d5 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:05.670217 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-111cf3db-8a03-46e1-90d3-48a419c7435a tempest-ImagesMetadataNegativeTestJSON-679260902 tempest-ImagesMetadataNegativeTestJSON-679260902-project] Returning 404 to user: Image not found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:44:05.673916 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-111cf3db-8a03-46e1-90d3-48a419c7435a tempest-ImagesMetadataNegativeTestJSON-679260902 tempest-ImagesMetadataNegativeTestJSON-679260902-project] 10.222.0.23 "PUT /compute/v2.1/images/a96d3631-5e5c-479c-b478-7ba20e09d577/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.106164 Sep 10 11:44:05.675735 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 665/1411] 10.222.0.23 () {60 vars in 1310 bytes} [Sat Sep 10 11:44:05 2022] PUT /compute/v2.1/images/a96d3631-5e5c-479c-b478-7ba20e09d577/metadata/os_distro => generated 62 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 10 11:44:05.676827 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a3894c18-bff6-46c6-acb8-64b59e5ac4d5 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:05.681239 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a3894c18-bff6-46c6-acb8-64b59e5ac4d5 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:05.681947 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a3894c18-bff6-46c6-acb8-64b59e5ac4d5 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:05.682690 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a3894c18-bff6-46c6-acb8-64b59e5ac4d5 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:05.683175 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a3894c18-bff6-46c6-acb8-64b59e5ac4d5 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:05.685082 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a3894c18-bff6-46c6-acb8-64b59e5ac4d5 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:05.688420 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2a757938-fe85-4970-a193-92b6669f558a tempest-ImagesMetadataNegativeTestJSON-679260902 tempest-ImagesMetadataNegativeTestJSON-679260902-project] Action: 'create', calling method: .version_select at 0x7f40734e8ca0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:05.747309 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-2a757938-fe85-4970-a193-92b6669f558a tempest-ImagesMetadataNegativeTestJSON-679260902 tempest-ImagesMetadataNegativeTestJSON-679260902-project] HTTP exception thrown: Image not found. Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2a757938-fe85-4970-a193-92b6669f558a tempest-ImagesMetadataNegativeTestJSON-679260902 tempest-ImagesMetadataNegativeTestJSON-679260902-project] Request method failure captured: Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/images/e0d6d2eb-ca41-4d40-830b-f8bd37e0ac91/metadata HTTP/1.1 Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 57 Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHiCMJ-MXrhaYgfvfqeeRQfPsfY6YWNmwdoV9ND4wjr8brNM5dUddhJUYrjRNiZuj4sA3cRoK-R4EfTSmmT8iocLHsWMHFYjUUzxNLq95LN9UM8NbXHb2v2k8q-cgLWfaoV-iZCvopLyM_RC59Ryup6xiYOcM_XFqCxiouyElICi4QI Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 58240729e3e24030bdad0811519aecac Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-679260902 Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/58240729e3e24030bdad0811519aecac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/58240729e3e24030bdad0811519aecac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_58240729e3e24030bdad0811519aecac", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/58240729e3e24030bdad0811519aecac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-679260902 Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 58240729e3e24030bdad0811519aecac Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-679260902 Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ImagesMetadataNegativeTestJSON-679260902-project Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 2cb4978c95854177bf5864a4156d6c23 Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-679260902-project Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: exception: Image not found. Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'image_id': 'e0d6d2eb-ca41-4d40-830b-f8bd37e0ac91', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e0d6d2eb-ca41-4d40-830b-f8bd37e0ac91 Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 10 11:44:05.750034 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e0d6d2eb-ca41-4d40-830b-f8bd37e0ac91 could not be found. Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2a757938-fe85-4970-a193-92b6669f558a tempest-ImagesMetadataNegativeTestJSON-679260902 tempest-ImagesMetadataNegativeTestJSON-679260902-project] Returning 404 to user: Image not found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2a757938-fe85-4970-a193-92b6669f558a tempest-ImagesMetadataNegativeTestJSON-679260902 tempest-ImagesMetadataNegativeTestJSON-679260902-project] 10.222.0.23 "POST /compute/v2.1/images/e0d6d2eb-ca41-4d40-830b-f8bd37e0ac91/metadata" status: 404 len: 62 microversion: 2.1 time: 0.071083 Sep 10 11:44:05.759719 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 666/1412] 10.222.0.23 () {60 vars in 1281 bytes} [Sat Sep 10 11:44:05 2022] POST /compute/v2.1/images/e0d6d2eb-ca41-4d40-830b-f8bd37e0ac91/metadata => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 10 11:44:05.860669 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3de2cc9a-f6b8-4e26-b5e6-86a0b4928bfd tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:05.864502 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3de2cc9a-f6b8-4e26-b5e6-86a0b4928bfd tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:05.895561 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3de2cc9a-f6b8-4e26-b5e6-86a0b4928bfd tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:05.898083 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3de2cc9a-f6b8-4e26-b5e6-86a0b4928bfd tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:05.901171 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3de2cc9a-f6b8-4e26-b5e6-86a0b4928bfd tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:05.904250 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3de2cc9a-f6b8-4e26-b5e6-86a0b4928bfd tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:05.909759 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3de2cc9a-f6b8-4e26-b5e6-86a0b4928bfd tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:05.911330 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3de2cc9a-f6b8-4e26-b5e6-86a0b4928bfd tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:06.268108 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3de2cc9a-f6b8-4e26-b5e6-86a0b4928bfd tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:06.283352 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3de2cc9a-f6b8-4e26-b5e6-86a0b4928bfd tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1094 microversion: 2.1 time: 0.430251 Sep 10 11:44:06.286149 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 667/1413] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:05 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1094 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:06.447602 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a3894c18-bff6-46c6-acb8-64b59e5ac4d5 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:06.481141 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a3894c18-bff6-46c6-acb8-64b59e5ac4d5 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:06.483112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a3894c18-bff6-46c6-acb8-64b59e5ac4d5 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:06.490494 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a3894c18-bff6-46c6-acb8-64b59e5ac4d5 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1802 microversion: 2.42 time: 0.842363 Sep 10 11:44:06.495468 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 747/1414] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:05 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1802 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:44:06.529109 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2b78bbd0-a65b-4cf2-b225-e2ccf8b9d7d5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:06.529872 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2b78bbd0-a65b-4cf2-b225-e2ccf8b9d7d5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:06.543141 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2b78bbd0-a65b-4cf2-b225-e2ccf8b9d7d5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:06.544544 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2b78bbd0-a65b-4cf2-b225-e2ccf8b9d7d5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:06.545269 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2b78bbd0-a65b-4cf2-b225-e2ccf8b9d7d5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:06.546821 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2b78bbd0-a65b-4cf2-b225-e2ccf8b9d7d5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:06.548482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2b78bbd0-a65b-4cf2-b225-e2ccf8b9d7d5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:06.549531 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2b78bbd0-a65b-4cf2-b225-e2ccf8b9d7d5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:06.614408 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ed513e2c-dab2-4253-aeb0-04cea1f0de8e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:06.615807 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ed513e2c-dab2-4253-aeb0-04cea1f0de8e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:06.627464 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ed513e2c-dab2-4253-aeb0-04cea1f0de8e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:06.627968 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ed513e2c-dab2-4253-aeb0-04cea1f0de8e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:06.628414 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ed513e2c-dab2-4253-aeb0-04cea1f0de8e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:06.632787 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ed513e2c-dab2-4253-aeb0-04cea1f0de8e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:06.633263 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ed513e2c-dab2-4253-aeb0-04cea1f0de8e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:06.633707 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ed513e2c-dab2-4253-aeb0-04cea1f0de8e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:07.204594 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2b78bbd0-a65b-4cf2-b225-e2ccf8b9d7d5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:07.218343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2b78bbd0-a65b-4cf2-b225-e2ccf8b9d7d5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:07.229052 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2b78bbd0-a65b-4cf2-b225-e2ccf8b9d7d5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:07.230417 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2b78bbd0-a65b-4cf2-b225-e2ccf8b9d7d5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1811 microversion: 2.25 time: 0.707037 Sep 10 11:44:07.248135 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 668/1415] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:06 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1811 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:44:07.294674 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ed513e2c-dab2-4253-aeb0-04cea1f0de8e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:07.316251 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dbc897e5-c52b-421a-b9b3-883d4e1c6cfb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:07.316862 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-dbc897e5-c52b-421a-b9b3-883d4e1c6cfb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:07.327476 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dbc897e5-c52b-421a-b9b3-883d4e1c6cfb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:07.328496 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ed513e2c-dab2-4253-aeb0-04cea1f0de8e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 200 len: 1470 microversion: 2.1 time: 0.715703 Sep 10 11:44:07.332156 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 748/1416] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:06 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 1470 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:07.332460 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dbc897e5-c52b-421a-b9b3-883d4e1c6cfb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:07.333211 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dbc897e5-c52b-421a-b9b3-883d4e1c6cfb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:07.333997 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dbc897e5-c52b-421a-b9b3-883d4e1c6cfb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:07.334474 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dbc897e5-c52b-421a-b9b3-883d4e1c6cfb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:07.334903 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dbc897e5-c52b-421a-b9b3-883d4e1c6cfb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:07.509588 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-dbc897e5-c52b-421a-b9b3-883d4e1c6cfb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:07.522545 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cbf8491c-69d3-42f6-b686-74b0b782df55 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:07.524319 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cbf8491c-69d3-42f6-b686-74b0b782df55 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:07.544151 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cbf8491c-69d3-42f6-b686-74b0b782df55 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:07.545880 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-dbc897e5-c52b-421a-b9b3-883d4e1c6cfb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1168 microversion: 2.1 time: 0.232563 Sep 10 11:44:07.546685 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 669/1417] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:07 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1168 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:07.550147 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cbf8491c-69d3-42f6-b686-74b0b782df55 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:07.550803 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cbf8491c-69d3-42f6-b686-74b0b782df55 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:07.555199 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cbf8491c-69d3-42f6-b686-74b0b782df55 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:07.558704 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cbf8491c-69d3-42f6-b686-74b0b782df55 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:07.559644 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cbf8491c-69d3-42f6-b686-74b0b782df55 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:08.056182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cbf8491c-69d3-42f6-b686-74b0b782df55 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:08.096418 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cbf8491c-69d3-42f6-b686-74b0b782df55 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:08.103682 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cbf8491c-69d3-42f6-b686-74b0b782df55 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:08.105055 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cbf8491c-69d3-42f6-b686-74b0b782df55 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1802 microversion: 2.42 time: 0.587281 Sep 10 11:44:08.112710 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 749/1418] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:07 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1802 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:44:08.258294 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a70f848f-952e-4475-bccd-dcead9a50647 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:08.259999 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a70f848f-952e-4475-bccd-dcead9a50647 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:08.273464 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a70f848f-952e-4475-bccd-dcead9a50647 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:08.274147 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a70f848f-952e-4475-bccd-dcead9a50647 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:08.274826 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a70f848f-952e-4475-bccd-dcead9a50647 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:08.275934 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a70f848f-952e-4475-bccd-dcead9a50647 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:08.276983 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a70f848f-952e-4475-bccd-dcead9a50647 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:08.277612 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a70f848f-952e-4475-bccd-dcead9a50647 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:08.370924 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-248b7bfc-6c1f-499c-9fd3-574efc958931 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:08.371835 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-248b7bfc-6c1f-499c-9fd3-574efc958931 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:08.397855 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-248b7bfc-6c1f-499c-9fd3-574efc958931 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:08.401857 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-248b7bfc-6c1f-499c-9fd3-574efc958931 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:08.402317 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-248b7bfc-6c1f-499c-9fd3-574efc958931 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:08.407029 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-248b7bfc-6c1f-499c-9fd3-574efc958931 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:08.408104 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-248b7bfc-6c1f-499c-9fd3-574efc958931 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:08.408679 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-248b7bfc-6c1f-499c-9fd3-574efc958931 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:08.976059 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a70f848f-952e-4475-bccd-dcead9a50647 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:08.997696 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a70f848f-952e-4475-bccd-dcead9a50647 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:09.003106 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a70f848f-952e-4475-bccd-dcead9a50647 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:09.008741 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a70f848f-952e-4475-bccd-dcead9a50647 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1811 microversion: 2.25 time: 0.753706 Sep 10 11:44:09.026217 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 670/1419] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:08 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1811 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:44:09.046840 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b747daac-ceae-46b2-9987-ef35bec71e3f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:09.050262 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b747daac-ceae-46b2-9987-ef35bec71e3f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:09.076218 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b747daac-ceae-46b2-9987-ef35bec71e3f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:09.077449 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b747daac-ceae-46b2-9987-ef35bec71e3f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:09.078637 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b747daac-ceae-46b2-9987-ef35bec71e3f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:09.079976 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b747daac-ceae-46b2-9987-ef35bec71e3f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:09.082020 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b747daac-ceae-46b2-9987-ef35bec71e3f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:09.082769 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b747daac-ceae-46b2-9987-ef35bec71e3f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:09.131593 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-248b7bfc-6c1f-499c-9fd3-574efc958931 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:09.153227 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-248b7bfc-6c1f-499c-9fd3-574efc958931 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 200 len: 1462 microversion: 2.1 time: 0.801658 Sep 10 11:44:09.158005 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 750/1420] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:08 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 1462 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:09.179006 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d600e11b-934a-4ed3-a276-bf939d323022 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:09.180195 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d600e11b-934a-4ed3-a276-bf939d323022 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:09.199760 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d600e11b-934a-4ed3-a276-bf939d323022 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:09.200551 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d600e11b-934a-4ed3-a276-bf939d323022 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:09.201950 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d600e11b-934a-4ed3-a276-bf939d323022 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:09.203575 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d600e11b-934a-4ed3-a276-bf939d323022 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:09.205560 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d600e11b-934a-4ed3-a276-bf939d323022 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:09.207308 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d600e11b-934a-4ed3-a276-bf939d323022 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:09.281344 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b747daac-ceae-46b2-9987-ef35bec71e3f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:09.283905 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:44:09.294962 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b747daac-ceae-46b2-9987-ef35bec71e3f tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1168 microversion: 2.1 time: 0.261243 Sep 10 11:44:09.304175 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 671/1421] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:09 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1168 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:09.309787 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ebb11bc4-8210-407a-a739-a8e820b468bc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:09.311831 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ebb11bc4-8210-407a-a739-a8e820b468bc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:09.338663 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ebb11bc4-8210-407a-a739-a8e820b468bc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:09.339722 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ebb11bc4-8210-407a-a739-a8e820b468bc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:09.340453 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ebb11bc4-8210-407a-a739-a8e820b468bc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:09.342190 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ebb11bc4-8210-407a-a739-a8e820b468bc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:09.342806 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ebb11bc4-8210-407a-a739-a8e820b468bc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:09.347137 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ebb11bc4-8210-407a-a739-a8e820b468bc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:09.981666 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ebb11bc4-8210-407a-a739-a8e820b468bc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:10.021823 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ebb11bc4-8210-407a-a739-a8e820b468bc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 200 len: 1462 microversion: 2.1 time: 0.713025 Sep 10 11:44:10.025576 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 672/1422] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:09 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 1462 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:10.053134 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f44cfa26-464c-4645-aa33-6f4816aad34e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:10.054176 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f44cfa26-464c-4645-aa33-6f4816aad34e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:10.074366 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f44cfa26-464c-4645-aa33-6f4816aad34e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:10.076160 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f44cfa26-464c-4645-aa33-6f4816aad34e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:10.079860 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f44cfa26-464c-4645-aa33-6f4816aad34e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:10.081014 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f44cfa26-464c-4645-aa33-6f4816aad34e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:10.081944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f44cfa26-464c-4645-aa33-6f4816aad34e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:10.084816 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f44cfa26-464c-4645-aa33-6f4816aad34e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:10.200450 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d600e11b-934a-4ed3-a276-bf939d323022 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:10.231486 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d600e11b-934a-4ed3-a276-bf939d323022 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:10.233397 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d600e11b-934a-4ed3-a276-bf939d323022 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:10.239899 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d600e11b-934a-4ed3-a276-bf939d323022 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1802 microversion: 2.42 time: 1.078394 Sep 10 11:44:10.241166 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 751/1423] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:09 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1802 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:44:10.256046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-30de898d-89d7-4826-bcf5-bd2a117d81c2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Action: 'create', calling method: .version_select at 0x7f407368b430>, body: {"keypair": {"name": "tempest-keypair-1390828912", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpcCDnz3xD1YTXjdK1Oz1YkavkgTzzfAdt0cu0LqY4Ck1WC/j/HTxjQJozN2L3cLsGXSBDNRWhyl9hP1cnbpCJjMl3XkW3KqOWnaBXYG45vOsXBu+65XRcWzHlJ7ZWmwA=="}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:10.305399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-30de898d-89d7-4826-bcf5-bd2a117d81c2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Getting quotas for project 7b37b36096cd42f6b6568ff9eee2751c. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:44:10.314923 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-30de898d-89d7-4826-bcf5-bd2a117d81c2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Getting quotas for user 77d854474f4c4481ac407a76b4627c69 and project 7b37b36096cd42f6b6568ff9eee2751c. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:44:10.362491 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-30de898d-89d7-4826-bcf5-bd2a117d81c2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.119526 Sep 10 11:44:10.363120 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 752/1424] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 11:44:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:44:10.377701 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-621eb482-6525-4100-810f-7475bb2d3e69 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:10.378279 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-621eb482-6525-4100-810f-7475bb2d3e69 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:10.392236 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-621eb482-6525-4100-810f-7475bb2d3e69 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:10.392754 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-621eb482-6525-4100-810f-7475bb2d3e69 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:10.393211 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-621eb482-6525-4100-810f-7475bb2d3e69 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:10.394085 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-621eb482-6525-4100-810f-7475bb2d3e69 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:10.407883 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-621eb482-6525-4100-810f-7475bb2d3e69 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:10.408262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-621eb482-6525-4100-810f-7475bb2d3e69 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:10.859367 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-621eb482-6525-4100-810f-7475bb2d3e69 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:10.871093 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-621eb482-6525-4100-810f-7475bb2d3e69 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1168 microversion: 2.1 time: 0.503731 Sep 10 11:44:10.871742 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 753/1425] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:10 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1168 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:11.124198 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9942c4ef-e326-4606-9b45-5c33b125ca0d tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Action: 'create', calling method: .version_select at 0x7f4073dfb3a0>, body: {"keypair": {"name": "tempest-keypair-642598816", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+yf6JdJajLjG+rlJI0zXhC6xu/EQpMw0U+UXoj7JxS1U1Ln2KXNUPcjVr5Yfk4ph5BH6weZlM6cPbOc4Gwrc5b7+ddmKcAnUcBYjhFsJvSgh+dXvyhTWDZ5/WhelPdxA=="}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:11.154832 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-9942c4ef-e326-4606-9b45-5c33b125ca0d tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Getting quotas for project 33ba2169064e4c1e9a077f9111ac6345. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:44:11.172753 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-9942c4ef-e326-4606-9b45-5c33b125ca0d tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Getting quotas for user 8270c6cc04f54b8382808457ba6b7e07 and project 33ba2169064e4c1e9a077f9111ac6345. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:44:11.223341 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9942c4ef-e326-4606-9b45-5c33b125ca0d tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.350216 Sep 10 11:44:11.224806 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 754/1426] 10.222.0.23 () {62 vars in 1199 bytes} [Sat Sep 10 11:44:10 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 352 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 10 11:44:11.236629 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-05cb7e53-9bba-41eb-a33f-b6288505b792 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Calling method '.version_select at 0x7f4073838b80>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:11.260569 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-05cb7e53-9bba-41eb-a33f-b6288505b792 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-642598816" status: 200 len: 512 microversion: 2.2 time: 0.028058 Sep 10 11:44:11.262127 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 755/1427] 10.222.0.23 () {60 vars in 1255 bytes} [Sat Sep 10 11:44:11 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-642598816 => generated 512 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:44:11.274486 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-00f330e7-5169-422a-b4ac-86d83e04e63e tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Calling method '.version_select at 0x7f40738c3430>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:11.316050 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-00f330e7-5169-422a-b4ac-86d83e04e63e tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-642598816" status: 204 len: 0 microversion: 2.2 time: 0.045615 Sep 10 11:44:11.316971 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 756/1428] 10.222.0.23 () {60 vars in 1258 bytes} [Sat Sep 10 11:44:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-642598816 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 11:44:11.329149 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0f2c32f9-6b79-4c26-a139-b86f6de7e279 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:11.330072 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0f2c32f9-6b79-4c26-a139-b86f6de7e279 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:11.338668 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0f2c32f9-6b79-4c26-a139-b86f6de7e279 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:11.352022 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0f2c32f9-6b79-4c26-a139-b86f6de7e279 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:11.352756 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0f2c32f9-6b79-4c26-a139-b86f6de7e279 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:11.353700 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0f2c32f9-6b79-4c26-a139-b86f6de7e279 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:11.354341 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0f2c32f9-6b79-4c26-a139-b86f6de7e279 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:11.354978 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0f2c32f9-6b79-4c26-a139-b86f6de7e279 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:12.106655 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f44cfa26-464c-4645-aa33-6f4816aad34e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:12.123153 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f44cfa26-464c-4645-aa33-6f4816aad34e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:12.125595 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f44cfa26-464c-4645-aa33-6f4816aad34e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:12.127124 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f44cfa26-464c-4645-aa33-6f4816aad34e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1811 microversion: 2.25 time: 2.082087 Sep 10 11:44:12.128320 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 673/1429] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:10 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1811 bytes in 2084 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:44:12.144513 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-723a7e3c-20f9-4e4b-a69c-c7810882fce7 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Action: 'create', calling method: .version_select at 0x7f4073385670>, body: {"keypair": {"name": "tempest-keypair-1842475847", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHEC/ey6iRBGriGHHxLX0dGPwz/vnfPclCmZLwMO+vqs+3peqerTqCRTauO6exbdoKeWEO+sFMMiigi/MWCIh9EZ+Id6xUCKSkHCDIIYWS60KJ+Kgh37SlglAXDhHE4TGA=="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:12.197617 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-723a7e3c-20f9-4e4b-a69c-c7810882fce7 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Getting quotas for project 33ba2169064e4c1e9a077f9111ac6345. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:44:12.212533 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-723a7e3c-20f9-4e4b-a69c-c7810882fce7 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Getting quotas for user 8270c6cc04f54b8382808457ba6b7e07 and project 33ba2169064e4c1e9a077f9111ac6345. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:44:12.307598 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-723a7e3c-20f9-4e4b-a69c-c7810882fce7 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.177769 Sep 10 11:44:12.315646 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 674/1430] 10.222.0.23 () {62 vars in 1199 bytes} [Sat Sep 10 11:44:12 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 181 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 10 11:44:12.323522 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4e409664-651d-417c-a2e7-5b83b2d49542 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:12.324290 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4e409664-651d-417c-a2e7-5b83b2d49542 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:12.337799 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e409664-651d-417c-a2e7-5b83b2d49542 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:12.338523 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e409664-651d-417c-a2e7-5b83b2d49542 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:12.339115 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e409664-651d-417c-a2e7-5b83b2d49542 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:12.340450 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e409664-651d-417c-a2e7-5b83b2d49542 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:12.340921 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e409664-651d-417c-a2e7-5b83b2d49542 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:12.341357 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e409664-651d-417c-a2e7-5b83b2d49542 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:12.788731 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0f2c32f9-6b79-4c26-a139-b86f6de7e279 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:12.805828 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0f2c32f9-6b79-4c26-a139-b86f6de7e279 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:12.807902 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0f2c32f9-6b79-4c26-a139-b86f6de7e279 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:12.809139 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0f2c32f9-6b79-4c26-a139-b86f6de7e279 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1849 microversion: 2.42 time: 1.491199 Sep 10 11:44:12.809721 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 757/1431] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:11 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1849 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:44:12.823196 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-72ce638d-2320-4ef6-b8c1-b97d8e573e5d tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Calling method '.version_select at 0x7f4073b95d30>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:12.862723 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-72ce638d-2320-4ef6-b8c1-b97d8e573e5d tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1842475847" status: 204 len: 0 microversion: 2.2 time: 0.051901 Sep 10 11:44:12.863697 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 758/1432] 10.222.0.23 () {60 vars in 1261 bytes} [Sat Sep 10 11:44:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1842475847 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:44:12.873294 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-06cc56ba-7b0d-4708-b49d-a9259dc07810 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Action: 'create', calling method: .version_select at 0x7f407322cb80>, body: {"keypair": {"name": "tempest-keypair-788943810", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:12.910030 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-06cc56ba-7b0d-4708-b49d-a9259dc07810 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Getting quotas for project 33ba2169064e4c1e9a077f9111ac6345. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:44:12.916147 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:44:12.920477 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-06cc56ba-7b0d-4708-b49d-a9259dc07810 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Getting quotas for user 8270c6cc04f54b8382808457ba6b7e07 and project 33ba2169064e4c1e9a077f9111ac6345. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:44:12.966156 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-06cc56ba-7b0d-4708-b49d-a9259dc07810 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.096653 Sep 10 11:44:12.967454 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 759/1433] 10.222.0.23 () {62 vars in 1199 bytes} [Sat Sep 10 11:44:12 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 99 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 10 11:44:12.981096 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e6a70dfa-9b86-45cb-ae03-9dfeb2f9af53 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Calling method '.version_select at 0x7f407369f3a0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:13.012632 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e6a70dfa-9b86-45cb-ae03-9dfeb2f9af53 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-788943810" status: 204 len: 0 microversion: 2.2 time: 0.038411 Sep 10 11:44:13.015364 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 760/1434] 10.222.0.23 () {60 vars in 1258 bytes} [Sat Sep 10 11:44:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-788943810 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 11:44:13.019855 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4e409664-651d-417c-a2e7-5b83b2d49542 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:13.030704 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4e409664-651d-417c-a2e7-5b83b2d49542 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1210 microversion: 2.1 time: 0.719247 Sep 10 11:44:13.034703 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 675/1435] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:12 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1210 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:13.036285 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-961c4688-eb93-4c85-bf9a-eac190358e48 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Action: 'create', calling method: .version_select at 0x7f40738c3ee0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-137021932", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJ03M8zvqH5/3wIVVaqAIJ3/XHSQp6F2Bcpi5BxdjPra0/oJDAMWRmNm4hVPvCFCwr1tPx0ANyFX4fqAzommulMWNs1USM15aDS7Ypbe6vheJamPxkBKgjLEyyeVcHURA=="}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:13.056278 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-961c4688-eb93-4c85-bf9a-eac190358e48 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Getting quotas for project 33ba2169064e4c1e9a077f9111ac6345. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:44:13.062559 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-961c4688-eb93-4c85-bf9a-eac190358e48 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Getting quotas for user 8270c6cc04f54b8382808457ba6b7e07 and project 33ba2169064e4c1e9a077f9111ac6345. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:44:13.096936 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-961c4688-eb93-4c85-bf9a-eac190358e48 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.072838 Sep 10 11:44:13.098833 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 761/1436] 10.222.0.23 () {62 vars in 1199 bytes} [Sat Sep 10 11:44:13 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 75 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 10 11:44:13.114695 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-629de7d8-8804-4387-b140-6bb75ac7cfe7 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Action: 'create', calling method: .version_select at 0x7f40733d1ca0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-392959520", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJuvm1N/67kWcGw5dkcHXwlweG+dyJjXHwHVYBHPrMAAwLEZx8gxiZqJ+Ve/0KLqPiux3GI/XcfQdadOlNQS3QjDKpfm2zWVg1rVhZ6tUDupqZQmGQrLq17P5W870NjBg=="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:13.133033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-629de7d8-8804-4387-b140-6bb75ac7cfe7 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Getting quotas for project 33ba2169064e4c1e9a077f9111ac6345. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:44:13.139082 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-629de7d8-8804-4387-b140-6bb75ac7cfe7 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Getting quotas for user 8270c6cc04f54b8382808457ba6b7e07 and project 33ba2169064e4c1e9a077f9111ac6345. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:44:13.158661 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e5f5771e-c8c6-49c2-a82a-a26869e172ee tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:13.160175 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e5f5771e-c8c6-49c2-a82a-a26869e172ee tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:13.173580 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-629de7d8-8804-4387-b140-6bb75ac7cfe7 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.064675 Sep 10 11:44:13.176065 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e5f5771e-c8c6-49c2-a82a-a26869e172ee tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:13.176360 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e5f5771e-c8c6-49c2-a82a-a26869e172ee tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:13.176902 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 676/1437] 10.222.0.23 () {62 vars in 1199 bytes} [Sat Sep 10 11:44:13 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 69 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 10 11:44:13.177304 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e5f5771e-c8c6-49c2-a82a-a26869e172ee tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:13.178551 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e5f5771e-c8c6-49c2-a82a-a26869e172ee tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:13.179036 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e5f5771e-c8c6-49c2-a82a-a26869e172ee tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:13.180779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e5f5771e-c8c6-49c2-a82a-a26869e172ee tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:13.191057 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bb58f251-3029-4912-a352-7d553a26289b tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Action: 'create', calling method: .version_select at 0x7f40733f6550>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-768133424", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA0yoiEnhTaJdbT/OKbv4+jGYlsmtwUu52KMrc5IGhd6cuHJ4SXiwl0Q+MbivEL4ylKO+awAcJiMsanvnuniEzeZCkmyo7VHfO3hKjpEiq7JqGych9iaO5/vhl9fdgK4NQ=="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:13.220916 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-bb58f251-3029-4912-a352-7d553a26289b tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Getting quotas for project 33ba2169064e4c1e9a077f9111ac6345. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:44:13.231266 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-bb58f251-3029-4912-a352-7d553a26289b tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Getting quotas for user 8270c6cc04f54b8382808457ba6b7e07 and project 33ba2169064e4c1e9a077f9111ac6345. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:44:13.261679 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bb58f251-3029-4912-a352-7d553a26289b tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.074963 Sep 10 11:44:13.269176 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 677/1438] 10.222.0.23 () {62 vars in 1199 bytes} [Sat Sep 10 11:44:13 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 83 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Sep 10 11:44:13.275974 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-934a3ee4-c2fc-4f49-a289-4fb5c67638e3 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Calling method '.version_select at 0x7f4073395f70>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:13.280482 n-d-856895-1 devstack@n-api.service[128776]: WARNING oslo_db.sqlalchemy.utils [None req-934a3ee4-c2fc-4f49-a289-4fb5c67638e3 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 10 11:44:13.289324 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-934a3ee4-c2fc-4f49-a289-4fb5c67638e3 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 1139 microversion: 2.2 time: 0.018382 Sep 10 11:44:13.297360 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 678/1439] 10.222.0.23 () {60 vars in 1177 bytes} [Sat Sep 10 11:44:13 2022] GET /compute/v2.1/os-keypairs => generated 1139 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:13.303754 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-74f26a92-3da3-4b3f-b166-1c374b503e56 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Calling method '.version_select at 0x7f40733858b0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:13.340474 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-74f26a92-3da3-4b3f-b166-1c374b503e56 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-768133424" status: 204 len: 0 microversion: 2.2 time: 0.041519 Sep 10 11:44:13.344770 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 679/1440] 10.222.0.23 () {60 vars in 1318 bytes} [Sat Sep 10 11:44:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-768133424 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:44:13.350756 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5dea6c59-3f95-41b7-988e-e2d532d8aecf tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Calling method '.version_select at 0x7f40733f6280>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:13.386338 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5dea6c59-3f95-41b7-988e-e2d532d8aecf tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-392959520" status: 204 len: 0 microversion: 2.2 time: 0.040171 Sep 10 11:44:13.387364 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 680/1441] 10.222.0.23 () {60 vars in 1318 bytes} [Sat Sep 10 11:44:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-392959520 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:44:13.399336 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c2c8e933-0be0-49b0-8fb3-77fbcd29e65e tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Calling method '.version_select at 0x7f4073385820>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:13.426331 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c2c8e933-0be0-49b0-8fb3-77fbcd29e65e tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-137021932" status: 204 len: 0 microversion: 2.2 time: 0.033597 Sep 10 11:44:13.434613 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 681/1442] 10.222.0.23 () {60 vars in 1318 bytes} [Sat Sep 10 11:44:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-137021932 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:44:13.440527 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d9b29527-4e04-4707-bffc-b6dcb6a599f8 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Action: 'create', calling method: .version_select at 0x7f407352f160>, body: {"keypair": {"name": "tempest-keypair-421231582", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2lwxP9RNLdrVVIx2M3bX/mfF8d4B/qrkRLx6ReMRCut5v9+sh49z8gabZ9nBRleZ1rnTgxCFl9RMbiPMsih9yC4f7E10ihAFPPxiGZHVLdxTcQ2VBWuNKKfU0Yy4YJJw=="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:13.460864 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-d9b29527-4e04-4707-bffc-b6dcb6a599f8 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Getting quotas for project 33ba2169064e4c1e9a077f9111ac6345. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:44:13.467084 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-d9b29527-4e04-4707-bffc-b6dcb6a599f8 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Getting quotas for user 8270c6cc04f54b8382808457ba6b7e07 and project 33ba2169064e4c1e9a077f9111ac6345. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:44:13.471427 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=4,nova_api:INSERT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:44:13.508069 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d9b29527-4e04-4707-bffc-b6dcb6a599f8 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.070516 Sep 10 11:44:13.508990 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 682/1443] 10.222.0.23 () {62 vars in 1199 bytes} [Sat Sep 10 11:44:13 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 74 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 10 11:44:13.522948 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8df4fcf6-7d65-4d3e-9355-cde087f5d53c tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Calling method '.version_select at 0x7f4073541940>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:13.534302 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8df4fcf6-7d65-4d3e-9355-cde087f5d53c tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-421231582" status: 200 len: 512 microversion: 2.2 time: 0.016604 Sep 10 11:44:13.541864 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 683/1444] 10.222.0.23 () {60 vars in 1255 bytes} [Sat Sep 10 11:44:13 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-421231582 => generated 512 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:44:13.548936 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6b3b3a26-43d0-4ffe-8f35-bfc56d69e196 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Calling method '.version_select at 0x7f40734533a0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:13.553947 n-d-856895-1 devstack@n-api.service[128776]: WARNING oslo_db.sqlalchemy.utils [None req-6b3b3a26-43d0-4ffe-8f35-bfc56d69e196 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 10 11:44:13.559874 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6b3b3a26-43d0-4ffe-8f35-bfc56d69e196 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.016656 Sep 10 11:44:13.566374 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 684/1445] 10.222.0.23 () {60 vars in 1177 bytes} [Sat Sep 10 11:44:13 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:44:13.585843 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3f6ba148-deaf-49d6-b923-1437a2dd3241 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Calling method '.version_select at 0x7f40733853a0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:13.612065 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e5f5771e-c8c6-49c2-a82a-a26869e172ee tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:13.624596 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3f6ba148-deaf-49d6-b923-1437a2dd3241 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-421231582" status: 204 len: 0 microversion: 2.2 time: 0.051489 Sep 10 11:44:13.625240 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 685/1446] 10.222.0.23 () {60 vars in 1258 bytes} [Sat Sep 10 11:44:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-421231582 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:44:13.635082 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-971e80e0-1603-44ea-abf9-f0b350f0cbf8 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Action: 'create', calling method: .version_select at 0x7f40733f6670>, body: {"keypair": {"name": "tempest-keypair-1985025397", "type": "x509"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:13.636680 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e5f5771e-c8c6-49c2-a82a-a26869e172ee tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:13.640972 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e5f5771e-c8c6-49c2-a82a-a26869e172ee tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:13.642229 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e5f5771e-c8c6-49c2-a82a-a26869e172ee tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1811 microversion: 2.25 time: 0.488276 Sep 10 11:44:13.642787 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 762/1447] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:13 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1811 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:44:13.654123 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-971e80e0-1603-44ea-abf9-f0b350f0cbf8 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Getting quotas for project 33ba2169064e4c1e9a077f9111ac6345. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:44:13.659221 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-971e80e0-1603-44ea-abf9-f0b350f0cbf8 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Getting quotas for user 8270c6cc04f54b8382808457ba6b7e07 and project 33ba2169064e4c1e9a077f9111ac6345. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:44:13.697235 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.processutils [None req-971e80e0-1603-44ea-abf9-f0b350f0cbf8 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpy5dc2rzw/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpy5dc2rzw/temp.key -subj /CN=8270c6cc04f54b8382808457ba6b7e07 -extensions v3_req_client {{(pid=128776) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 10 11:44:13.838506 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b13219e4-ca5e-408e-a5ee-d67b073a884f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:13.839263 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b13219e4-ca5e-408e-a5ee-d67b073a884f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:13.851010 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b13219e4-ca5e-408e-a5ee-d67b073a884f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:13.854046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b13219e4-ca5e-408e-a5ee-d67b073a884f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:13.854499 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b13219e4-ca5e-408e-a5ee-d67b073a884f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:13.855261 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b13219e4-ca5e-408e-a5ee-d67b073a884f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:13.855731 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b13219e4-ca5e-408e-a5ee-d67b073a884f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:13.856163 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b13219e4-ca5e-408e-a5ee-d67b073a884f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:13.912548 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.processutils [None req-971e80e0-1603-44ea-abf9-f0b350f0cbf8 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpy5dc2rzw/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpy5dc2rzw/temp.key -subj /CN=8270c6cc04f54b8382808457ba6b7e07 -extensions v3_req_client" returned: 0 in 0.215s {{(pid=128776) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 10 11:44:13.918609 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.processutils [None req-971e80e0-1603-44ea-abf9-f0b350f0cbf8 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpy5dc2rzw/temp.key -password pass: {{(pid=128776) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 10 11:44:13.976717 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.processutils [None req-971e80e0-1603-44ea-abf9-f0b350f0cbf8 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpy5dc2rzw/temp.key -password pass:" returned: 0 in 0.060s {{(pid=128776) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 10 11:44:14.061218 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-971e80e0-1603-44ea-abf9-f0b350f0cbf8 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Getting quotas for project 33ba2169064e4c1e9a077f9111ac6345. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:44:14.072203 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-971e80e0-1603-44ea-abf9-f0b350f0cbf8 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Getting quotas for user 8270c6cc04f54b8382808457ba6b7e07 and project 33ba2169064e4c1e9a077f9111ac6345. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:44:14.116010 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-971e80e0-1603-44ea-abf9-f0b350f0cbf8 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.484448 Sep 10 11:44:14.117306 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 686/1448] 10.222.0.23 () {62 vars in 1198 bytes} [Sat Sep 10 11:44:13 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 487 msecs (HTTP/1.1 201) 9 headers in 363 bytes (2 switches on core 0) Sep 10 11:44:14.136157 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0a545844-7eb2-4d53-bd5a-e2741fca43ac tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:14.137233 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0a545844-7eb2-4d53-bd5a-e2741fca43ac tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:14.157602 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0a545844-7eb2-4d53-bd5a-e2741fca43ac tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:14.158178 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0a545844-7eb2-4d53-bd5a-e2741fca43ac tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:14.158636 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0a545844-7eb2-4d53-bd5a-e2741fca43ac tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:14.159468 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0a545844-7eb2-4d53-bd5a-e2741fca43ac tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:14.160165 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0a545844-7eb2-4d53-bd5a-e2741fca43ac tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:14.160600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0a545844-7eb2-4d53-bd5a-e2741fca43ac tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:14.187186 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:44:14.463269 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b13219e4-ca5e-408e-a5ee-d67b073a884f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:14.482119 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b13219e4-ca5e-408e-a5ee-d67b073a884f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:14.488091 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b13219e4-ca5e-408e-a5ee-d67b073a884f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:14.489479 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b13219e4-ca5e-408e-a5ee-d67b073a884f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1849 microversion: 2.42 time: 0.655591 Sep 10 11:44:14.515885 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 763/1449] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:13 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1849 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:44:14.528068 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0f4b62f6-61cf-4121-b1cc-bd2b8b7870a6 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Calling method '.version_select at 0x7f407369f310>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:14.558214 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0f4b62f6-61cf-4121-b1cc-bd2b8b7870a6 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-1985025397" status: 200 len: 1534 microversion: 2.2 time: 0.038146 Sep 10 11:44:14.558871 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 764/1450] 10.222.0.23 () {60 vars in 1258 bytes} [Sat Sep 10 11:44:14 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1985025397 => generated 1534 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:14.573780 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e35a9d89-f6e4-4721-a071-d4e134f93526 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Calling method '.version_select at 0x7f4073b95790>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:14.588548 n-d-856895-1 devstack@n-api.service[128777]: WARNING oslo_db.sqlalchemy.utils [None req-e35a9d89-f6e4-4721-a071-d4e134f93526 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 10 11:44:14.611940 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e35a9d89-f6e4-4721-a071-d4e134f93526 tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.041847 Sep 10 11:44:14.612911 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 765/1451] 10.222.0.23 () {60 vars in 1177 bytes} [Sat Sep 10 11:44:14 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:14.649381 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1c86af3f-d3fd-4a8c-9d3c-75614205c09e tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] Calling method '.version_select at 0x7f4073244430>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:14.684295 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1c86af3f-d3fd-4a8c-9d3c-75614205c09e tempest-KeyPairsV22TestJSON-976437772 tempest-KeyPairsV22TestJSON-976437772-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1985025397" status: 204 len: 0 microversion: 2.2 time: 0.058041 Sep 10 11:44:14.685782 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 766/1452] 10.222.0.23 () {60 vars in 1261 bytes} [Sat Sep 10 11:44:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1985025397 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:44:14.695149 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cae931c0-deee-4678-9794-382cc5e6bb3a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:14.696130 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cae931c0-deee-4678-9794-382cc5e6bb3a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:14.704685 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cae931c0-deee-4678-9794-382cc5e6bb3a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:14.705333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cae931c0-deee-4678-9794-382cc5e6bb3a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:14.705898 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cae931c0-deee-4678-9794-382cc5e6bb3a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:14.706893 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cae931c0-deee-4678-9794-382cc5e6bb3a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:14.707483 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cae931c0-deee-4678-9794-382cc5e6bb3a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:14.708420 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cae931c0-deee-4678-9794-382cc5e6bb3a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:14.743766 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:44:14.859251 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0a545844-7eb2-4d53-bd5a-e2741fca43ac tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:14.874155 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0a545844-7eb2-4d53-bd5a-e2741fca43ac tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1210 microversion: 2.1 time: 0.755259 Sep 10 11:44:14.875678 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 687/1453] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:14 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1210 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:15.342868 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cae931c0-deee-4678-9794-382cc5e6bb3a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:15.365562 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cae931c0-deee-4678-9794-382cc5e6bb3a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:15.375667 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cae931c0-deee-4678-9794-382cc5e6bb3a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:15.380062 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cae931c0-deee-4678-9794-382cc5e6bb3a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1811 microversion: 2.25 time: 0.691264 Sep 10 11:44:15.399691 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 767/1454] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:14 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1811 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:44:15.524922 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-26f15326-95ac-41a0-98b0-8befae5b0aab tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:15.526923 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-26f15326-95ac-41a0-98b0-8befae5b0aab tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:15.547351 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-26f15326-95ac-41a0-98b0-8befae5b0aab tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:15.547921 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-26f15326-95ac-41a0-98b0-8befae5b0aab tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:15.548385 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-26f15326-95ac-41a0-98b0-8befae5b0aab tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:15.549175 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-26f15326-95ac-41a0-98b0-8befae5b0aab tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:15.549645 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-26f15326-95ac-41a0-98b0-8befae5b0aab tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:15.552770 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-26f15326-95ac-41a0-98b0-8befae5b0aab tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:15.923693 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-54281dbb-da83-48bd-8fa0-637f78a69f69 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:15.926077 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-54281dbb-da83-48bd-8fa0-637f78a69f69 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:15.956547 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-26f15326-95ac-41a0-98b0-8befae5b0aab tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:15.964821 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54281dbb-da83-48bd-8fa0-637f78a69f69 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:15.966999 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54281dbb-da83-48bd-8fa0-637f78a69f69 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:15.969905 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54281dbb-da83-48bd-8fa0-637f78a69f69 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:15.971208 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54281dbb-da83-48bd-8fa0-637f78a69f69 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:15.972959 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54281dbb-da83-48bd-8fa0-637f78a69f69 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:15.973676 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54281dbb-da83-48bd-8fa0-637f78a69f69 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:15.978886 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-26f15326-95ac-41a0-98b0-8befae5b0aab tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:15.981203 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-26f15326-95ac-41a0-98b0-8befae5b0aab tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:15.982872 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-26f15326-95ac-41a0-98b0-8befae5b0aab tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1849 microversion: 2.42 time: 0.464210 Sep 10 11:44:16.000320 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 688/1455] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:15 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1849 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:44:16.018401 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-5c9f49ab-7c66-453e-87b8-5d232bbd3636 req-59a88f18-79cd-45c1-b44f-115e98e8c8ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cb195e0-436b-4ffc-8819-fdac586f6896", "tag": "b191a802-e810-409f-980f-c88296d62dea"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:16.046013 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-5c9f49ab-7c66-453e-87b8-5d232bbd3636 req-59a88f18-79cd-45c1-b44f-115e98e8c8ce service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:16.046803 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-5c9f49ab-7c66-453e-87b8-5d232bbd3636 req-59a88f18-79cd-45c1-b44f-115e98e8c8ce service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:16.049080 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-5c9f49ab-7c66-453e-87b8-5d232bbd3636 req-59a88f18-79cd-45c1-b44f-115e98e8c8ce service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:16.074373 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-5c9f49ab-7c66-453e-87b8-5d232bbd3636 req-59a88f18-79cd-45c1-b44f-115e98e8c8ce service nova] Creating event network-changed:b191a802-e810-409f-980f-c88296d62dea for instance 6cb195e0-436b-4ffc-8819-fdac586f6896 on n-h2-856895-1 Sep 10 11:44:16.092032 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-5c9f49ab-7c66-453e-87b8-5d232bbd3636 req-59a88f18-79cd-45c1-b44f-115e98e8c8ce service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087352 Sep 10 11:44:16.093995 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 689/1456] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:44:16.414535 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4920ac08-f2d9-46ac-b280-522e685164b0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:16.415268 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4920ac08-f2d9-46ac-b280-522e685164b0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:16.422380 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4920ac08-f2d9-46ac-b280-522e685164b0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:16.423292 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4920ac08-f2d9-46ac-b280-522e685164b0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:16.423936 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4920ac08-f2d9-46ac-b280-522e685164b0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:16.424882 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4920ac08-f2d9-46ac-b280-522e685164b0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:16.425515 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4920ac08-f2d9-46ac-b280-522e685164b0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:16.427139 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4920ac08-f2d9-46ac-b280-522e685164b0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:16.474656 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-54281dbb-da83-48bd-8fa0-637f78a69f69 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:16.489393 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-54281dbb-da83-48bd-8fa0-637f78a69f69 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1210 microversion: 2.1 time: 0.583163 Sep 10 11:44:16.491437 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 768/1457] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:15 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1210 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:16.859780 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4920ac08-f2d9-46ac-b280-522e685164b0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:16.876012 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4920ac08-f2d9-46ac-b280-522e685164b0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:16.878072 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4920ac08-f2d9-46ac-b280-522e685164b0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:16.879746 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4920ac08-f2d9-46ac-b280-522e685164b0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1811 microversion: 2.25 time: 0.470995 Sep 10 11:44:16.881226 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 690/1458] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:16 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1811 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:44:17.016240 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b581e80f-faaa-4593-8f46-c17650489a8f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:17.017146 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b581e80f-faaa-4593-8f46-c17650489a8f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:17.025410 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b581e80f-faaa-4593-8f46-c17650489a8f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:17.026180 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b581e80f-faaa-4593-8f46-c17650489a8f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:17.026827 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b581e80f-faaa-4593-8f46-c17650489a8f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:17.027779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b581e80f-faaa-4593-8f46-c17650489a8f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:17.028413 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b581e80f-faaa-4593-8f46-c17650489a8f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:17.029017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b581e80f-faaa-4593-8f46-c17650489a8f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:17.393900 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b581e80f-faaa-4593-8f46-c17650489a8f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:17.408010 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b581e80f-faaa-4593-8f46-c17650489a8f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:17.409739 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b581e80f-faaa-4593-8f46-c17650489a8f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:17.412592 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b581e80f-faaa-4593-8f46-c17650489a8f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1849 microversion: 2.42 time: 0.399712 Sep 10 11:44:17.413812 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 769/1459] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:17 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1849 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:44:17.519953 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4300da4c-4fa9-4663-bb6b-953dd6bf2f34 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:17.523336 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4300da4c-4fa9-4663-bb6b-953dd6bf2f34 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:17.531924 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4300da4c-4fa9-4663-bb6b-953dd6bf2f34 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:17.537862 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4300da4c-4fa9-4663-bb6b-953dd6bf2f34 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:17.538635 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4300da4c-4fa9-4663-bb6b-953dd6bf2f34 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:17.539656 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4300da4c-4fa9-4663-bb6b-953dd6bf2f34 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:17.540622 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4300da4c-4fa9-4663-bb6b-953dd6bf2f34 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:17.541435 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4300da4c-4fa9-4663-bb6b-953dd6bf2f34 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:17.862694 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4300da4c-4fa9-4663-bb6b-953dd6bf2f34 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:17.874674 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4300da4c-4fa9-4663-bb6b-953dd6bf2f34 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1210 microversion: 2.1 time: 0.362375 Sep 10 11:44:17.875697 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 691/1460] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:17 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1210 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:17.906032 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-47ee8d67-c805-4097-bb3d-fbe65f3e3d55 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:17.906810 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-47ee8d67-c805-4097-bb3d-fbe65f3e3d55 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:17.916450 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47ee8d67-c805-4097-bb3d-fbe65f3e3d55 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:17.919299 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47ee8d67-c805-4097-bb3d-fbe65f3e3d55 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:17.919760 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47ee8d67-c805-4097-bb3d-fbe65f3e3d55 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:17.922053 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47ee8d67-c805-4097-bb3d-fbe65f3e3d55 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:17.922926 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47ee8d67-c805-4097-bb3d-fbe65f3e3d55 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:17.924525 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47ee8d67-c805-4097-bb3d-fbe65f3e3d55 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:18.171458 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-fc1171e1-1651-430b-a53d-ebf9c9c42642 req-491fb175-b98e-4ea6-916b-5cadfe0eef54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a", "tag": "63ec6435-27f2-4584-83e7-993fffb3189b"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:18.196234 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-fc1171e1-1651-430b-a53d-ebf9c9c42642 req-491fb175-b98e-4ea6-916b-5cadfe0eef54 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:18.196735 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-fc1171e1-1651-430b-a53d-ebf9c9c42642 req-491fb175-b98e-4ea6-916b-5cadfe0eef54 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:18.197180 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-fc1171e1-1651-430b-a53d-ebf9c9c42642 req-491fb175-b98e-4ea6-916b-5cadfe0eef54 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:18.231713 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-fc1171e1-1651-430b-a53d-ebf9c9c42642 req-491fb175-b98e-4ea6-916b-5cadfe0eef54 service nova] Creating event network-changed:63ec6435-27f2-4584-83e7-993fffb3189b for instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a on n-h1-856895-1 Sep 10 11:44:18.238615 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-fc1171e1-1651-430b-a53d-ebf9c9c42642 req-491fb175-b98e-4ea6-916b-5cadfe0eef54 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078782 Sep 10 11:44:18.245630 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 692/1461] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:44:18.440596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ea860f39-3e46-4b2a-9ad4-ebee34075ae1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:18.441401 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ea860f39-3e46-4b2a-9ad4-ebee34075ae1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:18.459196 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea860f39-3e46-4b2a-9ad4-ebee34075ae1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:18.460121 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea860f39-3e46-4b2a-9ad4-ebee34075ae1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:18.460753 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea860f39-3e46-4b2a-9ad4-ebee34075ae1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:18.463381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea860f39-3e46-4b2a-9ad4-ebee34075ae1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:18.464071 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea860f39-3e46-4b2a-9ad4-ebee34075ae1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:18.466730 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea860f39-3e46-4b2a-9ad4-ebee34075ae1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:19.266337 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-47ee8d67-c805-4097-bb3d-fbe65f3e3d55 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:19.294173 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-47ee8d67-c805-4097-bb3d-fbe65f3e3d55 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:19.301779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-47ee8d67-c805-4097-bb3d-fbe65f3e3d55 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:19.307317 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-47ee8d67-c805-4097-bb3d-fbe65f3e3d55 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1811 microversion: 2.25 time: 1.402616 Sep 10 11:44:19.311095 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 770/1462] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:17 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1811 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:44:19.324191 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5eee976e-c5cb-42b3-bbd7-06b9a4693aca tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:19.327681 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5eee976e-c5cb-42b3-bbd7-06b9a4693aca tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:19.344854 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5eee976e-c5cb-42b3-bbd7-06b9a4693aca tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:19.345737 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5eee976e-c5cb-42b3-bbd7-06b9a4693aca tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:19.348503 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5eee976e-c5cb-42b3-bbd7-06b9a4693aca tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:19.350932 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5eee976e-c5cb-42b3-bbd7-06b9a4693aca tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:19.351643 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5eee976e-c5cb-42b3-bbd7-06b9a4693aca tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:19.353282 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5eee976e-c5cb-42b3-bbd7-06b9a4693aca tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:19.375694 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ea860f39-3e46-4b2a-9ad4-ebee34075ae1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:19.403657 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ea860f39-3e46-4b2a-9ad4-ebee34075ae1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:19.406867 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ea860f39-3e46-4b2a-9ad4-ebee34075ae1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:19.411659 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ea860f39-3e46-4b2a-9ad4-ebee34075ae1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1870 microversion: 2.42 time: 0.975997 Sep 10 11:44:19.417632 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 693/1463] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:18 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1870 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:44:19.436849 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c85b4107-36bb-433d-81b6-6c40115f362a tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Calling method '.version_select at 0x7f40733d1dc0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:19.456916 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c85b4107-36bb-433d-81b6-6c40115f362a tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:19.459820 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c85b4107-36bb-433d-81b6-6c40115f362a tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:19.462752 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c85b4107-36bb-433d-81b6-6c40115f362a tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:19.508687 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c85b4107-36bb-433d-81b6-6c40115f362a tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 3104 microversion: 2.1 time: 0.088038 Sep 10 11:44:19.511896 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 694/1464] 10.222.0.23 () {58 vars in 1143 bytes} [Sat Sep 10 11:44:19 2022] GET /compute/v2.1/os-migrations => generated 3104 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:19.539777 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5b2cce00-b834-45e1-84fb-70a64d99d518 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:19.548413 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5b2cce00-b834-45e1-84fb-70a64d99d518 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013159 Sep 10 11:44:19.557700 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 695/1465] 10.222.0.23 () {58 vars in 1137 bytes} [Sat Sep 10 11:44:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:44:19.565722 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-139a1aea-a4ba-4420-842d-0b70f38ee3ee tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-252566354", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:19.597329 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-139a1aea-a4ba-4420-842d-0b70f38ee3ee tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.038021 Sep 10 11:44:19.606739 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 696/1466] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Sep 10 11:44:19 2022] POST /compute/v2.1/flavors => generated 498 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:44:19.613316 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-36b64d95-f4f3-4a53-b105-d150bde6a178 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:19.622949 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-36b64d95-f4f3-4a53-b105-d150bde6a178 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.014556 Sep 10 11:44:19.636258 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 697/1467] 10.222.0.23 () {58 vars in 1182 bytes} [Sat Sep 10 11:44:19 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:44:19.776672 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cadc333e-4955-4b02-9e6b-aeac3ecf32b4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-621917055", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "45bea006-62ce-446f-ad0c-86a8cd9d916d"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:19.845343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-cadc333e-4955-4b02-9e6b-aeac3ecf32b4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] validate_networks() for None {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:44:20.009587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5eee976e-c5cb-42b3-bbd7-06b9a4693aca tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:20.020550 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5eee976e-c5cb-42b3-bbd7-06b9a4693aca tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1210 microversion: 2.1 time: 0.706420 Sep 10 11:44:20.021982 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 771/1468] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:19 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1210 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:20.343769 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4507a1b1-8361-4cd6-8e0d-70e19abb3edb tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:20.345118 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4507a1b1-8361-4cd6-8e0d-70e19abb3edb tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:20.360662 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4507a1b1-8361-4cd6-8e0d-70e19abb3edb tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:20.361453 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4507a1b1-8361-4cd6-8e0d-70e19abb3edb tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:20.362105 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4507a1b1-8361-4cd6-8e0d-70e19abb3edb tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:20.363441 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4507a1b1-8361-4cd6-8e0d-70e19abb3edb tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:20.367695 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4507a1b1-8361-4cd6-8e0d-70e19abb3edb tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:20.368372 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4507a1b1-8361-4cd6-8e0d-70e19abb3edb tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:21.143008 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-cadc333e-4955-4b02-9e6b-aeac3ecf32b4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:44:21.144091 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4507a1b1-8361-4cd6-8e0d-70e19abb3edb tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:21.144261 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-cadc333e-4955-4b02-9e6b-aeac3ecf32b4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:44:21.146408 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-cadc333e-4955-4b02-9e6b-aeac3ecf32b4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:44:21.148027 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-cadc333e-4955-4b02-9e6b-aeac3ecf32b4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:44:21.149127 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-cadc333e-4955-4b02-9e6b-aeac3ecf32b4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:44:21.164741 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4507a1b1-8361-4cd6-8e0d-70e19abb3edb tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:21.167060 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4507a1b1-8361-4cd6-8e0d-70e19abb3edb tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:21.171138 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4507a1b1-8361-4cd6-8e0d-70e19abb3edb tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1811 microversion: 2.25 time: 0.831370 Sep 10 11:44:21.173754 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cadc333e-4955-4b02-9e6b-aeac3ecf32b4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:21.174241 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cadc333e-4955-4b02-9e6b-aeac3ecf32b4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:21.174630 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 772/1469] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:20 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1811 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:44:21.174788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cadc333e-4955-4b02-9e6b-aeac3ecf32b4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:21.177370 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cadc333e-4955-4b02-9e6b-aeac3ecf32b4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:21.180232 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cadc333e-4955-4b02-9e6b-aeac3ecf32b4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:21.180880 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cadc333e-4955-4b02-9e6b-aeac3ecf32b4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:21.182588 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4ba484db-b2e6-4450-8f3d-c5ca27bba17d tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:21.185757 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4ba484db-b2e6-4450-8f3d-c5ca27bba17d tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:21.198162 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ba484db-b2e6-4450-8f3d-c5ca27bba17d tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:21.204801 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ba484db-b2e6-4450-8f3d-c5ca27bba17d tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:21.205602 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ba484db-b2e6-4450-8f3d-c5ca27bba17d tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:21.206698 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ba484db-b2e6-4450-8f3d-c5ca27bba17d tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:21.207606 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ba484db-b2e6-4450-8f3d-c5ca27bba17d tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:21.209121 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ba484db-b2e6-4450-8f3d-c5ca27bba17d tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:21.236053 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-cadc333e-4955-4b02-9e6b-aeac3ecf32b4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Getting quotas for project 7b37b36096cd42f6b6568ff9eee2751c. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:44:21.244299 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-cadc333e-4955-4b02-9e6b-aeac3ecf32b4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Getting quotas for user 77d854474f4c4481ac407a76b4627c69 and project 7b37b36096cd42f6b6568ff9eee2751c. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:44:21.305977 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cadc333e-4955-4b02-9e6b-aeac3ecf32b4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:44:21.318058 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cadc333e-4955-4b02-9e6b-aeac3ecf32b4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:44:21.414346 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cadc333e-4955-4b02-9e6b-aeac3ecf32b4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.632548 Sep 10 11:44:21.421734 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 698/1470] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:44:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:44:21.428641 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-cba7b7ad-13d0-4ceb-9784-c9a42d75d03c req-23c1e878-dca7-4e38-8e56-376fca4f6b34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a", "tag": "1fe87fac-c7e8-4ff7-858b-ab19c862196d"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:21.459431 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-cba7b7ad-13d0-4ceb-9784-c9a42d75d03c req-23c1e878-dca7-4e38-8e56-376fca4f6b34 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:21.459954 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-cba7b7ad-13d0-4ceb-9784-c9a42d75d03c req-23c1e878-dca7-4e38-8e56-376fca4f6b34 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:21.460397 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-cba7b7ad-13d0-4ceb-9784-c9a42d75d03c req-23c1e878-dca7-4e38-8e56-376fca4f6b34 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:21.485551 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-cba7b7ad-13d0-4ceb-9784-c9a42d75d03c req-23c1e878-dca7-4e38-8e56-376fca4f6b34 service nova] Creating event network-changed:1fe87fac-c7e8-4ff7-858b-ab19c862196d for instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a on n-h1-856895-1 Sep 10 11:44:21.502299 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-cba7b7ad-13d0-4ceb-9784-c9a42d75d03c req-23c1e878-dca7-4e38-8e56-376fca4f6b34 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075268 Sep 10 11:44:21.503375 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 699/1471] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:44:21.541046 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9a3cfa42-7136-49c6-a92c-5647b30fd229 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:21.544853 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9a3cfa42-7136-49c6-a92c-5647b30fd229 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:21.564150 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a3cfa42-7136-49c6-a92c-5647b30fd229 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:21.564751 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a3cfa42-7136-49c6-a92c-5647b30fd229 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:21.565207 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a3cfa42-7136-49c6-a92c-5647b30fd229 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:21.568796 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a3cfa42-7136-49c6-a92c-5647b30fd229 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:21.569302 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a3cfa42-7136-49c6-a92c-5647b30fd229 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:21.573016 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a3cfa42-7136-49c6-a92c-5647b30fd229 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:22.198830 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4ba484db-b2e6-4450-8f3d-c5ca27bba17d tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:22.212203 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4ba484db-b2e6-4450-8f3d-c5ca27bba17d tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:22.218214 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4ba484db-b2e6-4450-8f3d-c5ca27bba17d tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:22.220130 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4ba484db-b2e6-4450-8f3d-c5ca27bba17d tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1870 microversion: 2.42 time: 1.043851 Sep 10 11:44:22.225852 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 773/1472] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:21 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1870 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:44:22.239482 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fbb5b870-627a-45f3-b9d2-62b5876c3966 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:22.239482 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fbb5b870-627a-45f3-b9d2-62b5876c3966 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:22.261094 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fbb5b870-627a-45f3-b9d2-62b5876c3966 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:22.264276 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fbb5b870-627a-45f3-b9d2-62b5876c3966 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:22.264854 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fbb5b870-627a-45f3-b9d2-62b5876c3966 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:22.267822 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fbb5b870-627a-45f3-b9d2-62b5876c3966 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:22.268369 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fbb5b870-627a-45f3-b9d2-62b5876c3966 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:22.270531 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fbb5b870-627a-45f3-b9d2-62b5876c3966 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:22.680853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fbb5b870-627a-45f3-b9d2-62b5876c3966 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:22.695132 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fbb5b870-627a-45f3-b9d2-62b5876c3966 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1282 microversion: 2.1 time: 0.468038 Sep 10 11:44:22.698926 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 774/1473] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:22 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1282 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:22.715733 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-71dcce4d-82e3-42d7-8ce8-46f727dbd0c4 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:22.716636 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-71dcce4d-82e3-42d7-8ce8-46f727dbd0c4 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:22.732411 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71dcce4d-82e3-42d7-8ce8-46f727dbd0c4 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:22.734061 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71dcce4d-82e3-42d7-8ce8-46f727dbd0c4 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:22.734770 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71dcce4d-82e3-42d7-8ce8-46f727dbd0c4 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:22.740485 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71dcce4d-82e3-42d7-8ce8-46f727dbd0c4 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:22.741724 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71dcce4d-82e3-42d7-8ce8-46f727dbd0c4 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:22.742344 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71dcce4d-82e3-42d7-8ce8-46f727dbd0c4 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:22.753483 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9a3cfa42-7136-49c6-a92c-5647b30fd229 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:22.772754 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9a3cfa42-7136-49c6-a92c-5647b30fd229 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1198 microversion: 2.1 time: 1.266891 Sep 10 11:44:22.776446 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 700/1474] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:21 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1198 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:23.073390 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=24 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:44:23.258066 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-67133644-791a-4f5a-be4d-bb9c695e9dda tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:23.258959 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-67133644-791a-4f5a-be4d-bb9c695e9dda tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:23.275878 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67133644-791a-4f5a-be4d-bb9c695e9dda tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:23.276897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67133644-791a-4f5a-be4d-bb9c695e9dda tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:23.278490 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67133644-791a-4f5a-be4d-bb9c695e9dda tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:23.279586 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67133644-791a-4f5a-be4d-bb9c695e9dda tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:23.282417 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67133644-791a-4f5a-be4d-bb9c695e9dda tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:23.283365 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67133644-791a-4f5a-be4d-bb9c695e9dda tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:24.055022 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-71dcce4d-82e3-42d7-8ce8-46f727dbd0c4 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:24.071361 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-71dcce4d-82e3-42d7-8ce8-46f727dbd0c4 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:24.075036 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-71dcce4d-82e3-42d7-8ce8-46f727dbd0c4 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:24.081077 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-71dcce4d-82e3-42d7-8ce8-46f727dbd0c4 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1811 microversion: 2.25 time: 1.378793 Sep 10 11:44:24.084470 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 775/1475] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:22 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1811 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:44:24.105877 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-34747be9-2901-4a87-b4d1-9dfdc3c1fad3 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:24.121700 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-34747be9-2901-4a87-b4d1-9dfdc3c1fad3 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:24.137483 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-34747be9-2901-4a87-b4d1-9dfdc3c1fad3 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:24.139258 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-34747be9-2901-4a87-b4d1-9dfdc3c1fad3 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:24.140392 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-34747be9-2901-4a87-b4d1-9dfdc3c1fad3 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:24.141340 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-34747be9-2901-4a87-b4d1-9dfdc3c1fad3 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:24.142745 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-34747be9-2901-4a87-b4d1-9dfdc3c1fad3 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:24.143754 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-34747be9-2901-4a87-b4d1-9dfdc3c1fad3 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:24.188550 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-67133644-791a-4f5a-be4d-bb9c695e9dda tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:24.203819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-67133644-791a-4f5a-be4d-bb9c695e9dda tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:24.206362 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-67133644-791a-4f5a-be4d-bb9c695e9dda tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:24.207806 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-67133644-791a-4f5a-be4d-bb9c695e9dda tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1870 microversion: 2.42 time: 0.955523 Sep 10 11:44:24.211731 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 701/1476] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:23 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1870 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:44:24.218985 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f47f3959-35eb-49a4-a72d-243dbebf6367 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:24.221706 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f47f3959-35eb-49a4-a72d-243dbebf6367 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:24.237265 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f47f3959-35eb-49a4-a72d-243dbebf6367 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:24.238075 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f47f3959-35eb-49a4-a72d-243dbebf6367 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:24.238790 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f47f3959-35eb-49a4-a72d-243dbebf6367 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:24.243003 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f47f3959-35eb-49a4-a72d-243dbebf6367 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:24.243885 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f47f3959-35eb-49a4-a72d-243dbebf6367 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:24.244721 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f47f3959-35eb-49a4-a72d-243dbebf6367 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:24.424576 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-34747be9-2901-4a87-b4d1-9dfdc3c1fad3 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:24.440657 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-34747be9-2901-4a87-b4d1-9dfdc3c1fad3 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1336 microversion: 2.1 time: 0.352815 Sep 10 11:44:24.462873 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 776/1477] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:24 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1336 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:24.756158 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f47f3959-35eb-49a4-a72d-243dbebf6367 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:24.767518 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f47f3959-35eb-49a4-a72d-243dbebf6367 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1198 microversion: 2.1 time: 0.553688 Sep 10 11:44:24.768124 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 702/1478] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:24 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1198 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:25.113439 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b15f1343-e6a6-4627-8dfe-df531b613db8 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:25.114069 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b15f1343-e6a6-4627-8dfe-df531b613db8 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:25.138787 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b15f1343-e6a6-4627-8dfe-df531b613db8 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:25.139357 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b15f1343-e6a6-4627-8dfe-df531b613db8 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:25.139795 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b15f1343-e6a6-4627-8dfe-df531b613db8 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:25.140525 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b15f1343-e6a6-4627-8dfe-df531b613db8 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:25.144300 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b15f1343-e6a6-4627-8dfe-df531b613db8 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:25.144973 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b15f1343-e6a6-4627-8dfe-df531b613db8 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:25.241611 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7d38dde8-b731-45cb-a5ca-e6fabab6e509 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:25.242237 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7d38dde8-b731-45cb-a5ca-e6fabab6e509 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:25.253338 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d38dde8-b731-45cb-a5ca-e6fabab6e509 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:25.253846 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d38dde8-b731-45cb-a5ca-e6fabab6e509 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:25.254297 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d38dde8-b731-45cb-a5ca-e6fabab6e509 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:25.255070 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d38dde8-b731-45cb-a5ca-e6fabab6e509 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:25.255568 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d38dde8-b731-45cb-a5ca-e6fabab6e509 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:25.256106 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d38dde8-b731-45cb-a5ca-e6fabab6e509 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:26.086150 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7d38dde8-b731-45cb-a5ca-e6fabab6e509 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:26.105233 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7d38dde8-b731-45cb-a5ca-e6fabab6e509 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:26.109965 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7d38dde8-b731-45cb-a5ca-e6fabab6e509 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:26.128222 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7d38dde8-b731-45cb-a5ca-e6fabab6e509 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1891 microversion: 2.42 time: 0.874971 Sep 10 11:44:26.131690 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 703/1479] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:25 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1891 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:44:26.154284 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-27d4c8e3-1634-46d4-8900-278fb455b77a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:26.154813 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-27d4c8e3-1634-46d4-8900-278fb455b77a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:26.164428 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27d4c8e3-1634-46d4-8900-278fb455b77a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:26.165267 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27d4c8e3-1634-46d4-8900-278fb455b77a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:26.170369 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27d4c8e3-1634-46d4-8900-278fb455b77a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:26.171617 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27d4c8e3-1634-46d4-8900-278fb455b77a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:26.172295 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27d4c8e3-1634-46d4-8900-278fb455b77a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:26.172922 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27d4c8e3-1634-46d4-8900-278fb455b77a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:26.260476 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b15f1343-e6a6-4627-8dfe-df531b613db8 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:26.269782 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b15f1343-e6a6-4627-8dfe-df531b613db8 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:26.271831 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b15f1343-e6a6-4627-8dfe-df531b613db8 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:26.275459 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b15f1343-e6a6-4627-8dfe-df531b613db8 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1811 microversion: 2.25 time: 1.166247 Sep 10 11:44:26.294429 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 777/1480] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:25 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1811 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:44:26.323751 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4bdfc697-2b3c-42d3-aa66-611d66e62479 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:26.326860 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4bdfc697-2b3c-42d3-aa66-611d66e62479 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:26.342520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4bdfc697-2b3c-42d3-aa66-611d66e62479 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:26.342911 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4bdfc697-2b3c-42d3-aa66-611d66e62479 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:26.343611 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4bdfc697-2b3c-42d3-aa66-611d66e62479 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:26.344504 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4bdfc697-2b3c-42d3-aa66-611d66e62479 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:26.346489 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4bdfc697-2b3c-42d3-aa66-611d66e62479 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:26.347943 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4bdfc697-2b3c-42d3-aa66-611d66e62479 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:26.876323 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4bdfc697-2b3c-42d3-aa66-611d66e62479 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:26.894416 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4bdfc697-2b3c-42d3-aa66-611d66e62479 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1198 microversion: 2.1 time: 0.598183 Sep 10 11:44:26.898384 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 778/1481] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:26 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1198 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:26.976001 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-27d4c8e3-1634-46d4-8900-278fb455b77a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:26.997995 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-27d4c8e3-1634-46d4-8900-278fb455b77a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1378 microversion: 2.1 time: 0.864483 Sep 10 11:44:27.012876 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 704/1482] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:26 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1378 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:27.155140 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9a6012a1-5717-40fc-9b76-a046431226d9 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:27.156166 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9a6012a1-5717-40fc-9b76-a046431226d9 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:27.163593 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9a6012a1-5717-40fc-9b76-a046431226d9 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:27.164511 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9a6012a1-5717-40fc-9b76-a046431226d9 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:27.165268 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9a6012a1-5717-40fc-9b76-a046431226d9 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:27.166249 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9a6012a1-5717-40fc-9b76-a046431226d9 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:27.167016 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9a6012a1-5717-40fc-9b76-a046431226d9 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:27.167793 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9a6012a1-5717-40fc-9b76-a046431226d9 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:27.306838 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e13e1da1-4ed2-4b5e-9730-f62786701be3 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:27.307822 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e13e1da1-4ed2-4b5e-9730-f62786701be3 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:27.315248 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e13e1da1-4ed2-4b5e-9730-f62786701be3 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:27.316040 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e13e1da1-4ed2-4b5e-9730-f62786701be3 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:27.316733 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e13e1da1-4ed2-4b5e-9730-f62786701be3 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:27.318474 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e13e1da1-4ed2-4b5e-9730-f62786701be3 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:27.319352 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e13e1da1-4ed2-4b5e-9730-f62786701be3 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:27.320004 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e13e1da1-4ed2-4b5e-9730-f62786701be3 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:27.905068 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e13e1da1-4ed2-4b5e-9730-f62786701be3 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:27.922208 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e13e1da1-4ed2-4b5e-9730-f62786701be3 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:27.927294 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e13e1da1-4ed2-4b5e-9730-f62786701be3 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:27.931503 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e13e1da1-4ed2-4b5e-9730-f62786701be3 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1801 microversion: 2.25 time: 0.626938 Sep 10 11:44:27.935966 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 705/1483] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:27 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1801 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:44:27.951123 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-b284b909-1864-4973-81fc-e91c02715df9 req-891e4e57-6a89-4f8e-a6b4-2cd6a31dce5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a", "tag": "22d4e712-b79b-4d38-8916-a0128c576b77"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:27.966386 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-b284b909-1864-4973-81fc-e91c02715df9 req-891e4e57-6a89-4f8e-a6b4-2cd6a31dce5f service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:27.967115 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-b284b909-1864-4973-81fc-e91c02715df9 req-891e4e57-6a89-4f8e-a6b4-2cd6a31dce5f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:27.967750 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-b284b909-1864-4973-81fc-e91c02715df9 req-891e4e57-6a89-4f8e-a6b4-2cd6a31dce5f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:27.993709 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-b284b909-1864-4973-81fc-e91c02715df9 req-891e4e57-6a89-4f8e-a6b4-2cd6a31dce5f service nova] Creating event network-changed:22d4e712-b79b-4d38-8916-a0128c576b77 for instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a on n-h1-856895-1 Sep 10 11:44:28.006886 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-b284b909-1864-4973-81fc-e91c02715df9 req-891e4e57-6a89-4f8e-a6b4-2cd6a31dce5f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069005 Sep 10 11:44:28.007864 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 706/1484] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:44:28.015990 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5faafa5d-e663-4d2e-aaa5-cb5328ef28c4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:28.016276 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9a6012a1-5717-40fc-9b76-a046431226d9 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:28.017822 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5faafa5d-e663-4d2e-aaa5-cb5328ef28c4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:28.027691 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5faafa5d-e663-4d2e-aaa5-cb5328ef28c4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:28.028597 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5faafa5d-e663-4d2e-aaa5-cb5328ef28c4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:28.029470 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5faafa5d-e663-4d2e-aaa5-cb5328ef28c4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:28.032041 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9a6012a1-5717-40fc-9b76-a046431226d9 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:28.037153 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5faafa5d-e663-4d2e-aaa5-cb5328ef28c4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:28.038675 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5faafa5d-e663-4d2e-aaa5-cb5328ef28c4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:28.039419 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5faafa5d-e663-4d2e-aaa5-cb5328ef28c4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:28.062297 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9a6012a1-5717-40fc-9b76-a046431226d9 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:28.066146 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9a6012a1-5717-40fc-9b76-a046431226d9 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1879 microversion: 2.42 time: 0.915037 Sep 10 11:44:28.071336 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 779/1485] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:27 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1879 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:44:28.080923 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-601a156a-b624-40ee-972f-a447329d306f tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Calling method '.version_select at 0x7f407369f9d0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:28.093098 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:44:28.093353 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-601a156a-b624-40ee-972f-a447329d306f tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:28.093661 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-601a156a-b624-40ee-972f-a447329d306f tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:28.094120 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-601a156a-b624-40ee-972f-a447329d306f tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:28.132412 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-601a156a-b624-40ee-972f-a447329d306f tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 3381 microversion: 2.25 time: 0.059705 Sep 10 11:44:28.133436 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 780/1486] 10.222.0.23 () {60 vars in 1184 bytes} [Sat Sep 10 11:44:28 2022] GET /compute/v2.1/os-migrations => generated 3381 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:44:28.162802 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-80bae6b1-1018-4ff3-ba8d-65e4d4f6a03a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:28.163836 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-80bae6b1-1018-4ff3-ba8d-65e4d4f6a03a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:28.172436 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-80bae6b1-1018-4ff3-ba8d-65e4d4f6a03a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:28.173061 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-80bae6b1-1018-4ff3-ba8d-65e4d4f6a03a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:28.174477 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-80bae6b1-1018-4ff3-ba8d-65e4d4f6a03a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:28.175496 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-80bae6b1-1018-4ff3-ba8d-65e4d4f6a03a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:28.176195 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-80bae6b1-1018-4ff3-ba8d-65e4d4f6a03a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:28.176943 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-80bae6b1-1018-4ff3-ba8d-65e4d4f6a03a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:28.438834 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5faafa5d-e663-4d2e-aaa5-cb5328ef28c4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:28.451337 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5faafa5d-e663-4d2e-aaa5-cb5328ef28c4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1198 microversion: 2.1 time: 0.441823 Sep 10 11:44:28.465170 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 707/1487] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:28 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1198 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:28.478547 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-39b70573-bbda-4aa2-9a28-f0fe05e913e7 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:28.479594 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-39b70573-bbda-4aa2-9a28-f0fe05e913e7 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:28.490575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-39b70573-bbda-4aa2-9a28-f0fe05e913e7 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:28.491507 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-39b70573-bbda-4aa2-9a28-f0fe05e913e7 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:28.492236 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-39b70573-bbda-4aa2-9a28-f0fe05e913e7 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:28.493674 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-39b70573-bbda-4aa2-9a28-f0fe05e913e7 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:28.494344 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-39b70573-bbda-4aa2-9a28-f0fe05e913e7 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:28.495029 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-39b70573-bbda-4aa2-9a28-f0fe05e913e7 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:29.420498 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-80bae6b1-1018-4ff3-ba8d-65e4d4f6a03a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:29.430005 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-80bae6b1-1018-4ff3-ba8d-65e4d4f6a03a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1378 microversion: 2.1 time: 1.294024 Sep 10 11:44:29.443559 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 781/1488] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:28 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1378 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:29.448646 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ac877e33-78c6-4003-8f3a-c983011f5484 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:29.449406 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ac877e33-78c6-4003-8f3a-c983011f5484 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:29.455541 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac877e33-78c6-4003-8f3a-c983011f5484 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:29.456030 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac877e33-78c6-4003-8f3a-c983011f5484 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:29.456465 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac877e33-78c6-4003-8f3a-c983011f5484 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:29.457164 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac877e33-78c6-4003-8f3a-c983011f5484 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:29.457617 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac877e33-78c6-4003-8f3a-c983011f5484 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:29.459799 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac877e33-78c6-4003-8f3a-c983011f5484 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:29.482669 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-39b70573-bbda-4aa2-9a28-f0fe05e913e7 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lazy-loading 'services' on Instance uuid 50d20272-889d-4b72-b33d-73094c78c7b4 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:44:29.523437 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-39b70573-bbda-4aa2-9a28-f0fe05e913e7 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 2419 microversion: 2.25 time: 1.055722 Sep 10 11:44:29.539202 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 708/1489] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:28 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 2419 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:44:29.539202 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6dce4216-498c-41ba-8573-bd110475b300 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:29.539202 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6dce4216-498c-41ba-8573-bd110475b300 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:29.566244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6dce4216-498c-41ba-8573-bd110475b300 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:29.568094 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6dce4216-498c-41ba-8573-bd110475b300 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:29.569214 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6dce4216-498c-41ba-8573-bd110475b300 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:29.569973 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6dce4216-498c-41ba-8573-bd110475b300 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:29.571723 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6dce4216-498c-41ba-8573-bd110475b300 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:29.573872 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6dce4216-498c-41ba-8573-bd110475b300 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:30.147775 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ac877e33-78c6-4003-8f3a-c983011f5484 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:30.165634 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ac877e33-78c6-4003-8f3a-c983011f5484 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:30.167085 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ac877e33-78c6-4003-8f3a-c983011f5484 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:30.168293 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ac877e33-78c6-4003-8f3a-c983011f5484 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1879 microversion: 2.42 time: 0.723631 Sep 10 11:44:30.168887 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 782/1490] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:29 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1879 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:44:30.189080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2b404de8-68cc-48b3-a30a-47ca36c36b03 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:30.189706 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2b404de8-68cc-48b3-a30a-47ca36c36b03 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:30.196446 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b404de8-68cc-48b3-a30a-47ca36c36b03 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:30.197208 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b404de8-68cc-48b3-a30a-47ca36c36b03 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:30.197832 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b404de8-68cc-48b3-a30a-47ca36c36b03 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:30.198713 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b404de8-68cc-48b3-a30a-47ca36c36b03 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:30.199545 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b404de8-68cc-48b3-a30a-47ca36c36b03 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:30.200163 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b404de8-68cc-48b3-a30a-47ca36c36b03 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:30.223567 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6dce4216-498c-41ba-8573-bd110475b300 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:30.245100 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6dce4216-498c-41ba-8573-bd110475b300 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1198 microversion: 2.1 time: 0.715903 Sep 10 11:44:30.246267 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 709/1491] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:29 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1198 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:30.251145 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-69739895-3981-48d7-9031-e8789d94cd86 req-ef5c5d66-1d56-4736-9fea-596fc8baaab1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cb195e0-436b-4ffc-8819-fdac586f6896", "name": "network-vif-plugged", "status": "completed", "tag": "b191a802-e810-409f-980f-c88296d62dea"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:30.272908 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-69739895-3981-48d7-9031-e8789d94cd86 req-ef5c5d66-1d56-4736-9fea-596fc8baaab1 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:30.281528 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-69739895-3981-48d7-9031-e8789d94cd86 req-ef5c5d66-1d56-4736-9fea-596fc8baaab1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:30.282264 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-69739895-3981-48d7-9031-e8789d94cd86 req-ef5c5d66-1d56-4736-9fea-596fc8baaab1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:30.296182 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-69739895-3981-48d7-9031-e8789d94cd86 req-ef5c5d66-1d56-4736-9fea-596fc8baaab1 service nova] Creating event network-vif-plugged:b191a802-e810-409f-980f-c88296d62dea for instance 6cb195e0-436b-4ffc-8819-fdac586f6896 on n-h2-856895-1 Sep 10 11:44:30.316575 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-69739895-3981-48d7-9031-e8789d94cd86 req-ef5c5d66-1d56-4736-9fea-596fc8baaab1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068040 Sep 10 11:44:30.317764 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 710/1492] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:44:30.454896 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f5b74540-ef9b-4acf-a96c-4ed688e71772 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:30.455664 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f5b74540-ef9b-4acf-a96c-4ed688e71772 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:30.475031 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f5b74540-ef9b-4acf-a96c-4ed688e71772 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:30.475558 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f5b74540-ef9b-4acf-a96c-4ed688e71772 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:30.475977 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f5b74540-ef9b-4acf-a96c-4ed688e71772 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:30.476689 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f5b74540-ef9b-4acf-a96c-4ed688e71772 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:30.477144 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f5b74540-ef9b-4acf-a96c-4ed688e71772 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:30.477571 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f5b74540-ef9b-4acf-a96c-4ed688e71772 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:30.866388 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-2b404de8-68cc-48b3-a30a-47ca36c36b03 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lazy-loading 'services' on Instance uuid 50d20272-889d-4b72-b33d-73094c78c7b4 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:44:30.883484 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2b404de8-68cc-48b3-a30a-47ca36c36b03 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 2419 microversion: 2.25 time: 0.711685 Sep 10 11:44:30.884363 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 783/1493] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:30 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 2419 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:44:30.889675 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-a2d4bd94-cf09-4cf6-ae14-e8f8e8904c4b req-dbbd5b2b-a465-457c-8d28-f5b218413255 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a", "tag": "59f16da0-b2c3-4790-8066-9b8d9bae32dd"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:30.900798 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a2d4bd94-cf09-4cf6-ae14-e8f8e8904c4b req-dbbd5b2b-a465-457c-8d28-f5b218413255 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:30.901571 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a2d4bd94-cf09-4cf6-ae14-e8f8e8904c4b req-dbbd5b2b-a465-457c-8d28-f5b218413255 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:30.902177 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a2d4bd94-cf09-4cf6-ae14-e8f8e8904c4b req-dbbd5b2b-a465-457c-8d28-f5b218413255 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:30.914377 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-a2d4bd94-cf09-4cf6-ae14-e8f8e8904c4b req-dbbd5b2b-a465-457c-8d28-f5b218413255 service nova] Creating event network-changed:59f16da0-b2c3-4790-8066-9b8d9bae32dd for instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a on n-h1-856895-1 Sep 10 11:44:30.919695 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-a2d4bd94-cf09-4cf6-ae14-e8f8e8904c4b req-dbbd5b2b-a465-457c-8d28-f5b218413255 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033915 Sep 10 11:44:30.921499 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 784/1494] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:44:30.926945 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-48c56f90-27cd-4947-9730-8d91a05a7e45 req-a1dcb108-908b-4351-834e-b53b1e660c21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc446beb-aed5-4d4e-954b-30c480f62ef0", "tag": "d53a3f4b-c348-4a6d-b50f-9111fcac793a"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:30.938921 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-48c56f90-27cd-4947-9730-8d91a05a7e45 req-a1dcb108-908b-4351-834e-b53b1e660c21 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:30.939629 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-48c56f90-27cd-4947-9730-8d91a05a7e45 req-a1dcb108-908b-4351-834e-b53b1e660c21 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:30.940555 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-48c56f90-27cd-4947-9730-8d91a05a7e45 req-a1dcb108-908b-4351-834e-b53b1e660c21 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:30.945298 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=100 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:44:30.954750 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-48c56f90-27cd-4947-9730-8d91a05a7e45 req-a1dcb108-908b-4351-834e-b53b1e660c21 service nova] Creating event network-changed:d53a3f4b-c348-4a6d-b50f-9111fcac793a for instance bc446beb-aed5-4d4e-954b-30c480f62ef0 on n-h1-856895-1 Sep 10 11:44:30.969776 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-48c56f90-27cd-4947-9730-8d91a05a7e45 req-a1dcb108-908b-4351-834e-b53b1e660c21 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046633 Sep 10 11:44:30.970732 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 785/1495] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:44:31.083884 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f5b74540-ef9b-4acf-a96c-4ed688e71772 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:31.089126 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4667667c-3188-4118-adcf-72fd60358cd7 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:31.089752 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4667667c-3188-4118-adcf-72fd60358cd7 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:31.095615 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f5b74540-ef9b-4acf-a96c-4ed688e71772 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1378 microversion: 2.1 time: 0.645087 Sep 10 11:44:31.104144 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4667667c-3188-4118-adcf-72fd60358cd7 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:31.104935 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4667667c-3188-4118-adcf-72fd60358cd7 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:31.105571 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4667667c-3188-4118-adcf-72fd60358cd7 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:31.106464 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4667667c-3188-4118-adcf-72fd60358cd7 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:31.107092 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4667667c-3188-4118-adcf-72fd60358cd7 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:31.107751 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4667667c-3188-4118-adcf-72fd60358cd7 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:31.110889 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 711/1496] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:30 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1378 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:44:31.208399 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2d42eda0-1cf0-48cc-b02f-882a5da85cab tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:31.213199 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2d42eda0-1cf0-48cc-b02f-882a5da85cab tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:31.233001 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:44:31.234313 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:44:31.240555 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d42eda0-1cf0-48cc-b02f-882a5da85cab tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:31.241684 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d42eda0-1cf0-48cc-b02f-882a5da85cab tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:31.243398 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d42eda0-1cf0-48cc-b02f-882a5da85cab tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:31.245060 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d42eda0-1cf0-48cc-b02f-882a5da85cab tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:31.245743 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d42eda0-1cf0-48cc-b02f-882a5da85cab tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:31.246998 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d42eda0-1cf0-48cc-b02f-882a5da85cab tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:31.286854 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=30 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:44:31.341175 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-4667667c-3188-4118-adcf-72fd60358cd7 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lazy-loading 'services' on Instance uuid 50d20272-889d-4b72-b33d-73094c78c7b4 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:44:31.484742 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4667667c-3188-4118-adcf-72fd60358cd7 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "DELETE /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4/os-volume_attachments/2bbf3154-b7dc-4f5d-be37-74a2b6035fec" status: 202 len: 0 microversion: 2.25 time: 0.403031 Sep 10 11:44:31.486446 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 786/1497] 10.222.0.23 () {60 vars in 1457 bytes} [Sat Sep 10 11:44:31 2022] DELETE /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4/os-volume_attachments/2bbf3154-b7dc-4f5d-be37-74a2b6035fec => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 10 11:44:31.503106 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f2434b14-5dce-4ebe-b530-2d1b72dfc518 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:31.504250 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f2434b14-5dce-4ebe-b530-2d1b72dfc518 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:31.516600 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f2434b14-5dce-4ebe-b530-2d1b72dfc518 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:31.517634 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f2434b14-5dce-4ebe-b530-2d1b72dfc518 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:31.519468 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f2434b14-5dce-4ebe-b530-2d1b72dfc518 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:31.521008 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f2434b14-5dce-4ebe-b530-2d1b72dfc518 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:31.522322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f2434b14-5dce-4ebe-b530-2d1b72dfc518 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:31.522957 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f2434b14-5dce-4ebe-b530-2d1b72dfc518 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:32.344233 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f2434b14-5dce-4ebe-b530-2d1b72dfc518 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:32.352916 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f2434b14-5dce-4ebe-b530-2d1b72dfc518 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1198 microversion: 2.1 time: 0.864896 Sep 10 11:44:32.363432 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 787/1498] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:31 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1198 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:32.376455 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5c8adecd-7a61-44c8-80d7-bc37836259dd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:32.382579 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5c8adecd-7a61-44c8-80d7-bc37836259dd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:32.398166 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c8adecd-7a61-44c8-80d7-bc37836259dd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:32.400391 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c8adecd-7a61-44c8-80d7-bc37836259dd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:32.402692 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c8adecd-7a61-44c8-80d7-bc37836259dd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:32.403664 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c8adecd-7a61-44c8-80d7-bc37836259dd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:32.404292 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c8adecd-7a61-44c8-80d7-bc37836259dd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:32.407561 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c8adecd-7a61-44c8-80d7-bc37836259dd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:32.487323 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5c8adecd-7a61-44c8-80d7-bc37836259dd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.122633 Sep 10 11:44:32.488282 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 788/1499] 10.222.0.23 () {60 vars in 1343 bytes} [Sat Sep 10 11:44:32 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:44:32.499152 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-80f86a89-daba-45ca-9037-009561a1a6de tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:32.500508 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-80f86a89-daba-45ca-9037-009561a1a6de tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:32.515428 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-80f86a89-daba-45ca-9037-009561a1a6de tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:32.515932 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-80f86a89-daba-45ca-9037-009561a1a6de tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:32.516373 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-80f86a89-daba-45ca-9037-009561a1a6de tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:32.521271 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-80f86a89-daba-45ca-9037-009561a1a6de tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:32.523363 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-80f86a89-daba-45ca-9037-009561a1a6de tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:32.524036 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-80f86a89-daba-45ca-9037-009561a1a6de tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:33.147813 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2d42eda0-1cf0-48cc-b02f-882a5da85cab tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:33.162997 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2d42eda0-1cf0-48cc-b02f-882a5da85cab tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:33.167029 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2d42eda0-1cf0-48cc-b02f-882a5da85cab tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:33.168311 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2d42eda0-1cf0-48cc-b02f-882a5da85cab tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1879 microversion: 2.42 time: 1.976164 Sep 10 11:44:33.176127 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 712/1500] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:31 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1879 bytes in 1984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:44:33.188479 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-9f5bfe31-a2b5-4899-a3ad-09b945a49a3a req-2b58f747-5d94-486a-b42d-f945d092a039 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a", "tag": "489e7897-1722-4643-b4ed-bef694daa679"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:33.215834 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-9f5bfe31-a2b5-4899-a3ad-09b945a49a3a req-2b58f747-5d94-486a-b42d-f945d092a039 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:33.216709 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-9f5bfe31-a2b5-4899-a3ad-09b945a49a3a req-2b58f747-5d94-486a-b42d-f945d092a039 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:33.221534 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-9f5bfe31-a2b5-4899-a3ad-09b945a49a3a req-2b58f747-5d94-486a-b42d-f945d092a039 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:33.257116 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-9f5bfe31-a2b5-4899-a3ad-09b945a49a3a req-2b58f747-5d94-486a-b42d-f945d092a039 service nova] Creating event network-changed:489e7897-1722-4643-b4ed-bef694daa679 for instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a on n-h1-856895-1 Sep 10 11:44:33.274219 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-9f5bfe31-a2b5-4899-a3ad-09b945a49a3a req-2b58f747-5d94-486a-b42d-f945d092a039 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095975 Sep 10 11:44:33.278579 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 713/1501] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:44:33.331376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-80f86a89-daba-45ca-9037-009561a1a6de tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:33.345916 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-80f86a89-daba-45ca-9037-009561a1a6de tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1378 microversion: 2.1 time: 0.855188 Sep 10 11:44:33.361611 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 789/1502] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:32 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1378 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:33.382722 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c1a210a9-7e8f-4ebb-b513-958332d07fe1 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:33.384571 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c1a210a9-7e8f-4ebb-b513-958332d07fe1 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:33.398325 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1a210a9-7e8f-4ebb-b513-958332d07fe1 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:33.400809 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1a210a9-7e8f-4ebb-b513-958332d07fe1 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:33.401300 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1a210a9-7e8f-4ebb-b513-958332d07fe1 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:33.402045 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1a210a9-7e8f-4ebb-b513-958332d07fe1 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:33.402517 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1a210a9-7e8f-4ebb-b513-958332d07fe1 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:33.402952 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1a210a9-7e8f-4ebb-b513-958332d07fe1 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:33.503406 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-defcc988-84d5-4f1b-961b-d3db2d7dc063 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:33.506592 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-defcc988-84d5-4f1b-961b-d3db2d7dc063 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:33.526798 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-defcc988-84d5-4f1b-961b-d3db2d7dc063 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:33.527329 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-defcc988-84d5-4f1b-961b-d3db2d7dc063 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:33.527772 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-defcc988-84d5-4f1b-961b-d3db2d7dc063 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:33.528484 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-defcc988-84d5-4f1b-961b-d3db2d7dc063 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:33.528942 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-defcc988-84d5-4f1b-961b-d3db2d7dc063 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:33.529367 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-defcc988-84d5-4f1b-961b-d3db2d7dc063 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:33.605905 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-defcc988-84d5-4f1b-961b-d3db2d7dc063 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.109678 Sep 10 11:44:33.606767 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 790/1503] 10.222.0.23 () {60 vars in 1343 bytes} [Sat Sep 10 11:44:33 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 10 11:44:34.068899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c1a210a9-7e8f-4ebb-b513-958332d07fe1 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:34.089232 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c1a210a9-7e8f-4ebb-b513-958332d07fe1 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1381 microversion: 2.1 time: 0.708951 Sep 10 11:44:34.090424 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 714/1504] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:33 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1381 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:34.205156 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-edd26fae-a685-40fc-b876-d6d3d1778f85 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:34.205848 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-edd26fae-a685-40fc-b876-d6d3d1778f85 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:34.213843 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-edd26fae-a685-40fc-b876-d6d3d1778f85 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:34.214336 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-edd26fae-a685-40fc-b876-d6d3d1778f85 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:34.214796 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-edd26fae-a685-40fc-b876-d6d3d1778f85 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:34.215690 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-edd26fae-a685-40fc-b876-d6d3d1778f85 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:34.217265 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-edd26fae-a685-40fc-b876-d6d3d1778f85 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:34.218186 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-edd26fae-a685-40fc-b876-d6d3d1778f85 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:34.758171 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7f52c524-5965-41fa-ba56-aae29518c8bc tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:34.759514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7f52c524-5965-41fa-ba56-aae29518c8bc tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:34.775642 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f52c524-5965-41fa-ba56-aae29518c8bc tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:34.776432 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f52c524-5965-41fa-ba56-aae29518c8bc tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:34.777061 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f52c524-5965-41fa-ba56-aae29518c8bc tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:34.778232 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f52c524-5965-41fa-ba56-aae29518c8bc tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:34.778862 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f52c524-5965-41fa-ba56-aae29518c8bc tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:34.783606 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f52c524-5965-41fa-ba56-aae29518c8bc tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:35.425443 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-edd26fae-a685-40fc-b876-d6d3d1778f85 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:35.444399 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-edd26fae-a685-40fc-b876-d6d3d1778f85 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:35.445873 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-edd26fae-a685-40fc-b876-d6d3d1778f85 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:35.448648 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-edd26fae-a685-40fc-b876-d6d3d1778f85 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1879 microversion: 2.42 time: 1.246174 Sep 10 11:44:35.449247 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 715/1505] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:34 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1879 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:44:35.474515 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ef0f7404-8444-4a69-90b6-b17b88edd43f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:35.475658 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ef0f7404-8444-4a69-90b6-b17b88edd43f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:35.495088 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ef0f7404-8444-4a69-90b6-b17b88edd43f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:35.500176 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ef0f7404-8444-4a69-90b6-b17b88edd43f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:35.500909 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ef0f7404-8444-4a69-90b6-b17b88edd43f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:35.501896 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ef0f7404-8444-4a69-90b6-b17b88edd43f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:35.502602 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ef0f7404-8444-4a69-90b6-b17b88edd43f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:35.503451 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ef0f7404-8444-4a69-90b6-b17b88edd43f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:36.191942 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7f52c524-5965-41fa-ba56-aae29518c8bc tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1532 microversion: 2.1 time: 2.081430 Sep 10 11:44:36.199326 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 791/1506] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:34 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1532 bytes in 2089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:36.221800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fea44ee0-1483-4eb8-9b57-6d1819b9743c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:36.232192 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fea44ee0-1483-4eb8-9b57-6d1819b9743c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:36.255680 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fea44ee0-1483-4eb8-9b57-6d1819b9743c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:36.263294 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fea44ee0-1483-4eb8-9b57-6d1819b9743c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:36.267561 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fea44ee0-1483-4eb8-9b57-6d1819b9743c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:36.274641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fea44ee0-1483-4eb8-9b57-6d1819b9743c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:36.276401 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fea44ee0-1483-4eb8-9b57-6d1819b9743c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:36.277076 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fea44ee0-1483-4eb8-9b57-6d1819b9743c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:36.358633 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fea44ee0-1483-4eb8-9b57-6d1819b9743c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.153498 Sep 10 11:44:36.367388 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 792/1507] 10.222.0.23 () {60 vars in 1343 bytes} [Sat Sep 10 11:44:36 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:44:36.390370 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-d959689e-4679-4109-b916-dfa6b100a4cd req-15f318de-b50e-4997-8406-985d38de5b8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a", "tag": "ff0620c7-4af8-438f-80cb-a5112186d60a"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:36.419490 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d959689e-4679-4109-b916-dfa6b100a4cd req-15f318de-b50e-4997-8406-985d38de5b8c service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:36.421210 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d959689e-4679-4109-b916-dfa6b100a4cd req-15f318de-b50e-4997-8406-985d38de5b8c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:36.421667 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d959689e-4679-4109-b916-dfa6b100a4cd req-15f318de-b50e-4997-8406-985d38de5b8c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:36.445396 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-d959689e-4679-4109-b916-dfa6b100a4cd req-15f318de-b50e-4997-8406-985d38de5b8c service nova] Creating event network-changed:ff0620c7-4af8-438f-80cb-a5112186d60a for instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a on n-h1-856895-1 Sep 10 11:44:36.463041 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-d959689e-4679-4109-b916-dfa6b100a4cd req-15f318de-b50e-4997-8406-985d38de5b8c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089254 Sep 10 11:44:36.465467 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 793/1508] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:44:36.479904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-59acd553-64fb-4f8e-94ab-f95dc2e8bbf4 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:36.482570 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-59acd553-64fb-4f8e-94ab-f95dc2e8bbf4 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:36.501224 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59acd553-64fb-4f8e-94ab-f95dc2e8bbf4 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:36.505188 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59acd553-64fb-4f8e-94ab-f95dc2e8bbf4 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:36.506553 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59acd553-64fb-4f8e-94ab-f95dc2e8bbf4 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:36.510623 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59acd553-64fb-4f8e-94ab-f95dc2e8bbf4 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:36.512356 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59acd553-64fb-4f8e-94ab-f95dc2e8bbf4 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:36.513036 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59acd553-64fb-4f8e-94ab-f95dc2e8bbf4 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:36.610359 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ef0f7404-8444-4a69-90b6-b17b88edd43f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:36.626229 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ef0f7404-8444-4a69-90b6-b17b88edd43f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1378 microversion: 2.1 time: 1.175069 Sep 10 11:44:36.626838 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 716/1509] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:35 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1378 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:36.642804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c5939e38-fa48-42a0-9186-63a88e2ecf72 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:36.649066 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c5939e38-fa48-42a0-9186-63a88e2ecf72 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:36.670939 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c5939e38-fa48-42a0-9186-63a88e2ecf72 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:36.674965 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c5939e38-fa48-42a0-9186-63a88e2ecf72 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:36.681202 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c5939e38-fa48-42a0-9186-63a88e2ecf72 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:36.682347 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c5939e38-fa48-42a0-9186-63a88e2ecf72 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:36.683063 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c5939e38-fa48-42a0-9186-63a88e2ecf72 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:36.683768 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c5939e38-fa48-42a0-9186-63a88e2ecf72 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:37.513288 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-59acd553-64fb-4f8e-94ab-f95dc2e8bbf4 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1532 microversion: 2.1 time: 1.038933 Sep 10 11:44:37.514529 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 794/1510] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:36 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1532 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:37.517687 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c5939e38-fa48-42a0-9186-63a88e2ecf72 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:37.531423 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1172eab5-aa81-414c-80e3-2580ad87740c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:37.537353 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1172eab5-aa81-414c-80e3-2580ad87740c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:37.542495 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c5939e38-fa48-42a0-9186-63a88e2ecf72 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:37.551400 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c5939e38-fa48-42a0-9186-63a88e2ecf72 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:37.553374 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c5939e38-fa48-42a0-9186-63a88e2ecf72 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1879 microversion: 2.42 time: 0.921380 Sep 10 11:44:37.558738 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 717/1511] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:36 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1879 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:44:37.565031 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1172eab5-aa81-414c-80e3-2580ad87740c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:37.566009 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1172eab5-aa81-414c-80e3-2580ad87740c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:37.567805 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1172eab5-aa81-414c-80e3-2580ad87740c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:37.572181 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1172eab5-aa81-414c-80e3-2580ad87740c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:37.573627 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1172eab5-aa81-414c-80e3-2580ad87740c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:37.574515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1172eab5-aa81-414c-80e3-2580ad87740c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:37.574755 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-72149d79-707b-4466-9298-e5cdab34ac66 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:37.591358 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-72149d79-707b-4466-9298-e5cdab34ac66 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:37.591876 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-72149d79-707b-4466-9298-e5cdab34ac66 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:37.596793 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-72149d79-707b-4466-9298-e5cdab34ac66 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:37.602770 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-72149d79-707b-4466-9298-e5cdab34ac66 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:37.605065 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-72149d79-707b-4466-9298-e5cdab34ac66 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:37.606238 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-72149d79-707b-4466-9298-e5cdab34ac66 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:37.652786 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1172eab5-aa81-414c-80e3-2580ad87740c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.134963 Sep 10 11:44:37.655706 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 795/1512] 10.222.0.23 () {60 vars in 1343 bytes} [Sat Sep 10 11:44:37 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:44:37.662420 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1a20302c-3d56-4e00-bdbb-a0a4051fcf9e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:37.663338 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1a20302c-3d56-4e00-bdbb-a0a4051fcf9e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:37.675787 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1a20302c-3d56-4e00-bdbb-a0a4051fcf9e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:37.676619 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1a20302c-3d56-4e00-bdbb-a0a4051fcf9e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:37.677505 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1a20302c-3d56-4e00-bdbb-a0a4051fcf9e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:37.678470 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1a20302c-3d56-4e00-bdbb-a0a4051fcf9e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:37.679109 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1a20302c-3d56-4e00-bdbb-a0a4051fcf9e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:37.680008 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1a20302c-3d56-4e00-bdbb-a0a4051fcf9e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:37.691700 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-72149d79-707b-4466-9298-e5cdab34ac66 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.128830 Sep 10 11:44:37.733682 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 718/1513] 10.222.0.23 () {58 vars in 1176 bytes} [Sat Sep 10 11:44:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:44:37.762422 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-893203cc-7e46-4b4e-8cb8-36b4a87946b2 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-856895-1", "block_migration": false, "disk_over_commit": false}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:37.780936 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-893203cc-7e46-4b4e-8cb8-36b4a87946b2 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:37.819390 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-893203cc-7e46-4b4e-8cb8-36b4a87946b2 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:37.822334 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-893203cc-7e46-4b4e-8cb8-36b4a87946b2 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:37.824609 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-893203cc-7e46-4b4e-8cb8-36b4a87946b2 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:37.827004 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-893203cc-7e46-4b4e-8cb8-36b4a87946b2 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:37.829483 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-893203cc-7e46-4b4e-8cb8-36b4a87946b2 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:37.830320 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-893203cc-7e46-4b4e-8cb8-36b4a87946b2 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:37.887015 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-893203cc-7e46-4b4e-8cb8-36b4a87946b2 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lazy-loading 'flavor' on Instance uuid 6cb195e0-436b-4ffc-8819-fdac586f6896 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:44:37.906675 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-893203cc-7e46-4b4e-8cb8-36b4a87946b2 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Going to try to live migrate instance to n-h1-856895-1 {{(pid=128776) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 10 11:44:39.531221 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1a20302c-3d56-4e00-bdbb-a0a4051fcf9e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:39.557092 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1a20302c-3d56-4e00-bdbb-a0a4051fcf9e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1378 microversion: 2.1 time: 1.899683 Sep 10 11:44:39.568343 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 796/1514] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:37 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1378 bytes in 1912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:39.573586 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c7d04c0d-1dff-4677-af40-740d10b567fa tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:39.574406 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c7d04c0d-1dff-4677-af40-740d10b567fa tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:39.586643 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7d04c0d-1dff-4677-af40-740d10b567fa tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:39.589977 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7d04c0d-1dff-4677-af40-740d10b567fa tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:39.590735 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7d04c0d-1dff-4677-af40-740d10b567fa tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:39.596145 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7d04c0d-1dff-4677-af40-740d10b567fa tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:39.596869 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7d04c0d-1dff-4677-af40-740d10b567fa tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:39.597488 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7d04c0d-1dff-4677-af40-740d10b567fa tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:40.420005 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c7d04c0d-1dff-4677-af40-740d10b567fa tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:40.431237 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c7d04c0d-1dff-4677-af40-740d10b567fa tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:40.432677 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c7d04c0d-1dff-4677-af40-740d10b567fa tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:40.433869 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c7d04c0d-1dff-4677-af40-740d10b567fa tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1879 microversion: 2.42 time: 0.864255 Sep 10 11:44:40.459549 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 797/1515] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:39 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1879 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:44:40.468745 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-177ebb9e-7ee7-493a-b8bc-d4624cc7486c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:40.471012 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-177ebb9e-7ee7-493a-b8bc-d4624cc7486c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:40.498738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-177ebb9e-7ee7-493a-b8bc-d4624cc7486c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:40.512151 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-177ebb9e-7ee7-493a-b8bc-d4624cc7486c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:40.512828 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-177ebb9e-7ee7-493a-b8bc-d4624cc7486c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:40.513607 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-177ebb9e-7ee7-493a-b8bc-d4624cc7486c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:40.514090 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-177ebb9e-7ee7-493a-b8bc-d4624cc7486c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:40.514527 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-177ebb9e-7ee7-493a-b8bc-d4624cc7486c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:40.577929 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-177ebb9e-7ee7-493a-b8bc-d4624cc7486c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.116273 Sep 10 11:44:40.584041 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 798/1516] 10.222.0.23 () {60 vars in 1343 bytes} [Sat Sep 10 11:44:40 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:44:40.590842 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-a68ffc56-6fc6-4e1e-8d67-37b4c39a8b21 req-cc5f418d-0914-4dc8-a5a5-c9cf8ec3f622 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc446beb-aed5-4d4e-954b-30c480f62ef0", "name": "network-vif-plugged", "status": "completed", "tag": "d53a3f4b-c348-4a6d-b50f-9111fcac793a"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:40.616479 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a68ffc56-6fc6-4e1e-8d67-37b4c39a8b21 req-cc5f418d-0914-4dc8-a5a5-c9cf8ec3f622 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:40.619559 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a68ffc56-6fc6-4e1e-8d67-37b4c39a8b21 req-cc5f418d-0914-4dc8-a5a5-c9cf8ec3f622 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:40.620963 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a68ffc56-6fc6-4e1e-8d67-37b4c39a8b21 req-cc5f418d-0914-4dc8-a5a5-c9cf8ec3f622 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:40.638207 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-a68ffc56-6fc6-4e1e-8d67-37b4c39a8b21 req-cc5f418d-0914-4dc8-a5a5-c9cf8ec3f622 service nova] Creating event network-vif-plugged:d53a3f4b-c348-4a6d-b50f-9111fcac793a for instance bc446beb-aed5-4d4e-954b-30c480f62ef0 on n-h1-856895-1 Sep 10 11:44:40.658082 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-a68ffc56-6fc6-4e1e-8d67-37b4c39a8b21 req-cc5f418d-0914-4dc8-a5a5-c9cf8ec3f622 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069486 Sep 10 11:44:40.661085 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 799/1517] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:44:40.669433 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-dccc7730-e5cd-4026-8369-420e6243251e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:40.673722 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-dccc7730-e5cd-4026-8369-420e6243251e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:40.687627 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:44:40.692666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dccc7730-e5cd-4026-8369-420e6243251e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:40.693492 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dccc7730-e5cd-4026-8369-420e6243251e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:40.694177 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dccc7730-e5cd-4026-8369-420e6243251e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:40.695137 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dccc7730-e5cd-4026-8369-420e6243251e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:40.696761 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dccc7730-e5cd-4026-8369-420e6243251e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:40.700911 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dccc7730-e5cd-4026-8369-420e6243251e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:41.623114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-dccc7730-e5cd-4026-8369-420e6243251e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:41.635589 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-dccc7730-e5cd-4026-8369-420e6243251e tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1378 microversion: 2.1 time: 0.972824 Sep 10 11:44:41.636460 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 800/1518] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:40 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1378 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:41.644300 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-d9567649-6df4-4c9b-8b8d-932c83a095e4 req-1cd8f00f-4ed6-42d8-9e89-c0eabd243167 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a", "tag": "e0c27aad-4065-4a4d-9a93-e46baa44130f"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:41.672243 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d9567649-6df4-4c9b-8b8d-932c83a095e4 req-1cd8f00f-4ed6-42d8-9e89-c0eabd243167 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:41.673209 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d9567649-6df4-4c9b-8b8d-932c83a095e4 req-1cd8f00f-4ed6-42d8-9e89-c0eabd243167 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:41.677275 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d9567649-6df4-4c9b-8b8d-932c83a095e4 req-1cd8f00f-4ed6-42d8-9e89-c0eabd243167 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:41.728019 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-d9567649-6df4-4c9b-8b8d-932c83a095e4 req-1cd8f00f-4ed6-42d8-9e89-c0eabd243167 service nova] Creating event network-changed:e0c27aad-4065-4a4d-9a93-e46baa44130f for instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a on n-h1-856895-1 Sep 10 11:44:41.741313 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-d9567649-6df4-4c9b-8b8d-932c83a095e4 req-1cd8f00f-4ed6-42d8-9e89-c0eabd243167 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103164 Sep 10 11:44:41.747514 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 801/1519] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:44:41.767550 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2eb57e85-d73d-423a-9bb8-6c15cc628d44 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:41.768947 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2eb57e85-d73d-423a-9bb8-6c15cc628d44 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:41.779893 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2eb57e85-d73d-423a-9bb8-6c15cc628d44 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:41.783138 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2eb57e85-d73d-423a-9bb8-6c15cc628d44 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:41.784566 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2eb57e85-d73d-423a-9bb8-6c15cc628d44 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:41.788439 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2eb57e85-d73d-423a-9bb8-6c15cc628d44 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:41.790160 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2eb57e85-d73d-423a-9bb8-6c15cc628d44 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:41.791589 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2eb57e85-d73d-423a-9bb8-6c15cc628d44 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:41.952304 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-893203cc-7e46-4b4e-8cb8-36b4a87946b2 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896/action" status: 202 len: 0 microversion: 2.1 time: 4.202157 Sep 10 11:44:41.953999 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 719/1520] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:44:37 2022] POST /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896/action => generated 0 bytes in 4220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:44:41.961019 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b99f7b89-b353-4889-ab15-17747daddc6a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:41.969435 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b99f7b89-b353-4889-ab15-17747daddc6a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:41.982322 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b99f7b89-b353-4889-ab15-17747daddc6a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:41.984916 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b99f7b89-b353-4889-ab15-17747daddc6a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:41.985634 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b99f7b89-b353-4889-ab15-17747daddc6a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:41.986643 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b99f7b89-b353-4889-ab15-17747daddc6a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:41.988421 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b99f7b89-b353-4889-ab15-17747daddc6a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:41.990612 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b99f7b89-b353-4889-ab15-17747daddc6a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:42.079953 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b99f7b89-b353-4889-ab15-17747daddc6a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.122422 Sep 10 11:44:42.083753 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 720/1521] 10.222.0.23 () {60 vars in 1343 bytes} [Sat Sep 10 11:44:41 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4/os-volume_attachments => generated 25 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:42.094326 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-087c4d4a-a710-4514-8e51-2dfa0e6d55b7 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:42.096048 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-087c4d4a-a710-4514-8e51-2dfa0e6d55b7 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:42.107207 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-087c4d4a-a710-4514-8e51-2dfa0e6d55b7 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:42.107762 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-087c4d4a-a710-4514-8e51-2dfa0e6d55b7 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:42.108152 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-087c4d4a-a710-4514-8e51-2dfa0e6d55b7 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:42.108945 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-087c4d4a-a710-4514-8e51-2dfa0e6d55b7 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:42.109405 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-087c4d4a-a710-4514-8e51-2dfa0e6d55b7 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:42.109835 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-087c4d4a-a710-4514-8e51-2dfa0e6d55b7 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:42.231778 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2eb57e85-d73d-423a-9bb8-6c15cc628d44 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:42.246001 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2eb57e85-d73d-423a-9bb8-6c15cc628d44 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:42.251100 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2eb57e85-d73d-423a-9bb8-6c15cc628d44 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:42.252642 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2eb57e85-d73d-423a-9bb8-6c15cc628d44 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1879 microversion: 2.42 time: 0.502925 Sep 10 11:44:42.256357 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 802/1522] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:41 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1879 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:44:42.463089 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-087c4d4a-a710-4514-8e51-2dfa0e6d55b7 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:42.471688 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-087c4d4a-a710-4514-8e51-2dfa0e6d55b7 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1391 microversion: 2.1 time: 0.385506 Sep 10 11:44:42.475528 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 721/1523] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:42 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1391 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:42.673327 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c2e37c42-af88-4b89-ac0c-47c0aa6bbf85 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:42.674002 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c2e37c42-af88-4b89-ac0c-47c0aa6bbf85 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:42.696030 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c2e37c42-af88-4b89-ac0c-47c0aa6bbf85 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:42.696793 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c2e37c42-af88-4b89-ac0c-47c0aa6bbf85 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:42.697499 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c2e37c42-af88-4b89-ac0c-47c0aa6bbf85 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:42.698607 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c2e37c42-af88-4b89-ac0c-47c0aa6bbf85 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:42.699435 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c2e37c42-af88-4b89-ac0c-47c0aa6bbf85 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:42.700397 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c2e37c42-af88-4b89-ac0c-47c0aa6bbf85 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:43.030078 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c2e37c42-af88-4b89-ac0c-47c0aa6bbf85 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:43.040056 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:44:43.043563 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c2e37c42-af88-4b89-ac0c-47c0aa6bbf85 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1378 microversion: 2.1 time: 0.383981 Sep 10 11:44:43.044804 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 803/1524] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:42 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1378 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:43.128327 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-27f16bcf-8b46-4e35-aa64-5828248cc1d2 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] Action: 'create', calling method: .version_select at 0x7f40733bf4c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-869590034", "description": "tempest-description-1091701162"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:43.295378 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-74527e37-3c5b-4335-8826-0162cf2f4a5e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:43.296565 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-74527e37-3c5b-4335-8826-0162cf2f4a5e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:43.323197 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-74527e37-3c5b-4335-8826-0162cf2f4a5e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:43.323911 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-74527e37-3c5b-4335-8826-0162cf2f4a5e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:43.324369 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-74527e37-3c5b-4335-8826-0162cf2f4a5e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:43.329115 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-74527e37-3c5b-4335-8826-0162cf2f4a5e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:43.329622 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-74527e37-3c5b-4335-8826-0162cf2f4a5e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:43.333776 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-74527e37-3c5b-4335-8826-0162cf2f4a5e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:43.591571 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-27f16bcf-8b46-4e35-aa64-5828248cc1d2 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.610852 Sep 10 11:44:43.602659 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 722/1525] 10.222.0.23 () {60 vars in 1180 bytes} [Sat Sep 10 11:44:42 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:44:43.609090 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e28d9633-10e9-4c48-a759-d2d471b3543c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:43.610073 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e28d9633-10e9-4c48-a759-d2d471b3543c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:43.622068 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e28d9633-10e9-4c48-a759-d2d471b3543c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:43.623634 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e28d9633-10e9-4c48-a759-d2d471b3543c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:43.624260 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e28d9633-10e9-4c48-a759-d2d471b3543c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:43.625287 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e28d9633-10e9-4c48-a759-d2d471b3543c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:43.626028 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e28d9633-10e9-4c48-a759-d2d471b3543c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:43.626746 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e28d9633-10e9-4c48-a759-d2d471b3543c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:44.193941 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e28d9633-10e9-4c48-a759-d2d471b3543c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:44.211233 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e28d9633-10e9-4c48-a759-d2d471b3543c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1391 microversion: 2.1 time: 0.601359 Sep 10 11:44:44.211832 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 723/1526] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:43 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1391 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:44.226538 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-74527e37-3c5b-4335-8826-0162cf2f4a5e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:44.232270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7539eb4e-a515-45ad-b04b-c192e8e5bdfd tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] Action: 'create', calling method: .version_select at 0x7f40735cc9d0>, body: {"security_group_rule": {"parent_group_id": "c4ddce47-0ba9-445c-89e6-db02cd30ac40", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:44.245491 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-74527e37-3c5b-4335-8826-0162cf2f4a5e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:44.258154 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-74527e37-3c5b-4335-8826-0162cf2f4a5e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:44.264688 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-74527e37-3c5b-4335-8826-0162cf2f4a5e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1879 microversion: 2.42 time: 0.975578 Sep 10 11:44:44.265924 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 804/1527] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:43 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1879 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:44:44.274460 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4844019e-9179-44c9-b7ae-16b666bc0460 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:44.277003 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4844019e-9179-44c9-b7ae-16b666bc0460 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:44.285074 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4844019e-9179-44c9-b7ae-16b666bc0460 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:44.286590 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4844019e-9179-44c9-b7ae-16b666bc0460 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:44.288292 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4844019e-9179-44c9-b7ae-16b666bc0460 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:44.289331 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4844019e-9179-44c9-b7ae-16b666bc0460 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:44.290008 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4844019e-9179-44c9-b7ae-16b666bc0460 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:44.290677 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4844019e-9179-44c9-b7ae-16b666bc0460 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:44.806019 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4844019e-9179-44c9-b7ae-16b666bc0460 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:44.820368 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4844019e-9179-44c9-b7ae-16b666bc0460 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1527 microversion: 2.1 time: 0.552839 Sep 10 11:44:44.820987 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 805/1528] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:44 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1527 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:44.851824 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-898d3b8b-270d-4a61-939d-6033ae40e015 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:44.853094 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-898d3b8b-270d-4a61-939d-6033ae40e015 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:44.868486 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-898d3b8b-270d-4a61-939d-6033ae40e015 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:44.872251 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-898d3b8b-270d-4a61-939d-6033ae40e015 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:44.872778 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-898d3b8b-270d-4a61-939d-6033ae40e015 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:44.873541 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-898d3b8b-270d-4a61-939d-6033ae40e015 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:44.876642 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-898d3b8b-270d-4a61-939d-6033ae40e015 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:44.877270 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-898d3b8b-270d-4a61-939d-6033ae40e015 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:45.163386 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7539eb4e-a515-45ad-b04b-c192e8e5bdfd tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.948192 Sep 10 11:44:45.164331 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 724/1529] 10.222.0.23 () {60 vars in 1195 bytes} [Sat Sep 10 11:44:44 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:44:45.179301 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1c4fc3d4-8944-4949-a4fe-1b28865aceab tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] Action: 'create', calling method: .version_select at 0x7f40733f6b80>, body: {"security_group_rule": {"parent_group_id": "c4ddce47-0ba9-445c-89e6-db02cd30ac40", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:45.508361 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-898d3b8b-270d-4a61-939d-6033ae40e015 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:45.521635 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-898d3b8b-270d-4a61-939d-6033ae40e015 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1527 microversion: 2.1 time: 0.674686 Sep 10 11:44:45.527395 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 806/1530] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:44 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1527 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:45.547799 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-1c4fc3d4-8944-4949-a4fe-1b28865aceab tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] HTTP exception thrown: This rule already exists in group c4ddce47-0ba9-445c-89e6-db02cd30ac40 Sep 10 11:44:45.548312 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-30a2181f-c368-4cac-83f5-d24f5b4251da tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1c4fc3d4-8944-4949-a4fe-1b28865aceab tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] Request method failure captured: Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 138 Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHiq3E4x9-GAX1PKuWAw-2nARlqWHmymBdfNPj0-Dr5iox6K-txX7S5iuW2Ml1I-titOPM0F1RHew2Tg3CeY42AxdP-9nUwZYN5SzxYFeeFP5esUUTGTY5x6s7nnpR7l3ae6NhUwsegwClWpZSWftPyTSGI1lTgvFwHy-OYhXAouID8 Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 8fe59e55f998426cb81a06172d33893f Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1539960326 Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8fe59e55f998426cb81a06172d33893f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8fe59e55f998426cb81a06172d33893f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8fe59e55f998426cb81a06172d33893f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8fe59e55f998426cb81a06172d33893f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1539960326 Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 8fe59e55f998426cb81a06172d33893f Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1539960326 Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: a3fe3d670da04ed39cabbb5b8899efd2 Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: {"security_group_rule": {"parent_group_id": "c4ddce47-0ba9-445c-89e6-db02cd30ac40", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: exception: This rule already exists in group c4ddce47-0ba9-445c-89e6-db02cd30ac40 Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'c4ddce47-0ba9-445c-89e6-db02cd30ac40', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group c4ddce47-0ba9-445c-89e6-db02cd30ac40 Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group c4ddce47-0ba9-445c-89e6-db02cd30ac40 Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:44:45.550376 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:44:45.556837 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:44:45.556837 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:44:45.556837 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group c4ddce47-0ba9-445c-89e6-db02cd30ac40 Sep 10 11:44:45.556837 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:45.557804 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-30a2181f-c368-4cac-83f5-d24f5b4251da tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:45.559701 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1c4fc3d4-8944-4949-a4fe-1b28865aceab tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] Returning 400 to user: This rule already exists in group c4ddce47-0ba9-445c-89e6-db02cd30ac40 {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:44:45.560588 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1c4fc3d4-8944-4949-a4fe-1b28865aceab tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.385785 Sep 10 11:44:45.561666 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 725/1531] 10.222.0.23 () {60 vars in 1195 bytes} [Sat Sep 10 11:44:45 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 388 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:44:45.574626 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-08cdb079-66a9-40e4-88e6-0eacc386187a tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:45.580060 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-08cdb079-66a9-40e4-88e6-0eacc386187a tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:45.592918 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30a2181f-c368-4cac-83f5-d24f5b4251da tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:45.593425 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30a2181f-c368-4cac-83f5-d24f5b4251da tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:45.593867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30a2181f-c368-4cac-83f5-d24f5b4251da tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:45.594588 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30a2181f-c368-4cac-83f5-d24f5b4251da tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:45.599870 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30a2181f-c368-4cac-83f5-d24f5b4251da tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:45.603054 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30a2181f-c368-4cac-83f5-d24f5b4251da tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:45.605851 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-08cdb079-66a9-40e4-88e6-0eacc386187a tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:45.606360 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-08cdb079-66a9-40e4-88e6-0eacc386187a tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:45.606805 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-08cdb079-66a9-40e4-88e6-0eacc386187a tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:45.607557 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-08cdb079-66a9-40e4-88e6-0eacc386187a tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:45.608012 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-08cdb079-66a9-40e4-88e6-0eacc386187a tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:45.608441 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-08cdb079-66a9-40e4-88e6-0eacc386187a tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:46.091718 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-08cdb079-66a9-40e4-88e6-0eacc386187a tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:46.097256 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:44:46.112673 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-08cdb079-66a9-40e4-88e6-0eacc386187a tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:46.117751 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-08cdb079-66a9-40e4-88e6-0eacc386187a tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:46.121281 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-08cdb079-66a9-40e4-88e6-0eacc386187a tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1879 microversion: 2.42 time: 0.556441 Sep 10 11:44:46.150310 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 726/1532] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:45 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1879 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:44:46.158531 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6cf33da7-06fc-4196-aaaf-db7d8deba8bf tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:46.188066 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6cf33da7-06fc-4196-aaaf-db7d8deba8bf tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/45bea006-62ce-446f-ad0c-86a8cd9d916d" status: 202 len: 0 microversion: 2.1 time: 0.033982 Sep 10 11:44:46.195881 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 727/1533] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:44:46 2022] DELETE /compute/v2.1/flavors/45bea006-62ce-446f-ad0c-86a8cd9d916d => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:44:46.217415 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-30a2181f-c368-4cac-83f5-d24f5b4251da tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:46.217811 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b08014e6-b51f-472f-aaed-bc5e53bd778c tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] Calling method '.version_select at 0x7f40733e8790>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:46.228290 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-30a2181f-c368-4cac-83f5-d24f5b4251da tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1391 microversion: 2.1 time: 0.697576 Sep 10 11:44:46.244321 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 807/1534] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:45 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1391 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:46.257434 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-479ac10c-1e9d-4afb-ac99-eaf388a07080 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:46.299737 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-479ac10c-1e9d-4afb-ac99-eaf388a07080 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053680 Sep 10 11:44:46.308597 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 808/1535] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:44:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:46.324141 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7dead2b1-ba6e-459b-affa-c376e413ada2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:46.343265 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7dead2b1-ba6e-459b-affa-c376e413ada2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:46.373706 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7dead2b1-ba6e-459b-affa-c376e413ada2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:46.381396 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7dead2b1-ba6e-459b-affa-c376e413ada2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:46.384213 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7dead2b1-ba6e-459b-affa-c376e413ada2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:46.385648 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7dead2b1-ba6e-459b-affa-c376e413ada2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:46.387774 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7dead2b1-ba6e-459b-affa-c376e413ada2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:46.388426 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7dead2b1-ba6e-459b-affa-c376e413ada2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:46.482539 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7dead2b1-ba6e-459b-affa-c376e413ada2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:46.497555 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7dead2b1-ba6e-459b-affa-c376e413ada2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Old instance type tempest-test_resize_flavor_-252566354, new instance type m1.heat {{(pid=128777) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 11:44:46.522290 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-7dead2b1-ba6e-459b-affa-c376e413ada2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:44:46.522900 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-7dead2b1-ba6e-459b-affa-c376e413ada2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:44:46.523187 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-7dead2b1-ba6e-459b-affa-c376e413ada2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:44:46.523597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-7dead2b1-ba6e-459b-affa-c376e413ada2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:44:46.524009 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-7dead2b1-ba6e-459b-affa-c376e413ada2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:44:46.691829 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7dead2b1-ba6e-459b-affa-c376e413ada2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "POST /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0/action" status: 202 len: 0 microversion: 2.1 time: 0.371385 Sep 10 11:44:46.699179 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 809/1536] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:44:46 2022] POST /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0/action => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:44:46.709530 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9320ac93-9db1-4c48-b59b-b7f28cc511bc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:46.710081 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9320ac93-9db1-4c48-b59b-b7f28cc511bc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:46.725407 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9320ac93-9db1-4c48-b59b-b7f28cc511bc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:46.725909 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9320ac93-9db1-4c48-b59b-b7f28cc511bc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:46.726348 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9320ac93-9db1-4c48-b59b-b7f28cc511bc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:46.727069 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9320ac93-9db1-4c48-b59b-b7f28cc511bc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:46.727554 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9320ac93-9db1-4c48-b59b-b7f28cc511bc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:46.728106 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9320ac93-9db1-4c48-b59b-b7f28cc511bc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:47.478737 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b08014e6-b51f-472f-aaed-bc5e53bd778c tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-group-rules/85045660-f65d-41e0-b1f3-ca3e160f85e4" status: 202 len: 0 microversion: 2.1 time: 1.281169 Sep 10 11:44:47.479378 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 728/1537] 10.222.0.23 () {58 vars in 1287 bytes} [Sat Sep 10 11:44:46 2022] DELETE /compute/v2.1/os-security-group-rules/85045660-f65d-41e0-b1f3-ca3e160f85e4 => generated 0 bytes in 1283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:44:47.486874 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0e162b37-8d80-4b98-83ca-a37dc506eb7d tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:47.487548 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0e162b37-8d80-4b98-83ca-a37dc506eb7d tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:47.499799 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e162b37-8d80-4b98-83ca-a37dc506eb7d tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:47.516449 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e162b37-8d80-4b98-83ca-a37dc506eb7d tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:47.517021 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e162b37-8d80-4b98-83ca-a37dc506eb7d tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:47.517786 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e162b37-8d80-4b98-83ca-a37dc506eb7d tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:47.518271 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e162b37-8d80-4b98-83ca-a37dc506eb7d tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:47.518707 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e162b37-8d80-4b98-83ca-a37dc506eb7d tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:47.632007 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:44:48.065444 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9320ac93-9db1-4c48-b59b-b7f28cc511bc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:48.081365 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9320ac93-9db1-4c48-b59b-b7f28cc511bc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1536 microversion: 2.1 time: 1.380981 Sep 10 11:44:48.095186 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 810/1538] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:46 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1536 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:48.095186 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f83619f0-a57e-4a6b-a71c-2dfef0ac4e5c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:48.095186 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f83619f0-a57e-4a6b-a71c-2dfef0ac4e5c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:48.105278 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f83619f0-a57e-4a6b-a71c-2dfef0ac4e5c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:48.107288 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f83619f0-a57e-4a6b-a71c-2dfef0ac4e5c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:48.107777 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f83619f0-a57e-4a6b-a71c-2dfef0ac4e5c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:48.108520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f83619f0-a57e-4a6b-a71c-2dfef0ac4e5c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:48.108990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f83619f0-a57e-4a6b-a71c-2dfef0ac4e5c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:48.109428 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f83619f0-a57e-4a6b-a71c-2dfef0ac4e5c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:48.362423 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0e162b37-8d80-4b98-83ca-a37dc506eb7d tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:48.377482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0e162b37-8d80-4b98-83ca-a37dc506eb7d tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:48.382107 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0e162b37-8d80-4b98-83ca-a37dc506eb7d tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:48.383505 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0e162b37-8d80-4b98-83ca-a37dc506eb7d tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1879 microversion: 2.42 time: 0.902422 Sep 10 11:44:48.384341 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 729/1539] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:47 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1879 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:44:48.421432 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a33db166-0ce9-44e9-8b45-ebcac0f5e140 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] Action: 'create', calling method: .version_select at 0x7f407352fc10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-448512044", "description": "tempest-description-1256426430"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:48.447433 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f83619f0-a57e-4a6b-a71c-2dfef0ac4e5c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:48.462090 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f83619f0-a57e-4a6b-a71c-2dfef0ac4e5c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1391 microversion: 2.1 time: 0.377342 Sep 10 11:44:48.476635 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 811/1540] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:48 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1391 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:49.106165 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-082615d8-ca01-4e70-94f7-318085490bf2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:49.108302 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-082615d8-ca01-4e70-94f7-318085490bf2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:49.151609 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-082615d8-ca01-4e70-94f7-318085490bf2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:49.152952 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-082615d8-ca01-4e70-94f7-318085490bf2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:49.155572 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-082615d8-ca01-4e70-94f7-318085490bf2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:49.162627 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-082615d8-ca01-4e70-94f7-318085490bf2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:49.166665 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-082615d8-ca01-4e70-94f7-318085490bf2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:49.169842 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-082615d8-ca01-4e70-94f7-318085490bf2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:49.672045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-082615d8-ca01-4e70-94f7-318085490bf2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:49.703151 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-082615d8-ca01-4e70-94f7-318085490bf2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1536 microversion: 2.1 time: 0.599065 Sep 10 11:44:49.703952 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 812/1541] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:49 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1536 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:49.752308 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-52b71922-9f9e-40e8-b3fa-c82f822377c5 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:49.763298 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-52b71922-9f9e-40e8-b3fa-c82f822377c5 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:49.792082 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-52b71922-9f9e-40e8-b3fa-c82f822377c5 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:49.796291 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-52b71922-9f9e-40e8-b3fa-c82f822377c5 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:49.797394 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-52b71922-9f9e-40e8-b3fa-c82f822377c5 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:49.800594 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-52b71922-9f9e-40e8-b3fa-c82f822377c5 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:49.801486 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-52b71922-9f9e-40e8-b3fa-c82f822377c5 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:49.802377 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-52b71922-9f9e-40e8-b3fa-c82f822377c5 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:49.867855 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a33db166-0ce9-44e9-8b45-ebcac0f5e140 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.482668 Sep 10 11:44:49.870401 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 730/1542] 10.222.0.23 () {60 vars in 1180 bytes} [Sat Sep 10 11:44:48 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:44:49.878554 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-437bc98a-e4db-42ff-95d4-14f9ff560962 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:49.881630 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-437bc98a-e4db-42ff-95d4-14f9ff560962 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:49.906529 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-437bc98a-e4db-42ff-95d4-14f9ff560962 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:49.907504 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-437bc98a-e4db-42ff-95d4-14f9ff560962 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:49.910439 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-437bc98a-e4db-42ff-95d4-14f9ff560962 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:49.911409 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-437bc98a-e4db-42ff-95d4-14f9ff560962 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:49.913140 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-437bc98a-e4db-42ff-95d4-14f9ff560962 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:49.915425 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-437bc98a-e4db-42ff-95d4-14f9ff560962 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:50.568888 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-52b71922-9f9e-40e8-b3fa-c82f822377c5 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:50.585309 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-52b71922-9f9e-40e8-b3fa-c82f822377c5 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:50.587802 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-52b71922-9f9e-40e8-b3fa-c82f822377c5 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:50.595768 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-52b71922-9f9e-40e8-b3fa-c82f822377c5 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1879 microversion: 2.42 time: 0.888383 Sep 10 11:44:50.596583 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 813/1543] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:49 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1879 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:44:50.604915 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6f49b4cb-098a-4ba7-9e43-151711b2757c tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] Action: 'create', calling method: .version_select at 0x7f407370caf0>, body: {"security_group_rule": {"parent_group_id": "a6e1eced-e664-47e7-8dd9-66d0f4143f70", "ip_protocol": "tcp", "from_port": 1450142750, "to_port": 22}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:50.727837 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-437bc98a-e4db-42ff-95d4-14f9ff560962 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:50.742810 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-437bc98a-e4db-42ff-95d4-14f9ff560962 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1391 microversion: 2.1 time: 0.870930 Sep 10 11:44:50.743707 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 731/1544] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:49 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1391 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:50.750215 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-6f49b4cb-098a-4ba7-9e43-151711b2757c tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] HTTP exception thrown: Invalid port range 1450142750:22. Former value cannot be greater than the later Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6f49b4cb-098a-4ba7-9e43-151711b2757c tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] Request method failure captured: Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 146 Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHiq3E4x9-GAX1PKuWAw-2nARlqWHmymBdfNPj0-Dr5iox6K-txX7S5iuW2Ml1I-titOPM0F1RHew2Tg3CeY42AxdP-9nUwZYN5SzxYFeeFP5esUUTGTY5x6s7nnpR7l3ae6NhUwsegwClWpZSWftPyTSGI1lTgvFwHy-OYhXAouID8 Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 8fe59e55f998426cb81a06172d33893f Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1539960326 Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8fe59e55f998426cb81a06172d33893f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8fe59e55f998426cb81a06172d33893f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8fe59e55f998426cb81a06172d33893f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8fe59e55f998426cb81a06172d33893f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1539960326 Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 8fe59e55f998426cb81a06172d33893f Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1539960326 Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: a3fe3d670da04ed39cabbb5b8899efd2 Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: {"security_group_rule": {"parent_group_id": "a6e1eced-e664-47e7-8dd9-66d0f4143f70", "ip_protocol": "tcp", "from_port": 1450142750, "to_port": 22}} Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: exception: Invalid port range 1450142750:22. Former value cannot be greater than the later Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'a6e1eced-e664-47e7-8dd9-66d0f4143f70', 'ip_protocol': 'tcp', 'from_port': 1450142750, 'to_port': 22}}} Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1450142750:22. Former value cannot be greater than the later Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1450142750:22. Former value cannot be greater than the later Sep 10 11:44:50.751999 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:50.758639 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:44:50.758639 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:50.758639 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:50.758639 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:44:50.758639 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:44:50.758639 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:44:50.758639 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:44:50.758639 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1450142750:22. Former value cannot be greater than the later Sep 10 11:44:50.758639 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:50.758639 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6f49b4cb-098a-4ba7-9e43-151711b2757c tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] Returning 400 to user: Invalid port range 1450142750:22. Former value cannot be greater than the later {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:44:50.758639 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6f49b4cb-098a-4ba7-9e43-151711b2757c tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.154596 Sep 10 11:44:50.758639 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 814/1545] 10.222.0.23 () {60 vars in 1195 bytes} [Sat Sep 10 11:44:50 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 157 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:44:50.771146 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6344c66c-bdfd-4488-9253-c0a273f33190 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] Action: 'create', calling method: .version_select at 0x7f40734ef790>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1559121012", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:50.774290 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-6344c66c-bdfd-4488-9253-c0a273f33190 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] HTTP exception thrown: Security group id should be uuid Sep 10 11:44:50.779453 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6852ba54-eb32-4532-9a45-89c88869102b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:50.781663 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6852ba54-eb32-4532-9a45-89c88869102b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6344c66c-bdfd-4488-9253-c0a273f33190 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] Request method failure captured: Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 131 Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHiq3E4x9-GAX1PKuWAw-2nARlqWHmymBdfNPj0-Dr5iox6K-txX7S5iuW2Ml1I-titOPM0F1RHew2Tg3CeY42AxdP-9nUwZYN5SzxYFeeFP5esUUTGTY5x6s7nnpR7l3ae6NhUwsegwClWpZSWftPyTSGI1lTgvFwHy-OYhXAouID8 Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 8fe59e55f998426cb81a06172d33893f Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1539960326 Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8fe59e55f998426cb81a06172d33893f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8fe59e55f998426cb81a06172d33893f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8fe59e55f998426cb81a06172d33893f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8fe59e55f998426cb81a06172d33893f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1539960326 Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 8fe59e55f998426cb81a06172d33893f Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1539960326 Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: a3fe3d670da04ed39cabbb5b8899efd2 Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1559121012", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: exception: Security group id should be uuid Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1559121012', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:44:50.784494 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:44:50.792571 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Sep 10 11:44:50.792571 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:50.792571 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6344c66c-bdfd-4488-9253-c0a273f33190 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] Returning 400 to user: Security group id should be uuid {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:44:50.792571 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6344c66c-bdfd-4488-9253-c0a273f33190 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.023571 Sep 10 11:44:50.794882 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 815/1546] 10.222.0.23 () {60 vars in 1195 bytes} [Sat Sep 10 11:44:50 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 10 11:44:50.798854 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6852ba54-eb32-4532-9a45-89c88869102b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:50.799596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6852ba54-eb32-4532-9a45-89c88869102b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:50.800234 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6852ba54-eb32-4532-9a45-89c88869102b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:50.801735 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6852ba54-eb32-4532-9a45-89c88869102b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:50.802405 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6852ba54-eb32-4532-9a45-89c88869102b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:50.803035 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6852ba54-eb32-4532-9a45-89c88869102b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:50.807701 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2d24bea4-4a6e-415c-abd5-0cbd9dea12ff tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] Action: 'create', calling method: .version_select at 0x7f40734efe50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-906712904", "description": "tempest-description-1974110441"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:51.089100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6852ba54-eb32-4532-9a45-89c88869102b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:51.106033 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6852ba54-eb32-4532-9a45-89c88869102b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1536 microversion: 2.1 time: 0.360248 Sep 10 11:44:51.109081 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 732/1547] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:50 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1536 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:51.633376 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2d24bea4-4a6e-415c-abd5-0cbd9dea12ff tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.833232 Sep 10 11:44:51.635033 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 816/1548] 10.222.0.23 () {60 vars in 1180 bytes} [Sat Sep 10 11:44:50 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:44:51.639504 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ff08ffa0-fa3a-4276-b8ab-8e06bd1b2dfc tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:51.640158 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ff08ffa0-fa3a-4276-b8ab-8e06bd1b2dfc tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:51.652767 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f4c9b881-7fd8-4af5-9b37-ef713cbdab33 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] Action: 'create', calling method: .version_select at 0x7f40730659d0>, body: {"security_group_rule": {"parent_group_id": "58bae744-95e1-4d32-8838-e1fefea7c437", "ip_protocol": "tempest-999-1170815678", "from_port": 22, "to_port": 22}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:51.686888 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff08ffa0-fa3a-4276-b8ab-8e06bd1b2dfc tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:51.690939 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff08ffa0-fa3a-4276-b8ab-8e06bd1b2dfc tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:51.691966 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff08ffa0-fa3a-4276-b8ab-8e06bd1b2dfc tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:51.698092 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff08ffa0-fa3a-4276-b8ab-8e06bd1b2dfc tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:51.701494 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff08ffa0-fa3a-4276-b8ab-8e06bd1b2dfc tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:51.704207 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff08ffa0-fa3a-4276-b8ab-8e06bd1b2dfc tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:51.787338 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-f4c9b881-7fd8-4af5-9b37-ef713cbdab33 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] HTTP exception thrown: Invalid IP protocol tempest-999-1170815678. Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f4c9b881-7fd8-4af5-9b37-ef713cbdab33 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] Request method failure captured: Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 157 Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHiq3E4x9-GAX1PKuWAw-2nARlqWHmymBdfNPj0-Dr5iox6K-txX7S5iuW2Ml1I-titOPM0F1RHew2Tg3CeY42AxdP-9nUwZYN5SzxYFeeFP5esUUTGTY5x6s7nnpR7l3ae6NhUwsegwClWpZSWftPyTSGI1lTgvFwHy-OYhXAouID8 Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 8fe59e55f998426cb81a06172d33893f Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1539960326 Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8fe59e55f998426cb81a06172d33893f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8fe59e55f998426cb81a06172d33893f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8fe59e55f998426cb81a06172d33893f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8fe59e55f998426cb81a06172d33893f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1539960326 Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 8fe59e55f998426cb81a06172d33893f Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1539960326 Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: a3fe3d670da04ed39cabbb5b8899efd2 Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: {"security_group_rule": {"parent_group_id": "58bae744-95e1-4d32-8838-e1fefea7c437", "ip_protocol": "tempest-999-1170815678", "from_port": 22, "to_port": 22}} Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: exception: Invalid IP protocol tempest-999-1170815678. Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'body': {'security_group_rule': {'parent_group_id': '58bae744-95e1-4d32-8838-e1fefea7c437', 'ip_protocol': 'tempest-999-1170815678', 'from_port': 22, 'to_port': 22}}} Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1170815678. Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1170815678. Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:51.789626 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:44:51.795736 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:51.795736 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:51.795736 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:44:51.795736 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:44:51.795736 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:44:51.795736 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:44:51.795736 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1170815678. Sep 10 11:44:51.795736 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:51.797850 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f4c9b881-7fd8-4af5-9b37-ef713cbdab33 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] Returning 400 to user: Invalid IP protocol tempest-999-1170815678. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:44:51.798950 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f4c9b881-7fd8-4af5-9b37-ef713cbdab33 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.155496 Sep 10 11:44:51.799785 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 817/1549] 10.222.0.23 () {60 vars in 1195 bytes} [Sat Sep 10 11:44:51 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 157 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 10 11:44:51.805787 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-646bce62-b239-4640-ac95-d7bfce2692c2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:51.816713 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-646bce62-b239-4640-ac95-d7bfce2692c2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:51.837674 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-646bce62-b239-4640-ac95-d7bfce2692c2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:51.839766 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-646bce62-b239-4640-ac95-d7bfce2692c2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:51.841074 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-646bce62-b239-4640-ac95-d7bfce2692c2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:51.843708 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-646bce62-b239-4640-ac95-d7bfce2692c2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:51.844474 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-646bce62-b239-4640-ac95-d7bfce2692c2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:51.845969 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-646bce62-b239-4640-ac95-d7bfce2692c2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:52.176895 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ff08ffa0-fa3a-4276-b8ab-8e06bd1b2dfc tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:52.205823 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ff08ffa0-fa3a-4276-b8ab-8e06bd1b2dfc tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:52.212083 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ff08ffa0-fa3a-4276-b8ab-8e06bd1b2dfc tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:52.215979 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ff08ffa0-fa3a-4276-b8ab-8e06bd1b2dfc tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1879 microversion: 2.42 time: 0.594305 Sep 10 11:44:52.219359 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 733/1550] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:51 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1879 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:44:52.241909 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c9ec1885-5a40-4143-9c6a-38aa502e8d79 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] Action: 'create', calling method: .version_select at 0x7f407b5ea0d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1767804759", "description": "tempest-description-1770337425"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:52.276339 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-646bce62-b239-4640-ac95-d7bfce2692c2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:52.289204 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-646bce62-b239-4640-ac95-d7bfce2692c2 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1391 microversion: 2.1 time: 0.486711 Sep 10 11:44:52.290873 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 818/1551] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:51 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1391 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:52.303783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-40bb8d81-5678-49a2-a5f5-488f957bd879 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:52.304623 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-40bb8d81-5678-49a2-a5f5-488f957bd879 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:52.320568 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40bb8d81-5678-49a2-a5f5-488f957bd879 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:52.321378 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40bb8d81-5678-49a2-a5f5-488f957bd879 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:52.321994 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40bb8d81-5678-49a2-a5f5-488f957bd879 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:52.326416 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40bb8d81-5678-49a2-a5f5-488f957bd879 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:52.327616 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40bb8d81-5678-49a2-a5f5-488f957bd879 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:52.330227 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40bb8d81-5678-49a2-a5f5-488f957bd879 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:52.614528 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-40bb8d81-5678-49a2-a5f5-488f957bd879 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:52.630949 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-40bb8d81-5678-49a2-a5f5-488f957bd879 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1536 microversion: 2.1 time: 0.338055 Sep 10 11:44:52.632440 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 819/1552] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:52 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1536 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:52.644665 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c9ec1885-5a40-4143-9c6a-38aa502e8d79 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.419058 Sep 10 11:44:52.646071 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 734/1553] 10.222.0.23 () {60 vars in 1180 bytes} [Sat Sep 10 11:44:52 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:44:52.658928 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a9fbb6a7-7e16-49e8-9343-2ee3431869a6 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] Action: 'create', calling method: .version_select at 0x7f407357e0d0>, body: {"security_group_rule": {"parent_group_id": "045ee808-d46c-4517-9390-b431bba0d7a1", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:52.757202 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-a9fbb6a7-7e16-49e8-9343-2ee3431869a6 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a9fbb6a7-7e16-49e8-9343-2ee3431869a6 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] Request method failure captured: Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 138 Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHiq3E4x9-GAX1PKuWAw-2nARlqWHmymBdfNPj0-Dr5iox6K-txX7S5iuW2Ml1I-titOPM0F1RHew2Tg3CeY42AxdP-9nUwZYN5SzxYFeeFP5esUUTGTY5x6s7nnpR7l3ae6NhUwsegwClWpZSWftPyTSGI1lTgvFwHy-OYhXAouID8 Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 8fe59e55f998426cb81a06172d33893f Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1539960326 Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8fe59e55f998426cb81a06172d33893f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8fe59e55f998426cb81a06172d33893f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8fe59e55f998426cb81a06172d33893f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8fe59e55f998426cb81a06172d33893f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1539960326 Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 8fe59e55f998426cb81a06172d33893f Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1539960326 Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: a3fe3d670da04ed39cabbb5b8899efd2 Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: {"security_group_rule": {"parent_group_id": "045ee808-d46c-4517-9390-b431bba0d7a1", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: exception: Invalid port range 22:21. Former value cannot be greater than the later Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'body': {'security_group_rule': {'parent_group_id': '045ee808-d46c-4517-9390-b431bba0d7a1', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Sep 10 11:44:52.758754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:52.764339 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:44:52.764339 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:52.764339 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:52.764339 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:44:52.764339 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:44:52.764339 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:44:52.764339 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:44:52.764339 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Sep 10 11:44:52.764339 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:52.764339 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a9fbb6a7-7e16-49e8-9343-2ee3431869a6 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:44:52.764339 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a9fbb6a7-7e16-49e8-9343-2ee3431869a6 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.105561 Sep 10 11:44:52.772106 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-67b14047-eb29-44b8-9a5b-d71c4703092a tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] Action: 'create', calling method: .version_select at 0x7f407352ff70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2114129172", "description": "tempest-description-363557746"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:52.775522 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 820/1554] 10.222.0.23 () {60 vars in 1195 bytes} [Sat Sep 10 11:44:52 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 121 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:44:53.245429 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0880dc86-a9b1-41be-a61d-4aa9560a1452 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:53.245748 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0880dc86-a9b1-41be-a61d-4aa9560a1452 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:53.270518 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0880dc86-a9b1-41be-a61d-4aa9560a1452 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:53.271035 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0880dc86-a9b1-41be-a61d-4aa9560a1452 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:53.271594 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0880dc86-a9b1-41be-a61d-4aa9560a1452 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:53.272275 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0880dc86-a9b1-41be-a61d-4aa9560a1452 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:53.272819 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0880dc86-a9b1-41be-a61d-4aa9560a1452 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:53.273256 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0880dc86-a9b1-41be-a61d-4aa9560a1452 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:53.287587 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-67b14047-eb29-44b8-9a5b-d71c4703092a tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.519945 Sep 10 11:44:53.297373 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 735/1555] 10.222.0.23 () {60 vars in 1180 bytes} [Sat Sep 10 11:44:52 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:44:53.303380 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-055ca956-561b-4927-9be7-b333da7d8b42 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] Action: 'create', calling method: .version_select at 0x7f40734c4dc0>, body: {"security_group_rule": {"parent_group_id": "46011de2-1311-46ee-b319-39e7eb1a06ab", "ip_protocol": "tcp", "from_port": 22, "to_port": 2054084501}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:53.743789 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-055ca956-561b-4927-9be7-b333da7d8b42 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] HTTP exception thrown: Invalid port range 22:2054084501. Valid TCP ports should be between 1-65535 Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-055ca956-561b-4927-9be7-b333da7d8b42 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] Request method failure captured: Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 146 Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHiq3E4x9-GAX1PKuWAw-2nARlqWHmymBdfNPj0-Dr5iox6K-txX7S5iuW2Ml1I-titOPM0F1RHew2Tg3CeY42AxdP-9nUwZYN5SzxYFeeFP5esUUTGTY5x6s7nnpR7l3ae6NhUwsegwClWpZSWftPyTSGI1lTgvFwHy-OYhXAouID8 Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 8fe59e55f998426cb81a06172d33893f Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1539960326 Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8fe59e55f998426cb81a06172d33893f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8fe59e55f998426cb81a06172d33893f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8fe59e55f998426cb81a06172d33893f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8fe59e55f998426cb81a06172d33893f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1539960326 Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 8fe59e55f998426cb81a06172d33893f Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1539960326 Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: a3fe3d670da04ed39cabbb5b8899efd2 Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: {"security_group_rule": {"parent_group_id": "46011de2-1311-46ee-b319-39e7eb1a06ab", "ip_protocol": "tcp", "from_port": 22, "to_port": 2054084501}} Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: exception: Invalid port range 22:2054084501. Valid TCP ports should be between 1-65535 Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'body': {'security_group_rule': {'parent_group_id': '46011de2-1311-46ee-b319-39e7eb1a06ab', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 2054084501}}} Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:2054084501. Valid TCP ports should be between 1-65535 Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:2054084501. Valid TCP ports should be between 1-65535 Sep 10 11:44:53.745934 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:53.763860 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:44:53.763860 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:53.763860 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:53.763860 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:44:53.763860 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:44:53.763860 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:44:53.763860 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:44:53.763860 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:2054084501. Valid TCP ports should be between 1-65535 Sep 10 11:44:53.763860 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:53.763860 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-055ca956-561b-4927-9be7-b333da7d8b42 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] Returning 400 to user: Invalid port range 22:2054084501. Valid TCP ports should be between 1-65535 {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:44:53.763860 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-055ca956-561b-4927-9be7-b333da7d8b42 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.458415 Sep 10 11:44:53.765623 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 736/1556] 10.222.0.23 () {60 vars in 1195 bytes} [Sat Sep 10 11:44:53 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 467 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:44:53.785371 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1894a400-5969-4de8-a33a-885ac71c9166 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:53.787757 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1894a400-5969-4de8-a33a-885ac71c9166 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:53.809049 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1894a400-5969-4de8-a33a-885ac71c9166 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:53.812135 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1894a400-5969-4de8-a33a-885ac71c9166 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:53.815330 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1894a400-5969-4de8-a33a-885ac71c9166 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:53.817488 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1894a400-5969-4de8-a33a-885ac71c9166 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:53.817978 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1894a400-5969-4de8-a33a-885ac71c9166 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:53.818426 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1894a400-5969-4de8-a33a-885ac71c9166 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:53.857745 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0880dc86-a9b1-41be-a61d-4aa9560a1452 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:53.877570 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0880dc86-a9b1-41be-a61d-4aa9560a1452 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:53.884852 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0880dc86-a9b1-41be-a61d-4aa9560a1452 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:53.886472 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0880dc86-a9b1-41be-a61d-4aa9560a1452 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1879 microversion: 2.42 time: 0.645634 Sep 10 11:44:53.908624 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 821/1557] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:53 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1879 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:44:53.915939 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8121db1b-3a84-4f62-90c5-8919df818c7b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:53.916565 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8121db1b-3a84-4f62-90c5-8919df818c7b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:53.940664 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8121db1b-3a84-4f62-90c5-8919df818c7b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:53.941321 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8121db1b-3a84-4f62-90c5-8919df818c7b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:53.942011 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8121db1b-3a84-4f62-90c5-8919df818c7b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:53.942770 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8121db1b-3a84-4f62-90c5-8919df818c7b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:53.943276 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8121db1b-3a84-4f62-90c5-8919df818c7b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:53.943716 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8121db1b-3a84-4f62-90c5-8919df818c7b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:54.495615 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1894a400-5969-4de8-a33a-885ac71c9166 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:54.506749 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1894a400-5969-4de8-a33a-885ac71c9166 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1391 microversion: 2.1 time: 0.739816 Sep 10 11:44:54.551594 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 737/1558] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:53 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1391 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:54.570988 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-178590ba-02e8-4399-9c76-cca965555214 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] Action: 'create', calling method: .version_select at 0x7f40735cc9d0>, body: {"security_group_rule": {"parent_group_id": "0ab666b1-2791-48e0-93f3-fb526e4c28da", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:44:54.590437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8121db1b-3a84-4f62-90c5-8919df818c7b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:54.599190 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8121db1b-3a84-4f62-90c5-8919df818c7b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1536 microversion: 2.1 time: 0.687057 Sep 10 11:44:54.608759 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 822/1559] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:53 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1536 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:54.686246 n-d-856895-1 devstack@n-api.service[128776]: DEBUG neutronclient.v2_0.client [None req-178590ba-02e8-4399-9c76-cca965555214 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0ab666b1-2791-48e0-93f3-fb526e4c28da does not exist", "detail": ""}} {{(pid=128776) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 11:44:54.687338 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.security_group_api [None req-178590ba-02e8-4399-9c76-cca965555214 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] Neutron security group 0ab666b1-2791-48e0-93f3-fb526e4c28da not found {{(pid=128776) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 11:44:54.688092 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-178590ba-02e8-4399-9c76-cca965555214 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] HTTP exception thrown: Security group 0ab666b1-2791-48e0-93f3-fb526e4c28da does not exist Sep 10 11:44:54.688092 n-d-856895-1 devstack@n-api.service[128776]: Neutron server returns request_ids: ['req-c781e5e6-191b-4300-9e34-3fe5840df5d9'] Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-178590ba-02e8-4399-9c76-cca965555214 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] Request method failure captured: Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 138 Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHiq3E4x9-GAX1PKuWAw-2nARlqWHmymBdfNPj0-Dr5iox6K-txX7S5iuW2Ml1I-titOPM0F1RHew2Tg3CeY42AxdP-9nUwZYN5SzxYFeeFP5esUUTGTY5x6s7nnpR7l3ae6NhUwsegwClWpZSWftPyTSGI1lTgvFwHy-OYhXAouID8 Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 8fe59e55f998426cb81a06172d33893f Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1539960326 Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8fe59e55f998426cb81a06172d33893f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8fe59e55f998426cb81a06172d33893f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8fe59e55f998426cb81a06172d33893f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8fe59e55f998426cb81a06172d33893f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1539960326 Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 8fe59e55f998426cb81a06172d33893f Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1539960326 Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: a3fe3d670da04ed39cabbb5b8899efd2 Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: {"security_group_rule": {"parent_group_id": "0ab666b1-2791-48e0-93f3-fb526e4c28da", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: exception: Security group 0ab666b1-2791-48e0-93f3-fb526e4c28da does not exist Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: Neutron server returns request_ids: ['req-c781e5e6-191b-4300-9e34-3fe5840df5d9'] Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'body': {'security_group_rule': {'parent_group_id': '0ab666b1-2791-48e0-93f3-fb526e4c28da', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 11:44:54.691723 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 11:44:54.697923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 11:44:54.697923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0ab666b1-2791-48e0-93f3-fb526e4c28da does not exist Sep 10 11:44:54.697923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c781e5e6-191b-4300-9e34-3fe5840df5d9'] Sep 10 11:44:54.697923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:54.697923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:44:54.697923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:54.697923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:54.697923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Sep 10 11:44:54.697923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Sep 10 11:44:54.697923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 11:44:54.697923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 11:44:54.697923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0ab666b1-2791-48e0-93f3-fb526e4c28da does not exist Sep 10 11:44:54.697923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c781e5e6-191b-4300-9e34-3fe5840df5d9'] Sep 10 11:44:54.697923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:54.697923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:44:54.697923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:54.697923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:54.697923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:44:54.697923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:44:54.697923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:44:54.697923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:44:54.697923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:44:54.697923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:44:54.697923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:44:54.697923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:44:54.697923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Sep 10 11:44:54.697923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 11:44:54.697923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0ab666b1-2791-48e0-93f3-fb526e4c28da does not exist Sep 10 11:44:54.697923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c781e5e6-191b-4300-9e34-3fe5840df5d9'] Sep 10 11:44:54.697923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:54.697923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:44:54.697923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:54.697923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:54.697923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:44:54.697923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:44:54.697923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:44:54.697923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:44:54.697923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0ab666b1-2791-48e0-93f3-fb526e4c28da does not exist Sep 10 11:44:54.697923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c781e5e6-191b-4300-9e34-3fe5840df5d9'] Sep 10 11:44:54.697923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:44:54.703535 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-178590ba-02e8-4399-9c76-cca965555214 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] Returning 404 to user: Security group 0ab666b1-2791-48e0-93f3-fb526e4c28da does not exist Sep 10 11:44:54.703535 n-d-856895-1 devstack@n-api.service[128776]: Neutron server returns request_ids: ['req-c781e5e6-191b-4300-9e34-3fe5840df5d9'] {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:44:54.704923 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-178590ba-02e8-4399-9c76-cca965555214 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] 10.222.0.23 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.142467 Sep 10 11:44:54.706173 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 738/1560] 10.222.0.23 () {60 vars in 1195 bytes} [Sat Sep 10 11:44:54 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:44:54.717858 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-df2df4b2-fb82-4fbc-b5e9-b049436b27c6 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] Calling method '.version_select at 0x7f4073dfb310>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:54.915663 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-afd84765-f7e1-453d-a5c0-d8bfe934b78e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:54.916590 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-afd84765-f7e1-453d-a5c0-d8bfe934b78e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:54.935056 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-afd84765-f7e1-453d-a5c0-d8bfe934b78e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:54.937729 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-afd84765-f7e1-453d-a5c0-d8bfe934b78e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:54.939837 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-afd84765-f7e1-453d-a5c0-d8bfe934b78e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:54.940943 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-afd84765-f7e1-453d-a5c0-d8bfe934b78e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:54.943253 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-afd84765-f7e1-453d-a5c0-d8bfe934b78e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:54.944168 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-afd84765-f7e1-453d-a5c0-d8bfe934b78e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:55.458910 n-d-856895-1 devstack@n-api.service[128777]: DEBUG neutronclient.v2_0.client [None req-df2df4b2-fb82-4fbc-b5e9-b049436b27c6 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule df8f2fa4-20e3-4032-b15e-076dd27a52b0 does not exist", "detail": ""}} {{(pid=128777) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 11:44:55.460212 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.security_group_api [None req-df2df4b2-fb82-4fbc-b5e9-b049436b27c6 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] Neutron security group rule df8f2fa4-20e3-4032-b15e-076dd27a52b0 not found {{(pid=128777) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Sep 10 11:44:55.461049 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-df2df4b2-fb82-4fbc-b5e9-b049436b27c6 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] HTTP exception thrown: Security group rule df8f2fa4-20e3-4032-b15e-076dd27a52b0 does not exist Sep 10 11:44:55.461049 n-d-856895-1 devstack@n-api.service[128777]: Neutron server returns request_ids: ['req-1e03f5b0-227d-4b1b-8255-a582d2b3a29a'] Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-df2df4b2-fb82-4fbc-b5e9-b049436b27c6 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] Request method failure captured: Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/os-security-group-rules/df8f2fa4-20e3-4032-b15e-076dd27a52b0 HTTP/1.1 Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHiq3E4x9-GAX1PKuWAw-2nARlqWHmymBdfNPj0-Dr5iox6K-txX7S5iuW2Ml1I-titOPM0F1RHew2Tg3CeY42AxdP-9nUwZYN5SzxYFeeFP5esUUTGTY5x6s7nnpR7l3ae6NhUwsegwClWpZSWftPyTSGI1lTgvFwHy-OYhXAouID8 Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 8fe59e55f998426cb81a06172d33893f Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1539960326 Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8fe59e55f998426cb81a06172d33893f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8fe59e55f998426cb81a06172d33893f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8fe59e55f998426cb81a06172d33893f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8fe59e55f998426cb81a06172d33893f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1539960326 Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 8fe59e55f998426cb81a06172d33893f Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1539960326 Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: a3fe3d670da04ed39cabbb5b8899efd2 Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: exception: Security group rule df8f2fa4-20e3-4032-b15e-076dd27a52b0 does not exist Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: Neutron server returns request_ids: ['req-1e03f5b0-227d-4b1b-8255-a582d2b3a29a'] Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'df8f2fa4-20e3-4032-b15e-076dd27a52b0'} Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 11:44:55.464121 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 11:44:55.468664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule df8f2fa4-20e3-4032-b15e-076dd27a52b0 does not exist Sep 10 11:44:55.468664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1e03f5b0-227d-4b1b-8255-a582d2b3a29a'] Sep 10 11:44:55.468664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:55.468664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:44:55.468664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:55.468664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:55.468664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Sep 10 11:44:55.468664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Sep 10 11:44:55.468664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Sep 10 11:44:55.468664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 11:44:55.468664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule df8f2fa4-20e3-4032-b15e-076dd27a52b0 does not exist Sep 10 11:44:55.468664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1e03f5b0-227d-4b1b-8255-a582d2b3a29a'] Sep 10 11:44:55.468664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:55.468664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:44:55.468664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:55.468664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:55.468664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:44:55.468664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:44:55.468664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:44:55.468664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:44:55.468664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:44:55.468664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:44:55.468664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:44:55.468664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:44:55.468664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Sep 10 11:44:55.468664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 11:44:55.468664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule df8f2fa4-20e3-4032-b15e-076dd27a52b0 does not exist Sep 10 11:44:55.468664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1e03f5b0-227d-4b1b-8255-a582d2b3a29a'] Sep 10 11:44:55.468664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:55.468664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:44:55.468664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:55.468664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:44:55.468664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:44:55.468664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:44:55.468664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:44:55.468664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:44:55.468664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule df8f2fa4-20e3-4032-b15e-076dd27a52b0 does not exist Sep 10 11:44:55.468664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1e03f5b0-227d-4b1b-8255-a582d2b3a29a'] Sep 10 11:44:55.468664 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:44:55.472666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-df2df4b2-fb82-4fbc-b5e9-b049436b27c6 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] Returning 404 to user: Security group rule df8f2fa4-20e3-4032-b15e-076dd27a52b0 does not exist Sep 10 11:44:55.472666 n-d-856895-1 devstack@n-api.service[128777]: Neutron server returns request_ids: ['req-1e03f5b0-227d-4b1b-8255-a582d2b3a29a'] {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:44:55.473817 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-df2df4b2-fb82-4fbc-b5e9-b049436b27c6 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-group-rules/df8f2fa4-20e3-4032-b15e-076dd27a52b0" status: 404 len: 199 microversion: 2.1 time: 0.759871 Sep 10 11:44:55.476710 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 823/1561] 10.222.0.23 () {58 vars in 1287 bytes} [Sat Sep 10 11:44:54 2022] DELETE /compute/v2.1/os-security-group-rules/df8f2fa4-20e3-4032-b15e-076dd27a52b0 => generated 199 bytes in 763 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:44:55.494571 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d980371c-86ad-44df-8ab1-02291f95ced0 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] Calling method '.version_select at 0x7f407369d3a0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:56.025166 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-afd84765-f7e1-453d-a5c0-d8bfe934b78e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:56.046100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-afd84765-f7e1-453d-a5c0-d8bfe934b78e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:56.048859 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-afd84765-f7e1-453d-a5c0-d8bfe934b78e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:56.050067 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-afd84765-f7e1-453d-a5c0-d8bfe934b78e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1879 microversion: 2.42 time: 1.140080 Sep 10 11:44:56.055969 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 739/1562] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:54 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1879 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:44:56.067102 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f9c76d4b-b9cd-44bf-b673-472914619c48 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:56.068294 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f9c76d4b-b9cd-44bf-b673-472914619c48 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:56.076349 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f9c76d4b-b9cd-44bf-b673-472914619c48 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:56.077072 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f9c76d4b-b9cd-44bf-b673-472914619c48 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:56.077700 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f9c76d4b-b9cd-44bf-b673-472914619c48 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:56.078421 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f9c76d4b-b9cd-44bf-b673-472914619c48 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:56.078890 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f9c76d4b-b9cd-44bf-b673-472914619c48 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:56.079502 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f9c76d4b-b9cd-44bf-b673-472914619c48 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:56.253374 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d980371c-86ad-44df-8ab1-02291f95ced0 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/46011de2-1311-46ee-b319-39e7eb1a06ab" status: 202 len: 0 microversion: 2.1 time: 0.767167 Sep 10 11:44:56.255029 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 824/1563] 10.222.0.23 () {58 vars in 1272 bytes} [Sat Sep 10 11:44:55 2022] DELETE /compute/v2.1/os-security-groups/46011de2-1311-46ee-b319-39e7eb1a06ab => generated 0 bytes in 770 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:44:56.262990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-299250ea-1f3f-4342-8852-4f75d94ffde7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:56.265702 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-299250ea-1f3f-4342-8852-4f75d94ffde7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:56.284440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-299250ea-1f3f-4342-8852-4f75d94ffde7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:56.290089 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-299250ea-1f3f-4342-8852-4f75d94ffde7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:56.290825 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-299250ea-1f3f-4342-8852-4f75d94ffde7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:56.293169 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-299250ea-1f3f-4342-8852-4f75d94ffde7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:56.294357 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-299250ea-1f3f-4342-8852-4f75d94ffde7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:56.295055 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-299250ea-1f3f-4342-8852-4f75d94ffde7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:56.523680 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f9c76d4b-b9cd-44bf-b673-472914619c48 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:56.540476 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f9c76d4b-b9cd-44bf-b673-472914619c48 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1391 microversion: 2.1 time: 0.479744 Sep 10 11:44:56.558588 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 740/1564] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:56 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1391 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:56.581071 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cd9ae787-cdb7-46d6-9494-c20b54506a94 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] Calling method '.version_select at 0x7f40733f6820>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:56.881591 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-299250ea-1f3f-4342-8852-4f75d94ffde7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:56.892504 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-299250ea-1f3f-4342-8852-4f75d94ffde7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1541 microversion: 2.1 time: 0.635820 Sep 10 11:44:56.893101 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 825/1565] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:56 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1541 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:57.084724 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e19a5c43-93aa-4763-bd5c-db2ef1f61456 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:57.085918 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e19a5c43-93aa-4763-bd5c-db2ef1f61456 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:57.095697 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e19a5c43-93aa-4763-bd5c-db2ef1f61456 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:57.096202 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e19a5c43-93aa-4763-bd5c-db2ef1f61456 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:57.096641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e19a5c43-93aa-4763-bd5c-db2ef1f61456 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:57.099904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e19a5c43-93aa-4763-bd5c-db2ef1f61456 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:57.100615 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e19a5c43-93aa-4763-bd5c-db2ef1f61456 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:57.101247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e19a5c43-93aa-4763-bd5c-db2ef1f61456 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:57.406643 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cd9ae787-cdb7-46d6-9494-c20b54506a94 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/045ee808-d46c-4517-9390-b431bba0d7a1" status: 202 len: 0 microversion: 2.1 time: 0.849090 Sep 10 11:44:57.408965 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 741/1566] 10.222.0.23 () {58 vars in 1272 bytes} [Sat Sep 10 11:44:56 2022] DELETE /compute/v2.1/os-security-groups/045ee808-d46c-4517-9390-b431bba0d7a1 => generated 0 bytes in 852 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:44:57.429227 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-09ec7e10-72d6-4e1d-8489-a9de9a8b4ac2 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] Calling method '.version_select at 0x7f40733f6f70>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:57.686450 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e19a5c43-93aa-4763-bd5c-db2ef1f61456 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:57.711692 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e19a5c43-93aa-4763-bd5c-db2ef1f61456 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:57.713847 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e19a5c43-93aa-4763-bd5c-db2ef1f61456 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:57.725162 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e19a5c43-93aa-4763-bd5c-db2ef1f61456 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1879 microversion: 2.42 time: 0.636648 Sep 10 11:44:57.726212 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 826/1567] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:57 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1879 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:44:57.731391 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3525c799-e1ba-4516-9c02-fb97ef59bd5c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:57.732296 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3525c799-e1ba-4516-9c02-fb97ef59bd5c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:57.746920 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3525c799-e1ba-4516-9c02-fb97ef59bd5c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:57.747935 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3525c799-e1ba-4516-9c02-fb97ef59bd5c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:57.748593 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3525c799-e1ba-4516-9c02-fb97ef59bd5c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:57.754229 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3525c799-e1ba-4516-9c02-fb97ef59bd5c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:57.755024 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3525c799-e1ba-4516-9c02-fb97ef59bd5c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:57.755830 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3525c799-e1ba-4516-9c02-fb97ef59bd5c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:57.771310 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:44:58.032757 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-09ec7e10-72d6-4e1d-8489-a9de9a8b4ac2 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/58bae744-95e1-4d32-8838-e1fefea7c437" status: 202 len: 0 microversion: 2.1 time: 0.617529 Sep 10 11:44:58.037983 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 742/1568] 10.222.0.23 () {58 vars in 1272 bytes} [Sat Sep 10 11:44:57 2022] DELETE /compute/v2.1/os-security-groups/58bae744-95e1-4d32-8838-e1fefea7c437 => generated 0 bytes in 624 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:44:58.044672 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5ff72139-dc33-499a-b818-0dd99ad9f795 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:58.045494 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5ff72139-dc33-499a-b818-0dd99ad9f795 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:58.060247 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ff72139-dc33-499a-b818-0dd99ad9f795 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:58.063304 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ff72139-dc33-499a-b818-0dd99ad9f795 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:58.065926 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ff72139-dc33-499a-b818-0dd99ad9f795 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:58.066932 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ff72139-dc33-499a-b818-0dd99ad9f795 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:58.068448 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ff72139-dc33-499a-b818-0dd99ad9f795 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:58.070383 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ff72139-dc33-499a-b818-0dd99ad9f795 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:58.262714 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3525c799-e1ba-4516-9c02-fb97ef59bd5c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:58.272431 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3525c799-e1ba-4516-9c02-fb97ef59bd5c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1391 microversion: 2.1 time: 0.544795 Sep 10 11:44:58.275677 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 827/1569] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:57 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1391 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:58.286853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f8191f61-69bb-4323-bed2-82fbbe8a76c3 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] Calling method '.version_select at 0x7f40738cfb80>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:58.600925 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5ff72139-dc33-499a-b818-0dd99ad9f795 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:58.613187 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5ff72139-dc33-499a-b818-0dd99ad9f795 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1541 microversion: 2.1 time: 0.573894 Sep 10 11:44:58.618460 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 743/1570] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:58 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1541 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:44:58.757828 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b3dcfb27-7515-4206-baf1-7d9e55f65864 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:58.758726 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b3dcfb27-7515-4206-baf1-7d9e55f65864 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:58.770035 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b3dcfb27-7515-4206-baf1-7d9e55f65864 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:58.775214 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b3dcfb27-7515-4206-baf1-7d9e55f65864 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:58.778388 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b3dcfb27-7515-4206-baf1-7d9e55f65864 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:58.780598 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b3dcfb27-7515-4206-baf1-7d9e55f65864 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:58.784373 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b3dcfb27-7515-4206-baf1-7d9e55f65864 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:58.789787 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b3dcfb27-7515-4206-baf1-7d9e55f65864 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:59.176161 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f8191f61-69bb-4323-bed2-82fbbe8a76c3 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/a6e1eced-e664-47e7-8dd9-66d0f4143f70" status: 202 len: 0 microversion: 2.1 time: 0.898277 Sep 10 11:44:59.184953 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 828/1571] 10.222.0.23 () {58 vars in 1272 bytes} [Sat Sep 10 11:44:58 2022] DELETE /compute/v2.1/os-security-groups/a6e1eced-e664-47e7-8dd9-66d0f4143f70 => generated 0 bytes in 909 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:44:59.195583 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0d3897a6-5c2b-4af2-9b45-6eb752274e46 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] Calling method '.version_select at 0x7f407369d430>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:59.318319 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b3dcfb27-7515-4206-baf1-7d9e55f65864 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:59.342666 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b3dcfb27-7515-4206-baf1-7d9e55f65864 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:59.344459 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b3dcfb27-7515-4206-baf1-7d9e55f65864 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:44:59.351231 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b3dcfb27-7515-4206-baf1-7d9e55f65864 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1879 microversion: 2.42 time: 0.599958 Sep 10 11:44:59.369331 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 744/1572] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:44:58 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1879 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:44:59.378511 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1bb3aa2d-c35a-4590-86c7-2f8fabd67081 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:44:59.385209 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1bb3aa2d-c35a-4590-86c7-2f8fabd67081 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:44:59.396600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1bb3aa2d-c35a-4590-86c7-2f8fabd67081 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:59.402818 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1bb3aa2d-c35a-4590-86c7-2f8fabd67081 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:59.403714 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1bb3aa2d-c35a-4590-86c7-2f8fabd67081 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:44:59.404713 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1bb3aa2d-c35a-4590-86c7-2f8fabd67081 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:44:59.405400 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1bb3aa2d-c35a-4590-86c7-2f8fabd67081 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:44:59.406065 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1bb3aa2d-c35a-4590-86c7-2f8fabd67081 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:00.423558 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1bb3aa2d-c35a-4590-86c7-2f8fabd67081 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:00.440546 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1bb3aa2d-c35a-4590-86c7-2f8fabd67081 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1391 microversion: 2.1 time: 1.068984 Sep 10 11:45:00.454167 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 745/1573] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:44:59 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1391 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:00.484698 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-56e6f36f-1bb7-481e-a414-fc293af35f87 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:00.486314 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-56e6f36f-1bb7-481e-a414-fc293af35f87 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:00.509462 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-56e6f36f-1bb7-481e-a414-fc293af35f87 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:00.510195 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-56e6f36f-1bb7-481e-a414-fc293af35f87 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:00.511070 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-56e6f36f-1bb7-481e-a414-fc293af35f87 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:00.513246 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-56e6f36f-1bb7-481e-a414-fc293af35f87 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:00.515910 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-56e6f36f-1bb7-481e-a414-fc293af35f87 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:00.516484 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-56e6f36f-1bb7-481e-a414-fc293af35f87 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:00.672434 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0d3897a6-5c2b-4af2-9b45-6eb752274e46 tempest-SecurityGroupRulesNegativeTestJSON-1539960326 tempest-SecurityGroupRulesNegativeTestJSON-1539960326-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/c4ddce47-0ba9-445c-89e6-db02cd30ac40" status: 202 len: 0 microversion: 2.1 time: 1.481625 Sep 10 11:45:00.674136 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 829/1574] 10.222.0.23 () {58 vars in 1272 bytes} [Sat Sep 10 11:44:59 2022] DELETE /compute/v2.1/os-security-groups/c4ddce47-0ba9-445c-89e6-db02cd30ac40 => generated 0 bytes in 1488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:45:00.681262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-235adb66-19e0-4a2e-ae92-ff37d601baa7 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:00.683541 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-235adb66-19e0-4a2e-ae92-ff37d601baa7 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:00.718435 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-235adb66-19e0-4a2e-ae92-ff37d601baa7 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:00.718958 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-235adb66-19e0-4a2e-ae92-ff37d601baa7 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:00.719683 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-235adb66-19e0-4a2e-ae92-ff37d601baa7 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:00.721180 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-235adb66-19e0-4a2e-ae92-ff37d601baa7 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:00.721649 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-235adb66-19e0-4a2e-ae92-ff37d601baa7 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:00.725387 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-235adb66-19e0-4a2e-ae92-ff37d601baa7 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:01.642936 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-56e6f36f-1bb7-481e-a414-fc293af35f87 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:01.658320 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-56e6f36f-1bb7-481e-a414-fc293af35f87 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1541 microversion: 2.1 time: 1.210131 Sep 10 11:45:01.660670 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 746/1575] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:00 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1541 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:01.672329 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c7656498-c96c-4ed5-9e68-ec84e6c221aa tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:01.674357 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c7656498-c96c-4ed5-9e68-ec84e6c221aa tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:01.681144 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:45:01.697914 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c7656498-c96c-4ed5-9e68-ec84e6c221aa tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:01.700879 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c7656498-c96c-4ed5-9e68-ec84e6c221aa tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:01.701420 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c7656498-c96c-4ed5-9e68-ec84e6c221aa tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:01.704062 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c7656498-c96c-4ed5-9e68-ec84e6c221aa tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:01.705220 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c7656498-c96c-4ed5-9e68-ec84e6c221aa tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:01.705676 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c7656498-c96c-4ed5-9e68-ec84e6c221aa tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:01.740317 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-235adb66-19e0-4a2e-ae92-ff37d601baa7 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:01.768574 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-235adb66-19e0-4a2e-ae92-ff37d601baa7 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:01.773821 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-235adb66-19e0-4a2e-ae92-ff37d601baa7 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:01.783447 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-235adb66-19e0-4a2e-ae92-ff37d601baa7 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1879 microversion: 2.42 time: 1.105061 Sep 10 11:45:01.785643 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 830/1576] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:00 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1879 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:45:02.196945 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c7656498-c96c-4ed5-9e68-ec84e6c221aa tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:02.211937 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c7656498-c96c-4ed5-9e68-ec84e6c221aa tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1391 microversion: 2.1 time: 0.548226 Sep 10 11:45:02.213115 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 747/1577] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:01 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1391 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:02.688645 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cefa2df9-66d2-4f6c-90b9-ea7ba98249db tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:02.692296 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cefa2df9-66d2-4f6c-90b9-ea7ba98249db tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:02.707460 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cefa2df9-66d2-4f6c-90b9-ea7ba98249db tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:02.708307 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cefa2df9-66d2-4f6c-90b9-ea7ba98249db tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:02.709010 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cefa2df9-66d2-4f6c-90b9-ea7ba98249db tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:02.712678 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cefa2df9-66d2-4f6c-90b9-ea7ba98249db tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:02.713987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cefa2df9-66d2-4f6c-90b9-ea7ba98249db tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:02.715888 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cefa2df9-66d2-4f6c-90b9-ea7ba98249db tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:02.822552 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ff8b4e20-a343-4f5e-a682-0291d2ac363d tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:02.824031 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ff8b4e20-a343-4f5e-a682-0291d2ac363d tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:02.842468 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff8b4e20-a343-4f5e-a682-0291d2ac363d tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:02.851446 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff8b4e20-a343-4f5e-a682-0291d2ac363d tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:02.852507 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff8b4e20-a343-4f5e-a682-0291d2ac363d tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:02.853961 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff8b4e20-a343-4f5e-a682-0291d2ac363d tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:02.854619 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff8b4e20-a343-4f5e-a682-0291d2ac363d tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:02.855266 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff8b4e20-a343-4f5e-a682-0291d2ac363d tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:04.102334 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cefa2df9-66d2-4f6c-90b9-ea7ba98249db tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:04.111072 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cefa2df9-66d2-4f6c-90b9-ea7ba98249db tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1541 microversion: 2.1 time: 1.426742 Sep 10 11:45:04.112109 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 831/1578] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:02 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1541 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:04.122424 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-87539e2f-19ff-4294-9b17-788037ad3966 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:04.123042 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-87539e2f-19ff-4294-9b17-788037ad3966 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:04.136659 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87539e2f-19ff-4294-9b17-788037ad3966 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:04.143226 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87539e2f-19ff-4294-9b17-788037ad3966 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:04.143865 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87539e2f-19ff-4294-9b17-788037ad3966 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:04.145610 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87539e2f-19ff-4294-9b17-788037ad3966 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:04.146181 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87539e2f-19ff-4294-9b17-788037ad3966 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:04.146713 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87539e2f-19ff-4294-9b17-788037ad3966 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:04.373240 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ff8b4e20-a343-4f5e-a682-0291d2ac363d tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:04.391589 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ff8b4e20-a343-4f5e-a682-0291d2ac363d tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:04.403976 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ff8b4e20-a343-4f5e-a682-0291d2ac363d tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:04.406125 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ff8b4e20-a343-4f5e-a682-0291d2ac363d tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1879 microversion: 2.42 time: 1.590654 Sep 10 11:45:04.416663 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 748/1579] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:02 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1879 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:45:04.841495 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-87539e2f-19ff-4294-9b17-788037ad3966 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:04.853329 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-87539e2f-19ff-4294-9b17-788037ad3966 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1391 microversion: 2.1 time: 0.740015 Sep 10 11:45:04.853933 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 832/1580] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:04 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1391 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:05.137929 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-dcec1ef9-a24f-40bd-a642-1b68b4e05049 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:05.138599 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-dcec1ef9-a24f-40bd-a642-1b68b4e05049 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:05.153152 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dcec1ef9-a24f-40bd-a642-1b68b4e05049 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:05.155342 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dcec1ef9-a24f-40bd-a642-1b68b4e05049 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:05.155794 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dcec1ef9-a24f-40bd-a642-1b68b4e05049 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:05.156526 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dcec1ef9-a24f-40bd-a642-1b68b4e05049 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:05.157175 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dcec1ef9-a24f-40bd-a642-1b68b4e05049 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:05.157397 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dcec1ef9-a24f-40bd-a642-1b68b4e05049 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:05.215611 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-ceb42ac1-727b-48e3-83e9-cd2f5fb91e1f req-50eb8976-4731-44ae-82da-44d008a25bd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cb195e0-436b-4ffc-8819-fdac586f6896", "name": "network-vif-unplugged", "status": "completed", "tag": "b191a802-e810-409f-980f-c88296d62dea"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:45:05.257562 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ceb42ac1-727b-48e3-83e9-cd2f5fb91e1f req-50eb8976-4731-44ae-82da-44d008a25bd5 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:05.261088 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ceb42ac1-727b-48e3-83e9-cd2f5fb91e1f req-50eb8976-4731-44ae-82da-44d008a25bd5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:05.265492 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ceb42ac1-727b-48e3-83e9-cd2f5fb91e1f req-50eb8976-4731-44ae-82da-44d008a25bd5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:05.316086 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-ceb42ac1-727b-48e3-83e9-cd2f5fb91e1f req-50eb8976-4731-44ae-82da-44d008a25bd5 service nova] Creating event network-vif-unplugged:b191a802-e810-409f-980f-c88296d62dea for instance 6cb195e0-436b-4ffc-8819-fdac586f6896 on n-h2-856895-1 Sep 10 11:45:05.327329 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-ceb42ac1-727b-48e3-83e9-cd2f5fb91e1f req-50eb8976-4731-44ae-82da-44d008a25bd5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.610938 Sep 10 11:45:05.328992 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 749/1581] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:45:05.453830 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-78126a7f-2852-4616-95e9-f2bd6de71a81 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:05.457501 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-78126a7f-2852-4616-95e9-f2bd6de71a81 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:05.473838 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-78126a7f-2852-4616-95e9-f2bd6de71a81 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:05.475510 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-78126a7f-2852-4616-95e9-f2bd6de71a81 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:05.477642 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-78126a7f-2852-4616-95e9-f2bd6de71a81 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:05.478631 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-78126a7f-2852-4616-95e9-f2bd6de71a81 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:05.480570 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-78126a7f-2852-4616-95e9-f2bd6de71a81 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:05.482234 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-78126a7f-2852-4616-95e9-f2bd6de71a81 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:05.766503 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-dcec1ef9-a24f-40bd-a642-1b68b4e05049 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:05.779407 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-dcec1ef9-a24f-40bd-a642-1b68b4e05049 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1541 microversion: 2.1 time: 0.645205 Sep 10 11:45:05.784053 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 833/1582] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:05 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1541 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:45:05.881710 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b1672476-e92e-4870-85c9-1be49df37d56 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:05.885147 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b1672476-e92e-4870-85c9-1be49df37d56 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:05.898535 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1672476-e92e-4870-85c9-1be49df37d56 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:05.906308 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1672476-e92e-4870-85c9-1be49df37d56 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:05.907001 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1672476-e92e-4870-85c9-1be49df37d56 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:05.910328 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1672476-e92e-4870-85c9-1be49df37d56 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:05.918921 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1672476-e92e-4870-85c9-1be49df37d56 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:05.920550 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1672476-e92e-4870-85c9-1be49df37d56 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:06.501244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-78126a7f-2852-4616-95e9-f2bd6de71a81 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:06.529380 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-78126a7f-2852-4616-95e9-f2bd6de71a81 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:06.540919 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-78126a7f-2852-4616-95e9-f2bd6de71a81 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:06.546686 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-78126a7f-2852-4616-95e9-f2bd6de71a81 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1879 microversion: 2.42 time: 1.098067 Sep 10 11:45:06.570335 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 750/1583] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:05 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1879 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:45:06.814396 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f1dc7642-7e8f-429b-9117-cd48c1a755fa tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:06.815407 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f1dc7642-7e8f-429b-9117-cd48c1a755fa tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:06.824058 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1dc7642-7e8f-429b-9117-cd48c1a755fa tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:06.825340 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1dc7642-7e8f-429b-9117-cd48c1a755fa tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:06.826002 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1dc7642-7e8f-429b-9117-cd48c1a755fa tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:06.827577 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1dc7642-7e8f-429b-9117-cd48c1a755fa tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:06.828460 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1dc7642-7e8f-429b-9117-cd48c1a755fa tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:06.829122 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1dc7642-7e8f-429b-9117-cd48c1a755fa tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:07.600278 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b1672476-e92e-4870-85c9-1be49df37d56 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:07.610935 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b1672476-e92e-4870-85c9-1be49df37d56 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1391 microversion: 2.1 time: 1.733870 Sep 10 11:45:07.616634 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 834/1584] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:05 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1391 bytes in 1740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:45:07.628421 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-0be165d8-6eaa-40c8-8f1e-9c5f200a5815 req-c57916e9-2007-41f5-a8e2-2c02a5968896 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cb195e0-436b-4ffc-8819-fdac586f6896", "tag": "b191a802-e810-409f-980f-c88296d62dea"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:45:07.655513 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0be165d8-6eaa-40c8-8f1e-9c5f200a5815 req-c57916e9-2007-41f5-a8e2-2c02a5968896 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:07.656364 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0be165d8-6eaa-40c8-8f1e-9c5f200a5815 req-c57916e9-2007-41f5-a8e2-2c02a5968896 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:07.660630 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0be165d8-6eaa-40c8-8f1e-9c5f200a5815 req-c57916e9-2007-41f5-a8e2-2c02a5968896 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:07.679685 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-0be165d8-6eaa-40c8-8f1e-9c5f200a5815 req-c57916e9-2007-41f5-a8e2-2c02a5968896 service nova] Creating event network-changed:b191a802-e810-409f-980f-c88296d62dea for instance 6cb195e0-436b-4ffc-8819-fdac586f6896 on n-h2-856895-1 Sep 10 11:45:07.689504 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-0be165d8-6eaa-40c8-8f1e-9c5f200a5815 req-c57916e9-2007-41f5-a8e2-2c02a5968896 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068789 Sep 10 11:45:07.691719 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 835/1585] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:45:07.719829 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0c2d1ca4-e825-4f7c-98e4-0a68073125a3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:07.723830 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0c2d1ca4-e825-4f7c-98e4-0a68073125a3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:07.733245 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c2d1ca4-e825-4f7c-98e4-0a68073125a3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:07.734159 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c2d1ca4-e825-4f7c-98e4-0a68073125a3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:07.734767 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c2d1ca4-e825-4f7c-98e4-0a68073125a3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:07.735777 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c2d1ca4-e825-4f7c-98e4-0a68073125a3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:07.736689 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c2d1ca4-e825-4f7c-98e4-0a68073125a3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:07.737375 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c2d1ca4-e825-4f7c-98e4-0a68073125a3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:07.744260 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f1dc7642-7e8f-429b-9117-cd48c1a755fa tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:07.772119 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f1dc7642-7e8f-429b-9117-cd48c1a755fa tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1541 microversion: 2.1 time: 0.965096 Sep 10 11:45:07.773837 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 751/1586] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:06 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1541 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:45:08.384345 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0c2d1ca4-e825-4f7c-98e4-0a68073125a3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:08.397087 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0c2d1ca4-e825-4f7c-98e4-0a68073125a3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:08.398547 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0c2d1ca4-e825-4f7c-98e4-0a68073125a3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:08.415562 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0c2d1ca4-e825-4f7c-98e4-0a68073125a3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1879 microversion: 2.42 time: 0.720982 Sep 10 11:45:08.416494 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 836/1587] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:07 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1879 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:45:08.643197 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3c0e6182-c521-438d-a911-1df24d9e276c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:08.644819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3c0e6182-c521-438d-a911-1df24d9e276c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:08.661104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3c0e6182-c521-438d-a911-1df24d9e276c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:08.661615 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3c0e6182-c521-438d-a911-1df24d9e276c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:08.662059 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3c0e6182-c521-438d-a911-1df24d9e276c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:08.663039 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3c0e6182-c521-438d-a911-1df24d9e276c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:08.663738 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3c0e6182-c521-438d-a911-1df24d9e276c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:08.664730 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3c0e6182-c521-438d-a911-1df24d9e276c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:08.806182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-942ec018-15e6-4376-b79f-b4372eb5430f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:08.807190 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-942ec018-15e6-4376-b79f-b4372eb5430f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:08.829477 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-942ec018-15e6-4376-b79f-b4372eb5430f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:08.830049 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-942ec018-15e6-4376-b79f-b4372eb5430f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:08.830338 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-942ec018-15e6-4376-b79f-b4372eb5430f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:08.831090 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-942ec018-15e6-4376-b79f-b4372eb5430f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:08.831631 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-942ec018-15e6-4376-b79f-b4372eb5430f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:08.832066 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-942ec018-15e6-4376-b79f-b4372eb5430f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:09.422070 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-942ec018-15e6-4376-b79f-b4372eb5430f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:09.436847 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-942ec018-15e6-4376-b79f-b4372eb5430f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1541 microversion: 2.1 time: 0.641130 Sep 10 11:45:09.438848 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 837/1588] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:08 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1541 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:09.464293 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3c0e6182-c521-438d-a911-1df24d9e276c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:09.465442 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-25289024-5a7c-4e98-b3f6-a583fe66b0b4 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:09.466275 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-25289024-5a7c-4e98-b3f6-a583fe66b0b4 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:09.473556 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25289024-5a7c-4e98-b3f6-a583fe66b0b4 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:09.474555 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25289024-5a7c-4e98-b3f6-a583fe66b0b4 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:09.475851 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25289024-5a7c-4e98-b3f6-a583fe66b0b4 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:09.477383 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25289024-5a7c-4e98-b3f6-a583fe66b0b4 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:09.478041 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25289024-5a7c-4e98-b3f6-a583fe66b0b4 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:09.479135 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25289024-5a7c-4e98-b3f6-a583fe66b0b4 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:09.497119 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3c0e6182-c521-438d-a911-1df24d9e276c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1391 microversion: 2.1 time: 0.857645 Sep 10 11:45:09.501574 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 752/1589] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:08 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1391 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:09.881510 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-25289024-5a7c-4e98-b3f6-a583fe66b0b4 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:09.907100 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-25289024-5a7c-4e98-b3f6-a583fe66b0b4 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:09.911013 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-25289024-5a7c-4e98-b3f6-a583fe66b0b4 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:09.914470 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-25289024-5a7c-4e98-b3f6-a583fe66b0b4 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1879 microversion: 2.42 time: 0.452709 Sep 10 11:45:09.915891 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 838/1590] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:09 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1879 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:45:10.463577 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-92506499-2530-4018-98d9-54f75ade9676 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:10.464214 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-92506499-2530-4018-98d9-54f75ade9676 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:10.496167 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-92506499-2530-4018-98d9-54f75ade9676 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:10.497505 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-92506499-2530-4018-98d9-54f75ade9676 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:10.498127 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-92506499-2530-4018-98d9-54f75ade9676 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:10.499078 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-92506499-2530-4018-98d9-54f75ade9676 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:10.499788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-92506499-2530-4018-98d9-54f75ade9676 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:10.500454 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-92506499-2530-4018-98d9-54f75ade9676 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:10.529396 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e6ad7c05-d110-4b2f-ba18-4c5158357ce1 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:10.530500 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e6ad7c05-d110-4b2f-ba18-4c5158357ce1 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:10.542925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e6ad7c05-d110-4b2f-ba18-4c5158357ce1 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:10.545716 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e6ad7c05-d110-4b2f-ba18-4c5158357ce1 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:10.548829 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e6ad7c05-d110-4b2f-ba18-4c5158357ce1 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:10.549993 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e6ad7c05-d110-4b2f-ba18-4c5158357ce1 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:10.552987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e6ad7c05-d110-4b2f-ba18-4c5158357ce1 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:10.553667 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e6ad7c05-d110-4b2f-ba18-4c5158357ce1 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:10.565070 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:45:11.057045 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-92506499-2530-4018-98d9-54f75ade9676 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:11.069228 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-92506499-2530-4018-98d9-54f75ade9676 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1541 microversion: 2.1 time: 0.609706 Sep 10 11:45:11.069838 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 753/1591] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:10 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1541 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:11.074385 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3dbbe93f-4e75-4491-b1a2-256ab5769cd8 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:11.092882 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3dbbe93f-4e75-4491-b1a2-256ab5769cd8 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:11.125739 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3dbbe93f-4e75-4491-b1a2-256ab5769cd8 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:11.126709 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3dbbe93f-4e75-4491-b1a2-256ab5769cd8 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:11.127447 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3dbbe93f-4e75-4491-b1a2-256ab5769cd8 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:11.135419 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3dbbe93f-4e75-4491-b1a2-256ab5769cd8 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:11.136414 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3dbbe93f-4e75-4491-b1a2-256ab5769cd8 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:11.141664 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3dbbe93f-4e75-4491-b1a2-256ab5769cd8 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:11.269918 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e6ad7c05-d110-4b2f-ba18-4c5158357ce1 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:11.282322 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e6ad7c05-d110-4b2f-ba18-4c5158357ce1 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1391 microversion: 2.1 time: 0.755617 Sep 10 11:45:11.286852 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 839/1592] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:10 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1391 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:45:11.578937 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-13a445fc-939c-4f42-b4d3-4efe3aeac7f5 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Action: 'create', calling method: .version_select at 0x7f407368b670>, body: {"keypair": {"name": "tempest-keypair-1352233681", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMyTU20UR56zmy+WO4CWJoZBd10WVB5q39rgDxQVulHsLnRIwtMQL790CZyUhX7rPVp/MtZUBrjOLn/O5+cP9IEwjyocrUtKLHTvwbT1lSwGHd/G43Gz58pLtQMtAtT1A=="}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:45:11.600831 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=66 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:45:11.637050 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-13a445fc-939c-4f42-b4d3-4efe3aeac7f5 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Getting quotas for project 99f601d0bb424da4bb02b532ac982878. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:45:11.650922 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-13a445fc-939c-4f42-b4d3-4efe3aeac7f5 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Getting quotas for user 91ea7c11febf451da4f1faf4dff9471d and project 99f601d0bb424da4bb02b532ac982878. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:45:11.742464 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-13a445fc-939c-4f42-b4d3-4efe3aeac7f5 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.353860 Sep 10 11:45:11.743311 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 840/1593] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 11:45:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:45:11.994063 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3dbbe93f-4e75-4491-b1a2-256ab5769cd8 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:12.012248 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3dbbe93f-4e75-4491-b1a2-256ab5769cd8 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:12.018540 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3dbbe93f-4e75-4491-b1a2-256ab5769cd8 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:12.023511 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3dbbe93f-4e75-4491-b1a2-256ab5769cd8 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1879 microversion: 2.42 time: 0.952552 Sep 10 11:45:12.024137 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 754/1594] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:11 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1879 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:45:12.097745 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5f31ab58-dc6d-4ac5-b3f8-81fb741f0b62 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:12.098902 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5f31ab58-dc6d-4ac5-b3f8-81fb741f0b62 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:12.120448 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5f31ab58-dc6d-4ac5-b3f8-81fb741f0b62 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:12.124936 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5f31ab58-dc6d-4ac5-b3f8-81fb741f0b62 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:12.127756 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5f31ab58-dc6d-4ac5-b3f8-81fb741f0b62 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:12.137729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5f31ab58-dc6d-4ac5-b3f8-81fb741f0b62 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:12.138174 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5f31ab58-dc6d-4ac5-b3f8-81fb741f0b62 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:12.145875 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5f31ab58-dc6d-4ac5-b3f8-81fb741f0b62 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:12.310091 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e61c4d26-e8df-4b4d-8597-58f76b26ba6a tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:12.313373 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e61c4d26-e8df-4b4d-8597-58f76b26ba6a tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:12.326593 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e61c4d26-e8df-4b4d-8597-58f76b26ba6a tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:12.335260 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e61c4d26-e8df-4b4d-8597-58f76b26ba6a tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:12.335818 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e61c4d26-e8df-4b4d-8597-58f76b26ba6a tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:12.337951 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e61c4d26-e8df-4b4d-8597-58f76b26ba6a tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:12.338443 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e61c4d26-e8df-4b4d-8597-58f76b26ba6a tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:12.351420 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e61c4d26-e8df-4b4d-8597-58f76b26ba6a tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:13.263274 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5f31ab58-dc6d-4ac5-b3f8-81fb741f0b62 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:13.281861 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5f31ab58-dc6d-4ac5-b3f8-81fb741f0b62 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1541 microversion: 2.1 time: 1.188769 Sep 10 11:45:13.301945 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 841/1595] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:12 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1541 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:13.320270 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-59dd7e74-9ebf-4d56-9c8f-f4d7d19fd463 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:13.325933 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-59dd7e74-9ebf-4d56-9c8f-f4d7d19fd463 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:13.355358 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59dd7e74-9ebf-4d56-9c8f-f4d7d19fd463 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:13.356291 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59dd7e74-9ebf-4d56-9c8f-f4d7d19fd463 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:13.358803 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59dd7e74-9ebf-4d56-9c8f-f4d7d19fd463 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:13.359798 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59dd7e74-9ebf-4d56-9c8f-f4d7d19fd463 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:13.360549 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59dd7e74-9ebf-4d56-9c8f-f4d7d19fd463 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:13.363018 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59dd7e74-9ebf-4d56-9c8f-f4d7d19fd463 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:13.395436 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e61c4d26-e8df-4b4d-8597-58f76b26ba6a tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:13.411217 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e61c4d26-e8df-4b4d-8597-58f76b26ba6a tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1391 microversion: 2.1 time: 1.098842 Sep 10 11:45:13.419601 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 755/1596] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:12 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1391 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:45:13.848979 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-59dd7e74-9ebf-4d56-9c8f-f4d7d19fd463 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:13.882158 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-59dd7e74-9ebf-4d56-9c8f-f4d7d19fd463 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:13.884615 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-59dd7e74-9ebf-4d56-9c8f-f4d7d19fd463 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:13.890342 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-59dd7e74-9ebf-4d56-9c8f-f4d7d19fd463 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1879 microversion: 2.42 time: 0.587038 Sep 10 11:45:13.894564 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 842/1597] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:13 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1879 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:45:14.313626 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2cc70c56-a02d-4e93-900c-993f84e56156 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:14.314250 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2cc70c56-a02d-4e93-900c-993f84e56156 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:14.333309 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2cc70c56-a02d-4e93-900c-993f84e56156 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:14.333822 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2cc70c56-a02d-4e93-900c-993f84e56156 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:14.334268 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2cc70c56-a02d-4e93-900c-993f84e56156 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:14.342071 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2cc70c56-a02d-4e93-900c-993f84e56156 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:14.342783 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2cc70c56-a02d-4e93-900c-993f84e56156 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:14.343452 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2cc70c56-a02d-4e93-900c-993f84e56156 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:14.442315 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8e47ec3b-3045-4d6b-ae0f-5ef9d52aa4b7 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:14.442945 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8e47ec3b-3045-4d6b-ae0f-5ef9d52aa4b7 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:14.460229 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e47ec3b-3045-4d6b-ae0f-5ef9d52aa4b7 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:14.467572 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e47ec3b-3045-4d6b-ae0f-5ef9d52aa4b7 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:14.468284 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e47ec3b-3045-4d6b-ae0f-5ef9d52aa4b7 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:14.469411 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e47ec3b-3045-4d6b-ae0f-5ef9d52aa4b7 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:14.470465 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e47ec3b-3045-4d6b-ae0f-5ef9d52aa4b7 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:14.474159 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e47ec3b-3045-4d6b-ae0f-5ef9d52aa4b7 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:14.800350 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2cc70c56-a02d-4e93-900c-993f84e56156 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:14.815319 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2cc70c56-a02d-4e93-900c-993f84e56156 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1541 microversion: 2.1 time: 0.505322 Sep 10 11:45:14.835638 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 756/1598] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:14 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1541 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:14.927368 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d757c954-6a23-42ab-a50e-d81252b2adfd tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:14.928518 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d757c954-6a23-42ab-a50e-d81252b2adfd tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:14.945314 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8e47ec3b-3045-4d6b-ae0f-5ef9d52aa4b7 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:14.945960 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d757c954-6a23-42ab-a50e-d81252b2adfd tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:14.947735 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d757c954-6a23-42ab-a50e-d81252b2adfd tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:14.949070 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d757c954-6a23-42ab-a50e-d81252b2adfd tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:14.950777 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d757c954-6a23-42ab-a50e-d81252b2adfd tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:14.953856 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8e47ec3b-3045-4d6b-ae0f-5ef9d52aa4b7 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1391 microversion: 2.1 time: 0.516164 Sep 10 11:45:14.954162 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d757c954-6a23-42ab-a50e-d81252b2adfd tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:14.955204 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 843/1599] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:14 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1391 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:14.956047 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d757c954-6a23-42ab-a50e-d81252b2adfd tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:15.569097 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d757c954-6a23-42ab-a50e-d81252b2adfd tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:15.595645 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d757c954-6a23-42ab-a50e-d81252b2adfd tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:15.601732 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d757c954-6a23-42ab-a50e-d81252b2adfd tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:15.606195 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d757c954-6a23-42ab-a50e-d81252b2adfd tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1879 microversion: 2.42 time: 0.687122 Sep 10 11:45:15.611187 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 757/1600] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:14 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1879 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:45:15.863927 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-521e53a7-3b61-422a-94dc-9f8dd8523b06 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:15.865265 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-521e53a7-3b61-422a-94dc-9f8dd8523b06 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:15.874579 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-521e53a7-3b61-422a-94dc-9f8dd8523b06 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:15.875649 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-521e53a7-3b61-422a-94dc-9f8dd8523b06 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:15.878627 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-521e53a7-3b61-422a-94dc-9f8dd8523b06 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:15.891781 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-521e53a7-3b61-422a-94dc-9f8dd8523b06 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:15.893172 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-521e53a7-3b61-422a-94dc-9f8dd8523b06 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:15.894891 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-521e53a7-3b61-422a-94dc-9f8dd8523b06 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:15.984525 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1f271da4-a29a-4dcd-8f02-7a2c632f51ad tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:15.986078 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1f271da4-a29a-4dcd-8f02-7a2c632f51ad tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:16.036944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f271da4-a29a-4dcd-8f02-7a2c632f51ad tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:16.066239 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f271da4-a29a-4dcd-8f02-7a2c632f51ad tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.055s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:16.077633 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f271da4-a29a-4dcd-8f02-7a2c632f51ad tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:16.078645 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f271da4-a29a-4dcd-8f02-7a2c632f51ad tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:16.079378 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f271da4-a29a-4dcd-8f02-7a2c632f51ad tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:16.079995 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f271da4-a29a-4dcd-8f02-7a2c632f51ad tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:16.774582 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-521e53a7-3b61-422a-94dc-9f8dd8523b06 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:16.784569 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-521e53a7-3b61-422a-94dc-9f8dd8523b06 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1541 microversion: 2.1 time: 0.942651 Sep 10 11:45:16.786036 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 844/1601] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:15 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1541 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:16.791070 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-30563a7a-f5db-4ef4-b051-18a5211def90 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:16.791923 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-30563a7a-f5db-4ef4-b051-18a5211def90 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:16.807131 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30563a7a-f5db-4ef4-b051-18a5211def90 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:16.807930 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30563a7a-f5db-4ef4-b051-18a5211def90 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:16.808582 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30563a7a-f5db-4ef4-b051-18a5211def90 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:16.809515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30563a7a-f5db-4ef4-b051-18a5211def90 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:16.811681 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30563a7a-f5db-4ef4-b051-18a5211def90 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:16.815251 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30563a7a-f5db-4ef4-b051-18a5211def90 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:16.871558 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1f271da4-a29a-4dcd-8f02-7a2c632f51ad tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:16.880821 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1f271da4-a29a-4dcd-8f02-7a2c632f51ad tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1391 microversion: 2.1 time: 0.902789 Sep 10 11:45:16.885346 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 758/1602] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:15 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1391 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:17.808241 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1e4f52d8-f94b-4393-a9ac-e961fa869190 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1382776365", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "42c19435-ba71-4934-a619-3d55b7ee5eac"}], "security_groups": [{"name": "tempest-securitygroup--137599250"}], "key_name": "tempest-keypair-1352233681", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:45:18.411046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-30563a7a-f5db-4ef4-b051-18a5211def90 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:18.431871 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-30563a7a-f5db-4ef4-b051-18a5211def90 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:18.439479 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-30563a7a-f5db-4ef4-b051-18a5211def90 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:18.441975 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-30563a7a-f5db-4ef4-b051-18a5211def90 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1879 microversion: 2.42 time: 1.654656 Sep 10 11:45:18.448967 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 845/1603] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:16 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1879 bytes in 1662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:45:18.490737 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b6e25328-2550-4fb2-985a-1efc5d74a7a7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:18.492747 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b6e25328-2550-4fb2-985a-1efc5d74a7a7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:18.519144 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b6e25328-2550-4fb2-985a-1efc5d74a7a7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:18.524798 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b6e25328-2550-4fb2-985a-1efc5d74a7a7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:18.526997 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b6e25328-2550-4fb2-985a-1efc5d74a7a7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:18.529660 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b6e25328-2550-4fb2-985a-1efc5d74a7a7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:18.532015 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b6e25328-2550-4fb2-985a-1efc5d74a7a7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:18.534852 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b6e25328-2550-4fb2-985a-1efc5d74a7a7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:18.762073 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-1e4f52d8-f94b-4393-a9ac-e961fa869190 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] validate_networks() for [('42c19435-ba71-4934-a619-3d55b7ee5eac', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:45:19.492160 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b6e25328-2550-4fb2-985a-1efc5d74a7a7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:19.508162 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b6e25328-2550-4fb2-985a-1efc5d74a7a7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1540 microversion: 2.1 time: 1.039001 Sep 10 11:45:19.520570 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 846/1604] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:18 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1540 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:19.536710 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7b75a173-94ae-4481-96af-52f2d788a66e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:19.538257 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7b75a173-94ae-4481-96af-52f2d788a66e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:19.561038 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b75a173-94ae-4481-96af-52f2d788a66e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:19.574318 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b75a173-94ae-4481-96af-52f2d788a66e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:19.575276 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b75a173-94ae-4481-96af-52f2d788a66e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:19.576270 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b75a173-94ae-4481-96af-52f2d788a66e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:19.577175 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b75a173-94ae-4481-96af-52f2d788a66e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:19.577863 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b75a173-94ae-4481-96af-52f2d788a66e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:19.639099 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=100 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:45:20.762759 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7b75a173-94ae-4481-96af-52f2d788a66e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:20.772835 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7b75a173-94ae-4481-96af-52f2d788a66e tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1381 microversion: 2.1 time: 1.249539 Sep 10 11:45:20.779467 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 847/1605] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:19 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1381 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:20.792558 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9bd4f25a-4f7a-4496-a58d-097057f62ab7 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:20.795131 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9bd4f25a-4f7a-4496-a58d-097057f62ab7 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:20.811581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9bd4f25a-4f7a-4496-a58d-097057f62ab7 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:20.812104 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9bd4f25a-4f7a-4496-a58d-097057f62ab7 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:20.812559 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9bd4f25a-4f7a-4496-a58d-097057f62ab7 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:20.813294 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9bd4f25a-4f7a-4496-a58d-097057f62ab7 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:20.813759 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9bd4f25a-4f7a-4496-a58d-097057f62ab7 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:20.814194 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9bd4f25a-4f7a-4496-a58d-097057f62ab7 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:21.621953 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-1e4f52d8-f94b-4393-a9ac-e961fa869190 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:45:21.624706 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-1e4f52d8-f94b-4393-a9ac-e961fa869190 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:45:21.626042 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-1e4f52d8-f94b-4393-a9ac-e961fa869190 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:45:21.627339 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9bd4f25a-4f7a-4496-a58d-097057f62ab7 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:21.628358 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-1e4f52d8-f94b-4393-a9ac-e961fa869190 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:45:21.629101 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-1e4f52d8-f94b-4393-a9ac-e961fa869190 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:45:21.647823 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9bd4f25a-4f7a-4496-a58d-097057f62ab7 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:21.649417 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9bd4f25a-4f7a-4496-a58d-097057f62ab7 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:21.662967 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9bd4f25a-4f7a-4496-a58d-097057f62ab7 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1879 microversion: 2.42 time: 0.877840 Sep 10 11:45:21.679784 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1e4f52d8-f94b-4393-a9ac-e961fa869190 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:21.682160 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1e4f52d8-f94b-4393-a9ac-e961fa869190 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:21.684198 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1e4f52d8-f94b-4393-a9ac-e961fa869190 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:21.687124 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1e4f52d8-f94b-4393-a9ac-e961fa869190 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:21.688251 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1e4f52d8-f94b-4393-a9ac-e961fa869190 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:21.689345 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1e4f52d8-f94b-4393-a9ac-e961fa869190 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:21.694290 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 848/1606] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:20 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1879 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:45:21.699410 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-73927803-382f-4f1b-aaee-fd6c239146e3 req-0f34b103-d2db-4d8c-b1d5-7faa97a94b2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc446beb-aed5-4d4e-954b-30c480f62ef0", "name": "network-vif-unplugged", "status": "completed", "tag": "d53a3f4b-c348-4a6d-b50f-9111fcac793a"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:45:21.723705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=4 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:45:21.733041 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-73927803-382f-4f1b-aaee-fd6c239146e3 req-0f34b103-d2db-4d8c-b1d5-7faa97a94b2e service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:21.740523 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-73927803-382f-4f1b-aaee-fd6c239146e3 req-0f34b103-d2db-4d8c-b1d5-7faa97a94b2e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:21.741369 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-73927803-382f-4f1b-aaee-fd6c239146e3 req-0f34b103-d2db-4d8c-b1d5-7faa97a94b2e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:21.754584 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-1e4f52d8-f94b-4393-a9ac-e961fa869190 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Getting quotas for project 99f601d0bb424da4bb02b532ac982878. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:45:21.761693 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-1e4f52d8-f94b-4393-a9ac-e961fa869190 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Getting quotas for user 91ea7c11febf451da4f1faf4dff9471d and project 99f601d0bb424da4bb02b532ac982878. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:45:21.767661 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-73927803-382f-4f1b-aaee-fd6c239146e3 req-0f34b103-d2db-4d8c-b1d5-7faa97a94b2e service nova] Creating event network-vif-unplugged:d53a3f4b-c348-4a6d-b50f-9111fcac793a for instance bc446beb-aed5-4d4e-954b-30c480f62ef0 on n-h2-856895-1 Sep 10 11:45:21.786706 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [req-73927803-382f-4f1b-aaee-fd6c239146e3 req-0f34b103-d2db-4d8c-b1d5-7faa97a94b2e service nova] Instance bc446beb-aed5-4d4e-954b-30c480f62ef0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856895-1', 'n-h1-856895-1'} {{(pid=128777) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 11:45:21.811620 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1e4f52d8-f94b-4393-a9ac-e961fa869190 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:45:21.818527 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-73927803-382f-4f1b-aaee-fd6c239146e3 req-0f34b103-d2db-4d8c-b1d5-7faa97a94b2e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122628 Sep 10 11:45:21.822244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1e4f52d8-f94b-4393-a9ac-e961fa869190 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: e713eb62-8c55-40ae-8424-4283e90a4c30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:45:21.822798 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 849/1607] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:45:21.840254 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-493450a8-337c-4402-a112-1dddc2a86043 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:21.841430 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-493450a8-337c-4402-a112-1dddc2a86043 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:21.859379 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-493450a8-337c-4402-a112-1dddc2a86043 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:21.859886 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-493450a8-337c-4402-a112-1dddc2a86043 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:21.860343 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-493450a8-337c-4402-a112-1dddc2a86043 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:21.861070 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-493450a8-337c-4402-a112-1dddc2a86043 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:21.861538 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-493450a8-337c-4402-a112-1dddc2a86043 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:21.862015 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-493450a8-337c-4402-a112-1dddc2a86043 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:21.975642 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1e4f52d8-f94b-4393-a9ac-e961fa869190 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 4.171562 Sep 10 11:45:21.979215 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 759/1608] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:45:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 4176 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:45:21.993505 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c675322d-b340-4477-bdc3-dfdc1cd06f8c tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Calling method '.version_select at 0x7f407b5efe50>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:22.005356 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c675322d-b340-4477-bdc3-dfdc1cd06f8c tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:22.006296 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c675322d-b340-4477-bdc3-dfdc1cd06f8c tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:22.007424 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c675322d-b340-4477-bdc3-dfdc1cd06f8c tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:22.028121 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c675322d-b340-4477-bdc3-dfdc1cd06f8c tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 3889 microversion: 2.1 time: 0.047106 Sep 10 11:45:22.029545 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 760/1609] 10.222.0.23 () {58 vars in 1143 bytes} [Sat Sep 10 11:45:21 2022] GET /compute/v2.1/os-migrations => generated 3889 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:22.050629 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-26a2163f-6878-4e54-8f81-5a4fd830b59e tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:22.059883 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-26a2163f-6878-4e54-8f81-5a4fd830b59e tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: e713eb62-8c55-40ae-8424-4283e90a4c30] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:22.943540 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-26a2163f-6878-4e54-8f81-5a4fd830b59e tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ea7c11febf451da4f1faf4dff9471d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f601d0bb424da4bb02b532ac982878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:22.951792 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-26a2163f-6878-4e54-8f81-5a4fd830b59e tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30" status: 200 len: 1242 microversion: 2.1 time: 0.907980 Sep 10 11:45:22.952818 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 761/1610] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:22 2022] GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30 => generated 1242 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:22.958461 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-373d331d-6a23-4470-a118-bd5b246fa248 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:22.959420 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-373d331d-6a23-4470-a118-bd5b246fa248 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:22.965664 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-373d331d-6a23-4470-a118-bd5b246fa248 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:22.966422 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-373d331d-6a23-4470-a118-bd5b246fa248 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:22.967114 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-373d331d-6a23-4470-a118-bd5b246fa248 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:22.968105 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-373d331d-6a23-4470-a118-bd5b246fa248 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:22.968817 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-373d331d-6a23-4470-a118-bd5b246fa248 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:22.969484 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-373d331d-6a23-4470-a118-bd5b246fa248 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:23.491552 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-493450a8-337c-4402-a112-1dddc2a86043 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:23.501428 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-493450a8-337c-4402-a112-1dddc2a86043 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1540 microversion: 2.1 time: 1.675236 Sep 10 11:45:23.504735 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 850/1611] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:21 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1540 bytes in 1681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:23.509827 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d50d99f0-95da-4ec1-b6dc-8097f58e41b2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1917092036", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "9d0f720d-8913-424b-864d-897845ccb4e7"}], "block_device_mapping_v2": [{"uuid": "5c83b133-eb8f-407d-b6e9-0baf06e6284e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:45:23.516238 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-373d331d-6a23-4470-a118-bd5b246fa248 tempest-LiveMigrationTest-657872902 tempest-LiveMigrationTest-657872902-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1532 microversion: 2.1 time: 0.562088 Sep 10 11:45:23.525774 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 762/1612] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:22 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1532 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:23.527139 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4bc89e48-b57c-4b55-a81b-d5b0334288b1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:23.540126 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4bc89e48-b57c-4b55-a81b-d5b0334288b1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:23.546441 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4bc89e48-b57c-4b55-a81b-d5b0334288b1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:23.547231 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4bc89e48-b57c-4b55-a81b-d5b0334288b1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:23.547865 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4bc89e48-b57c-4b55-a81b-d5b0334288b1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:23.549090 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4bc89e48-b57c-4b55-a81b-d5b0334288b1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:23.550101 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4bc89e48-b57c-4b55-a81b-d5b0334288b1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:23.550537 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4bc89e48-b57c-4b55-a81b-d5b0334288b1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:23.622661 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-d50d99f0-95da-4ec1-b6dc-8097f58e41b2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] validate_networks() for [('9d0f720d-8913-424b-864d-897845ccb4e7', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:45:24.367574 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4bc89e48-b57c-4b55-a81b-d5b0334288b1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:24.387390 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4bc89e48-b57c-4b55-a81b-d5b0334288b1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:24.389141 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4bc89e48-b57c-4b55-a81b-d5b0334288b1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:24.390621 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4bc89e48-b57c-4b55-a81b-d5b0334288b1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1879 microversion: 2.42 time: 0.870895 Sep 10 11:45:24.403585 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 763/1613] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:23 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1879 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:45:24.409089 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e491ee79-16c5-463b-926b-36797249f782 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:24.410065 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e491ee79-16c5-463b-926b-36797249f782 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:24.416661 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e491ee79-16c5-463b-926b-36797249f782 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:24.419802 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e491ee79-16c5-463b-926b-36797249f782 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:24.420513 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e491ee79-16c5-463b-926b-36797249f782 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:24.421553 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e491ee79-16c5-463b-926b-36797249f782 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:24.422255 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e491ee79-16c5-463b-926b-36797249f782 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:24.431095 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e491ee79-16c5-463b-926b-36797249f782 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:24.468538 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e491ee79-16c5-463b-926b-36797249f782 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:45:24.574848 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e491ee79-16c5-463b-926b-36797249f782 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 204 len: 0 microversion: 2.1 time: 0.168354 Sep 10 11:45:24.579753 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 764/1614] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:45:24 2022] DELETE /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:45:24.588312 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-8ef23803-dd2c-4658-9fc2-eba1f643db6e req-1a7de390-cbf0-4521-b25a-6c81ff5ae111 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc446beb-aed5-4d4e-954b-30c480f62ef0", "tag": "d53a3f4b-c348-4a6d-b50f-9111fcac793a"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:45:24.609263 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-8ef23803-dd2c-4658-9fc2-eba1f643db6e req-1a7de390-cbf0-4521-b25a-6c81ff5ae111 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:24.610384 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-8ef23803-dd2c-4658-9fc2-eba1f643db6e req-1a7de390-cbf0-4521-b25a-6c81ff5ae111 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:24.611090 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-8ef23803-dd2c-4658-9fc2-eba1f643db6e req-1a7de390-cbf0-4521-b25a-6c81ff5ae111 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:24.626460 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-8ef23803-dd2c-4658-9fc2-eba1f643db6e req-1a7de390-cbf0-4521-b25a-6c81ff5ae111 service nova] Creating event network-changed:d53a3f4b-c348-4a6d-b50f-9111fcac793a for instance bc446beb-aed5-4d4e-954b-30c480f62ef0 on n-h2-856895-1 Sep 10 11:45:24.635879 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [req-8ef23803-dd2c-4658-9fc2-eba1f643db6e req-1a7de390-cbf0-4521-b25a-6c81ff5ae111 service nova] Instance bc446beb-aed5-4d4e-954b-30c480f62ef0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856895-1', 'n-h1-856895-1'} {{(pid=128776) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 11:45:24.651597 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-8ef23803-dd2c-4658-9fc2-eba1f643db6e req-1a7de390-cbf0-4521-b25a-6c81ff5ae111 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068219 Sep 10 11:45:24.652591 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 765/1615] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:45:24.662042 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-81b0d345-867d-4e1c-a364-33750e13d5ac tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:24.662887 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-81b0d345-867d-4e1c-a364-33750e13d5ac tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: e713eb62-8c55-40ae-8424-4283e90a4c30] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:24.672647 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81b0d345-867d-4e1c-a364-33750e13d5ac tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:24.673409 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81b0d345-867d-4e1c-a364-33750e13d5ac tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:24.673837 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81b0d345-867d-4e1c-a364-33750e13d5ac tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:24.675285 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81b0d345-867d-4e1c-a364-33750e13d5ac tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:24.675855 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81b0d345-867d-4e1c-a364-33750e13d5ac tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:24.676563 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81b0d345-867d-4e1c-a364-33750e13d5ac tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:24.814260 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-81b0d345-867d-4e1c-a364-33750e13d5ac tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ea7c11febf451da4f1faf4dff9471d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f601d0bb424da4bb02b532ac982878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:24.826473 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-81b0d345-867d-4e1c-a364-33750e13d5ac tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30" status: 200 len: 1300 microversion: 2.1 time: 0.172528 Sep 10 11:45:24.829493 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 766/1616] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:24 2022] GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30 => generated 1300 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:24.837463 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5e5f075b-651b-4f47-bbe3-382d4ddfd2d1 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:24.842449 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5e5f075b-651b-4f47-bbe3-382d4ddfd2d1 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:24.856008 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5e5f075b-651b-4f47-bbe3-382d4ddfd2d1 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:24.859534 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5e5f075b-651b-4f47-bbe3-382d4ddfd2d1 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:24.860063 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5e5f075b-651b-4f47-bbe3-382d4ddfd2d1 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:24.860883 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5e5f075b-651b-4f47-bbe3-382d4ddfd2d1 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:24.865378 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5e5f075b-651b-4f47-bbe3-382d4ddfd2d1 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:24.866513 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5e5f075b-651b-4f47-bbe3-382d4ddfd2d1 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:24.929713 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d50d99f0-95da-4ec1-b6dc-8097f58e41b2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:45:24.930944 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d50d99f0-95da-4ec1-b6dc-8097f58e41b2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:45:24.932560 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d50d99f0-95da-4ec1-b6dc-8097f58e41b2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:45:24.933295 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d50d99f0-95da-4ec1-b6dc-8097f58e41b2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:45:24.935152 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d50d99f0-95da-4ec1-b6dc-8097f58e41b2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:45:24.955025 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d50d99f0-95da-4ec1-b6dc-8097f58e41b2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:24.956678 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d50d99f0-95da-4ec1-b6dc-8097f58e41b2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:24.957191 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d50d99f0-95da-4ec1-b6dc-8097f58e41b2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:24.958544 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d50d99f0-95da-4ec1-b6dc-8097f58e41b2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:24.962726 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d50d99f0-95da-4ec1-b6dc-8097f58e41b2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:24.963969 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d50d99f0-95da-4ec1-b6dc-8097f58e41b2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:24.994010 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-d50d99f0-95da-4ec1-b6dc-8097f58e41b2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Getting quotas for project c8c0800673e247fb8b3b3718512233c0. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:45:25.002862 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-d50d99f0-95da-4ec1-b6dc-8097f58e41b2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Getting quotas for user 1106bb2c5ce14c21a15ad62942745b62 and project c8c0800673e247fb8b3b3718512233c0. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:45:25.122386 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d50d99f0-95da-4ec1-b6dc-8097f58e41b2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:45:25.125560 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d50d99f0-95da-4ec1-b6dc-8097f58e41b2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5c83b133-eb8f-407d-b6e9-0baf06e6284e',volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:45:25.133890 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5e5f075b-651b-4f47-bbe3-382d4ddfd2d1 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:25.149103 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5e5f075b-651b-4f47-bbe3-382d4ddfd2d1 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1472 microversion: 2.1 time: 0.318321 Sep 10 11:45:25.164493 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 767/1617] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:24 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1472 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:25.182378 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-606343d5-71bd-4a73-bf3c-08fc42e777a4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:25.183003 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-606343d5-71bd-4a73-bf3c-08fc42e777a4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:25.198873 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-606343d5-71bd-4a73-bf3c-08fc42e777a4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:25.199497 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-606343d5-71bd-4a73-bf3c-08fc42e777a4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:25.200027 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-606343d5-71bd-4a73-bf3c-08fc42e777a4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:25.200771 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-606343d5-71bd-4a73-bf3c-08fc42e777a4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:25.201233 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-606343d5-71bd-4a73-bf3c-08fc42e777a4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:25.202012 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-606343d5-71bd-4a73-bf3c-08fc42e777a4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:25.334574 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d50d99f0-95da-4ec1-b6dc-8097f58e41b2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.828500 Sep 10 11:45:25.336492 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 851/1618] 10.222.0.23 () {62 vars in 1188 bytes} [Sat Sep 10 11:45:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1831 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 10 11:45:25.348060 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d4f386b1-b9f7-47fc-a721-ffbd621b55ac tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:25.348950 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d4f386b1-b9f7-47fc-a721-ffbd621b55ac tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:25.859998 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d4f386b1-b9f7-47fc-a721-ffbd621b55ac tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:25.871597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d4f386b1-b9f7-47fc-a721-ffbd621b55ac tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:25.881637 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d4f386b1-b9f7-47fc-a721-ffbd621b55ac tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:25.883691 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d4f386b1-b9f7-47fc-a721-ffbd621b55ac tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1104 microversion: 2.25 time: 0.539644 Sep 10 11:45:25.900090 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 852/1619] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:25 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1104 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:45:25.914519 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4cd78faf-1cda-461b-8781-ba7e21c8c3c8 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:25.918279 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4cd78faf-1cda-461b-8781-ba7e21c8c3c8 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:25.930942 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4cd78faf-1cda-461b-8781-ba7e21c8c3c8 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:25.932746 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4cd78faf-1cda-461b-8781-ba7e21c8c3c8 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:25.933415 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4cd78faf-1cda-461b-8781-ba7e21c8c3c8 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:25.945399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4cd78faf-1cda-461b-8781-ba7e21c8c3c8 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:25.946580 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4cd78faf-1cda-461b-8781-ba7e21c8c3c8 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:25.947280 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4cd78faf-1cda-461b-8781-ba7e21c8c3c8 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:26.428105 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-606343d5-71bd-4a73-bf3c-08fc42e777a4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:26.438546 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-606343d5-71bd-4a73-bf3c-08fc42e777a4 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1387 microversion: 2.1 time: 1.273055 Sep 10 11:45:26.443345 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 768/1620] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:25 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1387 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:26.448421 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8b3a62cb-a3ee-45b2-99fe-990fab616e06 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:26.456747 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8b3a62cb-a3ee-45b2-99fe-990fab616e06 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: e713eb62-8c55-40ae-8424-4283e90a4c30] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:26.475962 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8b3a62cb-a3ee-45b2-99fe-990fab616e06 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:26.476724 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8b3a62cb-a3ee-45b2-99fe-990fab616e06 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:26.477392 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8b3a62cb-a3ee-45b2-99fe-990fab616e06 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:26.478556 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8b3a62cb-a3ee-45b2-99fe-990fab616e06 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:26.479249 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8b3a62cb-a3ee-45b2-99fe-990fab616e06 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:26.479887 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8b3a62cb-a3ee-45b2-99fe-990fab616e06 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:26.782230 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4cd78faf-1cda-461b-8781-ba7e21c8c3c8 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:26.802699 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4cd78faf-1cda-461b-8781-ba7e21c8c3c8 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:26.804465 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4cd78faf-1cda-461b-8781-ba7e21c8c3c8 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:26.809310 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4cd78faf-1cda-461b-8781-ba7e21c8c3c8 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1879 microversion: 2.42 time: 0.907430 Sep 10 11:45:26.812567 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 853/1621] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:25 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1879 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:45:26.817922 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-144c6851-d007-489a-a2db-1718af12f8ef tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:26.830713 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-144c6851-d007-489a-a2db-1718af12f8ef tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:26.848497 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-144c6851-d007-489a-a2db-1718af12f8ef tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:26.849291 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-144c6851-d007-489a-a2db-1718af12f8ef tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:26.853200 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-144c6851-d007-489a-a2db-1718af12f8ef tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:26.854266 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-144c6851-d007-489a-a2db-1718af12f8ef tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:26.855157 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-144c6851-d007-489a-a2db-1718af12f8ef tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:26.855821 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-144c6851-d007-489a-a2db-1718af12f8ef tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:27.109020 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8b3a62cb-a3ee-45b2-99fe-990fab616e06 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ea7c11febf451da4f1faf4dff9471d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f601d0bb424da4bb02b532ac982878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:27.126258 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8b3a62cb-a3ee-45b2-99fe-990fab616e06 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30" status: 200 len: 1367 microversion: 2.1 time: 0.681473 Sep 10 11:45:27.127737 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 769/1622] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:26 2022] GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30 => generated 1367 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:27.135781 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a6b88dea-6380-4a14-99fe-d2569f7796e2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:27.136734 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a6b88dea-6380-4a14-99fe-d2569f7796e2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:27.144650 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6b88dea-6380-4a14-99fe-d2569f7796e2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:27.158170 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6b88dea-6380-4a14-99fe-d2569f7796e2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:27.159939 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6b88dea-6380-4a14-99fe-d2569f7796e2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:27.160974 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6b88dea-6380-4a14-99fe-d2569f7796e2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:27.161738 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6b88dea-6380-4a14-99fe-d2569f7796e2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:27.162436 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6b88dea-6380-4a14-99fe-d2569f7796e2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:27.237733 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-144c6851-d007-489a-a2db-1718af12f8ef tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:27.250880 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-144c6851-d007-489a-a2db-1718af12f8ef tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1469 microversion: 2.1 time: 0.436772 Sep 10 11:45:27.253277 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 854/1623] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:26 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1469 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:27.264728 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a6b88dea-6380-4a14-99fe-d2569f7796e2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:27.269145 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:45:27.292320 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9779c0d9-0499-4ad1-a008-b2395210c672 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:45:27.293579 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9779c0d9-0499-4ad1-a008-b2395210c672 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:27.299932 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a6b88dea-6380-4a14-99fe-d2569f7796e2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:27.306519 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9779c0d9-0499-4ad1-a008-b2395210c672 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:27.306726 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a6b88dea-6380-4a14-99fe-d2569f7796e2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:27.307989 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9779c0d9-0499-4ad1-a008-b2395210c672 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:27.308731 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9779c0d9-0499-4ad1-a008-b2395210c672 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:27.309767 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9779c0d9-0499-4ad1-a008-b2395210c672 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:27.310021 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a6b88dea-6380-4a14-99fe-d2569f7796e2 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1233 microversion: 2.25 time: 0.180802 Sep 10 11:45:27.310622 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 770/1624] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:27 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1233 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:45:27.310954 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9779c0d9-0499-4ad1-a008-b2395210c672 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:27.311698 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9779c0d9-0499-4ad1-a008-b2395210c672 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:27.387207 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9779c0d9-0499-4ad1-a008-b2395210c672 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:27.387993 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9779c0d9-0499-4ad1-a008-b2395210c672 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:27.389143 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9779c0d9-0499-4ad1-a008-b2395210c672 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:27.390453 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9779c0d9-0499-4ad1-a008-b2395210c672 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:27.391282 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9779c0d9-0499-4ad1-a008-b2395210c672 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:27.391881 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9779c0d9-0499-4ad1-a008-b2395210c672 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:27.441885 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-9779c0d9-0499-4ad1-a008-b2395210c672 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Getting quotas for project 7b37b36096cd42f6b6568ff9eee2751c. Resources: {'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:45:27.451935 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-9779c0d9-0499-4ad1-a008-b2395210c672 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Getting quotas for user 77d854474f4c4481ac407a76b4627c69 and project 7b37b36096cd42f6b6568ff9eee2751c. Resources: {'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:45:27.467419 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6906fd91-5cd7-423a-be5a-925fce5bd2df tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:27.468192 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6906fd91-5cd7-423a-be5a-925fce5bd2df tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:27.484624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6906fd91-5cd7-423a-be5a-925fce5bd2df tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:27.485140 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6906fd91-5cd7-423a-be5a-925fce5bd2df tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:27.487433 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6906fd91-5cd7-423a-be5a-925fce5bd2df tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:27.490107 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6906fd91-5cd7-423a-be5a-925fce5bd2df tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:27.491421 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6906fd91-5cd7-423a-be5a-925fce5bd2df tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:27.492313 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6906fd91-5cd7-423a-be5a-925fce5bd2df tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:27.706640 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9779c0d9-0499-4ad1-a008-b2395210c672 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "POST /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0/action" status: 202 len: 0 microversion: 2.1 time: 0.427264 Sep 10 11:45:27.707512 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 855/1625] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:45:27 2022] POST /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0/action => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 11:45:27.717493 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cc3786ad-7f65-452c-aff6-9a06124e2984 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:27.718538 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cc3786ad-7f65-452c-aff6-9a06124e2984 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:27.730308 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc3786ad-7f65-452c-aff6-9a06124e2984 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:27.731483 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc3786ad-7f65-452c-aff6-9a06124e2984 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:27.732516 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc3786ad-7f65-452c-aff6-9a06124e2984 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:27.733773 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc3786ad-7f65-452c-aff6-9a06124e2984 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:27.734736 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc3786ad-7f65-452c-aff6-9a06124e2984 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:27.735478 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc3786ad-7f65-452c-aff6-9a06124e2984 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:27.740345 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6906fd91-5cd7-423a-be5a-925fce5bd2df tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:27.752268 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6906fd91-5cd7-423a-be5a-925fce5bd2df tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1345 microversion: 2.1 time: 0.289806 Sep 10 11:45:27.753232 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 771/1626] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:27 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1345 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:45:27.845727 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-50225fb1-085a-4d72-b398-42d4d0c19b9e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:27.848025 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-50225fb1-085a-4d72-b398-42d4d0c19b9e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:27.863707 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50225fb1-085a-4d72-b398-42d4d0c19b9e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:27.866161 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50225fb1-085a-4d72-b398-42d4d0c19b9e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:27.866825 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50225fb1-085a-4d72-b398-42d4d0c19b9e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:27.867774 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50225fb1-085a-4d72-b398-42d4d0c19b9e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:27.871052 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50225fb1-085a-4d72-b398-42d4d0c19b9e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:27.872971 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50225fb1-085a-4d72-b398-42d4d0c19b9e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:28.443786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cc3786ad-7f65-452c-aff6-9a06124e2984 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:28.458200 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cc3786ad-7f65-452c-aff6-9a06124e2984 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1468 microversion: 2.1 time: 0.745117 Sep 10 11:45:28.459217 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 856/1627] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:27 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1468 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:28.471771 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-3214ad8d-99a1-4148-ae42-a2da7024a59d req-90a59fa5-46b0-4355-8034-2149db9d2d58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cb195e0-436b-4ffc-8819-fdac586f6896", "name": "network-vif-deleted", "tag": "b191a802-e810-409f-980f-c88296d62dea"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:45:28.507951 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-3214ad8d-99a1-4148-ae42-a2da7024a59d req-90a59fa5-46b0-4355-8034-2149db9d2d58 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:28.508942 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-3214ad8d-99a1-4148-ae42-a2da7024a59d req-90a59fa5-46b0-4355-8034-2149db9d2d58 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:28.513310 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-3214ad8d-99a1-4148-ae42-a2da7024a59d req-90a59fa5-46b0-4355-8034-2149db9d2d58 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:28.543572 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-3214ad8d-99a1-4148-ae42-a2da7024a59d req-90a59fa5-46b0-4355-8034-2149db9d2d58 service nova] Creating event network-vif-deleted:b191a802-e810-409f-980f-c88296d62dea for instance 6cb195e0-436b-4ffc-8819-fdac586f6896 on n-h1-856895-1 Sep 10 11:45:28.559627 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-3214ad8d-99a1-4148-ae42-a2da7024a59d req-90a59fa5-46b0-4355-8034-2149db9d2d58 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097522 Sep 10 11:45:28.583124 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 857/1628] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:45:28.601372 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-50225fb1-085a-4d72-b398-42d4d0c19b9e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:28.621273 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ba2b1d20-aec8-4be1-ad6b-c3e85e9a5dea tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:28.625766 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ba2b1d20-aec8-4be1-ad6b-c3e85e9a5dea tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: e713eb62-8c55-40ae-8424-4283e90a4c30] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:28.627528 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-50225fb1-085a-4d72-b398-42d4d0c19b9e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:28.632412 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-50225fb1-085a-4d72-b398-42d4d0c19b9e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:28.641502 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-50225fb1-085a-4d72-b398-42d4d0c19b9e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1879 microversion: 2.42 time: 0.800300 Sep 10 11:45:28.648017 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 772/1629] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:27 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1879 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:45:28.654749 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba2b1d20-aec8-4be1-ad6b-c3e85e9a5dea tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:28.662808 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba2b1d20-aec8-4be1-ad6b-c3e85e9a5dea tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:28.668566 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba2b1d20-aec8-4be1-ad6b-c3e85e9a5dea tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:28.672507 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba2b1d20-aec8-4be1-ad6b-c3e85e9a5dea tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:28.673538 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba2b1d20-aec8-4be1-ad6b-c3e85e9a5dea tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:28.675573 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba2b1d20-aec8-4be1-ad6b-c3e85e9a5dea tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:28.996998 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-15262b16-e4de-4316-82ef-352ae91d8fc9 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:28.998148 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-15262b16-e4de-4316-82ef-352ae91d8fc9 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:29.022704 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ba2b1d20-aec8-4be1-ad6b-c3e85e9a5dea tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ea7c11febf451da4f1faf4dff9471d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f601d0bb424da4bb02b532ac982878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:29.024983 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-15262b16-e4de-4316-82ef-352ae91d8fc9 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:29.027593 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-15262b16-e4de-4316-82ef-352ae91d8fc9 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:29.028051 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-15262b16-e4de-4316-82ef-352ae91d8fc9 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:29.028782 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-15262b16-e4de-4316-82ef-352ae91d8fc9 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:29.029252 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-15262b16-e4de-4316-82ef-352ae91d8fc9 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:29.029689 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-15262b16-e4de-4316-82ef-352ae91d8fc9 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:29.033288 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ba2b1d20-aec8-4be1-ad6b-c3e85e9a5dea tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30" status: 200 len: 1367 microversion: 2.1 time: 0.448384 Sep 10 11:45:29.038189 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 858/1630] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:28 2022] GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30 => generated 1367 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:29.050501 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ad9ed0e6-f2a8-48ec-a3e0-53f3327f4f71 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:29.051684 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ad9ed0e6-f2a8-48ec-a3e0-53f3327f4f71 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:29.064438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ad9ed0e6-f2a8-48ec-a3e0-53f3327f4f71 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:29.067789 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ad9ed0e6-f2a8-48ec-a3e0-53f3327f4f71 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:29.069982 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ad9ed0e6-f2a8-48ec-a3e0-53f3327f4f71 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:29.071013 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ad9ed0e6-f2a8-48ec-a3e0-53f3327f4f71 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:29.071743 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ad9ed0e6-f2a8-48ec-a3e0-53f3327f4f71 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:29.072753 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ad9ed0e6-f2a8-48ec-a3e0-53f3327f4f71 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:29.249027 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-15262b16-e4de-4316-82ef-352ae91d8fc9 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:29.261714 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-15262b16-e4de-4316-82ef-352ae91d8fc9 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:29.271884 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-15262b16-e4de-4316-82ef-352ae91d8fc9 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:29.276895 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ad9ed0e6-f2a8-48ec-a3e0-53f3327f4f71 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:29.280551 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-15262b16-e4de-4316-82ef-352ae91d8fc9 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1251 microversion: 2.25 time: 0.622161 Sep 10 11:45:29.285295 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ad9ed0e6-f2a8-48ec-a3e0-53f3327f4f71 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1183 microversion: 2.1 time: 0.245614 Sep 10 11:45:29.286192 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 773/1631] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:28 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1251 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:45:29.287129 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 859/1632] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:29 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1183 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:29.488968 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9fd69651-b19d-48e5-828c-23c09e3de7d2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:29.489749 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9fd69651-b19d-48e5-828c-23c09e3de7d2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:29.511464 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fd69651-b19d-48e5-828c-23c09e3de7d2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:29.515268 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fd69651-b19d-48e5-828c-23c09e3de7d2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:29.516249 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fd69651-b19d-48e5-828c-23c09e3de7d2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:29.519597 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fd69651-b19d-48e5-828c-23c09e3de7d2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:29.521036 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fd69651-b19d-48e5-828c-23c09e3de7d2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:29.523877 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fd69651-b19d-48e5-828c-23c09e3de7d2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:29.684359 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1167cecd-61ff-4fe3-9b2e-52c382c88757 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:29.684359 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1167cecd-61ff-4fe3-9b2e-52c382c88757 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:29.697559 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1167cecd-61ff-4fe3-9b2e-52c382c88757 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:29.698059 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1167cecd-61ff-4fe3-9b2e-52c382c88757 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:29.698700 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1167cecd-61ff-4fe3-9b2e-52c382c88757 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:29.700521 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1167cecd-61ff-4fe3-9b2e-52c382c88757 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:29.701445 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1167cecd-61ff-4fe3-9b2e-52c382c88757 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:29.702886 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1167cecd-61ff-4fe3-9b2e-52c382c88757 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:30.136298 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9fd69651-b19d-48e5-828c-23c09e3de7d2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:30.152174 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9fd69651-b19d-48e5-828c-23c09e3de7d2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1468 microversion: 2.1 time: 0.670364 Sep 10 11:45:30.165321 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 774/1633] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:29 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1468 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:30.177526 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-76ae3711-631f-4407-ac1a-a3fc98270131 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:30.179603 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-76ae3711-631f-4407-ac1a-a3fc98270131 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: e713eb62-8c55-40ae-8424-4283e90a4c30] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:30.201303 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-76ae3711-631f-4407-ac1a-a3fc98270131 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:30.202928 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-76ae3711-631f-4407-ac1a-a3fc98270131 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:30.204369 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-76ae3711-631f-4407-ac1a-a3fc98270131 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:30.206880 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-76ae3711-631f-4407-ac1a-a3fc98270131 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:30.207974 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-76ae3711-631f-4407-ac1a-a3fc98270131 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:30.210132 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-76ae3711-631f-4407-ac1a-a3fc98270131 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:30.263121 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1167cecd-61ff-4fe3-9b2e-52c382c88757 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:30.281954 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1167cecd-61ff-4fe3-9b2e-52c382c88757 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:30.283649 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1167cecd-61ff-4fe3-9b2e-52c382c88757 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:30.285160 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1167cecd-61ff-4fe3-9b2e-52c382c88757 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1879 microversion: 2.42 time: 0.611453 Sep 10 11:45:30.290715 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 860/1634] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:29 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1879 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:45:30.317814 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4df75f22-5a87-48d7-82bc-8e01885cce20 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:30.318438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4df75f22-5a87-48d7-82bc-8e01885cce20 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:30.347818 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4df75f22-5a87-48d7-82bc-8e01885cce20 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:30.348444 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4df75f22-5a87-48d7-82bc-8e01885cce20 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:30.348895 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4df75f22-5a87-48d7-82bc-8e01885cce20 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:30.349641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4df75f22-5a87-48d7-82bc-8e01885cce20 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:30.350287 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4df75f22-5a87-48d7-82bc-8e01885cce20 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:30.350899 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4df75f22-5a87-48d7-82bc-8e01885cce20 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:30.491386 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4df75f22-5a87-48d7-82bc-8e01885cce20 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:30.503771 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4df75f22-5a87-48d7-82bc-8e01885cce20 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:30.505223 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4df75f22-5a87-48d7-82bc-8e01885cce20 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:30.506352 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4df75f22-5a87-48d7-82bc-8e01885cce20 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1251 microversion: 2.25 time: 0.195078 Sep 10 11:45:30.506918 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 861/1635] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:30 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1251 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:45:30.528146 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-52a929fb-5eb9-4ae3-ad30-b08a0c3277df tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:30.528674 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-52a929fb-5eb9-4ae3-ad30-b08a0c3277df tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:30.556965 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-52a929fb-5eb9-4ae3-ad30-b08a0c3277df tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:30.557468 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-52a929fb-5eb9-4ae3-ad30-b08a0c3277df tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:30.557901 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-52a929fb-5eb9-4ae3-ad30-b08a0c3277df tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:30.558617 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-52a929fb-5eb9-4ae3-ad30-b08a0c3277df tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:30.559080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-52a929fb-5eb9-4ae3-ad30-b08a0c3277df tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:30.559691 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-52a929fb-5eb9-4ae3-ad30-b08a0c3277df tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:30.654077 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-76ae3711-631f-4407-ac1a-a3fc98270131 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ea7c11febf451da4f1faf4dff9471d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f601d0bb424da4bb02b532ac982878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:30.681078 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-76ae3711-631f-4407-ac1a-a3fc98270131 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30" status: 200 len: 1367 microversion: 2.1 time: 0.518663 Sep 10 11:45:30.681675 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 775/1636] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:30 2022] GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30 => generated 1367 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:30.703638 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-52a929fb-5eb9-4ae3-ad30-b08a0c3277df tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:30.714768 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-52a929fb-5eb9-4ae3-ad30-b08a0c3277df tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1183 microversion: 2.1 time: 0.192787 Sep 10 11:45:30.726618 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 862/1637] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:30 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:31.182659 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ff65bd04-4db4-470b-a588-f88183f74f67 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:31.183404 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ff65bd04-4db4-470b-a588-f88183f74f67 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:31.197283 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff65bd04-4db4-470b-a588-f88183f74f67 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:31.198200 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff65bd04-4db4-470b-a588-f88183f74f67 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:31.200292 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff65bd04-4db4-470b-a588-f88183f74f67 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:31.202667 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff65bd04-4db4-470b-a588-f88183f74f67 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:31.203425 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff65bd04-4db4-470b-a588-f88183f74f67 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:31.212209 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff65bd04-4db4-470b-a588-f88183f74f67 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:31.318373 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b5ce23c5-d0c5-4b05-917a-6135957eeee3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:31.318993 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b5ce23c5-d0c5-4b05-917a-6135957eeee3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:31.334788 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5ce23c5-d0c5-4b05-917a-6135957eeee3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:31.335317 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5ce23c5-d0c5-4b05-917a-6135957eeee3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:31.335757 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5ce23c5-d0c5-4b05-917a-6135957eeee3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:31.336480 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5ce23c5-d0c5-4b05-917a-6135957eeee3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:31.336936 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5ce23c5-d0c5-4b05-917a-6135957eeee3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:31.337363 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5ce23c5-d0c5-4b05-917a-6135957eeee3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:31.713888 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:45:31.750806 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ff65bd04-4db4-470b-a588-f88183f74f67 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:31.759901 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ff65bd04-4db4-470b-a588-f88183f74f67 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1468 microversion: 2.1 time: 0.581951 Sep 10 11:45:31.764373 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 776/1638] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:31 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1468 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:31.779392 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1417e9cb-49ec-4d32-9a54-520a23e9bd1a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:31.780317 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1417e9cb-49ec-4d32-9a54-520a23e9bd1a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:31.782502 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:45:31.797335 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1417e9cb-49ec-4d32-9a54-520a23e9bd1a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:31.799926 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1417e9cb-49ec-4d32-9a54-520a23e9bd1a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:31.800623 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1417e9cb-49ec-4d32-9a54-520a23e9bd1a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:31.801601 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1417e9cb-49ec-4d32-9a54-520a23e9bd1a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:31.803829 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1417e9cb-49ec-4d32-9a54-520a23e9bd1a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:31.804284 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1417e9cb-49ec-4d32-9a54-520a23e9bd1a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:32.011468 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1417e9cb-49ec-4d32-9a54-520a23e9bd1a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:32.026401 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1417e9cb-49ec-4d32-9a54-520a23e9bd1a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:32.028283 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1417e9cb-49ec-4d32-9a54-520a23e9bd1a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:32.034581 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1417e9cb-49ec-4d32-9a54-520a23e9bd1a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1251 microversion: 2.25 time: 0.267853 Sep 10 11:45:32.040967 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 777/1639] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:31 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1251 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:45:32.043352 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b5ce23c5-d0c5-4b05-917a-6135957eeee3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:32.051155 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-90264de6-cd4f-4c28-b0e3-21c8a19af17f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:32.051366 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:45:32.053623 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-90264de6-cd4f-4c28-b0e3-21c8a19af17f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: e713eb62-8c55-40ae-8424-4283e90a4c30] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:32.061725 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b5ce23c5-d0c5-4b05-917a-6135957eeee3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:32.066540 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b5ce23c5-d0c5-4b05-917a-6135957eeee3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:32.067910 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b5ce23c5-d0c5-4b05-917a-6135957eeee3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1879 microversion: 2.42 time: 0.754558 Sep 10 11:45:32.068506 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 863/1640] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:31 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1879 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:45:32.078522 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90264de6-cd4f-4c28-b0e3-21c8a19af17f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:32.079650 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90264de6-cd4f-4c28-b0e3-21c8a19af17f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:32.080800 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90264de6-cd4f-4c28-b0e3-21c8a19af17f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:32.083492 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90264de6-cd4f-4c28-b0e3-21c8a19af17f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:32.085457 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90264de6-cd4f-4c28-b0e3-21c8a19af17f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:32.086017 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90264de6-cd4f-4c28-b0e3-21c8a19af17f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:32.107374 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-43b70c5e-1575-48e8-bf9b-3201f8aacd9d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:32.108067 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-43b70c5e-1575-48e8-bf9b-3201f8aacd9d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:32.128363 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-43b70c5e-1575-48e8-bf9b-3201f8aacd9d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:32.133057 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-43b70c5e-1575-48e8-bf9b-3201f8aacd9d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:32.133836 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-43b70c5e-1575-48e8-bf9b-3201f8aacd9d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:32.134806 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-43b70c5e-1575-48e8-bf9b-3201f8aacd9d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:32.136576 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-43b70c5e-1575-48e8-bf9b-3201f8aacd9d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:32.137197 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-43b70c5e-1575-48e8-bf9b-3201f8aacd9d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:32.319140 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-43b70c5e-1575-48e8-bf9b-3201f8aacd9d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:32.330269 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-43b70c5e-1575-48e8-bf9b-3201f8aacd9d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1183 microversion: 2.1 time: 0.240361 Sep 10 11:45:32.350535 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 864/1641] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:32 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1183 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:32.513104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-90264de6-cd4f-4c28-b0e3-21c8a19af17f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ea7c11febf451da4f1faf4dff9471d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f601d0bb424da4bb02b532ac982878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:32.525697 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-90264de6-cd4f-4c28-b0e3-21c8a19af17f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30" status: 200 len: 1367 microversion: 2.1 time: 0.483480 Sep 10 11:45:32.526516 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 778/1642] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:32 2022] GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30 => generated 1367 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:32.797009 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bfb13ae7-b5f9-49a3-8723-04a9cc894d24 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:32.798185 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bfb13ae7-b5f9-49a3-8723-04a9cc894d24 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:32.813446 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bfb13ae7-b5f9-49a3-8723-04a9cc894d24 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:32.818332 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bfb13ae7-b5f9-49a3-8723-04a9cc894d24 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:32.819056 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bfb13ae7-b5f9-49a3-8723-04a9cc894d24 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:32.837757 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bfb13ae7-b5f9-49a3-8723-04a9cc894d24 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:32.838826 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bfb13ae7-b5f9-49a3-8723-04a9cc894d24 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:32.842476 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bfb13ae7-b5f9-49a3-8723-04a9cc894d24 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:33.061909 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-33f481ec-1fe1-460b-8a1d-622bea2ee074 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:33.062635 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-33f481ec-1fe1-460b-8a1d-622bea2ee074 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:33.081141 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=8 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:45:33.083513 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-33f481ec-1fe1-460b-8a1d-622bea2ee074 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:33.084667 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-33f481ec-1fe1-460b-8a1d-622bea2ee074 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:33.089089 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-33f481ec-1fe1-460b-8a1d-622bea2ee074 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:33.089928 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-33f481ec-1fe1-460b-8a1d-622bea2ee074 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:33.090917 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-33f481ec-1fe1-460b-8a1d-622bea2ee074 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:33.093453 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-33f481ec-1fe1-460b-8a1d-622bea2ee074 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:33.179288 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bfb13ae7-b5f9-49a3-8723-04a9cc894d24 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:33.190339 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bfb13ae7-b5f9-49a3-8723-04a9cc894d24 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1534 microversion: 2.1 time: 0.399467 Sep 10 11:45:33.195523 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 865/1643] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:32 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1534 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:33.199764 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e3a55ae0-7815-4372-90d3-9442e2e8a2b1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:33.200502 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e3a55ae0-7815-4372-90d3-9442e2e8a2b1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:33.210372 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e3a55ae0-7815-4372-90d3-9442e2e8a2b1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:33.216152 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e3a55ae0-7815-4372-90d3-9442e2e8a2b1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:33.216922 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e3a55ae0-7815-4372-90d3-9442e2e8a2b1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:33.218334 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e3a55ae0-7815-4372-90d3-9442e2e8a2b1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:33.220035 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e3a55ae0-7815-4372-90d3-9442e2e8a2b1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:33.221607 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e3a55ae0-7815-4372-90d3-9442e2e8a2b1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:33.518438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e3a55ae0-7815-4372-90d3-9442e2e8a2b1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:33.541153 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e3a55ae0-7815-4372-90d3-9442e2e8a2b1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:33.548102 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e3a55ae0-7815-4372-90d3-9442e2e8a2b1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:33.553699 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e3a55ae0-7815-4372-90d3-9442e2e8a2b1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1879 microversion: 2.42 time: 0.360454 Sep 10 11:45:33.567427 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 866/1644] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:33 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1879 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:45:33.580996 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-33f481ec-1fe1-460b-8a1d-622bea2ee074 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:33.590959 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-33f481ec-1fe1-460b-8a1d-622bea2ee074 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:33.605207 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-33f481ec-1fe1-460b-8a1d-622bea2ee074 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:33.606606 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-33f481ec-1fe1-460b-8a1d-622bea2ee074 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1293 microversion: 2.25 time: 0.548547 Sep 10 11:45:33.607775 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 779/1645] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:33 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1293 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:45:33.633165 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-01bcd473-e832-4ccf-86d4-60b0de794df6 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:33.635272 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-01bcd473-e832-4ccf-86d4-60b0de794df6 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:33.662074 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01bcd473-e832-4ccf-86d4-60b0de794df6 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:33.662641 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01bcd473-e832-4ccf-86d4-60b0de794df6 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:33.663100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01bcd473-e832-4ccf-86d4-60b0de794df6 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:33.669546 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01bcd473-e832-4ccf-86d4-60b0de794df6 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:33.679608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01bcd473-e832-4ccf-86d4-60b0de794df6 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:33.680220 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01bcd473-e832-4ccf-86d4-60b0de794df6 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:33.717569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-acc6d98b-b54b-453d-84c7-85ebc7216509 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Action: 'create', calling method: .version_select at 0x7f40738cfb80>, body: {"keypair": {"name": "tempest-keypair-1969874413", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGwsVD4nO0KOycqJyauFSqcU8fx//5XdGNfobVyH3mZRLZE7KppnNFxLRUvNNitY/CLaQxo0yk3vqF2S1UQUxjX5ZE15+pS5F5juRuo4p2P7tVP3wg+FQyIFX+/Uo0ANA=="}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:45:33.752640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-acc6d98b-b54b-453d-84c7-85ebc7216509 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Getting quotas for project 0bdddfac170d4386abaf77217e0f35c4. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:45:33.778824 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:45:33.781185 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-acc6d98b-b54b-453d-84c7-85ebc7216509 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Getting quotas for user 27fa5fccb6d54dfc9f0125be9787b171 and project 0bdddfac170d4386abaf77217e0f35c4. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:45:33.824470 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-01bcd473-e832-4ccf-86d4-60b0de794df6 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:33.837348 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-01bcd473-e832-4ccf-86d4-60b0de794df6 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1183 microversion: 2.1 time: 0.228127 Sep 10 11:45:33.841449 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 780/1646] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:33 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1183 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:33.847736 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-4b5cc11a-b51d-463b-b4a9-386e8e74ba9c req-33e5b1d3-78da-4e86-ba49-ab97b45887fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a", "name": "network-vif-plugged", "status": "completed", "tag": "22d4e712-b79b-4d38-8916-a0128c576b77"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:45:33.862884 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-acc6d98b-b54b-453d-84c7-85ebc7216509 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.305057 Sep 10 11:45:33.864126 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 867/1647] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 11:45:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:45:33.878463 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3f2f1cad-51c4-477e-8d6d-4c86b7ab18f7 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:33.879102 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3f2f1cad-51c4-477e-8d6d-4c86b7ab18f7 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: e713eb62-8c55-40ae-8424-4283e90a4c30] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:33.884893 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-4b5cc11a-b51d-463b-b4a9-386e8e74ba9c req-33e5b1d3-78da-4e86-ba49-ab97b45887fa service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:33.886369 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-4b5cc11a-b51d-463b-b4a9-386e8e74ba9c req-33e5b1d3-78da-4e86-ba49-ab97b45887fa service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:33.886839 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-4b5cc11a-b51d-463b-b4a9-386e8e74ba9c req-33e5b1d3-78da-4e86-ba49-ab97b45887fa service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:33.902815 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3f2f1cad-51c4-477e-8d6d-4c86b7ab18f7 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:33.903346 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3f2f1cad-51c4-477e-8d6d-4c86b7ab18f7 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:33.903788 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3f2f1cad-51c4-477e-8d6d-4c86b7ab18f7 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:33.904506 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3f2f1cad-51c4-477e-8d6d-4c86b7ab18f7 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:33.904960 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3f2f1cad-51c4-477e-8d6d-4c86b7ab18f7 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:33.905389 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3f2f1cad-51c4-477e-8d6d-4c86b7ab18f7 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:33.923047 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-4b5cc11a-b51d-463b-b4a9-386e8e74ba9c req-33e5b1d3-78da-4e86-ba49-ab97b45887fa service nova] Creating event network-vif-plugged:22d4e712-b79b-4d38-8916-a0128c576b77 for instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a on n-h1-856895-1 Sep 10 11:45:33.937186 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-4b5cc11a-b51d-463b-b4a9-386e8e74ba9c req-33e5b1d3-78da-4e86-ba49-ab97b45887fa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092927 Sep 10 11:45:33.940783 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 781/1648] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:45:34.197688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3f2f1cad-51c4-477e-8d6d-4c86b7ab18f7 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ea7c11febf451da4f1faf4dff9471d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f601d0bb424da4bb02b532ac982878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:34.216979 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-566df35b-65ee-4cce-806d-75558b0733ba tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:34.217687 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-566df35b-65ee-4cce-806d-75558b0733ba tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:34.219330 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3f2f1cad-51c4-477e-8d6d-4c86b7ab18f7 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30" status: 200 len: 1367 microversion: 2.1 time: 0.350393 Sep 10 11:45:34.235196 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 868/1649] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:33 2022] GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30 => generated 1367 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:34.235426 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-566df35b-65ee-4cce-806d-75558b0733ba tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:34.235426 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-566df35b-65ee-4cce-806d-75558b0733ba tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:34.235426 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-566df35b-65ee-4cce-806d-75558b0733ba tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:34.235426 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-566df35b-65ee-4cce-806d-75558b0733ba tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:34.235426 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-566df35b-65ee-4cce-806d-75558b0733ba tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:34.235426 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-566df35b-65ee-4cce-806d-75558b0733ba tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:34.488074 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-566df35b-65ee-4cce-806d-75558b0733ba tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:34.496127 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-566df35b-65ee-4cce-806d-75558b0733ba tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1534 microversion: 2.1 time: 0.285393 Sep 10 11:45:34.497294 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 782/1650] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:34 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1534 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:45:34.583083 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-35e05e53-df9b-4920-8854-6288419cc647 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:34.584739 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-35e05e53-df9b-4920-8854-6288419cc647 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:34.596866 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-35e05e53-df9b-4920-8854-6288419cc647 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:34.597374 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-35e05e53-df9b-4920-8854-6288419cc647 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:34.597817 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-35e05e53-df9b-4920-8854-6288419cc647 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:34.606520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-35e05e53-df9b-4920-8854-6288419cc647 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:34.607235 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-35e05e53-df9b-4920-8854-6288419cc647 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:34.608965 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-35e05e53-df9b-4920-8854-6288419cc647 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:34.636785 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4d5d57a2-7f6a-4f37-ae27-a795c52a7914 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:34.638154 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4d5d57a2-7f6a-4f37-ae27-a795c52a7914 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:34.646818 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4d5d57a2-7f6a-4f37-ae27-a795c52a7914 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:34.649195 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4d5d57a2-7f6a-4f37-ae27-a795c52a7914 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:34.649851 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4d5d57a2-7f6a-4f37-ae27-a795c52a7914 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:34.656823 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4d5d57a2-7f6a-4f37-ae27-a795c52a7914 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:34.657491 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4d5d57a2-7f6a-4f37-ae27-a795c52a7914 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:34.658161 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4d5d57a2-7f6a-4f37-ae27-a795c52a7914 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:34.964680 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4d5d57a2-7f6a-4f37-ae27-a795c52a7914 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:34.970989 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-35e05e53-df9b-4920-8854-6288419cc647 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:34.980343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4d5d57a2-7f6a-4f37-ae27-a795c52a7914 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:34.981790 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4d5d57a2-7f6a-4f37-ae27-a795c52a7914 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:34.981970 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-35e05e53-df9b-4920-8854-6288419cc647 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:34.982916 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4d5d57a2-7f6a-4f37-ae27-a795c52a7914 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1293 microversion: 2.25 time: 0.350091 Sep 10 11:45:34.983519 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 783/1651] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:34 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1293 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:45:34.984185 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-35e05e53-df9b-4920-8854-6288419cc647 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:34.985734 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-35e05e53-df9b-4920-8854-6288419cc647 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1879 microversion: 2.42 time: 0.408779 Sep 10 11:45:34.986772 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 869/1652] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:34 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1879 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:45:34.989595 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-53871bc7-eae2-4b01-8486-d06be3379dc9 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:34.999938 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-53871bc7-eae2-4b01-8486-d06be3379dc9 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:35.007813 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53871bc7-eae2-4b01-8486-d06be3379dc9 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:35.008579 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53871bc7-eae2-4b01-8486-d06be3379dc9 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:35.009232 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53871bc7-eae2-4b01-8486-d06be3379dc9 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:35.010134 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53871bc7-eae2-4b01-8486-d06be3379dc9 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:35.010784 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53871bc7-eae2-4b01-8486-d06be3379dc9 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:35.011432 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53871bc7-eae2-4b01-8486-d06be3379dc9 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:35.137318 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-53871bc7-eae2-4b01-8486-d06be3379dc9 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:35.162776 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-53871bc7-eae2-4b01-8486-d06be3379dc9 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 200 len: 1183 microversion: 2.1 time: 0.177757 Sep 10 11:45:35.163811 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 784/1653] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:34 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 1183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:35.284646 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-35d42b60-c5da-4317-85d9-67bbe52a509f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:35.285874 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-35d42b60-c5da-4317-85d9-67bbe52a509f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: e713eb62-8c55-40ae-8424-4283e90a4c30] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:35.303215 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-39a3b6cc-fb7a-4aa9-bfdd-6a38d3903c2d req-74c230e7-9fcb-4eba-a72f-015078f5623c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e713eb62-8c55-40ae-8424-4283e90a4c30", "tag": "e7466b53-cc0f-4f0f-a845-678ac860b57a"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:45:35.304320 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-35d42b60-c5da-4317-85d9-67bbe52a509f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:35.305092 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-35d42b60-c5da-4317-85d9-67bbe52a509f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:35.307644 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-35d42b60-c5da-4317-85d9-67bbe52a509f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:35.308630 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-35d42b60-c5da-4317-85d9-67bbe52a509f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:35.309989 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-35d42b60-c5da-4317-85d9-67bbe52a509f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:35.311695 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-35d42b60-c5da-4317-85d9-67bbe52a509f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:35.320960 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-39a3b6cc-fb7a-4aa9-bfdd-6a38d3903c2d req-74c230e7-9fcb-4eba-a72f-015078f5623c service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:35.321460 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-39a3b6cc-fb7a-4aa9-bfdd-6a38d3903c2d req-74c230e7-9fcb-4eba-a72f-015078f5623c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:35.321902 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-39a3b6cc-fb7a-4aa9-bfdd-6a38d3903c2d req-74c230e7-9fcb-4eba-a72f-015078f5623c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:35.366627 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-39a3b6cc-fb7a-4aa9-bfdd-6a38d3903c2d req-74c230e7-9fcb-4eba-a72f-015078f5623c service nova] Creating event network-changed:e7466b53-cc0f-4f0f-a845-678ac860b57a for instance e713eb62-8c55-40ae-8424-4283e90a4c30 on n-h2-856895-1 Sep 10 11:45:35.385983 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-39a3b6cc-fb7a-4aa9-bfdd-6a38d3903c2d req-74c230e7-9fcb-4eba-a72f-015078f5623c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084134 Sep 10 11:45:35.395374 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 785/1654] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:45:35.522838 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-300e5908-7131-495d-aa75-fed3f7c345a5 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:35.523612 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-300e5908-7131-495d-aa75-fed3f7c345a5 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:35.542122 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-35d42b60-c5da-4317-85d9-67bbe52a509f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ea7c11febf451da4f1faf4dff9471d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f601d0bb424da4bb02b532ac982878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:35.551852 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-35d42b60-c5da-4317-85d9-67bbe52a509f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30" status: 200 len: 1367 microversion: 2.1 time: 0.305052 Sep 10 11:45:35.558550 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-300e5908-7131-495d-aa75-fed3f7c345a5 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:35.559498 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-300e5908-7131-495d-aa75-fed3f7c345a5 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:35.560200 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-300e5908-7131-495d-aa75-fed3f7c345a5 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:35.561180 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-300e5908-7131-495d-aa75-fed3f7c345a5 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:35.561869 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-300e5908-7131-495d-aa75-fed3f7c345a5 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:35.562530 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-300e5908-7131-495d-aa75-fed3f7c345a5 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:35.567833 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 870/1655] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:35 2022] GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30 => generated 1367 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:45:35.773275 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-300e5908-7131-495d-aa75-fed3f7c345a5 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:35.784933 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-300e5908-7131-495d-aa75-fed3f7c345a5 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1534 microversion: 2.1 time: 0.266016 Sep 10 11:45:35.786183 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 786/1656] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:35 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1534 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:36.008387 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-78904c72-51db-4abe-b68c-6a20391e014e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:36.009004 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-78904c72-51db-4abe-b68c-6a20391e014e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:36.013941 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-411c52da-fcdf-4d67-a119-171a04e5d9db tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:36.015046 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-411c52da-fcdf-4d67-a119-171a04e5d9db tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:36.032217 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-411c52da-fcdf-4d67-a119-171a04e5d9db tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:36.032707 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-411c52da-fcdf-4d67-a119-171a04e5d9db tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:36.035431 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78904c72-51db-4abe-b68c-6a20391e014e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:36.036201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-411c52da-fcdf-4d67-a119-171a04e5d9db tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:36.037252 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-411c52da-fcdf-4d67-a119-171a04e5d9db tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:36.037916 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78904c72-51db-4abe-b68c-6a20391e014e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:36.038541 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78904c72-51db-4abe-b68c-6a20391e014e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:36.039468 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-411c52da-fcdf-4d67-a119-171a04e5d9db tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:36.040349 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78904c72-51db-4abe-b68c-6a20391e014e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:36.040937 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-411c52da-fcdf-4d67-a119-171a04e5d9db tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:36.043881 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78904c72-51db-4abe-b68c-6a20391e014e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:36.049634 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78904c72-51db-4abe-b68c-6a20391e014e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:36.587614 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-411c52da-fcdf-4d67-a119-171a04e5d9db tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:36.601462 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-411c52da-fcdf-4d67-a119-171a04e5d9db tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:36.605812 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-411c52da-fcdf-4d67-a119-171a04e5d9db tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:36.613472 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-411c52da-fcdf-4d67-a119-171a04e5d9db tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1879 microversion: 2.42 time: 0.603161 Sep 10 11:45:36.633275 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 787/1657] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:36 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1879 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:45:36.648105 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-78904c72-51db-4abe-b68c-6a20391e014e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:36.661492 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-3240f147-a9d4-4e61-8959-3ec6f09564f8 req-827d1a2c-8017-495c-b40f-4c166400c34c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a", "name": "network-vif-plugged", "status": "completed", "tag": "63ec6435-27f2-4584-83e7-993fffb3189b"}, {"server_uuid": "ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a", "name": "network-vif-plugged", "status": "completed", "tag": "489e7897-1722-4643-b4ed-bef694daa679"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:45:36.666895 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-78904c72-51db-4abe-b68c-6a20391e014e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:36.675969 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-78904c72-51db-4abe-b68c-6a20391e014e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:36.679877 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-78904c72-51db-4abe-b68c-6a20391e014e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1293 microversion: 2.25 time: 0.674076 Sep 10 11:45:36.682057 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 871/1658] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:36 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1293 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:45:36.686456 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-3240f147-a9d4-4e61-8959-3ec6f09564f8 req-827d1a2c-8017-495c-b40f-4c166400c34c service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:36.687149 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-3240f147-a9d4-4e61-8959-3ec6f09564f8 req-827d1a2c-8017-495c-b40f-4c166400c34c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:36.696096 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-3240f147-a9d4-4e61-8959-3ec6f09564f8 req-827d1a2c-8017-495c-b40f-4c166400c34c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:36.697759 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-633d25a8-50ab-40c3-b5e9-f7d06ee33e31 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:36.698628 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-633d25a8-50ab-40c3-b5e9-f7d06ee33e31 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 6cb195e0-436b-4ffc-8819-fdac586f6896] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:36.712911 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-633d25a8-50ab-40c3-b5e9-f7d06ee33e31 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:36.717969 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-633d25a8-50ab-40c3-b5e9-f7d06ee33e31 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:36.718151 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-3240f147-a9d4-4e61-8959-3ec6f09564f8 req-827d1a2c-8017-495c-b40f-4c166400c34c service nova] Creating event network-vif-plugged:63ec6435-27f2-4584-83e7-993fffb3189b for instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a on n-h1-856895-1 Sep 10 11:45:36.718601 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-3240f147-a9d4-4e61-8959-3ec6f09564f8 req-827d1a2c-8017-495c-b40f-4c166400c34c service nova] Creating event network-vif-plugged:489e7897-1722-4643-b4ed-bef694daa679 for instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a on n-h1-856895-1 Sep 10 11:45:36.718990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-633d25a8-50ab-40c3-b5e9-f7d06ee33e31 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:36.725111 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-633d25a8-50ab-40c3-b5e9-f7d06ee33e31 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:36.727516 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-3240f147-a9d4-4e61-8959-3ec6f09564f8 req-827d1a2c-8017-495c-b40f-4c166400c34c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.092625 Sep 10 11:45:36.728316 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 788/1659] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:45:36.741575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2378acd9-112f-4a39-8360-c9398cb06717 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:36.742302 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2378acd9-112f-4a39-8360-c9398cb06717 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: e713eb62-8c55-40ae-8424-4283e90a4c30] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:36.751614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-633d25a8-50ab-40c3-b5e9-f7d06ee33e31 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:36.752394 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-633d25a8-50ab-40c3-b5e9-f7d06ee33e31 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:36.771771 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2378acd9-112f-4a39-8360-c9398cb06717 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:36.773211 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2378acd9-112f-4a39-8360-c9398cb06717 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:36.773536 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2378acd9-112f-4a39-8360-c9398cb06717 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:36.774265 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2378acd9-112f-4a39-8360-c9398cb06717 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:36.774721 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2378acd9-112f-4a39-8360-c9398cb06717 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:36.775208 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2378acd9-112f-4a39-8360-c9398cb06717 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:36.787555 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-633d25a8-50ab-40c3-b5e9-f7d06ee33e31 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] HTTP exception thrown: Instance 6cb195e0-436b-4ffc-8819-fdac586f6896 could not be found. Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-633d25a8-50ab-40c3-b5e9-f7d06ee33e31 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Request method failure captured: Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 HTTP/1.1 Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHc28y97emUyUWaB-DU1sR2yW_NJ8wQwjxvgYoJp3QhVt8csYxyZV2I2MuSz5W0CcqtsNoVX-V3kbGPXqBL2XNuIrZMst7-PX_eYeJ22UptHu6DBoLoOK1_gvgLQMEm4uuwkZ4U2hE7nzHKCwWGG2gMUGj1sEUA8Bg8r5FS2vFpIAvY Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 6750367ae6604f798bfd58e2839f83e2 Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-LiveMigrationTest-1554382024 Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6750367ae6604f798bfd58e2839f83e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6750367ae6604f798bfd58e2839f83e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6750367ae6604f798bfd58e2839f83e2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6750367ae6604f798bfd58e2839f83e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-LiveMigrationTest-1554382024 Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 6750367ae6604f798bfd58e2839f83e2 Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-LiveMigrationTest-1554382024 Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-LiveMigrationTest-1554382024-project Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 805e0c24bd364ac8852387db73b614d9 Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-LiveMigrationTest-1554382024-project Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 6cb195e0-436b-4ffc-8819-fdac586f6896 could not be found. Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '6cb195e0-436b-4ffc-8819-fdac586f6896'} Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cb195e0-436b-4ffc-8819-fdac586f6896 could not be found. Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cb195e0-436b-4ffc-8819-fdac586f6896 could not be found. Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:45:36.789255 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:45:36.800854 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:45:36.800854 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:45:36.800854 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:45:36.800854 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:45:36.800854 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:45:36.800854 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cb195e0-436b-4ffc-8819-fdac586f6896 could not be found. Sep 10 11:45:36.800854 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:45:36.800854 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-633d25a8-50ab-40c3-b5e9-f7d06ee33e31 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Returning 404 to user: Instance 6cb195e0-436b-4ffc-8819-fdac586f6896 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:45:36.800854 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-633d25a8-50ab-40c3-b5e9-f7d06ee33e31 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896" status: 404 len: 111 microversion: 2.1 time: 0.107483 Sep 10 11:45:36.820609 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 872/1660] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:36 2022] GET /compute/v2.1/servers/6cb195e0-436b-4ffc-8819-fdac586f6896 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:45:36.824706 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:45:36.835974 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4fc5e5f4-191e-4c2a-93d9-169550d2b482 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:36.837600 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4fc5e5f4-191e-4c2a-93d9-169550d2b482 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:36.873322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4fc5e5f4-191e-4c2a-93d9-169550d2b482 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:36.874223 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4fc5e5f4-191e-4c2a-93d9-169550d2b482 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:36.882110 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4fc5e5f4-191e-4c2a-93d9-169550d2b482 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:36.883692 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4fc5e5f4-191e-4c2a-93d9-169550d2b482 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:36.890962 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4fc5e5f4-191e-4c2a-93d9-169550d2b482 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:36.891650 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4fc5e5f4-191e-4c2a-93d9-169550d2b482 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:37.424648 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=5 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:45:37.623725 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4fc5e5f4-191e-4c2a-93d9-169550d2b482 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:37.632462 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4fc5e5f4-191e-4c2a-93d9-169550d2b482 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1534 microversion: 2.1 time: 0.810393 Sep 10 11:45:37.633057 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 873/1661] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:36 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1534 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:37.646719 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-40fea1e5-279b-44c8-bf7d-51aae6d1e090 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:37.647400 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-40fea1e5-279b-44c8-bf7d-51aae6d1e090 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:37.662774 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40fea1e5-279b-44c8-bf7d-51aae6d1e090 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:37.663519 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40fea1e5-279b-44c8-bf7d-51aae6d1e090 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:37.663734 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40fea1e5-279b-44c8-bf7d-51aae6d1e090 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:37.664594 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40fea1e5-279b-44c8-bf7d-51aae6d1e090 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:37.665052 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40fea1e5-279b-44c8-bf7d-51aae6d1e090 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:37.665488 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40fea1e5-279b-44c8-bf7d-51aae6d1e090 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:37.718793 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2378acd9-112f-4a39-8360-c9398cb06717 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ea7c11febf451da4f1faf4dff9471d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f601d0bb424da4bb02b532ac982878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:37.727963 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2378acd9-112f-4a39-8360-c9398cb06717 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30" status: 200 len: 1367 microversion: 2.1 time: 0.998640 Sep 10 11:45:37.728545 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 789/1662] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:36 2022] GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30 => generated 1367 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:37.750950 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5259b264-f7f3-4911-886a-da597032ddbf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:37.753700 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5259b264-f7f3-4911-886a-da597032ddbf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:37.774160 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5259b264-f7f3-4911-886a-da597032ddbf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:37.774860 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5259b264-f7f3-4911-886a-da597032ddbf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:37.775223 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5259b264-f7f3-4911-886a-da597032ddbf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:37.775836 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5259b264-f7f3-4911-886a-da597032ddbf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:37.776294 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5259b264-f7f3-4911-886a-da597032ddbf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:37.776726 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5259b264-f7f3-4911-886a-da597032ddbf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:38.121331 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-40fea1e5-279b-44c8-bf7d-51aae6d1e090 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:38.130652 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5259b264-f7f3-4911-886a-da597032ddbf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:38.153931 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-40fea1e5-279b-44c8-bf7d-51aae6d1e090 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:38.155700 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-40fea1e5-279b-44c8-bf7d-51aae6d1e090 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:38.157845 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-40fea1e5-279b-44c8-bf7d-51aae6d1e090 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1879 microversion: 2.42 time: 0.517664 Sep 10 11:45:38.159413 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 874/1663] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:37 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1879 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:45:38.164031 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-d607769a-6316-4062-b7bf-b4fec810a9c9 req-5f73e819-b160-491e-b748-06048f614ba9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc446beb-aed5-4d4e-954b-30c480f62ef0", "tag": "d53a3f4b-c348-4a6d-b50f-9111fcac793a"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:45:38.166314 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5259b264-f7f3-4911-886a-da597032ddbf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:38.168681 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5259b264-f7f3-4911-886a-da597032ddbf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:38.174372 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5259b264-f7f3-4911-886a-da597032ddbf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1293 microversion: 2.25 time: 0.444444 Sep 10 11:45:38.175829 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d607769a-6316-4062-b7bf-b4fec810a9c9 req-5f73e819-b160-491e-b748-06048f614ba9 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:38.176508 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d607769a-6316-4062-b7bf-b4fec810a9c9 req-5f73e819-b160-491e-b748-06048f614ba9 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:38.177112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d607769a-6316-4062-b7bf-b4fec810a9c9 req-5f73e819-b160-491e-b748-06048f614ba9 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:38.190348 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 790/1664] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:37 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1293 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:45:38.194116 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-d607769a-6316-4062-b7bf-b4fec810a9c9 req-5f73e819-b160-491e-b748-06048f614ba9 service nova] Creating event network-changed:d53a3f4b-c348-4a6d-b50f-9111fcac793a for instance bc446beb-aed5-4d4e-954b-30c480f62ef0 on n-h1-856895-1 Sep 10 11:45:38.200857 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [req-d607769a-6316-4062-b7bf-b4fec810a9c9 req-5f73e819-b160-491e-b748-06048f614ba9 service nova] Instance bc446beb-aed5-4d4e-954b-30c480f62ef0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856895-1', 'n-h1-856895-1'} {{(pid=128777) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 11:45:38.231283 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-d607769a-6316-4062-b7bf-b4fec810a9c9 req-5f73e819-b160-491e-b748-06048f614ba9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056257 Sep 10 11:45:38.234369 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 875/1665] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:45:38.667312 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-81a0a522-59c4-41c3-8fd6-96a48eccf76f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:38.669083 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-81a0a522-59c4-41c3-8fd6-96a48eccf76f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:38.683372 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81a0a522-59c4-41c3-8fd6-96a48eccf76f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:38.686715 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81a0a522-59c4-41c3-8fd6-96a48eccf76f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:38.688222 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81a0a522-59c4-41c3-8fd6-96a48eccf76f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:38.691905 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81a0a522-59c4-41c3-8fd6-96a48eccf76f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:38.692467 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81a0a522-59c4-41c3-8fd6-96a48eccf76f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:38.693050 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81a0a522-59c4-41c3-8fd6-96a48eccf76f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:38.756977 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e9f284d2-97e0-4a5e-b627-566cd1f9f4f4 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:38.757850 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e9f284d2-97e0-4a5e-b627-566cd1f9f4f4 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: e713eb62-8c55-40ae-8424-4283e90a4c30] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:38.771217 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e9f284d2-97e0-4a5e-b627-566cd1f9f4f4 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:38.778398 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e9f284d2-97e0-4a5e-b627-566cd1f9f4f4 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:38.779386 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e9f284d2-97e0-4a5e-b627-566cd1f9f4f4 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:38.780589 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e9f284d2-97e0-4a5e-b627-566cd1f9f4f4 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:38.782054 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e9f284d2-97e0-4a5e-b627-566cd1f9f4f4 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:38.783619 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e9f284d2-97e0-4a5e-b627-566cd1f9f4f4 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:39.070472 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-81a0a522-59c4-41c3-8fd6-96a48eccf76f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:39.080772 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-81a0a522-59c4-41c3-8fd6-96a48eccf76f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1534 microversion: 2.1 time: 0.417438 Sep 10 11:45:39.095501 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 791/1666] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:38 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1534 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:39.105688 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-81825cbf-9260-4337-bc51-ea4d094b5b38 req-8976c9ed-a568-4fb0-92fe-d54f93d3dadd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a", "name": "network-vif-plugged", "status": "completed", "tag": "1fe87fac-c7e8-4ff7-858b-ab19c862196d"}, {"server_uuid": "ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a", "name": "network-vif-plugged", "status": "completed", "tag": "59f16da0-b2c3-4790-8066-9b8d9bae32dd"}, {"server_uuid": "ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a", "name": "network-vif-plugged", "status": "completed", "tag": "e0c27aad-4065-4a4d-9a93-e46baa44130f"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:45:39.130616 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-81825cbf-9260-4337-bc51-ea4d094b5b38 req-8976c9ed-a568-4fb0-92fe-d54f93d3dadd service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:39.131116 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-81825cbf-9260-4337-bc51-ea4d094b5b38 req-8976c9ed-a568-4fb0-92fe-d54f93d3dadd service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:39.131580 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-81825cbf-9260-4337-bc51-ea4d094b5b38 req-8976c9ed-a568-4fb0-92fe-d54f93d3dadd service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:39.191086 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-81825cbf-9260-4337-bc51-ea4d094b5b38 req-8976c9ed-a568-4fb0-92fe-d54f93d3dadd service nova] Creating event network-vif-plugged:1fe87fac-c7e8-4ff7-858b-ab19c862196d for instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a on n-h1-856895-1 Sep 10 11:45:39.192097 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-81825cbf-9260-4337-bc51-ea4d094b5b38 req-8976c9ed-a568-4fb0-92fe-d54f93d3dadd service nova] Creating event network-vif-plugged:59f16da0-b2c3-4790-8066-9b8d9bae32dd for instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a on n-h1-856895-1 Sep 10 11:45:39.192861 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-81825cbf-9260-4337-bc51-ea4d094b5b38 req-8976c9ed-a568-4fb0-92fe-d54f93d3dadd service nova] Creating event network-vif-plugged:e0c27aad-4065-4a4d-9a93-e46baa44130f for instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a on n-h1-856895-1 Sep 10 11:45:39.214519 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-81825cbf-9260-4337-bc51-ea4d094b5b38 req-8976c9ed-a568-4fb0-92fe-d54f93d3dadd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.127006 Sep 10 11:45:39.222957 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 792/1667] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:45:39.230049 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5d4e38e0-c8e0-4734-90bf-36c5ddcd62c3 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Action: 'create', calling method: .version_select at 0x7f407b5efb80>, body: {"keypair": {"name": "tempest-keypair-1675973244", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZ4R0rmj1iFyTRC/zRItggVLJBrhdv/EYCLNoZZNOMRL+PRSd8Nd7UzmfcafVmU8RW1PcZhI3bKI7swKmFFQPACNktOEBxPfn6nwnPEKUSGAejopzlpqZiRR6guHbO6Ag=="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:45:39.322297 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-5d4e38e0-c8e0-4734-90bf-36c5ddcd62c3 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Getting quotas for project 337f9c4dcb0b4da097f41bde1d789efa. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:45:39.338321 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-5d4e38e0-c8e0-4734-90bf-36c5ddcd62c3 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Getting quotas for user 2d00b725397549cfaa2aeb2b0a8dfe3d and project 337f9c4dcb0b4da097f41bde1d789efa. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:45:39.418217 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e9f284d2-97e0-4a5e-b627-566cd1f9f4f4 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ea7c11febf451da4f1faf4dff9471d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f601d0bb424da4bb02b532ac982878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:39.434290 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e9f284d2-97e0-4a5e-b627-566cd1f9f4f4 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30" status: 200 len: 1367 microversion: 2.1 time: 0.681762 Sep 10 11:45:39.438793 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5d4e38e0-c8e0-4734-90bf-36c5ddcd62c3 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.214399 Sep 10 11:45:39.450787 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 793/1668] 10.222.0.23 () {62 vars in 1200 bytes} [Sat Sep 10 11:45:39 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 227 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 10 11:45:39.452434 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 876/1669] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:38 2022] GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30 => generated 1367 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:45:39.460153 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-82fd1203-b5b4-40fb-ba21-57f977faefb1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:39.461482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-67d1d2a3-d83b-4be0-9c86-bcfd73303c48 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:39.463097 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-67d1d2a3-d83b-4be0-9c86-bcfd73303c48 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:39.475772 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-82fd1203-b5b4-40fb-ba21-57f977faefb1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:39.478912 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67d1d2a3-d83b-4be0-9c86-bcfd73303c48 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:39.483962 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67d1d2a3-d83b-4be0-9c86-bcfd73303c48 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:39.484796 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67d1d2a3-d83b-4be0-9c86-bcfd73303c48 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:39.485808 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67d1d2a3-d83b-4be0-9c86-bcfd73303c48 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:39.488297 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67d1d2a3-d83b-4be0-9c86-bcfd73303c48 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:39.488978 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67d1d2a3-d83b-4be0-9c86-bcfd73303c48 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:39.489261 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82fd1203-b5b4-40fb-ba21-57f977faefb1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:39.489757 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82fd1203-b5b4-40fb-ba21-57f977faefb1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:39.490195 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82fd1203-b5b4-40fb-ba21-57f977faefb1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:39.495442 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82fd1203-b5b4-40fb-ba21-57f977faefb1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:39.495989 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82fd1203-b5b4-40fb-ba21-57f977faefb1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:39.496436 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82fd1203-b5b4-40fb-ba21-57f977faefb1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:40.069501 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-82fd1203-b5b4-40fb-ba21-57f977faefb1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:40.148842 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-82fd1203-b5b4-40fb-ba21-57f977faefb1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:40.156066 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-82fd1203-b5b4-40fb-ba21-57f977faefb1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:40.176607 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-82fd1203-b5b4-40fb-ba21-57f977faefb1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1293 microversion: 2.25 time: 0.722785 Sep 10 11:45:40.177534 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 877/1670] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:39 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1293 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:45:40.195118 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-502a1c84-efc0-4350-9488-c81d951d408a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:40.195914 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-502a1c84-efc0-4350-9488-c81d951d408a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:40.202336 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-502a1c84-efc0-4350-9488-c81d951d408a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:40.202822 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-502a1c84-efc0-4350-9488-c81d951d408a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:40.203280 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-502a1c84-efc0-4350-9488-c81d951d408a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:40.203984 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-502a1c84-efc0-4350-9488-c81d951d408a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:40.204434 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-502a1c84-efc0-4350-9488-c81d951d408a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:40.204856 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-502a1c84-efc0-4350-9488-c81d951d408a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:40.506021 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-67d1d2a3-d83b-4be0-9c86-bcfd73303c48 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:40.540162 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-67d1d2a3-d83b-4be0-9c86-bcfd73303c48 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:40.548180 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-67d1d2a3-d83b-4be0-9c86-bcfd73303c48 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:40.553553 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-67d1d2a3-d83b-4be0-9c86-bcfd73303c48 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1879 microversion: 2.42 time: 1.100374 Sep 10 11:45:40.571490 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 794/1671] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:39 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1879 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:45:40.606392 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-3ceecffd-4a23-4757-83ef-555d434774c3 req-03bf3481-9aa3-49db-a5e6-0d06fec885f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a62a6c44-9d92-4766-a81d-c09670110ab4", "tag": "2bd5dc49-b958-48da-8036-9f8348b0324b"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:45:40.681296 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-3ceecffd-4a23-4757-83ef-555d434774c3 req-03bf3481-9aa3-49db-a5e6-0d06fec885f5 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:40.689755 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-3ceecffd-4a23-4757-83ef-555d434774c3 req-03bf3481-9aa3-49db-a5e6-0d06fec885f5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:40.692691 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-3ceecffd-4a23-4757-83ef-555d434774c3 req-03bf3481-9aa3-49db-a5e6-0d06fec885f5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:40.724443 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-502a1c84-efc0-4350-9488-c81d951d408a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:40.725636 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-3ceecffd-4a23-4757-83ef-555d434774c3 req-03bf3481-9aa3-49db-a5e6-0d06fec885f5 service nova] Creating event network-changed:2bd5dc49-b958-48da-8036-9f8348b0324b for instance a62a6c44-9d92-4766-a81d-c09670110ab4 on n-h2-856895-1 Sep 10 11:45:40.735808 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-3ceecffd-4a23-4757-83ef-555d434774c3 req-03bf3481-9aa3-49db-a5e6-0d06fec885f5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151756 Sep 10 11:45:40.736410 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-502a1c84-efc0-4350-9488-c81d951d408a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1534 microversion: 2.1 time: 0.554132 Sep 10 11:45:40.743252 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 878/1672] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:40 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1534 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:40.743597 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 795/1673] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:45:40.748711 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-172dfdb2-a644-4335-a4dc-e0276f29946e tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:40.749537 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-172dfdb2-a644-4335-a4dc-e0276f29946e tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: e713eb62-8c55-40ae-8424-4283e90a4c30] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:40.761435 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-172dfdb2-a644-4335-a4dc-e0276f29946e tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:40.761926 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-172dfdb2-a644-4335-a4dc-e0276f29946e tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:40.762358 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-172dfdb2-a644-4335-a4dc-e0276f29946e tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:40.763055 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-172dfdb2-a644-4335-a4dc-e0276f29946e tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:40.768554 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-172dfdb2-a644-4335-a4dc-e0276f29946e tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:40.769535 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-172dfdb2-a644-4335-a4dc-e0276f29946e tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:41.162302 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-172dfdb2-a644-4335-a4dc-e0276f29946e tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ea7c11febf451da4f1faf4dff9471d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f601d0bb424da4bb02b532ac982878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:41.175948 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-172dfdb2-a644-4335-a4dc-e0276f29946e tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30" status: 200 len: 1367 microversion: 2.1 time: 0.436048 Sep 10 11:45:41.199491 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 879/1674] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:40 2022] GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30 => generated 1367 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:41.207772 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-15772d83-5d8a-4958-9d5b-83f7a964e64e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:41.209120 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-15772d83-5d8a-4958-9d5b-83f7a964e64e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:41.225835 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-15772d83-5d8a-4958-9d5b-83f7a964e64e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:41.226736 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-15772d83-5d8a-4958-9d5b-83f7a964e64e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:41.229330 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-15772d83-5d8a-4958-9d5b-83f7a964e64e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:41.231629 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-15772d83-5d8a-4958-9d5b-83f7a964e64e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:41.235355 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-15772d83-5d8a-4958-9d5b-83f7a964e64e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:41.240755 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-15772d83-5d8a-4958-9d5b-83f7a964e64e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:41.268198 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-73aa229c-3be2-4aa1-86be-26a67c3a98d6 req-1d9582a3-efc1-471e-b52f-dffc086ea7ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a", "name": "network-vif-plugged", "status": "completed", "tag": "ff0620c7-4af8-438f-80cb-a5112186d60a"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:45:41.287258 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-73aa229c-3be2-4aa1-86be-26a67c3a98d6 req-1d9582a3-efc1-471e-b52f-dffc086ea7ee service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:41.288433 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-73aa229c-3be2-4aa1-86be-26a67c3a98d6 req-1d9582a3-efc1-471e-b52f-dffc086ea7ee service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:41.288966 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-73aa229c-3be2-4aa1-86be-26a67c3a98d6 req-1d9582a3-efc1-471e-b52f-dffc086ea7ee service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:41.317506 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-73aa229c-3be2-4aa1-86be-26a67c3a98d6 req-1d9582a3-efc1-471e-b52f-dffc086ea7ee service nova] Creating event network-vif-plugged:ff0620c7-4af8-438f-80cb-a5112186d60a for instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a on n-h1-856895-1 Sep 10 11:45:41.330415 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-73aa229c-3be2-4aa1-86be-26a67c3a98d6 req-1d9582a3-efc1-471e-b52f-dffc086ea7ee service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066342 Sep 10 11:45:41.333457 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 880/1675] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:45:41.594330 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ec24456f-e9a0-4656-9577-6f1bc425f5e3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:41.595477 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ec24456f-e9a0-4656-9577-6f1bc425f5e3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:41.608013 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec24456f-e9a0-4656-9577-6f1bc425f5e3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:41.609975 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec24456f-e9a0-4656-9577-6f1bc425f5e3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:41.614100 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec24456f-e9a0-4656-9577-6f1bc425f5e3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:41.617233 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec24456f-e9a0-4656-9577-6f1bc425f5e3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:41.618071 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec24456f-e9a0-4656-9577-6f1bc425f5e3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:41.618773 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec24456f-e9a0-4656-9577-6f1bc425f5e3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:41.978970 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-15772d83-5d8a-4958-9d5b-83f7a964e64e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:41.996526 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-15772d83-5d8a-4958-9d5b-83f7a964e64e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:41.998633 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-15772d83-5d8a-4958-9d5b-83f7a964e64e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:42.001584 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-15772d83-5d8a-4958-9d5b-83f7a964e64e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1293 microversion: 2.25 time: 0.799322 Sep 10 11:45:42.007866 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 796/1676] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:41 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1293 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:45:42.040258 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-89c04b06-1560-4d1d-b067-08ae1ee5f399 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:42.041580 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-89c04b06-1560-4d1d-b067-08ae1ee5f399 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:42.052127 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89c04b06-1560-4d1d-b067-08ae1ee5f399 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:42.053021 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89c04b06-1560-4d1d-b067-08ae1ee5f399 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:42.054765 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89c04b06-1560-4d1d-b067-08ae1ee5f399 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:42.059762 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89c04b06-1560-4d1d-b067-08ae1ee5f399 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:42.060328 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89c04b06-1560-4d1d-b067-08ae1ee5f399 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:42.061002 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89c04b06-1560-4d1d-b067-08ae1ee5f399 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:42.428379 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ec24456f-e9a0-4656-9577-6f1bc425f5e3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:42.440271 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ec24456f-e9a0-4656-9577-6f1bc425f5e3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:42.447859 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ec24456f-e9a0-4656-9577-6f1bc425f5e3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:42.451277 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ec24456f-e9a0-4656-9577-6f1bc425f5e3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1879 microversion: 2.42 time: 0.862168 Sep 10 11:45:42.460611 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 881/1677] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:41 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1879 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:45:42.465540 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-38b3584d-fb99-441f-a324-58ae2b6ddc1a tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:42.472405 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-38b3584d-fb99-441f-a324-58ae2b6ddc1a tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: e713eb62-8c55-40ae-8424-4283e90a4c30] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:42.490000 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-38b3584d-fb99-441f-a324-58ae2b6ddc1a tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:42.497220 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-38b3584d-fb99-441f-a324-58ae2b6ddc1a tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:42.497883 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-38b3584d-fb99-441f-a324-58ae2b6ddc1a tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:42.499247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-38b3584d-fb99-441f-a324-58ae2b6ddc1a tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:42.499880 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-38b3584d-fb99-441f-a324-58ae2b6ddc1a tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:42.500530 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-38b3584d-fb99-441f-a324-58ae2b6ddc1a tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:43.610663 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-89c04b06-1560-4d1d-b067-08ae1ee5f399 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:43.620483 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-89c04b06-1560-4d1d-b067-08ae1ee5f399 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1534 microversion: 2.1 time: 1.597826 Sep 10 11:45:43.621083 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 797/1678] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:42 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1534 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:43.646775 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dee7c9ab-4659-4ef1-8adf-d4461ceaf1c1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:43.647455 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-dee7c9ab-4659-4ef1-8adf-d4461ceaf1c1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:43.683020 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dee7c9ab-4659-4ef1-8adf-d4461ceaf1c1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:43.684314 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dee7c9ab-4659-4ef1-8adf-d4461ceaf1c1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:43.685645 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dee7c9ab-4659-4ef1-8adf-d4461ceaf1c1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:43.686411 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dee7c9ab-4659-4ef1-8adf-d4461ceaf1c1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:43.686881 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dee7c9ab-4659-4ef1-8adf-d4461ceaf1c1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:43.687587 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dee7c9ab-4659-4ef1-8adf-d4461ceaf1c1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:43.802777 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=12 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:45:44.229602 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-dee7c9ab-4659-4ef1-8adf-d4461ceaf1c1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:44.245808 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-dee7c9ab-4659-4ef1-8adf-d4461ceaf1c1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:44.252939 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-38b3584d-fb99-441f-a324-58ae2b6ddc1a tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ea7c11febf451da4f1faf4dff9471d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f601d0bb424da4bb02b532ac982878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:44.262057 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-dee7c9ab-4659-4ef1-8adf-d4461ceaf1c1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:44.263747 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-dee7c9ab-4659-4ef1-8adf-d4461ceaf1c1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1293 microversion: 2.25 time: 0.634210 Sep 10 11:45:44.264641 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-38b3584d-fb99-441f-a324-58ae2b6ddc1a tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30" status: 200 len: 1367 microversion: 2.1 time: 1.802660 Sep 10 11:45:44.265438 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 798/1679] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:43 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1293 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:45:44.269576 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 882/1680] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:42 2022] GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30 => generated 1367 bytes in 1808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:44.279599 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8b62c2be-e999-420e-a6a5-5ca8bf6071ec tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:44.281376 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8b62c2be-e999-420e-a6a5-5ca8bf6071ec tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:44.295956 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8b62c2be-e999-420e-a6a5-5ca8bf6071ec tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:44.298035 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8b62c2be-e999-420e-a6a5-5ca8bf6071ec tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:44.298755 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8b62c2be-e999-420e-a6a5-5ca8bf6071ec tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:44.302907 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8b62c2be-e999-420e-a6a5-5ca8bf6071ec tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:44.305708 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8b62c2be-e999-420e-a6a5-5ca8bf6071ec tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:44.306172 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8b62c2be-e999-420e-a6a5-5ca8bf6071ec tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:44.461522 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-ff1cabb4-6859-4335-8cdd-c0040aebccc6 req-0d57dd49-bc2e-4065-b9e8-f9496f1380ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e713eb62-8c55-40ae-8424-4283e90a4c30", "name": "network-vif-plugged", "status": "completed", "tag": "e7466b53-cc0f-4f0f-a845-678ac860b57a"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:45:44.488665 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-ff1cabb4-6859-4335-8cdd-c0040aebccc6 req-0d57dd49-bc2e-4065-b9e8-f9496f1380ff service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:44.495873 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-ff1cabb4-6859-4335-8cdd-c0040aebccc6 req-0d57dd49-bc2e-4065-b9e8-f9496f1380ff service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:44.496734 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-ff1cabb4-6859-4335-8cdd-c0040aebccc6 req-0d57dd49-bc2e-4065-b9e8-f9496f1380ff service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:44.526385 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=100 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:45:44.535648 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-ff1cabb4-6859-4335-8cdd-c0040aebccc6 req-0d57dd49-bc2e-4065-b9e8-f9496f1380ff service nova] Creating event network-vif-plugged:e7466b53-cc0f-4f0f-a845-678ac860b57a for instance e713eb62-8c55-40ae-8424-4283e90a4c30 on n-h2-856895-1 Sep 10 11:45:44.547669 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-ff1cabb4-6859-4335-8cdd-c0040aebccc6 req-0d57dd49-bc2e-4065-b9e8-f9496f1380ff service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102244 Sep 10 11:45:44.552139 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 883/1681] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:45:44.650880 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9ac76208-a614-4aa0-8292-8c1b2c87fd86 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:44.652035 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9ac76208-a614-4aa0-8292-8c1b2c87fd86 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:44.665893 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9ac76208-a614-4aa0-8292-8c1b2c87fd86 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:44.675872 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9ac76208-a614-4aa0-8292-8c1b2c87fd86 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:44.676712 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9ac76208-a614-4aa0-8292-8c1b2c87fd86 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:44.677734 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9ac76208-a614-4aa0-8292-8c1b2c87fd86 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:44.678436 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9ac76208-a614-4aa0-8292-8c1b2c87fd86 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:44.679129 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9ac76208-a614-4aa0-8292-8c1b2c87fd86 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:45.122468 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8b62c2be-e999-420e-a6a5-5ca8bf6071ec tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:45.144059 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8b62c2be-e999-420e-a6a5-5ca8bf6071ec tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:45.150286 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8b62c2be-e999-420e-a6a5-5ca8bf6071ec tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:45.153398 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8b62c2be-e999-420e-a6a5-5ca8bf6071ec tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1879 microversion: 2.42 time: 0.883931 Sep 10 11:45:45.155465 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 799/1682] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:44 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1879 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:45:45.216592 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9ac76208-a614-4aa0-8292-8c1b2c87fd86 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:45.226962 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9ac76208-a614-4aa0-8292-8c1b2c87fd86 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1527 microversion: 2.1 time: 0.579300 Sep 10 11:45:45.228615 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 884/1683] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:44 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1527 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:45.257714 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5d3a73c7-dae8-43ec-a855-b0f6e4553334 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:45.258829 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5d3a73c7-dae8-43ec-a855-b0f6e4553334 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:45.270491 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5d3a73c7-dae8-43ec-a855-b0f6e4553334 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:45.273519 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5d3a73c7-dae8-43ec-a855-b0f6e4553334 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:45.275860 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5d3a73c7-dae8-43ec-a855-b0f6e4553334 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:45.278029 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5d3a73c7-dae8-43ec-a855-b0f6e4553334 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:45.278694 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5d3a73c7-dae8-43ec-a855-b0f6e4553334 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:45.280491 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5d3a73c7-dae8-43ec-a855-b0f6e4553334 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:45.302338 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4befe72a-8353-4b86-aa62-8f7a2bf99f85 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:45.303260 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4befe72a-8353-4b86-aa62-8f7a2bf99f85 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:45.347455 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4befe72a-8353-4b86-aa62-8f7a2bf99f85 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:45.349690 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4befe72a-8353-4b86-aa62-8f7a2bf99f85 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:45.353383 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4befe72a-8353-4b86-aa62-8f7a2bf99f85 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:45.359444 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4befe72a-8353-4b86-aa62-8f7a2bf99f85 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:45.360003 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4befe72a-8353-4b86-aa62-8f7a2bf99f85 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:45.360446 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4befe72a-8353-4b86-aa62-8f7a2bf99f85 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:45.870514 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5d3a73c7-dae8-43ec-a855-b0f6e4553334 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:45.889450 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5d3a73c7-dae8-43ec-a855-b0f6e4553334 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1527 microversion: 2.1 time: 0.640186 Sep 10 11:45:45.908856 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 800/1684] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:45 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1527 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:45.923223 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6dfd90c4-cfe2-42ae-82c8-7cc6adefe64b tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:45.935239 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6dfd90c4-cfe2-42ae-82c8-7cc6adefe64b tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: e713eb62-8c55-40ae-8424-4283e90a4c30] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:45.941512 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4befe72a-8353-4b86-aa62-8f7a2bf99f85 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:45.960231 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6dfd90c4-cfe2-42ae-82c8-7cc6adefe64b tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:45.963502 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6dfd90c4-cfe2-42ae-82c8-7cc6adefe64b tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:45.963976 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6dfd90c4-cfe2-42ae-82c8-7cc6adefe64b tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:45.964739 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6dfd90c4-cfe2-42ae-82c8-7cc6adefe64b tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:45.965215 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6dfd90c4-cfe2-42ae-82c8-7cc6adefe64b tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:45.976003 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6dfd90c4-cfe2-42ae-82c8-7cc6adefe64b tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:45.981389 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4befe72a-8353-4b86-aa62-8f7a2bf99f85 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:45.995640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4befe72a-8353-4b86-aa62-8f7a2bf99f85 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:46.001974 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4befe72a-8353-4b86-aa62-8f7a2bf99f85 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1293 microversion: 2.25 time: 0.708807 Sep 10 11:45:46.003138 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 885/1685] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:45 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1293 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:45:46.032312 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4ef9af0e-aa19-4ad6-80af-50c4d26b9fed tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:46.068204 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-4ef9af0e-aa19-4ad6-80af-50c4d26b9fed tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] HTTP exception thrown: Flavor 45bea006-62ce-446f-ad0c-86a8cd9d916d could not be found. Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4ef9af0e-aa19-4ad6-80af-50c4d26b9fed tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Request method failure captured: Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/flavors/45bea006-62ce-446f-ad0c-86a8cd9d916d HTTP/1.1 Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHf8kCQkCcaY9TkiySGI1NzLoEOQ6QUKgXsF8bCKX0Lvj2SxY6QelRqZiA3Sf_tLmzUax1snrL7QXWo4Hik2QZ6nmY7kbm-_fl_IxmVd4EZJKu3JV1vjq35T3k88t2yPbIsBechX8cPCGXDRO0JoHSzljPKO75C6_7VivXlhPckg8nQ Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 76761c4a83844f4caefb9c72f0d91774 Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-MigrationsAdminTest-1662052522 Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,admin,member Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,admin,member Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/76761c4a83844f4caefb9c72f0d91774"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/76761c4a83844f4caefb9c72f0d91774"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_76761c4a83844f4caefb9c72f0d91774", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/76761c4a83844f4caefb9c72f0d91774"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-MigrationsAdminTest-1662052522 Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 76761c4a83844f4caefb9c72f0d91774 Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-MigrationsAdminTest-1662052522 Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-MigrationsAdminTest-1662052522-project-admin Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 4e6e722c23a9413a944f958f6c5a10ad Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-MigrationsAdminTest-1662052522-project-admin Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: exception: Flavor 45bea006-62ce-446f-ad0c-86a8cd9d916d could not be found. Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '45bea006-62ce-446f-ad0c-86a8cd9d916d'} Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi flavor.destroy() Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 45bea006-62ce-446f-ad0c-86a8cd9d916d could not be found. Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 45bea006-62ce-446f-ad0c-86a8cd9d916d could not be found. Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:45:46.078021 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:45:46.088488 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:45:46.088488 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:45:46.088488 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:45:46.088488 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:45:46.088488 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:45:46.088488 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:45:46.088488 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 45bea006-62ce-446f-ad0c-86a8cd9d916d could not be found. Sep 10 11:45:46.088488 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:45:46.101769 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4ef9af0e-aa19-4ad6-80af-50c4d26b9fed tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Returning 404 to user: Flavor 45bea006-62ce-446f-ad0c-86a8cd9d916d could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:45:46.103973 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4ef9af0e-aa19-4ad6-80af-50c4d26b9fed tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/45bea006-62ce-446f-ad0c-86a8cd9d916d" status: 404 len: 109 microversion: 2.1 time: 0.088530 Sep 10 11:45:46.104560 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 886/1686] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:45:46 2022] DELETE /compute/v2.1/flavors/45bea006-62ce-446f-ad0c-86a8cd9d916d => generated 109 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:45:46.182432 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8a32a682-d323-4410-8753-e3f1c6c691d1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:46.183366 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8a32a682-d323-4410-8753-e3f1c6c691d1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:46.208620 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a32a682-d323-4410-8753-e3f1c6c691d1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:46.217864 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a32a682-d323-4410-8753-e3f1c6c691d1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:46.218527 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a32a682-d323-4410-8753-e3f1c6c691d1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:46.219046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a32a682-d323-4410-8753-e3f1c6c691d1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:46.219534 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a32a682-d323-4410-8753-e3f1c6c691d1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:46.219962 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a32a682-d323-4410-8753-e3f1c6c691d1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:46.593382 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6dfd90c4-cfe2-42ae-82c8-7cc6adefe64b tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ea7c11febf451da4f1faf4dff9471d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f601d0bb424da4bb02b532ac982878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:46.620869 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6dfd90c4-cfe2-42ae-82c8-7cc6adefe64b tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30" status: 200 len: 1367 microversion: 2.1 time: 0.695740 Sep 10 11:45:46.653572 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 801/1687] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:45 2022] GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30 => generated 1367 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:46.672527 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9534eb5d-4907-4262-b24a-30b2cf8f5101 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1618942682", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:45:46.801070 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-9534eb5d-4907-4262-b24a-30b2cf8f5101 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] validate_networks() for None {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:45:47.258332 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8a32a682-d323-4410-8753-e3f1c6c691d1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:47.276055 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8a32a682-d323-4410-8753-e3f1c6c691d1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:47.278089 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8a32a682-d323-4410-8753-e3f1c6c691d1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:47.279953 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8a32a682-d323-4410-8753-e3f1c6c691d1 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 2837 microversion: 2.42 time: 1.102089 Sep 10 11:45:47.285821 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 887/1688] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:46 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 2837 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:45:47.313064 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-30cde6b7-bbd0-4ab4-8052-e13ff1c93f2c req-f8d8cdb0-bfa1-46ba-8ad1-fac204105c56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc446beb-aed5-4d4e-954b-30c480f62ef0", "name": "network-vif-plugged", "status": "completed", "tag": "d53a3f4b-c348-4a6d-b50f-9111fcac793a"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:45:47.340847 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-30cde6b7-bbd0-4ab4-8052-e13ff1c93f2c req-f8d8cdb0-bfa1-46ba-8ad1-fac204105c56 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:47.341616 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-30cde6b7-bbd0-4ab4-8052-e13ff1c93f2c req-f8d8cdb0-bfa1-46ba-8ad1-fac204105c56 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:47.344360 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-30cde6b7-bbd0-4ab4-8052-e13ff1c93f2c req-f8d8cdb0-bfa1-46ba-8ad1-fac204105c56 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:47.381862 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-30cde6b7-bbd0-4ab4-8052-e13ff1c93f2c req-f8d8cdb0-bfa1-46ba-8ad1-fac204105c56 service nova] Creating event network-vif-plugged:d53a3f4b-c348-4a6d-b50f-9111fcac793a for instance bc446beb-aed5-4d4e-954b-30c480f62ef0 on n-h1-856895-1 Sep 10 11:45:47.396276 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-30cde6b7-bbd0-4ab4-8052-e13ff1c93f2c req-f8d8cdb0-bfa1-46ba-8ad1-fac204105c56 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107828 Sep 10 11:45:47.401345 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 888/1689] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:45:47.414530 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6ce69013-3b27-43bb-a5b3-aa35ec4a1aaf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:47.415297 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6ce69013-3b27-43bb-a5b3-aa35ec4a1aaf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:47.446059 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6ce69013-3b27-43bb-a5b3-aa35ec4a1aaf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:47.446646 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6ce69013-3b27-43bb-a5b3-aa35ec4a1aaf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:47.447270 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6ce69013-3b27-43bb-a5b3-aa35ec4a1aaf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:47.453003 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6ce69013-3b27-43bb-a5b3-aa35ec4a1aaf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:47.453904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6ce69013-3b27-43bb-a5b3-aa35ec4a1aaf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:47.454409 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6ce69013-3b27-43bb-a5b3-aa35ec4a1aaf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:47.468206 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-9534eb5d-4907-4262-b24a-30b2cf8f5101 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:45:47.468954 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-9534eb5d-4907-4262-b24a-30b2cf8f5101 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:45:47.469562 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-9534eb5d-4907-4262-b24a-30b2cf8f5101 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:45:47.470199 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-9534eb5d-4907-4262-b24a-30b2cf8f5101 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:45:47.471600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-9534eb5d-4907-4262-b24a-30b2cf8f5101 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:45:47.482600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9534eb5d-4907-4262-b24a-30b2cf8f5101 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:47.483297 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9534eb5d-4907-4262-b24a-30b2cf8f5101 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:47.483783 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9534eb5d-4907-4262-b24a-30b2cf8f5101 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:47.484773 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9534eb5d-4907-4262-b24a-30b2cf8f5101 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:47.485511 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9534eb5d-4907-4262-b24a-30b2cf8f5101 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:47.486271 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9534eb5d-4907-4262-b24a-30b2cf8f5101 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:47.507384 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-9534eb5d-4907-4262-b24a-30b2cf8f5101 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Getting quotas for project 7b37b36096cd42f6b6568ff9eee2751c. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:45:47.512515 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-9534eb5d-4907-4262-b24a-30b2cf8f5101 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Getting quotas for user 77d854474f4c4481ac407a76b4627c69 and project 7b37b36096cd42f6b6568ff9eee2751c. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:45:47.527228 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9534eb5d-4907-4262-b24a-30b2cf8f5101 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:45:47.529584 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9534eb5d-4907-4262-b24a-30b2cf8f5101 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:45:47.592700 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9534eb5d-4907-4262-b24a-30b2cf8f5101 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.936304 Sep 10 11:45:47.602312 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 802/1690] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:45:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:45:47.609605 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9dcb5989-9871-405f-b1c9-b893ed50d548 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:47.610563 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9dcb5989-9871-405f-b1c9-b893ed50d548 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:47.631023 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9dcb5989-9871-405f-b1c9-b893ed50d548 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:47.633478 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9dcb5989-9871-405f-b1c9-b893ed50d548 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:47.635881 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9dcb5989-9871-405f-b1c9-b893ed50d548 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:47.636780 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9dcb5989-9871-405f-b1c9-b893ed50d548 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:47.637418 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9dcb5989-9871-405f-b1c9-b893ed50d548 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:47.638036 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9dcb5989-9871-405f-b1c9-b893ed50d548 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:47.804101 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9dcb5989-9871-405f-b1c9-b893ed50d548 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.199804 Sep 10 11:45:47.804779 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 803/1691] 10.222.0.23 () {60 vars in 1316 bytes} [Sat Sep 10 11:45:47 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a/os-interface => generated 1831 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:45:47.811705 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9305e059-1e20-4db5-aa47-49132ebe8bae tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1536587784", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "7eb9f20d-ef96-492d-ae8c-7f5bc2e8c863"}, {"port": "f9a625c6-a871-4b6f-9edf-d59069c8c738", "tag": "port-1"}, {"port": "fdbc5dc3-2de5-4f0c-8eca-af1d0dcbbfca", "tag": "port-2"}, {"uuid": "6529acb1-83ac-420e-a4ea-9312af3b1c52", "tag": "net-1"}, {"uuid": "6529acb1-83ac-420e-a4ea-9312af3b1c52"}, {"uuid": "74944410-48c8-4737-b5c7-ea0c7fb43c29", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "74944410-48c8-4737-b5c7-ea0c7fb43c29", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "5012fa74-9c66-4acc-80d2-e87f4cecbd29", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "276634f4-6981-465f-83d0-d6c510b857e2", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "89cb3dfd-d70f-4ee2-9741-30cf13c3f40c", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--285130913"}], "key_name": "tempest-keypair-1675973244", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:45:47.822200 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6ce69013-3b27-43bb-a5b3-aa35ec4a1aaf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:47.838940 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6ce69013-3b27-43bb-a5b3-aa35ec4a1aaf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:47.840478 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6ce69013-3b27-43bb-a5b3-aa35ec4a1aaf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:47.844010 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6ce69013-3b27-43bb-a5b3-aa35ec4a1aaf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1281 microversion: 2.25 time: 0.441455 Sep 10 11:45:47.844731 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 889/1692] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:47 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1281 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:45:47.860354 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c608c2bd-99c9-47c3-a29d-3892659ee98b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:47.863645 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c608c2bd-99c9-47c3-a29d-3892659ee98b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:48.009245 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c608c2bd-99c9-47c3-a29d-3892659ee98b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:48.020473 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c608c2bd-99c9-47c3-a29d-3892659ee98b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 200 len: 1213 microversion: 2.1 time: 0.169276 Sep 10 11:45:48.028022 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 890/1693] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:47 2022] GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 1213 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:48.033149 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-954fd6c0-d0f0-4fc1-a676-ce9e034d0436 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:48.034025 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-954fd6c0-d0f0-4fc1-a676-ce9e034d0436 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: e713eb62-8c55-40ae-8424-4283e90a4c30] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:48.048023 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-954fd6c0-d0f0-4fc1-a676-ce9e034d0436 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:48.049377 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-954fd6c0-d0f0-4fc1-a676-ce9e034d0436 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:48.054966 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-954fd6c0-d0f0-4fc1-a676-ce9e034d0436 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:48.056285 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-954fd6c0-d0f0-4fc1-a676-ce9e034d0436 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:48.056994 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-954fd6c0-d0f0-4fc1-a676-ce9e034d0436 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:48.057436 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-954fd6c0-d0f0-4fc1-a676-ce9e034d0436 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:48.198965 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-9305e059-1e20-4db5-aa47-49132ebe8bae tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] validate_networks() for [('7eb9f20d-ef96-492d-ae8c-7f5bc2e8c863', None, None, None, None, None), (None, None, 'f9a625c6-a871-4b6f-9edf-d59069c8c738', None, None, None), (None, None, 'fdbc5dc3-2de5-4f0c-8eca-af1d0dcbbfca', None, None, None), ('6529acb1-83ac-420e-a4ea-9312af3b1c52', None, None, None, None, None), ('6529acb1-83ac-420e-a4ea-9312af3b1c52', None, None, None, None, None), ('74944410-48c8-4737-b5c7-ea0c7fb43c29', '10.2.2.100', None, None, None, None), ('74944410-48c8-4737-b5c7-ea0c7fb43c29', '10.2.2.200', None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:45:48.485227 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-954fd6c0-d0f0-4fc1-a676-ce9e034d0436 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ea7c11febf451da4f1faf4dff9471d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f601d0bb424da4bb02b532ac982878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:48.496133 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-954fd6c0-d0f0-4fc1-a676-ce9e034d0436 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30" status: 200 len: 1558 microversion: 2.1 time: 0.466712 Sep 10 11:45:48.496747 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 891/1694] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:48 2022] GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30 => generated 1558 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:48.520488 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7691176d-08bb-40da-80c0-6d63b46882ea tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:48.521247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7691176d-08bb-40da-80c0-6d63b46882ea tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:48.528972 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7691176d-08bb-40da-80c0-6d63b46882ea tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:48.529775 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7691176d-08bb-40da-80c0-6d63b46882ea tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:48.530405 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7691176d-08bb-40da-80c0-6d63b46882ea tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:48.531319 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7691176d-08bb-40da-80c0-6d63b46882ea tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:48.532209 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7691176d-08bb-40da-80c0-6d63b46882ea tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:48.532825 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7691176d-08bb-40da-80c0-6d63b46882ea tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:48.591267 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7691176d-08bb-40da-80c0-6d63b46882ea tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:45:48.735472 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7691176d-08bb-40da-80c0-6d63b46882ea tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "DELETE /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 204 len: 0 microversion: 2.1 time: 0.225814 Sep 10 11:45:48.737671 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 892/1695] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:45:48 2022] DELETE /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:45:48.744761 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7ed4e3b6-5e56-4ebe-a11e-a6e9fa01604e tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:48.748461 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7ed4e3b6-5e56-4ebe-a11e-a6e9fa01604e tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: e713eb62-8c55-40ae-8424-4283e90a4c30] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:48.762348 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ed4e3b6-5e56-4ebe-a11e-a6e9fa01604e tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:48.766338 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ed4e3b6-5e56-4ebe-a11e-a6e9fa01604e tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:48.768147 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ed4e3b6-5e56-4ebe-a11e-a6e9fa01604e tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:48.770332 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ed4e3b6-5e56-4ebe-a11e-a6e9fa01604e tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:48.774612 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ed4e3b6-5e56-4ebe-a11e-a6e9fa01604e tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:48.775408 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ed4e3b6-5e56-4ebe-a11e-a6e9fa01604e tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:49.003802 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7ed4e3b6-5e56-4ebe-a11e-a6e9fa01604e tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.264068 Sep 10 11:45:49.012937 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 893/1696] 10.222.0.23 () {58 vars in 1275 bytes} [Sat Sep 10 11:45:48 2022] GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30/os-interface => generated 285 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:45:49.019526 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3427d064-a125-4594-aeb2-3848fd448633 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:49.020439 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3427d064-a125-4594-aeb2-3848fd448633 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:49.028620 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3427d064-a125-4594-aeb2-3848fd448633 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:49.029476 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3427d064-a125-4594-aeb2-3848fd448633 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:49.030171 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3427d064-a125-4594-aeb2-3848fd448633 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:49.031196 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3427d064-a125-4594-aeb2-3848fd448633 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:49.031896 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3427d064-a125-4594-aeb2-3848fd448633 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:49.032687 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3427d064-a125-4594-aeb2-3848fd448633 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:49.709924 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3427d064-a125-4594-aeb2-3848fd448633 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:49.722248 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3427d064-a125-4594-aeb2-3848fd448633 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1669 microversion: 2.1 time: 0.707089 Sep 10 11:45:49.725135 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 894/1697] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:49 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1669 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:49.744006 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cc926da6-53d1-4ab0-bab9-45eb221a73d5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:49.745076 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cc926da6-53d1-4ab0-bab9-45eb221a73d5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:49.795070 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc926da6-53d1-4ab0-bab9-45eb221a73d5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:49.799485 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc926da6-53d1-4ab0-bab9-45eb221a73d5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:49.801621 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc926da6-53d1-4ab0-bab9-45eb221a73d5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:49.808934 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc926da6-53d1-4ab0-bab9-45eb221a73d5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:49.809434 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc926da6-53d1-4ab0-bab9-45eb221a73d5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:49.809882 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc926da6-53d1-4ab0-bab9-45eb221a73d5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:50.961123 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cc926da6-53d1-4ab0-bab9-45eb221a73d5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:50.973304 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cc926da6-53d1-4ab0-bab9-45eb221a73d5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:50.976738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cc926da6-53d1-4ab0-bab9-45eb221a73d5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:50.978969 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cc926da6-53d1-4ab0-bab9-45eb221a73d5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1281 microversion: 2.25 time: 1.252174 Sep 10 11:45:50.980329 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 895/1698] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:49 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1281 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:45:50.985043 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-dc29cfe4-af8e-4c79-8d0c-9e95ba06d039 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:50.985869 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-dc29cfe4-af8e-4c79-8d0c-9e95ba06d039 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:51.000871 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dc29cfe4-af8e-4c79-8d0c-9e95ba06d039 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:51.001719 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dc29cfe4-af8e-4c79-8d0c-9e95ba06d039 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:51.003685 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dc29cfe4-af8e-4c79-8d0c-9e95ba06d039 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:51.004705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dc29cfe4-af8e-4c79-8d0c-9e95ba06d039 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:51.005598 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dc29cfe4-af8e-4c79-8d0c-9e95ba06d039 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:51.006491 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dc29cfe4-af8e-4c79-8d0c-9e95ba06d039 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:51.477989 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-dc29cfe4-af8e-4c79-8d0c-9e95ba06d039 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:51.490697 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-dc29cfe4-af8e-4c79-8d0c-9e95ba06d039 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 200 len: 1313 microversion: 2.1 time: 0.509249 Sep 10 11:45:51.496890 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 896/1699] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:50 2022] GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 1313 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:51.502346 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-ed05f0ca-4edf-4177-92cb-2fdbff8ac51c req-680b929c-0cd4-41e5-9398-e6a6124cd3b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a", "tag": "63ec6435-27f2-4584-83e7-993fffb3189b"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:45:51.525451 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-ed05f0ca-4edf-4177-92cb-2fdbff8ac51c req-680b929c-0cd4-41e5-9398-e6a6124cd3b9 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:51.527531 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-ed05f0ca-4edf-4177-92cb-2fdbff8ac51c req-680b929c-0cd4-41e5-9398-e6a6124cd3b9 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:51.529898 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-ed05f0ca-4edf-4177-92cb-2fdbff8ac51c req-680b929c-0cd4-41e5-9398-e6a6124cd3b9 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:51.575475 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-ed05f0ca-4edf-4177-92cb-2fdbff8ac51c req-680b929c-0cd4-41e5-9398-e6a6124cd3b9 service nova] Creating event network-changed:63ec6435-27f2-4584-83e7-993fffb3189b for instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a on n-h1-856895-1 Sep 10 11:45:51.586762 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-ed05f0ca-4edf-4177-92cb-2fdbff8ac51c req-680b929c-0cd4-41e5-9398-e6a6124cd3b9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088744 Sep 10 11:45:51.591078 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 897/1700] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:45:51.604810 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-30b62b18-62b2-4cd6-ad94-70499e471f44 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:51.612026 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-30b62b18-62b2-4cd6-ad94-70499e471f44 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:51.647265 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30b62b18-62b2-4cd6-ad94-70499e471f44 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:51.649591 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30b62b18-62b2-4cd6-ad94-70499e471f44 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:51.650163 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30b62b18-62b2-4cd6-ad94-70499e471f44 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:51.655189 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30b62b18-62b2-4cd6-ad94-70499e471f44 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:51.655796 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30b62b18-62b2-4cd6-ad94-70499e471f44 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:51.656310 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30b62b18-62b2-4cd6-ad94-70499e471f44 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:51.832051 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-30b62b18-62b2-4cd6-ad94-70499e471f44 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:51.844602 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-30b62b18-62b2-4cd6-ad94-70499e471f44 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1601 microversion: 2.1 time: 0.252009 Sep 10 11:45:51.845191 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 898/1701] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:51 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1601 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:52.007938 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fea09152-d454-405d-8bb3-84963da80aaa tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:52.009633 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fea09152-d454-405d-8bb3-84963da80aaa tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:52.017857 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fea09152-d454-405d-8bb3-84963da80aaa tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:52.018835 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fea09152-d454-405d-8bb3-84963da80aaa tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:52.019741 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fea09152-d454-405d-8bb3-84963da80aaa tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:52.020742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fea09152-d454-405d-8bb3-84963da80aaa tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:52.021711 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fea09152-d454-405d-8bb3-84963da80aaa tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:52.022527 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fea09152-d454-405d-8bb3-84963da80aaa tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:52.464481 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fea09152-d454-405d-8bb3-84963da80aaa tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:52.474562 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fea09152-d454-405d-8bb3-84963da80aaa tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:52.484095 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fea09152-d454-405d-8bb3-84963da80aaa tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:52.485284 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fea09152-d454-405d-8bb3-84963da80aaa tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1281 microversion: 2.25 time: 0.481853 Sep 10 11:45:52.501552 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 899/1702] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:52 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1281 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:45:52.522888 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b638437d-a767-4f67-9208-040ef2c61f4f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:52.523714 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b638437d-a767-4f67-9208-040ef2c61f4f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:52.533048 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b638437d-a767-4f67-9208-040ef2c61f4f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:52.534041 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b638437d-a767-4f67-9208-040ef2c61f4f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:52.534986 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b638437d-a767-4f67-9208-040ef2c61f4f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:52.535833 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b638437d-a767-4f67-9208-040ef2c61f4f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:52.536389 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b638437d-a767-4f67-9208-040ef2c61f4f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:52.537074 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b638437d-a767-4f67-9208-040ef2c61f4f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:53.463614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b638437d-a767-4f67-9208-040ef2c61f4f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:53.480186 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b638437d-a767-4f67-9208-040ef2c61f4f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 200 len: 1313 microversion: 2.1 time: 0.963137 Sep 10 11:45:53.481637 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 900/1703] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:52 2022] GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 1313 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:45:53.491051 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-129f006c-d454-40bf-965a-1da981a262bb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:53.492489 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-129f006c-d454-40bf-965a-1da981a262bb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:53.511111 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-129f006c-d454-40bf-965a-1da981a262bb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:53.512297 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-129f006c-d454-40bf-965a-1da981a262bb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:53.512969 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-129f006c-d454-40bf-965a-1da981a262bb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:53.513917 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-129f006c-d454-40bf-965a-1da981a262bb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:53.514877 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-129f006c-d454-40bf-965a-1da981a262bb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:53.516051 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-129f006c-d454-40bf-965a-1da981a262bb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:53.583384 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-129f006c-d454-40bf-965a-1da981a262bb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:53.587103 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-129f006c-d454-40bf-965a-1da981a262bb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:53.591759 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-129f006c-d454-40bf-965a-1da981a262bb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:53.592481 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-129f006c-d454-40bf-965a-1da981a262bb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lazy-loading 'fault' on Instance uuid 53e36757-9924-4d03-a8c0-fe52a166ffc1 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:45:53.748949 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-129f006c-d454-40bf-965a-1da981a262bb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:53.765003 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-129f006c-d454-40bf-965a-1da981a262bb tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 200 len: 1325 microversion: 2.1 time: 0.281904 Sep 10 11:45:53.766392 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 901/1704] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:53 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 1325 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:53.775863 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-61bf26a4-166b-4fd8-a01b-bb1900613c6c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:53.776860 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-61bf26a4-166b-4fd8-a01b-bb1900613c6c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:53.796218 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61bf26a4-166b-4fd8-a01b-bb1900613c6c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:53.797414 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61bf26a4-166b-4fd8-a01b-bb1900613c6c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:53.797863 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61bf26a4-166b-4fd8-a01b-bb1900613c6c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:53.798593 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61bf26a4-166b-4fd8-a01b-bb1900613c6c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:53.817326 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61bf26a4-166b-4fd8-a01b-bb1900613c6c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:53.817326 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61bf26a4-166b-4fd8-a01b-bb1900613c6c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:53.837393 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:45:54.320242 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-61bf26a4-166b-4fd8-a01b-bb1900613c6c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:54.329403 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-61bf26a4-166b-4fd8-a01b-bb1900613c6c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:54.331262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-61bf26a4-166b-4fd8-a01b-bb1900613c6c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:54.332601 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-61bf26a4-166b-4fd8-a01b-bb1900613c6c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1281 microversion: 2.25 time: 0.564924 Sep 10 11:45:54.347560 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 902/1705] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:53 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1281 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:45:54.356160 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-4e98ad2c-1de3-442a-b8a1-d6e534b578d7 req-fb8bc767-1776-42e7-b862-e9fd99d764b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53e36757-9924-4d03-a8c0-fe52a166ffc1", "name": "network-vif-deleted", "tag": "42683686-90d1-4e9e-9012-b0ee66c9e930"}, {"name": "network-changed", "server_uuid": "3d4f7a57-fa07-41db-97de-a6fed43e9feb", "tag": "7212ee8a-bd4e-4ab5-adbf-7906e0f409de"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:45:54.368138 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-4e98ad2c-1de3-442a-b8a1-d6e534b578d7 req-fb8bc767-1776-42e7-b862-e9fd99d764b8 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:54.368834 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-4e98ad2c-1de3-442a-b8a1-d6e534b578d7 req-fb8bc767-1776-42e7-b862-e9fd99d764b8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:54.369440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-4e98ad2c-1de3-442a-b8a1-d6e534b578d7 req-fb8bc767-1776-42e7-b862-e9fd99d764b8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:54.383500 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-4e98ad2c-1de3-442a-b8a1-d6e534b578d7 req-fb8bc767-1776-42e7-b862-e9fd99d764b8 service nova] Creating event network-vif-deleted:42683686-90d1-4e9e-9012-b0ee66c9e930 for instance 53e36757-9924-4d03-a8c0-fe52a166ffc1 on n-h2-856895-1 Sep 10 11:45:54.384300 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-4e98ad2c-1de3-442a-b8a1-d6e534b578d7 req-fb8bc767-1776-42e7-b862-e9fd99d764b8 service nova] Creating event network-changed:7212ee8a-bd4e-4ab5-adbf-7906e0f409de for instance 3d4f7a57-fa07-41db-97de-a6fed43e9feb on n-h2-856895-1 Sep 10 11:45:54.391558 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-4e98ad2c-1de3-442a-b8a1-d6e534b578d7 req-fb8bc767-1776-42e7-b862-e9fd99d764b8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.042391 Sep 10 11:45:54.392417 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 903/1706] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:45:54.433972 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-59457166-5cd0-4d21-9e49-2164ebde4cb8 req-7fafb1ff-ceea-471c-84ba-6e76e8779f1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e713eb62-8c55-40ae-8424-4283e90a4c30", "tag": "e7466b53-cc0f-4f0f-a845-678ac860b57a"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:45:54.444572 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-59457166-5cd0-4d21-9e49-2164ebde4cb8 req-7fafb1ff-ceea-471c-84ba-6e76e8779f1e service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:54.445381 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-59457166-5cd0-4d21-9e49-2164ebde4cb8 req-7fafb1ff-ceea-471c-84ba-6e76e8779f1e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:54.446066 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-59457166-5cd0-4d21-9e49-2164ebde4cb8 req-7fafb1ff-ceea-471c-84ba-6e76e8779f1e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:54.460576 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-59457166-5cd0-4d21-9e49-2164ebde4cb8 req-7fafb1ff-ceea-471c-84ba-6e76e8779f1e service nova] Creating event network-changed:e7466b53-cc0f-4f0f-a845-678ac860b57a for instance e713eb62-8c55-40ae-8424-4283e90a4c30 on n-h2-856895-1 Sep 10 11:45:54.465987 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-59457166-5cd0-4d21-9e49-2164ebde4cb8 req-7fafb1ff-ceea-471c-84ba-6e76e8779f1e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035939 Sep 10 11:45:54.467339 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 904/1707] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:45:54.511535 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-870df96b-8698-428e-b316-bea9239c81c3 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:54.512379 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-870df96b-8698-428e-b316-bea9239c81c3 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:54.539376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-870df96b-8698-428e-b316-bea9239c81c3 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:54.540556 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-870df96b-8698-428e-b316-bea9239c81c3 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:54.545014 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-870df96b-8698-428e-b316-bea9239c81c3 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:54.546072 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-870df96b-8698-428e-b316-bea9239c81c3 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:54.546721 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-870df96b-8698-428e-b316-bea9239c81c3 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:54.547182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-870df96b-8698-428e-b316-bea9239c81c3 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:54.908473 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-870df96b-8698-428e-b316-bea9239c81c3 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:54.921948 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-870df96b-8698-428e-b316-bea9239c81c3 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 200 len: 1313 microversion: 2.1 time: 0.418910 Sep 10 11:45:54.924453 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 905/1708] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:54 2022] GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 1313 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:54.930933 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ee727d54-5101-4a96-8ee1-9a72ebbe37f5 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:54.932102 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ee727d54-5101-4a96-8ee1-9a72ebbe37f5 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: 53e36757-9924-4d03-a8c0-fe52a166ffc1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:54.942044 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee727d54-5101-4a96-8ee1-9a72ebbe37f5 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:54.943314 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee727d54-5101-4a96-8ee1-9a72ebbe37f5 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:54.945480 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee727d54-5101-4a96-8ee1-9a72ebbe37f5 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:54.946668 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee727d54-5101-4a96-8ee1-9a72ebbe37f5 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:54.949392 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee727d54-5101-4a96-8ee1-9a72ebbe37f5 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:54.950349 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee727d54-5101-4a96-8ee1-9a72ebbe37f5 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:54.968983 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-ee727d54-5101-4a96-8ee1-9a72ebbe37f5 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] HTTP exception thrown: Instance 53e36757-9924-4d03-a8c0-fe52a166ffc1 could not be found. Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ee727d54-5101-4a96-8ee1-9a72ebbe37f5 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Request method failure captured: Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 HTTP/1.1 Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHc28y97emUyUWaB-DU1sR2yW_NJ8wQwjxvgYoJp3QhVt8csYxyZV2I2MuSz5W0CcqtsNoVX-V3kbGPXqBL2XNuIrZMst7-PX_eYeJ22UptHu6DBoLoOK1_gvgLQMEm4uuwkZ4U2hE7nzHKCwWGG2gMUGj1sEUA8Bg8r5FS2vFpIAvY Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 6750367ae6604f798bfd58e2839f83e2 Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-LiveMigrationTest-1554382024 Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6750367ae6604f798bfd58e2839f83e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6750367ae6604f798bfd58e2839f83e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6750367ae6604f798bfd58e2839f83e2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6750367ae6604f798bfd58e2839f83e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-LiveMigrationTest-1554382024 Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 6750367ae6604f798bfd58e2839f83e2 Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-LiveMigrationTest-1554382024 Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-LiveMigrationTest-1554382024-project Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 805e0c24bd364ac8852387db73b614d9 Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-LiveMigrationTest-1554382024-project Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 53e36757-9924-4d03-a8c0-fe52a166ffc1 could not be found. Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '53e36757-9924-4d03-a8c0-fe52a166ffc1'} Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53e36757-9924-4d03-a8c0-fe52a166ffc1 could not be found. Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53e36757-9924-4d03-a8c0-fe52a166ffc1 could not be found. Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:45:54.972649 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:45:54.979383 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:45:54.979383 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:45:54.979383 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:45:54.979383 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:45:54.979383 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:45:54.979383 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53e36757-9924-4d03-a8c0-fe52a166ffc1 could not be found. Sep 10 11:45:54.979383 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:45:54.984154 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ee727d54-5101-4a96-8ee1-9a72ebbe37f5 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Returning 404 to user: Instance 53e36757-9924-4d03-a8c0-fe52a166ffc1 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:45:54.987291 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ee727d54-5101-4a96-8ee1-9a72ebbe37f5 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1" status: 404 len: 111 microversion: 2.1 time: 0.059554 Sep 10 11:45:54.990118 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 906/1709] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:54 2022] GET /compute/v2.1/servers/53e36757-9924-4d03-a8c0-fe52a166ffc1 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:45:54.998734 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-df8d33c8-8b29-41ca-94e9-8ca99bba2a28 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '.version_select at 0x7f407348b8b0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:55.023315 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-df8d33c8-8b29-41ca-94e9-8ca99bba2a28 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1660230733" status: 202 len: 0 microversion: 2.1 time: 0.029227 Sep 10 11:45:55.024390 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 907/1710] 10.222.0.23 () {58 vars in 1221 bytes} [Sat Sep 10 11:45:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1660230733 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:45:55.363649 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-63a5ce35-9ed1-46a0-b7ec-e8cba4d1d17f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:55.364821 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-63a5ce35-9ed1-46a0-b7ec-e8cba4d1d17f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:55.381437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:45:55.397493 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-63a5ce35-9ed1-46a0-b7ec-e8cba4d1d17f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:55.398572 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-63a5ce35-9ed1-46a0-b7ec-e8cba4d1d17f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:55.399250 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-63a5ce35-9ed1-46a0-b7ec-e8cba4d1d17f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:55.400188 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-63a5ce35-9ed1-46a0-b7ec-e8cba4d1d17f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:55.400827 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-63a5ce35-9ed1-46a0-b7ec-e8cba4d1d17f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:55.401569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-63a5ce35-9ed1-46a0-b7ec-e8cba4d1d17f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:55.819118 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-9305e059-1e20-4db5-aa47-49132ebe8bae tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:45:55.820355 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-9305e059-1e20-4db5-aa47-49132ebe8bae tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:45:55.821507 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-9305e059-1e20-4db5-aa47-49132ebe8bae tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:45:55.822120 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-9305e059-1e20-4db5-aa47-49132ebe8bae tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:45:55.822722 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-9305e059-1e20-4db5-aa47-49132ebe8bae tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:45:55.853616 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9305e059-1e20-4db5-aa47-49132ebe8bae tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:55.854522 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9305e059-1e20-4db5-aa47-49132ebe8bae tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:55.854971 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9305e059-1e20-4db5-aa47-49132ebe8bae tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:55.856494 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9305e059-1e20-4db5-aa47-49132ebe8bae tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:55.861471 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9305e059-1e20-4db5-aa47-49132ebe8bae tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:55.864134 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9305e059-1e20-4db5-aa47-49132ebe8bae tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:55.926722 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-63a5ce35-9ed1-46a0-b7ec-e8cba4d1d17f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:55.936033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-9305e059-1e20-4db5-aa47-49132ebe8bae tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Getting quotas for project 337f9c4dcb0b4da097f41bde1d789efa. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:45:55.941052 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-63a5ce35-9ed1-46a0-b7ec-e8cba4d1d17f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:55.943499 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-63a5ce35-9ed1-46a0-b7ec-e8cba4d1d17f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:55.948133 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-63a5ce35-9ed1-46a0-b7ec-e8cba4d1d17f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1281 microversion: 2.25 time: 0.589783 Sep 10 11:45:55.949597 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 908/1711] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:55 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1281 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:45:55.950222 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-9305e059-1e20-4db5-aa47-49132ebe8bae tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Getting quotas for user 2d00b725397549cfaa2aeb2b0a8dfe3d and project 337f9c4dcb0b4da097f41bde1d789efa. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:45:55.966000 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a7c8a516-8191-4be1-a9f8-edf25b204398 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:55.966767 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a7c8a516-8191-4be1-a9f8-edf25b204398 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:55.989556 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a7c8a516-8191-4be1-a9f8-edf25b204398 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:55.990177 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a7c8a516-8191-4be1-a9f8-edf25b204398 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:55.990716 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a7c8a516-8191-4be1-a9f8-edf25b204398 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:55.991795 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a7c8a516-8191-4be1-a9f8-edf25b204398 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:55.992511 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a7c8a516-8191-4be1-a9f8-edf25b204398 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:55.993160 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a7c8a516-8191-4be1-a9f8-edf25b204398 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:56.229992 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9305e059-1e20-4db5-aa47-49132ebe8bae tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:45:56.232713 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9305e059-1e20-4db5-aa47-49132ebe8bae tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='5012fa74-9c66-4acc-80d2-e87f4cecbd29',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='276634f4-6981-465f-83d0-d6c510b857e2',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='89cb3dfd-d70f-4ee2-9741-30cf13c3f40c',volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:45:56.918539 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a7c8a516-8191-4be1-a9f8-edf25b204398 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:56.931498 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a7c8a516-8191-4be1-a9f8-edf25b204398 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 200 len: 1313 microversion: 2.1 time: 0.980351 Sep 10 11:45:56.934299 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9305e059-1e20-4db5-aa47-49132ebe8bae tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 9.124605 Sep 10 11:45:56.936738 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 804/1712] 10.222.0.23 () {62 vars in 1189 bytes} [Sat Sep 10 11:45:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 9131 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 10 11:45:56.952165 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8e4b2743-0730-48d5-bf3d-66a8c0d30032 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:56.953815 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8e4b2743-0730-48d5-bf3d-66a8c0d30032 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:56.954405 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 909/1713] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:55 2022] GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 1313 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:56.976755 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5b2a7841-4196-4019-b316-ce91c297bf04 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:56.977380 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5b2a7841-4196-4019-b316-ce91c297bf04 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:56.986141 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5b2a7841-4196-4019-b316-ce91c297bf04 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:56.989998 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5b2a7841-4196-4019-b316-ce91c297bf04 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:56.990480 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5b2a7841-4196-4019-b316-ce91c297bf04 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:56.993038 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5b2a7841-4196-4019-b316-ce91c297bf04 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:56.993578 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5b2a7841-4196-4019-b316-ce91c297bf04 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:56.994054 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5b2a7841-4196-4019-b316-ce91c297bf04 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:57.173386 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8e4b2743-0730-48d5-bf3d-66a8c0d30032 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:57.186037 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8e4b2743-0730-48d5-bf3d-66a8c0d30032 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:57.188278 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8e4b2743-0730-48d5-bf3d-66a8c0d30032 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:57.190340 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8e4b2743-0730-48d5-bf3d-66a8c0d30032 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1286 microversion: 2.32 time: 0.244991 Sep 10 11:45:57.191244 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 805/1714] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:56 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1286 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:45:57.430056 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5b2a7841-4196-4019-b316-ce91c297bf04 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:57.445442 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5b2a7841-4196-4019-b316-ce91c297bf04 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:57.448006 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5b2a7841-4196-4019-b316-ce91c297bf04 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:57.449745 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5b2a7841-4196-4019-b316-ce91c297bf04 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1281 microversion: 2.25 time: 0.477651 Sep 10 11:45:57.451059 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 910/1715] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:56 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1281 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:45:57.763618 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-db89a2a0-f3d5-4ba2-8825-fb17d1c366f0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:57.764283 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-db89a2a0-f3d5-4ba2-8825-fb17d1c366f0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: a21897bf-57b5-43df-b83e-0fe0461a589b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:57.767049 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:45:57.780783 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-db89a2a0-f3d5-4ba2-8825-fb17d1c366f0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:57.782321 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-db89a2a0-f3d5-4ba2-8825-fb17d1c366f0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:57.784275 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-db89a2a0-f3d5-4ba2-8825-fb17d1c366f0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:57.788306 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-db89a2a0-f3d5-4ba2-8825-fb17d1c366f0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:57.789956 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-db89a2a0-f3d5-4ba2-8825-fb17d1c366f0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:57.790765 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-db89a2a0-f3d5-4ba2-8825-fb17d1c366f0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:57.825651 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-db89a2a0-f3d5-4ba2-8825-fb17d1c366f0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: a21897bf-57b5-43df-b83e-0fe0461a589b] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:45:57.939961 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-db89a2a0-f3d5-4ba2-8825-fb17d1c366f0 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b" status: 204 len: 0 microversion: 2.1 time: 0.179959 Sep 10 11:45:57.942034 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 806/1716] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:45:57 2022] DELETE /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:45:57.954980 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1f41047c-6cd3-4fad-9d6d-b3f692500ef3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:57.956571 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1f41047c-6cd3-4fad-9d6d-b3f692500ef3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: a21897bf-57b5-43df-b83e-0fe0461a589b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:57.975204 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1f41047c-6cd3-4fad-9d6d-b3f692500ef3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:57.975618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1f41047c-6cd3-4fad-9d6d-b3f692500ef3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:57.976114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1f41047c-6cd3-4fad-9d6d-b3f692500ef3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:57.976877 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1f41047c-6cd3-4fad-9d6d-b3f692500ef3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:57.977383 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1f41047c-6cd3-4fad-9d6d-b3f692500ef3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:57.977810 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1f41047c-6cd3-4fad-9d6d-b3f692500ef3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:57.980226 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5156f2ea-f281-43a1-af76-5fa2c02fa6df tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:57.981275 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5156f2ea-f281-43a1-af76-5fa2c02fa6df tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:58.011534 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5156f2ea-f281-43a1-af76-5fa2c02fa6df tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:58.012190 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5156f2ea-f281-43a1-af76-5fa2c02fa6df tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:58.012674 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5156f2ea-f281-43a1-af76-5fa2c02fa6df tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:58.013404 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5156f2ea-f281-43a1-af76-5fa2c02fa6df tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:58.013887 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5156f2ea-f281-43a1-af76-5fa2c02fa6df tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:58.014331 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5156f2ea-f281-43a1-af76-5fa2c02fa6df tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:58.059146 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:45:58.408016 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1f41047c-6cd3-4fad-9d6d-b3f692500ef3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:58.422492 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1f41047c-6cd3-4fad-9d6d-b3f692500ef3 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b" status: 200 len: 1484 microversion: 2.1 time: 0.475639 Sep 10 11:45:58.434585 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 911/1717] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:57 2022] GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b => generated 1484 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:45:58.440704 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a8b500a1-657b-4ddb-94ec-430e0c3233fe tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:58.441668 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a8b500a1-657b-4ddb-94ec-430e0c3233fe tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:58.448384 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a8b500a1-657b-4ddb-94ec-430e0c3233fe tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:58.449174 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a8b500a1-657b-4ddb-94ec-430e0c3233fe tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:58.450425 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a8b500a1-657b-4ddb-94ec-430e0c3233fe tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:58.451372 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a8b500a1-657b-4ddb-94ec-430e0c3233fe tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:58.452009 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a8b500a1-657b-4ddb-94ec-430e0c3233fe tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:58.452613 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a8b500a1-657b-4ddb-94ec-430e0c3233fe tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:58.459624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5156f2ea-f281-43a1-af76-5fa2c02fa6df tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:58.484794 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5156f2ea-f281-43a1-af76-5fa2c02fa6df tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 200 len: 1313 microversion: 2.1 time: 0.524137 Sep 10 11:45:58.486378 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 807/1718] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:57 2022] GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 1313 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:58.514661 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e89e5d6f-c651-48ab-a97a-58fd6b390fd3 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:58.515644 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e89e5d6f-c651-48ab-a97a-58fd6b390fd3 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:58.528349 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e89e5d6f-c651-48ab-a97a-58fd6b390fd3 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:58.534992 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e89e5d6f-c651-48ab-a97a-58fd6b390fd3 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:58.536471 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e89e5d6f-c651-48ab-a97a-58fd6b390fd3 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:58.538148 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e89e5d6f-c651-48ab-a97a-58fd6b390fd3 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:58.540431 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e89e5d6f-c651-48ab-a97a-58fd6b390fd3 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:58.542525 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e89e5d6f-c651-48ab-a97a-58fd6b390fd3 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:58.581397 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a8b500a1-657b-4ddb-94ec-430e0c3233fe tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:58.619047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a8b500a1-657b-4ddb-94ec-430e0c3233fe tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:58.621825 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a8b500a1-657b-4ddb-94ec-430e0c3233fe tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:58.631203 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a8b500a1-657b-4ddb-94ec-430e0c3233fe tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1520 microversion: 2.32 time: 0.195145 Sep 10 11:45:58.635869 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 912/1719] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:58 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:45:58.668945 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-79453321-cf5d-486b-ba28-f9739ecc4333 req-472c31cc-2052-4889-b16d-1e0998c48f40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a62a6c44-9d92-4766-a81d-c09670110ab4", "name": "network-vif-plugged", "status": "completed", "tag": "2bd5dc49-b958-48da-8036-9f8348b0324b"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:45:58.696623 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-79453321-cf5d-486b-ba28-f9739ecc4333 req-472c31cc-2052-4889-b16d-1e0998c48f40 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:58.697422 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-79453321-cf5d-486b-ba28-f9739ecc4333 req-472c31cc-2052-4889-b16d-1e0998c48f40 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:58.698092 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-79453321-cf5d-486b-ba28-f9739ecc4333 req-472c31cc-2052-4889-b16d-1e0998c48f40 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:58.718141 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-79453321-cf5d-486b-ba28-f9739ecc4333 req-472c31cc-2052-4889-b16d-1e0998c48f40 service nova] Creating event network-vif-plugged:2bd5dc49-b958-48da-8036-9f8348b0324b for instance a62a6c44-9d92-4766-a81d-c09670110ab4 on n-h2-856895-1 Sep 10 11:45:58.726280 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-79453321-cf5d-486b-ba28-f9739ecc4333 req-472c31cc-2052-4889-b16d-1e0998c48f40 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076273 Sep 10 11:45:58.727089 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 913/1720] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:45:58.863389 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e89e5d6f-c651-48ab-a97a-58fd6b390fd3 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:58.875742 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e89e5d6f-c651-48ab-a97a-58fd6b390fd3 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:58.880712 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e89e5d6f-c651-48ab-a97a-58fd6b390fd3 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:58.884367 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e89e5d6f-c651-48ab-a97a-58fd6b390fd3 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1281 microversion: 2.25 time: 0.391468 Sep 10 11:45:58.886065 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 808/1721] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:58 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1281 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:45:59.488950 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6a8dc506-b043-4697-a84e-c12c1a43920c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:59.490261 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6a8dc506-b043-4697-a84e-c12c1a43920c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: a21897bf-57b5-43df-b83e-0fe0461a589b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:59.502121 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6a8dc506-b043-4697-a84e-c12c1a43920c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:59.512146 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7d239875-c3c6-4b1c-a816-3b09c01fb83a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:59.512969 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6a8dc506-b043-4697-a84e-c12c1a43920c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:59.513528 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7d239875-c3c6-4b1c-a816-3b09c01fb83a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:59.513670 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6a8dc506-b043-4697-a84e-c12c1a43920c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:59.514555 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6a8dc506-b043-4697-a84e-c12c1a43920c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:59.515041 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6a8dc506-b043-4697-a84e-c12c1a43920c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:59.515588 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6a8dc506-b043-4697-a84e-c12c1a43920c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:59.524264 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d239875-c3c6-4b1c-a816-3b09c01fb83a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:59.524978 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d239875-c3c6-4b1c-a816-3b09c01fb83a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:59.525597 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d239875-c3c6-4b1c-a816-3b09c01fb83a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:59.526476 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d239875-c3c6-4b1c-a816-3b09c01fb83a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:59.527292 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d239875-c3c6-4b1c-a816-3b09c01fb83a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:59.527906 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d239875-c3c6-4b1c-a816-3b09c01fb83a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:59.547470 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:45:59.672715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6a8dc506-b043-4697-a84e-c12c1a43920c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:59.686391 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6a8dc506-b043-4697-a84e-c12c1a43920c tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b" status: 200 len: 1442 microversion: 2.1 time: 0.209167 Sep 10 11:45:59.688653 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 914/1722] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:59 2022] GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b => generated 1442 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:45:59.712835 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3eac436d-d821-4666-82bc-420fd2b27751 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:59.717943 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3eac436d-d821-4666-82bc-420fd2b27751 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:59.733643 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3eac436d-d821-4666-82bc-420fd2b27751 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:59.734880 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3eac436d-d821-4666-82bc-420fd2b27751 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:59.736223 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3eac436d-d821-4666-82bc-420fd2b27751 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:59.741536 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3eac436d-d821-4666-82bc-420fd2b27751 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:59.742236 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3eac436d-d821-4666-82bc-420fd2b27751 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:59.743702 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3eac436d-d821-4666-82bc-420fd2b27751 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:59.821070 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7d239875-c3c6-4b1c-a816-3b09c01fb83a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:59.837112 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7d239875-c3c6-4b1c-a816-3b09c01fb83a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 200 len: 1313 microversion: 2.1 time: 0.329051 Sep 10 11:45:59.837527 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 809/1723] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:45:59 2022] GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 1313 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:45:59.860698 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-444f1d9a-5101-4efe-becd-299bcedcb724 req-4158fb2f-6b67-4d6c-810e-f150e3f4b6ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a21897bf-57b5-43df-b83e-0fe0461a589b", "name": "network-vif-deleted", "tag": "67cd0369-12ef-4363-bcb5-c9103b512fc1"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:45:59.888124 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-444f1d9a-5101-4efe-becd-299bcedcb724 req-4158fb2f-6b67-4d6c-810e-f150e3f4b6ac service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:59.888615 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-444f1d9a-5101-4efe-becd-299bcedcb724 req-4158fb2f-6b67-4d6c-810e-f150e3f4b6ac service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:59.889049 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-444f1d9a-5101-4efe-becd-299bcedcb724 req-4158fb2f-6b67-4d6c-810e-f150e3f4b6ac service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:59.914836 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-444f1d9a-5101-4efe-becd-299bcedcb724 req-4158fb2f-6b67-4d6c-810e-f150e3f4b6ac service nova] Creating event network-vif-deleted:67cd0369-12ef-4363-bcb5-c9103b512fc1 for instance a21897bf-57b5-43df-b83e-0fe0461a589b on n-h1-856895-1 Sep 10 11:45:59.929217 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-444f1d9a-5101-4efe-becd-299bcedcb724 req-4158fb2f-6b67-4d6c-810e-f150e3f4b6ac service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074780 Sep 10 11:45:59.935690 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 810/1724] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:45:59.941625 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3eac436d-d821-4666-82bc-420fd2b27751 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:59.942902 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-abb8c7e8-836b-4fba-bda2-a9fd4898e04c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:45:59.945543 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-abb8c7e8-836b-4fba-bda2-a9fd4898e04c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:45:59.961760 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-abb8c7e8-836b-4fba-bda2-a9fd4898e04c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:59.961931 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3eac436d-d821-4666-82bc-420fd2b27751 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:59.962270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-abb8c7e8-836b-4fba-bda2-a9fd4898e04c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:59.962729 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-abb8c7e8-836b-4fba-bda2-a9fd4898e04c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:59.963486 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-abb8c7e8-836b-4fba-bda2-a9fd4898e04c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:45:59.964187 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-abb8c7e8-836b-4fba-bda2-a9fd4898e04c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:45:59.964826 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-abb8c7e8-836b-4fba-bda2-a9fd4898e04c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:45:59.967262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3eac436d-d821-4666-82bc-420fd2b27751 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:45:59.972543 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3eac436d-d821-4666-82bc-420fd2b27751 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1576 microversion: 2.32 time: 0.278834 Sep 10 11:45:59.974379 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 915/1725] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:59 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1576 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:00.210509 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-abb8c7e8-836b-4fba-bda2-a9fd4898e04c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:00.229361 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-abb8c7e8-836b-4fba-bda2-a9fd4898e04c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:00.231682 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-abb8c7e8-836b-4fba-bda2-a9fd4898e04c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:00.245357 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-abb8c7e8-836b-4fba-bda2-a9fd4898e04c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1281 microversion: 2.25 time: 0.295633 Sep 10 11:46:00.271400 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 811/1726] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:45:59 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1281 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:00.721761 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5dee2c1c-07ae-48cf-b05f-8046072893db tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:00.724274 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5dee2c1c-07ae-48cf-b05f-8046072893db tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: a21897bf-57b5-43df-b83e-0fe0461a589b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:00.745883 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-0847ec98-0de4-4190-824a-6f5fc6f0e4bd req-0e86d53b-054d-4cce-b84f-c74b32ccc5df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d4f7a57-fa07-41db-97de-a6fed43e9feb", "name": "network-vif-plugged", "status": "completed", "tag": "7212ee8a-bd4e-4ab5-adbf-7906e0f409de"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:46:00.756872 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-0847ec98-0de4-4190-824a-6f5fc6f0e4bd req-0e86d53b-054d-4cce-b84f-c74b32ccc5df service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:00.757357 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-0847ec98-0de4-4190-824a-6f5fc6f0e4bd req-0e86d53b-054d-4cce-b84f-c74b32ccc5df service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:00.757795 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-0847ec98-0de4-4190-824a-6f5fc6f0e4bd req-0e86d53b-054d-4cce-b84f-c74b32ccc5df service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:00.758264 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5dee2c1c-07ae-48cf-b05f-8046072893db tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:00.758862 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5dee2c1c-07ae-48cf-b05f-8046072893db tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:00.760772 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5dee2c1c-07ae-48cf-b05f-8046072893db tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:00.761910 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5dee2c1c-07ae-48cf-b05f-8046072893db tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:00.763576 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5dee2c1c-07ae-48cf-b05f-8046072893db tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:00.764207 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5dee2c1c-07ae-48cf-b05f-8046072893db tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:00.774872 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-0847ec98-0de4-4190-824a-6f5fc6f0e4bd req-0e86d53b-054d-4cce-b84f-c74b32ccc5df service nova] Creating event network-vif-plugged:7212ee8a-bd4e-4ab5-adbf-7906e0f409de for instance 3d4f7a57-fa07-41db-97de-a6fed43e9feb on n-h2-856895-1 Sep 10 11:46:00.783060 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-0847ec98-0de4-4190-824a-6f5fc6f0e4bd req-0e86d53b-054d-4cce-b84f-c74b32ccc5df service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040412 Sep 10 11:46:00.785019 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 812/1727] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:46:00.840235 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5dee2c1c-07ae-48cf-b05f-8046072893db tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:00.841830 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5dee2c1c-07ae-48cf-b05f-8046072893db tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:00.842593 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5dee2c1c-07ae-48cf-b05f-8046072893db tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:00.843358 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-5dee2c1c-07ae-48cf-b05f-8046072893db tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lazy-loading 'fault' on Instance uuid a21897bf-57b5-43df-b83e-0fe0461a589b {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:46:00.862215 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6b20f41b-aa85-4380-8177-5d0992ef3560 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:00.863591 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6b20f41b-aa85-4380-8177-5d0992ef3560 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:00.879809 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6b20f41b-aa85-4380-8177-5d0992ef3560 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:00.880600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6b20f41b-aa85-4380-8177-5d0992ef3560 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:00.881296 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6b20f41b-aa85-4380-8177-5d0992ef3560 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:00.882230 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6b20f41b-aa85-4380-8177-5d0992ef3560 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:00.887709 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6b20f41b-aa85-4380-8177-5d0992ef3560 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:00.888396 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6b20f41b-aa85-4380-8177-5d0992ef3560 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:00.922910 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5dee2c1c-07ae-48cf-b05f-8046072893db tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:00.942620 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5dee2c1c-07ae-48cf-b05f-8046072893db tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b" status: 200 len: 1300 microversion: 2.1 time: 0.231610 Sep 10 11:46:00.947897 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 916/1728] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:00 2022] GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b => generated 1300 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:01.007946 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-895673a7-5ddf-4a28-8950-ca3925f1f74a tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:01.008801 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-895673a7-5ddf-4a28-8950-ca3925f1f74a tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:01.028457 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-895673a7-5ddf-4a28-8950-ca3925f1f74a tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:01.029482 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-895673a7-5ddf-4a28-8950-ca3925f1f74a tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:01.035507 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-895673a7-5ddf-4a28-8950-ca3925f1f74a tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:01.036581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-895673a7-5ddf-4a28-8950-ca3925f1f74a tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:01.039377 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-895673a7-5ddf-4a28-8950-ca3925f1f74a tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:01.040082 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-895673a7-5ddf-4a28-8950-ca3925f1f74a tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:01.169337 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-895673a7-5ddf-4a28-8950-ca3925f1f74a tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:01.185153 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-895673a7-5ddf-4a28-8950-ca3925f1f74a tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:01.188242 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-895673a7-5ddf-4a28-8950-ca3925f1f74a tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:01.195019 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-895673a7-5ddf-4a28-8950-ca3925f1f74a tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1594 microversion: 2.32 time: 0.192192 Sep 10 11:46:01.196273 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 917/1729] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:01 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1594 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:46:01.230831 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6b20f41b-aa85-4380-8177-5d0992ef3560 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:01.241522 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6b20f41b-aa85-4380-8177-5d0992ef3560 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 200 len: 1313 microversion: 2.1 time: 0.385010 Sep 10 11:46:01.261443 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 813/1730] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:00 2022] GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 1313 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:46:01.279716 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8bba245b-81dc-4d0b-af4a-d255e8197a6b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:01.280992 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8bba245b-81dc-4d0b-af4a-d255e8197a6b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:01.288793 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8bba245b-81dc-4d0b-af4a-d255e8197a6b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:01.289612 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8bba245b-81dc-4d0b-af4a-d255e8197a6b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:01.290339 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8bba245b-81dc-4d0b-af4a-d255e8197a6b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:01.291702 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8bba245b-81dc-4d0b-af4a-d255e8197a6b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:01.292554 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8bba245b-81dc-4d0b-af4a-d255e8197a6b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:01.293215 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8bba245b-81dc-4d0b-af4a-d255e8197a6b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:01.500194 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8bba245b-81dc-4d0b-af4a-d255e8197a6b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:01.530871 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8bba245b-81dc-4d0b-af4a-d255e8197a6b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:01.534257 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8bba245b-81dc-4d0b-af4a-d255e8197a6b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:01.536097 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8bba245b-81dc-4d0b-af4a-d255e8197a6b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1476 microversion: 2.25 time: 0.261581 Sep 10 11:46:01.537292 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 918/1731] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:01 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1476 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:01.735939 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4dce1bcb-2947-4072-aa95-a945cb55cadd tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:01.737445 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4dce1bcb-2947-4072-aa95-a945cb55cadd tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:01.743922 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4dce1bcb-2947-4072-aa95-a945cb55cadd tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:01.744760 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4dce1bcb-2947-4072-aa95-a945cb55cadd tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:01.745437 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4dce1bcb-2947-4072-aa95-a945cb55cadd tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:01.746400 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4dce1bcb-2947-4072-aa95-a945cb55cadd tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:01.747625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4dce1bcb-2947-4072-aa95-a945cb55cadd tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:01.748290 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4dce1bcb-2947-4072-aa95-a945cb55cadd tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:01.903860 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-4dce1bcb-2947-4072-aa95-a945cb55cadd tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lazy-loading 'services' on Instance uuid a62a6c44-9d92-4766-a81d-c09670110ab4 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:46:01.918122 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4dce1bcb-2947-4072-aa95-a945cb55cadd tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1969 microversion: 2.25 time: 0.360527 Sep 10 11:46:01.919300 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 814/1732] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:01 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1969 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:01.948281 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c6268f66-3a41-498c-95fd-0762567a989b tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:01.949772 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c6268f66-3a41-498c-95fd-0762567a989b tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:01.960388 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c6268f66-3a41-498c-95fd-0762567a989b tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:01.962010 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c6268f66-3a41-498c-95fd-0762567a989b tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:01.962908 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c6268f66-3a41-498c-95fd-0762567a989b tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:01.964205 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c6268f66-3a41-498c-95fd-0762567a989b tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:01.973073 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6ae883bc-7aeb-4fe1-9134-dd643a68e8d9 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:01.974168 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6ae883bc-7aeb-4fe1-9134-dd643a68e8d9 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: a21897bf-57b5-43df-b83e-0fe0461a589b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:01.975392 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c6268f66-3a41-498c-95fd-0762567a989b tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:01.978646 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c6268f66-3a41-498c-95fd-0762567a989b tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:01.994721 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6ae883bc-7aeb-4fe1-9134-dd643a68e8d9 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:01.995357 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6ae883bc-7aeb-4fe1-9134-dd643a68e8d9 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:01.997053 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6ae883bc-7aeb-4fe1-9134-dd643a68e8d9 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:01.999024 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6ae883bc-7aeb-4fe1-9134-dd643a68e8d9 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:01.999585 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6ae883bc-7aeb-4fe1-9134-dd643a68e8d9 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:02.000027 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6ae883bc-7aeb-4fe1-9134-dd643a68e8d9 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:02.045443 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-6ae883bc-7aeb-4fe1-9134-dd643a68e8d9 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] HTTP exception thrown: Instance a21897bf-57b5-43df-b83e-0fe0461a589b could not be found. Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6ae883bc-7aeb-4fe1-9134-dd643a68e8d9 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Request method failure captured: Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b HTTP/1.1 Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHc28y97emUyUWaB-DU1sR2yW_NJ8wQwjxvgYoJp3QhVt8csYxyZV2I2MuSz5W0CcqtsNoVX-V3kbGPXqBL2XNuIrZMst7-PX_eYeJ22UptHu6DBoLoOK1_gvgLQMEm4uuwkZ4U2hE7nzHKCwWGG2gMUGj1sEUA8Bg8r5FS2vFpIAvY Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 6750367ae6604f798bfd58e2839f83e2 Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-LiveMigrationTest-1554382024 Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6750367ae6604f798bfd58e2839f83e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6750367ae6604f798bfd58e2839f83e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6750367ae6604f798bfd58e2839f83e2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6750367ae6604f798bfd58e2839f83e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-LiveMigrationTest-1554382024 Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 6750367ae6604f798bfd58e2839f83e2 Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-LiveMigrationTest-1554382024 Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-LiveMigrationTest-1554382024-project Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 805e0c24bd364ac8852387db73b614d9 Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-LiveMigrationTest-1554382024-project Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance a21897bf-57b5-43df-b83e-0fe0461a589b could not be found. Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'a21897bf-57b5-43df-b83e-0fe0461a589b'} Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a21897bf-57b5-43df-b83e-0fe0461a589b could not be found. Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a21897bf-57b5-43df-b83e-0fe0461a589b could not be found. Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:46:02.047188 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:46:02.053061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:46:02.053061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:46:02.053061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:46:02.053061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:46:02.053061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:46:02.053061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a21897bf-57b5-43df-b83e-0fe0461a589b could not be found. Sep 10 11:46:02.053061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:46:02.053061 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6ae883bc-7aeb-4fe1-9134-dd643a68e8d9 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Returning 404 to user: Instance a21897bf-57b5-43df-b83e-0fe0461a589b could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:46:02.053061 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6ae883bc-7aeb-4fe1-9134-dd643a68e8d9 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b" status: 404 len: 111 microversion: 2.1 time: 0.082724 Sep 10 11:46:02.053061 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 815/1733] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:01 2022] GET /compute/v2.1/servers/a21897bf-57b5-43df-b83e-0fe0461a589b => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 11:46:02.058288 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0d65a565-fa56-44c2-9728-fa279142b5d5 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:02.058789 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0d65a565-fa56-44c2-9728-fa279142b5d5 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:02.065059 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0d65a565-fa56-44c2-9728-fa279142b5d5 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:02.065915 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0d65a565-fa56-44c2-9728-fa279142b5d5 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:02.066536 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0d65a565-fa56-44c2-9728-fa279142b5d5 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:02.067460 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0d65a565-fa56-44c2-9728-fa279142b5d5 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:02.068098 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0d65a565-fa56-44c2-9728-fa279142b5d5 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:02.068701 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0d65a565-fa56-44c2-9728-fa279142b5d5 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:02.097162 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0d65a565-fa56-44c2-9728-fa279142b5d5 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:46:02.251612 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0d65a565-fa56-44c2-9728-fa279142b5d5 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f" status: 204 len: 0 microversion: 2.1 time: 0.196538 Sep 10 11:46:02.252942 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 816/1734] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:46:02 2022] DELETE /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 11:46:02.279755 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-c6268f66-3a41-498c-95fd-0762567a989b tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lazy-loading 'services' on Instance uuid a62a6c44-9d92-4766-a81d-c09670110ab4 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:46:02.282160 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8528144b-cc66-4a5d-8a6a-e7223842fecc tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:02.286273 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8528144b-cc66-4a5d-8a6a-e7223842fecc tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:02.300748 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8528144b-cc66-4a5d-8a6a-e7223842fecc tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:02.304612 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8528144b-cc66-4a5d-8a6a-e7223842fecc tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:02.306689 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8528144b-cc66-4a5d-8a6a-e7223842fecc tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:02.312607 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8528144b-cc66-4a5d-8a6a-e7223842fecc tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:02.313946 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8528144b-cc66-4a5d-8a6a-e7223842fecc tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:02.316327 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8528144b-cc66-4a5d-8a6a-e7223842fecc tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:02.327818 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c6268f66-3a41-498c-95fd-0762567a989b tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1969 microversion: 2.25 time: 0.384137 Sep 10 11:46:02.331491 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 919/1735] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:01 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1969 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:02.351748 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-146acaef-22f8-4187-8b02-0583b7748e4d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:02.352802 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-146acaef-22f8-4187-8b02-0583b7748e4d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:02.361247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-146acaef-22f8-4187-8b02-0583b7748e4d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:02.366546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-146acaef-22f8-4187-8b02-0583b7748e4d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:02.366999 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-146acaef-22f8-4187-8b02-0583b7748e4d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:02.368008 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-146acaef-22f8-4187-8b02-0583b7748e4d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:02.368466 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-146acaef-22f8-4187-8b02-0583b7748e4d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:02.368886 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-146acaef-22f8-4187-8b02-0583b7748e4d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:02.521954 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8528144b-cc66-4a5d-8a6a-e7223842fecc tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:02.532240 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8528144b-cc66-4a5d-8a6a-e7223842fecc tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:02.533994 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8528144b-cc66-4a5d-8a6a-e7223842fecc tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:02.535428 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8528144b-cc66-4a5d-8a6a-e7223842fecc tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1594 microversion: 2.32 time: 0.281158 Sep 10 11:46:02.550762 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 817/1736] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:02 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1594 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:02.562663 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4a365660-6e34-4598-91d4-5488fba85cde tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:02.564455 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4a365660-6e34-4598-91d4-5488fba85cde tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:02.576432 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4a365660-6e34-4598-91d4-5488fba85cde tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:02.579101 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4a365660-6e34-4598-91d4-5488fba85cde tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:02.579709 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4a365660-6e34-4598-91d4-5488fba85cde tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:02.582421 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4a365660-6e34-4598-91d4-5488fba85cde tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:02.583239 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4a365660-6e34-4598-91d4-5488fba85cde tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:02.588211 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4a365660-6e34-4598-91d4-5488fba85cde tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:02.635446 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-146acaef-22f8-4187-8b02-0583b7748e4d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:02.643814 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-146acaef-22f8-4187-8b02-0583b7748e4d tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f" status: 200 len: 1500 microversion: 2.1 time: 0.310986 Sep 10 11:46:02.644619 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 920/1737] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:02 2022] GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f => generated 1500 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:02.658275 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-77043a47-8fe5-4c05-ad1d-692620fd5604 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:02.667114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-77043a47-8fe5-4c05-ad1d-692620fd5604 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:02.667807 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-77043a47-8fe5-4c05-ad1d-692620fd5604 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:02.673240 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-77043a47-8fe5-4c05-ad1d-692620fd5604 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:02.687779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-77043a47-8fe5-4c05-ad1d-692620fd5604 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:02.688326 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-77043a47-8fe5-4c05-ad1d-692620fd5604 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:02.688784 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-77043a47-8fe5-4c05-ad1d-692620fd5604 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:02.765771 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-77043a47-8fe5-4c05-ad1d-692620fd5604 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.119968 Sep 10 11:46:02.770074 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 921/1738] 10.222.0.23 () {60 vars in 1217 bytes} [Sat Sep 10 11:46:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:46:02.783972 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-17707194-f705-4d2d-9a30-85536b823205 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-856895-1", "block_migration": "auto"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:46:02.796221 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-17707194-f705-4d2d-9a30-85536b823205 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:02.809037 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17707194-f705-4d2d-9a30-85536b823205 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:02.809539 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17707194-f705-4d2d-9a30-85536b823205 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:02.809979 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17707194-f705-4d2d-9a30-85536b823205 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:02.810758 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17707194-f705-4d2d-9a30-85536b823205 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:02.811241 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17707194-f705-4d2d-9a30-85536b823205 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:02.811679 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17707194-f705-4d2d-9a30-85536b823205 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:02.852652 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=100 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:46:02.879101 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-17707194-f705-4d2d-9a30-85536b823205 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lazy-loading 'flavor' on Instance uuid a62a6c44-9d92-4766-a81d-c09670110ab4 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:46:02.895187 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-17707194-f705-4d2d-9a30-85536b823205 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Going to try to live migrate instance to n-h1-856895-1 {{(pid=128777) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 10 11:46:02.904032 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4a365660-6e34-4598-91d4-5488fba85cde tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:02.912680 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4a365660-6e34-4598-91d4-5488fba85cde tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 200 len: 1463 microversion: 2.1 time: 0.360247 Sep 10 11:46:02.914409 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 818/1739] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:02 2022] GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 1463 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:02.940741 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-361090ce-3292-4e97-92f7-ef421c669420 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:02.941641 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-361090ce-3292-4e97-92f7-ef421c669420 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:02.958595 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-361090ce-3292-4e97-92f7-ef421c669420 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:02.964971 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-361090ce-3292-4e97-92f7-ef421c669420 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:02.965968 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-361090ce-3292-4e97-92f7-ef421c669420 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:02.967096 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-361090ce-3292-4e97-92f7-ef421c669420 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:02.967863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-361090ce-3292-4e97-92f7-ef421c669420 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:02.968636 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-361090ce-3292-4e97-92f7-ef421c669420 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:03.245011 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-361090ce-3292-4e97-92f7-ef421c669420 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 200 len: 1614 microversion: 2.1 time: 0.308859 Sep 10 11:46:03.251988 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 819/1740] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:02 2022] GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 1614 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:46:03.280941 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bc2ae5cd-f7cc-4bdf-b8d3-c6b6eca307cc tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:46:03.285333 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bc2ae5cd-f7cc-4bdf-b8d3-c6b6eca307cc tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:03.300598 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc2ae5cd-f7cc-4bdf-b8d3-c6b6eca307cc tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:03.301411 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc2ae5cd-f7cc-4bdf-b8d3-c6b6eca307cc tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:03.302077 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc2ae5cd-f7cc-4bdf-b8d3-c6b6eca307cc tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:03.303527 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc2ae5cd-f7cc-4bdf-b8d3-c6b6eca307cc tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:03.304203 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc2ae5cd-f7cc-4bdf-b8d3-c6b6eca307cc tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:03.304842 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc2ae5cd-f7cc-4bdf-b8d3-c6b6eca307cc tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:03.798899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bc2ae5cd-f7cc-4bdf-b8d3-c6b6eca307cc tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4e6e722c23a9413a944f958f6c5a10ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76761c4a83844f4caefb9c72f0d91774', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:03.799728 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bc2ae5cd-f7cc-4bdf-b8d3-c6b6eca307cc tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] flavor_id is None. Assuming migration. {{(pid=128776) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 10 11:46:03.800199 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bc2ae5cd-f7cc-4bdf-b8d3-c6b6eca307cc tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128776) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 11:46:04.266563 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bc2ae5cd-f7cc-4bdf-b8d3-c6b6eca307cc tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb/action" status: 202 len: 0 microversion: 2.1 time: 0.990048 Sep 10 11:46:04.271851 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 820/1741] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:46:03 2022] POST /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb/action => generated 0 bytes in 996 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:46:04.278661 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e7ca5f21-b2a7-4b64-9a32-f4a9982f571f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:04.287433 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e7ca5f21-b2a7-4b64-9a32-f4a9982f571f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:04.303219 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7ca5f21-b2a7-4b64-9a32-f4a9982f571f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:04.307134 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7ca5f21-b2a7-4b64-9a32-f4a9982f571f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:04.307890 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7ca5f21-b2a7-4b64-9a32-f4a9982f571f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:04.309052 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7ca5f21-b2a7-4b64-9a32-f4a9982f571f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:04.310626 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7ca5f21-b2a7-4b64-9a32-f4a9982f571f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:04.311442 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7ca5f21-b2a7-4b64-9a32-f4a9982f571f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:04.766743 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e7ca5f21-b2a7-4b64-9a32-f4a9982f571f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:04.779084 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e7ca5f21-b2a7-4b64-9a32-f4a9982f571f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:04.785709 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e7ca5f21-b2a7-4b64-9a32-f4a9982f571f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:04.786923 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e7ca5f21-b2a7-4b64-9a32-f4a9982f571f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1661 microversion: 2.32 time: 0.513727 Sep 10 11:46:04.791803 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 821/1742] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:04 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1661 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:04.809080 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-aade7a90-85ec-4901-b9ba-be3d07a59f67 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:04.817677 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-aade7a90-85ec-4901-b9ba-be3d07a59f67 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:04.832838 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aade7a90-85ec-4901-b9ba-be3d07a59f67 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:04.833726 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aade7a90-85ec-4901-b9ba-be3d07a59f67 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:04.834840 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aade7a90-85ec-4901-b9ba-be3d07a59f67 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:04.835983 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aade7a90-85ec-4901-b9ba-be3d07a59f67 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:04.836859 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aade7a90-85ec-4901-b9ba-be3d07a59f67 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:04.837614 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aade7a90-85ec-4901-b9ba-be3d07a59f67 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:05.091211 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-aade7a90-85ec-4901-b9ba-be3d07a59f67 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:05.100909 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-aade7a90-85ec-4901-b9ba-be3d07a59f67 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f" status: 200 len: 1500 microversion: 2.1 time: 0.308002 Sep 10 11:46:05.103434 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 822/1743] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:04 2022] GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f => generated 1500 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:05.108419 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8dc9e549-a13c-47bf-a1a8-6f67897df0fd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:05.109319 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8dc9e549-a13c-47bf-a1a8-6f67897df0fd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:05.116677 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8dc9e549-a13c-47bf-a1a8-6f67897df0fd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:05.117500 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8dc9e549-a13c-47bf-a1a8-6f67897df0fd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:05.118319 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8dc9e549-a13c-47bf-a1a8-6f67897df0fd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:05.119319 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8dc9e549-a13c-47bf-a1a8-6f67897df0fd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:05.120017 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8dc9e549-a13c-47bf-a1a8-6f67897df0fd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:05.120682 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8dc9e549-a13c-47bf-a1a8-6f67897df0fd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:05.576490 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8dc9e549-a13c-47bf-a1a8-6f67897df0fd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:05.588232 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8dc9e549-a13c-47bf-a1a8-6f67897df0fd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 200 len: 1472 microversion: 2.1 time: 0.483429 Sep 10 11:46:05.592962 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 823/1744] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:05 2022] GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 1472 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:05.616606 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-bd723b61-7991-4ea2-9752-d93918861683 req-d1a3b73e-3dda-4dbd-a893-cda523a4feb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f", "name": "network-vif-deleted", "tag": "ea955540-4c57-4a66-aec1-116d10e8a2f8"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:46:05.645269 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-bd723b61-7991-4ea2-9752-d93918861683 req-d1a3b73e-3dda-4dbd-a893-cda523a4feb3 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:05.645926 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-bd723b61-7991-4ea2-9752-d93918861683 req-d1a3b73e-3dda-4dbd-a893-cda523a4feb3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:05.646561 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-bd723b61-7991-4ea2-9752-d93918861683 req-d1a3b73e-3dda-4dbd-a893-cda523a4feb3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:05.684584 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-bd723b61-7991-4ea2-9752-d93918861683 req-d1a3b73e-3dda-4dbd-a893-cda523a4feb3 service nova] Creating event network-vif-deleted:ea955540-4c57-4a66-aec1-116d10e8a2f8 for instance e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f on n-h1-856895-1 Sep 10 11:46:05.691059 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-bd723b61-7991-4ea2-9752-d93918861683 req-d1a3b73e-3dda-4dbd-a893-cda523a4feb3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096268 Sep 10 11:46:05.692406 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 824/1745] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:46:05.817499 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b18107d5-336f-4602-912f-813ded2f0317 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:05.818786 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b18107d5-336f-4602-912f-813ded2f0317 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:05.833810 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b18107d5-336f-4602-912f-813ded2f0317 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:05.834574 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b18107d5-336f-4602-912f-813ded2f0317 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:05.835012 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b18107d5-336f-4602-912f-813ded2f0317 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:05.841452 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b18107d5-336f-4602-912f-813ded2f0317 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:05.843520 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b18107d5-336f-4602-912f-813ded2f0317 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:05.843984 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b18107d5-336f-4602-912f-813ded2f0317 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:05.860897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:46:05.928981 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=4 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:46:06.120598 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-17707194-f705-4d2d-9a30-85536b823205 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4/action" status: 202 len: 0 microversion: 2.25 time: 3.340791 Sep 10 11:46:06.122106 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 922/1746] 10.222.0.23 () {62 vars in 1319 bytes} [Sat Sep 10 11:46:02 2022] POST /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4/action => generated 0 bytes in 3344 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 10 11:46:06.131718 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-51c585a7-2f98-4c26-8539-61ad87d63a29 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:06.135509 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-51c585a7-2f98-4c26-8539-61ad87d63a29 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:06.178735 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-51c585a7-2f98-4c26-8539-61ad87d63a29 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:06.179259 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-51c585a7-2f98-4c26-8539-61ad87d63a29 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:06.179721 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-51c585a7-2f98-4c26-8539-61ad87d63a29 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:06.188825 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-51c585a7-2f98-4c26-8539-61ad87d63a29 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:06.190008 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-51c585a7-2f98-4c26-8539-61ad87d63a29 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:06.192058 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-51c585a7-2f98-4c26-8539-61ad87d63a29 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:06.512666 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b18107d5-336f-4602-912f-813ded2f0317 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:06.530833 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b18107d5-336f-4602-912f-813ded2f0317 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:06.541538 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b18107d5-336f-4602-912f-813ded2f0317 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:06.543136 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b18107d5-336f-4602-912f-813ded2f0317 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1707 microversion: 2.32 time: 0.729960 Sep 10 11:46:06.544615 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 825/1747] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:05 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1707 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:46:06.558781 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d95c798e-6c98-4cb4-bd76-2272fe490108 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:06.562109 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d95c798e-6c98-4cb4-bd76-2272fe490108 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:06.579600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d95c798e-6c98-4cb4-bd76-2272fe490108 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:06.581507 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d95c798e-6c98-4cb4-bd76-2272fe490108 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:06.582187 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d95c798e-6c98-4cb4-bd76-2272fe490108 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:06.583408 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d95c798e-6c98-4cb4-bd76-2272fe490108 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:06.584045 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d95c798e-6c98-4cb4-bd76-2272fe490108 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:06.585005 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d95c798e-6c98-4cb4-bd76-2272fe490108 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:06.586287 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-51c585a7-2f98-4c26-8539-61ad87d63a29 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:06.599533 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-51c585a7-2f98-4c26-8539-61ad87d63a29 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:06.601838 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-51c585a7-2f98-4c26-8539-61ad87d63a29 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:06.603779 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-51c585a7-2f98-4c26-8539-61ad87d63a29 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1486 microversion: 2.25 time: 0.477013 Sep 10 11:46:06.617051 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 923/1748] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:06 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1486 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:46:06.618969 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0d55e812-5fd7-43d1-aaa1-6f9a7b1472f7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:06.621148 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0d55e812-5fd7-43d1-aaa1-6f9a7b1472f7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:06.630262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d55e812-5fd7-43d1-aaa1-6f9a7b1472f7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:06.631105 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d55e812-5fd7-43d1-aaa1-6f9a7b1472f7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:06.631779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d55e812-5fd7-43d1-aaa1-6f9a7b1472f7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:06.632925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d55e812-5fd7-43d1-aaa1-6f9a7b1472f7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:06.634356 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d55e812-5fd7-43d1-aaa1-6f9a7b1472f7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:06.635847 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d55e812-5fd7-43d1-aaa1-6f9a7b1472f7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:06.677300 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d95c798e-6c98-4cb4-bd76-2272fe490108 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:06.677794 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d95c798e-6c98-4cb4-bd76-2272fe490108 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:06.678240 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d95c798e-6c98-4cb4-bd76-2272fe490108 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:06.678707 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-d95c798e-6c98-4cb4-bd76-2272fe490108 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lazy-loading 'fault' on Instance uuid e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:46:06.921332 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d95c798e-6c98-4cb4-bd76-2272fe490108 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '805e0c24bd364ac8852387db73b614d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6750367ae6604f798bfd58e2839f83e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:06.938358 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d95c798e-6c98-4cb4-bd76-2272fe490108 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f" status: 200 len: 1300 microversion: 2.1 time: 0.391900 Sep 10 11:46:06.939259 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 826/1749] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:06 2022] GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f => generated 1300 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:06.960036 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0d55e812-5fd7-43d1-aaa1-6f9a7b1472f7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:06.970105 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0d55e812-5fd7-43d1-aaa1-6f9a7b1472f7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 200 len: 1472 microversion: 2.1 time: 0.355290 Sep 10 11:46:06.983191 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 924/1750] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:06 2022] GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 1472 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:07.575837 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-80e93e13-847a-41b1-b90d-2274a6dfafd8 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:07.576785 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-80e93e13-847a-41b1-b90d-2274a6dfafd8 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:07.587608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=18 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:46:07.598699 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-80e93e13-847a-41b1-b90d-2274a6dfafd8 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:07.600655 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-80e93e13-847a-41b1-b90d-2274a6dfafd8 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:07.601295 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-80e93e13-847a-41b1-b90d-2274a6dfafd8 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:07.602960 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-80e93e13-847a-41b1-b90d-2274a6dfafd8 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:07.607133 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-80e93e13-847a-41b1-b90d-2274a6dfafd8 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:07.608603 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-80e93e13-847a-41b1-b90d-2274a6dfafd8 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:07.643597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9fb2e075-2556-4fba-a186-f5804ed19ff3 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:07.644489 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9fb2e075-2556-4fba-a186-f5804ed19ff3 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:07.665468 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9fb2e075-2556-4fba-a186-f5804ed19ff3 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:07.666175 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9fb2e075-2556-4fba-a186-f5804ed19ff3 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:07.666464 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9fb2e075-2556-4fba-a186-f5804ed19ff3 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:07.673010 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9fb2e075-2556-4fba-a186-f5804ed19ff3 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:07.673660 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9fb2e075-2556-4fba-a186-f5804ed19ff3 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:07.674859 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9fb2e075-2556-4fba-a186-f5804ed19ff3 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:08.509166 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9fb2e075-2556-4fba-a186-f5804ed19ff3 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:08.524686 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-80e93e13-847a-41b1-b90d-2274a6dfafd8 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:08.535754 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9fb2e075-2556-4fba-a186-f5804ed19ff3 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:08.544012 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-80e93e13-847a-41b1-b90d-2274a6dfafd8 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:08.546239 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9fb2e075-2556-4fba-a186-f5804ed19ff3 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:08.547920 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9fb2e075-2556-4fba-a186-f5804ed19ff3 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1486 microversion: 2.25 time: 0.909063 Sep 10 11:46:08.549642 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 925/1751] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:07 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1486 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:46:08.554201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-80e93e13-847a-41b1-b90d-2274a6dfafd8 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:08.561102 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8667d9fe-ae39-4530-af5b-531e96b18844 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:08.562935 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-80e93e13-847a-41b1-b90d-2274a6dfafd8 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1753 microversion: 2.32 time: 0.991384 Sep 10 11:46:08.566830 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 827/1752] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:07 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1753 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:08.572300 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8667d9fe-ae39-4530-af5b-531e96b18844 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] [instance: e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:08.580244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-df6362c4-0323-476b-91db-0d09dae1f1bc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:08.584089 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-df6362c4-0323-476b-91db-0d09dae1f1bc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:08.587406 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8667d9fe-ae39-4530-af5b-531e96b18844 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:08.589810 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8667d9fe-ae39-4530-af5b-531e96b18844 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:08.591683 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8667d9fe-ae39-4530-af5b-531e96b18844 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:08.593423 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8667d9fe-ae39-4530-af5b-531e96b18844 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:08.596510 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-df6362c4-0323-476b-91db-0d09dae1f1bc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:08.597261 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8667d9fe-ae39-4530-af5b-531e96b18844 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:08.597991 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8667d9fe-ae39-4530-af5b-531e96b18844 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:08.602436 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-df6362c4-0323-476b-91db-0d09dae1f1bc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:08.603230 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-df6362c4-0323-476b-91db-0d09dae1f1bc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:08.604259 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-df6362c4-0323-476b-91db-0d09dae1f1bc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:08.608444 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-df6362c4-0323-476b-91db-0d09dae1f1bc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:08.609174 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-df6362c4-0323-476b-91db-0d09dae1f1bc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:08.634849 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-8667d9fe-ae39-4530-af5b-531e96b18844 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] HTTP exception thrown: Instance e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f could not be found. Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8667d9fe-ae39-4530-af5b-531e96b18844 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Request method failure captured: Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f HTTP/1.1 Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHc28y97emUyUWaB-DU1sR2yW_NJ8wQwjxvgYoJp3QhVt8csYxyZV2I2MuSz5W0CcqtsNoVX-V3kbGPXqBL2XNuIrZMst7-PX_eYeJ22UptHu6DBoLoOK1_gvgLQMEm4uuwkZ4U2hE7nzHKCwWGG2gMUGj1sEUA8Bg8r5FS2vFpIAvY Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 6750367ae6604f798bfd58e2839f83e2 Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-LiveMigrationTest-1554382024 Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6750367ae6604f798bfd58e2839f83e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6750367ae6604f798bfd58e2839f83e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6750367ae6604f798bfd58e2839f83e2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6750367ae6604f798bfd58e2839f83e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-LiveMigrationTest-1554382024 Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 6750367ae6604f798bfd58e2839f83e2 Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-LiveMigrationTest-1554382024 Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-LiveMigrationTest-1554382024-project Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 805e0c24bd364ac8852387db73b614d9 Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-LiveMigrationTest-1554382024-project Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f could not be found. Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f'} Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f could not be found. Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f could not be found. Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:46:08.642361 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:46:08.648186 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:46:08.648186 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:46:08.648186 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:46:08.648186 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:46:08.648186 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:46:08.648186 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f could not be found. Sep 10 11:46:08.648186 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:46:08.655847 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8667d9fe-ae39-4530-af5b-531e96b18844 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] Returning 404 to user: Instance e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:46:08.657211 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8667d9fe-ae39-4530-af5b-531e96b18844 tempest-LiveMigrationTest-1554382024 tempest-LiveMigrationTest-1554382024-project] 10.222.0.23 "GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f" status: 404 len: 111 microversion: 2.1 time: 0.101526 Sep 10 11:46:08.658318 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 926/1753] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:08 2022] GET /compute/v2.1/servers/e84ae2b5-1f4a-4b9e-9176-2a9e73a5f73f => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:46:09.585511 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-48c5da07-377f-4b5a-94fb-ada6f0d8c0a8 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:09.587243 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-48c5da07-377f-4b5a-94fb-ada6f0d8c0a8 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:09.603394 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48c5da07-377f-4b5a-94fb-ada6f0d8c0a8 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:09.604323 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48c5da07-377f-4b5a-94fb-ada6f0d8c0a8 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:09.605906 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48c5da07-377f-4b5a-94fb-ada6f0d8c0a8 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:09.608467 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48c5da07-377f-4b5a-94fb-ada6f0d8c0a8 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:09.609177 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48c5da07-377f-4b5a-94fb-ada6f0d8c0a8 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:09.610032 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48c5da07-377f-4b5a-94fb-ada6f0d8c0a8 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:10.059772 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-df6362c4-0323-476b-91db-0d09dae1f1bc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:10.074359 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-df6362c4-0323-476b-91db-0d09dae1f1bc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 200 len: 1472 microversion: 2.1 time: 1.506074 Sep 10 11:46:10.099677 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 828/1754] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:08 2022] GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 1472 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:10.113550 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7fb6f6f1-382a-4f6b-b303-0bf96563bc57 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:10.114475 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7fb6f6f1-382a-4f6b-b303-0bf96563bc57 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:10.128419 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7fb6f6f1-382a-4f6b-b303-0bf96563bc57 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:10.135732 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7fb6f6f1-382a-4f6b-b303-0bf96563bc57 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:10.140290 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7fb6f6f1-382a-4f6b-b303-0bf96563bc57 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:10.141178 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7fb6f6f1-382a-4f6b-b303-0bf96563bc57 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:10.141712 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7fb6f6f1-382a-4f6b-b303-0bf96563bc57 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:10.142170 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7fb6f6f1-382a-4f6b-b303-0bf96563bc57 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:10.436313 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-48c5da07-377f-4b5a-94fb-ada6f0d8c0a8 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:10.453640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-48c5da07-377f-4b5a-94fb-ada6f0d8c0a8 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:10.456723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-48c5da07-377f-4b5a-94fb-ada6f0d8c0a8 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:10.458617 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-48c5da07-377f-4b5a-94fb-ada6f0d8c0a8 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1486 microversion: 2.25 time: 0.884117 Sep 10 11:46:10.465323 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 927/1755] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:09 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1486 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:10.643115 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7fb6f6f1-382a-4f6b-b303-0bf96563bc57 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:10.666567 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7fb6f6f1-382a-4f6b-b303-0bf96563bc57 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:10.669038 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7fb6f6f1-382a-4f6b-b303-0bf96563bc57 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:10.670275 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7fb6f6f1-382a-4f6b-b303-0bf96563bc57 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1799 microversion: 2.32 time: 0.569398 Sep 10 11:46:10.675149 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 829/1756] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:10 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1799 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:11.119514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-027e01e7-134e-47cc-8c2c-dd845295baae tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:11.120455 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-027e01e7-134e-47cc-8c2c-dd845295baae tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:11.138933 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-027e01e7-134e-47cc-8c2c-dd845295baae tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:11.139914 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-027e01e7-134e-47cc-8c2c-dd845295baae tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:11.140686 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-027e01e7-134e-47cc-8c2c-dd845295baae tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:11.142516 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-027e01e7-134e-47cc-8c2c-dd845295baae tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:11.144036 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-027e01e7-134e-47cc-8c2c-dd845295baae tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:11.144787 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-027e01e7-134e-47cc-8c2c-dd845295baae tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:11.508986 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ce4c0519-43f5-4446-9c14-b3ac9fc74683 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:11.510611 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ce4c0519-43f5-4446-9c14-b3ac9fc74683 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:11.519715 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ce4c0519-43f5-4446-9c14-b3ac9fc74683 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:11.521177 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ce4c0519-43f5-4446-9c14-b3ac9fc74683 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:11.522044 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ce4c0519-43f5-4446-9c14-b3ac9fc74683 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:11.523082 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ce4c0519-43f5-4446-9c14-b3ac9fc74683 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:11.524587 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ce4c0519-43f5-4446-9c14-b3ac9fc74683 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:11.525765 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ce4c0519-43f5-4446-9c14-b3ac9fc74683 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:11.649943 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-027e01e7-134e-47cc-8c2c-dd845295baae tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:11.692807 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-027e01e7-134e-47cc-8c2c-dd845295baae tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 200 len: 1477 microversion: 2.1 time: 0.577718 Sep 10 11:46:11.694098 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 928/1757] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:11 2022] GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 1477 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:46:11.710818 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d9dfcb63-df6c-4ddf-a0ed-e3e076e8288a tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:11.712334 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d9dfcb63-df6c-4ddf-a0ed-e3e076e8288a tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:11.724440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d9dfcb63-df6c-4ddf-a0ed-e3e076e8288a tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:11.725864 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d9dfcb63-df6c-4ddf-a0ed-e3e076e8288a tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:11.726991 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d9dfcb63-df6c-4ddf-a0ed-e3e076e8288a tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:11.728040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d9dfcb63-df6c-4ddf-a0ed-e3e076e8288a tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:11.728926 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d9dfcb63-df6c-4ddf-a0ed-e3e076e8288a tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:11.729639 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d9dfcb63-df6c-4ddf-a0ed-e3e076e8288a tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:12.026575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ce4c0519-43f5-4446-9c14-b3ac9fc74683 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:12.054630 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ce4c0519-43f5-4446-9c14-b3ac9fc74683 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:12.059773 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ce4c0519-43f5-4446-9c14-b3ac9fc74683 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:12.062469 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ce4c0519-43f5-4446-9c14-b3ac9fc74683 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1486 microversion: 2.25 time: 0.558756 Sep 10 11:46:12.065770 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d9dfcb63-df6c-4ddf-a0ed-e3e076e8288a tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:12.075753 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d9dfcb63-df6c-4ddf-a0ed-e3e076e8288a tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:12.079892 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d9dfcb63-df6c-4ddf-a0ed-e3e076e8288a tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:12.081696 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d9dfcb63-df6c-4ddf-a0ed-e3e076e8288a tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1845 microversion: 2.32 time: 0.375855 Sep 10 11:46:12.082875 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 830/1758] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:11 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1486 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:46:12.084742 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 929/1759] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:11 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1845 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:12.094228 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-94aae8c3-655e-42e3-8678-aaf9504dbbda req-515693df-d4d4-4945-abdb-b4d59cd553f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d86e1b80-a305-48c7-9c51-ef4175a5840c", "tag": "6ccddaf2-efc8-42e5-9c38-3ba375ee3f68"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:46:12.110539 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-94aae8c3-655e-42e3-8678-aaf9504dbbda req-515693df-d4d4-4945-abdb-b4d59cd553f8 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:12.111038 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-94aae8c3-655e-42e3-8678-aaf9504dbbda req-515693df-d4d4-4945-abdb-b4d59cd553f8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:12.112103 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-94aae8c3-655e-42e3-8678-aaf9504dbbda req-515693df-d4d4-4945-abdb-b4d59cd553f8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:12.128164 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-94aae8c3-655e-42e3-8678-aaf9504dbbda req-515693df-d4d4-4945-abdb-b4d59cd553f8 service nova] Creating event network-changed:6ccddaf2-efc8-42e5-9c38-3ba375ee3f68 for instance d86e1b80-a305-48c7-9c51-ef4175a5840c on n-h2-856895-1 Sep 10 11:46:12.137351 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-94aae8c3-655e-42e3-8678-aaf9504dbbda req-515693df-d4d4-4945-abdb-b4d59cd553f8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050924 Sep 10 11:46:12.138738 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 831/1760] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:46:12.722291 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2cdcd133-9544-4b0a-bc85-8dbeeb43fa01 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:12.723302 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2cdcd133-9544-4b0a-bc85-8dbeeb43fa01 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:12.728336 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:46:12.736478 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2cdcd133-9544-4b0a-bc85-8dbeeb43fa01 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:12.738215 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2cdcd133-9544-4b0a-bc85-8dbeeb43fa01 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:12.739082 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2cdcd133-9544-4b0a-bc85-8dbeeb43fa01 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:12.740074 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2cdcd133-9544-4b0a-bc85-8dbeeb43fa01 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:12.740831 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2cdcd133-9544-4b0a-bc85-8dbeeb43fa01 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:12.741604 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2cdcd133-9544-4b0a-bc85-8dbeeb43fa01 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:12.990987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2cdcd133-9544-4b0a-bc85-8dbeeb43fa01 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:13.004277 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2cdcd133-9544-4b0a-bc85-8dbeeb43fa01 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 200 len: 1477 microversion: 2.1 time: 0.288333 Sep 10 11:46:13.005788 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 930/1761] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:12 2022] GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 1477 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:13.097710 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d17e7099-0e28-444d-94c6-75f065f7ff12 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:13.098332 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d17e7099-0e28-444d-94c6-75f065f7ff12 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:13.107128 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d17e7099-0e28-444d-94c6-75f065f7ff12 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:13.107921 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d17e7099-0e28-444d-94c6-75f065f7ff12 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:13.108547 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d17e7099-0e28-444d-94c6-75f065f7ff12 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:13.109081 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fd6abb18-e552-4549-b832-031a5b16fb1b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:13.109625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d17e7099-0e28-444d-94c6-75f065f7ff12 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:13.109921 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fd6abb18-e552-4549-b832-031a5b16fb1b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:13.110651 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d17e7099-0e28-444d-94c6-75f065f7ff12 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:13.111274 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d17e7099-0e28-444d-94c6-75f065f7ff12 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:13.127031 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fd6abb18-e552-4549-b832-031a5b16fb1b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:13.128273 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fd6abb18-e552-4549-b832-031a5b16fb1b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:13.128822 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fd6abb18-e552-4549-b832-031a5b16fb1b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:13.130340 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fd6abb18-e552-4549-b832-031a5b16fb1b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:13.130931 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fd6abb18-e552-4549-b832-031a5b16fb1b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:13.131513 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fd6abb18-e552-4549-b832-031a5b16fb1b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:13.904150 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fd6abb18-e552-4549-b832-031a5b16fb1b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:13.914733 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fd6abb18-e552-4549-b832-031a5b16fb1b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:13.916259 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fd6abb18-e552-4549-b832-031a5b16fb1b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:13.917455 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fd6abb18-e552-4549-b832-031a5b16fb1b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1866 microversion: 2.32 time: 0.812696 Sep 10 11:46:13.918072 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 931/1762] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:13 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1866 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:46:13.984957 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d17e7099-0e28-444d-94c6-75f065f7ff12 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:13.994319 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d17e7099-0e28-444d-94c6-75f065f7ff12 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:13.996190 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d17e7099-0e28-444d-94c6-75f065f7ff12 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:13.997778 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d17e7099-0e28-444d-94c6-75f065f7ff12 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1486 microversion: 2.25 time: 0.905671 Sep 10 11:46:13.998860 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 832/1763] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:13 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1486 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:14.030588 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-36927222-e946-4497-a737-f08ed3f64e17 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:14.031231 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-36927222-e946-4497-a737-f08ed3f64e17 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:14.041836 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36927222-e946-4497-a737-f08ed3f64e17 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:14.042371 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36927222-e946-4497-a737-f08ed3f64e17 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:14.042822 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36927222-e946-4497-a737-f08ed3f64e17 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:14.045845 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36927222-e946-4497-a737-f08ed3f64e17 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:14.046406 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36927222-e946-4497-a737-f08ed3f64e17 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:14.047505 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36927222-e946-4497-a737-f08ed3f64e17 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:14.215092 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-2ff7dd08-ebd8-4005-a05e-33447cc41d63 req-e5b0f90b-8f2d-4401-a264-4794ce07be75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d86e1b80-a305-48c7-9c51-ef4175a5840c", "tag": "f9a625c6-a871-4b6f-9edf-d59069c8c738"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:46:14.237677 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-2ff7dd08-ebd8-4005-a05e-33447cc41d63 req-e5b0f90b-8f2d-4401-a264-4794ce07be75 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:14.238340 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-2ff7dd08-ebd8-4005-a05e-33447cc41d63 req-e5b0f90b-8f2d-4401-a264-4794ce07be75 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:14.238882 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-2ff7dd08-ebd8-4005-a05e-33447cc41d63 req-e5b0f90b-8f2d-4401-a264-4794ce07be75 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:14.257996 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-2ff7dd08-ebd8-4005-a05e-33447cc41d63 req-e5b0f90b-8f2d-4401-a264-4794ce07be75 service nova] Creating event network-changed:f9a625c6-a871-4b6f-9edf-d59069c8c738 for instance d86e1b80-a305-48c7-9c51-ef4175a5840c on n-h2-856895-1 Sep 10 11:46:14.276389 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-2ff7dd08-ebd8-4005-a05e-33447cc41d63 req-e5b0f90b-8f2d-4401-a264-4794ce07be75 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066957 Sep 10 11:46:14.284842 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 833/1764] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:46:14.482221 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-36927222-e946-4497-a737-f08ed3f64e17 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:14.493322 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-36927222-e946-4497-a737-f08ed3f64e17 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 200 len: 1477 microversion: 2.1 time: 0.466576 Sep 10 11:46:14.494347 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 932/1765] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:14 2022] GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 1477 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:14.953932 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d2464c31-ff53-4fe2-8599-28b077149f7c tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:14.955007 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d2464c31-ff53-4fe2-8599-28b077149f7c tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:14.968323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2464c31-ff53-4fe2-8599-28b077149f7c tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:14.969006 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2464c31-ff53-4fe2-8599-28b077149f7c tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:14.969665 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2464c31-ff53-4fe2-8599-28b077149f7c tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:14.970573 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2464c31-ff53-4fe2-8599-28b077149f7c tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:14.971267 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2464c31-ff53-4fe2-8599-28b077149f7c tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:14.971910 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2464c31-ff53-4fe2-8599-28b077149f7c tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:15.026943 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-aa20a64b-5042-4899-8a55-243f0552f371 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:15.027828 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-aa20a64b-5042-4899-8a55-243f0552f371 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:15.039121 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa20a64b-5042-4899-8a55-243f0552f371 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:15.041876 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa20a64b-5042-4899-8a55-243f0552f371 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:15.042385 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa20a64b-5042-4899-8a55-243f0552f371 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:15.043616 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa20a64b-5042-4899-8a55-243f0552f371 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:15.046211 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa20a64b-5042-4899-8a55-243f0552f371 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:15.046727 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa20a64b-5042-4899-8a55-243f0552f371 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:15.395375 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d2464c31-ff53-4fe2-8599-28b077149f7c tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:15.407505 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d2464c31-ff53-4fe2-8599-28b077149f7c tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:15.410674 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d2464c31-ff53-4fe2-8599-28b077149f7c tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:15.412621 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d2464c31-ff53-4fe2-8599-28b077149f7c tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1887 microversion: 2.32 time: 0.469070 Sep 10 11:46:15.414339 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 834/1766] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:14 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1887 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:15.432661 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-aa20a64b-5042-4899-8a55-243f0552f371 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:15.444369 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-aa20a64b-5042-4899-8a55-243f0552f371 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:15.462474 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-aa20a64b-5042-4899-8a55-243f0552f371 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:15.470617 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-aa20a64b-5042-4899-8a55-243f0552f371 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1486 microversion: 2.25 time: 0.447096 Sep 10 11:46:15.472785 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 933/1767] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:15 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1486 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:46:15.520263 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2b69dde6-efe4-45cf-8a04-687683ee7cbd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:15.521962 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2b69dde6-efe4-45cf-8a04-687683ee7cbd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:15.534683 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2b69dde6-efe4-45cf-8a04-687683ee7cbd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:15.534937 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2b69dde6-efe4-45cf-8a04-687683ee7cbd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:15.535339 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2b69dde6-efe4-45cf-8a04-687683ee7cbd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:15.536277 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2b69dde6-efe4-45cf-8a04-687683ee7cbd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:15.536733 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2b69dde6-efe4-45cf-8a04-687683ee7cbd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:15.537196 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2b69dde6-efe4-45cf-8a04-687683ee7cbd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:16.034403 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2b69dde6-efe4-45cf-8a04-687683ee7cbd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:16.060131 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2b69dde6-efe4-45cf-8a04-687683ee7cbd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 200 len: 1477 microversion: 2.1 time: 0.545092 Sep 10 11:46:16.062567 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 835/1768] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:15 2022] GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 1477 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:16.506234 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-755c6eea-26ff-4b9e-a7cb-bbace02b5f21 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:16.506234 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-755c6eea-26ff-4b9e-a7cb-bbace02b5f21 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:16.506234 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-755c6eea-26ff-4b9e-a7cb-bbace02b5f21 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:16.506234 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-755c6eea-26ff-4b9e-a7cb-bbace02b5f21 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:16.506234 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-755c6eea-26ff-4b9e-a7cb-bbace02b5f21 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:16.506234 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-755c6eea-26ff-4b9e-a7cb-bbace02b5f21 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:16.506234 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-755c6eea-26ff-4b9e-a7cb-bbace02b5f21 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:16.506234 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-755c6eea-26ff-4b9e-a7cb-bbace02b5f21 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:16.509457 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1a5f4119-09b8-4dd5-ab62-6c7136e03cf0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:16.509457 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1a5f4119-09b8-4dd5-ab62-6c7136e03cf0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:16.522720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a5f4119-09b8-4dd5-ab62-6c7136e03cf0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:16.526402 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a5f4119-09b8-4dd5-ab62-6c7136e03cf0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:16.526964 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a5f4119-09b8-4dd5-ab62-6c7136e03cf0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:16.529576 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a5f4119-09b8-4dd5-ab62-6c7136e03cf0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:16.529576 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a5f4119-09b8-4dd5-ab62-6c7136e03cf0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:16.529576 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a5f4119-09b8-4dd5-ab62-6c7136e03cf0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:17.005187 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-755c6eea-26ff-4b9e-a7cb-bbace02b5f21 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:17.012763 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1a5f4119-09b8-4dd5-ab62-6c7136e03cf0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:17.032482 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-755c6eea-26ff-4b9e-a7cb-bbace02b5f21 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:17.038998 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1a5f4119-09b8-4dd5-ab62-6c7136e03cf0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:17.041270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1a5f4119-09b8-4dd5-ab62-6c7136e03cf0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:17.048308 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1a5f4119-09b8-4dd5-ab62-6c7136e03cf0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1486 microversion: 2.25 time: 0.546444 Sep 10 11:46:17.053523 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-755c6eea-26ff-4b9e-a7cb-bbace02b5f21 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:17.054346 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 836/1769] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:16 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1486 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:17.055970 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-755c6eea-26ff-4b9e-a7cb-bbace02b5f21 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1887 microversion: 2.32 time: 0.615126 Sep 10 11:46:17.059046 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 934/1770] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:16 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1887 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:17.061867 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-47b11858-ef0c-46c4-bfe7-cf266f4257c8 req-d25ba56a-c1a4-4908-92c0-f7c0aeff93d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d86e1b80-a305-48c7-9c51-ef4175a5840c", "tag": "fdbc5dc3-2de5-4f0c-8eca-af1d0dcbbfca"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:46:17.087540 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-65759fb5-1b07-4c03-8235-790c049af94a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:17.088373 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-65759fb5-1b07-4c03-8235-790c049af94a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:17.095542 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-65759fb5-1b07-4c03-8235-790c049af94a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:17.096608 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-65759fb5-1b07-4c03-8235-790c049af94a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:17.097058 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-65759fb5-1b07-4c03-8235-790c049af94a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:17.097775 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-65759fb5-1b07-4c03-8235-790c049af94a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:17.098235 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-65759fb5-1b07-4c03-8235-790c049af94a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:17.098671 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-65759fb5-1b07-4c03-8235-790c049af94a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:17.102758 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-47b11858-ef0c-46c4-bfe7-cf266f4257c8 req-d25ba56a-c1a4-4908-92c0-f7c0aeff93d2 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:17.103277 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-47b11858-ef0c-46c4-bfe7-cf266f4257c8 req-d25ba56a-c1a4-4908-92c0-f7c0aeff93d2 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:17.103721 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-47b11858-ef0c-46c4-bfe7-cf266f4257c8 req-d25ba56a-c1a4-4908-92c0-f7c0aeff93d2 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:17.133049 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-47b11858-ef0c-46c4-bfe7-cf266f4257c8 req-d25ba56a-c1a4-4908-92c0-f7c0aeff93d2 service nova] Creating event network-changed:fdbc5dc3-2de5-4f0c-8eca-af1d0dcbbfca for instance d86e1b80-a305-48c7-9c51-ef4175a5840c on n-h2-856895-1 Sep 10 11:46:17.146561 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-47b11858-ef0c-46c4-bfe7-cf266f4257c8 req-d25ba56a-c1a4-4908-92c0-f7c0aeff93d2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089283 Sep 10 11:46:17.147766 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 837/1771] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:46:17.299795 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-65759fb5-1b07-4c03-8235-790c049af94a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:17.321393 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-65759fb5-1b07-4c03-8235-790c049af94a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 200 len: 1477 microversion: 2.1 time: 0.237860 Sep 10 11:46:17.322004 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 935/1772] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:17 2022] GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 1477 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:46:18.114556 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0dc7a644-93fd-40b4-b95e-27d35cbef6bb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:18.115625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ea6f0b55-e7b0-4838-af09-34930847f9f1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:18.117384 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ea6f0b55-e7b0-4838-af09-34930847f9f1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:18.118848 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0dc7a644-93fd-40b4-b95e-27d35cbef6bb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:18.140831 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0dc7a644-93fd-40b4-b95e-27d35cbef6bb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:18.141421 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea6f0b55-e7b0-4838-af09-34930847f9f1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:18.141965 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea6f0b55-e7b0-4838-af09-34930847f9f1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:18.142416 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea6f0b55-e7b0-4838-af09-34930847f9f1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:18.143646 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0dc7a644-93fd-40b4-b95e-27d35cbef6bb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:18.145122 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0dc7a644-93fd-40b4-b95e-27d35cbef6bb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:18.145859 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0dc7a644-93fd-40b4-b95e-27d35cbef6bb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:18.146400 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea6f0b55-e7b0-4838-af09-34930847f9f1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:18.146876 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea6f0b55-e7b0-4838-af09-34930847f9f1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:18.147392 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea6f0b55-e7b0-4838-af09-34930847f9f1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:18.148003 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0dc7a644-93fd-40b4-b95e-27d35cbef6bb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:18.148461 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0dc7a644-93fd-40b4-b95e-27d35cbef6bb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:18.586006 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ea6f0b55-e7b0-4838-af09-34930847f9f1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:18.592503 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0dc7a644-93fd-40b4-b95e-27d35cbef6bb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:18.603316 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ea6f0b55-e7b0-4838-af09-34930847f9f1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:18.605619 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0dc7a644-93fd-40b4-b95e-27d35cbef6bb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:18.606530 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ea6f0b55-e7b0-4838-af09-34930847f9f1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:18.607603 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0dc7a644-93fd-40b4-b95e-27d35cbef6bb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:18.608011 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ea6f0b55-e7b0-4838-af09-34930847f9f1 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1486 microversion: 2.25 time: 0.515667 Sep 10 11:46:18.609284 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0dc7a644-93fd-40b4-b95e-27d35cbef6bb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1887 microversion: 2.32 time: 0.512707 Sep 10 11:46:18.623526 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 838/1773] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:18 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1486 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:46:18.623526 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7c2a5b8e-4bdd-44aa-a081-98f2e4cf733c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:18.623526 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7c2a5b8e-4bdd-44aa-a081-98f2e4cf733c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:18.624803 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 936/1774] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:18 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1887 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:18.626556 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7c2a5b8e-4bdd-44aa-a081-98f2e4cf733c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:18.627808 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7c2a5b8e-4bdd-44aa-a081-98f2e4cf733c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:18.628724 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7c2a5b8e-4bdd-44aa-a081-98f2e4cf733c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:18.630432 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7c2a5b8e-4bdd-44aa-a081-98f2e4cf733c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:18.632564 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7c2a5b8e-4bdd-44aa-a081-98f2e4cf733c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:18.633153 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7c2a5b8e-4bdd-44aa-a081-98f2e4cf733c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:18.886268 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7c2a5b8e-4bdd-44aa-a081-98f2e4cf733c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:18.895631 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7c2a5b8e-4bdd-44aa-a081-98f2e4cf733c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 200 len: 1477 microversion: 2.1 time: 0.284717 Sep 10 11:46:18.903544 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 839/1775] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:18 2022] GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 1477 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:19.191946 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-894628da-1993-4a6e-b19c-37f5342b4f87 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1727002563", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "d03aafc1-7066-4559-b631-8cc4296f35d7"}], "security_groups": [{"name": "tempest-securitygroup--1945180637"}], "key_name": "tempest-keypair-1969874413", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "4ccf97ae-7541-4783-83d8-a746e3fa288e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:46:19.264911 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-3b7f0804-20ca-41ff-9122-e54f4adeb7b1 req-aac5cace-f48f-4925-a08a-cde5b8b80c77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d86e1b80-a305-48c7-9c51-ef4175a5840c", "tag": "f5d4ab4f-0cbe-4d63-a759-332a06ede2bf"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:46:19.289794 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-3b7f0804-20ca-41ff-9122-e54f4adeb7b1 req-aac5cace-f48f-4925-a08a-cde5b8b80c77 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:19.290913 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-3b7f0804-20ca-41ff-9122-e54f4adeb7b1 req-aac5cace-f48f-4925-a08a-cde5b8b80c77 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:19.291394 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-3b7f0804-20ca-41ff-9122-e54f4adeb7b1 req-aac5cace-f48f-4925-a08a-cde5b8b80c77 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:19.318292 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-3b7f0804-20ca-41ff-9122-e54f4adeb7b1 req-aac5cace-f48f-4925-a08a-cde5b8b80c77 service nova] Creating event network-changed:f5d4ab4f-0cbe-4d63-a759-332a06ede2bf for instance d86e1b80-a305-48c7-9c51-ef4175a5840c on n-h2-856895-1 Sep 10 11:46:19.327445 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-3b7f0804-20ca-41ff-9122-e54f4adeb7b1 req-aac5cace-f48f-4925-a08a-cde5b8b80c77 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066231 Sep 10 11:46:19.328852 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 840/1776] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:46:19.631841 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-894628da-1993-4a6e-b19c-37f5342b4f87 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] validate_networks() for [('d03aafc1-7066-4559-b631-8cc4296f35d7', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:46:19.648145 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fa8909a3-5a7d-4fd8-a99b-1f81dfcf4c3e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:19.651189 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fa8909a3-5a7d-4fd8-a99b-1f81dfcf4c3e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:19.659937 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa8909a3-5a7d-4fd8-a99b-1f81dfcf4c3e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:19.661188 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa8909a3-5a7d-4fd8-a99b-1f81dfcf4c3e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:19.662025 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa8909a3-5a7d-4fd8-a99b-1f81dfcf4c3e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:19.663484 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa8909a3-5a7d-4fd8-a99b-1f81dfcf4c3e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:19.664758 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa8909a3-5a7d-4fd8-a99b-1f81dfcf4c3e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:19.665446 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa8909a3-5a7d-4fd8-a99b-1f81dfcf4c3e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:20.015864 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fa8909a3-5a7d-4fd8-a99b-1f81dfcf4c3e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:20.029977 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fa8909a3-5a7d-4fd8-a99b-1f81dfcf4c3e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:20.034060 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fa8909a3-5a7d-4fd8-a99b-1f81dfcf4c3e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:20.047946 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fa8909a3-5a7d-4fd8-a99b-1f81dfcf4c3e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1486 microversion: 2.25 time: 0.414126 Sep 10 11:46:20.067081 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 841/1777] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:19 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1486 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:20.072603 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-383e3301-5b7f-43cc-ae4b-eb5771c02d58 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:20.073431 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-383e3301-5b7f-43cc-ae4b-eb5771c02d58 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:20.080825 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-383e3301-5b7f-43cc-ae4b-eb5771c02d58 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:20.082044 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-383e3301-5b7f-43cc-ae4b-eb5771c02d58 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:20.082712 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-383e3301-5b7f-43cc-ae4b-eb5771c02d58 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:20.083692 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-383e3301-5b7f-43cc-ae4b-eb5771c02d58 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:20.084394 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-383e3301-5b7f-43cc-ae4b-eb5771c02d58 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:20.085354 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-383e3301-5b7f-43cc-ae4b-eb5771c02d58 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:20.463217 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-383e3301-5b7f-43cc-ae4b-eb5771c02d58 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:20.484868 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-383e3301-5b7f-43cc-ae4b-eb5771c02d58 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:20.491756 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-383e3301-5b7f-43cc-ae4b-eb5771c02d58 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:20.494261 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-383e3301-5b7f-43cc-ae4b-eb5771c02d58 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1887 microversion: 2.32 time: 0.425321 Sep 10 11:46:20.497142 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 842/1778] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:20 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1887 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:20.508444 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b201301b-3776-429b-8c8b-26eb9a9603e7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:20.509468 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b201301b-3776-429b-8c8b-26eb9a9603e7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:20.525564 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b201301b-3776-429b-8c8b-26eb9a9603e7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:20.526204 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b201301b-3776-429b-8c8b-26eb9a9603e7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:20.526839 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b201301b-3776-429b-8c8b-26eb9a9603e7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:20.528731 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b201301b-3776-429b-8c8b-26eb9a9603e7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:20.529591 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b201301b-3776-429b-8c8b-26eb9a9603e7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:20.530338 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b201301b-3776-429b-8c8b-26eb9a9603e7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:20.704167 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-894628da-1993-4a6e-b19c-37f5342b4f87 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Getting quotas for project 0bdddfac170d4386abaf77217e0f35c4. Resources: dict_keys(['metadata_items']) {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:46:20.714998 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-894628da-1993-4a6e-b19c-37f5342b4f87 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Getting quotas for user 27fa5fccb6d54dfc9f0125be9787b171 and project 0bdddfac170d4386abaf77217e0f35c4. Resources: dict_keys(['metadata_items']) {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:46:20.751572 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b201301b-3776-429b-8c8b-26eb9a9603e7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:20.752547 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-894628da-1993-4a6e-b19c-37f5342b4f87 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:46:20.752990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-894628da-1993-4a6e-b19c-37f5342b4f87 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:46:20.753575 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-894628da-1993-4a6e-b19c-37f5342b4f87 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:46:20.754009 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-894628da-1993-4a6e-b19c-37f5342b4f87 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:46:20.756837 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-894628da-1993-4a6e-b19c-37f5342b4f87 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:46:20.765531 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b201301b-3776-429b-8c8b-26eb9a9603e7 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 200 len: 1477 microversion: 2.1 time: 0.266438 Sep 10 11:46:20.776405 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 843/1779] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:20 2022] GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 1477 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:20.779749 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-894628da-1993-4a6e-b19c-37f5342b4f87 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:20.779749 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-894628da-1993-4a6e-b19c-37f5342b4f87 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:20.780987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-894628da-1993-4a6e-b19c-37f5342b4f87 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:20.781914 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-894628da-1993-4a6e-b19c-37f5342b4f87 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:20.784446 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-894628da-1993-4a6e-b19c-37f5342b4f87 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:20.787803 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-894628da-1993-4a6e-b19c-37f5342b4f87 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:20.813187 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-894628da-1993-4a6e-b19c-37f5342b4f87 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Getting quotas for project 0bdddfac170d4386abaf77217e0f35c4. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:46:20.819773 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-894628da-1993-4a6e-b19c-37f5342b4f87 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Getting quotas for user 27fa5fccb6d54dfc9f0125be9787b171 and project 0bdddfac170d4386abaf77217e0f35c4. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:46:20.948654 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-894628da-1993-4a6e-b19c-37f5342b4f87 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:46:20.950926 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-894628da-1993-4a6e-b19c-37f5342b4f87 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4ccf97ae-7541-4783-83d8-a746e3fa288e',volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:46:21.074422 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7593dcd9-9cdf-49cf-abc0-49439d2ffb30 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:21.075486 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7593dcd9-9cdf-49cf-abc0-49439d2ffb30 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:21.088871 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7593dcd9-9cdf-49cf-abc0-49439d2ffb30 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:21.089895 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7593dcd9-9cdf-49cf-abc0-49439d2ffb30 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:21.093188 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7593dcd9-9cdf-49cf-abc0-49439d2ffb30 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:21.100564 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7593dcd9-9cdf-49cf-abc0-49439d2ffb30 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:21.101328 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7593dcd9-9cdf-49cf-abc0-49439d2ffb30 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:21.102221 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7593dcd9-9cdf-49cf-abc0-49439d2ffb30 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:21.112049 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:46:21.230314 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-894628da-1993-4a6e-b19c-37f5342b4f87 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.043600 Sep 10 11:46:21.239335 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 937/1780] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:46:19 2022] POST /compute/v2.1/servers => generated 407 bytes in 2053 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:46:21.245612 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c6f4f0c4-b592-442f-8ed3-921893e2a8df tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:21.246467 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c6f4f0c4-b592-442f-8ed3-921893e2a8df tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:21.603801 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c6f4f0c4-b592-442f-8ed3-921893e2a8df tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:21.613806 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c6f4f0c4-b592-442f-8ed3-921893e2a8df tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1122 microversion: 2.1 time: 0.372872 Sep 10 11:46:21.633539 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 938/1781] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:21 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1122 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:21.650279 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-810a9e8b-cb6d-45cd-9f73-64d5c5ae2cad tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:21.650916 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-810a9e8b-cb6d-45cd-9f73-64d5c5ae2cad tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:21.665708 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-810a9e8b-cb6d-45cd-9f73-64d5c5ae2cad tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:21.666218 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-810a9e8b-cb6d-45cd-9f73-64d5c5ae2cad tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:21.669242 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-810a9e8b-cb6d-45cd-9f73-64d5c5ae2cad tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:21.671628 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-810a9e8b-cb6d-45cd-9f73-64d5c5ae2cad tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:21.672322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-810a9e8b-cb6d-45cd-9f73-64d5c5ae2cad tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:21.676669 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-810a9e8b-cb6d-45cd-9f73-64d5c5ae2cad tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:21.742259 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:46:21.853158 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7593dcd9-9cdf-49cf-abc0-49439d2ffb30 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:21.869841 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7593dcd9-9cdf-49cf-abc0-49439d2ffb30 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:21.876932 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7593dcd9-9cdf-49cf-abc0-49439d2ffb30 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:21.878353 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7593dcd9-9cdf-49cf-abc0-49439d2ffb30 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1486 microversion: 2.25 time: 0.808384 Sep 10 11:46:21.892073 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 844/1782] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:21 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1486 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:46:21.913381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-75cd1cb6-1484-4504-85c1-0021d8b5b39e req-5b3e4444-c002-47ec-8b54-6ad69fa5ac95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d86e1b80-a305-48c7-9c51-ef4175a5840c", "tag": "1044ecab-729c-4007-8cd5-f7510a291677"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:46:21.935886 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-75cd1cb6-1484-4504-85c1-0021d8b5b39e req-5b3e4444-c002-47ec-8b54-6ad69fa5ac95 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:21.939292 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-75cd1cb6-1484-4504-85c1-0021d8b5b39e req-5b3e4444-c002-47ec-8b54-6ad69fa5ac95 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:21.940214 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-75cd1cb6-1484-4504-85c1-0021d8b5b39e req-5b3e4444-c002-47ec-8b54-6ad69fa5ac95 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:21.971935 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-75cd1cb6-1484-4504-85c1-0021d8b5b39e req-5b3e4444-c002-47ec-8b54-6ad69fa5ac95 service nova] Creating event network-changed:1044ecab-729c-4007-8cd5-f7510a291677 for instance d86e1b80-a305-48c7-9c51-ef4175a5840c on n-h2-856895-1 Sep 10 11:46:21.988273 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-75cd1cb6-1484-4504-85c1-0021d8b5b39e req-5b3e4444-c002-47ec-8b54-6ad69fa5ac95 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094766 Sep 10 11:46:21.990214 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 845/1783] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:46:22.011591 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e01ee566-ca17-41d0-a3da-0ac27a61bc78 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:22.021574 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e01ee566-ca17-41d0-a3da-0ac27a61bc78 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:22.046512 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e01ee566-ca17-41d0-a3da-0ac27a61bc78 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:22.047313 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e01ee566-ca17-41d0-a3da-0ac27a61bc78 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:22.047906 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e01ee566-ca17-41d0-a3da-0ac27a61bc78 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:22.048890 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e01ee566-ca17-41d0-a3da-0ac27a61bc78 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:22.050070 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e01ee566-ca17-41d0-a3da-0ac27a61bc78 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:22.050656 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e01ee566-ca17-41d0-a3da-0ac27a61bc78 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:22.610147 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-810a9e8b-cb6d-45cd-9f73-64d5c5ae2cad tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:22.630509 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-810a9e8b-cb6d-45cd-9f73-64d5c5ae2cad tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:22.634961 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-810a9e8b-cb6d-45cd-9f73-64d5c5ae2cad tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:22.643631 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-810a9e8b-cb6d-45cd-9f73-64d5c5ae2cad tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1887 microversion: 2.32 time: 1.000942 Sep 10 11:46:22.660440 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 939/1784] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:21 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1887 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:22.670138 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4961c3d2-950c-4213-8ed4-8341241ffb73 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:22.675777 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4961c3d2-950c-4213-8ed4-8341241ffb73 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:22.694922 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4961c3d2-950c-4213-8ed4-8341241ffb73 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:22.714842 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4961c3d2-950c-4213-8ed4-8341241ffb73 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:22.719468 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4961c3d2-950c-4213-8ed4-8341241ffb73 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:22.720292 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4961c3d2-950c-4213-8ed4-8341241ffb73 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:22.720790 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4961c3d2-950c-4213-8ed4-8341241ffb73 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:22.721805 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4961c3d2-950c-4213-8ed4-8341241ffb73 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:22.870276 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e01ee566-ca17-41d0-a3da-0ac27a61bc78 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:22.879289 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e01ee566-ca17-41d0-a3da-0ac27a61bc78 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 200 len: 1477 microversion: 2.1 time: 0.872348 Sep 10 11:46:22.884886 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 846/1785] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:21 2022] GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 1477 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:22.907697 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ae009ad2-a27f-4f16-9c66-5954ee30613f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:22.908348 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ae009ad2-a27f-4f16-9c66-5954ee30613f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:22.918663 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ae009ad2-a27f-4f16-9c66-5954ee30613f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:22.919245 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ae009ad2-a27f-4f16-9c66-5954ee30613f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:22.923135 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ae009ad2-a27f-4f16-9c66-5954ee30613f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:22.923958 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ae009ad2-a27f-4f16-9c66-5954ee30613f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:22.924496 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ae009ad2-a27f-4f16-9c66-5954ee30613f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:22.924941 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ae009ad2-a27f-4f16-9c66-5954ee30613f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:22.995498 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4961c3d2-950c-4213-8ed4-8341241ffb73 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:23.007088 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4961c3d2-950c-4213-8ed4-8341241ffb73 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1172 microversion: 2.1 time: 0.345164 Sep 10 11:46:23.028899 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 940/1786] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:22 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1172 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:23.679790 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8f478349-1d97-449a-bda9-293df30f3acb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:23.681310 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8f478349-1d97-449a-bda9-293df30f3acb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:23.698121 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8f478349-1d97-449a-bda9-293df30f3acb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:23.698866 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8f478349-1d97-449a-bda9-293df30f3acb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:23.700673 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8f478349-1d97-449a-bda9-293df30f3acb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:23.702792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8f478349-1d97-449a-bda9-293df30f3acb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:23.703537 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8f478349-1d97-449a-bda9-293df30f3acb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:23.704158 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8f478349-1d97-449a-bda9-293df30f3acb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:24.300082 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ae009ad2-a27f-4f16-9c66-5954ee30613f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:24.316146 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ae009ad2-a27f-4f16-9c66-5954ee30613f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:24.320921 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ae009ad2-a27f-4f16-9c66-5954ee30613f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:24.334177 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ae009ad2-a27f-4f16-9c66-5954ee30613f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1486 microversion: 2.25 time: 1.430262 Sep 10 11:46:24.343919 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 847/1787] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:22 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1486 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:46:24.352594 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cb55f51d-6bd1-4713-aadf-a17d3d28f1c4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:24.353560 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cb55f51d-6bd1-4713-aadf-a17d3d28f1c4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:24.361121 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:46:24.364775 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb55f51d-6bd1-4713-aadf-a17d3d28f1c4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:24.366495 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb55f51d-6bd1-4713-aadf-a17d3d28f1c4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:24.366950 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb55f51d-6bd1-4713-aadf-a17d3d28f1c4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:24.367798 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb55f51d-6bd1-4713-aadf-a17d3d28f1c4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:24.368582 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb55f51d-6bd1-4713-aadf-a17d3d28f1c4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:24.369011 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb55f51d-6bd1-4713-aadf-a17d3d28f1c4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:24.481627 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8f478349-1d97-449a-bda9-293df30f3acb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:24.499093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8f478349-1d97-449a-bda9-293df30f3acb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:24.501346 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8f478349-1d97-449a-bda9-293df30f3acb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:24.509574 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8f478349-1d97-449a-bda9-293df30f3acb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1887 microversion: 2.32 time: 0.835107 Sep 10 11:46:24.514071 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 941/1788] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:23 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1887 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:24.544129 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-615058f1-8476-4575-82b1-752a42992cd7 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:24.544961 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-615058f1-8476-4575-82b1-752a42992cd7 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:24.560930 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:46:24.573178 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-615058f1-8476-4575-82b1-752a42992cd7 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:24.573703 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-615058f1-8476-4575-82b1-752a42992cd7 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:24.574142 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-615058f1-8476-4575-82b1-752a42992cd7 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:24.574927 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-615058f1-8476-4575-82b1-752a42992cd7 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:24.575500 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-615058f1-8476-4575-82b1-752a42992cd7 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:24.575853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-615058f1-8476-4575-82b1-752a42992cd7 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:24.739843 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-615058f1-8476-4575-82b1-752a42992cd7 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:24.760271 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-615058f1-8476-4575-82b1-752a42992cd7 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1220 microversion: 2.1 time: 0.228937 Sep 10 11:46:24.760900 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 942/1789] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:24 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1220 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:24.779750 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-79ca885e-9b9d-409b-b894-c8a796b8be9b tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "311da802-da68-4dc2-bb17-e8a99fa06eb8"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:46:24.788963 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-79ca885e-9b9d-409b-b894-c8a796b8be9b tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: e713eb62-8c55-40ae-8424-4283e90a4c30] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:24.799987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-79ca885e-9b9d-409b-b894-c8a796b8be9b tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:24.800742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-79ca885e-9b9d-409b-b894-c8a796b8be9b tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:24.801343 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-79ca885e-9b9d-409b-b894-c8a796b8be9b tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:24.802651 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-79ca885e-9b9d-409b-b894-c8a796b8be9b tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:24.803412 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-79ca885e-9b9d-409b-b894-c8a796b8be9b tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:24.804003 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-79ca885e-9b9d-409b-b894-c8a796b8be9b tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:25.029275 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-cb55f51d-6bd1-4713-aadf-a17d3d28f1c4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:25.056079 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cb55f51d-6bd1-4713-aadf-a17d3d28f1c4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 200 len: 1477 microversion: 2.1 time: 0.706493 Sep 10 11:46:25.057852 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 848/1790] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:24 2022] GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 1477 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:25.071421 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-c0b474ac-7bd4-4b5f-b5a9-384a36dcc29e req-91b8d39a-7656-4dd8-91fd-b79819794769 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d86e1b80-a305-48c7-9c51-ef4175a5840c", "tag": "e0df91dd-9b58-4a4f-abcf-93e91dd253ff"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:46:25.129111 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-c0b474ac-7bd4-4b5f-b5a9-384a36dcc29e req-91b8d39a-7656-4dd8-91fd-b79819794769 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:25.130401 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-c0b474ac-7bd4-4b5f-b5a9-384a36dcc29e req-91b8d39a-7656-4dd8-91fd-b79819794769 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:25.131814 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-c0b474ac-7bd4-4b5f-b5a9-384a36dcc29e req-91b8d39a-7656-4dd8-91fd-b79819794769 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:25.160597 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-c0b474ac-7bd4-4b5f-b5a9-384a36dcc29e req-91b8d39a-7656-4dd8-91fd-b79819794769 service nova] Creating event network-changed:e0df91dd-9b58-4a4f-abcf-93e91dd253ff for instance d86e1b80-a305-48c7-9c51-ef4175a5840c on n-h2-856895-1 Sep 10 11:46:25.172517 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-c0b474ac-7bd4-4b5f-b5a9-384a36dcc29e req-91b8d39a-7656-4dd8-91fd-b79819794769 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112651 Sep 10 11:46:25.174358 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 849/1791] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:46:25.309406 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-79ca885e-9b9d-409b-b894-c8a796b8be9b tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "POST /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.546749 Sep 10 11:46:25.311271 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 943/1792] 10.222.0.23 () {60 vars in 1323 bytes} [Sat Sep 10 11:46:24 2022] POST /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30/os-volume_attachments => generated 194 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:46:25.375881 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3faba2ae-893b-440f-80b0-bd4432c1aadd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:25.380317 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3faba2ae-893b-440f-80b0-bd4432c1aadd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:25.410364 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3faba2ae-893b-440f-80b0-bd4432c1aadd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:25.416874 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3faba2ae-893b-440f-80b0-bd4432c1aadd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:25.418742 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3faba2ae-893b-440f-80b0-bd4432c1aadd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:25.421599 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3faba2ae-893b-440f-80b0-bd4432c1aadd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:25.423720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3faba2ae-893b-440f-80b0-bd4432c1aadd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:25.425718 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3faba2ae-893b-440f-80b0-bd4432c1aadd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:25.549310 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-db6567f3-8e7a-44d2-8d99-3e5a17afd501 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:25.550691 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-db6567f3-8e7a-44d2-8d99-3e5a17afd501 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:25.590581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db6567f3-8e7a-44d2-8d99-3e5a17afd501 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:25.594119 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db6567f3-8e7a-44d2-8d99-3e5a17afd501 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:25.596732 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db6567f3-8e7a-44d2-8d99-3e5a17afd501 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:25.604344 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db6567f3-8e7a-44d2-8d99-3e5a17afd501 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:25.610318 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db6567f3-8e7a-44d2-8d99-3e5a17afd501 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:25.610816 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db6567f3-8e7a-44d2-8d99-3e5a17afd501 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:26.009222 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3faba2ae-893b-440f-80b0-bd4432c1aadd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:26.034246 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3faba2ae-893b-440f-80b0-bd4432c1aadd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:26.037401 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3faba2ae-893b-440f-80b0-bd4432c1aadd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:26.039767 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3faba2ae-893b-440f-80b0-bd4432c1aadd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1486 microversion: 2.25 time: 0.671021 Sep 10 11:46:26.050215 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 850/1793] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:25 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1486 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:26.055289 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-287764fd-3d46-4522-8c87-d97950282e7c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:26.060018 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-287764fd-3d46-4522-8c87-d97950282e7c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:26.080093 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-287764fd-3d46-4522-8c87-d97950282e7c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:26.081226 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-287764fd-3d46-4522-8c87-d97950282e7c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:26.081675 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-287764fd-3d46-4522-8c87-d97950282e7c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:26.082455 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-287764fd-3d46-4522-8c87-d97950282e7c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:26.082920 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-287764fd-3d46-4522-8c87-d97950282e7c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:26.083378 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-287764fd-3d46-4522-8c87-d97950282e7c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:26.365148 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-db6567f3-8e7a-44d2-8d99-3e5a17afd501 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:26.379354 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-287764fd-3d46-4522-8c87-d97950282e7c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:26.392842 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-db6567f3-8e7a-44d2-8d99-3e5a17afd501 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:26.396841 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-287764fd-3d46-4522-8c87-d97950282e7c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1238 microversion: 2.1 time: 0.344406 Sep 10 11:46:26.397508 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 851/1794] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:26 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1238 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:26.404191 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-db6567f3-8e7a-44d2-8d99-3e5a17afd501 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:26.404191 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-db6567f3-8e7a-44d2-8d99-3e5a17afd501 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1887 microversion: 2.32 time: 0.860773 Sep 10 11:46:26.418723 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 944/1795] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:25 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1887 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:46:26.419320 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-60103a84-3806-44ef-9f3c-ca4a6968e80a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:26.420055 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-60103a84-3806-44ef-9f3c-ca4a6968e80a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:26.454817 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60103a84-3806-44ef-9f3c-ca4a6968e80a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:26.455441 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60103a84-3806-44ef-9f3c-ca4a6968e80a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:26.461882 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60103a84-3806-44ef-9f3c-ca4a6968e80a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:26.464384 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60103a84-3806-44ef-9f3c-ca4a6968e80a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:26.464878 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60103a84-3806-44ef-9f3c-ca4a6968e80a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:26.465438 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60103a84-3806-44ef-9f3c-ca4a6968e80a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:27.007841 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-60103a84-3806-44ef-9f3c-ca4a6968e80a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:27.022851 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-60103a84-3806-44ef-9f3c-ca4a6968e80a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 200 len: 1477 microversion: 2.1 time: 0.623297 Sep 10 11:46:27.025403 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 852/1796] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:26 2022] GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 1477 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:27.078237 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-92087a01-27b7-466c-9bcf-c0249387cdee tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:27.078913 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-92087a01-27b7-466c-9bcf-c0249387cdee tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:27.100720 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92087a01-27b7-466c-9bcf-c0249387cdee tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:27.101220 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92087a01-27b7-466c-9bcf-c0249387cdee tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:27.101727 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92087a01-27b7-466c-9bcf-c0249387cdee tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:27.102521 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92087a01-27b7-466c-9bcf-c0249387cdee tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:27.102988 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92087a01-27b7-466c-9bcf-c0249387cdee tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:27.103494 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92087a01-27b7-466c-9bcf-c0249387cdee tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:27.442800 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ec79fd93-8b81-4acb-9ff2-8c7fd107b509 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:27.445440 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ec79fd93-8b81-4acb-9ff2-8c7fd107b509 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:27.464534 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec79fd93-8b81-4acb-9ff2-8c7fd107b509 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:27.465608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec79fd93-8b81-4acb-9ff2-8c7fd107b509 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:27.466210 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec79fd93-8b81-4acb-9ff2-8c7fd107b509 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:27.468560 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec79fd93-8b81-4acb-9ff2-8c7fd107b509 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:27.469224 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec79fd93-8b81-4acb-9ff2-8c7fd107b509 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:27.469974 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec79fd93-8b81-4acb-9ff2-8c7fd107b509 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:27.691493 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ec79fd93-8b81-4acb-9ff2-8c7fd107b509 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:27.711122 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ec79fd93-8b81-4acb-9ff2-8c7fd107b509 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1238 microversion: 2.1 time: 0.287106 Sep 10 11:46:27.715402 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 853/1797] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:27 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1238 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:46:27.721933 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-003c8dcb-bfc4-49ee-9425-87873e8798bb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:27.722742 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-003c8dcb-bfc4-49ee-9425-87873e8798bb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:27.736334 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-003c8dcb-bfc4-49ee-9425-87873e8798bb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:27.739598 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-003c8dcb-bfc4-49ee-9425-87873e8798bb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:27.740597 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-003c8dcb-bfc4-49ee-9425-87873e8798bb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:27.741843 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-003c8dcb-bfc4-49ee-9425-87873e8798bb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:27.742980 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-003c8dcb-bfc4-49ee-9425-87873e8798bb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:27.743856 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-003c8dcb-bfc4-49ee-9425-87873e8798bb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:28.029485 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-92087a01-27b7-466c-9bcf-c0249387cdee tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:28.058617 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-92087a01-27b7-466c-9bcf-c0249387cdee tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:28.066850 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-92087a01-27b7-466c-9bcf-c0249387cdee tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:28.068815 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-92087a01-27b7-466c-9bcf-c0249387cdee tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1486 microversion: 2.25 time: 0.994511 Sep 10 11:46:28.073234 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 945/1798] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:27 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1486 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:28.087507 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-08cfa82c-64a6-4688-b5da-758f5302d709 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:28.089602 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-08cfa82c-64a6-4688-b5da-758f5302d709 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:28.110892 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-08cfa82c-64a6-4688-b5da-758f5302d709 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:28.113322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-08cfa82c-64a6-4688-b5da-758f5302d709 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:28.115906 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-08cfa82c-64a6-4688-b5da-758f5302d709 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:28.118013 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-08cfa82c-64a6-4688-b5da-758f5302d709 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:28.118678 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-08cfa82c-64a6-4688-b5da-758f5302d709 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:28.123117 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-08cfa82c-64a6-4688-b5da-758f5302d709 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:28.936365 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-003c8dcb-bfc4-49ee-9425-87873e8798bb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:28.961802 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-08cfa82c-64a6-4688-b5da-758f5302d709 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:28.968441 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-003c8dcb-bfc4-49ee-9425-87873e8798bb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:28.970122 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-003c8dcb-bfc4-49ee-9425-87873e8798bb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:28.976554 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-08cfa82c-64a6-4688-b5da-758f5302d709 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 200 len: 1476 microversion: 2.1 time: 0.901842 Sep 10 11:46:28.977528 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 946/1799] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:28 2022] GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 1476 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:28.990683 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-003c8dcb-bfc4-49ee-9425-87873e8798bb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1887 microversion: 2.32 time: 1.254643 Sep 10 11:46:29.000005 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 854/1800] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:27 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1887 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:29.013995 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-ce911e8a-9644-4197-94eb-0f9171ef633a req-d54f3c6e-3d1a-464a-a751-e7c0c98bca34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a62a6c44-9d92-4766-a81d-c09670110ab4", "name": "network-vif-unplugged", "status": "completed", "tag": "2bd5dc49-b958-48da-8036-9f8348b0324b"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:46:29.019523 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-443cef25-a58b-425a-b4eb-9bf58e3b8bea tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:29.020822 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-443cef25-a58b-425a-b4eb-9bf58e3b8bea tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:29.028197 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-443cef25-a58b-425a-b4eb-9bf58e3b8bea tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:29.029422 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-443cef25-a58b-425a-b4eb-9bf58e3b8bea tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:29.030359 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-443cef25-a58b-425a-b4eb-9bf58e3b8bea tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:29.031393 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-443cef25-a58b-425a-b4eb-9bf58e3b8bea tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:29.032111 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-443cef25-a58b-425a-b4eb-9bf58e3b8bea tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:29.032755 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-443cef25-a58b-425a-b4eb-9bf58e3b8bea tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:29.053569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-ce911e8a-9644-4197-94eb-0f9171ef633a req-d54f3c6e-3d1a-464a-a751-e7c0c98bca34 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:29.054141 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-ce911e8a-9644-4197-94eb-0f9171ef633a req-d54f3c6e-3d1a-464a-a751-e7c0c98bca34 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:29.057866 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-ce911e8a-9644-4197-94eb-0f9171ef633a req-d54f3c6e-3d1a-464a-a751-e7c0c98bca34 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:29.077937 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-ce911e8a-9644-4197-94eb-0f9171ef633a req-d54f3c6e-3d1a-464a-a751-e7c0c98bca34 service nova] Creating event network-vif-unplugged:2bd5dc49-b958-48da-8036-9f8348b0324b for instance a62a6c44-9d92-4766-a81d-c09670110ab4 on n-h2-856895-1 Sep 10 11:46:29.085604 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-ce911e8a-9644-4197-94eb-0f9171ef633a req-d54f3c6e-3d1a-464a-a751-e7c0c98bca34 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106236 Sep 10 11:46:29.089708 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 947/1801] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:46:29.103605 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bebdc6da-b149-401e-8e75-df01244628ed tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:29.104699 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bebdc6da-b149-401e-8e75-df01244628ed tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:29.125245 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bebdc6da-b149-401e-8e75-df01244628ed tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:29.125975 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bebdc6da-b149-401e-8e75-df01244628ed tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:29.126687 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bebdc6da-b149-401e-8e75-df01244628ed tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:29.128559 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bebdc6da-b149-401e-8e75-df01244628ed tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:29.140871 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bebdc6da-b149-401e-8e75-df01244628ed tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:29.142239 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bebdc6da-b149-401e-8e75-df01244628ed tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:29.436283 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-443cef25-a58b-425a-b4eb-9bf58e3b8bea tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:29.462468 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-443cef25-a58b-425a-b4eb-9bf58e3b8bea tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1306 microversion: 2.1 time: 0.460726 Sep 10 11:46:29.465465 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 855/1802] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:29 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1306 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:29.478240 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-85b117c8-9acb-47e2-bad5-65a399ec86d6 req-91ba8bb3-1347-450a-a199-361d8c614013 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d86e1b80-a305-48c7-9c51-ef4175a5840c", "tag": "edef956a-da07-48ce-8164-a4f13ac10d0b"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:46:29.504579 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-85b117c8-9acb-47e2-bad5-65a399ec86d6 req-91ba8bb3-1347-450a-a199-361d8c614013 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:29.505640 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-85b117c8-9acb-47e2-bad5-65a399ec86d6 req-91ba8bb3-1347-450a-a199-361d8c614013 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:29.506295 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-85b117c8-9acb-47e2-bad5-65a399ec86d6 req-91ba8bb3-1347-450a-a199-361d8c614013 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:29.546068 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-85b117c8-9acb-47e2-bad5-65a399ec86d6 req-91ba8bb3-1347-450a-a199-361d8c614013 service nova] Creating event network-changed:edef956a-da07-48ce-8164-a4f13ac10d0b for instance d86e1b80-a305-48c7-9c51-ef4175a5840c on n-h2-856895-1 Sep 10 11:46:29.558026 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-85b117c8-9acb-47e2-bad5-65a399ec86d6 req-91ba8bb3-1347-450a-a199-361d8c614013 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090750 Sep 10 11:46:29.559003 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 856/1803] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:46:29.662077 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bebdc6da-b149-401e-8e75-df01244628ed tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:29.681882 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bebdc6da-b149-401e-8e75-df01244628ed tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:29.688500 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bebdc6da-b149-401e-8e75-df01244628ed tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:29.689872 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bebdc6da-b149-401e-8e75-df01244628ed tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1486 microversion: 2.25 time: 0.594900 Sep 10 11:46:29.691861 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 948/1804] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:29 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1486 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:30.009233 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0698fe59-25aa-4a7d-9fe4-3dde50cf309b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:30.010899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0698fe59-25aa-4a7d-9fe4-3dde50cf309b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:30.022500 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7657f5d5-7009-46b8-a734-c4aa870af71b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:30.023904 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0698fe59-25aa-4a7d-9fe4-3dde50cf309b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:30.025241 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0698fe59-25aa-4a7d-9fe4-3dde50cf309b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:30.025768 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0698fe59-25aa-4a7d-9fe4-3dde50cf309b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:30.026761 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0698fe59-25aa-4a7d-9fe4-3dde50cf309b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:30.027459 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0698fe59-25aa-4a7d-9fe4-3dde50cf309b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:30.027900 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0698fe59-25aa-4a7d-9fe4-3dde50cf309b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:30.034547 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7657f5d5-7009-46b8-a734-c4aa870af71b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:30.049986 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7657f5d5-7009-46b8-a734-c4aa870af71b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:30.055705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7657f5d5-7009-46b8-a734-c4aa870af71b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:30.056375 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7657f5d5-7009-46b8-a734-c4aa870af71b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:30.057357 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7657f5d5-7009-46b8-a734-c4aa870af71b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:30.058026 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7657f5d5-7009-46b8-a734-c4aa870af71b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:30.064464 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7657f5d5-7009-46b8-a734-c4aa870af71b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:30.473219 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0698fe59-25aa-4a7d-9fe4-3dde50cf309b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:30.487907 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0698fe59-25aa-4a7d-9fe4-3dde50cf309b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 200 len: 1476 microversion: 2.1 time: 0.485028 Sep 10 11:46:30.491372 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 857/1805] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:30 2022] GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 1476 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:30.500541 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4dc9b3a6-d26b-4a09-97e3-29ca216e89fc tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:30.501657 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4dc9b3a6-d26b-4a09-97e3-29ca216e89fc tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:30.518565 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4dc9b3a6-d26b-4a09-97e3-29ca216e89fc tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:30.519952 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4dc9b3a6-d26b-4a09-97e3-29ca216e89fc tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:30.520610 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4dc9b3a6-d26b-4a09-97e3-29ca216e89fc tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:30.521216 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7657f5d5-7009-46b8-a734-c4aa870af71b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:30.521987 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4dc9b3a6-d26b-4a09-97e3-29ca216e89fc tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:30.523435 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4dc9b3a6-d26b-4a09-97e3-29ca216e89fc tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:30.524646 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4dc9b3a6-d26b-4a09-97e3-29ca216e89fc tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:30.553694 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7657f5d5-7009-46b8-a734-c4aa870af71b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:30.558847 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7657f5d5-7009-46b8-a734-c4aa870af71b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:30.560569 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7657f5d5-7009-46b8-a734-c4aa870af71b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1887 microversion: 2.32 time: 0.542950 Sep 10 11:46:30.564108 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 949/1806] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:30 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1887 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:30.723885 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a83ab648-dd9b-4184-8a30-fc98f5af7c89 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:30.724888 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a83ab648-dd9b-4184-8a30-fc98f5af7c89 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:30.727974 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4dc9b3a6-d26b-4a09-97e3-29ca216e89fc tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:30.738714 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a83ab648-dd9b-4184-8a30-fc98f5af7c89 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:30.739542 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a83ab648-dd9b-4184-8a30-fc98f5af7c89 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:30.740455 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a83ab648-dd9b-4184-8a30-fc98f5af7c89 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:30.741211 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4dc9b3a6-d26b-4a09-97e3-29ca216e89fc tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1306 microversion: 2.1 time: 0.243991 Sep 10 11:46:30.741735 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a83ab648-dd9b-4184-8a30-fc98f5af7c89 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:30.742172 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 858/1807] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:30 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1306 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:30.743179 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a83ab648-dd9b-4184-8a30-fc98f5af7c89 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:30.743851 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a83ab648-dd9b-4184-8a30-fc98f5af7c89 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:30.805481 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:46:31.000337 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a83ab648-dd9b-4184-8a30-fc98f5af7c89 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:31.022798 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a83ab648-dd9b-4184-8a30-fc98f5af7c89 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:31.032325 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a83ab648-dd9b-4184-8a30-fc98f5af7c89 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:31.035798 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a83ab648-dd9b-4184-8a30-fc98f5af7c89 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1486 microversion: 2.25 time: 0.318099 Sep 10 11:46:31.057538 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 950/1808] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:30 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1486 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:31.115124 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-da6ffc71-209f-45a4-b4de-68db18959cd2 req-178745c6-0c4f-4767-a8e1-f2637d92d079 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a62a6c44-9d92-4766-a81d-c09670110ab4", "tag": "2bd5dc49-b958-48da-8036-9f8348b0324b"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:46:31.133908 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-da6ffc71-209f-45a4-b4de-68db18959cd2 req-178745c6-0c4f-4767-a8e1-f2637d92d079 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:31.134389 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-da6ffc71-209f-45a4-b4de-68db18959cd2 req-178745c6-0c4f-4767-a8e1-f2637d92d079 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:31.134827 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-da6ffc71-209f-45a4-b4de-68db18959cd2 req-178745c6-0c4f-4767-a8e1-f2637d92d079 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:31.152671 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-da6ffc71-209f-45a4-b4de-68db18959cd2 req-178745c6-0c4f-4767-a8e1-f2637d92d079 service nova] Creating event network-changed:2bd5dc49-b958-48da-8036-9f8348b0324b for instance a62a6c44-9d92-4766-a81d-c09670110ab4 on n-h2-856895-1 Sep 10 11:46:31.170847 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-da6ffc71-209f-45a4-b4de-68db18959cd2 req-178745c6-0c4f-4767-a8e1-f2637d92d079 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060915 Sep 10 11:46:31.171700 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 859/1809] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:46:31.519665 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ea56dfa9-b6b4-43b7-80f6-901f21466c04 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:31.520298 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ea56dfa9-b6b4-43b7-80f6-901f21466c04 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:31.533107 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea56dfa9-b6b4-43b7-80f6-901f21466c04 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:31.534409 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea56dfa9-b6b4-43b7-80f6-901f21466c04 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:31.535010 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea56dfa9-b6b4-43b7-80f6-901f21466c04 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:31.536204 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea56dfa9-b6b4-43b7-80f6-901f21466c04 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:31.539954 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea56dfa9-b6b4-43b7-80f6-901f21466c04 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:31.540581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea56dfa9-b6b4-43b7-80f6-901f21466c04 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:31.603805 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-13c4195b-846a-4e6e-9c99-81ad5c727caa tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:31.604532 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-13c4195b-846a-4e6e-9c99-81ad5c727caa tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:31.615687 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=12 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:46:31.629767 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13c4195b-846a-4e6e-9c99-81ad5c727caa tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:31.630441 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13c4195b-846a-4e6e-9c99-81ad5c727caa tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:31.631065 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13c4195b-846a-4e6e-9c99-81ad5c727caa tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:31.632804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13c4195b-846a-4e6e-9c99-81ad5c727caa tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:31.633515 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13c4195b-846a-4e6e-9c99-81ad5c727caa tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:31.634108 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13c4195b-846a-4e6e-9c99-81ad5c727caa tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:32.661629 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-13c4195b-846a-4e6e-9c99-81ad5c727caa tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:32.681244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-13c4195b-846a-4e6e-9c99-81ad5c727caa tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:32.682991 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-13c4195b-846a-4e6e-9c99-81ad5c727caa tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:32.703812 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-13c4195b-846a-4e6e-9c99-81ad5c727caa tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1887 microversion: 2.32 time: 1.107554 Sep 10 11:46:32.704851 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 860/1810] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:31 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1887 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:32.716289 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-a1461ee7-1770-421e-8529-bafd04fbffb6 req-89075eb9-3232-4d54-bcba-0f52ec8e12aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d4f7a57-fa07-41db-97de-a6fed43e9feb", "name": "network-vif-unplugged", "status": "completed", "tag": "7212ee8a-bd4e-4ab5-adbf-7906e0f409de"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:46:32.750508 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a1461ee7-1770-421e-8529-bafd04fbffb6 req-89075eb9-3232-4d54-bcba-0f52ec8e12aa service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:32.757442 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a1461ee7-1770-421e-8529-bafd04fbffb6 req-89075eb9-3232-4d54-bcba-0f52ec8e12aa service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:32.757927 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a1461ee7-1770-421e-8529-bafd04fbffb6 req-89075eb9-3232-4d54-bcba-0f52ec8e12aa service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:32.832976 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-a1461ee7-1770-421e-8529-bafd04fbffb6 req-89075eb9-3232-4d54-bcba-0f52ec8e12aa service nova] Creating event network-vif-unplugged:7212ee8a-bd4e-4ab5-adbf-7906e0f409de for instance 3d4f7a57-fa07-41db-97de-a6fed43e9feb on n-h1-856895-1 Sep 10 11:46:32.849697 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [req-a1461ee7-1770-421e-8529-bafd04fbffb6 req-89075eb9-3232-4d54-bcba-0f52ec8e12aa service nova] Instance 3d4f7a57-fa07-41db-97de-a6fed43e9feb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856895-1', 'n-h1-856895-1'} {{(pid=128776) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 11:46:32.882488 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-a1461ee7-1770-421e-8529-bafd04fbffb6 req-89075eb9-3232-4d54-bcba-0f52ec8e12aa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.176033 Sep 10 11:46:32.885532 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 861/1811] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:46:32.900034 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d255f3d0-608a-4265-ab65-d915fc779948 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:32.900773 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d255f3d0-608a-4265-ab65-d915fc779948 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:32.918120 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d255f3d0-608a-4265-ab65-d915fc779948 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:32.927152 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d255f3d0-608a-4265-ab65-d915fc779948 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:32.929513 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d255f3d0-608a-4265-ab65-d915fc779948 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:32.930453 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d255f3d0-608a-4265-ab65-d915fc779948 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:32.930921 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d255f3d0-608a-4265-ab65-d915fc779948 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:32.932054 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d255f3d0-608a-4265-ab65-d915fc779948 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:33.250927 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ea56dfa9-b6b4-43b7-80f6-901f21466c04 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:33.287907 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ea56dfa9-b6b4-43b7-80f6-901f21466c04 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 200 len: 1476 microversion: 2.1 time: 1.773175 Sep 10 11:46:33.289318 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 951/1812] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:31 2022] GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 1476 bytes in 1776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:33.298829 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f322b2a4-161b-45ef-82ec-fe02db73a45d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:33.300035 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f322b2a4-161b-45ef-82ec-fe02db73a45d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:33.308168 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f322b2a4-161b-45ef-82ec-fe02db73a45d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:33.309007 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f322b2a4-161b-45ef-82ec-fe02db73a45d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:33.309664 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f322b2a4-161b-45ef-82ec-fe02db73a45d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:33.310684 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f322b2a4-161b-45ef-82ec-fe02db73a45d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:33.311402 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f322b2a4-161b-45ef-82ec-fe02db73a45d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:33.312042 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f322b2a4-161b-45ef-82ec-fe02db73a45d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:33.617977 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d255f3d0-608a-4265-ab65-d915fc779948 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:33.627229 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d255f3d0-608a-4265-ab65-d915fc779948 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1306 microversion: 2.1 time: 0.740098 Sep 10 11:46:33.634103 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 862/1813] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:32 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1306 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:33.734826 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-79cc03e3-13ff-4c61-a0e4-ab886f26f7c6 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:33.736756 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-79cc03e3-13ff-4c61-a0e4-ab886f26f7c6 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:33.750896 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79cc03e3-13ff-4c61-a0e4-ab886f26f7c6 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:33.752567 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79cc03e3-13ff-4c61-a0e4-ab886f26f7c6 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:33.753736 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79cc03e3-13ff-4c61-a0e4-ab886f26f7c6 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:33.754636 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79cc03e3-13ff-4c61-a0e4-ab886f26f7c6 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:33.754947 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79cc03e3-13ff-4c61-a0e4-ab886f26f7c6 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:33.755407 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79cc03e3-13ff-4c61-a0e4-ab886f26f7c6 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:33.904999 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f322b2a4-161b-45ef-82ec-fe02db73a45d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:33.916666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f322b2a4-161b-45ef-82ec-fe02db73a45d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:33.921533 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f322b2a4-161b-45ef-82ec-fe02db73a45d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:33.927411 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f322b2a4-161b-45ef-82ec-fe02db73a45d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1486 microversion: 2.25 time: 0.636230 Sep 10 11:46:33.932402 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 952/1814] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:33 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1486 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:34.299481 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-79cc03e3-13ff-4c61-a0e4-ab886f26f7c6 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:34.302091 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:46:34.322047 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-79cc03e3-13ff-4c61-a0e4-ab886f26f7c6 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:34.324053 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-79cc03e3-13ff-4c61-a0e4-ab886f26f7c6 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:34.328243 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-79cc03e3-13ff-4c61-a0e4-ab886f26f7c6 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1887 microversion: 2.32 time: 0.598735 Sep 10 11:46:34.331536 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 863/1815] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:33 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1887 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:34.338990 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-42610e20-fdbd-4a6b-8b1f-7a1bedf06c8c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:34.348553 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-42610e20-fdbd-4a6b-8b1f-7a1bedf06c8c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:34.358061 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42610e20-fdbd-4a6b-8b1f-7a1bedf06c8c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:34.360943 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42610e20-fdbd-4a6b-8b1f-7a1bedf06c8c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:34.361519 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42610e20-fdbd-4a6b-8b1f-7a1bedf06c8c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:34.362865 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42610e20-fdbd-4a6b-8b1f-7a1bedf06c8c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:34.367917 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42610e20-fdbd-4a6b-8b1f-7a1bedf06c8c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:34.368559 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42610e20-fdbd-4a6b-8b1f-7a1bedf06c8c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:34.465077 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-69261e13-9b79-41ed-b6a7-89e96d7b20c8 tempest-QuotaClassesAdminTestJSON-156623959 tempest-QuotaClassesAdminTestJSON-156623959-project-admin] Calling method '.version_select at 0x7f407325cee0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:34.494075 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-69261e13-9b79-41ed-b6a7-89e96d7b20c8 tempest-QuotaClassesAdminTestJSON-156623959 tempest-QuotaClassesAdminTestJSON-156623959-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.337189 Sep 10 11:46:34.495138 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 953/1816] 10.222.0.23 () {58 vars in 1185 bytes} [Sat Sep 10 11:46:34 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:46:34.512177 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-62016cd0-6f2c-400e-b85a-8a3078087a86 tempest-QuotaClassesAdminTestJSON-156623959 tempest-QuotaClassesAdminTestJSON-156623959-project-admin] Action: 'update', calling method: .version_select at 0x7f40732be430>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:46:34.620138 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-42610e20-fdbd-4a6b-8b1f-7a1bedf06c8c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:34.629757 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-42610e20-fdbd-4a6b-8b1f-7a1bedf06c8c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 200 len: 1474 microversion: 2.1 time: 0.296957 Sep 10 11:46:34.632368 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 864/1817] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:34 2022] GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 1474 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:34.660949 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-26a74d1d-150a-402d-84e1-eb786787b617 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:34.665359 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-26a74d1d-150a-402d-84e1-eb786787b617 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:34.680562 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-26a74d1d-150a-402d-84e1-eb786787b617 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:34.682001 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-26a74d1d-150a-402d-84e1-eb786787b617 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:34.682472 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-26a74d1d-150a-402d-84e1-eb786787b617 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:34.685504 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-26a74d1d-150a-402d-84e1-eb786787b617 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:34.686007 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-26a74d1d-150a-402d-84e1-eb786787b617 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:34.689269 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-26a74d1d-150a-402d-84e1-eb786787b617 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:34.903958 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-62016cd0-6f2c-400e-b85a-8a3078087a86 tempest-QuotaClassesAdminTestJSON-156623959 tempest-QuotaClassesAdminTestJSON-156623959-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.395411 Sep 10 11:46:34.905072 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 954/1818] 10.222.0.23 () {60 vars in 1206 bytes} [Sat Sep 10 11:46:34 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:46:34.920105 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-894c9dd1-0033-4186-9b5d-b189a461037a tempest-QuotaClassesAdminTestJSON-156623959 tempest-QuotaClassesAdminTestJSON-156623959-project-admin] Calling method '.version_select at 0x7f407b5a78b0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:34.933461 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-894c9dd1-0033-4186-9b5d-b189a461037a tempest-QuotaClassesAdminTestJSON-156623959 tempest-QuotaClassesAdminTestJSON-156623959-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.020430 Sep 10 11:46:34.934611 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 955/1819] 10.222.0.23 () {58 vars in 1185 bytes} [Sat Sep 10 11:46:34 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:46:34.939524 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-4bc93634-5913-4555-bebc-33c958bbcebe req-fba5ecd5-6104-4da5-a552-d1995d0d3e42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d4f7a57-fa07-41db-97de-a6fed43e9feb", "tag": "7212ee8a-bd4e-4ab5-adbf-7906e0f409de"}, {"name": "network-changed", "server_uuid": "d54e6606-e731-472f-a828-0b2778a3b642", "tag": "8d303678-6914-42c7-92b8-39a1591b74c9"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:46:34.949472 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-26a74d1d-150a-402d-84e1-eb786787b617 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:34.953911 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-4bc93634-5913-4555-bebc-33c958bbcebe req-fba5ecd5-6104-4da5-a552-d1995d0d3e42 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:34.954918 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-4bc93634-5913-4555-bebc-33c958bbcebe req-fba5ecd5-6104-4da5-a552-d1995d0d3e42 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:34.956613 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-4bc93634-5913-4555-bebc-33c958bbcebe req-fba5ecd5-6104-4da5-a552-d1995d0d3e42 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:34.965217 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-26a74d1d-150a-402d-84e1-eb786787b617 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1306 microversion: 2.1 time: 0.316761 Sep 10 11:46:34.969701 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 865/1820] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:34 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1306 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:34.973796 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-4bc93634-5913-4555-bebc-33c958bbcebe req-fba5ecd5-6104-4da5-a552-d1995d0d3e42 service nova] Creating event network-changed:7212ee8a-bd4e-4ab5-adbf-7906e0f409de for instance 3d4f7a57-fa07-41db-97de-a6fed43e9feb on n-h1-856895-1 Sep 10 11:46:34.974702 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-4bc93634-5913-4555-bebc-33c958bbcebe req-fba5ecd5-6104-4da5-a552-d1995d0d3e42 service nova] Creating event network-changed:8d303678-6914-42c7-92b8-39a1591b74c9 for instance d54e6606-e731-472f-a828-0b2778a3b642 on n-h1-856895-1 Sep 10 11:46:34.975617 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-19d22b04-fef9-44f3-aa31-824fd3eb2f2e tempest-QuotaClassesAdminTestJSON-156623959 tempest-QuotaClassesAdminTestJSON-156623959-project-admin] Action: 'update', calling method: .version_select at 0x7f40734c4670>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:46:34.982185 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [req-4bc93634-5913-4555-bebc-33c958bbcebe req-fba5ecd5-6104-4da5-a552-d1995d0d3e42 service nova] Instance 3d4f7a57-fa07-41db-97de-a6fed43e9feb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856895-1', 'n-h1-856895-1'} {{(pid=128777) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 11:46:34.998994 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-4bc93634-5913-4555-bebc-33c958bbcebe req-fba5ecd5-6104-4da5-a552-d1995d0d3e42 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.062799 Sep 10 11:46:35.000255 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 956/1821] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:46:35.007342 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8c52276c-9250-4936-a3eb-39c375c989a0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:35.008341 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8c52276c-9250-4936-a3eb-39c375c989a0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:35.016848 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c52276c-9250-4936-a3eb-39c375c989a0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:35.017715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c52276c-9250-4936-a3eb-39c375c989a0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:35.019150 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c52276c-9250-4936-a3eb-39c375c989a0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:35.020228 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c52276c-9250-4936-a3eb-39c375c989a0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:35.020961 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c52276c-9250-4936-a3eb-39c375c989a0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:35.021707 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c52276c-9250-4936-a3eb-39c375c989a0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:35.173791 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-19d22b04-fef9-44f3-aa31-824fd3eb2f2e tempest-QuotaClassesAdminTestJSON-156623959 tempest-QuotaClassesAdminTestJSON-156623959-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.202654 Sep 10 11:46:35.189475 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 866/1822] 10.222.0.23 () {60 vars in 1206 bytes} [Sat Sep 10 11:46:34 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:46:35.379906 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bcbdcb2d-a4cc-45a8-84aa-ac0bac8a467a tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:35.380625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bcbdcb2d-a4cc-45a8-84aa-ac0bac8a467a tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:35.400698 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bcbdcb2d-a4cc-45a8-84aa-ac0bac8a467a tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:35.401422 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bcbdcb2d-a4cc-45a8-84aa-ac0bac8a467a tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:35.401999 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bcbdcb2d-a4cc-45a8-84aa-ac0bac8a467a tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:35.402804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bcbdcb2d-a4cc-45a8-84aa-ac0bac8a467a tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:35.404056 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bcbdcb2d-a4cc-45a8-84aa-ac0bac8a467a tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:35.404596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bcbdcb2d-a4cc-45a8-84aa-ac0bac8a467a tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:35.458691 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8c52276c-9250-4936-a3eb-39c375c989a0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:35.468695 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8c52276c-9250-4936-a3eb-39c375c989a0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:35.470915 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8c52276c-9250-4936-a3eb-39c375c989a0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:35.473249 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8c52276c-9250-4936-a3eb-39c375c989a0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1486 microversion: 2.25 time: 0.471581 Sep 10 11:46:35.474374 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 957/1823] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:35 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1486 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:35.657859 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f97b54a4-f33b-4811-8d4d-578036e303a2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:35.658463 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f97b54a4-f33b-4811-8d4d-578036e303a2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:35.674150 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f97b54a4-f33b-4811-8d4d-578036e303a2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:35.675125 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f97b54a4-f33b-4811-8d4d-578036e303a2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:35.675810 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f97b54a4-f33b-4811-8d4d-578036e303a2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:35.676678 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f97b54a4-f33b-4811-8d4d-578036e303a2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:35.677278 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f97b54a4-f33b-4811-8d4d-578036e303a2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:35.677848 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f97b54a4-f33b-4811-8d4d-578036e303a2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:36.339410 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bcbdcb2d-a4cc-45a8-84aa-ac0bac8a467a tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:36.351082 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bcbdcb2d-a4cc-45a8-84aa-ac0bac8a467a tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:36.353778 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bcbdcb2d-a4cc-45a8-84aa-ac0bac8a467a tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:36.355262 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bcbdcb2d-a4cc-45a8-84aa-ac0bac8a467a tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1887 microversion: 2.32 time: 0.980999 Sep 10 11:46:36.356359 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 867/1824] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:35 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1887 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:36.363395 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3a4db422-0c8f-43dd-8866-aae1e596a622 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:36.365030 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3a4db422-0c8f-43dd-8866-aae1e596a622 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:36.379280 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3a4db422-0c8f-43dd-8866-aae1e596a622 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:36.380183 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3a4db422-0c8f-43dd-8866-aae1e596a622 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:36.380847 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3a4db422-0c8f-43dd-8866-aae1e596a622 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:36.381903 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3a4db422-0c8f-43dd-8866-aae1e596a622 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:36.382551 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3a4db422-0c8f-43dd-8866-aae1e596a622 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:36.383446 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3a4db422-0c8f-43dd-8866-aae1e596a622 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:36.403609 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f97b54a4-f33b-4811-8d4d-578036e303a2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:36.407399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:46:36.413510 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f97b54a4-f33b-4811-8d4d-578036e303a2 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 200 len: 1474 microversion: 2.1 time: 0.759727 Sep 10 11:46:36.427966 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 958/1825] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:35 2022] GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 1474 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:36.505189 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-94c629d9-f3d2-4ff4-8263-96a4e9ecb654 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:36.505873 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-94c629d9-f3d2-4ff4-8263-96a4e9ecb654 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:36.514168 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94c629d9-f3d2-4ff4-8263-96a4e9ecb654 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:36.514659 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94c629d9-f3d2-4ff4-8263-96a4e9ecb654 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:36.515095 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94c629d9-f3d2-4ff4-8263-96a4e9ecb654 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:36.516049 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94c629d9-f3d2-4ff4-8263-96a4e9ecb654 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:36.516494 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94c629d9-f3d2-4ff4-8263-96a4e9ecb654 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:36.517275 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94c629d9-f3d2-4ff4-8263-96a4e9ecb654 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:36.765423 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3a4db422-0c8f-43dd-8866-aae1e596a622 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:36.775542 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3a4db422-0c8f-43dd-8866-aae1e596a622 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1306 microversion: 2.1 time: 0.416648 Sep 10 11:46:36.776489 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 868/1826] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:36 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1306 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:36.927475 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-94c629d9-f3d2-4ff4-8263-96a4e9ecb654 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:36.948088 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-94c629d9-f3d2-4ff4-8263-96a4e9ecb654 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:36.950994 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-94c629d9-f3d2-4ff4-8263-96a4e9ecb654 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:36.953764 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-94c629d9-f3d2-4ff4-8263-96a4e9ecb654 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1486 microversion: 2.25 time: 0.452995 Sep 10 11:46:36.957053 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 959/1827] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:36 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1486 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:46:37.383692 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ac61c558-bfc5-4adf-8c15-3d53f21044eb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:37.384909 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ac61c558-bfc5-4adf-8c15-3d53f21044eb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:37.400937 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac61c558-bfc5-4adf-8c15-3d53f21044eb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:37.401473 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac61c558-bfc5-4adf-8c15-3d53f21044eb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:37.401853 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac61c558-bfc5-4adf-8c15-3d53f21044eb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:37.402574 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac61c558-bfc5-4adf-8c15-3d53f21044eb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:37.403074 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac61c558-bfc5-4adf-8c15-3d53f21044eb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:37.403538 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac61c558-bfc5-4adf-8c15-3d53f21044eb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:37.454990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c05b1284-128c-4e43-a3a9-448283d9ef29 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:37.457121 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c05b1284-128c-4e43-a3a9-448283d9ef29 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:37.470251 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c05b1284-128c-4e43-a3a9-448283d9ef29 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:37.472421 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c05b1284-128c-4e43-a3a9-448283d9ef29 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:37.477070 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c05b1284-128c-4e43-a3a9-448283d9ef29 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:37.478073 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c05b1284-128c-4e43-a3a9-448283d9ef29 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:37.478762 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c05b1284-128c-4e43-a3a9-448283d9ef29 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:37.480479 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c05b1284-128c-4e43-a3a9-448283d9ef29 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:38.420398 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ac61c558-bfc5-4adf-8c15-3d53f21044eb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:38.433010 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ac61c558-bfc5-4adf-8c15-3d53f21044eb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:38.446282 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ac61c558-bfc5-4adf-8c15-3d53f21044eb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:38.447784 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ac61c558-bfc5-4adf-8c15-3d53f21044eb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1875 microversion: 2.32 time: 1.068553 Sep 10 11:46:38.449337 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 869/1828] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:37 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1875 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:38.467420 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9c41d6ce-693f-4f1b-9579-ba48d7f0567d tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:38.468173 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9c41d6ce-693f-4f1b-9579-ba48d7f0567d tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:38.482778 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c41d6ce-693f-4f1b-9579-ba48d7f0567d tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:38.483515 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c41d6ce-693f-4f1b-9579-ba48d7f0567d tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:38.484149 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c41d6ce-693f-4f1b-9579-ba48d7f0567d tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:38.487842 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c41d6ce-693f-4f1b-9579-ba48d7f0567d tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:38.489303 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c41d6ce-693f-4f1b-9579-ba48d7f0567d tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:38.489303 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c41d6ce-693f-4f1b-9579-ba48d7f0567d tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:38.651195 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c05b1284-128c-4e43-a3a9-448283d9ef29 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:38.663344 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c05b1284-128c-4e43-a3a9-448283d9ef29 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 200 len: 1474 microversion: 2.1 time: 1.212360 Sep 10 11:46:38.664365 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 960/1829] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:37 2022] GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 1474 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:38.679901 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d9fd0eec-3aa4-48c4-b9bb-2e58a0cd032a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:38.680557 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d9fd0eec-3aa4-48c4-b9bb-2e58a0cd032a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:38.696397 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d9fd0eec-3aa4-48c4-b9bb-2e58a0cd032a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:38.699736 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d9fd0eec-3aa4-48c4-b9bb-2e58a0cd032a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:38.700505 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d9fd0eec-3aa4-48c4-b9bb-2e58a0cd032a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:38.706611 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9c41d6ce-693f-4f1b-9579-ba48d7f0567d tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:38.712247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d9fd0eec-3aa4-48c4-b9bb-2e58a0cd032a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:38.712835 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d9fd0eec-3aa4-48c4-b9bb-2e58a0cd032a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:38.713466 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d9fd0eec-3aa4-48c4-b9bb-2e58a0cd032a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:38.715135 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9c41d6ce-693f-4f1b-9579-ba48d7f0567d tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1306 microversion: 2.1 time: 0.264057 Sep 10 11:46:38.736016 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 870/1830] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:38 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1306 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:39.035911 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d9fd0eec-3aa4-48c4-b9bb-2e58a0cd032a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:39.053605 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d9fd0eec-3aa4-48c4-b9bb-2e58a0cd032a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:39.055569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d9fd0eec-3aa4-48c4-b9bb-2e58a0cd032a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:39.056956 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d9fd0eec-3aa4-48c4-b9bb-2e58a0cd032a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1486 microversion: 2.25 time: 0.388080 Sep 10 11:46:39.058496 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 961/1831] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:38 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1486 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:39.476592 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a618982d-0097-4c56-a736-b380f44ec4a2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:39.477770 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a618982d-0097-4c56-a736-b380f44ec4a2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:39.487287 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a618982d-0097-4c56-a736-b380f44ec4a2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:39.490451 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a618982d-0097-4c56-a736-b380f44ec4a2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:39.492469 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a618982d-0097-4c56-a736-b380f44ec4a2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:39.493657 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a618982d-0097-4c56-a736-b380f44ec4a2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:39.494431 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a618982d-0097-4c56-a736-b380f44ec4a2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:39.495918 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a618982d-0097-4c56-a736-b380f44ec4a2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:39.691589 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f4947bed-33d7-45a6-993e-c14e351a1e99 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:39.692370 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f4947bed-33d7-45a6-993e-c14e351a1e99 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:39.701388 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f4947bed-33d7-45a6-993e-c14e351a1e99 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:39.702532 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f4947bed-33d7-45a6-993e-c14e351a1e99 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:39.703493 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f4947bed-33d7-45a6-993e-c14e351a1e99 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:39.704731 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f4947bed-33d7-45a6-993e-c14e351a1e99 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:39.705666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f4947bed-33d7-45a6-993e-c14e351a1e99 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:39.706314 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f4947bed-33d7-45a6-993e-c14e351a1e99 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:39.930667 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f4947bed-33d7-45a6-993e-c14e351a1e99 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:39.941181 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f4947bed-33d7-45a6-993e-c14e351a1e99 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 200 len: 1471 microversion: 2.1 time: 0.254669 Sep 10 11:46:39.956231 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 962/1832] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:39 2022] GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 1471 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:39.976600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a618982d-0097-4c56-a736-b380f44ec4a2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:39.990902 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9f65e0e1-41d4-42df-b5f0-1deb8ded7f15 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:39.995492 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9f65e0e1-41d4-42df-b5f0-1deb8ded7f15 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:40.013267 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a618982d-0097-4c56-a736-b380f44ec4a2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:40.017381 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9f65e0e1-41d4-42df-b5f0-1deb8ded7f15 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:40.018714 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9f65e0e1-41d4-42df-b5f0-1deb8ded7f15 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:40.019470 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9f65e0e1-41d4-42df-b5f0-1deb8ded7f15 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:40.020441 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a618982d-0097-4c56-a736-b380f44ec4a2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:40.023631 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a618982d-0097-4c56-a736-b380f44ec4a2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1875 microversion: 2.32 time: 0.550730 Sep 10 11:46:40.024104 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9f65e0e1-41d4-42df-b5f0-1deb8ded7f15 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:40.024600 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9f65e0e1-41d4-42df-b5f0-1deb8ded7f15 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:40.026019 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9f65e0e1-41d4-42df-b5f0-1deb8ded7f15 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:40.039203 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 871/1833] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:39 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1875 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:40.040201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2afa510d-f244-493d-bc38-ec7c5d865e48 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:46:40.042362 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2afa510d-f244-493d-bc38-ec7c5d865e48 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:40.062395 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2afa510d-f244-493d-bc38-ec7c5d865e48 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:40.063733 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2afa510d-f244-493d-bc38-ec7c5d865e48 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:40.065978 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2afa510d-f244-493d-bc38-ec7c5d865e48 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:40.068187 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2afa510d-f244-493d-bc38-ec7c5d865e48 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:40.070698 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2afa510d-f244-493d-bc38-ec7c5d865e48 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:40.071614 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2afa510d-f244-493d-bc38-ec7c5d865e48 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:40.325519 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9f65e0e1-41d4-42df-b5f0-1deb8ded7f15 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:40.336252 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9f65e0e1-41d4-42df-b5f0-1deb8ded7f15 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1306 microversion: 2.1 time: 0.378211 Sep 10 11:46:40.336845 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 963/1834] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:39 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1306 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:40.341902 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a5e739ec-082d-4b47-a621-27b078a6b82f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:40.342776 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a5e739ec-082d-4b47-a621-27b078a6b82f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:40.351665 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5e739ec-082d-4b47-a621-27b078a6b82f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:40.352409 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5e739ec-082d-4b47-a621-27b078a6b82f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:40.353567 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5e739ec-082d-4b47-a621-27b078a6b82f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:40.354577 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5e739ec-082d-4b47-a621-27b078a6b82f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:40.363281 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5e739ec-082d-4b47-a621-27b078a6b82f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:40.364551 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5e739ec-082d-4b47-a621-27b078a6b82f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:40.427094 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2afa510d-f244-493d-bc38-ec7c5d865e48 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "POST /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb/action" status: 202 len: 0 microversion: 2.1 time: 0.397936 Sep 10 11:46:40.434015 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 872/1835] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:46:40 2022] POST /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb/action => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:46:40.441102 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-13224e8c-03eb-45dc-b0ca-41713fb71386 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:40.460127 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-13224e8c-03eb-45dc-b0ca-41713fb71386 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:40.474996 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13224e8c-03eb-45dc-b0ca-41713fb71386 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:40.477895 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13224e8c-03eb-45dc-b0ca-41713fb71386 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:40.479029 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13224e8c-03eb-45dc-b0ca-41713fb71386 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:40.481378 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13224e8c-03eb-45dc-b0ca-41713fb71386 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:40.486104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13224e8c-03eb-45dc-b0ca-41713fb71386 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:40.487292 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13224e8c-03eb-45dc-b0ca-41713fb71386 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:40.763957 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a5e739ec-082d-4b47-a621-27b078a6b82f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:40.784515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a5e739ec-082d-4b47-a621-27b078a6b82f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:40.790216 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a5e739ec-082d-4b47-a621-27b078a6b82f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:40.791481 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a5e739ec-082d-4b47-a621-27b078a6b82f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1486 microversion: 2.25 time: 0.453402 Sep 10 11:46:40.794121 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 964/1836] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:40 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1486 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:40.842371 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-13224e8c-03eb-45dc-b0ca-41713fb71386 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:40.870432 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-13224e8c-03eb-45dc-b0ca-41713fb71386 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 200 len: 1470 microversion: 2.1 time: 0.433316 Sep 10 11:46:40.872420 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 873/1837] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:40 2022] GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 1470 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:41.063035 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-80583c9c-8221-4030-923b-3cb11b2c32e8 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:41.063674 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-80583c9c-8221-4030-923b-3cb11b2c32e8 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:41.074660 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-80583c9c-8221-4030-923b-3cb11b2c32e8 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:41.087938 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-80583c9c-8221-4030-923b-3cb11b2c32e8 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:41.088615 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-80583c9c-8221-4030-923b-3cb11b2c32e8 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:41.089550 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-80583c9c-8221-4030-923b-3cb11b2c32e8 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:41.090175 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-80583c9c-8221-4030-923b-3cb11b2c32e8 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:41.090758 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-80583c9c-8221-4030-923b-3cb11b2c32e8 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:41.442182 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4308ecb6-043b-4aba-9f05-6a4c8820bc19 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-637662224", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:46:41.523368 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-4308ecb6-043b-4aba-9f05-6a4c8820bc19 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] validate_networks() for None {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:46:41.536747 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-80583c9c-8221-4030-923b-3cb11b2c32e8 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:41.573508 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-80583c9c-8221-4030-923b-3cb11b2c32e8 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:41.575287 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-80583c9c-8221-4030-923b-3cb11b2c32e8 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:41.576726 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-80583c9c-8221-4030-923b-3cb11b2c32e8 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1875 microversion: 2.32 time: 0.517924 Sep 10 11:46:41.582868 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 965/1838] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:41 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1875 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:41.595589 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-78ac7803-c8d3-4520-992b-52ce75e5d17c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:41.596811 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-78ac7803-c8d3-4520-992b-52ce75e5d17c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:41.613480 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78ac7803-c8d3-4520-992b-52ce75e5d17c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:41.614304 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78ac7803-c8d3-4520-992b-52ce75e5d17c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:41.616742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78ac7803-c8d3-4520-992b-52ce75e5d17c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:41.619726 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78ac7803-c8d3-4520-992b-52ce75e5d17c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:41.620499 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78ac7803-c8d3-4520-992b-52ce75e5d17c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:41.623803 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78ac7803-c8d3-4520-992b-52ce75e5d17c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:42.141053 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-78ac7803-c8d3-4520-992b-52ce75e5d17c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:42.155289 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-78ac7803-c8d3-4520-992b-52ce75e5d17c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1306 microversion: 2.1 time: 0.570455 Sep 10 11:46:42.156178 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 966/1839] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:41 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1306 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:42.170652 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-dba2e6e3-a818-4d75-9e96-7945a516509f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:42.172217 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-dba2e6e3-a818-4d75-9e96-7945a516509f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:42.188168 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dba2e6e3-a818-4d75-9e96-7945a516509f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:42.189282 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dba2e6e3-a818-4d75-9e96-7945a516509f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:42.190589 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dba2e6e3-a818-4d75-9e96-7945a516509f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:42.191974 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dba2e6e3-a818-4d75-9e96-7945a516509f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:42.192914 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dba2e6e3-a818-4d75-9e96-7945a516509f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:42.193812 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dba2e6e3-a818-4d75-9e96-7945a516509f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:42.219736 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-4308ecb6-043b-4aba-9f05-6a4c8820bc19 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:46:42.220381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-4308ecb6-043b-4aba-9f05-6a4c8820bc19 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:46:42.221057 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-4308ecb6-043b-4aba-9f05-6a4c8820bc19 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:46:42.221862 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-4308ecb6-043b-4aba-9f05-6a4c8820bc19 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:46:42.222613 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-4308ecb6-043b-4aba-9f05-6a4c8820bc19 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:46:42.250541 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4308ecb6-043b-4aba-9f05-6a4c8820bc19 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:42.251032 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4308ecb6-043b-4aba-9f05-6a4c8820bc19 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:42.254549 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4308ecb6-043b-4aba-9f05-6a4c8820bc19 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:42.255659 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4308ecb6-043b-4aba-9f05-6a4c8820bc19 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:42.259842 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4308ecb6-043b-4aba-9f05-6a4c8820bc19 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:42.260485 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4308ecb6-043b-4aba-9f05-6a4c8820bc19 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:42.314825 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-4308ecb6-043b-4aba-9f05-6a4c8820bc19 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Getting quotas for project 5949225a72e649c1adc217d5a760460a. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:46:42.321527 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-4308ecb6-043b-4aba-9f05-6a4c8820bc19 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Getting quotas for user dfc33eb8645248f9b154587e7d8d449e and project 5949225a72e649c1adc217d5a760460a. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:46:42.355151 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4308ecb6-043b-4aba-9f05-6a4c8820bc19 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:46:42.357988 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4308ecb6-043b-4aba-9f05-6a4c8820bc19 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d89db381-1e9d-40ee-b076-b024d38d38b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:46:42.435412 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4308ecb6-043b-4aba-9f05-6a4c8820bc19 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.167264 Sep 10 11:46:42.437454 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 874/1840] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:46:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:46:42.446306 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-49cccee8-03c4-4bc2-83d9-4962fa09aff4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:42.447423 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-49cccee8-03c4-4bc2-83d9-4962fa09aff4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:42.459478 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-49cccee8-03c4-4bc2-83d9-4962fa09aff4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:42.460306 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-49cccee8-03c4-4bc2-83d9-4962fa09aff4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:42.461155 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-49cccee8-03c4-4bc2-83d9-4962fa09aff4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:42.463036 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-49cccee8-03c4-4bc2-83d9-4962fa09aff4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:42.464383 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-49cccee8-03c4-4bc2-83d9-4962fa09aff4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:42.464967 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-49cccee8-03c4-4bc2-83d9-4962fa09aff4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:42.483458 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-dba2e6e3-a818-4d75-9e96-7945a516509f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:42.498667 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-dba2e6e3-a818-4d75-9e96-7945a516509f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:42.500728 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-dba2e6e3-a818-4d75-9e96-7945a516509f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:42.503261 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-dba2e6e3-a818-4d75-9e96-7945a516509f tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1486 microversion: 2.25 time: 0.344912 Sep 10 11:46:42.519733 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 967/1841] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:42 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1486 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:42.539806 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-708e1e46-0290-472d-b567-f6e934c60a63 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:42.542844 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-708e1e46-0290-472d-b567-f6e934c60a63 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d89db381-1e9d-40ee-b076-b024d38d38b1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:42.644779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-708e1e46-0290-472d-b567-f6e934c60a63 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:42.654550 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-708e1e46-0290-472d-b567-f6e934c60a63 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1" status: 200 len: 1216 microversion: 2.1 time: 0.133354 Sep 10 11:46:42.655181 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 968/1842] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:42 2022] GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1 => generated 1216 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:42.668368 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b6a90b5c-fa9d-4556-b2d1-5e2c25f86a4b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:42.670189 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b6a90b5c-fa9d-4556-b2d1-5e2c25f86a4b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:42.673901 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=12,nova_api:INSERT=7 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:46:42.693647 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b6a90b5c-fa9d-4556-b2d1-5e2c25f86a4b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:42.695042 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b6a90b5c-fa9d-4556-b2d1-5e2c25f86a4b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:42.696238 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b6a90b5c-fa9d-4556-b2d1-5e2c25f86a4b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:42.696998 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b6a90b5c-fa9d-4556-b2d1-5e2c25f86a4b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:42.699295 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b6a90b5c-fa9d-4556-b2d1-5e2c25f86a4b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:42.701103 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b6a90b5c-fa9d-4556-b2d1-5e2c25f86a4b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:42.763455 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-49cccee8-03c4-4bc2-83d9-4962fa09aff4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:42.777345 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-49cccee8-03c4-4bc2-83d9-4962fa09aff4 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 200 len: 1470 microversion: 2.1 time: 0.338357 Sep 10 11:46:42.794171 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 875/1843] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:42 2022] GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 1470 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:43.003523 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b6a90b5c-fa9d-4556-b2d1-5e2c25f86a4b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:43.019062 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b6a90b5c-fa9d-4556-b2d1-5e2c25f86a4b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:43.022094 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b6a90b5c-fa9d-4556-b2d1-5e2c25f86a4b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:43.024176 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b6a90b5c-fa9d-4556-b2d1-5e2c25f86a4b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1875 microversion: 2.32 time: 0.363355 Sep 10 11:46:43.043551 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 969/1844] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:42 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1875 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:43.180955 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0bd5e14e-391e-442a-9267-552812781b4f tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:43.181605 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0bd5e14e-391e-442a-9267-552812781b4f tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:43.196640 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0bd5e14e-391e-442a-9267-552812781b4f tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:43.197460 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0bd5e14e-391e-442a-9267-552812781b4f tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:43.198333 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0bd5e14e-391e-442a-9267-552812781b4f tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:43.199269 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0bd5e14e-391e-442a-9267-552812781b4f tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:43.199754 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0bd5e14e-391e-442a-9267-552812781b4f tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:43.200251 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0bd5e14e-391e-442a-9267-552812781b4f tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:43.367792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6135c969-39ee-4ad0-8502-f3c3cbd7fd34 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:43.370502 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6135c969-39ee-4ad0-8502-f3c3cbd7fd34 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:43.382430 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6135c969-39ee-4ad0-8502-f3c3cbd7fd34 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:43.383603 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0bd5e14e-391e-442a-9267-552812781b4f tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:43.386309 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6135c969-39ee-4ad0-8502-f3c3cbd7fd34 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:43.390953 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6135c969-39ee-4ad0-8502-f3c3cbd7fd34 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:43.392751 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6135c969-39ee-4ad0-8502-f3c3cbd7fd34 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:43.394691 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6135c969-39ee-4ad0-8502-f3c3cbd7fd34 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:43.395111 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0bd5e14e-391e-442a-9267-552812781b4f tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1306 microversion: 2.1 time: 0.218269 Sep 10 11:46:43.395807 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6135c969-39ee-4ad0-8502-f3c3cbd7fd34 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:43.396143 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 876/1845] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:43 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1306 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:43.535962 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-75edcfdb-a166-43b1-a3c7-ba7c6fb68555 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:43.536591 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-75edcfdb-a166-43b1-a3c7-ba7c6fb68555 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:43.539066 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=12,nova_api:INSERT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:46:43.556032 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75edcfdb-a166-43b1-a3c7-ba7c6fb68555 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:43.556580 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75edcfdb-a166-43b1-a3c7-ba7c6fb68555 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:43.557243 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75edcfdb-a166-43b1-a3c7-ba7c6fb68555 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:43.557975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75edcfdb-a166-43b1-a3c7-ba7c6fb68555 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:43.558435 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75edcfdb-a166-43b1-a3c7-ba7c6fb68555 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:43.558870 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75edcfdb-a166-43b1-a3c7-ba7c6fb68555 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:43.658554 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6135c969-39ee-4ad0-8502-f3c3cbd7fd34 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:43.677290 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6135c969-39ee-4ad0-8502-f3c3cbd7fd34 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:43.680580 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6135c969-39ee-4ad0-8502-f3c3cbd7fd34 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:43.683623 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6135c969-39ee-4ad0-8502-f3c3cbd7fd34 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 2956 microversion: 2.42 time: 0.322726 Sep 10 11:46:43.684719 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 970/1846] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:43 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 2956 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:43.702344 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0a608c60-a8e7-486a-9a65-f6a8d74257e9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:43.703894 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0a608c60-a8e7-486a-9a65-f6a8d74257e9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d89db381-1e9d-40ee-b076-b024d38d38b1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:43.738723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a608c60-a8e7-486a-9a65-f6a8d74257e9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:43.743659 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a608c60-a8e7-486a-9a65-f6a8d74257e9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:43.744797 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a608c60-a8e7-486a-9a65-f6a8d74257e9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:43.749480 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a608c60-a8e7-486a-9a65-f6a8d74257e9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:43.751479 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a608c60-a8e7-486a-9a65-f6a8d74257e9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:43.756912 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a608c60-a8e7-486a-9a65-f6a8d74257e9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:43.797200 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-75edcfdb-a166-43b1-a3c7-ba7c6fb68555 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:43.821799 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-75edcfdb-a166-43b1-a3c7-ba7c6fb68555 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:43.825095 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-75edcfdb-a166-43b1-a3c7-ba7c6fb68555 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:43.827979 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-75edcfdb-a166-43b1-a3c7-ba7c6fb68555 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1486 microversion: 2.25 time: 0.295021 Sep 10 11:46:43.850052 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 877/1847] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:43 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1486 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:43.860769 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-88dcd69a-fd71-4975-a013-94ccce09fd98 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:43.861584 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-88dcd69a-fd71-4975-a013-94ccce09fd98 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:43.885706 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-88dcd69a-fd71-4975-a013-94ccce09fd98 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:43.886453 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-88dcd69a-fd71-4975-a013-94ccce09fd98 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:43.887331 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-88dcd69a-fd71-4975-a013-94ccce09fd98 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:43.888549 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-88dcd69a-fd71-4975-a013-94ccce09fd98 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:43.889214 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-88dcd69a-fd71-4975-a013-94ccce09fd98 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:43.889901 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-88dcd69a-fd71-4975-a013-94ccce09fd98 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:43.928755 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0a608c60-a8e7-486a-9a65-f6a8d74257e9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:43.950810 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0a608c60-a8e7-486a-9a65-f6a8d74257e9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1" status: 200 len: 1220 microversion: 2.1 time: 0.262266 Sep 10 11:46:43.953509 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 971/1848] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:43 2022] GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1 => generated 1220 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:43.963313 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-50106d25-db4c-4baa-9285-35f9a2f44035 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:43.964199 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-50106d25-db4c-4baa-9285-35f9a2f44035 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:43.971425 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-50106d25-db4c-4baa-9285-35f9a2f44035 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:43.973705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-50106d25-db4c-4baa-9285-35f9a2f44035 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:43.975265 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-50106d25-db4c-4baa-9285-35f9a2f44035 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:43.976140 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-50106d25-db4c-4baa-9285-35f9a2f44035 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:43.979225 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-50106d25-db4c-4baa-9285-35f9a2f44035 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:43.980758 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-50106d25-db4c-4baa-9285-35f9a2f44035 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:44.105165 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-88dcd69a-fd71-4975-a013-94ccce09fd98 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.253668 Sep 10 11:46:44.116680 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 878/1849] 10.222.0.23 () {60 vars in 1316 bytes} [Sat Sep 10 11:46:43 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a/os-interface => generated 1831 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:44.123945 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b2a7ee7f-048f-4411-9dff-1eea67199b37 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:44.124581 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b2a7ee7f-048f-4411-9dff-1eea67199b37 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:44.139881 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2a7ee7f-048f-4411-9dff-1eea67199b37 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:44.140417 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2a7ee7f-048f-4411-9dff-1eea67199b37 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:44.140837 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2a7ee7f-048f-4411-9dff-1eea67199b37 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:44.141777 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2a7ee7f-048f-4411-9dff-1eea67199b37 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:44.142426 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2a7ee7f-048f-4411-9dff-1eea67199b37 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:44.143077 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2a7ee7f-048f-4411-9dff-1eea67199b37 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:44.500150 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-50106d25-db4c-4baa-9285-35f9a2f44035 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:44.511130 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-50106d25-db4c-4baa-9285-35f9a2f44035 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 200 len: 1470 microversion: 2.1 time: 0.555460 Sep 10 11:46:44.515649 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 972/1850] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:43 2022] GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 1470 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:44.525727 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-87f564eb-fea6-4aaa-8433-10e25f261ac8 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:44.526577 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-87f564eb-fea6-4aaa-8433-10e25f261ac8 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:44.538923 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87f564eb-fea6-4aaa-8433-10e25f261ac8 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:44.541942 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87f564eb-fea6-4aaa-8433-10e25f261ac8 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:44.544231 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87f564eb-fea6-4aaa-8433-10e25f261ac8 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:44.545203 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87f564eb-fea6-4aaa-8433-10e25f261ac8 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:44.547955 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87f564eb-fea6-4aaa-8433-10e25f261ac8 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:44.548599 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87f564eb-fea6-4aaa-8433-10e25f261ac8 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:44.611215 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b2a7ee7f-048f-4411-9dff-1eea67199b37 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:44.623016 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b2a7ee7f-048f-4411-9dff-1eea67199b37 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:44.624965 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b2a7ee7f-048f-4411-9dff-1eea67199b37 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:44.626789 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b2a7ee7f-048f-4411-9dff-1eea67199b37 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1875 microversion: 2.32 time: 0.518596 Sep 10 11:46:44.628819 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 879/1851] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:44 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1875 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:44.655524 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-71105056-d376-4a7e-96f9-552ccc24deab req-6b7d275e-a6c3-4f61-a18f-1760f686dffd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d4f7a57-fa07-41db-97de-a6fed43e9feb", "name": "network-vif-plugged", "status": "completed", "tag": "7212ee8a-bd4e-4ab5-adbf-7906e0f409de"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:46:44.687541 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-71105056-d376-4a7e-96f9-552ccc24deab req-6b7d275e-a6c3-4f61-a18f-1760f686dffd service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:44.688036 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-71105056-d376-4a7e-96f9-552ccc24deab req-6b7d275e-a6c3-4f61-a18f-1760f686dffd service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:44.688539 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-71105056-d376-4a7e-96f9-552ccc24deab req-6b7d275e-a6c3-4f61-a18f-1760f686dffd service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:44.713601 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-71105056-d376-4a7e-96f9-552ccc24deab req-6b7d275e-a6c3-4f61-a18f-1760f686dffd service nova] Creating event network-vif-plugged:7212ee8a-bd4e-4ab5-adbf-7906e0f409de for instance 3d4f7a57-fa07-41db-97de-a6fed43e9feb on n-h1-856895-1 Sep 10 11:46:44.721630 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:46:44.735104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [req-71105056-d376-4a7e-96f9-552ccc24deab req-6b7d275e-a6c3-4f61-a18f-1760f686dffd service nova] Instance 3d4f7a57-fa07-41db-97de-a6fed43e9feb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856895-1', 'n-h1-856895-1'} {{(pid=128776) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 11:46:44.750103 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-71105056-d376-4a7e-96f9-552ccc24deab req-6b7d275e-a6c3-4f61-a18f-1760f686dffd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104471 Sep 10 11:46:44.751149 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 880/1852] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:46:44.819049 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-87f564eb-fea6-4aaa-8433-10e25f261ac8 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:44.830374 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-87f564eb-fea6-4aaa-8433-10e25f261ac8 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1306 microversion: 2.1 time: 0.313299 Sep 10 11:46:44.831842 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 973/1853] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:44 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1306 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:44.867921 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-843ff1a5-2529-411f-b5c5-829172521c56 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:44.868788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-843ff1a5-2529-411f-b5c5-829172521c56 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:44.878951 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-843ff1a5-2529-411f-b5c5-829172521c56 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:44.879834 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-843ff1a5-2529-411f-b5c5-829172521c56 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:44.880537 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-843ff1a5-2529-411f-b5c5-829172521c56 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:44.881560 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-843ff1a5-2529-411f-b5c5-829172521c56 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:44.882347 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-843ff1a5-2529-411f-b5c5-829172521c56 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:44.883020 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-843ff1a5-2529-411f-b5c5-829172521c56 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:44.982070 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f9f8d106-1aa3-47c2-be6e-70fbd8fb8a2f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:44.982688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f9f8d106-1aa3-47c2-be6e-70fbd8fb8a2f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d89db381-1e9d-40ee-b076-b024d38d38b1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:44.991273 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f9f8d106-1aa3-47c2-be6e-70fbd8fb8a2f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:44.991758 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f9f8d106-1aa3-47c2-be6e-70fbd8fb8a2f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:44.994803 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f9f8d106-1aa3-47c2-be6e-70fbd8fb8a2f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:45.000740 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f9f8d106-1aa3-47c2-be6e-70fbd8fb8a2f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:45.001297 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f9f8d106-1aa3-47c2-be6e-70fbd8fb8a2f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:45.001779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f9f8d106-1aa3-47c2-be6e-70fbd8fb8a2f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:45.169972 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f9f8d106-1aa3-47c2-be6e-70fbd8fb8a2f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:45.192425 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f9f8d106-1aa3-47c2-be6e-70fbd8fb8a2f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1" status: 200 len: 1212 microversion: 2.1 time: 0.204184 Sep 10 11:46:45.207498 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 974/1854] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:44 2022] GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1 => generated 1212 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:45.224260 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-843ff1a5-2529-411f-b5c5-829172521c56 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:45.234400 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-843ff1a5-2529-411f-b5c5-829172521c56 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:45.236016 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-843ff1a5-2529-411f-b5c5-829172521c56 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:45.238125 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-843ff1a5-2529-411f-b5c5-829172521c56 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1486 microversion: 2.25 time: 0.374786 Sep 10 11:46:45.239018 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 881/1855] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:44 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1486 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:45.541614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2ba97532-340a-48bf-98ed-1c2a57e6bc26 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:45.542528 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2ba97532-340a-48bf-98ed-1c2a57e6bc26 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:45.561268 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ba97532-340a-48bf-98ed-1c2a57e6bc26 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:45.562388 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ba97532-340a-48bf-98ed-1c2a57e6bc26 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:45.562388 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ba97532-340a-48bf-98ed-1c2a57e6bc26 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:45.562938 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ba97532-340a-48bf-98ed-1c2a57e6bc26 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:45.563428 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ba97532-340a-48bf-98ed-1c2a57e6bc26 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:45.563864 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ba97532-340a-48bf-98ed-1c2a57e6bc26 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:45.657039 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-17749bee-5275-4e7f-8872-9945115d0992 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:45.666000 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-17749bee-5275-4e7f-8872-9945115d0992 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:45.686909 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17749bee-5275-4e7f-8872-9945115d0992 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:45.690763 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17749bee-5275-4e7f-8872-9945115d0992 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:45.696713 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17749bee-5275-4e7f-8872-9945115d0992 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:45.698512 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17749bee-5275-4e7f-8872-9945115d0992 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:45.699246 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17749bee-5275-4e7f-8872-9945115d0992 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:45.702674 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17749bee-5275-4e7f-8872-9945115d0992 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:46.002475 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2ba97532-340a-48bf-98ed-1c2a57e6bc26 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:46.016331 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2ba97532-340a-48bf-98ed-1c2a57e6bc26 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 200 len: 1470 microversion: 2.1 time: 0.477106 Sep 10 11:46:46.017480 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 975/1856] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:45 2022] GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 1470 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:46.028939 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-18ab5fd3-cd21-4ca1-9051-0eef1a1ef989 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:46.029755 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-18ab5fd3-cd21-4ca1-9051-0eef1a1ef989 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:46.045193 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-18ab5fd3-cd21-4ca1-9051-0eef1a1ef989 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:46.045552 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-18ab5fd3-cd21-4ca1-9051-0eef1a1ef989 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:46.050520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-18ab5fd3-cd21-4ca1-9051-0eef1a1ef989 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:46.051040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-18ab5fd3-cd21-4ca1-9051-0eef1a1ef989 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:46.051586 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-18ab5fd3-cd21-4ca1-9051-0eef1a1ef989 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:46.052086 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-18ab5fd3-cd21-4ca1-9051-0eef1a1ef989 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:46.102228 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=100 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:46:46.534819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-17749bee-5275-4e7f-8872-9945115d0992 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:46.558398 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-17749bee-5275-4e7f-8872-9945115d0992 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:46.560700 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-17749bee-5275-4e7f-8872-9945115d0992 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:46.567075 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-17749bee-5275-4e7f-8872-9945115d0992 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1875 microversion: 2.32 time: 0.915258 Sep 10 11:46:46.571916 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 882/1857] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:45 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1875 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:46:46.603080 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c4d4ee1a-2c16-4ce3-b2d9-b712b078dc05 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:46.603804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c4d4ee1a-2c16-4ce3-b2d9-b712b078dc05 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d89db381-1e9d-40ee-b076-b024d38d38b1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:46.622250 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c4d4ee1a-2c16-4ce3-b2d9-b712b078dc05 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:46.623071 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c4d4ee1a-2c16-4ce3-b2d9-b712b078dc05 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:46.624751 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c4d4ee1a-2c16-4ce3-b2d9-b712b078dc05 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:46.625708 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c4d4ee1a-2c16-4ce3-b2d9-b712b078dc05 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:46.628889 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c4d4ee1a-2c16-4ce3-b2d9-b712b078dc05 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:46.629524 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c4d4ee1a-2c16-4ce3-b2d9-b712b078dc05 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:46.699073 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-18ab5fd3-cd21-4ca1-9051-0eef1a1ef989 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:46.706448 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-18ab5fd3-cd21-4ca1-9051-0eef1a1ef989 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1306 microversion: 2.1 time: 0.686092 Sep 10 11:46:46.706603 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 976/1858] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:46 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1306 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:46.725238 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-37efcdc3-efaa-4d22-8626-8f960e3aab92 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:46.725864 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-37efcdc3-efaa-4d22-8626-8f960e3aab92 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:46.743549 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-37efcdc3-efaa-4d22-8626-8f960e3aab92 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:46.744318 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-37efcdc3-efaa-4d22-8626-8f960e3aab92 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:46.744481 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-37efcdc3-efaa-4d22-8626-8f960e3aab92 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:46.748570 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-37efcdc3-efaa-4d22-8626-8f960e3aab92 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:46.749097 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-37efcdc3-efaa-4d22-8626-8f960e3aab92 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:46.749496 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-37efcdc3-efaa-4d22-8626-8f960e3aab92 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:46.819319 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c4d4ee1a-2c16-4ce3-b2d9-b712b078dc05 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:46.830967 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c4d4ee1a-2c16-4ce3-b2d9-b712b078dc05 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1" status: 200 len: 1268 microversion: 2.1 time: 0.255978 Sep 10 11:46:46.831857 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 883/1859] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:46 2022] GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1 => generated 1268 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:47.186622 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-89cef5d2-11c2-46ae-b6b9-b6118d8f5f53 tempest-VolumesAdminNegativeTest-1652611779 tempest-VolumesAdminNegativeTest-1652611779-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "981f0478-ee8c-4ea0-a9c4-dc144f369899"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:46:47.192576 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-89cef5d2-11c2-46ae-b6b9-b6118d8f5f53 tempest-VolumesAdminNegativeTest-1652611779 tempest-VolumesAdminNegativeTest-1652611779-project-admin] [instance: e713eb62-8c55-40ae-8424-4283e90a4c30] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:47.205461 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89cef5d2-11c2-46ae-b6b9-b6118d8f5f53 tempest-VolumesAdminNegativeTest-1652611779 tempest-VolumesAdminNegativeTest-1652611779-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:47.207639 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89cef5d2-11c2-46ae-b6b9-b6118d8f5f53 tempest-VolumesAdminNegativeTest-1652611779 tempest-VolumesAdminNegativeTest-1652611779-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:47.208368 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89cef5d2-11c2-46ae-b6b9-b6118d8f5f53 tempest-VolumesAdminNegativeTest-1652611779 tempest-VolumesAdminNegativeTest-1652611779-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:47.210394 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89cef5d2-11c2-46ae-b6b9-b6118d8f5f53 tempest-VolumesAdminNegativeTest-1652611779 tempest-VolumesAdminNegativeTest-1652611779-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:47.211495 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89cef5d2-11c2-46ae-b6b9-b6118d8f5f53 tempest-VolumesAdminNegativeTest-1652611779 tempest-VolumesAdminNegativeTest-1652611779-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:47.212810 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89cef5d2-11c2-46ae-b6b9-b6118d8f5f53 tempest-VolumesAdminNegativeTest-1652611779 tempest-VolumesAdminNegativeTest-1652611779-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:47.238223 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-37efcdc3-efaa-4d22-8626-8f960e3aab92 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:47.255599 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-37efcdc3-efaa-4d22-8626-8f960e3aab92 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:47.258327 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-37efcdc3-efaa-4d22-8626-8f960e3aab92 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:47.261387 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-37efcdc3-efaa-4d22-8626-8f960e3aab92 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1486 microversion: 2.25 time: 0.546677 Sep 10 11:46:47.263286 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 977/1860] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:46 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1486 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:47.273836 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c3352fca-b85c-4dba-8807-9848d0fd937a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:47.274702 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c3352fca-b85c-4dba-8807-9848d0fd937a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:47.289464 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3352fca-b85c-4dba-8807-9848d0fd937a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:47.291111 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3352fca-b85c-4dba-8807-9848d0fd937a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:47.298680 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3352fca-b85c-4dba-8807-9848d0fd937a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:47.300490 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3352fca-b85c-4dba-8807-9848d0fd937a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:47.301130 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3352fca-b85c-4dba-8807-9848d0fd937a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:47.301755 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3352fca-b85c-4dba-8807-9848d0fd937a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:47.441418 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-89cef5d2-11c2-46ae-b6b9-b6118d8f5f53 tempest-VolumesAdminNegativeTest-1652611779 tempest-VolumesAdminNegativeTest-1652611779-project-admin] HTTP exception thrown: Volume 981f0478-ee8c-4ea0-a9c4-dc144f369899 could not be found. Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-89cef5d2-11c2-46ae-b6b9-b6118d8f5f53 tempest-VolumesAdminNegativeTest-1652611779 tempest-VolumesAdminNegativeTest-1652611779-project-admin] Request method failure captured: Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: request: PUT /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30/os-volume_attachments/311da802-da68-4dc2-bb17-e8a99fa06eb8 HTTP/1.1 Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 74 Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHjHDDvKem4aKoNZBhFSfADDoVLMh_HkAJjD42PE5rE_fQq2BKq6WTuOOgU4kUQqaZclXy0nJYQ1cSso41_yDXqlr8GQLo8ZXOwP75hmGF6FJf_ePIOHeYlOIg0ZY8OVyt4iaaOBGGT-6GkuostV8jU7dPaEA34gdq_RhV0LF0z9aCc Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 14d092e887434bd385f4d1fcf9411963 Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-VolumesAdminNegativeTest-1652611779 Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,admin,member Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,admin,member Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/14d092e887434bd385f4d1fcf9411963"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/14d092e887434bd385f4d1fcf9411963"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_14d092e887434bd385f4d1fcf9411963", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/14d092e887434bd385f4d1fcf9411963"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-VolumesAdminNegativeTest-1652611779 Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 14d092e887434bd385f4d1fcf9411963 Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1652611779 Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-VolumesAdminNegativeTest-1652611779-project-admin Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 0561e52ef3fa42fe94d26f9cff16765c Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-VolumesAdminNegativeTest-1652611779-project-admin Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: {"volumeAttachment": {"volumeId": "981f0478-ee8c-4ea0-a9c4-dc144f369899"}} Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: exception: Volume 981f0478-ee8c-4ea0-a9c4-dc144f369899 could not be found. Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'server_id': 'e713eb62-8c55-40ae-8424-4283e90a4c30', 'id': '311da802-da68-4dc2-bb17-e8a99fa06eb8', 'body': {'volumeAttachment': {'volumeId': '981f0478-ee8c-4ea0-a9c4-dc144f369899'}}} Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 981f0478-ee8c-4ea0-a9c4-dc144f369899 could not be found. (HTTP 404) (Request-ID: req-c1985271-083f-49c8-a89c-d75ac0e3c485) Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 10 11:46:47.479955 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 981f0478-ee8c-4ea0-a9c4-dc144f369899 could not be found. Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 981f0478-ee8c-4ea0-a9c4-dc144f369899 could not be found. Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 981f0478-ee8c-4ea0-a9c4-dc144f369899 could not be found. Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-89cef5d2-11c2-46ae-b6b9-b6118d8f5f53 tempest-VolumesAdminNegativeTest-1652611779 tempest-VolumesAdminNegativeTest-1652611779-project-admin] Returning 400 to user: Volume 981f0478-ee8c-4ea0-a9c4-dc144f369899 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-89cef5d2-11c2-46ae-b6b9-b6118d8f5f53 tempest-VolumesAdminNegativeTest-1652611779 tempest-VolumesAdminNegativeTest-1652611779-project-admin] 10.222.0.23 "PUT /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30/os-volume_attachments/311da802-da68-4dc2-bb17-e8a99fa06eb8" status: 400 len: 107 microversion: 2.1 time: 0.633937 Sep 10 11:46:47.483380 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 884/1861] 10.222.0.23 () {60 vars in 1433 bytes} [Sat Sep 10 11:46:46 2022] PUT /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30/os-volume_attachments/311da802-da68-4dc2-bb17-e8a99fa06eb8 => generated 107 bytes in 650 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:46:47.581846 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-83094cd5-5cda-451a-990b-f787f214bbe3 req-b78dfc27-27f5-4f46-b293-4a541aa04d46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d4f7a57-fa07-41db-97de-a6fed43e9feb", "name": "network-vif-unplugged", "status": "completed", "tag": "7212ee8a-bd4e-4ab5-adbf-7906e0f409de"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:46:47.617301 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-83094cd5-5cda-451a-990b-f787f214bbe3 req-b78dfc27-27f5-4f46-b293-4a541aa04d46 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:47.617803 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-83094cd5-5cda-451a-990b-f787f214bbe3 req-b78dfc27-27f5-4f46-b293-4a541aa04d46 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:47.618249 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-83094cd5-5cda-451a-990b-f787f214bbe3 req-b78dfc27-27f5-4f46-b293-4a541aa04d46 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:47.636181 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c3352fca-b85c-4dba-8807-9848d0fd937a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:47.643830 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-83094cd5-5cda-451a-990b-f787f214bbe3 req-b78dfc27-27f5-4f46-b293-4a541aa04d46 service nova] Creating event network-vif-unplugged:7212ee8a-bd4e-4ab5-adbf-7906e0f409de for instance 3d4f7a57-fa07-41db-97de-a6fed43e9feb on n-h2-856895-1 Sep 10 11:46:47.652454 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c3352fca-b85c-4dba-8807-9848d0fd937a tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 200 len: 1470 microversion: 2.1 time: 0.387925 Sep 10 11:46:47.653840 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 978/1862] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:47 2022] GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 1470 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:47.659934 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [req-83094cd5-5cda-451a-990b-f787f214bbe3 req-b78dfc27-27f5-4f46-b293-4a541aa04d46 service nova] Instance 3d4f7a57-fa07-41db-97de-a6fed43e9feb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856895-1', 'n-h1-856895-1'} {{(pid=128776) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 11:46:47.667290 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8342cc66-ba22-4202-a771-a4812daa2b01 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:47.671559 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8342cc66-ba22-4202-a771-a4812daa2b01 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: e713eb62-8c55-40ae-8424-4283e90a4c30] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:47.687121 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-83094cd5-5cda-451a-990b-f787f214bbe3 req-b78dfc27-27f5-4f46-b293-4a541aa04d46 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109399 Sep 10 11:46:47.688271 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 885/1863] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:46:47.694613 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8342cc66-ba22-4202-a771-a4812daa2b01 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:47.698856 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bda24e2a-2401-4649-b826-31872715a5cc tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:47.700224 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bda24e2a-2401-4649-b826-31872715a5cc tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:47.707448 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8342cc66-ba22-4202-a771-a4812daa2b01 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:47.709063 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bda24e2a-2401-4649-b826-31872715a5cc tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:47.709756 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bda24e2a-2401-4649-b826-31872715a5cc tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:47.710354 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bda24e2a-2401-4649-b826-31872715a5cc tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:47.711716 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bda24e2a-2401-4649-b826-31872715a5cc tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:47.711865 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8342cc66-ba22-4202-a771-a4812daa2b01 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:47.712482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bda24e2a-2401-4649-b826-31872715a5cc tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:47.713752 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bda24e2a-2401-4649-b826-31872715a5cc tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:47.716173 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8342cc66-ba22-4202-a771-a4812daa2b01 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:47.722849 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8342cc66-ba22-4202-a771-a4812daa2b01 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:47.723969 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8342cc66-ba22-4202-a771-a4812daa2b01 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:47.920232 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-8342cc66-ba22-4202-a771-a4812daa2b01 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lazy-loading 'services' on Instance uuid e713eb62-8c55-40ae-8424-4283e90a4c30 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:46:48.027385 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8342cc66-ba22-4202-a771-a4812daa2b01 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30/os-volume_attachments/311da802-da68-4dc2-bb17-e8a99fa06eb8" status: 202 len: 0 microversion: 2.1 time: 0.366020 Sep 10 11:46:48.028002 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 979/1864] 10.222.0.23 () {58 vars in 1416 bytes} [Sat Sep 10 11:46:47 2022] DELETE /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30/os-volume_attachments/311da802-da68-4dc2-bb17-e8a99fa06eb8 => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:46:48.043374 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b10ca890-b798-4c26-8284-14c0de4e492c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:48.044588 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b10ca890-b798-4c26-8284-14c0de4e492c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:48.060968 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b10ca890-b798-4c26-8284-14c0de4e492c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:48.062196 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b10ca890-b798-4c26-8284-14c0de4e492c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:48.062817 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b10ca890-b798-4c26-8284-14c0de4e492c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:48.063772 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b10ca890-b798-4c26-8284-14c0de4e492c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:48.064228 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bda24e2a-2401-4649-b826-31872715a5cc tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:48.064760 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b10ca890-b798-4c26-8284-14c0de4e492c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:48.066226 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b10ca890-b798-4c26-8284-14c0de4e492c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:48.091483 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bda24e2a-2401-4649-b826-31872715a5cc tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:48.094533 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bda24e2a-2401-4649-b826-31872715a5cc tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:48.097151 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bda24e2a-2401-4649-b826-31872715a5cc tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1875 microversion: 2.32 time: 0.407422 Sep 10 11:46:48.098187 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 886/1865] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:47 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1875 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:48.103725 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-79776efc-057b-47e2-b3b0-86276f39fc00 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:48.104502 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-79776efc-057b-47e2-b3b0-86276f39fc00 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d89db381-1e9d-40ee-b076-b024d38d38b1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:48.112930 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79776efc-057b-47e2-b3b0-86276f39fc00 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:48.113507 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79776efc-057b-47e2-b3b0-86276f39fc00 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:48.114068 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79776efc-057b-47e2-b3b0-86276f39fc00 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:48.114740 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79776efc-057b-47e2-b3b0-86276f39fc00 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:48.117387 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79776efc-057b-47e2-b3b0-86276f39fc00 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:48.117898 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79776efc-057b-47e2-b3b0-86276f39fc00 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:48.243565 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-79776efc-057b-47e2-b3b0-86276f39fc00 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:48.253085 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b10ca890-b798-4c26-8284-14c0de4e492c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:48.255948 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-79776efc-057b-47e2-b3b0-86276f39fc00 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1" status: 200 len: 1274 microversion: 2.1 time: 0.156243 Sep 10 11:46:48.271371 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 887/1866] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:48 2022] GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1 => generated 1274 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:48.271371 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9bd0dc33-65c2-4208-9ca3-dd3b17dc8068 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:48.271371 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9bd0dc33-65c2-4208-9ca3-dd3b17dc8068 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: e713eb62-8c55-40ae-8424-4283e90a4c30] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:48.272970 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9bd0dc33-65c2-4208-9ca3-dd3b17dc8068 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:48.274553 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9bd0dc33-65c2-4208-9ca3-dd3b17dc8068 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:48.275013 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9bd0dc33-65c2-4208-9ca3-dd3b17dc8068 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:48.276122 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9bd0dc33-65c2-4208-9ca3-dd3b17dc8068 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:48.276783 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9bd0dc33-65c2-4208-9ca3-dd3b17dc8068 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:48.277417 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9bd0dc33-65c2-4208-9ca3-dd3b17dc8068 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:48.278282 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b10ca890-b798-4c26-8284-14c0de4e492c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1306 microversion: 2.1 time: 0.249066 Sep 10 11:46:48.279291 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 980/1867] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:48 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1306 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:48.292332 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d3ed1116-5076-4d7a-9246-979dd9034e19 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:48.293116 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d3ed1116-5076-4d7a-9246-979dd9034e19 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:48.302942 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3ed1116-5076-4d7a-9246-979dd9034e19 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:48.304595 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3ed1116-5076-4d7a-9246-979dd9034e19 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:48.305576 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3ed1116-5076-4d7a-9246-979dd9034e19 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:48.306437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3ed1116-5076-4d7a-9246-979dd9034e19 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:48.307040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3ed1116-5076-4d7a-9246-979dd9034e19 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:48.307936 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3ed1116-5076-4d7a-9246-979dd9034e19 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:48.317722 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9bd0dc33-65c2-4208-9ca3-dd3b17dc8068 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058619 Sep 10 11:46:48.327852 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 888/1868] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 11:46:48 2022] GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:46:48.476371 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d3ed1116-5076-4d7a-9246-979dd9034e19 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:48.490068 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d3ed1116-5076-4d7a-9246-979dd9034e19 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:48.493772 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d3ed1116-5076-4d7a-9246-979dd9034e19 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:48.494987 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d3ed1116-5076-4d7a-9246-979dd9034e19 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1486 microversion: 2.25 time: 0.207176 Sep 10 11:46:48.495783 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 981/1869] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:48 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1486 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:46:48.687291 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-03c2dd84-5b87-494e-bc4d-f089fee41524 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:48.689552 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-03c2dd84-5b87-494e-bc4d-f089fee41524 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:48.699670 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-03c2dd84-5b87-494e-bc4d-f089fee41524 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:48.700563 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-03c2dd84-5b87-494e-bc4d-f089fee41524 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:48.702040 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-03c2dd84-5b87-494e-bc4d-f089fee41524 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:48.704198 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-03c2dd84-5b87-494e-bc4d-f089fee41524 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:48.704835 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-03c2dd84-5b87-494e-bc4d-f089fee41524 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:48.705946 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-03c2dd84-5b87-494e-bc4d-f089fee41524 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:49.130115 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6fa6ec9d-f530-4be9-b9ca-c10e3dda29c5 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:49.130739 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6fa6ec9d-f530-4be9-b9ca-c10e3dda29c5 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:49.149819 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6fa6ec9d-f530-4be9-b9ca-c10e3dda29c5 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:49.150547 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6fa6ec9d-f530-4be9-b9ca-c10e3dda29c5 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:49.151219 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6fa6ec9d-f530-4be9-b9ca-c10e3dda29c5 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:49.152200 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6fa6ec9d-f530-4be9-b9ca-c10e3dda29c5 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:49.152996 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6fa6ec9d-f530-4be9-b9ca-c10e3dda29c5 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:49.153739 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6fa6ec9d-f530-4be9-b9ca-c10e3dda29c5 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:49.274430 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-03c2dd84-5b87-494e-bc4d-f089fee41524 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:49.282534 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-03c2dd84-5b87-494e-bc4d-f089fee41524 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 200 len: 1470 microversion: 2.1 time: 0.603027 Sep 10 11:46:49.283349 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 889/1870] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:48 2022] GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 1470 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:49.304035 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5fb03924-fbf8-4392-8946-485dfbd7ad36 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:49.304670 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5fb03924-fbf8-4392-8946-485dfbd7ad36 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d89db381-1e9d-40ee-b076-b024d38d38b1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:49.310781 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5fb03924-fbf8-4392-8946-485dfbd7ad36 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:49.311304 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5fb03924-fbf8-4392-8946-485dfbd7ad36 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:49.311749 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5fb03924-fbf8-4392-8946-485dfbd7ad36 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:49.312464 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5fb03924-fbf8-4392-8946-485dfbd7ad36 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:49.312929 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5fb03924-fbf8-4392-8946-485dfbd7ad36 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:49.313365 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5fb03924-fbf8-4392-8946-485dfbd7ad36 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:49.428218 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5fb03924-fbf8-4392-8946-485dfbd7ad36 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:49.445376 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5fb03924-fbf8-4392-8946-485dfbd7ad36 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1" status: 200 len: 1274 microversion: 2.1 time: 0.144297 Sep 10 11:46:49.446348 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 890/1871] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:49 2022] GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1 => generated 1274 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:49.456395 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bdf14fee-8572-447d-9c67-a50dd43662e3 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:49.457356 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bdf14fee-8572-447d-9c67-a50dd43662e3 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:49.467378 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bdf14fee-8572-447d-9c67-a50dd43662e3 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:49.468389 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bdf14fee-8572-447d-9c67-a50dd43662e3 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:49.492436 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bdf14fee-8572-447d-9c67-a50dd43662e3 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:49.493798 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bdf14fee-8572-447d-9c67-a50dd43662e3 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:49.494105 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bdf14fee-8572-447d-9c67-a50dd43662e3 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:49.494578 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bdf14fee-8572-447d-9c67-a50dd43662e3 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:49.510088 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6fa6ec9d-f530-4be9-b9ca-c10e3dda29c5 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:49.530159 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6fa6ec9d-f530-4be9-b9ca-c10e3dda29c5 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:49.532091 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6fa6ec9d-f530-4be9-b9ca-c10e3dda29c5 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:49.533493 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6fa6ec9d-f530-4be9-b9ca-c10e3dda29c5 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1875 microversion: 2.32 time: 0.408743 Sep 10 11:46:49.546906 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 982/1872] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:49 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1875 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:46:49.554181 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-45f2b995-1919-473a-ac00-bee7547a2a71 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:49.556592 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-45f2b995-1919-473a-ac00-bee7547a2a71 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: e713eb62-8c55-40ae-8424-4283e90a4c30] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:49.563037 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-45f2b995-1919-473a-ac00-bee7547a2a71 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:49.563682 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-45f2b995-1919-473a-ac00-bee7547a2a71 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:49.564572 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-45f2b995-1919-473a-ac00-bee7547a2a71 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:49.566211 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-45f2b995-1919-473a-ac00-bee7547a2a71 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:49.567610 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-45f2b995-1919-473a-ac00-bee7547a2a71 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:49.568715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-45f2b995-1919-473a-ac00-bee7547a2a71 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:49.611618 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-45f2b995-1919-473a-ac00-bee7547a2a71 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063065 Sep 10 11:46:49.617463 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 983/1873] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 11:46:49 2022] GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:46:49.622551 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b0b33f06-2fe8-4646-9677-132c7cac7f0c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:49.625711 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b0b33f06-2fe8-4646-9677-132c7cac7f0c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:49.633161 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0b33f06-2fe8-4646-9677-132c7cac7f0c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:49.634010 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0b33f06-2fe8-4646-9677-132c7cac7f0c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:49.634660 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0b33f06-2fe8-4646-9677-132c7cac7f0c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:49.635623 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0b33f06-2fe8-4646-9677-132c7cac7f0c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:49.636290 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0b33f06-2fe8-4646-9677-132c7cac7f0c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:49.636927 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0b33f06-2fe8-4646-9677-132c7cac7f0c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:50.310580 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bdf14fee-8572-447d-9c67-a50dd43662e3 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:50.347690 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bdf14fee-8572-447d-9c67-a50dd43662e3 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1294 microversion: 2.1 time: 0.880217 Sep 10 11:46:50.360011 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 891/1874] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:49 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1294 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:50.371869 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-802430fe-8b9f-448b-b968-fcf7711ff987 req-38ca5755-1028-4a25-bd8b-9345ec6d8986 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d4f7a57-fa07-41db-97de-a6fed43e9feb", "tag": "7212ee8a-bd4e-4ab5-adbf-7906e0f409de"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:46:50.389616 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-802430fe-8b9f-448b-b968-fcf7711ff987 req-38ca5755-1028-4a25-bd8b-9345ec6d8986 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:50.390371 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-802430fe-8b9f-448b-b968-fcf7711ff987 req-38ca5755-1028-4a25-bd8b-9345ec6d8986 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:50.390842 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b0b33f06-2fe8-4646-9677-132c7cac7f0c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:50.391824 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-802430fe-8b9f-448b-b968-fcf7711ff987 req-38ca5755-1028-4a25-bd8b-9345ec6d8986 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:50.407213 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-802430fe-8b9f-448b-b968-fcf7711ff987 req-38ca5755-1028-4a25-bd8b-9345ec6d8986 service nova] Creating event network-changed:7212ee8a-bd4e-4ab5-adbf-7906e0f409de for instance 3d4f7a57-fa07-41db-97de-a6fed43e9feb on n-h2-856895-1 Sep 10 11:46:50.408228 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b0b33f06-2fe8-4646-9677-132c7cac7f0c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:50.419603 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b0b33f06-2fe8-4646-9677-132c7cac7f0c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:50.421382 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b0b33f06-2fe8-4646-9677-132c7cac7f0c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1486 microversion: 2.25 time: 0.802642 Sep 10 11:46:50.421534 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [req-802430fe-8b9f-448b-b968-fcf7711ff987 req-38ca5755-1028-4a25-bd8b-9345ec6d8986 service nova] Instance 3d4f7a57-fa07-41db-97de-a6fed43e9feb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856895-1', 'n-h1-856895-1'} {{(pid=128776) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 11:46:50.422555 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 984/1875] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:49 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1486 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:50.429407 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-066a1300-23b9-4a0c-8d70-406cc853b426 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:50.431875 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-066a1300-23b9-4a0c-8d70-406cc853b426 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:50.442699 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-066a1300-23b9-4a0c-8d70-406cc853b426 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:50.443546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-066a1300-23b9-4a0c-8d70-406cc853b426 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:50.444255 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-066a1300-23b9-4a0c-8d70-406cc853b426 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:50.445859 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-066a1300-23b9-4a0c-8d70-406cc853b426 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:50.448045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-066a1300-23b9-4a0c-8d70-406cc853b426 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:50.451571 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-066a1300-23b9-4a0c-8d70-406cc853b426 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:50.478133 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-802430fe-8b9f-448b-b968-fcf7711ff987 req-38ca5755-1028-4a25-bd8b-9345ec6d8986 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115546 Sep 10 11:46:50.479701 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 892/1876] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:46:50.492242 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bba400a8-ba33-4429-9bbd-fcfea670075b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:50.493216 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bba400a8-ba33-4429-9bbd-fcfea670075b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d89db381-1e9d-40ee-b076-b024d38d38b1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:50.501288 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bba400a8-ba33-4429-9bbd-fcfea670075b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:50.501864 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bba400a8-ba33-4429-9bbd-fcfea670075b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:50.502512 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bba400a8-ba33-4429-9bbd-fcfea670075b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:50.504138 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bba400a8-ba33-4429-9bbd-fcfea670075b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:50.504661 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bba400a8-ba33-4429-9bbd-fcfea670075b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:50.505266 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bba400a8-ba33-4429-9bbd-fcfea670075b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:50.987996 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-066a1300-23b9-4a0c-8d70-406cc853b426 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:50.991419 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bba400a8-ba33-4429-9bbd-fcfea670075b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:51.000302 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-066a1300-23b9-4a0c-8d70-406cc853b426 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 200 len: 1470 microversion: 2.1 time: 0.576402 Sep 10 11:46:51.011195 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 985/1877] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:50 2022] GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 1470 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:51.021570 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b080e153-de6d-4934-8ba9-378db3e9619d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:51.021570 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b080e153-de6d-4934-8ba9-378db3e9619d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:51.026544 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b080e153-de6d-4934-8ba9-378db3e9619d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:51.026802 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b080e153-de6d-4934-8ba9-378db3e9619d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:51.027836 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b080e153-de6d-4934-8ba9-378db3e9619d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:51.028014 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b080e153-de6d-4934-8ba9-378db3e9619d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:51.028480 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b080e153-de6d-4934-8ba9-378db3e9619d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:51.028906 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b080e153-de6d-4934-8ba9-378db3e9619d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:51.038235 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bba400a8-ba33-4429-9bbd-fcfea670075b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1" status: 200 len: 1316 microversion: 2.1 time: 0.554658 Sep 10 11:46:51.040767 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 893/1878] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:50 2022] GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1 => generated 1316 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:51.056924 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f217937c-bf58-4eb7-a3be-9368855f94b0 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:51.060381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f217937c-bf58-4eb7-a3be-9368855f94b0 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: e713eb62-8c55-40ae-8424-4283e90a4c30] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:51.070705 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f217937c-bf58-4eb7-a3be-9368855f94b0 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:51.071634 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f217937c-bf58-4eb7-a3be-9368855f94b0 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:51.072871 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f217937c-bf58-4eb7-a3be-9368855f94b0 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:51.074155 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f217937c-bf58-4eb7-a3be-9368855f94b0 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:51.075814 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f217937c-bf58-4eb7-a3be-9368855f94b0 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:51.076571 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f217937c-bf58-4eb7-a3be-9368855f94b0 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:51.123888 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f217937c-bf58-4eb7-a3be-9368855f94b0 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081352 Sep 10 11:46:51.125366 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 894/1879] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 11:46:51 2022] GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:46:51.379406 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-17d3c199-bca8-48c0-9023-9a83fdd81ba0 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:51.381484 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-17d3c199-bca8-48c0-9023-9a83fdd81ba0 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:51.392331 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17d3c199-bca8-48c0-9023-9a83fdd81ba0 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:51.393264 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17d3c199-bca8-48c0-9023-9a83fdd81ba0 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:51.394411 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17d3c199-bca8-48c0-9023-9a83fdd81ba0 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:51.399108 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17d3c199-bca8-48c0-9023-9a83fdd81ba0 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:51.399824 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17d3c199-bca8-48c0-9023-9a83fdd81ba0 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:51.400413 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17d3c199-bca8-48c0-9023-9a83fdd81ba0 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:51.759445 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b080e153-de6d-4934-8ba9-378db3e9619d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:51.777517 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b080e153-de6d-4934-8ba9-378db3e9619d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:51.778980 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b080e153-de6d-4934-8ba9-378db3e9619d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:51.780216 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b080e153-de6d-4934-8ba9-378db3e9619d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1875 microversion: 2.32 time: 0.773919 Sep 10 11:46:51.783645 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 986/1880] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:51 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1875 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:51.796887 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-62b553e9-0e52-40a2-8059-c71581e1e563 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:51.800452 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-62b553e9-0e52-40a2-8059-c71581e1e563 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:51.818627 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-62b553e9-0e52-40a2-8059-c71581e1e563 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:51.819155 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-62b553e9-0e52-40a2-8059-c71581e1e563 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:51.819924 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-62b553e9-0e52-40a2-8059-c71581e1e563 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:51.820861 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-62b553e9-0e52-40a2-8059-c71581e1e563 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:51.821502 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-62b553e9-0e52-40a2-8059-c71581e1e563 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:51.824380 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-62b553e9-0e52-40a2-8059-c71581e1e563 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:51.896843 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-17d3c199-bca8-48c0-9023-9a83fdd81ba0 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:51.905410 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-17d3c199-bca8-48c0-9023-9a83fdd81ba0 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1294 microversion: 2.1 time: 0.531084 Sep 10 11:46:51.906015 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 895/1881] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:51 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1294 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:52.029151 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a860bec3-e086-439d-b02a-c7dd1366450f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:52.029779 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a860bec3-e086-439d-b02a-c7dd1366450f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:52.036971 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a860bec3-e086-439d-b02a-c7dd1366450f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:52.037461 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a860bec3-e086-439d-b02a-c7dd1366450f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:52.037903 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a860bec3-e086-439d-b02a-c7dd1366450f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:52.038614 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a860bec3-e086-439d-b02a-c7dd1366450f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:52.039066 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a860bec3-e086-439d-b02a-c7dd1366450f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:52.047767 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a860bec3-e086-439d-b02a-c7dd1366450f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:52.278180 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:46:52.344219 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=8 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:46:52.630699 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-62b553e9-0e52-40a2-8059-c71581e1e563 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:52.639453 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-62b553e9-0e52-40a2-8059-c71581e1e563 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:52.645302 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a860bec3-e086-439d-b02a-c7dd1366450f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:52.660613 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a860bec3-e086-439d-b02a-c7dd1366450f tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 200 len: 1470 microversion: 2.1 time: 0.635251 Sep 10 11:46:52.662890 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 896/1882] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:52 2022] GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 1470 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:46:52.669957 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-62b553e9-0e52-40a2-8059-c71581e1e563 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:52.673380 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-81dd87eb-0ccc-429e-84fa-f4a3752c7113 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:52.674086 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-62b553e9-0e52-40a2-8059-c71581e1e563 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1476 microversion: 2.25 time: 0.888783 Sep 10 11:46:52.675115 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 987/1883] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:51 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1476 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:52.677891 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-81dd87eb-0ccc-429e-84fa-f4a3752c7113 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d89db381-1e9d-40ee-b076-b024d38d38b1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:52.714242 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2cf4705c-c6a4-47ac-8d9b-3330b7d11355 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:52.724294 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2cf4705c-c6a4-47ac-8d9b-3330b7d11355 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: e713eb62-8c55-40ae-8424-4283e90a4c30] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:52.724889 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81dd87eb-0ccc-429e-84fa-f4a3752c7113 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:52.727797 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81dd87eb-0ccc-429e-84fa-f4a3752c7113 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:52.728995 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81dd87eb-0ccc-429e-84fa-f4a3752c7113 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:52.733783 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81dd87eb-0ccc-429e-84fa-f4a3752c7113 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:52.735666 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81dd87eb-0ccc-429e-84fa-f4a3752c7113 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:52.736327 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81dd87eb-0ccc-429e-84fa-f4a3752c7113 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:52.742189 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=29,nova_cell0:UPDATE=7 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:46:52.751648 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2cf4705c-c6a4-47ac-8d9b-3330b7d11355 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:52.752973 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2cf4705c-c6a4-47ac-8d9b-3330b7d11355 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:52.754818 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2cf4705c-c6a4-47ac-8d9b-3330b7d11355 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:52.756973 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2cf4705c-c6a4-47ac-8d9b-3330b7d11355 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:52.758640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2cf4705c-c6a4-47ac-8d9b-3330b7d11355 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:52.760252 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2cf4705c-c6a4-47ac-8d9b-3330b7d11355 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:52.843840 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2cf4705c-c6a4-47ac-8d9b-3330b7d11355 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.166898 Sep 10 11:46:52.851069 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 988/1884] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 11:46:52 2022] GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30/os-volume_attachments => generated 197 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:46:52.856552 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1272c3bb-9c69-474c-adf4-5f94ac7a7bc3 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Calling method '.version_select at 0x7f407b51b9d0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:52.861244 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1272c3bb-9c69-474c-adf4-5f94ac7a7bc3 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:52.863680 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1272c3bb-9c69-474c-adf4-5f94ac7a7bc3 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:52.864423 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1272c3bb-9c69-474c-adf4-5f94ac7a7bc3 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:52.879373 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1272c3bb-9c69-474c-adf4-5f94ac7a7bc3 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] 10.222.0.23 "GET /compute/v2.1/os-migrations" status: 200 len: 3633 microversion: 2.25 time: 0.025103 Sep 10 11:46:52.880959 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 989/1885] 10.222.0.23 () {60 vars in 1184 bytes} [Sat Sep 10 11:46:52 2022] GET /compute/v2.1/os-migrations => generated 3633 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:52.887758 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-eddfa999-e952-48cc-ab22-2bc19cbc46df tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:52.888865 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-eddfa999-e952-48cc-ab22-2bc19cbc46df tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:52.897809 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eddfa999-e952-48cc-ab22-2bc19cbc46df tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:52.898719 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eddfa999-e952-48cc-ab22-2bc19cbc46df tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:52.899477 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eddfa999-e952-48cc-ab22-2bc19cbc46df tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:52.900493 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eddfa999-e952-48cc-ab22-2bc19cbc46df tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:52.901100 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eddfa999-e952-48cc-ab22-2bc19cbc46df tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:52.901596 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eddfa999-e952-48cc-ab22-2bc19cbc46df tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:53.062700 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-81dd87eb-0ccc-429e-84fa-f4a3752c7113 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:53.071979 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-81dd87eb-0ccc-429e-84fa-f4a3752c7113 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1" status: 200 len: 1316 microversion: 2.1 time: 0.407713 Sep 10 11:46:53.075302 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 897/1886] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:52 2022] GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1 => generated 1316 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:53.082405 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-887eddac-5b73-482b-93de-7387ba517613 req-0292601b-4f56-4293-9d03-7070b62e283b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d89db381-1e9d-40ee-b076-b024d38d38b1", "tag": "d154c601-3089-464e-a0a5-7d00211e395b"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:46:53.094511 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-887eddac-5b73-482b-93de-7387ba517613 req-0292601b-4f56-4293-9d03-7070b62e283b service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:53.095334 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-887eddac-5b73-482b-93de-7387ba517613 req-0292601b-4f56-4293-9d03-7070b62e283b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:53.095888 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-887eddac-5b73-482b-93de-7387ba517613 req-0292601b-4f56-4293-9d03-7070b62e283b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:53.108678 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-887eddac-5b73-482b-93de-7387ba517613 req-0292601b-4f56-4293-9d03-7070b62e283b service nova] Creating event network-changed:d154c601-3089-464e-a0a5-7d00211e395b for instance d89db381-1e9d-40ee-b076-b024d38d38b1 on n-h1-856895-1 Sep 10 11:46:53.125399 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-887eddac-5b73-482b-93de-7387ba517613 req-0292601b-4f56-4293-9d03-7070b62e283b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050973 Sep 10 11:46:53.126385 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 898/1887] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:46:53.140779 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ab75eee8-4b47-4857-bc4b-41c584683ea9 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:53.141706 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ab75eee8-4b47-4857-bc4b-41c584683ea9 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:53.151980 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab75eee8-4b47-4857-bc4b-41c584683ea9 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:53.152701 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab75eee8-4b47-4857-bc4b-41c584683ea9 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:53.153323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab75eee8-4b47-4857-bc4b-41c584683ea9 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:53.154220 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab75eee8-4b47-4857-bc4b-41c584683ea9 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:53.154926 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab75eee8-4b47-4857-bc4b-41c584683ea9 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:53.155403 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab75eee8-4b47-4857-bc4b-41c584683ea9 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:53.162143 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:46:53.334112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-eddfa999-e952-48cc-ab22-2bc19cbc46df tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:53.348127 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-eddfa999-e952-48cc-ab22-2bc19cbc46df tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:53.350201 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-eddfa999-e952-48cc-ab22-2bc19cbc46df tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:53.352263 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-eddfa999-e952-48cc-ab22-2bc19cbc46df tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1875 microversion: 2.32 time: 0.469136 Sep 10 11:46:53.354874 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 990/1888] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:52 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1875 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:53.376690 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c1395f63-9965-4abe-bb43-04e8e405c6cf tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:53.379941 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c1395f63-9965-4abe-bb43-04e8e405c6cf tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:53.394506 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1395f63-9965-4abe-bb43-04e8e405c6cf tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:53.399665 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1395f63-9965-4abe-bb43-04e8e405c6cf tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:53.400435 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1395f63-9965-4abe-bb43-04e8e405c6cf tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:53.401355 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1395f63-9965-4abe-bb43-04e8e405c6cf tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:53.402124 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1395f63-9965-4abe-bb43-04e8e405c6cf tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:53.403871 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1395f63-9965-4abe-bb43-04e8e405c6cf tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:53.668899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-ab75eee8-4b47-4857-bc4b-41c584683ea9 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] Lazy-loading 'services' on Instance uuid a62a6c44-9d92-4766-a81d-c09670110ab4 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:46:53.693557 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ab75eee8-4b47-4857-bc4b-41c584683ea9 tempest-LiveAutoBlockMigrationV225Test-779529694 tempest-LiveAutoBlockMigrationV225Test-779529694-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1969 microversion: 2.25 time: 0.565914 Sep 10 11:46:53.694705 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 899/1889] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:53 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1969 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:53.699479 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6a64112a-2d5f-4459-9868-132796d32ebc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:53.700322 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6a64112a-2d5f-4459-9868-132796d32ebc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:53.707549 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6a64112a-2d5f-4459-9868-132796d32ebc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:53.708308 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6a64112a-2d5f-4459-9868-132796d32ebc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:53.708954 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6a64112a-2d5f-4459-9868-132796d32ebc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:53.709919 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6a64112a-2d5f-4459-9868-132796d32ebc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:53.710581 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6a64112a-2d5f-4459-9868-132796d32ebc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:53.711564 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6a64112a-2d5f-4459-9868-132796d32ebc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:53.805797 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c1395f63-9965-4abe-bb43-04e8e405c6cf tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:53.817873 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c1395f63-9965-4abe-bb43-04e8e405c6cf tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1294 microversion: 2.1 time: 0.459839 Sep 10 11:46:53.822975 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 991/1890] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:53 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1294 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:53.828142 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1ffe9515-63d6-47ed-b2a9-31ca27c2466c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:53.828835 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1ffe9515-63d6-47ed-b2a9-31ca27c2466c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:53.848739 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ffe9515-63d6-47ed-b2a9-31ca27c2466c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:53.849620 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ffe9515-63d6-47ed-b2a9-31ca27c2466c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:53.850304 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ffe9515-63d6-47ed-b2a9-31ca27c2466c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:53.851256 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ffe9515-63d6-47ed-b2a9-31ca27c2466c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:53.851907 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ffe9515-63d6-47ed-b2a9-31ca27c2466c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:53.852658 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ffe9515-63d6-47ed-b2a9-31ca27c2466c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:53.916926 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1ffe9515-63d6-47ed-b2a9-31ca27c2466c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:46:53.937435 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:46:53.991284 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6a64112a-2d5f-4459-9868-132796d32ebc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:54.009614 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6a64112a-2d5f-4459-9868-132796d32ebc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 200 len: 1463 microversion: 2.1 time: 0.313615 Sep 10 11:46:54.015323 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 900/1891] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:53 2022] GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 1463 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:54.032915 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2ba41b7d-8312-4eab-8bb4-12612cabc11f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:54.038301 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2ba41b7d-8312-4eab-8bb4-12612cabc11f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: e713eb62-8c55-40ae-8424-4283e90a4c30] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:54.045534 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2ba41b7d-8312-4eab-8bb4-12612cabc11f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:54.046251 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2ba41b7d-8312-4eab-8bb4-12612cabc11f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:54.047128 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2ba41b7d-8312-4eab-8bb4-12612cabc11f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:54.048023 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2ba41b7d-8312-4eab-8bb4-12612cabc11f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:54.048640 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2ba41b7d-8312-4eab-8bb4-12612cabc11f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:54.049228 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2ba41b7d-8312-4eab-8bb4-12612cabc11f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:54.083916 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1ffe9515-63d6-47ed-b2a9-31ca27c2466c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 204 len: 0 microversion: 2.25 time: 0.259207 Sep 10 11:46:54.084596 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 992/1892] 10.222.0.23 () {60 vars in 1280 bytes} [Sat Sep 10 11:46:53 2022] DELETE /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 11:46:54.091317 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f88abec2-7866-42a8-afb3-6a2180bae653 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:54.092581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f88abec2-7866-42a8-afb3-6a2180bae653 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:54.101191 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f88abec2-7866-42a8-afb3-6a2180bae653 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:54.101961 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f88abec2-7866-42a8-afb3-6a2180bae653 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:54.102616 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f88abec2-7866-42a8-afb3-6a2180bae653 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:54.103547 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f88abec2-7866-42a8-afb3-6a2180bae653 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:54.104187 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f88abec2-7866-42a8-afb3-6a2180bae653 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:54.104795 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f88abec2-7866-42a8-afb3-6a2180bae653 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:54.139979 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2ba41b7d-8312-4eab-8bb4-12612cabc11f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117364 Sep 10 11:46:54.145458 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 901/1893] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 11:46:54 2022] GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:46:54.156117 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b6793bbd-1f8a-4845-80fb-618612988dd0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:54.157021 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b6793bbd-1f8a-4845-80fb-618612988dd0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:54.168950 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b6793bbd-1f8a-4845-80fb-618612988dd0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:54.171483 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b6793bbd-1f8a-4845-80fb-618612988dd0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:54.173442 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b6793bbd-1f8a-4845-80fb-618612988dd0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:54.177244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b6793bbd-1f8a-4845-80fb-618612988dd0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:54.179060 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b6793bbd-1f8a-4845-80fb-618612988dd0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:54.179553 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b6793bbd-1f8a-4845-80fb-618612988dd0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:54.329851 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f88abec2-7866-42a8-afb3-6a2180bae653 tempest-MigrationsAdminTest-1662052522 tempest-MigrationsAdminTest-1662052522-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 200 len: 1614 microversion: 2.1 time: 0.243565 Sep 10 11:46:54.332602 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 993/1894] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:54 2022] GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 1614 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:54.367766 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1356a30b-33ab-4ef4-b1c8-a02733ec5474 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:54.368701 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1356a30b-33ab-4ef4-b1c8-a02733ec5474 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d89db381-1e9d-40ee-b076-b024d38d38b1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:54.383545 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1356a30b-33ab-4ef4-b1c8-a02733ec5474 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:54.384285 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1356a30b-33ab-4ef4-b1c8-a02733ec5474 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:54.385670 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1356a30b-33ab-4ef4-b1c8-a02733ec5474 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:54.390974 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1356a30b-33ab-4ef4-b1c8-a02733ec5474 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:54.392734 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1356a30b-33ab-4ef4-b1c8-a02733ec5474 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:54.394637 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1356a30b-33ab-4ef4-b1c8-a02733ec5474 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:54.421796 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b6793bbd-1f8a-4845-80fb-618612988dd0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:54.437494 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b6793bbd-1f8a-4845-80fb-618612988dd0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:54.441833 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b6793bbd-1f8a-4845-80fb-618612988dd0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:54.445714 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b6793bbd-1f8a-4845-80fb-618612988dd0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1482 microversion: 2.25 time: 0.299069 Sep 10 11:46:54.455138 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 902/1895] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:54 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1482 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:54.478965 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-05a60d4e-1821-4f86-812a-f448f0265edc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:54.480282 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-05a60d4e-1821-4f86-812a-f448f0265edc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:54.488229 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05a60d4e-1821-4f86-812a-f448f0265edc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:54.489082 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05a60d4e-1821-4f86-812a-f448f0265edc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:54.489916 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05a60d4e-1821-4f86-812a-f448f0265edc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:54.490865 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05a60d4e-1821-4f86-812a-f448f0265edc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:54.491573 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05a60d4e-1821-4f86-812a-f448f0265edc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:54.492218 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05a60d4e-1821-4f86-812a-f448f0265edc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:54.533005 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-05a60d4e-1821-4f86-812a-f448f0265edc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:46:54.637860 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1356a30b-33ab-4ef4-b1c8-a02733ec5474 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:54.651832 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1356a30b-33ab-4ef4-b1c8-a02733ec5474 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1" status: 200 len: 1316 microversion: 2.1 time: 0.302343 Sep 10 11:46:54.652889 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 994/1896] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:54 2022] GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1 => generated 1316 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:54.657608 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ec73cd30-f7a7-4418-9bec-eb8f24cd9892 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:54.658211 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ec73cd30-f7a7-4418-9bec-eb8f24cd9892 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:54.664806 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec73cd30-f7a7-4418-9bec-eb8f24cd9892 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:54.665738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec73cd30-f7a7-4418-9bec-eb8f24cd9892 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:54.665738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec73cd30-f7a7-4418-9bec-eb8f24cd9892 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:54.666533 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec73cd30-f7a7-4418-9bec-eb8f24cd9892 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:54.666957 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec73cd30-f7a7-4418-9bec-eb8f24cd9892 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:54.667537 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec73cd30-f7a7-4418-9bec-eb8f24cd9892 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:54.728064 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-05a60d4e-1821-4f86-812a-f448f0265edc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 204 len: 0 microversion: 2.1 time: 0.258812 Sep 10 11:46:54.729189 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 903/1897] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:46:54 2022] DELETE /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:46:54.744746 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7cc34c27-5e22-4c49-aead-bb532ff15d32 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:54.745193 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7cc34c27-5e22-4c49-aead-bb532ff15d32 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:54.753235 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7cc34c27-5e22-4c49-aead-bb532ff15d32 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:54.753742 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7cc34c27-5e22-4c49-aead-bb532ff15d32 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:54.754394 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7cc34c27-5e22-4c49-aead-bb532ff15d32 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:54.755100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7cc34c27-5e22-4c49-aead-bb532ff15d32 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:54.755659 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7cc34c27-5e22-4c49-aead-bb532ff15d32 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:54.756087 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7cc34c27-5e22-4c49-aead-bb532ff15d32 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:54.974226 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ec73cd30-f7a7-4418-9bec-eb8f24cd9892 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:54.985325 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ec73cd30-f7a7-4418-9bec-eb8f24cd9892 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:54.987342 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ec73cd30-f7a7-4418-9bec-eb8f24cd9892 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:54.989717 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ec73cd30-f7a7-4418-9bec-eb8f24cd9892 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1875 microversion: 2.32 time: 0.335738 Sep 10 11:46:54.990774 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 995/1898] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:54 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1875 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:54.995592 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6017cd36-fe85-485a-b4e0-8a700c896597 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:54.996471 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6017cd36-fe85-485a-b4e0-8a700c896597 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:55.002767 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6017cd36-fe85-485a-b4e0-8a700c896597 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:55.003279 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6017cd36-fe85-485a-b4e0-8a700c896597 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:55.003887 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6017cd36-fe85-485a-b4e0-8a700c896597 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:55.004752 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6017cd36-fe85-485a-b4e0-8a700c896597 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:55.005336 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6017cd36-fe85-485a-b4e0-8a700c896597 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:55.006280 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6017cd36-fe85-485a-b4e0-8a700c896597 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:55.024604 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7cc34c27-5e22-4c49-aead-bb532ff15d32 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:55.033063 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7cc34c27-5e22-4c49-aead-bb532ff15d32 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 200 len: 1469 microversion: 2.1 time: 0.299484 Sep 10 11:46:55.034749 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 904/1899] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:54 2022] GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 1469 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:46:55.153903 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-548345f6-c33c-4cc3-841a-8780bd02c13a tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:55.156521 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-548345f6-c33c-4cc3-841a-8780bd02c13a tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: e713eb62-8c55-40ae-8424-4283e90a4c30] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:55.164351 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-548345f6-c33c-4cc3-841a-8780bd02c13a tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:55.164847 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-548345f6-c33c-4cc3-841a-8780bd02c13a tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:55.165284 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-548345f6-c33c-4cc3-841a-8780bd02c13a tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:55.166178 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-548345f6-c33c-4cc3-841a-8780bd02c13a tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:55.166839 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-548345f6-c33c-4cc3-841a-8780bd02c13a tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:55.167309 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-548345f6-c33c-4cc3-841a-8780bd02c13a tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:55.198831 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-548345f6-c33c-4cc3-841a-8780bd02c13a tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049664 Sep 10 11:46:55.199881 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 905/1900] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 11:46:55 2022] GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 10 11:46:55.202935 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6017cd36-fe85-485a-b4e0-8a700c896597 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:55.212510 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6017cd36-fe85-485a-b4e0-8a700c896597 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1294 microversion: 2.1 time: 0.220402 Sep 10 11:46:55.213387 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 996/1901] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:54 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1294 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:55.365615 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f08cf555-6997-4457-9667-1115f0056b96 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1682729001", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "42c19435-ba71-4934-a619-3d55b7ee5eac"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:46:55.422306 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-f08cf555-6997-4457-9667-1115f0056b96 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] validate_networks() for [('42c19435-ba71-4934-a619-3d55b7ee5eac', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:46:55.486583 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-210275ce-8da9-40d8-9afb-1ea1796386b5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:55.487841 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-210275ce-8da9-40d8-9afb-1ea1796386b5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:55.494514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-210275ce-8da9-40d8-9afb-1ea1796386b5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:55.495000 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-210275ce-8da9-40d8-9afb-1ea1796386b5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:55.495988 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-210275ce-8da9-40d8-9afb-1ea1796386b5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:55.496234 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-210275ce-8da9-40d8-9afb-1ea1796386b5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:55.496686 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-210275ce-8da9-40d8-9afb-1ea1796386b5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:55.497104 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-210275ce-8da9-40d8-9afb-1ea1796386b5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:55.770279 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-210275ce-8da9-40d8-9afb-1ea1796386b5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:55.783272 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-210275ce-8da9-40d8-9afb-1ea1796386b5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:55.784968 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-210275ce-8da9-40d8-9afb-1ea1796386b5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:55.786245 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-210275ce-8da9-40d8-9afb-1ea1796386b5 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1482 microversion: 2.25 time: 0.303699 Sep 10 11:46:55.787078 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 997/1902] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:55 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1482 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:46:55.793507 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2758b75d-a468-448c-94c2-6ed67f65d00d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:55.794623 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2758b75d-a468-448c-94c2-6ed67f65d00d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d89db381-1e9d-40ee-b076-b024d38d38b1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:55.804750 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2758b75d-a468-448c-94c2-6ed67f65d00d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:55.806114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2758b75d-a468-448c-94c2-6ed67f65d00d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:55.806714 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2758b75d-a468-448c-94c2-6ed67f65d00d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:55.807640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2758b75d-a468-448c-94c2-6ed67f65d00d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:55.808216 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2758b75d-a468-448c-94c2-6ed67f65d00d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:55.808716 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2758b75d-a468-448c-94c2-6ed67f65d00d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:56.302948 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-f08cf555-6997-4457-9667-1115f0056b96 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:46:56.303562 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-f08cf555-6997-4457-9667-1115f0056b96 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:46:56.303875 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-f08cf555-6997-4457-9667-1115f0056b96 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:46:56.304293 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-f08cf555-6997-4457-9667-1115f0056b96 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:46:56.305035 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-f08cf555-6997-4457-9667-1115f0056b96 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:46:56.322442 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f08cf555-6997-4457-9667-1115f0056b96 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:56.323118 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f08cf555-6997-4457-9667-1115f0056b96 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:56.328709 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f08cf555-6997-4457-9667-1115f0056b96 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:56.329765 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f08cf555-6997-4457-9667-1115f0056b96 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:56.330352 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f08cf555-6997-4457-9667-1115f0056b96 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:56.331533 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f08cf555-6997-4457-9667-1115f0056b96 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:56.340200 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2758b75d-a468-448c-94c2-6ed67f65d00d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:56.349181 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2758b75d-a468-448c-94c2-6ed67f65d00d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1" status: 200 len: 1316 microversion: 2.1 time: 0.560783 Sep 10 11:46:56.351540 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 998/1903] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:55 2022] GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1 => generated 1316 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:56.370342 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-f08cf555-6997-4457-9667-1115f0056b96 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Getting quotas for project 99f601d0bb424da4bb02b532ac982878. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:46:56.372543 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5e13d94e-2629-444e-b43b-4c914bcb4349 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:56.373317 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5e13d94e-2629-444e-b43b-4c914bcb4349 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:56.376794 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-f08cf555-6997-4457-9667-1115f0056b96 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Getting quotas for user 91ea7c11febf451da4f1faf4dff9471d and project 99f601d0bb424da4bb02b532ac982878. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:46:56.380679 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5e13d94e-2629-444e-b43b-4c914bcb4349 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:56.381363 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5e13d94e-2629-444e-b43b-4c914bcb4349 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:56.381961 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5e13d94e-2629-444e-b43b-4c914bcb4349 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:56.382834 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5e13d94e-2629-444e-b43b-4c914bcb4349 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:56.383478 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5e13d94e-2629-444e-b43b-4c914bcb4349 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:56.384057 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5e13d94e-2629-444e-b43b-4c914bcb4349 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:56.399626 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f08cf555-6997-4457-9667-1115f0056b96 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:46:56.404720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f08cf555-6997-4457-9667-1115f0056b96 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: f33c83e4-9881-4c1e-a502-ad9589fd597c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:46:56.506216 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f08cf555-6997-4457-9667-1115f0056b96 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.141216 Sep 10 11:46:56.516566 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 906/1904] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:46:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:46:56.525124 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-69e6d9f1-6aa4-4444-8a6e-0403084f0551 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:56.525739 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-69e6d9f1-6aa4-4444-8a6e-0403084f0551 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:56.536741 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-69e6d9f1-6aa4-4444-8a6e-0403084f0551 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:56.538055 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-69e6d9f1-6aa4-4444-8a6e-0403084f0551 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:56.538612 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-69e6d9f1-6aa4-4444-8a6e-0403084f0551 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:56.540073 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-69e6d9f1-6aa4-4444-8a6e-0403084f0551 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:56.540755 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-69e6d9f1-6aa4-4444-8a6e-0403084f0551 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:56.541293 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-69e6d9f1-6aa4-4444-8a6e-0403084f0551 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:56.691909 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5e13d94e-2629-444e-b43b-4c914bcb4349 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:56.725085 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5e13d94e-2629-444e-b43b-4c914bcb4349 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:56.732994 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5e13d94e-2629-444e-b43b-4c914bcb4349 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:56.734483 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5e13d94e-2629-444e-b43b-4c914bcb4349 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1875 microversion: 2.32 time: 0.369331 Sep 10 11:46:56.737572 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 999/1905] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:56 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1875 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:56.743554 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-62ad14f1-89a3-49bf-ae22-8973a8bbb146 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:56.744374 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-62ad14f1-89a3-49bf-ae22-8973a8bbb146 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:56.751352 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-62ad14f1-89a3-49bf-ae22-8973a8bbb146 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:56.752038 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-62ad14f1-89a3-49bf-ae22-8973a8bbb146 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:56.753184 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-62ad14f1-89a3-49bf-ae22-8973a8bbb146 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:56.760822 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-62ad14f1-89a3-49bf-ae22-8973a8bbb146 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:56.762093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-62ad14f1-89a3-49bf-ae22-8973a8bbb146 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:56.762704 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-62ad14f1-89a3-49bf-ae22-8973a8bbb146 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:56.880839 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-69e6d9f1-6aa4-4444-8a6e-0403084f0551 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:56.894411 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-69e6d9f1-6aa4-4444-8a6e-0403084f0551 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 200 len: 1469 microversion: 2.1 time: 0.374689 Sep 10 11:46:56.896716 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 907/1906] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:56 2022] GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 1469 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:56.907379 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b0dd9e32-bbe3-45bd-8aeb-0ce34825eb7c tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:56.909982 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b0dd9e32-bbe3-45bd-8aeb-0ce34825eb7c tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: f33c83e4-9881-4c1e-a502-ad9589fd597c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:57.032669 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-62ad14f1-89a3-49bf-ae22-8973a8bbb146 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:57.041448 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-62ad14f1-89a3-49bf-ae22-8973a8bbb146 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1294 microversion: 2.1 time: 0.302309 Sep 10 11:46:57.045066 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1000/1907] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:56 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1294 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:57.047925 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b0dd9e32-bbe3-45bd-8aeb-0ce34825eb7c tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ea7c11febf451da4f1faf4dff9471d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f601d0bb424da4bb02b532ac982878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:57.051351 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8fc33255-0e26-4e2c-b9e5-64ca9e19b29c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:57.051977 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8fc33255-0e26-4e2c-b9e5-64ca9e19b29c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:57.059623 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8fc33255-0e26-4e2c-b9e5-64ca9e19b29c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:57.060562 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8fc33255-0e26-4e2c-b9e5-64ca9e19b29c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:57.061522 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8fc33255-0e26-4e2c-b9e5-64ca9e19b29c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:57.062397 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8fc33255-0e26-4e2c-b9e5-64ca9e19b29c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:57.063006 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8fc33255-0e26-4e2c-b9e5-64ca9e19b29c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:57.063636 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8fc33255-0e26-4e2c-b9e5-64ca9e19b29c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:57.064129 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b0dd9e32-bbe3-45bd-8aeb-0ce34825eb7c tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "GET /compute/v2.1/servers/f33c83e4-9881-4c1e-a502-ad9589fd597c" status: 200 len: 1218 microversion: 2.1 time: 0.166272 Sep 10 11:46:57.070570 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 908/1908] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:56 2022] GET /compute/v2.1/servers/f33c83e4-9881-4c1e-a502-ad9589fd597c => generated 1218 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:57.082755 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-2daed34d-8b5c-40d4-a88e-543f1d8bc405 req-46b3c5d6-5edd-4d1a-9f86-fdfaf7e57b62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d4f7a57-fa07-41db-97de-a6fed43e9feb", "name": "network-vif-deleted", "tag": "7212ee8a-bd4e-4ab5-adbf-7906e0f409de"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:46:57.119804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-2daed34d-8b5c-40d4-a88e-543f1d8bc405 req-46b3c5d6-5edd-4d1a-9f86-fdfaf7e57b62 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:57.120697 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-2daed34d-8b5c-40d4-a88e-543f1d8bc405 req-46b3c5d6-5edd-4d1a-9f86-fdfaf7e57b62 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:57.121298 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-2daed34d-8b5c-40d4-a88e-543f1d8bc405 req-46b3c5d6-5edd-4d1a-9f86-fdfaf7e57b62 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:57.150996 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-2daed34d-8b5c-40d4-a88e-543f1d8bc405 req-46b3c5d6-5edd-4d1a-9f86-fdfaf7e57b62 service nova] Creating event network-vif-deleted:7212ee8a-bd4e-4ab5-adbf-7906e0f409de for instance 3d4f7a57-fa07-41db-97de-a6fed43e9feb on n-h2-856895-1 Sep 10 11:46:57.176252 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-2daed34d-8b5c-40d4-a88e-543f1d8bc405 req-46b3c5d6-5edd-4d1a-9f86-fdfaf7e57b62 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097272 Sep 10 11:46:57.177036 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 909/1909] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:46:57.314585 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8fc33255-0e26-4e2c-b9e5-64ca9e19b29c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:57.334915 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8fc33255-0e26-4e2c-b9e5-64ca9e19b29c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:57.338962 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8fc33255-0e26-4e2c-b9e5-64ca9e19b29c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:57.340695 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8fc33255-0e26-4e2c-b9e5-64ca9e19b29c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1482 microversion: 2.25 time: 0.294214 Sep 10 11:46:57.342785 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1001/1910] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:57 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1482 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:57.382112 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9384ed9b-82d1-4ab0-a399-1904db83394f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:57.383845 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9384ed9b-82d1-4ab0-a399-1904db83394f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d89db381-1e9d-40ee-b076-b024d38d38b1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:57.398322 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9384ed9b-82d1-4ab0-a399-1904db83394f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:57.399751 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9384ed9b-82d1-4ab0-a399-1904db83394f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:57.401167 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9384ed9b-82d1-4ab0-a399-1904db83394f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:57.403486 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9384ed9b-82d1-4ab0-a399-1904db83394f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:57.406477 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9384ed9b-82d1-4ab0-a399-1904db83394f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:57.407397 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9384ed9b-82d1-4ab0-a399-1904db83394f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:57.665488 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9384ed9b-82d1-4ab0-a399-1904db83394f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:57.676877 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9384ed9b-82d1-4ab0-a399-1904db83394f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1" status: 200 len: 1316 microversion: 2.1 time: 0.302284 Sep 10 11:46:57.678137 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 910/1911] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:57 2022] GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1 => generated 1316 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:57.767756 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c4fc2a7e-ccf1-48fd-bde9-c31944774623 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:57.769194 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c4fc2a7e-ccf1-48fd-bde9-c31944774623 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:57.780299 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c4fc2a7e-ccf1-48fd-bde9-c31944774623 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:57.781053 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c4fc2a7e-ccf1-48fd-bde9-c31944774623 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:57.786449 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c4fc2a7e-ccf1-48fd-bde9-c31944774623 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:57.787493 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c4fc2a7e-ccf1-48fd-bde9-c31944774623 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:57.789289 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c4fc2a7e-ccf1-48fd-bde9-c31944774623 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:57.790803 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c4fc2a7e-ccf1-48fd-bde9-c31944774623 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:57.920171 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9fc745bf-ed8d-4684-8b0c-6b4d0b0a737c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:57.920975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9fc745bf-ed8d-4684-8b0c-6b4d0b0a737c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 3d4f7a57-fa07-41db-97de-a6fed43e9feb] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:57.950210 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fc745bf-ed8d-4684-8b0c-6b4d0b0a737c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:57.954175 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fc745bf-ed8d-4684-8b0c-6b4d0b0a737c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:57.954825 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fc745bf-ed8d-4684-8b0c-6b4d0b0a737c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:57.958224 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fc745bf-ed8d-4684-8b0c-6b4d0b0a737c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:57.959096 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fc745bf-ed8d-4684-8b0c-6b4d0b0a737c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:57.961287 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fc745bf-ed8d-4684-8b0c-6b4d0b0a737c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:57.998036 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-9fc745bf-ed8d-4684-8b0c-6b4d0b0a737c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] HTTP exception thrown: Instance 3d4f7a57-fa07-41db-97de-a6fed43e9feb could not be found. Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9fc745bf-ed8d-4684-8b0c-6b4d0b0a737c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Request method failure captured: Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb HTTP/1.1 Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHf7mACdlfzYNqqdAdehYL4NCPaTh2LiHYzzG2y_R-m91DirSD9NpPMperwROx5CtpOnZxmqPDNB9-2DL_apNDkdE-LB__QyjBTbYbDUeOWNR455kuIEfcUXxBZGOPYw79BioFM9zb447QPq1yl7E0tXPTJg7uWBXuI8k7QYTs8cI-Y Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 7b37b36096cd42f6b6568ff9eee2751c Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-MigrationsAdminTest-29591251 Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7b37b36096cd42f6b6568ff9eee2751c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7b37b36096cd42f6b6568ff9eee2751c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7b37b36096cd42f6b6568ff9eee2751c", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7b37b36096cd42f6b6568ff9eee2751c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-MigrationsAdminTest-29591251 Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 7b37b36096cd42f6b6568ff9eee2751c Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-MigrationsAdminTest-29591251 Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-MigrationsAdminTest-29591251-project Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 77d854474f4c4481ac407a76b4627c69 Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-MigrationsAdminTest-29591251-project Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 3d4f7a57-fa07-41db-97de-a6fed43e9feb could not be found. Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '3d4f7a57-fa07-41db-97de-a6fed43e9feb'} Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d4f7a57-fa07-41db-97de-a6fed43e9feb could not be found. Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d4f7a57-fa07-41db-97de-a6fed43e9feb could not be found. Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:46:58.012224 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:46:58.015989 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:46:58.015989 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:46:58.015989 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:46:58.015989 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:46:58.015989 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:46:58.015989 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d4f7a57-fa07-41db-97de-a6fed43e9feb could not be found. Sep 10 11:46:58.015989 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:46:58.015989 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9fc745bf-ed8d-4684-8b0c-6b4d0b0a737c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Returning 404 to user: Instance 3d4f7a57-fa07-41db-97de-a6fed43e9feb could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:46:58.015989 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9fc745bf-ed8d-4684-8b0c-6b4d0b0a737c tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb" status: 404 len: 111 microversion: 2.1 time: 0.099853 Sep 10 11:46:58.015989 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 911/1912] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:57 2022] GET /compute/v2.1/servers/3d4f7a57-fa07-41db-97de-a6fed43e9feb => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 11:46:58.022625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-db8018a5-a859-488d-95d4-92ecafbdec3b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:58.023147 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-db8018a5-a859-488d-95d4-92ecafbdec3b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:58.031482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-db8018a5-a859-488d-95d4-92ecafbdec3b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:58.032125 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-db8018a5-a859-488d-95d4-92ecafbdec3b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:58.032629 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-db8018a5-a859-488d-95d4-92ecafbdec3b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:58.033736 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-db8018a5-a859-488d-95d4-92ecafbdec3b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:58.034448 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-db8018a5-a859-488d-95d4-92ecafbdec3b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:58.035117 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-db8018a5-a859-488d-95d4-92ecafbdec3b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:58.084333 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-db8018a5-a859-488d-95d4-92ecafbdec3b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:46:58.269162 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-db8018a5-a859-488d-95d4-92ecafbdec3b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 204 len: 0 microversion: 2.1 time: 0.249782 Sep 10 11:46:58.270395 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 912/1913] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:46:58 2022] DELETE /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:46:58.278172 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fc1ad30c-3e67-4e74-8cee-529b489c573a tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:58.279296 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fc1ad30c-3e67-4e74-8cee-529b489c573a tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:58.288623 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:46:58.291328 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc1ad30c-3e67-4e74-8cee-529b489c573a tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:58.292019 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc1ad30c-3e67-4e74-8cee-529b489c573a tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:58.292935 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc1ad30c-3e67-4e74-8cee-529b489c573a tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:58.293732 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc1ad30c-3e67-4e74-8cee-529b489c573a tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:58.294324 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc1ad30c-3e67-4e74-8cee-529b489c573a tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:58.295008 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc1ad30c-3e67-4e74-8cee-529b489c573a tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:58.421392 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c4fc2a7e-ccf1-48fd-bde9-c31944774623 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:58.434463 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c4fc2a7e-ccf1-48fd-bde9-c31944774623 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:58.436001 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c4fc2a7e-ccf1-48fd-bde9-c31944774623 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:58.437265 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c4fc2a7e-ccf1-48fd-bde9-c31944774623 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1875 microversion: 2.32 time: 0.673990 Sep 10 11:46:58.448270 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1002/1914] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:57 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1875 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:58.463666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5ca0ba57-3d19-46cc-9456-2c5e86b9e18b tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:58.464402 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5ca0ba57-3d19-46cc-9456-2c5e86b9e18b tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: f33c83e4-9881-4c1e-a502-ad9589fd597c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:58.471268 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ca0ba57-3d19-46cc-9456-2c5e86b9e18b tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:58.472109 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ca0ba57-3d19-46cc-9456-2c5e86b9e18b tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:58.472791 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ca0ba57-3d19-46cc-9456-2c5e86b9e18b tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:58.474280 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ca0ba57-3d19-46cc-9456-2c5e86b9e18b tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:58.477483 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ca0ba57-3d19-46cc-9456-2c5e86b9e18b tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:58.478156 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ca0ba57-3d19-46cc-9456-2c5e86b9e18b tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:58.589169 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5ca0ba57-3d19-46cc-9456-2c5e86b9e18b tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ea7c11febf451da4f1faf4dff9471d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f601d0bb424da4bb02b532ac982878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:58.608231 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5ca0ba57-3d19-46cc-9456-2c5e86b9e18b tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "GET /compute/v2.1/servers/f33c83e4-9881-4c1e-a502-ad9589fd597c" status: 200 len: 1270 microversion: 2.1 time: 0.158588 Sep 10 11:46:58.609400 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1003/1915] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:58 2022] GET /compute/v2.1/servers/f33c83e4-9881-4c1e-a502-ad9589fd597c => generated 1270 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:58.619630 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fc1ad30c-3e67-4e74-8cee-529b489c573a tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:58.620713 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-326d2e0a-c1f6-474b-a331-ed5acb5f444b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:58.621477 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-326d2e0a-c1f6-474b-a331-ed5acb5f444b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:58.632292 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fc1ad30c-3e67-4e74-8cee-529b489c573a tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1294 microversion: 2.1 time: 0.360241 Sep 10 11:46:58.634887 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-326d2e0a-c1f6-474b-a331-ed5acb5f444b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:58.636387 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-326d2e0a-c1f6-474b-a331-ed5acb5f444b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:58.637161 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-326d2e0a-c1f6-474b-a331-ed5acb5f444b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:58.638021 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-326d2e0a-c1f6-474b-a331-ed5acb5f444b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:58.643927 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 913/1916] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:58 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1294 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:58.644993 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-326d2e0a-c1f6-474b-a331-ed5acb5f444b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:58.645690 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-326d2e0a-c1f6-474b-a331-ed5acb5f444b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:58.651614 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-40805e66-6e67-490d-b873-185158c1572b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:58.652186 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-40805e66-6e67-490d-b873-185158c1572b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:58.672028 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-40805e66-6e67-490d-b873-185158c1572b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:58.672528 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-40805e66-6e67-490d-b873-185158c1572b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:58.674240 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-40805e66-6e67-490d-b873-185158c1572b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:58.677185 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-40805e66-6e67-490d-b873-185158c1572b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:58.677185 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-40805e66-6e67-490d-b873-185158c1572b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:58.677399 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-40805e66-6e67-490d-b873-185158c1572b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:58.886058 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-326d2e0a-c1f6-474b-a331-ed5acb5f444b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:58.898292 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-326d2e0a-c1f6-474b-a331-ed5acb5f444b tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1533 microversion: 2.1 time: 0.287610 Sep 10 11:46:58.906199 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-40805e66-6e67-490d-b873-185158c1572b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:58.906495 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1004/1917] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:58 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1533 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:58.912239 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0ad81cd5-32b8-45d2-a57d-e482907bb593 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:58.915637 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-40805e66-6e67-490d-b873-185158c1572b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:58.917179 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-40805e66-6e67-490d-b873-185158c1572b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:58.918107 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0ad81cd5-32b8-45d2-a57d-e482907bb593 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d89db381-1e9d-40ee-b076-b024d38d38b1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:58.918370 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-40805e66-6e67-490d-b873-185158c1572b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1482 microversion: 2.25 time: 0.272105 Sep 10 11:46:58.931432 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 914/1918] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:58 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1482 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:46:58.937536 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ad81cd5-32b8-45d2-a57d-e482907bb593 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:58.938028 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ad81cd5-32b8-45d2-a57d-e482907bb593 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:58.938462 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ad81cd5-32b8-45d2-a57d-e482907bb593 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:58.939190 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ad81cd5-32b8-45d2-a57d-e482907bb593 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:58.939649 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ad81cd5-32b8-45d2-a57d-e482907bb593 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:58.940653 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ad81cd5-32b8-45d2-a57d-e482907bb593 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:59.103556 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0ad81cd5-32b8-45d2-a57d-e482907bb593 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:46:59.121349 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0ad81cd5-32b8-45d2-a57d-e482907bb593 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1" status: 200 len: 1316 microversion: 2.1 time: 0.210817 Sep 10 11:46:59.138644 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1005/1919] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:58 2022] GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1 => generated 1316 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:46:59.467531 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c65f1039-9885-49d4-a7f0-edf007391544 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:59.468459 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c65f1039-9885-49d4-a7f0-edf007391544 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:59.481926 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c65f1039-9885-49d4-a7f0-edf007391544 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:59.482501 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c65f1039-9885-49d4-a7f0-edf007391544 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:59.483010 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c65f1039-9885-49d4-a7f0-edf007391544 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:59.483972 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c65f1039-9885-49d4-a7f0-edf007391544 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:59.492942 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c65f1039-9885-49d4-a7f0-edf007391544 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:59.500721 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c65f1039-9885-49d4-a7f0-edf007391544 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:59.513692 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:46:59.634435 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-daccb67a-fcd0-4de9-915d-19781b5ff0e8 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:46:59.635049 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-daccb67a-fcd0-4de9-915d-19781b5ff0e8 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: f33c83e4-9881-4c1e-a502-ad9589fd597c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:46:59.643535 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-daccb67a-fcd0-4de9-915d-19781b5ff0e8 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:59.644017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-daccb67a-fcd0-4de9-915d-19781b5ff0e8 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:59.644451 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-daccb67a-fcd0-4de9-915d-19781b5ff0e8 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:46:59.645160 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-daccb67a-fcd0-4de9-915d-19781b5ff0e8 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:46:59.645606 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-daccb67a-fcd0-4de9-915d-19781b5ff0e8 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:46:59.650720 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-daccb67a-fcd0-4de9-915d-19781b5ff0e8 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:00.080262 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c65f1039-9885-49d4-a7f0-edf007391544 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:00.099466 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c65f1039-9885-49d4-a7f0-edf007391544 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:00.101169 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c65f1039-9885-49d4-a7f0-edf007391544 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:00.102473 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c65f1039-9885-49d4-a7f0-edf007391544 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1875 microversion: 2.32 time: 0.638952 Sep 10 11:47:00.108728 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 915/1920] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:46:59 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1875 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:47:00.114678 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-df2dd2aa-8a37-40a9-8926-9dddc6687bce tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:00.128125 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-df2dd2aa-8a37-40a9-8926-9dddc6687bce tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:00.135193 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-df2dd2aa-8a37-40a9-8926-9dddc6687bce tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:00.135925 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-df2dd2aa-8a37-40a9-8926-9dddc6687bce tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:00.136600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-df2dd2aa-8a37-40a9-8926-9dddc6687bce tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:00.137523 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-df2dd2aa-8a37-40a9-8926-9dddc6687bce tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:00.138181 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-df2dd2aa-8a37-40a9-8926-9dddc6687bce tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:00.138811 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-df2dd2aa-8a37-40a9-8926-9dddc6687bce tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:00.171373 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-daccb67a-fcd0-4de9-915d-19781b5ff0e8 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ea7c11febf451da4f1faf4dff9471d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f601d0bb424da4bb02b532ac982878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:00.181951 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-daccb67a-fcd0-4de9-915d-19781b5ff0e8 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "GET /compute/v2.1/servers/f33c83e4-9881-4c1e-a502-ad9589fd597c" status: 200 len: 1318 microversion: 2.1 time: 0.551280 Sep 10 11:47:00.182589 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1006/1921] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:46:59 2022] GET /compute/v2.1/servers/f33c83e4-9881-4c1e-a502-ad9589fd597c => generated 1318 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:47:00.210668 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b5cd42e2-dac9-4cd8-b163-77299ff15df5 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:00.211428 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b5cd42e2-dac9-4cd8-b163-77299ff15df5 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:00.219357 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5cd42e2-dac9-4cd8-b163-77299ff15df5 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:00.219872 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5cd42e2-dac9-4cd8-b163-77299ff15df5 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:00.220324 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5cd42e2-dac9-4cd8-b163-77299ff15df5 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:00.221873 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5cd42e2-dac9-4cd8-b163-77299ff15df5 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:00.222335 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5cd42e2-dac9-4cd8-b163-77299ff15df5 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:00.222824 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5cd42e2-dac9-4cd8-b163-77299ff15df5 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:00.638222 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-df2dd2aa-8a37-40a9-8926-9dddc6687bce tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:00.649423 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-df2dd2aa-8a37-40a9-8926-9dddc6687bce tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1294 microversion: 2.1 time: 0.539260 Sep 10 11:47:00.650347 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 916/1922] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:00 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1294 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:00.657124 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-14bb2aed-0fdb-4cd9-b42d-0876324a04ed tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:00.661885 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-14bb2aed-0fdb-4cd9-b42d-0876324a04ed tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:00.678449 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-14bb2aed-0fdb-4cd9-b42d-0876324a04ed tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:00.679221 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-14bb2aed-0fdb-4cd9-b42d-0876324a04ed tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:00.682011 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-14bb2aed-0fdb-4cd9-b42d-0876324a04ed tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:00.684704 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-14bb2aed-0fdb-4cd9-b42d-0876324a04ed tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:00.685281 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-14bb2aed-0fdb-4cd9-b42d-0876324a04ed tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:00.685740 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-14bb2aed-0fdb-4cd9-b42d-0876324a04ed tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:00.717071 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b5cd42e2-dac9-4cd8-b163-77299ff15df5 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:00.746141 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b5cd42e2-dac9-4cd8-b163-77299ff15df5 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1533 microversion: 2.1 time: 0.540429 Sep 10 11:47:00.746856 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1007/1923] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:00 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1533 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:00.767322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c76cf967-2084-4e13-b54f-0667ea3c9417 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:00.773302 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c76cf967-2084-4e13-b54f-0667ea3c9417 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d89db381-1e9d-40ee-b076-b024d38d38b1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:00.805279 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c76cf967-2084-4e13-b54f-0667ea3c9417 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:00.805983 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c76cf967-2084-4e13-b54f-0667ea3c9417 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:00.806589 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c76cf967-2084-4e13-b54f-0667ea3c9417 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:00.807499 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c76cf967-2084-4e13-b54f-0667ea3c9417 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:00.808123 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c76cf967-2084-4e13-b54f-0667ea3c9417 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:00.808706 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c76cf967-2084-4e13-b54f-0667ea3c9417 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:00.841744 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:47:01.004368 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-14bb2aed-0fdb-4cd9-b42d-0876324a04ed tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:01.024228 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-14bb2aed-0fdb-4cd9-b42d-0876324a04ed tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:01.026511 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-14bb2aed-0fdb-4cd9-b42d-0876324a04ed tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:01.029173 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-14bb2aed-0fdb-4cd9-b42d-0876324a04ed tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1440 microversion: 2.25 time: 0.375670 Sep 10 11:47:01.030679 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 917/1924] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:47:00 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1440 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:47:01.036446 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-24fa66ea-5c0b-4c9c-abd3-8cf5a7a0b1ca req-befe6654-3d6b-4dec-8efd-3372f1015ced service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a62a6c44-9d92-4766-a81d-c09670110ab4", "name": "network-vif-deleted", "tag": "2bd5dc49-b958-48da-8036-9f8348b0324b"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:01.051516 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-24fa66ea-5c0b-4c9c-abd3-8cf5a7a0b1ca req-befe6654-3d6b-4dec-8efd-3372f1015ced service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:01.052230 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-24fa66ea-5c0b-4c9c-abd3-8cf5a7a0b1ca req-befe6654-3d6b-4dec-8efd-3372f1015ced service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:01.052866 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-24fa66ea-5c0b-4c9c-abd3-8cf5a7a0b1ca req-befe6654-3d6b-4dec-8efd-3372f1015ced service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:01.072296 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-24fa66ea-5c0b-4c9c-abd3-8cf5a7a0b1ca req-befe6654-3d6b-4dec-8efd-3372f1015ced service nova] Creating event network-vif-deleted:2bd5dc49-b958-48da-8036-9f8348b0324b for instance a62a6c44-9d92-4766-a81d-c09670110ab4 on n-h1-856895-1 Sep 10 11:47:01.083076 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-24fa66ea-5c0b-4c9c-abd3-8cf5a7a0b1ca req-befe6654-3d6b-4dec-8efd-3372f1015ced service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050782 Sep 10 11:47:01.084776 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 918/1925] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:47:01.138775 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5ab3b2b4-0efd-47c3-9a47-c1824783e9c2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:01.139766 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5ab3b2b4-0efd-47c3-9a47-c1824783e9c2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:01.148457 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ab3b2b4-0efd-47c3-9a47-c1824783e9c2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:01.149193 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ab3b2b4-0efd-47c3-9a47-c1824783e9c2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:01.149863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ab3b2b4-0efd-47c3-9a47-c1824783e9c2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:01.150785 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ab3b2b4-0efd-47c3-9a47-c1824783e9c2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:01.152970 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ab3b2b4-0efd-47c3-9a47-c1824783e9c2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:01.153588 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ab3b2b4-0efd-47c3-9a47-c1824783e9c2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:01.164933 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c76cf967-2084-4e13-b54f-0667ea3c9417 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:01.173162 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c76cf967-2084-4e13-b54f-0667ea3c9417 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1" status: 200 len: 1316 microversion: 2.1 time: 0.425158 Sep 10 11:47:01.187415 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1008/1926] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:00 2022] GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1 => generated 1316 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:01.206171 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e7122ee0-d01e-4436-896e-29edc2869d78 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:01.206513 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e7122ee0-d01e-4436-896e-29edc2869d78 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: f33c83e4-9881-4c1e-a502-ad9589fd597c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:01.225312 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e7122ee0-d01e-4436-896e-29edc2869d78 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:01.225893 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e7122ee0-d01e-4436-896e-29edc2869d78 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:01.226336 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e7122ee0-d01e-4436-896e-29edc2869d78 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:01.228336 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e7122ee0-d01e-4436-896e-29edc2869d78 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:01.228815 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e7122ee0-d01e-4436-896e-29edc2869d78 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:01.229255 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e7122ee0-d01e-4436-896e-29edc2869d78 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:01.708444 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5ab3b2b4-0efd-47c3-9a47-c1824783e9c2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:01.725914 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5ab3b2b4-0efd-47c3-9a47-c1824783e9c2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:01.750975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5ab3b2b4-0efd-47c3-9a47-c1824783e9c2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:01.756646 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e7122ee0-d01e-4436-896e-29edc2869d78 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ea7c11febf451da4f1faf4dff9471d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f601d0bb424da4bb02b532ac982878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:01.757512 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5ab3b2b4-0efd-47c3-9a47-c1824783e9c2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1875 microversion: 2.32 time: 0.618479 Sep 10 11:47:01.777384 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 919/1927] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:47:01 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1875 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:47:01.781523 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e7122ee0-d01e-4436-896e-29edc2869d78 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "GET /compute/v2.1/servers/f33c83e4-9881-4c1e-a502-ad9589fd597c" status: 200 len: 1318 microversion: 2.1 time: 0.576867 Sep 10 11:47:01.795190 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-2c37f9b0-a16f-4b87-ba4f-4a0eab567b35 req-7f5f7fe5-9a87-4eb0-a941-074c73ffceac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc446beb-aed5-4d4e-954b-30c480f62ef0", "name": "network-vif-deleted", "tag": "d53a3f4b-c348-4a6d-b50f-9111fcac793a"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:01.802732 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1009/1928] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:01 2022] GET /compute/v2.1/servers/f33c83e4-9881-4c1e-a502-ad9589fd597c => generated 1318 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:01.819083 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c17e2312-83be-436c-be4c-becc10eb77bf tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:01.821253 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c17e2312-83be-436c-be4c-becc10eb77bf tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:01.828707 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c17e2312-83be-436c-be4c-becc10eb77bf tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:01.829515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c17e2312-83be-436c-be4c-becc10eb77bf tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:01.830113 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c17e2312-83be-436c-be4c-becc10eb77bf tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:01.831832 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c17e2312-83be-436c-be4c-becc10eb77bf tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:01.837294 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c17e2312-83be-436c-be4c-becc10eb77bf tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:01.838334 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c17e2312-83be-436c-be4c-becc10eb77bf tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:01.850563 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-2c37f9b0-a16f-4b87-ba4f-4a0eab567b35 req-7f5f7fe5-9a87-4eb0-a941-074c73ffceac service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:01.851072 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-2c37f9b0-a16f-4b87-ba4f-4a0eab567b35 req-7f5f7fe5-9a87-4eb0-a941-074c73ffceac service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:01.851547 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-2c37f9b0-a16f-4b87-ba4f-4a0eab567b35 req-7f5f7fe5-9a87-4eb0-a941-074c73ffceac service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:01.902035 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-2c37f9b0-a16f-4b87-ba4f-4a0eab567b35 req-7f5f7fe5-9a87-4eb0-a941-074c73ffceac service nova] Creating event network-vif-deleted:d53a3f4b-c348-4a6d-b50f-9111fcac793a for instance bc446beb-aed5-4d4e-954b-30c480f62ef0 on n-h1-856895-1 Sep 10 11:47:01.926485 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-2c37f9b0-a16f-4b87-ba4f-4a0eab567b35 req-7f5f7fe5-9a87-4eb0-a941-074c73ffceac service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143374 Sep 10 11:47:01.929932 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 920/1929] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:47:01.952394 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4b0ec242-58c7-47fd-bf08-83964b5504d8 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:01.955629 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4b0ec242-58c7-47fd-bf08-83964b5504d8 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:01.972683 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b0ec242-58c7-47fd-bf08-83964b5504d8 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:01.974402 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b0ec242-58c7-47fd-bf08-83964b5504d8 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:01.977295 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b0ec242-58c7-47fd-bf08-83964b5504d8 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:01.978448 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b0ec242-58c7-47fd-bf08-83964b5504d8 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:01.979093 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b0ec242-58c7-47fd-bf08-83964b5504d8 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:01.979844 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b0ec242-58c7-47fd-bf08-83964b5504d8 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:02.069338 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b0ec242-58c7-47fd-bf08-83964b5504d8 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:02.070660 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b0ec242-58c7-47fd-bf08-83964b5504d8 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:02.071533 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b0ec242-58c7-47fd-bf08-83964b5504d8 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:02.072341 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-4b0ec242-58c7-47fd-bf08-83964b5504d8 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lazy-loading 'fault' on Instance uuid bc446beb-aed5-4d4e-954b-30c480f62ef0 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:47:02.223521 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4b0ec242-58c7-47fd-bf08-83964b5504d8 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:02.248737 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4b0ec242-58c7-47fd-bf08-83964b5504d8 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 200 len: 1368 microversion: 2.1 time: 0.315519 Sep 10 11:47:02.258613 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 921/1930] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:01 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 1368 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:02.275369 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4617e428-3ed0-4946-8b93-b6f084370d7a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:02.276392 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4617e428-3ed0-4946-8b93-b6f084370d7a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:02.287501 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4617e428-3ed0-4946-8b93-b6f084370d7a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:02.288419 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4617e428-3ed0-4946-8b93-b6f084370d7a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:02.291492 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4617e428-3ed0-4946-8b93-b6f084370d7a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:02.293329 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4617e428-3ed0-4946-8b93-b6f084370d7a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:02.294051 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4617e428-3ed0-4946-8b93-b6f084370d7a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:02.295267 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4617e428-3ed0-4946-8b93-b6f084370d7a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:02.462158 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4617e428-3ed0-4946-8b93-b6f084370d7a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:02.465389 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c17e2312-83be-436c-be4c-becc10eb77bf tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:02.488573 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c17e2312-83be-436c-be4c-becc10eb77bf tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1294 microversion: 2.1 time: 0.674707 Sep 10 11:47:02.489397 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1010/1931] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:01 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1294 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:02.494026 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4617e428-3ed0-4946-8b93-b6f084370d7a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:02.496799 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4617e428-3ed0-4946-8b93-b6f084370d7a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:02.499415 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4617e428-3ed0-4946-8b93-b6f084370d7a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1266 microversion: 2.25 time: 0.237916 Sep 10 11:47:02.503486 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c7aa3042-0ec6-4c12-a4ef-61904fd4167a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:02.504664 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c7aa3042-0ec6-4c12-a4ef-61904fd4167a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d89db381-1e9d-40ee-b076-b024d38d38b1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:02.512823 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7aa3042-0ec6-4c12-a4ef-61904fd4167a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:02.513556 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7aa3042-0ec6-4c12-a4ef-61904fd4167a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:02.514136 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7aa3042-0ec6-4c12-a4ef-61904fd4167a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:02.518051 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 922/1932] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:47:02 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1266 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:47:02.527441 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7aa3042-0ec6-4c12-a4ef-61904fd4167a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:02.528064 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7aa3042-0ec6-4c12-a4ef-61904fd4167a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:02.528522 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7aa3042-0ec6-4c12-a4ef-61904fd4167a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:02.794037 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-99809a0c-5173-45cf-ae37-589e952b8833 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:02.794688 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-99809a0c-5173-45cf-ae37-589e952b8833 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:02.805860 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-99809a0c-5173-45cf-ae37-589e952b8833 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:02.811492 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-99809a0c-5173-45cf-ae37-589e952b8833 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:02.812100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-99809a0c-5173-45cf-ae37-589e952b8833 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:02.812864 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-99809a0c-5173-45cf-ae37-589e952b8833 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:02.813337 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-99809a0c-5173-45cf-ae37-589e952b8833 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:02.813778 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-99809a0c-5173-45cf-ae37-589e952b8833 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:02.842411 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c7aa3042-0ec6-4c12-a4ef-61904fd4167a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:02.853368 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c7aa3042-0ec6-4c12-a4ef-61904fd4167a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1" status: 200 len: 1316 microversion: 2.1 time: 0.360537 Sep 10 11:47:02.855837 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1011/1933] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:02 2022] GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1 => generated 1316 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:02.862815 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0035aaff-f418-4a97-9cf5-73d728cb73ba tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:02.865614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0035aaff-f418-4a97-9cf5-73d728cb73ba tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: f33c83e4-9881-4c1e-a502-ad9589fd597c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:02.879480 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0035aaff-f418-4a97-9cf5-73d728cb73ba tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:02.880396 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0035aaff-f418-4a97-9cf5-73d728cb73ba tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:02.881057 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0035aaff-f418-4a97-9cf5-73d728cb73ba tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:02.881955 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0035aaff-f418-4a97-9cf5-73d728cb73ba tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:02.882719 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0035aaff-f418-4a97-9cf5-73d728cb73ba tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:02.883395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0035aaff-f418-4a97-9cf5-73d728cb73ba tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:03.638502 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-99809a0c-5173-45cf-ae37-589e952b8833 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:03.642137 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0035aaff-f418-4a97-9cf5-73d728cb73ba tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ea7c11febf451da4f1faf4dff9471d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f601d0bb424da4bb02b532ac982878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:03.659687 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0035aaff-f418-4a97-9cf5-73d728cb73ba tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "GET /compute/v2.1/servers/f33c83e4-9881-4c1e-a502-ad9589fd597c" status: 200 len: 1318 microversion: 2.1 time: 0.799577 Sep 10 11:47:03.662460 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1012/1934] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:02 2022] GET /compute/v2.1/servers/f33c83e4-9881-4c1e-a502-ad9589fd597c => generated 1318 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:03.669678 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7c85642a-4726-43d9-862d-d81c209b58e9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:03.670567 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7c85642a-4726-43d9-862d-d81c209b58e9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: bc446beb-aed5-4d4e-954b-30c480f62ef0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:03.683154 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c85642a-4726-43d9-862d-d81c209b58e9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:03.684571 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c85642a-4726-43d9-862d-d81c209b58e9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:03.685749 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c85642a-4726-43d9-862d-d81c209b58e9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:03.687151 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c85642a-4726-43d9-862d-d81c209b58e9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:03.687930 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c85642a-4726-43d9-862d-d81c209b58e9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:03.688521 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c85642a-4726-43d9-862d-d81c209b58e9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:03.691844 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-99809a0c-5173-45cf-ae37-589e952b8833 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:03.695382 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-99809a0c-5173-45cf-ae37-589e952b8833 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:03.696841 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-99809a0c-5173-45cf-ae37-589e952b8833 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1875 microversion: 2.32 time: 0.906973 Sep 10 11:47:03.699733 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 923/1935] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:47:02 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1875 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:47:03.706956 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a6b5d21c-0041-49b9-b6d5-5e70cfd967b3 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:03.710942 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a6b5d21c-0041-49b9-b6d5-5e70cfd967b3 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:03.732001 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-7c85642a-4726-43d9-862d-d81c209b58e9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] HTTP exception thrown: Instance bc446beb-aed5-4d4e-954b-30c480f62ef0 could not be found. Sep 10 11:47:03.732616 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6b5d21c-0041-49b9-b6d5-5e70cfd967b3 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:03.733440 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6b5d21c-0041-49b9-b6d5-5e70cfd967b3 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:03.734233 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6b5d21c-0041-49b9-b6d5-5e70cfd967b3 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7c85642a-4726-43d9-862d-d81c209b58e9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Request method failure captured: Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 HTTP/1.1 Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHf7mACdlfzYNqqdAdehYL4NCPaTh2LiHYzzG2y_R-m91DirSD9NpPMperwROx5CtpOnZxmqPDNB9-2DL_apNDkdE-LB__QyjBTbYbDUeOWNR455kuIEfcUXxBZGOPYw79BioFM9zb447QPq1yl7E0tXPTJg7uWBXuI8k7QYTs8cI-Y Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 7b37b36096cd42f6b6568ff9eee2751c Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-MigrationsAdminTest-29591251 Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7b37b36096cd42f6b6568ff9eee2751c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7b37b36096cd42f6b6568ff9eee2751c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7b37b36096cd42f6b6568ff9eee2751c", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7b37b36096cd42f6b6568ff9eee2751c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-MigrationsAdminTest-29591251 Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 7b37b36096cd42f6b6568ff9eee2751c Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-MigrationsAdminTest-29591251 Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-MigrationsAdminTest-29591251-project Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 77d854474f4c4481ac407a76b4627c69 Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-MigrationsAdminTest-29591251-project Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance bc446beb-aed5-4d4e-954b-30c480f62ef0 could not be found. Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'bc446beb-aed5-4d4e-954b-30c480f62ef0'} Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc446beb-aed5-4d4e-954b-30c480f62ef0 could not be found. Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc446beb-aed5-4d4e-954b-30c480f62ef0 could not be found. Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:47:03.736765 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:03.742059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:03.742059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:47:03.742059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:47:03.742059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:47:03.742059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:47:03.742059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc446beb-aed5-4d4e-954b-30c480f62ef0 could not be found. Sep 10 11:47:03.742059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:03.745251 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6b5d21c-0041-49b9-b6d5-5e70cfd967b3 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:03.745251 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6b5d21c-0041-49b9-b6d5-5e70cfd967b3 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:03.745251 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6b5d21c-0041-49b9-b6d5-5e70cfd967b3 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:03.745729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7c85642a-4726-43d9-862d-d81c209b58e9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Returning 404 to user: Instance bc446beb-aed5-4d4e-954b-30c480f62ef0 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:47:03.745729 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7c85642a-4726-43d9-862d-d81c209b58e9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0" status: 404 len: 111 microversion: 2.1 time: 0.080018 Sep 10 11:47:03.745887 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1013/1936] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:03 2022] GET /compute/v2.1/servers/bc446beb-aed5-4d4e-954b-30c480f62ef0 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:47:03.757115 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-47f1fa5d-e7cf-4000-a856-be036f3d118b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:03.757763 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-47f1fa5d-e7cf-4000-a856-be036f3d118b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:03.766230 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47f1fa5d-e7cf-4000-a856-be036f3d118b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:03.766775 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47f1fa5d-e7cf-4000-a856-be036f3d118b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:03.767256 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47f1fa5d-e7cf-4000-a856-be036f3d118b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:03.767978 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47f1fa5d-e7cf-4000-a856-be036f3d118b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:03.769097 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47f1fa5d-e7cf-4000-a856-be036f3d118b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:03.769742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47f1fa5d-e7cf-4000-a856-be036f3d118b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:03.898174 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-47f1fa5d-e7cf-4000-a856-be036f3d118b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:03.917738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-47f1fa5d-e7cf-4000-a856-be036f3d118b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:03.919498 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-47f1fa5d-e7cf-4000-a856-be036f3d118b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:03.921444 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-47f1fa5d-e7cf-4000-a856-be036f3d118b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1266 microversion: 2.25 time: 0.169493 Sep 10 11:47:03.935734 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1014/1937] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:47:03 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:47:03.946107 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d5e7bb9e-933d-4200-86fd-4e0ace5cf886 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '.version_select at 0x7f407b5e4940>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:03.977857 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d5e7bb9e-933d-4200-86fd-4e0ace5cf886 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1390828912" status: 202 len: 0 microversion: 2.1 time: 0.039967 Sep 10 11:47:03.981084 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1015/1938] 10.222.0.23 () {58 vars in 1221 bytes} [Sat Sep 10 11:47:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1390828912 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:47:03.984715 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a6b5d21c-0041-49b9-b6d5-5e70cfd967b3 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:03.993586 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a6b5d21c-0041-49b9-b6d5-5e70cfd967b3 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1294 microversion: 2.1 time: 0.292564 Sep 10 11:47:03.999316 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9934cd59-2d40-4950-a1d8-7f26fec764f7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:04.000121 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 924/1939] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:03 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1294 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:04.008289 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-3ac970b6-cdb7-4c9c-b82e-f327d00a5e9d req-fa0ba627-5a42-4896-a61a-103b7eebffaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f33c83e4-9881-4c1e-a502-ad9589fd597c", "tag": "84f563f5-a3fe-4606-b3e5-e437d2a0c4c5"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:04.011899 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9934cd59-2d40-4950-a1d8-7f26fec764f7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d89db381-1e9d-40ee-b076-b024d38d38b1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:04.029074 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:47:04.036479 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9934cd59-2d40-4950-a1d8-7f26fec764f7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:04.037114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9934cd59-2d40-4950-a1d8-7f26fec764f7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:04.038459 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9934cd59-2d40-4950-a1d8-7f26fec764f7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:04.040420 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9934cd59-2d40-4950-a1d8-7f26fec764f7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:04.041693 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9934cd59-2d40-4950-a1d8-7f26fec764f7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:04.043993 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9934cd59-2d40-4950-a1d8-7f26fec764f7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:04.050591 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-3ac970b6-cdb7-4c9c-b82e-f327d00a5e9d req-fa0ba627-5a42-4896-a61a-103b7eebffaa service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:04.051433 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-3ac970b6-cdb7-4c9c-b82e-f327d00a5e9d req-fa0ba627-5a42-4896-a61a-103b7eebffaa service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:04.054156 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-3ac970b6-cdb7-4c9c-b82e-f327d00a5e9d req-fa0ba627-5a42-4896-a61a-103b7eebffaa service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:04.102890 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-3ac970b6-cdb7-4c9c-b82e-f327d00a5e9d req-fa0ba627-5a42-4896-a61a-103b7eebffaa service nova] Creating event network-changed:84f563f5-a3fe-4606-b3e5-e437d2a0c4c5 for instance f33c83e4-9881-4c1e-a502-ad9589fd597c on n-h2-856895-1 Sep 10 11:47:04.123687 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-3ac970b6-cdb7-4c9c-b82e-f327d00a5e9d req-fa0ba627-5a42-4896-a61a-103b7eebffaa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120952 Sep 10 11:47:04.128113 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 925/1940] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:47:04.477897 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9934cd59-2d40-4950-a1d8-7f26fec764f7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:04.489804 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9934cd59-2d40-4950-a1d8-7f26fec764f7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1" status: 200 len: 1316 microversion: 2.1 time: 0.499267 Sep 10 11:47:04.510400 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1016/1941] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:03 2022] GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1 => generated 1316 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:04.693529 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1eb87a5c-a7f4-45fc-b984-5e850c6ebdf6 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:04.695029 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1eb87a5c-a7f4-45fc-b984-5e850c6ebdf6 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: f33c83e4-9881-4c1e-a502-ad9589fd597c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:04.703270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1eb87a5c-a7f4-45fc-b984-5e850c6ebdf6 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:04.703805 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1eb87a5c-a7f4-45fc-b984-5e850c6ebdf6 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:04.704255 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1eb87a5c-a7f4-45fc-b984-5e850c6ebdf6 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:04.704984 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1eb87a5c-a7f4-45fc-b984-5e850c6ebdf6 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:04.705446 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1eb87a5c-a7f4-45fc-b984-5e850c6ebdf6 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:04.706104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1eb87a5c-a7f4-45fc-b984-5e850c6ebdf6 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:04.728518 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ce0be805-3f5f-40ef-975d-5405254eb0e0 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:04.729147 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ce0be805-3f5f-40ef-975d-5405254eb0e0 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:04.740557 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ce0be805-3f5f-40ef-975d-5405254eb0e0 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:04.747732 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ce0be805-3f5f-40ef-975d-5405254eb0e0 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:04.748379 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ce0be805-3f5f-40ef-975d-5405254eb0e0 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:04.749159 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ce0be805-3f5f-40ef-975d-5405254eb0e0 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:04.749638 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ce0be805-3f5f-40ef-975d-5405254eb0e0 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:04.750077 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ce0be805-3f5f-40ef-975d-5405254eb0e0 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:05.069082 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1eb87a5c-a7f4-45fc-b984-5e850c6ebdf6 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ea7c11febf451da4f1faf4dff9471d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f601d0bb424da4bb02b532ac982878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:05.077924 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1eb87a5c-a7f4-45fc-b984-5e850c6ebdf6 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "GET /compute/v2.1/servers/f33c83e4-9881-4c1e-a502-ad9589fd597c" status: 200 len: 1318 microversion: 2.1 time: 0.391627 Sep 10 11:47:05.094588 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 926/1942] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:04 2022] GET /compute/v2.1/servers/f33c83e4-9881-4c1e-a502-ad9589fd597c => generated 1318 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:05.100212 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ea5fa742-dfb8-44d6-9ad5-d61fd3b2e1aa tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:05.101153 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ea5fa742-dfb8-44d6-9ad5-d61fd3b2e1aa tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:05.107701 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea5fa742-dfb8-44d6-9ad5-d61fd3b2e1aa tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:05.108482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea5fa742-dfb8-44d6-9ad5-d61fd3b2e1aa tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:05.109740 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea5fa742-dfb8-44d6-9ad5-d61fd3b2e1aa tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:05.110696 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea5fa742-dfb8-44d6-9ad5-d61fd3b2e1aa tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:05.111412 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea5fa742-dfb8-44d6-9ad5-d61fd3b2e1aa tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:05.112108 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea5fa742-dfb8-44d6-9ad5-d61fd3b2e1aa tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:05.136740 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ce0be805-3f5f-40ef-975d-5405254eb0e0 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:05.152574 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ce0be805-3f5f-40ef-975d-5405254eb0e0 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:05.154360 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ce0be805-3f5f-40ef-975d-5405254eb0e0 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:05.160662 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ce0be805-3f5f-40ef-975d-5405254eb0e0 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1875 microversion: 2.32 time: 0.436047 Sep 10 11:47:05.162050 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1017/1943] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:47:04 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1875 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:47:05.168163 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2df7c3e7-4a66-4ea0-8376-d231318f2e51 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:05.169301 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2df7c3e7-4a66-4ea0-8376-d231318f2e51 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:05.176823 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2df7c3e7-4a66-4ea0-8376-d231318f2e51 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:05.177726 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2df7c3e7-4a66-4ea0-8376-d231318f2e51 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:05.178383 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2df7c3e7-4a66-4ea0-8376-d231318f2e51 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:05.179540 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2df7c3e7-4a66-4ea0-8376-d231318f2e51 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:05.180334 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2df7c3e7-4a66-4ea0-8376-d231318f2e51 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:05.180996 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2df7c3e7-4a66-4ea0-8376-d231318f2e51 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:05.211148 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ea5fa742-dfb8-44d6-9ad5-d61fd3b2e1aa tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:05.220190 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ea5fa742-dfb8-44d6-9ad5-d61fd3b2e1aa tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:05.228823 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ea5fa742-dfb8-44d6-9ad5-d61fd3b2e1aa tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:05.230138 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ea5fa742-dfb8-44d6-9ad5-d61fd3b2e1aa tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1266 microversion: 2.25 time: 0.134168 Sep 10 11:47:05.231151 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 927/1944] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:47:05 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1266 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:47:05.311746 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-eb15eec4-bcdb-4a73-b30e-b54f1d010d69 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:05.312261 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-eb15eec4-bcdb-4a73-b30e-b54f1d010d69 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:05.321894 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eb15eec4-bcdb-4a73-b30e-b54f1d010d69 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:05.322669 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eb15eec4-bcdb-4a73-b30e-b54f1d010d69 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:05.324233 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eb15eec4-bcdb-4a73-b30e-b54f1d010d69 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:05.325379 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eb15eec4-bcdb-4a73-b30e-b54f1d010d69 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:05.326048 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eb15eec4-bcdb-4a73-b30e-b54f1d010d69 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:05.326691 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eb15eec4-bcdb-4a73-b30e-b54f1d010d69 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:05.360546 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-eb15eec4-bcdb-4a73-b30e-b54f1d010d69 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:47:05.451303 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2df7c3e7-4a66-4ea0-8376-d231318f2e51 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:05.461018 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2df7c3e7-4a66-4ea0-8376-d231318f2e51 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1294 microversion: 2.1 time: 0.297347 Sep 10 11:47:05.466908 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1018/1945] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:05 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1294 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:05.494719 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-eb15eec4-bcdb-4a73-b30e-b54f1d010d69 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "DELETE /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 204 len: 0 microversion: 2.1 time: 0.186136 Sep 10 11:47:05.495784 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 928/1946] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:47:05 2022] DELETE /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:47:05.505331 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a9c096eb-f3f5-4091-8583-4eafa0ba8512 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:05.506428 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a9c096eb-f3f5-4091-8583-4eafa0ba8512 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:05.512487 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9c096eb-f3f5-4091-8583-4eafa0ba8512 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:05.512698 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9c096eb-f3f5-4091-8583-4eafa0ba8512 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:05.513520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9c096eb-f3f5-4091-8583-4eafa0ba8512 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:05.513703 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9c096eb-f3f5-4091-8583-4eafa0ba8512 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:05.514508 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9c096eb-f3f5-4091-8583-4eafa0ba8512 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:05.514619 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9c096eb-f3f5-4091-8583-4eafa0ba8512 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:05.524542 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-930ac0d0-6fdf-4b1a-ab66-de496031dbd0 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:05.526247 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-930ac0d0-6fdf-4b1a-ab66-de496031dbd0 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d89db381-1e9d-40ee-b076-b024d38d38b1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:05.535998 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-930ac0d0-6fdf-4b1a-ab66-de496031dbd0 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:05.537393 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-930ac0d0-6fdf-4b1a-ab66-de496031dbd0 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:05.538334 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-930ac0d0-6fdf-4b1a-ab66-de496031dbd0 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:05.539361 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-930ac0d0-6fdf-4b1a-ab66-de496031dbd0 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:05.540524 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-930ac0d0-6fdf-4b1a-ab66-de496031dbd0 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:05.541300 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-930ac0d0-6fdf-4b1a-ab66-de496031dbd0 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:05.832104 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a9c096eb-f3f5-4091-8583-4eafa0ba8512 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:05.843351 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a9c096eb-f3f5-4091-8583-4eafa0ba8512 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 200 len: 1468 microversion: 2.1 time: 0.342642 Sep 10 11:47:05.859925 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1019/1947] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:05 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 1468 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:05.867221 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-930ac0d0-6fdf-4b1a-ab66-de496031dbd0 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:05.875869 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-930ac0d0-6fdf-4b1a-ab66-de496031dbd0 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1" status: 200 len: 1316 microversion: 2.1 time: 0.357533 Sep 10 11:47:05.876677 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 929/1948] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:05 2022] GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1 => generated 1316 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:06.103002 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1af04c2a-64ad-455f-a526-c472347a90b3 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:06.104027 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1af04c2a-64ad-455f-a526-c472347a90b3 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: f33c83e4-9881-4c1e-a502-ad9589fd597c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:06.111688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1af04c2a-64ad-455f-a526-c472347a90b3 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:06.113334 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1af04c2a-64ad-455f-a526-c472347a90b3 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:06.114046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1af04c2a-64ad-455f-a526-c472347a90b3 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:06.114998 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1af04c2a-64ad-455f-a526-c472347a90b3 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:06.116129 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1af04c2a-64ad-455f-a526-c472347a90b3 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:06.116803 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1af04c2a-64ad-455f-a526-c472347a90b3 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:06.191107 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f81d5a83-a149-4fe5-93f7-eba533c6a40d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:06.192148 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f81d5a83-a149-4fe5-93f7-eba533c6a40d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:06.206332 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f81d5a83-a149-4fe5-93f7-eba533c6a40d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:06.207379 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f81d5a83-a149-4fe5-93f7-eba533c6a40d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:06.208063 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f81d5a83-a149-4fe5-93f7-eba533c6a40d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:06.209312 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f81d5a83-a149-4fe5-93f7-eba533c6a40d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:06.209984 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f81d5a83-a149-4fe5-93f7-eba533c6a40d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:06.211426 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f81d5a83-a149-4fe5-93f7-eba533c6a40d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:06.350735 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:47:06.477622 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1af04c2a-64ad-455f-a526-c472347a90b3 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ea7c11febf451da4f1faf4dff9471d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f601d0bb424da4bb02b532ac982878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:06.491976 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1af04c2a-64ad-455f-a526-c472347a90b3 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "GET /compute/v2.1/servers/f33c83e4-9881-4c1e-a502-ad9589fd597c" status: 200 len: 1318 microversion: 2.1 time: 0.390984 Sep 10 11:47:06.492697 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1020/1949] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:06 2022] GET /compute/v2.1/servers/f33c83e4-9881-4c1e-a502-ad9589fd597c => generated 1318 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:47:06.516170 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-828f509d-b0c9-4ad6-84bf-3e2e76eb5889 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:06.516966 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-828f509d-b0c9-4ad6-84bf-3e2e76eb5889 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:06.527436 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-828f509d-b0c9-4ad6-84bf-3e2e76eb5889 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:06.527921 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-828f509d-b0c9-4ad6-84bf-3e2e76eb5889 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:06.540369 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-828f509d-b0c9-4ad6-84bf-3e2e76eb5889 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:06.541277 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-828f509d-b0c9-4ad6-84bf-3e2e76eb5889 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:06.541756 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-828f509d-b0c9-4ad6-84bf-3e2e76eb5889 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:06.542188 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-828f509d-b0c9-4ad6-84bf-3e2e76eb5889 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:06.545432 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f81d5a83-a149-4fe5-93f7-eba533c6a40d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:06.563971 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f81d5a83-a149-4fe5-93f7-eba533c6a40d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:06.566381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f81d5a83-a149-4fe5-93f7-eba533c6a40d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:06.567728 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f81d5a83-a149-4fe5-93f7-eba533c6a40d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1875 microversion: 2.32 time: 0.381697 Sep 10 11:47:06.580693 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 930/1950] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:47:06 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1875 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:47:06.594417 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-166007f9-5249-4412-b701-1e5e0dea5b4a req-22389aea-2add-4838-9f0d-bef50f9dcba1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d89db381-1e9d-40ee-b076-b024d38d38b1", "name": "network-vif-plugged", "status": "completed", "tag": "d154c601-3089-464e-a0a5-7d00211e395b"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:06.609495 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-166007f9-5249-4412-b701-1e5e0dea5b4a req-22389aea-2add-4838-9f0d-bef50f9dcba1 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:06.615496 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-166007f9-5249-4412-b701-1e5e0dea5b4a req-22389aea-2add-4838-9f0d-bef50f9dcba1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:06.616220 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-166007f9-5249-4412-b701-1e5e0dea5b4a req-22389aea-2add-4838-9f0d-bef50f9dcba1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:06.645893 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-166007f9-5249-4412-b701-1e5e0dea5b4a req-22389aea-2add-4838-9f0d-bef50f9dcba1 service nova] Creating event network-vif-plugged:d154c601-3089-464e-a0a5-7d00211e395b for instance d89db381-1e9d-40ee-b076-b024d38d38b1 on n-h1-856895-1 Sep 10 11:47:06.651592 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-166007f9-5249-4412-b701-1e5e0dea5b4a req-22389aea-2add-4838-9f0d-bef50f9dcba1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068842 Sep 10 11:47:06.652534 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 931/1951] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:47:06.655379 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-828f509d-b0c9-4ad6-84bf-3e2e76eb5889 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:06.658281 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ece754b5-86a6-474a-a005-fdf0dc92536b tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:06.659745 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ece754b5-86a6-474a-a005-fdf0dc92536b tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:06.666247 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ece754b5-86a6-474a-a005-fdf0dc92536b tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:06.666736 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ece754b5-86a6-474a-a005-fdf0dc92536b tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:06.667235 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ece754b5-86a6-474a-a005-fdf0dc92536b tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:06.667948 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ece754b5-86a6-474a-a005-fdf0dc92536b tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:06.668412 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ece754b5-86a6-474a-a005-fdf0dc92536b tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:06.669953 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ece754b5-86a6-474a-a005-fdf0dc92536b tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:06.672291 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-828f509d-b0c9-4ad6-84bf-3e2e76eb5889 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:06.674041 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-828f509d-b0c9-4ad6-84bf-3e2e76eb5889 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:06.679281 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-828f509d-b0c9-4ad6-84bf-3e2e76eb5889 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1266 microversion: 2.25 time: 0.166221 Sep 10 11:47:06.683511 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1021/1952] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:47:06 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:47:06.709751 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:47:06.869967 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fed1b67a-99ee-412d-a912-4409d8501c1d tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:06.870989 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fed1b67a-99ee-412d-a912-4409d8501c1d tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:06.878417 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fed1b67a-99ee-412d-a912-4409d8501c1d tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:06.879243 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fed1b67a-99ee-412d-a912-4409d8501c1d tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:06.879999 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fed1b67a-99ee-412d-a912-4409d8501c1d tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:06.881043 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fed1b67a-99ee-412d-a912-4409d8501c1d tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:06.881768 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fed1b67a-99ee-412d-a912-4409d8501c1d tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:06.882417 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fed1b67a-99ee-412d-a912-4409d8501c1d tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:06.960436 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ece754b5-86a6-474a-a005-fdf0dc92536b tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:06.974032 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ece754b5-86a6-474a-a005-fdf0dc92536b tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1294 microversion: 2.1 time: 0.320145 Sep 10 11:47:06.975448 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 932/1953] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:06 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1294 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:06.980001 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-da2c23fd-1f32-45f5-9902-7ea1926d2950 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:06.980625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-da2c23fd-1f32-45f5-9902-7ea1926d2950 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d89db381-1e9d-40ee-b076-b024d38d38b1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:06.993874 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da2c23fd-1f32-45f5-9902-7ea1926d2950 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:06.995088 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da2c23fd-1f32-45f5-9902-7ea1926d2950 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:06.997480 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da2c23fd-1f32-45f5-9902-7ea1926d2950 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:07.001001 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da2c23fd-1f32-45f5-9902-7ea1926d2950 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:07.001877 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da2c23fd-1f32-45f5-9902-7ea1926d2950 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:07.002772 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da2c23fd-1f32-45f5-9902-7ea1926d2950 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:07.062345 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=8 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:47:07.297184 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fed1b67a-99ee-412d-a912-4409d8501c1d tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:07.306947 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fed1b67a-99ee-412d-a912-4409d8501c1d tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 200 len: 1468 microversion: 2.1 time: 0.441491 Sep 10 11:47:07.312518 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1022/1954] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:06 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 1468 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:07.344175 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-da2c23fd-1f32-45f5-9902-7ea1926d2950 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:07.353083 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-da2c23fd-1f32-45f5-9902-7ea1926d2950 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1" status: 200 len: 1316 microversion: 2.1 time: 0.376625 Sep 10 11:47:07.355590 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 933/1955] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:06 2022] GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1 => generated 1316 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:07.535734 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-288a4fe8-a9a3-4bd5-a7f2-006ccac95f9e tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:07.538599 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-288a4fe8-a9a3-4bd5-a7f2-006ccac95f9e tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: f33c83e4-9881-4c1e-a502-ad9589fd597c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:07.562924 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-288a4fe8-a9a3-4bd5-a7f2-006ccac95f9e tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:07.570748 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-288a4fe8-a9a3-4bd5-a7f2-006ccac95f9e tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:07.572692 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-288a4fe8-a9a3-4bd5-a7f2-006ccac95f9e tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:07.573480 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-288a4fe8-a9a3-4bd5-a7f2-006ccac95f9e tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:07.573967 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-288a4fe8-a9a3-4bd5-a7f2-006ccac95f9e tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:07.574411 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-288a4fe8-a9a3-4bd5-a7f2-006ccac95f9e tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:07.598663 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-91de31f4-84ab-4fb2-9be4-09650ea78950 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:07.600021 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-91de31f4-84ab-4fb2-9be4-09650ea78950 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:07.621327 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-91de31f4-84ab-4fb2-9be4-09650ea78950 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:07.622200 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-91de31f4-84ab-4fb2-9be4-09650ea78950 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:07.622878 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-91de31f4-84ab-4fb2-9be4-09650ea78950 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:07.625421 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-91de31f4-84ab-4fb2-9be4-09650ea78950 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:07.626322 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-91de31f4-84ab-4fb2-9be4-09650ea78950 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:07.626990 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-91de31f4-84ab-4fb2-9be4-09650ea78950 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:08.281039 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-91de31f4-84ab-4fb2-9be4-09650ea78950 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:08.292405 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-288a4fe8-a9a3-4bd5-a7f2-006ccac95f9e tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ea7c11febf451da4f1faf4dff9471d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f601d0bb424da4bb02b532ac982878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:08.304885 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-288a4fe8-a9a3-4bd5-a7f2-006ccac95f9e tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "GET /compute/v2.1/servers/f33c83e4-9881-4c1e-a502-ad9589fd597c" status: 200 len: 1318 microversion: 2.1 time: 0.789340 Sep 10 11:47:08.315194 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1023/1956] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:07 2022] GET /compute/v2.1/servers/f33c83e4-9881-4c1e-a502-ad9589fd597c => generated 1318 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:08.315585 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e5c8f66a-9f5a-47ed-8dc6-ca7f0efc44cf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:08.316024 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e5c8f66a-9f5a-47ed-8dc6-ca7f0efc44cf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:08.323979 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-91de31f4-84ab-4fb2-9be4-09650ea78950 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:08.323979 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-91de31f4-84ab-4fb2-9be4-09650ea78950 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:08.324369 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-91de31f4-84ab-4fb2-9be4-09650ea78950 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1875 microversion: 2.32 time: 0.730172 Sep 10 11:47:08.327081 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 934/1957] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:47:07 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1875 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:47:08.363910 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0dfe0698-6961-4b7e-ae77-9601a0835ad2 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:08.364546 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0dfe0698-6961-4b7e-ae77-9601a0835ad2 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:08.372128 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e5c8f66a-9f5a-47ed-8dc6-ca7f0efc44cf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:08.372633 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e5c8f66a-9f5a-47ed-8dc6-ca7f0efc44cf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:08.373080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e5c8f66a-9f5a-47ed-8dc6-ca7f0efc44cf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:08.375680 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e5c8f66a-9f5a-47ed-8dc6-ca7f0efc44cf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:08.376157 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e5c8f66a-9f5a-47ed-8dc6-ca7f0efc44cf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:08.376600 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e5c8f66a-9f5a-47ed-8dc6-ca7f0efc44cf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:08.398745 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0dfe0698-6961-4b7e-ae77-9601a0835ad2 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:08.399646 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0dfe0698-6961-4b7e-ae77-9601a0835ad2 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:08.399724 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0dfe0698-6961-4b7e-ae77-9601a0835ad2 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:08.400444 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0dfe0698-6961-4b7e-ae77-9601a0835ad2 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:08.407102 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0dfe0698-6961-4b7e-ae77-9601a0835ad2 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:08.407727 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0dfe0698-6961-4b7e-ae77-9601a0835ad2 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:08.525325 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e5c8f66a-9f5a-47ed-8dc6-ca7f0efc44cf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:08.525840 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e5c8f66a-9f5a-47ed-8dc6-ca7f0efc44cf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:08.526352 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e5c8f66a-9f5a-47ed-8dc6-ca7f0efc44cf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:08.526928 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-e5c8f66a-9f5a-47ed-8dc6-ca7f0efc44cf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lazy-loading 'fault' on Instance uuid a62a6c44-9d92-4766-a81d-c09670110ab4 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:47:08.577401 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e5c8f66a-9f5a-47ed-8dc6-ca7f0efc44cf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:08.588688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e5c8f66a-9f5a-47ed-8dc6-ca7f0efc44cf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:08.590524 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e5c8f66a-9f5a-47ed-8dc6-ca7f0efc44cf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:08.591979 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e5c8f66a-9f5a-47ed-8dc6-ca7f0efc44cf tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 200 len: 1271 microversion: 2.25 time: 0.284607 Sep 10 11:47:08.593138 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1024/1958] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:47:08 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 1271 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:47:08.598568 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3c4ade70-f87f-430a-a635-24d47d1119cc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:08.599484 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3c4ade70-f87f-430a-a635-24d47d1119cc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:08.606123 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3c4ade70-f87f-430a-a635-24d47d1119cc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:08.606843 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3c4ade70-f87f-430a-a635-24d47d1119cc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:08.607554 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3c4ade70-f87f-430a-a635-24d47d1119cc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:08.608494 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3c4ade70-f87f-430a-a635-24d47d1119cc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:08.609160 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3c4ade70-f87f-430a-a635-24d47d1119cc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:08.609817 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3c4ade70-f87f-430a-a635-24d47d1119cc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:08.825022 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0dfe0698-6961-4b7e-ae77-9601a0835ad2 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:08.836475 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0dfe0698-6961-4b7e-ae77-9601a0835ad2 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1294 microversion: 2.1 time: 0.495121 Sep 10 11:47:08.840034 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 935/1959] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:08 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1294 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:08.849390 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e5b474a1-db86-48df-92fc-3a91db9ff9a9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:08.851926 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e5b474a1-db86-48df-92fc-3a91db9ff9a9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d89db381-1e9d-40ee-b076-b024d38d38b1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:08.863536 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e5b474a1-db86-48df-92fc-3a91db9ff9a9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:08.868094 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e5b474a1-db86-48df-92fc-3a91db9ff9a9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:08.868786 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e5b474a1-db86-48df-92fc-3a91db9ff9a9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:08.869706 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e5b474a1-db86-48df-92fc-3a91db9ff9a9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:08.870351 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e5b474a1-db86-48df-92fc-3a91db9ff9a9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:08.871136 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e5b474a1-db86-48df-92fc-3a91db9ff9a9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:09.205030 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3c4ade70-f87f-430a-a635-24d47d1119cc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:09.216321 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3c4ade70-f87f-430a-a635-24d47d1119cc tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 200 len: 1468 microversion: 2.1 time: 0.621853 Sep 10 11:47:09.218341 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1025/1960] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:08 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 1468 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:09.228238 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-1eaf6ccc-ddca-4b23-9bb5-0464a248981b req-29fb077a-c15d-4ef8-b3bd-a3e09df74285 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d54e6606-e731-472f-a828-0b2778a3b642", "name": "network-vif-plugged", "status": "completed", "tag": "8d303678-6914-42c7-92b8-39a1591b74c9"}, {"server_uuid": "d86e1b80-a305-48c7-9c51-ef4175a5840c", "name": "network-vif-plugged", "status": "completed", "tag": "f5d4ab4f-0cbe-4d63-a759-332a06ede2bf"}, {"server_uuid": "d86e1b80-a305-48c7-9c51-ef4175a5840c", "name": "network-vif-plugged", "status": "completed", "tag": "edef956a-da07-48ce-8164-a4f13ac10d0b"}, {"server_uuid": "d86e1b80-a305-48c7-9c51-ef4175a5840c", "name": "network-vif-plugged", "status": "completed", "tag": "1044ecab-729c-4007-8cd5-f7510a291677"}, {"server_uuid": "d86e1b80-a305-48c7-9c51-ef4175a5840c", "name": "network-vif-plugged", "status": "completed", "tag": "e0df91dd-9b58-4a4f-abcf-93e91dd253ff"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:09.263918 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-1eaf6ccc-ddca-4b23-9bb5-0464a248981b req-29fb077a-c15d-4ef8-b3bd-a3e09df74285 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:09.265813 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-1eaf6ccc-ddca-4b23-9bb5-0464a248981b req-29fb077a-c15d-4ef8-b3bd-a3e09df74285 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:09.266262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-1eaf6ccc-ddca-4b23-9bb5-0464a248981b req-29fb077a-c15d-4ef8-b3bd-a3e09df74285 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:09.303915 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=100 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:47:09.313386 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-1eaf6ccc-ddca-4b23-9bb5-0464a248981b req-29fb077a-c15d-4ef8-b3bd-a3e09df74285 service nova] Creating event network-vif-plugged:8d303678-6914-42c7-92b8-39a1591b74c9 for instance d54e6606-e731-472f-a828-0b2778a3b642 on n-h1-856895-1 Sep 10 11:47:09.316392 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-1eaf6ccc-ddca-4b23-9bb5-0464a248981b req-29fb077a-c15d-4ef8-b3bd-a3e09df74285 service nova] Creating event network-vif-plugged:f5d4ab4f-0cbe-4d63-a759-332a06ede2bf for instance d86e1b80-a305-48c7-9c51-ef4175a5840c on n-h2-856895-1 Sep 10 11:47:09.318381 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-1eaf6ccc-ddca-4b23-9bb5-0464a248981b req-29fb077a-c15d-4ef8-b3bd-a3e09df74285 service nova] Creating event network-vif-plugged:edef956a-da07-48ce-8164-a4f13ac10d0b for instance d86e1b80-a305-48c7-9c51-ef4175a5840c on n-h2-856895-1 Sep 10 11:47:09.320398 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-1eaf6ccc-ddca-4b23-9bb5-0464a248981b req-29fb077a-c15d-4ef8-b3bd-a3e09df74285 service nova] Creating event network-vif-plugged:1044ecab-729c-4007-8cd5-f7510a291677 for instance d86e1b80-a305-48c7-9c51-ef4175a5840c on n-h2-856895-1 Sep 10 11:47:09.323781 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-1eaf6ccc-ddca-4b23-9bb5-0464a248981b req-29fb077a-c15d-4ef8-b3bd-a3e09df74285 service nova] Creating event network-vif-plugged:e0df91dd-9b58-4a4f-abcf-93e91dd253ff for instance d86e1b80-a305-48c7-9c51-ef4175a5840c on n-h2-856895-1 Sep 10 11:47:09.356716 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-1eaf6ccc-ddca-4b23-9bb5-0464a248981b req-29fb077a-c15d-4ef8-b3bd-a3e09df74285 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.135107 Sep 10 11:47:09.357415 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1026/1961] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:47:09.363720 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-facddaab-1bb5-4f12-ab42-aba5c112bf29 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:09.364634 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-facddaab-1bb5-4f12-ab42-aba5c112bf29 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: f33c83e4-9881-4c1e-a502-ad9589fd597c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:09.379224 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-facddaab-1bb5-4f12-ab42-aba5c112bf29 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:09.384243 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-facddaab-1bb5-4f12-ab42-aba5c112bf29 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:09.384775 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-facddaab-1bb5-4f12-ab42-aba5c112bf29 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:09.385585 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-facddaab-1bb5-4f12-ab42-aba5c112bf29 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:09.386135 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-facddaab-1bb5-4f12-ab42-aba5c112bf29 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:09.386643 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-facddaab-1bb5-4f12-ab42-aba5c112bf29 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:09.476429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e5b474a1-db86-48df-92fc-3a91db9ff9a9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:09.517537 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e5b474a1-db86-48df-92fc-3a91db9ff9a9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1" status: 200 len: 1466 microversion: 2.1 time: 0.676148 Sep 10 11:47:09.528540 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 936/1962] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:08 2022] GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1 => generated 1466 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:09.541428 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8c9aaaf3-81ad-4b92-a01e-c9e170d91c44 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:09.543645 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8c9aaaf3-81ad-4b92-a01e-c9e170d91c44 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:09.555042 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8c9aaaf3-81ad-4b92-a01e-c9e170d91c44 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:09.555570 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8c9aaaf3-81ad-4b92-a01e-c9e170d91c44 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:09.556019 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8c9aaaf3-81ad-4b92-a01e-c9e170d91c44 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:09.556712 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8c9aaaf3-81ad-4b92-a01e-c9e170d91c44 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:09.557171 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8c9aaaf3-81ad-4b92-a01e-c9e170d91c44 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:09.557597 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8c9aaaf3-81ad-4b92-a01e-c9e170d91c44 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:09.935153 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-facddaab-1bb5-4f12-ab42-aba5c112bf29 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ea7c11febf451da4f1faf4dff9471d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f601d0bb424da4bb02b532ac982878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:09.950030 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-facddaab-1bb5-4f12-ab42-aba5c112bf29 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "GET /compute/v2.1/servers/f33c83e4-9881-4c1e-a502-ad9589fd597c" status: 200 len: 1318 microversion: 2.1 time: 0.585802 Sep 10 11:47:09.950714 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1027/1963] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:09 2022] GET /compute/v2.1/servers/f33c83e4-9881-4c1e-a502-ad9589fd597c => generated 1318 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:10.052636 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8c9aaaf3-81ad-4b92-a01e-c9e170d91c44 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:10.063866 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8c9aaaf3-81ad-4b92-a01e-c9e170d91c44 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:10.066631 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8c9aaaf3-81ad-4b92-a01e-c9e170d91c44 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:10.068124 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8c9aaaf3-81ad-4b92-a01e-c9e170d91c44 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1875 microversion: 2.32 time: 0.536921 Sep 10 11:47:10.092878 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e91ff3a6-3e30-43d1-8614-5a3f6a3a1fc1 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:10.093519 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e91ff3a6-3e30-43d1-8614-5a3f6a3a1fc1 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] [instance: d89db381-1e9d-40ee-b076-b024d38d38b1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:10.099441 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 937/1964] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:47:09 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1875 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:47:10.104935 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e91ff3a6-3e30-43d1-8614-5a3f6a3a1fc1 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:10.106419 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e91ff3a6-3e30-43d1-8614-5a3f6a3a1fc1 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:10.107917 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e91ff3a6-3e30-43d1-8614-5a3f6a3a1fc1 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:10.110057 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9b88db91-8d43-4f49-8dfd-7d7e6444bc0e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:10.110815 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e91ff3a6-3e30-43d1-8614-5a3f6a3a1fc1 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:10.112803 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9b88db91-8d43-4f49-8dfd-7d7e6444bc0e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: a62a6c44-9d92-4766-a81d-c09670110ab4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:10.113031 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e91ff3a6-3e30-43d1-8614-5a3f6a3a1fc1 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:10.113722 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e91ff3a6-3e30-43d1-8614-5a3f6a3a1fc1 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:10.126090 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9b88db91-8d43-4f49-8dfd-7d7e6444bc0e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:10.126588 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9b88db91-8d43-4f49-8dfd-7d7e6444bc0e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:10.127034 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9b88db91-8d43-4f49-8dfd-7d7e6444bc0e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:10.136057 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9b88db91-8d43-4f49-8dfd-7d7e6444bc0e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:10.136787 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9b88db91-8d43-4f49-8dfd-7d7e6444bc0e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:10.137393 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9b88db91-8d43-4f49-8dfd-7d7e6444bc0e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:10.199853 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-9b88db91-8d43-4f49-8dfd-7d7e6444bc0e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] HTTP exception thrown: Instance a62a6c44-9d92-4766-a81d-c09670110ab4 could not be found. Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9b88db91-8d43-4f49-8dfd-7d7e6444bc0e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Request method failure captured: Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 HTTP/1.1 Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHed8GF4SHtUgHPAUwxlZp0PmksNunRKLHn4uufMjtnzMfcEDxm2fmaX4NtyCJylpQQHwCgUEqgi5V2zrbiedUn-xH6Izrg70le3OLsPeCQnm-5rS791bk5YHAVkg9DydYFa9B3iw8qLoH3oNVeO61-DMPi6A6i3npn7mlsBW8bk71c Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: X-Openstack-Nova-Api-Version: 2.25 Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: c8c0800673e247fb8b3b3718512233c0 Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1948749437 Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8c0800673e247fb8b3b3718512233c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8c0800673e247fb8b3b3718512233c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c8c0800673e247fb8b3b3718512233c0", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c8c0800673e247fb8b3b3718512233c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1948749437 Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: c8c0800673e247fb8b3b3718512233c0 Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1948749437 Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-LiveAutoBlockMigrationV225Test-1948749437-project Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 1106bb2c5ce14c21a15ad62942745b62 Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1948749437-project Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance a62a6c44-9d92-4766-a81d-c09670110ab4 could not be found. Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'a62a6c44-9d92-4766-a81d-c09670110ab4'} Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a62a6c44-9d92-4766-a81d-c09670110ab4 could not be found. Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a62a6c44-9d92-4766-a81d-c09670110ab4 could not be found. Sep 10 11:47:10.205952 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:10.210520 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:47:10.210520 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:10.210520 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:10.210520 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:47:10.210520 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:47:10.210520 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:47:10.210520 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:47:10.210520 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a62a6c44-9d92-4766-a81d-c09670110ab4 could not be found. Sep 10 11:47:10.210520 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:10.210520 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9b88db91-8d43-4f49-8dfd-7d7e6444bc0e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Returning 404 to user: Instance a62a6c44-9d92-4766-a81d-c09670110ab4 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:47:10.210520 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9b88db91-8d43-4f49-8dfd-7d7e6444bc0e tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4" status: 404 len: 111 microversion: 2.25 time: 0.109232 Sep 10 11:47:10.211433 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 938/1965] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:47:10 2022] GET /compute/v2.1/servers/a62a6c44-9d92-4766-a81d-c09670110ab4 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:47:10.223136 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-ca330fef-1261-47b6-ad73-afa86997429c req-0f41da44-2feb-48d0-bbcb-13b15bee5ec8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68861799-4265-42f8-a24a-dd78f3d6745a", "name": "network-vif-deleted", "tag": "588ba4ca-8af7-4faa-a475-eb41a709948d"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:10.249298 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ca330fef-1261-47b6-ad73-afa86997429c req-0f41da44-2feb-48d0-bbcb-13b15bee5ec8 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:10.254216 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ca330fef-1261-47b6-ad73-afa86997429c req-0f41da44-2feb-48d0-bbcb-13b15bee5ec8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:10.254816 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ca330fef-1261-47b6-ad73-afa86997429c req-0f41da44-2feb-48d0-bbcb-13b15bee5ec8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:10.281529 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-ca330fef-1261-47b6-ad73-afa86997429c req-0f41da44-2feb-48d0-bbcb-13b15bee5ec8 service nova] Creating event network-vif-deleted:588ba4ca-8af7-4faa-a475-eb41a709948d for instance 68861799-4265-42f8-a24a-dd78f3d6745a on n-h1-856895-1 Sep 10 11:47:10.297237 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-ca330fef-1261-47b6-ad73-afa86997429c req-0f41da44-2feb-48d0-bbcb-13b15bee5ec8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084223 Sep 10 11:47:10.305024 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 939/1966] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:47:10.322646 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-87fceb67-d5d8-4b7e-a5ba-5e2cf1d237eb tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:10.323400 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-87fceb67-d5d8-4b7e-a5ba-5e2cf1d237eb tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:10.351656 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-87fceb67-d5d8-4b7e-a5ba-5e2cf1d237eb tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:10.352437 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-87fceb67-d5d8-4b7e-a5ba-5e2cf1d237eb tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:10.352896 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-87fceb67-d5d8-4b7e-a5ba-5e2cf1d237eb tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:10.353628 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-87fceb67-d5d8-4b7e-a5ba-5e2cf1d237eb tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:10.359544 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-87fceb67-d5d8-4b7e-a5ba-5e2cf1d237eb tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:10.360042 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-87fceb67-d5d8-4b7e-a5ba-5e2cf1d237eb tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:10.764143 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-87fceb67-d5d8-4b7e-a5ba-5e2cf1d237eb tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:10.776381 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-87fceb67-d5d8-4b7e-a5ba-5e2cf1d237eb tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1294 microversion: 2.1 time: 0.467330 Sep 10 11:47:10.777124 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 940/1967] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:10 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1294 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:10.783589 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-31edede4-629f-4a6e-8219-20b6bc3da821 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:10.792244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-31edede4-629f-4a6e-8219-20b6bc3da821 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:10.813752 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-31edede4-629f-4a6e-8219-20b6bc3da821 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:10.820568 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-31edede4-629f-4a6e-8219-20b6bc3da821 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:10.821363 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-31edede4-629f-4a6e-8219-20b6bc3da821 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:10.822384 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-31edede4-629f-4a6e-8219-20b6bc3da821 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:10.827955 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-31edede4-629f-4a6e-8219-20b6bc3da821 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:10.828747 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-31edede4-629f-4a6e-8219-20b6bc3da821 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:10.868287 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-31edede4-629f-4a6e-8219-20b6bc3da821 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:10.869605 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-31edede4-629f-4a6e-8219-20b6bc3da821 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:10.870292 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-31edede4-629f-4a6e-8219-20b6bc3da821 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:10.871116 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-31edede4-629f-4a6e-8219-20b6bc3da821 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lazy-loading 'fault' on Instance uuid 68861799-4265-42f8-a24a-dd78f3d6745a {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:47:11.286800 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-31edede4-629f-4a6e-8219-20b6bc3da821 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:11.296795 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-31edede4-629f-4a6e-8219-20b6bc3da821 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 200 len: 1302 microversion: 2.1 time: 0.516845 Sep 10 11:47:11.298397 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 941/1968] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:10 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 1302 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:11.306611 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ea307cd6-08e4-4d59-9eba-63416f30c5cd tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:11.309699 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ea307cd6-08e4-4d59-9eba-63416f30c5cd tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: f33c83e4-9881-4c1e-a502-ad9589fd597c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:11.321141 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea307cd6-08e4-4d59-9eba-63416f30c5cd tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:11.321912 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea307cd6-08e4-4d59-9eba-63416f30c5cd tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:11.322703 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea307cd6-08e4-4d59-9eba-63416f30c5cd tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:11.324078 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea307cd6-08e4-4d59-9eba-63416f30c5cd tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:11.324847 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea307cd6-08e4-4d59-9eba-63416f30c5cd tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:11.325745 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea307cd6-08e4-4d59-9eba-63416f30c5cd tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:11.628970 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e91ff3a6-3e30-43d1-8614-5a3f6a3a1fc1 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1" status: 200 len: 1617 microversion: 2.1 time: 1.663831 Sep 10 11:47:11.629554 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1028/1969] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:09 2022] GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1 => generated 1617 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:11.636120 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-92ceb0ea-2b33-44f1-a955-a2584a0db49f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:11.636896 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-92ceb0ea-2b33-44f1-a955-a2584a0db49f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:11.645336 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92ceb0ea-2b33-44f1-a955-a2584a0db49f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:11.646360 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92ceb0ea-2b33-44f1-a955-a2584a0db49f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:11.647307 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92ceb0ea-2b33-44f1-a955-a2584a0db49f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:11.648685 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92ceb0ea-2b33-44f1-a955-a2584a0db49f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:11.649534 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92ceb0ea-2b33-44f1-a955-a2584a0db49f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:11.650525 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92ceb0ea-2b33-44f1-a955-a2584a0db49f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:11.917752 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ea307cd6-08e4-4d59-9eba-63416f30c5cd tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ea7c11febf451da4f1faf4dff9471d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f601d0bb424da4bb02b532ac982878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:11.936089 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ea307cd6-08e4-4d59-9eba-63416f30c5cd tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "GET /compute/v2.1/servers/f33c83e4-9881-4c1e-a502-ad9589fd597c" status: 200 len: 1318 microversion: 2.1 time: 0.636437 Sep 10 11:47:11.936674 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 942/1970] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:11 2022] GET /compute/v2.1/servers/f33c83e4-9881-4c1e-a502-ad9589fd597c => generated 1318 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:11.958165 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-a7ba469b-3189-4ae9-9c23-63a3f70c8eb7 req-d60abafe-aa00-4c93-9771-c806274400db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d86e1b80-a305-48c7-9c51-ef4175a5840c", "name": "network-vif-plugged", "status": "completed", "tag": "f9a625c6-a871-4b6f-9edf-d59069c8c738"}, {"server_uuid": "d86e1b80-a305-48c7-9c51-ef4175a5840c", "name": "network-vif-plugged", "status": "completed", "tag": "fdbc5dc3-2de5-4f0c-8eca-af1d0dcbbfca"}, {"server_uuid": "d86e1b80-a305-48c7-9c51-ef4175a5840c", "name": "network-vif-plugged", "status": "completed", "tag": "6ccddaf2-efc8-42e5-9c38-3ba375ee3f68"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:11.969238 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a7ba469b-3189-4ae9-9c23-63a3f70c8eb7 req-d60abafe-aa00-4c93-9771-c806274400db service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:11.970026 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a7ba469b-3189-4ae9-9c23-63a3f70c8eb7 req-d60abafe-aa00-4c93-9771-c806274400db service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:11.970610 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a7ba469b-3189-4ae9-9c23-63a3f70c8eb7 req-d60abafe-aa00-4c93-9771-c806274400db service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:11.996538 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-a7ba469b-3189-4ae9-9c23-63a3f70c8eb7 req-d60abafe-aa00-4c93-9771-c806274400db service nova] Creating event network-vif-plugged:f9a625c6-a871-4b6f-9edf-d59069c8c738 for instance d86e1b80-a305-48c7-9c51-ef4175a5840c on n-h2-856895-1 Sep 10 11:47:12.008046 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-a7ba469b-3189-4ae9-9c23-63a3f70c8eb7 req-d60abafe-aa00-4c93-9771-c806274400db service nova] Creating event network-vif-plugged:fdbc5dc3-2de5-4f0c-8eca-af1d0dcbbfca for instance d86e1b80-a305-48c7-9c51-ef4175a5840c on n-h2-856895-1 Sep 10 11:47:12.008849 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-a7ba469b-3189-4ae9-9c23-63a3f70c8eb7 req-d60abafe-aa00-4c93-9771-c806274400db service nova] Creating event network-vif-plugged:6ccddaf2-efc8-42e5-9c38-3ba375ee3f68 for instance d86e1b80-a305-48c7-9c51-ef4175a5840c on n-h2-856895-1 Sep 10 11:47:12.014899 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-a7ba469b-3189-4ae9-9c23-63a3f70c8eb7 req-d60abafe-aa00-4c93-9771-c806274400db service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.076802 Sep 10 11:47:12.015731 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 943/1971] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:47:12.021344 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-40f62f92-f9aa-416c-8a7a-dded9850420a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Action: 'create', calling method: .version_select at 0x7f407b552280>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-426199949", "policies": ["affinity"]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:12.069750 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-40f62f92-f9aa-416c-8a7a-dded9850420a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Getting quotas for project 5949225a72e649c1adc217d5a760460a. Resources: {'server_groups'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:47:12.081658 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-40f62f92-f9aa-416c-8a7a-dded9850420a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Getting quotas for user dfc33eb8645248f9b154587e7d8d449e and project 5949225a72e649c1adc217d5a760460a. Resources: {'server_groups'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:47:12.113946 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-92ceb0ea-2b33-44f1-a955-a2584a0db49f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:12.130675 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-92ceb0ea-2b33-44f1-a955-a2584a0db49f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:12.132170 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-92ceb0ea-2b33-44f1-a955-a2584a0db49f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:12.136952 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-92ceb0ea-2b33-44f1-a955-a2584a0db49f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1875 microversion: 2.32 time: 0.506344 Sep 10 11:47:12.137598 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1029/1972] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:47:11 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1875 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:47:12.148526 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-866eab0a-e881-4674-a0a0-a37d3b912404 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:12.156151 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-866eab0a-e881-4674-a0a0-a37d3b912404 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:12.171493 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-40f62f92-f9aa-416c-8a7a-dded9850420a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Getting quotas for project 5949225a72e649c1adc217d5a760460a. Resources: {'server_groups'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:47:12.173010 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-866eab0a-e881-4674-a0a0-a37d3b912404 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:12.173705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-866eab0a-e881-4674-a0a0-a37d3b912404 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:12.174312 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-866eab0a-e881-4674-a0a0-a37d3b912404 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:12.176128 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-866eab0a-e881-4674-a0a0-a37d3b912404 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:12.176775 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-866eab0a-e881-4674-a0a0-a37d3b912404 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:12.177367 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-866eab0a-e881-4674-a0a0-a37d3b912404 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:12.179877 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-40f62f92-f9aa-416c-8a7a-dded9850420a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Getting quotas for user dfc33eb8645248f9b154587e7d8d449e and project 5949225a72e649c1adc217d5a760460a. Resources: {'server_groups'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:47:12.197342 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-40f62f92-f9aa-416c-8a7a-dded9850420a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.180139 Sep 10 11:47:12.198797 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 944/1973] 10.222.0.23 () {60 vars in 1174 bytes} [Sat Sep 10 11:47:12 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:47:12.330304 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f719b84b-8ad2-4db7-96c6-92dd8abd83f9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:12.331698 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f719b84b-8ad2-4db7-96c6-92dd8abd83f9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: 68861799-4265-42f8-a24a-dd78f3d6745a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:12.338202 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:47:12.340148 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f719b84b-8ad2-4db7-96c6-92dd8abd83f9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:12.341017 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f719b84b-8ad2-4db7-96c6-92dd8abd83f9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:12.341929 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f719b84b-8ad2-4db7-96c6-92dd8abd83f9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:12.342847 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f719b84b-8ad2-4db7-96c6-92dd8abd83f9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:12.343521 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f719b84b-8ad2-4db7-96c6-92dd8abd83f9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:12.344137 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f719b84b-8ad2-4db7-96c6-92dd8abd83f9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:12.361671 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-f719b84b-8ad2-4db7-96c6-92dd8abd83f9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] HTTP exception thrown: Instance 68861799-4265-42f8-a24a-dd78f3d6745a could not be found. Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f719b84b-8ad2-4db7-96c6-92dd8abd83f9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Request method failure captured: Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a HTTP/1.1 Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHf7mACdlfzYNqqdAdehYL4NCPaTh2LiHYzzG2y_R-m91DirSD9NpPMperwROx5CtpOnZxmqPDNB9-2DL_apNDkdE-LB__QyjBTbYbDUeOWNR455kuIEfcUXxBZGOPYw79BioFM9zb447QPq1yl7E0tXPTJg7uWBXuI8k7QYTs8cI-Y Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 7b37b36096cd42f6b6568ff9eee2751c Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-MigrationsAdminTest-29591251 Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7b37b36096cd42f6b6568ff9eee2751c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7b37b36096cd42f6b6568ff9eee2751c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7b37b36096cd42f6b6568ff9eee2751c", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7b37b36096cd42f6b6568ff9eee2751c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-MigrationsAdminTest-29591251 Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 7b37b36096cd42f6b6568ff9eee2751c Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-MigrationsAdminTest-29591251 Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-MigrationsAdminTest-29591251-project Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 77d854474f4c4481ac407a76b4627c69 Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-MigrationsAdminTest-29591251-project Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 68861799-4265-42f8-a24a-dd78f3d6745a could not be found. Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '68861799-4265-42f8-a24a-dd78f3d6745a'} Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68861799-4265-42f8-a24a-dd78f3d6745a could not be found. Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68861799-4265-42f8-a24a-dd78f3d6745a could not be found. Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:47:12.365823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:12.370015 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:12.370015 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:47:12.370015 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:47:12.370015 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:47:12.370015 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:47:12.370015 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68861799-4265-42f8-a24a-dd78f3d6745a could not be found. Sep 10 11:47:12.370015 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:12.371832 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f719b84b-8ad2-4db7-96c6-92dd8abd83f9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Returning 404 to user: Instance 68861799-4265-42f8-a24a-dd78f3d6745a could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:47:12.373029 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f719b84b-8ad2-4db7-96c6-92dd8abd83f9 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a" status: 404 len: 111 microversion: 2.1 time: 0.047681 Sep 10 11:47:12.374253 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 945/1974] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:12 2022] GET /compute/v2.1/servers/68861799-4265-42f8-a24a-dd78f3d6745a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:47:12.379766 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-737657e7-135e-4784-85fa-34cbc9e3d384 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1356752254", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "c7729ba4-e702-4dcf-91a2-344963012fce"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:12.453785 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-737657e7-135e-4784-85fa-34cbc9e3d384 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] validate_networks() for None {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:47:12.454629 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-866eab0a-e881-4674-a0a0-a37d3b912404 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:12.464594 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-866eab0a-e881-4674-a0a0-a37d3b912404 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1485 microversion: 2.1 time: 0.324220 Sep 10 11:47:12.466014 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1030/1975] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:12 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1485 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:12.472630 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-024cdfa1-c98b-4028-b6fd-188045bc8602 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:12.473495 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-024cdfa1-c98b-4028-b6fd-188045bc8602 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:12.480355 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-024cdfa1-c98b-4028-b6fd-188045bc8602 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:12.482036 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-024cdfa1-c98b-4028-b6fd-188045bc8602 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:12.482753 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-024cdfa1-c98b-4028-b6fd-188045bc8602 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:12.483755 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-024cdfa1-c98b-4028-b6fd-188045bc8602 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:12.484643 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-024cdfa1-c98b-4028-b6fd-188045bc8602 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:12.485303 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-024cdfa1-c98b-4028-b6fd-188045bc8602 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:12.541053 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-024cdfa1-c98b-4028-b6fd-188045bc8602 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:47:12.682816 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-024cdfa1-c98b-4028-b6fd-188045bc8602 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 204 len: 0 microversion: 2.1 time: 0.213996 Sep 10 11:47:12.690951 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1031/1976] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:47:12 2022] DELETE /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:47:12.727729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4e338b08-d339-46f4-be82-4e6c001c8553 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:12.728613 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4e338b08-d339-46f4-be82-4e6c001c8553 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:12.737705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e338b08-d339-46f4-be82-4e6c001c8553 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:12.738548 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e338b08-d339-46f4-be82-4e6c001c8553 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:12.739226 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e338b08-d339-46f4-be82-4e6c001c8553 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:12.740295 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e338b08-d339-46f4-be82-4e6c001c8553 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:12.740939 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e338b08-d339-46f4-be82-4e6c001c8553 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:12.741566 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e338b08-d339-46f4-be82-4e6c001c8553 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:12.845838 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-737657e7-135e-4784-85fa-34cbc9e3d384 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:47:12.847730 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-737657e7-135e-4784-85fa-34cbc9e3d384 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:47:12.848379 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-737657e7-135e-4784-85fa-34cbc9e3d384 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:47:12.849143 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-737657e7-135e-4784-85fa-34cbc9e3d384 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:47:12.850281 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-737657e7-135e-4784-85fa-34cbc9e3d384 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:47:12.929793 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-737657e7-135e-4784-85fa-34cbc9e3d384 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:12.930590 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-737657e7-135e-4784-85fa-34cbc9e3d384 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:12.930713 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-737657e7-135e-4784-85fa-34cbc9e3d384 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:12.931479 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-737657e7-135e-4784-85fa-34cbc9e3d384 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:12.931933 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-737657e7-135e-4784-85fa-34cbc9e3d384 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:12.935363 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-737657e7-135e-4784-85fa-34cbc9e3d384 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:12.973224 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4e338b08-d339-46f4-be82-4e6c001c8553 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.278258 Sep 10 11:47:12.973842 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1032/1977] 10.222.0.23 () {58 vars in 1275 bytes} [Sat Sep 10 11:47:12 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642/os-interface => generated 284 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:47:12.981752 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4122b88c-688d-42d8-9120-4abaf7a7defd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:12.982403 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4122b88c-688d-42d8-9120-4abaf7a7defd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:12.989785 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-737657e7-135e-4784-85fa-34cbc9e3d384 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Getting quotas for project 5949225a72e649c1adc217d5a760460a. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:47:12.990031 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4122b88c-688d-42d8-9120-4abaf7a7defd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:12.990711 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4122b88c-688d-42d8-9120-4abaf7a7defd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:12.991388 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4122b88c-688d-42d8-9120-4abaf7a7defd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:12.992618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4122b88c-688d-42d8-9120-4abaf7a7defd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:12.993230 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4122b88c-688d-42d8-9120-4abaf7a7defd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:12.993803 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4122b88c-688d-42d8-9120-4abaf7a7defd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:13.007184 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-737657e7-135e-4784-85fa-34cbc9e3d384 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Getting quotas for user dfc33eb8645248f9b154587e7d8d449e and project 5949225a72e649c1adc217d5a760460a. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:47:13.033889 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-737657e7-135e-4784-85fa-34cbc9e3d384 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Going to run 2 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:47:13.037953 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-737657e7-135e-4784-85fa-34cbc9e3d384 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 2ab5ad80-d86c-44f1-870d-777d44fd340a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:47:13.100242 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-737657e7-135e-4784-85fa-34cbc9e3d384 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128776) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Sep 10 11:47:13.128417 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-737657e7-135e-4784-85fa-34cbc9e3d384 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Getting quotas for project 5949225a72e649c1adc217d5a760460a. Resources: {'server_group_members'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:47:13.142483 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-737657e7-135e-4784-85fa-34cbc9e3d384 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Getting quotas for user dfc33eb8645248f9b154587e7d8d449e and project 5949225a72e649c1adc217d5a760460a. Resources: {'server_group_members'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:47:13.207732 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-737657e7-135e-4784-85fa-34cbc9e3d384 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Getting quotas for project 5949225a72e649c1adc217d5a760460a. Resources: {'server_group_members'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:47:13.208348 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4122b88c-688d-42d8-9120-4abaf7a7defd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:13.215436 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-737657e7-135e-4784-85fa-34cbc9e3d384 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Getting quotas for user dfc33eb8645248f9b154587e7d8d449e and project 5949225a72e649c1adc217d5a760460a. Resources: {'server_group_members'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:47:13.221916 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4122b88c-688d-42d8-9120-4abaf7a7defd tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1467 microversion: 2.1 time: 0.243945 Sep 10 11:47:13.223451 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1033/1978] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:12 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1467 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:13.241558 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-71110b67-690d-4f08-b30a-cbd5f76c5f8f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:13.242745 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-71110b67-690d-4f08-b30a-cbd5f76c5f8f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: f33c83e4-9881-4c1e-a502-ad9589fd597c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:13.243763 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-737657e7-135e-4784-85fa-34cbc9e3d384 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: f30dcd4e-f14f-4f37-bb07-05bafdff2bbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=2ab5ad80-d86c-44f1-870d-777d44fd340a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:47:13.251020 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71110b67-690d-4f08-b30a-cbd5f76c5f8f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:13.253280 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71110b67-690d-4f08-b30a-cbd5f76c5f8f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:13.254112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71110b67-690d-4f08-b30a-cbd5f76c5f8f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:13.255074 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71110b67-690d-4f08-b30a-cbd5f76c5f8f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:13.255764 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71110b67-690d-4f08-b30a-cbd5f76c5f8f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:13.256440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71110b67-690d-4f08-b30a-cbd5f76c5f8f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:13.335978 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-737657e7-135e-4784-85fa-34cbc9e3d384 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Getting quotas for project 5949225a72e649c1adc217d5a760460a. Resources: {'server_group_members'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:47:13.355622 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-737657e7-135e-4784-85fa-34cbc9e3d384 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Getting quotas for user dfc33eb8645248f9b154587e7d8d449e and project 5949225a72e649c1adc217d5a760460a. Resources: {'server_group_members'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:47:13.460852 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-737657e7-135e-4784-85fa-34cbc9e3d384 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Getting quotas for project 5949225a72e649c1adc217d5a760460a. Resources: {'server_group_members'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:47:13.474431 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-737657e7-135e-4784-85fa-34cbc9e3d384 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Getting quotas for user dfc33eb8645248f9b154587e7d8d449e and project 5949225a72e649c1adc217d5a760460a. Resources: {'server_group_members'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:47:13.538383 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-737657e7-135e-4784-85fa-34cbc9e3d384 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.161842 Sep 10 11:47:13.539400 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 946/1979] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:47:12 2022] POST /compute/v2.1/servers => generated 32 bytes in 1164 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 10 11:47:13.547648 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-66b2afed-5f25-4525-ae98-86c38a8c80e5 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:13.548548 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-66b2afed-5f25-4525-ae98-86c38a8c80e5 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:13.555522 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-66b2afed-5f25-4525-ae98-86c38a8c80e5 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:13.556216 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-66b2afed-5f25-4525-ae98-86c38a8c80e5 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:13.556673 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-66b2afed-5f25-4525-ae98-86c38a8c80e5 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:13.557393 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-66b2afed-5f25-4525-ae98-86c38a8c80e5 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:13.558003 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-66b2afed-5f25-4525-ae98-86c38a8c80e5 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:13.558608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-66b2afed-5f25-4525-ae98-86c38a8c80e5 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:14.090842 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-71110b67-690d-4f08-b30a-cbd5f76c5f8f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ea7c11febf451da4f1faf4dff9471d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f601d0bb424da4bb02b532ac982878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:14.101653 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-71110b67-690d-4f08-b30a-cbd5f76c5f8f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "GET /compute/v2.1/servers/f33c83e4-9881-4c1e-a502-ad9589fd597c" status: 200 len: 1318 microversion: 2.1 time: 0.875423 Sep 10 11:47:14.108496 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1034/1980] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:13 2022] GET /compute/v2.1/servers/f33c83e4-9881-4c1e-a502-ad9589fd597c => generated 1318 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:14.116743 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6c62da89-c9f0-48c9-8ba8-41d98852807f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:14.125555 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6c62da89-c9f0-48c9-8ba8-41d98852807f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:14.126941 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6c62da89-c9f0-48c9-8ba8-41d98852807f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Searching by: {'deleted': False, 'project_id': '5949225a72e649c1adc217d5a760460a'} {{(pid=128777) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 11:47:14.185618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6c62da89-c9f0-48c9-8ba8-41d98852807f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:14.188556 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6c62da89-c9f0-48c9-8ba8-41d98852807f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:14.189437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6c62da89-c9f0-48c9-8ba8-41d98852807f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:14.193892 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6c62da89-c9f0-48c9-8ba8-41d98852807f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:14.195447 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6c62da89-c9f0-48c9-8ba8-41d98852807f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:14.197714 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6c62da89-c9f0-48c9-8ba8-41d98852807f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:14.397116 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.multi_cell_list [None req-6c62da89-c9f0-48c9-8ba8-41d98852807f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=128777) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 11:47:14.563507 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6c62da89-c9f0-48c9-8ba8-41d98852807f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.452649 Sep 10 11:47:14.564440 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1035/1981] 10.222.0.23 () {58 vars in 1125 bytes} [Sat Sep 10 11:47:14 2022] GET /compute/v2.1/servers => generated 1003 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:14.581863 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-fb268818-19ec-4ce4-b0eb-7796d93c1b2a req-13aaf471-dd34-491d-be7c-e084d25b08dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f33c83e4-9881-4c1e-a502-ad9589fd597c", "name": "network-vif-plugged", "status": "completed", "tag": "84f563f5-a3fe-4606-b3e5-e437d2a0c4c5"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:14.622058 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-fb268818-19ec-4ce4-b0eb-7796d93c1b2a req-13aaf471-dd34-491d-be7c-e084d25b08dc service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:14.622464 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-fb268818-19ec-4ce4-b0eb-7796d93c1b2a req-13aaf471-dd34-491d-be7c-e084d25b08dc service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:14.625110 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-fb268818-19ec-4ce4-b0eb-7796d93c1b2a req-13aaf471-dd34-491d-be7c-e084d25b08dc service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:14.654288 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-66b2afed-5f25-4525-ae98-86c38a8c80e5 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:14.663549 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-fb268818-19ec-4ce4-b0eb-7796d93c1b2a req-13aaf471-dd34-491d-be7c-e084d25b08dc service nova] Creating event network-vif-plugged:84f563f5-a3fe-4606-b3e5-e437d2a0c4c5 for instance f33c83e4-9881-4c1e-a502-ad9589fd597c on n-h2-856895-1 Sep 10 11:47:14.666082 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-66b2afed-5f25-4525-ae98-86c38a8c80e5 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:14.670229 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-fb268818-19ec-4ce4-b0eb-7796d93c1b2a req-13aaf471-dd34-491d-be7c-e084d25b08dc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104146 Sep 10 11:47:14.676079 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-66b2afed-5f25-4525-ae98-86c38a8c80e5 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:14.677361 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-66b2afed-5f25-4525-ae98-86c38a8c80e5 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1875 microversion: 2.32 time: 1.133858 Sep 10 11:47:14.685756 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1036/1982] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:47:14.691666 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 947/1983] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:47:13 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1875 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:47:14.702936 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5271b60c-415a-40fd-8961-63ee048272b9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:14.703649 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5271b60c-415a-40fd-8961-63ee048272b9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: f30dcd4e-f14f-4f37-bb07-05bafdff2bbb] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:14.718327 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1961d365-afb0-4e71-90c6-bb83b8838723 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:14.721927 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1961d365-afb0-4e71-90c6-bb83b8838723 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:14.739686 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1961d365-afb0-4e71-90c6-bb83b8838723 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:14.744907 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1961d365-afb0-4e71-90c6-bb83b8838723 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:14.745531 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1961d365-afb0-4e71-90c6-bb83b8838723 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:14.749676 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1961d365-afb0-4e71-90c6-bb83b8838723 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:14.750335 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1961d365-afb0-4e71-90c6-bb83b8838723 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:14.751039 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1961d365-afb0-4e71-90c6-bb83b8838723 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:14.913802 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5271b60c-415a-40fd-8961-63ee048272b9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:14.923434 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5271b60c-415a-40fd-8961-63ee048272b9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/f30dcd4e-f14f-4f37-bb07-05bafdff2bbb" status: 200 len: 1219 microversion: 2.1 time: 0.230559 Sep 10 11:47:14.924034 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 948/1984] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:14 2022] GET /compute/v2.1/servers/f30dcd4e-f14f-4f37-bb07-05bafdff2bbb => generated 1219 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:14.935913 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0864c1ce-c790-4e82-b979-c97c013dc60c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:14.940804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0864c1ce-c790-4e82-b979-c97c013dc60c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:14.962539 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0864c1ce-c790-4e82-b979-c97c013dc60c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:14.963057 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0864c1ce-c790-4e82-b979-c97c013dc60c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:14.967677 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0864c1ce-c790-4e82-b979-c97c013dc60c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:14.968713 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0864c1ce-c790-4e82-b979-c97c013dc60c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:14.969448 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0864c1ce-c790-4e82-b979-c97c013dc60c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:14.970234 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0864c1ce-c790-4e82-b979-c97c013dc60c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:15.045264 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0864c1ce-c790-4e82-b979-c97c013dc60c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:47:15.140389 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1961d365-afb0-4e71-90c6-bb83b8838723 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:15.150172 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1961d365-afb0-4e71-90c6-bb83b8838723 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1467 microversion: 2.1 time: 0.462332 Sep 10 11:47:15.154468 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1037/1985] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:14 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1467 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:15.165969 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4223568a-5066-4af6-890c-e47e9fe83f37 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:15.172274 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4223568a-5066-4af6-890c-e47e9fe83f37 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: f33c83e4-9881-4c1e-a502-ad9589fd597c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:15.192930 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4223568a-5066-4af6-890c-e47e9fe83f37 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:15.194045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4223568a-5066-4af6-890c-e47e9fe83f37 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:15.194609 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4223568a-5066-4af6-890c-e47e9fe83f37 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:15.199099 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4223568a-5066-4af6-890c-e47e9fe83f37 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:15.200415 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4223568a-5066-4af6-890c-e47e9fe83f37 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:15.201699 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4223568a-5066-4af6-890c-e47e9fe83f37 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:15.240435 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0864c1ce-c790-4e82-b979-c97c013dc60c tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "DELETE /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 204 len: 0 microversion: 2.25 time: 0.310374 Sep 10 11:47:15.245274 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 949/1986] 10.222.0.23 () {60 vars in 1280 bytes} [Sat Sep 10 11:47:14 2022] DELETE /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 11:47:15.262380 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-41fefb7f-8103-4fbf-adda-cc29baee6123 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:15.263763 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-41fefb7f-8103-4fbf-adda-cc29baee6123 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:15.285098 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41fefb7f-8103-4fbf-adda-cc29baee6123 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:15.285874 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41fefb7f-8103-4fbf-adda-cc29baee6123 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:15.286509 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41fefb7f-8103-4fbf-adda-cc29baee6123 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:15.287407 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41fefb7f-8103-4fbf-adda-cc29baee6123 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:15.288068 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41fefb7f-8103-4fbf-adda-cc29baee6123 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:15.289535 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41fefb7f-8103-4fbf-adda-cc29baee6123 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:15.663251 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4223568a-5066-4af6-890c-e47e9fe83f37 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ea7c11febf451da4f1faf4dff9471d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f601d0bb424da4bb02b532ac982878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:15.682317 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4223568a-5066-4af6-890c-e47e9fe83f37 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "GET /compute/v2.1/servers/f33c83e4-9881-4c1e-a502-ad9589fd597c" status: 200 len: 1318 microversion: 2.1 time: 0.515687 Sep 10 11:47:15.682993 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1038/1987] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:15 2022] GET /compute/v2.1/servers/f33c83e4-9881-4c1e-a502-ad9589fd597c => generated 1318 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:15.709699 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a5cc7dfb-0efa-4044-852d-310c5f91c16e tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:15.710497 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a5cc7dfb-0efa-4044-852d-310c5f91c16e tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:15.720748 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5cc7dfb-0efa-4044-852d-310c5f91c16e tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:15.722507 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5cc7dfb-0efa-4044-852d-310c5f91c16e tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:15.723377 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5cc7dfb-0efa-4044-852d-310c5f91c16e tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:15.724281 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5cc7dfb-0efa-4044-852d-310c5f91c16e tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:15.725316 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5cc7dfb-0efa-4044-852d-310c5f91c16e tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:15.726322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5cc7dfb-0efa-4044-852d-310c5f91c16e tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:15.744509 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-41fefb7f-8103-4fbf-adda-cc29baee6123 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:15.759127 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-41fefb7f-8103-4fbf-adda-cc29baee6123 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:15.763871 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-41fefb7f-8103-4fbf-adda-cc29baee6123 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:15.768111 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-41fefb7f-8103-4fbf-adda-cc29baee6123 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1729 microversion: 2.25 time: 0.518155 Sep 10 11:47:15.772593 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 950/1988] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:47:15 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1729 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:47:15.946738 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2e17f364-a9b4-4f96-a04b-8568f7d98e01 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:15.947934 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2e17f364-a9b4-4f96-a04b-8568f7d98e01 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: f30dcd4e-f14f-4f37-bb07-05bafdff2bbb] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:15.968135 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e17f364-a9b4-4f96-a04b-8568f7d98e01 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:15.970947 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e17f364-a9b4-4f96-a04b-8568f7d98e01 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:15.972187 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e17f364-a9b4-4f96-a04b-8568f7d98e01 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:15.974737 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e17f364-a9b4-4f96-a04b-8568f7d98e01 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:15.976668 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e17f364-a9b4-4f96-a04b-8568f7d98e01 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:15.978663 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e17f364-a9b4-4f96-a04b-8568f7d98e01 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:16.059441 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2e17f364-a9b4-4f96-a04b-8568f7d98e01 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:16.073675 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2e17f364-a9b4-4f96-a04b-8568f7d98e01 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/f30dcd4e-f14f-4f37-bb07-05bafdff2bbb" status: 200 len: 1215 microversion: 2.1 time: 0.127688 Sep 10 11:47:16.079703 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 951/1989] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:15 2022] GET /compute/v2.1/servers/f30dcd4e-f14f-4f37-bb07-05bafdff2bbb => generated 1215 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:16.167784 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f3c25db8-1a73-45a6-a60c-ff431232a1a6 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:16.168440 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f3c25db8-1a73-45a6-a60c-ff431232a1a6 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:16.179400 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3c25db8-1a73-45a6-a60c-ff431232a1a6 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:16.179902 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3c25db8-1a73-45a6-a60c-ff431232a1a6 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:16.180343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3c25db8-1a73-45a6-a60c-ff431232a1a6 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:16.181064 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3c25db8-1a73-45a6-a60c-ff431232a1a6 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:16.181525 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3c25db8-1a73-45a6-a60c-ff431232a1a6 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:16.181957 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3c25db8-1a73-45a6-a60c-ff431232a1a6 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:16.215760 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:47:16.295446 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a5cc7dfb-0efa-4044-852d-310c5f91c16e tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:16.307959 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a5cc7dfb-0efa-4044-852d-310c5f91c16e tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:16.310335 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a5cc7dfb-0efa-4044-852d-310c5f91c16e tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:16.314459 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a5cc7dfb-0efa-4044-852d-310c5f91c16e tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 2829 microversion: 2.32 time: 0.610054 Sep 10 11:47:16.317445 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1039/1990] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:47:15 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 2829 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:47:16.323245 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-81568a2b-d15a-412b-b6ac-591f0dda2332 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:16.323956 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-81568a2b-d15a-412b-b6ac-591f0dda2332 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:16.339702 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-81568a2b-d15a-412b-b6ac-591f0dda2332 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:16.340631 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-81568a2b-d15a-412b-b6ac-591f0dda2332 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:16.341262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-81568a2b-d15a-412b-b6ac-591f0dda2332 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:16.343321 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-81568a2b-d15a-412b-b6ac-591f0dda2332 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:16.343981 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-81568a2b-d15a-412b-b6ac-591f0dda2332 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:16.344596 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-81568a2b-d15a-412b-b6ac-591f0dda2332 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:16.505502 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-81568a2b-d15a-412b-b6ac-591f0dda2332 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d854474f4c4481ac407a76b4627c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b37b36096cd42f6b6568ff9eee2751c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:16.536056 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-81568a2b-d15a-412b-b6ac-591f0dda2332 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 200 len: 1425 microversion: 2.1 time: 0.217396 Sep 10 11:47:16.560756 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1040/1991] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:16 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 1425 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:16.570430 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f3c25db8-1a73-45a6-a60c-ff431232a1a6 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:16.574582 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-30a3c48d-ff88-4490-8d99-af51ab2da04a req-5df86168-8afd-4c69-a769-9ff5f1b1c6b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d54e6606-e731-472f-a828-0b2778a3b642", "tag": "8d303678-6914-42c7-92b8-39a1591b74c9"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:16.582178 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f3c25db8-1a73-45a6-a60c-ff431232a1a6 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1485 microversion: 2.1 time: 0.417997 Sep 10 11:47:16.582908 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 952/1992] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:16 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1485 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:16.592695 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-307bd140-d001-422b-b477-38608650f3e9 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:16.593365 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-307bd140-d001-422b-b477-38608650f3e9 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:16.611736 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-307bd140-d001-422b-b477-38608650f3e9 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:16.612280 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-307bd140-d001-422b-b477-38608650f3e9 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:16.612733 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-307bd140-d001-422b-b477-38608650f3e9 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:16.613459 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-307bd140-d001-422b-b477-38608650f3e9 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:16.613925 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-307bd140-d001-422b-b477-38608650f3e9 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:16.614361 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-307bd140-d001-422b-b477-38608650f3e9 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:16.619922 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-30a3c48d-ff88-4490-8d99-af51ab2da04a req-5df86168-8afd-4c69-a769-9ff5f1b1c6b1 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:16.621321 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-30a3c48d-ff88-4490-8d99-af51ab2da04a req-5df86168-8afd-4c69-a769-9ff5f1b1c6b1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:16.621740 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-30a3c48d-ff88-4490-8d99-af51ab2da04a req-5df86168-8afd-4c69-a769-9ff5f1b1c6b1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:16.659897 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-30a3c48d-ff88-4490-8d99-af51ab2da04a req-5df86168-8afd-4c69-a769-9ff5f1b1c6b1 service nova] Creating event network-changed:8d303678-6914-42c7-92b8-39a1591b74c9 for instance d54e6606-e731-472f-a828-0b2778a3b642 on n-h1-856895-1 Sep 10 11:47:16.686200 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-30a3c48d-ff88-4490-8d99-af51ab2da04a req-5df86168-8afd-4c69-a769-9ff5f1b1c6b1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124017 Sep 10 11:47:16.697062 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1041/1993] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:47:16.709466 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-54a9a68b-9d1a-45a5-bc49-084e0c395507 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:16.720239 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-54a9a68b-9d1a-45a5-bc49-084e0c395507 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: f33c83e4-9881-4c1e-a502-ad9589fd597c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:16.736470 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54a9a68b-9d1a-45a5-bc49-084e0c395507 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:16.737246 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54a9a68b-9d1a-45a5-bc49-084e0c395507 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:16.740328 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54a9a68b-9d1a-45a5-bc49-084e0c395507 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:16.741938 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54a9a68b-9d1a-45a5-bc49-084e0c395507 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:16.742593 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54a9a68b-9d1a-45a5-bc49-084e0c395507 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:16.744308 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54a9a68b-9d1a-45a5-bc49-084e0c395507 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:17.030134 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-307bd140-d001-422b-b477-38608650f3e9 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.443948 Sep 10 11:47:17.031738 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 953/1994] 10.222.0.23 () {60 vars in 1316 bytes} [Sat Sep 10 11:47:16 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c/os-interface => generated 1832 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:47:17.037241 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-86c2d3a5-215f-40d2-8c09-cab561e6207d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:17.038067 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-86c2d3a5-215f-40d2-8c09-cab561e6207d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:17.059497 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86c2d3a5-215f-40d2-8c09-cab561e6207d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:17.061969 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86c2d3a5-215f-40d2-8c09-cab561e6207d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:17.063920 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86c2d3a5-215f-40d2-8c09-cab561e6207d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:17.064775 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86c2d3a5-215f-40d2-8c09-cab561e6207d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:17.067862 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86c2d3a5-215f-40d2-8c09-cab561e6207d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:17.069339 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86c2d3a5-215f-40d2-8c09-cab561e6207d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:17.732421 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-54a9a68b-9d1a-45a5-bc49-084e0c395507 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ea7c11febf451da4f1faf4dff9471d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f601d0bb424da4bb02b532ac982878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:17.748508 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-54a9a68b-9d1a-45a5-bc49-084e0c395507 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "GET /compute/v2.1/servers/f33c83e4-9881-4c1e-a502-ad9589fd597c" status: 200 len: 1508 microversion: 2.1 time: 1.045467 Sep 10 11:47:17.749422 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1042/1995] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:16 2022] GET /compute/v2.1/servers/f33c83e4-9881-4c1e-a502-ad9589fd597c => generated 1508 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:17.763114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-22f5fd17-6fc3-4166-9307-4b48745e6df7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:17.763982 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-22f5fd17-6fc3-4166-9307-4b48745e6df7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: f30dcd4e-f14f-4f37-bb07-05bafdff2bbb] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:17.788887 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-22f5fd17-6fc3-4166-9307-4b48745e6df7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:17.789514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-22f5fd17-6fc3-4166-9307-4b48745e6df7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:17.789967 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-22f5fd17-6fc3-4166-9307-4b48745e6df7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:17.790711 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-22f5fd17-6fc3-4166-9307-4b48745e6df7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:17.791183 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-22f5fd17-6fc3-4166-9307-4b48745e6df7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:17.795452 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-22f5fd17-6fc3-4166-9307-4b48745e6df7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:17.838710 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:47:17.987735 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-22f5fd17-6fc3-4166-9307-4b48745e6df7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:18.019535 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-86c2d3a5-215f-40d2-8c09-cab561e6207d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:18.029507 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-86c2d3a5-215f-40d2-8c09-cab561e6207d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:18.030824 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-22f5fd17-6fc3-4166-9307-4b48745e6df7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/f30dcd4e-f14f-4f37-bb07-05bafdff2bbb" status: 200 len: 1289 microversion: 2.1 time: 0.270011 Sep 10 11:47:18.031831 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1043/1996] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:17 2022] GET /compute/v2.1/servers/f30dcd4e-f14f-4f37-bb07-05bafdff2bbb => generated 1289 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:18.036442 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-86c2d3a5-215f-40d2-8c09-cab561e6207d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:18.040873 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7ba80240-f051-430e-8961-d2c2ff1af402 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:18.042404 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-86c2d3a5-215f-40d2-8c09-cab561e6207d tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1729 microversion: 2.25 time: 1.009457 Sep 10 11:47:18.055719 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 954/1997] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:47:17 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1729 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:47:18.057990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7ba80240-f051-430e-8961-d2c2ff1af402 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] [instance: e3606a9e-e02c-451e-98b9-2e6395c6af17] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:18.075014 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ba80240-f051-430e-8961-d2c2ff1af402 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:18.075922 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ba80240-f051-430e-8961-d2c2ff1af402 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:18.076367 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ba80240-f051-430e-8961-d2c2ff1af402 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:18.077082 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ba80240-f051-430e-8961-d2c2ff1af402 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:18.082495 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ba80240-f051-430e-8961-d2c2ff1af402 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:18.082833 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ba80240-f051-430e-8961-d2c2ff1af402 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:18.119735 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-7ba80240-f051-430e-8961-d2c2ff1af402 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] HTTP exception thrown: Instance e3606a9e-e02c-451e-98b9-2e6395c6af17 could not be found. Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7ba80240-f051-430e-8961-d2c2ff1af402 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Request method failure captured: Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 HTTP/1.1 Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHf7mACdlfzYNqqdAdehYL4NCPaTh2LiHYzzG2y_R-m91DirSD9NpPMperwROx5CtpOnZxmqPDNB9-2DL_apNDkdE-LB__QyjBTbYbDUeOWNR455kuIEfcUXxBZGOPYw79BioFM9zb447QPq1yl7E0tXPTJg7uWBXuI8k7QYTs8cI-Y Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 7b37b36096cd42f6b6568ff9eee2751c Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-MigrationsAdminTest-29591251 Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7b37b36096cd42f6b6568ff9eee2751c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7b37b36096cd42f6b6568ff9eee2751c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7b37b36096cd42f6b6568ff9eee2751c", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7b37b36096cd42f6b6568ff9eee2751c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-MigrationsAdminTest-29591251 Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 7b37b36096cd42f6b6568ff9eee2751c Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-MigrationsAdminTest-29591251 Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-MigrationsAdminTest-29591251-project Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 77d854474f4c4481ac407a76b4627c69 Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-MigrationsAdminTest-29591251-project Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance e3606a9e-e02c-451e-98b9-2e6395c6af17 could not be found. Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'e3606a9e-e02c-451e-98b9-2e6395c6af17'} Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3606a9e-e02c-451e-98b9-2e6395c6af17 could not be found. Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3606a9e-e02c-451e-98b9-2e6395c6af17 could not be found. Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:47:18.124156 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:18.127762 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:18.127762 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:47:18.127762 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:47:18.127762 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:47:18.127762 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:47:18.127762 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3606a9e-e02c-451e-98b9-2e6395c6af17 could not be found. Sep 10 11:47:18.127762 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:18.132097 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7ba80240-f051-430e-8961-d2c2ff1af402 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] Returning 404 to user: Instance e3606a9e-e02c-451e-98b9-2e6395c6af17 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:47:18.135945 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7ba80240-f051-430e-8961-d2c2ff1af402 tempest-MigrationsAdminTest-29591251 tempest-MigrationsAdminTest-29591251-project] 10.222.0.23 "GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17" status: 404 len: 111 microversion: 2.1 time: 0.100447 Sep 10 11:47:18.140236 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1044/1998] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:18 2022] GET /compute/v2.1/servers/e3606a9e-e02c-451e-98b9-2e6395c6af17 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:47:18.718413 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-d6bc9817-06f4-4d51-b26d-5f8dbe5ec5bd req-ac735b0e-3aaf-46a7-acd9-dd6a5188a67c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3606a9e-e02c-451e-98b9-2e6395c6af17", "name": "network-vif-deleted", "tag": "f498d2de-3776-434f-9d82-c17325598f02"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:18.733909 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d6bc9817-06f4-4d51-b26d-5f8dbe5ec5bd req-ac735b0e-3aaf-46a7-acd9-dd6a5188a67c service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:18.738964 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d6bc9817-06f4-4d51-b26d-5f8dbe5ec5bd req-ac735b0e-3aaf-46a7-acd9-dd6a5188a67c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:18.739561 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d6bc9817-06f4-4d51-b26d-5f8dbe5ec5bd req-ac735b0e-3aaf-46a7-acd9-dd6a5188a67c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:18.768033 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-d6bc9817-06f4-4d51-b26d-5f8dbe5ec5bd req-ac735b0e-3aaf-46a7-acd9-dd6a5188a67c service nova] Creating event network-vif-deleted:f498d2de-3776-434f-9d82-c17325598f02 for instance e3606a9e-e02c-451e-98b9-2e6395c6af17 on n-h1-856895-1 Sep 10 11:47:18.783347 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-d6bc9817-06f4-4d51-b26d-5f8dbe5ec5bd req-ac735b0e-3aaf-46a7-acd9-dd6a5188a67c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068702 Sep 10 11:47:18.789157 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 955/1999] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:47:19.060227 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4d7c222c-3615-44fd-a02d-c5f27a3b93ac tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:19.062045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4d7c222c-3615-44fd-a02d-c5f27a3b93ac tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: f30dcd4e-f14f-4f37-bb07-05bafdff2bbb] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:19.078758 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-90955f37-f08c-4560-a370-78caaefccdda tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:19.081067 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-90955f37-f08c-4560-a370-78caaefccdda tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:19.100965 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:47:19.102626 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4d7c222c-3615-44fd-a02d-c5f27a3b93ac tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:19.104898 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4d7c222c-3615-44fd-a02d-c5f27a3b93ac tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:19.105631 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4d7c222c-3615-44fd-a02d-c5f27a3b93ac tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:19.106838 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90955f37-f08c-4560-a370-78caaefccdda tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:19.107885 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90955f37-f08c-4560-a370-78caaefccdda tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:19.108629 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4d7c222c-3615-44fd-a02d-c5f27a3b93ac tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:19.109873 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90955f37-f08c-4560-a370-78caaefccdda tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:19.110087 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4d7c222c-3615-44fd-a02d-c5f27a3b93ac tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:19.113951 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90955f37-f08c-4560-a370-78caaefccdda tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:19.114663 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4d7c222c-3615-44fd-a02d-c5f27a3b93ac tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:19.115970 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90955f37-f08c-4560-a370-78caaefccdda tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:19.122219 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90955f37-f08c-4560-a370-78caaefccdda tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:19.311642 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4d7c222c-3615-44fd-a02d-c5f27a3b93ac tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:19.324818 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4d7c222c-3615-44fd-a02d-c5f27a3b93ac tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/f30dcd4e-f14f-4f37-bb07-05bafdff2bbb" status: 200 len: 1277 microversion: 2.1 time: 0.270273 Sep 10 11:47:19.338268 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1045/2000] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:19 2022] GET /compute/v2.1/servers/f30dcd4e-f14f-4f37-bb07-05bafdff2bbb => generated 1277 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:19.370118 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-90955f37-f08c-4560-a370-78caaefccdda tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:19.379748 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-90955f37-f08c-4560-a370-78caaefccdda tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:19.381313 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-90955f37-f08c-4560-a370-78caaefccdda tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:19.420386 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-90955f37-f08c-4560-a370-78caaefccdda tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1661 microversion: 2.25 time: 0.349599 Sep 10 11:47:19.423203 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 956/2001] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:47:19 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1661 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:47:20.017399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-f6eceae5-6cd5-472d-bb6b-266aaa21ff7d req-36fa182a-6b5a-421b-ba6d-4c4bd9baf3d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50d20272-889d-4b72-b33d-73094c78c7b4", "name": "network-vif-deleted", "tag": "4a6239c6-5b04-4a27-9109-707d2bf0a4ed"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:20.060471 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-f6eceae5-6cd5-472d-bb6b-266aaa21ff7d req-36fa182a-6b5a-421b-ba6d-4c4bd9baf3d2 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:20.061147 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-f6eceae5-6cd5-472d-bb6b-266aaa21ff7d req-36fa182a-6b5a-421b-ba6d-4c4bd9baf3d2 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:20.064807 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-f6eceae5-6cd5-472d-bb6b-266aaa21ff7d req-36fa182a-6b5a-421b-ba6d-4c4bd9baf3d2 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:20.132667 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-f6eceae5-6cd5-472d-bb6b-266aaa21ff7d req-36fa182a-6b5a-421b-ba6d-4c4bd9baf3d2 service nova] Creating event network-vif-deleted:4a6239c6-5b04-4a27-9109-707d2bf0a4ed for instance 50d20272-889d-4b72-b33d-73094c78c7b4 on n-h1-856895-1 Sep 10 11:47:20.161105 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-f6eceae5-6cd5-472d-bb6b-266aaa21ff7d req-36fa182a-6b5a-421b-ba6d-4c4bd9baf3d2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141225 Sep 10 11:47:20.162124 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1046/2002] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:47:20.351369 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-604ba302-5141-4f5d-a2f1-aff428219e8a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:20.352568 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-604ba302-5141-4f5d-a2f1-aff428219e8a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: f30dcd4e-f14f-4f37-bb07-05bafdff2bbb] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:20.374392 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-604ba302-5141-4f5d-a2f1-aff428219e8a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:20.374908 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-604ba302-5141-4f5d-a2f1-aff428219e8a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:20.375383 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-604ba302-5141-4f5d-a2f1-aff428219e8a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:20.376108 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-604ba302-5141-4f5d-a2f1-aff428219e8a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:20.376569 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-604ba302-5141-4f5d-a2f1-aff428219e8a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:20.376996 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-604ba302-5141-4f5d-a2f1-aff428219e8a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:20.452119 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a7e7101b-4565-4ca5-9a3a-8e9d52d8d584 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:20.453078 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a7e7101b-4565-4ca5-9a3a-8e9d52d8d584 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:20.460962 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a7e7101b-4565-4ca5-9a3a-8e9d52d8d584 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:20.461702 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a7e7101b-4565-4ca5-9a3a-8e9d52d8d584 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:20.462578 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a7e7101b-4565-4ca5-9a3a-8e9d52d8d584 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:20.463471 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a7e7101b-4565-4ca5-9a3a-8e9d52d8d584 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:20.464936 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a7e7101b-4565-4ca5-9a3a-8e9d52d8d584 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:20.467661 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a7e7101b-4565-4ca5-9a3a-8e9d52d8d584 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:20.561074 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a7e7101b-4565-4ca5-9a3a-8e9d52d8d584 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:20.562827 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a7e7101b-4565-4ca5-9a3a-8e9d52d8d584 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:20.564275 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a7e7101b-4565-4ca5-9a3a-8e9d52d8d584 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:20.567047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-a7e7101b-4565-4ca5-9a3a-8e9d52d8d584 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lazy-loading 'fault' on Instance uuid 50d20272-889d-4b72-b33d-73094c78c7b4 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:47:20.675263 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-604ba302-5141-4f5d-a2f1-aff428219e8a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:20.688776 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-604ba302-5141-4f5d-a2f1-aff428219e8a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/f30dcd4e-f14f-4f37-bb07-05bafdff2bbb" status: 200 len: 1277 microversion: 2.1 time: 0.342608 Sep 10 11:47:20.691337 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 957/2003] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:20 2022] GET /compute/v2.1/servers/f30dcd4e-f14f-4f37-bb07-05bafdff2bbb => generated 1277 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:20.704013 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8fe1eef1-28d8-4df1-afd1-b8529ac2ed45 tempest-VolumesAdminNegativeTest-1652611779 tempest-VolumesAdminNegativeTest-1652611779-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "115855c9-81d5-4934-a177-76f895e5b56a"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:20.713002 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a7e7101b-4565-4ca5-9a3a-8e9d52d8d584 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:20.718510 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8fe1eef1-28d8-4df1-afd1-b8529ac2ed45 tempest-VolumesAdminNegativeTest-1652611779 tempest-VolumesAdminNegativeTest-1652611779-project-admin] [instance: f33c83e4-9881-4c1e-a502-ad9589fd597c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:20.729818 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a7e7101b-4565-4ca5-9a3a-8e9d52d8d584 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:20.735083 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a7e7101b-4565-4ca5-9a3a-8e9d52d8d584 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:20.738601 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a7e7101b-4565-4ca5-9a3a-8e9d52d8d584 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 200 len: 1375 microversion: 2.25 time: 0.288559 Sep 10 11:47:20.739250 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1047/2004] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:47:20 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 1375 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:47:20.741000 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8fe1eef1-28d8-4df1-afd1-b8529ac2ed45 tempest-VolumesAdminNegativeTest-1652611779 tempest-VolumesAdminNegativeTest-1652611779-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:20.742324 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8fe1eef1-28d8-4df1-afd1-b8529ac2ed45 tempest-VolumesAdminNegativeTest-1652611779 tempest-VolumesAdminNegativeTest-1652611779-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:20.751535 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8fe1eef1-28d8-4df1-afd1-b8529ac2ed45 tempest-VolumesAdminNegativeTest-1652611779 tempest-VolumesAdminNegativeTest-1652611779-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:20.752777 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8fe1eef1-28d8-4df1-afd1-b8529ac2ed45 tempest-VolumesAdminNegativeTest-1652611779 tempest-VolumesAdminNegativeTest-1652611779-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:20.753502 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8fe1eef1-28d8-4df1-afd1-b8529ac2ed45 tempest-VolumesAdminNegativeTest-1652611779 tempest-VolumesAdminNegativeTest-1652611779-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:20.754161 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8fe1eef1-28d8-4df1-afd1-b8529ac2ed45 tempest-VolumesAdminNegativeTest-1652611779 tempest-VolumesAdminNegativeTest-1652611779-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:20.841571 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-8fe1eef1-28d8-4df1-afd1-b8529ac2ed45 tempest-VolumesAdminNegativeTest-1652611779 tempest-VolumesAdminNegativeTest-1652611779-project-admin] HTTP exception thrown: Volume 139dac2b-c113-4f29-a6fa-a9df5a71bdd1 could not be found. Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8fe1eef1-28d8-4df1-afd1-b8529ac2ed45 tempest-VolumesAdminNegativeTest-1652611779 tempest-VolumesAdminNegativeTest-1652611779-project-admin] Request method failure captured: Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: request: PUT /compute/v2.1/servers/f33c83e4-9881-4c1e-a502-ad9589fd597c/os-volume_attachments/139dac2b-c113-4f29-a6fa-a9df5a71bdd1 HTTP/1.1 Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 74 Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHjHDDvKem4aKoNZBhFSfADDoVLMh_HkAJjD42PE5rE_fQq2BKq6WTuOOgU4kUQqaZclXy0nJYQ1cSso41_yDXqlr8GQLo8ZXOwP75hmGF6FJf_ePIOHeYlOIg0ZY8OVyt4iaaOBGGT-6GkuostV8jU7dPaEA34gdq_RhV0LF0z9aCc Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 14d092e887434bd385f4d1fcf9411963 Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-VolumesAdminNegativeTest-1652611779 Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,admin,member Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,admin,member Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/14d092e887434bd385f4d1fcf9411963"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/14d092e887434bd385f4d1fcf9411963"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_14d092e887434bd385f4d1fcf9411963", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/14d092e887434bd385f4d1fcf9411963"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-VolumesAdminNegativeTest-1652611779 Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 14d092e887434bd385f4d1fcf9411963 Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1652611779 Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-VolumesAdminNegativeTest-1652611779-project-admin Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 0561e52ef3fa42fe94d26f9cff16765c Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-VolumesAdminNegativeTest-1652611779-project-admin Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: {"volumeAttachment": {"volumeId": "115855c9-81d5-4934-a177-76f895e5b56a"}} Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: exception: Volume 139dac2b-c113-4f29-a6fa-a9df5a71bdd1 could not be found. Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'server_id': 'f33c83e4-9881-4c1e-a502-ad9589fd597c', 'id': '139dac2b-c113-4f29-a6fa-a9df5a71bdd1', 'body': {'volumeAttachment': {'volumeId': '115855c9-81d5-4934-a177-76f895e5b56a'}}} Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 139dac2b-c113-4f29-a6fa-a9df5a71bdd1 could not be found. (HTTP 404) (Request-ID: req-d63c0e2f-a607-4342-8c7a-f2cc3ebc237c) Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 10 11:47:20.844120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 139dac2b-c113-4f29-a6fa-a9df5a71bdd1 could not be found. Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 139dac2b-c113-4f29-a6fa-a9df5a71bdd1 could not be found. Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 139dac2b-c113-4f29-a6fa-a9df5a71bdd1 could not be found. Sep 10 11:47:20.848231 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:20.854268 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8fe1eef1-28d8-4df1-afd1-b8529ac2ed45 tempest-VolumesAdminNegativeTest-1652611779 tempest-VolumesAdminNegativeTest-1652611779-project-admin] Returning 404 to user: Volume 139dac2b-c113-4f29-a6fa-a9df5a71bdd1 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:47:20.855382 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8fe1eef1-28d8-4df1-afd1-b8529ac2ed45 tempest-VolumesAdminNegativeTest-1652611779 tempest-VolumesAdminNegativeTest-1652611779-project-admin] 10.222.0.23 "PUT /compute/v2.1/servers/f33c83e4-9881-4c1e-a502-ad9589fd597c/os-volume_attachments/139dac2b-c113-4f29-a6fa-a9df5a71bdd1" status: 404 len: 109 microversion: 2.1 time: 0.160632 Sep 10 11:47:20.861207 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 958/2005] 10.222.0.23 () {60 vars in 1433 bytes} [Sat Sep 10 11:47:20 2022] PUT /compute/v2.1/servers/f33c83e4-9881-4c1e-a502-ad9589fd597c/os-volume_attachments/139dac2b-c113-4f29-a6fa-a9df5a71bdd1 => generated 109 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:47:21.717830 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e208a37e-2fd8-4616-8208-531b1087ae99 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:21.718998 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e208a37e-2fd8-4616-8208-531b1087ae99 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: f30dcd4e-f14f-4f37-bb07-05bafdff2bbb] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:21.736145 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e208a37e-2fd8-4616-8208-531b1087ae99 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:21.740894 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e208a37e-2fd8-4616-8208-531b1087ae99 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:21.741562 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e208a37e-2fd8-4616-8208-531b1087ae99 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:21.742895 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e208a37e-2fd8-4616-8208-531b1087ae99 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:21.743546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e208a37e-2fd8-4616-8208-531b1087ae99 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:21.749542 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e208a37e-2fd8-4616-8208-531b1087ae99 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:21.771423 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-28d5ed61-d9b5-42b5-ba9e-a698801fa14b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:21.776284 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-28d5ed61-d9b5-42b5-ba9e-a698801fa14b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: 50d20272-889d-4b72-b33d-73094c78c7b4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:21.805710 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28d5ed61-d9b5-42b5-ba9e-a698801fa14b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:21.807964 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28d5ed61-d9b5-42b5-ba9e-a698801fa14b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:21.808879 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28d5ed61-d9b5-42b5-ba9e-a698801fa14b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:21.811441 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28d5ed61-d9b5-42b5-ba9e-a698801fa14b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:21.811917 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28d5ed61-d9b5-42b5-ba9e-a698801fa14b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:21.812356 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28d5ed61-d9b5-42b5-ba9e-a698801fa14b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:21.872458 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-28d5ed61-d9b5-42b5-ba9e-a698801fa14b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] HTTP exception thrown: Instance 50d20272-889d-4b72-b33d-73094c78c7b4 could not be found. Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-28d5ed61-d9b5-42b5-ba9e-a698801fa14b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Request method failure captured: Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 HTTP/1.1 Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHed8GF4SHtUgHPAUwxlZp0PmksNunRKLHn4uufMjtnzMfcEDxm2fmaX4NtyCJylpQQHwCgUEqgi5V2zrbiedUn-xH6Izrg70le3OLsPeCQnm-5rS791bk5YHAVkg9DydYFa9B3iw8qLoH3oNVeO61-DMPi6A6i3npn7mlsBW8bk71c Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: X-Openstack-Nova-Api-Version: 2.25 Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: c8c0800673e247fb8b3b3718512233c0 Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1948749437 Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8c0800673e247fb8b3b3718512233c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8c0800673e247fb8b3b3718512233c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c8c0800673e247fb8b3b3718512233c0", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c8c0800673e247fb8b3b3718512233c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1948749437 Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: c8c0800673e247fb8b3b3718512233c0 Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1948749437 Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-LiveAutoBlockMigrationV225Test-1948749437-project Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 1106bb2c5ce14c21a15ad62942745b62 Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1948749437-project Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 50d20272-889d-4b72-b33d-73094c78c7b4 could not be found. Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '50d20272-889d-4b72-b33d-73094c78c7b4'} Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50d20272-889d-4b72-b33d-73094c78c7b4 could not be found. Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50d20272-889d-4b72-b33d-73094c78c7b4 could not be found. Sep 10 11:47:21.874388 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:21.880009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:47:21.880009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:21.880009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:21.880009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:47:21.880009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:47:21.880009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:47:21.880009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:47:21.880009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50d20272-889d-4b72-b33d-73094c78c7b4 could not be found. Sep 10 11:47:21.880009 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:21.881837 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-28d5ed61-d9b5-42b5-ba9e-a698801fa14b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Returning 404 to user: Instance 50d20272-889d-4b72-b33d-73094c78c7b4 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:47:21.882889 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-28d5ed61-d9b5-42b5-ba9e-a698801fa14b tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4" status: 404 len: 111 microversion: 2.25 time: 0.119039 Sep 10 11:47:21.884142 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 959/2006] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:47:21 2022] GET /compute/v2.1/servers/50d20272-889d-4b72-b33d-73094c78c7b4 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:47:21.894786 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c3c26eb9-2895-4288-a778-0690fb528046 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '.version_select at 0x7f4073aaa4c0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:21.928846 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c3c26eb9-2895-4288-a778-0690fb528046 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1655694967" status: 204 len: 0 microversion: 2.25 time: 0.040444 Sep 10 11:47:21.932039 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 960/2007] 10.222.0.23 () {60 vars in 1262 bytes} [Sat Sep 10 11:47:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1655694967 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 10 11:47:22.212796 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-18aa3a47-c9ae-425b-b443-1f77a588609d req-683b36c8-ab34-4e63-b490-8f2845c0a550 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d86e1b80-a305-48c7-9c51-ef4175a5840c", "tag": "6ccddaf2-efc8-42e5-9c38-3ba375ee3f68"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:22.236750 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-18aa3a47-c9ae-425b-b443-1f77a588609d req-683b36c8-ab34-4e63-b490-8f2845c0a550 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:22.237370 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-18aa3a47-c9ae-425b-b443-1f77a588609d req-683b36c8-ab34-4e63-b490-8f2845c0a550 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:22.240894 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-18aa3a47-c9ae-425b-b443-1f77a588609d req-683b36c8-ab34-4e63-b490-8f2845c0a550 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:22.276874 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-18aa3a47-c9ae-425b-b443-1f77a588609d req-683b36c8-ab34-4e63-b490-8f2845c0a550 service nova] Creating event network-changed:6ccddaf2-efc8-42e5-9c38-3ba375ee3f68 for instance d86e1b80-a305-48c7-9c51-ef4175a5840c on n-h2-856895-1 Sep 10 11:47:22.296997 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-18aa3a47-c9ae-425b-b443-1f77a588609d req-683b36c8-ab34-4e63-b490-8f2845c0a550 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089703 Sep 10 11:47:22.298443 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 961/2008] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:47:22.872807 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e208a37e-2fd8-4616-8208-531b1087ae99 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:22.890846 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e208a37e-2fd8-4616-8208-531b1087ae99 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/f30dcd4e-f14f-4f37-bb07-05bafdff2bbb" status: 200 len: 1319 microversion: 2.1 time: 1.177952 Sep 10 11:47:22.892196 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1048/2009] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:21 2022] GET /compute/v2.1/servers/f30dcd4e-f14f-4f37-bb07-05bafdff2bbb => generated 1319 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:23.734527 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:47:23.920844 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8e794dbe-f127-4a3b-85e3-7c8a6158837b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:23.921478 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8e794dbe-f127-4a3b-85e3-7c8a6158837b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: f30dcd4e-f14f-4f37-bb07-05bafdff2bbb] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:23.937701 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e794dbe-f127-4a3b-85e3-7c8a6158837b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:23.938197 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e794dbe-f127-4a3b-85e3-7c8a6158837b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:23.938703 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e794dbe-f127-4a3b-85e3-7c8a6158837b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:23.945278 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e794dbe-f127-4a3b-85e3-7c8a6158837b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:23.946437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e794dbe-f127-4a3b-85e3-7c8a6158837b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:23.953173 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e794dbe-f127-4a3b-85e3-7c8a6158837b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:24.015033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-40835ad2-adbf-42e4-b42d-d8b035fac272 tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Calling method '.version_select at 0x7f4073665160>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:24.201784 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-40835ad2-adbf-42e4-b42d-d8b035fac272 tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/3fa744ef0e2345fc903f1303bc5c40f7" status: 200 len: 371 microversion: 2.1 time: 0.472367 Sep 10 11:47:24.206512 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 962/2010] 10.222.0.23 () {58 vars in 1242 bytes} [Sat Sep 10 11:47:23 2022] GET /compute/v2.1/os-quota-sets/3fa744ef0e2345fc903f1303bc5c40f7 => generated 371 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:47:24.235908 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-f0034303-112a-4e89-b09a-3844f43672d9 req-fa9270a4-c64a-4c5e-b58e-9db01835ab6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ab5ad80-d86c-44f1-870d-777d44fd340a", "tag": "a16a30e4-67d2-4203-af44-c01e5a7af9b6"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:24.257332 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f0034303-112a-4e89-b09a-3844f43672d9 req-fa9270a4-c64a-4c5e-b58e-9db01835ab6d service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:24.258037 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f0034303-112a-4e89-b09a-3844f43672d9 req-fa9270a4-c64a-4c5e-b58e-9db01835ab6d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:24.258723 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f0034303-112a-4e89-b09a-3844f43672d9 req-fa9270a4-c64a-4c5e-b58e-9db01835ab6d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:24.273298 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-f0034303-112a-4e89-b09a-3844f43672d9 req-fa9270a4-c64a-4c5e-b58e-9db01835ab6d service nova] Creating event network-changed:a16a30e4-67d2-4203-af44-c01e5a7af9b6 for instance 2ab5ad80-d86c-44f1-870d-777d44fd340a on n-h2-856895-1 Sep 10 11:47:24.274191 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:47:24.282974 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-f0034303-112a-4e89-b09a-3844f43672d9 req-fa9270a4-c64a-4c5e-b58e-9db01835ab6d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074520 Sep 10 11:47:24.284635 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 963/2011] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:47:24.292174 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6f94b7d6-19b3-47cf-bd9d-4676dffab430 tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Action: 'update', calling method: .version_select at 0x7f407b5ea430>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:24.566705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8e794dbe-f127-4a3b-85e3-7c8a6158837b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:24.584745 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8e794dbe-f127-4a3b-85e3-7c8a6158837b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/f30dcd4e-f14f-4f37-bb07-05bafdff2bbb" status: 200 len: 1319 microversion: 2.1 time: 0.668163 Sep 10 11:47:24.607777 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1049/2012] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:23 2022] GET /compute/v2.1/servers/f30dcd4e-f14f-4f37-bb07-05bafdff2bbb => generated 1319 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:47:24.672113 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-4859018b-51e8-4429-8b43-b22949862c43 req-5f3a2a0c-1444-4aa4-90c3-b1a87be3981c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f30dcd4e-f14f-4f37-bb07-05bafdff2bbb", "tag": "ed9ab511-09d7-41ab-a241-008569856ae1"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:24.684263 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-4859018b-51e8-4429-8b43-b22949862c43 req-5f3a2a0c-1444-4aa4-90c3-b1a87be3981c service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:24.688040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-4859018b-51e8-4429-8b43-b22949862c43 req-5f3a2a0c-1444-4aa4-90c3-b1a87be3981c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:24.690680 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-4859018b-51e8-4429-8b43-b22949862c43 req-5f3a2a0c-1444-4aa4-90c3-b1a87be3981c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:24.710769 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f94b7d6-19b3-47cf-bd9d-4676dffab430 tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:24.711299 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f94b7d6-19b3-47cf-bd9d-4676dffab430 tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:24.715569 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f94b7d6-19b3-47cf-bd9d-4676dffab430 tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:24.718542 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-4859018b-51e8-4429-8b43-b22949862c43 req-5f3a2a0c-1444-4aa4-90c3-b1a87be3981c service nova] Creating event network-changed:ed9ab511-09d7-41ab-a241-008569856ae1 for instance f30dcd4e-f14f-4f37-bb07-05bafdff2bbb on n-h2-856895-1 Sep 10 11:47:24.718968 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f94b7d6-19b3-47cf-bd9d-4676dffab430 tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:24.719522 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f94b7d6-19b3-47cf-bd9d-4676dffab430 tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:24.719965 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f94b7d6-19b3-47cf-bd9d-4676dffab430 tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:24.726232 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-4859018b-51e8-4429-8b43-b22949862c43 req-5f3a2a0c-1444-4aa4-90c3-b1a87be3981c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058163 Sep 10 11:47:24.727956 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1050/2013] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:47:24.858297 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6f94b7d6-19b3-47cf-bd9d-4676dffab430 tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/3fa744ef0e2345fc903f1303bc5c40f7" status: 200 len: 328 microversion: 2.1 time: 0.571937 Sep 10 11:47:24.863431 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 964/2014] 10.222.0.23 () {60 vars in 1262 bytes} [Sat Sep 10 11:47:24 2022] PUT /compute/v2.1/os-quota-sets/3fa744ef0e2345fc903f1303bc5c40f7 => generated 328 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:47:25.297323 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3726ba11-9074-4d72-946d-e1c2808f3591 tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1113353142", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:25.360120 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-3726ba11-9074-4d72-946d-e1c2808f3591 tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] validate_networks() for None {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:47:25.452846 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-94c01e05-34a8-4bad-bad1-19109a08f77f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:25.453925 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-94c01e05-34a8-4bad-bad1-19109a08f77f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: f33c83e4-9881-4c1e-a502-ad9589fd597c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:25.462378 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-94c01e05-34a8-4bad-bad1-19109a08f77f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:25.463141 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-94c01e05-34a8-4bad-bad1-19109a08f77f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:25.463696 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-94c01e05-34a8-4bad-bad1-19109a08f77f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:25.464391 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-94c01e05-34a8-4bad-bad1-19109a08f77f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:25.464849 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-94c01e05-34a8-4bad-bad1-19109a08f77f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:25.465673 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-94c01e05-34a8-4bad-bad1-19109a08f77f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:25.498806 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-94c01e05-34a8-4bad-bad1-19109a08f77f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: f33c83e4-9881-4c1e-a502-ad9589fd597c] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:47:25.613128 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-94c01e05-34a8-4bad-bad1-19109a08f77f tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f33c83e4-9881-4c1e-a502-ad9589fd597c" status: 204 len: 0 microversion: 2.1 time: 0.165004 Sep 10 11:47:25.613841 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 965/2015] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:47:25 2022] DELETE /compute/v2.1/servers/f33c83e4-9881-4c1e-a502-ad9589fd597c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 11:47:25.624094 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9a7f51f9-54a8-479e-8394-99f15c00af90 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:25.624805 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9a7f51f9-54a8-479e-8394-99f15c00af90 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: ebff5197-fc62-4ee6-a688-6e12f04645b5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:25.632051 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a7f51f9-54a8-479e-8394-99f15c00af90 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:25.632822 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a7f51f9-54a8-479e-8394-99f15c00af90 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:25.633271 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a7f51f9-54a8-479e-8394-99f15c00af90 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:25.633979 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a7f51f9-54a8-479e-8394-99f15c00af90 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:25.634435 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a7f51f9-54a8-479e-8394-99f15c00af90 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:25.634865 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a7f51f9-54a8-479e-8394-99f15c00af90 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:25.663641 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9a7f51f9-54a8-479e-8394-99f15c00af90 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: ebff5197-fc62-4ee6-a688-6e12f04645b5] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:47:25.674207 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-3726ba11-9074-4d72-946d-e1c2808f3591 tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:47:25.677348 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-3726ba11-9074-4d72-946d-e1c2808f3591 tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:47:25.678871 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-3726ba11-9074-4d72-946d-e1c2808f3591 tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:47:25.680440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-3726ba11-9074-4d72-946d-e1c2808f3591 tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:47:25.681513 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-3726ba11-9074-4d72-946d-e1c2808f3591 tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:47:25.703982 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3726ba11-9074-4d72-946d-e1c2808f3591 tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:25.705394 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3726ba11-9074-4d72-946d-e1c2808f3591 tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:25.706681 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3726ba11-9074-4d72-946d-e1c2808f3591 tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:25.707915 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3726ba11-9074-4d72-946d-e1c2808f3591 tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:25.708660 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3726ba11-9074-4d72-946d-e1c2808f3591 tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:25.709950 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3726ba11-9074-4d72-946d-e1c2808f3591 tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:25.739001 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-3726ba11-9074-4d72-946d-e1c2808f3591 tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Getting quotas for project 3fa744ef0e2345fc903f1303bc5c40f7. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:47:25.757485 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9a7f51f9-54a8-479e-8394-99f15c00af90 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5" status: 204 len: 0 microversion: 2.25 time: 0.138980 Sep 10 11:47:25.758905 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 966/2016] 10.222.0.23 () {60 vars in 1280 bytes} [Sat Sep 10 11:47:25 2022] DELETE /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 11:47:25.766432 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ebf0ccb0-07d7-4121-a041-45fac76e8879 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:25.767718 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ebf0ccb0-07d7-4121-a041-45fac76e8879 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: f30dcd4e-f14f-4f37-bb07-05bafdff2bbb] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:25.774689 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-3726ba11-9074-4d72-946d-e1c2808f3591 tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Getting quotas for user d0c0dfa1d12a4cc9802fbf7c80885a30 and project 3fa744ef0e2345fc903f1303bc5c40f7. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:47:25.777534 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ebf0ccb0-07d7-4121-a041-45fac76e8879 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:25.778556 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ebf0ccb0-07d7-4121-a041-45fac76e8879 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:25.779122 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ebf0ccb0-07d7-4121-a041-45fac76e8879 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:25.780334 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ebf0ccb0-07d7-4121-a041-45fac76e8879 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:25.781083 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ebf0ccb0-07d7-4121-a041-45fac76e8879 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:25.781938 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ebf0ccb0-07d7-4121-a041-45fac76e8879 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:25.794363 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.utils [None req-3726ba11-9074-4d72-946d-e1c2808f3591 tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] cores quota exceeded for 3fa744ef0e2345fc903f1303bc5c40f7, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128777) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 10 11:47:25.794926 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-3726ba11-9074-4d72-946d-e1c2808f3591 tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3726ba11-9074-4d72-946d-e1c2808f3591 tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Request method failure captured: Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 145 Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHlKsPb8lFcyFSNgE5lsvDCXfG35mrpHVQYcQE1UfYtSHmlXYDVzxRBSFIJGsa4qZB4-0Q3XS7LCoBpCMbwCcxnN5F49EgOX4MSJjKG1V8dZrgXjqPLZmy1Dc2ZTsuawu32_OZFF5Bu3BfIHZ7WNEQFcOQVU4aB9wtK6PpS5QxqTceQ Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 3fa744ef0e2345fc903f1303bc5c40f7 Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-QuotasAdminNegativeTest-1370420310 Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3fa744ef0e2345fc903f1303bc5c40f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3fa744ef0e2345fc903f1303bc5c40f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3fa744ef0e2345fc903f1303bc5c40f7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3fa744ef0e2345fc903f1303bc5c40f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-QuotasAdminNegativeTest-1370420310 Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 3fa744ef0e2345fc903f1303bc5c40f7 Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1370420310 Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-QuotasAdminNegativeTest-1370420310-project Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: d0c0dfa1d12a4cc9802fbf7c80885a30 Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-QuotasAdminNegativeTest-1370420310-project Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1113353142", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452"}} Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1113353142', 'imageRef': 'c23d4d62-7ab9-4623-9273-7f44582aa2e1', 'flavorRef': '452'}}} Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 10 11:47:25.807547 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 10 11:47:25.812243 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 10 11:47:25.812243 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 10 11:47:25.812243 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 10 11:47:25.812243 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 10 11:47:25.812243 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 10 11:47:25.812243 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 10 11:47:25.812243 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:25.812243 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:47:25.812243 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:25.812243 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:25.812243 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:47:25.812243 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:47:25.812243 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:47:25.812243 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:47:25.812243 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:47:25.812243 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:47:25.812243 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:47:25.812243 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:47:25.812243 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:47:25.812243 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:47:25.812243 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:47:25.812243 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:47:25.812243 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 10 11:47:25.812243 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 10 11:47:25.812243 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 10 11:47:25.812243 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 10 11:47:25.812243 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:25.812243 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:47:25.812243 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:25.812243 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:25.812243 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:47:25.812243 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:47:25.812243 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:47:25.812243 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:47:25.812243 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 10 11:47:25.812243 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:25.815525 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3726ba11-9074-4d72-946d-e1c2808f3591 tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:47:25.816556 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3726ba11-9074-4d72-946d-e1c2808f3591 tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.805628 Sep 10 11:47:25.818327 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1051/2017] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:47:25 2022] POST /compute/v2.1/servers => generated 111 bytes in 808 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:47:25.829686 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fb2bb055-cbe2-44aa-bf2b-a22a10a435b8 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:25.830460 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fb2bb055-cbe2-44aa-bf2b-a22a10a435b8 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: f33c83e4-9881-4c1e-a502-ad9589fd597c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:25.840225 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fb2bb055-cbe2-44aa-bf2b-a22a10a435b8 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:25.840813 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fb2bb055-cbe2-44aa-bf2b-a22a10a435b8 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:25.841335 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fb2bb055-cbe2-44aa-bf2b-a22a10a435b8 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:25.842182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fb2bb055-cbe2-44aa-bf2b-a22a10a435b8 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:25.842909 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fb2bb055-cbe2-44aa-bf2b-a22a10a435b8 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:25.844135 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fb2bb055-cbe2-44aa-bf2b-a22a10a435b8 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:26.166661 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ebf0ccb0-07d7-4121-a041-45fac76e8879 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:26.175190 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ebf0ccb0-07d7-4121-a041-45fac76e8879 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/f30dcd4e-f14f-4f37-bb07-05bafdff2bbb" status: 200 len: 1319 microversion: 2.1 time: 0.414401 Sep 10 11:47:26.175848 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 967/2018] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:25 2022] GET /compute/v2.1/servers/f30dcd4e-f14f-4f37-bb07-05bafdff2bbb => generated 1319 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:26.180759 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-20a81e4c-260e-44cb-90d5-e85bd6c58e1a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:26.181320 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-20a81e4c-260e-44cb-90d5-e85bd6c58e1a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: ebff5197-fc62-4ee6-a688-6e12f04645b5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:26.187561 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20a81e4c-260e-44cb-90d5-e85bd6c58e1a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:26.188577 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20a81e4c-260e-44cb-90d5-e85bd6c58e1a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:26.189212 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20a81e4c-260e-44cb-90d5-e85bd6c58e1a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:26.190753 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20a81e4c-260e-44cb-90d5-e85bd6c58e1a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:26.191596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20a81e4c-260e-44cb-90d5-e85bd6c58e1a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:26.192344 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20a81e4c-260e-44cb-90d5-e85bd6c58e1a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:26.200668 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fb2bb055-cbe2-44aa-bf2b-a22a10a435b8 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ea7c11febf451da4f1faf4dff9471d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f601d0bb424da4bb02b532ac982878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:26.212156 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fb2bb055-cbe2-44aa-bf2b-a22a10a435b8 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "GET /compute/v2.1/servers/f33c83e4-9881-4c1e-a502-ad9589fd597c" status: 200 len: 1514 microversion: 2.1 time: 0.391530 Sep 10 11:47:26.213805 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1052/2019] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:25 2022] GET /compute/v2.1/servers/f33c83e4-9881-4c1e-a502-ad9589fd597c => generated 1514 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:26.224842 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4b841abb-6d02-40a0-9cfe-b68623e8af65 tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Action: 'update', calling method: .version_select at 0x7f407355f5e0>, body: {"quota_set": {"cores": 20}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:26.495644 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b841abb-6d02-40a0-9cfe-b68623e8af65 tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:26.496328 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-20a81e4c-260e-44cb-90d5-e85bd6c58e1a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:26.496934 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b841abb-6d02-40a0-9cfe-b68623e8af65 tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:26.497543 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b841abb-6d02-40a0-9cfe-b68623e8af65 tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:26.498431 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b841abb-6d02-40a0-9cfe-b68623e8af65 tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:26.499036 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b841abb-6d02-40a0-9cfe-b68623e8af65 tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:26.499805 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b841abb-6d02-40a0-9cfe-b68623e8af65 tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:26.515465 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-20a81e4c-260e-44cb-90d5-e85bd6c58e1a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:26.522416 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-20a81e4c-260e-44cb-90d5-e85bd6c58e1a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:26.524752 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-20a81e4c-260e-44cb-90d5-e85bd6c58e1a tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5" status: 200 len: 1548 microversion: 2.25 time: 0.346887 Sep 10 11:47:26.525852 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 968/2020] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:47:26 2022] GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5 => generated 1548 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:47:26.554941 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:47:26.603820 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4b841abb-6d02-40a0-9cfe-b68623e8af65 tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/3fa744ef0e2345fc903f1303bc5c40f7" status: 200 len: 329 microversion: 2.1 time: 0.388435 Sep 10 11:47:26.604416 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1053/2021] 10.222.0.23 () {60 vars in 1262 bytes} [Sat Sep 10 11:47:26 2022] PUT /compute/v2.1/os-quota-sets/3fa744ef0e2345fc903f1303bc5c40f7 => generated 329 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:47:26.620021 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-97e2ab14-207e-4fd4-a45c-1322c22b0375 tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Calling method '.version_select at 0x7f407397bdc0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:26.726582 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-97e2ab14-207e-4fd4-a45c-1322c22b0375 tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/3fa744ef0e2345fc903f1303bc5c40f7" status: 200 len: 371 microversion: 2.1 time: 0.110351 Sep 10 11:47:26.727197 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 969/2022] 10.222.0.23 () {58 vars in 1242 bytes} [Sat Sep 10 11:47:26 2022] GET /compute/v2.1/os-quota-sets/3fa744ef0e2345fc903f1303bc5c40f7 => generated 371 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:47:26.739602 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3709af70-6c19-493b-a82a-64323a492769 tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Action: 'update', calling method: .version_select at 0x7f407b52d3a0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:26.832180 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3709af70-6c19-493b-a82a-64323a492769 tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:26.832861 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3709af70-6c19-493b-a82a-64323a492769 tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:26.833477 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3709af70-6c19-493b-a82a-64323a492769 tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:26.834398 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3709af70-6c19-493b-a82a-64323a492769 tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:26.835664 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3709af70-6c19-493b-a82a-64323a492769 tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:26.836188 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3709af70-6c19-493b-a82a-64323a492769 tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:26.892525 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3709af70-6c19-493b-a82a-64323a492769 tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/3fa744ef0e2345fc903f1303bc5c40f7" status: 200 len: 328 microversion: 2.1 time: 0.157459 Sep 10 11:47:26.905342 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1054/2023] 10.222.0.23 () {60 vars in 1262 bytes} [Sat Sep 10 11:47:26 2022] PUT /compute/v2.1/os-quota-sets/3fa744ef0e2345fc903f1303bc5c40f7 => generated 328 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:47:27.053203 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3cfc641b-ca3f-4e4c-a87a-ff3c0ec8ca6a tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-93713397", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:27.091263 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-228702ea-7c09-43c4-8088-bfb14722e5eb req-85dbdcfc-885a-4dd0-9a8b-f7686801a068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebff5197-fc62-4ee6-a688-6e12f04645b5", "name": "network-vif-deleted", "tag": "cbd26a57-8480-4427-a718-f5ccf1736f8d"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:27.108644 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-228702ea-7c09-43c4-8088-bfb14722e5eb req-85dbdcfc-885a-4dd0-9a8b-f7686801a068 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:27.109217 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-228702ea-7c09-43c4-8088-bfb14722e5eb req-85dbdcfc-885a-4dd0-9a8b-f7686801a068 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:27.110283 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-228702ea-7c09-43c4-8088-bfb14722e5eb req-85dbdcfc-885a-4dd0-9a8b-f7686801a068 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:27.129425 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-3cfc641b-ca3f-4e4c-a87a-ff3c0ec8ca6a tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] validate_networks() for None {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:47:27.142544 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-228702ea-7c09-43c4-8088-bfb14722e5eb req-85dbdcfc-885a-4dd0-9a8b-f7686801a068 service nova] Creating event network-vif-deleted:cbd26a57-8480-4427-a718-f5ccf1736f8d for instance ebff5197-fc62-4ee6-a688-6e12f04645b5 on n-h1-856895-1 Sep 10 11:47:27.148442 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-228702ea-7c09-43c4-8088-bfb14722e5eb req-85dbdcfc-885a-4dd0-9a8b-f7686801a068 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061937 Sep 10 11:47:27.149157 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1055/2024] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:47:27.203046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b5ef57b3-e224-453a-84f3-4338098fb604 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:27.204020 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b5ef57b3-e224-453a-84f3-4338098fb604 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: f30dcd4e-f14f-4f37-bb07-05bafdff2bbb] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:27.218192 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5ef57b3-e224-453a-84f3-4338098fb604 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:27.220432 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5ef57b3-e224-453a-84f3-4338098fb604 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:27.222608 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5ef57b3-e224-453a-84f3-4338098fb604 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:27.227612 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5ef57b3-e224-453a-84f3-4338098fb604 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:27.228446 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5ef57b3-e224-453a-84f3-4338098fb604 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:27.229078 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5ef57b3-e224-453a-84f3-4338098fb604 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:27.865100 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b5ef57b3-e224-453a-84f3-4338098fb604 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:27.881017 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b5ef57b3-e224-453a-84f3-4338098fb604 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/f30dcd4e-f14f-4f37-bb07-05bafdff2bbb" status: 200 len: 1319 microversion: 2.1 time: 0.684517 Sep 10 11:47:27.884597 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1056/2025] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:27 2022] GET /compute/v2.1/servers/f30dcd4e-f14f-4f37-bb07-05bafdff2bbb => generated 1319 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:47:27.897258 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f26ca16e-da74-455f-a3f2-de898f100ad7 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:27.902697 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f26ca16e-da74-455f-a3f2-de898f100ad7 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: f33c83e4-9881-4c1e-a502-ad9589fd597c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:27.910548 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f26ca16e-da74-455f-a3f2-de898f100ad7 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:27.911039 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f26ca16e-da74-455f-a3f2-de898f100ad7 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:27.911672 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f26ca16e-da74-455f-a3f2-de898f100ad7 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:27.912717 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f26ca16e-da74-455f-a3f2-de898f100ad7 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:27.913337 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f26ca16e-da74-455f-a3f2-de898f100ad7 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:27.913929 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f26ca16e-da74-455f-a3f2-de898f100ad7 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:27.928966 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-3cfc641b-ca3f-4e4c-a87a-ff3c0ec8ca6a tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:47:27.930222 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-3cfc641b-ca3f-4e4c-a87a-ff3c0ec8ca6a tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:47:27.930900 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-3cfc641b-ca3f-4e4c-a87a-ff3c0ec8ca6a tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:47:27.931538 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-3cfc641b-ca3f-4e4c-a87a-ff3c0ec8ca6a tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:47:27.932552 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-3cfc641b-ca3f-4e4c-a87a-ff3c0ec8ca6a tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:47:27.953383 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3cfc641b-ca3f-4e4c-a87a-ff3c0ec8ca6a tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:27.954196 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3cfc641b-ca3f-4e4c-a87a-ff3c0ec8ca6a tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:27.954830 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3cfc641b-ca3f-4e4c-a87a-ff3c0ec8ca6a tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:27.956377 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3cfc641b-ca3f-4e4c-a87a-ff3c0ec8ca6a tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:27.960736 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3cfc641b-ca3f-4e4c-a87a-ff3c0ec8ca6a tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:27.961460 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3cfc641b-ca3f-4e4c-a87a-ff3c0ec8ca6a tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:28.028179 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-3cfc641b-ca3f-4e4c-a87a-ff3c0ec8ca6a tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Getting quotas for project 3fa744ef0e2345fc903f1303bc5c40f7. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:47:28.038026 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-3cfc641b-ca3f-4e4c-a87a-ff3c0ec8ca6a tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Getting quotas for user d0c0dfa1d12a4cc9802fbf7c80885a30 and project 3fa744ef0e2345fc903f1303bc5c40f7. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:47:28.080280 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.utils [None req-3cfc641b-ca3f-4e4c-a87a-ff3c0ec8ca6a tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] instances quota exceeded for 3fa744ef0e2345fc903f1303bc5c40f7, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128776) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 10 11:47:28.082300 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-3cfc641b-ca3f-4e4c-a87a-ff3c0ec8ca6a tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3cfc641b-ca3f-4e4c-a87a-ff3c0ec8ca6a tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Request method failure captured: Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 143 Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHlKsPb8lFcyFSNgE5lsvDCXfG35mrpHVQYcQE1UfYtSHmlXYDVzxRBSFIJGsa4qZB4-0Q3XS7LCoBpCMbwCcxnN5F49EgOX4MSJjKG1V8dZrgXjqPLZmy1Dc2ZTsuawu32_OZFF5Bu3BfIHZ7WNEQFcOQVU4aB9wtK6PpS5QxqTceQ Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 3fa744ef0e2345fc903f1303bc5c40f7 Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-QuotasAdminNegativeTest-1370420310 Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3fa744ef0e2345fc903f1303bc5c40f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3fa744ef0e2345fc903f1303bc5c40f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3fa744ef0e2345fc903f1303bc5c40f7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3fa744ef0e2345fc903f1303bc5c40f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-QuotasAdminNegativeTest-1370420310 Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 3fa744ef0e2345fc903f1303bc5c40f7 Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1370420310 Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-QuotasAdminNegativeTest-1370420310-project Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: d0c0dfa1d12a4cc9802fbf7c80885a30 Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-QuotasAdminNegativeTest-1370420310-project Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-93713397", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452"}} Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-93713397', 'imageRef': 'c23d4d62-7ab9-4623-9273-7f44582aa2e1', 'flavorRef': '452'}}} Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 10 11:47:28.086375 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 10 11:47:28.091122 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 10 11:47:28.091122 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 10 11:47:28.091122 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 10 11:47:28.091122 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 10 11:47:28.091122 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 10 11:47:28.091122 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 10 11:47:28.091122 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:28.091122 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:47:28.091122 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:28.091122 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:28.091122 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:47:28.091122 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:47:28.091122 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:47:28.091122 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:47:28.091122 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:47:28.091122 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:47:28.091122 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:47:28.091122 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:47:28.091122 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:47:28.091122 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:47:28.091122 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:47:28.091122 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:47:28.091122 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 10 11:47:28.091122 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 10 11:47:28.091122 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 10 11:47:28.091122 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 10 11:47:28.091122 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:28.091122 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:47:28.091122 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:28.091122 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:28.091122 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:47:28.091122 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:47:28.091122 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:47:28.091122 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:47:28.091122 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 10 11:47:28.091122 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:28.095891 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3cfc641b-ca3f-4e4c-a87a-ff3c0ec8ca6a tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:47:28.098406 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3cfc641b-ca3f-4e4c-a87a-ff3c0ec8ca6a tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.050882 Sep 10 11:47:28.101079 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 970/2026] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:47:27 2022] POST /compute/v2.1/servers => generated 119 bytes in 1054 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 10 11:47:28.107626 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-367ea683-367a-479b-bf76-0d04bfd82b77 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:28.109519 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-367ea683-367a-479b-bf76-0d04bfd82b77 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: ebff5197-fc62-4ee6-a688-6e12f04645b5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:28.124231 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-367ea683-367a-479b-bf76-0d04bfd82b77 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:28.126226 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-367ea683-367a-479b-bf76-0d04bfd82b77 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:28.142436 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-367ea683-367a-479b-bf76-0d04bfd82b77 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:28.144220 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-367ea683-367a-479b-bf76-0d04bfd82b77 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:28.144780 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-367ea683-367a-479b-bf76-0d04bfd82b77 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:28.145998 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-367ea683-367a-479b-bf76-0d04bfd82b77 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:28.189764 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-367ea683-367a-479b-bf76-0d04bfd82b77 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] HTTP exception thrown: Instance ebff5197-fc62-4ee6-a688-6e12f04645b5 could not be found. Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-367ea683-367a-479b-bf76-0d04bfd82b77 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Request method failure captured: Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5 HTTP/1.1 Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHed8GF4SHtUgHPAUwxlZp0PmksNunRKLHn4uufMjtnzMfcEDxm2fmaX4NtyCJylpQQHwCgUEqgi5V2zrbiedUn-xH6Izrg70le3OLsPeCQnm-5rS791bk5YHAVkg9DydYFa9B3iw8qLoH3oNVeO61-DMPi6A6i3npn7mlsBW8bk71c Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: X-Openstack-Nova-Api-Version: 2.25 Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: c8c0800673e247fb8b3b3718512233c0 Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1948749437 Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8c0800673e247fb8b3b3718512233c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8c0800673e247fb8b3b3718512233c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c8c0800673e247fb8b3b3718512233c0", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c8c0800673e247fb8b3b3718512233c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1948749437 Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: c8c0800673e247fb8b3b3718512233c0 Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1948749437 Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-LiveAutoBlockMigrationV225Test-1948749437-project Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 1106bb2c5ce14c21a15ad62942745b62 Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1948749437-project Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance ebff5197-fc62-4ee6-a688-6e12f04645b5 could not be found. Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'ebff5197-fc62-4ee6-a688-6e12f04645b5'} Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebff5197-fc62-4ee6-a688-6e12f04645b5 could not be found. Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebff5197-fc62-4ee6-a688-6e12f04645b5 could not be found. Sep 10 11:47:28.193678 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:28.197200 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:47:28.197200 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:28.197200 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:28.197200 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:47:28.197200 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:47:28.197200 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:47:28.197200 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:47:28.197200 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebff5197-fc62-4ee6-a688-6e12f04645b5 could not be found. Sep 10 11:47:28.197200 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:28.197200 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-367ea683-367a-479b-bf76-0d04bfd82b77 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Returning 404 to user: Instance ebff5197-fc62-4ee6-a688-6e12f04645b5 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:47:28.197200 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-367ea683-367a-479b-bf76-0d04bfd82b77 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5" status: 404 len: 111 microversion: 2.25 time: 0.092984 Sep 10 11:47:28.197200 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 971/2027] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:47:28 2022] GET /compute/v2.1/servers/ebff5197-fc62-4ee6-a688-6e12f04645b5 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:47:28.203611 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d9e1acbf-2584-40cc-9083-34e3437ffe1e tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Action: 'update', calling method: .version_select at 0x7f407396eb80>, body: {"quota_set": {"instances": 10}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:28.274269 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f26ca16e-da74-455f-a3f2-de898f100ad7 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ea7c11febf451da4f1faf4dff9471d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f601d0bb424da4bb02b532ac982878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:28.285525 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f26ca16e-da74-455f-a3f2-de898f100ad7 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "GET /compute/v2.1/servers/f33c83e4-9881-4c1e-a502-ad9589fd597c" status: 200 len: 1514 microversion: 2.1 time: 0.399144 Sep 10 11:47:28.287190 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1057/2028] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:27 2022] GET /compute/v2.1/servers/f33c83e4-9881-4c1e-a502-ad9589fd597c => generated 1514 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:28.291733 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d9e1acbf-2584-40cc-9083-34e3437ffe1e tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:28.292265 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d9e1acbf-2584-40cc-9083-34e3437ffe1e tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:28.292708 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d9e1acbf-2584-40cc-9083-34e3437ffe1e tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:28.293606 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d9e1acbf-2584-40cc-9083-34e3437ffe1e tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:28.294058 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d9e1acbf-2584-40cc-9083-34e3437ffe1e tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:28.294740 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d9e1acbf-2584-40cc-9083-34e3437ffe1e tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:28.295625 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-836bfa87-aaa5-415c-9044-0581afa3fba0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:28.296338 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-836bfa87-aaa5-415c-9044-0581afa3fba0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: f600488a-7c52-4a96-9375-2723bf42cf83] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:28.303775 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-836bfa87-aaa5-415c-9044-0581afa3fba0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:28.304804 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-836bfa87-aaa5-415c-9044-0581afa3fba0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:28.305538 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-836bfa87-aaa5-415c-9044-0581afa3fba0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:28.306460 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-836bfa87-aaa5-415c-9044-0581afa3fba0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:28.307128 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-836bfa87-aaa5-415c-9044-0581afa3fba0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:28.307803 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-836bfa87-aaa5-415c-9044-0581afa3fba0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:28.345265 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-836bfa87-aaa5-415c-9044-0581afa3fba0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: f600488a-7c52-4a96-9375-2723bf42cf83] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:47:28.383821 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d9e1acbf-2584-40cc-9083-34e3437ffe1e tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/3fa744ef0e2345fc903f1303bc5c40f7" status: 200 len: 329 microversion: 2.1 time: 0.186217 Sep 10 11:47:28.385442 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 972/2029] 10.222.0.23 () {60 vars in 1262 bytes} [Sat Sep 10 11:47:28 2022] PUT /compute/v2.1/os-quota-sets/3fa744ef0e2345fc903f1303bc5c40f7 => generated 329 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:47:28.404093 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1aa60f33-afab-46b0-9a8e-84f72be8e267 tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Calling method '.version_select at 0x7f407355fa60>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:28.484112 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-836bfa87-aaa5-415c-9044-0581afa3fba0 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83" status: 204 len: 0 microversion: 2.25 time: 0.193648 Sep 10 11:47:28.489849 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1058/2030] 10.222.0.23 () {60 vars in 1280 bytes} [Sat Sep 10 11:47:28 2022] DELETE /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 11:47:28.496048 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-62feee5f-f7bc-4a21-b372-f83093992237 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:28.497024 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-62feee5f-f7bc-4a21-b372-f83093992237 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: f600488a-7c52-4a96-9375-2723bf42cf83] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:28.505519 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-62feee5f-f7bc-4a21-b372-f83093992237 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:28.508320 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-62feee5f-f7bc-4a21-b372-f83093992237 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:28.509136 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-62feee5f-f7bc-4a21-b372-f83093992237 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:28.511036 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-62feee5f-f7bc-4a21-b372-f83093992237 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:28.511728 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-62feee5f-f7bc-4a21-b372-f83093992237 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:28.512959 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-62feee5f-f7bc-4a21-b372-f83093992237 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:28.563942 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1aa60f33-afab-46b0-9a8e-84f72be8e267 tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/3fa744ef0e2345fc903f1303bc5c40f7" status: 200 len: 371 microversion: 2.1 time: 0.167959 Sep 10 11:47:28.572524 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 973/2031] 10.222.0.23 () {58 vars in 1242 bytes} [Sat Sep 10 11:47:28 2022] GET /compute/v2.1/os-quota-sets/3fa744ef0e2345fc903f1303bc5c40f7 => generated 371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:47:28.579959 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6e927feb-23a6-40bb-bab8-b3e6b6ee18d7 tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Action: 'update', calling method: .version_select at 0x7f40734bb430>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:28.673354 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e927feb-23a6-40bb-bab8-b3e6b6ee18d7 tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:28.674109 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e927feb-23a6-40bb-bab8-b3e6b6ee18d7 tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:28.674719 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e927feb-23a6-40bb-bab8-b3e6b6ee18d7 tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:28.676713 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e927feb-23a6-40bb-bab8-b3e6b6ee18d7 tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:28.677631 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e927feb-23a6-40bb-bab8-b3e6b6ee18d7 tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:28.678197 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e927feb-23a6-40bb-bab8-b3e6b6ee18d7 tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:28.724760 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:47:28.749487 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6e927feb-23a6-40bb-bab8-b3e6b6ee18d7 tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/3fa744ef0e2345fc903f1303bc5c40f7" status: 200 len: 325 microversion: 2.1 time: 0.175651 Sep 10 11:47:28.750498 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 974/2032] 10.222.0.23 () {60 vars in 1262 bytes} [Sat Sep 10 11:47:28 2022] PUT /compute/v2.1/os-quota-sets/3fa744ef0e2345fc903f1303bc5c40f7 => generated 325 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:47:28.755100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-b7516f9f-b051-4c79-81d9-193669d28b73 req-a3fd754a-ed8f-40a0-a50e-f3bc5ec0934a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f33c83e4-9881-4c1e-a502-ad9589fd597c", "name": "network-vif-deleted", "tag": "84f563f5-a3fe-4606-b3e5-e437d2a0c4c5"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:28.771263 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-62feee5f-f7bc-4a21-b372-f83093992237 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:28.780959 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-b7516f9f-b051-4c79-81d9-193669d28b73 req-a3fd754a-ed8f-40a0-a50e-f3bc5ec0934a service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:28.781801 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-b7516f9f-b051-4c79-81d9-193669d28b73 req-a3fd754a-ed8f-40a0-a50e-f3bc5ec0934a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:28.782259 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-b7516f9f-b051-4c79-81d9-193669d28b73 req-a3fd754a-ed8f-40a0-a50e-f3bc5ec0934a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:28.788103 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-62feee5f-f7bc-4a21-b372-f83093992237 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:28.791675 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-62feee5f-f7bc-4a21-b372-f83093992237 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:28.792904 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-62feee5f-f7bc-4a21-b372-f83093992237 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83" status: 200 len: 1560 microversion: 2.25 time: 0.301632 Sep 10 11:47:28.793489 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1059/2033] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:47:28 2022] GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83 => generated 1560 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:47:28.802011 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-b7516f9f-b051-4c79-81d9-193669d28b73 req-a3fd754a-ed8f-40a0-a50e-f3bc5ec0934a service nova] Creating event network-vif-deleted:84f563f5-a3fe-4606-b3e5-e437d2a0c4c5 for instance f33c83e4-9881-4c1e-a502-ad9589fd597c on n-h2-856895-1 Sep 10 11:47:28.812529 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-b7516f9f-b051-4c79-81d9-193669d28b73 req-a3fd754a-ed8f-40a0-a50e-f3bc5ec0934a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060746 Sep 10 11:47:28.813147 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 975/2034] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:47:28.832893 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b49ee82e-f40c-4e83-9551-e8f5b5546378 tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-708265934", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:28.888391 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-b49ee82e-f40c-4e83-9551-e8f5b5546378 tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] validate_networks() for None {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:47:28.913363 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9c78d5bf-f9e6-4dd7-8838-919d978dab01 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:28.915220 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9c78d5bf-f9e6-4dd7-8838-919d978dab01 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: f30dcd4e-f14f-4f37-bb07-05bafdff2bbb] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:28.931684 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c78d5bf-f9e6-4dd7-8838-919d978dab01 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:28.932312 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c78d5bf-f9e6-4dd7-8838-919d978dab01 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:28.932870 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c78d5bf-f9e6-4dd7-8838-919d978dab01 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:28.933943 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c78d5bf-f9e6-4dd7-8838-919d978dab01 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:28.934480 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c78d5bf-f9e6-4dd7-8838-919d978dab01 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:28.934993 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c78d5bf-f9e6-4dd7-8838-919d978dab01 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:29.220688 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9c78d5bf-f9e6-4dd7-8838-919d978dab01 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:29.223760 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-b49ee82e-f40c-4e83-9551-e8f5b5546378 tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:47:29.226423 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-b49ee82e-f40c-4e83-9551-e8f5b5546378 tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:47:29.228913 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-b49ee82e-f40c-4e83-9551-e8f5b5546378 tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:47:29.229369 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-b49ee82e-f40c-4e83-9551-e8f5b5546378 tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:47:29.230881 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9c78d5bf-f9e6-4dd7-8838-919d978dab01 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/f30dcd4e-f14f-4f37-bb07-05bafdff2bbb" status: 200 len: 1319 microversion: 2.1 time: 0.324617 Sep 10 11:47:29.231670 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 976/2035] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:28 2022] GET /compute/v2.1/servers/f30dcd4e-f14f-4f37-bb07-05bafdff2bbb => generated 1319 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:47:29.232121 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-b49ee82e-f40c-4e83-9551-e8f5b5546378 tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:47:29.248083 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b49ee82e-f40c-4e83-9551-e8f5b5546378 tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:29.248680 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b49ee82e-f40c-4e83-9551-e8f5b5546378 tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:29.249120 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b49ee82e-f40c-4e83-9551-e8f5b5546378 tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:29.249943 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b49ee82e-f40c-4e83-9551-e8f5b5546378 tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:29.250533 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b49ee82e-f40c-4e83-9551-e8f5b5546378 tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:29.250961 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b49ee82e-f40c-4e83-9551-e8f5b5546378 tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:29.270124 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-b49ee82e-f40c-4e83-9551-e8f5b5546378 tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Getting quotas for project 3fa744ef0e2345fc903f1303bc5c40f7. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:47:29.276541 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-b49ee82e-f40c-4e83-9551-e8f5b5546378 tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Getting quotas for user d0c0dfa1d12a4cc9802fbf7c80885a30 and project 3fa744ef0e2345fc903f1303bc5c40f7. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:47:29.290223 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.utils [None req-b49ee82e-f40c-4e83-9551-e8f5b5546378 tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] ram quota exceeded for 3fa744ef0e2345fc903f1303bc5c40f7, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128777) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 10 11:47:29.291549 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-b49ee82e-f40c-4e83-9551-e8f5b5546378 tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b49ee82e-f40c-4e83-9551-e8f5b5546378 tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Request method failure captured: Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 144 Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHlKsPb8lFcyFSNgE5lsvDCXfG35mrpHVQYcQE1UfYtSHmlXYDVzxRBSFIJGsa4qZB4-0Q3XS7LCoBpCMbwCcxnN5F49EgOX4MSJjKG1V8dZrgXjqPLZmy1Dc2ZTsuawu32_OZFF5Bu3BfIHZ7WNEQFcOQVU4aB9wtK6PpS5QxqTceQ Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 3fa744ef0e2345fc903f1303bc5c40f7 Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-QuotasAdminNegativeTest-1370420310 Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3fa744ef0e2345fc903f1303bc5c40f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3fa744ef0e2345fc903f1303bc5c40f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3fa744ef0e2345fc903f1303bc5c40f7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3fa744ef0e2345fc903f1303bc5c40f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-QuotasAdminNegativeTest-1370420310 Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 3fa744ef0e2345fc903f1303bc5c40f7 Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1370420310 Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-QuotasAdminNegativeTest-1370420310-project Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: d0c0dfa1d12a4cc9802fbf7c80885a30 Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-QuotasAdminNegativeTest-1370420310-project Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-708265934", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452"}} Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-708265934', 'imageRef': 'c23d4d62-7ab9-4623-9273-7f44582aa2e1', 'flavorRef': '452'}}} Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 10 11:47:29.293658 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 10 11:47:29.297876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 10 11:47:29.297876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 10 11:47:29.297876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 10 11:47:29.297876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 10 11:47:29.297876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 10 11:47:29.297876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 10 11:47:29.297876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:29.297876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:47:29.297876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:29.297876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:29.297876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:47:29.297876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:47:29.297876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:47:29.297876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:47:29.297876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:47:29.297876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:47:29.297876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:47:29.297876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:47:29.297876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:47:29.297876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:47:29.297876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:47:29.297876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:47:29.297876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 10 11:47:29.297876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 10 11:47:29.297876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 10 11:47:29.297876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 10 11:47:29.297876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:29.297876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:47:29.297876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:29.297876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:29.297876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:47:29.297876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:47:29.297876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:47:29.297876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:47:29.297876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 10 11:47:29.297876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:29.297876 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b49ee82e-f40c-4e83-9551-e8f5b5546378 tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:47:29.297876 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b49ee82e-f40c-4e83-9551-e8f5b5546378 tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.466843 Sep 10 11:47:29.297876 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1060/2036] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:47:28 2022] POST /compute/v2.1/servers => generated 110 bytes in 468 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:47:29.305444 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-51185b12-5d72-4dbb-8a9d-4042f7855ada tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Action: 'update', calling method: .version_select at 0x7f40738800d0>, body: {"quota_set": {"ram": 51200}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:29.313947 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0246fb45-2819-4693-b7bf-88e15d43ab66 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:29.314576 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0246fb45-2819-4693-b7bf-88e15d43ab66 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: f33c83e4-9881-4c1e-a502-ad9589fd597c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:29.322669 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0246fb45-2819-4693-b7bf-88e15d43ab66 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:29.324104 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0246fb45-2819-4693-b7bf-88e15d43ab66 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:29.324726 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0246fb45-2819-4693-b7bf-88e15d43ab66 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:29.325666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0246fb45-2819-4693-b7bf-88e15d43ab66 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:29.326454 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0246fb45-2819-4693-b7bf-88e15d43ab66 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:29.327039 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0246fb45-2819-4693-b7bf-88e15d43ab66 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:29.381795 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0246fb45-2819-4693-b7bf-88e15d43ab66 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:29.382332 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0246fb45-2819-4693-b7bf-88e15d43ab66 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:29.382727 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0246fb45-2819-4693-b7bf-88e15d43ab66 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:29.383189 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-0246fb45-2819-4693-b7bf-88e15d43ab66 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lazy-loading 'fault' on Instance uuid f33c83e4-9881-4c1e-a502-ad9589fd597c {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:47:29.415313 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-51185b12-5d72-4dbb-8a9d-4042f7855ada tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:29.415806 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-51185b12-5d72-4dbb-8a9d-4042f7855ada tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:29.416239 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-51185b12-5d72-4dbb-8a9d-4042f7855ada tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:29.416971 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-51185b12-5d72-4dbb-8a9d-4042f7855ada tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:29.417421 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-51185b12-5d72-4dbb-8a9d-4042f7855ada tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:29.418191 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-51185b12-5d72-4dbb-8a9d-4042f7855ada tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:29.429352 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:47:29.472466 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0246fb45-2819-4693-b7bf-88e15d43ab66 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ea7c11febf451da4f1faf4dff9471d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f601d0bb424da4bb02b532ac982878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:29.483957 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0246fb45-2819-4693-b7bf-88e15d43ab66 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "GET /compute/v2.1/servers/f33c83e4-9881-4c1e-a502-ad9589fd597c" status: 200 len: 1308 microversion: 2.1 time: 0.173707 Sep 10 11:47:29.495253 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1061/2037] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:29 2022] GET /compute/v2.1/servers/f33c83e4-9881-4c1e-a502-ad9589fd597c => generated 1308 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:47:29.510230 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-51185b12-5d72-4dbb-8a9d-4042f7855ada tempest-QuotasAdminNegativeTest-846002444 tempest-QuotasAdminNegativeTest-846002444-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/3fa744ef0e2345fc903f1303bc5c40f7" status: 200 len: 329 microversion: 2.1 time: 0.209092 Sep 10 11:47:29.510976 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 977/2038] 10.222.0.23 () {60 vars in 1262 bytes} [Sat Sep 10 11:47:29 2022] PUT /compute/v2.1/os-quota-sets/3fa744ef0e2345fc903f1303bc5c40f7 => generated 329 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:47:29.528680 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-08e0b168-f99c-4670-8e5e-c2c63da70bbf tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Action: 'update', calling method: .version_select at 0x7f407369a700>, body: {"quota_set": {"ram": 0}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:29.535592 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-08e0b168-f99c-4670-8e5e-c2c63da70bbf tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'd0c0dfa1d12a4cc9802fbf7c80885a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa744ef0e2345fc903f1303bc5c40f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-08e0b168-f99c-4670-8e5e-c2c63da70bbf tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Request method failure captured: Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: request: PUT /compute/v2.1/os-quota-sets/3fa744ef0e2345fc903f1303bc5c40f7 HTTP/1.1 Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 25 Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHlKsPb8lFcyFSNgE5lsvDCXfG35mrpHVQYcQE1UfYtSHmlXYDVzxRBSFIJGsa4qZB4-0Q3XS7LCoBpCMbwCcxnN5F49EgOX4MSJjKG1V8dZrgXjqPLZmy1Dc2ZTsuawu32_OZFF5Bu3BfIHZ7WNEQFcOQVU4aB9wtK6PpS5QxqTceQ Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 3fa744ef0e2345fc903f1303bc5c40f7 Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-QuotasAdminNegativeTest-1370420310 Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3fa744ef0e2345fc903f1303bc5c40f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3fa744ef0e2345fc903f1303bc5c40f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3fa744ef0e2345fc903f1303bc5c40f7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3fa744ef0e2345fc903f1303bc5c40f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-QuotasAdminNegativeTest-1370420310 Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 3fa744ef0e2345fc903f1303bc5c40f7 Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1370420310 Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-QuotasAdminNegativeTest-1370420310-project Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: d0c0dfa1d12a4cc9802fbf7c80885a30 Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-QuotasAdminNegativeTest-1370420310-project Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: {"quota_set": {"ram": 0}} Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '3fa744ef0e2345fc903f1303bc5c40f7', 'body': {'quota_set': {'ram': 0}}} Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:47:29.544308 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 11:47:29.548145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 11:47:29.548145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 11:47:29.548145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 11:47:29.548145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 11:47:29.548145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 11:47:29.548145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 10 11:47:29.548145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:29.548145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:47:29.548145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:29.548145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:29.548145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:47:29.548145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:47:29.548145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 11:47:29.548145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 11:47:29.548145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 10 11:47:29.548145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:29.548145 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-08e0b168-f99c-4670-8e5e-c2c63da70bbf tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:47:29.548145 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-08e0b168-f99c-4670-8e5e-c2c63da70bbf tempest-QuotasAdminNegativeTest-1370420310 tempest-QuotasAdminNegativeTest-1370420310-project] 10.222.0.23 "PUT /compute/v2.1/os-quota-sets/3fa744ef0e2345fc903f1303bc5c40f7" status: 403 len: 116 microversion: 2.1 time: 0.022732 Sep 10 11:47:29.548145 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1062/2039] 10.222.0.23 () {60 vars in 1262 bytes} [Sat Sep 10 11:47:29 2022] PUT /compute/v2.1/os-quota-sets/3fa744ef0e2345fc903f1303bc5c40f7 => generated 116 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:47:29.819192 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ae77ad20-e5c3-4fe8-bf9a-38ffffafc4fd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:29.820743 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ae77ad20-e5c3-4fe8-bf9a-38ffffafc4fd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: f600488a-7c52-4a96-9375-2723bf42cf83] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:29.832506 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ae77ad20-e5c3-4fe8-bf9a-38ffffafc4fd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:29.833889 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ae77ad20-e5c3-4fe8-bf9a-38ffffafc4fd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:29.834831 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ae77ad20-e5c3-4fe8-bf9a-38ffffafc4fd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:29.836146 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ae77ad20-e5c3-4fe8-bf9a-38ffffafc4fd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:29.836875 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ae77ad20-e5c3-4fe8-bf9a-38ffffafc4fd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:29.837952 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ae77ad20-e5c3-4fe8-bf9a-38ffffafc4fd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:30.176775 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-786e8e09-3eb3-4fb8-8265-95aa53212c76 req-47ab34b6-d6ad-4446-9992-badfdc68baeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ab5ad80-d86c-44f1-870d-777d44fd340a", "name": "network-vif-plugged", "status": "completed", "tag": "a16a30e4-67d2-4203-af44-c01e5a7af9b6"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:30.205309 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-786e8e09-3eb3-4fb8-8265-95aa53212c76 req-47ab34b6-d6ad-4446-9992-badfdc68baeb service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:30.206695 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-786e8e09-3eb3-4fb8-8265-95aa53212c76 req-47ab34b6-d6ad-4446-9992-badfdc68baeb service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:30.207375 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-786e8e09-3eb3-4fb8-8265-95aa53212c76 req-47ab34b6-d6ad-4446-9992-badfdc68baeb service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:30.223149 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ae77ad20-e5c3-4fe8-bf9a-38ffffafc4fd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:30.232454 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-786e8e09-3eb3-4fb8-8265-95aa53212c76 req-47ab34b6-d6ad-4446-9992-badfdc68baeb service nova] Creating event network-vif-plugged:a16a30e4-67d2-4203-af44-c01e5a7af9b6 for instance 2ab5ad80-d86c-44f1-870d-777d44fd340a on n-h2-856895-1 Sep 10 11:47:30.233881 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ae77ad20-e5c3-4fe8-bf9a-38ffffafc4fd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:30.235701 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ae77ad20-e5c3-4fe8-bf9a-38ffffafc4fd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:30.241432 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-786e8e09-3eb3-4fb8-8265-95aa53212c76 req-47ab34b6-d6ad-4446-9992-badfdc68baeb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075756 Sep 10 11:47:30.242746 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1063/2040] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:47:30.248711 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ae77ad20-e5c3-4fe8-bf9a-38ffffafc4fd tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83" status: 200 len: 1560 microversion: 2.25 time: 0.429482 Sep 10 11:47:30.250142 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 978/2041] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:47:29 2022] GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83 => generated 1560 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:47:30.260536 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f32dac1c-13c5-4507-99b3-fb57113e8ff5 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:30.261910 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f32dac1c-13c5-4507-99b3-fb57113e8ff5 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: f30dcd4e-f14f-4f37-bb07-05bafdff2bbb] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:30.291525 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f32dac1c-13c5-4507-99b3-fb57113e8ff5 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:30.294128 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f32dac1c-13c5-4507-99b3-fb57113e8ff5 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:30.296873 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f32dac1c-13c5-4507-99b3-fb57113e8ff5 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:30.298676 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f32dac1c-13c5-4507-99b3-fb57113e8ff5 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:30.299337 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f32dac1c-13c5-4507-99b3-fb57113e8ff5 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:30.300241 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f32dac1c-13c5-4507-99b3-fb57113e8ff5 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:30.335841 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:47:30.431244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-6687a9ba-a415-4f4a-9e17-1e92a136a078 req-caff0ee8-b125-4ea5-90d2-63311c1391ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f600488a-7c52-4a96-9375-2723bf42cf83", "name": "network-vif-deleted", "tag": "b17980fa-cb4b-4dcc-8ee5-cbb901783cfd"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:30.445160 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6687a9ba-a415-4f4a-9e17-1e92a136a078 req-caff0ee8-b125-4ea5-90d2-63311c1391ef service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:30.445767 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6687a9ba-a415-4f4a-9e17-1e92a136a078 req-caff0ee8-b125-4ea5-90d2-63311c1391ef service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:30.446214 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6687a9ba-a415-4f4a-9e17-1e92a136a078 req-caff0ee8-b125-4ea5-90d2-63311c1391ef service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:30.467011 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-6687a9ba-a415-4f4a-9e17-1e92a136a078 req-caff0ee8-b125-4ea5-90d2-63311c1391ef service nova] Creating event network-vif-deleted:b17980fa-cb4b-4dcc-8ee5-cbb901783cfd for instance f600488a-7c52-4a96-9375-2723bf42cf83 on n-h1-856895-1 Sep 10 11:47:30.475292 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-6687a9ba-a415-4f4a-9e17-1e92a136a078 req-caff0ee8-b125-4ea5-90d2-63311c1391ef service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051716 Sep 10 11:47:30.476497 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 979/2042] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:47:30.529032 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3abe4d20-a962-4e9e-8267-f8b41a452886 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:30.530362 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3abe4d20-a962-4e9e-8267-f8b41a452886 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: f33c83e4-9881-4c1e-a502-ad9589fd597c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:30.544036 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3abe4d20-a962-4e9e-8267-f8b41a452886 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:30.544658 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3abe4d20-a962-4e9e-8267-f8b41a452886 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:30.545169 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3abe4d20-a962-4e9e-8267-f8b41a452886 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:30.545848 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3abe4d20-a962-4e9e-8267-f8b41a452886 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:30.546755 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3abe4d20-a962-4e9e-8267-f8b41a452886 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:30.547393 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3abe4d20-a962-4e9e-8267-f8b41a452886 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:30.563455 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-3abe4d20-a962-4e9e-8267-f8b41a452886 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] HTTP exception thrown: Instance f33c83e4-9881-4c1e-a502-ad9589fd597c could not be found. Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3abe4d20-a962-4e9e-8267-f8b41a452886 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Request method failure captured: Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/f33c83e4-9881-4c1e-a502-ad9589fd597c HTTP/1.1 Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHi38QHxstYwmm1jqBxGoQRfHdmhpfKxTSM64faPsvQ9TC2e190TnKoyyyUSv8MdBks_lZfGdJ_kexRm7lqgB3JPXwcYfF5usK52IvsOVrWJbyToXQPRzSCoW2wEB02FhJD5WZ_OlvApJrkCHPlaKMMHpYIUv0yIrs_ORofzQ5jM_ms Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 99f601d0bb424da4bb02b532ac982878 Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-VolumesAdminNegativeTest-307132448 Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99f601d0bb424da4bb02b532ac982878"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99f601d0bb424da4bb02b532ac982878"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_99f601d0bb424da4bb02b532ac982878", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/99f601d0bb424da4bb02b532ac982878"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-VolumesAdminNegativeTest-307132448 Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 99f601d0bb424da4bb02b532ac982878 Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-307132448 Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-VolumesAdminNegativeTest-307132448-project Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 91ea7c11febf451da4f1faf4dff9471d Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-VolumesAdminNegativeTest-307132448-project Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance f33c83e4-9881-4c1e-a502-ad9589fd597c could not be found. Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'f33c83e4-9881-4c1e-a502-ad9589fd597c'} Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f33c83e4-9881-4c1e-a502-ad9589fd597c could not be found. Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f33c83e4-9881-4c1e-a502-ad9589fd597c could not be found. Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:47:30.566030 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:30.569828 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:30.569828 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:47:30.569828 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:47:30.569828 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:47:30.569828 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:47:30.569828 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f33c83e4-9881-4c1e-a502-ad9589fd597c could not be found. Sep 10 11:47:30.569828 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:30.569828 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3abe4d20-a962-4e9e-8267-f8b41a452886 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Returning 404 to user: Instance f33c83e4-9881-4c1e-a502-ad9589fd597c could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:47:30.569828 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3abe4d20-a962-4e9e-8267-f8b41a452886 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "GET /compute/v2.1/servers/f33c83e4-9881-4c1e-a502-ad9589fd597c" status: 404 len: 111 microversion: 2.1 time: 0.059598 Sep 10 11:47:30.579143 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 980/2043] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:30 2022] GET /compute/v2.1/servers/f33c83e4-9881-4c1e-a502-ad9589fd597c => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:47:30.631000 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f32dac1c-13c5-4507-99b3-fb57113e8ff5 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:30.640648 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f32dac1c-13c5-4507-99b3-fb57113e8ff5 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/f30dcd4e-f14f-4f37-bb07-05bafdff2bbb" status: 200 len: 1319 microversion: 2.1 time: 0.387105 Sep 10 11:47:30.641655 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1064/2044] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:30 2022] GET /compute/v2.1/servers/f30dcd4e-f14f-4f37-bb07-05bafdff2bbb => generated 1319 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:47:31.280003 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3fde0645-92f3-492f-82dc-0ac842ec7663 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:31.280698 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3fde0645-92f3-492f-82dc-0ac842ec7663 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: f600488a-7c52-4a96-9375-2723bf42cf83] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:31.288285 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3fde0645-92f3-492f-82dc-0ac842ec7663 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:31.289030 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3fde0645-92f3-492f-82dc-0ac842ec7663 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:31.289696 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3fde0645-92f3-492f-82dc-0ac842ec7663 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:31.290728 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3fde0645-92f3-492f-82dc-0ac842ec7663 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:31.291230 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3fde0645-92f3-492f-82dc-0ac842ec7663 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:31.291661 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3fde0645-92f3-492f-82dc-0ac842ec7663 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:31.329410 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3fde0645-92f3-492f-82dc-0ac842ec7663 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:31.329858 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3fde0645-92f3-492f-82dc-0ac842ec7663 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:31.330315 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3fde0645-92f3-492f-82dc-0ac842ec7663 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:31.331660 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-3fde0645-92f3-492f-82dc-0ac842ec7663 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lazy-loading 'fault' on Instance uuid f600488a-7c52-4a96-9375-2723bf42cf83 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:47:31.410328 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3fde0645-92f3-492f-82dc-0ac842ec7663 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:31.434264 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3fde0645-92f3-492f-82dc-0ac842ec7663 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:31.438819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3fde0645-92f3-492f-82dc-0ac842ec7663 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1106bb2c5ce14c21a15ad62942745b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c0800673e247fb8b3b3718512233c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:31.442832 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3fde0645-92f3-492f-82dc-0ac842ec7663 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83" status: 200 len: 1349 microversion: 2.25 time: 0.167862 Sep 10 11:47:31.443937 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 981/2045] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:47:31 2022] GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83 => generated 1349 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:47:31.677667 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6d0e16b3-0257-4e58-adf3-10c04c022d44 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:31.679040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6d0e16b3-0257-4e58-adf3-10c04c022d44 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: f30dcd4e-f14f-4f37-bb07-05bafdff2bbb] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:31.707966 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d0e16b3-0257-4e58-adf3-10c04c022d44 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:31.708802 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d0e16b3-0257-4e58-adf3-10c04c022d44 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:31.709441 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d0e16b3-0257-4e58-adf3-10c04c022d44 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:31.712058 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d0e16b3-0257-4e58-adf3-10c04c022d44 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:31.712988 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d0e16b3-0257-4e58-adf3-10c04c022d44 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:31.713725 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d0e16b3-0257-4e58-adf3-10c04c022d44 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:32.014066 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6d0e16b3-0257-4e58-adf3-10c04c022d44 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:32.028425 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6d0e16b3-0257-4e58-adf3-10c04c022d44 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/f30dcd4e-f14f-4f37-bb07-05bafdff2bbb" status: 200 len: 1319 microversion: 2.1 time: 0.356985 Sep 10 11:47:32.030039 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1065/2046] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:31 2022] GET /compute/v2.1/servers/f30dcd4e-f14f-4f37-bb07-05bafdff2bbb => generated 1319 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:32.468914 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-50ee5be8-9226-4108-bebd-98841daf0125 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:32.469602 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-50ee5be8-9226-4108-bebd-98841daf0125 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] [instance: f600488a-7c52-4a96-9375-2723bf42cf83] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:32.479547 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-de2d7151-7266-411c-9306-cbaf27587265 req-a093173c-ac01-4359-b186-732de8f977bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f30dcd4e-f14f-4f37-bb07-05bafdff2bbb", "name": "network-vif-plugged", "status": "completed", "tag": "ed9ab511-09d7-41ab-a241-008569856ae1"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:32.507223 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50ee5be8-9226-4108-bebd-98841daf0125 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:32.508179 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50ee5be8-9226-4108-bebd-98841daf0125 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:32.508766 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50ee5be8-9226-4108-bebd-98841daf0125 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:32.509904 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50ee5be8-9226-4108-bebd-98841daf0125 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:32.510881 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50ee5be8-9226-4108-bebd-98841daf0125 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:32.511760 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50ee5be8-9226-4108-bebd-98841daf0125 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:32.512607 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-de2d7151-7266-411c-9306-cbaf27587265 req-a093173c-ac01-4359-b186-732de8f977bb service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:32.516494 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-de2d7151-7266-411c-9306-cbaf27587265 req-a093173c-ac01-4359-b186-732de8f977bb service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:32.516989 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-de2d7151-7266-411c-9306-cbaf27587265 req-a093173c-ac01-4359-b186-732de8f977bb service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:32.530156 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-50ee5be8-9226-4108-bebd-98841daf0125 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] HTTP exception thrown: Instance f600488a-7c52-4a96-9375-2723bf42cf83 could not be found. Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-50ee5be8-9226-4108-bebd-98841daf0125 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Request method failure captured: Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83 HTTP/1.1 Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHed8GF4SHtUgHPAUwxlZp0PmksNunRKLHn4uufMjtnzMfcEDxm2fmaX4NtyCJylpQQHwCgUEqgi5V2zrbiedUn-xH6Izrg70le3OLsPeCQnm-5rS791bk5YHAVkg9DydYFa9B3iw8qLoH3oNVeO61-DMPi6A6i3npn7mlsBW8bk71c Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: X-Openstack-Nova-Api-Version: 2.25 Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: c8c0800673e247fb8b3b3718512233c0 Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1948749437 Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8c0800673e247fb8b3b3718512233c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c8c0800673e247fb8b3b3718512233c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c8c0800673e247fb8b3b3718512233c0", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c8c0800673e247fb8b3b3718512233c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1948749437 Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: c8c0800673e247fb8b3b3718512233c0 Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1948749437 Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-LiveAutoBlockMigrationV225Test-1948749437-project Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 1106bb2c5ce14c21a15ad62942745b62 Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1948749437-project Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance f600488a-7c52-4a96-9375-2723bf42cf83 could not be found. Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'f600488a-7c52-4a96-9375-2723bf42cf83'} Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f600488a-7c52-4a96-9375-2723bf42cf83 could not be found. Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f600488a-7c52-4a96-9375-2723bf42cf83 could not be found. Sep 10 11:47:32.532443 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:32.537981 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:47:32.537981 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:32.537981 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:32.537981 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:47:32.537981 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:47:32.537981 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:47:32.537981 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:47:32.537981 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f600488a-7c52-4a96-9375-2723bf42cf83 could not be found. Sep 10 11:47:32.537981 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:32.541592 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-50ee5be8-9226-4108-bebd-98841daf0125 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] Returning 404 to user: Instance f600488a-7c52-4a96-9375-2723bf42cf83 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:47:32.542760 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-50ee5be8-9226-4108-bebd-98841daf0125 tempest-LiveAutoBlockMigrationV225Test-1948749437 tempest-LiveAutoBlockMigrationV225Test-1948749437-project] 10.222.0.23 "GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83" status: 404 len: 111 microversion: 2.25 time: 0.078028 Sep 10 11:47:32.547428 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 982/2047] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:47:32 2022] GET /compute/v2.1/servers/f600488a-7c52-4a96-9375-2723bf42cf83 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:47:32.577716 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-de2d7151-7266-411c-9306-cbaf27587265 req-a093173c-ac01-4359-b186-732de8f977bb service nova] Creating event network-vif-plugged:ed9ab511-09d7-41ab-a241-008569856ae1 for instance f30dcd4e-f14f-4f37-bb07-05bafdff2bbb on n-h2-856895-1 Sep 10 11:47:32.593723 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-de2d7151-7266-411c-9306-cbaf27587265 req-a093173c-ac01-4359-b186-732de8f977bb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116420 Sep 10 11:47:32.594476 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1066/2048] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:47:33.063421 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-82852b83-df66-47e2-be6e-831a61f56165 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:33.065920 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-82852b83-df66-47e2-be6e-831a61f56165 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: f30dcd4e-f14f-4f37-bb07-05bafdff2bbb] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:33.077728 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-82852b83-df66-47e2-be6e-831a61f56165 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:33.078896 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-82852b83-df66-47e2-be6e-831a61f56165 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:33.080321 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-82852b83-df66-47e2-be6e-831a61f56165 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:33.083048 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-82852b83-df66-47e2-be6e-831a61f56165 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:33.083987 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-82852b83-df66-47e2-be6e-831a61f56165 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:33.084636 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-82852b83-df66-47e2-be6e-831a61f56165 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:33.482596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-82852b83-df66-47e2-be6e-831a61f56165 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:33.492750 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-82852b83-df66-47e2-be6e-831a61f56165 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/f30dcd4e-f14f-4f37-bb07-05bafdff2bbb" status: 200 len: 1319 microversion: 2.1 time: 0.434252 Sep 10 11:47:33.493633 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 983/2049] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:33 2022] GET /compute/v2.1/servers/f30dcd4e-f14f-4f37-bb07-05bafdff2bbb => generated 1319 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:34.260316 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-396f96b0-77e8-4e5e-ba38-515cdabc35e5 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-999532057", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:34.348963 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-396f96b0-77e8-4e5e-ba38-515cdabc35e5 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] validate_networks() for None {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:47:34.517558 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-887cb028-a331-44a1-b444-e136323f483f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:34.519148 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-887cb028-a331-44a1-b444-e136323f483f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: f30dcd4e-f14f-4f37-bb07-05bafdff2bbb] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:34.533343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-887cb028-a331-44a1-b444-e136323f483f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:34.534618 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-887cb028-a331-44a1-b444-e136323f483f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:34.535652 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-887cb028-a331-44a1-b444-e136323f483f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:34.536778 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-887cb028-a331-44a1-b444-e136323f483f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:34.537432 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-887cb028-a331-44a1-b444-e136323f483f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:34.538094 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-887cb028-a331-44a1-b444-e136323f483f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:34.972079 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-396f96b0-77e8-4e5e-ba38-515cdabc35e5 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:47:34.972998 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-396f96b0-77e8-4e5e-ba38-515cdabc35e5 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:47:34.973675 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-396f96b0-77e8-4e5e-ba38-515cdabc35e5 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:47:34.974418 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-396f96b0-77e8-4e5e-ba38-515cdabc35e5 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:47:34.975801 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-396f96b0-77e8-4e5e-ba38-515cdabc35e5 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:47:34.984919 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-887cb028-a331-44a1-b444-e136323f483f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:34.986665 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-396f96b0-77e8-4e5e-ba38-515cdabc35e5 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:34.987574 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-396f96b0-77e8-4e5e-ba38-515cdabc35e5 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:34.989154 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-396f96b0-77e8-4e5e-ba38-515cdabc35e5 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:34.991459 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-396f96b0-77e8-4e5e-ba38-515cdabc35e5 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:34.992212 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-396f96b0-77e8-4e5e-ba38-515cdabc35e5 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:34.993076 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-396f96b0-77e8-4e5e-ba38-515cdabc35e5 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:34.995374 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-887cb028-a331-44a1-b444-e136323f483f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/f30dcd4e-f14f-4f37-bb07-05bafdff2bbb" status: 200 len: 1468 microversion: 2.1 time: 0.482693 Sep 10 11:47:35.000355 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 984/2050] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:34 2022] GET /compute/v2.1/servers/f30dcd4e-f14f-4f37-bb07-05bafdff2bbb => generated 1468 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:35.023765 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-396f96b0-77e8-4e5e-ba38-515cdabc35e5 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Getting quotas for project d8f6657b05bd48edbe73282147feee78. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:47:35.027032 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ea9b8f87-bb45-4741-9766-0217c18506d1 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:35.028242 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ea9b8f87-bb45-4741-9766-0217c18506d1 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 2ab5ad80-d86c-44f1-870d-777d44fd340a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:35.031515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-396f96b0-77e8-4e5e-ba38-515cdabc35e5 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Getting quotas for user 221c7c18d84c400388bd95cf28cf3e1a and project d8f6657b05bd48edbe73282147feee78. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:47:35.043457 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea9b8f87-bb45-4741-9766-0217c18506d1 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:35.046771 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea9b8f87-bb45-4741-9766-0217c18506d1 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:35.047375 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea9b8f87-bb45-4741-9766-0217c18506d1 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:35.048249 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea9b8f87-bb45-4741-9766-0217c18506d1 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:35.049452 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea9b8f87-bb45-4741-9766-0217c18506d1 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:35.052111 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-396f96b0-77e8-4e5e-ba38-515cdabc35e5 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:47:35.052473 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea9b8f87-bb45-4741-9766-0217c18506d1 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:35.057054 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-396f96b0-77e8-4e5e-ba38-515cdabc35e5 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:47:35.158282 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-396f96b0-77e8-4e5e-ba38-515cdabc35e5 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.208539 Sep 10 11:47:35.159591 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1067/2051] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:47:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1211 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 11:47:35.193006 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a29c57b1-16eb-4d5e-86ad-c9c33935f506 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:35.193878 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a29c57b1-16eb-4d5e-86ad-c9c33935f506 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: e713eb62-8c55-40ae-8424-4283e90a4c30] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:35.203050 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a29c57b1-16eb-4d5e-86ad-c9c33935f506 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:35.204396 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a29c57b1-16eb-4d5e-86ad-c9c33935f506 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:35.204837 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a29c57b1-16eb-4d5e-86ad-c9c33935f506 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:35.205641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a29c57b1-16eb-4d5e-86ad-c9c33935f506 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:35.206147 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a29c57b1-16eb-4d5e-86ad-c9c33935f506 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:35.206624 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a29c57b1-16eb-4d5e-86ad-c9c33935f506 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:35.242960 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a29c57b1-16eb-4d5e-86ad-c9c33935f506 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: e713eb62-8c55-40ae-8424-4283e90a4c30] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:47:35.477800 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a29c57b1-16eb-4d5e-86ad-c9c33935f506 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30" status: 204 len: 0 microversion: 2.1 time: 0.288893 Sep 10 11:47:35.479759 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1068/2052] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:47:35 2022] DELETE /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 11:47:35.480902 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ea9b8f87-bb45-4741-9766-0217c18506d1 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:35.497390 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b0f7b2b6-047b-4c35-a90a-f1a57633df6e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1448450563", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:35.502045 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ea9b8f87-bb45-4741-9766-0217c18506d1 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/2ab5ad80-d86c-44f1-870d-777d44fd340a" status: 200 len: 1469 microversion: 2.1 time: 0.482612 Sep 10 11:47:35.503211 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 985/2053] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:35 2022] GET /compute/v2.1/servers/2ab5ad80-d86c-44f1-870d-777d44fd340a => generated 1469 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:47:35.531746 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e0180358-e2fe-4361-94ef-e131f078088c tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:35.532391 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e0180358-e2fe-4361-94ef-e131f078088c tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: e713eb62-8c55-40ae-8424-4283e90a4c30] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:35.570307 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e0180358-e2fe-4361-94ef-e131f078088c tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:35.570813 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e0180358-e2fe-4361-94ef-e131f078088c tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:35.572895 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e0180358-e2fe-4361-94ef-e131f078088c tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:35.579481 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e0180358-e2fe-4361-94ef-e131f078088c tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:35.581794 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e0180358-e2fe-4361-94ef-e131f078088c tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:35.582317 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e0180358-e2fe-4361-94ef-e131f078088c tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:35.654102 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-b0f7b2b6-047b-4c35-a90a-f1a57633df6e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] validate_networks() for None {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:47:36.257065 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-b0f7b2b6-047b-4c35-a90a-f1a57633df6e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:47:36.257441 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-b0f7b2b6-047b-4c35-a90a-f1a57633df6e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:47:36.258009 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-b0f7b2b6-047b-4c35-a90a-f1a57633df6e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:47:36.258338 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-b0f7b2b6-047b-4c35-a90a-f1a57633df6e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:47:36.258732 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-b0f7b2b6-047b-4c35-a90a-f1a57633df6e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:47:36.287287 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0f7b2b6-047b-4c35-a90a-f1a57633df6e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:36.290161 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0f7b2b6-047b-4c35-a90a-f1a57633df6e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:36.290757 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0f7b2b6-047b-4c35-a90a-f1a57633df6e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:36.293736 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0f7b2b6-047b-4c35-a90a-f1a57633df6e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:36.295107 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0f7b2b6-047b-4c35-a90a-f1a57633df6e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:36.296261 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0f7b2b6-047b-4c35-a90a-f1a57633df6e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:36.320300 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e0180358-e2fe-4361-94ef-e131f078088c tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ea7c11febf451da4f1faf4dff9471d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f601d0bb424da4bb02b532ac982878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:36.337679 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e0180358-e2fe-4361-94ef-e131f078088c tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30" status: 200 len: 1683 microversion: 2.1 time: 0.812227 Sep 10 11:47:36.338559 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 986/2054] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:35 2022] GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30 => generated 1683 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:36.348941 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3ae6ba95-47c7-4ffa-aa0e-611c8db5056d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:36.349825 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-b0f7b2b6-047b-4c35-a90a-f1a57633df6e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Getting quotas for project d8f6657b05bd48edbe73282147feee78. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:47:36.363152 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-b0f7b2b6-047b-4c35-a90a-f1a57633df6e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Getting quotas for user 221c7c18d84c400388bd95cf28cf3e1a and project d8f6657b05bd48edbe73282147feee78. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:47:36.374598 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3ae6ba95-47c7-4ffa-aa0e-611c8db5056d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:36.383264 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3ae6ba95-47c7-4ffa-aa0e-611c8db5056d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Searching by: {'reservation_id': 'r-yiwd51x8', 'deleted': False, 'project_id': '5949225a72e649c1adc217d5a760460a'} {{(pid=128776) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 11:47:36.391501 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3ae6ba95-47c7-4ffa-aa0e-611c8db5056d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:36.397719 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3ae6ba95-47c7-4ffa-aa0e-611c8db5056d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:36.398380 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3ae6ba95-47c7-4ffa-aa0e-611c8db5056d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:36.399381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3ae6ba95-47c7-4ffa-aa0e-611c8db5056d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:36.399987 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3ae6ba95-47c7-4ffa-aa0e-611c8db5056d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:36.400579 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3ae6ba95-47c7-4ffa-aa0e-611c8db5056d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:36.404877 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b0f7b2b6-047b-4c35-a90a-f1a57633df6e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:47:36.412293 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b0f7b2b6-047b-4c35-a90a-f1a57633df6e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: d54d09d0-a4be-4324-ae6e-c22ad671d008] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:47:36.469164 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:UPDATE=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:47:36.543906 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b0f7b2b6-047b-4c35-a90a-f1a57633df6e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.061937 Sep 10 11:47:36.550948 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1069/2055] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:47:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1070 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:47:36.556619 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-178d64f7-f668-4223-99d5-06eb3a73499c tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:36.557471 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-178d64f7-f668-4223-99d5-06eb3a73499c tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: d54d09d0-a4be-4324-ae6e-c22ad671d008] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:36.616534 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.multi_cell_list [None req-3ae6ba95-47c7-4ffa-aa0e-611c8db5056d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128776) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 11:47:36.785189 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-178d64f7-f668-4223-99d5-06eb3a73499c tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:36.798446 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-178d64f7-f668-4223-99d5-06eb3a73499c tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/d54d09d0-a4be-4324-ae6e-c22ad671d008" status: 200 len: 1214 microversion: 2.1 time: 0.245891 Sep 10 11:47:36.799122 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1070/2056] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:36 2022] GET /compute/v2.1/servers/d54d09d0-a4be-4324-ae6e-c22ad671d008 => generated 1214 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:36.819404 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3ae6ba95-47c7-4ffa-aa0e-611c8db5056d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:36.829775 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3ae6ba95-47c7-4ffa-aa0e-611c8db5056d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:36.830395 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3ae6ba95-47c7-4ffa-aa0e-611c8db5056d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:36.831469 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3ae6ba95-47c7-4ffa-aa0e-611c8db5056d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:37.173525 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3ae6ba95-47c7-4ffa-aa0e-611c8db5056d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?reservation_id=r-yiwd51x8" status: 200 len: 2930 microversion: 2.1 time: 0.833818 Sep 10 11:47:37.174305 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 987/2057] 10.222.0.23 () {58 vars in 1197 bytes} [Sat Sep 10 11:47:36 2022] GET /compute/v2.1/servers/detail?reservation_id=r-yiwd51x8 => generated 2930 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:37.203583 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-09b494b3-14e7-43cb-bc2d-b5b015354115 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:37.238267 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.compute.server_groups [None req-09b494b3-14e7-43cb-bc2d-b5b015354115 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Querying cell d31511aa-3734-4d55-9c57-4a88c62d4dfd(cell1) for 2 instances {{(pid=128777) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 10 11:47:37.239474 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-09b494b3-14e7-43cb-bc2d-b5b015354115 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:37.239970 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-09b494b3-14e7-43cb-bc2d-b5b015354115 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:37.241269 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-09b494b3-14e7-43cb-bc2d-b5b015354115 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:37.282611 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-09b494b3-14e7-43cb-bc2d-b5b015354115 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/c7729ba4-e702-4dcf-91a2-344963012fce" status: 200 len: 265 microversion: 2.1 time: 0.083544 Sep 10 11:47:37.283611 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1071/2058] 10.222.0.23 () {58 vars in 1263 bytes} [Sat Sep 10 11:47:37 2022] GET /compute/v2.1/os-server-groups/c7729ba4-e702-4dcf-91a2-344963012fce => generated 265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:47:37.296983 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-155c8d8d-143a-4974-a6ee-b94ac69cb6fe tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:37.297687 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-155c8d8d-143a-4974-a6ee-b94ac69cb6fe tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] [instance: 2ab5ad80-d86c-44f1-870d-777d44fd340a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:37.312606 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-155c8d8d-143a-4974-a6ee-b94ac69cb6fe tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:37.313191 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-155c8d8d-143a-4974-a6ee-b94ac69cb6fe tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:37.314839 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-155c8d8d-143a-4974-a6ee-b94ac69cb6fe tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:37.316173 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-155c8d8d-143a-4974-a6ee-b94ac69cb6fe tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:37.318657 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-155c8d8d-143a-4974-a6ee-b94ac69cb6fe tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:37.319274 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-155c8d8d-143a-4974-a6ee-b94ac69cb6fe tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:37.363893 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2fd38c3f-ef76-4bc1-b259-3030ec04fe6e tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:37.364869 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2fd38c3f-ef76-4bc1-b259-3030ec04fe6e tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: e713eb62-8c55-40ae-8424-4283e90a4c30] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:37.376351 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fd38c3f-ef76-4bc1-b259-3030ec04fe6e tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:37.377495 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fd38c3f-ef76-4bc1-b259-3030ec04fe6e tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:37.378710 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fd38c3f-ef76-4bc1-b259-3030ec04fe6e tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:37.381973 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fd38c3f-ef76-4bc1-b259-3030ec04fe6e tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:37.383536 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fd38c3f-ef76-4bc1-b259-3030ec04fe6e tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:37.384371 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fd38c3f-ef76-4bc1-b259-3030ec04fe6e tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:37.859481 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-155c8d8d-143a-4974-a6ee-b94ac69cb6fe tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/2ab5ad80-d86c-44f1-870d-777d44fd340a" status: 200 len: 1620 microversion: 2.1 time: 0.566858 Sep 10 11:47:37.885810 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 988/2059] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:37 2022] GET /compute/v2.1/servers/2ab5ad80-d86c-44f1-870d-777d44fd340a => generated 1620 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:37.895391 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9b1742f8-ef34-4519-963e-329cd971540a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:37.896403 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9b1742f8-ef34-4519-963e-329cd971540a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: d54d09d0-a4be-4324-ae6e-c22ad671d008] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:37.922377 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9b1742f8-ef34-4519-963e-329cd971540a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:37.923650 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9b1742f8-ef34-4519-963e-329cd971540a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:37.924505 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9b1742f8-ef34-4519-963e-329cd971540a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:37.926548 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9b1742f8-ef34-4519-963e-329cd971540a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:37.927758 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9b1742f8-ef34-4519-963e-329cd971540a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:37.928352 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9b1742f8-ef34-4519-963e-329cd971540a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:37.979496 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2fd38c3f-ef76-4bc1-b259-3030ec04fe6e tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ea7c11febf451da4f1faf4dff9471d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f601d0bb424da4bb02b532ac982878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:38.006027 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2fd38c3f-ef76-4bc1-b259-3030ec04fe6e tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30" status: 200 len: 1683 microversion: 2.1 time: 0.643998 Sep 10 11:47:38.010947 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1072/2060] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:37 2022] GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30 => generated 1683 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:47:38.037775 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c8437db0-d843-4c21-a8b5-78757f2c7a3b tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:38.053094 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c8437db0-d843-4c21-a8b5-78757f2c7a3b tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] [instance: f30dcd4e-f14f-4f37-bb07-05bafdff2bbb] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:38.066719 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c8437db0-d843-4c21-a8b5-78757f2c7a3b tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:38.067587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c8437db0-d843-4c21-a8b5-78757f2c7a3b tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:38.068730 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c8437db0-d843-4c21-a8b5-78757f2c7a3b tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:38.069625 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c8437db0-d843-4c21-a8b5-78757f2c7a3b tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:38.070560 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c8437db0-d843-4c21-a8b5-78757f2c7a3b tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:38.071141 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c8437db0-d843-4c21-a8b5-78757f2c7a3b tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:38.199919 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9b1742f8-ef34-4519-963e-329cd971540a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:38.217058 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9b1742f8-ef34-4519-963e-329cd971540a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/d54d09d0-a4be-4324-ae6e-c22ad671d008" status: 200 len: 1266 microversion: 2.1 time: 0.329120 Sep 10 11:47:38.217682 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 989/2061] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:37 2022] GET /compute/v2.1/servers/d54d09d0-a4be-4324-ae6e-c22ad671d008 => generated 1266 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:38.479146 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c8437db0-d843-4c21-a8b5-78757f2c7a3b tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/f30dcd4e-f14f-4f37-bb07-05bafdff2bbb" status: 200 len: 1619 microversion: 2.1 time: 0.460036 Sep 10 11:47:38.486471 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1073/2062] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:38 2022] GET /compute/v2.1/servers/f30dcd4e-f14f-4f37-bb07-05bafdff2bbb => generated 1619 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:38.515916 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bb9a6bc2-548d-4655-84a2-932daf50099d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Action: 'create', calling method: .version_select at 0x7f407b5e0b80>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-2014487797", "policies": ["anti-affinity"]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:38.557303 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=79 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:47:38.567460 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-bb9a6bc2-548d-4655-84a2-932daf50099d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Getting quotas for project 5949225a72e649c1adc217d5a760460a. Resources: {'server_groups'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:47:38.595210 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-bb9a6bc2-548d-4655-84a2-932daf50099d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Getting quotas for user dfc33eb8645248f9b154587e7d8d449e and project 5949225a72e649c1adc217d5a760460a. Resources: {'server_groups'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:47:38.705804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-bb9a6bc2-548d-4655-84a2-932daf50099d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Getting quotas for project 5949225a72e649c1adc217d5a760460a. Resources: {'server_groups'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:47:38.721184 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-bb9a6bc2-548d-4655-84a2-932daf50099d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Getting quotas for user dfc33eb8645248f9b154587e7d8d449e and project 5949225a72e649c1adc217d5a760460a. Resources: {'server_groups'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:47:38.764068 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bb9a6bc2-548d-4655-84a2-932daf50099d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.252708 Sep 10 11:47:38.776856 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 990/2063] 10.222.0.23 () {60 vars in 1174 bytes} [Sat Sep 10 11:47:38 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:47:38.910101 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-66f97682-f6f7-4b3b-be5c-c3a2ce7a2f49 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1989388160", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "cf98e173-04b2-4c6b-8f0c-384a6d2a36b1"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:38.999547 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-66f97682-f6f7-4b3b-be5c-c3a2ce7a2f49 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] validate_networks() for None {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:47:39.043338 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-eff491aa-ef93-4587-be79-50835082ba9c tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:39.046191 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-eff491aa-ef93-4587-be79-50835082ba9c tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: e713eb62-8c55-40ae-8424-4283e90a4c30] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:39.062199 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eff491aa-ef93-4587-be79-50835082ba9c tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:39.062960 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eff491aa-ef93-4587-be79-50835082ba9c tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:39.063658 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eff491aa-ef93-4587-be79-50835082ba9c tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:39.065016 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eff491aa-ef93-4587-be79-50835082ba9c tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:39.066495 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eff491aa-ef93-4587-be79-50835082ba9c tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:39.067193 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eff491aa-ef93-4587-be79-50835082ba9c tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:39.176857 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-eff491aa-ef93-4587-be79-50835082ba9c tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ea7c11febf451da4f1faf4dff9471d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f601d0bb424da4bb02b532ac982878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:39.187669 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-eff491aa-ef93-4587-be79-50835082ba9c tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30" status: 200 len: 1616 microversion: 2.1 time: 0.148484 Sep 10 11:47:39.188713 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 991/2064] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:39 2022] GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30 => generated 1616 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:39.241557 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ed16648a-a054-48af-81b6-1b183f13cfc6 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:39.242634 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ed16648a-a054-48af-81b6-1b183f13cfc6 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: d54d09d0-a4be-4324-ae6e-c22ad671d008] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:39.250796 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed16648a-a054-48af-81b6-1b183f13cfc6 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:39.251338 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed16648a-a054-48af-81b6-1b183f13cfc6 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:39.251793 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed16648a-a054-48af-81b6-1b183f13cfc6 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:39.253634 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed16648a-a054-48af-81b6-1b183f13cfc6 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:39.254149 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed16648a-a054-48af-81b6-1b183f13cfc6 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:39.254776 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed16648a-a054-48af-81b6-1b183f13cfc6 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:39.394506 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ed16648a-a054-48af-81b6-1b183f13cfc6 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:39.406961 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ed16648a-a054-48af-81b6-1b183f13cfc6 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/d54d09d0-a4be-4324-ae6e-c22ad671d008" status: 200 len: 1272 microversion: 2.1 time: 0.170042 Sep 10 11:47:39.407854 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 992/2065] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:39 2022] GET /compute/v2.1/servers/d54d09d0-a4be-4324-ae6e-c22ad671d008 => generated 1272 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:47:39.876020 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-66f97682-f6f7-4b3b-be5c-c3a2ce7a2f49 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:47:39.876558 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-66f97682-f6f7-4b3b-be5c-c3a2ce7a2f49 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:47:39.877152 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-66f97682-f6f7-4b3b-be5c-c3a2ce7a2f49 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:47:39.878824 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-66f97682-f6f7-4b3b-be5c-c3a2ce7a2f49 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:47:39.879553 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-66f97682-f6f7-4b3b-be5c-c3a2ce7a2f49 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:47:39.898257 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66f97682-f6f7-4b3b-be5c-c3a2ce7a2f49 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:39.898773 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66f97682-f6f7-4b3b-be5c-c3a2ce7a2f49 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:39.899420 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66f97682-f6f7-4b3b-be5c-c3a2ce7a2f49 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:39.900154 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66f97682-f6f7-4b3b-be5c-c3a2ce7a2f49 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:39.900609 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66f97682-f6f7-4b3b-be5c-c3a2ce7a2f49 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:39.901041 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66f97682-f6f7-4b3b-be5c-c3a2ce7a2f49 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:39.918955 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-66f97682-f6f7-4b3b-be5c-c3a2ce7a2f49 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Getting quotas for project 5949225a72e649c1adc217d5a760460a. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:47:39.924929 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-66f97682-f6f7-4b3b-be5c-c3a2ce7a2f49 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Getting quotas for user dfc33eb8645248f9b154587e7d8d449e and project 5949225a72e649c1adc217d5a760460a. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:47:39.938666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-66f97682-f6f7-4b3b-be5c-c3a2ce7a2f49 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Going to run 2 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:47:39.941988 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-66f97682-f6f7-4b3b-be5c-c3a2ce7a2f49 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 49cfca02-b968-45e0-9b31-404eded0c6d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:47:39.987573 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-66f97682-f6f7-4b3b-be5c-c3a2ce7a2f49 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128777) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Sep 10 11:47:40.010429 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-66f97682-f6f7-4b3b-be5c-c3a2ce7a2f49 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Getting quotas for project 5949225a72e649c1adc217d5a760460a. Resources: {'server_group_members'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:47:40.018688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-66f97682-f6f7-4b3b-be5c-c3a2ce7a2f49 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Getting quotas for user dfc33eb8645248f9b154587e7d8d449e and project 5949225a72e649c1adc217d5a760460a. Resources: {'server_group_members'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:47:40.074496 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-66f97682-f6f7-4b3b-be5c-c3a2ce7a2f49 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Getting quotas for project 5949225a72e649c1adc217d5a760460a. Resources: {'server_group_members'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:47:40.081494 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-66f97682-f6f7-4b3b-be5c-c3a2ce7a2f49 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Getting quotas for user dfc33eb8645248f9b154587e7d8d449e and project 5949225a72e649c1adc217d5a760460a. Resources: {'server_group_members'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:47:40.101955 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-66f97682-f6f7-4b3b-be5c-c3a2ce7a2f49 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 785f3cc4-7418-4e67-b5e7-d37bb7a59919] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=49cfca02-b968-45e0-9b31-404eded0c6d2,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:47:40.175420 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-66f97682-f6f7-4b3b-be5c-c3a2ce7a2f49 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Getting quotas for project 5949225a72e649c1adc217d5a760460a. Resources: {'server_group_members'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:47:40.183183 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-66f97682-f6f7-4b3b-be5c-c3a2ce7a2f49 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Getting quotas for user dfc33eb8645248f9b154587e7d8d449e and project 5949225a72e649c1adc217d5a760460a. Resources: {'server_group_members'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:47:40.215018 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c70d6624-9c23-40a9-a333-bf6db0899993 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:40.216604 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c70d6624-9c23-40a9-a333-bf6db0899993 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: e713eb62-8c55-40ae-8424-4283e90a4c30] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:40.225904 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c70d6624-9c23-40a9-a333-bf6db0899993 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:40.226747 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c70d6624-9c23-40a9-a333-bf6db0899993 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:40.227465 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c70d6624-9c23-40a9-a333-bf6db0899993 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:40.228407 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c70d6624-9c23-40a9-a333-bf6db0899993 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:40.229086 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c70d6624-9c23-40a9-a333-bf6db0899993 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:40.229924 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c70d6624-9c23-40a9-a333-bf6db0899993 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:40.257264 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-66f97682-f6f7-4b3b-be5c-c3a2ce7a2f49 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Getting quotas for project 5949225a72e649c1adc217d5a760460a. Resources: {'server_group_members'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:47:40.266785 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-66f97682-f6f7-4b3b-be5c-c3a2ce7a2f49 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Getting quotas for user dfc33eb8645248f9b154587e7d8d449e and project 5949225a72e649c1adc217d5a760460a. Resources: {'server_group_members'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:47:40.331047 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-66f97682-f6f7-4b3b-be5c-c3a2ce7a2f49 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.425588 Sep 10 11:47:40.335820 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1074/2066] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:47:38 2022] POST /compute/v2.1/servers => generated 32 bytes in 1431 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 10 11:47:40.342793 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b37e10f2-d427-4f61-b1f9-a438e09d3ed1 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:40.349322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b37e10f2-d427-4f61-b1f9-a438e09d3ed1 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:40.350314 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b37e10f2-d427-4f61-b1f9-a438e09d3ed1 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Searching by: {'deleted': False, 'project_id': '5949225a72e649c1adc217d5a760460a'} {{(pid=128777) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 11:47:40.370350 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b37e10f2-d427-4f61-b1f9-a438e09d3ed1 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:40.371047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b37e10f2-d427-4f61-b1f9-a438e09d3ed1 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:40.372000 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b37e10f2-d427-4f61-b1f9-a438e09d3ed1 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:40.373178 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b37e10f2-d427-4f61-b1f9-a438e09d3ed1 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:40.373954 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b37e10f2-d427-4f61-b1f9-a438e09d3ed1 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:40.374609 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b37e10f2-d427-4f61-b1f9-a438e09d3ed1 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:40.409854 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.multi_cell_list [None req-b37e10f2-d427-4f61-b1f9-a438e09d3ed1 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=128777) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 11:47:40.453817 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b37e10f2-d427-4f61-b1f9-a438e09d3ed1 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1665 microversion: 2.1 time: 0.116217 Sep 10 11:47:40.463831 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1075/2067] 10.222.0.23 () {58 vars in 1125 bytes} [Sat Sep 10 11:47:40 2022] GET /compute/v2.1/servers => generated 1665 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:40.469910 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-59cadf81-5408-4d19-82df-7eeffb5b968a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:40.470769 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-59cadf81-5408-4d19-82df-7eeffb5b968a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: d54d09d0-a4be-4324-ae6e-c22ad671d008] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:40.484773 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59cadf81-5408-4d19-82df-7eeffb5b968a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:40.485435 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59cadf81-5408-4d19-82df-7eeffb5b968a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:40.486091 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59cadf81-5408-4d19-82df-7eeffb5b968a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:40.488659 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59cadf81-5408-4d19-82df-7eeffb5b968a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:40.490049 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59cadf81-5408-4d19-82df-7eeffb5b968a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:40.490049 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59cadf81-5408-4d19-82df-7eeffb5b968a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:40.504383 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c70d6624-9c23-40a9-a333-bf6db0899993 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ea7c11febf451da4f1faf4dff9471d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99f601d0bb424da4bb02b532ac982878', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:40.521969 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c70d6624-9c23-40a9-a333-bf6db0899993 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30" status: 200 len: 1616 microversion: 2.1 time: 0.311140 Sep 10 11:47:40.522868 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 993/2068] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:40 2022] GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30 => generated 1616 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:40.559698 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7ff3397e-3d83-45de-a88a-c55d872fb353 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:40.560807 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7ff3397e-3d83-45de-a88a-c55d872fb353 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 785f3cc4-7418-4e67-b5e7-d37bb7a59919] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:40.720791 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7ff3397e-3d83-45de-a88a-c55d872fb353 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:40.730558 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7ff3397e-3d83-45de-a88a-c55d872fb353 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/785f3cc4-7418-4e67-b5e7-d37bb7a59919" status: 200 len: 1219 microversion: 2.1 time: 0.184400 Sep 10 11:47:40.733135 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 994/2069] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:40 2022] GET /compute/v2.1/servers/785f3cc4-7418-4e67-b5e7-d37bb7a59919 => generated 1219 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:40.761734 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-97bc489b-4561-4b1c-88ad-5ef44fded8dc req-7cc2733f-69ea-44a1-a6b1-3d57de04063b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e713eb62-8c55-40ae-8424-4283e90a4c30", "name": "network-vif-deleted", "tag": "e7466b53-cc0f-4f0f-a845-678ac860b57a"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:40.789354 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-97bc489b-4561-4b1c-88ad-5ef44fded8dc req-7cc2733f-69ea-44a1-a6b1-3d57de04063b service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:40.790735 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-97bc489b-4561-4b1c-88ad-5ef44fded8dc req-7cc2733f-69ea-44a1-a6b1-3d57de04063b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:40.792215 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-97bc489b-4561-4b1c-88ad-5ef44fded8dc req-7cc2733f-69ea-44a1-a6b1-3d57de04063b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:40.816169 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-59cadf81-5408-4d19-82df-7eeffb5b968a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:40.820912 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-97bc489b-4561-4b1c-88ad-5ef44fded8dc req-7cc2733f-69ea-44a1-a6b1-3d57de04063b service nova] Creating event network-vif-deleted:e7466b53-cc0f-4f0f-a845-678ac860b57a for instance e713eb62-8c55-40ae-8424-4283e90a4c30 on n-h2-856895-1 Sep 10 11:47:40.827860 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-59cadf81-5408-4d19-82df-7eeffb5b968a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/d54d09d0-a4be-4324-ae6e-c22ad671d008" status: 200 len: 1272 microversion: 2.1 time: 0.362671 Sep 10 11:47:40.828728 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1076/2070] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:40 2022] GET /compute/v2.1/servers/d54d09d0-a4be-4324-ae6e-c22ad671d008 => generated 1272 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:40.853279 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-97bc489b-4561-4b1c-88ad-5ef44fded8dc req-7cc2733f-69ea-44a1-a6b1-3d57de04063b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095686 Sep 10 11:47:40.856023 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 995/2071] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:47:41.239559 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-99f9f6b9-1471-4a16-b04a-b225b90fe0ab req-b1030f5c-e3e5-4145-af6d-702844f5fa4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ebabc55-1b1d-4276-8bde-d8d4859d74fd", "tag": "679e3ac9-dc5d-4404-aa8b-99020ce86192"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:41.271889 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-99f9f6b9-1471-4a16-b04a-b225b90fe0ab req-b1030f5c-e3e5-4145-af6d-702844f5fa4c service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:41.274091 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-99f9f6b9-1471-4a16-b04a-b225b90fe0ab req-b1030f5c-e3e5-4145-af6d-702844f5fa4c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:41.274932 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-99f9f6b9-1471-4a16-b04a-b225b90fe0ab req-b1030f5c-e3e5-4145-af6d-702844f5fa4c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:41.307563 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-99f9f6b9-1471-4a16-b04a-b225b90fe0ab req-b1030f5c-e3e5-4145-af6d-702844f5fa4c service nova] Creating event network-changed:679e3ac9-dc5d-4404-aa8b-99020ce86192 for instance 6ebabc55-1b1d-4276-8bde-d8d4859d74fd on n-h1-856895-1 Sep 10 11:47:41.319757 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-99f9f6b9-1471-4a16-b04a-b225b90fe0ab req-b1030f5c-e3e5-4145-af6d-702844f5fa4c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084258 Sep 10 11:47:41.323341 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1077/2072] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:47:41.552631 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3eb07221-6184-44f3-90c5-856ff8f2262d tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:41.555798 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3eb07221-6184-44f3-90c5-856ff8f2262d tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] [instance: e713eb62-8c55-40ae-8424-4283e90a4c30] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:41.574805 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3eb07221-6184-44f3-90c5-856ff8f2262d tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:41.575585 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3eb07221-6184-44f3-90c5-856ff8f2262d tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:41.576222 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3eb07221-6184-44f3-90c5-856ff8f2262d tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:41.577387 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3eb07221-6184-44f3-90c5-856ff8f2262d tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:41.578399 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3eb07221-6184-44f3-90c5-856ff8f2262d tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:41.579999 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3eb07221-6184-44f3-90c5-856ff8f2262d tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:41.616573 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-3eb07221-6184-44f3-90c5-856ff8f2262d tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] HTTP exception thrown: Instance e713eb62-8c55-40ae-8424-4283e90a4c30 could not be found. Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3eb07221-6184-44f3-90c5-856ff8f2262d tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Request method failure captured: Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30 HTTP/1.1 Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHi38QHxstYwmm1jqBxGoQRfHdmhpfKxTSM64faPsvQ9TC2e190TnKoyyyUSv8MdBks_lZfGdJ_kexRm7lqgB3JPXwcYfF5usK52IvsOVrWJbyToXQPRzSCoW2wEB02FhJD5WZ_OlvApJrkCHPlaKMMHpYIUv0yIrs_ORofzQ5jM_ms Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 99f601d0bb424da4bb02b532ac982878 Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-VolumesAdminNegativeTest-307132448 Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99f601d0bb424da4bb02b532ac982878"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99f601d0bb424da4bb02b532ac982878"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_99f601d0bb424da4bb02b532ac982878", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/99f601d0bb424da4bb02b532ac982878"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-VolumesAdminNegativeTest-307132448 Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 99f601d0bb424da4bb02b532ac982878 Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-307132448 Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-VolumesAdminNegativeTest-307132448-project Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 91ea7c11febf451da4f1faf4dff9471d Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-VolumesAdminNegativeTest-307132448-project Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance e713eb62-8c55-40ae-8424-4283e90a4c30 could not be found. Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'e713eb62-8c55-40ae-8424-4283e90a4c30'} Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e713eb62-8c55-40ae-8424-4283e90a4c30 could not be found. Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e713eb62-8c55-40ae-8424-4283e90a4c30 could not be found. Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:47:41.618610 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:41.622179 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:41.622179 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:47:41.622179 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:47:41.622179 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:47:41.622179 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:47:41.622179 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e713eb62-8c55-40ae-8424-4283e90a4c30 could not be found. Sep 10 11:47:41.622179 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:47:41.625907 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3eb07221-6184-44f3-90c5-856ff8f2262d tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Returning 404 to user: Instance e713eb62-8c55-40ae-8424-4283e90a4c30 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:47:41.628380 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3eb07221-6184-44f3-90c5-856ff8f2262d tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30" status: 404 len: 111 microversion: 2.1 time: 0.082877 Sep 10 11:47:41.628980 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 996/2073] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:41 2022] GET /compute/v2.1/servers/e713eb62-8c55-40ae-8424-4283e90a4c30 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:47:41.640813 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-411ffbcc-5fd8-464c-8b27-74a480b351e2 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] Calling method '.version_select at 0x7f407b4e2310>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:41.685834 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-411ffbcc-5fd8-464c-8b27-74a480b351e2 tempest-VolumesAdminNegativeTest-307132448 tempest-VolumesAdminNegativeTest-307132448-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1352233681" status: 202 len: 0 microversion: 2.1 time: 0.051972 Sep 10 11:47:41.687279 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1078/2074] 10.222.0.23 () {58 vars in 1221 bytes} [Sat Sep 10 11:47:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1352233681 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:47:41.760795 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-28e4778c-1232-4977-8d77-a9d07086d225 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:41.761665 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-28e4778c-1232-4977-8d77-a9d07086d225 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 785f3cc4-7418-4e67-b5e7-d37bb7a59919] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:41.860271 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-348f33d1-6627-4548-9a6c-8e4d451d31a6 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:41.861230 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-348f33d1-6627-4548-9a6c-8e4d451d31a6 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: d54d09d0-a4be-4324-ae6e-c22ad671d008] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:41.880753 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-348f33d1-6627-4548-9a6c-8e4d451d31a6 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:41.881970 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-348f33d1-6627-4548-9a6c-8e4d451d31a6 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:41.882635 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-348f33d1-6627-4548-9a6c-8e4d451d31a6 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:41.885473 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-348f33d1-6627-4548-9a6c-8e4d451d31a6 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:41.886367 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-348f33d1-6627-4548-9a6c-8e4d451d31a6 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:41.889490 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-348f33d1-6627-4548-9a6c-8e4d451d31a6 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:41.982444 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-28e4778c-1232-4977-8d77-a9d07086d225 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:42.006428 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-28e4778c-1232-4977-8d77-a9d07086d225 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/785f3cc4-7418-4e67-b5e7-d37bb7a59919" status: 200 len: 1219 microversion: 2.1 time: 0.245740 Sep 10 11:47:42.009620 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 997/2075] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:41 2022] GET /compute/v2.1/servers/785f3cc4-7418-4e67-b5e7-d37bb7a59919 => generated 1219 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:42.418097 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-348f33d1-6627-4548-9a6c-8e4d451d31a6 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:42.434393 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-348f33d1-6627-4548-9a6c-8e4d451d31a6 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/d54d09d0-a4be-4324-ae6e-c22ad671d008" status: 200 len: 1314 microversion: 2.1 time: 0.576730 Sep 10 11:47:42.435108 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1079/2076] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:41 2022] GET /compute/v2.1/servers/d54d09d0-a4be-4324-ae6e-c22ad671d008 => generated 1314 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:43.039551 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-654fdce5-24a7-442f-a56d-e22e74dae824 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:43.041289 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-654fdce5-24a7-442f-a56d-e22e74dae824 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 785f3cc4-7418-4e67-b5e7-d37bb7a59919] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:43.060111 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-654fdce5-24a7-442f-a56d-e22e74dae824 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:43.067805 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-654fdce5-24a7-442f-a56d-e22e74dae824 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:43.070084 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-654fdce5-24a7-442f-a56d-e22e74dae824 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:43.071301 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-654fdce5-24a7-442f-a56d-e22e74dae824 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:43.072059 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-654fdce5-24a7-442f-a56d-e22e74dae824 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:43.073000 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-654fdce5-24a7-442f-a56d-e22e74dae824 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:43.448946 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-654fdce5-24a7-442f-a56d-e22e74dae824 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:43.460463 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-654fdce5-24a7-442f-a56d-e22e74dae824 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/785f3cc4-7418-4e67-b5e7-d37bb7a59919" status: 200 len: 1271 microversion: 2.1 time: 0.427725 Sep 10 11:47:43.469396 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3c0552d9-22fb-4926-a404-9e0ef55aec04 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:43.470101 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3c0552d9-22fb-4926-a404-9e0ef55aec04 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: d54d09d0-a4be-4324-ae6e-c22ad671d008] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:43.474245 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:INSERT=11,nova_api:SELECT=88,nova_api:DELETE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:47:43.474552 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 998/2077] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:43 2022] GET /compute/v2.1/servers/785f3cc4-7418-4e67-b5e7-d37bb7a59919 => generated 1271 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:43.485061 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3c0552d9-22fb-4926-a404-9e0ef55aec04 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:43.486058 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3c0552d9-22fb-4926-a404-9e0ef55aec04 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:43.486820 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3c0552d9-22fb-4926-a404-9e0ef55aec04 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:43.488405 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3c0552d9-22fb-4926-a404-9e0ef55aec04 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:43.489135 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3c0552d9-22fb-4926-a404-9e0ef55aec04 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:43.489901 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3c0552d9-22fb-4926-a404-9e0ef55aec04 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:43.813619 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3c0552d9-22fb-4926-a404-9e0ef55aec04 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:43.825019 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3c0552d9-22fb-4926-a404-9e0ef55aec04 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/d54d09d0-a4be-4324-ae6e-c22ad671d008" status: 200 len: 1314 microversion: 2.1 time: 0.359857 Sep 10 11:47:43.826641 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1080/2078] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:43 2022] GET /compute/v2.1/servers/d54d09d0-a4be-4324-ae6e-c22ad671d008 => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:44.491544 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e2abc04d-4bfe-4ee7-ac84-26d5cdf22a79 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:44.493031 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e2abc04d-4bfe-4ee7-ac84-26d5cdf22a79 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 785f3cc4-7418-4e67-b5e7-d37bb7a59919] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:44.496432 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:47:44.509839 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e2abc04d-4bfe-4ee7-ac84-26d5cdf22a79 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:44.511469 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e2abc04d-4bfe-4ee7-ac84-26d5cdf22a79 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:44.514658 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e2abc04d-4bfe-4ee7-ac84-26d5cdf22a79 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:44.516187 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e2abc04d-4bfe-4ee7-ac84-26d5cdf22a79 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:44.517877 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e2abc04d-4bfe-4ee7-ac84-26d5cdf22a79 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:44.520417 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e2abc04d-4bfe-4ee7-ac84-26d5cdf22a79 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:44.653008 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e2abc04d-4bfe-4ee7-ac84-26d5cdf22a79 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:44.669109 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:47:44.684911 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e2abc04d-4bfe-4ee7-ac84-26d5cdf22a79 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/785f3cc4-7418-4e67-b5e7-d37bb7a59919" status: 200 len: 1277 microversion: 2.1 time: 0.188078 Sep 10 11:47:44.687952 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 999/2079] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:44 2022] GET /compute/v2.1/servers/785f3cc4-7418-4e67-b5e7-d37bb7a59919 => generated 1277 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:44.852838 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-36da838e-356e-411d-bd1e-9594e7ca33de tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:44.853562 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-36da838e-356e-411d-bd1e-9594e7ca33de tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: d54d09d0-a4be-4324-ae6e-c22ad671d008] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:44.878826 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36da838e-356e-411d-bd1e-9594e7ca33de tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:44.879990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36da838e-356e-411d-bd1e-9594e7ca33de tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:44.880772 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36da838e-356e-411d-bd1e-9594e7ca33de tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:44.889194 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36da838e-356e-411d-bd1e-9594e7ca33de tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:44.889792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36da838e-356e-411d-bd1e-9594e7ca33de tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:44.890292 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36da838e-356e-411d-bd1e-9594e7ca33de tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:45.286686 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-36da838e-356e-411d-bd1e-9594e7ca33de tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:45.298490 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-36da838e-356e-411d-bd1e-9594e7ca33de tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/d54d09d0-a4be-4324-ae6e-c22ad671d008" status: 200 len: 1314 microversion: 2.1 time: 0.452314 Sep 10 11:47:45.300680 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1081/2080] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:44 2022] GET /compute/v2.1/servers/d54d09d0-a4be-4324-ae6e-c22ad671d008 => generated 1314 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:45.720398 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bddb53eb-a1dd-4151-8595-a9146540db48 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:45.722400 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bddb53eb-a1dd-4151-8595-a9146540db48 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 785f3cc4-7418-4e67-b5e7-d37bb7a59919] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:45.733705 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bddb53eb-a1dd-4151-8595-a9146540db48 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:45.735825 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bddb53eb-a1dd-4151-8595-a9146540db48 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:45.736484 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bddb53eb-a1dd-4151-8595-a9146540db48 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:45.738575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bddb53eb-a1dd-4151-8595-a9146540db48 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:45.739632 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bddb53eb-a1dd-4151-8595-a9146540db48 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:45.740402 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bddb53eb-a1dd-4151-8595-a9146540db48 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:45.866417 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bddb53eb-a1dd-4151-8595-a9146540db48 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:45.879867 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bddb53eb-a1dd-4151-8595-a9146540db48 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/785f3cc4-7418-4e67-b5e7-d37bb7a59919" status: 200 len: 1277 microversion: 2.1 time: 0.164193 Sep 10 11:47:45.882436 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1000/2081] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:45 2022] GET /compute/v2.1/servers/785f3cc4-7418-4e67-b5e7-d37bb7a59919 => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:46.184681 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-2ea2f796-a0d5-4492-a26c-72d2f7347f19 req-faf18ef8-013f-4ce8-9d70-5968cb9887b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d54d09d0-a4be-4324-ae6e-c22ad671d008", "tag": "1b092d3a-3132-4efe-92da-07ca97304b78"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:46.209705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-2ea2f796-a0d5-4492-a26c-72d2f7347f19 req-faf18ef8-013f-4ce8-9d70-5968cb9887b1 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:46.210186 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-2ea2f796-a0d5-4492-a26c-72d2f7347f19 req-faf18ef8-013f-4ce8-9d70-5968cb9887b1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:46.210618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-2ea2f796-a0d5-4492-a26c-72d2f7347f19 req-faf18ef8-013f-4ce8-9d70-5968cb9887b1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:46.242880 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-2ea2f796-a0d5-4492-a26c-72d2f7347f19 req-faf18ef8-013f-4ce8-9d70-5968cb9887b1 service nova] Creating event network-changed:1b092d3a-3132-4efe-92da-07ca97304b78 for instance d54d09d0-a4be-4324-ae6e-c22ad671d008 on n-h2-856895-1 Sep 10 11:47:46.249517 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-2ea2f796-a0d5-4492-a26c-72d2f7347f19 req-faf18ef8-013f-4ce8-9d70-5968cb9887b1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068430 Sep 10 11:47:46.251256 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1082/2082] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:47:46.329298 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d37b6b1f-ac54-46f0-bc11-c29834021bc1 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:46.333470 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d37b6b1f-ac54-46f0-bc11-c29834021bc1 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: d54d09d0-a4be-4324-ae6e-c22ad671d008] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:46.345099 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d37b6b1f-ac54-46f0-bc11-c29834021bc1 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:46.347751 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d37b6b1f-ac54-46f0-bc11-c29834021bc1 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:46.348419 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d37b6b1f-ac54-46f0-bc11-c29834021bc1 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:46.350021 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d37b6b1f-ac54-46f0-bc11-c29834021bc1 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:46.351126 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d37b6b1f-ac54-46f0-bc11-c29834021bc1 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:46.351943 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d37b6b1f-ac54-46f0-bc11-c29834021bc1 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:46.473787 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=12 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:47:46.754146 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d37b6b1f-ac54-46f0-bc11-c29834021bc1 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:46.768713 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d37b6b1f-ac54-46f0-bc11-c29834021bc1 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/d54d09d0-a4be-4324-ae6e-c22ad671d008" status: 200 len: 1314 microversion: 2.1 time: 0.448184 Sep 10 11:47:46.783385 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1001/2083] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:46 2022] GET /compute/v2.1/servers/d54d09d0-a4be-4324-ae6e-c22ad671d008 => generated 1314 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:46.916938 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6afd6166-798f-4a76-b140-231d30385b0d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:46.917800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6afd6166-798f-4a76-b140-231d30385b0d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 785f3cc4-7418-4e67-b5e7-d37bb7a59919] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:46.927306 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6afd6166-798f-4a76-b140-231d30385b0d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:46.928052 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6afd6166-798f-4a76-b140-231d30385b0d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:46.928657 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6afd6166-798f-4a76-b140-231d30385b0d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:46.929558 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6afd6166-798f-4a76-b140-231d30385b0d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:46.930454 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6afd6166-798f-4a76-b140-231d30385b0d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:46.931048 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6afd6166-798f-4a76-b140-231d30385b0d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:47.414936 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6afd6166-798f-4a76-b140-231d30385b0d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:47.474898 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6afd6166-798f-4a76-b140-231d30385b0d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/785f3cc4-7418-4e67-b5e7-d37bb7a59919" status: 200 len: 1319 microversion: 2.1 time: 0.558660 Sep 10 11:47:47.488150 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1083/2084] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:46 2022] GET /compute/v2.1/servers/785f3cc4-7418-4e67-b5e7-d37bb7a59919 => generated 1319 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:47.792343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a234f054-e3f5-4dad-8092-09ab2648fc57 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:47.793198 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a234f054-e3f5-4dad-8092-09ab2648fc57 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: d54d09d0-a4be-4324-ae6e-c22ad671d008] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:47.807350 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a234f054-e3f5-4dad-8092-09ab2648fc57 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:47.809620 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a234f054-e3f5-4dad-8092-09ab2648fc57 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:47.810854 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a234f054-e3f5-4dad-8092-09ab2648fc57 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:47.812051 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a234f054-e3f5-4dad-8092-09ab2648fc57 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:47.812804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a234f054-e3f5-4dad-8092-09ab2648fc57 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:47.813349 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a234f054-e3f5-4dad-8092-09ab2648fc57 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:48.063924 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a234f054-e3f5-4dad-8092-09ab2648fc57 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:48.086960 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a234f054-e3f5-4dad-8092-09ab2648fc57 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/d54d09d0-a4be-4324-ae6e-c22ad671d008" status: 200 len: 1314 microversion: 2.1 time: 0.286356 Sep 10 11:47:48.105616 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1002/2085] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:47 2022] GET /compute/v2.1/servers/d54d09d0-a4be-4324-ae6e-c22ad671d008 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:48.510483 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d874d517-b06d-488e-b40a-62a2b4f10684 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:48.511891 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d874d517-b06d-488e-b40a-62a2b4f10684 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 785f3cc4-7418-4e67-b5e7-d37bb7a59919] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:48.537244 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d874d517-b06d-488e-b40a-62a2b4f10684 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:48.542455 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d874d517-b06d-488e-b40a-62a2b4f10684 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:48.543459 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d874d517-b06d-488e-b40a-62a2b4f10684 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:48.546086 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d874d517-b06d-488e-b40a-62a2b4f10684 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:48.550906 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d874d517-b06d-488e-b40a-62a2b4f10684 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:48.552644 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d874d517-b06d-488e-b40a-62a2b4f10684 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:48.801385 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d874d517-b06d-488e-b40a-62a2b4f10684 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:48.810666 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d874d517-b06d-488e-b40a-62a2b4f10684 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/785f3cc4-7418-4e67-b5e7-d37bb7a59919" status: 200 len: 1319 microversion: 2.1 time: 0.308656 Sep 10 11:47:48.811324 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1084/2086] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:48 2022] GET /compute/v2.1/servers/785f3cc4-7418-4e67-b5e7-d37bb7a59919 => generated 1319 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:49.009863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-9b468ee1-cbf3-4e89-8109-00f166b6ad80 req-03073ee5-5f0f-4da7-979b-c6ad4c1f39e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ebabc55-1b1d-4276-8bde-d8d4859d74fd", "name": "network-vif-plugged", "status": "completed", "tag": "679e3ac9-dc5d-4404-aa8b-99020ce86192"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:49.022583 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-9b468ee1-cbf3-4e89-8109-00f166b6ad80 req-03073ee5-5f0f-4da7-979b-c6ad4c1f39e7 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:49.023225 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-9b468ee1-cbf3-4e89-8109-00f166b6ad80 req-03073ee5-5f0f-4da7-979b-c6ad4c1f39e7 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:49.023748 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-9b468ee1-cbf3-4e89-8109-00f166b6ad80 req-03073ee5-5f0f-4da7-979b-c6ad4c1f39e7 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:49.041671 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-9b468ee1-cbf3-4e89-8109-00f166b6ad80 req-03073ee5-5f0f-4da7-979b-c6ad4c1f39e7 service nova] Creating event network-vif-plugged:679e3ac9-dc5d-4404-aa8b-99020ce86192 for instance 6ebabc55-1b1d-4276-8bde-d8d4859d74fd on n-h1-856895-1 Sep 10 11:47:49.046898 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-9b468ee1-cbf3-4e89-8109-00f166b6ad80 req-03073ee5-5f0f-4da7-979b-c6ad4c1f39e7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042781 Sep 10 11:47:49.047798 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1003/2087] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:47:49.135552 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d3f5ee2e-ef1b-4631-802b-19a8f9a9a79e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:49.136251 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d3f5ee2e-ef1b-4631-802b-19a8f9a9a79e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: d54d09d0-a4be-4324-ae6e-c22ad671d008] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:49.156433 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3f5ee2e-ef1b-4631-802b-19a8f9a9a79e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:49.158658 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3f5ee2e-ef1b-4631-802b-19a8f9a9a79e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:49.159292 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3f5ee2e-ef1b-4631-802b-19a8f9a9a79e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:49.176024 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3f5ee2e-ef1b-4631-802b-19a8f9a9a79e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:49.176785 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3f5ee2e-ef1b-4631-802b-19a8f9a9a79e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:49.177324 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3f5ee2e-ef1b-4631-802b-19a8f9a9a79e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:49.213186 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:47:49.608972 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d3f5ee2e-ef1b-4631-802b-19a8f9a9a79e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:49.623089 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d3f5ee2e-ef1b-4631-802b-19a8f9a9a79e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/d54d09d0-a4be-4324-ae6e-c22ad671d008" status: 200 len: 1314 microversion: 2.1 time: 0.508632 Sep 10 11:47:49.642631 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1085/2088] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:49 2022] GET /compute/v2.1/servers/d54d09d0-a4be-4324-ae6e-c22ad671d008 => generated 1314 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:49.835718 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ef52d738-4144-4bb1-86e0-4d5007ebbc4f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:49.836339 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ef52d738-4144-4bb1-86e0-4d5007ebbc4f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 785f3cc4-7418-4e67-b5e7-d37bb7a59919] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:49.844640 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ef52d738-4144-4bb1-86e0-4d5007ebbc4f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:49.845130 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ef52d738-4144-4bb1-86e0-4d5007ebbc4f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:49.845565 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ef52d738-4144-4bb1-86e0-4d5007ebbc4f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:49.846268 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ef52d738-4144-4bb1-86e0-4d5007ebbc4f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:49.847764 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ef52d738-4144-4bb1-86e0-4d5007ebbc4f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:49.848208 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ef52d738-4144-4bb1-86e0-4d5007ebbc4f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:50.129323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ef52d738-4144-4bb1-86e0-4d5007ebbc4f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:50.141563 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ef52d738-4144-4bb1-86e0-4d5007ebbc4f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/785f3cc4-7418-4e67-b5e7-d37bb7a59919" status: 200 len: 1319 microversion: 2.1 time: 0.310833 Sep 10 11:47:50.155390 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1004/2089] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:49 2022] GET /compute/v2.1/servers/785f3cc4-7418-4e67-b5e7-d37bb7a59919 => generated 1319 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:50.651121 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-582e3386-bb04-45c9-9de9-b8167358ab6e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:50.651787 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-582e3386-bb04-45c9-9de9-b8167358ab6e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: d54d09d0-a4be-4324-ae6e-c22ad671d008] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:50.655626 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=64 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:47:50.656926 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=16 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:47:50.665289 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-582e3386-bb04-45c9-9de9-b8167358ab6e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:50.666140 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-582e3386-bb04-45c9-9de9-b8167358ab6e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:50.666980 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-582e3386-bb04-45c9-9de9-b8167358ab6e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:50.668202 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-582e3386-bb04-45c9-9de9-b8167358ab6e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:50.669530 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-582e3386-bb04-45c9-9de9-b8167358ab6e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:50.670585 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-582e3386-bb04-45c9-9de9-b8167358ab6e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:51.132472 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-582e3386-bb04-45c9-9de9-b8167358ab6e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:51.145093 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-582e3386-bb04-45c9-9de9-b8167358ab6e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/d54d09d0-a4be-4324-ae6e-c22ad671d008" status: 200 len: 1314 microversion: 2.1 time: 0.497693 Sep 10 11:47:51.146115 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1086/2090] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:50 2022] GET /compute/v2.1/servers/d54d09d0-a4be-4324-ae6e-c22ad671d008 => generated 1314 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:51.167667 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-88856557-d9e4-4451-ada6-4c3bc37bc278 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:51.168913 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-88856557-d9e4-4451-ada6-4c3bc37bc278 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 785f3cc4-7418-4e67-b5e7-d37bb7a59919] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:51.177730 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-88856557-d9e4-4451-ada6-4c3bc37bc278 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:51.178474 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-88856557-d9e4-4451-ada6-4c3bc37bc278 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:51.179092 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-88856557-d9e4-4451-ada6-4c3bc37bc278 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:51.179992 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-88856557-d9e4-4451-ada6-4c3bc37bc278 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:51.181133 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-88856557-d9e4-4451-ada6-4c3bc37bc278 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:51.181730 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-88856557-d9e4-4451-ada6-4c3bc37bc278 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:51.493984 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-88856557-d9e4-4451-ada6-4c3bc37bc278 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:51.508324 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-88856557-d9e4-4451-ada6-4c3bc37bc278 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/785f3cc4-7418-4e67-b5e7-d37bb7a59919" status: 200 len: 1319 microversion: 2.1 time: 0.346053 Sep 10 11:47:51.510075 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1005/2091] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:51 2022] GET /compute/v2.1/servers/785f3cc4-7418-4e67-b5e7-d37bb7a59919 => generated 1319 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:51.769071 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-e27fd1ff-7b4b-4e8b-9bdc-5681a3774b73 req-3e7b7a40-d26b-4ad2-859e-be0c55161f00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "785f3cc4-7418-4e67-b5e7-d37bb7a59919", "tag": "77c98b43-bfc2-4abb-b50a-66f656d2b6e5"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:51.792190 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e27fd1ff-7b4b-4e8b-9bdc-5681a3774b73 req-3e7b7a40-d26b-4ad2-859e-be0c55161f00 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:51.794440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e27fd1ff-7b4b-4e8b-9bdc-5681a3774b73 req-3e7b7a40-d26b-4ad2-859e-be0c55161f00 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:51.799029 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e27fd1ff-7b4b-4e8b-9bdc-5681a3774b73 req-3e7b7a40-d26b-4ad2-859e-be0c55161f00 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:51.823769 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-e27fd1ff-7b4b-4e8b-9bdc-5681a3774b73 req-3e7b7a40-d26b-4ad2-859e-be0c55161f00 service nova] Creating event network-changed:77c98b43-bfc2-4abb-b50a-66f656d2b6e5 for instance 785f3cc4-7418-4e67-b5e7-d37bb7a59919 on n-h2-856895-1 Sep 10 11:47:51.838328 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-e27fd1ff-7b4b-4e8b-9bdc-5681a3774b73 req-3e7b7a40-d26b-4ad2-859e-be0c55161f00 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073392 Sep 10 11:47:51.839242 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1087/2092] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:47:52.169700 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-502bc2ca-30a8-4104-ba8b-2f5c3f5f5431 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:52.171072 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-502bc2ca-30a8-4104-ba8b-2f5c3f5f5431 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: d54d09d0-a4be-4324-ae6e-c22ad671d008] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:52.189689 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=11 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:47:52.201390 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-502bc2ca-30a8-4104-ba8b-2f5c3f5f5431 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:52.202172 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-502bc2ca-30a8-4104-ba8b-2f5c3f5f5431 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:52.202788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-502bc2ca-30a8-4104-ba8b-2f5c3f5f5431 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:52.203692 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-502bc2ca-30a8-4104-ba8b-2f5c3f5f5431 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:52.204303 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-502bc2ca-30a8-4104-ba8b-2f5c3f5f5431 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:52.205044 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-502bc2ca-30a8-4104-ba8b-2f5c3f5f5431 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:52.538918 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-08b88653-6274-4b91-ba08-6e0c9dde8022 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:52.539911 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-08b88653-6274-4b91-ba08-6e0c9dde8022 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 785f3cc4-7418-4e67-b5e7-d37bb7a59919] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:52.554238 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-08b88653-6274-4b91-ba08-6e0c9dde8022 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:52.558132 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-08b88653-6274-4b91-ba08-6e0c9dde8022 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:52.560103 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-08b88653-6274-4b91-ba08-6e0c9dde8022 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:52.561556 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-08b88653-6274-4b91-ba08-6e0c9dde8022 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:52.562475 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-08b88653-6274-4b91-ba08-6e0c9dde8022 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:52.564290 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-08b88653-6274-4b91-ba08-6e0c9dde8022 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:52.646547 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-502bc2ca-30a8-4104-ba8b-2f5c3f5f5431 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:52.680726 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-502bc2ca-30a8-4104-ba8b-2f5c3f5f5431 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/d54d09d0-a4be-4324-ae6e-c22ad671d008" status: 200 len: 1314 microversion: 2.1 time: 0.512896 Sep 10 11:47:52.693269 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1006/2093] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:52 2022] GET /compute/v2.1/servers/d54d09d0-a4be-4324-ae6e-c22ad671d008 => generated 1314 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:52.761852 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-bf4488cf-b5ac-42f5-999e-2b74ec14b290 req-c9b082b1-e089-4709-b066-2e7cdfe6bfd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d54d09d0-a4be-4324-ae6e-c22ad671d008", "name": "network-vif-plugged", "status": "completed", "tag": "1b092d3a-3132-4efe-92da-07ca97304b78"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:52.786978 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-bf4488cf-b5ac-42f5-999e-2b74ec14b290 req-c9b082b1-e089-4709-b066-2e7cdfe6bfd2 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:52.787818 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-bf4488cf-b5ac-42f5-999e-2b74ec14b290 req-c9b082b1-e089-4709-b066-2e7cdfe6bfd2 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:52.789173 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-bf4488cf-b5ac-42f5-999e-2b74ec14b290 req-c9b082b1-e089-4709-b066-2e7cdfe6bfd2 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:52.822988 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-bf4488cf-b5ac-42f5-999e-2b74ec14b290 req-c9b082b1-e089-4709-b066-2e7cdfe6bfd2 service nova] Creating event network-vif-plugged:1b092d3a-3132-4efe-92da-07ca97304b78 for instance d54d09d0-a4be-4324-ae6e-c22ad671d008 on n-h2-856895-1 Sep 10 11:47:52.860362 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-bf4488cf-b5ac-42f5-999e-2b74ec14b290 req-c9b082b1-e089-4709-b066-2e7cdfe6bfd2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100393 Sep 10 11:47:52.869467 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1007/2094] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:47:52.978228 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-08b88653-6274-4b91-ba08-6e0c9dde8022 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:52.994416 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-08b88653-6274-4b91-ba08-6e0c9dde8022 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/785f3cc4-7418-4e67-b5e7-d37bb7a59919" status: 200 len: 1319 microversion: 2.1 time: 0.462495 Sep 10 11:47:52.995767 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1088/2095] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:52 2022] GET /compute/v2.1/servers/785f3cc4-7418-4e67-b5e7-d37bb7a59919 => generated 1319 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:53.709914 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7e1b23f5-c8f1-4721-9d64-6a7ebc5274c7 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:53.710677 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7e1b23f5-c8f1-4721-9d64-6a7ebc5274c7 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: d54d09d0-a4be-4324-ae6e-c22ad671d008] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:53.723557 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7e1b23f5-c8f1-4721-9d64-6a7ebc5274c7 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:53.724108 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7e1b23f5-c8f1-4721-9d64-6a7ebc5274c7 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:53.724559 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7e1b23f5-c8f1-4721-9d64-6a7ebc5274c7 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:53.725338 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7e1b23f5-c8f1-4721-9d64-6a7ebc5274c7 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:53.725789 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7e1b23f5-c8f1-4721-9d64-6a7ebc5274c7 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:53.726221 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7e1b23f5-c8f1-4721-9d64-6a7ebc5274c7 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:53.879781 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-ecaf5e7f-6925-4915-8a61-22bff7077567 req-a6891407-0dc2-419b-9fba-2b7326d5f2a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49cfca02-b968-45e0-9b31-404eded0c6d2", "tag": "e51fd5a1-f40e-4a7e-a9ac-06c1f8dfb21d"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:53.896464 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-ecaf5e7f-6925-4915-8a61-22bff7077567 req-a6891407-0dc2-419b-9fba-2b7326d5f2a8 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:53.897381 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-ecaf5e7f-6925-4915-8a61-22bff7077567 req-a6891407-0dc2-419b-9fba-2b7326d5f2a8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:53.898093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-ecaf5e7f-6925-4915-8a61-22bff7077567 req-a6891407-0dc2-419b-9fba-2b7326d5f2a8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:53.915215 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-ecaf5e7f-6925-4915-8a61-22bff7077567 req-a6891407-0dc2-419b-9fba-2b7326d5f2a8 service nova] Creating event network-changed:e51fd5a1-f40e-4a7e-a9ac-06c1f8dfb21d for instance 49cfca02-b968-45e0-9b31-404eded0c6d2 on n-h1-856895-1 Sep 10 11:47:53.924619 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-ecaf5e7f-6925-4915-8a61-22bff7077567 req-a6891407-0dc2-419b-9fba-2b7326d5f2a8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050410 Sep 10 11:47:53.925672 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1089/2096] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:47:53.957861 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7e1b23f5-c8f1-4721-9d64-6a7ebc5274c7 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:53.974900 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7e1b23f5-c8f1-4721-9d64-6a7ebc5274c7 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/d54d09d0-a4be-4324-ae6e-c22ad671d008" status: 200 len: 1314 microversion: 2.1 time: 0.265889 Sep 10 11:47:53.976003 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1008/2097] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:53 2022] GET /compute/v2.1/servers/d54d09d0-a4be-4324-ae6e-c22ad671d008 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:54.022959 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-36c781b5-de9d-4b51-9d13-10d18ab13175 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:54.024583 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-36c781b5-de9d-4b51-9d13-10d18ab13175 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 785f3cc4-7418-4e67-b5e7-d37bb7a59919] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:54.034608 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36c781b5-de9d-4b51-9d13-10d18ab13175 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:54.035636 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36c781b5-de9d-4b51-9d13-10d18ab13175 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:54.037010 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36c781b5-de9d-4b51-9d13-10d18ab13175 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:54.038061 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36c781b5-de9d-4b51-9d13-10d18ab13175 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:54.038688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36c781b5-de9d-4b51-9d13-10d18ab13175 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:54.039424 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36c781b5-de9d-4b51-9d13-10d18ab13175 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:54.051146 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f1b084cc-f546-4a90-b59b-d4bb468b1faa tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:54.058111 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f1b084cc-f546-4a90-b59b-d4bb468b1faa tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:54.059100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f1b084cc-f546-4a90-b59b-d4bb468b1faa tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Searching by: {'deleted': False, 'project_id': '0bdddfac170d4386abaf77217e0f35c4'} {{(pid=128776) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 11:47:54.066194 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1b084cc-f546-4a90-b59b-d4bb468b1faa tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:54.066935 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1b084cc-f546-4a90-b59b-d4bb468b1faa tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:54.067672 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1b084cc-f546-4a90-b59b-d4bb468b1faa tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:54.068620 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1b084cc-f546-4a90-b59b-d4bb468b1faa tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:54.069329 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1b084cc-f546-4a90-b59b-d4bb468b1faa tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:54.069932 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1b084cc-f546-4a90-b59b-d4bb468b1faa tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:54.176020 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.multi_cell_list [None req-f1b084cc-f546-4a90-b59b-d4bb468b1faa tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128776) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 11:47:54.244907 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f1b084cc-f546-4a90-b59b-d4bb468b1faa tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.198445 Sep 10 11:47:54.245993 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1009/2098] 10.222.0.23 () {58 vars in 1125 bytes} [Sat Sep 10 11:47:54 2022] GET /compute/v2.1/servers => generated 344 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:47:54.261399 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2e27d6c4-d867-4ecc-ae98-dec1a603583a tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:54.267700 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2e27d6c4-d867-4ecc-ae98-dec1a603583a tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:54.269583 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2e27d6c4-d867-4ecc-ae98-dec1a603583a tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Searching by: {'deleted': False, 'project_id': '0bdddfac170d4386abaf77217e0f35c4'} {{(pid=128776) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 11:47:54.275894 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e27d6c4-d867-4ecc-ae98-dec1a603583a tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:54.276744 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e27d6c4-d867-4ecc-ae98-dec1a603583a tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:54.277421 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e27d6c4-d867-4ecc-ae98-dec1a603583a tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:54.278370 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e27d6c4-d867-4ecc-ae98-dec1a603583a tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:54.279012 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e27d6c4-d867-4ecc-ae98-dec1a603583a tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:54.279823 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e27d6c4-d867-4ecc-ae98-dec1a603583a tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:54.322568 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-36c781b5-de9d-4b51-9d13-10d18ab13175 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:54.340187 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-36c781b5-de9d-4b51-9d13-10d18ab13175 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/785f3cc4-7418-4e67-b5e7-d37bb7a59919" status: 200 len: 1319 microversion: 2.1 time: 0.318207 Sep 10 11:47:54.341600 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1090/2099] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:54 2022] GET /compute/v2.1/servers/785f3cc4-7418-4e67-b5e7-d37bb7a59919 => generated 1319 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:54.397446 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.multi_cell_list [None req-2e27d6c4-d867-4ecc-ae98-dec1a603583a tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128776) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 11:47:54.486103 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2e27d6c4-d867-4ecc-ae98-dec1a603583a tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:54.500720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e27d6c4-d867-4ecc-ae98-dec1a603583a tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:54.504013 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e27d6c4-d867-4ecc-ae98-dec1a603583a tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:54.504960 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e27d6c4-d867-4ecc-ae98-dec1a603583a tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:54.720280 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2e27d6c4-d867-4ecc-ae98-dec1a603583a tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 1607 microversion: 2.1 time: 0.463429 Sep 10 11:47:54.722937 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1010/2100] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:47:54 2022] GET /compute/v2.1/servers/detail => generated 1607 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:47:54.753620 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d1bb916b-535b-40fc-a552-8ae71e5194e4 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:54.766570 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d1bb916b-535b-40fc-a552-8ae71e5194e4 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021801 Sep 10 11:47:54.776086 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1091/2101] 10.222.0.23 () {58 vars in 1137 bytes} [Sat Sep 10 11:47:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:47:55.002654 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-583888a3-e081-4eee-9a50-0894cbd3dc3d tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:55.003880 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-583888a3-e081-4eee-9a50-0894cbd3dc3d tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: d54d09d0-a4be-4324-ae6e-c22ad671d008] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:55.012047 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-583888a3-e081-4eee-9a50-0894cbd3dc3d tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:55.012759 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-583888a3-e081-4eee-9a50-0894cbd3dc3d tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:55.013419 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-583888a3-e081-4eee-9a50-0894cbd3dc3d tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:55.014460 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-583888a3-e081-4eee-9a50-0894cbd3dc3d tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:55.016351 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-583888a3-e081-4eee-9a50-0894cbd3dc3d tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:55.016946 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-583888a3-e081-4eee-9a50-0894cbd3dc3d tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:55.347133 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a5f1101a-a1be-403e-bf5b-5d104d51a46b tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:55.348568 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a5f1101a-a1be-403e-bf5b-5d104d51a46b tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:55.365341 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5f1101a-a1be-403e-bf5b-5d104d51a46b tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:55.365954 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5f1101a-a1be-403e-bf5b-5d104d51a46b tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:55.366696 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5f1101a-a1be-403e-bf5b-5d104d51a46b tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:55.367559 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5f1101a-a1be-403e-bf5b-5d104d51a46b tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:55.368113 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5f1101a-a1be-403e-bf5b-5d104d51a46b tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:55.368743 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5f1101a-a1be-403e-bf5b-5d104d51a46b tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:55.399957 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a5f1101a-a1be-403e-bf5b-5d104d51a46b tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:47:55.467775 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-583888a3-e081-4eee-9a50-0894cbd3dc3d tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:55.480602 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-583888a3-e081-4eee-9a50-0894cbd3dc3d tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/d54d09d0-a4be-4324-ae6e-c22ad671d008" status: 200 len: 1314 microversion: 2.1 time: 0.480739 Sep 10 11:47:55.483409 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1011/2102] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:54 2022] GET /compute/v2.1/servers/d54d09d0-a4be-4324-ae6e-c22ad671d008 => generated 1314 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:55.510819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-38d7b40d-63aa-4fa0-b05e-8d8dcab39b7d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:55.512408 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-38d7b40d-63aa-4fa0-b05e-8d8dcab39b7d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 785f3cc4-7418-4e67-b5e7-d37bb7a59919] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:55.523768 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-38d7b40d-63aa-4fa0-b05e-8d8dcab39b7d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:55.524626 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-38d7b40d-63aa-4fa0-b05e-8d8dcab39b7d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:55.525451 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-38d7b40d-63aa-4fa0-b05e-8d8dcab39b7d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:55.526853 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-38d7b40d-63aa-4fa0-b05e-8d8dcab39b7d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:55.527650 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-38d7b40d-63aa-4fa0-b05e-8d8dcab39b7d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:55.528288 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-38d7b40d-63aa-4fa0-b05e-8d8dcab39b7d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:55.554979 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a5f1101a-a1be-403e-bf5b-5d104d51a46b tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 204 len: 0 microversion: 2.1 time: 0.213830 Sep 10 11:47:55.558624 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1092/2103] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:47:55 2022] DELETE /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:47:55.572896 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-62f47f7c-39c3-41aa-8a0b-83127fb4d3b4 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:55.573987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-62f47f7c-39c3-41aa-8a0b-83127fb4d3b4 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:55.582986 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-62f47f7c-39c3-41aa-8a0b-83127fb4d3b4 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:55.584300 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-62f47f7c-39c3-41aa-8a0b-83127fb4d3b4 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:55.584912 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-62f47f7c-39c3-41aa-8a0b-83127fb4d3b4 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:55.585868 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-62f47f7c-39c3-41aa-8a0b-83127fb4d3b4 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:55.586481 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-62f47f7c-39c3-41aa-8a0b-83127fb4d3b4 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:55.587664 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-62f47f7c-39c3-41aa-8a0b-83127fb4d3b4 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:56.124195 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-38d7b40d-63aa-4fa0-b05e-8d8dcab39b7d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:56.138488 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-62f47f7c-39c3-41aa-8a0b-83127fb4d3b4 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:56.148820 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-38d7b40d-63aa-4fa0-b05e-8d8dcab39b7d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/785f3cc4-7418-4e67-b5e7-d37bb7a59919" status: 200 len: 1319 microversion: 2.1 time: 0.652247 Sep 10 11:47:56.150811 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-62f47f7c-39c3-41aa-8a0b-83127fb4d3b4 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1610 microversion: 2.1 time: 0.586733 Sep 10 11:47:56.151445 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1093/2104] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:55 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1610 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:56.152822 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1012/2105] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:55 2022] GET /compute/v2.1/servers/785f3cc4-7418-4e67-b5e7-d37bb7a59919 => generated 1319 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:56.508996 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-02a41e0c-e940-4aa1-ba28-a6c0cd3dd0e4 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:56.509961 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-02a41e0c-e940-4aa1-ba28-a6c0cd3dd0e4 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: d54d09d0-a4be-4324-ae6e-c22ad671d008] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:56.524144 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02a41e0c-e940-4aa1-ba28-a6c0cd3dd0e4 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:56.526094 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02a41e0c-e940-4aa1-ba28-a6c0cd3dd0e4 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:56.528931 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02a41e0c-e940-4aa1-ba28-a6c0cd3dd0e4 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:56.529808 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02a41e0c-e940-4aa1-ba28-a6c0cd3dd0e4 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:56.531849 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02a41e0c-e940-4aa1-ba28-a6c0cd3dd0e4 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:56.537792 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02a41e0c-e940-4aa1-ba28-a6c0cd3dd0e4 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:56.555755 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8a1996f9-e530-4ca5-94f4-7a7193dcf3d0 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Action: 'update', calling method: .version_select at 0x7f40735815e0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:56.564531 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a1996f9-e530-4ca5-94f4-7a7193dcf3d0 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:56.567756 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a1996f9-e530-4ca5-94f4-7a7193dcf3d0 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:56.568299 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a1996f9-e530-4ca5-94f4-7a7193dcf3d0 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:56.603062 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a1996f9-e530-4ca5-94f4-7a7193dcf3d0 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:56.606253 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a1996f9-e530-4ca5-94f4-7a7193dcf3d0 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:56.606979 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a1996f9-e530-4ca5-94f4-7a7193dcf3d0 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:56.629395 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-8a1996f9-e530-4ca5-94f4-7a7193dcf3d0 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] HTTP exception thrown: Service f1274314-c1eb-4fc7-bbef-e5c33c25f651 could not be found. Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8a1996f9-e530-4ca5-94f4-7a7193dcf3d0 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Request method failure captured: Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: request: PUT /compute/v2.1/os-services/f1274314-c1eb-4fc7-bbef-e5c33c25f651 HTTP/1.1 Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 56 Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHlsKjqIqz8Z_9Aduw3hmkoMM1BEr5N2zGTIGlxPtlZ_VXHq4QDfCiaf7hzvVd-7fH3yx5wJ7zHpCbwZJZYOh_nW6wZUxcvszCCRjTSIUjfTQt6Lft21tDYlYk6aY4El2UqYscUKMDz0HQWVxPJ55eyC8oGyP1yMgcCLDB2EHgBgjiY Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: X-Openstack-Nova-Api-Version: 2.53 Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 8a315af3e95a453a8732671aae7cbe72 Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1039385288 Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,admin,member Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,admin,member Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a315af3e95a453a8732671aae7cbe72"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a315af3e95a453a8732671aae7cbe72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8a315af3e95a453a8732671aae7cbe72", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8a315af3e95a453a8732671aae7cbe72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1039385288 Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 8a315af3e95a453a8732671aae7cbe72 Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1039385288 Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 2b643d09598b46d48b2b3fb8c62eb7fc Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: {"status": "disabled", "disabled_reason": "maintenance"} Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: exception: Service f1274314-c1eb-4fc7-bbef-e5c33c25f651 could not be found. Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'f1274314-c1eb-4fc7-bbef-e5c33c25f651', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service f1274314-c1eb-4fc7-bbef-e5c33c25f651 could not be found. Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:47:56.632259 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:47:56.637245 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 10 11:47:56.637245 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:47:56.637245 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service f1274314-c1eb-4fc7-bbef-e5c33c25f651 could not be found. Sep 10 11:47:56.637245 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:56.637245 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:47:56.637245 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:56.637245 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:56.637245 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:47:56.637245 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:47:56.637245 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:47:56.637245 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:47:56.637245 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service f1274314-c1eb-4fc7-bbef-e5c33c25f651 could not be found. Sep 10 11:47:56.637245 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:56.637245 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8a1996f9-e530-4ca5-94f4-7a7193dcf3d0 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Returning 404 to user: Service f1274314-c1eb-4fc7-bbef-e5c33c25f651 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:47:56.637245 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8a1996f9-e530-4ca5-94f4-7a7193dcf3d0 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-services/f1274314-c1eb-4fc7-bbef-e5c33c25f651" status: 404 len: 110 microversion: 2.53 time: 0.273627 Sep 10 11:47:56.641995 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1094/2106] 10.222.0.23 () {62 vars in 1309 bytes} [Sat Sep 10 11:47:56 2022] PUT /compute/v2.1/os-services/f1274314-c1eb-4fc7-bbef-e5c33c25f651 => generated 110 bytes in 281 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:47:56.650224 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-395934c8-e6d4-44b4-9ea6-db3f878c273f tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Action: 'update', calling method: .version_select at 0x7f407369dd30>, body: {"status": "disabled"} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:56.659499 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-395934c8-e6d4-44b4-9ea6-db3f878c273f tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:56.660401 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-395934c8-e6d4-44b4-9ea6-db3f878c273f tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:56.661114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-395934c8-e6d4-44b4-9ea6-db3f878c273f tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:56.668868 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-395934c8-e6d4-44b4-9ea6-db3f878c273f tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:56.669584 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-395934c8-e6d4-44b4-9ea6-db3f878c273f tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:56.670113 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-395934c8-e6d4-44b4-9ea6-db3f878c273f tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:56.676785 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-395934c8-e6d4-44b4-9ea6-db3f878c273f tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] HTTP exception thrown: Service f1274314-c1eb-4fc7-bbef-e5c33c25f651 could not be found. Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-395934c8-e6d4-44b4-9ea6-db3f878c273f tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Request method failure captured: Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: request: PUT /compute/v2.1/os-services/f1274314-c1eb-4fc7-bbef-e5c33c25f651 HTTP/1.1 Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 22 Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHlsKjqIqz8Z_9Aduw3hmkoMM1BEr5N2zGTIGlxPtlZ_VXHq4QDfCiaf7hzvVd-7fH3yx5wJ7zHpCbwZJZYOh_nW6wZUxcvszCCRjTSIUjfTQt6Lft21tDYlYk6aY4El2UqYscUKMDz0HQWVxPJ55eyC8oGyP1yMgcCLDB2EHgBgjiY Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: X-Openstack-Nova-Api-Version: 2.53 Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 8a315af3e95a453a8732671aae7cbe72 Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1039385288 Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,admin,member Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,admin,member Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a315af3e95a453a8732671aae7cbe72"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a315af3e95a453a8732671aae7cbe72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8a315af3e95a453a8732671aae7cbe72", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8a315af3e95a453a8732671aae7cbe72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1039385288 Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 8a315af3e95a453a8732671aae7cbe72 Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1039385288 Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 2b643d09598b46d48b2b3fb8c62eb7fc Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: {"status": "disabled"} Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: exception: Service f1274314-c1eb-4fc7-bbef-e5c33c25f651 could not be found. Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'f1274314-c1eb-4fc7-bbef-e5c33c25f651', 'body': {'status': 'disabled'}} Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service f1274314-c1eb-4fc7-bbef-e5c33c25f651 could not be found. Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:47:56.678659 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:47:56.683328 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 10 11:47:56.683328 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:47:56.683328 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service f1274314-c1eb-4fc7-bbef-e5c33c25f651 could not be found. Sep 10 11:47:56.683328 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:56.683328 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:47:56.683328 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:56.683328 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:56.683328 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:47:56.683328 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:47:56.683328 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:47:56.683328 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:47:56.683328 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service f1274314-c1eb-4fc7-bbef-e5c33c25f651 could not be found. Sep 10 11:47:56.683328 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:56.683328 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-395934c8-e6d4-44b4-9ea6-db3f878c273f tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Returning 404 to user: Service f1274314-c1eb-4fc7-bbef-e5c33c25f651 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:47:56.684208 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-395934c8-e6d4-44b4-9ea6-db3f878c273f tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-services/f1274314-c1eb-4fc7-bbef-e5c33c25f651" status: 404 len: 110 microversion: 2.53 time: 0.039761 Sep 10 11:47:56.687330 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1095/2107] 10.222.0.23 () {62 vars in 1309 bytes} [Sat Sep 10 11:47:56 2022] PUT /compute/v2.1/os-services/f1274314-c1eb-4fc7-bbef-e5c33c25f651 => generated 110 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:47:56.698398 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3099c658-feaa-4456-9385-33773bdcda45 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Action: 'update', calling method: .version_select at 0x7f40735819d0>, body: {"status": "enabled"} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:56.708376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3099c658-feaa-4456-9385-33773bdcda45 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:56.708920 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3099c658-feaa-4456-9385-33773bdcda45 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:56.711523 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3099c658-feaa-4456-9385-33773bdcda45 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:56.719453 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3099c658-feaa-4456-9385-33773bdcda45 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:56.720392 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3099c658-feaa-4456-9385-33773bdcda45 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:56.722152 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3099c658-feaa-4456-9385-33773bdcda45 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:56.728920 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-3099c658-feaa-4456-9385-33773bdcda45 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] HTTP exception thrown: Service f1274314-c1eb-4fc7-bbef-e5c33c25f651 could not be found. Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3099c658-feaa-4456-9385-33773bdcda45 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Request method failure captured: Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: request: PUT /compute/v2.1/os-services/f1274314-c1eb-4fc7-bbef-e5c33c25f651 HTTP/1.1 Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 21 Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHlsKjqIqz8Z_9Aduw3hmkoMM1BEr5N2zGTIGlxPtlZ_VXHq4QDfCiaf7hzvVd-7fH3yx5wJ7zHpCbwZJZYOh_nW6wZUxcvszCCRjTSIUjfTQt6Lft21tDYlYk6aY4El2UqYscUKMDz0HQWVxPJ55eyC8oGyP1yMgcCLDB2EHgBgjiY Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: X-Openstack-Nova-Api-Version: 2.53 Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 8a315af3e95a453a8732671aae7cbe72 Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1039385288 Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,admin,member Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,admin,member Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a315af3e95a453a8732671aae7cbe72"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8a315af3e95a453a8732671aae7cbe72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8a315af3e95a453a8732671aae7cbe72", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8a315af3e95a453a8732671aae7cbe72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1039385288 Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 8a315af3e95a453a8732671aae7cbe72 Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1039385288 Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 2b643d09598b46d48b2b3fb8c62eb7fc Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: {"status": "enabled"} Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: exception: Service f1274314-c1eb-4fc7-bbef-e5c33c25f651 could not be found. Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'f1274314-c1eb-4fc7-bbef-e5c33c25f651', 'body': {'status': 'enabled'}} Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service f1274314-c1eb-4fc7-bbef-e5c33c25f651 could not be found. Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:47:56.731966 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:47:56.739423 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 10 11:47:56.739423 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:47:56.739423 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service f1274314-c1eb-4fc7-bbef-e5c33c25f651 could not be found. Sep 10 11:47:56.739423 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:56.739423 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:47:56.739423 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:56.739423 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:56.739423 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:47:56.739423 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:47:56.739423 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:47:56.739423 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:47:56.739423 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service f1274314-c1eb-4fc7-bbef-e5c33c25f651 could not be found. Sep 10 11:47:56.739423 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:56.742014 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3099c658-feaa-4456-9385-33773bdcda45 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Returning 404 to user: Service f1274314-c1eb-4fc7-bbef-e5c33c25f651 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:47:56.743066 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3099c658-feaa-4456-9385-33773bdcda45 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-services/f1274314-c1eb-4fc7-bbef-e5c33c25f651" status: 404 len: 110 microversion: 2.53 time: 0.050973 Sep 10 11:47:56.750293 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1096/2108] 10.222.0.23 () {62 vars in 1309 bytes} [Sat Sep 10 11:47:56 2022] PUT /compute/v2.1/os-services/f1274314-c1eb-4fc7-bbef-e5c33c25f651 => generated 110 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:47:56.758769 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3a1c5981-40ff-49ac-92d6-262c0114cb10 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:56.768122 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a1c5981-40ff-49ac-92d6-262c0114cb10 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:56.770079 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a1c5981-40ff-49ac-92d6-262c0114cb10 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:56.770930 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a1c5981-40ff-49ac-92d6-262c0114cb10 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:56.772005 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a1c5981-40ff-49ac-92d6-262c0114cb10 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:56.779497 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a1c5981-40ff-49ac-92d6-262c0114cb10 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:56.780228 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a1c5981-40ff-49ac-92d6-262c0114cb10 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:56.816148 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3a1c5981-40ff-49ac-92d6-262c0114cb10 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.063012 Sep 10 11:47:56.826180 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1097/2109] 10.222.0.23 () {60 vars in 1178 bytes} [Sat Sep 10 11:47:56 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:47:56.834091 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e15e469e-c1bf-498c-b01b-7479c8b9bf0d tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:56.845788 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e15e469e-c1bf-498c-b01b-7479c8b9bf0d tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:56.848472 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e15e469e-c1bf-498c-b01b-7479c8b9bf0d tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:56.849296 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e15e469e-c1bf-498c-b01b-7479c8b9bf0d tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:56.850284 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e15e469e-c1bf-498c-b01b-7479c8b9bf0d tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:56.851247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e15e469e-c1bf-498c-b01b-7479c8b9bf0d tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:56.852130 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e15e469e-c1bf-498c-b01b-7479c8b9bf0d tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:56.901046 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e15e469e-c1bf-498c-b01b-7479c8b9bf0d tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.073396 Sep 10 11:47:56.901669 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1098/2110] 10.222.0.23 () {60 vars in 1211 bytes} [Sat Sep 10 11:47:56 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:47:56.919797 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8132f3d8-f145-4051-b523-4ac5182c7669 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:56.923613 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8132f3d8-f145-4051-b523-4ac5182c7669 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:56.924075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8132f3d8-f145-4051-b523-4ac5182c7669 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:56.925733 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8132f3d8-f145-4051-b523-4ac5182c7669 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:56.926673 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8132f3d8-f145-4051-b523-4ac5182c7669 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:56.928371 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-02a41e0c-e940-4aa1-ba28-a6c0cd3dd0e4 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:56.928876 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8132f3d8-f145-4051-b523-4ac5182c7669 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:56.929980 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8132f3d8-f145-4051-b523-4ac5182c7669 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:56.942771 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-02a41e0c-e940-4aa1-ba28-a6c0cd3dd0e4 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/d54d09d0-a4be-4324-ae6e-c22ad671d008" status: 200 len: 1463 microversion: 2.1 time: 0.438033 Sep 10 11:47:56.944247 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1013/2111] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:56 2022] GET /compute/v2.1/servers/d54d09d0-a4be-4324-ae6e-c22ad671d008 => generated 1463 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:47:56.990965 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-abf613f8-05a1-410c-90b5-197e7cb370aa tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:56.993792 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-abf613f8-05a1-410c-90b5-197e7cb370aa tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:57.008306 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8132f3d8-f145-4051-b523-4ac5182c7669 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.092248 Sep 10 11:47:57.020094 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1099/2112] 10.222.0.23 () {60 vars in 1178 bytes} [Sat Sep 10 11:47:56 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:47:57.024479 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-abf613f8-05a1-410c-90b5-197e7cb370aa tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:57.025014 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-abf613f8-05a1-410c-90b5-197e7cb370aa tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:57.027720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-abf613f8-05a1-410c-90b5-197e7cb370aa tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:57.029284 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-abf613f8-05a1-410c-90b5-197e7cb370aa tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:57.029562 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3df63510-8a97-4c92-b63e-0705f2b03129 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:57.030100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-abf613f8-05a1-410c-90b5-197e7cb370aa tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:57.030758 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-abf613f8-05a1-410c-90b5-197e7cb370aa tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:57.036412 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3df63510-8a97-4c92-b63e-0705f2b03129 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:57.036972 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3df63510-8a97-4c92-b63e-0705f2b03129 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:57.037969 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3df63510-8a97-4c92-b63e-0705f2b03129 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:57.038755 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3df63510-8a97-4c92-b63e-0705f2b03129 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:57.042988 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3df63510-8a97-4c92-b63e-0705f2b03129 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:57.043582 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3df63510-8a97-4c92-b63e-0705f2b03129 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:57.091735 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3df63510-8a97-4c92-b63e-0705f2b03129 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=n-d-856895-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.068195 Sep 10 11:47:57.092886 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1100/2113] 10.222.0.23 () {60 vars in 1235 bytes} [Sat Sep 10 11:47:57 2022] GET /compute/v2.1/os-services?host=n-d-856895-1&binary=xxx => generated 16 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:47:57.110161 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-02baf848-2ae5-4196-8257-fddde99d8194 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:57.117312 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02baf848-2ae5-4196-8257-fddde99d8194 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:57.117981 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02baf848-2ae5-4196-8257-fddde99d8194 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:57.118607 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02baf848-2ae5-4196-8257-fddde99d8194 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:57.119621 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02baf848-2ae5-4196-8257-fddde99d8194 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:57.120299 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02baf848-2ae5-4196-8257-fddde99d8194 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:57.120961 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02baf848-2ae5-4196-8257-fddde99d8194 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:57.155819 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-02baf848-2ae5-4196-8257-fddde99d8194 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.051604 Sep 10 11:47:57.157270 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1101/2114] 10.222.0.23 () {60 vars in 1178 bytes} [Sat Sep 10 11:47:57 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:47:57.177432 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-aec58dbc-4830-4597-b538-d5ae109e2434 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:57.184266 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aec58dbc-4830-4597-b538-d5ae109e2434 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:57.184756 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aec58dbc-4830-4597-b538-d5ae109e2434 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:57.185396 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aec58dbc-4830-4597-b538-d5ae109e2434 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:57.186601 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aec58dbc-4830-4597-b538-d5ae109e2434 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:57.187456 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aec58dbc-4830-4597-b538-d5ae109e2434 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:57.188687 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aec58dbc-4830-4597-b538-d5ae109e2434 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:57.224318 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-aec58dbc-4830-4597-b538-d5ae109e2434 tempest-ServicesAdminNegativeV253TestJSON-1039385288 tempest-ServicesAdminNegativeV253TestJSON-1039385288-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.057260 Sep 10 11:47:57.225584 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1102/2115] 10.222.0.23 () {60 vars in 1239 bytes} [Sat Sep 10 11:47:57 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:47:57.231129 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-07e39ffb-c370-4133-aec0-b71726084d36 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:57.232009 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-07e39ffb-c370-4133-aec0-b71726084d36 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 785f3cc4-7418-4e67-b5e7-d37bb7a59919] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:57.241662 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-07e39ffb-c370-4133-aec0-b71726084d36 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:57.242441 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-07e39ffb-c370-4133-aec0-b71726084d36 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:57.243036 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-07e39ffb-c370-4133-aec0-b71726084d36 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:57.244060 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-07e39ffb-c370-4133-aec0-b71726084d36 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:57.244799 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-07e39ffb-c370-4133-aec0-b71726084d36 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:57.245413 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-07e39ffb-c370-4133-aec0-b71726084d36 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:57.615268 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-abf613f8-05a1-410c-90b5-197e7cb370aa tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:57.648267 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-abf613f8-05a1-410c-90b5-197e7cb370aa tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1463 microversion: 2.1 time: 0.669457 Sep 10 11:47:57.648901 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1014/2116] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:56 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1463 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:57.655557 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-07e39ffb-c370-4133-aec0-b71726084d36 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:57.660632 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f776d547-caba-4088-acd5-9bc7e610abf2 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:57.662252 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f776d547-caba-4088-acd5-9bc7e610abf2 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:57.664011 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-07e39ffb-c370-4133-aec0-b71726084d36 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/785f3cc4-7418-4e67-b5e7-d37bb7a59919" status: 200 len: 1319 microversion: 2.1 time: 0.437066 Sep 10 11:47:57.664599 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1103/2117] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:57 2022] GET /compute/v2.1/servers/785f3cc4-7418-4e67-b5e7-d37bb7a59919 => generated 1319 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:57.688476 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f776d547-caba-4088-acd5-9bc7e610abf2 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:57.689058 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f776d547-caba-4088-acd5-9bc7e610abf2 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:57.690079 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f776d547-caba-4088-acd5-9bc7e610abf2 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:57.691242 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f776d547-caba-4088-acd5-9bc7e610abf2 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:57.691615 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f776d547-caba-4088-acd5-9bc7e610abf2 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:57.692049 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f776d547-caba-4088-acd5-9bc7e610abf2 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:57.858922 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7757ac9c-d9bc-40c3-acb1-acc8a67f2f8f tempest-ServicesAdminNegativeV253TestJSON-1895081883 tempest-ServicesAdminNegativeV253TestJSON-1895081883-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:57.864721 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7757ac9c-d9bc-40c3-acb1-acc8a67f2f8f tempest-ServicesAdminNegativeV253TestJSON-1895081883 tempest-ServicesAdminNegativeV253TestJSON-1895081883-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'fd1b2743c46445bca6522d3f98f975b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '145f97949df94e9dac0de8d0145fdf32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7757ac9c-d9bc-40c3-acb1-acc8a67f2f8f tempest-ServicesAdminNegativeV253TestJSON-1895081883 tempest-ServicesAdminNegativeV253TestJSON-1895081883-project] Request method failure captured: Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHlrUOZV0knztjpQ6GyGDy1NStuH1Di_X_IaYtu6Lf7ta_VzLhQBKhbjmu_XwmSxsgqeQSSZJPY6-s_ToB_TaE_GZ3fhgmmmTg6tO7uz-nebxLyj6bc_3S_j1Xq-UqqYK_toF-uzrzdyQBNpqJLZBg76xtCOGvtw8867vm3ieD3vdjc Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: X-Openstack-Nova-Api-Version: 2.53 Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 145f97949df94e9dac0de8d0145fdf32 Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1895081883 Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/145f97949df94e9dac0de8d0145fdf32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/145f97949df94e9dac0de8d0145fdf32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_145f97949df94e9dac0de8d0145fdf32", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/145f97949df94e9dac0de8d0145fdf32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1895081883 Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 145f97949df94e9dac0de8d0145fdf32 Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1895081883 Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1895081883-project Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: fd1b2743c46445bca6522d3f98f975b3 Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1895081883-project Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: action_args: {} Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise self.value Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 10 11:47:57.867081 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 10 11:47:57.871284 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:57.871284 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:47:57.871284 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:57.871284 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:47:57.871284 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:47:57.871284 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:47:57.871284 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 10 11:47:57.871284 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 10 11:47:57.871284 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 10 11:47:57.871284 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:47:57.872894 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7757ac9c-d9bc-40c3-acb1-acc8a67f2f8f tempest-ServicesAdminNegativeV253TestJSON-1895081883 tempest-ServicesAdminNegativeV253TestJSON-1895081883-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:47:57.874048 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7757ac9c-d9bc-40c3-acb1-acc8a67f2f8f tempest-ServicesAdminNegativeV253TestJSON-1895081883 tempest-ServicesAdminNegativeV253TestJSON-1895081883-project] 10.222.0.23 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.205722 Sep 10 11:47:57.875091 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1104/2118] 10.222.0.23 () {60 vars in 1178 bytes} [Sat Sep 10 11:47:57 2022] GET /compute/v2.1/os-services => generated 112 bytes in 207 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:47:57.902146 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-41b113f8-2050-42c9-8764-7a22ead36eba tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-872994511", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "6ebabc55-1b1d-4276-8bde-d8d4859d74fd"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:58.010868 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-41b113f8-2050-42c9-8764-7a22ead36eba tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] validate_networks() for None {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:47:58.031256 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f776d547-caba-4088-acd5-9bc7e610abf2 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:58.045680 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f776d547-caba-4088-acd5-9bc7e610abf2 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1610 microversion: 2.1 time: 0.394698 Sep 10 11:47:58.048379 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1015/2119] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:57 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1610 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:58.594172 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-41b113f8-2050-42c9-8764-7a22ead36eba tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:47:58.594877 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-41b113f8-2050-42c9-8764-7a22ead36eba tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:47:58.597309 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-41b113f8-2050-42c9-8764-7a22ead36eba tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:47:58.598217 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-41b113f8-2050-42c9-8764-7a22ead36eba tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:47:58.598953 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-41b113f8-2050-42c9-8764-7a22ead36eba tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:47:58.620103 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-41b113f8-2050-42c9-8764-7a22ead36eba tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:58.620937 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-41b113f8-2050-42c9-8764-7a22ead36eba tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:58.621651 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-41b113f8-2050-42c9-8764-7a22ead36eba tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:58.624889 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-41b113f8-2050-42c9-8764-7a22ead36eba tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:58.625589 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-41b113f8-2050-42c9-8764-7a22ead36eba tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:58.626538 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-41b113f8-2050-42c9-8764-7a22ead36eba tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:58.670818 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-41b113f8-2050-42c9-8764-7a22ead36eba tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Getting quotas for project d8f6657b05bd48edbe73282147feee78. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:47:58.686537 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-41b113f8-2050-42c9-8764-7a22ead36eba tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Getting quotas for user 221c7c18d84c400388bd95cf28cf3e1a and project d8f6657b05bd48edbe73282147feee78. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:47:58.689564 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bff3e7a6-e252-465a-93fd-252e05124448 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:58.690227 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bff3e7a6-e252-465a-93fd-252e05124448 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 785f3cc4-7418-4e67-b5e7-d37bb7a59919] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:58.700923 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bff3e7a6-e252-465a-93fd-252e05124448 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:58.704586 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bff3e7a6-e252-465a-93fd-252e05124448 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:58.705344 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bff3e7a6-e252-465a-93fd-252e05124448 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:58.706925 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bff3e7a6-e252-465a-93fd-252e05124448 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:58.711324 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bff3e7a6-e252-465a-93fd-252e05124448 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:58.712047 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bff3e7a6-e252-465a-93fd-252e05124448 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:58.730856 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-41b113f8-2050-42c9-8764-7a22ead36eba tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:47:58.735938 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-41b113f8-2050-42c9-8764-7a22ead36eba tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 594465e4-0a38-4759-94be-9fbb40bdd824] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:47:58.826581 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-41b113f8-2050-42c9-8764-7a22ead36eba tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.928467 Sep 10 11:47:58.829351 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1105/2120] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:47:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:47:58.872114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3dc392ad-f803-40b4-a745-e1506675b1aa tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:58.876741 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3dc392ad-f803-40b4-a745-e1506675b1aa tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 594465e4-0a38-4759-94be-9fbb40bdd824] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:59.102108 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3dc392ad-f803-40b4-a745-e1506675b1aa tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:59.124120 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3dc392ad-f803-40b4-a745-e1506675b1aa tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/594465e4-0a38-4759-94be-9fbb40bdd824" status: 200 len: 1213 microversion: 2.1 time: 0.286523 Sep 10 11:47:59.128540 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1106/2121] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:58 2022] GET /compute/v2.1/servers/594465e4-0a38-4759-94be-9fbb40bdd824 => generated 1213 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:47:59.153895 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8e631d63-a8f0-453d-8245-5b754121007e tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:47:59.155627 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8e631d63-a8f0-453d-8245-5b754121007e tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:47:59.182771 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e631d63-a8f0-453d-8245-5b754121007e tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:59.185978 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e631d63-a8f0-453d-8245-5b754121007e tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:59.188040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e631d63-a8f0-453d-8245-5b754121007e tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:59.195602 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e631d63-a8f0-453d-8245-5b754121007e tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:59.196108 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e631d63-a8f0-453d-8245-5b754121007e tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:59.196567 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e631d63-a8f0-453d-8245-5b754121007e tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:59.495548 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bff3e7a6-e252-465a-93fd-252e05124448 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:47:59.500327 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:47:59.511293 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bff3e7a6-e252-465a-93fd-252e05124448 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/785f3cc4-7418-4e67-b5e7-d37bb7a59919" status: 200 len: 1319 microversion: 2.1 time: 0.825271 Sep 10 11:47:59.512829 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1016/2122] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:58 2022] GET /compute/v2.1/servers/785f3cc4-7418-4e67-b5e7-d37bb7a59919 => generated 1319 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:47:59.528420 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-505f7b07-07aa-430c-b969-f8ce084ee7a5 req-5c4cfb86-7b03-4bce-bc15-6528461fc16b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "785f3cc4-7418-4e67-b5e7-d37bb7a59919", "name": "network-vif-plugged", "status": "completed", "tag": "77c98b43-bfc2-4abb-b50a-66f656d2b6e5"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:47:59.548344 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-505f7b07-07aa-430c-b969-f8ce084ee7a5 req-5c4cfb86-7b03-4bce-bc15-6528461fc16b service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:47:59.549160 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-505f7b07-07aa-430c-b969-f8ce084ee7a5 req-5c4cfb86-7b03-4bce-bc15-6528461fc16b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:47:59.550475 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-505f7b07-07aa-430c-b969-f8ce084ee7a5 req-5c4cfb86-7b03-4bce-bc15-6528461fc16b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:47:59.586243 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-505f7b07-07aa-430c-b969-f8ce084ee7a5 req-5c4cfb86-7b03-4bce-bc15-6528461fc16b service nova] Creating event network-vif-plugged:77c98b43-bfc2-4abb-b50a-66f656d2b6e5 for instance 785f3cc4-7418-4e67-b5e7-d37bb7a59919 on n-h2-856895-1 Sep 10 11:47:59.600075 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-505f7b07-07aa-430c-b969-f8ce084ee7a5 req-5c4cfb86-7b03-4bce-bc15-6528461fc16b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085477 Sep 10 11:47:59.601022 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1017/2123] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:48:00.154062 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8a89ab75-6d46-434f-b260-e57d865f26e8 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:00.155526 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8a89ab75-6d46-434f-b260-e57d865f26e8 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 594465e4-0a38-4759-94be-9fbb40bdd824] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:00.168146 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a89ab75-6d46-434f-b260-e57d865f26e8 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:00.168638 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a89ab75-6d46-434f-b260-e57d865f26e8 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:00.169076 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a89ab75-6d46-434f-b260-e57d865f26e8 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:00.169788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a89ab75-6d46-434f-b260-e57d865f26e8 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:00.176091 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a89ab75-6d46-434f-b260-e57d865f26e8 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:00.176689 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a89ab75-6d46-434f-b260-e57d865f26e8 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:00.531416 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8e631d63-a8f0-453d-8245-5b754121007e tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:00.541757 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8a89ab75-6d46-434f-b260-e57d865f26e8 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:00.553044 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8e631d63-a8f0-453d-8245-5b754121007e tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1610 microversion: 2.1 time: 1.417855 Sep 10 11:48:00.553401 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8a89ab75-6d46-434f-b260-e57d865f26e8 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/594465e4-0a38-4759-94be-9fbb40bdd824" status: 200 len: 1265 microversion: 2.1 time: 0.403908 Sep 10 11:48:00.554587 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1018/2124] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:00 2022] GET /compute/v2.1/servers/594465e4-0a38-4759-94be-9fbb40bdd824 => generated 1265 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:48:00.555903 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1107/2125] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:47:59 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1610 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:00.565098 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6a5d9225-629a-45f9-b01c-3f1c60f69612 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:00.566008 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6a5d9225-629a-45f9-b01c-3f1c60f69612 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 785f3cc4-7418-4e67-b5e7-d37bb7a59919] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:00.578968 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6a5d9225-629a-45f9-b01c-3f1c60f69612 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:00.579990 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6a5d9225-629a-45f9-b01c-3f1c60f69612 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:00.582065 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6a5d9225-629a-45f9-b01c-3f1c60f69612 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:00.583014 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6a5d9225-629a-45f9-b01c-3f1c60f69612 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:00.583704 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6a5d9225-629a-45f9-b01c-3f1c60f69612 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:00.584330 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6a5d9225-629a-45f9-b01c-3f1c60f69612 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:00.960829 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6a5d9225-629a-45f9-b01c-3f1c60f69612 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:00.979549 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6a5d9225-629a-45f9-b01c-3f1c60f69612 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/785f3cc4-7418-4e67-b5e7-d37bb7a59919" status: 200 len: 1319 microversion: 2.1 time: 0.422713 Sep 10 11:48:00.980589 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1019/2126] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:00 2022] GET /compute/v2.1/servers/785f3cc4-7418-4e67-b5e7-d37bb7a59919 => generated 1319 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:01.578282 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ccf72f61-16aa-4dae-b57f-5c9239d64980 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:01.578921 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ccf72f61-16aa-4dae-b57f-5c9239d64980 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 594465e4-0a38-4759-94be-9fbb40bdd824] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:01.583320 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1ba73f0c-c51b-4953-a772-6f6dce33d300 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:01.583799 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1ba73f0c-c51b-4953-a772-6f6dce33d300 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:01.595014 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1ba73f0c-c51b-4953-a772-6f6dce33d300 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:01.596609 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ccf72f61-16aa-4dae-b57f-5c9239d64980 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:01.597634 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ccf72f61-16aa-4dae-b57f-5c9239d64980 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:01.598416 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ccf72f61-16aa-4dae-b57f-5c9239d64980 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:01.599404 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ccf72f61-16aa-4dae-b57f-5c9239d64980 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:01.599780 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1ba73f0c-c51b-4953-a772-6f6dce33d300 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:01.600412 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1ba73f0c-c51b-4953-a772-6f6dce33d300 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:01.600753 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ccf72f61-16aa-4dae-b57f-5c9239d64980 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:01.602726 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ccf72f61-16aa-4dae-b57f-5c9239d64980 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:01.603756 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1ba73f0c-c51b-4953-a772-6f6dce33d300 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:01.604244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1ba73f0c-c51b-4953-a772-6f6dce33d300 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:01.604690 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1ba73f0c-c51b-4953-a772-6f6dce33d300 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:01.903414 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1ba73f0c-c51b-4953-a772-6f6dce33d300 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:01.913305 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1ba73f0c-c51b-4953-a772-6f6dce33d300 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1542 microversion: 2.1 time: 0.335325 Sep 10 11:48:01.916043 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1020/2127] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:01 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1542 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:01.920478 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-2987c332-3bf6-4ad8-9ac8-4f9180ddbe09 req-ea5af23d-26e1-40bc-9c2d-94b1504f826a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49cfca02-b968-45e0-9b31-404eded0c6d2", "name": "network-vif-plugged", "status": "completed", "tag": "e51fd5a1-f40e-4a7e-a9ac-06c1f8dfb21d"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:48:01.933047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ccf72f61-16aa-4dae-b57f-5c9239d64980 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:01.948911 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ccf72f61-16aa-4dae-b57f-5c9239d64980 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/594465e4-0a38-4759-94be-9fbb40bdd824" status: 200 len: 1271 microversion: 2.1 time: 0.368800 Sep 10 11:48:01.950175 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1108/2128] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:01 2022] GET /compute/v2.1/servers/594465e4-0a38-4759-94be-9fbb40bdd824 => generated 1271 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:01.966389 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-2987c332-3bf6-4ad8-9ac8-4f9180ddbe09 req-ea5af23d-26e1-40bc-9c2d-94b1504f826a service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:01.966890 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-2987c332-3bf6-4ad8-9ac8-4f9180ddbe09 req-ea5af23d-26e1-40bc-9c2d-94b1504f826a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:01.967432 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-2987c332-3bf6-4ad8-9ac8-4f9180ddbe09 req-ea5af23d-26e1-40bc-9c2d-94b1504f826a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:01.992184 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-2987c332-3bf6-4ad8-9ac8-4f9180ddbe09 req-ea5af23d-26e1-40bc-9c2d-94b1504f826a service nova] Creating event network-vif-plugged:e51fd5a1-f40e-4a7e-a9ac-06c1f8dfb21d for instance 49cfca02-b968-45e0-9b31-404eded0c6d2 on n-h1-856895-1 Sep 10 11:48:02.003423 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-2987c332-3bf6-4ad8-9ac8-4f9180ddbe09 req-ea5af23d-26e1-40bc-9c2d-94b1504f826a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085689 Sep 10 11:48:02.008235 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1021/2129] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:48:02.024163 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-84145494-8981-475e-a4fd-87c7a65f2984 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:02.029488 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-84145494-8981-475e-a4fd-87c7a65f2984 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 785f3cc4-7418-4e67-b5e7-d37bb7a59919] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:02.053387 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-84145494-8981-475e-a4fd-87c7a65f2984 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:02.055340 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-84145494-8981-475e-a4fd-87c7a65f2984 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:02.058314 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-84145494-8981-475e-a4fd-87c7a65f2984 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:02.060278 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-84145494-8981-475e-a4fd-87c7a65f2984 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:02.062156 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-84145494-8981-475e-a4fd-87c7a65f2984 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:02.062665 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-84145494-8981-475e-a4fd-87c7a65f2984 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:02.345087 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-84145494-8981-475e-a4fd-87c7a65f2984 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:02.357799 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-84145494-8981-475e-a4fd-87c7a65f2984 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/785f3cc4-7418-4e67-b5e7-d37bb7a59919" status: 200 len: 1469 microversion: 2.1 time: 0.355287 Sep 10 11:48:02.370701 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1109/2130] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:02 2022] GET /compute/v2.1/servers/785f3cc4-7418-4e67-b5e7-d37bb7a59919 => generated 1469 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:02.397518 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d08a3a57-2bb2-42b5-b6eb-a462fa81af6b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:02.400380 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d08a3a57-2bb2-42b5-b6eb-a462fa81af6b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 49cfca02-b968-45e0-9b31-404eded0c6d2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:02.428931 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d08a3a57-2bb2-42b5-b6eb-a462fa81af6b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:02.429781 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d08a3a57-2bb2-42b5-b6eb-a462fa81af6b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:02.432314 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d08a3a57-2bb2-42b5-b6eb-a462fa81af6b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:02.433071 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d08a3a57-2bb2-42b5-b6eb-a462fa81af6b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:02.433536 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d08a3a57-2bb2-42b5-b6eb-a462fa81af6b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:02.433962 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d08a3a57-2bb2-42b5-b6eb-a462fa81af6b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:02.662101 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-a893f582-8467-48b0-915e-95662973d701 req-26d2bbef-7383-4a2b-9839-37a1edbb1c0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d54e6606-e731-472f-a828-0b2778a3b642", "name": "network-vif-deleted", "tag": "8d303678-6914-42c7-92b8-39a1591b74c9"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:48:02.689259 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a893f582-8467-48b0-915e-95662973d701 req-26d2bbef-7383-4a2b-9839-37a1edbb1c0f service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:02.692412 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a893f582-8467-48b0-915e-95662973d701 req-26d2bbef-7383-4a2b-9839-37a1edbb1c0f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:02.694421 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a893f582-8467-48b0-915e-95662973d701 req-26d2bbef-7383-4a2b-9839-37a1edbb1c0f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:02.741649 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-a893f582-8467-48b0-915e-95662973d701 req-26d2bbef-7383-4a2b-9839-37a1edbb1c0f service nova] Creating event network-vif-deleted:8d303678-6914-42c7-92b8-39a1591b74c9 for instance d54e6606-e731-472f-a828-0b2778a3b642 on n-h1-856895-1 Sep 10 11:48:02.756771 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-a893f582-8467-48b0-915e-95662973d701 req-26d2bbef-7383-4a2b-9839-37a1edbb1c0f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102664 Sep 10 11:48:02.762089 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1110/2131] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:48:02.877998 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d08a3a57-2bb2-42b5-b6eb-a462fa81af6b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:02.888218 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d08a3a57-2bb2-42b5-b6eb-a462fa81af6b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/49cfca02-b968-45e0-9b31-404eded0c6d2" status: 200 len: 1319 microversion: 2.1 time: 0.497738 Sep 10 11:48:02.889659 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1022/2132] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:02 2022] GET /compute/v2.1/servers/49cfca02-b968-45e0-9b31-404eded0c6d2 => generated 1319 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:02.944327 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ccbff096-016c-4086-aa4d-6d66572b3920 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:02.945572 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ccbff096-016c-4086-aa4d-6d66572b3920 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:02.955002 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ccbff096-016c-4086-aa4d-6d66572b3920 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:02.958077 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ccbff096-016c-4086-aa4d-6d66572b3920 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:02.958740 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ccbff096-016c-4086-aa4d-6d66572b3920 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:02.960802 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ccbff096-016c-4086-aa4d-6d66572b3920 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:02.961315 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ccbff096-016c-4086-aa4d-6d66572b3920 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:02.961765 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ccbff096-016c-4086-aa4d-6d66572b3920 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:02.974821 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-390b789e-bf41-47cf-8b8a-0a74eef1bf60 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:02.975554 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-390b789e-bf41-47cf-8b8a-0a74eef1bf60 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 594465e4-0a38-4759-94be-9fbb40bdd824] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:02.986422 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-390b789e-bf41-47cf-8b8a-0a74eef1bf60 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:02.989920 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-390b789e-bf41-47cf-8b8a-0a74eef1bf60 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:02.990631 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-390b789e-bf41-47cf-8b8a-0a74eef1bf60 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:02.995117 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-390b789e-bf41-47cf-8b8a-0a74eef1bf60 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:02.995889 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-390b789e-bf41-47cf-8b8a-0a74eef1bf60 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:02.996544 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-390b789e-bf41-47cf-8b8a-0a74eef1bf60 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:03.216085 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-390b789e-bf41-47cf-8b8a-0a74eef1bf60 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:03.229825 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-390b789e-bf41-47cf-8b8a-0a74eef1bf60 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/594465e4-0a38-4759-94be-9fbb40bdd824" status: 200 len: 1271 microversion: 2.1 time: 0.259689 Sep 10 11:48:03.231043 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1023/2133] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:02 2022] GET /compute/v2.1/servers/594465e4-0a38-4759-94be-9fbb40bdd824 => generated 1271 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:03.471145 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1fff4a20-9bcb-49c8-bdff-06dbae0fe09e tempest-FlavorsV2NegativeTest-696087978 tempest-FlavorsV2NegativeTest-696087978-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:03.481301 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1fff4a20-9bcb-49c8-bdff-06dbae0fe09e tempest-FlavorsV2NegativeTest-696087978 tempest-FlavorsV2NegativeTest-696087978-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.248849 Sep 10 11:48:03.482332 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1024/2134] 10.222.0.23 () {58 vars in 1137 bytes} [Sat Sep 10 11:48:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:48:03.586617 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ccbff096-016c-4086-aa4d-6d66572b3920 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:03.595972 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ccbff096-016c-4086-aa4d-6d66572b3920 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1253 microversion: 2.1 time: 0.658706 Sep 10 11:48:03.600566 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1111/2135] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:02 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1253 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:03.916804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4bde978e-fdb3-4bfe-9f3d-55b682138bd1 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:03.918201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4bde978e-fdb3-4bfe-9f3d-55b682138bd1 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 49cfca02-b968-45e0-9b31-404eded0c6d2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:03.927404 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4bde978e-fdb3-4bfe-9f3d-55b682138bd1 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:03.928139 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4bde978e-fdb3-4bfe-9f3d-55b682138bd1 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:03.928784 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4bde978e-fdb3-4bfe-9f3d-55b682138bd1 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:03.929751 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4bde978e-fdb3-4bfe-9f3d-55b682138bd1 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:03.959047 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4bde978e-fdb3-4bfe-9f3d-55b682138bd1 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:03.959957 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4bde978e-fdb3-4bfe-9f3d-55b682138bd1 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:04.255221 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7106d143-9f41-4134-b116-0bb6278f73ea tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:04.255853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7106d143-9f41-4134-b116-0bb6278f73ea tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 594465e4-0a38-4759-94be-9fbb40bdd824] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:04.275446 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7106d143-9f41-4134-b116-0bb6278f73ea tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:04.277578 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7106d143-9f41-4134-b116-0bb6278f73ea tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:04.286875 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7106d143-9f41-4134-b116-0bb6278f73ea tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:04.287923 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7106d143-9f41-4134-b116-0bb6278f73ea tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:04.289869 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7106d143-9f41-4134-b116-0bb6278f73ea tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:04.295963 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7106d143-9f41-4134-b116-0bb6278f73ea tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:04.315682 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=4 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:48:04.374591 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:48:04.430788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4bde978e-fdb3-4bfe-9f3d-55b682138bd1 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:04.457082 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4bde978e-fdb3-4bfe-9f3d-55b682138bd1 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/49cfca02-b968-45e0-9b31-404eded0c6d2" status: 200 len: 1319 microversion: 2.1 time: 0.545338 Sep 10 11:48:04.469421 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1025/2136] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:03 2022] GET /compute/v2.1/servers/49cfca02-b968-45e0-9b31-404eded0c6d2 => generated 1319 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:04.631550 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8846f3c1-0955-45e6-afb9-a1f15c5a989b tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:04.632311 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8846f3c1-0955-45e6-afb9-a1f15c5a989b tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:04.634281 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:48:04.650078 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8846f3c1-0955-45e6-afb9-a1f15c5a989b tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:04.650586 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8846f3c1-0955-45e6-afb9-a1f15c5a989b tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:04.651034 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8846f3c1-0955-45e6-afb9-a1f15c5a989b tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:04.664156 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8846f3c1-0955-45e6-afb9-a1f15c5a989b tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:04.664668 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8846f3c1-0955-45e6-afb9-a1f15c5a989b tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:04.665153 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8846f3c1-0955-45e6-afb9-a1f15c5a989b tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:04.814119 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7106d143-9f41-4134-b116-0bb6278f73ea tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:04.823489 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7106d143-9f41-4134-b116-0bb6278f73ea tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/594465e4-0a38-4759-94be-9fbb40bdd824" status: 200 len: 1313 microversion: 2.1 time: 0.572374 Sep 10 11:48:04.826495 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1112/2137] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:04 2022] GET /compute/v2.1/servers/594465e4-0a38-4759-94be-9fbb40bdd824 => generated 1313 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:04.836706 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-139e8693-45c3-4d0e-9c7b-3944e7c86850 tempest-FlavorsV2NegativeTest-696087978 tempest-FlavorsV2NegativeTest-696087978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-2139428734", "imageRef": "a8dbc398-1efd-40cb-9a34-98f916d3c179", "flavorRef": "452"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:48:04.869867 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8846f3c1-0955-45e6-afb9-a1f15c5a989b tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:04.885201 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8846f3c1-0955-45e6-afb9-a1f15c5a989b tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1253 microversion: 2.1 time: 0.265522 Sep 10 11:48:04.891826 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1026/2138] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:04 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1253 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:04.963555 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-139e8693-45c3-4d0e-9c7b-3944e7c86850 tempest-FlavorsV2NegativeTest-696087978 tempest-FlavorsV2NegativeTest-696087978-project] validate_networks() for None {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:48:05.276784 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-139e8693-45c3-4d0e-9c7b-3944e7c86850 tempest-FlavorsV2NegativeTest-696087978 tempest-FlavorsV2NegativeTest-696087978-project] HTTP exception thrown: Flavor's memory is too small for requested image. Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-139e8693-45c3-4d0e-9c7b-3944e7c86850 tempest-FlavorsV2NegativeTest-696087978 tempest-FlavorsV2NegativeTest-696087978-project] Request method failure captured: Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 143 Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHlzr50C3FSyPSL0NDqIm_6G2H1STy6xrm31H8ai6mKxXw1kpgoxiDC5t79W8JcVLTVJva7YEYtW6i87W5WvhS2y2vNbnjuos5gC08Jhk_q8WadLQZQJxVv_skmBM-Oht7546MBs25e0na3dLxH6NinpbJqWzFyOG8aWA3YnGbpqrpY Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: f42aada5c995430cb3882dad5308e372 Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-FlavorsV2NegativeTest-696087978 Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f42aada5c995430cb3882dad5308e372"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f42aada5c995430cb3882dad5308e372"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f42aada5c995430cb3882dad5308e372", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f42aada5c995430cb3882dad5308e372"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-FlavorsV2NegativeTest-696087978 Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: f42aada5c995430cb3882dad5308e372 Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-696087978 Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-FlavorsV2NegativeTest-696087978-project Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: a5a3c9102c86494c848e9c01da6aaaa5 Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-FlavorsV2NegativeTest-696087978-project Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-2139428734", "imageRef": "a8dbc398-1efd-40cb-9a34-98f916d3c179", "flavorRef": "452"}} Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: exception: Flavor's memory is too small for requested image. Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-2139428734', 'imageRef': 'a8dbc398-1efd-40cb-9a34-98f916d3c179', 'flavorRef': '452'}}} Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:48:05.279788 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:48:05.284793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:48:05.284793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:48:05.284793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 10 11:48:05.284793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Sep 10 11:48:05.284793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 10 11:48:05.284793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Sep 10 11:48:05.284793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:05.284793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:48:05.284793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:05.284793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:48:05.284793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:48:05.284793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:48:05.284793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:48:05.284793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:48:05.284793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Sep 10 11:48:05.284793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:05.287945 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-139e8693-45c3-4d0e-9c7b-3944e7c86850 tempest-FlavorsV2NegativeTest-696087978 tempest-FlavorsV2NegativeTest-696087978-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:48:05.289150 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-139e8693-45c3-4d0e-9c7b-3944e7c86850 tempest-FlavorsV2NegativeTest-696087978 tempest-FlavorsV2NegativeTest-696087978-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.461371 Sep 10 11:48:05.290066 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1113/2139] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:48:04 2022] POST /compute/v2.1/servers => generated 93 bytes in 463 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 10 11:48:05.485401 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9465f2eb-91ab-4b76-87d3-e05fb442ccc1 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:05.486036 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9465f2eb-91ab-4b76-87d3-e05fb442ccc1 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 49cfca02-b968-45e0-9b31-404eded0c6d2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:05.501642 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9465f2eb-91ab-4b76-87d3-e05fb442ccc1 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:05.502592 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9465f2eb-91ab-4b76-87d3-e05fb442ccc1 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:05.503686 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9465f2eb-91ab-4b76-87d3-e05fb442ccc1 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:05.504836 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9465f2eb-91ab-4b76-87d3-e05fb442ccc1 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:05.505457 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9465f2eb-91ab-4b76-87d3-e05fb442ccc1 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:05.506051 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9465f2eb-91ab-4b76-87d3-e05fb442ccc1 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:05.795358 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9465f2eb-91ab-4b76-87d3-e05fb442ccc1 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:05.808085 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9465f2eb-91ab-4b76-87d3-e05fb442ccc1 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/49cfca02-b968-45e0-9b31-404eded0c6d2" status: 200 len: 1469 microversion: 2.1 time: 0.327876 Sep 10 11:48:05.809177 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1027/2140] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:05 2022] GET /compute/v2.1/servers/49cfca02-b968-45e0-9b31-404eded0c6d2 => generated 1469 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:05.833570 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-86f119ba-11c0-4303-abb5-caea9edfb57b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:05.838819 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-86f119ba-11c0-4303-abb5-caea9edfb57b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:05.844867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-86f119ba-11c0-4303-abb5-caea9edfb57b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Searching by: {'reservation_id': 'r-r6rv158r', 'deleted': False, 'project_id': '5949225a72e649c1adc217d5a760460a'} {{(pid=128777) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 11:48:05.854065 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1b119bea-0a47-46e5-bf1f-531ccad0d866 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:05.854953 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1b119bea-0a47-46e5-bf1f-531ccad0d866 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 594465e4-0a38-4759-94be-9fbb40bdd824] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:05.857121 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-86f119ba-11c0-4303-abb5-caea9edfb57b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:05.857612 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-86f119ba-11c0-4303-abb5-caea9edfb57b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:05.858053 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-86f119ba-11c0-4303-abb5-caea9edfb57b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:05.858776 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-86f119ba-11c0-4303-abb5-caea9edfb57b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:05.863268 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-86f119ba-11c0-4303-abb5-caea9edfb57b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:05.863963 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-86f119ba-11c0-4303-abb5-caea9edfb57b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:05.864344 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1b119bea-0a47-46e5-bf1f-531ccad0d866 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:05.865035 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1b119bea-0a47-46e5-bf1f-531ccad0d866 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:05.865631 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1b119bea-0a47-46e5-bf1f-531ccad0d866 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:05.866595 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1b119bea-0a47-46e5-bf1f-531ccad0d866 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:05.867234 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1b119bea-0a47-46e5-bf1f-531ccad0d866 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:05.867829 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1b119bea-0a47-46e5-bf1f-531ccad0d866 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:06.054132 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.multi_cell_list [None req-86f119ba-11c0-4303-abb5-caea9edfb57b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128777) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 11:48:06.154058 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1b119bea-0a47-46e5-bf1f-531ccad0d866 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:06.160072 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-86f119ba-11c0-4303-abb5-caea9edfb57b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:06.162682 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1b119bea-0a47-46e5-bf1f-531ccad0d866 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/594465e4-0a38-4759-94be-9fbb40bdd824" status: 200 len: 1313 microversion: 2.1 time: 0.316000 Sep 10 11:48:06.165510 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1028/2141] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:05 2022] GET /compute/v2.1/servers/594465e4-0a38-4759-94be-9fbb40bdd824 => generated 1313 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:48:06.179795 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0e94d81d-1d6c-498a-bb26-e1080f2d3479 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:06.180508 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0e94d81d-1d6c-498a-bb26-e1080f2d3479 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:06.184395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-86f119ba-11c0-4303-abb5-caea9edfb57b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:06.184935 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-86f119ba-11c0-4303-abb5-caea9edfb57b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:06.185490 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-86f119ba-11c0-4303-abb5-caea9edfb57b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:06.186621 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e94d81d-1d6c-498a-bb26-e1080f2d3479 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:06.187108 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e94d81d-1d6c-498a-bb26-e1080f2d3479 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:06.187564 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e94d81d-1d6c-498a-bb26-e1080f2d3479 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:06.188428 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e94d81d-1d6c-498a-bb26-e1080f2d3479 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:06.188886 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e94d81d-1d6c-498a-bb26-e1080f2d3479 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:06.189310 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e94d81d-1d6c-498a-bb26-e1080f2d3479 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:06.355042 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0e94d81d-1d6c-498a-bb26-e1080f2d3479 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:06.370339 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0e94d81d-1d6c-498a-bb26-e1080f2d3479 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1253 microversion: 2.1 time: 0.198777 Sep 10 11:48:06.372298 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1029/2142] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:06 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1253 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:06.410936 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-86f119ba-11c0-4303-abb5-caea9edfb57b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?reservation_id=r-r6rv158r" status: 200 len: 2931 microversion: 2.1 time: 0.580876 Sep 10 11:48:06.412554 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1114/2143] 10.222.0.23 () {58 vars in 1197 bytes} [Sat Sep 10 11:48:05 2022] GET /compute/v2.1/servers/detail?reservation_id=r-r6rv158r => generated 2931 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:06.438182 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8307f478-f6f7-4670-9bc5-537811cb75c6 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:06.465375 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.compute.server_groups [None req-8307f478-f6f7-4670-9bc5-537811cb75c6 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Querying cell d31511aa-3734-4d55-9c57-4a88c62d4dfd(cell1) for 2 instances {{(pid=128776) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 10 11:48:06.466124 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8307f478-f6f7-4670-9bc5-537811cb75c6 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:06.466660 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8307f478-f6f7-4670-9bc5-537811cb75c6 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:06.467680 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8307f478-f6f7-4670-9bc5-537811cb75c6 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:06.516894 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8307f478-f6f7-4670-9bc5-537811cb75c6 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/cf98e173-04b2-4c6b-8f0c-384a6d2a36b1" status: 200 len: 271 microversion: 2.1 time: 0.083943 Sep 10 11:48:06.524014 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1030/2144] 10.222.0.23 () {58 vars in 1263 bytes} [Sat Sep 10 11:48:06 2022] GET /compute/v2.1/os-server-groups/cf98e173-04b2-4c6b-8f0c-384a6d2a36b1 => generated 271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:48:06.530284 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-09a4c98f-721a-450a-8b25-130f3cf7694c tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:06.531242 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-09a4c98f-721a-450a-8b25-130f3cf7694c tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] [instance: 785f3cc4-7418-4e67-b5e7-d37bb7a59919] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:06.539303 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-09a4c98f-721a-450a-8b25-130f3cf7694c tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:06.540232 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-09a4c98f-721a-450a-8b25-130f3cf7694c tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:06.540877 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-09a4c98f-721a-450a-8b25-130f3cf7694c tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:06.541760 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-09a4c98f-721a-450a-8b25-130f3cf7694c tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:06.542392 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-09a4c98f-721a-450a-8b25-130f3cf7694c tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:06.542994 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-09a4c98f-721a-450a-8b25-130f3cf7694c tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:06.801708 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-09a4c98f-721a-450a-8b25-130f3cf7694c tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/785f3cc4-7418-4e67-b5e7-d37bb7a59919" status: 200 len: 1620 microversion: 2.1 time: 0.275713 Sep 10 11:48:06.802864 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1115/2145] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:06 2022] GET /compute/v2.1/servers/785f3cc4-7418-4e67-b5e7-d37bb7a59919 => generated 1620 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:06.825381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fdbe7637-f6bb-44bf-ac64-702d35740da8 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:06.826384 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fdbe7637-f6bb-44bf-ac64-702d35740da8 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] [instance: 49cfca02-b968-45e0-9b31-404eded0c6d2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:06.834174 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fdbe7637-f6bb-44bf-ac64-702d35740da8 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:06.835054 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fdbe7637-f6bb-44bf-ac64-702d35740da8 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:06.835840 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fdbe7637-f6bb-44bf-ac64-702d35740da8 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:06.836745 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fdbe7637-f6bb-44bf-ac64-702d35740da8 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:06.837389 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fdbe7637-f6bb-44bf-ac64-702d35740da8 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:06.838008 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fdbe7637-f6bb-44bf-ac64-702d35740da8 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:07.103925 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fdbe7637-f6bb-44bf-ac64-702d35740da8 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/49cfca02-b968-45e0-9b31-404eded0c6d2" status: 200 len: 1620 microversion: 2.1 time: 0.282831 Sep 10 11:48:07.117730 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1031/2146] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:06 2022] GET /compute/v2.1/servers/49cfca02-b968-45e0-9b31-404eded0c6d2 => generated 1620 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:07.186533 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6cc7ab18-9e73-42d7-a54e-a63bd5a3a1a5 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:07.187454 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6cc7ab18-9e73-42d7-a54e-a63bd5a3a1a5 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 594465e4-0a38-4759-94be-9fbb40bdd824] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:07.198618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:48:07.200368 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6cc7ab18-9e73-42d7-a54e-a63bd5a3a1a5 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:07.200930 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6cc7ab18-9e73-42d7-a54e-a63bd5a3a1a5 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:07.201399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6cc7ab18-9e73-42d7-a54e-a63bd5a3a1a5 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:07.209051 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6cc7ab18-9e73-42d7-a54e-a63bd5a3a1a5 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:07.209548 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6cc7ab18-9e73-42d7-a54e-a63bd5a3a1a5 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:07.210000 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6cc7ab18-9e73-42d7-a54e-a63bd5a3a1a5 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:07.380214 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-66f32e0d-e519-4846-96b6-314d318408de tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-829869338", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "d89db381-1e9d-40ee-b076-b024d38d38b1"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:48:07.481696 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-66f32e0d-e519-4846-96b6-314d318408de tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] validate_networks() for None {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:48:07.916722 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6cc7ab18-9e73-42d7-a54e-a63bd5a3a1a5 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:07.930517 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6cc7ab18-9e73-42d7-a54e-a63bd5a3a1a5 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/594465e4-0a38-4759-94be-9fbb40bdd824" status: 200 len: 1313 microversion: 2.1 time: 0.748382 Sep 10 11:48:07.931118 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1116/2147] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:07 2022] GET /compute/v2.1/servers/594465e4-0a38-4759-94be-9fbb40bdd824 => generated 1313 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:07.943942 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-81ac99ee-457c-449e-a952-e6bc1ae5549e tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:07.944234 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-81ac99ee-457c-449e-a952-e6bc1ae5549e tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:07.965265 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-81ac99ee-457c-449e-a952-e6bc1ae5549e tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:07.969084 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-81ac99ee-457c-449e-a952-e6bc1ae5549e tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:07.970406 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-81ac99ee-457c-449e-a952-e6bc1ae5549e tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:07.975063 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-81ac99ee-457c-449e-a952-e6bc1ae5549e tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:07.977101 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-81ac99ee-457c-449e-a952-e6bc1ae5549e tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:07.977664 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-81ac99ee-457c-449e-a952-e6bc1ae5549e tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:08.129915 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-81ac99ee-457c-449e-a952-e6bc1ae5549e tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:08.147203 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-81ac99ee-457c-449e-a952-e6bc1ae5549e tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1253 microversion: 2.1 time: 0.214991 Sep 10 11:48:08.148444 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1117/2148] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:07 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1253 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:08.226856 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-fb105512-7aae-4081-8036-7716f598ee75 req-7f212071-08a9-4481-aeb0-05bf83ace370 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "594465e4-0a38-4759-94be-9fbb40bdd824", "tag": "c35a9766-d562-48d4-9a65-26a8d53718af"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:48:08.246648 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-fb105512-7aae-4081-8036-7716f598ee75 req-7f212071-08a9-4481-aeb0-05bf83ace370 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:08.249280 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-fb105512-7aae-4081-8036-7716f598ee75 req-7f212071-08a9-4481-aeb0-05bf83ace370 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:08.249908 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-fb105512-7aae-4081-8036-7716f598ee75 req-7f212071-08a9-4481-aeb0-05bf83ace370 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:08.275579 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-fb105512-7aae-4081-8036-7716f598ee75 req-7f212071-08a9-4481-aeb0-05bf83ace370 service nova] Creating event network-changed:c35a9766-d562-48d4-9a65-26a8d53718af for instance 594465e4-0a38-4759-94be-9fbb40bdd824 on n-h1-856895-1 Sep 10 11:48:08.301200 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-fb105512-7aae-4081-8036-7716f598ee75 req-7f212071-08a9-4481-aeb0-05bf83ace370 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077961 Sep 10 11:48:08.306204 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1118/2149] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:48:08.476552 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-66f32e0d-e519-4846-96b6-314d318408de tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:48:08.477378 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-66f32e0d-e519-4846-96b6-314d318408de tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:48:08.477873 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-66f32e0d-e519-4846-96b6-314d318408de tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:48:08.478342 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-66f32e0d-e519-4846-96b6-314d318408de tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:48:08.478775 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-66f32e0d-e519-4846-96b6-314d318408de tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:48:08.501671 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-66f32e0d-e519-4846-96b6-314d318408de tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:08.502198 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-66f32e0d-e519-4846-96b6-314d318408de tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:08.503269 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-66f32e0d-e519-4846-96b6-314d318408de tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:08.503862 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-66f32e0d-e519-4846-96b6-314d318408de tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:08.504322 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-66f32e0d-e519-4846-96b6-314d318408de tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:08.507392 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-66f32e0d-e519-4846-96b6-314d318408de tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:08.551823 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-66f32e0d-e519-4846-96b6-314d318408de tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Getting quotas for project 5949225a72e649c1adc217d5a760460a. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:48:08.566569 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-66f32e0d-e519-4846-96b6-314d318408de tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Getting quotas for user dfc33eb8645248f9b154587e7d8d449e and project 5949225a72e649c1adc217d5a760460a. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:48:08.599271 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-66f32e0d-e519-4846-96b6-314d318408de tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:48:08.606817 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-66f32e0d-e519-4846-96b6-314d318408de tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:48:08.731780 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-66f32e0d-e519-4846-96b6-314d318408de tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.353570 Sep 10 11:48:08.734227 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1032/2150] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:48:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1359 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 11:48:08.745576 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a06fc2f5-9dca-4f78-a63c-1140bd636c54 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:08.746329 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a06fc2f5-9dca-4f78-a63c-1140bd636c54 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:08.907286 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a06fc2f5-9dca-4f78-a63c-1140bd636c54 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:08.918206 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a06fc2f5-9dca-4f78-a63c-1140bd636c54 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2" status: 200 len: 1216 microversion: 2.1 time: 0.176833 Sep 10 11:48:08.920174 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1119/2151] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:08 2022] GET /compute/v2.1/servers/84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2 => generated 1216 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:08.958423 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ce468dec-dc9b-4d08-b64c-e4237c04b21f tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:08.959077 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ce468dec-dc9b-4d08-b64c-e4237c04b21f tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 594465e4-0a38-4759-94be-9fbb40bdd824] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:08.968363 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ce468dec-dc9b-4d08-b64c-e4237c04b21f tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:08.968991 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ce468dec-dc9b-4d08-b64c-e4237c04b21f tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:08.969300 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ce468dec-dc9b-4d08-b64c-e4237c04b21f tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:08.970004 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ce468dec-dc9b-4d08-b64c-e4237c04b21f tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:08.979885 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ce468dec-dc9b-4d08-b64c-e4237c04b21f tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:08.980352 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ce468dec-dc9b-4d08-b64c-e4237c04b21f tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:09.171008 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-38136917-1928-4e6f-9c2c-58904a7bec9c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:09.172076 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-38136917-1928-4e6f-9c2c-58904a7bec9c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:09.187015 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-38136917-1928-4e6f-9c2c-58904a7bec9c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:09.189724 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-38136917-1928-4e6f-9c2c-58904a7bec9c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:09.191914 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-38136917-1928-4e6f-9c2c-58904a7bec9c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:09.197536 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-38136917-1928-4e6f-9c2c-58904a7bec9c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:09.200163 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-38136917-1928-4e6f-9c2c-58904a7bec9c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:09.201798 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-38136917-1928-4e6f-9c2c-58904a7bec9c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:09.394438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-38136917-1928-4e6f-9c2c-58904a7bec9c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:09.403907 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-38136917-1928-4e6f-9c2c-58904a7bec9c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1253 microversion: 2.1 time: 0.237339 Sep 10 11:48:09.415414 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1120/2152] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:09 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1253 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:09.490811 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ce468dec-dc9b-4d08-b64c-e4237c04b21f tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:09.507022 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ce468dec-dc9b-4d08-b64c-e4237c04b21f tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/594465e4-0a38-4759-94be-9fbb40bdd824" status: 200 len: 1313 microversion: 2.1 time: 0.554166 Sep 10 11:48:09.509608 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1033/2153] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:08 2022] GET /compute/v2.1/servers/594465e4-0a38-4759-94be-9fbb40bdd824 => generated 1313 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:09.951611 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-476c2bd2-1228-47b7-b7b8-97d215ac7614 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:09.953208 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-476c2bd2-1228-47b7-b7b8-97d215ac7614 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:09.986253 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-476c2bd2-1228-47b7-b7b8-97d215ac7614 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:09.986780 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-476c2bd2-1228-47b7-b7b8-97d215ac7614 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:09.989078 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-476c2bd2-1228-47b7-b7b8-97d215ac7614 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:09.991497 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-476c2bd2-1228-47b7-b7b8-97d215ac7614 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:09.992992 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-476c2bd2-1228-47b7-b7b8-97d215ac7614 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:09.996642 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-476c2bd2-1228-47b7-b7b8-97d215ac7614 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:10.055789 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-679c68bd-ac15-4ba2-b593-66296d7b7ff8 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:10.056539 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-679c68bd-ac15-4ba2-b593-66296d7b7ff8 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:10.070568 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-679c68bd-ac15-4ba2-b593-66296d7b7ff8 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:10.072635 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-679c68bd-ac15-4ba2-b593-66296d7b7ff8 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:10.075043 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-679c68bd-ac15-4ba2-b593-66296d7b7ff8 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:10.077045 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-679c68bd-ac15-4ba2-b593-66296d7b7ff8 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:10.078926 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-679c68bd-ac15-4ba2-b593-66296d7b7ff8 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:10.080207 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-679c68bd-ac15-4ba2-b593-66296d7b7ff8 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:10.238233 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-476c2bd2-1228-47b7-b7b8-97d215ac7614 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:10.250199 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-476c2bd2-1228-47b7-b7b8-97d215ac7614 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2" status: 200 len: 1268 microversion: 2.1 time: 0.311080 Sep 10 11:48:10.251596 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1121/2154] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:09 2022] GET /compute/v2.1/servers/84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2 => generated 1268 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:10.435311 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4e109d28-752f-447d-8197-8e80f7485531 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:10.436149 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4e109d28-752f-447d-8197-8e80f7485531 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:10.480661 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e109d28-752f-447d-8197-8e80f7485531 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:10.484114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e109d28-752f-447d-8197-8e80f7485531 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:10.487806 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e109d28-752f-447d-8197-8e80f7485531 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:10.490335 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e109d28-752f-447d-8197-8e80f7485531 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:10.494051 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e109d28-752f-447d-8197-8e80f7485531 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:10.497131 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e109d28-752f-447d-8197-8e80f7485531 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:10.605602 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e109d28-752f-447d-8197-8e80f7485531 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:10.606106 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e109d28-752f-447d-8197-8e80f7485531 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:10.608778 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e109d28-752f-447d-8197-8e80f7485531 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:10.609269 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-4e109d28-752f-447d-8197-8e80f7485531 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lazy-loading 'fault' on Instance uuid d54e6606-e731-472f-a828-0b2778a3b642 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:48:10.947717 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4e109d28-752f-447d-8197-8e80f7485531 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:10.958439 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4e109d28-752f-447d-8197-8e80f7485531 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1258 microversion: 2.1 time: 0.529873 Sep 10 11:48:10.963319 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1122/2155] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:10 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1258 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:10.984495 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-58cde92d-823f-40bc-978a-54f0827bceda tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:10.985363 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-58cde92d-823f-40bc-978a-54f0827bceda tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 594465e4-0a38-4759-94be-9fbb40bdd824] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:10.992613 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-58cde92d-823f-40bc-978a-54f0827bceda tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:10.993338 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-58cde92d-823f-40bc-978a-54f0827bceda tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:10.994012 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-58cde92d-823f-40bc-978a-54f0827bceda tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:10.995012 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-58cde92d-823f-40bc-978a-54f0827bceda tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:10.995667 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-58cde92d-823f-40bc-978a-54f0827bceda tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:10.996256 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-58cde92d-823f-40bc-978a-54f0827bceda tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:11.058749 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-679c68bd-ac15-4ba2-b593-66296d7b7ff8 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:11.091944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-679c68bd-ac15-4ba2-b593-66296d7b7ff8 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:11.095919 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-679c68bd-ac15-4ba2-b593-66296d7b7ff8 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:11.097699 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-679c68bd-ac15-4ba2-b593-66296d7b7ff8 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 2948 microversion: 2.32 time: 1.046851 Sep 10 11:48:11.118236 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1034/2156] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:48:10 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 2948 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:48:11.140121 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8e518781-6271-43be-8957-248c64a66e0c tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:11.142199 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8e518781-6271-43be-8957-248c64a66e0c tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:11.151540 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e518781-6271-43be-8957-248c64a66e0c tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:11.152447 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e518781-6271-43be-8957-248c64a66e0c tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:11.153167 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e518781-6271-43be-8957-248c64a66e0c tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:11.154049 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e518781-6271-43be-8957-248c64a66e0c tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:11.154653 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e518781-6271-43be-8957-248c64a66e0c tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:11.155281 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e518781-6271-43be-8957-248c64a66e0c tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:11.452915 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8e518781-6271-43be-8957-248c64a66e0c tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.320357 Sep 10 11:48:11.454011 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1035/2157] 10.222.0.23 () {60 vars in 1316 bytes} [Sat Sep 10 11:48:11 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c/os-interface => generated 1832 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:48:11.466239 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1f5e9ed3-7d5b-4b0d-8202-eaedbb3c07b4 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:11.466923 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1f5e9ed3-7d5b-4b0d-8202-eaedbb3c07b4 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:11.477447 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f5e9ed3-7d5b-4b0d-8202-eaedbb3c07b4 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:11.480136 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f5e9ed3-7d5b-4b0d-8202-eaedbb3c07b4 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:11.480608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f5e9ed3-7d5b-4b0d-8202-eaedbb3c07b4 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:11.481348 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f5e9ed3-7d5b-4b0d-8202-eaedbb3c07b4 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:11.481814 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f5e9ed3-7d5b-4b0d-8202-eaedbb3c07b4 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:11.484583 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f5e9ed3-7d5b-4b0d-8202-eaedbb3c07b4 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:11.498806 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-58cde92d-823f-40bc-978a-54f0827bceda tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:11.507924 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-58cde92d-823f-40bc-978a-54f0827bceda tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/594465e4-0a38-4759-94be-9fbb40bdd824" status: 200 len: 1313 microversion: 2.1 time: 0.527388 Sep 10 11:48:11.525866 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1123/2158] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:10 2022] GET /compute/v2.1/servers/594465e4-0a38-4759-94be-9fbb40bdd824 => generated 1313 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:11.609451 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1f5e9ed3-7d5b-4b0d-8202-eaedbb3c07b4 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:11.619108 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1f5e9ed3-7d5b-4b0d-8202-eaedbb3c07b4 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2" status: 200 len: 1274 microversion: 2.1 time: 0.163797 Sep 10 11:48:11.619726 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1036/2159] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:11 2022] GET /compute/v2.1/servers/84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2 => generated 1274 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:11.986690 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5ee9302e-224a-4877-9459-1bf1804f8a19 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:11.987876 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5ee9302e-224a-4877-9459-1bf1804f8a19 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:12.001945 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ee9302e-224a-4877-9459-1bf1804f8a19 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:12.004007 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ee9302e-224a-4877-9459-1bf1804f8a19 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:12.013024 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ee9302e-224a-4877-9459-1bf1804f8a19 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:12.014066 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ee9302e-224a-4877-9459-1bf1804f8a19 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:12.014664 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ee9302e-224a-4877-9459-1bf1804f8a19 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:12.018078 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ee9302e-224a-4877-9459-1bf1804f8a19 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:12.088538 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ee9302e-224a-4877-9459-1bf1804f8a19 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:12.091437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ee9302e-224a-4877-9459-1bf1804f8a19 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:12.103530 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ee9302e-224a-4877-9459-1bf1804f8a19 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:12.104186 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-5ee9302e-224a-4877-9459-1bf1804f8a19 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lazy-loading 'fault' on Instance uuid d54e6606-e731-472f-a828-0b2778a3b642 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:48:12.254355 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5ee9302e-224a-4877-9459-1bf1804f8a19 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:12.266038 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5ee9302e-224a-4877-9459-1bf1804f8a19 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1258 microversion: 2.1 time: 0.283303 Sep 10 11:48:12.275871 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1124/2160] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:11 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1258 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:12.542603 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ef2a8001-3a45-4f07-b0af-3a0b87e4df13 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:12.543799 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ef2a8001-3a45-4f07-b0af-3a0b87e4df13 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 594465e4-0a38-4759-94be-9fbb40bdd824] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:12.566572 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ef2a8001-3a45-4f07-b0af-3a0b87e4df13 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:12.567798 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ef2a8001-3a45-4f07-b0af-3a0b87e4df13 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:12.569929 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ef2a8001-3a45-4f07-b0af-3a0b87e4df13 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:12.572209 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ef2a8001-3a45-4f07-b0af-3a0b87e4df13 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:12.572848 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ef2a8001-3a45-4f07-b0af-3a0b87e4df13 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:12.573971 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ef2a8001-3a45-4f07-b0af-3a0b87e4df13 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:12.586170 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:48:12.648856 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4e4ed72d-65ab-4a64-b723-13d308cf829b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:12.649667 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4e4ed72d-65ab-4a64-b723-13d308cf829b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:12.670642 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e4ed72d-65ab-4a64-b723-13d308cf829b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:12.676526 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e4ed72d-65ab-4a64-b723-13d308cf829b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:12.678581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e4ed72d-65ab-4a64-b723-13d308cf829b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:12.683707 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e4ed72d-65ab-4a64-b723-13d308cf829b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:12.684335 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e4ed72d-65ab-4a64-b723-13d308cf829b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:12.685028 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e4ed72d-65ab-4a64-b723-13d308cf829b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:13.180171 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4e4ed72d-65ab-4a64-b723-13d308cf829b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:13.188372 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4e4ed72d-65ab-4a64-b723-13d308cf829b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2" status: 200 len: 1316 microversion: 2.1 time: 0.548681 Sep 10 11:48:13.188952 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1125/2161] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:12 2022] GET /compute/v2.1/servers/84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2 => generated 1316 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:13.283412 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ef2a8001-3a45-4f07-b0af-3a0b87e4df13 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:13.300201 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ef2a8001-3a45-4f07-b0af-3a0b87e4df13 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/594465e4-0a38-4759-94be-9fbb40bdd824" status: 200 len: 1313 microversion: 2.1 time: 0.763944 Sep 10 11:48:13.314408 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fdedaa8d-0579-4866-856e-8bfba75a9b05 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:13.314408 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fdedaa8d-0579-4866-856e-8bfba75a9b05 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:13.316594 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1037/2162] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:12 2022] GET /compute/v2.1/servers/594465e4-0a38-4759-94be-9fbb40bdd824 => generated 1313 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:13.322722 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdedaa8d-0579-4866-856e-8bfba75a9b05 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:13.323672 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdedaa8d-0579-4866-856e-8bfba75a9b05 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:13.324346 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdedaa8d-0579-4866-856e-8bfba75a9b05 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:13.325622 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdedaa8d-0579-4866-856e-8bfba75a9b05 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:13.326652 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdedaa8d-0579-4866-856e-8bfba75a9b05 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:13.327261 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdedaa8d-0579-4866-856e-8bfba75a9b05 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:13.417826 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdedaa8d-0579-4866-856e-8bfba75a9b05 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:13.418642 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdedaa8d-0579-4866-856e-8bfba75a9b05 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:13.422696 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdedaa8d-0579-4866-856e-8bfba75a9b05 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:13.423766 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-fdedaa8d-0579-4866-856e-8bfba75a9b05 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lazy-loading 'fault' on Instance uuid d54e6606-e731-472f-a828-0b2778a3b642 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:48:13.739808 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fdedaa8d-0579-4866-856e-8bfba75a9b05 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27fa5fccb6d54dfc9f0125be9787b171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bdddfac170d4386abaf77217e0f35c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:13.756815 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fdedaa8d-0579-4866-856e-8bfba75a9b05 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 200 len: 1212 microversion: 2.1 time: 0.456150 Sep 10 11:48:13.778877 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1126/2163] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:13 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 1212 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:48:14.216459 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-55238e9c-6acf-49a2-8b9e-06547d4e65fa tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:14.217387 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-55238e9c-6acf-49a2-8b9e-06547d4e65fa tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:14.228952 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55238e9c-6acf-49a2-8b9e-06547d4e65fa tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:14.233020 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55238e9c-6acf-49a2-8b9e-06547d4e65fa tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:14.235550 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55238e9c-6acf-49a2-8b9e-06547d4e65fa tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:14.239958 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55238e9c-6acf-49a2-8b9e-06547d4e65fa tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:14.240567 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55238e9c-6acf-49a2-8b9e-06547d4e65fa tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:14.242391 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55238e9c-6acf-49a2-8b9e-06547d4e65fa tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:14.327472 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1ba13727-445a-4b3b-91cf-295727528a2a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:14.328754 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1ba13727-445a-4b3b-91cf-295727528a2a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 594465e4-0a38-4759-94be-9fbb40bdd824] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:14.344863 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ba13727-445a-4b3b-91cf-295727528a2a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:14.348112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ba13727-445a-4b3b-91cf-295727528a2a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:14.348846 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ba13727-445a-4b3b-91cf-295727528a2a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:14.349800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ba13727-445a-4b3b-91cf-295727528a2a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:14.351022 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ba13727-445a-4b3b-91cf-295727528a2a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:14.354301 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ba13727-445a-4b3b-91cf-295727528a2a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:14.939100 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1ba13727-445a-4b3b-91cf-295727528a2a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:14.948439 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-55238e9c-6acf-49a2-8b9e-06547d4e65fa tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:14.953069 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1ba13727-445a-4b3b-91cf-295727528a2a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/594465e4-0a38-4759-94be-9fbb40bdd824" status: 200 len: 1313 microversion: 2.1 time: 0.629682 Sep 10 11:48:14.954704 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1127/2164] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:14 2022] GET /compute/v2.1/servers/594465e4-0a38-4759-94be-9fbb40bdd824 => generated 1313 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:14.965243 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-55238e9c-6acf-49a2-8b9e-06547d4e65fa tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2" status: 200 len: 1316 microversion: 2.1 time: 0.753105 Sep 10 11:48:14.966317 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e176ad8e-c1f6-489c-9688-70ec10d4930c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:14.967027 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e176ad8e-c1f6-489c-9688-70ec10d4930c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] [instance: d54e6606-e731-472f-a828-0b2778a3b642] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:14.981839 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e176ad8e-c1f6-489c-9688-70ec10d4930c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:14.983310 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e176ad8e-c1f6-489c-9688-70ec10d4930c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:14.984563 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e176ad8e-c1f6-489c-9688-70ec10d4930c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:14.984742 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1038/2165] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:14 2022] GET /compute/v2.1/servers/84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2 => generated 1316 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:14.989121 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e176ad8e-c1f6-489c-9688-70ec10d4930c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:14.989121 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e176ad8e-c1f6-489c-9688-70ec10d4930c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:14.991519 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e176ad8e-c1f6-489c-9688-70ec10d4930c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:15.022227 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-e176ad8e-c1f6-489c-9688-70ec10d4930c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] HTTP exception thrown: Instance d54e6606-e731-472f-a828-0b2778a3b642 could not be found. Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e176ad8e-c1f6-489c-9688-70ec10d4930c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Request method failure captured: Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 HTTP/1.1 Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHjdfI4RhaaKvt9XZHW3zK22bK4a3CW4MyfSUQLsCqlz_PQPWHy27pwy0dPEQxKSJWcPANzD4cOVs2-s83_lx5HQKccDurrD8_VlplLwR-lsBGlGHNuQ1d5QtXGInUZPH3oLOb68Iu5wE_m_0pSfDxi7ki-gkGcuBCayw2c_CuKkr6M Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 0bdddfac170d4386abaf77217e0f35c4 Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersTestBootFromVolume-2001343771 Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0bdddfac170d4386abaf77217e0f35c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0bdddfac170d4386abaf77217e0f35c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0bdddfac170d4386abaf77217e0f35c4", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0bdddfac170d4386abaf77217e0f35c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersTestBootFromVolume-2001343771 Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 0bdddfac170d4386abaf77217e0f35c4 Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersTestBootFromVolume-2001343771 Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersTestBootFromVolume-2001343771-project Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 27fa5fccb6d54dfc9f0125be9787b171 Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersTestBootFromVolume-2001343771-project Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance d54e6606-e731-472f-a828-0b2778a3b642 could not be found. Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'd54e6606-e731-472f-a828-0b2778a3b642'} Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d54e6606-e731-472f-a828-0b2778a3b642 could not be found. Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d54e6606-e731-472f-a828-0b2778a3b642 could not be found. Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:48:15.029400 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:15.034727 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:48:15.034727 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:48:15.034727 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:48:15.034727 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:48:15.034727 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:48:15.034727 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d54e6606-e731-472f-a828-0b2778a3b642 could not be found. Sep 10 11:48:15.034727 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:15.038132 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e176ad8e-c1f6-489c-9688-70ec10d4930c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Returning 404 to user: Instance d54e6606-e731-472f-a828-0b2778a3b642 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:48:15.049998 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e176ad8e-c1f6-489c-9688-70ec10d4930c tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642" status: 404 len: 111 microversion: 2.1 time: 0.092315 Sep 10 11:48:15.056159 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1128/2166] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:14 2022] GET /compute/v2.1/servers/d54e6606-e731-472f-a828-0b2778a3b642 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:48:15.062309 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8070c341-4efb-4e1d-8a51-ae5f8a9ecfa4 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] Calling method '.version_select at 0x7f4072c78d30>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:15.074088 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:48:15.105423 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8070c341-4efb-4e1d-8a51-ae5f8a9ecfa4 tempest-ServersTestBootFromVolume-2001343771 tempest-ServersTestBootFromVolume-2001343771-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1969874413" status: 202 len: 0 microversion: 2.1 time: 0.046428 Sep 10 11:48:15.109246 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1039/2167] 10.222.0.23 () {58 vars in 1221 bytes} [Sat Sep 10 11:48:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1969874413 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:48:15.982272 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-85babf88-1a9d-4ca7-af61-8e91f07950a9 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:15.983054 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-85babf88-1a9d-4ca7-af61-8e91f07950a9 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 594465e4-0a38-4759-94be-9fbb40bdd824] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:15.986014 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=22 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:48:15.996912 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9be1eb81-37ae-493f-8b6f-0731885508ce tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:15.997540 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9be1eb81-37ae-493f-8b6f-0731885508ce tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:16.000417 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-85babf88-1a9d-4ca7-af61-8e91f07950a9 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:16.001129 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-85babf88-1a9d-4ca7-af61-8e91f07950a9 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:16.002178 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-85babf88-1a9d-4ca7-af61-8e91f07950a9 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:16.003096 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-85babf88-1a9d-4ca7-af61-8e91f07950a9 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:16.003767 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-85babf88-1a9d-4ca7-af61-8e91f07950a9 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:16.004377 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-85babf88-1a9d-4ca7-af61-8e91f07950a9 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:16.007191 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9be1eb81-37ae-493f-8b6f-0731885508ce tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:16.007702 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9be1eb81-37ae-493f-8b6f-0731885508ce tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:16.010080 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9be1eb81-37ae-493f-8b6f-0731885508ce tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:16.010889 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9be1eb81-37ae-493f-8b6f-0731885508ce tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:16.023547 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9be1eb81-37ae-493f-8b6f-0731885508ce tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:16.024104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9be1eb81-37ae-493f-8b6f-0731885508ce tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:16.420942 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-85babf88-1a9d-4ca7-af61-8e91f07950a9 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:16.431458 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-85babf88-1a9d-4ca7-af61-8e91f07950a9 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/594465e4-0a38-4759-94be-9fbb40bdd824" status: 200 len: 1313 microversion: 2.1 time: 0.453188 Sep 10 11:48:16.434048 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1129/2168] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:15 2022] GET /compute/v2.1/servers/594465e4-0a38-4759-94be-9fbb40bdd824 => generated 1313 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:16.591924 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9be1eb81-37ae-493f-8b6f-0731885508ce tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:16.615805 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9be1eb81-37ae-493f-8b6f-0731885508ce tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2" status: 200 len: 1316 microversion: 2.1 time: 0.622073 Sep 10 11:48:16.633604 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1040/2169] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:15 2022] GET /compute/v2.1/servers/84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2 => generated 1316 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:48:16.868528 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-85e0d9ad-af01-45dd-a053-efd243d78f6e req-96c56bd6-46aa-42c9-9860-f557fcdc79e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2", "tag": "61f70b54-b1c7-4797-8b2c-4ebeff0726b0"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:48:16.890516 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-85e0d9ad-af01-45dd-a053-efd243d78f6e req-96c56bd6-46aa-42c9-9860-f557fcdc79e5 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:16.891377 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-85e0d9ad-af01-45dd-a053-efd243d78f6e req-96c56bd6-46aa-42c9-9860-f557fcdc79e5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:16.892294 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-85e0d9ad-af01-45dd-a053-efd243d78f6e req-96c56bd6-46aa-42c9-9860-f557fcdc79e5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:16.913358 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-85e0d9ad-af01-45dd-a053-efd243d78f6e req-96c56bd6-46aa-42c9-9860-f557fcdc79e5 service nova] Creating event network-changed:61f70b54-b1c7-4797-8b2c-4ebeff0726b0 for instance 84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2 on n-h2-856895-1 Sep 10 11:48:16.920277 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-85e0d9ad-af01-45dd-a053-efd243d78f6e req-96c56bd6-46aa-42c9-9860-f557fcdc79e5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062358 Sep 10 11:48:16.921731 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1130/2170] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:48:17.422617 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-6c780fe3-e504-4bfb-9a62-d81eacea6729 req-23bd148b-5457-4616-b361-264af30f4e3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "594465e4-0a38-4759-94be-9fbb40bdd824", "name": "network-vif-plugged", "status": "completed", "tag": "c35a9766-d562-48d4-9a65-26a8d53718af"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:48:17.444152 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6c780fe3-e504-4bfb-9a62-d81eacea6729 req-23bd148b-5457-4616-b361-264af30f4e3b service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:17.444656 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6c780fe3-e504-4bfb-9a62-d81eacea6729 req-23bd148b-5457-4616-b361-264af30f4e3b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:17.446216 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6c780fe3-e504-4bfb-9a62-d81eacea6729 req-23bd148b-5457-4616-b361-264af30f4e3b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:17.465959 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-97743554-5281-4b7d-8017-2003aece185d tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:17.467340 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-97743554-5281-4b7d-8017-2003aece185d tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 594465e4-0a38-4759-94be-9fbb40bdd824] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:17.481280 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-6c780fe3-e504-4bfb-9a62-d81eacea6729 req-23bd148b-5457-4616-b361-264af30f4e3b service nova] Creating event network-vif-plugged:c35a9766-d562-48d4-9a65-26a8d53718af for instance 594465e4-0a38-4759-94be-9fbb40bdd824 on n-h1-856895-1 Sep 10 11:48:17.490994 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-97743554-5281-4b7d-8017-2003aece185d tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:17.493104 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-97743554-5281-4b7d-8017-2003aece185d tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:17.494858 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-97743554-5281-4b7d-8017-2003aece185d tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:17.497175 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-6c780fe3-e504-4bfb-9a62-d81eacea6729 req-23bd148b-5457-4616-b361-264af30f4e3b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078377 Sep 10 11:48:17.498605 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-97743554-5281-4b7d-8017-2003aece185d tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:17.500422 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-97743554-5281-4b7d-8017-2003aece185d tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:17.501997 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-97743554-5281-4b7d-8017-2003aece185d tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:17.502306 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1041/2171] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:48:17.520064 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=100 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:48:17.647396 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-91f9ed58-ffb3-4773-a805-8b5be2c36ecf tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:17.648276 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-91f9ed58-ffb3-4773-a805-8b5be2c36ecf tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:17.676763 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-91f9ed58-ffb3-4773-a805-8b5be2c36ecf tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:17.677556 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-91f9ed58-ffb3-4773-a805-8b5be2c36ecf tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:17.678198 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-91f9ed58-ffb3-4773-a805-8b5be2c36ecf tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:17.679238 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-91f9ed58-ffb3-4773-a805-8b5be2c36ecf tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:17.679843 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-91f9ed58-ffb3-4773-a805-8b5be2c36ecf tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:17.680378 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-91f9ed58-ffb3-4773-a805-8b5be2c36ecf tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:18.087666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-97743554-5281-4b7d-8017-2003aece185d tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:18.103876 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-97743554-5281-4b7d-8017-2003aece185d tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/594465e4-0a38-4759-94be-9fbb40bdd824" status: 200 len: 1313 microversion: 2.1 time: 0.647190 Sep 10 11:48:18.104669 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1131/2172] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:17 2022] GET /compute/v2.1/servers/594465e4-0a38-4759-94be-9fbb40bdd824 => generated 1313 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:18.265988 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-91f9ed58-ffb3-4773-a805-8b5be2c36ecf tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:18.286673 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-91f9ed58-ffb3-4773-a805-8b5be2c36ecf tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2" status: 200 len: 1316 microversion: 2.1 time: 0.641546 Sep 10 11:48:18.305704 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1042/2173] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:17 2022] GET /compute/v2.1/servers/84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2 => generated 1316 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:19.127284 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f91812ea-c21d-4fc3-9bb1-1becb60714c8 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:19.128283 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f91812ea-c21d-4fc3-9bb1-1becb60714c8 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 594465e4-0a38-4759-94be-9fbb40bdd824] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:19.131898 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=12 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:48:19.155368 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f91812ea-c21d-4fc3-9bb1-1becb60714c8 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:19.155971 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f91812ea-c21d-4fc3-9bb1-1becb60714c8 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:19.156508 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f91812ea-c21d-4fc3-9bb1-1becb60714c8 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:19.157282 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f91812ea-c21d-4fc3-9bb1-1becb60714c8 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:19.157807 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f91812ea-c21d-4fc3-9bb1-1becb60714c8 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:19.158291 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f91812ea-c21d-4fc3-9bb1-1becb60714c8 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:19.316145 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b4a0d0c4-2825-4ce6-842c-b177b3ea4f2a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:19.322475 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b4a0d0c4-2825-4ce6-842c-b177b3ea4f2a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:19.342069 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:48:19.343891 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:48:19.351481 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b4a0d0c4-2825-4ce6-842c-b177b3ea4f2a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:19.352177 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b4a0d0c4-2825-4ce6-842c-b177b3ea4f2a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:19.352935 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b4a0d0c4-2825-4ce6-842c-b177b3ea4f2a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:19.355141 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b4a0d0c4-2825-4ce6-842c-b177b3ea4f2a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:19.356974 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b4a0d0c4-2825-4ce6-842c-b177b3ea4f2a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:19.357693 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b4a0d0c4-2825-4ce6-842c-b177b3ea4f2a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:19.595929 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f91812ea-c21d-4fc3-9bb1-1becb60714c8 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:19.605439 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f91812ea-c21d-4fc3-9bb1-1becb60714c8 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/594465e4-0a38-4759-94be-9fbb40bdd824" status: 200 len: 1313 microversion: 2.1 time: 0.482023 Sep 10 11:48:19.610576 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1132/2174] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:19 2022] GET /compute/v2.1/servers/594465e4-0a38-4759-94be-9fbb40bdd824 => generated 1313 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:20.175142 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b4a0d0c4-2825-4ce6-842c-b177b3ea4f2a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:20.193941 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b4a0d0c4-2825-4ce6-842c-b177b3ea4f2a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2" status: 200 len: 1316 microversion: 2.1 time: 0.877623 Sep 10 11:48:20.211797 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1043/2175] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:19 2022] GET /compute/v2.1/servers/84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2 => generated 1316 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:48:20.648497 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d0163f95-a532-4bb0-a854-f723fe879091 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:20.650347 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d0163f95-a532-4bb0-a854-f723fe879091 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 594465e4-0a38-4759-94be-9fbb40bdd824] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:20.661370 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d0163f95-a532-4bb0-a854-f723fe879091 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:20.662682 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d0163f95-a532-4bb0-a854-f723fe879091 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:20.663427 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d0163f95-a532-4bb0-a854-f723fe879091 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:20.664421 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d0163f95-a532-4bb0-a854-f723fe879091 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:20.665393 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d0163f95-a532-4bb0-a854-f723fe879091 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:20.666046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d0163f95-a532-4bb0-a854-f723fe879091 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:21.220335 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f07f0c16-02dc-46ea-bab2-b6691d6487b3 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:21.221022 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f07f0c16-02dc-46ea-bab2-b6691d6487b3 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:21.236387 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f07f0c16-02dc-46ea-bab2-b6691d6487b3 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:21.237512 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f07f0c16-02dc-46ea-bab2-b6691d6487b3 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:21.238045 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f07f0c16-02dc-46ea-bab2-b6691d6487b3 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:21.238804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f07f0c16-02dc-46ea-bab2-b6691d6487b3 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:21.242067 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f07f0c16-02dc-46ea-bab2-b6691d6487b3 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:21.242533 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f07f0c16-02dc-46ea-bab2-b6691d6487b3 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:22.337189 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f07f0c16-02dc-46ea-bab2-b6691d6487b3 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:22.358727 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f07f0c16-02dc-46ea-bab2-b6691d6487b3 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2" status: 200 len: 1316 microversion: 2.1 time: 1.143983 Sep 10 11:48:22.359866 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1044/2176] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:21 2022] GET /compute/v2.1/servers/84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2 => generated 1316 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:22.420136 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d0163f95-a532-4bb0-a854-f723fe879091 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:22.429239 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d0163f95-a532-4bb0-a854-f723fe879091 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/594465e4-0a38-4759-94be-9fbb40bdd824" status: 200 len: 1463 microversion: 2.1 time: 1.797805 Sep 10 11:48:22.436251 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1133/2177] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:20 2022] GET /compute/v2.1/servers/594465e4-0a38-4759-94be-9fbb40bdd824 => generated 1463 bytes in 1806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:22.818197 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4d5721cf-ed84-40aa-9007-85ba33a02185 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:22.823991 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4d5721cf-ed84-40aa-9007-85ba33a02185 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Searching by: {'deleted': False, 'project_id': '50b46739feb14e9e81204eb3f496f09c'} {{(pid=128776) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 11:48:22.830094 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4d5721cf-ed84-40aa-9007-85ba33a02185 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:22.830573 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4d5721cf-ed84-40aa-9007-85ba33a02185 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:22.831755 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4d5721cf-ed84-40aa-9007-85ba33a02185 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:22.832719 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4d5721cf-ed84-40aa-9007-85ba33a02185 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:22.833174 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4d5721cf-ed84-40aa-9007-85ba33a02185 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:22.839320 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4d5721cf-ed84-40aa-9007-85ba33a02185 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:22.912468 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4d5721cf-ed84-40aa-9007-85ba33a02185 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.451358 Sep 10 11:48:22.913977 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1045/2178] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:48:22 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:48:22.937632 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-96f95e5d-de74-4868-ad03-5babe269c839 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:22.950115 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-96f95e5d-de74-4868-ad03-5babe269c839 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Searching by: {'deleted': False} {{(pid=128777) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 11:48:22.967704 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-96f95e5d-de74-4868-ad03-5babe269c839 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:22.968636 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-96f95e5d-de74-4868-ad03-5babe269c839 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:22.969237 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-96f95e5d-de74-4868-ad03-5babe269c839 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:22.972158 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-96f95e5d-de74-4868-ad03-5babe269c839 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:22.975335 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-96f95e5d-de74-4868-ad03-5babe269c839 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:22.976224 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-96f95e5d-de74-4868-ad03-5babe269c839 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:23.236724 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.multi_cell_list [None req-96f95e5d-de74-4868-ad03-5babe269c839 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Listed batch of 11 results from cell out of 1000 limit. Returned 11 total so far. {{(pid=128777) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 11:48:23.384192 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bac8cc87-7da6-41ac-b2fd-68e02b8970a8 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:23.384821 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bac8cc87-7da6-41ac-b2fd-68e02b8970a8 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:23.399217 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bac8cc87-7da6-41ac-b2fd-68e02b8970a8 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:23.399678 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bac8cc87-7da6-41ac-b2fd-68e02b8970a8 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:23.410218 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bac8cc87-7da6-41ac-b2fd-68e02b8970a8 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:23.410976 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bac8cc87-7da6-41ac-b2fd-68e02b8970a8 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:23.419321 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bac8cc87-7da6-41ac-b2fd-68e02b8970a8 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:23.421440 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bac8cc87-7da6-41ac-b2fd-68e02b8970a8 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:23.448723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-96f95e5d-de74-4868-ad03-5babe269c839 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:23.452669 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-96f95e5d-de74-4868-ad03-5babe269c839 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:23.453559 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-96f95e5d-de74-4868-ad03-5babe269c839 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:24.056278 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bac8cc87-7da6-41ac-b2fd-68e02b8970a8 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:24.067924 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bac8cc87-7da6-41ac-b2fd-68e02b8970a8 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2" status: 200 len: 1316 microversion: 2.1 time: 0.688519 Sep 10 11:48:24.070377 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1046/2179] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:23 2022] GET /compute/v2.1/servers/84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2 => generated 1316 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:24.629577 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-58c2dbd7-f867-442e-a926-b008fa2c0460 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-260592451", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "a31ea6ce-f247-4438-9f0b-5b6f6aa53a3b"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:48:24.731568 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-96f95e5d-de74-4868-ad03-5babe269c839 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 20222 microversion: 2.1 time: 1.797734 Sep 10 11:48:24.740615 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-58c2dbd7-f867-442e-a926-b008fa2c0460 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] validate_networks() for [('a31ea6ce-f247-4438-9f0b-5b6f6aa53a3b', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:48:24.745333 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1134/2180] 10.222.0.23 () {58 vars in 1171 bytes} [Sat Sep 10 11:48:22 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 20222 bytes in 1812 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:48:24.780534 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9b75f703-981c-4db1-a7f9-6d3f4a1c8538 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:24.785536 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9b75f703-981c-4db1-a7f9-6d3f4a1c8538 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Searching by: {'deleted': False, 'project_id': '50b46739feb14e9e81204eb3f496f09c'} {{(pid=128777) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 11:48:24.801095 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9b75f703-981c-4db1-a7f9-6d3f4a1c8538 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:24.801643 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9b75f703-981c-4db1-a7f9-6d3f4a1c8538 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:24.802084 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9b75f703-981c-4db1-a7f9-6d3f4a1c8538 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:24.802824 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9b75f703-981c-4db1-a7f9-6d3f4a1c8538 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:24.803312 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9b75f703-981c-4db1-a7f9-6d3f4a1c8538 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:24.806600 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9b75f703-981c-4db1-a7f9-6d3f4a1c8538 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:24.933792 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9b75f703-981c-4db1-a7f9-6d3f4a1c8538 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?tenant_id=d8f6657b05bd48edbe73282147feee78" status: 200 len: 15 microversion: 2.1 time: 0.156848 Sep 10 11:48:24.934888 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1135/2181] 10.222.0.23 () {58 vars in 1231 bytes} [Sat Sep 10 11:48:24 2022] GET /compute/v2.1/servers/detail?tenant_id=d8f6657b05bd48edbe73282147feee78 => generated 15 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 10 11:48:24.957905 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-efef3b54-d7a0-485e-9a83-f13f7b6856e0 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:24.969290 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-efef3b54-d7a0-485e-9a83-f13f7b6856e0 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Searching by: {'tenant_id': 'd8f6657b05bd48edbe73282147feee78', 'deleted': False} {{(pid=128777) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 11:48:24.988170 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-efef3b54-d7a0-485e-9a83-f13f7b6856e0 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:24.991559 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-efef3b54-d7a0-485e-9a83-f13f7b6856e0 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:24.999742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-efef3b54-d7a0-485e-9a83-f13f7b6856e0 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:25.000869 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-efef3b54-d7a0-485e-9a83-f13f7b6856e0 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:25.003795 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-efef3b54-d7a0-485e-9a83-f13f7b6856e0 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:25.004614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-efef3b54-d7a0-485e-9a83-f13f7b6856e0 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:25.058828 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.multi_cell_list [None req-efef3b54-d7a0-485e-9a83-f13f7b6856e0 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128777) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 11:48:25.235537 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-efef3b54-d7a0-485e-9a83-f13f7b6856e0 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:25.236031 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-efef3b54-d7a0-485e-9a83-f13f7b6856e0 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:25.236471 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-efef3b54-d7a0-485e-9a83-f13f7b6856e0 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:26.022453 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-58c2dbd7-f867-442e-a926-b008fa2c0460 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:48:26.022909 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-58c2dbd7-f867-442e-a926-b008fa2c0460 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:48:26.023445 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-58c2dbd7-f867-442e-a926-b008fa2c0460 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:48:26.023865 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-58c2dbd7-f867-442e-a926-b008fa2c0460 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:48:26.024348 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-58c2dbd7-f867-442e-a926-b008fa2c0460 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:48:26.042194 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-58c2dbd7-f867-442e-a926-b008fa2c0460 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:26.048297 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-58c2dbd7-f867-442e-a926-b008fa2c0460 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:26.048963 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-58c2dbd7-f867-442e-a926-b008fa2c0460 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:26.050175 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-58c2dbd7-f867-442e-a926-b008fa2c0460 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:26.050844 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-58c2dbd7-f867-442e-a926-b008fa2c0460 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:26.052249 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-58c2dbd7-f867-442e-a926-b008fa2c0460 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:26.066135 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-efef3b54-d7a0-485e-9a83-f13f7b6856e0 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=d8f6657b05bd48edbe73282147feee78" status: 200 len: 4825 microversion: 2.1 time: 1.113845 Sep 10 11:48:26.080791 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1136/2182] 10.222.0.23 () {58 vars in 1257 bytes} [Sat Sep 10 11:48:24 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=d8f6657b05bd48edbe73282147feee78 => generated 4825 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:26.099701 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-641e59e4-2e00-4e90-ae4a-bc9faf304c1c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:26.108086 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-641e59e4-2e00-4e90-ae4a-bc9faf304c1c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:26.108455 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-58c2dbd7-f867-442e-a926-b008fa2c0460 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Getting quotas for project 3e5d376048de4c3191a58a547e05fd07. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:48:26.120541 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-58c2dbd7-f867-442e-a926-b008fa2c0460 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Getting quotas for user 8ced1e84956246b6bb7384ba484fde54 and project 3e5d376048de4c3191a58a547e05fd07. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:48:26.124184 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-641e59e4-2e00-4e90-ae4a-bc9faf304c1c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:26.125265 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-641e59e4-2e00-4e90-ae4a-bc9faf304c1c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:26.128976 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-641e59e4-2e00-4e90-ae4a-bc9faf304c1c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:26.131491 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-641e59e4-2e00-4e90-ae4a-bc9faf304c1c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:26.131991 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-641e59e4-2e00-4e90-ae4a-bc9faf304c1c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:26.132438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-641e59e4-2e00-4e90-ae4a-bc9faf304c1c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:26.174279 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-58c2dbd7-f867-442e-a926-b008fa2c0460 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:48:26.189697 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-58c2dbd7-f867-442e-a926-b008fa2c0460 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:48:26.296618 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-58c2dbd7-f867-442e-a926-b008fa2c0460 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.769089 Sep 10 11:48:26.297507 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1047/2183] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:48:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 11:48:26.307315 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-08bf5e94-2bb9-41ee-8964-4c1f9a8a7614 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:26.338525 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-08bf5e94-2bb9-41ee-8964-4c1f9a8a7614 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Searching by: {'tenant_id': '50b46739feb14e9e81204eb3f496f09c', 'deleted': False} {{(pid=128776) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 11:48:26.378904 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-08bf5e94-2bb9-41ee-8964-4c1f9a8a7614 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:26.379730 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-08bf5e94-2bb9-41ee-8964-4c1f9a8a7614 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:26.380500 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-08bf5e94-2bb9-41ee-8964-4c1f9a8a7614 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:26.381438 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-08bf5e94-2bb9-41ee-8964-4c1f9a8a7614 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:26.382791 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-08bf5e94-2bb9-41ee-8964-4c1f9a8a7614 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:26.383427 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-08bf5e94-2bb9-41ee-8964-4c1f9a8a7614 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:26.463082 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-08bf5e94-2bb9-41ee-8964-4c1f9a8a7614 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=50b46739feb14e9e81204eb3f496f09c" status: 200 len: 15 microversion: 2.1 time: 0.164256 Sep 10 11:48:26.466793 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1048/2184] 10.222.0.23 () {58 vars in 1257 bytes} [Sat Sep 10 11:48:26 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=50b46739feb14e9e81204eb3f496f09c => generated 15 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:48:26.479273 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1dee1d24-198e-4883-a008-1c93f19bdd79 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:26.481812 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1dee1d24-198e-4883-a008-1c93f19bdd79 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:26.706562 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1dee1d24-198e-4883-a008-1c93f19bdd79 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:26.718857 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1dee1d24-198e-4883-a008-1c93f19bdd79 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 200 len: 1224 microversion: 2.1 time: 0.250359 Sep 10 11:48:26.719814 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1049/2185] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:26 2022] GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 1224 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:26.724401 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e8e96232-1f4d-4d14-aad0-a333bfdce7e5 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:26.732979 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-641e59e4-2e00-4e90-ae4a-bc9faf304c1c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:26.744419 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-641e59e4-2e00-4e90-ae4a-bc9faf304c1c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2" status: 200 len: 1316 microversion: 2.1 time: 0.661549 Sep 10 11:48:26.745012 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1137/2186] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:26 2022] GET /compute/v2.1/servers/84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2 => generated 1316 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:26.749401 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e8e96232-1f4d-4d14-aad0-a333bfdce7e5 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.028488 Sep 10 11:48:26.749968 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1050/2187] 10.222.0.23 () {58 vars in 1189 bytes} [Sat Sep 10 11:48:26 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:48:26.774442 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1c491a66-df96-4d8f-88dc-b089c4037ac9 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:48:26.777121 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1c491a66-df96-4d8f-88dc-b089c4037ac9 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:26.786143 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c491a66-df96-4d8f-88dc-b089c4037ac9 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:26.786924 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c491a66-df96-4d8f-88dc-b089c4037ac9 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:26.787565 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c491a66-df96-4d8f-88dc-b089c4037ac9 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:26.788996 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c491a66-df96-4d8f-88dc-b089c4037ac9 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:26.789696 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c491a66-df96-4d8f-88dc-b089c4037ac9 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:26.790292 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c491a66-df96-4d8f-88dc-b089c4037ac9 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:26.945036 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1c491a66-df96-4d8f-88dc-b089c4037ac9 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd/action" status: 202 len: 0 microversion: 2.1 time: 0.174655 Sep 10 11:48:26.946005 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1138/2188] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:48:26 2022] POST /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:48:26.957470 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-297566a1-f565-463a-b2a6-11e117873b09 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:26.967589 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-297566a1-f565-463a-b2a6-11e117873b09 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:26.974836 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-297566a1-f565-463a-b2a6-11e117873b09 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'd8f6657b05bd48edbe73282147feee78'} {{(pid=128776) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 11:48:26.988262 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-297566a1-f565-463a-b2a6-11e117873b09 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:26.989005 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-297566a1-f565-463a-b2a6-11e117873b09 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:26.990411 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-297566a1-f565-463a-b2a6-11e117873b09 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:26.991251 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-297566a1-f565-463a-b2a6-11e117873b09 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:26.994076 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-297566a1-f565-463a-b2a6-11e117873b09 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:26.995910 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-297566a1-f565-463a-b2a6-11e117873b09 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:27.183558 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.multi_cell_list [None req-297566a1-f565-463a-b2a6-11e117873b09 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128776) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 11:48:27.267320 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-297566a1-f565-463a-b2a6-11e117873b09 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.316648 Sep 10 11:48:27.276148 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1051/2189] 10.222.0.23 () {58 vars in 1150 bytes} [Sat Sep 10 11:48:26 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:48:27.282666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-82147d0b-6016-41a3-9752-e277cb4a8aa7 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:48:27.288671 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-82147d0b-6016-41a3-9752-e277cb4a8aa7 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:27.298993 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82147d0b-6016-41a3-9752-e277cb4a8aa7 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:27.299887 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82147d0b-6016-41a3-9752-e277cb4a8aa7 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:27.300856 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82147d0b-6016-41a3-9752-e277cb4a8aa7 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:27.301760 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82147d0b-6016-41a3-9752-e277cb4a8aa7 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:27.303984 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82147d0b-6016-41a3-9752-e277cb4a8aa7 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:27.304622 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82147d0b-6016-41a3-9752-e277cb4a8aa7 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:27.483778 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-82147d0b-6016-41a3-9752-e277cb4a8aa7 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd/action" status: 202 len: 0 microversion: 2.1 time: 0.206276 Sep 10 11:48:27.484686 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1139/2190] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:48:27 2022] POST /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 11:48:27.511575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0a521015-6fe6-4d7b-aa17-f05bc020290e tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:27.512414 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0a521015-6fe6-4d7b-aa17-f05bc020290e tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:27.532998 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0a521015-6fe6-4d7b-aa17-f05bc020290e tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:27.533501 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0a521015-6fe6-4d7b-aa17-f05bc020290e tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:27.534653 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0a521015-6fe6-4d7b-aa17-f05bc020290e tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:27.535421 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0a521015-6fe6-4d7b-aa17-f05bc020290e tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:27.535889 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0a521015-6fe6-4d7b-aa17-f05bc020290e tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:27.536326 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0a521015-6fe6-4d7b-aa17-f05bc020290e tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:27.751695 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-75788bb1-ef57-419f-8dc2-56b358d79732 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:27.752666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-75788bb1-ef57-419f-8dc2-56b358d79732 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:28.025275 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-75788bb1-ef57-419f-8dc2-56b358d79732 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:28.035684 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-75788bb1-ef57-419f-8dc2-56b358d79732 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 200 len: 1224 microversion: 2.1 time: 0.293406 Sep 10 11:48:28.036463 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1140/2191] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:27 2022] GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 1224 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:28.061856 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-231f951a-14a4-4312-9fd5-7395ef59b090 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:28.063066 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-231f951a-14a4-4312-9fd5-7395ef59b090 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:28.090291 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-231f951a-14a4-4312-9fd5-7395ef59b090 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:28.090814 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-231f951a-14a4-4312-9fd5-7395ef59b090 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:28.094347 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-231f951a-14a4-4312-9fd5-7395ef59b090 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:28.095498 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-231f951a-14a4-4312-9fd5-7395ef59b090 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:28.095982 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-231f951a-14a4-4312-9fd5-7395ef59b090 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:28.096594 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-231f951a-14a4-4312-9fd5-7395ef59b090 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:28.515066 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0a521015-6fe6-4d7b-aa17-f05bc020290e tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1614 microversion: 2.1 time: 1.025405 Sep 10 11:48:28.532302 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1052/2192] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:27 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1614 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:28.561697 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-14a6cb44-0e8d-4736-a26c-d69013240b8e req-519ff67a-d238-43be-870b-aab3d8a10033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2", "name": "network-vif-plugged", "status": "completed", "tag": "61f70b54-b1c7-4797-8b2c-4ebeff0726b0"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:48:28.584999 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-14a6cb44-0e8d-4736-a26c-d69013240b8e req-519ff67a-d238-43be-870b-aab3d8a10033 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:28.585480 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-14a6cb44-0e8d-4736-a26c-d69013240b8e req-519ff67a-d238-43be-870b-aab3d8a10033 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:28.588366 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-14a6cb44-0e8d-4736-a26c-d69013240b8e req-519ff67a-d238-43be-870b-aab3d8a10033 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:28.622419 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-14a6cb44-0e8d-4736-a26c-d69013240b8e req-519ff67a-d238-43be-870b-aab3d8a10033 service nova] Creating event network-vif-plugged:61f70b54-b1c7-4797-8b2c-4ebeff0726b0 for instance 84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2 on n-h2-856895-1 Sep 10 11:48:28.636544 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-14a6cb44-0e8d-4736-a26c-d69013240b8e req-519ff67a-d238-43be-870b-aab3d8a10033 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101745 Sep 10 11:48:28.637169 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1053/2193] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:48:28.649713 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e0e52e30-4c45-44a9-bef1-be5fc8a672c5 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:28.650485 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e0e52e30-4c45-44a9-bef1-be5fc8a672c5 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:28.688642 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e0e52e30-4c45-44a9-bef1-be5fc8a672c5 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:28.689697 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e0e52e30-4c45-44a9-bef1-be5fc8a672c5 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:28.690322 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e0e52e30-4c45-44a9-bef1-be5fc8a672c5 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:28.694123 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e0e52e30-4c45-44a9-bef1-be5fc8a672c5 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:28.697168 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e0e52e30-4c45-44a9-bef1-be5fc8a672c5 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:28.697668 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e0e52e30-4c45-44a9-bef1-be5fc8a672c5 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:28.726869 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-231f951a-14a4-4312-9fd5-7395ef59b090 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:28.737496 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-231f951a-14a4-4312-9fd5-7395ef59b090 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2" status: 200 len: 1316 microversion: 2.1 time: 0.699729 Sep 10 11:48:28.742008 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1141/2194] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:28 2022] GET /compute/v2.1/servers/84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2 => generated 1316 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:28.958793 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e0e52e30-4c45-44a9-bef1-be5fc8a672c5 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1614 microversion: 2.1 time: 0.320063 Sep 10 11:48:28.960031 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1054/2195] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:28 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1614 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:28.985139 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-200835d9-5e67-48f1-a8bc-d49c6a4e5797 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:28.999097 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-200835d9-5e67-48f1-a8bc-d49c6a4e5797 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Searching by: {'host': 'n-h1-856895-1', 'deleted': False} {{(pid=128777) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 11:48:29.014692 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-200835d9-5e67-48f1-a8bc-d49c6a4e5797 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:29.015200 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-200835d9-5e67-48f1-a8bc-d49c6a4e5797 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:29.015647 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-200835d9-5e67-48f1-a8bc-d49c6a4e5797 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:29.016385 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-200835d9-5e67-48f1-a8bc-d49c6a4e5797 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:29.016842 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-200835d9-5e67-48f1-a8bc-d49c6a4e5797 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:29.017273 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-200835d9-5e67-48f1-a8bc-d49c6a4e5797 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:29.061329 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9fe0e544-0701-4d61-b727-e5c792463f95 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:29.062225 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9fe0e544-0701-4d61-b727-e5c792463f95 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:29.074244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fe0e544-0701-4d61-b727-e5c792463f95 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:29.075030 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fe0e544-0701-4d61-b727-e5c792463f95 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:29.075681 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fe0e544-0701-4d61-b727-e5c792463f95 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:29.076708 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fe0e544-0701-4d61-b727-e5c792463f95 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:29.082673 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fe0e544-0701-4d61-b727-e5c792463f95 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:29.083133 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fe0e544-0701-4d61-b727-e5c792463f95 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:29.207897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9fe0e544-0701-4d61-b727-e5c792463f95 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:29.208136 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.multi_cell_list [None req-200835d9-5e67-48f1-a8bc-d49c6a4e5797 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=128777) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 11:48:29.222380 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9fe0e544-0701-4d61-b727-e5c792463f95 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 200 len: 1276 microversion: 2.1 time: 0.165072 Sep 10 11:48:29.224786 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1055/2196] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:29 2022] GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 1276 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:29.353167 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-200835d9-5e67-48f1-a8bc-d49c6a4e5797 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] 10.222.0.23 "GET /compute/v2.1/servers?host=n-h1-856895-1&all_tenants=1" status: 200 len: 1977 microversion: 2.1 time: 0.371819 Sep 10 11:48:29.360039 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1142/2197] 10.222.0.23 () {58 vars in 1190 bytes} [Sat Sep 10 11:48:28 2022] GET /compute/v2.1/servers?host=n-h1-856895-1&all_tenants=1 => generated 1977 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:29.379358 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cbf60995-2d9b-4992-8da2-f6a119620482 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:29.387951 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cbf60995-2d9b-4992-8da2-f6a119620482 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=128776) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 11:48:29.399614 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cbf60995-2d9b-4992-8da2-f6a119620482 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:29.400334 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cbf60995-2d9b-4992-8da2-f6a119620482 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:29.401096 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cbf60995-2d9b-4992-8da2-f6a119620482 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:29.402538 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cbf60995-2d9b-4992-8da2-f6a119620482 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:29.403250 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cbf60995-2d9b-4992-8da2-f6a119620482 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:29.403905 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cbf60995-2d9b-4992-8da2-f6a119620482 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:29.770172 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8f1bcf40-8779-4e6a-af1d-673fd7b2809c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:29.770872 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8f1bcf40-8779-4e6a-af1d-673fd7b2809c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:29.787094 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8f1bcf40-8779-4e6a-af1d-673fd7b2809c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:29.787729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8f1bcf40-8779-4e6a-af1d-673fd7b2809c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:29.789720 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8f1bcf40-8779-4e6a-af1d-673fd7b2809c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:29.790528 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8f1bcf40-8779-4e6a-af1d-673fd7b2809c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:29.791257 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8f1bcf40-8779-4e6a-af1d-673fd7b2809c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:29.791756 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8f1bcf40-8779-4e6a-af1d-673fd7b2809c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:29.918414 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cbf60995-2d9b-4992-8da2-f6a119620482 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] 10.222.0.23 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.548370 Sep 10 11:48:29.919335 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1056/2198] 10.222.0.23 () {58 vars in 1196 bytes} [Sat Sep 10 11:48:29 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:48:29.934647 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ccf8426e-ab95-4c65-b5a8-ea43d66edff7 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:48:29.949369 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ccf8426e-ab95-4c65-b5a8-ea43d66edff7 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:29.969727 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ccf8426e-ab95-4c65-b5a8-ea43d66edff7 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:29.972040 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ccf8426e-ab95-4c65-b5a8-ea43d66edff7 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:29.972533 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ccf8426e-ab95-4c65-b5a8-ea43d66edff7 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:29.973306 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ccf8426e-ab95-4c65-b5a8-ea43d66edff7 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:29.973775 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ccf8426e-ab95-4c65-b5a8-ea43d66edff7 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:29.974331 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ccf8426e-ab95-4c65-b5a8-ea43d66edff7 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:30.028455 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8f1bcf40-8779-4e6a-af1d-673fd7b2809c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:30.044697 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8f1bcf40-8779-4e6a-af1d-673fd7b2809c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2" status: 200 len: 1316 microversion: 2.1 time: 0.279506 Sep 10 11:48:30.047879 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1143/2199] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:29 2022] GET /compute/v2.1/servers/84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2 => generated 1316 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:30.160870 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ccf8426e-ab95-4c65-b5a8-ea43d66edff7 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd/action" status: 202 len: 0 microversion: 2.1 time: 0.229830 Sep 10 11:48:30.164255 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1057/2200] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:48:29 2022] POST /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:48:30.191756 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-72cee7ea-335c-40e6-bd75-78d922aea160 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:48:30.199673 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-72cee7ea-335c-40e6-bd75-78d922aea160 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:30.213603 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-72cee7ea-335c-40e6-bd75-78d922aea160 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:30.214117 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-72cee7ea-335c-40e6-bd75-78d922aea160 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:30.214563 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-72cee7ea-335c-40e6-bd75-78d922aea160 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:30.215777 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-72cee7ea-335c-40e6-bd75-78d922aea160 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:30.216761 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-72cee7ea-335c-40e6-bd75-78d922aea160 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:30.217203 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-72cee7ea-335c-40e6-bd75-78d922aea160 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:30.259423 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4ea6a976-04bf-4a05-a070-da50afba2914 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:30.260610 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4ea6a976-04bf-4a05-a070-da50afba2914 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:30.274504 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ea6a976-04bf-4a05-a070-da50afba2914 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:30.276560 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ea6a976-04bf-4a05-a070-da50afba2914 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:30.280198 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ea6a976-04bf-4a05-a070-da50afba2914 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:30.283173 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ea6a976-04bf-4a05-a070-da50afba2914 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:30.283831 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ea6a976-04bf-4a05-a070-da50afba2914 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:30.284950 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ea6a976-04bf-4a05-a070-da50afba2914 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:30.405307 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:48:30.459922 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4ea6a976-04bf-4a05-a070-da50afba2914 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:30.477047 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4ea6a976-04bf-4a05-a070-da50afba2914 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 200 len: 1282 microversion: 2.1 time: 0.226335 Sep 10 11:48:30.480877 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-72cee7ea-335c-40e6-bd75-78d922aea160 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:48:30.482213 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1058/2201] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:30 2022] GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 1282 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:30.483450 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-72cee7ea-335c-40e6-bd75-78d922aea160 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:48:30.486926 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-72cee7ea-335c-40e6-bd75-78d922aea160 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:48:30.488511 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-72cee7ea-335c-40e6-bd75-78d922aea160 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:48:30.489172 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-72cee7ea-335c-40e6-bd75-78d922aea160 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:48:30.620514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-72cee7ea-335c-40e6-bd75-78d922aea160 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:30.636555 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-72cee7ea-335c-40e6-bd75-78d922aea160 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:30.637498 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-72cee7ea-335c-40e6-bd75-78d922aea160 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:30.639126 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-72cee7ea-335c-40e6-bd75-78d922aea160 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:30.645279 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-72cee7ea-335c-40e6-bd75-78d922aea160 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:30.646081 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-72cee7ea-335c-40e6-bd75-78d922aea160 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:30.646880 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-72cee7ea-335c-40e6-bd75-78d922aea160 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:30.714178 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-72cee7ea-335c-40e6-bd75-78d922aea160 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "POST /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd/action" status: 202 len: 1067 microversion: 2.1 time: 0.544415 Sep 10 11:48:30.727200 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1144/2202] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:48:30 2022] POST /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd/action => generated 1067 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 10 11:48:30.735552 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a2ca382a-b00a-49e7-a621-169c4a7bc7a0 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:30.737899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a2ca382a-b00a-49e7-a621-169c4a7bc7a0 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:30.762230 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2ca382a-b00a-49e7-a621-169c4a7bc7a0 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:30.763026 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2ca382a-b00a-49e7-a621-169c4a7bc7a0 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:30.764155 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2ca382a-b00a-49e7-a621-169c4a7bc7a0 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:30.765720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2ca382a-b00a-49e7-a621-169c4a7bc7a0 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:30.766435 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2ca382a-b00a-49e7-a621-169c4a7bc7a0 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:30.767084 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2ca382a-b00a-49e7-a621-169c4a7bc7a0 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:30.780148 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:48:31.068925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-22478c57-b2b2-4bd8-b2c0-e9ed95c8013c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:31.069540 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-22478c57-b2b2-4bd8-b2c0-e9ed95c8013c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:31.076961 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-22478c57-b2b2-4bd8-b2c0-e9ed95c8013c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:31.077444 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-22478c57-b2b2-4bd8-b2c0-e9ed95c8013c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:31.082116 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-22478c57-b2b2-4bd8-b2c0-e9ed95c8013c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:31.082926 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-22478c57-b2b2-4bd8-b2c0-e9ed95c8013c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:31.095360 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-22478c57-b2b2-4bd8-b2c0-e9ed95c8013c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:31.099879 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-22478c57-b2b2-4bd8-b2c0-e9ed95c8013c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:31.102747 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a2ca382a-b00a-49e7-a621-169c4a7bc7a0 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:31.122043 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a2ca382a-b00a-49e7-a621-169c4a7bc7a0 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1471 microversion: 2.1 time: 0.391426 Sep 10 11:48:31.122506 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1059/2203] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:30 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1471 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:31.396877 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-22478c57-b2b2-4bd8-b2c0-e9ed95c8013c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:31.412892 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-22478c57-b2b2-4bd8-b2c0-e9ed95c8013c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2" status: 200 len: 1465 microversion: 2.1 time: 0.348009 Sep 10 11:48:31.413876 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1145/2204] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:31 2022] GET /compute/v2.1/servers/84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2 => generated 1465 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:31.437719 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3a545ac0-30e9-4f98-bf1f-192d8f89aee6 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:31.438353 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3a545ac0-30e9-4f98-bf1f-192d8f89aee6 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] [instance: 84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:31.445568 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3a545ac0-30e9-4f98-bf1f-192d8f89aee6 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:31.446067 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3a545ac0-30e9-4f98-bf1f-192d8f89aee6 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:31.446935 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3a545ac0-30e9-4f98-bf1f-192d8f89aee6 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:31.447356 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3a545ac0-30e9-4f98-bf1f-192d8f89aee6 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:31.447805 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3a545ac0-30e9-4f98-bf1f-192d8f89aee6 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:31.448392 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3a545ac0-30e9-4f98-bf1f-192d8f89aee6 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:31.506307 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e37f9a77-e193-4e71-ae51-98f8b82792b6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:31.507191 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e37f9a77-e193-4e71-ae51-98f8b82792b6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:31.522207 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e37f9a77-e193-4e71-ae51-98f8b82792b6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:31.522707 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e37f9a77-e193-4e71-ae51-98f8b82792b6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:31.523147 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e37f9a77-e193-4e71-ae51-98f8b82792b6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:31.525758 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e37f9a77-e193-4e71-ae51-98f8b82792b6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:31.526225 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e37f9a77-e193-4e71-ae51-98f8b82792b6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:31.526973 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e37f9a77-e193-4e71-ae51-98f8b82792b6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:31.679241 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e37f9a77-e193-4e71-ae51-98f8b82792b6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:31.689668 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e37f9a77-e193-4e71-ae51-98f8b82792b6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 200 len: 1282 microversion: 2.1 time: 0.187825 Sep 10 11:48:31.691416 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1146/2205] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:31 2022] GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 1282 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:31.876874 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3a545ac0-30e9-4f98-bf1f-192d8f89aee6 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2" status: 200 len: 1616 microversion: 2.1 time: 0.443454 Sep 10 11:48:31.888073 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1060/2206] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:31 2022] GET /compute/v2.1/servers/84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2 => generated 1616 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:31.960240 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-dc4bcd51-0e1f-46db-a9cc-0658fc7c0731 tempest-FloatingIPsTestJSON-605148736 tempest-FloatingIPsTestJSON-605148736-project] Action: 'create', calling method: .version_select at 0x7f40732be040>, body: {"pool": null} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:48:32.114882 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3446da68-6f57-4deb-85c2-467e394513d9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-39471625", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["d89db381-1e9d-40ee-b076-b024d38d38b1"]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:48:32.192010 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-3446da68-6f57-4deb-85c2-467e394513d9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] validate_networks() for None {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:48:32.785229 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-3446da68-6f57-4deb-85c2-467e394513d9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:48:32.785799 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-3446da68-6f57-4deb-85c2-467e394513d9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:48:32.786601 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-3446da68-6f57-4deb-85c2-467e394513d9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:48:32.787710 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-3446da68-6f57-4deb-85c2-467e394513d9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:48:32.788239 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-3446da68-6f57-4deb-85c2-467e394513d9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:48:32.799415 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3446da68-6f57-4deb-85c2-467e394513d9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:32.800389 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3446da68-6f57-4deb-85c2-467e394513d9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:32.801182 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3446da68-6f57-4deb-85c2-467e394513d9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:32.802043 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3446da68-6f57-4deb-85c2-467e394513d9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:32.802602 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3446da68-6f57-4deb-85c2-467e394513d9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:32.803132 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3446da68-6f57-4deb-85c2-467e394513d9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:32.835033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-3446da68-6f57-4deb-85c2-467e394513d9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Getting quotas for project 5949225a72e649c1adc217d5a760460a. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:48:32.846845 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-3446da68-6f57-4deb-85c2-467e394513d9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Getting quotas for user dfc33eb8645248f9b154587e7d8d449e and project 5949225a72e649c1adc217d5a760460a. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:48:32.866781 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3446da68-6f57-4deb-85c2-467e394513d9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:48:32.870404 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3446da68-6f57-4deb-85c2-467e394513d9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 727a5b3f-0317-46f9-9691-24caab6c3959] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:48:32.974011 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3446da68-6f57-4deb-85c2-467e394513d9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.863620 Sep 10 11:48:32.975556 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1061/2207] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:48:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:48:32.984490 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c4b79585-82d9-4fee-8f85-506292afbdf3 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:32.985634 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c4b79585-82d9-4fee-8f85-506292afbdf3 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:32.996889 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c4b79585-82d9-4fee-8f85-506292afbdf3 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:32.997656 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c4b79585-82d9-4fee-8f85-506292afbdf3 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:32.999721 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c4b79585-82d9-4fee-8f85-506292afbdf3 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:33.001119 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c4b79585-82d9-4fee-8f85-506292afbdf3 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:33.001526 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c4b79585-82d9-4fee-8f85-506292afbdf3 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:33.002411 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c4b79585-82d9-4fee-8f85-506292afbdf3 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:33.398751 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c4b79585-82d9-4fee-8f85-506292afbdf3 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:33.408209 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c4b79585-82d9-4fee-8f85-506292afbdf3 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1471 microversion: 2.1 time: 0.430990 Sep 10 11:48:33.414349 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1062/2208] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:32 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1471 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:33.428050 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d7e82d97-9e96-48be-8da0-75176f935799 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:33.432016 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d7e82d97-9e96-48be-8da0-75176f935799 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:33.444263 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d7e82d97-9e96-48be-8da0-75176f935799 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:33.444822 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d7e82d97-9e96-48be-8da0-75176f935799 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:33.445721 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d7e82d97-9e96-48be-8da0-75176f935799 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:33.446641 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d7e82d97-9e96-48be-8da0-75176f935799 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:33.447120 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d7e82d97-9e96-48be-8da0-75176f935799 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:33.447583 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d7e82d97-9e96-48be-8da0-75176f935799 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:33.815931 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d7e82d97-9e96-48be-8da0-75176f935799 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:33.828046 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d7e82d97-9e96-48be-8da0-75176f935799 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 200 len: 1324 microversion: 2.1 time: 0.409878 Sep 10 11:48:33.831654 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1063/2209] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:33 2022] GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 1324 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:33.837955 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3b39a28f-a55c-4d1e-9f2d-a39992b01fdf tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:33.838590 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3b39a28f-a55c-4d1e-9f2d-a39992b01fdf tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 727a5b3f-0317-46f9-9691-24caab6c3959] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:33.858243 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3b39a28f-a55c-4d1e-9f2d-a39992b01fdf tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:33.859098 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3b39a28f-a55c-4d1e-9f2d-a39992b01fdf tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:33.859721 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3b39a28f-a55c-4d1e-9f2d-a39992b01fdf tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:33.860620 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3b39a28f-a55c-4d1e-9f2d-a39992b01fdf tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:33.866395 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3b39a28f-a55c-4d1e-9f2d-a39992b01fdf tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:33.867476 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3b39a28f-a55c-4d1e-9f2d-a39992b01fdf tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:33.971448 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3b39a28f-a55c-4d1e-9f2d-a39992b01fdf tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:33.985323 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3b39a28f-a55c-4d1e-9f2d-a39992b01fdf tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/727a5b3f-0317-46f9-9691-24caab6c3959" status: 200 len: 1211 microversion: 2.1 time: 0.152406 Sep 10 11:48:33.990624 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1064/2210] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:33 2022] GET /compute/v2.1/servers/727a5b3f-0317-46f9-9691-24caab6c3959 => generated 1211 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:34.440580 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-007b0b2b-0dc3-41f1-9a8b-50c03b80faf3 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:34.441462 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-007b0b2b-0dc3-41f1-9a8b-50c03b80faf3 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:34.453576 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-007b0b2b-0dc3-41f1-9a8b-50c03b80faf3 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:34.454082 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-007b0b2b-0dc3-41f1-9a8b-50c03b80faf3 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:34.454529 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-007b0b2b-0dc3-41f1-9a8b-50c03b80faf3 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:34.459065 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-007b0b2b-0dc3-41f1-9a8b-50c03b80faf3 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:34.459851 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-007b0b2b-0dc3-41f1-9a8b-50c03b80faf3 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:34.460563 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-007b0b2b-0dc3-41f1-9a8b-50c03b80faf3 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:35.015567 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-dc4bcd51-0e1f-46db-a9cc-0658fc7c0731 tempest-FloatingIPsTestJSON-605148736 tempest-FloatingIPsTestJSON-605148736-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.322666 Sep 10 11:48:35.024051 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1147/2211] 10.222.0.23 () {60 vars in 1170 bytes} [Sat Sep 10 11:48:31 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:48:35.024236 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-007b0b2b-0dc3-41f1-9a8b-50c03b80faf3 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:35.024470 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d9546fc0-29b3-47aa-864e-89eb1b7612ef tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:35.024470 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d9546fc0-29b3-47aa-864e-89eb1b7612ef tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:35.031967 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-007b0b2b-0dc3-41f1-9a8b-50c03b80faf3 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1471 microversion: 2.1 time: 0.595933 Sep 10 11:48:35.032568 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1065/2212] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:34 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1471 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:48:35.043417 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cd34467e-f1b7-4f42-96c6-e11d9d3a6d49 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:35.046474 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d9546fc0-29b3-47aa-864e-89eb1b7612ef tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:35.047876 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d9546fc0-29b3-47aa-864e-89eb1b7612ef tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:35.048157 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cd34467e-f1b7-4f42-96c6-e11d9d3a6d49 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 727a5b3f-0317-46f9-9691-24caab6c3959] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:35.049631 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d9546fc0-29b3-47aa-864e-89eb1b7612ef tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:35.052631 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d9546fc0-29b3-47aa-864e-89eb1b7612ef tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:35.056807 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d9546fc0-29b3-47aa-864e-89eb1b7612ef tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:35.058182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d9546fc0-29b3-47aa-864e-89eb1b7612ef tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:35.060999 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cd34467e-f1b7-4f42-96c6-e11d9d3a6d49 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:35.064014 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cd34467e-f1b7-4f42-96c6-e11d9d3a6d49 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:35.064632 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cd34467e-f1b7-4f42-96c6-e11d9d3a6d49 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:35.067348 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cd34467e-f1b7-4f42-96c6-e11d9d3a6d49 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:35.070246 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cd34467e-f1b7-4f42-96c6-e11d9d3a6d49 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:35.070887 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cd34467e-f1b7-4f42-96c6-e11d9d3a6d49 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:35.222968 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-cd34467e-f1b7-4f42-96c6-e11d9d3a6d49 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:35.232472 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cd34467e-f1b7-4f42-96c6-e11d9d3a6d49 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/727a5b3f-0317-46f9-9691-24caab6c3959" status: 200 len: 1275 microversion: 2.1 time: 0.198825 Sep 10 11:48:35.240079 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1066/2213] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:35 2022] GET /compute/v2.1/servers/727a5b3f-0317-46f9-9691-24caab6c3959 => generated 1275 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:35.257953 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9e28a387-ef18-482c-9a4b-fbe4e9cf92db tempest-FloatingIPsTestJSON-605148736 tempest-FloatingIPsTestJSON-605148736-project] Calling method '.version_select at 0x7f4072cab790>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:35.460434 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d9546fc0-29b3-47aa-864e-89eb1b7612ef tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:35.469348 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d9546fc0-29b3-47aa-864e-89eb1b7612ef tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 200 len: 1324 microversion: 2.1 time: 0.451548 Sep 10 11:48:35.469938 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1148/2214] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:35 2022] GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 1324 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:35.600142 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9e28a387-ef18-482c-9a4b-fbe4e9cf92db tempest-FloatingIPsTestJSON-605148736 tempest-FloatingIPsTestJSON-605148736-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/a0b8d986-ec7a-4b7f-9643-3d7d82eaa54f" status: 200 len: 142 microversion: 2.1 time: 0.357762 Sep 10 11:48:35.601330 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1067/2215] 10.222.0.23 () {58 vars in 1260 bytes} [Sat Sep 10 11:48:35 2022] GET /compute/v2.1/os-floating-ips/a0b8d986-ec7a-4b7f-9643-3d7d82eaa54f => generated 142 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:48:35.621145 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-77f5d697-c74d-41a8-a372-3965c20647c4 tempest-FloatingIPsTestJSON-605148736 tempest-FloatingIPsTestJSON-605148736-project] Calling method '.version_select at 0x7f40732be700>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:36.068555 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-541b0a56-8e80-4c66-8f05-96bc4d364027 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:36.069683 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-541b0a56-8e80-4c66-8f05-96bc4d364027 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:36.089224 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-541b0a56-8e80-4c66-8f05-96bc4d364027 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:36.092485 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-541b0a56-8e80-4c66-8f05-96bc4d364027 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:36.093248 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-541b0a56-8e80-4c66-8f05-96bc4d364027 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:36.097710 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-541b0a56-8e80-4c66-8f05-96bc4d364027 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:36.098807 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-541b0a56-8e80-4c66-8f05-96bc4d364027 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:36.101224 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-541b0a56-8e80-4c66-8f05-96bc4d364027 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:36.457995 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-77f5d697-c74d-41a8-a372-3965c20647c4 tempest-FloatingIPsTestJSON-605148736 tempest-FloatingIPsTestJSON-605148736-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.846314 Sep 10 11:48:36.466772 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1149/2216] 10.222.0.23 () {58 vars in 1149 bytes} [Sat Sep 10 11:48:35 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:48:36.472739 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c0c34ef1-bcba-4839-b979-5f328305e600 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:36.475601 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c0c34ef1-bcba-4839-b979-5f328305e600 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 727a5b3f-0317-46f9-9691-24caab6c3959] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:36.491945 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c0c34ef1-bcba-4839-b979-5f328305e600 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:36.492701 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c0c34ef1-bcba-4839-b979-5f328305e600 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:36.495982 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c0c34ef1-bcba-4839-b979-5f328305e600 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:36.496986 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c0c34ef1-bcba-4839-b979-5f328305e600 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:36.497623 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c0c34ef1-bcba-4839-b979-5f328305e600 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:36.498218 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c0c34ef1-bcba-4839-b979-5f328305e600 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:36.618672 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c0c34ef1-bcba-4839-b979-5f328305e600 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:36.628382 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c0c34ef1-bcba-4839-b979-5f328305e600 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/727a5b3f-0317-46f9-9691-24caab6c3959" status: 200 len: 1273 microversion: 2.1 time: 0.159745 Sep 10 11:48:36.635903 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1150/2217] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:36 2022] GET /compute/v2.1/servers/727a5b3f-0317-46f9-9691-24caab6c3959 => generated 1273 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:36.641082 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2b61a969-e1bd-4932-a3ed-b75a288193eb tempest-FloatingIPsTestJSON-605148736 tempest-FloatingIPsTestJSON-605148736-project] Calling method '.version_select at 0x7f40734eff70>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:36.656362 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-541b0a56-8e80-4c66-8f05-96bc4d364027 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:36.666199 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-541b0a56-8e80-4c66-8f05-96bc4d364027 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1471 microversion: 2.1 time: 0.610922 Sep 10 11:48:36.667527 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1068/2218] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:36 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1471 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:36.770459 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-ce584f25-6530-4aee-9a22-2125940d89c0 req-d6c36309-c3f4-4e5d-a8c1-b42c682ea118 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cec74510-742b-4a47-b7c5-58411ca992de", "tag": "80da9e33-1a86-4d89-b08b-b5850346b6f1"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:48:36.789914 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ce584f25-6530-4aee-9a22-2125940d89c0 req-d6c36309-c3f4-4e5d-a8c1-b42c682ea118 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:36.790440 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ce584f25-6530-4aee-9a22-2125940d89c0 req-d6c36309-c3f4-4e5d-a8c1-b42c682ea118 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:36.790885 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ce584f25-6530-4aee-9a22-2125940d89c0 req-d6c36309-c3f4-4e5d-a8c1-b42c682ea118 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:36.826786 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-ce584f25-6530-4aee-9a22-2125940d89c0 req-d6c36309-c3f4-4e5d-a8c1-b42c682ea118 service nova] Creating event network-changed:80da9e33-1a86-4d89-b08b-b5850346b6f1 for instance cec74510-742b-4a47-b7c5-58411ca992de on n-h1-856895-1 Sep 10 11:48:36.836527 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-ce584f25-6530-4aee-9a22-2125940d89c0 req-d6c36309-c3f4-4e5d-a8c1-b42c682ea118 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167391 Sep 10 11:48:36.839964 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1069/2219] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:48:36.853984 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-589644eb-68d6-4049-913a-7d2ac020a551 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:36.854721 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-589644eb-68d6-4049-913a-7d2ac020a551 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:36.878518 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-589644eb-68d6-4049-913a-7d2ac020a551 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:36.878743 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-589644eb-68d6-4049-913a-7d2ac020a551 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:36.884019 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-589644eb-68d6-4049-913a-7d2ac020a551 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:36.884919 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-589644eb-68d6-4049-913a-7d2ac020a551 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:36.885432 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-589644eb-68d6-4049-913a-7d2ac020a551 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:36.886056 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-589644eb-68d6-4049-913a-7d2ac020a551 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:37.334721 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-589644eb-68d6-4049-913a-7d2ac020a551 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:37.353815 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-589644eb-68d6-4049-913a-7d2ac020a551 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 200 len: 1324 microversion: 2.1 time: 0.510640 Sep 10 11:48:37.356274 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1070/2220] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:36 2022] GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 1324 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:37.662103 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2b557656-3112-434a-8e8c-2b5dc69bb932 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:37.665523 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2b557656-3112-434a-8e8c-2b5dc69bb932 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 727a5b3f-0317-46f9-9691-24caab6c3959] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:37.677600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2b557656-3112-434a-8e8c-2b5dc69bb932 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:37.679958 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2b557656-3112-434a-8e8c-2b5dc69bb932 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:37.681850 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2b557656-3112-434a-8e8c-2b5dc69bb932 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:37.682615 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2b557656-3112-434a-8e8c-2b5dc69bb932 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:37.686143 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2b557656-3112-434a-8e8c-2b5dc69bb932 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:37.688773 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2b557656-3112-434a-8e8c-2b5dc69bb932 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:37.846371 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2b557656-3112-434a-8e8c-2b5dc69bb932 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:37.858509 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2b557656-3112-434a-8e8c-2b5dc69bb932 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/727a5b3f-0317-46f9-9691-24caab6c3959" status: 200 len: 1273 microversion: 2.1 time: 0.201465 Sep 10 11:48:37.860865 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1071/2221] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:37 2022] GET /compute/v2.1/servers/727a5b3f-0317-46f9-9691-24caab6c3959 => generated 1273 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:37.872394 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ccf67e0d-fbaa-453d-b766-b3da635219ed tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:37.873388 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ccf67e0d-fbaa-453d-b766-b3da635219ed tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:37.884127 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ccf67e0d-fbaa-453d-b766-b3da635219ed tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:37.884926 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ccf67e0d-fbaa-453d-b766-b3da635219ed tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:37.885778 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ccf67e0d-fbaa-453d-b766-b3da635219ed tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:37.887133 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ccf67e0d-fbaa-453d-b766-b3da635219ed tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:37.887792 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ccf67e0d-fbaa-453d-b766-b3da635219ed tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:37.888442 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ccf67e0d-fbaa-453d-b766-b3da635219ed tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:38.029726 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:48:38.146722 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ccf67e0d-fbaa-453d-b766-b3da635219ed tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:38.154939 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ccf67e0d-fbaa-453d-b766-b3da635219ed tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1471 microversion: 2.1 time: 0.292130 Sep 10 11:48:38.155574 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1072/2222] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:37 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1471 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:38.339355 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2b61a969-e1bd-4932-a3ed-b75a288193eb tempest-FloatingIPsTestJSON-605148736 tempest-FloatingIPsTestJSON-605148736-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/a0b8d986-ec7a-4b7f-9643-3d7d82eaa54f" status: 202 len: 0 microversion: 2.1 time: 1.701014 Sep 10 11:48:38.339355 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1151/2223] 10.222.0.23 () {58 vars in 1263 bytes} [Sat Sep 10 11:48:36 2022] DELETE /compute/v2.1/os-floating-ips/a0b8d986-ec7a-4b7f-9643-3d7d82eaa54f => generated 0 bytes in 1702 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:48:38.359925 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-88326bd9-dff4-477c-945b-489e965f6753 tempest-FloatingIPsTestJSON-605148736 tempest-FloatingIPsTestJSON-605148736-project] Action: 'create', calling method: .version_select at 0x7f4072c7a820>, body: {"pool": null} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:48:38.382753 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9021ce12-f300-46d6-9abb-1b3eeb815dd3 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:38.387093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9021ce12-f300-46d6-9abb-1b3eeb815dd3 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:38.398367 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=86 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:48:38.404893 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9021ce12-f300-46d6-9abb-1b3eeb815dd3 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:38.405632 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9021ce12-f300-46d6-9abb-1b3eeb815dd3 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:38.406544 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9021ce12-f300-46d6-9abb-1b3eeb815dd3 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:38.407456 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9021ce12-f300-46d6-9abb-1b3eeb815dd3 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:38.408070 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9021ce12-f300-46d6-9abb-1b3eeb815dd3 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:38.408680 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9021ce12-f300-46d6-9abb-1b3eeb815dd3 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:38.778871 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9021ce12-f300-46d6-9abb-1b3eeb815dd3 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:38.792631 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9021ce12-f300-46d6-9abb-1b3eeb815dd3 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 200 len: 1324 microversion: 2.1 time: 0.417484 Sep 10 11:48:38.803224 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1152/2224] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:38 2022] GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 1324 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:38.884769 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-03fb020d-3e04-429d-890f-e792f439f79e tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:38.885389 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-03fb020d-3e04-429d-890f-e792f439f79e tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 727a5b3f-0317-46f9-9691-24caab6c3959] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:38.891332 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03fb020d-3e04-429d-890f-e792f439f79e tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:38.892041 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03fb020d-3e04-429d-890f-e792f439f79e tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:38.892614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03fb020d-3e04-429d-890f-e792f439f79e tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:38.894074 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03fb020d-3e04-429d-890f-e792f439f79e tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:38.894719 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03fb020d-3e04-429d-890f-e792f439f79e tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:38.895388 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03fb020d-3e04-429d-890f-e792f439f79e tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:38.993446 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-03fb020d-3e04-429d-890f-e792f439f79e tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:39.003531 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-03fb020d-3e04-429d-890f-e792f439f79e tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/727a5b3f-0317-46f9-9691-24caab6c3959" status: 200 len: 1273 microversion: 2.1 time: 0.121673 Sep 10 11:48:39.016977 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1153/2225] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:38 2022] GET /compute/v2.1/servers/727a5b3f-0317-46f9-9691-24caab6c3959 => generated 1273 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:48:39.184328 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fca5dd82-0523-4321-a18f-0c3522ca4416 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:39.186289 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fca5dd82-0523-4321-a18f-0c3522ca4416 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:39.188522 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=8 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:48:39.204280 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fca5dd82-0523-4321-a18f-0c3522ca4416 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:39.205066 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fca5dd82-0523-4321-a18f-0c3522ca4416 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:39.205754 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fca5dd82-0523-4321-a18f-0c3522ca4416 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:39.206678 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fca5dd82-0523-4321-a18f-0c3522ca4416 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:39.214225 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fca5dd82-0523-4321-a18f-0c3522ca4416 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:39.215640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fca5dd82-0523-4321-a18f-0c3522ca4416 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:39.669782 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fca5dd82-0523-4321-a18f-0c3522ca4416 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:39.682421 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fca5dd82-0523-4321-a18f-0c3522ca4416 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1477 microversion: 2.1 time: 0.503834 Sep 10 11:48:39.684311 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1154/2226] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:39 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1477 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:39.818704 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ede02898-84a8-4676-9d6d-cdd393ad10cd tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:39.819971 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ede02898-84a8-4676-9d6d-cdd393ad10cd tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:39.837071 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ede02898-84a8-4676-9d6d-cdd393ad10cd tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:39.843284 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ede02898-84a8-4676-9d6d-cdd393ad10cd tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:39.844144 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ede02898-84a8-4676-9d6d-cdd393ad10cd tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:39.845219 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ede02898-84a8-4676-9d6d-cdd393ad10cd tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:39.845849 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ede02898-84a8-4676-9d6d-cdd393ad10cd tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:39.847917 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ede02898-84a8-4676-9d6d-cdd393ad10cd tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:40.422657 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ede02898-84a8-4676-9d6d-cdd393ad10cd tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:40.445686 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ede02898-84a8-4676-9d6d-cdd393ad10cd tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 200 len: 1324 microversion: 2.1 time: 0.627638 Sep 10 11:48:40.448810 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1155/2227] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:39 2022] GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 1324 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:40.455411 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0b97f458-b877-404a-828c-7a2fc869e0aa tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:40.456598 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0b97f458-b877-404a-828c-7a2fc869e0aa tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 727a5b3f-0317-46f9-9691-24caab6c3959] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:40.472082 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0b97f458-b877-404a-828c-7a2fc869e0aa tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:40.473022 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0b97f458-b877-404a-828c-7a2fc869e0aa tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:40.474074 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0b97f458-b877-404a-828c-7a2fc869e0aa tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:40.476449 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0b97f458-b877-404a-828c-7a2fc869e0aa tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:40.477269 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0b97f458-b877-404a-828c-7a2fc869e0aa tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:40.479705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0b97f458-b877-404a-828c-7a2fc869e0aa tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:40.925568 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0b97f458-b877-404a-828c-7a2fc869e0aa tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:40.939238 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0b97f458-b877-404a-828c-7a2fc869e0aa tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/727a5b3f-0317-46f9-9691-24caab6c3959" status: 200 len: 1315 microversion: 2.1 time: 0.488602 Sep 10 11:48:40.951694 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1156/2228] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:40 2022] GET /compute/v2.1/servers/727a5b3f-0317-46f9-9691-24caab6c3959 => generated 1315 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:40.967033 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-ef1eca2b-45e6-4f40-bbb2-a7cd5e9ffff3 req-83cb1ac1-0b89-4a96-ab7a-49772d8e5800 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "727a5b3f-0317-46f9-9691-24caab6c3959", "tag": "50566b5c-6990-480d-acc2-8eec359a9212"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:48:40.977477 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-ef1eca2b-45e6-4f40-bbb2-a7cd5e9ffff3 req-83cb1ac1-0b89-4a96-ab7a-49772d8e5800 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:40.978209 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-ef1eca2b-45e6-4f40-bbb2-a7cd5e9ffff3 req-83cb1ac1-0b89-4a96-ab7a-49772d8e5800 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:40.978800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-ef1eca2b-45e6-4f40-bbb2-a7cd5e9ffff3 req-83cb1ac1-0b89-4a96-ab7a-49772d8e5800 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:41.004929 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-ef1eca2b-45e6-4f40-bbb2-a7cd5e9ffff3 req-83cb1ac1-0b89-4a96-ab7a-49772d8e5800 service nova] Creating event network-changed:50566b5c-6990-480d-acc2-8eec359a9212 for instance 727a5b3f-0317-46f9-9691-24caab6c3959 on n-h2-856895-1 Sep 10 11:48:41.010614 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-ef1eca2b-45e6-4f40-bbb2-a7cd5e9ffff3 req-83cb1ac1-0b89-4a96-ab7a-49772d8e5800 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056897 Sep 10 11:48:41.012302 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1157/2229] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:48:41.019605 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-969f3d65-95a9-4acb-a098-48e398426d97 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:41.020554 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-969f3d65-95a9-4acb-a098-48e398426d97 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:41.027750 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-969f3d65-95a9-4acb-a098-48e398426d97 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:41.028514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-969f3d65-95a9-4acb-a098-48e398426d97 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:41.029232 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-969f3d65-95a9-4acb-a098-48e398426d97 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:41.030149 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-969f3d65-95a9-4acb-a098-48e398426d97 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:41.030797 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-969f3d65-95a9-4acb-a098-48e398426d97 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:41.031486 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-969f3d65-95a9-4acb-a098-48e398426d97 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:41.318200 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-969f3d65-95a9-4acb-a098-48e398426d97 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:41.325966 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-969f3d65-95a9-4acb-a098-48e398426d97 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1477 microversion: 2.1 time: 0.311954 Sep 10 11:48:41.339201 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1158/2230] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:41 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1477 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:41.355367 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-88326bd9-dff4-477c-945b-489e965f6753 tempest-FloatingIPsTestJSON-605148736 tempest-FloatingIPsTestJSON-605148736-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.008691 Sep 10 11:48:41.365273 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1073/2231] 10.222.0.23 () {60 vars in 1170 bytes} [Sat Sep 10 11:48:38 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3019 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:48:41.370674 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-dd38c8c4-d4be-457d-b176-c5a8ce3533b5 tempest-FloatingIPsTestJSON-605148736 tempest-FloatingIPsTestJSON-605148736-project] Calling method '.version_select at 0x7f4073f61550>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:41.473683 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ac7c1a61-2d8e-4eda-a1f1-7642747bf496 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:41.474498 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ac7c1a61-2d8e-4eda-a1f1-7642747bf496 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:41.482377 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:48:41.484855 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac7c1a61-2d8e-4eda-a1f1-7642747bf496 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:41.485361 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac7c1a61-2d8e-4eda-a1f1-7642747bf496 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:41.485803 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac7c1a61-2d8e-4eda-a1f1-7642747bf496 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:41.486526 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac7c1a61-2d8e-4eda-a1f1-7642747bf496 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:41.487547 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac7c1a61-2d8e-4eda-a1f1-7642747bf496 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:41.487984 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac7c1a61-2d8e-4eda-a1f1-7642747bf496 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:42.284340 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ac7c1a61-2d8e-4eda-a1f1-7642747bf496 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:42.295300 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ac7c1a61-2d8e-4eda-a1f1-7642747bf496 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 200 len: 1324 microversion: 2.1 time: 0.827533 Sep 10 11:48:42.296792 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1074/2232] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:41 2022] GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 1324 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:42.304382 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-7ee2e33b-2542-4c53-8f07-a47b73928482 req-05b70b6f-02b2-45f8-9a86-344521941eec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ebabc55-1b1d-4276-8bde-d8d4859d74fd", "name": "network-vif-unplugged", "status": "completed", "tag": "679e3ac9-dc5d-4404-aa8b-99020ce86192"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:48:42.317639 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-7ee2e33b-2542-4c53-8f07-a47b73928482 req-05b70b6f-02b2-45f8-9a86-344521941eec service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:42.318434 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-7ee2e33b-2542-4c53-8f07-a47b73928482 req-05b70b6f-02b2-45f8-9a86-344521941eec service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:42.319082 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-7ee2e33b-2542-4c53-8f07-a47b73928482 req-05b70b6f-02b2-45f8-9a86-344521941eec service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:42.335196 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-7ee2e33b-2542-4c53-8f07-a47b73928482 req-05b70b6f-02b2-45f8-9a86-344521941eec service nova] Creating event network-vif-unplugged:679e3ac9-dc5d-4404-aa8b-99020ce86192 for instance 6ebabc55-1b1d-4276-8bde-d8d4859d74fd on n-h1-856895-1 Sep 10 11:48:42.340998 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-7ee2e33b-2542-4c53-8f07-a47b73928482 req-05b70b6f-02b2-45f8-9a86-344521941eec service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042530 Sep 10 11:48:42.341634 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1075/2233] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:48:42.350023 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6eb984bc-be6a-4fb0-acc3-25ccace93a78 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:42.350732 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6eb984bc-be6a-4fb0-acc3-25ccace93a78 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 727a5b3f-0317-46f9-9691-24caab6c3959] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:42.357390 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6eb984bc-be6a-4fb0-acc3-25ccace93a78 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:42.358024 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6eb984bc-be6a-4fb0-acc3-25ccace93a78 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:42.358318 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6eb984bc-be6a-4fb0-acc3-25ccace93a78 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:42.359030 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6eb984bc-be6a-4fb0-acc3-25ccace93a78 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:42.359509 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6eb984bc-be6a-4fb0-acc3-25ccace93a78 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:42.359940 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6eb984bc-be6a-4fb0-acc3-25ccace93a78 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:42.757976 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6eb984bc-be6a-4fb0-acc3-25ccace93a78 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:42.769902 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6eb984bc-be6a-4fb0-acc3-25ccace93a78 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/727a5b3f-0317-46f9-9691-24caab6c3959" status: 200 len: 1315 microversion: 2.1 time: 0.424129 Sep 10 11:48:42.770499 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1076/2234] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:42 2022] GET /compute/v2.1/servers/727a5b3f-0317-46f9-9691-24caab6c3959 => generated 1315 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:42.777198 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ed06f6d4-dc16-4362-9a95-0b6222f42841 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:42.777923 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ed06f6d4-dc16-4362-9a95-0b6222f42841 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:42.785020 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed06f6d4-dc16-4362-9a95-0b6222f42841 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:42.785696 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed06f6d4-dc16-4362-9a95-0b6222f42841 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:42.786246 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed06f6d4-dc16-4362-9a95-0b6222f42841 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:42.787075 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed06f6d4-dc16-4362-9a95-0b6222f42841 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:42.787798 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed06f6d4-dc16-4362-9a95-0b6222f42841 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:42.788470 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed06f6d4-dc16-4362-9a95-0b6222f42841 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:42.824612 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=12 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:48:42.860120 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=14 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:48:43.201684 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ed06f6d4-dc16-4362-9a95-0b6222f42841 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:43.210148 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ed06f6d4-dc16-4362-9a95-0b6222f42841 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1477 microversion: 2.1 time: 0.438195 Sep 10 11:48:43.211749 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1077/2235] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:42 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1477 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:43.319261 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1ecfa689-8d93-442a-a8de-0971480b0406 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:43.320248 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1ecfa689-8d93-442a-a8de-0971480b0406 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:43.330682 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1ecfa689-8d93-442a-a8de-0971480b0406 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:43.335515 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1ecfa689-8d93-442a-a8de-0971480b0406 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:43.336146 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1ecfa689-8d93-442a-a8de-0971480b0406 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:43.340151 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1ecfa689-8d93-442a-a8de-0971480b0406 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:43.341194 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1ecfa689-8d93-442a-a8de-0971480b0406 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:43.341856 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1ecfa689-8d93-442a-a8de-0971480b0406 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:43.758566 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1ecfa689-8d93-442a-a8de-0971480b0406 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:43.770956 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1ecfa689-8d93-442a-a8de-0971480b0406 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 200 len: 1324 microversion: 2.1 time: 0.455804 Sep 10 11:48:43.773090 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1078/2236] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:43 2022] GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 1324 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:48:43.805784 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bd4f7697-178b-4785-bdc1-aa7998fd5d23 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:43.806763 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bd4f7697-178b-4785-bdc1-aa7998fd5d23 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 727a5b3f-0317-46f9-9691-24caab6c3959] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:43.823615 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd4f7697-178b-4785-bdc1-aa7998fd5d23 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:43.824410 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd4f7697-178b-4785-bdc1-aa7998fd5d23 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:43.825100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd4f7697-178b-4785-bdc1-aa7998fd5d23 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:43.826573 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd4f7697-178b-4785-bdc1-aa7998fd5d23 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:43.827313 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd4f7697-178b-4785-bdc1-aa7998fd5d23 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:43.827961 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd4f7697-178b-4785-bdc1-aa7998fd5d23 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:44.080655 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-dd38c8c4-d4be-457d-b176-c5a8ce3533b5 tempest-FloatingIPsTestJSON-605148736 tempest-FloatingIPsTestJSON-605148736-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/e40a8520-c9ee-4e01-8ef8-b33b028068dc" status: 202 len: 0 microversion: 2.1 time: 2.713624 Sep 10 11:48:44.082341 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1159/2237] 10.222.0.23 () {58 vars in 1263 bytes} [Sat Sep 10 11:48:41 2022] DELETE /compute/v2.1/os-floating-ips/e40a8520-c9ee-4e01-8ef8-b33b028068dc => generated 0 bytes in 2716 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:48:44.090108 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2d5807fb-63dc-4bfb-9313-98cdca5a76be tempest-FloatingIPsTestJSON-605148736 tempest-FloatingIPsTestJSON-605148736-project] Calling method '.version_select at 0x7f4073131b80>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG neutronclient.v2_0.client [None req-2d5807fb-63dc-4bfb-9313-98cdca5a76be tempest-FloatingIPsTestJSON-605148736 tempest-FloatingIPsTestJSON-605148736-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP e40a8520-c9ee-4e01-8ef8-b33b028068dc could not be found", "detail": ""}} {{(pid=128777) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-2d5807fb-63dc-4bfb-9313-98cdca5a76be tempest-FloatingIPsTestJSON-605148736 tempest-FloatingIPsTestJSON-605148736-project] HTTP exception thrown: Floating IP not found for ID e40a8520-c9ee-4e01-8ef8-b33b028068dc Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2d5807fb-63dc-4bfb-9313-98cdca5a76be tempest-FloatingIPsTestJSON-605148736 tempest-FloatingIPsTestJSON-605148736-project] Request method failure captured: Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/os-floating-ips/e40a8520-c9ee-4e01-8ef8-b33b028068dc HTTP/1.1 Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHmPNmEV9oCwK-Pzlsv2DmPAKLVo_Qe23RoYZG6uTyWxp2EIQmeGYcShxM1xW--b8OiuLidGS79Iz9NwgS04BQd-vnSXjhk7nTtpELPDqJf7GVrjJFnpFbvf-7C4eLpP3vOC614P4Ez5B4yXyCCze55LPbLZButTY-2DOh1x_gIHQVQ Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 5493a49c2833495197b12632f94d5bd8 Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-FloatingIPsTestJSON-605148736 Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5493a49c2833495197b12632f94d5bd8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5493a49c2833495197b12632f94d5bd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5493a49c2833495197b12632f94d5bd8", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5493a49c2833495197b12632f94d5bd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-FloatingIPsTestJSON-605148736 Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 5493a49c2833495197b12632f94d5bd8 Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-FloatingIPsTestJSON-605148736 Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-FloatingIPsTestJSON-605148736-project Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: d58e356d147b4560bb113cafb530428c Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-FloatingIPsTestJSON-605148736-project Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: exception: Floating IP not found for ID e40a8520-c9ee-4e01-8ef8-b33b028068dc Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'e40a8520-c9ee-4e01-8ef8-b33b028068dc'} Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:48:44.205688 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:48:44.210043 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 11:48:44.210043 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 11:48:44.210043 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 11:48:44.210043 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 11:48:44.210043 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP e40a8520-c9ee-4e01-8ef8-b33b028068dc could not be found Sep 10 11:48:44.210043 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bceb631d-8645-4268-ba76-d1329b8ca1d5'] Sep 10 11:48:44.210043 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:44.210043 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:48:44.210043 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:44.210043 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:48:44.210043 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 10 11:48:44.210043 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 10 11:48:44.210043 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 10 11:48:44.210043 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 10 11:48:44.210043 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID e40a8520-c9ee-4e01-8ef8-b33b028068dc. Sep 10 11:48:44.210043 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:44.210043 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:48:44.210043 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:44.210043 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:48:44.210043 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:48:44.210043 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:48:44.210043 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:48:44.210043 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:48:44.210043 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:48:44.210043 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:48:44.210043 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:48:44.210043 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:48:44.210043 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 10 11:48:44.210043 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 10 11:48:44.210043 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID e40a8520-c9ee-4e01-8ef8-b33b028068dc Sep 10 11:48:44.210043 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:44.210043 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:48:44.210043 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:44.210043 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:48:44.210043 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:48:44.210043 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:48:44.210043 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:48:44.210043 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:48:44.210043 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID e40a8520-c9ee-4e01-8ef8-b33b028068dc Sep 10 11:48:44.210043 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:44.210043 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2d5807fb-63dc-4bfb-9313-98cdca5a76be tempest-FloatingIPsTestJSON-605148736 tempest-FloatingIPsTestJSON-605148736-project] Returning 404 to user: Floating IP not found for ID e40a8520-c9ee-4e01-8ef8-b33b028068dc {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:48:44.210043 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2d5807fb-63dc-4bfb-9313-98cdca5a76be tempest-FloatingIPsTestJSON-605148736 tempest-FloatingIPsTestJSON-605148736-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/e40a8520-c9ee-4e01-8ef8-b33b028068dc" status: 404 len: 111 microversion: 2.1 time: 0.118203 Sep 10 11:48:44.212872 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1160/2238] 10.222.0.23 () {58 vars in 1260 bytes} [Sat Sep 10 11:48:44 2022] GET /compute/v2.1/os-floating-ips/e40a8520-c9ee-4e01-8ef8-b33b028068dc => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 11:48:44.219761 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-db205916-168e-400f-9c15-d6bdcc9ade8a tempest-FloatingIPsTestJSON-605148736 tempest-FloatingIPsTestJSON-605148736-project] Calling method '.version_select at 0x7f40732be0d0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:44.324587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG neutronclient.v2_0.client [None req-db205916-168e-400f-9c15-d6bdcc9ade8a tempest-FloatingIPsTestJSON-605148736 tempest-FloatingIPsTestJSON-605148736-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP e40a8520-c9ee-4e01-8ef8-b33b028068dc could not be found", "detail": ""}} {{(pid=128777) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 11:48:44.325957 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-db205916-168e-400f-9c15-d6bdcc9ade8a tempest-FloatingIPsTestJSON-605148736 tempest-FloatingIPsTestJSON-605148736-project] HTTP exception thrown: Floating IP not found for ID e40a8520-c9ee-4e01-8ef8-b33b028068dc Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-db205916-168e-400f-9c15-d6bdcc9ade8a tempest-FloatingIPsTestJSON-605148736 tempest-FloatingIPsTestJSON-605148736-project] Request method failure captured: Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/os-floating-ips/e40a8520-c9ee-4e01-8ef8-b33b028068dc HTTP/1.1 Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHmPNmEV9oCwK-Pzlsv2DmPAKLVo_Qe23RoYZG6uTyWxp2EIQmeGYcShxM1xW--b8OiuLidGS79Iz9NwgS04BQd-vnSXjhk7nTtpELPDqJf7GVrjJFnpFbvf-7C4eLpP3vOC614P4Ez5B4yXyCCze55LPbLZButTY-2DOh1x_gIHQVQ Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 5493a49c2833495197b12632f94d5bd8 Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-FloatingIPsTestJSON-605148736 Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5493a49c2833495197b12632f94d5bd8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5493a49c2833495197b12632f94d5bd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5493a49c2833495197b12632f94d5bd8", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5493a49c2833495197b12632f94d5bd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-FloatingIPsTestJSON-605148736 Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 5493a49c2833495197b12632f94d5bd8 Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-FloatingIPsTestJSON-605148736 Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-FloatingIPsTestJSON-605148736-project Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: d58e356d147b4560bb113cafb530428c Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-FloatingIPsTestJSON-605148736-project Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: exception: Floating IP not found for ID e40a8520-c9ee-4e01-8ef8-b33b028068dc Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'e40a8520-c9ee-4e01-8ef8-b33b028068dc'} Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP e40a8520-c9ee-4e01-8ef8-b33b028068dc could not be found Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e0c2ca00-8404-484f-97ad-02bd428fd52f'] Sep 10 11:48:44.328131 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:44.333468 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:48:44.333468 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:44.333468 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:48:44.333468 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 10 11:48:44.333468 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 10 11:48:44.333468 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 10 11:48:44.333468 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 10 11:48:44.333468 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID e40a8520-c9ee-4e01-8ef8-b33b028068dc. Sep 10 11:48:44.333468 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:44.333468 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:48:44.333468 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:44.333468 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:48:44.333468 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:48:44.333468 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:48:44.333468 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:48:44.333468 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:48:44.333468 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:48:44.333468 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:48:44.333468 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:48:44.333468 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:48:44.333468 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 10 11:48:44.333468 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 10 11:48:44.333468 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID e40a8520-c9ee-4e01-8ef8-b33b028068dc Sep 10 11:48:44.333468 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:44.333468 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:48:44.333468 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:44.333468 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:48:44.333468 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:48:44.333468 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:48:44.333468 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:48:44.333468 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:48:44.333468 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID e40a8520-c9ee-4e01-8ef8-b33b028068dc Sep 10 11:48:44.333468 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:44.333468 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-db205916-168e-400f-9c15-d6bdcc9ade8a tempest-FloatingIPsTestJSON-605148736 tempest-FloatingIPsTestJSON-605148736-project] Returning 404 to user: Floating IP not found for ID e40a8520-c9ee-4e01-8ef8-b33b028068dc {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:48:44.338195 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-db205916-168e-400f-9c15-d6bdcc9ade8a tempest-FloatingIPsTestJSON-605148736 tempest-FloatingIPsTestJSON-605148736-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/e40a8520-c9ee-4e01-8ef8-b33b028068dc" status: 404 len: 111 microversion: 2.1 time: 0.123269 Sep 10 11:48:44.339045 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1161/2239] 10.222.0.23 () {58 vars in 1263 bytes} [Sat Sep 10 11:48:44 2022] DELETE /compute/v2.1/os-floating-ips/e40a8520-c9ee-4e01-8ef8-b33b028068dc => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:48:44.345184 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bd4f7697-178b-4785-bdc1-aa7998fd5d23 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:44.350634 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:48:44.356567 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bd4f7697-178b-4785-bdc1-aa7998fd5d23 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/727a5b3f-0317-46f9-9691-24caab6c3959" status: 200 len: 1315 microversion: 2.1 time: 0.559983 Sep 10 11:48:44.357418 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1079/2240] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:43 2022] GET /compute/v2.1/servers/727a5b3f-0317-46f9-9691-24caab6c3959 => generated 1315 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:44.360900 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-84bfbd9d-bc52-472c-8576-cd32306e1c2a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:44.363107 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-84bfbd9d-bc52-472c-8576-cd32306e1c2a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:44.385495 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-84bfbd9d-bc52-472c-8576-cd32306e1c2a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:44.386198 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-84bfbd9d-bc52-472c-8576-cd32306e1c2a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:44.387201 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-84bfbd9d-bc52-472c-8576-cd32306e1c2a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:44.388951 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-84bfbd9d-bc52-472c-8576-cd32306e1c2a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:44.391471 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-84bfbd9d-bc52-472c-8576-cd32306e1c2a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:44.392438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-84bfbd9d-bc52-472c-8576-cd32306e1c2a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:44.591326 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f3abf054-07f8-46a4-b383-083b89b43267 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Action: 'create', calling method: .version_select at 0x7f407396eb80>, body: {"keypair": {"name": "tempest-keypair-1646666279", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZ4JGYhAJROeKOcfdQg0xLFW/7GMrrCoCKSxseadChHypQh8VYeF1cXQi2HJ9C/JnLkX8NfBdTMcgQZEsVgljbGwBLLi+zHMLneH5S1MSLxsC+UgdxvdnsyV6oKl7/ExA=="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:48:44.614636 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-f3abf054-07f8-46a4-b383-083b89b43267 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Getting quotas for project 30967668a810420ebf3d44363f44a135. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:48:44.620691 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-f3abf054-07f8-46a4-b383-083b89b43267 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Getting quotas for user 8a32e3e1c1164b8abbb9ee6532e81e72 and project 30967668a810420ebf3d44363f44a135. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:48:44.654117 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f3abf054-07f8-46a4-b383-083b89b43267 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.130295 Sep 10 11:48:44.656679 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1080/2241] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 11:48:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:48:44.795062 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e7e661eb-d891-4721-8aaf-4c5c704fd5c6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:44.796123 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e7e661eb-d891-4721-8aaf-4c5c704fd5c6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:44.805443 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7e661eb-d891-4721-8aaf-4c5c704fd5c6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:44.805963 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7e661eb-d891-4721-8aaf-4c5c704fd5c6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:44.806405 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7e661eb-d891-4721-8aaf-4c5c704fd5c6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:44.807134 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7e661eb-d891-4721-8aaf-4c5c704fd5c6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:44.807625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7e661eb-d891-4721-8aaf-4c5c704fd5c6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:44.808063 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7e661eb-d891-4721-8aaf-4c5c704fd5c6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:44.997257 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-84bfbd9d-bc52-472c-8576-cd32306e1c2a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:45.012974 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-84bfbd9d-bc52-472c-8576-cd32306e1c2a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1477 microversion: 2.1 time: 0.672679 Sep 10 11:48:45.018076 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1162/2242] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:44 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1477 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:45.119393 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e7e661eb-d891-4721-8aaf-4c5c704fd5c6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:45.138655 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e7e661eb-d891-4721-8aaf-4c5c704fd5c6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 200 len: 1324 microversion: 2.1 time: 0.338866 Sep 10 11:48:45.139362 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1081/2243] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:44 2022] GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 1324 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:48:45.382138 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-166cf92d-17da-47fe-840a-06ec17b0691a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:45.382767 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-166cf92d-17da-47fe-840a-06ec17b0691a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 727a5b3f-0317-46f9-9691-24caab6c3959] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:45.390501 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-166cf92d-17da-47fe-840a-06ec17b0691a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:45.392363 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-166cf92d-17da-47fe-840a-06ec17b0691a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:45.393174 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-166cf92d-17da-47fe-840a-06ec17b0691a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:45.395202 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-166cf92d-17da-47fe-840a-06ec17b0691a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:45.395977 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-166cf92d-17da-47fe-840a-06ec17b0691a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:45.396902 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-166cf92d-17da-47fe-840a-06ec17b0691a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:45.562541 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-166cf92d-17da-47fe-840a-06ec17b0691a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:45.572518 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-166cf92d-17da-47fe-840a-06ec17b0691a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/727a5b3f-0317-46f9-9691-24caab6c3959" status: 200 len: 1315 microversion: 2.1 time: 0.195476 Sep 10 11:48:45.573113 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1163/2244] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:45 2022] GET /compute/v2.1/servers/727a5b3f-0317-46f9-9691-24caab6c3959 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:46.047063 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7c018ae3-d3d3-4180-b268-ad02e600b450 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:46.049987 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7c018ae3-d3d3-4180-b268-ad02e600b450 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:46.065795 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7c018ae3-d3d3-4180-b268-ad02e600b450 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:46.075545 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7c018ae3-d3d3-4180-b268-ad02e600b450 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:46.077629 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7c018ae3-d3d3-4180-b268-ad02e600b450 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:46.082956 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7c018ae3-d3d3-4180-b268-ad02e600b450 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:46.084380 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7c018ae3-d3d3-4180-b268-ad02e600b450 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:46.085197 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7c018ae3-d3d3-4180-b268-ad02e600b450 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:46.164871 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d13b244f-ef48-495f-8585-54147b8f369e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:46.165677 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d13b244f-ef48-495f-8585-54147b8f369e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:46.193855 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d13b244f-ef48-495f-8585-54147b8f369e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:46.197709 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d13b244f-ef48-495f-8585-54147b8f369e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:46.198585 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d13b244f-ef48-495f-8585-54147b8f369e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:46.199644 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d13b244f-ef48-495f-8585-54147b8f369e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:46.200628 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d13b244f-ef48-495f-8585-54147b8f369e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:46.201342 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d13b244f-ef48-495f-8585-54147b8f369e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:46.601290 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d13b244f-ef48-495f-8585-54147b8f369e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:46.613117 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d13b244f-ef48-495f-8585-54147b8f369e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 200 len: 1324 microversion: 2.1 time: 0.453254 Sep 10 11:48:46.614432 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1164/2245] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:46 2022] GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 1324 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:48:46.624528 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-d3d2a8be-6d50-45e4-9261-3e8d0178b19c req-aa44a52b-63c1-4fd1-b220-6ade6e1328f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ebabc55-1b1d-4276-8bde-d8d4859d74fd", "name": "network-vif-plugged", "status": "completed", "tag": "679e3ac9-dc5d-4404-aa8b-99020ce86192"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:48:46.640010 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d3d2a8be-6d50-45e4-9261-3e8d0178b19c req-aa44a52b-63c1-4fd1-b220-6ade6e1328f9 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:46.640910 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d3d2a8be-6d50-45e4-9261-3e8d0178b19c req-aa44a52b-63c1-4fd1-b220-6ade6e1328f9 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:46.644321 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d3d2a8be-6d50-45e4-9261-3e8d0178b19c req-aa44a52b-63c1-4fd1-b220-6ade6e1328f9 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:46.657327 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-d3d2a8be-6d50-45e4-9261-3e8d0178b19c req-aa44a52b-63c1-4fd1-b220-6ade6e1328f9 service nova] Creating event network-vif-plugged:679e3ac9-dc5d-4404-aa8b-99020ce86192 for instance 6ebabc55-1b1d-4276-8bde-d8d4859d74fd on n-h1-856895-1 Sep 10 11:48:46.669318 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-d3d2a8be-6d50-45e4-9261-3e8d0178b19c req-aa44a52b-63c1-4fd1-b220-6ade6e1328f9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048749 Sep 10 11:48:46.670765 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1165/2246] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:48:46.677879 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e84200d2-d50e-48ba-a58b-f660f739dc28 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:46.679656 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e84200d2-d50e-48ba-a58b-f660f739dc28 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 727a5b3f-0317-46f9-9691-24caab6c3959] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:46.688513 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e84200d2-d50e-48ba-a58b-f660f739dc28 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:46.689605 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e84200d2-d50e-48ba-a58b-f660f739dc28 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:46.690335 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e84200d2-d50e-48ba-a58b-f660f739dc28 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:46.691783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e84200d2-d50e-48ba-a58b-f660f739dc28 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:46.692455 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e84200d2-d50e-48ba-a58b-f660f739dc28 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:46.694102 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e84200d2-d50e-48ba-a58b-f660f739dc28 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:46.748187 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7c018ae3-d3d3-4180-b268-ad02e600b450 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:46.760757 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7c018ae3-d3d3-4180-b268-ad02e600b450 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1477 microversion: 2.1 time: 0.718987 Sep 10 11:48:46.777157 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1082/2247] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:46 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1477 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:47.212191 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e84200d2-d50e-48ba-a58b-f660f739dc28 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:47.216650 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:48:47.229209 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e84200d2-d50e-48ba-a58b-f660f739dc28 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/727a5b3f-0317-46f9-9691-24caab6c3959" status: 200 len: 1315 microversion: 2.1 time: 0.556066 Sep 10 11:48:47.232140 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1166/2248] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:46 2022] GET /compute/v2.1/servers/727a5b3f-0317-46f9-9691-24caab6c3959 => generated 1315 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:47.646292 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b4fe6ff6-af95-4d53-afe0-4b3d7915812b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:47.646292 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b4fe6ff6-af95-4d53-afe0-4b3d7915812b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:47.659871 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b4fe6ff6-af95-4d53-afe0-4b3d7915812b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:47.661545 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b4fe6ff6-af95-4d53-afe0-4b3d7915812b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:47.662191 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b4fe6ff6-af95-4d53-afe0-4b3d7915812b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:47.665285 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b4fe6ff6-af95-4d53-afe0-4b3d7915812b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:47.666049 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b4fe6ff6-af95-4d53-afe0-4b3d7915812b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:47.666551 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b4fe6ff6-af95-4d53-afe0-4b3d7915812b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:47.791283 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-723a1e07-31a6-4c5a-a38c-d788a19b092c tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:47.791919 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-723a1e07-31a6-4c5a-a38c-d788a19b092c tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:47.800549 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-723a1e07-31a6-4c5a-a38c-d788a19b092c tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:47.801515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-723a1e07-31a6-4c5a-a38c-d788a19b092c tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:47.802169 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-723a1e07-31a6-4c5a-a38c-d788a19b092c tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:47.803059 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-723a1e07-31a6-4c5a-a38c-d788a19b092c tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:47.803701 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-723a1e07-31a6-4c5a-a38c-d788a19b092c tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:47.804294 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-723a1e07-31a6-4c5a-a38c-d788a19b092c tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:48.716430 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-723a1e07-31a6-4c5a-a38c-d788a19b092c tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:48.728671 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-723a1e07-31a6-4c5a-a38c-d788a19b092c tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1477 microversion: 2.1 time: 0.942139 Sep 10 11:48:48.730183 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1167/2249] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:47 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1477 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:48.746044 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b4fe6ff6-af95-4d53-afe0-4b3d7915812b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:48.749731 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b4fe6ff6-af95-4d53-afe0-4b3d7915812b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 200 len: 1324 microversion: 2.1 time: 1.110247 Sep 10 11:48:48.751886 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1083/2250] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:47 2022] GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 1324 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:48.754743 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e318225e-0d1a-4961-b396-a94c8ea9e6ab tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:48.755649 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e318225e-0d1a-4961-b396-a94c8ea9e6ab tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 727a5b3f-0317-46f9-9691-24caab6c3959] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:48.762258 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e318225e-0d1a-4961-b396-a94c8ea9e6ab tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:48.762927 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e318225e-0d1a-4961-b396-a94c8ea9e6ab tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:48.763573 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e318225e-0d1a-4961-b396-a94c8ea9e6ab tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:48.764430 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e318225e-0d1a-4961-b396-a94c8ea9e6ab tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:48.764631 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8ea7628d-6a83-44ed-8011-bc4edc0dd500 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-682090865", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "62793341-942b-4c81-9f46-c24a385b1366"}], "security_groups": [{"name": "tempest-securitygroup--1937936099"}], "key_name": "tempest-keypair-1646666279", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:48:48.765705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e318225e-0d1a-4961-b396-a94c8ea9e6ab tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:48.765705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e318225e-0d1a-4961-b396-a94c8ea9e6ab tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:49.041883 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-8ea7628d-6a83-44ed-8011-bc4edc0dd500 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] validate_networks() for [('62793341-942b-4c81-9f46-c24a385b1366', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:48:49.288342 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e318225e-0d1a-4961-b396-a94c8ea9e6ab tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:49.305296 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e318225e-0d1a-4961-b396-a94c8ea9e6ab tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/727a5b3f-0317-46f9-9691-24caab6c3959" status: 200 len: 1315 microversion: 2.1 time: 0.555893 Sep 10 11:48:49.319194 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1168/2251] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:48 2022] GET /compute/v2.1/servers/727a5b3f-0317-46f9-9691-24caab6c3959 => generated 1315 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:49.319194 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-8b99fd92-03e2-4e0e-b7aa-0be0b69cb298 req-65646a4d-be12-4821-9327-6e95baadf19f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "727a5b3f-0317-46f9-9691-24caab6c3959", "name": "network-vif-plugged", "status": "completed", "tag": "50566b5c-6990-480d-acc2-8eec359a9212"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:48:49.326211 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8b99fd92-03e2-4e0e-b7aa-0be0b69cb298 req-65646a4d-be12-4821-9327-6e95baadf19f service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:49.326707 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8b99fd92-03e2-4e0e-b7aa-0be0b69cb298 req-65646a4d-be12-4821-9327-6e95baadf19f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:49.327144 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8b99fd92-03e2-4e0e-b7aa-0be0b69cb298 req-65646a4d-be12-4821-9327-6e95baadf19f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:49.342402 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-8b99fd92-03e2-4e0e-b7aa-0be0b69cb298 req-65646a4d-be12-4821-9327-6e95baadf19f service nova] Creating event network-vif-plugged:50566b5c-6990-480d-acc2-8eec359a9212 for instance 727a5b3f-0317-46f9-9691-24caab6c3959 on n-h2-856895-1 Sep 10 11:48:49.349047 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-8b99fd92-03e2-4e0e-b7aa-0be0b69cb298 req-65646a4d-be12-4821-9327-6e95baadf19f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041148 Sep 10 11:48:49.356460 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1169/2252] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:48:49.754248 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5ad18ea8-d081-4917-9f42-f40bd86d03c8 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:49.754982 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5ad18ea8-d081-4917-9f42-f40bd86d03c8 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:49.761585 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ad18ea8-d081-4917-9f42-f40bd86d03c8 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:49.762297 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ad18ea8-d081-4917-9f42-f40bd86d03c8 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:49.762902 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ad18ea8-d081-4917-9f42-f40bd86d03c8 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:49.763804 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ad18ea8-d081-4917-9f42-f40bd86d03c8 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:49.764422 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ad18ea8-d081-4917-9f42-f40bd86d03c8 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:49.765015 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ad18ea8-d081-4917-9f42-f40bd86d03c8 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:50.184981 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-8ea7628d-6a83-44ed-8011-bc4edc0dd500 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Getting quotas for project 30967668a810420ebf3d44363f44a135. Resources: dict_keys(['metadata_items']) {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:48:50.214583 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-8ea7628d-6a83-44ed-8011-bc4edc0dd500 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Getting quotas for user 8a32e3e1c1164b8abbb9ee6532e81e72 and project 30967668a810420ebf3d44363f44a135. Resources: dict_keys(['metadata_items']) {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:48:50.217032 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5ad18ea8-d081-4917-9f42-f40bd86d03c8 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:50.243737 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5ad18ea8-d081-4917-9f42-f40bd86d03c8 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1463 microversion: 2.1 time: 0.494417 Sep 10 11:48:50.247353 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1170/2253] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:49 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1463 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:50.254804 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5f9ed01f-9a2e-47d4-b844-679ee8bac7a6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:50.255470 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5f9ed01f-9a2e-47d4-b844-679ee8bac7a6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:50.258847 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-8ea7628d-6a83-44ed-8011-bc4edc0dd500 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:48:50.259426 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-8ea7628d-6a83-44ed-8011-bc4edc0dd500 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:48:50.260330 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-8ea7628d-6a83-44ed-8011-bc4edc0dd500 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:48:50.260970 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-8ea7628d-6a83-44ed-8011-bc4edc0dd500 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:48:50.262306 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-8ea7628d-6a83-44ed-8011-bc4edc0dd500 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:48:50.276563 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8ea7628d-6a83-44ed-8011-bc4edc0dd500 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:50.277366 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8ea7628d-6a83-44ed-8011-bc4edc0dd500 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:50.278093 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8ea7628d-6a83-44ed-8011-bc4edc0dd500 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:50.279510 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8ea7628d-6a83-44ed-8011-bc4edc0dd500 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:50.281535 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8ea7628d-6a83-44ed-8011-bc4edc0dd500 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:50.282210 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8ea7628d-6a83-44ed-8011-bc4edc0dd500 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:50.294235 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5f9ed01f-9a2e-47d4-b844-679ee8bac7a6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:50.294795 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5f9ed01f-9a2e-47d4-b844-679ee8bac7a6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:50.295207 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5f9ed01f-9a2e-47d4-b844-679ee8bac7a6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:50.298075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5f9ed01f-9a2e-47d4-b844-679ee8bac7a6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:50.300775 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5f9ed01f-9a2e-47d4-b844-679ee8bac7a6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:50.301268 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5f9ed01f-9a2e-47d4-b844-679ee8bac7a6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:50.332781 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-8ea7628d-6a83-44ed-8011-bc4edc0dd500 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Getting quotas for project 30967668a810420ebf3d44363f44a135. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:48:50.348405 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-8ea7628d-6a83-44ed-8011-bc4edc0dd500 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Getting quotas for user 8a32e3e1c1164b8abbb9ee6532e81e72 and project 30967668a810420ebf3d44363f44a135. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:48:50.390575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8ea7628d-6a83-44ed-8011-bc4edc0dd500 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:48:50.395335 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8ea7628d-6a83-44ed-8011-bc4edc0dd500 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] [instance: c5779770-492b-4ecd-bbc3-8e67b959c5a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:48:50.488927 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8ea7628d-6a83-44ed-8011-bc4edc0dd500 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.735034 Sep 10 11:48:50.490134 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1084/2254] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:48:48 2022] POST /compute/v2.1/servers => generated 409 bytes in 1738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:48:50.640329 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5f9ed01f-9a2e-47d4-b844-679ee8bac7a6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:50.663645 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5f9ed01f-9a2e-47d4-b844-679ee8bac7a6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 200 len: 1324 microversion: 2.1 time: 0.414914 Sep 10 11:48:50.680050 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1171/2255] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:50 2022] GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 1324 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:50.681656 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5a7ae4f6-73dc-41f2-92cb-8f8b15b31c02 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:50.682838 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5a7ae4f6-73dc-41f2-92cb-8f8b15b31c02 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:50.696285 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5a7ae4f6-73dc-41f2-92cb-8f8b15b31c02 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:50.697119 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5a7ae4f6-73dc-41f2-92cb-8f8b15b31c02 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:50.699304 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5a7ae4f6-73dc-41f2-92cb-8f8b15b31c02 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:50.702841 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5a7ae4f6-73dc-41f2-92cb-8f8b15b31c02 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:50.710640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5a7ae4f6-73dc-41f2-92cb-8f8b15b31c02 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:50.711543 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5a7ae4f6-73dc-41f2-92cb-8f8b15b31c02 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:50.900204 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f1d7d0f4-8b32-45e3-b765-e2ffe253a2c9 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:50.900897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f1d7d0f4-8b32-45e3-b765-e2ffe253a2c9 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:50.925083 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1d7d0f4-8b32-45e3-b765-e2ffe253a2c9 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:50.926963 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1d7d0f4-8b32-45e3-b765-e2ffe253a2c9 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:50.927724 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1d7d0f4-8b32-45e3-b765-e2ffe253a2c9 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:50.930164 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1d7d0f4-8b32-45e3-b765-e2ffe253a2c9 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:50.931320 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1d7d0f4-8b32-45e3-b765-e2ffe253a2c9 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:50.932128 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1d7d0f4-8b32-45e3-b765-e2ffe253a2c9 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:51.034707 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f1d7d0f4-8b32-45e3-b765-e2ffe253a2c9 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:48:51.208940 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f1d7d0f4-8b32-45e3-b765-e2ffe253a2c9 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 204 len: 0 microversion: 2.42 time: 0.716776 Sep 10 11:48:51.230146 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1085/2256] 10.222.0.23 () {60 vars in 1280 bytes} [Sat Sep 10 11:48:50 2022] DELETE /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 0 bytes in 735 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 11:48:51.246620 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-85dea7ec-0c61-45a1-a1e8-69e712e15f3c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:51.247842 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-85dea7ec-0c61-45a1-a1e8-69e712e15f3c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 727a5b3f-0317-46f9-9691-24caab6c3959] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:51.261415 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85dea7ec-0c61-45a1-a1e8-69e712e15f3c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:51.262228 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85dea7ec-0c61-45a1-a1e8-69e712e15f3c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:51.262933 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85dea7ec-0c61-45a1-a1e8-69e712e15f3c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:51.263905 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85dea7ec-0c61-45a1-a1e8-69e712e15f3c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:51.264969 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85dea7ec-0c61-45a1-a1e8-69e712e15f3c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:51.265660 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85dea7ec-0c61-45a1-a1e8-69e712e15f3c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:51.402934 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5a7ae4f6-73dc-41f2-92cb-8f8b15b31c02 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:51.416636 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5a7ae4f6-73dc-41f2-92cb-8f8b15b31c02 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1463 microversion: 2.1 time: 0.750883 Sep 10 11:48:51.417223 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1172/2257] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:50 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1463 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:51.433320 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b79d9a84-b459-4060-9d2b-929550c46683 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:51.433947 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b79d9a84-b459-4060-9d2b-929550c46683 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] [instance: c5779770-492b-4ecd-bbc3-8e67b959c5a3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:51.598736 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b79d9a84-b459-4060-9d2b-929550c46683 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a32e3e1c1164b8abbb9ee6532e81e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30967668a810420ebf3d44363f44a135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:51.610677 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b79d9a84-b459-4060-9d2b-929550c46683 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] 10.222.0.23 "GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3" status: 200 len: 1277 microversion: 2.1 time: 0.192381 Sep 10 11:48:51.611602 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1173/2258] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:51 2022] GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3 => generated 1277 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:51.618262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e1d509bd-b89b-4805-8c21-a91d7871395a tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:51.620141 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e1d509bd-b89b-4805-8c21-a91d7871395a tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:51.626381 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e1d509bd-b89b-4805-8c21-a91d7871395a tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:51.627064 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e1d509bd-b89b-4805-8c21-a91d7871395a tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:51.629446 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e1d509bd-b89b-4805-8c21-a91d7871395a tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:51.630370 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e1d509bd-b89b-4805-8c21-a91d7871395a tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:51.632439 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e1d509bd-b89b-4805-8c21-a91d7871395a tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:51.633064 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e1d509bd-b89b-4805-8c21-a91d7871395a tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:51.701422 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-85dea7ec-0c61-45a1-a1e8-69e712e15f3c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:51.710774 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-85dea7ec-0c61-45a1-a1e8-69e712e15f3c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/727a5b3f-0317-46f9-9691-24caab6c3959" status: 200 len: 1465 microversion: 2.1 time: 0.477396 Sep 10 11:48:51.711395 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1086/2259] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:51 2022] GET /compute/v2.1/servers/727a5b3f-0317-46f9-9691-24caab6c3959 => generated 1465 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:51.733847 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-380081ad-8bc2-4827-81f5-c7fc5076902f tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:48:51.736737 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-380081ad-8bc2-4827-81f5-c7fc5076902f tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:51.743432 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-380081ad-8bc2-4827-81f5-c7fc5076902f tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:51.743921 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-380081ad-8bc2-4827-81f5-c7fc5076902f tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:51.744422 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-380081ad-8bc2-4827-81f5-c7fc5076902f tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:51.745058 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-380081ad-8bc2-4827-81f5-c7fc5076902f tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:51.745677 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-380081ad-8bc2-4827-81f5-c7fc5076902f tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:51.746277 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-380081ad-8bc2-4827-81f5-c7fc5076902f tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:51.847350 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-380081ad-8bc2-4827-81f5-c7fc5076902f tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:48:51.847788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-380081ad-8bc2-4827-81f5-c7fc5076902f tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:48:51.848282 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-380081ad-8bc2-4827-81f5-c7fc5076902f tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:48:51.848678 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-380081ad-8bc2-4827-81f5-c7fc5076902f tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:48:51.849087 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-380081ad-8bc2-4827-81f5-c7fc5076902f tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:48:51.950481 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-380081ad-8bc2-4827-81f5-c7fc5076902f tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:51.975694 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-380081ad-8bc2-4827-81f5-c7fc5076902f tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:51.976213 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-380081ad-8bc2-4827-81f5-c7fc5076902f tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:51.976664 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-380081ad-8bc2-4827-81f5-c7fc5076902f tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:51.979463 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-380081ad-8bc2-4827-81f5-c7fc5076902f tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:51.982051 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-380081ad-8bc2-4827-81f5-c7fc5076902f tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:51.982918 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-380081ad-8bc2-4827-81f5-c7fc5076902f tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:52.023672 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-380081ad-8bc2-4827-81f5-c7fc5076902f tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "POST /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd/action" status: 202 len: 1067 microversion: 2.1 time: 0.294774 Sep 10 11:48:52.035470 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1087/2260] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:48:51 2022] POST /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd/action => generated 1067 bytes in 307 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 10 11:48:52.042965 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9fd923cc-6960-48d8-aacc-9eb93fa7e385 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:52.044925 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9fd923cc-6960-48d8-aacc-9eb93fa7e385 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:52.056745 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e1d509bd-b89b-4805-8c21-a91d7871395a tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:52.058265 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fd923cc-6960-48d8-aacc-9eb93fa7e385 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:52.058897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fd923cc-6960-48d8-aacc-9eb93fa7e385 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:52.059479 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fd923cc-6960-48d8-aacc-9eb93fa7e385 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:52.060425 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fd923cc-6960-48d8-aacc-9eb93fa7e385 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:52.061333 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fd923cc-6960-48d8-aacc-9eb93fa7e385 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:52.061867 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fd923cc-6960-48d8-aacc-9eb93fa7e385 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:52.070914 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e1d509bd-b89b-4805-8c21-a91d7871395a tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:52.078818 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e1d509bd-b89b-4805-8c21-a91d7871395a tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:52.080152 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e1d509bd-b89b-4805-8c21-a91d7871395a tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 2962 microversion: 2.42 time: 0.466172 Sep 10 11:48:52.080878 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1174/2261] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:48:51 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 2962 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:48:52.116246 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d07f6236-cb7a-4347-b72e-25280be90e83 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:52.128671 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d07f6236-cb7a-4347-b72e-25280be90e83 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] [instance: 727a5b3f-0317-46f9-9691-24caab6c3959] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:52.147768 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d07f6236-cb7a-4347-b72e-25280be90e83 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:52.148572 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d07f6236-cb7a-4347-b72e-25280be90e83 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:52.149242 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d07f6236-cb7a-4347-b72e-25280be90e83 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:52.150228 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d07f6236-cb7a-4347-b72e-25280be90e83 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:52.150902 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d07f6236-cb7a-4347-b72e-25280be90e83 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:52.151574 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d07f6236-cb7a-4347-b72e-25280be90e83 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:52.378463 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9fd923cc-6960-48d8-aacc-9eb93fa7e385 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:52.389576 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9fd923cc-6960-48d8-aacc-9eb93fa7e385 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 200 len: 1324 microversion: 2.1 time: 0.352509 Sep 10 11:48:52.390271 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1088/2262] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:52 2022] GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 1324 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:52.406134 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c66025af-2fcd-4e9b-8b1c-8f664094e1ac tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:52.407005 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c66025af-2fcd-4e9b-8b1c-8f664094e1ac tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:52.414076 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c66025af-2fcd-4e9b-8b1c-8f664094e1ac tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:52.414653 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c66025af-2fcd-4e9b-8b1c-8f664094e1ac tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:52.415329 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c66025af-2fcd-4e9b-8b1c-8f664094e1ac tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:52.416171 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c66025af-2fcd-4e9b-8b1c-8f664094e1ac tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:52.416821 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c66025af-2fcd-4e9b-8b1c-8f664094e1ac tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:52.417407 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c66025af-2fcd-4e9b-8b1c-8f664094e1ac tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:52.434225 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d07f6236-cb7a-4347-b72e-25280be90e83 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/727a5b3f-0317-46f9-9691-24caab6c3959" status: 200 len: 1616 microversion: 2.1 time: 0.335913 Sep 10 11:48:52.435916 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1175/2263] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:52 2022] GET /compute/v2.1/servers/727a5b3f-0317-46f9-9691-24caab6c3959 => generated 1616 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:52.443155 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-1b7dfa43-1dd1-40ec-aab0-085b0ac67497 req-a52fbdee-3e6a-4f25-b995-9e504849450c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cec74510-742b-4a47-b7c5-58411ca992de", "name": "network-vif-plugged", "status": "completed", "tag": "80da9e33-1a86-4d89-b08b-b5850346b6f1"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:48:52.454347 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-1b7dfa43-1dd1-40ec-aab0-085b0ac67497 req-a52fbdee-3e6a-4f25-b995-9e504849450c service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:52.455133 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-1b7dfa43-1dd1-40ec-aab0-085b0ac67497 req-a52fbdee-3e6a-4f25-b995-9e504849450c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:52.456557 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-1b7dfa43-1dd1-40ec-aab0-085b0ac67497 req-a52fbdee-3e6a-4f25-b995-9e504849450c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:52.474606 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-1b7dfa43-1dd1-40ec-aab0-085b0ac67497 req-a52fbdee-3e6a-4f25-b995-9e504849450c service nova] Creating event network-vif-plugged:80da9e33-1a86-4d89-b08b-b5850346b6f1 for instance cec74510-742b-4a47-b7c5-58411ca992de on n-h1-856895-1 Sep 10 11:48:52.481273 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-1b7dfa43-1dd1-40ec-aab0-085b0ac67497 req-a52fbdee-3e6a-4f25-b995-9e504849450c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043534 Sep 10 11:48:52.482769 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1176/2264] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:48:52.603734 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0d2a6f82-f6bf-412a-b70b-df9d05ec1fc3 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-783401661", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "d89db381-1e9d-40ee-b076-b024d38d38b1"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:48:52.667280 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-0d2a6f82-f6bf-412a-b70b-df9d05ec1fc3 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] validate_networks() for None {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:48:52.774173 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c66025af-2fcd-4e9b-8b1c-8f664094e1ac tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:52.781867 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c66025af-2fcd-4e9b-8b1c-8f664094e1ac tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1472 microversion: 2.1 time: 0.390232 Sep 10 11:48:52.787820 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1089/2265] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:52 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1472 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:52.788633 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e9ec676c-ed24-4f24-acd7-b478e1655579 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:52.789266 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e9ec676c-ed24-4f24-acd7-b478e1655579 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] [instance: c5779770-492b-4ecd-bbc3-8e67b959c5a3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:52.795312 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e9ec676c-ed24-4f24-acd7-b478e1655579 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:52.796179 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e9ec676c-ed24-4f24-acd7-b478e1655579 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:52.796388 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e9ec676c-ed24-4f24-acd7-b478e1655579 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:52.797097 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e9ec676c-ed24-4f24-acd7-b478e1655579 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:52.797829 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e9ec676c-ed24-4f24-acd7-b478e1655579 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:52.798270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e9ec676c-ed24-4f24-acd7-b478e1655579 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:52.907967 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e9ec676c-ed24-4f24-acd7-b478e1655579 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a32e3e1c1164b8abbb9ee6532e81e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30967668a810420ebf3d44363f44a135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:52.917724 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e9ec676c-ed24-4f24-acd7-b478e1655579 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] 10.222.0.23 "GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3" status: 200 len: 1281 microversion: 2.1 time: 0.133816 Sep 10 11:48:52.919009 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1090/2266] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:52 2022] GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3 => generated 1281 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:53.123081 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-97f78a85-40b3-456e-bc7c-76d24286c86b tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:53.124112 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-97f78a85-40b3-456e-bc7c-76d24286c86b tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:53.135807 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-97f78a85-40b3-456e-bc7c-76d24286c86b tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:53.141931 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-97f78a85-40b3-456e-bc7c-76d24286c86b tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:53.142614 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-97f78a85-40b3-456e-bc7c-76d24286c86b tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:53.144170 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-97f78a85-40b3-456e-bc7c-76d24286c86b tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:53.145689 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-97f78a85-40b3-456e-bc7c-76d24286c86b tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:53.148349 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-97f78a85-40b3-456e-bc7c-76d24286c86b tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:53.582922 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-0d2a6f82-f6bf-412a-b70b-df9d05ec1fc3 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:48:53.584162 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-0d2a6f82-f6bf-412a-b70b-df9d05ec1fc3 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:48:53.584834 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-0d2a6f82-f6bf-412a-b70b-df9d05ec1fc3 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:48:53.585635 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-0d2a6f82-f6bf-412a-b70b-df9d05ec1fc3 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:48:53.586677 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-0d2a6f82-f6bf-412a-b70b-df9d05ec1fc3 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:48:53.608001 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d2a6f82-f6bf-412a-b70b-df9d05ec1fc3 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:53.610414 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d2a6f82-f6bf-412a-b70b-df9d05ec1fc3 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:53.611267 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d2a6f82-f6bf-412a-b70b-df9d05ec1fc3 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:53.612445 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d2a6f82-f6bf-412a-b70b-df9d05ec1fc3 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:53.613594 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d2a6f82-f6bf-412a-b70b-df9d05ec1fc3 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:53.614700 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d2a6f82-f6bf-412a-b70b-df9d05ec1fc3 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:53.653229 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-0d2a6f82-f6bf-412a-b70b-df9d05ec1fc3 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Getting quotas for project 5949225a72e649c1adc217d5a760460a. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:48:53.664679 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-0d2a6f82-f6bf-412a-b70b-df9d05ec1fc3 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Getting quotas for user dfc33eb8645248f9b154587e7d8d449e and project 5949225a72e649c1adc217d5a760460a. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:48:53.669522 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-97f78a85-40b3-456e-bc7c-76d24286c86b tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:53.686526 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0d2a6f82-f6bf-412a-b70b-df9d05ec1fc3 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:48:53.686799 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-97f78a85-40b3-456e-bc7c-76d24286c86b tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:53.691334 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-97f78a85-40b3-456e-bc7c-76d24286c86b tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:53.691882 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0d2a6f82-f6bf-412a-b70b-df9d05ec1fc3 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d01d9406-b2a4-4b3b-af6b-832861ed820c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:48:53.696303 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-97f78a85-40b3-456e-bc7c-76d24286c86b tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 2962 microversion: 2.42 time: 0.584970 Sep 10 11:48:53.699507 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1091/2267] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:48:53 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 2962 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:48:53.710583 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-168a8cbc-c840-401b-888c-287a661867c3 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:53.715395 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-168a8cbc-c840-401b-888c-287a661867c3 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:53.729778 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-168a8cbc-c840-401b-888c-287a661867c3 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:53.733080 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-168a8cbc-c840-401b-888c-287a661867c3 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:53.733930 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-168a8cbc-c840-401b-888c-287a661867c3 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:53.736078 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-168a8cbc-c840-401b-888c-287a661867c3 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:53.743683 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-168a8cbc-c840-401b-888c-287a661867c3 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:53.744673 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-168a8cbc-c840-401b-888c-287a661867c3 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:53.769273 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0d2a6f82-f6bf-412a-b70b-df9d05ec1fc3 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.170434 Sep 10 11:48:53.770605 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1177/2268] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:48:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:48:53.781624 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-139986da-005d-427c-9924-50bb91c1f4b4 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:53.784740 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-139986da-005d-427c-9924-50bb91c1f4b4 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d01d9406-b2a4-4b3b-af6b-832861ed820c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:53.972142 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-139986da-005d-427c-9924-50bb91c1f4b4 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:53.985367 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-139986da-005d-427c-9924-50bb91c1f4b4 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c" status: 200 len: 1216 microversion: 2.1 time: 0.207444 Sep 10 11:48:53.986200 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1178/2269] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:53 2022] GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c => generated 1216 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:48:54.014855 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d343197d-f4c0-445c-9166-37a2f485120d tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:54.015448 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d343197d-f4c0-445c-9166-37a2f485120d tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:54.044228 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d343197d-f4c0-445c-9166-37a2f485120d tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:54.044983 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d343197d-f4c0-445c-9166-37a2f485120d tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:54.045657 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d343197d-f4c0-445c-9166-37a2f485120d tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:54.046713 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d343197d-f4c0-445c-9166-37a2f485120d tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:54.047642 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d343197d-f4c0-445c-9166-37a2f485120d tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:54.048229 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d343197d-f4c0-445c-9166-37a2f485120d tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:54.333162 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-168a8cbc-c840-401b-888c-287a661867c3 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:54.342177 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-168a8cbc-c840-401b-888c-287a661867c3 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 200 len: 1324 microversion: 2.1 time: 0.641326 Sep 10 11:48:54.348276 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1092/2270] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:53 2022] GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 1324 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:54.353741 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4b19f385-a859-42e5-baa5-182c0390011a tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:54.364101 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4b19f385-a859-42e5-baa5-182c0390011a tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] [instance: c5779770-492b-4ecd-bbc3-8e67b959c5a3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:54.375884 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b19f385-a859-42e5-baa5-182c0390011a tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:54.377123 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b19f385-a859-42e5-baa5-182c0390011a tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:54.379037 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b19f385-a859-42e5-baa5-182c0390011a tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:54.380941 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b19f385-a859-42e5-baa5-182c0390011a tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:54.382080 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b19f385-a859-42e5-baa5-182c0390011a tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:54.383766 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b19f385-a859-42e5-baa5-182c0390011a tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:54.573667 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4b19f385-a859-42e5-baa5-182c0390011a tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a32e3e1c1164b8abbb9ee6532e81e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30967668a810420ebf3d44363f44a135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:54.588138 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4b19f385-a859-42e5-baa5-182c0390011a tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] 10.222.0.23 "GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3" status: 200 len: 1329 microversion: 2.1 time: 0.238230 Sep 10 11:48:54.588768 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1093/2271] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:54 2022] GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3 => generated 1329 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:54.639626 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d343197d-f4c0-445c-9166-37a2f485120d tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:54.657367 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d343197d-f4c0-445c-9166-37a2f485120d tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1472 microversion: 2.1 time: 0.649621 Sep 10 11:48:54.657984 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1179/2272] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:53 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1472 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:54.728489 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-16cfeac1-ead0-44dc-89e9-c5dce6a9c382 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:54.729131 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-16cfeac1-ead0-44dc-89e9-c5dce6a9c382 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:54.738471 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16cfeac1-ead0-44dc-89e9-c5dce6a9c382 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:54.739263 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16cfeac1-ead0-44dc-89e9-c5dce6a9c382 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:54.740008 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16cfeac1-ead0-44dc-89e9-c5dce6a9c382 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:54.741017 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16cfeac1-ead0-44dc-89e9-c5dce6a9c382 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:54.741575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16cfeac1-ead0-44dc-89e9-c5dce6a9c382 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:54.742084 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16cfeac1-ead0-44dc-89e9-c5dce6a9c382 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:54.769792 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:48:55.009923 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-acd661dd-24dc-4629-af7b-b5af1bb86fdf tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:55.010586 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-acd661dd-24dc-4629-af7b-b5af1bb86fdf tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d01d9406-b2a4-4b3b-af6b-832861ed820c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:55.017276 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-acd661dd-24dc-4629-af7b-b5af1bb86fdf tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:55.018601 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-acd661dd-24dc-4629-af7b-b5af1bb86fdf tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:55.019046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-acd661dd-24dc-4629-af7b-b5af1bb86fdf tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:55.019788 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-acd661dd-24dc-4629-af7b-b5af1bb86fdf tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:55.020418 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-acd661dd-24dc-4629-af7b-b5af1bb86fdf tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:55.020969 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-acd661dd-24dc-4629-af7b-b5af1bb86fdf tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:55.041430 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-16cfeac1-ead0-44dc-89e9-c5dce6a9c382 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:55.053162 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-16cfeac1-ead0-44dc-89e9-c5dce6a9c382 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:55.055050 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-16cfeac1-ead0-44dc-89e9-c5dce6a9c382 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:55.056600 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-16cfeac1-ead0-44dc-89e9-c5dce6a9c382 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 2962 microversion: 2.42 time: 0.332393 Sep 10 11:48:55.057363 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1094/2273] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:48:54 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 2962 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:48:55.130681 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-acd661dd-24dc-4629-af7b-b5af1bb86fdf tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:55.139988 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-acd661dd-24dc-4629-af7b-b5af1bb86fdf tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c" status: 200 len: 1220 microversion: 2.1 time: 0.134126 Sep 10 11:48:55.140583 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1180/2274] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:55 2022] GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c => generated 1220 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:55.374339 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9ea3e0ba-db41-4f09-876a-0431919266bf tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:55.375206 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9ea3e0ba-db41-4f09-876a-0431919266bf tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:55.383520 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ea3e0ba-db41-4f09-876a-0431919266bf tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:55.386554 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ea3e0ba-db41-4f09-876a-0431919266bf tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:55.390149 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ea3e0ba-db41-4f09-876a-0431919266bf tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:55.393975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ea3e0ba-db41-4f09-876a-0431919266bf tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:55.394688 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ea3e0ba-db41-4f09-876a-0431919266bf tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:55.395144 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ea3e0ba-db41-4f09-876a-0431919266bf tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:55.614739 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5c35026d-b7fa-4ff9-8cec-45122584fde3 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:55.615387 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5c35026d-b7fa-4ff9-8cec-45122584fde3 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] [instance: c5779770-492b-4ecd-bbc3-8e67b959c5a3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:55.622182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c35026d-b7fa-4ff9-8cec-45122584fde3 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:55.622909 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c35026d-b7fa-4ff9-8cec-45122584fde3 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:55.623541 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c35026d-b7fa-4ff9-8cec-45122584fde3 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:55.624473 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c35026d-b7fa-4ff9-8cec-45122584fde3 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:55.625078 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c35026d-b7fa-4ff9-8cec-45122584fde3 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:55.625663 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c35026d-b7fa-4ff9-8cec-45122584fde3 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:55.667495 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9ea3e0ba-db41-4f09-876a-0431919266bf tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:55.677771 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9ea3e0ba-db41-4f09-876a-0431919266bf tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 200 len: 1324 microversion: 2.1 time: 0.307167 Sep 10 11:48:55.678824 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1095/2275] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:55 2022] GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 1324 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:55.698205 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6d91fe70-662e-4540-b7d5-48d3d12882c2 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:55.699240 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6d91fe70-662e-4540-b7d5-48d3d12882c2 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:55.707592 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6d91fe70-662e-4540-b7d5-48d3d12882c2 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:55.712090 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6d91fe70-662e-4540-b7d5-48d3d12882c2 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:55.714482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6d91fe70-662e-4540-b7d5-48d3d12882c2 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:55.715552 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6d91fe70-662e-4540-b7d5-48d3d12882c2 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:55.718425 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6d91fe70-662e-4540-b7d5-48d3d12882c2 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:55.719151 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6d91fe70-662e-4540-b7d5-48d3d12882c2 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:55.754977 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5c35026d-b7fa-4ff9-8cec-45122584fde3 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a32e3e1c1164b8abbb9ee6532e81e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30967668a810420ebf3d44363f44a135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:55.767337 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5c35026d-b7fa-4ff9-8cec-45122584fde3 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] 10.222.0.23 "GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3" status: 200 len: 1329 microversion: 2.1 time: 0.155618 Sep 10 11:48:55.775326 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1181/2276] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:55 2022] GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3 => generated 1329 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:56.098221 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6d91fe70-662e-4540-b7d5-48d3d12882c2 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:56.099010 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-dd395def-b2a6-4bf4-8cae-21fec600ac4f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:56.099871 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-dd395def-b2a6-4bf4-8cae-21fec600ac4f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:56.113589 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6d91fe70-662e-4540-b7d5-48d3d12882c2 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1472 microversion: 2.1 time: 0.433399 Sep 10 11:48:56.127200 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd395def-b2a6-4bf4-8cae-21fec600ac4f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:56.127200 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd395def-b2a6-4bf4-8cae-21fec600ac4f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:56.127200 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd395def-b2a6-4bf4-8cae-21fec600ac4f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:56.127200 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd395def-b2a6-4bf4-8cae-21fec600ac4f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:56.127200 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd395def-b2a6-4bf4-8cae-21fec600ac4f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:56.127200 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd395def-b2a6-4bf4-8cae-21fec600ac4f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:56.132907 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1096/2277] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:55 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1472 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:56.166959 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-71981aef-24e5-4221-a2ad-5ddc65e98b56 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:56.167629 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-71981aef-24e5-4221-a2ad-5ddc65e98b56 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d01d9406-b2a4-4b3b-af6b-832861ed820c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:56.176963 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-71981aef-24e5-4221-a2ad-5ddc65e98b56 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:56.177754 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-71981aef-24e5-4221-a2ad-5ddc65e98b56 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:56.180276 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-71981aef-24e5-4221-a2ad-5ddc65e98b56 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:56.181256 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-71981aef-24e5-4221-a2ad-5ddc65e98b56 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:56.182819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-71981aef-24e5-4221-a2ad-5ddc65e98b56 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:56.186206 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-71981aef-24e5-4221-a2ad-5ddc65e98b56 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:56.304734 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-71981aef-24e5-4221-a2ad-5ddc65e98b56 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:56.317582 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-71981aef-24e5-4221-a2ad-5ddc65e98b56 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c" status: 200 len: 1212 microversion: 2.1 time: 0.151983 Sep 10 11:48:56.318598 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1097/2278] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:56 2022] GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c => generated 1212 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:48:56.519376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-dd395def-b2a6-4bf4-8cae-21fec600ac4f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:56.534715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-dd395def-b2a6-4bf4-8cae-21fec600ac4f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:56.538342 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-dd395def-b2a6-4bf4-8cae-21fec600ac4f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:56.541046 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-dd395def-b2a6-4bf4-8cae-21fec600ac4f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 2962 microversion: 2.42 time: 0.459708 Sep 10 11:48:56.543611 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1182/2279] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:48:56 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 2962 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:48:56.702430 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-faa879de-266c-4313-93e9-459f33f9586d tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:56.703785 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-faa879de-266c-4313-93e9-459f33f9586d tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:56.717759 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-faa879de-266c-4313-93e9-459f33f9586d tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:56.718997 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-faa879de-266c-4313-93e9-459f33f9586d tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:56.719661 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-faa879de-266c-4313-93e9-459f33f9586d tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:56.720723 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-faa879de-266c-4313-93e9-459f33f9586d tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:56.721567 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-faa879de-266c-4313-93e9-459f33f9586d tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:56.722271 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-faa879de-266c-4313-93e9-459f33f9586d tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:56.799208 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3e5e5742-895c-44df-9ef2-8e24370ab020 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:56.800632 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3e5e5742-895c-44df-9ef2-8e24370ab020 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] [instance: c5779770-492b-4ecd-bbc3-8e67b959c5a3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:56.806939 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e5e5742-895c-44df-9ef2-8e24370ab020 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:56.807688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e5e5742-895c-44df-9ef2-8e24370ab020 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:56.808135 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e5e5742-895c-44df-9ef2-8e24370ab020 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:56.808851 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e5e5742-895c-44df-9ef2-8e24370ab020 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:56.809310 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e5e5742-895c-44df-9ef2-8e24370ab020 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:56.809896 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e5e5742-895c-44df-9ef2-8e24370ab020 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:56.915648 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3e5e5742-895c-44df-9ef2-8e24370ab020 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a32e3e1c1164b8abbb9ee6532e81e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30967668a810420ebf3d44363f44a135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:56.928676 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3e5e5742-895c-44df-9ef2-8e24370ab020 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] 10.222.0.23 "GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3" status: 200 len: 1335 microversion: 2.1 time: 0.133428 Sep 10 11:48:56.930485 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1183/2280] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:56 2022] GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3 => generated 1335 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:48:56.980497 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-faa879de-266c-4313-93e9-459f33f9586d tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:56.992764 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-faa879de-266c-4313-93e9-459f33f9586d tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 200 len: 1520 microversion: 2.1 time: 0.295611 Sep 10 11:48:56.993980 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1098/2281] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:56 2022] GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 1520 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:57.021358 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-11d6307d-1a89-455d-b72d-d6042462a9f6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:57.022284 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-11d6307d-1a89-455d-b72d-d6042462a9f6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:57.029597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-11d6307d-1a89-455d-b72d-d6042462a9f6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:57.030490 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-11d6307d-1a89-455d-b72d-d6042462a9f6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:57.031107 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-11d6307d-1a89-455d-b72d-d6042462a9f6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:57.032015 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-11d6307d-1a89-455d-b72d-d6042462a9f6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:57.032630 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-11d6307d-1a89-455d-b72d-d6042462a9f6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:57.033218 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-11d6307d-1a89-455d-b72d-d6042462a9f6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:57.141716 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-89328850-4a69-47df-aea9-2421f81942e1 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:57.144061 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-89328850-4a69-47df-aea9-2421f81942e1 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:57.154916 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89328850-4a69-47df-aea9-2421f81942e1 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:57.156054 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89328850-4a69-47df-aea9-2421f81942e1 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:57.157434 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89328850-4a69-47df-aea9-2421f81942e1 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:57.159487 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89328850-4a69-47df-aea9-2421f81942e1 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:57.160747 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89328850-4a69-47df-aea9-2421f81942e1 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:57.161453 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89328850-4a69-47df-aea9-2421f81942e1 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:57.212867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-11d6307d-1a89-455d-b72d-d6042462a9f6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:57.223013 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-11d6307d-1a89-455d-b72d-d6042462a9f6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 200 len: 1520 microversion: 2.1 time: 0.205416 Sep 10 11:48:57.224309 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1184/2282] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:57 2022] GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:57.246571 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-19226b11-362d-4a69-a138-1f0f8a80d1a9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-798425792", "metadata": {"": ""}}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-19226b11-362d-4a69-a138-1f0f8a80d1a9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Request method failure captured: Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de/action HTTP/1.1 Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 106 Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHmIwAMwYRG5GoKY2e2BrHSNWC_XC8Dle2TjpsTglJZLl4iDdUWRHXObue6CBNwrU7ByI06vvCBASR59oLGdEXbdGMvKthtN9mtTXSrKa2RC4WmIF4PSo8bwMo95sbb-sIH1rhBMLrXpSep-X_LgFDTkeIXb7VSYHefdo66ew2GGhFc Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 3e5d376048de4c3191a58a547e05fd07 Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1177602115 Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3e5d376048de4c3191a58a547e05fd07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3e5d376048de4c3191a58a547e05fd07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3e5d376048de4c3191a58a547e05fd07", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3e5d376048de4c3191a58a547e05fd07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1177602115 Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 3e5d376048de4c3191a58a547e05fd07 Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1177602115 Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ImagesOneServerNegativeTestJSON-1177602115-project Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 8ced1e84956246b6bb7384ba484fde54 Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1177602115-project Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-798425792", "metadata": {"": ""}}} Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'cec74510-742b-4a47-b7c5-58411ca992de', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-798425792', 'metadata': {'': ''}}}} Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise error Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi {'': ''} Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:48:57.267478 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 11:48:57.272174 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 11:48:57.272174 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 11:48:57.272174 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 11:48:57.272174 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 11:48:57.272174 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 11:48:57.272174 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 11:48:57.272174 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:57.272174 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:48:57.272174 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:57.272174 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:48:57.272174 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:48:57.272174 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:48:57.272174 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 11:48:57.272174 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 11:48:57.272174 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 11:48:57.272174 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:57.276942 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-19226b11-362d-4a69-a138-1f0f8a80d1a9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:48:57.278226 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-19226b11-362d-4a69-a138-1f0f8a80d1a9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "POST /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de/action" status: 400 len: 170 microversion: 2.1 time: 0.036048 Sep 10 11:48:57.279533 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1185/2283] 10.222.0.23 () {60 vars in 1279 bytes} [Sat Sep 10 11:48:57 2022] POST /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de/action => generated 170 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 10 11:48:57.288869 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9e8beb6c-29d1-42b4-a083-a3ae645a742b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:57.289801 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9e8beb6c-29d1-42b4-a083-a3ae645a742b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:57.308188 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9e8beb6c-29d1-42b4-a083-a3ae645a742b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:57.311226 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9e8beb6c-29d1-42b4-a083-a3ae645a742b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:57.312279 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9e8beb6c-29d1-42b4-a083-a3ae645a742b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:57.313424 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9e8beb6c-29d1-42b4-a083-a3ae645a742b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:57.313916 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9e8beb6c-29d1-42b4-a083-a3ae645a742b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:57.314411 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9e8beb6c-29d1-42b4-a083-a3ae645a742b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:57.373942 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-89328850-4a69-47df-aea9-2421f81942e1 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:57.385424 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-89328850-4a69-47df-aea9-2421f81942e1 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1472 microversion: 2.1 time: 0.248320 Sep 10 11:48:57.386669 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1099/2284] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:57 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1472 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:57.408210 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-95802cf2-3fd0-4cbb-8c9d-1b584811caad tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:57.413183 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-95802cf2-3fd0-4cbb-8c9d-1b584811caad tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d01d9406-b2a4-4b3b-af6b-832861ed820c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:57.429914 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-95802cf2-3fd0-4cbb-8c9d-1b584811caad tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:57.431059 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-95802cf2-3fd0-4cbb-8c9d-1b584811caad tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:57.431743 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-95802cf2-3fd0-4cbb-8c9d-1b584811caad tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:57.432841 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-95802cf2-3fd0-4cbb-8c9d-1b584811caad tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:57.433531 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-95802cf2-3fd0-4cbb-8c9d-1b584811caad tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:57.434738 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-95802cf2-3fd0-4cbb-8c9d-1b584811caad tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:57.921419 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-95802cf2-3fd0-4cbb-8c9d-1b584811caad tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:57.930439 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-95802cf2-3fd0-4cbb-8c9d-1b584811caad tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c" status: 200 len: 1276 microversion: 2.1 time: 0.542385 Sep 10 11:48:57.943686 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1100/2285] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:57 2022] GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c => generated 1276 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:57.953718 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e544880a-9eeb-473d-a5e5-c7a0d915eaf3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:57.954731 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e544880a-9eeb-473d-a5e5-c7a0d915eaf3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:57.960742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9e8beb6c-29d1-42b4-a083-a3ae645a742b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:57.963013 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e544880a-9eeb-473d-a5e5-c7a0d915eaf3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:57.963752 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e544880a-9eeb-473d-a5e5-c7a0d915eaf3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:57.964357 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e544880a-9eeb-473d-a5e5-c7a0d915eaf3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:57.965308 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e544880a-9eeb-473d-a5e5-c7a0d915eaf3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:57.966218 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e544880a-9eeb-473d-a5e5-c7a0d915eaf3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:57.966804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e544880a-9eeb-473d-a5e5-c7a0d915eaf3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:57.977217 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9e8beb6c-29d1-42b4-a083-a3ae645a742b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 200 len: 1520 microversion: 2.1 time: 0.693243 Sep 10 11:48:57.978436 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1186/2286] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:57 2022] GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 1520 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:57.991754 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cfaaf251-188c-4213-82b1-cd75b6959302 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:57.992411 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cfaaf251-188c-4213-82b1-cd75b6959302 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] [instance: c5779770-492b-4ecd-bbc3-8e67b959c5a3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:58.018664 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cfaaf251-188c-4213-82b1-cd75b6959302 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:58.019440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cfaaf251-188c-4213-82b1-cd75b6959302 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:58.021278 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cfaaf251-188c-4213-82b1-cd75b6959302 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:58.022235 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cfaaf251-188c-4213-82b1-cd75b6959302 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:58.022900 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cfaaf251-188c-4213-82b1-cd75b6959302 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:58.023541 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cfaaf251-188c-4213-82b1-cd75b6959302 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:58.136932 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cfaaf251-188c-4213-82b1-cd75b6959302 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a32e3e1c1164b8abbb9ee6532e81e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30967668a810420ebf3d44363f44a135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:58.147263 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cfaaf251-188c-4213-82b1-cd75b6959302 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] 10.222.0.23 "GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3" status: 200 len: 1335 microversion: 2.1 time: 0.166654 Sep 10 11:48:58.183436 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1187/2287] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:57 2022] GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3 => generated 1335 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:58.198792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5732b44a-b7f2-4a76-88c4-64be2e5e1c9f tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:58.202276 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5732b44a-b7f2-4a76-88c4-64be2e5e1c9f tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:58.224026 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5732b44a-b7f2-4a76-88c4-64be2e5e1c9f tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:58.234293 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5732b44a-b7f2-4a76-88c4-64be2e5e1c9f tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:58.235425 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5732b44a-b7f2-4a76-88c4-64be2e5e1c9f tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:58.236385 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5732b44a-b7f2-4a76-88c4-64be2e5e1c9f tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:58.238003 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5732b44a-b7f2-4a76-88c4-64be2e5e1c9f tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:58.238619 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5732b44a-b7f2-4a76-88c4-64be2e5e1c9f tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:58.279053 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=100 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:48:58.463587 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e544880a-9eeb-473d-a5e5-c7a0d915eaf3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:58.476825 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e544880a-9eeb-473d-a5e5-c7a0d915eaf3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:58.478839 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e544880a-9eeb-473d-a5e5-c7a0d915eaf3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:58.480594 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e544880a-9eeb-473d-a5e5-c7a0d915eaf3 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 2962 microversion: 2.42 time: 0.535574 Sep 10 11:48:58.481731 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1101/2288] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:48:57 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 2962 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:48:58.486409 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-705c06e8-c059-4c62-84c4-1a320ae4c0ed req-932f6ba5-5097-48e5-a04a-097ea5818846 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a", "name": "network-vif-unplugged", "status": "completed", "tag": "22d4e712-b79b-4d38-8916-a0128c576b77"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:48:58.498480 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:48:58.501811 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-705c06e8-c059-4c62-84c4-1a320ae4c0ed req-932f6ba5-5097-48e5-a04a-097ea5818846 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:58.503153 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-705c06e8-c059-4c62-84c4-1a320ae4c0ed req-932f6ba5-5097-48e5-a04a-097ea5818846 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:58.505157 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-705c06e8-c059-4c62-84c4-1a320ae4c0ed req-932f6ba5-5097-48e5-a04a-097ea5818846 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:58.532654 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-705c06e8-c059-4c62-84c4-1a320ae4c0ed req-932f6ba5-5097-48e5-a04a-097ea5818846 service nova] Creating event network-vif-unplugged:22d4e712-b79b-4d38-8916-a0128c576b77 for instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a on n-h1-856895-1 Sep 10 11:48:58.539128 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-705c06e8-c059-4c62-84c4-1a320ae4c0ed req-932f6ba5-5097-48e5-a04a-097ea5818846 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056020 Sep 10 11:48:58.539993 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1102/2289] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:48:58.546631 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4567f242-0941-4b2d-a0b8-87581d566755 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:58.547817 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4567f242-0941-4b2d-a0b8-87581d566755 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:58.554982 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4567f242-0941-4b2d-a0b8-87581d566755 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:58.555769 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4567f242-0941-4b2d-a0b8-87581d566755 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:58.556432 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4567f242-0941-4b2d-a0b8-87581d566755 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:58.557480 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4567f242-0941-4b2d-a0b8-87581d566755 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:58.558109 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4567f242-0941-4b2d-a0b8-87581d566755 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:58.558729 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4567f242-0941-4b2d-a0b8-87581d566755 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:58.787738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5732b44a-b7f2-4a76-88c4-64be2e5e1c9f tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:58.797013 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5732b44a-b7f2-4a76-88c4-64be2e5e1c9f tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 200 len: 1520 microversion: 2.1 time: 0.605894 Sep 10 11:48:58.811222 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1188/2290] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:58 2022] GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 1520 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:58.821738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c8c23bc6-00c8-431a-a01b-dc302ad5e812 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-589346076", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:48:58.827138 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c8c23bc6-00c8-431a-a01b-dc302ad5e812 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Request method failure captured: Sep 10 11:48:58.827138 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de/action HTTP/1.1 Sep 10 11:48:58.827138 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:48:58.827138 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:48:58.827138 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:48:58.827138 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 618 Sep 10 11:48:58.827138 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:48:58.827138 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:48:58.827138 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:48:58.827138 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:48:58.827138 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHmIwAMwYRG5GoKY2e2BrHSNWC_XC8Dle2TjpsTglJZLl4iDdUWRHXObue6CBNwrU7ByI06vvCBASR59oLGdEXbdGMvKthtN9mtTXSrKa2RC4WmIF4PSo8bwMo95sbb-sIH1rhBMLrXpSep-X_LgFDTkeIXb7VSYHefdo66ew2GGhFc Sep 10 11:48:58.827138 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:48:58.827138 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:48:58.827138 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:48:58.827138 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:48:58.827138 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:48:58.827138 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:48:58.827138 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 3e5d376048de4c3191a58a547e05fd07 Sep 10 11:48:58.827138 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1177602115 Sep 10 11:48:58.827138 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:48:58.827138 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:48:58.827138 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3e5d376048de4c3191a58a547e05fd07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3e5d376048de4c3191a58a547e05fd07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3e5d376048de4c3191a58a547e05fd07", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3e5d376048de4c3191a58a547e05fd07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:48:58.827138 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1177602115 Sep 10 11:48:58.827138 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 3e5d376048de4c3191a58a547e05fd07 Sep 10 11:48:58.827138 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1177602115 Sep 10 11:48:58.827138 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ImagesOneServerNegativeTestJSON-1177602115-project Sep 10 11:48:58.827138 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:48:58.827138 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:48:58.827138 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 8ced1e84956246b6bb7384ba484fde54 Sep 10 11:48:58.827138 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1177602115-project Sep 10 11:48:58.827138 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:48:58.827138 n-d-856895-1 devstack@n-api.service[128777]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-589346076", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Sep 10 11:48:58.827138 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:48:58.827138 n-d-856895-1 devstack@n-api.service[128777]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 11:48:58.827138 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'cec74510-742b-4a47-b7c5-58411ca992de', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-589346076', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Sep 10 11:48:58.827138 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:48:58.827138 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:48:58.827138 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 11:48:58.827138 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 11:48:58.827138 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 11:48:58.827138 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise error Sep 10 11:48:58.829839 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 11:48:58.829839 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:58.829839 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 10 11:48:58.829839 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 10 11:48:58.829839 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 10 11:48:58.829839 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 10 11:48:58.829839 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 10 11:48:58.829839 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:58.829839 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 10 11:48:58.829839 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Sep 10 11:48:58.829839 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:58.829839 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:48:58.829839 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:58.829839 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:48:58.829839 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:48:58.829839 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:48:58.829839 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:48:58.829839 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:48:58.829839 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:48:58.829839 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:48:58.829839 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:48:58.829839 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:48:58.829839 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 11:48:58.829839 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 11:48:58.829839 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 11:48:58.829839 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 11:48:58.829839 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 11:48:58.829839 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 11:48:58.829839 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 11:48:58.829839 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:58.829839 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:48:58.829839 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:58.829839 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:48:58.829839 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:48:58.829839 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:48:58.829839 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 11:48:58.829839 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 11:48:58.829839 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 11:48:58.829839 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:58.834284 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c8c23bc6-00c8-431a-a01b-dc302ad5e812 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:48:58.835450 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c8c23bc6-00c8-431a-a01b-dc302ad5e812 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "POST /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de/action" status: 400 len: 938 microversion: 2.1 time: 0.017998 Sep 10 11:48:58.841346 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1189/2291] 10.222.0.23 () {60 vars in 1279 bytes} [Sat Sep 10 11:48:58 2022] POST /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de/action => generated 938 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:48:58.847196 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5eacce26-0b43-4726-8abf-9931a887d601 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:58.848171 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5eacce26-0b43-4726-8abf-9931a887d601 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:58.855607 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5eacce26-0b43-4726-8abf-9931a887d601 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:58.857720 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5eacce26-0b43-4726-8abf-9931a887d601 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:58.858471 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5eacce26-0b43-4726-8abf-9931a887d601 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:58.859670 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5eacce26-0b43-4726-8abf-9931a887d601 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:58.860413 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5eacce26-0b43-4726-8abf-9931a887d601 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:58.861074 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5eacce26-0b43-4726-8abf-9931a887d601 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:58.883092 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4567f242-0941-4b2d-a0b8-87581d566755 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:58.893945 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4567f242-0941-4b2d-a0b8-87581d566755 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1472 microversion: 2.1 time: 0.351306 Sep 10 11:48:58.894865 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1103/2292] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:58 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1472 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:58.959960 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c9bacd1b-b855-42bf-8648-33c46c417710 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:58.960933 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c9bacd1b-b855-42bf-8648-33c46c417710 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d01d9406-b2a4-4b3b-af6b-832861ed820c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:58.972157 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9bacd1b-b855-42bf-8648-33c46c417710 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:58.973923 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9bacd1b-b855-42bf-8648-33c46c417710 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:58.974703 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9bacd1b-b855-42bf-8648-33c46c417710 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:58.976827 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9bacd1b-b855-42bf-8648-33c46c417710 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:58.977815 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9bacd1b-b855-42bf-8648-33c46c417710 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:58.979523 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9bacd1b-b855-42bf-8648-33c46c417710 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:59.075930 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5eacce26-0b43-4726-8abf-9931a887d601 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:59.086789 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5eacce26-0b43-4726-8abf-9931a887d601 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 200 len: 1520 microversion: 2.1 time: 0.243872 Sep 10 11:48:59.088091 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1190/2293] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:58 2022] GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 1520 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:59.121042 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2bf84605-cb7a-41ab-abf0-393294cb6014 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:59.121827 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2bf84605-cb7a-41ab-abf0-393294cb6014 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:59.131045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2bf84605-cb7a-41ab-abf0-393294cb6014 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:59.131570 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2bf84605-cb7a-41ab-abf0-393294cb6014 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:59.132073 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2bf84605-cb7a-41ab-abf0-393294cb6014 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:59.132846 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2bf84605-cb7a-41ab-abf0-393294cb6014 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:59.133345 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2bf84605-cb7a-41ab-abf0-393294cb6014 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:59.133848 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2bf84605-cb7a-41ab-abf0-393294cb6014 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:59.152375 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c9bacd1b-b855-42bf-8648-33c46c417710 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:59.166216 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c9bacd1b-b855-42bf-8648-33c46c417710 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c" status: 200 len: 1274 microversion: 2.1 time: 0.213456 Sep 10 11:48:59.169755 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1104/2294] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:58 2022] GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c => generated 1274 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:48:59.175745 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d426bd80-9575-4e58-b138-142f17f4d11d tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:59.176691 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d426bd80-9575-4e58-b138-142f17f4d11d tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] [instance: c5779770-492b-4ecd-bbc3-8e67b959c5a3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:59.186052 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d426bd80-9575-4e58-b138-142f17f4d11d tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:59.187086 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d426bd80-9575-4e58-b138-142f17f4d11d tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:59.188037 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d426bd80-9575-4e58-b138-142f17f4d11d tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:59.189349 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d426bd80-9575-4e58-b138-142f17f4d11d tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:59.190467 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d426bd80-9575-4e58-b138-142f17f4d11d tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:59.191415 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d426bd80-9575-4e58-b138-142f17f4d11d tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:59.344992 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d426bd80-9575-4e58-b138-142f17f4d11d tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a32e3e1c1164b8abbb9ee6532e81e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30967668a810420ebf3d44363f44a135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:59.356304 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d426bd80-9575-4e58-b138-142f17f4d11d tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] 10.222.0.23 "GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3" status: 200 len: 1335 microversion: 2.1 time: 0.185123 Sep 10 11:48:59.362553 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1105/2295] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:59 2022] GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3 => generated 1335 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:59.478423 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2bf84605-cb7a-41ab-abf0-393294cb6014 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:48:59.496498 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2bf84605-cb7a-41ab-abf0-393294cb6014 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 200 len: 1520 microversion: 2.1 time: 0.382427 Sep 10 11:48:59.497707 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1191/2296] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:59 2022] GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 1520 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:48:59.525447 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5379370e-6aac-433a-a651-e0935740ac0e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:59.526349 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-57b4ec28-f0c7-4f12-a2e9-7c3793c69573 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:48:59.527608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5379370e-6aac-433a-a651-e0935740ac0e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-57b4ec28-f0c7-4f12-a2e9-7c3793c69573 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Request method failure captured: Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de/action HTTP/1.1 Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 285 Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHmIwAMwYRG5GoKY2e2BrHSNWC_XC8Dle2TjpsTglJZLl4iDdUWRHXObue6CBNwrU7ByI06vvCBASR59oLGdEXbdGMvKthtN9mtTXSrKa2RC4WmIF4PSo8bwMo95sbb-sIH1rhBMLrXpSep-X_LgFDTkeIXb7VSYHefdo66ew2GGhFc Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 3e5d376048de4c3191a58a547e05fd07 Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1177602115 Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3e5d376048de4c3191a58a547e05fd07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3e5d376048de4c3191a58a547e05fd07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3e5d376048de4c3191a58a547e05fd07", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3e5d376048de4c3191a58a547e05fd07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1177602115 Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 3e5d376048de4c3191a58a547e05fd07 Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1177602115 Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ImagesOneServerNegativeTestJSON-1177602115-project Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 8ced1e84956246b6bb7384ba484fde54 Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1177602115-project Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'cec74510-742b-4a47-b7c5-58411ca992de', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise error Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:48:59.530204 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:59.538346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:48:59.538346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:48:59.538346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:48:59.538346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:48:59.538346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:48:59.538346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:48:59.538346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:48:59.538346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:48:59.538346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:48:59.538346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 11:48:59.538346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 11:48:59.538346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 11:48:59.538346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 11:48:59.538346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 11:48:59.538346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 11:48:59.538346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 11:48:59.538346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:59.538346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:48:59.538346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:59.538346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:48:59.538346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:48:59.538346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:48:59.538346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 11:48:59.538346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 11:48:59.538346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 11:48:59.538346 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:48:59.538346 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-57b4ec28-f0c7-4f12-a2e9-7c3793c69573 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:48:59.538346 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-57b4ec28-f0c7-4f12-a2e9-7c3793c69573 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "POST /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de/action" status: 400 len: 619 microversion: 2.1 time: 0.009955 Sep 10 11:48:59.538346 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1192/2297] 10.222.0.23 () {60 vars in 1279 bytes} [Sat Sep 10 11:48:59 2022] POST /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de/action => generated 619 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:48:59.543287 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6276936e-8bf9-45a1-9170-b8db12bbd1ea tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:48:59.543287 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6276936e-8bf9-45a1-9170-b8db12bbd1ea tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:48:59.549729 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5379370e-6aac-433a-a651-e0935740ac0e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:59.550606 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5379370e-6aac-433a-a651-e0935740ac0e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:59.551361 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5379370e-6aac-433a-a651-e0935740ac0e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:59.552381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5379370e-6aac-433a-a651-e0935740ac0e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:59.553063 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5379370e-6aac-433a-a651-e0935740ac0e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:59.553735 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5379370e-6aac-433a-a651-e0935740ac0e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:59.561016 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6276936e-8bf9-45a1-9170-b8db12bbd1ea tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:59.561531 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6276936e-8bf9-45a1-9170-b8db12bbd1ea tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:59.562080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6276936e-8bf9-45a1-9170-b8db12bbd1ea tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:48:59.562798 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6276936e-8bf9-45a1-9170-b8db12bbd1ea tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:48:59.563307 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6276936e-8bf9-45a1-9170-b8db12bbd1ea tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:48:59.571918 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6276936e-8bf9-45a1-9170-b8db12bbd1ea tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:00.185983 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5379370e-6aac-433a-a651-e0935740ac0e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:00.197122 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5379370e-6aac-433a-a651-e0935740ac0e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:00.202447 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5379370e-6aac-433a-a651-e0935740ac0e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:00.207630 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5379370e-6aac-433a-a651-e0935740ac0e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 2941 microversion: 2.42 time: 0.684607 Sep 10 11:49:00.208482 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1106/2298] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:48:59 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 2941 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:49:00.248391 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e8315e05-a138-4b65-9f47-ce002a309325 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:00.249425 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e8315e05-a138-4b65-9f47-ce002a309325 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:00.257099 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e8315e05-a138-4b65-9f47-ce002a309325 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:00.257884 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e8315e05-a138-4b65-9f47-ce002a309325 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:00.258498 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e8315e05-a138-4b65-9f47-ce002a309325 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:00.259426 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e8315e05-a138-4b65-9f47-ce002a309325 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:00.260056 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e8315e05-a138-4b65-9f47-ce002a309325 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:00.260649 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e8315e05-a138-4b65-9f47-ce002a309325 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:00.293897 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6276936e-8bf9-45a1-9170-b8db12bbd1ea tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:00.308618 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6276936e-8bf9-45a1-9170-b8db12bbd1ea tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 200 len: 1520 microversion: 2.1 time: 0.771255 Sep 10 11:49:00.312362 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1193/2299] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:48:59 2022] GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 1520 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:00.320955 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9f95b232-3e4c-44b7-b126-3948a77f923f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:00.324757 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9f95b232-3e4c-44b7-b126-3948a77f923f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d01d9406-b2a4-4b3b-af6b-832861ed820c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:00.329210 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:49:00.337650 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9f95b232-3e4c-44b7-b126-3948a77f923f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:00.338522 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9f95b232-3e4c-44b7-b126-3948a77f923f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:00.339131 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9f95b232-3e4c-44b7-b126-3948a77f923f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:00.340037 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9f95b232-3e4c-44b7-b126-3948a77f923f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:00.340671 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9f95b232-3e4c-44b7-b126-3948a77f923f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:00.341560 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9f95b232-3e4c-44b7-b126-3948a77f923f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:00.362937 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=14 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:49:00.844102 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e8315e05-a138-4b65-9f47-ce002a309325 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:00.854570 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e8315e05-a138-4b65-9f47-ce002a309325 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1472 microversion: 2.1 time: 0.629263 Sep 10 11:49:00.863354 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1107/2300] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:00 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1472 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:00.870881 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2b5ad88f-34ff-49a9-93a1-50cd989ac044 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:00.871825 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2b5ad88f-34ff-49a9-93a1-50cd989ac044 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:00.887610 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2b5ad88f-34ff-49a9-93a1-50cd989ac044 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:00.888116 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2b5ad88f-34ff-49a9-93a1-50cd989ac044 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:00.888568 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2b5ad88f-34ff-49a9-93a1-50cd989ac044 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:00.892892 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2b5ad88f-34ff-49a9-93a1-50cd989ac044 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:00.894705 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2b5ad88f-34ff-49a9-93a1-50cd989ac044 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:00.895191 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2b5ad88f-34ff-49a9-93a1-50cd989ac044 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:01.053144 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9f95b232-3e4c-44b7-b126-3948a77f923f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:01.061125 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9f95b232-3e4c-44b7-b126-3948a77f923f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c" status: 200 len: 1316 microversion: 2.1 time: 0.747423 Sep 10 11:49:01.075909 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1194/2301] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:00 2022] GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c => generated 1316 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:01.090660 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-593b7a49-c89d-458b-8983-aea7f771dfed tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:01.094219 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-593b7a49-c89d-458b-8983-aea7f771dfed tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] [instance: c5779770-492b-4ecd-bbc3-8e67b959c5a3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:01.102679 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-593b7a49-c89d-458b-8983-aea7f771dfed tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:01.103551 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-593b7a49-c89d-458b-8983-aea7f771dfed tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:01.104491 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-593b7a49-c89d-458b-8983-aea7f771dfed tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:01.105435 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-593b7a49-c89d-458b-8983-aea7f771dfed tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:01.106109 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-593b7a49-c89d-458b-8983-aea7f771dfed tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:01.106791 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-593b7a49-c89d-458b-8983-aea7f771dfed tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:01.354982 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2b5ad88f-34ff-49a9-93a1-50cd989ac044 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:01.371709 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2b5ad88f-34ff-49a9-93a1-50cd989ac044 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 200 len: 1520 microversion: 2.1 time: 0.507020 Sep 10 11:49:01.374599 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1108/2302] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:00 2022] GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 1520 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:01.383699 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-76c66391-37ca-407a-bab7-6599e6637c7b req-6cdb7fca-4b38-4ffd-a765-d0a7badb1bf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a", "name": "network-vif-unplugged", "status": "completed", "tag": "63ec6435-27f2-4584-83e7-993fffb3189b"}, {"server_uuid": "ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a", "name": "network-vif-unplugged", "status": "completed", "tag": "489e7897-1722-4643-b4ed-bef694daa679"}, {"server_uuid": "ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a", "name": "network-vif-unplugged", "status": "completed", "tag": "59f16da0-b2c3-4790-8066-9b8d9bae32dd"}, {"server_uuid": "ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a", "name": "network-vif-unplugged", "status": "completed", "tag": "e0c27aad-4065-4a4d-9a93-e46baa44130f"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:01.399272 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-76c66391-37ca-407a-bab7-6599e6637c7b req-6cdb7fca-4b38-4ffd-a765-d0a7badb1bf6 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:01.400260 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-76c66391-37ca-407a-bab7-6599e6637c7b req-6cdb7fca-4b38-4ffd-a765-d0a7badb1bf6 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:01.401657 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-76c66391-37ca-407a-bab7-6599e6637c7b req-6cdb7fca-4b38-4ffd-a765-d0a7badb1bf6 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:01.420825 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-593b7a49-c89d-458b-8983-aea7f771dfed tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a32e3e1c1164b8abbb9ee6532e81e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30967668a810420ebf3d44363f44a135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:01.423906 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-76c66391-37ca-407a-bab7-6599e6637c7b req-6cdb7fca-4b38-4ffd-a765-d0a7badb1bf6 service nova] Creating event network-vif-unplugged:63ec6435-27f2-4584-83e7-993fffb3189b for instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a on n-h1-856895-1 Sep 10 11:49:01.424777 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-76c66391-37ca-407a-bab7-6599e6637c7b req-6cdb7fca-4b38-4ffd-a765-d0a7badb1bf6 service nova] Creating event network-vif-unplugged:489e7897-1722-4643-b4ed-bef694daa679 for instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a on n-h1-856895-1 Sep 10 11:49:01.425989 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-76c66391-37ca-407a-bab7-6599e6637c7b req-6cdb7fca-4b38-4ffd-a765-d0a7badb1bf6 service nova] Creating event network-vif-unplugged:59f16da0-b2c3-4790-8066-9b8d9bae32dd for instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a on n-h1-856895-1 Sep 10 11:49:01.426861 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-76c66391-37ca-407a-bab7-6599e6637c7b req-6cdb7fca-4b38-4ffd-a765-d0a7badb1bf6 service nova] Creating event network-vif-unplugged:e0c27aad-4065-4a4d-9a93-e46baa44130f for instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a on n-h1-856895-1 Sep 10 11:49:01.429522 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-593b7a49-c89d-458b-8983-aea7f771dfed tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] 10.222.0.23 "GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3" status: 200 len: 1403 microversion: 2.1 time: 0.352174 Sep 10 11:49:01.437948 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-76c66391-37ca-407a-bab7-6599e6637c7b req-6cdb7fca-4b38-4ffd-a765-d0a7badb1bf6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.058895 Sep 10 11:49:01.441347 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1109/2304] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:49:01.444958 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1195/2304] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:01 2022] GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3 => generated 1403 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:01.449970 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-083dbab5-7afb-41e9-8ea0-2750e7c86cff tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-687288585"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:01.452428 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-083dbab5-7afb-41e9-8ea0-2750e7c86cff tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:01.453881 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c7782fdd-b02c-4573-b786-9e3aba1ac715 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:01.454892 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c7782fdd-b02c-4573-b786-9e3aba1ac715 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:01.459391 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-083dbab5-7afb-41e9-8ea0-2750e7c86cff tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:01.460085 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-083dbab5-7afb-41e9-8ea0-2750e7c86cff tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:01.460700 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-083dbab5-7afb-41e9-8ea0-2750e7c86cff tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:01.461632 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-083dbab5-7afb-41e9-8ea0-2750e7c86cff tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:01.462259 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-083dbab5-7afb-41e9-8ea0-2750e7c86cff tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:01.463242 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-083dbab5-7afb-41e9-8ea0-2750e7c86cff tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:01.464510 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c7782fdd-b02c-4573-b786-9e3aba1ac715 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:01.465599 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c7782fdd-b02c-4573-b786-9e3aba1ac715 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:01.466809 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c7782fdd-b02c-4573-b786-9e3aba1ac715 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:01.467670 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c7782fdd-b02c-4573-b786-9e3aba1ac715 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:01.468556 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c7782fdd-b02c-4573-b786-9e3aba1ac715 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:01.469210 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c7782fdd-b02c-4573-b786-9e3aba1ac715 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:01.726831 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-083dbab5-7afb-41e9-8ea0-2750e7c86cff tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "POST /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de/action" status: 202 len: 0 microversion: 2.1 time: 0.280320 Sep 10 11:49:01.727783 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1196/2305] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:49:01 2022] POST /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 10 11:49:01.742640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1955185b-ba0a-4aa1-b98f-2ded93712eb9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-874175163"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:01.746938 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1955185b-ba0a-4aa1-b98f-2ded93712eb9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:01.755975 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1955185b-ba0a-4aa1-b98f-2ded93712eb9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:01.756869 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1955185b-ba0a-4aa1-b98f-2ded93712eb9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:01.758158 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1955185b-ba0a-4aa1-b98f-2ded93712eb9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:01.759370 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1955185b-ba0a-4aa1-b98f-2ded93712eb9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:01.760711 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1955185b-ba0a-4aa1-b98f-2ded93712eb9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:01.761698 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1955185b-ba0a-4aa1-b98f-2ded93712eb9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:01.858781 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-1955185b-ba0a-4aa1-b98f-2ded93712eb9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] HTTP exception thrown: Cannot 'createImage' instance cec74510-742b-4a47-b7c5-58411ca992de while it is in task_state image_snapshot_pending Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1955185b-ba0a-4aa1-b98f-2ded93712eb9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Request method failure captured: Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de/action HTTP/1.1 Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 84 Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHmIwAMwYRG5GoKY2e2BrHSNWC_XC8Dle2TjpsTglJZLl4iDdUWRHXObue6CBNwrU7ByI06vvCBASR59oLGdEXbdGMvKthtN9mtTXSrKa2RC4WmIF4PSo8bwMo95sbb-sIH1rhBMLrXpSep-X_LgFDTkeIXb7VSYHefdo66ew2GGhFc Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 3e5d376048de4c3191a58a547e05fd07 Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1177602115 Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3e5d376048de4c3191a58a547e05fd07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3e5d376048de4c3191a58a547e05fd07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3e5d376048de4c3191a58a547e05fd07", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3e5d376048de4c3191a58a547e05fd07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1177602115 Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 3e5d376048de4c3191a58a547e05fd07 Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1177602115 Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ImagesOneServerNegativeTestJSON-1177602115-project Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 8ced1e84956246b6bb7384ba484fde54 Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1177602115-project Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-874175163"}} Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: exception: Cannot 'createImage' instance cec74510-742b-4a47-b7c5-58411ca992de while it is in task_state image_snapshot_pending Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'cec74510-742b-4a47-b7c5-58411ca992de', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-874175163'}}} Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cec74510-742b-4a47-b7c5-58411ca992de in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 11:49:01.864671 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 11:49:01.868524 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance cec74510-742b-4a47-b7c5-58411ca992de while it is in task_state image_snapshot_pending Sep 10 11:49:01.868524 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:01.868524 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:01.868524 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:01.868524 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:01.868524 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:01.868524 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:01.868524 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:49:01.868524 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:49:01.868524 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance cec74510-742b-4a47-b7c5-58411ca992de while it is in task_state image_snapshot_pending Sep 10 11:49:01.868524 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:01.870704 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1955185b-ba0a-4aa1-b98f-2ded93712eb9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Returning 409 to user: Cannot 'createImage' instance cec74510-742b-4a47-b7c5-58411ca992de while it is in task_state image_snapshot_pending {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:49:01.872380 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1955185b-ba0a-4aa1-b98f-2ded93712eb9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "POST /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de/action" status: 409 len: 167 microversion: 2.1 time: 0.136813 Sep 10 11:49:01.873515 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1197/2306] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:49:01 2022] POST /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de/action => generated 167 bytes in 139 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:49:01.894906 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7afce238-0ee2-4fc3-9e54-3da56c104ab8 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '.version_select at 0x7f40730d2dc0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:01.909131 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c7782fdd-b02c-4573-b786-9e3aba1ac715 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:01.926139 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c7782fdd-b02c-4573-b786-9e3aba1ac715 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:01.927628 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c7782fdd-b02c-4573-b786-9e3aba1ac715 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:01.929022 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c7782fdd-b02c-4573-b786-9e3aba1ac715 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 2941 microversion: 2.42 time: 0.486254 Sep 10 11:49:01.932658 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1110/2307] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:49:01 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 2941 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:49:01.937354 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e65b9387-411b-412e-993f-71069f6c4211 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:01.937979 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e65b9387-411b-412e-993f-71069f6c4211 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:01.957708 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e65b9387-411b-412e-993f-71069f6c4211 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:01.958211 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e65b9387-411b-412e-993f-71069f6c4211 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:01.958656 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e65b9387-411b-412e-993f-71069f6c4211 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:01.959494 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e65b9387-411b-412e-993f-71069f6c4211 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:01.959851 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e65b9387-411b-412e-993f-71069f6c4211 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:01.960278 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e65b9387-411b-412e-993f-71069f6c4211 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:02.129243 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7afce238-0ee2-4fc3-9e54-3da56c104ab8 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "DELETE /compute/v2.1/images/bedb3c43-528b-40ec-9571-4ac3fa7a60c5" status: 204 len: 0 microversion: 2.1 time: 0.248353 Sep 10 11:49:02.129824 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1198/2308] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:01 2022] DELETE /compute/v2.1/images/bedb3c43-528b-40ec-9571-4ac3fa7a60c5 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:49:02.134851 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5d37122a-2402-4770-b572-fd8bd4c2a093 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:02.135767 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5d37122a-2402-4770-b572-fd8bd4c2a093 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d01d9406-b2a4-4b3b-af6b-832861ed820c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:02.161460 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d37122a-2402-4770-b572-fd8bd4c2a093 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:02.162377 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d37122a-2402-4770-b572-fd8bd4c2a093 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:02.164241 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d37122a-2402-4770-b572-fd8bd4c2a093 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:02.165234 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d37122a-2402-4770-b572-fd8bd4c2a093 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:02.166311 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d37122a-2402-4770-b572-fd8bd4c2a093 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:02.166959 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d37122a-2402-4770-b572-fd8bd4c2a093 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:02.550559 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e65b9387-411b-412e-993f-71069f6c4211 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:02.577264 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e65b9387-411b-412e-993f-71069f6c4211 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1472 microversion: 2.1 time: 0.643456 Sep 10 11:49:02.579354 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1111/2309] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:01 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1472 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:02.606148 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b5fb95d9-129e-4df1-80f5-4b6b74b930f3 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:02.606828 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b5fb95d9-129e-4df1-80f5-4b6b74b930f3 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:02.620051 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b5fb95d9-129e-4df1-80f5-4b6b74b930f3 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:02.620549 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b5fb95d9-129e-4df1-80f5-4b6b74b930f3 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:02.621010 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b5fb95d9-129e-4df1-80f5-4b6b74b930f3 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:02.621750 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b5fb95d9-129e-4df1-80f5-4b6b74b930f3 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:02.622293 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b5fb95d9-129e-4df1-80f5-4b6b74b930f3 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:02.622736 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b5fb95d9-129e-4df1-80f5-4b6b74b930f3 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:02.652105 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:49:02.992352 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5d37122a-2402-4770-b572-fd8bd4c2a093 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:03.005720 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5d37122a-2402-4770-b572-fd8bd4c2a093 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c" status: 200 len: 1316 microversion: 2.1 time: 0.873920 Sep 10 11:49:03.006744 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1199/2310] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:02 2022] GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c => generated 1316 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:03.026502 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b9733fd8-3530-49f4-b085-1b00ce97bcb9 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:03.027396 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b9733fd8-3530-49f4-b085-1b00ce97bcb9 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] [instance: c5779770-492b-4ecd-bbc3-8e67b959c5a3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:03.029408 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:49:03.035228 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9733fd8-3530-49f4-b085-1b00ce97bcb9 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:03.035724 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9733fd8-3530-49f4-b085-1b00ce97bcb9 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:03.036327 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9733fd8-3530-49f4-b085-1b00ce97bcb9 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:03.037207 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9733fd8-3530-49f4-b085-1b00ce97bcb9 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:03.037820 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9733fd8-3530-49f4-b085-1b00ce97bcb9 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:03.038405 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9733fd8-3530-49f4-b085-1b00ce97bcb9 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:03.318451 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b5fb95d9-129e-4df1-80f5-4b6b74b930f3 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:03.328498 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b5fb95d9-129e-4df1-80f5-4b6b74b930f3 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 200 len: 1532 microversion: 2.1 time: 0.738888 Sep 10 11:49:03.329160 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1112/2311] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:02 2022] GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 1532 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:03.335493 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-41ba9885-d16b-4aee-bf7a-70c395ca8283 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:03.336444 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-41ba9885-d16b-4aee-bf7a-70c395ca8283 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:03.344249 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41ba9885-d16b-4aee-bf7a-70c395ca8283 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:03.345039 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41ba9885-d16b-4aee-bf7a-70c395ca8283 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:03.346023 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41ba9885-d16b-4aee-bf7a-70c395ca8283 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:03.347902 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41ba9885-d16b-4aee-bf7a-70c395ca8283 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:03.348442 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41ba9885-d16b-4aee-bf7a-70c395ca8283 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:03.348951 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41ba9885-d16b-4aee-bf7a-70c395ca8283 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:03.384751 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b9733fd8-3530-49f4-b085-1b00ce97bcb9 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a32e3e1c1164b8abbb9ee6532e81e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30967668a810420ebf3d44363f44a135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:03.396016 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b9733fd8-3530-49f4-b085-1b00ce97bcb9 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] 10.222.0.23 "GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3" status: 200 len: 1403 microversion: 2.1 time: 0.373750 Sep 10 11:49:03.397242 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1200/2312] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:03 2022] GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3 => generated 1403 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:03.607436 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-ca146c50-0f01-4177-aef8-2f6a88b5dbe6 req-50e33ee8-bd4d-45b2-a106-3c5c27130997 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a", "name": "network-vif-unplugged", "status": "completed", "tag": "ff0620c7-4af8-438f-80cb-a5112186d60a"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:03.619528 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-ca146c50-0f01-4177-aef8-2f6a88b5dbe6 req-50e33ee8-bd4d-45b2-a106-3c5c27130997 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:03.620840 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-ca146c50-0f01-4177-aef8-2f6a88b5dbe6 req-50e33ee8-bd4d-45b2-a106-3c5c27130997 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:03.621282 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-ca146c50-0f01-4177-aef8-2f6a88b5dbe6 req-50e33ee8-bd4d-45b2-a106-3c5c27130997 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:03.636323 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-ca146c50-0f01-4177-aef8-2f6a88b5dbe6 req-50e33ee8-bd4d-45b2-a106-3c5c27130997 service nova] Creating event network-vif-unplugged:ff0620c7-4af8-438f-80cb-a5112186d60a for instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a on n-h1-856895-1 Sep 10 11:49:03.642717 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-ca146c50-0f01-4177-aef8-2f6a88b5dbe6 req-50e33ee8-bd4d-45b2-a106-3c5c27130997 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.184964 Sep 10 11:49:03.644004 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1201/2313] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:49:03.651484 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-42720461-fd01-4426-80b2-14b491d3a154 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:03.652434 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-42720461-fd01-4426-80b2-14b491d3a154 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:03.655526 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:49:03.661256 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-42720461-fd01-4426-80b2-14b491d3a154 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:03.662070 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-42720461-fd01-4426-80b2-14b491d3a154 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:03.662519 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-42720461-fd01-4426-80b2-14b491d3a154 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:03.663264 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-42720461-fd01-4426-80b2-14b491d3a154 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:03.663724 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-42720461-fd01-4426-80b2-14b491d3a154 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:03.664334 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-42720461-fd01-4426-80b2-14b491d3a154 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:03.771407 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-41ba9885-d16b-4aee-bf7a-70c395ca8283 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:03.793461 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-41ba9885-d16b-4aee-bf7a-70c395ca8283 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:03.800310 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-41ba9885-d16b-4aee-bf7a-70c395ca8283 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:03.802129 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-41ba9885-d16b-4aee-bf7a-70c395ca8283 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 2920 microversion: 2.42 time: 0.471645 Sep 10 11:49:03.815837 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1113/2314] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:49:03 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 2920 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:49:03.831717 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-d87eb4d6-7642-46b0-a1f8-75b42e78d363 req-f6b3ffba-9b5e-430a-92a2-f4469acd639e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d01d9406-b2a4-4b3b-af6b-832861ed820c", "tag": "2161d003-0eea-49c6-b0f7-f559642e1c1f"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:03.850028 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d87eb4d6-7642-46b0-a1f8-75b42e78d363 req-f6b3ffba-9b5e-430a-92a2-f4469acd639e service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:03.850685 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d87eb4d6-7642-46b0-a1f8-75b42e78d363 req-f6b3ffba-9b5e-430a-92a2-f4469acd639e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:03.851572 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d87eb4d6-7642-46b0-a1f8-75b42e78d363 req-f6b3ffba-9b5e-430a-92a2-f4469acd639e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:03.865986 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-d87eb4d6-7642-46b0-a1f8-75b42e78d363 req-f6b3ffba-9b5e-430a-92a2-f4469acd639e service nova] Creating event network-changed:2161d003-0eea-49c6-b0f7-f559642e1c1f for instance d01d9406-b2a4-4b3b-af6b-832861ed820c on n-h1-856895-1 Sep 10 11:49:03.872124 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-d87eb4d6-7642-46b0-a1f8-75b42e78d363 req-f6b3ffba-9b5e-430a-92a2-f4469acd639e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054697 Sep 10 11:49:03.874419 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1114/2315] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:49:03.977886 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=10 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:49:04.034453 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b528c9c9-5767-41f8-94bb-19e7e0286883 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:04.035213 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b528c9c9-5767-41f8-94bb-19e7e0286883 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d01d9406-b2a4-4b3b-af6b-832861ed820c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:04.042424 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b528c9c9-5767-41f8-94bb-19e7e0286883 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:04.043281 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b528c9c9-5767-41f8-94bb-19e7e0286883 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:04.043966 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b528c9c9-5767-41f8-94bb-19e7e0286883 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:04.044893 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b528c9c9-5767-41f8-94bb-19e7e0286883 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:04.045553 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b528c9c9-5767-41f8-94bb-19e7e0286883 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:04.046183 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b528c9c9-5767-41f8-94bb-19e7e0286883 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:04.072418 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-42720461-fd01-4426-80b2-14b491d3a154 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:04.085461 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-42720461-fd01-4426-80b2-14b491d3a154 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1472 microversion: 2.1 time: 0.439563 Sep 10 11:49:04.099801 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1202/2316] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:03 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1472 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:04.353445 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b1f97728-dada-4d5a-8bc4-f17a083c7177 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:04.354066 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b1f97728-dada-4d5a-8bc4-f17a083c7177 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:04.360408 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1f97728-dada-4d5a-8bc4-f17a083c7177 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:04.361654 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1f97728-dada-4d5a-8bc4-f17a083c7177 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:04.362313 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1f97728-dada-4d5a-8bc4-f17a083c7177 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:04.363406 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1f97728-dada-4d5a-8bc4-f17a083c7177 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:04.364114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1f97728-dada-4d5a-8bc4-f17a083c7177 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:04.364611 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1f97728-dada-4d5a-8bc4-f17a083c7177 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:04.474041 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b528c9c9-5767-41f8-94bb-19e7e0286883 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:04.484270 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b528c9c9-5767-41f8-94bb-19e7e0286883 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c" status: 200 len: 1316 microversion: 2.1 time: 0.454219 Sep 10 11:49:04.487624 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1115/2317] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:04 2022] GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c => generated 1316 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:04.493148 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-820ba198-9d51-4ba2-81e2-393853dcc61f tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:04.499428 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-820ba198-9d51-4ba2-81e2-393853dcc61f tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] [instance: c5779770-492b-4ecd-bbc3-8e67b959c5a3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:04.507835 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-820ba198-9d51-4ba2-81e2-393853dcc61f tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:04.508440 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-820ba198-9d51-4ba2-81e2-393853dcc61f tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:04.509065 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-820ba198-9d51-4ba2-81e2-393853dcc61f tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:04.509976 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-820ba198-9d51-4ba2-81e2-393853dcc61f tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:04.510774 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-820ba198-9d51-4ba2-81e2-393853dcc61f tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:04.511241 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-820ba198-9d51-4ba2-81e2-393853dcc61f tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:04.651200 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b1f97728-dada-4d5a-8bc4-f17a083c7177 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:04.661686 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b1f97728-dada-4d5a-8bc4-f17a083c7177 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 200 len: 1538 microversion: 2.1 time: 0.311968 Sep 10 11:49:04.670177 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1203/2318] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:04 2022] GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 1538 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:49:04.686401 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-6e61449a-e1ff-463e-96a4-99782af937fd req-aad3f9ae-47de-4692-9af6-b50c933b228f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5779770-492b-4ecd-bbc3-8e67b959c5a3", "tag": "988df13d-e1f4-40be-aacb-1610d45932ca"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:04.704437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-6e61449a-e1ff-463e-96a4-99782af937fd req-aad3f9ae-47de-4692-9af6-b50c933b228f service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:04.705186 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-6e61449a-e1ff-463e-96a4-99782af937fd req-aad3f9ae-47de-4692-9af6-b50c933b228f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:04.706973 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-6e61449a-e1ff-463e-96a4-99782af937fd req-aad3f9ae-47de-4692-9af6-b50c933b228f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:04.724413 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-6e61449a-e1ff-463e-96a4-99782af937fd req-aad3f9ae-47de-4692-9af6-b50c933b228f service nova] Creating event network-changed:988df13d-e1f4-40be-aacb-1610d45932ca for instance c5779770-492b-4ecd-bbc3-8e67b959c5a3 on n-h1-856895-1 Sep 10 11:49:04.729850 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-6e61449a-e1ff-463e-96a4-99782af937fd req-aad3f9ae-47de-4692-9af6-b50c933b228f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058233 Sep 10 11:49:04.731033 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1204/2319] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:49:04.760712 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-820ba198-9d51-4ba2-81e2-393853dcc61f tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a32e3e1c1164b8abbb9ee6532e81e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30967668a810420ebf3d44363f44a135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:04.770423 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-820ba198-9d51-4ba2-81e2-393853dcc61f tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] 10.222.0.23 "GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3" status: 200 len: 1403 microversion: 2.1 time: 0.280338 Sep 10 11:49:04.771615 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1116/2320] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:04 2022] GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3 => generated 1403 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:04.836159 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c3268384-35e3-47f6-aa05-b48e347b951c tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:04.837258 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c3268384-35e3-47f6-aa05-b48e347b951c tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:04.848799 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3268384-35e3-47f6-aa05-b48e347b951c tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:04.849363 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3268384-35e3-47f6-aa05-b48e347b951c tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:04.850098 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3268384-35e3-47f6-aa05-b48e347b951c tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:04.851251 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3268384-35e3-47f6-aa05-b48e347b951c tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:04.851948 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3268384-35e3-47f6-aa05-b48e347b951c tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:04.852685 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3268384-35e3-47f6-aa05-b48e347b951c tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:05.063806 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c3268384-35e3-47f6-aa05-b48e347b951c tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:05.075520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c3268384-35e3-47f6-aa05-b48e347b951c tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:05.076991 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c3268384-35e3-47f6-aa05-b48e347b951c tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:05.078248 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c3268384-35e3-47f6-aa05-b48e347b951c tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 2873 microversion: 2.42 time: 0.248070 Sep 10 11:49:05.078816 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1205/2321] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:49:04 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 2873 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:49:05.115670 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f29a3c7c-169d-4493-b338-de90f0026ab2 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:05.120641 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f29a3c7c-169d-4493-b338-de90f0026ab2 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:05.134331 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f29a3c7c-169d-4493-b338-de90f0026ab2 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:05.135206 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f29a3c7c-169d-4493-b338-de90f0026ab2 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:05.138412 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f29a3c7c-169d-4493-b338-de90f0026ab2 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:05.139530 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f29a3c7c-169d-4493-b338-de90f0026ab2 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:05.140239 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f29a3c7c-169d-4493-b338-de90f0026ab2 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:05.144248 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f29a3c7c-169d-4493-b338-de90f0026ab2 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:05.312672 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f29a3c7c-169d-4493-b338-de90f0026ab2 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:05.322667 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f29a3c7c-169d-4493-b338-de90f0026ab2 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1472 microversion: 2.1 time: 0.212494 Sep 10 11:49:05.323884 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1117/2322] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:05 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1472 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:05.487967 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-46ae250c-b531-4ca8-8e97-8246e87c290d tempest-FloatingIPDetailsTestJSON-514339443 tempest-FloatingIPDetailsTestJSON-514339443-project] Action: 'create', calling method: .version_select at 0x7f4073eabd30>, body: {"pool": null} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:05.509103 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-64a663ec-8034-4d14-b276-f36cd135f5d2 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:05.510671 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-64a663ec-8034-4d14-b276-f36cd135f5d2 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d01d9406-b2a4-4b3b-af6b-832861ed820c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:05.518105 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-64a663ec-8034-4d14-b276-f36cd135f5d2 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:05.519087 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-64a663ec-8034-4d14-b276-f36cd135f5d2 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:05.519787 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-64a663ec-8034-4d14-b276-f36cd135f5d2 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:05.520766 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-64a663ec-8034-4d14-b276-f36cd135f5d2 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:05.521306 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-64a663ec-8034-4d14-b276-f36cd135f5d2 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:05.521838 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-64a663ec-8034-4d14-b276-f36cd135f5d2 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:05.786038 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-64a663ec-8034-4d14-b276-f36cd135f5d2 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:05.798586 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-64a663ec-8034-4d14-b276-f36cd135f5d2 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c" status: 200 len: 1316 microversion: 2.1 time: 0.292708 Sep 10 11:49:05.816812 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1118/2323] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:05 2022] GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c => generated 1316 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:49:05.823275 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-485d2094-c952-456e-8c7d-6469f08ee4f9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:05.823910 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-485d2094-c952-456e-8c7d-6469f08ee4f9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:05.830751 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-485d2094-c952-456e-8c7d-6469f08ee4f9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:05.831381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-485d2094-c952-456e-8c7d-6469f08ee4f9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:05.832044 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-485d2094-c952-456e-8c7d-6469f08ee4f9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:05.832993 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-485d2094-c952-456e-8c7d-6469f08ee4f9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:05.833461 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-485d2094-c952-456e-8c7d-6469f08ee4f9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:05.834170 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-485d2094-c952-456e-8c7d-6469f08ee4f9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:06.107271 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-485d2094-c952-456e-8c7d-6469f08ee4f9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:06.123513 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-485d2094-c952-456e-8c7d-6469f08ee4f9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 200 len: 1538 microversion: 2.1 time: 0.304823 Sep 10 11:49:06.124912 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1119/2324] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:05 2022] GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 1538 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:06.147318 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e95311fb-17e3-42e1-8708-0c3e62f97047 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:06.148371 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e95311fb-17e3-42e1-8708-0c3e62f97047 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] [instance: c5779770-492b-4ecd-bbc3-8e67b959c5a3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:06.156617 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e95311fb-17e3-42e1-8708-0c3e62f97047 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:06.157925 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e95311fb-17e3-42e1-8708-0c3e62f97047 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:06.158587 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e95311fb-17e3-42e1-8708-0c3e62f97047 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:06.160449 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e95311fb-17e3-42e1-8708-0c3e62f97047 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:06.161266 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e95311fb-17e3-42e1-8708-0c3e62f97047 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:06.161897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e95311fb-17e3-42e1-8708-0c3e62f97047 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:06.404308 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e95311fb-17e3-42e1-8708-0c3e62f97047 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a32e3e1c1164b8abbb9ee6532e81e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30967668a810420ebf3d44363f44a135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:06.417258 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e95311fb-17e3-42e1-8708-0c3e62f97047 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] 10.222.0.23 "GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3" status: 200 len: 1403 microversion: 2.1 time: 0.290767 Sep 10 11:49:06.419311 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1120/2325] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:06 2022] GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3 => generated 1403 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:06.425873 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2c7f6015-116e-4b67-92c9-984b9f7993bb tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:06.426814 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2c7f6015-116e-4b67-92c9-984b9f7993bb tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:06.436157 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2c7f6015-116e-4b67-92c9-984b9f7993bb tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:06.437904 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2c7f6015-116e-4b67-92c9-984b9f7993bb tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:06.439367 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2c7f6015-116e-4b67-92c9-984b9f7993bb tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:06.442776 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2c7f6015-116e-4b67-92c9-984b9f7993bb tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:06.447506 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2c7f6015-116e-4b67-92c9-984b9f7993bb tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:06.449081 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2c7f6015-116e-4b67-92c9-984b9f7993bb tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:06.734093 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2c7f6015-116e-4b67-92c9-984b9f7993bb tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:06.754108 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2c7f6015-116e-4b67-92c9-984b9f7993bb tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:06.757875 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2c7f6015-116e-4b67-92c9-984b9f7993bb tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:06.760039 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2c7f6015-116e-4b67-92c9-984b9f7993bb tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 2873 microversion: 2.42 time: 0.339289 Sep 10 11:49:06.761300 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1121/2326] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:49:06 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 2873 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:49:06.775498 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0f54661c-5d5f-4ec9-bacd-363772b907e6 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:06.776756 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0f54661c-5d5f-4ec9-bacd-363772b907e6 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:06.783635 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f54661c-5d5f-4ec9-bacd-363772b907e6 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:06.784820 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f54661c-5d5f-4ec9-bacd-363772b907e6 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:06.785725 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f54661c-5d5f-4ec9-bacd-363772b907e6 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:06.786980 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f54661c-5d5f-4ec9-bacd-363772b907e6 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:06.787749 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f54661c-5d5f-4ec9-bacd-363772b907e6 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:06.788506 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f54661c-5d5f-4ec9-bacd-363772b907e6 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:07.041811 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0f54661c-5d5f-4ec9-bacd-363772b907e6 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:07.051303 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0f54661c-5d5f-4ec9-bacd-363772b907e6 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1472 microversion: 2.1 time: 0.288217 Sep 10 11:49:07.052692 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1122/2327] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:06 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1472 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:07.058316 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-f25ce0b3-4340-4c49-98d3-af48beb1fed5 req-ce6c84de-9b05-4f1e-80ec-09853b5c0198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a", "name": "network-vif-deleted", "tag": "e0c27aad-4065-4a4d-9a93-e46baa44130f"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:07.072508 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f25ce0b3-4340-4c49-98d3-af48beb1fed5 req-ce6c84de-9b05-4f1e-80ec-09853b5c0198 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:07.073265 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f25ce0b3-4340-4c49-98d3-af48beb1fed5 req-ce6c84de-9b05-4f1e-80ec-09853b5c0198 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:07.073946 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f25ce0b3-4340-4c49-98d3-af48beb1fed5 req-ce6c84de-9b05-4f1e-80ec-09853b5c0198 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:07.090227 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-f25ce0b3-4340-4c49-98d3-af48beb1fed5 req-ce6c84de-9b05-4f1e-80ec-09853b5c0198 service nova] Creating event network-vif-deleted:e0c27aad-4065-4a4d-9a93-e46baa44130f for instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a on n-h1-856895-1 Sep 10 11:49:07.110332 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-f25ce0b3-4340-4c49-98d3-af48beb1fed5 req-ce6c84de-9b05-4f1e-80ec-09853b5c0198 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052692 Sep 10 11:49:07.112415 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1123/2328] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:49:07.117987 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-547840c2-71d0-4772-8ee4-bb2bfdc6a4e9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:07.119675 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-547840c2-71d0-4772-8ee4-bb2bfdc6a4e9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d01d9406-b2a4-4b3b-af6b-832861ed820c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:07.130177 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-547840c2-71d0-4772-8ee4-bb2bfdc6a4e9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:07.130991 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-547840c2-71d0-4772-8ee4-bb2bfdc6a4e9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:07.131703 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-547840c2-71d0-4772-8ee4-bb2bfdc6a4e9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:07.132642 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-547840c2-71d0-4772-8ee4-bb2bfdc6a4e9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:07.134388 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-547840c2-71d0-4772-8ee4-bb2bfdc6a4e9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:07.135080 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-547840c2-71d0-4772-8ee4-bb2bfdc6a4e9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:07.473044 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-547840c2-71d0-4772-8ee4-bb2bfdc6a4e9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:07.488663 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-547840c2-71d0-4772-8ee4-bb2bfdc6a4e9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c" status: 200 len: 1316 microversion: 2.1 time: 0.374701 Sep 10 11:49:07.503645 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1124/2329] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:07 2022] GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c => generated 1316 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:07.511095 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7aa2fb79-b53d-4517-8d99-bffb1baf8339 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:07.511943 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7aa2fb79-b53d-4517-8d99-bffb1baf8339 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:07.520072 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7aa2fb79-b53d-4517-8d99-bffb1baf8339 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:07.520912 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7aa2fb79-b53d-4517-8d99-bffb1baf8339 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:07.521524 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7aa2fb79-b53d-4517-8d99-bffb1baf8339 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:07.522414 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7aa2fb79-b53d-4517-8d99-bffb1baf8339 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:07.523066 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7aa2fb79-b53d-4517-8d99-bffb1baf8339 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:07.523677 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7aa2fb79-b53d-4517-8d99-bffb1baf8339 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:07.640317 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-46ae250c-b531-4ca8-8e97-8246e87c290d tempest-FloatingIPDetailsTestJSON-514339443 tempest-FloatingIPDetailsTestJSON-514339443-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.219481 Sep 10 11:49:07.642888 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1206/2330] 10.222.0.23 () {60 vars in 1170 bytes} [Sat Sep 10 11:49:05 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:49:07.649011 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-253421f9-23fa-4cc5-a315-b0625a36e40f tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:07.649970 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-253421f9-23fa-4cc5-a315-b0625a36e40f tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] [instance: c5779770-492b-4ecd-bbc3-8e67b959c5a3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:07.657783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-253421f9-23fa-4cc5-a315-b0625a36e40f tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:07.658505 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-253421f9-23fa-4cc5-a315-b0625a36e40f tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:07.659191 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-253421f9-23fa-4cc5-a315-b0625a36e40f tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:07.660066 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-253421f9-23fa-4cc5-a315-b0625a36e40f tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:07.660731 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-253421f9-23fa-4cc5-a315-b0625a36e40f tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:07.661322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-253421f9-23fa-4cc5-a315-b0625a36e40f tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:07.835811 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7aa2fb79-b53d-4517-8d99-bffb1baf8339 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:07.845715 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7aa2fb79-b53d-4517-8d99-bffb1baf8339 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 200 len: 1538 microversion: 2.1 time: 0.340433 Sep 10 11:49:07.847428 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1125/2331] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:07 2022] GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 1538 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:07.867003 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6fd9134a-0942-4a8e-a397-29780fd9bbe6 tempest-FloatingIPDetailsTestJSON-514339443 tempest-FloatingIPDetailsTestJSON-514339443-project] Action: 'create', calling method: .version_select at 0x7f4073679790>, body: {"pool": null} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:07.998060 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-253421f9-23fa-4cc5-a315-b0625a36e40f tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a32e3e1c1164b8abbb9ee6532e81e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30967668a810420ebf3d44363f44a135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:08.010356 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-253421f9-23fa-4cc5-a315-b0625a36e40f tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] 10.222.0.23 "GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3" status: 200 len: 1403 microversion: 2.1 time: 0.365165 Sep 10 11:49:08.011389 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1207/2332] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:07 2022] GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3 => generated 1403 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:08.018105 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b3d843d9-0e61-4ea4-9751-110979a324be tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:08.019484 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b3d843d9-0e61-4ea4-9751-110979a324be tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:08.037044 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b3d843d9-0e61-4ea4-9751-110979a324be tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:08.037545 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b3d843d9-0e61-4ea4-9751-110979a324be tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:08.037982 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b3d843d9-0e61-4ea4-9751-110979a324be tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:08.038704 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b3d843d9-0e61-4ea4-9751-110979a324be tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:08.039157 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b3d843d9-0e61-4ea4-9751-110979a324be tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:08.039646 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b3d843d9-0e61-4ea4-9751-110979a324be tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:08.502233 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b3d843d9-0e61-4ea4-9751-110979a324be tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:08.515552 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b3d843d9-0e61-4ea4-9751-110979a324be tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:08.517316 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b3d843d9-0e61-4ea4-9751-110979a324be tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:08.519965 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b3d843d9-0e61-4ea4-9751-110979a324be tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 2873 microversion: 2.42 time: 0.507288 Sep 10 11:49:08.527487 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1208/2333] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:49:08 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 2873 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:49:08.543138 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ac8de6f3-7b76-4a76-b1fd-25d52d5347f0 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:08.544062 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ac8de6f3-7b76-4a76-b1fd-25d52d5347f0 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:08.554490 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac8de6f3-7b76-4a76-b1fd-25d52d5347f0 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:08.554970 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac8de6f3-7b76-4a76-b1fd-25d52d5347f0 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:08.557360 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac8de6f3-7b76-4a76-b1fd-25d52d5347f0 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:08.558936 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac8de6f3-7b76-4a76-b1fd-25d52d5347f0 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:08.563616 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac8de6f3-7b76-4a76-b1fd-25d52d5347f0 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:08.564192 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac8de6f3-7b76-4a76-b1fd-25d52d5347f0 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:08.569994 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:49:09.450098 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ac8de6f3-7b76-4a76-b1fd-25d52d5347f0 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:09.466652 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ac8de6f3-7b76-4a76-b1fd-25d52d5347f0 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1472 microversion: 2.1 time: 0.933008 Sep 10 11:49:09.494915 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1209/2334] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:08 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1472 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:09.512237 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-680d2819-b96c-4195-a31b-a0e9c83af858 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:09.513565 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-680d2819-b96c-4195-a31b-a0e9c83af858 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d01d9406-b2a4-4b3b-af6b-832861ed820c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:09.522891 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-680d2819-b96c-4195-a31b-a0e9c83af858 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:09.523587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-680d2819-b96c-4195-a31b-a0e9c83af858 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:09.524443 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-680d2819-b96c-4195-a31b-a0e9c83af858 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:09.525406 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-680d2819-b96c-4195-a31b-a0e9c83af858 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:09.525874 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-680d2819-b96c-4195-a31b-a0e9c83af858 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:09.526305 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-680d2819-b96c-4195-a31b-a0e9c83af858 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:09.823842 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-680d2819-b96c-4195-a31b-a0e9c83af858 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:09.834896 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-680d2819-b96c-4195-a31b-a0e9c83af858 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c" status: 200 len: 1316 microversion: 2.1 time: 0.337233 Sep 10 11:49:09.856292 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1210/2335] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:09 2022] GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c => generated 1316 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:09.880932 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-60d00797-5ded-4359-9473-c47d9a426e69 req-22d71e06-d577-4d36-ba12-e6cd81b95ce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cec74510-742b-4a47-b7c5-58411ca992de", "name": "network-vif-plugged", "status": "completed", "tag": "80da9e33-1a86-4d89-b08b-b5850346b6f1"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:09.903949 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-60d00797-5ded-4359-9473-c47d9a426e69 req-22d71e06-d577-4d36-ba12-e6cd81b95ce1 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:09.906691 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-60d00797-5ded-4359-9473-c47d9a426e69 req-22d71e06-d577-4d36-ba12-e6cd81b95ce1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:09.907707 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-60d00797-5ded-4359-9473-c47d9a426e69 req-22d71e06-d577-4d36-ba12-e6cd81b95ce1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:09.936209 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-60d00797-5ded-4359-9473-c47d9a426e69 req-22d71e06-d577-4d36-ba12-e6cd81b95ce1 service nova] Creating event network-vif-plugged:80da9e33-1a86-4d89-b08b-b5850346b6f1 for instance cec74510-742b-4a47-b7c5-58411ca992de on n-h1-856895-1 Sep 10 11:49:09.949648 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-60d00797-5ded-4359-9473-c47d9a426e69 req-22d71e06-d577-4d36-ba12-e6cd81b95ce1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090787 Sep 10 11:49:09.950263 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1211/2336] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:49:09.963462 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-febc3850-f74c-47bb-870a-a3553ee6158e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:09.964182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-febc3850-f74c-47bb-870a-a3553ee6158e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:09.976996 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-febc3850-f74c-47bb-870a-a3553ee6158e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:09.978974 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-febc3850-f74c-47bb-870a-a3553ee6158e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:09.980333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-febc3850-f74c-47bb-870a-a3553ee6158e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:09.981246 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-febc3850-f74c-47bb-870a-a3553ee6158e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:09.981884 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-febc3850-f74c-47bb-870a-a3553ee6158e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:09.982480 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-febc3850-f74c-47bb-870a-a3553ee6158e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:10.232881 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-febc3850-f74c-47bb-870a-a3553ee6158e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:10.255510 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-febc3850-f74c-47bb-870a-a3553ee6158e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 200 len: 1538 microversion: 2.1 time: 0.299151 Sep 10 11:49:10.256692 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1212/2337] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:09 2022] GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 1538 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:10.261581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-050f20e4-9db9-4d6e-98dc-0c1aaa5cd997 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:10.262422 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-050f20e4-9db9-4d6e-98dc-0c1aaa5cd997 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] [instance: c5779770-492b-4ecd-bbc3-8e67b959c5a3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:10.270655 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-050f20e4-9db9-4d6e-98dc-0c1aaa5cd997 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:10.272445 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-050f20e4-9db9-4d6e-98dc-0c1aaa5cd997 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:10.273078 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-050f20e4-9db9-4d6e-98dc-0c1aaa5cd997 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:10.273824 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-050f20e4-9db9-4d6e-98dc-0c1aaa5cd997 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:10.274286 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-050f20e4-9db9-4d6e-98dc-0c1aaa5cd997 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:10.274714 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-050f20e4-9db9-4d6e-98dc-0c1aaa5cd997 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:10.497183 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-050f20e4-9db9-4d6e-98dc-0c1aaa5cd997 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a32e3e1c1164b8abbb9ee6532e81e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30967668a810420ebf3d44363f44a135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:10.507705 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-050f20e4-9db9-4d6e-98dc-0c1aaa5cd997 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] 10.222.0.23 "GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3" status: 200 len: 1403 microversion: 2.1 time: 0.249591 Sep 10 11:49:10.508313 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1213/2338] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:10 2022] GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3 => generated 1403 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:10.524168 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8adf44b9-122f-4ed7-a60d-6a1caf281a29 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:10.525114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8adf44b9-122f-4ed7-a60d-6a1caf281a29 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:10.544864 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8adf44b9-122f-4ed7-a60d-6a1caf281a29 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:10.545343 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8adf44b9-122f-4ed7-a60d-6a1caf281a29 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:10.545786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8adf44b9-122f-4ed7-a60d-6a1caf281a29 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:10.546498 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8adf44b9-122f-4ed7-a60d-6a1caf281a29 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:10.547191 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8adf44b9-122f-4ed7-a60d-6a1caf281a29 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:10.547617 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8adf44b9-122f-4ed7-a60d-6a1caf281a29 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:10.826426 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8adf44b9-122f-4ed7-a60d-6a1caf281a29 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:10.839968 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8adf44b9-122f-4ed7-a60d-6a1caf281a29 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:10.844865 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8adf44b9-122f-4ed7-a60d-6a1caf281a29 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:10.848638 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8adf44b9-122f-4ed7-a60d-6a1caf281a29 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 2712 microversion: 2.42 time: 0.339334 Sep 10 11:49:10.850390 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1214/2339] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:49:10 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 2712 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:49:10.858166 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-69f7c5fd-25fe-44e3-ae55-46030fde9ae0 req-29e37ae1-a336-4037-ba1b-a513d88f274b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a", "name": "network-vif-deleted", "tag": "489e7897-1722-4643-b4ed-bef694daa679"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:10.883700 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-69f7c5fd-25fe-44e3-ae55-46030fde9ae0 req-29e37ae1-a336-4037-ba1b-a513d88f274b service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:10.884207 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-69f7c5fd-25fe-44e3-ae55-46030fde9ae0 req-29e37ae1-a336-4037-ba1b-a513d88f274b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:10.884650 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-69f7c5fd-25fe-44e3-ae55-46030fde9ae0 req-29e37ae1-a336-4037-ba1b-a513d88f274b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:10.897851 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-69f7c5fd-25fe-44e3-ae55-46030fde9ae0 req-29e37ae1-a336-4037-ba1b-a513d88f274b service nova] Creating event network-vif-deleted:489e7897-1722-4643-b4ed-bef694daa679 for instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a on n-h1-856895-1 Sep 10 11:49:10.903245 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-69f7c5fd-25fe-44e3-ae55-46030fde9ae0 req-29e37ae1-a336-4037-ba1b-a513d88f274b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051475 Sep 10 11:49:10.904150 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1215/2340] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:49:10.909459 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2d31d0cf-cc59-4ef5-aad3-3ebbf081df93 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:10.910460 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2d31d0cf-cc59-4ef5-aad3-3ebbf081df93 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:10.917045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2d31d0cf-cc59-4ef5-aad3-3ebbf081df93 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:10.917800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2d31d0cf-cc59-4ef5-aad3-3ebbf081df93 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:10.918401 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2d31d0cf-cc59-4ef5-aad3-3ebbf081df93 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:10.919308 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2d31d0cf-cc59-4ef5-aad3-3ebbf081df93 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:10.919773 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2d31d0cf-cc59-4ef5-aad3-3ebbf081df93 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:10.920204 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2d31d0cf-cc59-4ef5-aad3-3ebbf081df93 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:11.014970 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6fd9134a-0942-4a8e-a397-29780fd9bbe6 tempest-FloatingIPDetailsTestJSON-514339443 tempest-FloatingIPDetailsTestJSON-514339443-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.166184 Sep 10 11:49:11.015625 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1126/2341] 10.222.0.23 () {60 vars in 1170 bytes} [Sat Sep 10 11:49:07 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:49:11.021048 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a9e4175f-6938-44f9-9bf5-4401f8402573 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:11.021685 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a9e4175f-6938-44f9-9bf5-4401f8402573 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d01d9406-b2a4-4b3b-af6b-832861ed820c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:11.036711 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9e4175f-6938-44f9-9bf5-4401f8402573 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:11.037215 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9e4175f-6938-44f9-9bf5-4401f8402573 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:11.037659 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9e4175f-6938-44f9-9bf5-4401f8402573 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:11.039012 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9e4175f-6938-44f9-9bf5-4401f8402573 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:11.039638 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9e4175f-6938-44f9-9bf5-4401f8402573 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:11.040553 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9e4175f-6938-44f9-9bf5-4401f8402573 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:11.168593 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2d31d0cf-cc59-4ef5-aad3-3ebbf081df93 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:11.177632 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2d31d0cf-cc59-4ef5-aad3-3ebbf081df93 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1472 microversion: 2.1 time: 0.272112 Sep 10 11:49:11.178467 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1216/2342] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:10 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1472 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:11.183422 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2e69e277-9861-4025-8d29-ef37068163bd tempest-FloatingIPDetailsTestJSON-514339443 tempest-FloatingIPDetailsTestJSON-514339443-project] Action: 'create', calling method: .version_select at 0x7f407b5aa670>, body: {"pool": null} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:11.310140 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a9e4175f-6938-44f9-9bf5-4401f8402573 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:11.324224 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a9e4175f-6938-44f9-9bf5-4401f8402573 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c" status: 200 len: 1316 microversion: 2.1 time: 0.307436 Sep 10 11:49:11.339714 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1127/2343] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:11 2022] GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c => generated 1316 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:11.346302 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a327a95a-a5b8-451c-a645-0c1319d4632e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:11.347062 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a327a95a-a5b8-451c-a645-0c1319d4632e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:11.358544 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a327a95a-a5b8-451c-a645-0c1319d4632e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:11.359103 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a327a95a-a5b8-451c-a645-0c1319d4632e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:11.359647 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a327a95a-a5b8-451c-a645-0c1319d4632e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:11.361040 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a327a95a-a5b8-451c-a645-0c1319d4632e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:11.362308 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a327a95a-a5b8-451c-a645-0c1319d4632e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:11.362815 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a327a95a-a5b8-451c-a645-0c1319d4632e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:11.613262 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a327a95a-a5b8-451c-a645-0c1319d4632e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:11.628787 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a327a95a-a5b8-451c-a645-0c1319d4632e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 200 len: 1538 microversion: 2.1 time: 0.286384 Sep 10 11:49:11.630574 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1128/2344] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:11 2022] GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 1538 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:11.636369 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ad0b0aab-84cf-46bd-af8f-5d4f9b2b3a2e tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:11.637479 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ad0b0aab-84cf-46bd-af8f-5d4f9b2b3a2e tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] [instance: c5779770-492b-4ecd-bbc3-8e67b959c5a3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:11.645022 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad0b0aab-84cf-46bd-af8f-5d4f9b2b3a2e tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:11.645957 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad0b0aab-84cf-46bd-af8f-5d4f9b2b3a2e tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:11.646691 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad0b0aab-84cf-46bd-af8f-5d4f9b2b3a2e tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:11.648440 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad0b0aab-84cf-46bd-af8f-5d4f9b2b3a2e tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:11.649365 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad0b0aab-84cf-46bd-af8f-5d4f9b2b3a2e tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:11.650101 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad0b0aab-84cf-46bd-af8f-5d4f9b2b3a2e tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:11.919014 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ad0b0aab-84cf-46bd-af8f-5d4f9b2b3a2e tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a32e3e1c1164b8abbb9ee6532e81e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30967668a810420ebf3d44363f44a135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:11.932880 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ad0b0aab-84cf-46bd-af8f-5d4f9b2b3a2e tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] 10.222.0.23 "GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3" status: 200 len: 1403 microversion: 2.1 time: 0.300749 Sep 10 11:49:11.933476 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1129/2345] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:11 2022] GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3 => generated 1403 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:11.940608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8538575e-f78e-4523-bbd8-5dc2853f2f04 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:11.941849 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8538575e-f78e-4523-bbd8-5dc2853f2f04 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:11.953716 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8538575e-f78e-4523-bbd8-5dc2853f2f04 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:11.954219 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8538575e-f78e-4523-bbd8-5dc2853f2f04 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:11.954664 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8538575e-f78e-4523-bbd8-5dc2853f2f04 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:11.955453 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8538575e-f78e-4523-bbd8-5dc2853f2f04 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:11.957262 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8538575e-f78e-4523-bbd8-5dc2853f2f04 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:11.957862 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8538575e-f78e-4523-bbd8-5dc2853f2f04 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:12.567913 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8538575e-f78e-4523-bbd8-5dc2853f2f04 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:12.602560 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8538575e-f78e-4523-bbd8-5dc2853f2f04 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:12.606686 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8538575e-f78e-4523-bbd8-5dc2853f2f04 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:12.611248 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8538575e-f78e-4523-bbd8-5dc2853f2f04 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 2712 microversion: 2.42 time: 0.674438 Sep 10 11:49:12.614496 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1130/2346] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:49:11 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 2712 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:49:12.648392 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2d1b5b62-4cc2-43cc-9523-15f7550b5c17 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:12.649286 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2d1b5b62-4cc2-43cc-9523-15f7550b5c17 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:12.662412 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d1b5b62-4cc2-43cc-9523-15f7550b5c17 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:12.663537 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d1b5b62-4cc2-43cc-9523-15f7550b5c17 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:12.664842 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d1b5b62-4cc2-43cc-9523-15f7550b5c17 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:12.665965 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d1b5b62-4cc2-43cc-9523-15f7550b5c17 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:12.666658 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d1b5b62-4cc2-43cc-9523-15f7550b5c17 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:12.667433 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d1b5b62-4cc2-43cc-9523-15f7550b5c17 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:12.738709 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:49:13.168913 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2d1b5b62-4cc2-43cc-9523-15f7550b5c17 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:13.183945 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2d1b5b62-4cc2-43cc-9523-15f7550b5c17 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1472 microversion: 2.1 time: 0.566728 Sep 10 11:49:13.184549 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1131/2347] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:12 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1472 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:13.192409 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-08d585df-3e36-469b-bf2b-499aa58a4c8a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:13.194566 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-08d585df-3e36-469b-bf2b-499aa58a4c8a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d01d9406-b2a4-4b3b-af6b-832861ed820c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:13.207929 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-08d585df-3e36-469b-bf2b-499aa58a4c8a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:13.208714 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-08d585df-3e36-469b-bf2b-499aa58a4c8a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:13.209332 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-08d585df-3e36-469b-bf2b-499aa58a4c8a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:13.210859 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-08d585df-3e36-469b-bf2b-499aa58a4c8a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:13.211524 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-08d585df-3e36-469b-bf2b-499aa58a4c8a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:13.225120 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-08d585df-3e36-469b-bf2b-499aa58a4c8a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:13.834951 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-08d585df-3e36-469b-bf2b-499aa58a4c8a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:13.848220 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-08d585df-3e36-469b-bf2b-499aa58a4c8a tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c" status: 200 len: 1316 microversion: 2.1 time: 0.661920 Sep 10 11:49:13.859134 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1132/2348] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:13 2022] GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c => generated 1316 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:13.870452 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-0b33ef1b-7a11-4088-8a39-dbd35e12c61e req-02faf698-bb80-4c4e-80c5-14b798839357 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d01d9406-b2a4-4b3b-af6b-832861ed820c", "name": "network-vif-plugged", "status": "completed", "tag": "2161d003-0eea-49c6-b0f7-f559642e1c1f"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:13.883314 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-0b33ef1b-7a11-4088-8a39-dbd35e12c61e req-02faf698-bb80-4c4e-80c5-14b798839357 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:13.883877 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-0b33ef1b-7a11-4088-8a39-dbd35e12c61e req-02faf698-bb80-4c4e-80c5-14b798839357 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:13.884585 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-0b33ef1b-7a11-4088-8a39-dbd35e12c61e req-02faf698-bb80-4c4e-80c5-14b798839357 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:13.897696 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-0b33ef1b-7a11-4088-8a39-dbd35e12c61e req-02faf698-bb80-4c4e-80c5-14b798839357 service nova] Creating event network-vif-plugged:2161d003-0eea-49c6-b0f7-f559642e1c1f for instance d01d9406-b2a4-4b3b-af6b-832861ed820c on n-h1-856895-1 Sep 10 11:49:13.904281 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-0b33ef1b-7a11-4088-8a39-dbd35e12c61e req-02faf698-bb80-4c4e-80c5-14b798839357 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040633 Sep 10 11:49:13.905244 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1133/2349] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:49:13.913433 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fdeea01e-52db-48d1-978e-df9fdc6078e9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:13.914414 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fdeea01e-52db-48d1-978e-df9fdc6078e9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:13.922479 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fdeea01e-52db-48d1-978e-df9fdc6078e9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:13.923292 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fdeea01e-52db-48d1-978e-df9fdc6078e9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:13.924191 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fdeea01e-52db-48d1-978e-df9fdc6078e9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:13.925806 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fdeea01e-52db-48d1-978e-df9fdc6078e9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:13.926571 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fdeea01e-52db-48d1-978e-df9fdc6078e9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:13.927186 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fdeea01e-52db-48d1-978e-df9fdc6078e9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:13.928421 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2e69e277-9861-4025-8d29-ef37068163bd tempest-FloatingIPDetailsTestJSON-514339443 tempest-FloatingIPDetailsTestJSON-514339443-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.748736 Sep 10 11:49:13.937086 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1217/2350] 10.222.0.23 () {60 vars in 1170 bytes} [Sat Sep 10 11:49:11 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2750 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:49:13.937086 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-483687c6-e6dd-4d0d-a5de-be7213666cba tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:13.937086 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-483687c6-e6dd-4d0d-a5de-be7213666cba tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] [instance: c5779770-492b-4ecd-bbc3-8e67b959c5a3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:13.955513 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-483687c6-e6dd-4d0d-a5de-be7213666cba tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:13.956229 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-483687c6-e6dd-4d0d-a5de-be7213666cba tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:13.957331 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-483687c6-e6dd-4d0d-a5de-be7213666cba tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:13.958318 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-483687c6-e6dd-4d0d-a5de-be7213666cba tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:13.958983 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-483687c6-e6dd-4d0d-a5de-be7213666cba tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:13.959676 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-483687c6-e6dd-4d0d-a5de-be7213666cba tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:14.257670 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fdeea01e-52db-48d1-978e-df9fdc6078e9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:14.283110 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-483687c6-e6dd-4d0d-a5de-be7213666cba tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a32e3e1c1164b8abbb9ee6532e81e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30967668a810420ebf3d44363f44a135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:14.290393 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fdeea01e-52db-48d1-978e-df9fdc6078e9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 200 len: 1520 microversion: 2.1 time: 0.383630 Sep 10 11:49:14.291129 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1134/2351] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:13 2022] GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 1520 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:14.313057 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d1706bb1-f84d-4bda-9ff4-7b2c3a292903 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:14.313859 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d1706bb1-f84d-4bda-9ff4-7b2c3a292903 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:14.317669 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-483687c6-e6dd-4d0d-a5de-be7213666cba tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] 10.222.0.23 "GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3" status: 200 len: 1403 microversion: 2.1 time: 0.387108 Sep 10 11:49:14.320542 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1218/2352] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:13 2022] GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3 => generated 1403 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:14.324820 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d1706bb1-f84d-4bda-9ff4-7b2c3a292903 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:14.326634 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d1706bb1-f84d-4bda-9ff4-7b2c3a292903 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:14.328669 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d1706bb1-f84d-4bda-9ff4-7b2c3a292903 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:14.329561 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d1706bb1-f84d-4bda-9ff4-7b2c3a292903 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:14.331514 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d1706bb1-f84d-4bda-9ff4-7b2c3a292903 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:14.332842 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-feed6d91-3fa9-4600-8018-eb78e5170dc9 req-2751b3d4-a0a5-4c58-9e87-45b17d612f96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a", "name": "network-vif-deleted", "tag": "63ec6435-27f2-4584-83e7-993fffb3189b"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:14.333528 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d1706bb1-f84d-4bda-9ff4-7b2c3a292903 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:14.358044 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-feed6d91-3fa9-4600-8018-eb78e5170dc9 req-2751b3d4-a0a5-4c58-9e87-45b17d612f96 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:14.358763 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-feed6d91-3fa9-4600-8018-eb78e5170dc9 req-2751b3d4-a0a5-4c58-9e87-45b17d612f96 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:14.359411 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-feed6d91-3fa9-4600-8018-eb78e5170dc9 req-2751b3d4-a0a5-4c58-9e87-45b17d612f96 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:14.386947 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-feed6d91-3fa9-4600-8018-eb78e5170dc9 req-2751b3d4-a0a5-4c58-9e87-45b17d612f96 service nova] Creating event network-vif-deleted:63ec6435-27f2-4584-83e7-993fffb3189b for instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a on n-h1-856895-1 Sep 10 11:49:14.397039 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-feed6d91-3fa9-4600-8018-eb78e5170dc9 req-2751b3d4-a0a5-4c58-9e87-45b17d612f96 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074014 Sep 10 11:49:14.398264 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1219/2353] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:49:14.405630 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0adf4d21-7416-4cb9-962f-2611f08243c7 tempest-FloatingIPDetailsTestJSON-514339443 tempest-FloatingIPDetailsTestJSON-514339443-project] Action: 'create', calling method: .version_select at 0x7f407b5aa280>, body: {"pool": null} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:15.208613 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d1706bb1-f84d-4bda-9ff4-7b2c3a292903 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:15.229440 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d1706bb1-f84d-4bda-9ff4-7b2c3a292903 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:15.234442 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d1706bb1-f84d-4bda-9ff4-7b2c3a292903 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:15.244306 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d1706bb1-f84d-4bda-9ff4-7b2c3a292903 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 2551 microversion: 2.42 time: 0.936979 Sep 10 11:49:15.245227 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1135/2354] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:49:14 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 2551 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:49:15.259365 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-24d33122-f7bf-4f91-8a0c-705487c5ea0c tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:15.260965 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-24d33122-f7bf-4f91-8a0c-705487c5ea0c tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:15.277789 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-24d33122-f7bf-4f91-8a0c-705487c5ea0c tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:15.278401 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-24d33122-f7bf-4f91-8a0c-705487c5ea0c tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:15.278901 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-24d33122-f7bf-4f91-8a0c-705487c5ea0c tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:15.282322 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-24d33122-f7bf-4f91-8a0c-705487c5ea0c tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:15.284393 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-24d33122-f7bf-4f91-8a0c-705487c5ea0c tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:15.285795 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-24d33122-f7bf-4f91-8a0c-705487c5ea0c tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:15.789936 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-24d33122-f7bf-4f91-8a0c-705487c5ea0c tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:15.804490 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-24d33122-f7bf-4f91-8a0c-705487c5ea0c tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1478 microversion: 2.1 time: 0.557858 Sep 10 11:49:15.815664 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1136/2355] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:15 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1478 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:15.827033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fc6c1297-ff6c-4310-9fc2-b28d397eadb6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:15.833502 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fc6c1297-ff6c-4310-9fc2-b28d397eadb6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:15.852057 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc6c1297-ff6c-4310-9fc2-b28d397eadb6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:15.854610 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc6c1297-ff6c-4310-9fc2-b28d397eadb6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:15.855808 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc6c1297-ff6c-4310-9fc2-b28d397eadb6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:15.859584 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc6c1297-ff6c-4310-9fc2-b28d397eadb6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:15.861086 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc6c1297-ff6c-4310-9fc2-b28d397eadb6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:15.863780 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc6c1297-ff6c-4310-9fc2-b28d397eadb6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:15.949905 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fc6c1297-ff6c-4310-9fc2-b28d397eadb6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:49:16.170741 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fc6c1297-ff6c-4310-9fc2-b28d397eadb6 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 204 len: 0 microversion: 2.1 time: 0.359546 Sep 10 11:49:16.177114 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1137/2356] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:49:15 2022] DELETE /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:49:16.182828 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8ecde52e-b40f-4c02-ac71-8b5af4f68b37 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:16.183581 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8ecde52e-b40f-4c02-ac71-8b5af4f68b37 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d01d9406-b2a4-4b3b-af6b-832861ed820c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:16.200836 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8ecde52e-b40f-4c02-ac71-8b5af4f68b37 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:16.201354 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8ecde52e-b40f-4c02-ac71-8b5af4f68b37 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:16.201794 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8ecde52e-b40f-4c02-ac71-8b5af4f68b37 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:16.206322 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8ecde52e-b40f-4c02-ac71-8b5af4f68b37 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:16.209574 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8ecde52e-b40f-4c02-ac71-8b5af4f68b37 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:16.210687 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8ecde52e-b40f-4c02-ac71-8b5af4f68b37 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:16.469556 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8ecde52e-b40f-4c02-ac71-8b5af4f68b37 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:16.483444 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8ecde52e-b40f-4c02-ac71-8b5af4f68b37 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c" status: 200 len: 1316 microversion: 2.1 time: 0.304756 Sep 10 11:49:16.484040 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1138/2357] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:16 2022] GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c => generated 1316 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:16.498254 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7ce9f80c-c041-493b-bd7d-933403ad6b95 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:16.499189 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7ce9f80c-c041-493b-bd7d-933403ad6b95 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] [instance: c5779770-492b-4ecd-bbc3-8e67b959c5a3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:16.506217 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7ce9f80c-c041-493b-bd7d-933403ad6b95 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:16.507001 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7ce9f80c-c041-493b-bd7d-933403ad6b95 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:16.507624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7ce9f80c-c041-493b-bd7d-933403ad6b95 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:16.508587 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7ce9f80c-c041-493b-bd7d-933403ad6b95 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:16.509265 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7ce9f80c-c041-493b-bd7d-933403ad6b95 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:16.510593 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7ce9f80c-c041-493b-bd7d-933403ad6b95 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:16.781241 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7ce9f80c-c041-493b-bd7d-933403ad6b95 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a32e3e1c1164b8abbb9ee6532e81e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30967668a810420ebf3d44363f44a135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:16.797177 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7ce9f80c-c041-493b-bd7d-933403ad6b95 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] 10.222.0.23 "GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3" status: 200 len: 1403 microversion: 2.1 time: 0.304410 Sep 10 11:49:16.799045 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1139/2358] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:16 2022] GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3 => generated 1403 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:16.804975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-635f247d-08be-414f-a240-6f2dbed468c7 req-893e239f-1216-4ac3-918f-169c051e05a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5779770-492b-4ecd-bbc3-8e67b959c5a3", "name": "network-vif-plugged", "status": "completed", "tag": "988df13d-e1f4-40be-aacb-1610d45932ca"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:16.816144 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-635f247d-08be-414f-a240-6f2dbed468c7 req-893e239f-1216-4ac3-918f-169c051e05a8 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:16.816704 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-635f247d-08be-414f-a240-6f2dbed468c7 req-893e239f-1216-4ac3-918f-169c051e05a8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:16.817230 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-635f247d-08be-414f-a240-6f2dbed468c7 req-893e239f-1216-4ac3-918f-169c051e05a8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:16.831486 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-635f247d-08be-414f-a240-6f2dbed468c7 req-893e239f-1216-4ac3-918f-169c051e05a8 service nova] Creating event network-vif-plugged:988df13d-e1f4-40be-aacb-1610d45932ca for instance c5779770-492b-4ecd-bbc3-8e67b959c5a3 on n-h1-856895-1 Sep 10 11:49:16.841100 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-635f247d-08be-414f-a240-6f2dbed468c7 req-893e239f-1216-4ac3-918f-169c051e05a8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039951 Sep 10 11:49:16.845526 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1140/2359] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:49:16.853100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3f9e0d7d-ba4c-4561-ab04-158fb8d68096 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:16.853952 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3f9e0d7d-ba4c-4561-ab04-158fb8d68096 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:16.860961 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3f9e0d7d-ba4c-4561-ab04-158fb8d68096 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:16.861522 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3f9e0d7d-ba4c-4561-ab04-158fb8d68096 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:16.861996 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3f9e0d7d-ba4c-4561-ab04-158fb8d68096 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:16.862948 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3f9e0d7d-ba4c-4561-ab04-158fb8d68096 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:16.863602 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3f9e0d7d-ba4c-4561-ab04-158fb8d68096 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:16.864297 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3f9e0d7d-ba4c-4561-ab04-158fb8d68096 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:17.134281 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3f9e0d7d-ba4c-4561-ab04-158fb8d68096 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:17.147695 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3f9e0d7d-ba4c-4561-ab04-158fb8d68096 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 200 len: 1526 microversion: 2.1 time: 0.299136 Sep 10 11:49:17.148863 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1141/2360] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:16 2022] GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 1526 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:17.160147 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3ba9340f-770c-4524-a175-0e99fd0e2987 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:17.163542 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3ba9340f-770c-4524-a175-0e99fd0e2987 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:17.172244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3ba9340f-770c-4524-a175-0e99fd0e2987 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:17.173347 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3ba9340f-770c-4524-a175-0e99fd0e2987 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:17.174016 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3ba9340f-770c-4524-a175-0e99fd0e2987 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:17.175344 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3ba9340f-770c-4524-a175-0e99fd0e2987 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:17.175921 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3ba9340f-770c-4524-a175-0e99fd0e2987 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:17.176485 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3ba9340f-770c-4524-a175-0e99fd0e2987 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:17.270564 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3ba9340f-770c-4524-a175-0e99fd0e2987 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:17.285399 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3ba9340f-770c-4524-a175-0e99fd0e2987 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:17.294533 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3ba9340f-770c-4524-a175-0e99fd0e2987 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:17.297756 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3ba9340f-770c-4524-a175-0e99fd0e2987 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 2143 microversion: 2.42 time: 0.145211 Sep 10 11:49:17.302913 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1142/2361] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:49:17 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 2143 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:49:17.308696 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-58bc9824-f1f3-4371-9799-2e3833ff7dd1 req-4b6a6290-8d25-4b31-895f-e21c5d8da1d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a", "name": "network-vif-deleted", "tag": "ff0620c7-4af8-438f-80cb-a5112186d60a"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:17.321127 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-58bc9824-f1f3-4371-9799-2e3833ff7dd1 req-4b6a6290-8d25-4b31-895f-e21c5d8da1d7 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:17.321983 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-58bc9824-f1f3-4371-9799-2e3833ff7dd1 req-4b6a6290-8d25-4b31-895f-e21c5d8da1d7 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:17.322767 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-58bc9824-f1f3-4371-9799-2e3833ff7dd1 req-4b6a6290-8d25-4b31-895f-e21c5d8da1d7 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:17.344341 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0adf4d21-7416-4cb9-962f-2611f08243c7 tempest-FloatingIPDetailsTestJSON-514339443 tempest-FloatingIPDetailsTestJSON-514339443-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.944646 Sep 10 11:49:17.345742 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1220/2362] 10.222.0.23 () {60 vars in 1170 bytes} [Sat Sep 10 11:49:14 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2947 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:49:17.348796 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-58bc9824-f1f3-4371-9799-2e3833ff7dd1 req-4b6a6290-8d25-4b31-895f-e21c5d8da1d7 service nova] Creating event network-vif-deleted:ff0620c7-4af8-438f-80cb-a5112186d60a for instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a on n-h1-856895-1 Sep 10 11:49:17.353047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0f3eca60-801d-4399-ac16-74b3253f2df4 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:17.357413 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-58bc9824-f1f3-4371-9799-2e3833ff7dd1 req-4b6a6290-8d25-4b31-895f-e21c5d8da1d7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052675 Sep 10 11:49:17.358163 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1143/2363] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:49:17.358697 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0f3eca60-801d-4399-ac16-74b3253f2df4 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:17.365435 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-78a22cb0-a14c-46e2-bd80-9f987b77eaa2 tempest-FloatingIPDetailsTestJSON-514339443 tempest-FloatingIPDetailsTestJSON-514339443-project] Calling method '.version_select at 0x7f40735c0670>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:17.369139 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0f3eca60-801d-4399-ac16-74b3253f2df4 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:17.369655 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0f3eca60-801d-4399-ac16-74b3253f2df4 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:17.370259 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0f3eca60-801d-4399-ac16-74b3253f2df4 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:17.371728 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0f3eca60-801d-4399-ac16-74b3253f2df4 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:17.372272 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0f3eca60-801d-4399-ac16-74b3253f2df4 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:17.373550 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0f3eca60-801d-4399-ac16-74b3253f2df4 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:17.634178 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-78a22cb0-a14c-46e2-bd80-9f987b77eaa2 tempest-FloatingIPDetailsTestJSON-514339443 tempest-FloatingIPDetailsTestJSON-514339443-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/3d4917ac-0202-4e6f-8aeb-f1d0938e9110" status: 200 len: 142 microversion: 2.1 time: 0.274442 Sep 10 11:49:17.634773 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1144/2364] 10.222.0.23 () {58 vars in 1260 bytes} [Sat Sep 10 11:49:17 2022] GET /compute/v2.1/os-floating-ips/3d4917ac-0202-4e6f-8aeb-f1d0938e9110 => generated 142 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:49:17.640034 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9611e19a-6850-48d2-8fa5-05f5939f5ee5 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:17.641233 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9611e19a-6850-48d2-8fa5-05f5939f5ee5 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d01d9406-b2a4-4b3b-af6b-832861ed820c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:17.658081 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9611e19a-6850-48d2-8fa5-05f5939f5ee5 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:17.658977 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9611e19a-6850-48d2-8fa5-05f5939f5ee5 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:17.659539 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9611e19a-6850-48d2-8fa5-05f5939f5ee5 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:17.660717 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9611e19a-6850-48d2-8fa5-05f5939f5ee5 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:17.661214 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9611e19a-6850-48d2-8fa5-05f5939f5ee5 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:17.662066 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9611e19a-6850-48d2-8fa5-05f5939f5ee5 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:17.663306 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0f3eca60-801d-4399-ac16-74b3253f2df4 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:17.673441 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0f3eca60-801d-4399-ac16-74b3253f2df4 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1478 microversion: 2.1 time: 0.326163 Sep 10 11:49:17.687418 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1221/2365] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:17 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1478 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:17.696909 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0c2f1ed3-c109-4e93-9cd2-56343281717e tempest-FloatingIPDetailsTestJSON-514339443 tempest-FloatingIPDetailsTestJSON-514339443-project] Calling method '.version_select at 0x7f407b510790>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:17.916825 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9611e19a-6850-48d2-8fa5-05f5939f5ee5 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:17.929607 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9611e19a-6850-48d2-8fa5-05f5939f5ee5 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c" status: 200 len: 1316 microversion: 2.1 time: 0.293299 Sep 10 11:49:17.930231 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1145/2366] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:17 2022] GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c => generated 1316 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:17.937548 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-afc2beed-f621-4604-866a-c82e5aeeef22 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:17.937548 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-afc2beed-f621-4604-866a-c82e5aeeef22 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] [instance: c5779770-492b-4ecd-bbc3-8e67b959c5a3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:17.942567 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-afc2beed-f621-4604-866a-c82e5aeeef22 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:17.943072 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-afc2beed-f621-4604-866a-c82e5aeeef22 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:17.943536 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-afc2beed-f621-4604-866a-c82e5aeeef22 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:17.944243 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-afc2beed-f621-4604-866a-c82e5aeeef22 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:17.944703 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-afc2beed-f621-4604-866a-c82e5aeeef22 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:17.945127 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-afc2beed-f621-4604-866a-c82e5aeeef22 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:18.246175 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-afc2beed-f621-4604-866a-c82e5aeeef22 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a32e3e1c1164b8abbb9ee6532e81e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30967668a810420ebf3d44363f44a135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:18.255328 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-afc2beed-f621-4604-866a-c82e5aeeef22 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] 10.222.0.23 "GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3" status: 200 len: 1403 microversion: 2.1 time: 0.324080 Sep 10 11:49:18.256519 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1146/2367] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:17 2022] GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3 => generated 1403 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:18.261456 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e263c8c8-7cbc-44f8-9afe-fe56aa6ccaa9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:18.262141 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e263c8c8-7cbc-44f8-9afe-fe56aa6ccaa9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:18.268342 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e263c8c8-7cbc-44f8-9afe-fe56aa6ccaa9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:18.268972 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e263c8c8-7cbc-44f8-9afe-fe56aa6ccaa9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:18.269376 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e263c8c8-7cbc-44f8-9afe-fe56aa6ccaa9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:18.270148 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e263c8c8-7cbc-44f8-9afe-fe56aa6ccaa9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:18.270795 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e263c8c8-7cbc-44f8-9afe-fe56aa6ccaa9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:18.272008 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e263c8c8-7cbc-44f8-9afe-fe56aa6ccaa9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:18.475452 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e263c8c8-7cbc-44f8-9afe-fe56aa6ccaa9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:18.485390 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e263c8c8-7cbc-44f8-9afe-fe56aa6ccaa9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 200 len: 1526 microversion: 2.1 time: 0.227386 Sep 10 11:49:18.486235 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1147/2368] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:18 2022] GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 1526 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:18.491689 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5ca6b9a6-ecd2-4d31-bcf2-89c3f2a56ef0 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:18.492532 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5ca6b9a6-ecd2-4d31-bcf2-89c3f2a56ef0 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:18.508884 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ca6b9a6-ecd2-4d31-bcf2-89c3f2a56ef0 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:18.509563 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ca6b9a6-ecd2-4d31-bcf2-89c3f2a56ef0 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:18.510191 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ca6b9a6-ecd2-4d31-bcf2-89c3f2a56ef0 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:18.511077 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ca6b9a6-ecd2-4d31-bcf2-89c3f2a56ef0 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:18.511742 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ca6b9a6-ecd2-4d31-bcf2-89c3f2a56ef0 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:18.512340 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ca6b9a6-ecd2-4d31-bcf2-89c3f2a56ef0 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:18.611210 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5ca6b9a6-ecd2-4d31-bcf2-89c3f2a56ef0 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:18.630912 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5ca6b9a6-ecd2-4d31-bcf2-89c3f2a56ef0 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:18.634150 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5ca6b9a6-ecd2-4d31-bcf2-89c3f2a56ef0 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:18.635961 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5ca6b9a6-ecd2-4d31-bcf2-89c3f2a56ef0 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1985 microversion: 2.42 time: 0.148099 Sep 10 11:49:18.637094 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1148/2369] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:49:18 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1985 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:49:18.713940 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e95947d6-77ef-4a41-9aec-f7790f9cfa3e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:18.715508 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e95947d6-77ef-4a41-9aec-f7790f9cfa3e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:18.724820 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e95947d6-77ef-4a41-9aec-f7790f9cfa3e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:18.725589 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e95947d6-77ef-4a41-9aec-f7790f9cfa3e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:18.726257 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e95947d6-77ef-4a41-9aec-f7790f9cfa3e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:18.727347 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e95947d6-77ef-4a41-9aec-f7790f9cfa3e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:18.728008 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e95947d6-77ef-4a41-9aec-f7790f9cfa3e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:18.728639 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e95947d6-77ef-4a41-9aec-f7790f9cfa3e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:18.751936 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:49:18.831767 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0c2f1ed3-c109-4e93-9cd2-56343281717e tempest-FloatingIPDetailsTestJSON-514339443 tempest-FloatingIPDetailsTestJSON-514339443-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/3d4917ac-0202-4e6f-8aeb-f1d0938e9110" status: 202 len: 0 microversion: 2.1 time: 1.141927 Sep 10 11:49:18.833250 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1222/2370] 10.222.0.23 () {58 vars in 1263 bytes} [Sat Sep 10 11:49:17 2022] DELETE /compute/v2.1/os-floating-ips/3d4917ac-0202-4e6f-8aeb-f1d0938e9110 => generated 0 bytes in 1145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:49:18.843793 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e1a6ef1f-c498-40c5-9dc2-2746a2b3ed9d tempest-FloatingIPDetailsTestJSON-514339443 tempest-FloatingIPDetailsTestJSON-514339443-project] Calling method '.version_select at 0x7f407370c160>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:18.961650 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e95947d6-77ef-4a41-9aec-f7790f9cfa3e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:18.972484 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e95947d6-77ef-4a41-9aec-f7790f9cfa3e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1478 microversion: 2.1 time: 0.273361 Sep 10 11:49:18.973401 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1149/2371] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:18 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1478 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:18.978826 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-30457274-46b3-4961-9066-c46442c43f55 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:18.979614 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-30457274-46b3-4961-9066-c46442c43f55 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d01d9406-b2a4-4b3b-af6b-832861ed820c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:18.986841 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-30457274-46b3-4961-9066-c46442c43f55 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:18.987621 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-30457274-46b3-4961-9066-c46442c43f55 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:18.988168 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-30457274-46b3-4961-9066-c46442c43f55 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:18.988981 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-30457274-46b3-4961-9066-c46442c43f55 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:18.989561 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-30457274-46b3-4961-9066-c46442c43f55 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:18.990153 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-30457274-46b3-4961-9066-c46442c43f55 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:19.006934 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e1a6ef1f-c498-40c5-9dc2-2746a2b3ed9d tempest-FloatingIPDetailsTestJSON-514339443 tempest-FloatingIPDetailsTestJSON-514339443-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.168080 Sep 10 11:49:19.014916 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1223/2372] 10.222.0.23 () {58 vars in 1164 bytes} [Sat Sep 10 11:49:18 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:49:19.020679 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8ccc36df-1db8-4603-8049-7370a9f8307e tempest-FloatingIPDetailsTestJSON-514339443 tempest-FloatingIPDetailsTestJSON-514339443-project] Calling method '.version_select at 0x7f407b5aa430>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:19.278762 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-30457274-46b3-4961-9066-c46442c43f55 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:19.288437 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-30457274-46b3-4961-9066-c46442c43f55 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c" status: 200 len: 1466 microversion: 2.1 time: 0.314077 Sep 10 11:49:19.289822 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1150/2373] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:18 2022] GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c => generated 1466 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:19.294556 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-6932de6e-cb30-41be-8ebd-1d88fa3244c9 req-460a909a-9662-4c1c-a386-a1d7c2a380a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ebabc55-1b1d-4276-8bde-d8d4859d74fd", "name": "network-vif-unplugged", "status": "completed", "tag": "679e3ac9-dc5d-4404-aa8b-99020ce86192"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:19.305078 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:49:19.307542 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6932de6e-cb30-41be-8ebd-1d88fa3244c9 req-460a909a-9662-4c1c-a386-a1d7c2a380a1 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:19.308255 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6932de6e-cb30-41be-8ebd-1d88fa3244c9 req-460a909a-9662-4c1c-a386-a1d7c2a380a1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:19.308852 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6932de6e-cb30-41be-8ebd-1d88fa3244c9 req-460a909a-9662-4c1c-a386-a1d7c2a380a1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:19.324841 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8ccc36df-1db8-4603-8049-7370a9f8307e tempest-FloatingIPDetailsTestJSON-514339443 tempest-FloatingIPDetailsTestJSON-514339443-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.308709 Sep 10 11:49:19.325434 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1224/2374] 10.222.0.23 () {58 vars in 1149 bytes} [Sat Sep 10 11:49:19 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:49:19.330247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-80d5fcb9-90b8-4b42-8b7f-27c4ec7fc061 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:19.331114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-80d5fcb9-90b8-4b42-8b7f-27c4ec7fc061 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] [instance: c5779770-492b-4ecd-bbc3-8e67b959c5a3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:19.336492 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-6932de6e-cb30-41be-8ebd-1d88fa3244c9 req-460a909a-9662-4c1c-a386-a1d7c2a380a1 service nova] Creating event network-vif-unplugged:679e3ac9-dc5d-4404-aa8b-99020ce86192 for instance 6ebabc55-1b1d-4276-8bde-d8d4859d74fd on n-h1-856895-1 Sep 10 11:49:19.342495 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-6932de6e-cb30-41be-8ebd-1d88fa3244c9 req-460a909a-9662-4c1c-a386-a1d7c2a380a1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051357 Sep 10 11:49:19.343599 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1151/2375] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:49:19.344845 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-80d5fcb9-90b8-4b42-8b7f-27c4ec7fc061 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:19.345352 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-80d5fcb9-90b8-4b42-8b7f-27c4ec7fc061 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:19.345798 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-80d5fcb9-90b8-4b42-8b7f-27c4ec7fc061 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:19.347559 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-80d5fcb9-90b8-4b42-8b7f-27c4ec7fc061 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:19.348045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-80d5fcb9-90b8-4b42-8b7f-27c4ec7fc061 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:19.348486 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-80d5fcb9-90b8-4b42-8b7f-27c4ec7fc061 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:19.349853 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-77e9db82-ced3-485e-b388-176201c576f4 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:19.350759 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-77e9db82-ced3-485e-b388-176201c576f4 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] [instance: d01d9406-b2a4-4b3b-af6b-832861ed820c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:19.357181 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-77e9db82-ced3-485e-b388-176201c576f4 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:19.357869 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-77e9db82-ced3-485e-b388-176201c576f4 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:19.358467 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-77e9db82-ced3-485e-b388-176201c576f4 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:19.359394 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-77e9db82-ced3-485e-b388-176201c576f4 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:19.360269 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-77e9db82-ced3-485e-b388-176201c576f4 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:19.360919 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-77e9db82-ced3-485e-b388-176201c576f4 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:19.563068 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-80d5fcb9-90b8-4b42-8b7f-27c4ec7fc061 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a32e3e1c1164b8abbb9ee6532e81e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30967668a810420ebf3d44363f44a135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:19.592759 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-80d5fcb9-90b8-4b42-8b7f-27c4ec7fc061 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] 10.222.0.23 "GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3" status: 200 len: 1403 microversion: 2.1 time: 0.252250 Sep 10 11:49:19.593578 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-77e9db82-ced3-485e-b388-176201c576f4 tempest-ServersOnMultiNodesTest-925401203 tempest-ServersOnMultiNodesTest-925401203-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c" status: 200 len: 1617 microversion: 2.1 time: 0.248570 Sep 10 11:49:19.594658 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1152/2376] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:19 2022] GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c => generated 1617 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:19.600640 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2305a9f8-94fe-4113-91d7-91304a314b0b tempest-FloatingIPDetailsTestJSON-514339443 tempest-FloatingIPDetailsTestJSON-514339443-project] Calling method '.version_select at 0x7f40735c9040>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:19.612380 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1225/2377] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:19 2022] GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3 => generated 1403 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:19.626896 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-6f098408-a724-406f-b046-9db5033f4fcb req-e6148d89-9e98-4ddd-b36b-015368c3781c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a", "name": "network-vif-deleted", "tag": "59f16da0-b2c3-4790-8066-9b8d9bae32dd"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:19.645203 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-6f098408-a724-406f-b046-9db5033f4fcb req-e6148d89-9e98-4ddd-b36b-015368c3781c service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:19.646089 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-6f098408-a724-406f-b046-9db5033f4fcb req-e6148d89-9e98-4ddd-b36b-015368c3781c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:19.647311 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-6f098408-a724-406f-b046-9db5033f4fcb req-e6148d89-9e98-4ddd-b36b-015368c3781c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:19.667904 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-6f098408-a724-406f-b046-9db5033f4fcb req-e6148d89-9e98-4ddd-b36b-015368c3781c service nova] Creating event network-vif-deleted:59f16da0-b2c3-4790-8066-9b8d9bae32dd for instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a on n-h1-856895-1 Sep 10 11:49:19.709231 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-6f098408-a724-406f-b046-9db5033f4fcb req-e6148d89-9e98-4ddd-b36b-015368c3781c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072077 Sep 10 11:49:19.712209 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1226/2378] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:49:19.729852 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5db89cf0-81ad-4cb8-9a38-f99be8807a4e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:19.733239 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5db89cf0-81ad-4cb8-9a38-f99be8807a4e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:19.745849 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5db89cf0-81ad-4cb8-9a38-f99be8807a4e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:19.748470 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5db89cf0-81ad-4cb8-9a38-f99be8807a4e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:19.749179 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5db89cf0-81ad-4cb8-9a38-f99be8807a4e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:19.751606 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5db89cf0-81ad-4cb8-9a38-f99be8807a4e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:19.752407 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5db89cf0-81ad-4cb8-9a38-f99be8807a4e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:19.753527 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5db89cf0-81ad-4cb8-9a38-f99be8807a4e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:20.139712 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5db89cf0-81ad-4cb8-9a38-f99be8807a4e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:20.150408 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5db89cf0-81ad-4cb8-9a38-f99be8807a4e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 200 len: 1526 microversion: 2.1 time: 0.435408 Sep 10 11:49:20.151009 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1227/2379] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:19 2022] GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 1526 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:20.155683 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7dfdce04-63af-4e74-b1f7-9c84159696a7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:20.156426 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7dfdce04-63af-4e74-b1f7-9c84159696a7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d01d9406-b2a4-4b3b-af6b-832861ed820c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:20.163233 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7dfdce04-63af-4e74-b1f7-9c84159696a7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:20.163953 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7dfdce04-63af-4e74-b1f7-9c84159696a7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:20.164476 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7dfdce04-63af-4e74-b1f7-9c84159696a7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:20.165087 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7dfdce04-63af-4e74-b1f7-9c84159696a7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:20.165546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7dfdce04-63af-4e74-b1f7-9c84159696a7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:20.165977 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7dfdce04-63af-4e74-b1f7-9c84159696a7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:20.193385 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7dfdce04-63af-4e74-b1f7-9c84159696a7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d01d9406-b2a4-4b3b-af6b-832861ed820c] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:49:20.280686 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7dfdce04-63af-4e74-b1f7-9c84159696a7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c" status: 204 len: 0 microversion: 2.1 time: 0.128302 Sep 10 11:49:20.281292 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1228/2380] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:49:20 2022] DELETE /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:49:20.289243 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-99ccd9a2-bf96-4f36-9def-e0ec1210c1aa tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:20.290019 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-99ccd9a2-bf96-4f36-9def-e0ec1210c1aa tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:20.296848 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99ccd9a2-bf96-4f36-9def-e0ec1210c1aa tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:20.297204 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99ccd9a2-bf96-4f36-9def-e0ec1210c1aa tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:20.297750 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99ccd9a2-bf96-4f36-9def-e0ec1210c1aa tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:20.298350 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99ccd9a2-bf96-4f36-9def-e0ec1210c1aa tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:20.298816 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99ccd9a2-bf96-4f36-9def-e0ec1210c1aa tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:20.299427 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99ccd9a2-bf96-4f36-9def-e0ec1210c1aa tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:20.589033 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-99ccd9a2-bf96-4f36-9def-e0ec1210c1aa tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:20.599652 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-99ccd9a2-bf96-4f36-9def-e0ec1210c1aa tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:20.601114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-99ccd9a2-bf96-4f36-9def-e0ec1210c1aa tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:20.602323 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-99ccd9a2-bf96-4f36-9def-e0ec1210c1aa tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1985 microversion: 2.42 time: 0.319653 Sep 10 11:49:20.602898 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1229/2381] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:49:20 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1985 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:49:20.607655 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-62435ecf-8184-40d7-8ccf-ba7bf3302248 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:20.608271 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-62435ecf-8184-40d7-8ccf-ba7bf3302248 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:20.617034 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-62435ecf-8184-40d7-8ccf-ba7bf3302248 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:20.619044 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-62435ecf-8184-40d7-8ccf-ba7bf3302248 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:20.619629 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-62435ecf-8184-40d7-8ccf-ba7bf3302248 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:20.621348 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-62435ecf-8184-40d7-8ccf-ba7bf3302248 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:20.623367 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-62435ecf-8184-40d7-8ccf-ba7bf3302248 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:20.624396 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-62435ecf-8184-40d7-8ccf-ba7bf3302248 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:20.865855 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-62435ecf-8184-40d7-8ccf-ba7bf3302248 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:20.874407 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-62435ecf-8184-40d7-8ccf-ba7bf3302248 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1478 microversion: 2.1 time: 0.270102 Sep 10 11:49:20.875330 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1230/2382] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:20 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1478 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:20.879701 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f1aa800d-bbeb-44bc-9adb-dfe91521a280 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:20.880325 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f1aa800d-bbeb-44bc-9adb-dfe91521a280 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d01d9406-b2a4-4b3b-af6b-832861ed820c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:20.891839 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f1aa800d-bbeb-44bc-9adb-dfe91521a280 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:20.892280 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f1aa800d-bbeb-44bc-9adb-dfe91521a280 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:20.892649 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f1aa800d-bbeb-44bc-9adb-dfe91521a280 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:20.893408 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f1aa800d-bbeb-44bc-9adb-dfe91521a280 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:20.893873 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f1aa800d-bbeb-44bc-9adb-dfe91521a280 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:20.894301 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f1aa800d-bbeb-44bc-9adb-dfe91521a280 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:21.157951 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f1aa800d-bbeb-44bc-9adb-dfe91521a280 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:21.161925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:49:21.174653 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f1aa800d-bbeb-44bc-9adb-dfe91521a280 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c" status: 200 len: 1472 microversion: 2.1 time: 0.298013 Sep 10 11:49:21.175688 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1231/2383] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:20 2022] GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c => generated 1472 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:21.180522 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7c9c0433-51e4-4841-a2c2-223591445122 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:21.181429 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7c9c0433-51e4-4841-a2c2-223591445122 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] [instance: c5779770-492b-4ecd-bbc3-8e67b959c5a3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:21.203325 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c9c0433-51e4-4841-a2c2-223591445122 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:21.203771 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c9c0433-51e4-4841-a2c2-223591445122 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:21.205798 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c9c0433-51e4-4841-a2c2-223591445122 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:21.206867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c9c0433-51e4-4841-a2c2-223591445122 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:21.211839 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c9c0433-51e4-4841-a2c2-223591445122 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:21.212630 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c9c0433-51e4-4841-a2c2-223591445122 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:21.386084 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2305a9f8-94fe-4113-91d7-91304a314b0b tempest-FloatingIPDetailsTestJSON-514339443 tempest-FloatingIPDetailsTestJSON-514339443-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/040b4475-8b14-4b63-80f5-27402878655a" status: 202 len: 0 microversion: 2.1 time: 1.790071 Sep 10 11:49:21.389550 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1153/2384] 10.222.0.23 () {58 vars in 1263 bytes} [Sat Sep 10 11:49:19 2022] DELETE /compute/v2.1/os-floating-ips/040b4475-8b14-4b63-80f5-27402878655a => generated 0 bytes in 1792 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:49:21.391702 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4f9698e9-c6c7-43a6-810b-62345fb65e39 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:21.392323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4f9698e9-c6c7-43a6-810b-62345fb65e39 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:21.399351 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f9698e9-c6c7-43a6-810b-62345fb65e39 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:21.400081 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f9698e9-c6c7-43a6-810b-62345fb65e39 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:21.400525 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f9698e9-c6c7-43a6-810b-62345fb65e39 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:21.401238 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f9698e9-c6c7-43a6-810b-62345fb65e39 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:21.401701 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f9698e9-c6c7-43a6-810b-62345fb65e39 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:21.402132 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f9698e9-c6c7-43a6-810b-62345fb65e39 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:21.503658 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7c9c0433-51e4-4841-a2c2-223591445122 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a32e3e1c1164b8abbb9ee6532e81e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30967668a810420ebf3d44363f44a135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:21.511920 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7c9c0433-51e4-4841-a2c2-223591445122 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] 10.222.0.23 "GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3" status: 200 len: 1403 microversion: 2.1 time: 0.334999 Sep 10 11:49:21.512592 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1232/2385] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:21 2022] GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3 => generated 1403 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:21.517143 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-f5f95d81-34e2-4308-a14c-4baa3220eebd req-88a66a3b-cf15-4b5e-88aa-53a578277b94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cec74510-742b-4a47-b7c5-58411ca992de", "name": "network-vif-unplugged", "status": "completed", "tag": "80da9e33-1a86-4d89-b08b-b5850346b6f1"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:21.530206 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-f5f95d81-34e2-4308-a14c-4baa3220eebd req-88a66a3b-cf15-4b5e-88aa-53a578277b94 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:21.530896 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-f5f95d81-34e2-4308-a14c-4baa3220eebd req-88a66a3b-cf15-4b5e-88aa-53a578277b94 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:21.531499 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-f5f95d81-34e2-4308-a14c-4baa3220eebd req-88a66a3b-cf15-4b5e-88aa-53a578277b94 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:21.543875 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-f5f95d81-34e2-4308-a14c-4baa3220eebd req-88a66a3b-cf15-4b5e-88aa-53a578277b94 service nova] Creating event network-vif-unplugged:80da9e33-1a86-4d89-b08b-b5850346b6f1 for instance cec74510-742b-4a47-b7c5-58411ca992de on n-h1-856895-1 Sep 10 11:49:21.548776 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-f5f95d81-34e2-4308-a14c-4baa3220eebd req-88a66a3b-cf15-4b5e-88aa-53a578277b94 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035071 Sep 10 11:49:21.549995 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1233/2386] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:49:21.556460 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d99124b8-058e-4eb9-a868-ea2705db5e59 tempest-FloatingIPDetailsTestJSON-514339443 tempest-FloatingIPDetailsTestJSON-514339443-project] Calling method '.version_select at 0x7f407b5aa940>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:21.691470 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4f9698e9-c6c7-43a6-810b-62345fb65e39 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:21.705413 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4f9698e9-c6c7-43a6-810b-62345fb65e39 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 200 len: 1526 microversion: 2.1 time: 0.317318 Sep 10 11:49:21.706021 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1154/2387] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:21 2022] GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 1526 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:21.710783 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-53a2025f-de10-4118-b857-d5b1fcad8625 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:21.711527 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-53a2025f-de10-4118-b857-d5b1fcad8625 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:21.717796 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53a2025f-de10-4118-b857-d5b1fcad8625 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:21.718286 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53a2025f-de10-4118-b857-d5b1fcad8625 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:21.718729 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53a2025f-de10-4118-b857-d5b1fcad8625 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:21.719450 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53a2025f-de10-4118-b857-d5b1fcad8625 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:21.719917 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53a2025f-de10-4118-b857-d5b1fcad8625 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:21.720376 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53a2025f-de10-4118-b857-d5b1fcad8625 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:21.816335 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-53a2025f-de10-4118-b857-d5b1fcad8625 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:21.826190 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-53a2025f-de10-4118-b857-d5b1fcad8625 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:21.828025 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-53a2025f-de10-4118-b857-d5b1fcad8625 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:21.829394 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-53a2025f-de10-4118-b857-d5b1fcad8625 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1873 microversion: 2.42 time: 0.122239 Sep 10 11:49:21.844833 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1155/2388] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:49:21 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1873 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:49:21.898106 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-305690c3-c0f3-4150-89b6-74fcbed7ec05 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:21.899257 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-305690c3-c0f3-4150-89b6-74fcbed7ec05 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:21.906227 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-305690c3-c0f3-4150-89b6-74fcbed7ec05 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:21.906928 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-305690c3-c0f3-4150-89b6-74fcbed7ec05 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:21.907564 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-305690c3-c0f3-4150-89b6-74fcbed7ec05 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:21.909751 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-305690c3-c0f3-4150-89b6-74fcbed7ec05 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:21.910387 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-305690c3-c0f3-4150-89b6-74fcbed7ec05 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:21.911108 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-305690c3-c0f3-4150-89b6-74fcbed7ec05 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:22.236285 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-305690c3-c0f3-4150-89b6-74fcbed7ec05 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:22.247840 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-305690c3-c0f3-4150-89b6-74fcbed7ec05 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1478 microversion: 2.1 time: 0.353614 Sep 10 11:49:22.259880 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1156/2389] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:21 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1478 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:22.271644 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ddd37599-454c-4088-b352-55fca1598c63 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:22.272549 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ddd37599-454c-4088-b352-55fca1598c63 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d01d9406-b2a4-4b3b-af6b-832861ed820c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:22.279901 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ddd37599-454c-4088-b352-55fca1598c63 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:22.280652 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ddd37599-454c-4088-b352-55fca1598c63 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:22.281343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ddd37599-454c-4088-b352-55fca1598c63 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:22.282307 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ddd37599-454c-4088-b352-55fca1598c63 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:22.282937 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ddd37599-454c-4088-b352-55fca1598c63 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:22.283608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ddd37599-454c-4088-b352-55fca1598c63 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:22.520956 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ddd37599-454c-4088-b352-55fca1598c63 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:22.537788 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ddd37599-454c-4088-b352-55fca1598c63 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c" status: 200 len: 1472 microversion: 2.1 time: 0.276341 Sep 10 11:49:22.538904 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1157/2390] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:22 2022] GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c => generated 1472 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:22.543777 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-98fe06b6-ef10-4baa-a5f3-eabed555d36e tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:22.544685 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-98fe06b6-ef10-4baa-a5f3-eabed555d36e tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] [instance: c5779770-492b-4ecd-bbc3-8e67b959c5a3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:22.563766 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-98fe06b6-ef10-4baa-a5f3-eabed555d36e tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:22.568945 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-98fe06b6-ef10-4baa-a5f3-eabed555d36e tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:22.569452 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-98fe06b6-ef10-4baa-a5f3-eabed555d36e tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:22.570254 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-98fe06b6-ef10-4baa-a5f3-eabed555d36e tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:22.571146 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-98fe06b6-ef10-4baa-a5f3-eabed555d36e tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:22.571632 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-98fe06b6-ef10-4baa-a5f3-eabed555d36e tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:22.927884 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-98fe06b6-ef10-4baa-a5f3-eabed555d36e tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a32e3e1c1164b8abbb9ee6532e81e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30967668a810420ebf3d44363f44a135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:22.931709 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d99124b8-058e-4eb9-a868-ea2705db5e59 tempest-FloatingIPDetailsTestJSON-514339443 tempest-FloatingIPDetailsTestJSON-514339443-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/36adfd12-18e4-49af-939d-4734f71cf65b" status: 202 len: 0 microversion: 2.1 time: 1.379071 Sep 10 11:49:22.933260 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1234/2391] 10.222.0.23 () {58 vars in 1263 bytes} [Sat Sep 10 11:49:21 2022] DELETE /compute/v2.1/os-floating-ips/36adfd12-18e4-49af-939d-4734f71cf65b => generated 0 bytes in 1382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:49:22.942911 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1ae72405-1492-4c5f-96b1-0b06209905ed tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:22.947079 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1ae72405-1492-4c5f-96b1-0b06209905ed tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:22.953311 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-98fe06b6-ef10-4baa-a5f3-eabed555d36e tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] 10.222.0.23 "GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3" status: 200 len: 1403 microversion: 2.1 time: 0.413032 Sep 10 11:49:22.957169 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1158/2392] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:22 2022] GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3 => generated 1403 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:22.965290 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ae72405-1492-4c5f-96b1-0b06209905ed tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:22.965794 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ae72405-1492-4c5f-96b1-0b06209905ed tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:22.966243 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ae72405-1492-4c5f-96b1-0b06209905ed tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:22.969255 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d507881b-163b-4c00-8ddf-b27c9ca81b01 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:22.969871 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ae72405-1492-4c5f-96b1-0b06209905ed tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:22.970482 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ae72405-1492-4c5f-96b1-0b06209905ed tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:22.970926 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ae72405-1492-4c5f-96b1-0b06209905ed tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:22.972574 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d507881b-163b-4c00-8ddf-b27c9ca81b01 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:22.985971 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d507881b-163b-4c00-8ddf-b27c9ca81b01 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:22.987916 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d507881b-163b-4c00-8ddf-b27c9ca81b01 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:22.990052 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d507881b-163b-4c00-8ddf-b27c9ca81b01 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:22.993261 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d507881b-163b-4c00-8ddf-b27c9ca81b01 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:22.993861 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d507881b-163b-4c00-8ddf-b27c9ca81b01 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:22.995314 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d507881b-163b-4c00-8ddf-b27c9ca81b01 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:23.126981 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d507881b-163b-4c00-8ddf-b27c9ca81b01 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:23.148841 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d507881b-163b-4c00-8ddf-b27c9ca81b01 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:23.151440 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d507881b-163b-4c00-8ddf-b27c9ca81b01 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:23.152710 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d507881b-163b-4c00-8ddf-b27c9ca81b01 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1873 microversion: 2.42 time: 0.193657 Sep 10 11:49:23.167206 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1159/2393] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:49:22 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1873 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:49:23.185572 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c42f384d-6cca-4d4c-a963-8ccd14fe684f tempest-FloatingIPDetailsTestJSON-514339443 tempest-FloatingIPDetailsTestJSON-514339443-project] Calling method '.version_select at 0x7f407349eca0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:23.558299 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1ae72405-1492-4c5f-96b1-0b06209905ed tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:23.569761 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1ae72405-1492-4c5f-96b1-0b06209905ed tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 200 len: 1526 microversion: 2.1 time: 0.634855 Sep 10 11:49:23.570415 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1235/2394] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:22 2022] GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 1526 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:23.589428 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d5323d0e-3f75-49dd-b2aa-5b3b3b79103c tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:23.590304 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d5323d0e-3f75-49dd-b2aa-5b3b3b79103c tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:23.598758 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d5323d0e-3f75-49dd-b2aa-5b3b3b79103c tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:23.600782 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d5323d0e-3f75-49dd-b2aa-5b3b3b79103c tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:23.602750 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d5323d0e-3f75-49dd-b2aa-5b3b3b79103c tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:23.603698 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d5323d0e-3f75-49dd-b2aa-5b3b3b79103c tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:23.604938 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d5323d0e-3f75-49dd-b2aa-5b3b3b79103c tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:23.606807 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d5323d0e-3f75-49dd-b2aa-5b3b3b79103c tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:24.073799 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d5323d0e-3f75-49dd-b2aa-5b3b3b79103c tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:24.084063 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d5323d0e-3f75-49dd-b2aa-5b3b3b79103c tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1478 microversion: 2.1 time: 0.512592 Sep 10 11:49:24.098637 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1236/2395] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:23 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1478 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:24.143089 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b0d0a1f7-ac0e-4502-819a-ac6d669f90b0 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:24.148935 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b0d0a1f7-ac0e-4502-819a-ac6d669f90b0 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d01d9406-b2a4-4b3b-af6b-832861ed820c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:24.182776 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0d0a1f7-ac0e-4502-819a-ac6d669f90b0 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:24.186974 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0d0a1f7-ac0e-4502-819a-ac6d669f90b0 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:24.191431 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0d0a1f7-ac0e-4502-819a-ac6d669f90b0 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:24.193324 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0d0a1f7-ac0e-4502-819a-ac6d669f90b0 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:24.195711 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0d0a1f7-ac0e-4502-819a-ac6d669f90b0 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:24.198359 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0d0a1f7-ac0e-4502-819a-ac6d669f90b0 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:24.536799 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b0d0a1f7-ac0e-4502-819a-ac6d669f90b0 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:24.551111 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b0d0a1f7-ac0e-4502-819a-ac6d669f90b0 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c" status: 200 len: 1472 microversion: 2.1 time: 0.429865 Sep 10 11:49:24.557112 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1237/2396] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:24 2022] GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c => generated 1472 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:24.570723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-ce5afdba-7e0d-4bab-ad64-3755e1300114 req-8de7a503-378a-43e3-9daf-e8843bd66ce3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ebabc55-1b1d-4276-8bde-d8d4859d74fd", "name": "network-vif-plugged", "status": "completed", "tag": "679e3ac9-dc5d-4404-aa8b-99020ce86192"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:24.589944 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-ce5afdba-7e0d-4bab-ad64-3755e1300114 req-8de7a503-378a-43e3-9daf-e8843bd66ce3 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:24.590760 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-ce5afdba-7e0d-4bab-ad64-3755e1300114 req-8de7a503-378a-43e3-9daf-e8843bd66ce3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:24.592173 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-ce5afdba-7e0d-4bab-ad64-3755e1300114 req-8de7a503-378a-43e3-9daf-e8843bd66ce3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:24.606007 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-ce5afdba-7e0d-4bab-ad64-3755e1300114 req-8de7a503-378a-43e3-9daf-e8843bd66ce3 service nova] Creating event network-vif-plugged:679e3ac9-dc5d-4404-aa8b-99020ce86192 for instance 6ebabc55-1b1d-4276-8bde-d8d4859d74fd on n-h1-856895-1 Sep 10 11:49:24.614125 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-ce5afdba-7e0d-4bab-ad64-3755e1300114 req-8de7a503-378a-43e3-9daf-e8843bd66ce3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051132 Sep 10 11:49:24.615606 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1238/2397] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:49:24.626902 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5eb5709a-657d-4005-9276-3f71829aa651 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:24.629283 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5eb5709a-657d-4005-9276-3f71829aa651 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] [instance: c5779770-492b-4ecd-bbc3-8e67b959c5a3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:24.642050 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5eb5709a-657d-4005-9276-3f71829aa651 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:24.643854 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5eb5709a-657d-4005-9276-3f71829aa651 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:24.644975 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5eb5709a-657d-4005-9276-3f71829aa651 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:24.645929 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5eb5709a-657d-4005-9276-3f71829aa651 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:24.646745 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5eb5709a-657d-4005-9276-3f71829aa651 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:24.647599 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5eb5709a-657d-4005-9276-3f71829aa651 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:25.208341 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5eb5709a-657d-4005-9276-3f71829aa651 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a32e3e1c1164b8abbb9ee6532e81e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30967668a810420ebf3d44363f44a135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:25.226063 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5eb5709a-657d-4005-9276-3f71829aa651 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] 10.222.0.23 "GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3" status: 200 len: 1403 microversion: 2.1 time: 0.608929 Sep 10 11:49:25.244279 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1239/2398] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:24 2022] GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3 => generated 1403 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:25.251101 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-3a696219-ec65-4fc5-9176-94637061ba7a req-9cb420ef-1a8c-4c3c-a9d0-74acc2f07db9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cec74510-742b-4a47-b7c5-58411ca992de", "name": "network-vif-deleted", "tag": "80da9e33-1a86-4d89-b08b-b5850346b6f1"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:25.263478 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-3a696219-ec65-4fc5-9176-94637061ba7a req-9cb420ef-1a8c-4c3c-a9d0-74acc2f07db9 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:25.265919 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-3a696219-ec65-4fc5-9176-94637061ba7a req-9cb420ef-1a8c-4c3c-a9d0-74acc2f07db9 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:25.266606 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-3a696219-ec65-4fc5-9176-94637061ba7a req-9cb420ef-1a8c-4c3c-a9d0-74acc2f07db9 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:25.281143 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-3a696219-ec65-4fc5-9176-94637061ba7a req-9cb420ef-1a8c-4c3c-a9d0-74acc2f07db9 service nova] Creating event network-vif-deleted:80da9e33-1a86-4d89-b08b-b5850346b6f1 for instance cec74510-742b-4a47-b7c5-58411ca992de on n-h1-856895-1 Sep 10 11:49:25.287741 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-3a696219-ec65-4fc5-9176-94637061ba7a req-9cb420ef-1a8c-4c3c-a9d0-74acc2f07db9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041240 Sep 10 11:49:25.288834 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1240/2399] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:49:25.289701 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c42f384d-6cca-4d4c-a963-8ccd14fe684f tempest-FloatingIPDetailsTestJSON-514339443 tempest-FloatingIPDetailsTestJSON-514339443-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/ba60b33d-b66c-42a1-b475-9ed7fc9f615f" status: 202 len: 0 microversion: 2.1 time: 2.131355 Sep 10 11:49:25.294003 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1160/2400] 10.222.0.23 () {58 vars in 1263 bytes} [Sat Sep 10 11:49:23 2022] DELETE /compute/v2.1/os-floating-ips/ba60b33d-b66c-42a1-b475-9ed7fc9f615f => generated 0 bytes in 2136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:49:25.296810 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c4fd6ff4-3490-4acd-8d39-5f0bfd1a7594 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:25.297705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c4fd6ff4-3490-4acd-8d39-5f0bfd1a7594 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:25.298769 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-269090fa-7471-4979-b3ca-8bc91ba62557 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:25.299492 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-269090fa-7471-4979-b3ca-8bc91ba62557 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:25.304825 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c4fd6ff4-3490-4acd-8d39-5f0bfd1a7594 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:25.305495 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c4fd6ff4-3490-4acd-8d39-5f0bfd1a7594 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:25.306432 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c4fd6ff4-3490-4acd-8d39-5f0bfd1a7594 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:25.307523 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c4fd6ff4-3490-4acd-8d39-5f0bfd1a7594 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:25.308568 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c4fd6ff4-3490-4acd-8d39-5f0bfd1a7594 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:25.309214 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c4fd6ff4-3490-4acd-8d39-5f0bfd1a7594 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:25.317962 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-269090fa-7471-4979-b3ca-8bc91ba62557 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:25.318459 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-269090fa-7471-4979-b3ca-8bc91ba62557 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:25.318901 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-269090fa-7471-4979-b3ca-8bc91ba62557 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:25.327914 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-269090fa-7471-4979-b3ca-8bc91ba62557 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:25.328658 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-269090fa-7471-4979-b3ca-8bc91ba62557 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:25.329262 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-269090fa-7471-4979-b3ca-8bc91ba62557 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:25.413469 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-269090fa-7471-4979-b3ca-8bc91ba62557 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:25.413970 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-269090fa-7471-4979-b3ca-8bc91ba62557 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:25.419635 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-269090fa-7471-4979-b3ca-8bc91ba62557 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:25.429580 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-269090fa-7471-4979-b3ca-8bc91ba62557 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lazy-loading 'fault' on Instance uuid cec74510-742b-4a47-b7c5-58411ca992de {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:49:25.440999 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c4fd6ff4-3490-4acd-8d39-5f0bfd1a7594 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:25.457326 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c4fd6ff4-3490-4acd-8d39-5f0bfd1a7594 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:25.459206 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c4fd6ff4-3490-4acd-8d39-5f0bfd1a7594 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:25.463467 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c4fd6ff4-3490-4acd-8d39-5f0bfd1a7594 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1873 microversion: 2.42 time: 0.171446 Sep 10 11:49:25.466105 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1241/2401] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:49:25 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1873 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:49:25.498641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-637bd830-34f0-4669-b1c0-92614d269841 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:25.499790 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-637bd830-34f0-4669-b1c0-92614d269841 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:25.520113 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-637bd830-34f0-4669-b1c0-92614d269841 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:25.523550 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-637bd830-34f0-4669-b1c0-92614d269841 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:25.524168 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-637bd830-34f0-4669-b1c0-92614d269841 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:25.527451 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-637bd830-34f0-4669-b1c0-92614d269841 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:25.528215 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-637bd830-34f0-4669-b1c0-92614d269841 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:25.529034 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-637bd830-34f0-4669-b1c0-92614d269841 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:25.666181 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-269090fa-7471-4979-b3ca-8bc91ba62557 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:25.680176 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-269090fa-7471-4979-b3ca-8bc91ba62557 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 200 len: 1314 microversion: 2.1 time: 0.385078 Sep 10 11:49:25.681374 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1161/2402] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:25 2022] GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:25.686178 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9ff242d9-aaa4-4e73-ba4b-b71ffc4e3b9c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:25.688582 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9ff242d9-aaa4-4e73-ba4b-b71ffc4e3b9c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d01d9406-b2a4-4b3b-af6b-832861ed820c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:25.707731 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ff242d9-aaa4-4e73-ba4b-b71ffc4e3b9c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:25.708451 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ff242d9-aaa4-4e73-ba4b-b71ffc4e3b9c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:25.709079 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ff242d9-aaa4-4e73-ba4b-b71ffc4e3b9c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:25.709997 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ff242d9-aaa4-4e73-ba4b-b71ffc4e3b9c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:25.711857 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ff242d9-aaa4-4e73-ba4b-b71ffc4e3b9c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:25.712476 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ff242d9-aaa4-4e73-ba4b-b71ffc4e3b9c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:25.759757 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ff242d9-aaa4-4e73-ba4b-b71ffc4e3b9c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:25.760246 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ff242d9-aaa4-4e73-ba4b-b71ffc4e3b9c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:25.760681 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ff242d9-aaa4-4e73-ba4b-b71ffc4e3b9c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:25.761337 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-9ff242d9-aaa4-4e73-ba4b-b71ffc4e3b9c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lazy-loading 'fault' on Instance uuid d01d9406-b2a4-4b3b-af6b-832861ed820c {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:49:25.906067 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-637bd830-34f0-4669-b1c0-92614d269841 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:25.917830 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-637bd830-34f0-4669-b1c0-92614d269841 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1478 microversion: 2.1 time: 0.450187 Sep 10 11:49:25.919868 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1242/2403] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:25 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1478 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:25.934673 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9ff242d9-aaa4-4e73-ba4b-b71ffc4e3b9c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:25.951324 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9ff242d9-aaa4-4e73-ba4b-b71ffc4e3b9c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c" status: 200 len: 1306 microversion: 2.1 time: 0.268033 Sep 10 11:49:25.958399 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1162/2404] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:25 2022] GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c => generated 1306 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:26.258655 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-47aee584-3757-4cd4-bd53-cb68d54022ab tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:26.259307 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-47aee584-3757-4cd4-bd53-cb68d54022ab tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] [instance: c5779770-492b-4ecd-bbc3-8e67b959c5a3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:26.267307 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47aee584-3757-4cd4-bd53-cb68d54022ab tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:26.268054 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47aee584-3757-4cd4-bd53-cb68d54022ab tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:26.269033 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47aee584-3757-4cd4-bd53-cb68d54022ab tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:26.269909 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47aee584-3757-4cd4-bd53-cb68d54022ab tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:26.270660 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47aee584-3757-4cd4-bd53-cb68d54022ab tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:26.271315 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47aee584-3757-4cd4-bd53-cb68d54022ab tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:26.432268 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-47aee584-3757-4cd4-bd53-cb68d54022ab tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a32e3e1c1164b8abbb9ee6532e81e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30967668a810420ebf3d44363f44a135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:26.441608 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-47aee584-3757-4cd4-bd53-cb68d54022ab tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] 10.222.0.23 "GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3" status: 200 len: 1590 microversion: 2.1 time: 0.186928 Sep 10 11:49:26.442765 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1243/2405] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:26 2022] GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3 => generated 1590 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:26.466493 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-385fef44-8581-4d79-b780-2ac913c94f2a tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:26.467852 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-385fef44-8581-4d79-b780-2ac913c94f2a tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] [instance: c5779770-492b-4ecd-bbc3-8e67b959c5a3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:26.476040 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-385fef44-8581-4d79-b780-2ac913c94f2a tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:26.476790 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-385fef44-8581-4d79-b780-2ac913c94f2a tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:26.477624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-385fef44-8581-4d79-b780-2ac913c94f2a tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:26.478638 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-385fef44-8581-4d79-b780-2ac913c94f2a tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:26.479402 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-385fef44-8581-4d79-b780-2ac913c94f2a tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:26.480103 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-385fef44-8581-4d79-b780-2ac913c94f2a tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:26.497778 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ff3fd70f-4d2b-4aed-b483-60914e2dfe11 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:26.499134 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ff3fd70f-4d2b-4aed-b483-60914e2dfe11 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:26.508579 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ff3fd70f-4d2b-4aed-b483-60914e2dfe11 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:26.510953 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ff3fd70f-4d2b-4aed-b483-60914e2dfe11 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:26.512292 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ff3fd70f-4d2b-4aed-b483-60914e2dfe11 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:26.516305 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ff3fd70f-4d2b-4aed-b483-60914e2dfe11 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:26.516970 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ff3fd70f-4d2b-4aed-b483-60914e2dfe11 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:26.517552 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ff3fd70f-4d2b-4aed-b483-60914e2dfe11 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:26.659736 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ff3fd70f-4d2b-4aed-b483-60914e2dfe11 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:26.668077 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-385fef44-8581-4d79-b780-2ac913c94f2a tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] 10.222.0.23 "GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.206312 Sep 10 11:49:26.668767 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1163/2406] 10.222.0.23 () {58 vars in 1275 bytes} [Sat Sep 10 11:49:26 2022] GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3/os-interface => generated 284 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:49:26.673534 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ff3fd70f-4d2b-4aed-b483-60914e2dfe11 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:26.676476 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ff3fd70f-4d2b-4aed-b483-60914e2dfe11 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:26.678760 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ff3fd70f-4d2b-4aed-b483-60914e2dfe11 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1873 microversion: 2.42 time: 0.185488 Sep 10 11:49:26.684105 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1244/2407] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:49:26 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1873 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:49:26.708888 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f7e86a4c-91c8-4c24-ba2a-8887448bab84 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:26.709521 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f7e86a4c-91c8-4c24-ba2a-8887448bab84 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:26.717412 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f7e86a4c-91c8-4c24-ba2a-8887448bab84 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:26.719011 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f7e86a4c-91c8-4c24-ba2a-8887448bab84 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:26.719705 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f7e86a4c-91c8-4c24-ba2a-8887448bab84 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:26.720652 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f7e86a4c-91c8-4c24-ba2a-8887448bab84 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:26.722014 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f7e86a4c-91c8-4c24-ba2a-8887448bab84 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:26.722669 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f7e86a4c-91c8-4c24-ba2a-8887448bab84 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:26.763450 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f7e86a4c-91c8-4c24-ba2a-8887448bab84 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:26.764208 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f7e86a4c-91c8-4c24-ba2a-8887448bab84 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:26.764851 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f7e86a4c-91c8-4c24-ba2a-8887448bab84 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:26.765511 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-f7e86a4c-91c8-4c24-ba2a-8887448bab84 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lazy-loading 'fault' on Instance uuid cec74510-742b-4a47-b7c5-58411ca992de {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:49:26.947992 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9806298d-3678-4c02-bb4e-c467b10b3302 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:26.948658 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9806298d-3678-4c02-bb4e-c467b10b3302 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:26.960626 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f7e86a4c-91c8-4c24-ba2a-8887448bab84 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:26.972473 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f7e86a4c-91c8-4c24-ba2a-8887448bab84 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 200 len: 1314 microversion: 2.1 time: 0.267438 Sep 10 11:49:26.987361 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9806298d-3678-4c02-bb4e-c467b10b3302 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:26.987361 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9806298d-3678-4c02-bb4e-c467b10b3302 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:26.987361 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9806298d-3678-4c02-bb4e-c467b10b3302 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:26.987361 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9806298d-3678-4c02-bb4e-c467b10b3302 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:26.987361 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9806298d-3678-4c02-bb4e-c467b10b3302 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:26.987361 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9806298d-3678-4c02-bb4e-c467b10b3302 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:26.988635 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1164/2408] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:26 2022] GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:26.999332 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e99dbedf-aa35-4646-ad33-e208c0e87ec3 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:27.001286 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e99dbedf-aa35-4646-ad33-e208c0e87ec3 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d01d9406-b2a4-4b3b-af6b-832861ed820c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:27.012040 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e99dbedf-aa35-4646-ad33-e208c0e87ec3 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:27.012901 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e99dbedf-aa35-4646-ad33-e208c0e87ec3 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:27.013582 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e99dbedf-aa35-4646-ad33-e208c0e87ec3 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:27.014528 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e99dbedf-aa35-4646-ad33-e208c0e87ec3 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:27.015240 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e99dbedf-aa35-4646-ad33-e208c0e87ec3 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:27.015926 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e99dbedf-aa35-4646-ad33-e208c0e87ec3 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:27.067919 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e99dbedf-aa35-4646-ad33-e208c0e87ec3 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:27.068485 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e99dbedf-aa35-4646-ad33-e208c0e87ec3 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:27.070487 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e99dbedf-aa35-4646-ad33-e208c0e87ec3 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:27.070980 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-e99dbedf-aa35-4646-ad33-e208c0e87ec3 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lazy-loading 'fault' on Instance uuid d01d9406-b2a4-4b3b-af6b-832861ed820c {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:49:27.185979 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e99dbedf-aa35-4646-ad33-e208c0e87ec3 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:27.199531 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e99dbedf-aa35-4646-ad33-e208c0e87ec3 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c" status: 200 len: 1306 microversion: 2.1 time: 0.209410 Sep 10 11:49:27.200964 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1165/2409] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:26 2022] GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c => generated 1306 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:27.420513 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9806298d-3678-4c02-bb4e-c467b10b3302 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:27.428727 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9806298d-3678-4c02-bb4e-c467b10b3302 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1478 microversion: 2.1 time: 0.485750 Sep 10 11:49:27.432543 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1245/2410] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:26 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1478 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:27.466723 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-12ca9892-19ae-418f-bced-d65e22142359 req-51ea8d3c-a7ba-4808-9e05-01985b9867a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d01d9406-b2a4-4b3b-af6b-832861ed820c", "name": "network-vif-deleted", "tag": "2161d003-0eea-49c6-b0f7-f559642e1c1f"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:27.507260 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-12ca9892-19ae-418f-bced-d65e22142359 req-51ea8d3c-a7ba-4808-9e05-01985b9867a4 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:27.510677 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-12ca9892-19ae-418f-bced-d65e22142359 req-51ea8d3c-a7ba-4808-9e05-01985b9867a4 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:27.511396 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-12ca9892-19ae-418f-bced-d65e22142359 req-51ea8d3c-a7ba-4808-9e05-01985b9867a4 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:27.547224 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-12ca9892-19ae-418f-bced-d65e22142359 req-51ea8d3c-a7ba-4808-9e05-01985b9867a4 service nova] Creating event network-vif-deleted:2161d003-0eea-49c6-b0f7-f559642e1c1f for instance d01d9406-b2a4-4b3b-af6b-832861ed820c on n-h1-856895-1 Sep 10 11:49:27.556528 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-12ca9892-19ae-418f-bced-d65e22142359 req-51ea8d3c-a7ba-4808-9e05-01985b9867a4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103281 Sep 10 11:49:27.558130 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1166/2411] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:49:27.711080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-92243d2d-cc4c-48da-b13f-57fd8fe9a38b tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:27.711992 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-92243d2d-cc4c-48da-b13f-57fd8fe9a38b tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:27.737745 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92243d2d-cc4c-48da-b13f-57fd8fe9a38b tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:27.738887 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92243d2d-cc4c-48da-b13f-57fd8fe9a38b tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:27.741031 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92243d2d-cc4c-48da-b13f-57fd8fe9a38b tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:27.743513 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92243d2d-cc4c-48da-b13f-57fd8fe9a38b tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:27.748714 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92243d2d-cc4c-48da-b13f-57fd8fe9a38b tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:27.749373 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92243d2d-cc4c-48da-b13f-57fd8fe9a38b tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:28.011251 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-92243d2d-cc4c-48da-b13f-57fd8fe9a38b tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:28.019907 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b8654045-d605-4c98-8704-18ad9544e000 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:28.021797 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b8654045-d605-4c98-8704-18ad9544e000 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:28.040891 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-92243d2d-cc4c-48da-b13f-57fd8fe9a38b tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:28.045866 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8654045-d605-4c98-8704-18ad9544e000 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:28.048371 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-92243d2d-cc4c-48da-b13f-57fd8fe9a38b tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:28.050205 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8654045-d605-4c98-8704-18ad9544e000 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:28.050912 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8654045-d605-4c98-8704-18ad9544e000 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:28.054070 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-92243d2d-cc4c-48da-b13f-57fd8fe9a38b tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1873 microversion: 2.42 time: 0.349159 Sep 10 11:49:28.054929 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8654045-d605-4c98-8704-18ad9544e000 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:28.056914 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8654045-d605-4c98-8704-18ad9544e000 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:28.057766 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8654045-d605-4c98-8704-18ad9544e000 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:28.064095 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1246/2412] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:49:27 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1873 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:49:28.115219 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-b8654045-d605-4c98-8704-18ad9544e000 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] HTTP exception thrown: Instance cec74510-742b-4a47-b7c5-58411ca992de could not be found. Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b8654045-d605-4c98-8704-18ad9544e000 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Request method failure captured: Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de HTTP/1.1 Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHmIwAMwYRG5GoKY2e2BrHSNWC_XC8Dle2TjpsTglJZLl4iDdUWRHXObue6CBNwrU7ByI06vvCBASR59oLGdEXbdGMvKthtN9mtTXSrKa2RC4WmIF4PSo8bwMo95sbb-sIH1rhBMLrXpSep-X_LgFDTkeIXb7VSYHefdo66ew2GGhFc Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 3e5d376048de4c3191a58a547e05fd07 Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1177602115 Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3e5d376048de4c3191a58a547e05fd07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3e5d376048de4c3191a58a547e05fd07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3e5d376048de4c3191a58a547e05fd07", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3e5d376048de4c3191a58a547e05fd07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1177602115 Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 3e5d376048de4c3191a58a547e05fd07 Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1177602115 Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ImagesOneServerNegativeTestJSON-1177602115-project Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 8ced1e84956246b6bb7384ba484fde54 Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1177602115-project Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance cec74510-742b-4a47-b7c5-58411ca992de could not be found. Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'cec74510-742b-4a47-b7c5-58411ca992de'} Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cec74510-742b-4a47-b7c5-58411ca992de could not be found. Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cec74510-742b-4a47-b7c5-58411ca992de could not be found. Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:28.122063 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:28.126341 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:28.126341 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:28.126341 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:28.126341 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:28.126341 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:49:28.126341 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:49:28.126341 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cec74510-742b-4a47-b7c5-58411ca992de could not be found. Sep 10 11:49:28.126341 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:28.131672 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b8654045-d605-4c98-8704-18ad9544e000 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Returning 404 to user: Instance cec74510-742b-4a47-b7c5-58411ca992de could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:49:28.135642 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b8654045-d605-4c98-8704-18ad9544e000 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 404 len: 111 microversion: 2.1 time: 0.138663 Sep 10 11:49:28.138039 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1167/2413] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:27 2022] GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:49:28.150775 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b4d52104-6696-4eb8-8b69-96a231cb7d31 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Action: 'create', calling method: .version_select at 0x7f407b4f3940>, body: {"keypair": {"name": "tempest-keypair-463169617", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7Pz1UuIPUEYPo4lK13/bAx5m08TohBmYRy+PLtJ69Jf3JlESeq+ZSQ7zaur/Ktd76YJJzNeyPM66sLxRmlRpk8wB5jKjyylL/UXKrc+WaZyISemt04E2ok1qAQ+3BRyQ=="}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:28.182107 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-b4d52104-6696-4eb8-8b69-96a231cb7d31 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Getting quotas for project 3e5d376048de4c3191a58a547e05fd07. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:49:28.204033 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-b4d52104-6696-4eb8-8b69-96a231cb7d31 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Getting quotas for user 8ced1e84956246b6bb7384ba484fde54 and project 3e5d376048de4c3191a58a547e05fd07. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:49:28.224849 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7a49c572-4874-422a-bea6-e17506078b22 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:28.225865 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7a49c572-4874-422a-bea6-e17506078b22 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d01d9406-b2a4-4b3b-af6b-832861ed820c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:28.243571 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a49c572-4874-422a-bea6-e17506078b22 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:28.244766 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a49c572-4874-422a-bea6-e17506078b22 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:28.245442 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a49c572-4874-422a-bea6-e17506078b22 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:28.246374 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a49c572-4874-422a-bea6-e17506078b22 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:28.247056 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a49c572-4874-422a-bea6-e17506078b22 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:28.247732 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a49c572-4874-422a-bea6-e17506078b22 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:28.272598 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b4d52104-6696-4eb8-8b69-96a231cb7d31 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.127861 Sep 10 11:49:28.275004 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1247/2414] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 11:49:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:49:28.344106 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a49c572-4874-422a-bea6-e17506078b22 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:28.344954 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a49c572-4874-422a-bea6-e17506078b22 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:28.346655 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a49c572-4874-422a-bea6-e17506078b22 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:28.354798 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-7a49c572-4874-422a-bea6-e17506078b22 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lazy-loading 'fault' on Instance uuid d01d9406-b2a4-4b3b-af6b-832861ed820c {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:49:28.458728 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3c8aedaa-ea56-4db1-9b51-50da8d41f884 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:28.460667 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3c8aedaa-ea56-4db1-9b51-50da8d41f884 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:28.475515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3c8aedaa-ea56-4db1-9b51-50da8d41f884 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:28.476133 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3c8aedaa-ea56-4db1-9b51-50da8d41f884 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:28.476921 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3c8aedaa-ea56-4db1-9b51-50da8d41f884 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:28.479137 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3c8aedaa-ea56-4db1-9b51-50da8d41f884 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:28.480615 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3c8aedaa-ea56-4db1-9b51-50da8d41f884 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:28.481163 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3c8aedaa-ea56-4db1-9b51-50da8d41f884 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:28.942845 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7a49c572-4874-422a-bea6-e17506078b22 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:28.951761 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:49:28.961393 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7a49c572-4874-422a-bea6-e17506078b22 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c" status: 200 len: 1306 microversion: 2.1 time: 0.742069 Sep 10 11:49:28.983884 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1168/2415] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:28 2022] GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c => generated 1306 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:49:29.098234 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1dec68a4-6579-452b-a827-4771c78aafca tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:29.099662 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1dec68a4-6579-452b-a827-4771c78aafca tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:29.110697 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1dec68a4-6579-452b-a827-4771c78aafca tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:29.116308 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1dec68a4-6579-452b-a827-4771c78aafca tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:29.117861 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1dec68a4-6579-452b-a827-4771c78aafca tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:29.123501 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1dec68a4-6579-452b-a827-4771c78aafca tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:29.128090 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1dec68a4-6579-452b-a827-4771c78aafca tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:29.128881 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1dec68a4-6579-452b-a827-4771c78aafca tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:29.181803 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3c8aedaa-ea56-4db1-9b51-50da8d41f884 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:29.194375 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3c8aedaa-ea56-4db1-9b51-50da8d41f884 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1463 microversion: 2.1 time: 0.739543 Sep 10 11:49:29.196135 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1248/2416] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:28 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1463 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:29.239738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-54fab0b8-0c17-4441-b804-a31433ec5cf8 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:29.242543 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-54fab0b8-0c17-4441-b804-a31433ec5cf8 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:29.244837 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:49:29.251548 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54fab0b8-0c17-4441-b804-a31433ec5cf8 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:29.256216 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54fab0b8-0c17-4441-b804-a31433ec5cf8 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:29.257850 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54fab0b8-0c17-4441-b804-a31433ec5cf8 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:29.259430 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54fab0b8-0c17-4441-b804-a31433ec5cf8 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:29.260066 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54fab0b8-0c17-4441-b804-a31433ec5cf8 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:29.261276 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54fab0b8-0c17-4441-b804-a31433ec5cf8 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:29.312663 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1dec68a4-6579-452b-a827-4771c78aafca tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:29.331639 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1dec68a4-6579-452b-a827-4771c78aafca tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:29.338362 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1dec68a4-6579-452b-a827-4771c78aafca tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:29.340452 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1dec68a4-6579-452b-a827-4771c78aafca tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1873 microversion: 2.42 time: 0.252115 Sep 10 11:49:29.356287 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1169/2417] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:49:29 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1873 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:49:29.435210 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b5395d19-423a-42ee-8fe1-7239f54b1473 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:29.435961 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b5395d19-423a-42ee-8fe1-7239f54b1473 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] [instance: c5779770-492b-4ecd-bbc3-8e67b959c5a3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:29.441026 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-54fab0b8-0c17-4441-b804-a31433ec5cf8 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd/action" status: 202 len: 0 microversion: 2.1 time: 0.207186 Sep 10 11:49:29.441760 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1249/2418] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:49:29 2022] POST /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:49:29.449596 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-04e69195-a81e-4b59-bcaa-bb4ac4b2ee39 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:29.454504 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b5395d19-423a-42ee-8fe1-7239f54b1473 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:29.455080 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b5395d19-423a-42ee-8fe1-7239f54b1473 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:29.456351 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b5395d19-423a-42ee-8fe1-7239f54b1473 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:29.460009 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-04e69195-a81e-4b59-bcaa-bb4ac4b2ee39 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:29.461418 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b5395d19-423a-42ee-8fe1-7239f54b1473 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:29.464686 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b5395d19-423a-42ee-8fe1-7239f54b1473 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:29.465331 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b5395d19-423a-42ee-8fe1-7239f54b1473 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:29.481935 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-04e69195-a81e-4b59-bcaa-bb4ac4b2ee39 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:29.482492 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-04e69195-a81e-4b59-bcaa-bb4ac4b2ee39 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:29.483002 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-04e69195-a81e-4b59-bcaa-bb4ac4b2ee39 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:29.485144 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-04e69195-a81e-4b59-bcaa-bb4ac4b2ee39 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:29.489349 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-04e69195-a81e-4b59-bcaa-bb4ac4b2ee39 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:29.491713 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-04e69195-a81e-4b59-bcaa-bb4ac4b2ee39 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:29.583009 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-04e69195-a81e-4b59-bcaa-bb4ac4b2ee39 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:29.583537 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-04e69195-a81e-4b59-bcaa-bb4ac4b2ee39 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:29.597704 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-04e69195-a81e-4b59-bcaa-bb4ac4b2ee39 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:29.599105 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-04e69195-a81e-4b59-bcaa-bb4ac4b2ee39 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lazy-loading 'fault' on Instance uuid 6ebabc55-1b1d-4276-8bde-d8d4859d74fd {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:49:30.003397 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b5395d19-423a-42ee-8fe1-7239f54b1473 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a32e3e1c1164b8abbb9ee6532e81e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30967668a810420ebf3d44363f44a135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:30.017982 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b5395d19-423a-42ee-8fe1-7239f54b1473 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] 10.222.0.23 "GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3" status: 200 len: 1590 microversion: 2.1 time: 0.591650 Sep 10 11:49:30.033301 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1170/2419] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:29 2022] GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3 => generated 1590 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:49:30.051244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-5fd42bc1-d318-428c-98ec-1a5dad89af8a req-3df3a58f-d701-4356-9cb4-8b922cea74b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5779770-492b-4ecd-bbc3-8e67b959c5a3", "tag": "988df13d-e1f4-40be-aacb-1610d45932ca"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:30.076409 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-5fd42bc1-d318-428c-98ec-1a5dad89af8a req-3df3a58f-d701-4356-9cb4-8b922cea74b1 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:30.076924 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-5fd42bc1-d318-428c-98ec-1a5dad89af8a req-3df3a58f-d701-4356-9cb4-8b922cea74b1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:30.077381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-5fd42bc1-d318-428c-98ec-1a5dad89af8a req-3df3a58f-d701-4356-9cb4-8b922cea74b1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:30.105657 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:49:30.112158 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-5fd42bc1-d318-428c-98ec-1a5dad89af8a req-3df3a58f-d701-4356-9cb4-8b922cea74b1 service nova] Creating event network-changed:988df13d-e1f4-40be-aacb-1610d45932ca for instance c5779770-492b-4ecd-bbc3-8e67b959c5a3 on n-h1-856895-1 Sep 10 11:49:30.125527 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-04e69195-a81e-4b59-bcaa-bb4ac4b2ee39 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1597 microversion: 2.1 time: 0.671540 Sep 10 11:49:30.126832 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1250/2420] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:29 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1597 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:30.148861 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-af9c919a-1bbf-4c07-9478-dda718832f88 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:30.149485 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-af9c919a-1bbf-4c07-9478-dda718832f88 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d01d9406-b2a4-4b3b-af6b-832861ed820c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:30.154834 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-5fd42bc1-d318-428c-98ec-1a5dad89af8a req-3df3a58f-d701-4356-9cb4-8b922cea74b1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119175 Sep 10 11:49:30.156024 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1171/2421] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:49:30.163852 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-af9c919a-1bbf-4c07-9478-dda718832f88 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:30.164347 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-af9c919a-1bbf-4c07-9478-dda718832f88 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:30.164782 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-af9c919a-1bbf-4c07-9478-dda718832f88 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:30.165261 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d0ee5acc-1604-4087-8e9f-4117c733a2b9 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:30.165485 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-af9c919a-1bbf-4c07-9478-dda718832f88 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:30.165940 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-af9c919a-1bbf-4c07-9478-dda718832f88 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:30.166363 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-af9c919a-1bbf-4c07-9478-dda718832f88 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:30.170328 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d0ee5acc-1604-4087-8e9f-4117c733a2b9 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:30.181204 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d0ee5acc-1604-4087-8e9f-4117c733a2b9 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:30.182442 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d0ee5acc-1604-4087-8e9f-4117c733a2b9 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:30.183945 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d0ee5acc-1604-4087-8e9f-4117c733a2b9 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:30.185101 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d0ee5acc-1604-4087-8e9f-4117c733a2b9 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:30.185780 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d0ee5acc-1604-4087-8e9f-4117c733a2b9 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:30.186381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d0ee5acc-1604-4087-8e9f-4117c733a2b9 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:30.206063 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-af9c919a-1bbf-4c07-9478-dda718832f88 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] HTTP exception thrown: Instance d01d9406-b2a4-4b3b-af6b-832861ed820c could not be found. Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-af9c919a-1bbf-4c07-9478-dda718832f88 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Request method failure captured: Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c HTTP/1.1 Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHkg-Zo7KMrfu0nNgLtrDU5lUnvDP6kvvcMZg2xisQhCM8eccKrdiLyTPHyzb6K9Q1ZiirRtqBOL4GZdbmmVvyNi0Bc3ugjMpJ_IDaF7uzu1phl69Zh6vFfvNF5AXJUQgKyEoKjCn57nwgkILaNwuhei0IBfr9Mbt-jkLsFVJEXAgCM Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 5949225a72e649c1adc217d5a760460a Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersOnMultiNodesTest-954271111 Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5949225a72e649c1adc217d5a760460a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5949225a72e649c1adc217d5a760460a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5949225a72e649c1adc217d5a760460a", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5949225a72e649c1adc217d5a760460a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersOnMultiNodesTest-954271111 Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 5949225a72e649c1adc217d5a760460a Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-954271111 Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersOnMultiNodesTest-954271111-project Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: dfc33eb8645248f9b154587e7d8d449e Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersOnMultiNodesTest-954271111-project Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance d01d9406-b2a4-4b3b-af6b-832861ed820c could not be found. Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'd01d9406-b2a4-4b3b-af6b-832861ed820c'} Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d01d9406-b2a4-4b3b-af6b-832861ed820c could not be found. Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d01d9406-b2a4-4b3b-af6b-832861ed820c could not be found. Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:30.213898 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:30.218852 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:30.218852 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:30.218852 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:30.218852 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:49:30.218852 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:49:30.218852 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d01d9406-b2a4-4b3b-af6b-832861ed820c could not be found. Sep 10 11:49:30.218852 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:30.220553 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-af9c919a-1bbf-4c07-9478-dda718832f88 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Returning 404 to user: Instance d01d9406-b2a4-4b3b-af6b-832861ed820c could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:49:30.221859 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-af9c919a-1bbf-4c07-9478-dda718832f88 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c" status: 404 len: 111 microversion: 2.1 time: 0.091924 Sep 10 11:49:30.230301 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1251/2422] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:30 2022] GET /compute/v2.1/servers/d01d9406-b2a4-4b3b-af6b-832861ed820c => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:49:30.235499 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-008ae6a2-bc5d-4683-9850-73edc71cdae9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:30.236280 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-008ae6a2-bc5d-4683-9850-73edc71cdae9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 727a5b3f-0317-46f9-9691-24caab6c3959] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:30.243452 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-008ae6a2-bc5d-4683-9850-73edc71cdae9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:30.244348 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-008ae6a2-bc5d-4683-9850-73edc71cdae9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:30.245129 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-008ae6a2-bc5d-4683-9850-73edc71cdae9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:30.247019 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-008ae6a2-bc5d-4683-9850-73edc71cdae9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:30.247802 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-008ae6a2-bc5d-4683-9850-73edc71cdae9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:30.248411 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-008ae6a2-bc5d-4683-9850-73edc71cdae9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:30.306812 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-008ae6a2-bc5d-4683-9850-73edc71cdae9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 727a5b3f-0317-46f9-9691-24caab6c3959] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:49:30.338757 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d0ee5acc-1604-4087-8e9f-4117c733a2b9 tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd/action" status: 202 len: 0 microversion: 2.1 time: 0.181045 Sep 10 11:49:30.347689 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1172/2423] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:49:30 2022] POST /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:49:30.361683 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e0654c7e-7428-4186-bc0c-1f368449e07e tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:30.366523 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e0654c7e-7428-4186-bc0c-1f368449e07e tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:30.388277 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e0654c7e-7428-4186-bc0c-1f368449e07e tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:30.391341 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e0654c7e-7428-4186-bc0c-1f368449e07e tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:30.391889 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e0654c7e-7428-4186-bc0c-1f368449e07e tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:30.392764 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e0654c7e-7428-4186-bc0c-1f368449e07e tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:30.395407 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e0654c7e-7428-4186-bc0c-1f368449e07e tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:30.395916 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e0654c7e-7428-4186-bc0c-1f368449e07e tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:30.473839 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-008ae6a2-bc5d-4683-9850-73edc71cdae9 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "DELETE /compute/v2.1/servers/727a5b3f-0317-46f9-9691-24caab6c3959" status: 204 len: 0 microversion: 2.1 time: 0.241764 Sep 10 11:49:30.475572 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1252/2424] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:49:30 2022] DELETE /compute/v2.1/servers/727a5b3f-0317-46f9-9691-24caab6c3959 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:49:30.481798 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7218e8cc-3b9f-47cf-ad14-08ae398225e4 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:30.482845 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7218e8cc-3b9f-47cf-ad14-08ae398225e4 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:30.490391 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7218e8cc-3b9f-47cf-ad14-08ae398225e4 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:30.492832 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7218e8cc-3b9f-47cf-ad14-08ae398225e4 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:30.493395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7218e8cc-3b9f-47cf-ad14-08ae398225e4 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:30.494563 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7218e8cc-3b9f-47cf-ad14-08ae398225e4 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:30.498661 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7218e8cc-3b9f-47cf-ad14-08ae398225e4 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:30.499600 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7218e8cc-3b9f-47cf-ad14-08ae398225e4 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:30.651472 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7218e8cc-3b9f-47cf-ad14-08ae398225e4 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:30.672509 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7218e8cc-3b9f-47cf-ad14-08ae398225e4 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:30.677219 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7218e8cc-3b9f-47cf-ad14-08ae398225e4 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:30.680266 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7218e8cc-3b9f-47cf-ad14-08ae398225e4 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1873 microversion: 2.42 time: 0.203283 Sep 10 11:49:30.682350 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1253/2425] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:49:30 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1873 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:49:30.695557 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a958ccc2-18d4-443e-b43e-3667835321d6 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:30.696972 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a958ccc2-18d4-443e-b43e-3667835321d6 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 727a5b3f-0317-46f9-9691-24caab6c3959] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:30.713081 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a958ccc2-18d4-443e-b43e-3667835321d6 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:30.715046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a958ccc2-18d4-443e-b43e-3667835321d6 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:30.717550 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a958ccc2-18d4-443e-b43e-3667835321d6 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:30.718765 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a958ccc2-18d4-443e-b43e-3667835321d6 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:30.721686 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a958ccc2-18d4-443e-b43e-3667835321d6 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:30.724781 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a958ccc2-18d4-443e-b43e-3667835321d6 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:30.771076 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e0654c7e-7428-4186-bc0c-1f368449e07e tempest-ServersAdminTestJSON-1602661090 tempest-ServersAdminTestJSON-1602661090-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1614 microversion: 2.1 time: 0.420594 Sep 10 11:49:30.774129 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1173/2426] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:30 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1614 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:30.803442 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3553db2f-be38-4469-8d12-d393ccc3fa5d tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:30.805389 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3553db2f-be38-4469-8d12-d393ccc3fa5d tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 594465e4-0a38-4759-94be-9fbb40bdd824] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:30.816867 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3553db2f-be38-4469-8d12-d393ccc3fa5d tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:30.821519 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3553db2f-be38-4469-8d12-d393ccc3fa5d tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:30.822105 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3553db2f-be38-4469-8d12-d393ccc3fa5d tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:30.822887 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3553db2f-be38-4469-8d12-d393ccc3fa5d tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:30.823395 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3553db2f-be38-4469-8d12-d393ccc3fa5d tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:30.824422 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3553db2f-be38-4469-8d12-d393ccc3fa5d tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:30.888114 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3553db2f-be38-4469-8d12-d393ccc3fa5d tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 594465e4-0a38-4759-94be-9fbb40bdd824] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:49:31.073255 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3553db2f-be38-4469-8d12-d393ccc3fa5d tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "DELETE /compute/v2.1/servers/594465e4-0a38-4759-94be-9fbb40bdd824" status: 204 len: 0 microversion: 2.1 time: 0.274333 Sep 10 11:49:31.077914 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1174/2427] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:49:30 2022] DELETE /compute/v2.1/servers/594465e4-0a38-4759-94be-9fbb40bdd824 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 11:49:31.089679 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1d74a538-c6ef-4f0e-a147-c2455d9eb292 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:31.091707 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1d74a538-c6ef-4f0e-a147-c2455d9eb292 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 594465e4-0a38-4759-94be-9fbb40bdd824] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:31.092569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a958ccc2-18d4-443e-b43e-3667835321d6 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:31.107589 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a958ccc2-18d4-443e-b43e-3667835321d6 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/727a5b3f-0317-46f9-9691-24caab6c3959" status: 200 len: 1471 microversion: 2.1 time: 0.419714 Sep 10 11:49:31.107801 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1d74a538-c6ef-4f0e-a147-c2455d9eb292 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:31.123226 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1254/2428] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:30 2022] GET /compute/v2.1/servers/727a5b3f-0317-46f9-9691-24caab6c3959 => generated 1471 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:31.123578 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1d74a538-c6ef-4f0e-a147-c2455d9eb292 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:31.123578 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1d74a538-c6ef-4f0e-a147-c2455d9eb292 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:31.123578 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1d74a538-c6ef-4f0e-a147-c2455d9eb292 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:31.123578 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1d74a538-c6ef-4f0e-a147-c2455d9eb292 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:31.123578 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1d74a538-c6ef-4f0e-a147-c2455d9eb292 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:31.450225 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1d74a538-c6ef-4f0e-a147-c2455d9eb292 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:31.458591 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1d74a538-c6ef-4f0e-a147-c2455d9eb292 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/594465e4-0a38-4759-94be-9fbb40bdd824" status: 200 len: 1469 microversion: 2.1 time: 0.377791 Sep 10 11:49:31.463640 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1175/2429] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:31 2022] GET /compute/v2.1/servers/594465e4-0a38-4759-94be-9fbb40bdd824 => generated 1469 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:31.716672 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c595ab34-b367-41ae-9773-f1ede8e77a56 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:31.718033 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c595ab34-b367-41ae-9773-f1ede8e77a56 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:31.742593 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c595ab34-b367-41ae-9773-f1ede8e77a56 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:31.745989 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c595ab34-b367-41ae-9773-f1ede8e77a56 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:31.746443 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c595ab34-b367-41ae-9773-f1ede8e77a56 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:31.752706 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c595ab34-b367-41ae-9773-f1ede8e77a56 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:31.754576 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c595ab34-b367-41ae-9773-f1ede8e77a56 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:31.756579 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c595ab34-b367-41ae-9773-f1ede8e77a56 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:31.957666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c595ab34-b367-41ae-9773-f1ede8e77a56 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:31.971831 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c595ab34-b367-41ae-9773-f1ede8e77a56 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:31.978881 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c595ab34-b367-41ae-9773-f1ede8e77a56 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:31.981087 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c595ab34-b367-41ae-9773-f1ede8e77a56 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1873 microversion: 2.42 time: 0.271047 Sep 10 11:49:31.983481 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1255/2430] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:49:31 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1873 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:49:32.145564 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9408f2ac-7643-4439-8e8a-aeb5f5caf637 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:32.148322 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9408f2ac-7643-4439-8e8a-aeb5f5caf637 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 727a5b3f-0317-46f9-9691-24caab6c3959] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:32.156446 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9408f2ac-7643-4439-8e8a-aeb5f5caf637 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:32.159454 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9408f2ac-7643-4439-8e8a-aeb5f5caf637 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:32.160143 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9408f2ac-7643-4439-8e8a-aeb5f5caf637 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:32.161033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9408f2ac-7643-4439-8e8a-aeb5f5caf637 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:32.161600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9408f2ac-7643-4439-8e8a-aeb5f5caf637 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:32.162187 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9408f2ac-7643-4439-8e8a-aeb5f5caf637 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:32.490401 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-32ecb63a-b956-460f-b917-6fa79a800210 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:32.491481 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-32ecb63a-b956-460f-b917-6fa79a800210 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 594465e4-0a38-4759-94be-9fbb40bdd824] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:32.497831 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32ecb63a-b956-460f-b917-6fa79a800210 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:32.505320 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32ecb63a-b956-460f-b917-6fa79a800210 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:32.505910 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32ecb63a-b956-460f-b917-6fa79a800210 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:32.506634 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32ecb63a-b956-460f-b917-6fa79a800210 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:32.507113 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32ecb63a-b956-460f-b917-6fa79a800210 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:32.507595 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32ecb63a-b956-460f-b917-6fa79a800210 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:32.524194 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9408f2ac-7643-4439-8e8a-aeb5f5caf637 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:32.536772 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9408f2ac-7643-4439-8e8a-aeb5f5caf637 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/727a5b3f-0317-46f9-9691-24caab6c3959" status: 200 len: 1471 microversion: 2.1 time: 0.397723 Sep 10 11:49:32.540291 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1176/2431] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:32 2022] GET /compute/v2.1/servers/727a5b3f-0317-46f9-9691-24caab6c3959 => generated 1471 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:32.751625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a95c1209-cbf6-4858-ab9e-6e8cb2ac2a5b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-215518377", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:32.873595 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-a95c1209-cbf6-4858-ab9e-6e8cb2ac2a5b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] validate_networks() for [('a31ea6ce-f247-4438-9f0b-5b6f6aa53a3b', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:49:32.932086 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-32ecb63a-b956-460f-b917-6fa79a800210 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:32.942886 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-32ecb63a-b956-460f-b917-6fa79a800210 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/594465e4-0a38-4759-94be-9fbb40bdd824" status: 200 len: 1469 microversion: 2.1 time: 0.459012 Sep 10 11:49:32.960982 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1256/2432] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:32 2022] GET /compute/v2.1/servers/594465e4-0a38-4759-94be-9fbb40bdd824 => generated 1469 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:33.007690 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-07995eb0-11de-4ab6-9fd6-008b5e1991b9 req-ed9dc537-0beb-4afa-8ad0-152cf8d6ae54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "727a5b3f-0317-46f9-9691-24caab6c3959", "name": "network-vif-deleted", "tag": "50566b5c-6990-480d-acc2-8eec359a9212"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:33.025163 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-07995eb0-11de-4ab6-9fd6-008b5e1991b9 req-ed9dc537-0beb-4afa-8ad0-152cf8d6ae54 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:33.026228 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-07995eb0-11de-4ab6-9fd6-008b5e1991b9 req-ed9dc537-0beb-4afa-8ad0-152cf8d6ae54 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:33.027991 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-07995eb0-11de-4ab6-9fd6-008b5e1991b9 req-ed9dc537-0beb-4afa-8ad0-152cf8d6ae54 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:33.071058 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-07995eb0-11de-4ab6-9fd6-008b5e1991b9 req-ed9dc537-0beb-4afa-8ad0-152cf8d6ae54 service nova] Creating event network-vif-deleted:50566b5c-6990-480d-acc2-8eec359a9212 for instance 727a5b3f-0317-46f9-9691-24caab6c3959 on n-h2-856895-1 Sep 10 11:49:33.084242 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-07995eb0-11de-4ab6-9fd6-008b5e1991b9 req-ed9dc537-0beb-4afa-8ad0-152cf8d6ae54 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087783 Sep 10 11:49:33.086926 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1257/2433] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:49:33.104928 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-221995d3-b426-4cdd-a833-403b1ba1dd73 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:33.106788 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-221995d3-b426-4cdd-a833-403b1ba1dd73 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:33.118166 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-221995d3-b426-4cdd-a833-403b1ba1dd73 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:33.119040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-221995d3-b426-4cdd-a833-403b1ba1dd73 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:33.119733 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-221995d3-b426-4cdd-a833-403b1ba1dd73 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:33.120697 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-221995d3-b426-4cdd-a833-403b1ba1dd73 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:33.121784 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-221995d3-b426-4cdd-a833-403b1ba1dd73 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:33.122463 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-221995d3-b426-4cdd-a833-403b1ba1dd73 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:33.363201 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-221995d3-b426-4cdd-a833-403b1ba1dd73 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:33.394965 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-221995d3-b426-4cdd-a833-403b1ba1dd73 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:33.403176 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-221995d3-b426-4cdd-a833-403b1ba1dd73 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:33.404498 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-221995d3-b426-4cdd-a833-403b1ba1dd73 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1873 microversion: 2.42 time: 0.315212 Sep 10 11:49:33.411137 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1258/2434] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:49:33 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1873 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:49:33.565000 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-624d9131-f5d2-42db-af66-f5c47732734f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:33.566259 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-624d9131-f5d2-42db-af66-f5c47732734f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 727a5b3f-0317-46f9-9691-24caab6c3959] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:33.575603 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-624d9131-f5d2-42db-af66-f5c47732734f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:33.577932 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-624d9131-f5d2-42db-af66-f5c47732734f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:33.579037 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-624d9131-f5d2-42db-af66-f5c47732734f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:33.580813 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-624d9131-f5d2-42db-af66-f5c47732734f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:33.582090 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-624d9131-f5d2-42db-af66-f5c47732734f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:33.582836 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-624d9131-f5d2-42db-af66-f5c47732734f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:33.671691 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-624d9131-f5d2-42db-af66-f5c47732734f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:33.672398 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-624d9131-f5d2-42db-af66-f5c47732734f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:33.672992 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-624d9131-f5d2-42db-af66-f5c47732734f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:33.678142 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-624d9131-f5d2-42db-af66-f5c47732734f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lazy-loading 'fault' on Instance uuid 727a5b3f-0317-46f9-9691-24caab6c3959 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:49:33.819398 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-624d9131-f5d2-42db-af66-f5c47732734f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:33.844781 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-624d9131-f5d2-42db-af66-f5c47732734f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/727a5b3f-0317-46f9-9691-24caab6c3959" status: 200 len: 1305 microversion: 2.1 time: 0.284919 Sep 10 11:49:33.849087 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1259/2435] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:33 2022] GET /compute/v2.1/servers/727a5b3f-0317-46f9-9691-24caab6c3959 => generated 1305 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:33.973678 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-beb31a42-6462-4777-b6b0-7e28b0911193 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:33.974877 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-beb31a42-6462-4777-b6b0-7e28b0911193 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 594465e4-0a38-4759-94be-9fbb40bdd824] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:33.998151 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-beb31a42-6462-4777-b6b0-7e28b0911193 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:34.001171 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-beb31a42-6462-4777-b6b0-7e28b0911193 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:34.001897 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-beb31a42-6462-4777-b6b0-7e28b0911193 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:34.003682 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-beb31a42-6462-4777-b6b0-7e28b0911193 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:34.007111 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-beb31a42-6462-4777-b6b0-7e28b0911193 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:34.008676 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-beb31a42-6462-4777-b6b0-7e28b0911193 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:34.077413 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-a95c1209-cbf6-4858-ab9e-6e8cb2ac2a5b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:49:34.078581 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-a95c1209-cbf6-4858-ab9e-6e8cb2ac2a5b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:49:34.079784 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-a95c1209-cbf6-4858-ab9e-6e8cb2ac2a5b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:49:34.079784 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-a95c1209-cbf6-4858-ab9e-6e8cb2ac2a5b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:49:34.080518 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-a95c1209-cbf6-4858-ab9e-6e8cb2ac2a5b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:49:34.101250 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a95c1209-cbf6-4858-ab9e-6e8cb2ac2a5b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:34.107077 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a95c1209-cbf6-4858-ab9e-6e8cb2ac2a5b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:34.108159 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a95c1209-cbf6-4858-ab9e-6e8cb2ac2a5b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:34.109350 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a95c1209-cbf6-4858-ab9e-6e8cb2ac2a5b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:34.121592 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a95c1209-cbf6-4858-ab9e-6e8cb2ac2a5b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:34.122372 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a95c1209-cbf6-4858-ab9e-6e8cb2ac2a5b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:34.197080 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-a95c1209-cbf6-4858-ab9e-6e8cb2ac2a5b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Getting quotas for project 3e5d376048de4c3191a58a547e05fd07. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:49:34.215249 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-a95c1209-cbf6-4858-ab9e-6e8cb2ac2a5b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Getting quotas for user 8ced1e84956246b6bb7384ba484fde54 and project 3e5d376048de4c3191a58a547e05fd07. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:49:34.246639 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a95c1209-cbf6-4858-ab9e-6e8cb2ac2a5b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:49:34.251681 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a95c1209-cbf6-4858-ab9e-6e8cb2ac2a5b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:49:34.382692 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-beb31a42-6462-4777-b6b0-7e28b0911193 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:34.398154 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-beb31a42-6462-4777-b6b0-7e28b0911193 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/594465e4-0a38-4759-94be-9fbb40bdd824" status: 200 len: 1469 microversion: 2.1 time: 0.428968 Sep 10 11:49:34.412956 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1260/2436] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:33 2022] GET /compute/v2.1/servers/594465e4-0a38-4759-94be-9fbb40bdd824 => generated 1469 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:49:34.416161 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a95c1209-cbf6-4858-ab9e-6e8cb2ac2a5b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.669130 Sep 10 11:49:34.420822 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1177/2437] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:49:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 1674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:49:34.434551 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8e227b57-63ef-41fb-998b-694d597c5c07 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:34.437597 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8e227b57-63ef-41fb-998b-694d597c5c07 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:34.511323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8e227b57-63ef-41fb-998b-694d597c5c07 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:34.524609 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8e227b57-63ef-41fb-998b-694d597c5c07 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9" status: 200 len: 1224 microversion: 2.1 time: 0.095780 Sep 10 11:49:34.526323 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1178/2438] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:34 2022] GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:49:34.578718 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7a2165a8-4e39-4b99-8278-2fff79153414 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:34.580673 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7a2165a8-4e39-4b99-8278-2fff79153414 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:34.612102 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a2165a8-4e39-4b99-8278-2fff79153414 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:34.612648 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a2165a8-4e39-4b99-8278-2fff79153414 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:34.613102 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a2165a8-4e39-4b99-8278-2fff79153414 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:34.618847 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a2165a8-4e39-4b99-8278-2fff79153414 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:34.619607 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a2165a8-4e39-4b99-8278-2fff79153414 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:34.620073 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a2165a8-4e39-4b99-8278-2fff79153414 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:34.809949 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7a2165a8-4e39-4b99-8278-2fff79153414 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:34.828281 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7a2165a8-4e39-4b99-8278-2fff79153414 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:34.835903 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f3313702-a045-4d89-9784-25734ded3943 tempest-ListImageFiltersNegativeTestJSON-56471044 tempest-ListImageFiltersNegativeTestJSON-56471044-project] Calling method '.version_select at 0x7f407b5b0d30>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:34.850029 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7a2165a8-4e39-4b99-8278-2fff79153414 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:34.851351 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7a2165a8-4e39-4b99-8278-2fff79153414 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1873 microversion: 2.42 time: 0.323695 Sep 10 11:49:34.851914 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1179/2439] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:49:34 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1873 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:49:34.870850 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-f3313702-a045-4d89-9784-25734ded3943 tempest-ListImageFiltersNegativeTestJSON-56471044 tempest-ListImageFiltersNegativeTestJSON-56471044-project] HTTP exception thrown: Image not found. Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f3313702-a045-4d89-9784-25734ded3943 tempest-ListImageFiltersNegativeTestJSON-56471044 tempest-ListImageFiltersNegativeTestJSON-56471044-project] Request method failure captured: Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/images/8f03e211-4ab3-4cd1-ad1c-1c5fb2e037c5 HTTP/1.1 Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHnOVWExGcSm2E3s6XB0K7poZr4Lu1Nnapbz4EK6gFMjNPRU47A-Ekg-Bw3Z2vXLmfZJMqbFMpc3fuUCwa2EI2t7wHGTdP8pzIQMRYlgV4NRqQb3rbC_AEHGuhasATM4RUC69XYEOKS_HcQnmA-Im90QrOC9pSRDWAuuVviYKBJgDt0 Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 1d29bb8a0ec34b4ab1bb9d28903c801e Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-56471044 Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d29bb8a0ec34b4ab1bb9d28903c801e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d29bb8a0ec34b4ab1bb9d28903c801e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d29bb8a0ec34b4ab1bb9d28903c801e", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d29bb8a0ec34b4ab1bb9d28903c801e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-56471044 Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 1d29bb8a0ec34b4ab1bb9d28903c801e Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-56471044 Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ListImageFiltersNegativeTestJSON-56471044-project Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 8d29a67603a14e179f9272c13eb99a74 Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-56471044-project Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: exception: Image not found. Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '8f03e211-4ab3-4cd1-ad1c-1c5fb2e037c5'} Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8f03e211-4ab3-4cd1-ad1c-1c5fb2e037c5 Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 10 11:49:34.885105 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8f03e211-4ab3-4cd1-ad1c-1c5fb2e037c5 could not be found. Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:34.889015 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f3313702-a045-4d89-9784-25734ded3943 tempest-ListImageFiltersNegativeTestJSON-56471044 tempest-ListImageFiltersNegativeTestJSON-56471044-project] Returning 404 to user: Image not found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:49:34.896741 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f3313702-a045-4d89-9784-25734ded3943 tempest-ListImageFiltersNegativeTestJSON-56471044 tempest-ListImageFiltersNegativeTestJSON-56471044-project] 10.222.0.23 "GET /compute/v2.1/images/8f03e211-4ab3-4cd1-ad1c-1c5fb2e037c5" status: 404 len: 62 microversion: 2.1 time: 0.474091 Sep 10 11:49:34.896741 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1261/2440] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:49:34 2022] GET /compute/v2.1/images/8f03e211-4ab3-4cd1-ad1c-1c5fb2e037c5 => generated 62 bytes in 477 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:49:34.897682 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c53b67ff-7c4d-4b9c-a361-e9fc07c21337 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:34.898810 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c53b67ff-7c4d-4b9c-a361-e9fc07c21337 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 727a5b3f-0317-46f9-9691-24caab6c3959] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:34.914895 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c53b67ff-7c4d-4b9c-a361-e9fc07c21337 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:34.915488 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c53b67ff-7c4d-4b9c-a361-e9fc07c21337 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:34.915937 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c53b67ff-7c4d-4b9c-a361-e9fc07c21337 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:34.916659 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c53b67ff-7c4d-4b9c-a361-e9fc07c21337 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:34.917117 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c53b67ff-7c4d-4b9c-a361-e9fc07c21337 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:34.917544 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c53b67ff-7c4d-4b9c-a361-e9fc07c21337 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:34.962792 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-c53b67ff-7c4d-4b9c-a361-e9fc07c21337 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] HTTP exception thrown: Instance 727a5b3f-0317-46f9-9691-24caab6c3959 could not be found. Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c53b67ff-7c4d-4b9c-a361-e9fc07c21337 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Request method failure captured: Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/727a5b3f-0317-46f9-9691-24caab6c3959 HTTP/1.1 Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHkg-Zo7KMrfu0nNgLtrDU5lUnvDP6kvvcMZg2xisQhCM8eccKrdiLyTPHyzb6K9Q1ZiirRtqBOL4GZdbmmVvyNi0Bc3ugjMpJ_IDaF7uzu1phl69Zh6vFfvNF5AXJUQgKyEoKjCn57nwgkILaNwuhei0IBfr9Mbt-jkLsFVJEXAgCM Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 5949225a72e649c1adc217d5a760460a Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersOnMultiNodesTest-954271111 Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5949225a72e649c1adc217d5a760460a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5949225a72e649c1adc217d5a760460a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5949225a72e649c1adc217d5a760460a", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5949225a72e649c1adc217d5a760460a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersOnMultiNodesTest-954271111 Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 5949225a72e649c1adc217d5a760460a Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-954271111 Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersOnMultiNodesTest-954271111-project Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: dfc33eb8645248f9b154587e7d8d449e Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersOnMultiNodesTest-954271111-project Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 727a5b3f-0317-46f9-9691-24caab6c3959 could not be found. Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '727a5b3f-0317-46f9-9691-24caab6c3959'} Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 727a5b3f-0317-46f9-9691-24caab6c3959 could not be found. Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 727a5b3f-0317-46f9-9691-24caab6c3959 could not be found. Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:34.964604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:34.968804 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:34.968804 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:34.968804 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:34.968804 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:49:34.968804 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:49:34.968804 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 727a5b3f-0317-46f9-9691-24caab6c3959 could not be found. Sep 10 11:49:34.968804 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:34.968804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c53b67ff-7c4d-4b9c-a361-e9fc07c21337 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Returning 404 to user: Instance 727a5b3f-0317-46f9-9691-24caab6c3959 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:49:34.968804 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c53b67ff-7c4d-4b9c-a361-e9fc07c21337 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/727a5b3f-0317-46f9-9691-24caab6c3959" status: 404 len: 111 microversion: 2.1 time: 0.088504 Sep 10 11:49:34.975287 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8ee01650-bee2-48af-8938-a24e9c008480 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:34.975813 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8ee01650-bee2-48af-8938-a24e9c008480 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:34.986854 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8ee01650-bee2-48af-8938-a24e9c008480 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:34.987718 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8ee01650-bee2-48af-8938-a24e9c008480 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:34.988213 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8ee01650-bee2-48af-8938-a24e9c008480 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:34.988929 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8ee01650-bee2-48af-8938-a24e9c008480 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:34.989384 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8ee01650-bee2-48af-8938-a24e9c008480 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:34.989803 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8ee01650-bee2-48af-8938-a24e9c008480 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:34.990017 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1180/2441] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:34 2022] GET /compute/v2.1/servers/727a5b3f-0317-46f9-9691-24caab6c3959 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:49:35.050971 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8ee01650-bee2-48af-8938-a24e9c008480 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:49:35.121397 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-27c332c6-448d-4059-9d5d-0f8a5cfaa06f req-627d787d-aa94-4954-a2f8-06852875cb8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "594465e4-0a38-4759-94be-9fbb40bdd824", "name": "network-vif-deleted", "tag": "c35a9766-d562-48d4-9a65-26a8d53718af"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:35.158944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-27c332c6-448d-4059-9d5d-0f8a5cfaa06f req-627d787d-aa94-4954-a2f8-06852875cb8d service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:35.159486 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-27c332c6-448d-4059-9d5d-0f8a5cfaa06f req-627d787d-aa94-4954-a2f8-06852875cb8d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:35.159937 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-27c332c6-448d-4059-9d5d-0f8a5cfaa06f req-627d787d-aa94-4954-a2f8-06852875cb8d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:35.191472 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-27c332c6-448d-4059-9d5d-0f8a5cfaa06f req-627d787d-aa94-4954-a2f8-06852875cb8d service nova] Creating event network-vif-deleted:c35a9766-d562-48d4-9a65-26a8d53718af for instance 594465e4-0a38-4759-94be-9fbb40bdd824 on n-h1-856895-1 Sep 10 11:49:35.220227 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8ee01650-bee2-48af-8938-a24e9c008480 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "DELETE /compute/v2.1/servers/84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2" status: 204 len: 0 microversion: 2.1 time: 0.248817 Sep 10 11:49:35.224764 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1262/2442] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:49:34 2022] DELETE /compute/v2.1/servers/84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 11:49:35.224941 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-27c332c6-448d-4059-9d5d-0f8a5cfaa06f req-627d787d-aa94-4954-a2f8-06852875cb8d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106391 Sep 10 11:49:35.232676 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c966a28f-a397-45e0-9f7b-53ad3cd7ae66 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:35.232917 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1181/2443] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:49:35.233820 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c966a28f-a397-45e0-9f7b-53ad3cd7ae66 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:35.241759 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c966a28f-a397-45e0-9f7b-53ad3cd7ae66 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:35.242593 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c966a28f-a397-45e0-9f7b-53ad3cd7ae66 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:35.243263 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c966a28f-a397-45e0-9f7b-53ad3cd7ae66 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:35.244484 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c966a28f-a397-45e0-9f7b-53ad3cd7ae66 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:35.245159 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c966a28f-a397-45e0-9f7b-53ad3cd7ae66 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:35.245884 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c966a28f-a397-45e0-9f7b-53ad3cd7ae66 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:35.434964 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f4e69a19-622c-4895-b9d9-998d72111266 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:35.435783 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f4e69a19-622c-4895-b9d9-998d72111266 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 594465e4-0a38-4759-94be-9fbb40bdd824] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:35.450727 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4e69a19-622c-4895-b9d9-998d72111266 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:35.453145 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4e69a19-622c-4895-b9d9-998d72111266 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:35.455418 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4e69a19-622c-4895-b9d9-998d72111266 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:35.476723 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4e69a19-622c-4895-b9d9-998d72111266 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:35.481026 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4e69a19-622c-4895-b9d9-998d72111266 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:35.481760 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4e69a19-622c-4895-b9d9-998d72111266 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:35.524405 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c966a28f-a397-45e0-9f7b-53ad3cd7ae66 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:35.550519 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c966a28f-a397-45e0-9f7b-53ad3cd7ae66 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2" status: 200 len: 1471 microversion: 2.1 time: 0.323910 Sep 10 11:49:35.556091 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1263/2444] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:35 2022] GET /compute/v2.1/servers/84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2 => generated 1471 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:35.560906 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4e69a19-622c-4895-b9d9-998d72111266 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:35.561521 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4e69a19-622c-4895-b9d9-998d72111266 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:35.563602 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4e69a19-622c-4895-b9d9-998d72111266 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:35.567095 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-f4e69a19-622c-4895-b9d9-998d72111266 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lazy-loading 'fault' on Instance uuid 594465e4-0a38-4759-94be-9fbb40bdd824 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:49:35.569680 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-425b7df5-fe69-46b6-85ec-5dd6f1fe737d tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:35.570588 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-425b7df5-fe69-46b6-85ec-5dd6f1fe737d tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:35.586256 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-425b7df5-fe69-46b6-85ec-5dd6f1fe737d tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:35.591597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-425b7df5-fe69-46b6-85ec-5dd6f1fe737d tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:35.593177 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-425b7df5-fe69-46b6-85ec-5dd6f1fe737d tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:35.594108 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-425b7df5-fe69-46b6-85ec-5dd6f1fe737d tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:35.594787 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-425b7df5-fe69-46b6-85ec-5dd6f1fe737d tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:35.595433 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-425b7df5-fe69-46b6-85ec-5dd6f1fe737d tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:35.709262 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f4e69a19-622c-4895-b9d9-998d72111266 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:35.726235 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f4e69a19-622c-4895-b9d9-998d72111266 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/594465e4-0a38-4759-94be-9fbb40bdd824" status: 200 len: 1303 microversion: 2.1 time: 0.297450 Sep 10 11:49:35.727428 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1182/2445] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:35 2022] GET /compute/v2.1/servers/594465e4-0a38-4759-94be-9fbb40bdd824 => generated 1303 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:35.776599 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-425b7df5-fe69-46b6-85ec-5dd6f1fe737d tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:35.788869 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-425b7df5-fe69-46b6-85ec-5dd6f1fe737d tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9" status: 200 len: 1228 microversion: 2.1 time: 0.231326 Sep 10 11:49:35.795129 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1264/2446] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:35 2022] GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 => generated 1228 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:35.891471 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e4a79a6b-b587-471f-96ae-8fbd2ddefdc4 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:35.894947 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e4a79a6b-b587-471f-96ae-8fbd2ddefdc4 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:35.913309 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4a79a6b-b587-471f-96ae-8fbd2ddefdc4 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:35.913824 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4a79a6b-b587-471f-96ae-8fbd2ddefdc4 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:35.914344 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4a79a6b-b587-471f-96ae-8fbd2ddefdc4 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:35.915202 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4a79a6b-b587-471f-96ae-8fbd2ddefdc4 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:35.915743 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4a79a6b-b587-471f-96ae-8fbd2ddefdc4 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:35.916519 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4a79a6b-b587-471f-96ae-8fbd2ddefdc4 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:36.014517 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e4a79a6b-b587-471f-96ae-8fbd2ddefdc4 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:36.024157 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e4a79a6b-b587-471f-96ae-8fbd2ddefdc4 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:36.025637 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e4a79a6b-b587-471f-96ae-8fbd2ddefdc4 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:36.026882 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e4a79a6b-b587-471f-96ae-8fbd2ddefdc4 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1873 microversion: 2.42 time: 0.147939 Sep 10 11:49:36.029212 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1183/2447] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:49:35 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1873 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:49:36.584271 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a8e272fb-adec-45b9-b51f-6052f61d6bb5 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:36.585216 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a8e272fb-adec-45b9-b51f-6052f61d6bb5 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:36.593874 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a8e272fb-adec-45b9-b51f-6052f61d6bb5 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:36.595267 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a8e272fb-adec-45b9-b51f-6052f61d6bb5 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:36.596630 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a8e272fb-adec-45b9-b51f-6052f61d6bb5 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:36.597784 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a8e272fb-adec-45b9-b51f-6052f61d6bb5 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:36.599039 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a8e272fb-adec-45b9-b51f-6052f61d6bb5 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:36.600274 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a8e272fb-adec-45b9-b51f-6052f61d6bb5 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:36.753070 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f3106a4e-493a-41a8-9b01-7ce2bd0eecee tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:36.753701 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f3106a4e-493a-41a8-9b01-7ce2bd0eecee tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 594465e4-0a38-4759-94be-9fbb40bdd824] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:36.761576 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3106a4e-493a-41a8-9b01-7ce2bd0eecee tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:36.762072 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3106a4e-493a-41a8-9b01-7ce2bd0eecee tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:36.762519 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3106a4e-493a-41a8-9b01-7ce2bd0eecee tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:36.775714 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3106a4e-493a-41a8-9b01-7ce2bd0eecee tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:36.776540 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3106a4e-493a-41a8-9b01-7ce2bd0eecee tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:36.777168 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3106a4e-493a-41a8-9b01-7ce2bd0eecee tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:36.831515 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-f3106a4e-493a-41a8-9b01-7ce2bd0eecee tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] HTTP exception thrown: Instance 594465e4-0a38-4759-94be-9fbb40bdd824 could not be found. Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f3106a4e-493a-41a8-9b01-7ce2bd0eecee tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Request method failure captured: Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/594465e4-0a38-4759-94be-9fbb40bdd824 HTTP/1.1 Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHlUSEZXtyk8wt2IG5Gw3xoPsFQQ66k7MWJCT0nHxXDu_h1Nx8nIr3NAf8F8RfftelzrNjcJ_HA8P90BGd4ENOKdNKh9XYufdp_lCwVQBwJIAinu7k6skBJ3AdQs8-mJIMn2ggmqhZG_QtrfslhxbA8TTage9VXqvSPZajqtr1ERn_c Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: d8f6657b05bd48edbe73282147feee78 Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersAdminTestJSON-186209642 Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d8f6657b05bd48edbe73282147feee78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d8f6657b05bd48edbe73282147feee78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d8f6657b05bd48edbe73282147feee78", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d8f6657b05bd48edbe73282147feee78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersAdminTestJSON-186209642 Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: d8f6657b05bd48edbe73282147feee78 Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersAdminTestJSON-186209642 Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersAdminTestJSON-186209642-project Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 221c7c18d84c400388bd95cf28cf3e1a Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersAdminTestJSON-186209642-project Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 594465e4-0a38-4759-94be-9fbb40bdd824 could not be found. Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '594465e4-0a38-4759-94be-9fbb40bdd824'} Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 594465e4-0a38-4759-94be-9fbb40bdd824 could not be found. Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 594465e4-0a38-4759-94be-9fbb40bdd824 could not be found. Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:36.852098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:36.856403 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:36.856403 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:36.856403 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:36.856403 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:49:36.856403 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:49:36.856403 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 594465e4-0a38-4759-94be-9fbb40bdd824 could not be found. Sep 10 11:49:36.856403 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:36.856403 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f3106a4e-493a-41a8-9b01-7ce2bd0eecee tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Returning 404 to user: Instance 594465e4-0a38-4759-94be-9fbb40bdd824 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:49:36.856403 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f3106a4e-493a-41a8-9b01-7ce2bd0eecee tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/594465e4-0a38-4759-94be-9fbb40bdd824" status: 404 len: 111 microversion: 2.1 time: 0.105129 Sep 10 11:49:36.866453 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1184/2448] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:36 2022] GET /compute/v2.1/servers/594465e4-0a38-4759-94be-9fbb40bdd824 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:49:36.879096 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-69c8493d-baac-42dd-b8e6-97e399e297d0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:36.883943 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-69c8493d-baac-42dd-b8e6-97e399e297d0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:36.904771 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-69c8493d-baac-42dd-b8e6-97e399e297d0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:36.905854 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-69c8493d-baac-42dd-b8e6-97e399e297d0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:36.907542 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-69c8493d-baac-42dd-b8e6-97e399e297d0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:36.910635 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-69c8493d-baac-42dd-b8e6-97e399e297d0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:36.915063 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-69c8493d-baac-42dd-b8e6-97e399e297d0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:36.915761 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-69c8493d-baac-42dd-b8e6-97e399e297d0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:36.925753 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a8e272fb-adec-45b9-b51f-6052f61d6bb5 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:36.937933 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a8e272fb-adec-45b9-b51f-6052f61d6bb5 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2" status: 200 len: 1471 microversion: 2.1 time: 0.356777 Sep 10 11:49:36.950601 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1265/2449] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:36 2022] GET /compute/v2.1/servers/84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2 => generated 1471 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:36.961092 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8d7365b8-ae88-4898-8554-0cfd4d2dcd1b tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:36.961602 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8d7365b8-ae88-4898-8554-0cfd4d2dcd1b tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: d54d09d0-a4be-4324-ae6e-c22ad671d008] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:36.968216 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8d7365b8-ae88-4898-8554-0cfd4d2dcd1b tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:36.968719 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8d7365b8-ae88-4898-8554-0cfd4d2dcd1b tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:36.969236 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8d7365b8-ae88-4898-8554-0cfd4d2dcd1b tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:36.970155 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8d7365b8-ae88-4898-8554-0cfd4d2dcd1b tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:36.970986 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8d7365b8-ae88-4898-8554-0cfd4d2dcd1b tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:36.971817 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8d7365b8-ae88-4898-8554-0cfd4d2dcd1b tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:36.975946 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:49:37.037583 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8d7365b8-ae88-4898-8554-0cfd4d2dcd1b tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: d54d09d0-a4be-4324-ae6e-c22ad671d008] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:49:37.074575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-69c8493d-baac-42dd-b8e6-97e399e297d0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:37.084271 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-69c8493d-baac-42dd-b8e6-97e399e297d0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9" status: 200 len: 1276 microversion: 2.1 time: 0.215970 Sep 10 11:49:37.084853 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1185/2450] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:36 2022] GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 => generated 1276 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:37.092786 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2140ddfa-2b10-4d04-a072-ea9d77ff7f33 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:37.093404 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2140ddfa-2b10-4d04-a072-ea9d77ff7f33 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:37.110161 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:49:37.114043 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2140ddfa-2b10-4d04-a072-ea9d77ff7f33 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:37.118569 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2140ddfa-2b10-4d04-a072-ea9d77ff7f33 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:37.120872 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2140ddfa-2b10-4d04-a072-ea9d77ff7f33 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:37.121861 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2140ddfa-2b10-4d04-a072-ea9d77ff7f33 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:37.123760 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2140ddfa-2b10-4d04-a072-ea9d77ff7f33 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:37.127639 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2140ddfa-2b10-4d04-a072-ea9d77ff7f33 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:37.146197 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:49:37.218559 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8d7365b8-ae88-4898-8554-0cfd4d2dcd1b tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d54d09d0-a4be-4324-ae6e-c22ad671d008" status: 204 len: 0 microversion: 2.1 time: 0.264736 Sep 10 11:49:37.221845 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1266/2451] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:49:36 2022] DELETE /compute/v2.1/servers/d54d09d0-a4be-4324-ae6e-c22ad671d008 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:49:37.232215 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8b8bcb92-0e1f-4623-acb9-ec779eb6a141 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:37.237785 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8b8bcb92-0e1f-4623-acb9-ec779eb6a141 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: d54d09d0-a4be-4324-ae6e-c22ad671d008] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:37.256833 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b8bcb92-0e1f-4623-acb9-ec779eb6a141 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:37.259232 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b8bcb92-0e1f-4623-acb9-ec779eb6a141 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:37.261434 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b8bcb92-0e1f-4623-acb9-ec779eb6a141 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:37.263004 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b8bcb92-0e1f-4623-acb9-ec779eb6a141 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:37.264495 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b8bcb92-0e1f-4623-acb9-ec779eb6a141 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:37.272506 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b8bcb92-0e1f-4623-acb9-ec779eb6a141 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:37.300880 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2140ddfa-2b10-4d04-a072-ea9d77ff7f33 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:37.316500 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2140ddfa-2b10-4d04-a072-ea9d77ff7f33 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:37.318388 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2140ddfa-2b10-4d04-a072-ea9d77ff7f33 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:37.319905 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2140ddfa-2b10-4d04-a072-ea9d77ff7f33 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1873 microversion: 2.42 time: 0.232735 Sep 10 11:49:37.321179 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1186/2452] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:49:37 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1873 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:49:37.449791 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-5a7d4924-788d-4abd-93ac-8cbb37489c6b req-2821c76f-36e9-4ee7-82f5-b303e3c1cd92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2", "name": "network-vif-deleted", "tag": "61f70b54-b1c7-4797-8b2c-4ebeff0726b0"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:37.469977 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-5a7d4924-788d-4abd-93ac-8cbb37489c6b req-2821c76f-36e9-4ee7-82f5-b303e3c1cd92 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:37.470612 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-5a7d4924-788d-4abd-93ac-8cbb37489c6b req-2821c76f-36e9-4ee7-82f5-b303e3c1cd92 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:37.474659 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-5a7d4924-788d-4abd-93ac-8cbb37489c6b req-2821c76f-36e9-4ee7-82f5-b303e3c1cd92 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:37.488380 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-5a7d4924-788d-4abd-93ac-8cbb37489c6b req-2821c76f-36e9-4ee7-82f5-b303e3c1cd92 service nova] Creating event network-vif-deleted:61f70b54-b1c7-4797-8b2c-4ebeff0726b0 for instance 84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2 on n-h2-856895-1 Sep 10 11:49:37.494515 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-5a7d4924-788d-4abd-93ac-8cbb37489c6b req-2821c76f-36e9-4ee7-82f5-b303e3c1cd92 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048692 Sep 10 11:49:37.499021 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1187/2453] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:49:37.605701 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8b8bcb92-0e1f-4623-acb9-ec779eb6a141 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:37.616374 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8b8bcb92-0e1f-4623-acb9-ec779eb6a141 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/d54d09d0-a4be-4324-ae6e-c22ad671d008" status: 200 len: 1469 microversion: 2.1 time: 0.390350 Sep 10 11:49:37.619676 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1267/2454] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:37 2022] GET /compute/v2.1/servers/d54d09d0-a4be-4324-ae6e-c22ad671d008 => generated 1469 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:49:37.966223 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1140c781-891e-456e-9cb5-d68bedc06156 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:37.966945 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1140c781-891e-456e-9cb5-d68bedc06156 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:37.985171 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1140c781-891e-456e-9cb5-d68bedc06156 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:37.985681 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1140c781-891e-456e-9cb5-d68bedc06156 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:37.986299 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1140c781-891e-456e-9cb5-d68bedc06156 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:37.988456 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1140c781-891e-456e-9cb5-d68bedc06156 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:37.990900 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1140c781-891e-456e-9cb5-d68bedc06156 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:37.992872 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1140c781-891e-456e-9cb5-d68bedc06156 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:38.112480 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-26c81445-11cf-49f2-9182-dadb55ba1f16 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:38.113097 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-26c81445-11cf-49f2-9182-dadb55ba1f16 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:38.126014 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-26c81445-11cf-49f2-9182-dadb55ba1f16 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:38.129995 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-26c81445-11cf-49f2-9182-dadb55ba1f16 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:38.131658 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-26c81445-11cf-49f2-9182-dadb55ba1f16 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:38.135757 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-26c81445-11cf-49f2-9182-dadb55ba1f16 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:38.136428 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-26c81445-11cf-49f2-9182-dadb55ba1f16 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:38.137195 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-26c81445-11cf-49f2-9182-dadb55ba1f16 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:38.162146 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1140c781-891e-456e-9cb5-d68bedc06156 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:38.176142 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1140c781-891e-456e-9cb5-d68bedc06156 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2" status: 200 len: 1429 microversion: 2.1 time: 0.214526 Sep 10 11:49:38.177549 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1188/2455] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:37 2022] GET /compute/v2.1/servers/84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2 => generated 1429 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:38.226887 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=4 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:49:38.337080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-26c81445-11cf-49f2-9182-dadb55ba1f16 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:38.346532 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-26c81445-11cf-49f2-9182-dadb55ba1f16 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9" status: 200 len: 1284 microversion: 2.1 time: 0.237840 Sep 10 11:49:38.371209 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-aad7e794-4c9d-4b62-82b1-746dc2bc980f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:38.372155 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-aad7e794-4c9d-4b62-82b1-746dc2bc980f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:38.376101 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1268/2456] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:38 2022] GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 => generated 1284 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:49:38.382318 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aad7e794-4c9d-4b62-82b1-746dc2bc980f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:38.385298 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aad7e794-4c9d-4b62-82b1-746dc2bc980f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:38.389786 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aad7e794-4c9d-4b62-82b1-746dc2bc980f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:38.390806 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aad7e794-4c9d-4b62-82b1-746dc2bc980f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:38.391537 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aad7e794-4c9d-4b62-82b1-746dc2bc980f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:38.392154 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aad7e794-4c9d-4b62-82b1-746dc2bc980f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:38.554750 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-aad7e794-4c9d-4b62-82b1-746dc2bc980f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:38.564529 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-aad7e794-4c9d-4b62-82b1-746dc2bc980f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:38.566703 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-aad7e794-4c9d-4b62-82b1-746dc2bc980f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:38.578642 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-aad7e794-4c9d-4b62-82b1-746dc2bc980f tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1873 microversion: 2.42 time: 0.217986 Sep 10 11:49:38.579130 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1189/2457] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:49:38 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1873 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:49:38.640887 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fb12ca98-baed-4e7b-996d-39284b7873ce tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:38.641508 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fb12ca98-baed-4e7b-996d-39284b7873ce tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: d54d09d0-a4be-4324-ae6e-c22ad671d008] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:38.652734 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fb12ca98-baed-4e7b-996d-39284b7873ce tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:38.653238 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fb12ca98-baed-4e7b-996d-39284b7873ce tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:38.653679 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fb12ca98-baed-4e7b-996d-39284b7873ce tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:38.654396 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fb12ca98-baed-4e7b-996d-39284b7873ce tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:38.654860 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fb12ca98-baed-4e7b-996d-39284b7873ce tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:38.655329 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fb12ca98-baed-4e7b-996d-39284b7873ce tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:39.203461 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bd69ea09-ad37-4389-aab0-c6d30fa19ef7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:39.204277 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bd69ea09-ad37-4389-aab0-c6d30fa19ef7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:39.218788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd69ea09-ad37-4389-aab0-c6d30fa19ef7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:39.221760 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd69ea09-ad37-4389-aab0-c6d30fa19ef7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:39.222897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd69ea09-ad37-4389-aab0-c6d30fa19ef7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:39.224113 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd69ea09-ad37-4389-aab0-c6d30fa19ef7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:39.225016 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd69ea09-ad37-4389-aab0-c6d30fa19ef7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:39.227036 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd69ea09-ad37-4389-aab0-c6d30fa19ef7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:39.306037 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd69ea09-ad37-4389-aab0-c6d30fa19ef7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:39.308801 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd69ea09-ad37-4389-aab0-c6d30fa19ef7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:39.309490 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd69ea09-ad37-4389-aab0-c6d30fa19ef7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:39.312690 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-bd69ea09-ad37-4389-aab0-c6d30fa19ef7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lazy-loading 'fault' on Instance uuid 84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:49:39.447908 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bd69ea09-ad37-4389-aab0-c6d30fa19ef7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:39.456505 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bd69ea09-ad37-4389-aab0-c6d30fa19ef7 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2" status: 200 len: 1306 microversion: 2.1 time: 0.259124 Sep 10 11:49:39.459747 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1190/2458] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:39 2022] GET /compute/v2.1/servers/84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2 => generated 1306 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:39.473232 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8a490042-4b50-4e26-8572-82e72b3840e0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:39.474023 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8a490042-4b50-4e26-8572-82e72b3840e0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:39.493154 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a490042-4b50-4e26-8572-82e72b3840e0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:39.493825 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a490042-4b50-4e26-8572-82e72b3840e0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:39.494378 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a490042-4b50-4e26-8572-82e72b3840e0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:39.495229 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a490042-4b50-4e26-8572-82e72b3840e0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:39.495807 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a490042-4b50-4e26-8572-82e72b3840e0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:39.496347 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a490042-4b50-4e26-8572-82e72b3840e0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:39.520124 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fb12ca98-baed-4e7b-996d-39284b7873ce tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:39.535616 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fb12ca98-baed-4e7b-996d-39284b7873ce tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/d54d09d0-a4be-4324-ae6e-c22ad671d008" status: 200 len: 1469 microversion: 2.1 time: 0.898528 Sep 10 11:49:39.537797 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1269/2459] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:38 2022] GET /compute/v2.1/servers/d54d09d0-a4be-4324-ae6e-c22ad671d008 => generated 1469 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:39.609485 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-41f51fd4-8cc7-4ff3-8158-cb20cd376aee tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:39.610344 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-41f51fd4-8cc7-4ff3-8158-cb20cd376aee tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:39.618307 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-41f51fd4-8cc7-4ff3-8158-cb20cd376aee tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:39.619311 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-41f51fd4-8cc7-4ff3-8158-cb20cd376aee tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:39.619906 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-41f51fd4-8cc7-4ff3-8158-cb20cd376aee tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:39.621312 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-41f51fd4-8cc7-4ff3-8158-cb20cd376aee tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:39.621929 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-41f51fd4-8cc7-4ff3-8158-cb20cd376aee tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:39.622538 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-41f51fd4-8cc7-4ff3-8158-cb20cd376aee tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:39.692720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8a490042-4b50-4e26-8572-82e72b3840e0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:39.700906 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8a490042-4b50-4e26-8572-82e72b3840e0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9" status: 200 len: 1282 microversion: 2.1 time: 0.232769 Sep 10 11:49:39.705265 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1191/2460] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:39 2022] GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 => generated 1282 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:39.798116 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-41f51fd4-8cc7-4ff3-8158-cb20cd376aee tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:39.811722 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-41f51fd4-8cc7-4ff3-8158-cb20cd376aee tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:39.813403 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-41f51fd4-8cc7-4ff3-8158-cb20cd376aee tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:39.815034 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-41f51fd4-8cc7-4ff3-8158-cb20cd376aee tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1873 microversion: 2.42 time: 0.211060 Sep 10 11:49:39.815189 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1270/2461] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:49:39 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1873 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:49:39.959548 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-d70f7df2-7534-476f-8c99-5d2132678aa9 req-a859f297-c1d7-40a4-83d6-fb37ef5473f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d54d09d0-a4be-4324-ae6e-c22ad671d008", "name": "network-vif-deleted", "tag": "1b092d3a-3132-4efe-92da-07ca97304b78"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:39.983900 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d70f7df2-7534-476f-8c99-5d2132678aa9 req-a859f297-c1d7-40a4-83d6-fb37ef5473f8 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:39.985626 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d70f7df2-7534-476f-8c99-5d2132678aa9 req-a859f297-c1d7-40a4-83d6-fb37ef5473f8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:39.986260 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d70f7df2-7534-476f-8c99-5d2132678aa9 req-a859f297-c1d7-40a4-83d6-fb37ef5473f8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:40.020728 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-d70f7df2-7534-476f-8c99-5d2132678aa9 req-a859f297-c1d7-40a4-83d6-fb37ef5473f8 service nova] Creating event network-vif-deleted:1b092d3a-3132-4efe-92da-07ca97304b78 for instance d54d09d0-a4be-4324-ae6e-c22ad671d008 on n-h2-856895-1 Sep 10 11:49:40.028548 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-d70f7df2-7534-476f-8c99-5d2132678aa9 req-a859f297-c1d7-40a4-83d6-fb37ef5473f8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073512 Sep 10 11:49:40.032297 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1192/2462] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:49:40.491003 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5d449e78-311b-4769-94d3-72795be48017 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:40.491776 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5d449e78-311b-4769-94d3-72795be48017 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:40.503005 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d449e78-311b-4769-94d3-72795be48017 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:40.506163 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d449e78-311b-4769-94d3-72795be48017 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:40.506927 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d449e78-311b-4769-94d3-72795be48017 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:40.507929 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d449e78-311b-4769-94d3-72795be48017 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:40.522307 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d449e78-311b-4769-94d3-72795be48017 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:40.523009 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d449e78-311b-4769-94d3-72795be48017 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:40.563057 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1f937230-a453-44ad-a229-b7af4962495e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:40.563988 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1f937230-a453-44ad-a229-b7af4962495e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: d54d09d0-a4be-4324-ae6e-c22ad671d008] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:40.580913 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-5d449e78-311b-4769-94d3-72795be48017 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] HTTP exception thrown: Instance 84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2 could not be found. Sep 10 11:49:40.584574 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f937230-a453-44ad-a229-b7af4962495e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5d449e78-311b-4769-94d3-72795be48017 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Request method failure captured: Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2 HTTP/1.1 Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHkg-Zo7KMrfu0nNgLtrDU5lUnvDP6kvvcMZg2xisQhCM8eccKrdiLyTPHyzb6K9Q1ZiirRtqBOL4GZdbmmVvyNi0Bc3ugjMpJ_IDaF7uzu1phl69Zh6vFfvNF5AXJUQgKyEoKjCn57nwgkILaNwuhei0IBfr9Mbt-jkLsFVJEXAgCM Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 5949225a72e649c1adc217d5a760460a Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersOnMultiNodesTest-954271111 Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5949225a72e649c1adc217d5a760460a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5949225a72e649c1adc217d5a760460a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5949225a72e649c1adc217d5a760460a", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5949225a72e649c1adc217d5a760460a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersOnMultiNodesTest-954271111 Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 5949225a72e649c1adc217d5a760460a Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-954271111 Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersOnMultiNodesTest-954271111-project Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: dfc33eb8645248f9b154587e7d8d449e Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersOnMultiNodesTest-954271111-project Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2 could not be found. Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2'} Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2 could not be found. Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2 could not be found. Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:40.586644 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:40.590653 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:40.590653 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:40.590653 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:40.590653 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:49:40.590653 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:49:40.590653 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2 could not be found. Sep 10 11:49:40.590653 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:40.591080 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f937230-a453-44ad-a229-b7af4962495e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:40.591080 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f937230-a453-44ad-a229-b7af4962495e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:40.591080 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f937230-a453-44ad-a229-b7af4962495e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:40.591080 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f937230-a453-44ad-a229-b7af4962495e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:40.591080 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f937230-a453-44ad-a229-b7af4962495e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:40.595386 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5d449e78-311b-4769-94d3-72795be48017 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Returning 404 to user: Instance 84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:49:40.604385 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5d449e78-311b-4769-94d3-72795be48017 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2" status: 404 len: 111 microversion: 2.1 time: 0.118090 Sep 10 11:49:40.608634 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1271/2463] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:40 2022] GET /compute/v2.1/servers/84e77c18-3ecd-4bdd-8a4e-5f33c829dfb2 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:49:40.618854 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4469a60c-10a2-4b3c-bb6a-56073454217c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:40.628126 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4469a60c-10a2-4b3c-bb6a-56073454217c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 49cfca02-b968-45e0-9b31-404eded0c6d2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:40.648275 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4469a60c-10a2-4b3c-bb6a-56073454217c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:40.653076 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4469a60c-10a2-4b3c-bb6a-56073454217c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:40.653611 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4469a60c-10a2-4b3c-bb6a-56073454217c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:40.654433 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4469a60c-10a2-4b3c-bb6a-56073454217c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:40.656427 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4469a60c-10a2-4b3c-bb6a-56073454217c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:40.656993 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4469a60c-10a2-4b3c-bb6a-56073454217c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:40.726766 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f937230-a453-44ad-a229-b7af4962495e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:40.737543 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f937230-a453-44ad-a229-b7af4962495e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:40.738164 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f937230-a453-44ad-a229-b7af4962495e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:40.739192 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-1f937230-a453-44ad-a229-b7af4962495e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lazy-loading 'fault' on Instance uuid d54d09d0-a4be-4324-ae6e-c22ad671d008 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:49:40.758738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4469a60c-10a2-4b3c-bb6a-56073454217c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 49cfca02-b968-45e0-9b31-404eded0c6d2] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:49:40.903709 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1f937230-a453-44ad-a229-b7af4962495e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:40.916621 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1f937230-a453-44ad-a229-b7af4962495e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/d54d09d0-a4be-4324-ae6e-c22ad671d008" status: 200 len: 1304 microversion: 2.1 time: 0.358712 Sep 10 11:49:40.948711 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1193/2464] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:40 2022] GET /compute/v2.1/servers/d54d09d0-a4be-4324-ae6e-c22ad671d008 => generated 1304 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:49:40.971696 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bd24178c-a042-4dcb-ae48-1050d93f4a12 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:40.971696 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bd24178c-a042-4dcb-ae48-1050d93f4a12 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:41.010230 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd24178c-a042-4dcb-ae48-1050d93f4a12 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:41.013883 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4469a60c-10a2-4b3c-bb6a-56073454217c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "DELETE /compute/v2.1/servers/49cfca02-b968-45e0-9b31-404eded0c6d2" status: 204 len: 0 microversion: 2.1 time: 0.398745 Sep 10 11:49:41.014498 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1272/2465] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:49:40 2022] DELETE /compute/v2.1/servers/49cfca02-b968-45e0-9b31-404eded0c6d2 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 11:49:41.015924 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd24178c-a042-4dcb-ae48-1050d93f4a12 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:41.016485 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd24178c-a042-4dcb-ae48-1050d93f4a12 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:41.017525 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd24178c-a042-4dcb-ae48-1050d93f4a12 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:41.020035 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd24178c-a042-4dcb-ae48-1050d93f4a12 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:41.021197 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd24178c-a042-4dcb-ae48-1050d93f4a12 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:41.032743 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d72ddb32-d709-449d-87e2-a595667e6f3e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:41.033519 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d72ddb32-d709-449d-87e2-a595667e6f3e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:41.051510 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d72ddb32-d709-449d-87e2-a595667e6f3e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:41.052007 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d72ddb32-d709-449d-87e2-a595667e6f3e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:41.053273 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d72ddb32-d709-449d-87e2-a595667e6f3e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:41.054824 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d72ddb32-d709-449d-87e2-a595667e6f3e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:41.056708 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d72ddb32-d709-449d-87e2-a595667e6f3e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:41.057627 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d72ddb32-d709-449d-87e2-a595667e6f3e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:41.644379 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d72ddb32-d709-449d-87e2-a595667e6f3e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:41.669143 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d72ddb32-d709-449d-87e2-a595667e6f3e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:41.671925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d72ddb32-d709-449d-87e2-a595667e6f3e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:41.673478 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d72ddb32-d709-449d-87e2-a595667e6f3e tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1873 microversion: 2.42 time: 0.657729 Sep 10 11:49:41.682346 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1273/2466] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:49:41 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1873 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:49:41.689722 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e847fb9d-4ef7-4b1b-b768-25f8e6fce548 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:41.691460 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e847fb9d-4ef7-4b1b-b768-25f8e6fce548 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 785f3cc4-7418-4e67-b5e7-d37bb7a59919] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:41.726647 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e847fb9d-4ef7-4b1b-b768-25f8e6fce548 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:41.727142 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e847fb9d-4ef7-4b1b-b768-25f8e6fce548 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:41.727608 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e847fb9d-4ef7-4b1b-b768-25f8e6fce548 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:41.728313 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e847fb9d-4ef7-4b1b-b768-25f8e6fce548 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:41.728761 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e847fb9d-4ef7-4b1b-b768-25f8e6fce548 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:41.729184 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e847fb9d-4ef7-4b1b-b768-25f8e6fce548 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:41.793445 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e847fb9d-4ef7-4b1b-b768-25f8e6fce548 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 785f3cc4-7418-4e67-b5e7-d37bb7a59919] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:49:41.946257 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e847fb9d-4ef7-4b1b-b768-25f8e6fce548 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "DELETE /compute/v2.1/servers/785f3cc4-7418-4e67-b5e7-d37bb7a59919" status: 204 len: 0 microversion: 2.1 time: 0.261305 Sep 10 11:49:41.947365 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1274/2467] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:49:41 2022] DELETE /compute/v2.1/servers/785f3cc4-7418-4e67-b5e7-d37bb7a59919 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:49:41.958553 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6d0c6d10-fd3e-40bb-8d1a-a02044aa8785 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:41.964281 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6d0c6d10-fd3e-40bb-8d1a-a02044aa8785 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 49cfca02-b968-45e0-9b31-404eded0c6d2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:41.980682 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d0c6d10-fd3e-40bb-8d1a-a02044aa8785 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:41.981567 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d0c6d10-fd3e-40bb-8d1a-a02044aa8785 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:41.982696 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d0c6d10-fd3e-40bb-8d1a-a02044aa8785 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:41.983664 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d0c6d10-fd3e-40bb-8d1a-a02044aa8785 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:41.984301 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d0c6d10-fd3e-40bb-8d1a-a02044aa8785 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:41.996053 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bd24178c-a042-4dcb-ae48-1050d93f4a12 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:42.012875 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d0c6d10-fd3e-40bb-8d1a-a02044aa8785 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:42.019440 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bd24178c-a042-4dcb-ae48-1050d93f4a12 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9" status: 200 len: 1324 microversion: 2.1 time: 1.068189 Sep 10 11:49:42.023017 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1194/2468] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:40 2022] GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 => generated 1324 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:42.042220 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-afcac04e-7df2-4097-9347-c09f6c12974e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:42.043358 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-afcac04e-7df2-4097-9347-c09f6c12974e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: d54d09d0-a4be-4324-ae6e-c22ad671d008] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:42.060952 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-afcac04e-7df2-4097-9347-c09f6c12974e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:42.060952 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-afcac04e-7df2-4097-9347-c09f6c12974e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:42.060952 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-afcac04e-7df2-4097-9347-c09f6c12974e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:42.060952 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-afcac04e-7df2-4097-9347-c09f6c12974e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:42.062181 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-afcac04e-7df2-4097-9347-c09f6c12974e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:42.062637 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-afcac04e-7df2-4097-9347-c09f6c12974e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:42.105095 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-afcac04e-7df2-4097-9347-c09f6c12974e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] HTTP exception thrown: Instance d54d09d0-a4be-4324-ae6e-c22ad671d008 could not be found. Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-afcac04e-7df2-4097-9347-c09f6c12974e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Request method failure captured: Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/d54d09d0-a4be-4324-ae6e-c22ad671d008 HTTP/1.1 Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHlUSEZXtyk8wt2IG5Gw3xoPsFQQ66k7MWJCT0nHxXDu_h1Nx8nIr3NAf8F8RfftelzrNjcJ_HA8P90BGd4ENOKdNKh9XYufdp_lCwVQBwJIAinu7k6skBJ3AdQs8-mJIMn2ggmqhZG_QtrfslhxbA8TTage9VXqvSPZajqtr1ERn_c Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: d8f6657b05bd48edbe73282147feee78 Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersAdminTestJSON-186209642 Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d8f6657b05bd48edbe73282147feee78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d8f6657b05bd48edbe73282147feee78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d8f6657b05bd48edbe73282147feee78", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d8f6657b05bd48edbe73282147feee78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersAdminTestJSON-186209642 Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: d8f6657b05bd48edbe73282147feee78 Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersAdminTestJSON-186209642 Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersAdminTestJSON-186209642-project Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 221c7c18d84c400388bd95cf28cf3e1a Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersAdminTestJSON-186209642-project Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance d54d09d0-a4be-4324-ae6e-c22ad671d008 could not be found. Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'd54d09d0-a4be-4324-ae6e-c22ad671d008'} Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d54d09d0-a4be-4324-ae6e-c22ad671d008 could not be found. Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d54d09d0-a4be-4324-ae6e-c22ad671d008 could not be found. Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:42.106828 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:42.113195 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:42.113195 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:42.113195 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:42.113195 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:49:42.113195 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:49:42.113195 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d54d09d0-a4be-4324-ae6e-c22ad671d008 could not be found. Sep 10 11:49:42.113195 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:42.120122 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-afcac04e-7df2-4097-9347-c09f6c12974e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Returning 404 to user: Instance d54d09d0-a4be-4324-ae6e-c22ad671d008 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:49:42.124989 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-afcac04e-7df2-4097-9347-c09f6c12974e tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/d54d09d0-a4be-4324-ae6e-c22ad671d008" status: 404 len: 111 microversion: 2.1 time: 0.096318 Sep 10 11:49:42.127944 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1195/2469] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:42 2022] GET /compute/v2.1/servers/d54d09d0-a4be-4324-ae6e-c22ad671d008 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:49:42.164720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-5c14f50a-c381-4d69-a06c-91f2afe406e0 req-782e885d-de47-4f78-94d9-c071b27e7415 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9", "tag": "865e5e79-8273-4141-b596-7fb63328b234"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:42.190770 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-5c14f50a-c381-4d69-a06c-91f2afe406e0 req-782e885d-de47-4f78-94d9-c071b27e7415 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:42.191318 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-5c14f50a-c381-4d69-a06c-91f2afe406e0 req-782e885d-de47-4f78-94d9-c071b27e7415 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:42.191774 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-5c14f50a-c381-4d69-a06c-91f2afe406e0 req-782e885d-de47-4f78-94d9-c071b27e7415 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:42.204760 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-5c14f50a-c381-4d69-a06c-91f2afe406e0 req-782e885d-de47-4f78-94d9-c071b27e7415 service nova] Creating event network-changed:865e5e79-8273-4141-b596-7fb63328b234 for instance c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 on n-h2-856895-1 Sep 10 11:49:42.210358 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-5c14f50a-c381-4d69-a06c-91f2afe406e0 req-782e885d-de47-4f78-94d9-c071b27e7415 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080832 Sep 10 11:49:42.210973 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1196/2470] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:49:42.217228 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-388df3b2-09cd-4acc-8c98-2890a6b97d08 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:42.218276 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-388df3b2-09cd-4acc-8c98-2890a6b97d08 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:42.224940 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-388df3b2-09cd-4acc-8c98-2890a6b97d08 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:42.225622 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-388df3b2-09cd-4acc-8c98-2890a6b97d08 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:42.226258 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-388df3b2-09cd-4acc-8c98-2890a6b97d08 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:42.227144 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-388df3b2-09cd-4acc-8c98-2890a6b97d08 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:42.227998 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-388df3b2-09cd-4acc-8c98-2890a6b97d08 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:42.228641 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-388df3b2-09cd-4acc-8c98-2890a6b97d08 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:42.271380 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-388df3b2-09cd-4acc-8c98-2890a6b97d08 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:49:42.455984 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-388df3b2-09cd-4acc-8c98-2890a6b97d08 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 204 len: 0 microversion: 2.1 time: 0.243084 Sep 10 11:49:42.456601 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1197/2471] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:49:42 2022] DELETE /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:49:42.470375 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3f280b25-5ed8-4ee2-88a4-a4079c0b9f5a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:42.473962 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3f280b25-5ed8-4ee2-88a4-a4079c0b9f5a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:42.483365 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6d0c6d10-fd3e-40bb-8d1a-a02044aa8785 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:42.493090 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3f280b25-5ed8-4ee2-88a4-a4079c0b9f5a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:42.493609 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3f280b25-5ed8-4ee2-88a4-a4079c0b9f5a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:42.494053 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3f280b25-5ed8-4ee2-88a4-a4079c0b9f5a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:42.494774 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3f280b25-5ed8-4ee2-88a4-a4079c0b9f5a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:42.495259 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3f280b25-5ed8-4ee2-88a4-a4079c0b9f5a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:42.495695 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3f280b25-5ed8-4ee2-88a4-a4079c0b9f5a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:42.499429 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6d0c6d10-fd3e-40bb-8d1a-a02044aa8785 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/49cfca02-b968-45e0-9b31-404eded0c6d2" status: 200 len: 1475 microversion: 2.1 time: 0.544338 Sep 10 11:49:42.505554 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1275/2472] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:41 2022] GET /compute/v2.1/servers/49cfca02-b968-45e0-9b31-404eded0c6d2 => generated 1475 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:49:42.712342 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3fb2a45a-ab92-40d5-8167-09ccb8fbbe74 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:42.712975 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3fb2a45a-ab92-40d5-8167-09ccb8fbbe74 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:42.731568 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3fb2a45a-ab92-40d5-8167-09ccb8fbbe74 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:42.737942 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3fb2a45a-ab92-40d5-8167-09ccb8fbbe74 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:42.738385 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3fb2a45a-ab92-40d5-8167-09ccb8fbbe74 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:42.739132 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3fb2a45a-ab92-40d5-8167-09ccb8fbbe74 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:42.739625 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3fb2a45a-ab92-40d5-8167-09ccb8fbbe74 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:42.740051 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3fb2a45a-ab92-40d5-8167-09ccb8fbbe74 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:42.905659 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3f280b25-5ed8-4ee2-88a4-a4079c0b9f5a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:42.911448 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3fb2a45a-ab92-40d5-8167-09ccb8fbbe74 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:42.919509 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3f280b25-5ed8-4ee2-88a4-a4079c0b9f5a tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1469 microversion: 2.1 time: 0.456460 Sep 10 11:49:42.921680 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1198/2473] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:42 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1469 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:42.931915 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3fb2a45a-ab92-40d5-8167-09ccb8fbbe74 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:42.937349 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3fb2a45a-ab92-40d5-8167-09ccb8fbbe74 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:42.940933 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3fb2a45a-ab92-40d5-8167-09ccb8fbbe74 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1873 microversion: 2.42 time: 0.230348 Sep 10 11:49:42.943468 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1276/2474] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:49:42 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1873 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:49:43.044818 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-07abc348-a14e-45c2-affd-5bd3b5117ea1 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:43.046060 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-07abc348-a14e-45c2-affd-5bd3b5117ea1 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:43.058703 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-07abc348-a14e-45c2-affd-5bd3b5117ea1 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:43.060011 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-07abc348-a14e-45c2-affd-5bd3b5117ea1 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:43.062057 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-07abc348-a14e-45c2-affd-5bd3b5117ea1 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:43.062985 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-07abc348-a14e-45c2-affd-5bd3b5117ea1 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:43.065435 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-07abc348-a14e-45c2-affd-5bd3b5117ea1 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:43.066081 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-07abc348-a14e-45c2-affd-5bd3b5117ea1 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:43.350507 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-07abc348-a14e-45c2-affd-5bd3b5117ea1 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:43.364275 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-07abc348-a14e-45c2-affd-5bd3b5117ea1 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9" status: 200 len: 1324 microversion: 2.1 time: 0.319628 Sep 10 11:49:43.379878 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1199/2475] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:43 2022] GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 => generated 1324 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:43.529238 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1be3721c-50b2-4d71-b7d2-2f3337977220 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:43.531053 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1be3721c-50b2-4d71-b7d2-2f3337977220 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 49cfca02-b968-45e0-9b31-404eded0c6d2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:43.540191 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1be3721c-50b2-4d71-b7d2-2f3337977220 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:43.554103 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1be3721c-50b2-4d71-b7d2-2f3337977220 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:43.554872 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1be3721c-50b2-4d71-b7d2-2f3337977220 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:43.555890 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1be3721c-50b2-4d71-b7d2-2f3337977220 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:43.558304 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1be3721c-50b2-4d71-b7d2-2f3337977220 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:43.558991 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1be3721c-50b2-4d71-b7d2-2f3337977220 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:43.945113 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7f69c094-d888-426b-a9fd-819c42340631 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:43.946378 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7f69c094-d888-426b-a9fd-819c42340631 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:43.977126 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f69c094-d888-426b-a9fd-819c42340631 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:43.977643 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f69c094-d888-426b-a9fd-819c42340631 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:43.987394 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f69c094-d888-426b-a9fd-819c42340631 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:43.991779 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f69c094-d888-426b-a9fd-819c42340631 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:43.992998 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f69c094-d888-426b-a9fd-819c42340631 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:43.996455 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f69c094-d888-426b-a9fd-819c42340631 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:44.159015 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:49:44.215533 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1be3721c-50b2-4d71-b7d2-2f3337977220 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:44.227447 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1be3721c-50b2-4d71-b7d2-2f3337977220 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/49cfca02-b968-45e0-9b31-404eded0c6d2" status: 200 len: 1475 microversion: 2.1 time: 0.702706 Sep 10 11:49:44.228584 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1277/2476] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:43 2022] GET /compute/v2.1/servers/49cfca02-b968-45e0-9b31-404eded0c6d2 => generated 1475 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:44.239569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-214b0630-5574-4160-ad5f-c614b1041716 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:44.240689 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-214b0630-5574-4160-ad5f-c614b1041716 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:44.256185 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-214b0630-5574-4160-ad5f-c614b1041716 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:44.256950 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-214b0630-5574-4160-ad5f-c614b1041716 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:44.257552 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-214b0630-5574-4160-ad5f-c614b1041716 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:44.258423 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-214b0630-5574-4160-ad5f-c614b1041716 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:44.259034 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-214b0630-5574-4160-ad5f-c614b1041716 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:44.260891 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-214b0630-5574-4160-ad5f-c614b1041716 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:44.307420 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:49:44.466892 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7f69c094-d888-426b-a9fd-819c42340631 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:44.482553 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7f69c094-d888-426b-a9fd-819c42340631 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1469 microversion: 2.1 time: 0.543010 Sep 10 11:49:44.495763 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1200/2477] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:43 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1469 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:49:44.509479 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e9f5cfc4-4c8f-47f8-a8a4-f3c7fb27da7b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:44.511854 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e9f5cfc4-4c8f-47f8-a8a4-f3c7fb27da7b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:44.542328 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=8 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:49:44.544525 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e9f5cfc4-4c8f-47f8-a8a4-f3c7fb27da7b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:44.545032 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e9f5cfc4-4c8f-47f8-a8a4-f3c7fb27da7b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:44.545463 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e9f5cfc4-4c8f-47f8-a8a4-f3c7fb27da7b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:44.546175 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e9f5cfc4-4c8f-47f8-a8a4-f3c7fb27da7b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:44.546633 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e9f5cfc4-4c8f-47f8-a8a4-f3c7fb27da7b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:44.547052 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e9f5cfc4-4c8f-47f8-a8a4-f3c7fb27da7b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:44.726447 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-214b0630-5574-4160-ad5f-c614b1041716 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:44.727522 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-214b0630-5574-4160-ad5f-c614b1041716 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:44.727994 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-214b0630-5574-4160-ad5f-c614b1041716 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:44.728460 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-214b0630-5574-4160-ad5f-c614b1041716 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lazy-loading 'fault' on Instance uuid ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:49:44.909015 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-214b0630-5574-4160-ad5f-c614b1041716 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:44.941370 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-214b0630-5574-4160-ad5f-c614b1041716 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:44.949261 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-214b0630-5574-4160-ad5f-c614b1041716 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07d1c7718856439a8e76ed07ca5278b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ad66541dd4acdb35af09b28001e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:44.952439 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-214b0630-5574-4160-ad5f-c614b1041716 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 200 len: 1878 microversion: 2.42 time: 0.722485 Sep 10 11:49:44.957974 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1278/2478] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:49:44 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 1878 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:49:44.999249 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-a99056b9-c864-4422-bf1f-0610625ad835 req-5fd481eb-a3c8-4fb1-bf41-851edcf4cae1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "785f3cc4-7418-4e67-b5e7-d37bb7a59919", "name": "network-vif-deleted", "tag": "77c98b43-bfc2-4abb-b50a-66f656d2b6e5"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:45.046594 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a99056b9-c864-4422-bf1f-0610625ad835 req-5fd481eb-a3c8-4fb1-bf41-851edcf4cae1 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:45.048732 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a99056b9-c864-4422-bf1f-0610625ad835 req-5fd481eb-a3c8-4fb1-bf41-851edcf4cae1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:45.052147 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a99056b9-c864-4422-bf1f-0610625ad835 req-5fd481eb-a3c8-4fb1-bf41-851edcf4cae1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:45.086138 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-a99056b9-c864-4422-bf1f-0610625ad835 req-5fd481eb-a3c8-4fb1-bf41-851edcf4cae1 service nova] Creating event network-vif-deleted:77c98b43-bfc2-4abb-b50a-66f656d2b6e5 for instance 785f3cc4-7418-4e67-b5e7-d37bb7a59919 on n-h2-856895-1 Sep 10 11:49:45.104990 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-a99056b9-c864-4422-bf1f-0610625ad835 req-5fd481eb-a3c8-4fb1-bf41-851edcf4cae1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138792 Sep 10 11:49:45.106704 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1279/2479] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:49:45.257933 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d4cd31e2-ba8c-4012-b29e-2e6c60913934 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:45.259481 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d4cd31e2-ba8c-4012-b29e-2e6c60913934 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 49cfca02-b968-45e0-9b31-404eded0c6d2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:45.274978 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d4cd31e2-ba8c-4012-b29e-2e6c60913934 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:45.277614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d4cd31e2-ba8c-4012-b29e-2e6c60913934 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:45.278976 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d4cd31e2-ba8c-4012-b29e-2e6c60913934 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:45.280790 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d4cd31e2-ba8c-4012-b29e-2e6c60913934 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:45.285371 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d4cd31e2-ba8c-4012-b29e-2e6c60913934 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:45.286102 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d4cd31e2-ba8c-4012-b29e-2e6c60913934 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:45.316504 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e9f5cfc4-4c8f-47f8-a8a4-f3c7fb27da7b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:45.328258 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e9f5cfc4-4c8f-47f8-a8a4-f3c7fb27da7b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9" status: 200 len: 1324 microversion: 2.1 time: 0.831016 Sep 10 11:49:45.328674 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1201/2480] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:44 2022] GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 => generated 1324 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:45.518298 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-222e6968-cc3c-4c99-8d25-2acfac452876 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:45.519101 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-222e6968-cc3c-4c99-8d25-2acfac452876 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:45.526196 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-222e6968-cc3c-4c99-8d25-2acfac452876 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:45.527630 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-222e6968-cc3c-4c99-8d25-2acfac452876 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:45.530008 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-222e6968-cc3c-4c99-8d25-2acfac452876 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:45.531726 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-222e6968-cc3c-4c99-8d25-2acfac452876 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:45.532913 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-222e6968-cc3c-4c99-8d25-2acfac452876 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:45.534542 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-222e6968-cc3c-4c99-8d25-2acfac452876 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:45.730333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d4cd31e2-ba8c-4012-b29e-2e6c60913934 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:45.743824 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d4cd31e2-ba8c-4012-b29e-2e6c60913934 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/49cfca02-b968-45e0-9b31-404eded0c6d2" status: 200 len: 1475 microversion: 2.1 time: 0.492175 Sep 10 11:49:45.745014 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1280/2481] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:45 2022] GET /compute/v2.1/servers/49cfca02-b968-45e0-9b31-404eded0c6d2 => generated 1475 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:45.989279 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5078b931-7369-4b8e-a984-67b565cf397c tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:45.990375 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5078b931-7369-4b8e-a984-67b565cf397c tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:46.000738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5078b931-7369-4b8e-a984-67b565cf397c tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:46.001513 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5078b931-7369-4b8e-a984-67b565cf397c tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:46.002954 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5078b931-7369-4b8e-a984-67b565cf397c tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:46.004165 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5078b931-7369-4b8e-a984-67b565cf397c tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:46.004773 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5078b931-7369-4b8e-a984-67b565cf397c tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:46.005403 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5078b931-7369-4b8e-a984-67b565cf397c tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:46.024910 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-5078b931-7369-4b8e-a984-67b565cf397c tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] HTTP exception thrown: Instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a could not be found. Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5078b931-7369-4b8e-a984-67b565cf397c tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Request method failure captured: Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a HTTP/1.1 Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHgjOBfFfsseIGUp5n47Ik5-xGH5Pfq18YBHxBsPAEXnSTz3mSn11b45c-LfxzrqnY8NIh9Uopc30hZOWzfLMQmYOA0abVHwApxPLTEeBspm8q58-8aK_1FhvTFK0XvJPXkNcDUm395E_WXzCBZXVkRi-GelqGBAERuxKb2Mzys2DKw Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: X-Openstack-Nova-Api-Version: 2.42 Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 125ad66541dd4acdb35af09b28001e39 Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1953745739 Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/125ad66541dd4acdb35af09b28001e39"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/125ad66541dd4acdb35af09b28001e39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_125ad66541dd4acdb35af09b28001e39", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/125ad66541dd4acdb35af09b28001e39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1953745739 Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 125ad66541dd4acdb35af09b28001e39 Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1953745739 Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-TaggedBootDevicesTest_v242-1953745739-project Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 07d1c7718856439a8e76ed07ca5278b8 Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1953745739-project Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a could not be found. Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a'} Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a could not be found. Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a could not be found. Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:46.027677 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:46.032293 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:46.032293 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:46.032293 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:46.032293 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:46.032293 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:49:46.032293 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:49:46.032293 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a could not be found. Sep 10 11:49:46.032293 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:46.035311 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5078b931-7369-4b8e-a984-67b565cf397c tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Returning 404 to user: Instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:49:46.036466 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5078b931-7369-4b8e-a984-67b565cf397c tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 404 len: 111 microversion: 2.42 time: 0.053295 Sep 10 11:49:46.041673 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1281/2482] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:49:45 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:49:46.061520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e41083a2-9079-46d3-aa1e-55a6064a4967 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '.version_select at 0x7f4073ec7430>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:46.084107 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=5 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:49:46.125193 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e41083a2-9079-46d3-aa1e-55a6064a4967 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1715265238" status: 204 len: 0 microversion: 2.42 time: 0.081397 Sep 10 11:49:46.126919 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1282/2483] 10.222.0.23 () {60 vars in 1262 bytes} [Sat Sep 10 11:49:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1715265238 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 11:49:46.226029 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-222e6968-cc3c-4c99-8d25-2acfac452876 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:46.260994 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-222e6968-cc3c-4c99-8d25-2acfac452876 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1469 microversion: 2.1 time: 0.746289 Sep 10 11:49:46.264703 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1202/2484] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:45 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1469 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:46.364007 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0590b1d5-e03a-4535-8302-ff248f614555 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:46.366397 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0590b1d5-e03a-4535-8302-ff248f614555 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:46.398505 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0590b1d5-e03a-4535-8302-ff248f614555 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:46.400727 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0590b1d5-e03a-4535-8302-ff248f614555 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:46.402268 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0590b1d5-e03a-4535-8302-ff248f614555 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:46.411491 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0590b1d5-e03a-4535-8302-ff248f614555 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:46.412816 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0590b1d5-e03a-4535-8302-ff248f614555 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:46.413604 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0590b1d5-e03a-4535-8302-ff248f614555 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:46.781830 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9cd42d3e-2cd6-45cd-9a02-1d27dab8c53f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:46.783136 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9cd42d3e-2cd6-45cd-9a02-1d27dab8c53f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 49cfca02-b968-45e0-9b31-404eded0c6d2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:46.795341 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9cd42d3e-2cd6-45cd-9a02-1d27dab8c53f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:46.796283 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9cd42d3e-2cd6-45cd-9a02-1d27dab8c53f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:46.797005 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9cd42d3e-2cd6-45cd-9a02-1d27dab8c53f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:46.798193 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9cd42d3e-2cd6-45cd-9a02-1d27dab8c53f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:46.798930 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9cd42d3e-2cd6-45cd-9a02-1d27dab8c53f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:46.800972 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9cd42d3e-2cd6-45cd-9a02-1d27dab8c53f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:46.806560 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:49:46.853669 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9cd42d3e-2cd6-45cd-9a02-1d27dab8c53f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:46.854882 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9cd42d3e-2cd6-45cd-9a02-1d27dab8c53f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:46.855385 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9cd42d3e-2cd6-45cd-9a02-1d27dab8c53f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:46.856318 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-9cd42d3e-2cd6-45cd-9a02-1d27dab8c53f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lazy-loading 'fault' on Instance uuid 49cfca02-b968-45e0-9b31-404eded0c6d2 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:49:46.959147 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9cd42d3e-2cd6-45cd-9a02-1d27dab8c53f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:46.963788 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0590b1d5-e03a-4535-8302-ff248f614555 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:46.970702 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9cd42d3e-2cd6-45cd-9a02-1d27dab8c53f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/49cfca02-b968-45e0-9b31-404eded0c6d2" status: 200 len: 1309 microversion: 2.1 time: 0.203253 Sep 10 11:49:46.972245 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1203/2485] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:46 2022] GET /compute/v2.1/servers/49cfca02-b968-45e0-9b31-404eded0c6d2 => generated 1309 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:46.994060 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0590b1d5-e03a-4535-8302-ff248f614555 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9" status: 200 len: 1324 microversion: 2.1 time: 0.642990 Sep 10 11:49:47.012032 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1283/2486] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:46 2022] GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 => generated 1324 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:47.288636 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-349ac859-dd0a-41d6-a68d-3dc3e5b74f51 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:47.289577 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-349ac859-dd0a-41d6-a68d-3dc3e5b74f51 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:47.298457 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-349ac859-dd0a-41d6-a68d-3dc3e5b74f51 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:47.299278 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-349ac859-dd0a-41d6-a68d-3dc3e5b74f51 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:47.299907 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-349ac859-dd0a-41d6-a68d-3dc3e5b74f51 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:47.301890 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-349ac859-dd0a-41d6-a68d-3dc3e5b74f51 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:47.302598 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-349ac859-dd0a-41d6-a68d-3dc3e5b74f51 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:47.303230 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-349ac859-dd0a-41d6-a68d-3dc3e5b74f51 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:47.343705 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-349ac859-dd0a-41d6-a68d-3dc3e5b74f51 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:47.344484 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-349ac859-dd0a-41d6-a68d-3dc3e5b74f51 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:47.344936 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-349ac859-dd0a-41d6-a68d-3dc3e5b74f51 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:47.345400 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-349ac859-dd0a-41d6-a68d-3dc3e5b74f51 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lazy-loading 'fault' on Instance uuid 6ebabc55-1b1d-4276-8bde-d8d4859d74fd {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:49:47.459099 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-2cbd9d28-8eac-4fe9-bb88-9e22f8fa3510 req-88327de0-7af0-44ac-9f2a-2de96a801ca4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49cfca02-b968-45e0-9b31-404eded0c6d2", "name": "network-vif-deleted", "tag": "e51fd5a1-f40e-4a7e-a9ac-06c1f8dfb21d"}, {"server_uuid": "6ebabc55-1b1d-4276-8bde-d8d4859d74fd", "name": "network-vif-deleted", "tag": "679e3ac9-dc5d-4404-aa8b-99020ce86192"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:47.473889 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-2cbd9d28-8eac-4fe9-bb88-9e22f8fa3510 req-88327de0-7af0-44ac-9f2a-2de96a801ca4 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:47.474683 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-2cbd9d28-8eac-4fe9-bb88-9e22f8fa3510 req-88327de0-7af0-44ac-9f2a-2de96a801ca4 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:47.475325 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-2cbd9d28-8eac-4fe9-bb88-9e22f8fa3510 req-88327de0-7af0-44ac-9f2a-2de96a801ca4 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:47.494101 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-2cbd9d28-8eac-4fe9-bb88-9e22f8fa3510 req-88327de0-7af0-44ac-9f2a-2de96a801ca4 service nova] Creating event network-vif-deleted:e51fd5a1-f40e-4a7e-a9ac-06c1f8dfb21d for instance 49cfca02-b968-45e0-9b31-404eded0c6d2 on n-h1-856895-1 Sep 10 11:49:47.494962 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-2cbd9d28-8eac-4fe9-bb88-9e22f8fa3510 req-88327de0-7af0-44ac-9f2a-2de96a801ca4 service nova] Creating event network-vif-deleted:679e3ac9-dc5d-4404-aa8b-99020ce86192 for instance 6ebabc55-1b1d-4276-8bde-d8d4859d74fd on n-h1-856895-1 Sep 10 11:49:47.504143 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-2cbd9d28-8eac-4fe9-bb88-9e22f8fa3510 req-88327de0-7af0-44ac-9f2a-2de96a801ca4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.050241 Sep 10 11:49:47.505329 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1284/2487] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:49:47.621258 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-349ac859-dd0a-41d6-a68d-3dc3e5b74f51 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '221c7c18d84c400388bd95cf28cf3e1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f6657b05bd48edbe73282147feee78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:47.631957 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-349ac859-dd0a-41d6-a68d-3dc3e5b74f51 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 200 len: 1303 microversion: 2.1 time: 0.347378 Sep 10 11:49:47.632578 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1204/2488] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:47 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 1303 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:48.012456 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9883ecb4-fb13-439a-a9d8-907f42e1195c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:48.020228 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9883ecb4-fb13-439a-a9d8-907f42e1195c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 49cfca02-b968-45e0-9b31-404eded0c6d2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:48.039621 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9883ecb4-fb13-439a-a9d8-907f42e1195c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:48.041023 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9883ecb4-fb13-439a-a9d8-907f42e1195c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:48.043912 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9883ecb4-fb13-439a-a9d8-907f42e1195c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:48.046262 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9883ecb4-fb13-439a-a9d8-907f42e1195c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:48.046916 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9883ecb4-fb13-439a-a9d8-907f42e1195c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:48.048409 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9883ecb4-fb13-439a-a9d8-907f42e1195c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:48.088303 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-9883ecb4-fb13-439a-a9d8-907f42e1195c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] HTTP exception thrown: Instance 49cfca02-b968-45e0-9b31-404eded0c6d2 could not be found. Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9883ecb4-fb13-439a-a9d8-907f42e1195c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Request method failure captured: Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/49cfca02-b968-45e0-9b31-404eded0c6d2 HTTP/1.1 Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHkg-Zo7KMrfu0nNgLtrDU5lUnvDP6kvvcMZg2xisQhCM8eccKrdiLyTPHyzb6K9Q1ZiirRtqBOL4GZdbmmVvyNi0Bc3ugjMpJ_IDaF7uzu1phl69Zh6vFfvNF5AXJUQgKyEoKjCn57nwgkILaNwuhei0IBfr9Mbt-jkLsFVJEXAgCM Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 5949225a72e649c1adc217d5a760460a Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersOnMultiNodesTest-954271111 Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5949225a72e649c1adc217d5a760460a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5949225a72e649c1adc217d5a760460a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5949225a72e649c1adc217d5a760460a", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5949225a72e649c1adc217d5a760460a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersOnMultiNodesTest-954271111 Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 5949225a72e649c1adc217d5a760460a Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-954271111 Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersOnMultiNodesTest-954271111-project Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: dfc33eb8645248f9b154587e7d8d449e Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersOnMultiNodesTest-954271111-project Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 49cfca02-b968-45e0-9b31-404eded0c6d2 could not be found. Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '49cfca02-b968-45e0-9b31-404eded0c6d2'} Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49cfca02-b968-45e0-9b31-404eded0c6d2 could not be found. Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49cfca02-b968-45e0-9b31-404eded0c6d2 could not be found. Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:48.090323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:48.094917 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:48.094917 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:48.094917 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:48.094917 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:49:48.094917 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:49:48.094917 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49cfca02-b968-45e0-9b31-404eded0c6d2 could not be found. Sep 10 11:49:48.094917 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:48.094917 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9883ecb4-fb13-439a-a9d8-907f42e1195c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Returning 404 to user: Instance 49cfca02-b968-45e0-9b31-404eded0c6d2 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:49:48.094917 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9883ecb4-fb13-439a-a9d8-907f42e1195c tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/49cfca02-b968-45e0-9b31-404eded0c6d2" status: 404 len: 111 microversion: 2.1 time: 0.097255 Sep 10 11:49:48.098755 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1205/2489] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:47 2022] GET /compute/v2.1/servers/49cfca02-b968-45e0-9b31-404eded0c6d2 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:49:48.104267 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-592e9e44-9fc5-4579-bd8f-b5489ebacf3e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:48.109007 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-592e9e44-9fc5-4579-bd8f-b5489ebacf3e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:48.140464 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-592e9e44-9fc5-4579-bd8f-b5489ebacf3e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:48.144628 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-592e9e44-9fc5-4579-bd8f-b5489ebacf3e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:48.145955 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-592e9e44-9fc5-4579-bd8f-b5489ebacf3e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:48.148323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-592e9e44-9fc5-4579-bd8f-b5489ebacf3e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:48.149191 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-592e9e44-9fc5-4579-bd8f-b5489ebacf3e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:48.151425 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-592e9e44-9fc5-4579-bd8f-b5489ebacf3e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:48.379938 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-592e9e44-9fc5-4579-bd8f-b5489ebacf3e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:48.390159 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-592e9e44-9fc5-4579-bd8f-b5489ebacf3e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9" status: 200 len: 1324 microversion: 2.1 time: 0.289955 Sep 10 11:49:48.390740 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1206/2490] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:48 2022] GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 => generated 1324 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:48.402952 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-086c33c8-6e39-41d3-9b67-bd98ab79a141 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:48.407499 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-086c33c8-6e39-41d3-9b67-bd98ab79a141 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 785f3cc4-7418-4e67-b5e7-d37bb7a59919] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:48.414813 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0d5e49d4-fb44-48ce-adbf-536c9a80f665 tempest-SecurityGroupsNegativeTestJSON-668803644 tempest-SecurityGroupsNegativeTestJSON-668803644-project] Calling method '.version_select at 0x7f4073f61550>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:48.438441 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-086c33c8-6e39-41d3-9b67-bd98ab79a141 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:48.441468 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-086c33c8-6e39-41d3-9b67-bd98ab79a141 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:48.441951 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-086c33c8-6e39-41d3-9b67-bd98ab79a141 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:48.442696 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-086c33c8-6e39-41d3-9b67-bd98ab79a141 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:48.445640 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-086c33c8-6e39-41d3-9b67-bd98ab79a141 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:48.445640 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-086c33c8-6e39-41d3-9b67-bd98ab79a141 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:48.458794 n-d-856895-1 devstack@n-api.service[128777]: DEBUG neutronclient.v2_0.client [None req-0d5e49d4-fb44-48ce-adbf-536c9a80f665 tempest-SecurityGroupsNegativeTestJSON-668803644 tempest-SecurityGroupsNegativeTestJSON-668803644-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e771518c-ba1b-4f8f-b8d6-bab02cbbdb05 does not exist", "detail": ""}} {{(pid=128777) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 11:49:48.459441 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.security_group_api [None req-0d5e49d4-fb44-48ce-adbf-536c9a80f665 tempest-SecurityGroupsNegativeTestJSON-668803644 tempest-SecurityGroupsNegativeTestJSON-668803644-project] Neutron security group e771518c-ba1b-4f8f-b8d6-bab02cbbdb05 not found {{(pid=128777) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 11:49:48.459978 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-0d5e49d4-fb44-48ce-adbf-536c9a80f665 tempest-SecurityGroupsNegativeTestJSON-668803644 tempest-SecurityGroupsNegativeTestJSON-668803644-project] HTTP exception thrown: Security group e771518c-ba1b-4f8f-b8d6-bab02cbbdb05 does not exist Sep 10 11:49:48.459978 n-d-856895-1 devstack@n-api.service[128777]: Neutron server returns request_ids: ['req-88be9551-f78d-41d4-823c-519084230a61'] Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0d5e49d4-fb44-48ce-adbf-536c9a80f665 tempest-SecurityGroupsNegativeTestJSON-668803644 tempest-SecurityGroupsNegativeTestJSON-668803644-project] Request method failure captured: Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/os-security-groups/e771518c-ba1b-4f8f-b8d6-bab02cbbdb05 HTTP/1.1 Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHnb0Zb-1uaGacUz1rvPKGGUeZxL-lxyFzwTQeSBhpLSbxrCrqDMc-rKys66kHycTFBnEWLlbd8kz-eK3f_Q0aDKxW5fwN7G0gTjpdD6nx8foa89OXFmRL2xgl1GLEofh4GUwhKoTsxrR4HZ9BDRA0oQCdYhna9SH0rd6Y86guU4da8 Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 69ab1030dc404165996116368f0aabd7 Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-668803644 Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/69ab1030dc404165996116368f0aabd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/69ab1030dc404165996116368f0aabd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_69ab1030dc404165996116368f0aabd7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/69ab1030dc404165996116368f0aabd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-668803644 Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 69ab1030dc404165996116368f0aabd7 Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-668803644 Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-SecurityGroupsNegativeTestJSON-668803644-project Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 965e68060e1e404397f068f7442fcbfa Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-668803644-project Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: exception: Security group e771518c-ba1b-4f8f-b8d6-bab02cbbdb05 does not exist Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: Neutron server returns request_ids: ['req-88be9551-f78d-41d4-823c-519084230a61'] Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'e771518c-ba1b-4f8f-b8d6-bab02cbbdb05'} Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 11:49:48.461958 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e771518c-ba1b-4f8f-b8d6-bab02cbbdb05 does not exist Sep 10 11:49:48.465705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-88be9551-f78d-41d4-823c-519084230a61'] Sep 10 11:49:48.465705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:48.465705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:48.465705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:48.465705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:48.465705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 10 11:49:48.465705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 10 11:49:48.465705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 11:49:48.465705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 11:49:48.465705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e771518c-ba1b-4f8f-b8d6-bab02cbbdb05 does not exist Sep 10 11:49:48.465705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-88be9551-f78d-41d4-823c-519084230a61'] Sep 10 11:49:48.465705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:48.465705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:48.465705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:48.465705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:48.465705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:48.465705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:48.465705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:49:48.465705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:49:48.465705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:49:48.465705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:49:48.465705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:49:48.465705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:49:48.465705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 10 11:49:48.465705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 11:49:48.465705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e771518c-ba1b-4f8f-b8d6-bab02cbbdb05 does not exist Sep 10 11:49:48.465705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-88be9551-f78d-41d4-823c-519084230a61'] Sep 10 11:49:48.465705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:48.465705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:48.465705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:48.465705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:48.465705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:48.465705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:48.465705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:49:48.465705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:49:48.465705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e771518c-ba1b-4f8f-b8d6-bab02cbbdb05 does not exist Sep 10 11:49:48.465705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-88be9551-f78d-41d4-823c-519084230a61'] Sep 10 11:49:48.465705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:48.465705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0d5e49d4-fb44-48ce-adbf-536c9a80f665 tempest-SecurityGroupsNegativeTestJSON-668803644 tempest-SecurityGroupsNegativeTestJSON-668803644-project] Returning 404 to user: Security group e771518c-ba1b-4f8f-b8d6-bab02cbbdb05 does not exist Sep 10 11:49:48.465705 n-d-856895-1 devstack@n-api.service[128777]: Neutron server returns request_ids: ['req-88be9551-f78d-41d4-823c-519084230a61'] {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:49:48.465705 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0d5e49d4-fb44-48ce-adbf-536c9a80f665 tempest-SecurityGroupsNegativeTestJSON-668803644 tempest-SecurityGroupsNegativeTestJSON-668803644-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/e771518c-ba1b-4f8f-b8d6-bab02cbbdb05" status: 404 len: 194 microversion: 2.1 time: 0.527061 Sep 10 11:49:48.465705 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1285/2491] 10.222.0.23 () {58 vars in 1272 bytes} [Sat Sep 10 11:49:47 2022] DELETE /compute/v2.1/os-security-groups/e771518c-ba1b-4f8f-b8d6-bab02cbbdb05 => generated 194 bytes in 529 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:49:48.473300 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-086c33c8-6e39-41d3-9b67-bd98ab79a141 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] HTTP exception thrown: Instance 785f3cc4-7418-4e67-b5e7-d37bb7a59919 could not be found. Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-086c33c8-6e39-41d3-9b67-bd98ab79a141 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Request method failure captured: Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/785f3cc4-7418-4e67-b5e7-d37bb7a59919 HTTP/1.1 Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHkg-Zo7KMrfu0nNgLtrDU5lUnvDP6kvvcMZg2xisQhCM8eccKrdiLyTPHyzb6K9Q1ZiirRtqBOL4GZdbmmVvyNi0Bc3ugjMpJ_IDaF7uzu1phl69Zh6vFfvNF5AXJUQgKyEoKjCn57nwgkILaNwuhei0IBfr9Mbt-jkLsFVJEXAgCM Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 5949225a72e649c1adc217d5a760460a Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersOnMultiNodesTest-954271111 Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5949225a72e649c1adc217d5a760460a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5949225a72e649c1adc217d5a760460a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5949225a72e649c1adc217d5a760460a", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5949225a72e649c1adc217d5a760460a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersOnMultiNodesTest-954271111 Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 5949225a72e649c1adc217d5a760460a Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-954271111 Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersOnMultiNodesTest-954271111-project Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: dfc33eb8645248f9b154587e7d8d449e Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersOnMultiNodesTest-954271111-project Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 785f3cc4-7418-4e67-b5e7-d37bb7a59919 could not be found. Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '785f3cc4-7418-4e67-b5e7-d37bb7a59919'} Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 785f3cc4-7418-4e67-b5e7-d37bb7a59919 could not be found. Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 785f3cc4-7418-4e67-b5e7-d37bb7a59919 could not be found. Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:48.476096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:48.480787 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:48.480787 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:48.480787 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:48.480787 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:49:48.480787 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:49:48.480787 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 785f3cc4-7418-4e67-b5e7-d37bb7a59919 could not be found. Sep 10 11:49:48.480787 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:48.481308 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-339fa61e-864a-4326-ab47-1cacb5536336 tempest-SecurityGroupsNegativeTestJSON-668803644 tempest-SecurityGroupsNegativeTestJSON-668803644-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.005514 Sep 10 11:49:48.481308 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1286/2492] 10.222.0.23 () {58 vars in 1164 bytes} [Sat Sep 10 11:49:48 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 10 11:49:48.482798 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-086c33c8-6e39-41d3-9b67-bd98ab79a141 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Returning 404 to user: Instance 785f3cc4-7418-4e67-b5e7-d37bb7a59919 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:49:48.483896 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-086c33c8-6e39-41d3-9b67-bd98ab79a141 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/785f3cc4-7418-4e67-b5e7-d37bb7a59919" status: 404 len: 111 microversion: 2.1 time: 0.092207 Sep 10 11:49:48.484781 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1207/2493] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:48 2022] GET /compute/v2.1/servers/785f3cc4-7418-4e67-b5e7-d37bb7a59919 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:49:48.498568 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ed89577e-7c19-4daf-bb66-1a7ea26441dc tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:48.500671 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7de0aed1-c639-43f2-b4f9-c05ae7b66c83 tempest-SecurityGroupsNegativeTestJSON-668803644 tempest-SecurityGroupsNegativeTestJSON-668803644-project] Calling method '.version_select at 0x7f407b5aac10>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:48.550112 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ed89577e-7c19-4daf-bb66-1a7ea26441dc tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/cf98e173-04b2-4c6b-8f0c-384a6d2a36b1" status: 204 len: 0 microversion: 2.1 time: 0.056676 Sep 10 11:49:48.555380 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1208/2494] 10.222.0.23 () {58 vars in 1266 bytes} [Sat Sep 10 11:49:48 2022] DELETE /compute/v2.1/os-server-groups/cf98e173-04b2-4c6b-8f0c-384a6d2a36b1 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:49:48.561535 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-42682dc3-e9c0-4403-a21d-4fc0abb58230 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:48.562181 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-42682dc3-e9c0-4403-a21d-4fc0abb58230 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 2ab5ad80-d86c-44f1-870d-777d44fd340a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:48.570205 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42682dc3-e9c0-4403-a21d-4fc0abb58230 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:48.571310 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42682dc3-e9c0-4403-a21d-4fc0abb58230 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:48.572044 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42682dc3-e9c0-4403-a21d-4fc0abb58230 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:48.573024 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42682dc3-e9c0-4403-a21d-4fc0abb58230 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:48.573658 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42682dc3-e9c0-4403-a21d-4fc0abb58230 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:48.575626 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42682dc3-e9c0-4403-a21d-4fc0abb58230 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:48.610205 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-42682dc3-e9c0-4403-a21d-4fc0abb58230 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 2ab5ad80-d86c-44f1-870d-777d44fd340a] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:49:48.737859 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-42682dc3-e9c0-4403-a21d-4fc0abb58230 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2ab5ad80-d86c-44f1-870d-777d44fd340a" status: 204 len: 0 microversion: 2.1 time: 0.179950 Sep 10 11:49:48.739027 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1209/2495] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:49:48 2022] DELETE /compute/v2.1/servers/2ab5ad80-d86c-44f1-870d-777d44fd340a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:49:48.754149 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f188b4f2-528e-4b4e-a736-bcd407bd5508 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:48.756067 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f188b4f2-528e-4b4e-a736-bcd407bd5508 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] [instance: 6ebabc55-1b1d-4276-8bde-d8d4859d74fd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:48.769838 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f188b4f2-528e-4b4e-a736-bcd407bd5508 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:48.770619 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f188b4f2-528e-4b4e-a736-bcd407bd5508 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:48.771323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f188b4f2-528e-4b4e-a736-bcd407bd5508 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:48.776551 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f188b4f2-528e-4b4e-a736-bcd407bd5508 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:48.776551 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f188b4f2-528e-4b4e-a736-bcd407bd5508 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:48.777199 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f188b4f2-528e-4b4e-a736-bcd407bd5508 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:48.854490 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7de0aed1-c639-43f2-b4f9-c05ae7b66c83 tempest-SecurityGroupsNegativeTestJSON-668803644 tempest-SecurityGroupsNegativeTestJSON-668803644-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.370131 Sep 10 11:49:48.855436 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1287/2496] 10.222.0.23 () {58 vars in 1158 bytes} [Sat Sep 10 11:49:48 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:49:48.860005 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-f188b4f2-528e-4b4e-a736-bcd407bd5508 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] HTTP exception thrown: Instance 6ebabc55-1b1d-4276-8bde-d8d4859d74fd could not be found. Sep 10 11:49:48.860836 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7045100f-351d-480a-8b64-7627513c0fdd tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:48.861604 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7045100f-351d-480a-8b64-7627513c0fdd tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: f30dcd4e-f14f-4f37-bb07-05bafdff2bbb] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f188b4f2-528e-4b4e-a736-bcd407bd5508 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Request method failure captured: Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd HTTP/1.1 Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHlUSEZXtyk8wt2IG5Gw3xoPsFQQ66k7MWJCT0nHxXDu_h1Nx8nIr3NAf8F8RfftelzrNjcJ_HA8P90BGd4ENOKdNKh9XYufdp_lCwVQBwJIAinu7k6skBJ3AdQs8-mJIMn2ggmqhZG_QtrfslhxbA8TTage9VXqvSPZajqtr1ERn_c Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: d8f6657b05bd48edbe73282147feee78 Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersAdminTestJSON-186209642 Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d8f6657b05bd48edbe73282147feee78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d8f6657b05bd48edbe73282147feee78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d8f6657b05bd48edbe73282147feee78", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d8f6657b05bd48edbe73282147feee78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersAdminTestJSON-186209642 Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: d8f6657b05bd48edbe73282147feee78 Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersAdminTestJSON-186209642 Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersAdminTestJSON-186209642-project Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 221c7c18d84c400388bd95cf28cf3e1a Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersAdminTestJSON-186209642-project Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 6ebabc55-1b1d-4276-8bde-d8d4859d74fd could not be found. Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '6ebabc55-1b1d-4276-8bde-d8d4859d74fd'} Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ebabc55-1b1d-4276-8bde-d8d4859d74fd could not be found. Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ebabc55-1b1d-4276-8bde-d8d4859d74fd could not be found. Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:48.861875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:48.866664 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:48.866664 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:48.866664 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:48.866664 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:49:48.866664 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:49:48.866664 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ebabc55-1b1d-4276-8bde-d8d4859d74fd could not be found. Sep 10 11:49:48.866664 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:48.866664 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f188b4f2-528e-4b4e-a736-bcd407bd5508 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] Returning 404 to user: Instance 6ebabc55-1b1d-4276-8bde-d8d4859d74fd could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:49:48.866664 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f188b4f2-528e-4b4e-a736-bcd407bd5508 tempest-ServersAdminTestJSON-186209642 tempest-ServersAdminTestJSON-186209642-project] 10.222.0.23 "GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd" status: 404 len: 111 microversion: 2.1 time: 0.125689 Sep 10 11:49:48.870261 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1210/2497] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:48 2022] GET /compute/v2.1/servers/6ebabc55-1b1d-4276-8bde-d8d4859d74fd => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:49:48.875665 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7045100f-351d-480a-8b64-7627513c0fdd tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:48.876331 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7045100f-351d-480a-8b64-7627513c0fdd tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:48.877075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7045100f-351d-480a-8b64-7627513c0fdd tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:48.886189 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7045100f-351d-480a-8b64-7627513c0fdd tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:48.886952 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7045100f-351d-480a-8b64-7627513c0fdd tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:48.887609 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7045100f-351d-480a-8b64-7627513c0fdd tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:48.892481 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-caf48747-c9ed-47c2-9086-9f8034a44ccb tempest-SecurityGroupsNegativeTestJSON-668803644 tempest-SecurityGroupsNegativeTestJSON-668803644-project] Calling method '.version_select at 0x7f40733cb940>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:48.992935 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7045100f-351d-480a-8b64-7627513c0fdd tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: f30dcd4e-f14f-4f37-bb07-05bafdff2bbb] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:49:49.222791 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7045100f-351d-480a-8b64-7627513c0fdd tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f30dcd4e-f14f-4f37-bb07-05bafdff2bbb" status: 204 len: 0 microversion: 2.1 time: 0.365766 Sep 10 11:49:49.224257 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1288/2498] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:49:48 2022] DELETE /compute/v2.1/servers/f30dcd4e-f14f-4f37-bb07-05bafdff2bbb => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:49:49.234697 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e2102a95-9567-4d0f-a7c1-b5f2e7e7bbbd tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:49.239721 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e2102a95-9567-4d0f-a7c1-b5f2e7e7bbbd tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 2ab5ad80-d86c-44f1-870d-777d44fd340a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:49.254924 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e2102a95-9567-4d0f-a7c1-b5f2e7e7bbbd tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:49.255459 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e2102a95-9567-4d0f-a7c1-b5f2e7e7bbbd tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:49.261164 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e2102a95-9567-4d0f-a7c1-b5f2e7e7bbbd tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:49.261164 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e2102a95-9567-4d0f-a7c1-b5f2e7e7bbbd tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:49.262495 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e2102a95-9567-4d0f-a7c1-b5f2e7e7bbbd tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:49.263010 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e2102a95-9567-4d0f-a7c1-b5f2e7e7bbbd tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:49.314052 n-d-856895-1 devstack@n-api.service[128776]: DEBUG neutronclient.v2_0.client [None req-caf48747-c9ed-47c2-9086-9f8034a44ccb tempest-SecurityGroupsNegativeTestJSON-668803644 tempest-SecurityGroupsNegativeTestJSON-668803644-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=128776) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 11:49:49.314806 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-caf48747-c9ed-47c2-9086-9f8034a44ccb tempest-SecurityGroupsNegativeTestJSON-668803644 tempest-SecurityGroupsNegativeTestJSON-668803644-project] HTTP exception thrown: Insufficient rights for removing default security group. Sep 10 11:49:49.314806 n-d-856895-1 devstack@n-api.service[128776]: Neutron server returns request_ids: ['req-a32b83b0-34c8-4ee2-bf7b-45fa388685f7'] Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-caf48747-c9ed-47c2-9086-9f8034a44ccb tempest-SecurityGroupsNegativeTestJSON-668803644 tempest-SecurityGroupsNegativeTestJSON-668803644-project] Request method failure captured: Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/os-security-groups/34970d0d-1ba6-44a6-90aa-109e7aa2beb1 HTTP/1.1 Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHnb0Zb-1uaGacUz1rvPKGGUeZxL-lxyFzwTQeSBhpLSbxrCrqDMc-rKys66kHycTFBnEWLlbd8kz-eK3f_Q0aDKxW5fwN7G0gTjpdD6nx8foa89OXFmRL2xgl1GLEofh4GUwhKoTsxrR4HZ9BDRA0oQCdYhna9SH0rd6Y86guU4da8 Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 69ab1030dc404165996116368f0aabd7 Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-668803644 Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/69ab1030dc404165996116368f0aabd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/69ab1030dc404165996116368f0aabd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_69ab1030dc404165996116368f0aabd7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/69ab1030dc404165996116368f0aabd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-668803644 Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 69ab1030dc404165996116368f0aabd7 Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-668803644 Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-SecurityGroupsNegativeTestJSON-668803644-project Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 965e68060e1e404397f068f7442fcbfa Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-668803644-project Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: exception: Insufficient rights for removing default security group. Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: Neutron server returns request_ids: ['req-a32b83b0-34c8-4ee2-bf7b-45fa388685f7'] Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '34970d0d-1ba6-44a6-90aa-109e7aa2beb1'} Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 11:49:49.317913 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Sep 10 11:49:49.321924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a32b83b0-34c8-4ee2-bf7b-45fa388685f7'] Sep 10 11:49:49.321924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:49.321924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:49.321924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:49.321924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:49.321924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 10 11:49:49.321924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 10 11:49:49.321924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 10 11:49:49.321924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 10 11:49:49.321924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Sep 10 11:49:49.321924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a32b83b0-34c8-4ee2-bf7b-45fa388685f7'] Sep 10 11:49:49.321924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:49.321924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:49.321924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:49.321924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:49.321924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:49.321924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:49.321924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:49:49.321924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:49:49.321924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:49:49.321924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:49:49.321924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:49:49.321924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:49:49.321924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 10 11:49:49.321924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 10 11:49:49.321924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Sep 10 11:49:49.321924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a32b83b0-34c8-4ee2-bf7b-45fa388685f7'] Sep 10 11:49:49.321924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:49.321924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:49.321924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:49.321924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:49.321924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:49.321924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:49.321924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:49:49.321924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:49:49.321924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Sep 10 11:49:49.321924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a32b83b0-34c8-4ee2-bf7b-45fa388685f7'] Sep 10 11:49:49.321924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:49.321924 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-caf48747-c9ed-47c2-9086-9f8034a44ccb tempest-SecurityGroupsNegativeTestJSON-668803644 tempest-SecurityGroupsNegativeTestJSON-668803644-project] Returning 400 to user: Insufficient rights for removing default security group. Sep 10 11:49:49.321924 n-d-856895-1 devstack@n-api.service[128776]: Neutron server returns request_ids: ['req-a32b83b0-34c8-4ee2-bf7b-45fa388685f7'] {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:49:49.321924 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-caf48747-c9ed-47c2-9086-9f8034a44ccb tempest-SecurityGroupsNegativeTestJSON-668803644 tempest-SecurityGroupsNegativeTestJSON-668803644-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/34970d0d-1ba6-44a6-90aa-109e7aa2beb1" status: 400 len: 182 microversion: 2.1 time: 0.448973 Sep 10 11:49:49.326752 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1211/2499] 10.222.0.23 () {58 vars in 1272 bytes} [Sat Sep 10 11:49:48 2022] DELETE /compute/v2.1/os-security-groups/34970d0d-1ba6-44a6-90aa-109e7aa2beb1 => generated 182 bytes in 459 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:49:49.348173 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b4642772-52b9-4a2f-84cd-e05f6bee2fb4 tempest-SecurityGroupsNegativeTestJSON-668803644 tempest-SecurityGroupsNegativeTestJSON-668803644-project] Calling method '.version_select at 0x7f4073567e50>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:49.415414 n-d-856895-1 devstack@n-api.service[128776]: DEBUG neutronclient.v2_0.client [None req-b4642772-52b9-4a2f-84cd-e05f6bee2fb4 tempest-SecurityGroupsNegativeTestJSON-668803644 tempest-SecurityGroupsNegativeTestJSON-668803644-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b608d1cb-df7e-4385-b5fb-e92499b58be8 does not exist", "detail": ""}} {{(pid=128776) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 11:49:49.416130 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.security_group_api [None req-b4642772-52b9-4a2f-84cd-e05f6bee2fb4 tempest-SecurityGroupsNegativeTestJSON-668803644 tempest-SecurityGroupsNegativeTestJSON-668803644-project] Neutron security group b608d1cb-df7e-4385-b5fb-e92499b58be8 not found {{(pid=128776) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 11:49:49.416656 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-b4642772-52b9-4a2f-84cd-e05f6bee2fb4 tempest-SecurityGroupsNegativeTestJSON-668803644 tempest-SecurityGroupsNegativeTestJSON-668803644-project] HTTP exception thrown: Security group b608d1cb-df7e-4385-b5fb-e92499b58be8 does not exist Sep 10 11:49:49.416656 n-d-856895-1 devstack@n-api.service[128776]: Neutron server returns request_ids: ['req-ea03d83c-2626-4504-b288-6a4991e5c60d'] Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b4642772-52b9-4a2f-84cd-e05f6bee2fb4 tempest-SecurityGroupsNegativeTestJSON-668803644 tempest-SecurityGroupsNegativeTestJSON-668803644-project] Request method failure captured: Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/os-security-groups/b608d1cb-df7e-4385-b5fb-e92499b58be8 HTTP/1.1 Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHnb0Zb-1uaGacUz1rvPKGGUeZxL-lxyFzwTQeSBhpLSbxrCrqDMc-rKys66kHycTFBnEWLlbd8kz-eK3f_Q0aDKxW5fwN7G0gTjpdD6nx8foa89OXFmRL2xgl1GLEofh4GUwhKoTsxrR4HZ9BDRA0oQCdYhna9SH0rd6Y86guU4da8 Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 69ab1030dc404165996116368f0aabd7 Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-668803644 Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/69ab1030dc404165996116368f0aabd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/69ab1030dc404165996116368f0aabd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_69ab1030dc404165996116368f0aabd7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/69ab1030dc404165996116368f0aabd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-668803644 Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 69ab1030dc404165996116368f0aabd7 Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-668803644 Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-SecurityGroupsNegativeTestJSON-668803644-project Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 965e68060e1e404397f068f7442fcbfa Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-668803644-project Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: exception: Security group b608d1cb-df7e-4385-b5fb-e92499b58be8 does not exist Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: Neutron server returns request_ids: ['req-ea03d83c-2626-4504-b288-6a4991e5c60d'] Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'b608d1cb-df7e-4385-b5fb-e92499b58be8'} Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 11:49:49.419946 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b608d1cb-df7e-4385-b5fb-e92499b58be8 does not exist Sep 10 11:49:49.425215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea03d83c-2626-4504-b288-6a4991e5c60d'] Sep 10 11:49:49.425215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:49.425215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:49.425215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:49.425215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:49.425215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 10 11:49:49.425215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 10 11:49:49.425215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 11:49:49.425215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 11:49:49.425215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b608d1cb-df7e-4385-b5fb-e92499b58be8 does not exist Sep 10 11:49:49.425215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea03d83c-2626-4504-b288-6a4991e5c60d'] Sep 10 11:49:49.425215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:49.425215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:49.425215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:49.425215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:49.425215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:49.425215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:49.425215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:49:49.425215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:49:49.425215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:49:49.425215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:49:49.425215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:49:49.425215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:49:49.425215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 10 11:49:49.425215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 11:49:49.425215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b608d1cb-df7e-4385-b5fb-e92499b58be8 does not exist Sep 10 11:49:49.425215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea03d83c-2626-4504-b288-6a4991e5c60d'] Sep 10 11:49:49.425215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:49.425215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:49.425215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:49.425215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:49.425215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:49.425215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:49.425215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:49:49.425215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:49:49.425215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b608d1cb-df7e-4385-b5fb-e92499b58be8 does not exist Sep 10 11:49:49.425215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea03d83c-2626-4504-b288-6a4991e5c60d'] Sep 10 11:49:49.425215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:49.430048 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b4642772-52b9-4a2f-84cd-e05f6bee2fb4 tempest-SecurityGroupsNegativeTestJSON-668803644 tempest-SecurityGroupsNegativeTestJSON-668803644-project] Returning 404 to user: Security group b608d1cb-df7e-4385-b5fb-e92499b58be8 does not exist Sep 10 11:49:49.430048 n-d-856895-1 devstack@n-api.service[128776]: Neutron server returns request_ids: ['req-ea03d83c-2626-4504-b288-6a4991e5c60d'] {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:49:49.431491 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b4642772-52b9-4a2f-84cd-e05f6bee2fb4 tempest-SecurityGroupsNegativeTestJSON-668803644 tempest-SecurityGroupsNegativeTestJSON-668803644-project] 10.222.0.23 "GET /compute/v2.1/os-security-groups/b608d1cb-df7e-4385-b5fb-e92499b58be8" status: 404 len: 194 microversion: 2.1 time: 0.103568 Sep 10 11:49:49.432237 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1212/2500] 10.222.0.23 () {58 vars in 1269 bytes} [Sat Sep 10 11:49:49 2022] GET /compute/v2.1/os-security-groups/b608d1cb-df7e-4385-b5fb-e92499b58be8 => generated 194 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:49:49.446233 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-27b0b3b8-3bc4-4672-9e78-8a38ae3172b4 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:49.447499 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-27b0b3b8-3bc4-4672-9e78-8a38ae3172b4 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:49.466845 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27b0b3b8-3bc4-4672-9e78-8a38ae3172b4 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:49.467840 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27b0b3b8-3bc4-4672-9e78-8a38ae3172b4 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:49.471441 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27b0b3b8-3bc4-4672-9e78-8a38ae3172b4 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:49.473660 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27b0b3b8-3bc4-4672-9e78-8a38ae3172b4 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:49.478640 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27b0b3b8-3bc4-4672-9e78-8a38ae3172b4 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:49.479288 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27b0b3b8-3bc4-4672-9e78-8a38ae3172b4 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:49.641288 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e2102a95-9567-4d0f-a7c1-b5f2e7e7bbbd tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:49.656619 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e2102a95-9567-4d0f-a7c1-b5f2e7e7bbbd tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/2ab5ad80-d86c-44f1-870d-777d44fd340a" status: 200 len: 1475 microversion: 2.1 time: 0.426349 Sep 10 11:49:49.657504 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1289/2501] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:49 2022] GET /compute/v2.1/servers/2ab5ad80-d86c-44f1-870d-777d44fd340a => generated 1475 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:49.686033 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7660c6f4-4af0-4263-a150-10c923adbbdb tempest-SecurityGroupsNegativeTestJSON-668803644 tempest-SecurityGroupsNegativeTestJSON-668803644-project] Action: 'update', calling method: .version_select at 0x7f4073179940>, body: {"security_group": {"name": "tempest-sg-151723863", "description": "tempest-description-1981936634"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:49.737237 n-d-856895-1 devstack@n-api.service[128777]: DEBUG neutronclient.v2_0.client [None req-7660c6f4-4af0-4263-a150-10c923adbbdb tempest-SecurityGroupsNegativeTestJSON-668803644 tempest-SecurityGroupsNegativeTestJSON-668803644-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 62a19949-0086-4ba7-abe0-8f75f9012341 does not exist", "detail": ""}} {{(pid=128777) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 10 11:49:49.738406 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.security_group_api [None req-7660c6f4-4af0-4263-a150-10c923adbbdb tempest-SecurityGroupsNegativeTestJSON-668803644 tempest-SecurityGroupsNegativeTestJSON-668803644-project] Neutron security group 62a19949-0086-4ba7-abe0-8f75f9012341 not found {{(pid=128777) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 10 11:49:49.739296 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-7660c6f4-4af0-4263-a150-10c923adbbdb tempest-SecurityGroupsNegativeTestJSON-668803644 tempest-SecurityGroupsNegativeTestJSON-668803644-project] HTTP exception thrown: Security group 62a19949-0086-4ba7-abe0-8f75f9012341 does not exist Sep 10 11:49:49.739296 n-d-856895-1 devstack@n-api.service[128777]: Neutron server returns request_ids: ['req-c6bd88b4-94bf-4024-92ae-cc9a3eea43da'] Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7660c6f4-4af0-4263-a150-10c923adbbdb tempest-SecurityGroupsNegativeTestJSON-668803644 tempest-SecurityGroupsNegativeTestJSON-668803644-project] Request method failure captured: Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: request: PUT /compute/v2.1/os-security-groups/62a19949-0086-4ba7-abe0-8f75f9012341 HTTP/1.1 Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 101 Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHnb0Zb-1uaGacUz1rvPKGGUeZxL-lxyFzwTQeSBhpLSbxrCrqDMc-rKys66kHycTFBnEWLlbd8kz-eK3f_Q0aDKxW5fwN7G0gTjpdD6nx8foa89OXFmRL2xgl1GLEofh4GUwhKoTsxrR4HZ9BDRA0oQCdYhna9SH0rd6Y86guU4da8 Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 69ab1030dc404165996116368f0aabd7 Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-668803644 Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/69ab1030dc404165996116368f0aabd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/69ab1030dc404165996116368f0aabd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_69ab1030dc404165996116368f0aabd7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/69ab1030dc404165996116368f0aabd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-668803644 Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 69ab1030dc404165996116368f0aabd7 Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-668803644 Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-SecurityGroupsNegativeTestJSON-668803644-project Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 965e68060e1e404397f068f7442fcbfa Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-668803644-project Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: {"security_group": {"name": "tempest-sg-151723863", "description": "tempest-description-1981936634"}} Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: exception: Security group 62a19949-0086-4ba7-abe0-8f75f9012341 does not exist Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: Neutron server returns request_ids: ['req-c6bd88b4-94bf-4024-92ae-cc9a3eea43da'] Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '62a19949-0086-4ba7-abe0-8f75f9012341', 'body': {'security_group': {'name': 'tempest-sg-151723863', 'description': 'tempest-description-1981936634'}}} Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 10 11:49:49.743071 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 10 11:49:49.747195 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 10 11:49:49.747195 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 62a19949-0086-4ba7-abe0-8f75f9012341 does not exist Sep 10 11:49:49.747195 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6bd88b4-94bf-4024-92ae-cc9a3eea43da'] Sep 10 11:49:49.747195 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:49.747195 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:49.747195 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:49.747195 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:49.747195 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Sep 10 11:49:49.747195 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 10 11:49:49.747195 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 10 11:49:49.747195 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 11:49:49.747195 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 62a19949-0086-4ba7-abe0-8f75f9012341 does not exist Sep 10 11:49:49.747195 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6bd88b4-94bf-4024-92ae-cc9a3eea43da'] Sep 10 11:49:49.747195 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:49.747195 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:49.747195 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:49.747195 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:49.747195 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:49.747195 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:49.747195 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:49:49.747195 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:49:49.747195 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:49:49.747195 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:49:49.747195 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:49:49.747195 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:49:49.747195 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Sep 10 11:49:49.747195 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 10 11:49:49.747195 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 62a19949-0086-4ba7-abe0-8f75f9012341 does not exist Sep 10 11:49:49.747195 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6bd88b4-94bf-4024-92ae-cc9a3eea43da'] Sep 10 11:49:49.747195 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:49.747195 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:49.747195 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:49.747195 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:49.747195 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:49.747195 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:49.747195 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:49:49.747195 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:49:49.747195 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 62a19949-0086-4ba7-abe0-8f75f9012341 does not exist Sep 10 11:49:49.747195 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6bd88b4-94bf-4024-92ae-cc9a3eea43da'] Sep 10 11:49:49.747195 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:49.754128 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7660c6f4-4af0-4263-a150-10c923adbbdb tempest-SecurityGroupsNegativeTestJSON-668803644 tempest-SecurityGroupsNegativeTestJSON-668803644-project] Returning 404 to user: Security group 62a19949-0086-4ba7-abe0-8f75f9012341 does not exist Sep 10 11:49:49.754128 n-d-856895-1 devstack@n-api.service[128777]: Neutron server returns request_ids: ['req-c6bd88b4-94bf-4024-92ae-cc9a3eea43da'] {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:49:49.755458 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7660c6f4-4af0-4263-a150-10c923adbbdb tempest-SecurityGroupsNegativeTestJSON-668803644 tempest-SecurityGroupsNegativeTestJSON-668803644-project] 10.222.0.23 "PUT /compute/v2.1/os-security-groups/62a19949-0086-4ba7-abe0-8f75f9012341" status: 404 len: 194 microversion: 2.1 time: 0.079062 Sep 10 11:49:49.759031 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1290/2502] 10.222.0.23 () {60 vars in 1290 bytes} [Sat Sep 10 11:49:49 2022] PUT /compute/v2.1/os-security-groups/62a19949-0086-4ba7-abe0-8f75f9012341 => generated 194 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:49:49.774626 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-fd6b142f-d536-48ec-889c-1d0058ff215d req-daebf340-292d-4598-9a69-bcc8bdcee5b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9", "name": "network-vif-plugged", "status": "completed", "tag": "865e5e79-8273-4141-b596-7fb63328b234"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:49.803254 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-fd6b142f-d536-48ec-889c-1d0058ff215d req-daebf340-292d-4598-9a69-bcc8bdcee5b3 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:49.804133 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-fd6b142f-d536-48ec-889c-1d0058ff215d req-daebf340-292d-4598-9a69-bcc8bdcee5b3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:49.804953 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-fd6b142f-d536-48ec-889c-1d0058ff215d req-daebf340-292d-4598-9a69-bcc8bdcee5b3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:49.818396 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-fd6b142f-d536-48ec-889c-1d0058ff215d req-daebf340-292d-4598-9a69-bcc8bdcee5b3 service nova] Creating event network-vif-plugged:865e5e79-8273-4141-b596-7fb63328b234 for instance c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 on n-h2-856895-1 Sep 10 11:49:49.825614 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-fd6b142f-d536-48ec-889c-1d0058ff215d req-daebf340-292d-4598-9a69-bcc8bdcee5b3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064982 Sep 10 11:49:49.827151 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1291/2503] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:49:50.105663 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-27b0b3b8-3bc4-4672-9e78-8a38ae3172b4 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:50.118934 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-27b0b3b8-3bc4-4672-9e78-8a38ae3172b4 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9" status: 200 len: 1324 microversion: 2.1 time: 0.677658 Sep 10 11:49:50.121313 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1213/2504] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:49 2022] GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 => generated 1324 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:50.687225 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bb37a70a-f57a-4c21-9abf-961ae839f2bb tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:50.688606 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bb37a70a-f57a-4c21-9abf-961ae839f2bb tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 2ab5ad80-d86c-44f1-870d-777d44fd340a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:50.717363 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bb37a70a-f57a-4c21-9abf-961ae839f2bb tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:50.718379 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bb37a70a-f57a-4c21-9abf-961ae839f2bb tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:50.719024 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bb37a70a-f57a-4c21-9abf-961ae839f2bb tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:50.720001 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bb37a70a-f57a-4c21-9abf-961ae839f2bb tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:50.720678 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bb37a70a-f57a-4c21-9abf-961ae839f2bb tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:50.721681 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bb37a70a-f57a-4c21-9abf-961ae839f2bb tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:51.143351 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c2f6ec1f-6861-49f9-b238-f2ceeeedd219 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:51.144175 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c2f6ec1f-6861-49f9-b238-f2ceeeedd219 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:51.154327 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c2f6ec1f-6861-49f9-b238-f2ceeeedd219 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:51.154833 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c2f6ec1f-6861-49f9-b238-f2ceeeedd219 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:51.166064 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c2f6ec1f-6861-49f9-b238-f2ceeeedd219 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:51.174937 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c2f6ec1f-6861-49f9-b238-f2ceeeedd219 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:51.176455 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c2f6ec1f-6861-49f9-b238-f2ceeeedd219 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:51.177085 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c2f6ec1f-6861-49f9-b238-f2ceeeedd219 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:51.591325 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bb37a70a-f57a-4c21-9abf-961ae839f2bb tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:51.602232 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bb37a70a-f57a-4c21-9abf-961ae839f2bb tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/2ab5ad80-d86c-44f1-870d-777d44fd340a" status: 200 len: 1475 microversion: 2.1 time: 0.921272 Sep 10 11:49:51.615705 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1292/2505] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:50 2022] GET /compute/v2.1/servers/2ab5ad80-d86c-44f1-870d-777d44fd340a => generated 1475 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:51.850610 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c2f6ec1f-6861-49f9-b238-f2ceeeedd219 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:51.870780 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c2f6ec1f-6861-49f9-b238-f2ceeeedd219 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9" status: 200 len: 1324 microversion: 2.1 time: 0.727958 Sep 10 11:49:51.872347 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1214/2506] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:51 2022] GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 => generated 1324 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:52.628427 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-295af6c3-df48-4f27-841b-ae98176176b4 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:52.629306 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-295af6c3-df48-4f27-841b-ae98176176b4 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 2ab5ad80-d86c-44f1-870d-777d44fd340a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:52.643402 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-295af6c3-df48-4f27-841b-ae98176176b4 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:52.648610 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-295af6c3-df48-4f27-841b-ae98176176b4 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:52.649412 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-295af6c3-df48-4f27-841b-ae98176176b4 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:52.650568 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-295af6c3-df48-4f27-841b-ae98176176b4 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:52.651337 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-295af6c3-df48-4f27-841b-ae98176176b4 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:52.652102 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-295af6c3-df48-4f27-841b-ae98176176b4 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:52.670088 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-e82c1def-3d1f-4e64-afa3-3e171dddb81d req-7f698abf-bbe9-485e-abb4-fd7addf48ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f30dcd4e-f14f-4f37-bb07-05bafdff2bbb", "name": "network-vif-deleted", "tag": "ed9ab511-09d7-41ab-a241-008569856ae1"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:52.686382 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e82c1def-3d1f-4e64-afa3-3e171dddb81d req-7f698abf-bbe9-485e-abb4-fd7addf48ea9 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:52.687525 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e82c1def-3d1f-4e64-afa3-3e171dddb81d req-7f698abf-bbe9-485e-abb4-fd7addf48ea9 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:52.688174 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e82c1def-3d1f-4e64-afa3-3e171dddb81d req-7f698abf-bbe9-485e-abb4-fd7addf48ea9 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:52.721035 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-e82c1def-3d1f-4e64-afa3-3e171dddb81d req-7f698abf-bbe9-485e-abb4-fd7addf48ea9 service nova] Creating event network-vif-deleted:ed9ab511-09d7-41ab-a241-008569856ae1 for instance f30dcd4e-f14f-4f37-bb07-05bafdff2bbb on n-h2-856895-1 Sep 10 11:49:52.727987 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-e82c1def-3d1f-4e64-afa3-3e171dddb81d req-7f698abf-bbe9-485e-abb4-fd7addf48ea9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076780 Sep 10 11:49:52.729866 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1215/2507] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:49:52.901219 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9c01a5d3-78e7-4da9-856c-c4b27a932e2e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:52.902948 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9c01a5d3-78e7-4da9-856c-c4b27a932e2e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:52.924069 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c01a5d3-78e7-4da9-856c-c4b27a932e2e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:52.924908 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c01a5d3-78e7-4da9-856c-c4b27a932e2e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:52.925972 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c01a5d3-78e7-4da9-856c-c4b27a932e2e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:52.934653 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c01a5d3-78e7-4da9-856c-c4b27a932e2e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:52.938339 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c01a5d3-78e7-4da9-856c-c4b27a932e2e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:52.940304 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c01a5d3-78e7-4da9-856c-c4b27a932e2e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:52.941328 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-295af6c3-df48-4f27-841b-ae98176176b4 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:52.950683 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-295af6c3-df48-4f27-841b-ae98176176b4 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/2ab5ad80-d86c-44f1-870d-777d44fd340a" status: 200 len: 1475 microversion: 2.1 time: 0.326980 Sep 10 11:49:52.952032 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1293/2508] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:52 2022] GET /compute/v2.1/servers/2ab5ad80-d86c-44f1-870d-777d44fd340a => generated 1475 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:53.425100 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-44a6e783-43be-48ff-81be-692bcb44be33 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:53.428375 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-44a6e783-43be-48ff-81be-692bcb44be33 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:53.435918 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-44a6e783-43be-48ff-81be-692bcb44be33 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:53.440728 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-44a6e783-43be-48ff-81be-692bcb44be33 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:53.441205 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-44a6e783-43be-48ff-81be-692bcb44be33 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:53.442138 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-44a6e783-43be-48ff-81be-692bcb44be33 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:53.442776 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-44a6e783-43be-48ff-81be-692bcb44be33 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:53.446659 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-44a6e783-43be-48ff-81be-692bcb44be33 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:53.477036 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-44a6e783-43be-48ff-81be-692bcb44be33 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] HTTP exception thrown: Instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a could not be found. Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-44a6e783-43be-48ff-81be-692bcb44be33 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Request method failure captured: Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a HTTP/1.1 Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHgjOBfFfsseIGUp5n47Ik5-xGH5Pfq18YBHxBsPAEXnSTz3mSn11b45c-LfxzrqnY8NIh9Uopc30hZOWzfLMQmYOA0abVHwApxPLTEeBspm8q58-8aK_1FhvTFK0XvJPXkNcDUm395E_WXzCBZXVkRi-GelqGBAERuxKb2Mzys2DKw Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: X-Openstack-Nova-Api-Version: 2.42 Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 125ad66541dd4acdb35af09b28001e39 Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1953745739 Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/125ad66541dd4acdb35af09b28001e39"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/125ad66541dd4acdb35af09b28001e39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_125ad66541dd4acdb35af09b28001e39", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/125ad66541dd4acdb35af09b28001e39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1953745739 Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 125ad66541dd4acdb35af09b28001e39 Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1953745739 Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-TaggedBootDevicesTest_v242-1953745739-project Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 07d1c7718856439a8e76ed07ca5278b8 Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1953745739-project Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a could not be found. Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a'} Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a could not be found. Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:49:53.479030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:49:53.488558 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a could not be found. Sep 10 11:49:53.488558 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:53.488558 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:53.488558 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:53.488558 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:53.488558 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:53.488558 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:53.488558 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:49:53.488558 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:49:53.488558 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a could not be found. Sep 10 11:49:53.488558 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:53.488558 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-44a6e783-43be-48ff-81be-692bcb44be33 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Returning 404 to user: Instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:49:53.488558 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-44a6e783-43be-48ff-81be-692bcb44be33 tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 404 len: 111 microversion: 2.42 time: 0.068058 Sep 10 11:49:53.488558 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1294/2509] 10.222.0.23 () {60 vars in 1280 bytes} [Sat Sep 10 11:49:53 2022] DELETE /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:49:53.488558 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-668eacd7-f0f7-48f4-9194-1c51d34a4645 req-2aafb84c-c95e-4a00-b29d-e60c3ce2e57f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ab5ad80-d86c-44f1-870d-777d44fd340a", "name": "network-vif-deleted", "tag": "a16a30e4-67d2-4203-af44-c01e5a7af9b6"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:53.497792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-668eacd7-f0f7-48f4-9194-1c51d34a4645 req-2aafb84c-c95e-4a00-b29d-e60c3ce2e57f service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:53.498624 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-668eacd7-f0f7-48f4-9194-1c51d34a4645 req-2aafb84c-c95e-4a00-b29d-e60c3ce2e57f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:53.499356 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-668eacd7-f0f7-48f4-9194-1c51d34a4645 req-2aafb84c-c95e-4a00-b29d-e60c3ce2e57f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:53.512761 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-668eacd7-f0f7-48f4-9194-1c51d34a4645 req-2aafb84c-c95e-4a00-b29d-e60c3ce2e57f service nova] Creating event network-vif-deleted:a16a30e4-67d2-4203-af44-c01e5a7af9b6 for instance 2ab5ad80-d86c-44f1-870d-777d44fd340a on n-h2-856895-1 Sep 10 11:49:53.519899 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-668eacd7-f0f7-48f4-9194-1c51d34a4645 req-2aafb84c-c95e-4a00-b29d-e60c3ce2e57f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036219 Sep 10 11:49:53.525325 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1295/2510] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:49:53.531990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-49999b46-bed5-4bbf-8691-3785304b00cd tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:53.532708 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-49999b46-bed5-4bbf-8691-3785304b00cd tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] [instance: ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:53.543065 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-49999b46-bed5-4bbf-8691-3785304b00cd tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:53.543484 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-49999b46-bed5-4bbf-8691-3785304b00cd tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:53.543923 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-49999b46-bed5-4bbf-8691-3785304b00cd tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:53.544966 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-49999b46-bed5-4bbf-8691-3785304b00cd tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:53.545632 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-49999b46-bed5-4bbf-8691-3785304b00cd tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:53.546547 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-49999b46-bed5-4bbf-8691-3785304b00cd tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:53.575900 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-49999b46-bed5-4bbf-8691-3785304b00cd tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] HTTP exception thrown: Instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a could not be found. Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-49999b46-bed5-4bbf-8691-3785304b00cd tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Request method failure captured: Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a HTTP/1.1 Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHgjOBfFfsseIGUp5n47Ik5-xGH5Pfq18YBHxBsPAEXnSTz3mSn11b45c-LfxzrqnY8NIh9Uopc30hZOWzfLMQmYOA0abVHwApxPLTEeBspm8q58-8aK_1FhvTFK0XvJPXkNcDUm395E_WXzCBZXVkRi-GelqGBAERuxKb2Mzys2DKw Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: X-Openstack-Nova-Api-Version: 2.42 Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 125ad66541dd4acdb35af09b28001e39 Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1953745739 Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/125ad66541dd4acdb35af09b28001e39"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/125ad66541dd4acdb35af09b28001e39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_125ad66541dd4acdb35af09b28001e39", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/125ad66541dd4acdb35af09b28001e39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1953745739 Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 125ad66541dd4acdb35af09b28001e39 Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1953745739 Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-TaggedBootDevicesTest_v242-1953745739-project Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 07d1c7718856439a8e76ed07ca5278b8 Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1953745739-project Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a could not be found. Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a'} Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a could not be found. Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a could not be found. Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:53.578447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:53.583054 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:53.583054 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:53.583054 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:53.583054 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:53.583054 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:49:53.583054 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:49:53.583054 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a could not be found. Sep 10 11:49:53.583054 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:53.591354 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-49999b46-bed5-4bbf-8691-3785304b00cd tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] Returning 404 to user: Instance ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:49:53.592255 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-49999b46-bed5-4bbf-8691-3785304b00cd tempest-TaggedBootDevicesTest_v242-1953745739 tempest-TaggedBootDevicesTest_v242-1953745739-project] 10.222.0.23 "GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a" status: 404 len: 111 microversion: 2.42 time: 0.065408 Sep 10 11:49:53.593101 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1296/2511] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:49:53 2022] GET /compute/v2.1/servers/ff555e1f-7ed9-48c1-97e4-8bc40ce4ad6a => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:49:53.607437 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9c01a5d3-78e7-4da9-856c-c4b27a932e2e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:53.620442 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9c01a5d3-78e7-4da9-856c-c4b27a932e2e tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9" status: 200 len: 1324 microversion: 2.1 time: 0.728890 Sep 10 11:49:53.621050 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1216/2512] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:52 2022] GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 => generated 1324 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:49:53.983537 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b61b1107-212e-46d9-9479-b1bd8a75025b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:53.984958 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b61b1107-212e-46d9-9479-b1bd8a75025b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 2ab5ad80-d86c-44f1-870d-777d44fd340a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:54.013433 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b61b1107-212e-46d9-9479-b1bd8a75025b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:54.016346 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b61b1107-212e-46d9-9479-b1bd8a75025b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:54.018554 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b61b1107-212e-46d9-9479-b1bd8a75025b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:54.025453 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b61b1107-212e-46d9-9479-b1bd8a75025b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:54.029765 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b61b1107-212e-46d9-9479-b1bd8a75025b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:54.030528 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b61b1107-212e-46d9-9479-b1bd8a75025b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:54.146061 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b61b1107-212e-46d9-9479-b1bd8a75025b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:54.146524 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b61b1107-212e-46d9-9479-b1bd8a75025b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:54.147738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b61b1107-212e-46d9-9479-b1bd8a75025b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:54.148594 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-b61b1107-212e-46d9-9479-b1bd8a75025b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lazy-loading 'fault' on Instance uuid 2ab5ad80-d86c-44f1-870d-777d44fd340a {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:49:54.343391 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b61b1107-212e-46d9-9479-b1bd8a75025b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:54.359914 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b61b1107-212e-46d9-9479-b1bd8a75025b tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/2ab5ad80-d86c-44f1-870d-777d44fd340a" status: 200 len: 1309 microversion: 2.1 time: 0.383267 Sep 10 11:49:54.360823 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1297/2513] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:53 2022] GET /compute/v2.1/servers/2ab5ad80-d86c-44f1-870d-777d44fd340a => generated 1309 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:54.654330 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-98437bcd-7ab5-423e-86fd-20b5bcda320b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:54.655692 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-98437bcd-7ab5-423e-86fd-20b5bcda320b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:54.670926 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-98437bcd-7ab5-423e-86fd-20b5bcda320b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:54.671622 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-98437bcd-7ab5-423e-86fd-20b5bcda320b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:54.672081 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-98437bcd-7ab5-423e-86fd-20b5bcda320b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:54.681295 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-98437bcd-7ab5-423e-86fd-20b5bcda320b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:54.681900 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-98437bcd-7ab5-423e-86fd-20b5bcda320b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:54.682459 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-98437bcd-7ab5-423e-86fd-20b5bcda320b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:54.945215 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-98437bcd-7ab5-423e-86fd-20b5bcda320b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:54.958067 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-98437bcd-7ab5-423e-86fd-20b5bcda320b tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9" status: 200 len: 1520 microversion: 2.1 time: 0.311682 Sep 10 11:49:54.959446 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1217/2514] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:54 2022] GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 => generated 1520 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:54.989382 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-faa7cf2e-b49c-41a9-be3c-e99ff346d386 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:54.990075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-faa7cf2e-b49c-41a9-be3c-e99ff346d386 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:55.009947 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-faa7cf2e-b49c-41a9-be3c-e99ff346d386 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:55.010918 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-faa7cf2e-b49c-41a9-be3c-e99ff346d386 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:55.012120 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-faa7cf2e-b49c-41a9-be3c-e99ff346d386 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:55.013713 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-faa7cf2e-b49c-41a9-be3c-e99ff346d386 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:55.014626 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-faa7cf2e-b49c-41a9-be3c-e99ff346d386 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:55.016588 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-faa7cf2e-b49c-41a9-be3c-e99ff346d386 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:55.388643 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-faa7cf2e-b49c-41a9-be3c-e99ff346d386 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:55.394121 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c48c024a-7519-4077-b7fe-228adb56829f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:55.396845 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c48c024a-7519-4077-b7fe-228adb56829f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: 2ab5ad80-d86c-44f1-870d-777d44fd340a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:55.412153 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-faa7cf2e-b49c-41a9-be3c-e99ff346d386 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9" status: 200 len: 1520 microversion: 2.1 time: 0.427987 Sep 10 11:49:55.415039 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1298/2515] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:54 2022] GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 => generated 1520 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:55.420227 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c48c024a-7519-4077-b7fe-228adb56829f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:55.428967 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c48c024a-7519-4077-b7fe-228adb56829f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:55.432629 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c48c024a-7519-4077-b7fe-228adb56829f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:55.433765 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c48c024a-7519-4077-b7fe-228adb56829f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:55.434623 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c48c024a-7519-4077-b7fe-228adb56829f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:55.435338 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c48c024a-7519-4077-b7fe-228adb56829f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:55.436213 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1b053a7f-0233-45c3-8688-5d9f756540c9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-943505024"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:55.438849 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1b053a7f-0233-45c3-8688-5d9f756540c9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:55.465134 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-c48c024a-7519-4077-b7fe-228adb56829f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] HTTP exception thrown: Instance 2ab5ad80-d86c-44f1-870d-777d44fd340a could not be found. Sep 10 11:49:55.465497 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b053a7f-0233-45c3-8688-5d9f756540c9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:55.466183 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b053a7f-0233-45c3-8688-5d9f756540c9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:55.466812 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b053a7f-0233-45c3-8688-5d9f756540c9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:55.468012 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b053a7f-0233-45c3-8688-5d9f756540c9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:55.468644 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b053a7f-0233-45c3-8688-5d9f756540c9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:55.469313 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b053a7f-0233-45c3-8688-5d9f756540c9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c48c024a-7519-4077-b7fe-228adb56829f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Request method failure captured: Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/2ab5ad80-d86c-44f1-870d-777d44fd340a HTTP/1.1 Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHkg-Zo7KMrfu0nNgLtrDU5lUnvDP6kvvcMZg2xisQhCM8eccKrdiLyTPHyzb6K9Q1ZiirRtqBOL4GZdbmmVvyNi0Bc3ugjMpJ_IDaF7uzu1phl69Zh6vFfvNF5AXJUQgKyEoKjCn57nwgkILaNwuhei0IBfr9Mbt-jkLsFVJEXAgCM Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 5949225a72e649c1adc217d5a760460a Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersOnMultiNodesTest-954271111 Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5949225a72e649c1adc217d5a760460a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5949225a72e649c1adc217d5a760460a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5949225a72e649c1adc217d5a760460a", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5949225a72e649c1adc217d5a760460a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersOnMultiNodesTest-954271111 Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 5949225a72e649c1adc217d5a760460a Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-954271111 Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersOnMultiNodesTest-954271111-project Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: dfc33eb8645248f9b154587e7d8d449e Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersOnMultiNodesTest-954271111-project Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 2ab5ad80-d86c-44f1-870d-777d44fd340a could not be found. Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '2ab5ad80-d86c-44f1-870d-777d44fd340a'} Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ab5ad80-d86c-44f1-870d-777d44fd340a could not be found. Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ab5ad80-d86c-44f1-870d-777d44fd340a could not be found. Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:55.473123 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:55.477448 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:55.477448 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:55.477448 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:55.477448 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:49:55.477448 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:49:55.477448 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ab5ad80-d86c-44f1-870d-777d44fd340a could not be found. Sep 10 11:49:55.477448 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:55.477448 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c48c024a-7519-4077-b7fe-228adb56829f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Returning 404 to user: Instance 2ab5ad80-d86c-44f1-870d-777d44fd340a could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:49:55.477448 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c48c024a-7519-4077-b7fe-228adb56829f tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/2ab5ad80-d86c-44f1-870d-777d44fd340a" status: 404 len: 111 microversion: 2.1 time: 0.094319 Sep 10 11:49:55.479541 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1218/2516] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:55 2022] GET /compute/v2.1/servers/2ab5ad80-d86c-44f1-870d-777d44fd340a => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:49:55.499273 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a565d427-4c1c-4edb-82e0-bb2c21847727 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:55.500332 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a565d427-4c1c-4edb-82e0-bb2c21847727 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: f30dcd4e-f14f-4f37-bb07-05bafdff2bbb] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:55.507890 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a565d427-4c1c-4edb-82e0-bb2c21847727 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:55.508386 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a565d427-4c1c-4edb-82e0-bb2c21847727 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:55.508834 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a565d427-4c1c-4edb-82e0-bb2c21847727 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:55.509558 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a565d427-4c1c-4edb-82e0-bb2c21847727 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:55.510206 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a565d427-4c1c-4edb-82e0-bb2c21847727 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:55.510649 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a565d427-4c1c-4edb-82e0-bb2c21847727 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:55.529716 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-a565d427-4c1c-4edb-82e0-bb2c21847727 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] HTTP exception thrown: Instance f30dcd4e-f14f-4f37-bb07-05bafdff2bbb could not be found. Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a565d427-4c1c-4edb-82e0-bb2c21847727 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Request method failure captured: Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/f30dcd4e-f14f-4f37-bb07-05bafdff2bbb HTTP/1.1 Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHkg-Zo7KMrfu0nNgLtrDU5lUnvDP6kvvcMZg2xisQhCM8eccKrdiLyTPHyzb6K9Q1ZiirRtqBOL4GZdbmmVvyNi0Bc3ugjMpJ_IDaF7uzu1phl69Zh6vFfvNF5AXJUQgKyEoKjCn57nwgkILaNwuhei0IBfr9Mbt-jkLsFVJEXAgCM Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 5949225a72e649c1adc217d5a760460a Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersOnMultiNodesTest-954271111 Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5949225a72e649c1adc217d5a760460a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5949225a72e649c1adc217d5a760460a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5949225a72e649c1adc217d5a760460a", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5949225a72e649c1adc217d5a760460a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersOnMultiNodesTest-954271111 Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 5949225a72e649c1adc217d5a760460a Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-954271111 Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersOnMultiNodesTest-954271111-project Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: dfc33eb8645248f9b154587e7d8d449e Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersOnMultiNodesTest-954271111-project Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance f30dcd4e-f14f-4f37-bb07-05bafdff2bbb could not be found. Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'f30dcd4e-f14f-4f37-bb07-05bafdff2bbb'} Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f30dcd4e-f14f-4f37-bb07-05bafdff2bbb could not be found. Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f30dcd4e-f14f-4f37-bb07-05bafdff2bbb could not be found. Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:55.537265 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:55.541435 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:55.541435 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:55.541435 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:55.541435 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:49:55.541435 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:49:55.541435 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f30dcd4e-f14f-4f37-bb07-05bafdff2bbb could not be found. Sep 10 11:49:55.541435 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:49:55.543778 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a565d427-4c1c-4edb-82e0-bb2c21847727 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Returning 404 to user: Instance f30dcd4e-f14f-4f37-bb07-05bafdff2bbb could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:49:55.545549 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a565d427-4c1c-4edb-82e0-bb2c21847727 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/f30dcd4e-f14f-4f37-bb07-05bafdff2bbb" status: 404 len: 111 microversion: 2.1 time: 0.064586 Sep 10 11:49:55.551883 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1219/2517] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:55 2022] GET /compute/v2.1/servers/f30dcd4e-f14f-4f37-bb07-05bafdff2bbb => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:49:55.557737 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c29ad544-c7d8-4d75-af74-ad9ff00ad8c8 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:55.627907 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c29ad544-c7d8-4d75-af74-ad9ff00ad8c8 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/c7729ba4-e702-4dcf-91a2-344963012fce" status: 204 len: 0 microversion: 2.1 time: 0.073973 Sep 10 11:49:55.632351 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1220/2518] 10.222.0.23 () {58 vars in 1266 bytes} [Sat Sep 10 11:49:55 2022] DELETE /compute/v2.1/os-server-groups/c7729ba4-e702-4dcf-91a2-344963012fce => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:49:55.641070 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-90dac421-33c4-4c63-ba0c-3a72a3437fcb tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:55.642715 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-90dac421-33c4-4c63-ba0c-3a72a3437fcb tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d89db381-1e9d-40ee-b076-b024d38d38b1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:55.662741 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90dac421-33c4-4c63-ba0c-3a72a3437fcb tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:55.668185 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90dac421-33c4-4c63-ba0c-3a72a3437fcb tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:55.668988 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90dac421-33c4-4c63-ba0c-3a72a3437fcb tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:55.670302 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90dac421-33c4-4c63-ba0c-3a72a3437fcb tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:55.671628 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90dac421-33c4-4c63-ba0c-3a72a3437fcb tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:55.672403 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90dac421-33c4-4c63-ba0c-3a72a3437fcb tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:55.739374 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-90dac421-33c4-4c63-ba0c-3a72a3437fcb tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d89db381-1e9d-40ee-b076-b024d38d38b1] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:49:55.894038 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1b053a7f-0233-45c3-8688-5d9f756540c9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "POST /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9/action" status: 202 len: 0 microversion: 2.1 time: 0.460926 Sep 10 11:49:55.894679 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1299/2519] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:49:55 2022] POST /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9/action => generated 0 bytes in 463 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Sep 10 11:49:55.900777 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:49:55.922479 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-017dae70-fd96-4ac1-a708-c0ec16e7cec3 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '.version_select at 0x7f4073eab790>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:55.950050 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-90dac421-33c4-4c63-ba0c-3a72a3437fcb tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1" status: 204 len: 0 microversion: 2.1 time: 0.316097 Sep 10 11:49:55.953158 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1221/2520] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:49:55 2022] DELETE /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:49:55.978535 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-08a329b7-5d67-46d4-b577-41cb527a509d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:55.979465 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-08a329b7-5d67-46d4-b577-41cb527a509d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d89db381-1e9d-40ee-b076-b024d38d38b1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:55.994955 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-08a329b7-5d67-46d4-b577-41cb527a509d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:55.995291 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-08a329b7-5d67-46d4-b577-41cb527a509d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:55.995744 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-08a329b7-5d67-46d4-b577-41cb527a509d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:55.996472 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-08a329b7-5d67-46d4-b577-41cb527a509d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:55.996941 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-08a329b7-5d67-46d4-b577-41cb527a509d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:55.999085 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-08a329b7-5d67-46d4-b577-41cb527a509d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:56.308331 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-017dae70-fd96-4ac1-a708-c0ec16e7cec3 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "DELETE /compute/v2.1/images/0f669b7b-f0c5-47b3-8bd6-6abb3653f288" status: 204 len: 0 microversion: 2.1 time: 0.404499 Sep 10 11:49:56.311206 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1300/2521] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:55 2022] DELETE /compute/v2.1/images/0f669b7b-f0c5-47b3-8bd6-6abb3653f288 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:49:56.319724 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7d2d2372-d047-46fa-bbbd-fb925ffff66c tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '.version_select at 0x7f407358a0d0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:56.364635 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-7d2d2372-d047-46fa-bbbd-fb925ffff66c tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] HTTP exception thrown: Image not found. Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7d2d2372-d047-46fa-bbbd-fb925ffff66c tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Request method failure captured: Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/images/0f669b7b-f0c5-47b3-8bd6-6abb3653f288 HTTP/1.1 Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHmIwAMwYRG5GoKY2e2BrHSNWC_XC8Dle2TjpsTglJZLl4iDdUWRHXObue6CBNwrU7ByI06vvCBASR59oLGdEXbdGMvKthtN9mtTXSrKa2RC4WmIF4PSo8bwMo95sbb-sIH1rhBMLrXpSep-X_LgFDTkeIXb7VSYHefdo66ew2GGhFc Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 3e5d376048de4c3191a58a547e05fd07 Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1177602115 Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3e5d376048de4c3191a58a547e05fd07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3e5d376048de4c3191a58a547e05fd07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3e5d376048de4c3191a58a547e05fd07", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3e5d376048de4c3191a58a547e05fd07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1177602115 Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 3e5d376048de4c3191a58a547e05fd07 Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1177602115 Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ImagesOneServerNegativeTestJSON-1177602115-project Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 8ced1e84956246b6bb7384ba484fde54 Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1177602115-project Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: exception: Image not found. Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '0f669b7b-f0c5-47b3-8bd6-6abb3653f288'} Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0f669b7b-f0c5-47b3-8bd6-6abb3653f288 Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 10 11:49:56.366775 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0f669b7b-f0c5-47b3-8bd6-6abb3653f288 could not be found. Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7d2d2372-d047-46fa-bbbd-fb925ffff66c tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Returning 404 to user: Image not found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:49:56.370752 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7d2d2372-d047-46fa-bbbd-fb925ffff66c tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/images/0f669b7b-f0c5-47b3-8bd6-6abb3653f288" status: 404 len: 62 microversion: 2.1 time: 0.055139 Sep 10 11:49:56.381326 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1301/2522] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:49:56 2022] GET /compute/v2.1/images/0f669b7b-f0c5-47b3-8bd6-6abb3653f288 => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:49:56.381768 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-08a329b7-5d67-46d4-b577-41cb527a509d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:56.392058 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-08a329b7-5d67-46d4-b577-41cb527a509d tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1" status: 200 len: 1472 microversion: 2.1 time: 0.433369 Sep 10 11:49:56.395790 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1222/2523] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:55 2022] GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1 => generated 1472 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:56.400198 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-17eb6e6c-3a1f-400b-adba-8561799197ff tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:56.401056 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-17eb6e6c-3a1f-400b-adba-8561799197ff tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:56.415436 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17eb6e6c-3a1f-400b-adba-8561799197ff tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:56.415985 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17eb6e6c-3a1f-400b-adba-8561799197ff tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:56.416648 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17eb6e6c-3a1f-400b-adba-8561799197ff tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:56.417719 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17eb6e6c-3a1f-400b-adba-8561799197ff tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:56.418443 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17eb6e6c-3a1f-400b-adba-8561799197ff tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:56.419052 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17eb6e6c-3a1f-400b-adba-8561799197ff tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:56.640586 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-17eb6e6c-3a1f-400b-adba-8561799197ff tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:56.662752 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-17eb6e6c-3a1f-400b-adba-8561799197ff tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9" status: 200 len: 1532 microversion: 2.1 time: 0.288477 Sep 10 11:49:56.664073 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1302/2524] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:56 2022] GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 => generated 1532 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:56.861438 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a4da18bd-12ed-4db5-a7a7-a4af84827680 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-370690752", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": "none"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:56.961485 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-a4da18bd-12ed-4db5-a7a7-a4af84827680 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:49:56.961917 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-a4da18bd-12ed-4db5-a7a7-a4af84827680 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:49:56.962452 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-a4da18bd-12ed-4db5-a7a7-a4af84827680 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:49:56.962870 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-a4da18bd-12ed-4db5-a7a7-a4af84827680 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:49:56.963334 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-a4da18bd-12ed-4db5-a7a7-a4af84827680 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:49:56.974233 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a4da18bd-12ed-4db5-a7a7-a4af84827680 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:56.974731 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a4da18bd-12ed-4db5-a7a7-a4af84827680 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:56.975242 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a4da18bd-12ed-4db5-a7a7-a4af84827680 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:56.976159 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a4da18bd-12ed-4db5-a7a7-a4af84827680 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:56.976774 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a4da18bd-12ed-4db5-a7a7-a4af84827680 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:56.977390 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a4da18bd-12ed-4db5-a7a7-a4af84827680 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:56.999458 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-a4da18bd-12ed-4db5-a7a7-a4af84827680 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Getting quotas for project c22723baa90a4f1580169a60f93d6664. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:49:57.006596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-a4da18bd-12ed-4db5-a7a7-a4af84827680 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Getting quotas for user d1a99070e3b84f1eb90288db5aaea482 and project c22723baa90a4f1580169a60f93d6664. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:49:57.043760 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a4da18bd-12ed-4db5-a7a7-a4af84827680 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:49:57.048972 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a4da18bd-12ed-4db5-a7a7-a4af84827680 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:49:57.121266 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a4da18bd-12ed-4db5-a7a7-a4af84827680 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.720567 Sep 10 11:49:57.122571 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1223/2525] 10.222.0.23 () {62 vars in 1188 bytes} [Sat Sep 10 11:49:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 10 11:49:57.141287 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c4d0b53b-154b-40d1-932b-d6967d31b146 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:57.141919 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c4d0b53b-154b-40d1-932b-d6967d31b146 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:57.294645 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c4d0b53b-154b-40d1-932b-d6967d31b146 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:57.304811 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c4d0b53b-154b-40d1-932b-d6967d31b146 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:57.309279 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c4d0b53b-154b-40d1-932b-d6967d31b146 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:57.328396 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c4d0b53b-154b-40d1-932b-d6967d31b146 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1452 microversion: 2.91 time: 0.191915 Sep 10 11:49:57.332695 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1303/2526] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:49:57 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1452 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:49:57.422234 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-03f9a2ca-a17c-42a9-94ca-474a08210bbf tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:57.422942 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-03f9a2ca-a17c-42a9-94ca-474a08210bbf tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d89db381-1e9d-40ee-b076-b024d38d38b1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:57.439043 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-03f9a2ca-a17c-42a9-94ca-474a08210bbf tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:57.439648 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-03f9a2ca-a17c-42a9-94ca-474a08210bbf tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:57.440944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-03f9a2ca-a17c-42a9-94ca-474a08210bbf tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:57.441755 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-03f9a2ca-a17c-42a9-94ca-474a08210bbf tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:57.447465 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-03f9a2ca-a17c-42a9-94ca-474a08210bbf tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:57.447924 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-03f9a2ca-a17c-42a9-94ca-474a08210bbf tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:57.491594 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:49:57.687970 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e5aa3785-8de1-4c1d-8910-9bc42161623c tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:57.688592 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e5aa3785-8de1-4c1d-8910-9bc42161623c tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:57.696975 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e5aa3785-8de1-4c1d-8910-9bc42161623c tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:57.697708 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e5aa3785-8de1-4c1d-8910-9bc42161623c tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:57.698561 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-03f9a2ca-a17c-42a9-94ca-474a08210bbf tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:57.698888 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e5aa3785-8de1-4c1d-8910-9bc42161623c tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:57.699963 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e5aa3785-8de1-4c1d-8910-9bc42161623c tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:57.700832 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e5aa3785-8de1-4c1d-8910-9bc42161623c tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:57.701479 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e5aa3785-8de1-4c1d-8910-9bc42161623c tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:57.715933 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-03f9a2ca-a17c-42a9-94ca-474a08210bbf tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1" status: 200 len: 1472 microversion: 2.1 time: 0.297460 Sep 10 11:49:57.729205 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:49:57.738804 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1224/2527] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:57 2022] GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1 => generated 1472 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:57.940208 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e5aa3785-8de1-4c1d-8910-9bc42161623c tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:57.949348 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e5aa3785-8de1-4c1d-8910-9bc42161623c tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9" status: 200 len: 1538 microversion: 2.1 time: 0.265839 Sep 10 11:49:57.950288 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1304/2528] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:57 2022] GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 => generated 1538 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:49:58.368240 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-af4bffaf-8afa-4209-a8ea-c030e54ffd10 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:58.369402 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-af4bffaf-8afa-4209-a8ea-c030e54ffd10 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:58.416962 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af4bffaf-8afa-4209-a8ea-c030e54ffd10 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:58.417474 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af4bffaf-8afa-4209-a8ea-c030e54ffd10 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:58.422784 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af4bffaf-8afa-4209-a8ea-c030e54ffd10 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:58.426424 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af4bffaf-8afa-4209-a8ea-c030e54ffd10 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:58.426927 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af4bffaf-8afa-4209-a8ea-c030e54ffd10 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:58.431853 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af4bffaf-8afa-4209-a8ea-c030e54ffd10 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:58.567318 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-af4bffaf-8afa-4209-a8ea-c030e54ffd10 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:58.578423 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-af4bffaf-8afa-4209-a8ea-c030e54ffd10 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:58.582446 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-af4bffaf-8afa-4209-a8ea-c030e54ffd10 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:58.616086 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-af4bffaf-8afa-4209-a8ea-c030e54ffd10 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1504 microversion: 2.91 time: 0.253451 Sep 10 11:49:58.618388 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1225/2529] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:49:58 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1504 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:49:58.719020 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-df5eaacd-d959-466e-b1a6-26c11fbc2eb5 req-119460be-505f-4cda-8c23-9d94062c97cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d89db381-1e9d-40ee-b076-b024d38d38b1", "name": "network-vif-deleted", "tag": "d154c601-3089-464e-a0a5-7d00211e395b"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:49:58.741953 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-df5eaacd-d959-466e-b1a6-26c11fbc2eb5 req-119460be-505f-4cda-8c23-9d94062c97cf service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:58.743026 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-df5eaacd-d959-466e-b1a6-26c11fbc2eb5 req-119460be-505f-4cda-8c23-9d94062c97cf service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:58.743887 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-df5eaacd-d959-466e-b1a6-26c11fbc2eb5 req-119460be-505f-4cda-8c23-9d94062c97cf service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:58.748525 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b9a158fa-4222-4509-999e-b945cc6f5f88 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:58.749854 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b9a158fa-4222-4509-999e-b945cc6f5f88 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d89db381-1e9d-40ee-b076-b024d38d38b1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:58.760968 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-df5eaacd-d959-466e-b1a6-26c11fbc2eb5 req-119460be-505f-4cda-8c23-9d94062c97cf service nova] Creating event network-vif-deleted:d154c601-3089-464e-a0a5-7d00211e395b for instance d89db381-1e9d-40ee-b076-b024d38d38b1 on n-h1-856895-1 Sep 10 11:49:58.769959 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9a158fa-4222-4509-999e-b945cc6f5f88 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:58.770373 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9a158fa-4222-4509-999e-b945cc6f5f88 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:58.770826 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9a158fa-4222-4509-999e-b945cc6f5f88 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:58.771921 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9a158fa-4222-4509-999e-b945cc6f5f88 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:58.772024 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-df5eaacd-d959-466e-b1a6-26c11fbc2eb5 req-119460be-505f-4cda-8c23-9d94062c97cf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057058 Sep 10 11:49:58.772116 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9a158fa-4222-4509-999e-b945cc6f5f88 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:58.772455 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9a158fa-4222-4509-999e-b945cc6f5f88 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:58.811577 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1305/2530] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:49:58.851586 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b9a158fa-4222-4509-999e-b945cc6f5f88 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc33eb8645248f9b154587e7d8d449e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5949225a72e649c1adc217d5a760460a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:58.861312 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b9a158fa-4222-4509-999e-b945cc6f5f88 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1" status: 200 len: 1301 microversion: 2.1 time: 0.120382 Sep 10 11:49:58.863353 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1226/2531] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:58 2022] GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1 => generated 1301 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:49:58.985479 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-84add24a-5773-49db-94f0-555e3f99ab09 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:58.987382 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-84add24a-5773-49db-94f0-555e3f99ab09 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:58.996516 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-84add24a-5773-49db-94f0-555e3f99ab09 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:58.997703 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-84add24a-5773-49db-94f0-555e3f99ab09 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:58.998645 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-84add24a-5773-49db-94f0-555e3f99ab09 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:58.999876 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-84add24a-5773-49db-94f0-555e3f99ab09 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:59.000706 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-84add24a-5773-49db-94f0-555e3f99ab09 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:59.001578 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-84add24a-5773-49db-94f0-555e3f99ab09 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:59.305460 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-84add24a-5773-49db-94f0-555e3f99ab09 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:59.321300 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-84add24a-5773-49db-94f0-555e3f99ab09 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9" status: 200 len: 1533 microversion: 2.1 time: 0.344337 Sep 10 11:49:59.322251 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1306/2532] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:58 2022] GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 => generated 1533 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:49:59.652144 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-991952b2-a2c1-40a2-8537-321f0985d646 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:59.652770 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-991952b2-a2c1-40a2-8537-321f0985d646 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:59.671616 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-991952b2-a2c1-40a2-8537-321f0985d646 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:59.672351 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-991952b2-a2c1-40a2-8537-321f0985d646 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:59.672988 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-991952b2-a2c1-40a2-8537-321f0985d646 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:59.674521 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-991952b2-a2c1-40a2-8537-321f0985d646 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:59.675365 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-991952b2-a2c1-40a2-8537-321f0985d646 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:59.675970 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-991952b2-a2c1-40a2-8537-321f0985d646 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:59.769480 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-991952b2-a2c1-40a2-8537-321f0985d646 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:59.779445 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-991952b2-a2c1-40a2-8537-321f0985d646 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:59.780918 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-991952b2-a2c1-40a2-8537-321f0985d646 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:49:59.788745 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-991952b2-a2c1-40a2-8537-321f0985d646 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1510 microversion: 2.91 time: 0.140798 Sep 10 11:49:59.790053 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1227/2533] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:49:59 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1510 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:49:59.888889 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9a218a50-1934-4eba-98a4-fd0879d7d4d4 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:49:59.890039 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9a218a50-1934-4eba-98a4-fd0879d7d4d4 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] [instance: d89db381-1e9d-40ee-b076-b024d38d38b1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:49:59.900156 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9a218a50-1934-4eba-98a4-fd0879d7d4d4 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:59.900987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9a218a50-1934-4eba-98a4-fd0879d7d4d4 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:59.901693 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9a218a50-1934-4eba-98a4-fd0879d7d4d4 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:59.902857 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9a218a50-1934-4eba-98a4-fd0879d7d4d4 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:49:59.903692 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9a218a50-1934-4eba-98a4-fd0879d7d4d4 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:49:59.904300 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9a218a50-1934-4eba-98a4-fd0879d7d4d4 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:49:59.922214 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-9a218a50-1934-4eba-98a4-fd0879d7d4d4 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] HTTP exception thrown: Instance d89db381-1e9d-40ee-b076-b024d38d38b1 could not be found. Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9a218a50-1934-4eba-98a4-fd0879d7d4d4 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Request method failure captured: Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1 HTTP/1.1 Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHkg-Zo7KMrfu0nNgLtrDU5lUnvDP6kvvcMZg2xisQhCM8eccKrdiLyTPHyzb6K9Q1ZiirRtqBOL4GZdbmmVvyNi0Bc3ugjMpJ_IDaF7uzu1phl69Zh6vFfvNF5AXJUQgKyEoKjCn57nwgkILaNwuhei0IBfr9Mbt-jkLsFVJEXAgCM Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 5949225a72e649c1adc217d5a760460a Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersOnMultiNodesTest-954271111 Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5949225a72e649c1adc217d5a760460a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5949225a72e649c1adc217d5a760460a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5949225a72e649c1adc217d5a760460a", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5949225a72e649c1adc217d5a760460a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersOnMultiNodesTest-954271111 Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 5949225a72e649c1adc217d5a760460a Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-954271111 Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersOnMultiNodesTest-954271111-project Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: dfc33eb8645248f9b154587e7d8d449e Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersOnMultiNodesTest-954271111-project Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance d89db381-1e9d-40ee-b076-b024d38d38b1 could not be found. Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'd89db381-1e9d-40ee-b076-b024d38d38b1'} Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d89db381-1e9d-40ee-b076-b024d38d38b1 could not be found. Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d89db381-1e9d-40ee-b076-b024d38d38b1 could not be found. Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:49:59.924886 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:59.929527 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:49:59.929527 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:49:59.929527 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:49:59.929527 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:49:59.929527 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:49:59.929527 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d89db381-1e9d-40ee-b076-b024d38d38b1 could not be found. Sep 10 11:49:59.929527 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:49:59.930972 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9a218a50-1934-4eba-98a4-fd0879d7d4d4 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] Returning 404 to user: Instance d89db381-1e9d-40ee-b076-b024d38d38b1 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:49:59.932193 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9a218a50-1934-4eba-98a4-fd0879d7d4d4 tempest-ServersOnMultiNodesTest-954271111 tempest-ServersOnMultiNodesTest-954271111-project] 10.222.0.23 "GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1" status: 404 len: 111 microversion: 2.1 time: 0.048106 Sep 10 11:49:59.932931 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1307/2534] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:49:59 2022] GET /compute/v2.1/servers/d89db381-1e9d-40ee-b076-b024d38d38b1 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:50:00.345469 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f61ca3c5-0f34-4a68-a53e-1f2f95719064 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:00.346671 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f61ca3c5-0f34-4a68-a53e-1f2f95719064 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:00.362840 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f61ca3c5-0f34-4a68-a53e-1f2f95719064 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:00.363403 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f61ca3c5-0f34-4a68-a53e-1f2f95719064 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:00.363861 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f61ca3c5-0f34-4a68-a53e-1f2f95719064 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:00.364604 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f61ca3c5-0f34-4a68-a53e-1f2f95719064 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:00.365074 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f61ca3c5-0f34-4a68-a53e-1f2f95719064 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:00.365510 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f61ca3c5-0f34-4a68-a53e-1f2f95719064 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:00.790000 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f61ca3c5-0f34-4a68-a53e-1f2f95719064 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:00.804867 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f61ca3c5-0f34-4a68-a53e-1f2f95719064 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9" status: 200 len: 1520 microversion: 2.1 time: 0.463548 Sep 10 11:50:00.808149 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1228/2535] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:00 2022] GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 => generated 1520 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:00.827549 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-11c340e2-71e4-4150-9846-f54bdb69b5d7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:00.828590 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-11c340e2-71e4-4150-9846-f54bdb69b5d7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:00.837373 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e774849d-87b8-4276-a51f-d17fb60505f8 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:00.837886 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e774849d-87b8-4276-a51f-d17fb60505f8 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:00.839443 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-11c340e2-71e4-4150-9846-f54bdb69b5d7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:00.840067 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-11c340e2-71e4-4150-9846-f54bdb69b5d7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:00.843717 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-11c340e2-71e4-4150-9846-f54bdb69b5d7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:00.844784 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-11c340e2-71e4-4150-9846-f54bdb69b5d7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:00.845427 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-11c340e2-71e4-4150-9846-f54bdb69b5d7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:00.846620 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-11c340e2-71e4-4150-9846-f54bdb69b5d7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:00.849832 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e774849d-87b8-4276-a51f-d17fb60505f8 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:00.856733 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e774849d-87b8-4276-a51f-d17fb60505f8 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:00.857310 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e774849d-87b8-4276-a51f-d17fb60505f8 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:00.862036 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e774849d-87b8-4276-a51f-d17fb60505f8 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:00.865505 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e774849d-87b8-4276-a51f-d17fb60505f8 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:00.866561 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e774849d-87b8-4276-a51f-d17fb60505f8 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:00.954318 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e774849d-87b8-4276-a51f-d17fb60505f8 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:50:00.997736 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-11c340e2-71e4-4150-9846-f54bdb69b5d7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:01.017091 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-11c340e2-71e4-4150-9846-f54bdb69b5d7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:01.020995 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-11c340e2-71e4-4150-9846-f54bdb69b5d7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:01.030989 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-11c340e2-71e4-4150-9846-f54bdb69b5d7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1510 microversion: 2.91 time: 0.216485 Sep 10 11:50:01.032452 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1308/2536] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:00 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1510 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:01.150390 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e774849d-87b8-4276-a51f-d17fb60505f8 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9" status: 204 len: 0 microversion: 2.1 time: 0.317327 Sep 10 11:50:01.151377 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1229/2537] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:50:00 2022] DELETE /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 11:50:01.160761 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-64d70d25-519f-4fa9-a28d-ce297dcb62e8 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:01.162344 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-64d70d25-519f-4fa9-a28d-ce297dcb62e8 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:01.175366 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-64d70d25-519f-4fa9-a28d-ce297dcb62e8 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:01.176206 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-64d70d25-519f-4fa9-a28d-ce297dcb62e8 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:01.176883 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-64d70d25-519f-4fa9-a28d-ce297dcb62e8 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:01.177738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-64d70d25-519f-4fa9-a28d-ce297dcb62e8 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:01.181011 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-64d70d25-519f-4fa9-a28d-ce297dcb62e8 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:01.181560 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-64d70d25-519f-4fa9-a28d-ce297dcb62e8 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:01.407316 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-64d70d25-519f-4fa9-a28d-ce297dcb62e8 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:01.428961 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-64d70d25-519f-4fa9-a28d-ce297dcb62e8 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9" status: 200 len: 1526 microversion: 2.1 time: 0.272023 Sep 10 11:50:01.431340 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1309/2538] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:01 2022] GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 => generated 1526 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:02.066237 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ed18abc3-8a13-47cb-827b-b6844544b072 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:02.066962 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ed18abc3-8a13-47cb-827b-b6844544b072 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:02.075119 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed18abc3-8a13-47cb-827b-b6844544b072 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:02.075918 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed18abc3-8a13-47cb-827b-b6844544b072 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:02.076735 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed18abc3-8a13-47cb-827b-b6844544b072 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:02.077693 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed18abc3-8a13-47cb-827b-b6844544b072 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:02.078501 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed18abc3-8a13-47cb-827b-b6844544b072 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:02.079201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed18abc3-8a13-47cb-827b-b6844544b072 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:02.247722 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ed18abc3-8a13-47cb-827b-b6844544b072 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:02.258587 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ed18abc3-8a13-47cb-827b-b6844544b072 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:02.262595 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ed18abc3-8a13-47cb-827b-b6844544b072 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:02.275277 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ed18abc3-8a13-47cb-827b-b6844544b072 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1510 microversion: 2.91 time: 0.214220 Sep 10 11:50:02.276102 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1230/2539] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:02 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1510 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:02.458886 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bf5fdfab-661e-421a-88f2-3aa5a99522b0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:02.463398 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bf5fdfab-661e-421a-88f2-3aa5a99522b0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:02.486789 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bf5fdfab-661e-421a-88f2-3aa5a99522b0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:02.487675 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bf5fdfab-661e-421a-88f2-3aa5a99522b0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:02.489350 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bf5fdfab-661e-421a-88f2-3aa5a99522b0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:02.492156 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bf5fdfab-661e-421a-88f2-3aa5a99522b0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:02.492850 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bf5fdfab-661e-421a-88f2-3aa5a99522b0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:02.495763 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bf5fdfab-661e-421a-88f2-3aa5a99522b0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:03.059825 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-840fa247-c56d-4967-bd74-8effb513d334 req-a78df61c-0e81-458d-835a-e31036d5bee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9", "name": "network-vif-plugged", "status": "completed", "tag": "865e5e79-8273-4141-b596-7fb63328b234"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:50:03.082224 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-840fa247-c56d-4967-bd74-8effb513d334 req-a78df61c-0e81-458d-835a-e31036d5bee8 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:03.085314 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-840fa247-c56d-4967-bd74-8effb513d334 req-a78df61c-0e81-458d-835a-e31036d5bee8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:03.087985 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-840fa247-c56d-4967-bd74-8effb513d334 req-a78df61c-0e81-458d-835a-e31036d5bee8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:03.141068 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-840fa247-c56d-4967-bd74-8effb513d334 req-a78df61c-0e81-458d-835a-e31036d5bee8 service nova] Creating event network-vif-plugged:865e5e79-8273-4141-b596-7fb63328b234 for instance c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 on n-h2-856895-1 Sep 10 11:50:03.159401 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-840fa247-c56d-4967-bd74-8effb513d334 req-a78df61c-0e81-458d-835a-e31036d5bee8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106176 Sep 10 11:50:03.163473 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1231/2540] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:50:03.311419 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-10c66f2e-c4eb-4650-acbe-2eec3b42ccbc tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:03.312330 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-10c66f2e-c4eb-4650-acbe-2eec3b42ccbc tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:03.330314 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10c66f2e-c4eb-4650-acbe-2eec3b42ccbc tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:03.336076 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10c66f2e-c4eb-4650-acbe-2eec3b42ccbc tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:03.338605 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10c66f2e-c4eb-4650-acbe-2eec3b42ccbc tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:03.345158 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10c66f2e-c4eb-4650-acbe-2eec3b42ccbc tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:03.346856 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10c66f2e-c4eb-4650-acbe-2eec3b42ccbc tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:03.350889 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10c66f2e-c4eb-4650-acbe-2eec3b42ccbc tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:03.569108 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-10c66f2e-c4eb-4650-acbe-2eec3b42ccbc tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:03.585124 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-10c66f2e-c4eb-4650-acbe-2eec3b42ccbc tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:03.613158 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-10c66f2e-c4eb-4650-acbe-2eec3b42ccbc tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:03.669605 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-10c66f2e-c4eb-4650-acbe-2eec3b42ccbc tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1531 microversion: 2.91 time: 0.338648 Sep 10 11:50:03.675715 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1232/2541] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:03 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1531 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:03.699229 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-7287a8a7-37ad-491f-a954-ea9b985a2cf6 req-b1191e3b-b951-4917-9bce-d86cd75b5641 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9", "name": "network-vif-deleted", "tag": "865e5e79-8273-4141-b596-7fb63328b234"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:50:03.719118 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bf5fdfab-661e-421a-88f2-3aa5a99522b0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:03.745465 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bf5fdfab-661e-421a-88f2-3aa5a99522b0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9" status: 200 len: 1526 microversion: 2.1 time: 1.295292 Sep 10 11:50:03.746095 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1310/2542] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:02 2022] GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 => generated 1526 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:03.759683 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-7287a8a7-37ad-491f-a954-ea9b985a2cf6 req-b1191e3b-b951-4917-9bce-d86cd75b5641 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:03.760191 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-7287a8a7-37ad-491f-a954-ea9b985a2cf6 req-b1191e3b-b951-4917-9bce-d86cd75b5641 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:03.760629 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-7287a8a7-37ad-491f-a954-ea9b985a2cf6 req-b1191e3b-b951-4917-9bce-d86cd75b5641 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:03.799573 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-7287a8a7-37ad-491f-a954-ea9b985a2cf6 req-b1191e3b-b951-4917-9bce-d86cd75b5641 service nova] Creating event network-vif-deleted:865e5e79-8273-4141-b596-7fb63328b234 for instance c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 on n-h2-856895-1 Sep 10 11:50:03.815315 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-7287a8a7-37ad-491f-a954-ea9b985a2cf6 req-b1191e3b-b951-4917-9bce-d86cd75b5641 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137139 Sep 10 11:50:03.819325 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1233/2543] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:50:04.246289 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c752629d-2258-4741-9cbd-69ed163b7d87 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:04.247004 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c752629d-2258-4741-9cbd-69ed163b7d87 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:04.264742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c752629d-2258-4741-9cbd-69ed163b7d87 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:04.265378 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c752629d-2258-4741-9cbd-69ed163b7d87 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:04.265912 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c752629d-2258-4741-9cbd-69ed163b7d87 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:04.269332 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c752629d-2258-4741-9cbd-69ed163b7d87 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:04.269820 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c752629d-2258-4741-9cbd-69ed163b7d87 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:04.270329 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c752629d-2258-4741-9cbd-69ed163b7d87 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:04.449514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-c752629d-2258-4741-9cbd-69ed163b7d87 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Lazy-loading 'services' on Instance uuid 0ae1b1e1-f970-4d46-8d88-289c96d3f306 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:50:04.484744 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c752629d-2258-4741-9cbd-69ed163b7d87 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1936 microversion: 2.91 time: 0.737549 Sep 10 11:50:04.485688 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1311/2544] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:03 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1936 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:04.513202 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8f3ff4f8-5d9d-4799-a4a4-288eedfd3dbc tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:04.514531 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8f3ff4f8-5d9d-4799-a4a4-288eedfd3dbc tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:04.536020 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8f3ff4f8-5d9d-4799-a4a4-288eedfd3dbc tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:04.536514 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8f3ff4f8-5d9d-4799-a4a4-288eedfd3dbc tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:04.537162 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8f3ff4f8-5d9d-4799-a4a4-288eedfd3dbc tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:04.539779 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8f3ff4f8-5d9d-4799-a4a4-288eedfd3dbc tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:04.542859 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8f3ff4f8-5d9d-4799-a4a4-288eedfd3dbc tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:04.543313 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8f3ff4f8-5d9d-4799-a4a4-288eedfd3dbc tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:04.773578 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0513f691-09c8-4407-b812-b7c7c99c0b5a tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:04.774393 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0513f691-09c8-4407-b812-b7c7c99c0b5a tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:04.782475 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0513f691-09c8-4407-b812-b7c7c99c0b5a tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:04.787441 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0513f691-09c8-4407-b812-b7c7c99c0b5a tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:04.788101 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0513f691-09c8-4407-b812-b7c7c99c0b5a tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:04.793286 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0513f691-09c8-4407-b812-b7c7c99c0b5a tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:04.794704 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0513f691-09c8-4407-b812-b7c7c99c0b5a tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:04.795360 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0513f691-09c8-4407-b812-b7c7c99c0b5a tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:04.825499 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-0513f691-09c8-4407-b812-b7c7c99c0b5a tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] HTTP exception thrown: Instance c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 could not be found. Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0513f691-09c8-4407-b812-b7c7c99c0b5a tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Request method failure captured: Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 HTTP/1.1 Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHmIwAMwYRG5GoKY2e2BrHSNWC_XC8Dle2TjpsTglJZLl4iDdUWRHXObue6CBNwrU7ByI06vvCBASR59oLGdEXbdGMvKthtN9mtTXSrKa2RC4WmIF4PSo8bwMo95sbb-sIH1rhBMLrXpSep-X_LgFDTkeIXb7VSYHefdo66ew2GGhFc Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 3e5d376048de4c3191a58a547e05fd07 Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1177602115 Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3e5d376048de4c3191a58a547e05fd07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3e5d376048de4c3191a58a547e05fd07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3e5d376048de4c3191a58a547e05fd07", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3e5d376048de4c3191a58a547e05fd07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1177602115 Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 3e5d376048de4c3191a58a547e05fd07 Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1177602115 Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ImagesOneServerNegativeTestJSON-1177602115-project Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 8ced1e84956246b6bb7384ba484fde54 Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1177602115-project Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 could not be found. Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9'} Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 could not be found. Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 could not be found. Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:50:04.827103 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:50:04.832473 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:50:04.832473 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:04.832473 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:50:04.832473 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:50:04.832473 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:50:04.832473 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:50:04.832473 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 could not be found. Sep 10 11:50:04.832473 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:50:04.843906 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0513f691-09c8-4407-b812-b7c7c99c0b5a tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Returning 404 to user: Instance c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:50:04.846465 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0513f691-09c8-4407-b812-b7c7c99c0b5a tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9" status: 404 len: 111 microversion: 2.1 time: 0.076377 Sep 10 11:50:04.848618 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1312/2545] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:04 2022] GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:50:05.021570 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1aac698a-e951-4ff2-9b12-e12b9dd75931 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-785470269", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:50:05.031059 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-8f3ff4f8-5d9d-4799-a4a4-288eedfd3dbc tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Lazy-loading 'services' on Instance uuid 0ae1b1e1-f970-4d46-8d88-289c96d3f306 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:50:05.074940 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8f3ff4f8-5d9d-4799-a4a4-288eedfd3dbc tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1936 microversion: 2.91 time: 0.565921 Sep 10 11:50:05.076922 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1234/2546] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:04 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1936 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:05.110380 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6f137c35-277c-4071-85fd-a9a4395347d5 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:05.117652 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f137c35-277c-4071-85fd-a9a4395347d5 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:05.123199 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f137c35-277c-4071-85fd-a9a4395347d5 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:05.127331 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f137c35-277c-4071-85fd-a9a4395347d5 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:05.128608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f137c35-277c-4071-85fd-a9a4395347d5 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:05.131724 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f137c35-277c-4071-85fd-a9a4395347d5 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:05.132179 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f137c35-277c-4071-85fd-a9a4395347d5 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:05.151715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-1aac698a-e951-4ff2-9b12-e12b9dd75931 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] validate_networks() for [('a31ea6ce-f247-4438-9f0b-5b6f6aa53a3b', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:50:05.208494 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6f137c35-277c-4071-85fd-a9a4395347d5 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.105118 Sep 10 11:50:05.215231 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1235/2547] 10.222.0.23 () {60 vars in 1217 bytes} [Sat Sep 10 11:50:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 10 11:50:05.227201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5dca20f9-8279-4bcf-9b39-b9624472569d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:50:05.228712 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5dca20f9-8279-4bcf-9b39-b9624472569d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:05.235070 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5dca20f9-8279-4bcf-9b39-b9624472569d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:05.235610 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5dca20f9-8279-4bcf-9b39-b9624472569d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:05.236053 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5dca20f9-8279-4bcf-9b39-b9624472569d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:05.237388 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5dca20f9-8279-4bcf-9b39-b9624472569d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:05.237954 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5dca20f9-8279-4bcf-9b39-b9624472569d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:05.238395 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5dca20f9-8279-4bcf-9b39-b9624472569d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:05.338370 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-5dca20f9-8279-4bcf-9b39-b9624472569d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lazy-loading 'flavor' on Instance uuid 0ae1b1e1-f970-4d46-8d88-289c96d3f306 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:50:05.890182 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5dca20f9-8279-4bcf-9b39-b9624472569d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "POST /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306/action" status: 202 len: 0 microversion: 2.91 time: 0.670227 Sep 10 11:50:05.891540 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1236/2548] 10.222.0.23 () {62 vars in 1319 bytes} [Sat Sep 10 11:50:05 2022] POST /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306/action => generated 0 bytes in 674 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:50:05.910477 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f736da96-588b-49d0-ad76-e7f4748fc8ee tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:05.911508 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f736da96-588b-49d0-ad76-e7f4748fc8ee tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:05.962785 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f736da96-588b-49d0-ad76-e7f4748fc8ee tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:05.963439 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f736da96-588b-49d0-ad76-e7f4748fc8ee tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:05.963902 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f736da96-588b-49d0-ad76-e7f4748fc8ee tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:05.964667 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f736da96-588b-49d0-ad76-e7f4748fc8ee tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:05.965115 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f736da96-588b-49d0-ad76-e7f4748fc8ee tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:05.965540 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f736da96-588b-49d0-ad76-e7f4748fc8ee tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:06.119722 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f736da96-588b-49d0-ad76-e7f4748fc8ee tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:06.132538 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f736da96-588b-49d0-ad76-e7f4748fc8ee tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:06.149763 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f736da96-588b-49d0-ad76-e7f4748fc8ee tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:06.165369 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f736da96-588b-49d0-ad76-e7f4748fc8ee tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1537 microversion: 2.91 time: 0.267885 Sep 10 11:50:06.173233 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1237/2549] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:05 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1537 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:06.615031 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-1aac698a-e951-4ff2-9b12-e12b9dd75931 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:50:06.615642 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-1aac698a-e951-4ff2-9b12-e12b9dd75931 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:50:06.616237 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-1aac698a-e951-4ff2-9b12-e12b9dd75931 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:50:06.616760 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-1aac698a-e951-4ff2-9b12-e12b9dd75931 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:50:06.617330 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-1aac698a-e951-4ff2-9b12-e12b9dd75931 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:50:06.633951 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1aac698a-e951-4ff2-9b12-e12b9dd75931 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:06.638734 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1aac698a-e951-4ff2-9b12-e12b9dd75931 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:06.639502 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1aac698a-e951-4ff2-9b12-e12b9dd75931 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:06.640549 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1aac698a-e951-4ff2-9b12-e12b9dd75931 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:06.641239 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1aac698a-e951-4ff2-9b12-e12b9dd75931 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:06.641937 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1aac698a-e951-4ff2-9b12-e12b9dd75931 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:06.685715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-1aac698a-e951-4ff2-9b12-e12b9dd75931 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Getting quotas for project 3e5d376048de4c3191a58a547e05fd07. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:50:06.702717 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-1aac698a-e951-4ff2-9b12-e12b9dd75931 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Getting quotas for user 8ced1e84956246b6bb7384ba484fde54 and project 3e5d376048de4c3191a58a547e05fd07. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:50:06.738441 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1aac698a-e951-4ff2-9b12-e12b9dd75931 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:50:06.744071 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1aac698a-e951-4ff2-9b12-e12b9dd75931 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: 4e4e4a4c-e56f-4340-9b6c-088a41f007a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:50:06.876090 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1aac698a-e951-4ff2-9b12-e12b9dd75931 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.859346 Sep 10 11:50:06.877727 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1313/2550] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:50:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 1862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:50:06.891103 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b5bc177d-7a4f-4b3c-a779-fae61a888cb0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:06.891761 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b5bc177d-7a4f-4b3c-a779-fae61a888cb0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: 4e4e4a4c-e56f-4340-9b6c-088a41f007a1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:07.019441 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:50:07.133183 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b5bc177d-7a4f-4b3c-a779-fae61a888cb0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:07.146630 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b5bc177d-7a4f-4b3c-a779-fae61a888cb0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/4e4e4a4c-e56f-4340-9b6c-088a41f007a1" status: 200 len: 1224 microversion: 2.1 time: 0.261685 Sep 10 11:50:07.147253 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1238/2551] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:06 2022] GET /compute/v2.1/servers/4e4e4a4c-e56f-4340-9b6c-088a41f007a1 => generated 1224 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:07.199014 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7c444884-27b9-4ea2-8d11-b8994cbaeb49 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:07.199894 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7c444884-27b9-4ea2-8d11-b8994cbaeb49 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:07.212631 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c444884-27b9-4ea2-8d11-b8994cbaeb49 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:07.217549 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c444884-27b9-4ea2-8d11-b8994cbaeb49 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:07.219117 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c444884-27b9-4ea2-8d11-b8994cbaeb49 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:07.222243 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c444884-27b9-4ea2-8d11-b8994cbaeb49 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:07.225338 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c444884-27b9-4ea2-8d11-b8994cbaeb49 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:07.229921 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c444884-27b9-4ea2-8d11-b8994cbaeb49 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:07.631284 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7c444884-27b9-4ea2-8d11-b8994cbaeb49 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:07.648089 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7c444884-27b9-4ea2-8d11-b8994cbaeb49 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:07.662581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7c444884-27b9-4ea2-8d11-b8994cbaeb49 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:07.693058 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7c444884-27b9-4ea2-8d11-b8994cbaeb49 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1537 microversion: 2.91 time: 0.498536 Sep 10 11:50:07.696360 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1314/2552] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:07 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1537 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:08.173796 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7633510a-8be6-4111-80b1-cb476311e86d tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:08.174613 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7633510a-8be6-4111-80b1-cb476311e86d tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: 4e4e4a4c-e56f-4340-9b6c-088a41f007a1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:08.196345 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7633510a-8be6-4111-80b1-cb476311e86d tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:08.197841 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7633510a-8be6-4111-80b1-cb476311e86d tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:08.199037 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7633510a-8be6-4111-80b1-cb476311e86d tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:08.203075 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7633510a-8be6-4111-80b1-cb476311e86d tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:08.204597 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7633510a-8be6-4111-80b1-cb476311e86d tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:08.211758 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7633510a-8be6-4111-80b1-cb476311e86d tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:08.478190 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7633510a-8be6-4111-80b1-cb476311e86d tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:08.492680 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7633510a-8be6-4111-80b1-cb476311e86d tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/4e4e4a4c-e56f-4340-9b6c-088a41f007a1" status: 200 len: 1220 microversion: 2.1 time: 0.322536 Sep 10 11:50:08.495229 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1239/2553] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:08 2022] GET /compute/v2.1/servers/4e4e4a4c-e56f-4340-9b6c-088a41f007a1 => generated 1220 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:08.746914 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fe51acd0-2328-4736-b7de-0a7de16f055b tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:08.748082 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fe51acd0-2328-4736-b7de-0a7de16f055b tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:08.783026 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fe51acd0-2328-4736-b7de-0a7de16f055b tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:08.785110 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fe51acd0-2328-4736-b7de-0a7de16f055b tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:08.786691 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fe51acd0-2328-4736-b7de-0a7de16f055b tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:08.790627 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fe51acd0-2328-4736-b7de-0a7de16f055b tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:08.793334 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fe51acd0-2328-4736-b7de-0a7de16f055b tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:08.795465 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fe51acd0-2328-4736-b7de-0a7de16f055b tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:09.029043 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fe51acd0-2328-4736-b7de-0a7de16f055b tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:09.043291 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fe51acd0-2328-4736-b7de-0a7de16f055b tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:09.048991 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fe51acd0-2328-4736-b7de-0a7de16f055b tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:09.071336 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fe51acd0-2328-4736-b7de-0a7de16f055b tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1537 microversion: 2.91 time: 0.329412 Sep 10 11:50:09.071940 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1315/2554] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:08 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1537 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:09.523866 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9f5c2204-6b5b-4a98-93a3-c314e266ef00 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:09.524691 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9f5c2204-6b5b-4a98-93a3-c314e266ef00 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: 4e4e4a4c-e56f-4340-9b6c-088a41f007a1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:09.542073 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9f5c2204-6b5b-4a98-93a3-c314e266ef00 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:09.542847 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9f5c2204-6b5b-4a98-93a3-c314e266ef00 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:09.543564 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9f5c2204-6b5b-4a98-93a3-c314e266ef00 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:09.544678 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9f5c2204-6b5b-4a98-93a3-c314e266ef00 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:09.547019 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9f5c2204-6b5b-4a98-93a3-c314e266ef00 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:09.550155 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9f5c2204-6b5b-4a98-93a3-c314e266ef00 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:09.650698 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:50:09.790543 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9f5c2204-6b5b-4a98-93a3-c314e266ef00 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:09.803129 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9f5c2204-6b5b-4a98-93a3-c314e266ef00 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/4e4e4a4c-e56f-4340-9b6c-088a41f007a1" status: 200 len: 1282 microversion: 2.1 time: 0.281647 Sep 10 11:50:09.805037 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1240/2555] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:09 2022] GET /compute/v2.1/servers/4e4e4a4c-e56f-4340-9b6c-088a41f007a1 => generated 1282 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:10.105320 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3aeb34f1-c59e-430c-ab56-cf90761430cb tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:10.105866 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3aeb34f1-c59e-430c-ab56-cf90761430cb tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:10.122362 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3aeb34f1-c59e-430c-ab56-cf90761430cb tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:10.136405 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3aeb34f1-c59e-430c-ab56-cf90761430cb tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:10.138119 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3aeb34f1-c59e-430c-ab56-cf90761430cb tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:10.151538 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3aeb34f1-c59e-430c-ab56-cf90761430cb tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:10.152393 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3aeb34f1-c59e-430c-ab56-cf90761430cb tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:10.153067 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3aeb34f1-c59e-430c-ab56-cf90761430cb tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:10.346222 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3aeb34f1-c59e-430c-ab56-cf90761430cb tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:10.355832 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3aeb34f1-c59e-430c-ab56-cf90761430cb tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:10.357306 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3aeb34f1-c59e-430c-ab56-cf90761430cb tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:10.375436 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3aeb34f1-c59e-430c-ab56-cf90761430cb tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1537 microversion: 2.91 time: 0.274166 Sep 10 11:50:10.376621 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1316/2556] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:10 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1537 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:10.828995 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3b4e201a-3c74-4e0f-b045-98961646d7c1 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:10.829809 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3b4e201a-3c74-4e0f-b045-98961646d7c1 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: 4e4e4a4c-e56f-4340-9b6c-088a41f007a1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:10.846882 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3b4e201a-3c74-4e0f-b045-98961646d7c1 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:10.847717 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3b4e201a-3c74-4e0f-b045-98961646d7c1 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:10.848359 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3b4e201a-3c74-4e0f-b045-98961646d7c1 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:10.849260 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3b4e201a-3c74-4e0f-b045-98961646d7c1 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:10.849891 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3b4e201a-3c74-4e0f-b045-98961646d7c1 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:10.850512 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3b4e201a-3c74-4e0f-b045-98961646d7c1 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:10.859067 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4d417d00-82ab-49fa-b945-6471c62d2566 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-369273568", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "cfeac9bd-52fd-4612-85bf-8e6a7cf5b8db"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:50:10.962770 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-4d417d00-82ab-49fa-b945-6471c62d2566 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] validate_networks() for [('cfeac9bd-52fd-4612-85bf-8e6a7cf5b8db', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:50:12.054500 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3b4e201a-3c74-4e0f-b045-98961646d7c1 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:12.072928 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3b4e201a-3c74-4e0f-b045-98961646d7c1 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/4e4e4a4c-e56f-4340-9b6c-088a41f007a1" status: 200 len: 1282 microversion: 2.1 time: 1.248435 Sep 10 11:50:12.074221 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1317/2557] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:10 2022] GET /compute/v2.1/servers/4e4e4a4c-e56f-4340-9b6c-088a41f007a1 => generated 1282 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:12.080131 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3cc8009f-e5ae-4083-a48e-b39c9d6adfa1 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:12.084569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3cc8009f-e5ae-4083-a48e-b39c9d6adfa1 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:12.097025 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3cc8009f-e5ae-4083-a48e-b39c9d6adfa1 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:12.100065 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3cc8009f-e5ae-4083-a48e-b39c9d6adfa1 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:12.100788 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3cc8009f-e5ae-4083-a48e-b39c9d6adfa1 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:12.101765 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3cc8009f-e5ae-4083-a48e-b39c9d6adfa1 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:12.103251 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3cc8009f-e5ae-4083-a48e-b39c9d6adfa1 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:12.110640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3cc8009f-e5ae-4083-a48e-b39c9d6adfa1 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:12.433842 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3cc8009f-e5ae-4083-a48e-b39c9d6adfa1 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:12.443136 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3cc8009f-e5ae-4083-a48e-b39c9d6adfa1 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:12.444645 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3cc8009f-e5ae-4083-a48e-b39c9d6adfa1 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:12.476075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:50:12.477830 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3cc8009f-e5ae-4083-a48e-b39c9d6adfa1 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1537 microversion: 2.91 time: 0.402312 Sep 10 11:50:12.481810 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1318/2558] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:12 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1537 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:13.101329 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-991fcd9e-e537-4db8-a128-6a1baa9b54e5 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:13.102739 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-991fcd9e-e537-4db8-a128-6a1baa9b54e5 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: 4e4e4a4c-e56f-4340-9b6c-088a41f007a1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:13.122735 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-991fcd9e-e537-4db8-a128-6a1baa9b54e5 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:13.127769 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-991fcd9e-e537-4db8-a128-6a1baa9b54e5 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:13.128751 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-991fcd9e-e537-4db8-a128-6a1baa9b54e5 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:13.130467 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-991fcd9e-e537-4db8-a128-6a1baa9b54e5 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:13.133356 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-991fcd9e-e537-4db8-a128-6a1baa9b54e5 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:13.134092 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-991fcd9e-e537-4db8-a128-6a1baa9b54e5 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:13.193748 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-4d417d00-82ab-49fa-b945-6471c62d2566 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:50:13.194911 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-4d417d00-82ab-49fa-b945-6471c62d2566 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:50:13.195605 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-4d417d00-82ab-49fa-b945-6471c62d2566 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:50:13.196173 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-4d417d00-82ab-49fa-b945-6471c62d2566 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:50:13.197313 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-4d417d00-82ab-49fa-b945-6471c62d2566 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:50:13.216618 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4d417d00-82ab-49fa-b945-6471c62d2566 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:13.221381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4d417d00-82ab-49fa-b945-6471c62d2566 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:13.224355 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4d417d00-82ab-49fa-b945-6471c62d2566 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:13.228784 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4d417d00-82ab-49fa-b945-6471c62d2566 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:13.229508 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4d417d00-82ab-49fa-b945-6471c62d2566 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:13.232036 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4d417d00-82ab-49fa-b945-6471c62d2566 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:13.295295 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-4d417d00-82ab-49fa-b945-6471c62d2566 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Getting quotas for project 689e03cda40d4be5ab9fe3fe20ca8d97. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:50:13.310454 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-4d417d00-82ab-49fa-b945-6471c62d2566 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Getting quotas for user 1673c19f6ab545a18897858acf56f762 and project 689e03cda40d4be5ab9fe3fe20ca8d97. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:50:13.347918 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4d417d00-82ab-49fa-b945-6471c62d2566 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:50:13.354219 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4d417d00-82ab-49fa-b945-6471c62d2566 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: 3b2dc8b3-1049-4393-824f-b9786315d5ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:50:13.539376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-991fcd9e-e537-4db8-a128-6a1baa9b54e5 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:13.552985 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-991fcd9e-e537-4db8-a128-6a1baa9b54e5 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/4e4e4a4c-e56f-4340-9b6c-088a41f007a1" status: 200 len: 1324 microversion: 2.1 time: 0.459337 Sep 10 11:50:13.555303 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4d417d00-82ab-49fa-b945-6471c62d2566 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.871508 Sep 10 11:50:13.556456 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1241/2559] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:50:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:50:13.560652 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1319/2560] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:13 2022] GET /compute/v2.1/servers/4e4e4a4c-e56f-4340-9b6c-088a41f007a1 => generated 1324 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:13.593480 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2e5e4caa-46aa-4e3f-81fd-209a731d51c8 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:13.595617 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-eecfffb8-461a-4013-ad72-bb18b2687197 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:13.601526 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2e5e4caa-46aa-4e3f-81fd-209a731d51c8 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:13.603679 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-eecfffb8-461a-4013-ad72-bb18b2687197 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: 3b2dc8b3-1049-4393-824f-b9786315d5ad] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:13.610675 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e5e4caa-46aa-4e3f-81fd-209a731d51c8 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:13.611769 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e5e4caa-46aa-4e3f-81fd-209a731d51c8 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:13.612230 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e5e4caa-46aa-4e3f-81fd-209a731d51c8 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:13.613140 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e5e4caa-46aa-4e3f-81fd-209a731d51c8 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:13.614409 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e5e4caa-46aa-4e3f-81fd-209a731d51c8 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:13.614893 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e5e4caa-46aa-4e3f-81fd-209a731d51c8 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:14.419817 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2e5e4caa-46aa-4e3f-81fd-209a731d51c8 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:14.439107 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2e5e4caa-46aa-4e3f-81fd-209a731d51c8 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:14.448414 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2e5e4caa-46aa-4e3f-81fd-209a731d51c8 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:14.449847 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-eecfffb8-461a-4013-ad72-bb18b2687197 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:14.460398 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-eecfffb8-461a-4013-ad72-bb18b2687197 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad" status: 200 len: 1217 microversion: 2.1 time: 0.891725 Sep 10 11:50:14.462562 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2e5e4caa-46aa-4e3f-81fd-209a731d51c8 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1537 microversion: 2.91 time: 0.900701 Sep 10 11:50:14.465636 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1242/2561] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:13 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1537 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:14.469712 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1320/2562] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:13 2022] GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad => generated 1217 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:14.484105 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-bb54c189-0ae4-4fed-b1b8-f9c09fb66862 req-7175ab4c-7cbe-4c3d-8702-917a8cf95cdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e4e4a4c-e56f-4340-9b6c-088a41f007a1", "tag": "95a7a5ae-105e-4330-a91a-a156314e7022"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:50:14.537373 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-bb54c189-0ae4-4fed-b1b8-f9c09fb66862 req-7175ab4c-7cbe-4c3d-8702-917a8cf95cdb service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:14.537865 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-bb54c189-0ae4-4fed-b1b8-f9c09fb66862 req-7175ab4c-7cbe-4c3d-8702-917a8cf95cdb service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:14.538298 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-bb54c189-0ae4-4fed-b1b8-f9c09fb66862 req-7175ab4c-7cbe-4c3d-8702-917a8cf95cdb service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:14.573977 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-bb54c189-0ae4-4fed-b1b8-f9c09fb66862 req-7175ab4c-7cbe-4c3d-8702-917a8cf95cdb service nova] Creating event network-changed:95a7a5ae-105e-4330-a91a-a156314e7022 for instance 4e4e4a4c-e56f-4340-9b6c-088a41f007a1 on n-h1-856895-1 Sep 10 11:50:14.585469 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-bb54c189-0ae4-4fed-b1b8-f9c09fb66862 req-7175ab4c-7cbe-4c3d-8702-917a8cf95cdb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108612 Sep 10 11:50:14.592690 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1321/2563] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:50:14.593976 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ab2c4463-0414-4812-b7bd-8483b679ee09 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:14.594714 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ab2c4463-0414-4812-b7bd-8483b679ee09 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: 4e4e4a4c-e56f-4340-9b6c-088a41f007a1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:14.598637 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:50:14.617400 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab2c4463-0414-4812-b7bd-8483b679ee09 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:14.625916 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab2c4463-0414-4812-b7bd-8483b679ee09 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:14.627630 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab2c4463-0414-4812-b7bd-8483b679ee09 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:14.639548 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab2c4463-0414-4812-b7bd-8483b679ee09 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:14.643760 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab2c4463-0414-4812-b7bd-8483b679ee09 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:14.645737 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab2c4463-0414-4812-b7bd-8483b679ee09 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:15.165183 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ab2c4463-0414-4812-b7bd-8483b679ee09 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:15.183757 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ab2c4463-0414-4812-b7bd-8483b679ee09 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/4e4e4a4c-e56f-4340-9b6c-088a41f007a1" status: 200 len: 1324 microversion: 2.1 time: 0.595171 Sep 10 11:50:15.202971 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1243/2564] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:14 2022] GET /compute/v2.1/servers/4e4e4a4c-e56f-4340-9b6c-088a41f007a1 => generated 1324 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:15.496264 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1eb560e2-1ebb-4c83-af6b-ba87075a040a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:15.496816 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c83ba8fa-35e0-4107-90e2-8e092b08c5a0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:15.497311 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c83ba8fa-35e0-4107-90e2-8e092b08c5a0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:15.498139 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1eb560e2-1ebb-4c83-af6b-ba87075a040a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: 3b2dc8b3-1049-4393-824f-b9786315d5ad] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:15.512295 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1eb560e2-1ebb-4c83-af6b-ba87075a040a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:15.515257 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c83ba8fa-35e0-4107-90e2-8e092b08c5a0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:15.517181 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1eb560e2-1ebb-4c83-af6b-ba87075a040a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:15.518393 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1eb560e2-1ebb-4c83-af6b-ba87075a040a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:15.519923 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1eb560e2-1ebb-4c83-af6b-ba87075a040a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:15.520549 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1eb560e2-1ebb-4c83-af6b-ba87075a040a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:15.520840 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c83ba8fa-35e0-4107-90e2-8e092b08c5a0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:15.521336 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c83ba8fa-35e0-4107-90e2-8e092b08c5a0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:15.521541 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1eb560e2-1ebb-4c83-af6b-ba87075a040a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:15.522096 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c83ba8fa-35e0-4107-90e2-8e092b08c5a0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:15.522578 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c83ba8fa-35e0-4107-90e2-8e092b08c5a0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:15.523018 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c83ba8fa-35e0-4107-90e2-8e092b08c5a0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:15.744360 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1eb560e2-1ebb-4c83-af6b-ba87075a040a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:15.762572 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1eb560e2-1ebb-4c83-af6b-ba87075a040a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad" status: 200 len: 1269 microversion: 2.1 time: 0.272332 Sep 10 11:50:15.786875 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1322/2565] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:15 2022] GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad => generated 1269 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:15.905357 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c83ba8fa-35e0-4107-90e2-8e092b08c5a0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:15.923534 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c83ba8fa-35e0-4107-90e2-8e092b08c5a0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:15.925552 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c83ba8fa-35e0-4107-90e2-8e092b08c5a0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:15.938420 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c83ba8fa-35e0-4107-90e2-8e092b08c5a0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1537 microversion: 2.91 time: 0.445796 Sep 10 11:50:15.942399 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1244/2566] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:15 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1537 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:50:16.210171 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d495c3cb-66b9-4ea9-bbc6-0213f539929f tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:16.211492 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d495c3cb-66b9-4ea9-bbc6-0213f539929f tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: 4e4e4a4c-e56f-4340-9b6c-088a41f007a1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:16.229478 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d495c3cb-66b9-4ea9-bbc6-0213f539929f tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:16.233238 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d495c3cb-66b9-4ea9-bbc6-0213f539929f tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:16.235099 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d495c3cb-66b9-4ea9-bbc6-0213f539929f tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:16.237051 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d495c3cb-66b9-4ea9-bbc6-0213f539929f tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:16.238735 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d495c3cb-66b9-4ea9-bbc6-0213f539929f tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:16.240514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d495c3cb-66b9-4ea9-bbc6-0213f539929f tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:16.577437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d495c3cb-66b9-4ea9-bbc6-0213f539929f tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:16.588993 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d495c3cb-66b9-4ea9-bbc6-0213f539929f tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/4e4e4a4c-e56f-4340-9b6c-088a41f007a1" status: 200 len: 1324 microversion: 2.1 time: 0.385576 Sep 10 11:50:16.589679 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1323/2567] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:16 2022] GET /compute/v2.1/servers/4e4e4a4c-e56f-4340-9b6c-088a41f007a1 => generated 1324 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:16.793725 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8b06a254-33af-4e98-a86f-633334e76906 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:16.794351 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8b06a254-33af-4e98-a86f-633334e76906 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: 3b2dc8b3-1049-4393-824f-b9786315d5ad] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:16.808688 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8b06a254-33af-4e98-a86f-633334e76906 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:16.809181 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8b06a254-33af-4e98-a86f-633334e76906 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:16.809622 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8b06a254-33af-4e98-a86f-633334e76906 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:16.810328 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8b06a254-33af-4e98-a86f-633334e76906 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:16.810783 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8b06a254-33af-4e98-a86f-633334e76906 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:16.823783 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8b06a254-33af-4e98-a86f-633334e76906 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:16.975079 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:50:16.982126 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-22f35ca3-cdeb-4902-bada-36030af7754f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:16.983085 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-22f35ca3-cdeb-4902-bada-36030af7754f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:16.990651 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8b06a254-33af-4e98-a86f-633334e76906 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:17.005892 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-22f35ca3-cdeb-4902-bada-36030af7754f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:17.008530 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8b06a254-33af-4e98-a86f-633334e76906 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad" status: 200 len: 1275 microversion: 2.1 time: 0.216913 Sep 10 11:50:17.009313 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1245/2568] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:16 2022] GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad => generated 1275 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:17.012717 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-22f35ca3-cdeb-4902-bada-36030af7754f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:17.013558 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-22f35ca3-cdeb-4902-bada-36030af7754f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:17.014738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-22f35ca3-cdeb-4902-bada-36030af7754f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:17.016520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-22f35ca3-cdeb-4902-bada-36030af7754f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:17.017215 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-22f35ca3-cdeb-4902-bada-36030af7754f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:17.177095 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-22f35ca3-cdeb-4902-bada-36030af7754f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:17.183970 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=100 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:50:17.211695 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-22f35ca3-cdeb-4902-bada-36030af7754f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:17.213555 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-22f35ca3-cdeb-4902-bada-36030af7754f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:17.229723 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-22f35ca3-cdeb-4902-bada-36030af7754f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1537 microversion: 2.91 time: 0.256437 Sep 10 11:50:17.230329 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1324/2569] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:16 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1537 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:17.460256 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0c3d1d80-af10-4034-9201-38617dbed86f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-688107426", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "a9ff9635-7794-44ea-9e2d-dac85a415bc7"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:50:17.584357 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-0c3d1d80-af10-4034-9201-38617dbed86f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] validate_networks() for [('a9ff9635-7794-44ea-9e2d-dac85a415bc7', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:50:17.644972 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a9cb30d9-2631-4eea-829a-6ca68552630d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:17.644972 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a9cb30d9-2631-4eea-829a-6ca68552630d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:17.664015 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9cb30d9-2631-4eea-829a-6ca68552630d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:17.664688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9cb30d9-2631-4eea-829a-6ca68552630d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:17.671784 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9cb30d9-2631-4eea-829a-6ca68552630d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:17.671784 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9cb30d9-2631-4eea-829a-6ca68552630d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:17.672182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9cb30d9-2631-4eea-829a-6ca68552630d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:17.672947 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9cb30d9-2631-4eea-829a-6ca68552630d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:17.731024 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a9cb30d9-2631-4eea-829a-6ca68552630d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:50:17.926260 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a9cb30d9-2631-4eea-829a-6ca68552630d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 204 len: 0 microversion: 2.32 time: 0.563322 Sep 10 11:50:17.926622 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1325/2570] 10.222.0.23 () {60 vars in 1280 bytes} [Sat Sep 10 11:50:17 2022] DELETE /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 0 bytes in 566 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 10 11:50:17.941960 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f223791e-236c-4f3b-a32c-5ee810e1407c tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:17.943408 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f223791e-236c-4f3b-a32c-5ee810e1407c tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: 4e4e4a4c-e56f-4340-9b6c-088a41f007a1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:17.964911 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f223791e-236c-4f3b-a32c-5ee810e1407c tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:17.966423 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f223791e-236c-4f3b-a32c-5ee810e1407c tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:17.967421 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f223791e-236c-4f3b-a32c-5ee810e1407c tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:17.968587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f223791e-236c-4f3b-a32c-5ee810e1407c tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:17.969210 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f223791e-236c-4f3b-a32c-5ee810e1407c tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:17.969834 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f223791e-236c-4f3b-a32c-5ee810e1407c tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:18.382048 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f223791e-236c-4f3b-a32c-5ee810e1407c tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:18.411851 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f223791e-236c-4f3b-a32c-5ee810e1407c tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/4e4e4a4c-e56f-4340-9b6c-088a41f007a1" status: 200 len: 1324 microversion: 2.1 time: 0.483806 Sep 10 11:50:18.417096 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1326/2571] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:17 2022] GET /compute/v2.1/servers/4e4e4a4c-e56f-4340-9b6c-088a41f007a1 => generated 1324 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:18.442143 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f6eb980c-07d3-45f7-b2dd-21fd24e461b2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:18.452096 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f6eb980c-07d3-45f7-b2dd-21fd24e461b2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:18.472908 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f6eb980c-07d3-45f7-b2dd-21fd24e461b2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:18.475931 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f6eb980c-07d3-45f7-b2dd-21fd24e461b2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:18.478254 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f6eb980c-07d3-45f7-b2dd-21fd24e461b2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:18.480465 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f6eb980c-07d3-45f7-b2dd-21fd24e461b2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:18.481130 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f6eb980c-07d3-45f7-b2dd-21fd24e461b2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:18.481939 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f6eb980c-07d3-45f7-b2dd-21fd24e461b2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:18.509266 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-0c3d1d80-af10-4034-9201-38617dbed86f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:50:18.511512 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-0c3d1d80-af10-4034-9201-38617dbed86f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:50:18.519891 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-0c3d1d80-af10-4034-9201-38617dbed86f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:50:18.520791 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-0c3d1d80-af10-4034-9201-38617dbed86f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:50:18.521363 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-0c3d1d80-af10-4034-9201-38617dbed86f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:50:18.559361 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c3d1d80-af10-4034-9201-38617dbed86f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:18.562577 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c3d1d80-af10-4034-9201-38617dbed86f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:18.563055 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c3d1d80-af10-4034-9201-38617dbed86f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:18.567437 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c3d1d80-af10-4034-9201-38617dbed86f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:18.567933 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c3d1d80-af10-4034-9201-38617dbed86f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:18.568373 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c3d1d80-af10-4034-9201-38617dbed86f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:18.633740 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-0c3d1d80-af10-4034-9201-38617dbed86f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Getting quotas for project 57eb6c59b1a7467baf0daae9019ca5aa. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:50:18.640486 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-0c3d1d80-af10-4034-9201-38617dbed86f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Getting quotas for user 1ead4e0fd51b484c8dd38da5a3975788 and project 57eb6c59b1a7467baf0daae9019ca5aa. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:50:18.663864 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0c3d1d80-af10-4034-9201-38617dbed86f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:50:18.666804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0c3d1d80-af10-4034-9201-38617dbed86f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 10b130d5-dcd3-41e9-9e67-c68eb28726a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:50:18.767058 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0c3d1d80-af10-4034-9201-38617dbed86f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.575077 Sep 10 11:50:18.787450 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1246/2572] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:50:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:50:18.795934 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d871e249-6369-41ab-b487-c3b00787ef1a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:18.796673 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d871e249-6369-41ab-b487-c3b00787ef1a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: 3b2dc8b3-1049-4393-824f-b9786315d5ad] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:18.805799 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d871e249-6369-41ab-b487-c3b00787ef1a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:18.806708 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d871e249-6369-41ab-b487-c3b00787ef1a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:18.807401 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d871e249-6369-41ab-b487-c3b00787ef1a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:18.808843 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d871e249-6369-41ab-b487-c3b00787ef1a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:18.809582 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d871e249-6369-41ab-b487-c3b00787ef1a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:18.810260 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d871e249-6369-41ab-b487-c3b00787ef1a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:19.210266 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f6eb980c-07d3-45f7-b2dd-21fd24e461b2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:19.224327 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f6eb980c-07d3-45f7-b2dd-21fd24e461b2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:19.225784 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f6eb980c-07d3-45f7-b2dd-21fd24e461b2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:19.227128 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f6eb980c-07d3-45f7-b2dd-21fd24e461b2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 2954 microversion: 2.32 time: 0.807625 Sep 10 11:50:19.255323 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1327/2573] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:18 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 2954 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:19.260609 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cbc41874-ff5f-4cb4-ad8f-fb4ed2769661 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:19.268215 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cbc41874-ff5f-4cb4-ad8f-fb4ed2769661 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:19.279814 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cbc41874-ff5f-4cb4-ad8f-fb4ed2769661 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:19.284748 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cbc41874-ff5f-4cb4-ad8f-fb4ed2769661 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:19.286615 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cbc41874-ff5f-4cb4-ad8f-fb4ed2769661 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:19.288478 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cbc41874-ff5f-4cb4-ad8f-fb4ed2769661 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:19.292395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cbc41874-ff5f-4cb4-ad8f-fb4ed2769661 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:19.293208 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cbc41874-ff5f-4cb4-ad8f-fb4ed2769661 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:19.311005 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d871e249-6369-41ab-b487-c3b00787ef1a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:19.320661 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d871e249-6369-41ab-b487-c3b00787ef1a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad" status: 200 len: 1317 microversion: 2.1 time: 0.531446 Sep 10 11:50:19.321254 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1247/2574] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:18 2022] GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad => generated 1317 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:19.329881 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0e23f067-d56c-4534-a6d9-d498bc897415 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:19.337429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0e23f067-d56c-4534-a6d9-d498bc897415 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 10b130d5-dcd3-41e9-9e67-c68eb28726a2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:19.453252 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cbc41874-ff5f-4cb4-ad8f-fb4ed2769661 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:19.465035 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cbc41874-ff5f-4cb4-ad8f-fb4ed2769661 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:19.475340 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cbc41874-ff5f-4cb4-ad8f-fb4ed2769661 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:19.489911 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cbc41874-ff5f-4cb4-ad8f-fb4ed2769661 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1537 microversion: 2.91 time: 0.231764 Sep 10 11:50:19.495077 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1328/2575] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:19 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1537 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:19.506999 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-66fb39bd-c1f0-4f00-9b38-e859b0229dec tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:19.507979 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-66fb39bd-c1f0-4f00-9b38-e859b0229dec tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: 4e4e4a4c-e56f-4340-9b6c-088a41f007a1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:19.529616 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66fb39bd-c1f0-4f00-9b38-e859b0229dec tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:19.531411 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66fb39bd-c1f0-4f00-9b38-e859b0229dec tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:19.532310 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66fb39bd-c1f0-4f00-9b38-e859b0229dec tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:19.534065 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66fb39bd-c1f0-4f00-9b38-e859b0229dec tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:19.534795 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66fb39bd-c1f0-4f00-9b38-e859b0229dec tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:19.535652 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66fb39bd-c1f0-4f00-9b38-e859b0229dec tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:19.563026 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0e23f067-d56c-4534-a6d9-d498bc897415 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:19.572252 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0e23f067-d56c-4534-a6d9-d498bc897415 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/10b130d5-dcd3-41e9-9e67-c68eb28726a2" status: 200 len: 1207 microversion: 2.1 time: 0.245996 Sep 10 11:50:19.573314 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1248/2576] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:19 2022] GET /compute/v2.1/servers/10b130d5-dcd3-41e9-9e67-c68eb28726a2 => generated 1207 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:19.882517 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-66fb39bd-c1f0-4f00-9b38-e859b0229dec tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:19.891061 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-66fb39bd-c1f0-4f00-9b38-e859b0229dec tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/4e4e4a4c-e56f-4340-9b6c-088a41f007a1" status: 200 len: 1324 microversion: 2.1 time: 0.394641 Sep 10 11:50:19.899467 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1329/2577] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:19 2022] GET /compute/v2.1/servers/4e4e4a4c-e56f-4340-9b6c-088a41f007a1 => generated 1324 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:20.262995 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-664c2dfc-38a6-4d38-8be2-48aed15bc9f3 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:20.263990 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-664c2dfc-38a6-4d38-8be2-48aed15bc9f3 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:20.273661 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-664c2dfc-38a6-4d38-8be2-48aed15bc9f3 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:20.274445 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-664c2dfc-38a6-4d38-8be2-48aed15bc9f3 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:20.275074 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-664c2dfc-38a6-4d38-8be2-48aed15bc9f3 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:20.276127 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-664c2dfc-38a6-4d38-8be2-48aed15bc9f3 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:20.276821 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-664c2dfc-38a6-4d38-8be2-48aed15bc9f3 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:20.277456 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-664c2dfc-38a6-4d38-8be2-48aed15bc9f3 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:20.351147 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1ce5178c-08ce-48c6-8cae-865f7fc07012 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:20.352421 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1ce5178c-08ce-48c6-8cae-865f7fc07012 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: 3b2dc8b3-1049-4393-824f-b9786315d5ad] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:20.361458 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ce5178c-08ce-48c6-8cae-865f7fc07012 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:20.362382 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ce5178c-08ce-48c6-8cae-865f7fc07012 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:20.363286 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ce5178c-08ce-48c6-8cae-865f7fc07012 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:20.364659 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ce5178c-08ce-48c6-8cae-865f7fc07012 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:20.365510 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ce5178c-08ce-48c6-8cae-865f7fc07012 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:20.366199 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ce5178c-08ce-48c6-8cae-865f7fc07012 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:20.900048 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1ce5178c-08ce-48c6-8cae-865f7fc07012 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:20.915362 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-664c2dfc-38a6-4d38-8be2-48aed15bc9f3 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:20.920010 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1ce5178c-08ce-48c6-8cae-865f7fc07012 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad" status: 200 len: 1317 microversion: 2.1 time: 0.570739 Sep 10 11:50:20.924371 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1330/2578] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:20 2022] GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad => generated 1317 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:20.930782 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-664c2dfc-38a6-4d38-8be2-48aed15bc9f3 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:20.932859 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-664c2dfc-38a6-4d38-8be2-48aed15bc9f3 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:20.936446 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bed35bcb-4f04-4d61-a71a-6c44b4b1aba6 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:20.937107 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bed35bcb-4f04-4d61-a71a-6c44b4b1aba6 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:20.950911 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-664c2dfc-38a6-4d38-8be2-48aed15bc9f3 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 2954 microversion: 2.32 time: 0.676806 Sep 10 11:50:20.953177 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1249/2579] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:20 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 2954 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:20.962879 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b7072c32-5ce6-4133-8ac6-9a316b5739ba tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:20.967035 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b7072c32-5ce6-4133-8ac6-9a316b5739ba tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 10b130d5-dcd3-41e9-9e67-c68eb28726a2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:20.982783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bed35bcb-4f04-4d61-a71a-6c44b4b1aba6 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:20.987906 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7072c32-5ce6-4133-8ac6-9a316b5739ba tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:20.989500 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bed35bcb-4f04-4d61-a71a-6c44b4b1aba6 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:20.991787 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7072c32-5ce6-4133-8ac6-9a316b5739ba tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:20.993055 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7072c32-5ce6-4133-8ac6-9a316b5739ba tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:20.997208 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7072c32-5ce6-4133-8ac6-9a316b5739ba tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:20.998054 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7072c32-5ce6-4133-8ac6-9a316b5739ba tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:20.998652 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bed35bcb-4f04-4d61-a71a-6c44b4b1aba6 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:20.999467 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bed35bcb-4f04-4d61-a71a-6c44b4b1aba6 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:21.001647 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7072c32-5ce6-4133-8ac6-9a316b5739ba tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:21.008060 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bed35bcb-4f04-4d61-a71a-6c44b4b1aba6 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:21.009104 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bed35bcb-4f04-4d61-a71a-6c44b4b1aba6 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:21.320608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b7072c32-5ce6-4133-8ac6-9a316b5739ba tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:21.336551 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b7072c32-5ce6-4133-8ac6-9a316b5739ba tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/10b130d5-dcd3-41e9-9e67-c68eb28726a2" status: 200 len: 1277 microversion: 2.1 time: 0.380203 Sep 10 11:50:21.338903 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1250/2580] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:20 2022] GET /compute/v2.1/servers/10b130d5-dcd3-41e9-9e67-c68eb28726a2 => generated 1277 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:21.345353 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bed35bcb-4f04-4d61-a71a-6c44b4b1aba6 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:21.355777 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bed35bcb-4f04-4d61-a71a-6c44b4b1aba6 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:21.357232 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bed35bcb-4f04-4d61-a71a-6c44b4b1aba6 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:21.379539 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5f0c16aa-9ac4-4ac6-bc99-87de227ce6af tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:21.382975 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bed35bcb-4f04-4d61-a71a-6c44b4b1aba6 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1537 microversion: 2.91 time: 0.457151 Sep 10 11:50:21.386040 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5f0c16aa-9ac4-4ac6-bc99-87de227ce6af tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: 4e4e4a4c-e56f-4340-9b6c-088a41f007a1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:21.388583 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1331/2581] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:20 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1537 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:21.410408 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5f0c16aa-9ac4-4ac6-bc99-87de227ce6af tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:21.416489 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5f0c16aa-9ac4-4ac6-bc99-87de227ce6af tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:21.418653 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5f0c16aa-9ac4-4ac6-bc99-87de227ce6af tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:21.420113 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5f0c16aa-9ac4-4ac6-bc99-87de227ce6af tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:21.437205 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5f0c16aa-9ac4-4ac6-bc99-87de227ce6af tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:21.437750 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5f0c16aa-9ac4-4ac6-bc99-87de227ce6af tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:21.911890 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5f0c16aa-9ac4-4ac6-bc99-87de227ce6af tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:21.928543 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5f0c16aa-9ac4-4ac6-bc99-87de227ce6af tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/4e4e4a4c-e56f-4340-9b6c-088a41f007a1" status: 200 len: 1324 microversion: 2.1 time: 0.587136 Sep 10 11:50:21.929550 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1251/2582] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:21 2022] GET /compute/v2.1/servers/4e4e4a4c-e56f-4340-9b6c-088a41f007a1 => generated 1324 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:21.946937 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ae4ea05f-43a3-4474-9beb-6b5837fe5e8c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:21.947903 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ae4ea05f-43a3-4474-9beb-6b5837fe5e8c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: 3b2dc8b3-1049-4393-824f-b9786315d5ad] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:21.962614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae4ea05f-43a3-4474-9beb-6b5837fe5e8c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:21.963798 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae4ea05f-43a3-4474-9beb-6b5837fe5e8c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:21.966267 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae4ea05f-43a3-4474-9beb-6b5837fe5e8c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:21.967368 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae4ea05f-43a3-4474-9beb-6b5837fe5e8c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:21.971664 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae4ea05f-43a3-4474-9beb-6b5837fe5e8c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:21.972332 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae4ea05f-43a3-4474-9beb-6b5837fe5e8c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:21.981973 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9c8f8538-bf9a-439a-ae40-359e57212e25 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:21.983111 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9c8f8538-bf9a-439a-ae40-359e57212e25 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:21.995194 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c8f8538-bf9a-439a-ae40-359e57212e25 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:21.996781 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c8f8538-bf9a-439a-ae40-359e57212e25 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:21.997666 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c8f8538-bf9a-439a-ae40-359e57212e25 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:21.998584 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c8f8538-bf9a-439a-ae40-359e57212e25 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:21.999261 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c8f8538-bf9a-439a-ae40-359e57212e25 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:21.999869 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c8f8538-bf9a-439a-ae40-359e57212e25 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:22.263004 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ae4ea05f-43a3-4474-9beb-6b5837fe5e8c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:22.279749 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ae4ea05f-43a3-4474-9beb-6b5837fe5e8c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad" status: 200 len: 1317 microversion: 2.1 time: 0.336859 Sep 10 11:50:22.284447 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1332/2583] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:21 2022] GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad => generated 1317 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:22.361954 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-39f904b8-e85e-4dc5-92af-1443c5fb281b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:22.363802 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-39f904b8-e85e-4dc5-92af-1443c5fb281b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 10b130d5-dcd3-41e9-9e67-c68eb28726a2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:22.383657 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-39f904b8-e85e-4dc5-92af-1443c5fb281b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:22.385216 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-39f904b8-e85e-4dc5-92af-1443c5fb281b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:22.386691 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-39f904b8-e85e-4dc5-92af-1443c5fb281b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:22.387677 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-39f904b8-e85e-4dc5-92af-1443c5fb281b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:22.391826 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-39f904b8-e85e-4dc5-92af-1443c5fb281b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:22.392560 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-39f904b8-e85e-4dc5-92af-1443c5fb281b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:22.540994 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-39f904b8-e85e-4dc5-92af-1443c5fb281b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:22.566243 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-39f904b8-e85e-4dc5-92af-1443c5fb281b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/10b130d5-dcd3-41e9-9e67-c68eb28726a2" status: 200 len: 1265 microversion: 2.1 time: 0.209095 Sep 10 11:50:22.585031 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1333/2584] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:22 2022] GET /compute/v2.1/servers/10b130d5-dcd3-41e9-9e67-c68eb28726a2 => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:22.597722 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-eb857683-8cfe-44de-a873-67cf8b19c791 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:22.598667 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-eb857683-8cfe-44de-a873-67cf8b19c791 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:22.607579 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb857683-8cfe-44de-a873-67cf8b19c791 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:22.608459 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb857683-8cfe-44de-a873-67cf8b19c791 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:22.609070 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb857683-8cfe-44de-a873-67cf8b19c791 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:22.610995 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb857683-8cfe-44de-a873-67cf8b19c791 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:22.613695 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb857683-8cfe-44de-a873-67cf8b19c791 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:22.614341 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb857683-8cfe-44de-a873-67cf8b19c791 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:23.571495 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-eb857683-8cfe-44de-a873-67cf8b19c791 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:23.608185 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-eb857683-8cfe-44de-a873-67cf8b19c791 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:23.619008 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-eb857683-8cfe-44de-a873-67cf8b19c791 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:23.644579 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-eb857683-8cfe-44de-a873-67cf8b19c791 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1537 microversion: 2.91 time: 1.054354 Sep 10 11:50:23.647571 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1334/2585] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:22 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1537 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:23.661119 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-fc2012dc-5be9-4b40-9ed4-7f93ec1d3504 req-8683f355-7a8d-4f12-b8cd-ffc8edb6e970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e4e4a4c-e56f-4340-9b6c-088a41f007a1", "name": "network-vif-plugged", "status": "completed", "tag": "95a7a5ae-105e-4330-a91a-a156314e7022"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:50:23.692061 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-fc2012dc-5be9-4b40-9ed4-7f93ec1d3504 req-8683f355-7a8d-4f12-b8cd-ffc8edb6e970 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:23.692439 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-fc2012dc-5be9-4b40-9ed4-7f93ec1d3504 req-8683f355-7a8d-4f12-b8cd-ffc8edb6e970 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:23.693224 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-fc2012dc-5be9-4b40-9ed4-7f93ec1d3504 req-8683f355-7a8d-4f12-b8cd-ffc8edb6e970 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:23.726779 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-fc2012dc-5be9-4b40-9ed4-7f93ec1d3504 req-8683f355-7a8d-4f12-b8cd-ffc8edb6e970 service nova] Creating event network-vif-plugged:95a7a5ae-105e-4330-a91a-a156314e7022 for instance 4e4e4a4c-e56f-4340-9b6c-088a41f007a1 on n-h1-856895-1 Sep 10 11:50:23.741974 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-fc2012dc-5be9-4b40-9ed4-7f93ec1d3504 req-8683f355-7a8d-4f12-b8cd-ffc8edb6e970 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091463 Sep 10 11:50:23.742607 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1335/2586] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:50:23.752893 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f614516b-8128-49eb-93a7-a23deed35ceb tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:23.753617 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f614516b-8128-49eb-93a7-a23deed35ceb tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: 4e4e4a4c-e56f-4340-9b6c-088a41f007a1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:23.774352 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f614516b-8128-49eb-93a7-a23deed35ceb tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:23.775131 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f614516b-8128-49eb-93a7-a23deed35ceb tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:23.775783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f614516b-8128-49eb-93a7-a23deed35ceb tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:23.776695 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f614516b-8128-49eb-93a7-a23deed35ceb tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:23.777477 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f614516b-8128-49eb-93a7-a23deed35ceb tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:23.778084 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f614516b-8128-49eb-93a7-a23deed35ceb tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:24.066659 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9c8f8538-bf9a-439a-ae40-359e57212e25 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:24.083347 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9c8f8538-bf9a-439a-ae40-359e57212e25 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:24.084820 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9c8f8538-bf9a-439a-ae40-359e57212e25 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:24.086127 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9c8f8538-bf9a-439a-ae40-359e57212e25 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 2954 microversion: 2.32 time: 2.108159 Sep 10 11:50:24.104329 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1252/2587] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:21 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 2954 bytes in 2114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:24.104329 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-403a5a11-70ff-4ad2-a700-0a00fc9ed91f req-85a8c9a1-45b6-4aad-913a-05986b556c8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b2dc8b3-1049-4393-824f-b9786315d5ad", "tag": "4024f0bb-5caf-48f4-b443-b7c8a693e47b"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:50:24.152324 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-403a5a11-70ff-4ad2-a700-0a00fc9ed91f req-85a8c9a1-45b6-4aad-913a-05986b556c8f service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:24.152943 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-403a5a11-70ff-4ad2-a700-0a00fc9ed91f req-85a8c9a1-45b6-4aad-913a-05986b556c8f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:24.153400 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-403a5a11-70ff-4ad2-a700-0a00fc9ed91f req-85a8c9a1-45b6-4aad-913a-05986b556c8f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:24.184745 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-403a5a11-70ff-4ad2-a700-0a00fc9ed91f req-85a8c9a1-45b6-4aad-913a-05986b556c8f service nova] Creating event network-changed:4024f0bb-5caf-48f4-b443-b7c8a693e47b for instance 3b2dc8b3-1049-4393-824f-b9786315d5ad on n-h2-856895-1 Sep 10 11:50:24.197646 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-403a5a11-70ff-4ad2-a700-0a00fc9ed91f req-85a8c9a1-45b6-4aad-913a-05986b556c8f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103197 Sep 10 11:50:24.198770 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1253/2588] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:50:24.208212 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c3818136-4f3e-4810-921e-e985be74bf67 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:24.209410 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c3818136-4f3e-4810-921e-e985be74bf67 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: 3b2dc8b3-1049-4393-824f-b9786315d5ad] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:24.217861 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3818136-4f3e-4810-921e-e985be74bf67 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:24.218881 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3818136-4f3e-4810-921e-e985be74bf67 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:24.219578 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3818136-4f3e-4810-921e-e985be74bf67 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:24.224180 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3818136-4f3e-4810-921e-e985be74bf67 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:24.227954 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3818136-4f3e-4810-921e-e985be74bf67 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:24.228670 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3818136-4f3e-4810-921e-e985be74bf67 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:24.456748 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=10 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:50:24.500523 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f614516b-8128-49eb-93a7-a23deed35ceb tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:24.510215 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f614516b-8128-49eb-93a7-a23deed35ceb tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/4e4e4a4c-e56f-4340-9b6c-088a41f007a1" status: 200 len: 1324 microversion: 2.1 time: 0.761494 Sep 10 11:50:24.510815 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1336/2589] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:23 2022] GET /compute/v2.1/servers/4e4e4a4c-e56f-4340-9b6c-088a41f007a1 => generated 1324 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:24.520319 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4b403c99-b97e-4e51-a528-606cb012279f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:24.531316 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4b403c99-b97e-4e51-a528-606cb012279f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 10b130d5-dcd3-41e9-9e67-c68eb28726a2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:24.546888 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b403c99-b97e-4e51-a528-606cb012279f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:24.547608 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b403c99-b97e-4e51-a528-606cb012279f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:24.548254 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b403c99-b97e-4e51-a528-606cb012279f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:24.549377 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b403c99-b97e-4e51-a528-606cb012279f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:24.552619 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b403c99-b97e-4e51-a528-606cb012279f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:24.553249 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b403c99-b97e-4e51-a528-606cb012279f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:25.197395 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c3818136-4f3e-4810-921e-e985be74bf67 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:25.211118 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c3818136-4f3e-4810-921e-e985be74bf67 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad" status: 200 len: 1317 microversion: 2.1 time: 1.009146 Sep 10 11:50:25.213329 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1254/2590] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:24 2022] GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad => generated 1317 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:25.225135 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-80aacb19-f40e-4451-b098-5ee8b28f079d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:25.225781 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-80aacb19-f40e-4451-b098-5ee8b28f079d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:25.233413 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4b403c99-b97e-4e51-a528-606cb012279f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:25.240906 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-80aacb19-f40e-4451-b098-5ee8b28f079d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:25.241517 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-80aacb19-f40e-4451-b098-5ee8b28f079d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:25.242285 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-80aacb19-f40e-4451-b098-5ee8b28f079d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:25.243761 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-80aacb19-f40e-4451-b098-5ee8b28f079d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:25.246486 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4b403c99-b97e-4e51-a528-606cb012279f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/10b130d5-dcd3-41e9-9e67-c68eb28726a2" status: 200 len: 1307 microversion: 2.1 time: 0.730424 Sep 10 11:50:25.247352 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-80aacb19-f40e-4451-b098-5ee8b28f079d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:25.247970 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-80aacb19-f40e-4451-b098-5ee8b28f079d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:25.251417 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1337/2591] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:24 2022] GET /compute/v2.1/servers/10b130d5-dcd3-41e9-9e67-c68eb28726a2 => generated 1307 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:25.256738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-504b86f7-9a7d-4421-ba08-7b9bb5b90346 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:25.260698 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-504b86f7-9a7d-4421-ba08-7b9bb5b90346 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:25.294558 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-504b86f7-9a7d-4421-ba08-7b9bb5b90346 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:25.297561 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-504b86f7-9a7d-4421-ba08-7b9bb5b90346 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:25.298282 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-504b86f7-9a7d-4421-ba08-7b9bb5b90346 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:25.299872 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-504b86f7-9a7d-4421-ba08-7b9bb5b90346 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:25.302678 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-504b86f7-9a7d-4421-ba08-7b9bb5b90346 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:25.303425 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-504b86f7-9a7d-4421-ba08-7b9bb5b90346 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:25.500237 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-80aacb19-f40e-4451-b098-5ee8b28f079d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:25.509502 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-80aacb19-f40e-4451-b098-5ee8b28f079d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:25.511500 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-80aacb19-f40e-4451-b098-5ee8b28f079d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:25.519039 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-80aacb19-f40e-4451-b098-5ee8b28f079d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1537 microversion: 2.91 time: 0.304629 Sep 10 11:50:25.520945 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1255/2592] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:25 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1537 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:25.541055 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a3ff325e-b816-4e5f-a9fc-73d754047696 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:25.541981 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a3ff325e-b816-4e5f-a9fc-73d754047696 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: 4e4e4a4c-e56f-4340-9b6c-088a41f007a1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:25.563495 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a3ff325e-b816-4e5f-a9fc-73d754047696 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:25.565321 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a3ff325e-b816-4e5f-a9fc-73d754047696 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:25.566187 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a3ff325e-b816-4e5f-a9fc-73d754047696 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:25.567331 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a3ff325e-b816-4e5f-a9fc-73d754047696 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:25.568009 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a3ff325e-b816-4e5f-a9fc-73d754047696 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:25.569268 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a3ff325e-b816-4e5f-a9fc-73d754047696 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:25.854121 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-504b86f7-9a7d-4421-ba08-7b9bb5b90346 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:25.868224 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-504b86f7-9a7d-4421-ba08-7b9bb5b90346 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:25.870005 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-504b86f7-9a7d-4421-ba08-7b9bb5b90346 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:25.871884 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-504b86f7-9a7d-4421-ba08-7b9bb5b90346 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 2933 microversion: 2.32 time: 0.619053 Sep 10 11:50:25.872638 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1338/2593] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:25 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 2933 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:25.879242 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-19379e29-375d-409d-8a33-4f5c9c307161 req-208f1039-00e0-40f7-84c4-522a99d96601 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d86e1b80-a305-48c7-9c51-ef4175a5840c", "name": "network-vif-unplugged", "status": "completed", "tag": "f5d4ab4f-0cbe-4d63-a759-332a06ede2bf"}, {"server_uuid": "d86e1b80-a305-48c7-9c51-ef4175a5840c", "name": "network-vif-unplugged", "status": "completed", "tag": "edef956a-da07-48ce-8164-a4f13ac10d0b"}, {"server_uuid": "d86e1b80-a305-48c7-9c51-ef4175a5840c", "name": "network-vif-unplugged", "status": "completed", "tag": "1044ecab-729c-4007-8cd5-f7510a291677"}, {"server_uuid": "d86e1b80-a305-48c7-9c51-ef4175a5840c", "name": "network-vif-unplugged", "status": "completed", "tag": "e0df91dd-9b58-4a4f-abcf-93e91dd253ff"}, {"server_uuid": "d86e1b80-a305-48c7-9c51-ef4175a5840c", "name": "network-vif-unplugged", "status": "completed", "tag": "fdbc5dc3-2de5-4f0c-8eca-af1d0dcbbfca"}, {"server_uuid": "d86e1b80-a305-48c7-9c51-ef4175a5840c", "name": "network-vif-unplugged", "status": "completed", "tag": "6ccddaf2-efc8-42e5-9c38-3ba375ee3f68"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:50:25.894894 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-19379e29-375d-409d-8a33-4f5c9c307161 req-208f1039-00e0-40f7-84c4-522a99d96601 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:25.895613 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-19379e29-375d-409d-8a33-4f5c9c307161 req-208f1039-00e0-40f7-84c4-522a99d96601 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:25.896235 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-19379e29-375d-409d-8a33-4f5c9c307161 req-208f1039-00e0-40f7-84c4-522a99d96601 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:25.927356 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-19379e29-375d-409d-8a33-4f5c9c307161 req-208f1039-00e0-40f7-84c4-522a99d96601 service nova] Creating event network-vif-unplugged:f5d4ab4f-0cbe-4d63-a759-332a06ede2bf for instance d86e1b80-a305-48c7-9c51-ef4175a5840c on n-h2-856895-1 Sep 10 11:50:25.932519 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-19379e29-375d-409d-8a33-4f5c9c307161 req-208f1039-00e0-40f7-84c4-522a99d96601 service nova] Creating event network-vif-unplugged:edef956a-da07-48ce-8164-a4f13ac10d0b for instance d86e1b80-a305-48c7-9c51-ef4175a5840c on n-h2-856895-1 Sep 10 11:50:25.934973 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-19379e29-375d-409d-8a33-4f5c9c307161 req-208f1039-00e0-40f7-84c4-522a99d96601 service nova] Creating event network-vif-unplugged:1044ecab-729c-4007-8cd5-f7510a291677 for instance d86e1b80-a305-48c7-9c51-ef4175a5840c on n-h2-856895-1 Sep 10 11:50:25.936943 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-19379e29-375d-409d-8a33-4f5c9c307161 req-208f1039-00e0-40f7-84c4-522a99d96601 service nova] Creating event network-vif-unplugged:e0df91dd-9b58-4a4f-abcf-93e91dd253ff for instance d86e1b80-a305-48c7-9c51-ef4175a5840c on n-h2-856895-1 Sep 10 11:50:25.940399 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-19379e29-375d-409d-8a33-4f5c9c307161 req-208f1039-00e0-40f7-84c4-522a99d96601 service nova] Creating event network-vif-unplugged:fdbc5dc3-2de5-4f0c-8eca-af1d0dcbbfca for instance d86e1b80-a305-48c7-9c51-ef4175a5840c on n-h2-856895-1 Sep 10 11:50:25.941312 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-19379e29-375d-409d-8a33-4f5c9c307161 req-208f1039-00e0-40f7-84c4-522a99d96601 service nova] Creating event network-vif-unplugged:6ccddaf2-efc8-42e5-9c38-3ba375ee3f68 for instance d86e1b80-a305-48c7-9c51-ef4175a5840c on n-h2-856895-1 Sep 10 11:50:25.949459 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-19379e29-375d-409d-8a33-4f5c9c307161 req-208f1039-00e0-40f7-84c4-522a99d96601 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1050 microversion: 2.1 time: 0.075468 Sep 10 11:50:25.950504 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1339/2594] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 1050 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:26.048200 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a3ff325e-b816-4e5f-a9fc-73d754047696 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:26.075100 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a3ff325e-b816-4e5f-a9fc-73d754047696 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/4e4e4a4c-e56f-4340-9b6c-088a41f007a1" status: 200 len: 1324 microversion: 2.1 time: 0.540306 Sep 10 11:50:26.077446 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1256/2595] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:25 2022] GET /compute/v2.1/servers/4e4e4a4c-e56f-4340-9b6c-088a41f007a1 => generated 1324 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:50:26.243644 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2b45a8b4-d6b8-4304-a989-a6704f5cd310 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:26.245987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2b45a8b4-d6b8-4304-a989-a6704f5cd310 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: 3b2dc8b3-1049-4393-824f-b9786315d5ad] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:26.255645 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b45a8b4-d6b8-4304-a989-a6704f5cd310 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:26.256439 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b45a8b4-d6b8-4304-a989-a6704f5cd310 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:26.257111 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b45a8b4-d6b8-4304-a989-a6704f5cd310 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:26.257990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b45a8b4-d6b8-4304-a989-a6704f5cd310 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:26.258664 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b45a8b4-d6b8-4304-a989-a6704f5cd310 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:26.259697 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b45a8b4-d6b8-4304-a989-a6704f5cd310 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:26.278226 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0963364c-507d-4263-a8d0-e8c76951b973 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:26.279913 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0963364c-507d-4263-a8d0-e8c76951b973 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 10b130d5-dcd3-41e9-9e67-c68eb28726a2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:26.290555 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0963364c-507d-4263-a8d0-e8c76951b973 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:26.294872 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0963364c-507d-4263-a8d0-e8c76951b973 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:26.296765 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0963364c-507d-4263-a8d0-e8c76951b973 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:26.300598 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0963364c-507d-4263-a8d0-e8c76951b973 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:26.301543 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0963364c-507d-4263-a8d0-e8c76951b973 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:26.303685 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0963364c-507d-4263-a8d0-e8c76951b973 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:26.667311 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0963364c-507d-4263-a8d0-e8c76951b973 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:26.672295 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2b45a8b4-d6b8-4304-a989-a6704f5cd310 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:26.677979 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0963364c-507d-4263-a8d0-e8c76951b973 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/10b130d5-dcd3-41e9-9e67-c68eb28726a2" status: 200 len: 1307 microversion: 2.1 time: 0.404393 Sep 10 11:50:26.679196 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1257/2596] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:26 2022] GET /compute/v2.1/servers/10b130d5-dcd3-41e9-9e67-c68eb28726a2 => generated 1307 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:26.684483 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-3257fff2-4357-4cff-b27c-73c9cd30a9b8 req-8af8c26f-49a5-4be6-8501-78612c79b50b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10b130d5-dcd3-41e9-9e67-c68eb28726a2", "tag": "3eff96c5-ed1a-483c-9684-7de7e46b66f8"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:50:26.695096 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-3257fff2-4357-4cff-b27c-73c9cd30a9b8 req-8af8c26f-49a5-4be6-8501-78612c79b50b service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:26.695710 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-3257fff2-4357-4cff-b27c-73c9cd30a9b8 req-8af8c26f-49a5-4be6-8501-78612c79b50b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:26.696371 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-3257fff2-4357-4cff-b27c-73c9cd30a9b8 req-8af8c26f-49a5-4be6-8501-78612c79b50b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:26.696859 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2b45a8b4-d6b8-4304-a989-a6704f5cd310 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad" status: 200 len: 1317 microversion: 2.1 time: 0.459261 Sep 10 11:50:26.711217 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1340/2597] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:26 2022] GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad => generated 1317 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:26.711450 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-3257fff2-4357-4cff-b27c-73c9cd30a9b8 req-8af8c26f-49a5-4be6-8501-78612c79b50b service nova] Creating event network-changed:3eff96c5-ed1a-483c-9684-7de7e46b66f8 for instance 10b130d5-dcd3-41e9-9e67-c68eb28726a2 on n-h1-856895-1 Sep 10 11:50:26.717196 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5b6fd441-5446-49ba-9609-a19b678bf00a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:26.718819 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-3257fff2-4357-4cff-b27c-73c9cd30a9b8 req-8af8c26f-49a5-4be6-8501-78612c79b50b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037856 Sep 10 11:50:26.719880 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5b6fd441-5446-49ba-9609-a19b678bf00a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:26.720283 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1258/2598] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:50:26.727555 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5b6fd441-5446-49ba-9609-a19b678bf00a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:26.729124 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5b6fd441-5446-49ba-9609-a19b678bf00a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:26.729124 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5b6fd441-5446-49ba-9609-a19b678bf00a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:26.729980 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5b6fd441-5446-49ba-9609-a19b678bf00a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:26.730609 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5b6fd441-5446-49ba-9609-a19b678bf00a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:26.731323 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5b6fd441-5446-49ba-9609-a19b678bf00a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:26.737365 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:50:26.832351 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5b6fd441-5446-49ba-9609-a19b678bf00a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:26.844503 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5b6fd441-5446-49ba-9609-a19b678bf00a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:26.846767 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5b6fd441-5446-49ba-9609-a19b678bf00a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:26.859840 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5b6fd441-5446-49ba-9609-a19b678bf00a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1537 microversion: 2.91 time: 0.156415 Sep 10 11:50:26.860441 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1341/2599] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:26 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1537 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:26.905696 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bc966ae1-abf8-43fc-8a10-8eb0a072e79f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:26.906713 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bc966ae1-abf8-43fc-8a10-8eb0a072e79f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:26.914806 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc966ae1-abf8-43fc-8a10-8eb0a072e79f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:26.915584 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc966ae1-abf8-43fc-8a10-8eb0a072e79f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:26.916039 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc966ae1-abf8-43fc-8a10-8eb0a072e79f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:26.917112 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc966ae1-abf8-43fc-8a10-8eb0a072e79f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:26.918115 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc966ae1-abf8-43fc-8a10-8eb0a072e79f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:26.922570 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc966ae1-abf8-43fc-8a10-8eb0a072e79f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:27.099513 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1880218a-b564-47e4-afd6-89b41ca3fb59 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:27.101109 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1880218a-b564-47e4-afd6-89b41ca3fb59 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: 4e4e4a4c-e56f-4340-9b6c-088a41f007a1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:27.110550 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1880218a-b564-47e4-afd6-89b41ca3fb59 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:27.122129 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1880218a-b564-47e4-afd6-89b41ca3fb59 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:27.122979 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1880218a-b564-47e4-afd6-89b41ca3fb59 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:27.124021 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1880218a-b564-47e4-afd6-89b41ca3fb59 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:27.124733 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1880218a-b564-47e4-afd6-89b41ca3fb59 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:27.125238 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1880218a-b564-47e4-afd6-89b41ca3fb59 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:27.252598 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bc966ae1-abf8-43fc-8a10-8eb0a072e79f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:27.264639 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bc966ae1-abf8-43fc-8a10-8eb0a072e79f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:27.266476 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bc966ae1-abf8-43fc-8a10-8eb0a072e79f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:27.268493 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bc966ae1-abf8-43fc-8a10-8eb0a072e79f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 2912 microversion: 2.32 time: 0.368696 Sep 10 11:50:27.269234 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1259/2600] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:26 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 2912 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:27.424914 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1880218a-b564-47e4-afd6-89b41ca3fb59 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:27.436354 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1880218a-b564-47e4-afd6-89b41ca3fb59 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/4e4e4a4c-e56f-4340-9b6c-088a41f007a1" status: 200 len: 1520 microversion: 2.1 time: 0.341786 Sep 10 11:50:27.437994 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1342/2601] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:27 2022] GET /compute/v2.1/servers/4e4e4a4c-e56f-4340-9b6c-088a41f007a1 => generated 1520 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:50:27.444417 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-d4f4ebb2-a788-446d-9fb8-65912043503a req-4f9a2682-8c2f-4c36-bec6-cc29a1b58501 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d86e1b80-a305-48c7-9c51-ef4175a5840c", "name": "network-vif-deleted", "tag": "1044ecab-729c-4007-8cd5-f7510a291677"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:50:27.464831 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d4f4ebb2-a788-446d-9fb8-65912043503a req-4f9a2682-8c2f-4c36-bec6-cc29a1b58501 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:27.465719 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d4f4ebb2-a788-446d-9fb8-65912043503a req-4f9a2682-8c2f-4c36-bec6-cc29a1b58501 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:27.466414 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c435f612-136a-4f31-ac27-9dfae68e4186 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:27.466624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d4f4ebb2-a788-446d-9fb8-65912043503a req-4f9a2682-8c2f-4c36-bec6-cc29a1b58501 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:27.467526 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c435f612-136a-4f31-ac27-9dfae68e4186 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: 4e4e4a4c-e56f-4340-9b6c-088a41f007a1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:27.481402 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c435f612-136a-4f31-ac27-9dfae68e4186 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:27.482030 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c435f612-136a-4f31-ac27-9dfae68e4186 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:27.483435 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c435f612-136a-4f31-ac27-9dfae68e4186 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:27.484396 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c435f612-136a-4f31-ac27-9dfae68e4186 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:27.484792 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-d4f4ebb2-a788-446d-9fb8-65912043503a req-4f9a2682-8c2f-4c36-bec6-cc29a1b58501 service nova] Creating event network-vif-deleted:1044ecab-729c-4007-8cd5-f7510a291677 for instance d86e1b80-a305-48c7-9c51-ef4175a5840c on n-h2-856895-1 Sep 10 11:50:27.485321 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c435f612-136a-4f31-ac27-9dfae68e4186 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:27.485968 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c435f612-136a-4f31-ac27-9dfae68e4186 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:27.500808 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-d4f4ebb2-a788-446d-9fb8-65912043503a req-4f9a2682-8c2f-4c36-bec6-cc29a1b58501 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.229901 Sep 10 11:50:27.502301 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1260/2602] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:50:27.543723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c435f612-136a-4f31-ac27-9dfae68e4186 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: 4e4e4a4c-e56f-4340-9b6c-088a41f007a1] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:50:27.664588 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c435f612-136a-4f31-ac27-9dfae68e4186 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4e4e4a4c-e56f-4340-9b6c-088a41f007a1" status: 204 len: 0 microversion: 2.1 time: 0.202682 Sep 10 11:50:27.668753 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1343/2603] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:50:27 2022] DELETE /compute/v2.1/servers/4e4e4a4c-e56f-4340-9b6c-088a41f007a1 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 11:50:27.676828 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8aafba8e-edba-49e7-b12e-6b13260c4618 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:27.677862 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8aafba8e-edba-49e7-b12e-6b13260c4618 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: 4e4e4a4c-e56f-4340-9b6c-088a41f007a1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:27.685604 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8aafba8e-edba-49e7-b12e-6b13260c4618 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:27.686106 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8aafba8e-edba-49e7-b12e-6b13260c4618 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:27.686544 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8aafba8e-edba-49e7-b12e-6b13260c4618 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:27.687286 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8aafba8e-edba-49e7-b12e-6b13260c4618 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:27.687918 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8aafba8e-edba-49e7-b12e-6b13260c4618 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:27.688505 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8aafba8e-edba-49e7-b12e-6b13260c4618 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:27.693541 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:50:27.702701 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2c067e16-56b2-4bf1-af6d-0b71bd4b71bc tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:27.703445 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2c067e16-56b2-4bf1-af6d-0b71bd4b71bc tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 10b130d5-dcd3-41e9-9e67-c68eb28726a2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:27.720261 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c067e16-56b2-4bf1-af6d-0b71bd4b71bc tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:27.722930 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c067e16-56b2-4bf1-af6d-0b71bd4b71bc tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:27.730020 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c067e16-56b2-4bf1-af6d-0b71bd4b71bc tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:27.730020 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c067e16-56b2-4bf1-af6d-0b71bd4b71bc tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:27.730020 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c067e16-56b2-4bf1-af6d-0b71bd4b71bc tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:27.730020 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c067e16-56b2-4bf1-af6d-0b71bd4b71bc tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:28.107747 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8aafba8e-edba-49e7-b12e-6b13260c4618 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:28.138926 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8aafba8e-edba-49e7-b12e-6b13260c4618 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/4e4e4a4c-e56f-4340-9b6c-088a41f007a1" status: 200 len: 1526 microversion: 2.1 time: 0.468198 Sep 10 11:50:28.139649 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1261/2604] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:27 2022] GET /compute/v2.1/servers/4e4e4a4c-e56f-4340-9b6c-088a41f007a1 => generated 1526 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:28.144912 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bb80c076-7183-47a5-959f-70eeaa7a8a59 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:28.148019 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bb80c076-7183-47a5-959f-70eeaa7a8a59 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: 3b2dc8b3-1049-4393-824f-b9786315d5ad] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:28.154835 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bb80c076-7183-47a5-959f-70eeaa7a8a59 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:28.155568 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bb80c076-7183-47a5-959f-70eeaa7a8a59 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:28.156166 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bb80c076-7183-47a5-959f-70eeaa7a8a59 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:28.157034 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bb80c076-7183-47a5-959f-70eeaa7a8a59 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:28.158901 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bb80c076-7183-47a5-959f-70eeaa7a8a59 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:28.159826 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bb80c076-7183-47a5-959f-70eeaa7a8a59 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:28.172939 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2c067e16-56b2-4bf1-af6d-0b71bd4b71bc tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:28.184609 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2c067e16-56b2-4bf1-af6d-0b71bd4b71bc tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/10b130d5-dcd3-41e9-9e67-c68eb28726a2" status: 200 len: 1307 microversion: 2.1 time: 0.487000 Sep 10 11:50:28.187086 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1344/2605] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:27 2022] GET /compute/v2.1/servers/10b130d5-dcd3-41e9-9e67-c68eb28726a2 => generated 1307 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:50:28.202928 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-91da467c-0071-4e72-b905-974e8408748d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:28.203978 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-91da467c-0071-4e72-b905-974e8408748d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:28.212564 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-91da467c-0071-4e72-b905-974e8408748d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:28.213293 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-91da467c-0071-4e72-b905-974e8408748d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:28.214099 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-91da467c-0071-4e72-b905-974e8408748d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:28.214999 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-91da467c-0071-4e72-b905-974e8408748d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:28.215695 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-91da467c-0071-4e72-b905-974e8408748d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:28.216299 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-91da467c-0071-4e72-b905-974e8408748d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:28.415461 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-91da467c-0071-4e72-b905-974e8408748d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:28.430288 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-91da467c-0071-4e72-b905-974e8408748d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:28.431881 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-91da467c-0071-4e72-b905-974e8408748d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:28.447784 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-91da467c-0071-4e72-b905-974e8408748d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1537 microversion: 2.91 time: 0.251141 Sep 10 11:50:28.467957 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1345/2606] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:28 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1537 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:28.475118 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4b5678dc-8d4d-4b3e-874a-ca6702f2043d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:28.476081 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4b5678dc-8d4d-4b3e-874a-ca6702f2043d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:28.483054 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b5678dc-8d4d-4b3e-874a-ca6702f2043d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:28.483852 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b5678dc-8d4d-4b3e-874a-ca6702f2043d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:28.484524 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b5678dc-8d4d-4b3e-874a-ca6702f2043d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:28.485414 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b5678dc-8d4d-4b3e-874a-ca6702f2043d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:28.486583 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b5678dc-8d4d-4b3e-874a-ca6702f2043d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:28.487297 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b5678dc-8d4d-4b3e-874a-ca6702f2043d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:28.527945 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bb80c076-7183-47a5-959f-70eeaa7a8a59 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:28.543771 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bb80c076-7183-47a5-959f-70eeaa7a8a59 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad" status: 200 len: 1317 microversion: 2.1 time: 0.397074 Sep 10 11:50:28.544954 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1262/2607] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:28 2022] GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad => generated 1317 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:28.764016 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4b5678dc-8d4d-4b3e-874a-ca6702f2043d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:28.783800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4b5678dc-8d4d-4b3e-874a-ca6702f2043d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:28.787792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4b5678dc-8d4d-4b3e-874a-ca6702f2043d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:28.790109 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4b5678dc-8d4d-4b3e-874a-ca6702f2043d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 2706 microversion: 2.32 time: 0.320182 Sep 10 11:50:28.791397 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1346/2608] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:28 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 2706 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:29.164756 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-10d10396-6fde-4923-ad89-6ef8e835a705 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:29.165391 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-10d10396-6fde-4923-ad89-6ef8e835a705 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: 4e4e4a4c-e56f-4340-9b6c-088a41f007a1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:29.167358 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=8 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:50:29.179252 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10d10396-6fde-4923-ad89-6ef8e835a705 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:29.179821 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10d10396-6fde-4923-ad89-6ef8e835a705 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:29.180269 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10d10396-6fde-4923-ad89-6ef8e835a705 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:29.181652 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10d10396-6fde-4923-ad89-6ef8e835a705 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:29.182131 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10d10396-6fde-4923-ad89-6ef8e835a705 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:29.182568 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10d10396-6fde-4923-ad89-6ef8e835a705 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:29.211125 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cac4e4b1-c478-4d6c-b879-53ac504b2c77 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:29.212150 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cac4e4b1-c478-4d6c-b879-53ac504b2c77 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 10b130d5-dcd3-41e9-9e67-c68eb28726a2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:29.225280 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cac4e4b1-c478-4d6c-b879-53ac504b2c77 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:29.226057 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cac4e4b1-c478-4d6c-b879-53ac504b2c77 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:29.226665 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cac4e4b1-c478-4d6c-b879-53ac504b2c77 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:29.229680 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cac4e4b1-c478-4d6c-b879-53ac504b2c77 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:29.231838 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cac4e4b1-c478-4d6c-b879-53ac504b2c77 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:29.233321 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cac4e4b1-c478-4d6c-b879-53ac504b2c77 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:29.571982 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=16 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:50:29.883716 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-10d10396-6fde-4923-ad89-6ef8e835a705 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:29.894159 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-10d10396-6fde-4923-ad89-6ef8e835a705 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/4e4e4a4c-e56f-4340-9b6c-088a41f007a1" status: 200 len: 1526 microversion: 2.1 time: 0.733149 Sep 10 11:50:29.895411 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1263/2609] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:29 2022] GET /compute/v2.1/servers/4e4e4a4c-e56f-4340-9b6c-088a41f007a1 => generated 1526 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:29.901150 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-18468a65-38a3-481a-81a0-fc9538b6f140 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:29.902771 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-18468a65-38a3-481a-81a0-fc9538b6f140 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:29.910542 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-18468a65-38a3-481a-81a0-fc9538b6f140 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:29.911311 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-18468a65-38a3-481a-81a0-fc9538b6f140 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:29.911927 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-18468a65-38a3-481a-81a0-fc9538b6f140 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:29.912932 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-18468a65-38a3-481a-81a0-fc9538b6f140 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:29.913537 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-18468a65-38a3-481a-81a0-fc9538b6f140 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:29.914155 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-18468a65-38a3-481a-81a0-fc9538b6f140 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:29.969748 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cac4e4b1-c478-4d6c-b879-53ac504b2c77 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:29.978734 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cac4e4b1-c478-4d6c-b879-53ac504b2c77 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/10b130d5-dcd3-41e9-9e67-c68eb28726a2" status: 200 len: 1307 microversion: 2.1 time: 0.772351 Sep 10 11:50:29.979352 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1347/2610] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:29 2022] GET /compute/v2.1/servers/10b130d5-dcd3-41e9-9e67-c68eb28726a2 => generated 1307 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:50:29.994432 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-46254d76-0c9e-4b6e-b440-6b61d2c42e50 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:29.995049 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-46254d76-0c9e-4b6e-b440-6b61d2c42e50 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: 3b2dc8b3-1049-4393-824f-b9786315d5ad] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:30.006903 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46254d76-0c9e-4b6e-b440-6b61d2c42e50 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:30.007686 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46254d76-0c9e-4b6e-b440-6b61d2c42e50 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:30.008283 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46254d76-0c9e-4b6e-b440-6b61d2c42e50 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:30.009198 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46254d76-0c9e-4b6e-b440-6b61d2c42e50 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:30.009882 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46254d76-0c9e-4b6e-b440-6b61d2c42e50 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:30.010461 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46254d76-0c9e-4b6e-b440-6b61d2c42e50 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:30.049793 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-18468a65-38a3-481a-81a0-fc9538b6f140 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:30.060879 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-18468a65-38a3-481a-81a0-fc9538b6f140 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:30.062699 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-18468a65-38a3-481a-81a0-fc9538b6f140 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:30.070249 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-18468a65-38a3-481a-81a0-fc9538b6f140 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1537 microversion: 2.91 time: 0.173612 Sep 10 11:50:30.071408 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1264/2611] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:29 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1537 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:30.088878 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-404ae8f7-b11d-400e-83a4-d5993d4bfe83 req-d6c04298-c005-43a9-b04e-305b9dac6ecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d86e1b80-a305-48c7-9c51-ef4175a5840c", "name": "network-vif-deleted", "tag": "edef956a-da07-48ce-8164-a4f13ac10d0b"}, {"server_uuid": "d86e1b80-a305-48c7-9c51-ef4175a5840c", "name": "network-vif-deleted", "tag": "e0df91dd-9b58-4a4f-abcf-93e91dd253ff"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:50:30.107750 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-404ae8f7-b11d-400e-83a4-d5993d4bfe83 req-d6c04298-c005-43a9-b04e-305b9dac6ecb service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:30.116859 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-404ae8f7-b11d-400e-83a4-d5993d4bfe83 req-d6c04298-c005-43a9-b04e-305b9dac6ecb service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:30.117718 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-404ae8f7-b11d-400e-83a4-d5993d4bfe83 req-d6c04298-c005-43a9-b04e-305b9dac6ecb service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:30.133613 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-404ae8f7-b11d-400e-83a4-d5993d4bfe83 req-d6c04298-c005-43a9-b04e-305b9dac6ecb service nova] Creating event network-vif-deleted:edef956a-da07-48ce-8164-a4f13ac10d0b for instance d86e1b80-a305-48c7-9c51-ef4175a5840c on n-h2-856895-1 Sep 10 11:50:30.134386 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-404ae8f7-b11d-400e-83a4-d5993d4bfe83 req-d6c04298-c005-43a9-b04e-305b9dac6ecb service nova] Creating event network-vif-deleted:e0df91dd-9b58-4a4f-abcf-93e91dd253ff for instance d86e1b80-a305-48c7-9c51-ef4175a5840c on n-h2-856895-1 Sep 10 11:50:30.141562 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-404ae8f7-b11d-400e-83a4-d5993d4bfe83 req-d6c04298-c005-43a9-b04e-305b9dac6ecb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.068671 Sep 10 11:50:30.143316 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1265/2612] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:50:30.163752 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bb847d8d-f8bf-48ff-b02f-9314e920a3dd tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:30.166489 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bb847d8d-f8bf-48ff-b02f-9314e920a3dd tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:30.180024 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bb847d8d-f8bf-48ff-b02f-9314e920a3dd tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:30.180789 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bb847d8d-f8bf-48ff-b02f-9314e920a3dd tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:30.181233 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bb847d8d-f8bf-48ff-b02f-9314e920a3dd tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:30.182002 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bb847d8d-f8bf-48ff-b02f-9314e920a3dd tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:30.182465 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bb847d8d-f8bf-48ff-b02f-9314e920a3dd tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:30.182889 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bb847d8d-f8bf-48ff-b02f-9314e920a3dd tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:30.378699 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-46254d76-0c9e-4b6e-b440-6b61d2c42e50 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:30.388369 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-46254d76-0c9e-4b6e-b440-6b61d2c42e50 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad" status: 200 len: 1317 microversion: 2.1 time: 0.398322 Sep 10 11:50:30.389327 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1348/2613] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:29 2022] GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad => generated 1317 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:30.478897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bb847d8d-f8bf-48ff-b02f-9314e920a3dd tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:30.490273 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bb847d8d-f8bf-48ff-b02f-9314e920a3dd tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:30.491879 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bb847d8d-f8bf-48ff-b02f-9314e920a3dd tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:30.493340 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bb847d8d-f8bf-48ff-b02f-9314e920a3dd tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 2500 microversion: 2.32 time: 0.348541 Sep 10 11:50:30.494066 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1266/2614] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:30 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 2500 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:30.920827 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e2b86dea-26a6-419b-8a43-c4a3eda97d50 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:30.921694 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e2b86dea-26a6-419b-8a43-c4a3eda97d50 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: 4e4e4a4c-e56f-4340-9b6c-088a41f007a1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:30.932967 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e2b86dea-26a6-419b-8a43-c4a3eda97d50 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:30.935874 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e2b86dea-26a6-419b-8a43-c4a3eda97d50 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:30.936864 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e2b86dea-26a6-419b-8a43-c4a3eda97d50 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:30.937752 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e2b86dea-26a6-419b-8a43-c4a3eda97d50 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:30.940794 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e2b86dea-26a6-419b-8a43-c4a3eda97d50 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:30.941644 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e2b86dea-26a6-419b-8a43-c4a3eda97d50 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:31.003972 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0bd6d78d-997f-4944-ac5a-d47a1670a491 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:31.004702 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0bd6d78d-997f-4944-ac5a-d47a1670a491 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 10b130d5-dcd3-41e9-9e67-c68eb28726a2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:31.018907 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0bd6d78d-997f-4944-ac5a-d47a1670a491 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:31.019593 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0bd6d78d-997f-4944-ac5a-d47a1670a491 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:31.019919 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0bd6d78d-997f-4944-ac5a-d47a1670a491 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:31.020646 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0bd6d78d-997f-4944-ac5a-d47a1670a491 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:31.027537 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0bd6d78d-997f-4944-ac5a-d47a1670a491 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:31.030696 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0bd6d78d-997f-4944-ac5a-d47a1670a491 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:31.404360 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e2b86dea-26a6-419b-8a43-c4a3eda97d50 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:31.458169 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e2b86dea-26a6-419b-8a43-c4a3eda97d50 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/4e4e4a4c-e56f-4340-9b6c-088a41f007a1" status: 200 len: 1526 microversion: 2.1 time: 0.542424 Sep 10 11:50:31.458887 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0bd6d78d-997f-4944-ac5a-d47a1670a491 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:31.462190 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1349/2615] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:30 2022] GET /compute/v2.1/servers/4e4e4a4c-e56f-4340-9b6c-088a41f007a1 => generated 1526 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:31.467916 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0bd6d78d-997f-4944-ac5a-d47a1670a491 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/10b130d5-dcd3-41e9-9e67-c68eb28726a2" status: 200 len: 1307 microversion: 2.1 time: 0.469408 Sep 10 11:50:31.480474 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a0b8b1e2-15ec-4d3c-9252-6e52ccf2cf77 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:31.492115 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1267/2616] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:30 2022] GET /compute/v2.1/servers/10b130d5-dcd3-41e9-9e67-c68eb28726a2 => generated 1307 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:31.501818 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a0b8b1e2-15ec-4d3c-9252-6e52ccf2cf77 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:31.504787 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-148339e0-9dbd-424b-8ea9-a4985237f78d req-1f7bab64-e89e-4c4c-bd3d-bd13fc5410a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b2dc8b3-1049-4393-824f-b9786315d5ad", "name": "network-vif-plugged", "status": "completed", "tag": "4024f0bb-5caf-48f4-b443-b7c8a693e47b"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:50:31.533640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a0b8b1e2-15ec-4d3c-9252-6e52ccf2cf77 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:31.534845 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-148339e0-9dbd-424b-8ea9-a4985237f78d req-1f7bab64-e89e-4c4c-bd3d-bd13fc5410a1 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:31.535417 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-148339e0-9dbd-424b-8ea9-a4985237f78d req-1f7bab64-e89e-4c4c-bd3d-bd13fc5410a1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:31.535949 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-148339e0-9dbd-424b-8ea9-a4985237f78d req-1f7bab64-e89e-4c4c-bd3d-bd13fc5410a1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:31.539046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a0b8b1e2-15ec-4d3c-9252-6e52ccf2cf77 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:31.545808 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a0b8b1e2-15ec-4d3c-9252-6e52ccf2cf77 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:31.546599 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a0b8b1e2-15ec-4d3c-9252-6e52ccf2cf77 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:31.547296 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a0b8b1e2-15ec-4d3c-9252-6e52ccf2cf77 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:31.555623 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a0b8b1e2-15ec-4d3c-9252-6e52ccf2cf77 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:31.576422 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-148339e0-9dbd-424b-8ea9-a4985237f78d req-1f7bab64-e89e-4c4c-bd3d-bd13fc5410a1 service nova] Creating event network-vif-plugged:4024f0bb-5caf-48f4-b443-b7c8a693e47b for instance 3b2dc8b3-1049-4393-824f-b9786315d5ad on n-h2-856895-1 Sep 10 11:50:31.586836 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-148339e0-9dbd-424b-8ea9-a4985237f78d req-1f7bab64-e89e-4c4c-bd3d-bd13fc5410a1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092675 Sep 10 11:50:31.588489 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1268/2617] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:50:31.599279 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ac427273-a7de-4c0f-9eb0-21314caa8712 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:31.600283 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ac427273-a7de-4c0f-9eb0-21314caa8712 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: 3b2dc8b3-1049-4393-824f-b9786315d5ad] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:31.631313 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac427273-a7de-4c0f-9eb0-21314caa8712 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:31.633966 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac427273-a7de-4c0f-9eb0-21314caa8712 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:31.636457 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac427273-a7de-4c0f-9eb0-21314caa8712 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:31.637425 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac427273-a7de-4c0f-9eb0-21314caa8712 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:31.638067 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac427273-a7de-4c0f-9eb0-21314caa8712 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:31.640871 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac427273-a7de-4c0f-9eb0-21314caa8712 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:31.733831 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a0b8b1e2-15ec-4d3c-9252-6e52ccf2cf77 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:31.756063 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a0b8b1e2-15ec-4d3c-9252-6e52ccf2cf77 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:31.762497 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a0b8b1e2-15ec-4d3c-9252-6e52ccf2cf77 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:31.770211 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a0b8b1e2-15ec-4d3c-9252-6e52ccf2cf77 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1558 microversion: 2.91 time: 0.306251 Sep 10 11:50:31.771849 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1350/2618] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:31 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1558 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:31.779896 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2ae5f092-94e9-411f-996e-35c670f837bf tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:31.780754 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2ae5f092-94e9-411f-996e-35c670f837bf tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:31.790290 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ae5f092-94e9-411f-996e-35c670f837bf tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:31.791115 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ae5f092-94e9-411f-996e-35c670f837bf tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:31.792116 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ae5f092-94e9-411f-996e-35c670f837bf tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:31.793199 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ae5f092-94e9-411f-996e-35c670f837bf tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:31.795409 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ae5f092-94e9-411f-996e-35c670f837bf tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:31.796023 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ae5f092-94e9-411f-996e-35c670f837bf tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:32.001475 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ac427273-a7de-4c0f-9eb0-21314caa8712 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:32.015272 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ac427273-a7de-4c0f-9eb0-21314caa8712 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad" status: 200 len: 1317 microversion: 2.1 time: 0.425146 Sep 10 11:50:32.022856 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1269/2619] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:31 2022] GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad => generated 1317 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:32.025242 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2ae5f092-94e9-411f-996e-35c670f837bf tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:32.048174 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2ae5f092-94e9-411f-996e-35c670f837bf tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:32.050250 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2ae5f092-94e9-411f-996e-35c670f837bf tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:32.061563 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2ae5f092-94e9-411f-996e-35c670f837bf tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 2275 microversion: 2.32 time: 0.288204 Sep 10 11:50:32.062429 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1351/2620] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:31 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 2275 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:32.170035 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-183ca047-cb32-4b9c-90fb-5ccb3b83cb9a req-fab0a87d-a8d0-4e63-8ebc-d96b761bec1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d86e1b80-a305-48c7-9c51-ef4175a5840c", "name": "network-vif-deleted", "tag": "f5d4ab4f-0cbe-4d63-a759-332a06ede2bf"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:50:32.194983 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-183ca047-cb32-4b9c-90fb-5ccb3b83cb9a req-fab0a87d-a8d0-4e63-8ebc-d96b761bec1f service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:32.195834 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-183ca047-cb32-4b9c-90fb-5ccb3b83cb9a req-fab0a87d-a8d0-4e63-8ebc-d96b761bec1f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:32.197104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-183ca047-cb32-4b9c-90fb-5ccb3b83cb9a req-fab0a87d-a8d0-4e63-8ebc-d96b761bec1f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:32.234040 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-183ca047-cb32-4b9c-90fb-5ccb3b83cb9a req-fab0a87d-a8d0-4e63-8ebc-d96b761bec1f service nova] Creating event network-vif-deleted:f5d4ab4f-0cbe-4d63-a759-332a06ede2bf for instance d86e1b80-a305-48c7-9c51-ef4175a5840c on n-h2-856895-1 Sep 10 11:50:32.242656 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-183ca047-cb32-4b9c-90fb-5ccb3b83cb9a req-fab0a87d-a8d0-4e63-8ebc-d96b761bec1f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078861 Sep 10 11:50:32.243683 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1270/2621] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:50:32.487785 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8e69ddc1-80dd-431a-aea9-1f78011f0bad tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:32.488333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8e69ddc1-80dd-431a-aea9-1f78011f0bad tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: 4e4e4a4c-e56f-4340-9b6c-088a41f007a1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:32.497574 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-24e166ca-00e7-4968-94be-7b6afd7af8bf tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:32.498280 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-24e166ca-00e7-4968-94be-7b6afd7af8bf tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 10b130d5-dcd3-41e9-9e67-c68eb28726a2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:32.514943 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-24e166ca-00e7-4968-94be-7b6afd7af8bf tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:32.517371 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-24e166ca-00e7-4968-94be-7b6afd7af8bf tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:32.518003 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-24e166ca-00e7-4968-94be-7b6afd7af8bf tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:32.518971 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-24e166ca-00e7-4968-94be-7b6afd7af8bf tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:32.529642 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e69ddc1-80dd-431a-aea9-1f78011f0bad tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:32.530449 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e69ddc1-80dd-431a-aea9-1f78011f0bad tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:32.531608 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e69ddc1-80dd-431a-aea9-1f78011f0bad tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:32.532512 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e69ddc1-80dd-431a-aea9-1f78011f0bad tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:32.534111 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e69ddc1-80dd-431a-aea9-1f78011f0bad tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:32.534550 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-24e166ca-00e7-4968-94be-7b6afd7af8bf tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:32.535185 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-24e166ca-00e7-4968-94be-7b6afd7af8bf tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:32.535569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e69ddc1-80dd-431a-aea9-1f78011f0bad tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:33.243400 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-24e166ca-00e7-4968-94be-7b6afd7af8bf tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:33.258061 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-24e166ca-00e7-4968-94be-7b6afd7af8bf tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/10b130d5-dcd3-41e9-9e67-c68eb28726a2" status: 200 len: 1307 microversion: 2.1 time: 0.765143 Sep 10 11:50:33.293975 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8e69ddc1-80dd-431a-aea9-1f78011f0bad tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ced1e84956246b6bb7384ba484fde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5d376048de4c3191a58a547e05fd07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:33.305191 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1271/2622] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:32 2022] GET /compute/v2.1/servers/10b130d5-dcd3-41e9-9e67-c68eb28726a2 => generated 1307 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:50:33.343111 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fa8a8808-2a37-46d4-b91c-4d2b0a4e90ef tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:33.344790 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8e69ddc1-80dd-431a-aea9-1f78011f0bad tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/4e4e4a4c-e56f-4340-9b6c-088a41f007a1" status: 200 len: 1526 microversion: 2.1 time: 0.850943 Sep 10 11:50:33.365912 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1352/2623] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:32 2022] GET /compute/v2.1/servers/4e4e4a4c-e56f-4340-9b6c-088a41f007a1 => generated 1526 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:33.368949 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fa8a8808-2a37-46d4-b91c-4d2b0a4e90ef tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:33.397776 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-503c366e-b68c-4400-b0de-50a496a357c2 req-10803603-4abe-4bb0-948b-c9d864030172 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e4e4a4c-e56f-4340-9b6c-088a41f007a1", "name": "network-vif-deleted", "tag": "95a7a5ae-105e-4330-a91a-a156314e7022"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:50:33.408499 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa8a8808-2a37-46d4-b91c-4d2b0a4e90ef tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:33.409344 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa8a8808-2a37-46d4-b91c-4d2b0a4e90ef tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:33.409971 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa8a8808-2a37-46d4-b91c-4d2b0a4e90ef tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:33.410853 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa8a8808-2a37-46d4-b91c-4d2b0a4e90ef tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:33.411508 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa8a8808-2a37-46d4-b91c-4d2b0a4e90ef tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:33.413176 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa8a8808-2a37-46d4-b91c-4d2b0a4e90ef tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:33.433456 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-503c366e-b68c-4400-b0de-50a496a357c2 req-10803603-4abe-4bb0-948b-c9d864030172 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:33.434008 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-503c366e-b68c-4400-b0de-50a496a357c2 req-10803603-4abe-4bb0-948b-c9d864030172 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:33.434453 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-503c366e-b68c-4400-b0de-50a496a357c2 req-10803603-4abe-4bb0-948b-c9d864030172 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:33.466832 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-503c366e-b68c-4400-b0de-50a496a357c2 req-10803603-4abe-4bb0-948b-c9d864030172 service nova] Creating event network-vif-deleted:95a7a5ae-105e-4330-a91a-a156314e7022 for instance 4e4e4a4c-e56f-4340-9b6c-088a41f007a1 on n-h1-856895-1 Sep 10 11:50:33.491664 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-503c366e-b68c-4400-b0de-50a496a357c2 req-10803603-4abe-4bb0-948b-c9d864030172 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123914 Sep 10 11:50:33.495021 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1353/2624] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:50:33.510059 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4a9c9d0d-5346-4942-ab6d-d8bbf89b51a7 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:33.511744 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4a9c9d0d-5346-4942-ab6d-d8bbf89b51a7 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: 3b2dc8b3-1049-4393-824f-b9786315d5ad] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:33.525112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:50:33.528069 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a9c9d0d-5346-4942-ab6d-d8bbf89b51a7 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:33.541120 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a9c9d0d-5346-4942-ab6d-d8bbf89b51a7 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:33.542138 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a9c9d0d-5346-4942-ab6d-d8bbf89b51a7 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:33.543646 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a9c9d0d-5346-4942-ab6d-d8bbf89b51a7 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:33.546106 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a9c9d0d-5346-4942-ab6d-d8bbf89b51a7 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:33.546735 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a9c9d0d-5346-4942-ab6d-d8bbf89b51a7 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:33.596107 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fa8a8808-2a37-46d4-b91c-4d2b0a4e90ef tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:33.631824 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fa8a8808-2a37-46d4-b91c-4d2b0a4e90ef tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:33.633897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fa8a8808-2a37-46d4-b91c-4d2b0a4e90ef tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:33.649978 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fa8a8808-2a37-46d4-b91c-4d2b0a4e90ef tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1558 microversion: 2.91 time: 0.336428 Sep 10 11:50:33.652372 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1272/2625] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:33 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1558 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:33.671366 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-012015db-7a56-4e80-984b-310dd290dc16 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:33.673577 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-012015db-7a56-4e80-984b-310dd290dc16 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:33.702808 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-012015db-7a56-4e80-984b-310dd290dc16 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:33.708513 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-012015db-7a56-4e80-984b-310dd290dc16 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:33.714131 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-012015db-7a56-4e80-984b-310dd290dc16 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:33.718694 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-012015db-7a56-4e80-984b-310dd290dc16 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:33.719951 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-012015db-7a56-4e80-984b-310dd290dc16 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:33.726315 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-012015db-7a56-4e80-984b-310dd290dc16 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:33.865151 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-012015db-7a56-4e80-984b-310dd290dc16 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:33.874723 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-012015db-7a56-4e80-984b-310dd290dc16 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:33.876196 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-012015db-7a56-4e80-984b-310dd290dc16 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:33.877789 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-012015db-7a56-4e80-984b-310dd290dc16 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1605 microversion: 2.32 time: 0.223795 Sep 10 11:50:33.903645 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1273/2626] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:33 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1605 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:33.958884 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4a9c9d0d-5346-4942-ab6d-d8bbf89b51a7 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:33.968540 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4a9c9d0d-5346-4942-ab6d-d8bbf89b51a7 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad" status: 200 len: 1317 microversion: 2.1 time: 0.472133 Sep 10 11:50:33.969902 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1354/2627] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:33 2022] GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad => generated 1317 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:34.268134 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-ba0a2cfe-285f-4cb5-9192-7fce51731f0e req-5032d628-cd70-49c5-92ad-3988050142a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d86e1b80-a305-48c7-9c51-ef4175a5840c", "name": "network-vif-deleted", "tag": "6ccddaf2-efc8-42e5-9c38-3ba375ee3f68"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:50:34.282598 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ba0a2cfe-285f-4cb5-9192-7fce51731f0e req-5032d628-cd70-49c5-92ad-3988050142a3 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:34.283605 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ba0a2cfe-285f-4cb5-9192-7fce51731f0e req-5032d628-cd70-49c5-92ad-3988050142a3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:34.284292 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ba0a2cfe-285f-4cb5-9192-7fce51731f0e req-5032d628-cd70-49c5-92ad-3988050142a3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:34.302522 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fdce0cad-6d01-44a9-8992-e138ad98a410 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:34.303330 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fdce0cad-6d01-44a9-8992-e138ad98a410 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 10b130d5-dcd3-41e9-9e67-c68eb28726a2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:34.310152 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdce0cad-6d01-44a9-8992-e138ad98a410 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:34.311499 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-ba0a2cfe-285f-4cb5-9192-7fce51731f0e req-5032d628-cd70-49c5-92ad-3988050142a3 service nova] Creating event network-vif-deleted:6ccddaf2-efc8-42e5-9c38-3ba375ee3f68 for instance d86e1b80-a305-48c7-9c51-ef4175a5840c on n-h2-856895-1 Sep 10 11:50:34.312080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdce0cad-6d01-44a9-8992-e138ad98a410 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:34.314871 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdce0cad-6d01-44a9-8992-e138ad98a410 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:34.315815 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdce0cad-6d01-44a9-8992-e138ad98a410 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:34.317903 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdce0cad-6d01-44a9-8992-e138ad98a410 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:34.318455 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdce0cad-6d01-44a9-8992-e138ad98a410 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:34.320144 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-ba0a2cfe-285f-4cb5-9192-7fce51731f0e req-5032d628-cd70-49c5-92ad-3988050142a3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056965 Sep 10 11:50:34.322848 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1274/2628] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:50:34.374748 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-47f313f1-55a0-4fc6-b0bf-d9c6863786c8 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:34.376068 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-47f313f1-55a0-4fc6-b0bf-d9c6863786c8 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: 4e4e4a4c-e56f-4340-9b6c-088a41f007a1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:34.390847 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-47f313f1-55a0-4fc6-b0bf-d9c6863786c8 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:34.391388 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-47f313f1-55a0-4fc6-b0bf-d9c6863786c8 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:34.391830 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-47f313f1-55a0-4fc6-b0bf-d9c6863786c8 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:34.396287 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-47f313f1-55a0-4fc6-b0bf-d9c6863786c8 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:34.396813 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-47f313f1-55a0-4fc6-b0bf-d9c6863786c8 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:34.399367 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-47f313f1-55a0-4fc6-b0bf-d9c6863786c8 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:34.435195 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-47f313f1-55a0-4fc6-b0bf-d9c6863786c8 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] HTTP exception thrown: Instance 4e4e4a4c-e56f-4340-9b6c-088a41f007a1 could not be found. Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-47f313f1-55a0-4fc6-b0bf-d9c6863786c8 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Request method failure captured: Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/4e4e4a4c-e56f-4340-9b6c-088a41f007a1 HTTP/1.1 Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHmIwAMwYRG5GoKY2e2BrHSNWC_XC8Dle2TjpsTglJZLl4iDdUWRHXObue6CBNwrU7ByI06vvCBASR59oLGdEXbdGMvKthtN9mtTXSrKa2RC4WmIF4PSo8bwMo95sbb-sIH1rhBMLrXpSep-X_LgFDTkeIXb7VSYHefdo66ew2GGhFc Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 3e5d376048de4c3191a58a547e05fd07 Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1177602115 Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3e5d376048de4c3191a58a547e05fd07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3e5d376048de4c3191a58a547e05fd07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3e5d376048de4c3191a58a547e05fd07", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3e5d376048de4c3191a58a547e05fd07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1177602115 Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 3e5d376048de4c3191a58a547e05fd07 Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1177602115 Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ImagesOneServerNegativeTestJSON-1177602115-project Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 8ced1e84956246b6bb7384ba484fde54 Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1177602115-project Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 4e4e4a4c-e56f-4340-9b6c-088a41f007a1 could not be found. Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '4e4e4a4c-e56f-4340-9b6c-088a41f007a1'} Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e4e4a4c-e56f-4340-9b6c-088a41f007a1 could not be found. Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e4e4a4c-e56f-4340-9b6c-088a41f007a1 could not be found. Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:34.437749 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:50:34.443772 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:34.443772 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:34.443772 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:50:34.443772 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:50:34.443772 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:50:34.443772 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:50:34.443772 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e4e4a4c-e56f-4340-9b6c-088a41f007a1 could not be found. Sep 10 11:50:34.443772 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:34.452094 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-47f313f1-55a0-4fc6-b0bf-d9c6863786c8 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Returning 404 to user: Instance 4e4e4a4c-e56f-4340-9b6c-088a41f007a1 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:50:34.454335 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-47f313f1-55a0-4fc6-b0bf-d9c6863786c8 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/4e4e4a4c-e56f-4340-9b6c-088a41f007a1" status: 404 len: 111 microversion: 2.1 time: 0.084771 Sep 10 11:50:34.458209 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1275/2629] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:34 2022] GET /compute/v2.1/servers/4e4e4a4c-e56f-4340-9b6c-088a41f007a1 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 11:50:34.467957 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c6a3d009-b8b0-41c1-9a42-098a265693d0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '.version_select at 0x7f40734bb280>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:34.519274 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-c6a3d009-b8b0-41c1-9a42-098a265693d0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] HTTP exception thrown: Image not found. Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c6a3d009-b8b0-41c1-9a42-098a265693d0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Request method failure captured: Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/images/0f669b7b-f0c5-47b3-8bd6-6abb3653f288 HTTP/1.1 Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHmIwAMwYRG5GoKY2e2BrHSNWC_XC8Dle2TjpsTglJZLl4iDdUWRHXObue6CBNwrU7ByI06vvCBASR59oLGdEXbdGMvKthtN9mtTXSrKa2RC4WmIF4PSo8bwMo95sbb-sIH1rhBMLrXpSep-X_LgFDTkeIXb7VSYHefdo66ew2GGhFc Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 3e5d376048de4c3191a58a547e05fd07 Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1177602115 Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3e5d376048de4c3191a58a547e05fd07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3e5d376048de4c3191a58a547e05fd07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3e5d376048de4c3191a58a547e05fd07", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3e5d376048de4c3191a58a547e05fd07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1177602115 Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 3e5d376048de4c3191a58a547e05fd07 Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1177602115 Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ImagesOneServerNegativeTestJSON-1177602115-project Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 8ced1e84956246b6bb7384ba484fde54 Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1177602115-project Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: exception: Image not found. Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '0f669b7b-f0c5-47b3-8bd6-6abb3653f288'} Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0f669b7b-f0c5-47b3-8bd6-6abb3653f288 to delete Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0f669b7b-f0c5-47b3-8bd6-6abb3653f288 could not be found. Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:50:34.521096 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:34.525324 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:34.525324 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:50:34.525324 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:50:34.525324 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:50:34.525324 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:50:34.525324 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:50:34.525324 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:50:34.525324 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:50:34.525324 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:50:34.525324 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 10 11:50:34.525324 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 11:50:34.525324 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 11:50:34.525324 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:34.525324 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:50:34.525324 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:34.525324 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:34.525324 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:50:34.525324 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:50:34.525324 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:50:34.525324 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:50:34.525324 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 11:50:34.525324 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:34.525324 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c6a3d009-b8b0-41c1-9a42-098a265693d0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Returning 404 to user: Image not found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:50:34.525324 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c6a3d009-b8b0-41c1-9a42-098a265693d0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "DELETE /compute/v2.1/images/0f669b7b-f0c5-47b3-8bd6-6abb3653f288" status: 404 len: 62 microversion: 2.1 time: 0.059001 Sep 10 11:50:34.525324 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1276/2630] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:34 2022] DELETE /compute/v2.1/images/0f669b7b-f0c5-47b3-8bd6-6abb3653f288 => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:50:34.537186 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a7ec4ca9-10d7-4b3d-bb68-76de650db97a tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:34.537686 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a7ec4ca9-10d7-4b3d-bb68-76de650db97a tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:34.549166 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a7ec4ca9-10d7-4b3d-bb68-76de650db97a tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:34.549667 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a7ec4ca9-10d7-4b3d-bb68-76de650db97a tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:34.550113 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a7ec4ca9-10d7-4b3d-bb68-76de650db97a tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:34.550840 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a7ec4ca9-10d7-4b3d-bb68-76de650db97a tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:34.555088 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a7ec4ca9-10d7-4b3d-bb68-76de650db97a tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:34.555670 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a7ec4ca9-10d7-4b3d-bb68-76de650db97a tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:34.572030 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fdce0cad-6d01-44a9-8992-e138ad98a410 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:34.578701 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-a7ec4ca9-10d7-4b3d-bb68-76de650db97a tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] HTTP exception thrown: Instance c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 could not be found. Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a7ec4ca9-10d7-4b3d-bb68-76de650db97a tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Request method failure captured: Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 HTTP/1.1 Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHmIwAMwYRG5GoKY2e2BrHSNWC_XC8Dle2TjpsTglJZLl4iDdUWRHXObue6CBNwrU7ByI06vvCBASR59oLGdEXbdGMvKthtN9mtTXSrKa2RC4WmIF4PSo8bwMo95sbb-sIH1rhBMLrXpSep-X_LgFDTkeIXb7VSYHefdo66ew2GGhFc Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 3e5d376048de4c3191a58a547e05fd07 Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1177602115 Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3e5d376048de4c3191a58a547e05fd07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3e5d376048de4c3191a58a547e05fd07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3e5d376048de4c3191a58a547e05fd07", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3e5d376048de4c3191a58a547e05fd07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1177602115 Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 3e5d376048de4c3191a58a547e05fd07 Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1177602115 Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ImagesOneServerNegativeTestJSON-1177602115-project Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 8ced1e84956246b6bb7384ba484fde54 Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1177602115-project Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 could not be found. Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9'} Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 could not be found. Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:50:34.580875 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:50:34.585647 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 could not be found. Sep 10 11:50:34.585647 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:34.585647 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:50:34.585647 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:34.585647 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:34.585647 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:50:34.585647 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:50:34.585647 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:50:34.585647 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:50:34.585647 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 could not be found. Sep 10 11:50:34.585647 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:34.585647 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a7ec4ca9-10d7-4b3d-bb68-76de650db97a tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Returning 404 to user: Instance c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:50:34.585647 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a7ec4ca9-10d7-4b3d-bb68-76de650db97a tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9" status: 404 len: 111 microversion: 2.1 time: 0.052466 Sep 10 11:50:34.591068 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fdce0cad-6d01-44a9-8992-e138ad98a410 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/10b130d5-dcd3-41e9-9e67-c68eb28726a2" status: 200 len: 1307 microversion: 2.1 time: 0.292910 Sep 10 11:50:34.592990 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1277/2632] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:50:34 2022] DELETE /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 11:50:34.593116 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1355/2632] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:34 2022] GET /compute/v2.1/servers/10b130d5-dcd3-41e9-9e67-c68eb28726a2 => generated 1307 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:34.624093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8b9e9ffc-5b0a-4bfe-a553-323c5002fcc0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:34.624898 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8b9e9ffc-5b0a-4bfe-a553-323c5002fcc0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:34.638294 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b9e9ffc-5b0a-4bfe-a553-323c5002fcc0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:34.638920 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b9e9ffc-5b0a-4bfe-a553-323c5002fcc0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:34.639285 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b9e9ffc-5b0a-4bfe-a553-323c5002fcc0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:34.640153 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b9e9ffc-5b0a-4bfe-a553-323c5002fcc0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:34.640807 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b9e9ffc-5b0a-4bfe-a553-323c5002fcc0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:34.641425 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b9e9ffc-5b0a-4bfe-a553-323c5002fcc0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:34.685574 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a0255805-0682-48dd-82ef-998346855ad7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:34.686471 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a0255805-0682-48dd-82ef-998346855ad7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:34.692494 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-8b9e9ffc-5b0a-4bfe-a553-323c5002fcc0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] HTTP exception thrown: Instance c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 could not be found. Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8b9e9ffc-5b0a-4bfe-a553-323c5002fcc0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Request method failure captured: Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 HTTP/1.1 Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHmIwAMwYRG5GoKY2e2BrHSNWC_XC8Dle2TjpsTglJZLl4iDdUWRHXObue6CBNwrU7ByI06vvCBASR59oLGdEXbdGMvKthtN9mtTXSrKa2RC4WmIF4PSo8bwMo95sbb-sIH1rhBMLrXpSep-X_LgFDTkeIXb7VSYHefdo66ew2GGhFc Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 3e5d376048de4c3191a58a547e05fd07 Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1177602115 Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3e5d376048de4c3191a58a547e05fd07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3e5d376048de4c3191a58a547e05fd07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3e5d376048de4c3191a58a547e05fd07", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3e5d376048de4c3191a58a547e05fd07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1177602115 Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 3e5d376048de4c3191a58a547e05fd07 Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1177602115 Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ImagesOneServerNegativeTestJSON-1177602115-project Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 8ced1e84956246b6bb7384ba484fde54 Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1177602115-project Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 could not be found. Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9'} Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 could not be found. Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 could not be found. Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:50:34.696299 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:50:34.701204 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:50:34.701204 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:34.701204 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:50:34.701204 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:50:34.701204 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:50:34.701204 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:50:34.701204 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 could not be found. Sep 10 11:50:34.701204 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:50:34.702110 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a0255805-0682-48dd-82ef-998346855ad7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:34.702110 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a0255805-0682-48dd-82ef-998346855ad7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:34.702110 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a0255805-0682-48dd-82ef-998346855ad7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:34.702110 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a0255805-0682-48dd-82ef-998346855ad7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:34.702110 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a0255805-0682-48dd-82ef-998346855ad7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:34.702486 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8b9e9ffc-5b0a-4bfe-a553-323c5002fcc0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Returning 404 to user: Instance c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:50:34.702567 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8b9e9ffc-5b0a-4bfe-a553-323c5002fcc0 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9" status: 404 len: 111 microversion: 2.1 time: 0.099080 Sep 10 11:50:34.704505 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a0255805-0682-48dd-82ef-998346855ad7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:34.713021 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1356/2633] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:34 2022] GET /compute/v2.1/servers/c39a6abf-a9ab-4b5c-b9e7-d6a2cb41cba9 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:50:34.729628 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b35d54fa-d208-46d0-8202-f89759fd30a9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '.version_select at 0x7f40736f00d0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:34.796385 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b35d54fa-d208-46d0-8202-f89759fd30a9 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-463169617" status: 202 len: 0 microversion: 2.1 time: 0.081964 Sep 10 11:50:34.796987 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1357/2634] 10.222.0.23 () {58 vars in 1218 bytes} [Sat Sep 10 11:50:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-463169617 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:50:34.876322 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a0255805-0682-48dd-82ef-998346855ad7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:34.902569 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a0255805-0682-48dd-82ef-998346855ad7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:34.904436 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a0255805-0682-48dd-82ef-998346855ad7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:34.909558 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-60acd502-3d20-4216-96a9-369e807e7985 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:34.910701 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a0255805-0682-48dd-82ef-998346855ad7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1553 microversion: 2.91 time: 0.229371 Sep 10 11:50:34.911206 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-60acd502-3d20-4216-96a9-369e807e7985 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:34.911824 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1278/2635] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:34 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1553 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:50:34.937931 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-60acd502-3d20-4216-96a9-369e807e7985 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:34.951693 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-60acd502-3d20-4216-96a9-369e807e7985 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:34.958877 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-60acd502-3d20-4216-96a9-369e807e7985 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:34.961793 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-60acd502-3d20-4216-96a9-369e807e7985 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:34.962360 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-60acd502-3d20-4216-96a9-369e807e7985 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:34.962812 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-60acd502-3d20-4216-96a9-369e807e7985 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:34.995928 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c0fc3802-f778-4063-ad56-a68e2c2f3efd tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:34.997516 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c0fc3802-f778-4063-ad56-a68e2c2f3efd tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: 3b2dc8b3-1049-4393-824f-b9786315d5ad] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:35.009868 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0fc3802-f778-4063-ad56-a68e2c2f3efd tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:35.010378 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0fc3802-f778-4063-ad56-a68e2c2f3efd tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:35.010824 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0fc3802-f778-4063-ad56-a68e2c2f3efd tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:35.013030 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0fc3802-f778-4063-ad56-a68e2c2f3efd tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:35.013491 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0fc3802-f778-4063-ad56-a68e2c2f3efd tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:35.014930 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0fc3802-f778-4063-ad56-a68e2c2f3efd tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:35.028832 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:50:35.160711 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-60acd502-3d20-4216-96a9-369e807e7985 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:35.178017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-60acd502-3d20-4216-96a9-369e807e7985 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:35.185522 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-60acd502-3d20-4216-96a9-369e807e7985 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:35.192785 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-60acd502-3d20-4216-96a9-369e807e7985 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1605 microversion: 2.32 time: 0.290230 Sep 10 11:50:35.196832 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1358/2636] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:34 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1605 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:35.202747 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-c1cbbaa4-d359-4995-b01f-8456dd555a4c req-198a8827-5506-4dd3-ba04-58b8dcc02a75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10b130d5-dcd3-41e9-9e67-c68eb28726a2", "name": "network-vif-plugged", "status": "completed", "tag": "3eff96c5-ed1a-483c-9684-7de7e46b66f8"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:50:35.238578 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-c1cbbaa4-d359-4995-b01f-8456dd555a4c req-198a8827-5506-4dd3-ba04-58b8dcc02a75 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:35.241434 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-c1cbbaa4-d359-4995-b01f-8456dd555a4c req-198a8827-5506-4dd3-ba04-58b8dcc02a75 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:35.245706 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-c1cbbaa4-d359-4995-b01f-8456dd555a4c req-198a8827-5506-4dd3-ba04-58b8dcc02a75 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:35.272738 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-c1cbbaa4-d359-4995-b01f-8456dd555a4c req-198a8827-5506-4dd3-ba04-58b8dcc02a75 service nova] Creating event network-vif-plugged:3eff96c5-ed1a-483c-9684-7de7e46b66f8 for instance 10b130d5-dcd3-41e9-9e67-c68eb28726a2 on n-h1-856895-1 Sep 10 11:50:35.286376 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-c1cbbaa4-d359-4995-b01f-8456dd555a4c req-198a8827-5506-4dd3-ba04-58b8dcc02a75 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088274 Sep 10 11:50:35.289305 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1359/2637] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:50:35.347627 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c0fc3802-f778-4063-ad56-a68e2c2f3efd tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:35.364278 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c0fc3802-f778-4063-ad56-a68e2c2f3efd tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad" status: 200 len: 1507 microversion: 2.1 time: 0.369003 Sep 10 11:50:35.366181 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1279/2638] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:34 2022] GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad => generated 1507 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:35.403610 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b222cb9c-b11d-4054-94c7-6c59d9a0e6a0 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:35.403610 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b222cb9c-b11d-4054-94c7-6c59d9a0e6a0 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: 3b2dc8b3-1049-4393-824f-b9786315d5ad] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:35.411049 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b222cb9c-b11d-4054-94c7-6c59d9a0e6a0 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:35.413759 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b222cb9c-b11d-4054-94c7-6c59d9a0e6a0 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:35.414400 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b222cb9c-b11d-4054-94c7-6c59d9a0e6a0 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:35.415218 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b222cb9c-b11d-4054-94c7-6c59d9a0e6a0 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:35.416810 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b222cb9c-b11d-4054-94c7-6c59d9a0e6a0 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:35.417697 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b222cb9c-b11d-4054-94c7-6c59d9a0e6a0 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:35.625041 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ab868874-fa5a-4342-9679-f6441becaf02 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:35.625677 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ab868874-fa5a-4342-9679-f6441becaf02 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 10b130d5-dcd3-41e9-9e67-c68eb28726a2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:35.639569 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab868874-fa5a-4342-9679-f6441becaf02 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:35.639998 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab868874-fa5a-4342-9679-f6441becaf02 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:35.640444 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab868874-fa5a-4342-9679-f6441becaf02 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:35.641172 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab868874-fa5a-4342-9679-f6441becaf02 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:35.642030 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab868874-fa5a-4342-9679-f6441becaf02 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:35.642521 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab868874-fa5a-4342-9679-f6441becaf02 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:35.828390 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b222cb9c-b11d-4054-94c7-6c59d9a0e6a0 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:35.856913 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b222cb9c-b11d-4054-94c7-6c59d9a0e6a0 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad" status: 200 len: 1507 microversion: 2.1 time: 0.465531 Sep 10 11:50:35.863727 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1360/2639] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:35 2022] GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad => generated 1507 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:35.890215 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b0c0baa7-de74-4cf7-af26-933af119fd66 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:50:35.893514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b0c0baa7-de74-4cf7-af26-933af119fd66 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: 3b2dc8b3-1049-4393-824f-b9786315d5ad] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:35.917012 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0c0baa7-de74-4cf7-af26-933af119fd66 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:35.917518 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0c0baa7-de74-4cf7-af26-933af119fd66 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:35.917965 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0c0baa7-de74-4cf7-af26-933af119fd66 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:35.919101 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0c0baa7-de74-4cf7-af26-933af119fd66 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:35.919638 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0c0baa7-de74-4cf7-af26-933af119fd66 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:35.920076 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0c0baa7-de74-4cf7-af26-933af119fd66 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:36.107672 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-b0c0baa7-de74-4cf7-af26-933af119fd66 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:50:36.116263 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-b0c0baa7-de74-4cf7-af26-933af119fd66 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:50:36.117124 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-b0c0baa7-de74-4cf7-af26-933af119fd66 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:50:36.117960 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-b0c0baa7-de74-4cf7-af26-933af119fd66 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:50:36.118423 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ab868874-fa5a-4342-9679-f6441becaf02 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:36.120900 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-b0c0baa7-de74-4cf7-af26-933af119fd66 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:50:36.131736 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ab868874-fa5a-4342-9679-f6441becaf02 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/10b130d5-dcd3-41e9-9e67-c68eb28726a2" status: 200 len: 1307 microversion: 2.1 time: 0.513587 Sep 10 11:50:36.133888 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1280/2640] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:35 2022] GET /compute/v2.1/servers/10b130d5-dcd3-41e9-9e67-c68eb28726a2 => generated 1307 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:36.143098 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f77d87ce-e1d3-474c-979f-bf257e3544a6 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:36.143753 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f77d87ce-e1d3-474c-979f-bf257e3544a6 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:36.145794 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:50:36.195131 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f77d87ce-e1d3-474c-979f-bf257e3544a6 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:36.195706 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f77d87ce-e1d3-474c-979f-bf257e3544a6 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:36.196159 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f77d87ce-e1d3-474c-979f-bf257e3544a6 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:36.196876 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f77d87ce-e1d3-474c-979f-bf257e3544a6 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:36.200078 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f77d87ce-e1d3-474c-979f-bf257e3544a6 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:36.200539 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f77d87ce-e1d3-474c-979f-bf257e3544a6 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:36.313530 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b0c0baa7-de74-4cf7-af26-933af119fd66 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: 3b2dc8b3-1049-4393-824f-b9786315d5ad] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:36.341992 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0c0baa7-de74-4cf7-af26-933af119fd66 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:36.343611 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0c0baa7-de74-4cf7-af26-933af119fd66 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:36.344518 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0c0baa7-de74-4cf7-af26-933af119fd66 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:36.347079 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0c0baa7-de74-4cf7-af26-933af119fd66 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:36.348568 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0c0baa7-de74-4cf7-af26-933af119fd66 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:36.350047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0c0baa7-de74-4cf7-af26-933af119fd66 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:36.386754 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f77d87ce-e1d3-474c-979f-bf257e3544a6 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:36.409000 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f77d87ce-e1d3-474c-979f-bf257e3544a6 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:36.410689 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f77d87ce-e1d3-474c-979f-bf257e3544a6 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:36.431957 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f77d87ce-e1d3-474c-979f-bf257e3544a6 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1553 microversion: 2.91 time: 0.296908 Sep 10 11:50:36.437871 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1281/2641] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:36 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1553 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:36.444865 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6430a819-f9a3-4c71-9ab2-119daa3e5c9b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:36.456035 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6430a819-f9a3-4c71-9ab2-119daa3e5c9b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:36.469721 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b0c0baa7-de74-4cf7-af26-933af119fd66 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "POST /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad/action" status: 202 len: 1109 microversion: 2.1 time: 0.583231 Sep 10 11:50:36.483979 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6430a819-f9a3-4c71-9ab2-119daa3e5c9b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:36.484265 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1361/2642] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:50:35 2022] POST /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad/action => generated 1109 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Sep 10 11:50:36.489749 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6430a819-f9a3-4c71-9ab2-119daa3e5c9b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:36.492578 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6430a819-f9a3-4c71-9ab2-119daa3e5c9b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:36.494049 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6430a819-f9a3-4c71-9ab2-119daa3e5c9b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:36.496160 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6430a819-f9a3-4c71-9ab2-119daa3e5c9b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:36.497028 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6430a819-f9a3-4c71-9ab2-119daa3e5c9b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:36.501398 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e35f95df-f566-4338-a378-e2d575ee9ffc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:36.502122 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e35f95df-f566-4338-a378-e2d575ee9ffc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: 3b2dc8b3-1049-4393-824f-b9786315d5ad] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:36.514559 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e35f95df-f566-4338-a378-e2d575ee9ffc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:36.518733 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e35f95df-f566-4338-a378-e2d575ee9ffc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:36.519964 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e35f95df-f566-4338-a378-e2d575ee9ffc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:36.521817 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e35f95df-f566-4338-a378-e2d575ee9ffc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:36.524182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e35f95df-f566-4338-a378-e2d575ee9ffc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:36.525420 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e35f95df-f566-4338-a378-e2d575ee9ffc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:36.612825 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6430a819-f9a3-4c71-9ab2-119daa3e5c9b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:36.620057 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:50:36.628873 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6430a819-f9a3-4c71-9ab2-119daa3e5c9b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:36.636751 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6430a819-f9a3-4c71-9ab2-119daa3e5c9b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:36.638632 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6430a819-f9a3-4c71-9ab2-119daa3e5c9b tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1605 microversion: 2.32 time: 0.197424 Sep 10 11:50:36.639997 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1282/2643] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:36 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1605 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:36.661659 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-927744c5-0494-411e-8156-edafbece3f1c tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '.version_select at 0x7f4072a4d1f0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:36.699271 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-927744c5-0494-411e-8156-edafbece3f1c tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] HTTP exception thrown: Image not found. Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-927744c5-0494-411e-8156-edafbece3f1c tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Request method failure captured: Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/images/bedb3c43-528b-40ec-9571-4ac3fa7a60c5 HTTP/1.1 Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHmIwAMwYRG5GoKY2e2BrHSNWC_XC8Dle2TjpsTglJZLl4iDdUWRHXObue6CBNwrU7ByI06vvCBASR59oLGdEXbdGMvKthtN9mtTXSrKa2RC4WmIF4PSo8bwMo95sbb-sIH1rhBMLrXpSep-X_LgFDTkeIXb7VSYHefdo66ew2GGhFc Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 3e5d376048de4c3191a58a547e05fd07 Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1177602115 Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3e5d376048de4c3191a58a547e05fd07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3e5d376048de4c3191a58a547e05fd07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3e5d376048de4c3191a58a547e05fd07", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3e5d376048de4c3191a58a547e05fd07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1177602115 Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 3e5d376048de4c3191a58a547e05fd07 Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1177602115 Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ImagesOneServerNegativeTestJSON-1177602115-project Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 8ced1e84956246b6bb7384ba484fde54 Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1177602115-project Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: exception: Image not found. Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'bedb3c43-528b-40ec-9571-4ac3fa7a60c5'} Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image bedb3c43-528b-40ec-9571-4ac3fa7a60c5 to delete Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bedb3c43-528b-40ec-9571-4ac3fa7a60c5 could not be found. Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:50:36.701068 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:36.706247 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:36.706247 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:50:36.706247 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:50:36.706247 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:50:36.706247 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:50:36.706247 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:50:36.706247 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:50:36.706247 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:50:36.706247 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:50:36.706247 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 10 11:50:36.706247 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 11:50:36.706247 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 11:50:36.706247 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:36.706247 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:50:36.706247 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:36.706247 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:36.706247 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:50:36.706247 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:50:36.706247 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:50:36.706247 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:50:36.706247 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 11:50:36.706247 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:36.706247 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-927744c5-0494-411e-8156-edafbece3f1c tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Returning 404 to user: Image not found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:50:36.706247 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-927744c5-0494-411e-8156-edafbece3f1c tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "DELETE /compute/v2.1/images/bedb3c43-528b-40ec-9571-4ac3fa7a60c5" status: 404 len: 62 microversion: 2.1 time: 0.060952 Sep 10 11:50:36.706247 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1283/2644] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:36 2022] DELETE /compute/v2.1/images/bedb3c43-528b-40ec-9571-4ac3fa7a60c5 => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:50:36.714673 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f4845517-2b7f-47a1-bff3-c0a777308146 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:36.715216 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f4845517-2b7f-47a1-bff3-c0a777308146 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:36.755059 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4845517-2b7f-47a1-bff3-c0a777308146 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:36.757421 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4845517-2b7f-47a1-bff3-c0a777308146 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:36.761092 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4845517-2b7f-47a1-bff3-c0a777308146 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:36.762151 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4845517-2b7f-47a1-bff3-c0a777308146 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:36.762851 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4845517-2b7f-47a1-bff3-c0a777308146 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:36.770575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4845517-2b7f-47a1-bff3-c0a777308146 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:36.794556 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-f4845517-2b7f-47a1-bff3-c0a777308146 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] HTTP exception thrown: Instance cec74510-742b-4a47-b7c5-58411ca992de could not be found. Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f4845517-2b7f-47a1-bff3-c0a777308146 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Request method failure captured: Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de HTTP/1.1 Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHmIwAMwYRG5GoKY2e2BrHSNWC_XC8Dle2TjpsTglJZLl4iDdUWRHXObue6CBNwrU7ByI06vvCBASR59oLGdEXbdGMvKthtN9mtTXSrKa2RC4WmIF4PSo8bwMo95sbb-sIH1rhBMLrXpSep-X_LgFDTkeIXb7VSYHefdo66ew2GGhFc Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 3e5d376048de4c3191a58a547e05fd07 Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1177602115 Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3e5d376048de4c3191a58a547e05fd07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3e5d376048de4c3191a58a547e05fd07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3e5d376048de4c3191a58a547e05fd07", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3e5d376048de4c3191a58a547e05fd07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1177602115 Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 3e5d376048de4c3191a58a547e05fd07 Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1177602115 Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ImagesOneServerNegativeTestJSON-1177602115-project Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 8ced1e84956246b6bb7384ba484fde54 Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1177602115-project Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance cec74510-742b-4a47-b7c5-58411ca992de could not be found. Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'cec74510-742b-4a47-b7c5-58411ca992de'} Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cec74510-742b-4a47-b7c5-58411ca992de could not be found. Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:50:36.809128 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:50:36.813608 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cec74510-742b-4a47-b7c5-58411ca992de could not be found. Sep 10 11:50:36.813608 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:36.813608 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:50:36.813608 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:36.813608 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:36.813608 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:50:36.813608 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:50:36.813608 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:50:36.813608 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:50:36.813608 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cec74510-742b-4a47-b7c5-58411ca992de could not be found. Sep 10 11:50:36.813608 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:36.816466 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f4845517-2b7f-47a1-bff3-c0a777308146 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Returning 404 to user: Instance cec74510-742b-4a47-b7c5-58411ca992de could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:50:36.817599 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f4845517-2b7f-47a1-bff3-c0a777308146 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 404 len: 111 microversion: 2.1 time: 0.107715 Sep 10 11:50:36.818725 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1284/2645] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:50:36 2022] DELETE /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:50:36.825600 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e35f95df-f566-4338-a378-e2d575ee9ffc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:36.839464 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e35f95df-f566-4338-a378-e2d575ee9ffc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad" status: 200 len: 1514 microversion: 2.1 time: 0.349522 Sep 10 11:50:36.840840 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1362/2646] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:36 2022] GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad => generated 1514 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:36.859557 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fa055789-1f7d-4ce1-8ab6-01f8b2ed2671 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:36.860738 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fa055789-1f7d-4ce1-8ab6-01f8b2ed2671 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] [instance: cec74510-742b-4a47-b7c5-58411ca992de] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:36.874425 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa055789-1f7d-4ce1-8ab6-01f8b2ed2671 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:36.875135 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa055789-1f7d-4ce1-8ab6-01f8b2ed2671 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:36.875779 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa055789-1f7d-4ce1-8ab6-01f8b2ed2671 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:36.877511 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa055789-1f7d-4ce1-8ab6-01f8b2ed2671 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:36.879211 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa055789-1f7d-4ce1-8ab6-01f8b2ed2671 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:36.879829 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa055789-1f7d-4ce1-8ab6-01f8b2ed2671 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:36.896496 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-fa055789-1f7d-4ce1-8ab6-01f8b2ed2671 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] HTTP exception thrown: Instance cec74510-742b-4a47-b7c5-58411ca992de could not be found. Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fa055789-1f7d-4ce1-8ab6-01f8b2ed2671 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Request method failure captured: Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de HTTP/1.1 Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHmIwAMwYRG5GoKY2e2BrHSNWC_XC8Dle2TjpsTglJZLl4iDdUWRHXObue6CBNwrU7ByI06vvCBASR59oLGdEXbdGMvKthtN9mtTXSrKa2RC4WmIF4PSo8bwMo95sbb-sIH1rhBMLrXpSep-X_LgFDTkeIXb7VSYHefdo66ew2GGhFc Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 3e5d376048de4c3191a58a547e05fd07 Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1177602115 Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3e5d376048de4c3191a58a547e05fd07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3e5d376048de4c3191a58a547e05fd07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3e5d376048de4c3191a58a547e05fd07", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3e5d376048de4c3191a58a547e05fd07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1177602115 Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 3e5d376048de4c3191a58a547e05fd07 Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1177602115 Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ImagesOneServerNegativeTestJSON-1177602115-project Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 8ced1e84956246b6bb7384ba484fde54 Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1177602115-project Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance cec74510-742b-4a47-b7c5-58411ca992de could not be found. Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'cec74510-742b-4a47-b7c5-58411ca992de'} Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cec74510-742b-4a47-b7c5-58411ca992de could not be found. Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cec74510-742b-4a47-b7c5-58411ca992de could not be found. Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:36.898391 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:50:36.903254 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:36.903254 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:36.903254 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:50:36.903254 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:50:36.903254 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:50:36.903254 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:50:36.903254 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cec74510-742b-4a47-b7c5-58411ca992de could not be found. Sep 10 11:50:36.903254 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:36.904786 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fa055789-1f7d-4ce1-8ab6-01f8b2ed2671 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] Returning 404 to user: Instance cec74510-742b-4a47-b7c5-58411ca992de could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:50:36.905823 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fa055789-1f7d-4ce1-8ab6-01f8b2ed2671 tempest-ImagesOneServerNegativeTestJSON-1177602115 tempest-ImagesOneServerNegativeTestJSON-1177602115-project] 10.222.0.23 "GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de" status: 404 len: 111 microversion: 2.1 time: 0.083331 Sep 10 11:50:36.906555 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1285/2647] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:36 2022] GET /compute/v2.1/servers/cec74510-742b-4a47-b7c5-58411ca992de => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 11:50:37.157132 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2190effe-f8e3-4b1d-883f-65688ddd03f6 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:37.157770 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2190effe-f8e3-4b1d-883f-65688ddd03f6 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 10b130d5-dcd3-41e9-9e67-c68eb28726a2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:37.167688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2190effe-f8e3-4b1d-883f-65688ddd03f6 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:37.175969 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2190effe-f8e3-4b1d-883f-65688ddd03f6 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:37.176698 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2190effe-f8e3-4b1d-883f-65688ddd03f6 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:37.182161 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4199fdd9-9ed9-491f-80f9-028ef1745ae4 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:37.187272 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4199fdd9-9ed9-491f-80f9-028ef1745ae4 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8a32e3e1c1164b8abbb9ee6532e81e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30967668a810420ebf3d44363f44a135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:37.188154 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2190effe-f8e3-4b1d-883f-65688ddd03f6 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:37.189942 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2190effe-f8e3-4b1d-883f-65688ddd03f6 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:37.190718 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4199fdd9-9ed9-491f-80f9-028ef1745ae4 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Searching by: {'deleted': False, 'project_id': '30967668a810420ebf3d44363f44a135'} {{(pid=128776) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 11:50:37.191702 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2190effe-f8e3-4b1d-883f-65688ddd03f6 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:37.206029 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4199fdd9-9ed9-491f-80f9-028ef1745ae4 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:37.215212 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4199fdd9-9ed9-491f-80f9-028ef1745ae4 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:37.217556 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4199fdd9-9ed9-491f-80f9-028ef1745ae4 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:37.219354 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4199fdd9-9ed9-491f-80f9-028ef1745ae4 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:37.224798 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4199fdd9-9ed9-491f-80f9-028ef1745ae4 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:37.228376 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4199fdd9-9ed9-491f-80f9-028ef1745ae4 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:37.323382 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.multi_cell_list [None req-4199fdd9-9ed9-491f-80f9-028ef1745ae4 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128776) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 11:50:37.419621 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4199fdd9-9ed9-491f-80f9-028ef1745ae4 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.240929 Sep 10 11:50:37.421059 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1286/2648] 10.222.0.23 () {58 vars in 1125 bytes} [Sat Sep 10 11:50:37 2022] GET /compute/v2.1/servers => generated 339 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:50:37.435749 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-983343f4-4065-4f8b-bc5d-aeed8faff8fb tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:37.442065 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-983343f4-4065-4f8b-bc5d-aeed8faff8fb tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8a32e3e1c1164b8abbb9ee6532e81e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30967668a810420ebf3d44363f44a135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:37.442853 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-983343f4-4065-4f8b-bc5d-aeed8faff8fb tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Searching by: {'deleted': False, 'project_id': '30967668a810420ebf3d44363f44a135'} {{(pid=128776) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 11:50:37.468139 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-983343f4-4065-4f8b-bc5d-aeed8faff8fb tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:37.469479 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-983343f4-4065-4f8b-bc5d-aeed8faff8fb tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:37.470265 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-983343f4-4065-4f8b-bc5d-aeed8faff8fb tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:37.471962 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-983343f4-4065-4f8b-bc5d-aeed8faff8fb tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:37.472652 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-983343f4-4065-4f8b-bc5d-aeed8faff8fb tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:37.473270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-983343f4-4065-4f8b-bc5d-aeed8faff8fb tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:37.523773 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.multi_cell_list [None req-983343f4-4065-4f8b-bc5d-aeed8faff8fb tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128776) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 11:50:37.606026 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-983343f4-4065-4f8b-bc5d-aeed8faff8fb tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a32e3e1c1164b8abbb9ee6532e81e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30967668a810420ebf3d44363f44a135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:37.622792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2190effe-f8e3-4b1d-883f-65688ddd03f6 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:37.624581 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-983343f4-4065-4f8b-bc5d-aeed8faff8fb tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:37.625956 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-983343f4-4065-4f8b-bc5d-aeed8faff8fb tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:37.626842 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-983343f4-4065-4f8b-bc5d-aeed8faff8fb tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:37.633138 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2190effe-f8e3-4b1d-883f-65688ddd03f6 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/10b130d5-dcd3-41e9-9e67-c68eb28726a2" status: 200 len: 1486 microversion: 2.1 time: 0.480377 Sep 10 11:50:37.636614 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1363/2649] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:37 2022] GET /compute/v2.1/servers/10b130d5-dcd3-41e9-9e67-c68eb28726a2 => generated 1486 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:37.652276 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-06495660-b0b8-4528-b1b4-c4029d7e2bb2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:37.663012 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-06495660-b0b8-4528-b1b4-c4029d7e2bb2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:37.675899 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06495660-b0b8-4528-b1b4-c4029d7e2bb2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:37.676678 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06495660-b0b8-4528-b1b4-c4029d7e2bb2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:37.683873 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06495660-b0b8-4528-b1b4-c4029d7e2bb2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:37.695780 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06495660-b0b8-4528-b1b4-c4029d7e2bb2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:37.696340 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06495660-b0b8-4528-b1b4-c4029d7e2bb2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:37.696806 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06495660-b0b8-4528-b1b4-c4029d7e2bb2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:38.051760 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-06495660-b0b8-4528-b1b4-c4029d7e2bb2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:38.065256 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-06495660-b0b8-4528-b1b4-c4029d7e2bb2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:38.073239 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-06495660-b0b8-4528-b1b4-c4029d7e2bb2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:38.086091 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-06495660-b0b8-4528-b1b4-c4029d7e2bb2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1553 microversion: 2.91 time: 0.448126 Sep 10 11:50:38.103681 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1364/2650] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:37 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1553 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:38.127774 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-93b998d6-d31b-4e23-80c3-4c13ac208cf8 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:50:38.128659 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-93b998d6-d31b-4e23-80c3-4c13ac208cf8 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 10b130d5-dcd3-41e9-9e67-c68eb28726a2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:38.140059 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-93b998d6-d31b-4e23-80c3-4c13ac208cf8 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:38.143274 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-93b998d6-d31b-4e23-80c3-4c13ac208cf8 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:38.143918 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-93b998d6-d31b-4e23-80c3-4c13ac208cf8 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:38.144860 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-93b998d6-d31b-4e23-80c3-4c13ac208cf8 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:38.145520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-93b998d6-d31b-4e23-80c3-4c13ac208cf8 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:38.146148 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-93b998d6-d31b-4e23-80c3-4c13ac208cf8 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:38.306135 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-983343f4-4065-4f8b-bc5d-aeed8faff8fb tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 0.874166 Sep 10 11:50:38.306731 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1287/2651] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:50:37 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:50:38.312758 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8f0fac2b-843d-4137-95d5-d6f2efaf544f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:38.313388 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8f0fac2b-843d-4137-95d5-d6f2efaf544f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:38.339098 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-93b998d6-d31b-4e23-80c3-4c13ac208cf8 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "POST /compute/v2.1/servers/10b130d5-dcd3-41e9-9e67-c68eb28726a2/action" status: 202 len: 0 microversion: 2.1 time: 0.222163 Sep 10 11:50:38.351098 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8f0fac2b-843d-4137-95d5-d6f2efaf544f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:38.351632 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8f0fac2b-843d-4137-95d5-d6f2efaf544f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:38.352095 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8f0fac2b-843d-4137-95d5-d6f2efaf544f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:38.352804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8f0fac2b-843d-4137-95d5-d6f2efaf544f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:38.353272 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8f0fac2b-843d-4137-95d5-d6f2efaf544f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:38.353737 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8f0fac2b-843d-4137-95d5-d6f2efaf544f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:38.355819 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1365/2652] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:50:38 2022] POST /compute/v2.1/servers/10b130d5-dcd3-41e9-9e67-c68eb28726a2/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:50:38.607295 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8f0fac2b-843d-4137-95d5-d6f2efaf544f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:38.621001 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8f0fac2b-843d-4137-95d5-d6f2efaf544f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:38.624071 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8f0fac2b-843d-4137-95d5-d6f2efaf544f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:38.625688 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8f0fac2b-843d-4137-95d5-d6f2efaf544f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1605 microversion: 2.32 time: 0.317855 Sep 10 11:50:38.654547 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-42057fc7-5872-46ec-8e7b-3e5e0e4158f7 tempest-MultipleCreateNegativeTestJSON-493940806 tempest-MultipleCreateNegativeTestJSON-493940806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1310510923", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:50:38.668504 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1288/2653] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:38 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1605 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:38.676690 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-42057fc7-5872-46ec-8e7b-3e5e0e4158f7 tempest-MultipleCreateNegativeTestJSON-493940806 tempest-MultipleCreateNegativeTestJSON-493940806-project] HTTP exception thrown: min_count must be <= max_count Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-42057fc7-5872-46ec-8e7b-3e5e0e4158f7 tempest-MultipleCreateNegativeTestJSON-493940806 tempest-MultipleCreateNegativeTestJSON-493940806-project] Request method failure captured: Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 184 Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHoNjVQ3X2XLrblGV9ssCo6sLl-q6_NqRFlhWRBlKxw_Gw4lYUC7bxZjB9CBoBIyGh-j6DRIBwlTCH_RWPfEwcGY-0afZMIWlmfiHAoDQEMa8BybrH4pjdfql66NtpONdfwcPQAb5zKkTQXIM7igRfrgTGJO1AV9F8Vujp3OwAzXcxw Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: c728a05ebc5b400aae7aad790bf17cf4 Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-493940806 Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c728a05ebc5b400aae7aad790bf17cf4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c728a05ebc5b400aae7aad790bf17cf4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c728a05ebc5b400aae7aad790bf17cf4", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c728a05ebc5b400aae7aad790bf17cf4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-493940806 Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: c728a05ebc5b400aae7aad790bf17cf4 Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-493940806 Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-MultipleCreateNegativeTestJSON-493940806-project Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: df7de9562ccb4808abc52f425e0d6861 Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-493940806-project Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1310510923", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "min_count": 3, "max_count": 2}} Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: exception: min_count must be <= max_count Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1310510923', 'imageRef': 'c23d4d62-7ab9-4623-9273-7f44582aa2e1', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Sep 10 11:50:38.688205 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:50:38.693724 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-42057fc7-5872-46ec-8e7b-3e5e0e4158f7 tempest-MultipleCreateNegativeTestJSON-493940806 tempest-MultipleCreateNegativeTestJSON-493940806-project] Returning 400 to user: min_count must be <= max_count {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:50:38.697031 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-85458f06-2df1-4724-a03c-839daf62106c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:38.698449 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-42057fc7-5872-46ec-8e7b-3e5e0e4158f7 tempest-MultipleCreateNegativeTestJSON-493940806 tempest-MultipleCreateNegativeTestJSON-493940806-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.339946 Sep 10 11:50:38.699137 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-85458f06-2df1-4724-a03c-839daf62106c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: 3b2dc8b3-1049-4393-824f-b9786315d5ad] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:38.702502 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1366/2654] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:50:38 2022] POST /compute/v2.1/servers => generated 74 bytes in 346 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 10 11:50:38.725043 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-682f9a05-c1b2-4c6a-8629-34ed52a36084 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:38.728007 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85458f06-2df1-4724-a03c-839daf62106c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:38.729008 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85458f06-2df1-4724-a03c-839daf62106c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:38.729736 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85458f06-2df1-4724-a03c-839daf62106c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:38.733751 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85458f06-2df1-4724-a03c-839daf62106c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:38.734523 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85458f06-2df1-4724-a03c-839daf62106c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:38.735402 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85458f06-2df1-4724-a03c-839daf62106c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:38.747322 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-682f9a05-c1b2-4c6a-8629-34ed52a36084 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.040742 Sep 10 11:50:38.760343 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1367/2655] 10.222.0.23 () {58 vars in 1137 bytes} [Sat Sep 10 11:50:38 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:50:38.772178 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3b35f6e4-f799-453c-848b-54dd8fbe4544 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:38.777846 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3b35f6e4-f799-453c-848b-54dd8fbe4544 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 10b130d5-dcd3-41e9-9e67-c68eb28726a2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:38.788276 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3b35f6e4-f799-453c-848b-54dd8fbe4544 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:38.792290 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3b35f6e4-f799-453c-848b-54dd8fbe4544 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:38.793279 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3b35f6e4-f799-453c-848b-54dd8fbe4544 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:38.794234 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3b35f6e4-f799-453c-848b-54dd8fbe4544 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:38.794916 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3b35f6e4-f799-453c-848b-54dd8fbe4544 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:38.795615 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3b35f6e4-f799-453c-848b-54dd8fbe4544 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:39.213188 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-85458f06-2df1-4724-a03c-839daf62106c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:39.222045 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-85458f06-2df1-4724-a03c-839daf62106c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad" status: 200 len: 1514 microversion: 2.1 time: 0.547515 Sep 10 11:50:39.235433 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3b35f6e4-f799-453c-848b-54dd8fbe4544 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:39.235906 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1289/2656] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:38 2022] GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad => generated 1514 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:39.236104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0b4b9653-02f0-4b32-84df-7093987f1183 tempest-MultipleCreateNegativeTestJSON-493940806 tempest-MultipleCreateNegativeTestJSON-493940806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-789647617", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "max_count": 0}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:50:39.245911 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3b35f6e4-f799-453c-848b-54dd8fbe4544 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/10b130d5-dcd3-41e9-9e67-c68eb28726a2" status: 200 len: 1471 microversion: 2.1 time: 0.483618 Sep 10 11:50:39.246792 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1368/2657] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:38 2022] GET /compute/v2.1/servers/10b130d5-dcd3-41e9-9e67-c68eb28726a2 => generated 1471 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:39.257876 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0a35d2b4-f108-4ae1-bf4a-4c92b88e4e21 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:39.260616 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0a35d2b4-f108-4ae1-bf4a-4c92b88e4e21 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] [instance: c5779770-492b-4ecd-bbc3-8e67b959c5a3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0b4b9653-02f0-4b32-84df-7093987f1183 tempest-MultipleCreateNegativeTestJSON-493940806 tempest-MultipleCreateNegativeTestJSON-493940806-project] Request method failure captured: Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 167 Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHoNjVQ3X2XLrblGV9ssCo6sLl-q6_NqRFlhWRBlKxw_Gw4lYUC7bxZjB9CBoBIyGh-j6DRIBwlTCH_RWPfEwcGY-0afZMIWlmfiHAoDQEMa8BybrH4pjdfql66NtpONdfwcPQAb5zKkTQXIM7igRfrgTGJO1AV9F8Vujp3OwAzXcxw Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: c728a05ebc5b400aae7aad790bf17cf4 Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-493940806 Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c728a05ebc5b400aae7aad790bf17cf4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c728a05ebc5b400aae7aad790bf17cf4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c728a05ebc5b400aae7aad790bf17cf4", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c728a05ebc5b400aae7aad790bf17cf4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-493940806 Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: c728a05ebc5b400aae7aad790bf17cf4 Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-493940806 Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-MultipleCreateNegativeTestJSON-493940806-project Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: df7de9562ccb4808abc52f425e0d6861 Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-493940806-project Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-789647617", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "max_count": 0}} Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-789647617', 'imageRef': 'c23d4d62-7ab9-4623-9273-7f44582aa2e1', 'flavorRef': '452', 'max_count': 0}}} Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise error Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 0 Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 11:50:39.268302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 11:50:39.273025 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 11:50:39.273025 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 11:50:39.273025 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 11:50:39.273025 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 11:50:39.273025 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 10 11:50:39.273025 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:39.273025 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:50:39.273025 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:39.273025 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:39.273025 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:50:39.273025 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:50:39.273025 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 11:50:39.273025 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 11:50:39.273025 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 10 11:50:39.273025 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:39.281308 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0b4b9653-02f0-4b32-84df-7093987f1183 tempest-MultipleCreateNegativeTestJSON-493940806 tempest-MultipleCreateNegativeTestJSON-493940806-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:50:39.282566 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0b4b9653-02f0-4b32-84df-7093987f1183 tempest-MultipleCreateNegativeTestJSON-493940806 tempest-MultipleCreateNegativeTestJSON-493940806-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.050217 Sep 10 11:50:39.283512 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1290/2658] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:50:39 2022] POST /compute/v2.1/servers => generated 130 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:50:39.297221 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a35d2b4-f108-4ae1-bf4a-4c92b88e4e21 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:39.303273 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bdb2d0de-512d-49b8-b4af-8d93e3edae52 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:39.304200 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a35d2b4-f108-4ae1-bf4a-4c92b88e4e21 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:39.307056 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a35d2b4-f108-4ae1-bf4a-4c92b88e4e21 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:39.308037 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a35d2b4-f108-4ae1-bf4a-4c92b88e4e21 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:39.308704 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a35d2b4-f108-4ae1-bf4a-4c92b88e4e21 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:39.309305 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a35d2b4-f108-4ae1-bf4a-4c92b88e4e21 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:39.316882 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bdb2d0de-512d-49b8-b4af-8d93e3edae52 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:39.339553 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bdb2d0de-512d-49b8-b4af-8d93e3edae52 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:39.340312 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bdb2d0de-512d-49b8-b4af-8d93e3edae52 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:39.340932 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bdb2d0de-512d-49b8-b4af-8d93e3edae52 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:39.347819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bdb2d0de-512d-49b8-b4af-8d93e3edae52 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:39.351666 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bdb2d0de-512d-49b8-b4af-8d93e3edae52 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:39.352540 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bdb2d0de-512d-49b8-b4af-8d93e3edae52 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:39.414392 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0a35d2b4-f108-4ae1-bf4a-4c92b88e4e21 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] [instance: c5779770-492b-4ecd-bbc3-8e67b959c5a3] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:50:39.596662 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bdb2d0de-512d-49b8-b4af-8d93e3edae52 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:39.602795 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0a35d2b4-f108-4ae1-bf4a-4c92b88e4e21 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3" status: 204 len: 0 microversion: 2.1 time: 0.354533 Sep 10 11:50:39.603680 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1369/2659] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:50:39 2022] DELETE /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:50:39.612664 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7bb33514-a377-4dc5-ab36-b18055aa279d tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-83023105"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:50:39.621383 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bdb2d0de-512d-49b8-b4af-8d93e3edae52 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:39.624789 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7bb33514-a377-4dc5-ab36-b18055aa279d tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 10b130d5-dcd3-41e9-9e67-c68eb28726a2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:39.629332 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bdb2d0de-512d-49b8-b4af-8d93e3edae52 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:39.644416 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7bb33514-a377-4dc5-ab36-b18055aa279d tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:39.650602 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bdb2d0de-512d-49b8-b4af-8d93e3edae52 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1553 microversion: 2.91 time: 0.355632 Sep 10 11:50:39.652065 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7bb33514-a377-4dc5-ab36-b18055aa279d tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:39.652695 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7bb33514-a377-4dc5-ab36-b18055aa279d tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:39.653478 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1291/2660] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:39 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1553 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:39.654445 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7bb33514-a377-4dc5-ab36-b18055aa279d tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:39.659962 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9a60e9e1-893d-435b-9c31-63799fd92f74 tempest-MultipleCreateNegativeTestJSON-493940806 tempest-MultipleCreateNegativeTestJSON-493940806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2104946219", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "max_count": 2.5}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:50:39.662110 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7bb33514-a377-4dc5-ab36-b18055aa279d tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:39.662737 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7bb33514-a377-4dc5-ab36-b18055aa279d tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9a60e9e1-893d-435b-9c31-63799fd92f74 tempest-MultipleCreateNegativeTestJSON-493940806 tempest-MultipleCreateNegativeTestJSON-493940806-project] Request method failure captured: Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 170 Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHoNjVQ3X2XLrblGV9ssCo6sLl-q6_NqRFlhWRBlKxw_Gw4lYUC7bxZjB9CBoBIyGh-j6DRIBwlTCH_RWPfEwcGY-0afZMIWlmfiHAoDQEMa8BybrH4pjdfql66NtpONdfwcPQAb5zKkTQXIM7igRfrgTGJO1AV9F8Vujp3OwAzXcxw Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: c728a05ebc5b400aae7aad790bf17cf4 Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-493940806 Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c728a05ebc5b400aae7aad790bf17cf4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c728a05ebc5b400aae7aad790bf17cf4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c728a05ebc5b400aae7aad790bf17cf4", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c728a05ebc5b400aae7aad790bf17cf4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-493940806 Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: c728a05ebc5b400aae7aad790bf17cf4 Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-493940806 Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-MultipleCreateNegativeTestJSON-493940806-project Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: df7de9562ccb4808abc52f425e0d6861 Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-493940806-project Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2104946219", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "max_count": 2.5}} Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2104946219', 'imageRef': 'c23d4d62-7ab9-4623-9273-7f44582aa2e1', 'flavorRef': '452', 'max_count': 2.5}}} Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise error Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 2.5 Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 11:50:39.676302 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 11:50:39.681232 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 11:50:39.681232 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 11:50:39.681232 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 11:50:39.681232 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 11:50:39.681232 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 10 11:50:39.681232 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:39.681232 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:50:39.681232 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:39.681232 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:39.681232 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:50:39.681232 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:50:39.681232 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 11:50:39.681232 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 11:50:39.681232 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 10 11:50:39.681232 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:39.697758 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9a60e9e1-893d-435b-9c31-63799fd92f74 tempest-MultipleCreateNegativeTestJSON-493940806 tempest-MultipleCreateNegativeTestJSON-493940806-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:50:39.698893 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9a60e9e1-893d-435b-9c31-63799fd92f74 tempest-MultipleCreateNegativeTestJSON-493940806 tempest-MultipleCreateNegativeTestJSON-493940806-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.043324 Sep 10 11:50:39.704263 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1292/2661] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:50:39 2022] POST /compute/v2.1/servers => generated 139 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:50:39.709310 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-839c226b-0a07-467d-b2c1-ee0864079219 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:39.739200 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-839c226b-0a07-467d-b2c1-ee0864079219 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] [instance: c5779770-492b-4ecd-bbc3-8e67b959c5a3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:39.769545 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-839c226b-0a07-467d-b2c1-ee0864079219 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:39.777765 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-839c226b-0a07-467d-b2c1-ee0864079219 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:39.780126 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-839c226b-0a07-467d-b2c1-ee0864079219 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:39.782936 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-839c226b-0a07-467d-b2c1-ee0864079219 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:39.785639 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-839c226b-0a07-467d-b2c1-ee0864079219 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:39.788264 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-839c226b-0a07-467d-b2c1-ee0864079219 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:40.171595 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-839c226b-0a07-467d-b2c1-ee0864079219 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a32e3e1c1164b8abbb9ee6532e81e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30967668a810420ebf3d44363f44a135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:40.185190 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-839c226b-0a07-467d-b2c1-ee0864079219 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] 10.222.0.23 "GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3" status: 200 len: 1714 microversion: 2.1 time: 0.479479 Sep 10 11:50:40.193260 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1293/2662] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:39 2022] GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3 => generated 1714 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:40.209404 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-aa38aaae-445a-47b7-848a-8bbd2476be72 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:40.212136 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-aa38aaae-445a-47b7-848a-8bbd2476be72 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:40.230869 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aa38aaae-445a-47b7-848a-8bbd2476be72 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:40.231407 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aa38aaae-445a-47b7-848a-8bbd2476be72 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:40.231883 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aa38aaae-445a-47b7-848a-8bbd2476be72 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:40.232585 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aa38aaae-445a-47b7-848a-8bbd2476be72 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:40.233048 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aa38aaae-445a-47b7-848a-8bbd2476be72 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:40.239807 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aa38aaae-445a-47b7-848a-8bbd2476be72 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:40.248949 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7bb33514-a377-4dc5-ab36-b18055aa279d tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "POST /compute/v2.1/servers/10b130d5-dcd3-41e9-9e67-c68eb28726a2/action" status: 202 len: 0 microversion: 2.1 time: 0.639817 Sep 10 11:50:40.250480 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1370/2663] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:50:39 2022] POST /compute/v2.1/servers/10b130d5-dcd3-41e9-9e67-c68eb28726a2/action => generated 0 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 10 11:50:40.260830 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-068c51f5-496d-4ba5-959f-b897bf5a1a7d tempest-MultipleCreateNegativeTestJSON-493940806 tempest-MultipleCreateNegativeTestJSON-493940806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-623487006", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "min_count": 0}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-068c51f5-496d-4ba5-959f-b897bf5a1a7d tempest-MultipleCreateNegativeTestJSON-493940806 tempest-MultipleCreateNegativeTestJSON-493940806-project] Request method failure captured: Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 167 Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHoNjVQ3X2XLrblGV9ssCo6sLl-q6_NqRFlhWRBlKxw_Gw4lYUC7bxZjB9CBoBIyGh-j6DRIBwlTCH_RWPfEwcGY-0afZMIWlmfiHAoDQEMa8BybrH4pjdfql66NtpONdfwcPQAb5zKkTQXIM7igRfrgTGJO1AV9F8Vujp3OwAzXcxw Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: c728a05ebc5b400aae7aad790bf17cf4 Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-493940806 Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c728a05ebc5b400aae7aad790bf17cf4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c728a05ebc5b400aae7aad790bf17cf4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c728a05ebc5b400aae7aad790bf17cf4", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c728a05ebc5b400aae7aad790bf17cf4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-493940806 Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: c728a05ebc5b400aae7aad790bf17cf4 Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-493940806 Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-MultipleCreateNegativeTestJSON-493940806-project Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: df7de9562ccb4808abc52f425e0d6861 Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-493940806-project Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-623487006", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "min_count": 0}} Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-623487006', 'imageRef': 'c23d4d62-7ab9-4623-9273-7f44582aa2e1', 'flavorRef': '452', 'min_count': 0}}} Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise error Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi 0 Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 11:50:40.269340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 11:50:40.274253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 11:50:40.274253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 11:50:40.274253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 11:50:40.274253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 11:50:40.274253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 10 11:50:40.274253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:50:40.274253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:50:40.274253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:50:40.274253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:40.274253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:50:40.274253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:50:40.274253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 11:50:40.274253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 11:50:40.274253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 10 11:50:40.274253 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:50:40.276531 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-068c51f5-496d-4ba5-959f-b897bf5a1a7d tempest-MultipleCreateNegativeTestJSON-493940806 tempest-MultipleCreateNegativeTestJSON-493940806-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:50:40.277764 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-068c51f5-496d-4ba5-959f-b897bf5a1a7d tempest-MultipleCreateNegativeTestJSON-493940806 tempest-MultipleCreateNegativeTestJSON-493940806-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.025976 Sep 10 11:50:40.278497 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1371/2664] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:50:40 2022] POST /compute/v2.1/servers => generated 130 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:50:40.285587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-85195ec2-7e4f-40f2-8425-43ffe80f072c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:40.287036 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-85195ec2-7e4f-40f2-8425-43ffe80f072c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: 3b2dc8b3-1049-4393-824f-b9786315d5ad] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:40.300604 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-85195ec2-7e4f-40f2-8425-43ffe80f072c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:40.301734 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-85195ec2-7e4f-40f2-8425-43ffe80f072c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:40.303467 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-85195ec2-7e4f-40f2-8425-43ffe80f072c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:40.304380 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-85195ec2-7e4f-40f2-8425-43ffe80f072c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:40.305006 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-85195ec2-7e4f-40f2-8425-43ffe80f072c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:40.305595 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-85195ec2-7e4f-40f2-8425-43ffe80f072c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:40.472783 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-aa38aaae-445a-47b7-848a-8bbd2476be72 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:40.483974 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-aa38aaae-445a-47b7-848a-8bbd2476be72 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:40.485882 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-aa38aaae-445a-47b7-848a-8bbd2476be72 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:40.509345 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-aa38aaae-445a-47b7-848a-8bbd2476be72 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1605 microversion: 2.32 time: 0.314654 Sep 10 11:50:40.510501 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1294/2665] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:40 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1605 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:40.541913 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0e3b5984-b7c6-498b-b583-df49e8f813fa tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f4072c78f70>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:40.550427 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-85195ec2-7e4f-40f2-8425-43ffe80f072c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:40.553395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:50:40.571433 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-85195ec2-7e4f-40f2-8425-43ffe80f072c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad" status: 200 len: 1514 microversion: 2.1 time: 0.291540 Sep 10 11:50:40.582229 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1372/2666] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:40 2022] GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad => generated 1514 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:40.587376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-58ca48c0-3996-435a-9cd5-bff5495f0d1c tempest-MultipleCreateNegativeTestJSON-493940806 tempest-MultipleCreateNegativeTestJSON-493940806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1527307328", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "min_count": 2.5}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-58ca48c0-3996-435a-9cd5-bff5495f0d1c tempest-MultipleCreateNegativeTestJSON-493940806 tempest-MultipleCreateNegativeTestJSON-493940806-project] Request method failure captured: Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 170 Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHoNjVQ3X2XLrblGV9ssCo6sLl-q6_NqRFlhWRBlKxw_Gw4lYUC7bxZjB9CBoBIyGh-j6DRIBwlTCH_RWPfEwcGY-0afZMIWlmfiHAoDQEMa8BybrH4pjdfql66NtpONdfwcPQAb5zKkTQXIM7igRfrgTGJO1AV9F8Vujp3OwAzXcxw Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: c728a05ebc5b400aae7aad790bf17cf4 Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-493940806 Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c728a05ebc5b400aae7aad790bf17cf4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c728a05ebc5b400aae7aad790bf17cf4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c728a05ebc5b400aae7aad790bf17cf4", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c728a05ebc5b400aae7aad790bf17cf4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-493940806 Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: c728a05ebc5b400aae7aad790bf17cf4 Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-493940806 Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-MultipleCreateNegativeTestJSON-493940806-project Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: df7de9562ccb4808abc52f425e0d6861 Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-493940806-project Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1527307328", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "min_count": 2.5}} Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1527307328', 'imageRef': 'c23d4d62-7ab9-4623-9273-7f44582aa2e1', 'flavorRef': '452', 'min_count': 2.5}}} Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise error Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi 2.5 Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 11:50:40.612262 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 11:50:40.618556 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 11:50:40.618556 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 11:50:40.618556 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 11:50:40.618556 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 11:50:40.618556 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 10 11:50:40.618556 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:50:40.618556 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:50:40.618556 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:50:40.618556 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:40.618556 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:50:40.618556 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:50:40.618556 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 11:50:40.618556 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 11:50:40.618556 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 10 11:50:40.618556 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:50:40.618556 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-58ca48c0-3996-435a-9cd5-bff5495f0d1c tempest-MultipleCreateNegativeTestJSON-493940806 tempest-MultipleCreateNegativeTestJSON-493940806-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:50:40.618556 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-58ca48c0-3996-435a-9cd5-bff5495f0d1c tempest-MultipleCreateNegativeTestJSON-493940806 tempest-MultipleCreateNegativeTestJSON-493940806-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.030385 Sep 10 11:50:40.618556 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1373/2667] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:50:40 2022] POST /compute/v2.1/servers => generated 139 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:50:40.627900 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0e3b5984-b7c6-498b-b583-df49e8f813fa tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/9af4c5ec-005a-43b8-8d1f-84731e30d0df" status: 200 len: 1410 microversion: 2.1 time: 0.092787 Sep 10 11:50:40.627900 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1295/2668] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:50:40 2022] GET /compute/v2.1/images/9af4c5ec-005a-43b8-8d1f-84731e30d0df => generated 1410 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:40.689851 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-90997da6-0c5e-4a07-a6bd-fc9c3088e2dc tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:40.690588 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-90997da6-0c5e-4a07-a6bd-fc9c3088e2dc tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:40.711347 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-90997da6-0c5e-4a07-a6bd-fc9c3088e2dc tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:40.713912 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-90997da6-0c5e-4a07-a6bd-fc9c3088e2dc tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:40.715694 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-90997da6-0c5e-4a07-a6bd-fc9c3088e2dc tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:40.716826 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-90997da6-0c5e-4a07-a6bd-fc9c3088e2dc tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:40.723088 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-90997da6-0c5e-4a07-a6bd-fc9c3088e2dc tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:40.723637 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-90997da6-0c5e-4a07-a6bd-fc9c3088e2dc tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:40.939992 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-90997da6-0c5e-4a07-a6bd-fc9c3088e2dc tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:40.959636 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-90997da6-0c5e-4a07-a6bd-fc9c3088e2dc tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:40.961998 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-90997da6-0c5e-4a07-a6bd-fc9c3088e2dc tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:40.971232 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-90997da6-0c5e-4a07-a6bd-fc9c3088e2dc tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1553 microversion: 2.91 time: 0.285883 Sep 10 11:50:40.971887 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1374/2669] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:40 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1553 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:41.225294 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-43199ba8-c1e8-4313-b316-aba352de3af4 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:41.226182 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-43199ba8-c1e8-4313-b316-aba352de3af4 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] [instance: c5779770-492b-4ecd-bbc3-8e67b959c5a3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:41.248561 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-43199ba8-c1e8-4313-b316-aba352de3af4 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:41.253344 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-43199ba8-c1e8-4313-b316-aba352de3af4 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:41.254143 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-43199ba8-c1e8-4313-b316-aba352de3af4 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:41.255126 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-43199ba8-c1e8-4313-b316-aba352de3af4 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:41.255838 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-43199ba8-c1e8-4313-b316-aba352de3af4 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:41.257565 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-43199ba8-c1e8-4313-b316-aba352de3af4 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:41.491737 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-43199ba8-c1e8-4313-b316-aba352de3af4 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a32e3e1c1164b8abbb9ee6532e81e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30967668a810420ebf3d44363f44a135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:41.501290 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-43199ba8-c1e8-4313-b316-aba352de3af4 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] 10.222.0.23 "GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3" status: 200 len: 1714 microversion: 2.1 time: 0.281803 Sep 10 11:50:41.506170 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1296/2670] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:41 2022] GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3 => generated 1714 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:41.546446 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6e63ef93-548b-4660-bfd9-a6cb61ac96f6 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:41.548208 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6e63ef93-548b-4660-bfd9-a6cb61ac96f6 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:41.563726 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6e63ef93-548b-4660-bfd9-a6cb61ac96f6 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:41.564885 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6e63ef93-548b-4660-bfd9-a6cb61ac96f6 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:41.565735 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6e63ef93-548b-4660-bfd9-a6cb61ac96f6 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:41.569400 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6e63ef93-548b-4660-bfd9-a6cb61ac96f6 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:41.572771 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6e63ef93-548b-4660-bfd9-a6cb61ac96f6 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:41.574716 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6e63ef93-548b-4660-bfd9-a6cb61ac96f6 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:41.602783 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e113b2e1-bff8-4267-8de4-9966eb52c576 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:41.603443 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e113b2e1-bff8-4267-8de4-9966eb52c576 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: 3b2dc8b3-1049-4393-824f-b9786315d5ad] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:41.615149 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e113b2e1-bff8-4267-8de4-9966eb52c576 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:41.616428 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e113b2e1-bff8-4267-8de4-9966eb52c576 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:41.617136 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e113b2e1-bff8-4267-8de4-9966eb52c576 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:41.618264 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e113b2e1-bff8-4267-8de4-9966eb52c576 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:41.619191 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e113b2e1-bff8-4267-8de4-9966eb52c576 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:41.619836 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e113b2e1-bff8-4267-8de4-9966eb52c576 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:41.976249 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6e63ef93-548b-4660-bfd9-a6cb61ac96f6 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:41.992348 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6e63ef93-548b-4660-bfd9-a6cb61ac96f6 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:41.994403 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6e63ef93-548b-4660-bfd9-a6cb61ac96f6 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:42.002612 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6e63ef93-548b-4660-bfd9-a6cb61ac96f6 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1605 microversion: 2.32 time: 0.460621 Sep 10 11:50:42.006050 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1375/2671] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:41 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1605 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:42.019211 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-60884869-97a9-4c3b-894e-cc7168ceb586 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f40734ef8b0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:42.126284 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-60884869-97a9-4c3b-894e-cc7168ceb586 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/9af4c5ec-005a-43b8-8d1f-84731e30d0df" status: 200 len: 1410 microversion: 2.1 time: 0.118845 Sep 10 11:50:42.145134 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1376/2672] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:50:42 2022] GET /compute/v2.1/images/9af4c5ec-005a-43b8-8d1f-84731e30d0df => generated 1410 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:42.150413 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f36be6d4-f9d6-4a7a-853a-afd9fdcceb1a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:42.157863 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f36be6d4-f9d6-4a7a-853a-afd9fdcceb1a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:42.180438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f36be6d4-f9d6-4a7a-853a-afd9fdcceb1a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:42.183325 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f36be6d4-f9d6-4a7a-853a-afd9fdcceb1a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:42.187868 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f36be6d4-f9d6-4a7a-853a-afd9fdcceb1a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:42.189232 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f36be6d4-f9d6-4a7a-853a-afd9fdcceb1a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:42.189888 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f36be6d4-f9d6-4a7a-853a-afd9fdcceb1a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:42.192195 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f36be6d4-f9d6-4a7a-853a-afd9fdcceb1a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:42.341875 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f36be6d4-f9d6-4a7a-853a-afd9fdcceb1a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:42.359203 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f36be6d4-f9d6-4a7a-853a-afd9fdcceb1a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:42.363253 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f36be6d4-f9d6-4a7a-853a-afd9fdcceb1a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:42.372467 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f36be6d4-f9d6-4a7a-853a-afd9fdcceb1a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1553 microversion: 2.91 time: 0.225340 Sep 10 11:50:42.387850 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1377/2673] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:42 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1553 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:42.467337 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e113b2e1-bff8-4267-8de4-9966eb52c576 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:42.489085 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e113b2e1-bff8-4267-8de4-9966eb52c576 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad" status: 200 len: 1514 microversion: 2.1 time: 0.884788 Sep 10 11:50:42.489845 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1297/2674] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:41 2022] GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad => generated 1514 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:42.535627 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e42409cc-6281-409c-8062-1783fd2c297f tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:42.536821 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e42409cc-6281-409c-8062-1783fd2c297f tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] [instance: c5779770-492b-4ecd-bbc3-8e67b959c5a3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:42.550517 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e42409cc-6281-409c-8062-1783fd2c297f tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:42.551234 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e42409cc-6281-409c-8062-1783fd2c297f tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:42.556248 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e42409cc-6281-409c-8062-1783fd2c297f tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:42.557148 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e42409cc-6281-409c-8062-1783fd2c297f tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:42.557729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e42409cc-6281-409c-8062-1783fd2c297f tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:42.558275 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e42409cc-6281-409c-8062-1783fd2c297f tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:42.862363 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e42409cc-6281-409c-8062-1783fd2c297f tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a32e3e1c1164b8abbb9ee6532e81e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30967668a810420ebf3d44363f44a135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:42.872600 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e42409cc-6281-409c-8062-1783fd2c297f tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] 10.222.0.23 "GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3" status: 200 len: 1714 microversion: 2.1 time: 0.341690 Sep 10 11:50:42.874246 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1378/2675] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:42 2022] GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3 => generated 1714 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:43.036540 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-27f1a3e9-662f-4636-b8d7-2e631f4e67ad tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:43.037245 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-27f1a3e9-662f-4636-b8d7-2e631f4e67ad tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:43.054549 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27f1a3e9-662f-4636-b8d7-2e631f4e67ad tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:43.057452 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27f1a3e9-662f-4636-b8d7-2e631f4e67ad tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:43.058075 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27f1a3e9-662f-4636-b8d7-2e631f4e67ad tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:43.058702 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27f1a3e9-662f-4636-b8d7-2e631f4e67ad tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:43.059199 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27f1a3e9-662f-4636-b8d7-2e631f4e67ad tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:43.063091 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27f1a3e9-662f-4636-b8d7-2e631f4e67ad tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:43.142132 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d3bca0ec-57d2-4351-9988-b660cfead16d tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f4073dd4430>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:43.226882 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d3bca0ec-57d2-4351-9988-b660cfead16d tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/9af4c5ec-005a-43b8-8d1f-84731e30d0df" status: 200 len: 1410 microversion: 2.1 time: 0.088669 Sep 10 11:50:43.239068 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1379/2676] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:50:43 2022] GET /compute/v2.1/images/9af4c5ec-005a-43b8-8d1f-84731e30d0df => generated 1410 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:43.296401 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-27f1a3e9-662f-4636-b8d7-2e631f4e67ad tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:43.309986 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-27f1a3e9-662f-4636-b8d7-2e631f4e67ad tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:43.316266 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-27f1a3e9-662f-4636-b8d7-2e631f4e67ad tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:43.318441 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-27f1a3e9-662f-4636-b8d7-2e631f4e67ad tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1605 microversion: 2.32 time: 0.288347 Sep 10 11:50:43.325659 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1298/2677] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:43 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1605 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:43.405305 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9343cc3c-877d-48b6-91dc-958773cc8824 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:43.405305 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9343cc3c-877d-48b6-91dc-958773cc8824 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:43.429417 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9343cc3c-877d-48b6-91dc-958773cc8824 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:43.429924 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9343cc3c-877d-48b6-91dc-958773cc8824 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:43.430366 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9343cc3c-877d-48b6-91dc-958773cc8824 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:43.437992 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9343cc3c-877d-48b6-91dc-958773cc8824 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:43.442854 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9343cc3c-877d-48b6-91dc-958773cc8824 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:43.443653 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9343cc3c-877d-48b6-91dc-958773cc8824 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:43.523024 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f0a7f16d-ea73-416c-96ab-08c627a4c77f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:43.524920 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f0a7f16d-ea73-416c-96ab-08c627a4c77f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: 3b2dc8b3-1049-4393-824f-b9786315d5ad] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:43.538575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f0a7f16d-ea73-416c-96ab-08c627a4c77f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:43.538575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f0a7f16d-ea73-416c-96ab-08c627a4c77f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:43.538575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f0a7f16d-ea73-416c-96ab-08c627a4c77f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:43.538575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f0a7f16d-ea73-416c-96ab-08c627a4c77f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:43.538575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f0a7f16d-ea73-416c-96ab-08c627a4c77f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:43.539026 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f0a7f16d-ea73-416c-96ab-08c627a4c77f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:43.608008 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9343cc3c-877d-48b6-91dc-958773cc8824 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:43.622665 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9343cc3c-877d-48b6-91dc-958773cc8824 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:43.628894 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9343cc3c-877d-48b6-91dc-958773cc8824 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:43.637957 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9343cc3c-877d-48b6-91dc-958773cc8824 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1553 microversion: 2.91 time: 0.240175 Sep 10 11:50:43.641223 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1380/2678] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:43 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1553 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:50:43.894841 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f0a7f16d-ea73-416c-96ab-08c627a4c77f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:43.903886 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-973d252d-e927-4d26-b01f-36a80ccd3d81 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:43.904775 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-973d252d-e927-4d26-b01f-36a80ccd3d81 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] [instance: c5779770-492b-4ecd-bbc3-8e67b959c5a3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:43.913136 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f0a7f16d-ea73-416c-96ab-08c627a4c77f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad" status: 200 len: 1514 microversion: 2.1 time: 0.396667 Sep 10 11:50:43.913732 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1299/2679] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:43 2022] GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad => generated 1514 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:43.918892 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-973d252d-e927-4d26-b01f-36a80ccd3d81 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:43.921086 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-973d252d-e927-4d26-b01f-36a80ccd3d81 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:43.921769 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-973d252d-e927-4d26-b01f-36a80ccd3d81 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:43.922713 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-973d252d-e927-4d26-b01f-36a80ccd3d81 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:43.927254 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-973d252d-e927-4d26-b01f-36a80ccd3d81 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:43.928422 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-973d252d-e927-4d26-b01f-36a80ccd3d81 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:44.226664 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-973d252d-e927-4d26-b01f-36a80ccd3d81 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a32e3e1c1164b8abbb9ee6532e81e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30967668a810420ebf3d44363f44a135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:44.242929 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d669e848-9370-4bb8-9a3f-f2d9615bf24c tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f4072a73160>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:44.263042 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-973d252d-e927-4d26-b01f-36a80ccd3d81 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] 10.222.0.23 "GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3" status: 200 len: 1714 microversion: 2.1 time: 0.351365 Sep 10 11:50:44.270730 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1381/2680] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:43 2022] GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3 => generated 1714 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:50:44.311953 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d669e848-9370-4bb8-9a3f-f2d9615bf24c tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/9af4c5ec-005a-43b8-8d1f-84731e30d0df" status: 200 len: 1410 microversion: 2.1 time: 0.072812 Sep 10 11:50:44.320677 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1300/2681] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:50:44 2022] GET /compute/v2.1/images/9af4c5ec-005a-43b8-8d1f-84731e30d0df => generated 1410 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:50:44.350580 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f597c93e-b1a2-441b-9cad-9cfd4bb54fbb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:44.351842 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f597c93e-b1a2-441b-9cad-9cfd4bb54fbb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:44.364501 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f597c93e-b1a2-441b-9cad-9cfd4bb54fbb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:44.365377 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f597c93e-b1a2-441b-9cad-9cfd4bb54fbb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:44.366702 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f597c93e-b1a2-441b-9cad-9cfd4bb54fbb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:44.368175 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f597c93e-b1a2-441b-9cad-9cfd4bb54fbb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:44.368929 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f597c93e-b1a2-441b-9cad-9cfd4bb54fbb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:44.369583 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f597c93e-b1a2-441b-9cad-9cfd4bb54fbb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:44.462342 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f597c93e-b1a2-441b-9cad-9cfd4bb54fbb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:44.474702 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f597c93e-b1a2-441b-9cad-9cfd4bb54fbb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:44.476875 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f597c93e-b1a2-441b-9cad-9cfd4bb54fbb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:44.478666 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f597c93e-b1a2-441b-9cad-9cfd4bb54fbb tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1605 microversion: 2.32 time: 0.132055 Sep 10 11:50:44.494980 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1382/2682] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:44 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1605 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:44.674414 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4ba1c1c7-6d6d-4002-9d0e-35bf85a84d36 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:44.675940 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4ba1c1c7-6d6d-4002-9d0e-35bf85a84d36 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:44.691955 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ba1c1c7-6d6d-4002-9d0e-35bf85a84d36 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:44.699126 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ba1c1c7-6d6d-4002-9d0e-35bf85a84d36 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:44.703287 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ba1c1c7-6d6d-4002-9d0e-35bf85a84d36 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:44.706784 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ba1c1c7-6d6d-4002-9d0e-35bf85a84d36 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:44.707879 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ba1c1c7-6d6d-4002-9d0e-35bf85a84d36 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:44.710548 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ba1c1c7-6d6d-4002-9d0e-35bf85a84d36 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:44.733933 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dbf8322c-cfb7-424b-a273-a26bfc4b2827 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1181853279", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": "none"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:50:44.850503 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-dbf8322c-cfb7-424b-a273-a26bfc4b2827 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:50:44.850935 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-dbf8322c-cfb7-424b-a273-a26bfc4b2827 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:50:44.851443 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-dbf8322c-cfb7-424b-a273-a26bfc4b2827 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:50:44.851865 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-dbf8322c-cfb7-424b-a273-a26bfc4b2827 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:50:44.852285 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-dbf8322c-cfb7-424b-a273-a26bfc4b2827 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:50:44.890510 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dbf8322c-cfb7-424b-a273-a26bfc4b2827 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:44.891014 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dbf8322c-cfb7-424b-a273-a26bfc4b2827 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:44.897218 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dbf8322c-cfb7-424b-a273-a26bfc4b2827 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:44.898069 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dbf8322c-cfb7-424b-a273-a26bfc4b2827 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:44.898553 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dbf8322c-cfb7-424b-a273-a26bfc4b2827 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:44.898990 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dbf8322c-cfb7-424b-a273-a26bfc4b2827 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:44.912417 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4ba1c1c7-6d6d-4002-9d0e-35bf85a84d36 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:44.933415 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4ba1c1c7-6d6d-4002-9d0e-35bf85a84d36 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:44.935098 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4ba1c1c7-6d6d-4002-9d0e-35bf85a84d36 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:44.953566 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4ba1c1c7-6d6d-4002-9d0e-35bf85a84d36 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1553 microversion: 2.91 time: 0.283921 Sep 10 11:50:44.954179 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1383/2683] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:44 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1553 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:50:44.978595 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a0a631e4-7b17-4b56-adbe-7066cc2e5112 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:44.982387 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a0a631e4-7b17-4b56-adbe-7066cc2e5112 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: 3b2dc8b3-1049-4393-824f-b9786315d5ad] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:44.985485 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-dbf8322c-cfb7-424b-a273-a26bfc4b2827 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Getting quotas for project ceee7b01d1014a538d1d1aea7da5c582. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:50:45.006346 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-dbf8322c-cfb7-424b-a273-a26bfc4b2827 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Getting quotas for user 6051ef60abd443599fd2f0ee2b948479 and project ceee7b01d1014a538d1d1aea7da5c582. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:50:45.006551 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a0a631e4-7b17-4b56-adbe-7066cc2e5112 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:45.006986 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a0a631e4-7b17-4b56-adbe-7066cc2e5112 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:45.007625 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a0a631e4-7b17-4b56-adbe-7066cc2e5112 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:45.008526 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a0a631e4-7b17-4b56-adbe-7066cc2e5112 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:45.009143 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a0a631e4-7b17-4b56-adbe-7066cc2e5112 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:45.009732 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a0a631e4-7b17-4b56-adbe-7066cc2e5112 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:45.085087 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-dbf8322c-cfb7-424b-a273-a26bfc4b2827 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:50:45.092920 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-dbf8322c-cfb7-424b-a273-a26bfc4b2827 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] [instance: d011e7e2-60c2-4e71-962c-73eb811f7351] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:50:45.237950 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-dbf8322c-cfb7-424b-a273-a26bfc4b2827 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.839192 Sep 10 11:50:45.246254 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1301/2684] 10.222.0.23 () {62 vars in 1188 bytes} [Sat Sep 10 11:50:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 842 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 10 11:50:45.262488 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b59f0d95-de7c-4575-be01-8f2e2275f656 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:45.269703 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b59f0d95-de7c-4575-be01-8f2e2275f656 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] [instance: d011e7e2-60c2-4e71-962c-73eb811f7351] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:45.691882 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b59f0d95-de7c-4575-be01-8f2e2275f656 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6051ef60abd443599fd2f0ee2b948479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceee7b01d1014a538d1d1aea7da5c582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:45.713458 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b59f0d95-de7c-4575-be01-8f2e2275f656 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6051ef60abd443599fd2f0ee2b948479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceee7b01d1014a538d1d1aea7da5c582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:45.730355 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b59f0d95-de7c-4575-be01-8f2e2275f656 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6051ef60abd443599fd2f0ee2b948479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceee7b01d1014a538d1d1aea7da5c582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:45.737200 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b59f0d95-de7c-4575-be01-8f2e2275f656 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] 10.222.0.23 "GET /compute/v2.1/servers/d011e7e2-60c2-4e71-962c-73eb811f7351" status: 200 len: 1281 microversion: 2.47 time: 0.485554 Sep 10 11:50:45.740091 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1302/2685] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:45 2022] GET /compute/v2.1/servers/d011e7e2-60c2-4e71-962c-73eb811f7351 => generated 1281 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:45.762354 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b8b15775-6962-4c4b-a510-335f86cd96f2 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:45.763107 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b8b15775-6962-4c4b-a510-335f86cd96f2 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] [instance: c5779770-492b-4ecd-bbc3-8e67b959c5a3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:45.783541 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8b15775-6962-4c4b-a510-335f86cd96f2 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:45.783896 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8b15775-6962-4c4b-a510-335f86cd96f2 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:45.784350 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8b15775-6962-4c4b-a510-335f86cd96f2 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:45.785088 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8b15775-6962-4c4b-a510-335f86cd96f2 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:45.785554 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8b15775-6962-4c4b-a510-335f86cd96f2 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:45.785991 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8b15775-6962-4c4b-a510-335f86cd96f2 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:45.949770 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8b15775-6962-4c4b-a510-335f86cd96f2 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:45.950525 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8b15775-6962-4c4b-a510-335f86cd96f2 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:45.951188 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8b15775-6962-4c4b-a510-335f86cd96f2 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:45.954291 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-b8b15775-6962-4c4b-a510-335f86cd96f2 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lazy-loading 'fault' on Instance uuid c5779770-492b-4ecd-bbc3-8e67b959c5a3 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:50:46.005051 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a0a631e4-7b17-4b56-adbe-7066cc2e5112 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:46.027891 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a0a631e4-7b17-4b56-adbe-7066cc2e5112 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad" status: 200 len: 1514 microversion: 2.1 time: 1.067093 Sep 10 11:50:46.048074 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1384/2686] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:44 2022] GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad => generated 1514 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:46.053941 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-02efd4af-9a9e-4245-915c-91c763709750 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f40734e5e50>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:46.103296 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b8b15775-6962-4c4b-a510-335f86cd96f2 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a32e3e1c1164b8abbb9ee6532e81e72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30967668a810420ebf3d44363f44a135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:46.121224 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b8b15775-6962-4c4b-a510-335f86cd96f2 tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] 10.222.0.23 "GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3" status: 200 len: 1367 microversion: 2.1 time: 0.379994 Sep 10 11:50:46.125246 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1303/2687] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:45 2022] GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3 => generated 1367 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:46.147356 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a47cf8fb-eb18-4862-b13a-5a9165f08fd2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:46.153700 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a47cf8fb-eb18-4862-b13a-5a9165f08fd2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:46.164218 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-02efd4af-9a9e-4245-915c-91c763709750 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/9af4c5ec-005a-43b8-8d1f-84731e30d0df" status: 200 len: 1410 microversion: 2.1 time: 0.114044 Sep 10 11:50:46.164816 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1385/2688] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:50:46 2022] GET /compute/v2.1/images/9af4c5ec-005a-43b8-8d1f-84731e30d0df => generated 1410 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:46.180364 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-57524d89-7c02-4de6-b10f-bd209715d65b req-827bf22a-8d72-45f1-a87e-e2bd0c7ba80e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5779770-492b-4ecd-bbc3-8e67b959c5a3", "name": "network-vif-deleted", "tag": "988df13d-e1f4-40be-aacb-1610d45932ca"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:50:46.184768 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a47cf8fb-eb18-4862-b13a-5a9165f08fd2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:46.187759 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a47cf8fb-eb18-4862-b13a-5a9165f08fd2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:46.188344 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a47cf8fb-eb18-4862-b13a-5a9165f08fd2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:46.192143 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a47cf8fb-eb18-4862-b13a-5a9165f08fd2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:46.192861 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a47cf8fb-eb18-4862-b13a-5a9165f08fd2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:46.193799 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a47cf8fb-eb18-4862-b13a-5a9165f08fd2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:46.223644 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-57524d89-7c02-4de6-b10f-bd209715d65b req-827bf22a-8d72-45f1-a87e-e2bd0c7ba80e service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:46.226663 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-57524d89-7c02-4de6-b10f-bd209715d65b req-827bf22a-8d72-45f1-a87e-e2bd0c7ba80e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:46.227413 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-57524d89-7c02-4de6-b10f-bd209715d65b req-827bf22a-8d72-45f1-a87e-e2bd0c7ba80e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:46.259205 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-57524d89-7c02-4de6-b10f-bd209715d65b req-827bf22a-8d72-45f1-a87e-e2bd0c7ba80e service nova] Creating event network-vif-deleted:988df13d-e1f4-40be-aacb-1610d45932ca for instance c5779770-492b-4ecd-bbc3-8e67b959c5a3 on n-h1-856895-1 Sep 10 11:50:46.272608 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-57524d89-7c02-4de6-b10f-bd209715d65b req-827bf22a-8d72-45f1-a87e-e2bd0c7ba80e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105790 Sep 10 11:50:46.279114 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1386/2689] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:50:46.292930 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cea071a8-9efc-4a13-95c8-d8406b3bab3c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:46.294365 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cea071a8-9efc-4a13-95c8-d8406b3bab3c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:46.313786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cea071a8-9efc-4a13-95c8-d8406b3bab3c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:46.315766 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cea071a8-9efc-4a13-95c8-d8406b3bab3c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:46.317940 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cea071a8-9efc-4a13-95c8-d8406b3bab3c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:46.319009 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cea071a8-9efc-4a13-95c8-d8406b3bab3c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:46.325768 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cea071a8-9efc-4a13-95c8-d8406b3bab3c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:46.326567 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cea071a8-9efc-4a13-95c8-d8406b3bab3c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:46.357389 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a47cf8fb-eb18-4862-b13a-5a9165f08fd2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:46.372783 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a47cf8fb-eb18-4862-b13a-5a9165f08fd2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:46.376624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a47cf8fb-eb18-4862-b13a-5a9165f08fd2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:46.385894 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a47cf8fb-eb18-4862-b13a-5a9165f08fd2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1605 microversion: 2.32 time: 0.257451 Sep 10 11:50:46.387686 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1304/2690] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:46 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1605 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:46.515381 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cea071a8-9efc-4a13-95c8-d8406b3bab3c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:46.527599 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cea071a8-9efc-4a13-95c8-d8406b3bab3c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:46.529393 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cea071a8-9efc-4a13-95c8-d8406b3bab3c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:46.539612 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cea071a8-9efc-4a13-95c8-d8406b3bab3c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1553 microversion: 2.91 time: 0.258734 Sep 10 11:50:46.541284 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1387/2691] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:46 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1553 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:46.764615 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-12f32519-7a63-48b3-8418-9e0563d5cb94 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:46.766047 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-12f32519-7a63-48b3-8418-9e0563d5cb94 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] [instance: d011e7e2-60c2-4e71-962c-73eb811f7351] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:46.774599 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-12f32519-7a63-48b3-8418-9e0563d5cb94 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:46.775098 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-12f32519-7a63-48b3-8418-9e0563d5cb94 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:46.775580 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-12f32519-7a63-48b3-8418-9e0563d5cb94 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:46.776294 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-12f32519-7a63-48b3-8418-9e0563d5cb94 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:46.785834 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-12f32519-7a63-48b3-8418-9e0563d5cb94 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:46.786450 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-12f32519-7a63-48b3-8418-9e0563d5cb94 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:46.943748 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-12f32519-7a63-48b3-8418-9e0563d5cb94 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6051ef60abd443599fd2f0ee2b948479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceee7b01d1014a538d1d1aea7da5c582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:46.959624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-12f32519-7a63-48b3-8418-9e0563d5cb94 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6051ef60abd443599fd2f0ee2b948479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceee7b01d1014a538d1d1aea7da5c582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:46.961734 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-12f32519-7a63-48b3-8418-9e0563d5cb94 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6051ef60abd443599fd2f0ee2b948479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceee7b01d1014a538d1d1aea7da5c582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:46.962549 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-12f32519-7a63-48b3-8418-9e0563d5cb94 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] 10.222.0.23 "GET /compute/v2.1/servers/d011e7e2-60c2-4e71-962c-73eb811f7351" status: 200 len: 1277 microversion: 2.47 time: 0.201861 Sep 10 11:50:46.984328 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1305/2692] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:46 2022] GET /compute/v2.1/servers/d011e7e2-60c2-4e71-962c-73eb811f7351 => generated 1277 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:47.056818 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-666e7174-1ad4-4b65-ab1f-b5befb9468fc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:47.070536 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-666e7174-1ad4-4b65-ab1f-b5befb9468fc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: 3b2dc8b3-1049-4393-824f-b9786315d5ad] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:47.125343 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-666e7174-1ad4-4b65-ab1f-b5befb9468fc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:47.128525 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-666e7174-1ad4-4b65-ab1f-b5befb9468fc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:47.129239 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-666e7174-1ad4-4b65-ab1f-b5befb9468fc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:47.132641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-666e7174-1ad4-4b65-ab1f-b5befb9468fc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:47.136214 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-666e7174-1ad4-4b65-ab1f-b5befb9468fc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:47.137732 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-666e7174-1ad4-4b65-ab1f-b5befb9468fc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:47.151628 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6bd5a998-a15a-4b9a-92e0-eba336b7c84a tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:47.152262 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6bd5a998-a15a-4b9a-92e0-eba336b7c84a tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] [instance: c5779770-492b-4ecd-bbc3-8e67b959c5a3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:47.163885 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6bd5a998-a15a-4b9a-92e0-eba336b7c84a tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:47.168421 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6bd5a998-a15a-4b9a-92e0-eba336b7c84a tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:47.169090 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6bd5a998-a15a-4b9a-92e0-eba336b7c84a tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:47.169992 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6bd5a998-a15a-4b9a-92e0-eba336b7c84a tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:47.170625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6bd5a998-a15a-4b9a-92e0-eba336b7c84a tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:47.171258 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6bd5a998-a15a-4b9a-92e0-eba336b7c84a tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:47.182413 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:50:47.219838 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-6bd5a998-a15a-4b9a-92e0-eba336b7c84a tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] HTTP exception thrown: Instance c5779770-492b-4ecd-bbc3-8e67b959c5a3 could not be found. Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6bd5a998-a15a-4b9a-92e0-eba336b7c84a tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Request method failure captured: Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3 HTTP/1.1 Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHmcK0REE_mElgNTIXg4ZfDUVhjjNVq9ub8sPpZGt_I77IWmjmg0xzCBX-IIExGzzLeN_qG6yH3rfDD0PAsqO8Qc8sMG3UHIfcu4lrv3WJU16Y1HQUiMyX-D70faoBsl08nLWaq-VwC24hXgGcRsz98ypnBSx_XtGoOXLDN8tqIdnsM Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 30967668a810420ebf3d44363f44a135 Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersTestManualDisk-235420588 Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/30967668a810420ebf3d44363f44a135"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/30967668a810420ebf3d44363f44a135"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_30967668a810420ebf3d44363f44a135", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/30967668a810420ebf3d44363f44a135"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersTestManualDisk-235420588 Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 30967668a810420ebf3d44363f44a135 Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersTestManualDisk-235420588 Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersTestManualDisk-235420588-project Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 8a32e3e1c1164b8abbb9ee6532e81e72 Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersTestManualDisk-235420588-project Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance c5779770-492b-4ecd-bbc3-8e67b959c5a3 could not be found. Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'c5779770-492b-4ecd-bbc3-8e67b959c5a3'} Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5779770-492b-4ecd-bbc3-8e67b959c5a3 could not be found. Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5779770-492b-4ecd-bbc3-8e67b959c5a3 could not be found. Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:50:47.222294 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:47.227784 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:50:47.227784 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:50:47.227784 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:50:47.227784 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:50:47.227784 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:50:47.227784 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5779770-492b-4ecd-bbc3-8e67b959c5a3 could not be found. Sep 10 11:50:47.227784 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:50:47.233736 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6bd5a998-a15a-4b9a-92e0-eba336b7c84a tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Returning 404 to user: Instance c5779770-492b-4ecd-bbc3-8e67b959c5a3 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:50:47.235448 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6bd5a998-a15a-4b9a-92e0-eba336b7c84a tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] 10.222.0.23 "GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3" status: 404 len: 111 microversion: 2.1 time: 0.088895 Sep 10 11:50:47.240996 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1306/2693] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:47 2022] GET /compute/v2.1/servers/c5779770-492b-4ecd-bbc3-8e67b959c5a3 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:50:47.251402 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-336e03e1-34d2-41c2-8993-637623c83c7e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f4072a73280>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:47.327713 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-336e03e1-34d2-41c2-8993-637623c83c7e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/9af4c5ec-005a-43b8-8d1f-84731e30d0df" status: 200 len: 1410 microversion: 2.1 time: 0.084588 Sep 10 11:50:47.328312 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1307/2694] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:50:47 2022] GET /compute/v2.1/images/9af4c5ec-005a-43b8-8d1f-84731e30d0df => generated 1410 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:47.333384 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-39d36523-b1f8-4efd-8c5f-a353cc39d93a tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] Calling method '.version_select at 0x7f4072a1ac10>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:47.384229 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-39d36523-b1f8-4efd-8c5f-a353cc39d93a tempest-ServersTestManualDisk-235420588 tempest-ServersTestManualDisk-235420588-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1646666279" status: 202 len: 0 microversion: 2.1 time: 0.054847 Sep 10 11:50:47.384824 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1308/2695] 10.222.0.23 () {58 vars in 1221 bytes} [Sat Sep 10 11:50:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1646666279 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:50:47.420426 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f1fda1bb-e3c7-4b39-8645-f905b4c28216 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:47.421063 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f1fda1bb-e3c7-4b39-8645-f905b4c28216 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:47.437579 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1fda1bb-e3c7-4b39-8645-f905b4c28216 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:47.438089 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1fda1bb-e3c7-4b39-8645-f905b4c28216 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:47.438540 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1fda1bb-e3c7-4b39-8645-f905b4c28216 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:47.440744 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1fda1bb-e3c7-4b39-8645-f905b4c28216 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:47.441238 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1fda1bb-e3c7-4b39-8645-f905b4c28216 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:47.441683 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1fda1bb-e3c7-4b39-8645-f905b4c28216 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:48.451139 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f1fda1bb-e3c7-4b39-8645-f905b4c28216 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:48.463142 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f1fda1bb-e3c7-4b39-8645-f905b4c28216 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:48.478895 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f1fda1bb-e3c7-4b39-8645-f905b4c28216 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:48.480328 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f1fda1bb-e3c7-4b39-8645-f905b4c28216 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1605 microversion: 2.32 time: 1.067606 Sep 10 11:50:48.482774 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1309/2696] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:47 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1605 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:48.500509 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9fe37b79-9fb2-4292-ba16-4342e996c153 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:48.512596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9fe37b79-9fb2-4292-ba16-4342e996c153 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:48.549074 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fe37b79-9fb2-4292-ba16-4342e996c153 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:48.549996 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fe37b79-9fb2-4292-ba16-4342e996c153 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:48.550679 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fe37b79-9fb2-4292-ba16-4342e996c153 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:48.551724 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fe37b79-9fb2-4292-ba16-4342e996c153 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:48.554960 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fe37b79-9fb2-4292-ba16-4342e996c153 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:48.557002 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fe37b79-9fb2-4292-ba16-4342e996c153 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:48.760155 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-666e7174-1ad4-4b65-ab1f-b5befb9468fc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:48.774495 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-666e7174-1ad4-4b65-ab1f-b5befb9468fc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad" status: 200 len: 1514 microversion: 2.1 time: 1.721992 Sep 10 11:50:48.776189 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1388/2697] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:47 2022] GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad => generated 1514 bytes in 1726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:48.792366 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b1cd5c0c-ed83-4386-ada9-f32366d9616d tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:48.793356 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b1cd5c0c-ed83-4386-ada9-f32366d9616d tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] [instance: d011e7e2-60c2-4e71-962c-73eb811f7351] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:48.809171 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1cd5c0c-ed83-4386-ada9-f32366d9616d tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:48.810030 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1cd5c0c-ed83-4386-ada9-f32366d9616d tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:48.810756 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1cd5c0c-ed83-4386-ada9-f32366d9616d tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:48.812014 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1cd5c0c-ed83-4386-ada9-f32366d9616d tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:48.815827 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1cd5c0c-ed83-4386-ada9-f32366d9616d tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:48.816730 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1cd5c0c-ed83-4386-ada9-f32366d9616d tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:48.900932 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9fe37b79-9fb2-4292-ba16-4342e996c153 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:48.913104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9fe37b79-9fb2-4292-ba16-4342e996c153 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:48.925310 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9fe37b79-9fb2-4292-ba16-4342e996c153 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:48.948887 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9fe37b79-9fb2-4292-ba16-4342e996c153 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1553 microversion: 2.91 time: 0.462703 Sep 10 11:50:48.959569 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1310/2698] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:48 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1553 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:48.997127 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b17d45e8-9911-4efc-84d7-802f93a9d87f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f4072a72f70>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:49.033551 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b1cd5c0c-ed83-4386-ada9-f32366d9616d tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6051ef60abd443599fd2f0ee2b948479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceee7b01d1014a538d1d1aea7da5c582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:49.050508 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b1cd5c0c-ed83-4386-ada9-f32366d9616d tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6051ef60abd443599fd2f0ee2b948479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceee7b01d1014a538d1d1aea7da5c582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:49.055443 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b1cd5c0c-ed83-4386-ada9-f32366d9616d tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6051ef60abd443599fd2f0ee2b948479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceee7b01d1014a538d1d1aea7da5c582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:49.056692 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b1cd5c0c-ed83-4386-ada9-f32366d9616d tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] 10.222.0.23 "GET /compute/v2.1/servers/d011e7e2-60c2-4e71-962c-73eb811f7351" status: 200 len: 1339 microversion: 2.47 time: 0.279350 Sep 10 11:50:49.075011 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1389/2699] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:48 2022] GET /compute/v2.1/servers/d011e7e2-60c2-4e71-962c-73eb811f7351 => generated 1339 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:49.516835 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e0b2d2c0-7450-4434-b02f-9a0245ef5ced tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:49.522919 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e0b2d2c0-7450-4434-b02f-9a0245ef5ced tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:49.555498 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0b2d2c0-7450-4434-b02f-9a0245ef5ced tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:49.560207 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0b2d2c0-7450-4434-b02f-9a0245ef5ced tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:49.561017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0b2d2c0-7450-4434-b02f-9a0245ef5ced tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:49.562044 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0b2d2c0-7450-4434-b02f-9a0245ef5ced tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:49.565175 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0b2d2c0-7450-4434-b02f-9a0245ef5ced tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:49.566717 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0b2d2c0-7450-4434-b02f-9a0245ef5ced tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:49.791737 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e0b2d2c0-7450-4434-b02f-9a0245ef5ced tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:49.816606 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e0b2d2c0-7450-4434-b02f-9a0245ef5ced tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:49.822035 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e0b2d2c0-7450-4434-b02f-9a0245ef5ced tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:49.837074 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e0b2d2c0-7450-4434-b02f-9a0245ef5ced tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1605 microversion: 2.32 time: 0.320423 Sep 10 11:50:49.838824 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1390/2700] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:49 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1605 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:50:49.861246 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-6c569076-a4a6-449c-a716-4468f524383d req-86355caf-5e08-450b-b530-05e7cbdbe407 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10b130d5-dcd3-41e9-9e67-c68eb28726a2", "name": "network-vif-plugged", "status": "completed", "tag": "3eff96c5-ed1a-483c-9684-7de7e46b66f8"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:50:49.903004 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-6c569076-a4a6-449c-a716-4468f524383d req-86355caf-5e08-450b-b530-05e7cbdbe407 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:49.907975 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-6c569076-a4a6-449c-a716-4468f524383d req-86355caf-5e08-450b-b530-05e7cbdbe407 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:49.909695 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-6c569076-a4a6-449c-a716-4468f524383d req-86355caf-5e08-450b-b530-05e7cbdbe407 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:49.977186 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-6c569076-a4a6-449c-a716-4468f524383d req-86355caf-5e08-450b-b530-05e7cbdbe407 service nova] Creating event network-vif-plugged:3eff96c5-ed1a-483c-9684-7de7e46b66f8 for instance 10b130d5-dcd3-41e9-9e67-c68eb28726a2 on n-h1-856895-1 Sep 10 11:50:50.004254 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-6c569076-a4a6-449c-a716-4468f524383d req-86355caf-5e08-450b-b530-05e7cbdbe407 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159549 Sep 10 11:50:50.004907 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1391/2701] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:50:50.029437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-51fdfcf0-0adb-470f-971c-b604d5d009f9 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:50.030153 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-51fdfcf0-0adb-470f-971c-b604d5d009f9 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: 3b2dc8b3-1049-4393-824f-b9786315d5ad] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:50.062699 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-51fdfcf0-0adb-470f-971c-b604d5d009f9 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:50.065263 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-51fdfcf0-0adb-470f-971c-b604d5d009f9 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:50.065738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-51fdfcf0-0adb-470f-971c-b604d5d009f9 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:50.066468 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-51fdfcf0-0adb-470f-971c-b604d5d009f9 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:50.069543 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-51fdfcf0-0adb-470f-971c-b604d5d009f9 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:50.069950 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-51fdfcf0-0adb-470f-971c-b604d5d009f9 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:50.496268 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-51fdfcf0-0adb-470f-971c-b604d5d009f9 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:50.514661 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-51fdfcf0-0adb-470f-971c-b604d5d009f9 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad" status: 200 len: 1514 microversion: 2.1 time: 0.508499 Sep 10 11:50:50.538381 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1392/2702] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:50 2022] GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad => generated 1514 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:50.545042 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-898d5a1a-98af-4fd0-b9a9-625d8c7575cc tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:50.546731 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-898d5a1a-98af-4fd0-b9a9-625d8c7575cc tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:50.566428 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-898d5a1a-98af-4fd0-b9a9-625d8c7575cc tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:50.568784 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-898d5a1a-98af-4fd0-b9a9-625d8c7575cc tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:50.569433 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-898d5a1a-98af-4fd0-b9a9-625d8c7575cc tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:50.574724 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-898d5a1a-98af-4fd0-b9a9-625d8c7575cc tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:50.575737 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-898d5a1a-98af-4fd0-b9a9-625d8c7575cc tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:50.578193 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-898d5a1a-98af-4fd0-b9a9-625d8c7575cc tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:50.784186 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-898d5a1a-98af-4fd0-b9a9-625d8c7575cc tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:50.796257 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-898d5a1a-98af-4fd0-b9a9-625d8c7575cc tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:50.799680 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-898d5a1a-98af-4fd0-b9a9-625d8c7575cc tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:50.807025 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-898d5a1a-98af-4fd0-b9a9-625d8c7575cc tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1553 microversion: 2.91 time: 0.266272 Sep 10 11:50:50.807865 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1393/2703] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:50 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1553 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:50.814924 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-54c7b0a1-42e8-43cc-a2a5-12a08c95c639 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:50.820395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-54c7b0a1-42e8-43cc-a2a5-12a08c95c639 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] [instance: d011e7e2-60c2-4e71-962c-73eb811f7351] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:50.833501 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54c7b0a1-42e8-43cc-a2a5-12a08c95c639 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:50.835417 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54c7b0a1-42e8-43cc-a2a5-12a08c95c639 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:50.837431 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54c7b0a1-42e8-43cc-a2a5-12a08c95c639 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:50.839099 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54c7b0a1-42e8-43cc-a2a5-12a08c95c639 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:50.840091 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54c7b0a1-42e8-43cc-a2a5-12a08c95c639 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:50.841545 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54c7b0a1-42e8-43cc-a2a5-12a08c95c639 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:51.004763 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-54c7b0a1-42e8-43cc-a2a5-12a08c95c639 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6051ef60abd443599fd2f0ee2b948479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceee7b01d1014a538d1d1aea7da5c582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:51.012894 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=100 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:50:51.021356 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-54c7b0a1-42e8-43cc-a2a5-12a08c95c639 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6051ef60abd443599fd2f0ee2b948479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceee7b01d1014a538d1d1aea7da5c582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:51.027563 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-54c7b0a1-42e8-43cc-a2a5-12a08c95c639 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6051ef60abd443599fd2f0ee2b948479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceee7b01d1014a538d1d1aea7da5c582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:51.028856 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-54c7b0a1-42e8-43cc-a2a5-12a08c95c639 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] 10.222.0.23 "GET /compute/v2.1/servers/d011e7e2-60c2-4e71-962c-73eb811f7351" status: 200 len: 1339 microversion: 2.47 time: 0.219810 Sep 10 11:50:51.032628 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1394/2704] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:50 2022] GET /compute/v2.1/servers/d011e7e2-60c2-4e71-962c-73eb811f7351 => generated 1339 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:51.040857 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d023c2f0-856f-4b16-8686-4478d72afe5f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:51.044172 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d023c2f0-856f-4b16-8686-4478d72afe5f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:51.062154 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d023c2f0-856f-4b16-8686-4478d72afe5f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:51.062154 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d023c2f0-856f-4b16-8686-4478d72afe5f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:51.063418 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d023c2f0-856f-4b16-8686-4478d72afe5f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:51.064263 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d023c2f0-856f-4b16-8686-4478d72afe5f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:51.064740 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d023c2f0-856f-4b16-8686-4478d72afe5f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:51.065182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d023c2f0-856f-4b16-8686-4478d72afe5f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:51.216322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d023c2f0-856f-4b16-8686-4478d72afe5f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:51.236074 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d023c2f0-856f-4b16-8686-4478d72afe5f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:51.237618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d023c2f0-856f-4b16-8686-4478d72afe5f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:51.238780 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d023c2f0-856f-4b16-8686-4478d72afe5f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1605 microversion: 2.32 time: 0.204612 Sep 10 11:50:51.239391 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1395/2705] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:51 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1605 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:51.607078 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b1aded0a-e4fe-4ace-9e58-3cadd78e9c31 tempest-KeyPairsV2TestJSON-462193904 tempest-KeyPairsV2TestJSON-462193904-project] Action: 'create', calling method: .version_select at 0x7f40730d6280>, body: {"keypair": {"name": "tempest-keypair-1865010884", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLf7DwCU3kvf5uNgen3tz+AutgHTMhkplFXzH5wkwn1C1Tb0RvnfgJaIrj9JXn5211yoOY2VATgfaUAXK9P/Qx5fj2ge/qJ4e2sPammj2htyRzHMLXtMxWZWkrEtDdPMDw=="}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:50:51.663345 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:50:51.694468 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-b1aded0a-e4fe-4ace-9e58-3cadd78e9c31 tempest-KeyPairsV2TestJSON-462193904 tempest-KeyPairsV2TestJSON-462193904-project] Getting quotas for project 740f7ae8a7d147c2b54375d3bc90075f. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:50:51.706690 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-b1aded0a-e4fe-4ace-9e58-3cadd78e9c31 tempest-KeyPairsV2TestJSON-462193904 tempest-KeyPairsV2TestJSON-462193904-project] Getting quotas for user 9dbe9a32e24e439a913f39ac048e6a55 and project 740f7ae8a7d147c2b54375d3bc90075f. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:50:51.836635 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b1aded0a-e4fe-4ace-9e58-3cadd78e9c31 tempest-KeyPairsV2TestJSON-462193904 tempest-KeyPairsV2TestJSON-462193904-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.488393 Sep 10 11:50:51.839655 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1396/2706] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 11:50:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:50:51.872098 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b269c461-a36f-484b-9b66-16f49cf36118 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:51.872741 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b269c461-a36f-484b-9b66-16f49cf36118 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: 3b2dc8b3-1049-4393-824f-b9786315d5ad] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:51.913722 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b269c461-a36f-484b-9b66-16f49cf36118 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:51.917545 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b269c461-a36f-484b-9b66-16f49cf36118 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:51.923720 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b269c461-a36f-484b-9b66-16f49cf36118 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:51.926760 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b269c461-a36f-484b-9b66-16f49cf36118 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:51.927294 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b269c461-a36f-484b-9b66-16f49cf36118 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:51.930113 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b269c461-a36f-484b-9b66-16f49cf36118 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:52.304273 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b269c461-a36f-484b-9b66-16f49cf36118 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:52.316240 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b269c461-a36f-484b-9b66-16f49cf36118 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad" status: 200 len: 1514 microversion: 2.1 time: 0.475393 Sep 10 11:50:52.338717 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1397/2707] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:50:51 2022] GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad => generated 1514 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:50:52.353751 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-61d4277c-bced-485c-a162-40538920af3c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:52.359727 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-61d4277c-bced-485c-a162-40538920af3c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:52.369366 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61d4277c-bced-485c-a162-40538920af3c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:52.378553 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61d4277c-bced-485c-a162-40538920af3c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:52.378553 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61d4277c-bced-485c-a162-40538920af3c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:52.378553 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61d4277c-bced-485c-a162-40538920af3c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:52.378984 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61d4277c-bced-485c-a162-40538920af3c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:52.379269 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61d4277c-bced-485c-a162-40538920af3c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:52.532448 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-61d4277c-bced-485c-a162-40538920af3c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:52.542660 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-61d4277c-bced-485c-a162-40538920af3c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:52.553758 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-61d4277c-bced-485c-a162-40538920af3c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:52.568219 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-61d4277c-bced-485c-a162-40538920af3c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1553 microversion: 2.91 time: 0.225253 Sep 10 11:50:52.568789 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1398/2708] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:52 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1553 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:52.581331 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-726fb34f-fef0-44b5-be4c-499424593bd3 tempest-KeyPairsV2TestJSON-462193904 tempest-KeyPairsV2TestJSON-462193904-project] Calling method '.version_select at 0x7f407329a790>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:52.606110 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-726fb34f-fef0-44b5-be4c-499424593bd3 tempest-KeyPairsV2TestJSON-462193904 tempest-KeyPairsV2TestJSON-462193904-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs/tempest-keypair-1865010884" status: 200 len: 498 microversion: 2.1 time: 0.036074 Sep 10 11:50:52.616302 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1399/2709] 10.222.0.23 () {58 vars in 1218 bytes} [Sat Sep 10 11:50:52 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1865010884 => generated 498 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:50:52.624422 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a94e5d3a-4500-4e3a-a238-b153cd52d98d tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:52.625064 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a94e5d3a-4500-4e3a-a238-b153cd52d98d tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] [instance: d011e7e2-60c2-4e71-962c-73eb811f7351] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:52.637218 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a94e5d3a-4500-4e3a-a238-b153cd52d98d tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:52.639137 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a94e5d3a-4500-4e3a-a238-b153cd52d98d tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:52.639819 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a94e5d3a-4500-4e3a-a238-b153cd52d98d tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:52.644675 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a94e5d3a-4500-4e3a-a238-b153cd52d98d tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:52.645395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a94e5d3a-4500-4e3a-a238-b153cd52d98d tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:52.646005 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a94e5d3a-4500-4e3a-a238-b153cd52d98d tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:52.815361 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a94e5d3a-4500-4e3a-a238-b153cd52d98d tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6051ef60abd443599fd2f0ee2b948479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceee7b01d1014a538d1d1aea7da5c582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:52.837337 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a94e5d3a-4500-4e3a-a238-b153cd52d98d tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6051ef60abd443599fd2f0ee2b948479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceee7b01d1014a538d1d1aea7da5c582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:52.840472 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a94e5d3a-4500-4e3a-a238-b153cd52d98d tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6051ef60abd443599fd2f0ee2b948479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceee7b01d1014a538d1d1aea7da5c582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:52.841800 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a94e5d3a-4500-4e3a-a238-b153cd52d98d tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] 10.222.0.23 "GET /compute/v2.1/servers/d011e7e2-60c2-4e71-962c-73eb811f7351" status: 200 len: 1360 microversion: 2.47 time: 0.231120 Sep 10 11:50:52.847018 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1400/2710] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:52 2022] GET /compute/v2.1/servers/d011e7e2-60c2-4e71-962c-73eb811f7351 => generated 1360 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:52.866550 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cce90b1a-3214-4d80-870a-9da32d49f71f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:52.867423 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cce90b1a-3214-4d80-870a-9da32d49f71f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:52.878840 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cce90b1a-3214-4d80-870a-9da32d49f71f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:52.879389 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cce90b1a-3214-4d80-870a-9da32d49f71f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:52.881901 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cce90b1a-3214-4d80-870a-9da32d49f71f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:52.882676 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cce90b1a-3214-4d80-870a-9da32d49f71f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:52.883156 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cce90b1a-3214-4d80-870a-9da32d49f71f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:52.883619 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cce90b1a-3214-4d80-870a-9da32d49f71f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:53.127064 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cce90b1a-3214-4d80-870a-9da32d49f71f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:53.146120 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cce90b1a-3214-4d80-870a-9da32d49f71f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:53.147877 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cce90b1a-3214-4d80-870a-9da32d49f71f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:50:53.150636 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cce90b1a-3214-4d80-870a-9da32d49f71f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1605 microversion: 2.32 time: 0.300916 Sep 10 11:50:53.151235 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1401/2711] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:50:52 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1605 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:50:53.155674 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8ceb52b2-bf2a-43cc-939a-626668645c4e tempest-KeyPairsV2TestJSON-462193904 tempest-KeyPairsV2TestJSON-462193904-project] Calling method '.version_select at 0x7f407b5e4790>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:50:53.200971 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8ceb52b2-bf2a-43cc-939a-626668645c4e tempest-KeyPairsV2TestJSON-462193904 tempest-KeyPairsV2TestJSON-462193904-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1865010884" status: 202 len: 0 microversion: 2.1 time: 0.048644 Sep 10 11:50:53.201706 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1402/2712] 10.222.0.23 () {58 vars in 1221 bytes} [Sat Sep 10 11:50:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1865010884 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:50:53.214873 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-14ab514d-9bbd-4e28-98b5-5f635d94d6dc tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-506851922"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:50:53.217425 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-14ab514d-9bbd-4e28-98b5-5f635d94d6dc tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] [instance: d011e7e2-60c2-4e71-962c-73eb811f7351] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:50:53.238683 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-14ab514d-9bbd-4e28-98b5-5f635d94d6dc tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:53.239681 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-14ab514d-9bbd-4e28-98b5-5f635d94d6dc tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:53.239786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-14ab514d-9bbd-4e28-98b5-5f635d94d6dc tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:53.240539 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-14ab514d-9bbd-4e28-98b5-5f635d94d6dc tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:50:53.241897 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-14ab514d-9bbd-4e28-98b5-5f635d94d6dc tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:50:53.242555 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-14ab514d-9bbd-4e28-98b5-5f635d94d6dc tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:50:54.945899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:50:55.705819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=10 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:50:58.911145 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=12 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:50:58.948196 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:51:01.028010 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b17d45e8-9911-4efc-84d7-802f93a9d87f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/9af4c5ec-005a-43b8-8d1f-84731e30d0df" status: 200 len: 1410 microversion: 2.1 time: 12.066720 Sep 10 11:51:01.029865 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1311/2713] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:50:48 2022] GET /compute/v2.1/images/9af4c5ec-005a-43b8-8d1f-84731e30d0df => generated 1410 bytes in 12069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:01.038737 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8433e236-5c9b-4626-8b3a-939d579efc27 tempest-KeyPairsV2TestJSON-462193904 tempest-KeyPairsV2TestJSON-462193904-project] Action: 'create', calling method: .version_select at 0x7f4072a4d550>, body: {"keypair": {"name": "tempest-keypair-573322263", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFChGzkSDIUw+01g68Z5oedmF7jaqIiIdCGzb25Vfw/lkzsYWZ6bymxksRoeifBgyZQwfMiLeYlz/MSKz+HpttG8n/hXYI9mk+1xJgaq1CiiVLLam7cG82OmpwUY8xQhsA=="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:51:01.087604 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-8433e236-5c9b-4626-8b3a-939d579efc27 tempest-KeyPairsV2TestJSON-462193904 tempest-KeyPairsV2TestJSON-462193904-project] Getting quotas for project 740f7ae8a7d147c2b54375d3bc90075f. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:51:01.104457 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-8433e236-5c9b-4626-8b3a-939d579efc27 tempest-KeyPairsV2TestJSON-462193904 tempest-KeyPairsV2TestJSON-462193904-project] Getting quotas for user 9dbe9a32e24e439a913f39ac048e6a55 and project 740f7ae8a7d147c2b54375d3bc90075f. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:51:01.159867 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8433e236-5c9b-4626-8b3a-939d579efc27 tempest-KeyPairsV2TestJSON-462193904 tempest-KeyPairsV2TestJSON-462193904-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.128050 Sep 10 11:51:01.161022 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1312/2714] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 11:51:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:51:01.167708 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dd212392-35b8-4294-b1c5-311924fff5ce tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:01.168869 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-dd212392-35b8-4294-b1c5-311924fff5ce tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: 3b2dc8b3-1049-4393-824f-b9786315d5ad] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:01.180075 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dd212392-35b8-4294-b1c5-311924fff5ce tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:01.182999 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dd212392-35b8-4294-b1c5-311924fff5ce tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:01.183741 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dd212392-35b8-4294-b1c5-311924fff5ce tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:01.185280 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dd212392-35b8-4294-b1c5-311924fff5ce tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:01.187051 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dd212392-35b8-4294-b1c5-311924fff5ce tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:01.189510 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dd212392-35b8-4294-b1c5-311924fff5ce tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:01.264971 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-14ab514d-9bbd-4e28-98b5-5f635d94d6dc tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] 10.222.0.23 "POST /compute/v2.1/servers/d011e7e2-60c2-4e71-962c-73eb811f7351/action" status: 202 len: 52 microversion: 2.47 time: 8.053246 Sep 10 11:51:01.268146 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1403/2715] 10.222.0.23 () {62 vars in 1319 bytes} [Sat Sep 10 11:50:53 2022] POST /compute/v2.1/servers/d011e7e2-60c2-4e71-962c-73eb811f7351/action => generated 52 bytes in 8066 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Sep 10 11:51:01.297973 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fad66a73-a12b-4449-9060-7d59cffcd599 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:01.299968 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fad66a73-a12b-4449-9060-7d59cffcd599 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:01.311946 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fad66a73-a12b-4449-9060-7d59cffcd599 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:01.312780 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fad66a73-a12b-4449-9060-7d59cffcd599 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:01.313813 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fad66a73-a12b-4449-9060-7d59cffcd599 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:01.314883 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fad66a73-a12b-4449-9060-7d59cffcd599 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:01.315640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fad66a73-a12b-4449-9060-7d59cffcd599 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:01.316243 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fad66a73-a12b-4449-9060-7d59cffcd599 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:01.552549 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fad66a73-a12b-4449-9060-7d59cffcd599 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:01.553721 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-dd212392-35b8-4294-b1c5-311924fff5ce tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:01.563655 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-dd212392-35b8-4294-b1c5-311924fff5ce tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad" status: 200 len: 1514 microversion: 2.1 time: 0.401276 Sep 10 11:51:01.571485 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1313/2716] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:01 2022] GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad => generated 1514 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:01.577475 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ab6e293a-6f7c-46cb-a21f-1c0b5ab1e639 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:01.578350 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ab6e293a-6f7c-46cb-a21f-1c0b5ab1e639 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:01.593018 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab6e293a-6f7c-46cb-a21f-1c0b5ab1e639 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:01.593813 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab6e293a-6f7c-46cb-a21f-1c0b5ab1e639 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:01.595967 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab6e293a-6f7c-46cb-a21f-1c0b5ab1e639 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:01.597046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fad66a73-a12b-4449-9060-7d59cffcd599 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:01.598005 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab6e293a-6f7c-46cb-a21f-1c0b5ab1e639 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:01.598952 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fad66a73-a12b-4449-9060-7d59cffcd599 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:01.599731 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab6e293a-6f7c-46cb-a21f-1c0b5ab1e639 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:01.605192 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab6e293a-6f7c-46cb-a21f-1c0b5ab1e639 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:01.619591 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fad66a73-a12b-4449-9060-7d59cffcd599 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1553 microversion: 2.91 time: 0.349987 Sep 10 11:51:01.633230 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1404/2717] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:01 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1553 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:51:01.641508 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4d116490-395e-48f4-b658-ca9810590d76 tempest-KeyPairsV2TestJSON-462193904 tempest-KeyPairsV2TestJSON-462193904-project] Calling method '.version_select at 0x7f407355f940>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:01.695518 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4d116490-395e-48f4-b658-ca9810590d76 tempest-KeyPairsV2TestJSON-462193904 tempest-KeyPairsV2TestJSON-462193904-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-573322263" status: 202 len: 0 microversion: 2.1 time: 0.059582 Sep 10 11:51:01.698656 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1405/2718] 10.222.0.23 () {58 vars in 1218 bytes} [Sat Sep 10 11:51:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-573322263 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:51:01.718396 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4e3a88e7-2d5f-429c-9eb5-f2c4440b50d4 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:01.719387 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4e3a88e7-2d5f-429c-9eb5-f2c4440b50d4 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] [instance: d011e7e2-60c2-4e71-962c-73eb811f7351] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:01.750493 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=4 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:51:01.754376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e3a88e7-2d5f-429c-9eb5-f2c4440b50d4 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:01.755115 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e3a88e7-2d5f-429c-9eb5-f2c4440b50d4 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:01.756398 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e3a88e7-2d5f-429c-9eb5-f2c4440b50d4 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:01.757505 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e3a88e7-2d5f-429c-9eb5-f2c4440b50d4 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:01.758710 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e3a88e7-2d5f-429c-9eb5-f2c4440b50d4 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:01.760813 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e3a88e7-2d5f-429c-9eb5-f2c4440b50d4 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:01.762207 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ab6e293a-6f7c-46cb-a21f-1c0b5ab1e639 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:01.778499 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ab6e293a-6f7c-46cb-a21f-1c0b5ab1e639 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:01.784932 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ab6e293a-6f7c-46cb-a21f-1c0b5ab1e639 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:01.786195 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ab6e293a-6f7c-46cb-a21f-1c0b5ab1e639 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1605 microversion: 2.32 time: 0.213447 Sep 10 11:51:01.786854 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1314/2719] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:01 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1605 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:51:01.805383 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4e3a88e7-2d5f-429c-9eb5-f2c4440b50d4 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] [instance: d011e7e2-60c2-4e71-962c-73eb811f7351] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:51:01.821257 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f6b9fe00-98bc-4c18-b053-45bb92102b28 tempest-KeyPairsV2TestJSON-462193904 tempest-KeyPairsV2TestJSON-462193904-project] Action: 'create', calling method: .version_select at 0x7f40733bf3a0>, body: {"keypair": {"name": "tempest-keypair-22139687", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:51:01.861633 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-f6b9fe00-98bc-4c18-b053-45bb92102b28 tempest-KeyPairsV2TestJSON-462193904 tempest-KeyPairsV2TestJSON-462193904-project] Getting quotas for project 740f7ae8a7d147c2b54375d3bc90075f. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:51:01.881200 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-f6b9fe00-98bc-4c18-b053-45bb92102b28 tempest-KeyPairsV2TestJSON-462193904 tempest-KeyPairsV2TestJSON-462193904-project] Getting quotas for user 9dbe9a32e24e439a913f39ac048e6a55 and project 740f7ae8a7d147c2b54375d3bc90075f. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:51:01.945830 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f6b9fe00-98bc-4c18-b053-45bb92102b28 tempest-KeyPairsV2TestJSON-462193904 tempest-KeyPairsV2TestJSON-462193904-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 572 microversion: 2.1 time: 0.140384 Sep 10 11:51:01.947551 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1315/2720] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 11:51:01 2022] POST /compute/v2.1/os-keypairs => generated 572 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:51:01.959006 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-51cc4715-0107-46a1-aa0c-6ba83a004e2f tempest-KeyPairsV2TestJSON-462193904 tempest-KeyPairsV2TestJSON-462193904-project] Calling method '.version_select at 0x7f407b59a040>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:01.999674 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4e3a88e7-2d5f-429c-9eb5-f2c4440b50d4 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d011e7e2-60c2-4e71-962c-73eb811f7351" status: 204 len: 0 microversion: 2.47 time: 0.299273 Sep 10 11:51:02.000846 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1406/2721] 10.222.0.23 () {60 vars in 1280 bytes} [Sat Sep 10 11:51:01 2022] DELETE /compute/v2.1/servers/d011e7e2-60c2-4e71-962c-73eb811f7351 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 11:51:02.021135 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-43566857-d6b4-46a9-b18e-b2f00046bbbc tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:02.023615 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-43566857-d6b4-46a9-b18e-b2f00046bbbc tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] [instance: d011e7e2-60c2-4e71-962c-73eb811f7351] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:02.030698 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-51cc4715-0107-46a1-aa0c-6ba83a004e2f tempest-KeyPairsV2TestJSON-462193904 tempest-KeyPairsV2TestJSON-462193904-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-22139687" status: 202 len: 0 microversion: 2.1 time: 0.076745 Sep 10 11:51:02.032852 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1316/2722] 10.222.0.23 () {58 vars in 1215 bytes} [Sat Sep 10 11:51:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-22139687 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 11:51:02.044449 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8631a805-7a95-486f-878c-3a5500104c06 tempest-KeyPairsV2TestJSON-462193904 tempest-KeyPairsV2TestJSON-462193904-project] Action: 'create', calling method: .version_select at 0x7f407b5e0550>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-40891611", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmw1aUYMusOe7GZ5wdeHCnGg1MCCgQxhYRxRqxerYUXQIqp4DtUSfgNi7BPAfdMjYqY9s9vbrITJf1nP2hZr4kO3f1JGkB2aPtaI0NH3ieKjPE42a+G817CpRaCdKcoVg=="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:51:02.045416 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-43566857-d6b4-46a9-b18e-b2f00046bbbc tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:02.046051 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-43566857-d6b4-46a9-b18e-b2f00046bbbc tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:02.046607 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-43566857-d6b4-46a9-b18e-b2f00046bbbc tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:02.049862 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-43566857-d6b4-46a9-b18e-b2f00046bbbc tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:02.050752 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-43566857-d6b4-46a9-b18e-b2f00046bbbc tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:02.051360 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-43566857-d6b4-46a9-b18e-b2f00046bbbc tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:02.068788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-8631a805-7a95-486f-878c-3a5500104c06 tempest-KeyPairsV2TestJSON-462193904 tempest-KeyPairsV2TestJSON-462193904-project] Getting quotas for project 740f7ae8a7d147c2b54375d3bc90075f. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:51:02.075543 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-8631a805-7a95-486f-878c-3a5500104c06 tempest-KeyPairsV2TestJSON-462193904 tempest-KeyPairsV2TestJSON-462193904-project] Getting quotas for user 9dbe9a32e24e439a913f39ac048e6a55 and project 740f7ae8a7d147c2b54375d3bc90075f. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:51:02.127406 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8631a805-7a95-486f-878c-3a5500104c06 tempest-KeyPairsV2TestJSON-462193904 tempest-KeyPairsV2TestJSON-462193904-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.085745 Sep 10 11:51:02.128698 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1317/2723] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 11:51:02 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:51:02.134640 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-264c0722-0cc7-49a3-999f-8ea5d337d865 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f40733bf550>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:02.193482 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-264c0722-0cc7-49a3-999f-8ea5d337d865 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/9af4c5ec-005a-43b8-8d1f-84731e30d0df" status: 200 len: 1410 microversion: 2.1 time: 0.063150 Sep 10 11:51:02.203069 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1318/2724] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:51:02 2022] GET /compute/v2.1/images/9af4c5ec-005a-43b8-8d1f-84731e30d0df => generated 1410 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:02.209785 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fa9deb6d-c022-4c47-817b-c52ddee64ecd tempest-KeyPairsV2TestJSON-462193904 tempest-KeyPairsV2TestJSON-462193904-project] Action: 'create', calling method: .version_select at 0x7f4072a48ee0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1355953705", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmlQQPIjrN1n+Lj2SZ7ihpyiCZAMe/7cC/ABbyrhQDrH/5P/XqGxdP6eWK8PcA7LRj9/vRwFWay8kxMobWv+Wd4JyYEEUaKNG62K5llZAqxF9TwOkfq336cmnIII4P7hA=="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:51:02.234195 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-fa9deb6d-c022-4c47-817b-c52ddee64ecd tempest-KeyPairsV2TestJSON-462193904 tempest-KeyPairsV2TestJSON-462193904-project] Getting quotas for project 740f7ae8a7d147c2b54375d3bc90075f. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:51:02.241522 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-fa9deb6d-c022-4c47-817b-c52ddee64ecd tempest-KeyPairsV2TestJSON-462193904 tempest-KeyPairsV2TestJSON-462193904-project] Getting quotas for user 9dbe9a32e24e439a913f39ac048e6a55 and project 740f7ae8a7d147c2b54375d3bc90075f. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:51:02.274573 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-43566857-d6b4-46a9-b18e-b2f00046bbbc tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6051ef60abd443599fd2f0ee2b948479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceee7b01d1014a538d1d1aea7da5c582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:02.290943 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-43566857-d6b4-46a9-b18e-b2f00046bbbc tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6051ef60abd443599fd2f0ee2b948479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceee7b01d1014a538d1d1aea7da5c582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:02.292922 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-43566857-d6b4-46a9-b18e-b2f00046bbbc tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6051ef60abd443599fd2f0ee2b948479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceee7b01d1014a538d1d1aea7da5c582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:02.295307 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-43566857-d6b4-46a9-b18e-b2f00046bbbc tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] 10.222.0.23 "GET /compute/v2.1/servers/d011e7e2-60c2-4e71-962c-73eb811f7351" status: 200 len: 1366 microversion: 2.47 time: 0.289464 Sep 10 11:51:02.307208 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fa9deb6d-c022-4c47-817b-c52ddee64ecd tempest-KeyPairsV2TestJSON-462193904 tempest-KeyPairsV2TestJSON-462193904-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.093347 Sep 10 11:51:02.307208 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1319/2725] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 11:51:02 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:51:02.308527 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1407/2726] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:02 2022] GET /compute/v2.1/servers/d011e7e2-60c2-4e71-962c-73eb811f7351 => generated 1366 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:51:02.329857 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-98069faa-aaf7-4430-aacf-ea1064f08108 tempest-KeyPairsV2TestJSON-462193904 tempest-KeyPairsV2TestJSON-462193904-project] Action: 'create', calling method: .version_select at 0x7f4072e70700>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-771280440", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJsa541aMsRx80+uvxlc79aeRjNYhMXTYzPq3QuTOBCqN6m5CeMSnhcwT7b3EParC9nCHn1FB/BawfTb4oeWF9vikgiYDq+m84mYoqrFkJkcpDSZSE+fXD5XgYTEvUbWHg=="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:51:02.370420 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-98069faa-aaf7-4430-aacf-ea1064f08108 tempest-KeyPairsV2TestJSON-462193904 tempest-KeyPairsV2TestJSON-462193904-project] Getting quotas for project 740f7ae8a7d147c2b54375d3bc90075f. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:51:02.385711 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-98069faa-aaf7-4430-aacf-ea1064f08108 tempest-KeyPairsV2TestJSON-462193904 tempest-KeyPairsV2TestJSON-462193904-project] Getting quotas for user 9dbe9a32e24e439a913f39ac048e6a55 and project 740f7ae8a7d147c2b54375d3bc90075f. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:51:02.461396 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-98069faa-aaf7-4430-aacf-ea1064f08108 tempest-KeyPairsV2TestJSON-462193904 tempest-KeyPairsV2TestJSON-462193904-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.139683 Sep 10 11:51:02.462542 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1320/2727] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 11:51:02 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:51:02.474849 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bbb5ae39-18e1-429f-a36c-cf61377940c4 tempest-KeyPairsV2TestJSON-462193904 tempest-KeyPairsV2TestJSON-462193904-project] Calling method '.version_select at 0x7f40734e5ee0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:02.480559 n-d-856895-1 devstack@n-api.service[128777]: WARNING oslo_db.sqlalchemy.utils [None req-bbb5ae39-18e1-429f-a36c-cf61377940c4 tempest-KeyPairsV2TestJSON-462193904 tempest-KeyPairsV2TestJSON-462193904-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 10 11:51:02.504583 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bbb5ae39-18e1-429f-a36c-cf61377940c4 tempest-KeyPairsV2TestJSON-462193904 tempest-KeyPairsV2TestJSON-462193904-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 1091 microversion: 2.1 time: 0.034222 Sep 10 11:51:02.507020 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1408/2728] 10.222.0.23 () {58 vars in 1137 bytes} [Sat Sep 10 11:51:02 2022] GET /compute/v2.1/os-keypairs => generated 1091 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:02.519202 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fc83b17e-c51c-4dd5-9b5d-33dff9532c90 tempest-KeyPairsV2TestJSON-462193904 tempest-KeyPairsV2TestJSON-462193904-project] Calling method '.version_select at 0x7f407b59aca0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:02.566275 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fc83b17e-c51c-4dd5-9b5d-33dff9532c90 tempest-KeyPairsV2TestJSON-462193904 tempest-KeyPairsV2TestJSON-462193904-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-771280440" status: 202 len: 0 microversion: 2.1 time: 0.050236 Sep 10 11:51:02.568629 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1321/2729] 10.222.0.23 () {58 vars in 1275 bytes} [Sat Sep 10 11:51:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-771280440 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:51:02.576549 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c4670f6b-5070-4450-83d3-994ee2557202 tempest-KeyPairsV2TestJSON-462193904 tempest-KeyPairsV2TestJSON-462193904-project] Calling method '.version_select at 0x7f40730d6160>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:02.596740 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-df7d2a35-6439-4e68-8876-2eb00c65103a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:02.600033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-df7d2a35-6439-4e68-8876-2eb00c65103a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: 3b2dc8b3-1049-4393-824f-b9786315d5ad] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:02.621400 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-df7d2a35-6439-4e68-8876-2eb00c65103a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:02.621945 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-df7d2a35-6439-4e68-8876-2eb00c65103a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:02.622872 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-df7d2a35-6439-4e68-8876-2eb00c65103a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:02.623810 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-df7d2a35-6439-4e68-8876-2eb00c65103a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:02.630166 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c4670f6b-5070-4450-83d3-994ee2557202 tempest-KeyPairsV2TestJSON-462193904 tempest-KeyPairsV2TestJSON-462193904-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1355953705" status: 202 len: 0 microversion: 2.1 time: 0.058179 Sep 10 11:51:02.631508 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-df7d2a35-6439-4e68-8876-2eb00c65103a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:02.632058 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-df7d2a35-6439-4e68-8876-2eb00c65103a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:02.633399 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1409/2730] 10.222.0.23 () {58 vars in 1278 bytes} [Sat Sep 10 11:51:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1355953705 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 11:51:02.644782 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-66444cb3-ac3e-4201-8870-6ba0a637ae6e tempest-KeyPairsV2TestJSON-462193904 tempest-KeyPairsV2TestJSON-462193904-project] Calling method '.version_select at 0x7f407369f1f0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:02.697851 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-66444cb3-ac3e-4201-8870-6ba0a637ae6e tempest-KeyPairsV2TestJSON-462193904 tempest-KeyPairsV2TestJSON-462193904-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-40891611" status: 202 len: 0 microversion: 2.1 time: 0.060510 Sep 10 11:51:02.699122 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1410/2731] 10.222.0.23 () {58 vars in 1272 bytes} [Sat Sep 10 11:51:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-40891611 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 11:51:02.827678 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-eb620527-63a0-4fde-ab49-aa05cd8f92b0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:02.830078 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-eb620527-63a0-4fde-ab49-aa05cd8f92b0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:02.853474 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb620527-63a0-4fde-ab49-aa05cd8f92b0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:02.854268 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb620527-63a0-4fde-ab49-aa05cd8f92b0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:02.854891 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb620527-63a0-4fde-ab49-aa05cd8f92b0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:02.855825 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb620527-63a0-4fde-ab49-aa05cd8f92b0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:02.856524 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb620527-63a0-4fde-ab49-aa05cd8f92b0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:02.857123 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb620527-63a0-4fde-ab49-aa05cd8f92b0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:03.133345 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-eb620527-63a0-4fde-ab49-aa05cd8f92b0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:03.142326 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-eb620527-63a0-4fde-ab49-aa05cd8f92b0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:03.158302 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-eb620527-63a0-4fde-ab49-aa05cd8f92b0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:03.167512 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-eb620527-63a0-4fde-ab49-aa05cd8f92b0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1535 microversion: 2.91 time: 0.466864 Sep 10 11:51:03.172438 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1411/2732] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:02 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1535 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:51:03.178736 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-dfde6e2b-3ef4-47f4-a961-724698b30386 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:03.196163 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-dfde6e2b-3ef4-47f4-a961-724698b30386 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:03.213841 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dfde6e2b-3ef4-47f4-a961-724698b30386 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:03.226148 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dfde6e2b-3ef4-47f4-a961-724698b30386 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:03.226900 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dfde6e2b-3ef4-47f4-a961-724698b30386 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:03.227835 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dfde6e2b-3ef4-47f4-a961-724698b30386 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:03.228450 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dfde6e2b-3ef4-47f4-a961-724698b30386 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:03.229054 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dfde6e2b-3ef4-47f4-a961-724698b30386 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:03.286689 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dfde6e2b-3ef4-47f4-a961-724698b30386 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:03.287889 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dfde6e2b-3ef4-47f4-a961-724698b30386 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:03.288525 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dfde6e2b-3ef4-47f4-a961-724698b30386 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:03.289190 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-dfde6e2b-3ef4-47f4-a961-724698b30386 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lazy-loading 'fault' on Instance uuid d86e1b80-a305-48c7-9c51-ef4175a5840c {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:51:03.325945 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-df7d2a35-6439-4e68-8876-2eb00c65103a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:03.342882 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-df7d2a35-6439-4e68-8876-2eb00c65103a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad" status: 200 len: 1514 microversion: 2.1 time: 0.756409 Sep 10 11:51:03.350751 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1322/2733] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:02 2022] GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad => generated 1514 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:03.355809 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-97fc43f7-d995-4839-ab71-503e60f1a7ed tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f40735c9670>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:03.424477 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-dfde6e2b-3ef4-47f4-a961-724698b30386 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:03.438923 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-dfde6e2b-3ef4-47f4-a961-724698b30386 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:03.440616 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-dfde6e2b-3ef4-47f4-a961-724698b30386 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:03.445305 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-dfde6e2b-3ef4-47f4-a961-724698b30386 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1610 microversion: 2.32 time: 0.270432 Sep 10 11:51:03.449602 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1412/2734] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:03 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1610 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:51:03.456818 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-79c97cbf-8337-4d72-befe-23715562ead6 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:03.457445 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-79c97cbf-8337-4d72-befe-23715562ead6 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] [instance: d011e7e2-60c2-4e71-962c-73eb811f7351] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:03.475776 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-79c97cbf-8337-4d72-befe-23715562ead6 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:03.476269 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-79c97cbf-8337-4d72-befe-23715562ead6 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:03.476707 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-79c97cbf-8337-4d72-befe-23715562ead6 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:03.477423 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-79c97cbf-8337-4d72-befe-23715562ead6 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:03.477870 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-79c97cbf-8337-4d72-befe-23715562ead6 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:03.478290 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-79c97cbf-8337-4d72-befe-23715562ead6 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:03.492713 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-97fc43f7-d995-4839-ab71-503e60f1a7ed tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/9af4c5ec-005a-43b8-8d1f-84731e30d0df" status: 200 len: 1410 microversion: 2.1 time: 0.140443 Sep 10 11:51:03.494410 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1323/2735] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:51:03 2022] GET /compute/v2.1/images/9af4c5ec-005a-43b8-8d1f-84731e30d0df => generated 1410 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:03.680191 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-79c97cbf-8337-4d72-befe-23715562ead6 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6051ef60abd443599fd2f0ee2b948479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceee7b01d1014a538d1d1aea7da5c582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:03.693395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-79c97cbf-8337-4d72-befe-23715562ead6 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6051ef60abd443599fd2f0ee2b948479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceee7b01d1014a538d1d1aea7da5c582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:03.695284 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-79c97cbf-8337-4d72-befe-23715562ead6 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6051ef60abd443599fd2f0ee2b948479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceee7b01d1014a538d1d1aea7da5c582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:03.704188 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-79c97cbf-8337-4d72-befe-23715562ead6 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] 10.222.0.23 "GET /compute/v2.1/servers/d011e7e2-60c2-4e71-962c-73eb811f7351" status: 200 len: 1366 microversion: 2.47 time: 0.253417 Sep 10 11:51:03.705216 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1413/2736] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:03 2022] GET /compute/v2.1/servers/d011e7e2-60c2-4e71-962c-73eb811f7351 => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:51:04.215740 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b77eef75-1825-4ce9-a590-220c4388a773 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:04.217006 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b77eef75-1825-4ce9-a590-220c4388a773 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:04.251464 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b77eef75-1825-4ce9-a590-220c4388a773 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:04.258106 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b77eef75-1825-4ce9-a590-220c4388a773 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:04.260498 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b77eef75-1825-4ce9-a590-220c4388a773 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:04.263741 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b77eef75-1825-4ce9-a590-220c4388a773 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:04.264645 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b77eef75-1825-4ce9-a590-220c4388a773 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:04.268273 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b77eef75-1825-4ce9-a590-220c4388a773 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:04.376508 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-59820a1c-86a5-4d7a-90f9-987c7b615a60 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:04.377365 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-59820a1c-86a5-4d7a-90f9-987c7b615a60 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: 3b2dc8b3-1049-4393-824f-b9786315d5ad] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:04.388969 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59820a1c-86a5-4d7a-90f9-987c7b615a60 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:04.389809 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59820a1c-86a5-4d7a-90f9-987c7b615a60 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:04.390438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59820a1c-86a5-4d7a-90f9-987c7b615a60 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:04.394333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59820a1c-86a5-4d7a-90f9-987c7b615a60 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:04.395300 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59820a1c-86a5-4d7a-90f9-987c7b615a60 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:04.396057 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59820a1c-86a5-4d7a-90f9-987c7b615a60 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:04.453050 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b77eef75-1825-4ce9-a590-220c4388a773 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:04.468446 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b77eef75-1825-4ce9-a590-220c4388a773 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:04.475038 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b77eef75-1825-4ce9-a590-220c4388a773 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:04.488171 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b77eef75-1825-4ce9-a590-220c4388a773 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1535 microversion: 2.91 time: 0.284784 Sep 10 11:51:04.495111 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1324/2737] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:04 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1535 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:51:04.506149 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9eb7dcdf-6c18-491e-8f89-d84a8d963e11 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:04.507356 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9eb7dcdf-6c18-491e-8f89-d84a8d963e11 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:04.523113 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9eb7dcdf-6c18-491e-8f89-d84a8d963e11 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:04.523814 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9eb7dcdf-6c18-491e-8f89-d84a8d963e11 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:04.527004 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9eb7dcdf-6c18-491e-8f89-d84a8d963e11 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:04.528076 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9eb7dcdf-6c18-491e-8f89-d84a8d963e11 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:04.528776 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9eb7dcdf-6c18-491e-8f89-d84a8d963e11 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:04.529461 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9eb7dcdf-6c18-491e-8f89-d84a8d963e11 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:04.573458 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9eb7dcdf-6c18-491e-8f89-d84a8d963e11 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:04.575084 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9eb7dcdf-6c18-491e-8f89-d84a8d963e11 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:04.575815 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9eb7dcdf-6c18-491e-8f89-d84a8d963e11 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:04.577165 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-9eb7dcdf-6c18-491e-8f89-d84a8d963e11 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lazy-loading 'fault' on Instance uuid d86e1b80-a305-48c7-9c51-ef4175a5840c {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:51:04.680749 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9eb7dcdf-6c18-491e-8f89-d84a8d963e11 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:04.699943 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9eb7dcdf-6c18-491e-8f89-d84a8d963e11 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:04.710863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9eb7dcdf-6c18-491e-8f89-d84a8d963e11 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:04.712754 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9eb7dcdf-6c18-491e-8f89-d84a8d963e11 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1610 microversion: 2.32 time: 0.216003 Sep 10 11:51:04.713559 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1325/2738] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:04 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1610 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:51:04.725603 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-010dff68-0218-4664-9c10-78bd13864a86 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f4072a1e4c0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:04.811453 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-010dff68-0218-4664-9c10-78bd13864a86 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/9af4c5ec-005a-43b8-8d1f-84731e30d0df" status: 200 len: 1410 microversion: 2.1 time: 0.096335 Sep 10 11:51:04.812233 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1326/2739] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:51:04 2022] GET /compute/v2.1/images/9af4c5ec-005a-43b8-8d1f-84731e30d0df => generated 1410 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:04.819677 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c50080b2-dd1c-4b95-9256-b37e0ee36fa3 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:04.827946 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c50080b2-dd1c-4b95-9256-b37e0ee36fa3 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] [instance: d011e7e2-60c2-4e71-962c-73eb811f7351] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:04.842331 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c50080b2-dd1c-4b95-9256-b37e0ee36fa3 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:04.843152 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c50080b2-dd1c-4b95-9256-b37e0ee36fa3 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:04.843881 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c50080b2-dd1c-4b95-9256-b37e0ee36fa3 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:04.845888 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c50080b2-dd1c-4b95-9256-b37e0ee36fa3 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:04.847917 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c50080b2-dd1c-4b95-9256-b37e0ee36fa3 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:04.850141 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c50080b2-dd1c-4b95-9256-b37e0ee36fa3 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:05.074676 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c50080b2-dd1c-4b95-9256-b37e0ee36fa3 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6051ef60abd443599fd2f0ee2b948479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceee7b01d1014a538d1d1aea7da5c582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:05.084845 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c50080b2-dd1c-4b95-9256-b37e0ee36fa3 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6051ef60abd443599fd2f0ee2b948479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceee7b01d1014a538d1d1aea7da5c582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:05.086296 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c50080b2-dd1c-4b95-9256-b37e0ee36fa3 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6051ef60abd443599fd2f0ee2b948479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceee7b01d1014a538d1d1aea7da5c582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:05.087513 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c50080b2-dd1c-4b95-9256-b37e0ee36fa3 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] 10.222.0.23 "GET /compute/v2.1/servers/d011e7e2-60c2-4e71-962c-73eb811f7351" status: 200 len: 1366 microversion: 2.47 time: 0.274292 Sep 10 11:51:05.088088 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1327/2740] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:04 2022] GET /compute/v2.1/servers/d011e7e2-60c2-4e71-962c-73eb811f7351 => generated 1366 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:51:05.118771 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-59820a1c-86a5-4d7a-90f9-987c7b615a60 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:05.130265 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-59820a1c-86a5-4d7a-90f9-987c7b615a60 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad" status: 200 len: 1520 microversion: 2.1 time: 0.758208 Sep 10 11:51:05.133523 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1414/2741] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:04 2022] GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad => generated 1520 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:51:05.526457 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b06ebf8b-f912-46aa-a22c-9e902ee2aa6c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:05.527001 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b06ebf8b-f912-46aa-a22c-9e902ee2aa6c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:05.542184 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b06ebf8b-f912-46aa-a22c-9e902ee2aa6c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:05.542823 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b06ebf8b-f912-46aa-a22c-9e902ee2aa6c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:05.543291 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b06ebf8b-f912-46aa-a22c-9e902ee2aa6c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:05.552159 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b06ebf8b-f912-46aa-a22c-9e902ee2aa6c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:05.560095 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b06ebf8b-f912-46aa-a22c-9e902ee2aa6c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:05.563119 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b06ebf8b-f912-46aa-a22c-9e902ee2aa6c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:05.748581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ea644431-3abf-4d4f-8a79-4e6017b9c22d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:05.750045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ea644431-3abf-4d4f-8a79-4e6017b9c22d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:05.764177 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea644431-3abf-4d4f-8a79-4e6017b9c22d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:05.765861 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea644431-3abf-4d4f-8a79-4e6017b9c22d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:05.766475 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea644431-3abf-4d4f-8a79-4e6017b9c22d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:05.770482 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea644431-3abf-4d4f-8a79-4e6017b9c22d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:05.771935 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea644431-3abf-4d4f-8a79-4e6017b9c22d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:05.772562 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea644431-3abf-4d4f-8a79-4e6017b9c22d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:05.852313 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:51:05.893820 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea644431-3abf-4d4f-8a79-4e6017b9c22d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:05.897558 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea644431-3abf-4d4f-8a79-4e6017b9c22d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:05.898589 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea644431-3abf-4d4f-8a79-4e6017b9c22d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:05.899694 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-ea644431-3abf-4d4f-8a79-4e6017b9c22d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lazy-loading 'fault' on Instance uuid d86e1b80-a305-48c7-9c51-ef4175a5840c {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:51:06.142560 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ea644431-3abf-4d4f-8a79-4e6017b9c22d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:06.169506 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ea644431-3abf-4d4f-8a79-4e6017b9c22d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:06.210711 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ea644431-3abf-4d4f-8a79-4e6017b9c22d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d00b725397549cfaa2aeb2b0a8dfe3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f9c4dcb0b4da097f41bde1d789efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:06.212196 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ea644431-3abf-4d4f-8a79-4e6017b9c22d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 200 len: 1610 microversion: 2.32 time: 0.467591 Sep 10 11:51:06.212799 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1415/2742] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:05 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 1610 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:51:06.225483 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b06ebf8b-f912-46aa-a22c-9e902ee2aa6c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:06.250649 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d9bf7b6f-24ae-459d-a0ca-f980c0ed23ed tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f40734e5dc0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:06.259639 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b06ebf8b-f912-46aa-a22c-9e902ee2aa6c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:06.266765 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b06ebf8b-f912-46aa-a22c-9e902ee2aa6c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:06.283119 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b06ebf8b-f912-46aa-a22c-9e902ee2aa6c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1535 microversion: 2.91 time: 0.759525 Sep 10 11:51:06.285716 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1328/2743] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:05 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1535 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:51:06.304638 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5acc7196-59e9-4a98-a28a-0991c7dfb990 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:06.305661 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5acc7196-59e9-4a98-a28a-0991c7dfb990 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] [instance: d011e7e2-60c2-4e71-962c-73eb811f7351] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:06.340008 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5acc7196-59e9-4a98-a28a-0991c7dfb990 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:06.345950 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5acc7196-59e9-4a98-a28a-0991c7dfb990 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:06.346412 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5acc7196-59e9-4a98-a28a-0991c7dfb990 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:06.351022 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5acc7196-59e9-4a98-a28a-0991c7dfb990 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:06.351520 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5acc7196-59e9-4a98-a28a-0991c7dfb990 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:06.352005 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5acc7196-59e9-4a98-a28a-0991c7dfb990 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:06.371191 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d9bf7b6f-24ae-459d-a0ca-f980c0ed23ed tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/9af4c5ec-005a-43b8-8d1f-84731e30d0df" status: 200 len: 1410 microversion: 2.1 time: 0.146630 Sep 10 11:51:06.379992 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1416/2744] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:51:06 2022] GET /compute/v2.1/images/9af4c5ec-005a-43b8-8d1f-84731e30d0df => generated 1410 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:06.385448 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ed579b25-6067-48c5-9e0c-59140e10a48a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:06.390809 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ed579b25-6067-48c5-9e0c-59140e10a48a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: 3b2dc8b3-1049-4393-824f-b9786315d5ad] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:06.418968 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ed579b25-6067-48c5-9e0c-59140e10a48a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:06.428544 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ed579b25-6067-48c5-9e0c-59140e10a48a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:06.429409 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ed579b25-6067-48c5-9e0c-59140e10a48a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:06.430392 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ed579b25-6067-48c5-9e0c-59140e10a48a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:06.431008 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ed579b25-6067-48c5-9e0c-59140e10a48a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:06.431634 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ed579b25-6067-48c5-9e0c-59140e10a48a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:06.507307 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5acc7196-59e9-4a98-a28a-0991c7dfb990 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:06.507811 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5acc7196-59e9-4a98-a28a-0991c7dfb990 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:06.508269 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5acc7196-59e9-4a98-a28a-0991c7dfb990 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:06.508733 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-5acc7196-59e9-4a98-a28a-0991c7dfb990 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lazy-loading 'fault' on Instance uuid d011e7e2-60c2-4e71-962c-73eb811f7351 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:51:06.697684 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5acc7196-59e9-4a98-a28a-0991c7dfb990 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6051ef60abd443599fd2f0ee2b948479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceee7b01d1014a538d1d1aea7da5c582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:06.715080 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5acc7196-59e9-4a98-a28a-0991c7dfb990 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6051ef60abd443599fd2f0ee2b948479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceee7b01d1014a538d1d1aea7da5c582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:06.731885 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5acc7196-59e9-4a98-a28a-0991c7dfb990 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6051ef60abd443599fd2f0ee2b948479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceee7b01d1014a538d1d1aea7da5c582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:06.733489 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5acc7196-59e9-4a98-a28a-0991c7dfb990 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] 10.222.0.23 "GET /compute/v2.1/servers/d011e7e2-60c2-4e71-962c-73eb811f7351" status: 200 len: 1371 microversion: 2.47 time: 0.446612 Sep 10 11:51:06.760623 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1329/2745] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:06 2022] GET /compute/v2.1/servers/d011e7e2-60c2-4e71-962c-73eb811f7351 => generated 1371 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:51:07.047896 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-11315409-f6fe-4814-a086-7587761dda7e tempest-AZV2TestJSON-857588951 tempest-AZV2TestJSON-857588951-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:07.050047 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-11315409-f6fe-4814-a086-7587761dda7e tempest-AZV2TestJSON-857588951 tempest-AZV2TestJSON-857588951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:07.050661 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-11315409-f6fe-4814-a086-7587761dda7e tempest-AZV2TestJSON-857588951 tempest-AZV2TestJSON-857588951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:07.051417 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-11315409-f6fe-4814-a086-7587761dda7e tempest-AZV2TestJSON-857588951 tempest-AZV2TestJSON-857588951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:07.052282 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-11315409-f6fe-4814-a086-7587761dda7e tempest-AZV2TestJSON-857588951 tempest-AZV2TestJSON-857588951-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:07.054066 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-11315409-f6fe-4814-a086-7587761dda7e tempest-AZV2TestJSON-857588951 tempest-AZV2TestJSON-857588951-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:07.055088 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-11315409-f6fe-4814-a086-7587761dda7e tempest-AZV2TestJSON-857588951 tempest-AZV2TestJSON-857588951-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:07.163639 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-11315409-f6fe-4814-a086-7587761dda7e tempest-AZV2TestJSON-857588951 tempest-AZV2TestJSON-857588951-project] 10.222.0.23 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.392055 Sep 10 11:51:07.164974 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1330/2746] 10.222.0.23 () {58 vars in 1164 bytes} [Sat Sep 10 11:51:06 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:51:07.165327 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ed579b25-6067-48c5-9e0c-59140e10a48a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:07.209401 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ed579b25-6067-48c5-9e0c-59140e10a48a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad" status: 200 len: 1520 microversion: 2.1 time: 0.827596 Sep 10 11:51:07.211572 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1417/2747] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:06 2022] GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad => generated 1520 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:07.246264 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-17496f4b-3f5c-4b4f-b83f-604238fe0a7d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:07.247457 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-17496f4b-3f5c-4b4f-b83f-604238fe0a7d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:07.259743 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17496f4b-3f5c-4b4f-b83f-604238fe0a7d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:07.260639 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17496f4b-3f5c-4b4f-b83f-604238fe0a7d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:07.261999 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17496f4b-3f5c-4b4f-b83f-604238fe0a7d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:07.264609 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17496f4b-3f5c-4b4f-b83f-604238fe0a7d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:07.266673 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17496f4b-3f5c-4b4f-b83f-604238fe0a7d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:07.269211 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17496f4b-3f5c-4b4f-b83f-604238fe0a7d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:07.303621 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-17496f4b-3f5c-4b4f-b83f-604238fe0a7d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] HTTP exception thrown: Instance d86e1b80-a305-48c7-9c51-ef4175a5840c could not be found. Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-17496f4b-3f5c-4b4f-b83f-604238fe0a7d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Request method failure captured: Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c HTTP/1.1 Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHiE1tOUJxuJKfNvyiDNIgVr_QrySnbiCZqUNWPj7NkVKXM1LuL3x7qa4dUmejrjrkloa_lwbwXwUWvmzp2PiGwPTp9X7FWejZG9bnL-Edlj8K0xKFvxhzq2Br8i09mDoTGjAboRgQnv5XZ0FwjESZ1MBgKuABptkTmCi9xT5iBIRFE Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: X-Openstack-Nova-Api-Version: 2.32 Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 337f9c4dcb0b4da097f41bde1d789efa Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-TaggedBootDevicesTest-1893956690 Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/337f9c4dcb0b4da097f41bde1d789efa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/337f9c4dcb0b4da097f41bde1d789efa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_337f9c4dcb0b4da097f41bde1d789efa", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/337f9c4dcb0b4da097f41bde1d789efa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-TaggedBootDevicesTest-1893956690 Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 337f9c4dcb0b4da097f41bde1d789efa Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1893956690 Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-TaggedBootDevicesTest-1893956690-project Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 2d00b725397549cfaa2aeb2b0a8dfe3d Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-TaggedBootDevicesTest-1893956690-project Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance d86e1b80-a305-48c7-9c51-ef4175a5840c could not be found. Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'd86e1b80-a305-48c7-9c51-ef4175a5840c'} Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d86e1b80-a305-48c7-9c51-ef4175a5840c could not be found. Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d86e1b80-a305-48c7-9c51-ef4175a5840c could not be found. Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:51:07.307706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:51:07.312092 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:51:07.312092 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:51:07.312092 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:51:07.312092 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:51:07.312092 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:51:07.312092 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:51:07.312092 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d86e1b80-a305-48c7-9c51-ef4175a5840c could not be found. Sep 10 11:51:07.312092 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:51:07.314397 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-30dd479b-67a3-4823-8860-cf63279b5071 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:07.315250 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-30dd479b-67a3-4823-8860-cf63279b5071 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:07.318036 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-17496f4b-3f5c-4b4f-b83f-604238fe0a7d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Returning 404 to user: Instance d86e1b80-a305-48c7-9c51-ef4175a5840c could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:51:07.320556 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-17496f4b-3f5c-4b4f-b83f-604238fe0a7d tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 404 len: 111 microversion: 2.32 time: 0.079446 Sep 10 11:51:07.323245 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1331/2748] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:07 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:51:07.333933 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30dd479b-67a3-4823-8860-cf63279b5071 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:07.334456 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30dd479b-67a3-4823-8860-cf63279b5071 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:07.334881 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30dd479b-67a3-4823-8860-cf63279b5071 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:07.340262 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-51ac2e3b-d256-4468-a3ea-1820f14a9d7f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '.version_select at 0x7f40733cb310>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:07.348721 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30dd479b-67a3-4823-8860-cf63279b5071 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:07.352142 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30dd479b-67a3-4823-8860-cf63279b5071 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:07.355327 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30dd479b-67a3-4823-8860-cf63279b5071 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:07.371109 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:51:07.422370 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-51ac2e3b-d256-4468-a3ea-1820f14a9d7f tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1675973244" status: 204 len: 0 microversion: 2.32 time: 0.080755 Sep 10 11:51:07.425759 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1332/2749] 10.222.0.23 () {60 vars in 1262 bytes} [Sat Sep 10 11:51:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1675973244 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 11:51:07.437483 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-aa06ace0-9e15-448a-b23c-20008d886aac tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f4072a21280>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:07.582712 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-aa06ace0-9e15-448a-b23c-20008d886aac tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/9af4c5ec-005a-43b8-8d1f-84731e30d0df" status: 200 len: 1410 microversion: 2.1 time: 0.155568 Sep 10 11:51:07.594538 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1333/2750] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:51:07 2022] GET /compute/v2.1/images/9af4c5ec-005a-43b8-8d1f-84731e30d0df => generated 1410 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:07.772550 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fece7297-96bc-4e55-8cf2-9466d201d843 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:07.774030 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fece7297-96bc-4e55-8cf2-9466d201d843 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] [instance: d011e7e2-60c2-4e71-962c-73eb811f7351] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:07.784833 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fece7297-96bc-4e55-8cf2-9466d201d843 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:07.788079 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fece7297-96bc-4e55-8cf2-9466d201d843 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:07.789678 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fece7297-96bc-4e55-8cf2-9466d201d843 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:07.792373 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fece7297-96bc-4e55-8cf2-9466d201d843 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:07.794023 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-30dd479b-67a3-4823-8860-cf63279b5071 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:07.794811 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fece7297-96bc-4e55-8cf2-9466d201d843 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:07.796074 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fece7297-96bc-4e55-8cf2-9466d201d843 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:07.804696 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-30dd479b-67a3-4823-8860-cf63279b5071 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:07.806152 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-30dd479b-67a3-4823-8860-cf63279b5071 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:07.834887 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-30dd479b-67a3-4823-8860-cf63279b5071 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1478 microversion: 2.91 time: 0.524681 Sep 10 11:51:07.836276 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1418/2751] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:07 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1478 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:51:07.852925 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-fece7297-96bc-4e55-8cf2-9466d201d843 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] HTTP exception thrown: Instance d011e7e2-60c2-4e71-962c-73eb811f7351 could not be found. Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fece7297-96bc-4e55-8cf2-9466d201d843 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Request method failure captured: Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/d011e7e2-60c2-4e71-962c-73eb811f7351 HTTP/1.1 Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHoUKwQqzAG8Pve9qDsCEi9MjzPY8TnWIBJVjwcL98Whl9YNYD3WvIkep5l52AjNEe5dr66b4AI7v2JsIjq9FLAad-eUX9Hp3kr7g7U1YSVphyp1-M3ENkSL6THXKdf8LdGbxg_MLlKrcSBHi7soK1FTnfMHTyNQu-LGuspDBkFR6gE Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: X-Openstack-Nova-Api-Version: 2.47 Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: ceee7b01d1014a538d1d1aea7da5c582 Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersAaction247Test-1252837855 Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ceee7b01d1014a538d1d1aea7da5c582"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ceee7b01d1014a538d1d1aea7da5c582"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ceee7b01d1014a538d1d1aea7da5c582", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ceee7b01d1014a538d1d1aea7da5c582"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersAaction247Test-1252837855 Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: ceee7b01d1014a538d1d1aea7da5c582 Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersAaction247Test-1252837855 Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersAaction247Test-1252837855-project Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 6051ef60abd443599fd2f0ee2b948479 Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersAaction247Test-1252837855-project Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance d011e7e2-60c2-4e71-962c-73eb811f7351 could not be found. Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'd011e7e2-60c2-4e71-962c-73eb811f7351'} Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d011e7e2-60c2-4e71-962c-73eb811f7351 could not be found. Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d011e7e2-60c2-4e71-962c-73eb811f7351 could not be found. Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:51:07.856576 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:51:07.861785 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:51:07.861785 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:51:07.861785 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:51:07.861785 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:51:07.861785 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:51:07.861785 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:51:07.861785 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d011e7e2-60c2-4e71-962c-73eb811f7351 could not be found. Sep 10 11:51:07.861785 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:51:07.861785 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fece7297-96bc-4e55-8cf2-9466d201d843 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] Returning 404 to user: Instance d011e7e2-60c2-4e71-962c-73eb811f7351 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:51:07.862647 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fece7297-96bc-4e55-8cf2-9466d201d843 tempest-ServersAaction247Test-1252837855 tempest-ServersAaction247Test-1252837855-project] 10.222.0.23 "GET /compute/v2.1/servers/d011e7e2-60c2-4e71-962c-73eb811f7351" status: 404 len: 111 microversion: 2.47 time: 0.094531 Sep 10 11:51:07.873543 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f842c159-bc09-41f6-9e01-feea347b2add tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-856895-1"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:51:07.876468 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f842c159-bc09-41f6-9e01-feea347b2add tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:07.882575 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1334/2752] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:07 2022] GET /compute/v2.1/servers/d011e7e2-60c2-4e71-962c-73eb811f7351 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:51:07.887263 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f842c159-bc09-41f6-9e01-feea347b2add tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:07.900331 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f842c159-bc09-41f6-9e01-feea347b2add tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:07.903955 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f842c159-bc09-41f6-9e01-feea347b2add tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:07.906213 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f842c159-bc09-41f6-9e01-feea347b2add tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:07.908857 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f842c159-bc09-41f6-9e01-feea347b2add tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:07.909527 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f842c159-bc09-41f6-9e01-feea347b2add tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:08.112853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f842c159-bc09-41f6-9e01-feea347b2add tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-856895-1". {{(pid=128777) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 10 11:51:08.241214 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-22b84e00-c61c-4195-961e-1fca00cef219 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:08.242201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-22b84e00-c61c-4195-961e-1fca00cef219 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: 3b2dc8b3-1049-4393-824f-b9786315d5ad] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:08.255239 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-22b84e00-c61c-4195-961e-1fca00cef219 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:08.257840 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-22b84e00-c61c-4195-961e-1fca00cef219 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:08.259033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-22b84e00-c61c-4195-961e-1fca00cef219 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:08.262215 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-22b84e00-c61c-4195-961e-1fca00cef219 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:08.262943 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-22b84e00-c61c-4195-961e-1fca00cef219 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:08.264070 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-22b84e00-c61c-4195-961e-1fca00cef219 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:08.330442 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f842c159-bc09-41f6-9e01-feea347b2add tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306/action" status: 202 len: 0 microversion: 2.91 time: 0.460613 Sep 10 11:51:08.335454 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1419/2753] 10.222.0.23 () {62 vars in 1319 bytes} [Sat Sep 10 11:51:07 2022] POST /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306/action => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:51:08.342648 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f410c8b4-5847-41c8-9a31-8aeb97a52fb9 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:08.346945 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f410c8b4-5847-41c8-9a31-8aeb97a52fb9 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:08.362306 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f410c8b4-5847-41c8-9a31-8aeb97a52fb9 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:08.362842 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f410c8b4-5847-41c8-9a31-8aeb97a52fb9 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:08.363366 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f410c8b4-5847-41c8-9a31-8aeb97a52fb9 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:08.364565 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f410c8b4-5847-41c8-9a31-8aeb97a52fb9 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:08.365314 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f410c8b4-5847-41c8-9a31-8aeb97a52fb9 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:08.365916 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f410c8b4-5847-41c8-9a31-8aeb97a52fb9 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:08.993156 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f410c8b4-5847-41c8-9a31-8aeb97a52fb9 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:09.009029 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f410c8b4-5847-41c8-9a31-8aeb97a52fb9 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:09.011893 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f410c8b4-5847-41c8-9a31-8aeb97a52fb9 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:09.043082 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f410c8b4-5847-41c8-9a31-8aeb97a52fb9 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1486 microversion: 2.91 time: 0.705345 Sep 10 11:51:09.050664 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1420/2754] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:08 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1486 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:51:09.067904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a444fabb-e9d7-4f5b-9cbd-a4471285653b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f40735910d0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:09.155289 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a444fabb-e9d7-4f5b-9cbd-a4471285653b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/9af4c5ec-005a-43b8-8d1f-84731e30d0df" status: 200 len: 1410 microversion: 2.1 time: 0.102785 Sep 10 11:51:09.156143 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1421/2755] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:51:09 2022] GET /compute/v2.1/images/9af4c5ec-005a-43b8-8d1f-84731e30d0df => generated 1410 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:09.343370 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-22b84e00-c61c-4195-961e-1fca00cef219 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:09.362828 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-22b84e00-c61c-4195-961e-1fca00cef219 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad" status: 200 len: 1520 microversion: 2.1 time: 1.123885 Sep 10 11:51:09.364219 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1335/2756] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:08 2022] GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad => generated 1520 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:51:10.082640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f7e3fafb-5f63-43bf-adfc-815268e2e173 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:10.083294 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f7e3fafb-5f63-43bf-adfc-815268e2e173 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:10.095811 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f7e3fafb-5f63-43bf-adfc-815268e2e173 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:10.106674 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f7e3fafb-5f63-43bf-adfc-815268e2e173 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:10.107267 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f7e3fafb-5f63-43bf-adfc-815268e2e173 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:10.111749 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f7e3fafb-5f63-43bf-adfc-815268e2e173 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:10.112260 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f7e3fafb-5f63-43bf-adfc-815268e2e173 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:10.112705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f7e3fafb-5f63-43bf-adfc-815268e2e173 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:10.172646 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7b3b7e50-15f5-4249-aa49-948097ebcebb tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f4072a1e550>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:10.269907 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7b3b7e50-15f5-4249-aa49-948097ebcebb tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/9af4c5ec-005a-43b8-8d1f-84731e30d0df" status: 200 len: 1410 microversion: 2.1 time: 0.102514 Sep 10 11:51:10.270451 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1336/2757] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:51:10 2022] GET /compute/v2.1/images/9af4c5ec-005a-43b8-8d1f-84731e30d0df => generated 1410 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:51:10.318145 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f7e3fafb-5f63-43bf-adfc-815268e2e173 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:10.336685 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f7e3fafb-5f63-43bf-adfc-815268e2e173 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:10.342508 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f7e3fafb-5f63-43bf-adfc-815268e2e173 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:10.367976 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f7e3fafb-5f63-43bf-adfc-815268e2e173 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1486 microversion: 2.91 time: 0.288283 Sep 10 11:51:10.385614 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1422/2758] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:10 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1486 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:51:10.390587 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-510b5593-f041-4681-a336-9957f0ebfa8e tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:10.391869 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-510b5593-f041-4681-a336-9957f0ebfa8e tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: 3b2dc8b3-1049-4393-824f-b9786315d5ad] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:10.405047 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-510b5593-f041-4681-a336-9957f0ebfa8e tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:10.405562 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-510b5593-f041-4681-a336-9957f0ebfa8e tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:10.406013 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-510b5593-f041-4681-a336-9957f0ebfa8e tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:10.406738 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-510b5593-f041-4681-a336-9957f0ebfa8e tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:10.407221 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-510b5593-f041-4681-a336-9957f0ebfa8e tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:10.413605 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-510b5593-f041-4681-a336-9957f0ebfa8e tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:11.290722 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c59ccfac-76d9-4674-a4bd-ca5e7c6bcd01 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f4073591e50>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:11.385737 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c59ccfac-76d9-4674-a4bd-ca5e7c6bcd01 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/9af4c5ec-005a-43b8-8d1f-84731e30d0df" status: 200 len: 1410 microversion: 2.1 time: 0.104396 Sep 10 11:51:11.386608 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1423/2759] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:51:11 2022] GET /compute/v2.1/images/9af4c5ec-005a-43b8-8d1f-84731e30d0df => generated 1410 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:51:11.405860 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0607ef4c-47b3-4bdb-a846-6b1957567782 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:11.406482 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0607ef4c-47b3-4bdb-a846-6b1957567782 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:11.430729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0607ef4c-47b3-4bdb-a846-6b1957567782 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:11.431255 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0607ef4c-47b3-4bdb-a846-6b1957567782 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:11.431706 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0607ef4c-47b3-4bdb-a846-6b1957567782 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:11.432421 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0607ef4c-47b3-4bdb-a846-6b1957567782 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:11.432938 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0607ef4c-47b3-4bdb-a846-6b1957567782 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:11.433303 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0607ef4c-47b3-4bdb-a846-6b1957567782 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:11.915671 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0607ef4c-47b3-4bdb-a846-6b1957567782 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:11.979984 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0607ef4c-47b3-4bdb-a846-6b1957567782 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:11.985235 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0607ef4c-47b3-4bdb-a846-6b1957567782 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:12.025444 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0607ef4c-47b3-4bdb-a846-6b1957567782 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1544 microversion: 2.91 time: 0.619101 Sep 10 11:51:12.057709 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1424/2760] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:11 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1544 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:51:12.105634 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-510b5593-f041-4681-a336-9957f0ebfa8e tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:12.196626 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-510b5593-f041-4681-a336-9957f0ebfa8e tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad" status: 200 len: 1520 microversion: 2.1 time: 1.810102 Sep 10 11:51:12.199036 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1337/2761] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:10 2022] GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad => generated 1520 bytes in 1813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:51:12.401771 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1c10cf30-68ea-4197-9d14-92b6e9ef6c68 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f4072a4d550>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:12.412665 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=20 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:51:12.476986 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1c10cf30-68ea-4197-9d14-92b6e9ef6c68 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/9af4c5ec-005a-43b8-8d1f-84731e30d0df" status: 200 len: 1410 microversion: 2.1 time: 0.078931 Sep 10 11:51:12.477570 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1338/2762] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:51:12 2022] GET /compute/v2.1/images/9af4c5ec-005a-43b8-8d1f-84731e30d0df => generated 1410 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:51:13.066012 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-64cc46c0-b5d3-411d-8bdb-54eb9994e198 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:13.066996 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-64cc46c0-b5d3-411d-8bdb-54eb9994e198 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:13.078174 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-64cc46c0-b5d3-411d-8bdb-54eb9994e198 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:13.101975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-64cc46c0-b5d3-411d-8bdb-54eb9994e198 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:13.102710 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-64cc46c0-b5d3-411d-8bdb-54eb9994e198 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:13.103663 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-64cc46c0-b5d3-411d-8bdb-54eb9994e198 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:13.105208 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-64cc46c0-b5d3-411d-8bdb-54eb9994e198 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:13.107579 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-64cc46c0-b5d3-411d-8bdb-54eb9994e198 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:13.108674 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d0ab0dcb-9067-4cc5-a764-70ff91ebeba3 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1002171061", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:51:13.262550 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-d0ab0dcb-9067-4cc5-a764-70ff91ebeba3 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] validate_networks() for [('8f68d2a9-4e42-44ea-9b28-28dc7e8528d4', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:51:13.855897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-64cc46c0-b5d3-411d-8bdb-54eb9994e198 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:13.865120 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-64cc46c0-b5d3-411d-8bdb-54eb9994e198 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:13.877910 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-64cc46c0-b5d3-411d-8bdb-54eb9994e198 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:13.905877 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-64cc46c0-b5d3-411d-8bdb-54eb9994e198 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1544 microversion: 2.91 time: 0.844545 Sep 10 11:51:13.908333 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1339/2763] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:13 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1544 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:51:13.914608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-131239c5-654c-48ee-9625-0e9da0655b3a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:13.915265 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-131239c5-654c-48ee-9625-0e9da0655b3a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: 3b2dc8b3-1049-4393-824f-b9786315d5ad] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:13.924958 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-131239c5-654c-48ee-9625-0e9da0655b3a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:13.925844 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-131239c5-654c-48ee-9625-0e9da0655b3a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:13.926471 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-131239c5-654c-48ee-9625-0e9da0655b3a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:13.927960 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-131239c5-654c-48ee-9625-0e9da0655b3a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:13.928677 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-131239c5-654c-48ee-9625-0e9da0655b3a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:13.929340 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-131239c5-654c-48ee-9625-0e9da0655b3a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:14.930050 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-131239c5-654c-48ee-9625-0e9da0655b3a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:14.945249 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-131239c5-654c-48ee-9625-0e9da0655b3a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad" status: 200 len: 1520 microversion: 2.1 time: 1.033099 Sep 10 11:51:14.953343 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1340/2764] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:13 2022] GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad => generated 1520 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:14.967780 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-559691ad-f74b-4544-b9f7-bf59b64e271e req-5c4e1286-4fa5-470e-b5d1-18d9aa296bff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b2dc8b3-1049-4393-824f-b9786315d5ad", "name": "network-vif-plugged", "status": "completed", "tag": "4024f0bb-5caf-48f4-b443-b7c8a693e47b"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:51:15.030466 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-559691ad-f74b-4544-b9f7-bf59b64e271e req-5c4e1286-4fa5-470e-b5d1-18d9aa296bff service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:15.034694 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-559691ad-f74b-4544-b9f7-bf59b64e271e req-5c4e1286-4fa5-470e-b5d1-18d9aa296bff service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:15.036742 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-559691ad-f74b-4544-b9f7-bf59b64e271e req-5c4e1286-4fa5-470e-b5d1-18d9aa296bff service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:15.118444 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-559691ad-f74b-4544-b9f7-bf59b64e271e req-5c4e1286-4fa5-470e-b5d1-18d9aa296bff service nova] Creating event network-vif-plugged:4024f0bb-5caf-48f4-b443-b7c8a693e47b for instance 3b2dc8b3-1049-4393-824f-b9786315d5ad on n-h2-856895-1 Sep 10 11:51:15.172404 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-559691ad-f74b-4544-b9f7-bf59b64e271e req-5c4e1286-4fa5-470e-b5d1-18d9aa296bff service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.213892 Sep 10 11:51:15.183575 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1341/2765] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:51:15.189717 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a4533ef3-fd83-4999-a48d-d8e3c168aeed tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f4072a480d0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:15.297762 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a4533ef3-fd83-4999-a48d-d8e3c168aeed tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/9af4c5ec-005a-43b8-8d1f-84731e30d0df" status: 200 len: 1419 microversion: 2.1 time: 0.111984 Sep 10 11:51:15.299451 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1342/2766] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:51:15 2022] GET /compute/v2.1/images/9af4c5ec-005a-43b8-8d1f-84731e30d0df => generated 1419 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:15.313529 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a9035864-6939-476c-9999-1dac45d58977 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:15.315357 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a9035864-6939-476c-9999-1dac45d58977 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:15.369319 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9035864-6939-476c-9999-1dac45d58977 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:15.374709 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9035864-6939-476c-9999-1dac45d58977 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:15.376440 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9035864-6939-476c-9999-1dac45d58977 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:15.379648 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9035864-6939-476c-9999-1dac45d58977 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:15.380409 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9035864-6939-476c-9999-1dac45d58977 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:15.383323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9035864-6939-476c-9999-1dac45d58977 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:15.409059 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d0ab0dcb-9067-4cc5-a764-70ff91ebeba3 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:51:15.410473 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d0ab0dcb-9067-4cc5-a764-70ff91ebeba3 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:51:15.411131 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d0ab0dcb-9067-4cc5-a764-70ff91ebeba3 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:51:15.411816 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d0ab0dcb-9067-4cc5-a764-70ff91ebeba3 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:51:15.412439 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d0ab0dcb-9067-4cc5-a764-70ff91ebeba3 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:51:15.424619 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=1,nova_api:DELETE=4,nova_api:UPDATE=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:51:15.446931 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d0ab0dcb-9067-4cc5-a764-70ff91ebeba3 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:15.456412 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d0ab0dcb-9067-4cc5-a764-70ff91ebeba3 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:15.456872 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d0ab0dcb-9067-4cc5-a764-70ff91ebeba3 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:15.460794 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d0ab0dcb-9067-4cc5-a764-70ff91ebeba3 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:15.461466 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d0ab0dcb-9067-4cc5-a764-70ff91ebeba3 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:15.462073 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d0ab0dcb-9067-4cc5-a764-70ff91ebeba3 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:15.500561 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-d0ab0dcb-9067-4cc5-a764-70ff91ebeba3 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Getting quotas for project d393ecae873a4fc99a4745ed894b5137. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:51:15.510002 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-d0ab0dcb-9067-4cc5-a764-70ff91ebeba3 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Getting quotas for user 311a89ac7bc648f1a2f4067773a2ba59 and project d393ecae873a4fc99a4745ed894b5137. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:51:15.571641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d0ab0dcb-9067-4cc5-a764-70ff91ebeba3 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:51:15.581875 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d0ab0dcb-9067-4cc5-a764-70ff91ebeba3 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:51:15.675535 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a9035864-6939-476c-9999-1dac45d58977 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:15.684369 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a9035864-6939-476c-9999-1dac45d58977 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:15.685826 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a9035864-6939-476c-9999-1dac45d58977 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:15.693635 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d0ab0dcb-9067-4cc5-a764-70ff91ebeba3 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.311638 Sep 10 11:51:15.696425 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1425/2767] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:51:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 3317 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:51:15.712352 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-214791d4-6fee-4d13-956a-c261492b6575 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f4073e6d670>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:15.722105 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a9035864-6939-476c-9999-1dac45d58977 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1544 microversion: 2.91 time: 0.406516 Sep 10 11:51:15.725569 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1343/2768] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:15 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1544 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:51:15.752175 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d09eb884-50cc-4d9a-92c1-6af642de5842 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:15.752824 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d09eb884-50cc-4d9a-92c1-6af642de5842 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:15.827106 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-214791d4-6fee-4d13-956a-c261492b6575 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/9af4c5ec-005a-43b8-8d1f-84731e30d0df" status: 200 len: 1419 microversion: 2.1 time: 0.126640 Sep 10 11:51:15.827900 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1426/2769] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:51:15 2022] GET /compute/v2.1/images/9af4c5ec-005a-43b8-8d1f-84731e30d0df => generated 1419 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:15.842699 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4fe35e76-7009-4539-b967-f3a18f3ba08f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f407304a9d0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:16.082081 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d09eb884-50cc-4d9a-92c1-6af642de5842 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:16.092158 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d09eb884-50cc-4d9a-92c1-6af642de5842 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1223 microversion: 2.1 time: 0.365262 Sep 10 11:51:16.094010 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1344/2770] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:15 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1223 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:16.147853 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e9b3773e-cb1a-431c-908a-6fbd5c321ccb tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:16.148803 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e9b3773e-cb1a-431c-908a-6fbd5c321ccb tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: 3b2dc8b3-1049-4393-824f-b9786315d5ad] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:16.156857 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e9b3773e-cb1a-431c-908a-6fbd5c321ccb tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:16.159517 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e9b3773e-cb1a-431c-908a-6fbd5c321ccb tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:16.160211 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e9b3773e-cb1a-431c-908a-6fbd5c321ccb tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:16.167968 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e9b3773e-cb1a-431c-908a-6fbd5c321ccb tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:16.169085 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e9b3773e-cb1a-431c-908a-6fbd5c321ccb tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:16.169689 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e9b3773e-cb1a-431c-908a-6fbd5c321ccb tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:17.009826 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e9b3773e-cb1a-431c-908a-6fbd5c321ccb tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:17.025211 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e9b3773e-cb1a-431c-908a-6fbd5c321ccb tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad" status: 200 len: 1520 microversion: 2.1 time: 0.929839 Sep 10 11:51:17.031770 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1345/2771] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:16 2022] GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad => generated 1520 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:17.047734 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e241f28d-88be-4bb5-806e-9070a147158c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:17.048621 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e241f28d-88be-4bb5-806e-9070a147158c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:17.068358 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e241f28d-88be-4bb5-806e-9070a147158c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:17.071260 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e241f28d-88be-4bb5-806e-9070a147158c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:17.072640 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e241f28d-88be-4bb5-806e-9070a147158c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:17.072961 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e241f28d-88be-4bb5-806e-9070a147158c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:17.073574 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e241f28d-88be-4bb5-806e-9070a147158c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:17.085748 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e241f28d-88be-4bb5-806e-9070a147158c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:17.089102 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:51:17.176670 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:51:17.347056 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4fe35e76-7009-4539-b967-f3a18f3ba08f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "DELETE /compute/v2.1/images/9af4c5ec-005a-43b8-8d1f-84731e30d0df" status: 204 len: 0 microversion: 2.1 time: 1.508315 Sep 10 11:51:17.348615 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1427/2772] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:15 2022] DELETE /compute/v2.1/images/9af4c5ec-005a-43b8-8d1f-84731e30d0df => generated 0 bytes in 1510 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:51:17.364811 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4da29c03-3acc-4965-9b71-7157a319b4bd tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:17.370900 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4da29c03-3acc-4965-9b71-7157a319b4bd tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:17.416635 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4da29c03-3acc-4965-9b71-7157a319b4bd tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:17.418815 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4da29c03-3acc-4965-9b71-7157a319b4bd tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:17.419329 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4da29c03-3acc-4965-9b71-7157a319b4bd tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:17.427312 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4da29c03-3acc-4965-9b71-7157a319b4bd tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:17.436258 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4da29c03-3acc-4965-9b71-7157a319b4bd tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:17.437885 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4da29c03-3acc-4965-9b71-7157a319b4bd tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:17.716833 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e241f28d-88be-4bb5-806e-9070a147158c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:17.759966 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e241f28d-88be-4bb5-806e-9070a147158c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:17.763128 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e241f28d-88be-4bb5-806e-9070a147158c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:17.798157 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e241f28d-88be-4bb5-806e-9070a147158c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1544 microversion: 2.91 time: 0.765126 Sep 10 11:51:17.804045 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1346/2773] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:17 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1544 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:51:17.811018 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4da29c03-3acc-4965-9b71-7157a319b4bd tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:17.826077 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d41cc723-9870-4d4b-a354-667c0d22860c tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:17.826491 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4da29c03-3acc-4965-9b71-7157a319b4bd tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1227 microversion: 2.1 time: 0.474126 Sep 10 11:51:17.826777 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d41cc723-9870-4d4b-a354-667c0d22860c tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 10b130d5-dcd3-41e9-9e67-c68eb28726a2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:17.828264 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1428/2774] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:17 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1227 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:17.849152 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d41cc723-9870-4d4b-a354-667c0d22860c tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:17.849560 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d41cc723-9870-4d4b-a354-667c0d22860c tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:17.850006 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d41cc723-9870-4d4b-a354-667c0d22860c tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:17.852576 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d41cc723-9870-4d4b-a354-667c0d22860c tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:17.853580 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d41cc723-9870-4d4b-a354-667c0d22860c tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:17.888067 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d41cc723-9870-4d4b-a354-667c0d22860c tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:17.953645 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d41cc723-9870-4d4b-a354-667c0d22860c tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 10b130d5-dcd3-41e9-9e67-c68eb28726a2] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:51:18.062583 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3633bb4e-e4b9-43d0-b351-cce222b5c87c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:18.069880 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3633bb4e-e4b9-43d0-b351-cce222b5c87c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: 3b2dc8b3-1049-4393-824f-b9786315d5ad] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:18.107354 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3633bb4e-e4b9-43d0-b351-cce222b5c87c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:18.108099 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3633bb4e-e4b9-43d0-b351-cce222b5c87c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:18.108846 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3633bb4e-e4b9-43d0-b351-cce222b5c87c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:18.113371 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3633bb4e-e4b9-43d0-b351-cce222b5c87c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:18.113866 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3633bb4e-e4b9-43d0-b351-cce222b5c87c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:18.122548 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3633bb4e-e4b9-43d0-b351-cce222b5c87c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:18.232630 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d41cc723-9870-4d4b-a354-667c0d22860c tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "DELETE /compute/v2.1/servers/10b130d5-dcd3-41e9-9e67-c68eb28726a2" status: 204 len: 0 microversion: 2.1 time: 0.420134 Sep 10 11:51:18.233990 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1347/2775] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:51:17 2022] DELETE /compute/v2.1/servers/10b130d5-dcd3-41e9-9e67-c68eb28726a2 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:51:18.559671 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-def4cbe3-51bf-454b-9d73-d69bde7efd76 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-405018126", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "a9ff9635-7794-44ea-9e2d-dac85a415bc7"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:51:18.702752 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-def4cbe3-51bf-454b-9d73-d69bde7efd76 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] validate_networks() for [('a9ff9635-7794-44ea-9e2d-dac85a415bc7', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:51:19.604204 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3633bb4e-e4b9-43d0-b351-cce222b5c87c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:19.617471 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3633bb4e-e4b9-43d0-b351-cce222b5c87c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad" status: 200 len: 1505 microversion: 2.1 time: 1.560968 Sep 10 11:51:19.620774 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1429/2776] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:18 2022] GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad => generated 1505 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:51:19.639382 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-933d6ff0-c814-4b5e-adb3-5471773b80b0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:19.640260 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-933d6ff0-c814-4b5e-adb3-5471773b80b0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:19.657901 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-933d6ff0-c814-4b5e-adb3-5471773b80b0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:19.658987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-933d6ff0-c814-4b5e-adb3-5471773b80b0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:19.659774 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-933d6ff0-c814-4b5e-adb3-5471773b80b0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:19.661117 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-933d6ff0-c814-4b5e-adb3-5471773b80b0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:19.662948 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-933d6ff0-c814-4b5e-adb3-5471773b80b0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:19.674369 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-933d6ff0-c814-4b5e-adb3-5471773b80b0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:19.980483 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-933d6ff0-c814-4b5e-adb3-5471773b80b0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:19.992167 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-933d6ff0-c814-4b5e-adb3-5471773b80b0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:20.003934 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-933d6ff0-c814-4b5e-adb3-5471773b80b0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:20.037111 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-933d6ff0-c814-4b5e-adb3-5471773b80b0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1544 microversion: 2.91 time: 0.396138 Sep 10 11:51:20.040997 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1430/2777] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:19 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1544 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:51:20.047999 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-32115dde-fc54-43ab-ac6c-86e61e87a1da tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:20.063583 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-32115dde-fc54-43ab-ac6c-86e61e87a1da tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:20.078389 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32115dde-fc54-43ab-ac6c-86e61e87a1da tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:20.089447 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32115dde-fc54-43ab-ac6c-86e61e87a1da tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:20.091607 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32115dde-fc54-43ab-ac6c-86e61e87a1da tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:20.093246 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32115dde-fc54-43ab-ac6c-86e61e87a1da tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:20.096066 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32115dde-fc54-43ab-ac6c-86e61e87a1da tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:20.098350 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32115dde-fc54-43ab-ac6c-86e61e87a1da tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:20.380646 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-32115dde-fc54-43ab-ac6c-86e61e87a1da tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:20.390686 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-32115dde-fc54-43ab-ac6c-86e61e87a1da tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1281 microversion: 2.1 time: 0.348334 Sep 10 11:51:20.395288 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1431/2778] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:20 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1281 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:20.406156 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-976535ae-e91d-4f39-9252-0107972b28b3 req-cff0612b-64c2-4945-9b5e-2bb6b7e72ed1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10b130d5-dcd3-41e9-9e67-c68eb28726a2", "name": "network-vif-unplugged", "status": "completed", "tag": "3eff96c5-ed1a-483c-9684-7de7e46b66f8"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:51:20.471539 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-976535ae-e91d-4f39-9252-0107972b28b3 req-cff0612b-64c2-4945-9b5e-2bb6b7e72ed1 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:20.472300 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-976535ae-e91d-4f39-9252-0107972b28b3 req-cff0612b-64c2-4945-9b5e-2bb6b7e72ed1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:20.477202 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-976535ae-e91d-4f39-9252-0107972b28b3 req-cff0612b-64c2-4945-9b5e-2bb6b7e72ed1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:20.543452 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-976535ae-e91d-4f39-9252-0107972b28b3 req-cff0612b-64c2-4945-9b5e-2bb6b7e72ed1 service nova] Creating event network-vif-unplugged:3eff96c5-ed1a-483c-9684-7de7e46b66f8 for instance 10b130d5-dcd3-41e9-9e67-c68eb28726a2 on n-h1-856895-1 Sep 10 11:51:20.564667 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-976535ae-e91d-4f39-9252-0107972b28b3 req-cff0612b-64c2-4945-9b5e-2bb6b7e72ed1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.165890 Sep 10 11:51:20.568157 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1432/2779] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:51:20.581884 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f49ae97f-39fb-4618-87b3-26d319a6bde2 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:20.586473 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f49ae97f-39fb-4618-87b3-26d319a6bde2 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: 3b2dc8b3-1049-4393-824f-b9786315d5ad] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:20.607105 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f49ae97f-39fb-4618-87b3-26d319a6bde2 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:20.612612 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f49ae97f-39fb-4618-87b3-26d319a6bde2 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:20.614699 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f49ae97f-39fb-4618-87b3-26d319a6bde2 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:20.616989 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f49ae97f-39fb-4618-87b3-26d319a6bde2 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:20.620997 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f49ae97f-39fb-4618-87b3-26d319a6bde2 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:20.621704 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f49ae97f-39fb-4618-87b3-26d319a6bde2 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:21.302366 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f49ae97f-39fb-4618-87b3-26d319a6bde2 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:21.316092 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f49ae97f-39fb-4618-87b3-26d319a6bde2 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad" status: 200 len: 1505 microversion: 2.1 time: 0.746188 Sep 10 11:51:21.317278 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1433/2780] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:20 2022] GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad => generated 1505 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:21.322074 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5a05b124-8d74-454a-a529-6846f662f254 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:21.326702 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5a05b124-8d74-454a-a529-6846f662f254 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:21.339608 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5a05b124-8d74-454a-a529-6846f662f254 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:21.347080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5a05b124-8d74-454a-a529-6846f662f254 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:21.347980 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5a05b124-8d74-454a-a529-6846f662f254 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:21.356237 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5a05b124-8d74-454a-a529-6846f662f254 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:21.356985 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5a05b124-8d74-454a-a529-6846f662f254 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:21.357640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5a05b124-8d74-454a-a529-6846f662f254 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:21.836544 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5a05b124-8d74-454a-a529-6846f662f254 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:21.852524 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5a05b124-8d74-454a-a529-6846f662f254 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:21.866811 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5a05b124-8d74-454a-a529-6846f662f254 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:21.888551 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5a05b124-8d74-454a-a529-6846f662f254 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1544 microversion: 2.91 time: 0.569942 Sep 10 11:51:21.891531 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1434/2781] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:21 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1544 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:51:21.907978 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8a3a57bf-d663-4977-b568-d25fcedb39eb tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:21.921441 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8a3a57bf-d663-4977-b568-d25fcedb39eb tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: 3b2dc8b3-1049-4393-824f-b9786315d5ad] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:21.931296 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a3a57bf-d663-4977-b568-d25fcedb39eb tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:21.931802 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a3a57bf-d663-4977-b568-d25fcedb39eb tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:21.932253 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a3a57bf-d663-4977-b568-d25fcedb39eb tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:21.932976 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a3a57bf-d663-4977-b568-d25fcedb39eb tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:21.933438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a3a57bf-d663-4977-b568-d25fcedb39eb tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:21.933871 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a3a57bf-d663-4977-b568-d25fcedb39eb tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:22.037866 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8a3a57bf-d663-4977-b568-d25fcedb39eb tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: 3b2dc8b3-1049-4393-824f-b9786315d5ad] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:51:22.189476 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:51:22.297649 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8a3a57bf-d663-4977-b568-d25fcedb39eb tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad" status: 204 len: 0 microversion: 2.1 time: 0.403660 Sep 10 11:51:22.303502 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1435/2782] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:51:21 2022] DELETE /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:51:22.312755 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7d1b9b71-b927-46fd-8541-8cd81893b3d6 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:22.315806 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7d1b9b71-b927-46fd-8541-8cd81893b3d6 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:22.323991 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d1b9b71-b927-46fd-8541-8cd81893b3d6 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:22.324816 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d1b9b71-b927-46fd-8541-8cd81893b3d6 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:22.325447 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d1b9b71-b927-46fd-8541-8cd81893b3d6 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:22.326786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d1b9b71-b927-46fd-8541-8cd81893b3d6 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:22.327465 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d1b9b71-b927-46fd-8541-8cd81893b3d6 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:22.328065 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d1b9b71-b927-46fd-8541-8cd81893b3d6 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:22.871953 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7d1b9b71-b927-46fd-8541-8cd81893b3d6 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:22.896343 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7d1b9b71-b927-46fd-8541-8cd81893b3d6 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1281 microversion: 2.1 time: 0.588284 Sep 10 11:51:22.913825 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1436/2783] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:22 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1281 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:22.927389 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-70b153e4-aad6-4a55-8047-10fd41b447dc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1806116836", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "cfeac9bd-52fd-4612-85bf-8e6a7cf5b8db"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:51:23.052538 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-70b153e4-aad6-4a55-8047-10fd41b447dc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] validate_networks() for [('cfeac9bd-52fd-4612-85bf-8e6a7cf5b8db', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:51:23.127121 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-def4cbe3-51bf-454b-9d73-d69bde7efd76 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:51:23.127862 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-def4cbe3-51bf-454b-9d73-d69bde7efd76 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:51:23.128105 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-def4cbe3-51bf-454b-9d73-d69bde7efd76 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:51:23.129621 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-def4cbe3-51bf-454b-9d73-d69bde7efd76 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:51:23.130127 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-def4cbe3-51bf-454b-9d73-d69bde7efd76 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:51:23.147487 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-def4cbe3-51bf-454b-9d73-d69bde7efd76 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:23.150291 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-def4cbe3-51bf-454b-9d73-d69bde7efd76 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:23.152851 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-def4cbe3-51bf-454b-9d73-d69bde7efd76 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:23.157498 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-def4cbe3-51bf-454b-9d73-d69bde7efd76 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:23.158462 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-def4cbe3-51bf-454b-9d73-d69bde7efd76 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:23.160283 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-def4cbe3-51bf-454b-9d73-d69bde7efd76 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:23.213564 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-def4cbe3-51bf-454b-9d73-d69bde7efd76 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Getting quotas for project 57eb6c59b1a7467baf0daae9019ca5aa. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:51:23.231253 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-def4cbe3-51bf-454b-9d73-d69bde7efd76 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Getting quotas for user 1ead4e0fd51b484c8dd38da5a3975788 and project 57eb6c59b1a7467baf0daae9019ca5aa. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:51:23.272150 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-def4cbe3-51bf-454b-9d73-d69bde7efd76 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:51:23.278463 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-def4cbe3-51bf-454b-9d73-d69bde7efd76 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 7c17b066-2297-4d76-adcb-abae0e87a3c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:51:23.457720 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-def4cbe3-51bf-454b-9d73-d69bde7efd76 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.907727 Sep 10 11:51:23.460045 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1348/2784] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:51:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 4911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 11:51:23.467882 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-16594aeb-628e-4587-9a22-d82bdaa1c27a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:23.468826 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-16594aeb-628e-4587-9a22-d82bdaa1c27a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:23.483572 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16594aeb-628e-4587-9a22-d82bdaa1c27a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:23.484086 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16594aeb-628e-4587-9a22-d82bdaa1c27a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:23.484539 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16594aeb-628e-4587-9a22-d82bdaa1c27a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:23.485264 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16594aeb-628e-4587-9a22-d82bdaa1c27a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:23.486490 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16594aeb-628e-4587-9a22-d82bdaa1c27a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:23.487689 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16594aeb-628e-4587-9a22-d82bdaa1c27a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:24.335064 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-16594aeb-628e-4587-9a22-d82bdaa1c27a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:24.364559 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-16594aeb-628e-4587-9a22-d82bdaa1c27a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:24.377525 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-16594aeb-628e-4587-9a22-d82bdaa1c27a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:24.406960 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-16594aeb-628e-4587-9a22-d82bdaa1c27a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1544 microversion: 2.91 time: 0.945457 Sep 10 11:51:24.418528 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1349/2785] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:23 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1544 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:51:24.426374 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-69a7da80-fa47-4b9e-84b9-a27d9ad6ae13 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:24.440935 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-69a7da80-fa47-4b9e-84b9-a27d9ad6ae13 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 7c17b066-2297-4d76-adcb-abae0e87a3c2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:24.854516 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-69a7da80-fa47-4b9e-84b9-a27d9ad6ae13 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:24.879556 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-69a7da80-fa47-4b9e-84b9-a27d9ad6ae13 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2" status: 200 len: 1207 microversion: 2.1 time: 0.459319 Sep 10 11:51:24.889504 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1350/2786] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:24 2022] GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2 => generated 1207 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:24.897600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-91ddbc23-0e8b-4a0b-a036-3e25494d14b6 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:24.898266 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-91ddbc23-0e8b-4a0b-a036-3e25494d14b6 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:24.926027 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-91ddbc23-0e8b-4a0b-a036-3e25494d14b6 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:24.926564 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-91ddbc23-0e8b-4a0b-a036-3e25494d14b6 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:24.930282 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-91ddbc23-0e8b-4a0b-a036-3e25494d14b6 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:24.931457 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-91ddbc23-0e8b-4a0b-a036-3e25494d14b6 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:24.937175 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-91ddbc23-0e8b-4a0b-a036-3e25494d14b6 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:24.940098 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-91ddbc23-0e8b-4a0b-a036-3e25494d14b6 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:25.478710 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:51:25.545990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:51:25.715070 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-91ddbc23-0e8b-4a0b-a036-3e25494d14b6 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:25.729971 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-91ddbc23-0e8b-4a0b-a036-3e25494d14b6 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1281 microversion: 2.1 time: 0.839166 Sep 10 11:51:25.730504 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1351/2787] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:24 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1281 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:25.741710 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-77cddbb7-7e52-4caf-a338-c415eaa55a06 req-cb4d09dd-833b-4412-96fb-d5df4c451eed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10b130d5-dcd3-41e9-9e67-c68eb28726a2", "name": "network-vif-deleted", "tag": "3eff96c5-ed1a-483c-9684-7de7e46b66f8"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:51:25.764940 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-77cddbb7-7e52-4caf-a338-c415eaa55a06 req-cb4d09dd-833b-4412-96fb-d5df4c451eed service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:25.767747 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-77cddbb7-7e52-4caf-a338-c415eaa55a06 req-cb4d09dd-833b-4412-96fb-d5df4c451eed service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:25.768249 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-77cddbb7-7e52-4caf-a338-c415eaa55a06 req-cb4d09dd-833b-4412-96fb-d5df4c451eed service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:25.797987 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-77cddbb7-7e52-4caf-a338-c415eaa55a06 req-cb4d09dd-833b-4412-96fb-d5df4c451eed service nova] Creating event network-vif-deleted:3eff96c5-ed1a-483c-9684-7de7e46b66f8 for instance 10b130d5-dcd3-41e9-9e67-c68eb28726a2 on n-h1-856895-1 Sep 10 11:51:25.815045 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-77cddbb7-7e52-4caf-a338-c415eaa55a06 req-cb4d09dd-833b-4412-96fb-d5df4c451eed service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083274 Sep 10 11:51:25.815696 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1352/2788] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:51:25.838307 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bc4f2625-df81-4222-87e8-4b8ae157851f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:25.840256 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bc4f2625-df81-4222-87e8-4b8ae157851f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:25.857529 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc4f2625-df81-4222-87e8-4b8ae157851f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:25.861163 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc4f2625-df81-4222-87e8-4b8ae157851f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:25.861666 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc4f2625-df81-4222-87e8-4b8ae157851f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:25.862422 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc4f2625-df81-4222-87e8-4b8ae157851f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:25.862892 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc4f2625-df81-4222-87e8-4b8ae157851f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:25.864592 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc4f2625-df81-4222-87e8-4b8ae157851f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:27.134919 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bc4f2625-df81-4222-87e8-4b8ae157851f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:27.144108 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bc4f2625-df81-4222-87e8-4b8ae157851f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:27.145566 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bc4f2625-df81-4222-87e8-4b8ae157851f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:27.164114 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bc4f2625-df81-4222-87e8-4b8ae157851f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1544 microversion: 2.91 time: 1.347175 Sep 10 11:51:27.165339 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1353/2789] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:25 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1544 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:51:27.171938 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-93373a34-a92e-48e2-b7a8-c666c8e0cb89 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:27.183526 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-93373a34-a92e-48e2-b7a8-c666c8e0cb89 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 7c17b066-2297-4d76-adcb-abae0e87a3c2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:27.191999 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-93373a34-a92e-48e2-b7a8-c666c8e0cb89 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:27.198527 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-93373a34-a92e-48e2-b7a8-c666c8e0cb89 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:27.199307 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-93373a34-a92e-48e2-b7a8-c666c8e0cb89 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:27.200252 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-93373a34-a92e-48e2-b7a8-c666c8e0cb89 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:27.200891 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-93373a34-a92e-48e2-b7a8-c666c8e0cb89 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:27.201483 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-93373a34-a92e-48e2-b7a8-c666c8e0cb89 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:27.569086 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-93373a34-a92e-48e2-b7a8-c666c8e0cb89 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:27.577347 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-93373a34-a92e-48e2-b7a8-c666c8e0cb89 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2" status: 200 len: 1265 microversion: 2.1 time: 0.410525 Sep 10 11:51:27.580674 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1354/2790] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:27 2022] GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2 => generated 1265 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:27.605840 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c9530e46-57c6-42d3-92f9-127cd5cc79b8 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:27.606493 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c9530e46-57c6-42d3-92f9-127cd5cc79b8 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:27.624414 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9530e46-57c6-42d3-92f9-127cd5cc79b8 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:27.625195 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9530e46-57c6-42d3-92f9-127cd5cc79b8 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:27.625827 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9530e46-57c6-42d3-92f9-127cd5cc79b8 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:27.626784 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9530e46-57c6-42d3-92f9-127cd5cc79b8 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:27.627441 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9530e46-57c6-42d3-92f9-127cd5cc79b8 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:27.628037 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9530e46-57c6-42d3-92f9-127cd5cc79b8 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:27.933935 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c9530e46-57c6-42d3-92f9-127cd5cc79b8 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:27.943072 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c9530e46-57c6-42d3-92f9-127cd5cc79b8 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1281 microversion: 2.1 time: 0.346537 Sep 10 11:51:27.943694 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1355/2791] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:27 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1281 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:27.958506 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e980c587-d65b-4851-a4b5-81d2410946ff tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Action: 'create', calling method: .version_select at 0x7f40729fd550>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-273725322", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMH9V8HdAjFXAJ11r8SF97be5J3QvY6ZpHUqaM3ALjxysnUCif5gYN1GITNqIWPP4mvyLxlw/BHzQFto0AhaGWTjRdYc7Rf/5Fbg9J9apukEiWdQboZF5CkzAICWziYQwA=="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:51:27.979399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-70b153e4-aad6-4a55-8047-10fd41b447dc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:51:27.980625 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-70b153e4-aad6-4a55-8047-10fd41b447dc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:51:27.981281 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-70b153e4-aad6-4a55-8047-10fd41b447dc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:51:27.981868 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-70b153e4-aad6-4a55-8047-10fd41b447dc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:51:27.982458 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-70b153e4-aad6-4a55-8047-10fd41b447dc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:51:28.018449 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-70b153e4-aad6-4a55-8047-10fd41b447dc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:28.019294 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-70b153e4-aad6-4a55-8047-10fd41b447dc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:28.019918 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-70b153e4-aad6-4a55-8047-10fd41b447dc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:28.021773 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-70b153e4-aad6-4a55-8047-10fd41b447dc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:28.022838 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-70b153e4-aad6-4a55-8047-10fd41b447dc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:28.024147 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-e980c587-d65b-4851-a4b5-81d2410946ff tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Getting quotas for project 20756c1a77fb44f684973f382b802825. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:51:28.024797 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-70b153e4-aad6-4a55-8047-10fd41b447dc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:28.044289 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-e980c587-d65b-4851-a4b5-81d2410946ff tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Getting quotas for user 92be647276cc456e83dacd25b98e37f2 and project 20756c1a77fb44f684973f382b802825. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:51:28.096324 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-70b153e4-aad6-4a55-8047-10fd41b447dc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Getting quotas for project 689e03cda40d4be5ab9fe3fe20ca8d97. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:51:28.121592 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-70b153e4-aad6-4a55-8047-10fd41b447dc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Getting quotas for user 1673c19f6ab545a18897858acf56f762 and project 689e03cda40d4be5ab9fe3fe20ca8d97. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:51:28.130281 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e980c587-d65b-4851-a4b5-81d2410946ff tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.179563 Sep 10 11:51:28.133574 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1356/2792] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 11:51:27 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:51:28.148636 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-70b153e4-aad6-4a55-8047-10fd41b447dc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:51:28.151310 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-70b153e4-aad6-4a55-8047-10fd41b447dc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:51:28.193630 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-19da2e17-b094-4ba6-84f8-f6fefeb4e685 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:28.194855 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-19da2e17-b094-4ba6-84f8-f6fefeb4e685 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:28.207023 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19da2e17-b094-4ba6-84f8-f6fefeb4e685 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:28.207845 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19da2e17-b094-4ba6-84f8-f6fefeb4e685 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:28.208473 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19da2e17-b094-4ba6-84f8-f6fefeb4e685 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:28.209386 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19da2e17-b094-4ba6-84f8-f6fefeb4e685 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:28.210540 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19da2e17-b094-4ba6-84f8-f6fefeb4e685 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:28.212844 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19da2e17-b094-4ba6-84f8-f6fefeb4e685 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:28.252160 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-70b153e4-aad6-4a55-8047-10fd41b447dc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.336208 Sep 10 11:51:28.256150 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1437/2793] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:51:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 5342 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:51:28.271685 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d7719472-434b-44cd-b306-10c82da0988a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:28.272712 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d7719472-434b-44cd-b306-10c82da0988a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:28.594835 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-19da2e17-b094-4ba6-84f8-f6fefeb4e685 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:28.596264 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d7719472-434b-44cd-b306-10c82da0988a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:28.625648 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-19da2e17-b094-4ba6-84f8-f6fefeb4e685 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:28.632565 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d7719472-434b-44cd-b306-10c82da0988a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1218 microversion: 2.1 time: 0.368601 Sep 10 11:51:28.639567 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1438/2794] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:28 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1218 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:28.643780 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-19da2e17-b094-4ba6-84f8-f6fefeb4e685 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:28.662070 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9056c7ff-60f2-4355-8ae4-490cc6ac6be8 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:28.667522 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9056c7ff-60f2-4355-8ae4-490cc6ac6be8 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 7c17b066-2297-4d76-adcb-abae0e87a3c2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:28.669105 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-19da2e17-b094-4ba6-84f8-f6fefeb4e685 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1544 microversion: 2.91 time: 0.477626 Sep 10 11:51:28.674055 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1357/2795] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:28 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1544 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:51:28.685678 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9056c7ff-60f2-4355-8ae4-490cc6ac6be8 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:28.687429 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9056c7ff-60f2-4355-8ae4-490cc6ac6be8 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:28.692362 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9056c7ff-60f2-4355-8ae4-490cc6ac6be8 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:28.693846 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9056c7ff-60f2-4355-8ae4-490cc6ac6be8 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:28.695436 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9056c7ff-60f2-4355-8ae4-490cc6ac6be8 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:28.696462 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9056c7ff-60f2-4355-8ae4-490cc6ac6be8 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:28.974077 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b2f13c4e-4a9a-4540-9031-ebb52c2c663c tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:28.974803 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b2f13c4e-4a9a-4540-9031-ebb52c2c663c tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:28.989914 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2f13c4e-4a9a-4540-9031-ebb52c2c663c tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:28.990429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2f13c4e-4a9a-4540-9031-ebb52c2c663c tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:28.992132 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2f13c4e-4a9a-4540-9031-ebb52c2c663c tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:28.994475 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2f13c4e-4a9a-4540-9031-ebb52c2c663c tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:28.996746 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2f13c4e-4a9a-4540-9031-ebb52c2c663c tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:28.997478 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2f13c4e-4a9a-4540-9031-ebb52c2c663c tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:29.420267 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9056c7ff-60f2-4355-8ae4-490cc6ac6be8 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:29.430989 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9056c7ff-60f2-4355-8ae4-490cc6ac6be8 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2" status: 200 len: 1265 microversion: 2.1 time: 0.787523 Sep 10 11:51:29.453606 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1439/2796] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:28 2022] GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2 => generated 1265 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:29.665500 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c511b8d9-53e1-4590-ae0d-90337b12df50 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:29.666121 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c511b8d9-53e1-4590-ae0d-90337b12df50 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:29.686423 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c511b8d9-53e1-4590-ae0d-90337b12df50 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:29.711709 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c511b8d9-53e1-4590-ae0d-90337b12df50 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:29.712683 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c511b8d9-53e1-4590-ae0d-90337b12df50 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:29.713615 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c511b8d9-53e1-4590-ae0d-90337b12df50 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:29.714240 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c511b8d9-53e1-4590-ae0d-90337b12df50 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:29.714823 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c511b8d9-53e1-4590-ae0d-90337b12df50 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:30.671658 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c511b8d9-53e1-4590-ae0d-90337b12df50 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:30.694300 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c511b8d9-53e1-4590-ae0d-90337b12df50 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1214 microversion: 2.1 time: 1.032522 Sep 10 11:51:30.696745 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1440/2797] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:29 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1214 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:30.723721 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5dc1dc81-6b12-48dc-8961-21a299c37b41 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:30.728229 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5dc1dc81-6b12-48dc-8961-21a299c37b41 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:30.739609 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5dc1dc81-6b12-48dc-8961-21a299c37b41 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:30.742931 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5dc1dc81-6b12-48dc-8961-21a299c37b41 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:30.743690 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5dc1dc81-6b12-48dc-8961-21a299c37b41 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:30.744708 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5dc1dc81-6b12-48dc-8961-21a299c37b41 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:30.745410 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5dc1dc81-6b12-48dc-8961-21a299c37b41 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:30.752036 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5dc1dc81-6b12-48dc-8961-21a299c37b41 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:31.243749 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5dc1dc81-6b12-48dc-8961-21a299c37b41 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:31.257609 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5dc1dc81-6b12-48dc-8961-21a299c37b41 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:31.263197 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5dc1dc81-6b12-48dc-8961-21a299c37b41 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:31.279377 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5dc1dc81-6b12-48dc-8961-21a299c37b41 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1544 microversion: 2.91 time: 0.578774 Sep 10 11:51:31.280916 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1441/2798] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:30 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1544 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:51:31.289617 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b2f13c4e-4a9a-4540-9031-ebb52c2c663c tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:31.294515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-b69c7c44-5aed-4efe-a79b-99a7f1e70cca req-c209e8cc-5c52-4af6-9750-6dc15a82c18e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b2dc8b3-1049-4393-824f-b9786315d5ad", "name": "network-vif-deleted", "tag": "4024f0bb-5caf-48f4-b443-b7c8a693e47b"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:51:31.309102 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b2f13c4e-4a9a-4540-9031-ebb52c2c663c tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1323 microversion: 2.1 time: 2.341811 Sep 10 11:51:31.309660 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1358/2799] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:28 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1323 bytes in 2344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:31.319135 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cb5a8719-4fdd-4196-8b83-a16e91b5c02e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:31.319811 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cb5a8719-4fdd-4196-8b83-a16e91b5c02e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 7c17b066-2297-4d76-adcb-abae0e87a3c2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:31.322023 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-b69c7c44-5aed-4efe-a79b-99a7f1e70cca req-c209e8cc-5c52-4af6-9750-6dc15a82c18e service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:31.325211 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-b69c7c44-5aed-4efe-a79b-99a7f1e70cca req-c209e8cc-5c52-4af6-9750-6dc15a82c18e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:31.328649 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-b69c7c44-5aed-4efe-a79b-99a7f1e70cca req-c209e8cc-5c52-4af6-9750-6dc15a82c18e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:31.338265 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb5a8719-4fdd-4196-8b83-a16e91b5c02e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:31.338774 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb5a8719-4fdd-4196-8b83-a16e91b5c02e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:31.340274 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb5a8719-4fdd-4196-8b83-a16e91b5c02e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:31.343418 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb5a8719-4fdd-4196-8b83-a16e91b5c02e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:31.344200 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb5a8719-4fdd-4196-8b83-a16e91b5c02e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:31.344726 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb5a8719-4fdd-4196-8b83-a16e91b5c02e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:31.357730 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-b69c7c44-5aed-4efe-a79b-99a7f1e70cca req-c209e8cc-5c52-4af6-9750-6dc15a82c18e service nova] Creating event network-vif-deleted:4024f0bb-5caf-48f4-b443-b7c8a693e47b for instance 3b2dc8b3-1049-4393-824f-b9786315d5ad on n-h2-856895-1 Sep 10 11:51:31.363612 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-b69c7c44-5aed-4efe-a79b-99a7f1e70cca req-c209e8cc-5c52-4af6-9750-6dc15a82c18e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078422 Sep 10 11:51:31.364763 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1442/2800] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:51:31.727513 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2c39dce6-1ef5-4b76-87b2-0d1cca025134 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:31.729235 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2c39dce6-1ef5-4b76-87b2-0d1cca025134 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:31.750915 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c39dce6-1ef5-4b76-87b2-0d1cca025134 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:31.753080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c39dce6-1ef5-4b76-87b2-0d1cca025134 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:31.755087 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c39dce6-1ef5-4b76-87b2-0d1cca025134 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:31.757248 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c39dce6-1ef5-4b76-87b2-0d1cca025134 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:31.758528 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c39dce6-1ef5-4b76-87b2-0d1cca025134 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:31.759349 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c39dce6-1ef5-4b76-87b2-0d1cca025134 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:31.931253 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2c39dce6-1ef5-4b76-87b2-0d1cca025134 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:31.940375 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-cb5a8719-4fdd-4196-8b83-a16e91b5c02e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:31.956644 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cb5a8719-4fdd-4196-8b83-a16e91b5c02e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2" status: 200 len: 1307 microversion: 2.1 time: 0.645873 Sep 10 11:51:31.958206 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2c39dce6-1ef5-4b76-87b2-0d1cca025134 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1276 microversion: 2.1 time: 0.238554 Sep 10 11:51:31.974243 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1359/2801] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:31 2022] GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2 => generated 1307 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:31.979494 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1443/2802] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:31 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1276 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:51:31.984249 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-de6bf9d7-50e6-460e-8f57-ab3d04cf0cc5 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:31.984997 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-de6bf9d7-50e6-460e-8f57-ab3d04cf0cc5 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:31.992043 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de6bf9d7-50e6-460e-8f57-ab3d04cf0cc5 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:31.992967 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de6bf9d7-50e6-460e-8f57-ab3d04cf0cc5 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:31.993585 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de6bf9d7-50e6-460e-8f57-ab3d04cf0cc5 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:31.994504 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de6bf9d7-50e6-460e-8f57-ab3d04cf0cc5 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:31.995123 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de6bf9d7-50e6-460e-8f57-ab3d04cf0cc5 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:31.995732 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de6bf9d7-50e6-460e-8f57-ab3d04cf0cc5 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:32.011763 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-de6bf9d7-50e6-460e-8f57-ab3d04cf0cc5 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] HTTP exception thrown: Instance d86e1b80-a305-48c7-9c51-ef4175a5840c could not be found. Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-de6bf9d7-50e6-460e-8f57-ab3d04cf0cc5 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Request method failure captured: Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c HTTP/1.1 Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHiE1tOUJxuJKfNvyiDNIgVr_QrySnbiCZqUNWPj7NkVKXM1LuL3x7qa4dUmejrjrkloa_lwbwXwUWvmzp2PiGwPTp9X7FWejZG9bnL-Edlj8K0xKFvxhzq2Br8i09mDoTGjAboRgQnv5XZ0FwjESZ1MBgKuABptkTmCi9xT5iBIRFE Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: X-Openstack-Nova-Api-Version: 2.32 Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 337f9c4dcb0b4da097f41bde1d789efa Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-TaggedBootDevicesTest-1893956690 Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/337f9c4dcb0b4da097f41bde1d789efa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/337f9c4dcb0b4da097f41bde1d789efa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_337f9c4dcb0b4da097f41bde1d789efa", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/337f9c4dcb0b4da097f41bde1d789efa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-TaggedBootDevicesTest-1893956690 Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 337f9c4dcb0b4da097f41bde1d789efa Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1893956690 Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-TaggedBootDevicesTest-1893956690-project Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 2d00b725397549cfaa2aeb2b0a8dfe3d Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-TaggedBootDevicesTest-1893956690-project Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance d86e1b80-a305-48c7-9c51-ef4175a5840c could not be found. Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'd86e1b80-a305-48c7-9c51-ef4175a5840c'} Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d86e1b80-a305-48c7-9c51-ef4175a5840c could not be found. Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:51:32.013995 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:51:32.019793 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d86e1b80-a305-48c7-9c51-ef4175a5840c could not be found. Sep 10 11:51:32.019793 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:51:32.019793 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:51:32.019793 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:51:32.019793 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:51:32.019793 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:51:32.019793 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:51:32.019793 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:51:32.019793 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:51:32.019793 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d86e1b80-a305-48c7-9c51-ef4175a5840c could not be found. Sep 10 11:51:32.019793 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:51:32.021094 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-de6bf9d7-50e6-460e-8f57-ab3d04cf0cc5 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Returning 404 to user: Instance d86e1b80-a305-48c7-9c51-ef4175a5840c could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:51:32.022026 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-de6bf9d7-50e6-460e-8f57-ab3d04cf0cc5 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 404 len: 111 microversion: 2.32 time: 0.042639 Sep 10 11:51:32.023488 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1360/2803] 10.222.0.23 () {60 vars in 1280 bytes} [Sat Sep 10 11:51:31 2022] DELETE /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:51:32.042803 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e8b76f54-ecf6-4f87-8f2a-a08f95202fa2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:32.045916 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e8b76f54-ecf6-4f87-8f2a-a08f95202fa2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] [instance: d86e1b80-a305-48c7-9c51-ef4175a5840c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:32.057189 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e8b76f54-ecf6-4f87-8f2a-a08f95202fa2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:32.058248 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e8b76f54-ecf6-4f87-8f2a-a08f95202fa2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:32.058914 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e8b76f54-ecf6-4f87-8f2a-a08f95202fa2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:32.060610 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e8b76f54-ecf6-4f87-8f2a-a08f95202fa2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:32.061454 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e8b76f54-ecf6-4f87-8f2a-a08f95202fa2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:32.062865 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e8b76f54-ecf6-4f87-8f2a-a08f95202fa2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:32.083542 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-e8b76f54-ecf6-4f87-8f2a-a08f95202fa2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] HTTP exception thrown: Instance d86e1b80-a305-48c7-9c51-ef4175a5840c could not be found. Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e8b76f54-ecf6-4f87-8f2a-a08f95202fa2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Request method failure captured: Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c HTTP/1.1 Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHiE1tOUJxuJKfNvyiDNIgVr_QrySnbiCZqUNWPj7NkVKXM1LuL3x7qa4dUmejrjrkloa_lwbwXwUWvmzp2PiGwPTp9X7FWejZG9bnL-Edlj8K0xKFvxhzq2Br8i09mDoTGjAboRgQnv5XZ0FwjESZ1MBgKuABptkTmCi9xT5iBIRFE Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: X-Openstack-Nova-Api-Version: 2.32 Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 337f9c4dcb0b4da097f41bde1d789efa Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-TaggedBootDevicesTest-1893956690 Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/337f9c4dcb0b4da097f41bde1d789efa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/337f9c4dcb0b4da097f41bde1d789efa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_337f9c4dcb0b4da097f41bde1d789efa", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/337f9c4dcb0b4da097f41bde1d789efa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-TaggedBootDevicesTest-1893956690 Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 337f9c4dcb0b4da097f41bde1d789efa Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1893956690 Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-TaggedBootDevicesTest-1893956690-project Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 2d00b725397549cfaa2aeb2b0a8dfe3d Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-TaggedBootDevicesTest-1893956690-project Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance d86e1b80-a305-48c7-9c51-ef4175a5840c could not be found. Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'd86e1b80-a305-48c7-9c51-ef4175a5840c'} Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d86e1b80-a305-48c7-9c51-ef4175a5840c could not be found. Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d86e1b80-a305-48c7-9c51-ef4175a5840c could not be found. Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:51:32.086261 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:51:32.091013 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:51:32.091013 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:51:32.091013 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:51:32.091013 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:51:32.091013 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:51:32.091013 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:51:32.091013 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d86e1b80-a305-48c7-9c51-ef4175a5840c could not be found. Sep 10 11:51:32.091013 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:51:32.092584 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e8b76f54-ecf6-4f87-8f2a-a08f95202fa2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] Returning 404 to user: Instance d86e1b80-a305-48c7-9c51-ef4175a5840c could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:51:32.095558 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e8b76f54-ecf6-4f87-8f2a-a08f95202fa2 tempest-TaggedBootDevicesTest-1893956690 tempest-TaggedBootDevicesTest-1893956690-project] 10.222.0.23 "GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c" status: 404 len: 111 microversion: 2.32 time: 0.068167 Sep 10 11:51:32.097083 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1444/2804] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:32 2022] GET /compute/v2.1/servers/d86e1b80-a305-48c7-9c51-ef4175a5840c => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 10 11:51:32.312719 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ce959337-d178-44ec-a129-7a5bf1cca3de tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:32.314116 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ce959337-d178-44ec-a129-7a5bf1cca3de tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:32.322413 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ce959337-d178-44ec-a129-7a5bf1cca3de tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:32.323232 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ce959337-d178-44ec-a129-7a5bf1cca3de tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:32.323853 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ce959337-d178-44ec-a129-7a5bf1cca3de tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:32.324762 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ce959337-d178-44ec-a129-7a5bf1cca3de tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:32.326018 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ce959337-d178-44ec-a129-7a5bf1cca3de tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:32.332627 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c3f5f2f7-e90b-409e-ba6b-1a81bfd780f9 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:32.333540 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c3f5f2f7-e90b-409e-ba6b-1a81bfd780f9 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:32.335635 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ce959337-d178-44ec-a129-7a5bf1cca3de tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:32.354045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3f5f2f7-e90b-409e-ba6b-1a81bfd780f9 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:32.356884 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3f5f2f7-e90b-409e-ba6b-1a81bfd780f9 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:32.367856 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3f5f2f7-e90b-409e-ba6b-1a81bfd780f9 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:32.368914 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3f5f2f7-e90b-409e-ba6b-1a81bfd780f9 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:32.369555 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3f5f2f7-e90b-409e-ba6b-1a81bfd780f9 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:32.370174 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3f5f2f7-e90b-409e-ba6b-1a81bfd780f9 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:32.665810 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ce959337-d178-44ec-a129-7a5bf1cca3de tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:32.680320 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ce959337-d178-44ec-a129-7a5bf1cca3de tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:32.690498 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ce959337-d178-44ec-a129-7a5bf1cca3de tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:32.712697 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:51:32.722169 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ce959337-d178-44ec-a129-7a5bf1cca3de tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1544 microversion: 2.91 time: 0.410877 Sep 10 11:51:32.724947 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1361/2805] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:32 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1544 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:51:32.774108 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c3f5f2f7-e90b-409e-ba6b-1a81bfd780f9 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:32.785594 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c3f5f2f7-e90b-409e-ba6b-1a81bfd780f9 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1323 microversion: 2.1 time: 0.457588 Sep 10 11:51:32.800145 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1445/2806] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:32 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1323 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:32.986684 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cccc8b7b-f025-46e8-be60-5a77ec313afa tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:32.987651 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cccc8b7b-f025-46e8-be60-5a77ec313afa tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 7c17b066-2297-4d76-adcb-abae0e87a3c2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:33.012752 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cccc8b7b-f025-46e8-be60-5a77ec313afa tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:33.014208 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cccc8b7b-f025-46e8-be60-5a77ec313afa tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:33.017375 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cccc8b7b-f025-46e8-be60-5a77ec313afa tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:33.017547 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-81548ffd-74c4-4aab-bafa-0f05e169c6ca tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:33.018366 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-81548ffd-74c4-4aab-bafa-0f05e169c6ca tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:33.019493 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cccc8b7b-f025-46e8-be60-5a77ec313afa tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:33.021671 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cccc8b7b-f025-46e8-be60-5a77ec313afa tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:33.022938 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cccc8b7b-f025-46e8-be60-5a77ec313afa tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:33.029031 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-81548ffd-74c4-4aab-bafa-0f05e169c6ca tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:33.035401 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-81548ffd-74c4-4aab-bafa-0f05e169c6ca tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:33.036206 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-81548ffd-74c4-4aab-bafa-0f05e169c6ca tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:33.039453 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-81548ffd-74c4-4aab-bafa-0f05e169c6ca tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:33.040184 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-81548ffd-74c4-4aab-bafa-0f05e169c6ca tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:33.042459 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-81548ffd-74c4-4aab-bafa-0f05e169c6ca tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:33.189829 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:51:33.480399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-81548ffd-74c4-4aab-bafa-0f05e169c6ca tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:33.489712 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-81548ffd-74c4-4aab-bafa-0f05e169c6ca tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1276 microversion: 2.1 time: 0.481004 Sep 10 11:51:33.490312 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1446/2807] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:33 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1276 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:33.663135 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-cccc8b7b-f025-46e8-be60-5a77ec313afa tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:33.678698 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cccc8b7b-f025-46e8-be60-5a77ec313afa tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2" status: 200 len: 1307 microversion: 2.1 time: 0.696348 Sep 10 11:51:33.680949 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1362/2808] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:32 2022] GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2 => generated 1307 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:33.764280 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b67445b9-dd5b-4431-9e67-2c2dfbe0fba7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:33.764958 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b67445b9-dd5b-4431-9e67-2c2dfbe0fba7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:33.785441 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b67445b9-dd5b-4431-9e67-2c2dfbe0fba7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:33.788386 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b67445b9-dd5b-4431-9e67-2c2dfbe0fba7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:33.793980 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b67445b9-dd5b-4431-9e67-2c2dfbe0fba7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:33.795029 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b67445b9-dd5b-4431-9e67-2c2dfbe0fba7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:33.795799 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b67445b9-dd5b-4431-9e67-2c2dfbe0fba7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:33.797502 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b67445b9-dd5b-4431-9e67-2c2dfbe0fba7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:33.811959 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-78b338cf-ed29-4359-b3fc-339a2844195e tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:33.813121 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-78b338cf-ed29-4359-b3fc-339a2844195e tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:33.821869 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-78b338cf-ed29-4359-b3fc-339a2844195e tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:33.830264 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-78b338cf-ed29-4359-b3fc-339a2844195e tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:33.835121 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-78b338cf-ed29-4359-b3fc-339a2844195e tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:33.836147 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-78b338cf-ed29-4359-b3fc-339a2844195e tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:33.839521 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-78b338cf-ed29-4359-b3fc-339a2844195e tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:33.840189 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-78b338cf-ed29-4359-b3fc-339a2844195e tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:34.159252 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b67445b9-dd5b-4431-9e67-2c2dfbe0fba7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:34.172414 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b67445b9-dd5b-4431-9e67-2c2dfbe0fba7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:34.175531 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b67445b9-dd5b-4431-9e67-2c2dfbe0fba7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:34.204341 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b67445b9-dd5b-4431-9e67-2c2dfbe0fba7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1544 microversion: 2.91 time: 0.448864 Sep 10 11:51:34.206538 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1447/2809] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:33 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1544 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:51:34.524824 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-97c5fec0-9db0-4b25-a2d0-e0d69119fd38 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:34.525611 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-97c5fec0-9db0-4b25-a2d0-e0d69119fd38 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:34.538966 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-97c5fec0-9db0-4b25-a2d0-e0d69119fd38 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:34.557776 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-97c5fec0-9db0-4b25-a2d0-e0d69119fd38 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:34.559490 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-97c5fec0-9db0-4b25-a2d0-e0d69119fd38 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:34.565547 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-97c5fec0-9db0-4b25-a2d0-e0d69119fd38 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:34.568312 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-97c5fec0-9db0-4b25-a2d0-e0d69119fd38 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:34.570077 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-97c5fec0-9db0-4b25-a2d0-e0d69119fd38 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:34.889407 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-78b338cf-ed29-4359-b3fc-339a2844195e tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:34.898953 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-78b338cf-ed29-4359-b3fc-339a2844195e tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1323 microversion: 2.1 time: 1.092664 Sep 10 11:51:34.920219 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1363/2810] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:33 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1323 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:34.931509 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f066967a-6c20-4a60-b69f-c4a94aa224bd tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:34.941255 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f066967a-6c20-4a60-b69f-c4a94aa224bd tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 7c17b066-2297-4d76-adcb-abae0e87a3c2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:34.948154 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f066967a-6c20-4a60-b69f-c4a94aa224bd tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:34.948970 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f066967a-6c20-4a60-b69f-c4a94aa224bd tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:34.949666 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f066967a-6c20-4a60-b69f-c4a94aa224bd tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:34.951109 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f066967a-6c20-4a60-b69f-c4a94aa224bd tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:34.955824 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f066967a-6c20-4a60-b69f-c4a94aa224bd tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:34.956405 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f066967a-6c20-4a60-b69f-c4a94aa224bd tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:35.274093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-97c5fec0-9db0-4b25-a2d0-e0d69119fd38 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:35.288278 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-97c5fec0-9db0-4b25-a2d0-e0d69119fd38 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1318 microversion: 2.1 time: 0.767752 Sep 10 11:51:35.289209 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1448/2811] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:34 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1318 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:51:35.294123 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-811a03dd-aaa8-46e7-99b1-0ad377d5ef5c req-69ede5ca-ccab-417a-b207-45931797ec91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da5c3efa-07a9-4b8b-b258-482cecc2a0ea", "tag": "985e81bb-aeae-46fb-bc6f-b3a5e1be77f6"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:51:35.321408 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-811a03dd-aaa8-46e7-99b1-0ad377d5ef5c req-69ede5ca-ccab-417a-b207-45931797ec91 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:35.322202 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-811a03dd-aaa8-46e7-99b1-0ad377d5ef5c req-69ede5ca-ccab-417a-b207-45931797ec91 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:35.322796 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-811a03dd-aaa8-46e7-99b1-0ad377d5ef5c req-69ede5ca-ccab-417a-b207-45931797ec91 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:35.349906 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-811a03dd-aaa8-46e7-99b1-0ad377d5ef5c req-69ede5ca-ccab-417a-b207-45931797ec91 service nova] Creating event network-changed:985e81bb-aeae-46fb-bc6f-b3a5e1be77f6 for instance da5c3efa-07a9-4b8b-b258-482cecc2a0ea on n-h1-856895-1 Sep 10 11:51:35.363134 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-811a03dd-aaa8-46e7-99b1-0ad377d5ef5c req-69ede5ca-ccab-417a-b207-45931797ec91 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072465 Sep 10 11:51:35.367522 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1449/2812] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:51:35.379969 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9e3afb3a-47c8-4679-89af-e80f9ae89d6a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:35.380973 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9e3afb3a-47c8-4679-89af-e80f9ae89d6a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:35.400623 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9e3afb3a-47c8-4679-89af-e80f9ae89d6a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:35.402115 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9e3afb3a-47c8-4679-89af-e80f9ae89d6a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:35.402460 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9e3afb3a-47c8-4679-89af-e80f9ae89d6a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:35.403787 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9e3afb3a-47c8-4679-89af-e80f9ae89d6a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:35.404333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9e3afb3a-47c8-4679-89af-e80f9ae89d6a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:35.405510 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9e3afb3a-47c8-4679-89af-e80f9ae89d6a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:35.475075 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f066967a-6c20-4a60-b69f-c4a94aa224bd tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:35.489336 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f066967a-6c20-4a60-b69f-c4a94aa224bd tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2" status: 200 len: 1307 microversion: 2.1 time: 0.567270 Sep 10 11:51:35.490441 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1364/2813] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:34 2022] GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2 => generated 1307 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:35.588337 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9e3afb3a-47c8-4679-89af-e80f9ae89d6a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:35.604371 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9e3afb3a-47c8-4679-89af-e80f9ae89d6a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:35.611127 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9e3afb3a-47c8-4679-89af-e80f9ae89d6a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:35.625647 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9e3afb3a-47c8-4679-89af-e80f9ae89d6a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1531 microversion: 2.91 time: 0.254803 Sep 10 11:51:35.630772 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1450/2814] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:35 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1531 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:51:35.662380 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-691f27e6-698c-494d-b48d-7057529b39c8 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:35.663745 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-691f27e6-698c-494d-b48d-7057529b39c8 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:35.674223 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-691f27e6-698c-494d-b48d-7057529b39c8 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:35.676122 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-691f27e6-698c-494d-b48d-7057529b39c8 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:35.678779 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-691f27e6-698c-494d-b48d-7057529b39c8 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:35.679784 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-691f27e6-698c-494d-b48d-7057529b39c8 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:35.682298 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-691f27e6-698c-494d-b48d-7057529b39c8 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:35.684262 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-691f27e6-698c-494d-b48d-7057529b39c8 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:35.737284 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:51:35.870055 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-691f27e6-698c-494d-b48d-7057529b39c8 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Lazy-loading 'services' on Instance uuid 0ae1b1e1-f970-4d46-8d88-289c96d3f306 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:51:35.915827 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-691f27e6-698c-494d-b48d-7057529b39c8 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1936 microversion: 2.91 time: 0.260906 Sep 10 11:51:35.932553 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1365/2815] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:35 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1936 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:51:35.935431 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ec7efe17-bb21-4328-acb0-16e426cd17e2 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:35.936085 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ec7efe17-bb21-4328-acb0-16e426cd17e2 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:35.947128 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec7efe17-bb21-4328-acb0-16e426cd17e2 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:35.949049 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec7efe17-bb21-4328-acb0-16e426cd17e2 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:35.950958 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1214a9b0-3d13-44fe-b37c-df494ab0f5c1 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:51:35.951681 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1214a9b0-3d13-44fe-b37c-df494ab0f5c1 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:35.955197 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec7efe17-bb21-4328-acb0-16e426cd17e2 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:35.956152 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec7efe17-bb21-4328-acb0-16e426cd17e2 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:35.956652 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec7efe17-bb21-4328-acb0-16e426cd17e2 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:35.957109 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec7efe17-bb21-4328-acb0-16e426cd17e2 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:35.964090 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1214a9b0-3d13-44fe-b37c-df494ab0f5c1 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:35.964791 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1214a9b0-3d13-44fe-b37c-df494ab0f5c1 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:35.966994 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1214a9b0-3d13-44fe-b37c-df494ab0f5c1 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:35.968575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1214a9b0-3d13-44fe-b37c-df494ab0f5c1 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:35.975899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1214a9b0-3d13-44fe-b37c-df494ab0f5c1 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:35.976437 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1214a9b0-3d13-44fe-b37c-df494ab0f5c1 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:36.029135 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-1214a9b0-3d13-44fe-b37c-df494ab0f5c1 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lazy-loading 'flavor' on Instance uuid 0ae1b1e1-f970-4d46-8d88-289c96d3f306 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:51:36.258891 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ec7efe17-bb21-4328-acb0-16e426cd17e2 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:36.328025 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ec7efe17-bb21-4328-acb0-16e426cd17e2 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1323 microversion: 2.1 time: 0.393358 Sep 10 11:51:36.330804 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1451/2816] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:35 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1323 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:51:36.346722 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-beb3dff9-c623-4a6a-a375-2aeacf41dfbc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:36.347672 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-beb3dff9-c623-4a6a-a375-2aeacf41dfbc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:36.354336 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-beb3dff9-c623-4a6a-a375-2aeacf41dfbc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:36.355078 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-beb3dff9-c623-4a6a-a375-2aeacf41dfbc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:36.355695 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-beb3dff9-c623-4a6a-a375-2aeacf41dfbc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:36.356978 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-beb3dff9-c623-4a6a-a375-2aeacf41dfbc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:36.357610 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-beb3dff9-c623-4a6a-a375-2aeacf41dfbc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:36.358219 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-beb3dff9-c623-4a6a-a375-2aeacf41dfbc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:36.398974 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1214a9b0-3d13-44fe-b37c-df494ab0f5c1 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "POST /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306/action" status: 202 len: 0 microversion: 2.91 time: 0.452201 Sep 10 11:51:36.404093 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1366/2817] 10.222.0.23 () {62 vars in 1319 bytes} [Sat Sep 10 11:51:35 2022] POST /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306/action => generated 0 bytes in 458 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:51:36.424578 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-13a0bdba-c677-4685-91a0-90214278da5a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:36.425403 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-13a0bdba-c677-4685-91a0-90214278da5a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:36.466983 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13a0bdba-c677-4685-91a0-90214278da5a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:36.467835 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13a0bdba-c677-4685-91a0-90214278da5a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:36.468240 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13a0bdba-c677-4685-91a0-90214278da5a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:36.470822 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13a0bdba-c677-4685-91a0-90214278da5a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:36.475077 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13a0bdba-c677-4685-91a0-90214278da5a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:36.475817 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13a0bdba-c677-4685-91a0-90214278da5a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:36.656155 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-13a0bdba-c677-4685-91a0-90214278da5a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:36.671939 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-13a0bdba-c677-4685-91a0-90214278da5a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:36.674354 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-13a0bdba-c677-4685-91a0-90214278da5a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:36.689870 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-13a0bdba-c677-4685-91a0-90214278da5a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1537 microversion: 2.91 time: 0.280927 Sep 10 11:51:36.698438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-beb3dff9-c623-4a6a-a375-2aeacf41dfbc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:36.708856 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-beb3dff9-c623-4a6a-a375-2aeacf41dfbc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1318 microversion: 2.1 time: 0.376611 Sep 10 11:51:36.710496 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1367/2818] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:36 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1537 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:51:36.711439 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1452/2819] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:36 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1318 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:36.746092 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f1d15136-204c-47b0-beaf-82c0fe722fdc tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:36.747033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f1d15136-204c-47b0-beaf-82c0fe722fdc tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 7c17b066-2297-4d76-adcb-abae0e87a3c2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:36.760443 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1d15136-204c-47b0-beaf-82c0fe722fdc tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:36.760943 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1d15136-204c-47b0-beaf-82c0fe722fdc tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:36.761387 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1d15136-204c-47b0-beaf-82c0fe722fdc tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:36.762117 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1d15136-204c-47b0-beaf-82c0fe722fdc tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:36.762577 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1d15136-204c-47b0-beaf-82c0fe722fdc tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:36.763010 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1d15136-204c-47b0-beaf-82c0fe722fdc tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:37.214121 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f1d15136-204c-47b0-beaf-82c0fe722fdc tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:37.229533 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f1d15136-204c-47b0-beaf-82c0fe722fdc tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2" status: 200 len: 1307 microversion: 2.1 time: 0.501955 Sep 10 11:51:37.231544 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1368/2820] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:36 2022] GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2 => generated 1307 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:37.354631 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-aade939e-f517-4a81-9f21-19eb2af06d83 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:37.355279 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-aade939e-f517-4a81-9f21-19eb2af06d83 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:37.366816 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aade939e-f517-4a81-9f21-19eb2af06d83 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:37.367622 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aade939e-f517-4a81-9f21-19eb2af06d83 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:37.368911 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aade939e-f517-4a81-9f21-19eb2af06d83 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:37.370449 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aade939e-f517-4a81-9f21-19eb2af06d83 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:37.371106 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aade939e-f517-4a81-9f21-19eb2af06d83 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:37.372589 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aade939e-f517-4a81-9f21-19eb2af06d83 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:37.740643 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4ba6f790-a0fa-459e-9879-c2b516d5bf72 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:37.748192 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4ba6f790-a0fa-459e-9879-c2b516d5bf72 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:37.779816 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ba6f790-a0fa-459e-9879-c2b516d5bf72 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:37.780479 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ba6f790-a0fa-459e-9879-c2b516d5bf72 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:37.781009 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ba6f790-a0fa-459e-9879-c2b516d5bf72 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:37.781831 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ba6f790-a0fa-459e-9879-c2b516d5bf72 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:37.782399 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ba6f790-a0fa-459e-9879-c2b516d5bf72 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:37.782935 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ba6f790-a0fa-459e-9879-c2b516d5bf72 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:37.833282 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-aade939e-f517-4a81-9f21-19eb2af06d83 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:37.849763 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-aade939e-f517-4a81-9f21-19eb2af06d83 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1323 microversion: 2.1 time: 0.499673 Sep 10 11:51:37.850923 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1453/2821] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:37 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1323 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:37.858893 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e6155252-262b-4406-be70-f74688f919ce tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:37.859917 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e6155252-262b-4406-be70-f74688f919ce tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:37.867787 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e6155252-262b-4406-be70-f74688f919ce tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:37.868821 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e6155252-262b-4406-be70-f74688f919ce tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:37.869588 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e6155252-262b-4406-be70-f74688f919ce tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:37.870506 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e6155252-262b-4406-be70-f74688f919ce tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:37.871230 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e6155252-262b-4406-be70-f74688f919ce tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:37.872140 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e6155252-262b-4406-be70-f74688f919ce tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:38.026452 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e6155252-262b-4406-be70-f74688f919ce tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:38.042143 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e6155252-262b-4406-be70-f74688f919ce tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:38.050769 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e6155252-262b-4406-be70-f74688f919ce tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:38.054424 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:51:38.055798 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:51:38.073664 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e6155252-262b-4406-be70-f74688f919ce tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1537 microversion: 2.91 time: 0.220953 Sep 10 11:51:38.074741 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=14 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:51:38.077180 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1454/2822] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:37 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1537 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:51:38.111667 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d38c9b20-fdf5-4b8f-9545-e1a41a3562d4 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1263567504", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "39e87e43-83b0-47c1-a0a7-c2a5f16fa311"}], "key_name": "tempest-TestNetworkBasicOps-273725322", "security_groups": [{"name": "tempest-secgroup-smoke-601283554"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:51:38.210747 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4ba6f790-a0fa-459e-9879-c2b516d5bf72 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:38.219431 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4ba6f790-a0fa-459e-9879-c2b516d5bf72 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1318 microversion: 2.1 time: 0.485039 Sep 10 11:51:38.220679 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1369/2823] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:37 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1318 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:38.221750 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4ba6f790-a0fa-459e-9879-c2b516d5bf72 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:38.222653 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4ba6f790-a0fa-459e-9879-c2b516d5bf72 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001177 Sep 10 11:51:38.230535 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1370/2824] 10.222.0.23 () {56 vars in 886 bytes} [Sat Sep 10 11:51:38 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 10 11:51:38.258667 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-faf3cb86-a6a9-4880-bab3-a369424e9d44 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:38.259355 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-faf3cb86-a6a9-4880-bab3-a369424e9d44 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 7c17b066-2297-4d76-adcb-abae0e87a3c2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:38.270200 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-faf3cb86-a6a9-4880-bab3-a369424e9d44 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:38.270701 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-faf3cb86-a6a9-4880-bab3-a369424e9d44 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:38.271147 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-faf3cb86-a6a9-4880-bab3-a369424e9d44 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:38.271881 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-faf3cb86-a6a9-4880-bab3-a369424e9d44 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:38.272341 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-faf3cb86-a6a9-4880-bab3-a369424e9d44 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:38.272775 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-faf3cb86-a6a9-4880-bab3-a369424e9d44 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:38.572418 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-faf3cb86-a6a9-4880-bab3-a369424e9d44 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:38.574608 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-d38c9b20-fdf5-4b8f-9545-e1a41a3562d4 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] validate_networks() for [('39e87e43-83b0-47c1-a0a7-c2a5f16fa311', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:51:38.589571 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-faf3cb86-a6a9-4880-bab3-a369424e9d44 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2" status: 200 len: 1307 microversion: 2.1 time: 0.334908 Sep 10 11:51:38.590171 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1371/2825] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:38 2022] GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2 => generated 1307 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:51:38.605670 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-e12e1ef8-a049-42ce-82c9-6c506b066547 req-a8ab60d2-3e78-458a-8663-14a6a87fb48c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c17b066-2297-4d76-adcb-abae0e87a3c2", "tag": "f7ecbdeb-b574-40b0-8ff5-0aed4036ed04"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:51:38.618207 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e12e1ef8-a049-42ce-82c9-6c506b066547 req-a8ab60d2-3e78-458a-8663-14a6a87fb48c service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:38.618698 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e12e1ef8-a049-42ce-82c9-6c506b066547 req-a8ab60d2-3e78-458a-8663-14a6a87fb48c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:38.619114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=8 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:51:38.619462 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e12e1ef8-a049-42ce-82c9-6c506b066547 req-a8ab60d2-3e78-458a-8663-14a6a87fb48c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:38.633829 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-e12e1ef8-a049-42ce-82c9-6c506b066547 req-a8ab60d2-3e78-458a-8663-14a6a87fb48c service nova] Creating event network-changed:f7ecbdeb-b574-40b0-8ff5-0aed4036ed04 for instance 7c17b066-2297-4d76-adcb-abae0e87a3c2 on n-h2-856895-1 Sep 10 11:51:38.638917 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-e12e1ef8-a049-42ce-82c9-6c506b066547 req-a8ab60d2-3e78-458a-8663-14a6a87fb48c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047531 Sep 10 11:51:38.639921 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1372/2826] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:51:38.878974 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3d086894-ffef-4ed1-a905-e54c2715bc71 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:38.879846 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3d086894-ffef-4ed1-a905-e54c2715bc71 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:38.917693 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3d086894-ffef-4ed1-a905-e54c2715bc71 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:38.919926 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3d086894-ffef-4ed1-a905-e54c2715bc71 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:38.920475 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3d086894-ffef-4ed1-a905-e54c2715bc71 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:38.921302 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3d086894-ffef-4ed1-a905-e54c2715bc71 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:38.923964 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3d086894-ffef-4ed1-a905-e54c2715bc71 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:38.931868 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3d086894-ffef-4ed1-a905-e54c2715bc71 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:39.911850 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3d086894-ffef-4ed1-a905-e54c2715bc71 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:39.926849 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3d086894-ffef-4ed1-a905-e54c2715bc71 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1323 microversion: 2.1 time: 1.052437 Sep 10 11:51:39.929015 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1373/2827] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:38 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1323 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:39.943532 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e7768b30-a686-4a6b-8e34-4ebd17cb8e66 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:39.944734 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e7768b30-a686-4a6b-8e34-4ebd17cb8e66 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:39.956445 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7768b30-a686-4a6b-8e34-4ebd17cb8e66 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:39.960219 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7768b30-a686-4a6b-8e34-4ebd17cb8e66 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:39.960924 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7768b30-a686-4a6b-8e34-4ebd17cb8e66 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:39.964391 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7768b30-a686-4a6b-8e34-4ebd17cb8e66 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:39.965225 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7768b30-a686-4a6b-8e34-4ebd17cb8e66 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:39.965908 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7768b30-a686-4a6b-8e34-4ebd17cb8e66 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:40.213205 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e7768b30-a686-4a6b-8e34-4ebd17cb8e66 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:40.246773 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e7768b30-a686-4a6b-8e34-4ebd17cb8e66 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:40.252660 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e7768b30-a686-4a6b-8e34-4ebd17cb8e66 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:40.305493 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e7768b30-a686-4a6b-8e34-4ebd17cb8e66 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1537 microversion: 2.91 time: 0.370089 Sep 10 11:51:40.335416 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1374/2828] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:39 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1537 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:51:40.670691 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-db20e3d1-29be-40ca-9735-c39f2f3f60a7 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Action: 'create', calling method: .version_select at 0x7f40729e7d30>, body: {"keypair": {"name": "tempest-keypair-1668632494", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXSY4LZ+kZX0Wp0eNYi4b3nCeQC8no2yBbEe8DPt9YTK1ufcIAiHP3b7a4X+5icXgxBMgCqY0tVal1ukCER4R00duGlwsNj1jIfd6G3OkBun5wdyoIi2nGar60sENM0cA=="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:51:40.732471 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-db20e3d1-29be-40ca-9735-c39f2f3f60a7 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Getting quotas for project 926d7fd11fb84c86b66362074c1ca8a7. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:51:40.754626 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-db20e3d1-29be-40ca-9735-c39f2f3f60a7 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Getting quotas for user d5d0aaa7b7a34bb4bcea483bb41276aa and project 926d7fd11fb84c86b66362074c1ca8a7. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:51:40.792041 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d38c9b20-fdf5-4b8f-9545-e1a41a3562d4 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:51:40.792525 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d38c9b20-fdf5-4b8f-9545-e1a41a3562d4 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:51:40.792965 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d38c9b20-fdf5-4b8f-9545-e1a41a3562d4 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:51:40.793384 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d38c9b20-fdf5-4b8f-9545-e1a41a3562d4 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:51:40.793961 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d38c9b20-fdf5-4b8f-9545-e1a41a3562d4 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:51:40.824863 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d38c9b20-fdf5-4b8f-9545-e1a41a3562d4 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:40.825519 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d38c9b20-fdf5-4b8f-9545-e1a41a3562d4 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:40.827288 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d38c9b20-fdf5-4b8f-9545-e1a41a3562d4 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:40.828115 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d38c9b20-fdf5-4b8f-9545-e1a41a3562d4 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:40.828588 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d38c9b20-fdf5-4b8f-9545-e1a41a3562d4 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:40.828848 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-db20e3d1-29be-40ca-9735-c39f2f3f60a7 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.491953 Sep 10 11:51:40.829748 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1375/2829] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 11:51:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:51:40.832064 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d38c9b20-fdf5-4b8f-9545-e1a41a3562d4 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:40.834197 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-98a288e1-7b17-4d8a-b52b-37eb513b87bc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:40.834836 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-98a288e1-7b17-4d8a-b52b-37eb513b87bc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:40.857349 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-98a288e1-7b17-4d8a-b52b-37eb513b87bc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:40.857858 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-98a288e1-7b17-4d8a-b52b-37eb513b87bc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:40.858303 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-98a288e1-7b17-4d8a-b52b-37eb513b87bc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:40.859023 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-98a288e1-7b17-4d8a-b52b-37eb513b87bc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:40.859543 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-98a288e1-7b17-4d8a-b52b-37eb513b87bc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:40.859666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:51:40.859979 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-98a288e1-7b17-4d8a-b52b-37eb513b87bc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:40.882016 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-d38c9b20-fdf5-4b8f-9545-e1a41a3562d4 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Getting quotas for project 20756c1a77fb44f684973f382b802825. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:51:40.889763 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-d38c9b20-fdf5-4b8f-9545-e1a41a3562d4 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Getting quotas for user 92be647276cc456e83dacd25b98e37f2 and project 20756c1a77fb44f684973f382b802825. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:51:40.905836 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d38c9b20-fdf5-4b8f-9545-e1a41a3562d4 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:51:40.911512 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d38c9b20-fdf5-4b8f-9545-e1a41a3562d4 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: f74f15ef-04b5-4313-b90f-20b96291734b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:51:40.993265 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d38c9b20-fdf5-4b8f-9545-e1a41a3562d4 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.897979 Sep 10 11:51:40.994114 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1455/2830] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:51:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 2916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:51:41.009450 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f5df2cb5-dbae-4b07-871b-246d9b0b5f1e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:41.010094 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f5df2cb5-dbae-4b07-871b-246d9b0b5f1e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 7c17b066-2297-4d76-adcb-abae0e87a3c2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:41.018384 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f5df2cb5-dbae-4b07-871b-246d9b0b5f1e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:41.018886 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f5df2cb5-dbae-4b07-871b-246d9b0b5f1e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:41.019371 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f5df2cb5-dbae-4b07-871b-246d9b0b5f1e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:41.020403 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f5df2cb5-dbae-4b07-871b-246d9b0b5f1e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:41.021659 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f5df2cb5-dbae-4b07-871b-246d9b0b5f1e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:41.022151 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f5df2cb5-dbae-4b07-871b-246d9b0b5f1e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:41.680458 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-98a288e1-7b17-4d8a-b52b-37eb513b87bc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:41.695919 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-98a288e1-7b17-4d8a-b52b-37eb513b87bc tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1318 microversion: 2.1 time: 0.865263 Sep 10 11:51:41.700057 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1376/2831] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:40 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1318 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:41.705128 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-ae587be3-dcf9-4d6e-a6af-863087cb301a req-dd51d815-66bd-493f-a4be-a5c2e25e880d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4cf27c4-4cda-46f0-94b9-f862994d2071", "tag": "98552666-f390-4515-b1a3-d6bf538fb04c"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:51:41.732212 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f5df2cb5-dbae-4b07-871b-246d9b0b5f1e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:41.741732 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f5df2cb5-dbae-4b07-871b-246d9b0b5f1e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2" status: 200 len: 1307 microversion: 2.1 time: 0.736316 Sep 10 11:51:41.745552 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1456/2832] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:40 2022] GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2 => generated 1307 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:41.750481 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b1771d56-b2ad-4a0f-a8dc-d01d4131cc2d tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:41.764172 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b1771d56-b2ad-4a0f-a8dc-d01d4131cc2d tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:41.787996 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ae587be3-dcf9-4d6e-a6af-863087cb301a req-dd51d815-66bd-493f-a4be-a5c2e25e880d service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:41.789773 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1771d56-b2ad-4a0f-a8dc-d01d4131cc2d tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:41.790564 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1771d56-b2ad-4a0f-a8dc-d01d4131cc2d tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:41.791303 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1771d56-b2ad-4a0f-a8dc-d01d4131cc2d tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:41.794733 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1771d56-b2ad-4a0f-a8dc-d01d4131cc2d tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:41.795442 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1771d56-b2ad-4a0f-a8dc-d01d4131cc2d tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:41.795979 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1771d56-b2ad-4a0f-a8dc-d01d4131cc2d tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:41.817883 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ae587be3-dcf9-4d6e-a6af-863087cb301a req-dd51d815-66bd-493f-a4be-a5c2e25e880d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:41.818818 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ae587be3-dcf9-4d6e-a6af-863087cb301a req-dd51d815-66bd-493f-a4be-a5c2e25e880d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:41.857752 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-ae587be3-dcf9-4d6e-a6af-863087cb301a req-dd51d815-66bd-493f-a4be-a5c2e25e880d service nova] Creating event network-changed:98552666-f390-4515-b1a3-d6bf538fb04c for instance d4cf27c4-4cda-46f0-94b9-f862994d2071 on n-h1-856895-1 Sep 10 11:51:41.866117 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-ae587be3-dcf9-4d6e-a6af-863087cb301a req-dd51d815-66bd-493f-a4be-a5c2e25e880d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164549 Sep 10 11:51:41.867893 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1377/2833] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:51:41.884581 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ef0c3f55-1507-4ad8-8bad-b5bb86fee247 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:41.885475 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ef0c3f55-1507-4ad8-8bad-b5bb86fee247 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: f74f15ef-04b5-4313-b90f-20b96291734b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:42.051707 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ef0c3f55-1507-4ad8-8bad-b5bb86fee247 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be647276cc456e83dacd25b98e37f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20756c1a77fb44f684973f382b802825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:42.062977 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ef0c3f55-1507-4ad8-8bad-b5bb86fee247 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/f74f15ef-04b5-4313-b90f-20b96291734b" status: 200 len: 1248 microversion: 2.1 time: 0.191994 Sep 10 11:51:42.078686 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1378/2834] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:41 2022] GET /compute/v2.1/servers/f74f15ef-04b5-4313-b90f-20b96291734b => generated 1248 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:42.101154 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f20b6e4b-a44a-42af-8de7-bdadbeef801c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:42.101154 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f20b6e4b-a44a-42af-8de7-bdadbeef801c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:42.106988 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f20b6e4b-a44a-42af-8de7-bdadbeef801c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:42.107605 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f20b6e4b-a44a-42af-8de7-bdadbeef801c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:42.108062 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f20b6e4b-a44a-42af-8de7-bdadbeef801c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:42.108791 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f20b6e4b-a44a-42af-8de7-bdadbeef801c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:42.109257 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f20b6e4b-a44a-42af-8de7-bdadbeef801c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:42.109694 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f20b6e4b-a44a-42af-8de7-bdadbeef801c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:42.196027 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b1771d56-b2ad-4a0f-a8dc-d01d4131cc2d tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:42.222380 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b1771d56-b2ad-4a0f-a8dc-d01d4131cc2d tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1323 microversion: 2.1 time: 0.475415 Sep 10 11:51:42.229913 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1457/2835] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:41 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1323 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:42.318313 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f20b6e4b-a44a-42af-8de7-bdadbeef801c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:42.334313 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f20b6e4b-a44a-42af-8de7-bdadbeef801c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:42.340315 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f20b6e4b-a44a-42af-8de7-bdadbeef801c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:42.362982 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f20b6e4b-a44a-42af-8de7-bdadbeef801c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1537 microversion: 2.91 time: 0.289324 Sep 10 11:51:42.365056 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1379/2836] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:42 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1537 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:51:42.728856 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c4cca343-6e38-4b8e-9544-123c723920ce tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:42.740177 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c4cca343-6e38-4b8e-9544-123c723920ce tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:42.752917 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c4cca343-6e38-4b8e-9544-123c723920ce tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:42.753742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c4cca343-6e38-4b8e-9544-123c723920ce tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:42.754514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c4cca343-6e38-4b8e-9544-123c723920ce tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:42.755484 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c4cca343-6e38-4b8e-9544-123c723920ce tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:42.756464 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c4cca343-6e38-4b8e-9544-123c723920ce tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:42.757323 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c4cca343-6e38-4b8e-9544-123c723920ce tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:42.776169 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-89eb06d7-d913-4966-a2a7-a667cb0ec969 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:42.780040 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-89eb06d7-d913-4966-a2a7-a667cb0ec969 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 7c17b066-2297-4d76-adcb-abae0e87a3c2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:42.801419 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89eb06d7-d913-4966-a2a7-a667cb0ec969 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:42.802151 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89eb06d7-d913-4966-a2a7-a667cb0ec969 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:42.802694 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89eb06d7-d913-4966-a2a7-a667cb0ec969 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:42.803573 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89eb06d7-d913-4966-a2a7-a667cb0ec969 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:42.805235 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89eb06d7-d913-4966-a2a7-a667cb0ec969 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:42.806853 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89eb06d7-d913-4966-a2a7-a667cb0ec969 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:43.359575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-89eb06d7-d913-4966-a2a7-a667cb0ec969 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:43.373446 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-89eb06d7-d913-4966-a2a7-a667cb0ec969 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2" status: 200 len: 1307 microversion: 2.1 time: 0.602116 Sep 10 11:51:43.374767 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1380/2837] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:42 2022] GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2 => generated 1307 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:43.386419 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6d9751d1-f308-4d02-9784-979bdde32205 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:43.388782 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6d9751d1-f308-4d02-9784-979bdde32205 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: f74f15ef-04b5-4313-b90f-20b96291734b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:43.408723 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6d9751d1-f308-4d02-9784-979bdde32205 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:43.409597 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6d9751d1-f308-4d02-9784-979bdde32205 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:43.413065 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6d9751d1-f308-4d02-9784-979bdde32205 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:43.414277 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6d9751d1-f308-4d02-9784-979bdde32205 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:43.418504 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6d9751d1-f308-4d02-9784-979bdde32205 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:43.420576 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6d9751d1-f308-4d02-9784-979bdde32205 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:43.514323 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c4cca343-6e38-4b8e-9544-123c723920ce tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:43.524565 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c4cca343-6e38-4b8e-9544-123c723920ce tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1318 microversion: 2.1 time: 0.801564 Sep 10 11:51:43.544691 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1458/2838] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:42 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1318 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:43.549399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-12439312-25dd-41cc-9aa7-16b5c6fe632e tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:43.552451 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-12439312-25dd-41cc-9aa7-16b5c6fe632e tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:43.563144 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-12439312-25dd-41cc-9aa7-16b5c6fe632e tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:43.564498 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-12439312-25dd-41cc-9aa7-16b5c6fe632e tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:43.565041 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-12439312-25dd-41cc-9aa7-16b5c6fe632e tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:43.565969 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-12439312-25dd-41cc-9aa7-16b5c6fe632e tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:43.566540 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-12439312-25dd-41cc-9aa7-16b5c6fe632e tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:43.568145 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-12439312-25dd-41cc-9aa7-16b5c6fe632e tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:43.616247 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6d9751d1-f308-4d02-9784-979bdde32205 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be647276cc456e83dacd25b98e37f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20756c1a77fb44f684973f382b802825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:43.629082 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6d9751d1-f308-4d02-9784-979bdde32205 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/f74f15ef-04b5-4313-b90f-20b96291734b" status: 200 len: 1306 microversion: 2.1 time: 0.249561 Sep 10 11:51:43.629899 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1381/2839] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:43 2022] GET /compute/v2.1/servers/f74f15ef-04b5-4313-b90f-20b96291734b => generated 1306 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:43.641047 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-26812a82-932e-40cd-b811-30bad218cce0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:43.647046 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-26812a82-932e-40cd-b811-30bad218cce0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:43.662329 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-26812a82-932e-40cd-b811-30bad218cce0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:43.663094 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-26812a82-932e-40cd-b811-30bad218cce0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:43.663871 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-26812a82-932e-40cd-b811-30bad218cce0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:43.664792 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-26812a82-932e-40cd-b811-30bad218cce0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:43.665419 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-26812a82-932e-40cd-b811-30bad218cce0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:43.666034 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-26812a82-932e-40cd-b811-30bad218cce0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:43.824458 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-26812a82-932e-40cd-b811-30bad218cce0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:43.839741 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-26812a82-932e-40cd-b811-30bad218cce0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:43.840900 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-26812a82-932e-40cd-b811-30bad218cce0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:43.847632 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-26812a82-932e-40cd-b811-30bad218cce0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1537 microversion: 2.91 time: 0.215005 Sep 10 11:51:43.864136 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1382/2840] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:43 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1537 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:51:44.107143 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-12439312-25dd-41cc-9aa7-16b5c6fe632e tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:44.116412 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-12439312-25dd-41cc-9aa7-16b5c6fe632e tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1323 microversion: 2.1 time: 0.585942 Sep 10 11:51:44.120323 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1459/2841] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:43 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1323 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:44.322615 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-eb6c2405-968c-4a4f-afd0-9903aa988ddb req-bd95e284-132d-4ba1-bfbd-5022301c162d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da5c3efa-07a9-4b8b-b258-482cecc2a0ea", "name": "network-vif-plugged", "status": "completed", "tag": "985e81bb-aeae-46fb-bc6f-b3a5e1be77f6"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:51:44.342329 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-eb6c2405-968c-4a4f-afd0-9903aa988ddb req-bd95e284-132d-4ba1-bfbd-5022301c162d service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:44.342944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-eb6c2405-968c-4a4f-afd0-9903aa988ddb req-bd95e284-132d-4ba1-bfbd-5022301c162d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:44.343306 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-eb6c2405-968c-4a4f-afd0-9903aa988ddb req-bd95e284-132d-4ba1-bfbd-5022301c162d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:44.369094 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-eb6c2405-968c-4a4f-afd0-9903aa988ddb req-bd95e284-132d-4ba1-bfbd-5022301c162d service nova] Creating event network-vif-plugged:985e81bb-aeae-46fb-bc6f-b3a5e1be77f6 for instance da5c3efa-07a9-4b8b-b258-482cecc2a0ea on n-h1-856895-1 Sep 10 11:51:44.378347 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-eb6c2405-968c-4a4f-afd0-9903aa988ddb req-bd95e284-132d-4ba1-bfbd-5022301c162d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059523 Sep 10 11:51:44.381077 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1383/2842] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:51:44.397703 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b7655fec-567e-4b3b-af65-34e8abce597f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:44.398585 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b7655fec-567e-4b3b-af65-34e8abce597f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 7c17b066-2297-4d76-adcb-abae0e87a3c2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:44.419795 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b7655fec-567e-4b3b-af65-34e8abce597f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:44.420624 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b7655fec-567e-4b3b-af65-34e8abce597f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:44.421309 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b7655fec-567e-4b3b-af65-34e8abce597f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:44.422236 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b7655fec-567e-4b3b-af65-34e8abce597f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:44.423704 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b7655fec-567e-4b3b-af65-34e8abce597f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:44.430474 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b7655fec-567e-4b3b-af65-34e8abce597f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:44.553067 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e21ddd7a-14ae-4511-85c9-9e12c00ead11 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:44.553790 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e21ddd7a-14ae-4511-85c9-9e12c00ead11 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:44.573565 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e21ddd7a-14ae-4511-85c9-9e12c00ead11 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:44.573982 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e21ddd7a-14ae-4511-85c9-9e12c00ead11 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:44.574432 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e21ddd7a-14ae-4511-85c9-9e12c00ead11 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:44.575149 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e21ddd7a-14ae-4511-85c9-9e12c00ead11 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:44.575672 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e21ddd7a-14ae-4511-85c9-9e12c00ead11 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:44.576387 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e21ddd7a-14ae-4511-85c9-9e12c00ead11 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:45.559493 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b7655fec-567e-4b3b-af65-34e8abce597f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:45.576021 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b7655fec-567e-4b3b-af65-34e8abce597f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2" status: 200 len: 1307 microversion: 2.1 time: 1.179391 Sep 10 11:51:45.578045 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1460/2843] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:44 2022] GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2 => generated 1307 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:45.590818 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bfc16bc2-c960-4d88-843a-1498ec3d8cbe tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:45.592979 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bfc16bc2-c960-4d88-843a-1498ec3d8cbe tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: f74f15ef-04b5-4313-b90f-20b96291734b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:45.628825 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bfc16bc2-c960-4d88-843a-1498ec3d8cbe tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:45.634884 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bfc16bc2-c960-4d88-843a-1498ec3d8cbe tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:45.636849 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bfc16bc2-c960-4d88-843a-1498ec3d8cbe tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:45.637877 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bfc16bc2-c960-4d88-843a-1498ec3d8cbe tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:45.640480 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bfc16bc2-c960-4d88-843a-1498ec3d8cbe tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:45.642443 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bfc16bc2-c960-4d88-843a-1498ec3d8cbe tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:45.803378 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e21ddd7a-14ae-4511-85c9-9e12c00ead11 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:45.809712 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:51:45.815103 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bfc16bc2-c960-4d88-843a-1498ec3d8cbe tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be647276cc456e83dacd25b98e37f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20756c1a77fb44f684973f382b802825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:45.831867 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e21ddd7a-14ae-4511-85c9-9e12c00ead11 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1318 microversion: 2.1 time: 1.264892 Sep 10 11:51:45.832752 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1384/2844] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:44 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1318 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:45.833829 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bfc16bc2-c960-4d88-843a-1498ec3d8cbe tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/f74f15ef-04b5-4313-b90f-20b96291734b" status: 200 len: 1306 microversion: 2.1 time: 0.252394 Sep 10 11:51:45.838201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9b573791-0acd-49bb-854a-a82a39d95298 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:45.839018 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9b573791-0acd-49bb-854a-a82a39d95298 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:45.849235 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1461/2845] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:45 2022] GET /compute/v2.1/servers/f74f15ef-04b5-4313-b90f-20b96291734b => generated 1306 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:45.859290 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9b573791-0acd-49bb-854a-a82a39d95298 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:45.860355 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9b573791-0acd-49bb-854a-a82a39d95298 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:45.861748 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9b573791-0acd-49bb-854a-a82a39d95298 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:45.861958 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-67d99983-753f-4381-b2de-039fc95e5629 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:45.862732 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-67d99983-753f-4381-b2de-039fc95e5629 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:45.872576 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-67d99983-753f-4381-b2de-039fc95e5629 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:45.873051 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9b573791-0acd-49bb-854a-a82a39d95298 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:45.873187 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-67d99983-753f-4381-b2de-039fc95e5629 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:45.873737 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-67d99983-753f-4381-b2de-039fc95e5629 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:45.874631 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-67d99983-753f-4381-b2de-039fc95e5629 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:45.875003 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9b573791-0acd-49bb-854a-a82a39d95298 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:45.875135 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-67d99983-753f-4381-b2de-039fc95e5629 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:45.876305 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9b573791-0acd-49bb-854a-a82a39d95298 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:45.877566 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-67d99983-753f-4381-b2de-039fc95e5629 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:46.039517 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9b573791-0acd-49bb-854a-a82a39d95298 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:46.051767 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9b573791-0acd-49bb-854a-a82a39d95298 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:46.054219 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9b573791-0acd-49bb-854a-a82a39d95298 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:46.062070 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9b573791-0acd-49bb-854a-a82a39d95298 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1537 microversion: 2.91 time: 0.227996 Sep 10 11:51:46.062875 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1385/2846] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:45 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1537 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:51:46.159140 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-67d99983-753f-4381-b2de-039fc95e5629 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:46.174789 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-67d99983-753f-4381-b2de-039fc95e5629 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1323 microversion: 2.1 time: 0.322893 Sep 10 11:51:46.176009 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1462/2847] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:45 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1323 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:46.458680 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-638fa45d-4012-42df-aa8f-a9986f4208ff req-cba72836-43cd-4b83-9f77-3a2746eafaaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c17b066-2297-4d76-adcb-abae0e87a3c2", "name": "network-vif-plugged", "status": "completed", "tag": "f7ecbdeb-b574-40b0-8ff5-0aed4036ed04"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:51:46.485698 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-638fa45d-4012-42df-aa8f-a9986f4208ff req-cba72836-43cd-4b83-9f77-3a2746eafaaf service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:46.486471 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-638fa45d-4012-42df-aa8f-a9986f4208ff req-cba72836-43cd-4b83-9f77-3a2746eafaaf service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:46.486929 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-638fa45d-4012-42df-aa8f-a9986f4208ff req-cba72836-43cd-4b83-9f77-3a2746eafaaf service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:46.519304 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-638fa45d-4012-42df-aa8f-a9986f4208ff req-cba72836-43cd-4b83-9f77-3a2746eafaaf service nova] Creating event network-vif-plugged:f7ecbdeb-b574-40b0-8ff5-0aed4036ed04 for instance 7c17b066-2297-4d76-adcb-abae0e87a3c2 on n-h2-856895-1 Sep 10 11:51:46.530089 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-638fa45d-4012-42df-aa8f-a9986f4208ff req-cba72836-43cd-4b83-9f77-3a2746eafaaf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075922 Sep 10 11:51:46.531339 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1386/2848] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:51:46.605396 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8975874e-cf7f-4694-b2f4-65e489e933cb tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:46.606183 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8975874e-cf7f-4694-b2f4-65e489e933cb tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 7c17b066-2297-4d76-adcb-abae0e87a3c2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:46.615904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8975874e-cf7f-4694-b2f4-65e489e933cb tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:46.616723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8975874e-cf7f-4694-b2f4-65e489e933cb tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:46.617681 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8975874e-cf7f-4694-b2f4-65e489e933cb tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:46.618611 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8975874e-cf7f-4694-b2f4-65e489e933cb tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:46.619338 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8975874e-cf7f-4694-b2f4-65e489e933cb tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:46.620061 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8975874e-cf7f-4694-b2f4-65e489e933cb tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:46.662505 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b8dee8c7-e9cb-41ac-80cd-dee709d467c5 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "0426593b-0609-4cd6-8ce1-c11d589b61db"}], "security_groups": [{"name": "tempest-securitygroup--1500928420"}], "key_name": "tempest-keypair-1668632494", "user_data": "}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:51:47.225483 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-b8dee8c7-e9cb-41ac-80cd-dee709d467c5 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] validate_networks() for [('0426593b-0609-4cd6-8ce1-c11d589b61db', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:51:47.497186 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8975874e-cf7f-4694-b2f4-65e489e933cb tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:47.506146 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8975874e-cf7f-4694-b2f4-65e489e933cb tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2" status: 200 len: 1307 microversion: 2.1 time: 0.905747 Sep 10 11:51:47.507466 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1463/2849] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:46 2022] GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2 => generated 1307 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:47.521961 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bbfc8dee-f331-44bf-9480-1bf8b94eed56 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:47.522875 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bbfc8dee-f331-44bf-9480-1bf8b94eed56 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:47.530450 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bbfc8dee-f331-44bf-9480-1bf8b94eed56 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:47.531342 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bbfc8dee-f331-44bf-9480-1bf8b94eed56 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:47.532634 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bbfc8dee-f331-44bf-9480-1bf8b94eed56 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:47.533805 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bbfc8dee-f331-44bf-9480-1bf8b94eed56 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:47.534626 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bbfc8dee-f331-44bf-9480-1bf8b94eed56 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:47.535256 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bbfc8dee-f331-44bf-9480-1bf8b94eed56 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:47.865505 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-b8dee8c7-e9cb-41ac-80cd-dee709d467c5 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:51:47.865936 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-b8dee8c7-e9cb-41ac-80cd-dee709d467c5 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:51:47.866636 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-b8dee8c7-e9cb-41ac-80cd-dee709d467c5 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:51:47.867254 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-b8dee8c7-e9cb-41ac-80cd-dee709d467c5 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:51:47.867864 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-b8dee8c7-e9cb-41ac-80cd-dee709d467c5 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:51:47.885556 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8dee8c7-e9cb-41ac-80cd-dee709d467c5 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:47.886238 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8dee8c7-e9cb-41ac-80cd-dee709d467c5 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:47.886847 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8dee8c7-e9cb-41ac-80cd-dee709d467c5 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:47.890258 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8dee8c7-e9cb-41ac-80cd-dee709d467c5 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:47.890976 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8dee8c7-e9cb-41ac-80cd-dee709d467c5 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:47.892345 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8dee8c7-e9cb-41ac-80cd-dee709d467c5 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:47.927819 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bbfc8dee-f331-44bf-9480-1bf8b94eed56 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:47.931783 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-b8dee8c7-e9cb-41ac-80cd-dee709d467c5 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Getting quotas for project 926d7fd11fb84c86b66362074c1ca8a7. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:51:47.937590 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-b8dee8c7-e9cb-41ac-80cd-dee709d467c5 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Getting quotas for user d5d0aaa7b7a34bb4bcea483bb41276aa and project 926d7fd11fb84c86b66362074c1ca8a7. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:51:47.943835 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bbfc8dee-f331-44bf-9480-1bf8b94eed56 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1318 microversion: 2.1 time: 0.434843 Sep 10 11:51:47.944656 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1464/2850] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:47 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1318 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:47.952098 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b8dee8c7-e9cb-41ac-80cd-dee709d467c5 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:51:47.955585 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b8dee8c7-e9cb-41ac-80cd-dee709d467c5 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] [instance: 402b5cd2-03cd-4c59-b1fb-757b8c03b3e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:51:47.963385 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3bf15ed6-4f6d-409a-b08f-05b8a666c1d3 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:47.964105 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3bf15ed6-4f6d-409a-b08f-05b8a666c1d3 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: f74f15ef-04b5-4313-b90f-20b96291734b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:47.985930 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3bf15ed6-4f6d-409a-b08f-05b8a666c1d3 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:47.990877 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3bf15ed6-4f6d-409a-b08f-05b8a666c1d3 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:47.991399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3bf15ed6-4f6d-409a-b08f-05b8a666c1d3 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:47.992301 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3bf15ed6-4f6d-409a-b08f-05b8a666c1d3 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:47.992767 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3bf15ed6-4f6d-409a-b08f-05b8a666c1d3 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:47.993201 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3bf15ed6-4f6d-409a-b08f-05b8a666c1d3 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:48.058758 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b8dee8c7-e9cb-41ac-80cd-dee709d467c5 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.402575 Sep 10 11:51:48.059539 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1387/2851] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:51:46 2022] POST /compute/v2.1/servers => generated 409 bytes in 1404 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:51:48.068793 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1f8da696-a82e-4350-a196-c7b01dfc4351 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:48.071603 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1f8da696-a82e-4350-a196-c7b01dfc4351 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:48.091861 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f8da696-a82e-4350-a196-c7b01dfc4351 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:48.097765 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f8da696-a82e-4350-a196-c7b01dfc4351 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:48.098449 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f8da696-a82e-4350-a196-c7b01dfc4351 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:48.104476 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f8da696-a82e-4350-a196-c7b01dfc4351 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:48.105192 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f8da696-a82e-4350-a196-c7b01dfc4351 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:48.105829 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f8da696-a82e-4350-a196-c7b01dfc4351 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:48.415681 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1f8da696-a82e-4350-a196-c7b01dfc4351 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:48.434634 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1f8da696-a82e-4350-a196-c7b01dfc4351 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:48.436562 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1f8da696-a82e-4350-a196-c7b01dfc4351 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:48.452152 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1f8da696-a82e-4350-a196-c7b01dfc4351 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1537 microversion: 2.91 time: 0.391214 Sep 10 11:51:48.468067 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1388/2852] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:48 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1537 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:51:48.468067 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-71463122-77c2-4a44-a439-27de9156b65c tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:48.468067 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-71463122-77c2-4a44-a439-27de9156b65c tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:48.484108 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-71463122-77c2-4a44-a439-27de9156b65c tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:48.484526 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-71463122-77c2-4a44-a439-27de9156b65c tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:48.484974 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-71463122-77c2-4a44-a439-27de9156b65c tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:48.486437 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-71463122-77c2-4a44-a439-27de9156b65c tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:48.486975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-71463122-77c2-4a44-a439-27de9156b65c tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:48.517301 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-71463122-77c2-4a44-a439-27de9156b65c tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:48.650170 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3bf15ed6-4f6d-409a-b08f-05b8a666c1d3 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be647276cc456e83dacd25b98e37f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20756c1a77fb44f684973f382b802825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:48.667707 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3bf15ed6-4f6d-409a-b08f-05b8a666c1d3 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/f74f15ef-04b5-4313-b90f-20b96291734b" status: 200 len: 1373 microversion: 2.1 time: 0.713375 Sep 10 11:51:48.668630 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1465/2853] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:47 2022] GET /compute/v2.1/servers/f74f15ef-04b5-4313-b90f-20b96291734b => generated 1373 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:48.687727 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7c4794ba-8a2b-4643-9f17-c44b3984bfa5 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:48.688365 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7c4794ba-8a2b-4643-9f17-c44b3984bfa5 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] [instance: 402b5cd2-03cd-4c59-b1fb-757b8c03b3e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:48.893420 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7c4794ba-8a2b-4643-9f17-c44b3984bfa5 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d0aaa7b7a34bb4bcea483bb41276aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d7fd11fb84c86b66362074c1ca8a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:48.901696 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7c4794ba-8a2b-4643-9f17-c44b3984bfa5 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] 10.222.0.23 "GET /compute/v2.1/servers/402b5cd2-03cd-4c59-b1fb-757b8c03b3e2" status: 200 len: 1226 microversion: 2.1 time: 0.231637 Sep 10 11:51:48.926213 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1466/2854] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:48 2022] GET /compute/v2.1/servers/402b5cd2-03cd-4c59-b1fb-757b8c03b3e2 => generated 1226 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:48.931659 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-fa7db59f-f914-4c63-a31a-f6fbaa733509 req-fb3c5667-dfc5-40f5-a382-a7b7de94f398 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f74f15ef-04b5-4313-b90f-20b96291734b", "tag": "db9651b2-3db5-4e9b-9153-56055a48ba72"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:51:48.955199 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-fa7db59f-f914-4c63-a31a-f6fbaa733509 req-fb3c5667-dfc5-40f5-a382-a7b7de94f398 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:48.960444 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-fa7db59f-f914-4c63-a31a-f6fbaa733509 req-fb3c5667-dfc5-40f5-a382-a7b7de94f398 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:48.960973 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-fa7db59f-f914-4c63-a31a-f6fbaa733509 req-fb3c5667-dfc5-40f5-a382-a7b7de94f398 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:48.985484 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-71463122-77c2-4a44-a439-27de9156b65c tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:49.005936 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-71463122-77c2-4a44-a439-27de9156b65c tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1518 microversion: 2.1 time: 0.551213 Sep 10 11:51:49.008838 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1389/2855] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:48 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1518 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:49.011125 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-fa7db59f-f914-4c63-a31a-f6fbaa733509 req-fb3c5667-dfc5-40f5-a382-a7b7de94f398 service nova] Creating event network-changed:db9651b2-3db5-4e9b-9153-56055a48ba72 for instance f74f15ef-04b5-4313-b90f-20b96291734b on n-h2-856895-1 Sep 10 11:51:49.018853 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0ae3aa10-727a-4726-86f4-f6b5e7b48871 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:49.026897 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-fa7db59f-f914-4c63-a31a-f6fbaa733509 req-fb3c5667-dfc5-40f5-a382-a7b7de94f398 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099116 Sep 10 11:51:49.028757 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0ae3aa10-727a-4726-86f4-f6b5e7b48871 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 7c17b066-2297-4d76-adcb-abae0e87a3c2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:49.032929 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1467/2856] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:51:49.054210 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ae3aa10-727a-4726-86f4-f6b5e7b48871 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:49.054637 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-8dada466-6388-4034-9e0e-dad4f9216026 req-2d7548e7-ae17-421d-9649-856254e89347 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4cf27c4-4cda-46f0-94b9-f862994d2071", "name": "network-vif-plugged", "status": "completed", "tag": "98552666-f390-4515-b1a3-d6bf538fb04c"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:51:49.060884 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ae3aa10-727a-4726-86f4-f6b5e7b48871 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:49.061604 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ae3aa10-727a-4726-86f4-f6b5e7b48871 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:49.062451 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ae3aa10-727a-4726-86f4-f6b5e7b48871 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:49.063762 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ae3aa10-727a-4726-86f4-f6b5e7b48871 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:49.064309 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ae3aa10-727a-4726-86f4-f6b5e7b48871 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:49.081902 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8dada466-6388-4034-9e0e-dad4f9216026 req-2d7548e7-ae17-421d-9649-856254e89347 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:49.082605 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8dada466-6388-4034-9e0e-dad4f9216026 req-2d7548e7-ae17-421d-9649-856254e89347 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:49.083395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8dada466-6388-4034-9e0e-dad4f9216026 req-2d7548e7-ae17-421d-9649-856254e89347 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:49.120804 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-8dada466-6388-4034-9e0e-dad4f9216026 req-2d7548e7-ae17-421d-9649-856254e89347 service nova] Creating event network-vif-plugged:98552666-f390-4515-b1a3-d6bf538fb04c for instance d4cf27c4-4cda-46f0-94b9-f862994d2071 on n-h1-856895-1 Sep 10 11:51:49.129932 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-8dada466-6388-4034-9e0e-dad4f9216026 req-2d7548e7-ae17-421d-9649-856254e89347 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093269 Sep 10 11:51:49.134882 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1468/2857] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:51:49.143282 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b45252df-6010-4a10-8f7c-5422d910aa25 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:49.144209 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b45252df-6010-4a10-8f7c-5422d910aa25 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:49.154426 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b45252df-6010-4a10-8f7c-5422d910aa25 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:49.155604 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b45252df-6010-4a10-8f7c-5422d910aa25 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:49.156477 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b45252df-6010-4a10-8f7c-5422d910aa25 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:49.157461 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b45252df-6010-4a10-8f7c-5422d910aa25 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:49.158215 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b45252df-6010-4a10-8f7c-5422d910aa25 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:49.158836 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b45252df-6010-4a10-8f7c-5422d910aa25 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:49.554899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0ae3aa10-727a-4726-86f4-f6b5e7b48871 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:49.565682 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0ae3aa10-727a-4726-86f4-f6b5e7b48871 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2" status: 200 len: 1487 microversion: 2.1 time: 0.553229 Sep 10 11:51:49.566350 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1390/2858] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:49 2022] GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2 => generated 1487 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:49.572098 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-958bfde4-7682-4eb4-8480-7e04685e4853 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:51:49.574709 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-958bfde4-7682-4eb4-8480-7e04685e4853 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:49.580884 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:51:49.583472 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-958bfde4-7682-4eb4-8480-7e04685e4853 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:49.584148 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-958bfde4-7682-4eb4-8480-7e04685e4853 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:49.584863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-958bfde4-7682-4eb4-8480-7e04685e4853 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:49.586197 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-958bfde4-7682-4eb4-8480-7e04685e4853 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:49.586886 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-958bfde4-7682-4eb4-8480-7e04685e4853 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:49.587872 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-958bfde4-7682-4eb4-8480-7e04685e4853 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:49.610647 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b45252df-6010-4a10-8f7c-5422d910aa25 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:49.622273 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b45252df-6010-4a10-8f7c-5422d910aa25 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1318 microversion: 2.1 time: 0.485840 Sep 10 11:51:49.622459 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-958bfde4-7682-4eb4-8480-7e04685e4853 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lazy-loading 'flavor' on Instance uuid da5c3efa-07a9-4b8b-b258-482cecc2a0ea {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:51:49.626484 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1469/2859] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:49 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1318 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:49.652908 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e09738b1-39ee-4fe3-9d7b-2a14b5d3a475 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:49.653721 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e09738b1-39ee-4fe3-9d7b-2a14b5d3a475 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:49.660906 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e09738b1-39ee-4fe3-9d7b-2a14b5d3a475 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:49.661705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e09738b1-39ee-4fe3-9d7b-2a14b5d3a475 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:49.662348 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e09738b1-39ee-4fe3-9d7b-2a14b5d3a475 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:49.663148 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e09738b1-39ee-4fe3-9d7b-2a14b5d3a475 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:49.663559 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e09738b1-39ee-4fe3-9d7b-2a14b5d3a475 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:49.663992 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e09738b1-39ee-4fe3-9d7b-2a14b5d3a475 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:49.724209 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-958bfde4-7682-4eb4-8480-7e04685e4853 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "POST /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea/action" status: 200 len: 32 microversion: 2.1 time: 0.156435 Sep 10 11:51:49.725253 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1391/2860] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:51:49 2022] POST /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea/action => generated 32 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:51:49.731627 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-af5308fe-790d-48d2-8ec6-bb1a31452824 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:51:49.749944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af5308fe-790d-48d2-8ec6-bb1a31452824 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:49.750810 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af5308fe-790d-48d2-8ec6-bb1a31452824 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:49.751672 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af5308fe-790d-48d2-8ec6-bb1a31452824 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:49.790022 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e09738b1-39ee-4fe3-9d7b-2a14b5d3a475 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:49.812783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e09738b1-39ee-4fe3-9d7b-2a14b5d3a475 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:49.814766 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e09738b1-39ee-4fe3-9d7b-2a14b5d3a475 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:49.823146 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e09738b1-39ee-4fe3-9d7b-2a14b5d3a475 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1537 microversion: 2.91 time: 0.195580 Sep 10 11:51:49.839393 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1470/2861] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:49 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1537 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:51:49.839589 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-af5308fe-790d-48d2-8ec6-bb1a31452824 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 7c17b066-2297-4d76-adcb-abae0e87a3c2] Going to try to stop instance {{(pid=128776) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 10 11:51:49.839698 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-efb2bc38-661c-4faa-a6fc-77e4a144db54 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:49.839698 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-efb2bc38-661c-4faa-a6fc-77e4a144db54 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: f74f15ef-04b5-4313-b90f-20b96291734b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:49.839698 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-efb2bc38-661c-4faa-a6fc-77e4a144db54 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:49.839698 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-efb2bc38-661c-4faa-a6fc-77e4a144db54 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:49.839698 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-efb2bc38-661c-4faa-a6fc-77e4a144db54 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:49.839698 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-efb2bc38-661c-4faa-a6fc-77e4a144db54 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:49.839698 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-efb2bc38-661c-4faa-a6fc-77e4a144db54 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:49.840324 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-efb2bc38-661c-4faa-a6fc-77e4a144db54 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:49.921862 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-af5308fe-790d-48d2-8ec6-bb1a31452824 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "POST /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2/action" status: 202 len: 0 microversion: 2.1 time: 0.192525 Sep 10 11:51:49.925604 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1392/2862] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:51:49 2022] POST /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:51:49.932132 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0920424e-e5e8-4fa4-aeae-f04cb69ad644 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:49.932982 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0920424e-e5e8-4fa4-aeae-f04cb69ad644 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:49.939997 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0920424e-e5e8-4fa4-aeae-f04cb69ad644 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:49.940494 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0920424e-e5e8-4fa4-aeae-f04cb69ad644 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:49.940915 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0920424e-e5e8-4fa4-aeae-f04cb69ad644 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:49.941931 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0920424e-e5e8-4fa4-aeae-f04cb69ad644 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:49.942400 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0920424e-e5e8-4fa4-aeae-f04cb69ad644 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:49.942825 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0920424e-e5e8-4fa4-aeae-f04cb69ad644 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:50.074732 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-efb2bc38-661c-4faa-a6fc-77e4a144db54 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be647276cc456e83dacd25b98e37f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20756c1a77fb44f684973f382b802825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:50.083345 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-efb2bc38-661c-4faa-a6fc-77e4a144db54 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/f74f15ef-04b5-4313-b90f-20b96291734b" status: 200 len: 1373 microversion: 2.1 time: 0.257843 Sep 10 11:51:50.084483 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1471/2863] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:49 2022] GET /compute/v2.1/servers/f74f15ef-04b5-4313-b90f-20b96291734b => generated 1373 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:50.090822 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0943f2ec-3c97-4a9b-a55f-6f4f42d2318c tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:50.091693 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0943f2ec-3c97-4a9b-a55f-6f4f42d2318c tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] [instance: 402b5cd2-03cd-4c59-b1fb-757b8c03b3e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:50.099001 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0943f2ec-3c97-4a9b-a55f-6f4f42d2318c tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:50.099764 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0943f2ec-3c97-4a9b-a55f-6f4f42d2318c tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:50.100893 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0943f2ec-3c97-4a9b-a55f-6f4f42d2318c tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:50.101929 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0943f2ec-3c97-4a9b-a55f-6f4f42d2318c tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:50.102666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0943f2ec-3c97-4a9b-a55f-6f4f42d2318c tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:50.103325 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0943f2ec-3c97-4a9b-a55f-6f4f42d2318c tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:50.149057 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0920424e-e5e8-4fa4-aeae-f04cb69ad644 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:50.158879 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0920424e-e5e8-4fa4-aeae-f04cb69ad644 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1524 microversion: 2.1 time: 0.231837 Sep 10 11:51:50.159801 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1393/2864] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:49 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1524 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:50.164783 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3577d4c9-ecc1-40f2-8d7e-78f4d9369518 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:50.165393 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3577d4c9-ecc1-40f2-8d7e-78f4d9369518 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 7c17b066-2297-4d76-adcb-abae0e87a3c2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:50.185614 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3577d4c9-ecc1-40f2-8d7e-78f4d9369518 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:50.186111 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3577d4c9-ecc1-40f2-8d7e-78f4d9369518 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:50.186689 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3577d4c9-ecc1-40f2-8d7e-78f4d9369518 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:50.187490 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3577d4c9-ecc1-40f2-8d7e-78f4d9369518 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:50.188206 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3577d4c9-ecc1-40f2-8d7e-78f4d9369518 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:50.189423 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3577d4c9-ecc1-40f2-8d7e-78f4d9369518 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:50.208482 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0943f2ec-3c97-4a9b-a55f-6f4f42d2318c tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d0aaa7b7a34bb4bcea483bb41276aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d7fd11fb84c86b66362074c1ca8a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:50.217590 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0943f2ec-3c97-4a9b-a55f-6f4f42d2318c tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] 10.222.0.23 "GET /compute/v2.1/servers/402b5cd2-03cd-4c59-b1fb-757b8c03b3e2" status: 200 len: 1278 microversion: 2.1 time: 0.131836 Sep 10 11:51:50.218745 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1472/2865] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:50 2022] GET /compute/v2.1/servers/402b5cd2-03cd-4c59-b1fb-757b8c03b3e2 => generated 1278 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:50.341476 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3577d4c9-ecc1-40f2-8d7e-78f4d9369518 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:50.351584 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3577d4c9-ecc1-40f2-8d7e-78f4d9369518 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2" status: 200 len: 1497 microversion: 2.1 time: 0.190332 Sep 10 11:51:50.353311 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1394/2866] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:50 2022] GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2 => generated 1497 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:50.651138 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ccf7121d-4e01-47e5-967b-7da44a92aada tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:50.651712 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ccf7121d-4e01-47e5-967b-7da44a92aada tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:50.662590 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ccf7121d-4e01-47e5-967b-7da44a92aada tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:50.663368 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ccf7121d-4e01-47e5-967b-7da44a92aada tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:50.665817 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ccf7121d-4e01-47e5-967b-7da44a92aada tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:50.667449 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ccf7121d-4e01-47e5-967b-7da44a92aada tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:50.668690 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ccf7121d-4e01-47e5-967b-7da44a92aada tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:50.670467 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ccf7121d-4e01-47e5-967b-7da44a92aada tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:50.856535 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:51:50.858557 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-857dfaa6-f2e9-40f9-9133-6bcdfdcdc34d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:50.859231 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-857dfaa6-f2e9-40f9-9133-6bcdfdcdc34d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:50.875833 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-857dfaa6-f2e9-40f9-9133-6bcdfdcdc34d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:50.878363 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-857dfaa6-f2e9-40f9-9133-6bcdfdcdc34d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:50.881137 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-857dfaa6-f2e9-40f9-9133-6bcdfdcdc34d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:50.884684 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-857dfaa6-f2e9-40f9-9133-6bcdfdcdc34d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:50.886065 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-857dfaa6-f2e9-40f9-9133-6bcdfdcdc34d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:50.888671 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-857dfaa6-f2e9-40f9-9133-6bcdfdcdc34d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:51.042608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-857dfaa6-f2e9-40f9-9133-6bcdfdcdc34d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:51.054874 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-857dfaa6-f2e9-40f9-9133-6bcdfdcdc34d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:51.059776 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-857dfaa6-f2e9-40f9-9133-6bcdfdcdc34d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:51.067691 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ccf7121d-4e01-47e5-967b-7da44a92aada tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:51.076759 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-857dfaa6-f2e9-40f9-9133-6bcdfdcdc34d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1537 microversion: 2.91 time: 0.222053 Sep 10 11:51:51.077782 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1395/2867] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:50 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1537 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:51:51.091715 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ccf7121d-4e01-47e5-967b-7da44a92aada tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1318 microversion: 2.1 time: 0.443430 Sep 10 11:51:51.095526 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1473/2868] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:50 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1318 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:51.120961 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f15e337c-e27b-44f7-a671-57120ee70e67 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:51.121691 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f15e337c-e27b-44f7-a671-57120ee70e67 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: f74f15ef-04b5-4313-b90f-20b96291734b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:51.137719 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f15e337c-e27b-44f7-a671-57120ee70e67 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:51.138629 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f15e337c-e27b-44f7-a671-57120ee70e67 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:51.139079 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f15e337c-e27b-44f7-a671-57120ee70e67 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:51.139825 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f15e337c-e27b-44f7-a671-57120ee70e67 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:51.140285 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f15e337c-e27b-44f7-a671-57120ee70e67 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:51.140713 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f15e337c-e27b-44f7-a671-57120ee70e67 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:51.182483 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0b8fb7d7-6589-422a-bdad-fc1773a86f05 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:51.183810 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0b8fb7d7-6589-422a-bdad-fc1773a86f05 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:51.202659 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0b8fb7d7-6589-422a-bdad-fc1773a86f05 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:51.203647 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0b8fb7d7-6589-422a-bdad-fc1773a86f05 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:51.206976 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0b8fb7d7-6589-422a-bdad-fc1773a86f05 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:51.209997 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0b8fb7d7-6589-422a-bdad-fc1773a86f05 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:51.212544 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0b8fb7d7-6589-422a-bdad-fc1773a86f05 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:51.213290 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0b8fb7d7-6589-422a-bdad-fc1773a86f05 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:51.459813 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f15e337c-e27b-44f7-a671-57120ee70e67 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be647276cc456e83dacd25b98e37f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20756c1a77fb44f684973f382b802825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:51.470011 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f15e337c-e27b-44f7-a671-57120ee70e67 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/f74f15ef-04b5-4313-b90f-20b96291734b" status: 200 len: 1373 microversion: 2.1 time: 0.361414 Sep 10 11:51:51.498588 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1396/2869] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:51 2022] GET /compute/v2.1/servers/f74f15ef-04b5-4313-b90f-20b96291734b => generated 1373 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:51.528302 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ec2a15c2-e72e-4238-864f-c542fef0bc28 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:51.532037 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ec2a15c2-e72e-4238-864f-c542fef0bc28 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] [instance: 402b5cd2-03cd-4c59-b1fb-757b8c03b3e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:51.554781 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec2a15c2-e72e-4238-864f-c542fef0bc28 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:51.555230 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec2a15c2-e72e-4238-864f-c542fef0bc28 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:51.556669 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec2a15c2-e72e-4238-864f-c542fef0bc28 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:51.557975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec2a15c2-e72e-4238-864f-c542fef0bc28 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:51.558449 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec2a15c2-e72e-4238-864f-c542fef0bc28 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:51.558880 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec2a15c2-e72e-4238-864f-c542fef0bc28 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:51.569908 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0b8fb7d7-6589-422a-bdad-fc1773a86f05 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:51.572390 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=100 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:51:51.582165 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0b8fb7d7-6589-422a-bdad-fc1773a86f05 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1524 microversion: 2.1 time: 0.404023 Sep 10 11:51:51.583307 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1474/2870] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:51 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1524 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:51.588716 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-69585706-4ffb-4092-bcb2-b820923d3f9c tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:51.589570 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-69585706-4ffb-4092-bcb2-b820923d3f9c tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 7c17b066-2297-4d76-adcb-abae0e87a3c2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:51.597833 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-69585706-4ffb-4092-bcb2-b820923d3f9c tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:51.598716 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-69585706-4ffb-4092-bcb2-b820923d3f9c tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:51.600233 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-69585706-4ffb-4092-bcb2-b820923d3f9c tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:51.601264 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-69585706-4ffb-4092-bcb2-b820923d3f9c tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:51.602234 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-69585706-4ffb-4092-bcb2-b820923d3f9c tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:51.603229 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-69585706-4ffb-4092-bcb2-b820923d3f9c tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:51.802440 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ec2a15c2-e72e-4238-864f-c542fef0bc28 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d0aaa7b7a34bb4bcea483bb41276aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d7fd11fb84c86b66362074c1ca8a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:51.816706 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ec2a15c2-e72e-4238-864f-c542fef0bc28 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] 10.222.0.23 "GET /compute/v2.1/servers/402b5cd2-03cd-4c59-b1fb-757b8c03b3e2" status: 200 len: 1284 microversion: 2.1 time: 0.316512 Sep 10 11:51:51.818131 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1397/2871] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:51 2022] GET /compute/v2.1/servers/402b5cd2-03cd-4c59-b1fb-757b8c03b3e2 => generated 1284 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:52.114045 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e69826c8-a46e-4668-8cb7-716e5631089a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:52.115963 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e69826c8-a46e-4668-8cb7-716e5631089a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:52.123647 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-69585706-4ffb-4092-bcb2-b820923d3f9c tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:52.128951 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e69826c8-a46e-4668-8cb7-716e5631089a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:52.129464 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e69826c8-a46e-4668-8cb7-716e5631089a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:52.129908 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e69826c8-a46e-4668-8cb7-716e5631089a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:52.131657 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e69826c8-a46e-4668-8cb7-716e5631089a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:52.132401 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e69826c8-a46e-4668-8cb7-716e5631089a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:52.132992 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e69826c8-a46e-4668-8cb7-716e5631089a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:52.138762 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-69585706-4ffb-4092-bcb2-b820923d3f9c tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2" status: 200 len: 1497 microversion: 2.1 time: 0.554034 Sep 10 11:51:52.151806 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1475/2872] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:51 2022] GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2 => generated 1497 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:52.162890 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-300aa36b-f7f7-42db-a125-2bec91cbeaf3 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:52.163729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-300aa36b-f7f7-42db-a125-2bec91cbeaf3 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:52.170229 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-300aa36b-f7f7-42db-a125-2bec91cbeaf3 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:52.170951 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-300aa36b-f7f7-42db-a125-2bec91cbeaf3 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:52.171612 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-300aa36b-f7f7-42db-a125-2bec91cbeaf3 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:52.172517 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-300aa36b-f7f7-42db-a125-2bec91cbeaf3 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:52.173390 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-300aa36b-f7f7-42db-a125-2bec91cbeaf3 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:52.174172 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-300aa36b-f7f7-42db-a125-2bec91cbeaf3 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:52.232004 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e69826c8-a46e-4668-8cb7-716e5631089a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:52.242807 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e69826c8-a46e-4668-8cb7-716e5631089a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:52.244617 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e69826c8-a46e-4668-8cb7-716e5631089a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:52.250633 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e69826c8-a46e-4668-8cb7-716e5631089a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1537 microversion: 2.91 time: 0.142707 Sep 10 11:51:52.251288 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1398/2873] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:52 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1537 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:51:52.425295 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-300aa36b-f7f7-42db-a125-2bec91cbeaf3 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:52.434970 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-300aa36b-f7f7-42db-a125-2bec91cbeaf3 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1509 microversion: 2.1 time: 0.281759 Sep 10 11:51:52.451186 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1476/2874] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:52 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1509 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:52.459738 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8820aec6-fb0b-4c1c-b084-ebd39fda070c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:52.460560 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8820aec6-fb0b-4c1c-b084-ebd39fda070c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:52.469122 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8820aec6-fb0b-4c1c-b084-ebd39fda070c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:52.469638 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8820aec6-fb0b-4c1c-b084-ebd39fda070c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:52.470310 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8820aec6-fb0b-4c1c-b084-ebd39fda070c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:52.471536 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8820aec6-fb0b-4c1c-b084-ebd39fda070c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:52.472153 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8820aec6-fb0b-4c1c-b084-ebd39fda070c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:52.472736 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8820aec6-fb0b-4c1c-b084-ebd39fda070c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:52.508182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d5f2302d-57f1-47c2-8f8b-d1b180c4ebcc tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:52.509103 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d5f2302d-57f1-47c2-8f8b-d1b180c4ebcc tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: f74f15ef-04b5-4313-b90f-20b96291734b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:52.516232 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d5f2302d-57f1-47c2-8f8b-d1b180c4ebcc tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:52.516866 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d5f2302d-57f1-47c2-8f8b-d1b180c4ebcc tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:52.517712 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d5f2302d-57f1-47c2-8f8b-d1b180c4ebcc tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:52.518507 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d5f2302d-57f1-47c2-8f8b-d1b180c4ebcc tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:52.519250 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d5f2302d-57f1-47c2-8f8b-d1b180c4ebcc tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:52.519884 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d5f2302d-57f1-47c2-8f8b-d1b180c4ebcc tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:52.756130 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8820aec6-fb0b-4c1c-b084-ebd39fda070c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:52.760216 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:51:52.761136 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d5f2302d-57f1-47c2-8f8b-d1b180c4ebcc tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be647276cc456e83dacd25b98e37f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20756c1a77fb44f684973f382b802825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:52.766042 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8820aec6-fb0b-4c1c-b084-ebd39fda070c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1509 microversion: 2.1 time: 0.311171 Sep 10 11:51:52.767141 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1399/2875] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:52 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1509 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:52.772861 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-eb202dc6-614c-4aac-a8fb-fc5451d30e24 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:52.773606 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-eb202dc6-614c-4aac-a8fb-fc5451d30e24 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:52.787040 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d5f2302d-57f1-47c2-8f8b-d1b180c4ebcc tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/f74f15ef-04b5-4313-b90f-20b96291734b" status: 200 len: 1373 microversion: 2.1 time: 0.284552 Sep 10 11:51:52.790147 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1477/2876] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:52 2022] GET /compute/v2.1/servers/f74f15ef-04b5-4313-b90f-20b96291734b => generated 1373 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:51:52.791852 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eb202dc6-614c-4aac-a8fb-fc5451d30e24 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:52.792355 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eb202dc6-614c-4aac-a8fb-fc5451d30e24 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:52.792797 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eb202dc6-614c-4aac-a8fb-fc5451d30e24 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:52.793563 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eb202dc6-614c-4aac-a8fb-fc5451d30e24 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:52.794040 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eb202dc6-614c-4aac-a8fb-fc5451d30e24 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:52.800003 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eb202dc6-614c-4aac-a8fb-fc5451d30e24 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:52.800467 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cf826457-d3c3-4fe9-81dc-93793fe17a2d tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:51:52.804039 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cf826457-d3c3-4fe9-81dc-93793fe17a2d tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:52.810492 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cf826457-d3c3-4fe9-81dc-93793fe17a2d tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:52.811324 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cf826457-d3c3-4fe9-81dc-93793fe17a2d tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:52.811964 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cf826457-d3c3-4fe9-81dc-93793fe17a2d tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:52.812830 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cf826457-d3c3-4fe9-81dc-93793fe17a2d tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:52.813492 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cf826457-d3c3-4fe9-81dc-93793fe17a2d tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:52.814077 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cf826457-d3c3-4fe9-81dc-93793fe17a2d tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:52.890102 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cf826457-d3c3-4fe9-81dc-93793fe17a2d tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "PUT /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1081 microversion: 2.1 time: 0.098744 Sep 10 11:51:52.890833 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1478/2877] 10.222.0.23 () {60 vars in 1256 bytes} [Sat Sep 10 11:51:52 2022] PUT /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1081 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:52.896498 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5afdffcc-01ec-483b-ad0d-d5de99116963 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:52.897303 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5afdffcc-01ec-483b-ad0d-d5de99116963 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] [instance: 402b5cd2-03cd-4c59-b1fb-757b8c03b3e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:52.904078 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5afdffcc-01ec-483b-ad0d-d5de99116963 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:52.905233 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5afdffcc-01ec-483b-ad0d-d5de99116963 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:52.905673 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5afdffcc-01ec-483b-ad0d-d5de99116963 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:52.906576 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5afdffcc-01ec-483b-ad0d-d5de99116963 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:52.907765 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5afdffcc-01ec-483b-ad0d-d5de99116963 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:52.908802 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5afdffcc-01ec-483b-ad0d-d5de99116963 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:52.948145 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-eb202dc6-614c-4aac-a8fb-fc5451d30e24 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:52.957989 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-eb202dc6-614c-4aac-a8fb-fc5451d30e24 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1524 microversion: 2.1 time: 0.189189 Sep 10 11:51:52.964772 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1400/2878] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:52 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1524 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:52.964772 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e48acfcc-c2d7-4099-a4b8-80f5c17e8704 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:52.964772 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e48acfcc-c2d7-4099-a4b8-80f5c17e8704 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:52.971556 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e48acfcc-c2d7-4099-a4b8-80f5c17e8704 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:52.972059 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e48acfcc-c2d7-4099-a4b8-80f5c17e8704 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:52.972504 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e48acfcc-c2d7-4099-a4b8-80f5c17e8704 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:52.973278 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e48acfcc-c2d7-4099-a4b8-80f5c17e8704 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:52.973744 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e48acfcc-c2d7-4099-a4b8-80f5c17e8704 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:52.974178 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e48acfcc-c2d7-4099-a4b8-80f5c17e8704 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:53.136540 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5afdffcc-01ec-483b-ad0d-d5de99116963 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d0aaa7b7a34bb4bcea483bb41276aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d7fd11fb84c86b66362074c1ca8a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:53.149607 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5afdffcc-01ec-483b-ad0d-d5de99116963 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] 10.222.0.23 "GET /compute/v2.1/servers/402b5cd2-03cd-4c59-b1fb-757b8c03b3e2" status: 200 len: 1352 microversion: 2.1 time: 0.256923 Sep 10 11:51:53.150282 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1479/2879] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:52 2022] GET /compute/v2.1/servers/402b5cd2-03cd-4c59-b1fb-757b8c03b3e2 => generated 1352 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:53.168651 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1182443b-3dca-41ad-98ec-a1f7f884c879 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:53.169412 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1182443b-3dca-41ad-98ec-a1f7f884c879 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 7c17b066-2297-4d76-adcb-abae0e87a3c2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:53.177678 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e48acfcc-c2d7-4099-a4b8-80f5c17e8704 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:53.178738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1182443b-3dca-41ad-98ec-a1f7f884c879 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:53.179374 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1182443b-3dca-41ad-98ec-a1f7f884c879 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:53.180155 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1182443b-3dca-41ad-98ec-a1f7f884c879 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:53.180968 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1182443b-3dca-41ad-98ec-a1f7f884c879 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:53.181548 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1182443b-3dca-41ad-98ec-a1f7f884c879 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:53.182222 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1182443b-3dca-41ad-98ec-a1f7f884c879 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:53.189503 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e48acfcc-c2d7-4099-a4b8-80f5c17e8704 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1507 microversion: 2.1 time: 0.228997 Sep 10 11:51:53.190194 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1401/2880] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:52 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1507 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:53.217927 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d618867c-4199-46aa-b2e9-9f3bc8127f20 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:53.218944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d618867c-4199-46aa-b2e9-9f3bc8127f20 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:53.229699 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d618867c-4199-46aa-b2e9-9f3bc8127f20 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:53.230366 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d618867c-4199-46aa-b2e9-9f3bc8127f20 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:53.231264 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d618867c-4199-46aa-b2e9-9f3bc8127f20 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:53.232683 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d618867c-4199-46aa-b2e9-9f3bc8127f20 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:53.233322 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d618867c-4199-46aa-b2e9-9f3bc8127f20 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:53.234059 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d618867c-4199-46aa-b2e9-9f3bc8127f20 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:53.429509 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1182443b-3dca-41ad-98ec-a1f7f884c879 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:53.441163 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1182443b-3dca-41ad-98ec-a1f7f884c879 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2" status: 200 len: 1497 microversion: 2.1 time: 0.276450 Sep 10 11:51:53.455239 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1480/2881] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:53 2022] GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2 => generated 1497 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:51:53.455239 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-dfa06e52-83fd-4427-bf7e-c573520d3b02 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:53.455239 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-dfa06e52-83fd-4427-bf7e-c573520d3b02 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:53.465152 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dfa06e52-83fd-4427-bf7e-c573520d3b02 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:53.467065 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dfa06e52-83fd-4427-bf7e-c573520d3b02 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:53.467996 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dfa06e52-83fd-4427-bf7e-c573520d3b02 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:53.468877 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dfa06e52-83fd-4427-bf7e-c573520d3b02 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:53.470133 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dfa06e52-83fd-4427-bf7e-c573520d3b02 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:53.470727 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dfa06e52-83fd-4427-bf7e-c573520d3b02 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:53.493945 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d618867c-4199-46aa-b2e9-9f3bc8127f20 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:53.503134 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d618867c-4199-46aa-b2e9-9f3bc8127f20 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1507 microversion: 2.1 time: 0.290037 Sep 10 11:51:53.517795 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1402/2882] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:53 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1507 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:53.527851 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ac5da941-08dc-4491-8fd7-53d60641d8b5 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:51:53.530859 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ac5da941-08dc-4491-8fd7-53d60641d8b5 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:53.538317 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac5da941-08dc-4491-8fd7-53d60641d8b5 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:53.538807 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac5da941-08dc-4491-8fd7-53d60641d8b5 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:53.539353 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac5da941-08dc-4491-8fd7-53d60641d8b5 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:53.540059 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac5da941-08dc-4491-8fd7-53d60641d8b5 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:53.540506 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac5da941-08dc-4491-8fd7-53d60641d8b5 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:53.541156 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac5da941-08dc-4491-8fd7-53d60641d8b5 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:53.553257 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-dfa06e52-83fd-4427-bf7e-c573520d3b02 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:53.568072 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-dfa06e52-83fd-4427-bf7e-c573520d3b02 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:53.569843 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-dfa06e52-83fd-4427-bf7e-c573520d3b02 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:53.578845 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-dfa06e52-83fd-4427-bf7e-c573520d3b02 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1537 microversion: 2.91 time: 0.135577 Sep 10 11:51:53.580015 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1481/2883] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:53 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1537 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:51:53.649748 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-ac5da941-08dc-4491-8fd7-53d60641d8b5 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:51:53.650093 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-ac5da941-08dc-4491-8fd7-53d60641d8b5 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:51:53.650794 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-ac5da941-08dc-4491-8fd7-53d60641d8b5 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:51:53.651228 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-ac5da941-08dc-4491-8fd7-53d60641d8b5 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:51:53.651844 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-ac5da941-08dc-4491-8fd7-53d60641d8b5 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:51:53.721912 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ac5da941-08dc-4491-8fd7-53d60641d8b5 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:53.730453 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac5da941-08dc-4491-8fd7-53d60641d8b5 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:53.731384 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac5da941-08dc-4491-8fd7-53d60641d8b5 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:53.732026 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac5da941-08dc-4491-8fd7-53d60641d8b5 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:53.733510 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac5da941-08dc-4491-8fd7-53d60641d8b5 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:53.734485 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac5da941-08dc-4491-8fd7-53d60641d8b5 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:53.735562 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac5da941-08dc-4491-8fd7-53d60641d8b5 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:53.773269 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ac5da941-08dc-4491-8fd7-53d60641d8b5 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "POST /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071/action" status: 202 len: 1113 microversion: 2.1 time: 0.249761 Sep 10 11:51:53.774398 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1403/2884] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:51:53 2022] POST /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071/action => generated 1113 bytes in 252 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 10 11:51:53.794036 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2bd51f6a-6389-4fbc-b22e-0076ef57a82c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:53.795439 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2bd51f6a-6389-4fbc-b22e-0076ef57a82c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:53.808141 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2bd51f6a-6389-4fbc-b22e-0076ef57a82c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:53.809076 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2bd51f6a-6389-4fbc-b22e-0076ef57a82c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:53.815713 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d13ee1cb-e542-4ce2-afc9-1f7c359573c4 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:53.818520 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d13ee1cb-e542-4ce2-afc9-1f7c359573c4 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: f74f15ef-04b5-4313-b90f-20b96291734b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:53.820286 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2bd51f6a-6389-4fbc-b22e-0076ef57a82c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:53.823837 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2bd51f6a-6389-4fbc-b22e-0076ef57a82c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:53.824524 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2bd51f6a-6389-4fbc-b22e-0076ef57a82c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:53.825193 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2bd51f6a-6389-4fbc-b22e-0076ef57a82c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:53.835868 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d13ee1cb-e542-4ce2-afc9-1f7c359573c4 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:53.836609 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d13ee1cb-e542-4ce2-afc9-1f7c359573c4 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:53.839035 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d13ee1cb-e542-4ce2-afc9-1f7c359573c4 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:53.839896 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d13ee1cb-e542-4ce2-afc9-1f7c359573c4 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:53.840362 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d13ee1cb-e542-4ce2-afc9-1f7c359573c4 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:53.842659 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d13ee1cb-e542-4ce2-afc9-1f7c359573c4 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:54.068374 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d13ee1cb-e542-4ce2-afc9-1f7c359573c4 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be647276cc456e83dacd25b98e37f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20756c1a77fb44f684973f382b802825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:54.082377 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d13ee1cb-e542-4ce2-afc9-1f7c359573c4 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/f74f15ef-04b5-4313-b90f-20b96291734b" status: 200 len: 1373 microversion: 2.1 time: 0.271768 Sep 10 11:51:54.083720 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1404/2885] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:53 2022] GET /compute/v2.1/servers/f74f15ef-04b5-4313-b90f-20b96291734b => generated 1373 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:54.092348 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-69c74ba0-2e04-41c0-9ad5-09f03e52a05a tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:54.092704 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2bd51f6a-6389-4fbc-b22e-0076ef57a82c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:54.093510 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-69c74ba0-2e04-41c0-9ad5-09f03e52a05a tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:54.103326 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2bd51f6a-6389-4fbc-b22e-0076ef57a82c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1518 microversion: 2.1 time: 0.313602 Sep 10 11:51:54.103990 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1482/2886] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:53 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1518 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:54.104746 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-69c74ba0-2e04-41c0-9ad5-09f03e52a05a tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:54.105448 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-69c74ba0-2e04-41c0-9ad5-09f03e52a05a tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:54.105977 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-69c74ba0-2e04-41c0-9ad5-09f03e52a05a tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:54.106852 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-69c74ba0-2e04-41c0-9ad5-09f03e52a05a tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:54.107419 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-69c74ba0-2e04-41c0-9ad5-09f03e52a05a tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:54.107808 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-69c74ba0-2e04-41c0-9ad5-09f03e52a05a tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:54.174325 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2c56e9b7-660d-4af1-bdba-ca550a722aa1 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:54.176258 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2c56e9b7-660d-4af1-bdba-ca550a722aa1 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] [instance: 402b5cd2-03cd-4c59-b1fb-757b8c03b3e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:54.190379 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c56e9b7-660d-4af1-bdba-ca550a722aa1 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:54.190847 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c56e9b7-660d-4af1-bdba-ca550a722aa1 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:54.191356 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c56e9b7-660d-4af1-bdba-ca550a722aa1 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:54.192086 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c56e9b7-660d-4af1-bdba-ca550a722aa1 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:54.192551 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c56e9b7-660d-4af1-bdba-ca550a722aa1 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:54.192980 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c56e9b7-660d-4af1-bdba-ca550a722aa1 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:54.358707 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-69c74ba0-2e04-41c0-9ad5-09f03e52a05a tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:54.371999 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-69c74ba0-2e04-41c0-9ad5-09f03e52a05a tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1524 microversion: 2.1 time: 0.284692 Sep 10 11:51:54.383193 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1405/2887] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:54 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1524 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:54.443685 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2c56e9b7-660d-4af1-bdba-ca550a722aa1 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d0aaa7b7a34bb4bcea483bb41276aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d7fd11fb84c86b66362074c1ca8a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:54.456429 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2c56e9b7-660d-4af1-bdba-ca550a722aa1 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] 10.222.0.23 "GET /compute/v2.1/servers/402b5cd2-03cd-4c59-b1fb-757b8c03b3e2" status: 200 len: 1352 microversion: 2.1 time: 0.286401 Sep 10 11:51:54.459210 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1483/2888] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:54 2022] GET /compute/v2.1/servers/402b5cd2-03cd-4c59-b1fb-757b8c03b3e2 => generated 1352 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:51:54.474239 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d559c828-e4c7-4b1a-b666-44c117e8b525 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:54.474881 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d559c828-e4c7-4b1a-b666-44c117e8b525 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 7c17b066-2297-4d76-adcb-abae0e87a3c2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:54.482523 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d559c828-e4c7-4b1a-b666-44c117e8b525 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:54.483280 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d559c828-e4c7-4b1a-b666-44c117e8b525 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:54.483928 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d559c828-e4c7-4b1a-b666-44c117e8b525 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:54.486510 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d559c828-e4c7-4b1a-b666-44c117e8b525 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:54.487219 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d559c828-e4c7-4b1a-b666-44c117e8b525 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:54.488236 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d559c828-e4c7-4b1a-b666-44c117e8b525 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:54.609572 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9e156bb7-1361-424d-88c9-3a66d5f16cc9 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:54.613132 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9e156bb7-1361-424d-88c9-3a66d5f16cc9 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:54.626858 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9e156bb7-1361-424d-88c9-3a66d5f16cc9 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:54.628297 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9e156bb7-1361-424d-88c9-3a66d5f16cc9 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:54.629147 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9e156bb7-1361-424d-88c9-3a66d5f16cc9 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:54.631793 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9e156bb7-1361-424d-88c9-3a66d5f16cc9 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:54.632442 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9e156bb7-1361-424d-88c9-3a66d5f16cc9 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:54.633047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9e156bb7-1361-424d-88c9-3a66d5f16cc9 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:54.659556 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d559c828-e4c7-4b1a-b666-44c117e8b525 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:54.671127 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d559c828-e4c7-4b1a-b666-44c117e8b525 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2" status: 200 len: 1497 microversion: 2.1 time: 0.207014 Sep 10 11:51:54.688887 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1406/2889] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:54 2022] GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2 => generated 1497 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:54.735138 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9e156bb7-1361-424d-88c9-3a66d5f16cc9 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:54.764138 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9e156bb7-1361-424d-88c9-3a66d5f16cc9 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:54.766269 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9e156bb7-1361-424d-88c9-3a66d5f16cc9 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:54.774745 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9e156bb7-1361-424d-88c9-3a66d5f16cc9 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1537 microversion: 2.91 time: 0.170933 Sep 10 11:51:54.785893 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1484/2890] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:54 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1537 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:51:55.109837 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ffe6068b-72ae-45da-85b7-a4d169e416c3 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:55.110997 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ffe6068b-72ae-45da-85b7-a4d169e416c3 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: f74f15ef-04b5-4313-b90f-20b96291734b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:55.117725 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ffe6068b-72ae-45da-85b7-a4d169e416c3 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:55.118227 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ffe6068b-72ae-45da-85b7-a4d169e416c3 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:55.118670 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ffe6068b-72ae-45da-85b7-a4d169e416c3 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:55.119640 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ffe6068b-72ae-45da-85b7-a4d169e416c3 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:55.120095 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ffe6068b-72ae-45da-85b7-a4d169e416c3 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:55.120520 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ffe6068b-72ae-45da-85b7-a4d169e416c3 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:55.141479 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-eabb6de5-7371-4eb7-aeb0-3810d93c8933 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:55.142519 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-eabb6de5-7371-4eb7-aeb0-3810d93c8933 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:55.151983 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eabb6de5-7371-4eb7-aeb0-3810d93c8933 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:55.152614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eabb6de5-7371-4eb7-aeb0-3810d93c8933 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:55.153157 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eabb6de5-7371-4eb7-aeb0-3810d93c8933 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:55.154290 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eabb6de5-7371-4eb7-aeb0-3810d93c8933 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:55.154864 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eabb6de5-7371-4eb7-aeb0-3810d93c8933 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:55.155459 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eabb6de5-7371-4eb7-aeb0-3810d93c8933 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:55.401829 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ffe6068b-72ae-45da-85b7-a4d169e416c3 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be647276cc456e83dacd25b98e37f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20756c1a77fb44f684973f382b802825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:55.411173 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-eabb6de5-7371-4eb7-aeb0-3810d93c8933 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:55.426170 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-eabb6de5-7371-4eb7-aeb0-3810d93c8933 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1518 microversion: 2.1 time: 0.301922 Sep 10 11:51:55.429469 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1485/2891] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:55 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1518 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:55.444669 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7b4da49c-8b21-48a6-886b-a88deea2af00 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:55.446042 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7b4da49c-8b21-48a6-886b-a88deea2af00 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:55.455816 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b4da49c-8b21-48a6-886b-a88deea2af00 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:55.456729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b4da49c-8b21-48a6-886b-a88deea2af00 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:55.457430 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b4da49c-8b21-48a6-886b-a88deea2af00 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:55.462998 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b4da49c-8b21-48a6-886b-a88deea2af00 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:55.466103 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ffe6068b-72ae-45da-85b7-a4d169e416c3 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/f74f15ef-04b5-4313-b90f-20b96291734b" status: 200 len: 1373 microversion: 2.1 time: 0.359990 Sep 10 11:51:55.466999 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1407/2892] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:55 2022] GET /compute/v2.1/servers/f74f15ef-04b5-4313-b90f-20b96291734b => generated 1373 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:55.481959 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-7900d5d3-36ae-4d31-88d1-b82cd3413fdf req-a3d356f4-a3e8-42e0-935b-3f2a37793a01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f74f15ef-04b5-4313-b90f-20b96291734b", "name": "network-vif-plugged", "status": "completed", "tag": "db9651b2-3db5-4e9b-9153-56055a48ba72"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:51:55.486872 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b4da49c-8b21-48a6-886b-a88deea2af00 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:55.487550 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b4da49c-8b21-48a6-886b-a88deea2af00 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:55.505601 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-7900d5d3-36ae-4d31-88d1-b82cd3413fdf req-a3d356f4-a3e8-42e0-935b-3f2a37793a01 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:55.506763 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-7900d5d3-36ae-4d31-88d1-b82cd3413fdf req-a3d356f4-a3e8-42e0-935b-3f2a37793a01 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:55.507536 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-7900d5d3-36ae-4d31-88d1-b82cd3413fdf req-a3d356f4-a3e8-42e0-935b-3f2a37793a01 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:55.526373 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-7900d5d3-36ae-4d31-88d1-b82cd3413fdf req-a3d356f4-a3e8-42e0-935b-3f2a37793a01 service nova] Creating event network-vif-plugged:db9651b2-3db5-4e9b-9153-56055a48ba72 for instance f74f15ef-04b5-4313-b90f-20b96291734b on n-h2-856895-1 Sep 10 11:51:55.547334 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-7900d5d3-36ae-4d31-88d1-b82cd3413fdf req-a3d356f4-a3e8-42e0-935b-3f2a37793a01 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078765 Sep 10 11:51:55.549494 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1408/2893] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:51:55.557778 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-beb98687-d1a2-458a-9532-81c25e5ed8e3 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:55.559542 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-beb98687-d1a2-458a-9532-81c25e5ed8e3 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] [instance: 402b5cd2-03cd-4c59-b1fb-757b8c03b3e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:55.580133 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-beb98687-d1a2-458a-9532-81c25e5ed8e3 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:55.580635 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-beb98687-d1a2-458a-9532-81c25e5ed8e3 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:55.586915 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-beb98687-d1a2-458a-9532-81c25e5ed8e3 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:55.587959 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-beb98687-d1a2-458a-9532-81c25e5ed8e3 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:55.588593 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-beb98687-d1a2-458a-9532-81c25e5ed8e3 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:55.589043 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-beb98687-d1a2-458a-9532-81c25e5ed8e3 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:55.718807 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7b4da49c-8b21-48a6-886b-a88deea2af00 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:55.731530 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7b4da49c-8b21-48a6-886b-a88deea2af00 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1524 microversion: 2.1 time: 0.300344 Sep 10 11:51:55.739317 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1486/2894] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:55 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1524 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:55.739317 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a216a79f-2dd9-4536-a203-a97b2eada8ef tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:55.739317 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a216a79f-2dd9-4536-a203-a97b2eada8ef tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 7c17b066-2297-4d76-adcb-abae0e87a3c2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:55.745454 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a216a79f-2dd9-4536-a203-a97b2eada8ef tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:55.746142 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a216a79f-2dd9-4536-a203-a97b2eada8ef tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:55.746585 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a216a79f-2dd9-4536-a203-a97b2eada8ef tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:55.747552 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a216a79f-2dd9-4536-a203-a97b2eada8ef tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:55.748010 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a216a79f-2dd9-4536-a203-a97b2eada8ef tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:55.748443 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a216a79f-2dd9-4536-a203-a97b2eada8ef tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:55.807011 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-beb98687-d1a2-458a-9532-81c25e5ed8e3 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d0aaa7b7a34bb4bcea483bb41276aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d7fd11fb84c86b66362074c1ca8a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:55.816256 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-beb98687-d1a2-458a-9532-81c25e5ed8e3 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] 10.222.0.23 "GET /compute/v2.1/servers/402b5cd2-03cd-4c59-b1fb-757b8c03b3e2" status: 200 len: 1352 microversion: 2.1 time: 0.264659 Sep 10 11:51:55.817151 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1409/2895] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:55 2022] GET /compute/v2.1/servers/402b5cd2-03cd-4c59-b1fb-757b8c03b3e2 => generated 1352 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:55.837630 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1d18e9b8-ee07-4956-9824-7fc1c14dc21f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:55.838555 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1d18e9b8-ee07-4956-9824-7fc1c14dc21f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:55.846540 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1d18e9b8-ee07-4956-9824-7fc1c14dc21f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:55.847209 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1d18e9b8-ee07-4956-9824-7fc1c14dc21f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:55.847740 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1d18e9b8-ee07-4956-9824-7fc1c14dc21f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:55.848632 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1d18e9b8-ee07-4956-9824-7fc1c14dc21f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:55.849200 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1d18e9b8-ee07-4956-9824-7fc1c14dc21f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:55.849734 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1d18e9b8-ee07-4956-9824-7fc1c14dc21f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:55.918275 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a216a79f-2dd9-4536-a203-a97b2eada8ef tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:55.929050 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a216a79f-2dd9-4536-a203-a97b2eada8ef tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2" status: 200 len: 1497 microversion: 2.1 time: 0.195400 Sep 10 11:51:55.929789 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1487/2896] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:55 2022] GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2 => generated 1497 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:55.936752 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1d18e9b8-ee07-4956-9824-7fc1c14dc21f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:55.942244 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-af6b5e35-8710-4e7c-87ee-f9e3b59b717b req-1e5ad2aa-17a8-4f79-ae87-d3cfe2e2fee2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "402b5cd2-03cd-4c59-b1fb-757b8c03b3e2", "tag": "65a0f5b9-a99d-4243-bb34-98369eceac63"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:51:55.946794 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1d18e9b8-ee07-4956-9824-7fc1c14dc21f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:55.953057 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1d18e9b8-ee07-4956-9824-7fc1c14dc21f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:55.955305 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-af6b5e35-8710-4e7c-87ee-f9e3b59b717b req-1e5ad2aa-17a8-4f79-ae87-d3cfe2e2fee2 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:55.955951 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-af6b5e35-8710-4e7c-87ee-f9e3b59b717b req-1e5ad2aa-17a8-4f79-ae87-d3cfe2e2fee2 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:55.956385 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-af6b5e35-8710-4e7c-87ee-f9e3b59b717b req-1e5ad2aa-17a8-4f79-ae87-d3cfe2e2fee2 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:55.959890 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1d18e9b8-ee07-4956-9824-7fc1c14dc21f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1537 microversion: 2.91 time: 0.131100 Sep 10 11:51:55.960631 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1410/2897] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:55 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1537 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:51:55.968393 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-af6b5e35-8710-4e7c-87ee-f9e3b59b717b req-1e5ad2aa-17a8-4f79-ae87-d3cfe2e2fee2 service nova] Creating event network-changed:65a0f5b9-a99d-4243-bb34-98369eceac63 for instance 402b5cd2-03cd-4c59-b1fb-757b8c03b3e2 on n-h1-856895-1 Sep 10 11:51:55.975005 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-af6b5e35-8710-4e7c-87ee-f9e3b59b717b req-1e5ad2aa-17a8-4f79-ae87-d3cfe2e2fee2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043746 Sep 10 11:51:55.975758 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1488/2898] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:51:56.456476 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9a060487-bcfd-4ad1-9bf7-41d439458776 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:56.457192 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9a060487-bcfd-4ad1-9bf7-41d439458776 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:56.464757 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a060487-bcfd-4ad1-9bf7-41d439458776 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:56.465532 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a060487-bcfd-4ad1-9bf7-41d439458776 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:56.466273 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a060487-bcfd-4ad1-9bf7-41d439458776 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:56.467314 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a060487-bcfd-4ad1-9bf7-41d439458776 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:56.468921 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a060487-bcfd-4ad1-9bf7-41d439458776 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:56.471775 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a060487-bcfd-4ad1-9bf7-41d439458776 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:56.498115 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-21865090-1103-41e2-89a3-699aa6acb93f tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:56.502104 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-21865090-1103-41e2-89a3-699aa6acb93f tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: f74f15ef-04b5-4313-b90f-20b96291734b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:56.518371 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-21865090-1103-41e2-89a3-699aa6acb93f tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:56.520784 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-21865090-1103-41e2-89a3-699aa6acb93f tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:56.521493 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-21865090-1103-41e2-89a3-699aa6acb93f tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:56.524128 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-21865090-1103-41e2-89a3-699aa6acb93f tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:56.524903 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-21865090-1103-41e2-89a3-699aa6acb93f tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:56.526888 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-21865090-1103-41e2-89a3-699aa6acb93f tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:56.865078 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-21865090-1103-41e2-89a3-699aa6acb93f tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be647276cc456e83dacd25b98e37f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20756c1a77fb44f684973f382b802825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:56.877661 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-21865090-1103-41e2-89a3-699aa6acb93f tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/f74f15ef-04b5-4313-b90f-20b96291734b" status: 200 len: 1373 microversion: 2.1 time: 0.389134 Sep 10 11:51:56.903717 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1489/2899] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:56 2022] GET /compute/v2.1/servers/f74f15ef-04b5-4313-b90f-20b96291734b => generated 1373 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:56.916401 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-28d34a54-0658-4c0f-9038-3c2ba9025f89 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:56.917109 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-28d34a54-0658-4c0f-9038-3c2ba9025f89 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:56.923384 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28d34a54-0658-4c0f-9038-3c2ba9025f89 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:56.924155 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28d34a54-0658-4c0f-9038-3c2ba9025f89 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:56.924819 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28d34a54-0658-4c0f-9038-3c2ba9025f89 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:56.925792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28d34a54-0658-4c0f-9038-3c2ba9025f89 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:56.926470 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28d34a54-0658-4c0f-9038-3c2ba9025f89 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:56.927101 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28d34a54-0658-4c0f-9038-3c2ba9025f89 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:56.975124 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9a060487-bcfd-4ad1-9bf7-41d439458776 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:56.988650 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9a060487-bcfd-4ad1-9bf7-41d439458776 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1518 microversion: 2.1 time: 0.536627 Sep 10 11:51:56.993687 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1411/2900] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:56 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1518 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:57.006461 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f681ef6a-5925-44ee-adc4-1ae39e04ad02 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:57.009079 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f681ef6a-5925-44ee-adc4-1ae39e04ad02 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] [instance: 402b5cd2-03cd-4c59-b1fb-757b8c03b3e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:57.020315 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f681ef6a-5925-44ee-adc4-1ae39e04ad02 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:57.021599 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f681ef6a-5925-44ee-adc4-1ae39e04ad02 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:57.021991 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f681ef6a-5925-44ee-adc4-1ae39e04ad02 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:57.022708 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f681ef6a-5925-44ee-adc4-1ae39e04ad02 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:57.025405 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f681ef6a-5925-44ee-adc4-1ae39e04ad02 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:57.026176 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f681ef6a-5925-44ee-adc4-1ae39e04ad02 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:57.387485 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-28d34a54-0658-4c0f-9038-3c2ba9025f89 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:57.405038 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-28d34a54-0658-4c0f-9038-3c2ba9025f89 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1524 microversion: 2.1 time: 0.497463 Sep 10 11:51:57.408286 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1490/2901] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:56 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1524 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:57.425861 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c9e3c628-a9dc-418f-9389-27abe9f0a4d7 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:57.426542 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c9e3c628-a9dc-418f-9389-27abe9f0a4d7 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 7c17b066-2297-4d76-adcb-abae0e87a3c2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:57.429382 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f681ef6a-5925-44ee-adc4-1ae39e04ad02 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d0aaa7b7a34bb4bcea483bb41276aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d7fd11fb84c86b66362074c1ca8a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:57.441414 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c9e3c628-a9dc-418f-9389-27abe9f0a4d7 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:57.441658 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f681ef6a-5925-44ee-adc4-1ae39e04ad02 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] 10.222.0.23 "GET /compute/v2.1/servers/402b5cd2-03cd-4c59-b1fb-757b8c03b3e2" status: 200 len: 1352 microversion: 2.1 time: 0.446628 Sep 10 11:51:57.441942 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c9e3c628-a9dc-418f-9389-27abe9f0a4d7 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:57.442351 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c9e3c628-a9dc-418f-9389-27abe9f0a4d7 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:57.443058 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c9e3c628-a9dc-418f-9389-27abe9f0a4d7 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:57.443549 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c9e3c628-a9dc-418f-9389-27abe9f0a4d7 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:57.443981 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c9e3c628-a9dc-418f-9389-27abe9f0a4d7 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:57.445942 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1412/2902] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:56 2022] GET /compute/v2.1/servers/402b5cd2-03cd-4c59-b1fb-757b8c03b3e2 => generated 1352 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:57.450960 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5fe76776-1799-40c6-b01e-1462ffa5f2f7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:57.456865 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5fe76776-1799-40c6-b01e-1462ffa5f2f7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:57.472692 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5fe76776-1799-40c6-b01e-1462ffa5f2f7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:57.473190 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5fe76776-1799-40c6-b01e-1462ffa5f2f7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:57.473639 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5fe76776-1799-40c6-b01e-1462ffa5f2f7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:57.474349 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5fe76776-1799-40c6-b01e-1462ffa5f2f7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:57.474998 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5fe76776-1799-40c6-b01e-1462ffa5f2f7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:57.475653 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5fe76776-1799-40c6-b01e-1462ffa5f2f7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:57.508118 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:51:57.611361 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5fe76776-1799-40c6-b01e-1462ffa5f2f7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:57.624853 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5fe76776-1799-40c6-b01e-1462ffa5f2f7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:57.633112 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5fe76776-1799-40c6-b01e-1462ffa5f2f7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:57.639181 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5fe76776-1799-40c6-b01e-1462ffa5f2f7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1537 microversion: 2.91 time: 0.191556 Sep 10 11:51:57.643704 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1413/2903] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:57 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1537 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:51:57.736672 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c9e3c628-a9dc-418f-9389-27abe9f0a4d7 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:57.745376 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c9e3c628-a9dc-418f-9389-27abe9f0a4d7 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2" status: 200 len: 1497 microversion: 2.1 time: 0.334606 Sep 10 11:51:57.745967 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1491/2904] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:57 2022] GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2 => generated 1497 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:57.915939 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b638d742-3db5-4689-abef-7c73bc07ff9d tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:57.916583 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b638d742-3db5-4689-abef-7c73bc07ff9d tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: f74f15ef-04b5-4313-b90f-20b96291734b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:57.920302 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:51:57.926096 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b638d742-3db5-4689-abef-7c73bc07ff9d tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:57.926609 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b638d742-3db5-4689-abef-7c73bc07ff9d tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:57.927433 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b638d742-3db5-4689-abef-7c73bc07ff9d tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:57.928274 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b638d742-3db5-4689-abef-7c73bc07ff9d tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:57.928913 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b638d742-3db5-4689-abef-7c73bc07ff9d tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:57.929329 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b638d742-3db5-4689-abef-7c73bc07ff9d tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:57.947540 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=12 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:51:58.022101 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-df2bb0ae-40c8-4dd1-a2a0-7a02a818ccfe tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:58.023137 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-df2bb0ae-40c8-4dd1-a2a0-7a02a818ccfe tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:58.028001 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:51:58.045288 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-df2bb0ae-40c8-4dd1-a2a0-7a02a818ccfe tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:58.045839 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-df2bb0ae-40c8-4dd1-a2a0-7a02a818ccfe tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:58.046296 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-df2bb0ae-40c8-4dd1-a2a0-7a02a818ccfe tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:58.048749 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-df2bb0ae-40c8-4dd1-a2a0-7a02a818ccfe tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:58.049520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-df2bb0ae-40c8-4dd1-a2a0-7a02a818ccfe tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:58.050377 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-df2bb0ae-40c8-4dd1-a2a0-7a02a818ccfe tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:58.170925 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b638d742-3db5-4689-abef-7c73bc07ff9d tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be647276cc456e83dacd25b98e37f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20756c1a77fb44f684973f382b802825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:58.183923 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b638d742-3db5-4689-abef-7c73bc07ff9d tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/f74f15ef-04b5-4313-b90f-20b96291734b" status: 200 len: 1545 microversion: 2.1 time: 0.271674 Sep 10 11:51:58.186178 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1414/2905] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:57 2022] GET /compute/v2.1/servers/f74f15ef-04b5-4313-b90f-20b96291734b => generated 1545 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:58.212022 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-252db0b6-b708-4863-97eb-28e09fa5f907 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:58.213955 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-252db0b6-b708-4863-97eb-28e09fa5f907 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: f74f15ef-04b5-4313-b90f-20b96291734b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:58.223357 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-252db0b6-b708-4863-97eb-28e09fa5f907 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:58.224017 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-252db0b6-b708-4863-97eb-28e09fa5f907 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:58.224521 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-252db0b6-b708-4863-97eb-28e09fa5f907 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:58.225326 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-252db0b6-b708-4863-97eb-28e09fa5f907 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:58.225944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-252db0b6-b708-4863-97eb-28e09fa5f907 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:58.226442 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-252db0b6-b708-4863-97eb-28e09fa5f907 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:58.230804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:51:58.414240 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-df2bb0ae-40c8-4dd1-a2a0-7a02a818ccfe tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:58.424600 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-df2bb0ae-40c8-4dd1-a2a0-7a02a818ccfe tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1518 microversion: 2.1 time: 0.408633 Sep 10 11:51:58.425223 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1492/2906] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:58 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1518 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:58.445978 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7fd37ac1-c1d6-4322-8769-5585497b41a2 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:58.446610 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7fd37ac1-c1d6-4322-8769-5585497b41a2 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:58.457941 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7fd37ac1-c1d6-4322-8769-5585497b41a2 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:58.458449 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7fd37ac1-c1d6-4322-8769-5585497b41a2 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:58.458894 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7fd37ac1-c1d6-4322-8769-5585497b41a2 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:58.459845 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7fd37ac1-c1d6-4322-8769-5585497b41a2 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:58.460476 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7fd37ac1-c1d6-4322-8769-5585497b41a2 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:58.461102 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7fd37ac1-c1d6-4322-8769-5585497b41a2 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:58.467877 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-252db0b6-b708-4863-97eb-28e09fa5f907 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be647276cc456e83dacd25b98e37f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20756c1a77fb44f684973f382b802825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:58.483618 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-252db0b6-b708-4863-97eb-28e09fa5f907 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/f74f15ef-04b5-4313-b90f-20b96291734b" status: 200 len: 1545 microversion: 2.1 time: 0.275931 Sep 10 11:51:58.492533 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1415/2907] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:58 2022] GET /compute/v2.1/servers/f74f15ef-04b5-4313-b90f-20b96291734b => generated 1545 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:58.515472 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-70fcc10d-8b03-471f-9a65-f346f697a4e2 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:58.517103 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-70fcc10d-8b03-471f-9a65-f346f697a4e2 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] [instance: 402b5cd2-03cd-4c59-b1fb-757b8c03b3e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:58.523870 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-70fcc10d-8b03-471f-9a65-f346f697a4e2 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:58.525637 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-70fcc10d-8b03-471f-9a65-f346f697a4e2 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:58.526336 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-70fcc10d-8b03-471f-9a65-f346f697a4e2 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:58.528388 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-70fcc10d-8b03-471f-9a65-f346f697a4e2 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:58.529159 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-70fcc10d-8b03-471f-9a65-f346f697a4e2 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:58.529930 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-70fcc10d-8b03-471f-9a65-f346f697a4e2 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:58.779325 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7fd37ac1-c1d6-4322-8769-5585497b41a2 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:58.788342 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7fd37ac1-c1d6-4322-8769-5585497b41a2 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1524 microversion: 2.1 time: 0.346354 Sep 10 11:51:58.788700 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1493/2908] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:58 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1524 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:51:58.799723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-04ab1201-eedf-4f78-a898-85d2982090a8 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:58.804860 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-04ab1201-eedf-4f78-a898-85d2982090a8 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:58.818300 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-04ab1201-eedf-4f78-a898-85d2982090a8 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:58.819065 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-04ab1201-eedf-4f78-a898-85d2982090a8 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:58.822453 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-04ab1201-eedf-4f78-a898-85d2982090a8 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:58.823074 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-04ab1201-eedf-4f78-a898-85d2982090a8 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:58.823579 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-04ab1201-eedf-4f78-a898-85d2982090a8 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:58.824021 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-04ab1201-eedf-4f78-a898-85d2982090a8 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:58.902584 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=8 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:51:59.011902 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-70fcc10d-8b03-471f-9a65-f346f697a4e2 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d0aaa7b7a34bb4bcea483bb41276aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d7fd11fb84c86b66362074c1ca8a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:59.024294 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-70fcc10d-8b03-471f-9a65-f346f697a4e2 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] 10.222.0.23 "GET /compute/v2.1/servers/402b5cd2-03cd-4c59-b1fb-757b8c03b3e2" status: 200 len: 1352 microversion: 2.1 time: 0.518103 Sep 10 11:51:59.024963 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1416/2909] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:58 2022] GET /compute/v2.1/servers/402b5cd2-03cd-4c59-b1fb-757b8c03b3e2 => generated 1352 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:59.034935 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-04ab1201-eedf-4f78-a898-85d2982090a8 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:59.043328 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-04ab1201-eedf-4f78-a898-85d2982090a8 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:59.044809 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-04ab1201-eedf-4f78-a898-85d2982090a8 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:59.048811 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e88d20ee-8494-4864-87d5-d30f37a59a72 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:59.049447 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e88d20ee-8494-4864-87d5-d30f37a59a72 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 7c17b066-2297-4d76-adcb-abae0e87a3c2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:59.070049 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e88d20ee-8494-4864-87d5-d30f37a59a72 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:59.072771 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-04ab1201-eedf-4f78-a898-85d2982090a8 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1537 microversion: 2.91 time: 0.283013 Sep 10 11:51:59.073472 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e88d20ee-8494-4864-87d5-d30f37a59a72 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:59.074100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e88d20ee-8494-4864-87d5-d30f37a59a72 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:59.074894 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1494/2910] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:51:58 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1537 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:51:59.075936 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e88d20ee-8494-4864-87d5-d30f37a59a72 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:59.076572 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e88d20ee-8494-4864-87d5-d30f37a59a72 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:59.077201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e88d20ee-8494-4864-87d5-d30f37a59a72 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:59.452111 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b67415bf-e095-4690-86aa-413b7135046f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:59.452740 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b67415bf-e095-4690-86aa-413b7135046f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:59.460808 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b67415bf-e095-4690-86aa-413b7135046f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:59.461308 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b67415bf-e095-4690-86aa-413b7135046f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:59.461753 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b67415bf-e095-4690-86aa-413b7135046f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:59.462472 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b67415bf-e095-4690-86aa-413b7135046f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:59.462930 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b67415bf-e095-4690-86aa-413b7135046f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:59.463386 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b67415bf-e095-4690-86aa-413b7135046f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:59.789652 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e88d20ee-8494-4864-87d5-d30f37a59a72 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:59.794016 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b67415bf-e095-4690-86aa-413b7135046f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:51:59.812895 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e88d20ee-8494-4864-87d5-d30f37a59a72 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2" status: 200 len: 1497 microversion: 2.1 time: 0.786830 Sep 10 11:51:59.813855 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1417/2911] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:59 2022] GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2 => generated 1497 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:51:59.817585 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b67415bf-e095-4690-86aa-413b7135046f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1518 microversion: 2.1 time: 0.369424 Sep 10 11:51:59.830445 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1495/2912] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:59 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1518 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:51:59.846817 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4fbad523-4e28-4177-81aa-080fa3476c7d tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:51:59.848095 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4fbad523-4e28-4177-81aa-080fa3476c7d tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:51:59.859953 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fbad523-4e28-4177-81aa-080fa3476c7d tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:59.862173 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fbad523-4e28-4177-81aa-080fa3476c7d tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:59.866477 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fbad523-4e28-4177-81aa-080fa3476c7d tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:51:59.867632 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fbad523-4e28-4177-81aa-080fa3476c7d tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:51:59.868264 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fbad523-4e28-4177-81aa-080fa3476c7d tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:51:59.868892 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fbad523-4e28-4177-81aa-080fa3476c7d tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:00.055851 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f2efe766-00c7-4125-a543-6b1cb89d02b2 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:00.056515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f2efe766-00c7-4125-a543-6b1cb89d02b2 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] [instance: 402b5cd2-03cd-4c59-b1fb-757b8c03b3e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:00.075839 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f2efe766-00c7-4125-a543-6b1cb89d02b2 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:00.076772 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f2efe766-00c7-4125-a543-6b1cb89d02b2 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:00.077232 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f2efe766-00c7-4125-a543-6b1cb89d02b2 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:00.077941 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f2efe766-00c7-4125-a543-6b1cb89d02b2 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:00.078392 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f2efe766-00c7-4125-a543-6b1cb89d02b2 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:00.079418 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f2efe766-00c7-4125-a543-6b1cb89d02b2 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:00.382244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4fbad523-4e28-4177-81aa-080fa3476c7d tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:00.400265 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4fbad523-4e28-4177-81aa-080fa3476c7d tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1524 microversion: 2.1 time: 0.578710 Sep 10 11:52:00.401478 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1418/2913] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:51:59 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1524 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:00.406363 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-45f4b1f5-877d-4355-aaf7-9ed85e005ab5 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:00.407303 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-45f4b1f5-877d-4355-aaf7-9ed85e005ab5 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:00.425792 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-45f4b1f5-877d-4355-aaf7-9ed85e005ab5 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:00.426824 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-45f4b1f5-877d-4355-aaf7-9ed85e005ab5 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:00.427613 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-45f4b1f5-877d-4355-aaf7-9ed85e005ab5 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:00.428566 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-45f4b1f5-877d-4355-aaf7-9ed85e005ab5 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:00.429130 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-45f4b1f5-877d-4355-aaf7-9ed85e005ab5 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:00.429645 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-45f4b1f5-877d-4355-aaf7-9ed85e005ab5 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:00.491601 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f2efe766-00c7-4125-a543-6b1cb89d02b2 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d0aaa7b7a34bb4bcea483bb41276aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d7fd11fb84c86b66362074c1ca8a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:00.500057 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f2efe766-00c7-4125-a543-6b1cb89d02b2 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] 10.222.0.23 "GET /compute/v2.1/servers/402b5cd2-03cd-4c59-b1fb-757b8c03b3e2" status: 200 len: 1352 microversion: 2.1 time: 0.452306 Sep 10 11:52:00.501959 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1496/2914] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:00 2022] GET /compute/v2.1/servers/402b5cd2-03cd-4c59-b1fb-757b8c03b3e2 => generated 1352 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:00.608943 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-45f4b1f5-877d-4355-aaf7-9ed85e005ab5 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:00.621424 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-45f4b1f5-877d-4355-aaf7-9ed85e005ab5 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:00.626850 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-45f4b1f5-877d-4355-aaf7-9ed85e005ab5 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:00.646401 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-45f4b1f5-877d-4355-aaf7-9ed85e005ab5 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1537 microversion: 2.91 time: 0.243580 Sep 10 11:52:00.647121 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1419/2915] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:00 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1537 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:00.838508 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9df66f2f-6808-46ed-b84b-30a80c4241a6 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:00.839399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9df66f2f-6808-46ed-b84b-30a80c4241a6 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 7c17b066-2297-4d76-adcb-abae0e87a3c2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:00.861520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9df66f2f-6808-46ed-b84b-30a80c4241a6 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:00.864030 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9df66f2f-6808-46ed-b84b-30a80c4241a6 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:00.866694 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9df66f2f-6808-46ed-b84b-30a80c4241a6 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:00.867663 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9df66f2f-6808-46ed-b84b-30a80c4241a6 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:00.869820 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9df66f2f-6808-46ed-b84b-30a80c4241a6 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:00.872853 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9179dd4e-1e3f-4da3-a7fa-e336acdb4930 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:00.874254 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9179dd4e-1e3f-4da3-a7fa-e336acdb4930 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:00.881196 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9df66f2f-6808-46ed-b84b-30a80c4241a6 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:00.894903 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9179dd4e-1e3f-4da3-a7fa-e336acdb4930 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:00.896569 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9179dd4e-1e3f-4da3-a7fa-e336acdb4930 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:00.897581 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9179dd4e-1e3f-4da3-a7fa-e336acdb4930 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:00.914081 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9179dd4e-1e3f-4da3-a7fa-e336acdb4930 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:00.914884 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9179dd4e-1e3f-4da3-a7fa-e336acdb4930 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:00.916013 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9179dd4e-1e3f-4da3-a7fa-e336acdb4930 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:01.369739 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9179dd4e-1e3f-4da3-a7fa-e336acdb4930 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:01.378015 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9179dd4e-1e3f-4da3-a7fa-e336acdb4930 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1518 microversion: 2.1 time: 0.531081 Sep 10 11:52:01.378604 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1420/2916] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:00 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1518 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:01.404454 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9df66f2f-6808-46ed-b84b-30a80c4241a6 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:01.414004 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9df66f2f-6808-46ed-b84b-30a80c4241a6 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2" status: 200 len: 1497 microversion: 2.1 time: 0.579853 Sep 10 11:52:01.414593 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1497/2917] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:00 2022] GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2 => generated 1497 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:01.425919 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6f8b68de-c6db-480c-a43f-64bae4d6b86a tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:01.426837 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6f8b68de-c6db-480c-a43f-64bae4d6b86a tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:01.439784 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f8b68de-c6db-480c-a43f-64bae4d6b86a tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:01.440670 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f8b68de-c6db-480c-a43f-64bae4d6b86a tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:01.441298 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f8b68de-c6db-480c-a43f-64bae4d6b86a tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:01.442210 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f8b68de-c6db-480c-a43f-64bae4d6b86a tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:01.442832 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f8b68de-c6db-480c-a43f-64bae4d6b86a tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:01.443461 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f8b68de-c6db-480c-a43f-64bae4d6b86a tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:01.531439 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4d2ce892-b17a-4308-8d3d-cde2eb6b9d85 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:01.531439 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4d2ce892-b17a-4308-8d3d-cde2eb6b9d85 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] [instance: 402b5cd2-03cd-4c59-b1fb-757b8c03b3e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:01.534648 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4d2ce892-b17a-4308-8d3d-cde2eb6b9d85 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:01.535872 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4d2ce892-b17a-4308-8d3d-cde2eb6b9d85 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:01.537425 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4d2ce892-b17a-4308-8d3d-cde2eb6b9d85 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:01.538318 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4d2ce892-b17a-4308-8d3d-cde2eb6b9d85 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:01.538878 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4d2ce892-b17a-4308-8d3d-cde2eb6b9d85 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:01.539440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4d2ce892-b17a-4308-8d3d-cde2eb6b9d85 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:01.904570 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6f8b68de-c6db-480c-a43f-64bae4d6b86a tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:01.913257 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6f8b68de-c6db-480c-a43f-64bae4d6b86a tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1524 microversion: 2.1 time: 0.492787 Sep 10 11:52:01.927851 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1421/2918] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:01 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1524 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:01.931613 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4d2ce892-b17a-4308-8d3d-cde2eb6b9d85 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d0aaa7b7a34bb4bcea483bb41276aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d7fd11fb84c86b66362074c1ca8a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:01.947947 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4d2ce892-b17a-4308-8d3d-cde2eb6b9d85 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] 10.222.0.23 "GET /compute/v2.1/servers/402b5cd2-03cd-4c59-b1fb-757b8c03b3e2" status: 200 len: 1352 microversion: 2.1 time: 0.425808 Sep 10 11:52:01.960166 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1498/2919] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:01 2022] GET /compute/v2.1/servers/402b5cd2-03cd-4c59-b1fb-757b8c03b3e2 => generated 1352 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:01.973473 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-aa9f69e1-7fe2-4e1c-8c3d-72cb024402e2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:01.974753 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-aa9f69e1-7fe2-4e1c-8c3d-72cb024402e2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:01.984355 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa9f69e1-7fe2-4e1c-8c3d-72cb024402e2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:01.985530 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa9f69e1-7fe2-4e1c-8c3d-72cb024402e2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:01.986129 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa9f69e1-7fe2-4e1c-8c3d-72cb024402e2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:01.986947 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa9f69e1-7fe2-4e1c-8c3d-72cb024402e2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:01.987679 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa9f69e1-7fe2-4e1c-8c3d-72cb024402e2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:01.988371 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa9f69e1-7fe2-4e1c-8c3d-72cb024402e2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:02.082075 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0c70a573-d57e-44e2-8ebb-9d6262941e2c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Action: 'create', calling method: .version_select at 0x7f407292bdc0>, body: {"keypair": {"name": "tempest-keypair-891424763", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGj2v/k9IkSnSNPa4VHiE8ynsz30v7Noc3bBbxwkgASYDmkZYVS4teHanLmwbg66u6EiTCGGJqEWpSTk4lsMEKROg7jNeRmlNTJcNV9uq9Ghc98rgXajeIHEkbISz5bmw=="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:52:02.091364 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-aa9f69e1-7fe2-4e1c-8c3d-72cb024402e2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:02.099434 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-0c70a573-d57e-44e2-8ebb-9d6262941e2c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Getting quotas for project 66677b88ab6b436da8477f213df0ed1d. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:52:02.104161 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-aa9f69e1-7fe2-4e1c-8c3d-72cb024402e2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:02.105453 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-0c70a573-d57e-44e2-8ebb-9d6262941e2c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Getting quotas for user 20a5848b40dc4fbaa2a25a41d92d383a and project 66677b88ab6b436da8477f213df0ed1d. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:52:02.106073 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-aa9f69e1-7fe2-4e1c-8c3d-72cb024402e2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:02.114149 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-aa9f69e1-7fe2-4e1c-8c3d-72cb024402e2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1558 microversion: 2.91 time: 0.152591 Sep 10 11:52:02.114881 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1499/2920] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:01 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:02.124911 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-eb6a5eb5-497a-4585-baf4-fd080344cbe7 req-116bb35c-99a3-4998-8ffe-3f048ec5614a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "402b5cd2-03cd-4c59-b1fb-757b8c03b3e2", "name": "network-vif-plugged", "status": "completed", "tag": "65a0f5b9-a99d-4243-bb34-98369eceac63"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:52:02.140679 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0c70a573-d57e-44e2-8ebb-9d6262941e2c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.211389 Sep 10 11:52:02.142288 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1422/2921] 10.222.0.23 () {62 vars in 1200 bytes} [Sat Sep 10 11:52:01 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 214 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 10 11:52:02.143981 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-eb6a5eb5-497a-4585-baf4-fd080344cbe7 req-116bb35c-99a3-4998-8ffe-3f048ec5614a service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:02.144815 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-eb6a5eb5-497a-4585-baf4-fd080344cbe7 req-116bb35c-99a3-4998-8ffe-3f048ec5614a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:02.145221 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-eb6a5eb5-497a-4585-baf4-fd080344cbe7 req-116bb35c-99a3-4998-8ffe-3f048ec5614a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:02.160104 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-eb6a5eb5-497a-4585-baf4-fd080344cbe7 req-116bb35c-99a3-4998-8ffe-3f048ec5614a service nova] Creating event network-vif-plugged:65a0f5b9-a99d-4243-bb34-98369eceac63 for instance 402b5cd2-03cd-4c59-b1fb-757b8c03b3e2 on n-h1-856895-1 Sep 10 11:52:02.171855 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-eb6a5eb5-497a-4585-baf4-fd080344cbe7 req-116bb35c-99a3-4998-8ffe-3f048ec5614a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053697 Sep 10 11:52:02.173065 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1500/2922] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:52:02.401656 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-33032bed-ebc0-4a23-89f6-fab9a9b0935d tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:02.402368 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-33032bed-ebc0-4a23-89f6-fab9a9b0935d tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:02.410859 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-33032bed-ebc0-4a23-89f6-fab9a9b0935d tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:02.418322 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-33032bed-ebc0-4a23-89f6-fab9a9b0935d tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:02.418894 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-33032bed-ebc0-4a23-89f6-fab9a9b0935d tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:02.419774 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-33032bed-ebc0-4a23-89f6-fab9a9b0935d tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:02.420367 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-33032bed-ebc0-4a23-89f6-fab9a9b0935d tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:02.420896 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-33032bed-ebc0-4a23-89f6-fab9a9b0935d tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:02.442597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-772545bc-6463-4020-85d9-53dcee4c04ce tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:02.443417 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-772545bc-6463-4020-85d9-53dcee4c04ce tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 7c17b066-2297-4d76-adcb-abae0e87a3c2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:02.462988 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-772545bc-6463-4020-85d9-53dcee4c04ce tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:02.463520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-772545bc-6463-4020-85d9-53dcee4c04ce tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:02.463966 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-772545bc-6463-4020-85d9-53dcee4c04ce tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:02.464685 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-772545bc-6463-4020-85d9-53dcee4c04ce tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:02.465149 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-772545bc-6463-4020-85d9-53dcee4c04ce tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:02.465585 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-772545bc-6463-4020-85d9-53dcee4c04ce tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:03.049770 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-772545bc-6463-4020-85d9-53dcee4c04ce tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:03.054046 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-33032bed-ebc0-4a23-89f6-fab9a9b0935d tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:03.065398 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-772545bc-6463-4020-85d9-53dcee4c04ce tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2" status: 200 len: 1497 microversion: 2.1 time: 0.627528 Sep 10 11:52:03.068122 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-33032bed-ebc0-4a23-89f6-fab9a9b0935d tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1518 microversion: 2.1 time: 0.670347 Sep 10 11:52:03.069657 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1423/2923] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:02 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1518 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:03.076482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7d361c42-3468-483d-8ceb-e1a541c0064c tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:03.077981 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7d361c42-3468-483d-8ceb-e1a541c0064c tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:03.083762 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1501/2924] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:02 2022] GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2 => generated 1497 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:03.087115 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d361c42-3468-483d-8ceb-e1a541c0064c tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:03.088386 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d361c42-3468-483d-8ceb-e1a541c0064c tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:03.089210 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d361c42-3468-483d-8ceb-e1a541c0064c tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:03.090105 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d361c42-3468-483d-8ceb-e1a541c0064c tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:03.090714 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d361c42-3468-483d-8ceb-e1a541c0064c tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:03.091376 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d361c42-3468-483d-8ceb-e1a541c0064c tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:03.095667 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7be5de4e-7fd3-47de-9fd7-27e76addf706 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:03.106756 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7be5de4e-7fd3-47de-9fd7-27e76addf706 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] [instance: 402b5cd2-03cd-4c59-b1fb-757b8c03b3e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:03.114656 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7be5de4e-7fd3-47de-9fd7-27e76addf706 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:03.115384 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7be5de4e-7fd3-47de-9fd7-27e76addf706 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:03.115938 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7be5de4e-7fd3-47de-9fd7-27e76addf706 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:03.116786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7be5de4e-7fd3-47de-9fd7-27e76addf706 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:03.117479 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7be5de4e-7fd3-47de-9fd7-27e76addf706 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:03.118136 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7be5de4e-7fd3-47de-9fd7-27e76addf706 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:03.486760 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7d361c42-3468-483d-8ceb-e1a541c0064c tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:03.500525 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7be5de4e-7fd3-47de-9fd7-27e76addf706 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d0aaa7b7a34bb4bcea483bb41276aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d7fd11fb84c86b66362074c1ca8a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:03.504445 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7d361c42-3468-483d-8ceb-e1a541c0064c tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1524 microversion: 2.1 time: 0.433550 Sep 10 11:52:03.505043 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1424/2925] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:03 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1524 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:03.509642 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d08ac963-5ddb-4c80-912a-f62fef0784e2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:03.510252 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d08ac963-5ddb-4c80-912a-f62fef0784e2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:03.512070 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7be5de4e-7fd3-47de-9fd7-27e76addf706 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] 10.222.0.23 "GET /compute/v2.1/servers/402b5cd2-03cd-4c59-b1fb-757b8c03b3e2" status: 200 len: 1352 microversion: 2.1 time: 0.424813 Sep 10 11:52:03.515826 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1502/2926] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:03 2022] GET /compute/v2.1/servers/402b5cd2-03cd-4c59-b1fb-757b8c03b3e2 => generated 1352 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:03.524193 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d08ac963-5ddb-4c80-912a-f62fef0784e2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:03.524685 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d08ac963-5ddb-4c80-912a-f62fef0784e2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:03.525124 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d08ac963-5ddb-4c80-912a-f62fef0784e2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:03.525840 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d08ac963-5ddb-4c80-912a-f62fef0784e2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:03.526284 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d08ac963-5ddb-4c80-912a-f62fef0784e2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:03.526703 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d08ac963-5ddb-4c80-912a-f62fef0784e2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:03.704896 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d08ac963-5ddb-4c80-912a-f62fef0784e2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:03.726928 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d08ac963-5ddb-4c80-912a-f62fef0784e2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:03.728644 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d08ac963-5ddb-4c80-912a-f62fef0784e2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:03.734722 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d08ac963-5ddb-4c80-912a-f62fef0784e2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1558 microversion: 2.91 time: 0.228632 Sep 10 11:52:03.737120 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1425/2927] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:03 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1558 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:04.036726 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-40c7c905-02ac-4883-ac7f-ea65cca47cf7 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1314576037", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ca04eb86-9cd3-452a-acd7-d2607c9b7fc0"}], "security_groups": [{"name": "tempest-securitygroup--1294486599"}], "key_name": "tempest-keypair-891424763", "user_data": "}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:52:04.112722 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fdb882ac-e508-4137-8ec6-ce2f3f36acb9 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:04.113482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fdb882ac-e508-4137-8ec6-ce2f3f36acb9 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:04.134464 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fdb882ac-e508-4137-8ec6-ce2f3f36acb9 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:04.138389 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fdb882ac-e508-4137-8ec6-ce2f3f36acb9 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:04.139613 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fdb882ac-e508-4137-8ec6-ce2f3f36acb9 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:04.142415 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fdb882ac-e508-4137-8ec6-ce2f3f36acb9 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:04.143724 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fdb882ac-e508-4137-8ec6-ce2f3f36acb9 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:04.145175 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fdb882ac-e508-4137-8ec6-ce2f3f36acb9 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:04.408500 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-40c7c905-02ac-4883-ac7f-ea65cca47cf7 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] validate_networks() for [('ca04eb86-9cd3-452a-acd7-d2607c9b7fc0', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:52:04.623658 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fdb882ac-e508-4137-8ec6-ce2f3f36acb9 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:04.633533 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fdb882ac-e508-4137-8ec6-ce2f3f36acb9 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1518 microversion: 2.1 time: 0.528744 Sep 10 11:52:04.634145 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1426/2928] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:04 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1518 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:04.646923 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-6bf6d7db-b073-40c9-b66a-35d0873b38ef req-9fa64ed0-3add-4278-a6ab-abe3e436c277 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f74f15ef-04b5-4313-b90f-20b96291734b", "tag": "db9651b2-3db5-4e9b-9153-56055a48ba72"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:52:04.665468 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6bf6d7db-b073-40c9-b66a-35d0873b38ef req-9fa64ed0-3add-4278-a6ab-abe3e436c277 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:04.666022 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6bf6d7db-b073-40c9-b66a-35d0873b38ef req-9fa64ed0-3add-4278-a6ab-abe3e436c277 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:04.666470 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6bf6d7db-b073-40c9-b66a-35d0873b38ef req-9fa64ed0-3add-4278-a6ab-abe3e436c277 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:04.714190 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-6bf6d7db-b073-40c9-b66a-35d0873b38ef req-9fa64ed0-3add-4278-a6ab-abe3e436c277 service nova] Creating event network-changed:db9651b2-3db5-4e9b-9153-56055a48ba72 for instance f74f15ef-04b5-4313-b90f-20b96291734b on n-h2-856895-1 Sep 10 11:52:04.735731 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-6bf6d7db-b073-40c9-b66a-35d0873b38ef req-9fa64ed0-3add-4278-a6ab-abe3e436c277 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099658 Sep 10 11:52:04.736561 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1427/2929] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:52:04.742311 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bdd0eb61-3249-4916-b427-b05763033a94 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:04.756567 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bdd0eb61-3249-4916-b427-b05763033a94 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 7c17b066-2297-4d76-adcb-abae0e87a3c2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:04.762236 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:52:04.764370 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bdd0eb61-3249-4916-b427-b05763033a94 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:04.764868 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bdd0eb61-3249-4916-b427-b05763033a94 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:04.765313 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bdd0eb61-3249-4916-b427-b05763033a94 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:04.772522 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bdd0eb61-3249-4916-b427-b05763033a94 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:04.773030 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bdd0eb61-3249-4916-b427-b05763033a94 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:04.773487 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bdd0eb61-3249-4916-b427-b05763033a94 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:05.873405 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bdd0eb61-3249-4916-b427-b05763033a94 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:05.902663 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bdd0eb61-3249-4916-b427-b05763033a94 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2" status: 200 len: 1497 microversion: 2.1 time: 1.160979 Sep 10 11:52:05.903325 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1428/2930] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:04 2022] GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2 => generated 1497 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:05.930499 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f1ea7693-e70d-4ba7-b856-a804dce7ae1f tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:05.945604 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f1ea7693-e70d-4ba7-b856-a804dce7ae1f tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:05.964088 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1ea7693-e70d-4ba7-b856-a804dce7ae1f tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:05.964809 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1ea7693-e70d-4ba7-b856-a804dce7ae1f tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:05.965410 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1ea7693-e70d-4ba7-b856-a804dce7ae1f tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:05.966325 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1ea7693-e70d-4ba7-b856-a804dce7ae1f tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:05.969000 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1ea7693-e70d-4ba7-b856-a804dce7ae1f tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:05.970419 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1ea7693-e70d-4ba7-b856-a804dce7ae1f tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:06.185696 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-40c7c905-02ac-4883-ac7f-ea65cca47cf7 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:52:06.186235 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-40c7c905-02ac-4883-ac7f-ea65cca47cf7 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:52:06.186718 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-40c7c905-02ac-4883-ac7f-ea65cca47cf7 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:52:06.187498 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-40c7c905-02ac-4883-ac7f-ea65cca47cf7 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:52:06.189117 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-40c7c905-02ac-4883-ac7f-ea65cca47cf7 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:52:06.229046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40c7c905-02ac-4883-ac7f-ea65cca47cf7 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:06.229810 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40c7c905-02ac-4883-ac7f-ea65cca47cf7 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:06.230715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40c7c905-02ac-4883-ac7f-ea65cca47cf7 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:06.231766 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40c7c905-02ac-4883-ac7f-ea65cca47cf7 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:06.232471 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40c7c905-02ac-4883-ac7f-ea65cca47cf7 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:06.233190 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40c7c905-02ac-4883-ac7f-ea65cca47cf7 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:06.263573 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-40c7c905-02ac-4883-ac7f-ea65cca47cf7 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Getting quotas for project 66677b88ab6b436da8477f213df0ed1d. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:52:06.266372 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f1ea7693-e70d-4ba7-b856-a804dce7ae1f tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:06.276325 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f1ea7693-e70d-4ba7-b856-a804dce7ae1f tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1524 microversion: 2.1 time: 0.349559 Sep 10 11:52:06.279791 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1429/2931] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:05 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1524 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:06.283465 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-40c7c905-02ac-4883-ac7f-ea65cca47cf7 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Getting quotas for user 20a5848b40dc4fbaa2a25a41d92d383a and project 66677b88ab6b436da8477f213df0ed1d. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:52:06.290637 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6f50f032-d5f7-4c8a-a1bc-7bb6b8d2aef5 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:06.294011 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6f50f032-d5f7-4c8a-a1bc-7bb6b8d2aef5 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] [instance: 402b5cd2-03cd-4c59-b1fb-757b8c03b3e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:06.301408 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f50f032-d5f7-4c8a-a1bc-7bb6b8d2aef5 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:06.301915 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f50f032-d5f7-4c8a-a1bc-7bb6b8d2aef5 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:06.302337 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f50f032-d5f7-4c8a-a1bc-7bb6b8d2aef5 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:06.303046 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f50f032-d5f7-4c8a-a1bc-7bb6b8d2aef5 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:06.303527 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f50f032-d5f7-4c8a-a1bc-7bb6b8d2aef5 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:06.304052 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f50f032-d5f7-4c8a-a1bc-7bb6b8d2aef5 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:06.304603 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-40c7c905-02ac-4883-ac7f-ea65cca47cf7 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:52:06.307576 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-40c7c905-02ac-4883-ac7f-ea65cca47cf7 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:52:06.418048 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-40c7c905-02ac-4883-ac7f-ea65cca47cf7 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.386240 Sep 10 11:52:06.423530 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1503/2932] 10.222.0.23 () {62 vars in 1188 bytes} [Sat Sep 10 11:52:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 2392 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 10 11:52:06.443073 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f5da3376-dd7d-47bf-bfd0-f4a2ef46a49d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:06.445895 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f5da3376-dd7d-47bf-bfd0-f4a2ef46a49d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:06.476015 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f5da3376-dd7d-47bf-bfd0-f4a2ef46a49d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:06.476806 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f5da3376-dd7d-47bf-bfd0-f4a2ef46a49d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:06.478301 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f5da3376-dd7d-47bf-bfd0-f4a2ef46a49d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:06.479638 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f5da3376-dd7d-47bf-bfd0-f4a2ef46a49d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:06.482747 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f5da3376-dd7d-47bf-bfd0-f4a2ef46a49d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:06.483480 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f5da3376-dd7d-47bf-bfd0-f4a2ef46a49d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:06.629850 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f5da3376-dd7d-47bf-bfd0-f4a2ef46a49d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:06.634875 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6f50f032-d5f7-4c8a-a1bc-7bb6b8d2aef5 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d0aaa7b7a34bb4bcea483bb41276aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d7fd11fb84c86b66362074c1ca8a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:06.673125 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6f50f032-d5f7-4c8a-a1bc-7bb6b8d2aef5 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] 10.222.0.23 "GET /compute/v2.1/servers/402b5cd2-03cd-4c59-b1fb-757b8c03b3e2" status: 200 len: 1543 microversion: 2.1 time: 0.391641 Sep 10 11:52:06.675888 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f5da3376-dd7d-47bf-bfd0-f4a2ef46a49d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:06.677400 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f5da3376-dd7d-47bf-bfd0-f4a2ef46a49d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:06.679234 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1430/2933] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:06 2022] GET /compute/v2.1/servers/402b5cd2-03cd-4c59-b1fb-757b8c03b3e2 => generated 1543 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:06.684160 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-90af5ad7-08ed-4fa7-bedd-66c734cdadfe tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:06.686349 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-90af5ad7-08ed-4fa7-bedd-66c734cdadfe tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:06.697404 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f5da3376-dd7d-47bf-bfd0-f4a2ef46a49d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1553 microversion: 2.91 time: 0.272126 Sep 10 11:52:06.698281 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1504/2934] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:06 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1553 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:06.701666 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90af5ad7-08ed-4fa7-bedd-66c734cdadfe tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:06.703723 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90af5ad7-08ed-4fa7-bedd-66c734cdadfe tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:06.705522 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90af5ad7-08ed-4fa7-bedd-66c734cdadfe tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:06.706416 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90af5ad7-08ed-4fa7-bedd-66c734cdadfe tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:06.708392 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-36accd3f-8941-4d81-abab-a040bed310a0 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:06.709023 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90af5ad7-08ed-4fa7-bedd-66c734cdadfe tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:06.709909 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90af5ad7-08ed-4fa7-bedd-66c734cdadfe tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:06.712962 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-36accd3f-8941-4d81-abab-a040bed310a0 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:07.010644 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-36accd3f-8941-4d81-abab-a040bed310a0 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:07.030913 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-36accd3f-8941-4d81-abab-a040bed310a0 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:07.070195 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-36accd3f-8941-4d81-abab-a040bed310a0 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:07.071492 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-36accd3f-8941-4d81-abab-a040bed310a0 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1281 microversion: 2.20 time: 0.371581 Sep 10 11:52:07.072097 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1505/2935] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:06 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1281 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:07.092497 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0f907c6a-0426-4508-9952-84072f65dff0 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:07.093494 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0f907c6a-0426-4508-9952-84072f65dff0 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] [instance: 402b5cd2-03cd-4c59-b1fb-757b8c03b3e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:07.108221 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0f907c6a-0426-4508-9952-84072f65dff0 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:07.109015 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0f907c6a-0426-4508-9952-84072f65dff0 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:07.109626 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0f907c6a-0426-4508-9952-84072f65dff0 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:07.111100 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0f907c6a-0426-4508-9952-84072f65dff0 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:07.112564 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0f907c6a-0426-4508-9952-84072f65dff0 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:07.113341 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0f907c6a-0426-4508-9952-84072f65dff0 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:07.145292 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-90af5ad7-08ed-4fa7-bedd-66c734cdadfe tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:07.158811 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-90af5ad7-08ed-4fa7-bedd-66c734cdadfe tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1518 microversion: 2.1 time: 0.478279 Sep 10 11:52:07.177017 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1431/2936] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:06 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1518 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:07.184083 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-75a7f9dc-d2ff-43e8-908e-a8bf55ca10a3 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:07.186080 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-75a7f9dc-d2ff-43e8-908e-a8bf55ca10a3 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 7c17b066-2297-4d76-adcb-abae0e87a3c2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:07.218428 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75a7f9dc-d2ff-43e8-908e-a8bf55ca10a3 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:07.218940 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75a7f9dc-d2ff-43e8-908e-a8bf55ca10a3 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:07.221736 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75a7f9dc-d2ff-43e8-908e-a8bf55ca10a3 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:07.225895 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75a7f9dc-d2ff-43e8-908e-a8bf55ca10a3 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:07.227914 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75a7f9dc-d2ff-43e8-908e-a8bf55ca10a3 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:07.228559 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75a7f9dc-d2ff-43e8-908e-a8bf55ca10a3 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:07.301501 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0f907c6a-0426-4508-9952-84072f65dff0 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] 10.222.0.23 "GET /compute/v2.1/servers/402b5cd2-03cd-4c59-b1fb-757b8c03b3e2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.226820 Sep 10 11:52:07.302428 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1506/2937] 10.222.0.23 () {58 vars in 1275 bytes} [Sat Sep 10 11:52:07 2022] GET /compute/v2.1/servers/402b5cd2-03cd-4c59-b1fb-757b8c03b3e2/os-interface => generated 285 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:52:07.308432 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ebff4ebd-fab4-4897-a4a9-e56562fbe7a5 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:07.309172 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ebff4ebd-fab4-4897-a4a9-e56562fbe7a5 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:07.331061 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ebff4ebd-fab4-4897-a4a9-e56562fbe7a5 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:07.331489 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ebff4ebd-fab4-4897-a4a9-e56562fbe7a5 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:07.334274 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ebff4ebd-fab4-4897-a4a9-e56562fbe7a5 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:07.335011 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ebff4ebd-fab4-4897-a4a9-e56562fbe7a5 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:07.335508 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ebff4ebd-fab4-4897-a4a9-e56562fbe7a5 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:07.338176 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ebff4ebd-fab4-4897-a4a9-e56562fbe7a5 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:07.853834 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-75a7f9dc-d2ff-43e8-908e-a8bf55ca10a3 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:07.867517 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-75a7f9dc-d2ff-43e8-908e-a8bf55ca10a3 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2" status: 200 len: 1497 microversion: 2.1 time: 0.689006 Sep 10 11:52:07.879188 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1432/2938] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:07 2022] GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2 => generated 1497 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:07.879415 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-59b1592f-e9d3-40fd-8d8c-e4d4922e5fa2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:07.880374 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-59b1592f-e9d3-40fd-8d8c-e4d4922e5fa2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:07.891454 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-59b1592f-e9d3-40fd-8d8c-e4d4922e5fa2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:07.898829 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ebff4ebd-fab4-4897-a4a9-e56562fbe7a5 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:07.906273 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-59b1592f-e9d3-40fd-8d8c-e4d4922e5fa2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:07.908854 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ebff4ebd-fab4-4897-a4a9-e56562fbe7a5 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1524 microversion: 2.1 time: 0.604418 Sep 10 11:52:07.912303 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-59b1592f-e9d3-40fd-8d8c-e4d4922e5fa2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:07.914368 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1507/2939] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:07 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1524 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:07.914838 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-59b1592f-e9d3-40fd-8d8c-e4d4922e5fa2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:07.915470 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-59b1592f-e9d3-40fd-8d8c-e4d4922e5fa2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:07.915953 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-59b1592f-e9d3-40fd-8d8c-e4d4922e5fa2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:07.968930 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:52:08.089125 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-59b1592f-e9d3-40fd-8d8c-e4d4922e5fa2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:08.103855 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4ca5203a-f886-4f35-8c3b-9e1d01827072 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:08.104560 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4ca5203a-f886-4f35-8c3b-9e1d01827072 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:08.116254 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-59b1592f-e9d3-40fd-8d8c-e4d4922e5fa2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:08.125224 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-59b1592f-e9d3-40fd-8d8c-e4d4922e5fa2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:08.143680 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-59b1592f-e9d3-40fd-8d8c-e4d4922e5fa2 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1553 microversion: 2.91 time: 0.273070 Sep 10 11:52:08.144132 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ca5203a-f886-4f35-8c3b-9e1d01827072 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:08.145428 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1433/2940] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:07 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1553 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:08.146431 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ca5203a-f886-4f35-8c3b-9e1d01827072 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:08.147202 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ca5203a-f886-4f35-8c3b-9e1d01827072 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:08.148261 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ca5203a-f886-4f35-8c3b-9e1d01827072 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:08.149158 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ca5203a-f886-4f35-8c3b-9e1d01827072 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:08.150215 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ca5203a-f886-4f35-8c3b-9e1d01827072 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:08.187595 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b811eea4-7791-4f0c-be8e-aeca71650b5b tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:08.188347 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b811eea4-7791-4f0c-be8e-aeca71650b5b tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:08.214869 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b811eea4-7791-4f0c-be8e-aeca71650b5b tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:08.215514 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b811eea4-7791-4f0c-be8e-aeca71650b5b tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:08.215973 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b811eea4-7791-4f0c-be8e-aeca71650b5b tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:08.216717 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b811eea4-7791-4f0c-be8e-aeca71650b5b tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:08.217250 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b811eea4-7791-4f0c-be8e-aeca71650b5b tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:08.217594 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b811eea4-7791-4f0c-be8e-aeca71650b5b tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:08.426876 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4ca5203a-f886-4f35-8c3b-9e1d01827072 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:08.442509 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4ca5203a-f886-4f35-8c3b-9e1d01827072 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:08.444389 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4ca5203a-f886-4f35-8c3b-9e1d01827072 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:08.445746 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4ca5203a-f886-4f35-8c3b-9e1d01827072 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1333 microversion: 2.20 time: 0.347244 Sep 10 11:52:08.459626 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1508/2941] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:08 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1333 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:08.622997 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b811eea4-7791-4f0c-be8e-aeca71650b5b tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:08.633326 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b811eea4-7791-4f0c-be8e-aeca71650b5b tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1518 microversion: 2.1 time: 0.449857 Sep 10 11:52:08.652245 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1434/2942] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:08 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1518 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:52:08.898396 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e81810c9-2671-43cd-9468-0c6fa3a9ad4f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:08.899496 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e81810c9-2671-43cd-9468-0c6fa3a9ad4f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 7c17b066-2297-4d76-adcb-abae0e87a3c2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:08.938698 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d2238e12-197b-4aa8-9f84-56d4451069fa tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:08.940241 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d2238e12-197b-4aa8-9f84-56d4451069fa tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:08.945642 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e81810c9-2671-43cd-9468-0c6fa3a9ad4f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:08.949295 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e81810c9-2671-43cd-9468-0c6fa3a9ad4f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:08.949919 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e81810c9-2671-43cd-9468-0c6fa3a9ad4f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:08.951048 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2238e12-197b-4aa8-9f84-56d4451069fa tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:08.951755 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2238e12-197b-4aa8-9f84-56d4451069fa tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:08.952396 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2238e12-197b-4aa8-9f84-56d4451069fa tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:08.953194 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2238e12-197b-4aa8-9f84-56d4451069fa tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:08.955641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e81810c9-2671-43cd-9468-0c6fa3a9ad4f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:08.956283 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2238e12-197b-4aa8-9f84-56d4451069fa tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:08.958421 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e81810c9-2671-43cd-9468-0c6fa3a9ad4f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:08.958907 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e81810c9-2671-43cd-9468-0c6fa3a9ad4f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:08.959140 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2238e12-197b-4aa8-9f84-56d4451069fa tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:09.320427 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d2238e12-197b-4aa8-9f84-56d4451069fa tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:09.330453 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d2238e12-197b-4aa8-9f84-56d4451069fa tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1524 microversion: 2.1 time: 0.396282 Sep 10 11:52:09.337607 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1435/2943] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:08 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1524 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:09.343329 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-42245d10-e215-486f-8c5b-a9bf697bcb6e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:09.354682 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-42245d10-e215-486f-8c5b-a9bf697bcb6e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:09.364503 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42245d10-e215-486f-8c5b-a9bf697bcb6e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:09.365012 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42245d10-e215-486f-8c5b-a9bf697bcb6e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:09.365584 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42245d10-e215-486f-8c5b-a9bf697bcb6e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:09.366578 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42245d10-e215-486f-8c5b-a9bf697bcb6e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:09.367048 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42245d10-e215-486f-8c5b-a9bf697bcb6e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:09.367590 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42245d10-e215-486f-8c5b-a9bf697bcb6e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:09.417806 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e81810c9-2671-43cd-9468-0c6fa3a9ad4f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:09.425917 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e81810c9-2671-43cd-9468-0c6fa3a9ad4f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2" status: 200 len: 1497 microversion: 2.1 time: 0.535456 Sep 10 11:52:09.426491 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1509/2944] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:08 2022] GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2 => generated 1497 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:52:09.474974 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d4a5a7c8-8564-461e-9296-114645403532 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:09.476299 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d4a5a7c8-8564-461e-9296-114645403532 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:09.485097 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d4a5a7c8-8564-461e-9296-114645403532 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:09.489269 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d4a5a7c8-8564-461e-9296-114645403532 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:09.490295 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d4a5a7c8-8564-461e-9296-114645403532 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:09.491269 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d4a5a7c8-8564-461e-9296-114645403532 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:09.493783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d4a5a7c8-8564-461e-9296-114645403532 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:09.494419 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d4a5a7c8-8564-461e-9296-114645403532 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:09.528402 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-42245d10-e215-486f-8c5b-a9bf697bcb6e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:09.543253 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-42245d10-e215-486f-8c5b-a9bf697bcb6e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:09.544766 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-42245d10-e215-486f-8c5b-a9bf697bcb6e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:09.566147 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-42245d10-e215-486f-8c5b-a9bf697bcb6e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1553 microversion: 2.91 time: 0.226815 Sep 10 11:52:09.570412 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1436/2945] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:09 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1553 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:09.610834 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d4a5a7c8-8564-461e-9296-114645403532 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:09.621057 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=100 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:52:09.628311 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d4a5a7c8-8564-461e-9296-114645403532 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:09.634676 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d4a5a7c8-8564-461e-9296-114645403532 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:09.636960 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d4a5a7c8-8564-461e-9296-114645403532 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1339 microversion: 2.20 time: 0.166032 Sep 10 11:52:09.655121 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1510/2946] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:09 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1339 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:09.667212 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5f07405b-20ec-41fd-b2f5-027bd294a351 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:09.668246 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5f07405b-20ec-41fd-b2f5-027bd294a351 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:09.698473 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5f07405b-20ec-41fd-b2f5-027bd294a351 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:09.698999 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5f07405b-20ec-41fd-b2f5-027bd294a351 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:09.708507 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5f07405b-20ec-41fd-b2f5-027bd294a351 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:09.710910 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5f07405b-20ec-41fd-b2f5-027bd294a351 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:09.713600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5f07405b-20ec-41fd-b2f5-027bd294a351 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:09.720856 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5f07405b-20ec-41fd-b2f5-027bd294a351 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:09.997088 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-f520035f-585e-4722-bcf5-c9cd466bcf42 req-a80e89ee-019b-46f8-a4ae-ed694d063840 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "402b5cd2-03cd-4c59-b1fb-757b8c03b3e2", "tag": "65a0f5b9-a99d-4243-bb34-98369eceac63"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:52:10.018152 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-f520035f-585e-4722-bcf5-c9cd466bcf42 req-a80e89ee-019b-46f8-a4ae-ed694d063840 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:10.019070 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-f520035f-585e-4722-bcf5-c9cd466bcf42 req-a80e89ee-019b-46f8-a4ae-ed694d063840 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:10.019789 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-f520035f-585e-4722-bcf5-c9cd466bcf42 req-a80e89ee-019b-46f8-a4ae-ed694d063840 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:10.036885 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-f520035f-585e-4722-bcf5-c9cd466bcf42 req-a80e89ee-019b-46f8-a4ae-ed694d063840 service nova] Creating event network-changed:65a0f5b9-a99d-4243-bb34-98369eceac63 for instance 402b5cd2-03cd-4c59-b1fb-757b8c03b3e2 on n-h1-856895-1 Sep 10 11:52:10.047345 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-f520035f-585e-4722-bcf5-c9cd466bcf42 req-a80e89ee-019b-46f8-a4ae-ed694d063840 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054130 Sep 10 11:52:10.051105 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1511/2947] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:52:10.070828 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5f07405b-20ec-41fd-b2f5-027bd294a351 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:10.086807 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5f07405b-20ec-41fd-b2f5-027bd294a351 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1518 microversion: 2.1 time: 0.417805 Sep 10 11:52:10.087835 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1437/2948] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:09 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1518 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:10.362290 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-41dab38f-5660-4afa-a8f0-979693abeea7 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:10.363709 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-41dab38f-5660-4afa-a8f0-979693abeea7 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:10.379190 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-41dab38f-5660-4afa-a8f0-979693abeea7 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:10.380065 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-41dab38f-5660-4afa-a8f0-979693abeea7 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:10.380749 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-41dab38f-5660-4afa-a8f0-979693abeea7 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:10.381569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-41dab38f-5660-4afa-a8f0-979693abeea7 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:10.382131 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-41dab38f-5660-4afa-a8f0-979693abeea7 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:10.382688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-41dab38f-5660-4afa-a8f0-979693abeea7 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:10.454103 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b58d3007-0163-4627-a254-4dab751330fa tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:10.454849 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b58d3007-0163-4627-a254-4dab751330fa tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 7c17b066-2297-4d76-adcb-abae0e87a3c2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:10.467848 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b58d3007-0163-4627-a254-4dab751330fa tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:10.468346 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b58d3007-0163-4627-a254-4dab751330fa tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:10.468790 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b58d3007-0163-4627-a254-4dab751330fa tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:10.469808 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b58d3007-0163-4627-a254-4dab751330fa tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:10.470279 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b58d3007-0163-4627-a254-4dab751330fa tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:10.470716 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b58d3007-0163-4627-a254-4dab751330fa tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:10.661985 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-41dab38f-5660-4afa-a8f0-979693abeea7 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:10.681966 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-41dab38f-5660-4afa-a8f0-979693abeea7 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1524 microversion: 2.1 time: 0.323996 Sep 10 11:52:10.682577 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1512/2949] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:10 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1524 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:10.687224 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c16cdf43-bffc-4819-95ab-02769b3fb9b7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:10.687902 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c16cdf43-bffc-4819-95ab-02769b3fb9b7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:10.707103 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c16cdf43-bffc-4819-95ab-02769b3fb9b7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:10.707655 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c16cdf43-bffc-4819-95ab-02769b3fb9b7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:10.708107 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c16cdf43-bffc-4819-95ab-02769b3fb9b7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:10.708829 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c16cdf43-bffc-4819-95ab-02769b3fb9b7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:10.709297 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c16cdf43-bffc-4819-95ab-02769b3fb9b7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:10.709733 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c16cdf43-bffc-4819-95ab-02769b3fb9b7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:10.841419 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c16cdf43-bffc-4819-95ab-02769b3fb9b7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:10.852238 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c16cdf43-bffc-4819-95ab-02769b3fb9b7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:10.856986 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c16cdf43-bffc-4819-95ab-02769b3fb9b7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:10.867049 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b58d3007-0163-4627-a254-4dab751330fa tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:10.876924 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b58d3007-0163-4627-a254-4dab751330fa tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2" status: 200 len: 1497 microversion: 2.1 time: 0.427351 Sep 10 11:52:10.880937 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c16cdf43-bffc-4819-95ab-02769b3fb9b7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1553 microversion: 2.91 time: 0.197290 Sep 10 11:52:10.882172 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1438/2950] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:10 2022] GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2 => generated 1497 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:10.884538 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1513/2951] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:10 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1553 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:10.901523 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-593fc77f-94f7-404a-b0ac-13463d12c4df tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:10.905620 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-593fc77f-94f7-404a-b0ac-13463d12c4df tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:10.919117 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-593fc77f-94f7-404a-b0ac-13463d12c4df tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:10.919949 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-593fc77f-94f7-404a-b0ac-13463d12c4df tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:10.923743 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-593fc77f-94f7-404a-b0ac-13463d12c4df tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:10.925355 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-593fc77f-94f7-404a-b0ac-13463d12c4df tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:10.926017 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-593fc77f-94f7-404a-b0ac-13463d12c4df tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:10.926625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-593fc77f-94f7-404a-b0ac-13463d12c4df tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:11.036200 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-593fc77f-94f7-404a-b0ac-13463d12c4df tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:11.055621 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-593fc77f-94f7-404a-b0ac-13463d12c4df tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:11.058009 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-593fc77f-94f7-404a-b0ac-13463d12c4df tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:11.060731 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-593fc77f-94f7-404a-b0ac-13463d12c4df tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1339 microversion: 2.20 time: 0.177019 Sep 10 11:52:11.062445 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1439/2952] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:10 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1339 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:11.120164 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cd9eeb11-442c-43f7-a978-e4f64bb8d1da tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:11.122338 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cd9eeb11-442c-43f7-a978-e4f64bb8d1da tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:11.134944 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd9eeb11-442c-43f7-a978-e4f64bb8d1da tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:11.136627 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd9eeb11-442c-43f7-a978-e4f64bb8d1da tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:11.137400 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd9eeb11-442c-43f7-a978-e4f64bb8d1da tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:11.139068 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd9eeb11-442c-43f7-a978-e4f64bb8d1da tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:11.140155 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd9eeb11-442c-43f7-a978-e4f64bb8d1da tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:11.140772 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd9eeb11-442c-43f7-a978-e4f64bb8d1da tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:11.383580 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cd9eeb11-442c-43f7-a978-e4f64bb8d1da tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:11.419196 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cd9eeb11-442c-43f7-a978-e4f64bb8d1da tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1518 microversion: 2.1 time: 0.304843 Sep 10 11:52:11.420538 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1514/2953] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:11 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1518 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:11.714031 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-95ef31cc-ee80-4e89-bda6-65e1580100c7 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:11.715415 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-95ef31cc-ee80-4e89-bda6-65e1580100c7 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:11.736630 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-95ef31cc-ee80-4e89-bda6-65e1580100c7 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:11.737822 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-95ef31cc-ee80-4e89-bda6-65e1580100c7 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:11.739475 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-95ef31cc-ee80-4e89-bda6-65e1580100c7 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:11.741124 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-95ef31cc-ee80-4e89-bda6-65e1580100c7 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:11.742103 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-95ef31cc-ee80-4e89-bda6-65e1580100c7 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:11.743533 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-95ef31cc-ee80-4e89-bda6-65e1580100c7 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:11.910611 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0b3cc7cf-774b-4d56-90fc-b81d7bbd1580 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:11.912452 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0b3cc7cf-774b-4d56-90fc-b81d7bbd1580 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 7c17b066-2297-4d76-adcb-abae0e87a3c2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:11.936415 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0b3cc7cf-774b-4d56-90fc-b81d7bbd1580 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:11.936930 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0b3cc7cf-774b-4d56-90fc-b81d7bbd1580 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:11.937381 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0b3cc7cf-774b-4d56-90fc-b81d7bbd1580 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:11.938206 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0b3cc7cf-774b-4d56-90fc-b81d7bbd1580 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:11.938672 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0b3cc7cf-774b-4d56-90fc-b81d7bbd1580 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:11.939267 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0b3cc7cf-774b-4d56-90fc-b81d7bbd1580 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:12.115254 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=4 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:52:12.562169 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-95ef31cc-ee80-4e89-bda6-65e1580100c7 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:12.574616 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-95ef31cc-ee80-4e89-bda6-65e1580100c7 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1524 microversion: 2.1 time: 0.867458 Sep 10 11:52:12.581727 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1440/2954] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:11 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1524 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:12.586648 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bef4b5a1-32fe-481f-bb35-cb6823fd2bcb tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:12.589797 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bef4b5a1-32fe-481f-bb35-cb6823fd2bcb tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:12.603718 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bef4b5a1-32fe-481f-bb35-cb6823fd2bcb tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:12.604513 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bef4b5a1-32fe-481f-bb35-cb6823fd2bcb tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:12.605137 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bef4b5a1-32fe-481f-bb35-cb6823fd2bcb tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:12.612711 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bef4b5a1-32fe-481f-bb35-cb6823fd2bcb tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:12.613457 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bef4b5a1-32fe-481f-bb35-cb6823fd2bcb tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:12.614070 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bef4b5a1-32fe-481f-bb35-cb6823fd2bcb tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:12.629435 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0b3cc7cf-774b-4d56-90fc-b81d7bbd1580 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:12.654336 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0b3cc7cf-774b-4d56-90fc-b81d7bbd1580 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2" status: 200 len: 1497 microversion: 2.1 time: 0.749120 Sep 10 11:52:12.667509 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1515/2955] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:11 2022] GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2 => generated 1497 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:12.685030 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2217ade0-1791-4ecf-9eaa-c7894b6f7376 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:12.690941 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2217ade0-1791-4ecf-9eaa-c7894b6f7376 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:12.708244 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2217ade0-1791-4ecf-9eaa-c7894b6f7376 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:12.709005 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2217ade0-1791-4ecf-9eaa-c7894b6f7376 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:12.709723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2217ade0-1791-4ecf-9eaa-c7894b6f7376 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:12.710729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2217ade0-1791-4ecf-9eaa-c7894b6f7376 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:12.713090 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2217ade0-1791-4ecf-9eaa-c7894b6f7376 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:12.713717 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2217ade0-1791-4ecf-9eaa-c7894b6f7376 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:12.863476 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bef4b5a1-32fe-481f-bb35-cb6823fd2bcb tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:12.877146 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bef4b5a1-32fe-481f-bb35-cb6823fd2bcb tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:12.882074 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bef4b5a1-32fe-481f-bb35-cb6823fd2bcb tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:12.894217 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bef4b5a1-32fe-481f-bb35-cb6823fd2bcb tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1553 microversion: 2.91 time: 0.311153 Sep 10 11:52:12.895421 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1441/2956] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:12 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1553 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:12.901789 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-19111c77-81a0-42cc-bedf-dfb21fcca2de tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:12.906334 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-19111c77-81a0-42cc-bedf-dfb21fcca2de tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:12.920817 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19111c77-81a0-42cc-bedf-dfb21fcca2de tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:12.921624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19111c77-81a0-42cc-bedf-dfb21fcca2de tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:12.923402 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19111c77-81a0-42cc-bedf-dfb21fcca2de tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:12.924337 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19111c77-81a0-42cc-bedf-dfb21fcca2de tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:12.924961 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19111c77-81a0-42cc-bedf-dfb21fcca2de tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:12.925581 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19111c77-81a0-42cc-bedf-dfb21fcca2de tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:12.972256 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2217ade0-1791-4ecf-9eaa-c7894b6f7376 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:12.986455 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2217ade0-1791-4ecf-9eaa-c7894b6f7376 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:12.993226 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2217ade0-1791-4ecf-9eaa-c7894b6f7376 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:12.995298 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2217ade0-1791-4ecf-9eaa-c7894b6f7376 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1407 microversion: 2.20 time: 0.326695 Sep 10 11:52:12.999593 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1516/2957] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:12 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1407 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:13.161153 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-19111c77-81a0-42cc-bedf-dfb21fcca2de tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:13.170179 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-19111c77-81a0-42cc-bedf-dfb21fcca2de tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1518 microversion: 2.1 time: 0.273477 Sep 10 11:52:13.171035 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1442/2958] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:12 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1518 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:13.244722 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-a5ef5aab-64d8-42f2-a39c-02e45c4bd291 req-dabe8b1c-1517-42a2-a4d5-1b98d4ad2a84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61ab78c6-917d-46d1-b3e2-9935ca45c8e2", "tag": "998df393-88c6-4f53-8cdf-ce9cb6efbc62"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:52:13.271289 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a5ef5aab-64d8-42f2-a39c-02e45c4bd291 req-dabe8b1c-1517-42a2-a4d5-1b98d4ad2a84 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:13.273627 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a5ef5aab-64d8-42f2-a39c-02e45c4bd291 req-dabe8b1c-1517-42a2-a4d5-1b98d4ad2a84 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:13.274424 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a5ef5aab-64d8-42f2-a39c-02e45c4bd291 req-dabe8b1c-1517-42a2-a4d5-1b98d4ad2a84 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:13.287569 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-a5ef5aab-64d8-42f2-a39c-02e45c4bd291 req-dabe8b1c-1517-42a2-a4d5-1b98d4ad2a84 service nova] Creating event network-changed:998df393-88c6-4f53-8cdf-ce9cb6efbc62 for instance 61ab78c6-917d-46d1-b3e2-9935ca45c8e2 on n-h2-856895-1 Sep 10 11:52:13.293665 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-a5ef5aab-64d8-42f2-a39c-02e45c4bd291 req-dabe8b1c-1517-42a2-a4d5-1b98d4ad2a84 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055438 Sep 10 11:52:13.294861 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1517/2959] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:52:13.604571 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-690e80c9-97d3-49b3-8f84-dbcec45fe5bf tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:13.605709 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-690e80c9-97d3-49b3-8f84-dbcec45fe5bf tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:13.613458 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-690e80c9-97d3-49b3-8f84-dbcec45fe5bf tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:13.614267 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-690e80c9-97d3-49b3-8f84-dbcec45fe5bf tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:13.615005 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-690e80c9-97d3-49b3-8f84-dbcec45fe5bf tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:13.615984 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-690e80c9-97d3-49b3-8f84-dbcec45fe5bf tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:13.616681 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-690e80c9-97d3-49b3-8f84-dbcec45fe5bf tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:13.617370 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-690e80c9-97d3-49b3-8f84-dbcec45fe5bf tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:13.687291 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9e78ce6b-f312-48c2-a555-4b593bc9ea11 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:13.688584 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9e78ce6b-f312-48c2-a555-4b593bc9ea11 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 7c17b066-2297-4d76-adcb-abae0e87a3c2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:13.697964 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9e78ce6b-f312-48c2-a555-4b593bc9ea11 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:13.698460 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9e78ce6b-f312-48c2-a555-4b593bc9ea11 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:13.699334 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9e78ce6b-f312-48c2-a555-4b593bc9ea11 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:13.700226 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9e78ce6b-f312-48c2-a555-4b593bc9ea11 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:13.700849 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9e78ce6b-f312-48c2-a555-4b593bc9ea11 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:13.701445 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9e78ce6b-f312-48c2-a555-4b593bc9ea11 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:13.908326 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-690e80c9-97d3-49b3-8f84-dbcec45fe5bf tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:13.920959 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-690e80c9-97d3-49b3-8f84-dbcec45fe5bf tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1524 microversion: 2.1 time: 0.320518 Sep 10 11:52:13.921552 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1443/2960] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:13 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1524 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:13.932133 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b5dede67-3460-477b-bd7b-77988cfd2452 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:13.932133 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b5dede67-3460-477b-bd7b-77988cfd2452 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:13.935096 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b5dede67-3460-477b-bd7b-77988cfd2452 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:13.935973 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b5dede67-3460-477b-bd7b-77988cfd2452 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:13.936590 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b5dede67-3460-477b-bd7b-77988cfd2452 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:13.937469 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b5dede67-3460-477b-bd7b-77988cfd2452 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:13.938185 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b5dede67-3460-477b-bd7b-77988cfd2452 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:13.938901 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b5dede67-3460-477b-bd7b-77988cfd2452 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:13.961205 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9e78ce6b-f312-48c2-a555-4b593bc9ea11 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:13.973754 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9e78ce6b-f312-48c2-a555-4b593bc9ea11 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2" status: 200 len: 1497 microversion: 2.1 time: 0.291638 Sep 10 11:52:13.977030 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1518/2961] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:13 2022] GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2 => generated 1497 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:52:14.023195 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b5dede67-3460-477b-bd7b-77988cfd2452 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:14.029014 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1e9dd016-cbe2-4e40-93bc-0fdc47c9ce48 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:14.029739 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1e9dd016-cbe2-4e40-93bc-0fdc47c9ce48 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:14.040039 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b5dede67-3460-477b-bd7b-77988cfd2452 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:14.041566 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1e9dd016-cbe2-4e40-93bc-0fdc47c9ce48 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:14.042072 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1e9dd016-cbe2-4e40-93bc-0fdc47c9ce48 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:14.042519 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1e9dd016-cbe2-4e40-93bc-0fdc47c9ce48 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:14.042648 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b5dede67-3460-477b-bd7b-77988cfd2452 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:14.043258 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1e9dd016-cbe2-4e40-93bc-0fdc47c9ce48 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:14.043898 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1e9dd016-cbe2-4e40-93bc-0fdc47c9ce48 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:14.044497 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1e9dd016-cbe2-4e40-93bc-0fdc47c9ce48 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:14.048972 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b5dede67-3460-477b-bd7b-77988cfd2452 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1553 microversion: 2.91 time: 0.124468 Sep 10 11:52:14.050165 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1444/2962] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:13 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1553 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:14.201317 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-31114923-78f4-46fd-8f8f-3556f63d0ffe tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:14.203285 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-31114923-78f4-46fd-8f8f-3556f63d0ffe tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:14.213293 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-31114923-78f4-46fd-8f8f-3556f63d0ffe tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:14.214140 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-31114923-78f4-46fd-8f8f-3556f63d0ffe tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:14.214950 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-31114923-78f4-46fd-8f8f-3556f63d0ffe tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:14.215915 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-31114923-78f4-46fd-8f8f-3556f63d0ffe tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:14.217908 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-31114923-78f4-46fd-8f8f-3556f63d0ffe tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:14.218747 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-31114923-78f4-46fd-8f8f-3556f63d0ffe tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:14.281254 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1e9dd016-cbe2-4e40-93bc-0fdc47c9ce48 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:14.291467 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1e9dd016-cbe2-4e40-93bc-0fdc47c9ce48 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:14.293618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1e9dd016-cbe2-4e40-93bc-0fdc47c9ce48 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:14.295727 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1e9dd016-cbe2-4e40-93bc-0fdc47c9ce48 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1407 microversion: 2.20 time: 0.276789 Sep 10 11:52:14.314526 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1519/2963] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:14 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1407 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:52:14.455350 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-31114923-78f4-46fd-8f8f-3556f63d0ffe tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:14.478118 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-31114923-78f4-46fd-8f8f-3556f63d0ffe tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1518 microversion: 2.1 time: 0.282259 Sep 10 11:52:14.482483 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1445/2964] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:14 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1518 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:52:14.947660 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8805e922-e735-4c70-936e-b65e1cccd333 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:14.948302 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8805e922-e735-4c70-936e-b65e1cccd333 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:14.957099 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8805e922-e735-4c70-936e-b65e1cccd333 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:14.958405 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8805e922-e735-4c70-936e-b65e1cccd333 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:14.959092 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8805e922-e735-4c70-936e-b65e1cccd333 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:14.959899 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8805e922-e735-4c70-936e-b65e1cccd333 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:14.960526 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8805e922-e735-4c70-936e-b65e1cccd333 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:14.961152 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8805e922-e735-4c70-936e-b65e1cccd333 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:15.000009 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0f547400-3b48-42a6-b396-540cbb7546ae tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:15.001279 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0f547400-3b48-42a6-b396-540cbb7546ae tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 7c17b066-2297-4d76-adcb-abae0e87a3c2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:15.015434 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f547400-3b48-42a6-b396-540cbb7546ae tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:15.030578 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f547400-3b48-42a6-b396-540cbb7546ae tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:15.031277 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f547400-3b48-42a6-b396-540cbb7546ae tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:15.032080 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f547400-3b48-42a6-b396-540cbb7546ae tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:15.032714 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f547400-3b48-42a6-b396-540cbb7546ae tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:15.033157 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f547400-3b48-42a6-b396-540cbb7546ae tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:15.252719 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8805e922-e735-4c70-936e-b65e1cccd333 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:15.269228 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8805e922-e735-4c70-936e-b65e1cccd333 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1524 microversion: 2.1 time: 0.326840 Sep 10 11:52:15.269834 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1520/2965] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:14 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1524 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:15.276666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-464c896b-ca0d-4e12-9601-3449ccf3b1c1 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:15.280552 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-464c896b-ca0d-4e12-9601-3449ccf3b1c1 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:15.293501 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-464c896b-ca0d-4e12-9601-3449ccf3b1c1 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:15.299585 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-464c896b-ca0d-4e12-9601-3449ccf3b1c1 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:15.300229 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-464c896b-ca0d-4e12-9601-3449ccf3b1c1 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:15.301120 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-464c896b-ca0d-4e12-9601-3449ccf3b1c1 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:15.302145 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-464c896b-ca0d-4e12-9601-3449ccf3b1c1 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:15.302782 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-464c896b-ca0d-4e12-9601-3449ccf3b1c1 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:15.310392 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0f547400-3b48-42a6-b396-540cbb7546ae tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:15.331452 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0f547400-3b48-42a6-b396-540cbb7546ae tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2" status: 200 len: 1497 microversion: 2.1 time: 0.333595 Sep 10 11:52:15.332915 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1446/2966] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:14 2022] GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2 => generated 1497 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:52:15.346677 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6ac394d7-1743-4742-8462-648acaccf368 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:15.351203 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6ac394d7-1743-4742-8462-648acaccf368 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:15.390575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6ac394d7-1743-4742-8462-648acaccf368 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:15.391109 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6ac394d7-1743-4742-8462-648acaccf368 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:15.396284 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6ac394d7-1743-4742-8462-648acaccf368 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:15.397058 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6ac394d7-1743-4742-8462-648acaccf368 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:15.402208 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6ac394d7-1743-4742-8462-648acaccf368 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:15.402833 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6ac394d7-1743-4742-8462-648acaccf368 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:15.511423 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-464c896b-ca0d-4e12-9601-3449ccf3b1c1 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:15.521136 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-464c896b-ca0d-4e12-9601-3449ccf3b1c1 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:15.529330 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-464c896b-ca0d-4e12-9601-3449ccf3b1c1 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:15.539843 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-464c896b-ca0d-4e12-9601-3449ccf3b1c1 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1553 microversion: 2.91 time: 0.267571 Sep 10 11:52:15.542425 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1521/2967] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:15 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1553 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:15.559597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-169cfe03-64ae-462e-8fa1-45ff00bbaff1 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:15.560619 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-169cfe03-64ae-462e-8fa1-45ff00bbaff1 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:15.569015 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-169cfe03-64ae-462e-8fa1-45ff00bbaff1 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:15.569534 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-169cfe03-64ae-462e-8fa1-45ff00bbaff1 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:15.569950 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-169cfe03-64ae-462e-8fa1-45ff00bbaff1 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:15.571212 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-169cfe03-64ae-462e-8fa1-45ff00bbaff1 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:15.572059 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-169cfe03-64ae-462e-8fa1-45ff00bbaff1 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:15.572821 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-169cfe03-64ae-462e-8fa1-45ff00bbaff1 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:15.702287 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6ac394d7-1743-4742-8462-648acaccf368 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:15.711128 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6ac394d7-1743-4742-8462-648acaccf368 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:15.715471 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6ac394d7-1743-4742-8462-648acaccf368 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:15.721243 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6ac394d7-1743-4742-8462-648acaccf368 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1407 microversion: 2.20 time: 0.381142 Sep 10 11:52:15.722357 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1447/2968] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:15 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1407 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:15.845276 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-169cfe03-64ae-462e-8fa1-45ff00bbaff1 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:15.856331 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-169cfe03-64ae-462e-8fa1-45ff00bbaff1 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1518 microversion: 2.1 time: 0.312566 Sep 10 11:52:15.857492 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1522/2969] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:15 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1518 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:15.985079 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-24da64c3-c4b9-45ea-8182-859e5f13c842 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1351033987", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "ed12fdc2-38d7-4b26-81da-c8b044592566"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:52:16.054229 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-24da64c3-c4b9-45ea-8182-859e5f13c842 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] validate_networks() for [('ed12fdc2-38d7-4b26-81da-c8b044592566', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:52:16.297228 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cbe0fc4d-02bd-4093-bf24-9cea9cefacce tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:16.301284 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cbe0fc4d-02bd-4093-bf24-9cea9cefacce tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:16.314332 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:52:16.318142 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cbe0fc4d-02bd-4093-bf24-9cea9cefacce tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:16.318625 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cbe0fc4d-02bd-4093-bf24-9cea9cefacce tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:16.319071 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cbe0fc4d-02bd-4093-bf24-9cea9cefacce tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:16.319817 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cbe0fc4d-02bd-4093-bf24-9cea9cefacce tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:16.320304 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cbe0fc4d-02bd-4093-bf24-9cea9cefacce tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:16.322975 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cbe0fc4d-02bd-4093-bf24-9cea9cefacce tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:16.672749 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cbe0fc4d-02bd-4093-bf24-9cea9cefacce tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:16.685518 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cbe0fc4d-02bd-4093-bf24-9cea9cefacce tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1524 microversion: 2.1 time: 0.392173 Sep 10 11:52:16.686278 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1523/2970] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:16 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1524 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:52:16.705500 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e9a152d1-a9b3-414b-be2b-74b188cdbcef tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:16.708666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e9a152d1-a9b3-414b-be2b-74b188cdbcef tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 7c17b066-2297-4d76-adcb-abae0e87a3c2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:16.717600 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e9a152d1-a9b3-414b-be2b-74b188cdbcef tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:16.722817 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e9a152d1-a9b3-414b-be2b-74b188cdbcef tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:16.726725 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e9a152d1-a9b3-414b-be2b-74b188cdbcef tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:16.729534 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e9a152d1-a9b3-414b-be2b-74b188cdbcef tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:16.731337 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e9a152d1-a9b3-414b-be2b-74b188cdbcef tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:16.732143 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e9a152d1-a9b3-414b-be2b-74b188cdbcef tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:16.751768 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-24da64c3-c4b9-45ea-8182-859e5f13c842 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:52:16.752414 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-24da64c3-c4b9-45ea-8182-859e5f13c842 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:52:16.752895 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-24da64c3-c4b9-45ea-8182-859e5f13c842 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:52:16.753553 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-24da64c3-c4b9-45ea-8182-859e5f13c842 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:52:16.753975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-24da64c3-c4b9-45ea-8182-859e5f13c842 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:52:16.763652 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-24da64c3-c4b9-45ea-8182-859e5f13c842 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:16.764350 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-24da64c3-c4b9-45ea-8182-859e5f13c842 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:16.764971 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-24da64c3-c4b9-45ea-8182-859e5f13c842 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:16.765926 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-24da64c3-c4b9-45ea-8182-859e5f13c842 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:16.766899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-24da64c3-c4b9-45ea-8182-859e5f13c842 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:16.767533 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-24da64c3-c4b9-45ea-8182-859e5f13c842 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:16.817869 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-24da64c3-c4b9-45ea-8182-859e5f13c842 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Getting quotas for project 27bed0cb3a46406b92496bee2da42567. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:52:16.844001 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-24da64c3-c4b9-45ea-8182-859e5f13c842 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Getting quotas for user fe7ac57af1c94269bad68b4c8aec52fd and project 27bed0cb3a46406b92496bee2da42567. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:52:16.867557 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-24da64c3-c4b9-45ea-8182-859e5f13c842 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:52:16.870170 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-24da64c3-c4b9-45ea-8182-859e5f13c842 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:52:16.926031 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e9a152d1-a9b3-414b-be2b-74b188cdbcef tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:16.939993 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e9a152d1-a9b3-414b-be2b-74b188cdbcef tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2" status: 200 len: 1497 microversion: 2.1 time: 0.251723 Sep 10 11:52:16.941575 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1524/2971] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:16 2022] GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2 => generated 1497 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:16.947591 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-24da64c3-c4b9-45ea-8182-859e5f13c842 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.163531 Sep 10 11:52:16.949225 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a07cc284-4b26-4a4b-b485-295cf858097f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:16.950184 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a07cc284-4b26-4a4b-b485-295cf858097f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:16.960464 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1448/2972] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:52:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1177 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 11:52:16.966650 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a974aafb-0edd-47bd-9439-021ca730df95 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:16.967500 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a974aafb-0edd-47bd-9439-021ca730df95 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:16.970449 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a07cc284-4b26-4a4b-b485-295cf858097f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:16.972364 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a07cc284-4b26-4a4b-b485-295cf858097f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:16.972830 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a07cc284-4b26-4a4b-b485-295cf858097f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:16.973591 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a07cc284-4b26-4a4b-b485-295cf858097f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:16.974052 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a07cc284-4b26-4a4b-b485-295cf858097f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:16.975804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a974aafb-0edd-47bd-9439-021ca730df95 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:16.979044 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a07cc284-4b26-4a4b-b485-295cf858097f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:16.987429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a974aafb-0edd-47bd-9439-021ca730df95 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:16.988110 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a974aafb-0edd-47bd-9439-021ca730df95 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:16.993240 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a974aafb-0edd-47bd-9439-021ca730df95 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:16.993910 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a974aafb-0edd-47bd-9439-021ca730df95 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:16.994515 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a974aafb-0edd-47bd-9439-021ca730df95 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:17.029236 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=8 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:52:17.097736 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a07cc284-4b26-4a4b-b485-295cf858097f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:17.110929 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a07cc284-4b26-4a4b-b485-295cf858097f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:17.117548 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a07cc284-4b26-4a4b-b485-295cf858097f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:17.126469 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a07cc284-4b26-4a4b-b485-295cf858097f tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1553 microversion: 2.91 time: 0.183845 Sep 10 11:52:17.155938 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1525/2973] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:16 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1553 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:17.167592 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-83af2a38-a41c-4e9a-bcd9-1bab4e86e736 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:17.168430 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-83af2a38-a41c-4e9a-bcd9-1bab4e86e736 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:17.179282 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-83af2a38-a41c-4e9a-bcd9-1bab4e86e736 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:17.179787 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-83af2a38-a41c-4e9a-bcd9-1bab4e86e736 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:17.180232 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-83af2a38-a41c-4e9a-bcd9-1bab4e86e736 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:17.180938 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-83af2a38-a41c-4e9a-bcd9-1bab4e86e736 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:17.181460 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-83af2a38-a41c-4e9a-bcd9-1bab4e86e736 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:17.181811 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-83af2a38-a41c-4e9a-bcd9-1bab4e86e736 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:17.342976 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a974aafb-0edd-47bd-9439-021ca730df95 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:17.352775 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a974aafb-0edd-47bd-9439-021ca730df95 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:17.354245 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a974aafb-0edd-47bd-9439-021ca730df95 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:17.359073 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a974aafb-0edd-47bd-9439-021ca730df95 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1407 microversion: 2.20 time: 0.393644 Sep 10 11:52:17.360309 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1449/2974] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:16 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1407 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:17.378673 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-52f3fadc-000c-4f64-ab0f-225e5ead09a7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1202288100", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "ed12fdc2-38d7-4b26-81da-c8b044592566"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:52:17.467958 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-52f3fadc-000c-4f64-ab0f-225e5ead09a7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] validate_networks() for [('ed12fdc2-38d7-4b26-81da-c8b044592566', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:52:17.636228 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-83af2a38-a41c-4e9a-bcd9-1bab4e86e736 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:17.666389 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-83af2a38-a41c-4e9a-bcd9-1bab4e86e736 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1518 microversion: 2.1 time: 0.509323 Sep 10 11:52:17.669073 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1526/2975] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:17 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1518 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:17.710569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-883e5b35-ff7c-4995-b7e1-97d524349937 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:17.711475 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-883e5b35-ff7c-4995-b7e1-97d524349937 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:17.720861 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:52:17.727557 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-883e5b35-ff7c-4995-b7e1-97d524349937 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:17.728342 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-883e5b35-ff7c-4995-b7e1-97d524349937 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:17.728987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-883e5b35-ff7c-4995-b7e1-97d524349937 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:17.729754 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-883e5b35-ff7c-4995-b7e1-97d524349937 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:17.732491 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-883e5b35-ff7c-4995-b7e1-97d524349937 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:17.733190 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-883e5b35-ff7c-4995-b7e1-97d524349937 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:18.061333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-883e5b35-ff7c-4995-b7e1-97d524349937 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:18.070804 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-883e5b35-ff7c-4995-b7e1-97d524349937 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1524 microversion: 2.1 time: 0.364186 Sep 10 11:52:18.095152 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1527/2976] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:17 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1524 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:52:18.105453 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-860b8550-bbc7-4c34-ae42-d6f75903cab8 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:18.106591 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-860b8550-bbc7-4c34-ae42-d6f75903cab8 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 7c17b066-2297-4d76-adcb-abae0e87a3c2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:18.117192 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-860b8550-bbc7-4c34-ae42-d6f75903cab8 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:18.118856 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-860b8550-bbc7-4c34-ae42-d6f75903cab8 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:18.120648 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-860b8550-bbc7-4c34-ae42-d6f75903cab8 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:18.121819 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-860b8550-bbc7-4c34-ae42-d6f75903cab8 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:18.122541 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-860b8550-bbc7-4c34-ae42-d6f75903cab8 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:18.123242 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-860b8550-bbc7-4c34-ae42-d6f75903cab8 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:18.415821 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-860b8550-bbc7-4c34-ae42-d6f75903cab8 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:18.418399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=100 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:52:18.431805 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-860b8550-bbc7-4c34-ae42-d6f75903cab8 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2" status: 200 len: 1497 microversion: 2.1 time: 0.333973 Sep 10 11:52:18.434509 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1528/2977] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:18 2022] GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2 => generated 1497 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:18.441656 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-91fbb708-aa87-4c27-98a8-73fc5bd6d268 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:18.442269 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-91fbb708-aa87-4c27-98a8-73fc5bd6d268 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:18.469228 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-91fbb708-aa87-4c27-98a8-73fc5bd6d268 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:18.470406 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-91fbb708-aa87-4c27-98a8-73fc5bd6d268 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:18.470870 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-91fbb708-aa87-4c27-98a8-73fc5bd6d268 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:18.471908 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-91fbb708-aa87-4c27-98a8-73fc5bd6d268 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:18.472368 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-91fbb708-aa87-4c27-98a8-73fc5bd6d268 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:18.473636 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-91fbb708-aa87-4c27-98a8-73fc5bd6d268 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:18.489569 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-52f3fadc-000c-4f64-ab0f-225e5ead09a7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:52:18.490139 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-52f3fadc-000c-4f64-ab0f-225e5ead09a7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:52:18.490454 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-52f3fadc-000c-4f64-ab0f-225e5ead09a7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:52:18.490866 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-52f3fadc-000c-4f64-ab0f-225e5ead09a7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:52:18.491300 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-52f3fadc-000c-4f64-ab0f-225e5ead09a7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:52:18.505908 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52f3fadc-000c-4f64-ab0f-225e5ead09a7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:18.506397 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52f3fadc-000c-4f64-ab0f-225e5ead09a7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:18.506837 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52f3fadc-000c-4f64-ab0f-225e5ead09a7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:18.515943 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52f3fadc-000c-4f64-ab0f-225e5ead09a7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:18.516501 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52f3fadc-000c-4f64-ab0f-225e5ead09a7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:18.516938 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52f3fadc-000c-4f64-ab0f-225e5ead09a7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:18.564275 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-52f3fadc-000c-4f64-ab0f-225e5ead09a7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Getting quotas for project 27bed0cb3a46406b92496bee2da42567. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:52:18.570500 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-52f3fadc-000c-4f64-ab0f-225e5ead09a7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Getting quotas for user fe7ac57af1c94269bad68b4c8aec52fd and project 27bed0cb3a46406b92496bee2da42567. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:52:18.588591 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-52f3fadc-000c-4f64-ab0f-225e5ead09a7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:52:18.591321 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-52f3fadc-000c-4f64-ab0f-225e5ead09a7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: a4dbe5aa-fddd-42e7-b422-1585785f6034] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:52:18.626626 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-91fbb708-aa87-4c27-98a8-73fc5bd6d268 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:18.637481 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-91fbb708-aa87-4c27-98a8-73fc5bd6d268 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:18.640119 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-91fbb708-aa87-4c27-98a8-73fc5bd6d268 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:18.646503 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-91fbb708-aa87-4c27-98a8-73fc5bd6d268 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1553 microversion: 2.91 time: 0.210900 Sep 10 11:52:18.647106 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1529/2978] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:18 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1553 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:18.657676 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-baeb55bc-2ddc-473d-b9da-60164dc995ba tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:18.660794 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-baeb55bc-2ddc-473d-b9da-60164dc995ba tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:18.665290 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-52f3fadc-000c-4f64-ab0f-225e5ead09a7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.303860 Sep 10 11:52:18.679623 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1450/2979] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:52:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1319 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:52:18.682639 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-baeb55bc-2ddc-473d-b9da-60164dc995ba tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:18.685635 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-baeb55bc-2ddc-473d-b9da-60164dc995ba tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:18.686302 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-baeb55bc-2ddc-473d-b9da-60164dc995ba tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:18.695121 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-99fd7f14-b2d6-4c6b-bff2-d2e954ec69d5 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:18.696114 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-99fd7f14-b2d6-4c6b-bff2-d2e954ec69d5 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:18.702007 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-baeb55bc-2ddc-473d-b9da-60164dc995ba tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:18.702851 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-baeb55bc-2ddc-473d-b9da-60164dc995ba tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:18.705437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-baeb55bc-2ddc-473d-b9da-60164dc995ba tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:18.712419 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-99fd7f14-b2d6-4c6b-bff2-d2e954ec69d5 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:18.713377 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-99fd7f14-b2d6-4c6b-bff2-d2e954ec69d5 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:18.714051 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-99fd7f14-b2d6-4c6b-bff2-d2e954ec69d5 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:18.721189 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-99fd7f14-b2d6-4c6b-bff2-d2e954ec69d5 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:18.722314 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-99fd7f14-b2d6-4c6b-bff2-d2e954ec69d5 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:18.722873 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-99fd7f14-b2d6-4c6b-bff2-d2e954ec69d5 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:18.783600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:52:19.045624 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-baeb55bc-2ddc-473d-b9da-60164dc995ba tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:19.080569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-baeb55bc-2ddc-473d-b9da-60164dc995ba tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:19.089149 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-baeb55bc-2ddc-473d-b9da-60164dc995ba tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:19.095442 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-baeb55bc-2ddc-473d-b9da-60164dc995ba tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1407 microversion: 2.20 time: 0.446806 Sep 10 11:52:19.098512 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1530/2980] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:18 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1407 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:19.103754 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e41671c2-4815-460f-bc65-d4cc7bccdb5b tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-447635959", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "451", "networks": [{"uuid": "ed12fdc2-38d7-4b26-81da-c8b044592566"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:52:19.121795 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-99fd7f14-b2d6-4c6b-bff2-d2e954ec69d5 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:19.132299 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-99fd7f14-b2d6-4c6b-bff2-d2e954ec69d5 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1518 microversion: 2.1 time: 0.440747 Sep 10 11:52:19.147273 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1451/2981] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:18 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1518 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:19.180987 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0ce6c8bc-552e-431a-b115-b3b58f24bc80 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:19.190200 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0ce6c8bc-552e-431a-b115-b3b58f24bc80 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:19.226807 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ce6c8bc-552e-431a-b115-b3b58f24bc80 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:19.227662 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ce6c8bc-552e-431a-b115-b3b58f24bc80 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:19.228381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ce6c8bc-552e-431a-b115-b3b58f24bc80 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:19.229343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ce6c8bc-552e-431a-b115-b3b58f24bc80 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:19.230092 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ce6c8bc-552e-431a-b115-b3b58f24bc80 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:19.230856 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ce6c8bc-552e-431a-b115-b3b58f24bc80 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:19.273681 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-e41671c2-4815-460f-bc65-d4cc7bccdb5b tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] validate_networks() for [('ed12fdc2-38d7-4b26-81da-c8b044592566', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:52:19.690505 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0ce6c8bc-552e-431a-b115-b3b58f24bc80 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:19.704506 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0ce6c8bc-552e-431a-b115-b3b58f24bc80 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1524 microversion: 2.1 time: 0.542768 Sep 10 11:52:19.705113 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1452/2982] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:19 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1524 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:19.712230 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ddfe78b1-5216-4c9e-af19-3cf28168d301 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:19.712991 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ddfe78b1-5216-4c9e-af19-3cf28168d301 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 7c17b066-2297-4d76-adcb-abae0e87a3c2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:19.720311 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ddfe78b1-5216-4c9e-af19-3cf28168d301 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:19.723958 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ddfe78b1-5216-4c9e-af19-3cf28168d301 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:19.728435 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ddfe78b1-5216-4c9e-af19-3cf28168d301 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:19.729942 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ddfe78b1-5216-4c9e-af19-3cf28168d301 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:19.730858 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ddfe78b1-5216-4c9e-af19-3cf28168d301 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:19.731607 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ddfe78b1-5216-4c9e-af19-3cf28168d301 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:19.969910 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ddfe78b1-5216-4c9e-af19-3cf28168d301 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:19.978401 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ddfe78b1-5216-4c9e-af19-3cf28168d301 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2" status: 200 len: 1497 microversion: 2.1 time: 0.269987 Sep 10 11:52:19.991581 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1453/2983] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:19 2022] GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2 => generated 1497 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:19.997518 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-e41671c2-4815-460f-bc65-d4cc7bccdb5b tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:52:19.998524 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-e41671c2-4815-460f-bc65-d4cc7bccdb5b tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:52:19.999174 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-e41671c2-4815-460f-bc65-d4cc7bccdb5b tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:52:19.999393 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-74ce3629-f57f-4a3b-8c58-d347348b684f req-fb849826-d280-4932-852b-71e67f38ca2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61ab78c6-917d-46d1-b3e2-9935ca45c8e2", "name": "network-vif-plugged", "status": "completed", "tag": "998df393-88c6-4f53-8cdf-ce9cb6efbc62"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:52:19.999768 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-e41671c2-4815-460f-bc65-d4cc7bccdb5b tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:52:20.000217 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-e41671c2-4815-460f-bc65-d4cc7bccdb5b tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:52:20.010906 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e41671c2-4815-460f-bc65-d4cc7bccdb5b tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:20.011593 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e41671c2-4815-460f-bc65-d4cc7bccdb5b tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:20.011980 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-74ce3629-f57f-4a3b-8c58-d347348b684f req-fb849826-d280-4932-852b-71e67f38ca2a service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:20.012158 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e41671c2-4815-460f-bc65-d4cc7bccdb5b tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:20.012463 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-74ce3629-f57f-4a3b-8c58-d347348b684f req-fb849826-d280-4932-852b-71e67f38ca2a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:20.012744 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e41671c2-4815-460f-bc65-d4cc7bccdb5b tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:20.013193 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e41671c2-4815-460f-bc65-d4cc7bccdb5b tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:20.013429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-74ce3629-f57f-4a3b-8c58-d347348b684f req-fb849826-d280-4932-852b-71e67f38ca2a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:20.013612 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e41671c2-4815-460f-bc65-d4cc7bccdb5b tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:20.026685 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-74ce3629-f57f-4a3b-8c58-d347348b684f req-fb849826-d280-4932-852b-71e67f38ca2a service nova] Creating event network-vif-plugged:998df393-88c6-4f53-8cdf-ce9cb6efbc62 for instance 61ab78c6-917d-46d1-b3e2-9935ca45c8e2 on n-h2-856895-1 Sep 10 11:52:20.033019 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-74ce3629-f57f-4a3b-8c58-d347348b684f req-fb849826-d280-4932-852b-71e67f38ca2a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039833 Sep 10 11:52:20.034209 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1454/2984] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:52:20.035820 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-e41671c2-4815-460f-bc65-d4cc7bccdb5b tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Getting quotas for project 27bed0cb3a46406b92496bee2da42567. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:52:20.040444 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6a9af8ba-f92d-49fa-a07a-fcb4bad4b07b tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:20.041382 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6a9af8ba-f92d-49fa-a07a-fcb4bad4b07b tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:20.042679 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-e41671c2-4815-460f-bc65-d4cc7bccdb5b tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Getting quotas for user fe7ac57af1c94269bad68b4c8aec52fd and project 27bed0cb3a46406b92496bee2da42567. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:52:20.049741 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6a9af8ba-f92d-49fa-a07a-fcb4bad4b07b tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:20.050532 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6a9af8ba-f92d-49fa-a07a-fcb4bad4b07b tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:20.051192 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6a9af8ba-f92d-49fa-a07a-fcb4bad4b07b tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:20.052104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6a9af8ba-f92d-49fa-a07a-fcb4bad4b07b tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:20.053017 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6a9af8ba-f92d-49fa-a07a-fcb4bad4b07b tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:20.053762 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6a9af8ba-f92d-49fa-a07a-fcb4bad4b07b tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:20.058684 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e41671c2-4815-460f-bc65-d4cc7bccdb5b tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:52:20.062144 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e41671c2-4815-460f-bc65-d4cc7bccdb5b tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 0954dadf-c6a9-4b78-b38d-2febfb54736a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:52:20.128804 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e41671c2-4815-460f-bc65-d4cc7bccdb5b tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.028835 Sep 10 11:52:20.131919 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1531/2985] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:52:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:52:20.144944 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e54f5d5a-c518-4130-ba25-c527ded577fc tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:20.145858 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e54f5d5a-c518-4130-ba25-c527ded577fc tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:20.159850 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e54f5d5a-c518-4130-ba25-c527ded577fc tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:20.160573 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e54f5d5a-c518-4130-ba25-c527ded577fc tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:20.161198 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e54f5d5a-c518-4130-ba25-c527ded577fc tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:20.162079 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e54f5d5a-c518-4130-ba25-c527ded577fc tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:20.162815 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e54f5d5a-c518-4130-ba25-c527ded577fc tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:20.163538 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e54f5d5a-c518-4130-ba25-c527ded577fc tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:20.201748 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6a9af8ba-f92d-49fa-a07a-fcb4bad4b07b tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:20.214156 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6a9af8ba-f92d-49fa-a07a-fcb4bad4b07b tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:20.215822 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6a9af8ba-f92d-49fa-a07a-fcb4bad4b07b tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:20.223650 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6a9af8ba-f92d-49fa-a07a-fcb4bad4b07b tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1553 microversion: 2.91 time: 0.188089 Sep 10 11:52:20.224747 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1455/2986] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:20 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1553 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:20.230957 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f25848bd-d334-4235-a49b-3e62c784f6a1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:20.232032 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f25848bd-d334-4235-a49b-3e62c784f6a1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 0954dadf-c6a9-4b78-b38d-2febfb54736a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:20.331739 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f25848bd-d334-4235-a49b-3e62c784f6a1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:20.349601 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f25848bd-d334-4235-a49b-3e62c784f6a1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a" status: 200 len: 1220 microversion: 2.1 time: 0.123547 Sep 10 11:52:20.350205 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1456/2987] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:20 2022] GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a => generated 1220 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:20.374445 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dd26875b-1576-4200-b001-423c888f5d85 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:20.375066 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-dd26875b-1576-4200-b001-423c888f5d85 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:20.390051 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dd26875b-1576-4200-b001-423c888f5d85 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:20.391746 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dd26875b-1576-4200-b001-423c888f5d85 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:20.393348 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dd26875b-1576-4200-b001-423c888f5d85 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:20.395762 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dd26875b-1576-4200-b001-423c888f5d85 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:20.397324 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dd26875b-1576-4200-b001-423c888f5d85 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:20.398951 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dd26875b-1576-4200-b001-423c888f5d85 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:20.476898 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e54f5d5a-c518-4130-ba25-c527ded577fc tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:20.485678 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e54f5d5a-c518-4130-ba25-c527ded577fc tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:20.496488 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e54f5d5a-c518-4130-ba25-c527ded577fc tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:20.497881 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e54f5d5a-c518-4130-ba25-c527ded577fc tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1407 microversion: 2.20 time: 0.361527 Sep 10 11:52:20.498921 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1532/2988] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:20 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1407 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:20.596683 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-dd26875b-1576-4200-b001-423c888f5d85 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:20.606127 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-dd26875b-1576-4200-b001-423c888f5d85 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1518 microversion: 2.1 time: 0.248188 Sep 10 11:52:20.607476 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1457/2989] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:20 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1518 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:20.732348 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4b960013-763c-4b6b-a296-d5093d41b40f tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:20.733349 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4b960013-763c-4b6b-a296-d5093d41b40f tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:20.756763 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b960013-763c-4b6b-a296-d5093d41b40f tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:20.757270 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b960013-763c-4b6b-a296-d5093d41b40f tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:20.757708 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b960013-763c-4b6b-a296-d5093d41b40f tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:20.758429 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b960013-763c-4b6b-a296-d5093d41b40f tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:20.758894 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b960013-763c-4b6b-a296-d5093d41b40f tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:20.759355 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b960013-763c-4b6b-a296-d5093d41b40f tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:21.006265 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5bf024e7-29b0-4e4a-84eb-60aa1e8acd70 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:21.006788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5bf024e7-29b0-4e4a-84eb-60aa1e8acd70 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 7c17b066-2297-4d76-adcb-abae0e87a3c2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:21.016910 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:52:21.018936 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5bf024e7-29b0-4e4a-84eb-60aa1e8acd70 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:21.021623 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5bf024e7-29b0-4e4a-84eb-60aa1e8acd70 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:21.023254 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5bf024e7-29b0-4e4a-84eb-60aa1e8acd70 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:21.024369 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5bf024e7-29b0-4e4a-84eb-60aa1e8acd70 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:21.025310 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5bf024e7-29b0-4e4a-84eb-60aa1e8acd70 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:21.027706 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5bf024e7-29b0-4e4a-84eb-60aa1e8acd70 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:21.028114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4b960013-763c-4b6b-a296-d5093d41b40f tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:21.039825 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4b960013-763c-4b6b-a296-d5093d41b40f tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1524 microversion: 2.1 time: 0.311367 Sep 10 11:52:21.055803 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1533/2990] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:20 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1524 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:21.231097 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5bf024e7-29b0-4e4a-84eb-60aa1e8acd70 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:21.239625 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5bf024e7-29b0-4e4a-84eb-60aa1e8acd70 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2" status: 200 len: 1474 microversion: 2.1 time: 0.237267 Sep 10 11:52:21.240442 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1458/2991] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:21 2022] GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2 => generated 1474 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:21.254777 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5ecdfdd8-dd3f-489c-8792-cbf02cbc91c5 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:21.255720 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5ecdfdd8-dd3f-489c-8792-cbf02cbc91c5 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:21.264749 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ecdfdd8-dd3f-489c-8792-cbf02cbc91c5 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:21.265408 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6b9c4267-ad02-45bd-a1c2-5f5c2c3a2f84 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1884720440"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:52:21.265581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ecdfdd8-dd3f-489c-8792-cbf02cbc91c5 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:21.266767 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ecdfdd8-dd3f-489c-8792-cbf02cbc91c5 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:21.268120 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ecdfdd8-dd3f-489c-8792-cbf02cbc91c5 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:21.269405 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ecdfdd8-dd3f-489c-8792-cbf02cbc91c5 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:21.270083 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ecdfdd8-dd3f-489c-8792-cbf02cbc91c5 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:21.280085 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6b9c4267-ad02-45bd-a1c2-5f5c2c3a2f84 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 7c17b066-2297-4d76-adcb-abae0e87a3c2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:21.317756 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6b9c4267-ad02-45bd-a1c2-5f5c2c3a2f84 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:21.319833 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6b9c4267-ad02-45bd-a1c2-5f5c2c3a2f84 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:21.324199 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6b9c4267-ad02-45bd-a1c2-5f5c2c3a2f84 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:21.325472 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6b9c4267-ad02-45bd-a1c2-5f5c2c3a2f84 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:21.326360 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6b9c4267-ad02-45bd-a1c2-5f5c2c3a2f84 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:21.326935 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6b9c4267-ad02-45bd-a1c2-5f5c2c3a2f84 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:21.372860 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5ecdfdd8-dd3f-489c-8792-cbf02cbc91c5 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:21.383894 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5ecdfdd8-dd3f-489c-8792-cbf02cbc91c5 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:21.385367 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5ecdfdd8-dd3f-489c-8792-cbf02cbc91c5 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:21.392046 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5ecdfdd8-dd3f-489c-8792-cbf02cbc91c5 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1553 microversion: 2.91 time: 0.141943 Sep 10 11:52:21.393019 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1534/2992] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:21 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1553 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:21.413052 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-592f90b4-82ec-4af1-ba3a-ce683d866913 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:21.413802 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-592f90b4-82ec-4af1-ba3a-ce683d866913 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 0954dadf-c6a9-4b78-b38d-2febfb54736a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:21.420137 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-592f90b4-82ec-4af1-ba3a-ce683d866913 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:21.420725 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-592f90b4-82ec-4af1-ba3a-ce683d866913 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:21.421227 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-592f90b4-82ec-4af1-ba3a-ce683d866913 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:21.423283 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-592f90b4-82ec-4af1-ba3a-ce683d866913 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:21.423813 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-592f90b4-82ec-4af1-ba3a-ce683d866913 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:21.424310 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-592f90b4-82ec-4af1-ba3a-ce683d866913 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:21.500786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-592f90b4-82ec-4af1-ba3a-ce683d866913 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:21.509108 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-592f90b4-82ec-4af1-ba3a-ce683d866913 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a" status: 200 len: 1224 microversion: 2.1 time: 0.100575 Sep 10 11:52:21.511216 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1535/2993] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:21 2022] GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a => generated 1224 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:21.524975 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-781ddcd6-8c81-425a-8c05-f433cbed496e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:21.525596 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-781ddcd6-8c81-425a-8c05-f433cbed496e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:21.532290 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-781ddcd6-8c81-425a-8c05-f433cbed496e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:21.532787 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-781ddcd6-8c81-425a-8c05-f433cbed496e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:21.533231 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-781ddcd6-8c81-425a-8c05-f433cbed496e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:21.534643 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-781ddcd6-8c81-425a-8c05-f433cbed496e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:21.535430 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-781ddcd6-8c81-425a-8c05-f433cbed496e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:21.535843 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-781ddcd6-8c81-425a-8c05-f433cbed496e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:21.566052 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6b9c4267-ad02-45bd-a1c2-5f5c2c3a2f84 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "POST /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2/action" status: 202 len: 0 microversion: 2.1 time: 0.304365 Sep 10 11:52:21.567713 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1459/2994] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:52:21 2022] POST /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 10 11:52:21.584538 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d7dbf8f5-1ad0-4962-b994-02b6707fd9e1 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f40728851f0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:21.645554 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d7dbf8f5-1ad0-4962-b994-02b6707fd9e1 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/1579b63c-4bb7-4e44-ab69-cea48d12791e" status: 200 len: 1412 microversion: 2.1 time: 0.067300 Sep 10 11:52:21.646148 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1460/2995] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:52:21 2022] GET /compute/v2.1/images/1579b63c-4bb7-4e44-ab69-cea48d12791e => generated 1412 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:21.664351 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6bad4606-63b7-4d94-a86f-acde87b0310b tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:21.666765 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6bad4606-63b7-4d94-a86f-acde87b0310b tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:21.682233 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6bad4606-63b7-4d94-a86f-acde87b0310b tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:21.683409 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6bad4606-63b7-4d94-a86f-acde87b0310b tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:21.684278 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6bad4606-63b7-4d94-a86f-acde87b0310b tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:21.685331 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6bad4606-63b7-4d94-a86f-acde87b0310b tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:21.685988 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6bad4606-63b7-4d94-a86f-acde87b0310b tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:21.686614 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6bad4606-63b7-4d94-a86f-acde87b0310b tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:21.714048 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-781ddcd6-8c81-425a-8c05-f433cbed496e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:21.725229 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-781ddcd6-8c81-425a-8c05-f433cbed496e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:21.729852 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-781ddcd6-8c81-425a-8c05-f433cbed496e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:21.731200 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-781ddcd6-8c81-425a-8c05-f433cbed496e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1407 microversion: 2.20 time: 0.210097 Sep 10 11:52:21.731995 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1536/2996] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:21 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:21.863894 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6bad4606-63b7-4d94-a86f-acde87b0310b tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:21.874232 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6bad4606-63b7-4d94-a86f-acde87b0310b tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1524 microversion: 2.1 time: 0.226712 Sep 10 11:52:21.874801 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1461/2997] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:21 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1524 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:22.064038 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5ea88ce9-bcce-499d-ae29-9d2f877fdc25 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:22.064570 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5ea88ce9-bcce-499d-ae29-9d2f877fdc25 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:22.071297 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ea88ce9-bcce-499d-ae29-9d2f877fdc25 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:22.071796 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ea88ce9-bcce-499d-ae29-9d2f877fdc25 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:22.072242 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ea88ce9-bcce-499d-ae29-9d2f877fdc25 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:22.072956 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ea88ce9-bcce-499d-ae29-9d2f877fdc25 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:22.073419 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ea88ce9-bcce-499d-ae29-9d2f877fdc25 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:22.073851 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ea88ce9-bcce-499d-ae29-9d2f877fdc25 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:22.232116 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5ea88ce9-bcce-499d-ae29-9d2f877fdc25 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:22.240333 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5ea88ce9-bcce-499d-ae29-9d2f877fdc25 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1524 microversion: 2.1 time: 0.180481 Sep 10 11:52:22.240935 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1537/2998] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:22 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1524 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:22.420142 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8704a651-b80c-489b-8cbe-3c09974dd2f7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:22.420853 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8704a651-b80c-489b-8cbe-3c09974dd2f7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:22.428305 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8704a651-b80c-489b-8cbe-3c09974dd2f7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:22.428788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8704a651-b80c-489b-8cbe-3c09974dd2f7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:22.429223 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8704a651-b80c-489b-8cbe-3c09974dd2f7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:22.429915 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8704a651-b80c-489b-8cbe-3c09974dd2f7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:22.430368 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8704a651-b80c-489b-8cbe-3c09974dd2f7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:22.430793 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8704a651-b80c-489b-8cbe-3c09974dd2f7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:22.499800 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8704a651-b80c-489b-8cbe-3c09974dd2f7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:22.509098 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8704a651-b80c-489b-8cbe-3c09974dd2f7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:22.510679 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8704a651-b80c-489b-8cbe-3c09974dd2f7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:22.515780 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8704a651-b80c-489b-8cbe-3c09974dd2f7 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1535 microversion: 2.91 time: 0.099379 Sep 10 11:52:22.517099 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1462/2999] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:22 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1535 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:22.532689 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7933fad4-8240-4fe1-8bd0-5f971d2bf4c6 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:22.533505 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7933fad4-8240-4fe1-8bd0-5f971d2bf4c6 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 0954dadf-c6a9-4b78-b38d-2febfb54736a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:22.540811 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7933fad4-8240-4fe1-8bd0-5f971d2bf4c6 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:22.541391 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7933fad4-8240-4fe1-8bd0-5f971d2bf4c6 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:22.541899 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7933fad4-8240-4fe1-8bd0-5f971d2bf4c6 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:22.542673 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7933fad4-8240-4fe1-8bd0-5f971d2bf4c6 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:22.543236 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7933fad4-8240-4fe1-8bd0-5f971d2bf4c6 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:22.543756 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7933fad4-8240-4fe1-8bd0-5f971d2bf4c6 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:22.612647 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7933fad4-8240-4fe1-8bd0-5f971d2bf4c6 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:22.621085 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7933fad4-8240-4fe1-8bd0-5f971d2bf4c6 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a" status: 200 len: 1216 microversion: 2.1 time: 0.092261 Sep 10 11:52:22.621664 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1538/3000] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:22 2022] GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a => generated 1216 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:22.661628 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cbfe5af2-63b9-408f-a84b-c34a52cd10cd tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f40728dc790>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:22.705664 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cbfe5af2-63b9-408f-a84b-c34a52cd10cd tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/1579b63c-4bb7-4e44-ab69-cea48d12791e" status: 200 len: 1412 microversion: 2.1 time: 0.047816 Sep 10 11:52:22.706234 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1463/3001] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:52:22 2022] GET /compute/v2.1/images/1579b63c-4bb7-4e44-ab69-cea48d12791e => generated 1412 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:22.757577 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ca2db60d-72fd-4907-8248-9d9487f2da7b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:22.758191 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ca2db60d-72fd-4907-8248-9d9487f2da7b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:22.764288 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca2db60d-72fd-4907-8248-9d9487f2da7b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:22.764766 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca2db60d-72fd-4907-8248-9d9487f2da7b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:22.765199 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca2db60d-72fd-4907-8248-9d9487f2da7b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:22.766546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca2db60d-72fd-4907-8248-9d9487f2da7b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:22.766984 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca2db60d-72fd-4907-8248-9d9487f2da7b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:22.767429 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca2db60d-72fd-4907-8248-9d9487f2da7b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:22.898198 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d18cc4a7-9a69-4eac-a160-4f1d7caf1888 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:22.898824 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d18cc4a7-9a69-4eac-a160-4f1d7caf1888 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:22.904460 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ca2db60d-72fd-4907-8248-9d9487f2da7b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:22.904993 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d18cc4a7-9a69-4eac-a160-4f1d7caf1888 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:22.905488 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d18cc4a7-9a69-4eac-a160-4f1d7caf1888 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:22.905929 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d18cc4a7-9a69-4eac-a160-4f1d7caf1888 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:22.906796 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d18cc4a7-9a69-4eac-a160-4f1d7caf1888 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:22.907333 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d18cc4a7-9a69-4eac-a160-4f1d7caf1888 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:22.908301 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d18cc4a7-9a69-4eac-a160-4f1d7caf1888 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:22.912861 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ca2db60d-72fd-4907-8248-9d9487f2da7b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:22.914516 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ca2db60d-72fd-4907-8248-9d9487f2da7b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:22.915796 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ca2db60d-72fd-4907-8248-9d9487f2da7b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1599 microversion: 2.20 time: 0.162233 Sep 10 11:52:22.916395 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1539/3002] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:22 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:22.941281 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-57a6a075-6c4d-4952-a5b8-f7c979b7862d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:22.941781 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-57a6a075-6c4d-4952-a5b8-f7c979b7862d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:22.947779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57a6a075-6c4d-4952-a5b8-f7c979b7862d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:22.948269 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57a6a075-6c4d-4952-a5b8-f7c979b7862d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:22.948775 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57a6a075-6c4d-4952-a5b8-f7c979b7862d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:22.949510 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57a6a075-6c4d-4952-a5b8-f7c979b7862d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:22.949968 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57a6a075-6c4d-4952-a5b8-f7c979b7862d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:22.950397 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57a6a075-6c4d-4952-a5b8-f7c979b7862d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:23.055443 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-57a6a075-6c4d-4952-a5b8-f7c979b7862d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.118663 Sep 10 11:52:23.056210 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1540/3003] 10.222.0.23 () {60 vars in 1316 bytes} [Sat Sep 10 11:52:22 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 10 11:52:23.121610 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d18cc4a7-9a69-4eac-a160-4f1d7caf1888 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:23.130052 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d18cc4a7-9a69-4eac-a160-4f1d7caf1888 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1524 microversion: 2.1 time: 0.236132 Sep 10 11:52:23.130764 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1464/3004] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:22 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1524 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:23.263887 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0810bd0e-d72c-4cb1-a878-f747e4f2518e tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:23.264458 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0810bd0e-d72c-4cb1-a878-f747e4f2518e tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:23.271242 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0810bd0e-d72c-4cb1-a878-f747e4f2518e tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:23.272131 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0810bd0e-d72c-4cb1-a878-f747e4f2518e tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:23.272795 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0810bd0e-d72c-4cb1-a878-f747e4f2518e tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:23.273621 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0810bd0e-d72c-4cb1-a878-f747e4f2518e tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:23.274076 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0810bd0e-d72c-4cb1-a878-f747e4f2518e tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:23.274837 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0810bd0e-d72c-4cb1-a878-f747e4f2518e tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:23.506330 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0810bd0e-d72c-4cb1-a878-f747e4f2518e tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:23.514205 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0810bd0e-d72c-4cb1-a878-f747e4f2518e tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1504 microversion: 2.1 time: 0.254648 Sep 10 11:52:23.514731 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1541/3005] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:23 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1504 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:52:23.537408 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5c1b88a2-3b56-4cbf-9e67-58048b11c33f tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Action: 'create', calling method: .version_select at 0x7f407292b670>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1948751185", "description": "tempest-description-1758965407"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:52:23.546295 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-617146cd-75f1-4176-9f35-23169b10c47d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:23.546913 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-617146cd-75f1-4176-9f35-23169b10c47d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:23.553542 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-617146cd-75f1-4176-9f35-23169b10c47d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:23.554027 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-617146cd-75f1-4176-9f35-23169b10c47d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:23.554464 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-617146cd-75f1-4176-9f35-23169b10c47d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:23.555157 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-617146cd-75f1-4176-9f35-23169b10c47d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:23.555625 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-617146cd-75f1-4176-9f35-23169b10c47d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:23.556052 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-617146cd-75f1-4176-9f35-23169b10c47d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:23.638655 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-617146cd-75f1-4176-9f35-23169b10c47d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:23.646045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-617146cd-75f1-4176-9f35-23169b10c47d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:23.647526 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-617146cd-75f1-4176-9f35-23169b10c47d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:23.652321 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-617146cd-75f1-4176-9f35-23169b10c47d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1535 microversion: 2.91 time: 0.110451 Sep 10 11:52:23.652890 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1542/3006] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:23 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1535 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:23.657374 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-006778cb-e0d0-4208-86ca-d2fc839be513 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:23.657986 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-006778cb-e0d0-4208-86ca-d2fc839be513 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 0954dadf-c6a9-4b78-b38d-2febfb54736a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:23.663670 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-006778cb-e0d0-4208-86ca-d2fc839be513 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:23.664147 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-006778cb-e0d0-4208-86ca-d2fc839be513 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:23.664578 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-006778cb-e0d0-4208-86ca-d2fc839be513 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:23.665259 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-006778cb-e0d0-4208-86ca-d2fc839be513 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:23.665715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-006778cb-e0d0-4208-86ca-d2fc839be513 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:23.666136 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-006778cb-e0d0-4208-86ca-d2fc839be513 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:23.753925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-006778cb-e0d0-4208-86ca-d2fc839be513 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:23.761838 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-006778cb-e0d0-4208-86ca-d2fc839be513 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a" status: 200 len: 1216 microversion: 2.1 time: 0.107988 Sep 10 11:52:23.762639 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1543/3007] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:23 2022] GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a => generated 1216 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:23.767024 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2b4f0d6d-ebee-4ad6-ba84-ad179e730fbc tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f40735910d0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:23.818376 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2b4f0d6d-ebee-4ad6-ba84-ad179e730fbc tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/1579b63c-4bb7-4e44-ab69-cea48d12791e" status: 200 len: 1412 microversion: 2.1 time: 0.054918 Sep 10 11:52:23.819150 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1544/3008] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:52:23 2022] GET /compute/v2.1/images/1579b63c-4bb7-4e44-ab69-cea48d12791e => generated 1412 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:23.905572 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5c1b88a2-3b56-4cbf-9e67-58048b11c33f tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.372010 Sep 10 11:52:23.906188 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1465/3009] 10.222.0.23 () {60 vars in 1180 bytes} [Sat Sep 10 11:52:23 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:52:23.919495 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fc04f79f-5def-4db7-a616-75545780c8eb tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1948751185"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:52:23.920039 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fc04f79f-5def-4db7-a616-75545780c8eb tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:23.927077 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc04f79f-5def-4db7-a616-75545780c8eb tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:23.927602 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc04f79f-5def-4db7-a616-75545780c8eb tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:23.928049 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc04f79f-5def-4db7-a616-75545780c8eb tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:23.928757 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc04f79f-5def-4db7-a616-75545780c8eb tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:23.929217 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc04f79f-5def-4db7-a616-75545780c8eb tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:23.929649 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc04f79f-5def-4db7-a616-75545780c8eb tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:24.154367 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2c55a5a0-c54a-4c2c-a85d-333c885e6d2f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:24.155175 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2c55a5a0-c54a-4c2c-a85d-333c885e6d2f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:24.162430 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2c55a5a0-c54a-4c2c-a85d-333c885e6d2f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:24.162927 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2c55a5a0-c54a-4c2c-a85d-333c885e6d2f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:24.163391 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2c55a5a0-c54a-4c2c-a85d-333c885e6d2f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:24.164094 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2c55a5a0-c54a-4c2c-a85d-333c885e6d2f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:24.165043 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2c55a5a0-c54a-4c2c-a85d-333c885e6d2f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:24.165476 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2c55a5a0-c54a-4c2c-a85d-333c885e6d2f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:24.437205 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2c55a5a0-c54a-4c2c-a85d-333c885e6d2f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:24.445662 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2c55a5a0-c54a-4c2c-a85d-333c885e6d2f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1524 microversion: 2.1 time: 0.295656 Sep 10 11:52:24.446232 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1466/3010] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:24 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1524 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:52:24.473017 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.network.security_group_api [None req-fc04f79f-5def-4db7-a616-75545780c8eb tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Adding security group d71b7c0a-2dcb-4f9d-a322-07ef6419d985 to port 985e81bb-aeae-46fb-bc6f-b3a5e1be77f6 Sep 10 11:52:24.681267 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e4454666-0c99-463a-8e68-4e6b38f42079 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:24.681884 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e4454666-0c99-463a-8e68-4e6b38f42079 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:24.689734 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4454666-0c99-463a-8e68-4e6b38f42079 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:24.690169 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4454666-0c99-463a-8e68-4e6b38f42079 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:24.690615 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4454666-0c99-463a-8e68-4e6b38f42079 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:24.691370 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4454666-0c99-463a-8e68-4e6b38f42079 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:24.691847 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4454666-0c99-463a-8e68-4e6b38f42079 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:24.692278 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4454666-0c99-463a-8e68-4e6b38f42079 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:24.814947 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e4454666-0c99-463a-8e68-4e6b38f42079 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:24.842541 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e4454666-0c99-463a-8e68-4e6b38f42079 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:24.845452 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e4454666-0c99-463a-8e68-4e6b38f42079 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:24.861875 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e4454666-0c99-463a-8e68-4e6b38f42079 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1478 microversion: 2.91 time: 0.184613 Sep 10 11:52:24.873653 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1467/3011] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:24 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1478 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:52:24.904488 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1a81e57d-3274-4c60-ba1e-d9038e629907 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:24.905424 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1a81e57d-3274-4c60-ba1e-d9038e629907 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 0954dadf-c6a9-4b78-b38d-2febfb54736a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:24.913090 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a81e57d-3274-4c60-ba1e-d9038e629907 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:24.914129 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a81e57d-3274-4c60-ba1e-d9038e629907 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:24.914797 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a81e57d-3274-4c60-ba1e-d9038e629907 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:24.916344 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a81e57d-3274-4c60-ba1e-d9038e629907 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:24.917150 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a81e57d-3274-4c60-ba1e-d9038e629907 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:24.917796 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a81e57d-3274-4c60-ba1e-d9038e629907 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:25.038470 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1a81e57d-3274-4c60-ba1e-d9038e629907 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:25.054155 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1a81e57d-3274-4c60-ba1e-d9038e629907 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a" status: 200 len: 1216 microversion: 2.1 time: 0.163737 Sep 10 11:52:25.055894 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1468/3012] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:24 2022] GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a => generated 1216 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:25.063957 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f89aa4d8-5901-4f66-8d45-1e13d6fb7731 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f40728a0f70>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:25.121763 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fc04f79f-5def-4db7-a616-75545780c8eb tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "POST /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea/action" status: 202 len: 0 microversion: 2.1 time: 1.206337 Sep 10 11:52:25.125666 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1545/3013] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:52:23 2022] POST /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea/action => generated 0 bytes in 1208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:52:25.126869 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f89aa4d8-5901-4f66-8d45-1e13d6fb7731 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/1579b63c-4bb7-4e44-ab69-cea48d12791e" status: 200 len: 1412 microversion: 2.1 time: 0.069592 Sep 10 11:52:25.128395 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1469/3014] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:52:25 2022] GET /compute/v2.1/images/1579b63c-4bb7-4e44-ab69-cea48d12791e => generated 1412 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:25.128528 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a4409326-cb09-4220-830f-3d1bd05bdb69 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-856895-1"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:52:25.130869 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a4409326-cb09-4220-830f-3d1bd05bdb69 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:25.138196 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-c9f36045-68f7-4ca3-a1ec-6c9337ba9529 req-db5ac027-264a-471c-a912-8a772ea0a45a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61ab78c6-917d-46d1-b3e2-9935ca45c8e2", "tag": "998df393-88c6-4f53-8cdf-ce9cb6efbc62"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:52:25.147110 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a4409326-cb09-4220-830f-3d1bd05bdb69 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:25.147618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a4409326-cb09-4220-830f-3d1bd05bdb69 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:25.151924 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-c9f36045-68f7-4ca3-a1ec-6c9337ba9529 req-db5ac027-264a-471c-a912-8a772ea0a45a service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:25.152814 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-c9f36045-68f7-4ca3-a1ec-6c9337ba9529 req-db5ac027-264a-471c-a912-8a772ea0a45a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:25.153478 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-c9f36045-68f7-4ca3-a1ec-6c9337ba9529 req-db5ac027-264a-471c-a912-8a772ea0a45a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:25.154318 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a4409326-cb09-4220-830f-3d1bd05bdb69 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:25.155057 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a4409326-cb09-4220-830f-3d1bd05bdb69 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:25.155565 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a4409326-cb09-4220-830f-3d1bd05bdb69 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:25.156386 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a4409326-cb09-4220-830f-3d1bd05bdb69 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:25.170905 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-c9f36045-68f7-4ca3-a1ec-6c9337ba9529 req-db5ac027-264a-471c-a912-8a772ea0a45a service nova] Creating event network-changed:998df393-88c6-4f53-8cdf-ce9cb6efbc62 for instance 61ab78c6-917d-46d1-b3e2-9935ca45c8e2 on n-h2-856895-1 Sep 10 11:52:25.182925 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-c9f36045-68f7-4ca3-a1ec-6c9337ba9529 req-db5ac027-264a-471c-a912-8a772ea0a45a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052404 Sep 10 11:52:25.184813 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1470/3015] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:52:25.196062 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c48a1973-5946-48cd-8b6a-c4c1ffbb843c tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:52:25.200811 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c48a1973-5946-48cd-8b6a-c4c1ffbb843c tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: f74f15ef-04b5-4313-b90f-20b96291734b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:25.214768 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c48a1973-5946-48cd-8b6a-c4c1ffbb843c tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:25.215920 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c48a1973-5946-48cd-8b6a-c4c1ffbb843c tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:25.216656 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c48a1973-5946-48cd-8b6a-c4c1ffbb843c tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:25.217622 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c48a1973-5946-48cd-8b6a-c4c1ffbb843c tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:25.218371 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c48a1973-5946-48cd-8b6a-c4c1ffbb843c tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:25.219725 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c48a1973-5946-48cd-8b6a-c4c1ffbb843c tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:25.240118 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a4409326-cb09-4220-830f-3d1bd05bdb69 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-856895-1". {{(pid=128777) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 10 11:52:25.295334 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:52:25.314931 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c48a1973-5946-48cd-8b6a-c4c1ffbb843c tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "POST /compute/v2.1/servers/f74f15ef-04b5-4313-b90f-20b96291734b/action" status: 200 len: 24572 microversion: 2.1 time: 0.128342 Sep 10 11:52:25.318271 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1471/3016] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:52:25 2022] POST /compute/v2.1/servers/f74f15ef-04b5-4313-b90f-20b96291734b/action => generated 24572 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:52:25.325738 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1c314e5f-8e37-4cae-a735-c74e7332ea76 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1948751185"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:52:25.326677 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a4409326-cb09-4220-830f-3d1bd05bdb69 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306/action" status: 202 len: 0 microversion: 2.91 time: 0.202230 Sep 10 11:52:25.327394 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1c314e5f-8e37-4cae-a735-c74e7332ea76 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:25.327891 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1546/3017] 10.222.0.23 () {62 vars in 1319 bytes} [Sat Sep 10 11:52:25 2022] POST /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:52:25.336257 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ddecde93-6e3e-42ac-b0dd-f04213feb705 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:25.337266 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ddecde93-6e3e-42ac-b0dd-f04213feb705 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:25.337448 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1c314e5f-8e37-4cae-a735-c74e7332ea76 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:25.338032 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1c314e5f-8e37-4cae-a735-c74e7332ea76 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:25.339671 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1c314e5f-8e37-4cae-a735-c74e7332ea76 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:25.340603 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1c314e5f-8e37-4cae-a735-c74e7332ea76 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:25.341271 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1c314e5f-8e37-4cae-a735-c74e7332ea76 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:25.341906 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1c314e5f-8e37-4cae-a735-c74e7332ea76 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:25.346112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ddecde93-6e3e-42ac-b0dd-f04213feb705 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:25.347056 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ddecde93-6e3e-42ac-b0dd-f04213feb705 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:25.347538 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ddecde93-6e3e-42ac-b0dd-f04213feb705 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:25.348446 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ddecde93-6e3e-42ac-b0dd-f04213feb705 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:25.349995 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ddecde93-6e3e-42ac-b0dd-f04213feb705 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:25.350739 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ddecde93-6e3e-42ac-b0dd-f04213feb705 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:25.482394 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ddecde93-6e3e-42ac-b0dd-f04213feb705 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:25.499353 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ddecde93-6e3e-42ac-b0dd-f04213feb705 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:25.503991 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ddecde93-6e3e-42ac-b0dd-f04213feb705 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:25.517723 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ddecde93-6e3e-42ac-b0dd-f04213feb705 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1486 microversion: 2.91 time: 0.183645 Sep 10 11:52:25.518387 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1547/3018] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:25 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1486 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:52:25.548437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-858dbe66-1ac7-4f48-b474-4fc0328ac1de tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:25.550834 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-858dbe66-1ac7-4f48-b474-4fc0328ac1de tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:25.570399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-858dbe66-1ac7-4f48-b474-4fc0328ac1de tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:25.570925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-858dbe66-1ac7-4f48-b474-4fc0328ac1de tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:25.571458 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-858dbe66-1ac7-4f48-b474-4fc0328ac1de tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:25.573968 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-858dbe66-1ac7-4f48-b474-4fc0328ac1de tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:25.574440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-858dbe66-1ac7-4f48-b474-4fc0328ac1de tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:25.575471 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-858dbe66-1ac7-4f48-b474-4fc0328ac1de tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:25.741323 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.network.security_group_api [None req-1c314e5f-8e37-4cae-a735-c74e7332ea76 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Removing security group d71b7c0a-2dcb-4f9d-a322-07ef6419d985 from port 985e81bb-aeae-46fb-bc6f-b3a5e1be77f6 Sep 10 11:52:25.888241 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-858dbe66-1ac7-4f48-b474-4fc0328ac1de tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:25.901141 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-858dbe66-1ac7-4f48-b474-4fc0328ac1de tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1524 microversion: 2.1 time: 0.369723 Sep 10 11:52:25.901913 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1548/3019] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:25 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1524 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:26.081832 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-491a8579-cbd0-41c2-a83e-8b530b901b02 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:26.082759 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-491a8579-cbd0-41c2-a83e-8b530b901b02 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 0954dadf-c6a9-4b78-b38d-2febfb54736a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:26.102158 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-491a8579-cbd0-41c2-a83e-8b530b901b02 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:26.105390 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-491a8579-cbd0-41c2-a83e-8b530b901b02 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:26.124250 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-491a8579-cbd0-41c2-a83e-8b530b901b02 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:26.132360 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-491a8579-cbd0-41c2-a83e-8b530b901b02 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:26.133216 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-491a8579-cbd0-41c2-a83e-8b530b901b02 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:26.133831 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-491a8579-cbd0-41c2-a83e-8b530b901b02 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:26.228247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-491a8579-cbd0-41c2-a83e-8b530b901b02 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:26.241791 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-491a8579-cbd0-41c2-a83e-8b530b901b02 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a" status: 200 len: 1272 microversion: 2.1 time: 0.166820 Sep 10 11:52:26.243984 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1549/3020] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:26 2022] GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a => generated 1272 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:26.268592 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c855fa75-1d01-41d2-88a8-a1c36fefcefc tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f4072595e50>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:26.333918 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c855fa75-1d01-41d2-88a8-a1c36fefcefc tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/1579b63c-4bb7-4e44-ab69-cea48d12791e" status: 200 len: 1412 microversion: 2.1 time: 0.078764 Sep 10 11:52:26.342945 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1550/3021] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:52:26 2022] GET /compute/v2.1/images/1579b63c-4bb7-4e44-ab69-cea48d12791e => generated 1412 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:26.482706 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1c314e5f-8e37-4cae-a735-c74e7332ea76 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "POST /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea/action" status: 202 len: 0 microversion: 2.1 time: 1.162487 Sep 10 11:52:26.483668 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1472/3022] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:52:25 2022] POST /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea/action => generated 0 bytes in 1165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:52:26.494530 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6b9fe25a-7c05-4a6d-81ba-9d4eb70b4f93 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Action: 'create', calling method: .version_select at 0x7f4072595940>, body: {"pool": null} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:52:26.551133 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3343553d-a8e4-4297-b51c-14c0bf75ee8d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:26.551781 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3343553d-a8e4-4297-b51c-14c0bf75ee8d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:26.570710 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3343553d-a8e4-4297-b51c-14c0bf75ee8d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:26.571938 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3343553d-a8e4-4297-b51c-14c0bf75ee8d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:26.573002 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3343553d-a8e4-4297-b51c-14c0bf75ee8d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:26.574735 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3343553d-a8e4-4297-b51c-14c0bf75ee8d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:26.575897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3343553d-a8e4-4297-b51c-14c0bf75ee8d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:26.576957 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3343553d-a8e4-4297-b51c-14c0bf75ee8d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:27.027851 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3343553d-a8e4-4297-b51c-14c0bf75ee8d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:27.032220 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:52:27.050209 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3343553d-a8e4-4297-b51c-14c0bf75ee8d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:27.058388 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3343553d-a8e4-4297-b51c-14c0bf75ee8d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:27.088404 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3343553d-a8e4-4297-b51c-14c0bf75ee8d tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1486 microversion: 2.91 time: 0.541510 Sep 10 11:52:27.088920 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1473/3023] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:26 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1486 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:52:27.100296 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fca88c34-8091-4fb7-a83f-21b77be35980 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:27.101012 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fca88c34-8091-4fb7-a83f-21b77be35980 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:27.130525 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fca88c34-8091-4fb7-a83f-21b77be35980 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:27.131043 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fca88c34-8091-4fb7-a83f-21b77be35980 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:27.131525 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fca88c34-8091-4fb7-a83f-21b77be35980 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:27.132266 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fca88c34-8091-4fb7-a83f-21b77be35980 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:27.132726 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fca88c34-8091-4fb7-a83f-21b77be35980 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:27.133161 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fca88c34-8091-4fb7-a83f-21b77be35980 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:28.009381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fca88c34-8091-4fb7-a83f-21b77be35980 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:28.022192 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fca88c34-8091-4fb7-a83f-21b77be35980 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1524 microversion: 2.1 time: 0.931941 Sep 10 11:52:28.036017 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1474/3024] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:27 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1524 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:28.041305 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-5cee03ff-7018-487f-beaa-0e9f5f6b17da req-b2354b0c-d7fc-483e-851c-7fab863c5f04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4cf27c4-4cda-46f0-94b9-f862994d2071", "name": "network-vif-unplugged", "status": "completed", "tag": "98552666-f390-4515-b1a3-d6bf538fb04c"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:52:28.055924 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-5cee03ff-7018-487f-beaa-0e9f5f6b17da req-b2354b0c-d7fc-483e-851c-7fab863c5f04 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:28.066205 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-5cee03ff-7018-487f-beaa-0e9f5f6b17da req-b2354b0c-d7fc-483e-851c-7fab863c5f04 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:28.066970 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-5cee03ff-7018-487f-beaa-0e9f5f6b17da req-b2354b0c-d7fc-483e-851c-7fab863c5f04 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:28.095201 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-5cee03ff-7018-487f-beaa-0e9f5f6b17da req-b2354b0c-d7fc-483e-851c-7fab863c5f04 service nova] Creating event network-vif-unplugged:98552666-f390-4515-b1a3-d6bf538fb04c for instance d4cf27c4-4cda-46f0-94b9-f862994d2071 on n-h1-856895-1 Sep 10 11:52:28.107210 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-5cee03ff-7018-487f-beaa-0e9f5f6b17da req-b2354b0c-d7fc-483e-851c-7fab863c5f04 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068893 Sep 10 11:52:28.108049 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1475/3025] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:52:28.120624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3d745bdc-29f9-464b-a69a-d4916cdc7d1f tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:28.121699 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3d745bdc-29f9-464b-a69a-d4916cdc7d1f tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 0954dadf-c6a9-4b78-b38d-2febfb54736a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:28.151364 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3d745bdc-29f9-464b-a69a-d4916cdc7d1f tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:28.152038 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3d745bdc-29f9-464b-a69a-d4916cdc7d1f tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:28.152662 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3d745bdc-29f9-464b-a69a-d4916cdc7d1f tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:28.153636 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3d745bdc-29f9-464b-a69a-d4916cdc7d1f tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:28.154300 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3d745bdc-29f9-464b-a69a-d4916cdc7d1f tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:28.154961 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3d745bdc-29f9-464b-a69a-d4916cdc7d1f tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:28.546808 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=4 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:52:28.724590 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3d745bdc-29f9-464b-a69a-d4916cdc7d1f tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:28.744612 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3d745bdc-29f9-464b-a69a-d4916cdc7d1f tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a" status: 200 len: 1278 microversion: 2.1 time: 0.634123 Sep 10 11:52:28.747900 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1476/3026] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:28 2022] GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a => generated 1278 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:28.759885 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-1d2890f4-6d41-4a99-9a3f-c0a306e5e07e req-bf0214a9-3cef-4399-a841-1c80c97a5686 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da5c3efa-07a9-4b8b-b258-482cecc2a0ea", "tag": "985e81bb-aeae-46fb-bc6f-b3a5e1be77f6"}, {"name": "network-changed", "server_uuid": "da5c3efa-07a9-4b8b-b258-482cecc2a0ea", "tag": "985e81bb-aeae-46fb-bc6f-b3a5e1be77f6"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:52:28.808922 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-1d2890f4-6d41-4a99-9a3f-c0a306e5e07e req-bf0214a9-3cef-4399-a841-1c80c97a5686 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:28.808922 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-1d2890f4-6d41-4a99-9a3f-c0a306e5e07e req-bf0214a9-3cef-4399-a841-1c80c97a5686 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:28.809239 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-1d2890f4-6d41-4a99-9a3f-c0a306e5e07e req-bf0214a9-3cef-4399-a841-1c80c97a5686 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:28.853479 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-1d2890f4-6d41-4a99-9a3f-c0a306e5e07e req-bf0214a9-3cef-4399-a841-1c80c97a5686 service nova] Creating event network-changed:985e81bb-aeae-46fb-bc6f-b3a5e1be77f6 for instance da5c3efa-07a9-4b8b-b258-482cecc2a0ea on n-h1-856895-1 Sep 10 11:52:28.855817 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-1d2890f4-6d41-4a99-9a3f-c0a306e5e07e req-bf0214a9-3cef-4399-a841-1c80c97a5686 service nova] Creating event network-changed:985e81bb-aeae-46fb-bc6f-b3a5e1be77f6 for instance da5c3efa-07a9-4b8b-b258-482cecc2a0ea on n-h1-856895-1 Sep 10 11:52:28.868425 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-1d2890f4-6d41-4a99-9a3f-c0a306e5e07e req-bf0214a9-3cef-4399-a841-1c80c97a5686 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.112656 Sep 10 11:52:28.869808 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1477/3027] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:52:28.884867 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-313d7264-a92c-4eb8-a0b7-492af5d3d581 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f40728a0820>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:28.981107 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-313d7264-a92c-4eb8-a0b7-492af5d3d581 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/1579b63c-4bb7-4e44-ab69-cea48d12791e" status: 200 len: 1412 microversion: 2.1 time: 0.108090 Sep 10 11:52:28.981969 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1478/3028] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:52:28 2022] GET /compute/v2.1/images/1579b63c-4bb7-4e44-ab69-cea48d12791e => generated 1412 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:28.996729 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0319f22f-ce99-4bbf-ad76-b5e797565724 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:28.997861 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0319f22f-ce99-4bbf-ad76-b5e797565724 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:29.014105 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0319f22f-ce99-4bbf-ad76-b5e797565724 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:29.014964 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0319f22f-ce99-4bbf-ad76-b5e797565724 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:29.015692 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0319f22f-ce99-4bbf-ad76-b5e797565724 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:29.017025 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0319f22f-ce99-4bbf-ad76-b5e797565724 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:29.018317 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0319f22f-ce99-4bbf-ad76-b5e797565724 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:29.020718 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0319f22f-ce99-4bbf-ad76-b5e797565724 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:29.788559 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0319f22f-ce99-4bbf-ad76-b5e797565724 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:29.799021 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0319f22f-ce99-4bbf-ad76-b5e797565724 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:29.803035 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0319f22f-ce99-4bbf-ad76-b5e797565724 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:29.816783 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0319f22f-ce99-4bbf-ad76-b5e797565724 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1544 microversion: 2.91 time: 0.833463 Sep 10 11:52:29.818072 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1479/3029] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:28 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1544 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:29.823926 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-76ba086f-a4f7-49e5-976c-bbb645989723 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:29.824836 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-76ba086f-a4f7-49e5-976c-bbb645989723 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:29.832365 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-76ba086f-a4f7-49e5-976c-bbb645989723 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:29.833159 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-76ba086f-a4f7-49e5-976c-bbb645989723 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:29.833838 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-76ba086f-a4f7-49e5-976c-bbb645989723 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:29.834890 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-76ba086f-a4f7-49e5-976c-bbb645989723 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:29.835873 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-76ba086f-a4f7-49e5-976c-bbb645989723 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:29.836521 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-76ba086f-a4f7-49e5-976c-bbb645989723 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:30.023959 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:52:30.052200 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:52:30.345604 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=14 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:52:30.542576 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-76ba086f-a4f7-49e5-976c-bbb645989723 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:30.552695 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-76ba086f-a4f7-49e5-976c-bbb645989723 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1524 microversion: 2.1 time: 0.733278 Sep 10 11:52:30.553292 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1480/3030] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:29 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1524 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:30.568542 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e8ce4be4-9325-4a5d-8b3b-a8743ecb0bd1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:30.569718 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e8ce4be4-9325-4a5d-8b3b-a8743ecb0bd1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 0954dadf-c6a9-4b78-b38d-2febfb54736a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:30.580190 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e8ce4be4-9325-4a5d-8b3b-a8743ecb0bd1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:30.580950 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e8ce4be4-9325-4a5d-8b3b-a8743ecb0bd1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:30.581560 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e8ce4be4-9325-4a5d-8b3b-a8743ecb0bd1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:30.582433 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e8ce4be4-9325-4a5d-8b3b-a8743ecb0bd1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:30.583060 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e8ce4be4-9325-4a5d-8b3b-a8743ecb0bd1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:30.583881 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e8ce4be4-9325-4a5d-8b3b-a8743ecb0bd1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:31.687589 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e8ce4be4-9325-4a5d-8b3b-a8743ecb0bd1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:31.702820 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e8ce4be4-9325-4a5d-8b3b-a8743ecb0bd1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a" status: 200 len: 1320 microversion: 2.1 time: 1.138948 Sep 10 11:52:31.705498 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1481/3031] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:30 2022] GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a => generated 1320 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:31.724019 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-434e173e-9454-4ec3-b1d7-f23ded2f6c9f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f40728e44c0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:32.731033 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6b9fe25a-7c05-4a6d-81ba-9d4eb70b4f93 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.240314 Sep 10 11:52:32.733995 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1551/3032] 10.222.0.23 () {60 vars in 1170 bytes} [Sat Sep 10 11:52:26 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:52:32.736786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-14b49381-771f-4069-87d1-59372ebfa5e5 req-11628e5c-2bc6-473b-9908-6db42f70dde8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985", "tag": "41f294db-6dd8-4d98-bef8-4a14b639fcba"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:52:32.752451 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-14b49381-771f-4069-87d1-59372ebfa5e5 req-11628e5c-2bc6-473b-9908-6db42f70dde8 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:32.753228 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-14b49381-771f-4069-87d1-59372ebfa5e5 req-11628e5c-2bc6-473b-9908-6db42f70dde8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:32.753840 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-14b49381-771f-4069-87d1-59372ebfa5e5 req-11628e5c-2bc6-473b-9908-6db42f70dde8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:32.765063 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-14b49381-771f-4069-87d1-59372ebfa5e5 req-11628e5c-2bc6-473b-9908-6db42f70dde8 service nova] Creating event network-changed:41f294db-6dd8-4d98-bef8-4a14b639fcba for instance 7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985 on n-h1-856895-1 Sep 10 11:52:32.774043 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-14b49381-771f-4069-87d1-59372ebfa5e5 req-11628e5c-2bc6-473b-9908-6db42f70dde8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040193 Sep 10 11:52:32.774579 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1552/3033] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:52:32.782704 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-5f0d2708-dbdf-46c0-bb4a-27fca74f8b83 req-3c358fd8-e95c-4f88-8e0a-bc96f90ab9a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c17b066-2297-4d76-adcb-abae0e87a3c2", "name": "network-vif-plugged", "status": "completed", "tag": "f7ecbdeb-b574-40b0-8ff5-0aed4036ed04"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:52:32.798453 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-5f0d2708-dbdf-46c0-bb4a-27fca74f8b83 req-3c358fd8-e95c-4f88-8e0a-bc96f90ab9a8 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:32.798951 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-5f0d2708-dbdf-46c0-bb4a-27fca74f8b83 req-3c358fd8-e95c-4f88-8e0a-bc96f90ab9a8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:32.799421 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-5f0d2708-dbdf-46c0-bb4a-27fca74f8b83 req-3c358fd8-e95c-4f88-8e0a-bc96f90ab9a8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:32.812564 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-5f0d2708-dbdf-46c0-bb4a-27fca74f8b83 req-3c358fd8-e95c-4f88-8e0a-bc96f90ab9a8 service nova] Creating event network-vif-plugged:f7ecbdeb-b574-40b0-8ff5-0aed4036ed04 for instance 7c17b066-2297-4d76-adcb-abae0e87a3c2 on n-h2-856895-1 Sep 10 11:52:32.818012 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-5f0d2708-dbdf-46c0-bb4a-27fca74f8b83 req-3c358fd8-e95c-4f88-8e0a-bc96f90ab9a8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041929 Sep 10 11:52:32.821993 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1553/3034] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:52:32.827604 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-efc6dc7a-4f0c-4d34-8c20-6bead172611a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:32.829071 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-efc6dc7a-4f0c-4d34-8c20-6bead172611a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:32.835912 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-efc6dc7a-4f0c-4d34-8c20-6bead172611a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:32.836741 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-efc6dc7a-4f0c-4d34-8c20-6bead172611a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:32.837354 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-efc6dc7a-4f0c-4d34-8c20-6bead172611a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:32.838242 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-efc6dc7a-4f0c-4d34-8c20-6bead172611a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:32.838865 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-efc6dc7a-4f0c-4d34-8c20-6bead172611a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:32.852582 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-efc6dc7a-4f0c-4d34-8c20-6bead172611a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:32.975725 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-efc6dc7a-4f0c-4d34-8c20-6bead172611a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:32.988798 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-efc6dc7a-4f0c-4d34-8c20-6bead172611a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:32.991203 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-efc6dc7a-4f0c-4d34-8c20-6bead172611a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:32.999123 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-efc6dc7a-4f0c-4d34-8c20-6bead172611a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1544 microversion: 2.91 time: 0.175639 Sep 10 11:52:33.017129 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1554/3035] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:32 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1544 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:33.027058 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8e2b9ec8-6a02-4776-a4e5-826cf6b52545 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:33.027790 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8e2b9ec8-6a02-4776-a4e5-826cf6b52545 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:33.033866 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e2b9ec8-6a02-4776-a4e5-826cf6b52545 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:33.034588 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e2b9ec8-6a02-4776-a4e5-826cf6b52545 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:33.035215 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e2b9ec8-6a02-4776-a4e5-826cf6b52545 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:33.036077 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e2b9ec8-6a02-4776-a4e5-826cf6b52545 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:33.036714 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e2b9ec8-6a02-4776-a4e5-826cf6b52545 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:33.037504 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e2b9ec8-6a02-4776-a4e5-826cf6b52545 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:33.265426 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8e2b9ec8-6a02-4776-a4e5-826cf6b52545 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:33.273426 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8e2b9ec8-6a02-4776-a4e5-826cf6b52545 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1524 microversion: 2.1 time: 0.254898 Sep 10 11:52:33.274261 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1555/3036] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:33 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1524 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:33.296712 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4ac8f55c-43f7-46a4-958d-0d1b8ac07c14 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:33.298194 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4ac8f55c-43f7-46a4-958d-0d1b8ac07c14 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 0954dadf-c6a9-4b78-b38d-2febfb54736a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:33.308471 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ac8f55c-43f7-46a4-958d-0d1b8ac07c14 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:33.308987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ac8f55c-43f7-46a4-958d-0d1b8ac07c14 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:33.309437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ac8f55c-43f7-46a4-958d-0d1b8ac07c14 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:33.310176 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ac8f55c-43f7-46a4-958d-0d1b8ac07c14 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:33.310637 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ac8f55c-43f7-46a4-958d-0d1b8ac07c14 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:33.311069 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ac8f55c-43f7-46a4-958d-0d1b8ac07c14 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:33.540731 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4ac8f55c-43f7-46a4-958d-0d1b8ac07c14 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:33.551360 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4ac8f55c-43f7-46a4-958d-0d1b8ac07c14 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a" status: 200 len: 1320 microversion: 2.1 time: 0.259776 Sep 10 11:52:33.554818 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1556/3037] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:33 2022] GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a => generated 1320 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:33.560207 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-218a5f0d-1411-4649-8a65-478cd8786bcd tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.47"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:52:33.563772 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-218a5f0d-1411-4649-8a65-478cd8786bcd tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:33.571580 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-218a5f0d-1411-4649-8a65-478cd8786bcd tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:33.572102 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-218a5f0d-1411-4649-8a65-478cd8786bcd tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:33.572544 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-218a5f0d-1411-4649-8a65-478cd8786bcd tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:33.573246 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-218a5f0d-1411-4649-8a65-478cd8786bcd tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:33.573710 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-218a5f0d-1411-4649-8a65-478cd8786bcd tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:33.574144 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-218a5f0d-1411-4649-8a65-478cd8786bcd tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:33.602373 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-218a5f0d-1411-4649-8a65-478cd8786bcd tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "refresh_cache-da5c3efa-07a9-4b8b-b258-482cecc2a0ea" {{(pid=128777) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 10 11:52:33.602780 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-218a5f0d-1411-4649-8a65-478cd8786bcd tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquired lock "refresh_cache-da5c3efa-07a9-4b8b-b258-482cecc2a0ea" {{(pid=128777) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 10 11:52:35.097251 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-218a5f0d-1411-4649-8a65-478cd8786bcd tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Building network info cache for instance {{(pid=128777) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 10 11:52:36.131902 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-218a5f0d-1411-4649-8a65-478cd8786bcd tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Updating instance_info_cache with network_info: [{"id": "985e81bb-aeae-46fb-bc6f-b3a5e1be77f6", "address": "fa:16:3e:d2:00:91", "network": {"id": "8f68d2a9-4e42-44ea-9b28-28dc7e8528d4", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-156299585-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d393ecae873a4fc99a4745ed894b5137", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap985e81bb-ae", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128777) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 10 11:52:36.164796 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-218a5f0d-1411-4649-8a65-478cd8786bcd tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Releasing lock "refresh_cache-da5c3efa-07a9-4b8b-b258-482cecc2a0ea" {{(pid=128777) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 10 11:52:36.166113 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-218a5f0d-1411-4649-8a65-478cd8786bcd tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "POST /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea/action" status: 202 len: 0 microversion: 2.1 time: 2.609903 Sep 10 11:52:36.171495 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1557/3038] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:52:33 2022] POST /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea/action => generated 0 bytes in 2616 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 10 11:52:36.180712 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-c5be3298-1f61-47d2-9ca2-8d5599849c2a req-a24ebd80-7a40-437b-894d-385e52c5ea68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0954dadf-c6a9-4b78-b38d-2febfb54736a", "tag": "3c43a878-d2b9-4792-b156-ab611307dd32"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:52:36.205314 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-c5be3298-1f61-47d2-9ca2-8d5599849c2a req-a24ebd80-7a40-437b-894d-385e52c5ea68 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:36.208758 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-c5be3298-1f61-47d2-9ca2-8d5599849c2a req-a24ebd80-7a40-437b-894d-385e52c5ea68 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:36.209325 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-c5be3298-1f61-47d2-9ca2-8d5599849c2a req-a24ebd80-7a40-437b-894d-385e52c5ea68 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:36.239482 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-c5be3298-1f61-47d2-9ca2-8d5599849c2a req-a24ebd80-7a40-437b-894d-385e52c5ea68 service nova] Creating event network-changed:3c43a878-d2b9-4792-b156-ab611307dd32 for instance 0954dadf-c6a9-4b78-b38d-2febfb54736a on n-h1-856895-1 Sep 10 11:52:36.253942 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-c5be3298-1f61-47d2-9ca2-8d5599849c2a req-a24ebd80-7a40-437b-894d-385e52c5ea68 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079976 Sep 10 11:52:36.254573 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1558/3039] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:52:36.261654 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9d12d4e2-7172-4179-957d-0c6dd3b81dfa tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:36.262260 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9d12d4e2-7172-4179-957d-0c6dd3b81dfa tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:36.278064 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9d12d4e2-7172-4179-957d-0c6dd3b81dfa tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:36.278986 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9d12d4e2-7172-4179-957d-0c6dd3b81dfa tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:36.278986 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9d12d4e2-7172-4179-957d-0c6dd3b81dfa tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:36.279727 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9d12d4e2-7172-4179-957d-0c6dd3b81dfa tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:36.280190 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9d12d4e2-7172-4179-957d-0c6dd3b81dfa tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:36.280639 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9d12d4e2-7172-4179-957d-0c6dd3b81dfa tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:36.453353 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9d12d4e2-7172-4179-957d-0c6dd3b81dfa tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:36.463744 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9d12d4e2-7172-4179-957d-0c6dd3b81dfa tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:36.465219 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9d12d4e2-7172-4179-957d-0c6dd3b81dfa tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:36.471053 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9d12d4e2-7172-4179-957d-0c6dd3b81dfa tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1544 microversion: 2.91 time: 0.215241 Sep 10 11:52:36.471681 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1559/3040] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:36 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1544 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:36.487955 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-330a4edf-4d0d-4231-9c74-69652bd0e3e4 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:36.488631 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-330a4edf-4d0d-4231-9c74-69652bd0e3e4 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:36.506401 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-330a4edf-4d0d-4231-9c74-69652bd0e3e4 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:36.506913 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-330a4edf-4d0d-4231-9c74-69652bd0e3e4 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:36.507398 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-330a4edf-4d0d-4231-9c74-69652bd0e3e4 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:36.508164 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-330a4edf-4d0d-4231-9c74-69652bd0e3e4 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:36.508568 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-330a4edf-4d0d-4231-9c74-69652bd0e3e4 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:36.509700 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-330a4edf-4d0d-4231-9c74-69652bd0e3e4 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:36.853375 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-330a4edf-4d0d-4231-9c74-69652bd0e3e4 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:36.882230 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-330a4edf-4d0d-4231-9c74-69652bd0e3e4 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1524 microversion: 2.1 time: 0.408987 Sep 10 11:52:36.885040 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1560/3041] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:36 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1524 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:36.895039 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-afa3637c-257e-4049-91b9-a3e832b9af74 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:36.897644 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-afa3637c-257e-4049-91b9-a3e832b9af74 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 0954dadf-c6a9-4b78-b38d-2febfb54736a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:36.914197 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-afa3637c-257e-4049-91b9-a3e832b9af74 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:36.915050 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-afa3637c-257e-4049-91b9-a3e832b9af74 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:36.915799 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-afa3637c-257e-4049-91b9-a3e832b9af74 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:36.916767 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-afa3637c-257e-4049-91b9-a3e832b9af74 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:36.917447 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-afa3637c-257e-4049-91b9-a3e832b9af74 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:36.918093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-afa3637c-257e-4049-91b9-a3e832b9af74 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:37.173970 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-afa3637c-257e-4049-91b9-a3e832b9af74 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:37.186194 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-afa3637c-257e-4049-91b9-a3e832b9af74 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a" status: 200 len: 1320 microversion: 2.1 time: 0.299249 Sep 10 11:52:37.187740 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1561/3042] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:36 2022] GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a => generated 1320 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:37.193518 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-b30eb3be-23c8-4c3c-84af-8a1720e20696 req-04dcedb8-f4f7-42a5-ba16-e6a393d106eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4dbe5aa-fddd-42e7-b422-1585785f6034", "tag": "8e40280c-4dd6-4982-bbdb-e834864f3de1"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:52:37.209109 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-b30eb3be-23c8-4c3c-84af-8a1720e20696 req-04dcedb8-f4f7-42a5-ba16-e6a393d106eb service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:37.209691 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-b30eb3be-23c8-4c3c-84af-8a1720e20696 req-04dcedb8-f4f7-42a5-ba16-e6a393d106eb service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:37.210325 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-b30eb3be-23c8-4c3c-84af-8a1720e20696 req-04dcedb8-f4f7-42a5-ba16-e6a393d106eb service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:37.229016 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-b30eb3be-23c8-4c3c-84af-8a1720e20696 req-04dcedb8-f4f7-42a5-ba16-e6a393d106eb service nova] Creating event network-changed:8e40280c-4dd6-4982-bbdb-e834864f3de1 for instance a4dbe5aa-fddd-42e7-b422-1585785f6034 on n-h1-856895-1 Sep 10 11:52:37.234448 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-b30eb3be-23c8-4c3c-84af-8a1720e20696 req-04dcedb8-f4f7-42a5-ba16-e6a393d106eb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045008 Sep 10 11:52:37.239986 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1562/3043] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:52:37.246881 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-e2cce9f6-debb-42f4-97e4-3b5c33015003 req-ac2f1ca5-3b70-4129-ab82-e3228667d08b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4cf27c4-4cda-46f0-94b9-f862994d2071", "name": "network-vif-plugged", "status": "completed", "tag": "98552666-f390-4515-b1a3-d6bf538fb04c"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:52:37.260450 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e2cce9f6-debb-42f4-97e4-3b5c33015003 req-ac2f1ca5-3b70-4129-ab82-e3228667d08b service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:37.261125 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e2cce9f6-debb-42f4-97e4-3b5c33015003 req-ac2f1ca5-3b70-4129-ab82-e3228667d08b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:37.261875 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e2cce9f6-debb-42f4-97e4-3b5c33015003 req-ac2f1ca5-3b70-4129-ab82-e3228667d08b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:37.299344 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-e2cce9f6-debb-42f4-97e4-3b5c33015003 req-ac2f1ca5-3b70-4129-ab82-e3228667d08b service nova] Creating event network-vif-plugged:98552666-f390-4515-b1a3-d6bf538fb04c for instance d4cf27c4-4cda-46f0-94b9-f862994d2071 on n-h1-856895-1 Sep 10 11:52:37.321643 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-e2cce9f6-debb-42f4-97e4-3b5c33015003 req-ac2f1ca5-3b70-4129-ab82-e3228667d08b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076235 Sep 10 11:52:37.323745 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1563/3044] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:52:37.352894 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0c1edbf0-ca10-4abb-9697-75ab3f34e7d0 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Action: 'action', calling method: .version_select at 0x7f40799065e0>, body: {"removeFloatingIp": {"address": "172.25.5.47"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:52:37.651373 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0c1edbf0-ca10-4abb-9697-75ab3f34e7d0 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:37.659926 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c1edbf0-ca10-4abb-9697-75ab3f34e7d0 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:37.668787 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c1edbf0-ca10-4abb-9697-75ab3f34e7d0 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:37.676386 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c1edbf0-ca10-4abb-9697-75ab3f34e7d0 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:37.680141 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c1edbf0-ca10-4abb-9697-75ab3f34e7d0 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:37.680965 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c1edbf0-ca10-4abb-9697-75ab3f34e7d0 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:37.681474 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c1edbf0-ca10-4abb-9697-75ab3f34e7d0 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:38.156917 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c1edbf0-ca10-4abb-9697-75ab3f34e7d0 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "refresh_cache-da5c3efa-07a9-4b8b-b258-482cecc2a0ea" {{(pid=128777) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 10 11:52:38.157350 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c1edbf0-ca10-4abb-9697-75ab3f34e7d0 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquired lock "refresh_cache-da5c3efa-07a9-4b8b-b258-482cecc2a0ea" {{(pid=128777) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 10 11:52:39.865418 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-0c1edbf0-ca10-4abb-9697-75ab3f34e7d0 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Building network info cache for instance {{(pid=128777) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 10 11:52:40.576921 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=44 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:52:41.611867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-0c1edbf0-ca10-4abb-9697-75ab3f34e7d0 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Updating instance_info_cache with network_info: [{"id": "985e81bb-aeae-46fb-bc6f-b3a5e1be77f6", "address": "fa:16:3e:d2:00:91", "network": {"id": "8f68d2a9-4e42-44ea-9b28-28dc7e8528d4", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-156299585-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d393ecae873a4fc99a4745ed894b5137", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap985e81bb-ae", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128777) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 10 11:52:41.633378 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c1edbf0-ca10-4abb-9697-75ab3f34e7d0 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Releasing lock "refresh_cache-da5c3efa-07a9-4b8b-b258-482cecc2a0ea" {{(pid=128777) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 10 11:52:41.643247 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0c1edbf0-ca10-4abb-9697-75ab3f34e7d0 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "POST /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea/action" status: 202 len: 0 microversion: 2.1 time: 4.310126 Sep 10 11:52:41.644352 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1564/3045] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:52:37 2022] POST /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea/action => generated 0 bytes in 4320 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 10 11:52:41.652121 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8bc87cca-e46c-4dfb-986f-b06a732fa81a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:41.653060 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8bc87cca-e46c-4dfb-986f-b06a732fa81a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:41.664415 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:52:41.667754 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8bc87cca-e46c-4dfb-986f-b06a732fa81a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:41.671063 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8bc87cca-e46c-4dfb-986f-b06a732fa81a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:41.671645 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8bc87cca-e46c-4dfb-986f-b06a732fa81a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:41.674747 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8bc87cca-e46c-4dfb-986f-b06a732fa81a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:41.675462 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8bc87cca-e46c-4dfb-986f-b06a732fa81a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:41.678214 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8bc87cca-e46c-4dfb-986f-b06a732fa81a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:41.695841 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=34 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:52:41.898341 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8bc87cca-e46c-4dfb-986f-b06a732fa81a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:41.916441 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8bc87cca-e46c-4dfb-986f-b06a732fa81a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:41.919531 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8bc87cca-e46c-4dfb-986f-b06a732fa81a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:41.937597 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8bc87cca-e46c-4dfb-986f-b06a732fa81a tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1544 microversion: 2.91 time: 0.291641 Sep 10 11:52:41.939610 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1565/3046] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:41 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1544 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:41.950528 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-083bf5ea-e0ea-4666-afd9-391b33145895 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:41.953669 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-083bf5ea-e0ea-4666-afd9-391b33145895 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:41.961006 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-083bf5ea-e0ea-4666-afd9-391b33145895 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:41.961749 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-083bf5ea-e0ea-4666-afd9-391b33145895 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:41.962371 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-083bf5ea-e0ea-4666-afd9-391b33145895 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:41.963796 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-083bf5ea-e0ea-4666-afd9-391b33145895 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:41.964424 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-083bf5ea-e0ea-4666-afd9-391b33145895 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:41.965015 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-083bf5ea-e0ea-4666-afd9-391b33145895 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:42.516481 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-083bf5ea-e0ea-4666-afd9-391b33145895 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:42.518860 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:52:42.533630 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-083bf5ea-e0ea-4666-afd9-391b33145895 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1524 microversion: 2.1 time: 0.591677 Sep 10 11:52:42.534264 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1566/3047] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:41 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1524 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:42.546152 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7ecb8b4d-7d96-460a-8929-e8cc97502a54 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:42.548395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7ecb8b4d-7d96-460a-8929-e8cc97502a54 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 0954dadf-c6a9-4b78-b38d-2febfb54736a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:42.560368 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ecb8b4d-7d96-460a-8929-e8cc97502a54 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:42.561061 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ecb8b4d-7d96-460a-8929-e8cc97502a54 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:42.561574 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ecb8b4d-7d96-460a-8929-e8cc97502a54 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:42.563076 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ecb8b4d-7d96-460a-8929-e8cc97502a54 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:42.564060 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ecb8b4d-7d96-460a-8929-e8cc97502a54 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:42.564704 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ecb8b4d-7d96-460a-8929-e8cc97502a54 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:42.634363 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-434e173e-9454-4ec3-b1d7-f23ded2f6c9f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/1579b63c-4bb7-4e44-ab69-cea48d12791e" status: 200 len: 1421 microversion: 2.1 time: 10.925406 Sep 10 11:52:42.634972 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1482/3048] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:52:31 2022] GET /compute/v2.1/images/1579b63c-4bb7-4e44-ab69-cea48d12791e => generated 1421 bytes in 10929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:42.639556 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-c990fb01-b879-48cc-adfd-685f702d1631 req-27d1ca95-5690-4f22-ace0-1e3dcb41607d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da5c3efa-07a9-4b8b-b258-482cecc2a0ea", "tag": "985e81bb-aeae-46fb-bc6f-b3a5e1be77f6"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:52:42.657759 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-c990fb01-b879-48cc-adfd-685f702d1631 req-27d1ca95-5690-4f22-ace0-1e3dcb41607d service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:42.658239 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-c990fb01-b879-48cc-adfd-685f702d1631 req-27d1ca95-5690-4f22-ace0-1e3dcb41607d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:42.658670 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-c990fb01-b879-48cc-adfd-685f702d1631 req-27d1ca95-5690-4f22-ace0-1e3dcb41607d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:42.672493 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-c990fb01-b879-48cc-adfd-685f702d1631 req-27d1ca95-5690-4f22-ace0-1e3dcb41607d service nova] Creating event network-changed:985e81bb-aeae-46fb-bc6f-b3a5e1be77f6 for instance da5c3efa-07a9-4b8b-b258-482cecc2a0ea on n-h1-856895-1 Sep 10 11:52:42.677331 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-c990fb01-b879-48cc-adfd-685f702d1631 req-27d1ca95-5690-4f22-ace0-1e3dcb41607d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041062 Sep 10 11:52:42.677948 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1483/3049] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:52:42.682961 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-aa85eeda-e022-4123-8bbc-13b928986716 req-6aa98705-5acf-4a90-a51a-90d13c832206 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985", "name": "network-vif-plugged", "status": "completed", "tag": "41f294db-6dd8-4d98-bef8-4a14b639fcba"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:52:42.693232 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-aa85eeda-e022-4123-8bbc-13b928986716 req-6aa98705-5acf-4a90-a51a-90d13c832206 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:42.693726 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-aa85eeda-e022-4123-8bbc-13b928986716 req-6aa98705-5acf-4a90-a51a-90d13c832206 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:42.694190 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-aa85eeda-e022-4123-8bbc-13b928986716 req-6aa98705-5acf-4a90-a51a-90d13c832206 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:42.863221 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7ecb8b4d-7d96-460a-8929-e8cc97502a54 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:42.873821 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7ecb8b4d-7d96-460a-8929-e8cc97502a54 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a" status: 200 len: 1320 microversion: 2.1 time: 0.338336 Sep 10 11:52:42.874594 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1567/3050] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:42 2022] GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a => generated 1320 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:42.880359 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e873041a-845c-4e57-a4c2-2f70c6644631 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '.version_select at 0x7f4072595700>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:42.949735 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-aa85eeda-e022-4123-8bbc-13b928986716 req-6aa98705-5acf-4a90-a51a-90d13c832206 service nova] Creating event network-vif-plugged:41f294db-6dd8-4d98-bef8-4a14b639fcba for instance 7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985 on n-h1-856895-1 Sep 10 11:52:42.960284 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-aa85eeda-e022-4123-8bbc-13b928986716 req-6aa98705-5acf-4a90-a51a-90d13c832206 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.280934 Sep 10 11:52:42.960894 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1484/3051] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:52:42.970687 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4f25316c-89f4-431e-8c34-ce795c6b9809 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f4072885ee0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:43.032128 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4f25316c-89f4-431e-8c34-ce795c6b9809 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/1579b63c-4bb7-4e44-ab69-cea48d12791e" status: 200 len: 1421 microversion: 2.1 time: 0.068652 Sep 10 11:52:43.033303 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1485/3052] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:52:42 2022] GET /compute/v2.1/images/1579b63c-4bb7-4e44-ab69-cea48d12791e => generated 1421 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:43.039042 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-080e2fd4-d3dc-46cf-9dba-f582c5a5bc6e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:43.040009 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-080e2fd4-d3dc-46cf-9dba-f582c5a5bc6e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:43.049169 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-080e2fd4-d3dc-46cf-9dba-f582c5a5bc6e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:43.049953 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-080e2fd4-d3dc-46cf-9dba-f582c5a5bc6e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:43.050581 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-080e2fd4-d3dc-46cf-9dba-f582c5a5bc6e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:43.051516 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-080e2fd4-d3dc-46cf-9dba-f582c5a5bc6e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:43.052135 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-080e2fd4-d3dc-46cf-9dba-f582c5a5bc6e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:43.052726 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-080e2fd4-d3dc-46cf-9dba-f582c5a5bc6e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:43.168548 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-080e2fd4-d3dc-46cf-9dba-f582c5a5bc6e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:43.183011 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-080e2fd4-d3dc-46cf-9dba-f582c5a5bc6e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:43.184550 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-080e2fd4-d3dc-46cf-9dba-f582c5a5bc6e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:43.196599 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-080e2fd4-d3dc-46cf-9dba-f582c5a5bc6e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1544 microversion: 2.91 time: 0.161966 Sep 10 11:52:43.227436 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1486/3053] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:43 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1544 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:43.237640 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b8387831-6c35-4487-9371-f54ff1db5e25 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f40728dfdc0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:44.060618 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e873041a-845c-4e57-a4c2-2f70c6644631 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/082229c3-b164-437a-b82a-627a36cad076" status: 202 len: 0 microversion: 2.1 time: 1.184084 Sep 10 11:52:44.061213 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1568/3054] 10.222.0.23 () {58 vars in 1263 bytes} [Sat Sep 10 11:52:42 2022] DELETE /compute/v2.1/os-floating-ips/082229c3-b164-437a-b82a-627a36cad076 => generated 0 bytes in 1186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:52:44.066929 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e9b8820a-38bf-4ccc-9fad-a82040fcb519 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Action: 'create', calling method: .version_select at 0x7f407253f1f0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2141031577", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvmAgYap/hXMI49juAIeASk8aJt8wdyhTcosT+Cxa8GdT0CX+cSpYe86P9sM+RH4P9Es7xeXmxPPH9FlGVeZC7mVwGy42Lk8Q4miRbNkzdLLQMtIEOxeBMk4bvNo0FpaQ=="}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:52:44.091785 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-e9b8820a-38bf-4ccc-9fad-a82040fcb519 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Getting quotas for project 20756c1a77fb44f684973f382b802825. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:52:44.099290 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-e9b8820a-38bf-4ccc-9fad-a82040fcb519 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Getting quotas for user 92be647276cc456e83dacd25b98e37f2 and project 20756c1a77fb44f684973f382b802825. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:52:44.129452 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e9b8820a-38bf-4ccc-9fad-a82040fcb519 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.066684 Sep 10 11:52:44.130429 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1569/3055] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 11:52:44 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:52:44.150812 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a203b7f4-fe7d-4efd-a545-bbd74097b86d tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:44.151481 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a203b7f4-fe7d-4efd-a545-bbd74097b86d tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:44.153685 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b8387831-6c35-4487-9371-f54ff1db5e25 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "DELETE /compute/v2.1/images/1579b63c-4bb7-4e44-ab69-cea48d12791e" status: 204 len: 0 microversion: 2.1 time: 0.926749 Sep 10 11:52:44.154250 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1487/3056] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:43 2022] DELETE /compute/v2.1/images/1579b63c-4bb7-4e44-ab69-cea48d12791e => generated 0 bytes in 933 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:52:44.160066 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a203b7f4-fe7d-4efd-a545-bbd74097b86d tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:44.160559 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8cc57cc2-36e8-4c5c-955c-b170ece13e20 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:44.161110 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a203b7f4-fe7d-4efd-a545-bbd74097b86d tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:44.161244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8cc57cc2-36e8-4c5c-955c-b170ece13e20 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 0954dadf-c6a9-4b78-b38d-2febfb54736a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:44.161887 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a203b7f4-fe7d-4efd-a545-bbd74097b86d tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:44.162959 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a203b7f4-fe7d-4efd-a545-bbd74097b86d tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:44.163638 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a203b7f4-fe7d-4efd-a545-bbd74097b86d tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:44.164256 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a203b7f4-fe7d-4efd-a545-bbd74097b86d tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:44.168657 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8cc57cc2-36e8-4c5c-955c-b170ece13e20 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:44.169155 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8cc57cc2-36e8-4c5c-955c-b170ece13e20 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:44.169916 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8cc57cc2-36e8-4c5c-955c-b170ece13e20 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:44.170715 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8cc57cc2-36e8-4c5c-955c-b170ece13e20 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:44.171293 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8cc57cc2-36e8-4c5c-955c-b170ece13e20 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:44.172032 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8cc57cc2-36e8-4c5c-955c-b170ece13e20 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:44.442898 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a203b7f4-fe7d-4efd-a545-bbd74097b86d tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:44.450867 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a203b7f4-fe7d-4efd-a545-bbd74097b86d tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1524 microversion: 2.1 time: 0.318986 Sep 10 11:52:44.451511 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1570/3057] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:44 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1524 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:44.456928 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4616584d-c5a1-4ae2-ae55-6ede97c2c0f4 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '.version_select at 0x7f407258a160>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:44.467959 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8cc57cc2-36e8-4c5c-955c-b170ece13e20 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:44.477176 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8cc57cc2-36e8-4c5c-955c-b170ece13e20 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a" status: 200 len: 1320 microversion: 2.1 time: 0.321694 Sep 10 11:52:44.477931 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1488/3058] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:44 2022] GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a => generated 1320 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:44.482684 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cef8c5c6-7eda-48d9-9985-217927ea9fea tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:44.483458 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cef8c5c6-7eda-48d9-9985-217927ea9fea tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 7c17b066-2297-4d76-adcb-abae0e87a3c2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:44.490531 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cef8c5c6-7eda-48d9-9985-217927ea9fea tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:44.491043 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cef8c5c6-7eda-48d9-9985-217927ea9fea tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:44.491603 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cef8c5c6-7eda-48d9-9985-217927ea9fea tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:44.492304 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cef8c5c6-7eda-48d9-9985-217927ea9fea tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:44.492778 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cef8c5c6-7eda-48d9-9985-217927ea9fea tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:44.493338 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cef8c5c6-7eda-48d9-9985-217927ea9fea tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:44.521340 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cef8c5c6-7eda-48d9-9985-217927ea9fea tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 7c17b066-2297-4d76-adcb-abae0e87a3c2] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:52:44.613176 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cef8c5c6-7eda-48d9-9985-217927ea9fea tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2" status: 204 len: 0 microversion: 2.1 time: 0.133570 Sep 10 11:52:44.613801 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1489/3059] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:52:44 2022] DELETE /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:52:44.622998 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4ddd3444-5146-4951-a73a-d2d830d66aad tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:44.623962 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4ddd3444-5146-4951-a73a-d2d830d66aad tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:44.634327 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ddd3444-5146-4951-a73a-d2d830d66aad tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:44.634850 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ddd3444-5146-4951-a73a-d2d830d66aad tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:44.635326 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ddd3444-5146-4951-a73a-d2d830d66aad tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:44.636158 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ddd3444-5146-4951-a73a-d2d830d66aad tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:44.636692 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ddd3444-5146-4951-a73a-d2d830d66aad tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:44.637140 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ddd3444-5146-4951-a73a-d2d830d66aad tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:44.736501 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4ddd3444-5146-4951-a73a-d2d830d66aad tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:44.749653 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4ddd3444-5146-4951-a73a-d2d830d66aad tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:44.754877 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4ddd3444-5146-4951-a73a-d2d830d66aad tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:44.761208 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4ddd3444-5146-4951-a73a-d2d830d66aad tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1544 microversion: 2.91 time: 0.142307 Sep 10 11:52:44.761874 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1490/3060] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:44 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1544 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:44.770984 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4616584d-c5a1-4ae2-ae55-6ede97c2c0f4 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "DELETE /compute/v2.1/os-security-groups/d71b7c0a-2dcb-4f9d-a322-07ef6419d985" status: 202 len: 0 microversion: 2.1 time: 0.317732 Sep 10 11:52:44.771862 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-f410e20f-be97-4cb3-88d3-10a96fe59900 req-f85a3197-5ba1-4dfa-ab09-0d26d855ca73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da5c3efa-07a9-4b8b-b258-482cecc2a0ea", "tag": "985e81bb-aeae-46fb-bc6f-b3a5e1be77f6"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:52:44.772172 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1571/3061] 10.222.0.23 () {58 vars in 1272 bytes} [Sat Sep 10 11:52:44 2022] DELETE /compute/v2.1/os-security-groups/d71b7c0a-2dcb-4f9d-a322-07ef6419d985 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:52:44.777269 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-67c85f9e-8132-4869-9e16-bdc8359db616 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-216671570", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "a9ff9635-7794-44ea-9e2d-dac85a415bc7"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:52:44.791493 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f410e20f-be97-4cb3-88d3-10a96fe59900 req-f85a3197-5ba1-4dfa-ab09-0d26d855ca73 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:44.792296 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f410e20f-be97-4cb3-88d3-10a96fe59900 req-f85a3197-5ba1-4dfa-ab09-0d26d855ca73 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:44.793189 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f410e20f-be97-4cb3-88d3-10a96fe59900 req-f85a3197-5ba1-4dfa-ab09-0d26d855ca73 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:44.806968 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-f410e20f-be97-4cb3-88d3-10a96fe59900 req-f85a3197-5ba1-4dfa-ab09-0d26d855ca73 service nova] Creating event network-changed:985e81bb-aeae-46fb-bc6f-b3a5e1be77f6 for instance da5c3efa-07a9-4b8b-b258-482cecc2a0ea on n-h1-856895-1 Sep 10 11:52:44.812474 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-f410e20f-be97-4cb3-88d3-10a96fe59900 req-f85a3197-5ba1-4dfa-ab09-0d26d855ca73 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049114 Sep 10 11:52:44.813082 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1491/3062] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:52:44.819361 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-06e831fd-1a4e-47be-918f-489cf0958999 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:44.820367 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-06e831fd-1a4e-47be-918f-489cf0958999 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:44.828861 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-06e831fd-1a4e-47be-918f-489cf0958999 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:44.829754 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-06e831fd-1a4e-47be-918f-489cf0958999 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:44.830496 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-06e831fd-1a4e-47be-918f-489cf0958999 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:44.831445 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-06e831fd-1a4e-47be-918f-489cf0958999 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:44.832068 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-06e831fd-1a4e-47be-918f-489cf0958999 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:44.832692 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-06e831fd-1a4e-47be-918f-489cf0958999 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:44.896649 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-67c85f9e-8132-4869-9e16-bdc8359db616 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] validate_networks() for [('a9ff9635-7794-44ea-9e2d-dac85a415bc7', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:52:44.898447 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-06e831fd-1a4e-47be-918f-489cf0958999 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:52:45.015267 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-06e831fd-1a4e-47be-918f-489cf0958999 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "DELETE /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 204 len: 0 microversion: 2.1 time: 0.200077 Sep 10 11:52:45.017456 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1492/3063] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:52:44 2022] DELETE /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:52:45.027062 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-52f5b076-5e50-468a-9651-b2b5e84a0346 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:45.028070 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-52f5b076-5e50-468a-9651-b2b5e84a0346 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:45.038596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52f5b076-5e50-468a-9651-b2b5e84a0346 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:45.039901 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52f5b076-5e50-468a-9651-b2b5e84a0346 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:45.040702 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52f5b076-5e50-468a-9651-b2b5e84a0346 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:45.041609 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52f5b076-5e50-468a-9651-b2b5e84a0346 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:45.042459 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52f5b076-5e50-468a-9651-b2b5e84a0346 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:45.043801 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52f5b076-5e50-468a-9651-b2b5e84a0346 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:45.368020 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-52f5b076-5e50-468a-9651-b2b5e84a0346 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:45.380019 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-52f5b076-5e50-468a-9651-b2b5e84a0346 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1510 microversion: 2.1 time: 0.358310 Sep 10 11:52:45.381522 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1493/3064] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:45 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1510 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:52:45.480858 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1c7b70c8-bb4b-456a-9418-10a7d799e713 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:45.485341 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1c7b70c8-bb4b-456a-9418-10a7d799e713 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:45.502661 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1c7b70c8-bb4b-456a-9418-10a7d799e713 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:45.503609 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1c7b70c8-bb4b-456a-9418-10a7d799e713 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:45.504292 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1c7b70c8-bb4b-456a-9418-10a7d799e713 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:45.505136 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1c7b70c8-bb4b-456a-9418-10a7d799e713 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:45.505692 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1c7b70c8-bb4b-456a-9418-10a7d799e713 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:45.506242 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1c7b70c8-bb4b-456a-9418-10a7d799e713 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:45.520345 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-67c85f9e-8132-4869-9e16-bdc8359db616 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:52:45.521288 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-67c85f9e-8132-4869-9e16-bdc8359db616 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:52:45.521925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-67c85f9e-8132-4869-9e16-bdc8359db616 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:52:45.523992 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-67c85f9e-8132-4869-9e16-bdc8359db616 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:52:45.525589 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-67c85f9e-8132-4869-9e16-bdc8359db616 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:52:45.540098 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-67c85f9e-8132-4869-9e16-bdc8359db616 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:45.540963 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-67c85f9e-8132-4869-9e16-bdc8359db616 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:45.541580 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-67c85f9e-8132-4869-9e16-bdc8359db616 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:45.542462 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-67c85f9e-8132-4869-9e16-bdc8359db616 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:45.543075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-67c85f9e-8132-4869-9e16-bdc8359db616 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:45.543691 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-67c85f9e-8132-4869-9e16-bdc8359db616 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:45.562646 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-67c85f9e-8132-4869-9e16-bdc8359db616 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Getting quotas for project 57eb6c59b1a7467baf0daae9019ca5aa. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:52:45.568665 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-67c85f9e-8132-4869-9e16-bdc8359db616 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Getting quotas for user 1ead4e0fd51b484c8dd38da5a3975788 and project 57eb6c59b1a7467baf0daae9019ca5aa. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:52:45.582487 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-67c85f9e-8132-4869-9e16-bdc8359db616 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:52:45.584993 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-67c85f9e-8132-4869-9e16-bdc8359db616 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: c56e3146-bad1-4abf-853a-2d01226d85b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:52:45.641965 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-67c85f9e-8132-4869-9e16-bdc8359db616 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.866953 Sep 10 11:52:45.642673 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1572/3065] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:52:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:52:45.656828 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b110c09d-56af-485f-96b8-ca6d2b58c242 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:45.658384 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b110c09d-56af-485f-96b8-ca6d2b58c242 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 0954dadf-c6a9-4b78-b38d-2febfb54736a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:45.671671 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b110c09d-56af-485f-96b8-ca6d2b58c242 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:45.672689 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b110c09d-56af-485f-96b8-ca6d2b58c242 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:45.673326 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b110c09d-56af-485f-96b8-ca6d2b58c242 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:45.674237 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b110c09d-56af-485f-96b8-ca6d2b58c242 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:45.674878 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b110c09d-56af-485f-96b8-ca6d2b58c242 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:45.675631 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b110c09d-56af-485f-96b8-ca6d2b58c242 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:45.721624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1c7b70c8-bb4b-456a-9418-10a7d799e713 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:45.735621 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1c7b70c8-bb4b-456a-9418-10a7d799e713 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1524 microversion: 2.1 time: 0.262592 Sep 10 11:52:45.736213 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1494/3066] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:45 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1524 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:52:45.744504 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-29775cc1-1443-4ec0-a264-8c55a2daca52 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:45.745126 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-29775cc1-1443-4ec0-a264-8c55a2daca52 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: c56e3146-bad1-4abf-853a-2d01226d85b4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:45.879667 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-29775cc1-1443-4ec0-a264-8c55a2daca52 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:45.892516 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-29775cc1-1443-4ec0-a264-8c55a2daca52 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/c56e3146-bad1-4abf-853a-2d01226d85b4" status: 200 len: 1207 microversion: 2.1 time: 0.149200 Sep 10 11:52:45.892845 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1495/3067] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:45 2022] GET /compute/v2.1/servers/c56e3146-bad1-4abf-853a-2d01226d85b4 => generated 1207 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:45.901184 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e6c0eefd-7bb6-4fba-bf70-414880310fbf tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:45.902059 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e6c0eefd-7bb6-4fba-bf70-414880310fbf tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:45.915359 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6c0eefd-7bb6-4fba-bf70-414880310fbf tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:45.915874 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6c0eefd-7bb6-4fba-bf70-414880310fbf tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:45.916331 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6c0eefd-7bb6-4fba-bf70-414880310fbf tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:45.919762 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6c0eefd-7bb6-4fba-bf70-414880310fbf tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:45.920246 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6c0eefd-7bb6-4fba-bf70-414880310fbf tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:45.921102 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6c0eefd-7bb6-4fba-bf70-414880310fbf tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:45.954933 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b110c09d-56af-485f-96b8-ca6d2b58c242 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:45.964415 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b110c09d-56af-485f-96b8-ca6d2b58c242 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a" status: 200 len: 1320 microversion: 2.1 time: 0.316076 Sep 10 11:52:45.965608 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1573/3068] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:45 2022] GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a => generated 1320 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:45.971078 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0c91197d-c31d-4db3-bfec-fe9925dfab96 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-179089133", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "f6eaa2c8-24e2-4172-938b-93924e632fa0"}], "key_name": "tempest-TestNetworkBasicOps-2141031577", "security_groups": [{"name": "tempest-secgroup-smoke-1969164558"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:52:46.007432 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e6c0eefd-7bb6-4fba-bf70-414880310fbf tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:46.017251 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e6c0eefd-7bb6-4fba-bf70-414880310fbf tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:46.019093 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e6c0eefd-7bb6-4fba-bf70-414880310fbf tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:46.032146 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e6c0eefd-7bb6-4fba-bf70-414880310fbf tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1544 microversion: 2.91 time: 0.135743 Sep 10 11:52:46.034997 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1496/3069] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:45 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1544 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:46.040681 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-c754962c-e834-420b-b747-d23c817d017b req-c27e416b-c743-4cc3-a545-a734e0ecb59a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c17b066-2297-4d76-adcb-abae0e87a3c2", "name": "network-vif-unplugged", "status": "completed", "tag": "f7ecbdeb-b574-40b0-8ff5-0aed4036ed04"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:52:46.075376 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-c754962c-e834-420b-b747-d23c817d017b req-c27e416b-c743-4cc3-a545-a734e0ecb59a service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:46.075915 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-c754962c-e834-420b-b747-d23c817d017b req-c27e416b-c743-4cc3-a545-a734e0ecb59a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:46.076461 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-c754962c-e834-420b-b747-d23c817d017b req-c27e416b-c743-4cc3-a545-a734e0ecb59a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:46.090738 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-c754962c-e834-420b-b747-d23c817d017b req-c27e416b-c743-4cc3-a545-a734e0ecb59a service nova] Creating event network-vif-unplugged:f7ecbdeb-b574-40b0-8ff5-0aed4036ed04 for instance 7c17b066-2297-4d76-adcb-abae0e87a3c2 on n-h2-856895-1 Sep 10 11:52:46.096632 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-c754962c-e834-420b-b747-d23c817d017b req-c27e416b-c743-4cc3-a545-a734e0ecb59a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060004 Sep 10 11:52:46.098079 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1497/3070] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:52:46.112700 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-0c91197d-c31d-4db3-bfec-fe9925dfab96 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] validate_networks() for [('f6eaa2c8-24e2-4172-938b-93924e632fa0', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:52:46.405815 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3a911fe5-ce53-4a6f-9bb4-bf1330bcc3e8 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:46.407423 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3a911fe5-ce53-4a6f-9bb4-bf1330bcc3e8 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:46.415767 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3a911fe5-ce53-4a6f-9bb4-bf1330bcc3e8 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:46.416670 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3a911fe5-ce53-4a6f-9bb4-bf1330bcc3e8 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:46.417355 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3a911fe5-ce53-4a6f-9bb4-bf1330bcc3e8 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:46.419462 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3a911fe5-ce53-4a6f-9bb4-bf1330bcc3e8 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:46.420175 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3a911fe5-ce53-4a6f-9bb4-bf1330bcc3e8 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:46.420850 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3a911fe5-ce53-4a6f-9bb4-bf1330bcc3e8 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:46.586120 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-0c91197d-c31d-4db3-bfec-fe9925dfab96 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:52:46.586597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-0c91197d-c31d-4db3-bfec-fe9925dfab96 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:52:46.587200 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-0c91197d-c31d-4db3-bfec-fe9925dfab96 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:52:46.587622 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-0c91197d-c31d-4db3-bfec-fe9925dfab96 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:52:46.588044 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-0c91197d-c31d-4db3-bfec-fe9925dfab96 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:52:46.599880 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c91197d-c31d-4db3-bfec-fe9925dfab96 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:46.600637 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c91197d-c31d-4db3-bfec-fe9925dfab96 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:46.601250 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c91197d-c31d-4db3-bfec-fe9925dfab96 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:46.602245 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c91197d-c31d-4db3-bfec-fe9925dfab96 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:46.602875 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c91197d-c31d-4db3-bfec-fe9925dfab96 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:46.603727 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c91197d-c31d-4db3-bfec-fe9925dfab96 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:46.615715 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3a911fe5-ce53-4a6f-9bb4-bf1330bcc3e8 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:46.623952 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3a911fe5-ce53-4a6f-9bb4-bf1330bcc3e8 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1510 microversion: 2.1 time: 0.222329 Sep 10 11:52:46.624946 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1498/3071] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:46 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1510 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:52:46.635915 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-0c91197d-c31d-4db3-bfec-fe9925dfab96 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Getting quotas for project 20756c1a77fb44f684973f382b802825. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:52:46.641333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-0c91197d-c31d-4db3-bfec-fe9925dfab96 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Getting quotas for user 92be647276cc456e83dacd25b98e37f2 and project 20756c1a77fb44f684973f382b802825. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:52:46.655480 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0c91197d-c31d-4db3-bfec-fe9925dfab96 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:52:46.658379 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0c91197d-c31d-4db3-bfec-fe9925dfab96 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: 3ce09007-d5b4-4565-96db-00ec7c98fb75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:52:46.711240 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0c91197d-c31d-4db3-bfec-fe9925dfab96 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.744180 Sep 10 11:52:46.711911 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1574/3072] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:52:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:52:46.717270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-bcaa2a78-3be0-4ac6-ae25-784fd983c703 req-1d606040-a3f8-4d37-af5e-2ed7d1a912b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c17b066-2297-4d76-adcb-abae0e87a3c2", "name": "network-vif-deleted", "tag": "f7ecbdeb-b574-40b0-8ff5-0aed4036ed04"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:52:46.723950 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c0d42d6c-2463-401f-b449-efe31c21d60d tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:46.724657 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c0d42d6c-2463-401f-b449-efe31c21d60d tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: 3ce09007-d5b4-4565-96db-00ec7c98fb75] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:46.733565 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-bcaa2a78-3be0-4ac6-ae25-784fd983c703 req-1d606040-a3f8-4d37-af5e-2ed7d1a912b9 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:46.735985 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-bcaa2a78-3be0-4ac6-ae25-784fd983c703 req-1d606040-a3f8-4d37-af5e-2ed7d1a912b9 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:46.736778 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-bcaa2a78-3be0-4ac6-ae25-784fd983c703 req-1d606040-a3f8-4d37-af5e-2ed7d1a912b9 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:46.753304 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-bcaa2a78-3be0-4ac6-ae25-784fd983c703 req-1d606040-a3f8-4d37-af5e-2ed7d1a912b9 service nova] Creating event network-vif-deleted:f7ecbdeb-b574-40b0-8ff5-0aed4036ed04 for instance 7c17b066-2297-4d76-adcb-abae0e87a3c2 on n-h2-856895-1 Sep 10 11:52:46.759485 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-bcaa2a78-3be0-4ac6-ae25-784fd983c703 req-1d606040-a3f8-4d37-af5e-2ed7d1a912b9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049506 Sep 10 11:52:46.760331 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1499/3073] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:52:46.772420 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-08709c93-3d06-4198-9e35-a762fd20cfac tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:46.773542 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-08709c93-3d06-4198-9e35-a762fd20cfac tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:46.780825 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-08709c93-3d06-4198-9e35-a762fd20cfac tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:46.782378 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-08709c93-3d06-4198-9e35-a762fd20cfac tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:46.783067 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-08709c93-3d06-4198-9e35-a762fd20cfac tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:46.784186 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-08709c93-3d06-4198-9e35-a762fd20cfac tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:46.785265 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-08709c93-3d06-4198-9e35-a762fd20cfac tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:46.786051 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-08709c93-3d06-4198-9e35-a762fd20cfac tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:46.801526 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c0d42d6c-2463-401f-b449-efe31c21d60d tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be647276cc456e83dacd25b98e37f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20756c1a77fb44f684973f382b802825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:46.810018 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c0d42d6c-2463-401f-b449-efe31c21d60d tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/3ce09007-d5b4-4565-96db-00ec7c98fb75" status: 200 len: 1248 microversion: 2.1 time: 0.090176 Sep 10 11:52:46.813932 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1575/3074] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:46 2022] GET /compute/v2.1/servers/3ce09007-d5b4-4565-96db-00ec7c98fb75 => generated 1248 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:52:46.915229 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9db6d3a1-bc8c-4b07-ad57-c36fc498e6a8 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:46.915869 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9db6d3a1-bc8c-4b07-ad57-c36fc498e6a8 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: c56e3146-bad1-4abf-853a-2d01226d85b4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:46.923473 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9db6d3a1-bc8c-4b07-ad57-c36fc498e6a8 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:46.923988 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9db6d3a1-bc8c-4b07-ad57-c36fc498e6a8 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:46.925523 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9db6d3a1-bc8c-4b07-ad57-c36fc498e6a8 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:46.926811 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9db6d3a1-bc8c-4b07-ad57-c36fc498e6a8 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:46.927233 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9db6d3a1-bc8c-4b07-ad57-c36fc498e6a8 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:46.927784 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9db6d3a1-bc8c-4b07-ad57-c36fc498e6a8 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:46.966966 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-08709c93-3d06-4198-9e35-a762fd20cfac tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:46.993428 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-08709c93-3d06-4198-9e35-a762fd20cfac tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1524 microversion: 2.1 time: 0.231186 Sep 10 11:52:46.994141 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1500/3075] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:46 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1524 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:47.013871 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2705a360-bd77-4ae4-a146-2f5ff23c457d tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:47.014917 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2705a360-bd77-4ae4-a146-2f5ff23c457d tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 0954dadf-c6a9-4b78-b38d-2febfb54736a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:47.022623 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2705a360-bd77-4ae4-a146-2f5ff23c457d tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:47.023488 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2705a360-bd77-4ae4-a146-2f5ff23c457d tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:47.024040 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2705a360-bd77-4ae4-a146-2f5ff23c457d tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:47.027306 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2705a360-bd77-4ae4-a146-2f5ff23c457d tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:47.028250 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2705a360-bd77-4ae4-a146-2f5ff23c457d tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:47.029634 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2705a360-bd77-4ae4-a146-2f5ff23c457d tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:47.075019 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9db6d3a1-bc8c-4b07-ad57-c36fc498e6a8 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:47.089695 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9db6d3a1-bc8c-4b07-ad57-c36fc498e6a8 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/c56e3146-bad1-4abf-853a-2d01226d85b4" status: 200 len: 1259 microversion: 2.1 time: 0.178713 Sep 10 11:52:47.093891 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1576/3076] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:46 2022] GET /compute/v2.1/servers/c56e3146-bad1-4abf-853a-2d01226d85b4 => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:47.099041 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2117c6bf-d27c-4487-9868-76886f11eeb3 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:47.099885 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2117c6bf-d27c-4487-9868-76886f11eeb3 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:47.106405 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2117c6bf-d27c-4487-9868-76886f11eeb3 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:47.107145 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2117c6bf-d27c-4487-9868-76886f11eeb3 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:47.107787 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2117c6bf-d27c-4487-9868-76886f11eeb3 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:47.108663 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2117c6bf-d27c-4487-9868-76886f11eeb3 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:47.109862 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2117c6bf-d27c-4487-9868-76886f11eeb3 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:47.110723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2117c6bf-d27c-4487-9868-76886f11eeb3 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:47.314198 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2117c6bf-d27c-4487-9868-76886f11eeb3 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:47.326815 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2117c6bf-d27c-4487-9868-76886f11eeb3 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:47.331263 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2117c6bf-d27c-4487-9868-76886f11eeb3 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:47.338793 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2117c6bf-d27c-4487-9868-76886f11eeb3 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1544 microversion: 2.91 time: 0.241985 Sep 10 11:52:47.339959 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1577/3077] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:47 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1544 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:47.410087 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2705a360-bd77-4ae4-a146-2f5ff23c457d tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:47.418486 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2705a360-bd77-4ae4-a146-2f5ff23c457d tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a" status: 200 len: 1320 microversion: 2.1 time: 0.423073 Sep 10 11:52:47.419067 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1501/3078] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:46 2022] GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a => generated 1320 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:47.648945 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fc328751-a0bb-4ccb-864b-1ffbfcf9bc68 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:47.649808 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fc328751-a0bb-4ccb-864b-1ffbfcf9bc68 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:47.656529 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc328751-a0bb-4ccb-864b-1ffbfcf9bc68 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:47.657194 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc328751-a0bb-4ccb-864b-1ffbfcf9bc68 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:47.657698 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc328751-a0bb-4ccb-864b-1ffbfcf9bc68 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:47.658487 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc328751-a0bb-4ccb-864b-1ffbfcf9bc68 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:47.659013 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc328751-a0bb-4ccb-864b-1ffbfcf9bc68 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:47.659598 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc328751-a0bb-4ccb-864b-1ffbfcf9bc68 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:47.838608 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fc328751-a0bb-4ccb-864b-1ffbfcf9bc68 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:47.838839 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5ec37550-fbdf-45d0-94b5-8739748377ac tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:47.839508 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5ec37550-fbdf-45d0-94b5-8739748377ac tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: 3ce09007-d5b4-4565-96db-00ec7c98fb75] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:47.849287 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fc328751-a0bb-4ccb-864b-1ffbfcf9bc68 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1510 microversion: 2.1 time: 0.205091 Sep 10 11:52:47.849891 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1578/3079] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:47 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1510 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:47.865668 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ec37550-fbdf-45d0-94b5-8739748377ac tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:47.866234 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ec37550-fbdf-45d0-94b5-8739748377ac tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:47.867793 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ec37550-fbdf-45d0-94b5-8739748377ac tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:47.869137 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ec37550-fbdf-45d0-94b5-8739748377ac tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:47.869947 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ec37550-fbdf-45d0-94b5-8739748377ac tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:47.870554 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ec37550-fbdf-45d0-94b5-8739748377ac tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:47.894559 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:52:47.961867 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5ec37550-fbdf-45d0-94b5-8739748377ac tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be647276cc456e83dacd25b98e37f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20756c1a77fb44f684973f382b802825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:47.970146 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5ec37550-fbdf-45d0-94b5-8739748377ac tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/3ce09007-d5b4-4565-96db-00ec7c98fb75" status: 200 len: 1300 microversion: 2.1 time: 0.136083 Sep 10 11:52:47.970721 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1502/3080] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:47 2022] GET /compute/v2.1/servers/3ce09007-d5b4-4565-96db-00ec7c98fb75 => generated 1300 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:52:48.017691 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8e21c2a0-acff-497d-86b0-8705d8037f42 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:48.018309 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8e21c2a0-acff-497d-86b0-8705d8037f42 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:48.027267 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e21c2a0-acff-497d-86b0-8705d8037f42 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:48.027784 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e21c2a0-acff-497d-86b0-8705d8037f42 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:48.028203 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e21c2a0-acff-497d-86b0-8705d8037f42 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:48.028912 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e21c2a0-acff-497d-86b0-8705d8037f42 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:48.029560 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e21c2a0-acff-497d-86b0-8705d8037f42 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:48.029987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e21c2a0-acff-497d-86b0-8705d8037f42 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:48.124515 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d6cb47fe-dbe6-42c0-952b-0ea6775aafb1 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:48.125532 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d6cb47fe-dbe6-42c0-952b-0ea6775aafb1 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: c56e3146-bad1-4abf-853a-2d01226d85b4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:48.141646 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d6cb47fe-dbe6-42c0-952b-0ea6775aafb1 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:48.142378 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d6cb47fe-dbe6-42c0-952b-0ea6775aafb1 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:48.143024 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d6cb47fe-dbe6-42c0-952b-0ea6775aafb1 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:48.144007 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d6cb47fe-dbe6-42c0-952b-0ea6775aafb1 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:48.144886 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d6cb47fe-dbe6-42c0-952b-0ea6775aafb1 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:48.145619 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d6cb47fe-dbe6-42c0-952b-0ea6775aafb1 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:48.741646 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8e21c2a0-acff-497d-86b0-8705d8037f42 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:48.750798 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8e21c2a0-acff-497d-86b0-8705d8037f42 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1524 microversion: 2.1 time: 0.736973 Sep 10 11:52:48.751430 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1579/3081] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:48 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1524 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:48.761452 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c0bf05f8-4287-4ca4-8886-b4a5720c8553 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:48.762318 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c0bf05f8-4287-4ca4-8886-b4a5720c8553 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:48.773813 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c0bf05f8-4287-4ca4-8886-b4a5720c8553 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:48.774415 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c0bf05f8-4287-4ca4-8886-b4a5720c8553 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:48.774935 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c0bf05f8-4287-4ca4-8886-b4a5720c8553 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:48.775955 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c0bf05f8-4287-4ca4-8886-b4a5720c8553 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:48.776529 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c0bf05f8-4287-4ca4-8886-b4a5720c8553 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:48.777051 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c0bf05f8-4287-4ca4-8886-b4a5720c8553 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:48.793207 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d6cb47fe-dbe6-42c0-952b-0ea6775aafb1 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:48.806712 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d6cb47fe-dbe6-42c0-952b-0ea6775aafb1 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/c56e3146-bad1-4abf-853a-2d01226d85b4" status: 200 len: 1307 microversion: 2.1 time: 0.687734 Sep 10 11:52:48.807620 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1503/3082] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:48 2022] GET /compute/v2.1/servers/c56e3146-bad1-4abf-853a-2d01226d85b4 => generated 1307 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:48.821854 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bf357b71-4db8-4e6d-94d0-36024fec1729 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:48.822513 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bf357b71-4db8-4e6d-94d0-36024fec1729 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 0954dadf-c6a9-4b78-b38d-2febfb54736a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:48.829474 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bf357b71-4db8-4e6d-94d0-36024fec1729 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:48.830052 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bf357b71-4db8-4e6d-94d0-36024fec1729 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:48.830507 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bf357b71-4db8-4e6d-94d0-36024fec1729 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:48.831256 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bf357b71-4db8-4e6d-94d0-36024fec1729 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:48.831725 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bf357b71-4db8-4e6d-94d0-36024fec1729 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:48.832166 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bf357b71-4db8-4e6d-94d0-36024fec1729 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:48.864846 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c0bf05f8-4287-4ca4-8886-b4a5720c8553 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:48.877414 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c0bf05f8-4287-4ca4-8886-b4a5720c8553 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:48.878912 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c0bf05f8-4287-4ca4-8886-b4a5720c8553 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:48.884350 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c0bf05f8-4287-4ca4-8886-b4a5720c8553 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1544 microversion: 2.91 time: 0.131732 Sep 10 11:52:48.884948 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1580/3083] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:48 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1544 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:48.889736 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0111dce2-8c73-4037-b8b4-a8c3a2c9c465 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:48.890938 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0111dce2-8c73-4037-b8b4-a8c3a2c9c465 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:48.899112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0111dce2-8c73-4037-b8b4-a8c3a2c9c465 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:48.899639 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0111dce2-8c73-4037-b8b4-a8c3a2c9c465 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:48.900079 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0111dce2-8c73-4037-b8b4-a8c3a2c9c465 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:48.900783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0111dce2-8c73-4037-b8b4-a8c3a2c9c465 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:48.901242 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0111dce2-8c73-4037-b8b4-a8c3a2c9c465 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:48.901670 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0111dce2-8c73-4037-b8b4-a8c3a2c9c465 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:49.128099 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bf357b71-4db8-4e6d-94d0-36024fec1729 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:49.138884 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bf357b71-4db8-4e6d-94d0-36024fec1729 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a" status: 200 len: 1320 microversion: 2.1 time: 0.321753 Sep 10 11:52:49.151747 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1504/3084] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:48 2022] GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a => generated 1320 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:49.151747 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-85f4614f-d332-4b0c-bc31-8723d13980bf tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:49.151747 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-85f4614f-d332-4b0c-bc31-8723d13980bf tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: 3ce09007-d5b4-4565-96db-00ec7c98fb75] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:49.156931 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85f4614f-d332-4b0c-bc31-8723d13980bf tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:49.157590 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85f4614f-d332-4b0c-bc31-8723d13980bf tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:49.158046 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85f4614f-d332-4b0c-bc31-8723d13980bf tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:49.158795 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85f4614f-d332-4b0c-bc31-8723d13980bf tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:49.159305 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85f4614f-d332-4b0c-bc31-8723d13980bf tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:49.159774 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85f4614f-d332-4b0c-bc31-8723d13980bf tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:49.175498 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0111dce2-8c73-4037-b8b4-a8c3a2c9c465 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:49.186291 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0111dce2-8c73-4037-b8b4-a8c3a2c9c465 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1510 microversion: 2.1 time: 0.299789 Sep 10 11:52:49.187600 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1581/3085] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:48 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1510 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:49.193106 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-9ead8883-6031-42c1-80c0-7177c9f87672 req-61b3de26-6ffa-400a-9a71-66493964a5fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c56e3146-bad1-4abf-853a-2d01226d85b4", "tag": "0c512e55-530c-4d6d-9d65-364f8052e833"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:52:49.205185 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-9ead8883-6031-42c1-80c0-7177c9f87672 req-61b3de26-6ffa-400a-9a71-66493964a5fe service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:49.206139 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-9ead8883-6031-42c1-80c0-7177c9f87672 req-61b3de26-6ffa-400a-9a71-66493964a5fe service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:49.206767 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-9ead8883-6031-42c1-80c0-7177c9f87672 req-61b3de26-6ffa-400a-9a71-66493964a5fe service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:49.220684 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-9ead8883-6031-42c1-80c0-7177c9f87672 req-61b3de26-6ffa-400a-9a71-66493964a5fe service nova] Creating event network-changed:0c512e55-530c-4d6d-9d65-364f8052e833 for instance c56e3146-bad1-4abf-853a-2d01226d85b4 on n-h2-856895-1 Sep 10 11:52:49.226978 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-9ead8883-6031-42c1-80c0-7177c9f87672 req-61b3de26-6ffa-400a-9a71-66493964a5fe service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036954 Sep 10 11:52:49.226978 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1582/3086] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:52:49.248721 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-85f4614f-d332-4b0c-bc31-8723d13980bf tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be647276cc456e83dacd25b98e37f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20756c1a77fb44f684973f382b802825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:49.258415 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-85f4614f-d332-4b0c-bc31-8723d13980bf tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/3ce09007-d5b4-4565-96db-00ec7c98fb75" status: 200 len: 1306 microversion: 2.1 time: 0.117728 Sep 10 11:52:49.260238 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1505/3087] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:49 2022] GET /compute/v2.1/servers/3ce09007-d5b4-4565-96db-00ec7c98fb75 => generated 1306 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:49.776214 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-eb5a3a58-6ce5-4562-81b6-4078243731b6 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:49.777548 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-eb5a3a58-6ce5-4562-81b6-4078243731b6 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:49.784033 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb5a3a58-6ce5-4562-81b6-4078243731b6 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:49.784520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb5a3a58-6ce5-4562-81b6-4078243731b6 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:49.784952 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb5a3a58-6ce5-4562-81b6-4078243731b6 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:49.785646 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb5a3a58-6ce5-4562-81b6-4078243731b6 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:49.786262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb5a3a58-6ce5-4562-81b6-4078243731b6 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:49.786843 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb5a3a58-6ce5-4562-81b6-4078243731b6 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:49.830550 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-65d5f0a9-17ec-43a5-8170-68ee95a581b0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:49.831236 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-65d5f0a9-17ec-43a5-8170-68ee95a581b0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: c56e3146-bad1-4abf-853a-2d01226d85b4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:49.838689 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65d5f0a9-17ec-43a5-8170-68ee95a581b0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:49.839205 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65d5f0a9-17ec-43a5-8170-68ee95a581b0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:49.839652 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65d5f0a9-17ec-43a5-8170-68ee95a581b0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:49.840362 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65d5f0a9-17ec-43a5-8170-68ee95a581b0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:49.841008 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65d5f0a9-17ec-43a5-8170-68ee95a581b0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:49.841495 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65d5f0a9-17ec-43a5-8170-68ee95a581b0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:49.987365 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-eb5a3a58-6ce5-4562-81b6-4078243731b6 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:49.995058 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-eb5a3a58-6ce5-4562-81b6-4078243731b6 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1509 microversion: 2.1 time: 0.223788 Sep 10 11:52:49.995672 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1583/3088] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:49 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1509 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:50.000736 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3e71efd7-df74-4875-8682-6e32b9b27cc4 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:50.001535 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3e71efd7-df74-4875-8682-6e32b9b27cc4 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:50.007376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e71efd7-df74-4875-8682-6e32b9b27cc4 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:50.007861 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e71efd7-df74-4875-8682-6e32b9b27cc4 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:50.008296 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e71efd7-df74-4875-8682-6e32b9b27cc4 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:50.008982 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e71efd7-df74-4875-8682-6e32b9b27cc4 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:50.009432 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e71efd7-df74-4875-8682-6e32b9b27cc4 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:50.009853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e71efd7-df74-4875-8682-6e32b9b27cc4 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:50.010745 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-65d5f0a9-17ec-43a5-8170-68ee95a581b0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:50.019666 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-65d5f0a9-17ec-43a5-8170-68ee95a581b0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/c56e3146-bad1-4abf-853a-2d01226d85b4" status: 200 len: 1307 microversion: 2.1 time: 0.193636 Sep 10 11:52:50.020263 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1506/3089] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:49 2022] GET /compute/v2.1/servers/c56e3146-bad1-4abf-853a-2d01226d85b4 => generated 1307 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:52:50.027343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a8faeda7-eb63-4e97-a3b9-ed0868c29f37 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:50.027343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a8faeda7-eb63-4e97-a3b9-ed0868c29f37 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:50.032283 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8faeda7-eb63-4e97-a3b9-ed0868c29f37 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:50.033118 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8faeda7-eb63-4e97-a3b9-ed0868c29f37 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:50.033906 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8faeda7-eb63-4e97-a3b9-ed0868c29f37 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:50.035186 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8faeda7-eb63-4e97-a3b9-ed0868c29f37 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:50.035838 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8faeda7-eb63-4e97-a3b9-ed0868c29f37 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:50.036279 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8faeda7-eb63-4e97-a3b9-ed0868c29f37 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:50.078748 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3e71efd7-df74-4875-8682-6e32b9b27cc4 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:50.087425 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3e71efd7-df74-4875-8682-6e32b9b27cc4 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:50.088896 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3e71efd7-df74-4875-8682-6e32b9b27cc4 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:50.094608 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3e71efd7-df74-4875-8682-6e32b9b27cc4 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1544 microversion: 2.91 time: 0.097625 Sep 10 11:52:50.095242 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1584/3090] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:49 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1544 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:50.164572 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4e2b189b-8b38-4f9f-8d5c-0d391b5db51f tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:50.165505 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4e2b189b-8b38-4f9f-8d5c-0d391b5db51f tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 0954dadf-c6a9-4b78-b38d-2febfb54736a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:50.172907 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e2b189b-8b38-4f9f-8d5c-0d391b5db51f tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:50.173441 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e2b189b-8b38-4f9f-8d5c-0d391b5db51f tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:50.173905 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e2b189b-8b38-4f9f-8d5c-0d391b5db51f tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:50.174620 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e2b189b-8b38-4f9f-8d5c-0d391b5db51f tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:50.175080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e2b189b-8b38-4f9f-8d5c-0d391b5db51f tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:50.175540 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e2b189b-8b38-4f9f-8d5c-0d391b5db51f tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:50.182126 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a8faeda7-eb63-4e97-a3b9-ed0868c29f37 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:50.190872 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a8faeda7-eb63-4e97-a3b9-ed0868c29f37 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 200 len: 1509 microversion: 2.1 time: 0.169592 Sep 10 11:52:50.191713 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1507/3091] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:50 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 1509 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:50.211544 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1a2a43b3-b638-48a0-94f0-47646934311b tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:50.212251 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1a2a43b3-b638-48a0-94f0-47646934311b tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:50.218372 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a2a43b3-b638-48a0-94f0-47646934311b tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:50.218965 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a2a43b3-b638-48a0-94f0-47646934311b tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:50.219434 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a2a43b3-b638-48a0-94f0-47646934311b tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:50.220149 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a2a43b3-b638-48a0-94f0-47646934311b tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:50.220609 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a2a43b3-b638-48a0-94f0-47646934311b tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:50.221040 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a2a43b3-b638-48a0-94f0-47646934311b tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:50.365144 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4e2b189b-8b38-4f9f-8d5c-0d391b5db51f tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:50.374341 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4e2b189b-8b38-4f9f-8d5c-0d391b5db51f tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a" status: 200 len: 1320 microversion: 2.1 time: 0.214593 Sep 10 11:52:50.375104 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1585/3092] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:50 2022] GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a => generated 1320 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:52:50.380031 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ede0e505-eb2e-473d-87d1-40e96d48074e tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:50.380719 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ede0e505-eb2e-473d-87d1-40e96d48074e tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:50.388600 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ede0e505-eb2e-473d-87d1-40e96d48074e tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:50.389234 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ede0e505-eb2e-473d-87d1-40e96d48074e tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:50.390591 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ede0e505-eb2e-473d-87d1-40e96d48074e tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:50.391419 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ede0e505-eb2e-473d-87d1-40e96d48074e tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:50.391882 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ede0e505-eb2e-473d-87d1-40e96d48074e tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:50.392312 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ede0e505-eb2e-473d-87d1-40e96d48074e tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:50.398429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1a2a43b3-b638-48a0-94f0-47646934311b tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:50.407372 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1a2a43b3-b638-48a0-94f0-47646934311b tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1510 microversion: 2.1 time: 0.199436 Sep 10 11:52:50.408437 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1508/3093] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:50 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1510 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:52:50.413032 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-48afd592-2e19-4006-8848-6829901cfe75 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:50.413668 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-48afd592-2e19-4006-8848-6829901cfe75 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: 3ce09007-d5b4-4565-96db-00ec7c98fb75] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:50.421450 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ede0e505-eb2e-473d-87d1-40e96d48074e tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:52:50.423066 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-48afd592-2e19-4006-8848-6829901cfe75 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:50.423600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-48afd592-2e19-4006-8848-6829901cfe75 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:50.424043 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-48afd592-2e19-4006-8848-6829901cfe75 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:50.424764 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-48afd592-2e19-4006-8848-6829901cfe75 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:50.425218 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-48afd592-2e19-4006-8848-6829901cfe75 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:50.425645 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-48afd592-2e19-4006-8848-6829901cfe75 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:50.523399 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ede0e505-eb2e-473d-87d1-40e96d48074e tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 204 len: 0 microversion: 2.1 time: 0.146595 Sep 10 11:52:50.524307 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1586/3094] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:52:50 2022] DELETE /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:52:50.659246 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4a7bc95d-c724-4df2-a3ee-ff97e294ef11 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-331049029", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "cfeac9bd-52fd-4612-85bf-8e6a7cf5b8db"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:52:50.724287 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-4a7bc95d-c724-4df2-a3ee-ff97e294ef11 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] validate_networks() for [('cfeac9bd-52fd-4612-85bf-8e6a7cf5b8db', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:52:50.905221 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-48afd592-2e19-4006-8848-6829901cfe75 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be647276cc456e83dacd25b98e37f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20756c1a77fb44f684973f382b802825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:50.914416 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-48afd592-2e19-4006-8848-6829901cfe75 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/3ce09007-d5b4-4565-96db-00ec7c98fb75" status: 200 len: 1374 microversion: 2.1 time: 0.504973 Sep 10 11:52:50.915362 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1509/3095] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:50 2022] GET /compute/v2.1/servers/3ce09007-d5b4-4565-96db-00ec7c98fb75 => generated 1374 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:51.043340 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-17e9f144-b57b-4d0b-b4a4-1921aba1498e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:51.043970 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-17e9f144-b57b-4d0b-b4a4-1921aba1498e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: c56e3146-bad1-4abf-853a-2d01226d85b4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:51.051434 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17e9f144-b57b-4d0b-b4a4-1921aba1498e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:51.052131 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17e9f144-b57b-4d0b-b4a4-1921aba1498e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:51.052788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17e9f144-b57b-4d0b-b4a4-1921aba1498e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:51.053727 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17e9f144-b57b-4d0b-b4a4-1921aba1498e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:51.054376 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17e9f144-b57b-4d0b-b4a4-1921aba1498e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:51.054979 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17e9f144-b57b-4d0b-b4a4-1921aba1498e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:51.403347 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-17e9f144-b57b-4d0b-b4a4-1921aba1498e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:51.413716 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-17e9f144-b57b-4d0b-b4a4-1921aba1498e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/c56e3146-bad1-4abf-853a-2d01226d85b4" status: 200 len: 1307 microversion: 2.1 time: 0.374978 Sep 10 11:52:51.414383 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1510/3096] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:51 2022] GET /compute/v2.1/servers/c56e3146-bad1-4abf-853a-2d01226d85b4 => generated 1307 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:52:51.419313 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f118230d-8c84-4535-b69a-dcc23daa947b tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:51.419935 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f118230d-8c84-4535-b69a-dcc23daa947b tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:51.426875 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f118230d-8c84-4535-b69a-dcc23daa947b tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:51.427588 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f118230d-8c84-4535-b69a-dcc23daa947b tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:51.428040 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f118230d-8c84-4535-b69a-dcc23daa947b tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:51.428737 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f118230d-8c84-4535-b69a-dcc23daa947b tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:51.429282 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f118230d-8c84-4535-b69a-dcc23daa947b tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:51.429714 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f118230d-8c84-4535-b69a-dcc23daa947b tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:51.524150 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f118230d-8c84-4535-b69a-dcc23daa947b tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:51.532687 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f118230d-8c84-4535-b69a-dcc23daa947b tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:51.534154 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f118230d-8c84-4535-b69a-dcc23daa947b tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:51.539254 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f118230d-8c84-4535-b69a-dcc23daa947b tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1544 microversion: 2.91 time: 0.123793 Sep 10 11:52:51.539832 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1511/3097] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:51 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1544 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:51.544331 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6bed26a7-4974-4faf-b22e-38fe60974145 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:51.545107 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6bed26a7-4974-4faf-b22e-38fe60974145 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 0954dadf-c6a9-4b78-b38d-2febfb54736a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:51.551488 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6bed26a7-4974-4faf-b22e-38fe60974145 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:51.551993 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6bed26a7-4974-4faf-b22e-38fe60974145 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:51.552438 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6bed26a7-4974-4faf-b22e-38fe60974145 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:51.553139 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6bed26a7-4974-4faf-b22e-38fe60974145 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:51.553597 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6bed26a7-4974-4faf-b22e-38fe60974145 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:51.554027 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6bed26a7-4974-4faf-b22e-38fe60974145 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:51.587359 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-4a7bc95d-c724-4df2-a3ee-ff97e294ef11 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:52:51.588392 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-4a7bc95d-c724-4df2-a3ee-ff97e294ef11 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:52:51.588991 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-4a7bc95d-c724-4df2-a3ee-ff97e294ef11 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:52:51.589509 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-4a7bc95d-c724-4df2-a3ee-ff97e294ef11 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:52:51.590031 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-4a7bc95d-c724-4df2-a3ee-ff97e294ef11 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:52:51.599953 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a7bc95d-c724-4df2-a3ee-ff97e294ef11 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:51.600441 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a7bc95d-c724-4df2-a3ee-ff97e294ef11 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:51.600896 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a7bc95d-c724-4df2-a3ee-ff97e294ef11 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:51.601603 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a7bc95d-c724-4df2-a3ee-ff97e294ef11 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:51.602080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a7bc95d-c724-4df2-a3ee-ff97e294ef11 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:51.605085 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a7bc95d-c724-4df2-a3ee-ff97e294ef11 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:51.615297 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:52:51.622589 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-4a7bc95d-c724-4df2-a3ee-ff97e294ef11 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Getting quotas for project 689e03cda40d4be5ab9fe3fe20ca8d97. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:52:51.630421 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-4a7bc95d-c724-4df2-a3ee-ff97e294ef11 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Getting quotas for user 1673c19f6ab545a18897858acf56f762 and project 689e03cda40d4be5ab9fe3fe20ca8d97. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:52:51.643600 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4a7bc95d-c724-4df2-a3ee-ff97e294ef11 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:52:51.646077 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4a7bc95d-c724-4df2-a3ee-ff97e294ef11 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: f2657379-0c39-4338-9d80-51ab6f0e2a64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:52:51.693588 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4a7bc95d-c724-4df2-a3ee-ff97e294ef11 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.039304 Sep 10 11:52:51.694476 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1587/3098] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:52:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1041 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:52:51.698917 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-dc72891a-c7f5-4f2c-b383-2e6e4b89554e tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:51.699738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-dc72891a-c7f5-4f2c-b383-2e6e4b89554e tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:51.707402 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dc72891a-c7f5-4f2c-b383-2e6e4b89554e tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:51.707926 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dc72891a-c7f5-4f2c-b383-2e6e4b89554e tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:51.708487 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dc72891a-c7f5-4f2c-b383-2e6e4b89554e tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:51.709067 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dc72891a-c7f5-4f2c-b383-2e6e4b89554e tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:51.709530 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dc72891a-c7f5-4f2c-b383-2e6e4b89554e tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:51.709967 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dc72891a-c7f5-4f2c-b383-2e6e4b89554e tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:51.734261 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:52:51.878560 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6bed26a7-4974-4faf-b22e-38fe60974145 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:51.889341 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6bed26a7-4974-4faf-b22e-38fe60974145 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a" status: 200 len: 1320 microversion: 2.1 time: 0.348379 Sep 10 11:52:51.891017 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1512/3099] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:51 2022] GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a => generated 1320 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:51.911261 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3914802b-33d0-429f-b369-3fd5cd7dc6f5 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:51.911887 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3914802b-33d0-429f-b369-3fd5cd7dc6f5 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: f2657379-0c39-4338-9d80-51ab6f0e2a64] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:52.326820 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3914802b-33d0-429f-b369-3fd5cd7dc6f5 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:52.334445 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3914802b-33d0-429f-b369-3fd5cd7dc6f5 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64" status: 200 len: 1217 microversion: 2.1 time: 0.442142 Sep 10 11:52:52.335596 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1513/3100] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:51 2022] GET /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64 => generated 1217 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:52.341308 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-deabe10b-41db-454a-9ebe-c396323c10a6 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:52.342162 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-deabe10b-41db-454a-9ebe-c396323c10a6 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: 3ce09007-d5b4-4565-96db-00ec7c98fb75] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:52.354974 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-deabe10b-41db-454a-9ebe-c396323c10a6 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:52.356170 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-deabe10b-41db-454a-9ebe-c396323c10a6 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:52.356738 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-deabe10b-41db-454a-9ebe-c396323c10a6 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:52.357319 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-deabe10b-41db-454a-9ebe-c396323c10a6 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:52.357807 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-deabe10b-41db-454a-9ebe-c396323c10a6 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:52.358243 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-deabe10b-41db-454a-9ebe-c396323c10a6 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:52.535026 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-dc72891a-c7f5-4f2c-b383-2e6e4b89554e tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:52.542885 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-dc72891a-c7f5-4f2c-b383-2e6e4b89554e tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1510 microversion: 2.1 time: 0.847619 Sep 10 11:52:52.543822 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1588/3101] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:51 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1510 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:52.549871 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-979670fb-6f94-41ed-b78a-016561f9215b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:52.550478 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-979670fb-6f94-41ed-b78a-016561f9215b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: c56e3146-bad1-4abf-853a-2d01226d85b4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:52.557017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-979670fb-6f94-41ed-b78a-016561f9215b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:52.557508 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-979670fb-6f94-41ed-b78a-016561f9215b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:52.558130 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-979670fb-6f94-41ed-b78a-016561f9215b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:52.559295 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-979670fb-6f94-41ed-b78a-016561f9215b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:52.559854 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-979670fb-6f94-41ed-b78a-016561f9215b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:52.560272 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-979670fb-6f94-41ed-b78a-016561f9215b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:52.685790 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-deabe10b-41db-454a-9ebe-c396323c10a6 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be647276cc456e83dacd25b98e37f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20756c1a77fb44f684973f382b802825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:52.695113 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-deabe10b-41db-454a-9ebe-c396323c10a6 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/3ce09007-d5b4-4565-96db-00ec7c98fb75" status: 200 len: 1374 microversion: 2.1 time: 0.358281 Sep 10 11:52:52.695717 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1514/3102] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:52 2022] GET /compute/v2.1/servers/3ce09007-d5b4-4565-96db-00ec7c98fb75 => generated 1374 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:52.700275 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-41578d96-4e4e-4606-8162-f1edc6ff479e req-3bcc9767-54d2-4c41-b10d-4d834f1575b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ce09007-d5b4-4565-96db-00ec7c98fb75", "tag": "bbf418c3-dbbf-4738-a16c-ef5fd6cb4d15"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:52:52.711188 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-41578d96-4e4e-4606-8162-f1edc6ff479e req-3bcc9767-54d2-4c41-b10d-4d834f1575b5 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:52.711681 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-41578d96-4e4e-4606-8162-f1edc6ff479e req-3bcc9767-54d2-4c41-b10d-4d834f1575b5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:52.712121 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-41578d96-4e4e-4606-8162-f1edc6ff479e req-3bcc9767-54d2-4c41-b10d-4d834f1575b5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:52.724267 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-41578d96-4e4e-4606-8162-f1edc6ff479e req-3bcc9767-54d2-4c41-b10d-4d834f1575b5 service nova] Creating event network-changed:bbf418c3-dbbf-4738-a16c-ef5fd6cb4d15 for instance 3ce09007-d5b4-4565-96db-00ec7c98fb75 on n-h2-856895-1 Sep 10 11:52:52.734426 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-41578d96-4e4e-4606-8162-f1edc6ff479e req-3bcc9767-54d2-4c41-b10d-4d834f1575b5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037128 Sep 10 11:52:52.736138 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1515/3103] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:52:52.741898 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-977f0ddb-917c-421c-954d-68a8e65aa9dd tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:52.742459 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-977f0ddb-917c-421c-954d-68a8e65aa9dd tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:52.748727 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-977f0ddb-917c-421c-954d-68a8e65aa9dd tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:52.749199 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-977f0ddb-917c-421c-954d-68a8e65aa9dd tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:52.750362 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-977f0ddb-917c-421c-954d-68a8e65aa9dd tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:52.750750 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-979670fb-6f94-41ed-b78a-016561f9215b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:52.751348 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-977f0ddb-917c-421c-954d-68a8e65aa9dd tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:52.751713 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-977f0ddb-917c-421c-954d-68a8e65aa9dd tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:52.752147 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-977f0ddb-917c-421c-954d-68a8e65aa9dd tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:52.758799 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-979670fb-6f94-41ed-b78a-016561f9215b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/c56e3146-bad1-4abf-853a-2d01226d85b4" status: 200 len: 1307 microversion: 2.1 time: 0.213999 Sep 10 11:52:52.759412 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1589/3104] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:52 2022] GET /compute/v2.1/servers/c56e3146-bad1-4abf-853a-2d01226d85b4 => generated 1307 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:52.831120 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-977f0ddb-917c-421c-954d-68a8e65aa9dd tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:52.839730 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-977f0ddb-917c-421c-954d-68a8e65aa9dd tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:52.841509 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-977f0ddb-917c-421c-954d-68a8e65aa9dd tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:52.848280 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-977f0ddb-917c-421c-954d-68a8e65aa9dd tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1544 microversion: 2.91 time: 0.110934 Sep 10 11:52:52.848906 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1516/3105] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:52 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1544 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:52.915686 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-551b26d6-11c6-4af4-8ad6-0568f6dbddd7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:52.916307 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-551b26d6-11c6-4af4-8ad6-0568f6dbddd7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 0954dadf-c6a9-4b78-b38d-2febfb54736a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:52.924876 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-551b26d6-11c6-4af4-8ad6-0568f6dbddd7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:52.925776 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-551b26d6-11c6-4af4-8ad6-0568f6dbddd7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:52.926383 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-551b26d6-11c6-4af4-8ad6-0568f6dbddd7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:52.927294 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-551b26d6-11c6-4af4-8ad6-0568f6dbddd7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:52.927928 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-551b26d6-11c6-4af4-8ad6-0568f6dbddd7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:52.928510 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-551b26d6-11c6-4af4-8ad6-0568f6dbddd7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:53.162493 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-551b26d6-11c6-4af4-8ad6-0568f6dbddd7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:53.171231 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-551b26d6-11c6-4af4-8ad6-0568f6dbddd7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a" status: 200 len: 1320 microversion: 2.1 time: 0.261533 Sep 10 11:52:53.171747 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1590/3106] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:52 2022] GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a => generated 1320 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:53.358116 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-77d3f716-6e2b-499a-b571-bf5c5cbe83ca tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:53.358754 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-77d3f716-6e2b-499a-b571-bf5c5cbe83ca tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: f2657379-0c39-4338-9d80-51ab6f0e2a64] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:53.365630 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-77d3f716-6e2b-499a-b571-bf5c5cbe83ca tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:53.366198 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-77d3f716-6e2b-499a-b571-bf5c5cbe83ca tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:53.366634 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-77d3f716-6e2b-499a-b571-bf5c5cbe83ca tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:53.367357 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-77d3f716-6e2b-499a-b571-bf5c5cbe83ca tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:53.367813 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-77d3f716-6e2b-499a-b571-bf5c5cbe83ca tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:53.368237 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-77d3f716-6e2b-499a-b571-bf5c5cbe83ca tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:53.432880 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-77d3f716-6e2b-499a-b571-bf5c5cbe83ca tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:53.442742 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-77d3f716-6e2b-499a-b571-bf5c5cbe83ca tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64" status: 200 len: 1275 microversion: 2.1 time: 0.088634 Sep 10 11:52:53.444003 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1517/3107] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:53 2022] GET /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64 => generated 1275 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:53.570194 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-05845eac-42e6-404b-b514-8248c691e057 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:53.573804 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-05845eac-42e6-404b-b514-8248c691e057 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:53.585960 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-05845eac-42e6-404b-b514-8248c691e057 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:53.589124 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-05845eac-42e6-404b-b514-8248c691e057 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:53.589825 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-05845eac-42e6-404b-b514-8248c691e057 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:53.590809 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-05845eac-42e6-404b-b514-8248c691e057 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:53.592005 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-05845eac-42e6-404b-b514-8248c691e057 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:53.592687 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-05845eac-42e6-404b-b514-8248c691e057 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:53.721892 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8811394b-550a-4d20-80e1-7ed30c4cbf55 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:53.722917 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8811394b-550a-4d20-80e1-7ed30c4cbf55 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: 3ce09007-d5b4-4565-96db-00ec7c98fb75] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:53.729238 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8811394b-550a-4d20-80e1-7ed30c4cbf55 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:53.729760 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8811394b-550a-4d20-80e1-7ed30c4cbf55 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:53.731348 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8811394b-550a-4d20-80e1-7ed30c4cbf55 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:53.732423 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8811394b-550a-4d20-80e1-7ed30c4cbf55 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:53.732866 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8811394b-550a-4d20-80e1-7ed30c4cbf55 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:53.733378 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8811394b-550a-4d20-80e1-7ed30c4cbf55 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:53.757207 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-05845eac-42e6-404b-b514-8248c691e057 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:53.767906 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-05845eac-42e6-404b-b514-8248c691e057 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1510 microversion: 2.1 time: 0.201829 Sep 10 11:52:53.769700 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1591/3108] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:53 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1510 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:53.784931 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6fe6a4c1-a4ae-48fe-8455-d340ff9cf4f1 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:53.785732 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6fe6a4c1-a4ae-48fe-8455-d340ff9cf4f1 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: c56e3146-bad1-4abf-853a-2d01226d85b4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:53.794303 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6fe6a4c1-a4ae-48fe-8455-d340ff9cf4f1 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:53.795075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6fe6a4c1-a4ae-48fe-8455-d340ff9cf4f1 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:53.795722 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6fe6a4c1-a4ae-48fe-8455-d340ff9cf4f1 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:53.796639 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6fe6a4c1-a4ae-48fe-8455-d340ff9cf4f1 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:53.797707 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6fe6a4c1-a4ae-48fe-8455-d340ff9cf4f1 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:53.798310 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6fe6a4c1-a4ae-48fe-8455-d340ff9cf4f1 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:53.916270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8811394b-550a-4d20-80e1-7ed30c4cbf55 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be647276cc456e83dacd25b98e37f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20756c1a77fb44f684973f382b802825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:53.926739 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8811394b-550a-4d20-80e1-7ed30c4cbf55 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/3ce09007-d5b4-4565-96db-00ec7c98fb75" status: 200 len: 1374 microversion: 2.1 time: 0.210184 Sep 10 11:52:53.927376 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1518/3109] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:53 2022] GET /compute/v2.1/servers/3ce09007-d5b4-4565-96db-00ec7c98fb75 => generated 1374 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:52:53.933031 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e6367304-01ee-42b1-a5a6-cad2084add50 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:53.933855 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e6367304-01ee-42b1-a5a6-cad2084add50 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:53.939975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6367304-01ee-42b1-a5a6-cad2084add50 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:53.940538 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6367304-01ee-42b1-a5a6-cad2084add50 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:53.941187 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6367304-01ee-42b1-a5a6-cad2084add50 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:53.942109 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6367304-01ee-42b1-a5a6-cad2084add50 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:53.942766 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6367304-01ee-42b1-a5a6-cad2084add50 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:53.943212 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6367304-01ee-42b1-a5a6-cad2084add50 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:53.978521 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6fe6a4c1-a4ae-48fe-8455-d340ff9cf4f1 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:53.987147 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6fe6a4c1-a4ae-48fe-8455-d340ff9cf4f1 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/c56e3146-bad1-4abf-853a-2d01226d85b4" status: 200 len: 1307 microversion: 2.1 time: 0.208448 Sep 10 11:52:53.988067 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1592/3110] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:53 2022] GET /compute/v2.1/servers/c56e3146-bad1-4abf-853a-2d01226d85b4 => generated 1307 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:54.010680 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e6367304-01ee-42b1-a5a6-cad2084add50 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:54.020337 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e6367304-01ee-42b1-a5a6-cad2084add50 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:54.021805 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e6367304-01ee-42b1-a5a6-cad2084add50 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:54.026837 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e6367304-01ee-42b1-a5a6-cad2084add50 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1544 microversion: 2.91 time: 0.098176 Sep 10 11:52:54.027459 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1519/3111] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:53 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1544 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:54.194457 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e81f0783-2124-4b09-9999-348204dddeb2 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:54.195079 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e81f0783-2124-4b09-9999-348204dddeb2 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 0954dadf-c6a9-4b78-b38d-2febfb54736a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:54.202076 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e81f0783-2124-4b09-9999-348204dddeb2 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:54.202567 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e81f0783-2124-4b09-9999-348204dddeb2 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:54.203611 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e81f0783-2124-4b09-9999-348204dddeb2 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:54.204477 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e81f0783-2124-4b09-9999-348204dddeb2 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:54.204941 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e81f0783-2124-4b09-9999-348204dddeb2 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:54.205400 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e81f0783-2124-4b09-9999-348204dddeb2 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:54.348014 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e81f0783-2124-4b09-9999-348204dddeb2 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:54.356416 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e81f0783-2124-4b09-9999-348204dddeb2 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a" status: 200 len: 1320 microversion: 2.1 time: 0.165765 Sep 10 11:52:54.370842 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1593/3112] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:54 2022] GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a => generated 1320 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:54.469007 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5add668b-9386-4057-8bbf-76c7a45b0626 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:54.471337 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5add668b-9386-4057-8bbf-76c7a45b0626 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: f2657379-0c39-4338-9d80-51ab6f0e2a64] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:54.479957 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:52:54.482068 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5add668b-9386-4057-8bbf-76c7a45b0626 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:54.483100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5add668b-9386-4057-8bbf-76c7a45b0626 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:54.483777 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5add668b-9386-4057-8bbf-76c7a45b0626 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:54.485291 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5add668b-9386-4057-8bbf-76c7a45b0626 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:54.486138 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5add668b-9386-4057-8bbf-76c7a45b0626 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:54.486840 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5add668b-9386-4057-8bbf-76c7a45b0626 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:54.761167 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5add668b-9386-4057-8bbf-76c7a45b0626 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:54.764654 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:52:54.770325 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5add668b-9386-4057-8bbf-76c7a45b0626 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64" status: 200 len: 1317 microversion: 2.1 time: 0.306447 Sep 10 11:52:54.770901 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1520/3113] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:54 2022] GET /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64 => generated 1317 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:54.797799 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fca96c9e-c799-4c0a-a651-577fd73138be tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:54.799050 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fca96c9e-c799-4c0a-a651-577fd73138be tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:54.805705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fca96c9e-c799-4c0a-a651-577fd73138be tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:54.806939 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fca96c9e-c799-4c0a-a651-577fd73138be tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:54.807432 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fca96c9e-c799-4c0a-a651-577fd73138be tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:54.808350 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fca96c9e-c799-4c0a-a651-577fd73138be tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:54.808807 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fca96c9e-c799-4c0a-a651-577fd73138be tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:54.809234 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fca96c9e-c799-4c0a-a651-577fd73138be tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:54.875489 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fca96c9e-c799-4c0a-a651-577fd73138be tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:54.883567 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fca96c9e-c799-4c0a-a651-577fd73138be tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1468 microversion: 2.1 time: 0.092301 Sep 10 11:52:54.884155 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1594/3114] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:54 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1468 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:54.950557 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e24ee796-f726-440a-9e38-7a64aebdf40b tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:54.951495 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e24ee796-f726-440a-9e38-7a64aebdf40b tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: 3ce09007-d5b4-4565-96db-00ec7c98fb75] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:54.958929 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e24ee796-f726-440a-9e38-7a64aebdf40b tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:54.959518 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e24ee796-f726-440a-9e38-7a64aebdf40b tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:54.960174 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e24ee796-f726-440a-9e38-7a64aebdf40b tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:54.961142 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e24ee796-f726-440a-9e38-7a64aebdf40b tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:54.961696 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e24ee796-f726-440a-9e38-7a64aebdf40b tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:54.963351 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e24ee796-f726-440a-9e38-7a64aebdf40b tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:54.997310 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-fc22e2dd-bff8-4135-a8d0-3d1832f7c4db req-fe952ce2-07af-4ea3-8b2d-4537610e0046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da5c3efa-07a9-4b8b-b258-482cecc2a0ea", "name": "network-vif-deleted", "tag": "985e81bb-aeae-46fb-bc6f-b3a5e1be77f6"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:52:55.008696 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-fc22e2dd-bff8-4135-a8d0-3d1832f7c4db req-fe952ce2-07af-4ea3-8b2d-4537610e0046 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:55.008960 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-fc22e2dd-bff8-4135-a8d0-3d1832f7c4db req-fe952ce2-07af-4ea3-8b2d-4537610e0046 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:55.009591 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-fc22e2dd-bff8-4135-a8d0-3d1832f7c4db req-fe952ce2-07af-4ea3-8b2d-4537610e0046 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:55.023982 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-fc22e2dd-bff8-4135-a8d0-3d1832f7c4db req-fe952ce2-07af-4ea3-8b2d-4537610e0046 service nova] Creating event network-vif-deleted:985e81bb-aeae-46fb-bc6f-b3a5e1be77f6 for instance da5c3efa-07a9-4b8b-b258-482cecc2a0ea on n-h1-856895-1 Sep 10 11:52:55.030607 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-fc22e2dd-bff8-4135-a8d0-3d1832f7c4db req-fe952ce2-07af-4ea3-8b2d-4537610e0046 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036891 Sep 10 11:52:55.031293 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1595/3115] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:52:55.038406 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c41cfa95-8707-4bcb-9362-14089633c504 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:55.039471 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c41cfa95-8707-4bcb-9362-14089633c504 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: c56e3146-bad1-4abf-853a-2d01226d85b4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:55.046571 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c41cfa95-8707-4bcb-9362-14089633c504 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:55.047058 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c41cfa95-8707-4bcb-9362-14089633c504 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:55.047614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c41cfa95-8707-4bcb-9362-14089633c504 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:55.048321 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c41cfa95-8707-4bcb-9362-14089633c504 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:55.048776 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c41cfa95-8707-4bcb-9362-14089633c504 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:55.049203 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c41cfa95-8707-4bcb-9362-14089633c504 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:55.289915 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e24ee796-f726-440a-9e38-7a64aebdf40b tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be647276cc456e83dacd25b98e37f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20756c1a77fb44f684973f382b802825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:55.298863 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e24ee796-f726-440a-9e38-7a64aebdf40b tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/3ce09007-d5b4-4565-96db-00ec7c98fb75" status: 200 len: 1374 microversion: 2.1 time: 0.352708 Sep 10 11:52:55.306737 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1521/3116] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:54 2022] GET /compute/v2.1/servers/3ce09007-d5b4-4565-96db-00ec7c98fb75 => generated 1374 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:55.306737 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f563709f-d70e-47ad-986e-36605390e341 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:55.306737 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f563709f-d70e-47ad-986e-36605390e341 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:55.312656 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f563709f-d70e-47ad-986e-36605390e341 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:55.312821 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f563709f-d70e-47ad-986e-36605390e341 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:55.313225 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f563709f-d70e-47ad-986e-36605390e341 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:55.313941 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f563709f-d70e-47ad-986e-36605390e341 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:55.314411 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f563709f-d70e-47ad-986e-36605390e341 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:55.314851 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f563709f-d70e-47ad-986e-36605390e341 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:55.357654 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c41cfa95-8707-4bcb-9362-14089633c504 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:55.366515 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c41cfa95-8707-4bcb-9362-14089633c504 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/c56e3146-bad1-4abf-853a-2d01226d85b4" status: 200 len: 1307 microversion: 2.1 time: 0.333496 Sep 10 11:52:55.367476 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1596/3117] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:55 2022] GET /compute/v2.1/servers/c56e3146-bad1-4abf-853a-2d01226d85b4 => generated 1307 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:55.387681 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bd5f0456-63b8-4e09-8181-d9c61f4e7e9f tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:55.389798 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bd5f0456-63b8-4e09-8181-d9c61f4e7e9f tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 0954dadf-c6a9-4b78-b38d-2febfb54736a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:55.396833 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd5f0456-63b8-4e09-8181-d9c61f4e7e9f tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:55.397416 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd5f0456-63b8-4e09-8181-d9c61f4e7e9f tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:55.397925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd5f0456-63b8-4e09-8181-d9c61f4e7e9f tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:55.402167 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd5f0456-63b8-4e09-8181-d9c61f4e7e9f tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:55.402167 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd5f0456-63b8-4e09-8181-d9c61f4e7e9f tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:55.402167 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd5f0456-63b8-4e09-8181-d9c61f4e7e9f tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:55.405156 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f563709f-d70e-47ad-986e-36605390e341 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:55.414729 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f563709f-d70e-47ad-986e-36605390e341 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:55.416225 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f563709f-d70e-47ad-986e-36605390e341 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:55.422026 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f563709f-d70e-47ad-986e-36605390e341 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1544 microversion: 2.91 time: 0.121280 Sep 10 11:52:55.422835 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1522/3118] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:55 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1544 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:55.549687 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bd5f0456-63b8-4e09-8181-d9c61f4e7e9f tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:55.557365 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bd5f0456-63b8-4e09-8181-d9c61f4e7e9f tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a" status: 200 len: 1320 microversion: 2.1 time: 0.173810 Sep 10 11:52:55.557940 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1597/3119] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:55 2022] GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a => generated 1320 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:52:55.795004 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9f31491d-c17b-442e-89cc-18fa87c9a21a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:55.796688 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9f31491d-c17b-442e-89cc-18fa87c9a21a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: f2657379-0c39-4338-9d80-51ab6f0e2a64] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:55.803549 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9f31491d-c17b-442e-89cc-18fa87c9a21a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:55.804045 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9f31491d-c17b-442e-89cc-18fa87c9a21a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:55.804491 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9f31491d-c17b-442e-89cc-18fa87c9a21a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:55.805211 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9f31491d-c17b-442e-89cc-18fa87c9a21a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:55.805676 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9f31491d-c17b-442e-89cc-18fa87c9a21a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:55.806108 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9f31491d-c17b-442e-89cc-18fa87c9a21a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:55.908829 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c3d834ee-57a5-4bd3-9cfc-76c6bfb9e355 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:55.909471 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c3d834ee-57a5-4bd3-9cfc-76c6bfb9e355 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:55.915844 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3d834ee-57a5-4bd3-9cfc-76c6bfb9e355 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:55.916553 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3d834ee-57a5-4bd3-9cfc-76c6bfb9e355 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:55.916999 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3d834ee-57a5-4bd3-9cfc-76c6bfb9e355 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:55.917878 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3d834ee-57a5-4bd3-9cfc-76c6bfb9e355 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:55.918333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3d834ee-57a5-4bd3-9cfc-76c6bfb9e355 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:55.918941 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3d834ee-57a5-4bd3-9cfc-76c6bfb9e355 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:55.946561 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9f31491d-c17b-442e-89cc-18fa87c9a21a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:55.957784 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9f31491d-c17b-442e-89cc-18fa87c9a21a tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64" status: 200 len: 1317 microversion: 2.1 time: 0.167535 Sep 10 11:52:55.959191 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1523/3120] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:55 2022] GET /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:52:55.986128 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c3d834ee-57a5-4bd3-9cfc-76c6bfb9e355 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:55.992606 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-efd3963c-0751-4c52-9436-a5f3314ef1b3 req-b616765a-6c91-4c04-8114-b281ce91b8e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4cf27c4-4cda-46f0-94b9-f862994d2071", "name": "network-vif-unplugged", "status": "completed", "tag": "98552666-f390-4515-b1a3-d6bf538fb04c"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:52:55.994354 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c3d834ee-57a5-4bd3-9cfc-76c6bfb9e355 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1468 microversion: 2.1 time: 0.089826 Sep 10 11:52:55.994941 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1598/3121] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:55 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1468 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:52:56.003913 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-efd3963c-0751-4c52-9436-a5f3314ef1b3 req-b616765a-6c91-4c04-8114-b281ce91b8e8 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:56.004500 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-efd3963c-0751-4c52-9436-a5f3314ef1b3 req-b616765a-6c91-4c04-8114-b281ce91b8e8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:56.004994 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-efd3963c-0751-4c52-9436-a5f3314ef1b3 req-b616765a-6c91-4c04-8114-b281ce91b8e8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:56.020681 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-efd3963c-0751-4c52-9436-a5f3314ef1b3 req-b616765a-6c91-4c04-8114-b281ce91b8e8 service nova] Creating event network-vif-unplugged:98552666-f390-4515-b1a3-d6bf538fb04c for instance d4cf27c4-4cda-46f0-94b9-f862994d2071 on n-h1-856895-1 Sep 10 11:52:56.025760 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-efd3963c-0751-4c52-9436-a5f3314ef1b3 req-b616765a-6c91-4c04-8114-b281ce91b8e8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037014 Sep 10 11:52:56.026433 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1524/3122] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:52:56.323585 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-37a7fe97-e4f9-481c-8496-786d6a235ebf tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:56.324166 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-37a7fe97-e4f9-481c-8496-786d6a235ebf tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: 3ce09007-d5b4-4565-96db-00ec7c98fb75] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:56.331476 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-37a7fe97-e4f9-481c-8496-786d6a235ebf tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:56.331962 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-37a7fe97-e4f9-481c-8496-786d6a235ebf tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:56.332401 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-37a7fe97-e4f9-481c-8496-786d6a235ebf tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:56.333091 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-37a7fe97-e4f9-481c-8496-786d6a235ebf tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:56.333549 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-37a7fe97-e4f9-481c-8496-786d6a235ebf tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:56.333981 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-37a7fe97-e4f9-481c-8496-786d6a235ebf tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:56.390661 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b238b5e4-88a8-4285-9ee0-8011c0d0063e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:56.391226 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b238b5e4-88a8-4285-9ee0-8011c0d0063e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: c56e3146-bad1-4abf-853a-2d01226d85b4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:56.397743 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b238b5e4-88a8-4285-9ee0-8011c0d0063e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:56.398227 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b238b5e4-88a8-4285-9ee0-8011c0d0063e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:56.398670 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b238b5e4-88a8-4285-9ee0-8011c0d0063e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:56.399402 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b238b5e4-88a8-4285-9ee0-8011c0d0063e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:56.399864 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b238b5e4-88a8-4285-9ee0-8011c0d0063e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:56.400298 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b238b5e4-88a8-4285-9ee0-8011c0d0063e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:56.511143 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-37a7fe97-e4f9-481c-8496-786d6a235ebf tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be647276cc456e83dacd25b98e37f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20756c1a77fb44f684973f382b802825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:56.519117 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-37a7fe97-e4f9-481c-8496-786d6a235ebf tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/3ce09007-d5b4-4565-96db-00ec7c98fb75" status: 200 len: 1374 microversion: 2.1 time: 0.199494 Sep 10 11:52:56.519745 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1599/3123] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:56 2022] GET /compute/v2.1/servers/3ce09007-d5b4-4565-96db-00ec7c98fb75 => generated 1374 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:56.536883 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-16b06dd6-cf22-4e78-8234-38fc53656021 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:56.537649 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-16b06dd6-cf22-4e78-8234-38fc53656021 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:56.543481 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-16b06dd6-cf22-4e78-8234-38fc53656021 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:56.543962 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-16b06dd6-cf22-4e78-8234-38fc53656021 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:56.544399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-16b06dd6-cf22-4e78-8234-38fc53656021 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:56.545085 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-16b06dd6-cf22-4e78-8234-38fc53656021 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:56.545562 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-16b06dd6-cf22-4e78-8234-38fc53656021 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:56.545984 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-16b06dd6-cf22-4e78-8234-38fc53656021 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:56.556577 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b238b5e4-88a8-4285-9ee0-8011c0d0063e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:56.564551 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b238b5e4-88a8-4285-9ee0-8011c0d0063e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/c56e3146-bad1-4abf-853a-2d01226d85b4" status: 200 len: 1307 microversion: 2.1 time: 0.178419 Sep 10 11:52:56.565241 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1525/3124] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:56 2022] GET /compute/v2.1/servers/c56e3146-bad1-4abf-853a-2d01226d85b4 => generated 1307 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:52:56.580753 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c210b439-45dd-4c36-9d8a-527a0817ca98 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:56.581385 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c210b439-45dd-4c36-9d8a-527a0817ca98 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 0954dadf-c6a9-4b78-b38d-2febfb54736a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:56.587514 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c210b439-45dd-4c36-9d8a-527a0817ca98 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:56.588012 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c210b439-45dd-4c36-9d8a-527a0817ca98 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:56.588455 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c210b439-45dd-4c36-9d8a-527a0817ca98 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:56.589186 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c210b439-45dd-4c36-9d8a-527a0817ca98 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:56.589649 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c210b439-45dd-4c36-9d8a-527a0817ca98 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:56.590082 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c210b439-45dd-4c36-9d8a-527a0817ca98 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:56.614056 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-16b06dd6-cf22-4e78-8234-38fc53656021 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:56.622267 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-16b06dd6-cf22-4e78-8234-38fc53656021 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:56.623752 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-16b06dd6-cf22-4e78-8234-38fc53656021 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:56.628799 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-16b06dd6-cf22-4e78-8234-38fc53656021 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1544 microversion: 2.91 time: 0.095714 Sep 10 11:52:56.629387 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1600/3125] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:56 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1544 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:56.724008 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c210b439-45dd-4c36-9d8a-527a0817ca98 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:56.731744 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c210b439-45dd-4c36-9d8a-527a0817ca98 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a" status: 200 len: 1320 microversion: 2.1 time: 0.154866 Sep 10 11:52:56.732333 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1526/3126] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:56 2022] GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a => generated 1320 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:52:56.981537 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fad8e808-7dca-47e8-a053-df5fbd383e58 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:56.982149 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fad8e808-7dca-47e8-a053-df5fbd383e58 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: f2657379-0c39-4338-9d80-51ab6f0e2a64] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:56.988493 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fad8e808-7dca-47e8-a053-df5fbd383e58 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:56.988968 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fad8e808-7dca-47e8-a053-df5fbd383e58 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:56.989398 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fad8e808-7dca-47e8-a053-df5fbd383e58 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:56.990076 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fad8e808-7dca-47e8-a053-df5fbd383e58 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:56.990566 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fad8e808-7dca-47e8-a053-df5fbd383e58 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:56.990938 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fad8e808-7dca-47e8-a053-df5fbd383e58 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:57.021261 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-79d82a93-2b16-406d-87df-28cad9f3f399 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:57.021997 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-79d82a93-2b16-406d-87df-28cad9f3f399 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:57.028920 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79d82a93-2b16-406d-87df-28cad9f3f399 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:57.029410 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79d82a93-2b16-406d-87df-28cad9f3f399 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:57.029849 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79d82a93-2b16-406d-87df-28cad9f3f399 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:57.030545 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79d82a93-2b16-406d-87df-28cad9f3f399 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:57.031004 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79d82a93-2b16-406d-87df-28cad9f3f399 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:57.031492 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79d82a93-2b16-406d-87df-28cad9f3f399 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:57.106256 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-79d82a93-2b16-406d-87df-28cad9f3f399 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:57.114715 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-79d82a93-2b16-406d-87df-28cad9f3f399 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1468 microversion: 2.1 time: 0.097221 Sep 10 11:52:57.115564 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1527/3127] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:57 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1468 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:52:57.120251 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-df5ba9ce-f754-4ce5-9f98-5d39bc2b7a6e req-e6cf1a50-f70b-45a9-9a84-8793d08d206a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2657379-0c39-4338-9d80-51ab6f0e2a64", "tag": "47100703-ef79-435f-8e7d-d7d58dd5558c"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:52:57.130504 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-df5ba9ce-f754-4ce5-9f98-5d39bc2b7a6e req-e6cf1a50-f70b-45a9-9a84-8793d08d206a service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:57.131284 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-df5ba9ce-f754-4ce5-9f98-5d39bc2b7a6e req-e6cf1a50-f70b-45a9-9a84-8793d08d206a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:57.132039 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-df5ba9ce-f754-4ce5-9f98-5d39bc2b7a6e req-e6cf1a50-f70b-45a9-9a84-8793d08d206a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:57.144296 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-df5ba9ce-f754-4ce5-9f98-5d39bc2b7a6e req-e6cf1a50-f70b-45a9-9a84-8793d08d206a service nova] Creating event network-changed:47100703-ef79-435f-8e7d-d7d58dd5558c for instance f2657379-0c39-4338-9d80-51ab6f0e2a64 on n-h2-856895-1 Sep 10 11:52:57.149171 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-df5ba9ce-f754-4ce5-9f98-5d39bc2b7a6e req-e6cf1a50-f70b-45a9-9a84-8793d08d206a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032295 Sep 10 11:52:57.149772 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1528/3128] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:52:57.151662 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fad8e808-7dca-47e8-a053-df5fbd383e58 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:57.160319 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fad8e808-7dca-47e8-a053-df5fbd383e58 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64" status: 200 len: 1317 microversion: 2.1 time: 0.182608 Sep 10 11:52:57.160893 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1601/3129] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:56 2022] GET /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64 => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:57.543630 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ac87f3f5-ca55-4396-95ec-bbc34b085f6f tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:57.544381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ac87f3f5-ca55-4396-95ec-bbc34b085f6f tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: 3ce09007-d5b4-4565-96db-00ec7c98fb75] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:57.551334 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac87f3f5-ca55-4396-95ec-bbc34b085f6f tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:57.551827 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac87f3f5-ca55-4396-95ec-bbc34b085f6f tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:57.552274 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac87f3f5-ca55-4396-95ec-bbc34b085f6f tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:57.552983 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac87f3f5-ca55-4396-95ec-bbc34b085f6f tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:57.553526 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac87f3f5-ca55-4396-95ec-bbc34b085f6f tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:57.553968 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac87f3f5-ca55-4396-95ec-bbc34b085f6f tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:57.588041 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-414a429b-4e70-4159-9784-b2ada0ac2b5b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:57.588666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-414a429b-4e70-4159-9784-b2ada0ac2b5b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: c56e3146-bad1-4abf-853a-2d01226d85b4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:57.596724 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-414a429b-4e70-4159-9784-b2ada0ac2b5b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:57.597478 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-414a429b-4e70-4159-9784-b2ada0ac2b5b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:57.598059 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-414a429b-4e70-4159-9784-b2ada0ac2b5b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:57.598764 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-414a429b-4e70-4159-9784-b2ada0ac2b5b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:57.599255 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-414a429b-4e70-4159-9784-b2ada0ac2b5b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:57.599688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-414a429b-4e70-4159-9784-b2ada0ac2b5b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:57.821217 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-414a429b-4e70-4159-9784-b2ada0ac2b5b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:57.830101 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-414a429b-4e70-4159-9784-b2ada0ac2b5b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/c56e3146-bad1-4abf-853a-2d01226d85b4" status: 200 len: 1307 microversion: 2.1 time: 0.246187 Sep 10 11:52:57.838971 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1602/3130] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:57 2022] GET /compute/v2.1/servers/c56e3146-bad1-4abf-853a-2d01226d85b4 => generated 1307 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:52:57.838971 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-183a945e-9633-424a-9ddb-f55318371d18 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:57.839430 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ac87f3f5-ca55-4396-95ec-bbc34b085f6f tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be647276cc456e83dacd25b98e37f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20756c1a77fb44f684973f382b802825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:57.839550 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-183a945e-9633-424a-9ddb-f55318371d18 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:57.843852 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-183a945e-9633-424a-9ddb-f55318371d18 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:57.844540 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-183a945e-9633-424a-9ddb-f55318371d18 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:57.844862 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ac87f3f5-ca55-4396-95ec-bbc34b085f6f tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/3ce09007-d5b4-4565-96db-00ec7c98fb75" status: 200 len: 1374 microversion: 2.1 time: 0.305494 Sep 10 11:52:57.845418 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-183a945e-9633-424a-9ddb-f55318371d18 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:57.859304 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1529/3131] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:57 2022] GET /compute/v2.1/servers/3ce09007-d5b4-4565-96db-00ec7c98fb75 => generated 1374 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:57.859304 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d2064b56-51b0-4789-8046-8f6f3ce5c72f tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:57.859304 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d2064b56-51b0-4789-8046-8f6f3ce5c72f tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 0954dadf-c6a9-4b78-b38d-2febfb54736a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:57.859304 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2064b56-51b0-4789-8046-8f6f3ce5c72f tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:57.859304 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2064b56-51b0-4789-8046-8f6f3ce5c72f tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:57.859304 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2064b56-51b0-4789-8046-8f6f3ce5c72f tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:57.859304 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2064b56-51b0-4789-8046-8f6f3ce5c72f tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:57.859908 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2064b56-51b0-4789-8046-8f6f3ce5c72f tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:57.859908 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2064b56-51b0-4789-8046-8f6f3ce5c72f tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:57.861304 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-183a945e-9633-424a-9ddb-f55318371d18 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:57.861801 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-183a945e-9633-424a-9ddb-f55318371d18 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:57.862250 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-183a945e-9633-424a-9ddb-f55318371d18 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:57.958357 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-183a945e-9633-424a-9ddb-f55318371d18 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:57.967089 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-183a945e-9633-424a-9ddb-f55318371d18 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:57.968966 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-183a945e-9633-424a-9ddb-f55318371d18 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:57.974744 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-183a945e-9633-424a-9ddb-f55318371d18 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1544 microversion: 2.91 time: 0.143014 Sep 10 11:52:57.975684 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1603/3132] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:57 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1544 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:58.030733 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d2064b56-51b0-4789-8046-8f6f3ce5c72f tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:58.039302 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d2064b56-51b0-4789-8046-8f6f3ce5c72f tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a" status: 200 len: 1320 microversion: 2.1 time: 0.192386 Sep 10 11:52:58.039880 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1530/3133] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:57 2022] GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a => generated 1320 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:58.081552 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-db2a1051-7932-47ad-b7a9-91c394411d00 req-b0fda977-c799-437a-b1f6-2d7500baa62e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c56e3146-bad1-4abf-853a-2d01226d85b4", "name": "network-vif-plugged", "status": "completed", "tag": "0c512e55-530c-4d6d-9d65-364f8052e833"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:52:58.092956 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-db2a1051-7932-47ad-b7a9-91c394411d00 req-b0fda977-c799-437a-b1f6-2d7500baa62e service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:58.093902 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-db2a1051-7932-47ad-b7a9-91c394411d00 req-b0fda977-c799-437a-b1f6-2d7500baa62e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:58.094391 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-db2a1051-7932-47ad-b7a9-91c394411d00 req-b0fda977-c799-437a-b1f6-2d7500baa62e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:58.105529 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-db2a1051-7932-47ad-b7a9-91c394411d00 req-b0fda977-c799-437a-b1f6-2d7500baa62e service nova] Creating event network-vif-plugged:0c512e55-530c-4d6d-9d65-364f8052e833 for instance c56e3146-bad1-4abf-853a-2d01226d85b4 on n-h2-856895-1 Sep 10 11:52:58.112717 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-db2a1051-7932-47ad-b7a9-91c394411d00 req-b0fda977-c799-437a-b1f6-2d7500baa62e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035793 Sep 10 11:52:58.113335 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1604/3134] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:52:58.137997 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c8019e5a-355d-4e1d-a7ee-33e749237b66 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:58.138651 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c8019e5a-355d-4e1d-a7ee-33e749237b66 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:58.145463 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c8019e5a-355d-4e1d-a7ee-33e749237b66 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:58.146142 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c8019e5a-355d-4e1d-a7ee-33e749237b66 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:58.146775 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c8019e5a-355d-4e1d-a7ee-33e749237b66 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:58.147599 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c8019e5a-355d-4e1d-a7ee-33e749237b66 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:58.148174 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c8019e5a-355d-4e1d-a7ee-33e749237b66 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:58.148707 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c8019e5a-355d-4e1d-a7ee-33e749237b66 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:58.183419 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0711ae94-35f7-4f02-85ef-7603cb4d0b42 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:58.184492 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0711ae94-35f7-4f02-85ef-7603cb4d0b42 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: f2657379-0c39-4338-9d80-51ab6f0e2a64] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:58.196623 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0711ae94-35f7-4f02-85ef-7603cb4d0b42 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:58.197114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0711ae94-35f7-4f02-85ef-7603cb4d0b42 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:58.197546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0711ae94-35f7-4f02-85ef-7603cb4d0b42 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:58.198247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0711ae94-35f7-4f02-85ef-7603cb4d0b42 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:58.198777 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0711ae94-35f7-4f02-85ef-7603cb4d0b42 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:58.199211 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0711ae94-35f7-4f02-85ef-7603cb4d0b42 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:58.225738 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c8019e5a-355d-4e1d-a7ee-33e749237b66 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:58.233750 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c8019e5a-355d-4e1d-a7ee-33e749237b66 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1468 microversion: 2.1 time: 0.099663 Sep 10 11:52:58.235076 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1531/3135] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:58 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1468 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:58.335643 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0711ae94-35f7-4f02-85ef-7603cb4d0b42 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:58.343224 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0711ae94-35f7-4f02-85ef-7603cb4d0b42 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64" status: 200 len: 1317 microversion: 2.1 time: 0.164075 Sep 10 11:52:58.343978 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1605/3136] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:58 2022] GET /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:52:58.852596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e29d8e82-41c2-4ef3-b9f7-088554a5d3d0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:58.853348 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e29d8e82-41c2-4ef3-b9f7-088554a5d3d0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: c56e3146-bad1-4abf-853a-2d01226d85b4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:58.861197 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e29d8e82-41c2-4ef3-b9f7-088554a5d3d0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:58.861732 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e29d8e82-41c2-4ef3-b9f7-088554a5d3d0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:58.862202 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e29d8e82-41c2-4ef3-b9f7-088554a5d3d0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:58.862938 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e29d8e82-41c2-4ef3-b9f7-088554a5d3d0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:58.863440 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e29d8e82-41c2-4ef3-b9f7-088554a5d3d0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:58.864133 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e29d8e82-41c2-4ef3-b9f7-088554a5d3d0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:58.876595 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2b3c8840-cfa6-4c1a-afc8-6faff008a96b tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:58.877297 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2b3c8840-cfa6-4c1a-afc8-6faff008a96b tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: 3ce09007-d5b4-4565-96db-00ec7c98fb75] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:58.888806 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b3c8840-cfa6-4c1a-afc8-6faff008a96b tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:58.889293 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b3c8840-cfa6-4c1a-afc8-6faff008a96b tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:58.889728 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b3c8840-cfa6-4c1a-afc8-6faff008a96b tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:58.891093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b3c8840-cfa6-4c1a-afc8-6faff008a96b tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:58.891577 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b3c8840-cfa6-4c1a-afc8-6faff008a96b tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:58.892002 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b3c8840-cfa6-4c1a-afc8-6faff008a96b tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:58.908889 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=100 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:52:59.075072 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e29d8e82-41c2-4ef3-b9f7-088554a5d3d0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:59.080928 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2b3c8840-cfa6-4c1a-afc8-6faff008a96b tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be647276cc456e83dacd25b98e37f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20756c1a77fb44f684973f382b802825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:59.085261 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e29d8e82-41c2-4ef3-b9f7-088554a5d3d0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/c56e3146-bad1-4abf-853a-2d01226d85b4" status: 200 len: 1307 microversion: 2.1 time: 0.236597 Sep 10 11:52:59.085983 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1532/3137] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:58 2022] GET /compute/v2.1/servers/c56e3146-bad1-4abf-853a-2d01226d85b4 => generated 1307 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:59.091045 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cf1ce1e1-1ee7-498d-82f1-8f2e3f550d97 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:59.091726 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cf1ce1e1-1ee7-498d-82f1-8f2e3f550d97 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:59.094563 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2b3c8840-cfa6-4c1a-afc8-6faff008a96b tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/3ce09007-d5b4-4565-96db-00ec7c98fb75" status: 200 len: 1374 microversion: 2.1 time: 0.222473 Sep 10 11:52:59.095444 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1606/3138] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:58 2022] GET /compute/v2.1/servers/3ce09007-d5b4-4565-96db-00ec7c98fb75 => generated 1374 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:52:59.098821 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cf1ce1e1-1ee7-498d-82f1-8f2e3f550d97 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:59.103233 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cf1ce1e1-1ee7-498d-82f1-8f2e3f550d97 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:59.103233 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cf1ce1e1-1ee7-498d-82f1-8f2e3f550d97 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:59.103233 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cf1ce1e1-1ee7-498d-82f1-8f2e3f550d97 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:59.103579 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2f47beb1-998a-43c0-a21c-c15a03d6afac tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:59.103682 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cf1ce1e1-1ee7-498d-82f1-8f2e3f550d97 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:59.103682 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cf1ce1e1-1ee7-498d-82f1-8f2e3f550d97 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:59.103867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2f47beb1-998a-43c0-a21c-c15a03d6afac tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:59.108395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f47beb1-998a-43c0-a21c-c15a03d6afac tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:59.109248 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f47beb1-998a-43c0-a21c-c15a03d6afac tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:59.109922 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f47beb1-998a-43c0-a21c-c15a03d6afac tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:59.110863 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f47beb1-998a-43c0-a21c-c15a03d6afac tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:59.111583 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f47beb1-998a-43c0-a21c-c15a03d6afac tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:59.112825 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f47beb1-998a-43c0-a21c-c15a03d6afac tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:59.143856 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2f47beb1-998a-43c0-a21c-c15a03d6afac tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2/ips" status: 200 len: 151 microversion: 2.20 time: 0.047108 Sep 10 11:52:59.144465 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1607/3139] 10.222.0.23 () {60 vars in 1289 bytes} [Sat Sep 10 11:52:59 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2/ips => generated 151 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:52:59.149410 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-664ec5a5-28f5-4f79-8d62-91d247aa9adb tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:59.150235 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-664ec5a5-28f5-4f79-8d62-91d247aa9adb tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 0954dadf-c6a9-4b78-b38d-2febfb54736a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:59.157775 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-664ec5a5-28f5-4f79-8d62-91d247aa9adb tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:59.158280 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-664ec5a5-28f5-4f79-8d62-91d247aa9adb tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:59.158724 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-664ec5a5-28f5-4f79-8d62-91d247aa9adb tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:59.159457 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-664ec5a5-28f5-4f79-8d62-91d247aa9adb tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:59.159920 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-664ec5a5-28f5-4f79-8d62-91d247aa9adb tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:59.160353 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-664ec5a5-28f5-4f79-8d62-91d247aa9adb tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:59.179903 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-cf1ce1e1-1ee7-498d-82f1-8f2e3f550d97 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:59.189049 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-cf1ce1e1-1ee7-498d-82f1-8f2e3f550d97 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:59.190532 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-cf1ce1e1-1ee7-498d-82f1-8f2e3f550d97 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:59.196002 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cf1ce1e1-1ee7-498d-82f1-8f2e3f550d97 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1544 microversion: 2.91 time: 0.108771 Sep 10 11:52:59.196947 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1533/3140] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:52:59 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1544 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:52:59.259136 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a78e3062-c259-4e62-9a4a-f5f9e9bc27cf tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:59.261022 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a78e3062-c259-4e62-9a4a-f5f9e9bc27cf tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:59.268275 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a78e3062-c259-4e62-9a4a-f5f9e9bc27cf tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:59.269103 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a78e3062-c259-4e62-9a4a-f5f9e9bc27cf tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:59.269805 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a78e3062-c259-4e62-9a4a-f5f9e9bc27cf tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:59.270773 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a78e3062-c259-4e62-9a4a-f5f9e9bc27cf tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:59.271477 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a78e3062-c259-4e62-9a4a-f5f9e9bc27cf tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:59.272099 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a78e3062-c259-4e62-9a4a-f5f9e9bc27cf tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:59.322928 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-664ec5a5-28f5-4f79-8d62-91d247aa9adb tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:59.331644 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-664ec5a5-28f5-4f79-8d62-91d247aa9adb tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a" status: 200 len: 1320 microversion: 2.1 time: 0.185928 Sep 10 11:52:59.332631 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1608/3141] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:59 2022] GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a => generated 1320 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:52:59.342283 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a78e3062-c259-4e62-9a4a-f5f9e9bc27cf tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:59.350890 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a78e3062-c259-4e62-9a4a-f5f9e9bc27cf tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1468 microversion: 2.1 time: 0.095707 Sep 10 11:52:59.351514 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1534/3142] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:59 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1468 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:52:59.366916 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-98dae171-c5d8-4b9a-afde-98b2d120fad9 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:52:59.367716 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-98dae171-c5d8-4b9a-afde-98b2d120fad9 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: f2657379-0c39-4338-9d80-51ab6f0e2a64] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:52:59.375138 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98dae171-c5d8-4b9a-afde-98b2d120fad9 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:59.375780 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98dae171-c5d8-4b9a-afde-98b2d120fad9 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:59.376221 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98dae171-c5d8-4b9a-afde-98b2d120fad9 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:59.376962 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98dae171-c5d8-4b9a-afde-98b2d120fad9 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:52:59.377426 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98dae171-c5d8-4b9a-afde-98b2d120fad9 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:52:59.377857 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98dae171-c5d8-4b9a-afde-98b2d120fad9 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:52:59.693824 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-98dae171-c5d8-4b9a-afde-98b2d120fad9 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:52:59.701917 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-98dae171-c5d8-4b9a-afde-98b2d120fad9 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64" status: 200 len: 1317 microversion: 2.1 time: 0.339350 Sep 10 11:52:59.703341 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1609/3143] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:52:59 2022] GET /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64 => generated 1317 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:00.110114 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4d8deb2b-d414-444b-a759-19a8e4a9e207 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:00.110985 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4d8deb2b-d414-444b-a759-19a8e4a9e207 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: c56e3146-bad1-4abf-853a-2d01226d85b4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:00.127207 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2ad1acc5-6937-4d82-8248-84d4e8f14d72 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:00.128025 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2ad1acc5-6937-4d82-8248-84d4e8f14d72 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: 3ce09007-d5b4-4565-96db-00ec7c98fb75] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:00.134624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4d8deb2b-d414-444b-a759-19a8e4a9e207 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:00.138557 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4d8deb2b-d414-444b-a759-19a8e4a9e207 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:00.139115 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4d8deb2b-d414-444b-a759-19a8e4a9e207 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:00.140053 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4d8deb2b-d414-444b-a759-19a8e4a9e207 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:00.141211 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ad1acc5-6937-4d82-8248-84d4e8f14d72 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:00.141953 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4d8deb2b-d414-444b-a759-19a8e4a9e207 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:00.142644 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ad1acc5-6937-4d82-8248-84d4e8f14d72 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:00.143510 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4d8deb2b-d414-444b-a759-19a8e4a9e207 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:00.143999 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ad1acc5-6937-4d82-8248-84d4e8f14d72 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:00.146531 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ad1acc5-6937-4d82-8248-84d4e8f14d72 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:00.147101 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ad1acc5-6937-4d82-8248-84d4e8f14d72 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:00.147668 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ad1acc5-6937-4d82-8248-84d4e8f14d72 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:00.370786 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4d8deb2b-d414-444b-a759-19a8e4a9e207 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:00.380014 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2ad1acc5-6937-4d82-8248-84d4e8f14d72 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be647276cc456e83dacd25b98e37f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20756c1a77fb44f684973f382b802825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:00.417382 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4d8deb2b-d414-444b-a759-19a8e4a9e207 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/c56e3146-bad1-4abf-853a-2d01226d85b4" status: 200 len: 1486 microversion: 2.1 time: 0.311991 Sep 10 11:53:00.418251 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1535/3144] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:00 2022] GET /compute/v2.1/servers/c56e3146-bad1-4abf-853a-2d01226d85b4 => generated 1486 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:53:00.425922 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-c1c331bd-4d2b-4003-bddc-c00508c75cd1 req-e6f9a860-f20a-41eb-86d2-481df2c5215f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4dbe5aa-fddd-42e7-b422-1585785f6034", "name": "network-vif-plugged", "status": "completed", "tag": "8e40280c-4dd6-4982-bbdb-e834864f3de1"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:53:00.433655 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2ad1acc5-6937-4d82-8248-84d4e8f14d72 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/3ce09007-d5b4-4565-96db-00ec7c98fb75" status: 200 len: 1374 microversion: 2.1 time: 0.295469 Sep 10 11:53:00.447601 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1610/3145] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:00 2022] GET /compute/v2.1/servers/3ce09007-d5b4-4565-96db-00ec7c98fb75 => generated 1374 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:00.450732 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-c1c331bd-4d2b-4003-bddc-c00508c75cd1 req-e6f9a860-f20a-41eb-86d2-481df2c5215f service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:00.453955 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-c1c331bd-4d2b-4003-bddc-c00508c75cd1 req-e6f9a860-f20a-41eb-86d2-481df2c5215f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:00.455556 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-c1c331bd-4d2b-4003-bddc-c00508c75cd1 req-e6f9a860-f20a-41eb-86d2-481df2c5215f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:00.460652 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bb6e9c46-6b84-4684-83c9-e518ac35c61e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:00.461446 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bb6e9c46-6b84-4684-83c9-e518ac35c61e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:00.469504 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-c1c331bd-4d2b-4003-bddc-c00508c75cd1 req-e6f9a860-f20a-41eb-86d2-481df2c5215f service nova] Creating event network-vif-plugged:8e40280c-4dd6-4982-bbdb-e834864f3de1 for instance a4dbe5aa-fddd-42e7-b422-1585785f6034 on n-h1-856895-1 Sep 10 11:53:00.477118 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bb6e9c46-6b84-4684-83c9-e518ac35c61e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:00.477835 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bb6e9c46-6b84-4684-83c9-e518ac35c61e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:00.477971 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-c1c331bd-4d2b-4003-bddc-c00508c75cd1 req-e6f9a860-f20a-41eb-86d2-481df2c5215f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057165 Sep 10 11:53:00.478495 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1536/3146] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:53:00.479096 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bb6e9c46-6b84-4684-83c9-e518ac35c61e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:00.480635 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bb6e9c46-6b84-4684-83c9-e518ac35c61e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:00.482260 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bb6e9c46-6b84-4684-83c9-e518ac35c61e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:00.485699 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8a8cbb9c-8845-4649-b3ad-a9ea814ec671 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:00.486877 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8a8cbb9c-8845-4649-b3ad-a9ea814ec671 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 0954dadf-c6a9-4b78-b38d-2febfb54736a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:00.487550 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bb6e9c46-6b84-4684-83c9-e518ac35c61e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:00.494253 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a8cbb9c-8845-4649-b3ad-a9ea814ec671 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:00.495446 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a8cbb9c-8845-4649-b3ad-a9ea814ec671 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:00.496735 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a8cbb9c-8845-4649-b3ad-a9ea814ec671 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:00.497865 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a8cbb9c-8845-4649-b3ad-a9ea814ec671 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:00.498501 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a8cbb9c-8845-4649-b3ad-a9ea814ec671 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:00.499099 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a8cbb9c-8845-4649-b3ad-a9ea814ec671 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:00.727908 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bb6e9c46-6b84-4684-83c9-e518ac35c61e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:00.738932 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bb6e9c46-6b84-4684-83c9-e518ac35c61e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:00.740859 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bb6e9c46-6b84-4684-83c9-e518ac35c61e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:00.746281 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bb6e9c46-6b84-4684-83c9-e518ac35c61e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1544 microversion: 2.91 time: 0.297509 Sep 10 11:53:00.760007 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1611/3147] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:53:00 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1544 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:53:00.778920 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5cee027f-b745-4e55-846b-3e9c0de7cfba tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:00.780606 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5cee027f-b745-4e55-846b-3e9c0de7cfba tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:00.789285 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5cee027f-b745-4e55-846b-3e9c0de7cfba tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:00.789783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5cee027f-b745-4e55-846b-3e9c0de7cfba tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:00.790415 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5cee027f-b745-4e55-846b-3e9c0de7cfba tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:00.791331 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5cee027f-b745-4e55-846b-3e9c0de7cfba tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:00.792428 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5cee027f-b745-4e55-846b-3e9c0de7cfba tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:00.793029 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5cee027f-b745-4e55-846b-3e9c0de7cfba tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:00.803240 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8a8cbb9c-8845-4649-b3ad-a9ea814ec671 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:00.813544 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8a8cbb9c-8845-4649-b3ad-a9ea814ec671 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a" status: 200 len: 1320 microversion: 2.1 time: 0.333036 Sep 10 11:53:00.824421 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1537/3148] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:00 2022] GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a => generated 1320 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:00.831957 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-332ce9a3-1b6f-4701-a69c-8a184498df9a tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:53:00.832633 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-332ce9a3-1b6f-4701-a69c-8a184498df9a tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: c56e3146-bad1-4abf-853a-2d01226d85b4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:00.838850 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-332ce9a3-1b6f-4701-a69c-8a184498df9a tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:00.839476 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-332ce9a3-1b6f-4701-a69c-8a184498df9a tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:00.840052 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-332ce9a3-1b6f-4701-a69c-8a184498df9a tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:00.840846 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-332ce9a3-1b6f-4701-a69c-8a184498df9a tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:00.841490 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-332ce9a3-1b6f-4701-a69c-8a184498df9a tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:00.841919 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-332ce9a3-1b6f-4701-a69c-8a184498df9a tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:00.845634 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5cee027f-b745-4e55-846b-3e9c0de7cfba tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:00.846252 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5cee027f-b745-4e55-846b-3e9c0de7cfba tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:00.846812 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5cee027f-b745-4e55-846b-3e9c0de7cfba tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:00.847783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-5cee027f-b745-4e55-846b-3e9c0de7cfba tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lazy-loading 'fault' on Instance uuid da5c3efa-07a9-4b8b-b258-482cecc2a0ea {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:53:00.868236 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-332ce9a3-1b6f-4701-a69c-8a184498df9a tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lazy-loading 'flavor' on Instance uuid c56e3146-bad1-4abf-853a-2d01226d85b4 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:53:00.900475 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:53:00.904853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5cee027f-b745-4e55-846b-3e9c0de7cfba tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:00.914186 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5cee027f-b745-4e55-846b-3e9c0de7cfba tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1313 microversion: 2.1 time: 0.152726 Sep 10 11:53:00.915094 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1612/3149] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:00 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:00.920738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e953f7e1-e399-400c-9421-61085d8e4376 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:00.922618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e953f7e1-e399-400c-9421-61085d8e4376 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: f2657379-0c39-4338-9d80-51ab6f0e2a64] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:00.929652 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e953f7e1-e399-400c-9421-61085d8e4376 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:00.930388 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e953f7e1-e399-400c-9421-61085d8e4376 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:00.931031 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e953f7e1-e399-400c-9421-61085d8e4376 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:00.932017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e953f7e1-e399-400c-9421-61085d8e4376 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:00.932468 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e953f7e1-e399-400c-9421-61085d8e4376 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:00.932898 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e953f7e1-e399-400c-9421-61085d8e4376 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:00.957026 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-332ce9a3-1b6f-4701-a69c-8a184498df9a tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "POST /compute/v2.1/servers/c56e3146-bad1-4abf-853a-2d01226d85b4/action" status: 202 len: 0 microversion: 2.1 time: 0.130521 Sep 10 11:53:00.958452 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1538/3150] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:53:00 2022] POST /compute/v2.1/servers/c56e3146-bad1-4abf-853a-2d01226d85b4/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:53:00.983914 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-570cdada-c8d6-4f16-942c-60ca4481d38b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:00.988326 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-570cdada-c8d6-4f16-942c-60ca4481d38b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: c56e3146-bad1-4abf-853a-2d01226d85b4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:00.996643 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-570cdada-c8d6-4f16-942c-60ca4481d38b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:00.997343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-570cdada-c8d6-4f16-942c-60ca4481d38b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:00.997958 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-570cdada-c8d6-4f16-942c-60ca4481d38b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:00.998832 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-570cdada-c8d6-4f16-942c-60ca4481d38b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:01.000142 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-570cdada-c8d6-4f16-942c-60ca4481d38b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:01.001535 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-570cdada-c8d6-4f16-942c-60ca4481d38b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:01.313736 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e953f7e1-e399-400c-9421-61085d8e4376 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:01.321962 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e953f7e1-e399-400c-9421-61085d8e4376 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64" status: 200 len: 1317 microversion: 2.1 time: 0.405146 Sep 10 11:53:01.327282 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1613/3151] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:00 2022] GET /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64 => generated 1317 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:01.327464 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-570cdada-c8d6-4f16-942c-60ca4481d38b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:01.328992 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-a8be5120-0a34-4dd8-be70-751c6bfc5f42 req-52b64d55-f8b1-48aa-b94a-11156c02d458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4cf27c4-4cda-46f0-94b9-f862994d2071", "name": "network-vif-deleted", "tag": "98552666-f390-4515-b1a3-d6bf538fb04c"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:53:01.333951 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-570cdada-c8d6-4f16-942c-60ca4481d38b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/c56e3146-bad1-4abf-853a-2d01226d85b4" status: 200 len: 1494 microversion: 2.1 time: 0.357173 Sep 10 11:53:01.335179 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1539/3152] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:00 2022] GET /compute/v2.1/servers/c56e3146-bad1-4abf-853a-2d01226d85b4 => generated 1494 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:01.349562 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a8be5120-0a34-4dd8-be70-751c6bfc5f42 req-52b64d55-f8b1-48aa-b94a-11156c02d458 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:01.350089 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a8be5120-0a34-4dd8-be70-751c6bfc5f42 req-52b64d55-f8b1-48aa-b94a-11156c02d458 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:01.350521 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a8be5120-0a34-4dd8-be70-751c6bfc5f42 req-52b64d55-f8b1-48aa-b94a-11156c02d458 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:01.367322 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-a8be5120-0a34-4dd8-be70-751c6bfc5f42 req-52b64d55-f8b1-48aa-b94a-11156c02d458 service nova] Creating event network-vif-deleted:98552666-f390-4515-b1a3-d6bf538fb04c for instance d4cf27c4-4cda-46f0-94b9-f862994d2071 on n-h1-856895-1 Sep 10 11:53:01.373761 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-a8be5120-0a34-4dd8-be70-751c6bfc5f42 req-52b64d55-f8b1-48aa-b94a-11156c02d458 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049456 Sep 10 11:53:01.374366 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1614/3153] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:53:01.458106 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2caa0bf6-c663-4a1f-99c1-b382a6a055c3 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:01.458731 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2caa0bf6-c663-4a1f-99c1-b382a6a055c3 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: 3ce09007-d5b4-4565-96db-00ec7c98fb75] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:01.465520 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2caa0bf6-c663-4a1f-99c1-b382a6a055c3 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:01.466262 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2caa0bf6-c663-4a1f-99c1-b382a6a055c3 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:01.466896 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2caa0bf6-c663-4a1f-99c1-b382a6a055c3 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:01.467663 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2caa0bf6-c663-4a1f-99c1-b382a6a055c3 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:01.468134 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2caa0bf6-c663-4a1f-99c1-b382a6a055c3 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:01.468769 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2caa0bf6-c663-4a1f-99c1-b382a6a055c3 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:01.607843 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2caa0bf6-c663-4a1f-99c1-b382a6a055c3 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be647276cc456e83dacd25b98e37f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20756c1a77fb44f684973f382b802825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:01.616198 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2caa0bf6-c663-4a1f-99c1-b382a6a055c3 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/3ce09007-d5b4-4565-96db-00ec7c98fb75" status: 200 len: 1374 microversion: 2.1 time: 0.162042 Sep 10 11:53:01.616775 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1540/3154] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:01 2022] GET /compute/v2.1/servers/3ce09007-d5b4-4565-96db-00ec7c98fb75 => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:01.775295 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:53:01.776352 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=24 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:53:01.782163 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-24797712-4caf-4229-b510-86e3c56b3213 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:01.783296 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-24797712-4caf-4229-b510-86e3c56b3213 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:01.792106 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-24797712-4caf-4229-b510-86e3c56b3213 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:01.805409 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-24797712-4caf-4229-b510-86e3c56b3213 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:01.807824 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-24797712-4caf-4229-b510-86e3c56b3213 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:01.810829 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-24797712-4caf-4229-b510-86e3c56b3213 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:01.811513 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-24797712-4caf-4229-b510-86e3c56b3213 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:01.812849 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-24797712-4caf-4229-b510-86e3c56b3213 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:01.838619 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e7a43287-3510-4be6-b805-66931e250297 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:01.839527 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e7a43287-3510-4be6-b805-66931e250297 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 0954dadf-c6a9-4b78-b38d-2febfb54736a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:01.846600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7a43287-3510-4be6-b805-66931e250297 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:01.847554 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7a43287-3510-4be6-b805-66931e250297 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:01.848099 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7a43287-3510-4be6-b805-66931e250297 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:01.848901 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7a43287-3510-4be6-b805-66931e250297 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:01.849583 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7a43287-3510-4be6-b805-66931e250297 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:01.850270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7a43287-3510-4be6-b805-66931e250297 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:01.901266 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-24797712-4caf-4229-b510-86e3c56b3213 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:01.913750 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-24797712-4caf-4229-b510-86e3c56b3213 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:01.915218 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-24797712-4caf-4229-b510-86e3c56b3213 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:01.928682 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-24797712-4caf-4229-b510-86e3c56b3213 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1544 microversion: 2.91 time: 0.153880 Sep 10 11:53:01.929875 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1615/3155] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:53:01 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1544 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:53:01.957900 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-71398bb9-976d-4d27-ae65-61611b2aada0 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:01.958846 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-71398bb9-976d-4d27-ae65-61611b2aada0 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:01.969333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71398bb9-976d-4d27-ae65-61611b2aada0 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:01.969869 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71398bb9-976d-4d27-ae65-61611b2aada0 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:01.970622 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71398bb9-976d-4d27-ae65-61611b2aada0 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:01.971839 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71398bb9-976d-4d27-ae65-61611b2aada0 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:01.973131 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71398bb9-976d-4d27-ae65-61611b2aada0 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:01.973685 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71398bb9-976d-4d27-ae65-61611b2aada0 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:02.010439 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71398bb9-976d-4d27-ae65-61611b2aada0 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:02.010921 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71398bb9-976d-4d27-ae65-61611b2aada0 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:02.011388 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71398bb9-976d-4d27-ae65-61611b2aada0 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:02.011939 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-71398bb9-976d-4d27-ae65-61611b2aada0 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lazy-loading 'fault' on Instance uuid da5c3efa-07a9-4b8b-b258-482cecc2a0ea {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:53:02.064754 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-71398bb9-976d-4d27-ae65-61611b2aada0 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '311a89ac7bc648f1a2f4067773a2ba59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd393ecae873a4fc99a4745ed894b5137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:02.070854 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e7a43287-3510-4be6-b805-66931e250297 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:02.074007 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-71398bb9-976d-4d27-ae65-61611b2aada0 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 200 len: 1487 microversion: 2.1 time: 0.129146 Sep 10 11:53:02.074906 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1616/3156] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:01 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 1487 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:02.091365 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e7a43287-3510-4be6-b805-66931e250297 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a" status: 200 len: 1320 microversion: 2.1 time: 0.256827 Sep 10 11:53:02.092154 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1541/3157] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:01 2022] GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a => generated 1320 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:53:02.205820 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cb166070-9ce3-4caf-8e93-7e5626dde721 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:53:02.206866 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cb166070-9ce3-4caf-8e93-7e5626dde721 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:02.214408 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb166070-9ce3-4caf-8e93-7e5626dde721 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:02.215327 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb166070-9ce3-4caf-8e93-7e5626dde721 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:02.215951 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb166070-9ce3-4caf-8e93-7e5626dde721 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:02.217017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb166070-9ce3-4caf-8e93-7e5626dde721 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:02.217639 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb166070-9ce3-4caf-8e93-7e5626dde721 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:02.218285 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb166070-9ce3-4caf-8e93-7e5626dde721 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:02.246589 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-cb166070-9ce3-4caf-8e93-7e5626dde721 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lazy-loading 'flavor' on Instance uuid 61ab78c6-917d-46d1-b3e2-9935ca45c8e2 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:53:02.346565 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fc9b004e-72ce-4bb4-b5d0-36a2f9d0ee9c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:02.347954 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fc9b004e-72ce-4bb4-b5d0-36a2f9d0ee9c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: f2657379-0c39-4338-9d80-51ab6f0e2a64] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:02.354245 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=4 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:53:02.361574 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc9b004e-72ce-4bb4-b5d0-36a2f9d0ee9c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:02.362356 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc9b004e-72ce-4bb4-b5d0-36a2f9d0ee9c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:02.362898 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc9b004e-72ce-4bb4-b5d0-36a2f9d0ee9c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:02.364681 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc9b004e-72ce-4bb4-b5d0-36a2f9d0ee9c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:02.365222 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc9b004e-72ce-4bb4-b5d0-36a2f9d0ee9c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:02.365730 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc9b004e-72ce-4bb4-b5d0-36a2f9d0ee9c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:02.494817 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cb166070-9ce3-4caf-8e93-7e5626dde721 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "POST /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2/action" status: 202 len: 0 microversion: 2.20 time: 0.294040 Sep 10 11:53:02.495612 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1617/3158] 10.222.0.23 () {62 vars in 1319 bytes} [Sat Sep 10 11:53:02 2022] POST /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 10 11:53:02.501132 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-758dfc3a-d009-40dd-9904-c1dd38176f05 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:02.502273 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-758dfc3a-d009-40dd-9904-c1dd38176f05 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: c56e3146-bad1-4abf-853a-2d01226d85b4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:02.508964 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-758dfc3a-d009-40dd-9904-c1dd38176f05 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:02.509786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-758dfc3a-d009-40dd-9904-c1dd38176f05 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:02.510456 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-758dfc3a-d009-40dd-9904-c1dd38176f05 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:02.511403 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-758dfc3a-d009-40dd-9904-c1dd38176f05 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:02.512096 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-758dfc3a-d009-40dd-9904-c1dd38176f05 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:02.512864 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-758dfc3a-d009-40dd-9904-c1dd38176f05 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:02.535141 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fc9b004e-72ce-4bb4-b5d0-36a2f9d0ee9c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:02.554915 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fc9b004e-72ce-4bb4-b5d0-36a2f9d0ee9c tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64" status: 200 len: 1317 microversion: 2.1 time: 0.213558 Sep 10 11:53:02.555548 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1542/3159] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:02 2022] GET /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64 => generated 1317 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:02.564693 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-13b51c58-ea43-47cf-a8a7-7db244c45a62 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:02.566531 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-13b51c58-ea43-47cf-a8a7-7db244c45a62 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:02.574555 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13b51c58-ea43-47cf-a8a7-7db244c45a62 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:02.575043 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13b51c58-ea43-47cf-a8a7-7db244c45a62 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:02.575506 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13b51c58-ea43-47cf-a8a7-7db244c45a62 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:02.576205 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13b51c58-ea43-47cf-a8a7-7db244c45a62 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:02.576658 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13b51c58-ea43-47cf-a8a7-7db244c45a62 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:02.577270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13b51c58-ea43-47cf-a8a7-7db244c45a62 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:03.014360 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-758dfc3a-d009-40dd-9904-c1dd38176f05 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:03.023480 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-758dfc3a-d009-40dd-9904-c1dd38176f05 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/c56e3146-bad1-4abf-853a-2d01226d85b4" status: 200 len: 1477 microversion: 2.1 time: 0.526420 Sep 10 11:53:03.024269 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1618/3160] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:02 2022] GET /compute/v2.1/servers/c56e3146-bad1-4abf-853a-2d01226d85b4 => generated 1477 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:03.051650 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-bbac71af-5f24-4cf5-aaca-440a7d1a1185 req-c604c60a-92ce-4613-99dd-3df538475d88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ce09007-d5b4-4565-96db-00ec7c98fb75", "name": "network-vif-plugged", "status": "completed", "tag": "bbf418c3-dbbf-4738-a16c-ef5fd6cb4d15"}, {"server_uuid": "f2657379-0c39-4338-9d80-51ab6f0e2a64", "name": "network-vif-plugged", "status": "completed", "tag": "47100703-ef79-435f-8e7d-d7d58dd5558c"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:53:03.065430 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-bbac71af-5f24-4cf5-aaca-440a7d1a1185 req-c604c60a-92ce-4613-99dd-3df538475d88 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:03.065951 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-bbac71af-5f24-4cf5-aaca-440a7d1a1185 req-c604c60a-92ce-4613-99dd-3df538475d88 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:03.066795 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-bbac71af-5f24-4cf5-aaca-440a7d1a1185 req-c604c60a-92ce-4613-99dd-3df538475d88 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:03.096029 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-bbac71af-5f24-4cf5-aaca-440a7d1a1185 req-c604c60a-92ce-4613-99dd-3df538475d88 service nova] Creating event network-vif-plugged:bbf418c3-dbbf-4738-a16c-ef5fd6cb4d15 for instance 3ce09007-d5b4-4565-96db-00ec7c98fb75 on n-h2-856895-1 Sep 10 11:53:03.096908 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-bbac71af-5f24-4cf5-aaca-440a7d1a1185 req-c604c60a-92ce-4613-99dd-3df538475d88 service nova] Creating event network-vif-plugged:47100703-ef79-435f-8e7d-d7d58dd5558c for instance f2657379-0c39-4338-9d80-51ab6f0e2a64 on n-h2-856895-1 Sep 10 11:53:03.106318 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-bbac71af-5f24-4cf5-aaca-440a7d1a1185 req-c604c60a-92ce-4613-99dd-3df538475d88 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.059915 Sep 10 11:53:03.107219 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1619/3161] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:53:03.116522 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-13b51c58-ea43-47cf-a8a7-7db244c45a62 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:03.134724 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-13b51c58-ea43-47cf-a8a7-7db244c45a62 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:03.136279 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-13b51c58-ea43-47cf-a8a7-7db244c45a62 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:03.138080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e33a6b0d-bdf0-49af-abf3-9612cb5214e3 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:03.138545 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-13b51c58-ea43-47cf-a8a7-7db244c45a62 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1723 microversion: 2.20 time: 0.579262 Sep 10 11:53:03.140143 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e33a6b0d-bdf0-49af-abf3-9612cb5214e3 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: 3ce09007-d5b4-4565-96db-00ec7c98fb75] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:03.142136 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1543/3162] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:53:02 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1723 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:53:03.147698 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e33a6b0d-bdf0-49af-abf3-9612cb5214e3 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:03.148548 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e33a6b0d-bdf0-49af-abf3-9612cb5214e3 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:03.149333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e33a6b0d-bdf0-49af-abf3-9612cb5214e3 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:03.150218 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e33a6b0d-bdf0-49af-abf3-9612cb5214e3 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:03.150383 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-00a08065-8c81-4014-b4b2-92942911419e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:03.151020 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-00a08065-8c81-4014-b4b2-92942911419e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:03.151190 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e33a6b0d-bdf0-49af-abf3-9612cb5214e3 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:03.151835 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e33a6b0d-bdf0-49af-abf3-9612cb5214e3 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:03.160593 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00a08065-8c81-4014-b4b2-92942911419e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:03.161916 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00a08065-8c81-4014-b4b2-92942911419e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:03.162539 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00a08065-8c81-4014-b4b2-92942911419e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:03.164000 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00a08065-8c81-4014-b4b2-92942911419e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:03.164657 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00a08065-8c81-4014-b4b2-92942911419e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:03.165249 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00a08065-8c81-4014-b4b2-92942911419e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:03.246962 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-00a08065-8c81-4014-b4b2-92942911419e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:03.264958 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-00a08065-8c81-4014-b4b2-92942911419e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:03.268001 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-00a08065-8c81-4014-b4b2-92942911419e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:03.274437 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-00a08065-8c81-4014-b4b2-92942911419e tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1531 microversion: 2.91 time: 0.131055 Sep 10 11:53:03.275348 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1544/3163] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:53:03 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1531 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:53:03.291340 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a46fc846-4a00-4173-82a9-181a3b605952 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-313558698"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:53:03.294112 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a46fc846-4a00-4173-82a9-181a3b605952 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: c56e3146-bad1-4abf-853a-2d01226d85b4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:03.306958 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a46fc846-4a00-4173-82a9-181a3b605952 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:03.307414 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a46fc846-4a00-4173-82a9-181a3b605952 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:03.307851 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a46fc846-4a00-4173-82a9-181a3b605952 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:03.308555 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a46fc846-4a00-4173-82a9-181a3b605952 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:03.308990 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a46fc846-4a00-4173-82a9-181a3b605952 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:03.309418 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a46fc846-4a00-4173-82a9-181a3b605952 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:03.466246 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e33a6b0d-bdf0-49af-abf3-9612cb5214e3 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be647276cc456e83dacd25b98e37f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20756c1a77fb44f684973f382b802825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:03.477544 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e33a6b0d-bdf0-49af-abf3-9612cb5214e3 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/3ce09007-d5b4-4565-96db-00ec7c98fb75" status: 200 len: 1374 microversion: 2.1 time: 0.368885 Sep 10 11:53:03.478136 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1620/3164] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:03 2022] GET /compute/v2.1/servers/3ce09007-d5b4-4565-96db-00ec7c98fb75 => generated 1374 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:03.489686 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ea760985-60ae-47af-80c8-0a1ce9af024d tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:03.490369 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ea760985-60ae-47af-80c8-0a1ce9af024d tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 0954dadf-c6a9-4b78-b38d-2febfb54736a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:03.496908 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea760985-60ae-47af-80c8-0a1ce9af024d tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:03.497547 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea760985-60ae-47af-80c8-0a1ce9af024d tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:03.497815 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea760985-60ae-47af-80c8-0a1ce9af024d tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:03.512607 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea760985-60ae-47af-80c8-0a1ce9af024d tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:03.513031 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea760985-60ae-47af-80c8-0a1ce9af024d tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:03.513476 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea760985-60ae-47af-80c8-0a1ce9af024d tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:03.559554 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a46fc846-4a00-4173-82a9-181a3b605952 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "POST /compute/v2.1/servers/c56e3146-bad1-4abf-853a-2d01226d85b4/action" status: 202 len: 0 microversion: 2.1 time: 0.282882 Sep 10 11:53:03.560866 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1545/3165] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:53:03 2022] POST /compute/v2.1/servers/c56e3146-bad1-4abf-853a-2d01226d85b4/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 10 11:53:03.567858 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7e2812f1-0ff1-4c3a-9800-ce79cba7b599 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:03.568908 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7e2812f1-0ff1-4c3a-9800-ce79cba7b599 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] [instance: da5c3efa-07a9-4b8b-b258-482cecc2a0ea] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:03.577405 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7e2812f1-0ff1-4c3a-9800-ce79cba7b599 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:03.578013 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7e2812f1-0ff1-4c3a-9800-ce79cba7b599 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:03.578589 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7e2812f1-0ff1-4c3a-9800-ce79cba7b599 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:03.579414 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7e2812f1-0ff1-4c3a-9800-ce79cba7b599 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:03.579956 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7e2812f1-0ff1-4c3a-9800-ce79cba7b599 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:03.580541 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7e2812f1-0ff1-4c3a-9800-ce79cba7b599 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:03.601291 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-7e2812f1-0ff1-4c3a-9800-ce79cba7b599 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] HTTP exception thrown: Instance da5c3efa-07a9-4b8b-b258-482cecc2a0ea could not be found. Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7e2812f1-0ff1-4c3a-9800-ce79cba7b599 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Request method failure captured: Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea HTTP/1.1 Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHow4uILeCrTWi2TF6oCclY8uVGbOYr2ZfBJlcnMDnVrYZm9lOHMfwgZEM1eZMh3LghzxrdzEHGXiDY63YIaFrvp8wmOrpvCHjfunIjn3oNSj9ScXr0HuZrEQq8Ar0nWS8GWBfGcFe7qO8LpOJEUOh0fscyPQcpkAx6CKkt7y8JKh8A Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: d393ecae873a4fc99a4745ed894b5137 Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1233886435 Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d393ecae873a4fc99a4745ed894b5137"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d393ecae873a4fc99a4745ed894b5137"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d393ecae873a4fc99a4745ed894b5137", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d393ecae873a4fc99a4745ed894b5137"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1233886435 Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: d393ecae873a4fc99a4745ed894b5137 Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1233886435 Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServerRescueTestJSONUnderV235-1233886435-project Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 311a89ac7bc648f1a2f4067773a2ba59 Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1233886435-project Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance da5c3efa-07a9-4b8b-b258-482cecc2a0ea could not be found. Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'da5c3efa-07a9-4b8b-b258-482cecc2a0ea'} Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da5c3efa-07a9-4b8b-b258-482cecc2a0ea could not be found. Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da5c3efa-07a9-4b8b-b258-482cecc2a0ea could not be found. Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:53:03.605098 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:53:03.610731 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:53:03.610731 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:53:03.610731 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:53:03.610731 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:53:03.610731 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:53:03.610731 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:53:03.610731 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da5c3efa-07a9-4b8b-b258-482cecc2a0ea could not be found. Sep 10 11:53:03.610731 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:53:03.610731 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7e2812f1-0ff1-4c3a-9800-ce79cba7b599 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] Returning 404 to user: Instance da5c3efa-07a9-4b8b-b258-482cecc2a0ea could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:53:03.613304 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7e2812f1-0ff1-4c3a-9800-ce79cba7b599 tempest-ServerRescueTestJSONUnderV235-1233886435 tempest-ServerRescueTestJSONUnderV235-1233886435-project] 10.222.0.23 "GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea" status: 404 len: 111 microversion: 2.1 time: 0.050987 Sep 10 11:53:03.618266 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1546/3166] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:03 2022] GET /compute/v2.1/servers/da5c3efa-07a9-4b8b-b258-482cecc2a0ea => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:53:03.626212 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bf866991-7fd3-49f7-a93c-1addf0856e07 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:03.628232 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bf866991-7fd3-49f7-a93c-1addf0856e07 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:03.636344 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bf866991-7fd3-49f7-a93c-1addf0856e07 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:03.637020 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bf866991-7fd3-49f7-a93c-1addf0856e07 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:03.637641 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bf866991-7fd3-49f7-a93c-1addf0856e07 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:03.638547 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bf866991-7fd3-49f7-a93c-1addf0856e07 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:03.639189 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bf866991-7fd3-49f7-a93c-1addf0856e07 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:03.639798 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bf866991-7fd3-49f7-a93c-1addf0856e07 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:03.709737 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ea760985-60ae-47af-80c8-0a1ce9af024d tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:03.718123 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ea760985-60ae-47af-80c8-0a1ce9af024d tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a" status: 200 len: 1320 microversion: 2.1 time: 0.232498 Sep 10 11:53:03.719574 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1621/3167] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:03 2022] GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a => generated 1320 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:03.738789 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-bf866991-7fd3-49f7-a93c-1addf0856e07 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] Lazy-loading 'services' on Instance uuid 0ae1b1e1-f970-4d46-8d88-289c96d3f306 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:53:03.744552 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-790f1bc3-ad19-4c6c-8e12-d2cf7c211c1a tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f4072560310>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:03.762566 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bf866991-7fd3-49f7-a93c-1addf0856e07 tempest-UnshelveToHostMultiNodesTest-1944456796 tempest-UnshelveToHostMultiNodesTest-1944456796-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1936 microversion: 2.91 time: 0.141563 Sep 10 11:53:03.763618 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1547/3168] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:53:03 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1936 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:53:03.770040 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b5912493-b99d-4c77-acdd-1c47416242a4 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:03.770890 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b5912493-b99d-4c77-acdd-1c47416242a4 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: f2657379-0c39-4338-9d80-51ab6f0e2a64] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:03.783558 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b5912493-b99d-4c77-acdd-1c47416242a4 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:03.784638 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b5912493-b99d-4c77-acdd-1c47416242a4 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:03.785372 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b5912493-b99d-4c77-acdd-1c47416242a4 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:03.786305 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b5912493-b99d-4c77-acdd-1c47416242a4 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:03.786966 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b5912493-b99d-4c77-acdd-1c47416242a4 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:03.787635 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b5912493-b99d-4c77-acdd-1c47416242a4 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:03.802018 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-790f1bc3-ad19-4c6c-8e12-d2cf7c211c1a tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/4f0c3346-cd3b-4d5a-bcc9-4f0d2ff31c8b" status: 200 len: 1437 microversion: 2.1 time: 0.063496 Sep 10 11:53:03.803194 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1622/3169] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:53:03 2022] GET /compute/v2.1/images/4f0c3346-cd3b-4d5a-bcc9-4f0d2ff31c8b => generated 1437 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:03.819946 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b0f7661f-7813-4a25-9104-d66eaf010c14 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:03.820802 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b0f7661f-7813-4a25-9104-d66eaf010c14 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:03.828207 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0f7661f-7813-4a25-9104-d66eaf010c14 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:03.829641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0f7661f-7813-4a25-9104-d66eaf010c14 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:03.830344 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0f7661f-7813-4a25-9104-d66eaf010c14 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:03.831345 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0f7661f-7813-4a25-9104-d66eaf010c14 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:03.832179 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0f7661f-7813-4a25-9104-d66eaf010c14 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:03.835733 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0f7661f-7813-4a25-9104-d66eaf010c14 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:03.845761 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:53:03.879416 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b0f7661f-7813-4a25-9104-d66eaf010c14 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:53:04.020906 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b5912493-b99d-4c77-acdd-1c47416242a4 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:04.030282 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b5912493-b99d-4c77-acdd-1c47416242a4 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64" status: 200 len: 1317 microversion: 2.1 time: 0.265432 Sep 10 11:53:04.037184 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b0f7661f-7813-4a25-9104-d66eaf010c14 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 204 len: 0 microversion: 2.91 time: 0.225670 Sep 10 11:53:04.037805 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1623/3170] 10.222.0.23 () {60 vars in 1280 bytes} [Sat Sep 10 11:53:03 2022] DELETE /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 11:53:04.044692 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1548/3171] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:03 2022] GET /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64 => generated 1317 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:04.049975 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ad23c12c-7b4e-4786-9ebe-ee902b46dfd0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:04.050671 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ad23c12c-7b4e-4786-9ebe-ee902b46dfd0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:04.055876 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:53:04.057388 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ad23c12c-7b4e-4786-9ebe-ee902b46dfd0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:04.057870 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ad23c12c-7b4e-4786-9ebe-ee902b46dfd0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:04.058306 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ad23c12c-7b4e-4786-9ebe-ee902b46dfd0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:04.059045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ad23c12c-7b4e-4786-9ebe-ee902b46dfd0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:04.059528 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ad23c12c-7b4e-4786-9ebe-ee902b46dfd0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:04.059952 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ad23c12c-7b4e-4786-9ebe-ee902b46dfd0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:04.145681 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ad23c12c-7b4e-4786-9ebe-ee902b46dfd0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:04.154322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ad23c12c-7b4e-4786-9ebe-ee902b46dfd0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:04.155930 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ad23c12c-7b4e-4786-9ebe-ee902b46dfd0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:04.161130 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ad23c12c-7b4e-4786-9ebe-ee902b46dfd0 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1537 microversion: 2.91 time: 0.115913 Sep 10 11:53:04.163430 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1624/3172] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:53:04 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1537 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:53:04.178266 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cb9e6675-6bfb-45a6-8dd6-76add151e8c4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:04.179771 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cb9e6675-6bfb-45a6-8dd6-76add151e8c4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:04.186593 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb9e6675-6bfb-45a6-8dd6-76add151e8c4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:04.187832 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb9e6675-6bfb-45a6-8dd6-76add151e8c4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:04.188673 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb9e6675-6bfb-45a6-8dd6-76add151e8c4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:04.189763 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb9e6675-6bfb-45a6-8dd6-76add151e8c4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:04.190508 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb9e6675-6bfb-45a6-8dd6-76add151e8c4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:04.190905 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb9e6675-6bfb-45a6-8dd6-76add151e8c4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:04.328474 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-cb9e6675-6bfb-45a6-8dd6-76add151e8c4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:04.336910 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-cb9e6675-6bfb-45a6-8dd6-76add151e8c4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:04.338681 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-cb9e6675-6bfb-45a6-8dd6-76add151e8c4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:04.339909 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cb9e6675-6bfb-45a6-8dd6-76add151e8c4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1723 microversion: 2.20 time: 0.167120 Sep 10 11:53:04.340480 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1549/3173] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:53:04 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:53:04.502705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c1043651-459d-4e4d-bba4-8d40d5183fc5 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:04.503435 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c1043651-459d-4e4d-bba4-8d40d5183fc5 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: 3ce09007-d5b4-4565-96db-00ec7c98fb75] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:04.509858 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1043651-459d-4e4d-bba4-8d40d5183fc5 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:04.510348 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1043651-459d-4e4d-bba4-8d40d5183fc5 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:04.510783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1043651-459d-4e4d-bba4-8d40d5183fc5 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:04.511505 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1043651-459d-4e4d-bba4-8d40d5183fc5 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:04.511973 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1043651-459d-4e4d-bba4-8d40d5183fc5 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:04.512404 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1043651-459d-4e4d-bba4-8d40d5183fc5 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:04.649322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c1043651-459d-4e4d-bba4-8d40d5183fc5 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be647276cc456e83dacd25b98e37f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20756c1a77fb44f684973f382b802825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:04.657650 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c1043651-459d-4e4d-bba4-8d40d5183fc5 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/3ce09007-d5b4-4565-96db-00ec7c98fb75" status: 200 len: 1374 microversion: 2.1 time: 0.159899 Sep 10 11:53:04.658235 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1625/3174] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:04 2022] GET /compute/v2.1/servers/3ce09007-d5b4-4565-96db-00ec7c98fb75 => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:04.744444 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8954a118-3aea-449a-ae2c-a3889f0580e1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:04.745191 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8954a118-3aea-449a-ae2c-a3889f0580e1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 0954dadf-c6a9-4b78-b38d-2febfb54736a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:04.752218 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8954a118-3aea-449a-ae2c-a3889f0580e1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:04.752717 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8954a118-3aea-449a-ae2c-a3889f0580e1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:04.753162 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8954a118-3aea-449a-ae2c-a3889f0580e1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:04.753870 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8954a118-3aea-449a-ae2c-a3889f0580e1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:04.754333 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8954a118-3aea-449a-ae2c-a3889f0580e1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:04.754773 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8954a118-3aea-449a-ae2c-a3889f0580e1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:04.818419 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a64541bd-2278-4af2-9a03-8b8ccdb09f79 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f407304aca0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:04.890929 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a64541bd-2278-4af2-9a03-8b8ccdb09f79 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/4f0c3346-cd3b-4d5a-bcc9-4f0d2ff31c8b" status: 200 len: 1437 microversion: 2.1 time: 0.076049 Sep 10 11:53:04.903939 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1626/3175] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:53:04 2022] GET /compute/v2.1/images/4f0c3346-cd3b-4d5a-bcc9-4f0d2ff31c8b => generated 1437 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:04.927799 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8954a118-3aea-449a-ae2c-a3889f0580e1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:04.935922 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8954a118-3aea-449a-ae2c-a3889f0580e1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a" status: 200 len: 1320 microversion: 2.1 time: 0.195285 Sep 10 11:53:04.936740 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1550/3176] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:04 2022] GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a => generated 1320 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:05.054096 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-444d675d-3898-4517-b71f-b5c2751c9c8d tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:05.054843 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-444d675d-3898-4517-b71f-b5c2751c9c8d tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: f2657379-0c39-4338-9d80-51ab6f0e2a64] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:05.060968 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-444d675d-3898-4517-b71f-b5c2751c9c8d tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:05.061519 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-444d675d-3898-4517-b71f-b5c2751c9c8d tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:05.062734 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-444d675d-3898-4517-b71f-b5c2751c9c8d tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:05.063632 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-444d675d-3898-4517-b71f-b5c2751c9c8d tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:05.064154 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-444d675d-3898-4517-b71f-b5c2751c9c8d tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:05.064585 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-444d675d-3898-4517-b71f-b5c2751c9c8d tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:05.135474 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-f74454cc-a04a-4df8-9e28-17563b38cced req-d65b5ff9-67c2-4571-be7b-52487af285e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0954dadf-c6a9-4b78-b38d-2febfb54736a", "name": "network-vif-plugged", "status": "completed", "tag": "3c43a878-d2b9-4792-b156-ab611307dd32"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:53:05.151013 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f74454cc-a04a-4df8-9e28-17563b38cced req-d65b5ff9-67c2-4571-be7b-52487af285e3 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:05.151845 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f74454cc-a04a-4df8-9e28-17563b38cced req-d65b5ff9-67c2-4571-be7b-52487af285e3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:05.152446 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f74454cc-a04a-4df8-9e28-17563b38cced req-d65b5ff9-67c2-4571-be7b-52487af285e3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:05.174810 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-f74454cc-a04a-4df8-9e28-17563b38cced req-d65b5ff9-67c2-4571-be7b-52487af285e3 service nova] Creating event network-vif-plugged:3c43a878-d2b9-4792-b156-ab611307dd32 for instance 0954dadf-c6a9-4b78-b38d-2febfb54736a on n-h1-856895-1 Sep 10 11:53:05.183846 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-f74454cc-a04a-4df8-9e28-17563b38cced req-d65b5ff9-67c2-4571-be7b-52487af285e3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055124 Sep 10 11:53:05.184380 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1551/3177] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:53:05.195905 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-782425c6-3f22-4043-97b2-286fb69623af tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:05.197025 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-782425c6-3f22-4043-97b2-286fb69623af tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:05.203135 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-782425c6-3f22-4043-97b2-286fb69623af tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:05.203914 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-782425c6-3f22-4043-97b2-286fb69623af tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:05.204352 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-782425c6-3f22-4043-97b2-286fb69623af tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:05.205117 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-782425c6-3f22-4043-97b2-286fb69623af tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:05.205496 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-782425c6-3f22-4043-97b2-286fb69623af tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:05.205917 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-782425c6-3f22-4043-97b2-286fb69623af tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:05.251651 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-444d675d-3898-4517-b71f-b5c2751c9c8d tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:05.262022 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-444d675d-3898-4517-b71f-b5c2751c9c8d tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64" status: 200 len: 1507 microversion: 2.1 time: 0.211984 Sep 10 11:53:05.264350 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1627/3178] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:05 2022] GET /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64 => generated 1507 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:05.285333 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-782425c6-3f22-4043-97b2-286fb69623af tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:05.294860 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-782425c6-3f22-4043-97b2-286fb69623af tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:05.296418 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-782425c6-3f22-4043-97b2-286fb69623af tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:05.303464 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-02b4c8fe-30b4-4ae7-8341-29a3771b75b7 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:05.305182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-02b4c8fe-30b4-4ae7-8341-29a3771b75b7 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: f2657379-0c39-4338-9d80-51ab6f0e2a64] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:05.305499 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-782425c6-3f22-4043-97b2-286fb69623af tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1537 microversion: 2.91 time: 0.113796 Sep 10 11:53:05.306154 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1552/3179] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:53:05 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1537 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:53:05.315196 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02b4c8fe-30b4-4ae7-8341-29a3771b75b7 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:05.315691 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02b4c8fe-30b4-4ae7-8341-29a3771b75b7 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:05.316134 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02b4c8fe-30b4-4ae7-8341-29a3771b75b7 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:05.316853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02b4c8fe-30b4-4ae7-8341-29a3771b75b7 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:05.317311 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02b4c8fe-30b4-4ae7-8341-29a3771b75b7 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:05.317736 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02b4c8fe-30b4-4ae7-8341-29a3771b75b7 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:05.366747 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-de39df7b-e84d-4404-aa10-96680513d37e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:05.367515 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-de39df7b-e84d-4404-aa10-96680513d37e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:05.374114 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de39df7b-e84d-4404-aa10-96680513d37e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:05.375190 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de39df7b-e84d-4404-aa10-96680513d37e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:05.375899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de39df7b-e84d-4404-aa10-96680513d37e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:05.376740 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de39df7b-e84d-4404-aa10-96680513d37e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:05.377214 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de39df7b-e84d-4404-aa10-96680513d37e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:05.377830 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de39df7b-e84d-4404-aa10-96680513d37e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:05.523048 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-02b4c8fe-30b4-4ae7-8341-29a3771b75b7 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:05.531180 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-02b4c8fe-30b4-4ae7-8341-29a3771b75b7 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64" status: 200 len: 1507 microversion: 2.1 time: 0.236977 Sep 10 11:53:05.532033 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1628/3180] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:05 2022] GET /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64 => generated 1507 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:05.552910 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7ea9d7b7-ee35-43d9-80c7-edfcaa7ac778 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:53:05.555603 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7ea9d7b7-ee35-43d9-80c7-edfcaa7ac778 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: f2657379-0c39-4338-9d80-51ab6f0e2a64] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:05.562581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ea9d7b7-ee35-43d9-80c7-edfcaa7ac778 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:05.563056 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ea9d7b7-ee35-43d9-80c7-edfcaa7ac778 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:05.563553 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ea9d7b7-ee35-43d9-80c7-edfcaa7ac778 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:05.563680 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-de39df7b-e84d-4404-aa10-96680513d37e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:05.564261 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ea9d7b7-ee35-43d9-80c7-edfcaa7ac778 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:05.564713 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ea9d7b7-ee35-43d9-80c7-edfcaa7ac778 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:05.565175 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ea9d7b7-ee35-43d9-80c7-edfcaa7ac778 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:05.576228 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-de39df7b-e84d-4404-aa10-96680513d37e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:05.578318 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-de39df7b-e84d-4404-aa10-96680513d37e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:05.579865 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-de39df7b-e84d-4404-aa10-96680513d37e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1723 microversion: 2.20 time: 0.217383 Sep 10 11:53:05.596450 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1553/3181] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:53:05 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:53:05.633015 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7ea9d7b7-ee35-43d9-80c7-edfcaa7ac778 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "PUT /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64" status: 200 len: 1079 microversion: 2.1 time: 0.083886 Sep 10 11:53:05.633659 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1629/3182] 10.222.0.23 () {60 vars in 1256 bytes} [Sat Sep 10 11:53:05 2022] PUT /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64 => generated 1079 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:53:05.653222 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1e9c29cf-ff8e-4614-aa48-2020d1cc22ae tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:05.653846 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1e9c29cf-ff8e-4614-aa48-2020d1cc22ae tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: f2657379-0c39-4338-9d80-51ab6f0e2a64] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:05.662035 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1e9c29cf-ff8e-4614-aa48-2020d1cc22ae tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:05.662535 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1e9c29cf-ff8e-4614-aa48-2020d1cc22ae tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:05.662986 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1e9c29cf-ff8e-4614-aa48-2020d1cc22ae tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:05.663727 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1e9c29cf-ff8e-4614-aa48-2020d1cc22ae tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:05.665104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1e9c29cf-ff8e-4614-aa48-2020d1cc22ae tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:05.668249 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1e9c29cf-ff8e-4614-aa48-2020d1cc22ae tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:05.677654 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:53:05.683580 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8d79cebe-eaeb-4c43-92c0-87616426f5f8 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:05.684061 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8d79cebe-eaeb-4c43-92c0-87616426f5f8 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: 3ce09007-d5b4-4565-96db-00ec7c98fb75] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:05.691828 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8d79cebe-eaeb-4c43-92c0-87616426f5f8 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:05.692326 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8d79cebe-eaeb-4c43-92c0-87616426f5f8 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:05.692841 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8d79cebe-eaeb-4c43-92c0-87616426f5f8 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:05.693718 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8d79cebe-eaeb-4c43-92c0-87616426f5f8 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:05.694175 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8d79cebe-eaeb-4c43-92c0-87616426f5f8 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:05.694758 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8d79cebe-eaeb-4c43-92c0-87616426f5f8 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:06.009763 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8d79cebe-eaeb-4c43-92c0-87616426f5f8 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be647276cc456e83dacd25b98e37f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20756c1a77fb44f684973f382b802825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:06.019418 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8d79cebe-eaeb-4c43-92c0-87616426f5f8 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/3ce09007-d5b4-4565-96db-00ec7c98fb75" status: 200 len: 1546 microversion: 2.1 time: 0.339983 Sep 10 11:53:06.020487 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1630/3183] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:05 2022] GET /compute/v2.1/servers/3ce09007-d5b4-4565-96db-00ec7c98fb75 => generated 1546 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:06.025828 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cbdbdb46-2e6a-4676-9da4-e17903b34b15 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f40724ec550>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:06.025981 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1e9c29cf-ff8e-4614-aa48-2020d1cc22ae tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:06.034495 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1e9c29cf-ff8e-4614-aa48-2020d1cc22ae tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64" status: 200 len: 1505 microversion: 2.1 time: 0.385409 Sep 10 11:53:06.047586 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1554/3184] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:05 2022] GET /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64 => generated 1505 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:06.058369 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7bf9eabc-1db6-4606-977a-e2d061326018 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:06.059298 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7bf9eabc-1db6-4606-977a-e2d061326018 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 0954dadf-c6a9-4b78-b38d-2febfb54736a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:06.067990 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7bf9eabc-1db6-4606-977a-e2d061326018 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:06.068447 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7bf9eabc-1db6-4606-977a-e2d061326018 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:06.069052 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7bf9eabc-1db6-4606-977a-e2d061326018 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:06.069940 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7bf9eabc-1db6-4606-977a-e2d061326018 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:06.070559 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7bf9eabc-1db6-4606-977a-e2d061326018 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:06.071146 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7bf9eabc-1db6-4606-977a-e2d061326018 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:06.074636 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cbdbdb46-2e6a-4676-9da4-e17903b34b15 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/4f0c3346-cd3b-4d5a-bcc9-4f0d2ff31c8b" status: 200 len: 1437 microversion: 2.1 time: 0.052844 Sep 10 11:53:06.083817 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1631/3185] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:53:06 2022] GET /compute/v2.1/images/4f0c3346-cd3b-4d5a-bcc9-4f0d2ff31c8b => generated 1437 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:06.088586 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-53afd013-c0b9-4370-985a-0edc6f1c8cb2 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:06.089306 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-53afd013-c0b9-4370-985a-0edc6f1c8cb2 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: 3ce09007-d5b4-4565-96db-00ec7c98fb75] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:06.097969 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-53afd013-c0b9-4370-985a-0edc6f1c8cb2 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:06.098467 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-53afd013-c0b9-4370-985a-0edc6f1c8cb2 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:06.098906 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-53afd013-c0b9-4370-985a-0edc6f1c8cb2 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:06.099667 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-53afd013-c0b9-4370-985a-0edc6f1c8cb2 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:06.100346 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-53afd013-c0b9-4370-985a-0edc6f1c8cb2 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:06.100786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-53afd013-c0b9-4370-985a-0edc6f1c8cb2 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:06.386559 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7bf9eabc-1db6-4606-977a-e2d061326018 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:06.394409 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7bf9eabc-1db6-4606-977a-e2d061326018 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a" status: 200 len: 1320 microversion: 2.1 time: 0.345394 Sep 10 11:53:06.395268 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1555/3186] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:06 2022] GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a => generated 1320 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:06.399989 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-406d4861-3a83-498a-b1aa-9d7799b72424 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:06.400663 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-406d4861-3a83-498a-b1aa-9d7799b72424 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: f2657379-0c39-4338-9d80-51ab6f0e2a64] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:06.408122 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-406d4861-3a83-498a-b1aa-9d7799b72424 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:06.408626 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-406d4861-3a83-498a-b1aa-9d7799b72424 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:06.409068 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-406d4861-3a83-498a-b1aa-9d7799b72424 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:06.409783 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-406d4861-3a83-498a-b1aa-9d7799b72424 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:06.410277 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-406d4861-3a83-498a-b1aa-9d7799b72424 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:06.410712 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-406d4861-3a83-498a-b1aa-9d7799b72424 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:06.438280 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-53afd013-c0b9-4370-985a-0edc6f1c8cb2 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be647276cc456e83dacd25b98e37f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20756c1a77fb44f684973f382b802825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:06.446193 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-53afd013-c0b9-4370-985a-0edc6f1c8cb2 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/3ce09007-d5b4-4565-96db-00ec7c98fb75" status: 200 len: 1546 microversion: 2.1 time: 0.361207 Sep 10 11:53:06.446770 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1632/3187] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:06 2022] GET /compute/v2.1/servers/3ce09007-d5b4-4565-96db-00ec7c98fb75 => generated 1546 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:06.451312 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b42610d4-d6f8-46f1-b9bb-ca2e7a96f55c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:06.451923 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b42610d4-d6f8-46f1-b9bb-ca2e7a96f55c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:06.457847 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b42610d4-d6f8-46f1-b9bb-ca2e7a96f55c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:06.458402 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b42610d4-d6f8-46f1-b9bb-ca2e7a96f55c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:06.458850 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b42610d4-d6f8-46f1-b9bb-ca2e7a96f55c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:06.459573 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b42610d4-d6f8-46f1-b9bb-ca2e7a96f55c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:06.460234 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b42610d4-d6f8-46f1-b9bb-ca2e7a96f55c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:06.460674 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b42610d4-d6f8-46f1-b9bb-ca2e7a96f55c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:06.559551 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b42610d4-d6f8-46f1-b9bb-ca2e7a96f55c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:06.568788 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b42610d4-d6f8-46f1-b9bb-ca2e7a96f55c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:06.570212 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b42610d4-d6f8-46f1-b9bb-ca2e7a96f55c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:06.575355 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b42610d4-d6f8-46f1-b9bb-ca2e7a96f55c tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1537 microversion: 2.91 time: 0.127561 Sep 10 11:53:06.576126 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1633/3188] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:53:06 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1537 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:53:06.607767 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-31aee21c-d082-4edd-88c1-76c0bcf232f7 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:06.608549 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-31aee21c-d082-4edd-88c1-76c0bcf232f7 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:06.615071 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-31aee21c-d082-4edd-88c1-76c0bcf232f7 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:06.615597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-31aee21c-d082-4edd-88c1-76c0bcf232f7 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:06.616028 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-31aee21c-d082-4edd-88c1-76c0bcf232f7 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:06.616713 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-31aee21c-d082-4edd-88c1-76c0bcf232f7 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:06.617159 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-31aee21c-d082-4edd-88c1-76c0bcf232f7 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:06.617576 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-31aee21c-d082-4edd-88c1-76c0bcf232f7 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:06.688472 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-406d4861-3a83-498a-b1aa-9d7799b72424 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:06.697474 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-406d4861-3a83-498a-b1aa-9d7799b72424 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64" status: 200 len: 1505 microversion: 2.1 time: 0.301011 Sep 10 11:53:06.698070 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1556/3189] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:06 2022] GET /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64 => generated 1505 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:06.725665 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5cdd275e-1bc1-41ec-a991-d6df2b55799f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:53:06.730106 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5cdd275e-1bc1-41ec-a991-d6df2b55799f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: f2657379-0c39-4338-9d80-51ab6f0e2a64] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:06.740395 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5cdd275e-1bc1-41ec-a991-d6df2b55799f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:06.740975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5cdd275e-1bc1-41ec-a991-d6df2b55799f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:06.741439 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5cdd275e-1bc1-41ec-a991-d6df2b55799f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:06.742231 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5cdd275e-1bc1-41ec-a991-d6df2b55799f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:06.743025 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5cdd275e-1bc1-41ec-a991-d6df2b55799f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:06.743736 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5cdd275e-1bc1-41ec-a991-d6df2b55799f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:06.847151 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5cdd275e-1bc1-41ec-a991-d6df2b55799f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "PUT /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64" status: 200 len: 1081 microversion: 2.1 time: 0.127299 Sep 10 11:53:06.849037 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1557/3190] 10.222.0.23 () {60 vars in 1256 bytes} [Sat Sep 10 11:53:06 2022] PUT /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64 => generated 1081 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:06.861759 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-31aee21c-d082-4edd-88c1-76c0bcf232f7 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:06.892101 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f54ddcb0-93a7-4338-b0e2-0cbb7ca917ec tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:06.896944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f54ddcb0-93a7-4338-b0e2-0cbb7ca917ec tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: f2657379-0c39-4338-9d80-51ab6f0e2a64] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:06.910691 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-31aee21c-d082-4edd-88c1-76c0bcf232f7 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:06.911992 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f54ddcb0-93a7-4338-b0e2-0cbb7ca917ec tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:06.913777 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f54ddcb0-93a7-4338-b0e2-0cbb7ca917ec tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:06.914246 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f54ddcb0-93a7-4338-b0e2-0cbb7ca917ec tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:06.914881 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-31aee21c-d082-4edd-88c1-76c0bcf232f7 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:06.916116 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f54ddcb0-93a7-4338-b0e2-0cbb7ca917ec tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:06.916601 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f54ddcb0-93a7-4338-b0e2-0cbb7ca917ec tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:06.918637 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f54ddcb0-93a7-4338-b0e2-0cbb7ca917ec tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:06.920090 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-31aee21c-d082-4edd-88c1-76c0bcf232f7 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1723 microversion: 2.20 time: 0.314200 Sep 10 11:53:06.924608 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1634/3191] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:53:06 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1723 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:53:07.090569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3ac87b22-823d-4ab3-966d-c460e8c7528e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f40725793a0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:07.167924 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3ac87b22-823d-4ab3-966d-c460e8c7528e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/4f0c3346-cd3b-4d5a-bcc9-4f0d2ff31c8b" status: 200 len: 1437 microversion: 2.1 time: 0.081382 Sep 10 11:53:07.169889 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1635/3192] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:53:07 2022] GET /compute/v2.1/images/4f0c3346-cd3b-4d5a-bcc9-4f0d2ff31c8b => generated 1437 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:53:07.235683 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f54ddcb0-93a7-4338-b0e2-0cbb7ca917ec tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:07.253862 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f54ddcb0-93a7-4338-b0e2-0cbb7ca917ec tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64" status: 200 len: 1507 microversion: 2.1 time: 0.386566 Sep 10 11:53:07.271863 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1558/3193] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:06 2022] GET /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64 => generated 1507 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:07.284879 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0bbcc6e3-243f-4916-b69e-fd988ad0af58 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:07.285509 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0bbcc6e3-243f-4916-b69e-fd988ad0af58 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: f2657379-0c39-4338-9d80-51ab6f0e2a64] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:07.292429 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0bbcc6e3-243f-4916-b69e-fd988ad0af58 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:07.292962 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0bbcc6e3-243f-4916-b69e-fd988ad0af58 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:07.293408 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0bbcc6e3-243f-4916-b69e-fd988ad0af58 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:07.294119 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0bbcc6e3-243f-4916-b69e-fd988ad0af58 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:07.294562 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0bbcc6e3-243f-4916-b69e-fd988ad0af58 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:07.294992 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0bbcc6e3-243f-4916-b69e-fd988ad0af58 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:07.417361 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-19e2df67-0777-4ff8-b51e-bfcbd4d6925b tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:07.417994 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-19e2df67-0777-4ff8-b51e-bfcbd4d6925b tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 0954dadf-c6a9-4b78-b38d-2febfb54736a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:07.434740 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19e2df67-0777-4ff8-b51e-bfcbd4d6925b tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:07.435279 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19e2df67-0777-4ff8-b51e-bfcbd4d6925b tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:07.435725 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19e2df67-0777-4ff8-b51e-bfcbd4d6925b tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:07.436445 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19e2df67-0777-4ff8-b51e-bfcbd4d6925b tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:07.437040 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19e2df67-0777-4ff8-b51e-bfcbd4d6925b tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:07.438711 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19e2df67-0777-4ff8-b51e-bfcbd4d6925b tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:07.659121 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0bbcc6e3-243f-4916-b69e-fd988ad0af58 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:07.677135 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0bbcc6e3-243f-4916-b69e-fd988ad0af58 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64" status: 200 len: 1507 microversion: 2.1 time: 0.398101 Sep 10 11:53:07.687670 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1636/3194] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:07 2022] GET /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64 => generated 1507 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:07.706498 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b9889eef-7786-451a-bcfb-a72dff8916af tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:07.707129 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b9889eef-7786-451a-bcfb-a72dff8916af tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:07.724292 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9889eef-7786-451a-bcfb-a72dff8916af tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:07.724824 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9889eef-7786-451a-bcfb-a72dff8916af tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:07.725317 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9889eef-7786-451a-bcfb-a72dff8916af tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:07.725925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9889eef-7786-451a-bcfb-a72dff8916af tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:07.726384 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9889eef-7786-451a-bcfb-a72dff8916af tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:07.726815 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9889eef-7786-451a-bcfb-a72dff8916af tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:07.761608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-19e2df67-0777-4ff8-b51e-bfcbd4d6925b tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:07.788766 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9889eef-7786-451a-bcfb-a72dff8916af tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:07.789529 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9889eef-7786-451a-bcfb-a72dff8916af tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:07.790610 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9889eef-7786-451a-bcfb-a72dff8916af tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:07.791514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-b9889eef-7786-451a-bcfb-a72dff8916af tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lazy-loading 'fault' on Instance uuid 0ae1b1e1-f970-4d46-8d88-289c96d3f306 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:53:07.795230 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-19e2df67-0777-4ff8-b51e-bfcbd4d6925b tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a" status: 200 len: 1511 microversion: 2.1 time: 0.379767 Sep 10 11:53:07.798432 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1559/3195] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:07 2022] GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a => generated 1511 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:07.807458 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d7f119c7-a6bd-4b35-9dcc-69f6047017ec tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:07.808128 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d7f119c7-a6bd-4b35-9dcc-69f6047017ec tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: f2657379-0c39-4338-9d80-51ab6f0e2a64] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:07.815717 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d7f119c7-a6bd-4b35-9dcc-69f6047017ec tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:07.818011 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d7f119c7-a6bd-4b35-9dcc-69f6047017ec tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:07.818770 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d7f119c7-a6bd-4b35-9dcc-69f6047017ec tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:07.821670 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d7f119c7-a6bd-4b35-9dcc-69f6047017ec tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:07.823655 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d7f119c7-a6bd-4b35-9dcc-69f6047017ec tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:07.824545 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d7f119c7-a6bd-4b35-9dcc-69f6047017ec tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:07.904759 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d7f119c7-a6bd-4b35-9dcc-69f6047017ec tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: f2657379-0c39-4338-9d80-51ab6f0e2a64] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:53:07.905694 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b9889eef-7786-451a-bcfb-a72dff8916af tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:07.918128 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b9889eef-7786-451a-bcfb-a72dff8916af tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:07.920464 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b9889eef-7786-451a-bcfb-a72dff8916af tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd1a99070e3b84f1eb90288db5aaea482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c22723baa90a4f1580169a60f93d6664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:07.926817 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b9889eef-7786-451a-bcfb-a72dff8916af tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 200 len: 1542 microversion: 2.91 time: 0.238035 Sep 10 11:53:07.928141 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1637/3196] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:53:07 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 1542 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:53:07.943178 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c55dd651-4e44-495c-980c-17c6209cc613 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:07.944108 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c55dd651-4e44-495c-980c-17c6209cc613 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:07.960037 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c55dd651-4e44-495c-980c-17c6209cc613 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:07.960806 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c55dd651-4e44-495c-980c-17c6209cc613 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:07.961419 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c55dd651-4e44-495c-980c-17c6209cc613 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:07.962330 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c55dd651-4e44-495c-980c-17c6209cc613 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:07.962959 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c55dd651-4e44-495c-980c-17c6209cc613 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:07.963582 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c55dd651-4e44-495c-980c-17c6209cc613 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:08.098951 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d7f119c7-a6bd-4b35-9dcc-69f6047017ec tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64" status: 204 len: 0 microversion: 2.1 time: 0.298766 Sep 10 11:53:08.099882 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1560/3197] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:53:07 2022] DELETE /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:53:08.115022 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0e85571a-1f20-44f0-ba85-4205ed3b1a61 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:08.121416 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0e85571a-1f20-44f0-ba85-4205ed3b1a61 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:08.133597 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e85571a-1f20-44f0-ba85-4205ed3b1a61 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:08.138866 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e85571a-1f20-44f0-ba85-4205ed3b1a61 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:08.139575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e85571a-1f20-44f0-ba85-4205ed3b1a61 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:08.148627 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e85571a-1f20-44f0-ba85-4205ed3b1a61 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:08.149353 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e85571a-1f20-44f0-ba85-4205ed3b1a61 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:08.150185 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e85571a-1f20-44f0-ba85-4205ed3b1a61 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:08.647560 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c55dd651-4e44-495c-980c-17c6209cc613 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:08.671249 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c55dd651-4e44-495c-980c-17c6209cc613 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985" status: 200 len: 1512 microversion: 2.1 time: 0.731093 Sep 10 11:53:08.672197 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1638/3198] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:07 2022] GET /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985 => generated 1512 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:08.676922 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b465341f-a9c0-4271-97ce-f2ca4b38c425 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:08.677411 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b465341f-a9c0-4271-97ce-f2ca4b38c425 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: f2657379-0c39-4338-9d80-51ab6f0e2a64] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:08.695953 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b465341f-a9c0-4271-97ce-f2ca4b38c425 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:08.699598 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b465341f-a9c0-4271-97ce-f2ca4b38c425 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:08.700247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b465341f-a9c0-4271-97ce-f2ca4b38c425 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:08.702983 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b465341f-a9c0-4271-97ce-f2ca4b38c425 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:08.705746 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b465341f-a9c0-4271-97ce-f2ca4b38c425 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:08.706199 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b465341f-a9c0-4271-97ce-f2ca4b38c425 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:08.763810 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b465341f-a9c0-4271-97ce-f2ca4b38c425 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: f2657379-0c39-4338-9d80-51ab6f0e2a64] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:53:08.858910 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:53:08.888365 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.compute.api [None req-b465341f-a9c0-4271-97ce-f2ca4b38c425 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: f2657379-0c39-4338-9d80-51ab6f0e2a64] Instance is already in deleting state, ignoring this request Sep 10 11:53:08.889480 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b465341f-a9c0-4271-97ce-f2ca4b38c425 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64" status: 204 len: 0 microversion: 2.1 time: 0.216331 Sep 10 11:53:08.891368 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1639/3199] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:53:08 2022] DELETE /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:53:08.898624 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-97af1700-9a2e-464b-b988-f8e6a14e5a03 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f407257c160>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:08.950831 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0e85571a-1f20-44f0-ba85-4205ed3b1a61 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:08.965744 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0e85571a-1f20-44f0-ba85-4205ed3b1a61 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:08.969188 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0e85571a-1f20-44f0-ba85-4205ed3b1a61 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:08.982984 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-97af1700-9a2e-464b-b988-f8e6a14e5a03 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/4f0c3346-cd3b-4d5a-bcc9-4f0d2ff31c8b" status: 200 len: 1437 microversion: 2.1 time: 0.089833 Sep 10 11:53:08.983616 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1640/3200] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:53:08 2022] GET /compute/v2.1/images/4f0c3346-cd3b-4d5a-bcc9-4f0d2ff31c8b => generated 1437 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:08.985310 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0e85571a-1f20-44f0-ba85-4205ed3b1a61 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1723 microversion: 2.20 time: 0.869643 Sep 10 11:53:08.996316 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1561/3201] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:53:08 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1723 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:53:09.038312 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e24fbc58-6d67-4d3e-815c-33babba47798 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:09.046512 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ca4637f7-e53e-490f-8b20-a4feda5b8729 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:09.050618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e24fbc58-6d67-4d3e-815c-33babba47798 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: a4dbe5aa-fddd-42e7-b422-1585785f6034] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:09.057845 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ca4637f7-e53e-490f-8b20-a4feda5b8729 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: f2657379-0c39-4338-9d80-51ab6f0e2a64] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:09.070401 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:53:09.074641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e24fbc58-6d67-4d3e-815c-33babba47798 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:09.077006 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e24fbc58-6d67-4d3e-815c-33babba47798 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:09.079440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e24fbc58-6d67-4d3e-815c-33babba47798 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:09.082200 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e24fbc58-6d67-4d3e-815c-33babba47798 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:09.084934 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e24fbc58-6d67-4d3e-815c-33babba47798 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:09.085857 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e24fbc58-6d67-4d3e-815c-33babba47798 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:09.088623 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca4637f7-e53e-490f-8b20-a4feda5b8729 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:09.089129 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca4637f7-e53e-490f-8b20-a4feda5b8729 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:09.089571 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca4637f7-e53e-490f-8b20-a4feda5b8729 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:09.090903 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca4637f7-e53e-490f-8b20-a4feda5b8729 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:09.091557 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca4637f7-e53e-490f-8b20-a4feda5b8729 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:09.094644 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca4637f7-e53e-490f-8b20-a4feda5b8729 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:09.504305 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ca4637f7-e53e-490f-8b20-a4feda5b8729 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:09.508786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e24fbc58-6d67-4d3e-815c-33babba47798 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:09.516994 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ca4637f7-e53e-490f-8b20-a4feda5b8729 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64" status: 200 len: 1513 microversion: 2.1 time: 0.519469 Sep 10 11:53:09.518246 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1562/3202] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:08 2022] GET /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64 => generated 1513 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:09.519877 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e24fbc58-6d67-4d3e-815c-33babba47798 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/a4dbe5aa-fddd-42e7-b422-1585785f6034" status: 200 len: 1513 microversion: 2.1 time: 0.534767 Sep 10 11:53:09.520843 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1641/3203] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:08 2022] GET /compute/v2.1/servers/a4dbe5aa-fddd-42e7-b422-1585785f6034 => generated 1513 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:09.525333 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ca86ec38-4c89-4619-8fa7-c3fd42cd7e56 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:09.531757 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ca86ec38-4c89-4619-8fa7-c3fd42cd7e56 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] [instance: 0ae1b1e1-f970-4d46-8d88-289c96d3f306] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:09.544440 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca86ec38-4c89-4619-8fa7-c3fd42cd7e56 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:09.545242 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca86ec38-4c89-4619-8fa7-c3fd42cd7e56 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:09.545902 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b5683e09-e90d-44e6-abb8-e553c4bc8d8c tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:09.547022 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca86ec38-4c89-4619-8fa7-c3fd42cd7e56 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:09.548563 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca86ec38-4c89-4619-8fa7-c3fd42cd7e56 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:09.549255 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca86ec38-4c89-4619-8fa7-c3fd42cd7e56 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:09.550399 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca86ec38-4c89-4619-8fa7-c3fd42cd7e56 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:09.552659 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b5683e09-e90d-44e6-abb8-e553c4bc8d8c tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:09.553613 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b5683e09-e90d-44e6-abb8-e553c4bc8d8c tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '27bed0cb3a46406b92496bee2da42567'} {{(pid=128777) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 11:53:09.569027 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5683e09-e90d-44e6-abb8-e553c4bc8d8c tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:09.569904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5683e09-e90d-44e6-abb8-e553c4bc8d8c tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:09.570463 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5683e09-e90d-44e6-abb8-e553c4bc8d8c tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:09.571829 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5683e09-e90d-44e6-abb8-e553c4bc8d8c tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:09.573293 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5683e09-e90d-44e6-abb8-e553c4bc8d8c tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:09.573911 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5683e09-e90d-44e6-abb8-e553c4bc8d8c tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:09.588077 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-ca86ec38-4c89-4619-8fa7-c3fd42cd7e56 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] HTTP exception thrown: Instance 0ae1b1e1-f970-4d46-8d88-289c96d3f306 could not be found. Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ca86ec38-4c89-4619-8fa7-c3fd42cd7e56 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Request method failure captured: Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 HTTP/1.1 Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHni5kEqfDd71wacYaoDKARybQC8EPsiTR1opOB53DCUVHyhwLopkvOOgihwMvFq017-SFWph4-DbNPx0jIF9TYhVz3UFElYCeCUoALTBkvYGpo-bK7xNIbys6HSAH90EMjiBofK5sLtDWyFxgV2zV3FcW09ZmlBbQkcAZeRaQFqkkU Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: X-Openstack-Nova-Api-Version: 2.91 Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: c22723baa90a4f1580169a60f93d6664 Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-2123983584 Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c22723baa90a4f1580169a60f93d6664"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c22723baa90a4f1580169a60f93d6664"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c22723baa90a4f1580169a60f93d6664", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c22723baa90a4f1580169a60f93d6664"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-2123983584 Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: c22723baa90a4f1580169a60f93d6664 Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-2123983584 Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-UnshelveToHostMultiNodesTest-2123983584-project Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: d1a99070e3b84f1eb90288db5aaea482 Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-2123983584-project Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 0ae1b1e1-f970-4d46-8d88-289c96d3f306 could not be found. Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '0ae1b1e1-f970-4d46-8d88-289c96d3f306'} Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ae1b1e1-f970-4d46-8d88-289c96d3f306 could not be found. Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ae1b1e1-f970-4d46-8d88-289c96d3f306 could not be found. Sep 10 11:53:09.589824 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:53:09.595920 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:53:09.595920 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:53:09.595920 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:53:09.595920 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:53:09.595920 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:53:09.595920 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:53:09.595920 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:53:09.595920 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ae1b1e1-f970-4d46-8d88-289c96d3f306 could not be found. Sep 10 11:53:09.595920 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:53:09.597759 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ca86ec38-4c89-4619-8fa7-c3fd42cd7e56 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] Returning 404 to user: Instance 0ae1b1e1-f970-4d46-8d88-289c96d3f306 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:53:09.599104 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ca86ec38-4c89-4619-8fa7-c3fd42cd7e56 tempest-UnshelveToHostMultiNodesTest-2123983584 tempest-UnshelveToHostMultiNodesTest-2123983584-project] 10.222.0.23 "GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306" status: 404 len: 111 microversion: 2.91 time: 0.079664 Sep 10 11:53:09.599709 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1563/3204] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:53:09 2022] GET /compute/v2.1/servers/0ae1b1e1-f970-4d46-8d88-289c96d3f306 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:53:09.686103 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.multi_cell_list [None req-b5683e09-e90d-44e6-abb8-e553c4bc8d8c tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128777) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 11:53:09.774466 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b5683e09-e90d-44e6-abb8-e553c4bc8d8c tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:09.781164 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5683e09-e90d-44e6-abb8-e553c4bc8d8c tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:09.782342 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5683e09-e90d-44e6-abb8-e553c4bc8d8c tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:09.783003 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5683e09-e90d-44e6-abb8-e553c4bc8d8c tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:10.001279 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f428028e-5cc2-4c87-8ace-46476b071243 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f4072a485e0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:10.121738 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f428028e-5cc2-4c87-8ace-46476b071243 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/4f0c3346-cd3b-4d5a-bcc9-4f0d2ff31c8b" status: 200 len: 1437 microversion: 2.1 time: 0.127421 Sep 10 11:53:10.125638 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1564/3205] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:53:09 2022] GET /compute/v2.1/images/4f0c3346-cd3b-4d5a-bcc9-4f0d2ff31c8b => generated 1437 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:53:10.137522 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7e6b290f-8df3-4d22-93b4-c424285ccd02 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:10.138948 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7e6b290f-8df3-4d22-93b4-c424285ccd02 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:10.157016 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7e6b290f-8df3-4d22-93b4-c424285ccd02 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:10.159528 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7e6b290f-8df3-4d22-93b4-c424285ccd02 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:10.162482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7e6b290f-8df3-4d22-93b4-c424285ccd02 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:10.167956 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7e6b290f-8df3-4d22-93b4-c424285ccd02 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:10.171333 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7e6b290f-8df3-4d22-93b4-c424285ccd02 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:10.171803 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7e6b290f-8df3-4d22-93b4-c424285ccd02 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:10.542738 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b5683e09-e90d-44e6-abb8-e553c4bc8d8c tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 1.001493 Sep 10 11:53:10.543372 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1642/3206] 10.222.0.23 () {58 vars in 1167 bytes} [Sat Sep 10 11:53:09 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:53:10.555207 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-8ed29221-4e79-4c2c-b30a-bf424e20f76c req-aa6acdf6-d14e-4617-8af9-eebf1e63a59b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c56e3146-bad1-4abf-853a-2d01226d85b4", "name": "network-vif-plugged", "status": "completed", "tag": "0c512e55-530c-4d6d-9d65-364f8052e833"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:53:10.570883 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8ed29221-4e79-4c2c-b30a-bf424e20f76c req-aa6acdf6-d14e-4617-8af9-eebf1e63a59b service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:10.571342 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8ed29221-4e79-4c2c-b30a-bf424e20f76c req-aa6acdf6-d14e-4617-8af9-eebf1e63a59b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:10.574247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8ed29221-4e79-4c2c-b30a-bf424e20f76c req-aa6acdf6-d14e-4617-8af9-eebf1e63a59b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:10.633678 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-8ed29221-4e79-4c2c-b30a-bf424e20f76c req-aa6acdf6-d14e-4617-8af9-eebf1e63a59b service nova] Creating event network-vif-plugged:0c512e55-530c-4d6d-9d65-364f8052e833 for instance c56e3146-bad1-4abf-853a-2d01226d85b4 on n-h2-856895-1 Sep 10 11:53:10.655193 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-8ed29221-4e79-4c2c-b30a-bf424e20f76c req-aa6acdf6-d14e-4617-8af9-eebf1e63a59b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110492 Sep 10 11:53:10.676386 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1643/3207] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:53:10.690112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-906a8998-412a-4f6a-b1c9-9bb587cf2da9 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:10.691960 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-906a8998-412a-4f6a-b1c9-9bb587cf2da9 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: f2657379-0c39-4338-9d80-51ab6f0e2a64] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:10.714155 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-906a8998-412a-4f6a-b1c9-9bb587cf2da9 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:10.716946 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-906a8998-412a-4f6a-b1c9-9bb587cf2da9 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:10.719884 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-906a8998-412a-4f6a-b1c9-9bb587cf2da9 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:10.720665 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-906a8998-412a-4f6a-b1c9-9bb587cf2da9 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:10.722330 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-906a8998-412a-4f6a-b1c9-9bb587cf2da9 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:10.724116 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-906a8998-412a-4f6a-b1c9-9bb587cf2da9 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:10.852637 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7e6b290f-8df3-4d22-93b4-c424285ccd02 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:10.871536 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7e6b290f-8df3-4d22-93b4-c424285ccd02 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:10.873434 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7e6b290f-8df3-4d22-93b4-c424285ccd02 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:10.875780 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7e6b290f-8df3-4d22-93b4-c424285ccd02 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1723 microversion: 2.20 time: 0.748727 Sep 10 11:53:10.922562 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1565/3208] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:53:10 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1723 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:53:10.935728 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-635d91dc-0bb8-4776-b0b5-811084e0c4a1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:10.954881 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-635d91dc-0bb8-4776-b0b5-811084e0c4a1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:10.955911 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-635d91dc-0bb8-4776-b0b5-811084e0c4a1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1351033987', 'deleted': False, 'project_id': '27bed0cb3a46406b92496bee2da42567'} {{(pid=128776) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 11:53:10.970647 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-635d91dc-0bb8-4776-b0b5-811084e0c4a1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:10.971140 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-635d91dc-0bb8-4776-b0b5-811084e0c4a1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:10.971620 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-635d91dc-0bb8-4776-b0b5-811084e0c4a1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:10.972354 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-635d91dc-0bb8-4776-b0b5-811084e0c4a1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:10.973309 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-635d91dc-0bb8-4776-b0b5-811084e0c4a1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:10.973987 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-635d91dc-0bb8-4776-b0b5-811084e0c4a1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:11.177511 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-906a8998-412a-4f6a-b1c9-9bb587cf2da9 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:11.186403 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-906a8998-412a-4f6a-b1c9-9bb587cf2da9 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64" status: 200 len: 1513 microversion: 2.1 time: 0.508313 Sep 10 11:53:11.191920 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1644/3209] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:10 2022] GET /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64 => generated 1513 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:11.206973 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5e1faae3-a415-4c0a-a8f7-cecca203438d tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f4072529d30>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:11.282502 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5e1faae3-a415-4c0a-a8f7-cecca203438d tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/4f0c3346-cd3b-4d5a-bcc9-4f0d2ff31c8b" status: 200 len: 1437 microversion: 2.1 time: 0.089131 Sep 10 11:53:11.283267 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1645/3210] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:53:11 2022] GET /compute/v2.1/images/4f0c3346-cd3b-4d5a-bcc9-4f0d2ff31c8b => generated 1437 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:11.303540 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.multi_cell_list [None req-635d91dc-0bb8-4776-b0b5-811084e0c4a1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128776) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 11:53:11.467534 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-635d91dc-0bb8-4776-b0b5-811084e0c4a1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:11.479057 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-635d91dc-0bb8-4776-b0b5-811084e0c4a1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:11.479729 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-635d91dc-0bb8-4776-b0b5-811084e0c4a1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:11.485953 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-635d91dc-0bb8-4776-b0b5-811084e0c4a1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:11.517324 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-0e7ceb7e-23bd-49d4-b0a0-8867408287ab req-7004fa01-960a-4cfe-ac03-e33715587ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2657379-0c39-4338-9d80-51ab6f0e2a64", "name": "network-vif-deleted", "tag": "47100703-ef79-435f-8e7d-d7d58dd5558c"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:53:11.550181 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0e7ceb7e-23bd-49d4-b0a0-8867408287ab req-7004fa01-960a-4cfe-ac03-e33715587ef5 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:11.559736 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0e7ceb7e-23bd-49d4-b0a0-8867408287ab req-7004fa01-960a-4cfe-ac03-e33715587ef5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:11.560387 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0e7ceb7e-23bd-49d4-b0a0-8867408287ab req-7004fa01-960a-4cfe-ac03-e33715587ef5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:11.598452 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-0e7ceb7e-23bd-49d4-b0a0-8867408287ab req-7004fa01-960a-4cfe-ac03-e33715587ef5 service nova] Creating event network-vif-deleted:47100703-ef79-435f-8e7d-d7d58dd5558c for instance f2657379-0c39-4338-9d80-51ab6f0e2a64 on n-h2-856895-1 Sep 10 11:53:11.602738 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-0e7ceb7e-23bd-49d4-b0a0-8867408287ab req-7004fa01-960a-4cfe-ac03-e33715587ef5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089498 Sep 10 11:53:11.603625 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1646/3211] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:53:11.906501 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d234a6e6-36b5-4ce6-a098-45906ec272f1 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:11.908109 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d234a6e6-36b5-4ce6-a098-45906ec272f1 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:11.915156 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d234a6e6-36b5-4ce6-a098-45906ec272f1 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:11.915677 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d234a6e6-36b5-4ce6-a098-45906ec272f1 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:11.916113 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d234a6e6-36b5-4ce6-a098-45906ec272f1 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:11.916824 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d234a6e6-36b5-4ce6-a098-45906ec272f1 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:11.917308 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d234a6e6-36b5-4ce6-a098-45906ec272f1 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:11.917738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d234a6e6-36b5-4ce6-a098-45906ec272f1 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:11.945664 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-635d91dc-0bb8-4776-b0b5-811084e0c4a1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1351033987" status: 200 len: 1515 microversion: 2.1 time: 1.020497 Sep 10 11:53:11.946670 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1566/3212] 10.222.0.23 () {58 vars in 1263 bytes} [Sat Sep 10 11:53:10 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1351033987 => generated 1515 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:11.974960 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2dbc94bc-b797-4bae-9a1f-71ac1affc115 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:11.987985 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2dbc94bc-b797-4bae-9a1f-71ac1affc115 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:12.005640 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2dbc94bc-b797-4bae-9a1f-71ac1affc115 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '27bed0cb3a46406b92496bee2da42567'} {{(pid=128776) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 11:53:12.020101 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2dbc94bc-b797-4bae-9a1f-71ac1affc115 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:12.020778 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2dbc94bc-b797-4bae-9a1f-71ac1affc115 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:12.021403 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2dbc94bc-b797-4bae-9a1f-71ac1affc115 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:12.033774 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2dbc94bc-b797-4bae-9a1f-71ac1affc115 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:12.034587 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2dbc94bc-b797-4bae-9a1f-71ac1affc115 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:12.035235 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2dbc94bc-b797-4bae-9a1f-71ac1affc115 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:12.288141 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.multi_cell_list [None req-2dbc94bc-b797-4bae-9a1f-71ac1affc115 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128776) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 11:53:12.337945 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d234a6e6-36b5-4ce6-a098-45906ec272f1 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:12.349321 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d234a6e6-36b5-4ce6-a098-45906ec272f1 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:12.350781 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d234a6e6-36b5-4ce6-a098-45906ec272f1 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:12.362970 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d234a6e6-36b5-4ce6-a098-45906ec272f1 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1723 microversion: 2.20 time: 0.460873 Sep 10 11:53:12.367983 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1647/3213] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:53:11 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1723 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:53:12.374605 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-048f8abc-38f3-45eb-9227-cbb23bb9c4e2 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:12.393505 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-048f8abc-38f3-45eb-9227-cbb23bb9c4e2 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: f2657379-0c39-4338-9d80-51ab6f0e2a64] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:12.407547 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-048f8abc-38f3-45eb-9227-cbb23bb9c4e2 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:12.408223 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-048f8abc-38f3-45eb-9227-cbb23bb9c4e2 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:12.411367 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-048f8abc-38f3-45eb-9227-cbb23bb9c4e2 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:12.415821 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-048f8abc-38f3-45eb-9227-cbb23bb9c4e2 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:12.416404 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-048f8abc-38f3-45eb-9227-cbb23bb9c4e2 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:12.416915 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-048f8abc-38f3-45eb-9227-cbb23bb9c4e2 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:12.451058 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2dbc94bc-b797-4bae-9a1f-71ac1affc115 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:12.459870 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2dbc94bc-b797-4bae-9a1f-71ac1affc115 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:12.460608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2dbc94bc-b797-4bae-9a1f-71ac1affc115 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:12.461246 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2dbc94bc-b797-4bae-9a1f-71ac1affc115 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:12.526640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-048f8abc-38f3-45eb-9227-cbb23bb9c4e2 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:12.527134 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-048f8abc-38f3-45eb-9227-cbb23bb9c4e2 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:12.527596 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-048f8abc-38f3-45eb-9227-cbb23bb9c4e2 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:12.528053 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-048f8abc-38f3-45eb-9227-cbb23bb9c4e2 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lazy-loading 'fault' on Instance uuid f2657379-0c39-4338-9d80-51ab6f0e2a64 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:53:12.883819 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-048f8abc-38f3-45eb-9227-cbb23bb9c4e2 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1673c19f6ab545a18897858acf56f762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689e03cda40d4be5ab9fe3fe20ca8d97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:12.913366 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-048f8abc-38f3-45eb-9227-cbb23bb9c4e2 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64" status: 200 len: 1307 microversion: 2.1 time: 0.536829 Sep 10 11:53:12.915203 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1648/3214] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:12 2022] GET /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64 => generated 1307 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:12.935962 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8305cdb5-287c-4c9e-9187-d2bb9e10afbb tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f40724155e0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:13.045974 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8305cdb5-287c-4c9e-9187-d2bb9e10afbb tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/4f0c3346-cd3b-4d5a-bcc9-4f0d2ff31c8b" status: 200 len: 1437 microversion: 2.1 time: 0.101721 Sep 10 11:53:13.045974 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1649/3215] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:53:12 2022] GET /compute/v2.1/images/4f0c3346-cd3b-4d5a-bcc9-4f0d2ff31c8b => generated 1437 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:13.259469 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2dbc94bc-b797-4bae-9a1f-71ac1affc115 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4519 microversion: 2.1 time: 1.288741 Sep 10 11:53:13.260065 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1567/3216] 10.222.0.23 () {58 vars in 1173 bytes} [Sat Sep 10 11:53:11 2022] GET /compute/v2.1/servers/detail?status=active => generated 4519 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:13.293836 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3e90db0a-bcd8-4361-92c6-ab67ac347d87 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:13.312010 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3e90db0a-bcd8-4361-92c6-ab67ac347d87 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:13.318546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.compute.servers [None req-3e90db0a-bcd8-4361-92c6-ab67ac347d87 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Removing options 'limit' from query {{(pid=128777) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 10 11:53:13.320062 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3e90db0a-bcd8-4361-92c6-ab67ac347d87 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Searching by: {'deleted': False, 'project_id': '27bed0cb3a46406b92496bee2da42567'} {{(pid=128777) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 11:53:13.329288 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e90db0a-bcd8-4361-92c6-ab67ac347d87 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:13.331401 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e90db0a-bcd8-4361-92c6-ab67ac347d87 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:13.332203 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e90db0a-bcd8-4361-92c6-ab67ac347d87 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:13.335251 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e90db0a-bcd8-4361-92c6-ab67ac347d87 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:13.336264 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e90db0a-bcd8-4361-92c6-ab67ac347d87 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:13.337538 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e90db0a-bcd8-4361-92c6-ab67ac347d87 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:13.399510 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5b07ae16-58c5-43a8-ab79-d707307bcaf5 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:13.400171 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5b07ae16-58c5-43a8-ab79-d707307bcaf5 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:13.403965 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3e90db0a-bcd8-4361-92c6-ab67ac347d87 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:13.411454 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b07ae16-58c5-43a8-ab79-d707307bcaf5 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:13.411958 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b07ae16-58c5-43a8-ab79-d707307bcaf5 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:13.414514 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b07ae16-58c5-43a8-ab79-d707307bcaf5 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:13.415478 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b07ae16-58c5-43a8-ab79-d707307bcaf5 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:13.416005 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b07ae16-58c5-43a8-ab79-d707307bcaf5 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:13.416377 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b07ae16-58c5-43a8-ab79-d707307bcaf5 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:13.434545 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e90db0a-bcd8-4361-92c6-ab67ac347d87 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:13.438646 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e90db0a-bcd8-4361-92c6-ab67ac347d87 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:13.443203 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e90db0a-bcd8-4361-92c6-ab67ac347d87 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:13.868990 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3e90db0a-bcd8-4361-92c6-ab67ac347d87 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.582836 Sep 10 11:53:13.870874 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1650/3217] 10.222.0.23 () {58 vars in 1161 bytes} [Sat Sep 10 11:53:13 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:13.885254 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5b07ae16-58c5-43a8-ab79-d707307bcaf5 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:13.895963 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-29b5e487-27c8-4e09-91b2-2dd0a91a5b14 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:13.897045 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:53:13.903431 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5b07ae16-58c5-43a8-ab79-d707307bcaf5 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:13.904756 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-29b5e487-27c8-4e09-91b2-2dd0a91a5b14 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:13.904934 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5b07ae16-58c5-43a8-ab79-d707307bcaf5 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:13.905909 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-29b5e487-27c8-4e09-91b2-2dd0a91a5b14 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '27bed0cb3a46406b92496bee2da42567'} {{(pid=128777) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 11:53:13.908759 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5b07ae16-58c5-43a8-ab79-d707307bcaf5 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1723 microversion: 2.20 time: 0.515642 Sep 10 11:53:13.909355 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1568/3218] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:53:13 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1723 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:53:13.930020 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29b5e487-27c8-4e09-91b2-2dd0a91a5b14 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:13.930020 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29b5e487-27c8-4e09-91b2-2dd0a91a5b14 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:13.930020 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29b5e487-27c8-4e09-91b2-2dd0a91a5b14 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:13.930908 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29b5e487-27c8-4e09-91b2-2dd0a91a5b14 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:13.939939 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29b5e487-27c8-4e09-91b2-2dd0a91a5b14 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:13.940400 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29b5e487-27c8-4e09-91b2-2dd0a91a5b14 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:13.942186 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a88f42e6-0183-4322-a9c4-66616c39ca5f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:13.946383 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a88f42e6-0183-4322-a9c4-66616c39ca5f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: f2657379-0c39-4338-9d80-51ab6f0e2a64] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:13.974660 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a88f42e6-0183-4322-a9c4-66616c39ca5f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:13.975229 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a88f42e6-0183-4322-a9c4-66616c39ca5f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:13.975688 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a88f42e6-0183-4322-a9c4-66616c39ca5f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:13.985133 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a88f42e6-0183-4322-a9c4-66616c39ca5f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:13.985685 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a88f42e6-0183-4322-a9c4-66616c39ca5f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:13.986144 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a88f42e6-0183-4322-a9c4-66616c39ca5f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:14.043057 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-a88f42e6-0183-4322-a9c4-66616c39ca5f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] HTTP exception thrown: Instance f2657379-0c39-4338-9d80-51ab6f0e2a64 could not be found. Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a88f42e6-0183-4322-a9c4-66616c39ca5f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Request method failure captured: Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64 HTTP/1.1 Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHnyjk1R9t-5DHC6kY_A9D2O1Zl8X53NuPG2n4D1IOW3moqGynYBml4LEyE5FNO-62PUkXNynQHGzCw-qf-zMlpB3JMPQuAsiCGPRNioJOd8jJCtv3UckIkgwTp8gkBXRK9rXBVT1Q3QYs48lyHhES3PSwQubIvjBW9-helLgcRIino Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 689e03cda40d4be5ab9fe3fe20ca8d97 Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1491069582 Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/689e03cda40d4be5ab9fe3fe20ca8d97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/689e03cda40d4be5ab9fe3fe20ca8d97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_689e03cda40d4be5ab9fe3fe20ca8d97", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/689e03cda40d4be5ab9fe3fe20ca8d97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServerDiskConfigTestJSON-1491069582 Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 689e03cda40d4be5ab9fe3fe20ca8d97 Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1491069582 Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServerDiskConfigTestJSON-1491069582-project Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 1673c19f6ab545a18897858acf56f762 Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServerDiskConfigTestJSON-1491069582-project Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance f2657379-0c39-4338-9d80-51ab6f0e2a64 could not be found. Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'f2657379-0c39-4338-9d80-51ab6f0e2a64'} Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2657379-0c39-4338-9d80-51ab6f0e2a64 could not be found. Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2657379-0c39-4338-9d80-51ab6f0e2a64 could not be found. Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:53:14.055404 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:53:14.059931 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:53:14.059931 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:53:14.059931 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:53:14.059931 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:53:14.059931 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:53:14.059931 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2657379-0c39-4338-9d80-51ab6f0e2a64 could not be found. Sep 10 11:53:14.059931 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:53:14.059931 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a88f42e6-0183-4322-a9c4-66616c39ca5f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Returning 404 to user: Instance f2657379-0c39-4338-9d80-51ab6f0e2a64 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:53:14.059931 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a88f42e6-0183-4322-a9c4-66616c39ca5f tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64" status: 404 len: 111 microversion: 2.1 time: 0.123117 Sep 10 11:53:14.064568 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1569/3219] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:13 2022] GET /compute/v2.1/servers/f2657379-0c39-4338-9d80-51ab6f0e2a64 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:53:14.075324 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1009c933-46a4-47a5-950c-bf4b3323c831 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f40733bf8b0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:14.169157 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1009c933-46a4-47a5-950c-bf4b3323c831 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/4f0c3346-cd3b-4d5a-bcc9-4f0d2ff31c8b" status: 200 len: 1437 microversion: 2.1 time: 0.103291 Sep 10 11:53:14.170092 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1570/3220] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:53:14 2022] GET /compute/v2.1/images/4f0c3346-cd3b-4d5a-bcc9-4f0d2ff31c8b => generated 1437 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:14.176323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-58989097-d09e-4aed-a2c8-486b956d3e27 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:14.177159 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-58989097-d09e-4aed-a2c8-486b956d3e27 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:14.188484 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-58989097-d09e-4aed-a2c8-486b956d3e27 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:14.189470 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-58989097-d09e-4aed-a2c8-486b956d3e27 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:14.190089 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-58989097-d09e-4aed-a2c8-486b956d3e27 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:14.191034 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-58989097-d09e-4aed-a2c8-486b956d3e27 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:14.194246 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-58989097-d09e-4aed-a2c8-486b956d3e27 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:14.194246 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-58989097-d09e-4aed-a2c8-486b956d3e27 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:14.204340 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.multi_cell_list [None req-29b5e487-27c8-4e09-91b2-2dd0a91a5b14 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128777) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 11:53:14.211550 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-58989097-d09e-4aed-a2c8-486b956d3e27 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] HTTP exception thrown: Instance d4cf27c4-4cda-46f0-94b9-f862994d2071 could not be found. Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-58989097-d09e-4aed-a2c8-486b956d3e27 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Request method failure captured: Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 HTTP/1.1 Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHnyjk1R9t-5DHC6kY_A9D2O1Zl8X53NuPG2n4D1IOW3moqGynYBml4LEyE5FNO-62PUkXNynQHGzCw-qf-zMlpB3JMPQuAsiCGPRNioJOd8jJCtv3UckIkgwTp8gkBXRK9rXBVT1Q3QYs48lyHhES3PSwQubIvjBW9-helLgcRIino Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 689e03cda40d4be5ab9fe3fe20ca8d97 Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1491069582 Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/689e03cda40d4be5ab9fe3fe20ca8d97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/689e03cda40d4be5ab9fe3fe20ca8d97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_689e03cda40d4be5ab9fe3fe20ca8d97", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/689e03cda40d4be5ab9fe3fe20ca8d97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServerDiskConfigTestJSON-1491069582 Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 689e03cda40d4be5ab9fe3fe20ca8d97 Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1491069582 Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServerDiskConfigTestJSON-1491069582-project Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 1673c19f6ab545a18897858acf56f762 Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServerDiskConfigTestJSON-1491069582-project Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance d4cf27c4-4cda-46f0-94b9-f862994d2071 could not be found. Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'd4cf27c4-4cda-46f0-94b9-f862994d2071'} Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4cf27c4-4cda-46f0-94b9-f862994d2071 could not be found. Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:53:14.213732 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:53:14.219980 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4cf27c4-4cda-46f0-94b9-f862994d2071 could not be found. Sep 10 11:53:14.219980 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:53:14.219980 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:53:14.219980 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:53:14.219980 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:53:14.219980 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:53:14.219980 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:53:14.219980 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:53:14.219980 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:53:14.219980 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4cf27c4-4cda-46f0-94b9-f862994d2071 could not be found. Sep 10 11:53:14.219980 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:53:14.222427 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-58989097-d09e-4aed-a2c8-486b956d3e27 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Returning 404 to user: Instance d4cf27c4-4cda-46f0-94b9-f862994d2071 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:53:14.224007 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-58989097-d09e-4aed-a2c8-486b956d3e27 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 404 len: 111 microversion: 2.1 time: 0.052680 Sep 10 11:53:14.228313 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1571/3221] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:53:14 2022] DELETE /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:53:14.239026 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3987b5b4-1747-46c0-a6b9-653ddb646c70 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:14.240786 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3987b5b4-1747-46c0-a6b9-653ddb646c70 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: d4cf27c4-4cda-46f0-94b9-f862994d2071] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:14.253502 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3987b5b4-1747-46c0-a6b9-653ddb646c70 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:14.254821 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3987b5b4-1747-46c0-a6b9-653ddb646c70 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:14.255547 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3987b5b4-1747-46c0-a6b9-653ddb646c70 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:14.256495 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3987b5b4-1747-46c0-a6b9-653ddb646c70 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:14.257254 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3987b5b4-1747-46c0-a6b9-653ddb646c70 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:14.257916 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3987b5b4-1747-46c0-a6b9-653ddb646c70 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:14.279998 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-3987b5b4-1747-46c0-a6b9-653ddb646c70 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] HTTP exception thrown: Instance d4cf27c4-4cda-46f0-94b9-f862994d2071 could not be found. Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3987b5b4-1747-46c0-a6b9-653ddb646c70 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Request method failure captured: Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 HTTP/1.1 Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHnyjk1R9t-5DHC6kY_A9D2O1Zl8X53NuPG2n4D1IOW3moqGynYBml4LEyE5FNO-62PUkXNynQHGzCw-qf-zMlpB3JMPQuAsiCGPRNioJOd8jJCtv3UckIkgwTp8gkBXRK9rXBVT1Q3QYs48lyHhES3PSwQubIvjBW9-helLgcRIino Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 689e03cda40d4be5ab9fe3fe20ca8d97 Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1491069582 Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/689e03cda40d4be5ab9fe3fe20ca8d97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/689e03cda40d4be5ab9fe3fe20ca8d97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_689e03cda40d4be5ab9fe3fe20ca8d97", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/689e03cda40d4be5ab9fe3fe20ca8d97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServerDiskConfigTestJSON-1491069582 Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 689e03cda40d4be5ab9fe3fe20ca8d97 Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1491069582 Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServerDiskConfigTestJSON-1491069582-project Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 1673c19f6ab545a18897858acf56f762 Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServerDiskConfigTestJSON-1491069582-project Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance d4cf27c4-4cda-46f0-94b9-f862994d2071 could not be found. Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'd4cf27c4-4cda-46f0-94b9-f862994d2071'} Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4cf27c4-4cda-46f0-94b9-f862994d2071 could not be found. Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4cf27c4-4cda-46f0-94b9-f862994d2071 could not be found. Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:53:14.281914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:53:14.286377 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:53:14.286377 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:53:14.286377 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:53:14.286377 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:53:14.286377 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:53:14.286377 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4cf27c4-4cda-46f0-94b9-f862994d2071 could not be found. Sep 10 11:53:14.286377 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:53:14.288910 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3987b5b4-1747-46c0-a6b9-653ddb646c70 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Returning 404 to user: Instance d4cf27c4-4cda-46f0-94b9-f862994d2071 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:53:14.290190 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3987b5b4-1747-46c0-a6b9-653ddb646c70 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071" status: 404 len: 111 microversion: 2.1 time: 0.060160 Sep 10 11:53:14.298494 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1572/3222] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:14 2022] GET /compute/v2.1/servers/d4cf27c4-4cda-46f0-94b9-f862994d2071 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:53:14.313596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a8a36d22-8585-4268-8227-b28b7a9b56c2 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:14.314103 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a8a36d22-8585-4268-8227-b28b7a9b56c2 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: 3b2dc8b3-1049-4393-824f-b9786315d5ad] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:14.330352 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8a36d22-8585-4268-8227-b28b7a9b56c2 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:14.331823 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8a36d22-8585-4268-8227-b28b7a9b56c2 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:14.332531 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8a36d22-8585-4268-8227-b28b7a9b56c2 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:14.333776 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8a36d22-8585-4268-8227-b28b7a9b56c2 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:14.334572 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8a36d22-8585-4268-8227-b28b7a9b56c2 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:14.335274 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8a36d22-8585-4268-8227-b28b7a9b56c2 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:14.356464 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-a8a36d22-8585-4268-8227-b28b7a9b56c2 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] HTTP exception thrown: Instance 3b2dc8b3-1049-4393-824f-b9786315d5ad could not be found. Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a8a36d22-8585-4268-8227-b28b7a9b56c2 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Request method failure captured: Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad HTTP/1.1 Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHnyjk1R9t-5DHC6kY_A9D2O1Zl8X53NuPG2n4D1IOW3moqGynYBml4LEyE5FNO-62PUkXNynQHGzCw-qf-zMlpB3JMPQuAsiCGPRNioJOd8jJCtv3UckIkgwTp8gkBXRK9rXBVT1Q3QYs48lyHhES3PSwQubIvjBW9-helLgcRIino Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 689e03cda40d4be5ab9fe3fe20ca8d97 Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1491069582 Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/689e03cda40d4be5ab9fe3fe20ca8d97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/689e03cda40d4be5ab9fe3fe20ca8d97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_689e03cda40d4be5ab9fe3fe20ca8d97", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/689e03cda40d4be5ab9fe3fe20ca8d97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServerDiskConfigTestJSON-1491069582 Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 689e03cda40d4be5ab9fe3fe20ca8d97 Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1491069582 Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServerDiskConfigTestJSON-1491069582-project Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 1673c19f6ab545a18897858acf56f762 Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServerDiskConfigTestJSON-1491069582-project Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 3b2dc8b3-1049-4393-824f-b9786315d5ad could not be found. Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '3b2dc8b3-1049-4393-824f-b9786315d5ad'} Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b2dc8b3-1049-4393-824f-b9786315d5ad could not be found. Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:53:14.358800 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:53:14.364212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b2dc8b3-1049-4393-824f-b9786315d5ad could not be found. Sep 10 11:53:14.364212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:53:14.364212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:53:14.364212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:53:14.364212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:53:14.364212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:53:14.364212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:53:14.364212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:53:14.364212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:53:14.364212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b2dc8b3-1049-4393-824f-b9786315d5ad could not be found. Sep 10 11:53:14.364212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:53:14.368239 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a8a36d22-8585-4268-8227-b28b7a9b56c2 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Returning 404 to user: Instance 3b2dc8b3-1049-4393-824f-b9786315d5ad could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:53:14.369518 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a8a36d22-8585-4268-8227-b28b7a9b56c2 tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad" status: 404 len: 111 microversion: 2.1 time: 0.071055 Sep 10 11:53:14.374076 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1573/3223] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:53:14 2022] DELETE /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:53:14.379584 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ba983331-a647-4566-99a1-c2eb842b59ec tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:14.380155 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ba983331-a647-4566-99a1-c2eb842b59ec tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] [instance: 3b2dc8b3-1049-4393-824f-b9786315d5ad] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:14.385182 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-29b5e487-27c8-4e09-91b2-2dd0a91a5b14 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.492963 Sep 10 11:53:14.387456 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1651/3224] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Sep 10 11:53:13 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:53:14.402546 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ba983331-a647-4566-99a1-c2eb842b59ec tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:14.403493 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ba983331-a647-4566-99a1-c2eb842b59ec tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:14.404358 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ba983331-a647-4566-99a1-c2eb842b59ec tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:14.406075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-896b2cf8-272b-4385-b953-52af43a203d9 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:14.406233 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ba983331-a647-4566-99a1-c2eb842b59ec tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:14.408964 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ba983331-a647-4566-99a1-c2eb842b59ec tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:14.410406 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ba983331-a647-4566-99a1-c2eb842b59ec tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:14.411788 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-896b2cf8-272b-4385-b953-52af43a203d9 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:14.412242 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.compute.servers [None req-896b2cf8-272b-4385-b953-52af43a203d9 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Removing options 'limit' from query {{(pid=128777) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 10 11:53:14.427471 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-896b2cf8-272b-4385-b953-52af43a203d9 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Searching by: {'deleted': False, 'project_id': '27bed0cb3a46406b92496bee2da42567'} {{(pid=128777) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 11:53:14.439235 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-ba983331-a647-4566-99a1-c2eb842b59ec tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] HTTP exception thrown: Instance 3b2dc8b3-1049-4393-824f-b9786315d5ad could not be found. Sep 10 11:53:14.440769 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-896b2cf8-272b-4385-b953-52af43a203d9 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:14.441263 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-896b2cf8-272b-4385-b953-52af43a203d9 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:14.441748 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-896b2cf8-272b-4385-b953-52af43a203d9 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ba983331-a647-4566-99a1-c2eb842b59ec tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Request method failure captured: Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad HTTP/1.1 Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHnyjk1R9t-5DHC6kY_A9D2O1Zl8X53NuPG2n4D1IOW3moqGynYBml4LEyE5FNO-62PUkXNynQHGzCw-qf-zMlpB3JMPQuAsiCGPRNioJOd8jJCtv3UckIkgwTp8gkBXRK9rXBVT1Q3QYs48lyHhES3PSwQubIvjBW9-helLgcRIino Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 689e03cda40d4be5ab9fe3fe20ca8d97 Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1491069582 Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/689e03cda40d4be5ab9fe3fe20ca8d97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/689e03cda40d4be5ab9fe3fe20ca8d97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_689e03cda40d4be5ab9fe3fe20ca8d97", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/689e03cda40d4be5ab9fe3fe20ca8d97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServerDiskConfigTestJSON-1491069582 Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 689e03cda40d4be5ab9fe3fe20ca8d97 Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1491069582 Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServerDiskConfigTestJSON-1491069582-project Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 1673c19f6ab545a18897858acf56f762 Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServerDiskConfigTestJSON-1491069582-project Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 3b2dc8b3-1049-4393-824f-b9786315d5ad could not be found. Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '3b2dc8b3-1049-4393-824f-b9786315d5ad'} Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b2dc8b3-1049-4393-824f-b9786315d5ad could not be found. Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b2dc8b3-1049-4393-824f-b9786315d5ad could not be found. Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:53:14.442124 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:53:14.446680 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:53:14.446680 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:53:14.446680 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:53:14.446680 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:53:14.446680 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:53:14.446680 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b2dc8b3-1049-4393-824f-b9786315d5ad could not be found. Sep 10 11:53:14.446680 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:53:14.447826 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-896b2cf8-272b-4385-b953-52af43a203d9 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:14.447826 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-896b2cf8-272b-4385-b953-52af43a203d9 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:14.447826 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-896b2cf8-272b-4385-b953-52af43a203d9 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:14.449768 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ba983331-a647-4566-99a1-c2eb842b59ec tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] Returning 404 to user: Instance 3b2dc8b3-1049-4393-824f-b9786315d5ad could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:53:14.451253 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ba983331-a647-4566-99a1-c2eb842b59ec tempest-ServerDiskConfigTestJSON-1491069582 tempest-ServerDiskConfigTestJSON-1491069582-project] 10.222.0.23 "GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad" status: 404 len: 111 microversion: 2.1 time: 0.075253 Sep 10 11:53:14.467690 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1574/3225] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:14 2022] GET /compute/v2.1/servers/3b2dc8b3-1049-4393-824f-b9786315d5ad => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:53:14.508380 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.multi_cell_list [None req-896b2cf8-272b-4385-b953-52af43a203d9 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128777) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 11:53:14.549699 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-896b2cf8-272b-4385-b953-52af43a203d9 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.151026 Sep 10 11:53:14.563539 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f49bd60b-90fa-437a-9ace-88305040e373 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:14.567692 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1652/3226] 10.222.0.23 () {58 vars in 1150 bytes} [Sat Sep 10 11:53:14 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:53:14.569813 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f49bd60b-90fa-437a-9ace-88305040e373 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:14.571709 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f49bd60b-90fa-437a-9ace-88305040e373 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Searching by: {'deleted': False, 'project_id': '27bed0cb3a46406b92496bee2da42567'} {{(pid=128776) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 11:53:14.580374 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f49bd60b-90fa-437a-9ace-88305040e373 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:14.581278 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f49bd60b-90fa-437a-9ace-88305040e373 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:14.581881 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f49bd60b-90fa-437a-9ace-88305040e373 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:14.582783 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f49bd60b-90fa-437a-9ace-88305040e373 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:14.583439 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f49bd60b-90fa-437a-9ace-88305040e373 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:14.584047 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f49bd60b-90fa-437a-9ace-88305040e373 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:14.615119 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.multi_cell_list [None req-f49bd60b-90fa-437a-9ace-88305040e373 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128776) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 11:53:14.656382 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f49bd60b-90fa-437a-9ace-88305040e373 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.097662 Sep 10 11:53:14.672493 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-45c2f79f-dab6-4a6a-8b73-9c51164734a9 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:14.677876 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1575/3227] 10.222.0.23 () {58 vars in 1125 bytes} [Sat Sep 10 11:53:14 2022] GET /compute/v2.1/servers => generated 1011 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:14.678619 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-45c2f79f-dab6-4a6a-8b73-9c51164734a9 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:14.679499 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-45c2f79f-dab6-4a6a-8b73-9c51164734a9 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '27bed0cb3a46406b92496bee2da42567'} {{(pid=128777) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 11:53:14.699409 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-45c2f79f-dab6-4a6a-8b73-9c51164734a9 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:14.700287 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-45c2f79f-dab6-4a6a-8b73-9c51164734a9 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:14.701442 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-45c2f79f-dab6-4a6a-8b73-9c51164734a9 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:14.702405 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-45c2f79f-dab6-4a6a-8b73-9c51164734a9 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:14.703084 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-45c2f79f-dab6-4a6a-8b73-9c51164734a9 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:14.703805 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-45c2f79f-dab6-4a6a-8b73-9c51164734a9 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:14.845829 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.multi_cell_list [None req-45c2f79f-dab6-4a6a-8b73-9c51164734a9 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128777) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 11:53:14.939953 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a6802b72-9990-493d-b03e-fc1cb5a3059e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:14.941357 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a6802b72-9990-493d-b03e-fc1cb5a3059e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:14.958162 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6802b72-9990-493d-b03e-fc1cb5a3059e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:14.962374 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6802b72-9990-493d-b03e-fc1cb5a3059e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:14.965720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6802b72-9990-493d-b03e-fc1cb5a3059e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:14.969926 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6802b72-9990-493d-b03e-fc1cb5a3059e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:14.970808 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6802b72-9990-493d-b03e-fc1cb5a3059e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:14.974819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6802b72-9990-493d-b03e-fc1cb5a3059e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:15.438698 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-45c2f79f-dab6-4a6a-8b73-9c51164734a9 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.771818 Sep 10 11:53:15.440338 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1653/3228] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:53:14 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:53:15.445255 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-88caa9c9-942c-43c6-9ed8-7cadcc2403b9 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f40724ec3a0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:15.525521 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-88caa9c9-942c-43c6-9ed8-7cadcc2403b9 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/4f0c3346-cd3b-4d5a-bcc9-4f0d2ff31c8b" status: 200 len: 1437 microversion: 2.1 time: 0.083772 Sep 10 11:53:15.526537 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1654/3229] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:53:15 2022] GET /compute/v2.1/images/4f0c3346-cd3b-4d5a-bcc9-4f0d2ff31c8b => generated 1437 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:15.539255 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3815472b-e0b3-41d7-aa3a-f465bec474e7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:15.552233 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3815472b-e0b3-41d7-aa3a-f465bec474e7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:15.555464 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.compute.servers [None req-3815472b-e0b3-41d7-aa3a-f465bec474e7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Removing options 'limit' from query {{(pid=128777) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 10 11:53:15.559093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3815472b-e0b3-41d7-aa3a-f465bec474e7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Searching by: {'deleted': False, 'project_id': '27bed0cb3a46406b92496bee2da42567'} {{(pid=128777) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 11:53:15.575356 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3815472b-e0b3-41d7-aa3a-f465bec474e7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:15.576232 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3815472b-e0b3-41d7-aa3a-f465bec474e7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:15.576887 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3815472b-e0b3-41d7-aa3a-f465bec474e7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:15.580327 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3815472b-e0b3-41d7-aa3a-f465bec474e7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:15.582474 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3815472b-e0b3-41d7-aa3a-f465bec474e7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:15.583254 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3815472b-e0b3-41d7-aa3a-f465bec474e7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:15.647086 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3815472b-e0b3-41d7-aa3a-f465bec474e7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.118823 Sep 10 11:53:15.650848 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1655/3230] 10.222.0.23 () {58 vars in 1140 bytes} [Sat Sep 10 11:53:15 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:53:15.655633 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a6802b72-9990-493d-b03e-fc1cb5a3059e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:15.664626 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-37bb059b-8eee-4464-89cc-963383607768 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:15.671355 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a6802b72-9990-493d-b03e-fc1cb5a3059e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:15.675001 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-37bb059b-8eee-4464-89cc-963383607768 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:15.675370 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a6802b72-9990-493d-b03e-fc1cb5a3059e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:15.679108 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-37bb059b-8eee-4464-89cc-963383607768 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1351033987', 'deleted': False, 'project_id': '27bed0cb3a46406b92496bee2da42567'} {{(pid=128777) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 11:53:15.679365 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a6802b72-9990-493d-b03e-fc1cb5a3059e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1723 microversion: 2.20 time: 0.743284 Sep 10 11:53:15.681513 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1576/3231] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:53:14 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1723 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:53:15.696296 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-37bb059b-8eee-4464-89cc-963383607768 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:15.698001 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-37bb059b-8eee-4464-89cc-963383607768 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:15.699112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-37bb059b-8eee-4464-89cc-963383607768 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:15.706630 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-37bb059b-8eee-4464-89cc-963383607768 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:15.707569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-37bb059b-8eee-4464-89cc-963383607768 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:15.709270 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-37bb059b-8eee-4464-89cc-963383607768 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:15.856329 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.multi_cell_list [None req-37bb059b-8eee-4464-89cc-963383607768 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128777) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 11:53:15.934025 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-37bb059b-8eee-4464-89cc-963383607768 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1351033987" status: 200 len: 346 microversion: 2.1 time: 0.273863 Sep 10 11:53:15.935512 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1656/3232] 10.222.0.23 () {58 vars in 1242 bytes} [Sat Sep 10 11:53:15 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1351033987 => generated 346 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:53:15.953575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f7fb55de-fc26-407d-97e6-81947a8126cb tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:53:15.969282 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f7fb55de-fc26-407d-97e6-81947a8126cb tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:15.974575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f7fb55de-fc26-407d-97e6-81947a8126cb tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:15.976360 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f7fb55de-fc26-407d-97e6-81947a8126cb tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:16.071695 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f7fb55de-fc26-407d-97e6-81947a8126cb tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985] Going to try to stop instance {{(pid=128776) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 10 11:53:16.217458 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f7fb55de-fc26-407d-97e6-81947a8126cb tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "POST /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985/action" status: 202 len: 0 microversion: 2.1 time: 0.271848 Sep 10 11:53:16.222406 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1577/3233] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:53:15 2022] POST /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:53:16.230445 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5568156c-a86e-4da8-9de7-2d10e66fbb96 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:16.231258 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5568156c-a86e-4da8-9de7-2d10e66fbb96 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:16.246571 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5568156c-a86e-4da8-9de7-2d10e66fbb96 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:16.254164 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5568156c-a86e-4da8-9de7-2d10e66fbb96 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:16.256999 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5568156c-a86e-4da8-9de7-2d10e66fbb96 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:16.260907 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5568156c-a86e-4da8-9de7-2d10e66fbb96 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:16.261676 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5568156c-a86e-4da8-9de7-2d10e66fbb96 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:16.264101 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5568156c-a86e-4da8-9de7-2d10e66fbb96 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:16.543543 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0ba1f837-72c3-49b5-83d4-54258573affb tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f40733f6b80>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:16.630592 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5568156c-a86e-4da8-9de7-2d10e66fbb96 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:16.642285 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5568156c-a86e-4da8-9de7-2d10e66fbb96 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985" status: 200 len: 1522 microversion: 2.1 time: 0.416192 Sep 10 11:53:16.657904 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1657/3234] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:16 2022] GET /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985 => generated 1522 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:16.658113 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0ba1f837-72c3-49b5-83d4-54258573affb tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/4f0c3346-cd3b-4d5a-bcc9-4f0d2ff31c8b" status: 200 len: 1437 microversion: 2.1 time: 0.119030 Sep 10 11:53:16.662306 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1578/3235] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:53:16 2022] GET /compute/v2.1/images/4f0c3346-cd3b-4d5a-bcc9-4f0d2ff31c8b => generated 1437 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:16.712942 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8cab037b-d880-4fa2-9229-43fe05acde70 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:16.713726 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8cab037b-d880-4fa2-9229-43fe05acde70 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:16.733136 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8cab037b-d880-4fa2-9229-43fe05acde70 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:16.733718 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8cab037b-d880-4fa2-9229-43fe05acde70 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:16.734414 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8cab037b-d880-4fa2-9229-43fe05acde70 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:16.735737 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8cab037b-d880-4fa2-9229-43fe05acde70 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:16.736452 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8cab037b-d880-4fa2-9229-43fe05acde70 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:16.739306 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8cab037b-d880-4fa2-9229-43fe05acde70 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:17.149720 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8cab037b-d880-4fa2-9229-43fe05acde70 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:17.169730 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8cab037b-d880-4fa2-9229-43fe05acde70 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:17.189018 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8cab037b-d880-4fa2-9229-43fe05acde70 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:17.190950 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8cab037b-d880-4fa2-9229-43fe05acde70 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1723 microversion: 2.20 time: 0.481873 Sep 10 11:53:17.202224 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1658/3236] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:53:16 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1723 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:53:17.664930 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4ef1c079-856e-4d82-8186-b9743c09bf03 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:17.666389 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4ef1c079-856e-4d82-8186-b9743c09bf03 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:17.676717 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-65c38e4b-5c5a-432e-866a-3083918256f2 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f407257c940>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:17.694808 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ef1c079-856e-4d82-8186-b9743c09bf03 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:17.706826 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ef1c079-856e-4d82-8186-b9743c09bf03 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:17.713127 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ef1c079-856e-4d82-8186-b9743c09bf03 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:17.714083 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ef1c079-856e-4d82-8186-b9743c09bf03 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:17.715813 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ef1c079-856e-4d82-8186-b9743c09bf03 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:17.716541 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ef1c079-856e-4d82-8186-b9743c09bf03 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:17.784316 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-65c38e4b-5c5a-432e-866a-3083918256f2 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/4f0c3346-cd3b-4d5a-bcc9-4f0d2ff31c8b" status: 200 len: 1437 microversion: 2.1 time: 0.113908 Sep 10 11:53:17.794152 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1659/3237] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:53:17 2022] GET /compute/v2.1/images/4f0c3346-cd3b-4d5a-bcc9-4f0d2ff31c8b => generated 1437 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:18.235293 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0d45957c-da34-4251-b3ad-dcfe1977b55d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:18.235945 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0d45957c-da34-4251-b3ad-dcfe1977b55d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:18.249089 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d45957c-da34-4251-b3ad-dcfe1977b55d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:18.250069 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d45957c-da34-4251-b3ad-dcfe1977b55d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:18.254702 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d45957c-da34-4251-b3ad-dcfe1977b55d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:18.260564 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d45957c-da34-4251-b3ad-dcfe1977b55d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:18.265219 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d45957c-da34-4251-b3ad-dcfe1977b55d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:18.266022 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d45957c-da34-4251-b3ad-dcfe1977b55d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:18.340428 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:53:18.880402 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0d45957c-da34-4251-b3ad-dcfe1977b55d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:18.893763 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0d45957c-da34-4251-b3ad-dcfe1977b55d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:18.897257 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0d45957c-da34-4251-b3ad-dcfe1977b55d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:18.901425 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0d45957c-da34-4251-b3ad-dcfe1977b55d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1744 microversion: 2.20 time: 0.668666 Sep 10 11:53:18.903974 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1660/3238] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:53:18 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1744 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:53:18.916464 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-39b2179d-7187-435e-bcfc-1ccbef3aa835 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f4072540040>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:19.010024 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-39b2179d-7187-435e-bcfc-1ccbef3aa835 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/4f0c3346-cd3b-4d5a-bcc9-4f0d2ff31c8b" status: 200 len: 1437 microversion: 2.1 time: 0.104134 Sep 10 11:53:19.010717 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1661/3239] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:53:18 2022] GET /compute/v2.1/images/4f0c3346-cd3b-4d5a-bcc9-4f0d2ff31c8b => generated 1437 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:19.278270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4ef1c079-856e-4d82-8186-b9743c09bf03 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:19.305650 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4ef1c079-856e-4d82-8186-b9743c09bf03 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985" status: 200 len: 1522 microversion: 2.1 time: 1.642385 Sep 10 11:53:19.310846 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1579/3240] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:17 2022] GET /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985 => generated 1522 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:19.935115 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d47ea2be-c86a-4501-b3f7-c65967be4e75 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:19.936869 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d47ea2be-c86a-4501-b3f7-c65967be4e75 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:19.946554 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d47ea2be-c86a-4501-b3f7-c65967be4e75 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:19.951591 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d47ea2be-c86a-4501-b3f7-c65967be4e75 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:19.952808 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d47ea2be-c86a-4501-b3f7-c65967be4e75 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:19.957092 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d47ea2be-c86a-4501-b3f7-c65967be4e75 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:19.958014 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d47ea2be-c86a-4501-b3f7-c65967be4e75 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:19.958705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d47ea2be-c86a-4501-b3f7-c65967be4e75 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:20.027031 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-66efba86-5d81-454e-8b58-164b8f958d65 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f4072c78ca0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:20.144624 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-66efba86-5d81-454e-8b58-164b8f958d65 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/4f0c3346-cd3b-4d5a-bcc9-4f0d2ff31c8b" status: 200 len: 1437 microversion: 2.1 time: 0.121831 Sep 10 11:53:20.171146 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1580/3241] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:53:20 2022] GET /compute/v2.1/images/4f0c3346-cd3b-4d5a-bcc9-4f0d2ff31c8b => generated 1437 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:20.341764 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-82c6b009-e753-47fd-bf0b-f9fa25b57e16 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:20.341764 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-82c6b009-e753-47fd-bf0b-f9fa25b57e16 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:20.354441 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-82c6b009-e753-47fd-bf0b-f9fa25b57e16 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:20.355660 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-82c6b009-e753-47fd-bf0b-f9fa25b57e16 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:20.355660 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-82c6b009-e753-47fd-bf0b-f9fa25b57e16 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:20.356277 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-82c6b009-e753-47fd-bf0b-f9fa25b57e16 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:20.367970 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-82c6b009-e753-47fd-bf0b-f9fa25b57e16 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:20.368575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-82c6b009-e753-47fd-bf0b-f9fa25b57e16 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:21.043135 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d47ea2be-c86a-4501-b3f7-c65967be4e75 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:21.077374 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d47ea2be-c86a-4501-b3f7-c65967be4e75 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:21.080673 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d47ea2be-c86a-4501-b3f7-c65967be4e75 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:21.094175 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d47ea2be-c86a-4501-b3f7-c65967be4e75 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1744 microversion: 2.20 time: 1.157541 Sep 10 11:53:21.096238 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1662/3242] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:53:19 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1744 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:53:21.184699 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c9284fe0-8520-44ba-89ff-704d0b673d55 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f40724ec9d0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:21.287126 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-82c6b009-e753-47fd-bf0b-f9fa25b57e16 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:21.300302 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-82c6b009-e753-47fd-bf0b-f9fa25b57e16 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985" status: 200 len: 1522 microversion: 2.1 time: 0.967317 Sep 10 11:53:21.301261 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1581/3243] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:20 2022] GET /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985 => generated 1522 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:22.126177 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-936075e4-ac5c-40fc-860c-7dfb4ff5f649 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:22.127991 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-936075e4-ac5c-40fc-860c-7dfb4ff5f649 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:22.152173 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-936075e4-ac5c-40fc-860c-7dfb4ff5f649 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:22.153379 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-936075e4-ac5c-40fc-860c-7dfb4ff5f649 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:22.154909 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-936075e4-ac5c-40fc-860c-7dfb4ff5f649 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:22.157730 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-936075e4-ac5c-40fc-860c-7dfb4ff5f649 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:22.161397 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-936075e4-ac5c-40fc-860c-7dfb4ff5f649 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:22.162795 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-936075e4-ac5c-40fc-860c-7dfb4ff5f649 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:22.450481 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=4 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:53:22.992246 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-936075e4-ac5c-40fc-860c-7dfb4ff5f649 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:23.010062 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-936075e4-ac5c-40fc-860c-7dfb4ff5f649 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:23.017651 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-936075e4-ac5c-40fc-860c-7dfb4ff5f649 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:23.027520 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-936075e4-ac5c-40fc-860c-7dfb4ff5f649 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1739 microversion: 2.20 time: 0.905944 Sep 10 11:53:23.053090 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1582/3244] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:53:22 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1739 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:53:23.069304 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b25c2044-367f-4563-a97c-78befa3f1f4a tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:23.075620 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b25c2044-367f-4563-a97c-78befa3f1f4a tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:23.101100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b25c2044-367f-4563-a97c-78befa3f1f4a tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:23.102351 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b25c2044-367f-4563-a97c-78befa3f1f4a tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:23.112042 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b25c2044-367f-4563-a97c-78befa3f1f4a tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:23.115980 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b25c2044-367f-4563-a97c-78befa3f1f4a tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:23.117325 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b25c2044-367f-4563-a97c-78befa3f1f4a tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:23.120969 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b25c2044-367f-4563-a97c-78befa3f1f4a tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:23.399555 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=4 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:53:24.332582 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b25c2044-367f-4563-a97c-78befa3f1f4a tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:24.351308 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b25c2044-367f-4563-a97c-78befa3f1f4a tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985" status: 200 len: 1522 microversion: 2.1 time: 1.294810 Sep 10 11:53:24.375009 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1583/3245] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:23 2022] GET /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985 => generated 1522 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:24.396111 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-305e839c-44c8-4ec7-84be-5adfedee3f39 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:24.399272 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-305e839c-44c8-4ec7-84be-5adfedee3f39 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:24.425152 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-305e839c-44c8-4ec7-84be-5adfedee3f39 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:24.426297 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-305e839c-44c8-4ec7-84be-5adfedee3f39 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:24.426758 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-305e839c-44c8-4ec7-84be-5adfedee3f39 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:24.430929 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-305e839c-44c8-4ec7-84be-5adfedee3f39 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:24.433988 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-305e839c-44c8-4ec7-84be-5adfedee3f39 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:24.437721 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-305e839c-44c8-4ec7-84be-5adfedee3f39 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:24.604296 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:53:24.899593 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-305e839c-44c8-4ec7-84be-5adfedee3f39 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:24.926157 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-305e839c-44c8-4ec7-84be-5adfedee3f39 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:24.930123 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-305e839c-44c8-4ec7-84be-5adfedee3f39 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:24.938194 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-305e839c-44c8-4ec7-84be-5adfedee3f39 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1739 microversion: 2.20 time: 0.559034 Sep 10 11:53:24.963488 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1584/3246] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:53:24 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1739 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:53:24.982579 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f61e1edd-8dc5-4575-986c-a2fce4987f55 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:24.984165 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f61e1edd-8dc5-4575-986c-a2fce4987f55 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] [instance: 402b5cd2-03cd-4c59-b1fb-757b8c03b3e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:24.996920 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f61e1edd-8dc5-4575-986c-a2fce4987f55 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:25.002982 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f61e1edd-8dc5-4575-986c-a2fce4987f55 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:25.004476 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f61e1edd-8dc5-4575-986c-a2fce4987f55 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:25.005518 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f61e1edd-8dc5-4575-986c-a2fce4987f55 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:25.006209 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f61e1edd-8dc5-4575-986c-a2fce4987f55 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:25.006853 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f61e1edd-8dc5-4575-986c-a2fce4987f55 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:25.065748 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f61e1edd-8dc5-4575-986c-a2fce4987f55 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] [instance: 402b5cd2-03cd-4c59-b1fb-757b8c03b3e2] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:53:25.416105 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f61e1edd-8dc5-4575-986c-a2fce4987f55 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] 10.222.0.23 "DELETE /compute/v2.1/servers/402b5cd2-03cd-4c59-b1fb-757b8c03b3e2" status: 204 len: 0 microversion: 2.1 time: 0.450695 Sep 10 11:53:25.421853 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1585/3247] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:53:24 2022] DELETE /compute/v2.1/servers/402b5cd2-03cd-4c59-b1fb-757b8c03b3e2 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:53:25.451054 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-684bc73b-4175-4b05-be16-e407bc204ab4 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:25.454464 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-684bc73b-4175-4b05-be16-e407bc204ab4 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:25.472529 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-684bc73b-4175-4b05-be16-e407bc204ab4 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:25.475563 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-684bc73b-4175-4b05-be16-e407bc204ab4 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:25.476453 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-684bc73b-4175-4b05-be16-e407bc204ab4 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:25.480052 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-684bc73b-4175-4b05-be16-e407bc204ab4 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:25.482985 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-684bc73b-4175-4b05-be16-e407bc204ab4 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:25.485193 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-684bc73b-4175-4b05-be16-e407bc204ab4 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:25.804648 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=14 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:53:25.912754 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-684bc73b-4175-4b05-be16-e407bc204ab4 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:25.927926 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-684bc73b-4175-4b05-be16-e407bc204ab4 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985" status: 200 len: 1522 microversion: 2.1 time: 0.502800 Sep 10 11:53:25.934140 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1586/3248] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:25 2022] GET /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985 => generated 1522 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:25.966747 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b33ea11e-faaa-43cd-89d9-d85a7eefe2ad tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:25.966747 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b33ea11e-faaa-43cd-89d9-d85a7eefe2ad tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] [instance: 402b5cd2-03cd-4c59-b1fb-757b8c03b3e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:25.993194 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b33ea11e-faaa-43cd-89d9-d85a7eefe2ad tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:25.998734 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b33ea11e-faaa-43cd-89d9-d85a7eefe2ad tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:25.999395 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b33ea11e-faaa-43cd-89d9-d85a7eefe2ad tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:26.000311 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b33ea11e-faaa-43cd-89d9-d85a7eefe2ad tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:26.001270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b33ea11e-faaa-43cd-89d9-d85a7eefe2ad tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:26.010358 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b33ea11e-faaa-43cd-89d9-d85a7eefe2ad tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:26.366129 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b33ea11e-faaa-43cd-89d9-d85a7eefe2ad tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d0aaa7b7a34bb4bcea483bb41276aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d7fd11fb84c86b66362074c1ca8a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:26.379911 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b33ea11e-faaa-43cd-89d9-d85a7eefe2ad tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] 10.222.0.23 "GET /compute/v2.1/servers/402b5cd2-03cd-4c59-b1fb-757b8c03b3e2" status: 200 len: 1668 microversion: 2.1 time: 0.439529 Sep 10 11:53:26.383304 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1587/3249] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:25 2022] GET /compute/v2.1/servers/402b5cd2-03cd-4c59-b1fb-757b8c03b3e2 => generated 1668 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:26.399942 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a3d1695c-950d-421e-8180-e1606ce926e6 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:26.400970 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a3d1695c-950d-421e-8180-e1606ce926e6 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:26.416093 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a3d1695c-950d-421e-8180-e1606ce926e6 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:26.417004 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a3d1695c-950d-421e-8180-e1606ce926e6 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:26.418146 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a3d1695c-950d-421e-8180-e1606ce926e6 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:26.419374 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a3d1695c-950d-421e-8180-e1606ce926e6 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:26.423962 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a3d1695c-950d-421e-8180-e1606ce926e6 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:26.424769 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a3d1695c-950d-421e-8180-e1606ce926e6 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:26.667232 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a3d1695c-950d-421e-8180-e1606ce926e6 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:26.677537 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:53:26.690436 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a3d1695c-950d-421e-8180-e1606ce926e6 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:26.693076 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a3d1695c-950d-421e-8180-e1606ce926e6 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:26.694860 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a3d1695c-950d-421e-8180-e1606ce926e6 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1739 microversion: 2.20 time: 0.310354 Sep 10 11:53:26.696168 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1588/3250] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:53:26 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1739 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:53:26.971769 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-307f9dae-9ee5-4e11-a707-b7322865eee0 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:26.973822 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-307f9dae-9ee5-4e11-a707-b7322865eee0 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:27.007023 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-307f9dae-9ee5-4e11-a707-b7322865eee0 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:27.008006 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-307f9dae-9ee5-4e11-a707-b7322865eee0 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:27.010616 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-307f9dae-9ee5-4e11-a707-b7322865eee0 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:27.017492 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-307f9dae-9ee5-4e11-a707-b7322865eee0 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:27.019790 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-307f9dae-9ee5-4e11-a707-b7322865eee0 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:27.020420 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-307f9dae-9ee5-4e11-a707-b7322865eee0 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:27.461945 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-307f9dae-9ee5-4e11-a707-b7322865eee0 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:27.481874 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-307f9dae-9ee5-4e11-a707-b7322865eee0 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985" status: 200 len: 1522 microversion: 2.1 time: 0.515126 Sep 10 11:53:27.483123 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1589/3251] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:26 2022] GET /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985 => generated 1522 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:53:27.497205 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-22c5e603-5c5c-4e8d-8deb-b455b235b3e8 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:27.498203 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-22c5e603-5c5c-4e8d-8deb-b455b235b3e8 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] [instance: 402b5cd2-03cd-4c59-b1fb-757b8c03b3e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:27.528710 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-22c5e603-5c5c-4e8d-8deb-b455b235b3e8 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:27.530001 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-22c5e603-5c5c-4e8d-8deb-b455b235b3e8 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:27.532212 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-22c5e603-5c5c-4e8d-8deb-b455b235b3e8 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:27.533138 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-22c5e603-5c5c-4e8d-8deb-b455b235b3e8 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:27.534946 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-22c5e603-5c5c-4e8d-8deb-b455b235b3e8 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:27.538404 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-22c5e603-5c5c-4e8d-8deb-b455b235b3e8 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:27.854522 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-22c5e603-5c5c-4e8d-8deb-b455b235b3e8 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d0aaa7b7a34bb4bcea483bb41276aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d7fd11fb84c86b66362074c1ca8a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:27.865776 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-22c5e603-5c5c-4e8d-8deb-b455b235b3e8 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] 10.222.0.23 "GET /compute/v2.1/servers/402b5cd2-03cd-4c59-b1fb-757b8c03b3e2" status: 200 len: 1668 microversion: 2.1 time: 0.377795 Sep 10 11:53:27.867689 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1590/3252] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:27 2022] GET /compute/v2.1/servers/402b5cd2-03cd-4c59-b1fb-757b8c03b3e2 => generated 1668 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:27.872610 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-6bb4f616-481d-4357-a56a-bcdfb121d305 req-87e30517-4286-4ab5-893d-dcca77e1e9d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61ab78c6-917d-46d1-b3e2-9935ca45c8e2", "name": "network-vif-plugged", "status": "completed", "tag": "998df393-88c6-4f53-8cdf-ce9cb6efbc62"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:53:27.885445 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6bb4f616-481d-4357-a56a-bcdfb121d305 req-87e30517-4286-4ab5-893d-dcca77e1e9d1 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:27.886301 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6bb4f616-481d-4357-a56a-bcdfb121d305 req-87e30517-4286-4ab5-893d-dcca77e1e9d1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:27.887612 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6bb4f616-481d-4357-a56a-bcdfb121d305 req-87e30517-4286-4ab5-893d-dcca77e1e9d1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:27.912165 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-6bb4f616-481d-4357-a56a-bcdfb121d305 req-87e30517-4286-4ab5-893d-dcca77e1e9d1 service nova] Creating event network-vif-plugged:998df393-88c6-4f53-8cdf-ce9cb6efbc62 for instance 61ab78c6-917d-46d1-b3e2-9935ca45c8e2 on n-h2-856895-1 Sep 10 11:53:27.924398 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-6bb4f616-481d-4357-a56a-bcdfb121d305 req-87e30517-4286-4ab5-893d-dcca77e1e9d1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055275 Sep 10 11:53:27.926617 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1591/3253] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:53:27.942924 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1e7c67d4-3f38-4ea8-a967-c05e4f002a5c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:27.946884 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1e7c67d4-3f38-4ea8-a967-c05e4f002a5c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:27.964129 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1e7c67d4-3f38-4ea8-a967-c05e4f002a5c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:27.964981 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1e7c67d4-3f38-4ea8-a967-c05e4f002a5c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:27.965501 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1e7c67d4-3f38-4ea8-a967-c05e4f002a5c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:27.966480 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1e7c67d4-3f38-4ea8-a967-c05e4f002a5c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:27.967279 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1e7c67d4-3f38-4ea8-a967-c05e4f002a5c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:27.968062 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1e7c67d4-3f38-4ea8-a967-c05e4f002a5c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:28.428274 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1e7c67d4-3f38-4ea8-a967-c05e4f002a5c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:28.444132 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1e7c67d4-3f38-4ea8-a967-c05e4f002a5c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:28.446146 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1e7c67d4-3f38-4ea8-a967-c05e4f002a5c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:28.455868 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1e7c67d4-3f38-4ea8-a967-c05e4f002a5c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1739 microversion: 2.20 time: 0.519938 Sep 10 11:53:28.457573 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1592/3254] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:53:27 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1739 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:53:28.512298 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9001a632-59c7-4564-910e-4f6ea766901c tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:28.515078 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9001a632-59c7-4564-910e-4f6ea766901c tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:28.531793 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9001a632-59c7-4564-910e-4f6ea766901c tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:28.534487 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9001a632-59c7-4564-910e-4f6ea766901c tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:28.536349 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9001a632-59c7-4564-910e-4f6ea766901c tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:28.539121 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9001a632-59c7-4564-910e-4f6ea766901c tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:28.541424 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9001a632-59c7-4564-910e-4f6ea766901c tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:28.542190 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9001a632-59c7-4564-910e-4f6ea766901c tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:29.039968 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9001a632-59c7-4564-910e-4f6ea766901c tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:29.071072 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9001a632-59c7-4564-910e-4f6ea766901c tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985" status: 200 len: 1522 microversion: 2.1 time: 0.563112 Sep 10 11:53:29.072058 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1593/3255] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:28 2022] GET /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985 => generated 1522 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:29.078450 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1d49797e-50e0-4545-9a06-75db64061429 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:29.079439 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1d49797e-50e0-4545-9a06-75db64061429 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] [instance: 402b5cd2-03cd-4c59-b1fb-757b8c03b3e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:29.087267 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1d49797e-50e0-4545-9a06-75db64061429 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:29.088262 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1d49797e-50e0-4545-9a06-75db64061429 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:29.089266 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1d49797e-50e0-4545-9a06-75db64061429 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:29.090632 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1d49797e-50e0-4545-9a06-75db64061429 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:29.091713 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1d49797e-50e0-4545-9a06-75db64061429 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:29.092570 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1d49797e-50e0-4545-9a06-75db64061429 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:29.525177 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1d49797e-50e0-4545-9a06-75db64061429 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d0aaa7b7a34bb4bcea483bb41276aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d7fd11fb84c86b66362074c1ca8a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:29.549743 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1d49797e-50e0-4545-9a06-75db64061429 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] 10.222.0.23 "GET /compute/v2.1/servers/402b5cd2-03cd-4c59-b1fb-757b8c03b3e2" status: 200 len: 1668 microversion: 2.1 time: 0.472083 Sep 10 11:53:29.572205 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1594/3256] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:29 2022] GET /compute/v2.1/servers/402b5cd2-03cd-4c59-b1fb-757b8c03b3e2 => generated 1668 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:29.619760 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3936f100-1fe6-4fe0-9a31-47d761db7c4e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:29.622598 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3936f100-1fe6-4fe0-9a31-47d761db7c4e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:29.652108 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3936f100-1fe6-4fe0-9a31-47d761db7c4e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:29.652849 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3936f100-1fe6-4fe0-9a31-47d761db7c4e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:29.654886 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3936f100-1fe6-4fe0-9a31-47d761db7c4e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:29.657136 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3936f100-1fe6-4fe0-9a31-47d761db7c4e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:29.659078 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3936f100-1fe6-4fe0-9a31-47d761db7c4e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:29.660864 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3936f100-1fe6-4fe0-9a31-47d761db7c4e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:29.950392 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=76 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:53:30.118960 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3936f100-1fe6-4fe0-9a31-47d761db7c4e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:30.145118 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3936f100-1fe6-4fe0-9a31-47d761db7c4e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:30.148992 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3936f100-1fe6-4fe0-9a31-47d761db7c4e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:30.156721 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3936f100-1fe6-4fe0-9a31-47d761db7c4e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1739 microversion: 2.20 time: 0.582199 Sep 10 11:53:30.160377 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1595/3257] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:53:29 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1739 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:53:30.175987 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0e9e6244-d38a-4cbc-9cdb-859d64b9dc8a tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:30.177482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0e9e6244-d38a-4cbc-9cdb-859d64b9dc8a tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:30.211913 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e9e6244-d38a-4cbc-9cdb-859d64b9dc8a tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:30.212750 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e9e6244-d38a-4cbc-9cdb-859d64b9dc8a tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:30.216617 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e9e6244-d38a-4cbc-9cdb-859d64b9dc8a tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:30.219130 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e9e6244-d38a-4cbc-9cdb-859d64b9dc8a tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:30.219815 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e9e6244-d38a-4cbc-9cdb-859d64b9dc8a tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:30.221161 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e9e6244-d38a-4cbc-9cdb-859d64b9dc8a tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:30.640625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0e9e6244-d38a-4cbc-9cdb-859d64b9dc8a tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:30.654308 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0e9e6244-d38a-4cbc-9cdb-859d64b9dc8a tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985" status: 200 len: 1522 microversion: 2.1 time: 0.490809 Sep 10 11:53:30.676749 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1596/3258] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:30 2022] GET /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985 => generated 1522 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:31.054341 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=11 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:53:31.310483 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c9284fe0-8520-44ba-89ff-704d0b673d55 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/4f0c3346-cd3b-4d5a-bcc9-4f0d2ff31c8b" status: 200 len: 1446 microversion: 2.1 time: 10.144712 Sep 10 11:53:31.312419 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1663/3259] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:53:21 2022] GET /compute/v2.1/images/4f0c3346-cd3b-4d5a-bcc9-4f0d2ff31c8b => generated 1446 bytes in 10147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:31.331874 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-16cda371-fab7-4884-ac0b-e57f55dae64d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1427654197", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "9f016ce0-94a4-441f-9715-493bd2b96018"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:53:31.336257 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-889a8e2e-cdce-4ce3-958f-6ed7c6f9e9d4 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:31.341268 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-889a8e2e-cdce-4ce3-958f-6ed7c6f9e9d4 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] [instance: 402b5cd2-03cd-4c59-b1fb-757b8c03b3e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:31.365184 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-889a8e2e-cdce-4ce3-958f-6ed7c6f9e9d4 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:31.365697 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-889a8e2e-cdce-4ce3-958f-6ed7c6f9e9d4 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:31.366143 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-889a8e2e-cdce-4ce3-958f-6ed7c6f9e9d4 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:31.377217 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-889a8e2e-cdce-4ce3-958f-6ed7c6f9e9d4 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:31.381260 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-889a8e2e-cdce-4ce3-958f-6ed7c6f9e9d4 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:31.383059 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-889a8e2e-cdce-4ce3-958f-6ed7c6f9e9d4 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:31.495547 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-16cda371-fab7-4884-ac0b-e57f55dae64d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] validate_networks() for [('9f016ce0-94a4-441f-9715-493bd2b96018', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:53:31.822079 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-889a8e2e-cdce-4ce3-958f-6ed7c6f9e9d4 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d0aaa7b7a34bb4bcea483bb41276aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d7fd11fb84c86b66362074c1ca8a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:31.855422 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-889a8e2e-cdce-4ce3-958f-6ed7c6f9e9d4 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] 10.222.0.23 "GET /compute/v2.1/servers/402b5cd2-03cd-4c59-b1fb-757b8c03b3e2" status: 200 len: 1600 microversion: 2.1 time: 0.538118 Sep 10 11:53:31.859332 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1664/3260] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:31 2022] GET /compute/v2.1/servers/402b5cd2-03cd-4c59-b1fb-757b8c03b3e2 => generated 1600 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:31.879460 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-36dd3165-d08b-40a0-89a5-b098511f1792 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:31.880412 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-36dd3165-d08b-40a0-89a5-b098511f1792 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:31.898265 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36dd3165-d08b-40a0-89a5-b098511f1792 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:31.898761 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36dd3165-d08b-40a0-89a5-b098511f1792 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:31.899249 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36dd3165-d08b-40a0-89a5-b098511f1792 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:31.899965 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36dd3165-d08b-40a0-89a5-b098511f1792 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:31.912475 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36dd3165-d08b-40a0-89a5-b098511f1792 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:31.914142 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36dd3165-d08b-40a0-89a5-b098511f1792 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:32.274306 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-36dd3165-d08b-40a0-89a5-b098511f1792 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:32.288054 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-36dd3165-d08b-40a0-89a5-b098511f1792 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:32.290884 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-36dd3165-d08b-40a0-89a5-b098511f1792 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:32.294066 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-36dd3165-d08b-40a0-89a5-b098511f1792 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1739 microversion: 2.20 time: 0.433310 Sep 10 11:53:32.298718 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1665/3261] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:53:31 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1739 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:53:32.306033 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4972522b-e122-4b92-a959-91674cc0cadc tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f40725af1f0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:32.455952 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4972522b-e122-4b92-a959-91674cc0cadc tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/4f0c3346-cd3b-4d5a-bcc9-4f0d2ff31c8b" status: 200 len: 1446 microversion: 2.1 time: 0.150446 Sep 10 11:53:32.460560 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1666/3262] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:53:32 2022] GET /compute/v2.1/images/4f0c3346-cd3b-4d5a-bcc9-4f0d2ff31c8b => generated 1446 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:32.472677 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-e3075def-a0af-499e-a70a-3d3910a359aa req-88f45c39-b3f2-4e2e-8259-8b38b14f45c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "402b5cd2-03cd-4c59-b1fb-757b8c03b3e2", "name": "network-vif-deleted", "tag": "65a0f5b9-a99d-4243-bb34-98369eceac63"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:53:32.525614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e3075def-a0af-499e-a70a-3d3910a359aa req-88f45c39-b3f2-4e2e-8259-8b38b14f45c4 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:32.526115 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e3075def-a0af-499e-a70a-3d3910a359aa req-88f45c39-b3f2-4e2e-8259-8b38b14f45c4 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:32.530035 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e3075def-a0af-499e-a70a-3d3910a359aa req-88f45c39-b3f2-4e2e-8259-8b38b14f45c4 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:32.535458 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-16cda371-fab7-4884-ac0b-e57f55dae64d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:53:32.536026 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-16cda371-fab7-4884-ac0b-e57f55dae64d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:53:32.536610 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-16cda371-fab7-4884-ac0b-e57f55dae64d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:53:32.537133 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-16cda371-fab7-4884-ac0b-e57f55dae64d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:53:32.537681 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-16cda371-fab7-4884-ac0b-e57f55dae64d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:53:32.554272 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16cda371-fab7-4884-ac0b-e57f55dae64d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:32.558504 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16cda371-fab7-4884-ac0b-e57f55dae64d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:32.559092 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16cda371-fab7-4884-ac0b-e57f55dae64d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:32.560314 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16cda371-fab7-4884-ac0b-e57f55dae64d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:32.560996 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16cda371-fab7-4884-ac0b-e57f55dae64d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:32.562851 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16cda371-fab7-4884-ac0b-e57f55dae64d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:32.585029 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-e3075def-a0af-499e-a70a-3d3910a359aa req-88f45c39-b3f2-4e2e-8259-8b38b14f45c4 service nova] Creating event network-vif-deleted:65a0f5b9-a99d-4243-bb34-98369eceac63 for instance 402b5cd2-03cd-4c59-b1fb-757b8c03b3e2 on n-h1-856895-1 Sep 10 11:53:32.606253 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-e3075def-a0af-499e-a70a-3d3910a359aa req-88f45c39-b3f2-4e2e-8259-8b38b14f45c4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143792 Sep 10 11:53:32.606884 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1667/3263] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:53:32.628504 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-16cda371-fab7-4884-ac0b-e57f55dae64d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Getting quotas for project 093f44e4274f41c1882cf1a2167dc891. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:53:32.637809 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2477e590-8390-4d5b-8d2a-3ae3389db6bf tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:32.647355 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-16cda371-fab7-4884-ac0b-e57f55dae64d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Getting quotas for user 4318416fa33b40ae98c8c35675b0c101 and project 093f44e4274f41c1882cf1a2167dc891. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:53:32.647497 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2477e590-8390-4d5b-8d2a-3ae3389db6bf tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:32.669766 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2477e590-8390-4d5b-8d2a-3ae3389db6bf tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:32.676434 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2477e590-8390-4d5b-8d2a-3ae3389db6bf tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:32.679175 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2477e590-8390-4d5b-8d2a-3ae3389db6bf tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:32.680340 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2477e590-8390-4d5b-8d2a-3ae3389db6bf tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:32.683062 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2477e590-8390-4d5b-8d2a-3ae3389db6bf tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:32.683814 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2477e590-8390-4d5b-8d2a-3ae3389db6bf tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:32.697568 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-16cda371-fab7-4884-ac0b-e57f55dae64d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:53:32.714930 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-16cda371-fab7-4884-ac0b-e57f55dae64d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 8d231092-f981-47fe-9994-6fcb031c8a83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:53:32.877495 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-16cda371-fab7-4884-ac0b-e57f55dae64d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.199214 Sep 10 11:53:32.879730 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1597/3264] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:53:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2202 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:53:32.891571 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3534085d-6e3a-4478-81c1-885df2ab27a8 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f407b5505e0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:33.056192 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2477e590-8390-4d5b-8d2a-3ae3389db6bf tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:33.071952 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2477e590-8390-4d5b-8d2a-3ae3389db6bf tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985" status: 200 len: 1499 microversion: 2.1 time: 0.445539 Sep 10 11:53:33.073002 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1668/3265] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:32 2022] GET /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985 => generated 1499 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:33.083516 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b5f5dd9d-8d37-41a0-b0d0-55fc640f22e2 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:33.087880 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b5f5dd9d-8d37-41a0-b0d0-55fc640f22e2 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] [instance: 402b5cd2-03cd-4c59-b1fb-757b8c03b3e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:33.110226 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5f5dd9d-8d37-41a0-b0d0-55fc640f22e2 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:33.111252 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5f5dd9d-8d37-41a0-b0d0-55fc640f22e2 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:33.121454 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5f5dd9d-8d37-41a0-b0d0-55fc640f22e2 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:33.123014 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5f5dd9d-8d37-41a0-b0d0-55fc640f22e2 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:33.124109 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5f5dd9d-8d37-41a0-b0d0-55fc640f22e2 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:33.124777 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5f5dd9d-8d37-41a0-b0d0-55fc640f22e2 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:33.149257 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-b5f5dd9d-8d37-41a0-b0d0-55fc640f22e2 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] HTTP exception thrown: Instance 402b5cd2-03cd-4c59-b1fb-757b8c03b3e2 could not be found. Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b5f5dd9d-8d37-41a0-b0d0-55fc640f22e2 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Request method failure captured: Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/402b5cd2-03cd-4c59-b1fb-757b8c03b3e2 HTTP/1.1 Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHpKvwiZkdNnsLS068eKq96oeGPNbHuoKS1Cs3JddgffK7J-Iv8iiYziDVP3uFi6uz2KOqcuXp747C2vcDM6Ty4bKYgr51lZ_TV5fCBg82Cpj7Kv3t3-yW3GEV8on_NN7_YdCwrZZze7Gj7jZFiPHYHCc66JrTdMpQCvyK7aYMwlekg Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 926d7fd11fb84c86b66362074c1ca8a7 Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersTestFqdnHostnames-700274385 Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/926d7fd11fb84c86b66362074c1ca8a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/926d7fd11fb84c86b66362074c1ca8a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_926d7fd11fb84c86b66362074c1ca8a7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/926d7fd11fb84c86b66362074c1ca8a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersTestFqdnHostnames-700274385 Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 926d7fd11fb84c86b66362074c1ca8a7 Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-700274385 Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersTestFqdnHostnames-700274385-project Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: d5d0aaa7b7a34bb4bcea483bb41276aa Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersTestFqdnHostnames-700274385-project Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 402b5cd2-03cd-4c59-b1fb-757b8c03b3e2 could not be found. Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '402b5cd2-03cd-4c59-b1fb-757b8c03b3e2'} Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 402b5cd2-03cd-4c59-b1fb-757b8c03b3e2 could not be found. Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 402b5cd2-03cd-4c59-b1fb-757b8c03b3e2 could not be found. Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:53:33.151300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:53:33.156952 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:53:33.156952 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:53:33.156952 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:53:33.156952 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:53:33.156952 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:53:33.156952 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 402b5cd2-03cd-4c59-b1fb-757b8c03b3e2 could not be found. Sep 10 11:53:33.156952 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:53:33.159751 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b5f5dd9d-8d37-41a0-b0d0-55fc640f22e2 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Returning 404 to user: Instance 402b5cd2-03cd-4c59-b1fb-757b8c03b3e2 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:53:33.161581 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b5f5dd9d-8d37-41a0-b0d0-55fc640f22e2 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] 10.222.0.23 "GET /compute/v2.1/servers/402b5cd2-03cd-4c59-b1fb-757b8c03b3e2" status: 404 len: 111 microversion: 2.1 time: 0.086863 Sep 10 11:53:33.162526 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1669/3266] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:33 2022] GET /compute/v2.1/servers/402b5cd2-03cd-4c59-b1fb-757b8c03b3e2 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:53:33.176082 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b7bfcd24-c561-4001-b099-fe28d07656ad tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:33.178512 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b7bfcd24-c561-4001-b099-fe28d07656ad tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 8d231092-f981-47fe-9994-6fcb031c8a83] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:33.292922 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b7bfcd24-c561-4001-b099-fe28d07656ad tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318416fa33b40ae98c8c35675b0c101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f44e4274f41c1882cf1a2167dc891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:33.302817 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b7bfcd24-c561-4001-b099-fe28d07656ad tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "GET /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83" status: 200 len: 1224 microversion: 2.1 time: 0.138937 Sep 10 11:53:33.305442 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1670/3267] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:33 2022] GET /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83 => generated 1224 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:33.313263 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-88c5f72a-cae3-4630-9bb4-74007601e2b0 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:33.329632 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-88c5f72a-cae3-4630-9bb4-74007601e2b0 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:33.336774 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-88c5f72a-cae3-4630-9bb4-74007601e2b0 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '27bed0cb3a46406b92496bee2da42567'} {{(pid=128777) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 11:53:33.351386 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-88c5f72a-cae3-4630-9bb4-74007601e2b0 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:33.354106 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-88c5f72a-cae3-4630-9bb4-74007601e2b0 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:33.354730 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-88c5f72a-cae3-4630-9bb4-74007601e2b0 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:33.356916 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-88c5f72a-cae3-4630-9bb4-74007601e2b0 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:33.359335 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-88c5f72a-cae3-4630-9bb4-74007601e2b0 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:33.360569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-88c5f72a-cae3-4630-9bb4-74007601e2b0 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:33.436715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.multi_cell_list [None req-88c5f72a-cae3-4630-9bb4-74007601e2b0 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128777) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 11:53:33.540805 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-88c5f72a-cae3-4630-9bb4-74007601e2b0 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.232388 Sep 10 11:53:33.560312 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1671/3268] 10.222.0.23 () {58 vars in 1154 bytes} [Sat Sep 10 11:53:33 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:53:33.565792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5727ef5f-29ca-43c4-828c-3e4ff0db35d2 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] Calling method '.version_select at 0x7f4072545af0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:33.670832 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5727ef5f-29ca-43c4-828c-3e4ff0db35d2 tempest-ServersTestFqdnHostnames-700274385 tempest-ServersTestFqdnHostnames-700274385-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1668632494" status: 202 len: 0 microversion: 2.1 time: 0.110101 Sep 10 11:53:33.672721 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1672/3269] 10.222.0.23 () {58 vars in 1221 bytes} [Sat Sep 10 11:53:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1668632494 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:53:33.691231 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-009e9fdc-2642-4899-96dc-ebb6f850170d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:33.696844 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-009e9fdc-2642-4899-96dc-ebb6f850170d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:33.724056 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-009e9fdc-2642-4899-96dc-ebb6f850170d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:33.726080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-009e9fdc-2642-4899-96dc-ebb6f850170d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:33.727705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-009e9fdc-2642-4899-96dc-ebb6f850170d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:33.731102 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-009e9fdc-2642-4899-96dc-ebb6f850170d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:33.734160 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-009e9fdc-2642-4899-96dc-ebb6f850170d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:33.735761 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-009e9fdc-2642-4899-96dc-ebb6f850170d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:34.257955 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-009e9fdc-2642-4899-96dc-ebb6f850170d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:34.270683 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-009e9fdc-2642-4899-96dc-ebb6f850170d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:34.277395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-009e9fdc-2642-4899-96dc-ebb6f850170d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:34.280048 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-009e9fdc-2642-4899-96dc-ebb6f850170d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1739 microversion: 2.20 time: 0.599771 Sep 10 11:53:34.312278 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1673/3270] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:53:33 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1739 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:53:34.331230 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f19de38f-64f1-4e75-be87-e63cb6189558 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:53:34.380876 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f19de38f-64f1-4e75-be87-e63cb6189558 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:34.382772 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f19de38f-64f1-4e75-be87-e63cb6189558 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:34.384076 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f19de38f-64f1-4e75-be87-e63cb6189558 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:34.645274 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f19de38f-64f1-4e75-be87-e63cb6189558 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985] Going to try to start instance {{(pid=128777) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 10 11:53:34.745756 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f19de38f-64f1-4e75-be87-e63cb6189558 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "POST /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985/action" status: 202 len: 0 microversion: 2.1 time: 0.431261 Sep 10 11:53:34.747029 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1674/3271] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:53:34 2022] POST /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985/action => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:53:34.784138 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5cd8e16a-4b46-4efb-ba0d-0364876ebef0 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:34.784952 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5cd8e16a-4b46-4efb-ba0d-0364876ebef0 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 8d231092-f981-47fe-9994-6fcb031c8a83] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:35.018149 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5cd8e16a-4b46-4efb-ba0d-0364876ebef0 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318416fa33b40ae98c8c35675b0c101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f44e4274f41c1882cf1a2167dc891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:35.035036 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5cd8e16a-4b46-4efb-ba0d-0364876ebef0 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "GET /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83" status: 200 len: 1224 microversion: 2.1 time: 0.286243 Sep 10 11:53:35.057278 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1675/3272] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:34 2022] GET /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83 => generated 1224 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:35.086099 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3d7dac85-135f-45d1-b4f6-518c5d431e99 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:35.086878 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3d7dac85-135f-45d1-b4f6-518c5d431e99 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:35.128489 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d7dac85-135f-45d1-b4f6-518c5d431e99 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:35.145656 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d7dac85-135f-45d1-b4f6-518c5d431e99 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:35.146193 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d7dac85-135f-45d1-b4f6-518c5d431e99 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:35.147257 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d7dac85-135f-45d1-b4f6-518c5d431e99 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:35.147991 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d7dac85-135f-45d1-b4f6-518c5d431e99 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:35.158345 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d7dac85-135f-45d1-b4f6-518c5d431e99 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:35.347863 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3534085d-6e3a-4478-81c1-885df2ab27a8 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "DELETE /compute/v2.1/images/4f0c3346-cd3b-4d5a-bcc9-4f0d2ff31c8b" status: 204 len: 0 microversion: 2.1 time: 2.462995 Sep 10 11:53:35.349743 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1598/3273] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:32 2022] DELETE /compute/v2.1/images/4f0c3346-cd3b-4d5a-bcc9-4f0d2ff31c8b => generated 0 bytes in 2469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:53:35.356707 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-283e912b-a762-4ae6-a7bb-631933e86e8f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:35.358207 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-283e912b-a762-4ae6-a7bb-631933e86e8f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:35.380390 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-283e912b-a762-4ae6-a7bb-631933e86e8f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:35.381471 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-283e912b-a762-4ae6-a7bb-631933e86e8f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:35.382163 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-283e912b-a762-4ae6-a7bb-631933e86e8f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:35.386263 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-283e912b-a762-4ae6-a7bb-631933e86e8f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:35.387775 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-283e912b-a762-4ae6-a7bb-631933e86e8f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:35.389706 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-283e912b-a762-4ae6-a7bb-631933e86e8f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:36.080162 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-283e912b-a762-4ae6-a7bb-631933e86e8f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:36.120770 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-283e912b-a762-4ae6-a7bb-631933e86e8f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:36.122842 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-283e912b-a762-4ae6-a7bb-631933e86e8f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:36.124280 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-283e912b-a762-4ae6-a7bb-631933e86e8f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1739 microversion: 2.20 time: 0.773357 Sep 10 11:53:36.139556 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1599/3274] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:53:35 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1739 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:53:36.152265 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c51d6d70-4c03-4020-8258-6f023a46d5ad tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:36.152583 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c51d6d70-4c03-4020-8258-6f023a46d5ad tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: c56e3146-bad1-4abf-853a-2d01226d85b4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:36.171640 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c51d6d70-4c03-4020-8258-6f023a46d5ad tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:36.179083 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c51d6d70-4c03-4020-8258-6f023a46d5ad tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:36.187554 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c51d6d70-4c03-4020-8258-6f023a46d5ad tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:36.190280 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c51d6d70-4c03-4020-8258-6f023a46d5ad tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:36.197337 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c51d6d70-4c03-4020-8258-6f023a46d5ad tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:36.198271 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c51d6d70-4c03-4020-8258-6f023a46d5ad tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:36.247868 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3d7dac85-135f-45d1-b4f6-518c5d431e99 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:36.266766 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3d7dac85-135f-45d1-b4f6-518c5d431e99 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985" status: 200 len: 1508 microversion: 2.1 time: 1.204956 Sep 10 11:53:36.268751 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1676/3275] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:35 2022] GET /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985 => generated 1508 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:36.284770 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-7a4f3c18-1b56-40a5-9db6-9bf9d7b2fd5f req-f6e1e031-2456-4f1c-a90e-80cec1e9bd27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c56e3146-bad1-4abf-853a-2d01226d85b4", "name": "network-vif-unplugged", "status": "completed", "tag": "0c512e55-530c-4d6d-9d65-364f8052e833"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:53:36.311032 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c51d6d70-4c03-4020-8258-6f023a46d5ad tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: c56e3146-bad1-4abf-853a-2d01226d85b4] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:53:36.311723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-7a4f3c18-1b56-40a5-9db6-9bf9d7b2fd5f req-f6e1e031-2456-4f1c-a90e-80cec1e9bd27 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:36.313917 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-7a4f3c18-1b56-40a5-9db6-9bf9d7b2fd5f req-f6e1e031-2456-4f1c-a90e-80cec1e9bd27 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:36.315130 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-7a4f3c18-1b56-40a5-9db6-9bf9d7b2fd5f req-f6e1e031-2456-4f1c-a90e-80cec1e9bd27 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:36.364576 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-7a4f3c18-1b56-40a5-9db6-9bf9d7b2fd5f req-f6e1e031-2456-4f1c-a90e-80cec1e9bd27 service nova] Creating event network-vif-unplugged:0c512e55-530c-4d6d-9d65-364f8052e833 for instance c56e3146-bad1-4abf-853a-2d01226d85b4 on n-h2-856895-1 Sep 10 11:53:36.383914 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-7a4f3c18-1b56-40a5-9db6-9bf9d7b2fd5f req-f6e1e031-2456-4f1c-a90e-80cec1e9bd27 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105995 Sep 10 11:53:36.385747 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1677/3276] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:53:36.399083 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4a66be9c-a9d4-4dc5-905e-77d4f8d8dbdf tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:36.402081 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4a66be9c-a9d4-4dc5-905e-77d4f8d8dbdf tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 8d231092-f981-47fe-9994-6fcb031c8a83] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:36.417800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a66be9c-a9d4-4dc5-905e-77d4f8d8dbdf tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:36.420059 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a66be9c-a9d4-4dc5-905e-77d4f8d8dbdf tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:36.422090 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a66be9c-a9d4-4dc5-905e-77d4f8d8dbdf tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:36.423322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a66be9c-a9d4-4dc5-905e-77d4f8d8dbdf tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:36.425807 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a66be9c-a9d4-4dc5-905e-77d4f8d8dbdf tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:36.427863 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a66be9c-a9d4-4dc5-905e-77d4f8d8dbdf tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:36.529969 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c51d6d70-4c03-4020-8258-6f023a46d5ad tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c56e3146-bad1-4abf-853a-2d01226d85b4" status: 204 len: 0 microversion: 2.1 time: 0.391493 Sep 10 11:53:36.533064 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1600/3277] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:53:36 2022] DELETE /compute/v2.1/servers/c56e3146-bad1-4abf-853a-2d01226d85b4 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:53:36.736635 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-00ae897f-cb16-4efa-bce5-bb0bd354308e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1136489189", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "a9ff9635-7794-44ea-9e2d-dac85a415bc7"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:53:36.817955 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4a66be9c-a9d4-4dc5-905e-77d4f8d8dbdf tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318416fa33b40ae98c8c35675b0c101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f44e4274f41c1882cf1a2167dc891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:36.835585 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-00ae897f-cb16-4efa-bce5-bb0bd354308e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] validate_networks() for [('a9ff9635-7794-44ea-9e2d-dac85a415bc7', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:53:36.841604 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4a66be9c-a9d4-4dc5-905e-77d4f8d8dbdf tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "GET /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83" status: 200 len: 1284 microversion: 2.1 time: 0.448026 Sep 10 11:53:36.844558 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1678/3278] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:36 2022] GET /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83 => generated 1284 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:37.158958 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a14a78ea-5aee-44ee-a2a0-f591221617ff tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:37.160042 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a14a78ea-5aee-44ee-a2a0-f591221617ff tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:37.186420 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a14a78ea-5aee-44ee-a2a0-f591221617ff tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:37.187851 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a14a78ea-5aee-44ee-a2a0-f591221617ff tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:37.191004 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a14a78ea-5aee-44ee-a2a0-f591221617ff tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:37.192642 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a14a78ea-5aee-44ee-a2a0-f591221617ff tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:37.193343 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a14a78ea-5aee-44ee-a2a0-f591221617ff tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:37.194761 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a14a78ea-5aee-44ee-a2a0-f591221617ff tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:37.953398 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a14a78ea-5aee-44ee-a2a0-f591221617ff tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:37.968685 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a14a78ea-5aee-44ee-a2a0-f591221617ff tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:37.970289 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a14a78ea-5aee-44ee-a2a0-f591221617ff tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:37.993460 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a14a78ea-5aee-44ee-a2a0-f591221617ff tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1739 microversion: 2.20 time: 0.840104 Sep 10 11:53:37.997173 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1679/3279] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:53:37 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1739 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:53:38.021118 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ab94ab6c-e336-4cb8-9222-859d76cbf5a8 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:38.027857 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ab94ab6c-e336-4cb8-9222-859d76cbf5a8 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:38.047031 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ab94ab6c-e336-4cb8-9222-859d76cbf5a8 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:38.047895 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ab94ab6c-e336-4cb8-9222-859d76cbf5a8 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:38.050901 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ab94ab6c-e336-4cb8-9222-859d76cbf5a8 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:38.052029 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ab94ab6c-e336-4cb8-9222-859d76cbf5a8 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:38.052747 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ab94ab6c-e336-4cb8-9222-859d76cbf5a8 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:38.053821 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ab94ab6c-e336-4cb8-9222-859d76cbf5a8 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:38.998412 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-00ae897f-cb16-4efa-bce5-bb0bd354308e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:53:39.000368 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-00ae897f-cb16-4efa-bce5-bb0bd354308e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:53:39.001061 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-00ae897f-cb16-4efa-bce5-bb0bd354308e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:53:39.001653 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-00ae897f-cb16-4efa-bce5-bb0bd354308e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:53:39.002350 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-00ae897f-cb16-4efa-bce5-bb0bd354308e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:53:39.007235 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:53:39.052006 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00ae897f-cb16-4efa-bce5-bb0bd354308e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:39.062259 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00ae897f-cb16-4efa-bce5-bb0bd354308e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:39.069901 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00ae897f-cb16-4efa-bce5-bb0bd354308e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:39.071576 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00ae897f-cb16-4efa-bce5-bb0bd354308e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:39.072540 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00ae897f-cb16-4efa-bce5-bb0bd354308e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:39.073367 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00ae897f-cb16-4efa-bce5-bb0bd354308e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:39.160780 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-00ae897f-cb16-4efa-bce5-bb0bd354308e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Getting quotas for project 57eb6c59b1a7467baf0daae9019ca5aa. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:53:39.187987 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-00ae897f-cb16-4efa-bce5-bb0bd354308e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Getting quotas for user 1ead4e0fd51b484c8dd38da5a3975788 and project 57eb6c59b1a7467baf0daae9019ca5aa. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:53:39.243112 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-00ae897f-cb16-4efa-bce5-bb0bd354308e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:53:39.251368 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-00ae897f-cb16-4efa-bce5-bb0bd354308e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: be5d3b39-cea6-47fa-adeb-d79a92a2076a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:53:39.376594 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-00ae897f-cb16-4efa-bce5-bb0bd354308e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.647331 Sep 10 11:53:39.378055 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1601/3280] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:53:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 11:53:39.383266 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-79d1b9ac-7ab0-49ce-9784-550a6386ae45 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:39.384526 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-79d1b9ac-7ab0-49ce-9784-550a6386ae45 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 8d231092-f981-47fe-9994-6fcb031c8a83] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:39.395152 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79d1b9ac-7ab0-49ce-9784-550a6386ae45 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:39.395938 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79d1b9ac-7ab0-49ce-9784-550a6386ae45 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:39.396823 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79d1b9ac-7ab0-49ce-9784-550a6386ae45 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:39.398878 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79d1b9ac-7ab0-49ce-9784-550a6386ae45 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:39.400570 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79d1b9ac-7ab0-49ce-9784-550a6386ae45 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:39.401244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79d1b9ac-7ab0-49ce-9784-550a6386ae45 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:39.435459 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ab94ab6c-e336-4cb8-9222-859d76cbf5a8 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:39.445555 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ab94ab6c-e336-4cb8-9222-859d76cbf5a8 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985" status: 200 len: 1508 microversion: 2.1 time: 1.447063 Sep 10 11:53:39.453888 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1680/3281] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:37 2022] GET /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985 => generated 1508 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:39.464519 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-27e4324a-7b1b-4431-827f-2ca8239c2fbb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:39.465831 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-27e4324a-7b1b-4431-827f-2ca8239c2fbb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:39.481011 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-27e4324a-7b1b-4431-827f-2ca8239c2fbb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:39.481679 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-27e4324a-7b1b-4431-827f-2ca8239c2fbb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:39.482771 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-27e4324a-7b1b-4431-827f-2ca8239c2fbb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:39.488046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-27e4324a-7b1b-4431-827f-2ca8239c2fbb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:39.488646 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-27e4324a-7b1b-4431-827f-2ca8239c2fbb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:39.489199 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-27e4324a-7b1b-4431-827f-2ca8239c2fbb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:39.703612 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-79d1b9ac-7ab0-49ce-9784-550a6386ae45 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318416fa33b40ae98c8c35675b0c101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f44e4274f41c1882cf1a2167dc891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:39.713799 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-79d1b9ac-7ab0-49ce-9784-550a6386ae45 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "GET /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83" status: 200 len: 1282 microversion: 2.1 time: 0.334278 Sep 10 11:53:39.720353 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1602/3282] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:39 2022] GET /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83 => generated 1282 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:39.725696 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-25434b96-e549-401b-b175-2996fab4bb39 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:39.740813 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-25434b96-e549-401b-b175-2996fab4bb39 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: be5d3b39-cea6-47fa-adeb-d79a92a2076a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:40.076756 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-25434b96-e549-401b-b175-2996fab4bb39 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:40.087599 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-25434b96-e549-401b-b175-2996fab4bb39 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a" status: 200 len: 1208 microversion: 2.1 time: 0.365839 Sep 10 11:53:40.121436 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1603/3283] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:39 2022] GET /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a => generated 1208 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:40.190448 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-27e4324a-7b1b-4431-827f-2ca8239c2fbb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:40.209714 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-27e4324a-7b1b-4431-827f-2ca8239c2fbb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:40.216363 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-27e4324a-7b1b-4431-827f-2ca8239c2fbb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:40.220823 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-27e4324a-7b1b-4431-827f-2ca8239c2fbb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1739 microversion: 2.20 time: 0.765316 Sep 10 11:53:40.223551 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1681/3284] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:53:39 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1739 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:53:40.481762 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-47541bae-9b5e-4b20-9174-50257941f8bf tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:40.483650 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-47541bae-9b5e-4b20-9174-50257941f8bf tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:40.510857 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-47541bae-9b5e-4b20-9174-50257941f8bf tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:40.515208 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-47541bae-9b5e-4b20-9174-50257941f8bf tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:40.517593 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-47541bae-9b5e-4b20-9174-50257941f8bf tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:40.520786 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-47541bae-9b5e-4b20-9174-50257941f8bf tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:40.523429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-47541bae-9b5e-4b20-9174-50257941f8bf tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:40.524162 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-47541bae-9b5e-4b20-9174-50257941f8bf tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:40.745403 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0915154b-96b9-40b7-85aa-20bfc07c7979 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:40.750515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0915154b-96b9-40b7-85aa-20bfc07c7979 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 8d231092-f981-47fe-9994-6fcb031c8a83] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:40.800455 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0915154b-96b9-40b7-85aa-20bfc07c7979 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:40.800987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0915154b-96b9-40b7-85aa-20bfc07c7979 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:40.807462 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0915154b-96b9-40b7-85aa-20bfc07c7979 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:40.808291 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0915154b-96b9-40b7-85aa-20bfc07c7979 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:40.808778 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0915154b-96b9-40b7-85aa-20bfc07c7979 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:40.809214 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0915154b-96b9-40b7-85aa-20bfc07c7979 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:41.641063 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-47541bae-9b5e-4b20-9174-50257941f8bf tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:41.665027 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-47541bae-9b5e-4b20-9174-50257941f8bf tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985" status: 200 len: 1512 microversion: 2.1 time: 1.174256 Sep 10 11:53:41.668665 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1604/3285] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:40 2022] GET /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985 => generated 1512 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:41.687281 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7993d231-0c1b-4690-a052-a4001ff5af5f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:41.693288 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7993d231-0c1b-4690-a052-a4001ff5af5f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: be5d3b39-cea6-47fa-adeb-d79a92a2076a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:41.721504 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7993d231-0c1b-4690-a052-a4001ff5af5f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:41.722368 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7993d231-0c1b-4690-a052-a4001ff5af5f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:41.726509 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7993d231-0c1b-4690-a052-a4001ff5af5f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:41.729038 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7993d231-0c1b-4690-a052-a4001ff5af5f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:41.730905 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7993d231-0c1b-4690-a052-a4001ff5af5f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:41.734368 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7993d231-0c1b-4690-a052-a4001ff5af5f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:41.879486 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7993d231-0c1b-4690-a052-a4001ff5af5f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:41.896079 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7993d231-0c1b-4690-a052-a4001ff5af5f tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a" status: 200 len: 1260 microversion: 2.1 time: 0.225967 Sep 10 11:53:41.896870 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1605/3286] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:41 2022] GET /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a => generated 1260 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:41.898771 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0915154b-96b9-40b7-85aa-20bfc07c7979 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318416fa33b40ae98c8c35675b0c101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f44e4274f41c1882cf1a2167dc891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:41.901497 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2229b5b3-ea53-4487-85a4-40e8f3869ec9 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:41.902119 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2229b5b3-ea53-4487-85a4-40e8f3869ec9 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:41.910918 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0915154b-96b9-40b7-85aa-20bfc07c7979 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "GET /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83" status: 200 len: 1324 microversion: 2.1 time: 1.171734 Sep 10 11:53:41.914614 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2229b5b3-ea53-4487-85a4-40e8f3869ec9 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:41.916362 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2229b5b3-ea53-4487-85a4-40e8f3869ec9 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:41.917136 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2229b5b3-ea53-4487-85a4-40e8f3869ec9 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:41.919072 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2229b5b3-ea53-4487-85a4-40e8f3869ec9 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:41.927611 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2229b5b3-ea53-4487-85a4-40e8f3869ec9 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:41.928330 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2229b5b3-ea53-4487-85a4-40e8f3869ec9 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:41.946594 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1682/3287] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:40 2022] GET /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83 => generated 1324 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:41.959156 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-5d283d06-8eaf-4282-a12e-e6ca6bb80fd6 req-abece67e-867f-427d-a6f3-a662bf15f6d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c56e3146-bad1-4abf-853a-2d01226d85b4", "name": "network-vif-deleted", "tag": "0c512e55-530c-4d6d-9d65-364f8052e833"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:53:41.992848 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-5d283d06-8eaf-4282-a12e-e6ca6bb80fd6 req-abece67e-867f-427d-a6f3-a662bf15f6d0 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:41.994173 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-5d283d06-8eaf-4282-a12e-e6ca6bb80fd6 req-abece67e-867f-427d-a6f3-a662bf15f6d0 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:41.994729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-5d283d06-8eaf-4282-a12e-e6ca6bb80fd6 req-abece67e-867f-427d-a6f3-a662bf15f6d0 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:42.078354 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-5d283d06-8eaf-4282-a12e-e6ca6bb80fd6 req-abece67e-867f-427d-a6f3-a662bf15f6d0 service nova] Creating event network-vif-deleted:0c512e55-530c-4d6d-9d65-364f8052e833 for instance c56e3146-bad1-4abf-853a-2d01226d85b4 on n-h2-856895-1 Sep 10 11:53:42.095655 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-5d283d06-8eaf-4282-a12e-e6ca6bb80fd6 req-abece67e-867f-427d-a6f3-a662bf15f6d0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147238 Sep 10 11:53:42.099617 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1683/3288] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:53:42.134792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-abd5c54b-1d6a-4cb5-ada1-945bb98c3ac8 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:42.156497 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-abd5c54b-1d6a-4cb5-ada1-945bb98c3ac8 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:42.168053 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.compute.servers [None req-abd5c54b-1d6a-4cb5-ada1-945bb98c3ac8 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Removing options 'limit' from query {{(pid=128777) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 10 11:53:42.175738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-abd5c54b-1d6a-4cb5-ada1-945bb98c3ac8 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Searching by: {'deleted': False, 'project_id': '27bed0cb3a46406b92496bee2da42567'} {{(pid=128777) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 11:53:42.177320 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-abd5c54b-1d6a-4cb5-ada1-945bb98c3ac8 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:42.180532 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-abd5c54b-1d6a-4cb5-ada1-945bb98c3ac8 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:42.181266 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-abd5c54b-1d6a-4cb5-ada1-945bb98c3ac8 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:42.186709 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-abd5c54b-1d6a-4cb5-ada1-945bb98c3ac8 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:42.192824 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-abd5c54b-1d6a-4cb5-ada1-945bb98c3ac8 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:42.194956 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-abd5c54b-1d6a-4cb5-ada1-945bb98c3ac8 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:42.202036 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-abd5c54b-1d6a-4cb5-ada1-945bb98c3ac8 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.100729 Sep 10 11:53:42.211766 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1684/3289] 10.222.0.23 () {58 vars in 1140 bytes} [Sat Sep 10 11:53:42 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:53:42.230206 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e3c41cea-9b19-4fb0-86cf-35659ec497cd tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:42.233905 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e3c41cea-9b19-4fb0-86cf-35659ec497cd tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:42.252335 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e3c41cea-9b19-4fb0-86cf-35659ec497cd tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:42.253236 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e3c41cea-9b19-4fb0-86cf-35659ec497cd tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:42.261210 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e3c41cea-9b19-4fb0-86cf-35659ec497cd tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:42.263504 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e3c41cea-9b19-4fb0-86cf-35659ec497cd tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:42.265023 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e3c41cea-9b19-4fb0-86cf-35659ec497cd tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:42.267197 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e3c41cea-9b19-4fb0-86cf-35659ec497cd tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:43.117815 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2229b5b3-ea53-4487-85a4-40e8f3869ec9 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:43.132518 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2229b5b3-ea53-4487-85a4-40e8f3869ec9 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:43.194925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e3c41cea-9b19-4fb0-86cf-35659ec497cd tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:43.195773 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2229b5b3-ea53-4487-85a4-40e8f3869ec9 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:43.195773 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2229b5b3-ea53-4487-85a4-40e8f3869ec9 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1739 microversion: 2.20 time: 1.268080 Sep 10 11:53:43.195981 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e3c41cea-9b19-4fb0-86cf-35659ec497cd tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985" status: 200 len: 1512 microversion: 2.1 time: 0.960571 Sep 10 11:53:43.196083 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1606/3290] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:53:41 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1739 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:53:43.196174 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1685/3291] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:42 2022] GET /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985 => generated 1512 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:43.208264 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-da9ec8cf-004a-45d7-990c-7734201134ee tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:43.208942 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-da9ec8cf-004a-45d7-990c-7734201134ee tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: 3ce09007-d5b4-4565-96db-00ec7c98fb75] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:43.217978 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fcffbc84-db3b-45d8-9fb7-26d32a8a9053 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:43.218880 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fcffbc84-db3b-45d8-9fb7-26d32a8a9053 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: be5d3b39-cea6-47fa-adeb-d79a92a2076a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:43.234442 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da9ec8cf-004a-45d7-990c-7734201134ee tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:43.235622 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da9ec8cf-004a-45d7-990c-7734201134ee tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:43.237804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da9ec8cf-004a-45d7-990c-7734201134ee tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:43.240935 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da9ec8cf-004a-45d7-990c-7734201134ee tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:43.242052 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da9ec8cf-004a-45d7-990c-7734201134ee tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:43.242760 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da9ec8cf-004a-45d7-990c-7734201134ee tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:43.243222 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fcffbc84-db3b-45d8-9fb7-26d32a8a9053 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:43.243830 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fcffbc84-db3b-45d8-9fb7-26d32a8a9053 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:43.245736 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fcffbc84-db3b-45d8-9fb7-26d32a8a9053 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:43.248693 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fcffbc84-db3b-45d8-9fb7-26d32a8a9053 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:43.249840 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fcffbc84-db3b-45d8-9fb7-26d32a8a9053 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:43.250536 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fcffbc84-db3b-45d8-9fb7-26d32a8a9053 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:43.328333 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-da9ec8cf-004a-45d7-990c-7734201134ee tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: 3ce09007-d5b4-4565-96db-00ec7c98fb75] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:53:43.350210 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:53:43.382764 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:53:43.400452 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fcffbc84-db3b-45d8-9fb7-26d32a8a9053 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:43.424735 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:53:43.433705 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fcffbc84-db3b-45d8-9fb7-26d32a8a9053 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a" status: 200 len: 1266 microversion: 2.1 time: 0.238295 Sep 10 11:53:43.441327 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1686/3292] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:43 2022] GET /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a => generated 1266 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:43.458002 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-300c999b-2a04-4d6b-bb4e-c432d0c0bc94 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:43.458894 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-300c999b-2a04-4d6b-bb4e-c432d0c0bc94 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 8d231092-f981-47fe-9994-6fcb031c8a83] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:43.516583 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-300c999b-2a04-4d6b-bb4e-c432d0c0bc94 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:43.518525 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-300c999b-2a04-4d6b-bb4e-c432d0c0bc94 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:43.520962 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-300c999b-2a04-4d6b-bb4e-c432d0c0bc94 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:43.522084 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-300c999b-2a04-4d6b-bb4e-c432d0c0bc94 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:43.522761 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-300c999b-2a04-4d6b-bb4e-c432d0c0bc94 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:43.525350 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-300c999b-2a04-4d6b-bb4e-c432d0c0bc94 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:43.629221 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-da9ec8cf-004a-45d7-990c-7734201134ee tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3ce09007-d5b4-4565-96db-00ec7c98fb75" status: 204 len: 0 microversion: 2.1 time: 0.450557 Sep 10 11:53:43.635386 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1607/3293] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:53:43 2022] DELETE /compute/v2.1/servers/3ce09007-d5b4-4565-96db-00ec7c98fb75 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:53:43.647589 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f6607bc1-f0df-4e43-a298-252f0f3b06db tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:43.661888 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f6607bc1-f0df-4e43-a298-252f0f3b06db tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: a4dbe5aa-fddd-42e7-b422-1585785f6034] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:43.681056 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f6607bc1-f0df-4e43-a298-252f0f3b06db tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:43.692711 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f6607bc1-f0df-4e43-a298-252f0f3b06db tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:43.695789 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f6607bc1-f0df-4e43-a298-252f0f3b06db tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:43.698584 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f6607bc1-f0df-4e43-a298-252f0f3b06db tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:43.704100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f6607bc1-f0df-4e43-a298-252f0f3b06db tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:43.704773 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f6607bc1-f0df-4e43-a298-252f0f3b06db tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:43.898959 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-300c999b-2a04-4d6b-bb4e-c432d0c0bc94 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318416fa33b40ae98c8c35675b0c101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f44e4274f41c1882cf1a2167dc891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:43.914803 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-300c999b-2a04-4d6b-bb4e-c432d0c0bc94 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "GET /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83" status: 200 len: 1324 microversion: 2.1 time: 0.470288 Sep 10 11:53:43.916562 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1687/3294] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:43 2022] GET /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83 => generated 1324 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:43.930473 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5c40550f-ab64-4c66-9b28-a220f2b43f69 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:43.937397 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5c40550f-ab64-4c66-9b28-a220f2b43f69 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: 3ce09007-d5b4-4565-96db-00ec7c98fb75] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:43.960883 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c40550f-ab64-4c66-9b28-a220f2b43f69 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:43.962434 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c40550f-ab64-4c66-9b28-a220f2b43f69 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:43.966004 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c40550f-ab64-4c66-9b28-a220f2b43f69 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:43.971086 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c40550f-ab64-4c66-9b28-a220f2b43f69 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:43.972406 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c40550f-ab64-4c66-9b28-a220f2b43f69 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:43.975613 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c40550f-ab64-4c66-9b28-a220f2b43f69 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:44.364768 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f6607bc1-f0df-4e43-a298-252f0f3b06db tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:44.372707 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f6607bc1-f0df-4e43-a298-252f0f3b06db tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/a4dbe5aa-fddd-42e7-b422-1585785f6034" status: 200 len: 1513 microversion: 2.1 time: 0.729373 Sep 10 11:53:44.377653 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1608/3295] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:43 2022] GET /compute/v2.1/servers/a4dbe5aa-fddd-42e7-b422-1585785f6034 => generated 1513 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:44.382458 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fe7c8a6e-ba02-4264-943a-c65f364c3127 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:44.383075 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fe7c8a6e-ba02-4264-943a-c65f364c3127 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:44.417759 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe7c8a6e-ba02-4264-943a-c65f364c3127 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:44.418287 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe7c8a6e-ba02-4264-943a-c65f364c3127 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:44.418882 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe7c8a6e-ba02-4264-943a-c65f364c3127 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:44.419653 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe7c8a6e-ba02-4264-943a-c65f364c3127 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:44.425668 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe7c8a6e-ba02-4264-943a-c65f364c3127 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:44.426242 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe7c8a6e-ba02-4264-943a-c65f364c3127 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:44.441454 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5c40550f-ab64-4c66-9b28-a220f2b43f69 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be647276cc456e83dacd25b98e37f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20756c1a77fb44f684973f382b802825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:44.451734 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5c40550f-ab64-4c66-9b28-a220f2b43f69 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/3ce09007-d5b4-4565-96db-00ec7c98fb75" status: 200 len: 1552 microversion: 2.1 time: 0.532398 Sep 10 11:53:44.454972 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1688/3296] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:43 2022] GET /compute/v2.1/servers/3ce09007-d5b4-4565-96db-00ec7c98fb75 => generated 1552 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:44.467192 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fb694f95-718e-4a0f-81bd-7c7012235b90 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:44.470668 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fb694f95-718e-4a0f-81bd-7c7012235b90 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 0954dadf-c6a9-4b78-b38d-2febfb54736a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:44.496451 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fb694f95-718e-4a0f-81bd-7c7012235b90 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:44.497902 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fb694f95-718e-4a0f-81bd-7c7012235b90 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:44.503679 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fb694f95-718e-4a0f-81bd-7c7012235b90 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:44.504978 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fb694f95-718e-4a0f-81bd-7c7012235b90 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:44.509456 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fb694f95-718e-4a0f-81bd-7c7012235b90 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:44.512016 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fb694f95-718e-4a0f-81bd-7c7012235b90 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:44.738368 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fe7c8a6e-ba02-4264-943a-c65f364c3127 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:44.747499 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fe7c8a6e-ba02-4264-943a-c65f364c3127 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:44.749151 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fe7c8a6e-ba02-4264-943a-c65f364c3127 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:44.750392 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fe7c8a6e-ba02-4264-943a-c65f364c3127 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1739 microversion: 2.20 time: 0.371721 Sep 10 11:53:44.750975 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1609/3297] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:53:44 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1739 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:53:44.787577 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-00c1d8e2-5a01-4117-ae2b-814d559e97b2 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:44.789243 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-00c1d8e2-5a01-4117-ae2b-814d559e97b2 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: be5d3b39-cea6-47fa-adeb-d79a92a2076a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:44.807238 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00c1d8e2-5a01-4117-ae2b-814d559e97b2 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:44.808164 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00c1d8e2-5a01-4117-ae2b-814d559e97b2 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:44.808865 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00c1d8e2-5a01-4117-ae2b-814d559e97b2 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:44.809834 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00c1d8e2-5a01-4117-ae2b-814d559e97b2 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:44.810545 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00c1d8e2-5a01-4117-ae2b-814d559e97b2 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:44.811549 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00c1d8e2-5a01-4117-ae2b-814d559e97b2 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:44.967310 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-00c1d8e2-5a01-4117-ae2b-814d559e97b2 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:44.977250 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-00c1d8e2-5a01-4117-ae2b-814d559e97b2 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a" status: 200 len: 1266 microversion: 2.1 time: 0.202030 Sep 10 11:53:44.986333 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1610/3298] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:44 2022] GET /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:44.993727 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-a62606be-7f3c-4c3c-ac3a-7c20f6d330c9 req-c4331b86-b89d-4ff5-b192-31f799e9cde1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d231092-f981-47fe-9994-6fcb031c8a83", "tag": "8c8742ac-1c89-456c-9fd1-cc7ed178f4dd"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:53:45.034547 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=4 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:53:45.039404 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a62606be-7f3c-4c3c-ac3a-7c20f6d330c9 req-c4331b86-b89d-4ff5-b192-31f799e9cde1 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:45.039962 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a62606be-7f3c-4c3c-ac3a-7c20f6d330c9 req-c4331b86-b89d-4ff5-b192-31f799e9cde1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:45.040314 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a62606be-7f3c-4c3c-ac3a-7c20f6d330c9 req-c4331b86-b89d-4ff5-b192-31f799e9cde1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:45.065534 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-a62606be-7f3c-4c3c-ac3a-7c20f6d330c9 req-c4331b86-b89d-4ff5-b192-31f799e9cde1 service nova] Creating event network-changed:8c8742ac-1c89-456c-9fd1-cc7ed178f4dd for instance 8d231092-f981-47fe-9994-6fcb031c8a83 on n-h1-856895-1 Sep 10 11:53:45.074659 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-a62606be-7f3c-4c3c-ac3a-7c20f6d330c9 req-c4331b86-b89d-4ff5-b192-31f799e9cde1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083948 Sep 10 11:53:45.075980 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1611/3299] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:53:45.087326 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1df83853-7b13-49cd-920f-d4497dafaa94 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:45.088270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1df83853-7b13-49cd-920f-d4497dafaa94 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 8d231092-f981-47fe-9994-6fcb031c8a83] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:45.100371 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1df83853-7b13-49cd-920f-d4497dafaa94 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:45.101416 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1df83853-7b13-49cd-920f-d4497dafaa94 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:45.102288 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1df83853-7b13-49cd-920f-d4497dafaa94 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:45.104294 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1df83853-7b13-49cd-920f-d4497dafaa94 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:45.104985 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1df83853-7b13-49cd-920f-d4497dafaa94 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:45.107368 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1df83853-7b13-49cd-920f-d4497dafaa94 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:45.141760 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fb694f95-718e-4a0f-81bd-7c7012235b90 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:45.151855 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fb694f95-718e-4a0f-81bd-7c7012235b90 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a" status: 200 len: 1511 microversion: 2.1 time: 0.693228 Sep 10 11:53:45.156330 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1689/3300] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:44 2022] GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a => generated 1511 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:45.179532 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-53bccb9b-9145-48e7-b7b0-fb1a5d086fe1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:45.186784 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-53bccb9b-9145-48e7-b7b0-fb1a5d086fe1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:45.187531 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-53bccb9b-9145-48e7-b7b0-fb1a5d086fe1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Searching by: {'ip': '172.20.0.12', 'deleted': False, 'project_id': '27bed0cb3a46406b92496bee2da42567'} {{(pid=128777) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 11:53:45.412469 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-53bccb9b-9145-48e7-b7b0-fb1a5d086fe1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:45.412888 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-53bccb9b-9145-48e7-b7b0-fb1a5d086fe1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:45.413336 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-53bccb9b-9145-48e7-b7b0-fb1a5d086fe1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:45.414078 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-53bccb9b-9145-48e7-b7b0-fb1a5d086fe1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:45.414545 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-53bccb9b-9145-48e7-b7b0-fb1a5d086fe1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:45.414975 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-53bccb9b-9145-48e7-b7b0-fb1a5d086fe1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:45.578020 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.multi_cell_list [None req-53bccb9b-9145-48e7-b7b0-fb1a5d086fe1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128777) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 11:53:45.649192 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-53bccb9b-9145-48e7-b7b0-fb1a5d086fe1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers?ip=172.20.0.12" status: 200 len: 346 microversion: 2.1 time: 0.473824 Sep 10 11:53:45.650434 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1690/3301] 10.222.0.23 () {58 vars in 1154 bytes} [Sat Sep 10 11:53:45 2022] GET /compute/v2.1/servers?ip=172.20.0.12 => generated 346 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:53:45.665440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-355030b1-cdf4-4047-996c-a4ddcc1dce8b tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:45.666407 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-355030b1-cdf4-4047-996c-a4ddcc1dce8b tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: 3ce09007-d5b4-4565-96db-00ec7c98fb75] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:45.674432 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-355030b1-cdf4-4047-996c-a4ddcc1dce8b tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:45.675510 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-355030b1-cdf4-4047-996c-a4ddcc1dce8b tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:45.676209 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-355030b1-cdf4-4047-996c-a4ddcc1dce8b tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:45.677131 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-355030b1-cdf4-4047-996c-a4ddcc1dce8b tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:45.677773 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-355030b1-cdf4-4047-996c-a4ddcc1dce8b tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:45.678377 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-355030b1-cdf4-4047-996c-a4ddcc1dce8b tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:46.129278 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1df83853-7b13-49cd-920f-d4497dafaa94 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318416fa33b40ae98c8c35675b0c101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f44e4274f41c1882cf1a2167dc891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:46.150021 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1df83853-7b13-49cd-920f-d4497dafaa94 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "GET /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83" status: 200 len: 1324 microversion: 2.1 time: 1.070764 Sep 10 11:53:46.157566 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1612/3302] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:45 2022] GET /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83 => generated 1324 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:46.169766 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f8dd845e-f261-45de-9825-436a7689ce4d tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:46.170399 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f8dd845e-f261-45de-9825-436a7689ce4d tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:46.183585 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-355030b1-cdf4-4047-996c-a4ddcc1dce8b tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be647276cc456e83dacd25b98e37f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20756c1a77fb44f684973f382b802825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:46.184193 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f8dd845e-f261-45de-9825-436a7689ce4d tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:46.184947 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f8dd845e-f261-45de-9825-436a7689ce4d tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:46.185578 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f8dd845e-f261-45de-9825-436a7689ce4d tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:46.187111 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f8dd845e-f261-45de-9825-436a7689ce4d tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:46.188126 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f8dd845e-f261-45de-9825-436a7689ce4d tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:46.188970 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f8dd845e-f261-45de-9825-436a7689ce4d tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:46.193005 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-355030b1-cdf4-4047-996c-a4ddcc1dce8b tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/3ce09007-d5b4-4565-96db-00ec7c98fb75" status: 200 len: 1552 microversion: 2.1 time: 0.540842 Sep 10 11:53:46.213858 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1691/3303] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:45 2022] GET /compute/v2.1/servers/3ce09007-d5b4-4565-96db-00ec7c98fb75 => generated 1552 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:46.219494 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ce22fc27-472f-44ad-923b-6bdacb8c6e30 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:46.220119 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ce22fc27-472f-44ad-923b-6bdacb8c6e30 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:46.236825 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ce22fc27-472f-44ad-923b-6bdacb8c6e30 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:46.237253 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ce22fc27-472f-44ad-923b-6bdacb8c6e30 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:46.237681 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ce22fc27-472f-44ad-923b-6bdacb8c6e30 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:46.238388 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ce22fc27-472f-44ad-923b-6bdacb8c6e30 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:46.238842 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ce22fc27-472f-44ad-923b-6bdacb8c6e30 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:46.239299 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ce22fc27-472f-44ad-923b-6bdacb8c6e30 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:46.677638 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f8dd845e-f261-45de-9825-436a7689ce4d tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:46.691024 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f8dd845e-f261-45de-9825-436a7689ce4d tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985" status: 200 len: 1512 microversion: 2.1 time: 0.530635 Sep 10 11:53:46.692213 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1613/3304] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:46 2022] GET /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985 => generated 1512 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:46.696990 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d0c1944b-d371-4b9f-b3ba-6c34be649aca tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:46.699029 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d0c1944b-d371-4b9f-b3ba-6c34be649aca tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: be5d3b39-cea6-47fa-adeb-d79a92a2076a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:46.710078 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d0c1944b-d371-4b9f-b3ba-6c34be649aca tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:46.711367 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d0c1944b-d371-4b9f-b3ba-6c34be649aca tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:46.712054 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d0c1944b-d371-4b9f-b3ba-6c34be649aca tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:46.713016 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d0c1944b-d371-4b9f-b3ba-6c34be649aca tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:46.713478 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d0c1944b-d371-4b9f-b3ba-6c34be649aca tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:46.713909 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d0c1944b-d371-4b9f-b3ba-6c34be649aca tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:46.723657 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ce22fc27-472f-44ad-923b-6bdacb8c6e30 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:46.744335 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ce22fc27-472f-44ad-923b-6bdacb8c6e30 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:46.748284 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ce22fc27-472f-44ad-923b-6bdacb8c6e30 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:46.754917 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ce22fc27-472f-44ad-923b-6bdacb8c6e30 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1739 microversion: 2.20 time: 0.537877 Sep 10 11:53:46.756889 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1692/3305] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:53:46 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1739 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:53:46.769678 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-22642a4d-84e2-4d9f-bbdb-879226840878 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:46.772712 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-22642a4d-84e2-4d9f-bbdb-879226840878 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: a4dbe5aa-fddd-42e7-b422-1585785f6034] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:46.789305 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-22642a4d-84e2-4d9f-bbdb-879226840878 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:46.790997 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-22642a4d-84e2-4d9f-bbdb-879226840878 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:46.791546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-22642a4d-84e2-4d9f-bbdb-879226840878 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:46.792583 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-22642a4d-84e2-4d9f-bbdb-879226840878 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:46.799107 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-22642a4d-84e2-4d9f-bbdb-879226840878 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:46.800187 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-22642a4d-84e2-4d9f-bbdb-879226840878 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:47.182211 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d0c1944b-d371-4b9f-b3ba-6c34be649aca tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:47.192015 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d0c1944b-d371-4b9f-b3ba-6c34be649aca tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a" status: 200 len: 1308 microversion: 2.1 time: 0.498659 Sep 10 11:53:47.207480 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1614/3306] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:46 2022] GET /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a => generated 1308 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:47.219918 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2e052282-b692-4585-af16-f7478410399f tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:47.220931 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2e052282-b692-4585-af16-f7478410399f tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 8d231092-f981-47fe-9994-6fcb031c8a83] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:47.228779 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e052282-b692-4585-af16-f7478410399f tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:47.229622 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e052282-b692-4585-af16-f7478410399f tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:47.230318 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e052282-b692-4585-af16-f7478410399f tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:47.231463 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e052282-b692-4585-af16-f7478410399f tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:47.232164 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e052282-b692-4585-af16-f7478410399f tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:47.232901 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e052282-b692-4585-af16-f7478410399f tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:47.461406 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-22642a4d-84e2-4d9f-bbdb-879226840878 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:47.478792 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-22642a4d-84e2-4d9f-bbdb-879226840878 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/a4dbe5aa-fddd-42e7-b422-1585785f6034" status: 200 len: 1513 microversion: 2.1 time: 0.720036 Sep 10 11:53:47.483431 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1693/3307] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:46 2022] GET /compute/v2.1/servers/a4dbe5aa-fddd-42e7-b422-1585785f6034 => generated 1513 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:47.507059 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d88462e6-5627-4e4e-b615-56412540ef6b tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:47.508009 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d88462e6-5627-4e4e-b615-56412540ef6b tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: 3ce09007-d5b4-4565-96db-00ec7c98fb75] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:47.535270 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d88462e6-5627-4e4e-b615-56412540ef6b tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:47.535985 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d88462e6-5627-4e4e-b615-56412540ef6b tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:47.544330 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d88462e6-5627-4e4e-b615-56412540ef6b tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:47.548195 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d88462e6-5627-4e4e-b615-56412540ef6b tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:47.549747 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d88462e6-5627-4e4e-b615-56412540ef6b tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:47.556055 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d88462e6-5627-4e4e-b615-56412540ef6b tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:47.810662 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2e052282-b692-4585-af16-f7478410399f tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318416fa33b40ae98c8c35675b0c101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f44e4274f41c1882cf1a2167dc891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:47.830245 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2e052282-b692-4585-af16-f7478410399f tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "GET /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83" status: 200 len: 1324 microversion: 2.1 time: 0.621148 Sep 10 11:53:47.836166 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1615/3308] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:47 2022] GET /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83 => generated 1324 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:47.864242 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2829afd9-dbfd-435c-bdda-4dd7ab6423ed tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:47.865023 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2829afd9-dbfd-435c-bdda-4dd7ab6423ed tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 0954dadf-c6a9-4b78-b38d-2febfb54736a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:47.873074 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2829afd9-dbfd-435c-bdda-4dd7ab6423ed tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:47.873642 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2829afd9-dbfd-435c-bdda-4dd7ab6423ed tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:47.874089 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2829afd9-dbfd-435c-bdda-4dd7ab6423ed tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:47.874813 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2829afd9-dbfd-435c-bdda-4dd7ab6423ed tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:47.875304 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2829afd9-dbfd-435c-bdda-4dd7ab6423ed tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:47.875747 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2829afd9-dbfd-435c-bdda-4dd7ab6423ed tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:47.884287 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d88462e6-5627-4e4e-b615-56412540ef6b tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be647276cc456e83dacd25b98e37f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20756c1a77fb44f684973f382b802825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:47.894935 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d88462e6-5627-4e4e-b615-56412540ef6b tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/3ce09007-d5b4-4565-96db-00ec7c98fb75" status: 200 len: 1484 microversion: 2.1 time: 0.404802 Sep 10 11:53:47.899506 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1694/3309] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:47 2022] GET /compute/v2.1/servers/3ce09007-d5b4-4565-96db-00ec7c98fb75 => generated 1484 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:47.907065 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-f6753118-e8c8-40ad-8f15-cddaecbaf844 req-54485d0c-8cab-4eea-b32a-64b927e8af54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ce09007-d5b4-4565-96db-00ec7c98fb75", "name": "network-vif-deleted", "tag": "bbf418c3-dbbf-4738-a16c-ef5fd6cb4d15"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:53:47.924902 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-f6753118-e8c8-40ad-8f15-cddaecbaf844 req-54485d0c-8cab-4eea-b32a-64b927e8af54 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:47.925822 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-f6753118-e8c8-40ad-8f15-cddaecbaf844 req-54485d0c-8cab-4eea-b32a-64b927e8af54 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:47.926437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-f6753118-e8c8-40ad-8f15-cddaecbaf844 req-54485d0c-8cab-4eea-b32a-64b927e8af54 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:47.960343 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-f6753118-e8c8-40ad-8f15-cddaecbaf844 req-54485d0c-8cab-4eea-b32a-64b927e8af54 service nova] Creating event network-vif-deleted:bbf418c3-dbbf-4738-a16c-ef5fd6cb4d15 for instance 3ce09007-d5b4-4565-96db-00ec7c98fb75 on n-h2-856895-1 Sep 10 11:53:47.974978 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-f6753118-e8c8-40ad-8f15-cddaecbaf844 req-54485d0c-8cab-4eea-b32a-64b927e8af54 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073966 Sep 10 11:53:47.980154 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1695/3310] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:53:47.987265 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3cdc1d6a-5eaa-4093-866b-db604e6cbbe4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:47.988170 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3cdc1d6a-5eaa-4093-866b-db604e6cbbe4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:48.001411 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3cdc1d6a-5eaa-4093-866b-db604e6cbbe4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:48.004568 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3cdc1d6a-5eaa-4093-866b-db604e6cbbe4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:48.011219 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3cdc1d6a-5eaa-4093-866b-db604e6cbbe4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:48.012493 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3cdc1d6a-5eaa-4093-866b-db604e6cbbe4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:48.013343 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3cdc1d6a-5eaa-4093-866b-db604e6cbbe4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:48.013965 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3cdc1d6a-5eaa-4093-866b-db604e6cbbe4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:48.530918 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2829afd9-dbfd-435c-bdda-4dd7ab6423ed tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:48.539186 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2829afd9-dbfd-435c-bdda-4dd7ab6423ed tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a" status: 200 len: 1511 microversion: 2.1 time: 0.701861 Sep 10 11:53:48.549081 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1616/3311] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:47 2022] GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a => generated 1511 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:48.557212 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f7e31e51-4ba4-4ba2-8472-55e2e250fb55 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:48.580101 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f7e31e51-4ba4-4ba2-8472-55e2e250fb55 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: be5d3b39-cea6-47fa-adeb-d79a92a2076a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:48.605339 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f7e31e51-4ba4-4ba2-8472-55e2e250fb55 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:48.609206 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f7e31e51-4ba4-4ba2-8472-55e2e250fb55 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:48.617899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f7e31e51-4ba4-4ba2-8472-55e2e250fb55 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:48.619501 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f7e31e51-4ba4-4ba2-8472-55e2e250fb55 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:48.620165 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f7e31e51-4ba4-4ba2-8472-55e2e250fb55 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:48.622722 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f7e31e51-4ba4-4ba2-8472-55e2e250fb55 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:48.658506 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3cdc1d6a-5eaa-4093-866b-db604e6cbbe4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:48.678099 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3cdc1d6a-5eaa-4093-866b-db604e6cbbe4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:48.694410 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3cdc1d6a-5eaa-4093-866b-db604e6cbbe4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:48.701287 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3cdc1d6a-5eaa-4093-866b-db604e6cbbe4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1739 microversion: 2.20 time: 0.719652 Sep 10 11:53:48.713934 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1696/3312] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:53:47 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1739 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:53:48.733489 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5fe8d399-2a42-4f8b-89b9-4bc39aea0b8a tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:48.760941 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5fe8d399-2a42-4f8b-89b9-4bc39aea0b8a tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:48.774961 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5fe8d399-2a42-4f8b-89b9-4bc39aea0b8a tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Searching by: {'deleted': False, 'project_id': '27bed0cb3a46406b92496bee2da42567'} {{(pid=128777) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 11:53:48.794670 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5fe8d399-2a42-4f8b-89b9-4bc39aea0b8a tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:48.795572 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5fe8d399-2a42-4f8b-89b9-4bc39aea0b8a tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:48.797147 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5fe8d399-2a42-4f8b-89b9-4bc39aea0b8a tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:48.799985 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5fe8d399-2a42-4f8b-89b9-4bc39aea0b8a tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:48.800702 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5fe8d399-2a42-4f8b-89b9-4bc39aea0b8a tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:48.802373 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5fe8d399-2a42-4f8b-89b9-4bc39aea0b8a tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:48.847947 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.multi_cell_list [None req-5fe8d399-2a42-4f8b-89b9-4bc39aea0b8a tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128777) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 11:53:48.931303 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5fe8d399-2a42-4f8b-89b9-4bc39aea0b8a tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:48.945578 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5fe8d399-2a42-4f8b-89b9-4bc39aea0b8a tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:48.946079 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5fe8d399-2a42-4f8b-89b9-4bc39aea0b8a tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:48.946535 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5fe8d399-2a42-4f8b-89b9-4bc39aea0b8a tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:49.112506 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=4 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:53:49.541924 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f7e31e51-4ba4-4ba2-8472-55e2e250fb55 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:49.565782 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f7e31e51-4ba4-4ba2-8472-55e2e250fb55 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a" status: 200 len: 1308 microversion: 2.1 time: 1.011687 Sep 10 11:53:49.576458 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5fe8d399-2a42-4f8b-89b9-4bc39aea0b8a tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 4519 microversion: 2.1 time: 0.861075 Sep 10 11:53:49.578313 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1697/3313] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:53:48 2022] GET /compute/v2.1/servers/detail => generated 4519 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:49.583970 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a425c10a-876e-45ae-b77e-429b6e6d3637 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:49.584858 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a425c10a-876e-45ae-b77e-429b6e6d3637 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 8d231092-f981-47fe-9994-6fcb031c8a83] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:49.593537 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1617/3314] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:48 2022] GET /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a => generated 1308 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:49.611714 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c3cec7d6-6b75-4369-aa7e-3df933293671 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:49.613740 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c3cec7d6-6b75-4369-aa7e-3df933293671 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: 3ce09007-d5b4-4565-96db-00ec7c98fb75] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:49.624583 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3cec7d6-6b75-4369-aa7e-3df933293671 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:49.625433 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3cec7d6-6b75-4369-aa7e-3df933293671 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:49.626051 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3cec7d6-6b75-4369-aa7e-3df933293671 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:49.626955 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3cec7d6-6b75-4369-aa7e-3df933293671 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:49.628725 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a425c10a-876e-45ae-b77e-429b6e6d3637 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:49.629236 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a425c10a-876e-45ae-b77e-429b6e6d3637 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:49.629680 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a425c10a-876e-45ae-b77e-429b6e6d3637 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:49.638574 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a425c10a-876e-45ae-b77e-429b6e6d3637 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:49.639079 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a425c10a-876e-45ae-b77e-429b6e6d3637 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:49.643663 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3cec7d6-6b75-4369-aa7e-3df933293671 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:49.644404 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a425c10a-876e-45ae-b77e-429b6e6d3637 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:49.645943 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3cec7d6-6b75-4369-aa7e-3df933293671 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:49.666300 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-c3cec7d6-6b75-4369-aa7e-3df933293671 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] HTTP exception thrown: Instance 3ce09007-d5b4-4565-96db-00ec7c98fb75 could not be found. Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c3cec7d6-6b75-4369-aa7e-3df933293671 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Request method failure captured: Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/3ce09007-d5b4-4565-96db-00ec7c98fb75 HTTP/1.1 Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHogBq53-9-XubuuhITXNAF47e9O-F9j2HmPN_ZAzaILKfi2Pl_nRVBUKY6RJ7-rmxz_SsMp1i-0LR3WIJrp6wvP30HF1ctVN0zxdUOu1_0G2ypEN75gjPKuhWZo4Ir5rxwwebmKbjCQ_9abPeiN1PkPhkBLPpGBAigOh69JHiUiI_c Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 20756c1a77fb44f684973f382b802825 Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-TestNetworkBasicOps-1480462047 Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20756c1a77fb44f684973f382b802825"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20756c1a77fb44f684973f382b802825"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_20756c1a77fb44f684973f382b802825", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/20756c1a77fb44f684973f382b802825"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-TestNetworkBasicOps-1480462047 Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 20756c1a77fb44f684973f382b802825 Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-TestNetworkBasicOps-1480462047 Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-TestNetworkBasicOps-1480462047-project Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 92be647276cc456e83dacd25b98e37f2 Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-TestNetworkBasicOps-1480462047-project Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 3ce09007-d5b4-4565-96db-00ec7c98fb75 could not be found. Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '3ce09007-d5b4-4565-96db-00ec7c98fb75'} Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ce09007-d5b4-4565-96db-00ec7c98fb75 could not be found. Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ce09007-d5b4-4565-96db-00ec7c98fb75 could not be found. Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:53:49.668530 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:53:49.674593 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:53:49.674593 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:53:49.674593 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:53:49.674593 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:53:49.674593 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:53:49.674593 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ce09007-d5b4-4565-96db-00ec7c98fb75 could not be found. Sep 10 11:53:49.674593 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:53:49.676869 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c3cec7d6-6b75-4369-aa7e-3df933293671 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Returning 404 to user: Instance 3ce09007-d5b4-4565-96db-00ec7c98fb75 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:53:49.688117 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c3cec7d6-6b75-4369-aa7e-3df933293671 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/3ce09007-d5b4-4565-96db-00ec7c98fb75" status: 404 len: 111 microversion: 2.1 time: 0.093107 Sep 10 11:53:49.689007 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1618/3315] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:49 2022] GET /compute/v2.1/servers/3ce09007-d5b4-4565-96db-00ec7c98fb75 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:53:49.921510 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-3f7f8858-2a41-4f5c-96a8-1aec642ad3cc req-d43ecdf2-685e-4e23-9e27-1bc9fd1eb402 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be5d3b39-cea6-47fa-adeb-d79a92a2076a", "tag": "8e02d220-253c-4ad6-8b9e-e09ad96099e3"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:53:49.939993 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-3f7f8858-2a41-4f5c-96a8-1aec642ad3cc req-d43ecdf2-685e-4e23-9e27-1bc9fd1eb402 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:49.942847 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-3f7f8858-2a41-4f5c-96a8-1aec642ad3cc req-d43ecdf2-685e-4e23-9e27-1bc9fd1eb402 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:49.945059 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-3f7f8858-2a41-4f5c-96a8-1aec642ad3cc req-d43ecdf2-685e-4e23-9e27-1bc9fd1eb402 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:49.978161 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-3f7f8858-2a41-4f5c-96a8-1aec642ad3cc req-d43ecdf2-685e-4e23-9e27-1bc9fd1eb402 service nova] Creating event network-changed:8e02d220-253c-4ad6-8b9e-e09ad96099e3 for instance be5d3b39-cea6-47fa-adeb-d79a92a2076a on n-h1-856895-1 Sep 10 11:53:49.987245 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-3f7f8858-2a41-4f5c-96a8-1aec642ad3cc req-d43ecdf2-685e-4e23-9e27-1bc9fd1eb402 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.296872 Sep 10 11:53:49.994260 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1619/3316] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:53:50.005814 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-699103c9-3d73-4b51-b4e7-22682e28bcb5 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:50.022714 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-699103c9-3d73-4b51-b4e7-22682e28bcb5 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:50.023627 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-699103c9-3d73-4b51-b4e7-22682e28bcb5 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '27bed0cb3a46406b92496bee2da42567'} {{(pid=128776) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 11:53:50.084025 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=14 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:53:50.371135 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-699103c9-3d73-4b51-b4e7-22682e28bcb5 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:50.371694 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-699103c9-3d73-4b51-b4e7-22682e28bcb5 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:50.372169 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-699103c9-3d73-4b51-b4e7-22682e28bcb5 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:50.373145 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-699103c9-3d73-4b51-b4e7-22682e28bcb5 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:50.373571 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-699103c9-3d73-4b51-b4e7-22682e28bcb5 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:50.374011 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-699103c9-3d73-4b51-b4e7-22682e28bcb5 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:50.515518 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a425c10a-876e-45ae-b77e-429b6e6d3637 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318416fa33b40ae98c8c35675b0c101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f44e4274f41c1882cf1a2167dc891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:50.530306 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a425c10a-876e-45ae-b77e-429b6e6d3637 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "GET /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83" status: 200 len: 1324 microversion: 2.1 time: 0.950056 Sep 10 11:53:50.530917 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1698/3317] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:49 2022] GET /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83 => generated 1324 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:50.556721 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-df91ffc4-6650-46a1-a452-22a9a8c700ac tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:50.560609 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-df91ffc4-6650-46a1-a452-22a9a8c700ac tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:50.570773 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.multi_cell_list [None req-699103c9-3d73-4b51-b4e7-22682e28bcb5 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128776) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 11:53:50.584461 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-df91ffc4-6650-46a1-a452-22a9a8c700ac tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:50.586730 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-df91ffc4-6650-46a1-a452-22a9a8c700ac tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:50.597110 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-df91ffc4-6650-46a1-a452-22a9a8c700ac tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:50.598164 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-df91ffc4-6650-46a1-a452-22a9a8c700ac tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:50.601623 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-df91ffc4-6650-46a1-a452-22a9a8c700ac tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:50.602394 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-df91ffc4-6650-46a1-a452-22a9a8c700ac tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:50.726137 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-699103c9-3d73-4b51-b4e7-22682e28bcb5 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.730536 Sep 10 11:53:50.726881 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1620/3318] 10.222.0.23 () {58 vars in 1150 bytes} [Sat Sep 10 11:53:49 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:50.739913 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e8c88d42-536f-42ff-bf1b-c5d855c61129 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '.version_select at 0x7f4078c2b670>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:50.773439 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e8c88d42-536f-42ff-bf1b-c5d855c61129 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2141031577" status: 202 len: 0 microversion: 2.1 time: 0.045048 Sep 10 11:53:50.774043 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1621/3319] 10.222.0.23 () {58 vars in 1257 bytes} [Sat Sep 10 11:53:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2141031577 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:53:50.778974 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-19b446cf-5aea-4f2f-b3eb-c8bf5f4c68d5 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:50.779818 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-19b446cf-5aea-4f2f-b3eb-c8bf5f4c68d5 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: be5d3b39-cea6-47fa-adeb-d79a92a2076a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:50.786984 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19b446cf-5aea-4f2f-b3eb-c8bf5f4c68d5 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:50.787549 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19b446cf-5aea-4f2f-b3eb-c8bf5f4c68d5 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:50.787998 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19b446cf-5aea-4f2f-b3eb-c8bf5f4c68d5 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:50.788714 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19b446cf-5aea-4f2f-b3eb-c8bf5f4c68d5 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:50.789178 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19b446cf-5aea-4f2f-b3eb-c8bf5f4c68d5 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:50.789612 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19b446cf-5aea-4f2f-b3eb-c8bf5f4c68d5 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:51.834208 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-df91ffc4-6650-46a1-a452-22a9a8c700ac tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:51.856820 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-df91ffc4-6650-46a1-a452-22a9a8c700ac tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:51.863405 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-df91ffc4-6650-46a1-a452-22a9a8c700ac tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:51.864764 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-df91ffc4-6650-46a1-a452-22a9a8c700ac tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1721 microversion: 2.20 time: 1.332843 Sep 10 11:53:51.877770 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1699/3320] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:53:50 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1721 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:53:51.883737 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-347353c0-41b8-4cd9-9aa8-a7470edf3ebf tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:51.906864 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-347353c0-41b8-4cd9-9aa8-a7470edf3ebf tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:51.907595 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-347353c0-41b8-4cd9-9aa8-a7470edf3ebf tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '27bed0cb3a46406b92496bee2da42567'} {{(pid=128777) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 11:53:51.919358 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-347353c0-41b8-4cd9-9aa8-a7470edf3ebf tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:51.920425 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-347353c0-41b8-4cd9-9aa8-a7470edf3ebf tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:51.925114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-347353c0-41b8-4cd9-9aa8-a7470edf3ebf tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:51.927248 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-347353c0-41b8-4cd9-9aa8-a7470edf3ebf tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:51.928424 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-347353c0-41b8-4cd9-9aa8-a7470edf3ebf tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:51.929627 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-347353c0-41b8-4cd9-9aa8-a7470edf3ebf tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:52.144895 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.multi_cell_list [None req-347353c0-41b8-4cd9-9aa8-a7470edf3ebf tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128777) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 11:53:52.298434 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-347353c0-41b8-4cd9-9aa8-a7470edf3ebf tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.416310 Sep 10 11:53:52.299249 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1700/3321] 10.222.0.23 () {58 vars in 1212 bytes} [Sat Sep 10 11:53:51 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:52.311116 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-087df544-e769-4cdb-b89f-ff6a102ffd07 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:52.311811 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-087df544-e769-4cdb-b89f-ff6a102ffd07 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 8d231092-f981-47fe-9994-6fcb031c8a83] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:52.317873 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-087df544-e769-4cdb-b89f-ff6a102ffd07 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:52.318377 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-087df544-e769-4cdb-b89f-ff6a102ffd07 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:52.318891 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-087df544-e769-4cdb-b89f-ff6a102ffd07 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:52.319625 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-087df544-e769-4cdb-b89f-ff6a102ffd07 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:52.320282 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-087df544-e769-4cdb-b89f-ff6a102ffd07 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:52.321070 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-087df544-e769-4cdb-b89f-ff6a102ffd07 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:52.354708 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-19b446cf-5aea-4f2f-b3eb-c8bf5f4c68d5 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:52.373456 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-19b446cf-5aea-4f2f-b3eb-c8bf5f4c68d5 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a" status: 200 len: 1308 microversion: 2.1 time: 1.598273 Sep 10 11:53:52.376118 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1622/3322] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:50 2022] GET /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a => generated 1308 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:52.399344 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-01e8c49f-fe62-46ad-baa3-f76546401c53 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:52.406323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-01e8c49f-fe62-46ad-baa3-f76546401c53 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:52.407017 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-01e8c49f-fe62-46ad-baa3-f76546401c53 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '27bed0cb3a46406b92496bee2da42567'} {{(pid=128776) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 11:53:52.412832 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01e8c49f-fe62-46ad-baa3-f76546401c53 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:52.413324 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01e8c49f-fe62-46ad-baa3-f76546401c53 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:52.413765 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01e8c49f-fe62-46ad-baa3-f76546401c53 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:52.414500 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01e8c49f-fe62-46ad-baa3-f76546401c53 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:52.414957 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01e8c49f-fe62-46ad-baa3-f76546401c53 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:52.415434 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01e8c49f-fe62-46ad-baa3-f76546401c53 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:52.514057 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.multi_cell_list [None req-01e8c49f-fe62-46ad-baa3-f76546401c53 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128776) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 11:53:52.597584 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-01e8c49f-fe62-46ad-baa3-f76546401c53 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.211888 Sep 10 11:53:52.605185 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1623/3323] 10.222.0.23 () {58 vars in 1196 bytes} [Sat Sep 10 11:53:52 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:52.619949 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ef225f2a-568d-47c4-b021-51518fa00e53 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:52.626700 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ef225f2a-568d-47c4-b021-51518fa00e53 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:52.627983 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ef225f2a-568d-47c4-b021-51518fa00e53 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Searching by: {'name': '1351033987', 'deleted': False, 'project_id': '27bed0cb3a46406b92496bee2da42567'} {{(pid=128776) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 11:53:52.639155 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ef225f2a-568d-47c4-b021-51518fa00e53 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:52.640304 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ef225f2a-568d-47c4-b021-51518fa00e53 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:52.641508 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ef225f2a-568d-47c4-b021-51518fa00e53 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:52.642553 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ef225f2a-568d-47c4-b021-51518fa00e53 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:52.643286 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ef225f2a-568d-47c4-b021-51518fa00e53 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:52.644516 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ef225f2a-568d-47c4-b021-51518fa00e53 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:52.788026 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.multi_cell_list [None req-ef225f2a-568d-47c4-b021-51518fa00e53 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128776) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 11:53:52.883068 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:53:52.907823 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ef225f2a-568d-47c4-b021-51518fa00e53 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers?name=1351033987" status: 200 len: 346 microversion: 2.1 time: 0.299292 Sep 10 11:53:52.916692 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1624/3324] 10.222.0.23 () {58 vars in 1156 bytes} [Sat Sep 10 11:53:52 2022] GET /compute/v2.1/servers?name=1351033987 => generated 346 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:53:52.922851 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2a2fbcb1-b953-47a0-aec0-bd592491ef2d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:52.923869 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2a2fbcb1-b953-47a0-aec0-bd592491ef2d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:52.933780 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2a2fbcb1-b953-47a0-aec0-bd592491ef2d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:52.934445 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2a2fbcb1-b953-47a0-aec0-bd592491ef2d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:52.935092 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2a2fbcb1-b953-47a0-aec0-bd592491ef2d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:52.936873 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2a2fbcb1-b953-47a0-aec0-bd592491ef2d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:52.937941 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2a2fbcb1-b953-47a0-aec0-bd592491ef2d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:52.938619 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2a2fbcb1-b953-47a0-aec0-bd592491ef2d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:53.146144 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-087df544-e769-4cdb-b89f-ff6a102ffd07 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318416fa33b40ae98c8c35675b0c101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f44e4274f41c1882cf1a2167dc891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:53.164169 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-087df544-e769-4cdb-b89f-ff6a102ffd07 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "GET /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83" status: 200 len: 1324 microversion: 2.1 time: 0.856126 Sep 10 11:53:53.188151 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1701/3325] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:52 2022] GET /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83 => generated 1324 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:53.200934 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ec0d5ca4-f8cc-4652-b7e5-e6d8e3d0c5d7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:53.234244 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ec0d5ca4-f8cc-4652-b7e5-e6d8e3d0c5d7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:53.235266 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ec0d5ca4-f8cc-4652-b7e5-e6d8e3d0c5d7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '27bed0cb3a46406b92496bee2da42567'} {{(pid=128777) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 11:53:53.252531 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec0d5ca4-f8cc-4652-b7e5-e6d8e3d0c5d7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:53.253340 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec0d5ca4-f8cc-4652-b7e5-e6d8e3d0c5d7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:53.254308 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec0d5ca4-f8cc-4652-b7e5-e6d8e3d0c5d7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:53.256129 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec0d5ca4-f8cc-4652-b7e5-e6d8e3d0c5d7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:53.257377 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec0d5ca4-f8cc-4652-b7e5-e6d8e3d0c5d7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:53.260118 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec0d5ca4-f8cc-4652-b7e5-e6d8e3d0c5d7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:53.506767 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.multi_cell_list [None req-ec0d5ca4-f8cc-4652-b7e5-e6d8e3d0c5d7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128777) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 11:53:53.533625 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=100 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:53:53.608943 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ec0d5ca4-f8cc-4652-b7e5-e6d8e3d0c5d7 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.418955 Sep 10 11:53:53.610090 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1702/3326] 10.222.0.23 () {58 vars in 1154 bytes} [Sat Sep 10 11:53:53 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:53.621490 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-442be673-d84c-48d5-b47f-4efa1eac73a8 req-3d5539ee-e5d3-42ac-a56d-012ed79f0a1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61ab78c6-917d-46d1-b3e2-9935ca45c8e2", "name": "network-vif-unplugged", "status": "completed", "tag": "998df393-88c6-4f53-8cdf-ce9cb6efbc62"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:53:53.645200 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-442be673-d84c-48d5-b47f-4efa1eac73a8 req-3d5539ee-e5d3-42ac-a56d-012ed79f0a1a service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:53.646073 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-442be673-d84c-48d5-b47f-4efa1eac73a8 req-3d5539ee-e5d3-42ac-a56d-012ed79f0a1a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:53.648976 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-442be673-d84c-48d5-b47f-4efa1eac73a8 req-3d5539ee-e5d3-42ac-a56d-012ed79f0a1a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:53.677107 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-442be673-d84c-48d5-b47f-4efa1eac73a8 req-3d5539ee-e5d3-42ac-a56d-012ed79f0a1a service nova] Creating event network-vif-unplugged:998df393-88c6-4f53-8cdf-ce9cb6efbc62 for instance 61ab78c6-917d-46d1-b3e2-9935ca45c8e2 on n-h2-856895-1 Sep 10 11:53:53.684384 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-442be673-d84c-48d5-b47f-4efa1eac73a8 req-3d5539ee-e5d3-42ac-a56d-012ed79f0a1a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072495 Sep 10 11:53:53.685485 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1703/3327] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:53:53.708242 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4a755b54-09fc-47df-a726-7fae6e9fa22d tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:53.709792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4a755b54-09fc-47df-a726-7fae6e9fa22d tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: be5d3b39-cea6-47fa-adeb-d79a92a2076a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:53.718351 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a755b54-09fc-47df-a726-7fae6e9fa22d tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:53.719342 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a755b54-09fc-47df-a726-7fae6e9fa22d tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:53.719990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a755b54-09fc-47df-a726-7fae6e9fa22d tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:53.720926 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a755b54-09fc-47df-a726-7fae6e9fa22d tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:53.721588 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a755b54-09fc-47df-a726-7fae6e9fa22d tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:53.722298 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a755b54-09fc-47df-a726-7fae6e9fa22d tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:53.886625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2a2fbcb1-b953-47a0-aec0-bd592491ef2d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:53.903259 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2a2fbcb1-b953-47a0-aec0-bd592491ef2d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:53.916523 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2a2fbcb1-b953-47a0-aec0-bd592491ef2d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:53.918103 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2a2fbcb1-b953-47a0-aec0-bd592491ef2d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1721 microversion: 2.20 time: 0.999931 Sep 10 11:53:53.919229 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1625/3328] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:53:52 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1721 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:53:53.926016 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e3d2e0ce-a0b7-4c93-9be6-eb8b6abf82a4 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:53.931650 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e3d2e0ce-a0b7-4c93-9be6-eb8b6abf82a4 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:53.932595 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e3d2e0ce-a0b7-4c93-9be6-eb8b6abf82a4 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-135103398', 'deleted': False, 'project_id': '27bed0cb3a46406b92496bee2da42567'} {{(pid=128776) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 11:53:53.938398 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e3d2e0ce-a0b7-4c93-9be6-eb8b6abf82a4 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:53.938950 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e3d2e0ce-a0b7-4c93-9be6-eb8b6abf82a4 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:53.939436 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e3d2e0ce-a0b7-4c93-9be6-eb8b6abf82a4 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:53.940321 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e3d2e0ce-a0b7-4c93-9be6-eb8b6abf82a4 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:53.940940 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e3d2e0ce-a0b7-4c93-9be6-eb8b6abf82a4 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:53.941372 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e3d2e0ce-a0b7-4c93-9be6-eb8b6abf82a4 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:54.085152 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.multi_cell_list [None req-e3d2e0ce-a0b7-4c93-9be6-eb8b6abf82a4 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128776) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 11:53:54.174035 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4a755b54-09fc-47df-a726-7fae6e9fa22d tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:54.191309 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4a755b54-09fc-47df-a726-7fae6e9fa22d tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a" status: 200 len: 1308 microversion: 2.1 time: 0.499910 Sep 10 11:53:54.194008 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1704/3329] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:53 2022] GET /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a => generated 1308 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:54.216439 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e3d2e0ce-a0b7-4c93-9be6-eb8b6abf82a4 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-135103398" status: 200 len: 346 microversion: 2.1 time: 0.295808 Sep 10 11:53:54.218862 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1626/3330] 10.222.0.23 () {58 vars in 1228 bytes} [Sat Sep 10 11:53:53 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-135103398 => generated 346 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:53:54.228164 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-74558d64-74b4-4a52-9a66-7c11394f236b tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:54.231347 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-74558d64-74b4-4a52-9a66-7c11394f236b tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 8d231092-f981-47fe-9994-6fcb031c8a83] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:54.234728 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c0d1605f-81be-4cb0-899a-dba047b640db tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:54.235265 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c0d1605f-81be-4cb0-899a-dba047b640db tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 0954dadf-c6a9-4b78-b38d-2febfb54736a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:54.249828 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0d1605f-81be-4cb0-899a-dba047b640db tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:54.250344 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0d1605f-81be-4cb0-899a-dba047b640db tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:54.250805 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0d1605f-81be-4cb0-899a-dba047b640db tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:54.251276 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-74558d64-74b4-4a52-9a66-7c11394f236b tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:54.251579 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0d1605f-81be-4cb0-899a-dba047b640db tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:54.252047 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0d1605f-81be-4cb0-899a-dba047b640db tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:54.252475 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0d1605f-81be-4cb0-899a-dba047b640db tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:54.252926 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-74558d64-74b4-4a52-9a66-7c11394f236b tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:54.255599 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-74558d64-74b4-4a52-9a66-7c11394f236b tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:54.258061 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-74558d64-74b4-4a52-9a66-7c11394f236b tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:54.258948 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-74558d64-74b4-4a52-9a66-7c11394f236b tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:54.259897 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-74558d64-74b4-4a52-9a66-7c11394f236b tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:54.315728 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c0d1605f-81be-4cb0-899a-dba047b640db tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 0954dadf-c6a9-4b78-b38d-2febfb54736a] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:53:54.532307 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c0d1605f-81be-4cb0-899a-dba047b640db tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a" status: 204 len: 0 microversion: 2.1 time: 0.303664 Sep 10 11:53:54.537787 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1627/3331] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:53:54 2022] DELETE /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:53:54.567814 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8d5beb2b-823e-4144-9f54-83f08feb8f19 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:54.569415 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8d5beb2b-823e-4144-9f54-83f08feb8f19 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 0954dadf-c6a9-4b78-b38d-2febfb54736a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:54.595323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8d5beb2b-823e-4144-9f54-83f08feb8f19 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:54.595818 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8d5beb2b-823e-4144-9f54-83f08feb8f19 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:54.596251 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8d5beb2b-823e-4144-9f54-83f08feb8f19 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:54.604639 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8d5beb2b-823e-4144-9f54-83f08feb8f19 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:54.605734 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8d5beb2b-823e-4144-9f54-83f08feb8f19 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:54.607307 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8d5beb2b-823e-4144-9f54-83f08feb8f19 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:54.741201 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-74558d64-74b4-4a52-9a66-7c11394f236b tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318416fa33b40ae98c8c35675b0c101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f44e4274f41c1882cf1a2167dc891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:54.754039 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-74558d64-74b4-4a52-9a66-7c11394f236b tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "GET /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83" status: 200 len: 1324 microversion: 2.1 time: 0.556540 Sep 10 11:53:54.754815 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1705/3332] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:54 2022] GET /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83 => generated 1324 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:54.950335 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c717da02-0b81-4fbb-8b1f-3f2e073d2d23 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:54.950964 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c717da02-0b81-4fbb-8b1f-3f2e073d2d23 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:54.962339 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c717da02-0b81-4fbb-8b1f-3f2e073d2d23 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:54.962838 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c717da02-0b81-4fbb-8b1f-3f2e073d2d23 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:54.964402 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c717da02-0b81-4fbb-8b1f-3f2e073d2d23 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:54.966266 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c717da02-0b81-4fbb-8b1f-3f2e073d2d23 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:54.966723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c717da02-0b81-4fbb-8b1f-3f2e073d2d23 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:54.968308 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c717da02-0b81-4fbb-8b1f-3f2e073d2d23 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:55.065175 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8d5beb2b-823e-4144-9f54-83f08feb8f19 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:55.086188 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8d5beb2b-823e-4144-9f54-83f08feb8f19 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a" status: 200 len: 1517 microversion: 2.1 time: 0.535449 Sep 10 11:53:55.087434 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1628/3333] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:54 2022] GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a => generated 1517 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:55.220890 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e660dd82-e05c-41ed-8ec9-b4de935f2d6d tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:55.221554 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e660dd82-e05c-41ed-8ec9-b4de935f2d6d tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: be5d3b39-cea6-47fa-adeb-d79a92a2076a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:55.231893 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e660dd82-e05c-41ed-8ec9-b4de935f2d6d tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:55.232645 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e660dd82-e05c-41ed-8ec9-b4de935f2d6d tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:55.233898 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e660dd82-e05c-41ed-8ec9-b4de935f2d6d tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:55.234798 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e660dd82-e05c-41ed-8ec9-b4de935f2d6d tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:55.235648 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e660dd82-e05c-41ed-8ec9-b4de935f2d6d tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:55.237103 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e660dd82-e05c-41ed-8ec9-b4de935f2d6d tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:55.524578 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c717da02-0b81-4fbb-8b1f-3f2e073d2d23 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:55.534044 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c717da02-0b81-4fbb-8b1f-3f2e073d2d23 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:55.541300 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c717da02-0b81-4fbb-8b1f-3f2e073d2d23 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:55.542787 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c717da02-0b81-4fbb-8b1f-3f2e073d2d23 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1721 microversion: 2.20 time: 0.596501 Sep 10 11:53:55.546405 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1706/3334] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:53:54 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1721 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:53:55.680533 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e660dd82-e05c-41ed-8ec9-b4de935f2d6d tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:55.689603 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e660dd82-e05c-41ed-8ec9-b4de935f2d6d tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a" status: 200 len: 1308 microversion: 2.1 time: 0.475556 Sep 10 11:53:55.711562 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1629/3335] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:55 2022] GET /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a => generated 1308 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:53:55.784766 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ae6a24e5-1c7e-477c-9157-3779dedad572 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:55.788423 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ae6a24e5-1c7e-477c-9157-3779dedad572 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 8d231092-f981-47fe-9994-6fcb031c8a83] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:55.811938 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-3ec98176-10d5-4286-8a21-043b8c1df7c6 req-4bf2485f-f3a3-4e6d-a9c1-cc9b17a2f7e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d231092-f981-47fe-9994-6fcb031c8a83", "name": "network-vif-plugged", "status": "completed", "tag": "8c8742ac-1c89-456c-9fd1-cc7ed178f4dd"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:53:55.813320 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae6a24e5-1c7e-477c-9157-3779dedad572 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:55.816629 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae6a24e5-1c7e-477c-9157-3779dedad572 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:55.818389 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae6a24e5-1c7e-477c-9157-3779dedad572 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:55.821275 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae6a24e5-1c7e-477c-9157-3779dedad572 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:55.828166 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae6a24e5-1c7e-477c-9157-3779dedad572 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:55.828718 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae6a24e5-1c7e-477c-9157-3779dedad572 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:55.835880 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-3ec98176-10d5-4286-8a21-043b8c1df7c6 req-4bf2485f-f3a3-4e6d-a9c1-cc9b17a2f7e0 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:55.838942 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-3ec98176-10d5-4286-8a21-043b8c1df7c6 req-4bf2485f-f3a3-4e6d-a9c1-cc9b17a2f7e0 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:55.839517 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-3ec98176-10d5-4286-8a21-043b8c1df7c6 req-4bf2485f-f3a3-4e6d-a9c1-cc9b17a2f7e0 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:55.875500 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-3ec98176-10d5-4286-8a21-043b8c1df7c6 req-4bf2485f-f3a3-4e6d-a9c1-cc9b17a2f7e0 service nova] Creating event network-vif-plugged:8c8742ac-1c89-456c-9fd1-cc7ed178f4dd for instance 8d231092-f981-47fe-9994-6fcb031c8a83 on n-h1-856895-1 Sep 10 11:53:55.888954 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-3ec98176-10d5-4286-8a21-043b8c1df7c6 req-4bf2485f-f3a3-4e6d-a9c1-cc9b17a2f7e0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083451 Sep 10 11:53:55.891331 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1630/3336] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:53:55.907820 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2c6107a3-d237-44b3-9ac3-41642baa2abd tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:55.908470 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2c6107a3-d237-44b3-9ac3-41642baa2abd tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: f74f15ef-04b5-4313-b90f-20b96291734b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:55.928450 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2c6107a3-d237-44b3-9ac3-41642baa2abd tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:55.929288 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2c6107a3-d237-44b3-9ac3-41642baa2abd tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:55.929981 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2c6107a3-d237-44b3-9ac3-41642baa2abd tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:55.932852 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2c6107a3-d237-44b3-9ac3-41642baa2abd tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:55.933339 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2c6107a3-d237-44b3-9ac3-41642baa2abd tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:55.934573 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2c6107a3-d237-44b3-9ac3-41642baa2abd tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:55.986172 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2c6107a3-d237-44b3-9ac3-41642baa2abd tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: f74f15ef-04b5-4313-b90f-20b96291734b] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:53:56.159209 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2c6107a3-d237-44b3-9ac3-41642baa2abd tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f74f15ef-04b5-4313-b90f-20b96291734b" status: 204 len: 0 microversion: 2.1 time: 0.261933 Sep 10 11:53:56.161336 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1631/3337] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:53:55 2022] DELETE /compute/v2.1/servers/f74f15ef-04b5-4313-b90f-20b96291734b => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:53:56.179505 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-9a9155a4-c0c7-4f09-9a2e-556e6dd65af3 req-f507c570-48a3-41ea-996d-8f538797b958 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f74f15ef-04b5-4313-b90f-20b96291734b", "tag": "db9651b2-3db5-4e9b-9153-56055a48ba72"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:53:56.205744 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-9a9155a4-c0c7-4f09-9a2e-556e6dd65af3 req-f507c570-48a3-41ea-996d-8f538797b958 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:56.206539 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-9a9155a4-c0c7-4f09-9a2e-556e6dd65af3 req-f507c570-48a3-41ea-996d-8f538797b958 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:56.207139 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-9a9155a4-c0c7-4f09-9a2e-556e6dd65af3 req-f507c570-48a3-41ea-996d-8f538797b958 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:56.225598 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-9a9155a4-c0c7-4f09-9a2e-556e6dd65af3 req-f507c570-48a3-41ea-996d-8f538797b958 service nova] Creating event network-changed:db9651b2-3db5-4e9b-9153-56055a48ba72 for instance f74f15ef-04b5-4313-b90f-20b96291734b on n-h2-856895-1 Sep 10 11:53:56.231743 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-9a9155a4-c0c7-4f09-9a2e-556e6dd65af3 req-f507c570-48a3-41ea-996d-8f538797b958 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067118 Sep 10 11:53:56.233914 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1632/3338] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:53:56.363700 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ae6a24e5-1c7e-477c-9157-3779dedad572 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318416fa33b40ae98c8c35675b0c101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f44e4274f41c1882cf1a2167dc891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:56.378124 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ae6a24e5-1c7e-477c-9157-3779dedad572 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "GET /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83" status: 200 len: 1324 microversion: 2.1 time: 0.601534 Sep 10 11:53:56.381153 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1707/3339] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:55 2022] GET /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83 => generated 1324 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:56.391291 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-47aeb7ee-097c-4528-9373-ce357d5f84bf tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:56.393910 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-47aeb7ee-097c-4528-9373-ce357d5f84bf tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 0954dadf-c6a9-4b78-b38d-2febfb54736a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:56.417087 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47aeb7ee-097c-4528-9373-ce357d5f84bf tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:56.417575 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47aeb7ee-097c-4528-9373-ce357d5f84bf tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:56.418013 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47aeb7ee-097c-4528-9373-ce357d5f84bf tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:56.418737 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47aeb7ee-097c-4528-9373-ce357d5f84bf tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:56.419362 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47aeb7ee-097c-4528-9373-ce357d5f84bf tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:56.419656 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47aeb7ee-097c-4528-9373-ce357d5f84bf tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:56.486267 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ac3cb055-3fa9-4763-9e74-57f8b1ae7f3b tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1715428779", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "83f91881-6a4e-4a53-a5e6-d9364026251d"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:53:56.590382 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-ac3cb055-3fa9-4763-9e74-57f8b1ae7f3b tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] validate_networks() for [('83f91881-6a4e-4a53-a5e6-d9364026251d', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:53:56.895929 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-47aeb7ee-097c-4528-9373-ce357d5f84bf tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:56.908885 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-47aeb7ee-097c-4528-9373-ce357d5f84bf tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a" status: 200 len: 1517 microversion: 2.1 time: 0.526050 Sep 10 11:53:56.909692 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1708/3340] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:56 2022] GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a => generated 1517 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:56.915981 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b8c85130-1626-428c-83eb-035380ed980c tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:56.923982 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b8c85130-1626-428c-83eb-035380ed980c tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: f74f15ef-04b5-4313-b90f-20b96291734b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:56.941643 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b8c85130-1626-428c-83eb-035380ed980c tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:56.944384 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b8c85130-1626-428c-83eb-035380ed980c tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:56.947118 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b8c85130-1626-428c-83eb-035380ed980c tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:56.948454 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b8c85130-1626-428c-83eb-035380ed980c tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:56.953415 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b8c85130-1626-428c-83eb-035380ed980c tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:56.954107 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b8c85130-1626-428c-83eb-035380ed980c tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:57.376453 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b8c85130-1626-428c-83eb-035380ed980c tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be647276cc456e83dacd25b98e37f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20756c1a77fb44f684973f382b802825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:57.398377 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b8c85130-1626-428c-83eb-035380ed980c tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/f74f15ef-04b5-4313-b90f-20b96291734b" status: 200 len: 1670 microversion: 2.1 time: 0.486022 Sep 10 11:53:57.399805 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1709/3341] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:56 2022] GET /compute/v2.1/servers/f74f15ef-04b5-4313-b90f-20b96291734b => generated 1670 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:57.406567 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e28ba176-62bd-41b5-890c-b3ac2c3c18bb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:57.419786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e28ba176-62bd-41b5-890c-b3ac2c3c18bb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:57.456709 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e28ba176-62bd-41b5-890c-b3ac2c3c18bb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:57.457988 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e28ba176-62bd-41b5-890c-b3ac2c3c18bb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:57.460254 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e28ba176-62bd-41b5-890c-b3ac2c3c18bb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:57.461312 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e28ba176-62bd-41b5-890c-b3ac2c3c18bb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:57.464297 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e28ba176-62bd-41b5-890c-b3ac2c3c18bb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:57.464887 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e28ba176-62bd-41b5-890c-b3ac2c3c18bb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:58.570954 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-ac3cb055-3fa9-4763-9e74-57f8b1ae7f3b tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:53:58.571524 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-ac3cb055-3fa9-4763-9e74-57f8b1ae7f3b tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:53:58.571889 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-ac3cb055-3fa9-4763-9e74-57f8b1ae7f3b tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:53:58.572306 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-ac3cb055-3fa9-4763-9e74-57f8b1ae7f3b tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:53:58.573645 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-ac3cb055-3fa9-4763-9e74-57f8b1ae7f3b tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:53:58.585927 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac3cb055-3fa9-4763-9e74-57f8b1ae7f3b tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:58.587037 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac3cb055-3fa9-4763-9e74-57f8b1ae7f3b tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:58.587796 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac3cb055-3fa9-4763-9e74-57f8b1ae7f3b tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:58.588501 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e28ba176-62bd-41b5-890c-b3ac2c3c18bb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:58.589504 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac3cb055-3fa9-4763-9e74-57f8b1ae7f3b tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:58.591040 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac3cb055-3fa9-4763-9e74-57f8b1ae7f3b tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:58.591521 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac3cb055-3fa9-4763-9e74-57f8b1ae7f3b tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:58.599792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e28ba176-62bd-41b5-890c-b3ac2c3c18bb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:58.601587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e28ba176-62bd-41b5-890c-b3ac2c3c18bb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:58.603571 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e28ba176-62bd-41b5-890c-b3ac2c3c18bb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1664 microversion: 2.20 time: 1.202449 Sep 10 11:53:58.620901 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1710/3342] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:53:57 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1664 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:53:58.626260 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7d6f3d38-286d-4bb9-b711-3adae630f81e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:58.636052 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7d6f3d38-286d-4bb9-b711-3adae630f81e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: be5d3b39-cea6-47fa-adeb-d79a92a2076a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:58.643293 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:53:58.647588 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d6f3d38-286d-4bb9-b711-3adae630f81e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:58.648611 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d6f3d38-286d-4bb9-b711-3adae630f81e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:58.649256 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d6f3d38-286d-4bb9-b711-3adae630f81e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:58.650144 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d6f3d38-286d-4bb9-b711-3adae630f81e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:58.651620 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-ac3cb055-3fa9-4763-9e74-57f8b1ae7f3b tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Getting quotas for project a827355dfbcf40ec8d2e3e75d453e6bb. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:53:58.652203 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d6f3d38-286d-4bb9-b711-3adae630f81e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:58.653746 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d6f3d38-286d-4bb9-b711-3adae630f81e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:58.663977 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-ac3cb055-3fa9-4763-9e74-57f8b1ae7f3b tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Getting quotas for user 85362ff7bd6245d79b31a3937e14c095 and project a827355dfbcf40ec8d2e3e75d453e6bb. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:53:58.689349 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ac3cb055-3fa9-4763-9e74-57f8b1ae7f3b tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:53:58.692270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ac3cb055-3fa9-4763-9e74-57f8b1ae7f3b tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] [instance: d40c7388-4376-47ca-98e3-27db94e48009] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:53:58.762840 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ac3cb055-3fa9-4763-9e74-57f8b1ae7f3b tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.527375 Sep 10 11:53:58.767151 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1633/3343] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:53:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:53:58.779028 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ffecc0bb-3259-4886-9307-950b8b73e24a tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:58.781071 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ffecc0bb-3259-4886-9307-950b8b73e24a tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 8d231092-f981-47fe-9994-6fcb031c8a83] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:58.799644 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ffecc0bb-3259-4886-9307-950b8b73e24a tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:58.800960 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ffecc0bb-3259-4886-9307-950b8b73e24a tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:58.802915 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ffecc0bb-3259-4886-9307-950b8b73e24a tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:58.804508 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ffecc0bb-3259-4886-9307-950b8b73e24a tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:58.805002 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ffecc0bb-3259-4886-9307-950b8b73e24a tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:58.805513 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ffecc0bb-3259-4886-9307-950b8b73e24a tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:58.929025 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:53:59.501221 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7d6f3d38-286d-4bb9-b711-3adae630f81e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:59.512191 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7d6f3d38-286d-4bb9-b711-3adae630f81e tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a" status: 200 len: 1308 microversion: 2.1 time: 0.890011 Sep 10 11:53:59.512818 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1711/3344] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:58 2022] GET /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a => generated 1308 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:59.527116 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a37be788-fe99-4a39-92a2-93dae387dc68 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:59.527790 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a37be788-fe99-4a39-92a2-93dae387dc68 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 0954dadf-c6a9-4b78-b38d-2febfb54736a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:59.530919 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:53:59.546437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a37be788-fe99-4a39-92a2-93dae387dc68 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:59.546945 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a37be788-fe99-4a39-92a2-93dae387dc68 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:59.547423 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a37be788-fe99-4a39-92a2-93dae387dc68 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:59.548147 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a37be788-fe99-4a39-92a2-93dae387dc68 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:59.548614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a37be788-fe99-4a39-92a2-93dae387dc68 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:59.549246 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a37be788-fe99-4a39-92a2-93dae387dc68 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:59.586464 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-a37be788-fe99-4a39-92a2-93dae387dc68 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] HTTP exception thrown: Instance 0954dadf-c6a9-4b78-b38d-2febfb54736a could not be found. Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a37be788-fe99-4a39-92a2-93dae387dc68 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Request method failure captured: Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a HTTP/1.1 Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHpvUcmR858xMY2SMLPakMoaz7_5OxFmkxTcHDutSdvsSNJFYS-mXUzlY5tFDlBJ95sjtWALXHmsAkzi88DwK8Y-l1xkoG96XernZMHi3q9ESNlfiBUYB31yZ99lguGpXmtbkbLVG5UTMZ1pGHiHcVPvwgwLOaTKbORD3yDCU_Q6OfI Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 27bed0cb3a46406b92496bee2da42567 Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ListServerFiltersTestJSON-1180781712 Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/27bed0cb3a46406b92496bee2da42567"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/27bed0cb3a46406b92496bee2da42567"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_27bed0cb3a46406b92496bee2da42567", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/27bed0cb3a46406b92496bee2da42567"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ListServerFiltersTestJSON-1180781712 Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 27bed0cb3a46406b92496bee2da42567 Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1180781712 Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ListServerFiltersTestJSON-1180781712-project Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: fe7ac57af1c94269bad68b4c8aec52fd Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ListServerFiltersTestJSON-1180781712-project Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 0954dadf-c6a9-4b78-b38d-2febfb54736a could not be found. Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '0954dadf-c6a9-4b78-b38d-2febfb54736a'} Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0954dadf-c6a9-4b78-b38d-2febfb54736a could not be found. Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0954dadf-c6a9-4b78-b38d-2febfb54736a could not be found. Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:53:59.588324 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:53:59.595305 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:53:59.595305 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:53:59.595305 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:53:59.595305 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:53:59.595305 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:53:59.595305 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0954dadf-c6a9-4b78-b38d-2febfb54736a could not be found. Sep 10 11:53:59.595305 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:53:59.595305 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a37be788-fe99-4a39-92a2-93dae387dc68 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Returning 404 to user: Instance 0954dadf-c6a9-4b78-b38d-2febfb54736a could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:53:59.595305 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a37be788-fe99-4a39-92a2-93dae387dc68 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a" status: 404 len: 111 microversion: 2.1 time: 0.071808 Sep 10 11:53:59.598939 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1712/3345] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:59 2022] GET /compute/v2.1/servers/0954dadf-c6a9-4b78-b38d-2febfb54736a => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:53:59.605234 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-3ec32de0-44c1-47e5-9241-b6a683920816 req-3f687deb-0309-4600-8bd2-8d2a96c93ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0954dadf-c6a9-4b78-b38d-2febfb54736a", "name": "network-vif-deleted", "tag": "3c43a878-d2b9-4792-b156-ab611307dd32"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:53:59.628046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-3ec32de0-44c1-47e5-9241-b6a683920816 req-3f687deb-0309-4600-8bd2-8d2a96c93ed3 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:59.629058 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-3ec32de0-44c1-47e5-9241-b6a683920816 req-3f687deb-0309-4600-8bd2-8d2a96c93ed3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:59.629696 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-3ec32de0-44c1-47e5-9241-b6a683920816 req-3f687deb-0309-4600-8bd2-8d2a96c93ed3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:59.642639 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-3ec32de0-44c1-47e5-9241-b6a683920816 req-3f687deb-0309-4600-8bd2-8d2a96c93ed3 service nova] Creating event network-vif-deleted:3c43a878-d2b9-4792-b156-ab611307dd32 for instance 0954dadf-c6a9-4b78-b38d-2febfb54736a on n-h1-856895-1 Sep 10 11:53:59.656582 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-3ec32de0-44c1-47e5-9241-b6a683920816 req-3f687deb-0309-4600-8bd2-8d2a96c93ed3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056217 Sep 10 11:53:59.657653 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1713/3346] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:53:59.664163 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ffecc0bb-3259-4886-9307-950b8b73e24a tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318416fa33b40ae98c8c35675b0c101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f44e4274f41c1882cf1a2167dc891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:59.665303 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-023faf16-a62b-48af-8616-185496bb3d6c tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:59.666311 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-023faf16-a62b-48af-8616-185496bb3d6c tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: f74f15ef-04b5-4313-b90f-20b96291734b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:59.674006 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-023faf16-a62b-48af-8616-185496bb3d6c tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:59.676603 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-023faf16-a62b-48af-8616-185496bb3d6c tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:59.677631 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-023faf16-a62b-48af-8616-185496bb3d6c tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:59.678592 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-023faf16-a62b-48af-8616-185496bb3d6c tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:59.679539 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-023faf16-a62b-48af-8616-185496bb3d6c tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:59.680608 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-023faf16-a62b-48af-8616-185496bb3d6c tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:59.685532 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ffecc0bb-3259-4886-9307-950b8b73e24a tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "GET /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83" status: 200 len: 1519 microversion: 2.1 time: 0.916525 Sep 10 11:53:59.690431 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1634/3347] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:58 2022] GET /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83 => generated 1519 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:59.706508 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-83cde10c-4ffd-47ad-bceb-7843ba1918ad tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7898802-dd5a-46fb-96ee-3a6b3199c9f7"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:53:59.713197 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-83cde10c-4ffd-47ad-bceb-7843ba1918ad tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:59.716441 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-023faf16-a62b-48af-8616-185496bb3d6c tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] HTTP exception thrown: Instance f74f15ef-04b5-4313-b90f-20b96291734b could not be found. Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-023faf16-a62b-48af-8616-185496bb3d6c tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Request method failure captured: Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/f74f15ef-04b5-4313-b90f-20b96291734b HTTP/1.1 Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHogBq53-9-XubuuhITXNAF47e9O-F9j2HmPN_ZAzaILKfi2Pl_nRVBUKY6RJ7-rmxz_SsMp1i-0LR3WIJrp6wvP30HF1ctVN0zxdUOu1_0G2ypEN75gjPKuhWZo4Ir5rxwwebmKbjCQ_9abPeiN1PkPhkBLPpGBAigOh69JHiUiI_c Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 20756c1a77fb44f684973f382b802825 Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-TestNetworkBasicOps-1480462047 Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20756c1a77fb44f684973f382b802825"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20756c1a77fb44f684973f382b802825"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_20756c1a77fb44f684973f382b802825", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/20756c1a77fb44f684973f382b802825"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-TestNetworkBasicOps-1480462047 Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 20756c1a77fb44f684973f382b802825 Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-TestNetworkBasicOps-1480462047 Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-TestNetworkBasicOps-1480462047-project Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 92be647276cc456e83dacd25b98e37f2 Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-TestNetworkBasicOps-1480462047-project Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance f74f15ef-04b5-4313-b90f-20b96291734b could not be found. Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'f74f15ef-04b5-4313-b90f-20b96291734b'} Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f74f15ef-04b5-4313-b90f-20b96291734b could not be found. Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f74f15ef-04b5-4313-b90f-20b96291734b could not be found. Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:53:59.720867 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:53:59.726181 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:53:59.726181 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:53:59.726181 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:53:59.726181 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:53:59.726181 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:53:59.726181 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f74f15ef-04b5-4313-b90f-20b96291734b could not be found. Sep 10 11:53:59.726181 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:53:59.731506 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-83cde10c-4ffd-47ad-bceb-7843ba1918ad tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:59.732670 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-023faf16-a62b-48af-8616-185496bb3d6c tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Returning 404 to user: Instance f74f15ef-04b5-4313-b90f-20b96291734b could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:53:59.734967 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-023faf16-a62b-48af-8616-185496bb3d6c tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/f74f15ef-04b5-4313-b90f-20b96291734b" status: 404 len: 111 microversion: 2.1 time: 0.075915 Sep 10 11:53:59.736184 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1714/3348] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:59 2022] GET /compute/v2.1/servers/f74f15ef-04b5-4313-b90f-20b96291734b => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:53:59.741257 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-83cde10c-4ffd-47ad-bceb-7843ba1918ad tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:59.742024 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-83cde10c-4ffd-47ad-bceb-7843ba1918ad tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:59.743670 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-83cde10c-4ffd-47ad-bceb-7843ba1918ad tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:59.744376 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-83cde10c-4ffd-47ad-bceb-7843ba1918ad tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:59.745793 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-83cde10c-4ffd-47ad-bceb-7843ba1918ad tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:59.747108 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ca4b7cc6-bbde-4f1f-a364-6114c1ac3816 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:59.752728 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ca4b7cc6-bbde-4f1f-a364-6114c1ac3816 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] [instance: d40c7388-4376-47ca-98e3-27db94e48009] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:59.769261 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca4b7cc6-bbde-4f1f-a364-6114c1ac3816 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:59.770013 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca4b7cc6-bbde-4f1f-a364-6114c1ac3816 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:59.770692 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca4b7cc6-bbde-4f1f-a364-6114c1ac3816 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:59.771691 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca4b7cc6-bbde-4f1f-a364-6114c1ac3816 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:59.772393 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca4b7cc6-bbde-4f1f-a364-6114c1ac3816 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:59.773060 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca4b7cc6-bbde-4f1f-a364-6114c1ac3816 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:59.919672 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ca4b7cc6-bbde-4f1f-a364-6114c1ac3816 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85362ff7bd6245d79b31a3937e14c095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a827355dfbcf40ec8d2e3e75d453e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:53:59.931712 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ca4b7cc6-bbde-4f1f-a364-6114c1ac3816 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c7388-4376-47ca-98e3-27db94e48009" status: 200 len: 1228 microversion: 2.1 time: 0.194077 Sep 10 11:53:59.932670 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1715/3349] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:53:59 2022] GET /compute/v2.1/servers/d40c7388-4376-47ca-98e3-27db94e48009 => generated 1228 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:53:59.953430 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6ebe87f9-7bde-407b-9e08-1f1a4cacf074 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:53:59.953942 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6ebe87f9-7bde-407b-9e08-1f1a4cacf074 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: a4dbe5aa-fddd-42e7-b422-1585785f6034] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:53:59.984245 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6ebe87f9-7bde-407b-9e08-1f1a4cacf074 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:59.984741 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6ebe87f9-7bde-407b-9e08-1f1a4cacf074 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:59.992987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6ebe87f9-7bde-407b-9e08-1f1a4cacf074 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:53:59.993763 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6ebe87f9-7bde-407b-9e08-1f1a4cacf074 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:53:59.994253 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6ebe87f9-7bde-407b-9e08-1f1a4cacf074 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:53:59.994682 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6ebe87f9-7bde-407b-9e08-1f1a4cacf074 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:00.114416 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6ebe87f9-7bde-407b-9e08-1f1a4cacf074 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: a4dbe5aa-fddd-42e7-b422-1585785f6034] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:54:00.326397 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6ebe87f9-7bde-407b-9e08-1f1a4cacf074 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a4dbe5aa-fddd-42e7-b422-1585785f6034" status: 204 len: 0 microversion: 2.1 time: 0.392476 Sep 10 11:54:00.327760 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1716/3350] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:53:59 2022] DELETE /compute/v2.1/servers/a4dbe5aa-fddd-42e7-b422-1585785f6034 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:54:00.336847 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4d11bf15-bb41-46fd-8249-e39384a20f33 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Action: 'create', calling method: .version_select at 0x7f407348b1f0>, body: {"pool": null} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:54:00.366472 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-83cde10c-4ffd-47ad-bceb-7843ba1918ad tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "POST /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.674034 Sep 10 11:54:00.368040 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1635/3351] 10.222.0.23 () {62 vars in 1364 bytes} [Sat Sep 10 11:53:59 2022] POST /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2/os-volume_attachments => generated 188 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:54:00.379630 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d5bd1c24-615b-424b-ade4-1a63647b7ea2 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '.version_select at 0x7f407b5e0280>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:00.424563 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d5bd1c24-615b-424b-ade4-1a63647b7ea2 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-273725322" status: 202 len: 0 microversion: 2.1 time: 0.054633 Sep 10 11:54:00.426285 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1636/3352] 10.222.0.23 () {58 vars in 1254 bytes} [Sat Sep 10 11:54:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-273725322 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:54:00.444064 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-91b5ba2c-db74-47bd-a577-f93fb9e0756d tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:00.445164 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-91b5ba2c-db74-47bd-a577-f93fb9e0756d tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: a4dbe5aa-fddd-42e7-b422-1585785f6034] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:00.455876 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-91b5ba2c-db74-47bd-a577-f93fb9e0756d tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:00.456496 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-91b5ba2c-db74-47bd-a577-f93fb9e0756d tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:00.456944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-91b5ba2c-db74-47bd-a577-f93fb9e0756d tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:00.458179 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-91b5ba2c-db74-47bd-a577-f93fb9e0756d tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:00.458700 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-91b5ba2c-db74-47bd-a577-f93fb9e0756d tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:00.459132 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-91b5ba2c-db74-47bd-a577-f93fb9e0756d tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:00.810164 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-91b5ba2c-db74-47bd-a577-f93fb9e0756d tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:00.820229 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-91b5ba2c-db74-47bd-a577-f93fb9e0756d tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/a4dbe5aa-fddd-42e7-b422-1585785f6034" status: 200 len: 1519 microversion: 2.1 time: 0.392651 Sep 10 11:54:00.837371 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1637/3353] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:00 2022] GET /compute/v2.1/servers/a4dbe5aa-fddd-42e7-b422-1585785f6034 => generated 1519 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:00.849729 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-21744c7f-e8db-4a88-8643-5ba113fe8f63 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:00.854116 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-21744c7f-e8db-4a88-8643-5ba113fe8f63 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: be5d3b39-cea6-47fa-adeb-d79a92a2076a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:00.862177 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-21744c7f-e8db-4a88-8643-5ba113fe8f63 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:00.862837 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-21744c7f-e8db-4a88-8643-5ba113fe8f63 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:00.863447 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-21744c7f-e8db-4a88-8643-5ba113fe8f63 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:00.864277 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-21744c7f-e8db-4a88-8643-5ba113fe8f63 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:00.864855 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-21744c7f-e8db-4a88-8643-5ba113fe8f63 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:00.865396 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-21744c7f-e8db-4a88-8643-5ba113fe8f63 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:00.896237 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=6,nova_cell1:INSERT=5 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:54:01.475941 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-21744c7f-e8db-4a88-8643-5ba113fe8f63 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:01.484764 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-21744c7f-e8db-4a88-8643-5ba113fe8f63 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a" status: 200 len: 1308 microversion: 2.1 time: 0.645817 Sep 10 11:54:01.500562 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1638/3354] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:00 2022] GET /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a => generated 1308 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:01.509210 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fe527ac3-9a3e-4797-98c7-e5154c3d50b5 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:54:01.510046 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fe527ac3-9a3e-4797-98c7-e5154c3d50b5 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:01.516601 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe527ac3-9a3e-4797-98c7-e5154c3d50b5 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:01.517385 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe527ac3-9a3e-4797-98c7-e5154c3d50b5 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:01.518000 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe527ac3-9a3e-4797-98c7-e5154c3d50b5 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:01.518898 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe527ac3-9a3e-4797-98c7-e5154c3d50b5 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:01.519548 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe527ac3-9a3e-4797-98c7-e5154c3d50b5 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:01.520220 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe527ac3-9a3e-4797-98c7-e5154c3d50b5 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:01.613092 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fe527ac3-9a3e-4797-98c7-e5154c3d50b5 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128776) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 10 11:54:01.716721 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fe527ac3-9a3e-4797-98c7-e5154c3d50b5 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "POST /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2/action" status: 202 len: 0 microversion: 2.20 time: 0.213935 Sep 10 11:54:01.718126 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1639/3355] 10.222.0.23 () {62 vars in 1319 bytes} [Sat Sep 10 11:54:01 2022] POST /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:54:01.727272 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b1d95c8b-ed80-41bd-8d9d-9d8e73aa96af tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:01.727905 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b1d95c8b-ed80-41bd-8d9d-9d8e73aa96af tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] [instance: d40c7388-4376-47ca-98e3-27db94e48009] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:01.752377 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b1d95c8b-ed80-41bd-8d9d-9d8e73aa96af tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:01.752965 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b1d95c8b-ed80-41bd-8d9d-9d8e73aa96af tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:01.753425 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b1d95c8b-ed80-41bd-8d9d-9d8e73aa96af tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:01.754172 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b1d95c8b-ed80-41bd-8d9d-9d8e73aa96af tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:01.754633 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b1d95c8b-ed80-41bd-8d9d-9d8e73aa96af tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:01.755085 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b1d95c8b-ed80-41bd-8d9d-9d8e73aa96af tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:01.955193 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b1d95c8b-ed80-41bd-8d9d-9d8e73aa96af tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85362ff7bd6245d79b31a3937e14c095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a827355dfbcf40ec8d2e3e75d453e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:01.964078 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b1d95c8b-ed80-41bd-8d9d-9d8e73aa96af tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c7388-4376-47ca-98e3-27db94e48009" status: 200 len: 1282 microversion: 2.1 time: 0.244820 Sep 10 11:54:01.965818 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1640/3356] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:01 2022] GET /compute/v2.1/servers/d40c7388-4376-47ca-98e3-27db94e48009 => generated 1282 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:01.971950 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-e5d9811c-aa81-4b5e-a24a-bb1be9e348a3 req-94a0a673-2563-4120-8792-db44dd05211b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be5d3b39-cea6-47fa-adeb-d79a92a2076a", "name": "network-vif-plugged", "status": "completed", "tag": "8e02d220-253c-4ad6-8b9e-e09ad96099e3"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:54:01.982079 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e5d9811c-aa81-4b5e-a24a-bb1be9e348a3 req-94a0a673-2563-4120-8792-db44dd05211b service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:01.983103 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e5d9811c-aa81-4b5e-a24a-bb1be9e348a3 req-94a0a673-2563-4120-8792-db44dd05211b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:01.983870 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e5d9811c-aa81-4b5e-a24a-bb1be9e348a3 req-94a0a673-2563-4120-8792-db44dd05211b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:02.002353 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-e5d9811c-aa81-4b5e-a24a-bb1be9e348a3 req-94a0a673-2563-4120-8792-db44dd05211b service nova] Creating event network-vif-plugged:8e02d220-253c-4ad6-8b9e-e09ad96099e3 for instance be5d3b39-cea6-47fa-adeb-d79a92a2076a on n-h1-856895-1 Sep 10 11:54:02.015809 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-e5d9811c-aa81-4b5e-a24a-bb1be9e348a3 req-94a0a673-2563-4120-8792-db44dd05211b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048551 Sep 10 11:54:02.016439 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1641/3357] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:54:02.028945 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-13e8448d-90f1-4a8b-aa13-54831f807d42 req-994d9cfb-3e6c-4995-88af-16affe168a83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f74f15ef-04b5-4313-b90f-20b96291734b", "name": "network-vif-deleted", "tag": "db9651b2-3db5-4e9b-9153-56055a48ba72"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:54:02.067936 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-13e8448d-90f1-4a8b-aa13-54831f807d42 req-994d9cfb-3e6c-4995-88af-16affe168a83 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:02.068410 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-13e8448d-90f1-4a8b-aa13-54831f807d42 req-994d9cfb-3e6c-4995-88af-16affe168a83 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:02.068863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-13e8448d-90f1-4a8b-aa13-54831f807d42 req-994d9cfb-3e6c-4995-88af-16affe168a83 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:02.100395 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-13e8448d-90f1-4a8b-aa13-54831f807d42 req-994d9cfb-3e6c-4995-88af-16affe168a83 service nova] Creating event network-vif-deleted:db9651b2-3db5-4e9b-9153-56055a48ba72 for instance f74f15ef-04b5-4313-b90f-20b96291734b on n-h2-856895-1 Sep 10 11:54:02.121553 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-13e8448d-90f1-4a8b-aa13-54831f807d42 req-994d9cfb-3e6c-4995-88af-16affe168a83 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100824 Sep 10 11:54:02.122188 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1642/3358] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:54:02.140779 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6cd88958-a792-43bc-bac8-37fdd28235c0 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:02.141647 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6cd88958-a792-43bc-bac8-37fdd28235c0 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:02.163221 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6cd88958-a792-43bc-bac8-37fdd28235c0 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:02.163812 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6cd88958-a792-43bc-bac8-37fdd28235c0 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:02.164278 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6cd88958-a792-43bc-bac8-37fdd28235c0 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:02.165030 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6cd88958-a792-43bc-bac8-37fdd28235c0 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:02.165497 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6cd88958-a792-43bc-bac8-37fdd28235c0 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:02.165936 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6cd88958-a792-43bc-bac8-37fdd28235c0 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:03.077879 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6cd88958-a792-43bc-bac8-37fdd28235c0 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:03.091545 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6cd88958-a792-43bc-bac8-37fdd28235c0 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:03.094217 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6cd88958-a792-43bc-bac8-37fdd28235c0 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:03.096095 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6cd88958-a792-43bc-bac8-37fdd28235c0 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1750 microversion: 2.20 time: 0.970947 Sep 10 11:54:03.097392 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1643/3359] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:54:02 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1750 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:54:03.116736 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-178b77b7-8acb-41d7-b097-d813664802a1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:03.117800 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-178b77b7-8acb-41d7-b097-d813664802a1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: a4dbe5aa-fddd-42e7-b422-1585785f6034] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:03.128729 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-178b77b7-8acb-41d7-b097-d813664802a1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:03.129360 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-178b77b7-8acb-41d7-b097-d813664802a1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:03.130451 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-178b77b7-8acb-41d7-b097-d813664802a1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:03.132132 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-178b77b7-8acb-41d7-b097-d813664802a1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:03.132665 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-178b77b7-8acb-41d7-b097-d813664802a1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:03.133142 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-178b77b7-8acb-41d7-b097-d813664802a1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:03.388349 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=8 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:54:04.295040 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-178b77b7-8acb-41d7-b097-d813664802a1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:04.306621 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-178b77b7-8acb-41d7-b097-d813664802a1 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/a4dbe5aa-fddd-42e7-b422-1585785f6034" status: 200 len: 1519 microversion: 2.1 time: 1.207862 Sep 10 11:54:04.315956 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1644/3360] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:03 2022] GET /compute/v2.1/servers/a4dbe5aa-fddd-42e7-b422-1585785f6034 => generated 1519 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:04.326114 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-525e5df8-c6f5-4741-a517-b0c4dcc6b612 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:04.335107 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-525e5df8-c6f5-4741-a517-b0c4dcc6b612 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: be5d3b39-cea6-47fa-adeb-d79a92a2076a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:04.363093 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-525e5df8-c6f5-4741-a517-b0c4dcc6b612 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:04.364572 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-525e5df8-c6f5-4741-a517-b0c4dcc6b612 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:04.368745 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-525e5df8-c6f5-4741-a517-b0c4dcc6b612 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:04.369624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-525e5df8-c6f5-4741-a517-b0c4dcc6b612 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:04.372384 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-525e5df8-c6f5-4741-a517-b0c4dcc6b612 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:04.373869 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-525e5df8-c6f5-4741-a517-b0c4dcc6b612 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:05.368625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-525e5df8-c6f5-4741-a517-b0c4dcc6b612 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:05.384424 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-525e5df8-c6f5-4741-a517-b0c4dcc6b612 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a" status: 200 len: 1488 microversion: 2.1 time: 1.064316 Sep 10 11:54:05.399189 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1645/3361] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:04 2022] GET /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a => generated 1488 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:05.399189 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9542e71b-0429-463e-b31a-0b221b19e4d7 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:05.399189 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9542e71b-0429-463e-b31a-0b221b19e4d7 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] [instance: d40c7388-4376-47ca-98e3-27db94e48009] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:05.414536 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9542e71b-0429-463e-b31a-0b221b19e4d7 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:05.416493 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9542e71b-0429-463e-b31a-0b221b19e4d7 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:05.417162 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9542e71b-0429-463e-b31a-0b221b19e4d7 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:05.427303 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9542e71b-0429-463e-b31a-0b221b19e4d7 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:05.430363 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9542e71b-0429-463e-b31a-0b221b19e4d7 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:05.431899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9542e71b-0429-463e-b31a-0b221b19e4d7 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:06.034430 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9542e71b-0429-463e-b31a-0b221b19e4d7 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85362ff7bd6245d79b31a3937e14c095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a827355dfbcf40ec8d2e3e75d453e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:06.053395 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9542e71b-0429-463e-b31a-0b221b19e4d7 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c7388-4376-47ca-98e3-27db94e48009" status: 200 len: 1324 microversion: 2.1 time: 0.666669 Sep 10 11:54:06.072617 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1646/3362] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:05 2022] GET /compute/v2.1/servers/d40c7388-4376-47ca-98e3-27db94e48009 => generated 1324 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:06.072617 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c5d18e80-d7fa-44f9-ba20-d22c576e47b2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:06.072617 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c5d18e80-d7fa-44f9-ba20-d22c576e47b2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:06.080460 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c5d18e80-d7fa-44f9-ba20-d22c576e47b2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:06.080959 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c5d18e80-d7fa-44f9-ba20-d22c576e47b2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:06.081407 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c5d18e80-d7fa-44f9-ba20-d22c576e47b2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:06.092343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c5d18e80-d7fa-44f9-ba20-d22c576e47b2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:06.092788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c5d18e80-d7fa-44f9-ba20-d22c576e47b2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:06.093266 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c5d18e80-d7fa-44f9-ba20-d22c576e47b2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:07.021528 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c5d18e80-d7fa-44f9-ba20-d22c576e47b2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:07.031132 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c5d18e80-d7fa-44f9-ba20-d22c576e47b2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:07.042158 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c5d18e80-d7fa-44f9-ba20-d22c576e47b2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:07.043614 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c5d18e80-d7fa-44f9-ba20-d22c576e47b2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1752 microversion: 2.20 time: 0.988223 Sep 10 11:54:07.044662 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1647/3363] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:54:06 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1752 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:54:07.052256 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-711001ad-59bf-43f2-bc50-9a78a47d0452 req-4301a1e6-5d27-4942-b9a3-9b6c61cf7fee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4dbe5aa-fddd-42e7-b422-1585785f6034", "name": "network-vif-deleted", "tag": "8e40280c-4dd6-4982-bbdb-e834864f3de1"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:54:07.081599 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-711001ad-59bf-43f2-bc50-9a78a47d0452 req-4301a1e6-5d27-4942-b9a3-9b6c61cf7fee service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:07.082097 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-711001ad-59bf-43f2-bc50-9a78a47d0452 req-4301a1e6-5d27-4942-b9a3-9b6c61cf7fee service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:07.082538 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-711001ad-59bf-43f2-bc50-9a78a47d0452 req-4301a1e6-5d27-4942-b9a3-9b6c61cf7fee service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:07.106031 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-711001ad-59bf-43f2-bc50-9a78a47d0452 req-4301a1e6-5d27-4942-b9a3-9b6c61cf7fee service nova] Creating event network-vif-deleted:8e40280c-4dd6-4982-bbdb-e834864f3de1 for instance a4dbe5aa-fddd-42e7-b422-1585785f6034 on n-h1-856895-1 Sep 10 11:54:07.136057 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-711001ad-59bf-43f2-bc50-9a78a47d0452 req-4301a1e6-5d27-4942-b9a3-9b6c61cf7fee service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086445 Sep 10 11:54:07.136746 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1648/3364] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:54:07.153121 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c33329f0-d883-4d75-b262-8afc4c1ea250 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:07.155596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c33329f0-d883-4d75-b262-8afc4c1ea250 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: a4dbe5aa-fddd-42e7-b422-1585785f6034] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:07.164516 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c33329f0-d883-4d75-b262-8afc4c1ea250 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:07.178016 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c33329f0-d883-4d75-b262-8afc4c1ea250 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:07.178841 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c33329f0-d883-4d75-b262-8afc4c1ea250 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:07.179854 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c33329f0-d883-4d75-b262-8afc4c1ea250 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:07.180729 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c33329f0-d883-4d75-b262-8afc4c1ea250 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:07.181331 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c33329f0-d883-4d75-b262-8afc4c1ea250 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:07.212531 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-c33329f0-d883-4d75-b262-8afc4c1ea250 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] HTTP exception thrown: Instance a4dbe5aa-fddd-42e7-b422-1585785f6034 could not be found. Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c33329f0-d883-4d75-b262-8afc4c1ea250 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Request method failure captured: Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/a4dbe5aa-fddd-42e7-b422-1585785f6034 HTTP/1.1 Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHpvUcmR858xMY2SMLPakMoaz7_5OxFmkxTcHDutSdvsSNJFYS-mXUzlY5tFDlBJ95sjtWALXHmsAkzi88DwK8Y-l1xkoG96XernZMHi3q9ESNlfiBUYB31yZ99lguGpXmtbkbLVG5UTMZ1pGHiHcVPvwgwLOaTKbORD3yDCU_Q6OfI Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 27bed0cb3a46406b92496bee2da42567 Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ListServerFiltersTestJSON-1180781712 Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/27bed0cb3a46406b92496bee2da42567"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/27bed0cb3a46406b92496bee2da42567"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_27bed0cb3a46406b92496bee2da42567", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/27bed0cb3a46406b92496bee2da42567"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ListServerFiltersTestJSON-1180781712 Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 27bed0cb3a46406b92496bee2da42567 Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1180781712 Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ListServerFiltersTestJSON-1180781712-project Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: fe7ac57af1c94269bad68b4c8aec52fd Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ListServerFiltersTestJSON-1180781712-project Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance a4dbe5aa-fddd-42e7-b422-1585785f6034 could not be found. Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'a4dbe5aa-fddd-42e7-b422-1585785f6034'} Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4dbe5aa-fddd-42e7-b422-1585785f6034 could not be found. Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4dbe5aa-fddd-42e7-b422-1585785f6034 could not be found. Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:07.225396 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:07.230431 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:07.230431 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:07.230431 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:07.230431 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:54:07.230431 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:54:07.230431 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4dbe5aa-fddd-42e7-b422-1585785f6034 could not be found. Sep 10 11:54:07.230431 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:07.230431 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c33329f0-d883-4d75-b262-8afc4c1ea250 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Returning 404 to user: Instance a4dbe5aa-fddd-42e7-b422-1585785f6034 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:54:07.230431 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c33329f0-d883-4d75-b262-8afc4c1ea250 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/a4dbe5aa-fddd-42e7-b422-1585785f6034" status: 404 len: 111 microversion: 2.1 time: 0.089407 Sep 10 11:54:07.230431 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1649/3365] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:07 2022] GET /compute/v2.1/servers/a4dbe5aa-fddd-42e7-b422-1585785f6034 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:54:07.234908 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a701dd58-cef4-4a38-8b1e-58d49e09a3aa tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1463615824"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:54:07.237571 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a701dd58-cef4-4a38-8b1e-58d49e09a3aa tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: be5d3b39-cea6-47fa-adeb-d79a92a2076a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:07.251644 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a701dd58-cef4-4a38-8b1e-58d49e09a3aa tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:07.255521 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a701dd58-cef4-4a38-8b1e-58d49e09a3aa tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:07.256215 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a701dd58-cef4-4a38-8b1e-58d49e09a3aa tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:07.257089 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a701dd58-cef4-4a38-8b1e-58d49e09a3aa tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:07.263775 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a701dd58-cef4-4a38-8b1e-58d49e09a3aa tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:07.265102 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a701dd58-cef4-4a38-8b1e-58d49e09a3aa tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:07.673818 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4d11bf15-bb41-46fd-8249-e39384a20f33 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.343847 Sep 10 11:54:07.674989 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1717/3366] 10.222.0.23 () {60 vars in 1170 bytes} [Sat Sep 10 11:54:00 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:54:07.684543 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c3ab1afa-ffb9-47a3-a3c0-5054d5ad5b53 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:07.686465 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c3ab1afa-ffb9-47a3-a3c0-5054d5ad5b53 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] [instance: d40c7388-4376-47ca-98e3-27db94e48009] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:07.703631 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a701dd58-cef4-4a38-8b1e-58d49e09a3aa tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "POST /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a/action" status: 202 len: 0 microversion: 2.1 time: 0.472940 Sep 10 11:54:07.719551 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1650/3367] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:54:07 2022] POST /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 10 11:54:07.725346 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2c9ef463-f91c-4212-a6c4-9b5705940874 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:07.725947 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2c9ef463-f91c-4212-a6c4-9b5705940874 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:07.729304 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3ab1afa-ffb9-47a3-a3c0-5054d5ad5b53 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:07.731314 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3ab1afa-ffb9-47a3-a3c0-5054d5ad5b53 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:07.734571 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3ab1afa-ffb9-47a3-a3c0-5054d5ad5b53 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:07.738697 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3ab1afa-ffb9-47a3-a3c0-5054d5ad5b53 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:07.740397 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3ab1afa-ffb9-47a3-a3c0-5054d5ad5b53 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:07.742030 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3ab1afa-ffb9-47a3-a3c0-5054d5ad5b53 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:07.748416 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2c9ef463-f91c-4212-a6c4-9b5705940874 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:07.748928 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2c9ef463-f91c-4212-a6c4-9b5705940874 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:07.749374 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2c9ef463-f91c-4212-a6c4-9b5705940874 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:07.750091 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2c9ef463-f91c-4212-a6c4-9b5705940874 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:07.750550 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2c9ef463-f91c-4212-a6c4-9b5705940874 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:07.750986 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2c9ef463-f91c-4212-a6c4-9b5705940874 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:07.814877 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2c9ef463-f91c-4212-a6c4-9b5705940874 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:54:07.990156 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2c9ef463-f91c-4212-a6c4-9b5705940874 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985" status: 204 len: 0 microversion: 2.1 time: 0.268750 Sep 10 11:54:07.991389 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1651/3368] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:54:07 2022] DELETE /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:54:08.021731 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4637df1b-cf18-4db2-b481-895bfb884e72 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f407358a3a0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:08.135416 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4637df1b-cf18-4db2-b481-895bfb884e72 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/8eebc8ff-332d-41a0-878f-833613913538" status: 200 len: 1412 microversion: 2.1 time: 0.142293 Sep 10 11:54:08.136933 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1652/3369] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:54:07 2022] GET /compute/v2.1/images/8eebc8ff-332d-41a0-878f-833613913538 => generated 1412 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:08.149260 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6616dbce-2cab-49b8-8423-11ea5a4a4de2 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1905483072", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "9f016ce0-94a4-441f-9715-493bd2b96018"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:54:08.253674 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-6616dbce-2cab-49b8-8423-11ea5a4a4de2 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] validate_networks() for [('9f016ce0-94a4-441f-9715-493bd2b96018', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:54:08.418709 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c3ab1afa-ffb9-47a3-a3c0-5054d5ad5b53 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85362ff7bd6245d79b31a3937e14c095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a827355dfbcf40ec8d2e3e75d453e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:08.431692 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c3ab1afa-ffb9-47a3-a3c0-5054d5ad5b53 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c7388-4376-47ca-98e3-27db94e48009" status: 200 len: 1324 microversion: 2.1 time: 0.755167 Sep 10 11:54:08.432301 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1718/3370] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:07 2022] GET /compute/v2.1/servers/d40c7388-4376-47ca-98e3-27db94e48009 => generated 1324 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:08.448819 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2565cf1a-b4e7-484f-ab6a-8280b1831964 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:08.450865 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2565cf1a-b4e7-484f-ab6a-8280b1831964 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:08.466699 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2565cf1a-b4e7-484f-ab6a-8280b1831964 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:08.468626 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2565cf1a-b4e7-484f-ab6a-8280b1831964 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:08.476820 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2565cf1a-b4e7-484f-ab6a-8280b1831964 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:08.477858 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2565cf1a-b4e7-484f-ab6a-8280b1831964 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:08.478735 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2565cf1a-b4e7-484f-ab6a-8280b1831964 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:08.479381 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2565cf1a-b4e7-484f-ab6a-8280b1831964 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:08.631892 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=10 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:54:08.684303 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:54:09.033343 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2565cf1a-b4e7-484f-ab6a-8280b1831964 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:09.050111 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2565cf1a-b4e7-484f-ab6a-8280b1831964 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985" status: 200 len: 1518 microversion: 2.1 time: 0.614650 Sep 10 11:54:09.051147 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1719/3371] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:08 2022] GET /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985 => generated 1518 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:09.063724 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-44dead98-96ac-40a7-a711-73c1446d0e59 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:09.065404 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-44dead98-96ac-40a7-a711-73c1446d0e59 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:09.083524 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-44dead98-96ac-40a7-a711-73c1446d0e59 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:09.086094 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-44dead98-96ac-40a7-a711-73c1446d0e59 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:09.086802 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-44dead98-96ac-40a7-a711-73c1446d0e59 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:09.089059 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-44dead98-96ac-40a7-a711-73c1446d0e59 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:09.091231 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-44dead98-96ac-40a7-a711-73c1446d0e59 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:09.092542 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-44dead98-96ac-40a7-a711-73c1446d0e59 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:09.119868 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-6616dbce-2cab-49b8-8423-11ea5a4a4de2 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:54:09.120917 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-6616dbce-2cab-49b8-8423-11ea5a4a4de2 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:54:09.121561 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-6616dbce-2cab-49b8-8423-11ea5a4a4de2 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:54:09.122139 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-6616dbce-2cab-49b8-8423-11ea5a4a4de2 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:54:09.122727 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-6616dbce-2cab-49b8-8423-11ea5a4a4de2 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:54:09.133420 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6616dbce-2cab-49b8-8423-11ea5a4a4de2 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:09.138627 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6616dbce-2cab-49b8-8423-11ea5a4a4de2 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:09.139370 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6616dbce-2cab-49b8-8423-11ea5a4a4de2 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:09.142334 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6616dbce-2cab-49b8-8423-11ea5a4a4de2 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:09.149115 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6616dbce-2cab-49b8-8423-11ea5a4a4de2 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:09.149784 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6616dbce-2cab-49b8-8423-11ea5a4a4de2 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:09.193698 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-6616dbce-2cab-49b8-8423-11ea5a4a4de2 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Getting quotas for project 093f44e4274f41c1882cf1a2167dc891. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:54:09.206718 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-6616dbce-2cab-49b8-8423-11ea5a4a4de2 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Getting quotas for user 4318416fa33b40ae98c8c35675b0c101 and project 093f44e4274f41c1882cf1a2167dc891. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:54:09.235438 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6616dbce-2cab-49b8-8423-11ea5a4a4de2 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:54:09.238175 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6616dbce-2cab-49b8-8423-11ea5a4a4de2 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 43e1acba-4c0e-4f89-8d03-e9dcb388c1ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:54:09.292289 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6616dbce-2cab-49b8-8423-11ea5a4a4de2 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.153799 Sep 10 11:54:09.293276 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1653/3372] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:54:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:54:09.299320 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-25503f4c-92d9-439f-887b-f91de304a655 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f407354dc10>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:09.359745 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-25503f4c-92d9-439f-887b-f91de304a655 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/8eebc8ff-332d-41a0-878f-833613913538" status: 200 len: 1412 microversion: 2.1 time: 0.064882 Sep 10 11:54:09.364094 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1654/3373] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:54:09 2022] GET /compute/v2.1/images/8eebc8ff-332d-41a0-878f-833613913538 => generated 1412 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:09.378486 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-8980f645-5050-49de-8a61-663bfb938071 req-a3e8b886-0836-4e17-b61c-a4e89b673a92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d40c7388-4376-47ca-98e3-27db94e48009", "tag": "a27af5ea-3518-46fe-a788-b8d2663c94a9"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:54:09.398851 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-8980f645-5050-49de-8a61-663bfb938071 req-a3e8b886-0836-4e17-b61c-a4e89b673a92 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:09.402825 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-8980f645-5050-49de-8a61-663bfb938071 req-a3e8b886-0836-4e17-b61c-a4e89b673a92 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:09.403321 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-8980f645-5050-49de-8a61-663bfb938071 req-a3e8b886-0836-4e17-b61c-a4e89b673a92 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:09.427999 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-8980f645-5050-49de-8a61-663bfb938071 req-a3e8b886-0836-4e17-b61c-a4e89b673a92 service nova] Creating event network-changed:a27af5ea-3518-46fe-a788-b8d2663c94a9 for instance d40c7388-4376-47ca-98e3-27db94e48009 on n-h2-856895-1 Sep 10 11:54:09.443258 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-8980f645-5050-49de-8a61-663bfb938071 req-a3e8b886-0836-4e17-b61c-a4e89b673a92 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077396 Sep 10 11:54:09.444556 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1655/3374] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:54:09.450145 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2169484b-1552-43d8-beb9-119bf513f33d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:09.451109 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2169484b-1552-43d8-beb9-119bf513f33d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 43e1acba-4c0e-4f89-8d03-e9dcb388c1ef] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:09.604764 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2169484b-1552-43d8-beb9-119bf513f33d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318416fa33b40ae98c8c35675b0c101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f44e4274f41c1882cf1a2167dc891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:09.625792 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2169484b-1552-43d8-beb9-119bf513f33d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "GET /compute/v2.1/servers/43e1acba-4c0e-4f89-8d03-e9dcb388c1ef" status: 200 len: 1224 microversion: 2.1 time: 0.178713 Sep 10 11:54:09.626990 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1656/3375] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:09 2022] GET /compute/v2.1/servers/43e1acba-4c0e-4f89-8d03-e9dcb388c1ef => generated 1224 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:09.652649 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e333949a-a152-4c4a-9c1c-e94e164759c0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f40736b1670>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:09.685294 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-44dead98-96ac-40a7-a711-73c1446d0e59 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:09.699638 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-44dead98-96ac-40a7-a711-73c1446d0e59 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:09.704173 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-44dead98-96ac-40a7-a711-73c1446d0e59 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:09.708846 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-44dead98-96ac-40a7-a711-73c1446d0e59 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1752 microversion: 2.20 time: 0.654828 Sep 10 11:54:09.712523 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1720/3376] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:54:09 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1752 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:54:09.726740 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-03aca496-d842-4edf-b9f9-0822cfa33a38 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:09.727878 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-03aca496-d842-4edf-b9f9-0822cfa33a38 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] [instance: d40c7388-4376-47ca-98e3-27db94e48009] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:09.751088 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03aca496-d842-4edf-b9f9-0822cfa33a38 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:09.752831 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03aca496-d842-4edf-b9f9-0822cfa33a38 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:09.754904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03aca496-d842-4edf-b9f9-0822cfa33a38 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:09.755701 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03aca496-d842-4edf-b9f9-0822cfa33a38 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:09.758229 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03aca496-d842-4edf-b9f9-0822cfa33a38 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:09.758395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03aca496-d842-4edf-b9f9-0822cfa33a38 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:09.764760 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:54:09.996430 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e333949a-a152-4c4a-9c1c-e94e164759c0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "DELETE /compute/v2.1/images/8eebc8ff-332d-41a0-878f-833613913538" status: 204 len: 0 microversion: 2.1 time: 0.349736 Sep 10 11:54:10.000130 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1657/3377] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:09 2022] DELETE /compute/v2.1/images/8eebc8ff-332d-41a0-878f-833613913538 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:54:10.006914 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-03aca496-d842-4edf-b9f9-0822cfa33a38 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85362ff7bd6245d79b31a3937e14c095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a827355dfbcf40ec8d2e3e75d453e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:10.023104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2019c291-5e8c-400f-9233-e82cf273b2c6 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f4073678ee0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:10.033157 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-03aca496-d842-4edf-b9f9-0822cfa33a38 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c7388-4376-47ca-98e3-27db94e48009" status: 200 len: 1324 microversion: 2.1 time: 0.318954 Sep 10 11:54:10.034402 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1721/3378] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:09 2022] GET /compute/v2.1/servers/d40c7388-4376-47ca-98e3-27db94e48009 => generated 1324 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:10.056916 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-2019c291-5e8c-400f-9233-e82cf273b2c6 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] HTTP exception thrown: Image not found. Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2019c291-5e8c-400f-9233-e82cf273b2c6 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Request method failure captured: Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/images/8eebc8ff-332d-41a0-878f-833613913538 HTTP/1.1 Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHn4qx7-RJW530OcZP-HbaGtHMvLFpM5FagIMU2VdWF84c499i9YfjZquQEUjoDx9LuzhR3BDEoUkdspCmBol1ak1On1wm7uogZWHDZsvVl6TsHMKnzPFOC81lsU-lVJhYePyv1AjhxbbjqxuBJCGxjFxEftt4cUayosCmqZZn3TePc Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 57eb6c59b1a7467baf0daae9019ca5aa Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ImagesTestJSON-915014488 Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/57eb6c59b1a7467baf0daae9019ca5aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/57eb6c59b1a7467baf0daae9019ca5aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_57eb6c59b1a7467baf0daae9019ca5aa", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/57eb6c59b1a7467baf0daae9019ca5aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ImagesTestJSON-915014488 Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 57eb6c59b1a7467baf0daae9019ca5aa Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ImagesTestJSON-915014488 Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ImagesTestJSON-915014488-project Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 1ead4e0fd51b484c8dd38da5a3975788 Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ImagesTestJSON-915014488-project Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: exception: Image not found. Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '8eebc8ff-332d-41a0-878f-833613913538'} Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8eebc8ff-332d-41a0-878f-833613913538 Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 10 11:54:10.059531 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8eebc8ff-332d-41a0-878f-833613913538 could not be found. Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2019c291-5e8c-400f-9233-e82cf273b2c6 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Returning 404 to user: Image not found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2019c291-5e8c-400f-9233-e82cf273b2c6 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/images/8eebc8ff-332d-41a0-878f-833613913538" status: 404 len: 62 microversion: 2.1 time: 0.052503 Sep 10 11:54:10.064805 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1658/3379] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:54:10 2022] GET /compute/v2.1/images/8eebc8ff-332d-41a0-878f-833613913538 => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:54:10.074452 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2acf8341-2209-49b1-84b2-8cc5fd531a91 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:10.075089 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2acf8341-2209-49b1-84b2-8cc5fd531a91 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: be5d3b39-cea6-47fa-adeb-d79a92a2076a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:10.088386 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2acf8341-2209-49b1-84b2-8cc5fd531a91 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:10.091713 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-56e6c676-ff61-4700-bffa-dd92480dd514 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:10.092535 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-56e6c676-ff61-4700-bffa-dd92480dd514 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:10.094208 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2acf8341-2209-49b1-84b2-8cc5fd531a91 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:10.094766 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2acf8341-2209-49b1-84b2-8cc5fd531a91 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:10.095526 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2acf8341-2209-49b1-84b2-8cc5fd531a91 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:10.095980 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2acf8341-2209-49b1-84b2-8cc5fd531a91 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:10.096758 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2acf8341-2209-49b1-84b2-8cc5fd531a91 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:10.113449 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-56e6c676-ff61-4700-bffa-dd92480dd514 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:10.114004 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-56e6c676-ff61-4700-bffa-dd92480dd514 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:10.114380 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-56e6c676-ff61-4700-bffa-dd92480dd514 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:10.115086 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-56e6c676-ff61-4700-bffa-dd92480dd514 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:10.117051 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-56e6c676-ff61-4700-bffa-dd92480dd514 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:10.117628 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-56e6c676-ff61-4700-bffa-dd92480dd514 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:10.477260 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-56e6c676-ff61-4700-bffa-dd92480dd514 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:10.486845 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:54:10.489935 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-56e6c676-ff61-4700-bffa-dd92480dd514 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985" status: 200 len: 1518 microversion: 2.1 time: 0.406717 Sep 10 11:54:10.491041 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1659/3380] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:10 2022] GET /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985 => generated 1518 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:10.653546 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c7359f3c-39be-4cb6-8900-c8db573410b8 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:10.653546 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c7359f3c-39be-4cb6-8900-c8db573410b8 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 43e1acba-4c0e-4f89-8d03-e9dcb388c1ef] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:10.677223 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c7359f3c-39be-4cb6-8900-c8db573410b8 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:10.677722 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c7359f3c-39be-4cb6-8900-c8db573410b8 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:10.678161 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c7359f3c-39be-4cb6-8900-c8db573410b8 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:10.678865 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c7359f3c-39be-4cb6-8900-c8db573410b8 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:10.679363 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c7359f3c-39be-4cb6-8900-c8db573410b8 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:10.679787 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c7359f3c-39be-4cb6-8900-c8db573410b8 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:10.693703 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2acf8341-2209-49b1-84b2-8cc5fd531a91 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:10.708593 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2acf8341-2209-49b1-84b2-8cc5fd531a91 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a" status: 200 len: 1500 microversion: 2.1 time: 0.636805 Sep 10 11:54:10.709589 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1722/3381] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:10 2022] GET /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a => generated 1500 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:10.752457 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5f715906-2e5d-4222-815f-fbbaf1f228df tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:10.753376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5f715906-2e5d-4222-815f-fbbaf1f228df tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:10.760493 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5f715906-2e5d-4222-815f-fbbaf1f228df tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:10.761698 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5f715906-2e5d-4222-815f-fbbaf1f228df tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:10.762502 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5f715906-2e5d-4222-815f-fbbaf1f228df tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:10.763566 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5f715906-2e5d-4222-815f-fbbaf1f228df tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:10.764993 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5f715906-2e5d-4222-815f-fbbaf1f228df tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:10.765687 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5f715906-2e5d-4222-815f-fbbaf1f228df tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:10.949355 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c7359f3c-39be-4cb6-8900-c8db573410b8 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318416fa33b40ae98c8c35675b0c101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f44e4274f41c1882cf1a2167dc891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:10.963192 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c7359f3c-39be-4cb6-8900-c8db573410b8 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "GET /compute/v2.1/servers/43e1acba-4c0e-4f89-8d03-e9dcb388c1ef" status: 200 len: 1220 microversion: 2.1 time: 0.314434 Sep 10 11:54:10.966281 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1660/3382] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:10 2022] GET /compute/v2.1/servers/43e1acba-4c0e-4f89-8d03-e9dcb388c1ef => generated 1220 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:11.057633 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fc4762c6-c79e-4774-b521-35897f9d5f4d tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:11.058516 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fc4762c6-c79e-4774-b521-35897f9d5f4d tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] [instance: d40c7388-4376-47ca-98e3-27db94e48009] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:11.069666 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc4762c6-c79e-4774-b521-35897f9d5f4d tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:11.071719 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc4762c6-c79e-4774-b521-35897f9d5f4d tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:11.073786 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc4762c6-c79e-4774-b521-35897f9d5f4d tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:11.078299 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc4762c6-c79e-4774-b521-35897f9d5f4d tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:11.079280 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc4762c6-c79e-4774-b521-35897f9d5f4d tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:11.079836 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc4762c6-c79e-4774-b521-35897f9d5f4d tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:11.596841 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5f715906-2e5d-4222-815f-fbbaf1f228df tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:11.607206 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5f715906-2e5d-4222-815f-fbbaf1f228df tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:11.616797 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5f715906-2e5d-4222-815f-fbbaf1f228df tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:11.634697 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5f715906-2e5d-4222-815f-fbbaf1f228df tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1752 microversion: 2.20 time: 0.894549 Sep 10 11:54:11.642892 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1723/3383] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:54:10 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1752 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:54:11.665004 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-166feece-aba3-4ce0-b443-835a33387560 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:11.667956 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-166feece-aba3-4ce0-b443-835a33387560 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:11.705627 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-166feece-aba3-4ce0-b443-835a33387560 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:11.706132 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-166feece-aba3-4ce0-b443-835a33387560 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:11.707271 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-166feece-aba3-4ce0-b443-835a33387560 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:11.707988 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-166feece-aba3-4ce0-b443-835a33387560 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:11.708450 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-166feece-aba3-4ce0-b443-835a33387560 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:11.708881 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-166feece-aba3-4ce0-b443-835a33387560 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:11.835997 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fc4762c6-c79e-4774-b521-35897f9d5f4d tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85362ff7bd6245d79b31a3937e14c095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a827355dfbcf40ec8d2e3e75d453e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:11.865278 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fc4762c6-c79e-4774-b521-35897f9d5f4d tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c7388-4376-47ca-98e3-27db94e48009" status: 200 len: 1324 microversion: 2.1 time: 0.810509 Sep 10 11:54:11.888279 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1661/3384] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:11 2022] GET /compute/v2.1/servers/d40c7388-4376-47ca-98e3-27db94e48009 => generated 1324 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:54:11.897666 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-889771d8-984b-4c00-8547-553f32c7a70b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:11.899277 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-889771d8-984b-4c00-8547-553f32c7a70b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: be5d3b39-cea6-47fa-adeb-d79a92a2076a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:11.924616 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-889771d8-984b-4c00-8547-553f32c7a70b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:11.925201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-889771d8-984b-4c00-8547-553f32c7a70b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:11.925855 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-889771d8-984b-4c00-8547-553f32c7a70b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:11.927485 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-889771d8-984b-4c00-8547-553f32c7a70b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:11.928165 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-889771d8-984b-4c00-8547-553f32c7a70b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:11.928859 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-889771d8-984b-4c00-8547-553f32c7a70b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:12.626306 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-166feece-aba3-4ce0-b443-835a33387560 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:12.646070 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-166feece-aba3-4ce0-b443-835a33387560 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985" status: 200 len: 1518 microversion: 2.1 time: 0.997623 Sep 10 11:54:12.669523 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1724/3385] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:11 2022] GET /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985 => generated 1518 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:12.683443 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4df0b72d-39f1-4a21-a625-ac1fd53b81d8 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:12.688953 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4df0b72d-39f1-4a21-a625-ac1fd53b81d8 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 43e1acba-4c0e-4f89-8d03-e9dcb388c1ef] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:12.702351 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4df0b72d-39f1-4a21-a625-ac1fd53b81d8 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:12.704987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4df0b72d-39f1-4a21-a625-ac1fd53b81d8 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:12.712460 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4df0b72d-39f1-4a21-a625-ac1fd53b81d8 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:12.713451 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4df0b72d-39f1-4a21-a625-ac1fd53b81d8 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:12.715553 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4df0b72d-39f1-4a21-a625-ac1fd53b81d8 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:12.716342 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4df0b72d-39f1-4a21-a625-ac1fd53b81d8 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:12.841316 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-889771d8-984b-4c00-8547-553f32c7a70b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:12.851771 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-889771d8-984b-4c00-8547-553f32c7a70b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a" status: 200 len: 1506 microversion: 2.1 time: 0.960785 Sep 10 11:54:12.854810 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1662/3386] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:11 2022] GET /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a => generated 1506 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:12.864588 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cb966527-512a-43ae-afac-efde937454fb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:12.874785 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cb966527-512a-43ae-afac-efde937454fb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:12.881549 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb966527-512a-43ae-afac-efde937454fb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:12.882402 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb966527-512a-43ae-afac-efde937454fb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:12.883643 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb966527-512a-43ae-afac-efde937454fb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:12.884932 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb966527-512a-43ae-afac-efde937454fb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:12.885699 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb966527-512a-43ae-afac-efde937454fb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:12.886551 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb966527-512a-43ae-afac-efde937454fb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:12.941691 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4df0b72d-39f1-4a21-a625-ac1fd53b81d8 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318416fa33b40ae98c8c35675b0c101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f44e4274f41c1882cf1a2167dc891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:12.954834 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4df0b72d-39f1-4a21-a625-ac1fd53b81d8 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "GET /compute/v2.1/servers/43e1acba-4c0e-4f89-8d03-e9dcb388c1ef" status: 200 len: 1282 microversion: 2.1 time: 0.281964 Sep 10 11:54:12.976655 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1725/3387] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:12 2022] GET /compute/v2.1/servers/43e1acba-4c0e-4f89-8d03-e9dcb388c1ef => generated 1282 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:12.990893 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-61b7f119-a3c7-463d-b108-8a42757042ed tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:12.991545 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-61b7f119-a3c7-463d-b108-8a42757042ed tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] [instance: d40c7388-4376-47ca-98e3-27db94e48009] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:13.022819 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61b7f119-a3c7-463d-b108-8a42757042ed tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:13.023584 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61b7f119-a3c7-463d-b108-8a42757042ed tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:13.024127 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61b7f119-a3c7-463d-b108-8a42757042ed tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:13.025751 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61b7f119-a3c7-463d-b108-8a42757042ed tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:13.027267 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61b7f119-a3c7-463d-b108-8a42757042ed tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:13.028672 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61b7f119-a3c7-463d-b108-8a42757042ed tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:13.564020 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-cb966527-512a-43ae-afac-efde937454fb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:13.583385 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-cb966527-512a-43ae-afac-efde937454fb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:13.589573 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-cb966527-512a-43ae-afac-efde937454fb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:13.595614 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cb966527-512a-43ae-afac-efde937454fb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1752 microversion: 2.20 time: 0.734349 Sep 10 11:54:13.619828 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1663/3388] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:54:12 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1752 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:54:13.641952 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-c531005a-db71-42ff-8a8a-a31e43c56951 req-83272566-b1bd-478d-a6fe-34ecb178b28d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985", "name": "network-vif-deleted", "tag": "41f294db-6dd8-4d98-bef8-4a14b639fcba"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:54:13.677983 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-c531005a-db71-42ff-8a8a-a31e43c56951 req-83272566-b1bd-478d-a6fe-34ecb178b28d service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:13.678478 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-c531005a-db71-42ff-8a8a-a31e43c56951 req-83272566-b1bd-478d-a6fe-34ecb178b28d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:13.687395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-61b7f119-a3c7-463d-b108-8a42757042ed tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85362ff7bd6245d79b31a3937e14c095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a827355dfbcf40ec8d2e3e75d453e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:13.697418 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-c531005a-db71-42ff-8a8a-a31e43c56951 req-83272566-b1bd-478d-a6fe-34ecb178b28d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:13.701709 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-61b7f119-a3c7-463d-b108-8a42757042ed tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c7388-4376-47ca-98e3-27db94e48009" status: 200 len: 1324 microversion: 2.1 time: 0.723705 Sep 10 11:54:13.719370 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1726/3389] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:12 2022] GET /compute/v2.1/servers/d40c7388-4376-47ca-98e3-27db94e48009 => generated 1324 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:13.719370 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-83624dba-5289-4696-9ed0-cd3c780d7f15 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:13.719370 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-83624dba-5289-4696-9ed0-cd3c780d7f15 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:13.724574 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-83624dba-5289-4696-9ed0-cd3c780d7f15 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:13.729940 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-83624dba-5289-4696-9ed0-cd3c780d7f15 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:13.730557 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-83624dba-5289-4696-9ed0-cd3c780d7f15 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:13.733855 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-83624dba-5289-4696-9ed0-cd3c780d7f15 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:13.744485 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-c531005a-db71-42ff-8a8a-a31e43c56951 req-83272566-b1bd-478d-a6fe-34ecb178b28d service nova] Creating event network-vif-deleted:41f294db-6dd8-4d98-bef8-4a14b639fcba for instance 7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985 on n-h1-856895-1 Sep 10 11:54:13.744651 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-83624dba-5289-4696-9ed0-cd3c780d7f15 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:13.745210 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-83624dba-5289-4696-9ed0-cd3c780d7f15 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:13.762108 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-c531005a-db71-42ff-8a8a-a31e43c56951 req-83272566-b1bd-478d-a6fe-34ecb178b28d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140368 Sep 10 11:54:13.762713 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1664/3390] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:54:13.793046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-83624dba-5289-4696-9ed0-cd3c780d7f15 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:13.793688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-83624dba-5289-4696-9ed0-cd3c780d7f15 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:13.794385 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-83624dba-5289-4696-9ed0-cd3c780d7f15 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:13.795661 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-83624dba-5289-4696-9ed0-cd3c780d7f15 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lazy-loading 'fault' on Instance uuid 7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:54:13.877784 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-83624dba-5289-4696-9ed0-cd3c780d7f15 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe7ac57af1c94269bad68b4c8aec52fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27bed0cb3a46406b92496bee2da42567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:13.884706 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-110d74e7-134f-48db-9c94-fd37bc3764d0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:13.886418 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-110d74e7-134f-48db-9c94-fd37bc3764d0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: be5d3b39-cea6-47fa-adeb-d79a92a2076a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:13.890097 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-83624dba-5289-4696-9ed0-cd3c780d7f15 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985" status: 200 len: 1311 microversion: 2.1 time: 0.183896 Sep 10 11:54:13.892037 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1727/3391] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:13 2022] GET /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985 => generated 1311 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:13.917678 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-110d74e7-134f-48db-9c94-fd37bc3764d0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:13.918507 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-110d74e7-134f-48db-9c94-fd37bc3764d0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:13.919876 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-110d74e7-134f-48db-9c94-fd37bc3764d0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:13.922257 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-110d74e7-134f-48db-9c94-fd37bc3764d0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:13.923106 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-110d74e7-134f-48db-9c94-fd37bc3764d0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:13.923542 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-110d74e7-134f-48db-9c94-fd37bc3764d0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:13.982171 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d73a316e-a27b-432a-83fb-39c44e92d15e tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:13.983764 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d73a316e-a27b-432a-83fb-39c44e92d15e tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 43e1acba-4c0e-4f89-8d03-e9dcb388c1ef] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:13.996035 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d73a316e-a27b-432a-83fb-39c44e92d15e tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:13.997701 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d73a316e-a27b-432a-83fb-39c44e92d15e tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:13.998324 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d73a316e-a27b-432a-83fb-39c44e92d15e tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:14.001854 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d73a316e-a27b-432a-83fb-39c44e92d15e tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:14.002472 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d73a316e-a27b-432a-83fb-39c44e92d15e tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:14.005348 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d73a316e-a27b-432a-83fb-39c44e92d15e tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:14.161672 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d73a316e-a27b-432a-83fb-39c44e92d15e tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318416fa33b40ae98c8c35675b0c101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f44e4274f41c1882cf1a2167dc891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:14.171484 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d73a316e-a27b-432a-83fb-39c44e92d15e tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "GET /compute/v2.1/servers/43e1acba-4c0e-4f89-8d03-e9dcb388c1ef" status: 200 len: 1282 microversion: 2.1 time: 0.193092 Sep 10 11:54:14.192778 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1728/3392] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:13 2022] GET /compute/v2.1/servers/43e1acba-4c0e-4f89-8d03-e9dcb388c1ef => generated 1282 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:14.646057 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-110d74e7-134f-48db-9c94-fd37bc3764d0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:14.688350 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-110d74e7-134f-48db-9c94-fd37bc3764d0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a" status: 200 len: 1506 microversion: 2.1 time: 0.807748 Sep 10 11:54:14.690345 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1665/3393] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:13 2022] GET /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a => generated 1506 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:54:14.703240 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8fbafd74-cd1f-45ff-b5cf-96aed9d47d10 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:14.704294 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8fbafd74-cd1f-45ff-b5cf-96aed9d47d10 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:14.730198 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8fbafd74-cd1f-45ff-b5cf-96aed9d47d10 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:14.731332 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8fbafd74-cd1f-45ff-b5cf-96aed9d47d10 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:14.732177 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8fbafd74-cd1f-45ff-b5cf-96aed9d47d10 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:14.732975 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-da498c1f-c4fb-49d8-8d11-60e42edc0c2f req-12ef6f1e-225a-4be4-b6b8-4c0f4cf09ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d40c7388-4376-47ca-98e3-27db94e48009", "name": "network-vif-plugged", "status": "completed", "tag": "a27af5ea-3518-46fe-a788-b8d2663c94a9"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:54:14.733738 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8fbafd74-cd1f-45ff-b5cf-96aed9d47d10 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:14.734538 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8fbafd74-cd1f-45ff-b5cf-96aed9d47d10 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:14.736387 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8fbafd74-cd1f-45ff-b5cf-96aed9d47d10 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:14.752294 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-da498c1f-c4fb-49d8-8d11-60e42edc0c2f req-12ef6f1e-225a-4be4-b6b8-4c0f4cf09ff8 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:14.752779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-da498c1f-c4fb-49d8-8d11-60e42edc0c2f req-12ef6f1e-225a-4be4-b6b8-4c0f4cf09ff8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:14.756204 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-da498c1f-c4fb-49d8-8d11-60e42edc0c2f req-12ef6f1e-225a-4be4-b6b8-4c0f4cf09ff8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:14.783631 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-da498c1f-c4fb-49d8-8d11-60e42edc0c2f req-12ef6f1e-225a-4be4-b6b8-4c0f4cf09ff8 service nova] Creating event network-vif-plugged:a27af5ea-3518-46fe-a788-b8d2663c94a9 for instance d40c7388-4376-47ca-98e3-27db94e48009 on n-h2-856895-1 Sep 10 11:54:14.799083 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-da498c1f-c4fb-49d8-8d11-60e42edc0c2f req-12ef6f1e-225a-4be4-b6b8-4c0f4cf09ff8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.524058 Sep 10 11:54:14.802272 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1729/3394] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:54:14.809498 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-63fb8a2f-389e-4a7e-9b22-d2f1c8769a2f tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:14.811101 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-63fb8a2f-389e-4a7e-9b22-d2f1c8769a2f tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] [instance: d40c7388-4376-47ca-98e3-27db94e48009] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:14.836828 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-63fb8a2f-389e-4a7e-9b22-d2f1c8769a2f tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:14.838027 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-63fb8a2f-389e-4a7e-9b22-d2f1c8769a2f tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:14.838747 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-63fb8a2f-389e-4a7e-9b22-d2f1c8769a2f tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:14.841492 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-63fb8a2f-389e-4a7e-9b22-d2f1c8769a2f tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:14.842712 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-63fb8a2f-389e-4a7e-9b22-d2f1c8769a2f tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:14.847801 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-63fb8a2f-389e-4a7e-9b22-d2f1c8769a2f tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:15.582659 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8fbafd74-cd1f-45ff-b5cf-96aed9d47d10 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:15.597773 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8fbafd74-cd1f-45ff-b5cf-96aed9d47d10 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:15.609549 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-63fb8a2f-389e-4a7e-9b22-d2f1c8769a2f tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85362ff7bd6245d79b31a3937e14c095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a827355dfbcf40ec8d2e3e75d453e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:15.614610 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8fbafd74-cd1f-45ff-b5cf-96aed9d47d10 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:15.618516 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8fbafd74-cd1f-45ff-b5cf-96aed9d47d10 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1808 microversion: 2.20 time: 0.925398 Sep 10 11:54:15.619865 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1666/3395] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:54:14 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1808 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:54:15.620818 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-63fb8a2f-389e-4a7e-9b22-d2f1c8769a2f tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c7388-4376-47ca-98e3-27db94e48009" status: 200 len: 1324 microversion: 2.1 time: 0.816965 Sep 10 11:54:15.622773 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1730/3396] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:14 2022] GET /compute/v2.1/servers/d40c7388-4376-47ca-98e3-27db94e48009 => generated 1324 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:15.634522 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-68273c84-901d-4581-9ebf-dbca0b974035 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:15.635468 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-68273c84-901d-4581-9ebf-dbca0b974035 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] [instance: 7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:15.642897 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fd558927-b656-4ff0-be06-2147116d78bf tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:15.643636 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fd558927-b656-4ff0-be06-2147116d78bf tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 43e1acba-4c0e-4f89-8d03-e9dcb388c1ef] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:15.657515 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-68273c84-901d-4581-9ebf-dbca0b974035 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:15.658069 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fd558927-b656-4ff0-be06-2147116d78bf tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:15.659334 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fd558927-b656-4ff0-be06-2147116d78bf tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:15.660082 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fd558927-b656-4ff0-be06-2147116d78bf tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:15.661152 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fd558927-b656-4ff0-be06-2147116d78bf tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:15.662056 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-68273c84-901d-4581-9ebf-dbca0b974035 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:15.663141 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fd558927-b656-4ff0-be06-2147116d78bf tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:15.663558 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-68273c84-901d-4581-9ebf-dbca0b974035 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:15.664391 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-68273c84-901d-4581-9ebf-dbca0b974035 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:15.664935 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fd558927-b656-4ff0-be06-2147116d78bf tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:15.670681 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-68273c84-901d-4581-9ebf-dbca0b974035 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:15.671600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-68273c84-901d-4581-9ebf-dbca0b974035 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:15.700866 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-68273c84-901d-4581-9ebf-dbca0b974035 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] HTTP exception thrown: Instance 7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985 could not be found. Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-68273c84-901d-4581-9ebf-dbca0b974035 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Request method failure captured: Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985 HTTP/1.1 Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHpvUcmR858xMY2SMLPakMoaz7_5OxFmkxTcHDutSdvsSNJFYS-mXUzlY5tFDlBJ95sjtWALXHmsAkzi88DwK8Y-l1xkoG96XernZMHi3q9ESNlfiBUYB31yZ99lguGpXmtbkbLVG5UTMZ1pGHiHcVPvwgwLOaTKbORD3yDCU_Q6OfI Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 27bed0cb3a46406b92496bee2da42567 Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ListServerFiltersTestJSON-1180781712 Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/27bed0cb3a46406b92496bee2da42567"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/27bed0cb3a46406b92496bee2da42567"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_27bed0cb3a46406b92496bee2da42567", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/27bed0cb3a46406b92496bee2da42567"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ListServerFiltersTestJSON-1180781712 Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 27bed0cb3a46406b92496bee2da42567 Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1180781712 Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ListServerFiltersTestJSON-1180781712-project Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: fe7ac57af1c94269bad68b4c8aec52fd Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ListServerFiltersTestJSON-1180781712-project Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985 could not be found. Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985'} Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985 could not be found. Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985 could not be found. Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:15.704871 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:15.709559 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:15.709559 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:15.709559 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:15.709559 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:54:15.709559 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:54:15.709559 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985 could not be found. Sep 10 11:54:15.709559 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:15.709559 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-68273c84-901d-4581-9ebf-dbca0b974035 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] Returning 404 to user: Instance 7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:54:15.709559 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-68273c84-901d-4581-9ebf-dbca0b974035 tempest-ListServerFiltersTestJSON-1180781712 tempest-ListServerFiltersTestJSON-1180781712-project] 10.222.0.23 "GET /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985" status: 404 len: 111 microversion: 2.1 time: 0.085332 Sep 10 11:54:15.709559 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1667/3397] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:15 2022] GET /compute/v2.1/servers/7eaff6d3-f7d8-46d5-a6dc-7f3e4281f985 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:54:15.726005 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3166d2f9-35df-49ee-b0f5-f2d4d75a98d7 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:15.726614 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3166d2f9-35df-49ee-b0f5-f2d4d75a98d7 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: be5d3b39-cea6-47fa-adeb-d79a92a2076a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:15.736315 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:54:15.738270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3166d2f9-35df-49ee-b0f5-f2d4d75a98d7 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:15.739153 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3166d2f9-35df-49ee-b0f5-f2d4d75a98d7 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:15.739692 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3166d2f9-35df-49ee-b0f5-f2d4d75a98d7 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:15.740577 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3166d2f9-35df-49ee-b0f5-f2d4d75a98d7 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:15.741033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3166d2f9-35df-49ee-b0f5-f2d4d75a98d7 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:15.741491 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3166d2f9-35df-49ee-b0f5-f2d4d75a98d7 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:16.288553 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fd558927-b656-4ff0-be06-2147116d78bf tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318416fa33b40ae98c8c35675b0c101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f44e4274f41c1882cf1a2167dc891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:16.297658 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3166d2f9-35df-49ee-b0f5-f2d4d75a98d7 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:16.302405 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fd558927-b656-4ff0-be06-2147116d78bf tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "GET /compute/v2.1/servers/43e1acba-4c0e-4f89-8d03-e9dcb388c1ef" status: 200 len: 1324 microversion: 2.1 time: 0.674290 Sep 10 11:54:16.306450 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1731/3398] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:15 2022] GET /compute/v2.1/servers/43e1acba-4c0e-4f89-8d03-e9dcb388c1ef => generated 1324 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:16.324181 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3166d2f9-35df-49ee-b0f5-f2d4d75a98d7 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a" status: 200 len: 1501 microversion: 2.1 time: 0.602893 Sep 10 11:54:16.340516 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1668/3399] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:15 2022] GET /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a => generated 1501 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:16.645944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f81d29e4-8fc1-416e-bd98-5be5477f94ef tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:16.646878 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f81d29e4-8fc1-416e-bd98-5be5477f94ef tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] [instance: d40c7388-4376-47ca-98e3-27db94e48009] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:16.658682 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f81d29e4-8fc1-416e-bd98-5be5477f94ef tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:16.663513 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-89439c4f-3eb3-4e74-a8ea-0d045ecbb2e0 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:16.665077 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f81d29e4-8fc1-416e-bd98-5be5477f94ef tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:16.665542 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f81d29e4-8fc1-416e-bd98-5be5477f94ef tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:16.666291 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f81d29e4-8fc1-416e-bd98-5be5477f94ef tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:16.666916 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f81d29e4-8fc1-416e-bd98-5be5477f94ef tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:16.667383 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f81d29e4-8fc1-416e-bd98-5be5477f94ef tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:16.669502 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-89439c4f-3eb3-4e74-a8ea-0d045ecbb2e0 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:16.692440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-89439c4f-3eb3-4e74-a8ea-0d045ecbb2e0 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:16.695565 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-89439c4f-3eb3-4e74-a8ea-0d045ecbb2e0 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:16.697117 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-89439c4f-3eb3-4e74-a8ea-0d045ecbb2e0 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:16.699531 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-89439c4f-3eb3-4e74-a8ea-0d045ecbb2e0 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:16.700264 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-89439c4f-3eb3-4e74-a8ea-0d045ecbb2e0 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:16.702510 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-89439c4f-3eb3-4e74-a8ea-0d045ecbb2e0 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:17.949809 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f81d29e4-8fc1-416e-bd98-5be5477f94ef tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85362ff7bd6245d79b31a3937e14c095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a827355dfbcf40ec8d2e3e75d453e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:17.960203 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f81d29e4-8fc1-416e-bd98-5be5477f94ef tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c7388-4376-47ca-98e3-27db94e48009" status: 200 len: 1324 microversion: 2.1 time: 1.318079 Sep 10 11:54:17.969265 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1669/3400] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:16 2022] GET /compute/v2.1/servers/d40c7388-4376-47ca-98e3-27db94e48009 => generated 1324 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:17.981403 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-750d5436-18f9-401b-84d5-405106df5a5f req-8ef1fc3e-a5f6-4eaf-b394-f87ad6c8ebdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43e1acba-4c0e-4f89-8d03-e9dcb388c1ef", "tag": "12dbd5b4-0a1e-43b6-b783-06fe70dd1b54"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:54:18.002985 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-750d5436-18f9-401b-84d5-405106df5a5f req-8ef1fc3e-a5f6-4eaf-b394-f87ad6c8ebdd service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:18.003963 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-750d5436-18f9-401b-84d5-405106df5a5f req-8ef1fc3e-a5f6-4eaf-b394-f87ad6c8ebdd service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:18.004646 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-750d5436-18f9-401b-84d5-405106df5a5f req-8ef1fc3e-a5f6-4eaf-b394-f87ad6c8ebdd service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:18.036913 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-750d5436-18f9-401b-84d5-405106df5a5f req-8ef1fc3e-a5f6-4eaf-b394-f87ad6c8ebdd service nova] Creating event network-changed:12dbd5b4-0a1e-43b6-b783-06fe70dd1b54 for instance 43e1acba-4c0e-4f89-8d03-e9dcb388c1ef on n-h2-856895-1 Sep 10 11:54:18.045452 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-750d5436-18f9-401b-84d5-405106df5a5f req-8ef1fc3e-a5f6-4eaf-b394-f87ad6c8ebdd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074531 Sep 10 11:54:18.046694 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1670/3401] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:54:18.062279 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1a0f89a9-4cb8-47d0-8c0f-12b2dfee7795 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:18.063016 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1a0f89a9-4cb8-47d0-8c0f-12b2dfee7795 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 43e1acba-4c0e-4f89-8d03-e9dcb388c1ef] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:18.077621 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a0f89a9-4cb8-47d0-8c0f-12b2dfee7795 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:18.081855 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a0f89a9-4cb8-47d0-8c0f-12b2dfee7795 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:18.082363 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a0f89a9-4cb8-47d0-8c0f-12b2dfee7795 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:18.083119 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a0f89a9-4cb8-47d0-8c0f-12b2dfee7795 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:18.083559 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a0f89a9-4cb8-47d0-8c0f-12b2dfee7795 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:18.083990 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a0f89a9-4cb8-47d0-8c0f-12b2dfee7795 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:18.367715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-89439c4f-3eb3-4e74-a8ea-0d045ecbb2e0 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:18.381045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-89439c4f-3eb3-4e74-a8ea-0d045ecbb2e0 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:18.382564 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-89439c4f-3eb3-4e74-a8ea-0d045ecbb2e0 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:18.391587 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-89439c4f-3eb3-4e74-a8ea-0d045ecbb2e0 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1808 microversion: 2.20 time: 1.748526 Sep 10 11:54:18.392196 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1732/3402] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:54:16 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1808 bytes in 1751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:54:18.402126 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-01ebc419-0493-418a-9bc1-a3f6075b31af tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:18.404223 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-01ebc419-0493-418a-9bc1-a3f6075b31af tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: be5d3b39-cea6-47fa-adeb-d79a92a2076a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:18.415413 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-01ebc419-0493-418a-9bc1-a3f6075b31af tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:18.415912 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-01ebc419-0493-418a-9bc1-a3f6075b31af tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:18.416354 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-01ebc419-0493-418a-9bc1-a3f6075b31af tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:18.417061 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-01ebc419-0493-418a-9bc1-a3f6075b31af tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:18.417524 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-01ebc419-0493-418a-9bc1-a3f6075b31af tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:18.417953 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-01ebc419-0493-418a-9bc1-a3f6075b31af tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:18.429620 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1a0f89a9-4cb8-47d0-8c0f-12b2dfee7795 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318416fa33b40ae98c8c35675b0c101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f44e4274f41c1882cf1a2167dc891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:18.450149 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1a0f89a9-4cb8-47d0-8c0f-12b2dfee7795 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "GET /compute/v2.1/servers/43e1acba-4c0e-4f89-8d03-e9dcb388c1ef" status: 200 len: 1324 microversion: 2.1 time: 0.401307 Sep 10 11:54:18.450958 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1671/3403] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:18 2022] GET /compute/v2.1/servers/43e1acba-4c0e-4f89-8d03-e9dcb388c1ef => generated 1324 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:18.522375 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-8b692afd-b23f-47e7-92dc-a1dbcc91eba8 req-9957ca65-50a0-480c-b9b2-3936405d9d0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be5d3b39-cea6-47fa-adeb-d79a92a2076a", "name": "network-vif-plugged", "status": "completed", "tag": "8e02d220-253c-4ad6-8b9e-e09ad96099e3"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:54:18.541468 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-8b692afd-b23f-47e7-92dc-a1dbcc91eba8 req-9957ca65-50a0-480c-b9b2-3936405d9d0c service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:18.542139 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-8b692afd-b23f-47e7-92dc-a1dbcc91eba8 req-9957ca65-50a0-480c-b9b2-3936405d9d0c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:18.542793 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-8b692afd-b23f-47e7-92dc-a1dbcc91eba8 req-9957ca65-50a0-480c-b9b2-3936405d9d0c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:18.573655 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-8b692afd-b23f-47e7-92dc-a1dbcc91eba8 req-9957ca65-50a0-480c-b9b2-3936405d9d0c service nova] Creating event network-vif-plugged:8e02d220-253c-4ad6-8b9e-e09ad96099e3 for instance be5d3b39-cea6-47fa-adeb-d79a92a2076a on n-h1-856895-1 Sep 10 11:54:18.587513 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-8b692afd-b23f-47e7-92dc-a1dbcc91eba8 req-9957ca65-50a0-480c-b9b2-3936405d9d0c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066520 Sep 10 11:54:18.588301 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1672/3404] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:54:18.966384 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-01ebc419-0493-418a-9bc1-a3f6075b31af tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:18.979438 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-01ebc419-0493-418a-9bc1-a3f6075b31af tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a" status: 200 len: 1488 microversion: 2.1 time: 0.580929 Sep 10 11:54:18.991497 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1733/3405] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:18 2022] GET /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a => generated 1488 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:18.995583 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2efa3d47-c1a0-49ea-8b55-f7509d2df8c9 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:18.996405 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2efa3d47-c1a0-49ea-8b55-f7509d2df8c9 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] [instance: d40c7388-4376-47ca-98e3-27db94e48009] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:19.006551 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c0986436-02fd-47af-b2a9-419eb6b728ca tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:19.006551 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c0986436-02fd-47af-b2a9-419eb6b728ca tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: be5d3b39-cea6-47fa-adeb-d79a92a2076a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:19.008865 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2efa3d47-c1a0-49ea-8b55-f7509d2df8c9 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:19.010449 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2efa3d47-c1a0-49ea-8b55-f7509d2df8c9 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:19.011027 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2efa3d47-c1a0-49ea-8b55-f7509d2df8c9 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:19.013936 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2efa3d47-c1a0-49ea-8b55-f7509d2df8c9 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:19.015793 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2efa3d47-c1a0-49ea-8b55-f7509d2df8c9 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:19.020441 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2efa3d47-c1a0-49ea-8b55-f7509d2df8c9 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:19.040570 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c0986436-02fd-47af-b2a9-419eb6b728ca tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:19.041721 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c0986436-02fd-47af-b2a9-419eb6b728ca tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:19.043510 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c0986436-02fd-47af-b2a9-419eb6b728ca tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:19.044632 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c0986436-02fd-47af-b2a9-419eb6b728ca tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:19.047415 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c0986436-02fd-47af-b2a9-419eb6b728ca tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:19.048093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c0986436-02fd-47af-b2a9-419eb6b728ca tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:19.103939 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c0986436-02fd-47af-b2a9-419eb6b728ca tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: be5d3b39-cea6-47fa-adeb-d79a92a2076a] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:54:19.168129 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:54:19.281766 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c0986436-02fd-47af-b2a9-419eb6b728ca tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "DELETE /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a" status: 204 len: 0 microversion: 2.1 time: 0.280001 Sep 10 11:54:19.282944 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1734/3406] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:54:19 2022] DELETE /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:54:19.298298 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-73d8c8dc-a559-492a-b65f-53ea0513a3a1 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f4072631d30>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:19.326839 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-73d8c8dc-a559-492a-b65f-53ea0513a3a1 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] HTTP exception thrown: Image not found. Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-73d8c8dc-a559-492a-b65f-53ea0513a3a1 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Request method failure captured: Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/images/8eebc8ff-332d-41a0-878f-833613913538 HTTP/1.1 Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHn4qx7-RJW530OcZP-HbaGtHMvLFpM5FagIMU2VdWF84c499i9YfjZquQEUjoDx9LuzhR3BDEoUkdspCmBol1ak1On1wm7uogZWHDZsvVl6TsHMKnzPFOC81lsU-lVJhYePyv1AjhxbbjqxuBJCGxjFxEftt4cUayosCmqZZn3TePc Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 57eb6c59b1a7467baf0daae9019ca5aa Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ImagesTestJSON-915014488 Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/57eb6c59b1a7467baf0daae9019ca5aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/57eb6c59b1a7467baf0daae9019ca5aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_57eb6c59b1a7467baf0daae9019ca5aa", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/57eb6c59b1a7467baf0daae9019ca5aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ImagesTestJSON-915014488 Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 57eb6c59b1a7467baf0daae9019ca5aa Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ImagesTestJSON-915014488 Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ImagesTestJSON-915014488-project Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 1ead4e0fd51b484c8dd38da5a3975788 Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ImagesTestJSON-915014488-project Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: exception: Image not found. Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '8eebc8ff-332d-41a0-878f-833613913538'} Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8eebc8ff-332d-41a0-878f-833613913538 to delete Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8eebc8ff-332d-41a0-878f-833613913538 could not be found. Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:19.330032 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:19.336018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:19.336018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:19.336018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:54:19.336018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:54:19.336018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:54:19.336018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:54:19.336018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:54:19.336018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:54:19.336018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 10 11:54:19.336018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 11:54:19.336018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 11:54:19.336018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:19.336018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:19.336018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:19.336018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:19.336018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:19.336018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:19.336018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:54:19.336018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:54:19.336018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 11:54:19.336018 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:19.339788 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-73d8c8dc-a559-492a-b65f-53ea0513a3a1 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Returning 404 to user: Image not found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:54:19.340833 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-73d8c8dc-a559-492a-b65f-53ea0513a3a1 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "DELETE /compute/v2.1/images/8eebc8ff-332d-41a0-878f-833613913538" status: 404 len: 62 microversion: 2.1 time: 0.048353 Sep 10 11:54:19.343047 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1735/3407] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:19 2022] DELETE /compute/v2.1/images/8eebc8ff-332d-41a0-878f-833613913538 => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:54:19.355299 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e516ce1f-15e7-4f90-b66c-4a5191c0d9e2 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:19.367078 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e516ce1f-15e7-4f90-b66c-4a5191c0d9e2 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: be5d3b39-cea6-47fa-adeb-d79a92a2076a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:19.388232 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e516ce1f-15e7-4f90-b66c-4a5191c0d9e2 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:19.396003 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e516ce1f-15e7-4f90-b66c-4a5191c0d9e2 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:19.396865 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e516ce1f-15e7-4f90-b66c-4a5191c0d9e2 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:19.397806 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e516ce1f-15e7-4f90-b66c-4a5191c0d9e2 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:19.398461 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e516ce1f-15e7-4f90-b66c-4a5191c0d9e2 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:19.399086 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e516ce1f-15e7-4f90-b66c-4a5191c0d9e2 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:19.455210 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e516ce1f-15e7-4f90-b66c-4a5191c0d9e2 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: be5d3b39-cea6-47fa-adeb-d79a92a2076a] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:54:19.531253 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:54:19.581428 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.compute.api [None req-e516ce1f-15e7-4f90-b66c-4a5191c0d9e2 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: be5d3b39-cea6-47fa-adeb-d79a92a2076a] Instance is already in deleting state, ignoring this request Sep 10 11:54:19.582297 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e516ce1f-15e7-4f90-b66c-4a5191c0d9e2 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "DELETE /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a" status: 204 len: 0 microversion: 2.1 time: 0.234530 Sep 10 11:54:19.583204 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1736/3408] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:54:19 2022] DELETE /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 11:54:19.601767 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0acbd132-2383-4f93-bca1-f7811c198d79 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:19.604630 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0acbd132-2383-4f93-bca1-f7811c198d79 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:19.609790 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=8 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:54:19.621468 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0acbd132-2383-4f93-bca1-f7811c198d79 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:19.622195 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0acbd132-2383-4f93-bca1-f7811c198d79 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:19.626828 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0acbd132-2383-4f93-bca1-f7811c198d79 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:19.628011 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0acbd132-2383-4f93-bca1-f7811c198d79 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:19.629534 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0acbd132-2383-4f93-bca1-f7811c198d79 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:19.630170 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0acbd132-2383-4f93-bca1-f7811c198d79 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:19.666302 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2efa3d47-c1a0-49ea-8b55-f7509d2df8c9 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85362ff7bd6245d79b31a3937e14c095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a827355dfbcf40ec8d2e3e75d453e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:19.689683 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2efa3d47-c1a0-49ea-8b55-f7509d2df8c9 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c7388-4376-47ca-98e3-27db94e48009" status: 200 len: 1519 microversion: 2.1 time: 0.697592 Sep 10 11:54:19.702708 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1673/3409] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:18 2022] GET /compute/v2.1/servers/d40c7388-4376-47ca-98e3-27db94e48009 => generated 1519 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:54:19.728849 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-da532b4a-3061-4d22-bbfa-1d3b9ebec957 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:19.730966 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-da532b4a-3061-4d22-bbfa-1d3b9ebec957 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 43e1acba-4c0e-4f89-8d03-e9dcb388c1ef] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:19.762366 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da532b4a-3061-4d22-bbfa-1d3b9ebec957 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:19.763401 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da532b4a-3061-4d22-bbfa-1d3b9ebec957 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:19.765073 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da532b4a-3061-4d22-bbfa-1d3b9ebec957 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:19.773292 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da532b4a-3061-4d22-bbfa-1d3b9ebec957 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:19.775317 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da532b4a-3061-4d22-bbfa-1d3b9ebec957 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:19.777769 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da532b4a-3061-4d22-bbfa-1d3b9ebec957 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:20.041218 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0acbd132-2383-4f93-bca1-f7811c198d79 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:20.051688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0acbd132-2383-4f93-bca1-f7811c198d79 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:20.058034 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0acbd132-2383-4f93-bca1-f7811c198d79 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:20.062472 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0acbd132-2383-4f93-bca1-f7811c198d79 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1808 microversion: 2.20 time: 0.474862 Sep 10 11:54:20.102629 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1737/3410] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:54:19 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1808 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:54:20.108155 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-19d4109f-caf7-4a86-91cb-138db4343d10 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:20.109053 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-19d4109f-caf7-4a86-91cb-138db4343d10 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: be5d3b39-cea6-47fa-adeb-d79a92a2076a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:20.119547 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-19d4109f-caf7-4a86-91cb-138db4343d10 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:20.128446 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-19d4109f-caf7-4a86-91cb-138db4343d10 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:20.131810 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-19d4109f-caf7-4a86-91cb-138db4343d10 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:20.132786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-19d4109f-caf7-4a86-91cb-138db4343d10 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:20.133444 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-19d4109f-caf7-4a86-91cb-138db4343d10 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:20.134889 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-19d4109f-caf7-4a86-91cb-138db4343d10 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:21.026057 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-da532b4a-3061-4d22-bbfa-1d3b9ebec957 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318416fa33b40ae98c8c35675b0c101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f44e4274f41c1882cf1a2167dc891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:21.036208 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-da532b4a-3061-4d22-bbfa-1d3b9ebec957 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "GET /compute/v2.1/servers/43e1acba-4c0e-4f89-8d03-e9dcb388c1ef" status: 200 len: 1324 microversion: 2.1 time: 1.332159 Sep 10 11:54:21.037725 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1674/3411] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:19 2022] GET /compute/v2.1/servers/43e1acba-4c0e-4f89-8d03-e9dcb388c1ef => generated 1324 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:21.047099 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-39086a24-76a0-4bc9-9068-7dbcee4e4670 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1804309219", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "83f91881-6a4e-4a53-a5e6-d9364026251d"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-39086a24-76a0-4bc9-9068-7dbcee4e4670 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Request method failure captured: Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 243 Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHrTpCo0yXxonVtTfuEo7q9d9JaTJLEMxSBhM3CRSuRRHE_U0i67aI-5w6q9iQxAwMf923lxdCJSmSDRo3TAKA4iRJ7iW7gNDHAlt82zx7Id93XrAUX6yAnTz93gkjDvuCs_VRxwLJw7qrSwynQniHZQl5CS4GaJInaGELG8WEfpnRQ Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: a827355dfbcf40ec8d2e3e75d453e6bb Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-521406430 Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a827355dfbcf40ec8d2e3e75d453e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a827355dfbcf40ec8d2e3e75d453e6bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a827355dfbcf40ec8d2e3e75d453e6bb", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a827355dfbcf40ec8d2e3e75d453e6bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-521406430 Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: a827355dfbcf40ec8d2e3e75d453e6bb Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-521406430 Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServerMetadataNegativeTestJSON-521406430-project Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 85362ff7bd6245d79b31a3937e14c095 Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-521406430-project Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1804309219", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "83f91881-6a4e-4a53-a5e6-d9364026251d"}]}} Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1804309219', 'imageRef': 'c23d4d62-7ab9-4623-9273-7f44582aa2e1', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '83f91881-6a4e-4a53-a5e6-d9364026251d'}]}}} Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise error Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi {'': 'data1'} Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:54:21.054706 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:54:21.062814 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:54:21.062814 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 11:54:21.062814 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 11:54:21.062814 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 11:54:21.062814 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 11:54:21.062814 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 11:54:21.062814 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 11:54:21.062814 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 11:54:21.062814 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:21.062814 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:21.062814 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:21.062814 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:21.062814 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:21.062814 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:21.062814 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 11:54:21.062814 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 11:54:21.062814 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 11:54:21.062814 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:21.067253 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-39086a24-76a0-4bc9-9068-7dbcee4e4670 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:54:21.068417 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-39086a24-76a0-4bc9-9068-7dbcee4e4670 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.029452 Sep 10 11:54:21.069627 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1675/3412] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:54:21 2022] POST /compute/v2.1/servers => generated 175 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:54:21.080194 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-370f3291-59f1-4b42-bd67-de249f0c5589 req-5a6c24dc-128e-4edb-a5bf-d701dad1de6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be5d3b39-cea6-47fa-adeb-d79a92a2076a", "name": "network-vif-unplugged", "status": "completed", "tag": "8e02d220-253c-4ad6-8b9e-e09ad96099e3"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:54:21.093685 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-370f3291-59f1-4b42-bd67-de249f0c5589 req-5a6c24dc-128e-4edb-a5bf-d701dad1de6f service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:21.094567 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-370f3291-59f1-4b42-bd67-de249f0c5589 req-5a6c24dc-128e-4edb-a5bf-d701dad1de6f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:21.095350 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-370f3291-59f1-4b42-bd67-de249f0c5589 req-5a6c24dc-128e-4edb-a5bf-d701dad1de6f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:21.123599 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-370f3291-59f1-4b42-bd67-de249f0c5589 req-5a6c24dc-128e-4edb-a5bf-d701dad1de6f service nova] Creating event network-vif-unplugged:8e02d220-253c-4ad6-8b9e-e09ad96099e3 for instance be5d3b39-cea6-47fa-adeb-d79a92a2076a on n-h1-856895-1 Sep 10 11:54:21.150583 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-370f3291-59f1-4b42-bd67-de249f0c5589 req-5a6c24dc-128e-4edb-a5bf-d701dad1de6f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075875 Sep 10 11:54:21.153988 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1676/3413] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:54:21.167268 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-422b764e-27d6-4aa0-976f-de982a6c9cbb tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:21.168866 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-422b764e-27d6-4aa0-976f-de982a6c9cbb tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] [instance: 8d9bb244-205c-4c4a-b45b-94f8fd95f23e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:21.178683 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-422b764e-27d6-4aa0-976f-de982a6c9cbb tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] HTTP exception thrown: Instance 8d9bb244-205c-4c4a-b45b-94f8fd95f23e could not be found. Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-422b764e-27d6-4aa0-976f-de982a6c9cbb tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Request method failure captured: Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/8d9bb244-205c-4c4a-b45b-94f8fd95f23e/metadata HTTP/1.1 Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHrTpCo0yXxonVtTfuEo7q9d9JaTJLEMxSBhM3CRSuRRHE_U0i67aI-5w6q9iQxAwMf923lxdCJSmSDRo3TAKA4iRJ7iW7gNDHAlt82zx7Id93XrAUX6yAnTz93gkjDvuCs_VRxwLJw7qrSwynQniHZQl5CS4GaJInaGELG8WEfpnRQ Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: a827355dfbcf40ec8d2e3e75d453e6bb Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-521406430 Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a827355dfbcf40ec8d2e3e75d453e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a827355dfbcf40ec8d2e3e75d453e6bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a827355dfbcf40ec8d2e3e75d453e6bb", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a827355dfbcf40ec8d2e3e75d453e6bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-521406430 Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: a827355dfbcf40ec8d2e3e75d453e6bb Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-521406430 Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServerMetadataNegativeTestJSON-521406430-project Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 85362ff7bd6245d79b31a3937e14c095 Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-521406430-project Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 8d9bb244-205c-4c4a-b45b-94f8fd95f23e could not be found. Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'server_id': '8d9bb244-205c-4c4a-b45b-94f8fd95f23e'} Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d9bb244-205c-4c4a-b45b-94f8fd95f23e could not be found. Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d9bb244-205c-4c4a-b45b-94f8fd95f23e could not be found. Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:21.188323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:21.205326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:54:21.205326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:54:21.205326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d9bb244-205c-4c4a-b45b-94f8fd95f23e could not be found. Sep 10 11:54:21.205326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:21.207223 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-422b764e-27d6-4aa0-976f-de982a6c9cbb tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Returning 404 to user: Instance 8d9bb244-205c-4c4a-b45b-94f8fd95f23e could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:54:21.209946 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-422b764e-27d6-4aa0-976f-de982a6c9cbb tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] 10.222.0.23 "GET /compute/v2.1/servers/8d9bb244-205c-4c4a-b45b-94f8fd95f23e/metadata" status: 404 len: 111 microversion: 2.1 time: 0.050725 Sep 10 11:54:21.220982 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1677/3414] 10.222.0.23 () {58 vars in 1263 bytes} [Sat Sep 10 11:54:21 2022] GET /compute/v2.1/servers/8d9bb244-205c-4c4a-b45b-94f8fd95f23e/metadata => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:54:21.231136 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f1c63ba5-5797-4189-9330-4c518add3318 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:21.242668 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f1c63ba5-5797-4189-9330-4c518add3318 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:21.268438 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1c63ba5-5797-4189-9330-4c518add3318 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:21.270894 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1c63ba5-5797-4189-9330-4c518add3318 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:21.275855 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1c63ba5-5797-4189-9330-4c518add3318 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:21.277090 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1c63ba5-5797-4189-9330-4c518add3318 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:21.278477 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1c63ba5-5797-4189-9330-4c518add3318 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:21.283381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1c63ba5-5797-4189-9330-4c518add3318 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:21.289440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-19d4109f-caf7-4a86-91cb-138db4343d10 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:21.307782 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-19d4109f-caf7-4a86-91cb-138db4343d10 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a" status: 200 len: 1494 microversion: 2.1 time: 1.203895 Sep 10 11:54:21.317374 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1738/3415] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:20 2022] GET /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a => generated 1494 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:21.606979 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-78d3979c-4ab4-4582-a35a-1aabb541f25e tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-721274608", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "83f91881-6a4e-4a53-a5e6-d9364026251d"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-78d3979c-4ab4-4582-a35a-1aabb541f25e tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Request method failure captured: Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 498 Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHrTpCo0yXxonVtTfuEo7q9d9JaTJLEMxSBhM3CRSuRRHE_U0i67aI-5w6q9iQxAwMf923lxdCJSmSDRo3TAKA4iRJ7iW7gNDHAlt82zx7Id93XrAUX6yAnTz93gkjDvuCs_VRxwLJw7qrSwynQniHZQl5CS4GaJInaGELG8WEfpnRQ Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: a827355dfbcf40ec8d2e3e75d453e6bb Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-521406430 Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a827355dfbcf40ec8d2e3e75d453e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a827355dfbcf40ec8d2e3e75d453e6bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a827355dfbcf40ec8d2e3e75d453e6bb", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a827355dfbcf40ec8d2e3e75d453e6bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-521406430 Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: a827355dfbcf40ec8d2e3e75d453e6bb Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-521406430 Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServerMetadataNegativeTestJSON-521406430-project Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 85362ff7bd6245d79b31a3937e14c095 Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-521406430-project Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-721274608", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "83f91881-6a4e-4a53-a5e6-d9364026251d"}]}} Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-721274608', 'imageRef': 'c23d4d62-7ab9-4623-9273-7f44582aa2e1', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '83f91881-6a4e-4a53-a5e6-d9364026251d'}]}}} Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise error Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 10 11:54:21.634287 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 10 11:54:21.639330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 10 11:54:21.639330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:21.639330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 11:54:21.639330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 10 11:54:21.639330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:21.639330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:21.639330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:21.639330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:21.639330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:21.639330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:21.639330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:54:21.639330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:54:21.639330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:54:21.639330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:54:21.639330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:54:21.639330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:54:21.639330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 11:54:21.639330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 11:54:21.639330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 11:54:21.639330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 11:54:21.639330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 11:54:21.639330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 11:54:21.639330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 11:54:21.639330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:21.639330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:21.639330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:21.639330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:21.639330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:21.639330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:21.639330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 11:54:21.639330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 11:54:21.639330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 11:54:21.639330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:21.648830 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-78d3979c-4ab4-4582-a35a-1aabb541f25e tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:54:21.654385 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-78d3979c-4ab4-4582-a35a-1aabb541f25e tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.074905 Sep 10 11:54:21.657836 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1739/3416] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:54:21 2022] POST /compute/v2.1/servers => generated 687 bytes in 80 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 10 11:54:22.077840 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4a649ec4-71a3-46bb-babb-a3d17ffd73f2 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:22.077840 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4a649ec4-71a3-46bb-babb-a3d17ffd73f2 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 43e1acba-4c0e-4f89-8d03-e9dcb388c1ef] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:22.101329 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a649ec4-71a3-46bb-babb-a3d17ffd73f2 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:22.101988 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a649ec4-71a3-46bb-babb-a3d17ffd73f2 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:22.102616 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a649ec4-71a3-46bb-babb-a3d17ffd73f2 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:22.110740 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a649ec4-71a3-46bb-babb-a3d17ffd73f2 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:22.112931 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a649ec4-71a3-46bb-babb-a3d17ffd73f2 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:22.136372 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a649ec4-71a3-46bb-babb-a3d17ffd73f2 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:23.073326 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4a649ec4-71a3-46bb-babb-a3d17ffd73f2 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318416fa33b40ae98c8c35675b0c101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f44e4274f41c1882cf1a2167dc891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:23.096622 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4a649ec4-71a3-46bb-babb-a3d17ffd73f2 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "GET /compute/v2.1/servers/43e1acba-4c0e-4f89-8d03-e9dcb388c1ef" status: 200 len: 1324 microversion: 2.1 time: 1.036401 Sep 10 11:54:23.103061 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1740/3417] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:22 2022] GET /compute/v2.1/servers/43e1acba-4c0e-4f89-8d03-e9dcb388c1ef => generated 1324 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:23.111040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3a54e554-3222-4c38-a969-e795331261db tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1828905484", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "83f91881-6a4e-4a53-a5e6-d9364026251d"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3a54e554-3222-4c38-a969-e795331261db tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Request method failure captured: Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 500 Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHrTpCo0yXxonVtTfuEo7q9d9JaTJLEMxSBhM3CRSuRRHE_U0i67aI-5w6q9iQxAwMf923lxdCJSmSDRo3TAKA4iRJ7iW7gNDHAlt82zx7Id93XrAUX6yAnTz93gkjDvuCs_VRxwLJw7qrSwynQniHZQl5CS4GaJInaGELG8WEfpnRQ Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: a827355dfbcf40ec8d2e3e75d453e6bb Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-521406430 Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a827355dfbcf40ec8d2e3e75d453e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a827355dfbcf40ec8d2e3e75d453e6bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a827355dfbcf40ec8d2e3e75d453e6bb", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a827355dfbcf40ec8d2e3e75d453e6bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-521406430 Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: a827355dfbcf40ec8d2e3e75d453e6bb Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-521406430 Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServerMetadataNegativeTestJSON-521406430-project Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 85362ff7bd6245d79b31a3937e14c095 Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-521406430-project Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1828905484", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "83f91881-6a4e-4a53-a5e6-d9364026251d"}]}} Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1828905484', 'imageRef': 'c23d4d62-7ab9-4623-9273-7f44582aa2e1', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '83f91881-6a4e-4a53-a5e6-d9364026251d'}]}}} Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise error Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 10 11:54:23.129857 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 10 11:54:23.133665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 10 11:54:23.133665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:23.133665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 11:54:23.133665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 10 11:54:23.133665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:23.133665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:23.133665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:23.133665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:23.133665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:23.133665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:23.133665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:54:23.133665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:54:23.133665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:54:23.133665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:54:23.133665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:54:23.133665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:54:23.133665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 11:54:23.133665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 11:54:23.133665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 11:54:23.133665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 11:54:23.133665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 11:54:23.133665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 11:54:23.133665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 11:54:23.133665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:23.133665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:23.133665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:23.133665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:23.133665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:23.133665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:23.133665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 11:54:23.133665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 11:54:23.133665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 11:54:23.133665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:23.133665 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3a54e554-3222-4c38-a969-e795331261db tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:54:23.133665 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3a54e554-3222-4c38-a969-e795331261db tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.024436 Sep 10 11:54:23.153949 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1741/3418] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:54:23 2022] POST /compute/v2.1/servers => generated 689 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:54:23.156919 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f1c63ba5-5797-4189-9330-4c518add3318 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:23.176390 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f1c63ba5-5797-4189-9330-4c518add3318 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:23.180104 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a5d35aa9-3d66-41ac-97e0-d605b8d9a727 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:23.180829 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a5d35aa9-3d66-41ac-97e0-d605b8d9a727 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: be5d3b39-cea6-47fa-adeb-d79a92a2076a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:23.181163 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f1c63ba5-5797-4189-9330-4c518add3318 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:23.184451 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f1c63ba5-5797-4189-9330-4c518add3318 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1808 microversion: 2.20 time: 1.961815 Sep 10 11:54:23.187028 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1678/3419] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:54:21 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1808 bytes in 1965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:54:23.242562 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5d35aa9-3d66-41ac-97e0-d605b8d9a727 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:23.245272 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5d35aa9-3d66-41ac-97e0-d605b8d9a727 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:23.248515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5d35aa9-3d66-41ac-97e0-d605b8d9a727 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:23.252519 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5d35aa9-3d66-41ac-97e0-d605b8d9a727 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:23.253432 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5d35aa9-3d66-41ac-97e0-d605b8d9a727 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:23.254943 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5d35aa9-3d66-41ac-97e0-d605b8d9a727 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:23.422132 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-30b9fc31-db5e-4141-a429-594bedb62012 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1478394387", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "83f91881-6a4e-4a53-a5e6-d9364026251d"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:54:23.430403 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-30b9fc31-db5e-4141-a429-594bedb62012 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Request method failure captured: Sep 10 11:54:23.430403 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 11:54:23.430403 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:54:23.430403 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:54:23.430403 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:54:23.430403 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 754 Sep 10 11:54:23.430403 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:54:23.430403 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:54:23.430403 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:54:23.430403 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:54:23.430403 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHrTpCo0yXxonVtTfuEo7q9d9JaTJLEMxSBhM3CRSuRRHE_U0i67aI-5w6q9iQxAwMf923lxdCJSmSDRo3TAKA4iRJ7iW7gNDHAlt82zx7Id93XrAUX6yAnTz93gkjDvuCs_VRxwLJw7qrSwynQniHZQl5CS4GaJInaGELG8WEfpnRQ Sep 10 11:54:23.430403 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:54:23.430403 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:54:23.430403 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:54:23.430403 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:54:23.430403 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:54:23.430403 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:54:23.430403 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: a827355dfbcf40ec8d2e3e75d453e6bb Sep 10 11:54:23.430403 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-521406430 Sep 10 11:54:23.430403 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:54:23.430403 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:54:23.430403 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a827355dfbcf40ec8d2e3e75d453e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a827355dfbcf40ec8d2e3e75d453e6bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a827355dfbcf40ec8d2e3e75d453e6bb", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a827355dfbcf40ec8d2e3e75d453e6bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:54:23.430403 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-521406430 Sep 10 11:54:23.430403 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: a827355dfbcf40ec8d2e3e75d453e6bb Sep 10 11:54:23.430403 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-521406430 Sep 10 11:54:23.430403 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServerMetadataNegativeTestJSON-521406430-project Sep 10 11:54:23.430403 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:54:23.430403 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:54:23.430403 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 85362ff7bd6245d79b31a3937e14c095 Sep 10 11:54:23.430403 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-521406430-project Sep 10 11:54:23.430403 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 11:54:23.430403 n-d-856895-1 devstack@n-api.service[128776]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1478394387", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "83f91881-6a4e-4a53-a5e6-d9364026251d"}]}} Sep 10 11:54:23.430403 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:54:23.430403 n-d-856895-1 devstack@n-api.service[128776]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 11:54:23.430403 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1478394387', 'imageRef': 'c23d4d62-7ab9-4623-9273-7f44582aa2e1', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '83f91881-6a4e-4a53-a5e6-d9364026251d'}]}}} Sep 10 11:54:23.430403 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:54:23.430403 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:23.430403 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 11:54:23.430403 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 11:54:23.430403 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 11:54:23.434193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise error Sep 10 11:54:23.434193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 11:54:23.434193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:23.434193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 10 11:54:23.434193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 10 11:54:23.434193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 10 11:54:23.434193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 10 11:54:23.434193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 10 11:54:23.434193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:23.434193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 11:54:23.434193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 10 11:54:23.434193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:23.434193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:23.434193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:23.434193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:23.434193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:23.434193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:23.434193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:54:23.434193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:54:23.434193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:54:23.434193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:54:23.434193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:54:23.434193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:54:23.434193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 11:54:23.434193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 11:54:23.434193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 11:54:23.434193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 11:54:23.434193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 11:54:23.434193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 11:54:23.434193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 11:54:23.434193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:23.434193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:23.434193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:23.434193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:23.434193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:23.434193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:23.434193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 11:54:23.434193 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 11:54:23.439935 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 11:54:23.439935 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:23.442496 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-30b9fc31-db5e-4141-a429-594bedb62012 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:54:23.443877 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-30b9fc31-db5e-4141-a429-594bedb62012 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.026722 Sep 10 11:54:23.458496 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1679/3420] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:54:23 2022] POST /compute/v2.1/servers => generated 1197 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Sep 10 11:54:23.554259 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-aa9b900f-3199-45ac-bd72-b293783f0b1f tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-47750149", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "83f91881-6a4e-4a53-a5e6-d9364026251d"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:54:23.569232 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-aa9b900f-3199-45ac-bd72-b293783f0b1f tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Request method failure captured: Sep 10 11:54:23.569232 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 11:54:23.569232 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:54:23.569232 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:54:23.569232 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:54:23.569232 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 1264 Sep 10 11:54:23.569232 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:54:23.569232 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:54:23.569232 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:54:23.569232 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:54:23.569232 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHrTpCo0yXxonVtTfuEo7q9d9JaTJLEMxSBhM3CRSuRRHE_U0i67aI-5w6q9iQxAwMf923lxdCJSmSDRo3TAKA4iRJ7iW7gNDHAlt82zx7Id93XrAUX6yAnTz93gkjDvuCs_VRxwLJw7qrSwynQniHZQl5CS4GaJInaGELG8WEfpnRQ Sep 10 11:54:23.569232 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:54:23.569232 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:54:23.569232 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:54:23.569232 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:54:23.569232 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:54:23.569232 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:54:23.569232 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: a827355dfbcf40ec8d2e3e75d453e6bb Sep 10 11:54:23.569232 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-521406430 Sep 10 11:54:23.569232 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:54:23.569232 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:54:23.569232 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a827355dfbcf40ec8d2e3e75d453e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a827355dfbcf40ec8d2e3e75d453e6bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a827355dfbcf40ec8d2e3e75d453e6bb", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a827355dfbcf40ec8d2e3e75d453e6bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:54:23.569232 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-521406430 Sep 10 11:54:23.569232 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: a827355dfbcf40ec8d2e3e75d453e6bb Sep 10 11:54:23.569232 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-521406430 Sep 10 11:54:23.569232 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServerMetadataNegativeTestJSON-521406430-project Sep 10 11:54:23.569232 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:54:23.569232 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:54:23.569232 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 85362ff7bd6245d79b31a3937e14c095 Sep 10 11:54:23.569232 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-521406430-project Sep 10 11:54:23.569232 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 11:54:23.569232 n-d-856895-1 devstack@n-api.service[128776]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-47750149", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "83f91881-6a4e-4a53-a5e6-d9364026251d"}]}} Sep 10 11:54:23.569232 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:54:23.572437 n-d-856895-1 devstack@n-api.service[128776]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 11:54:23.572437 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-47750149', 'imageRef': 'c23d4d62-7ab9-4623-9273-7f44582aa2e1', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '83f91881-6a4e-4a53-a5e6-d9364026251d'}]}}} Sep 10 11:54:23.572437 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:54:23.572437 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:23.572437 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 11:54:23.572437 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 11:54:23.572437 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 11:54:23.572437 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise error Sep 10 11:54:23.572437 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 11:54:23.572437 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:23.572437 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 10 11:54:23.572437 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 10 11:54:23.572437 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 10 11:54:23.572437 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 10 11:54:23.572437 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 10 11:54:23.572437 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:23.572437 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 11:54:23.573910 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 10 11:54:23.573910 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:23.573910 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:23.573910 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:23.573910 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:23.573910 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:23.573910 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:23.573910 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:54:23.573910 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:54:23.573910 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:54:23.573910 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:54:23.573910 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:54:23.573910 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:54:23.573910 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 11:54:23.573910 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 11:54:23.573910 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 11:54:23.573910 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 11:54:23.573910 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 11:54:23.573910 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 11:54:23.573910 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 11:54:23.573910 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:23.573910 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:23.573910 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:23.573910 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:23.573910 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:23.573910 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:23.573910 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 11:54:23.573910 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 11:54:23.577613 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 10 11:54:23.577613 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:23.577613 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-aa9b900f-3199-45ac-bd72-b293783f0b1f tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:54:23.582104 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-aa9b900f-3199-45ac-bd72-b293783f0b1f tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.034621 Sep 10 11:54:23.584903 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1680/3421] 10.222.0.23 () {60 vars in 1148 bytes} [Sat Sep 10 11:54:23 2022] POST /compute/v2.1/servers => generated 2221 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Sep 10 11:54:23.616742 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1b61b70a-b173-452c-9797-6dbf95583d45 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:23.619137 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1b61b70a-b173-452c-9797-6dbf95583d45 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] [instance: 06d9b864-3894-45d9-80ce-6d6cda371a1f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:23.635914 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-1b61b70a-b173-452c-9797-6dbf95583d45 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] HTTP exception thrown: Instance 06d9b864-3894-45d9-80ce-6d6cda371a1f could not be found. Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1b61b70a-b173-452c-9797-6dbf95583d45 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Request method failure captured: Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/06d9b864-3894-45d9-80ce-6d6cda371a1f/metadata/test2 HTTP/1.1 Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHrTpCo0yXxonVtTfuEo7q9d9JaTJLEMxSBhM3CRSuRRHE_U0i67aI-5w6q9iQxAwMf923lxdCJSmSDRo3TAKA4iRJ7iW7gNDHAlt82zx7Id93XrAUX6yAnTz93gkjDvuCs_VRxwLJw7qrSwynQniHZQl5CS4GaJInaGELG8WEfpnRQ Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: a827355dfbcf40ec8d2e3e75d453e6bb Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-521406430 Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a827355dfbcf40ec8d2e3e75d453e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a827355dfbcf40ec8d2e3e75d453e6bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a827355dfbcf40ec8d2e3e75d453e6bb", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a827355dfbcf40ec8d2e3e75d453e6bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-521406430 Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: a827355dfbcf40ec8d2e3e75d453e6bb Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-521406430 Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServerMetadataNegativeTestJSON-521406430-project Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 85362ff7bd6245d79b31a3937e14c095 Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-521406430-project Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 06d9b864-3894-45d9-80ce-6d6cda371a1f could not be found. Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'server_id': '06d9b864-3894-45d9-80ce-6d6cda371a1f', 'id': 'test2'} Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06d9b864-3894-45d9-80ce-6d6cda371a1f could not be found. Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06d9b864-3894-45d9-80ce-6d6cda371a1f could not be found. Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:23.642328 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:23.648690 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:54:23.648690 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:54:23.648690 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06d9b864-3894-45d9-80ce-6d6cda371a1f could not be found. Sep 10 11:54:23.648690 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:23.655406 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1b61b70a-b173-452c-9797-6dbf95583d45 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Returning 404 to user: Instance 06d9b864-3894-45d9-80ce-6d6cda371a1f could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:54:23.657735 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1b61b70a-b173-452c-9797-6dbf95583d45 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] 10.222.0.23 "GET /compute/v2.1/servers/06d9b864-3894-45d9-80ce-6d6cda371a1f/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.065444 Sep 10 11:54:23.660619 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1681/3422] 10.222.0.23 () {58 vars in 1281 bytes} [Sat Sep 10 11:54:23 2022] GET /compute/v2.1/servers/06d9b864-3894-45d9-80ce-6d6cda371a1f/metadata/test2 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:54:23.692646 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-06156da7-2202-4b27-9160-67e6fc0f70e0 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:23.693195 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-06156da7-2202-4b27-9160-67e6fc0f70e0 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] [instance: d40c7388-4376-47ca-98e3-27db94e48009] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:23.719910 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-06156da7-2202-4b27-9160-67e6fc0f70e0 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:23.723080 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-06156da7-2202-4b27-9160-67e6fc0f70e0 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:23.723080 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-06156da7-2202-4b27-9160-67e6fc0f70e0 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:23.730033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-06156da7-2202-4b27-9160-67e6fc0f70e0 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:23.731039 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-06156da7-2202-4b27-9160-67e6fc0f70e0 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:23.731916 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-06156da7-2202-4b27-9160-67e6fc0f70e0 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:23.823270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-06156da7-2202-4b27-9160-67e6fc0f70e0 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] [instance: d40c7388-4376-47ca-98e3-27db94e48009] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:54:24.039297 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-06156da7-2202-4b27-9160-67e6fc0f70e0 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d40c7388-4376-47ca-98e3-27db94e48009" status: 204 len: 0 microversion: 2.1 time: 0.368473 Sep 10 11:54:24.040203 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1682/3423] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:54:23 2022] DELETE /compute/v2.1/servers/d40c7388-4376-47ca-98e3-27db94e48009 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:54:24.067628 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ca36e52a-f62c-4dc6-a391-a09ee97e8997 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:24.070532 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ca36e52a-f62c-4dc6-a391-a09ee97e8997 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] [instance: d40c7388-4376-47ca-98e3-27db94e48009] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:24.088000 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca36e52a-f62c-4dc6-a391-a09ee97e8997 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:24.091726 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca36e52a-f62c-4dc6-a391-a09ee97e8997 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:24.093642 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca36e52a-f62c-4dc6-a391-a09ee97e8997 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:24.094727 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca36e52a-f62c-4dc6-a391-a09ee97e8997 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:24.096376 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca36e52a-f62c-4dc6-a391-a09ee97e8997 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:24.100378 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca36e52a-f62c-4dc6-a391-a09ee97e8997 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:24.103640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a5d35aa9-3d66-41ac-97e0-d605b8d9a727 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ead4e0fd51b484c8dd38da5a3975788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eb6c59b1a7467baf0daae9019ca5aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:24.121412 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a5d35aa9-3d66-41ac-97e0-d605b8d9a727 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a" status: 200 len: 1494 microversion: 2.1 time: 0.959317 Sep 10 11:54:24.124073 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1742/3424] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:23 2022] GET /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a => generated 1494 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:24.149636 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:54:24.151417 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fae01687-98c7-411c-884a-de0b19967629 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:24.156619 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fae01687-98c7-411c-884a-de0b19967629 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 43e1acba-4c0e-4f89-8d03-e9dcb388c1ef] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:24.172676 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fae01687-98c7-411c-884a-de0b19967629 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:24.173174 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fae01687-98c7-411c-884a-de0b19967629 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:24.173621 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fae01687-98c7-411c-884a-de0b19967629 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:24.174334 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fae01687-98c7-411c-884a-de0b19967629 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:24.174794 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fae01687-98c7-411c-884a-de0b19967629 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:24.191581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fae01687-98c7-411c-884a-de0b19967629 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:24.877973 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ca36e52a-f62c-4dc6-a391-a09ee97e8997 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85362ff7bd6245d79b31a3937e14c095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a827355dfbcf40ec8d2e3e75d453e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:24.896790 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ca36e52a-f62c-4dc6-a391-a09ee97e8997 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c7388-4376-47ca-98e3-27db94e48009" status: 200 len: 1525 microversion: 2.1 time: 0.849014 Sep 10 11:54:24.898090 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1683/3425] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:24 2022] GET /compute/v2.1/servers/d40c7388-4376-47ca-98e3-27db94e48009 => generated 1525 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:24.922882 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f36a1dae-2783-43fc-b1a3-ec05c33425ab tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:24.923895 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f36a1dae-2783-43fc-b1a3-ec05c33425ab tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:24.931834 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f36a1dae-2783-43fc-b1a3-ec05c33425ab tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:24.932373 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f36a1dae-2783-43fc-b1a3-ec05c33425ab tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:24.932792 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f36a1dae-2783-43fc-b1a3-ec05c33425ab tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:24.933525 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f36a1dae-2783-43fc-b1a3-ec05c33425ab tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:24.933986 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f36a1dae-2783-43fc-b1a3-ec05c33425ab tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:24.934605 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f36a1dae-2783-43fc-b1a3-ec05c33425ab tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:25.526148 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fae01687-98c7-411c-884a-de0b19967629 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318416fa33b40ae98c8c35675b0c101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f44e4274f41c1882cf1a2167dc891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:25.556046 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fae01687-98c7-411c-884a-de0b19967629 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "GET /compute/v2.1/servers/43e1acba-4c0e-4f89-8d03-e9dcb388c1ef" status: 200 len: 1324 microversion: 2.1 time: 1.412347 Sep 10 11:54:25.556046 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1743/3426] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:24 2022] GET /compute/v2.1/servers/43e1acba-4c0e-4f89-8d03-e9dcb388c1ef => generated 1324 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:25.571354 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0a4f6767-a78c-4963-a7ac-bffd3ad74fc0 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1079605567", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "e5186474-7f56-4f58-9c7f-611895dcc512"}, {"uuid": "69b54fd3-3a38-4276-b7cd-273bac6e4400"}, {"uuid": "e5186474-7f56-4f58-9c7f-611895dcc512"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:54:25.730095 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-0a4f6767-a78c-4963-a7ac-bffd3ad74fc0 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] validate_networks() for [('e5186474-7f56-4f58-9c7f-611895dcc512', None, None, None, None, None), ('69b54fd3-3a38-4276-b7cd-273bac6e4400', None, None, None, None, None), ('e5186474-7f56-4f58-9c7f-611895dcc512', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:54:26.304100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f36a1dae-2783-43fc-b1a3-ec05c33425ab tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:26.327860 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f36a1dae-2783-43fc-b1a3-ec05c33425ab tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:26.330742 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f36a1dae-2783-43fc-b1a3-ec05c33425ab tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:26.333194 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f36a1dae-2783-43fc-b1a3-ec05c33425ab tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1808 microversion: 2.20 time: 1.433201 Sep 10 11:54:26.348109 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1684/3427] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:54:24 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1808 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:54:26.366281 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-64162ca2-8d84-4163-845d-a6b9e976d3ec req-01bd8f07-5bf2-4851-9b81-1b61c76028c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be5d3b39-cea6-47fa-adeb-d79a92a2076a", "name": "network-vif-deleted", "tag": "8e02d220-253c-4ad6-8b9e-e09ad96099e3"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:54:26.394879 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-64162ca2-8d84-4163-845d-a6b9e976d3ec req-01bd8f07-5bf2-4851-9b81-1b61c76028c7 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:26.400393 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-64162ca2-8d84-4163-845d-a6b9e976d3ec req-01bd8f07-5bf2-4851-9b81-1b61c76028c7 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:26.401168 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-64162ca2-8d84-4163-845d-a6b9e976d3ec req-01bd8f07-5bf2-4851-9b81-1b61c76028c7 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:26.426152 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-64162ca2-8d84-4163-845d-a6b9e976d3ec req-01bd8f07-5bf2-4851-9b81-1b61c76028c7 service nova] Creating event network-vif-deleted:8e02d220-253c-4ad6-8b9e-e09ad96099e3 for instance be5d3b39-cea6-47fa-adeb-d79a92a2076a on n-h1-856895-1 Sep 10 11:54:26.446997 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-64162ca2-8d84-4163-845d-a6b9e976d3ec req-01bd8f07-5bf2-4851-9b81-1b61c76028c7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096887 Sep 10 11:54:26.451259 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1685/3428] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:54:26.466043 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-da0fb38a-e10a-4e96-9c7d-b9063f3db3e0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:26.467330 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-da0fb38a-e10a-4e96-9c7d-b9063f3db3e0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: be5d3b39-cea6-47fa-adeb-d79a92a2076a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:26.495595 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da0fb38a-e10a-4e96-9c7d-b9063f3db3e0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:26.496125 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da0fb38a-e10a-4e96-9c7d-b9063f3db3e0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:26.500013 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da0fb38a-e10a-4e96-9c7d-b9063f3db3e0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:26.503022 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da0fb38a-e10a-4e96-9c7d-b9063f3db3e0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:26.503573 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da0fb38a-e10a-4e96-9c7d-b9063f3db3e0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:26.506216 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da0fb38a-e10a-4e96-9c7d-b9063f3db3e0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:26.582679 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-da0fb38a-e10a-4e96-9c7d-b9063f3db3e0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] HTTP exception thrown: Instance be5d3b39-cea6-47fa-adeb-d79a92a2076a could not be found. Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-da0fb38a-e10a-4e96-9c7d-b9063f3db3e0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Request method failure captured: Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a HTTP/1.1 Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHn4qx7-RJW530OcZP-HbaGtHMvLFpM5FagIMU2VdWF84c499i9YfjZquQEUjoDx9LuzhR3BDEoUkdspCmBol1ak1On1wm7uogZWHDZsvVl6TsHMKnzPFOC81lsU-lVJhYePyv1AjhxbbjqxuBJCGxjFxEftt4cUayosCmqZZn3TePc Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 57eb6c59b1a7467baf0daae9019ca5aa Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ImagesTestJSON-915014488 Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/57eb6c59b1a7467baf0daae9019ca5aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/57eb6c59b1a7467baf0daae9019ca5aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_57eb6c59b1a7467baf0daae9019ca5aa", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/57eb6c59b1a7467baf0daae9019ca5aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ImagesTestJSON-915014488 Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 57eb6c59b1a7467baf0daae9019ca5aa Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ImagesTestJSON-915014488 Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ImagesTestJSON-915014488-project Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 1ead4e0fd51b484c8dd38da5a3975788 Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ImagesTestJSON-915014488-project Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance be5d3b39-cea6-47fa-adeb-d79a92a2076a could not be found. Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'be5d3b39-cea6-47fa-adeb-d79a92a2076a'} Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be5d3b39-cea6-47fa-adeb-d79a92a2076a could not be found. Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be5d3b39-cea6-47fa-adeb-d79a92a2076a could not be found. Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:26.596349 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:26.603954 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:26.603954 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:26.603954 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:54:26.603954 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:54:26.603954 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be5d3b39-cea6-47fa-adeb-d79a92a2076a could not be found. Sep 10 11:54:26.603954 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:26.603954 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-da0fb38a-e10a-4e96-9c7d-b9063f3db3e0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Returning 404 to user: Instance be5d3b39-cea6-47fa-adeb-d79a92a2076a could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:54:26.603954 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-da0fb38a-e10a-4e96-9c7d-b9063f3db3e0 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a" status: 404 len: 111 microversion: 2.1 time: 0.145061 Sep 10 11:54:26.603954 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1686/3429] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:26 2022] GET /compute/v2.1/servers/be5d3b39-cea6-47fa-adeb-d79a92a2076a => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:54:26.630544 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5f29f379-0ee9-4ca7-aca1-010ee3562390 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:26.631213 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5f29f379-0ee9-4ca7-aca1-010ee3562390 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] [instance: d40c7388-4376-47ca-98e3-27db94e48009] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:26.658750 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5f29f379-0ee9-4ca7-aca1-010ee3562390 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:26.659557 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5f29f379-0ee9-4ca7-aca1-010ee3562390 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:26.660008 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5f29f379-0ee9-4ca7-aca1-010ee3562390 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:26.664042 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5f29f379-0ee9-4ca7-aca1-010ee3562390 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:26.664527 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5f29f379-0ee9-4ca7-aca1-010ee3562390 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:26.664968 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5f29f379-0ee9-4ca7-aca1-010ee3562390 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:28.642828 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5f29f379-0ee9-4ca7-aca1-010ee3562390 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85362ff7bd6245d79b31a3937e14c095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a827355dfbcf40ec8d2e3e75d453e6bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:28.663986 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5f29f379-0ee9-4ca7-aca1-010ee3562390 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c7388-4376-47ca-98e3-27db94e48009" status: 200 len: 1525 microversion: 2.1 time: 2.053345 Sep 10 11:54:28.665150 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1687/3430] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:26 2022] GET /compute/v2.1/servers/d40c7388-4376-47ca-98e3-27db94e48009 => generated 1525 bytes in 2062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:28.677639 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-92b8ecd8-f884-4f81-8d60-53a41c45ceae tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:28.681807 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-92b8ecd8-f884-4f81-8d60-53a41c45ceae tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 43e1acba-4c0e-4f89-8d03-e9dcb388c1ef] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:28.726628 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-92b8ecd8-f884-4f81-8d60-53a41c45ceae tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:28.727501 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-92b8ecd8-f884-4f81-8d60-53a41c45ceae tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:28.728112 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-92b8ecd8-f884-4f81-8d60-53a41c45ceae tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:28.729031 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-92b8ecd8-f884-4f81-8d60-53a41c45ceae tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:28.731466 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-92b8ecd8-f884-4f81-8d60-53a41c45ceae tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:28.734815 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-92b8ecd8-f884-4f81-8d60-53a41c45ceae tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:29.305551 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-92b8ecd8-f884-4f81-8d60-53a41c45ceae tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318416fa33b40ae98c8c35675b0c101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f44e4274f41c1882cf1a2167dc891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:29.320722 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-92b8ecd8-f884-4f81-8d60-53a41c45ceae tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "GET /compute/v2.1/servers/43e1acba-4c0e-4f89-8d03-e9dcb388c1ef" status: 200 len: 1324 microversion: 2.1 time: 0.651053 Sep 10 11:54:29.337754 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1688/3431] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:28 2022] GET /compute/v2.1/servers/43e1acba-4c0e-4f89-8d03-e9dcb388c1ef => generated 1324 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:29.350827 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-559600df-6802-4380-b928-de12c5bd9c5b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f40733bfa60>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:29.831261 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-559600df-6802-4380-b928-de12c5bd9c5b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] HTTP exception thrown: Image not found. Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-559600df-6802-4380-b928-de12c5bd9c5b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Request method failure captured: Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/images/4f0c3346-cd3b-4d5a-bcc9-4f0d2ff31c8b HTTP/1.1 Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHn4qx7-RJW530OcZP-HbaGtHMvLFpM5FagIMU2VdWF84c499i9YfjZquQEUjoDx9LuzhR3BDEoUkdspCmBol1ak1On1wm7uogZWHDZsvVl6TsHMKnzPFOC81lsU-lVJhYePyv1AjhxbbjqxuBJCGxjFxEftt4cUayosCmqZZn3TePc Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 57eb6c59b1a7467baf0daae9019ca5aa Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ImagesTestJSON-915014488 Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/57eb6c59b1a7467baf0daae9019ca5aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/57eb6c59b1a7467baf0daae9019ca5aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_57eb6c59b1a7467baf0daae9019ca5aa", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/57eb6c59b1a7467baf0daae9019ca5aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ImagesTestJSON-915014488 Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 57eb6c59b1a7467baf0daae9019ca5aa Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ImagesTestJSON-915014488 Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ImagesTestJSON-915014488-project Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 1ead4e0fd51b484c8dd38da5a3975788 Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ImagesTestJSON-915014488-project Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: exception: Image not found. Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '4f0c3346-cd3b-4d5a-bcc9-4f0d2ff31c8b'} Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4f0c3346-cd3b-4d5a-bcc9-4f0d2ff31c8b to delete Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4f0c3346-cd3b-4d5a-bcc9-4f0d2ff31c8b could not be found. Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:29.833806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:29.839120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:29.839120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:29.839120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:54:29.839120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:54:29.839120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:54:29.839120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:54:29.839120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:54:29.839120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:54:29.839120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 10 11:54:29.839120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 11:54:29.839120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 11:54:29.839120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:29.839120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:29.839120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:29.839120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:29.839120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:29.839120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:29.839120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:54:29.839120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:54:29.839120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 11:54:29.839120 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:29.840941 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-559600df-6802-4380-b928-de12c5bd9c5b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Returning 404 to user: Image not found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:54:29.843041 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-559600df-6802-4380-b928-de12c5bd9c5b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "DELETE /compute/v2.1/images/4f0c3346-cd3b-4d5a-bcc9-4f0d2ff31c8b" status: 404 len: 62 microversion: 2.1 time: 0.504095 Sep 10 11:54:29.844277 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1689/3432] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:29 2022] DELETE /compute/v2.1/images/4f0c3346-cd3b-4d5a-bcc9-4f0d2ff31c8b => generated 62 bytes in 506 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:54:29.863118 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bceb48f1-f07a-438a-9726-e779e3ef8370 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:29.864301 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bceb48f1-f07a-438a-9726-e779e3ef8370 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:29.874789 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bceb48f1-f07a-438a-9726-e779e3ef8370 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:29.875868 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bceb48f1-f07a-438a-9726-e779e3ef8370 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:29.876695 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bceb48f1-f07a-438a-9726-e779e3ef8370 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:29.878045 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bceb48f1-f07a-438a-9726-e779e3ef8370 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:29.879215 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bceb48f1-f07a-438a-9726-e779e3ef8370 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:29.879915 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bceb48f1-f07a-438a-9726-e779e3ef8370 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:30.368102 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bceb48f1-f07a-438a-9726-e779e3ef8370 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:30.384485 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bceb48f1-f07a-438a-9726-e779e3ef8370 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:30.392589 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bceb48f1-f07a-438a-9726-e779e3ef8370 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:30.394145 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bceb48f1-f07a-438a-9726-e779e3ef8370 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1808 microversion: 2.20 time: 0.548081 Sep 10 11:54:30.402143 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1690/3433] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:54:29 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1808 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:54:30.418667 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-7d5ff39a-7c7d-49ec-b5ac-6d31b7b0f342 req-a5028821-451f-4a68-9927-2a2ec116ba12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d40c7388-4376-47ca-98e3-27db94e48009", "name": "network-vif-deleted", "tag": "a27af5ea-3518-46fe-a788-b8d2663c94a9"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:54:30.458860 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-7d5ff39a-7c7d-49ec-b5ac-6d31b7b0f342 req-a5028821-451f-4a68-9927-2a2ec116ba12 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:30.459536 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-7d5ff39a-7c7d-49ec-b5ac-6d31b7b0f342 req-a5028821-451f-4a68-9927-2a2ec116ba12 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:30.460266 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-7d5ff39a-7c7d-49ec-b5ac-6d31b7b0f342 req-a5028821-451f-4a68-9927-2a2ec116ba12 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:30.527410 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-7d5ff39a-7c7d-49ec-b5ac-6d31b7b0f342 req-a5028821-451f-4a68-9927-2a2ec116ba12 service nova] Creating event network-vif-deleted:a27af5ea-3518-46fe-a788-b8d2663c94a9 for instance d40c7388-4376-47ca-98e3-27db94e48009 on n-h2-856895-1 Sep 10 11:54:30.546418 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-7d5ff39a-7c7d-49ec-b5ac-6d31b7b0f342 req-a5028821-451f-4a68-9927-2a2ec116ba12 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137914 Sep 10 11:54:30.555835 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1691/3434] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:54:30.624538 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0fe6a63b-e35f-4a89-b0fb-f333267e9ba6 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Action: 'create', calling method: .version_select at 0x7f4072e08940>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-11539708", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDTLUrI/rG/hsaruXoC74YLAIbmPtYaJUwxKvOIGPyC0FqTpgVaG384u+JmDphNbkTAI4m+p/mSwIyisvruSg4inGnoyst2zgecSW/xx3263dg1Djj1pFU5Qgg4AmMxhJg=="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:54:30.653209 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-0a4f6767-a78c-4963-a7ac-bffd3ad74fc0 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:54:30.653742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-0a4f6767-a78c-4963-a7ac-bffd3ad74fc0 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:54:30.654298 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-0a4f6767-a78c-4963-a7ac-bffd3ad74fc0 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:54:30.654839 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-0a4f6767-a78c-4963-a7ac-bffd3ad74fc0 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:54:30.655339 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-0a4f6767-a78c-4963-a7ac-bffd3ad74fc0 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:54:30.657700 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:54:30.685997 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a4f6767-a78c-4963-a7ac-bffd3ad74fc0 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:30.686501 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a4f6767-a78c-4963-a7ac-bffd3ad74fc0 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:30.687053 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a4f6767-a78c-4963-a7ac-bffd3ad74fc0 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:30.687819 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a4f6767-a78c-4963-a7ac-bffd3ad74fc0 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:30.688416 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a4f6767-a78c-4963-a7ac-bffd3ad74fc0 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:30.696662 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-0fe6a63b-e35f-4a89-b0fb-f333267e9ba6 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Getting quotas for project 20756c1a77fb44f684973f382b802825. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:54:30.711286 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-0fe6a63b-e35f-4a89-b0fb-f333267e9ba6 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Getting quotas for user 92be647276cc456e83dacd25b98e37f2 and project 20756c1a77fb44f684973f382b802825. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:54:30.724344 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a4f6767-a78c-4963-a7ac-bffd3ad74fc0 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:30.773748 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0fe6a63b-e35f-4a89-b0fb-f333267e9ba6 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.194805 Sep 10 11:54:30.774556 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1692/3435] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 11:54:30 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:54:30.798762 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2caf7b6a-ffde-47ba-9e43-0ecc42fd8762 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:30.808343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2caf7b6a-ffde-47ba-9e43-0ecc42fd8762 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] [instance: d40c7388-4376-47ca-98e3-27db94e48009] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:30.815110 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-0a4f6767-a78c-4963-a7ac-bffd3ad74fc0 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Getting quotas for project 37597777ce774f87aeabe08ab2227cbd. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:54:30.839286 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2caf7b6a-ffde-47ba-9e43-0ecc42fd8762 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:30.842027 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-0a4f6767-a78c-4963-a7ac-bffd3ad74fc0 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Getting quotas for user ce925a3528c64d4fa50a8310be9e7c06 and project 37597777ce774f87aeabe08ab2227cbd. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:54:30.852112 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2caf7b6a-ffde-47ba-9e43-0ecc42fd8762 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:30.855113 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2caf7b6a-ffde-47ba-9e43-0ecc42fd8762 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:30.856111 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2caf7b6a-ffde-47ba-9e43-0ecc42fd8762 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:30.856852 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2caf7b6a-ffde-47ba-9e43-0ecc42fd8762 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:30.858888 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2caf7b6a-ffde-47ba-9e43-0ecc42fd8762 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:30.935046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0a4f6767-a78c-4963-a7ac-bffd3ad74fc0 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:54:30.947887 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-2caf7b6a-ffde-47ba-9e43-0ecc42fd8762 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] HTTP exception thrown: Instance d40c7388-4376-47ca-98e3-27db94e48009 could not be found. Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2caf7b6a-ffde-47ba-9e43-0ecc42fd8762 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Request method failure captured: Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/d40c7388-4376-47ca-98e3-27db94e48009 HTTP/1.1 Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHrTpCo0yXxonVtTfuEo7q9d9JaTJLEMxSBhM3CRSuRRHE_U0i67aI-5w6q9iQxAwMf923lxdCJSmSDRo3TAKA4iRJ7iW7gNDHAlt82zx7Id93XrAUX6yAnTz93gkjDvuCs_VRxwLJw7qrSwynQniHZQl5CS4GaJInaGELG8WEfpnRQ Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: a827355dfbcf40ec8d2e3e75d453e6bb Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-521406430 Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a827355dfbcf40ec8d2e3e75d453e6bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a827355dfbcf40ec8d2e3e75d453e6bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a827355dfbcf40ec8d2e3e75d453e6bb", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a827355dfbcf40ec8d2e3e75d453e6bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-521406430 Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: a827355dfbcf40ec8d2e3e75d453e6bb Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-521406430 Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServerMetadataNegativeTestJSON-521406430-project Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 85362ff7bd6245d79b31a3937e14c095 Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-521406430-project Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance d40c7388-4376-47ca-98e3-27db94e48009 could not be found. Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'd40c7388-4376-47ca-98e3-27db94e48009'} Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d40c7388-4376-47ca-98e3-27db94e48009 could not be found. Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d40c7388-4376-47ca-98e3-27db94e48009 could not be found. Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:30.949775 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:30.959517 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:30.959517 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:30.959517 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:30.959517 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:30.959517 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:54:30.959517 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:54:30.959517 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d40c7388-4376-47ca-98e3-27db94e48009 could not be found. Sep 10 11:54:30.959517 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:30.959517 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2caf7b6a-ffde-47ba-9e43-0ecc42fd8762 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] Returning 404 to user: Instance d40c7388-4376-47ca-98e3-27db94e48009 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:54:30.962248 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0a4f6767-a78c-4963-a7ac-bffd3ad74fc0 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 6f2872c7-ac86-4764-9db6-96eece78150f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:54:30.975706 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2caf7b6a-ffde-47ba-9e43-0ecc42fd8762 tempest-ServerMetadataNegativeTestJSON-521406430 tempest-ServerMetadataNegativeTestJSON-521406430-project] 10.222.0.23 "GET /compute/v2.1/servers/d40c7388-4376-47ca-98e3-27db94e48009" status: 404 len: 111 microversion: 2.1 time: 0.175678 Sep 10 11:54:30.984022 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1693/3436] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:30 2022] GET /compute/v2.1/servers/d40c7388-4376-47ca-98e3-27db94e48009 => generated 111 bytes in 208 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:54:30.992485 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4f912605-fb92-494a-ad1e-9b85cc909304 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:30.999765 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4f912605-fb92-494a-ad1e-9b85cc909304 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: c56e3146-bad1-4abf-853a-2d01226d85b4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:31.009487 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f912605-fb92-494a-ad1e-9b85cc909304 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:31.010441 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f912605-fb92-494a-ad1e-9b85cc909304 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:31.011276 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f912605-fb92-494a-ad1e-9b85cc909304 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:31.012380 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f912605-fb92-494a-ad1e-9b85cc909304 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:31.013206 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f912605-fb92-494a-ad1e-9b85cc909304 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:31.015755 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f912605-fb92-494a-ad1e-9b85cc909304 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:31.095101 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-4f912605-fb92-494a-ad1e-9b85cc909304 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] HTTP exception thrown: Instance c56e3146-bad1-4abf-853a-2d01226d85b4 could not be found. Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4f912605-fb92-494a-ad1e-9b85cc909304 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Request method failure captured: Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/servers/c56e3146-bad1-4abf-853a-2d01226d85b4 HTTP/1.1 Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHn4qx7-RJW530OcZP-HbaGtHMvLFpM5FagIMU2VdWF84c499i9YfjZquQEUjoDx9LuzhR3BDEoUkdspCmBol1ak1On1wm7uogZWHDZsvVl6TsHMKnzPFOC81lsU-lVJhYePyv1AjhxbbjqxuBJCGxjFxEftt4cUayosCmqZZn3TePc Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 57eb6c59b1a7467baf0daae9019ca5aa Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ImagesTestJSON-915014488 Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/57eb6c59b1a7467baf0daae9019ca5aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/57eb6c59b1a7467baf0daae9019ca5aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_57eb6c59b1a7467baf0daae9019ca5aa", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/57eb6c59b1a7467baf0daae9019ca5aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ImagesTestJSON-915014488 Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 57eb6c59b1a7467baf0daae9019ca5aa Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ImagesTestJSON-915014488 Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ImagesTestJSON-915014488-project Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 1ead4e0fd51b484c8dd38da5a3975788 Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ImagesTestJSON-915014488-project Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance c56e3146-bad1-4abf-853a-2d01226d85b4 could not be found. Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'c56e3146-bad1-4abf-853a-2d01226d85b4'} Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c56e3146-bad1-4abf-853a-2d01226d85b4 could not be found. Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:54:31.098233 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c56e3146-bad1-4abf-853a-2d01226d85b4 could not be found. Sep 10 11:54:31.107870 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:31.107870 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:31.107870 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:31.107870 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:31.107870 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:31.107870 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:31.107870 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:54:31.107870 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:54:31.107870 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c56e3146-bad1-4abf-853a-2d01226d85b4 could not be found. Sep 10 11:54:31.107870 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:31.111519 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4f912605-fb92-494a-ad1e-9b85cc909304 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Returning 404 to user: Instance c56e3146-bad1-4abf-853a-2d01226d85b4 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:54:31.113449 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4f912605-fb92-494a-ad1e-9b85cc909304 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c56e3146-bad1-4abf-853a-2d01226d85b4" status: 404 len: 111 microversion: 2.1 time: 0.127700 Sep 10 11:54:31.115510 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1694/3437] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:54:30 2022] DELETE /compute/v2.1/servers/c56e3146-bad1-4abf-853a-2d01226d85b4 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:54:31.157358 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9bce4701-cc26-4bb8-943e-318659f3f80a tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:31.158382 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9bce4701-cc26-4bb8-943e-318659f3f80a tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 43e1acba-4c0e-4f89-8d03-e9dcb388c1ef] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:31.191338 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9bce4701-cc26-4bb8-943e-318659f3f80a tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:31.191850 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9bce4701-cc26-4bb8-943e-318659f3f80a tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:31.192299 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9bce4701-cc26-4bb8-943e-318659f3f80a tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:31.193085 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9bce4701-cc26-4bb8-943e-318659f3f80a tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:31.193689 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9bce4701-cc26-4bb8-943e-318659f3f80a tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:31.194173 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9bce4701-cc26-4bb8-943e-318659f3f80a tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:31.205536 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0a4f6767-a78c-4963-a7ac-bffd3ad74fc0 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.659521 Sep 10 11:54:31.206212 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1744/3438] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:54:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 5664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:54:31.226253 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-560f6560-60ac-463d-a583-ea9b77b0e295 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:31.226904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-560f6560-60ac-463d-a583-ea9b77b0e295 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: c56e3146-bad1-4abf-853a-2d01226d85b4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:31.284230 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-560f6560-60ac-463d-a583-ea9b77b0e295 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:31.284764 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-560f6560-60ac-463d-a583-ea9b77b0e295 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:31.286209 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-560f6560-60ac-463d-a583-ea9b77b0e295 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:31.290301 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-560f6560-60ac-463d-a583-ea9b77b0e295 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:31.293475 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-560f6560-60ac-463d-a583-ea9b77b0e295 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:31.295880 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-560f6560-60ac-463d-a583-ea9b77b0e295 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:31.394768 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-560f6560-60ac-463d-a583-ea9b77b0e295 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] HTTP exception thrown: Instance c56e3146-bad1-4abf-853a-2d01226d85b4 could not be found. Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-560f6560-60ac-463d-a583-ea9b77b0e295 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Request method failure captured: Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/c56e3146-bad1-4abf-853a-2d01226d85b4 HTTP/1.1 Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHn4qx7-RJW530OcZP-HbaGtHMvLFpM5FagIMU2VdWF84c499i9YfjZquQEUjoDx9LuzhR3BDEoUkdspCmBol1ak1On1wm7uogZWHDZsvVl6TsHMKnzPFOC81lsU-lVJhYePyv1AjhxbbjqxuBJCGxjFxEftt4cUayosCmqZZn3TePc Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 57eb6c59b1a7467baf0daae9019ca5aa Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ImagesTestJSON-915014488 Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/57eb6c59b1a7467baf0daae9019ca5aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/57eb6c59b1a7467baf0daae9019ca5aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_57eb6c59b1a7467baf0daae9019ca5aa", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/57eb6c59b1a7467baf0daae9019ca5aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ImagesTestJSON-915014488 Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 57eb6c59b1a7467baf0daae9019ca5aa Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ImagesTestJSON-915014488 Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ImagesTestJSON-915014488-project Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 1ead4e0fd51b484c8dd38da5a3975788 Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ImagesTestJSON-915014488-project Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance c56e3146-bad1-4abf-853a-2d01226d85b4 could not be found. Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'c56e3146-bad1-4abf-853a-2d01226d85b4'} Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c56e3146-bad1-4abf-853a-2d01226d85b4 could not be found. Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c56e3146-bad1-4abf-853a-2d01226d85b4 could not be found. Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:31.412614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:31.420394 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:31.420394 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:31.420394 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:54:31.420394 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:54:31.420394 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c56e3146-bad1-4abf-853a-2d01226d85b4 could not be found. Sep 10 11:54:31.420394 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:31.420394 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-560f6560-60ac-463d-a583-ea9b77b0e295 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Returning 404 to user: Instance c56e3146-bad1-4abf-853a-2d01226d85b4 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:54:31.420394 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-560f6560-60ac-463d-a583-ea9b77b0e295 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/c56e3146-bad1-4abf-853a-2d01226d85b4" status: 404 len: 111 microversion: 2.1 time: 0.210506 Sep 10 11:54:31.431367 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1745/3439] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:31 2022] GET /compute/v2.1/servers/c56e3146-bad1-4abf-853a-2d01226d85b4 => generated 111 bytes in 224 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:54:31.452078 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-67c2a184-db1b-4016-8e79-7061bfeb45e9 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:31.452712 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-67c2a184-db1b-4016-8e79-7061bfeb45e9 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 6f2872c7-ac86-4764-9db6-96eece78150f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:32.114449 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-67c2a184-db1b-4016-8e79-7061bfeb45e9 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:32.128721 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-67c2a184-db1b-4016-8e79-7061bfeb45e9 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f" status: 200 len: 1213 microversion: 2.1 time: 0.694027 Sep 10 11:54:32.133336 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1746/3440] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:31 2022] GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f => generated 1213 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:32.173507 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6152b53f-67a6-40e9-8ec0-285fcb459793 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f407355ff70>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:32.350876 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-6152b53f-67a6-40e9-8ec0-285fcb459793 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] HTTP exception thrown: Image not found. Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6152b53f-67a6-40e9-8ec0-285fcb459793 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Request method failure captured: Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/images/1579b63c-4bb7-4e44-ab69-cea48d12791e HTTP/1.1 Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHn4qx7-RJW530OcZP-HbaGtHMvLFpM5FagIMU2VdWF84c499i9YfjZquQEUjoDx9LuzhR3BDEoUkdspCmBol1ak1On1wm7uogZWHDZsvVl6TsHMKnzPFOC81lsU-lVJhYePyv1AjhxbbjqxuBJCGxjFxEftt4cUayosCmqZZn3TePc Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 57eb6c59b1a7467baf0daae9019ca5aa Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ImagesTestJSON-915014488 Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/57eb6c59b1a7467baf0daae9019ca5aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/57eb6c59b1a7467baf0daae9019ca5aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_57eb6c59b1a7467baf0daae9019ca5aa", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/57eb6c59b1a7467baf0daae9019ca5aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ImagesTestJSON-915014488 Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 57eb6c59b1a7467baf0daae9019ca5aa Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ImagesTestJSON-915014488 Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ImagesTestJSON-915014488-project Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 1ead4e0fd51b484c8dd38da5a3975788 Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ImagesTestJSON-915014488-project Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: exception: Image not found. Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '1579b63c-4bb7-4e44-ab69-cea48d12791e'} Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1579b63c-4bb7-4e44-ab69-cea48d12791e to delete Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1579b63c-4bb7-4e44-ab69-cea48d12791e could not be found. Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:32.379441 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:32.385562 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:32.385562 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:32.385562 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:54:32.385562 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:54:32.385562 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:54:32.385562 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:54:32.385562 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:54:32.385562 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:54:32.385562 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 10 11:54:32.385562 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 11:54:32.385562 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 11:54:32.385562 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:32.385562 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:32.385562 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:32.385562 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:32.385562 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:32.385562 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:32.385562 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:54:32.385562 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:54:32.385562 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 11:54:32.385562 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:32.385562 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6152b53f-67a6-40e9-8ec0-285fcb459793 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Returning 404 to user: Image not found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:54:32.385562 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6152b53f-67a6-40e9-8ec0-285fcb459793 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "DELETE /compute/v2.1/images/1579b63c-4bb7-4e44-ab69-cea48d12791e" status: 404 len: 62 microversion: 2.1 time: 0.217105 Sep 10 11:54:32.385562 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1747/3441] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:32 2022] DELETE /compute/v2.1/images/1579b63c-4bb7-4e44-ab69-cea48d12791e => generated 62 bytes in 218 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:54:32.385562 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-695c03ef-9ef6-49b4-907f-6a5732241e52 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:32.385562 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-695c03ef-9ef6-49b4-907f-6a5732241e52 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:32.409597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-695c03ef-9ef6-49b4-907f-6a5732241e52 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:32.410094 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-695c03ef-9ef6-49b4-907f-6a5732241e52 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:32.438263 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-695c03ef-9ef6-49b4-907f-6a5732241e52 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:32.445783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-695c03ef-9ef6-49b4-907f-6a5732241e52 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:32.457158 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-695c03ef-9ef6-49b4-907f-6a5732241e52 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:32.457671 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-695c03ef-9ef6-49b4-907f-6a5732241e52 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:32.710730 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9bce4701-cc26-4bb8-943e-318659f3f80a tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318416fa33b40ae98c8c35675b0c101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f44e4274f41c1882cf1a2167dc891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:32.722033 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9bce4701-cc26-4bb8-943e-318659f3f80a tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "GET /compute/v2.1/servers/43e1acba-4c0e-4f89-8d03-e9dcb388c1ef" status: 200 len: 1324 microversion: 2.1 time: 1.604949 Sep 10 11:54:32.722622 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1695/3442] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:31 2022] GET /compute/v2.1/servers/43e1acba-4c0e-4f89-8d03-e9dcb388c1ef => generated 1324 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:32.737318 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-b313830c-e103-4c3c-9768-d915caa0e651 req-0500ba9a-52af-4b41-ae2b-2830eacdae8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43e1acba-4c0e-4f89-8d03-e9dcb388c1ef", "name": "network-vif-plugged", "status": "completed", "tag": "12dbd5b4-0a1e-43b6-b783-06fe70dd1b54"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:54:32.806586 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-b313830c-e103-4c3c-9768-d915caa0e651 req-0500ba9a-52af-4b41-ae2b-2830eacdae8d service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:32.807090 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-b313830c-e103-4c3c-9768-d915caa0e651 req-0500ba9a-52af-4b41-ae2b-2830eacdae8d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:32.807580 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-b313830c-e103-4c3c-9768-d915caa0e651 req-0500ba9a-52af-4b41-ae2b-2830eacdae8d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:32.907341 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-b313830c-e103-4c3c-9768-d915caa0e651 req-0500ba9a-52af-4b41-ae2b-2830eacdae8d service nova] Creating event network-vif-plugged:12dbd5b4-0a1e-43b6-b783-06fe70dd1b54 for instance 43e1acba-4c0e-4f89-8d03-e9dcb388c1ef on n-h2-856895-1 Sep 10 11:54:32.916387 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-b313830c-e103-4c3c-9768-d915caa0e651 req-0500ba9a-52af-4b41-ae2b-2830eacdae8d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181604 Sep 10 11:54:32.922898 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1696/3443] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:54:32.958141 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ed0ffaa2-7727-4fd8-b8df-cc4358750445 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:32.968711 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ed0ffaa2-7727-4fd8-b8df-cc4358750445 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 7c17b066-2297-4d76-adcb-abae0e87a3c2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:32.982884 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed0ffaa2-7727-4fd8-b8df-cc4358750445 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:32.983849 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed0ffaa2-7727-4fd8-b8df-cc4358750445 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:32.986295 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed0ffaa2-7727-4fd8-b8df-cc4358750445 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:32.987861 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed0ffaa2-7727-4fd8-b8df-cc4358750445 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:32.989828 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed0ffaa2-7727-4fd8-b8df-cc4358750445 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:32.991855 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed0ffaa2-7727-4fd8-b8df-cc4358750445 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:33.049368 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-ed0ffaa2-7727-4fd8-b8df-cc4358750445 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] HTTP exception thrown: Instance 7c17b066-2297-4d76-adcb-abae0e87a3c2 could not be found. Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ed0ffaa2-7727-4fd8-b8df-cc4358750445 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Request method failure captured: Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2 HTTP/1.1 Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHn4qx7-RJW530OcZP-HbaGtHMvLFpM5FagIMU2VdWF84c499i9YfjZquQEUjoDx9LuzhR3BDEoUkdspCmBol1ak1On1wm7uogZWHDZsvVl6TsHMKnzPFOC81lsU-lVJhYePyv1AjhxbbjqxuBJCGxjFxEftt4cUayosCmqZZn3TePc Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 57eb6c59b1a7467baf0daae9019ca5aa Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ImagesTestJSON-915014488 Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/57eb6c59b1a7467baf0daae9019ca5aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/57eb6c59b1a7467baf0daae9019ca5aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_57eb6c59b1a7467baf0daae9019ca5aa", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/57eb6c59b1a7467baf0daae9019ca5aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ImagesTestJSON-915014488 Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 57eb6c59b1a7467baf0daae9019ca5aa Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ImagesTestJSON-915014488 Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ImagesTestJSON-915014488-project Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 1ead4e0fd51b484c8dd38da5a3975788 Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ImagesTestJSON-915014488-project Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 7c17b066-2297-4d76-adcb-abae0e87a3c2 could not be found. Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '7c17b066-2297-4d76-adcb-abae0e87a3c2'} Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c17b066-2297-4d76-adcb-abae0e87a3c2 could not be found. Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:54:33.055406 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c17b066-2297-4d76-adcb-abae0e87a3c2 could not be found. Sep 10 11:54:33.062253 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:33.062253 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:33.062253 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:33.062253 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:33.062253 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:33.062253 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:33.062253 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:54:33.062253 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:54:33.062253 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c17b066-2297-4d76-adcb-abae0e87a3c2 could not be found. Sep 10 11:54:33.062253 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:33.062253 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ed0ffaa2-7727-4fd8-b8df-cc4358750445 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Returning 404 to user: Instance 7c17b066-2297-4d76-adcb-abae0e87a3c2 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:54:33.062253 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ed0ffaa2-7727-4fd8-b8df-cc4358750445 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2" status: 404 len: 111 microversion: 2.1 time: 0.130423 Sep 10 11:54:33.065532 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1697/3444] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:54:32 2022] DELETE /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:54:33.080788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4cd19d51-363a-46ed-a79f-c59dc9198859 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:33.081434 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4cd19d51-363a-46ed-a79f-c59dc9198859 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 7c17b066-2297-4d76-adcb-abae0e87a3c2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:33.093499 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4cd19d51-363a-46ed-a79f-c59dc9198859 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:33.093989 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4cd19d51-363a-46ed-a79f-c59dc9198859 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:33.094439 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4cd19d51-363a-46ed-a79f-c59dc9198859 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:33.095259 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4cd19d51-363a-46ed-a79f-c59dc9198859 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:33.100619 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4cd19d51-363a-46ed-a79f-c59dc9198859 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:33.101088 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4cd19d51-363a-46ed-a79f-c59dc9198859 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:33.159543 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-4cd19d51-363a-46ed-a79f-c59dc9198859 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] HTTP exception thrown: Instance 7c17b066-2297-4d76-adcb-abae0e87a3c2 could not be found. Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4cd19d51-363a-46ed-a79f-c59dc9198859 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Request method failure captured: Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2 HTTP/1.1 Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHn4qx7-RJW530OcZP-HbaGtHMvLFpM5FagIMU2VdWF84c499i9YfjZquQEUjoDx9LuzhR3BDEoUkdspCmBol1ak1On1wm7uogZWHDZsvVl6TsHMKnzPFOC81lsU-lVJhYePyv1AjhxbbjqxuBJCGxjFxEftt4cUayosCmqZZn3TePc Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 57eb6c59b1a7467baf0daae9019ca5aa Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ImagesTestJSON-915014488 Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/57eb6c59b1a7467baf0daae9019ca5aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/57eb6c59b1a7467baf0daae9019ca5aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_57eb6c59b1a7467baf0daae9019ca5aa", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/57eb6c59b1a7467baf0daae9019ca5aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ImagesTestJSON-915014488 Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 57eb6c59b1a7467baf0daae9019ca5aa Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ImagesTestJSON-915014488 Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ImagesTestJSON-915014488-project Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 1ead4e0fd51b484c8dd38da5a3975788 Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ImagesTestJSON-915014488-project Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 7c17b066-2297-4d76-adcb-abae0e87a3c2 could not be found. Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '7c17b066-2297-4d76-adcb-abae0e87a3c2'} Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c17b066-2297-4d76-adcb-abae0e87a3c2 could not be found. Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c17b066-2297-4d76-adcb-abae0e87a3c2 could not be found. Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:33.173469 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:33.179385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:33.179385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:33.179385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:54:33.179385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:54:33.179385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c17b066-2297-4d76-adcb-abae0e87a3c2 could not be found. Sep 10 11:54:33.179385 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:33.179385 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4cd19d51-363a-46ed-a79f-c59dc9198859 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Returning 404 to user: Instance 7c17b066-2297-4d76-adcb-abae0e87a3c2 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:54:33.179385 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4cd19d51-363a-46ed-a79f-c59dc9198859 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2" status: 404 len: 111 microversion: 2.1 time: 0.107516 Sep 10 11:54:33.183726 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1698/3445] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:33 2022] GET /compute/v2.1/servers/7c17b066-2297-4d76-adcb-abae0e87a3c2 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:54:33.206857 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-faa4c31f-9924-46ef-8265-8e1b16b570ea tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:33.207607 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-faa4c31f-9924-46ef-8265-8e1b16b570ea tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 6f2872c7-ac86-4764-9db6-96eece78150f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:33.230580 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-faa4c31f-9924-46ef-8265-8e1b16b570ea tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:33.231102 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-faa4c31f-9924-46ef-8265-8e1b16b570ea tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:33.240207 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-faa4c31f-9924-46ef-8265-8e1b16b570ea tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:33.242818 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-faa4c31f-9924-46ef-8265-8e1b16b570ea tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:33.244952 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-faa4c31f-9924-46ef-8265-8e1b16b570ea tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:33.245426 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-faa4c31f-9924-46ef-8265-8e1b16b570ea tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:33.404527 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-695c03ef-9ef6-49b4-907f-6a5732241e52 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:33.418606 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-695c03ef-9ef6-49b4-907f-6a5732241e52 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:33.437718 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-695c03ef-9ef6-49b4-907f-6a5732241e52 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:33.439446 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-695c03ef-9ef6-49b4-907f-6a5732241e52 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1808 microversion: 2.20 time: 1.082425 Sep 10 11:54:33.440769 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1748/3446] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:54:32 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1808 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:54:33.457447 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-634f97cb-e44c-487f-9220-19c90f9f325b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '.version_select at 0x7f407355faf0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:33.713452 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-634f97cb-e44c-487f-9220-19c90f9f325b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] HTTP exception thrown: Image not found. Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-634f97cb-e44c-487f-9220-19c90f9f325b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Request method failure captured: Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/images/9af4c5ec-005a-43b8-8d1f-84731e30d0df HTTP/1.1 Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHn4qx7-RJW530OcZP-HbaGtHMvLFpM5FagIMU2VdWF84c499i9YfjZquQEUjoDx9LuzhR3BDEoUkdspCmBol1ak1On1wm7uogZWHDZsvVl6TsHMKnzPFOC81lsU-lVJhYePyv1AjhxbbjqxuBJCGxjFxEftt4cUayosCmqZZn3TePc Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 57eb6c59b1a7467baf0daae9019ca5aa Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ImagesTestJSON-915014488 Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/57eb6c59b1a7467baf0daae9019ca5aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/57eb6c59b1a7467baf0daae9019ca5aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_57eb6c59b1a7467baf0daae9019ca5aa", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/57eb6c59b1a7467baf0daae9019ca5aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ImagesTestJSON-915014488 Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 57eb6c59b1a7467baf0daae9019ca5aa Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ImagesTestJSON-915014488 Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ImagesTestJSON-915014488-project Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 1ead4e0fd51b484c8dd38da5a3975788 Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ImagesTestJSON-915014488-project Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: exception: Image not found. Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '9af4c5ec-005a-43b8-8d1f-84731e30d0df'} Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9af4c5ec-005a-43b8-8d1f-84731e30d0df to delete Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9af4c5ec-005a-43b8-8d1f-84731e30d0df could not be found. Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:33.715579 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:33.722020 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:33.722020 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:33.722020 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:54:33.722020 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:54:33.722020 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:54:33.722020 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:54:33.722020 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:54:33.722020 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:54:33.722020 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 10 11:54:33.722020 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 10 11:54:33.722020 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 10 11:54:33.722020 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:33.722020 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:33.722020 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:33.722020 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:33.722020 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:33.722020 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:33.722020 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:54:33.722020 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:54:33.722020 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 10 11:54:33.722020 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:33.722020 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-634f97cb-e44c-487f-9220-19c90f9f325b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Returning 404 to user: Image not found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:54:33.725100 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-634f97cb-e44c-487f-9220-19c90f9f325b tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "DELETE /compute/v2.1/images/9af4c5ec-005a-43b8-8d1f-84731e30d0df" status: 404 len: 62 microversion: 2.1 time: 0.282270 Sep 10 11:54:33.726115 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1749/3447] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:33 2022] DELETE /compute/v2.1/images/9af4c5ec-005a-43b8-8d1f-84731e30d0df => generated 62 bytes in 284 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:54:33.756589 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5c801a16-c43e-420d-8304-6aaf98d505e6 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:33.758450 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5c801a16-c43e-420d-8304-6aaf98d505e6 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 10b130d5-dcd3-41e9-9e67-c68eb28726a2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:33.796987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c801a16-c43e-420d-8304-6aaf98d505e6 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:33.799378 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c801a16-c43e-420d-8304-6aaf98d505e6 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:33.800824 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c801a16-c43e-420d-8304-6aaf98d505e6 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:33.803757 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c801a16-c43e-420d-8304-6aaf98d505e6 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:33.804459 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c801a16-c43e-420d-8304-6aaf98d505e6 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:33.808020 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c801a16-c43e-420d-8304-6aaf98d505e6 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:33.844913 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-5c801a16-c43e-420d-8304-6aaf98d505e6 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] HTTP exception thrown: Instance 10b130d5-dcd3-41e9-9e67-c68eb28726a2 could not be found. Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5c801a16-c43e-420d-8304-6aaf98d505e6 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Request method failure captured: Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/servers/10b130d5-dcd3-41e9-9e67-c68eb28726a2 HTTP/1.1 Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHn4qx7-RJW530OcZP-HbaGtHMvLFpM5FagIMU2VdWF84c499i9YfjZquQEUjoDx9LuzhR3BDEoUkdspCmBol1ak1On1wm7uogZWHDZsvVl6TsHMKnzPFOC81lsU-lVJhYePyv1AjhxbbjqxuBJCGxjFxEftt4cUayosCmqZZn3TePc Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 57eb6c59b1a7467baf0daae9019ca5aa Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ImagesTestJSON-915014488 Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/57eb6c59b1a7467baf0daae9019ca5aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/57eb6c59b1a7467baf0daae9019ca5aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_57eb6c59b1a7467baf0daae9019ca5aa", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/57eb6c59b1a7467baf0daae9019ca5aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ImagesTestJSON-915014488 Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 57eb6c59b1a7467baf0daae9019ca5aa Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ImagesTestJSON-915014488 Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ImagesTestJSON-915014488-project Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 1ead4e0fd51b484c8dd38da5a3975788 Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ImagesTestJSON-915014488-project Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 10b130d5-dcd3-41e9-9e67-c68eb28726a2 could not be found. Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '10b130d5-dcd3-41e9-9e67-c68eb28726a2'} Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10b130d5-dcd3-41e9-9e67-c68eb28726a2 could not be found. Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:54:33.849260 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10b130d5-dcd3-41e9-9e67-c68eb28726a2 could not be found. Sep 10 11:54:33.854776 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:33.854776 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:33.854776 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:33.854776 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:33.854776 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:33.854776 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:33.854776 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:54:33.854776 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:54:33.854776 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10b130d5-dcd3-41e9-9e67-c68eb28726a2 could not be found. Sep 10 11:54:33.854776 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:54:33.856155 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5c801a16-c43e-420d-8304-6aaf98d505e6 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Returning 404 to user: Instance 10b130d5-dcd3-41e9-9e67-c68eb28726a2 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:54:33.859130 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5c801a16-c43e-420d-8304-6aaf98d505e6 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "DELETE /compute/v2.1/servers/10b130d5-dcd3-41e9-9e67-c68eb28726a2" status: 404 len: 111 microversion: 2.1 time: 0.128819 Sep 10 11:54:33.863283 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1750/3448] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:54:33 2022] DELETE /compute/v2.1/servers/10b130d5-dcd3-41e9-9e67-c68eb28726a2 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:54:33.878568 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8f83b4b8-f468-4eb5-acfb-f49fceb50512 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:33.879768 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8f83b4b8-f468-4eb5-acfb-f49fceb50512 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 43e1acba-4c0e-4f89-8d03-e9dcb388c1ef] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:33.887850 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8f83b4b8-f468-4eb5-acfb-f49fceb50512 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:33.889779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8f83b4b8-f468-4eb5-acfb-f49fceb50512 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:33.890578 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8f83b4b8-f468-4eb5-acfb-f49fceb50512 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:33.891581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8f83b4b8-f468-4eb5-acfb-f49fceb50512 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:33.892271 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8f83b4b8-f468-4eb5-acfb-f49fceb50512 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:33.892968 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8f83b4b8-f468-4eb5-acfb-f49fceb50512 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:34.144580 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-faa4c31f-9924-46ef-8265-8e1b16b570ea tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:34.161110 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-faa4c31f-9924-46ef-8265-8e1b16b570ea tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f" status: 200 len: 1209 microversion: 2.1 time: 0.976087 Sep 10 11:54:34.161729 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1699/3449] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:33 2022] GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f => generated 1209 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:34.203077 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-321f2d7f-c972-4d37-bd98-36e03b1885d1 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:34.216242 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-321f2d7f-c972-4d37-bd98-36e03b1885d1 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] [instance: 10b130d5-dcd3-41e9-9e67-c68eb28726a2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:34.242493 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-321f2d7f-c972-4d37-bd98-36e03b1885d1 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:34.243373 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-321f2d7f-c972-4d37-bd98-36e03b1885d1 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:34.251565 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-321f2d7f-c972-4d37-bd98-36e03b1885d1 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:34.254391 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-321f2d7f-c972-4d37-bd98-36e03b1885d1 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:34.254983 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-321f2d7f-c972-4d37-bd98-36e03b1885d1 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:34.257675 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-321f2d7f-c972-4d37-bd98-36e03b1885d1 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:34.326704 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-321f2d7f-c972-4d37-bd98-36e03b1885d1 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] HTTP exception thrown: Instance 10b130d5-dcd3-41e9-9e67-c68eb28726a2 could not be found. Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-321f2d7f-c972-4d37-bd98-36e03b1885d1 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Request method failure captured: Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/10b130d5-dcd3-41e9-9e67-c68eb28726a2 HTTP/1.1 Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHn4qx7-RJW530OcZP-HbaGtHMvLFpM5FagIMU2VdWF84c499i9YfjZquQEUjoDx9LuzhR3BDEoUkdspCmBol1ak1On1wm7uogZWHDZsvVl6TsHMKnzPFOC81lsU-lVJhYePyv1AjhxbbjqxuBJCGxjFxEftt4cUayosCmqZZn3TePc Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 57eb6c59b1a7467baf0daae9019ca5aa Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ImagesTestJSON-915014488 Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/57eb6c59b1a7467baf0daae9019ca5aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/57eb6c59b1a7467baf0daae9019ca5aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_57eb6c59b1a7467baf0daae9019ca5aa", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/57eb6c59b1a7467baf0daae9019ca5aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ImagesTestJSON-915014488 Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 57eb6c59b1a7467baf0daae9019ca5aa Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ImagesTestJSON-915014488 Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ImagesTestJSON-915014488-project Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 1ead4e0fd51b484c8dd38da5a3975788 Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ImagesTestJSON-915014488-project Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 10b130d5-dcd3-41e9-9e67-c68eb28726a2 could not be found. Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '10b130d5-dcd3-41e9-9e67-c68eb28726a2'} Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10b130d5-dcd3-41e9-9e67-c68eb28726a2 could not be found. Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10b130d5-dcd3-41e9-9e67-c68eb28726a2 could not be found. Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:34.333051 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:54:34.338475 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:54:34.338475 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:54:34.338475 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:54:34.338475 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:54:34.338475 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10b130d5-dcd3-41e9-9e67-c68eb28726a2 could not be found. Sep 10 11:54:34.338475 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:54:34.351224 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-321f2d7f-c972-4d37-bd98-36e03b1885d1 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] Returning 404 to user: Instance 10b130d5-dcd3-41e9-9e67-c68eb28726a2 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:54:34.359417 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-321f2d7f-c972-4d37-bd98-36e03b1885d1 tempest-ImagesTestJSON-915014488 tempest-ImagesTestJSON-915014488-project] 10.222.0.23 "GET /compute/v2.1/servers/10b130d5-dcd3-41e9-9e67-c68eb28726a2" status: 404 len: 111 microversion: 2.1 time: 0.174000 Sep 10 11:54:34.365256 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1700/3450] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:34 2022] GET /compute/v2.1/servers/10b130d5-dcd3-41e9-9e67-c68eb28726a2 => generated 111 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:54:34.474800 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ebea5563-4f12-4b3d-ae9c-f2f824ccbe4a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:34.476125 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ebea5563-4f12-4b3d-ae9c-f2f824ccbe4a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:34.506344 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ebea5563-4f12-4b3d-ae9c-f2f824ccbe4a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:34.507770 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ebea5563-4f12-4b3d-ae9c-f2f824ccbe4a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:34.509156 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ebea5563-4f12-4b3d-ae9c-f2f824ccbe4a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:34.516858 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ebea5563-4f12-4b3d-ae9c-f2f824ccbe4a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:34.517857 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ebea5563-4f12-4b3d-ae9c-f2f824ccbe4a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:34.519509 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ebea5563-4f12-4b3d-ae9c-f2f824ccbe4a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:35.713078 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ebea5563-4f12-4b3d-ae9c-f2f824ccbe4a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:35.743315 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ebea5563-4f12-4b3d-ae9c-f2f824ccbe4a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:35.747233 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ebea5563-4f12-4b3d-ae9c-f2f824ccbe4a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:35.753210 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8f83b4b8-f468-4eb5-acfb-f49fceb50512 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318416fa33b40ae98c8c35675b0c101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f44e4274f41c1882cf1a2167dc891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:35.755569 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ebea5563-4f12-4b3d-ae9c-f2f824ccbe4a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1808 microversion: 2.20 time: 1.289550 Sep 10 11:54:35.769581 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8f83b4b8-f468-4eb5-acfb-f49fceb50512 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "GET /compute/v2.1/servers/43e1acba-4c0e-4f89-8d03-e9dcb388c1ef" status: 200 len: 1324 microversion: 2.1 time: 1.904554 Sep 10 11:54:35.774516 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1751/3451] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:33 2022] GET /compute/v2.1/servers/43e1acba-4c0e-4f89-8d03-e9dcb388c1ef => generated 1324 bytes in 1910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:35.786877 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1701/3452] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:54:34 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1808 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:54:35.800154 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-be54e5c6-3367-4fd9-af5e-279c13c1a8ca tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:35.804241 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-be54e5c6-3367-4fd9-af5e-279c13c1a8ca tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 6f2872c7-ac86-4764-9db6-96eece78150f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:35.833118 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be54e5c6-3367-4fd9-af5e-279c13c1a8ca tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:35.833713 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be54e5c6-3367-4fd9-af5e-279c13c1a8ca tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:35.836345 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be54e5c6-3367-4fd9-af5e-279c13c1a8ca tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:35.842860 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be54e5c6-3367-4fd9-af5e-279c13c1a8ca tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:35.845182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be54e5c6-3367-4fd9-af5e-279c13c1a8ca tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:35.859558 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be54e5c6-3367-4fd9-af5e-279c13c1a8ca tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:36.354702 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-be54e5c6-3367-4fd9-af5e-279c13c1a8ca tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:36.371608 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-be54e5c6-3367-4fd9-af5e-279c13c1a8ca tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f" status: 200 len: 1271 microversion: 2.1 time: 0.590342 Sep 10 11:54:36.372694 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1752/3453] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:35 2022] GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f => generated 1271 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:36.801315 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-dc9181c0-710e-4604-bb3a-e4b954606a1a tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:36.802979 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-64b434fb-5252-4f01-96c6-01c43b9c94bf tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:36.804855 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-64b434fb-5252-4f01-96c6-01c43b9c94bf tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:36.807219 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-dc9181c0-710e-4604-bb3a-e4b954606a1a tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 43e1acba-4c0e-4f89-8d03-e9dcb388c1ef] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:36.837922 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-64b434fb-5252-4f01-96c6-01c43b9c94bf tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:36.840062 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dc9181c0-710e-4604-bb3a-e4b954606a1a tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:36.840838 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-64b434fb-5252-4f01-96c6-01c43b9c94bf tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:36.841659 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dc9181c0-710e-4604-bb3a-e4b954606a1a tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:36.844238 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dc9181c0-710e-4604-bb3a-e4b954606a1a tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:36.844796 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-64b434fb-5252-4f01-96c6-01c43b9c94bf tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:36.845820 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dc9181c0-710e-4604-bb3a-e4b954606a1a tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:36.848655 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-64b434fb-5252-4f01-96c6-01c43b9c94bf tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:36.853148 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-64b434fb-5252-4f01-96c6-01c43b9c94bf tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:36.855247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dc9181c0-710e-4604-bb3a-e4b954606a1a tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:36.856527 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dc9181c0-710e-4604-bb3a-e4b954606a1a tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:36.860042 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-64b434fb-5252-4f01-96c6-01c43b9c94bf tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:38.048828 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-dc9181c0-710e-4604-bb3a-e4b954606a1a tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318416fa33b40ae98c8c35675b0c101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f44e4274f41c1882cf1a2167dc891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:38.056815 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-dc9181c0-710e-4604-bb3a-e4b954606a1a tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "GET /compute/v2.1/servers/43e1acba-4c0e-4f89-8d03-e9dcb388c1ef" status: 200 len: 1520 microversion: 2.1 time: 1.262693 Sep 10 11:54:38.089187 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1753/3454] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:36 2022] GET /compute/v2.1/servers/43e1acba-4c0e-4f89-8d03-e9dcb388c1ef => generated 1520 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:38.094520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7ec046dd-1a8e-4252-a8d2-23a00ba0df8a tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:38.095136 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7ec046dd-1a8e-4252-a8d2-23a00ba0df8a tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 6f2872c7-ac86-4764-9db6-96eece78150f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:38.113969 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ec046dd-1a8e-4252-a8d2-23a00ba0df8a tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:38.114816 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ec046dd-1a8e-4252-a8d2-23a00ba0df8a tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:38.115566 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ec046dd-1a8e-4252-a8d2-23a00ba0df8a tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:38.116531 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ec046dd-1a8e-4252-a8d2-23a00ba0df8a tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:38.117215 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ec046dd-1a8e-4252-a8d2-23a00ba0df8a tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:38.118486 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ec046dd-1a8e-4252-a8d2-23a00ba0df8a tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:38.275057 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-64b434fb-5252-4f01-96c6-01c43b9c94bf tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:38.312526 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-64b434fb-5252-4f01-96c6-01c43b9c94bf tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:38.316451 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-64b434fb-5252-4f01-96c6-01c43b9c94bf tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:38.318984 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-64b434fb-5252-4f01-96c6-01c43b9c94bf tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1808 microversion: 2.20 time: 1.529835 Sep 10 11:54:38.320859 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1702/3455] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:54:36 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1808 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:54:38.334349 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bfbe8a93-5c49-49b9-9683-228d7d9ddcee tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.209"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:54:38.347596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bfbe8a93-5c49-49b9-9683-228d7d9ddcee tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 8d231092-f981-47fe-9994-6fcb031c8a83] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:38.366629 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bfbe8a93-5c49-49b9-9683-228d7d9ddcee tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:38.367008 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bfbe8a93-5c49-49b9-9683-228d7d9ddcee tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:38.367344 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bfbe8a93-5c49-49b9-9683-228d7d9ddcee tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:38.384644 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bfbe8a93-5c49-49b9-9683-228d7d9ddcee tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:38.385419 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bfbe8a93-5c49-49b9-9683-228d7d9ddcee tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:38.386071 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bfbe8a93-5c49-49b9-9683-228d7d9ddcee tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:38.451363 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bfbe8a93-5c49-49b9-9683-228d7d9ddcee tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "refresh_cache-8d231092-f981-47fe-9994-6fcb031c8a83" {{(pid=128776) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 10 11:54:38.452018 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bfbe8a93-5c49-49b9-9683-228d7d9ddcee tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquired lock "refresh_cache-8d231092-f981-47fe-9994-6fcb031c8a83" {{(pid=128776) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 10 11:54:38.900994 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7ec046dd-1a8e-4252-a8d2-23a00ba0df8a tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:38.964135 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7ec046dd-1a8e-4252-a8d2-23a00ba0df8a tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f" status: 200 len: 1313 microversion: 2.1 time: 0.873090 Sep 10 11:54:38.967248 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1754/3456] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:38 2022] GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f => generated 1313 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:39.346017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ee5657a2-3bde-49a5-80ca-423c1dcb2df8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:39.346783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ee5657a2-3bde-49a5-80ca-423c1dcb2df8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:39.360884 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee5657a2-3bde-49a5-80ca-423c1dcb2df8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:39.365542 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee5657a2-3bde-49a5-80ca-423c1dcb2df8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:39.366300 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee5657a2-3bde-49a5-80ca-423c1dcb2df8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:39.366995 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee5657a2-3bde-49a5-80ca-423c1dcb2df8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:39.367701 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee5657a2-3bde-49a5-80ca-423c1dcb2df8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:39.369271 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee5657a2-3bde-49a5-80ca-423c1dcb2df8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:39.910596 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ee5657a2-3bde-49a5-80ca-423c1dcb2df8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:39.945401 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ee5657a2-3bde-49a5-80ca-423c1dcb2df8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:39.952778 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ee5657a2-3bde-49a5-80ca-423c1dcb2df8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:39.963555 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ee5657a2-3bde-49a5-80ca-423c1dcb2df8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1808 microversion: 2.20 time: 0.621699 Sep 10 11:54:39.967915 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1755/3457] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:54:39 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1808 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:54:39.993479 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ca0e25cf-acb8-4453-be82-48f01451f23d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:39.994919 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ca0e25cf-acb8-4453-be82-48f01451f23d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 6f2872c7-ac86-4764-9db6-96eece78150f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:40.014249 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca0e25cf-acb8-4453-be82-48f01451f23d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:40.015768 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca0e25cf-acb8-4453-be82-48f01451f23d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:40.016768 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca0e25cf-acb8-4453-be82-48f01451f23d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:40.018253 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca0e25cf-acb8-4453-be82-48f01451f23d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:40.019533 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca0e25cf-acb8-4453-be82-48f01451f23d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:40.020561 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca0e25cf-acb8-4453-be82-48f01451f23d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:40.732043 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=4 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:54:40.760537 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:54:41.473038 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ca0e25cf-acb8-4453-be82-48f01451f23d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:41.481419 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ca0e25cf-acb8-4453-be82-48f01451f23d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f" status: 200 len: 1313 microversion: 2.1 time: 1.495239 Sep 10 11:54:41.500024 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1756/3458] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:39 2022] GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f => generated 1313 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:41.518093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b8db04ce-06e6-478b-b71a-5464828b837a tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1842833329", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "5f520529-aa75-4004-b922-3d29ebd9e053"}], "key_name": "tempest-TestNetworkBasicOps-11539708", "security_groups": [{"name": "tempest-secgroup-smoke-109325402"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:54:41.995634 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-b8db04ce-06e6-478b-b71a-5464828b837a tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] validate_networks() for [('5f520529-aa75-4004-b922-3d29ebd9e053', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:54:42.119582 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=8 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:54:44.366065 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-bfbe8a93-5c49-49b9-9683-228d7d9ddcee tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 8d231092-f981-47fe-9994-6fcb031c8a83] Building network info cache for instance {{(pid=128776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 10 11:54:44.422968 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-b8db04ce-06e6-478b-b71a-5464828b837a tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:54:44.424274 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-b8db04ce-06e6-478b-b71a-5464828b837a tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:54:44.425010 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-b8db04ce-06e6-478b-b71a-5464828b837a tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:54:44.425856 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-b8db04ce-06e6-478b-b71a-5464828b837a tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:54:44.426611 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-b8db04ce-06e6-478b-b71a-5464828b837a tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:54:44.442467 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b8db04ce-06e6-478b-b71a-5464828b837a tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:44.443420 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b8db04ce-06e6-478b-b71a-5464828b837a tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:44.444333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b8db04ce-06e6-478b-b71a-5464828b837a tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:44.449207 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b8db04ce-06e6-478b-b71a-5464828b837a tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:44.450348 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b8db04ce-06e6-478b-b71a-5464828b837a tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:44.451114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b8db04ce-06e6-478b-b71a-5464828b837a tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:44.518650 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-b8db04ce-06e6-478b-b71a-5464828b837a tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Getting quotas for project 20756c1a77fb44f684973f382b802825. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:54:44.528157 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-b8db04ce-06e6-478b-b71a-5464828b837a tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Getting quotas for user 92be647276cc456e83dacd25b98e37f2 and project 20756c1a77fb44f684973f382b802825. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:54:44.552706 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b8db04ce-06e6-478b-b71a-5464828b837a tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:54:44.554933 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b8db04ce-06e6-478b-b71a-5464828b837a tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: 70c46bf2-0367-499b-822a-e18923866289] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:54:44.641361 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b8db04ce-06e6-478b-b71a-5464828b837a tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.139290 Sep 10 11:54:44.649485 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1757/3459] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:54:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 3148 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:54:44.655848 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-efb297a9-8573-4652-b5e0-52dadeb53e11 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:44.656664 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-efb297a9-8573-4652-b5e0-52dadeb53e11 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:44.663220 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-efb297a9-8573-4652-b5e0-52dadeb53e11 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:44.663964 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-efb297a9-8573-4652-b5e0-52dadeb53e11 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:44.664700 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-efb297a9-8573-4652-b5e0-52dadeb53e11 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:44.666220 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-efb297a9-8573-4652-b5e0-52dadeb53e11 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:44.667064 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-efb297a9-8573-4652-b5e0-52dadeb53e11 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:44.668051 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-efb297a9-8573-4652-b5e0-52dadeb53e11 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:45.442265 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-efb297a9-8573-4652-b5e0-52dadeb53e11 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:45.479289 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-efb297a9-8573-4652-b5e0-52dadeb53e11 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:45.485956 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-efb297a9-8573-4652-b5e0-52dadeb53e11 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:45.494494 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-efb297a9-8573-4652-b5e0-52dadeb53e11 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1808 microversion: 2.20 time: 0.838685 Sep 10 11:54:45.495254 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1758/3460] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:54:44 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1808 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:54:45.523496 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0e638a7b-65c7-42fb-a5e9-f0f6ec0e282a tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:45.525113 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0e638a7b-65c7-42fb-a5e9-f0f6ec0e282a tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 6f2872c7-ac86-4764-9db6-96eece78150f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:45.551778 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e638a7b-65c7-42fb-a5e9-f0f6ec0e282a tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:45.552583 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e638a7b-65c7-42fb-a5e9-f0f6ec0e282a tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:45.553406 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e638a7b-65c7-42fb-a5e9-f0f6ec0e282a tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:45.564194 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e638a7b-65c7-42fb-a5e9-f0f6ec0e282a tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:45.566533 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e638a7b-65c7-42fb-a5e9-f0f6ec0e282a tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:45.567108 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e638a7b-65c7-42fb-a5e9-f0f6ec0e282a tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:46.185199 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0e638a7b-65c7-42fb-a5e9-f0f6ec0e282a tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:46.197462 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0e638a7b-65c7-42fb-a5e9-f0f6ec0e282a tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f" status: 200 len: 1355 microversion: 2.1 time: 0.698391 Sep 10 11:54:46.200116 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1759/3461] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:45 2022] GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f => generated 1355 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:46.635907 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-94e2ab02-2637-42f5-bab8-8e6597e75a6c tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1309507012", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:54:46.810951 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-94e2ab02-2637-42f5-bab8-8e6597e75a6c tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] validate_networks() for [('1fac80b7-ed82-4841-b3a7-f53280be67c1', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:54:48.064111 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-bfbe8a93-5c49-49b9-9683-228d7d9ddcee tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 8d231092-f981-47fe-9994-6fcb031c8a83] Updating instance_info_cache with network_info: [{"id": "8c8742ac-1c89-456c-9fd1-cc7ed178f4dd", "address": "fa:16:3e:ba:60:00", "network": {"id": "9f016ce0-94a4-441f-9715-493bd2b96018", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-332030758-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "093f44e4274f41c1882cf1a2167dc891", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8c8742ac-1c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 10 11:54:48.091876 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bfbe8a93-5c49-49b9-9683-228d7d9ddcee tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Releasing lock "refresh_cache-8d231092-f981-47fe-9994-6fcb031c8a83" {{(pid=128776) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 10 11:54:48.095156 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bfbe8a93-5c49-49b9-9683-228d7d9ddcee tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "POST /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83/action" status: 202 len: 0 microversion: 2.1 time: 9.770198 Sep 10 11:54:48.097132 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1703/3462] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:54:38 2022] POST /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83/action => generated 0 bytes in 9775 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 10 11:54:48.124952 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-47f9b486-1344-498c-b2b0-3002dca3b1e0 req-a2131aa6-1535-4fc2-bc08-53135260015f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d231092-f981-47fe-9994-6fcb031c8a83", "tag": "8c8742ac-1c89-456c-9fd1-cc7ed178f4dd"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:54:48.152477 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:54:48.156501 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-47f9b486-1344-498c-b2b0-3002dca3b1e0 req-a2131aa6-1535-4fc2-bc08-53135260015f service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:48.159244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-47f9b486-1344-498c-b2b0-3002dca3b1e0 req-a2131aa6-1535-4fc2-bc08-53135260015f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:48.159879 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-47f9b486-1344-498c-b2b0-3002dca3b1e0 req-a2131aa6-1535-4fc2-bc08-53135260015f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:48.202010 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-47f9b486-1344-498c-b2b0-3002dca3b1e0 req-a2131aa6-1535-4fc2-bc08-53135260015f service nova] Creating event network-changed:8c8742ac-1c89-456c-9fd1-cc7ed178f4dd for instance 8d231092-f981-47fe-9994-6fcb031c8a83 on n-h1-856895-1 Sep 10 11:54:48.227463 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-47f9b486-1344-498c-b2b0-3002dca3b1e0 req-a2131aa6-1535-4fc2-bc08-53135260015f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114123 Sep 10 11:54:48.230195 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1704/3463] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:54:48.248342 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c5b8c526-ddb1-49c2-a98c-1482dcf0b135 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:48.253251 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c5b8c526-ddb1-49c2-a98c-1482dcf0b135 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: 70c46bf2-0367-499b-822a-e18923866289] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:48.270999 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c5b8c526-ddb1-49c2-a98c-1482dcf0b135 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:48.274004 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c5b8c526-ddb1-49c2-a98c-1482dcf0b135 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:48.274473 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c5b8c526-ddb1-49c2-a98c-1482dcf0b135 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:48.275352 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c5b8c526-ddb1-49c2-a98c-1482dcf0b135 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:48.275851 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c5b8c526-ddb1-49c2-a98c-1482dcf0b135 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:48.276136 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c5b8c526-ddb1-49c2-a98c-1482dcf0b135 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:48.511754 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c5b8c526-ddb1-49c2-a98c-1482dcf0b135 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be647276cc456e83dacd25b98e37f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20756c1a77fb44f684973f382b802825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:48.524828 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c5b8c526-ddb1-49c2-a98c-1482dcf0b135 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/70c46bf2-0367-499b-822a-e18923866289" status: 200 len: 1305 microversion: 2.1 time: 0.290455 Sep 10 11:54:48.531255 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1705/3464] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:48 2022] GET /compute/v2.1/servers/70c46bf2-0367-499b-822a-e18923866289 => generated 1305 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:48.531255 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3b415cdd-4968-43b0-8a39-f3af2e43f221 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:48.531255 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3b415cdd-4968-43b0-8a39-f3af2e43f221 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:48.554747 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3b415cdd-4968-43b0-8a39-f3af2e43f221 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:48.555272 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3b415cdd-4968-43b0-8a39-f3af2e43f221 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:48.555718 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3b415cdd-4968-43b0-8a39-f3af2e43f221 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:48.556434 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3b415cdd-4968-43b0-8a39-f3af2e43f221 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:48.556894 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3b415cdd-4968-43b0-8a39-f3af2e43f221 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:48.557327 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3b415cdd-4968-43b0-8a39-f3af2e43f221 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:49.117903 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3b415cdd-4968-43b0-8a39-f3af2e43f221 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:49.144482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3b415cdd-4968-43b0-8a39-f3af2e43f221 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:49.147034 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3b415cdd-4968-43b0-8a39-f3af2e43f221 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:49.150708 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3b415cdd-4968-43b0-8a39-f3af2e43f221 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1808 microversion: 2.20 time: 0.623912 Sep 10 11:54:49.152615 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1706/3465] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:54:48 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1808 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:54:49.167354 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8a65cc16-8e8c-42cf-99cf-51359407660f tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:49.167975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8a65cc16-8e8c-42cf-99cf-51359407660f tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 6f2872c7-ac86-4764-9db6-96eece78150f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:49.178822 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a65cc16-8e8c-42cf-99cf-51359407660f tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:49.179424 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a65cc16-8e8c-42cf-99cf-51359407660f tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:49.179766 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a65cc16-8e8c-42cf-99cf-51359407660f tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:49.180468 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a65cc16-8e8c-42cf-99cf-51359407660f tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:49.180921 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a65cc16-8e8c-42cf-99cf-51359407660f tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:49.181343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a65cc16-8e8c-42cf-99cf-51359407660f tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:49.410205 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-94e2ab02-2637-42f5-bab8-8e6597e75a6c tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:54:49.411326 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-94e2ab02-2637-42f5-bab8-8e6597e75a6c tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:54:49.412139 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-94e2ab02-2637-42f5-bab8-8e6597e75a6c tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:54:49.412774 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-94e2ab02-2637-42f5-bab8-8e6597e75a6c tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:54:49.413513 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-94e2ab02-2637-42f5-bab8-8e6597e75a6c tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:54:49.429721 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94e2ab02-2637-42f5-bab8-8e6597e75a6c tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:49.431048 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94e2ab02-2637-42f5-bab8-8e6597e75a6c tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:49.431915 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94e2ab02-2637-42f5-bab8-8e6597e75a6c tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:49.432917 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94e2ab02-2637-42f5-bab8-8e6597e75a6c tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:49.433707 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94e2ab02-2637-42f5-bab8-8e6597e75a6c tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:49.439298 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94e2ab02-2637-42f5-bab8-8e6597e75a6c tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:49.470925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-94e2ab02-2637-42f5-bab8-8e6597e75a6c tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Getting quotas for project 8e8bc2c6ea1946bfbbf47d63b5fa4648. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:54:49.478714 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-94e2ab02-2637-42f5-bab8-8e6597e75a6c tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Getting quotas for user bddddbd6718f472e951fd87a6ec00f8d and project 8e8bc2c6ea1946bfbbf47d63b5fa4648. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:54:49.510111 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-94e2ab02-2637-42f5-bab8-8e6597e75a6c tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:54:49.516559 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-94e2ab02-2637-42f5-bab8-8e6597e75a6c tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 51d91016-0b23-4d74-98b4-1c76652aacb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:54:49.634225 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-94e2ab02-2637-42f5-bab8-8e6597e75a6c tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.430387 Sep 10 11:54:49.634962 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1760/3466] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:54:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 3433 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:54:49.675468 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b237b271-1396-49ff-8c99-3709a1367187 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.209"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:54:49.683687 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b237b271-1396-49ff-8c99-3709a1367187 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 43e1acba-4c0e-4f89-8d03-e9dcb388c1ef] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:49.703248 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b237b271-1396-49ff-8c99-3709a1367187 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:49.703808 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b237b271-1396-49ff-8c99-3709a1367187 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:49.704262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b237b271-1396-49ff-8c99-3709a1367187 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:49.704984 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b237b271-1396-49ff-8c99-3709a1367187 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:49.705738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b237b271-1396-49ff-8c99-3709a1367187 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:49.709603 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b237b271-1396-49ff-8c99-3709a1367187 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:49.717882 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:54:49.753388 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b237b271-1396-49ff-8c99-3709a1367187 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "refresh_cache-43e1acba-4c0e-4f89-8d03-e9dcb388c1ef" {{(pid=128777) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 10 11:54:49.754147 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b237b271-1396-49ff-8c99-3709a1367187 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquired lock "refresh_cache-43e1acba-4c0e-4f89-8d03-e9dcb388c1ef" {{(pid=128777) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 10 11:54:50.510926 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8a65cc16-8e8c-42cf-99cf-51359407660f tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:50.515311 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:54:50.527831 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8a65cc16-8e8c-42cf-99cf-51359407660f tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f" status: 200 len: 1355 microversion: 2.1 time: 1.372849 Sep 10 11:54:50.529076 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1707/3467] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:49 2022] GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f => generated 1355 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:50.534678 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b9b989e1-fe0f-4ff0-98a2-b128048bbef4 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:50.535725 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b9b989e1-fe0f-4ff0-98a2-b128048bbef4 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: 70c46bf2-0367-499b-822a-e18923866289] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:50.581060 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9b989e1-fe0f-4ff0-98a2-b128048bbef4 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:50.582301 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9b989e1-fe0f-4ff0-98a2-b128048bbef4 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:50.582829 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9b989e1-fe0f-4ff0-98a2-b128048bbef4 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:50.583669 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9b989e1-fe0f-4ff0-98a2-b128048bbef4 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:50.584169 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9b989e1-fe0f-4ff0-98a2-b128048bbef4 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:50.584763 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9b989e1-fe0f-4ff0-98a2-b128048bbef4 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:51.111304 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b9b989e1-fe0f-4ff0-98a2-b128048bbef4 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be647276cc456e83dacd25b98e37f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20756c1a77fb44f684973f382b802825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:51.127473 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b9b989e1-fe0f-4ff0-98a2-b128048bbef4 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/70c46bf2-0367-499b-822a-e18923866289" status: 200 len: 1372 microversion: 2.1 time: 0.596622 Sep 10 11:54:51.131308 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1708/3468] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:50 2022] GET /compute/v2.1/servers/70c46bf2-0367-499b-822a-e18923866289 => generated 1372 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:51.143967 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6886b7bf-30ed-41ef-9928-fbc89462af3e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:51.144994 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6886b7bf-30ed-41ef-9928-fbc89462af3e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 51d91016-0b23-4d74-98b4-1c76652aacb5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:51.199498 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6886b7bf-30ed-41ef-9928-fbc89462af3e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:51.205073 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6886b7bf-30ed-41ef-9928-fbc89462af3e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:51.205741 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6886b7bf-30ed-41ef-9928-fbc89462af3e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:51.207820 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6886b7bf-30ed-41ef-9928-fbc89462af3e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:51.209597 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6886b7bf-30ed-41ef-9928-fbc89462af3e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:51.211271 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6886b7bf-30ed-41ef-9928-fbc89462af3e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:51.400809 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6886b7bf-30ed-41ef-9928-fbc89462af3e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:51.426415 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6886b7bf-30ed-41ef-9928-fbc89462af3e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5" status: 200 len: 1274 microversion: 2.1 time: 0.291284 Sep 10 11:54:51.428433 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1709/3469] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:51 2022] GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5 => generated 1274 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:51.436204 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-9f25e5a8-8436-43c3-a6cc-5c76b40eaa37 req-f91127dd-356e-4b25-b497-b90e8165b723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61ab78c6-917d-46d1-b3e2-9935ca45c8e2", "name": "network-vif-plugged", "status": "completed", "tag": "998df393-88c6-4f53-8cdf-ce9cb6efbc62"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:54:51.520039 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-9f25e5a8-8436-43c3-a6cc-5c76b40eaa37 req-f91127dd-356e-4b25-b497-b90e8165b723 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:51.522267 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-9f25e5a8-8436-43c3-a6cc-5c76b40eaa37 req-f91127dd-356e-4b25-b497-b90e8165b723 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:51.525450 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-9f25e5a8-8436-43c3-a6cc-5c76b40eaa37 req-f91127dd-356e-4b25-b497-b90e8165b723 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:51.580157 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-9f25e5a8-8436-43c3-a6cc-5c76b40eaa37 req-f91127dd-356e-4b25-b497-b90e8165b723 service nova] Creating event network-vif-plugged:998df393-88c6-4f53-8cdf-ce9cb6efbc62 for instance 61ab78c6-917d-46d1-b3e2-9935ca45c8e2 on n-h2-856895-1 Sep 10 11:54:51.594662 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-9f25e5a8-8436-43c3-a6cc-5c76b40eaa37 req-f91127dd-356e-4b25-b497-b90e8165b723 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160592 Sep 10 11:54:51.596225 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1710/3470] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:54:51.616039 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8a41cec7-d623-4f09-b477-bad452bf4fdb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:51.620643 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8a41cec7-d623-4f09-b477-bad452bf4fdb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:51.639519 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a41cec7-d623-4f09-b477-bad452bf4fdb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:51.642887 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a41cec7-d623-4f09-b477-bad452bf4fdb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:51.646303 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a41cec7-d623-4f09-b477-bad452bf4fdb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:51.647318 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a41cec7-d623-4f09-b477-bad452bf4fdb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:51.649136 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a41cec7-d623-4f09-b477-bad452bf4fdb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:51.651012 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a41cec7-d623-4f09-b477-bad452bf4fdb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:52.274570 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8a41cec7-d623-4f09-b477-bad452bf4fdb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:52.291699 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8a41cec7-d623-4f09-b477-bad452bf4fdb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:52.298660 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8a41cec7-d623-4f09-b477-bad452bf4fdb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:52.301921 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8a41cec7-d623-4f09-b477-bad452bf4fdb tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1808 microversion: 2.20 time: 0.700975 Sep 10 11:54:52.306940 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1711/3471] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:54:51 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1808 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:54:52.318197 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-f50b6ef2-6e19-434e-a9b9-0f7fe6aa4f47 req-185b6223-1622-4021-b7ea-2347c6cd22ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f2872c7-ac86-4764-9db6-96eece78150f", "tag": "274b11cc-1af8-42d8-8bfd-b3d105469cd7"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:54:52.351428 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f50b6ef2-6e19-434e-a9b9-0f7fe6aa4f47 req-185b6223-1622-4021-b7ea-2347c6cd22ea service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:52.352407 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f50b6ef2-6e19-434e-a9b9-0f7fe6aa4f47 req-185b6223-1622-4021-b7ea-2347c6cd22ea service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:52.357346 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f50b6ef2-6e19-434e-a9b9-0f7fe6aa4f47 req-185b6223-1622-4021-b7ea-2347c6cd22ea service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:52.394687 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-f50b6ef2-6e19-434e-a9b9-0f7fe6aa4f47 req-185b6223-1622-4021-b7ea-2347c6cd22ea service nova] Creating event network-changed:274b11cc-1af8-42d8-8bfd-b3d105469cd7 for instance 6f2872c7-ac86-4764-9db6-96eece78150f on n-h1-856895-1 Sep 10 11:54:52.410098 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-f50b6ef2-6e19-434e-a9b9-0f7fe6aa4f47 req-185b6223-1622-4021-b7ea-2347c6cd22ea service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101244 Sep 10 11:54:52.411437 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1712/3472] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:54:52.422875 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-faadb95d-7913-43f9-95a1-594c77978243 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:52.427800 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-faadb95d-7913-43f9-95a1-594c77978243 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 6f2872c7-ac86-4764-9db6-96eece78150f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:52.440852 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-faadb95d-7913-43f9-95a1-594c77978243 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:52.441445 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-faadb95d-7913-43f9-95a1-594c77978243 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:52.442363 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-faadb95d-7913-43f9-95a1-594c77978243 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:52.453522 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-faadb95d-7913-43f9-95a1-594c77978243 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:52.454436 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-faadb95d-7913-43f9-95a1-594c77978243 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:52.455280 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-faadb95d-7913-43f9-95a1-594c77978243 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:53.151047 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-faadb95d-7913-43f9-95a1-594c77978243 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:53.169621 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-faadb95d-7913-43f9-95a1-594c77978243 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f" status: 200 len: 1355 microversion: 2.1 time: 0.756159 Sep 10 11:54:53.178554 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1713/3473] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:52 2022] GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f => generated 1355 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:53.212587 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-de5f2841-bcc8-47ec-9c15-2f2a21b5f5fe req-8c22b782-4d29-44f7-9197-8985ae329a49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70c46bf2-0367-499b-822a-e18923866289", "tag": "4f477cca-0fac-4e49-8748-690968026f45"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:54:53.254544 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-de5f2841-bcc8-47ec-9c15-2f2a21b5f5fe req-8c22b782-4d29-44f7-9197-8985ae329a49 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:53.258703 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-de5f2841-bcc8-47ec-9c15-2f2a21b5f5fe req-8c22b782-4d29-44f7-9197-8985ae329a49 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:53.259938 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-de5f2841-bcc8-47ec-9c15-2f2a21b5f5fe req-8c22b782-4d29-44f7-9197-8985ae329a49 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:53.332704 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-de5f2841-bcc8-47ec-9c15-2f2a21b5f5fe req-8c22b782-4d29-44f7-9197-8985ae329a49 service nova] Creating event network-changed:4f477cca-0fac-4e49-8748-690968026f45 for instance 70c46bf2-0367-499b-822a-e18923866289 on n-h2-856895-1 Sep 10 11:54:53.348541 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-de5f2841-bcc8-47ec-9c15-2f2a21b5f5fe req-8c22b782-4d29-44f7-9197-8985ae329a49 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167939 Sep 10 11:54:53.354104 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1714/3474] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:54:53.375126 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-85a881ac-149b-4289-abcc-05a1fd04bb89 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1238919351", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:54:53.527083 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-85a881ac-149b-4289-abcc-05a1fd04bb89 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] validate_networks() for [('1fac80b7-ed82-4841-b3a7-f53280be67c1', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:54:55.333374 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-85a881ac-149b-4289-abcc-05a1fd04bb89 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:54:55.334680 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-85a881ac-149b-4289-abcc-05a1fd04bb89 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:54:55.335589 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-85a881ac-149b-4289-abcc-05a1fd04bb89 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:54:55.336835 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-85a881ac-149b-4289-abcc-05a1fd04bb89 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:54:55.337607 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-85a881ac-149b-4289-abcc-05a1fd04bb89 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:54:55.366609 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85a881ac-149b-4289-abcc-05a1fd04bb89 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:55.367705 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85a881ac-149b-4289-abcc-05a1fd04bb89 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:55.370384 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85a881ac-149b-4289-abcc-05a1fd04bb89 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:55.374142 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85a881ac-149b-4289-abcc-05a1fd04bb89 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:55.375062 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85a881ac-149b-4289-abcc-05a1fd04bb89 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:55.375771 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85a881ac-149b-4289-abcc-05a1fd04bb89 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:55.406329 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-85a881ac-149b-4289-abcc-05a1fd04bb89 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Getting quotas for project 8e8bc2c6ea1946bfbbf47d63b5fa4648. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:54:55.414626 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-85a881ac-149b-4289-abcc-05a1fd04bb89 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Getting quotas for user bddddbd6718f472e951fd87a6ec00f8d and project 8e8bc2c6ea1946bfbbf47d63b5fa4648. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:54:55.438905 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-85a881ac-149b-4289-abcc-05a1fd04bb89 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:54:55.443615 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-85a881ac-149b-4289-abcc-05a1fd04bb89 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:54:55.624541 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-85a881ac-149b-4289-abcc-05a1fd04bb89 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.268968 Sep 10 11:54:55.627131 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1715/3475] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:54:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 2272 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:54:55.635416 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bd474add-b55c-4efe-80f3-630d4dfc0c89 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:55.638442 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bd474add-b55c-4efe-80f3-630d4dfc0c89 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: 70c46bf2-0367-499b-822a-e18923866289] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:55.663786 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd474add-b55c-4efe-80f3-630d4dfc0c89 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:55.664292 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd474add-b55c-4efe-80f3-630d4dfc0c89 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:55.664740 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd474add-b55c-4efe-80f3-630d4dfc0c89 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:55.669757 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd474add-b55c-4efe-80f3-630d4dfc0c89 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:55.670269 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd474add-b55c-4efe-80f3-630d4dfc0c89 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:55.670718 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd474add-b55c-4efe-80f3-630d4dfc0c89 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:56.157716 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bd474add-b55c-4efe-80f3-630d4dfc0c89 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be647276cc456e83dacd25b98e37f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20756c1a77fb44f684973f382b802825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:56.179665 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bd474add-b55c-4efe-80f3-630d4dfc0c89 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/70c46bf2-0367-499b-822a-e18923866289" status: 200 len: 1372 microversion: 2.1 time: 0.551148 Sep 10 11:54:56.184574 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1716/3476] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:55 2022] GET /compute/v2.1/servers/70c46bf2-0367-499b-822a-e18923866289 => generated 1372 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:56.208789 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0e0047f4-a1e0-4ab0-9ce3-1bc10100ce82 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:56.211858 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0e0047f4-a1e0-4ab0-9ce3-1bc10100ce82 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:56.227578 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e0047f4-a1e0-4ab0-9ce3-1bc10100ce82 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:56.229304 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e0047f4-a1e0-4ab0-9ce3-1bc10100ce82 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:56.236916 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e0047f4-a1e0-4ab0-9ce3-1bc10100ce82 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:56.237979 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e0047f4-a1e0-4ab0-9ce3-1bc10100ce82 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:56.238955 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e0047f4-a1e0-4ab0-9ce3-1bc10100ce82 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:56.239713 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e0047f4-a1e0-4ab0-9ce3-1bc10100ce82 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:56.647475 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.network.neutron [None req-b237b271-1396-49ff-8c99-3709a1367187 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 43e1acba-4c0e-4f89-8d03-e9dcb388c1ef] re-assign floating IP 172.25.5.209 from instance 8d231092-f981-47fe-9994-6fcb031c8a83 Sep 10 11:54:56.722780 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-b237b271-1396-49ff-8c99-3709a1367187 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 8d231092-f981-47fe-9994-6fcb031c8a83] Building network info cache for instance {{(pid=128777) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 10 11:54:56.775745 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0e0047f4-a1e0-4ab0-9ce3-1bc10100ce82 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:56.787304 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0e0047f4-a1e0-4ab0-9ce3-1bc10100ce82 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:56.797914 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0e0047f4-a1e0-4ab0-9ce3-1bc10100ce82 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:56.799742 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0e0047f4-a1e0-4ab0-9ce3-1bc10100ce82 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1795 microversion: 2.20 time: 0.612138 Sep 10 11:54:56.804661 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1717/3477] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:54:56 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1795 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:54:56.814043 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e0b5cb4d-3310-4994-b0c1-05a7ad00182d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:56.818624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e0b5cb4d-3310-4994-b0c1-05a7ad00182d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 6f2872c7-ac86-4764-9db6-96eece78150f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:56.838220 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e0b5cb4d-3310-4994-b0c1-05a7ad00182d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:56.838948 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e0b5cb4d-3310-4994-b0c1-05a7ad00182d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:56.839512 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e0b5cb4d-3310-4994-b0c1-05a7ad00182d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:56.840493 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e0b5cb4d-3310-4994-b0c1-05a7ad00182d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:56.841727 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e0b5cb4d-3310-4994-b0c1-05a7ad00182d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:56.842513 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e0b5cb4d-3310-4994-b0c1-05a7ad00182d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:57.382408 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e0b5cb4d-3310-4994-b0c1-05a7ad00182d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:57.392891 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e0b5cb4d-3310-4994-b0c1-05a7ad00182d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f" status: 200 len: 1355 microversion: 2.1 time: 0.586703 Sep 10 11:54:57.400003 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1718/3478] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:56 2022] GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f => generated 1355 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:57.406793 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-c888109d-5411-4c20-8ef4-cf150a09486d req-8571a7d6-d177-4a93-8b4d-5c9a2a39b955 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f2872c7-ac86-4764-9db6-96eece78150f", "tag": "d6f5febb-95cd-42ed-8a3f-6d78c2e14ad9"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:54:57.425159 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-c888109d-5411-4c20-8ef4-cf150a09486d req-8571a7d6-d177-4a93-8b4d-5c9a2a39b955 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:57.425907 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-c888109d-5411-4c20-8ef4-cf150a09486d req-8571a7d6-d177-4a93-8b4d-5c9a2a39b955 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:57.426507 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-c888109d-5411-4c20-8ef4-cf150a09486d req-8571a7d6-d177-4a93-8b4d-5c9a2a39b955 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:57.461006 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-c888109d-5411-4c20-8ef4-cf150a09486d req-8571a7d6-d177-4a93-8b4d-5c9a2a39b955 service nova] Creating event network-changed:d6f5febb-95cd-42ed-8a3f-6d78c2e14ad9 for instance 6f2872c7-ac86-4764-9db6-96eece78150f on n-h1-856895-1 Sep 10 11:54:57.467800 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-c888109d-5411-4c20-8ef4-cf150a09486d req-8571a7d6-d177-4a93-8b4d-5c9a2a39b955 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065878 Sep 10 11:54:57.468634 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1719/3479] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:54:57.474679 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cfd3539b-f0bd-4d15-b236-d20198ae1f9f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:57.475671 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cfd3539b-f0bd-4d15-b236-d20198ae1f9f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:57.484126 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cfd3539b-f0bd-4d15-b236-d20198ae1f9f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:57.484804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cfd3539b-f0bd-4d15-b236-d20198ae1f9f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:57.485421 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cfd3539b-f0bd-4d15-b236-d20198ae1f9f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:57.486665 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cfd3539b-f0bd-4d15-b236-d20198ae1f9f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:57.487337 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cfd3539b-f0bd-4d15-b236-d20198ae1f9f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:57.487938 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cfd3539b-f0bd-4d15-b236-d20198ae1f9f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:57.667655 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-cfd3539b-f0bd-4d15-b236-d20198ae1f9f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:57.691848 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cfd3539b-f0bd-4d15-b236-d20198ae1f9f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180" status: 200 len: 1282 microversion: 2.1 time: 0.222179 Sep 10 11:54:57.695841 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1720/3480] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:57 2022] GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180 => generated 1282 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:57.716643 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-0ef2e014-1734-444e-8376-97fa37b50f29 req-7b431722-2ba7-4538-a428-155d91181f4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51d91016-0b23-4d74-98b4-1c76652aacb5", "tag": "9844db02-76f7-4542-ae21-8ec4bede55f6"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:54:57.759202 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-0ef2e014-1734-444e-8376-97fa37b50f29 req-7b431722-2ba7-4538-a428-155d91181f4a service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:57.760000 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-0ef2e014-1734-444e-8376-97fa37b50f29 req-7b431722-2ba7-4538-a428-155d91181f4a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:57.762687 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-0ef2e014-1734-444e-8376-97fa37b50f29 req-7b431722-2ba7-4538-a428-155d91181f4a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:57.796095 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-0ef2e014-1734-444e-8376-97fa37b50f29 req-7b431722-2ba7-4538-a428-155d91181f4a service nova] Creating event network-changed:9844db02-76f7-4542-ae21-8ec4bede55f6 for instance 51d91016-0b23-4d74-98b4-1c76652aacb5 on n-h1-856895-1 Sep 10 11:54:57.804993 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-0ef2e014-1734-444e-8376-97fa37b50f29 req-7b431722-2ba7-4538-a428-155d91181f4a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105197 Sep 10 11:54:57.807529 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1721/3481] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:54:57.814019 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-614dafbf-1080-4c63-afe9-83fedcb728b1 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:57.814774 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-614dafbf-1080-4c63-afe9-83fedcb728b1 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: 70c46bf2-0367-499b-822a-e18923866289] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:57.835340 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-614dafbf-1080-4c63-afe9-83fedcb728b1 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:57.835676 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-614dafbf-1080-4c63-afe9-83fedcb728b1 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:57.836189 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-614dafbf-1080-4c63-afe9-83fedcb728b1 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:57.836905 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-614dafbf-1080-4c63-afe9-83fedcb728b1 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:57.837359 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-614dafbf-1080-4c63-afe9-83fedcb728b1 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:57.837791 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-614dafbf-1080-4c63-afe9-83fedcb728b1 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:58.375347 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-614dafbf-1080-4c63-afe9-83fedcb728b1 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be647276cc456e83dacd25b98e37f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20756c1a77fb44f684973f382b802825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:58.385261 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-614dafbf-1080-4c63-afe9-83fedcb728b1 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/70c46bf2-0367-499b-822a-e18923866289" status: 200 len: 1372 microversion: 2.1 time: 0.575835 Sep 10 11:54:58.403775 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1722/3482] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:57 2022] GET /compute/v2.1/servers/70c46bf2-0367-499b-822a-e18923866289 => generated 1372 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:58.419597 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9570371a-f1af-4f63-a8cf-a94a1acfc955 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:58.420837 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9570371a-f1af-4f63-a8cf-a94a1acfc955 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 6f2872c7-ac86-4764-9db6-96eece78150f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:58.434246 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9570371a-f1af-4f63-a8cf-a94a1acfc955 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:58.435748 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9570371a-f1af-4f63-a8cf-a94a1acfc955 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:58.436394 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9570371a-f1af-4f63-a8cf-a94a1acfc955 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:58.437393 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9570371a-f1af-4f63-a8cf-a94a1acfc955 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:58.438570 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9570371a-f1af-4f63-a8cf-a94a1acfc955 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:58.439272 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9570371a-f1af-4f63-a8cf-a94a1acfc955 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:59.084949 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-b237b271-1396-49ff-8c99-3709a1367187 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 8d231092-f981-47fe-9994-6fcb031c8a83] Updating instance_info_cache with network_info: [{"id": "8c8742ac-1c89-456c-9fd1-cc7ed178f4dd", "address": "fa:16:3e:ba:60:00", "network": {"id": "9f016ce0-94a4-441f-9715-493bd2b96018", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-332030758-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "093f44e4274f41c1882cf1a2167dc891", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8c8742ac-1c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128777) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 10 11:54:59.099289 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-b237b271-1396-49ff-8c99-3709a1367187 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 43e1acba-4c0e-4f89-8d03-e9dcb388c1ef] Building network info cache for instance {{(pid=128777) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 10 11:54:59.271432 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9570371a-f1af-4f63-a8cf-a94a1acfc955 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:59.288162 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9570371a-f1af-4f63-a8cf-a94a1acfc955 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f" status: 200 len: 1355 microversion: 2.1 time: 0.874336 Sep 10 11:54:59.288761 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1723/3483] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:58 2022] GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f => generated 1355 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:59.293484 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8812178b-d052-431b-a1fb-71ab603adddf tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:59.294692 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8812178b-d052-431b-a1fb-71ab603adddf tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:59.308923 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8812178b-d052-431b-a1fb-71ab603adddf tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:59.309719 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8812178b-d052-431b-a1fb-71ab603adddf tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:59.315888 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8812178b-d052-431b-a1fb-71ab603adddf tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:59.316858 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8812178b-d052-431b-a1fb-71ab603adddf tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:59.317494 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8812178b-d052-431b-a1fb-71ab603adddf tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:59.318096 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8812178b-d052-431b-a1fb-71ab603adddf tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:59.454202 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=4 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:54:59.466971 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8812178b-d052-431b-a1fb-71ab603adddf tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:59.483292 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8812178b-d052-431b-a1fb-71ab603adddf tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180" status: 200 len: 1280 microversion: 2.1 time: 0.193046 Sep 10 11:54:59.484347 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1724/3484] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:59 2022] GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180 => generated 1280 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:59.499685 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=12 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:54:59.501448 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-8bac6638-de9b-46a5-bc00-612f6f478e5e req-8fbdccee-e38f-4c27-92e1-64144a139559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c46bf2-0367-499b-822a-e18923866289", "name": "network-vif-plugged", "status": "completed", "tag": "4f477cca-0fac-4e49-8748-690968026f45"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:54:59.517440 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-8bac6638-de9b-46a5-bc00-612f6f478e5e req-8fbdccee-e38f-4c27-92e1-64144a139559 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:59.518693 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-8bac6638-de9b-46a5-bc00-612f6f478e5e req-8fbdccee-e38f-4c27-92e1-64144a139559 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:59.519388 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-8bac6638-de9b-46a5-bc00-612f6f478e5e req-8fbdccee-e38f-4c27-92e1-64144a139559 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:59.543881 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-8bac6638-de9b-46a5-bc00-612f6f478e5e req-8fbdccee-e38f-4c27-92e1-64144a139559 service nova] Creating event network-vif-plugged:4f477cca-0fac-4e49-8748-690968026f45 for instance 70c46bf2-0367-499b-822a-e18923866289 on n-h2-856895-1 Sep 10 11:54:59.550294 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-8bac6638-de9b-46a5-bc00-612f6f478e5e req-8fbdccee-e38f-4c27-92e1-64144a139559 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061835 Sep 10 11:54:59.551050 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1725/3485] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:54:59.557789 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3e8afdb6-ba15-42d9-8b52-5f3ca09919cd tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:54:59.559105 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3e8afdb6-ba15-42d9-8b52-5f3ca09919cd tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: 70c46bf2-0367-499b-822a-e18923866289] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:54:59.592760 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3e8afdb6-ba15-42d9-8b52-5f3ca09919cd tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:59.593569 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3e8afdb6-ba15-42d9-8b52-5f3ca09919cd tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:59.594030 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3e8afdb6-ba15-42d9-8b52-5f3ca09919cd tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:59.594750 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3e8afdb6-ba15-42d9-8b52-5f3ca09919cd tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:59.595229 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3e8afdb6-ba15-42d9-8b52-5f3ca09919cd tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:59.598051 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3e8afdb6-ba15-42d9-8b52-5f3ca09919cd tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:59.694500 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=9 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:54:59.887485 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3e8afdb6-ba15-42d9-8b52-5f3ca09919cd tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be647276cc456e83dacd25b98e37f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20756c1a77fb44f684973f382b802825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:54:59.908058 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3e8afdb6-ba15-42d9-8b52-5f3ca09919cd tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/70c46bf2-0367-499b-822a-e18923866289" status: 200 len: 1372 microversion: 2.1 time: 0.350668 Sep 10 11:54:59.909862 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1726/3486] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:54:59 2022] GET /compute/v2.1/servers/70c46bf2-0367-499b-822a-e18923866289 => generated 1372 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:54:59.914983 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-a77c1563-7387-48a3-8ae5-d0fcf5936fff req-bc8afe3a-5da5-4bdd-8e1d-b0e1cd638269 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d231092-f981-47fe-9994-6fcb031c8a83", "tag": "8c8742ac-1c89-456c-9fd1-cc7ed178f4dd"}, {"name": "network-changed", "server_uuid": "43e1acba-4c0e-4f89-8d03-e9dcb388c1ef", "tag": "12dbd5b4-0a1e-43b6-b783-06fe70dd1b54"}, {"name": "network-changed", "server_uuid": "6f2872c7-ac86-4764-9db6-96eece78150f", "tag": "68d1b2dc-eb73-4a5b-913e-098bd9786d52"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:54:59.928719 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a77c1563-7387-48a3-8ae5-d0fcf5936fff req-bc8afe3a-5da5-4bdd-8e1d-b0e1cd638269 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:54:59.929521 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a77c1563-7387-48a3-8ae5-d0fcf5936fff req-bc8afe3a-5da5-4bdd-8e1d-b0e1cd638269 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:54:59.930068 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a77c1563-7387-48a3-8ae5-d0fcf5936fff req-bc8afe3a-5da5-4bdd-8e1d-b0e1cd638269 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:54:59.947246 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-a77c1563-7387-48a3-8ae5-d0fcf5936fff req-bc8afe3a-5da5-4bdd-8e1d-b0e1cd638269 service nova] Creating event network-changed:8c8742ac-1c89-456c-9fd1-cc7ed178f4dd for instance 8d231092-f981-47fe-9994-6fcb031c8a83 on n-h1-856895-1 Sep 10 11:54:59.948867 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-a77c1563-7387-48a3-8ae5-d0fcf5936fff req-bc8afe3a-5da5-4bdd-8e1d-b0e1cd638269 service nova] Creating event network-changed:12dbd5b4-0a1e-43b6-b783-06fe70dd1b54 for instance 43e1acba-4c0e-4f89-8d03-e9dcb388c1ef on n-h2-856895-1 Sep 10 11:54:59.951356 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-a77c1563-7387-48a3-8ae5-d0fcf5936fff req-bc8afe3a-5da5-4bdd-8e1d-b0e1cd638269 service nova] Creating event network-changed:68d1b2dc-eb73-4a5b-913e-098bd9786d52 for instance 6f2872c7-ac86-4764-9db6-96eece78150f on n-h1-856895-1 Sep 10 11:54:59.964879 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-a77c1563-7387-48a3-8ae5-d0fcf5936fff req-bc8afe3a-5da5-4bdd-8e1d-b0e1cd638269 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.053360 Sep 10 11:54:59.968356 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1727/3487] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:55:00.198597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-b237b271-1396-49ff-8c99-3709a1367187 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 43e1acba-4c0e-4f89-8d03-e9dcb388c1ef] Updating instance_info_cache with network_info: [{"id": "12dbd5b4-0a1e-43b6-b783-06fe70dd1b54", "address": "fa:16:3e:fb:7a:c5", "network": {"id": "9f016ce0-94a4-441f-9715-493bd2b96018", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-332030758-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "093f44e4274f41c1882cf1a2167dc891", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap12dbd5b4-0a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128777) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 10 11:55:00.219304 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b237b271-1396-49ff-8c99-3709a1367187 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Releasing lock "refresh_cache-43e1acba-4c0e-4f89-8d03-e9dcb388c1ef" {{(pid=128777) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 10 11:55:00.221126 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b237b271-1396-49ff-8c99-3709a1367187 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "POST /compute/v2.1/servers/43e1acba-4c0e-4f89-8d03-e9dcb388c1ef/action" status: 202 len: 0 microversion: 2.1 time: 10.573923 Sep 10 11:55:00.222186 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1761/3488] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:54:49 2022] POST /compute/v2.1/servers/43e1acba-4c0e-4f89-8d03-e9dcb388c1ef/action => generated 0 bytes in 10576 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 10 11:55:00.248907 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-662dd071-65eb-4579-bac7-486d85727bed tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.209"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:00.328738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3be946da-ef63-4c89-abec-82604a78c9c1 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:00.330955 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3be946da-ef63-4c89-abec-82604a78c9c1 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 6f2872c7-ac86-4764-9db6-96eece78150f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:00.353950 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3be946da-ef63-4c89-abec-82604a78c9c1 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:00.355426 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3be946da-ef63-4c89-abec-82604a78c9c1 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:00.356260 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3be946da-ef63-4c89-abec-82604a78c9c1 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:00.358560 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3be946da-ef63-4c89-abec-82604a78c9c1 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:00.359259 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3be946da-ef63-4c89-abec-82604a78c9c1 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:00.359758 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3be946da-ef63-4c89-abec-82604a78c9c1 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:00.609762 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-662dd071-65eb-4579-bac7-486d85727bed tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 43e1acba-4c0e-4f89-8d03-e9dcb388c1ef] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:00.617944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-662dd071-65eb-4579-bac7-486d85727bed tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:00.618423 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-662dd071-65eb-4579-bac7-486d85727bed tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:00.618865 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-662dd071-65eb-4579-bac7-486d85727bed tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:00.619616 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-662dd071-65eb-4579-bac7-486d85727bed tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:00.620071 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-662dd071-65eb-4579-bac7-486d85727bed tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:00.620495 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-662dd071-65eb-4579-bac7-486d85727bed tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:00.850948 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3be946da-ef63-4c89-abec-82604a78c9c1 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:00.859568 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3be946da-ef63-4c89-abec-82604a78c9c1 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f" status: 200 len: 1355 microversion: 2.1 time: 0.549607 Sep 10 11:55:00.860786 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1762/3489] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:00 2022] GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f => generated 1355 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:00.891568 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ca248232-28d6-43fe-aac1-d393ea01baf2 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:00.892481 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ca248232-28d6-43fe-aac1-d393ea01baf2 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:00.905782 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca248232-28d6-43fe-aac1-d393ea01baf2 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:00.906681 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca248232-28d6-43fe-aac1-d393ea01baf2 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:00.907664 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca248232-28d6-43fe-aac1-d393ea01baf2 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:00.909140 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca248232-28d6-43fe-aac1-d393ea01baf2 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:00.911022 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca248232-28d6-43fe-aac1-d393ea01baf2 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:00.911826 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca248232-28d6-43fe-aac1-d393ea01baf2 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:01.323924 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-662dd071-65eb-4579-bac7-486d85727bed tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] HTTP exception thrown: Floating IP 172.25.5.209 is not associated with instance 8d231092-f981-47fe-9994-6fcb031c8a83. Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-662dd071-65eb-4579-bac7-486d85727bed tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Request method failure captured: Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83/action HTTP/1.1 Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 49 Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHq5BkZgPX7f6T3ZvNM6KJTwUEF_P2Poy5J694hoS3GODhtDTXc9TLop2ydCIrCdON696HV3srZ1xFjcF9dfWk1t_YvL_c6JBS1rBLsIW8vVfzIG_z2OxCl_TfHcLpLsqkM0k2pGMBaNThNNyQZaXkcjZXdT98s1AdJUVDCAfkwkKW0 Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 093f44e4274f41c1882cf1a2167dc891 Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1464892634 Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/093f44e4274f41c1882cf1a2167dc891"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/093f44e4274f41c1882cf1a2167dc891"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_093f44e4274f41c1882cf1a2167dc891", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/093f44e4274f41c1882cf1a2167dc891"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1464892634 Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 093f44e4274f41c1882cf1a2167dc891 Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1464892634 Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-FloatingIPsAssociationTestJSON-1464892634-project Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 4318416fa33b40ae98c8c35675b0c101 Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1464892634-project Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: {"removeFloatingIp": {"address": "172.25.5.209"}} Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: exception: Floating IP 172.25.5.209 is not associated with instance 8d231092-f981-47fe-9994-6fcb031c8a83. Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '8d231092-f981-47fe-9994-6fcb031c8a83', 'body': {'removeFloatingIp': {'address': '172.25.5.209'}}} Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.5.209 is not associated with instance 8d231092-f981-47fe-9994-6fcb031c8a83. Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.5.209 is not associated with instance 8d231092-f981-47fe-9994-6fcb031c8a83. Sep 10 11:55:01.327812 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:55:01.336209 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-662dd071-65eb-4579-bac7-486d85727bed tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Returning 409 to user: Floating IP 172.25.5.209 is not associated with instance 8d231092-f981-47fe-9994-6fcb031c8a83. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:55:01.338443 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-662dd071-65eb-4579-bac7-486d85727bed tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "POST /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83/action" status: 409 len: 146 microversion: 2.1 time: 1.109157 Sep 10 11:55:01.340008 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1728/3490] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:55:00 2022] POST /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83/action => generated 146 bytes in 1112 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:55:01.357028 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-41bbbf0b-61d9-4da1-895c-c5d066b7c2a0 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:01.368267 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-41bbbf0b-61d9-4da1-895c-c5d066b7c2a0 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: 70c46bf2-0367-499b-822a-e18923866289] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:01.375369 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41bbbf0b-61d9-4da1-895c-c5d066b7c2a0 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:01.376012 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41bbbf0b-61d9-4da1-895c-c5d066b7c2a0 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:01.376763 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41bbbf0b-61d9-4da1-895c-c5d066b7c2a0 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:01.380064 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41bbbf0b-61d9-4da1-895c-c5d066b7c2a0 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:01.380807 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41bbbf0b-61d9-4da1-895c-c5d066b7c2a0 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:01.381504 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41bbbf0b-61d9-4da1-895c-c5d066b7c2a0 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:01.472143 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ca248232-28d6-43fe-aac1-d393ea01baf2 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:01.484479 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ca248232-28d6-43fe-aac1-d393ea01baf2 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180" status: 200 len: 1322 microversion: 2.1 time: 0.621935 Sep 10 11:55:01.504042 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1763/3491] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:00 2022] GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180 => generated 1322 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:01.519020 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e2de9623-7f7d-412a-964b-e5468e734bdc tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.209"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:02.360972 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e2de9623-7f7d-412a-964b-e5468e734bdc tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 43e1acba-4c0e-4f89-8d03-e9dcb388c1ef] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:02.367559 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e2de9623-7f7d-412a-964b-e5468e734bdc tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:02.368768 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e2de9623-7f7d-412a-964b-e5468e734bdc tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:02.369225 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e2de9623-7f7d-412a-964b-e5468e734bdc tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:02.369941 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e2de9623-7f7d-412a-964b-e5468e734bdc tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:02.370401 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e2de9623-7f7d-412a-964b-e5468e734bdc tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:02.370827 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e2de9623-7f7d-412a-964b-e5468e734bdc tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:02.392766 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-41bbbf0b-61d9-4da1-895c-c5d066b7c2a0 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be647276cc456e83dacd25b98e37f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20756c1a77fb44f684973f382b802825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:02.404851 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-41bbbf0b-61d9-4da1-895c-c5d066b7c2a0 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/70c46bf2-0367-499b-822a-e18923866289" status: 200 len: 1544 microversion: 2.1 time: 1.063398 Sep 10 11:55:02.405454 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1729/3492] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:01 2022] GET /compute/v2.1/servers/70c46bf2-0367-499b-822a-e18923866289 => generated 1544 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:02.416147 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f1fce52e-4059-49cb-95cc-518bcec58f08 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:02.425341 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f1fce52e-4059-49cb-95cc-518bcec58f08 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 6f2872c7-ac86-4764-9db6-96eece78150f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:02.431899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1fce52e-4059-49cb-95cc-518bcec58f08 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:02.432398 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1fce52e-4059-49cb-95cc-518bcec58f08 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:02.432848 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1fce52e-4059-49cb-95cc-518bcec58f08 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:02.433571 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1fce52e-4059-49cb-95cc-518bcec58f08 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:02.434034 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1fce52e-4059-49cb-95cc-518bcec58f08 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:02.434464 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1fce52e-4059-49cb-95cc-518bcec58f08 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:02.439350 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:55:02.833080 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f1fce52e-4059-49cb-95cc-518bcec58f08 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:02.851352 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f1fce52e-4059-49cb-95cc-518bcec58f08 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f" status: 200 len: 1355 microversion: 2.1 time: 0.434975 Sep 10 11:55:02.863435 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1730/3493] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:02 2022] GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f => generated 1355 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:02.867082 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c2e6be24-743a-4dcb-ada0-43c0ced684ca tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:02.867752 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c2e6be24-743a-4dcb-ada0-43c0ced684ca tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: 70c46bf2-0367-499b-822a-e18923866289] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:02.881268 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c2e6be24-743a-4dcb-ada0-43c0ced684ca tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:02.881771 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c2e6be24-743a-4dcb-ada0-43c0ced684ca tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:02.882223 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c2e6be24-743a-4dcb-ada0-43c0ced684ca tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:02.882935 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c2e6be24-743a-4dcb-ada0-43c0ced684ca tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:02.883416 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c2e6be24-743a-4dcb-ada0-43c0ced684ca tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:02.884065 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c2e6be24-743a-4dcb-ada0-43c0ced684ca tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:02.929703 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e2de9623-7f7d-412a-964b-e5468e734bdc tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "refresh_cache-43e1acba-4c0e-4f89-8d03-e9dcb388c1ef" {{(pid=128777) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 10 11:55:02.931713 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e2de9623-7f7d-412a-964b-e5468e734bdc tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquired lock "refresh_cache-43e1acba-4c0e-4f89-8d03-e9dcb388c1ef" {{(pid=128777) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 10 11:55:03.179907 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c2e6be24-743a-4dcb-ada0-43c0ced684ca tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be647276cc456e83dacd25b98e37f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20756c1a77fb44f684973f382b802825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:03.190210 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c2e6be24-743a-4dcb-ada0-43c0ced684ca tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/70c46bf2-0367-499b-822a-e18923866289" status: 200 len: 1544 microversion: 2.1 time: 0.335946 Sep 10 11:55:03.190973 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1731/3494] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:02 2022] GET /compute/v2.1/servers/70c46bf2-0367-499b-822a-e18923866289 => generated 1544 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:03.195859 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-291c6af1-7b99-4b68-b49b-105af344997b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:03.196757 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-291c6af1-7b99-4b68-b49b-105af344997b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:03.214579 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-291c6af1-7b99-4b68-b49b-105af344997b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:03.214879 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-291c6af1-7b99-4b68-b49b-105af344997b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:03.215348 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-291c6af1-7b99-4b68-b49b-105af344997b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:03.216104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-291c6af1-7b99-4b68-b49b-105af344997b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:03.216705 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-291c6af1-7b99-4b68-b49b-105af344997b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:03.217138 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-291c6af1-7b99-4b68-b49b-105af344997b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:03.616624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-291c6af1-7b99-4b68-b49b-105af344997b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:03.631931 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-291c6af1-7b99-4b68-b49b-105af344997b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180" status: 200 len: 1322 microversion: 2.1 time: 0.439609 Sep 10 11:55:03.633829 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1732/3495] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:03 2022] GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180 => generated 1322 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:03.651611 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-08c8d199-d8d2-4529-ac86-e45e48b14484 req-35663b31-15f8-4284-8266-d9ff75a5bf6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51d91016-0b23-4d74-98b4-1c76652aacb5", "name": "network-vif-plugged", "status": "completed", "tag": "9844db02-76f7-4542-ae21-8ec4bede55f6"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:03.697901 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-08c8d199-d8d2-4529-ac86-e45e48b14484 req-35663b31-15f8-4284-8266-d9ff75a5bf6f service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:03.701064 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-08c8d199-d8d2-4529-ac86-e45e48b14484 req-35663b31-15f8-4284-8266-d9ff75a5bf6f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:03.701519 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-08c8d199-d8d2-4529-ac86-e45e48b14484 req-35663b31-15f8-4284-8266-d9ff75a5bf6f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:03.715449 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-08c8d199-d8d2-4529-ac86-e45e48b14484 req-35663b31-15f8-4284-8266-d9ff75a5bf6f service nova] Creating event network-vif-plugged:9844db02-76f7-4542-ae21-8ec4bede55f6 for instance 51d91016-0b23-4d74-98b4-1c76652aacb5 on n-h1-856895-1 Sep 10 11:55:03.723397 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-08c8d199-d8d2-4529-ac86-e45e48b14484 req-35663b31-15f8-4284-8266-d9ff75a5bf6f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088292 Sep 10 11:55:03.726198 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1733/3496] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:55:03.879928 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-893ee422-bed1-4806-85d1-6bee593c1619 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:03.880924 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-893ee422-bed1-4806-85d1-6bee593c1619 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 6f2872c7-ac86-4764-9db6-96eece78150f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:03.889373 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-893ee422-bed1-4806-85d1-6bee593c1619 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:03.890118 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-893ee422-bed1-4806-85d1-6bee593c1619 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:03.890726 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-893ee422-bed1-4806-85d1-6bee593c1619 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:03.891666 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-893ee422-bed1-4806-85d1-6bee593c1619 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:03.892429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-893ee422-bed1-4806-85d1-6bee593c1619 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:03.893098 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-893ee422-bed1-4806-85d1-6bee593c1619 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:04.283393 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-893ee422-bed1-4806-85d1-6bee593c1619 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:04.293468 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-893ee422-bed1-4806-85d1-6bee593c1619 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f" status: 200 len: 1355 microversion: 2.1 time: 0.418233 Sep 10 11:55:04.295087 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1734/3497] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:03 2022] GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f => generated 1355 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:55:04.445356 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-e2de9623-7f7d-412a-964b-e5468e734bdc tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 43e1acba-4c0e-4f89-8d03-e9dcb388c1ef] Building network info cache for instance {{(pid=128777) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 10 11:55:04.449795 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-6b1ae3a0-c806-4b57-9f80-4af331358ad5 req-c6b38e26-9c8b-4c1d-8e95-cea1540a833e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43e1acba-4c0e-4f89-8d03-e9dcb388c1ef", "tag": "12dbd5b4-0a1e-43b6-b783-06fe70dd1b54"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:04.466250 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6b1ae3a0-c806-4b57-9f80-4af331358ad5 req-c6b38e26-9c8b-4c1d-8e95-cea1540a833e service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:04.467670 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6b1ae3a0-c806-4b57-9f80-4af331358ad5 req-c6b38e26-9c8b-4c1d-8e95-cea1540a833e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:04.468337 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6b1ae3a0-c806-4b57-9f80-4af331358ad5 req-c6b38e26-9c8b-4c1d-8e95-cea1540a833e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:04.487627 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-6b1ae3a0-c806-4b57-9f80-4af331358ad5 req-c6b38e26-9c8b-4c1d-8e95-cea1540a833e service nova] Creating event network-changed:12dbd5b4-0a1e-43b6-b783-06fe70dd1b54 for instance 43e1acba-4c0e-4f89-8d03-e9dcb388c1ef on n-h2-856895-1 Sep 10 11:55:04.493227 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-6b1ae3a0-c806-4b57-9f80-4af331358ad5 req-c6b38e26-9c8b-4c1d-8e95-cea1540a833e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048501 Sep 10 11:55:04.494748 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1735/3498] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:55:04.657406 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-059435dc-4591-421f-a608-a51693e9da89 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:04.658115 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-059435dc-4591-421f-a608-a51693e9da89 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:04.670369 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-059435dc-4591-421f-a608-a51693e9da89 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:04.671222 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-059435dc-4591-421f-a608-a51693e9da89 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:04.671928 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-059435dc-4591-421f-a608-a51693e9da89 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:04.672849 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-059435dc-4591-421f-a608-a51693e9da89 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:04.673519 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-059435dc-4591-421f-a608-a51693e9da89 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:04.674163 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-059435dc-4591-421f-a608-a51693e9da89 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:05.209543 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-059435dc-4591-421f-a608-a51693e9da89 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:05.222252 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-059435dc-4591-421f-a608-a51693e9da89 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180" status: 200 len: 1322 microversion: 2.1 time: 0.569608 Sep 10 11:55:05.235187 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1736/3499] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:04 2022] GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180 => generated 1322 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:05.319377 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-28f62fb0-3df3-434d-9a36-0a079c3d1cea tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:05.320299 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-28f62fb0-3df3-434d-9a36-0a079c3d1cea tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 6f2872c7-ac86-4764-9db6-96eece78150f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:05.328642 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28f62fb0-3df3-434d-9a36-0a079c3d1cea tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:05.329668 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28f62fb0-3df3-434d-9a36-0a079c3d1cea tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:05.330180 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28f62fb0-3df3-434d-9a36-0a079c3d1cea tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:05.330897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28f62fb0-3df3-434d-9a36-0a079c3d1cea tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:05.332687 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28f62fb0-3df3-434d-9a36-0a079c3d1cea tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:05.333336 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28f62fb0-3df3-434d-9a36-0a079c3d1cea tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:05.396820 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:55:05.431387 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:55:06.080247 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-28f62fb0-3df3-434d-9a36-0a079c3d1cea tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:06.089355 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-28f62fb0-3df3-434d-9a36-0a079c3d1cea tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f" status: 200 len: 1355 microversion: 2.1 time: 0.774784 Sep 10 11:55:06.106104 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1737/3500] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:05 2022] GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f => generated 1355 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:55:06.249173 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b5e8754b-aa37-4de3-89a1-cf5f8bbc0f33 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:06.249834 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b5e8754b-aa37-4de3-89a1-cf5f8bbc0f33 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:06.256339 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b5e8754b-aa37-4de3-89a1-cf5f8bbc0f33 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:06.257082 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b5e8754b-aa37-4de3-89a1-cf5f8bbc0f33 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:06.257720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b5e8754b-aa37-4de3-89a1-cf5f8bbc0f33 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:06.258613 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b5e8754b-aa37-4de3-89a1-cf5f8bbc0f33 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:06.259277 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b5e8754b-aa37-4de3-89a1-cf5f8bbc0f33 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:06.259912 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b5e8754b-aa37-4de3-89a1-cf5f8bbc0f33 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:06.630009 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-e2de9623-7f7d-412a-964b-e5468e734bdc tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 43e1acba-4c0e-4f89-8d03-e9dcb388c1ef] Updating instance_info_cache with network_info: [{"id": "12dbd5b4-0a1e-43b6-b783-06fe70dd1b54", "address": "fa:16:3e:fb:7a:c5", "network": {"id": "9f016ce0-94a4-441f-9715-493bd2b96018", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-332030758-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "093f44e4274f41c1882cf1a2167dc891", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap12dbd5b4-0a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128777) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 10 11:55:06.648855 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e2de9623-7f7d-412a-964b-e5468e734bdc tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Releasing lock "refresh_cache-43e1acba-4c0e-4f89-8d03-e9dcb388c1ef" {{(pid=128777) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 10 11:55:06.650036 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e2de9623-7f7d-412a-964b-e5468e734bdc tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "POST /compute/v2.1/servers/43e1acba-4c0e-4f89-8d03-e9dcb388c1ef/action" status: 202 len: 0 microversion: 2.1 time: 5.144868 Sep 10 11:55:06.650685 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1764/3501] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:55:01 2022] POST /compute/v2.1/servers/43e1acba-4c0e-4f89-8d03-e9dcb388c1ef/action => generated 0 bytes in 5146 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 10 11:55:06.654761 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b5e8754b-aa37-4de3-89a1-cf5f8bbc0f33 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:06.660242 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-75433607-1d2d-4434-9d57-ec284fdc4828 req-71f7ed48-a7fe-439e-be02-aaf4f9740d5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84f2edbd-a437-474e-bd57-10814851e180", "tag": "55557b64-98f5-4620-a6c2-033018b54096"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:06.670218 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b5e8754b-aa37-4de3-89a1-cf5f8bbc0f33 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180" status: 200 len: 1322 microversion: 2.1 time: 0.424771 Sep 10 11:55:06.675183 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-75433607-1d2d-4434-9d57-ec284fdc4828 req-71f7ed48-a7fe-439e-be02-aaf4f9740d5c service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:06.675848 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-75433607-1d2d-4434-9d57-ec284fdc4828 req-71f7ed48-a7fe-439e-be02-aaf4f9740d5c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:06.676456 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-75433607-1d2d-4434-9d57-ec284fdc4828 req-71f7ed48-a7fe-439e-be02-aaf4f9740d5c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:06.678323 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1738/3502] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:06 2022] GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180 => generated 1322 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:55:06.683093 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-37e59245-9a84-49d8-960d-59c34c6a3f75 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:06.683647 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-37e59245-9a84-49d8-960d-59c34c6a3f75 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 43e1acba-4c0e-4f89-8d03-e9dcb388c1ef] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:06.690609 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-75433607-1d2d-4434-9d57-ec284fdc4828 req-71f7ed48-a7fe-439e-be02-aaf4f9740d5c service nova] Creating event network-changed:55557b64-98f5-4620-a6c2-033018b54096 for instance 84f2edbd-a437-474e-bd57-10814851e180 on n-h2-856895-1 Sep 10 11:55:06.696369 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-75433607-1d2d-4434-9d57-ec284fdc4828 req-71f7ed48-a7fe-439e-be02-aaf4f9740d5c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040134 Sep 10 11:55:06.697172 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1765/3503] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:55:06.701568 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-37e59245-9a84-49d8-960d-59c34c6a3f75 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:06.702069 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-37e59245-9a84-49d8-960d-59c34c6a3f75 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:06.702514 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-37e59245-9a84-49d8-960d-59c34c6a3f75 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:06.703274 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-37e59245-9a84-49d8-960d-59c34c6a3f75 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:06.703932 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-37e59245-9a84-49d8-960d-59c34c6a3f75 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:06.704537 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-37e59245-9a84-49d8-960d-59c34c6a3f75 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:06.732813 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-37e59245-9a84-49d8-960d-59c34c6a3f75 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 43e1acba-4c0e-4f89-8d03-e9dcb388c1ef] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:55:06.838901 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-37e59245-9a84-49d8-960d-59c34c6a3f75 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "DELETE /compute/v2.1/servers/43e1acba-4c0e-4f89-8d03-e9dcb388c1ef" status: 204 len: 0 microversion: 2.1 time: 0.159092 Sep 10 11:55:06.840606 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1739/3504] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:55:06 2022] DELETE /compute/v2.1/servers/43e1acba-4c0e-4f89-8d03-e9dcb388c1ef => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:55:06.852867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d4d35ac4-dbc3-4f2a-96f5-65be59ff6df1 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.209"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:06.855798 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d4d35ac4-dbc3-4f2a-96f5-65be59ff6df1 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 8d231092-f981-47fe-9994-6fcb031c8a83] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:06.863633 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d4d35ac4-dbc3-4f2a-96f5-65be59ff6df1 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:06.864175 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d4d35ac4-dbc3-4f2a-96f5-65be59ff6df1 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:06.864631 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d4d35ac4-dbc3-4f2a-96f5-65be59ff6df1 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:06.865367 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d4d35ac4-dbc3-4f2a-96f5-65be59ff6df1 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:06.865826 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d4d35ac4-dbc3-4f2a-96f5-65be59ff6df1 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:06.867011 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d4d35ac4-dbc3-4f2a-96f5-65be59ff6df1 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:06.905051 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d4d35ac4-dbc3-4f2a-96f5-65be59ff6df1 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "refresh_cache-8d231092-f981-47fe-9994-6fcb031c8a83" {{(pid=128777) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 10 11:55:06.905432 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d4d35ac4-dbc3-4f2a-96f5-65be59ff6df1 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquired lock "refresh_cache-8d231092-f981-47fe-9994-6fcb031c8a83" {{(pid=128777) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 10 11:55:07.114210 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d51740b4-cb8b-4aad-9fb3-621667a5f8f7 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:07.115626 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d51740b4-cb8b-4aad-9fb3-621667a5f8f7 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 6f2872c7-ac86-4764-9db6-96eece78150f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:07.123439 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d51740b4-cb8b-4aad-9fb3-621667a5f8f7 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:07.124195 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d51740b4-cb8b-4aad-9fb3-621667a5f8f7 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:07.124816 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d51740b4-cb8b-4aad-9fb3-621667a5f8f7 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:07.125744 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d51740b4-cb8b-4aad-9fb3-621667a5f8f7 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:07.126449 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d51740b4-cb8b-4aad-9fb3-621667a5f8f7 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:07.127056 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d51740b4-cb8b-4aad-9fb3-621667a5f8f7 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:07.497070 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d51740b4-cb8b-4aad-9fb3-621667a5f8f7 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:07.513146 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d51740b4-cb8b-4aad-9fb3-621667a5f8f7 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f" status: 200 len: 1355 microversion: 2.1 time: 0.403044 Sep 10 11:55:07.514581 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1740/3505] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:07 2022] GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f => generated 1355 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:55:07.701799 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7de00637-7564-447b-814c-f38f32bedff6 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:07.702763 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7de00637-7564-447b-814c-f38f32bedff6 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:07.710667 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7de00637-7564-447b-814c-f38f32bedff6 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:07.712097 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7de00637-7564-447b-814c-f38f32bedff6 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:07.713065 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7de00637-7564-447b-814c-f38f32bedff6 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:07.714418 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7de00637-7564-447b-814c-f38f32bedff6 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:07.715546 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7de00637-7564-447b-814c-f38f32bedff6 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:07.716519 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7de00637-7564-447b-814c-f38f32bedff6 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:08.852791 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7de00637-7564-447b-814c-f38f32bedff6 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:08.864297 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7de00637-7564-447b-814c-f38f32bedff6 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180" status: 200 len: 1322 microversion: 2.1 time: 1.173609 Sep 10 11:55:08.865183 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1741/3506] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:07 2022] GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180 => generated 1322 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:55:08.870068 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-987e9e65-2226-4abf-bf98-e1f7f113db13 req-f82ba631-46ee-4778-9cfb-0feb90a2b7f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70c46bf2-0367-499b-822a-e18923866289", "tag": "4f477cca-0fac-4e49-8748-690968026f45"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:08.912723 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-987e9e65-2226-4abf-bf98-e1f7f113db13 req-f82ba631-46ee-4778-9cfb-0feb90a2b7f4 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:08.913492 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-987e9e65-2226-4abf-bf98-e1f7f113db13 req-f82ba631-46ee-4778-9cfb-0feb90a2b7f4 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:08.914201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-987e9e65-2226-4abf-bf98-e1f7f113db13 req-f82ba631-46ee-4778-9cfb-0feb90a2b7f4 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:08.937435 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-987e9e65-2226-4abf-bf98-e1f7f113db13 req-f82ba631-46ee-4778-9cfb-0feb90a2b7f4 service nova] Creating event network-changed:4f477cca-0fac-4e49-8748-690968026f45 for instance 70c46bf2-0367-499b-822a-e18923866289 on n-h2-856895-1 Sep 10 11:55:08.948322 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-987e9e65-2226-4abf-bf98-e1f7f113db13 req-f82ba631-46ee-4778-9cfb-0feb90a2b7f4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081467 Sep 10 11:55:08.949195 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1742/3507] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:55:08.962821 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cad0aa9e-a6ec-4b97-81dd-c9308fc71c9e tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:08.963943 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cad0aa9e-a6ec-4b97-81dd-c9308fc71c9e tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 6f2872c7-ac86-4764-9db6-96eece78150f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:08.971190 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cad0aa9e-a6ec-4b97-81dd-c9308fc71c9e tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:08.971671 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cad0aa9e-a6ec-4b97-81dd-c9308fc71c9e tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:08.972316 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cad0aa9e-a6ec-4b97-81dd-c9308fc71c9e tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:08.976725 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cad0aa9e-a6ec-4b97-81dd-c9308fc71c9e tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:08.977431 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cad0aa9e-a6ec-4b97-81dd-c9308fc71c9e tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:08.978065 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cad0aa9e-a6ec-4b97-81dd-c9308fc71c9e tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:09.534318 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-cad0aa9e-a6ec-4b97-81dd-c9308fc71c9e tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:09.553518 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cad0aa9e-a6ec-4b97-81dd-c9308fc71c9e tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f" status: 200 len: 1355 microversion: 2.1 time: 0.602024 Sep 10 11:55:09.554123 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1743/3508] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:08 2022] GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f => generated 1355 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:09.891502 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5d3c56be-71de-4291-a9d5-baea629355be tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:09.892883 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5d3c56be-71de-4291-a9d5-baea629355be tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:09.901176 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:55:09.910225 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5d3c56be-71de-4291-a9d5-baea629355be tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:09.911441 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5d3c56be-71de-4291-a9d5-baea629355be tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:09.915538 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5d3c56be-71de-4291-a9d5-baea629355be tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:09.924847 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5d3c56be-71de-4291-a9d5-baea629355be tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:09.926482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5d3c56be-71de-4291-a9d5-baea629355be tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:09.927449 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5d3c56be-71de-4291-a9d5-baea629355be tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:10.471508 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5d3c56be-71de-4291-a9d5-baea629355be tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:10.489006 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5d3c56be-71de-4291-a9d5-baea629355be tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180" status: 200 len: 1322 microversion: 2.1 time: 0.600960 Sep 10 11:55:10.491919 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1744/3509] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:09 2022] GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180 => generated 1322 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:55:10.770884 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5525ddbb-585b-4f51-a836-f882cf243ced tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1636514919", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "471bef66-289e-44bc-a38f-0fbd7758b454"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:10.876898 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-5525ddbb-585b-4f51-a836-f882cf243ced tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] validate_networks() for [('471bef66-289e-44bc-a38f-0fbd7758b454', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:55:11.102509 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-d4d35ac4-dbc3-4f2a-96f5-65be59ff6df1 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 8d231092-f981-47fe-9994-6fcb031c8a83] Building network info cache for instance {{(pid=128777) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 10 11:55:12.570399 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-5525ddbb-585b-4f51-a836-f882cf243ced tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:55:12.571437 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-5525ddbb-585b-4f51-a836-f882cf243ced tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:55:12.572113 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-5525ddbb-585b-4f51-a836-f882cf243ced tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:55:12.573343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-5525ddbb-585b-4f51-a836-f882cf243ced tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:55:12.574055 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-5525ddbb-585b-4f51-a836-f882cf243ced tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:55:12.597223 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5525ddbb-585b-4f51-a836-f882cf243ced tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:12.597929 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5525ddbb-585b-4f51-a836-f882cf243ced tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:12.598383 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5525ddbb-585b-4f51-a836-f882cf243ced tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:12.599194 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5525ddbb-585b-4f51-a836-f882cf243ced tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:12.599930 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5525ddbb-585b-4f51-a836-f882cf243ced tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:12.600359 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5525ddbb-585b-4f51-a836-f882cf243ced tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:12.652548 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-5525ddbb-585b-4f51-a836-f882cf243ced tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Getting quotas for project 2f92ad05650840f6bb4c8f6134b489ca. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:55:12.666781 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-5525ddbb-585b-4f51-a836-f882cf243ced tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Getting quotas for user d244789bea974bd99d0f1debebabb54a and project 2f92ad05650840f6bb4c8f6134b489ca. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:55:12.688669 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5525ddbb-585b-4f51-a836-f882cf243ced tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:55:12.691677 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5525ddbb-585b-4f51-a836-f882cf243ced tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: e3157819-80a0-4ca3-9ad5-fe790fb7b2a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:55:12.769486 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5525ddbb-585b-4f51-a836-f882cf243ced tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.276121 Sep 10 11:55:12.770716 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1745/3510] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:55:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2278 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:55:12.775726 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-40e8e04a-62a3-42ab-91ce-8f89e35c6d23 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:12.776886 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-40e8e04a-62a3-42ab-91ce-8f89e35c6d23 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 6f2872c7-ac86-4764-9db6-96eece78150f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:12.784691 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-40e8e04a-62a3-42ab-91ce-8f89e35c6d23 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:12.785611 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-40e8e04a-62a3-42ab-91ce-8f89e35c6d23 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:12.786297 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-40e8e04a-62a3-42ab-91ce-8f89e35c6d23 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:12.787302 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-40e8e04a-62a3-42ab-91ce-8f89e35c6d23 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:12.787998 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-40e8e04a-62a3-42ab-91ce-8f89e35c6d23 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:12.788700 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-40e8e04a-62a3-42ab-91ce-8f89e35c6d23 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:13.577377 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-40e8e04a-62a3-42ab-91ce-8f89e35c6d23 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:13.597062 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-40e8e04a-62a3-42ab-91ce-8f89e35c6d23 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f" status: 200 len: 1355 microversion: 2.1 time: 0.823772 Sep 10 11:55:13.601162 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1746/3511] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:12 2022] GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f => generated 1355 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:13.613607 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-d6b8244e-edae-4ae2-b713-b625665297b6 req-3a084ab6-ca03-499e-abfc-dd5cfaddeb5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43e1acba-4c0e-4f89-8d03-e9dcb388c1ef", "name": "network-vif-deleted", "tag": "12dbd5b4-0a1e-43b6-b783-06fe70dd1b54"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:13.617696 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-d4d35ac4-dbc3-4f2a-96f5-65be59ff6df1 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 8d231092-f981-47fe-9994-6fcb031c8a83] Updating instance_info_cache with network_info: [{"id": "8c8742ac-1c89-456c-9fd1-cc7ed178f4dd", "address": "fa:16:3e:ba:60:00", "network": {"id": "9f016ce0-94a4-441f-9715-493bd2b96018", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-332030758-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "093f44e4274f41c1882cf1a2167dc891", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8c8742ac-1c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128777) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 10 11:55:13.635149 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d4d35ac4-dbc3-4f2a-96f5-65be59ff6df1 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Releasing lock "refresh_cache-8d231092-f981-47fe-9994-6fcb031c8a83" {{(pid=128777) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 10 11:55:13.636072 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d4d35ac4-dbc3-4f2a-96f5-65be59ff6df1 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "POST /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83/action" status: 202 len: 0 microversion: 2.1 time: 6.788560 Sep 10 11:55:13.636730 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1766/3512] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:55:06 2022] POST /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83/action => generated 0 bytes in 6790 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 10 11:55:13.640574 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d6b8244e-edae-4ae2-b713-b625665297b6 req-3a084ab6-ca03-499e-abfc-dd5cfaddeb5b service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:13.642275 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d6b8244e-edae-4ae2-b713-b625665297b6 req-3a084ab6-ca03-499e-abfc-dd5cfaddeb5b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:13.643694 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d6b8244e-edae-4ae2-b713-b625665297b6 req-3a084ab6-ca03-499e-abfc-dd5cfaddeb5b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:13.644693 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d68dc66c-bd40-4d3d-b000-47b8813ff132 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:13.645353 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d68dc66c-bd40-4d3d-b000-47b8813ff132 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:13.662886 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d68dc66c-bd40-4d3d-b000-47b8813ff132 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:13.663419 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d68dc66c-bd40-4d3d-b000-47b8813ff132 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:13.663870 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d68dc66c-bd40-4d3d-b000-47b8813ff132 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:13.664648 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d68dc66c-bd40-4d3d-b000-47b8813ff132 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:13.665125 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d68dc66c-bd40-4d3d-b000-47b8813ff132 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:13.665553 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d68dc66c-bd40-4d3d-b000-47b8813ff132 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:13.680279 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-d6b8244e-edae-4ae2-b713-b625665297b6 req-3a084ab6-ca03-499e-abfc-dd5cfaddeb5b service nova] Creating event network-vif-deleted:12dbd5b4-0a1e-43b6-b783-06fe70dd1b54 for instance 43e1acba-4c0e-4f89-8d03-e9dcb388c1ef on n-h2-856895-1 Sep 10 11:55:13.691341 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-d6b8244e-edae-4ae2-b713-b625665297b6 req-3a084ab6-ca03-499e-abfc-dd5cfaddeb5b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088875 Sep 10 11:55:13.694380 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1747/3513] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:55:13.708236 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-353ea323-4a9f-45f5-bd5e-be31d78fdc7a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:13.708709 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-353ea323-4a9f-45f5-bd5e-be31d78fdc7a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: e3157819-80a0-4ca3-9ad5-fe790fb7b2a1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:13.716929 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-353ea323-4a9f-45f5-bd5e-be31d78fdc7a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:13.717699 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-353ea323-4a9f-45f5-bd5e-be31d78fdc7a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:13.718321 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-353ea323-4a9f-45f5-bd5e-be31d78fdc7a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:13.719324 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-353ea323-4a9f-45f5-bd5e-be31d78fdc7a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:13.719955 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-353ea323-4a9f-45f5-bd5e-be31d78fdc7a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:13.720664 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-353ea323-4a9f-45f5-bd5e-be31d78fdc7a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:13.763517 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:55:14.064495 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-353ea323-4a9f-45f5-bd5e-be31d78fdc7a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:14.083038 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-353ea323-4a9f-45f5-bd5e-be31d78fdc7a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/e3157819-80a0-4ca3-9ad5-fe790fb7b2a1" status: 200 len: 1219 microversion: 2.1 time: 0.384799 Sep 10 11:55:14.086939 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1748/3514] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:13 2022] GET /compute/v2.1/servers/e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 => generated 1219 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:14.097265 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3ae17dad-0ca5-4a93-ad5f-6cb584dfd423 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Calling method '.version_select at 0x7f40734de8b0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:14.150542 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d68dc66c-bd40-4d3d-b000-47b8813ff132 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:14.165740 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d68dc66c-bd40-4d3d-b000-47b8813ff132 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180" status: 200 len: 1322 microversion: 2.1 time: 0.527915 Sep 10 11:55:14.180044 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1767/3515] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:13 2022] GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180 => generated 1322 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:14.508994 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3ae17dad-0ca5-4a93-ad5f-6cb584dfd423 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "GET /compute/v2.1/os-floating-ips/2b0d333c-98f3-4ed4-8c50-c9f5aaedb9c7" status: 200 len: 184 microversion: 2.1 time: 0.420587 Sep 10 11:55:14.509845 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1749/3516] 10.222.0.23 () {58 vars in 1260 bytes} [Sat Sep 10 11:55:14 2022] GET /compute/v2.1/os-floating-ips/2b0d333c-98f3-4ed4-8c50-c9f5aaedb9c7 => generated 184 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:55:14.523588 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4843d986-3d43-4323-98db-fc86344da35e tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.209"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:14.623847 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2d603aff-feee-4cd2-bd19-de169a4314ed tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:14.624480 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2d603aff-feee-4cd2-bd19-de169a4314ed tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 6f2872c7-ac86-4764-9db6-96eece78150f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:14.641717 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d603aff-feee-4cd2-bd19-de169a4314ed tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:14.642696 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d603aff-feee-4cd2-bd19-de169a4314ed tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:14.643361 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d603aff-feee-4cd2-bd19-de169a4314ed tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:14.646432 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d603aff-feee-4cd2-bd19-de169a4314ed tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:14.647129 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d603aff-feee-4cd2-bd19-de169a4314ed tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:14.651871 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d603aff-feee-4cd2-bd19-de169a4314ed tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:15.159036 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4843d986-3d43-4323-98db-fc86344da35e tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 8d231092-f981-47fe-9994-6fcb031c8a83] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:15.168205 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4843d986-3d43-4323-98db-fc86344da35e tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:15.169648 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4843d986-3d43-4323-98db-fc86344da35e tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:15.171503 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4843d986-3d43-4323-98db-fc86344da35e tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:15.176663 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4843d986-3d43-4323-98db-fc86344da35e tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:15.177438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4843d986-3d43-4323-98db-fc86344da35e tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:15.178060 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4843d986-3d43-4323-98db-fc86344da35e tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:15.209383 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2d603aff-feee-4cd2-bd19-de169a4314ed tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:15.229846 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2d603aff-feee-4cd2-bd19-de169a4314ed tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f" status: 200 len: 1355 microversion: 2.1 time: 0.604647 Sep 10 11:55:15.235339 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1750/3517] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:14 2022] GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f => generated 1355 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:55:15.260024 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3d08dcba-929f-42e5-8cff-b4c29c87fc7f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:15.261080 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3d08dcba-929f-42e5-8cff-b4c29c87fc7f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: e3157819-80a0-4ca3-9ad5-fe790fb7b2a1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:15.268865 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3d08dcba-929f-42e5-8cff-b4c29c87fc7f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:15.269764 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3d08dcba-929f-42e5-8cff-b4c29c87fc7f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:15.270411 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3d08dcba-929f-42e5-8cff-b4c29c87fc7f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:15.271470 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3d08dcba-929f-42e5-8cff-b4c29c87fc7f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:15.271955 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3d08dcba-929f-42e5-8cff-b4c29c87fc7f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:15.272701 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3d08dcba-929f-42e5-8cff-b4c29c87fc7f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:15.390064 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3d08dcba-929f-42e5-8cff-b4c29c87fc7f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:15.401300 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3d08dcba-929f-42e5-8cff-b4c29c87fc7f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/e3157819-80a0-4ca3-9ad5-fe790fb7b2a1" status: 200 len: 1273 microversion: 2.1 time: 0.164284 Sep 10 11:55:15.402578 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1751/3518] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:15 2022] GET /compute/v2.1/servers/e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 => generated 1273 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:15.411498 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d5383e7d-ff7b-4308-906d-c2a0e208bc2a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:15.412473 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d5383e7d-ff7b-4308-906d-c2a0e208bc2a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:15.421034 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d5383e7d-ff7b-4308-906d-c2a0e208bc2a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:15.422006 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d5383e7d-ff7b-4308-906d-c2a0e208bc2a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:15.422642 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d5383e7d-ff7b-4308-906d-c2a0e208bc2a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:15.423652 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d5383e7d-ff7b-4308-906d-c2a0e208bc2a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:15.424500 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d5383e7d-ff7b-4308-906d-c2a0e208bc2a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:15.425664 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d5383e7d-ff7b-4308-906d-c2a0e208bc2a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:15.595262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4843d986-3d43-4323-98db-fc86344da35e tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "refresh_cache-8d231092-f981-47fe-9994-6fcb031c8a83" {{(pid=128777) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 10 11:55:15.595773 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4843d986-3d43-4323-98db-fc86344da35e tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquired lock "refresh_cache-8d231092-f981-47fe-9994-6fcb031c8a83" {{(pid=128777) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 10 11:55:15.693453 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d5383e7d-ff7b-4308-906d-c2a0e208bc2a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:15.703674 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d5383e7d-ff7b-4308-906d-c2a0e208bc2a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180" status: 200 len: 1322 microversion: 2.1 time: 0.298540 Sep 10 11:55:15.724488 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1752/3519] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:15 2022] GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180 => generated 1322 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:15.812185 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0122c13c-8f48-46c8-b1bd-412cd4f24d7e tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-612223801", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:15.893012 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-0122c13c-8f48-46c8-b1bd-412cd4f24d7e tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] validate_networks() for [('8981d05d-3169-42b2-b341-d927308d80cd', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:55:16.946886 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-0122c13c-8f48-46c8-b1bd-412cd4f24d7e tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:55:16.947543 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-0122c13c-8f48-46c8-b1bd-412cd4f24d7e tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:55:16.947814 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-0122c13c-8f48-46c8-b1bd-412cd4f24d7e tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:55:16.949276 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-0122c13c-8f48-46c8-b1bd-412cd4f24d7e tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:55:16.950601 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-0122c13c-8f48-46c8-b1bd-412cd4f24d7e tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:55:16.970132 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0122c13c-8f48-46c8-b1bd-412cd4f24d7e tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:16.970942 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0122c13c-8f48-46c8-b1bd-412cd4f24d7e tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:16.976622 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0122c13c-8f48-46c8-b1bd-412cd4f24d7e tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:16.977915 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0122c13c-8f48-46c8-b1bd-412cd4f24d7e tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:16.978587 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0122c13c-8f48-46c8-b1bd-412cd4f24d7e tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:16.979232 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0122c13c-8f48-46c8-b1bd-412cd4f24d7e tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:17.024274 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-0122c13c-8f48-46c8-b1bd-412cd4f24d7e tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Getting quotas for project e4037e33456e49ce9fc9dca787b81c5b. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:55:17.036248 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-0122c13c-8f48-46c8-b1bd-412cd4f24d7e tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Getting quotas for user 699642ccee09488eb731ba7c707947d4 and project e4037e33456e49ce9fc9dca787b81c5b. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:55:17.069429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0122c13c-8f48-46c8-b1bd-412cd4f24d7e tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:55:17.074748 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0122c13c-8f48-46c8-b1bd-412cd4f24d7e tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: 9af45fd0-4f3b-480b-a33f-df501592594d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:55:17.190326 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0122c13c-8f48-46c8-b1bd-412cd4f24d7e tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.462606 Sep 10 11:55:17.200928 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1753/3520] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:55:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 1468 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:55:17.204776 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-6677828a-95b9-4fe7-95a8-69767e9350f9 req-14e27ca2-4d1d-4e00-8d9b-1e709687f6f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d231092-f981-47fe-9994-6fcb031c8a83", "tag": "8c8742ac-1c89-456c-9fd1-cc7ed178f4dd"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:17.253527 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6677828a-95b9-4fe7-95a8-69767e9350f9 req-14e27ca2-4d1d-4e00-8d9b-1e709687f6f5 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:17.254019 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6677828a-95b9-4fe7-95a8-69767e9350f9 req-14e27ca2-4d1d-4e00-8d9b-1e709687f6f5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:17.257762 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6677828a-95b9-4fe7-95a8-69767e9350f9 req-14e27ca2-4d1d-4e00-8d9b-1e709687f6f5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:17.295455 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-6677828a-95b9-4fe7-95a8-69767e9350f9 req-14e27ca2-4d1d-4e00-8d9b-1e709687f6f5 service nova] Creating event network-changed:8c8742ac-1c89-456c-9fd1-cc7ed178f4dd for instance 8d231092-f981-47fe-9994-6fcb031c8a83 on n-h1-856895-1 Sep 10 11:55:17.305110 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-6677828a-95b9-4fe7-95a8-69767e9350f9 req-14e27ca2-4d1d-4e00-8d9b-1e709687f6f5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108668 Sep 10 11:55:17.307534 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1754/3521] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:55:17.322436 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6dc397db-c72e-43df-9d96-f665e9d89bec tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:17.323171 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6dc397db-c72e-43df-9d96-f665e9d89bec tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 6f2872c7-ac86-4764-9db6-96eece78150f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:17.338702 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6dc397db-c72e-43df-9d96-f665e9d89bec tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:17.339247 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6dc397db-c72e-43df-9d96-f665e9d89bec tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:17.339699 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6dc397db-c72e-43df-9d96-f665e9d89bec tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:17.342700 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6dc397db-c72e-43df-9d96-f665e9d89bec tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:17.343222 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6dc397db-c72e-43df-9d96-f665e9d89bec tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:17.345962 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6dc397db-c72e-43df-9d96-f665e9d89bec tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:17.539616 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-4843d986-3d43-4323-98db-fc86344da35e tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 8d231092-f981-47fe-9994-6fcb031c8a83] Building network info cache for instance {{(pid=128777) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 10 11:55:17.858167 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6dc397db-c72e-43df-9d96-f665e9d89bec tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:17.866453 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6dc397db-c72e-43df-9d96-f665e9d89bec tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f" status: 200 len: 1355 microversion: 2.1 time: 0.555750 Sep 10 11:55:17.871201 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1755/3522] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:17 2022] GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f => generated 1355 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:17.882525 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-13a01455-854c-421a-9973-b76ef5f5f38d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:17.883459 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-13a01455-854c-421a-9973-b76ef5f5f38d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: e3157819-80a0-4ca3-9ad5-fe790fb7b2a1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:17.898598 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13a01455-854c-421a-9973-b76ef5f5f38d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:17.899426 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13a01455-854c-421a-9973-b76ef5f5f38d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:17.901046 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13a01455-854c-421a-9973-b76ef5f5f38d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:17.904165 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13a01455-854c-421a-9973-b76ef5f5f38d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:17.906662 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13a01455-854c-421a-9973-b76ef5f5f38d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:17.907355 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13a01455-854c-421a-9973-b76ef5f5f38d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:18.294664 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-13a01455-854c-421a-9973-b76ef5f5f38d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:18.311803 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-13a01455-854c-421a-9973-b76ef5f5f38d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/e3157819-80a0-4ca3-9ad5-fe790fb7b2a1" status: 200 len: 1315 microversion: 2.1 time: 0.439018 Sep 10 11:55:18.312956 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1756/3523] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:17 2022] GET /compute/v2.1/servers/e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 => generated 1315 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:18.326759 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-e2e67557-ba77-4055-ab9f-dad34a8cca9a req-19591a02-fcfa-408c-8ce7-fcafbacc62c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84f2edbd-a437-474e-bd57-10814851e180", "name": "network-vif-plugged", "status": "completed", "tag": "55557b64-98f5-4620-a6c2-033018b54096"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:18.357899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e2e67557-ba77-4055-ab9f-dad34a8cca9a req-19591a02-fcfa-408c-8ce7-fcafbacc62c3 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:18.358390 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e2e67557-ba77-4055-ab9f-dad34a8cca9a req-19591a02-fcfa-408c-8ce7-fcafbacc62c3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:18.358878 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e2e67557-ba77-4055-ab9f-dad34a8cca9a req-19591a02-fcfa-408c-8ce7-fcafbacc62c3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:18.384214 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-e2e67557-ba77-4055-ab9f-dad34a8cca9a req-19591a02-fcfa-408c-8ce7-fcafbacc62c3 service nova] Creating event network-vif-plugged:55557b64-98f5-4620-a6c2-033018b54096 for instance 84f2edbd-a437-474e-bd57-10814851e180 on n-h2-856895-1 Sep 10 11:55:18.391852 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-e2e67557-ba77-4055-ab9f-dad34a8cca9a req-19591a02-fcfa-408c-8ce7-fcafbacc62c3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077155 Sep 10 11:55:18.398370 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1757/3524] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:55:18.405906 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d2670f86-ed62-4481-a665-ed911b1afb78 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:18.407195 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d2670f86-ed62-4481-a665-ed911b1afb78 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:18.429343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2670f86-ed62-4481-a665-ed911b1afb78 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:18.430198 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2670f86-ed62-4481-a665-ed911b1afb78 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:18.431795 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2670f86-ed62-4481-a665-ed911b1afb78 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:18.433580 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2670f86-ed62-4481-a665-ed911b1afb78 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:18.438812 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2670f86-ed62-4481-a665-ed911b1afb78 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:18.439402 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2670f86-ed62-4481-a665-ed911b1afb78 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:18.946546 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d2670f86-ed62-4481-a665-ed911b1afb78 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:18.956823 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d2670f86-ed62-4481-a665-ed911b1afb78 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180" status: 200 len: 1322 microversion: 2.1 time: 0.556857 Sep 10 11:55:18.973465 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1758/3525] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:18 2022] GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180 => generated 1322 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:18.993345 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-4843d986-3d43-4323-98db-fc86344da35e tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 8d231092-f981-47fe-9994-6fcb031c8a83] Updating instance_info_cache with network_info: [{"id": "8c8742ac-1c89-456c-9fd1-cc7ed178f4dd", "address": "fa:16:3e:ba:60:00", "network": {"id": "9f016ce0-94a4-441f-9715-493bd2b96018", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-332030758-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "093f44e4274f41c1882cf1a2167dc891", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8c8742ac-1c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128777) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 10 11:55:18.993949 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-75fab269-c359-471e-83c4-3ad96a156628 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:18.995276 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-75fab269-c359-471e-83c4-3ad96a156628 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: 9af45fd0-4f3b-480b-a33f-df501592594d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:19.014398 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4843d986-3d43-4323-98db-fc86344da35e tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Releasing lock "refresh_cache-8d231092-f981-47fe-9994-6fcb031c8a83" {{(pid=128777) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 10 11:55:19.015874 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4843d986-3d43-4323-98db-fc86344da35e tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "POST /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83/action" status: 202 len: 0 microversion: 2.1 time: 4.496468 Sep 10 11:55:19.017965 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75fab269-c359-471e-83c4-3ad96a156628 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:19.020504 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1768/3526] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:55:14 2022] POST /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83/action => generated 0 bytes in 4502 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 10 11:55:19.021188 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75fab269-c359-471e-83c4-3ad96a156628 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:19.022277 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75fab269-c359-471e-83c4-3ad96a156628 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:19.025285 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75fab269-c359-471e-83c4-3ad96a156628 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:19.026352 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75fab269-c359-471e-83c4-3ad96a156628 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:19.027040 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75fab269-c359-471e-83c4-3ad96a156628 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:19.032848 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ac841c49-f8c2-4ceb-8b30-f04c3a092745 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:19.033493 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ac841c49-f8c2-4ceb-8b30-f04c3a092745 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 6f2872c7-ac86-4764-9db6-96eece78150f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:19.056190 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac841c49-f8c2-4ceb-8b30-f04c3a092745 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:19.056724 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac841c49-f8c2-4ceb-8b30-f04c3a092745 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:19.057161 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac841c49-f8c2-4ceb-8b30-f04c3a092745 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:19.058087 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac841c49-f8c2-4ceb-8b30-f04c3a092745 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:19.060183 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac841c49-f8c2-4ceb-8b30-f04c3a092745 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:19.061438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac841c49-f8c2-4ceb-8b30-f04c3a092745 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:19.132388 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-75fab269-c359-471e-83c4-3ad96a156628 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:19.144335 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-75fab269-c359-471e-83c4-3ad96a156628 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d" status: 200 len: 1265 microversion: 2.1 time: 0.166947 Sep 10 11:55:19.145253 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1759/3527] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:18 2022] GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:19.156731 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b38ec209-99a1-4555-87f4-700cc575e98a tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:19.157243 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b38ec209-99a1-4555-87f4-700cc575e98a tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 43e1acba-4c0e-4f89-8d03-e9dcb388c1ef] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:19.167895 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b38ec209-99a1-4555-87f4-700cc575e98a tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:19.168391 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b38ec209-99a1-4555-87f4-700cc575e98a tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:19.168885 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b38ec209-99a1-4555-87f4-700cc575e98a tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:19.169597 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b38ec209-99a1-4555-87f4-700cc575e98a tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:19.183946 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b38ec209-99a1-4555-87f4-700cc575e98a tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:19.184453 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b38ec209-99a1-4555-87f4-700cc575e98a tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:19.198663 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-b38ec209-99a1-4555-87f4-700cc575e98a tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] HTTP exception thrown: Instance 43e1acba-4c0e-4f89-8d03-e9dcb388c1ef could not be found. Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b38ec209-99a1-4555-87f4-700cc575e98a tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Request method failure captured: Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/servers/43e1acba-4c0e-4f89-8d03-e9dcb388c1ef HTTP/1.1 Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHq5BkZgPX7f6T3ZvNM6KJTwUEF_P2Poy5J694hoS3GODhtDTXc9TLop2ydCIrCdON696HV3srZ1xFjcF9dfWk1t_YvL_c6JBS1rBLsIW8vVfzIG_z2OxCl_TfHcLpLsqkM0k2pGMBaNThNNyQZaXkcjZXdT98s1AdJUVDCAfkwkKW0 Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 093f44e4274f41c1882cf1a2167dc891 Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1464892634 Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/093f44e4274f41c1882cf1a2167dc891"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/093f44e4274f41c1882cf1a2167dc891"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_093f44e4274f41c1882cf1a2167dc891", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/093f44e4274f41c1882cf1a2167dc891"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1464892634 Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 093f44e4274f41c1882cf1a2167dc891 Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1464892634 Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-FloatingIPsAssociationTestJSON-1464892634-project Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 4318416fa33b40ae98c8c35675b0c101 Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1464892634-project Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 43e1acba-4c0e-4f89-8d03-e9dcb388c1ef could not be found. Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '43e1acba-4c0e-4f89-8d03-e9dcb388c1ef'} Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43e1acba-4c0e-4f89-8d03-e9dcb388c1ef could not be found. Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:55:19.206288 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:55:19.213152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43e1acba-4c0e-4f89-8d03-e9dcb388c1ef could not be found. Sep 10 11:55:19.213152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:55:19.213152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:55:19.213152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:55:19.213152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:55:19.213152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:55:19.213152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:55:19.213152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:55:19.213152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:55:19.213152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43e1acba-4c0e-4f89-8d03-e9dcb388c1ef could not be found. Sep 10 11:55:19.213152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:55:19.213152 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b38ec209-99a1-4555-87f4-700cc575e98a tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Returning 404 to user: Instance 43e1acba-4c0e-4f89-8d03-e9dcb388c1ef could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:55:19.213152 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b38ec209-99a1-4555-87f4-700cc575e98a tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "DELETE /compute/v2.1/servers/43e1acba-4c0e-4f89-8d03-e9dcb388c1ef" status: 404 len: 111 microversion: 2.1 time: 0.061596 Sep 10 11:55:19.213152 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1760/3528] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:55:19 2022] DELETE /compute/v2.1/servers/43e1acba-4c0e-4f89-8d03-e9dcb388c1ef => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:55:19.217693 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9eb7fdf5-fefd-438a-b17c-44b24b263c93 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:19.218328 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9eb7fdf5-fefd-438a-b17c-44b24b263c93 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 43e1acba-4c0e-4f89-8d03-e9dcb388c1ef] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:19.236522 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9eb7fdf5-fefd-438a-b17c-44b24b263c93 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:19.237016 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9eb7fdf5-fefd-438a-b17c-44b24b263c93 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:19.241656 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9eb7fdf5-fefd-438a-b17c-44b24b263c93 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:19.242610 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9eb7fdf5-fefd-438a-b17c-44b24b263c93 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:19.243285 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9eb7fdf5-fefd-438a-b17c-44b24b263c93 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:19.243921 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9eb7fdf5-fefd-438a-b17c-44b24b263c93 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:19.266451 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-9eb7fdf5-fefd-438a-b17c-44b24b263c93 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] HTTP exception thrown: Instance 43e1acba-4c0e-4f89-8d03-e9dcb388c1ef could not be found. Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9eb7fdf5-fefd-438a-b17c-44b24b263c93 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Request method failure captured: Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/43e1acba-4c0e-4f89-8d03-e9dcb388c1ef HTTP/1.1 Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHq5BkZgPX7f6T3ZvNM6KJTwUEF_P2Poy5J694hoS3GODhtDTXc9TLop2ydCIrCdON696HV3srZ1xFjcF9dfWk1t_YvL_c6JBS1rBLsIW8vVfzIG_z2OxCl_TfHcLpLsqkM0k2pGMBaNThNNyQZaXkcjZXdT98s1AdJUVDCAfkwkKW0 Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 093f44e4274f41c1882cf1a2167dc891 Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1464892634 Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/093f44e4274f41c1882cf1a2167dc891"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/093f44e4274f41c1882cf1a2167dc891"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_093f44e4274f41c1882cf1a2167dc891", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/093f44e4274f41c1882cf1a2167dc891"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1464892634 Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 093f44e4274f41c1882cf1a2167dc891 Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1464892634 Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-FloatingIPsAssociationTestJSON-1464892634-project Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 4318416fa33b40ae98c8c35675b0c101 Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1464892634-project Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 43e1acba-4c0e-4f89-8d03-e9dcb388c1ef could not be found. Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '43e1acba-4c0e-4f89-8d03-e9dcb388c1ef'} Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43e1acba-4c0e-4f89-8d03-e9dcb388c1ef could not be found. Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43e1acba-4c0e-4f89-8d03-e9dcb388c1ef could not be found. Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:55:19.287105 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:55:19.292674 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:55:19.292674 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:55:19.292674 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:55:19.292674 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:55:19.292674 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:55:19.292674 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:55:19.292674 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43e1acba-4c0e-4f89-8d03-e9dcb388c1ef could not be found. Sep 10 11:55:19.292674 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:55:19.292674 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9eb7fdf5-fefd-438a-b17c-44b24b263c93 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Returning 404 to user: Instance 43e1acba-4c0e-4f89-8d03-e9dcb388c1ef could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:55:19.294094 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9eb7fdf5-fefd-438a-b17c-44b24b263c93 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "GET /compute/v2.1/servers/43e1acba-4c0e-4f89-8d03-e9dcb388c1ef" status: 404 len: 111 microversion: 2.1 time: 0.080099 Sep 10 11:55:19.295399 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1761/3529] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:19 2022] GET /compute/v2.1/servers/43e1acba-4c0e-4f89-8d03-e9dcb388c1ef => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:55:19.305416 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ec28de67-79fc-4e6d-a898-2d6c81ced7eb tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Calling method '.version_select at 0x7f407b5ea5e0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:19.534913 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ac841c49-f8c2-4ceb-8b30-f04c3a092745 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:19.554440 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ac841c49-f8c2-4ceb-8b30-f04c3a092745 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f" status: 200 len: 1355 microversion: 2.1 time: 0.532700 Sep 10 11:55:19.555073 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1769/3530] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:19 2022] GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f => generated 1355 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:19.565532 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-5c069a1a-ac97-479b-b16d-84b3b75f24ae req-d183d7af-6a1f-4fc0-99db-9b7029965e0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3157819-80a0-4ca3-9ad5-fe790fb7b2a1", "tag": "7bf6d662-b9fe-4268-a377-ea1147808f0f"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:19.613883 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-5c069a1a-ac97-479b-b16d-84b3b75f24ae req-d183d7af-6a1f-4fc0-99db-9b7029965e0c service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:19.617470 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-5c069a1a-ac97-479b-b16d-84b3b75f24ae req-d183d7af-6a1f-4fc0-99db-9b7029965e0c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:19.619738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-5c069a1a-ac97-479b-b16d-84b3b75f24ae req-d183d7af-6a1f-4fc0-99db-9b7029965e0c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:19.655354 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-5c069a1a-ac97-479b-b16d-84b3b75f24ae req-d183d7af-6a1f-4fc0-99db-9b7029965e0c service nova] Creating event network-changed:7bf6d662-b9fe-4268-a377-ea1147808f0f for instance e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 on n-h1-856895-1 Sep 10 11:55:19.667319 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-5c069a1a-ac97-479b-b16d-84b3b75f24ae req-d183d7af-6a1f-4fc0-99db-9b7029965e0c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108680 Sep 10 11:55:19.670676 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1770/3531] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:55:19.687182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-301bce8d-fd06-4ed2-975e-89974df95914 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:19.688661 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-301bce8d-fd06-4ed2-975e-89974df95914 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: e3157819-80a0-4ca3-9ad5-fe790fb7b2a1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:19.697167 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-301bce8d-fd06-4ed2-975e-89974df95914 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:19.697956 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-301bce8d-fd06-4ed2-975e-89974df95914 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:19.698611 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-301bce8d-fd06-4ed2-975e-89974df95914 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:19.713150 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-301bce8d-fd06-4ed2-975e-89974df95914 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:19.717904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-301bce8d-fd06-4ed2-975e-89974df95914 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:19.720006 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-301bce8d-fd06-4ed2-975e-89974df95914 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:19.755682 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=68,nova_cell1:SAVEPOINT=5,nova_cell1:UPDATE=4,nova_cell1:RELEASE=5 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:55:20.138684 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-301bce8d-fd06-4ed2-975e-89974df95914 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:20.150895 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-301bce8d-fd06-4ed2-975e-89974df95914 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/e3157819-80a0-4ca3-9ad5-fe790fb7b2a1" status: 200 len: 1315 microversion: 2.1 time: 0.476843 Sep 10 11:55:20.152154 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1771/3532] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:19 2022] GET /compute/v2.1/servers/e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 => generated 1315 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:20.158120 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-810de73e-4074-425a-be30-a2461708bf2d req-78fedf49-716e-4eb2-9807-06eac2abe767 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d231092-f981-47fe-9994-6fcb031c8a83", "tag": "8c8742ac-1c89-456c-9fd1-cc7ed178f4dd"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:20.174114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-810de73e-4074-425a-be30-a2461708bf2d req-78fedf49-716e-4eb2-9807-06eac2abe767 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:20.174873 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-810de73e-4074-425a-be30-a2461708bf2d req-78fedf49-716e-4eb2-9807-06eac2abe767 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:20.175658 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-810de73e-4074-425a-be30-a2461708bf2d req-78fedf49-716e-4eb2-9807-06eac2abe767 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:20.190832 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-810de73e-4074-425a-be30-a2461708bf2d req-78fedf49-716e-4eb2-9807-06eac2abe767 service nova] Creating event network-changed:8c8742ac-1c89-456c-9fd1-cc7ed178f4dd for instance 8d231092-f981-47fe-9994-6fcb031c8a83 on n-h1-856895-1 Sep 10 11:55:20.198841 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-810de73e-4074-425a-be30-a2461708bf2d req-78fedf49-716e-4eb2-9807-06eac2abe767 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044848 Sep 10 11:55:20.201558 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1772/3533] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:55:20.209017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-76ae697a-267a-4453-88d1-7041a1b73a7b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:20.210237 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-76ae697a-267a-4453-88d1-7041a1b73a7b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:20.220514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-76ae697a-267a-4453-88d1-7041a1b73a7b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:20.221966 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-76ae697a-267a-4453-88d1-7041a1b73a7b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:20.222758 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-76ae697a-267a-4453-88d1-7041a1b73a7b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:20.224434 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-76ae697a-267a-4453-88d1-7041a1b73a7b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:20.225390 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-76ae697a-267a-4453-88d1-7041a1b73a7b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:20.226336 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-76ae697a-267a-4453-88d1-7041a1b73a7b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:20.569860 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-76ae697a-267a-4453-88d1-7041a1b73a7b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:20.580238 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-76ae697a-267a-4453-88d1-7041a1b73a7b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180" status: 200 len: 1322 microversion: 2.1 time: 0.375374 Sep 10 11:55:20.581146 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1773/3534] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:20 2022] GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180 => generated 1322 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:20.586045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ef6aebeb-6271-4f35-a024-5d852e13dab0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:20.586933 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ef6aebeb-6271-4f35-a024-5d852e13dab0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: 9af45fd0-4f3b-480b-a33f-df501592594d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:20.601638 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ef6aebeb-6271-4f35-a024-5d852e13dab0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:20.602623 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ef6aebeb-6271-4f35-a024-5d852e13dab0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:20.605430 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ef6aebeb-6271-4f35-a024-5d852e13dab0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:20.607036 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ef6aebeb-6271-4f35-a024-5d852e13dab0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:20.609042 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ef6aebeb-6271-4f35-a024-5d852e13dab0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:20.609761 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ef6aebeb-6271-4f35-a024-5d852e13dab0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:20.718898 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ec28de67-79fc-4e6d-a898-2d6c81ced7eb tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "DELETE /compute/v2.1/os-floating-ips/2b0d333c-98f3-4ed4-8c50-c9f5aaedb9c7" status: 202 len: 0 microversion: 2.1 time: 1.418917 Sep 10 11:55:20.720881 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1762/3535] 10.222.0.23 () {58 vars in 1263 bytes} [Sat Sep 10 11:55:19 2022] DELETE /compute/v2.1/os-floating-ips/2b0d333c-98f3-4ed4-8c50-c9f5aaedb9c7 => generated 0 bytes in 1422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:55:20.724403 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ef6aebeb-6271-4f35-a024-5d852e13dab0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:20.729185 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-9fcfdbe6-ad10-42d2-8b6b-a616fece2148 req-8c11f55d-2dc0-4706-92fa-60937f127dd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f2872c7-ac86-4764-9db6-96eece78150f", "name": "network-vif-plugged", "status": "completed", "tag": "274b11cc-1af8-42d8-8bfd-b3d105469cd7"}, {"server_uuid": "6f2872c7-ac86-4764-9db6-96eece78150f", "name": "network-vif-plugged", "status": "completed", "tag": "68d1b2dc-eb73-4a5b-913e-098bd9786d52"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:20.744885 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-9fcfdbe6-ad10-42d2-8b6b-a616fece2148 req-8c11f55d-2dc0-4706-92fa-60937f127dd5 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:20.745370 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-9fcfdbe6-ad10-42d2-8b6b-a616fece2148 req-8c11f55d-2dc0-4706-92fa-60937f127dd5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:20.745799 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-9fcfdbe6-ad10-42d2-8b6b-a616fece2148 req-8c11f55d-2dc0-4706-92fa-60937f127dd5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:20.746127 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ef6aebeb-6271-4f35-a024-5d852e13dab0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d" status: 200 len: 1271 microversion: 2.1 time: 0.163362 Sep 10 11:55:20.747560 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1774/3536] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:20 2022] GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d => generated 1271 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:20.754439 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a01cb86f-82c1-4b8a-a5aa-80a26634cfad tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:20.756358 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a01cb86f-82c1-4b8a-a5aa-80a26634cfad tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 6f2872c7-ac86-4764-9db6-96eece78150f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:20.769053 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a01cb86f-82c1-4b8a-a5aa-80a26634cfad tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:20.769745 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a01cb86f-82c1-4b8a-a5aa-80a26634cfad tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:20.770517 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a01cb86f-82c1-4b8a-a5aa-80a26634cfad tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:20.772022 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a01cb86f-82c1-4b8a-a5aa-80a26634cfad tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:20.772778 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a01cb86f-82c1-4b8a-a5aa-80a26634cfad tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:20.773380 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a01cb86f-82c1-4b8a-a5aa-80a26634cfad tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:20.777453 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-9fcfdbe6-ad10-42d2-8b6b-a616fece2148 req-8c11f55d-2dc0-4706-92fa-60937f127dd5 service nova] Creating event network-vif-plugged:274b11cc-1af8-42d8-8bfd-b3d105469cd7 for instance 6f2872c7-ac86-4764-9db6-96eece78150f on n-h1-856895-1 Sep 10 11:55:20.778705 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-9fcfdbe6-ad10-42d2-8b6b-a616fece2148 req-8c11f55d-2dc0-4706-92fa-60937f127dd5 service nova] Creating event network-vif-plugged:68d1b2dc-eb73-4a5b-913e-098bd9786d52 for instance 6f2872c7-ac86-4764-9db6-96eece78150f on n-h1-856895-1 Sep 10 11:55:20.787079 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-9fcfdbe6-ad10-42d2-8b6b-a616fece2148 req-8c11f55d-2dc0-4706-92fa-60937f127dd5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.062026 Sep 10 11:55:20.791147 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1763/3537] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:55:20.797803 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8fff7a69-43e9-407d-9e32-01b7abdfeb32 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:20.798410 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8fff7a69-43e9-407d-9e32-01b7abdfeb32 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 8d231092-f981-47fe-9994-6fcb031c8a83] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:20.809007 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8fff7a69-43e9-407d-9e32-01b7abdfeb32 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:20.809697 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8fff7a69-43e9-407d-9e32-01b7abdfeb32 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:20.819561 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8fff7a69-43e9-407d-9e32-01b7abdfeb32 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:20.820675 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8fff7a69-43e9-407d-9e32-01b7abdfeb32 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:20.821486 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8fff7a69-43e9-407d-9e32-01b7abdfeb32 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:20.822087 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8fff7a69-43e9-407d-9e32-01b7abdfeb32 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:20.884039 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8fff7a69-43e9-407d-9e32-01b7abdfeb32 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 8d231092-f981-47fe-9994-6fcb031c8a83] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:55:21.029221 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a01cb86f-82c1-4b8a-a5aa-80a26634cfad tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:21.039090 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a01cb86f-82c1-4b8a-a5aa-80a26634cfad tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f" status: 200 len: 1355 microversion: 2.1 time: 0.290230 Sep 10 11:55:21.040615 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1775/3538] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:20 2022] GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f => generated 1355 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:21.072674 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8fff7a69-43e9-407d-9e32-01b7abdfeb32 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83" status: 204 len: 0 microversion: 2.1 time: 0.278864 Sep 10 11:55:21.078695 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1764/3539] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:55:20 2022] DELETE /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:55:21.083148 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-20ede5a3-b8a1-41a9-96ec-0386aee110cb tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:21.083793 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-20ede5a3-b8a1-41a9-96ec-0386aee110cb tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 8d231092-f981-47fe-9994-6fcb031c8a83] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:21.092492 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-20ede5a3-b8a1-41a9-96ec-0386aee110cb tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:21.093044 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-20ede5a3-b8a1-41a9-96ec-0386aee110cb tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:21.093695 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-20ede5a3-b8a1-41a9-96ec-0386aee110cb tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:21.095008 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-20ede5a3-b8a1-41a9-96ec-0386aee110cb tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:21.095871 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-20ede5a3-b8a1-41a9-96ec-0386aee110cb tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:21.096529 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-20ede5a3-b8a1-41a9-96ec-0386aee110cb tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:21.174688 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-79d98fbb-2f11-487a-8765-e0a1669e2356 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:21.176211 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-79d98fbb-2f11-487a-8765-e0a1669e2356 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: e3157819-80a0-4ca3-9ad5-fe790fb7b2a1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:21.183880 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79d98fbb-2f11-487a-8765-e0a1669e2356 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:21.185135 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79d98fbb-2f11-487a-8765-e0a1669e2356 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:21.185831 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79d98fbb-2f11-487a-8765-e0a1669e2356 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:21.186641 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79d98fbb-2f11-487a-8765-e0a1669e2356 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:21.187374 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79d98fbb-2f11-487a-8765-e0a1669e2356 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:21.188034 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79d98fbb-2f11-487a-8765-e0a1669e2356 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:21.294877 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-20ede5a3-b8a1-41a9-96ec-0386aee110cb tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318416fa33b40ae98c8c35675b0c101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f44e4274f41c1882cf1a2167dc891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:21.305965 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-20ede5a3-b8a1-41a9-96ec-0386aee110cb tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "GET /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83" status: 200 len: 1525 microversion: 2.1 time: 0.226646 Sep 10 11:55:21.321365 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1776/3540] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:21 2022] GET /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83 => generated 1525 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:21.388500 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-79d98fbb-2f11-487a-8765-e0a1669e2356 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:21.397239 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-79d98fbb-2f11-487a-8765-e0a1669e2356 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/e3157819-80a0-4ca3-9ad5-fe790fb7b2a1" status: 200 len: 1315 microversion: 2.1 time: 0.226733 Sep 10 11:55:21.400308 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1765/3541] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:21 2022] GET /compute/v2.1/servers/e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:55:21.605508 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-60979974-5f1a-49a4-ba7c-8b3a3561a6ca tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:21.607001 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-60979974-5f1a-49a4-ba7c-8b3a3561a6ca tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:21.624359 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-60979974-5f1a-49a4-ba7c-8b3a3561a6ca tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:21.625231 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-60979974-5f1a-49a4-ba7c-8b3a3561a6ca tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:21.634892 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-60979974-5f1a-49a4-ba7c-8b3a3561a6ca tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:21.635972 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-60979974-5f1a-49a4-ba7c-8b3a3561a6ca tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:21.636631 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-60979974-5f1a-49a4-ba7c-8b3a3561a6ca tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:21.637799 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-60979974-5f1a-49a4-ba7c-8b3a3561a6ca tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:21.773399 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9d8c97c9-1fe2-4e29-810c-d766d36c3995 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:21.774352 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9d8c97c9-1fe2-4e29-810c-d766d36c3995 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: 9af45fd0-4f3b-480b-a33f-df501592594d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:21.795334 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d8c97c9-1fe2-4e29-810c-d766d36c3995 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:21.796262 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d8c97c9-1fe2-4e29-810c-d766d36c3995 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:21.796989 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d8c97c9-1fe2-4e29-810c-d766d36c3995 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:21.797975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d8c97c9-1fe2-4e29-810c-d766d36c3995 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:21.798667 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d8c97c9-1fe2-4e29-810c-d766d36c3995 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:21.799371 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d8c97c9-1fe2-4e29-810c-d766d36c3995 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:22.239223 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-60979974-5f1a-49a4-ba7c-8b3a3561a6ca tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:22.253851 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-60979974-5f1a-49a4-ba7c-8b3a3561a6ca tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180" status: 200 len: 1515 microversion: 2.1 time: 0.652227 Sep 10 11:55:22.257235 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1777/3542] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:21 2022] GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180 => generated 1515 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:22.265953 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-aa9c02c3-4085-4e12-a687-3c32c2f90b45 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:22.267045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-aa9c02c3-4085-4e12-a687-3c32c2f90b45 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 6f2872c7-ac86-4764-9db6-96eece78150f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:22.275283 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa9c02c3-4085-4e12-a687-3c32c2f90b45 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:22.276230 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa9c02c3-4085-4e12-a687-3c32c2f90b45 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:22.277057 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa9c02c3-4085-4e12-a687-3c32c2f90b45 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:22.278037 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa9c02c3-4085-4e12-a687-3c32c2f90b45 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:22.278723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa9c02c3-4085-4e12-a687-3c32c2f90b45 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:22.279638 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa9c02c3-4085-4e12-a687-3c32c2f90b45 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:22.298277 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9d8c97c9-1fe2-4e29-810c-d766d36c3995 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:22.309842 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9d8c97c9-1fe2-4e29-810c-d766d36c3995 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d" status: 200 len: 1313 microversion: 2.1 time: 0.539639 Sep 10 11:55:22.311969 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1766/3543] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:21 2022] GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d => generated 1313 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:55:22.325471 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2cd064cf-e86c-48fc-9edb-56c67badf270 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:22.331398 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2cd064cf-e86c-48fc-9edb-56c67badf270 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:22.346837 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2cd064cf-e86c-48fc-9edb-56c67badf270 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:22.349398 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2cd064cf-e86c-48fc-9edb-56c67badf270 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:22.349667 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2cd064cf-e86c-48fc-9edb-56c67badf270 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:22.351888 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2cd064cf-e86c-48fc-9edb-56c67badf270 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:22.361621 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2cd064cf-e86c-48fc-9edb-56c67badf270 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:22.362411 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2cd064cf-e86c-48fc-9edb-56c67badf270 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:22.403269 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-2cd064cf-e86c-48fc-9edb-56c67badf270 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lazy-loading 'flavor' on Instance uuid 84f2edbd-a437-474e-bd57-10814851e180 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:55:22.515621 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:55:22.568894 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2cd064cf-e86c-48fc-9edb-56c67badf270 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "POST /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180/action" status: 200 len: 32 microversion: 2.1 time: 0.252092 Sep 10 11:55:22.569920 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1767/3544] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:55:22 2022] POST /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180/action => generated 32 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:55:22.583072 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a45741e7-9f11-4e29-9e58-9a6c074f49aa tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:22.586096 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a45741e7-9f11-4e29-9e58-9a6c074f49aa tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 8d231092-f981-47fe-9994-6fcb031c8a83] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:22.609130 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a45741e7-9f11-4e29-9e58-9a6c074f49aa tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:22.609694 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a45741e7-9f11-4e29-9e58-9a6c074f49aa tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:22.610153 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a45741e7-9f11-4e29-9e58-9a6c074f49aa tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:22.623005 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a45741e7-9f11-4e29-9e58-9a6c074f49aa tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:22.626505 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a45741e7-9f11-4e29-9e58-9a6c074f49aa tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:22.628766 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a45741e7-9f11-4e29-9e58-9a6c074f49aa tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:22.708478 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-aa9c02c3-4085-4e12-a687-3c32c2f90b45 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:22.720585 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-aa9c02c3-4085-4e12-a687-3c32c2f90b45 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f" status: 200 len: 1355 microversion: 2.1 time: 0.462120 Sep 10 11:55:22.726802 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1778/3545] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:22 2022] GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f => generated 1355 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:22.735008 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0428e887-9ecb-4955-befb-50401d5c2242 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:22.738105 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0428e887-9ecb-4955-befb-50401d5c2242 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: e3157819-80a0-4ca3-9ad5-fe790fb7b2a1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:22.764685 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0428e887-9ecb-4955-befb-50401d5c2242 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:22.765483 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0428e887-9ecb-4955-befb-50401d5c2242 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:22.767355 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0428e887-9ecb-4955-befb-50401d5c2242 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:22.771075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0428e887-9ecb-4955-befb-50401d5c2242 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:22.771898 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0428e887-9ecb-4955-befb-50401d5c2242 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:22.772519 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0428e887-9ecb-4955-befb-50401d5c2242 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:23.022444 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a45741e7-9f11-4e29-9e58-9a6c074f49aa tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318416fa33b40ae98c8c35675b0c101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f44e4274f41c1882cf1a2167dc891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:23.035707 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a45741e7-9f11-4e29-9e58-9a6c074f49aa tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "GET /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83" status: 200 len: 1525 microversion: 2.1 time: 0.464682 Sep 10 11:55:23.036730 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1768/3546] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:22 2022] GET /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83 => generated 1525 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:23.052283 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c527f126-0f06-456b-a1e7-587d797638f0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:23.054831 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c527f126-0f06-456b-a1e7-587d797638f0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:23.068323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c527f126-0f06-456b-a1e7-587d797638f0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:23.068617 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0428e887-9ecb-4955-befb-50401d5c2242 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:23.069154 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c527f126-0f06-456b-a1e7-587d797638f0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:23.071449 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c527f126-0f06-456b-a1e7-587d797638f0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:23.072477 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c527f126-0f06-456b-a1e7-587d797638f0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:23.073437 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c527f126-0f06-456b-a1e7-587d797638f0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:23.074161 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c527f126-0f06-456b-a1e7-587d797638f0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:23.079423 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0428e887-9ecb-4955-befb-50401d5c2242 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/e3157819-80a0-4ca3-9ad5-fe790fb7b2a1" status: 200 len: 1315 microversion: 2.1 time: 0.351229 Sep 10 11:55:23.086540 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1779/3547] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:22 2022] GET /compute/v2.1/servers/e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 => generated 1315 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:23.086991 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-d4fd6483-865d-4f4a-9a94-3985132b591a req-604e6ac6-c1f8-4797-9fbf-d96f2a2cc7af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f2872c7-ac86-4764-9db6-96eece78150f", "name": "network-vif-plugged", "status": "completed", "tag": "d6f5febb-95cd-42ed-8a3f-6d78c2e14ad9"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:23.101569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d4fd6483-865d-4f4a-9a94-3985132b591a req-604e6ac6-c1f8-4797-9fbf-d96f2a2cc7af service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:23.102895 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d4fd6483-865d-4f4a-9a94-3985132b591a req-604e6ac6-c1f8-4797-9fbf-d96f2a2cc7af service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:23.103408 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d4fd6483-865d-4f4a-9a94-3985132b591a req-604e6ac6-c1f8-4797-9fbf-d96f2a2cc7af service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:23.120803 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-d4fd6483-865d-4f4a-9a94-3985132b591a req-604e6ac6-c1f8-4797-9fbf-d96f2a2cc7af service nova] Creating event network-vif-plugged:d6f5febb-95cd-42ed-8a3f-6d78c2e14ad9 for instance 6f2872c7-ac86-4764-9db6-96eece78150f on n-h1-856895-1 Sep 10 11:55:23.129757 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-d4fd6483-865d-4f4a-9a94-3985132b591a req-604e6ac6-c1f8-4797-9fbf-d96f2a2cc7af service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047085 Sep 10 11:55:23.133890 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1780/3548] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:55:23.309002 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-c3e2698f-4919-4218-bbc7-11822e9951a7 req-fc000cf5-e502-4b85-aba9-83d26ba6cde1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9af45fd0-4f3b-480b-a33f-df501592594d", "tag": "951e4435-a89e-490e-85f0-419e66b7de3a"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:23.335066 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-c3e2698f-4919-4218-bbc7-11822e9951a7 req-fc000cf5-e502-4b85-aba9-83d26ba6cde1 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:23.335731 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-c3e2698f-4919-4218-bbc7-11822e9951a7 req-fc000cf5-e502-4b85-aba9-83d26ba6cde1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:23.336713 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-c3e2698f-4919-4218-bbc7-11822e9951a7 req-fc000cf5-e502-4b85-aba9-83d26ba6cde1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:23.355685 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-c3e2698f-4919-4218-bbc7-11822e9951a7 req-fc000cf5-e502-4b85-aba9-83d26ba6cde1 service nova] Creating event network-changed:951e4435-a89e-490e-85f0-419e66b7de3a for instance 9af45fd0-4f3b-480b-a33f-df501592594d on n-h2-856895-1 Sep 10 11:55:23.361043 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-c3e2698f-4919-4218-bbc7-11822e9951a7 req-fc000cf5-e502-4b85-aba9-83d26ba6cde1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059452 Sep 10 11:55:23.362402 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1781/3549] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:55:23.368695 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-802ace14-1732-4a0e-a305-56a8c1bc9d00 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:23.370620 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-802ace14-1732-4a0e-a305-56a8c1bc9d00 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: 9af45fd0-4f3b-480b-a33f-df501592594d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:23.373310 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c527f126-0f06-456b-a1e7-587d797638f0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:23.379115 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-802ace14-1732-4a0e-a305-56a8c1bc9d00 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:23.379748 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-802ace14-1732-4a0e-a305-56a8c1bc9d00 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:23.380455 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-802ace14-1732-4a0e-a305-56a8c1bc9d00 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:23.381058 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c527f126-0f06-456b-a1e7-587d797638f0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180" status: 200 len: 1521 microversion: 2.1 time: 0.343193 Sep 10 11:55:23.381640 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1769/3550] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:23 2022] GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180 => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:23.382145 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-802ace14-1732-4a0e-a305-56a8c1bc9d00 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:23.384478 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-802ace14-1732-4a0e-a305-56a8c1bc9d00 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:23.385618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-802ace14-1732-4a0e-a305-56a8c1bc9d00 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:23.564510 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-802ace14-1732-4a0e-a305-56a8c1bc9d00 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:23.573051 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-802ace14-1732-4a0e-a305-56a8c1bc9d00 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d" status: 200 len: 1313 microversion: 2.1 time: 0.209155 Sep 10 11:55:23.576600 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1782/3551] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:23 2022] GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:23.753948 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9056c59a-0584-4105-855f-4a64d06c02a1 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:23.755323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9056c59a-0584-4105-855f-4a64d06c02a1 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 6f2872c7-ac86-4764-9db6-96eece78150f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:23.767537 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9056c59a-0584-4105-855f-4a64d06c02a1 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:23.768893 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9056c59a-0584-4105-855f-4a64d06c02a1 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:23.769598 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9056c59a-0584-4105-855f-4a64d06c02a1 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:23.771660 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9056c59a-0584-4105-855f-4a64d06c02a1 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:23.772523 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9056c59a-0584-4105-855f-4a64d06c02a1 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:23.772984 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9056c59a-0584-4105-855f-4a64d06c02a1 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:23.953711 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9056c59a-0584-4105-855f-4a64d06c02a1 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:23.962656 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9056c59a-0584-4105-855f-4a64d06c02a1 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f" status: 200 len: 1355 microversion: 2.1 time: 0.213036 Sep 10 11:55:23.963760 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1770/3552] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:23 2022] GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f => generated 1355 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:24.087217 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d1f601a8-c4c4-4971-9460-df4c007ac64d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:24.087881 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d1f601a8-c4c4-4971-9460-df4c007ac64d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 8d231092-f981-47fe-9994-6fcb031c8a83] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:24.096514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1f601a8-c4c4-4971-9460-df4c007ac64d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:24.097010 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1f601a8-c4c4-4971-9460-df4c007ac64d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:24.097451 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1f601a8-c4c4-4971-9460-df4c007ac64d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:24.098405 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1f601a8-c4c4-4971-9460-df4c007ac64d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:24.098864 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1f601a8-c4c4-4971-9460-df4c007ac64d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:24.099318 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1f601a8-c4c4-4971-9460-df4c007ac64d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:24.114968 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b47e5d95-7a92-4960-a324-59d1d5a2c351 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:24.116525 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b47e5d95-7a92-4960-a324-59d1d5a2c351 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: e3157819-80a0-4ca3-9ad5-fe790fb7b2a1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:24.123792 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b47e5d95-7a92-4960-a324-59d1d5a2c351 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:24.124341 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b47e5d95-7a92-4960-a324-59d1d5a2c351 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:24.124883 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b47e5d95-7a92-4960-a324-59d1d5a2c351 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:24.126431 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b47e5d95-7a92-4960-a324-59d1d5a2c351 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:24.126903 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b47e5d95-7a92-4960-a324-59d1d5a2c351 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:24.127364 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b47e5d95-7a92-4960-a324-59d1d5a2c351 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:24.326924 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d1f601a8-c4c4-4971-9460-df4c007ac64d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318416fa33b40ae98c8c35675b0c101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f44e4274f41c1882cf1a2167dc891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:24.331289 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b47e5d95-7a92-4960-a324-59d1d5a2c351 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:24.335042 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d1f601a8-c4c4-4971-9460-df4c007ac64d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "GET /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83" status: 200 len: 1525 microversion: 2.1 time: 0.267080 Sep 10 11:55:24.335665 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1783/3553] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:24 2022] GET /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83 => generated 1525 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:24.341524 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b47e5d95-7a92-4960-a324-59d1d5a2c351 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/e3157819-80a0-4ca3-9ad5-fe790fb7b2a1" status: 200 len: 1315 microversion: 2.1 time: 0.231878 Sep 10 11:55:24.342094 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1771/3554] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:24 2022] GET /compute/v2.1/servers/e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:55:24.406859 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3b2418e1-0d35-4d83-89ce-4331f3dc7d92 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:24.407644 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3b2418e1-0d35-4d83-89ce-4331f3dc7d92 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:24.414945 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3b2418e1-0d35-4d83-89ce-4331f3dc7d92 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:24.415468 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3b2418e1-0d35-4d83-89ce-4331f3dc7d92 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:24.415905 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3b2418e1-0d35-4d83-89ce-4331f3dc7d92 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:24.416599 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3b2418e1-0d35-4d83-89ce-4331f3dc7d92 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:24.417051 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3b2418e1-0d35-4d83-89ce-4331f3dc7d92 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:24.417504 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3b2418e1-0d35-4d83-89ce-4331f3dc7d92 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:24.555593 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3b2418e1-0d35-4d83-89ce-4331f3dc7d92 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:24.566970 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3b2418e1-0d35-4d83-89ce-4331f3dc7d92 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180" status: 200 len: 1521 microversion: 2.1 time: 0.165450 Sep 10 11:55:24.567879 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1784/3555] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:24 2022] GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:24.596792 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2cf11848-f6fb-43d9-847a-0bf609fcea77 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:24.597360 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2cf11848-f6fb-43d9-847a-0bf609fcea77 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: 9af45fd0-4f3b-480b-a33f-df501592594d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:24.604875 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2cf11848-f6fb-43d9-847a-0bf609fcea77 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:24.605672 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2cf11848-f6fb-43d9-847a-0bf609fcea77 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:24.606833 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2cf11848-f6fb-43d9-847a-0bf609fcea77 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:24.607788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2cf11848-f6fb-43d9-847a-0bf609fcea77 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:24.608586 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2cf11848-f6fb-43d9-847a-0bf609fcea77 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:24.609365 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2cf11848-f6fb-43d9-847a-0bf609fcea77 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:24.842879 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2cf11848-f6fb-43d9-847a-0bf609fcea77 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:24.858720 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2cf11848-f6fb-43d9-847a-0bf609fcea77 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d" status: 200 len: 1313 microversion: 2.1 time: 0.265725 Sep 10 11:55:24.859978 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1772/3556] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:24 2022] GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:24.986120 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-52d9ec9c-7adb-493e-bcce-19a0bd1a370d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:24.986738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-52d9ec9c-7adb-493e-bcce-19a0bd1a370d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 6f2872c7-ac86-4764-9db6-96eece78150f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:24.994697 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-52d9ec9c-7adb-493e-bcce-19a0bd1a370d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:24.995201 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-52d9ec9c-7adb-493e-bcce-19a0bd1a370d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:24.995642 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-52d9ec9c-7adb-493e-bcce-19a0bd1a370d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:24.996347 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-52d9ec9c-7adb-493e-bcce-19a0bd1a370d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:24.997597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-52d9ec9c-7adb-493e-bcce-19a0bd1a370d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:24.997943 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-52d9ec9c-7adb-493e-bcce-19a0bd1a370d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:25.253866 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-52d9ec9c-7adb-493e-bcce-19a0bd1a370d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:25.264307 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-52d9ec9c-7adb-493e-bcce-19a0bd1a370d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f" status: 200 len: 1355 microversion: 2.1 time: 0.281904 Sep 10 11:55:25.275773 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1785/3557] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:24 2022] GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f => generated 1355 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:25.367576 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-12149e97-b7eb-4cde-a34c-c111abb8bdfb tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:25.368933 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-12149e97-b7eb-4cde-a34c-c111abb8bdfb tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: e3157819-80a0-4ca3-9ad5-fe790fb7b2a1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:25.371077 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ce804bc7-877d-4cad-a0b3-1af01446eb34 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:25.374457 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ce804bc7-877d-4cad-a0b3-1af01446eb34 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 8d231092-f981-47fe-9994-6fcb031c8a83] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:25.390576 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-12149e97-b7eb-4cde-a34c-c111abb8bdfb tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:25.391405 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-12149e97-b7eb-4cde-a34c-c111abb8bdfb tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:25.394862 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-12149e97-b7eb-4cde-a34c-c111abb8bdfb tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:25.396049 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-12149e97-b7eb-4cde-a34c-c111abb8bdfb tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:25.396954 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ce804bc7-877d-4cad-a0b3-1af01446eb34 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:25.398310 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ce804bc7-877d-4cad-a0b3-1af01446eb34 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:25.398876 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-12149e97-b7eb-4cde-a34c-c111abb8bdfb tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:25.399548 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-12149e97-b7eb-4cde-a34c-c111abb8bdfb tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:25.401269 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ce804bc7-877d-4cad-a0b3-1af01446eb34 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:25.404947 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ce804bc7-877d-4cad-a0b3-1af01446eb34 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:25.405744 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ce804bc7-877d-4cad-a0b3-1af01446eb34 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:25.407557 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ce804bc7-877d-4cad-a0b3-1af01446eb34 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:25.564238 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ce804bc7-877d-4cad-a0b3-1af01446eb34 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318416fa33b40ae98c8c35675b0c101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f44e4274f41c1882cf1a2167dc891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:25.580084 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ce804bc7-877d-4cad-a0b3-1af01446eb34 tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "GET /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83" status: 200 len: 1483 microversion: 2.1 time: 0.223003 Sep 10 11:55:25.591318 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1773/3558] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:25 2022] GET /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83 => generated 1483 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:25.592615 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f07b1e09-5f79-4f73-b5c0-df4027f880fd tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:25.593251 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f07b1e09-5f79-4f73-b5c0-df4027f880fd tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:25.607676 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f07b1e09-5f79-4f73-b5c0-df4027f880fd tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:25.608176 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f07b1e09-5f79-4f73-b5c0-df4027f880fd tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:25.608619 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f07b1e09-5f79-4f73-b5c0-df4027f880fd tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:25.609332 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f07b1e09-5f79-4f73-b5c0-df4027f880fd tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:25.609791 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f07b1e09-5f79-4f73-b5c0-df4027f880fd tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:25.610219 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f07b1e09-5f79-4f73-b5c0-df4027f880fd tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:25.795443 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-12149e97-b7eb-4cde-a34c-c111abb8bdfb tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:25.805368 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-12149e97-b7eb-4cde-a34c-c111abb8bdfb tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/e3157819-80a0-4ca3-9ad5-fe790fb7b2a1" status: 200 len: 1315 microversion: 2.1 time: 0.444104 Sep 10 11:55:25.806897 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1786/3559] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:25 2022] GET /compute/v2.1/servers/e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 => generated 1315 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:25.815976 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-a142d551-b8d9-4642-b105-909788ef4ef0 req-eba4f8b7-9e67-4081-a3c8-fc97a6a1f204 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d231092-f981-47fe-9994-6fcb031c8a83", "name": "network-vif-deleted", "tag": "8c8742ac-1c89-456c-9fd1-cc7ed178f4dd"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:25.825993 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f07b1e09-5f79-4f73-b5c0-df4027f880fd tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:25.830118 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a142d551-b8d9-4642-b105-909788ef4ef0 req-eba4f8b7-9e67-4081-a3c8-fc97a6a1f204 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:25.830830 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a142d551-b8d9-4642-b105-909788ef4ef0 req-eba4f8b7-9e67-4081-a3c8-fc97a6a1f204 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:25.831280 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a142d551-b8d9-4642-b105-909788ef4ef0 req-eba4f8b7-9e67-4081-a3c8-fc97a6a1f204 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:25.833655 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f07b1e09-5f79-4f73-b5c0-df4027f880fd tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180" status: 200 len: 1521 microversion: 2.1 time: 0.247630 Sep 10 11:55:25.834417 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1774/3560] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:25 2022] GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180 => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:25.859222 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-a142d551-b8d9-4642-b105-909788ef4ef0 req-eba4f8b7-9e67-4081-a3c8-fc97a6a1f204 service nova] Creating event network-vif-deleted:8c8742ac-1c89-456c-9fd1-cc7ed178f4dd for instance 8d231092-f981-47fe-9994-6fcb031c8a83 on n-h1-856895-1 Sep 10 11:55:25.865750 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-a142d551-b8d9-4642-b105-909788ef4ef0 req-eba4f8b7-9e67-4081-a3c8-fc97a6a1f204 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053172 Sep 10 11:55:25.866555 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1787/3561] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:55:25.886744 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b4f9b23c-5137-44fc-91b8-e12c1752431f tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:25.888111 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b4f9b23c-5137-44fc-91b8-e12c1752431f tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: 9af45fd0-4f3b-480b-a33f-df501592594d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:25.895930 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b4f9b23c-5137-44fc-91b8-e12c1752431f tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:25.896546 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b4f9b23c-5137-44fc-91b8-e12c1752431f tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:25.897063 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b4f9b23c-5137-44fc-91b8-e12c1752431f tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:25.897852 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b4f9b23c-5137-44fc-91b8-e12c1752431f tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:25.898411 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b4f9b23c-5137-44fc-91b8-e12c1752431f tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:25.898918 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b4f9b23c-5137-44fc-91b8-e12c1752431f tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:26.112933 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b4f9b23c-5137-44fc-91b8-e12c1752431f tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:26.127030 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b4f9b23c-5137-44fc-91b8-e12c1752431f tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d" status: 200 len: 1313 microversion: 2.1 time: 0.248722 Sep 10 11:55:26.128375 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1775/3562] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:25 2022] GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:26.296113 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-37838ee8-21af-43f2-92e5-b8f012200984 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:26.296837 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-37838ee8-21af-43f2-92e5-b8f012200984 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 6f2872c7-ac86-4764-9db6-96eece78150f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:26.307895 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-37838ee8-21af-43f2-92e5-b8f012200984 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:26.315647 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-37838ee8-21af-43f2-92e5-b8f012200984 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:26.316328 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-37838ee8-21af-43f2-92e5-b8f012200984 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:26.317194 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-37838ee8-21af-43f2-92e5-b8f012200984 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:26.317665 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-37838ee8-21af-43f2-92e5-b8f012200984 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:26.318309 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-37838ee8-21af-43f2-92e5-b8f012200984 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:26.499403 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-37838ee8-21af-43f2-92e5-b8f012200984 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:26.508438 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-37838ee8-21af-43f2-92e5-b8f012200984 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f" status: 200 len: 1355 microversion: 2.1 time: 0.219579 Sep 10 11:55:26.509437 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1788/3563] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:26 2022] GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f => generated 1355 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:26.609359 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-19fc72a2-80c6-48c7-8318-2e5a720e190d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:26.610083 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-19fc72a2-80c6-48c7-8318-2e5a720e190d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 8d231092-f981-47fe-9994-6fcb031c8a83] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:26.618054 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19fc72a2-80c6-48c7-8318-2e5a720e190d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:26.618850 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19fc72a2-80c6-48c7-8318-2e5a720e190d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:26.619393 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19fc72a2-80c6-48c7-8318-2e5a720e190d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:26.620185 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19fc72a2-80c6-48c7-8318-2e5a720e190d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:26.620699 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19fc72a2-80c6-48c7-8318-2e5a720e190d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:26.621467 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19fc72a2-80c6-48c7-8318-2e5a720e190d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:26.654740 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19fc72a2-80c6-48c7-8318-2e5a720e190d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:26.655348 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19fc72a2-80c6-48c7-8318-2e5a720e190d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:26.655688 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19fc72a2-80c6-48c7-8318-2e5a720e190d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:26.656244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-19fc72a2-80c6-48c7-8318-2e5a720e190d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lazy-loading 'fault' on Instance uuid 8d231092-f981-47fe-9994-6fcb031c8a83 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:55:26.722182 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-19fc72a2-80c6-48c7-8318-2e5a720e190d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4318416fa33b40ae98c8c35675b0c101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f44e4274f41c1882cf1a2167dc891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:26.734859 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-19fc72a2-80c6-48c7-8318-2e5a720e190d tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "GET /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83" status: 200 len: 1314 microversion: 2.1 time: 0.130539 Sep 10 11:55:26.736944 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1776/3564] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:26 2022] GET /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83 => generated 1314 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:26.830767 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b785bfe9-3a82-473f-829e-345e5df7406f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:26.831443 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b785bfe9-3a82-473f-829e-345e5df7406f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: e3157819-80a0-4ca3-9ad5-fe790fb7b2a1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:26.837394 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b785bfe9-3a82-473f-829e-345e5df7406f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:26.837887 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b785bfe9-3a82-473f-829e-345e5df7406f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:26.838339 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b785bfe9-3a82-473f-829e-345e5df7406f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:26.839144 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b785bfe9-3a82-473f-829e-345e5df7406f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:26.839628 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b785bfe9-3a82-473f-829e-345e5df7406f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:26.840065 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b785bfe9-3a82-473f-829e-345e5df7406f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:26.857702 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bf2ccfbb-11ae-4b5c-89f5-633151c80459 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:26.858322 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bf2ccfbb-11ae-4b5c-89f5-633151c80459 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:26.864556 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bf2ccfbb-11ae-4b5c-89f5-633151c80459 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:26.865331 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bf2ccfbb-11ae-4b5c-89f5-633151c80459 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:26.865768 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bf2ccfbb-11ae-4b5c-89f5-633151c80459 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:26.866600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bf2ccfbb-11ae-4b5c-89f5-633151c80459 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:26.867061 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bf2ccfbb-11ae-4b5c-89f5-633151c80459 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:26.867764 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bf2ccfbb-11ae-4b5c-89f5-633151c80459 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:27.000205 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=4 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:55:27.054360 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=12 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:55:27.127659 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b785bfe9-3a82-473f-829e-345e5df7406f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:27.139199 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b785bfe9-3a82-473f-829e-345e5df7406f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/e3157819-80a0-4ca3-9ad5-fe790fb7b2a1" status: 200 len: 1315 microversion: 2.1 time: 0.312230 Sep 10 11:55:27.139852 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1789/3565] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:26 2022] GET /compute/v2.1/servers/e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:27.151719 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-46b23984-a1af-461e-961b-39783f316532 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:27.152425 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-46b23984-a1af-461e-961b-39783f316532 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: 9af45fd0-4f3b-480b-a33f-df501592594d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:27.159666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46b23984-a1af-461e-961b-39783f316532 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:27.160152 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46b23984-a1af-461e-961b-39783f316532 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:27.160520 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bf2ccfbb-11ae-4b5c-89f5-633151c80459 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:27.160661 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46b23984-a1af-461e-961b-39783f316532 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:27.161339 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46b23984-a1af-461e-961b-39783f316532 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:27.161793 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46b23984-a1af-461e-961b-39783f316532 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:27.162213 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46b23984-a1af-461e-961b-39783f316532 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:27.170897 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bf2ccfbb-11ae-4b5c-89f5-633151c80459 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180" status: 200 len: 1521 microversion: 2.1 time: 0.317873 Sep 10 11:55:27.171726 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1777/3566] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:26 2022] GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180 => generated 1521 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:27.532666 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-de502893-52e0-43d4-8815-fe1bbd9fc8cd tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:27.533596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-de502893-52e0-43d4-8815-fe1bbd9fc8cd tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 6f2872c7-ac86-4764-9db6-96eece78150f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:27.535678 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:55:27.540876 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de502893-52e0-43d4-8815-fe1bbd9fc8cd tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:27.541374 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de502893-52e0-43d4-8815-fe1bbd9fc8cd tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:27.541817 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de502893-52e0-43d4-8815-fe1bbd9fc8cd tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:27.542537 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de502893-52e0-43d4-8815-fe1bbd9fc8cd tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:27.542983 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de502893-52e0-43d4-8815-fe1bbd9fc8cd tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:27.544022 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de502893-52e0-43d4-8815-fe1bbd9fc8cd tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:27.762108 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-46b23984-a1af-461e-961b-39783f316532 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:27.765131 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=100 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:55:27.773117 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-46b23984-a1af-461e-961b-39783f316532 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d" status: 200 len: 1313 microversion: 2.1 time: 0.624838 Sep 10 11:55:27.773918 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1790/3567] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:27 2022] GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d => generated 1313 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:55:27.795387 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-50b5a7fd-0b0b-4c52-b90d-a162d1d324f6 req-e5c4fb23-2e77-442a-aaf2-20707a0f81ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3157819-80a0-4ca3-9ad5-fe790fb7b2a1", "name": "network-vif-plugged", "status": "completed", "tag": "7bf6d662-b9fe-4268-a377-ea1147808f0f"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:27.811830 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-50b5a7fd-0b0b-4c52-b90d-a162d1d324f6 req-e5c4fb23-2e77-442a-aaf2-20707a0f81ae service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:27.812308 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-50b5a7fd-0b0b-4c52-b90d-a162d1d324f6 req-e5c4fb23-2e77-442a-aaf2-20707a0f81ae service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:27.812740 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-50b5a7fd-0b0b-4c52-b90d-a162d1d324f6 req-e5c4fb23-2e77-442a-aaf2-20707a0f81ae service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:27.817542 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-de502893-52e0-43d4-8815-fe1bbd9fc8cd tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:27.829079 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-50b5a7fd-0b0b-4c52-b90d-a162d1d324f6 req-e5c4fb23-2e77-442a-aaf2-20707a0f81ae service nova] Creating event network-vif-plugged:7bf6d662-b9fe-4268-a377-ea1147808f0f for instance e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 on n-h1-856895-1 Sep 10 11:55:27.832056 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-de502893-52e0-43d4-8815-fe1bbd9fc8cd tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f" status: 200 len: 1802 microversion: 2.1 time: 0.303241 Sep 10 11:55:27.843395 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-50b5a7fd-0b0b-4c52-b90d-a162d1d324f6 req-e5c4fb23-2e77-442a-aaf2-20707a0f81ae service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059946 Sep 10 11:55:27.843395 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1791/3568] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:55:27.844022 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0ff9bdf5-9fe0-41ef-9a06-1cc643264b1b tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:27.845235 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1778/3569] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:27 2022] GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f => generated 1802 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:27.845598 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0ff9bdf5-9fe0-41ef-9a06-1cc643264b1b tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] [instance: 8d231092-f981-47fe-9994-6fcb031c8a83] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:27.860356 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c892a2cd-8959-4a23-8015-eac91b9537a6 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:27.860876 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c892a2cd-8959-4a23-8015-eac91b9537a6 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 6f2872c7-ac86-4764-9db6-96eece78150f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:27.861768 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ff9bdf5-9fe0-41ef-9a06-1cc643264b1b tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:27.863038 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ff9bdf5-9fe0-41ef-9a06-1cc643264b1b tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:27.863563 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ff9bdf5-9fe0-41ef-9a06-1cc643264b1b tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:27.867043 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ff9bdf5-9fe0-41ef-9a06-1cc643264b1b tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:27.867558 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ff9bdf5-9fe0-41ef-9a06-1cc643264b1b tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:27.868000 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ff9bdf5-9fe0-41ef-9a06-1cc643264b1b tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:27.868140 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c892a2cd-8959-4a23-8015-eac91b9537a6 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:27.868680 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c892a2cd-8959-4a23-8015-eac91b9537a6 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:27.869130 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c892a2cd-8959-4a23-8015-eac91b9537a6 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:27.869889 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c892a2cd-8959-4a23-8015-eac91b9537a6 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:27.870410 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c892a2cd-8959-4a23-8015-eac91b9537a6 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:27.870837 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c892a2cd-8959-4a23-8015-eac91b9537a6 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:27.891199 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-0ff9bdf5-9fe0-41ef-9a06-1cc643264b1b tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] HTTP exception thrown: Instance 8d231092-f981-47fe-9994-6fcb031c8a83 could not be found. Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0ff9bdf5-9fe0-41ef-9a06-1cc643264b1b tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Request method failure captured: Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83 HTTP/1.1 Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHq5BkZgPX7f6T3ZvNM6KJTwUEF_P2Poy5J694hoS3GODhtDTXc9TLop2ydCIrCdON696HV3srZ1xFjcF9dfWk1t_YvL_c6JBS1rBLsIW8vVfzIG_z2OxCl_TfHcLpLsqkM0k2pGMBaNThNNyQZaXkcjZXdT98s1AdJUVDCAfkwkKW0 Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 093f44e4274f41c1882cf1a2167dc891 Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1464892634 Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/093f44e4274f41c1882cf1a2167dc891"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/093f44e4274f41c1882cf1a2167dc891"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_093f44e4274f41c1882cf1a2167dc891", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/093f44e4274f41c1882cf1a2167dc891"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1464892634 Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 093f44e4274f41c1882cf1a2167dc891 Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1464892634 Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-FloatingIPsAssociationTestJSON-1464892634-project Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 4318416fa33b40ae98c8c35675b0c101 Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1464892634-project Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 8d231092-f981-47fe-9994-6fcb031c8a83 could not be found. Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '8d231092-f981-47fe-9994-6fcb031c8a83'} Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d231092-f981-47fe-9994-6fcb031c8a83 could not be found. Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d231092-f981-47fe-9994-6fcb031c8a83 could not be found. Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:55:27.895447 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:55:27.901074 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:55:27.901074 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:55:27.901074 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:55:27.901074 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:55:27.901074 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:55:27.901074 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:55:27.901074 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d231092-f981-47fe-9994-6fcb031c8a83 could not be found. Sep 10 11:55:27.901074 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:55:27.901074 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0ff9bdf5-9fe0-41ef-9a06-1cc643264b1b tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] Returning 404 to user: Instance 8d231092-f981-47fe-9994-6fcb031c8a83 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:55:27.901074 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0ff9bdf5-9fe0-41ef-9a06-1cc643264b1b tempest-FloatingIPsAssociationTestJSON-1464892634 tempest-FloatingIPsAssociationTestJSON-1464892634-project] 10.222.0.23 "GET /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83" status: 404 len: 111 microversion: 2.1 time: 0.059763 Sep 10 11:55:27.901074 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1792/3570] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:27 2022] GET /compute/v2.1/servers/8d231092-f981-47fe-9994-6fcb031c8a83 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:55:27.941115 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c892a2cd-8959-4a23-8015-eac91b9537a6 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f/ips" status: 200 len: 215 microversion: 2.1 time: 0.086594 Sep 10 11:55:27.950791 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1779/3571] 10.222.0.23 () {58 vars in 1248 bytes} [Sat Sep 10 11:55:27 2022] GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f/ips => generated 215 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:55:27.956645 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e45d905c-9778-4014-87a0-b868e977f954 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:27.957145 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e45d905c-9778-4014-87a0-b868e977f954 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 6f2872c7-ac86-4764-9db6-96eece78150f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:27.963355 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e45d905c-9778-4014-87a0-b868e977f954 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:27.963843 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e45d905c-9778-4014-87a0-b868e977f954 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:27.964297 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e45d905c-9778-4014-87a0-b868e977f954 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:27.964980 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e45d905c-9778-4014-87a0-b868e977f954 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:27.965899 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e45d905c-9778-4014-87a0-b868e977f954 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:27.966736 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e45d905c-9778-4014-87a0-b868e977f954 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:28.009113 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e45d905c-9778-4014-87a0-b868e977f954 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 6f2872c7-ac86-4764-9db6-96eece78150f] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:55:28.160750 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e45d905c-9778-4014-87a0-b868e977f954 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f" status: 204 len: 0 microversion: 2.1 time: 0.207748 Sep 10 11:55:28.162179 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1793/3572] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:55:27 2022] DELETE /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 11:55:28.168192 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e9159171-7252-4c26-831c-7a7cce20088a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:28.169689 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e9159171-7252-4c26-831c-7a7cce20088a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: e3157819-80a0-4ca3-9ad5-fe790fb7b2a1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:28.175703 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8d99eb15-b8a4-4527-8460-e8f71be356d6 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:28.176438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8d99eb15-b8a4-4527-8460-e8f71be356d6 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 6f2872c7-ac86-4764-9db6-96eece78150f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:28.177899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e9159171-7252-4c26-831c-7a7cce20088a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:28.178575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e9159171-7252-4c26-831c-7a7cce20088a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:28.179216 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e9159171-7252-4c26-831c-7a7cce20088a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:28.180097 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e9159171-7252-4c26-831c-7a7cce20088a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:28.180731 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e9159171-7252-4c26-831c-7a7cce20088a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:28.181370 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e9159171-7252-4c26-831c-7a7cce20088a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:28.183913 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8d99eb15-b8a4-4527-8460-e8f71be356d6 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:28.186064 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8d99eb15-b8a4-4527-8460-e8f71be356d6 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:28.186536 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8d99eb15-b8a4-4527-8460-e8f71be356d6 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:28.188611 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8d99eb15-b8a4-4527-8460-e8f71be356d6 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:28.188611 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8d99eb15-b8a4-4527-8460-e8f71be356d6 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:28.188611 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8d99eb15-b8a4-4527-8460-e8f71be356d6 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:28.483812 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e9159171-7252-4c26-831c-7a7cce20088a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:28.492147 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e9159171-7252-4c26-831c-7a7cce20088a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/e3157819-80a0-4ca3-9ad5-fe790fb7b2a1" status: 200 len: 1315 microversion: 2.1 time: 0.332672 Sep 10 11:55:28.492819 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1780/3573] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:28 2022] GET /compute/v2.1/servers/e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:55:28.498974 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8d99eb15-b8a4-4527-8460-e8f71be356d6 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:28.509837 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8d99eb15-b8a4-4527-8460-e8f71be356d6 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f" status: 200 len: 1808 microversion: 2.1 time: 0.339959 Sep 10 11:55:28.523185 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1794/3574] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:28 2022] GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f => generated 1808 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:28.523396 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4b329bd4-1f74-47cf-862a-791ef2c12b5a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:28.523396 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4b329bd4-1f74-47cf-862a-791ef2c12b5a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:28.523396 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b329bd4-1f74-47cf-862a-791ef2c12b5a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:28.523396 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b329bd4-1f74-47cf-862a-791ef2c12b5a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:28.523396 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b329bd4-1f74-47cf-862a-791ef2c12b5a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:28.523396 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b329bd4-1f74-47cf-862a-791ef2c12b5a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:28.523396 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b329bd4-1f74-47cf-862a-791ef2c12b5a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:28.523396 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b329bd4-1f74-47cf-862a-791ef2c12b5a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:28.750509 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4b329bd4-1f74-47cf-862a-791ef2c12b5a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:28.759198 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4b329bd4-1f74-47cf-862a-791ef2c12b5a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180" status: 200 len: 1521 microversion: 2.1 time: 0.265076 Sep 10 11:55:28.759797 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1781/3575] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:28 2022] GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:28.798841 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fbcbaf56-4695-4105-9a89-927998529240 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:28.799651 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fbcbaf56-4695-4105-9a89-927998529240 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: 9af45fd0-4f3b-480b-a33f-df501592594d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:28.805976 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fbcbaf56-4695-4105-9a89-927998529240 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:28.806552 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fbcbaf56-4695-4105-9a89-927998529240 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:28.807020 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fbcbaf56-4695-4105-9a89-927998529240 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:28.807814 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fbcbaf56-4695-4105-9a89-927998529240 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:28.808277 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fbcbaf56-4695-4105-9a89-927998529240 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:28.808709 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fbcbaf56-4695-4105-9a89-927998529240 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:29.021234 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fbcbaf56-4695-4105-9a89-927998529240 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:29.036379 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fbcbaf56-4695-4105-9a89-927998529240 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d" status: 200 len: 1313 microversion: 2.1 time: 0.243892 Sep 10 11:55:29.052030 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1795/3576] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:28 2022] GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:29.099665 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d34ce8c0-e60f-463a-b2cd-debfd7c0e7ef tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:29.102443 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d34ce8c0-e60f-463a-b2cd-debfd7c0e7ef tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: 70c46bf2-0367-499b-822a-e18923866289] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:29.109740 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d34ce8c0-e60f-463a-b2cd-debfd7c0e7ef tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:29.110243 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d34ce8c0-e60f-463a-b2cd-debfd7c0e7ef tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:29.110752 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d34ce8c0-e60f-463a-b2cd-debfd7c0e7ef tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:29.111979 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d34ce8c0-e60f-463a-b2cd-debfd7c0e7ef tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:29.112664 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d34ce8c0-e60f-463a-b2cd-debfd7c0e7ef tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:29.113260 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d34ce8c0-e60f-463a-b2cd-debfd7c0e7ef tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:29.213705 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d34ce8c0-e60f-463a-b2cd-debfd7c0e7ef tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "POST /compute/v2.1/servers/70c46bf2-0367-499b-822a-e18923866289/action" status: 200 len: 24571 microversion: 2.1 time: 0.116939 Sep 10 11:55:29.216040 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1782/3577] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:55:29 2022] POST /compute/v2.1/servers/70c46bf2-0367-499b-822a-e18923866289/action => generated 24571 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:55:29.515734 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2c3507de-3f78-4654-92af-d70a2f972982 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:29.517397 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2c3507de-3f78-4654-92af-d70a2f972982 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: e3157819-80a0-4ca3-9ad5-fe790fb7b2a1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:29.534046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c3507de-3f78-4654-92af-d70a2f972982 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:29.534774 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c3507de-3f78-4654-92af-d70a2f972982 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:29.535439 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c3507de-3f78-4654-92af-d70a2f972982 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:29.536588 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-90a0fc71-cf99-45ad-b0e9-238037484fb6 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:29.537366 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-90a0fc71-cf99-45ad-b0e9-238037484fb6 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 6f2872c7-ac86-4764-9db6-96eece78150f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:29.537839 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c3507de-3f78-4654-92af-d70a2f972982 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:29.541118 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c3507de-3f78-4654-92af-d70a2f972982 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:29.541774 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c3507de-3f78-4654-92af-d70a2f972982 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:29.553302 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90a0fc71-cf99-45ad-b0e9-238037484fb6 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:29.553863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90a0fc71-cf99-45ad-b0e9-238037484fb6 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:29.554418 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90a0fc71-cf99-45ad-b0e9-238037484fb6 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:29.555366 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90a0fc71-cf99-45ad-b0e9-238037484fb6 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:29.556021 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90a0fc71-cf99-45ad-b0e9-238037484fb6 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:29.556643 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90a0fc71-cf99-45ad-b0e9-238037484fb6 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:29.915586 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2c3507de-3f78-4654-92af-d70a2f972982 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:29.933175 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2c3507de-3f78-4654-92af-d70a2f972982 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/e3157819-80a0-4ca3-9ad5-fe790fb7b2a1" status: 200 len: 1315 microversion: 2.1 time: 0.419419 Sep 10 11:55:29.936379 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1796/3578] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:29 2022] GET /compute/v2.1/servers/e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:29.945070 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-90a0fc71-cf99-45ad-b0e9-238037484fb6 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:29.963375 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-562d8ae7-12f5-4f8c-b07b-fd415279caf0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:29.965084 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-90a0fc71-cf99-45ad-b0e9-238037484fb6 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f" status: 200 len: 1808 microversion: 2.1 time: 0.433073 Sep 10 11:55:29.966435 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1783/3579] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:29 2022] GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f => generated 1808 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:55:29.969262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-562d8ae7-12f5-4f8c-b07b-fd415279caf0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:29.978556 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-70517a3e-e103-4aad-a725-7f0534984133 req-d6f69766-b6df-4089-a0a9-4a964c2de770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9af45fd0-4f3b-480b-a33f-df501592594d", "name": "network-vif-plugged", "status": "completed", "tag": "951e4435-a89e-490e-85f0-419e66b7de3a"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:29.982421 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:55:29.990001 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-562d8ae7-12f5-4f8c-b07b-fd415279caf0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:29.992049 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-562d8ae7-12f5-4f8c-b07b-fd415279caf0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:29.994040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-562d8ae7-12f5-4f8c-b07b-fd415279caf0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:29.994985 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-562d8ae7-12f5-4f8c-b07b-fd415279caf0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:29.997726 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-562d8ae7-12f5-4f8c-b07b-fd415279caf0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:29.998409 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-562d8ae7-12f5-4f8c-b07b-fd415279caf0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:30.016148 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-70517a3e-e103-4aad-a725-7f0534984133 req-d6f69766-b6df-4089-a0a9-4a964c2de770 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:30.016717 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-70517a3e-e103-4aad-a725-7f0534984133 req-d6f69766-b6df-4089-a0a9-4a964c2de770 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:30.017339 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-70517a3e-e103-4aad-a725-7f0534984133 req-d6f69766-b6df-4089-a0a9-4a964c2de770 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:30.029154 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-70517a3e-e103-4aad-a725-7f0534984133 req-d6f69766-b6df-4089-a0a9-4a964c2de770 service nova] Creating event network-vif-plugged:951e4435-a89e-490e-85f0-419e66b7de3a for instance 9af45fd0-4f3b-480b-a33f-df501592594d on n-h2-856895-1 Sep 10 11:55:30.035290 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-70517a3e-e103-4aad-a725-7f0534984133 req-d6f69766-b6df-4089-a0a9-4a964c2de770 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066960 Sep 10 11:55:30.036884 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1784/3580] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:55:30.079779 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a1ceab90-1784-43e1-b83c-2a95d0735bd6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:30.095845 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a1ceab90-1784-43e1-b83c-2a95d0735bd6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: 9af45fd0-4f3b-480b-a33f-df501592594d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:30.109875 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a1ceab90-1784-43e1-b83c-2a95d0735bd6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:30.116409 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a1ceab90-1784-43e1-b83c-2a95d0735bd6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:30.117436 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a1ceab90-1784-43e1-b83c-2a95d0735bd6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:30.117676 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a1ceab90-1784-43e1-b83c-2a95d0735bd6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:30.118160 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a1ceab90-1784-43e1-b83c-2a95d0735bd6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:30.118601 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a1ceab90-1784-43e1-b83c-2a95d0735bd6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:30.135459 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:55:30.306140 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-562d8ae7-12f5-4f8c-b07b-fd415279caf0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:30.314778 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-562d8ae7-12f5-4f8c-b07b-fd415279caf0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180" status: 200 len: 1521 microversion: 2.1 time: 0.376867 Sep 10 11:55:30.315407 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1797/3581] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:29 2022] GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180 => generated 1521 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:30.330412 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4bb6e024-0678-46d2-a0a6-3163b98bf33a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:30.331229 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4bb6e024-0678-46d2-a0a6-3163b98bf33a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:30.346695 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4bb6e024-0678-46d2-a0a6-3163b98bf33a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:30.347007 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4bb6e024-0678-46d2-a0a6-3163b98bf33a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:30.347475 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4bb6e024-0678-46d2-a0a6-3163b98bf33a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:30.348332 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4bb6e024-0678-46d2-a0a6-3163b98bf33a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:30.348967 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4bb6e024-0678-46d2-a0a6-3163b98bf33a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:30.349402 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4bb6e024-0678-46d2-a0a6-3163b98bf33a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:30.383600 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4bb6e024-0678-46d2-a0a6-3163b98bf33a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2/os-volume_attachments/f7898802-dd5a-46fb-96ee-3a6b3199c9f7" status: 200 len: 194 microversion: 2.20 time: 0.067092 Sep 10 11:55:30.391281 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1798/3582] 10.222.0.23 () {60 vars in 1454 bytes} [Sat Sep 10 11:55:30 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2/os-volume_attachments/f7898802-dd5a-46fb-96ee-3a6b3199c9f7 => generated 194 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:55:30.455306 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a1ceab90-1784-43e1-b83c-2a95d0735bd6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:30.456416 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a1ceab90-1784-43e1-b83c-2a95d0735bd6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d" status: 200 len: 1313 microversion: 2.1 time: 0.398727 Sep 10 11:55:30.459930 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1785/3583] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:30 2022] GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d => generated 1313 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:55:30.469315 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8ee5e2c8-9b01-4068-9438-e587aef87d2c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:30.469824 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8ee5e2c8-9b01-4068-9438-e587aef87d2c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:30.481980 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8ee5e2c8-9b01-4068-9438-e587aef87d2c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:30.482407 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8ee5e2c8-9b01-4068-9438-e587aef87d2c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:30.483978 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8ee5e2c8-9b01-4068-9438-e587aef87d2c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:30.483978 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8ee5e2c8-9b01-4068-9438-e587aef87d2c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:30.484464 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8ee5e2c8-9b01-4068-9438-e587aef87d2c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:30.484905 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8ee5e2c8-9b01-4068-9438-e587aef87d2c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:30.580081 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-8ee5e2c8-9b01-4068-9438-e587aef87d2c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lazy-loading 'services' on Instance uuid 61ab78c6-917d-46d1-b3e2-9935ca45c8e2 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:55:30.683457 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8ee5e2c8-9b01-4068-9438-e587aef87d2c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "DELETE /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2/os-volume_attachments/f7898802-dd5a-46fb-96ee-3a6b3199c9f7" status: 202 len: 0 microversion: 2.20 time: 0.219968 Sep 10 11:55:30.683457 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1799/3584] 10.222.0.23 () {60 vars in 1457 bytes} [Sat Sep 10 11:55:30 2022] DELETE /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2/os-volume_attachments/f7898802-dd5a-46fb-96ee-3a6b3199c9f7 => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 10 11:55:30.692343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1edcac01-e796-4f74-a2df-98fc7579c3c3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:30.694547 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1edcac01-e796-4f74-a2df-98fc7579c3c3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:30.703047 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1edcac01-e796-4f74-a2df-98fc7579c3c3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:30.703568 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1edcac01-e796-4f74-a2df-98fc7579c3c3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:30.704017 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1edcac01-e796-4f74-a2df-98fc7579c3c3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:30.704740 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1edcac01-e796-4f74-a2df-98fc7579c3c3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:30.705567 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1edcac01-e796-4f74-a2df-98fc7579c3c3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:30.705902 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1edcac01-e796-4f74-a2df-98fc7579c3c3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:30.766479 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1edcac01-e796-4f74-a2df-98fc7579c3c3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077647 Sep 10 11:55:30.767518 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1786/3585] 10.222.0.23 () {60 vars in 1343 bytes} [Sat Sep 10 11:55:30 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:55:30.961274 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0d921f52-bffe-40f7-a9fd-86162d993bb4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:30.962680 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0d921f52-bffe-40f7-a9fd-86162d993bb4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: e3157819-80a0-4ca3-9ad5-fe790fb7b2a1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:30.970148 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d921f52-bffe-40f7-a9fd-86162d993bb4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:30.971202 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d921f52-bffe-40f7-a9fd-86162d993bb4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:30.971875 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d921f52-bffe-40f7-a9fd-86162d993bb4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:30.972821 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d921f52-bffe-40f7-a9fd-86162d993bb4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:30.973742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d921f52-bffe-40f7-a9fd-86162d993bb4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:30.974392 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d921f52-bffe-40f7-a9fd-86162d993bb4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:30.991304 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e6334913-8618-4bb7-8b43-9b72e8a68b8b tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:30.992806 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e6334913-8618-4bb7-8b43-9b72e8a68b8b tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 6f2872c7-ac86-4764-9db6-96eece78150f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:31.000044 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6334913-8618-4bb7-8b43-9b72e8a68b8b tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:31.001172 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6334913-8618-4bb7-8b43-9b72e8a68b8b tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:31.001793 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6334913-8618-4bb7-8b43-9b72e8a68b8b tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:31.003449 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6334913-8618-4bb7-8b43-9b72e8a68b8b tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:31.004097 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6334913-8618-4bb7-8b43-9b72e8a68b8b tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:31.004732 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6334913-8618-4bb7-8b43-9b72e8a68b8b tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:31.400162 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0d921f52-bffe-40f7-a9fd-86162d993bb4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:31.414224 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0d921f52-bffe-40f7-a9fd-86162d993bb4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/e3157819-80a0-4ca3-9ad5-fe790fb7b2a1" status: 200 len: 1315 microversion: 2.1 time: 0.457629 Sep 10 11:55:31.415932 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1800/3586] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:30 2022] GET /compute/v2.1/servers/e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 => generated 1315 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:31.419217 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e6334913-8618-4bb7-8b43-9b72e8a68b8b tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:31.425151 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c0f8ec3b-9728-415a-8962-7fa421caf269 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:31.426137 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c0f8ec3b-9728-415a-8962-7fa421caf269 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:31.434804 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e6334913-8618-4bb7-8b43-9b72e8a68b8b tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f" status: 200 len: 1808 microversion: 2.1 time: 0.447850 Sep 10 11:55:31.436547 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1787/3587] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:30 2022] GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f => generated 1808 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:31.452564 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-0f1e6e10-9d2e-4c76-bf9f-fee5af95807d req-17d8a202-c52b-416a-aeb8-a2b285b5a8fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f2872c7-ac86-4764-9db6-96eece78150f", "name": "network-vif-deleted", "tag": "68d1b2dc-eb73-4a5b-913e-098bd9786d52"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:31.463401 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c0f8ec3b-9728-415a-8962-7fa421caf269 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:31.464190 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c0f8ec3b-9728-415a-8962-7fa421caf269 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:31.466208 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c0f8ec3b-9728-415a-8962-7fa421caf269 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:31.468874 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c0f8ec3b-9728-415a-8962-7fa421caf269 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:31.470221 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c0f8ec3b-9728-415a-8962-7fa421caf269 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:31.471900 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c0f8ec3b-9728-415a-8962-7fa421caf269 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:31.480140 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-0f1e6e10-9d2e-4c76-bf9f-fee5af95807d req-17d8a202-c52b-416a-aeb8-a2b285b5a8fd service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:31.480631 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-0f1e6e10-9d2e-4c76-bf9f-fee5af95807d req-17d8a202-c52b-416a-aeb8-a2b285b5a8fd service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:31.481615 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-0f1e6e10-9d2e-4c76-bf9f-fee5af95807d req-17d8a202-c52b-416a-aeb8-a2b285b5a8fd service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:31.926318 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-0f1e6e10-9d2e-4c76-bf9f-fee5af95807d req-17d8a202-c52b-416a-aeb8-a2b285b5a8fd service nova] Creating event network-vif-deleted:68d1b2dc-eb73-4a5b-913e-098bd9786d52 for instance 6f2872c7-ac86-4764-9db6-96eece78150f on n-h1-856895-1 Sep 10 11:55:31.937300 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-0f1e6e10-9d2e-4c76-bf9f-fee5af95807d req-17d8a202-c52b-416a-aeb8-a2b285b5a8fd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.488563 Sep 10 11:55:31.938807 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1788/3588] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:55:31.952214 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9c4c4a95-3152-450d-a147-0c469ba5dc88 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:31.953095 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9c4c4a95-3152-450d-a147-0c469ba5dc88 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: 9af45fd0-4f3b-480b-a33f-df501592594d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:31.966661 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c4c4a95-3152-450d-a147-0c469ba5dc88 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:31.968102 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c4c4a95-3152-450d-a147-0c469ba5dc88 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:31.968652 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c4c4a95-3152-450d-a147-0c469ba5dc88 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:31.969823 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c4c4a95-3152-450d-a147-0c469ba5dc88 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:31.970531 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c4c4a95-3152-450d-a147-0c469ba5dc88 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:31.971226 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c4c4a95-3152-450d-a147-0c469ba5dc88 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:32.447900 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c0f8ec3b-9728-415a-8962-7fa421caf269 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:32.485673 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c0f8ec3b-9728-415a-8962-7fa421caf269 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180" status: 200 len: 1521 microversion: 2.1 time: 1.066985 Sep 10 11:55:32.488387 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1801/3589] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:31 2022] GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180 => generated 1521 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:32.501182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-be843b57-5feb-4092-b552-ac803c62d73d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:32.506886 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-be843b57-5feb-4092-b552-ac803c62d73d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:32.520285 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be843b57-5feb-4092-b552-ac803c62d73d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:32.521472 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be843b57-5feb-4092-b552-ac803c62d73d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:32.522557 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be843b57-5feb-4092-b552-ac803c62d73d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:32.525057 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be843b57-5feb-4092-b552-ac803c62d73d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:32.526098 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be843b57-5feb-4092-b552-ac803c62d73d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:32.527091 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be843b57-5feb-4092-b552-ac803c62d73d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:32.593481 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-be843b57-5feb-4092-b552-ac803c62d73d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.102122 Sep 10 11:55:32.594858 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1802/3590] 10.222.0.23 () {60 vars in 1343 bytes} [Sat Sep 10 11:55:32 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:55:32.607740 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6f6f37ee-d1e4-498f-a481-ec6446d8b239 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:32.609392 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6f6f37ee-d1e4-498f-a481-ec6446d8b239 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: e3157819-80a0-4ca3-9ad5-fe790fb7b2a1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:32.620795 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6f6f37ee-d1e4-498f-a481-ec6446d8b239 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:32.622148 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6f6f37ee-d1e4-498f-a481-ec6446d8b239 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:32.623259 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6f6f37ee-d1e4-498f-a481-ec6446d8b239 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:32.624798 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6f6f37ee-d1e4-498f-a481-ec6446d8b239 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:32.625920 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6f6f37ee-d1e4-498f-a481-ec6446d8b239 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:32.627145 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6f6f37ee-d1e4-498f-a481-ec6446d8b239 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:33.013087 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9c4c4a95-3152-450d-a147-0c469ba5dc88 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:33.028655 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9c4c4a95-3152-450d-a147-0c469ba5dc88 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d" status: 200 len: 1499 microversion: 2.1 time: 1.087911 Sep 10 11:55:33.029355 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1789/3591] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:31 2022] GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d => generated 1499 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:33.034176 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-00a02221-a389-4d7f-b523-ec8138967e8d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:33.034800 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-00a02221-a389-4d7f-b523-ec8138967e8d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 6f2872c7-ac86-4764-9db6-96eece78150f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:33.053636 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00a02221-a389-4d7f-b523-ec8138967e8d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:33.054193 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00a02221-a389-4d7f-b523-ec8138967e8d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:33.054801 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00a02221-a389-4d7f-b523-ec8138967e8d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:33.055687 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00a02221-a389-4d7f-b523-ec8138967e8d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:33.056295 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00a02221-a389-4d7f-b523-ec8138967e8d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:33.056872 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00a02221-a389-4d7f-b523-ec8138967e8d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:33.177655 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-00a02221-a389-4d7f-b523-ec8138967e8d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:33.189227 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-00a02221-a389-4d7f-b523-ec8138967e8d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f" status: 200 len: 1610 microversion: 2.1 time: 0.158611 Sep 10 11:55:33.192116 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1790/3592] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:33 2022] GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f => generated 1610 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:33.207468 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f3fac40b-17c9-49d1-b107-822632c3db96 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:33.216082 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f3fac40b-17c9-49d1-b107-822632c3db96 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: 9af45fd0-4f3b-480b-a33f-df501592594d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:33.233037 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3fac40b-17c9-49d1-b107-822632c3db96 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:33.233547 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3fac40b-17c9-49d1-b107-822632c3db96 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:33.233995 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3fac40b-17c9-49d1-b107-822632c3db96 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:33.234712 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3fac40b-17c9-49d1-b107-822632c3db96 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:33.235189 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3fac40b-17c9-49d1-b107-822632c3db96 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:33.238996 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3fac40b-17c9-49d1-b107-822632c3db96 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:33.287870 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-f3fac40b-17c9-49d1-b107-822632c3db96 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lazy-loading 'flavor' on Instance uuid 9af45fd0-4f3b-480b-a33f-df501592594d {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:55:33.295913 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6f6f37ee-d1e4-498f-a481-ec6446d8b239 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:33.310425 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6f6f37ee-d1e4-498f-a481-ec6446d8b239 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/e3157819-80a0-4ca3-9ad5-fe790fb7b2a1" status: 200 len: 1502 microversion: 2.1 time: 0.710134 Sep 10 11:55:33.312151 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1803/3593] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:32 2022] GET /compute/v2.1/servers/e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 => generated 1502 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:33.337793 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7284bb9a-3b27-4a91-bfcb-02a5719a4c03 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:33.338616 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7284bb9a-3b27-4a91-bfcb-02a5719a4c03 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: e3157819-80a0-4ca3-9ad5-fe790fb7b2a1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:33.349688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7284bb9a-3b27-4a91-bfcb-02a5719a4c03 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:33.352834 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7284bb9a-3b27-4a91-bfcb-02a5719a4c03 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:33.353602 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7284bb9a-3b27-4a91-bfcb-02a5719a4c03 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:33.354538 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7284bb9a-3b27-4a91-bfcb-02a5719a4c03 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:33.358962 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7284bb9a-3b27-4a91-bfcb-02a5719a4c03 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:33.360038 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7284bb9a-3b27-4a91-bfcb-02a5719a4c03 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:33.444756 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7284bb9a-3b27-4a91-bfcb-02a5719a4c03 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: e3157819-80a0-4ca3-9ad5-fe790fb7b2a1] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:55:33.509082 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f3fac40b-17c9-49d1-b107-822632c3db96 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "POST /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d/action" status: 200 len: 32 microversion: 2.1 time: 0.312994 Sep 10 11:55:33.515393 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1791/3594] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:55:33 2022] POST /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d/action => generated 32 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:55:33.522500 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-15dc142d-04d7-4fbb-a1a7-daef27a3121a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:33.527290 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-15dc142d-04d7-4fbb-a1a7-daef27a3121a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: 9af45fd0-4f3b-480b-a33f-df501592594d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:33.557972 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-15dc142d-04d7-4fbb-a1a7-daef27a3121a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:33.561240 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-15dc142d-04d7-4fbb-a1a7-daef27a3121a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:33.562908 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-15dc142d-04d7-4fbb-a1a7-daef27a3121a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:33.565203 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-15dc142d-04d7-4fbb-a1a7-daef27a3121a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:33.569987 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-15dc142d-04d7-4fbb-a1a7-daef27a3121a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:33.571872 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-15dc142d-04d7-4fbb-a1a7-daef27a3121a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:33.664078 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:55:33.727784 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7284bb9a-3b27-4a91-bfcb-02a5719a4c03 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e3157819-80a0-4ca3-9ad5-fe790fb7b2a1" status: 204 len: 0 microversion: 2.1 time: 0.393281 Sep 10 11:55:33.729094 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1804/3595] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:55:33 2022] DELETE /compute/v2.1/servers/e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 11:55:33.737269 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3ff25e80-f45a-4394-8388-fa3bbfabde4f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:33.738426 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3ff25e80-f45a-4394-8388-fa3bbfabde4f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:33.747544 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3ff25e80-f45a-4394-8388-fa3bbfabde4f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:33.748460 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3ff25e80-f45a-4394-8388-fa3bbfabde4f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:33.749148 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3ff25e80-f45a-4394-8388-fa3bbfabde4f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:33.751115 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3ff25e80-f45a-4394-8388-fa3bbfabde4f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:33.752031 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3ff25e80-f45a-4394-8388-fa3bbfabde4f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:33.752814 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3ff25e80-f45a-4394-8388-fa3bbfabde4f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:34.049681 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-15dc142d-04d7-4fbb-a1a7-daef27a3121a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:34.069690 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-15dc142d-04d7-4fbb-a1a7-daef27a3121a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d" status: 200 len: 1505 microversion: 2.1 time: 0.552552 Sep 10 11:55:34.083187 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1792/3596] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:33 2022] GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d => generated 1505 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:34.088602 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a159a2af-9848-451e-812a-300376887184 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:34.091773 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a159a2af-9848-451e-812a-300376887184 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:34.102114 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a159a2af-9848-451e-812a-300376887184 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:34.105330 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a159a2af-9848-451e-812a-300376887184 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:34.106614 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a159a2af-9848-451e-812a-300376887184 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:34.107579 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a159a2af-9848-451e-812a-300376887184 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:34.111790 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a159a2af-9848-451e-812a-300376887184 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:34.112503 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a159a2af-9848-451e-812a-300376887184 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:34.149834 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3ff25e80-f45a-4394-8388-fa3bbfabde4f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:34.165674 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3ff25e80-f45a-4394-8388-fa3bbfabde4f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180" status: 200 len: 1521 microversion: 2.1 time: 0.434735 Sep 10 11:55:34.166801 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1805/3597] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:33 2022] GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180 => generated 1521 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:34.183036 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-09d8895a-f1f3-4a5d-ae33-be025102bf41 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:34.183702 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-09d8895a-f1f3-4a5d-ae33-be025102bf41 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: e3157819-80a0-4ca3-9ad5-fe790fb7b2a1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:34.193232 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-09d8895a-f1f3-4a5d-ae33-be025102bf41 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:34.193728 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-09d8895a-f1f3-4a5d-ae33-be025102bf41 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:34.194172 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-09d8895a-f1f3-4a5d-ae33-be025102bf41 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:34.194885 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-09d8895a-f1f3-4a5d-ae33-be025102bf41 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:34.195373 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-09d8895a-f1f3-4a5d-ae33-be025102bf41 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:34.195804 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-09d8895a-f1f3-4a5d-ae33-be025102bf41 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:34.211275 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a159a2af-9848-451e-812a-300376887184 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.139490 Sep 10 11:55:34.213227 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1793/3598] 10.222.0.23 () {60 vars in 1343 bytes} [Sat Sep 10 11:55:34 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:55:34.225324 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-cca2598f-8fb1-4f04-83fa-f75d5597bdcc req-c39ee91c-e9b5-4316-a91c-07127521921f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f2872c7-ac86-4764-9db6-96eece78150f", "name": "network-vif-deleted", "tag": "d6f5febb-95cd-42ed-8a3f-6d78c2e14ad9"}, {"server_uuid": "6f2872c7-ac86-4764-9db6-96eece78150f", "name": "network-vif-deleted", "tag": "274b11cc-1af8-42d8-8bfd-b3d105469cd7"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:34.272064 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-cca2598f-8fb1-4f04-83fa-f75d5597bdcc req-c39ee91c-e9b5-4316-a91c-07127521921f service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:34.272817 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-cca2598f-8fb1-4f04-83fa-f75d5597bdcc req-c39ee91c-e9b5-4316-a91c-07127521921f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:34.274159 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-cca2598f-8fb1-4f04-83fa-f75d5597bdcc req-c39ee91c-e9b5-4316-a91c-07127521921f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:34.310552 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-cca2598f-8fb1-4f04-83fa-f75d5597bdcc req-c39ee91c-e9b5-4316-a91c-07127521921f service nova] Creating event network-vif-deleted:d6f5febb-95cd-42ed-8a3f-6d78c2e14ad9 for instance 6f2872c7-ac86-4764-9db6-96eece78150f on n-h1-856895-1 Sep 10 11:55:34.319659 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-cca2598f-8fb1-4f04-83fa-f75d5597bdcc req-c39ee91c-e9b5-4316-a91c-07127521921f service nova] Creating event network-vif-deleted:274b11cc-1af8-42d8-8bfd-b3d105469cd7 for instance 6f2872c7-ac86-4764-9db6-96eece78150f on n-h1-856895-1 Sep 10 11:55:34.335685 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-cca2598f-8fb1-4f04-83fa-f75d5597bdcc req-c39ee91c-e9b5-4316-a91c-07127521921f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.115656 Sep 10 11:55:34.336545 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1794/3599] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:55:34.345662 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f93fca7e-f0ca-4bf4-aa3f-0b0fc3a95f9c tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:34.346379 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f93fca7e-f0ca-4bf4-aa3f-0b0fc3a95f9c tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 6f2872c7-ac86-4764-9db6-96eece78150f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:34.362984 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f93fca7e-f0ca-4bf4-aa3f-0b0fc3a95f9c tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:34.363520 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f93fca7e-f0ca-4bf4-aa3f-0b0fc3a95f9c tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:34.363944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f93fca7e-f0ca-4bf4-aa3f-0b0fc3a95f9c tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:34.364658 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f93fca7e-f0ca-4bf4-aa3f-0b0fc3a95f9c tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:34.365123 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f93fca7e-f0ca-4bf4-aa3f-0b0fc3a95f9c tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:34.376198 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f93fca7e-f0ca-4bf4-aa3f-0b0fc3a95f9c tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:34.435806 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f93fca7e-f0ca-4bf4-aa3f-0b0fc3a95f9c tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:34.436344 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f93fca7e-f0ca-4bf4-aa3f-0b0fc3a95f9c tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:34.436801 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f93fca7e-f0ca-4bf4-aa3f-0b0fc3a95f9c tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:34.437267 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-f93fca7e-f0ca-4bf4-aa3f-0b0fc3a95f9c tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lazy-loading 'fault' on Instance uuid 6f2872c7-ac86-4764-9db6-96eece78150f {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:55:34.543887 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f93fca7e-f0ca-4bf4-aa3f-0b0fc3a95f9c tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:34.555469 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f93fca7e-f0ca-4bf4-aa3f-0b0fc3a95f9c tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f" status: 200 len: 1303 microversion: 2.1 time: 0.216487 Sep 10 11:55:34.578840 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1795/3600] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:34 2022] GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f => generated 1303 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:34.624286 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-09d8895a-f1f3-4a5d-ae33-be025102bf41 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:34.637383 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-09d8895a-f1f3-4a5d-ae33-be025102bf41 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/e3157819-80a0-4ca3-9ad5-fe790fb7b2a1" status: 200 len: 1508 microversion: 2.1 time: 0.469265 Sep 10 11:55:34.638687 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1806/3601] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:34 2022] GET /compute/v2.1/servers/e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 => generated 1508 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:35.101695 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cbf72985-c2ca-4663-9d10-ea2da6dc0b7a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:35.102925 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cbf72985-c2ca-4663-9d10-ea2da6dc0b7a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: 9af45fd0-4f3b-480b-a33f-df501592594d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:35.125385 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cbf72985-c2ca-4663-9d10-ea2da6dc0b7a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:35.126568 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cbf72985-c2ca-4663-9d10-ea2da6dc0b7a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:35.127240 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cbf72985-c2ca-4663-9d10-ea2da6dc0b7a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:35.128169 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cbf72985-c2ca-4663-9d10-ea2da6dc0b7a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:35.128837 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cbf72985-c2ca-4663-9d10-ea2da6dc0b7a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:35.138966 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cbf72985-c2ca-4663-9d10-ea2da6dc0b7a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:35.191715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-82a866f5-b2f5-47fd-b270-5f1533a96299 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:35.193022 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-82a866f5-b2f5-47fd-b270-5f1533a96299 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:35.204055 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82a866f5-b2f5-47fd-b270-5f1533a96299 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:35.204918 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82a866f5-b2f5-47fd-b270-5f1533a96299 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:35.205551 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82a866f5-b2f5-47fd-b270-5f1533a96299 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:35.206837 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82a866f5-b2f5-47fd-b270-5f1533a96299 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:35.207929 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82a866f5-b2f5-47fd-b270-5f1533a96299 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:35.208698 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82a866f5-b2f5-47fd-b270-5f1533a96299 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:35.508378 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-82a866f5-b2f5-47fd-b270-5f1533a96299 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:35.518118 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-82a866f5-b2f5-47fd-b270-5f1533a96299 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180" status: 200 len: 1521 microversion: 2.1 time: 0.331453 Sep 10 11:55:35.524758 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1807/3602] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:35 2022] GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180 => generated 1521 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:35.533536 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2be283ae-1b71-45a3-9810-90b70bed83af tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:35.535804 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2be283ae-1b71-45a3-9810-90b70bed83af tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:35.554773 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2be283ae-1b71-45a3-9810-90b70bed83af tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:35.555544 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2be283ae-1b71-45a3-9810-90b70bed83af tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:35.556164 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2be283ae-1b71-45a3-9810-90b70bed83af tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:35.557031 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2be283ae-1b71-45a3-9810-90b70bed83af tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:35.557644 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2be283ae-1b71-45a3-9810-90b70bed83af tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:35.558230 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2be283ae-1b71-45a3-9810-90b70bed83af tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:35.583431 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-cbf72985-c2ca-4663-9d10-ea2da6dc0b7a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:35.592075 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cbf72985-c2ca-4663-9d10-ea2da6dc0b7a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d" status: 200 len: 1505 microversion: 2.1 time: 0.494523 Sep 10 11:55:35.599004 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1796/3603] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:35 2022] GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d => generated 1505 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:35.604874 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f2b88495-333d-4614-8371-e35c4a77896c tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:35.613967 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f2b88495-333d-4614-8371-e35c4a77896c tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 6f2872c7-ac86-4764-9db6-96eece78150f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:35.635204 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f2b88495-333d-4614-8371-e35c4a77896c tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:35.635667 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f2b88495-333d-4614-8371-e35c4a77896c tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:35.636225 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f2b88495-333d-4614-8371-e35c4a77896c tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:35.637143 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f2b88495-333d-4614-8371-e35c4a77896c tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:35.637714 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f2b88495-333d-4614-8371-e35c4a77896c tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:35.638049 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f2b88495-333d-4614-8371-e35c4a77896c tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:35.660157 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2be283ae-1b71-45a3-9810-90b70bed83af tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.134101 Sep 10 11:55:35.662840 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1808/3604] 10.222.0.23 () {60 vars in 1343 bytes} [Sat Sep 10 11:55:35 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:55:35.668008 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1dcf2d2d-34c9-4054-9b03-9bac699376b3 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:35.680296 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1dcf2d2d-34c9-4054-9b03-9bac699376b3 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: e3157819-80a0-4ca3-9ad5-fe790fb7b2a1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:35.695708 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1dcf2d2d-34c9-4054-9b03-9bac699376b3 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:35.696456 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1dcf2d2d-34c9-4054-9b03-9bac699376b3 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:35.697132 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1dcf2d2d-34c9-4054-9b03-9bac699376b3 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:35.698075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1dcf2d2d-34c9-4054-9b03-9bac699376b3 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:35.698738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1dcf2d2d-34c9-4054-9b03-9bac699376b3 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:35.699491 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1dcf2d2d-34c9-4054-9b03-9bac699376b3 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:35.724735 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f2b88495-333d-4614-8371-e35c4a77896c tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:35.725991 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f2b88495-333d-4614-8371-e35c4a77896c tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:35.727457 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f2b88495-333d-4614-8371-e35c4a77896c tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:35.728784 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-f2b88495-333d-4614-8371-e35c4a77896c tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lazy-loading 'fault' on Instance uuid 6f2872c7-ac86-4764-9db6-96eece78150f {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:55:35.793612 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f2b88495-333d-4614-8371-e35c4a77896c tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:35.809904 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f2b88495-333d-4614-8371-e35c4a77896c tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f" status: 200 len: 1303 microversion: 2.1 time: 0.205923 Sep 10 11:55:35.813375 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1797/3605] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:35 2022] GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f => generated 1303 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:36.098341 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1dcf2d2d-34c9-4054-9b03-9bac699376b3 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:36.108790 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1dcf2d2d-34c9-4054-9b03-9bac699376b3 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/e3157819-80a0-4ca3-9ad5-fe790fb7b2a1" status: 200 len: 1508 microversion: 2.1 time: 0.444604 Sep 10 11:55:36.134085 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1809/3606] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:35 2022] GET /compute/v2.1/servers/e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 => generated 1508 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:36.378667 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-0f6f53c1-1a7a-42fe-81c9-a81712d041a3 req-545885d4-5526-48f9-aaa8-d3212f5f9892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3157819-80a0-4ca3-9ad5-fe790fb7b2a1", "name": "network-vif-deleted", "tag": "7bf6d662-b9fe-4268-a377-ea1147808f0f"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:36.393251 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-0f6f53c1-1a7a-42fe-81c9-a81712d041a3 req-545885d4-5526-48f9-aaa8-d3212f5f9892 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:36.394138 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-0f6f53c1-1a7a-42fe-81c9-a81712d041a3 req-545885d4-5526-48f9-aaa8-d3212f5f9892 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:36.394808 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-0f6f53c1-1a7a-42fe-81c9-a81712d041a3 req-545885d4-5526-48f9-aaa8-d3212f5f9892 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:36.420738 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-0f6f53c1-1a7a-42fe-81c9-a81712d041a3 req-545885d4-5526-48f9-aaa8-d3212f5f9892 service nova] Creating event network-vif-deleted:7bf6d662-b9fe-4268-a377-ea1147808f0f for instance e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 on n-h1-856895-1 Sep 10 11:55:36.428814 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-0f6f53c1-1a7a-42fe-81c9-a81712d041a3 req-545885d4-5526-48f9-aaa8-d3212f5f9892 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060060 Sep 10 11:55:36.429908 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1798/3607] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:55:36.549291 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-73e22318-4278-43a8-bccc-d7d1a2e65442 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:36.550509 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-73e22318-4278-43a8-bccc-d7d1a2e65442 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:36.568256 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-73e22318-4278-43a8-bccc-d7d1a2e65442 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:36.571600 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-73e22318-4278-43a8-bccc-d7d1a2e65442 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:36.572493 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-73e22318-4278-43a8-bccc-d7d1a2e65442 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:36.573415 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-73e22318-4278-43a8-bccc-d7d1a2e65442 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:36.576511 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-73e22318-4278-43a8-bccc-d7d1a2e65442 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:36.577150 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-73e22318-4278-43a8-bccc-d7d1a2e65442 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:36.626889 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5701a744-7d6b-4c7f-83c8-43f7d5973776 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:36.627853 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5701a744-7d6b-4c7f-83c8-43f7d5973776 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: 9af45fd0-4f3b-480b-a33f-df501592594d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:36.634447 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5701a744-7d6b-4c7f-83c8-43f7d5973776 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:36.639234 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5701a744-7d6b-4c7f-83c8-43f7d5973776 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:36.639861 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5701a744-7d6b-4c7f-83c8-43f7d5973776 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:36.640740 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5701a744-7d6b-4c7f-83c8-43f7d5973776 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:36.641359 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5701a744-7d6b-4c7f-83c8-43f7d5973776 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:36.641938 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5701a744-7d6b-4c7f-83c8-43f7d5973776 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:36.854357 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-73e22318-4278-43a8-bccc-d7d1a2e65442 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:36.864217 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-73e22318-4278-43a8-bccc-d7d1a2e65442 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180" status: 200 len: 1521 microversion: 2.1 time: 0.318296 Sep 10 11:55:36.868159 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1810/3608] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:36 2022] GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180 => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:36.874915 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-85d1bf9a-3a03-4e14-ac0e-064b48284357 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:36.877076 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-85d1bf9a-3a03-4e14-ac0e-064b48284357 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:36.895222 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-85d1bf9a-3a03-4e14-ac0e-064b48284357 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:36.895866 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-85d1bf9a-3a03-4e14-ac0e-064b48284357 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:36.896320 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-85d1bf9a-3a03-4e14-ac0e-064b48284357 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:36.902906 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-85d1bf9a-3a03-4e14-ac0e-064b48284357 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:36.904053 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-85d1bf9a-3a03-4e14-ac0e-064b48284357 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:36.907215 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-85d1bf9a-3a03-4e14-ac0e-064b48284357 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:36.927505 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5701a744-7d6b-4c7f-83c8-43f7d5973776 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:36.938415 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5701a744-7d6b-4c7f-83c8-43f7d5973776 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d" status: 200 len: 1505 microversion: 2.1 time: 0.319009 Sep 10 11:55:36.939625 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1799/3609] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:36 2022] GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d => generated 1505 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:55:36.944576 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-412b2d04-389c-4a7a-9891-e166ffb630df tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:36.945392 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-412b2d04-389c-4a7a-9891-e166ffb630df tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 6f2872c7-ac86-4764-9db6-96eece78150f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:36.952996 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-412b2d04-389c-4a7a-9891-e166ffb630df tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:36.953706 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-412b2d04-389c-4a7a-9891-e166ffb630df tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:36.954520 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-412b2d04-389c-4a7a-9891-e166ffb630df tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:36.955432 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-412b2d04-389c-4a7a-9891-e166ffb630df tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:36.956031 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-412b2d04-389c-4a7a-9891-e166ffb630df tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:36.956592 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-412b2d04-389c-4a7a-9891-e166ffb630df tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:36.974609 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-412b2d04-389c-4a7a-9891-e166ffb630df tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] HTTP exception thrown: Instance 6f2872c7-ac86-4764-9db6-96eece78150f could not be found. Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-412b2d04-389c-4a7a-9891-e166ffb630df tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Request method failure captured: Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f HTTP/1.1 Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHrpDbI_vwysjrZI0pLgV2e_9ugqPwvEusU3Vp9T8_0IKbBIqjVhqDJZ20XuEbp27bB1AOEvdv_MdqobhZETMprY0llBtDOGnDYkSutpNvLCyJxVCzumDpKThaUgJ6fh0Yzl7omsmFl0yReFCqG8RlC6ulAtSgz8ylIcu8wmUlUk0vs Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 37597777ce774f87aeabe08ab2227cbd Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersTestMultiNic-1216547353 Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/37597777ce774f87aeabe08ab2227cbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/37597777ce774f87aeabe08ab2227cbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_37597777ce774f87aeabe08ab2227cbd", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/37597777ce774f87aeabe08ab2227cbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersTestMultiNic-1216547353 Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 37597777ce774f87aeabe08ab2227cbd Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersTestMultiNic-1216547353 Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersTestMultiNic-1216547353-project Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: ce925a3528c64d4fa50a8310be9e7c06 Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersTestMultiNic-1216547353-project Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 6f2872c7-ac86-4764-9db6-96eece78150f could not be found. Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '6f2872c7-ac86-4764-9db6-96eece78150f'} Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f2872c7-ac86-4764-9db6-96eece78150f could not be found. Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f2872c7-ac86-4764-9db6-96eece78150f could not be found. Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:55:36.977139 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:55:36.981041 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:55:36.981041 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:55:36.981041 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:55:36.981041 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:55:36.981041 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:55:36.981041 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f2872c7-ac86-4764-9db6-96eece78150f could not be found. Sep 10 11:55:36.981041 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:55:36.982742 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-412b2d04-389c-4a7a-9891-e166ffb630df tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Returning 404 to user: Instance 6f2872c7-ac86-4764-9db6-96eece78150f could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:55:36.983870 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-412b2d04-389c-4a7a-9891-e166ffb630df tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f" status: 404 len: 111 microversion: 2.1 time: 0.043093 Sep 10 11:55:36.985538 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1800/3610] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:36 2022] GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:55:36.999703 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-85d1bf9a-3a03-4e14-ac0e-064b48284357 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.125240 Sep 10 11:55:37.000624 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1811/3611] 10.222.0.23 () {60 vars in 1343 bytes} [Sat Sep 10 11:55:36 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:55:37.139340 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a3f85e99-3990-4c20-a055-6c6561460e01 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:37.139971 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a3f85e99-3990-4c20-a055-6c6561460e01 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: e3157819-80a0-4ca3-9ad5-fe790fb7b2a1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:37.164932 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a3f85e99-3990-4c20-a055-6c6561460e01 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:37.165438 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a3f85e99-3990-4c20-a055-6c6561460e01 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:37.166061 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a3f85e99-3990-4c20-a055-6c6561460e01 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:37.166789 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a3f85e99-3990-4c20-a055-6c6561460e01 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:37.172918 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a3f85e99-3990-4c20-a055-6c6561460e01 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:37.173691 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a3f85e99-3990-4c20-a055-6c6561460e01 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:37.249693 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a3f85e99-3990-4c20-a055-6c6561460e01 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:37.252303 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a3f85e99-3990-4c20-a055-6c6561460e01 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:37.253175 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a3f85e99-3990-4c20-a055-6c6561460e01 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:37.253805 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-a3f85e99-3990-4c20-a055-6c6561460e01 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lazy-loading 'fault' on Instance uuid e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:55:37.259702 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:55:37.315631 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a3f85e99-3990-4c20-a055-6c6561460e01 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:37.328021 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a3f85e99-3990-4c20-a055-6c6561460e01 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/e3157819-80a0-4ca3-9ad5-fe790fb7b2a1" status: 200 len: 1305 microversion: 2.1 time: 0.193081 Sep 10 11:55:37.333162 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1801/3612] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:37 2022] GET /compute/v2.1/servers/e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 => generated 1305 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:37.892445 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3d31f0f9-03be-4dc7-a346-c3f818e8fcc7 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:37.893162 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3d31f0f9-03be-4dc7-a346-c3f818e8fcc7 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:37.906994 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d31f0f9-03be-4dc7-a346-c3f818e8fcc7 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:37.907631 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d31f0f9-03be-4dc7-a346-c3f818e8fcc7 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:37.908190 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d31f0f9-03be-4dc7-a346-c3f818e8fcc7 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:37.908997 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d31f0f9-03be-4dc7-a346-c3f818e8fcc7 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:37.909522 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d31f0f9-03be-4dc7-a346-c3f818e8fcc7 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:37.913712 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d31f0f9-03be-4dc7-a346-c3f818e8fcc7 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:37.966445 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e085a448-eee5-4768-9401-ac7cd484b5c6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:37.967143 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e085a448-eee5-4768-9401-ac7cd484b5c6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: 9af45fd0-4f3b-480b-a33f-df501592594d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:37.978473 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e085a448-eee5-4768-9401-ac7cd484b5c6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:37.979538 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e085a448-eee5-4768-9401-ac7cd484b5c6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:37.981742 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e085a448-eee5-4768-9401-ac7cd484b5c6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:37.983265 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e085a448-eee5-4768-9401-ac7cd484b5c6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:37.984245 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e085a448-eee5-4768-9401-ac7cd484b5c6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:37.984867 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e085a448-eee5-4768-9401-ac7cd484b5c6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:38.340931 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3d31f0f9-03be-4dc7-a346-c3f818e8fcc7 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:38.348869 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3d31f0f9-03be-4dc7-a346-c3f818e8fcc7 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180" status: 200 len: 1521 microversion: 2.1 time: 0.460288 Sep 10 11:55:38.349454 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1812/3613] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:37 2022] GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180 => generated 1521 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:38.355151 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-88ac182b-2cdd-46d6-ae74-e86b54eb6eec tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:38.358011 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-88ac182b-2cdd-46d6-ae74-e86b54eb6eec tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:38.364034 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-88ac182b-2cdd-46d6-ae74-e86b54eb6eec tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:38.364523 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-88ac182b-2cdd-46d6-ae74-e86b54eb6eec tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:38.364964 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-88ac182b-2cdd-46d6-ae74-e86b54eb6eec tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:38.365658 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-88ac182b-2cdd-46d6-ae74-e86b54eb6eec tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:38.366115 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-88ac182b-2cdd-46d6-ae74-e86b54eb6eec tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:38.366538 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-88ac182b-2cdd-46d6-ae74-e86b54eb6eec tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:38.396888 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-88ac182b-2cdd-46d6-ae74-e86b54eb6eec tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045423 Sep 10 11:55:38.397398 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1813/3614] 10.222.0.23 () {60 vars in 1343 bytes} [Sat Sep 10 11:55:38 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:38.401886 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-babb3780-dded-4b2b-8c08-c826a1f66c53 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f407329aca0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:38.432415 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e085a448-eee5-4768-9401-ac7cd484b5c6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:38.449394 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e085a448-eee5-4768-9401-ac7cd484b5c6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d" status: 200 len: 1505 microversion: 2.1 time: 0.487255 Sep 10 11:55:38.455138 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-babb3780-dded-4b2b-8c08-c826a1f66c53 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/6ecb4b95-c373-456b-9e15-ee7c9822bca3" status: 200 len: 662 microversion: 2.1 time: 0.056651 Sep 10 11:55:38.462225 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1814/3615] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:55:38 2022] GET /compute/v2.1/images/6ecb4b95-c373-456b-9e15-ee7c9822bca3 => generated 662 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:55:38.463565 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1802/3616] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:37 2022] GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d => generated 1505 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:38.470496 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b3094d86-e7a0-4a6f-8c0c-75a0188d0b58 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:38.472292 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b3094d86-e7a0-4a6f-8c0c-75a0188d0b58 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: e3157819-80a0-4ca3-9ad5-fe790fb7b2a1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:38.491274 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0574c128-3d4b-4025-b75c-5801785b1653 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f407b5ea940>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:38.491508 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b3094d86-e7a0-4a6f-8c0c-75a0188d0b58 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:38.491991 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b3094d86-e7a0-4a6f-8c0c-75a0188d0b58 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:38.492458 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b3094d86-e7a0-4a6f-8c0c-75a0188d0b58 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:38.493395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b3094d86-e7a0-4a6f-8c0c-75a0188d0b58 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:38.493856 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b3094d86-e7a0-4a6f-8c0c-75a0188d0b58 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:38.494282 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b3094d86-e7a0-4a6f-8c0c-75a0188d0b58 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:38.509725 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-b3094d86-e7a0-4a6f-8c0c-75a0188d0b58 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] HTTP exception thrown: Instance e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 could not be found. Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b3094d86-e7a0-4a6f-8c0c-75a0188d0b58 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Request method failure captured: Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 HTTP/1.1 Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHsd-AnnLZFS6-Lbfr9ATef_4cX6EE0Up-a_Ch8dobncDUqljTHX0YcK7WbJaaBcAlN6twvlZe9au1SNJQwC5-nItcb7pEhHjqWyH9GhqCmgS3jEbfUY8st6zk2hVKWMOxRl1E1nEdlCzWIcW0YZf7xPnP7IvCJy_UgVMW4-UpTlv4M Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2f92ad05650840f6bb4c8f6134b489ca", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-DeleteServersTestJSON-419044733 Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-DeleteServersTestJSON-419044733-project Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: d244789bea974bd99d0f1debebabb54a Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-DeleteServersTestJSON-419044733-project Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 could not be found. Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'e3157819-80a0-4ca3-9ad5-fe790fb7b2a1'} Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 could not be found. Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 could not be found. Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:55:38.511436 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:55:38.521078 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:55:38.521078 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:55:38.521078 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:55:38.521078 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:55:38.521078 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:55:38.521078 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 could not be found. Sep 10 11:55:38.521078 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:55:38.521078 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b3094d86-e7a0-4a6f-8c0c-75a0188d0b58 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Returning 404 to user: Instance e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:55:38.521078 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b3094d86-e7a0-4a6f-8c0c-75a0188d0b58 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/e3157819-80a0-4ca3-9ad5-fe790fb7b2a1" status: 404 len: 111 microversion: 2.1 time: 0.049528 Sep 10 11:55:38.521078 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1815/3617] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:38 2022] GET /compute/v2.1/servers/e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:55:38.536042 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7263a1b3-e3fe-4459-ae75-e64875b1fff6 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:38.536543 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7263a1b3-e3fe-4459-ae75-e64875b1fff6 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:38.545797 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7263a1b3-e3fe-4459-ae75-e64875b1fff6 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:38.546289 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7263a1b3-e3fe-4459-ae75-e64875b1fff6 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:38.546727 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7263a1b3-e3fe-4459-ae75-e64875b1fff6 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:38.547453 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7263a1b3-e3fe-4459-ae75-e64875b1fff6 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:38.547937 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7263a1b3-e3fe-4459-ae75-e64875b1fff6 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:38.548362 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7263a1b3-e3fe-4459-ae75-e64875b1fff6 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:38.567431 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0574c128-3d4b-4025-b75c-5801785b1653 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/6ecb4b95-c373-456b-9e15-ee7c9822bca3" status: 200 len: 662 microversion: 2.1 time: 0.093104 Sep 10 11:55:38.568421 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1803/3618] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:55:38 2022] GET /compute/v2.1/images/6ecb4b95-c373-456b-9e15-ee7c9822bca3 => generated 662 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:55:38.620194 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7263a1b3-e3fe-4459-ae75-e64875b1fff6 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:55:38.646925 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5b7ff810-70b4-4674-ac85-c112d87db21b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-554895983", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "471bef66-289e-44bc-a38f-0fbd7758b454"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:38.723650 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-5b7ff810-70b4-4674-ac85-c112d87db21b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] validate_networks() for [('471bef66-289e-44bc-a38f-0fbd7758b454', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:55:38.738785 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7263a1b3-e3fe-4459-ae75-e64875b1fff6 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "DELETE /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 204 len: 0 microversion: 2.20 time: 0.223277 Sep 10 11:55:38.739934 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1816/3619] 10.222.0.23 () {60 vars in 1280 bytes} [Sat Sep 10 11:55:38 2022] DELETE /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 11:55:38.750730 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-15129e90-a9ef-42ca-9a5c-a6668e3b72fe tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:38.751697 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-15129e90-a9ef-42ca-9a5c-a6668e3b72fe tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:38.758493 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-15129e90-a9ef-42ca-9a5c-a6668e3b72fe tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:38.758978 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-15129e90-a9ef-42ca-9a5c-a6668e3b72fe tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:38.759451 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-15129e90-a9ef-42ca-9a5c-a6668e3b72fe tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:38.760302 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-15129e90-a9ef-42ca-9a5c-a6668e3b72fe tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:38.760928 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-15129e90-a9ef-42ca-9a5c-a6668e3b72fe tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:38.761612 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-15129e90-a9ef-42ca-9a5c-a6668e3b72fe tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:39.081130 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-15129e90-a9ef-42ca-9a5c-a6668e3b72fe tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:39.091112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-15129e90-a9ef-42ca-9a5c-a6668e3b72fe tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:39.092640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-15129e90-a9ef-42ca-9a5c-a6668e3b72fe tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:39.093827 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-15129e90-a9ef-42ca-9a5c-a6668e3b72fe tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1723 microversion: 2.20 time: 0.349152 Sep 10 11:55:39.094395 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1817/3620] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:55:38 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1723 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:55:39.380693 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3e8992b7-c2cc-4a6e-81be-4214b38566f0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:39.382019 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3e8992b7-c2cc-4a6e-81be-4214b38566f0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:39.392319 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e8992b7-c2cc-4a6e-81be-4214b38566f0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:39.393139 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e8992b7-c2cc-4a6e-81be-4214b38566f0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:39.394075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e8992b7-c2cc-4a6e-81be-4214b38566f0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:39.395369 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e8992b7-c2cc-4a6e-81be-4214b38566f0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:39.396068 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e8992b7-c2cc-4a6e-81be-4214b38566f0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:39.402998 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e8992b7-c2cc-4a6e-81be-4214b38566f0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:39.640071 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-5b7ff810-70b4-4674-ac85-c112d87db21b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:55:39.640545 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-5b7ff810-70b4-4674-ac85-c112d87db21b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:55:39.641384 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-5b7ff810-70b4-4674-ac85-c112d87db21b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:55:39.641566 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-5b7ff810-70b4-4674-ac85-c112d87db21b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:55:39.641883 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-5b7ff810-70b4-4674-ac85-c112d87db21b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:55:39.653484 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b7ff810-70b4-4674-ac85-c112d87db21b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:39.653978 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b7ff810-70b4-4674-ac85-c112d87db21b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:39.654619 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b7ff810-70b4-4674-ac85-c112d87db21b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:39.655515 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b7ff810-70b4-4674-ac85-c112d87db21b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:39.656230 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b7ff810-70b4-4674-ac85-c112d87db21b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:39.656675 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b7ff810-70b4-4674-ac85-c112d87db21b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:39.663233 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3e8992b7-c2cc-4a6e-81be-4214b38566f0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:39.676884 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3e8992b7-c2cc-4a6e-81be-4214b38566f0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180" status: 200 len: 1521 microversion: 2.1 time: 0.306119 Sep 10 11:55:39.680072 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1818/3621] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:39 2022] GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180 => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:39.687422 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3411bde1-2dad-4c39-b8b7-5a6296ed6af6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:39.688348 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3411bde1-2dad-4c39-b8b7-5a6296ed6af6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: 9af45fd0-4f3b-480b-a33f-df501592594d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:39.695698 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3411bde1-2dad-4c39-b8b7-5a6296ed6af6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:39.696398 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3411bde1-2dad-4c39-b8b7-5a6296ed6af6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:39.697032 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3411bde1-2dad-4c39-b8b7-5a6296ed6af6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:39.697785 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3411bde1-2dad-4c39-b8b7-5a6296ed6af6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:39.698266 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3411bde1-2dad-4c39-b8b7-5a6296ed6af6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:39.698691 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3411bde1-2dad-4c39-b8b7-5a6296ed6af6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:39.699031 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-5b7ff810-70b4-4674-ac85-c112d87db21b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Getting quotas for project 2f92ad05650840f6bb4c8f6134b489ca. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:55:39.705892 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-5b7ff810-70b4-4674-ac85-c112d87db21b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Getting quotas for user d244789bea974bd99d0f1debebabb54a and project 2f92ad05650840f6bb4c8f6134b489ca. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:55:39.722670 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5b7ff810-70b4-4674-ac85-c112d87db21b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:55:39.725479 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5b7ff810-70b4-4674-ac85-c112d87db21b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 9da5b114-2ad4-41f0-897f-d4e2984f5a16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:55:39.777091 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5b7ff810-70b4-4674-ac85-c112d87db21b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.134434 Sep 10 11:55:39.784225 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1804/3622] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:55:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:55:39.796903 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d1b8d232-6286-4bdd-a130-1d40c2b932b0 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:39.796903 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d1b8d232-6286-4bdd-a130-1d40c2b932b0 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 9da5b114-2ad4-41f0-897f-d4e2984f5a16] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:39.905006 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d1b8d232-6286-4bdd-a130-1d40c2b932b0 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:39.920214 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d1b8d232-6286-4bdd-a130-1d40c2b932b0 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16" status: 200 len: 1214 microversion: 2.1 time: 0.129381 Sep 10 11:55:39.920898 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1805/3623] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:39 2022] GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16 => generated 1214 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:40.075319 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-77be9772-3e28-4e8d-90b0-ece269aabfef tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f40739e99d0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:40.148233 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3411bde1-2dad-4c39-b8b7-5a6296ed6af6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:40.154071 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-77be9772-3e28-4e8d-90b0-ece269aabfef tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/7befc81b-98f5-4a10-8312-e2558586f3cc" status: 200 len: 661 microversion: 2.1 time: 0.082455 Sep 10 11:55:40.154969 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1806/3624] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:55:40 2022] GET /compute/v2.1/images/7befc81b-98f5-4a10-8312-e2558586f3cc => generated 661 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:55:40.159473 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3411bde1-2dad-4c39-b8b7-5a6296ed6af6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d" status: 200 len: 1505 microversion: 2.1 time: 0.478974 Sep 10 11:55:40.161014 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1862e176-181f-4853-84b4-2c7bfbfa3933 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:40.161823 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1862e176-181f-4853-84b4-2c7bfbfa3933 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:40.172015 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1819/3625] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:39 2022] GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d => generated 1505 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:40.182326 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d3e6ea15-d7a3-49e9-ad27-0d62cf9055e5 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:40.184454 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1862e176-181f-4853-84b4-2c7bfbfa3933 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:40.185441 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d3e6ea15-d7a3-49e9-ad27-0d62cf9055e5 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: 70c46bf2-0367-499b-822a-e18923866289] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:40.185994 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1862e176-181f-4853-84b4-2c7bfbfa3933 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:40.186482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1862e176-181f-4853-84b4-2c7bfbfa3933 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:40.189799 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1862e176-181f-4853-84b4-2c7bfbfa3933 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:40.192139 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1862e176-181f-4853-84b4-2c7bfbfa3933 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:40.193612 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1862e176-181f-4853-84b4-2c7bfbfa3933 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:40.193970 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3e6ea15-d7a3-49e9-ad27-0d62cf9055e5 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:40.194562 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3e6ea15-d7a3-49e9-ad27-0d62cf9055e5 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:40.195073 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3e6ea15-d7a3-49e9-ad27-0d62cf9055e5 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:40.195903 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3e6ea15-d7a3-49e9-ad27-0d62cf9055e5 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:40.196499 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3e6ea15-d7a3-49e9-ad27-0d62cf9055e5 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:40.196931 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3e6ea15-d7a3-49e9-ad27-0d62cf9055e5 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:40.257858 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d3e6ea15-d7a3-49e9-ad27-0d62cf9055e5 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "POST /compute/v2.1/servers/70c46bf2-0367-499b-822a-e18923866289/action" status: 200 len: 32644 microversion: 2.1 time: 0.084441 Sep 10 11:55:40.266157 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1820/3626] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:55:40 2022] POST /compute/v2.1/servers/70c46bf2-0367-499b-822a-e18923866289/action => generated 32644 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:55:40.274308 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b9c65fc7-3aa4-452f-8a74-908a69df7ac9 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f407368bf70>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:40.339344 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b9c65fc7-3aa4-452f-8a74-908a69df7ac9 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/7befc81b-98f5-4a10-8312-e2558586f3cc" status: 200 len: 661 microversion: 2.1 time: 0.067677 Sep 10 11:55:40.342729 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1821/3627] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:55:40 2022] GET /compute/v2.1/images/7befc81b-98f5-4a10-8312-e2558586f3cc => generated 661 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:55:40.705538 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-94f440d5-e1e2-41de-b3d5-9a089cf1d0e1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:40.706581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-94f440d5-e1e2-41de-b3d5-9a089cf1d0e1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:40.713392 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94f440d5-e1e2-41de-b3d5-9a089cf1d0e1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:40.714090 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94f440d5-e1e2-41de-b3d5-9a089cf1d0e1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:40.714717 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94f440d5-e1e2-41de-b3d5-9a089cf1d0e1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:40.715654 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94f440d5-e1e2-41de-b3d5-9a089cf1d0e1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:40.716260 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94f440d5-e1e2-41de-b3d5-9a089cf1d0e1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:40.716848 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94f440d5-e1e2-41de-b3d5-9a089cf1d0e1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:40.983144 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1862e176-181f-4853-84b4-2c7bfbfa3933 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:40.992693 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1862e176-181f-4853-84b4-2c7bfbfa3933 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:40.994521 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1862e176-181f-4853-84b4-2c7bfbfa3933 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:40.996271 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1862e176-181f-4853-84b4-2c7bfbfa3933 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1723 microversion: 2.20 time: 0.839594 Sep 10 11:55:41.011193 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1807/3628] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:55:40 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1723 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:55:41.019421 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e44e5375-6fb3-41c2-9c92-a5d394eba47c tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:41.020234 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e44e5375-6fb3-41c2-9c92-a5d394eba47c tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 9da5b114-2ad4-41f0-897f-d4e2984f5a16] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:41.026835 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e44e5375-6fb3-41c2-9c92-a5d394eba47c tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:41.028191 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e44e5375-6fb3-41c2-9c92-a5d394eba47c tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:41.028917 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e44e5375-6fb3-41c2-9c92-a5d394eba47c tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:41.029590 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e44e5375-6fb3-41c2-9c92-a5d394eba47c tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:41.030171 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e44e5375-6fb3-41c2-9c92-a5d394eba47c tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:41.030870 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e44e5375-6fb3-41c2-9c92-a5d394eba47c tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:41.063621 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-94f440d5-e1e2-41de-b3d5-9a089cf1d0e1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:41.066888 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:55:41.081366 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-94f440d5-e1e2-41de-b3d5-9a089cf1d0e1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180" status: 200 len: 1521 microversion: 2.1 time: 0.380301 Sep 10 11:55:41.082742 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1822/3629] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:40 2022] GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180 => generated 1521 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:55:41.155127 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e44e5375-6fb3-41c2-9c92-a5d394eba47c tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:41.164559 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e44e5375-6fb3-41c2-9c92-a5d394eba47c tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16" status: 200 len: 1266 microversion: 2.1 time: 0.153390 Sep 10 11:55:41.165785 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1808/3630] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:41 2022] GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:41.188028 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6c44494a-4439-47ce-9178-c80bb2c59bf4 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:41.189486 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6c44494a-4439-47ce-9178-c80bb2c59bf4 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: 9af45fd0-4f3b-480b-a33f-df501592594d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:41.200413 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6c44494a-4439-47ce-9178-c80bb2c59bf4 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:41.201148 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6c44494a-4439-47ce-9178-c80bb2c59bf4 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:41.202096 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6c44494a-4439-47ce-9178-c80bb2c59bf4 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:41.203715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6c44494a-4439-47ce-9178-c80bb2c59bf4 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:41.204367 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6c44494a-4439-47ce-9178-c80bb2c59bf4 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:41.204983 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6c44494a-4439-47ce-9178-c80bb2c59bf4 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:41.458873 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6c44494a-4439-47ce-9178-c80bb2c59bf4 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:41.473078 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6c44494a-4439-47ce-9178-c80bb2c59bf4 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d" status: 200 len: 1505 microversion: 2.1 time: 0.289252 Sep 10 11:55:41.474624 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1823/3631] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:41 2022] GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d => generated 1505 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:41.821510 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b433c585-4b4b-44f0-9052-356cbc339723 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f407292b550>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:41.871645 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b433c585-4b4b-44f0-9052-356cbc339723 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/335e781f-56dc-4ac1-8e1d-4abb9ea32d8c" status: 200 len: 661 microversion: 2.1 time: 0.053818 Sep 10 11:55:41.872242 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1809/3632] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:55:41 2022] GET /compute/v2.1/images/335e781f-56dc-4ac1-8e1d-4abb9ea32d8c => generated 661 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:55:41.888915 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-44fcef8f-ced2-4b49-8f3d-b2ad5bda8704 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4073b66ee0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:41.935361 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-44fcef8f-ced2-4b49-8f3d-b2ad5bda8704 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/335e781f-56dc-4ac1-8e1d-4abb9ea32d8c" status: 200 len: 661 microversion: 2.1 time: 0.051976 Sep 10 11:55:41.936222 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1824/3633] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:55:41 2022] GET /compute/v2.1/images/335e781f-56dc-4ac1-8e1d-4abb9ea32d8c => generated 661 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:55:42.024787 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-85fcb2b7-03b9-417e-be04-e3c855493e54 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:42.026159 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-85fcb2b7-03b9-417e-be04-e3c855493e54 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:42.033955 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85fcb2b7-03b9-417e-be04-e3c855493e54 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:42.035889 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85fcb2b7-03b9-417e-be04-e3c855493e54 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:42.036726 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85fcb2b7-03b9-417e-be04-e3c855493e54 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:42.038001 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85fcb2b7-03b9-417e-be04-e3c855493e54 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:42.038989 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85fcb2b7-03b9-417e-be04-e3c855493e54 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:42.039773 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85fcb2b7-03b9-417e-be04-e3c855493e54 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:42.091616 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bfd81d60-33dd-4830-89ba-d999e4832c6b tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-397736127", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:42.188003 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-bfd81d60-33dd-4830-89ba-d999e4832c6b tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] validate_networks() for None {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:55:43.124402 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-85fcb2b7-03b9-417e-be04-e3c855493e54 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:43.145658 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-85fcb2b7-03b9-417e-be04-e3c855493e54 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:43.157126 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-85fcb2b7-03b9-417e-be04-e3c855493e54 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:43.158884 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-85fcb2b7-03b9-417e-be04-e3c855493e54 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 200 len: 1723 microversion: 2.20 time: 1.139660 Sep 10 11:55:43.160132 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1810/3634] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:55:42 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 1723 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:55:43.180622 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-260589ba-1c0f-41de-a45b-0618ce7979e6 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:43.181412 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-260589ba-1c0f-41de-a45b-0618ce7979e6 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:43.188802 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-260589ba-1c0f-41de-a45b-0618ce7979e6 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:43.192418 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-260589ba-1c0f-41de-a45b-0618ce7979e6 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:43.193825 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-260589ba-1c0f-41de-a45b-0618ce7979e6 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:43.194986 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-260589ba-1c0f-41de-a45b-0618ce7979e6 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:43.195703 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-260589ba-1c0f-41de-a45b-0618ce7979e6 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:43.196426 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-260589ba-1c0f-41de-a45b-0618ce7979e6 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:43.316738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-bfd81d60-33dd-4830-89ba-d999e4832c6b tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:55:43.317258 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-bfd81d60-33dd-4830-89ba-d999e4832c6b tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:55:43.317941 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-bfd81d60-33dd-4830-89ba-d999e4832c6b tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:55:43.318435 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-bfd81d60-33dd-4830-89ba-d999e4832c6b tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:55:43.318987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-bfd81d60-33dd-4830-89ba-d999e4832c6b tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:55:43.335490 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bfd81d60-33dd-4830-89ba-d999e4832c6b tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:43.336829 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bfd81d60-33dd-4830-89ba-d999e4832c6b tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:43.340934 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bfd81d60-33dd-4830-89ba-d999e4832c6b tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:43.344600 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bfd81d60-33dd-4830-89ba-d999e4832c6b tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:43.345307 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bfd81d60-33dd-4830-89ba-d999e4832c6b tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:43.346357 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bfd81d60-33dd-4830-89ba-d999e4832c6b tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:43.424550 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-bfd81d60-33dd-4830-89ba-d999e4832c6b tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Getting quotas for project 6f245084ce3f409889039ba1ee751eed. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:55:43.439590 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-bfd81d60-33dd-4830-89ba-d999e4832c6b tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Getting quotas for user 72e27edecefe4d60a2dba4ba99055bb1 and project 6f245084ce3f409889039ba1ee751eed. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:55:43.467862 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bfd81d60-33dd-4830-89ba-d999e4832c6b tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:55:43.471328 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bfd81d60-33dd-4830-89ba-d999e4832c6b tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] [instance: af31e6eb-f34c-4ae9-aede-bc4ca6949556] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:55:43.544281 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bfd81d60-33dd-4830-89ba-d999e4832c6b tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.464886 Sep 10 11:55:43.573671 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1825/3635] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:55:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:55:43.610058 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-35ed055c-5d75-46ac-96d7-60925245be09 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:43.612483 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-35ed055c-5d75-46ac-96d7-60925245be09 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 9da5b114-2ad4-41f0-897f-d4e2984f5a16] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:43.654884 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-35ed055c-5d75-46ac-96d7-60925245be09 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:43.655590 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-35ed055c-5d75-46ac-96d7-60925245be09 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:43.655982 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-35ed055c-5d75-46ac-96d7-60925245be09 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:43.659667 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-35ed055c-5d75-46ac-96d7-60925245be09 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:43.660990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-35ed055c-5d75-46ac-96d7-60925245be09 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:43.663649 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-35ed055c-5d75-46ac-96d7-60925245be09 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:44.726927 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-260589ba-1c0f-41de-a45b-0618ce7979e6 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:44.749503 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-260589ba-1c0f-41de-a45b-0618ce7979e6 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180" status: 200 len: 1521 microversion: 2.1 time: 1.587490 Sep 10 11:55:44.760644 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1811/3636] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:43 2022] GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180 => generated 1521 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:44.767929 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-592fdf67-2f30-49ef-ac0a-96658c910b6b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:44.768800 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-592fdf67-2f30-49ef-ac0a-96658c910b6b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: 9af45fd0-4f3b-480b-a33f-df501592594d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:44.778350 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-592fdf67-2f30-49ef-ac0a-96658c910b6b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:44.778852 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-592fdf67-2f30-49ef-ac0a-96658c910b6b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:44.780399 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-592fdf67-2f30-49ef-ac0a-96658c910b6b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:44.782124 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-592fdf67-2f30-49ef-ac0a-96658c910b6b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:44.783058 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-592fdf67-2f30-49ef-ac0a-96658c910b6b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:44.783778 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-592fdf67-2f30-49ef-ac0a-96658c910b6b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:45.053665 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-35ed055c-5d75-46ac-96d7-60925245be09 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:45.066522 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-35ed055c-5d75-46ac-96d7-60925245be09 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16" status: 200 len: 1314 microversion: 2.1 time: 1.487564 Sep 10 11:55:45.080671 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1826/3637] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:43 2022] GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16 => generated 1314 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:45.107306 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-d1c600f6-feec-4fd5-ba3d-9b8b5c105836 req-0c19b9d3-2073-4ce7-a4fc-ac960fa259f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61ab78c6-917d-46d1-b3e2-9935ca45c8e2", "name": "network-vif-deleted", "tag": "998df393-88c6-4f53-8cdf-ce9cb6efbc62"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:45.137487 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d1c600f6-feec-4fd5-ba3d-9b8b5c105836 req-0c19b9d3-2073-4ce7-a4fc-ac960fa259f5 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:45.144436 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d1c600f6-feec-4fd5-ba3d-9b8b5c105836 req-0c19b9d3-2073-4ce7-a4fc-ac960fa259f5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:45.145118 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d1c600f6-feec-4fd5-ba3d-9b8b5c105836 req-0c19b9d3-2073-4ce7-a4fc-ac960fa259f5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:45.185010 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-d1c600f6-feec-4fd5-ba3d-9b8b5c105836 req-0c19b9d3-2073-4ce7-a4fc-ac960fa259f5 service nova] Creating event network-vif-deleted:998df393-88c6-4f53-8cdf-ce9cb6efbc62 for instance 61ab78c6-917d-46d1-b3e2-9935ca45c8e2 on n-h2-856895-1 Sep 10 11:55:45.204353 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-d1c600f6-feec-4fd5-ba3d-9b8b5c105836 req-0c19b9d3-2073-4ce7-a4fc-ac960fa259f5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113713 Sep 10 11:55:45.205246 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1827/3638] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:55:45.210544 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6fdffd27-429e-423d-8695-a7f3712df3a9 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1272791800", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:45.306077 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-6fdffd27-429e-423d-8695-a7f3712df3a9 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] validate_networks() for None {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:55:45.521833 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-592fdf67-2f30-49ef-ac0a-96658c910b6b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:45.539835 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-592fdf67-2f30-49ef-ac0a-96658c910b6b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d" status: 200 len: 1505 microversion: 2.1 time: 0.772499 Sep 10 11:55:45.542216 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1812/3639] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:44 2022] GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d => generated 1505 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:45.555147 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-20a19d04-788d-47a6-8c12-bd2f9779f606 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:45.558095 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-20a19d04-788d-47a6-8c12-bd2f9779f606 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: 70c46bf2-0367-499b-822a-e18923866289] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:45.576214 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20a19d04-788d-47a6-8c12-bd2f9779f606 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:45.577299 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20a19d04-788d-47a6-8c12-bd2f9779f606 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:45.577928 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20a19d04-788d-47a6-8c12-bd2f9779f606 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:45.579078 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20a19d04-788d-47a6-8c12-bd2f9779f606 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:45.579929 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20a19d04-788d-47a6-8c12-bd2f9779f606 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:45.584540 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20a19d04-788d-47a6-8c12-bd2f9779f606 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:45.645133 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-20a19d04-788d-47a6-8c12-bd2f9779f606 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: 70c46bf2-0367-499b-822a-e18923866289] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:55:45.832827 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-20a19d04-788d-47a6-8c12-bd2f9779f606 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "DELETE /compute/v2.1/servers/70c46bf2-0367-499b-822a-e18923866289" status: 204 len: 0 microversion: 2.1 time: 0.288315 Sep 10 11:55:45.837390 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1813/3640] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:55:45 2022] DELETE /compute/v2.1/servers/70c46bf2-0367-499b-822a-e18923866289 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:55:45.846330 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ccd5514c-8b3a-4381-a28a-af542a90bf7e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:45.851013 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ccd5514c-8b3a-4381-a28a-af542a90bf7e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:45.866717 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ccd5514c-8b3a-4381-a28a-af542a90bf7e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:45.870384 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ccd5514c-8b3a-4381-a28a-af542a90bf7e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:45.870931 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ccd5514c-8b3a-4381-a28a-af542a90bf7e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:45.875079 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ccd5514c-8b3a-4381-a28a-af542a90bf7e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:45.876574 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ccd5514c-8b3a-4381-a28a-af542a90bf7e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:45.876574 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ccd5514c-8b3a-4381-a28a-af542a90bf7e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:45.913073 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-ccd5514c-8b3a-4381-a28a-af542a90bf7e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] HTTP exception thrown: Instance 61ab78c6-917d-46d1-b3e2-9935ca45c8e2 could not be found. Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ccd5514c-8b3a-4381-a28a-af542a90bf7e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Request method failure captured: Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 HTTP/1.1 Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHphfhbI9Qteyjy3ZlWrVlKeCpT8zQm8i7n7Sggd45WVDD9yWc9UxuAh8PXlKHgR6Xe0vr_1iqbSyYTRkcahJaDM32Pgw8B1xZdS1O2rT-cXx_-R1ejO472cgUfAfw7CmlqdNhJE1X4u5IsFou0L-G1rp0byXvcTZ2mOtxrHGfiWFEQ Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: X-Openstack-Nova-Api-Version: 2.20 Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 66677b88ab6b436da8477f213df0ed1d Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-176716713 Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/66677b88ab6b436da8477f213df0ed1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/66677b88ab6b436da8477f213df0ed1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_66677b88ab6b436da8477f213df0ed1d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/66677b88ab6b436da8477f213df0ed1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-AttachVolumeShelveTestJSON-176716713 Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 66677b88ab6b436da8477f213df0ed1d Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-176716713 Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-AttachVolumeShelveTestJSON-176716713-project Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 20a5848b40dc4fbaa2a25a41d92d383a Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-AttachVolumeShelveTestJSON-176716713-project Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 61ab78c6-917d-46d1-b3e2-9935ca45c8e2 could not be found. Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '61ab78c6-917d-46d1-b3e2-9935ca45c8e2'} Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61ab78c6-917d-46d1-b3e2-9935ca45c8e2 could not be found. Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61ab78c6-917d-46d1-b3e2-9935ca45c8e2 could not be found. Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:55:45.920637 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:55:45.923735 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:55:45.923735 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:55:45.923735 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:55:45.923735 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:55:45.923735 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:55:45.923735 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:55:45.923735 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61ab78c6-917d-46d1-b3e2-9935ca45c8e2 could not be found. Sep 10 11:55:45.923735 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:55:45.923735 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ccd5514c-8b3a-4381-a28a-af542a90bf7e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Returning 404 to user: Instance 61ab78c6-917d-46d1-b3e2-9935ca45c8e2 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:55:45.923735 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ccd5514c-8b3a-4381-a28a-af542a90bf7e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 404 len: 111 microversion: 2.20 time: 0.083060 Sep 10 11:55:45.925150 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1814/3641] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:55:45 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:55:45.942329 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-add2bcce-bbbe-4849-8ea1-10df5162fbb5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:45.943001 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-add2bcce-bbbe-4849-8ea1-10df5162fbb5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:45.960311 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-add2bcce-bbbe-4849-8ea1-10df5162fbb5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:45.960837 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-add2bcce-bbbe-4849-8ea1-10df5162fbb5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:45.961268 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-add2bcce-bbbe-4849-8ea1-10df5162fbb5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:45.962144 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-add2bcce-bbbe-4849-8ea1-10df5162fbb5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:45.962603 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-add2bcce-bbbe-4849-8ea1-10df5162fbb5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:45.963032 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-add2bcce-bbbe-4849-8ea1-10df5162fbb5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:46.240419 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-6fdffd27-429e-423d-8695-a7f3712df3a9 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:55:46.241493 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-6fdffd27-429e-423d-8695-a7f3712df3a9 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:55:46.242060 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-6fdffd27-429e-423d-8695-a7f3712df3a9 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:55:46.242548 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-6fdffd27-429e-423d-8695-a7f3712df3a9 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:55:46.243030 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-6fdffd27-429e-423d-8695-a7f3712df3a9 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:55:46.263974 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6fdffd27-429e-423d-8695-a7f3712df3a9 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:46.264677 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6fdffd27-429e-423d-8695-a7f3712df3a9 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:46.264888 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6fdffd27-429e-423d-8695-a7f3712df3a9 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:46.265928 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6fdffd27-429e-423d-8695-a7f3712df3a9 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:46.266441 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6fdffd27-429e-423d-8695-a7f3712df3a9 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:46.266910 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6fdffd27-429e-423d-8695-a7f3712df3a9 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:46.321614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-6fdffd27-429e-423d-8695-a7f3712df3a9 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Getting quotas for project 6f245084ce3f409889039ba1ee751eed. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:55:46.341282 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-6fdffd27-429e-423d-8695-a7f3712df3a9 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Getting quotas for user 72e27edecefe4d60a2dba4ba99055bb1 and project 6f245084ce3f409889039ba1ee751eed. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:55:46.364261 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6fdffd27-429e-423d-8695-a7f3712df3a9 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:55:46.372999 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6fdffd27-429e-423d-8695-a7f3712df3a9 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] [instance: aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:55:46.416345 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-add2bcce-bbbe-4849-8ea1-10df5162fbb5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:46.431253 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6fdffd27-429e-423d-8695-a7f3712df3a9 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.224687 Sep 10 11:55:46.432089 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1828/3642] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:55:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1226 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:55:46.434210 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-add2bcce-bbbe-4849-8ea1-10df5162fbb5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180" status: 200 len: 1521 microversion: 2.1 time: 0.507386 Sep 10 11:55:46.444442 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7f30b8df-4b0c-4d3e-b211-bb030818d151 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:46.445065 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7f30b8df-4b0c-4d3e-b211-bb030818d151 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: 70c46bf2-0367-499b-822a-e18923866289] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:46.452863 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1815/3643] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:45 2022] GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180 => generated 1521 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:46.453134 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f30b8df-4b0c-4d3e-b211-bb030818d151 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:46.453810 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f30b8df-4b0c-4d3e-b211-bb030818d151 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:46.454402 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f30b8df-4b0c-4d3e-b211-bb030818d151 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:46.455490 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f30b8df-4b0c-4d3e-b211-bb030818d151 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:46.457865 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-15ad5e9f-d920-4587-859c-69c76e556b5d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '.version_select at 0x7f4073aa6040>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:46.472513 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f30b8df-4b0c-4d3e-b211-bb030818d151 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:46.473429 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f30b8df-4b0c-4d3e-b211-bb030818d151 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:46.494851 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:55:46.508847 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-15ad5e9f-d920-4587-859c-69c76e556b5d tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-891424763" status: 204 len: 0 microversion: 2.20 time: 0.054756 Sep 10 11:55:46.510670 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1816/3644] 10.222.0.23 () {60 vars in 1259 bytes} [Sat Sep 10 11:55:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-891424763 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 11:55:46.521748 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dffd9596-6792-4bd9-879c-abb81ec456e9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:46.525925 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-dffd9596-6792-4bd9-879c-abb81ec456e9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 9da5b114-2ad4-41f0-897f-d4e2984f5a16] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:46.546775 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dffd9596-6792-4bd9-879c-abb81ec456e9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:46.549232 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dffd9596-6792-4bd9-879c-abb81ec456e9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:46.549659 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dffd9596-6792-4bd9-879c-abb81ec456e9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:46.551144 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dffd9596-6792-4bd9-879c-abb81ec456e9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:46.551644 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dffd9596-6792-4bd9-879c-abb81ec456e9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:46.552078 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dffd9596-6792-4bd9-879c-abb81ec456e9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:46.929869 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-dffd9596-6792-4bd9-879c-abb81ec456e9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:46.940474 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-dffd9596-6792-4bd9-879c-abb81ec456e9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16" status: 200 len: 1314 microversion: 2.1 time: 0.428674 Sep 10 11:55:46.945900 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1817/3645] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:46 2022] GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16 => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:46.955296 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9e453d8b-88bd-40cc-8515-1ee45161980b tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:46.956154 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9e453d8b-88bd-40cc-8515-1ee45161980b tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] [instance: aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:47.026911 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7f30b8df-4b0c-4d3e-b211-bb030818d151 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be647276cc456e83dacd25b98e37f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20756c1a77fb44f684973f382b802825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:47.063842 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7f30b8df-4b0c-4d3e-b211-bb030818d151 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/70c46bf2-0367-499b-822a-e18923866289" status: 200 len: 1669 microversion: 2.1 time: 0.622780 Sep 10 11:55:47.067511 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1829/3646] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:46 2022] GET /compute/v2.1/servers/70c46bf2-0367-499b-822a-e18923866289 => generated 1669 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:47.074807 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a7b2a561-cfc6-49ba-9942-7bfe5cc0096f tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:47.075807 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a7b2a561-cfc6-49ba-9942-7bfe5cc0096f tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: 9af45fd0-4f3b-480b-a33f-df501592594d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:47.083775 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:55:47.086610 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a7b2a561-cfc6-49ba-9942-7bfe5cc0096f tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:47.088124 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a7b2a561-cfc6-49ba-9942-7bfe5cc0096f tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:47.089009 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a7b2a561-cfc6-49ba-9942-7bfe5cc0096f tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:47.090411 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a7b2a561-cfc6-49ba-9942-7bfe5cc0096f tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:47.095468 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9e453d8b-88bd-40cc-8515-1ee45161980b tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e27edecefe4d60a2dba4ba99055bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f245084ce3f409889039ba1ee751eed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:47.105032 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a7b2a561-cfc6-49ba-9942-7bfe5cc0096f tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:47.106556 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a7b2a561-cfc6-49ba-9942-7bfe5cc0096f tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:47.109670 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9e453d8b-88bd-40cc-8515-1ee45161980b tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7" status: 200 len: 1218 microversion: 2.1 time: 0.160853 Sep 10 11:55:47.111769 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1818/3647] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:46 2022] GET /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7 => generated 1218 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:47.122301 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b573e8cc-16af-4191-bad2-69cdc0b08313 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1417290845", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "5c169213-1457-4e40-ab33-024fc6148323"}, {"uuid": "11846a23-3f50-4d47-97f6-18ebec40ce76"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:47.229806 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-b573e8cc-16af-4191-bad2-69cdc0b08313 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] validate_networks() for [('5c169213-1457-4e40-ab33-024fc6148323', None, None, None, None, None), ('11846a23-3f50-4d47-97f6-18ebec40ce76', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:55:47.579153 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a7b2a561-cfc6-49ba-9942-7bfe5cc0096f tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:47.591283 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a7b2a561-cfc6-49ba-9942-7bfe5cc0096f tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d" status: 200 len: 1505 microversion: 2.1 time: 0.520516 Sep 10 11:55:47.592016 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1830/3648] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:47 2022] GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d => generated 1505 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:47.596822 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-cc531ddc-bc9b-44fe-af9a-95b55cf3cd33 req-8ef76480-ac1c-4133-882f-edaba9f2259c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70c46bf2-0367-499b-822a-e18923866289", "tag": "4f477cca-0fac-4e49-8748-690968026f45"}, {"name": "network-changed", "server_uuid": "9da5b114-2ad4-41f0-897f-d4e2984f5a16", "tag": "7598d657-80cf-4e28-8238-e097ce3d8fe0"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:47.610631 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-cc531ddc-bc9b-44fe-af9a-95b55cf3cd33 req-8ef76480-ac1c-4133-882f-edaba9f2259c service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:47.611680 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-cc531ddc-bc9b-44fe-af9a-95b55cf3cd33 req-8ef76480-ac1c-4133-882f-edaba9f2259c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:47.612329 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-cc531ddc-bc9b-44fe-af9a-95b55cf3cd33 req-8ef76480-ac1c-4133-882f-edaba9f2259c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:47.631151 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-cc531ddc-bc9b-44fe-af9a-95b55cf3cd33 req-8ef76480-ac1c-4133-882f-edaba9f2259c service nova] Creating event network-changed:4f477cca-0fac-4e49-8748-690968026f45 for instance 70c46bf2-0367-499b-822a-e18923866289 on n-h2-856895-1 Sep 10 11:55:47.632179 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-cc531ddc-bc9b-44fe-af9a-95b55cf3cd33 req-8ef76480-ac1c-4133-882f-edaba9f2259c service nova] Creating event network-changed:7598d657-80cf-4e28-8238-e097ce3d8fe0 for instance 9da5b114-2ad4-41f0-897f-d4e2984f5a16 on n-h1-856895-1 Sep 10 11:55:47.641616 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-cc531ddc-bc9b-44fe-af9a-95b55cf3cd33 req-8ef76480-ac1c-4133-882f-edaba9f2259c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.048291 Sep 10 11:55:47.642383 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1831/3649] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:55:47.647746 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-50cbbb3a-ce3f-4f34-abfa-f3a1b373a24e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:47.648534 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-50cbbb3a-ce3f-4f34-abfa-f3a1b373a24e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:47.657086 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-50cbbb3a-ce3f-4f34-abfa-f3a1b373a24e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:47.657756 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-50cbbb3a-ce3f-4f34-abfa-f3a1b373a24e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:47.658302 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-50cbbb3a-ce3f-4f34-abfa-f3a1b373a24e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:47.659529 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-50cbbb3a-ce3f-4f34-abfa-f3a1b373a24e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:47.661075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-50cbbb3a-ce3f-4f34-abfa-f3a1b373a24e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:47.661778 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-50cbbb3a-ce3f-4f34-abfa-f3a1b373a24e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:48.049197 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-50cbbb3a-ce3f-4f34-abfa-f3a1b373a24e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:48.058360 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-50cbbb3a-ce3f-4f34-abfa-f3a1b373a24e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180" status: 200 len: 1521 microversion: 2.1 time: 0.414417 Sep 10 11:55:48.059951 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1832/3650] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:47 2022] GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180 => generated 1521 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:48.066025 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-aaf730e3-36c0-4a82-92eb-f3b0458f4a06 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:48.066635 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-aaf730e3-36c0-4a82-92eb-f3b0458f4a06 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 9da5b114-2ad4-41f0-897f-d4e2984f5a16] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:48.072645 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aaf730e3-36c0-4a82-92eb-f3b0458f4a06 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:48.075262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aaf730e3-36c0-4a82-92eb-f3b0458f4a06 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:48.075937 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aaf730e3-36c0-4a82-92eb-f3b0458f4a06 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:48.076831 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aaf730e3-36c0-4a82-92eb-f3b0458f4a06 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:48.077436 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aaf730e3-36c0-4a82-92eb-f3b0458f4a06 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:48.078206 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aaf730e3-36c0-4a82-92eb-f3b0458f4a06 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:48.417310 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-aaf730e3-36c0-4a82-92eb-f3b0458f4a06 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:48.428628 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-aaf730e3-36c0-4a82-92eb-f3b0458f4a06 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16" status: 200 len: 1314 microversion: 2.1 time: 0.365586 Sep 10 11:55:48.430847 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1833/3651] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:48 2022] GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16 => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:48.436746 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a941daee-a539-42a7-b65e-43907a1c12de tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:48.437353 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a941daee-a539-42a7-b65e-43907a1c12de tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: 70c46bf2-0367-499b-822a-e18923866289] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:48.453899 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a941daee-a539-42a7-b65e-43907a1c12de tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:48.454618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a941daee-a539-42a7-b65e-43907a1c12de tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:48.455344 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a941daee-a539-42a7-b65e-43907a1c12de tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:48.456208 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a941daee-a539-42a7-b65e-43907a1c12de tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:48.456826 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a941daee-a539-42a7-b65e-43907a1c12de tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:48.457393 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a941daee-a539-42a7-b65e-43907a1c12de tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:48.743786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a941daee-a539-42a7-b65e-43907a1c12de tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be647276cc456e83dacd25b98e37f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20756c1a77fb44f684973f382b802825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:48.752722 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a941daee-a539-42a7-b65e-43907a1c12de tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/70c46bf2-0367-499b-822a-e18923866289" status: 200 len: 1669 microversion: 2.1 time: 0.319742 Sep 10 11:55:48.753961 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1834/3652] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:48 2022] GET /compute/v2.1/servers/70c46bf2-0367-499b-822a-e18923866289 => generated 1669 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:48.758974 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-46ef8f1e-344d-4fe4-85b1-58d23d9a6ced tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:48.759974 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-46ef8f1e-344d-4fe4-85b1-58d23d9a6ced tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] [instance: aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:48.767786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46ef8f1e-344d-4fe4-85b1-58d23d9a6ced tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:48.768705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46ef8f1e-344d-4fe4-85b1-58d23d9a6ced tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:48.769351 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46ef8f1e-344d-4fe4-85b1-58d23d9a6ced tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:48.770288 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46ef8f1e-344d-4fe4-85b1-58d23d9a6ced tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:48.770953 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46ef8f1e-344d-4fe4-85b1-58d23d9a6ced tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:48.774980 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-b573e8cc-16af-4191-bad2-69cdc0b08313 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:55:48.775688 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-b573e8cc-16af-4191-bad2-69cdc0b08313 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:55:48.776281 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-b573e8cc-16af-4191-bad2-69cdc0b08313 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:55:48.776800 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-b573e8cc-16af-4191-bad2-69cdc0b08313 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:55:48.777897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-b573e8cc-16af-4191-bad2-69cdc0b08313 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:55:48.782251 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46ef8f1e-344d-4fe4-85b1-58d23d9a6ced tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:48.792092 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b573e8cc-16af-4191-bad2-69cdc0b08313 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:48.794934 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b573e8cc-16af-4191-bad2-69cdc0b08313 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:48.795744 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b573e8cc-16af-4191-bad2-69cdc0b08313 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:48.801490 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b573e8cc-16af-4191-bad2-69cdc0b08313 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:48.802360 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b573e8cc-16af-4191-bad2-69cdc0b08313 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:48.803776 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b573e8cc-16af-4191-bad2-69cdc0b08313 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:48.837582 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-b573e8cc-16af-4191-bad2-69cdc0b08313 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Getting quotas for project 37597777ce774f87aeabe08ab2227cbd. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:55:48.846940 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-b573e8cc-16af-4191-bad2-69cdc0b08313 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Getting quotas for user ce925a3528c64d4fa50a8310be9e7c06 and project 37597777ce774f87aeabe08ab2227cbd. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:55:48.862964 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b573e8cc-16af-4191-bad2-69cdc0b08313 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:55:48.865661 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b573e8cc-16af-4191-bad2-69cdc0b08313 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 1175db1c-de8d-4486-bf15-b45db331da80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:55:48.870955 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-46ef8f1e-344d-4fe4-85b1-58d23d9a6ced tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e27edecefe4d60a2dba4ba99055bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f245084ce3f409889039ba1ee751eed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:48.881834 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-46ef8f1e-344d-4fe4-85b1-58d23d9a6ced tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7" status: 200 len: 1278 microversion: 2.1 time: 0.126433 Sep 10 11:55:48.882879 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1835/3653] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:48 2022] GET /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7 => generated 1278 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:48.889141 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4f4f5a3f-2e5f-4f59-bf84-eadf56d87460 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:48.890039 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4f4f5a3f-2e5f-4f59-bf84-eadf56d87460 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: 9af45fd0-4f3b-480b-a33f-df501592594d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:48.919789 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4f4f5a3f-2e5f-4f59-bf84-eadf56d87460 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:48.920382 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4f4f5a3f-2e5f-4f59-bf84-eadf56d87460 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:48.923701 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4f4f5a3f-2e5f-4f59-bf84-eadf56d87460 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:48.924650 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4f4f5a3f-2e5f-4f59-bf84-eadf56d87460 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:48.925344 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4f4f5a3f-2e5f-4f59-bf84-eadf56d87460 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:48.926008 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4f4f5a3f-2e5f-4f59-bf84-eadf56d87460 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:48.939968 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b573e8cc-16af-4191-bad2-69cdc0b08313 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.824066 Sep 10 11:55:48.940659 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1819/3654] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:55:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:55:48.954509 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-867c554e-aa7a-44bd-850e-cc1929efe8fc tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:48.955513 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-867c554e-aa7a-44bd-850e-cc1929efe8fc tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 1175db1c-de8d-4486-bf15-b45db331da80] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:49.118006 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-867c554e-aa7a-44bd-850e-cc1929efe8fc tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:49.128023 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-867c554e-aa7a-44bd-850e-cc1929efe8fc tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80" status: 200 len: 1213 microversion: 2.1 time: 0.179420 Sep 10 11:55:49.131545 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1820/3655] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:48 2022] GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80 => generated 1213 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:55:49.137086 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-352cfa85-9158-4c33-b8cc-3d244a3e9656 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:49.141118 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-352cfa85-9158-4c33-b8cc-3d244a3e9656 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:49.163586 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-352cfa85-9158-4c33-b8cc-3d244a3e9656 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:49.170044 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-352cfa85-9158-4c33-b8cc-3d244a3e9656 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:49.170618 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-352cfa85-9158-4c33-b8cc-3d244a3e9656 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:49.171934 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-352cfa85-9158-4c33-b8cc-3d244a3e9656 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:49.172630 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-352cfa85-9158-4c33-b8cc-3d244a3e9656 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:49.173389 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-352cfa85-9158-4c33-b8cc-3d244a3e9656 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:49.226888 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4f4f5a3f-2e5f-4f59-bf84-eadf56d87460 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:49.242293 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4f4f5a3f-2e5f-4f59-bf84-eadf56d87460 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d" status: 200 len: 1505 microversion: 2.1 time: 0.357634 Sep 10 11:55:49.248768 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1836/3656] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:48 2022] GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d => generated 1505 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:49.456521 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8f4aacb4-24fd-4c3b-83ac-e7b1078d107e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:49.457160 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8f4aacb4-24fd-4c3b-83ac-e7b1078d107e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 9da5b114-2ad4-41f0-897f-d4e2984f5a16] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:49.467460 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-352cfa85-9158-4c33-b8cc-3d244a3e9656 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:49.467666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8f4aacb4-24fd-4c3b-83ac-e7b1078d107e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:49.467966 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8f4aacb4-24fd-4c3b-83ac-e7b1078d107e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:49.468403 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8f4aacb4-24fd-4c3b-83ac-e7b1078d107e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:49.474239 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8f4aacb4-24fd-4c3b-83ac-e7b1078d107e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:49.477638 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8f4aacb4-24fd-4c3b-83ac-e7b1078d107e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:49.479221 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8f4aacb4-24fd-4c3b-83ac-e7b1078d107e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:49.483245 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-352cfa85-9158-4c33-b8cc-3d244a3e9656 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180" status: 200 len: 1521 microversion: 2.1 time: 0.348608 Sep 10 11:55:49.491229 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1821/3657] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:49 2022] GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180 => generated 1521 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:49.694501 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-68d1bb0b-3260-49d4-be4b-513c5680dfc6 req-818e432e-01a7-4524-b90c-a3fb5c3feb11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c46bf2-0367-499b-822a-e18923866289", "name": "network-vif-deleted", "tag": "4f477cca-0fac-4e49-8748-690968026f45"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:49.723866 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-68d1bb0b-3260-49d4-be4b-513c5680dfc6 req-818e432e-01a7-4524-b90c-a3fb5c3feb11 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:49.724698 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-68d1bb0b-3260-49d4-be4b-513c5680dfc6 req-818e432e-01a7-4524-b90c-a3fb5c3feb11 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:49.726325 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-68d1bb0b-3260-49d4-be4b-513c5680dfc6 req-818e432e-01a7-4524-b90c-a3fb5c3feb11 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:49.754074 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-68d1bb0b-3260-49d4-be4b-513c5680dfc6 req-818e432e-01a7-4524-b90c-a3fb5c3feb11 service nova] Creating event network-vif-deleted:4f477cca-0fac-4e49-8748-690968026f45 for instance 70c46bf2-0367-499b-822a-e18923866289 on n-h2-856895-1 Sep 10 11:55:49.769937 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-68d1bb0b-3260-49d4-be4b-513c5680dfc6 req-818e432e-01a7-4524-b90c-a3fb5c3feb11 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080310 Sep 10 11:55:49.771366 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8f4aacb4-24fd-4c3b-83ac-e7b1078d107e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:49.776156 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1822/3658] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:55:49.784591 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8f4aacb4-24fd-4c3b-83ac-e7b1078d107e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16" status: 200 len: 1314 microversion: 2.1 time: 0.332138 Sep 10 11:55:49.785573 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1837/3659] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:49 2022] GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:55:49.789654 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-84963094-402c-4338-8138-d3dc0cfa8767 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:49.790947 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-84963094-402c-4338-8138-d3dc0cfa8767 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: 70c46bf2-0367-499b-822a-e18923866289] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:49.800069 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-84963094-402c-4338-8138-d3dc0cfa8767 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:49.800898 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-84963094-402c-4338-8138-d3dc0cfa8767 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:49.801502 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-84963094-402c-4338-8138-d3dc0cfa8767 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:49.802246 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-84963094-402c-4338-8138-d3dc0cfa8767 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:49.802745 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-84963094-402c-4338-8138-d3dc0cfa8767 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:49.803422 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-84963094-402c-4338-8138-d3dc0cfa8767 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:49.846353 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-84963094-402c-4338-8138-d3dc0cfa8767 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:49.847149 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-84963094-402c-4338-8138-d3dc0cfa8767 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:49.847670 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-84963094-402c-4338-8138-d3dc0cfa8767 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:49.848362 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-84963094-402c-4338-8138-d3dc0cfa8767 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lazy-loading 'fault' on Instance uuid 70c46bf2-0367-499b-822a-e18923866289 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:55:49.904290 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-84963094-402c-4338-8138-d3dc0cfa8767 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92be647276cc456e83dacd25b98e37f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20756c1a77fb44f684973f382b802825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:49.906257 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-49351833-75e6-4a0f-a029-14e8a54a1e79 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:49.907368 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-49351833-75e6-4a0f-a029-14e8a54a1e79 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] [instance: aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:49.915491 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-84963094-402c-4338-8138-d3dc0cfa8767 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/70c46bf2-0367-499b-822a-e18923866289" status: 200 len: 1337 microversion: 2.1 time: 0.134229 Sep 10 11:55:49.923237 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1823/3660] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:49 2022] GET /compute/v2.1/servers/70c46bf2-0367-499b-822a-e18923866289 => generated 1337 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:49.923413 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-49351833-75e6-4a0f-a029-14e8a54a1e79 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:49.923413 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-49351833-75e6-4a0f-a029-14e8a54a1e79 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:49.925635 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-49351833-75e6-4a0f-a029-14e8a54a1e79 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:49.926379 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-49351833-75e6-4a0f-a029-14e8a54a1e79 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:49.927902 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-49351833-75e6-4a0f-a029-14e8a54a1e79 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:49.928355 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-49351833-75e6-4a0f-a029-14e8a54a1e79 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:50.023360 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-49351833-75e6-4a0f-a029-14e8a54a1e79 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e27edecefe4d60a2dba4ba99055bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f245084ce3f409889039ba1ee751eed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:50.031198 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-49351833-75e6-4a0f-a029-14e8a54a1e79 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7" status: 200 len: 1278 microversion: 2.1 time: 0.129098 Sep 10 11:55:50.031769 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1838/3661] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:49 2022] GET /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7 => generated 1278 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:55:50.070723 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4ae30a56-0cae-4e93-a873-c5c75a399b1f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Action: 'create', calling method: .version_select at 0x7f407250b670>, body: {"keypair": {"name": "tempest-keypair-2083658485", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4hUUvtRhWqeBJzduAv6f3AgJrR7bB7rIou1h1xFTc/FsBZK4oWs1n0zK8jAKUsyIvyyp/3MRYijThDYV+HcF1XJbLcDuiuHeQOzMGUfQRXHK4HAUGwYBGTWzDeTulS8w=="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:50.088028 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-4ae30a56-0cae-4e93-a873-c5c75a399b1f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Getting quotas for project 66677b88ab6b436da8477f213df0ed1d. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:55:50.093740 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-4ae30a56-0cae-4e93-a873-c5c75a399b1f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Getting quotas for user 20a5848b40dc4fbaa2a25a41d92d383a and project 66677b88ab6b436da8477f213df0ed1d. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:55:50.143759 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4ae30a56-0cae-4e93-a873-c5c75a399b1f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.073186 Sep 10 11:55:50.146230 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1824/3662] 10.222.0.23 () {62 vars in 1200 bytes} [Sat Sep 10 11:55:50 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 80 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 10 11:55:50.154237 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-980974bf-1489-4281-a331-6e56bb7ba982 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:50.154897 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-980974bf-1489-4281-a331-6e56bb7ba982 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 1175db1c-de8d-4486-bf15-b45db331da80] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:50.161992 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-980974bf-1489-4281-a331-6e56bb7ba982 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:50.165722 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-980974bf-1489-4281-a331-6e56bb7ba982 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:50.166506 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-980974bf-1489-4281-a331-6e56bb7ba982 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:50.168725 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-980974bf-1489-4281-a331-6e56bb7ba982 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:50.169587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-980974bf-1489-4281-a331-6e56bb7ba982 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:50.170875 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-980974bf-1489-4281-a331-6e56bb7ba982 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:50.272794 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4f0ee76d-d193-4cd4-8d08-c6e080a74af3 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:50.274429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4f0ee76d-d193-4cd4-8d08-c6e080a74af3 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: 9af45fd0-4f3b-480b-a33f-df501592594d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:50.285430 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-980974bf-1489-4281-a331-6e56bb7ba982 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:50.295689 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-980974bf-1489-4281-a331-6e56bb7ba982 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80" status: 200 len: 1209 microversion: 2.1 time: 0.145443 Sep 10 11:55:50.296997 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1839/3663] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:50 2022] GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80 => generated 1209 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:50.311479 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f0ee76d-d193-4cd4-8d08-c6e080a74af3 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:50.312815 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f0ee76d-d193-4cd4-8d08-c6e080a74af3 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:50.314668 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f0ee76d-d193-4cd4-8d08-c6e080a74af3 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:50.315567 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f0ee76d-d193-4cd4-8d08-c6e080a74af3 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:50.316607 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f0ee76d-d193-4cd4-8d08-c6e080a74af3 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:50.318438 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f0ee76d-d193-4cd4-8d08-c6e080a74af3 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:50.532713 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1c8ac122-61a5-4482-bf81-71d03f47de6c tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:50.539291 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1c8ac122-61a5-4482-bf81-71d03f47de6c tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:50.554176 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c8ac122-61a5-4482-bf81-71d03f47de6c tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:50.554701 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c8ac122-61a5-4482-bf81-71d03f47de6c tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:50.555150 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c8ac122-61a5-4482-bf81-71d03f47de6c tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:50.555919 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c8ac122-61a5-4482-bf81-71d03f47de6c tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:50.556362 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c8ac122-61a5-4482-bf81-71d03f47de6c tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:50.560915 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c8ac122-61a5-4482-bf81-71d03f47de6c tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:50.885250 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4f0ee76d-d193-4cd4-8d08-c6e080a74af3 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:50.895593 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4f0ee76d-d193-4cd4-8d08-c6e080a74af3 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d" status: 200 len: 1505 microversion: 2.1 time: 0.627077 Sep 10 11:55:50.915192 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1825/3664] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:50 2022] GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d => generated 1505 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:50.915192 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7131920c-3843-4a87-8531-743a34add91c tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:50.915192 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7131920c-3843-4a87-8531-743a34add91c tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 9da5b114-2ad4-41f0-897f-d4e2984f5a16] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:50.926780 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7131920c-3843-4a87-8531-743a34add91c tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:50.927308 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7131920c-3843-4a87-8531-743a34add91c tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:50.927752 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7131920c-3843-4a87-8531-743a34add91c tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:50.928461 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7131920c-3843-4a87-8531-743a34add91c tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:50.928920 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7131920c-3843-4a87-8531-743a34add91c tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:50.929344 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7131920c-3843-4a87-8531-743a34add91c tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:51.624391 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1c8ac122-61a5-4482-bf81-71d03f47de6c tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:51.643935 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1c8ac122-61a5-4482-bf81-71d03f47de6c tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180" status: 200 len: 1521 microversion: 2.1 time: 1.132996 Sep 10 11:55:51.646728 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1840/3665] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:50 2022] GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180 => generated 1521 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:55:51.677970 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ca2b869d-2ad7-40bd-9f08-bece54a208a2 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:51.679878 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ca2b869d-2ad7-40bd-9f08-bece54a208a2 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] [instance: 70c46bf2-0367-499b-822a-e18923866289] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:51.689723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca2b869d-2ad7-40bd-9f08-bece54a208a2 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:51.690446 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca2b869d-2ad7-40bd-9f08-bece54a208a2 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:51.691595 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca2b869d-2ad7-40bd-9f08-bece54a208a2 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:51.693303 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca2b869d-2ad7-40bd-9f08-bece54a208a2 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:51.694114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca2b869d-2ad7-40bd-9f08-bece54a208a2 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:51.694724 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca2b869d-2ad7-40bd-9f08-bece54a208a2 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:51.725613 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-ca2b869d-2ad7-40bd-9f08-bece54a208a2 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] HTTP exception thrown: Instance 70c46bf2-0367-499b-822a-e18923866289 could not be found. Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ca2b869d-2ad7-40bd-9f08-bece54a208a2 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Request method failure captured: Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/70c46bf2-0367-499b-822a-e18923866289 HTTP/1.1 Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHogBq53-9-XubuuhITXNAF47e9O-F9j2HmPN_ZAzaILKfi2Pl_nRVBUKY6RJ7-rmxz_SsMp1i-0LR3WIJrp6wvP30HF1ctVN0zxdUOu1_0G2ypEN75gjPKuhWZo4Ir5rxwwebmKbjCQ_9abPeiN1PkPhkBLPpGBAigOh69JHiUiI_c Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 20756c1a77fb44f684973f382b802825 Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-TestNetworkBasicOps-1480462047 Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20756c1a77fb44f684973f382b802825"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/20756c1a77fb44f684973f382b802825"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_20756c1a77fb44f684973f382b802825", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/20756c1a77fb44f684973f382b802825"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-TestNetworkBasicOps-1480462047 Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 20756c1a77fb44f684973f382b802825 Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-TestNetworkBasicOps-1480462047 Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-TestNetworkBasicOps-1480462047-project Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 92be647276cc456e83dacd25b98e37f2 Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-TestNetworkBasicOps-1480462047-project Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 70c46bf2-0367-499b-822a-e18923866289 could not be found. Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '70c46bf2-0367-499b-822a-e18923866289'} Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70c46bf2-0367-499b-822a-e18923866289 could not be found. Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70c46bf2-0367-499b-822a-e18923866289 could not be found. Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:55:51.729505 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:55:51.733894 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:55:51.733894 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:55:51.733894 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:55:51.733894 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:55:51.733894 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:55:51.733894 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70c46bf2-0367-499b-822a-e18923866289 could not be found. Sep 10 11:55:51.733894 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:55:51.733894 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ca2b869d-2ad7-40bd-9f08-bece54a208a2 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Returning 404 to user: Instance 70c46bf2-0367-499b-822a-e18923866289 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:55:51.733894 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ca2b869d-2ad7-40bd-9f08-bece54a208a2 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "GET /compute/v2.1/servers/70c46bf2-0367-499b-822a-e18923866289" status: 404 len: 111 microversion: 2.1 time: 0.085705 Sep 10 11:55:51.734456 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1841/3666] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:51 2022] GET /compute/v2.1/servers/70c46bf2-0367-499b-822a-e18923866289 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:55:51.745110 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4fc0fb9c-9fbb-4540-9e88-90522b6ab786 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:51.748042 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4fc0fb9c-9fbb-4540-9e88-90522b6ab786 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] [instance: aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:51.759481 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4fc0fb9c-9fbb-4540-9e88-90522b6ab786 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:51.761904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4fc0fb9c-9fbb-4540-9e88-90522b6ab786 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:51.762503 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4fc0fb9c-9fbb-4540-9e88-90522b6ab786 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:51.765010 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4fc0fb9c-9fbb-4540-9e88-90522b6ab786 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:51.766318 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4fc0fb9c-9fbb-4540-9e88-90522b6ab786 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:51.767005 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4fc0fb9c-9fbb-4540-9e88-90522b6ab786 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:51.883119 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7131920c-3843-4a87-8531-743a34add91c tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:51.899849 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:55:51.916271 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7131920c-3843-4a87-8531-743a34add91c tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16" status: 200 len: 1314 microversion: 2.1 time: 1.007313 Sep 10 11:55:51.938185 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4fc0fb9c-9fbb-4540-9e88-90522b6ab786 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e27edecefe4d60a2dba4ba99055bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f245084ce3f409889039ba1ee751eed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:51.938792 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1826/3667] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:50 2022] GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16 => generated 1314 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:51.949842 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4bc4a58f-eeb0-4c13-9b63-f8b321416076 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:51.950693 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4bc4a58f-eeb0-4c13-9b63-f8b321416076 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 1175db1c-de8d-4486-bf15-b45db331da80] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:51.959676 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4bc4a58f-eeb0-4c13-9b63-f8b321416076 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:51.960390 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4bc4a58f-eeb0-4c13-9b63-f8b321416076 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:51.960978 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4bc4a58f-eeb0-4c13-9b63-f8b321416076 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:51.961847 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4bc4a58f-eeb0-4c13-9b63-f8b321416076 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:51.962581 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4bc4a58f-eeb0-4c13-9b63-f8b321416076 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:51.963199 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4bc4a58f-eeb0-4c13-9b63-f8b321416076 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:51.965920 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4fc0fb9c-9fbb-4540-9e88-90522b6ab786 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7" status: 200 len: 1276 microversion: 2.1 time: 0.230317 Sep 10 11:55:51.971486 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1842/3668] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:51 2022] GET /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7 => generated 1276 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:51.985199 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-295fc24e-9a64-4208-b1f9-7181c9c41909 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:51.991565 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-295fc24e-9a64-4208-b1f9-7181c9c41909 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: 9af45fd0-4f3b-480b-a33f-df501592594d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:52.013100 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-295fc24e-9a64-4208-b1f9-7181c9c41909 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:52.014711 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-295fc24e-9a64-4208-b1f9-7181c9c41909 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:52.017373 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-295fc24e-9a64-4208-b1f9-7181c9c41909 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:52.020513 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-295fc24e-9a64-4208-b1f9-7181c9c41909 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:52.022273 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-295fc24e-9a64-4208-b1f9-7181c9c41909 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:52.023395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-295fc24e-9a64-4208-b1f9-7181c9c41909 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:52.087072 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4bc4a58f-eeb0-4c13-9b63-f8b321416076 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:52.104147 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4bc4a58f-eeb0-4c13-9b63-f8b321416076 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80" status: 200 len: 1271 microversion: 2.1 time: 0.164070 Sep 10 11:55:52.105766 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1827/3669] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:51 2022] GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80 => generated 1271 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:52.389893 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-295fc24e-9a64-4208-b1f9-7181c9c41909 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:52.398432 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=100 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:55:52.422667 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-295fc24e-9a64-4208-b1f9-7181c9c41909 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d" status: 200 len: 1505 microversion: 2.1 time: 0.449676 Sep 10 11:55:52.423709 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1843/3670] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:51 2022] GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d => generated 1505 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:52.505633 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1347450a-4b36-47a8-a770-644cb2b6b120 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] Calling method '.version_select at 0x7f4073b08940>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:52.548768 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1347450a-4b36-47a8-a770-644cb2b6b120 tempest-TestNetworkBasicOps-1480462047 tempest-TestNetworkBasicOps-1480462047-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-11539708" status: 202 len: 0 microversion: 2.1 time: 0.048625 Sep 10 11:55:52.549608 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1844/3671] 10.222.0.23 () {58 vars in 1251 bytes} [Sat Sep 10 11:55:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-11539708 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 11:55:52.670606 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-942637b5-12f5-40ed-bbb5-c07736266d7b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:52.673040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-942637b5-12f5-40ed-bbb5-c07736266d7b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:52.684229 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-942637b5-12f5-40ed-bbb5-c07736266d7b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:52.684768 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-942637b5-12f5-40ed-bbb5-c07736266d7b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:52.685184 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-942637b5-12f5-40ed-bbb5-c07736266d7b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:52.685906 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-942637b5-12f5-40ed-bbb5-c07736266d7b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:52.706177 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-942637b5-12f5-40ed-bbb5-c07736266d7b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:52.706651 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-942637b5-12f5-40ed-bbb5-c07736266d7b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:52.812326 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-937d349b-480a-4e3c-96d4-f77c1c5b86ab req-bd2cbc48-1b7d-431f-9820-5548b55ba49b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af31e6eb-f34c-4ae9-aede-bc4ca6949556", "tag": "3fe151c0-067d-4e53-a33f-9bab864a1662"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:52.832697 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-937d349b-480a-4e3c-96d4-f77c1c5b86ab req-bd2cbc48-1b7d-431f-9820-5548b55ba49b service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:52.833296 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-937d349b-480a-4e3c-96d4-f77c1c5b86ab req-bd2cbc48-1b7d-431f-9820-5548b55ba49b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:52.833744 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-937d349b-480a-4e3c-96d4-f77c1c5b86ab req-bd2cbc48-1b7d-431f-9820-5548b55ba49b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:52.847331 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-937d349b-480a-4e3c-96d4-f77c1c5b86ab req-bd2cbc48-1b7d-431f-9820-5548b55ba49b service nova] Creating event network-changed:3fe151c0-067d-4e53-a33f-9bab864a1662 for instance af31e6eb-f34c-4ae9-aede-bc4ca6949556 on n-h1-856895-1 Sep 10 11:55:52.853992 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-937d349b-480a-4e3c-96d4-f77c1c5b86ab req-bd2cbc48-1b7d-431f-9820-5548b55ba49b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.413368 Sep 10 11:55:52.855145 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1828/3672] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:55:52.960093 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-12f78da7-96a5-460f-a7e1-3c72032d1996 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:52.960954 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-12f78da7-96a5-460f-a7e1-3c72032d1996 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 9da5b114-2ad4-41f0-897f-d4e2984f5a16] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:52.974556 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-12f78da7-96a5-460f-a7e1-3c72032d1996 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:52.977675 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-12f78da7-96a5-460f-a7e1-3c72032d1996 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:52.979259 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-12f78da7-96a5-460f-a7e1-3c72032d1996 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:52.980759 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-12f78da7-96a5-460f-a7e1-3c72032d1996 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:52.988866 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-12f78da7-96a5-460f-a7e1-3c72032d1996 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:52.989634 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-12f78da7-96a5-460f-a7e1-3c72032d1996 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:53.362963 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-942637b5-12f5-40ed-bbb5-c07736266d7b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:53.371395 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-942637b5-12f5-40ed-bbb5-c07736266d7b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180" status: 200 len: 1521 microversion: 2.1 time: 0.704777 Sep 10 11:55:53.376564 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1845/3673] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:52 2022] GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180 => generated 1521 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:55:53.383365 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5165386d-add9-4d52-8eb1-3bfa091433d1 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:53.384376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5165386d-add9-4d52-8eb1-3bfa091433d1 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] [instance: aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:53.397814 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5165386d-add9-4d52-8eb1-3bfa091433d1 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:53.398740 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5165386d-add9-4d52-8eb1-3bfa091433d1 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:53.399422 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5165386d-add9-4d52-8eb1-3bfa091433d1 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:53.400707 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5165386d-add9-4d52-8eb1-3bfa091433d1 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:53.401622 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5165386d-add9-4d52-8eb1-3bfa091433d1 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:53.402956 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5165386d-add9-4d52-8eb1-3bfa091433d1 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:53.549372 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-12f78da7-96a5-460f-a7e1-3c72032d1996 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:53.561177 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-12f78da7-96a5-460f-a7e1-3c72032d1996 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16" status: 200 len: 1314 microversion: 2.1 time: 0.612950 Sep 10 11:55:53.575565 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1829/3674] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:52 2022] GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16 => generated 1314 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:53.582296 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-22c3f1b1-c5ad-42bf-a7ea-9536253b5e4e tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:53.586938 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-22c3f1b1-c5ad-42bf-a7ea-9536253b5e4e tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 1175db1c-de8d-4486-bf15-b45db331da80] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:53.597937 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-22c3f1b1-c5ad-42bf-a7ea-9536253b5e4e tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:53.603617 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-22c3f1b1-c5ad-42bf-a7ea-9536253b5e4e tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:53.604805 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-22c3f1b1-c5ad-42bf-a7ea-9536253b5e4e tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:53.606369 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-22c3f1b1-c5ad-42bf-a7ea-9536253b5e4e tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:53.606873 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-22c3f1b1-c5ad-42bf-a7ea-9536253b5e4e tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:53.619989 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-22c3f1b1-c5ad-42bf-a7ea-9536253b5e4e tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:53.812420 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-22c3f1b1-c5ad-42bf-a7ea-9536253b5e4e tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:53.819646 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5165386d-add9-4d52-8eb1-3bfa091433d1 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e27edecefe4d60a2dba4ba99055bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f245084ce3f409889039ba1ee751eed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:53.822759 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-22c3f1b1-c5ad-42bf-a7ea-9536253b5e4e tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80" status: 200 len: 1271 microversion: 2.1 time: 0.245986 Sep 10 11:55:53.824654 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1830/3675] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:53 2022] GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80 => generated 1271 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:53.829027 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5165386d-add9-4d52-8eb1-3bfa091433d1 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7" status: 200 len: 1318 microversion: 2.1 time: 0.450815 Sep 10 11:55:53.835504 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1846/3676] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:53 2022] GET /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7 => generated 1318 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:53.842363 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-01231734-230d-4233-80c0-cc6df2e83544 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:53.843096 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-01231734-230d-4233-80c0-cc6df2e83544 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: 9af45fd0-4f3b-480b-a33f-df501592594d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:53.855762 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01231734-230d-4233-80c0-cc6df2e83544 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:53.857020 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01231734-230d-4233-80c0-cc6df2e83544 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:53.858579 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01231734-230d-4233-80c0-cc6df2e83544 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:53.860148 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01231734-230d-4233-80c0-cc6df2e83544 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:53.860643 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01231734-230d-4233-80c0-cc6df2e83544 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:53.862297 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01231734-230d-4233-80c0-cc6df2e83544 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:54.019814 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-587f20a5-6027-4380-9244-47a9589c2651 req-eb9f14fd-e62c-44d5-a24b-3c94e4d1bfe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9da5b114-2ad4-41f0-897f-d4e2984f5a16", "name": "network-vif-plugged", "status": "completed", "tag": "7598d657-80cf-4e28-8238-e097ce3d8fe0"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:54.081269 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-587f20a5-6027-4380-9244-47a9589c2651 req-eb9f14fd-e62c-44d5-a24b-3c94e4d1bfe3 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:54.083023 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-587f20a5-6027-4380-9244-47a9589c2651 req-eb9f14fd-e62c-44d5-a24b-3c94e4d1bfe3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:54.084697 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-587f20a5-6027-4380-9244-47a9589c2651 req-eb9f14fd-e62c-44d5-a24b-3c94e4d1bfe3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:54.122187 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-587f20a5-6027-4380-9244-47a9589c2651 req-eb9f14fd-e62c-44d5-a24b-3c94e4d1bfe3 service nova] Creating event network-vif-plugged:7598d657-80cf-4e28-8238-e097ce3d8fe0 for instance 9da5b114-2ad4-41f0-897f-d4e2984f5a16 on n-h1-856895-1 Sep 10 11:55:54.145046 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-587f20a5-6027-4380-9244-47a9589c2651 req-eb9f14fd-e62c-44d5-a24b-3c94e4d1bfe3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131454 Sep 10 11:55:54.147880 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1847/3677] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:55:54.154783 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-01231734-230d-4233-80c0-cc6df2e83544 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:54.177852 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-01231734-230d-4233-80c0-cc6df2e83544 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d" status: 200 len: 1505 microversion: 2.1 time: 0.351118 Sep 10 11:55:54.191571 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1831/3678] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:53 2022] GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d => generated 1505 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:54.401139 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e9741888-d78e-491c-8947-ca8556dffe6d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:54.401939 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e9741888-d78e-491c-8947-ca8556dffe6d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:54.420589 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e9741888-d78e-491c-8947-ca8556dffe6d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:54.421342 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e9741888-d78e-491c-8947-ca8556dffe6d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:54.422053 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e9741888-d78e-491c-8947-ca8556dffe6d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:54.423099 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e9741888-d78e-491c-8947-ca8556dffe6d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:54.423963 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e9741888-d78e-491c-8947-ca8556dffe6d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:54.425168 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e9741888-d78e-491c-8947-ca8556dffe6d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:54.591742 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2e2acd8c-2f72-4edc-80ce-8cd8fae7177b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:54.592799 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2e2acd8c-2f72-4edc-80ce-8cd8fae7177b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 9da5b114-2ad4-41f0-897f-d4e2984f5a16] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:54.607541 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e2acd8c-2f72-4edc-80ce-8cd8fae7177b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:54.609018 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e2acd8c-2f72-4edc-80ce-8cd8fae7177b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:54.609769 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e2acd8c-2f72-4edc-80ce-8cd8fae7177b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:54.610877 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e2acd8c-2f72-4edc-80ce-8cd8fae7177b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:54.630846 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e2acd8c-2f72-4edc-80ce-8cd8fae7177b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:54.632809 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e2acd8c-2f72-4edc-80ce-8cd8fae7177b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:54.649643 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e9741888-d78e-491c-8947-ca8556dffe6d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:54.659970 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e9741888-d78e-491c-8947-ca8556dffe6d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180" status: 200 len: 1521 microversion: 2.1 time: 0.263817 Sep 10 11:55:54.661192 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1848/3679] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:54 2022] GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:54.830600 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7151d701-476b-4592-b3fe-1f4323f42693 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-188551296", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ca04eb86-9cd3-452a-acd7-d2607c9b7fc0"}], "security_groups": [{"name": "tempest-securitygroup--330339781"}], "key_name": "tempest-keypair-2083658485", "user_data": "}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:54.874411 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2e2acd8c-2f72-4edc-80ce-8cd8fae7177b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:54.895031 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2e2acd8c-2f72-4edc-80ce-8cd8fae7177b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16" status: 200 len: 1314 microversion: 2.1 time: 0.310058 Sep 10 11:55:54.912109 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1832/3680] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:54 2022] GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16 => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:54.922539 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d1dd0ec2-c3d1-4768-b768-e6d05fa3e17e tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:54.923396 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d1dd0ec2-c3d1-4768-b768-e6d05fa3e17e tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 1175db1c-de8d-4486-bf15-b45db331da80] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:54.929712 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d1dd0ec2-c3d1-4768-b768-e6d05fa3e17e tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:54.930205 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d1dd0ec2-c3d1-4768-b768-e6d05fa3e17e tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:54.930637 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d1dd0ec2-c3d1-4768-b768-e6d05fa3e17e tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:54.931577 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d1dd0ec2-c3d1-4768-b768-e6d05fa3e17e tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:54.932072 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d1dd0ec2-c3d1-4768-b768-e6d05fa3e17e tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:54.932847 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d1dd0ec2-c3d1-4768-b768-e6d05fa3e17e tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:54.991961 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-7151d701-476b-4592-b3fe-1f4323f42693 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] validate_networks() for [('ca04eb86-9cd3-452a-acd7-d2607c9b7fc0', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:55:55.181468 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d1dd0ec2-c3d1-4768-b768-e6d05fa3e17e tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:55.190980 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d1dd0ec2-c3d1-4768-b768-e6d05fa3e17e tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80" status: 200 len: 1313 microversion: 2.1 time: 0.277194 Sep 10 11:55:55.191802 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1833/3681] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:54 2022] GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80 => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:55.198364 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-712a6ee4-1f9f-49da-988b-bae9f27df05a tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:55.200048 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-712a6ee4-1f9f-49da-988b-bae9f27df05a tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] [instance: aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:55.207435 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-712a6ee4-1f9f-49da-988b-bae9f27df05a tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:55.208265 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-712a6ee4-1f9f-49da-988b-bae9f27df05a tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:55.208942 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-712a6ee4-1f9f-49da-988b-bae9f27df05a tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:55.209744 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-712a6ee4-1f9f-49da-988b-bae9f27df05a tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:55.210440 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-712a6ee4-1f9f-49da-988b-bae9f27df05a tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:55.211095 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-712a6ee4-1f9f-49da-988b-bae9f27df05a tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:55.440370 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-712a6ee4-1f9f-49da-988b-bae9f27df05a tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e27edecefe4d60a2dba4ba99055bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f245084ce3f409889039ba1ee751eed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:55.449582 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-712a6ee4-1f9f-49da-988b-bae9f27df05a tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7" status: 200 len: 1318 microversion: 2.1 time: 0.255826 Sep 10 11:55:55.463461 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1834/3682] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:55 2022] GET /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7 => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:55.469417 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-12fd3c22-de78-4fb6-9d20-484e3d0aed33 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:55.470175 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-12fd3c22-de78-4fb6-9d20-484e3d0aed33 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: 9af45fd0-4f3b-480b-a33f-df501592594d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:55.477119 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-12fd3c22-de78-4fb6-9d20-484e3d0aed33 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:55.477702 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-12fd3c22-de78-4fb6-9d20-484e3d0aed33 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:55.478225 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-12fd3c22-de78-4fb6-9d20-484e3d0aed33 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:55.479015 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-12fd3c22-de78-4fb6-9d20-484e3d0aed33 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:55.479578 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-12fd3c22-de78-4fb6-9d20-484e3d0aed33 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:55.480208 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-12fd3c22-de78-4fb6-9d20-484e3d0aed33 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:55.623715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-7151d701-476b-4592-b3fe-1f4323f42693 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:55:55.623873 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-7151d701-476b-4592-b3fe-1f4323f42693 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:55:55.624806 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-7151d701-476b-4592-b3fe-1f4323f42693 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:55:55.625297 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-7151d701-476b-4592-b3fe-1f4323f42693 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:55:55.627414 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-7151d701-476b-4592-b3fe-1f4323f42693 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:55:55.640424 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7151d701-476b-4592-b3fe-1f4323f42693 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:55.640736 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7151d701-476b-4592-b3fe-1f4323f42693 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:55.641270 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7151d701-476b-4592-b3fe-1f4323f42693 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:55.643080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7151d701-476b-4592-b3fe-1f4323f42693 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:55.643666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7151d701-476b-4592-b3fe-1f4323f42693 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:55.644265 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7151d701-476b-4592-b3fe-1f4323f42693 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:55.655124 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-12fd3c22-de78-4fb6-9d20-484e3d0aed33 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:55.664251 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-12fd3c22-de78-4fb6-9d20-484e3d0aed33 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d" status: 200 len: 1505 microversion: 2.1 time: 0.198650 Sep 10 11:55:55.664847 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1835/3683] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:55 2022] GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d => generated 1505 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:55.690384 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-7151d701-476b-4592-b3fe-1f4323f42693 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Getting quotas for project 66677b88ab6b436da8477f213df0ed1d. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:55:55.691831 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-85b3ebde-1a63-4ab3-9625-fc31dc5f04a1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:55.695115 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-85b3ebde-1a63-4ab3-9625-fc31dc5f04a1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:55.696657 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-7151d701-476b-4592-b3fe-1f4323f42693 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Getting quotas for user 20a5848b40dc4fbaa2a25a41d92d383a and project 66677b88ab6b436da8477f213df0ed1d. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:55:55.710123 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85b3ebde-1a63-4ab3-9625-fc31dc5f04a1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:55.710625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85b3ebde-1a63-4ab3-9625-fc31dc5f04a1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:55.711068 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85b3ebde-1a63-4ab3-9625-fc31dc5f04a1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:55.711687 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7151d701-476b-4592-b3fe-1f4323f42693 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:55:55.712010 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85b3ebde-1a63-4ab3-9625-fc31dc5f04a1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:55.712462 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85b3ebde-1a63-4ab3-9625-fc31dc5f04a1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:55.714007 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7151d701-476b-4592-b3fe-1f4323f42693 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:55:55.715557 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85b3ebde-1a63-4ab3-9625-fc31dc5f04a1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:55.770218 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7151d701-476b-4592-b3fe-1f4323f42693 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.947059 Sep 10 11:55:55.771215 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1849/3684] 10.222.0.23 () {62 vars in 1188 bytes} [Sat Sep 10 11:55:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 949 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 10 11:55:55.782948 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b9e90b14-2e66-4950-b96c-d7f92affb0da tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:55.787116 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b9e90b14-2e66-4950-b96c-d7f92affb0da tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:55.896520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b9e90b14-2e66-4950-b96c-d7f92affb0da tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:55.911015 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b9e90b14-2e66-4950-b96c-d7f92affb0da tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:55.912689 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b9e90b14-2e66-4950-b96c-d7f92affb0da tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:55.914147 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b9e90b14-2e66-4950-b96c-d7f92affb0da tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1281 microversion: 2.20 time: 0.135252 Sep 10 11:55:55.929433 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1850/3685] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:55:55 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1281 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:55:55.941423 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9c102632-bba5-446f-b3e8-ef4468715d11 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:55.941996 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9c102632-bba5-446f-b3e8-ef4468715d11 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 9da5b114-2ad4-41f0-897f-d4e2984f5a16] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:55.951681 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9c102632-bba5-446f-b3e8-ef4468715d11 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:55.952365 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9c102632-bba5-446f-b3e8-ef4468715d11 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:55.953076 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9c102632-bba5-446f-b3e8-ef4468715d11 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:55.954071 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9c102632-bba5-446f-b3e8-ef4468715d11 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:55.954707 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9c102632-bba5-446f-b3e8-ef4468715d11 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:55.955322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9c102632-bba5-446f-b3e8-ef4468715d11 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:55.971889 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-85b3ebde-1a63-4ab3-9625-fc31dc5f04a1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:55.981092 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-85b3ebde-1a63-4ab3-9625-fc31dc5f04a1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180" status: 200 len: 1521 microversion: 2.1 time: 0.295193 Sep 10 11:55:55.982938 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1836/3686] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:55 2022] GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180 => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:55:56.215022 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c39b1446-b044-4032-b985-f79f6b2c855f tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:56.216571 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c39b1446-b044-4032-b985-f79f6b2c855f tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 1175db1c-de8d-4486-bf15-b45db331da80] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:56.222898 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c39b1446-b044-4032-b985-f79f6b2c855f tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:56.223683 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c39b1446-b044-4032-b985-f79f6b2c855f tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:56.224198 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c39b1446-b044-4032-b985-f79f6b2c855f tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:56.224918 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c39b1446-b044-4032-b985-f79f6b2c855f tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:56.225643 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c39b1446-b044-4032-b985-f79f6b2c855f tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:56.226221 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c39b1446-b044-4032-b985-f79f6b2c855f tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:56.243215 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9c102632-bba5-446f-b3e8-ef4468715d11 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:56.255956 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9c102632-bba5-446f-b3e8-ef4468715d11 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16" status: 200 len: 1314 microversion: 2.1 time: 0.325591 Sep 10 11:55:56.257252 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1851/3687] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:55 2022] GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:56.476094 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c39b1446-b044-4032-b985-f79f6b2c855f tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:56.476322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-794a35da-480d-4eaf-8292-16a1b1d17453 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:56.477122 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-794a35da-480d-4eaf-8292-16a1b1d17453 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] [instance: aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:56.489313 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c39b1446-b044-4032-b985-f79f6b2c855f tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80" status: 200 len: 1313 microversion: 2.1 time: 0.275927 Sep 10 11:55:56.492193 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1837/3688] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:56 2022] GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80 => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:56.523397 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-794a35da-480d-4eaf-8292-16a1b1d17453 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:56.524095 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-794a35da-480d-4eaf-8292-16a1b1d17453 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:56.526208 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-794a35da-480d-4eaf-8292-16a1b1d17453 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:56.528236 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-794a35da-480d-4eaf-8292-16a1b1d17453 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:56.530483 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-794a35da-480d-4eaf-8292-16a1b1d17453 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:56.531121 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-794a35da-480d-4eaf-8292-16a1b1d17453 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:56.690801 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-53f70f65-28d9-426b-8aee-5f5bbb4ac815 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:56.692165 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-53f70f65-28d9-426b-8aee-5f5bbb4ac815 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: 9af45fd0-4f3b-480b-a33f-df501592594d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:56.702292 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53f70f65-28d9-426b-8aee-5f5bbb4ac815 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:56.703011 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53f70f65-28d9-426b-8aee-5f5bbb4ac815 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:56.703840 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53f70f65-28d9-426b-8aee-5f5bbb4ac815 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:56.704735 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53f70f65-28d9-426b-8aee-5f5bbb4ac815 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:56.705451 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53f70f65-28d9-426b-8aee-5f5bbb4ac815 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:56.706539 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53f70f65-28d9-426b-8aee-5f5bbb4ac815 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:56.925349 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-794a35da-480d-4eaf-8292-16a1b1d17453 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e27edecefe4d60a2dba4ba99055bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f245084ce3f409889039ba1ee751eed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:56.936033 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-794a35da-480d-4eaf-8292-16a1b1d17453 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7" status: 200 len: 1318 microversion: 2.1 time: 0.465765 Sep 10 11:55:56.937653 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1852/3689] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:56 2022] GET /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7 => generated 1318 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:56.942731 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-f6ec67cf-5ace-4dea-a8af-82079577bdf2 req-6532ff5f-40f7-4bf4-be59-1cb518c96eed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7", "tag": "83f19d9c-64d5-42d5-86ba-3993c5101e77"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:56.959522 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-f6ec67cf-5ace-4dea-a8af-82079577bdf2 req-6532ff5f-40f7-4bf4-be59-1cb518c96eed service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:56.960293 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-f6ec67cf-5ace-4dea-a8af-82079577bdf2 req-6532ff5f-40f7-4bf4-be59-1cb518c96eed service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:56.960730 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-f6ec67cf-5ace-4dea-a8af-82079577bdf2 req-6532ff5f-40f7-4bf4-be59-1cb518c96eed service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:56.978232 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-f6ec67cf-5ace-4dea-a8af-82079577bdf2 req-6532ff5f-40f7-4bf4-be59-1cb518c96eed service nova] Creating event network-changed:83f19d9c-64d5-42d5-86ba-3993c5101e77 for instance aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7 on n-h1-856895-1 Sep 10 11:55:56.986104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-53f70f65-28d9-426b-8aee-5f5bbb4ac815 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:56.987996 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-f6ec67cf-5ace-4dea-a8af-82079577bdf2 req-6532ff5f-40f7-4bf4-be59-1cb518c96eed service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048783 Sep 10 11:55:56.988965 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1853/3690] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:55:56.994589 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8a9cfe2d-b589-444b-9d31-8fe190070750 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:56.995575 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8a9cfe2d-b589-444b-9d31-8fe190070750 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:57.002698 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-53f70f65-28d9-426b-8aee-5f5bbb4ac815 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d" status: 200 len: 1505 microversion: 2.1 time: 0.317745 Sep 10 11:55:57.007497 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1838/3691] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:56 2022] GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d => generated 1505 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:55:57.009419 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-aaae84ac-449c-440d-935b-2282b2099a3a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:57.010248 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-aaae84ac-449c-440d-935b-2282b2099a3a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:57.014511 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a9cfe2d-b589-444b-9d31-8fe190070750 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:57.015418 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a9cfe2d-b589-444b-9d31-8fe190070750 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:57.016254 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a9cfe2d-b589-444b-9d31-8fe190070750 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:57.017365 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a9cfe2d-b589-444b-9d31-8fe190070750 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:57.018711 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a9cfe2d-b589-444b-9d31-8fe190070750 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:57.020565 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a9cfe2d-b589-444b-9d31-8fe190070750 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:57.026732 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aaae84ac-449c-440d-935b-2282b2099a3a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:57.031133 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aaae84ac-449c-440d-935b-2282b2099a3a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:57.032969 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aaae84ac-449c-440d-935b-2282b2099a3a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:57.045579 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aaae84ac-449c-440d-935b-2282b2099a3a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:57.047093 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aaae84ac-449c-440d-935b-2282b2099a3a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:57.047739 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aaae84ac-449c-440d-935b-2282b2099a3a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:57.113633 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8a9cfe2d-b589-444b-9d31-8fe190070750 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:57.124170 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8a9cfe2d-b589-444b-9d31-8fe190070750 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:57.125825 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8a9cfe2d-b589-444b-9d31-8fe190070750 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:57.128444 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8a9cfe2d-b589-444b-9d31-8fe190070750 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1277 microversion: 2.20 time: 0.138023 Sep 10 11:55:57.142646 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1854/3692] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:55:56 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1277 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:55:57.279429 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b496942c-bcb7-49f0-80c4-3a32e61b8b8a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:57.280053 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b496942c-bcb7-49f0-80c4-3a32e61b8b8a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 9da5b114-2ad4-41f0-897f-d4e2984f5a16] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:57.287661 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b496942c-bcb7-49f0-80c4-3a32e61b8b8a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:57.289149 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b496942c-bcb7-49f0-80c4-3a32e61b8b8a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:57.289861 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b496942c-bcb7-49f0-80c4-3a32e61b8b8a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:57.290915 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b496942c-bcb7-49f0-80c4-3a32e61b8b8a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:57.291621 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b496942c-bcb7-49f0-80c4-3a32e61b8b8a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:57.292227 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b496942c-bcb7-49f0-80c4-3a32e61b8b8a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:57.332989 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-aaae84ac-449c-440d-935b-2282b2099a3a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:57.343451 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-aaae84ac-449c-440d-935b-2282b2099a3a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180" status: 200 len: 1501 microversion: 2.1 time: 0.338516 Sep 10 11:55:57.356272 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1839/3693] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:57 2022] GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180 => generated 1501 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:57.367070 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f0a5a430-2ae0-4918-adaa-999a0c7419ae tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:57.367727 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f0a5a430-2ae0-4918-adaa-999a0c7419ae tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 51d91016-0b23-4d74-98b4-1c76652aacb5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:57.375083 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f0a5a430-2ae0-4918-adaa-999a0c7419ae tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:57.375616 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f0a5a430-2ae0-4918-adaa-999a0c7419ae tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:57.376265 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f0a5a430-2ae0-4918-adaa-999a0c7419ae tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:57.377145 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f0a5a430-2ae0-4918-adaa-999a0c7419ae tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:57.377783 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f0a5a430-2ae0-4918-adaa-999a0c7419ae tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:57.378308 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f0a5a430-2ae0-4918-adaa-999a0c7419ae tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:57.489027 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b496942c-bcb7-49f0-80c4-3a32e61b8b8a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:57.496921 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b496942c-bcb7-49f0-80c4-3a32e61b8b8a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16" status: 200 len: 1314 microversion: 2.1 time: 0.222260 Sep 10 11:55:57.497840 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1855/3694] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:57 2022] GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:55:57.516913 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0a27fd8b-64a7-406c-b886-051156c2036e tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:57.517831 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0a27fd8b-64a7-406c-b886-051156c2036e tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 1175db1c-de8d-4486-bf15-b45db331da80] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:57.524434 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a27fd8b-64a7-406c-b886-051156c2036e tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:57.525049 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a27fd8b-64a7-406c-b886-051156c2036e tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:57.525590 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a27fd8b-64a7-406c-b886-051156c2036e tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:57.527750 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a27fd8b-64a7-406c-b886-051156c2036e tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:57.527750 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a27fd8b-64a7-406c-b886-051156c2036e tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:57.528316 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a27fd8b-64a7-406c-b886-051156c2036e tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:57.576266 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f0a5a430-2ae0-4918-adaa-999a0c7419ae tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:57.591458 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f0a5a430-2ae0-4918-adaa-999a0c7419ae tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5" status: 200 len: 1516 microversion: 2.1 time: 0.228281 Sep 10 11:55:57.593430 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1840/3695] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:57 2022] GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5 => generated 1516 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:55:57.619785 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2bb69c23-3b79-4e2d-a0da-9ceb90498e5d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:57.624306 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2bb69c23-3b79-4e2d-a0da-9ceb90498e5d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 6f367698-ad86-4306-aaaa-afe987d2892a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:57.632401 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-2bb69c23-3b79-4e2d-a0da-9ceb90498e5d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] HTTP exception thrown: Instance 6f367698-ad86-4306-aaaa-afe987d2892a could not be found. Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2bb69c23-3b79-4e2d-a0da-9ceb90498e5d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Request method failure captured: Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/servers/6f367698-ad86-4306-aaaa-afe987d2892a/action HTTP/1.1 Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 14 Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHsDb9McMbZ9alVjJ4oJKA7xoa0-QA-ERuLKN-wY-xgkYgjg-f1Qkk9v6xNr7bPpAGzBceBuhySDill-chXUItw0i1842Y9FDTX_ZkXuD1aeT9HQ_-qUH7OXi222TXPS2e9y3GtImQxVIp9JaCN7mrwULBVN7FoNXkYNRF6EUEoKMAw Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 8e8bc2c6ea1946bfbbf47d63b5fa4648 Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1615383257 Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e8bc2c6ea1946bfbbf47d63b5fa4648"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e8bc2c6ea1946bfbbf47d63b5fa4648"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8e8bc2c6ea1946bfbbf47d63b5fa4648", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8e8bc2c6ea1946bfbbf47d63b5fa4648"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1615383257 Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 8e8bc2c6ea1946bfbbf47d63b5fa4648 Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1615383257 Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServerRescueNegativeTestJSON-1615383257-project Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: bddddbd6718f472e951fd87a6ec00f8d Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1615383257-project Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: {"rescue": {}} Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 6f367698-ad86-4306-aaaa-afe987d2892a could not be found. Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '6f367698-ad86-4306-aaaa-afe987d2892a', 'body': {'rescue': {}}} Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f367698-ad86-4306-aaaa-afe987d2892a could not be found. Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f367698-ad86-4306-aaaa-afe987d2892a could not be found. Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:55:57.657187 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:55:57.665806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:55:57.665806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:55:57.665806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:55:57.665806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:55:57.665806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f367698-ad86-4306-aaaa-afe987d2892a could not be found. Sep 10 11:55:57.665806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:55:57.665806 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2bb69c23-3b79-4e2d-a0da-9ceb90498e5d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Returning 404 to user: Instance 6f367698-ad86-4306-aaaa-afe987d2892a could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:55:57.665806 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2bb69c23-3b79-4e2d-a0da-9ceb90498e5d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "POST /compute/v2.1/servers/6f367698-ad86-4306-aaaa-afe987d2892a/action" status: 404 len: 111 microversion: 2.1 time: 0.044817 Sep 10 11:55:57.665806 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1841/3696] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:55:57 2022] POST /compute/v2.1/servers/6f367698-ad86-4306-aaaa-afe987d2892a/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 11:55:57.674596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f95bfe74-ec41-4530-8696-53796b2023d5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:57.675367 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f95bfe74-ec41-4530-8696-53796b2023d5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 51d91016-0b23-4d74-98b4-1c76652aacb5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:57.685317 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f95bfe74-ec41-4530-8696-53796b2023d5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:57.685976 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f95bfe74-ec41-4530-8696-53796b2023d5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:57.686182 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f95bfe74-ec41-4530-8696-53796b2023d5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:57.686932 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f95bfe74-ec41-4530-8696-53796b2023d5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:57.687403 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f95bfe74-ec41-4530-8696-53796b2023d5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:57.691580 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f95bfe74-ec41-4530-8696-53796b2023d5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:57.714028 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0a27fd8b-64a7-406c-b886-051156c2036e tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:57.731075 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0a27fd8b-64a7-406c-b886-051156c2036e tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80" status: 200 len: 1334 microversion: 2.1 time: 0.217625 Sep 10 11:55:57.752326 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1856/3697] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:57 2022] GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80 => generated 1334 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:57.817698 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f95bfe74-ec41-4530-8696-53796b2023d5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "POST /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5/action" status: 202 len: 0 microversion: 2.1 time: 0.151414 Sep 10 11:55:57.821409 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1842/3698] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:55:57 2022] POST /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 11:55:57.826891 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fe154da3-3011-4ac3-8225-d836c99f89d5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:57.836872 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fe154da3-3011-4ac3-8225-d836c99f89d5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 51d91016-0b23-4d74-98b4-1c76652aacb5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:57.858002 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fe154da3-3011-4ac3-8225-d836c99f89d5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:57.859067 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fe154da3-3011-4ac3-8225-d836c99f89d5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:57.860057 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fe154da3-3011-4ac3-8225-d836c99f89d5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:57.866311 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fe154da3-3011-4ac3-8225-d836c99f89d5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:57.866874 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fe154da3-3011-4ac3-8225-d836c99f89d5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:57.867371 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fe154da3-3011-4ac3-8225-d836c99f89d5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:57.940223 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-33722062-3b94-4cb6-8171-f8a9afa1ff15 req-8475046a-bdb2-44c5-9e4c-51e1eecf4004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af31e6eb-f34c-4ae9-aede-bc4ca6949556", "name": "network-vif-plugged", "status": "completed", "tag": "3fe151c0-067d-4e53-a33f-9bab864a1662"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:55:57.951934 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-33722062-3b94-4cb6-8171-f8a9afa1ff15 req-8475046a-bdb2-44c5-9e4c-51e1eecf4004 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:57.952517 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-33722062-3b94-4cb6-8171-f8a9afa1ff15 req-8475046a-bdb2-44c5-9e4c-51e1eecf4004 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:57.953002 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-33722062-3b94-4cb6-8171-f8a9afa1ff15 req-8475046a-bdb2-44c5-9e4c-51e1eecf4004 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:57.983282 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-33722062-3b94-4cb6-8171-f8a9afa1ff15 req-8475046a-bdb2-44c5-9e4c-51e1eecf4004 service nova] Creating event network-vif-plugged:3fe151c0-067d-4e53-a33f-9bab864a1662 for instance af31e6eb-f34c-4ae9-aede-bc4ca6949556 on n-h1-856895-1 Sep 10 11:55:57.993741 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-33722062-3b94-4cb6-8171-f8a9afa1ff15 req-8475046a-bdb2-44c5-9e4c-51e1eecf4004 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057499 Sep 10 11:55:57.994517 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1843/3699] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:55:58.009850 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-995403dc-4eeb-4b6d-967a-be1f52796694 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:58.010931 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-995403dc-4eeb-4b6d-967a-be1f52796694 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] [instance: aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:58.029263 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-995403dc-4eeb-4b6d-967a-be1f52796694 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:58.029778 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-995403dc-4eeb-4b6d-967a-be1f52796694 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:58.030228 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-995403dc-4eeb-4b6d-967a-be1f52796694 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:58.030953 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-995403dc-4eeb-4b6d-967a-be1f52796694 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:58.031456 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-995403dc-4eeb-4b6d-967a-be1f52796694 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:58.031900 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-995403dc-4eeb-4b6d-967a-be1f52796694 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:58.100597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fe154da3-3011-4ac3-8225-d836c99f89d5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:58.114356 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fe154da3-3011-4ac3-8225-d836c99f89d5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5" status: 200 len: 1521 microversion: 2.1 time: 0.291318 Sep 10 11:55:58.115578 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1857/3700] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:57 2022] GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5 => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:58.129527 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7d2b05d8-5e39-449b-8e75-f7a7fa77b91a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:58.132480 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7d2b05d8-5e39-449b-8e75-f7a7fa77b91a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: 9af45fd0-4f3b-480b-a33f-df501592594d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:58.154034 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d2b05d8-5e39-449b-8e75-f7a7fa77b91a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:58.155553 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d2b05d8-5e39-449b-8e75-f7a7fa77b91a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:58.158273 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d2b05d8-5e39-449b-8e75-f7a7fa77b91a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:58.159401 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d2b05d8-5e39-449b-8e75-f7a7fa77b91a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:58.161590 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d2b05d8-5e39-449b-8e75-f7a7fa77b91a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:58.162382 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d2b05d8-5e39-449b-8e75-f7a7fa77b91a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:58.322965 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-995403dc-4eeb-4b6d-967a-be1f52796694 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e27edecefe4d60a2dba4ba99055bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f245084ce3f409889039ba1ee751eed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:58.326294 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:55:58.333980 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-995403dc-4eeb-4b6d-967a-be1f52796694 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7" status: 200 len: 1318 microversion: 2.1 time: 0.338376 Sep 10 11:55:58.350180 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1844/3701] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:57 2022] GET /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7 => generated 1318 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:58.358901 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bd073e30-a4e6-4cff-9547-497126e123e2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:58.359995 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bd073e30-a4e6-4cff-9547-497126e123e2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:58.367533 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd073e30-a4e6-4cff-9547-497126e123e2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:58.368442 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd073e30-a4e6-4cff-9547-497126e123e2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:58.369106 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd073e30-a4e6-4cff-9547-497126e123e2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:58.370339 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd073e30-a4e6-4cff-9547-497126e123e2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:58.371887 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd073e30-a4e6-4cff-9547-497126e123e2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:58.373239 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd073e30-a4e6-4cff-9547-497126e123e2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:58.391842 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7d2b05d8-5e39-449b-8e75-f7a7fa77b91a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:58.402351 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7d2b05d8-5e39-449b-8e75-f7a7fa77b91a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d" status: 200 len: 1505 microversion: 2.1 time: 0.285052 Sep 10 11:55:58.407765 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1858/3702] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:58 2022] GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d => generated 1505 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:58.467619 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bd073e30-a4e6-4cff-9547-497126e123e2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:58.481985 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bd073e30-a4e6-4cff-9547-497126e123e2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:58.483665 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bd073e30-a4e6-4cff-9547-497126e123e2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:58.484888 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bd073e30-a4e6-4cff-9547-497126e123e2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1339 microversion: 2.20 time: 0.133052 Sep 10 11:55:58.485520 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1845/3703] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:55:58 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1339 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:55:58.524653 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-49e8a056-350b-42e2-84c4-5482491ccd57 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:58.525522 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-49e8a056-350b-42e2-84c4-5482491ccd57 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 9da5b114-2ad4-41f0-897f-d4e2984f5a16] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:58.532821 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-49e8a056-350b-42e2-84c4-5482491ccd57 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:58.533638 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-49e8a056-350b-42e2-84c4-5482491ccd57 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:58.534353 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-49e8a056-350b-42e2-84c4-5482491ccd57 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:58.535417 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-49e8a056-350b-42e2-84c4-5482491ccd57 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:58.536137 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-49e8a056-350b-42e2-84c4-5482491ccd57 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:58.536812 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-49e8a056-350b-42e2-84c4-5482491ccd57 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:58.762730 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8aa118a7-b861-4062-a3cf-19e35dc2c2ee tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:58.763833 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8aa118a7-b861-4062-a3cf-19e35dc2c2ee tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 1175db1c-de8d-4486-bf15-b45db331da80] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:58.770711 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8aa118a7-b861-4062-a3cf-19e35dc2c2ee tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:58.771239 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8aa118a7-b861-4062-a3cf-19e35dc2c2ee tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:58.771691 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8aa118a7-b861-4062-a3cf-19e35dc2c2ee tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:58.772922 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8aa118a7-b861-4062-a3cf-19e35dc2c2ee tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:58.772922 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8aa118a7-b861-4062-a3cf-19e35dc2c2ee tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:58.773303 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8aa118a7-b861-4062-a3cf-19e35dc2c2ee tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:58.821272 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=4 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:55:59.189290 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-49e8a056-350b-42e2-84c4-5482491ccd57 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:59.203077 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-49e8a056-350b-42e2-84c4-5482491ccd57 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16" status: 200 len: 1501 microversion: 2.1 time: 0.683720 Sep 10 11:55:59.206209 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1859/3704] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:58 2022] GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16 => generated 1501 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:59.210867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c0caec89-b589-4fe1-b021-67df7c352bb4 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:59.222403 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c0caec89-b589-4fe1-b021-67df7c352bb4 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 51d91016-0b23-4d74-98b4-1c76652aacb5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:59.231348 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c0caec89-b589-4fe1-b021-67df7c352bb4 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:59.231847 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c0caec89-b589-4fe1-b021-67df7c352bb4 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:59.232350 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c0caec89-b589-4fe1-b021-67df7c352bb4 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:59.232971 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c0caec89-b589-4fe1-b021-67df7c352bb4 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:59.233479 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c0caec89-b589-4fe1-b021-67df7c352bb4 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:59.233845 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c0caec89-b589-4fe1-b021-67df7c352bb4 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:59.459707 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8aa118a7-b861-4062-a3cf-19e35dc2c2ee tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:59.477854 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8aa118a7-b861-4062-a3cf-19e35dc2c2ee tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80" status: 200 len: 1334 microversion: 2.1 time: 0.719564 Sep 10 11:55:59.491800 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1846/3705] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:58 2022] GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80 => generated 1334 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:55:59.508120 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2fb96317-069e-4fe2-a964-c2b2b9a5fe53 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:59.509882 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2fb96317-069e-4fe2-a964-c2b2b9a5fe53 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] [instance: aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:59.524736 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2fb96317-069e-4fe2-a964-c2b2b9a5fe53 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:59.525419 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2fb96317-069e-4fe2-a964-c2b2b9a5fe53 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:59.527719 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2fb96317-069e-4fe2-a964-c2b2b9a5fe53 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:59.530664 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2fb96317-069e-4fe2-a964-c2b2b9a5fe53 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:59.532708 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2fb96317-069e-4fe2-a964-c2b2b9a5fe53 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:59.533318 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2fb96317-069e-4fe2-a964-c2b2b9a5fe53 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:59.635027 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c0caec89-b589-4fe1-b021-67df7c352bb4 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:59.649511 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c0caec89-b589-4fe1-b021-67df7c352bb4 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5" status: 200 len: 1501 microversion: 2.1 time: 0.442159 Sep 10 11:55:59.650079 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1860/3706] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:59 2022] GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5 => generated 1501 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:59.655518 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8e5b83ac-141c-4153-bb0d-8b48b0f8da10 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:59.656382 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8e5b83ac-141c-4153-bb0d-8b48b0f8da10 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: 9af45fd0-4f3b-480b-a33f-df501592594d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:59.663210 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e5b83ac-141c-4153-bb0d-8b48b0f8da10 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:59.663873 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e5b83ac-141c-4153-bb0d-8b48b0f8da10 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:59.665314 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e5b83ac-141c-4153-bb0d-8b48b0f8da10 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:59.666193 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e5b83ac-141c-4153-bb0d-8b48b0f8da10 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:59.667490 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e5b83ac-141c-4153-bb0d-8b48b0f8da10 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:59.674942 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e5b83ac-141c-4153-bb0d-8b48b0f8da10 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:59.891966 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2fb96317-069e-4fe2-a964-c2b2b9a5fe53 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e27edecefe4d60a2dba4ba99055bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f245084ce3f409889039ba1ee751eed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:55:59.903406 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2fb96317-069e-4fe2-a964-c2b2b9a5fe53 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7" status: 200 len: 1318 microversion: 2.1 time: 0.410310 Sep 10 11:55:59.914975 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1847/3707] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:59 2022] GET /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7 => generated 1318 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:55:59.926760 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cc1fac30-06ba-41dd-953f-c530adc9a0ff tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:55:59.928776 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cc1fac30-06ba-41dd-953f-c530adc9a0ff tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:55:59.936023 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cc1fac30-06ba-41dd-953f-c530adc9a0ff tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:59.936714 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cc1fac30-06ba-41dd-953f-c530adc9a0ff tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:59.937363 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cc1fac30-06ba-41dd-953f-c530adc9a0ff tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:55:59.938219 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cc1fac30-06ba-41dd-953f-c530adc9a0ff tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:55:59.938825 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cc1fac30-06ba-41dd-953f-c530adc9a0ff tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:55:59.939460 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cc1fac30-06ba-41dd-953f-c530adc9a0ff tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:00.111944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=22 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:56:00.134042 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-cc1fac30-06ba-41dd-953f-c530adc9a0ff tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:00.142003 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8e5b83ac-141c-4153-bb0d-8b48b0f8da10 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:00.151142 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8e5b83ac-141c-4153-bb0d-8b48b0f8da10 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d" status: 200 len: 1505 microversion: 2.1 time: 0.499862 Sep 10 11:56:00.155387 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1861/3708] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:55:59 2022] GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d => generated 1505 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:00.175630 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cb9aa715-e28b-4abf-a098-90ea559f40d3 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:56:00.179124 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cb9aa715-e28b-4abf-a098-90ea559f40d3 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 51d91016-0b23-4d74-98b4-1c76652aacb5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:00.191406 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-cc1fac30-06ba-41dd-953f-c530adc9a0ff tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:00.194002 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-cc1fac30-06ba-41dd-953f-c530adc9a0ff tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:00.195791 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cc1fac30-06ba-41dd-953f-c530adc9a0ff tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1339 microversion: 2.20 time: 0.280216 Sep 10 11:56:00.197589 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1848/3709] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:55:59 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1339 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:56:00.219270 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb9aa715-e28b-4abf-a098-90ea559f40d3 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:00.219784 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb9aa715-e28b-4abf-a098-90ea559f40d3 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:00.224639 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb9aa715-e28b-4abf-a098-90ea559f40d3 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:00.225692 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb9aa715-e28b-4abf-a098-90ea559f40d3 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:00.226391 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb9aa715-e28b-4abf-a098-90ea559f40d3 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:00.227045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb9aa715-e28b-4abf-a098-90ea559f40d3 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:00.272219 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-cb9aa715-e28b-4abf-a098-90ea559f40d3 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lazy-loading 'flavor' on Instance uuid 51d91016-0b23-4d74-98b4-1c76652aacb5 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:56:00.302771 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-cb9aa715-e28b-4abf-a098-90ea559f40d3 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] HTTP exception thrown: Cannot 'rescue' instance 51d91016-0b23-4d74-98b4-1c76652aacb5 while it is in vm_state paused Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cb9aa715-e28b-4abf-a098-90ea559f40d3 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Request method failure captured: Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5/action HTTP/1.1 Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 14 Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHsDb9McMbZ9alVjJ4oJKA7xoa0-QA-ERuLKN-wY-xgkYgjg-f1Qkk9v6xNr7bPpAGzBceBuhySDill-chXUItw0i1842Y9FDTX_ZkXuD1aeT9HQ_-qUH7OXi222TXPS2e9y3GtImQxVIp9JaCN7mrwULBVN7FoNXkYNRF6EUEoKMAw Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 8e8bc2c6ea1946bfbbf47d63b5fa4648 Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1615383257 Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e8bc2c6ea1946bfbbf47d63b5fa4648"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e8bc2c6ea1946bfbbf47d63b5fa4648"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8e8bc2c6ea1946bfbbf47d63b5fa4648", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8e8bc2c6ea1946bfbbf47d63b5fa4648"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1615383257 Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 8e8bc2c6ea1946bfbbf47d63b5fa4648 Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1615383257 Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServerRescueNegativeTestJSON-1615383257-project Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: bddddbd6718f472e951fd87a6ec00f8d Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1615383257-project Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: {"rescue": {}} Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: exception: Cannot 'rescue' instance 51d91016-0b23-4d74-98b4-1c76652aacb5 while it is in vm_state paused Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '51d91016-0b23-4d74-98b4-1c76652aacb5', 'body': {'rescue': {}}} Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 51d91016-0b23-4d74-98b4-1c76652aacb5 in vm_state paused. Cannot rescue while the instance is in this state. Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 51d91016-0b23-4d74-98b4-1c76652aacb5 while it is in vm_state paused Sep 10 11:56:00.310379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:56:00.314611 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:56:00.314611 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:56:00.314611 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:56:00.314611 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:56:00.314611 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:56:00.314611 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:56:00.314611 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:56:00.314611 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 51d91016-0b23-4d74-98b4-1c76652aacb5 while it is in vm_state paused Sep 10 11:56:00.314611 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:56:00.316138 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cb9aa715-e28b-4abf-a098-90ea559f40d3 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Returning 409 to user: Cannot 'rescue' instance 51d91016-0b23-4d74-98b4-1c76652aacb5 while it is in vm_state paused {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:56:00.321780 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cb9aa715-e28b-4abf-a098-90ea559f40d3 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "POST /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5/action" status: 409 len: 144 microversion: 2.1 time: 0.164560 Sep 10 11:56:00.326050 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1862/3710] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:56:00 2022] POST /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5/action => generated 144 bytes in 170 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:56:00.333191 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-69128a67-0ca0-4f29-a3f5-3f7479a1ab65 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:56:00.333864 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-69128a67-0ca0-4f29-a3f5-3f7479a1ab65 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 51d91016-0b23-4d74-98b4-1c76652aacb5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:00.343900 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-69128a67-0ca0-4f29-a3f5-3f7479a1ab65 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:00.349570 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-69128a67-0ca0-4f29-a3f5-3f7479a1ab65 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:00.350154 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-69128a67-0ca0-4f29-a3f5-3f7479a1ab65 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:00.351284 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-69128a67-0ca0-4f29-a3f5-3f7479a1ab65 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:00.352179 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-69128a67-0ca0-4f29-a3f5-3f7479a1ab65 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:00.353451 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-69128a67-0ca0-4f29-a3f5-3f7479a1ab65 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:00.463141 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-69128a67-0ca0-4f29-a3f5-3f7479a1ab65 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "POST /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5/action" status: 202 len: 0 microversion: 2.1 time: 0.132975 Sep 10 11:56:00.473540 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f782efdd-fade-40b4-82bc-e5feff466c72 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:00.474460 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f782efdd-fade-40b4-82bc-e5feff466c72 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 51d91016-0b23-4d74-98b4-1c76652aacb5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:00.478453 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1849/3711] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:56:00 2022] POST /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:56:00.486159 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f782efdd-fade-40b4-82bc-e5feff466c72 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:00.486931 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f782efdd-fade-40b4-82bc-e5feff466c72 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:00.489081 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f782efdd-fade-40b4-82bc-e5feff466c72 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:00.491539 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f782efdd-fade-40b4-82bc-e5feff466c72 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:00.492195 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f782efdd-fade-40b4-82bc-e5feff466c72 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:00.493979 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f782efdd-fade-40b4-82bc-e5feff466c72 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:00.520122 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-85959965-7c9b-40d4-b0bb-051e61815bd6 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:00.522049 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-85959965-7c9b-40d4-b0bb-051e61815bd6 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 1175db1c-de8d-4486-bf15-b45db331da80] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:00.538017 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85959965-7c9b-40d4-b0bb-051e61815bd6 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:00.544460 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85959965-7c9b-40d4-b0bb-051e61815bd6 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:00.547501 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85959965-7c9b-40d4-b0bb-051e61815bd6 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:00.550466 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85959965-7c9b-40d4-b0bb-051e61815bd6 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:00.553326 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85959965-7c9b-40d4-b0bb-051e61815bd6 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:00.555621 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85959965-7c9b-40d4-b0bb-051e61815bd6 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:01.061869 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-85959965-7c9b-40d4-b0bb-051e61815bd6 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:01.111417 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-85959965-7c9b-40d4-b0bb-051e61815bd6 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80" status: 200 len: 1334 microversion: 2.1 time: 0.605747 Sep 10 11:56:01.113016 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1850/3712] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:00 2022] GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80 => generated 1334 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:01.128685 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ac258fca-1e8f-44a3-8364-8a241f114b40 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:01.131655 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ac258fca-1e8f-44a3-8364-8a241f114b40 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] [instance: aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:01.139961 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=95,nova_api:INSERT=4 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:56:01.156393 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac258fca-1e8f-44a3-8364-8a241f114b40 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:01.157021 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac258fca-1e8f-44a3-8364-8a241f114b40 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:01.157608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac258fca-1e8f-44a3-8364-8a241f114b40 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:01.158454 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac258fca-1e8f-44a3-8364-8a241f114b40 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:01.158997 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac258fca-1e8f-44a3-8364-8a241f114b40 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:01.159754 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac258fca-1e8f-44a3-8364-8a241f114b40 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:01.470675 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f782efdd-fade-40b4-82bc-e5feff466c72 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:01.505561 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f782efdd-fade-40b4-82bc-e5feff466c72 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5" status: 200 len: 1508 microversion: 2.1 time: 1.035990 Sep 10 11:56:01.506169 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1863/3713] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:00 2022] GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5 => generated 1508 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:01.527670 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-224809fb-5a2f-4cd0-a3b4-1258c7c162b4 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:01.532177 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-224809fb-5a2f-4cd0-a3b4-1258c7c162b4 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: 9af45fd0-4f3b-480b-a33f-df501592594d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:01.553707 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-224809fb-5a2f-4cd0-a3b4-1258c7c162b4 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:01.554667 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-224809fb-5a2f-4cd0-a3b4-1258c7c162b4 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:01.555441 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-224809fb-5a2f-4cd0-a3b4-1258c7c162b4 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:01.556760 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-224809fb-5a2f-4cd0-a3b4-1258c7c162b4 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:01.562488 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-224809fb-5a2f-4cd0-a3b4-1258c7c162b4 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:01.564362 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-224809fb-5a2f-4cd0-a3b4-1258c7c162b4 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:01.592214 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=100 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:56:01.908610 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ac258fca-1e8f-44a3-8364-8a241f114b40 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e27edecefe4d60a2dba4ba99055bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f245084ce3f409889039ba1ee751eed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:01.930689 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ac258fca-1e8f-44a3-8364-8a241f114b40 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7" status: 200 len: 1318 microversion: 2.1 time: 0.807940 Sep 10 11:56:01.930689 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1851/3714] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:01 2022] GET /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7 => generated 1318 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:01.934798 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-08cdb982-d4b1-4b9c-91f6-da3cd84fa557 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:01.935491 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-08cdb982-d4b1-4b9c-91f6-da3cd84fa557 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:01.949576 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-08cdb982-d4b1-4b9c-91f6-da3cd84fa557 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:01.950147 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-08cdb982-d4b1-4b9c-91f6-da3cd84fa557 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:01.950612 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-08cdb982-d4b1-4b9c-91f6-da3cd84fa557 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:01.951404 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-08cdb982-d4b1-4b9c-91f6-da3cd84fa557 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:01.951878 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-08cdb982-d4b1-4b9c-91f6-da3cd84fa557 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:01.952335 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-08cdb982-d4b1-4b9c-91f6-da3cd84fa557 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:02.094233 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-224809fb-5a2f-4cd0-a3b4-1258c7c162b4 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:02.115270 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-224809fb-5a2f-4cd0-a3b4-1258c7c162b4 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d" status: 200 len: 1505 microversion: 2.1 time: 0.591289 Sep 10 11:56:02.132334 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1864/3715] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:01 2022] GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d => generated 1505 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:02.141819 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-d8d4ca2e-7542-4687-a0a2-ea148b6e09da req-55c3c0f0-6ff9-43a5-815a-6a61c88c4584 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1175db1c-de8d-4486-bf15-b45db331da80", "tag": "5da54f77-16c2-476d-a3aa-6ea3e1bebcc6"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:56:02.155989 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d8d4ca2e-7542-4687-a0a2-ea148b6e09da req-55c3c0f0-6ff9-43a5-815a-6a61c88c4584 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:02.156697 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d8d4ca2e-7542-4687-a0a2-ea148b6e09da req-55c3c0f0-6ff9-43a5-815a-6a61c88c4584 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:02.158131 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d8d4ca2e-7542-4687-a0a2-ea148b6e09da req-55c3c0f0-6ff9-43a5-815a-6a61c88c4584 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:02.175922 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-d8d4ca2e-7542-4687-a0a2-ea148b6e09da req-55c3c0f0-6ff9-43a5-815a-6a61c88c4584 service nova] Creating event network-changed:5da54f77-16c2-476d-a3aa-6ea3e1bebcc6 for instance 1175db1c-de8d-4486-bf15-b45db331da80 on n-h2-856895-1 Sep 10 11:56:02.181246 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-d8d4ca2e-7542-4687-a0a2-ea148b6e09da req-55c3c0f0-6ff9-43a5-815a-6a61c88c4584 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045511 Sep 10 11:56:02.182064 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1865/3716] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:56:02.187860 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0cfc0231-60f7-4099-a3a2-dafb9c6c22b0 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b61f31c-bca8-4224-8772-aba357066e39"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:56:02.191150 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0cfc0231-60f7-4099-a3a2-dafb9c6c22b0 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 9da5b114-2ad4-41f0-897f-d4e2984f5a16] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:02.198067 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0cfc0231-60f7-4099-a3a2-dafb9c6c22b0 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:02.200174 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0cfc0231-60f7-4099-a3a2-dafb9c6c22b0 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:02.200878 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0cfc0231-60f7-4099-a3a2-dafb9c6c22b0 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:02.202155 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0cfc0231-60f7-4099-a3a2-dafb9c6c22b0 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:02.204142 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0cfc0231-60f7-4099-a3a2-dafb9c6c22b0 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:02.204627 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0cfc0231-60f7-4099-a3a2-dafb9c6c22b0 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:02.413476 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-08cdb982-d4b1-4b9c-91f6-da3cd84fa557 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:02.423100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-08cdb982-d4b1-4b9c-91f6-da3cd84fa557 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:02.424585 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-08cdb982-d4b1-4b9c-91f6-da3cd84fa557 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:02.425728 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-08cdb982-d4b1-4b9c-91f6-da3cd84fa557 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1406 microversion: 2.20 time: 0.501863 Sep 10 11:56:02.426300 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1852/3717] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:56:01 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1406 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:56:02.432752 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-20786e07-874f-4c87-87d9-f4bc3eafc472 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:02.434101 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-20786e07-874f-4c87-87d9-f4bc3eafc472 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 1175db1c-de8d-4486-bf15-b45db331da80] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:02.440421 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20786e07-874f-4c87-87d9-f4bc3eafc472 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:02.441307 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20786e07-874f-4c87-87d9-f4bc3eafc472 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:02.441758 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20786e07-874f-4c87-87d9-f4bc3eafc472 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:02.442476 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20786e07-874f-4c87-87d9-f4bc3eafc472 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:02.442939 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20786e07-874f-4c87-87d9-f4bc3eafc472 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:02.443484 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20786e07-874f-4c87-87d9-f4bc3eafc472 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:02.805686 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-20786e07-874f-4c87-87d9-f4bc3eafc472 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:02.816615 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-20786e07-874f-4c87-87d9-f4bc3eafc472 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80" status: 200 len: 1334 microversion: 2.1 time: 0.389001 Sep 10 11:56:02.817198 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1853/3718] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:02 2022] GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80 => generated 1334 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:02.823414 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-01189f1b-0c98-4853-900a-fa135d254c8f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:02.824695 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-01189f1b-0c98-4853-900a-fa135d254c8f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 51d91016-0b23-4d74-98b4-1c76652aacb5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:02.834991 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01189f1b-0c98-4853-900a-fa135d254c8f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:02.835819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01189f1b-0c98-4853-900a-fa135d254c8f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:02.836263 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01189f1b-0c98-4853-900a-fa135d254c8f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:02.837035 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01189f1b-0c98-4853-900a-fa135d254c8f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:02.837493 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01189f1b-0c98-4853-900a-fa135d254c8f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:02.838079 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01189f1b-0c98-4853-900a-fa135d254c8f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:03.089947 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-01189f1b-0c98-4853-900a-fa135d254c8f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:03.101885 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-01189f1b-0c98-4853-900a-fa135d254c8f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5" status: 200 len: 1516 microversion: 2.1 time: 0.283310 Sep 10 11:56:03.125641 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1854/3719] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:02 2022] GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5 => generated 1516 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:03.125641 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f2232d58-207b-423a-9f3a-f84fce4817c0 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:03.125641 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f2232d58-207b-423a-9f3a-f84fce4817c0 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] [instance: aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:03.141429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f2232d58-207b-423a-9f3a-f84fce4817c0 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:03.141429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f2232d58-207b-423a-9f3a-f84fce4817c0 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:03.141429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f2232d58-207b-423a-9f3a-f84fce4817c0 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:03.141429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f2232d58-207b-423a-9f3a-f84fce4817c0 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:03.141429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f2232d58-207b-423a-9f3a-f84fce4817c0 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:03.141429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f2232d58-207b-423a-9f3a-f84fce4817c0 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:03.934318 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f2232d58-207b-423a-9f3a-f84fce4817c0 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e27edecefe4d60a2dba4ba99055bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f245084ce3f409889039ba1ee751eed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:03.943125 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f2232d58-207b-423a-9f3a-f84fce4817c0 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7" status: 200 len: 1318 microversion: 2.1 time: 0.827049 Sep 10 11:56:03.961068 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1855/3720] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:03 2022] GET /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7 => generated 1318 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:03.967333 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-de717552-edf3-45a9-9188-3a98bd3d9f63 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:03.968313 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-de717552-edf3-45a9-9188-3a98bd3d9f63 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: 9af45fd0-4f3b-480b-a33f-df501592594d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:03.977482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de717552-edf3-45a9-9188-3a98bd3d9f63 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:03.978071 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de717552-edf3-45a9-9188-3a98bd3d9f63 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:03.978518 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de717552-edf3-45a9-9188-3a98bd3d9f63 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:03.979663 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de717552-edf3-45a9-9188-3a98bd3d9f63 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:03.980216 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de717552-edf3-45a9-9188-3a98bd3d9f63 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:03.980822 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de717552-edf3-45a9-9188-3a98bd3d9f63 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:04.356812 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-de717552-edf3-45a9-9188-3a98bd3d9f63 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:04.374069 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-de717552-edf3-45a9-9188-3a98bd3d9f63 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d" status: 200 len: 1485 microversion: 2.1 time: 0.410936 Sep 10 11:56:04.403235 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1856/3721] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:03 2022] GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d => generated 1485 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:04.408796 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f8d03045-25b0-4c02-87e5-529ba14101fc tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:04.424165 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f8d03045-25b0-4c02-87e5-529ba14101fc tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:04.437762 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f8d03045-25b0-4c02-87e5-529ba14101fc tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:04.438268 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f8d03045-25b0-4c02-87e5-529ba14101fc tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:04.441502 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f8d03045-25b0-4c02-87e5-529ba14101fc tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:04.442502 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f8d03045-25b0-4c02-87e5-529ba14101fc tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:04.445139 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f8d03045-25b0-4c02-87e5-529ba14101fc tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:04.445819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f8d03045-25b0-4c02-87e5-529ba14101fc tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:04.787244 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0cfc0231-60f7-4099-a3a2-dafb9c6c22b0 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "POST /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.603324 Sep 10 11:56:04.789005 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1866/3722] 10.222.0.23 () {60 vars in 1323 bytes} [Sat Sep 10 11:56:02 2022] POST /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16/os-volume_attachments => generated 194 bytes in 2606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:56:04.799719 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-37a33637-dea5-4733-bcc0-f53dac191b69 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:04.800776 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-37a33637-dea5-4733-bcc0-f53dac191b69 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 1175db1c-de8d-4486-bf15-b45db331da80] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:04.818046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-37a33637-dea5-4733-bcc0-f53dac191b69 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:04.819446 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-37a33637-dea5-4733-bcc0-f53dac191b69 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:04.820614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-37a33637-dea5-4733-bcc0-f53dac191b69 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:04.822351 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-37a33637-dea5-4733-bcc0-f53dac191b69 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:04.823015 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-37a33637-dea5-4733-bcc0-f53dac191b69 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:04.823537 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-37a33637-dea5-4733-bcc0-f53dac191b69 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:05.043513 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f8d03045-25b0-4c02-87e5-529ba14101fc tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:05.083613 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f8d03045-25b0-4c02-87e5-529ba14101fc tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:05.085430 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f8d03045-25b0-4c02-87e5-529ba14101fc tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:05.088545 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f8d03045-25b0-4c02-87e5-529ba14101fc tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1406 microversion: 2.20 time: 0.683566 Sep 10 11:56:05.094478 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-37a33637-dea5-4733-bcc0-f53dac191b69 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:05.110745 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-37a33637-dea5-4733-bcc0-f53dac191b69 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80" status: 200 len: 1334 microversion: 2.1 time: 0.320070 Sep 10 11:56:05.135401 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1867/3723] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:04 2022] GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80 => generated 1334 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:05.139815 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1857/3724] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:56:04 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1406 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:56:05.153536 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-df001990-1a84-40d5-bc6a-67171e1fea60 req-33c36c9b-75bc-4d94-8b69-98cc9154222d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1175db1c-de8d-4486-bf15-b45db331da80", "tag": "3974daf4-8378-4f94-80fa-edf23f2cbae5"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:56:05.162864 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4cd976a9-33db-44ab-aff3-5f3436877fcf tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-2124312050", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:56:05.165694 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-df001990-1a84-40d5-bc6a-67171e1fea60 req-33c36c9b-75bc-4d94-8b69-98cc9154222d service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:05.166551 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-df001990-1a84-40d5-bc6a-67171e1fea60 req-33c36c9b-75bc-4d94-8b69-98cc9154222d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:05.167152 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-df001990-1a84-40d5-bc6a-67171e1fea60 req-33c36c9b-75bc-4d94-8b69-98cc9154222d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:05.184959 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-df001990-1a84-40d5-bc6a-67171e1fea60 req-33c36c9b-75bc-4d94-8b69-98cc9154222d service nova] Creating event network-changed:3974daf4-8378-4f94-80fa-edf23f2cbae5 for instance 1175db1c-de8d-4486-bf15-b45db331da80 on n-h2-856895-1 Sep 10 11:56:05.199481 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-df001990-1a84-40d5-bc6a-67171e1fea60 req-33c36c9b-75bc-4d94-8b69-98cc9154222d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060514 Sep 10 11:56:05.200758 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1868/3725] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:56:05.221336 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bbd546e3-6f37-456d-b41e-efde732e2875 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:05.221768 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bbd546e3-6f37-456d-b41e-efde732e2875 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] [instance: aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:05.237063 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bbd546e3-6f37-456d-b41e-efde732e2875 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:05.237563 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bbd546e3-6f37-456d-b41e-efde732e2875 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:05.238002 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bbd546e3-6f37-456d-b41e-efde732e2875 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:05.238711 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bbd546e3-6f37-456d-b41e-efde732e2875 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:05.241334 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bbd546e3-6f37-456d-b41e-efde732e2875 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:05.241808 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bbd546e3-6f37-456d-b41e-efde732e2875 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:05.263319 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-4cd976a9-33db-44ab-aff3-5f3436877fcf tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] validate_networks() for [('8981d05d-3169-42b2-b341-d927308d80cd', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:56:05.673323 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:56:05.786200 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bbd546e3-6f37-456d-b41e-efde732e2875 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e27edecefe4d60a2dba4ba99055bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f245084ce3f409889039ba1ee751eed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:05.810504 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bbd546e3-6f37-456d-b41e-efde732e2875 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7" status: 200 len: 1318 microversion: 2.1 time: 0.608429 Sep 10 11:56:05.811120 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1869/3726] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:05 2022] GET /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7 => generated 1318 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:05.889643 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bd872da2-6558-40cd-9efc-c87266d18681 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:56:05.892411 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bd872da2-6558-40cd-9efc-c87266d18681 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 51d91016-0b23-4d74-98b4-1c76652aacb5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:05.896209 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:56:05.907966 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd872da2-6558-40cd-9efc-c87266d18681 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:05.908688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd872da2-6558-40cd-9efc-c87266d18681 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:05.909980 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd872da2-6558-40cd-9efc-c87266d18681 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:05.910918 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd872da2-6558-40cd-9efc-c87266d18681 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:05.911678 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd872da2-6558-40cd-9efc-c87266d18681 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:05.912336 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd872da2-6558-40cd-9efc-c87266d18681 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:05.914525 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=20 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:56:05.980850 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-bd872da2-6558-40cd-9efc-c87266d18681 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lazy-loading 'flavor' on Instance uuid 51d91016-0b23-4d74-98b4-1c76652aacb5 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:56:06.164883 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bd872da2-6558-40cd-9efc-c87266d18681 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "POST /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5/action" status: 200 len: 32 microversion: 2.1 time: 0.280805 Sep 10 11:56:06.175301 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1870/3727] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:56:05 2022] POST /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5/action => generated 32 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 10 11:56:06.187627 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-78b0a6cf-3ac7-4dad-a0ba-2dd580add4a2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:06.188365 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-78b0a6cf-3ac7-4dad-a0ba-2dd580add4a2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:06.202026 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78b0a6cf-3ac7-4dad-a0ba-2dd580add4a2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:06.202793 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78b0a6cf-3ac7-4dad-a0ba-2dd580add4a2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:06.205018 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78b0a6cf-3ac7-4dad-a0ba-2dd580add4a2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:06.205932 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78b0a6cf-3ac7-4dad-a0ba-2dd580add4a2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:06.209148 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78b0a6cf-3ac7-4dad-a0ba-2dd580add4a2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:06.209792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78b0a6cf-3ac7-4dad-a0ba-2dd580add4a2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:06.590449 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-78b0a6cf-3ac7-4dad-a0ba-2dd580add4a2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:06.605855 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-78b0a6cf-3ac7-4dad-a0ba-2dd580add4a2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:06.611483 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-78b0a6cf-3ac7-4dad-a0ba-2dd580add4a2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:06.612701 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-78b0a6cf-3ac7-4dad-a0ba-2dd580add4a2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1406 microversion: 2.20 time: 0.436094 Sep 10 11:56:06.613611 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1871/3728] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:56:06 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1406 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:56:06.623815 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a4fffc11-603b-4a5b-b482-23670efaf702 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:06.624423 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a4fffc11-603b-4a5b-b482-23670efaf702 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 1175db1c-de8d-4486-bf15-b45db331da80] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:06.641633 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a4fffc11-603b-4a5b-b482-23670efaf702 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:06.643550 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a4fffc11-603b-4a5b-b482-23670efaf702 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:06.644164 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a4fffc11-603b-4a5b-b482-23670efaf702 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:06.647510 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a4fffc11-603b-4a5b-b482-23670efaf702 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:06.648145 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a4fffc11-603b-4a5b-b482-23670efaf702 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:06.649042 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a4fffc11-603b-4a5b-b482-23670efaf702 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:06.778668 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-4cd976a9-33db-44ab-aff3-5f3436877fcf tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:56:06.779192 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-4cd976a9-33db-44ab-aff3-5f3436877fcf tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:56:06.780426 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-4cd976a9-33db-44ab-aff3-5f3436877fcf tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:56:06.780993 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-4cd976a9-33db-44ab-aff3-5f3436877fcf tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:56:06.781429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-4cd976a9-33db-44ab-aff3-5f3436877fcf tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:56:06.800868 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4cd976a9-33db-44ab-aff3-5f3436877fcf tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:06.803048 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4cd976a9-33db-44ab-aff3-5f3436877fcf tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:06.804036 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4cd976a9-33db-44ab-aff3-5f3436877fcf tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:06.808587 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4cd976a9-33db-44ab-aff3-5f3436877fcf tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:06.809388 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4cd976a9-33db-44ab-aff3-5f3436877fcf tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:06.810128 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4cd976a9-33db-44ab-aff3-5f3436877fcf tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:06.856515 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-4cd976a9-33db-44ab-aff3-5f3436877fcf tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Getting quotas for project e4037e33456e49ce9fc9dca787b81c5b. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:56:06.869755 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-4cd976a9-33db-44ab-aff3-5f3436877fcf tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Getting quotas for user 699642ccee09488eb731ba7c707947d4 and project e4037e33456e49ce9fc9dca787b81c5b. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:56:06.904431 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4cd976a9-33db-44ab-aff3-5f3436877fcf tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:56:06.907174 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4cd976a9-33db-44ab-aff3-5f3436877fcf tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:56:06.925132 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a4fffc11-603b-4a5b-b482-23670efaf702 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:06.937083 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a4fffc11-603b-4a5b-b482-23670efaf702 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80" status: 200 len: 1334 microversion: 2.1 time: 0.321670 Sep 10 11:56:06.937747 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1872/3729] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:06 2022] GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80 => generated 1334 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:06.957459 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ba0ecf00-851f-4e1c-8ae8-201586e9334a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:06.959627 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ba0ecf00-851f-4e1c-8ae8-201586e9334a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 51d91016-0b23-4d74-98b4-1c76652aacb5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:06.968747 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba0ecf00-851f-4e1c-8ae8-201586e9334a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:06.969264 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba0ecf00-851f-4e1c-8ae8-201586e9334a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:06.969690 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba0ecf00-851f-4e1c-8ae8-201586e9334a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:06.970401 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba0ecf00-851f-4e1c-8ae8-201586e9334a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:06.970859 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba0ecf00-851f-4e1c-8ae8-201586e9334a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:06.971322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba0ecf00-851f-4e1c-8ae8-201586e9334a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:07.018236 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4cd976a9-33db-44ab-aff3-5f3436877fcf tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.877051 Sep 10 11:56:07.019657 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1858/3730] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:56:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 1879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:56:07.027753 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7bc18fcd-e45c-45a2-b680-294012df67f0 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:07.029946 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7bc18fcd-e45c-45a2-b680-294012df67f0 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] [instance: aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:07.044018 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7bc18fcd-e45c-45a2-b680-294012df67f0 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:07.044922 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7bc18fcd-e45c-45a2-b680-294012df67f0 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:07.062379 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7bc18fcd-e45c-45a2-b680-294012df67f0 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:07.065685 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7bc18fcd-e45c-45a2-b680-294012df67f0 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:07.068881 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7bc18fcd-e45c-45a2-b680-294012df67f0 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:07.069350 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7bc18fcd-e45c-45a2-b680-294012df67f0 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:07.398377 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ba0ecf00-851f-4e1c-8ae8-201586e9334a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:07.407194 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ba0ecf00-851f-4e1c-8ae8-201586e9334a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5" status: 200 len: 1522 microversion: 2.1 time: 0.461110 Sep 10 11:56:07.407921 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1873/3731] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:06 2022] GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5 => generated 1522 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:07.412664 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0c43743c-d23f-4b7e-917b-7206c12d45b9 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:07.413482 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0c43743c-d23f-4b7e-917b-7206c12d45b9 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:07.552706 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0c43743c-d23f-4b7e-917b-7206c12d45b9 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:07.577307 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0c43743c-d23f-4b7e-917b-7206c12d45b9 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1214 microversion: 2.1 time: 0.166208 Sep 10 11:56:07.579378 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1874/3732] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:07 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1214 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:07.599513 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-fc4308f3-2c3b-4f5a-a839-51b8b682aeba req-33d4692a-d6c9-4070-b8c5-590ab05173d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39f90b6f-123c-451f-8f7a-dbe291a5d4a7", "tag": "c38ed82a-b2c8-4c91-b325-3aed6429f4b0"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:56:07.615000 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-fc4308f3-2c3b-4f5a-a839-51b8b682aeba req-33d4692a-d6c9-4070-b8c5-590ab05173d7 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:07.616193 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-fc4308f3-2c3b-4f5a-a839-51b8b682aeba req-33d4692a-d6c9-4070-b8c5-590ab05173d7 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:07.616833 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-fc4308f3-2c3b-4f5a-a839-51b8b682aeba req-33d4692a-d6c9-4070-b8c5-590ab05173d7 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:07.631277 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-fc4308f3-2c3b-4f5a-a839-51b8b682aeba req-33d4692a-d6c9-4070-b8c5-590ab05173d7 service nova] Creating event network-changed:c38ed82a-b2c8-4c91-b325-3aed6429f4b0 for instance 39f90b6f-123c-451f-8f7a-dbe291a5d4a7 on n-h2-856895-1 Sep 10 11:56:07.639987 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-fc4308f3-2c3b-4f5a-a839-51b8b682aeba req-33d4692a-d6c9-4070-b8c5-590ab05173d7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057555 Sep 10 11:56:07.641373 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1875/3733] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:56:07.650847 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-82c98413-18aa-47e8-a522-500274a82268 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:07.652423 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-82c98413-18aa-47e8-a522-500274a82268 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:07.662528 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82c98413-18aa-47e8-a522-500274a82268 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:07.663598 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82c98413-18aa-47e8-a522-500274a82268 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:07.664278 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82c98413-18aa-47e8-a522-500274a82268 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:07.665788 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82c98413-18aa-47e8-a522-500274a82268 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:07.666510 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82c98413-18aa-47e8-a522-500274a82268 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:07.668398 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82c98413-18aa-47e8-a522-500274a82268 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:07.717266 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7bc18fcd-e45c-45a2-b680-294012df67f0 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e27edecefe4d60a2dba4ba99055bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f245084ce3f409889039ba1ee751eed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:07.731503 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7bc18fcd-e45c-45a2-b680-294012df67f0 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7" status: 200 len: 1318 microversion: 2.1 time: 0.708750 Sep 10 11:56:07.734240 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1859/3734] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:07 2022] GET /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7 => generated 1318 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:07.966511 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f855916b-16dd-4c5f-8bbb-955d82847e17 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:07.967145 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f855916b-16dd-4c5f-8bbb-955d82847e17 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 1175db1c-de8d-4486-bf15-b45db331da80] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:07.981883 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-82c98413-18aa-47e8-a522-500274a82268 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:07.983985 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f855916b-16dd-4c5f-8bbb-955d82847e17 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:07.985786 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f855916b-16dd-4c5f-8bbb-955d82847e17 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:07.986284 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f855916b-16dd-4c5f-8bbb-955d82847e17 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:07.989379 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f855916b-16dd-4c5f-8bbb-955d82847e17 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:07.989869 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f855916b-16dd-4c5f-8bbb-955d82847e17 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:07.990956 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f855916b-16dd-4c5f-8bbb-955d82847e17 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:07.996114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-82c98413-18aa-47e8-a522-500274a82268 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:07.999309 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-82c98413-18aa-47e8-a522-500274a82268 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:08.000817 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-82c98413-18aa-47e8-a522-500274a82268 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1406 microversion: 2.20 time: 0.357389 Sep 10 11:56:08.003323 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1876/3735] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:56:07 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1406 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:56:08.216318 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-28f90c74-4035-479e-8c8d-a6f1e9ebd317 req-96a9cabf-59a1-4f1e-97b8-152148bec358 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7", "name": "network-vif-plugged", "status": "completed", "tag": "83f19d9c-64d5-42d5-86ba-3993c5101e77"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:56:08.236625 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-28f90c74-4035-479e-8c8d-a6f1e9ebd317 req-96a9cabf-59a1-4f1e-97b8-152148bec358 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:08.237982 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-28f90c74-4035-479e-8c8d-a6f1e9ebd317 req-96a9cabf-59a1-4f1e-97b8-152148bec358 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:08.239825 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-28f90c74-4035-479e-8c8d-a6f1e9ebd317 req-96a9cabf-59a1-4f1e-97b8-152148bec358 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:08.269033 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-28f90c74-4035-479e-8c8d-a6f1e9ebd317 req-96a9cabf-59a1-4f1e-97b8-152148bec358 service nova] Creating event network-vif-plugged:83f19d9c-64d5-42d5-86ba-3993c5101e77 for instance aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7 on n-h1-856895-1 Sep 10 11:56:08.279767 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-28f90c74-4035-479e-8c8d-a6f1e9ebd317 req-96a9cabf-59a1-4f1e-97b8-152148bec358 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074893 Sep 10 11:56:08.280994 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1877/3736] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:56:08.443485 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c8c8141e-3527-4c85-9d2d-ab4690ef6f70 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:08.446737 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c8c8141e-3527-4c85-9d2d-ab4690ef6f70 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 51d91016-0b23-4d74-98b4-1c76652aacb5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:08.489181 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c8c8141e-3527-4c85-9d2d-ab4690ef6f70 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:08.490372 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c8c8141e-3527-4c85-9d2d-ab4690ef6f70 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:08.491318 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f855916b-16dd-4c5f-8bbb-955d82847e17 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:08.492884 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c8c8141e-3527-4c85-9d2d-ab4690ef6f70 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:08.497929 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c8c8141e-3527-4c85-9d2d-ab4690ef6f70 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:08.504075 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f855916b-16dd-4c5f-8bbb-955d82847e17 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80" status: 200 len: 1334 microversion: 2.1 time: 0.543804 Sep 10 11:56:08.505354 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c8c8141e-3527-4c85-9d2d-ab4690ef6f70 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:08.507018 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c8c8141e-3527-4c85-9d2d-ab4690ef6f70 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:08.507567 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1860/3737] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:07 2022] GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80 => generated 1334 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:08.602373 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-96af3c74-09c1-42e1-9ddc-59276449981a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:08.602893 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-96af3c74-09c1-42e1-9ddc-59276449981a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:08.619976 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-96af3c74-09c1-42e1-9ddc-59276449981a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:08.620403 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-96af3c74-09c1-42e1-9ddc-59276449981a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:08.620916 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-96af3c74-09c1-42e1-9ddc-59276449981a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:08.624670 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-96af3c74-09c1-42e1-9ddc-59276449981a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:08.626856 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-96af3c74-09c1-42e1-9ddc-59276449981a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:08.633718 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-96af3c74-09c1-42e1-9ddc-59276449981a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:08.698023 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:56:08.793018 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-96af3c74-09c1-42e1-9ddc-59276449981a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:08.805505 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-96af3c74-09c1-42e1-9ddc-59276449981a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1266 microversion: 2.1 time: 0.207040 Sep 10 11:56:08.816763 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1861/3738] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:08 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:56:08.823030 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-62927f71-f5f8-4f4f-adcf-11e4aa50e5e4 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:08.825003 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-62927f71-f5f8-4f4f-adcf-11e4aa50e5e4 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] [instance: aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:08.841072 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-62927f71-f5f8-4f4f-adcf-11e4aa50e5e4 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:08.841620 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-62927f71-f5f8-4f4f-adcf-11e4aa50e5e4 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:08.842675 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-62927f71-f5f8-4f4f-adcf-11e4aa50e5e4 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:08.843480 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-62927f71-f5f8-4f4f-adcf-11e4aa50e5e4 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:08.843949 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-62927f71-f5f8-4f4f-adcf-11e4aa50e5e4 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:08.844389 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-62927f71-f5f8-4f4f-adcf-11e4aa50e5e4 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:08.868563 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c8c8141e-3527-4c85-9d2d-ab4690ef6f70 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:08.878356 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c8c8141e-3527-4c85-9d2d-ab4690ef6f70 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5" status: 200 len: 1522 microversion: 2.1 time: 0.447384 Sep 10 11:56:08.878872 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1878/3739] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:08 2022] GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5 => generated 1522 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:56:09.031816 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5f125d7e-ff8d-4726-b6fc-bb7af568ebaf tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:09.032480 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5f125d7e-ff8d-4726-b6fc-bb7af568ebaf tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:09.044257 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5f125d7e-ff8d-4726-b6fc-bb7af568ebaf tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:09.044799 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5f125d7e-ff8d-4726-b6fc-bb7af568ebaf tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:09.045244 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5f125d7e-ff8d-4726-b6fc-bb7af568ebaf tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:09.046549 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5f125d7e-ff8d-4726-b6fc-bb7af568ebaf tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:09.047027 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5f125d7e-ff8d-4726-b6fc-bb7af568ebaf tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:09.047546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5f125d7e-ff8d-4726-b6fc-bb7af568ebaf tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:09.567285 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-62927f71-f5f8-4f4f-adcf-11e4aa50e5e4 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e27edecefe4d60a2dba4ba99055bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f245084ce3f409889039ba1ee751eed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:09.596571 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-62927f71-f5f8-4f4f-adcf-11e4aa50e5e4 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7" status: 200 len: 1318 microversion: 2.1 time: 0.771248 Sep 10 11:56:09.598688 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1862/3740] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:08 2022] GET /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7 => generated 1318 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:09.616088 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fea312d1-ae69-4054-a704-93070b28520a tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:09.618770 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fea312d1-ae69-4054-a704-93070b28520a tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 1175db1c-de8d-4486-bf15-b45db331da80] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:09.647736 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fea312d1-ae69-4054-a704-93070b28520a tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:09.649725 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fea312d1-ae69-4054-a704-93070b28520a tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:09.650409 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fea312d1-ae69-4054-a704-93070b28520a tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:09.653002 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fea312d1-ae69-4054-a704-93070b28520a tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:09.655884 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fea312d1-ae69-4054-a704-93070b28520a tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:09.656409 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fea312d1-ae69-4054-a704-93070b28520a tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:09.689813 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5f125d7e-ff8d-4726-b6fc-bb7af568ebaf tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:09.704958 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5f125d7e-ff8d-4726-b6fc-bb7af568ebaf tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:09.707445 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5f125d7e-ff8d-4726-b6fc-bb7af568ebaf tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:09.708760 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5f125d7e-ff8d-4726-b6fc-bb7af568ebaf tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1406 microversion: 2.20 time: 0.681171 Sep 10 11:56:09.717196 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1879/3741] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:56:09 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1406 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:56:09.838527 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1ccaf361-90c4-4115-88e0-1f0fe8eb93bf tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:09.840432 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1ccaf361-90c4-4115-88e0-1f0fe8eb93bf tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:09.861202 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ccaf361-90c4-4115-88e0-1f0fe8eb93bf tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:09.866347 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ccaf361-90c4-4115-88e0-1f0fe8eb93bf tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:09.867101 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ccaf361-90c4-4115-88e0-1f0fe8eb93bf tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:09.868194 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ccaf361-90c4-4115-88e0-1f0fe8eb93bf tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:09.872352 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ccaf361-90c4-4115-88e0-1f0fe8eb93bf tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:09.873399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ccaf361-90c4-4115-88e0-1f0fe8eb93bf tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:10.002615 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1ccaf361-90c4-4115-88e0-1f0fe8eb93bf tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:10.013462 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1ccaf361-90c4-4115-88e0-1f0fe8eb93bf tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1266 microversion: 2.1 time: 0.177789 Sep 10 11:56:10.017308 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1880/3742] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:09 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:56:10.025249 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fea312d1-ae69-4054-a704-93070b28520a tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:10.036244 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fea312d1-ae69-4054-a704-93070b28520a tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80" status: 200 len: 1334 microversion: 2.1 time: 0.433589 Sep 10 11:56:10.037201 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-964e832e-5a10-4381-9079-c82095eccaf4 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:10.037960 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-964e832e-5a10-4381-9079-c82095eccaf4 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 51d91016-0b23-4d74-98b4-1c76652aacb5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:10.038564 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1863/3743] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:09 2022] GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80 => generated 1334 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:10.057705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-964e832e-5a10-4381-9079-c82095eccaf4 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:10.067938 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-964e832e-5a10-4381-9079-c82095eccaf4 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:10.068646 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-964e832e-5a10-4381-9079-c82095eccaf4 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:10.072879 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-964e832e-5a10-4381-9079-c82095eccaf4 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:10.073648 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-964e832e-5a10-4381-9079-c82095eccaf4 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:10.074346 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-964e832e-5a10-4381-9079-c82095eccaf4 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:10.110038 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:56:10.500057 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-964e832e-5a10-4381-9079-c82095eccaf4 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:10.508049 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-964e832e-5a10-4381-9079-c82095eccaf4 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5" status: 200 len: 1522 microversion: 2.1 time: 0.489385 Sep 10 11:56:10.511901 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1881/3744] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:10 2022] GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5 => generated 1522 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:10.624485 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-358e831f-407a-4383-a260-86befaed7750 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:10.625111 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-358e831f-407a-4383-a260-86befaed7750 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] [instance: aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:10.646325 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-358e831f-407a-4383-a260-86befaed7750 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:10.646819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-358e831f-407a-4383-a260-86befaed7750 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:10.647282 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-358e831f-407a-4383-a260-86befaed7750 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:10.648001 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-358e831f-407a-4383-a260-86befaed7750 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:10.651494 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-358e831f-407a-4383-a260-86befaed7750 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:10.652581 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-358e831f-407a-4383-a260-86befaed7750 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:10.730214 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-e8541fad-4fa7-47a2-bb47-6e8412efb2d2 req-c29247ff-ba7b-4a4f-9b32-312134cbcfce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39f90b6f-123c-451f-8f7a-dbe291a5d4a7", "name": "network-vif-plugged", "status": "completed", "tag": "c38ed82a-b2c8-4c91-b325-3aed6429f4b0"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:56:10.766092 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e8541fad-4fa7-47a2-bb47-6e8412efb2d2 req-c29247ff-ba7b-4a4f-9b32-312134cbcfce service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:10.770260 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e8541fad-4fa7-47a2-bb47-6e8412efb2d2 req-c29247ff-ba7b-4a4f-9b32-312134cbcfce service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:10.770988 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e8541fad-4fa7-47a2-bb47-6e8412efb2d2 req-c29247ff-ba7b-4a4f-9b32-312134cbcfce service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:10.803708 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-e8541fad-4fa7-47a2-bb47-6e8412efb2d2 req-c29247ff-ba7b-4a4f-9b32-312134cbcfce service nova] Creating event network-vif-plugged:c38ed82a-b2c8-4c91-b325-3aed6429f4b0 for instance 39f90b6f-123c-451f-8f7a-dbe291a5d4a7 on n-h2-856895-1 Sep 10 11:56:10.815670 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-e8541fad-4fa7-47a2-bb47-6e8412efb2d2 req-c29247ff-ba7b-4a4f-9b32-312134cbcfce service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098036 Sep 10 11:56:10.820366 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1882/3745] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:56:10.848876 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-265a881c-c0ce-4061-aeed-61a558a33712 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:10.850165 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-265a881c-c0ce-4061-aeed-61a558a33712 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:10.861273 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-265a881c-c0ce-4061-aeed-61a558a33712 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:10.875182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-265a881c-c0ce-4061-aeed-61a558a33712 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:10.876937 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-265a881c-c0ce-4061-aeed-61a558a33712 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:10.877964 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-265a881c-c0ce-4061-aeed-61a558a33712 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:10.878654 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-265a881c-c0ce-4061-aeed-61a558a33712 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:10.879500 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-265a881c-c0ce-4061-aeed-61a558a33712 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:11.172890 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-358e831f-407a-4383-a260-86befaed7750 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e27edecefe4d60a2dba4ba99055bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f245084ce3f409889039ba1ee751eed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:11.181649 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-358e831f-407a-4383-a260-86befaed7750 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7" status: 200 len: 1468 microversion: 2.1 time: 0.561293 Sep 10 11:56:11.182985 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1864/3746] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:10 2022] GET /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7 => generated 1468 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:11.189862 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fa540d02-d941-4f54-ad61-92128bb32f1e tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:11.190803 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fa540d02-d941-4f54-ad61-92128bb32f1e tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:11.197797 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa540d02-d941-4f54-ad61-92128bb32f1e tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:11.198666 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa540d02-d941-4f54-ad61-92128bb32f1e tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:11.199830 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa540d02-d941-4f54-ad61-92128bb32f1e tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:11.204394 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa540d02-d941-4f54-ad61-92128bb32f1e tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:11.205707 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa540d02-d941-4f54-ad61-92128bb32f1e tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:11.206897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa540d02-d941-4f54-ad61-92128bb32f1e tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:11.229396 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-265a881c-c0ce-4061-aeed-61a558a33712 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:11.245854 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-265a881c-c0ce-4061-aeed-61a558a33712 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:11.252024 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-265a881c-c0ce-4061-aeed-61a558a33712 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:11.253259 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-265a881c-c0ce-4061-aeed-61a558a33712 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1406 microversion: 2.20 time: 0.431294 Sep 10 11:56:11.254056 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1883/3747] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:56:10 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1406 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:56:11.265569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f93b40b7-2063-4f59-b5dc-0ee7bfc63ddd tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:11.266217 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f93b40b7-2063-4f59-b5dc-0ee7bfc63ddd tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 1175db1c-de8d-4486-bf15-b45db331da80] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:11.286918 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f93b40b7-2063-4f59-b5dc-0ee7bfc63ddd tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:11.287456 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f93b40b7-2063-4f59-b5dc-0ee7bfc63ddd tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:11.287902 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f93b40b7-2063-4f59-b5dc-0ee7bfc63ddd tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:11.288620 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f93b40b7-2063-4f59-b5dc-0ee7bfc63ddd tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:11.289267 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f93b40b7-2063-4f59-b5dc-0ee7bfc63ddd tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:11.289706 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f93b40b7-2063-4f59-b5dc-0ee7bfc63ddd tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:11.326423 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fa540d02-d941-4f54-ad61-92128bb32f1e tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:11.341986 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fa540d02-d941-4f54-ad61-92128bb32f1e tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1272 microversion: 2.1 time: 0.156801 Sep 10 11:56:11.342937 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1865/3748] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:11 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1272 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:11.353572 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bac999f3-2c53-423a-81c9-68a7734d9b7f tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:11.354417 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bac999f3-2c53-423a-81c9-68a7734d9b7f tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] [instance: af31e6eb-f34c-4ae9-aede-bc4ca6949556] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:11.374504 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bac999f3-2c53-423a-81c9-68a7734d9b7f tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:11.375005 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bac999f3-2c53-423a-81c9-68a7734d9b7f tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:11.376076 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bac999f3-2c53-423a-81c9-68a7734d9b7f tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:11.376803 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bac999f3-2c53-423a-81c9-68a7734d9b7f tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:11.377268 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bac999f3-2c53-423a-81c9-68a7734d9b7f tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:11.377704 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bac999f3-2c53-423a-81c9-68a7734d9b7f tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:11.681393 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f93b40b7-2063-4f59-b5dc-0ee7bfc63ddd tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:11.695696 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f93b40b7-2063-4f59-b5dc-0ee7bfc63ddd tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80" status: 200 len: 1334 microversion: 2.1 time: 0.438102 Sep 10 11:56:11.696360 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1884/3749] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:11 2022] GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80 => generated 1334 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:11.701616 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7dddace0-b964-4382-9465-3eac65601ab5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:11.709697 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7dddace0-b964-4382-9465-3eac65601ab5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 51d91016-0b23-4d74-98b4-1c76652aacb5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:11.725199 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7dddace0-b964-4382-9465-3eac65601ab5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:11.727245 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7dddace0-b964-4382-9465-3eac65601ab5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:11.727970 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7dddace0-b964-4382-9465-3eac65601ab5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:11.740889 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7dddace0-b964-4382-9465-3eac65601ab5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:11.741376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7dddace0-b964-4382-9465-3eac65601ab5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:11.741851 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7dddace0-b964-4382-9465-3eac65601ab5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:11.874369 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bac999f3-2c53-423a-81c9-68a7734d9b7f tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e27edecefe4d60a2dba4ba99055bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f245084ce3f409889039ba1ee751eed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:11.883133 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bac999f3-2c53-423a-81c9-68a7734d9b7f tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/servers/af31e6eb-f34c-4ae9-aede-bc4ca6949556" status: 200 len: 1466 microversion: 2.1 time: 0.539048 Sep 10 11:56:11.884084 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1866/3750] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:11 2022] GET /compute/v2.1/servers/af31e6eb-f34c-4ae9-aede-bc4ca6949556 => generated 1466 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:11.909275 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-12fef9d4-344a-4298-b41c-9d4346548224 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1474676894"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:56:11.913475 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-12fef9d4-344a-4298-b41c-9d4346548224 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] [instance: af31e6eb-f34c-4ae9-aede-bc4ca6949556] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:11.934632 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-12fef9d4-344a-4298-b41c-9d4346548224 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:11.935686 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-12fef9d4-344a-4298-b41c-9d4346548224 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:11.936348 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-12fef9d4-344a-4298-b41c-9d4346548224 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:11.937791 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-12fef9d4-344a-4298-b41c-9d4346548224 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:11.938466 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-12fef9d4-344a-4298-b41c-9d4346548224 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:11.939107 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-12fef9d4-344a-4298-b41c-9d4346548224 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:12.109720 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7dddace0-b964-4382-9465-3eac65601ab5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:12.144709 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7dddace0-b964-4382-9465-3eac65601ab5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5" status: 200 len: 1522 microversion: 2.1 time: 0.445774 Sep 10 11:56:12.165407 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1885/3751] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:11 2022] GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5 => generated 1522 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:12.275009 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-12fef9d4-344a-4298-b41c-9d4346548224 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "POST /compute/v2.1/servers/af31e6eb-f34c-4ae9-aede-bc4ca6949556/action" status: 202 len: 0 microversion: 2.1 time: 0.370685 Sep 10 11:56:12.280994 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1867/3752] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:56:11 2022] POST /compute/v2.1/servers/af31e6eb-f34c-4ae9-aede-bc4ca6949556/action => generated 0 bytes in 373 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 10 11:56:12.289272 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ca9064bd-ebe0-42d7-92c3-c2ff741076d4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:12.291722 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ca9064bd-ebe0-42d7-92c3-c2ff741076d4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:12.301396 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-41fc1181-01e9-4cfe-afcb-0f6ad5379cf8 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4072cabee0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:12.327941 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca9064bd-ebe0-42d7-92c3-c2ff741076d4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:12.329559 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca9064bd-ebe0-42d7-92c3-c2ff741076d4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:12.331994 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca9064bd-ebe0-42d7-92c3-c2ff741076d4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:12.332858 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca9064bd-ebe0-42d7-92c3-c2ff741076d4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:12.333587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca9064bd-ebe0-42d7-92c3-c2ff741076d4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:12.335275 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca9064bd-ebe0-42d7-92c3-c2ff741076d4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:12.383278 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-41fc1181-01e9-4cfe-afcb-0f6ad5379cf8 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474" status: 200 len: 1455 microversion: 2.1 time: 0.095751 Sep 10 11:56:12.387453 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1868/3753] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:56:12 2022] GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474 => generated 1455 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:12.400291 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-10b947c1-0051-4260-9db5-2cd88854e41b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:12.401055 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-10b947c1-0051-4260-9db5-2cd88854e41b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:12.415291 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10b947c1-0051-4260-9db5-2cd88854e41b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:12.415788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10b947c1-0051-4260-9db5-2cd88854e41b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:12.416423 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10b947c1-0051-4260-9db5-2cd88854e41b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:12.418125 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10b947c1-0051-4260-9db5-2cd88854e41b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:12.421059 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10b947c1-0051-4260-9db5-2cd88854e41b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:12.421700 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10b947c1-0051-4260-9db5-2cd88854e41b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:12.701752 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ca9064bd-ebe0-42d7-92c3-c2ff741076d4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:12.710315 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ca9064bd-ebe0-42d7-92c3-c2ff741076d4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:12.711884 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ca9064bd-ebe0-42d7-92c3-c2ff741076d4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:12.713292 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ca9064bd-ebe0-42d7-92c3-c2ff741076d4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1599 microversion: 2.20 time: 0.439356 Sep 10 11:56:12.713927 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1886/3754] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:56:12 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1599 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:56:12.731346 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-10b947c1-0051-4260-9db5-2cd88854e41b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:12.750510 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-92f8e9d1-6641-4dc8-94c4-3a0436a16cc1 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:12.751036 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-92f8e9d1-6641-4dc8-94c4-3a0436a16cc1 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 1175db1c-de8d-4486-bf15-b45db331da80] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:12.756428 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-10b947c1-0051-4260-9db5-2cd88854e41b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1314 microversion: 2.1 time: 0.366592 Sep 10 11:56:12.765072 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1869/3755] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:12 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:12.783542 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92f8e9d1-6641-4dc8-94c4-3a0436a16cc1 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:12.784362 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-55b0f994-1eae-4e96-ac9d-f0027ee22e0f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:12.785227 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-55b0f994-1eae-4e96-ac9d-f0027ee22e0f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:12.786576 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92f8e9d1-6641-4dc8-94c4-3a0436a16cc1 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:12.787197 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92f8e9d1-6641-4dc8-94c4-3a0436a16cc1 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:12.789725 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92f8e9d1-6641-4dc8-94c4-3a0436a16cc1 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:12.790363 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92f8e9d1-6641-4dc8-94c4-3a0436a16cc1 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:12.790792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92f8e9d1-6641-4dc8-94c4-3a0436a16cc1 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:12.805221 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55b0f994-1eae-4e96-ac9d-f0027ee22e0f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:12.807899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55b0f994-1eae-4e96-ac9d-f0027ee22e0f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:12.810022 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55b0f994-1eae-4e96-ac9d-f0027ee22e0f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:12.810923 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55b0f994-1eae-4e96-ac9d-f0027ee22e0f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:12.811583 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55b0f994-1eae-4e96-ac9d-f0027ee22e0f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:12.812092 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55b0f994-1eae-4e96-ac9d-f0027ee22e0f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:13.004962 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-55b0f994-1eae-4e96-ac9d-f0027ee22e0f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.234853 Sep 10 11:56:13.005546 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1870/3756] 10.222.0.23 () {60 vars in 1316 bytes} [Sat Sep 10 11:56:12 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7/os-interface => generated 285 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:56:13.010154 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-ae116bbd-a232-4c0f-9689-34683d77ec92 req-d37030a8-d66b-44b9-af8f-a8f88a6abd80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e327931f-dea2-4ee1-ab5a-db5566ea3607", "tag": "0ab05d2a-080b-4a9f-8613-b4079fcf6314"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:56:13.021246 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ae116bbd-a232-4c0f-9689-34683d77ec92 req-d37030a8-d66b-44b9-af8f-a8f88a6abd80 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:13.021753 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ae116bbd-a232-4c0f-9689-34683d77ec92 req-d37030a8-d66b-44b9-af8f-a8f88a6abd80 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:13.022645 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ae116bbd-a232-4c0f-9689-34683d77ec92 req-d37030a8-d66b-44b9-af8f-a8f88a6abd80 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:13.037493 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-ae116bbd-a232-4c0f-9689-34683d77ec92 req-d37030a8-d66b-44b9-af8f-a8f88a6abd80 service nova] Creating event network-changed:0ab05d2a-080b-4a9f-8613-b4079fcf6314 for instance e327931f-dea2-4ee1-ab5a-db5566ea3607 on n-h1-856895-1 Sep 10 11:56:13.045647 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-ae116bbd-a232-4c0f-9689-34683d77ec92 req-d37030a8-d66b-44b9-af8f-a8f88a6abd80 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038198 Sep 10 11:56:13.046946 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1871/3757] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:56:13.128309 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-92f8e9d1-6641-4dc8-94c4-3a0436a16cc1 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:13.144792 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-92f8e9d1-6641-4dc8-94c4-3a0436a16cc1 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80" status: 200 len: 1334 microversion: 2.1 time: 0.404985 Sep 10 11:56:13.161894 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1887/3758] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:12 2022] GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80 => generated 1334 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:13.171985 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ff56a216-2efd-4e3d-987b-d6d7fb9ddd3d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:13.173091 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ff56a216-2efd-4e3d-987b-d6d7fb9ddd3d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 51d91016-0b23-4d74-98b4-1c76652aacb5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:13.180108 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff56a216-2efd-4e3d-987b-d6d7fb9ddd3d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:13.180808 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff56a216-2efd-4e3d-987b-d6d7fb9ddd3d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:13.181409 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff56a216-2efd-4e3d-987b-d6d7fb9ddd3d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:13.182971 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff56a216-2efd-4e3d-987b-d6d7fb9ddd3d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:13.183682 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff56a216-2efd-4e3d-987b-d6d7fb9ddd3d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:13.187555 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff56a216-2efd-4e3d-987b-d6d7fb9ddd3d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:13.218464 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-e0e93f29-aa15-4273-9fad-4e1d8103fdd7 req-288e81bd-58ec-4af2-acc0-c79a2a6b43ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1175db1c-de8d-4486-bf15-b45db331da80", "name": "network-vif-plugged", "status": "completed", "tag": "5da54f77-16c2-476d-a3aa-6ea3e1bebcc6"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:56:13.235037 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e0e93f29-aa15-4273-9fad-4e1d8103fdd7 req-288e81bd-58ec-4af2-acc0-c79a2a6b43ca service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:13.235544 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e0e93f29-aa15-4273-9fad-4e1d8103fdd7 req-288e81bd-58ec-4af2-acc0-c79a2a6b43ca service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:13.235973 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e0e93f29-aa15-4273-9fad-4e1d8103fdd7 req-288e81bd-58ec-4af2-acc0-c79a2a6b43ca service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:13.258277 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-e0e93f29-aa15-4273-9fad-4e1d8103fdd7 req-288e81bd-58ec-4af2-acc0-c79a2a6b43ca service nova] Creating event network-vif-plugged:5da54f77-16c2-476d-a3aa-6ea3e1bebcc6 for instance 1175db1c-de8d-4486-bf15-b45db331da80 on n-h2-856895-1 Sep 10 11:56:13.266366 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-e0e93f29-aa15-4273-9fad-4e1d8103fdd7 req-288e81bd-58ec-4af2-acc0-c79a2a6b43ca service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052743 Sep 10 11:56:13.268429 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1888/3759] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:56:13.403688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-41c16aac-f92c-4025-a322-42e442e5ff37 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f407b5aa820>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:13.456023 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-41c16aac-f92c-4025-a322-42e442e5ff37 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474" status: 200 len: 1455 microversion: 2.1 time: 0.057811 Sep 10 11:56:13.456306 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ff56a216-2efd-4e3d-987b-d6d7fb9ddd3d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:13.465217 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1889/3760] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:56:13 2022] GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474 => generated 1455 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:56:13.468889 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ff56a216-2efd-4e3d-987b-d6d7fb9ddd3d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5" status: 200 len: 1522 microversion: 2.1 time: 0.302133 Sep 10 11:56:13.470819 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1872/3761] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:13 2022] GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5 => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:13.787284 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f6aec2f3-3e9b-4ea7-8f50-a99a46dc76da tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:13.789178 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f6aec2f3-3e9b-4ea7-8f50-a99a46dc76da tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:13.797620 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f6aec2f3-3e9b-4ea7-8f50-a99a46dc76da tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:13.798362 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f6aec2f3-3e9b-4ea7-8f50-a99a46dc76da tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:13.799078 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f6aec2f3-3e9b-4ea7-8f50-a99a46dc76da tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:13.799784 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f6aec2f3-3e9b-4ea7-8f50-a99a46dc76da tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:13.800270 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f6aec2f3-3e9b-4ea7-8f50-a99a46dc76da tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:13.800665 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f6aec2f3-3e9b-4ea7-8f50-a99a46dc76da tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:14.029747 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f6aec2f3-3e9b-4ea7-8f50-a99a46dc76da tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:14.038245 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f6aec2f3-3e9b-4ea7-8f50-a99a46dc76da tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1314 microversion: 2.1 time: 0.255407 Sep 10 11:56:14.038821 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1890/3762] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:13 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:14.173834 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b0405605-f3c0-4ca4-bf93-521d0afeddc4 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:14.174481 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b0405605-f3c0-4ca4-bf93-521d0afeddc4 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 1175db1c-de8d-4486-bf15-b45db331da80] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:14.181897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b0405605-f3c0-4ca4-bf93-521d0afeddc4 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:14.182472 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b0405605-f3c0-4ca4-bf93-521d0afeddc4 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:14.183590 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b0405605-f3c0-4ca4-bf93-521d0afeddc4 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:14.184437 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b0405605-f3c0-4ca4-bf93-521d0afeddc4 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:14.184928 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b0405605-f3c0-4ca4-bf93-521d0afeddc4 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:14.185351 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b0405605-f3c0-4ca4-bf93-521d0afeddc4 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:14.328436 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b0405605-f3c0-4ca4-bf93-521d0afeddc4 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:14.336424 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b0405605-f3c0-4ca4-bf93-521d0afeddc4 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80" status: 200 len: 1334 microversion: 2.1 time: 0.166740 Sep 10 11:56:14.337375 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1873/3763] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:14 2022] GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80 => generated 1334 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:14.472337 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d65722af-44e4-44f0-89a5-b8ed1c36b399 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4073065ee0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:14.493466 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-720466da-61c2-40ac-bbd2-b62cbccd3fc6 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:14.494342 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-720466da-61c2-40ac-bbd2-b62cbccd3fc6 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 51d91016-0b23-4d74-98b4-1c76652aacb5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:14.505554 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-720466da-61c2-40ac-bbd2-b62cbccd3fc6 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:14.506045 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-720466da-61c2-40ac-bbd2-b62cbccd3fc6 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:14.506491 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-720466da-61c2-40ac-bbd2-b62cbccd3fc6 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:14.507363 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-720466da-61c2-40ac-bbd2-b62cbccd3fc6 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:14.507827 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-720466da-61c2-40ac-bbd2-b62cbccd3fc6 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:14.508256 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-720466da-61c2-40ac-bbd2-b62cbccd3fc6 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:14.519976 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d65722af-44e4-44f0-89a5-b8ed1c36b399 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474" status: 200 len: 1455 microversion: 2.1 time: 0.051608 Sep 10 11:56:14.521297 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1891/3764] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:56:14 2022] GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474 => generated 1455 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:14.652770 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-720466da-61c2-40ac-bbd2-b62cbccd3fc6 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:14.661259 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-720466da-61c2-40ac-bbd2-b62cbccd3fc6 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5" status: 200 len: 1522 microversion: 2.1 time: 0.171660 Sep 10 11:56:14.662104 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1874/3765] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:14 2022] GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:56:15.064845 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e84b6f0f-a9ff-43b7-8c32-f84426036970 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:15.065600 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e84b6f0f-a9ff-43b7-8c32-f84426036970 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:15.072881 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e84b6f0f-a9ff-43b7-8c32-f84426036970 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:15.073376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e84b6f0f-a9ff-43b7-8c32-f84426036970 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:15.074711 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e84b6f0f-a9ff-43b7-8c32-f84426036970 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:15.075628 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e84b6f0f-a9ff-43b7-8c32-f84426036970 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:15.076245 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e84b6f0f-a9ff-43b7-8c32-f84426036970 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:15.076680 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e84b6f0f-a9ff-43b7-8c32-f84426036970 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:15.144979 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-31306806-ab39-4062-b291-aade32a84b4b req-ee5d025a-4d0a-423a-bdd4-fdc5a8ee9334 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39f90b6f-123c-451f-8f7a-dbe291a5d4a7", "tag": "c38ed82a-b2c8-4c91-b325-3aed6429f4b0"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:56:15.161755 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-31306806-ab39-4062-b291-aade32a84b4b req-ee5d025a-4d0a-423a-bdd4-fdc5a8ee9334 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:15.162971 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-31306806-ab39-4062-b291-aade32a84b4b req-ee5d025a-4d0a-423a-bdd4-fdc5a8ee9334 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:15.163819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-31306806-ab39-4062-b291-aade32a84b4b req-ee5d025a-4d0a-423a-bdd4-fdc5a8ee9334 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:15.182324 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-31306806-ab39-4062-b291-aade32a84b4b req-ee5d025a-4d0a-423a-bdd4-fdc5a8ee9334 service nova] Creating event network-changed:c38ed82a-b2c8-4c91-b325-3aed6429f4b0 for instance 39f90b6f-123c-451f-8f7a-dbe291a5d4a7 on n-h2-856895-1 Sep 10 11:56:15.188943 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-31306806-ab39-4062-b291-aade32a84b4b req-ee5d025a-4d0a-423a-bdd4-fdc5a8ee9334 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050483 Sep 10 11:56:15.191126 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1875/3766] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:56:15.270645 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e84b6f0f-a9ff-43b7-8c32-f84426036970 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:15.282030 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e84b6f0f-a9ff-43b7-8c32-f84426036970 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1314 microversion: 2.1 time: 0.221876 Sep 10 11:56:15.297617 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-5f32ce2f-380f-463f-b897-582b1ecacdcb req-2308ae29-41a8-4681-9a3b-9e66ac20e104 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1175db1c-de8d-4486-bf15-b45db331da80", "name": "network-vif-plugged", "status": "completed", "tag": "3974daf4-8378-4f94-80fa-edf23f2cbae5"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:56:15.299442 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1892/3767] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:15 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:15.315753 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-5f32ce2f-380f-463f-b897-582b1ecacdcb req-2308ae29-41a8-4681-9a3b-9e66ac20e104 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:15.316252 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-5f32ce2f-380f-463f-b897-582b1ecacdcb req-2308ae29-41a8-4681-9a3b-9e66ac20e104 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:15.316702 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-5f32ce2f-380f-463f-b897-582b1ecacdcb req-2308ae29-41a8-4681-9a3b-9e66ac20e104 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:15.332948 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-5f32ce2f-380f-463f-b897-582b1ecacdcb req-2308ae29-41a8-4681-9a3b-9e66ac20e104 service nova] Creating event network-vif-plugged:3974daf4-8378-4f94-80fa-edf23f2cbae5 for instance 1175db1c-de8d-4486-bf15-b45db331da80 on n-h2-856895-1 Sep 10 11:56:15.339591 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-5f32ce2f-380f-463f-b897-582b1ecacdcb req-2308ae29-41a8-4681-9a3b-9e66ac20e104 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052847 Sep 10 11:56:15.340322 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1876/3768] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:56:15.362783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fdd99333-e0a4-4ce6-9c93-4b511b4c9cbd tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:15.378492 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fdd99333-e0a4-4ce6-9c93-4b511b4c9cbd tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 1175db1c-de8d-4486-bf15-b45db331da80] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:15.387195 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdd99333-e0a4-4ce6-9c93-4b511b4c9cbd tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:15.387986 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdd99333-e0a4-4ce6-9c93-4b511b4c9cbd tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:15.388629 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdd99333-e0a4-4ce6-9c93-4b511b4c9cbd tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:15.389688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdd99333-e0a4-4ce6-9c93-4b511b4c9cbd tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:15.390596 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdd99333-e0a4-4ce6-9c93-4b511b4c9cbd tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:15.391269 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdd99333-e0a4-4ce6-9c93-4b511b4c9cbd tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:15.537387 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9a9281b8-cdc7-4e1a-acf3-5ad4378175a7 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f407b5ea430>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:15.557286 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fdd99333-e0a4-4ce6-9c93-4b511b4c9cbd tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:15.567453 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fdd99333-e0a4-4ce6-9c93-4b511b4c9cbd tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80" status: 200 len: 1334 microversion: 2.1 time: 0.209872 Sep 10 11:56:15.579733 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1893/3769] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:15 2022] GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80 => generated 1334 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:56:15.618495 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9a9281b8-cdc7-4e1a-acf3-5ad4378175a7 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474" status: 200 len: 1455 microversion: 2.1 time: 0.085284 Sep 10 11:56:15.619209 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1877/3770] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:56:15 2022] GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474 => generated 1455 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:56:15.685499 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ede29c5a-8e9f-43c8-a765-a2cfb86f4b06 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:15.686179 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ede29c5a-8e9f-43c8-a765-a2cfb86f4b06 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 51d91016-0b23-4d74-98b4-1c76652aacb5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:15.694492 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ede29c5a-8e9f-43c8-a765-a2cfb86f4b06 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:15.695257 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ede29c5a-8e9f-43c8-a765-a2cfb86f4b06 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:15.695713 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ede29c5a-8e9f-43c8-a765-a2cfb86f4b06 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:15.696607 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ede29c5a-8e9f-43c8-a765-a2cfb86f4b06 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:15.697099 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ede29c5a-8e9f-43c8-a765-a2cfb86f4b06 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:15.697695 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ede29c5a-8e9f-43c8-a765-a2cfb86f4b06 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:15.856610 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ede29c5a-8e9f-43c8-a765-a2cfb86f4b06 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:15.867596 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ede29c5a-8e9f-43c8-a765-a2cfb86f4b06 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5" status: 200 len: 1522 microversion: 2.1 time: 0.186666 Sep 10 11:56:15.868771 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1894/3771] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:15 2022] GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:16.306978 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fc83358d-b630-4161-bf20-d27057c6fdb7 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:16.307756 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fc83358d-b630-4161-bf20-d27057c6fdb7 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:16.315154 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc83358d-b630-4161-bf20-d27057c6fdb7 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:16.315611 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc83358d-b630-4161-bf20-d27057c6fdb7 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:16.316066 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc83358d-b630-4161-bf20-d27057c6fdb7 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:16.316785 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc83358d-b630-4161-bf20-d27057c6fdb7 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:16.317251 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc83358d-b630-4161-bf20-d27057c6fdb7 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:16.317685 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc83358d-b630-4161-bf20-d27057c6fdb7 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:16.456067 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fc83358d-b630-4161-bf20-d27057c6fdb7 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:16.463887 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fc83358d-b630-4161-bf20-d27057c6fdb7 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1314 microversion: 2.1 time: 0.161752 Sep 10 11:56:16.464542 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1878/3772] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:16 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:56:16.592249 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c46a8f56-1408-47de-bcde-cdccdf269886 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:16.592865 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c46a8f56-1408-47de-bcde-cdccdf269886 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 1175db1c-de8d-4486-bf15-b45db331da80] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:16.599815 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c46a8f56-1408-47de-bcde-cdccdf269886 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:16.600307 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c46a8f56-1408-47de-bcde-cdccdf269886 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:16.601005 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c46a8f56-1408-47de-bcde-cdccdf269886 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:16.601692 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c46a8f56-1408-47de-bcde-cdccdf269886 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:16.602140 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c46a8f56-1408-47de-bcde-cdccdf269886 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:16.602558 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c46a8f56-1408-47de-bcde-cdccdf269886 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:16.635715 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8f388672-eeb0-45b0-acfe-b487edd07cf3 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f407250bdc0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:16.688149 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8f388672-eeb0-45b0-acfe-b487edd07cf3 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474" status: 200 len: 1455 microversion: 2.1 time: 0.056496 Sep 10 11:56:16.688760 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1879/3773] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:56:16 2022] GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474 => generated 1455 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:56:16.799135 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c46a8f56-1408-47de-bcde-cdccdf269886 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:16.821612 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c46a8f56-1408-47de-bcde-cdccdf269886 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80" status: 200 len: 1334 microversion: 2.1 time: 0.234229 Sep 10 11:56:16.823705 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1895/3774] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:16 2022] GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80 => generated 1334 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:16.963981 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:56:16.965350 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:56:16.969481 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-71ee159e-38a4-4a92-8ee3-88ac4880afac tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:16.970388 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-71ee159e-38a4-4a92-8ee3-88ac4880afac tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 51d91016-0b23-4d74-98b4-1c76652aacb5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:16.977196 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-71ee159e-38a4-4a92-8ee3-88ac4880afac tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:16.978167 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-71ee159e-38a4-4a92-8ee3-88ac4880afac tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:16.978847 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-71ee159e-38a4-4a92-8ee3-88ac4880afac tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:16.979982 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-71ee159e-38a4-4a92-8ee3-88ac4880afac tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:16.980707 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-71ee159e-38a4-4a92-8ee3-88ac4880afac tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:16.981210 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-71ee159e-38a4-4a92-8ee3-88ac4880afac tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:17.155838 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-71ee159e-38a4-4a92-8ee3-88ac4880afac tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:17.165197 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-71ee159e-38a4-4a92-8ee3-88ac4880afac tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5" status: 200 len: 1522 microversion: 2.1 time: 0.201544 Sep 10 11:56:17.168217 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1880/3775] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:16 2022] GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:17.489346 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f5e63645-2601-404c-a9d2-f8bb7fe0b75a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:17.490013 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f5e63645-2601-404c-a9d2-f8bb7fe0b75a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:17.496606 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f5e63645-2601-404c-a9d2-f8bb7fe0b75a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:17.497097 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f5e63645-2601-404c-a9d2-f8bb7fe0b75a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:17.497536 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f5e63645-2601-404c-a9d2-f8bb7fe0b75a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:17.498233 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f5e63645-2601-404c-a9d2-f8bb7fe0b75a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:17.498688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f5e63645-2601-404c-a9d2-f8bb7fe0b75a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:17.499114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f5e63645-2601-404c-a9d2-f8bb7fe0b75a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:17.568782 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:56:17.703798 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5b41fa05-5bb5-4d06-8b46-a552aeb3f9bb tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4073630b80>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:17.719586 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f5e63645-2601-404c-a9d2-f8bb7fe0b75a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:17.732140 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f5e63645-2601-404c-a9d2-f8bb7fe0b75a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1314 microversion: 2.1 time: 0.246418 Sep 10 11:56:17.732906 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1896/3776] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:17 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:56:17.763840 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5b41fa05-5bb5-4d06-8b46-a552aeb3f9bb tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474" status: 200 len: 1455 microversion: 2.1 time: 0.063989 Sep 10 11:56:17.764545 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1881/3777] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:56:17 2022] GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474 => generated 1455 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:17.929875 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3b508e1a-f763-4a05-a08e-23d3fe8fea16 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:17.930497 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3b508e1a-f763-4a05-a08e-23d3fe8fea16 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 1175db1c-de8d-4486-bf15-b45db331da80] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:17.939616 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3b508e1a-f763-4a05-a08e-23d3fe8fea16 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:17.940854 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3b508e1a-f763-4a05-a08e-23d3fe8fea16 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:17.942079 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3b508e1a-f763-4a05-a08e-23d3fe8fea16 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:17.943120 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3b508e1a-f763-4a05-a08e-23d3fe8fea16 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:17.944208 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3b508e1a-f763-4a05-a08e-23d3fe8fea16 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:17.944800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3b508e1a-f763-4a05-a08e-23d3fe8fea16 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:18.141937 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3b508e1a-f763-4a05-a08e-23d3fe8fea16 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:18.150991 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3b508e1a-f763-4a05-a08e-23d3fe8fea16 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80" status: 200 len: 1669 microversion: 2.1 time: 0.224864 Sep 10 11:56:18.151869 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1897/3778] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:17 2022] GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80 => generated 1669 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:18.174031 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3a324610-d32d-4afe-a54a-2a1fe0160b21 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:18.174534 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3a324610-d32d-4afe-a54a-2a1fe0160b21 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 1175db1c-de8d-4486-bf15-b45db331da80] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:18.181395 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3a324610-d32d-4afe-a54a-2a1fe0160b21 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:18.181923 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3a324610-d32d-4afe-a54a-2a1fe0160b21 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:18.182374 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3a324610-d32d-4afe-a54a-2a1fe0160b21 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:18.183691 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3a324610-d32d-4afe-a54a-2a1fe0160b21 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:18.184106 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3a324610-d32d-4afe-a54a-2a1fe0160b21 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:18.184547 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3a324610-d32d-4afe-a54a-2a1fe0160b21 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:18.189112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4f6dee4e-cfe0-49ea-a145-5eb83a894a91 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:18.189855 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4f6dee4e-cfe0-49ea-a145-5eb83a894a91 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 51d91016-0b23-4d74-98b4-1c76652aacb5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:18.196215 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4f6dee4e-cfe0-49ea-a145-5eb83a894a91 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:18.196780 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4f6dee4e-cfe0-49ea-a145-5eb83a894a91 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:18.197293 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4f6dee4e-cfe0-49ea-a145-5eb83a894a91 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:18.198200 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4f6dee4e-cfe0-49ea-a145-5eb83a894a91 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:18.199548 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4f6dee4e-cfe0-49ea-a145-5eb83a894a91 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:18.199953 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4f6dee4e-cfe0-49ea-a145-5eb83a894a91 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:18.212887 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3a324610-d32d-4afe-a54a-2a1fe0160b21 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80/ips" status: 200 len: 179 microversion: 2.1 time: 0.042741 Sep 10 11:56:18.219088 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1882/3779] 10.222.0.23 () {58 vars in 1248 bytes} [Sat Sep 10 11:56:18 2022] GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80/ips => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:56:18.229017 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8645a324-66d6-4d22-bb4e-c95219cb15d3 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:18.229572 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8645a324-66d6-4d22-bb4e-c95219cb15d3 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 1175db1c-de8d-4486-bf15-b45db331da80] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:18.241848 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8645a324-66d6-4d22-bb4e-c95219cb15d3 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:18.242474 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8645a324-66d6-4d22-bb4e-c95219cb15d3 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:18.243025 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8645a324-66d6-4d22-bb4e-c95219cb15d3 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:18.243905 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8645a324-66d6-4d22-bb4e-c95219cb15d3 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:18.244495 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8645a324-66d6-4d22-bb4e-c95219cb15d3 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:18.245038 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8645a324-66d6-4d22-bb4e-c95219cb15d3 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:18.250736 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:56:18.280300 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8645a324-66d6-4d22-bb4e-c95219cb15d3 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 1175db1c-de8d-4486-bf15-b45db331da80] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:56:18.394108 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8645a324-66d6-4d22-bb4e-c95219cb15d3 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80" status: 204 len: 0 microversion: 2.1 time: 0.172538 Sep 10 11:56:18.398212 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1883/3780] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:56:18 2022] DELETE /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 11:56:18.409249 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d2b0b4f8-4c16-46b7-b275-6301b71ba278 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:18.411011 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d2b0b4f8-4c16-46b7-b275-6301b71ba278 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 1175db1c-de8d-4486-bf15-b45db331da80] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:18.422957 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2b0b4f8-4c16-46b7-b275-6301b71ba278 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:18.423732 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2b0b4f8-4c16-46b7-b275-6301b71ba278 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:18.424387 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2b0b4f8-4c16-46b7-b275-6301b71ba278 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:18.425940 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2b0b4f8-4c16-46b7-b275-6301b71ba278 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:18.426615 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2b0b4f8-4c16-46b7-b275-6301b71ba278 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:18.427304 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2b0b4f8-4c16-46b7-b275-6301b71ba278 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:18.569050 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4f6dee4e-cfe0-49ea-a145-5eb83a894a91 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:18.578549 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4f6dee4e-cfe0-49ea-a145-5eb83a894a91 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5" status: 200 len: 1522 microversion: 2.1 time: 0.393501 Sep 10 11:56:18.579658 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1898/3781] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:18 2022] GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5 => generated 1522 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:56:18.746621 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d2b0b4f8-4c16-46b7-b275-6301b71ba278 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:18.755006 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d2b0b4f8-4c16-46b7-b275-6301b71ba278 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80" status: 200 len: 1675 microversion: 2.1 time: 0.355267 Sep 10 11:56:18.755889 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1884/3782] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:18 2022] GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80 => generated 1675 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:18.757960 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-995935c5-9b67-4f2b-9251-7077dbf6aba0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:18.758626 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-995935c5-9b67-4f2b-9251-7077dbf6aba0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:18.765387 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-995935c5-9b67-4f2b-9251-7077dbf6aba0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:18.765874 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-995935c5-9b67-4f2b-9251-7077dbf6aba0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:18.766310 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-995935c5-9b67-4f2b-9251-7077dbf6aba0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:18.767000 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-995935c5-9b67-4f2b-9251-7077dbf6aba0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:18.767480 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-995935c5-9b67-4f2b-9251-7077dbf6aba0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:18.767898 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-995935c5-9b67-4f2b-9251-7077dbf6aba0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:18.780160 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ed0cc29b-7d8b-4fab-989a-948060b0a01f tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f407250b160>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:18.828314 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ed0cc29b-7d8b-4fab-989a-948060b0a01f tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474" status: 200 len: 1455 microversion: 2.1 time: 0.052499 Sep 10 11:56:18.828905 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1885/3783] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:56:18 2022] GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474 => generated 1455 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:56:19.026315 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-995935c5-9b67-4f2b-9251-7077dbf6aba0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:19.034268 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-995935c5-9b67-4f2b-9251-7077dbf6aba0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1314 microversion: 2.1 time: 0.280262 Sep 10 11:56:19.034846 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1899/3784] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:18 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:56:19.110696 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b803691a-bdcf-44cb-933b-eb8e07c7132d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:19.111050 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b803691a-bdcf-44cb-933b-eb8e07c7132d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 9da5b114-2ad4-41f0-897f-d4e2984f5a16] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:19.117844 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b803691a-bdcf-44cb-933b-eb8e07c7132d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:19.118353 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b803691a-bdcf-44cb-933b-eb8e07c7132d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:19.118800 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b803691a-bdcf-44cb-933b-eb8e07c7132d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:19.119553 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b803691a-bdcf-44cb-933b-eb8e07c7132d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:19.120025 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b803691a-bdcf-44cb-933b-eb8e07c7132d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:19.120584 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b803691a-bdcf-44cb-933b-eb8e07c7132d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:19.150348 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b803691a-bdcf-44cb-933b-eb8e07c7132d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 9da5b114-2ad4-41f0-897f-d4e2984f5a16] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:56:19.229731 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b803691a-bdcf-44cb-933b-eb8e07c7132d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16" status: 204 len: 0 microversion: 2.1 time: 0.122860 Sep 10 11:56:19.230338 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1886/3785] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:56:19 2022] DELETE /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:56:19.238365 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4125a49e-425b-4f93-827f-a25faa281eb2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:19.238974 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4125a49e-425b-4f93-827f-a25faa281eb2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 9da5b114-2ad4-41f0-897f-d4e2984f5a16] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:19.245023 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4125a49e-425b-4f93-827f-a25faa281eb2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:19.245745 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4125a49e-425b-4f93-827f-a25faa281eb2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:19.246404 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4125a49e-425b-4f93-827f-a25faa281eb2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:19.247077 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4125a49e-425b-4f93-827f-a25faa281eb2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:19.248729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4125a49e-425b-4f93-827f-a25faa281eb2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:19.248729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4125a49e-425b-4f93-827f-a25faa281eb2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:19.510819 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4125a49e-425b-4f93-827f-a25faa281eb2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:19.519638 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4125a49e-425b-4f93-827f-a25faa281eb2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16" status: 200 len: 1553 microversion: 2.1 time: 0.284960 Sep 10 11:56:19.520149 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1900/3786] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:19 2022] GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16 => generated 1553 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:56:19.605727 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6a036898-4a3f-4beb-8d53-14559f62ec4b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:19.606707 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6a036898-4a3f-4beb-8d53-14559f62ec4b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 51d91016-0b23-4d74-98b4-1c76652aacb5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:19.614246 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6a036898-4a3f-4beb-8d53-14559f62ec4b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:19.614828 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6a036898-4a3f-4beb-8d53-14559f62ec4b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:19.615306 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6a036898-4a3f-4beb-8d53-14559f62ec4b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:19.616028 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6a036898-4a3f-4beb-8d53-14559f62ec4b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:19.616738 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6a036898-4a3f-4beb-8d53-14559f62ec4b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:19.617177 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6a036898-4a3f-4beb-8d53-14559f62ec4b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:19.778598 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-84986415-0d11-4e4c-855d-1a10c8d011fd tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:19.779250 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-84986415-0d11-4e4c-855d-1a10c8d011fd tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 1175db1c-de8d-4486-bf15-b45db331da80] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:19.786025 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-84986415-0d11-4e4c-855d-1a10c8d011fd tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:19.786512 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-84986415-0d11-4e4c-855d-1a10c8d011fd tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:19.786950 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-84986415-0d11-4e4c-855d-1a10c8d011fd tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:19.788120 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-84986415-0d11-4e4c-855d-1a10c8d011fd tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:19.788575 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-84986415-0d11-4e4c-855d-1a10c8d011fd tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:19.789007 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-84986415-0d11-4e4c-855d-1a10c8d011fd tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:19.804395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=100 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:56:19.875748 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6a036898-4a3f-4beb-8d53-14559f62ec4b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:19.885224 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6a036898-4a3f-4beb-8d53-14559f62ec4b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5" status: 200 len: 1522 microversion: 2.1 time: 0.284454 Sep 10 11:56:19.899193 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1887/3787] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:19 2022] GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5 => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:19.899193 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8edf5965-b78a-4eb0-8358-4c27fd0668ed tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f407916cca0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:19.949439 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8edf5965-b78a-4eb0-8358-4c27fd0668ed tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474" status: 200 len: 1455 microversion: 2.1 time: 0.054411 Sep 10 11:56:19.950408 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1888/3788] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:56:19 2022] GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474 => generated 1455 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:20.047109 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-84986415-0d11-4e4c-855d-1a10c8d011fd tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:20.058075 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2ab08d77-d83b-4e83-98d6-910d1376e3dd tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:20.058312 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-84986415-0d11-4e4c-855d-1a10c8d011fd tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80" status: 200 len: 1675 microversion: 2.1 time: 0.283164 Sep 10 11:56:20.058973 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2ab08d77-d83b-4e83-98d6-910d1376e3dd tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:20.060590 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1901/3789] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:19 2022] GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80 => generated 1675 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:56:20.082686 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2ab08d77-d83b-4e83-98d6-910d1376e3dd tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:20.083214 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2ab08d77-d83b-4e83-98d6-910d1376e3dd tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:20.083852 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2ab08d77-d83b-4e83-98d6-910d1376e3dd tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:20.084767 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2ab08d77-d83b-4e83-98d6-910d1376e3dd tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:20.085439 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2ab08d77-d83b-4e83-98d6-910d1376e3dd tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:20.085880 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2ab08d77-d83b-4e83-98d6-910d1376e3dd tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:20.235830 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-7fd92ddc-1b77-419a-8a51-598f382ec8da req-bd411c50-440d-49e6-97b2-da2e1f02a57d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af31e6eb-f34c-4ae9-aede-bc4ca6949556", "name": "network-vif-plugged", "status": "completed", "tag": "3fe151c0-067d-4e53-a33f-9bab864a1662"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:56:20.253135 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-7fd92ddc-1b77-419a-8a51-598f382ec8da req-bd411c50-440d-49e6-97b2-da2e1f02a57d service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:20.254853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-7fd92ddc-1b77-419a-8a51-598f382ec8da req-bd411c50-440d-49e6-97b2-da2e1f02a57d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:20.255766 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-7fd92ddc-1b77-419a-8a51-598f382ec8da req-bd411c50-440d-49e6-97b2-da2e1f02a57d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:20.272313 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-7fd92ddc-1b77-419a-8a51-598f382ec8da req-bd411c50-440d-49e6-97b2-da2e1f02a57d service nova] Creating event network-vif-plugged:3fe151c0-067d-4e53-a33f-9bab864a1662 for instance af31e6eb-f34c-4ae9-aede-bc4ca6949556 on n-h1-856895-1 Sep 10 11:56:20.282194 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-7fd92ddc-1b77-419a-8a51-598f382ec8da req-bd411c50-440d-49e6-97b2-da2e1f02a57d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052257 Sep 10 11:56:20.285114 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1902/3790] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:56:20.302218 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2ab08d77-d83b-4e83-98d6-910d1376e3dd tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:20.312843 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2ab08d77-d83b-4e83-98d6-910d1376e3dd tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1314 microversion: 2.1 time: 0.258893 Sep 10 11:56:20.314266 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1889/3791] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:20 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:56:20.542977 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c74485c6-d3fa-43a3-8f23-1ad5f1ca2de7 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:20.544208 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c74485c6-d3fa-43a3-8f23-1ad5f1ca2de7 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 9da5b114-2ad4-41f0-897f-d4e2984f5a16] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:20.551846 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c74485c6-d3fa-43a3-8f23-1ad5f1ca2de7 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:20.552574 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c74485c6-d3fa-43a3-8f23-1ad5f1ca2de7 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:20.553398 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c74485c6-d3fa-43a3-8f23-1ad5f1ca2de7 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:20.554364 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c74485c6-d3fa-43a3-8f23-1ad5f1ca2de7 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:20.555155 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c74485c6-d3fa-43a3-8f23-1ad5f1ca2de7 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:20.555839 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c74485c6-d3fa-43a3-8f23-1ad5f1ca2de7 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:20.659878 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-f5f196c0-66fb-4923-80ba-1ecba4f1beac req-e2bac100-9f81-4dbe-b368-dc4824c910a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1175db1c-de8d-4486-bf15-b45db331da80", "name": "network-vif-deleted", "tag": "5da54f77-16c2-476d-a3aa-6ea3e1bebcc6"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:56:20.678514 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f5f196c0-66fb-4923-80ba-1ecba4f1beac req-e2bac100-9f81-4dbe-b368-dc4824c910a7 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:20.679431 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f5f196c0-66fb-4923-80ba-1ecba4f1beac req-e2bac100-9f81-4dbe-b368-dc4824c910a7 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:20.681093 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f5f196c0-66fb-4923-80ba-1ecba4f1beac req-e2bac100-9f81-4dbe-b368-dc4824c910a7 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:20.697359 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-f5f196c0-66fb-4923-80ba-1ecba4f1beac req-e2bac100-9f81-4dbe-b368-dc4824c910a7 service nova] Creating event network-vif-deleted:5da54f77-16c2-476d-a3aa-6ea3e1bebcc6 for instance 1175db1c-de8d-4486-bf15-b45db331da80 on n-h2-856895-1 Sep 10 11:56:20.707562 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-f5f196c0-66fb-4923-80ba-1ecba4f1beac req-e2bac100-9f81-4dbe-b368-dc4824c910a7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053947 Sep 10 11:56:20.726527 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1890/3792] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:56:20.914327 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7a40f4cb-8475-4396-8871-1ed465f9324a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:20.916458 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7a40f4cb-8475-4396-8871-1ed465f9324a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 51d91016-0b23-4d74-98b4-1c76652aacb5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:20.940504 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a40f4cb-8475-4396-8871-1ed465f9324a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:20.943418 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a40f4cb-8475-4396-8871-1ed465f9324a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:20.944032 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a40f4cb-8475-4396-8871-1ed465f9324a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:20.946651 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a40f4cb-8475-4396-8871-1ed465f9324a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:20.949978 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a40f4cb-8475-4396-8871-1ed465f9324a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:20.950613 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a40f4cb-8475-4396-8871-1ed465f9324a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:21.172175 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c74485c6-d3fa-43a3-8f23-1ad5f1ca2de7 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:21.185363 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c74485c6-d3fa-43a3-8f23-1ad5f1ca2de7 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16" status: 200 len: 1553 microversion: 2.1 time: 0.645992 Sep 10 11:56:21.191754 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1903/3793] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:20 2022] GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16 => generated 1553 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:21.204843 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a7b15862-228c-4130-88c2-aa458872ecdc tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f407b5aac10>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:21.282050 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a7b15862-228c-4130-88c2-aa458872ecdc tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474" status: 200 len: 1455 microversion: 2.1 time: 0.088803 Sep 10 11:56:21.282897 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1904/3794] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:56:21 2022] GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474 => generated 1455 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:21.288637 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-51d19fb3-6142-42e8-b195-cb9ccd84a84a tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:21.289700 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-51d19fb3-6142-42e8-b195-cb9ccd84a84a tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 1175db1c-de8d-4486-bf15-b45db331da80] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:21.297270 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-51d19fb3-6142-42e8-b195-cb9ccd84a84a tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:21.298222 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-51d19fb3-6142-42e8-b195-cb9ccd84a84a tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:21.298886 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-51d19fb3-6142-42e8-b195-cb9ccd84a84a tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:21.299822 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-51d19fb3-6142-42e8-b195-cb9ccd84a84a tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:21.300475 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-51d19fb3-6142-42e8-b195-cb9ccd84a84a tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:21.301095 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-51d19fb3-6142-42e8-b195-cb9ccd84a84a tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:21.349297 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7a40f4cb-8475-4396-8871-1ed465f9324a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:21.361688 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7a40f4cb-8475-4396-8871-1ed465f9324a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5" status: 200 len: 1522 microversion: 2.1 time: 0.455295 Sep 10 11:56:21.364000 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1891/3795] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:20 2022] GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5 => generated 1522 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:56:21.388609 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6ff6c057-18c5-4162-8fa8-8789aefa0ed6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:21.391001 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6ff6c057-18c5-4162-8fa8-8789aefa0ed6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:21.403825 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6ff6c057-18c5-4162-8fa8-8789aefa0ed6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:21.406224 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6ff6c057-18c5-4162-8fa8-8789aefa0ed6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:21.406879 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6ff6c057-18c5-4162-8fa8-8789aefa0ed6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:21.407993 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6ff6c057-18c5-4162-8fa8-8789aefa0ed6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:21.408666 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6ff6c057-18c5-4162-8fa8-8789aefa0ed6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:21.409263 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6ff6c057-18c5-4162-8fa8-8789aefa0ed6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:21.421314 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-51d19fb3-6142-42e8-b195-cb9ccd84a84a tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce925a3528c64d4fa50a8310be9e7c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37597777ce774f87aeabe08ab2227cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:21.436183 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-51d19fb3-6142-42e8-b195-cb9ccd84a84a tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80" status: 200 len: 1454 microversion: 2.1 time: 0.152000 Sep 10 11:56:21.436786 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1905/3796] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:21 2022] GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80 => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:21.633703 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6ff6c057-18c5-4162-8fa8-8789aefa0ed6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:21.643300 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6ff6c057-18c5-4162-8fa8-8789aefa0ed6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1314 microversion: 2.1 time: 0.277582 Sep 10 11:56:21.644349 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1892/3797] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:21 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:22.210914 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-823c9d53-088d-46b4-bc58-0d94193bb153 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:22.211605 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-823c9d53-088d-46b4-bc58-0d94193bb153 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 9da5b114-2ad4-41f0-897f-d4e2984f5a16] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:22.219327 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-823c9d53-088d-46b4-bc58-0d94193bb153 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:22.219817 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-823c9d53-088d-46b4-bc58-0d94193bb153 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:22.220254 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-823c9d53-088d-46b4-bc58-0d94193bb153 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:22.220951 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-823c9d53-088d-46b4-bc58-0d94193bb153 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:22.221408 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-823c9d53-088d-46b4-bc58-0d94193bb153 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:22.221836 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-823c9d53-088d-46b4-bc58-0d94193bb153 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:22.298798 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e9feb417-57af-43b9-960d-fab94d0d0ee5 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f407351e1f0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:22.368566 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e9feb417-57af-43b9-960d-fab94d0d0ee5 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474" status: 200 len: 1455 microversion: 2.1 time: 0.073911 Sep 10 11:56:22.369964 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1893/3798] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:56:22 2022] GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474 => generated 1455 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:56:22.392376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-823c9d53-088d-46b4-bc58-0d94193bb153 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:22.399911 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c0a84124-6fdd-4f22-b7bf-eb771cec2351 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:22.402334 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-823c9d53-088d-46b4-bc58-0d94193bb153 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16" status: 200 len: 1553 microversion: 2.1 time: 0.194494 Sep 10 11:56:22.403253 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1906/3799] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:22 2022] GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16 => generated 1553 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:22.403895 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c0a84124-6fdd-4f22-b7bf-eb771cec2351 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 51d91016-0b23-4d74-98b4-1c76652aacb5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:22.416783 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0a84124-6fdd-4f22-b7bf-eb771cec2351 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:22.420617 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0a84124-6fdd-4f22-b7bf-eb771cec2351 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:22.421802 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0a84124-6fdd-4f22-b7bf-eb771cec2351 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:22.422887 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0a84124-6fdd-4f22-b7bf-eb771cec2351 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:22.423692 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0a84124-6fdd-4f22-b7bf-eb771cec2351 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:22.424713 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0a84124-6fdd-4f22-b7bf-eb771cec2351 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:22.461849 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-941a3b0b-9cee-4f95-b418-b8ce03a81271 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:22.462709 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-941a3b0b-9cee-4f95-b418-b8ce03a81271 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 1175db1c-de8d-4486-bf15-b45db331da80] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:22.469371 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-941a3b0b-9cee-4f95-b418-b8ce03a81271 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:22.469867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-941a3b0b-9cee-4f95-b418-b8ce03a81271 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:22.470306 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-941a3b0b-9cee-4f95-b418-b8ce03a81271 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:22.471008 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-941a3b0b-9cee-4f95-b418-b8ce03a81271 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:22.471586 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-941a3b0b-9cee-4f95-b418-b8ce03a81271 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:22.472019 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-941a3b0b-9cee-4f95-b418-b8ce03a81271 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:22.491911 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-941a3b0b-9cee-4f95-b418-b8ce03a81271 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] HTTP exception thrown: Instance 1175db1c-de8d-4486-bf15-b45db331da80 could not be found. Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-941a3b0b-9cee-4f95-b418-b8ce03a81271 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Request method failure captured: Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80 HTTP/1.1 Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHrpDbI_vwysjrZI0pLgV2e_9ugqPwvEusU3Vp9T8_0IKbBIqjVhqDJZ20XuEbp27bB1AOEvdv_MdqobhZETMprY0llBtDOGnDYkSutpNvLCyJxVCzumDpKThaUgJ6fh0Yzl7omsmFl0yReFCqG8RlC6ulAtSgz8ylIcu8wmUlUk0vs Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 37597777ce774f87aeabe08ab2227cbd Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersTestMultiNic-1216547353 Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/37597777ce774f87aeabe08ab2227cbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/37597777ce774f87aeabe08ab2227cbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_37597777ce774f87aeabe08ab2227cbd", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/37597777ce774f87aeabe08ab2227cbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersTestMultiNic-1216547353 Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 37597777ce774f87aeabe08ab2227cbd Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersTestMultiNic-1216547353 Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersTestMultiNic-1216547353-project Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: ce925a3528c64d4fa50a8310be9e7c06 Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersTestMultiNic-1216547353-project Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 1175db1c-de8d-4486-bf15-b45db331da80 could not be found. Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '1175db1c-de8d-4486-bf15-b45db331da80'} Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1175db1c-de8d-4486-bf15-b45db331da80 could not be found. Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1175db1c-de8d-4486-bf15-b45db331da80 could not be found. Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:56:22.493578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:56:22.498638 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:56:22.498638 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:56:22.498638 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:56:22.498638 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:56:22.498638 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:56:22.498638 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1175db1c-de8d-4486-bf15-b45db331da80 could not be found. Sep 10 11:56:22.498638 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:56:22.498638 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-941a3b0b-9cee-4f95-b418-b8ce03a81271 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Returning 404 to user: Instance 1175db1c-de8d-4486-bf15-b45db331da80 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:56:22.498638 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-941a3b0b-9cee-4f95-b418-b8ce03a81271 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80" status: 404 len: 111 microversion: 2.1 time: 0.038503 Sep 10 11:56:22.499611 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1907/3800] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:22 2022] GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 11:56:22.648161 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c0a84124-6fdd-4f22-b7bf-eb771cec2351 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:22.661031 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c0a84124-6fdd-4f22-b7bf-eb771cec2351 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5" status: 200 len: 1522 microversion: 2.1 time: 0.270011 Sep 10 11:56:22.664519 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1894/3801] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:22 2022] GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:22.679260 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-70417b14-14cb-404b-81a7-b0d78ed43ed3 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:22.680223 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-70417b14-14cb-404b-81a7-b0d78ed43ed3 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:22.687131 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-70417b14-14cb-404b-81a7-b0d78ed43ed3 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:22.687321 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-70417b14-14cb-404b-81a7-b0d78ed43ed3 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:22.687673 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-70417b14-14cb-404b-81a7-b0d78ed43ed3 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:22.688375 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-70417b14-14cb-404b-81a7-b0d78ed43ed3 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:22.688833 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-70417b14-14cb-404b-81a7-b0d78ed43ed3 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:22.689261 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-70417b14-14cb-404b-81a7-b0d78ed43ed3 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:22.801732 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-e897c28e-683e-417e-acc8-d6e3f836600c req-52fcf783-d8b8-4846-89f1-812fb5397ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e327931f-dea2-4ee1-ab5a-db5566ea3607", "name": "network-vif-plugged", "status": "completed", "tag": "0ab05d2a-080b-4a9f-8613-b4079fcf6314"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:56:22.810044 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:56:22.815407 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e897c28e-683e-417e-acc8-d6e3f836600c req-52fcf783-d8b8-4846-89f1-812fb5397ca2 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:22.816245 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e897c28e-683e-417e-acc8-d6e3f836600c req-52fcf783-d8b8-4846-89f1-812fb5397ca2 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:22.816907 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e897c28e-683e-417e-acc8-d6e3f836600c req-52fcf783-d8b8-4846-89f1-812fb5397ca2 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:22.832044 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-e897c28e-683e-417e-acc8-d6e3f836600c req-52fcf783-d8b8-4846-89f1-812fb5397ca2 service nova] Creating event network-vif-plugged:0ab05d2a-080b-4a9f-8613-b4079fcf6314 for instance e327931f-dea2-4ee1-ab5a-db5566ea3607 on n-h1-856895-1 Sep 10 11:56:22.838029 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-e897c28e-683e-417e-acc8-d6e3f836600c req-52fcf783-d8b8-4846-89f1-812fb5397ca2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040764 Sep 10 11:56:22.840254 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1895/3802] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:56:23.012480 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-b523a747-8527-4ed1-b704-034aea9ab9b6 req-72c00683-d555-421b-a843-87088962495f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1175db1c-de8d-4486-bf15-b45db331da80", "name": "network-vif-deleted", "tag": "3974daf4-8378-4f94-80fa-edf23f2cbae5"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:56:23.039185 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-b523a747-8527-4ed1-b704-034aea9ab9b6 req-72c00683-d555-421b-a843-87088962495f service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:23.041476 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-b523a747-8527-4ed1-b704-034aea9ab9b6 req-72c00683-d555-421b-a843-87088962495f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:23.042295 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-b523a747-8527-4ed1-b704-034aea9ab9b6 req-72c00683-d555-421b-a843-87088962495f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:23.054956 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-70417b14-14cb-404b-81a7-b0d78ed43ed3 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:23.061611 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-b523a747-8527-4ed1-b704-034aea9ab9b6 req-72c00683-d555-421b-a843-87088962495f service nova] Creating event network-vif-deleted:3974daf4-8378-4f94-80fa-edf23f2cbae5 for instance 1175db1c-de8d-4486-bf15-b45db331da80 on n-h2-856895-1 Sep 10 11:56:23.065113 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-70417b14-14cb-404b-81a7-b0d78ed43ed3 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1314 microversion: 2.1 time: 0.400805 Sep 10 11:56:23.067274 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1908/3803] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:22 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:23.069864 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-b523a747-8527-4ed1-b704-034aea9ab9b6 req-72c00683-d555-421b-a843-87088962495f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065638 Sep 10 11:56:23.072003 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1896/3804] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:56:23.391650 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2880bc42-292c-4121-8fb4-304def9e87cc tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f40730078b0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:23.433294 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4e2da8f8-c40b-437d-8903-c645049cbd38 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:23.435821 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4e2da8f8-c40b-437d-8903-c645049cbd38 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 9da5b114-2ad4-41f0-897f-d4e2984f5a16] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:23.444826 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e2da8f8-c40b-437d-8903-c645049cbd38 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:23.445474 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e2da8f8-c40b-437d-8903-c645049cbd38 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:23.446543 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e2da8f8-c40b-437d-8903-c645049cbd38 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:23.447480 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e2da8f8-c40b-437d-8903-c645049cbd38 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:23.448118 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e2da8f8-c40b-437d-8903-c645049cbd38 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:23.449068 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e2da8f8-c40b-437d-8903-c645049cbd38 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:23.479603 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2880bc42-292c-4121-8fb4-304def9e87cc tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474" status: 200 len: 1455 microversion: 2.1 time: 0.097302 Sep 10 11:56:23.481502 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1909/3805] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:56:23 2022] GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474 => generated 1455 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:23.687419 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6c5f0dc6-274f-4cf3-8f9f-5254f37f7160 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:23.691600 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6c5f0dc6-274f-4cf3-8f9f-5254f37f7160 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 51d91016-0b23-4d74-98b4-1c76652aacb5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:23.704223 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6c5f0dc6-274f-4cf3-8f9f-5254f37f7160 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:23.705033 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6c5f0dc6-274f-4cf3-8f9f-5254f37f7160 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:23.705728 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6c5f0dc6-274f-4cf3-8f9f-5254f37f7160 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:23.706699 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6c5f0dc6-274f-4cf3-8f9f-5254f37f7160 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:23.707420 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6c5f0dc6-274f-4cf3-8f9f-5254f37f7160 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:23.708126 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6c5f0dc6-274f-4cf3-8f9f-5254f37f7160 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:23.726248 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4e2da8f8-c40b-437d-8903-c645049cbd38 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:23.737698 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4e2da8f8-c40b-437d-8903-c645049cbd38 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16" status: 200 len: 1553 microversion: 2.1 time: 0.315343 Sep 10 11:56:23.738302 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1897/3806] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:23 2022] GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16 => generated 1553 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:23.871855 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6c5f0dc6-274f-4cf3-8f9f-5254f37f7160 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:23.879706 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6c5f0dc6-274f-4cf3-8f9f-5254f37f7160 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5" status: 200 len: 1522 microversion: 2.1 time: 0.196182 Sep 10 11:56:23.880288 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1910/3807] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:23 2022] GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:24.093905 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-89210834-35bd-4cf3-8a1a-fec63718e8af tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:24.094533 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-89210834-35bd-4cf3-8a1a-fec63718e8af tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:24.101969 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89210834-35bd-4cf3-8a1a-fec63718e8af tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:24.102463 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89210834-35bd-4cf3-8a1a-fec63718e8af tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:24.102908 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89210834-35bd-4cf3-8a1a-fec63718e8af tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:24.103669 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89210834-35bd-4cf3-8a1a-fec63718e8af tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:24.104319 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89210834-35bd-4cf3-8a1a-fec63718e8af tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:24.105569 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89210834-35bd-4cf3-8a1a-fec63718e8af tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:24.310121 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-89210834-35bd-4cf3-8a1a-fec63718e8af tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:24.320877 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-89210834-35bd-4cf3-8a1a-fec63718e8af tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1314 microversion: 2.1 time: 0.231123 Sep 10 11:56:24.323263 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1898/3808] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:24 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:24.498581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-debbc2f7-91ce-4ed5-90f1-f3bc1ade598d tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f407323de50>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:24.594588 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-debbc2f7-91ce-4ed5-90f1-f3bc1ade598d tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474" status: 200 len: 1455 microversion: 2.1 time: 0.101750 Sep 10 11:56:24.596829 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1911/3809] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:56:24 2022] GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474 => generated 1455 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:24.767833 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a19dbd89-9e17-4a3b-96b4-86735787d70e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:24.769097 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a19dbd89-9e17-4a3b-96b4-86735787d70e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 9da5b114-2ad4-41f0-897f-d4e2984f5a16] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:24.789876 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a19dbd89-9e17-4a3b-96b4-86735787d70e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:24.790721 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a19dbd89-9e17-4a3b-96b4-86735787d70e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:24.791447 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a19dbd89-9e17-4a3b-96b4-86735787d70e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:24.795072 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a19dbd89-9e17-4a3b-96b4-86735787d70e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:24.797393 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a19dbd89-9e17-4a3b-96b4-86735787d70e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:24.798122 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a19dbd89-9e17-4a3b-96b4-86735787d70e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:24.904641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-53020079-6495-43a1-8208-f7bcfb61d440 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:24.905246 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-53020079-6495-43a1-8208-f7bcfb61d440 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 51d91016-0b23-4d74-98b4-1c76652aacb5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:24.918424 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-53020079-6495-43a1-8208-f7bcfb61d440 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:24.918925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-53020079-6495-43a1-8208-f7bcfb61d440 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:24.919438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-53020079-6495-43a1-8208-f7bcfb61d440 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:24.920156 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-53020079-6495-43a1-8208-f7bcfb61d440 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:24.920621 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-53020079-6495-43a1-8208-f7bcfb61d440 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:24.921060 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-53020079-6495-43a1-8208-f7bcfb61d440 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:25.300974 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-53020079-6495-43a1-8208-f7bcfb61d440 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:25.335587 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-53020079-6495-43a1-8208-f7bcfb61d440 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5" status: 200 len: 1502 microversion: 2.1 time: 0.431259 Sep 10 11:56:25.362449 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a19dbd89-9e17-4a3b-96b4-86735787d70e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:25.363570 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1912/3810] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:24 2022] GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5 => generated 1502 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:25.377800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f43da0d1-c31b-4f1a-bf74-fcd453a96012 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:25.378240 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a19dbd89-9e17-4a3b-96b4-86735787d70e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16" status: 200 len: 1553 microversion: 2.1 time: 0.616585 Sep 10 11:56:25.378967 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1899/3811] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:24 2022] GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16 => generated 1553 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:25.381240 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f43da0d1-c31b-4f1a-bf74-fcd453a96012 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:25.395058 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0830dcde-abae-4b23-9ea8-78356cb9cdac tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08a32924-e5cc-4859-8156-4d58f4eebb04"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:56:25.397767 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0830dcde-abae-4b23-9ea8-78356cb9cdac tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 51d91016-0b23-4d74-98b4-1c76652aacb5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:25.407923 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f43da0d1-c31b-4f1a-bf74-fcd453a96012 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:25.408473 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f43da0d1-c31b-4f1a-bf74-fcd453a96012 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:25.410838 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f43da0d1-c31b-4f1a-bf74-fcd453a96012 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:25.414585 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0830dcde-abae-4b23-9ea8-78356cb9cdac tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:25.415230 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0830dcde-abae-4b23-9ea8-78356cb9cdac tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:25.418925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f43da0d1-c31b-4f1a-bf74-fcd453a96012 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:25.419491 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f43da0d1-c31b-4f1a-bf74-fcd453a96012 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:25.419622 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0830dcde-abae-4b23-9ea8-78356cb9cdac tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:25.419946 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f43da0d1-c31b-4f1a-bf74-fcd453a96012 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:25.420543 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0830dcde-abae-4b23-9ea8-78356cb9cdac tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:25.421107 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0830dcde-abae-4b23-9ea8-78356cb9cdac tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:25.421634 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0830dcde-abae-4b23-9ea8-78356cb9cdac tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:25.486870 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-0830dcde-abae-4b23-9ea8-78356cb9cdac tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] HTTP exception thrown: Cannot 'attach_volume' instance 51d91016-0b23-4d74-98b4-1c76652aacb5 while it is in vm_state rescued Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0830dcde-abae-4b23-9ea8-78356cb9cdac tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Request method failure captured: Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5/os-volume_attachments HTTP/1.1 Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 74 Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHsDb9McMbZ9alVjJ4oJKA7xoa0-QA-ERuLKN-wY-xgkYgjg-f1Qkk9v6xNr7bPpAGzBceBuhySDill-chXUItw0i1842Y9FDTX_ZkXuD1aeT9HQ_-qUH7OXi222TXPS2e9y3GtImQxVIp9JaCN7mrwULBVN7FoNXkYNRF6EUEoKMAw Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 8e8bc2c6ea1946bfbbf47d63b5fa4648 Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1615383257 Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e8bc2c6ea1946bfbbf47d63b5fa4648"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e8bc2c6ea1946bfbbf47d63b5fa4648"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8e8bc2c6ea1946bfbbf47d63b5fa4648", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8e8bc2c6ea1946bfbbf47d63b5fa4648"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1615383257 Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 8e8bc2c6ea1946bfbbf47d63b5fa4648 Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1615383257 Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServerRescueNegativeTestJSON-1615383257-project Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: bddddbd6718f472e951fd87a6ec00f8d Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1615383257-project Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: {"volumeAttachment": {"volumeId": "08a32924-e5cc-4859-8156-4d58f4eebb04"}} Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: exception: Cannot 'attach_volume' instance 51d91016-0b23-4d74-98b4-1c76652aacb5 while it is in vm_state rescued Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'server_id': '51d91016-0b23-4d74-98b4-1c76652aacb5', 'body': {'volumeAttachment': {'volumeId': '08a32924-e5cc-4859-8156-4d58f4eebb04'}}} Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 51d91016-0b23-4d74-98b4-1c76652aacb5 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 10 11:56:25.494227 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 10 11:56:25.498662 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 11:56:25.498662 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 11:56:25.498662 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 51d91016-0b23-4d74-98b4-1c76652aacb5 while it is in vm_state rescued Sep 10 11:56:25.498662 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:56:25.498662 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:56:25.498662 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:56:25.498662 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:56:25.498662 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:56:25.498662 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:56:25.498662 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:56:25.498662 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:56:25.498662 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 51d91016-0b23-4d74-98b4-1c76652aacb5 while it is in vm_state rescued Sep 10 11:56:25.498662 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:56:25.498662 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0830dcde-abae-4b23-9ea8-78356cb9cdac tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Returning 409 to user: Cannot 'attach_volume' instance 51d91016-0b23-4d74-98b4-1c76652aacb5 while it is in vm_state rescued {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:56:25.504715 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0830dcde-abae-4b23-9ea8-78356cb9cdac tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "POST /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.117540 Sep 10 11:56:25.508030 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1900/3812] 10.222.0.23 () {60 vars in 1323 bytes} [Sat Sep 10 11:56:25 2022] POST /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5/os-volume_attachments => generated 152 bytes in 126 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:56:25.525873 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-757ab238-73fd-4387-a65d-69f71ebba9e7 req-f01bec02-e74f-4def-a0a4-c5480528f1ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9da5b114-2ad4-41f0-897f-d4e2984f5a16", "name": "network-vif-deleted", "tag": "7598d657-80cf-4e28-8238-e097ce3d8fe0"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:56:25.552809 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-757ab238-73fd-4387-a65d-69f71ebba9e7 req-f01bec02-e74f-4def-a0a4-c5480528f1ed service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:25.553653 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-757ab238-73fd-4387-a65d-69f71ebba9e7 req-f01bec02-e74f-4def-a0a4-c5480528f1ed service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:25.555019 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-757ab238-73fd-4387-a65d-69f71ebba9e7 req-f01bec02-e74f-4def-a0a4-c5480528f1ed service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:25.596906 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-757ab238-73fd-4387-a65d-69f71ebba9e7 req-f01bec02-e74f-4def-a0a4-c5480528f1ed service nova] Creating event network-vif-deleted:7598d657-80cf-4e28-8238-e097ce3d8fe0 for instance 9da5b114-2ad4-41f0-897f-d4e2984f5a16 on n-h1-856895-1 Sep 10 11:56:25.600355 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f43da0d1-c31b-4f1a-bf74-fcd453a96012 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:25.613802 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f43da0d1-c31b-4f1a-bf74-fcd453a96012 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1314 microversion: 2.1 time: 0.247742 Sep 10 11:56:25.616221 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-757ab238-73fd-4387-a65d-69f71ebba9e7 req-f01bec02-e74f-4def-a0a4-c5480528f1ed service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106330 Sep 10 11:56:25.617745 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1901/3813] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:56:25.629708 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-804ec109-e890-4809-b1b7-192b290c2378 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:56:25.634125 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1913/3814] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:25 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:25.635943 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-804ec109-e890-4809-b1b7-192b290c2378 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 51d91016-0b23-4d74-98b4-1c76652aacb5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:25.639953 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4d95259f-2226-4658-acf8-5c50fcf28e58 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4073e7ef70>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:25.672751 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-804ec109-e890-4809-b1b7-192b290c2378 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:25.674735 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-804ec109-e890-4809-b1b7-192b290c2378 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:25.676572 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-804ec109-e890-4809-b1b7-192b290c2378 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:25.685854 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-804ec109-e890-4809-b1b7-192b290c2378 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:25.686596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-804ec109-e890-4809-b1b7-192b290c2378 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:25.687053 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-804ec109-e890-4809-b1b7-192b290c2378 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:25.720555 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:56:25.722654 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4d95259f-2226-4658-acf8-5c50fcf28e58 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474" status: 200 len: 1455 microversion: 2.1 time: 0.087137 Sep 10 11:56:25.723422 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1914/3815] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:56:25 2022] GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474 => generated 1455 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:25.809777 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-804ec109-e890-4809-b1b7-192b290c2378 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "POST /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5/action" status: 202 len: 0 microversion: 2.1 time: 0.186049 Sep 10 11:56:25.810761 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1902/3816] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:56:25 2022] POST /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:56:25.819768 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7168735d-03e0-4344-9707-4f3d68a32a05 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:25.820575 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7168735d-03e0-4344-9707-4f3d68a32a05 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 51d91016-0b23-4d74-98b4-1c76652aacb5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:25.827766 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7168735d-03e0-4344-9707-4f3d68a32a05 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:25.828562 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7168735d-03e0-4344-9707-4f3d68a32a05 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:25.829224 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7168735d-03e0-4344-9707-4f3d68a32a05 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:25.830611 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7168735d-03e0-4344-9707-4f3d68a32a05 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:25.831384 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7168735d-03e0-4344-9707-4f3d68a32a05 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:25.832052 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7168735d-03e0-4344-9707-4f3d68a32a05 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:26.300887 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6720342c-c07e-447e-b9f4-d171c2ddf11f tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:26.301494 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6720342c-c07e-447e-b9f4-d171c2ddf11f tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 1175db1c-de8d-4486-bf15-b45db331da80] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:26.319000 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6720342c-c07e-447e-b9f4-d171c2ddf11f tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:26.319506 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6720342c-c07e-447e-b9f4-d171c2ddf11f tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:26.319954 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6720342c-c07e-447e-b9f4-d171c2ddf11f tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:26.320752 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6720342c-c07e-447e-b9f4-d171c2ddf11f tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:26.321211 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6720342c-c07e-447e-b9f4-d171c2ddf11f tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:26.321651 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6720342c-c07e-447e-b9f4-d171c2ddf11f tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:26.353406 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-6720342c-c07e-447e-b9f4-d171c2ddf11f tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] HTTP exception thrown: Instance 1175db1c-de8d-4486-bf15-b45db331da80 could not be found. Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6720342c-c07e-447e-b9f4-d171c2ddf11f tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Request method failure captured: Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80 HTTP/1.1 Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHrpDbI_vwysjrZI0pLgV2e_9ugqPwvEusU3Vp9T8_0IKbBIqjVhqDJZ20XuEbp27bB1AOEvdv_MdqobhZETMprY0llBtDOGnDYkSutpNvLCyJxVCzumDpKThaUgJ6fh0Yzl7omsmFl0yReFCqG8RlC6ulAtSgz8ylIcu8wmUlUk0vs Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 37597777ce774f87aeabe08ab2227cbd Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersTestMultiNic-1216547353 Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/37597777ce774f87aeabe08ab2227cbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/37597777ce774f87aeabe08ab2227cbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_37597777ce774f87aeabe08ab2227cbd", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/37597777ce774f87aeabe08ab2227cbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersTestMultiNic-1216547353 Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 37597777ce774f87aeabe08ab2227cbd Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersTestMultiNic-1216547353 Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersTestMultiNic-1216547353-project Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: ce925a3528c64d4fa50a8310be9e7c06 Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersTestMultiNic-1216547353-project Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 1175db1c-de8d-4486-bf15-b45db331da80 could not be found. Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '1175db1c-de8d-4486-bf15-b45db331da80'} Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1175db1c-de8d-4486-bf15-b45db331da80 could not be found. Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:56:26.356260 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:56:26.359796 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1175db1c-de8d-4486-bf15-b45db331da80 could not be found. Sep 10 11:56:26.359796 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:56:26.359796 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:56:26.359796 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:56:26.359796 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:56:26.359796 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:56:26.359796 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:56:26.359796 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:56:26.359796 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:56:26.359796 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1175db1c-de8d-4486-bf15-b45db331da80 could not be found. Sep 10 11:56:26.359796 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:56:26.359796 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6720342c-c07e-447e-b9f4-d171c2ddf11f tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Returning 404 to user: Instance 1175db1c-de8d-4486-bf15-b45db331da80 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:56:26.359796 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6720342c-c07e-447e-b9f4-d171c2ddf11f tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80" status: 404 len: 111 microversion: 2.1 time: 0.061225 Sep 10 11:56:26.371688 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1903/3817] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:56:26 2022] DELETE /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 11:56:26.378360 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a87f4873-e360-448d-aad3-98ee4472d092 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:26.379454 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a87f4873-e360-448d-aad3-98ee4472d092 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 1175db1c-de8d-4486-bf15-b45db331da80] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:26.404402 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a87f4873-e360-448d-aad3-98ee4472d092 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:26.405512 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a87f4873-e360-448d-aad3-98ee4472d092 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:26.406725 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a87f4873-e360-448d-aad3-98ee4472d092 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:26.407758 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a87f4873-e360-448d-aad3-98ee4472d092 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:26.408442 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a87f4873-e360-448d-aad3-98ee4472d092 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:26.409161 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a87f4873-e360-448d-aad3-98ee4472d092 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:26.412782 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7168735d-03e0-4344-9707-4f3d68a32a05 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:26.423677 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7168735d-03e0-4344-9707-4f3d68a32a05 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5" status: 200 len: 1510 microversion: 2.1 time: 0.608552 Sep 10 11:56:26.431257 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1915/3818] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:25 2022] GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5 => generated 1510 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:26.439376 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-a87f4873-e360-448d-aad3-98ee4472d092 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] HTTP exception thrown: Instance 1175db1c-de8d-4486-bf15-b45db331da80 could not be found. Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a87f4873-e360-448d-aad3-98ee4472d092 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Request method failure captured: Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80 HTTP/1.1 Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHrpDbI_vwysjrZI0pLgV2e_9ugqPwvEusU3Vp9T8_0IKbBIqjVhqDJZ20XuEbp27bB1AOEvdv_MdqobhZETMprY0llBtDOGnDYkSutpNvLCyJxVCzumDpKThaUgJ6fh0Yzl7omsmFl0yReFCqG8RlC6ulAtSgz8ylIcu8wmUlUk0vs Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 37597777ce774f87aeabe08ab2227cbd Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersTestMultiNic-1216547353 Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/37597777ce774f87aeabe08ab2227cbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/37597777ce774f87aeabe08ab2227cbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_37597777ce774f87aeabe08ab2227cbd", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/37597777ce774f87aeabe08ab2227cbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersTestMultiNic-1216547353 Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 37597777ce774f87aeabe08ab2227cbd Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersTestMultiNic-1216547353 Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersTestMultiNic-1216547353-project Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: ce925a3528c64d4fa50a8310be9e7c06 Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersTestMultiNic-1216547353-project Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 1175db1c-de8d-4486-bf15-b45db331da80 could not be found. Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '1175db1c-de8d-4486-bf15-b45db331da80'} Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1175db1c-de8d-4486-bf15-b45db331da80 could not be found. Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1175db1c-de8d-4486-bf15-b45db331da80 could not be found. Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:56:26.441106 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:56:26.444785 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:56:26.444785 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:56:26.444785 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:56:26.444785 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:56:26.444785 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:56:26.444785 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1175db1c-de8d-4486-bf15-b45db331da80 could not be found. Sep 10 11:56:26.444785 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:56:26.445161 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0942e588-cbb2-476e-b61d-730c703b9759 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:26.445161 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0942e588-cbb2-476e-b61d-730c703b9759 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 9da5b114-2ad4-41f0-897f-d4e2984f5a16] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:26.447865 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a87f4873-e360-448d-aad3-98ee4472d092 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Returning 404 to user: Instance 1175db1c-de8d-4486-bf15-b45db331da80 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:56:26.449147 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a87f4873-e360-448d-aad3-98ee4472d092 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80" status: 404 len: 111 microversion: 2.1 time: 0.076081 Sep 10 11:56:26.451189 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1904/3819] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:26 2022] GET /compute/v2.1/servers/1175db1c-de8d-4486-bf15-b45db331da80 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:56:26.461539 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0942e588-cbb2-476e-b61d-730c703b9759 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:26.462120 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0942e588-cbb2-476e-b61d-730c703b9759 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:26.462355 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8993c116-a154-4a68-8515-644627957c0d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:26.462564 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0942e588-cbb2-476e-b61d-730c703b9759 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:26.463443 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8993c116-a154-4a68-8515-644627957c0d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 6f2872c7-ac86-4764-9db6-96eece78150f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:26.465789 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0942e588-cbb2-476e-b61d-730c703b9759 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:26.466262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0942e588-cbb2-476e-b61d-730c703b9759 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:26.466701 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0942e588-cbb2-476e-b61d-730c703b9759 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:26.474743 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8993c116-a154-4a68-8515-644627957c0d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:26.475900 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8993c116-a154-4a68-8515-644627957c0d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:26.476780 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8993c116-a154-4a68-8515-644627957c0d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:26.478707 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8993c116-a154-4a68-8515-644627957c0d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:26.480096 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8993c116-a154-4a68-8515-644627957c0d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:26.480876 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8993c116-a154-4a68-8515-644627957c0d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:26.499482 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-8993c116-a154-4a68-8515-644627957c0d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] HTTP exception thrown: Instance 6f2872c7-ac86-4764-9db6-96eece78150f could not be found. Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8993c116-a154-4a68-8515-644627957c0d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Request method failure captured: Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f HTTP/1.1 Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHrpDbI_vwysjrZI0pLgV2e_9ugqPwvEusU3Vp9T8_0IKbBIqjVhqDJZ20XuEbp27bB1AOEvdv_MdqobhZETMprY0llBtDOGnDYkSutpNvLCyJxVCzumDpKThaUgJ6fh0Yzl7omsmFl0yReFCqG8RlC6ulAtSgz8ylIcu8wmUlUk0vs Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 37597777ce774f87aeabe08ab2227cbd Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersTestMultiNic-1216547353 Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/37597777ce774f87aeabe08ab2227cbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/37597777ce774f87aeabe08ab2227cbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_37597777ce774f87aeabe08ab2227cbd", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/37597777ce774f87aeabe08ab2227cbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersTestMultiNic-1216547353 Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 37597777ce774f87aeabe08ab2227cbd Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersTestMultiNic-1216547353 Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersTestMultiNic-1216547353-project Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: ce925a3528c64d4fa50a8310be9e7c06 Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersTestMultiNic-1216547353-project Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 6f2872c7-ac86-4764-9db6-96eece78150f could not be found. Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '6f2872c7-ac86-4764-9db6-96eece78150f'} Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f2872c7-ac86-4764-9db6-96eece78150f could not be found. Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:56:26.501451 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:56:26.504943 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f2872c7-ac86-4764-9db6-96eece78150f could not be found. Sep 10 11:56:26.504943 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:56:26.504943 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:56:26.504943 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:56:26.504943 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:56:26.504943 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:56:26.504943 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:56:26.504943 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:56:26.504943 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:56:26.504943 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f2872c7-ac86-4764-9db6-96eece78150f could not be found. Sep 10 11:56:26.504943 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:56:26.507118 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8993c116-a154-4a68-8515-644627957c0d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Returning 404 to user: Instance 6f2872c7-ac86-4764-9db6-96eece78150f could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:56:26.509416 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8993c116-a154-4a68-8515-644627957c0d tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f" status: 404 len: 111 microversion: 2.1 time: 0.053296 Sep 10 11:56:26.510529 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1905/3820] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:56:26 2022] DELETE /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:56:26.525193 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d3153f52-f9a3-4255-a1e8-86154341c767 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:26.526175 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d3153f52-f9a3-4255-a1e8-86154341c767 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] [instance: 6f2872c7-ac86-4764-9db6-96eece78150f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:26.545871 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d3153f52-f9a3-4255-a1e8-86154341c767 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:26.547775 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d3153f52-f9a3-4255-a1e8-86154341c767 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:26.549879 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d3153f52-f9a3-4255-a1e8-86154341c767 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:26.550844 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d3153f52-f9a3-4255-a1e8-86154341c767 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:26.554897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d3153f52-f9a3-4255-a1e8-86154341c767 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:26.555590 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d3153f52-f9a3-4255-a1e8-86154341c767 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:26.613390 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-d3153f52-f9a3-4255-a1e8-86154341c767 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] HTTP exception thrown: Instance 6f2872c7-ac86-4764-9db6-96eece78150f could not be found. Sep 10 11:56:26.619974 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0942e588-cbb2-476e-b61d-730c703b9759 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d3153f52-f9a3-4255-a1e8-86154341c767 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Request method failure captured: Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f HTTP/1.1 Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHrpDbI_vwysjrZI0pLgV2e_9ugqPwvEusU3Vp9T8_0IKbBIqjVhqDJZ20XuEbp27bB1AOEvdv_MdqobhZETMprY0llBtDOGnDYkSutpNvLCyJxVCzumDpKThaUgJ6fh0Yzl7omsmFl0yReFCqG8RlC6ulAtSgz8ylIcu8wmUlUk0vs Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 37597777ce774f87aeabe08ab2227cbd Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersTestMultiNic-1216547353 Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/37597777ce774f87aeabe08ab2227cbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/37597777ce774f87aeabe08ab2227cbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_37597777ce774f87aeabe08ab2227cbd", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/37597777ce774f87aeabe08ab2227cbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersTestMultiNic-1216547353 Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 37597777ce774f87aeabe08ab2227cbd Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersTestMultiNic-1216547353 Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersTestMultiNic-1216547353-project Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: ce925a3528c64d4fa50a8310be9e7c06 Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersTestMultiNic-1216547353-project Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 6f2872c7-ac86-4764-9db6-96eece78150f could not be found. Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '6f2872c7-ac86-4764-9db6-96eece78150f'} Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f2872c7-ac86-4764-9db6-96eece78150f could not be found. Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f2872c7-ac86-4764-9db6-96eece78150f could not be found. Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:56:26.624006 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:56:26.628275 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:56:26.628275 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:56:26.628275 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:56:26.628275 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:56:26.628275 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:56:26.628275 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f2872c7-ac86-4764-9db6-96eece78150f could not be found. Sep 10 11:56:26.628275 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:56:26.628275 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d3153f52-f9a3-4255-a1e8-86154341c767 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] Returning 404 to user: Instance 6f2872c7-ac86-4764-9db6-96eece78150f could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:56:26.628797 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d3153f52-f9a3-4255-a1e8-86154341c767 tempest-ServersTestMultiNic-1216547353 tempest-ServersTestMultiNic-1216547353-project] 10.222.0.23 "GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f" status: 404 len: 111 microversion: 2.1 time: 0.113489 Sep 10 11:56:26.632476 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1906/3821] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:26 2022] GET /compute/v2.1/servers/6f2872c7-ac86-4764-9db6-96eece78150f => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:56:26.640447 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0942e588-cbb2-476e-b61d-730c703b9759 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16" status: 200 len: 1345 microversion: 2.1 time: 0.207811 Sep 10 11:56:26.644685 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8168ed25-983d-4761-982b-101e471d918b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:26.645326 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8168ed25-983d-4761-982b-101e471d918b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:26.645552 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1916/3822] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:26 2022] GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16 => generated 1345 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:26.666390 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8168ed25-983d-4761-982b-101e471d918b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:26.667155 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8168ed25-983d-4761-982b-101e471d918b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:26.667802 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8168ed25-983d-4761-982b-101e471d918b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:26.669310 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8168ed25-983d-4761-982b-101e471d918b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:26.670018 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8168ed25-983d-4761-982b-101e471d918b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:26.670608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8168ed25-983d-4761-982b-101e471d918b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:26.738999 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-66008a42-2e6e-4caa-a3fe-776266b52858 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f407b4f3af0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:26.818307 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-66008a42-2e6e-4caa-a3fe-776266b52858 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474" status: 200 len: 1455 microversion: 2.1 time: 0.083014 Sep 10 11:56:26.819624 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1917/3823] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:56:26 2022] GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474 => generated 1455 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:56:27.001436 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8168ed25-983d-4761-982b-101e471d918b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:27.021422 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8168ed25-983d-4761-982b-101e471d918b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1499 microversion: 2.1 time: 0.384724 Sep 10 11:56:27.022581 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1907/3824] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:26 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1499 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:27.052048 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c7fbd3db-3fa7-4098-a804-8d779444dc34 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:56:27.054643 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c7fbd3db-3fa7-4098-a804-8d779444dc34 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:27.063381 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7fbd3db-3fa7-4098-a804-8d779444dc34 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:27.064155 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7fbd3db-3fa7-4098-a804-8d779444dc34 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:27.064777 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7fbd3db-3fa7-4098-a804-8d779444dc34 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:27.065803 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7fbd3db-3fa7-4098-a804-8d779444dc34 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:27.066416 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7fbd3db-3fa7-4098-a804-8d779444dc34 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:27.066998 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7fbd3db-3fa7-4098-a804-8d779444dc34 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:27.096300 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-c7fbd3db-3fa7-4098-a804-8d779444dc34 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lazy-loading 'flavor' on Instance uuid e327931f-dea2-4ee1-ab5a-db5566ea3607 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:56:27.266276 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c7fbd3db-3fa7-4098-a804-8d779444dc34 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "POST /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607/action" status: 200 len: 32 microversion: 2.1 time: 0.222779 Sep 10 11:56:27.267496 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1918/3825] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:56:27 2022] POST /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607/action => generated 32 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:56:27.278473 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-47934724-bf09-417d-b9b7-6731d6e8a3a0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:27.280032 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-47934724-bf09-417d-b9b7-6731d6e8a3a0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:27.295902 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-47934724-bf09-417d-b9b7-6731d6e8a3a0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:27.298176 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-47934724-bf09-417d-b9b7-6731d6e8a3a0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:27.298873 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-47934724-bf09-417d-b9b7-6731d6e8a3a0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:27.301342 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-47934724-bf09-417d-b9b7-6731d6e8a3a0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:27.303930 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-47934724-bf09-417d-b9b7-6731d6e8a3a0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:27.304703 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-47934724-bf09-417d-b9b7-6731d6e8a3a0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:27.454365 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8654ca59-7892-4797-ae66-a8e50d6c5076 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:27.456627 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8654ca59-7892-4797-ae66-a8e50d6c5076 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 51d91016-0b23-4d74-98b4-1c76652aacb5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:27.485982 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8654ca59-7892-4797-ae66-a8e50d6c5076 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:27.486804 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8654ca59-7892-4797-ae66-a8e50d6c5076 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:27.489677 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8654ca59-7892-4797-ae66-a8e50d6c5076 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:27.490825 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8654ca59-7892-4797-ae66-a8e50d6c5076 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:27.495025 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8654ca59-7892-4797-ae66-a8e50d6c5076 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:27.499885 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8654ca59-7892-4797-ae66-a8e50d6c5076 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:27.811888 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-47934724-bf09-417d-b9b7-6731d6e8a3a0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:27.829891 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-47934724-bf09-417d-b9b7-6731d6e8a3a0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1505 microversion: 2.1 time: 0.548726 Sep 10 11:56:27.831138 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1908/3826] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:27 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1505 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:27.838068 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b94247de-b473-4592-9576-afbd284f5c33 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:27.840488 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b94247de-b473-4592-9576-afbd284f5c33 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 9da5b114-2ad4-41f0-897f-d4e2984f5a16] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:27.855778 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b94247de-b473-4592-9576-afbd284f5c33 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:27.861194 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b94247de-b473-4592-9576-afbd284f5c33 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:27.861952 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b94247de-b473-4592-9576-afbd284f5c33 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:27.862876 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b94247de-b473-4592-9576-afbd284f5c33 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:27.863541 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b94247de-b473-4592-9576-afbd284f5c33 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:27.864863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b94247de-b473-4592-9576-afbd284f5c33 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:27.978912 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b94247de-b473-4592-9576-afbd284f5c33 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:27.988802 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8654ca59-7892-4797-ae66-a8e50d6c5076 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:28.004885 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b94247de-b473-4592-9576-afbd284f5c33 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16" status: 200 len: 1345 microversion: 2.1 time: 0.172426 Sep 10 11:56:28.005514 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8654ca59-7892-4797-ae66-a8e50d6c5076 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5" status: 200 len: 1510 microversion: 2.1 time: 0.549486 Sep 10 11:56:28.006327 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1919/3827] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:27 2022] GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5 => generated 1510 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:56:28.013820 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1909/3828] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:27 2022] GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16 => generated 1345 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:28.016705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d3f0c191-fc1e-469c-bc9d-2d7eba331c9a tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f407263e4c0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:28.088211 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d3f0c191-fc1e-469c-bc9d-2d7eba331c9a tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474" status: 200 len: 1455 microversion: 2.1 time: 0.080170 Sep 10 11:56:28.096695 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1920/3829] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:56:28 2022] GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474 => generated 1455 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:28.859988 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-71441a5c-5a93-44f5-a886-b7aa5b212e0f tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:28.862602 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-71441a5c-5a93-44f5-a886-b7aa5b212e0f tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:28.877284 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-71441a5c-5a93-44f5-a886-b7aa5b212e0f tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:28.884330 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-71441a5c-5a93-44f5-a886-b7aa5b212e0f tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:28.885232 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-71441a5c-5a93-44f5-a886-b7aa5b212e0f tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:28.886220 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-71441a5c-5a93-44f5-a886-b7aa5b212e0f tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:28.886847 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-71441a5c-5a93-44f5-a886-b7aa5b212e0f tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:28.887475 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-71441a5c-5a93-44f5-a886-b7aa5b212e0f tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:29.030999 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ba9bc319-de50-4e51-814f-7bbaf1908824 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:29.032530 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ba9bc319-de50-4e51-814f-7bbaf1908824 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 51d91016-0b23-4d74-98b4-1c76652aacb5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:29.043245 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba9bc319-de50-4e51-814f-7bbaf1908824 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:29.044110 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba9bc319-de50-4e51-814f-7bbaf1908824 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:29.045066 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba9bc319-de50-4e51-814f-7bbaf1908824 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:29.045980 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba9bc319-de50-4e51-814f-7bbaf1908824 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:29.046608 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba9bc319-de50-4e51-814f-7bbaf1908824 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:29.047247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba9bc319-de50-4e51-814f-7bbaf1908824 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:29.970946 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ba9bc319-de50-4e51-814f-7bbaf1908824 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:29.983823 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-71441a5c-5a93-44f5-a886-b7aa5b212e0f tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:30.016290 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ba9bc319-de50-4e51-814f-7bbaf1908824 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5" status: 200 len: 1510 microversion: 2.1 time: 0.990049 Sep 10 11:56:30.034111 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1921/3830] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:29 2022] GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5 => generated 1510 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:30.051587 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-71441a5c-5a93-44f5-a886-b7aa5b212e0f tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1505 microversion: 2.1 time: 1.197423 Sep 10 11:56:30.052799 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1910/3831] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:28 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1505 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:30.058203 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0e94ee5b-032d-4c9c-8271-42779b4ec8c9 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f40733e8ee0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:30.059332 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5c776764-c370-48d7-a3d6-2190c460df97 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:30.061956 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5c776764-c370-48d7-a3d6-2190c460df97 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 9da5b114-2ad4-41f0-897f-d4e2984f5a16] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:30.078797 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c776764-c370-48d7-a3d6-2190c460df97 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:30.079538 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c776764-c370-48d7-a3d6-2190c460df97 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:30.080188 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c776764-c370-48d7-a3d6-2190c460df97 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:30.081154 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c776764-c370-48d7-a3d6-2190c460df97 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:30.082525 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c776764-c370-48d7-a3d6-2190c460df97 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:30.083227 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c776764-c370-48d7-a3d6-2190c460df97 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:30.167480 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0e94ee5b-032d-4c9c-8271-42779b4ec8c9 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474" status: 200 len: 1455 microversion: 2.1 time: 0.112761 Sep 10 11:56:30.171245 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1911/3832] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:56:30 2022] GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474 => generated 1455 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:30.265173 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5c776764-c370-48d7-a3d6-2190c460df97 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:30.308995 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5c776764-c370-48d7-a3d6-2190c460df97 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16" status: 200 len: 1345 microversion: 2.1 time: 0.272751 Sep 10 11:56:30.312787 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1922/3833] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:30 2022] GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16 => generated 1345 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:31.053721 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ec86db8d-da54-43e2-bf6b-d1a2b473d6fc tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:31.054352 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ec86db8d-da54-43e2-bf6b-d1a2b473d6fc tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 51d91016-0b23-4d74-98b4-1c76652aacb5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:31.072345 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec86db8d-da54-43e2-bf6b-d1a2b473d6fc tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:31.076473 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec86db8d-da54-43e2-bf6b-d1a2b473d6fc tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:31.080799 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec86db8d-da54-43e2-bf6b-d1a2b473d6fc tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:31.081849 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec86db8d-da54-43e2-bf6b-d1a2b473d6fc tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:31.083141 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a4b715bc-6c73-4c71-88c1-9d75f5fb3baf tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:31.083794 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a4b715bc-6c73-4c71-88c1-9d75f5fb3baf tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:31.084594 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec86db8d-da54-43e2-bf6b-d1a2b473d6fc tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:31.087326 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec86db8d-da54-43e2-bf6b-d1a2b473d6fc tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:31.097913 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a4b715bc-6c73-4c71-88c1-9d75f5fb3baf tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:31.098615 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a4b715bc-6c73-4c71-88c1-9d75f5fb3baf tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:31.099395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a4b715bc-6c73-4c71-88c1-9d75f5fb3baf tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:31.108719 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a4b715bc-6c73-4c71-88c1-9d75f5fb3baf tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:31.109376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a4b715bc-6c73-4c71-88c1-9d75f5fb3baf tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:31.110001 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a4b715bc-6c73-4c71-88c1-9d75f5fb3baf tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:31.151827 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:56:31.786169 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ec86db8d-da54-43e2-bf6b-d1a2b473d6fc tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:31.799558 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ec86db8d-da54-43e2-bf6b-d1a2b473d6fc tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5" status: 200 len: 1516 microversion: 2.1 time: 0.751353 Sep 10 11:56:31.802224 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1912/3834] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:31 2022] GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5 => generated 1516 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:31.809904 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e32cdbb3-7f0e-45cc-9869-4f71b78518a0 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f40733e8c10>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:31.892419 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e32cdbb3-7f0e-45cc-9869-4f71b78518a0 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474" status: 200 len: 1455 microversion: 2.1 time: 0.088028 Sep 10 11:56:31.918162 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1913/3835] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:56:31 2022] GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474 => generated 1455 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:31.926453 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-81b319f1-66fa-4c52-b136-40af032ff01d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:31.927800 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-81b319f1-66fa-4c52-b136-40af032ff01d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 9da5b114-2ad4-41f0-897f-d4e2984f5a16] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:31.945086 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81b319f1-66fa-4c52-b136-40af032ff01d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:31.945652 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81b319f1-66fa-4c52-b136-40af032ff01d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:31.946534 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81b319f1-66fa-4c52-b136-40af032ff01d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:31.947438 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81b319f1-66fa-4c52-b136-40af032ff01d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:31.947805 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81b319f1-66fa-4c52-b136-40af032ff01d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:31.948316 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81b319f1-66fa-4c52-b136-40af032ff01d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:32.214284 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a4b715bc-6c73-4c71-88c1-9d75f5fb3baf tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:32.230579 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a4b715bc-6c73-4c71-88c1-9d75f5fb3baf tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1505 microversion: 2.1 time: 1.150456 Sep 10 11:56:32.231535 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1923/3836] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:31 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1505 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:32.331314 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-81b319f1-66fa-4c52-b136-40af032ff01d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:32.343883 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-81b319f1-66fa-4c52-b136-40af032ff01d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16" status: 200 len: 1345 microversion: 2.1 time: 0.429605 Sep 10 11:56:32.348495 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1914/3837] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:31 2022] GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16 => generated 1345 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:32.921476 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-58cfba90-5ab2-4926-bd66-1c10ff8d19b4 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f407263eca0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:32.998592 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-58cfba90-5ab2-4926-bd66-1c10ff8d19b4 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474" status: 200 len: 1455 microversion: 2.1 time: 0.081236 Sep 10 11:56:32.999340 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1924/3838] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:56:32 2022] GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474 => generated 1455 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:33.260752 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c0bd156e-2a86-4e36-81c0-d78b35c045ba tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:33.261755 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c0bd156e-2a86-4e36-81c0-d78b35c045ba tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:33.280558 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0bd156e-2a86-4e36-81c0-d78b35c045ba tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:33.281393 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0bd156e-2a86-4e36-81c0-d78b35c045ba tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:33.282020 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0bd156e-2a86-4e36-81c0-d78b35c045ba tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:33.283452 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0bd156e-2a86-4e36-81c0-d78b35c045ba tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:33.287619 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0bd156e-2a86-4e36-81c0-d78b35c045ba tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:33.288389 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0bd156e-2a86-4e36-81c0-d78b35c045ba tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:33.379058 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-56d4ed0d-dc0f-4279-9cd4-2224cc0b5bff tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:33.379845 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-56d4ed0d-dc0f-4279-9cd4-2224cc0b5bff tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 9da5b114-2ad4-41f0-897f-d4e2984f5a16] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:33.400836 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-56d4ed0d-dc0f-4279-9cd4-2224cc0b5bff tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:33.403714 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-56d4ed0d-dc0f-4279-9cd4-2224cc0b5bff tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:33.411431 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-56d4ed0d-dc0f-4279-9cd4-2224cc0b5bff tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:33.412482 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-56d4ed0d-dc0f-4279-9cd4-2224cc0b5bff tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:33.413065 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-56d4ed0d-dc0f-4279-9cd4-2224cc0b5bff tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:33.413626 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-56d4ed0d-dc0f-4279-9cd4-2224cc0b5bff tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:33.476289 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-56d4ed0d-dc0f-4279-9cd4-2224cc0b5bff tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:33.479194 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-56d4ed0d-dc0f-4279-9cd4-2224cc0b5bff tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:33.481974 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-56d4ed0d-dc0f-4279-9cd4-2224cc0b5bff tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:33.483352 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-56d4ed0d-dc0f-4279-9cd4-2224cc0b5bff tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lazy-loading 'fault' on Instance uuid 9da5b114-2ad4-41f0-897f-d4e2984f5a16 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:56:33.649439 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-56d4ed0d-dc0f-4279-9cd4-2224cc0b5bff tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:33.668554 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-56d4ed0d-dc0f-4279-9cd4-2224cc0b5bff tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16" status: 200 len: 1350 microversion: 2.1 time: 0.291083 Sep 10 11:56:33.671270 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1925/3839] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:33 2022] GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16 => generated 1350 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:56:33.754095 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c0bd156e-2a86-4e36-81c0-d78b35c045ba tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:33.772854 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c0bd156e-2a86-4e36-81c0-d78b35c045ba tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1505 microversion: 2.1 time: 0.515911 Sep 10 11:56:33.774817 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1915/3840] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:33 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1505 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:34.015425 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-73473118-cc20-4d5e-a64c-16dc182823d3 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f407263eca0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:34.090998 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-73473118-cc20-4d5e-a64c-16dc182823d3 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474" status: 200 len: 1455 microversion: 2.1 time: 0.079547 Sep 10 11:56:34.093212 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1926/3841] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:56:34 2022] GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474 => generated 1455 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:34.644337 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d14376b4-78b2-4d0c-9e66-77e002c16a9e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Action: 'create', calling method: .version_select at 0x7f407352f0d0>, body: {"keypair": {"name": "tempest-keypair-842044496", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBidLLyxo93ekV3ZFBD6rVKFsuazF24OaQeRIBytV/6dgQGU+En3iuEWfolJOJLsZHwtGX+UOTTgFmtHnCXLBrIWLkMqxsk0ypjAtEkhGKhfObPmcp6l79tAIrugs3IkvQ=="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:56:34.679605 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-d14376b4-78b2-4d0c-9e66-77e002c16a9e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Getting quotas for project 8e8bc2c6ea1946bfbbf47d63b5fa4648. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:56:34.699628 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1b03a722-a6bb-4648-b392-952330060c73 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:34.700805 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1b03a722-a6bb-4648-b392-952330060c73 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 9da5b114-2ad4-41f0-897f-d4e2984f5a16] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:34.717105 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-d14376b4-78b2-4d0c-9e66-77e002c16a9e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Getting quotas for user bddddbd6718f472e951fd87a6ec00f8d and project 8e8bc2c6ea1946bfbbf47d63b5fa4648. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:56:34.722762 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b03a722-a6bb-4648-b392-952330060c73 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:34.726404 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b03a722-a6bb-4648-b392-952330060c73 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:34.726921 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b03a722-a6bb-4648-b392-952330060c73 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:34.727696 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b03a722-a6bb-4648-b392-952330060c73 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:34.728170 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b03a722-a6bb-4648-b392-952330060c73 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:34.728601 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b03a722-a6bb-4648-b392-952330060c73 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:34.772318 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-1b03a722-a6bb-4648-b392-952330060c73 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] HTTP exception thrown: Instance 9da5b114-2ad4-41f0-897f-d4e2984f5a16 could not be found. Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1b03a722-a6bb-4648-b392-952330060c73 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Request method failure captured: Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16 HTTP/1.1 Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHsd-AnnLZFS6-Lbfr9ATef_4cX6EE0Up-a_Ch8dobncDUqljTHX0YcK7WbJaaBcAlN6twvlZe9au1SNJQwC5-nItcb7pEhHjqWyH9GhqCmgS3jEbfUY8st6zk2hVKWMOxRl1E1nEdlCzWIcW0YZf7xPnP7IvCJy_UgVMW4-UpTlv4M Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2f92ad05650840f6bb4c8f6134b489ca", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-DeleteServersTestJSON-419044733 Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-DeleteServersTestJSON-419044733-project Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: d244789bea974bd99d0f1debebabb54a Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-DeleteServersTestJSON-419044733-project Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 9da5b114-2ad4-41f0-897f-d4e2984f5a16 could not be found. Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '9da5b114-2ad4-41f0-897f-d4e2984f5a16'} Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9da5b114-2ad4-41f0-897f-d4e2984f5a16 could not be found. Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9da5b114-2ad4-41f0-897f-d4e2984f5a16 could not be found. Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:56:34.777540 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:56:34.783577 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:56:34.783577 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:56:34.783577 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:56:34.783577 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:56:34.783577 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:56:34.783577 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9da5b114-2ad4-41f0-897f-d4e2984f5a16 could not be found. Sep 10 11:56:34.783577 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:56:34.786896 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1b03a722-a6bb-4648-b392-952330060c73 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Returning 404 to user: Instance 9da5b114-2ad4-41f0-897f-d4e2984f5a16 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:56:34.790899 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d14376b4-78b2-4d0c-9e66-77e002c16a9e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.152516 Sep 10 11:56:34.794566 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1b03a722-a6bb-4648-b392-952330060c73 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16" status: 404 len: 111 microversion: 2.1 time: 0.094895 Sep 10 11:56:34.799343 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1927/3842] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:34 2022] GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 11:56:34.801050 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1916/3843] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 11:56:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:56:34.806614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6bfaa373-3cbd-456e-b768-8d7fd3ef7bc8 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:34.807516 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6bfaa373-3cbd-456e-b768-8d7fd3ef7bc8 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:34.811093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=100 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:56:34.828569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6bfaa373-3cbd-456e-b768-8d7fd3ef7bc8 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:34.829060 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6bfaa373-3cbd-456e-b768-8d7fd3ef7bc8 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:34.835688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6bfaa373-3cbd-456e-b768-8d7fd3ef7bc8 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:34.836495 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6bfaa373-3cbd-456e-b768-8d7fd3ef7bc8 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:34.836971 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6bfaa373-3cbd-456e-b768-8d7fd3ef7bc8 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:34.837571 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6bfaa373-3cbd-456e-b768-8d7fd3ef7bc8 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:35.050827 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e4bea631-7379-4ef6-a598-e306424095b4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:35.053863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e4bea631-7379-4ef6-a598-e306424095b4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 9da5b114-2ad4-41f0-897f-d4e2984f5a16] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:35.062414 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4bea631-7379-4ef6-a598-e306424095b4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:35.063408 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4bea631-7379-4ef6-a598-e306424095b4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:35.064015 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4bea631-7379-4ef6-a598-e306424095b4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:35.064918 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4bea631-7379-4ef6-a598-e306424095b4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:35.065543 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4bea631-7379-4ef6-a598-e306424095b4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:35.066137 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4bea631-7379-4ef6-a598-e306424095b4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:35.084116 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-e4bea631-7379-4ef6-a598-e306424095b4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] HTTP exception thrown: Instance 9da5b114-2ad4-41f0-897f-d4e2984f5a16 could not be found. Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e4bea631-7379-4ef6-a598-e306424095b4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Request method failure captured: Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16/os-volume_attachments HTTP/1.1 Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHsd-AnnLZFS6-Lbfr9ATef_4cX6EE0Up-a_Ch8dobncDUqljTHX0YcK7WbJaaBcAlN6twvlZe9au1SNJQwC5-nItcb7pEhHjqWyH9GhqCmgS3jEbfUY8st6zk2hVKWMOxRl1E1nEdlCzWIcW0YZf7xPnP7IvCJy_UgVMW4-UpTlv4M Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2f92ad05650840f6bb4c8f6134b489ca", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-DeleteServersTestJSON-419044733 Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-DeleteServersTestJSON-419044733-project Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: d244789bea974bd99d0f1debebabb54a Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-DeleteServersTestJSON-419044733-project Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 9da5b114-2ad4-41f0-897f-d4e2984f5a16 could not be found. Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'server_id': '9da5b114-2ad4-41f0-897f-d4e2984f5a16'} Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9da5b114-2ad4-41f0-897f-d4e2984f5a16 could not be found. Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:56:35.086691 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:56:35.091597 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9da5b114-2ad4-41f0-897f-d4e2984f5a16 could not be found. Sep 10 11:56:35.091597 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:56:35.091597 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:56:35.091597 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:56:35.091597 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:56:35.091597 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:56:35.091597 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:56:35.091597 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:56:35.091597 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:56:35.091597 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9da5b114-2ad4-41f0-897f-d4e2984f5a16 could not be found. Sep 10 11:56:35.091597 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:56:35.095199 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e4bea631-7379-4ef6-a598-e306424095b4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Returning 404 to user: Instance 9da5b114-2ad4-41f0-897f-d4e2984f5a16 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:56:35.096419 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e4bea631-7379-4ef6-a598-e306424095b4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.053036 Sep 10 11:56:35.097511 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1917/3844] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 11:56:35 2022] GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16/os-volume_attachments => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 11:56:35.138869 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0a5e8045-9311-42cd-b1d6-431483956336 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f40733f6700>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:35.220234 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0a5e8045-9311-42cd-b1d6-431483956336 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474" status: 200 len: 1455 microversion: 2.1 time: 0.103813 Sep 10 11:56:35.228709 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1918/3845] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:56:35 2022] GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474 => generated 1455 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:35.311747 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6bfaa373-3cbd-456e-b768-8d7fd3ef7bc8 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:35.327808 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6bfaa373-3cbd-456e-b768-8d7fd3ef7bc8 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1505 microversion: 2.1 time: 0.527160 Sep 10 11:56:35.328812 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1928/3846] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:34 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1505 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:35.397340 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7b0b2852-70c2-451a-9929-c6dff470f993 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1120895999", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "471bef66-289e-44bc-a38f-0fbd7758b454"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:56:35.497691 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-7b0b2852-70c2-451a-9929-c6dff470f993 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] validate_networks() for [('471bef66-289e-44bc-a38f-0fbd7758b454', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:56:36.247396 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2e7bfcb3-bfc8-4f01-b92e-6c3ef586b751 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4072425670>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:36.315463 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2e7bfcb3-bfc8-4f01-b92e-6c3ef586b751 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474" status: 200 len: 1455 microversion: 2.1 time: 0.073944 Sep 10 11:56:36.324610 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1929/3847] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:56:36 2022] GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474 => generated 1455 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:36.356891 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-881b67a0-aa6b-4a19-adfa-744facaffc72 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:36.359457 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-881b67a0-aa6b-4a19-adfa-744facaffc72 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:36.367855 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-881b67a0-aa6b-4a19-adfa-744facaffc72 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:36.368643 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-881b67a0-aa6b-4a19-adfa-744facaffc72 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:36.369308 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-881b67a0-aa6b-4a19-adfa-744facaffc72 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:36.370335 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-881b67a0-aa6b-4a19-adfa-744facaffc72 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:36.371024 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-881b67a0-aa6b-4a19-adfa-744facaffc72 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:36.371714 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-881b67a0-aa6b-4a19-adfa-744facaffc72 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:36.841491 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-881b67a0-aa6b-4a19-adfa-744facaffc72 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:36.854836 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-881b67a0-aa6b-4a19-adfa-744facaffc72 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1505 microversion: 2.1 time: 0.500172 Sep 10 11:56:36.874276 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1930/3848] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:36 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1505 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:56:36.910522 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-7b0b2852-70c2-451a-9929-c6dff470f993 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:56:36.911701 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-7b0b2852-70c2-451a-9929-c6dff470f993 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:56:36.912548 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-7b0b2852-70c2-451a-9929-c6dff470f993 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:56:36.913267 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-7b0b2852-70c2-451a-9929-c6dff470f993 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:56:36.913963 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-7b0b2852-70c2-451a-9929-c6dff470f993 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:56:36.937034 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7b0b2852-70c2-451a-9929-c6dff470f993 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:36.939517 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7b0b2852-70c2-451a-9929-c6dff470f993 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:36.941908 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7b0b2852-70c2-451a-9929-c6dff470f993 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:36.943662 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7b0b2852-70c2-451a-9929-c6dff470f993 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:36.944355 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7b0b2852-70c2-451a-9929-c6dff470f993 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:36.945864 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7b0b2852-70c2-451a-9929-c6dff470f993 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:36.981053 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-7b0b2852-70c2-451a-9929-c6dff470f993 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Getting quotas for project 2f92ad05650840f6bb4c8f6134b489ca. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:56:36.990137 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-7b0b2852-70c2-451a-9929-c6dff470f993 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Getting quotas for user d244789bea974bd99d0f1debebabb54a and project 2f92ad05650840f6bb4c8f6134b489ca. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:56:37.016404 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7b0b2852-70c2-451a-9929-c6dff470f993 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:56:37.020064 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7b0b2852-70c2-451a-9929-c6dff470f993 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 5ec4b140-3d97-40f1-a497-1868e5eb56a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:56:37.111699 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7b0b2852-70c2-451a-9929-c6dff470f993 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.718170 Sep 10 11:56:37.118889 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1919/3849] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:56:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:56:37.150831 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f547b1e9-64b2-448b-a9a3-00bfe737f0c2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:37.151725 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f547b1e9-64b2-448b-a9a3-00bfe737f0c2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 5ec4b140-3d97-40f1-a497-1868e5eb56a5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:37.319825 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f547b1e9-64b2-448b-a9a3-00bfe737f0c2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:37.330886 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6b7c72ab-6e96-4183-bfb8-f1ed425bb6e4 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4073bac430>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:37.332557 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f547b1e9-64b2-448b-a9a3-00bfe737f0c2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/5ec4b140-3d97-40f1-a497-1868e5eb56a5" status: 200 len: 1215 microversion: 2.1 time: 0.209264 Sep 10 11:56:37.334493 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1931/3850] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:37 2022] GET /compute/v2.1/servers/5ec4b140-3d97-40f1-a497-1868e5eb56a5 => generated 1215 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:37.380034 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-28af1309-c1b7-489d-bebe-d908103c309a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:37.380944 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-28af1309-c1b7-489d-bebe-d908103c309a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 5ec4b140-3d97-40f1-a497-1868e5eb56a5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:37.494614 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6b7c72ab-6e96-4183-bfb8-f1ed425bb6e4 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474" status: 200 len: 1455 microversion: 2.1 time: 0.167510 Sep 10 11:56:37.495829 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1920/3851] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:56:37 2022] GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474 => generated 1455 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:56:37.505001 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-28af1309-c1b7-489d-bebe-d908103c309a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 5ec4b140-3d97-40f1-a497-1868e5eb56a5] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:56:37.882231 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7a6ac3e3-df73-4b4f-b4c7-eecee264c633 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:37.883240 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7a6ac3e3-df73-4b4f-b4c7-eecee264c633 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:37.897462 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a6ac3e3-df73-4b4f-b4c7-eecee264c633 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:37.898426 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a6ac3e3-df73-4b4f-b4c7-eecee264c633 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:37.899091 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a6ac3e3-df73-4b4f-b4c7-eecee264c633 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:37.900157 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a6ac3e3-df73-4b4f-b4c7-eecee264c633 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:37.904092 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a6ac3e3-df73-4b4f-b4c7-eecee264c633 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:37.904984 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a6ac3e3-df73-4b4f-b4c7-eecee264c633 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:38.189356 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.scheduler.client.report [None req-28af1309-c1b7-489d-bebe-d908103c309a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Deleted allocations for instance 5ec4b140-3d97-40f1-a497-1868e5eb56a5 Sep 10 11:56:38.199871 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.compute.api [None req-28af1309-c1b7-489d-bebe-d908103c309a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 5ec4b140-3d97-40f1-a497-1868e5eb56a5] Instance Mapping does not exist while attempting local delete cleanup. Sep 10 11:56:38.201006 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-28af1309-c1b7-489d-bebe-d908103c309a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5ec4b140-3d97-40f1-a497-1868e5eb56a5" status: 204 len: 0 microversion: 2.1 time: 0.846946 Sep 10 11:56:38.204741 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1932/3852] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:56:37 2022] DELETE /compute/v2.1/servers/5ec4b140-3d97-40f1-a497-1868e5eb56a5 => generated 0 bytes in 851 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 11:56:38.218919 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-36ee4ba7-9958-4c16-906e-09acded70f88 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1778369062", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1fac80b7-ed82-4841-b3a7-f53280be67c1"}], "security_groups": [{"name": "tempest-securitygroup--1010248216"}], "key_name": "tempest-keypair-842044496", "user_data": "}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:56:38.221827 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7a6ac3e3-df73-4b4f-b4c7-eecee264c633 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:38.243138 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7a6ac3e3-df73-4b4f-b4c7-eecee264c633 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1505 microversion: 2.1 time: 0.365640 Sep 10 11:56:38.250783 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1921/3853] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:37 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1505 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:38.259938 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-388ed7f5-bac6-458a-b67f-3a610e5e70b3 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:38.261657 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-388ed7f5-bac6-458a-b67f-3a610e5e70b3 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 5ec4b140-3d97-40f1-a497-1868e5eb56a5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:38.273258 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-388ed7f5-bac6-458a-b67f-3a610e5e70b3 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] HTTP exception thrown: Instance 5ec4b140-3d97-40f1-a497-1868e5eb56a5 could not be found. Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-388ed7f5-bac6-458a-b67f-3a610e5e70b3 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Request method failure captured: Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/5ec4b140-3d97-40f1-a497-1868e5eb56a5 HTTP/1.1 Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHsd-AnnLZFS6-Lbfr9ATef_4cX6EE0Up-a_Ch8dobncDUqljTHX0YcK7WbJaaBcAlN6twvlZe9au1SNJQwC5-nItcb7pEhHjqWyH9GhqCmgS3jEbfUY8st6zk2hVKWMOxRl1E1nEdlCzWIcW0YZf7xPnP7IvCJy_UgVMW4-UpTlv4M Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2f92ad05650840f6bb4c8f6134b489ca", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-DeleteServersTestJSON-419044733 Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-DeleteServersTestJSON-419044733-project Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: d244789bea974bd99d0f1debebabb54a Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-DeleteServersTestJSON-419044733-project Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 5ec4b140-3d97-40f1-a497-1868e5eb56a5 could not be found. Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '5ec4b140-3d97-40f1-a497-1868e5eb56a5'} Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ec4b140-3d97-40f1-a497-1868e5eb56a5 could not be found. Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ec4b140-3d97-40f1-a497-1868e5eb56a5 could not be found. Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:56:38.274842 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:56:38.278485 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:56:38.278485 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:56:38.278485 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:56:38.278485 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ec4b140-3d97-40f1-a497-1868e5eb56a5 could not be found. Sep 10 11:56:38.278485 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:56:38.281222 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-388ed7f5-bac6-458a-b67f-3a610e5e70b3 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Returning 404 to user: Instance 5ec4b140-3d97-40f1-a497-1868e5eb56a5 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:56:38.282881 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-388ed7f5-bac6-458a-b67f-3a610e5e70b3 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/5ec4b140-3d97-40f1-a497-1868e5eb56a5" status: 404 len: 111 microversion: 2.1 time: 0.030346 Sep 10 11:56:38.283799 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1922/3854] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:38 2022] GET /compute/v2.1/servers/5ec4b140-3d97-40f1-a497-1868e5eb56a5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:56:38.452739 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-36ee4ba7-9958-4c16-906e-09acded70f88 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] validate_networks() for [('1fac80b7-ed82-4841-b3a7-f53280be67c1', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:56:38.478023 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fe736df9-4a7c-4a63-90f2-129809697a67 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1266150060", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "471bef66-289e-44bc-a38f-0fbd7758b454"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:56:38.578837 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-fe736df9-4a7c-4a63-90f2-129809697a67 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] validate_networks() for [('471bef66-289e-44bc-a38f-0fbd7758b454', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:56:39.904904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-36ee4ba7-9958-4c16-906e-09acded70f88 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:56:39.905406 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-36ee4ba7-9958-4c16-906e-09acded70f88 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:56:39.905930 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-36ee4ba7-9958-4c16-906e-09acded70f88 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:56:39.906348 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-36ee4ba7-9958-4c16-906e-09acded70f88 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:56:39.906763 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-36ee4ba7-9958-4c16-906e-09acded70f88 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:56:39.928112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36ee4ba7-9958-4c16-906e-09acded70f88 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:39.929641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36ee4ba7-9958-4c16-906e-09acded70f88 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:39.934105 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36ee4ba7-9958-4c16-906e-09acded70f88 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:39.936096 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36ee4ba7-9958-4c16-906e-09acded70f88 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:39.938090 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36ee4ba7-9958-4c16-906e-09acded70f88 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:39.940006 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36ee4ba7-9958-4c16-906e-09acded70f88 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:39.994239 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-36ee4ba7-9958-4c16-906e-09acded70f88 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Getting quotas for project 8e8bc2c6ea1946bfbbf47d63b5fa4648. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:56:40.004446 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-36ee4ba7-9958-4c16-906e-09acded70f88 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Getting quotas for user bddddbd6718f472e951fd87a6ec00f8d and project 8e8bc2c6ea1946bfbbf47d63b5fa4648. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:56:40.041357 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-36ee4ba7-9958-4c16-906e-09acded70f88 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:56:40.045493 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-36ee4ba7-9958-4c16-906e-09acded70f88 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:56:40.101775 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-fe736df9-4a7c-4a63-90f2-129809697a67 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:56:40.102273 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-fe736df9-4a7c-4a63-90f2-129809697a67 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:56:40.102722 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-fe736df9-4a7c-4a63-90f2-129809697a67 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:56:40.103429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-fe736df9-4a7c-4a63-90f2-129809697a67 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:56:40.103864 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-fe736df9-4a7c-4a63-90f2-129809697a67 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:56:40.126092 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe736df9-4a7c-4a63-90f2-129809697a67 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:40.127124 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe736df9-4a7c-4a63-90f2-129809697a67 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:40.127907 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe736df9-4a7c-4a63-90f2-129809697a67 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:40.130996 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe736df9-4a7c-4a63-90f2-129809697a67 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:40.131713 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe736df9-4a7c-4a63-90f2-129809697a67 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:40.132153 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe736df9-4a7c-4a63-90f2-129809697a67 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:40.137079 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-36ee4ba7-9958-4c16-906e-09acded70f88 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.930828 Sep 10 11:56:40.145842 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1933/3855] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:56:38 2022] POST /compute/v2.1/servers => generated 409 bytes in 1940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:56:40.151918 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-689be06e-b9b8-49be-a703-4c67b72e322e tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f407b4f3940>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:40.215215 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-fe736df9-4a7c-4a63-90f2-129809697a67 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Getting quotas for project 2f92ad05650840f6bb4c8f6134b489ca. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:56:40.221986 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-fe736df9-4a7c-4a63-90f2-129809697a67 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Getting quotas for user d244789bea974bd99d0f1debebabb54a and project 2f92ad05650840f6bb4c8f6134b489ca. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:56:40.225312 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-689be06e-b9b8-49be-a703-4c67b72e322e tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474" status: 200 len: 1455 microversion: 2.1 time: 0.078171 Sep 10 11:56:40.237071 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1934/3856] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:56:40 2022] GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474 => generated 1455 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:40.245191 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fe736df9-4a7c-4a63-90f2-129809697a67 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:56:40.246978 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-55053d00-9342-4849-820b-61a98f0531ca tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:40.247731 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-55053d00-9342-4849-820b-61a98f0531ca tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:40.248452 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fe736df9-4a7c-4a63-90f2-129809697a67 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 476ea519-5dea-4143-93b7-46458d92bab3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:56:40.264951 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-55053d00-9342-4849-820b-61a98f0531ca tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:40.265614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-55053d00-9342-4849-820b-61a98f0531ca tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:40.266309 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-55053d00-9342-4849-820b-61a98f0531ca tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:40.267595 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-55053d00-9342-4849-820b-61a98f0531ca tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:40.268292 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-55053d00-9342-4849-820b-61a98f0531ca tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:40.268930 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-55053d00-9342-4849-820b-61a98f0531ca tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:40.325703 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fe736df9-4a7c-4a63-90f2-129809697a67 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.853442 Sep 10 11:56:40.332112 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1923/3857] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:56:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:56:40.332112 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7ab7a472-309d-45bf-ad4d-2312a19b06c1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:40.332112 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7ab7a472-309d-45bf-ad4d-2312a19b06c1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:40.527641 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7ab7a472-309d-45bf-ad4d-2312a19b06c1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:40.535210 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7ab7a472-309d-45bf-ad4d-2312a19b06c1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4" status: 200 len: 1245 microversion: 2.1 time: 0.207542 Sep 10 11:56:40.535809 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1924/3858] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:40 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 => generated 1245 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:40.556999 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dcded333-5a8c-4c93-9b1d-54e8bc94109b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:40.557774 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-dcded333-5a8c-4c93-9b1d-54e8bc94109b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 476ea519-5dea-4143-93b7-46458d92bab3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:40.829932 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-dcded333-5a8c-4c93-9b1d-54e8bc94109b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:40.837591 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-dcded333-5a8c-4c93-9b1d-54e8bc94109b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3" status: 200 len: 1215 microversion: 2.1 time: 0.300758 Sep 10 11:56:40.841282 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1925/3859] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:40 2022] GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3 => generated 1215 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:40.877083 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-55053d00-9342-4849-820b-61a98f0531ca tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:40.890654 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-55053d00-9342-4849-820b-61a98f0531ca tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1505 microversion: 2.1 time: 0.652217 Sep 10 11:56:40.898733 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1935/3860] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:40 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1505 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:41.243676 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2870f5c1-fc51-4e51-bc18-bb461ee5d0c6 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f40736ff5e0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:41.343752 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2870f5c1-fc51-4e51-bc18-bb461ee5d0c6 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474" status: 200 len: 1455 microversion: 2.1 time: 0.103483 Sep 10 11:56:41.345313 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1926/3861] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:56:41 2022] GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474 => generated 1455 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:56:41.558440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3a4f0c09-0648-4dff-8efb-3cc4b5940047 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:41.559822 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3a4f0c09-0648-4dff-8efb-3cc4b5940047 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:41.576552 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a4f0c09-0648-4dff-8efb-3cc4b5940047 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:41.579704 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a4f0c09-0648-4dff-8efb-3cc4b5940047 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:41.580950 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a4f0c09-0648-4dff-8efb-3cc4b5940047 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:41.581973 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a4f0c09-0648-4dff-8efb-3cc4b5940047 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:41.583618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a4f0c09-0648-4dff-8efb-3cc4b5940047 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:41.588098 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a4f0c09-0648-4dff-8efb-3cc4b5940047 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:41.789884 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3a4f0c09-0648-4dff-8efb-3cc4b5940047 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:41.803636 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3a4f0c09-0648-4dff-8efb-3cc4b5940047 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4" status: 200 len: 1241 microversion: 2.1 time: 0.245323 Sep 10 11:56:41.814035 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1936/3862] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:41 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 => generated 1241 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:41.863055 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2f21d14b-467e-4246-97ff-ab4df36eab07 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:41.865432 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2f21d14b-467e-4246-97ff-ab4df36eab07 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 476ea519-5dea-4143-93b7-46458d92bab3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:41.886931 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f21d14b-467e-4246-97ff-ab4df36eab07 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:41.890525 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f21d14b-467e-4246-97ff-ab4df36eab07 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:41.895105 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f21d14b-467e-4246-97ff-ab4df36eab07 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:41.896769 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f21d14b-467e-4246-97ff-ab4df36eab07 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:41.902065 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f21d14b-467e-4246-97ff-ab4df36eab07 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:41.904401 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f21d14b-467e-4246-97ff-ab4df36eab07 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:41.928223 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2eeb1040-202e-4909-836b-d1937e0ca592 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:41.929461 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2eeb1040-202e-4909-836b-d1937e0ca592 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:41.949342 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2eeb1040-202e-4909-836b-d1937e0ca592 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:41.956013 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2eeb1040-202e-4909-836b-d1937e0ca592 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:41.960744 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2eeb1040-202e-4909-836b-d1937e0ca592 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:41.962076 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2eeb1040-202e-4909-836b-d1937e0ca592 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:41.964240 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2eeb1040-202e-4909-836b-d1937e0ca592 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:41.964964 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2eeb1040-202e-4909-836b-d1937e0ca592 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:42.087767 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2f21d14b-467e-4246-97ff-ab4df36eab07 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:42.108614 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2f21d14b-467e-4246-97ff-ab4df36eab07 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3" status: 200 len: 1211 microversion: 2.1 time: 0.251175 Sep 10 11:56:42.110607 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1927/3863] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:41 2022] GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3 => generated 1211 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:42.332470 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2eeb1040-202e-4909-836b-d1937e0ca592 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:42.347057 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2eeb1040-202e-4909-836b-d1937e0ca592 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1505 microversion: 2.1 time: 0.425860 Sep 10 11:56:42.348229 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1937/3864] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:41 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1505 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:56:42.364631 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-36bc70cc-fc9f-434d-a2c0-7f4bc7ec324a tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f40733cb670>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:42.445724 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-36bc70cc-fc9f-434d-a2c0-7f4bc7ec324a tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474" status: 200 len: 1455 microversion: 2.1 time: 0.088388 Sep 10 11:56:42.446603 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1928/3865] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:56:42 2022] GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474 => generated 1455 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:42.831316 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-40198d71-19da-4aa4-b4bc-883d20540e2e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:42.832603 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-40198d71-19da-4aa4-b4bc-883d20540e2e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:42.851440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40198d71-19da-4aa4-b4bc-883d20540e2e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:42.853902 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40198d71-19da-4aa4-b4bc-883d20540e2e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:42.854798 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40198d71-19da-4aa4-b4bc-883d20540e2e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:42.858951 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40198d71-19da-4aa4-b4bc-883d20540e2e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:42.860094 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40198d71-19da-4aa4-b4bc-883d20540e2e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:42.861832 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40198d71-19da-4aa4-b4bc-883d20540e2e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:43.123415 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-40198d71-19da-4aa4-b4bc-883d20540e2e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:43.136237 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-40198d71-19da-4aa4-b4bc-883d20540e2e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4" status: 200 len: 1305 microversion: 2.1 time: 0.306128 Sep 10 11:56:43.156278 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-55b922d9-8a15-4d63-8741-9643e879a0bf tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:43.156278 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-55b922d9-8a15-4d63-8741-9643e879a0bf tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 476ea519-5dea-4143-93b7-46458d92bab3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:43.156775 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1938/3866] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:42 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 => generated 1305 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:43.169625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55b922d9-8a15-4d63-8741-9643e879a0bf tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:43.178129 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55b922d9-8a15-4d63-8741-9643e879a0bf tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:43.181706 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55b922d9-8a15-4d63-8741-9643e879a0bf tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:43.182549 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55b922d9-8a15-4d63-8741-9643e879a0bf tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:43.183047 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55b922d9-8a15-4d63-8741-9643e879a0bf tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:43.184101 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55b922d9-8a15-4d63-8741-9643e879a0bf tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:43.377897 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a8db6b98-b042-4448-b4f8-4d18c8cbf092 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:43.379148 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a8db6b98-b042-4448-b4f8-4d18c8cbf092 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:43.391003 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a8db6b98-b042-4448-b4f8-4d18c8cbf092 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:43.391743 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a8db6b98-b042-4448-b4f8-4d18c8cbf092 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:43.392242 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a8db6b98-b042-4448-b4f8-4d18c8cbf092 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:43.393995 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a8db6b98-b042-4448-b4f8-4d18c8cbf092 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:43.394615 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a8db6b98-b042-4448-b4f8-4d18c8cbf092 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:43.398093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a8db6b98-b042-4448-b4f8-4d18c8cbf092 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:43.509528 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-55b922d9-8a15-4d63-8741-9643e879a0bf tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:43.518647 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-55b922d9-8a15-4d63-8741-9643e879a0bf tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3" status: 200 len: 1267 microversion: 2.1 time: 0.388489 Sep 10 11:56:43.523697 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1929/3867] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:43 2022] GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3 => generated 1267 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:43.536225 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6237390c-8970-4f0a-a70c-67471fa9e58d tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4072cabd30>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:43.617232 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6237390c-8970-4f0a-a70c-67471fa9e58d tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474" status: 200 len: 1455 microversion: 2.1 time: 0.092096 Sep 10 11:56:43.618481 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1930/3868] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:56:43 2022] GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474 => generated 1455 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:43.744971 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a8db6b98-b042-4448-b4f8-4d18c8cbf092 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:43.753752 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a8db6b98-b042-4448-b4f8-4d18c8cbf092 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1505 microversion: 2.1 time: 0.380394 Sep 10 11:56:43.757345 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1939/3869] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:43 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1505 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:56:44.163552 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6fa04510-d2ee-4ff5-b63f-83fc8b5c5869 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:44.164187 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6fa04510-d2ee-4ff5-b63f-83fc8b5c5869 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:44.167031 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:56:44.202995 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6fa04510-d2ee-4ff5-b63f-83fc8b5c5869 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:44.205843 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6fa04510-d2ee-4ff5-b63f-83fc8b5c5869 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:44.206534 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6fa04510-d2ee-4ff5-b63f-83fc8b5c5869 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:44.207482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6fa04510-d2ee-4ff5-b63f-83fc8b5c5869 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:44.210419 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6fa04510-d2ee-4ff5-b63f-83fc8b5c5869 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:44.211105 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6fa04510-d2ee-4ff5-b63f-83fc8b5c5869 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:44.430658 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6fa04510-d2ee-4ff5-b63f-83fc8b5c5869 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:44.443297 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6fa04510-d2ee-4ff5-b63f-83fc8b5c5869 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4" status: 200 len: 1303 microversion: 2.1 time: 0.284291 Sep 10 11:56:44.448957 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1931/3870] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:44 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 => generated 1303 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:44.545258 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cdfa1d49-9330-4a06-9025-bac720d17977 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:44.545877 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cdfa1d49-9330-4a06-9025-bac720d17977 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 476ea519-5dea-4143-93b7-46458d92bab3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:44.555293 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cdfa1d49-9330-4a06-9025-bac720d17977 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:44.556286 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cdfa1d49-9330-4a06-9025-bac720d17977 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:44.557536 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cdfa1d49-9330-4a06-9025-bac720d17977 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:44.558486 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cdfa1d49-9330-4a06-9025-bac720d17977 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:44.559247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cdfa1d49-9330-4a06-9025-bac720d17977 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:44.570574 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cdfa1d49-9330-4a06-9025-bac720d17977 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:44.633290 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c5de4e0c-3fd3-407d-8aa5-0036016936a7 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f40734e88b0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:44.723490 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c5de4e0c-3fd3-407d-8aa5-0036016936a7 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474" status: 200 len: 1455 microversion: 2.1 time: 0.093965 Sep 10 11:56:44.724342 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1932/3871] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:56:44 2022] GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474 => generated 1455 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:56:44.781923 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8a2dadf1-1501-434e-913d-2c9d90f3a1d0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:44.782838 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8a2dadf1-1501-434e-913d-2c9d90f3a1d0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:44.799308 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a2dadf1-1501-434e-913d-2c9d90f3a1d0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:44.800005 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a2dadf1-1501-434e-913d-2c9d90f3a1d0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:44.800625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a2dadf1-1501-434e-913d-2c9d90f3a1d0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:44.801502 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a2dadf1-1501-434e-913d-2c9d90f3a1d0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:44.802119 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a2dadf1-1501-434e-913d-2c9d90f3a1d0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:44.802707 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a2dadf1-1501-434e-913d-2c9d90f3a1d0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:45.011468 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cdfa1d49-9330-4a06-9025-bac720d17977 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:45.023866 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cdfa1d49-9330-4a06-9025-bac720d17977 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3" status: 200 len: 1273 microversion: 2.1 time: 0.482600 Sep 10 11:56:45.028056 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1940/3872] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:44 2022] GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3 => generated 1273 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:45.137906 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8a2dadf1-1501-434e-913d-2c9d90f3a1d0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:45.151412 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8a2dadf1-1501-434e-913d-2c9d90f3a1d0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1505 microversion: 2.1 time: 0.372985 Sep 10 11:56:45.156623 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1933/3873] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:44 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1505 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:45.474506 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-72e7e309-1de8-4ae8-ad39-faba8ca28a57 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:45.475546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-72e7e309-1de8-4ae8-ad39-faba8ca28a57 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:45.487897 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-72e7e309-1de8-4ae8-ad39-faba8ca28a57 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:45.489419 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-72e7e309-1de8-4ae8-ad39-faba8ca28a57 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:45.490118 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-72e7e309-1de8-4ae8-ad39-faba8ca28a57 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:45.491933 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-72e7e309-1de8-4ae8-ad39-faba8ca28a57 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:45.494146 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-72e7e309-1de8-4ae8-ad39-faba8ca28a57 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:45.495053 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-72e7e309-1de8-4ae8-ad39-faba8ca28a57 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:45.715873 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-72e7e309-1de8-4ae8-ad39-faba8ca28a57 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:45.734230 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-72e7e309-1de8-4ae8-ad39-faba8ca28a57 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4" status: 200 len: 1303 microversion: 2.1 time: 0.264138 Sep 10 11:56:45.744433 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f0aa1c5f-34a5-4d39-9962-d43f3d44b7ba tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f40733e8c10>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:45.756731 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1941/3874] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:45 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 => generated 1303 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:45.844958 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f0aa1c5f-34a5-4d39-9962-d43f3d44b7ba tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474" status: 200 len: 1455 microversion: 2.1 time: 0.107882 Sep 10 11:56:45.847340 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1934/3875] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:56:45 2022] GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474 => generated 1455 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:56:46.052197 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8938d2e2-01c8-42b8-9833-3cd9a7cc212e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:46.052813 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8938d2e2-01c8-42b8-9833-3cd9a7cc212e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 476ea519-5dea-4143-93b7-46458d92bab3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:46.072206 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8938d2e2-01c8-42b8-9833-3cd9a7cc212e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:46.073485 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8938d2e2-01c8-42b8-9833-3cd9a7cc212e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:46.077444 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8938d2e2-01c8-42b8-9833-3cd9a7cc212e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:46.078404 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8938d2e2-01c8-42b8-9833-3cd9a7cc212e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:46.079037 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8938d2e2-01c8-42b8-9833-3cd9a7cc212e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:46.080962 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8938d2e2-01c8-42b8-9833-3cd9a7cc212e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:46.182172 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dc0eff43-7663-41f5-a3c8-cb16b8752e76 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:46.182900 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-dc0eff43-7663-41f5-a3c8-cb16b8752e76 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:46.208833 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dc0eff43-7663-41f5-a3c8-cb16b8752e76 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:46.210667 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dc0eff43-7663-41f5-a3c8-cb16b8752e76 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:46.211404 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dc0eff43-7663-41f5-a3c8-cb16b8752e76 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:46.214163 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dc0eff43-7663-41f5-a3c8-cb16b8752e76 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:46.214849 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dc0eff43-7663-41f5-a3c8-cb16b8752e76 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:46.215483 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dc0eff43-7663-41f5-a3c8-cb16b8752e76 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:46.600773 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-dc0eff43-7663-41f5-a3c8-cb16b8752e76 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:46.604178 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:56:46.612412 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-dc0eff43-7663-41f5-a3c8-cb16b8752e76 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1505 microversion: 2.1 time: 0.436266 Sep 10 11:56:46.616640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8938d2e2-01c8-42b8-9833-3cd9a7cc212e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:46.625664 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8938d2e2-01c8-42b8-9833-3cd9a7cc212e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3" status: 200 len: 1315 microversion: 2.1 time: 0.577884 Sep 10 11:56:46.632526 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1942/3876] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:46 2022] GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3 => generated 1315 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:46.633130 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1935/3877] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:46 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1505 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:56:46.786434 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a0889d0b-64e9-4ba3-b812-7e206a9a2ba1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:46.787961 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a0889d0b-64e9-4ba3-b812-7e206a9a2ba1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:46.798752 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a0889d0b-64e9-4ba3-b812-7e206a9a2ba1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:46.799576 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a0889d0b-64e9-4ba3-b812-7e206a9a2ba1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:46.800233 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a0889d0b-64e9-4ba3-b812-7e206a9a2ba1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:46.801118 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a0889d0b-64e9-4ba3-b812-7e206a9a2ba1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:46.801934 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a0889d0b-64e9-4ba3-b812-7e206a9a2ba1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:46.802400 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a0889d0b-64e9-4ba3-b812-7e206a9a2ba1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:46.861938 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4087f99b-9c7d-4294-b5e1-5d87662f38f5 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f40734e5310>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:46.930992 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4087f99b-9c7d-4294-b5e1-5d87662f38f5 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474" status: 200 len: 1455 microversion: 2.1 time: 0.072839 Sep 10 11:56:46.933037 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1943/3878] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:56:46 2022] GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474 => generated 1455 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:56:47.043536 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a0889d0b-64e9-4ba3-b812-7e206a9a2ba1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:47.069226 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a0889d0b-64e9-4ba3-b812-7e206a9a2ba1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4" status: 200 len: 1371 microversion: 2.1 time: 0.290268 Sep 10 11:56:47.091976 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1936/3879] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:46 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 => generated 1371 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:47.499650 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-cc023a09-36e2-4136-a9e5-170039d6f916 req-59d304f9-e2fe-4db0-8cbe-337d373140a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "476ea519-5dea-4143-93b7-46458d92bab3", "tag": "e56519e6-c900-4deb-83d2-d13cf2311767"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:56:47.513839 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-cc023a09-36e2-4136-a9e5-170039d6f916 req-59d304f9-e2fe-4db0-8cbe-337d373140a9 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:47.515018 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-cc023a09-36e2-4136-a9e5-170039d6f916 req-59d304f9-e2fe-4db0-8cbe-337d373140a9 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:47.515549 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-cc023a09-36e2-4136-a9e5-170039d6f916 req-59d304f9-e2fe-4db0-8cbe-337d373140a9 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:47.527988 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-cc023a09-36e2-4136-a9e5-170039d6f916 req-59d304f9-e2fe-4db0-8cbe-337d373140a9 service nova] Creating event network-changed:e56519e6-c900-4deb-83d2-d13cf2311767 for instance 476ea519-5dea-4143-93b7-46458d92bab3 on n-h1-856895-1 Sep 10 11:56:47.534243 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-cc023a09-36e2-4136-a9e5-170039d6f916 req-59d304f9-e2fe-4db0-8cbe-337d373140a9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038170 Sep 10 11:56:47.535127 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1944/3880] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:56:47.640201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f1ec58a0-2460-4ffe-ae15-a4f766bbd810 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:47.641321 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f1ec58a0-2460-4ffe-ae15-a4f766bbd810 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:47.654552 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1ec58a0-2460-4ffe-ae15-a4f766bbd810 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:47.655515 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1ec58a0-2460-4ffe-ae15-a4f766bbd810 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:47.656220 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1ec58a0-2460-4ffe-ae15-a4f766bbd810 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:47.657923 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d3324a14-d7c2-4bd5-8c60-cbd9e0e12d61 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:47.658372 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1ec58a0-2460-4ffe-ae15-a4f766bbd810 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:47.658647 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d3324a14-d7c2-4bd5-8c60-cbd9e0e12d61 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 476ea519-5dea-4143-93b7-46458d92bab3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:47.659373 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1ec58a0-2460-4ffe-ae15-a4f766bbd810 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:47.660011 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1ec58a0-2460-4ffe-ae15-a4f766bbd810 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:47.676212 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3324a14-d7c2-4bd5-8c60-cbd9e0e12d61 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:47.676708 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3324a14-d7c2-4bd5-8c60-cbd9e0e12d61 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:47.677153 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3324a14-d7c2-4bd5-8c60-cbd9e0e12d61 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:47.682499 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3324a14-d7c2-4bd5-8c60-cbd9e0e12d61 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:47.682998 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3324a14-d7c2-4bd5-8c60-cbd9e0e12d61 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:47.695547 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3324a14-d7c2-4bd5-8c60-cbd9e0e12d61 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:48.079691 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d3324a14-d7c2-4bd5-8c60-cbd9e0e12d61 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:48.109057 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d3324a14-d7c2-4bd5-8c60-cbd9e0e12d61 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3" status: 200 len: 1315 microversion: 2.1 time: 0.456144 Sep 10 11:56:48.110265 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1945/3881] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:47 2022] GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3 => generated 1315 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:56:48.129585 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f1ec58a0-2460-4ffe-ae15-a4f766bbd810 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:48.146870 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f1ec58a0-2460-4ffe-ae15-a4f766bbd810 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1505 microversion: 2.1 time: 0.512819 Sep 10 11:56:48.148981 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1937/3882] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:47 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1505 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:48.171224 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-561abffe-2bda-43ed-8fe1-f88730da77da tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4072cab430>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:48.243378 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-561abffe-2bda-43ed-8fe1-f88730da77da tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474" status: 200 len: 1464 microversion: 2.1 time: 0.092112 Sep 10 11:56:48.244305 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1938/3883] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:56:48 2022] GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474 => generated 1464 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:48.249143 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e5b05f22-2986-4bd0-a06d-3ab64ee63f61 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:48.249770 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e5b05f22-2986-4bd0-a06d-3ab64ee63f61 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:48.257775 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e5b05f22-2986-4bd0-a06d-3ab64ee63f61 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:48.258581 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e5b05f22-2986-4bd0-a06d-3ab64ee63f61 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:48.259286 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e5b05f22-2986-4bd0-a06d-3ab64ee63f61 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:48.260384 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e5b05f22-2986-4bd0-a06d-3ab64ee63f61 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:48.261101 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e5b05f22-2986-4bd0-a06d-3ab64ee63f61 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:48.261757 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e5b05f22-2986-4bd0-a06d-3ab64ee63f61 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:48.340847 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-662fff80-8ce6-41ad-825b-2c6b62da139b tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1957966598", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "3762cfcf-18ac-4448-9822-4ba5e1db8e87"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:56:48.426588 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-662fff80-8ce6-41ad-825b-2c6b62da139b tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] validate_networks() for [('3762cfcf-18ac-4448-9822-4ba5e1db8e87', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:56:48.616182 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e5b05f22-2986-4bd0-a06d-3ab64ee63f61 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:48.639100 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e5b05f22-2986-4bd0-a06d-3ab64ee63f61 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4" status: 200 len: 1371 microversion: 2.1 time: 0.393494 Sep 10 11:56:48.641421 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1939/3884] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:48 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 => generated 1371 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:48.653101 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-1e7107e7-4309-478a-b8e6-08f169410ea8 req-fa0c7d83-1142-47ea-b3b0-52889ec3c7e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74075ab0-826c-4b95-9660-e3417ec2b1f4", "tag": "d09e77fe-182b-48f1-88a4-905829b41a74"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:56:48.664876 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-1e7107e7-4309-478a-b8e6-08f169410ea8 req-fa0c7d83-1142-47ea-b3b0-52889ec3c7e9 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:48.666160 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-1e7107e7-4309-478a-b8e6-08f169410ea8 req-fa0c7d83-1142-47ea-b3b0-52889ec3c7e9 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:48.667410 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-1e7107e7-4309-478a-b8e6-08f169410ea8 req-fa0c7d83-1142-47ea-b3b0-52889ec3c7e9 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:48.682883 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-1e7107e7-4309-478a-b8e6-08f169410ea8 req-fa0c7d83-1142-47ea-b3b0-52889ec3c7e9 service nova] Creating event network-changed:d09e77fe-182b-48f1-88a4-905829b41a74 for instance 74075ab0-826c-4b95-9660-e3417ec2b1f4 on n-h1-856895-1 Sep 10 11:56:48.689703 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-1e7107e7-4309-478a-b8e6-08f169410ea8 req-fa0c7d83-1142-47ea-b3b0-52889ec3c7e9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046998 Sep 10 11:56:48.690929 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1940/3885] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:56:48.697134 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1f1a85d7-8d8d-45b5-a582-5bf0d143c4b1 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4072cab700>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:48.792631 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1f1a85d7-8d8d-45b5-a582-5bf0d143c4b1 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474" status: 200 len: 1464 microversion: 2.1 time: 0.099903 Sep 10 11:56:48.793752 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1941/3886] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:56:48 2022] GET /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474 => generated 1464 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:48.809243 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-14c8cd70-04d3-421c-b246-d627c597ff46 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:48.810178 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-14c8cd70-04d3-421c-b246-d627c597ff46 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] [instance: af31e6eb-f34c-4ae9-aede-bc4ca6949556] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:48.823639 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-14c8cd70-04d3-421c-b246-d627c597ff46 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:48.824321 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-14c8cd70-04d3-421c-b246-d627c597ff46 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:48.824772 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-14c8cd70-04d3-421c-b246-d627c597ff46 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:48.825487 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-14c8cd70-04d3-421c-b246-d627c597ff46 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:48.825949 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-14c8cd70-04d3-421c-b246-d627c597ff46 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:48.826383 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-14c8cd70-04d3-421c-b246-d627c597ff46 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:49.553660 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-14c8cd70-04d3-421c-b246-d627c597ff46 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e27edecefe4d60a2dba4ba99055bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f245084ce3f409889039ba1ee751eed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:49.576677 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-14c8cd70-04d3-421c-b246-d627c597ff46 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/servers/af31e6eb-f34c-4ae9-aede-bc4ca6949556" status: 200 len: 1466 microversion: 2.1 time: 0.773281 Sep 10 11:56:49.578393 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1942/3887] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:48 2022] GET /compute/v2.1/servers/af31e6eb-f34c-4ae9-aede-bc4ca6949556 => generated 1466 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:56:49.584352 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a34eadfd-2e60-4814-908c-08374a69c6a1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:49.586071 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a34eadfd-2e60-4814-908c-08374a69c6a1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 476ea519-5dea-4143-93b7-46458d92bab3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:49.594395 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a34eadfd-2e60-4814-908c-08374a69c6a1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:49.602753 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a34eadfd-2e60-4814-908c-08374a69c6a1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:49.605191 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a34eadfd-2e60-4814-908c-08374a69c6a1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:49.618290 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a34eadfd-2e60-4814-908c-08374a69c6a1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:49.619044 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a34eadfd-2e60-4814-908c-08374a69c6a1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:49.619774 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a34eadfd-2e60-4814-908c-08374a69c6a1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:49.646162 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-662fff80-8ce6-41ad-825b-2c6b62da139b tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:56:49.646659 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-662fff80-8ce6-41ad-825b-2c6b62da139b tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:56:49.647070 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-662fff80-8ce6-41ad-825b-2c6b62da139b tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:56:49.654247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-662fff80-8ce6-41ad-825b-2c6b62da139b tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:56:49.654749 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-662fff80-8ce6-41ad-825b-2c6b62da139b tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:56:49.681019 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-662fff80-8ce6-41ad-825b-2c6b62da139b tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:49.681608 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-662fff80-8ce6-41ad-825b-2c6b62da139b tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:49.682494 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-662fff80-8ce6-41ad-825b-2c6b62da139b tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:49.683545 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-662fff80-8ce6-41ad-825b-2c6b62da139b tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:49.684167 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-662fff80-8ce6-41ad-825b-2c6b62da139b tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:49.684766 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-662fff80-8ce6-41ad-825b-2c6b62da139b tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:49.715397 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-662fff80-8ce6-41ad-825b-2c6b62da139b tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Getting quotas for project 3436b7d949394ec28528c82b4a9124b9. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:56:49.722530 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-662fff80-8ce6-41ad-825b-2c6b62da139b tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Getting quotas for user 516e2700c7ce4f0ca6fc38bcfd6b7fa5 and project 3436b7d949394ec28528c82b4a9124b9. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:56:49.738145 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-662fff80-8ce6-41ad-825b-2c6b62da139b tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:56:49.741231 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-662fff80-8ce6-41ad-825b-2c6b62da139b tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] [instance: 2273534d-1c30-4664-b353-4c0aea1dc4c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:56:49.836342 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-662fff80-8ce6-41ad-825b-2c6b62da139b tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.723762 Sep 10 11:56:49.842470 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1946/3888] 10.222.0.23 () {62 vars in 1188 bytes} [Sat Sep 10 11:56:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1731 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 10 11:56:49.856046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e8558dc7-90ae-4c65-9001-9bf88fba21b4 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:49.859392 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e8558dc7-90ae-4c65-9001-9bf88fba21b4 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:49.883373 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a34eadfd-2e60-4814-908c-08374a69c6a1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:49.894353 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e8558dc7-90ae-4c65-9001-9bf88fba21b4 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:49.897074 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e8558dc7-90ae-4c65-9001-9bf88fba21b4 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:49.898031 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e8558dc7-90ae-4c65-9001-9bf88fba21b4 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:49.902186 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e8558dc7-90ae-4c65-9001-9bf88fba21b4 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:49.903134 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e8558dc7-90ae-4c65-9001-9bf88fba21b4 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:49.906025 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e8558dc7-90ae-4c65-9001-9bf88fba21b4 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:49.930484 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a34eadfd-2e60-4814-908c-08374a69c6a1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3" status: 200 len: 1315 microversion: 2.1 time: 0.350705 Sep 10 11:56:49.931109 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1943/3889] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:49 2022] GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3 => generated 1315 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:49.936755 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9c550f96-00dc-46e7-ae73-8e7ed89b7fae tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1507993545"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:56:49.939202 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9c550f96-00dc-46e7-ae73-8e7ed89b7fae tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] [instance: aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:49.959472 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c550f96-00dc-46e7-ae73-8e7ed89b7fae tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:49.959981 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c550f96-00dc-46e7-ae73-8e7ed89b7fae tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:49.960431 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c550f96-00dc-46e7-ae73-8e7ed89b7fae tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:49.961156 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c550f96-00dc-46e7-ae73-8e7ed89b7fae tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:49.961625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c550f96-00dc-46e7-ae73-8e7ed89b7fae tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:49.962060 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9c550f96-00dc-46e7-ae73-8e7ed89b7fae tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:50.158240 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e8558dc7-90ae-4c65-9001-9bf88fba21b4 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:50.173074 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e8558dc7-90ae-4c65-9001-9bf88fba21b4 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1505 microversion: 2.1 time: 0.324635 Sep 10 11:56:50.174817 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1947/3890] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:49 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1505 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:50.187275 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=4 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:56:50.188329 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-28ce8d96-7570-412b-a520-ff05f0b9a485 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:50.189141 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-28ce8d96-7570-412b-a520-ff05f0b9a485 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:50.207970 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28ce8d96-7570-412b-a520-ff05f0b9a485 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:50.208592 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28ce8d96-7570-412b-a520-ff05f0b9a485 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:50.208937 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28ce8d96-7570-412b-a520-ff05f0b9a485 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:50.212040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28ce8d96-7570-412b-a520-ff05f0b9a485 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:50.212587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28ce8d96-7570-412b-a520-ff05f0b9a485 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:50.213082 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28ce8d96-7570-412b-a520-ff05f0b9a485 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:50.357883 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9c550f96-00dc-46e7-ae73-8e7ed89b7fae tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "POST /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7/action" status: 202 len: 0 microversion: 2.1 time: 0.425150 Sep 10 11:56:50.358982 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1944/3891] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:56:49 2022] POST /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7/action => generated 0 bytes in 427 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 10 11:56:50.365830 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d7618471-7af2-4ae9-93ae-05c93257ebb3 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:50.367305 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d7618471-7af2-4ae9-93ae-05c93257ebb3 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] [instance: 2273534d-1c30-4664-b353-4c0aea1dc4c6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:50.456187 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d7618471-7af2-4ae9-93ae-05c93257ebb3 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e2700c7ce4f0ca6fc38bcfd6b7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3436b7d949394ec28528c82b4a9124b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:50.470873 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-28ce8d96-7570-412b-a520-ff05f0b9a485 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:50.478239 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d7618471-7af2-4ae9-93ae-05c93257ebb3 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '516e2700c7ce4f0ca6fc38bcfd6b7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3436b7d949394ec28528c82b4a9124b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:50.480520 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d7618471-7af2-4ae9-93ae-05c93257ebb3 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '516e2700c7ce4f0ca6fc38bcfd6b7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3436b7d949394ec28528c82b4a9124b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:50.482205 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-28ce8d96-7570-412b-a520-ff05f0b9a485 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4" status: 200 len: 1371 microversion: 2.1 time: 0.306070 Sep 10 11:56:50.483245 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1948/3892] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:50 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 => generated 1371 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:50.487841 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cc4544a8-0d4a-41dd-b0dd-64fb36151c23 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f407b4f3550>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:50.488568 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d7618471-7af2-4ae9-93ae-05c93257ebb3 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] 10.222.0.23 "GET /compute/v2.1/servers/2273534d-1c30-4664-b353-4c0aea1dc4c6" status: 200 len: 1259 microversion: 2.21 time: 0.127376 Sep 10 11:56:50.489356 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1945/3893] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:56:50 2022] GET /compute/v2.1/servers/2273534d-1c30-4664-b353-4c0aea1dc4c6 => generated 1259 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:56:50.556644 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cc4544a8-0d4a-41dd-b0dd-64fb36151c23 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76" status: 200 len: 1455 microversion: 2.1 time: 0.072284 Sep 10 11:56:50.569670 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1949/3894] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:56:50 2022] GET /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76 => generated 1455 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:50.841700 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-dfc27043-0a4f-4932-8acd-f0dea2f250a9 req-c6700d62-c90b-45c5-80be-dff5d0c1825b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af31e6eb-f34c-4ae9-aede-bc4ca6949556", "name": "network-vif-unplugged", "status": "completed", "tag": "3fe151c0-067d-4e53-a33f-9bab864a1662"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:56:50.881893 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-dfc27043-0a4f-4932-8acd-f0dea2f250a9 req-c6700d62-c90b-45c5-80be-dff5d0c1825b service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:50.882916 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-dfc27043-0a4f-4932-8acd-f0dea2f250a9 req-c6700d62-c90b-45c5-80be-dff5d0c1825b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:50.883406 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-dfc27043-0a4f-4932-8acd-f0dea2f250a9 req-c6700d62-c90b-45c5-80be-dff5d0c1825b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:50.921578 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-dfc27043-0a4f-4932-8acd-f0dea2f250a9 req-c6700d62-c90b-45c5-80be-dff5d0c1825b service nova] Creating event network-vif-unplugged:3fe151c0-067d-4e53-a33f-9bab864a1662 for instance af31e6eb-f34c-4ae9-aede-bc4ca6949556 on n-h1-856895-1 Sep 10 11:56:50.928152 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-dfc27043-0a4f-4932-8acd-f0dea2f250a9 req-c6700d62-c90b-45c5-80be-dff5d0c1825b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090682 Sep 10 11:56:50.928785 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1946/3895] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:56:50.958644 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-56fb1e88-5a69-4996-ae5f-ff23995097dd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:50.960781 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-56fb1e88-5a69-4996-ae5f-ff23995097dd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 476ea519-5dea-4143-93b7-46458d92bab3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:50.973229 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-56fb1e88-5a69-4996-ae5f-ff23995097dd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:50.976468 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-56fb1e88-5a69-4996-ae5f-ff23995097dd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:50.977743 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-56fb1e88-5a69-4996-ae5f-ff23995097dd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:50.978457 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-56fb1e88-5a69-4996-ae5f-ff23995097dd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:50.979710 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-56fb1e88-5a69-4996-ae5f-ff23995097dd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:50.980476 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-56fb1e88-5a69-4996-ae5f-ff23995097dd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:51.007059 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=100 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:56:51.017486 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-24967a23-b17f-4e8a-9a72-c1e12f262e87 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:51.018036 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-24967a23-b17f-4e8a-9a72-c1e12f262e87 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:51.027638 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-24967a23-b17f-4e8a-9a72-c1e12f262e87 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:51.028146 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-24967a23-b17f-4e8a-9a72-c1e12f262e87 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:51.028701 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-24967a23-b17f-4e8a-9a72-c1e12f262e87 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:51.029608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-24967a23-b17f-4e8a-9a72-c1e12f262e87 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:51.030264 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-24967a23-b17f-4e8a-9a72-c1e12f262e87 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:51.031106 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-24967a23-b17f-4e8a-9a72-c1e12f262e87 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:51.066287 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-24967a23-b17f-4e8a-9a72-c1e12f262e87 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7/ips" status: 200 len: 152 microversion: 2.20 time: 0.053376 Sep 10 11:56:51.075813 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1947/3896] 10.222.0.23 () {60 vars in 1289 bytes} [Sat Sep 10 11:56:51 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7/ips => generated 152 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:56:51.200874 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ecc37859-b75a-48e5-b55b-07cea7531b3c tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:51.201937 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ecc37859-b75a-48e5-b55b-07cea7531b3c tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:51.210951 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ecc37859-b75a-48e5-b55b-07cea7531b3c tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:51.215080 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ecc37859-b75a-48e5-b55b-07cea7531b3c tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:51.216001 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ecc37859-b75a-48e5-b55b-07cea7531b3c tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:51.218620 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ecc37859-b75a-48e5-b55b-07cea7531b3c tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:51.219205 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ecc37859-b75a-48e5-b55b-07cea7531b3c tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:51.220644 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ecc37859-b75a-48e5-b55b-07cea7531b3c tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:51.230494 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-56fb1e88-5a69-4996-ae5f-ff23995097dd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:51.241309 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-56fb1e88-5a69-4996-ae5f-ff23995097dd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3" status: 200 len: 1315 microversion: 2.1 time: 0.291523 Sep 10 11:56:51.243440 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1950/3897] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:50 2022] GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:51.406290 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ecc37859-b75a-48e5-b55b-07cea7531b3c tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:51.418095 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ecc37859-b75a-48e5-b55b-07cea7531b3c tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1505 microversion: 2.1 time: 0.221427 Sep 10 11:56:51.418873 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1948/3898] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:51 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1505 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:51.515025 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-18cbf53a-6396-4092-bdbb-c32467ae261e tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:51.515690 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-18cbf53a-6396-4092-bdbb-c32467ae261e tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] [instance: 2273534d-1c30-4664-b353-4c0aea1dc4c6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:51.517736 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-febfb798-64c7-4057-97ab-6a59dd54c9b1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:51.518294 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-febfb798-64c7-4057-97ab-6a59dd54c9b1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:51.537393 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-febfb798-64c7-4057-97ab-6a59dd54c9b1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:51.540972 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-18cbf53a-6396-4092-bdbb-c32467ae261e tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:51.542096 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-18cbf53a-6396-4092-bdbb-c32467ae261e tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:51.542546 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-18cbf53a-6396-4092-bdbb-c32467ae261e tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:51.543288 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-18cbf53a-6396-4092-bdbb-c32467ae261e tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:51.544098 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-febfb798-64c7-4057-97ab-6a59dd54c9b1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:51.545390 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-febfb798-64c7-4057-97ab-6a59dd54c9b1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:51.546354 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-febfb798-64c7-4057-97ab-6a59dd54c9b1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:51.546938 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-febfb798-64c7-4057-97ab-6a59dd54c9b1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:51.547527 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-febfb798-64c7-4057-97ab-6a59dd54c9b1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:51.548280 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-18cbf53a-6396-4092-bdbb-c32467ae261e tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:51.553305 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-18cbf53a-6396-4092-bdbb-c32467ae261e tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:51.672575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-18cbf53a-6396-4092-bdbb-c32467ae261e tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e2700c7ce4f0ca6fc38bcfd6b7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3436b7d949394ec28528c82b4a9124b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:51.693287 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-18cbf53a-6396-4092-bdbb-c32467ae261e tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '516e2700c7ce4f0ca6fc38bcfd6b7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3436b7d949394ec28528c82b4a9124b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:51.693287 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-18cbf53a-6396-4092-bdbb-c32467ae261e tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '516e2700c7ce4f0ca6fc38bcfd6b7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3436b7d949394ec28528c82b4a9124b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:51.693287 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-18cbf53a-6396-4092-bdbb-c32467ae261e tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] 10.222.0.23 "GET /compute/v2.1/servers/2273534d-1c30-4664-b353-4c0aea1dc4c6" status: 200 len: 1319 microversion: 2.21 time: 0.175466 Sep 10 11:56:51.693287 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1949/3899] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:56:51 2022] GET /compute/v2.1/servers/2273534d-1c30-4664-b353-4c0aea1dc4c6 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:56:51.700495 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6d8386de-38a8-4b17-963f-a20c04b212c9 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f407250b160>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:51.788510 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6d8386de-38a8-4b17-963f-a20c04b212c9 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76" status: 200 len: 1455 microversion: 2.1 time: 0.091861 Sep 10 11:56:51.794581 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1950/3900] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:56:51 2022] GET /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76 => generated 1455 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:51.896823 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-febfb798-64c7-4057-97ab-6a59dd54c9b1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:51.905285 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-febfb798-64c7-4057-97ab-6a59dd54c9b1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4" status: 200 len: 1371 microversion: 2.1 time: 0.399704 Sep 10 11:56:51.906219 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1951/3901] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:51 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 => generated 1371 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:56:52.268262 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8626acee-38f6-4b4d-9c55-2b48e25135cd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:52.268900 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8626acee-38f6-4b4d-9c55-2b48e25135cd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 476ea519-5dea-4143-93b7-46458d92bab3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:52.277871 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8626acee-38f6-4b4d-9c55-2b48e25135cd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:52.278734 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8626acee-38f6-4b4d-9c55-2b48e25135cd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:52.279405 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8626acee-38f6-4b4d-9c55-2b48e25135cd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:52.280321 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8626acee-38f6-4b4d-9c55-2b48e25135cd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:52.280975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8626acee-38f6-4b4d-9c55-2b48e25135cd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:52.281618 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8626acee-38f6-4b4d-9c55-2b48e25135cd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:52.449518 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5113667f-ac7d-41a5-8efe-465d769408c5 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:52.452228 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5113667f-ac7d-41a5-8efe-465d769408c5 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:52.462393 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5113667f-ac7d-41a5-8efe-465d769408c5 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:52.463810 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5113667f-ac7d-41a5-8efe-465d769408c5 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:52.464964 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5113667f-ac7d-41a5-8efe-465d769408c5 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:52.486099 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5113667f-ac7d-41a5-8efe-465d769408c5 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:52.488472 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5113667f-ac7d-41a5-8efe-465d769408c5 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:52.489274 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5113667f-ac7d-41a5-8efe-465d769408c5 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:52.725873 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8626acee-38f6-4b4d-9c55-2b48e25135cd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:52.754357 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8626acee-38f6-4b4d-9c55-2b48e25135cd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3" status: 200 len: 1315 microversion: 2.1 time: 0.488954 Sep 10 11:56:52.755404 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1951/3902] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:52 2022] GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3 => generated 1315 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:52.761836 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f44ee214-c425-4a0e-8d5a-ff81520d7f57 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:52.762780 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f44ee214-c425-4a0e-8d5a-ff81520d7f57 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] [instance: 2273534d-1c30-4664-b353-4c0aea1dc4c6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:52.779132 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f44ee214-c425-4a0e-8d5a-ff81520d7f57 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:52.780531 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f44ee214-c425-4a0e-8d5a-ff81520d7f57 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:52.781709 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f44ee214-c425-4a0e-8d5a-ff81520d7f57 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:52.784809 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f44ee214-c425-4a0e-8d5a-ff81520d7f57 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:52.785640 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f44ee214-c425-4a0e-8d5a-ff81520d7f57 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:52.786446 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f44ee214-c425-4a0e-8d5a-ff81520d7f57 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:53.080381 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5113667f-ac7d-41a5-8efe-465d769408c5 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:53.089745 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5113667f-ac7d-41a5-8efe-465d769408c5 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1505 microversion: 2.1 time: 0.647271 Sep 10 11:56:53.090647 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1952/3903] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:52 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1505 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:53.095394 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-34c1df37-898e-4d35-a507-10a743123995 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f407306daf0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:53.149382 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-34c1df37-898e-4d35-a507-10a743123995 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76" status: 200 len: 1455 microversion: 2.1 time: 0.057417 Sep 10 11:56:53.158504 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1953/3904] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:56:53 2022] GET /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76 => generated 1455 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:53.163603 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-47c81151-3430-4f78-ae93-818ebd06d206 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:53.164658 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-47c81151-3430-4f78-ae93-818ebd06d206 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:53.169491 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f44ee214-c425-4a0e-8d5a-ff81520d7f57 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e2700c7ce4f0ca6fc38bcfd6b7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3436b7d949394ec28528c82b4a9124b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:53.182299 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f44ee214-c425-4a0e-8d5a-ff81520d7f57 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '516e2700c7ce4f0ca6fc38bcfd6b7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3436b7d949394ec28528c82b4a9124b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:53.186397 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47c81151-3430-4f78-ae93-818ebd06d206 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:53.188630 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f44ee214-c425-4a0e-8d5a-ff81520d7f57 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '516e2700c7ce4f0ca6fc38bcfd6b7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3436b7d949394ec28528c82b4a9124b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:53.190096 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f44ee214-c425-4a0e-8d5a-ff81520d7f57 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] 10.222.0.23 "GET /compute/v2.1/servers/2273534d-1c30-4664-b353-4c0aea1dc4c6" status: 200 len: 1359 microversion: 2.21 time: 0.433500 Sep 10 11:56:53.190897 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47c81151-3430-4f78-ae93-818ebd06d206 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:53.192286 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47c81151-3430-4f78-ae93-818ebd06d206 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:53.193205 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47c81151-3430-4f78-ae93-818ebd06d206 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:53.193607 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1952/3905] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:56:52 2022] GET /compute/v2.1/servers/2273534d-1c30-4664-b353-4c0aea1dc4c6 => generated 1359 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:56:53.194253 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47c81151-3430-4f78-ae93-818ebd06d206 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:53.194868 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47c81151-3430-4f78-ae93-818ebd06d206 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:53.449330 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-47c81151-3430-4f78-ae93-818ebd06d206 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:53.459798 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-47c81151-3430-4f78-ae93-818ebd06d206 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4" status: 200 len: 1371 microversion: 2.1 time: 0.300112 Sep 10 11:56:53.473243 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1954/3906] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:53 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 => generated 1371 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:53.787155 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-86fc122f-2571-4b4b-bfee-6c2f1ba17094 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:53.789659 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-86fc122f-2571-4b4b-bfee-6c2f1ba17094 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 476ea519-5dea-4143-93b7-46458d92bab3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:53.798350 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86fc122f-2571-4b4b-bfee-6c2f1ba17094 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:53.799101 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86fc122f-2571-4b4b-bfee-6c2f1ba17094 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:53.799639 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86fc122f-2571-4b4b-bfee-6c2f1ba17094 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:53.800822 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86fc122f-2571-4b4b-bfee-6c2f1ba17094 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:53.801629 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86fc122f-2571-4b4b-bfee-6c2f1ba17094 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:53.802639 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86fc122f-2571-4b4b-bfee-6c2f1ba17094 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:53.982431 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-86fc122f-2571-4b4b-bfee-6c2f1ba17094 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:53.991952 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-86fc122f-2571-4b4b-bfee-6c2f1ba17094 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3" status: 200 len: 1315 microversion: 2.1 time: 0.212172 Sep 10 11:56:53.992763 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1953/3907] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:53 2022] GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:54.039381 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-a7fa60fb-1afc-49e0-a723-8b3b31854e74 req-0d23587f-319a-421a-8869-6d08c26e50d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2273534d-1c30-4664-b353-4c0aea1dc4c6", "tag": "78e2a599-1588-4c7a-bff9-3d91b9cfde27"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:56:54.053125 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a7fa60fb-1afc-49e0-a723-8b3b31854e74 req-0d23587f-319a-421a-8869-6d08c26e50d3 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:54.053693 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a7fa60fb-1afc-49e0-a723-8b3b31854e74 req-0d23587f-319a-421a-8869-6d08c26e50d3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:54.054367 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a7fa60fb-1afc-49e0-a723-8b3b31854e74 req-0d23587f-319a-421a-8869-6d08c26e50d3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:54.066326 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-a7fa60fb-1afc-49e0-a723-8b3b31854e74 req-0d23587f-319a-421a-8869-6d08c26e50d3 service nova] Creating event network-changed:78e2a599-1588-4c7a-bff9-3d91b9cfde27 for instance 2273534d-1c30-4664-b353-4c0aea1dc4c6 on n-h2-856895-1 Sep 10 11:56:54.073330 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-a7fa60fb-1afc-49e0-a723-8b3b31854e74 req-0d23587f-319a-421a-8869-6d08c26e50d3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037001 Sep 10 11:56:54.074001 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1955/3908] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:56:54.115107 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e36283f1-1acc-4a01-9357-de9e7e83b267 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:54.115793 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e36283f1-1acc-4a01-9357-de9e7e83b267 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:54.125598 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e36283f1-1acc-4a01-9357-de9e7e83b267 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:54.126127 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e36283f1-1acc-4a01-9357-de9e7e83b267 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:54.126568 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e36283f1-1acc-4a01-9357-de9e7e83b267 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:54.127319 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e36283f1-1acc-4a01-9357-de9e7e83b267 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:54.139409 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e36283f1-1acc-4a01-9357-de9e7e83b267 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:54.140056 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e36283f1-1acc-4a01-9357-de9e7e83b267 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:54.166301 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-51c02712-ac35-46b4-916a-4f2f1673c2b2 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4073eab550>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:54.219736 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-51c02712-ac35-46b4-916a-4f2f1673c2b2 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76" status: 200 len: 1455 microversion: 2.1 time: 0.057500 Sep 10 11:56:54.220895 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1956/3909] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:56:54 2022] GET /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76 => generated 1455 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:56:54.225686 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ed8616a3-4276-41c1-8a84-958de9b82a51 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:54.226875 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ed8616a3-4276-41c1-8a84-958de9b82a51 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] [instance: 2273534d-1c30-4664-b353-4c0aea1dc4c6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:54.236559 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ed8616a3-4276-41c1-8a84-958de9b82a51 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:54.237305 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ed8616a3-4276-41c1-8a84-958de9b82a51 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:54.237964 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ed8616a3-4276-41c1-8a84-958de9b82a51 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:54.238993 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ed8616a3-4276-41c1-8a84-958de9b82a51 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:54.239690 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ed8616a3-4276-41c1-8a84-958de9b82a51 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:54.240351 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ed8616a3-4276-41c1-8a84-958de9b82a51 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:54.382832 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e36283f1-1acc-4a01-9357-de9e7e83b267 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:54.391907 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e36283f1-1acc-4a01-9357-de9e7e83b267 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1505 microversion: 2.1 time: 0.282191 Sep 10 11:56:54.392884 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1954/3910] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:54 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1505 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:54.408336 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ae845fe9-1124-4215-aa80-f11b5b270362 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:56:54.408981 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ae845fe9-1124-4215-aa80-f11b5b270362 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:54.416105 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ae845fe9-1124-4215-aa80-f11b5b270362 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:54.417241 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ae845fe9-1124-4215-aa80-f11b5b270362 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:54.417594 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ae845fe9-1124-4215-aa80-f11b5b270362 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:54.418317 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ae845fe9-1124-4215-aa80-f11b5b270362 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:54.419223 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ae845fe9-1124-4215-aa80-f11b5b270362 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:54.419223 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ae845fe9-1124-4215-aa80-f11b5b270362 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:54.452196 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-ae845fe9-1124-4215-aa80-f11b5b270362 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lazy-loading 'flavor' on Instance uuid 39f90b6f-123c-451f-8f7a-dbe291a5d4a7 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:56:54.452442 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ed8616a3-4276-41c1-8a84-958de9b82a51 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e2700c7ce4f0ca6fc38bcfd6b7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3436b7d949394ec28528c82b4a9124b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:54.464569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ed8616a3-4276-41c1-8a84-958de9b82a51 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '516e2700c7ce4f0ca6fc38bcfd6b7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3436b7d949394ec28528c82b4a9124b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:54.466965 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ed8616a3-4276-41c1-8a84-958de9b82a51 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '516e2700c7ce4f0ca6fc38bcfd6b7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3436b7d949394ec28528c82b4a9124b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:54.468339 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ed8616a3-4276-41c1-8a84-958de9b82a51 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] 10.222.0.23 "GET /compute/v2.1/servers/2273534d-1c30-4664-b353-4c0aea1dc4c6" status: 200 len: 1359 microversion: 2.21 time: 0.246298 Sep 10 11:56:54.479440 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1957/3911] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:56:54 2022] GET /compute/v2.1/servers/2273534d-1c30-4664-b353-4c0aea1dc4c6 => generated 1359 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:56:54.491802 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a0ccfb97-c741-4216-a65b-f7c5b4103f88 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:54.492426 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a0ccfb97-c741-4216-a65b-f7c5b4103f88 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:54.499904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a0ccfb97-c741-4216-a65b-f7c5b4103f88 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:54.500408 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a0ccfb97-c741-4216-a65b-f7c5b4103f88 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:54.500851 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a0ccfb97-c741-4216-a65b-f7c5b4103f88 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:54.502259 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a0ccfb97-c741-4216-a65b-f7c5b4103f88 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:54.502729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a0ccfb97-c741-4216-a65b-f7c5b4103f88 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:54.503192 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a0ccfb97-c741-4216-a65b-f7c5b4103f88 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:54.505483 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:56:54.708935 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a0ccfb97-c741-4216-a65b-f7c5b4103f88 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:54.715767 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ae845fe9-1124-4215-aa80-f11b5b270362 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "POST /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7/action" status: 202 len: 0 microversion: 2.20 time: 0.321481 Sep 10 11:56:54.716595 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1955/3912] 10.222.0.23 () {62 vars in 1319 bytes} [Sat Sep 10 11:56:54 2022] POST /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:56:54.718214 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a0ccfb97-c741-4216-a65b-f7c5b4103f88 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4" status: 200 len: 1371 microversion: 2.1 time: 0.237183 Sep 10 11:56:54.718871 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1958/3913] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:54 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 => generated 1371 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:54.726770 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-72450edf-dff4-4bf4-9486-21aed90cc5ab tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:54.727510 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-72450edf-dff4-4bf4-9486-21aed90cc5ab tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:54.734533 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-72450edf-dff4-4bf4-9486-21aed90cc5ab tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:54.735053 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-72450edf-dff4-4bf4-9486-21aed90cc5ab tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:54.735527 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-72450edf-dff4-4bf4-9486-21aed90cc5ab tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:54.736240 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-72450edf-dff4-4bf4-9486-21aed90cc5ab tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:54.736699 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-72450edf-dff4-4bf4-9486-21aed90cc5ab tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:54.737130 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-72450edf-dff4-4bf4-9486-21aed90cc5ab tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:54.990701 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-72450edf-dff4-4bf4-9486-21aed90cc5ab tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:55.001278 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-72450edf-dff4-4bf4-9486-21aed90cc5ab tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:55.002749 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-72450edf-dff4-4bf4-9486-21aed90cc5ab tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:55.003977 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-72450edf-dff4-4bf4-9486-21aed90cc5ab tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1723 microversion: 2.20 time: 0.281915 Sep 10 11:56:55.004564 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1956/3914] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:56:54 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1723 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:56:55.017258 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-69c35b4d-e16a-4851-9285-87c2de4a9db5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:55.017887 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-69c35b4d-e16a-4851-9285-87c2de4a9db5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 476ea519-5dea-4143-93b7-46458d92bab3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:55.024259 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-69c35b4d-e16a-4851-9285-87c2de4a9db5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:55.024752 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-69c35b4d-e16a-4851-9285-87c2de4a9db5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:55.025194 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-69c35b4d-e16a-4851-9285-87c2de4a9db5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:55.026244 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-69c35b4d-e16a-4851-9285-87c2de4a9db5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:55.026715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-69c35b4d-e16a-4851-9285-87c2de4a9db5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:55.027149 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-69c35b4d-e16a-4851-9285-87c2de4a9db5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:55.232498 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-69c35b4d-e16a-4851-9285-87c2de4a9db5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:55.236242 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-734ad1c8-1ce2-4a34-8d32-8611c54d544d tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f40733cbe50>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:55.241118 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-69c35b4d-e16a-4851-9285-87c2de4a9db5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3" status: 200 len: 1315 microversion: 2.1 time: 0.227737 Sep 10 11:56:55.241783 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1959/3915] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:55 2022] GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:55.292252 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-734ad1c8-1ce2-4a34-8d32-8611c54d544d tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76" status: 200 len: 1455 microversion: 2.1 time: 0.059272 Sep 10 11:56:55.293030 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1957/3916] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:56:55 2022] GET /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76 => generated 1455 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:56:55.421458 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-79f77cba-2dec-4f10-b8c2-8b3c2f803068 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:55.422252 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-79f77cba-2dec-4f10-b8c2-8b3c2f803068 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:55.428785 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-79f77cba-2dec-4f10-b8c2-8b3c2f803068 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:55.429411 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-79f77cba-2dec-4f10-b8c2-8b3c2f803068 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:55.430097 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-79f77cba-2dec-4f10-b8c2-8b3c2f803068 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:55.430908 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-79f77cba-2dec-4f10-b8c2-8b3c2f803068 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:55.431509 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-79f77cba-2dec-4f10-b8c2-8b3c2f803068 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:55.432605 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-79f77cba-2dec-4f10-b8c2-8b3c2f803068 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:55.499887 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2f8db086-23ab-4cc7-9120-a57f25b7b4e8 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:55.500742 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2f8db086-23ab-4cc7-9120-a57f25b7b4e8 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] [instance: 2273534d-1c30-4664-b353-4c0aea1dc4c6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:55.507688 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f8db086-23ab-4cc7-9120-a57f25b7b4e8 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:55.508467 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f8db086-23ab-4cc7-9120-a57f25b7b4e8 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:55.509091 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f8db086-23ab-4cc7-9120-a57f25b7b4e8 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:55.510081 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f8db086-23ab-4cc7-9120-a57f25b7b4e8 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:55.510880 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f8db086-23ab-4cc7-9120-a57f25b7b4e8 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:55.511723 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f8db086-23ab-4cc7-9120-a57f25b7b4e8 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:55.772292 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-79f77cba-2dec-4f10-b8c2-8b3c2f803068 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:55.782621 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-79f77cba-2dec-4f10-b8c2-8b3c2f803068 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1505 microversion: 2.1 time: 0.370056 Sep 10 11:56:55.783762 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1960/3917] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:55 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1505 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:55.788983 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c12134df-a5d9-45cf-bb2f-f4cde409d623 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:55.789779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c12134df-a5d9-45cf-bb2f-f4cde409d623 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:55.803593 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c12134df-a5d9-45cf-bb2f-f4cde409d623 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:55.804091 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c12134df-a5d9-45cf-bb2f-f4cde409d623 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:55.804542 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c12134df-a5d9-45cf-bb2f-f4cde409d623 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:55.805262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c12134df-a5d9-45cf-bb2f-f4cde409d623 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:55.805725 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c12134df-a5d9-45cf-bb2f-f4cde409d623 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:55.806157 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c12134df-a5d9-45cf-bb2f-f4cde409d623 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:55.816040 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2f8db086-23ab-4cc7-9120-a57f25b7b4e8 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e2700c7ce4f0ca6fc38bcfd6b7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3436b7d949394ec28528c82b4a9124b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:55.827901 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2f8db086-23ab-4cc7-9120-a57f25b7b4e8 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '516e2700c7ce4f0ca6fc38bcfd6b7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3436b7d949394ec28528c82b4a9124b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:55.829397 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2f8db086-23ab-4cc7-9120-a57f25b7b4e8 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '516e2700c7ce4f0ca6fc38bcfd6b7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3436b7d949394ec28528c82b4a9124b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:55.830588 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2f8db086-23ab-4cc7-9120-a57f25b7b4e8 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] 10.222.0.23 "GET /compute/v2.1/servers/2273534d-1c30-4664-b353-4c0aea1dc4c6" status: 200 len: 1359 microversion: 2.21 time: 0.335062 Sep 10 11:56:55.840053 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1958/3918] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:56:55 2022] GET /compute/v2.1/servers/2273534d-1c30-4664-b353-4c0aea1dc4c6 => generated 1359 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:56:56.034239 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9f1ffae9-8606-47c6-9e32-b8cc81376c23 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:56.036771 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9f1ffae9-8606-47c6-9e32-b8cc81376c23 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:56.046967 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9f1ffae9-8606-47c6-9e32-b8cc81376c23 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:56.048048 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9f1ffae9-8606-47c6-9e32-b8cc81376c23 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:56.053018 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9f1ffae9-8606-47c6-9e32-b8cc81376c23 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:56.054532 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9f1ffae9-8606-47c6-9e32-b8cc81376c23 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:56.055264 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9f1ffae9-8606-47c6-9e32-b8cc81376c23 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:56.055864 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9f1ffae9-8606-47c6-9e32-b8cc81376c23 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:56.085134 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c12134df-a5d9-45cf-bb2f-f4cde409d623 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:56.099801 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c12134df-a5d9-45cf-bb2f-f4cde409d623 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4" status: 200 len: 1371 microversion: 2.1 time: 0.314670 Sep 10 11:56:56.105442 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1961/3919] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:55 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 => generated 1371 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:56.272082 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9f1ffae9-8606-47c6-9e32-b8cc81376c23 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:56.273615 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f7b0fcb5-ed1f-46b9-82fa-036b2af61164 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:56.274475 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f7b0fcb5-ed1f-46b9-82fa-036b2af61164 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 476ea519-5dea-4143-93b7-46458d92bab3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:56.281338 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f7b0fcb5-ed1f-46b9-82fa-036b2af61164 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:56.282923 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f7b0fcb5-ed1f-46b9-82fa-036b2af61164 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:56.283633 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f7b0fcb5-ed1f-46b9-82fa-036b2af61164 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:56.284613 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f7b0fcb5-ed1f-46b9-82fa-036b2af61164 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:56.285452 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9f1ffae9-8606-47c6-9e32-b8cc81376c23 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:56.285977 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f7b0fcb5-ed1f-46b9-82fa-036b2af61164 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:56.287346 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9f1ffae9-8606-47c6-9e32-b8cc81376c23 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:56.287651 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f7b0fcb5-ed1f-46b9-82fa-036b2af61164 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:56.290385 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9f1ffae9-8606-47c6-9e32-b8cc81376c23 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1723 microversion: 2.20 time: 0.262263 Sep 10 11:56:56.292911 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1959/3920] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:56:56 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1723 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:56:56.315320 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cd7b55b6-0e19-4210-b8bc-e8ae5955694d tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f407357f5e0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:56.377765 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cd7b55b6-0e19-4210-b8bc-e8ae5955694d tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76" status: 200 len: 1455 microversion: 2.1 time: 0.073291 Sep 10 11:56:56.389168 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1960/3921] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:56:56 2022] GET /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76 => generated 1455 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:56.482963 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-bc3d8fb6-bfc5-4fcb-87d4-eb759c1beaf8 req-cbe87cc2-3504-4ee0-998d-33f080294e87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74075ab0-826c-4b95-9660-e3417ec2b1f4", "name": "network-vif-plugged", "status": "completed", "tag": "d09e77fe-182b-48f1-88a4-905829b41a74"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:56:56.505215 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-bc3d8fb6-bfc5-4fcb-87d4-eb759c1beaf8 req-cbe87cc2-3504-4ee0-998d-33f080294e87 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:56.506007 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-bc3d8fb6-bfc5-4fcb-87d4-eb759c1beaf8 req-cbe87cc2-3504-4ee0-998d-33f080294e87 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:56.506593 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-bc3d8fb6-bfc5-4fcb-87d4-eb759c1beaf8 req-cbe87cc2-3504-4ee0-998d-33f080294e87 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:56.528498 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-bc3d8fb6-bfc5-4fcb-87d4-eb759c1beaf8 req-cbe87cc2-3504-4ee0-998d-33f080294e87 service nova] Creating event network-vif-plugged:d09e77fe-182b-48f1-88a4-905829b41a74 for instance 74075ab0-826c-4b95-9660-e3417ec2b1f4 on n-h1-856895-1 Sep 10 11:56:56.535441 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-bc3d8fb6-bfc5-4fcb-87d4-eb759c1beaf8 req-cbe87cc2-3504-4ee0-998d-33f080294e87 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060140 Sep 10 11:56:56.536536 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1961/3922] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:56:56.560892 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f7b0fcb5-ed1f-46b9-82fa-036b2af61164 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:56.569190 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f7b0fcb5-ed1f-46b9-82fa-036b2af61164 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3" status: 200 len: 1315 microversion: 2.1 time: 0.301031 Sep 10 11:56:56.569786 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1962/3923] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:56 2022] GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3 => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:56.807090 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e92a8f6e-f70f-4296-920e-a3e124b66498 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:56.808099 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e92a8f6e-f70f-4296-920e-a3e124b66498 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:56.832443 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e92a8f6e-f70f-4296-920e-a3e124b66498 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:56.832887 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e92a8f6e-f70f-4296-920e-a3e124b66498 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:56.833356 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e92a8f6e-f70f-4296-920e-a3e124b66498 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:56.834615 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e92a8f6e-f70f-4296-920e-a3e124b66498 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:56.835091 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e92a8f6e-f70f-4296-920e-a3e124b66498 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:56.835557 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e92a8f6e-f70f-4296-920e-a3e124b66498 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:56.860191 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9123871e-15ab-4c2d-86dd-dd18816ced4d tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:56.860815 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9123871e-15ab-4c2d-86dd-dd18816ced4d tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] [instance: 2273534d-1c30-4664-b353-4c0aea1dc4c6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:56.862808 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:56:56.874785 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9123871e-15ab-4c2d-86dd-dd18816ced4d tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:56.875677 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9123871e-15ab-4c2d-86dd-dd18816ced4d tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:56.879116 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9123871e-15ab-4c2d-86dd-dd18816ced4d tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:56.880288 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9123871e-15ab-4c2d-86dd-dd18816ced4d tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:56.880928 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9123871e-15ab-4c2d-86dd-dd18816ced4d tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:56.881528 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9123871e-15ab-4c2d-86dd-dd18816ced4d tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:57.178113 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9123871e-15ab-4c2d-86dd-dd18816ced4d tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e2700c7ce4f0ca6fc38bcfd6b7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3436b7d949394ec28528c82b4a9124b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:57.183248 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e92a8f6e-f70f-4296-920e-a3e124b66498 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:57.191818 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e92a8f6e-f70f-4296-920e-a3e124b66498 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1505 microversion: 2.1 time: 0.389395 Sep 10 11:56:57.192639 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1962/3924] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:56 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1505 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:57.194146 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9123871e-15ab-4c2d-86dd-dd18816ced4d tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '516e2700c7ce4f0ca6fc38bcfd6b7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3436b7d949394ec28528c82b4a9124b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:57.195870 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9123871e-15ab-4c2d-86dd-dd18816ced4d tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '516e2700c7ce4f0ca6fc38bcfd6b7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3436b7d949394ec28528c82b4a9124b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:57.198243 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9123871e-15ab-4c2d-86dd-dd18816ced4d tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] 10.222.0.23 "GET /compute/v2.1/servers/2273534d-1c30-4664-b353-4c0aea1dc4c6" status: 200 len: 1359 microversion: 2.21 time: 0.341398 Sep 10 11:56:57.199125 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-eefefbbf-c25a-4451-9f18-2561fc20499f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:57.199765 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1963/3925] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:56:56 2022] GET /compute/v2.1/servers/2273534d-1c30-4664-b353-4c0aea1dc4c6 => generated 1359 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:56:57.203046 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-eefefbbf-c25a-4451-9f18-2561fc20499f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:57.211434 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eefefbbf-c25a-4451-9f18-2561fc20499f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:57.212604 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eefefbbf-c25a-4451-9f18-2561fc20499f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:57.213425 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eefefbbf-c25a-4451-9f18-2561fc20499f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:57.214378 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eefefbbf-c25a-4451-9f18-2561fc20499f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:57.216065 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eefefbbf-c25a-4451-9f18-2561fc20499f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:57.216754 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eefefbbf-c25a-4451-9f18-2561fc20499f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:57.321245 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ca1d171e-61e1-4b83-9d60-e295f01f9f5f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:57.322312 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ca1d171e-61e1-4b83-9d60-e295f01f9f5f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:57.329692 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca1d171e-61e1-4b83-9d60-e295f01f9f5f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:57.330398 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca1d171e-61e1-4b83-9d60-e295f01f9f5f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:57.330996 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca1d171e-61e1-4b83-9d60-e295f01f9f5f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:57.331978 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca1d171e-61e1-4b83-9d60-e295f01f9f5f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:57.332595 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca1d171e-61e1-4b83-9d60-e295f01f9f5f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:57.333196 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca1d171e-61e1-4b83-9d60-e295f01f9f5f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:57.393762 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-eefefbbf-c25a-4451-9f18-2561fc20499f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:57.403401 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-eefefbbf-c25a-4451-9f18-2561fc20499f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4" status: 200 len: 1371 microversion: 2.1 time: 0.209470 Sep 10 11:56:57.404792 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1963/3926] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:57 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 => generated 1371 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:57.410733 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7acf870f-4e1d-4713-9caa-df861b242050 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4072c0f3a0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:57.461015 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7acf870f-4e1d-4713-9caa-df861b242050 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76" status: 200 len: 1455 microversion: 2.1 time: 0.054953 Sep 10 11:56:57.461610 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1964/3927] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:56:57 2022] GET /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76 => generated 1455 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:57.522063 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ca1d171e-61e1-4b83-9d60-e295f01f9f5f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:57.532089 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ca1d171e-61e1-4b83-9d60-e295f01f9f5f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:57.533527 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ca1d171e-61e1-4b83-9d60-e295f01f9f5f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:57.534714 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ca1d171e-61e1-4b83-9d60-e295f01f9f5f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1723 microversion: 2.20 time: 0.217353 Sep 10 11:56:57.535618 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1964/3928] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:56:57 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:56:57.594333 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0487b5b1-24b4-4c0f-92b9-74f9c53a6f35 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:57.595236 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0487b5b1-24b4-4c0f-92b9-74f9c53a6f35 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 476ea519-5dea-4143-93b7-46458d92bab3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:57.603075 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0487b5b1-24b4-4c0f-92b9-74f9c53a6f35 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:57.604245 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0487b5b1-24b4-4c0f-92b9-74f9c53a6f35 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:57.605431 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0487b5b1-24b4-4c0f-92b9-74f9c53a6f35 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:57.606328 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0487b5b1-24b4-4c0f-92b9-74f9c53a6f35 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:57.606968 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0487b5b1-24b4-4c0f-92b9-74f9c53a6f35 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:57.607444 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0487b5b1-24b4-4c0f-92b9-74f9c53a6f35 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:57.859060 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0487b5b1-24b4-4c0f-92b9-74f9c53a6f35 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:57.867185 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0487b5b1-24b4-4c0f-92b9-74f9c53a6f35 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3" status: 200 len: 1315 microversion: 2.1 time: 0.277360 Sep 10 11:56:57.867770 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1965/3929] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:57 2022] GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3 => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:56:58.219858 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-974d52aa-015d-4e2d-9259-11940c8392aa tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:58.220739 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-974d52aa-015d-4e2d-9259-11940c8392aa tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:58.224167 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c1915e2b-9a5b-452c-9cc2-a70164985fdc tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:58.225332 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c1915e2b-9a5b-452c-9cc2-a70164985fdc tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] [instance: 2273534d-1c30-4664-b353-4c0aea1dc4c6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:58.232804 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-974d52aa-015d-4e2d-9259-11940c8392aa tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:58.232964 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1915e2b-9a5b-452c-9cc2-a70164985fdc tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:58.233373 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-974d52aa-015d-4e2d-9259-11940c8392aa tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:58.234092 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-974d52aa-015d-4e2d-9259-11940c8392aa tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:58.234210 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1915e2b-9a5b-452c-9cc2-a70164985fdc tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:58.234611 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1915e2b-9a5b-452c-9cc2-a70164985fdc tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:58.235212 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-974d52aa-015d-4e2d-9259-11940c8392aa tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:58.235762 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-974d52aa-015d-4e2d-9259-11940c8392aa tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:58.236177 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1915e2b-9a5b-452c-9cc2-a70164985fdc tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:58.236295 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-974d52aa-015d-4e2d-9259-11940c8392aa tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:58.237167 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1915e2b-9a5b-452c-9cc2-a70164985fdc tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:58.238420 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1915e2b-9a5b-452c-9cc2-a70164985fdc tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:58.516706 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c1915e2b-9a5b-452c-9cc2-a70164985fdc tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e2700c7ce4f0ca6fc38bcfd6b7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3436b7d949394ec28528c82b4a9124b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:58.525800 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c1915e2b-9a5b-452c-9cc2-a70164985fdc tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '516e2700c7ce4f0ca6fc38bcfd6b7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3436b7d949394ec28528c82b4a9124b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:58.533411 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c1915e2b-9a5b-452c-9cc2-a70164985fdc tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '516e2700c7ce4f0ca6fc38bcfd6b7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3436b7d949394ec28528c82b4a9124b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:58.535190 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c1915e2b-9a5b-452c-9cc2-a70164985fdc tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] 10.222.0.23 "GET /compute/v2.1/servers/2273534d-1c30-4664-b353-4c0aea1dc4c6" status: 200 len: 1359 microversion: 2.21 time: 0.314619 Sep 10 11:56:58.536533 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1966/3930] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:56:58 2022] GET /compute/v2.1/servers/2273534d-1c30-4664-b353-4c0aea1dc4c6 => generated 1359 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:56:58.537618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-974d52aa-015d-4e2d-9259-11940c8392aa tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:58.542599 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a555c642-07d5-4a62-8084-b314e9a46d60 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:58.543246 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a555c642-07d5-4a62-8084-b314e9a46d60 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:58.549714 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a555c642-07d5-4a62-8084-b314e9a46d60 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:58.550455 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a555c642-07d5-4a62-8084-b314e9a46d60 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:58.551067 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a555c642-07d5-4a62-8084-b314e9a46d60 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:58.551965 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a555c642-07d5-4a62-8084-b314e9a46d60 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:58.552588 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a555c642-07d5-4a62-8084-b314e9a46d60 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:58.552964 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-974d52aa-015d-4e2d-9259-11940c8392aa tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1505 microversion: 2.1 time: 0.339924 Sep 10 11:56:58.553372 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a555c642-07d5-4a62-8084-b314e9a46d60 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:58.557223 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1965/3931] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:58 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1505 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:58.563848 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-395919f9-4e29-4332-b62d-5c53078e1500 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4071ffc310>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:58.621260 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-395919f9-4e29-4332-b62d-5c53078e1500 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76" status: 200 len: 1455 microversion: 2.1 time: 0.062682 Sep 10 11:56:58.633324 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1966/3932] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:56:58 2022] GET /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76 => generated 1455 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:58.643195 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0f101805-5117-4af3-8353-b723590a8e8f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:58.644058 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0f101805-5117-4af3-8353-b723590a8e8f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:58.650343 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0f101805-5117-4af3-8353-b723590a8e8f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:58.651259 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0f101805-5117-4af3-8353-b723590a8e8f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:58.651933 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0f101805-5117-4af3-8353-b723590a8e8f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:58.652841 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0f101805-5117-4af3-8353-b723590a8e8f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:58.653496 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0f101805-5117-4af3-8353-b723590a8e8f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:58.654119 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0f101805-5117-4af3-8353-b723590a8e8f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:58.752897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a555c642-07d5-4a62-8084-b314e9a46d60 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:58.765999 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a555c642-07d5-4a62-8084-b314e9a46d60 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4" status: 200 len: 1371 microversion: 2.1 time: 0.227279 Sep 10 11:56:58.767021 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1967/3933] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:58 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 => generated 1371 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:58.825178 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0f101805-5117-4af3-8353-b723590a8e8f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:58.834511 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0f101805-5117-4af3-8353-b723590a8e8f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:58.836179 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0f101805-5117-4af3-8353-b723590a8e8f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:58.837488 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0f101805-5117-4af3-8353-b723590a8e8f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1723 microversion: 2.20 time: 0.202317 Sep 10 11:56:58.838733 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1967/3934] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:56:58 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:56:58.891627 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-267aa1c5-4b58-4cf9-902f-cfa3f47614cd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:58.892346 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-267aa1c5-4b58-4cf9-902f-cfa3f47614cd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 476ea519-5dea-4143-93b7-46458d92bab3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:58.903572 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-267aa1c5-4b58-4cf9-902f-cfa3f47614cd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:58.905253 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-9244d296-9051-4d26-80db-f46138d9054b req-42ef8cee-b2b8-4b6c-b751-d4cddb71b125 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2273534d-1c30-4664-b353-4c0aea1dc4c6", "name": "network-vif-plugged", "status": "completed", "tag": "78e2a599-1588-4c7a-bff9-3d91b9cfde27"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:56:58.905969 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-267aa1c5-4b58-4cf9-902f-cfa3f47614cd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:58.906464 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-267aa1c5-4b58-4cf9-902f-cfa3f47614cd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:58.912277 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-267aa1c5-4b58-4cf9-902f-cfa3f47614cd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:58.913164 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-267aa1c5-4b58-4cf9-902f-cfa3f47614cd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:58.913653 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-267aa1c5-4b58-4cf9-902f-cfa3f47614cd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:58.928759 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-9244d296-9051-4d26-80db-f46138d9054b req-42ef8cee-b2b8-4b6c-b751-d4cddb71b125 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:58.929313 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-9244d296-9051-4d26-80db-f46138d9054b req-42ef8cee-b2b8-4b6c-b751-d4cddb71b125 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:58.929807 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-9244d296-9051-4d26-80db-f46138d9054b req-42ef8cee-b2b8-4b6c-b751-d4cddb71b125 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:58.967669 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-9244d296-9051-4d26-80db-f46138d9054b req-42ef8cee-b2b8-4b6c-b751-d4cddb71b125 service nova] Creating event network-vif-plugged:78e2a599-1588-4c7a-bff9-3d91b9cfde27 for instance 2273534d-1c30-4664-b353-4c0aea1dc4c6 on n-h2-856895-1 Sep 10 11:56:58.978953 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-9244d296-9051-4d26-80db-f46138d9054b req-42ef8cee-b2b8-4b6c-b751-d4cddb71b125 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081321 Sep 10 11:56:58.979967 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1968/3935] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:56:59.114291 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-267aa1c5-4b58-4cf9-902f-cfa3f47614cd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:56:59.124468 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-267aa1c5-4b58-4cf9-902f-cfa3f47614cd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3" status: 200 len: 1315 microversion: 2.1 time: 0.237612 Sep 10 11:56:59.125168 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1968/3936] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:58 2022] GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:56:59.578120 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-99f4de39-4103-4f3b-9b48-2a056ec450e5 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:59.584196 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-737af2b1-f523-4a95-8930-0af0cb08a6e0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:56:59.584854 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-737af2b1-f523-4a95-8930-0af0cb08a6e0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:59.589360 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-99f4de39-4103-4f3b-9b48-2a056ec450e5 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] [instance: 2273534d-1c30-4664-b353-4c0aea1dc4c6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:56:59.602191 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-737af2b1-f523-4a95-8930-0af0cb08a6e0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:59.602950 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-737af2b1-f523-4a95-8930-0af0cb08a6e0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:59.607213 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-737af2b1-f523-4a95-8930-0af0cb08a6e0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:59.607956 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-737af2b1-f523-4a95-8930-0af0cb08a6e0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:59.608418 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-737af2b1-f523-4a95-8930-0af0cb08a6e0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:59.608845 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-737af2b1-f523-4a95-8930-0af0cb08a6e0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:59.611303 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99f4de39-4103-4f3b-9b48-2a056ec450e5 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:59.611869 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99f4de39-4103-4f3b-9b48-2a056ec450e5 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:59.612450 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99f4de39-4103-4f3b-9b48-2a056ec450e5 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:59.613335 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99f4de39-4103-4f3b-9b48-2a056ec450e5 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:56:59.614588 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99f4de39-4103-4f3b-9b48-2a056ec450e5 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:56:59.617211 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99f4de39-4103-4f3b-9b48-2a056ec450e5 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:56:59.704214 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=4 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:56:59.731706 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=16 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:57:00.274974 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-737af2b1-f523-4a95-8930-0af0cb08a6e0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:00.283076 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-737af2b1-f523-4a95-8930-0af0cb08a6e0 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1505 microversion: 2.1 time: 0.702806 Sep 10 11:57:00.283735 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1969/3937] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:56:59 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1505 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:00.285606 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-99f4de39-4103-4f3b-9b48-2a056ec450e5 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e2700c7ce4f0ca6fc38bcfd6b7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3436b7d949394ec28528c82b4a9124b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:00.288384 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-76436d4c-67aa-4326-94b8-9ce98584e7a4 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f40736ff550>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:00.304109 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-99f4de39-4103-4f3b-9b48-2a056ec450e5 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '516e2700c7ce4f0ca6fc38bcfd6b7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3436b7d949394ec28528c82b4a9124b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:00.305956 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-99f4de39-4103-4f3b-9b48-2a056ec450e5 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '516e2700c7ce4f0ca6fc38bcfd6b7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3436b7d949394ec28528c82b4a9124b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:00.308280 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-99f4de39-4103-4f3b-9b48-2a056ec450e5 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] 10.222.0.23 "GET /compute/v2.1/servers/2273534d-1c30-4664-b353-4c0aea1dc4c6" status: 200 len: 1359 microversion: 2.21 time: 0.736472 Sep 10 11:57:00.309060 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1969/3938] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:56:59 2022] GET /compute/v2.1/servers/2273534d-1c30-4664-b353-4c0aea1dc4c6 => generated 1359 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:57:00.332104 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9a3fc7e8-820d-41bd-b700-f26a07fbfe7a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:00.336090 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9a3fc7e8-820d-41bd-b700-f26a07fbfe7a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:00.345272 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9a3fc7e8-820d-41bd-b700-f26a07fbfe7a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:00.346035 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9a3fc7e8-820d-41bd-b700-f26a07fbfe7a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:00.347366 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9a3fc7e8-820d-41bd-b700-f26a07fbfe7a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:00.348551 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9a3fc7e8-820d-41bd-b700-f26a07fbfe7a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:00.349168 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9a3fc7e8-820d-41bd-b700-f26a07fbfe7a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:00.349757 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9a3fc7e8-820d-41bd-b700-f26a07fbfe7a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:00.349905 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-76436d4c-67aa-4326-94b8-9ce98584e7a4 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76" status: 200 len: 1455 microversion: 2.1 time: 0.064969 Sep 10 11:57:00.350494 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1970/3939] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:57:00 2022] GET /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76 => generated 1455 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:00.356122 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8bb5716e-9bf4-4b28-89bd-353ffbde4094 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:00.356747 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8bb5716e-9bf4-4b28-89bd-353ffbde4094 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:00.363309 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8bb5716e-9bf4-4b28-89bd-353ffbde4094 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:00.363813 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8bb5716e-9bf4-4b28-89bd-353ffbde4094 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:00.364274 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8bb5716e-9bf4-4b28-89bd-353ffbde4094 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:00.365395 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8bb5716e-9bf4-4b28-89bd-353ffbde4094 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:00.366035 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8bb5716e-9bf4-4b28-89bd-353ffbde4094 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:00.366476 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8bb5716e-9bf4-4b28-89bd-353ffbde4094 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:00.460660 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=22 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:57:00.630029 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9a3fc7e8-820d-41bd-b700-f26a07fbfe7a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:00.639072 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9a3fc7e8-820d-41bd-b700-f26a07fbfe7a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4" status: 200 len: 1564 microversion: 2.1 time: 0.328743 Sep 10 11:57:00.640017 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1970/3940] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:00 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 => generated 1564 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:00.645574 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-74aa75db-d464-4c83-82b0-53edf74a6ea4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:00.645952 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8bb5716e-9bf4-4b28-89bd-353ffbde4094 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:00.646912 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-74aa75db-d464-4c83-82b0-53edf74a6ea4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 476ea519-5dea-4143-93b7-46458d92bab3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:00.653803 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-74aa75db-d464-4c83-82b0-53edf74a6ea4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:00.654489 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-74aa75db-d464-4c83-82b0-53edf74a6ea4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:00.654927 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-74aa75db-d464-4c83-82b0-53edf74a6ea4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:00.655720 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-74aa75db-d464-4c83-82b0-53edf74a6ea4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:00.656182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-74aa75db-d464-4c83-82b0-53edf74a6ea4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:00.656610 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-74aa75db-d464-4c83-82b0-53edf74a6ea4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:00.672262 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8bb5716e-9bf4-4b28-89bd-353ffbde4094 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:00.673792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=100 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:57:00.673946 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8bb5716e-9bf4-4b28-89bd-353ffbde4094 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:00.675098 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8bb5716e-9bf4-4b28-89bd-353ffbde4094 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1723 microversion: 2.20 time: 0.323668 Sep 10 11:57:00.675813 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1971/3941] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:57:00 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1723 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:57:00.680926 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-06b2807c-3a42-4763-a50f-ddd721c3ef4b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:00.681425 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-06b2807c-3a42-4763-a50f-ddd721c3ef4b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:00.688220 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-06b2807c-3a42-4763-a50f-ddd721c3ef4b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:00.688936 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-06b2807c-3a42-4763-a50f-ddd721c3ef4b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:00.689597 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-06b2807c-3a42-4763-a50f-ddd721c3ef4b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:00.690577 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-06b2807c-3a42-4763-a50f-ddd721c3ef4b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:00.691196 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-06b2807c-3a42-4763-a50f-ddd721c3ef4b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:00.691884 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-06b2807c-3a42-4763-a50f-ddd721c3ef4b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:00.831321 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-06b2807c-3a42-4763-a50f-ddd721c3ef4b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.154221 Sep 10 11:57:00.831946 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1972/3942] 10.222.0.23 () {58 vars in 1275 bytes} [Sat Sep 10 11:57:00 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4/os-interface => generated 284 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:57:00.910841 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-74aa75db-d464-4c83-82b0-53edf74a6ea4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:00.920068 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-74aa75db-d464-4c83-82b0-53edf74a6ea4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3" status: 200 len: 1315 microversion: 2.1 time: 0.278498 Sep 10 11:57:00.920877 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1971/3943] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:00 2022] GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3 => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:01.286246 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-9dd96565-8f75-4b13-aa3f-347de921d733 req-4d0823ce-d509-40b4-af64-8bedd07d727f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7", "name": "network-vif-plugged", "status": "completed", "tag": "83f19d9c-64d5-42d5-86ba-3993c5101e77"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:57:01.299225 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-9dd96565-8f75-4b13-aa3f-347de921d733 req-4d0823ce-d509-40b4-af64-8bedd07d727f service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:01.299954 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-9dd96565-8f75-4b13-aa3f-347de921d733 req-4d0823ce-d509-40b4-af64-8bedd07d727f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:01.300543 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-9dd96565-8f75-4b13-aa3f-347de921d733 req-4d0823ce-d509-40b4-af64-8bedd07d727f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:01.309341 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-44152ae9-ab2f-459c-8f18-58b6385eb486 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:01.310405 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-44152ae9-ab2f-459c-8f18-58b6385eb486 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:01.317354 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-9dd96565-8f75-4b13-aa3f-347de921d733 req-4d0823ce-d509-40b4-af64-8bedd07d727f service nova] Creating event network-vif-plugged:83f19d9c-64d5-42d5-86ba-3993c5101e77 for instance aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7 on n-h1-856895-1 Sep 10 11:57:01.320539 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-44152ae9-ab2f-459c-8f18-58b6385eb486 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:01.323846 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-44152ae9-ab2f-459c-8f18-58b6385eb486 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:01.325658 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-9dd96565-8f75-4b13-aa3f-347de921d733 req-4d0823ce-d509-40b4-af64-8bedd07d727f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044401 Sep 10 11:57:01.326130 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-44152ae9-ab2f-459c-8f18-58b6385eb486 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:01.326966 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-44152ae9-ab2f-459c-8f18-58b6385eb486 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:01.327352 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1973/3944] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:57:01.327658 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-44152ae9-ab2f-459c-8f18-58b6385eb486 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:01.328094 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-44152ae9-ab2f-459c-8f18-58b6385eb486 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:01.345970 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-673e011e-c615-4274-82ff-d324694eeea3 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:01.348035 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-673e011e-c615-4274-82ff-d324694eeea3 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] [instance: 2273534d-1c30-4664-b353-4c0aea1dc4c6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:01.364748 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-673e011e-c615-4274-82ff-d324694eeea3 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:01.367227 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-673e011e-c615-4274-82ff-d324694eeea3 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:01.369056 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-673e011e-c615-4274-82ff-d324694eeea3 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:01.373802 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-673e011e-c615-4274-82ff-d324694eeea3 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:01.374491 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-673e011e-c615-4274-82ff-d324694eeea3 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:01.375319 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-673e011e-c615-4274-82ff-d324694eeea3 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:01.700968 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-44152ae9-ab2f-459c-8f18-58b6385eb486 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:01.710602 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-44152ae9-ab2f-459c-8f18-58b6385eb486 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1505 microversion: 2.1 time: 0.406947 Sep 10 11:57:01.711508 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1972/3945] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:01 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1505 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:57:01.717665 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e178535a-5eab-48e3-96ce-16b764ebede1 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4072020dc0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:01.769480 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-673e011e-c615-4274-82ff-d324694eeea3 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e2700c7ce4f0ca6fc38bcfd6b7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3436b7d949394ec28528c82b4a9124b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:01.773633 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e178535a-5eab-48e3-96ce-16b764ebede1 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76" status: 200 len: 1455 microversion: 2.1 time: 0.061031 Sep 10 11:57:01.782328 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-673e011e-c615-4274-82ff-d324694eeea3 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '516e2700c7ce4f0ca6fc38bcfd6b7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3436b7d949394ec28528c82b4a9124b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:01.783421 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1973/3946] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:57:01 2022] GET /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76 => generated 1455 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:01.784748 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-673e011e-c615-4274-82ff-d324694eeea3 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '516e2700c7ce4f0ca6fc38bcfd6b7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3436b7d949394ec28528c82b4a9124b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:01.786891 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-673e011e-c615-4274-82ff-d324694eeea3 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] 10.222.0.23 "GET /compute/v2.1/servers/2273534d-1c30-4664-b353-4c0aea1dc4c6" status: 200 len: 1552 microversion: 2.21 time: 0.449730 Sep 10 11:57:01.788635 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-09b689ae-22b5-4681-923a-db955a1af817 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:01.789433 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-09b689ae-22b5-4681-923a-db955a1af817 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:01.796172 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-09b689ae-22b5-4681-923a-db955a1af817 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:01.796835 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-09b689ae-22b5-4681-923a-db955a1af817 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:01.797457 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-09b689ae-22b5-4681-923a-db955a1af817 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:01.798401 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-09b689ae-22b5-4681-923a-db955a1af817 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:01.799014 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-09b689ae-22b5-4681-923a-db955a1af817 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:01.799639 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-09b689ae-22b5-4681-923a-db955a1af817 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:01.801555 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1974/3947] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:57:01 2022] GET /compute/v2.1/servers/2273534d-1c30-4664-b353-4c0aea1dc4c6 => generated 1552 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:57:01.819842 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-16a71436-39d5-4861-830a-ad1744ee8f2a tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:01.820596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-16a71436-39d5-4861-830a-ad1744ee8f2a tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] [instance: 2273534d-1c30-4664-b353-4c0aea1dc4c6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:01.829720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16a71436-39d5-4861-830a-ad1744ee8f2a tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:01.831118 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16a71436-39d5-4861-830a-ad1744ee8f2a tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:01.832379 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16a71436-39d5-4861-830a-ad1744ee8f2a tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:01.833250 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16a71436-39d5-4861-830a-ad1744ee8f2a tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:01.834112 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16a71436-39d5-4861-830a-ad1744ee8f2a tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:01.834849 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16a71436-39d5-4861-830a-ad1744ee8f2a tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:01.867016 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-16a71436-39d5-4861-830a-ad1744ee8f2a tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] [instance: 2273534d-1c30-4664-b353-4c0aea1dc4c6] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:57:01.934716 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:57:01.998348 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-16a71436-39d5-4861-830a-ad1744ee8f2a tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2273534d-1c30-4664-b353-4c0aea1dc4c6" status: 204 len: 0 microversion: 2.21 time: 0.182184 Sep 10 11:57:02.000772 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1975/3948] 10.222.0.23 () {60 vars in 1280 bytes} [Sat Sep 10 11:57:01 2022] DELETE /compute/v2.1/servers/2273534d-1c30-4664-b353-4c0aea1dc4c6 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 11:57:02.015180 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-369413dc-c4b8-492f-9260-2984257fee73 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:02.016217 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-369413dc-c4b8-492f-9260-2984257fee73 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 476ea519-5dea-4143-93b7-46458d92bab3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:02.026052 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-369413dc-c4b8-492f-9260-2984257fee73 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:02.027548 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-369413dc-c4b8-492f-9260-2984257fee73 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:02.028634 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-369413dc-c4b8-492f-9260-2984257fee73 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:02.030136 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-369413dc-c4b8-492f-9260-2984257fee73 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:02.031131 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-369413dc-c4b8-492f-9260-2984257fee73 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:02.031825 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-369413dc-c4b8-492f-9260-2984257fee73 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:02.042233 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-09b689ae-22b5-4681-923a-db955a1af817 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:02.053902 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-09b689ae-22b5-4681-923a-db955a1af817 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:02.055718 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-09b689ae-22b5-4681-923a-db955a1af817 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:02.057770 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-09b689ae-22b5-4681-923a-db955a1af817 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1723 microversion: 2.20 time: 0.272563 Sep 10 11:57:02.059129 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1974/3949] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:57:01 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1723 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:57:02.066905 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ec519792-7e4f-4943-aa9a-dcaf853ef8b0 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:02.067799 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ec519792-7e4f-4943-aa9a-dcaf853ef8b0 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] [instance: 2273534d-1c30-4664-b353-4c0aea1dc4c6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:02.076268 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec519792-7e4f-4943-aa9a-dcaf853ef8b0 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:02.076950 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec519792-7e4f-4943-aa9a-dcaf853ef8b0 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:02.077582 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec519792-7e4f-4943-aa9a-dcaf853ef8b0 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:02.078297 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec519792-7e4f-4943-aa9a-dcaf853ef8b0 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:02.078794 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec519792-7e4f-4943-aa9a-dcaf853ef8b0 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:02.079282 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec519792-7e4f-4943-aa9a-dcaf853ef8b0 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:02.308445 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-369413dc-c4b8-492f-9260-2984257fee73 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:02.318755 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ec519792-7e4f-4943-aa9a-dcaf853ef8b0 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e2700c7ce4f0ca6fc38bcfd6b7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3436b7d949394ec28528c82b4a9124b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:02.330740 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-369413dc-c4b8-492f-9260-2984257fee73 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3" status: 200 len: 1315 microversion: 2.1 time: 0.319498 Sep 10 11:57:02.332173 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1976/3950] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:02 2022] GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3 => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:02.334192 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ec519792-7e4f-4943-aa9a-dcaf853ef8b0 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '516e2700c7ce4f0ca6fc38bcfd6b7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3436b7d949394ec28528c82b4a9124b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:02.343007 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ec519792-7e4f-4943-aa9a-dcaf853ef8b0 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '516e2700c7ce4f0ca6fc38bcfd6b7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3436b7d949394ec28528c82b4a9124b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:02.346432 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ec519792-7e4f-4943-aa9a-dcaf853ef8b0 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] 10.222.0.23 "GET /compute/v2.1/servers/2273534d-1c30-4664-b353-4c0aea1dc4c6" status: 200 len: 1558 microversion: 2.21 time: 0.285512 Sep 10 11:57:02.347028 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1975/3951] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:57:02 2022] GET /compute/v2.1/servers/2273534d-1c30-4664-b353-4c0aea1dc4c6 => generated 1558 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:57:02.348132 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-eebd6dc2-da5d-4a53-9499-e9838d8f0bf3 req-e36aa2b4-32b6-443f-ab1f-e90c458306c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74075ab0-826c-4b95-9660-e3417ec2b1f4", "tag": "d09e77fe-182b-48f1-88a4-905829b41a74"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:57:02.368451 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-eebd6dc2-da5d-4a53-9499-e9838d8f0bf3 req-e36aa2b4-32b6-443f-ab1f-e90c458306c5 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:02.369265 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-eebd6dc2-da5d-4a53-9499-e9838d8f0bf3 req-e36aa2b4-32b6-443f-ab1f-e90c458306c5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:02.369869 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-eebd6dc2-da5d-4a53-9499-e9838d8f0bf3 req-e36aa2b4-32b6-443f-ab1f-e90c458306c5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:02.383018 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-eebd6dc2-da5d-4a53-9499-e9838d8f0bf3 req-e36aa2b4-32b6-443f-ab1f-e90c458306c5 service nova] Creating event network-changed:d09e77fe-182b-48f1-88a4-905829b41a74 for instance 74075ab0-826c-4b95-9660-e3417ec2b1f4 on n-h1-856895-1 Sep 10 11:57:02.390877 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-eebd6dc2-da5d-4a53-9499-e9838d8f0bf3 req-e36aa2b4-32b6-443f-ab1f-e90c458306c5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054238 Sep 10 11:57:02.392217 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1977/3952] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:57:02.740237 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-173db7b5-89f4-461b-aa21-757548e0099c tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:02.741430 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-173db7b5-89f4-461b-aa21-757548e0099c tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:02.777976 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-173db7b5-89f4-461b-aa21-757548e0099c tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:02.778935 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-173db7b5-89f4-461b-aa21-757548e0099c tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:02.780114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-173db7b5-89f4-461b-aa21-757548e0099c tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:02.781044 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-173db7b5-89f4-461b-aa21-757548e0099c tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:02.781685 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-173db7b5-89f4-461b-aa21-757548e0099c tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:02.794301 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-173db7b5-89f4-461b-aa21-757548e0099c tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:02.794508 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a1cf702e-6a07-4b82-99c3-1251599b847f tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4072c78ee0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:02.864983 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a1cf702e-6a07-4b82-99c3-1251599b847f tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76" status: 200 len: 1455 microversion: 2.1 time: 0.079008 Sep 10 11:57:02.874772 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1978/3953] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:57:02 2022] GET /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76 => generated 1455 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:03.028287 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-173db7b5-89f4-461b-aa21-757548e0099c tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:03.038893 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-173db7b5-89f4-461b-aa21-757548e0099c tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1505 microversion: 2.1 time: 0.303700 Sep 10 11:57:03.052502 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1976/3954] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:02 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1505 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:03.356705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-68f77e31-b3d3-4586-9f84-84459ef75622 req-7dbc4b24-df26-48a5-83f8-8d3804461a42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "476ea519-5dea-4143-93b7-46458d92bab3", "name": "network-vif-plugged", "status": "completed", "tag": "e56519e6-c900-4deb-83d2-d13cf2311767"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:57:03.370504 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dadd6b29-e82d-4e22-ac52-dd3a9e4ed9d2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:03.371627 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-dadd6b29-e82d-4e22-ac52-dd3a9e4ed9d2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:03.386883 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-68f77e31-b3d3-4586-9f84-84459ef75622 req-7dbc4b24-df26-48a5-83f8-8d3804461a42 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:03.387399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-68f77e31-b3d3-4586-9f84-84459ef75622 req-7dbc4b24-df26-48a5-83f8-8d3804461a42 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:03.387530 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dadd6b29-e82d-4e22-ac52-dd3a9e4ed9d2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:03.387838 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-68f77e31-b3d3-4586-9f84-84459ef75622 req-7dbc4b24-df26-48a5-83f8-8d3804461a42 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:03.388211 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dadd6b29-e82d-4e22-ac52-dd3a9e4ed9d2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:03.388656 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dadd6b29-e82d-4e22-ac52-dd3a9e4ed9d2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:03.389356 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dadd6b29-e82d-4e22-ac52-dd3a9e4ed9d2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:03.389814 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dadd6b29-e82d-4e22-ac52-dd3a9e4ed9d2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:03.390244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dadd6b29-e82d-4e22-ac52-dd3a9e4ed9d2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:03.416710 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-68f77e31-b3d3-4586-9f84-84459ef75622 req-7dbc4b24-df26-48a5-83f8-8d3804461a42 service nova] Creating event network-vif-plugged:e56519e6-c900-4deb-83d2-d13cf2311767 for instance 476ea519-5dea-4143-93b7-46458d92bab3 on n-h1-856895-1 Sep 10 11:57:03.428557 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-68f77e31-b3d3-4586-9f84-84459ef75622 req-7dbc4b24-df26-48a5-83f8-8d3804461a42 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080167 Sep 10 11:57:03.429799 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1977/3955] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:57:03.448872 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5df555f2-c9e5-46c2-a59b-016a2de4910a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:03.456309 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5df555f2-c9e5-46c2-a59b-016a2de4910a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 476ea519-5dea-4143-93b7-46458d92bab3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:03.468862 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5df555f2-c9e5-46c2-a59b-016a2de4910a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:03.469636 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5df555f2-c9e5-46c2-a59b-016a2de4910a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:03.470084 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5df555f2-c9e5-46c2-a59b-016a2de4910a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:03.470800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5df555f2-c9e5-46c2-a59b-016a2de4910a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:03.471346 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5df555f2-c9e5-46c2-a59b-016a2de4910a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:03.471785 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5df555f2-c9e5-46c2-a59b-016a2de4910a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:03.708210 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-dadd6b29-e82d-4e22-ac52-dd3a9e4ed9d2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:03.717059 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-dadd6b29-e82d-4e22-ac52-dd3a9e4ed9d2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:03.718806 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-dadd6b29-e82d-4e22-ac52-dd3a9e4ed9d2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:03.725505 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-dadd6b29-e82d-4e22-ac52-dd3a9e4ed9d2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1723 microversion: 2.20 time: 0.644361 Sep 10 11:57:03.726602 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1979/3956] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:57:03 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1723 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:57:03.731958 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a33440c9-0f1c-4375-8ad2-65ef3d0a961d tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:03.736096 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a33440c9-0f1c-4375-8ad2-65ef3d0a961d tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] [instance: 2273534d-1c30-4664-b353-4c0aea1dc4c6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:03.748120 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5df555f2-c9e5-46c2-a59b-016a2de4910a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:03.755098 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a33440c9-0f1c-4375-8ad2-65ef3d0a961d tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:03.755807 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a33440c9-0f1c-4375-8ad2-65ef3d0a961d tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:03.756384 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5df555f2-c9e5-46c2-a59b-016a2de4910a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3" status: 200 len: 1315 microversion: 2.1 time: 0.325114 Sep 10 11:57:03.756611 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a33440c9-0f1c-4375-8ad2-65ef3d0a961d tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:03.756984 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1978/3957] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:03 2022] GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3 => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:03.757823 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a33440c9-0f1c-4375-8ad2-65ef3d0a961d tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:03.758444 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a33440c9-0f1c-4375-8ad2-65ef3d0a961d tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:03.759273 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a33440c9-0f1c-4375-8ad2-65ef3d0a961d tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:03.881544 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ccd90fe1-6ca8-4654-8447-91d70e843a0e tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f40720204c0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:03.932404 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ccd90fe1-6ca8-4654-8447-91d70e843a0e tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76" status: 200 len: 1455 microversion: 2.1 time: 0.053968 Sep 10 11:57:03.932999 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1979/3958] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:57:03 2022] GET /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76 => generated 1455 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:57:03.998288 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a33440c9-0f1c-4375-8ad2-65ef3d0a961d tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e2700c7ce4f0ca6fc38bcfd6b7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3436b7d949394ec28528c82b4a9124b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:04.013672 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a33440c9-0f1c-4375-8ad2-65ef3d0a961d tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '516e2700c7ce4f0ca6fc38bcfd6b7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3436b7d949394ec28528c82b4a9124b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:04.016243 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a33440c9-0f1c-4375-8ad2-65ef3d0a961d tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '516e2700c7ce4f0ca6fc38bcfd6b7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3436b7d949394ec28528c82b4a9124b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:04.017628 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a33440c9-0f1c-4375-8ad2-65ef3d0a961d tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] 10.222.0.23 "GET /compute/v2.1/servers/2273534d-1c30-4664-b353-4c0aea1dc4c6" status: 200 len: 1558 microversion: 2.21 time: 0.289763 Sep 10 11:57:04.019237 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1980/3959] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:57:03 2022] GET /compute/v2.1/servers/2273534d-1c30-4664-b353-4c0aea1dc4c6 => generated 1558 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:57:04.066758 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f8a1af64-23fc-4cc0-b678-dff689f47253 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:04.067483 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f8a1af64-23fc-4cc0-b678-dff689f47253 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:04.079615 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8a1af64-23fc-4cc0-b678-dff689f47253 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:04.081171 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8a1af64-23fc-4cc0-b678-dff689f47253 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:04.083274 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8a1af64-23fc-4cc0-b678-dff689f47253 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:04.084158 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8a1af64-23fc-4cc0-b678-dff689f47253 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:04.084921 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8a1af64-23fc-4cc0-b678-dff689f47253 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:04.085513 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8a1af64-23fc-4cc0-b678-dff689f47253 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:04.475603 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f8a1af64-23fc-4cc0-b678-dff689f47253 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:04.487888 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f8a1af64-23fc-4cc0-b678-dff689f47253 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1505 microversion: 2.1 time: 0.427273 Sep 10 11:57:04.490920 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1980/3960] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:04 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1505 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:04.755350 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d2c84d90-2ba3-406c-b6d2-de757fe838d6 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:04.761312 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d2c84d90-2ba3-406c-b6d2-de757fe838d6 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:04.776625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2c84d90-2ba3-406c-b6d2-de757fe838d6 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:04.777838 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2c84d90-2ba3-406c-b6d2-de757fe838d6 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:04.785729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0d7328e2-c142-44c1-9a30-8b70b4b578f3 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:04.786883 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0d7328e2-c142-44c1-9a30-8b70b4b578f3 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 476ea519-5dea-4143-93b7-46458d92bab3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:04.793036 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2c84d90-2ba3-406c-b6d2-de757fe838d6 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:04.796442 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d7328e2-c142-44c1-9a30-8b70b4b578f3 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:04.803992 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2c84d90-2ba3-406c-b6d2-de757fe838d6 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:04.804788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2c84d90-2ba3-406c-b6d2-de757fe838d6 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:04.805422 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d2c84d90-2ba3-406c-b6d2-de757fe838d6 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:04.809733 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d7328e2-c142-44c1-9a30-8b70b4b578f3 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:04.810675 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d7328e2-c142-44c1-9a30-8b70b4b578f3 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:04.811730 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d7328e2-c142-44c1-9a30-8b70b4b578f3 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:04.812374 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d7328e2-c142-44c1-9a30-8b70b4b578f3 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:04.812969 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d7328e2-c142-44c1-9a30-8b70b4b578f3 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:05.182049 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d2c84d90-2ba3-406c-b6d2-de757fe838d6 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:05.221477 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0d7328e2-c142-44c1-9a30-8b70b4b578f3 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:05.231650 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0d7328e2-c142-44c1-9a30-8b70b4b578f3 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3" status: 200 len: 1315 microversion: 2.1 time: 0.449321 Sep 10 11:57:05.232528 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d2c84d90-2ba3-406c-b6d2-de757fe838d6 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:05.237562 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d2c84d90-2ba3-406c-b6d2-de757fe838d6 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:05.239827 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d2c84d90-2ba3-406c-b6d2-de757fe838d6 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1723 microversion: 2.20 time: 0.488762 Sep 10 11:57:05.245077 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1981/3961] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:04 2022] GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3 => generated 1315 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:57:05.261241 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1981/3962] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:57:04 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1723 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:57:05.266654 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0a80dc38-bc64-4f3a-a79a-41211f77992a tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4071ffc4c0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:05.278334 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a13cd29e-57c4-44f9-99f2-8c47187eea87 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:05.279214 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a13cd29e-57c4-44f9-99f2-8c47187eea87 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] [instance: 2273534d-1c30-4664-b353-4c0aea1dc4c6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:05.294989 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a13cd29e-57c4-44f9-99f2-8c47187eea87 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:05.295895 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a13cd29e-57c4-44f9-99f2-8c47187eea87 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:05.296592 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a13cd29e-57c4-44f9-99f2-8c47187eea87 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:05.297534 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a13cd29e-57c4-44f9-99f2-8c47187eea87 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:05.298754 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a13cd29e-57c4-44f9-99f2-8c47187eea87 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:05.299440 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a13cd29e-57c4-44f9-99f2-8c47187eea87 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:05.335227 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0a80dc38-bc64-4f3a-a79a-41211f77992a tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76" status: 200 len: 1455 microversion: 2.1 time: 0.084511 Sep 10 11:57:05.337392 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1982/3963] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:57:05 2022] GET /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76 => generated 1455 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:05.419554 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a13cd29e-57c4-44f9-99f2-8c47187eea87 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e2700c7ce4f0ca6fc38bcfd6b7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3436b7d949394ec28528c82b4a9124b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:05.429344 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a13cd29e-57c4-44f9-99f2-8c47187eea87 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '516e2700c7ce4f0ca6fc38bcfd6b7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3436b7d949394ec28528c82b4a9124b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:05.432819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a13cd29e-57c4-44f9-99f2-8c47187eea87 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '516e2700c7ce4f0ca6fc38bcfd6b7fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3436b7d949394ec28528c82b4a9124b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:05.433958 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a13cd29e-57c4-44f9-99f2-8c47187eea87 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] 10.222.0.23 "GET /compute/v2.1/servers/2273534d-1c30-4664-b353-4c0aea1dc4c6" status: 200 len: 1516 microversion: 2.21 time: 0.171460 Sep 10 11:57:05.435096 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1982/3964] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:57:05 2022] GET /compute/v2.1/servers/2273534d-1c30-4664-b353-4c0aea1dc4c6 => generated 1516 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:57:05.513712 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-47531fbe-5806-4a92-9c28-260a7305f06b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:05.514351 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-47531fbe-5806-4a92-9c28-260a7305f06b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:05.527370 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47531fbe-5806-4a92-9c28-260a7305f06b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:05.527797 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47531fbe-5806-4a92-9c28-260a7305f06b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:05.528376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47531fbe-5806-4a92-9c28-260a7305f06b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:05.528983 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47531fbe-5806-4a92-9c28-260a7305f06b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:05.529443 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47531fbe-5806-4a92-9c28-260a7305f06b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:05.529883 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47531fbe-5806-4a92-9c28-260a7305f06b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:05.533254 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-2c6af91b-0dbc-492d-a900-fd81c3abe0b7 req-c4bd5f3b-1409-47c2-a5f2-f8cf8f623b61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2273534d-1c30-4664-b353-4c0aea1dc4c6", "name": "network-vif-deleted", "tag": "78e2a599-1588-4c7a-bff9-3d91b9cfde27"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:57:05.562516 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-2c6af91b-0dbc-492d-a900-fd81c3abe0b7 req-c4bd5f3b-1409-47c2-a5f2-f8cf8f623b61 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:05.563274 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-2c6af91b-0dbc-492d-a900-fd81c3abe0b7 req-c4bd5f3b-1409-47c2-a5f2-f8cf8f623b61 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:05.563822 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-2c6af91b-0dbc-492d-a900-fd81c3abe0b7 req-c4bd5f3b-1409-47c2-a5f2-f8cf8f623b61 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:05.585413 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-2c6af91b-0dbc-492d-a900-fd81c3abe0b7 req-c4bd5f3b-1409-47c2-a5f2-f8cf8f623b61 service nova] Creating event network-vif-deleted:78e2a599-1588-4c7a-bff9-3d91b9cfde27 for instance 2273534d-1c30-4664-b353-4c0aea1dc4c6 on n-h2-856895-1 Sep 10 11:57:05.596809 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-2c6af91b-0dbc-492d-a900-fd81c3abe0b7 req-c4bd5f3b-1409-47c2-a5f2-f8cf8f623b61 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075739 Sep 10 11:57:05.597919 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1983/3965] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:57:05.824008 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-47531fbe-5806-4a92-9c28-260a7305f06b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:05.847480 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-47531fbe-5806-4a92-9c28-260a7305f06b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1505 microversion: 2.1 time: 0.335793 Sep 10 11:57:05.850910 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1983/3966] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:05 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1505 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:06.257825 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ec29ebdc-c20b-4e8d-a0ad-d157e572c2d5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:06.258551 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ec29ebdc-c20b-4e8d-a0ad-d157e572c2d5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 476ea519-5dea-4143-93b7-46458d92bab3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:06.271594 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec29ebdc-c20b-4e8d-a0ad-d157e572c2d5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:06.271594 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec29ebdc-c20b-4e8d-a0ad-d157e572c2d5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:06.271918 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec29ebdc-c20b-4e8d-a0ad-d157e572c2d5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:06.272803 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec29ebdc-c20b-4e8d-a0ad-d157e572c2d5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:06.272803 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec29ebdc-c20b-4e8d-a0ad-d157e572c2d5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:06.273234 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec29ebdc-c20b-4e8d-a0ad-d157e572c2d5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:06.278207 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2cb64b64-681f-4650-80c4-b4ed99c853f2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:06.278973 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2cb64b64-681f-4650-80c4-b4ed99c853f2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:06.295773 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2cb64b64-681f-4650-80c4-b4ed99c853f2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:06.296606 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2cb64b64-681f-4650-80c4-b4ed99c853f2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:06.297150 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2cb64b64-681f-4650-80c4-b4ed99c853f2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:06.298347 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2cb64b64-681f-4650-80c4-b4ed99c853f2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:06.300222 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2cb64b64-681f-4650-80c4-b4ed99c853f2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:06.300917 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2cb64b64-681f-4650-80c4-b4ed99c853f2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:06.650210 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2cb64b64-681f-4650-80c4-b4ed99c853f2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:06.660002 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2cb64b64-681f-4650-80c4-b4ed99c853f2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:06.661930 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2cb64b64-681f-4650-80c4-b4ed99c853f2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:06.663691 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2cb64b64-681f-4650-80c4-b4ed99c853f2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1723 microversion: 2.20 time: 0.389939 Sep 10 11:57:06.664251 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ec29ebdc-c20b-4e8d-a0ad-d157e572c2d5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:06.680409 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1984/3967] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:57:06 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1723 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:57:06.680627 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ec29ebdc-c20b-4e8d-a0ad-d157e572c2d5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3" status: 200 len: 1315 microversion: 2.1 time: 0.426504 Sep 10 11:57:06.681058 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1984/3968] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:06 2022] GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3 => generated 1315 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:06.689279 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e53c520d-e283-4c38-bdd6-8c2a88016245 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4071ffcdc0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:06.692315 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6f1ea4ad-eab1-4459-bb2a-bd163e99121e tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:06.693326 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6f1ea4ad-eab1-4459-bb2a-bd163e99121e tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] [instance: 2273534d-1c30-4664-b353-4c0aea1dc4c6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:06.701610 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f1ea4ad-eab1-4459-bb2a-bd163e99121e tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:06.702307 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f1ea4ad-eab1-4459-bb2a-bd163e99121e tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:06.703291 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f1ea4ad-eab1-4459-bb2a-bd163e99121e tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:06.704449 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f1ea4ad-eab1-4459-bb2a-bd163e99121e tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:06.705105 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f1ea4ad-eab1-4459-bb2a-bd163e99121e tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:06.705711 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f1ea4ad-eab1-4459-bb2a-bd163e99121e tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:06.724081 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-6f1ea4ad-eab1-4459-bb2a-bd163e99121e tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] HTTP exception thrown: Instance 2273534d-1c30-4664-b353-4c0aea1dc4c6 could not be found. Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6f1ea4ad-eab1-4459-bb2a-bd163e99121e tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Request method failure captured: Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/2273534d-1c30-4664-b353-4c0aea1dc4c6 HTTP/1.1 Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHt_z-NEaO74iPjKf9lE2gpNSPJlYcm_Y2dQQbzXiMGJC-RzSsY0cMUkDgneU3ykAlNxZURtvmHLRgqE1GP96RbT_fdbxJ2lJS2MGo_xCSv6xENj5mch4PyxahD-rjKwSxiB2g6ZarcdlPmu6ozVjVOHnIrbCS88_Wq1D16mi2XwfRo Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: X-Openstack-Nova-Api-Version: 2.21 Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 3436b7d949394ec28528c82b4a9124b9 Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1483293198 Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3436b7d949394ec28528c82b4a9124b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3436b7d949394ec28528c82b4a9124b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3436b7d949394ec28528c82b4a9124b9", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3436b7d949394ec28528c82b4a9124b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-InstanceActionsV221TestJSON-1483293198 Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 3436b7d949394ec28528c82b4a9124b9 Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1483293198 Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-InstanceActionsV221TestJSON-1483293198-project Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 516e2700c7ce4f0ca6fc38bcfd6b7fa5 Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-InstanceActionsV221TestJSON-1483293198-project Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 2273534d-1c30-4664-b353-4c0aea1dc4c6 could not be found. Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '2273534d-1c30-4664-b353-4c0aea1dc4c6'} Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2273534d-1c30-4664-b353-4c0aea1dc4c6 could not be found. Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2273534d-1c30-4664-b353-4c0aea1dc4c6 could not be found. Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:57:06.726915 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:57:06.731270 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:57:06.731270 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:57:06.731270 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:57:06.731270 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:57:06.731270 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:57:06.731270 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:57:06.731270 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2273534d-1c30-4664-b353-4c0aea1dc4c6 could not be found. Sep 10 11:57:06.731270 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:57:06.733676 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6f1ea4ad-eab1-4459-bb2a-bd163e99121e tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Returning 404 to user: Instance 2273534d-1c30-4664-b353-4c0aea1dc4c6 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:57:06.734778 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6f1ea4ad-eab1-4459-bb2a-bd163e99121e tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] 10.222.0.23 "GET /compute/v2.1/servers/2273534d-1c30-4664-b353-4c0aea1dc4c6" status: 404 len: 111 microversion: 2.21 time: 0.051121 Sep 10 11:57:06.735932 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1985/3969] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:57:06 2022] GET /compute/v2.1/servers/2273534d-1c30-4664-b353-4c0aea1dc4c6 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:57:06.739532 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e53c520d-e283-4c38-bdd6-8c2a88016245 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76" status: 200 len: 1455 microversion: 2.1 time: 0.056313 Sep 10 11:57:06.739532 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1985/3970] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:57:06 2022] GET /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76 => generated 1455 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:06.744992 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b9426026-6018-4ace-98eb-2f0b730a71ed tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Calling method '.version_select at 0x7f4071fb5e50>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:06.745770 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b9426026-6018-4ace-98eb-2f0b730a71ed tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] [instance: 2273534d-1c30-4664-b353-4c0aea1dc4c6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:06.753029 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9426026-6018-4ace-98eb-2f0b730a71ed tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:06.753710 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9426026-6018-4ace-98eb-2f0b730a71ed tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:06.754158 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9426026-6018-4ace-98eb-2f0b730a71ed tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:06.754877 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9426026-6018-4ace-98eb-2f0b730a71ed tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:06.755367 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9426026-6018-4ace-98eb-2f0b730a71ed tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:06.755802 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9426026-6018-4ace-98eb-2f0b730a71ed tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:06.831656 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b9426026-6018-4ace-98eb-2f0b730a71ed tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] 10.222.0.23 "GET /compute/v2.1/servers/2273534d-1c30-4664-b353-4c0aea1dc4c6/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.091090 Sep 10 11:57:06.840756 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1986/3971] 10.222.0.23 () {60 vars in 1337 bytes} [Sat Sep 10 11:57:06 2022] GET /compute/v2.1/servers/2273534d-1c30-4664-b353-4c0aea1dc4c6/os-instance-actions => generated 611 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:57:06.845889 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5380db22-8519-45bf-bbcc-8aa95e39f682 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:06.846753 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5380db22-8519-45bf-bbcc-8aa95e39f682 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] [instance: 2273534d-1c30-4664-b353-4c0aea1dc4c6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:06.853230 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5380db22-8519-45bf-bbcc-8aa95e39f682 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:06.854556 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5380db22-8519-45bf-bbcc-8aa95e39f682 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:06.854996 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5380db22-8519-45bf-bbcc-8aa95e39f682 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:06.855896 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5380db22-8519-45bf-bbcc-8aa95e39f682 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:06.856628 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5380db22-8519-45bf-bbcc-8aa95e39f682 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:06.857066 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5380db22-8519-45bf-bbcc-8aa95e39f682 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:06.872492 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-5380db22-8519-45bf-bbcc-8aa95e39f682 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] HTTP exception thrown: Instance 2273534d-1c30-4664-b353-4c0aea1dc4c6 could not be found. Sep 10 11:57:06.873897 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a6f8069b-fca4-485c-95f1-009dce56c931 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:06.874532 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a6f8069b-fca4-485c-95f1-009dce56c931 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5380db22-8519-45bf-bbcc-8aa95e39f682 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Request method failure captured: Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/servers/2273534d-1c30-4664-b353-4c0aea1dc4c6 HTTP/1.1 Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHt_z-NEaO74iPjKf9lE2gpNSPJlYcm_Y2dQQbzXiMGJC-RzSsY0cMUkDgneU3ykAlNxZURtvmHLRgqE1GP96RbT_fdbxJ2lJS2MGo_xCSv6xENj5mch4PyxahD-rjKwSxiB2g6ZarcdlPmu6ozVjVOHnIrbCS88_Wq1D16mi2XwfRo Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: X-Openstack-Nova-Api-Version: 2.21 Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 3436b7d949394ec28528c82b4a9124b9 Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1483293198 Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3436b7d949394ec28528c82b4a9124b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3436b7d949394ec28528c82b4a9124b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3436b7d949394ec28528c82b4a9124b9", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3436b7d949394ec28528c82b4a9124b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-InstanceActionsV221TestJSON-1483293198 Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 3436b7d949394ec28528c82b4a9124b9 Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1483293198 Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-InstanceActionsV221TestJSON-1483293198-project Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 516e2700c7ce4f0ca6fc38bcfd6b7fa5 Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-InstanceActionsV221TestJSON-1483293198-project Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 2273534d-1c30-4664-b353-4c0aea1dc4c6 could not be found. Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '2273534d-1c30-4664-b353-4c0aea1dc4c6'} Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2273534d-1c30-4664-b353-4c0aea1dc4c6 could not be found. Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:57:06.874750 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:57:06.878806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2273534d-1c30-4664-b353-4c0aea1dc4c6 could not be found. Sep 10 11:57:06.878806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:57:06.878806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:57:06.878806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:57:06.878806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:57:06.878806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:57:06.878806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:57:06.878806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:57:06.878806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:57:06.878806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2273534d-1c30-4664-b353-4c0aea1dc4c6 could not be found. Sep 10 11:57:06.878806 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:57:06.880187 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5380db22-8519-45bf-bbcc-8aa95e39f682 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Returning 404 to user: Instance 2273534d-1c30-4664-b353-4c0aea1dc4c6 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:57:06.881239 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5380db22-8519-45bf-bbcc-8aa95e39f682 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2273534d-1c30-4664-b353-4c0aea1dc4c6" status: 404 len: 111 microversion: 2.21 time: 0.039404 Sep 10 11:57:06.881818 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1986/3972] 10.222.0.23 () {60 vars in 1280 bytes} [Sat Sep 10 11:57:06 2022] DELETE /compute/v2.1/servers/2273534d-1c30-4664-b353-4c0aea1dc4c6 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:57:06.885761 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a6f8069b-fca4-485c-95f1-009dce56c931 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:06.885761 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a6f8069b-fca4-485c-95f1-009dce56c931 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:06.885761 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a6f8069b-fca4-485c-95f1-009dce56c931 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:06.886468 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a6f8069b-fca4-485c-95f1-009dce56c931 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:06.889428 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a6f8069b-fca4-485c-95f1-009dce56c931 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:06.889900 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a6f8069b-fca4-485c-95f1-009dce56c931 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:06.893604 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c0df09d4-2a13-45cf-ab2a-dfaf324dd124 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:06.895481 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c0df09d4-2a13-45cf-ab2a-dfaf324dd124 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] [instance: 2273534d-1c30-4664-b353-4c0aea1dc4c6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:06.902866 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:57:06.905570 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0df09d4-2a13-45cf-ab2a-dfaf324dd124 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:06.906261 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0df09d4-2a13-45cf-ab2a-dfaf324dd124 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:06.906917 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0df09d4-2a13-45cf-ab2a-dfaf324dd124 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:06.907830 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0df09d4-2a13-45cf-ab2a-dfaf324dd124 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:06.908442 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0df09d4-2a13-45cf-ab2a-dfaf324dd124 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:06.908878 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0df09d4-2a13-45cf-ab2a-dfaf324dd124 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:06.930708 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-c0df09d4-2a13-45cf-ab2a-dfaf324dd124 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] HTTP exception thrown: Instance 2273534d-1c30-4664-b353-4c0aea1dc4c6 could not be found. Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c0df09d4-2a13-45cf-ab2a-dfaf324dd124 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Request method failure captured: Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/2273534d-1c30-4664-b353-4c0aea1dc4c6 HTTP/1.1 Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHt_z-NEaO74iPjKf9lE2gpNSPJlYcm_Y2dQQbzXiMGJC-RzSsY0cMUkDgneU3ykAlNxZURtvmHLRgqE1GP96RbT_fdbxJ2lJS2MGo_xCSv6xENj5mch4PyxahD-rjKwSxiB2g6ZarcdlPmu6ozVjVOHnIrbCS88_Wq1D16mi2XwfRo Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: X-Openstack-Nova-Api-Version: 2.21 Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 3436b7d949394ec28528c82b4a9124b9 Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1483293198 Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3436b7d949394ec28528c82b4a9124b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3436b7d949394ec28528c82b4a9124b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3436b7d949394ec28528c82b4a9124b9", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3436b7d949394ec28528c82b4a9124b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-InstanceActionsV221TestJSON-1483293198 Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 3436b7d949394ec28528c82b4a9124b9 Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1483293198 Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-InstanceActionsV221TestJSON-1483293198-project Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 516e2700c7ce4f0ca6fc38bcfd6b7fa5 Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-InstanceActionsV221TestJSON-1483293198-project Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 2273534d-1c30-4664-b353-4c0aea1dc4c6 could not be found. Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '2273534d-1c30-4664-b353-4c0aea1dc4c6'} Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2273534d-1c30-4664-b353-4c0aea1dc4c6 could not be found. Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2273534d-1c30-4664-b353-4c0aea1dc4c6 could not be found. Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:57:06.933236 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:57:06.938008 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:57:06.938008 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:57:06.938008 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:57:06.938008 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:57:06.938008 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:57:06.938008 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:57:06.938008 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2273534d-1c30-4664-b353-4c0aea1dc4c6 could not be found. Sep 10 11:57:06.938008 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:57:06.938008 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c0df09d4-2a13-45cf-ab2a-dfaf324dd124 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] Returning 404 to user: Instance 2273534d-1c30-4664-b353-4c0aea1dc4c6 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:57:06.939448 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c0df09d4-2a13-45cf-ab2a-dfaf324dd124 tempest-InstanceActionsV221TestJSON-1483293198 tempest-InstanceActionsV221TestJSON-1483293198-project] 10.222.0.23 "GET /compute/v2.1/servers/2273534d-1c30-4664-b353-4c0aea1dc4c6" status: 404 len: 111 microversion: 2.21 time: 0.050932 Sep 10 11:57:06.939859 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1987/3973] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:57:06 2022] GET /compute/v2.1/servers/2273534d-1c30-4664-b353-4c0aea1dc4c6 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:57:07.178755 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a6f8069b-fca4-485c-95f1-009dce56c931 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:07.190745 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a6f8069b-fca4-485c-95f1-009dce56c931 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1505 microversion: 2.1 time: 0.320577 Sep 10 11:57:07.192007 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1987/3974] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:06 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1505 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:57:07.701840 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4ed7b162-a86a-42e0-9c26-84e420bad7bd tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:07.709558 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-56760eb9-e946-4593-87f5-91e49aac1fbe tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:07.710520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-56760eb9-e946-4593-87f5-91e49aac1fbe tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 476ea519-5dea-4143-93b7-46458d92bab3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:07.714289 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4ed7b162-a86a-42e0-9c26-84e420bad7bd tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:07.722949 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-56760eb9-e946-4593-87f5-91e49aac1fbe tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:07.724168 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-56760eb9-e946-4593-87f5-91e49aac1fbe tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:07.725098 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-56760eb9-e946-4593-87f5-91e49aac1fbe tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:07.726651 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-56760eb9-e946-4593-87f5-91e49aac1fbe tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:07.727481 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-56760eb9-e946-4593-87f5-91e49aac1fbe tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:07.728534 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-56760eb9-e946-4593-87f5-91e49aac1fbe tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:07.735838 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ed7b162-a86a-42e0-9c26-84e420bad7bd tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:07.736505 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ed7b162-a86a-42e0-9c26-84e420bad7bd tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:07.738605 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ed7b162-a86a-42e0-9c26-84e420bad7bd tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:07.741569 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ed7b162-a86a-42e0-9c26-84e420bad7bd tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:07.742433 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ed7b162-a86a-42e0-9c26-84e420bad7bd tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:07.747575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ed7b162-a86a-42e0-9c26-84e420bad7bd tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:08.024345 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-56760eb9-e946-4593-87f5-91e49aac1fbe tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:08.041212 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-56760eb9-e946-4593-87f5-91e49aac1fbe tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3" status: 200 len: 1502 microversion: 2.1 time: 0.335237 Sep 10 11:57:08.068835 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1988/3975] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:07 2022] GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3 => generated 1502 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:57:08.076361 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4bb53d61-fc3c-4d11-8f54-17cb503b94bd tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f407b4f3af0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:08.141007 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4ed7b162-a86a-42e0-9c26-84e420bad7bd tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:08.151976 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4ed7b162-a86a-42e0-9c26-84e420bad7bd tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:08.154070 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4ed7b162-a86a-42e0-9c26-84e420bad7bd tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:08.155597 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4ed7b162-a86a-42e0-9c26-84e420bad7bd tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1723 microversion: 2.20 time: 0.462168 Sep 10 11:57:08.157585 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1988/3976] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:57:07 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1723 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:57:08.158950 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4bb53d61-fc3c-4d11-8f54-17cb503b94bd tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76" status: 200 len: 1455 microversion: 2.1 time: 0.088475 Sep 10 11:57:08.163653 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f59fa0e2-b818-49dd-be0d-1ce8352eaaa4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:57:08.164616 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f59fa0e2-b818-49dd-be0d-1ce8352eaaa4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 476ea519-5dea-4143-93b7-46458d92bab3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:08.167074 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1989/3977] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:57:08 2022] GET /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76 => generated 1455 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:08.172143 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f59fa0e2-b818-49dd-be0d-1ce8352eaaa4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:08.172903 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f59fa0e2-b818-49dd-be0d-1ce8352eaaa4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:08.173577 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f59fa0e2-b818-49dd-be0d-1ce8352eaaa4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:08.174673 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f59fa0e2-b818-49dd-be0d-1ce8352eaaa4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:08.175387 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f59fa0e2-b818-49dd-be0d-1ce8352eaaa4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:08.176065 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f59fa0e2-b818-49dd-be0d-1ce8352eaaa4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:08.216064 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ef4727ae-5fc5-477f-bce9-dc35b43c6f3e tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:08.216984 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ef4727ae-5fc5-477f-bce9-dc35b43c6f3e tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:08.227742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ef4727ae-5fc5-477f-bce9-dc35b43c6f3e tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:08.229040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ef4727ae-5fc5-477f-bce9-dc35b43c6f3e tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:08.231669 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ef4727ae-5fc5-477f-bce9-dc35b43c6f3e tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:08.232882 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ef4727ae-5fc5-477f-bce9-dc35b43c6f3e tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:08.233477 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ef4727ae-5fc5-477f-bce9-dc35b43c6f3e tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:08.235951 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ef4727ae-5fc5-477f-bce9-dc35b43c6f3e tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:08.298548 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f59fa0e2-b818-49dd-be0d-1ce8352eaaa4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "POST /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3/action" status: 202 len: 0 microversion: 2.1 time: 0.138972 Sep 10 11:57:08.318007 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1989/3978] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:57:08 2022] POST /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:57:08.330138 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b456e061-fcac-4943-9b1d-72afc3725b5d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:08.330857 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b456e061-fcac-4943-9b1d-72afc3725b5d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 476ea519-5dea-4143-93b7-46458d92bab3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:08.341454 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b456e061-fcac-4943-9b1d-72afc3725b5d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:08.341959 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b456e061-fcac-4943-9b1d-72afc3725b5d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:08.342415 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b456e061-fcac-4943-9b1d-72afc3725b5d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:08.343307 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b456e061-fcac-4943-9b1d-72afc3725b5d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:08.343775 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b456e061-fcac-4943-9b1d-72afc3725b5d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:08.345631 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b456e061-fcac-4943-9b1d-72afc3725b5d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:08.590308 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ef4727ae-5fc5-477f-bce9-dc35b43c6f3e tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:08.605615 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ef4727ae-5fc5-477f-bce9-dc35b43c6f3e tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1485 microversion: 2.1 time: 0.395389 Sep 10 11:57:08.606386 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1990/3979] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:08 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1485 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:08.633498 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-25b53d25-cbcf-4fd7-aded-923c2ed362b6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:57:08.634107 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-25b53d25-cbcf-4fd7-aded-923c2ed362b6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:08.636018 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b456e061-fcac-4943-9b1d-72afc3725b5d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:08.650238 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b456e061-fcac-4943-9b1d-72afc3725b5d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3" status: 200 len: 1507 microversion: 2.1 time: 0.329613 Sep 10 11:57:08.651691 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1990/3980] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:08 2022] GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3 => generated 1507 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:08.660299 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25b53d25-cbcf-4fd7-aded-923c2ed362b6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:08.662376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25b53d25-cbcf-4fd7-aded-923c2ed362b6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:08.662845 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25b53d25-cbcf-4fd7-aded-923c2ed362b6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:08.666687 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25b53d25-cbcf-4fd7-aded-923c2ed362b6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:08.667446 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25b53d25-cbcf-4fd7-aded-923c2ed362b6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:08.667840 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25b53d25-cbcf-4fd7-aded-923c2ed362b6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:08.788139 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-25b53d25-cbcf-4fd7-aded-923c2ed362b6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "POST /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607/action" status: 202 len: 0 microversion: 2.1 time: 0.157971 Sep 10 11:57:08.789279 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1991/3981] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:57:08 2022] POST /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 11:57:08.798495 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-979e5538-2ecf-4022-8b5b-db12afca989f tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:08.799718 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-979e5538-2ecf-4022-8b5b-db12afca989f tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:08.807050 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-979e5538-2ecf-4022-8b5b-db12afca989f tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:08.807875 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-979e5538-2ecf-4022-8b5b-db12afca989f tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:08.808483 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-979e5538-2ecf-4022-8b5b-db12afca989f tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:08.809395 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-979e5538-2ecf-4022-8b5b-db12afca989f tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:08.810103 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-979e5538-2ecf-4022-8b5b-db12afca989f tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:08.810831 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-979e5538-2ecf-4022-8b5b-db12afca989f tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:09.118324 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-979e5538-2ecf-4022-8b5b-db12afca989f tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:09.136089 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-979e5538-2ecf-4022-8b5b-db12afca989f tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1493 microversion: 2.1 time: 0.334130 Sep 10 11:57:09.145609 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1991/3982] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:08 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1493 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:09.175210 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a4aa80fa-470e-4663-a96d-42d19224eb8e tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4073eabd30>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:09.189724 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c291ad09-d6ef-43f1-ae5b-2957cd856562 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:09.190514 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c291ad09-d6ef-43f1-ae5b-2957cd856562 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:09.204852 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c291ad09-d6ef-43f1-ae5b-2957cd856562 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:09.205485 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c291ad09-d6ef-43f1-ae5b-2957cd856562 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:09.206024 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c291ad09-d6ef-43f1-ae5b-2957cd856562 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:09.208333 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c291ad09-d6ef-43f1-ae5b-2957cd856562 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:09.209196 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c291ad09-d6ef-43f1-ae5b-2957cd856562 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:09.215887 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c291ad09-d6ef-43f1-ae5b-2957cd856562 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:09.254273 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a4aa80fa-470e-4663-a96d-42d19224eb8e tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76" status: 200 len: 1455 microversion: 2.1 time: 0.083731 Sep 10 11:57:09.255089 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1992/3983] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:57:09 2022] GET /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76 => generated 1455 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:09.573466 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c291ad09-d6ef-43f1-ae5b-2957cd856562 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:09.592159 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c291ad09-d6ef-43f1-ae5b-2957cd856562 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:09.600412 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c291ad09-d6ef-43f1-ae5b-2957cd856562 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:09.611403 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c291ad09-d6ef-43f1-ae5b-2957cd856562 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1723 microversion: 2.20 time: 0.421501 Sep 10 11:57:09.612456 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1992/3984] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:57:09 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1723 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:57:09.675674 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8c6b27ca-08bf-4e77-9bb9-adc6a8673283 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:09.676337 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8c6b27ca-08bf-4e77-9bb9-adc6a8673283 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 476ea519-5dea-4143-93b7-46458d92bab3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:09.691320 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c6b27ca-08bf-4e77-9bb9-adc6a8673283 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:09.691974 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c6b27ca-08bf-4e77-9bb9-adc6a8673283 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:09.692242 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c6b27ca-08bf-4e77-9bb9-adc6a8673283 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:09.692945 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c6b27ca-08bf-4e77-9bb9-adc6a8673283 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:09.693397 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c6b27ca-08bf-4e77-9bb9-adc6a8673283 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:09.693825 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c6b27ca-08bf-4e77-9bb9-adc6a8673283 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:10.075723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8c6b27ca-08bf-4e77-9bb9-adc6a8673283 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:10.082159 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:57:10.084651 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8c6b27ca-08bf-4e77-9bb9-adc6a8673283 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3" status: 200 len: 1487 microversion: 2.1 time: 0.413007 Sep 10 11:57:10.095419 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1993/3985] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:09 2022] GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3 => generated 1487 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:10.109408 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-eee07aa6-57d8-42e3-9ce1-8c542df8a70b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:10.110564 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-eee07aa6-57d8-42e3-9ce1-8c542df8a70b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 476ea519-5dea-4143-93b7-46458d92bab3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:10.129965 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eee07aa6-57d8-42e3-9ce1-8c542df8a70b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:10.130467 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eee07aa6-57d8-42e3-9ce1-8c542df8a70b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:10.130917 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eee07aa6-57d8-42e3-9ce1-8c542df8a70b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:10.131670 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eee07aa6-57d8-42e3-9ce1-8c542df8a70b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:10.133591 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eee07aa6-57d8-42e3-9ce1-8c542df8a70b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:10.134068 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eee07aa6-57d8-42e3-9ce1-8c542df8a70b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:10.156971 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6ddf62c5-087d-4849-9993-6cfd4705615b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:10.157597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6ddf62c5-087d-4849-9993-6cfd4705615b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:10.166963 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6ddf62c5-087d-4849-9993-6cfd4705615b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:10.167508 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6ddf62c5-087d-4849-9993-6cfd4705615b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:10.167954 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6ddf62c5-087d-4849-9993-6cfd4705615b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:10.168680 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6ddf62c5-087d-4849-9993-6cfd4705615b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:10.169145 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6ddf62c5-087d-4849-9993-6cfd4705615b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:10.186127 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6ddf62c5-087d-4849-9993-6cfd4705615b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:10.216669 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-eee07aa6-57d8-42e3-9ce1-8c542df8a70b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 476ea519-5dea-4143-93b7-46458d92bab3] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:57:10.315788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:57:10.363267 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-eee07aa6-57d8-42e3-9ce1-8c542df8a70b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "DELETE /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3" status: 204 len: 0 microversion: 2.1 time: 0.259392 Sep 10 11:57:10.364420 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1993/3986] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:57:10 2022] DELETE /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:57:10.371011 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-97276f25-09d5-49fb-a882-a423c831729f tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4072c0fa60>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:10.483309 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-97276f25-09d5-49fb-a882-a423c831729f tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76" status: 200 len: 1455 microversion: 2.1 time: 0.117382 Sep 10 11:57:10.484097 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1994/3987] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:57:10 2022] GET /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76 => generated 1455 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:10.492502 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-25c485f3-10e2-43c0-9bb3-c6f96a79ad22 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:10.493378 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-25c485f3-10e2-43c0-9bb3-c6f96a79ad22 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 476ea519-5dea-4143-93b7-46458d92bab3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:10.496557 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6ddf62c5-087d-4849-9993-6cfd4705615b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:10.512748 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6ddf62c5-087d-4849-9993-6cfd4705615b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1493 microversion: 2.1 time: 0.359159 Sep 10 11:57:10.513898 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1994/3988] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:10 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1493 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:10.524144 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-25c485f3-10e2-43c0-9bb3-c6f96a79ad22 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:10.525038 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-25c485f3-10e2-43c0-9bb3-c6f96a79ad22 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:10.526355 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-25c485f3-10e2-43c0-9bb3-c6f96a79ad22 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:10.534486 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-25c485f3-10e2-43c0-9bb3-c6f96a79ad22 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:10.538321 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-25c485f3-10e2-43c0-9bb3-c6f96a79ad22 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:10.541603 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-25c485f3-10e2-43c0-9bb3-c6f96a79ad22 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:10.638517 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-911fb378-1eaf-490f-8767-9ee94d5ec1a8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:10.639698 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-911fb378-1eaf-490f-8767-9ee94d5ec1a8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:10.652358 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-911fb378-1eaf-490f-8767-9ee94d5ec1a8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:10.653168 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-911fb378-1eaf-490f-8767-9ee94d5ec1a8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:10.655334 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-911fb378-1eaf-490f-8767-9ee94d5ec1a8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:10.657146 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-911fb378-1eaf-490f-8767-9ee94d5ec1a8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:10.659313 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-911fb378-1eaf-490f-8767-9ee94d5ec1a8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:10.661940 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-911fb378-1eaf-490f-8767-9ee94d5ec1a8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:11.557890 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-25c485f3-10e2-43c0-9bb3-c6f96a79ad22 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:11.569146 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-25c485f3-10e2-43c0-9bb3-c6f96a79ad22 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3" status: 200 len: 1493 microversion: 2.1 time: 1.083925 Sep 10 11:57:11.588427 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1995/3989] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:10 2022] GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3 => generated 1493 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:11.600186 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ba9ca4c7-add5-4681-89be-0842a9e9ca24 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f40733cbb80>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:11.633783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-911fb378-1eaf-490f-8767-9ee94d5ec1a8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:11.654112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-911fb378-1eaf-490f-8767-9ee94d5ec1a8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:11.657585 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-911fb378-1eaf-490f-8767-9ee94d5ec1a8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:11.657585 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-911fb378-1eaf-490f-8767-9ee94d5ec1a8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1723 microversion: 2.20 time: 1.023043 Sep 10 11:57:11.657947 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1995/3990] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:57:10 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1723 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:57:11.663145 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-08a5fd1d-6a28-4e42-9241-3fcf2a2e9522 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:11.663797 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-08a5fd1d-6a28-4e42-9241-3fcf2a2e9522 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:11.668874 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ba9ca4c7-add5-4681-89be-0842a9e9ca24 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76" status: 200 len: 1455 microversion: 2.1 time: 0.078861 Sep 10 11:57:11.672569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-08a5fd1d-6a28-4e42-9241-3fcf2a2e9522 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:11.673063 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-08a5fd1d-6a28-4e42-9241-3fcf2a2e9522 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:11.673506 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-08a5fd1d-6a28-4e42-9241-3fcf2a2e9522 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:11.674212 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-08a5fd1d-6a28-4e42-9241-3fcf2a2e9522 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:11.674667 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-08a5fd1d-6a28-4e42-9241-3fcf2a2e9522 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:11.675094 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-08a5fd1d-6a28-4e42-9241-3fcf2a2e9522 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:11.677800 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1996/3991] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:57:11 2022] GET /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76 => generated 1455 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:11.911676 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-08a5fd1d-6a28-4e42-9241-3fcf2a2e9522 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:11.925437 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-08a5fd1d-6a28-4e42-9241-3fcf2a2e9522 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1493 microversion: 2.1 time: 0.266400 Sep 10 11:57:11.926594 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1996/3992] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:11 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1493 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:12.598433 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0ad04174-4a51-41e1-a905-da0735510074 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:12.608986 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0ad04174-4a51-41e1-a905-da0735510074 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 476ea519-5dea-4143-93b7-46458d92bab3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:12.649303 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ad04174-4a51-41e1-a905-da0735510074 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:12.652434 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ad04174-4a51-41e1-a905-da0735510074 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:12.653023 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ad04174-4a51-41e1-a905-da0735510074 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:12.653784 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ad04174-4a51-41e1-a905-da0735510074 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:12.656636 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ad04174-4a51-41e1-a905-da0735510074 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:12.669826 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ad04174-4a51-41e1-a905-da0735510074 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:12.684245 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6ac2d59e-6d7f-4a66-b207-5f6051404f7a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:12.684862 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6ac2d59e-6d7f-4a66-b207-5f6051404f7a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:12.698446 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6ac2d59e-6d7f-4a66-b207-5f6051404f7a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:12.698930 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6ac2d59e-6d7f-4a66-b207-5f6051404f7a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:12.699365 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6ac2d59e-6d7f-4a66-b207-5f6051404f7a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:12.718694 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6ac2d59e-6d7f-4a66-b207-5f6051404f7a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:12.719196 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6ac2d59e-6d7f-4a66-b207-5f6051404f7a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:12.734307 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6ac2d59e-6d7f-4a66-b207-5f6051404f7a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:13.274139 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0ad04174-4a51-41e1-a905-da0735510074 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:13.282767 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0ad04174-4a51-41e1-a905-da0735510074 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3" status: 200 len: 1493 microversion: 2.1 time: 0.688769 Sep 10 11:57:13.303700 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1997/3993] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:12 2022] GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3 => generated 1493 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:13.308861 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e7ed651e-e141-48f3-93bf-18d7b602f118 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f40733e8c10>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:13.382438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6ac2d59e-6d7f-4a66-b207-5f6051404f7a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:13.396662 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6ac2d59e-6d7f-4a66-b207-5f6051404f7a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:13.399037 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6ac2d59e-6d7f-4a66-b207-5f6051404f7a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:13.404282 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6ac2d59e-6d7f-4a66-b207-5f6051404f7a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1744 microversion: 2.20 time: 0.724135 Sep 10 11:57:13.420649 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1997/3994] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:57:12 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1744 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:57:13.432421 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-65cf21bf-618d-4b35-ae31-60f01d56fa7a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:13.433034 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-65cf21bf-618d-4b35-ae31-60f01d56fa7a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:13.451659 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-65cf21bf-618d-4b35-ae31-60f01d56fa7a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:13.452469 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-65cf21bf-618d-4b35-ae31-60f01d56fa7a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:13.453708 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-65cf21bf-618d-4b35-ae31-60f01d56fa7a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:13.454659 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-65cf21bf-618d-4b35-ae31-60f01d56fa7a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:13.455374 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-65cf21bf-618d-4b35-ae31-60f01d56fa7a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:13.477068 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-65cf21bf-618d-4b35-ae31-60f01d56fa7a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:13.548126 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e7ed651e-e141-48f3-93bf-18d7b602f118 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76" status: 200 len: 1455 microversion: 2.1 time: 0.242657 Sep 10 11:57:13.550291 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1998/3995] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:57:13 2022] GET /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76 => generated 1455 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:13.914016 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-65cf21bf-618d-4b35-ae31-60f01d56fa7a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:13.926904 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-65cf21bf-618d-4b35-ae31-60f01d56fa7a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1493 microversion: 2.1 time: 0.504843 Sep 10 11:57:13.930928 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1998/3996] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:13 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1493 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:14.311394 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-78afdcfc-6256-4484-8339-0c9112f22f08 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:14.315819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-78afdcfc-6256-4484-8339-0c9112f22f08 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 476ea519-5dea-4143-93b7-46458d92bab3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:14.334622 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-78afdcfc-6256-4484-8339-0c9112f22f08 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:14.335113 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-78afdcfc-6256-4484-8339-0c9112f22f08 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:14.335737 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-78afdcfc-6256-4484-8339-0c9112f22f08 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:14.337108 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-78afdcfc-6256-4484-8339-0c9112f22f08 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:14.337899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-78afdcfc-6256-4484-8339-0c9112f22f08 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:14.338491 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-78afdcfc-6256-4484-8339-0c9112f22f08 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:14.435449 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-96ac0f20-c291-4f42-9bd8-78f1127d908e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:14.436590 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-96ac0f20-c291-4f42-9bd8-78f1127d908e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:14.449423 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-96ac0f20-c291-4f42-9bd8-78f1127d908e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:14.452780 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-96ac0f20-c291-4f42-9bd8-78f1127d908e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:14.471662 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-96ac0f20-c291-4f42-9bd8-78f1127d908e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:14.472988 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-96ac0f20-c291-4f42-9bd8-78f1127d908e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:14.478256 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-96ac0f20-c291-4f42-9bd8-78f1127d908e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:14.482820 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-96ac0f20-c291-4f42-9bd8-78f1127d908e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:14.846697 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-78afdcfc-6256-4484-8339-0c9112f22f08 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:14.867625 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-78afdcfc-6256-4484-8339-0c9112f22f08 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3" status: 200 len: 1493 microversion: 2.1 time: 0.560009 Sep 10 11:57:14.868353 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 1999/3997] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:14 2022] GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3 => generated 1493 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:14.890602 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bb99ac00-067e-4240-80af-8d36026180a0 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f40729fd550>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:15.978711 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-96ac0f20-c291-4f42-9bd8-78f1127d908e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:15.991193 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-96ac0f20-c291-4f42-9bd8-78f1127d908e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:16.019466 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-96ac0f20-c291-4f42-9bd8-78f1127d908e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:16.022336 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-96ac0f20-c291-4f42-9bd8-78f1127d908e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1739 microversion: 2.20 time: 1.592137 Sep 10 11:57:16.058395 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 1999/3998] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:57:14 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1739 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:57:16.077939 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-18b7516e-012a-4ae3-97b4-7b1471c77f20 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:16.080150 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-18b7516e-012a-4ae3-97b4-7b1471c77f20 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:16.102506 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-18b7516e-012a-4ae3-97b4-7b1471c77f20 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:16.104625 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-18b7516e-012a-4ae3-97b4-7b1471c77f20 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:16.107816 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-18b7516e-012a-4ae3-97b4-7b1471c77f20 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:16.108817 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-18b7516e-012a-4ae3-97b4-7b1471c77f20 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:16.109383 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-18b7516e-012a-4ae3-97b4-7b1471c77f20 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:16.110003 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-18b7516e-012a-4ae3-97b4-7b1471c77f20 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:16.603699 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-18b7516e-012a-4ae3-97b4-7b1471c77f20 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:16.621232 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-18b7516e-012a-4ae3-97b4-7b1471c77f20 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1499 microversion: 2.1 time: 0.561281 Sep 10 11:57:16.632126 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2000/3999] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:16 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1499 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:16.647029 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-58f8e53b-aa76-4a70-8f20-c2ac17700fc9 req-6dc5f333-d3a5-4699-97c2-b8c7d0a92f7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39f90b6f-123c-451f-8f7a-dbe291a5d4a7", "name": "network-vif-plugged", "status": "completed", "tag": "c38ed82a-b2c8-4c91-b325-3aed6429f4b0"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:57:16.675113 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-58f8e53b-aa76-4a70-8f20-c2ac17700fc9 req-6dc5f333-d3a5-4699-97c2-b8c7d0a92f7a service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:16.675928 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-58f8e53b-aa76-4a70-8f20-c2ac17700fc9 req-6dc5f333-d3a5-4699-97c2-b8c7d0a92f7a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:16.676373 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-58f8e53b-aa76-4a70-8f20-c2ac17700fc9 req-6dc5f333-d3a5-4699-97c2-b8c7d0a92f7a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:16.698819 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-58f8e53b-aa76-4a70-8f20-c2ac17700fc9 req-6dc5f333-d3a5-4699-97c2-b8c7d0a92f7a service nova] Creating event network-vif-plugged:c38ed82a-b2c8-4c91-b325-3aed6429f4b0 for instance 39f90b6f-123c-451f-8f7a-dbe291a5d4a7 on n-h2-856895-1 Sep 10 11:57:16.721034 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-58f8e53b-aa76-4a70-8f20-c2ac17700fc9 req-6dc5f333-d3a5-4699-97c2-b8c7d0a92f7a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087442 Sep 10 11:57:16.722215 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2001/4000] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:57:16.727930 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7f35f0c4-e03a-4b24-9150-d9156ab6e07e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:16.736167 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7f35f0c4-e03a-4b24-9150-d9156ab6e07e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 476ea519-5dea-4143-93b7-46458d92bab3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:16.748992 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f35f0c4-e03a-4b24-9150-d9156ab6e07e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:16.756609 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f35f0c4-e03a-4b24-9150-d9156ab6e07e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:16.757231 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f35f0c4-e03a-4b24-9150-d9156ab6e07e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:16.758519 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f35f0c4-e03a-4b24-9150-d9156ab6e07e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:16.759328 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f35f0c4-e03a-4b24-9150-d9156ab6e07e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:16.760254 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f35f0c4-e03a-4b24-9150-d9156ab6e07e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:16.841448 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f35f0c4-e03a-4b24-9150-d9156ab6e07e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:16.842257 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f35f0c4-e03a-4b24-9150-d9156ab6e07e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:16.842946 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f35f0c4-e03a-4b24-9150-d9156ab6e07e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:16.843700 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-7f35f0c4-e03a-4b24-9150-d9156ab6e07e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lazy-loading 'fault' on Instance uuid 476ea519-5dea-4143-93b7-46458d92bab3 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:57:16.923405 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7f35f0c4-e03a-4b24-9150-d9156ab6e07e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:16.936245 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7f35f0c4-e03a-4b24-9150-d9156ab6e07e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3" status: 200 len: 1305 microversion: 2.1 time: 0.212658 Sep 10 11:57:16.947878 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2002/4001] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:16 2022] GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3 => generated 1305 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:16.959845 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-4b957521-4e1e-4a45-9a9a-482f6a723f01 req-2a84c17e-ae5c-4c21-a1b5-1bbd9b950151 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "476ea519-5dea-4143-93b7-46458d92bab3", "name": "network-vif-deleted", "tag": "e56519e6-c900-4deb-83d2-d13cf2311767"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:57:16.971333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-4b957521-4e1e-4a45-9a9a-482f6a723f01 req-2a84c17e-ae5c-4c21-a1b5-1bbd9b950151 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:16.972025 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-4b957521-4e1e-4a45-9a9a-482f6a723f01 req-2a84c17e-ae5c-4c21-a1b5-1bbd9b950151 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:16.972636 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-4b957521-4e1e-4a45-9a9a-482f6a723f01 req-2a84c17e-ae5c-4c21-a1b5-1bbd9b950151 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:16.989785 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-4b957521-4e1e-4a45-9a9a-482f6a723f01 req-2a84c17e-ae5c-4c21-a1b5-1bbd9b950151 service nova] Creating event network-vif-deleted:e56519e6-c900-4deb-83d2-d13cf2311767 for instance 476ea519-5dea-4143-93b7-46458d92bab3 on n-h1-856895-1 Sep 10 11:57:16.997269 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-4b957521-4e1e-4a45-9a9a-482f6a723f01 req-2a84c17e-ae5c-4c21-a1b5-1bbd9b950151 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047578 Sep 10 11:57:17.002710 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2003/4002] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:57:17.008921 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bcee27c2-692a-4077-8eb3-8e5883405843 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:17.010631 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bcee27c2-692a-4077-8eb3-8e5883405843 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:17.018727 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bcee27c2-692a-4077-8eb3-8e5883405843 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:17.020142 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bcee27c2-692a-4077-8eb3-8e5883405843 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:17.021347 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bcee27c2-692a-4077-8eb3-8e5883405843 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:17.022338 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bcee27c2-692a-4077-8eb3-8e5883405843 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:17.023028 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bcee27c2-692a-4077-8eb3-8e5883405843 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:17.023829 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bcee27c2-692a-4077-8eb3-8e5883405843 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:17.061218 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bcee27c2-692a-4077-8eb3-8e5883405843 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:57:17.248711 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bcee27c2-692a-4077-8eb3-8e5883405843 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 204 len: 0 microversion: 2.1 time: 0.244077 Sep 10 11:57:17.249864 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2004/4003] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:57:17 2022] DELETE /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:57:17.255629 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a41abfa9-45ff-4a0a-982c-fe9aff14fe55 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:17.256592 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a41abfa9-45ff-4a0a-982c-fe9aff14fe55 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:17.273245 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a41abfa9-45ff-4a0a-982c-fe9aff14fe55 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:17.277863 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a41abfa9-45ff-4a0a-982c-fe9aff14fe55 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:17.278614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a41abfa9-45ff-4a0a-982c-fe9aff14fe55 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:17.279576 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a41abfa9-45ff-4a0a-982c-fe9aff14fe55 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:17.280221 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a41abfa9-45ff-4a0a-982c-fe9aff14fe55 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:17.280845 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a41abfa9-45ff-4a0a-982c-fe9aff14fe55 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:17.626403 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a41abfa9-45ff-4a0a-982c-fe9aff14fe55 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:17.641584 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a41abfa9-45ff-4a0a-982c-fe9aff14fe55 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:17.645278 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a41abfa9-45ff-4a0a-982c-fe9aff14fe55 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:17.650006 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a41abfa9-45ff-4a0a-982c-fe9aff14fe55 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1739 microversion: 2.20 time: 0.396117 Sep 10 11:57:17.651938 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2005/4004] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:57:17 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1739 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:57:17.661555 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-555898cf-a1a0-47a7-a9a8-60b8513b03ab tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:17.662464 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-555898cf-a1a0-47a7-a9a8-60b8513b03ab tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:17.681436 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-555898cf-a1a0-47a7-a9a8-60b8513b03ab tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:17.682314 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-555898cf-a1a0-47a7-a9a8-60b8513b03ab tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:17.683049 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-555898cf-a1a0-47a7-a9a8-60b8513b03ab tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:17.684218 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-555898cf-a1a0-47a7-a9a8-60b8513b03ab tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:17.684894 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-555898cf-a1a0-47a7-a9a8-60b8513b03ab tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:17.685960 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-555898cf-a1a0-47a7-a9a8-60b8513b03ab tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:18.155954 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-555898cf-a1a0-47a7-a9a8-60b8513b03ab tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:18.172699 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-555898cf-a1a0-47a7-a9a8-60b8513b03ab tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1505 microversion: 2.1 time: 0.519363 Sep 10 11:57:18.173880 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2006/4005] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:17 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1505 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:18.182641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3ea95ca6-c414-4b7e-b27b-3bae720d3035 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:18.187057 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3ea95ca6-c414-4b7e-b27b-3bae720d3035 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 476ea519-5dea-4143-93b7-46458d92bab3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:18.205835 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3ea95ca6-c414-4b7e-b27b-3bae720d3035 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:18.212004 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3ea95ca6-c414-4b7e-b27b-3bae720d3035 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:18.213360 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3ea95ca6-c414-4b7e-b27b-3bae720d3035 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:18.214304 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3ea95ca6-c414-4b7e-b27b-3bae720d3035 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:18.218815 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3ea95ca6-c414-4b7e-b27b-3bae720d3035 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:18.219492 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3ea95ca6-c414-4b7e-b27b-3bae720d3035 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:18.242918 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-3ea95ca6-c414-4b7e-b27b-3bae720d3035 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] HTTP exception thrown: Instance 476ea519-5dea-4143-93b7-46458d92bab3 could not be found. Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3ea95ca6-c414-4b7e-b27b-3bae720d3035 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Request method failure captured: Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3 HTTP/1.1 Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHsd-AnnLZFS6-Lbfr9ATef_4cX6EE0Up-a_Ch8dobncDUqljTHX0YcK7WbJaaBcAlN6twvlZe9au1SNJQwC5-nItcb7pEhHjqWyH9GhqCmgS3jEbfUY8st6zk2hVKWMOxRl1E1nEdlCzWIcW0YZf7xPnP7IvCJy_UgVMW4-UpTlv4M Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2f92ad05650840f6bb4c8f6134b489ca", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-DeleteServersTestJSON-419044733 Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-DeleteServersTestJSON-419044733-project Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: d244789bea974bd99d0f1debebabb54a Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-DeleteServersTestJSON-419044733-project Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 476ea519-5dea-4143-93b7-46458d92bab3 could not be found. Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '476ea519-5dea-4143-93b7-46458d92bab3'} Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 476ea519-5dea-4143-93b7-46458d92bab3 could not be found. Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 476ea519-5dea-4143-93b7-46458d92bab3 could not be found. Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:57:18.245076 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:57:18.249201 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:57:18.249201 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:57:18.249201 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:57:18.249201 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:57:18.249201 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:57:18.249201 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 476ea519-5dea-4143-93b7-46458d92bab3 could not be found. Sep 10 11:57:18.249201 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:57:18.250695 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3ea95ca6-c414-4b7e-b27b-3bae720d3035 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Returning 404 to user: Instance 476ea519-5dea-4143-93b7-46458d92bab3 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:57:18.255138 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3ea95ca6-c414-4b7e-b27b-3bae720d3035 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3" status: 404 len: 111 microversion: 2.1 time: 0.079885 Sep 10 11:57:18.256511 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2007/4006] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:18 2022] GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:57:18.484216 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d1a167b0-2610-4312-a36a-cd777d2693bf tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-606581154", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "471bef66-289e-44bc-a38f-0fbd7758b454"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:57:19.041918 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bb99ac00-067e-4240-80af-8d36026180a0 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76" status: 200 len: 1464 microversion: 2.1 time: 4.171792 Sep 10 11:57:19.042526 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2000/4007] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:57:14 2022] GET /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76 => generated 1464 bytes in 4174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:19.062242 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-53cbab39-8a4e-4a55-a5ef-7f1d1f88211b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:19.069000 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-53cbab39-8a4e-4a55-a5ef-7f1d1f88211b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:19.074837 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-d1a167b0-2610-4312-a36a-cd777d2693bf tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] validate_networks() for [('471bef66-289e-44bc-a38f-0fbd7758b454', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:57:19.082695 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53cbab39-8a4e-4a55-a5ef-7f1d1f88211b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:19.089118 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53cbab39-8a4e-4a55-a5ef-7f1d1f88211b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:19.089789 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53cbab39-8a4e-4a55-a5ef-7f1d1f88211b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:19.091522 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53cbab39-8a4e-4a55-a5ef-7f1d1f88211b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:19.092173 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53cbab39-8a4e-4a55-a5ef-7f1d1f88211b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:19.092776 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53cbab39-8a4e-4a55-a5ef-7f1d1f88211b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:19.374631 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-53cbab39-8a4e-4a55-a5ef-7f1d1f88211b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:19.394927 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-53cbab39-8a4e-4a55-a5ef-7f1d1f88211b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:19.399855 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-53cbab39-8a4e-4a55-a5ef-7f1d1f88211b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:19.403384 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-53cbab39-8a4e-4a55-a5ef-7f1d1f88211b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1739 microversion: 2.20 time: 0.358654 Sep 10 11:57:19.406959 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2001/4008] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:57:19 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1739 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:57:19.417862 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f2c4bb27-9533-4485-b2d8-5831f12ccd1a tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f40729fd160>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:19.512644 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f2c4bb27-9533-4485-b2d8-5831f12ccd1a tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76" status: 200 len: 1464 microversion: 2.1 time: 0.104323 Sep 10 11:57:19.513871 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2002/4009] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:57:19 2022] GET /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76 => generated 1464 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:19.518956 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-eab6986a-e100-4e72-88d6-67ed25c85db4 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:19.519792 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-eab6986a-e100-4e72-88d6-67ed25c85db4 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:19.540736 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eab6986a-e100-4e72-88d6-67ed25c85db4 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:19.543540 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eab6986a-e100-4e72-88d6-67ed25c85db4 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:19.544459 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eab6986a-e100-4e72-88d6-67ed25c85db4 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:19.545471 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eab6986a-e100-4e72-88d6-67ed25c85db4 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:19.546160 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eab6986a-e100-4e72-88d6-67ed25c85db4 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:19.546814 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eab6986a-e100-4e72-88d6-67ed25c85db4 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:20.033577 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-eab6986a-e100-4e72-88d6-67ed25c85db4 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:20.044938 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-eab6986a-e100-4e72-88d6-67ed25c85db4 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1505 microversion: 2.1 time: 0.529616 Sep 10 11:57:20.064061 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2003/4010] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:19 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1505 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:20.069741 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a1420642-bbb0-41db-a0aa-a246fc3a53a6 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:20.070381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a1420642-bbb0-41db-a0aa-a246fc3a53a6 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] [instance: aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:20.088096 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a1420642-bbb0-41db-a0aa-a246fc3a53a6 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:20.088845 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a1420642-bbb0-41db-a0aa-a246fc3a53a6 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:20.089440 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a1420642-bbb0-41db-a0aa-a246fc3a53a6 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:20.090348 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a1420642-bbb0-41db-a0aa-a246fc3a53a6 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:20.090958 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a1420642-bbb0-41db-a0aa-a246fc3a53a6 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:20.091579 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a1420642-bbb0-41db-a0aa-a246fc3a53a6 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:20.168443 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d1a167b0-2610-4312-a36a-cd777d2693bf tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:57:20.169415 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d1a167b0-2610-4312-a36a-cd777d2693bf tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:57:20.170080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d1a167b0-2610-4312-a36a-cd777d2693bf tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:57:20.170643 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d1a167b0-2610-4312-a36a-cd777d2693bf tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:57:20.172546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d1a167b0-2610-4312-a36a-cd777d2693bf tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:57:20.196097 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1a167b0-2610-4312-a36a-cd777d2693bf tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:20.197605 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1a167b0-2610-4312-a36a-cd777d2693bf tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:20.198255 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1a167b0-2610-4312-a36a-cd777d2693bf tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:20.199209 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1a167b0-2610-4312-a36a-cd777d2693bf tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:20.200263 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1a167b0-2610-4312-a36a-cd777d2693bf tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:20.201144 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1a167b0-2610-4312-a36a-cd777d2693bf tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:20.229914 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-d1a167b0-2610-4312-a36a-cd777d2693bf tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Getting quotas for project 2f92ad05650840f6bb4c8f6134b489ca. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:57:20.236619 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-d1a167b0-2610-4312-a36a-cd777d2693bf tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Getting quotas for user d244789bea974bd99d0f1debebabb54a and project 2f92ad05650840f6bb4c8f6134b489ca. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:57:20.253057 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d1a167b0-2610-4312-a36a-cd777d2693bf tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:57:20.256476 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d1a167b0-2610-4312-a36a-cd777d2693bf tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:57:20.318921 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d1a167b0-2610-4312-a36a-cd777d2693bf tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.839574 Sep 10 11:57:20.320417 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2008/4011] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:57:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:57:20.333794 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c4e7f8de-a0ab-4255-92fa-3c914eba6a11 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:20.334838 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c4e7f8de-a0ab-4255-92fa-3c914eba6a11 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:20.341683 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:57:20.458173 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a1420642-bbb0-41db-a0aa-a246fc3a53a6 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e27edecefe4d60a2dba4ba99055bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f245084ce3f409889039ba1ee751eed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:20.464369 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c4e7f8de-a0ab-4255-92fa-3c914eba6a11 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:20.487699 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c4e7f8de-a0ab-4255-92fa-3c914eba6a11 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1214 microversion: 2.1 time: 0.158413 Sep 10 11:57:20.489186 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2009/4012] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:20 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1214 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:20.513050 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a1420642-bbb0-41db-a0aa-a246fc3a53a6 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7" status: 200 len: 1481 microversion: 2.1 time: 0.443515 Sep 10 11:57:20.514004 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2004/4013] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:20 2022] GET /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7 => generated 1481 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:20.543607 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8b83bdb6-2043-4085-815d-47cac50f0a69 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:20.548198 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8b83bdb6-2043-4085-815d-47cac50f0a69 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:20.565492 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b83bdb6-2043-4085-815d-47cac50f0a69 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:20.566545 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b83bdb6-2043-4085-815d-47cac50f0a69 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:20.567830 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b83bdb6-2043-4085-815d-47cac50f0a69 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:20.570856 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b83bdb6-2043-4085-815d-47cac50f0a69 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:20.575612 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b83bdb6-2043-4085-815d-47cac50f0a69 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:20.576753 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b83bdb6-2043-4085-815d-47cac50f0a69 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:21.076892 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3068252d-f468-4481-abfb-84d93c8e5551 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:21.078309 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3068252d-f468-4481-abfb-84d93c8e5551 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:21.105306 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3068252d-f468-4481-abfb-84d93c8e5551 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:21.110846 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3068252d-f468-4481-abfb-84d93c8e5551 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:21.124901 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3068252d-f468-4481-abfb-84d93c8e5551 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:21.132403 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3068252d-f468-4481-abfb-84d93c8e5551 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:21.134105 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3068252d-f468-4481-abfb-84d93c8e5551 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:21.146689 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3068252d-f468-4481-abfb-84d93c8e5551 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:21.400844 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8b83bdb6-2043-4085-815d-47cac50f0a69 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:21.422374 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8b83bdb6-2043-4085-815d-47cac50f0a69 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:21.440830 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8b83bdb6-2043-4085-815d-47cac50f0a69 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:21.447801 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8b83bdb6-2043-4085-815d-47cac50f0a69 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1739 microversion: 2.20 time: 0.933810 Sep 10 11:57:21.448650 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2010/4014] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:57:20 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1739 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:57:21.515491 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fd4f1ec1-9195-4c7f-a700-613611b63b6f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:21.516173 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fd4f1ec1-9195-4c7f-a700-613611b63b6f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:21.534536 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fd4f1ec1-9195-4c7f-a700-613611b63b6f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:21.535003 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fd4f1ec1-9195-4c7f-a700-613611b63b6f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:21.535490 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fd4f1ec1-9195-4c7f-a700-613611b63b6f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:21.536240 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fd4f1ec1-9195-4c7f-a700-613611b63b6f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:21.536712 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fd4f1ec1-9195-4c7f-a700-613611b63b6f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:21.542224 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fd4f1ec1-9195-4c7f-a700-613611b63b6f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:21.900072 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fd4f1ec1-9195-4c7f-a700-613611b63b6f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:21.912078 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fd4f1ec1-9195-4c7f-a700-613611b63b6f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1218 microversion: 2.1 time: 0.401582 Sep 10 11:57:21.913320 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2011/4015] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:21 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1218 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:21.924793 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b15ccd56-f17e-488e-b1ed-680e19d0300a tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:21.925643 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b15ccd56-f17e-488e-b1ed-680e19d0300a tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] [instance: aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:21.939418 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b15ccd56-f17e-488e-b1ed-680e19d0300a tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:21.943137 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b15ccd56-f17e-488e-b1ed-680e19d0300a tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:21.944048 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b15ccd56-f17e-488e-b1ed-680e19d0300a tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:21.950311 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b15ccd56-f17e-488e-b1ed-680e19d0300a tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:21.951045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b15ccd56-f17e-488e-b1ed-680e19d0300a tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:21.951696 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b15ccd56-f17e-488e-b1ed-680e19d0300a tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:22.005027 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:57:22.133144 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3068252d-f468-4481-abfb-84d93c8e5551 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:22.165716 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3068252d-f468-4481-abfb-84d93c8e5551 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1505 microversion: 2.1 time: 1.099864 Sep 10 11:57:22.191428 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2005/4016] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:21 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1505 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:57:22.475374 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b15ccd56-f17e-488e-b1ed-680e19d0300a tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e27edecefe4d60a2dba4ba99055bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f245084ce3f409889039ba1ee751eed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:22.478602 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9220f29c-fc45-4747-916d-59c96860591c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:22.479776 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9220f29c-fc45-4747-916d-59c96860591c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:22.484191 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b15ccd56-f17e-488e-b1ed-680e19d0300a tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7" status: 200 len: 1468 microversion: 2.1 time: 0.563329 Sep 10 11:57:22.485010 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2012/4017] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:21 2022] GET /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7 => generated 1468 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:22.500757 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9220f29c-fc45-4747-916d-59c96860591c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:22.502320 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9220f29c-fc45-4747-916d-59c96860591c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:22.505513 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9220f29c-fc45-4747-916d-59c96860591c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:22.507028 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9220f29c-fc45-4747-916d-59c96860591c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:22.510029 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9220f29c-fc45-4747-916d-59c96860591c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:22.510845 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9220f29c-fc45-4747-916d-59c96860591c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:22.512984 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8bf8a5d2-5632-43da-a21c-a022b91005e7 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-888480416"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:57:22.515724 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8bf8a5d2-5632-43da-a21c-a022b91005e7 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] [instance: af31e6eb-f34c-4ae9-aede-bc4ca6949556] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:22.543829 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8bf8a5d2-5632-43da-a21c-a022b91005e7 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:22.544022 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8bf8a5d2-5632-43da-a21c-a022b91005e7 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:22.544441 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8bf8a5d2-5632-43da-a21c-a022b91005e7 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:22.551336 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8bf8a5d2-5632-43da-a21c-a022b91005e7 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:22.555416 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8bf8a5d2-5632-43da-a21c-a022b91005e7 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:22.555880 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8bf8a5d2-5632-43da-a21c-a022b91005e7 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:23.202007 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8bf8a5d2-5632-43da-a21c-a022b91005e7 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "POST /compute/v2.1/servers/af31e6eb-f34c-4ae9-aede-bc4ca6949556/action" status: 202 len: 0 microversion: 2.1 time: 0.689735 Sep 10 11:57:23.204198 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2013/4018] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:57:22 2022] POST /compute/v2.1/servers/af31e6eb-f34c-4ae9-aede-bc4ca6949556/action => generated 0 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Sep 10 11:57:23.217760 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d1608a37-4152-4eab-837f-b41240e30f81 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:23.219211 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d1608a37-4152-4eab-837f-b41240e30f81 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:23.227063 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1608a37-4152-4eab-837f-b41240e30f81 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:23.227900 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1608a37-4152-4eab-837f-b41240e30f81 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:23.229756 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1608a37-4152-4eab-837f-b41240e30f81 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:23.232152 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1608a37-4152-4eab-837f-b41240e30f81 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:23.235488 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1608a37-4152-4eab-837f-b41240e30f81 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:23.236791 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1608a37-4152-4eab-837f-b41240e30f81 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:23.382159 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d1608a37-4152-4eab-837f-b41240e30f81 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:23.399577 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d1608a37-4152-4eab-837f-b41240e30f81 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1272 microversion: 2.1 time: 0.190168 Sep 10 11:57:23.406109 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2014/4019] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:23 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1272 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:23.416938 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-443fa382-0e5f-4f83-9a9c-07178d7a2691 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:23.417555 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-443fa382-0e5f-4f83-9a9c-07178d7a2691 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:23.447326 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9220f29c-fc45-4747-916d-59c96860591c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:23.456508 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9220f29c-fc45-4747-916d-59c96860591c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:23.461361 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9220f29c-fc45-4747-916d-59c96860591c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:23.463809 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-443fa382-0e5f-4f83-9a9c-07178d7a2691 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:23.465257 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9220f29c-fc45-4747-916d-59c96860591c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1739 microversion: 2.20 time: 0.992818 Sep 10 11:57:23.465922 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-443fa382-0e5f-4f83-9a9c-07178d7a2691 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:23.466524 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-443fa382-0e5f-4f83-9a9c-07178d7a2691 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:23.468458 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-443fa382-0e5f-4f83-9a9c-07178d7a2691 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:23.468858 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2006/4020] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:57:22 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1739 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:57:23.470512 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-443fa382-0e5f-4f83-9a9c-07178d7a2691 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:23.471114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-443fa382-0e5f-4f83-9a9c-07178d7a2691 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:23.474944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-052862ac-0e98-4ed5-85a2-3e14724958dc tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4072a734c0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:23.549293 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-052862ac-0e98-4ed5-85a2-3e14724958dc tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ecb21bf2-1e4a-4b54-9ab7-b90b9f3a17d1" status: 200 len: 1454 microversion: 2.1 time: 0.079164 Sep 10 11:57:23.550529 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2007/4021] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:57:23 2022] GET /compute/v2.1/images/ecb21bf2-1e4a-4b54-9ab7-b90b9f3a17d1 => generated 1454 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:23.784145 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-443fa382-0e5f-4f83-9a9c-07178d7a2691 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:23.793003 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-443fa382-0e5f-4f83-9a9c-07178d7a2691 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1505 microversion: 2.1 time: 0.386014 Sep 10 11:57:23.802426 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2015/4022] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:23 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1505 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:23.869849 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-2fcd13ad-f731-456d-babf-a1e7013ac9e3 req-dbe72324-70f1-4f86-bd94-9fb7158d6b31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7", "name": "network-vif-unplugged", "status": "completed", "tag": "83f19d9c-64d5-42d5-86ba-3993c5101e77"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:57:23.906839 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-2fcd13ad-f731-456d-babf-a1e7013ac9e3 req-dbe72324-70f1-4f86-bd94-9fb7158d6b31 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:23.907691 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-2fcd13ad-f731-456d-babf-a1e7013ac9e3 req-dbe72324-70f1-4f86-bd94-9fb7158d6b31 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:23.908314 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-2fcd13ad-f731-456d-babf-a1e7013ac9e3 req-dbe72324-70f1-4f86-bd94-9fb7158d6b31 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:23.937376 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-2fcd13ad-f731-456d-babf-a1e7013ac9e3 req-dbe72324-70f1-4f86-bd94-9fb7158d6b31 service nova] Creating event network-vif-unplugged:83f19d9c-64d5-42d5-86ba-3993c5101e77 for instance aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7 on n-h1-856895-1 Sep 10 11:57:23.945573 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-2fcd13ad-f731-456d-babf-a1e7013ac9e3 req-dbe72324-70f1-4f86-bd94-9fb7158d6b31 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082212 Sep 10 11:57:23.949276 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2008/4023] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:57:24.434185 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-14241df8-31cf-4e34-931b-87ca24f4d5d6 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:24.434813 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-14241df8-31cf-4e34-931b-87ca24f4d5d6 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:24.441587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-14241df8-31cf-4e34-931b-87ca24f4d5d6 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:24.442083 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-14241df8-31cf-4e34-931b-87ca24f4d5d6 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:24.442529 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-14241df8-31cf-4e34-931b-87ca24f4d5d6 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:24.455544 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-14241df8-31cf-4e34-931b-87ca24f4d5d6 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:24.456233 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-14241df8-31cf-4e34-931b-87ca24f4d5d6 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:24.459288 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-14241df8-31cf-4e34-931b-87ca24f4d5d6 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:24.498418 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1aa6b8cd-7ed9-4a33-b0c5-15929c69296b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:24.500970 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1aa6b8cd-7ed9-4a33-b0c5-15929c69296b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:24.513515 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1aa6b8cd-7ed9-4a33-b0c5-15929c69296b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:24.523906 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1aa6b8cd-7ed9-4a33-b0c5-15929c69296b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:24.524595 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1aa6b8cd-7ed9-4a33-b0c5-15929c69296b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:24.526354 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1aa6b8cd-7ed9-4a33-b0c5-15929c69296b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:24.526986 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1aa6b8cd-7ed9-4a33-b0c5-15929c69296b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:24.527600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1aa6b8cd-7ed9-4a33-b0c5-15929c69296b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:24.698030 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-14241df8-31cf-4e34-931b-87ca24f4d5d6 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:24.727084 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-14241df8-31cf-4e34-931b-87ca24f4d5d6 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1272 microversion: 2.1 time: 0.292770 Sep 10 11:57:24.729320 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2016/4024] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:24 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1272 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:24.768029 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-12ac21a1-a3c3-4d48-b3b2-da22b3ed67d4 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f407b51b0d0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:24.848984 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-12ac21a1-a3c3-4d48-b3b2-da22b3ed67d4 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ecb21bf2-1e4a-4b54-9ab7-b90b9f3a17d1" status: 200 len: 1454 microversion: 2.1 time: 0.116064 Sep 10 11:57:24.853324 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2017/4025] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:57:24 2022] GET /compute/v2.1/images/ecb21bf2-1e4a-4b54-9ab7-b90b9f3a17d1 => generated 1454 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:24.864514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-8f926e1f-0fe9-4446-b30d-9bc822df90de req-181542bd-f1be-4f19-bbb4-e4b5758649b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e327931f-dea2-4ee1-ab5a-db5566ea3607", "name": "network-vif-deleted", "tag": "0ab05d2a-080b-4a9f-8613-b4079fcf6314"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:57:24.890324 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8f926e1f-0fe9-4446-b30d-9bc822df90de req-181542bd-f1be-4f19-bbb4-e4b5758649b4 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:24.891122 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8f926e1f-0fe9-4446-b30d-9bc822df90de req-181542bd-f1be-4f19-bbb4-e4b5758649b4 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:24.891742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8f926e1f-0fe9-4446-b30d-9bc822df90de req-181542bd-f1be-4f19-bbb4-e4b5758649b4 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:24.904309 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-8f926e1f-0fe9-4446-b30d-9bc822df90de req-181542bd-f1be-4f19-bbb4-e4b5758649b4 service nova] Creating event network-vif-deleted:0ab05d2a-080b-4a9f-8613-b4079fcf6314 for instance e327931f-dea2-4ee1-ab5a-db5566ea3607 on n-h1-856895-1 Sep 10 11:57:24.910703 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-8f926e1f-0fe9-4446-b30d-9bc822df90de req-181542bd-f1be-4f19-bbb4-e4b5758649b4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054752 Sep 10 11:57:24.912383 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2018/4026] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:57:24.918422 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-74671887-006a-40cf-98a1-ff3c07f49387 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:24.919430 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-74671887-006a-40cf-98a1-ff3c07f49387 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:24.929572 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-74671887-006a-40cf-98a1-ff3c07f49387 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:24.930621 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-74671887-006a-40cf-98a1-ff3c07f49387 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:24.932026 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-74671887-006a-40cf-98a1-ff3c07f49387 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:24.932920 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-74671887-006a-40cf-98a1-ff3c07f49387 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:24.933680 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-74671887-006a-40cf-98a1-ff3c07f49387 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:24.934302 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-74671887-006a-40cf-98a1-ff3c07f49387 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:24.972018 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1aa6b8cd-7ed9-4a33-b0c5-15929c69296b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:24.987050 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1aa6b8cd-7ed9-4a33-b0c5-15929c69296b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:24.990789 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1aa6b8cd-7ed9-4a33-b0c5-15929c69296b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:24.994331 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1aa6b8cd-7ed9-4a33-b0c5-15929c69296b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1739 microversion: 2.20 time: 0.500180 Sep 10 11:57:24.995154 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2009/4027] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:57:24 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1739 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:57:25.008594 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-74671887-006a-40cf-98a1-ff3c07f49387 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:25.009611 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-74671887-006a-40cf-98a1-ff3c07f49387 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:25.010728 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-74671887-006a-40cf-98a1-ff3c07f49387 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:25.011457 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-74671887-006a-40cf-98a1-ff3c07f49387 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lazy-loading 'fault' on Instance uuid e327931f-dea2-4ee1-ab5a-db5566ea3607 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:57:25.060287 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-74671887-006a-40cf-98a1-ff3c07f49387 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:25.068922 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-74671887-006a-40cf-98a1-ff3c07f49387 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 200 len: 1304 microversion: 2.1 time: 0.155118 Sep 10 11:57:25.071050 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2019/4028] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:24 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 1304 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:25.758276 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-112da6ea-0e3b-41f6-b1c8-ebc9ff9ccd71 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:25.758901 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-112da6ea-0e3b-41f6-b1c8-ebc9ff9ccd71 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:25.766729 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-112da6ea-0e3b-41f6-b1c8-ebc9ff9ccd71 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:25.767191 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-112da6ea-0e3b-41f6-b1c8-ebc9ff9ccd71 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:25.771889 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-112da6ea-0e3b-41f6-b1c8-ebc9ff9ccd71 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:25.772705 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-112da6ea-0e3b-41f6-b1c8-ebc9ff9ccd71 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:25.784463 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-112da6ea-0e3b-41f6-b1c8-ebc9ff9ccd71 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:25.785117 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-112da6ea-0e3b-41f6-b1c8-ebc9ff9ccd71 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:25.868221 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b6109845-770a-4877-9d0e-5140b6d36293 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4071f769d0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:25.957014 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b6109845-770a-4877-9d0e-5140b6d36293 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ecb21bf2-1e4a-4b54-9ab7-b90b9f3a17d1" status: 200 len: 1454 microversion: 2.1 time: 0.092510 Sep 10 11:57:25.973488 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2020/4029] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:57:25 2022] GET /compute/v2.1/images/ecb21bf2-1e4a-4b54-9ab7-b90b9f3a17d1 => generated 1454 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:57:26.026656 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b5523e02-b919-418d-b031-54469407d604 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:26.027614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b5523e02-b919-418d-b031-54469407d604 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:26.050527 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5523e02-b919-418d-b031-54469407d604 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:26.053072 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5523e02-b919-418d-b031-54469407d604 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:26.056985 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5523e02-b919-418d-b031-54469407d604 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:26.060515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5523e02-b919-418d-b031-54469407d604 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:26.062720 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5523e02-b919-418d-b031-54469407d604 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:26.063305 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5523e02-b919-418d-b031-54469407d604 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:26.466610 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b5523e02-b919-418d-b031-54469407d604 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:26.469594 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-112da6ea-0e3b-41f6-b1c8-ebc9ff9ccd71 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:26.484976 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b5523e02-b919-418d-b031-54469407d604 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:26.486445 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b5523e02-b919-418d-b031-54469407d604 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:26.487730 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b5523e02-b919-418d-b031-54469407d604 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1739 microversion: 2.20 time: 0.466646 Sep 10 11:57:26.488613 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2021/4030] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:57:26 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1739 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:57:26.504287 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ba47a64a-17b8-486c-a2f5-dd5db28e67e2 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:26.505129 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ba47a64a-17b8-486c-a2f5-dd5db28e67e2 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: e327931f-dea2-4ee1-ab5a-db5566ea3607] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:26.505719 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-112da6ea-0e3b-41f6-b1c8-ebc9ff9ccd71 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1314 microversion: 2.1 time: 0.751693 Sep 10 11:57:26.506431 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2010/4031] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:25 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1314 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:26.521838 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba47a64a-17b8-486c-a2f5-dd5db28e67e2 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:26.522625 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba47a64a-17b8-486c-a2f5-dd5db28e67e2 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:26.523291 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba47a64a-17b8-486c-a2f5-dd5db28e67e2 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:26.524175 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba47a64a-17b8-486c-a2f5-dd5db28e67e2 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:26.525332 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba47a64a-17b8-486c-a2f5-dd5db28e67e2 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:26.529131 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba47a64a-17b8-486c-a2f5-dd5db28e67e2 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:26.566703 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-ba47a64a-17b8-486c-a2f5-dd5db28e67e2 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] HTTP exception thrown: Instance e327931f-dea2-4ee1-ab5a-db5566ea3607 could not be found. Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ba47a64a-17b8-486c-a2f5-dd5db28e67e2 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Request method failure captured: Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 HTTP/1.1 Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHsiLd4Qi6J4NvKeHPi1vR8zukYADoiCVBtW7P309hPiJUKyEZxWYlN21mf0Vnt8Dou5emLU0Ao6NNFPJNxoBlRt2FC4coeoKPsIWmF4Hq6woehBXv37Ky20Ckdtl2Kb91QvfC0AnBJUcX-WQw-6wILk4_D8lJvWYHPLbpqVl35UVJk Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: e4037e33456e49ce9fc9dca787b81c5b Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServerRescueTestJSON-1409604419 Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e4037e33456e49ce9fc9dca787b81c5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e4037e33456e49ce9fc9dca787b81c5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e4037e33456e49ce9fc9dca787b81c5b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e4037e33456e49ce9fc9dca787b81c5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServerRescueTestJSON-1409604419 Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: e4037e33456e49ce9fc9dca787b81c5b Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServerRescueTestJSON-1409604419 Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServerRescueTestJSON-1409604419-project Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 699642ccee09488eb731ba7c707947d4 Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServerRescueTestJSON-1409604419-project Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance e327931f-dea2-4ee1-ab5a-db5566ea3607 could not be found. Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'e327931f-dea2-4ee1-ab5a-db5566ea3607'} Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e327931f-dea2-4ee1-ab5a-db5566ea3607 could not be found. Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e327931f-dea2-4ee1-ab5a-db5566ea3607 could not be found. Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:57:26.569572 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:57:26.574588 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:57:26.574588 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:57:26.574588 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:57:26.574588 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:57:26.574588 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:57:26.574588 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e327931f-dea2-4ee1-ab5a-db5566ea3607 could not be found. Sep 10 11:57:26.574588 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:57:26.576015 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ba47a64a-17b8-486c-a2f5-dd5db28e67e2 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Returning 404 to user: Instance e327931f-dea2-4ee1-ab5a-db5566ea3607 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:57:26.577070 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ba47a64a-17b8-486c-a2f5-dd5db28e67e2 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607" status: 404 len: 111 microversion: 2.1 time: 0.087245 Sep 10 11:57:26.582046 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2022/4032] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:26 2022] GET /compute/v2.1/servers/e327931f-dea2-4ee1-ab5a-db5566ea3607 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:57:26.589478 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-56d85c69-9e79-4601-94fe-5a72ed4f6e94 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:26.590283 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-56d85c69-9e79-4601-94fe-5a72ed4f6e94 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: 9af45fd0-4f3b-480b-a33f-df501592594d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:26.605055 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-56d85c69-9e79-4601-94fe-5a72ed4f6e94 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:26.606132 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-56d85c69-9e79-4601-94fe-5a72ed4f6e94 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:26.606790 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-56d85c69-9e79-4601-94fe-5a72ed4f6e94 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:26.607694 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-56d85c69-9e79-4601-94fe-5a72ed4f6e94 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:26.608983 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-56d85c69-9e79-4601-94fe-5a72ed4f6e94 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:26.609528 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-56d85c69-9e79-4601-94fe-5a72ed4f6e94 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:26.693246 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-56d85c69-9e79-4601-94fe-5a72ed4f6e94 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: 9af45fd0-4f3b-480b-a33f-df501592594d] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:57:26.966085 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-56d85c69-9e79-4601-94fe-5a72ed4f6e94 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d" status: 204 len: 0 microversion: 2.1 time: 0.382136 Sep 10 11:57:26.967193 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2011/4033] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:57:26 2022] DELETE /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:57:26.980659 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8fe443e0-e485-428d-9689-c7fb5925d04a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:26.990881 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8fe443e0-e485-428d-9689-c7fb5925d04a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: 9af45fd0-4f3b-480b-a33f-df501592594d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:26.992055 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-33a30d82-39d5-4c4a-9de4-3e23fcc0b58b tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f407323d550>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:27.017843 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8fe443e0-e485-428d-9689-c7fb5925d04a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:27.022889 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8fe443e0-e485-428d-9689-c7fb5925d04a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:27.026128 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8fe443e0-e485-428d-9689-c7fb5925d04a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:27.030860 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8fe443e0-e485-428d-9689-c7fb5925d04a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:27.035022 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8fe443e0-e485-428d-9689-c7fb5925d04a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:27.037461 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8fe443e0-e485-428d-9689-c7fb5925d04a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:27.151670 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-33a30d82-39d5-4c4a-9de4-3e23fcc0b58b tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ecb21bf2-1e4a-4b54-9ab7-b90b9f3a17d1" status: 200 len: 1454 microversion: 2.1 time: 0.177585 Sep 10 11:57:27.153873 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2023/4034] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:57:26 2022] GET /compute/v2.1/images/ecb21bf2-1e4a-4b54-9ab7-b90b9f3a17d1 => generated 1454 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:27.402558 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8fe443e0-e485-428d-9689-c7fb5925d04a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:27.420629 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8fe443e0-e485-428d-9689-c7fb5925d04a tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d" status: 200 len: 1491 microversion: 2.1 time: 0.440677 Sep 10 11:57:27.421647 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2012/4035] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:26 2022] GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d => generated 1491 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:27.543916 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-66242fec-1104-405d-9858-8779ae74b233 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:27.544463 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-99e1995b-a589-4167-9a5c-57aa396c90f2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:27.547810 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-66242fec-1104-405d-9858-8779ae74b233 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:27.548487 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-99e1995b-a589-4167-9a5c-57aa396c90f2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:27.599087 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-66242fec-1104-405d-9858-8779ae74b233 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:27.604389 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99e1995b-a589-4167-9a5c-57aa396c90f2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:27.604835 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-66242fec-1104-405d-9858-8779ae74b233 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:27.606930 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99e1995b-a589-4167-9a5c-57aa396c90f2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:27.609772 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-66242fec-1104-405d-9858-8779ae74b233 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:27.611600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-66242fec-1104-405d-9858-8779ae74b233 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:27.612386 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99e1995b-a589-4167-9a5c-57aa396c90f2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:27.615335 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-66242fec-1104-405d-9858-8779ae74b233 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:27.616033 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99e1995b-a589-4167-9a5c-57aa396c90f2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:27.619635 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99e1995b-a589-4167-9a5c-57aa396c90f2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:27.620769 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99e1995b-a589-4167-9a5c-57aa396c90f2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:27.621446 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-66242fec-1104-405d-9858-8779ae74b233 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:28.533080 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-66242fec-1104-405d-9858-8779ae74b233 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:28.542929 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-66242fec-1104-405d-9858-8779ae74b233 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1314 microversion: 2.1 time: 1.012679 Sep 10 11:57:28.550540 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-99e1995b-a589-4167-9a5c-57aa396c90f2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:28.555673 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2013/4036] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:27 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1314 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:57:28.561082 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-99e1995b-a589-4167-9a5c-57aa396c90f2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:28.566494 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-b9795648-7393-46ec-98b5-6df82727d2d6 req-1527cada-5119-45ae-9942-2b4a9acf910e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7063ea81-230e-4cee-902b-76c44ebd2d74", "tag": "31936436-071f-4346-af16-9b17b5da3199"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:57:28.574771 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-99e1995b-a589-4167-9a5c-57aa396c90f2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:28.580104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-b9795648-7393-46ec-98b5-6df82727d2d6 req-1527cada-5119-45ae-9942-2b4a9acf910e service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:28.580827 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-b9795648-7393-46ec-98b5-6df82727d2d6 req-1527cada-5119-45ae-9942-2b4a9acf910e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:28.581422 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-b9795648-7393-46ec-98b5-6df82727d2d6 req-1527cada-5119-45ae-9942-2b4a9acf910e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:28.582762 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-99e1995b-a589-4167-9a5c-57aa396c90f2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1739 microversion: 2.20 time: 1.062880 Sep 10 11:57:28.584286 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2024/4037] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:57:27 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1739 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:57:28.595026 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-b9795648-7393-46ec-98b5-6df82727d2d6 req-1527cada-5119-45ae-9942-2b4a9acf910e service nova] Creating event network-changed:31936436-071f-4346-af16-9b17b5da3199 for instance 7063ea81-230e-4cee-902b-76c44ebd2d74 on n-h2-856895-1 Sep 10 11:57:28.603979 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-b9795648-7393-46ec-98b5-6df82727d2d6 req-1527cada-5119-45ae-9942-2b4a9acf910e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040762 Sep 10 11:57:28.604210 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b3d899d0-7b03-4157-af70-f0b9a8ee9568 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f407263ea60>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:28.604857 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2014/4038] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:57:28.676504 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b3d899d0-7b03-4157-af70-f0b9a8ee9568 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ecb21bf2-1e4a-4b54-9ab7-b90b9f3a17d1" status: 200 len: 1454 microversion: 2.1 time: 0.091136 Sep 10 11:57:28.685556 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2025/4039] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:57:28 2022] GET /compute/v2.1/images/ecb21bf2-1e4a-4b54-9ab7-b90b9f3a17d1 => generated 1454 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:28.691156 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-85ca8897-b63f-446c-b12d-40bf99dba069 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:28.692064 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-85ca8897-b63f-446c-b12d-40bf99dba069 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: 9af45fd0-4f3b-480b-a33f-df501592594d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:28.701222 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-85ca8897-b63f-446c-b12d-40bf99dba069 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:28.701869 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-85ca8897-b63f-446c-b12d-40bf99dba069 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:28.702318 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-85ca8897-b63f-446c-b12d-40bf99dba069 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:28.703155 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-85ca8897-b63f-446c-b12d-40bf99dba069 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:28.703656 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-85ca8897-b63f-446c-b12d-40bf99dba069 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:28.704090 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-85ca8897-b63f-446c-b12d-40bf99dba069 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:28.808731 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cb707cbd-9111-46a8-9245-1658088459a2 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-707858253", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "f3b99158-6f4e-4926-891c-f5c081931776"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:57:28.918046 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-cb707cbd-9111-46a8-9245-1658088459a2 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] validate_networks() for [('f3b99158-6f4e-4926-891c-f5c081931776', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:57:29.213967 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-85ca8897-b63f-446c-b12d-40bf99dba069 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:29.231828 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-85ca8897-b63f-446c-b12d-40bf99dba069 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d" status: 200 len: 1491 microversion: 2.1 time: 0.544850 Sep 10 11:57:29.248759 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2026/4040] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:28 2022] GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d => generated 1491 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:29.581593 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f8c25251-ccda-44a9-84ff-80bfbdb79ce5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:29.582248 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f8c25251-ccda-44a9-84ff-80bfbdb79ce5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:29.592192 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8c25251-ccda-44a9-84ff-80bfbdb79ce5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:29.592709 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8c25251-ccda-44a9-84ff-80bfbdb79ce5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:29.593117 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8c25251-ccda-44a9-84ff-80bfbdb79ce5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:29.596868 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8c25251-ccda-44a9-84ff-80bfbdb79ce5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:29.598206 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8c25251-ccda-44a9-84ff-80bfbdb79ce5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:29.602557 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8c25251-ccda-44a9-84ff-80bfbdb79ce5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:29.879603 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-cb707cbd-9111-46a8-9245-1658088459a2 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:57:29.880057 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-cb707cbd-9111-46a8-9245-1658088459a2 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:57:29.880329 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-cb707cbd-9111-46a8-9245-1658088459a2 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:57:29.880929 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-cb707cbd-9111-46a8-9245-1658088459a2 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:57:29.881649 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-cb707cbd-9111-46a8-9245-1658088459a2 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:57:29.896095 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb707cbd-9111-46a8-9245-1658088459a2 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:29.896606 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb707cbd-9111-46a8-9245-1658088459a2 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:29.897054 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb707cbd-9111-46a8-9245-1658088459a2 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:29.897824 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb707cbd-9111-46a8-9245-1658088459a2 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:29.898288 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb707cbd-9111-46a8-9245-1658088459a2 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:29.898721 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb707cbd-9111-46a8-9245-1658088459a2 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:29.948532 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-cb707cbd-9111-46a8-9245-1658088459a2 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Getting quotas for project bb98d82404b64a35a8cb133741cc7520. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:57:29.959911 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-cb707cbd-9111-46a8-9245-1658088459a2 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Getting quotas for user e5c9ac05b96f4e929836889598694eb7 and project bb98d82404b64a35a8cb133741cc7520. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:57:29.992384 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cb707cbd-9111-46a8-9245-1658088459a2 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:57:30.001585 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cb707cbd-9111-46a8-9245-1658088459a2 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] [instance: 52f1bff4-4be0-4817-9ac5-aee8d7bf6258] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:57:30.085938 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cb707cbd-9111-46a8-9245-1658088459a2 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.479853 Sep 10 11:57:30.088809 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2015/4041] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:57:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1483 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:57:30.094789 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4b87f1ff-fb5b-4b54-bea7-9286f3ac595f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:30.096891 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4b87f1ff-fb5b-4b54-bea7-9286f3ac595f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:30.107856 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b87f1ff-fb5b-4b54-bea7-9286f3ac595f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:30.109071 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b87f1ff-fb5b-4b54-bea7-9286f3ac595f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:30.110163 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b87f1ff-fb5b-4b54-bea7-9286f3ac595f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:30.111865 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b87f1ff-fb5b-4b54-bea7-9286f3ac595f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:30.112662 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b87f1ff-fb5b-4b54-bea7-9286f3ac595f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:30.115107 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b87f1ff-fb5b-4b54-bea7-9286f3ac595f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:30.219977 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:57:30.239244 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f8c25251-ccda-44a9-84ff-80bfbdb79ce5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:30.257325 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f8c25251-ccda-44a9-84ff-80bfbdb79ce5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1314 microversion: 2.1 time: 0.680105 Sep 10 11:57:30.260686 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2027/4042] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:29 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1314 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:57:30.280488 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-fe12dc6e-3699-4a47-bd27-71b1f2b08a96 req-495999ec-cc28-409c-9fae-ecfb285fec9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af31e6eb-f34c-4ae9-aede-bc4ca6949556", "name": "network-vif-plugged", "status": "completed", "tag": "3fe151c0-067d-4e53-a33f-9bab864a1662"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:57:30.305523 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-fe12dc6e-3699-4a47-bd27-71b1f2b08a96 req-495999ec-cc28-409c-9fae-ecfb285fec9e service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:30.308382 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-fe12dc6e-3699-4a47-bd27-71b1f2b08a96 req-495999ec-cc28-409c-9fae-ecfb285fec9e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:30.309629 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-fe12dc6e-3699-4a47-bd27-71b1f2b08a96 req-495999ec-cc28-409c-9fae-ecfb285fec9e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:30.346449 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-fe12dc6e-3699-4a47-bd27-71b1f2b08a96 req-495999ec-cc28-409c-9fae-ecfb285fec9e service nova] Creating event network-vif-plugged:3fe151c0-067d-4e53-a33f-9bab864a1662 for instance af31e6eb-f34c-4ae9-aede-bc4ca6949556 on n-h1-856895-1 Sep 10 11:57:30.355246 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-fe12dc6e-3699-4a47-bd27-71b1f2b08a96 req-495999ec-cc28-409c-9fae-ecfb285fec9e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092810 Sep 10 11:57:30.358934 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2028/4043] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:57:30.372710 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c6a77df0-e3e0-4074-846d-fa83bea8410b tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f407263e3a0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:30.495981 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c6a77df0-e3e0-4074-846d-fa83bea8410b tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ecb21bf2-1e4a-4b54-9ab7-b90b9f3a17d1" status: 200 len: 1454 microversion: 2.1 time: 0.133344 Sep 10 11:57:30.506967 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2029/4044] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:57:30 2022] GET /compute/v2.1/images/ecb21bf2-1e4a-4b54-9ab7-b90b9f3a17d1 => generated 1454 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:30.516155 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5e5e98da-3b63-4e19-b527-c0887d2f849c tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:30.520537 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5e5e98da-3b63-4e19-b527-c0887d2f849c tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] [instance: 52f1bff4-4be0-4817-9ac5-aee8d7bf6258] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:30.534891 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=8 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:57:30.634144 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5e5e98da-3b63-4e19-b527-c0887d2f849c tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c9ac05b96f4e929836889598694eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb98d82404b64a35a8cb133741cc7520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:30.648161 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5e5e98da-3b63-4e19-b527-c0887d2f849c tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] 10.222.0.23 "GET /compute/v2.1/servers/52f1bff4-4be0-4817-9ac5-aee8d7bf6258" status: 200 len: 1224 microversion: 2.1 time: 0.139706 Sep 10 11:57:30.651837 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2030/4045] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:30 2022] GET /compute/v2.1/servers/52f1bff4-4be0-4817-9ac5-aee8d7bf6258 => generated 1224 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:30.656912 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4b87f1ff-fb5b-4b54-bea7-9286f3ac595f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:30.659504 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:57:30.675543 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-880409ba-cef8-443f-b1d8-0bb8b2cc49b6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:30.676404 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-880409ba-cef8-443f-b1d8-0bb8b2cc49b6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: 9af45fd0-4f3b-480b-a33f-df501592594d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:30.676804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4b87f1ff-fb5b-4b54-bea7-9286f3ac595f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:30.680581 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4b87f1ff-fb5b-4b54-bea7-9286f3ac595f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:30.684934 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4b87f1ff-fb5b-4b54-bea7-9286f3ac595f tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1739 microversion: 2.20 time: 0.594703 Sep 10 11:57:30.688030 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2016/4046] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:57:30 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1739 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:57:30.690721 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-880409ba-cef8-443f-b1d8-0bb8b2cc49b6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:30.692012 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-880409ba-cef8-443f-b1d8-0bb8b2cc49b6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:30.692524 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-880409ba-cef8-443f-b1d8-0bb8b2cc49b6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:30.693477 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-880409ba-cef8-443f-b1d8-0bb8b2cc49b6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:30.694676 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-880409ba-cef8-443f-b1d8-0bb8b2cc49b6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:30.695491 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-880409ba-cef8-443f-b1d8-0bb8b2cc49b6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:30.743261 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-b2c124b6-1987-43e8-a99c-efedb8907e2f req-b9d284f7-4571-4c6c-9434-de22d4ed430d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9af45fd0-4f3b-480b-a33f-df501592594d", "name": "network-vif-deleted", "tag": "951e4435-a89e-490e-85f0-419e66b7de3a"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:57:30.810286 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-b2c124b6-1987-43e8-a99c-efedb8907e2f req-b9d284f7-4571-4c6c-9434-de22d4ed430d service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:30.812702 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-b2c124b6-1987-43e8-a99c-efedb8907e2f req-b9d284f7-4571-4c6c-9434-de22d4ed430d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:30.817704 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-b2c124b6-1987-43e8-a99c-efedb8907e2f req-b9d284f7-4571-4c6c-9434-de22d4ed430d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:30.871897 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-b2c124b6-1987-43e8-a99c-efedb8907e2f req-b9d284f7-4571-4c6c-9434-de22d4ed430d service nova] Creating event network-vif-deleted:951e4435-a89e-490e-85f0-419e66b7de3a for instance 9af45fd0-4f3b-480b-a33f-df501592594d on n-h2-856895-1 Sep 10 11:57:30.881919 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-880409ba-cef8-443f-b1d8-0bb8b2cc49b6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:30.884050 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-b2c124b6-1987-43e8-a99c-efedb8907e2f req-b9d284f7-4571-4c6c-9434-de22d4ed430d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145602 Sep 10 11:57:30.885219 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2017/4047] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:57:30.897974 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-880409ba-cef8-443f-b1d8-0bb8b2cc49b6 tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d" status: 200 len: 1449 microversion: 2.1 time: 0.244437 Sep 10 11:57:30.901508 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2031/4048] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:30 2022] GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d => generated 1449 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:31.286928 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-243b5111-69d6-4095-a023-75c1b9800e83 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:31.288236 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-243b5111-69d6-4095-a023-75c1b9800e83 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:31.308380 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-243b5111-69d6-4095-a023-75c1b9800e83 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:31.310920 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-243b5111-69d6-4095-a023-75c1b9800e83 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:31.312748 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-243b5111-69d6-4095-a023-75c1b9800e83 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:31.316626 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-243b5111-69d6-4095-a023-75c1b9800e83 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:31.318674 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-243b5111-69d6-4095-a023-75c1b9800e83 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:31.319371 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-243b5111-69d6-4095-a023-75c1b9800e83 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:31.527793 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b1597db3-344b-4fb4-8205-8d28feeb5adf tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f407263e310>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:31.637706 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b1597db3-344b-4fb4-8205-8d28feeb5adf tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ecb21bf2-1e4a-4b54-9ab7-b90b9f3a17d1" status: 200 len: 1454 microversion: 2.1 time: 0.126010 Sep 10 11:57:31.639252 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2032/4049] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:57:31 2022] GET /compute/v2.1/images/ecb21bf2-1e4a-4b54-9ab7-b90b9f3a17d1 => generated 1454 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:31.677039 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-733def90-dd79-4a13-9c21-dfcd08df114f tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:31.678134 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-733def90-dd79-4a13-9c21-dfcd08df114f tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] [instance: 52f1bff4-4be0-4817-9ac5-aee8d7bf6258] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:31.679871 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-243b5111-69d6-4095-a023-75c1b9800e83 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:31.698437 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-243b5111-69d6-4095-a023-75c1b9800e83 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1314 microversion: 2.1 time: 0.416369 Sep 10 11:57:31.700682 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-733def90-dd79-4a13-9c21-dfcd08df114f tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:31.704261 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-733def90-dd79-4a13-9c21-dfcd08df114f tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:31.706213 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-733def90-dd79-4a13-9c21-dfcd08df114f tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:31.707146 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-733def90-dd79-4a13-9c21-dfcd08df114f tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:31.712918 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-733def90-dd79-4a13-9c21-dfcd08df114f tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:31.713415 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2018/4050] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:31 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:31.715126 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-733def90-dd79-4a13-9c21-dfcd08df114f tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:31.724469 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4a98634e-e7e6-4280-8e9e-06fb02a10e85 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:31.725497 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4a98634e-e7e6-4280-8e9e-06fb02a10e85 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:31.736389 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4a98634e-e7e6-4280-8e9e-06fb02a10e85 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:31.737125 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4a98634e-e7e6-4280-8e9e-06fb02a10e85 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:31.737721 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4a98634e-e7e6-4280-8e9e-06fb02a10e85 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:31.738622 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4a98634e-e7e6-4280-8e9e-06fb02a10e85 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:31.743913 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4a98634e-e7e6-4280-8e9e-06fb02a10e85 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:31.744745 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4a98634e-e7e6-4280-8e9e-06fb02a10e85 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:32.061596 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-733def90-dd79-4a13-9c21-dfcd08df114f tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c9ac05b96f4e929836889598694eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb98d82404b64a35a8cb133741cc7520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:32.072402 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-733def90-dd79-4a13-9c21-dfcd08df114f tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] 10.222.0.23 "GET /compute/v2.1/servers/52f1bff4-4be0-4817-9ac5-aee8d7bf6258" status: 200 len: 1276 microversion: 2.1 time: 0.399570 Sep 10 11:57:32.075205 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2033/4051] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:31 2022] GET /compute/v2.1/servers/52f1bff4-4be0-4817-9ac5-aee8d7bf6258 => generated 1276 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:57:32.087782 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-602f6fa0-e7b8-46f4-b642-992c3f23071d tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:32.093044 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-602f6fa0-e7b8-46f4-b642-992c3f23071d tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: 9af45fd0-4f3b-480b-a33f-df501592594d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:32.103211 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-602f6fa0-e7b8-46f4-b642-992c3f23071d tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:32.106017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-602f6fa0-e7b8-46f4-b642-992c3f23071d tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:32.107703 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-602f6fa0-e7b8-46f4-b642-992c3f23071d tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:32.110062 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-602f6fa0-e7b8-46f4-b642-992c3f23071d tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:32.110775 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-602f6fa0-e7b8-46f4-b642-992c3f23071d tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:32.122425 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-602f6fa0-e7b8-46f4-b642-992c3f23071d tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:32.241970 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-602f6fa0-e7b8-46f4-b642-992c3f23071d tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:32.242647 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-602f6fa0-e7b8-46f4-b642-992c3f23071d tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:32.243928 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-602f6fa0-e7b8-46f4-b642-992c3f23071d tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:32.244549 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-602f6fa0-e7b8-46f4-b642-992c3f23071d tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lazy-loading 'fault' on Instance uuid 9af45fd0-4f3b-480b-a33f-df501592594d {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:57:32.256085 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4a98634e-e7e6-4280-8e9e-06fb02a10e85 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:32.269912 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4a98634e-e7e6-4280-8e9e-06fb02a10e85 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:32.273895 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4a98634e-e7e6-4280-8e9e-06fb02a10e85 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:32.283898 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4a98634e-e7e6-4280-8e9e-06fb02a10e85 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1739 microversion: 2.20 time: 0.560249 Sep 10 11:57:32.287919 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2019/4052] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:57:31 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1739 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:57:32.356860 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-602f6fa0-e7b8-46f4-b642-992c3f23071d tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '699642ccee09488eb731ba7c707947d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4037e33456e49ce9fc9dca787b81c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:32.370680 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-602f6fa0-e7b8-46f4-b642-992c3f23071d tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d" status: 200 len: 1303 microversion: 2.1 time: 0.290297 Sep 10 11:57:32.371388 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2034/4053] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:32 2022] GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d => generated 1303 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:32.662319 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-428e6913-b36e-4bf5-bb55-98dfbc4bff25 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4072a1aa60>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:32.725869 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2d67f874-4548-4084-95a0-a849e968ec19 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:32.727320 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2d67f874-4548-4084-95a0-a849e968ec19 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:32.742173 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2d67f874-4548-4084-95a0-a849e968ec19 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:32.742614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2d67f874-4548-4084-95a0-a849e968ec19 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:32.743062 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2d67f874-4548-4084-95a0-a849e968ec19 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:32.754497 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2d67f874-4548-4084-95a0-a849e968ec19 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:32.755011 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2d67f874-4548-4084-95a0-a849e968ec19 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:32.755489 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2d67f874-4548-4084-95a0-a849e968ec19 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:32.774213 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-428e6913-b36e-4bf5-bb55-98dfbc4bff25 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ecb21bf2-1e4a-4b54-9ab7-b90b9f3a17d1" status: 200 len: 1454 microversion: 2.1 time: 0.122807 Sep 10 11:57:32.786846 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2020/4054] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:57:32 2022] GET /compute/v2.1/images/ecb21bf2-1e4a-4b54-9ab7-b90b9f3a17d1 => generated 1454 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:33.032627 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2d67f874-4548-4084-95a0-a849e968ec19 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:33.040004 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:57:33.043498 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2d67f874-4548-4084-95a0-a849e968ec19 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1314 microversion: 2.1 time: 0.322156 Sep 10 11:57:33.055762 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2035/4055] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:32 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:33.109087 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b19764bf-4a44-42cf-84da-107e3604449b tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:33.109960 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b19764bf-4a44-42cf-84da-107e3604449b tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] [instance: 52f1bff4-4be0-4817-9ac5-aee8d7bf6258] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:33.135782 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b19764bf-4a44-42cf-84da-107e3604449b tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:33.136457 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b19764bf-4a44-42cf-84da-107e3604449b tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:33.139052 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b19764bf-4a44-42cf-84da-107e3604449b tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:33.140514 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b19764bf-4a44-42cf-84da-107e3604449b tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:33.144031 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b19764bf-4a44-42cf-84da-107e3604449b tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:33.144688 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b19764bf-4a44-42cf-84da-107e3604449b tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:33.266050 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b19764bf-4a44-42cf-84da-107e3604449b tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c9ac05b96f4e929836889598694eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb98d82404b64a35a8cb133741cc7520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:33.277016 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b19764bf-4a44-42cf-84da-107e3604449b tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] 10.222.0.23 "GET /compute/v2.1/servers/52f1bff4-4be0-4817-9ac5-aee8d7bf6258" status: 200 len: 1282 microversion: 2.1 time: 0.175829 Sep 10 11:57:33.277615 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2021/4056] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:33 2022] GET /compute/v2.1/servers/52f1bff4-4be0-4817-9ac5-aee8d7bf6258 => generated 1282 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:33.314165 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-370ed627-0771-45ed-a593-d20710918512 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:33.315194 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-370ed627-0771-45ed-a593-d20710918512 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:33.323296 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-370ed627-0771-45ed-a593-d20710918512 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:33.324118 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-370ed627-0771-45ed-a593-d20710918512 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:33.324836 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-370ed627-0771-45ed-a593-d20710918512 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:33.325853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-370ed627-0771-45ed-a593-d20710918512 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:33.326543 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-370ed627-0771-45ed-a593-d20710918512 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:33.327439 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-370ed627-0771-45ed-a593-d20710918512 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:33.399002 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-07a6981d-2d44-4150-9331-dd6d9890601b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:33.400100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-07a6981d-2d44-4150-9331-dd6d9890601b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] [instance: 9af45fd0-4f3b-480b-a33f-df501592594d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:33.410134 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-07a6981d-2d44-4150-9331-dd6d9890601b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:33.415146 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-07a6981d-2d44-4150-9331-dd6d9890601b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:33.418298 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-07a6981d-2d44-4150-9331-dd6d9890601b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:33.420101 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-07a6981d-2d44-4150-9331-dd6d9890601b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:33.421356 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-07a6981d-2d44-4150-9331-dd6d9890601b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:33.422596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-07a6981d-2d44-4150-9331-dd6d9890601b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:33.444736 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-07a6981d-2d44-4150-9331-dd6d9890601b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] HTTP exception thrown: Instance 9af45fd0-4f3b-480b-a33f-df501592594d could not be found. Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-07a6981d-2d44-4150-9331-dd6d9890601b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Request method failure captured: Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d HTTP/1.1 Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHsiLd4Qi6J4NvKeHPi1vR8zukYADoiCVBtW7P309hPiJUKyEZxWYlN21mf0Vnt8Dou5emLU0Ao6NNFPJNxoBlRt2FC4coeoKPsIWmF4Hq6woehBXv37Ky20Ckdtl2Kb91QvfC0AnBJUcX-WQw-6wILk4_D8lJvWYHPLbpqVl35UVJk Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: e4037e33456e49ce9fc9dca787b81c5b Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServerRescueTestJSON-1409604419 Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e4037e33456e49ce9fc9dca787b81c5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e4037e33456e49ce9fc9dca787b81c5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e4037e33456e49ce9fc9dca787b81c5b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e4037e33456e49ce9fc9dca787b81c5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServerRescueTestJSON-1409604419 Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: e4037e33456e49ce9fc9dca787b81c5b Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServerRescueTestJSON-1409604419 Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServerRescueTestJSON-1409604419-project Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 699642ccee09488eb731ba7c707947d4 Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServerRescueTestJSON-1409604419-project Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 9af45fd0-4f3b-480b-a33f-df501592594d could not be found. Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '9af45fd0-4f3b-480b-a33f-df501592594d'} Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9af45fd0-4f3b-480b-a33f-df501592594d could not be found. Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9af45fd0-4f3b-480b-a33f-df501592594d could not be found. Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:57:33.449793 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:57:33.453415 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:57:33.453415 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:57:33.453415 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:57:33.453415 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:57:33.453415 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:57:33.453415 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9af45fd0-4f3b-480b-a33f-df501592594d could not be found. Sep 10 11:57:33.453415 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:57:33.453415 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-07a6981d-2d44-4150-9331-dd6d9890601b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] Returning 404 to user: Instance 9af45fd0-4f3b-480b-a33f-df501592594d could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:57:33.453415 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-07a6981d-2d44-4150-9331-dd6d9890601b tempest-ServerRescueTestJSON-1409604419 tempest-ServerRescueTestJSON-1409604419-project] 10.222.0.23 "GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d" status: 404 len: 111 microversion: 2.1 time: 0.061129 Sep 10 11:57:33.453415 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2022/4057] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:33 2022] GET /compute/v2.1/servers/9af45fd0-4f3b-480b-a33f-df501592594d => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:57:33.656010 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-370ed627-0771-45ed-a593-d20710918512 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:33.668958 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-370ed627-0771-45ed-a593-d20710918512 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:33.672479 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-370ed627-0771-45ed-a593-d20710918512 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:33.677519 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-370ed627-0771-45ed-a593-d20710918512 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1739 microversion: 2.20 time: 0.369399 Sep 10 11:57:33.680037 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2036/4058] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:57:33 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1739 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:57:33.792295 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7a450f96-4727-45e4-bad1-bb08ee8699a5 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f40729c30d0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:33.861869 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7a450f96-4727-45e4-bad1-bb08ee8699a5 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ecb21bf2-1e4a-4b54-9ab7-b90b9f3a17d1" status: 200 len: 1454 microversion: 2.1 time: 0.074933 Sep 10 11:57:33.862798 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2023/4059] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:57:33 2022] GET /compute/v2.1/images/ecb21bf2-1e4a-4b54-9ab7-b90b9f3a17d1 => generated 1454 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:34.068973 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ae340943-1628-4533-a328-fdc9996dbb68 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:34.070283 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ae340943-1628-4533-a328-fdc9996dbb68 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:34.085960 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae340943-1628-4533-a328-fdc9996dbb68 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:34.086468 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae340943-1628-4533-a328-fdc9996dbb68 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:34.086918 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae340943-1628-4533-a328-fdc9996dbb68 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:34.088223 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae340943-1628-4533-a328-fdc9996dbb68 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:34.088694 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae340943-1628-4533-a328-fdc9996dbb68 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:34.089136 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae340943-1628-4533-a328-fdc9996dbb68 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:34.307436 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-163a3ebc-a968-4420-9f83-8e4e096cb418 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:34.308066 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-163a3ebc-a968-4420-9f83-8e4e096cb418 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] [instance: 52f1bff4-4be0-4817-9ac5-aee8d7bf6258] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:34.326752 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-163a3ebc-a968-4420-9f83-8e4e096cb418 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:34.327661 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-163a3ebc-a968-4420-9f83-8e4e096cb418 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:34.328310 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-163a3ebc-a968-4420-9f83-8e4e096cb418 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:34.329223 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-163a3ebc-a968-4420-9f83-8e4e096cb418 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:34.329873 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-163a3ebc-a968-4420-9f83-8e4e096cb418 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:34.330504 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-163a3ebc-a968-4420-9f83-8e4e096cb418 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:34.471381 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ae340943-1628-4533-a328-fdc9996dbb68 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:34.506253 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ae340943-1628-4533-a328-fdc9996dbb68 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1314 microversion: 2.1 time: 0.441890 Sep 10 11:57:34.528237 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2037/4060] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:34 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1314 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:34.708531 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4911f3ba-b200-4a71-967f-59cefae701ba tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:34.709220 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4911f3ba-b200-4a71-967f-59cefae701ba tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:34.720597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4911f3ba-b200-4a71-967f-59cefae701ba tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:34.721106 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4911f3ba-b200-4a71-967f-59cefae701ba tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:34.721601 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4911f3ba-b200-4a71-967f-59cefae701ba tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:34.722263 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4911f3ba-b200-4a71-967f-59cefae701ba tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:34.729007 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4911f3ba-b200-4a71-967f-59cefae701ba tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:34.729489 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4911f3ba-b200-4a71-967f-59cefae701ba tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:34.729906 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-163a3ebc-a968-4420-9f83-8e4e096cb418 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c9ac05b96f4e929836889598694eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb98d82404b64a35a8cb133741cc7520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:34.738071 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-163a3ebc-a968-4420-9f83-8e4e096cb418 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] 10.222.0.23 "GET /compute/v2.1/servers/52f1bff4-4be0-4817-9ac5-aee8d7bf6258" status: 200 len: 1324 microversion: 2.1 time: 0.434778 Sep 10 11:57:34.742937 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2024/4061] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:34 2022] GET /compute/v2.1/servers/52f1bff4-4be0-4817-9ac5-aee8d7bf6258 => generated 1324 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:57:34.878878 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bce1d9d8-b51a-4e90-9a0a-5b1da4afa6d2 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f40729c39d0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:35.556529 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4911f3ba-b200-4a71-967f-59cefae701ba tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:35.571601 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4911f3ba-b200-4a71-967f-59cefae701ba tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:35.590825 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4911f3ba-b200-4a71-967f-59cefae701ba tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:35.594259 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4911f3ba-b200-4a71-967f-59cefae701ba tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1739 microversion: 2.20 time: 0.890719 Sep 10 11:57:35.594842 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2038/4062] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:57:34 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1739 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:57:35.609704 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-56bdc174-1b85-4b7d-b849-16c175b71715 req-be162a0e-6603-47c8-8fe6-a719774cad97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52f1bff4-4be0-4817-9ac5-aee8d7bf6258", "tag": "84efcd35-efa6-4c22-8ee5-29dd08fcf8b2"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:57:35.667461 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-56bdc174-1b85-4b7d-b849-16c175b71715 req-be162a0e-6603-47c8-8fe6-a719774cad97 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:35.669292 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-56bdc174-1b85-4b7d-b849-16c175b71715 req-be162a0e-6603-47c8-8fe6-a719774cad97 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:35.670057 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-56bdc174-1b85-4b7d-b849-16c175b71715 req-be162a0e-6603-47c8-8fe6-a719774cad97 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:35.722757 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-56bdc174-1b85-4b7d-b849-16c175b71715 req-be162a0e-6603-47c8-8fe6-a719774cad97 service nova] Creating event network-changed:84efcd35-efa6-4c22-8ee5-29dd08fcf8b2 for instance 52f1bff4-4be0-4817-9ac5-aee8d7bf6258 on n-h1-856895-1 Sep 10 11:57:35.731698 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-56bdc174-1b85-4b7d-b849-16c175b71715 req-be162a0e-6603-47c8-8fe6-a719774cad97 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133089 Sep 10 11:57:35.732822 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2039/4063] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:57:35.740525 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2f4d7b36-a066-41d0-9d30-800ac97a5a13 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:35.741503 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2f4d7b36-a066-41d0-9d30-800ac97a5a13 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:35.749244 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f4d7b36-a066-41d0-9d30-800ac97a5a13 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:35.750480 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f4d7b36-a066-41d0-9d30-800ac97a5a13 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:35.751130 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f4d7b36-a066-41d0-9d30-800ac97a5a13 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:35.752105 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f4d7b36-a066-41d0-9d30-800ac97a5a13 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:35.752781 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f4d7b36-a066-41d0-9d30-800ac97a5a13 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:35.753418 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f4d7b36-a066-41d0-9d30-800ac97a5a13 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:36.314389 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2f4d7b36-a066-41d0-9d30-800ac97a5a13 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:36.323137 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2f4d7b36-a066-41d0-9d30-800ac97a5a13 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1314 microversion: 2.1 time: 0.588910 Sep 10 11:57:36.329472 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2040/4064] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:35 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1314 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:36.350643 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9bf328ba-e16f-44c4-bb1b-54df08f0eff7 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:36.351281 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9bf328ba-e16f-44c4-bb1b-54df08f0eff7 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] [instance: 52f1bff4-4be0-4817-9ac5-aee8d7bf6258] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:36.359133 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9bf328ba-e16f-44c4-bb1b-54df08f0eff7 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:36.359976 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9bf328ba-e16f-44c4-bb1b-54df08f0eff7 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:36.360633 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9bf328ba-e16f-44c4-bb1b-54df08f0eff7 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:36.361555 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9bf328ba-e16f-44c4-bb1b-54df08f0eff7 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:36.362445 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9bf328ba-e16f-44c4-bb1b-54df08f0eff7 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:36.363100 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9bf328ba-e16f-44c4-bb1b-54df08f0eff7 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:36.891860 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9bf328ba-e16f-44c4-bb1b-54df08f0eff7 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c9ac05b96f4e929836889598694eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb98d82404b64a35a8cb133741cc7520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:36.901120 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9bf328ba-e16f-44c4-bb1b-54df08f0eff7 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] 10.222.0.23 "GET /compute/v2.1/servers/52f1bff4-4be0-4817-9ac5-aee8d7bf6258" status: 200 len: 1324 microversion: 2.1 time: 0.556290 Sep 10 11:57:36.907985 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2041/4065] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:36 2022] GET /compute/v2.1/servers/52f1bff4-4be0-4817-9ac5-aee8d7bf6258 => generated 1324 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:36.927714 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ee39d176-b167-4bd8-8385-a4cf05618c15 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:36.928829 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ee39d176-b167-4bd8-8385-a4cf05618c15 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:36.942678 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee39d176-b167-4bd8-8385-a4cf05618c15 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:36.943203 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee39d176-b167-4bd8-8385-a4cf05618c15 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:36.943640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee39d176-b167-4bd8-8385-a4cf05618c15 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:36.944344 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee39d176-b167-4bd8-8385-a4cf05618c15 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:36.944797 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee39d176-b167-4bd8-8385-a4cf05618c15 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:36.945266 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee39d176-b167-4bd8-8385-a4cf05618c15 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:37.491318 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ee39d176-b167-4bd8-8385-a4cf05618c15 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:37.509750 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ee39d176-b167-4bd8-8385-a4cf05618c15 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:37.512252 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ee39d176-b167-4bd8-8385-a4cf05618c15 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:37.537520 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ee39d176-b167-4bd8-8385-a4cf05618c15 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1739 microversion: 2.20 time: 0.626992 Sep 10 11:57:37.545553 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2042/4066] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:57:36 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1739 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:57:37.559911 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d92ae8fd-1405-4215-8e7c-6524eeee32d2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:37.568263 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d92ae8fd-1405-4215-8e7c-6524eeee32d2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:37.583987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d92ae8fd-1405-4215-8e7c-6524eeee32d2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:37.585443 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d92ae8fd-1405-4215-8e7c-6524eeee32d2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:37.588337 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d92ae8fd-1405-4215-8e7c-6524eeee32d2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:37.589190 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d92ae8fd-1405-4215-8e7c-6524eeee32d2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:37.589740 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d92ae8fd-1405-4215-8e7c-6524eeee32d2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:37.590251 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d92ae8fd-1405-4215-8e7c-6524eeee32d2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:38.106574 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bce1d9d8-b51a-4e90-9a0a-5b1da4afa6d2 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ecb21bf2-1e4a-4b54-9ab7-b90b9f3a17d1" status: 200 len: 1454 microversion: 2.1 time: 3.231525 Sep 10 11:57:38.115218 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2025/4067] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:57:34 2022] GET /compute/v2.1/images/ecb21bf2-1e4a-4b54-9ab7-b90b9f3a17d1 => generated 1454 bytes in 3233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:38.125486 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0b66cff6-77fc-412a-96dd-63216d8cbebf tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:38.126111 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0b66cff6-77fc-412a-96dd-63216d8cbebf tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] [instance: 52f1bff4-4be0-4817-9ac5-aee8d7bf6258] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:38.147948 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:57:38.151636 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0b66cff6-77fc-412a-96dd-63216d8cbebf tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:38.152386 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0b66cff6-77fc-412a-96dd-63216d8cbebf tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:38.153194 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0b66cff6-77fc-412a-96dd-63216d8cbebf tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:38.154617 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0b66cff6-77fc-412a-96dd-63216d8cbebf tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:38.155909 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0b66cff6-77fc-412a-96dd-63216d8cbebf tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:38.156980 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0b66cff6-77fc-412a-96dd-63216d8cbebf tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:38.741095 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d92ae8fd-1405-4215-8e7c-6524eeee32d2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:38.757438 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d92ae8fd-1405-4215-8e7c-6524eeee32d2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1314 microversion: 2.1 time: 1.208405 Sep 10 11:57:38.759825 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2043/4068] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:37 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1314 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:38.766572 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-f74b51bd-3d99-4860-a220-7ac6aace97a5 req-cc195ebe-eea9-49b5-805c-784306dc8c4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7063ea81-230e-4cee-902b-76c44ebd2d74", "name": "network-vif-plugged", "status": "completed", "tag": "31936436-071f-4346-af16-9b17b5da3199"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:57:38.780246 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-f74b51bd-3d99-4860-a220-7ac6aace97a5 req-cc195ebe-eea9-49b5-805c-784306dc8c4f service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:38.781888 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-f74b51bd-3d99-4860-a220-7ac6aace97a5 req-cc195ebe-eea9-49b5-805c-784306dc8c4f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:38.783403 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-f74b51bd-3d99-4860-a220-7ac6aace97a5 req-cc195ebe-eea9-49b5-805c-784306dc8c4f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:38.815144 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-f74b51bd-3d99-4860-a220-7ac6aace97a5 req-cc195ebe-eea9-49b5-805c-784306dc8c4f service nova] Creating event network-vif-plugged:31936436-071f-4346-af16-9b17b5da3199 for instance 7063ea81-230e-4cee-902b-76c44ebd2d74 on n-h2-856895-1 Sep 10 11:57:38.822806 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-f74b51bd-3d99-4860-a220-7ac6aace97a5 req-cc195ebe-eea9-49b5-805c-784306dc8c4f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060356 Sep 10 11:57:38.823493 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2044/4069] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:57:38.842994 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d518ec2c-6abc-4b5b-a14d-a4541529eef3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:38.846083 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d518ec2c-6abc-4b5b-a14d-a4541529eef3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:38.879030 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d518ec2c-6abc-4b5b-a14d-a4541529eef3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:38.880469 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d518ec2c-6abc-4b5b-a14d-a4541529eef3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:38.881721 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d518ec2c-6abc-4b5b-a14d-a4541529eef3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:38.885335 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d518ec2c-6abc-4b5b-a14d-a4541529eef3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:38.886031 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d518ec2c-6abc-4b5b-a14d-a4541529eef3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:38.886646 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d518ec2c-6abc-4b5b-a14d-a4541529eef3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:38.890736 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0b66cff6-77fc-412a-96dd-63216d8cbebf tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c9ac05b96f4e929836889598694eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb98d82404b64a35a8cb133741cc7520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:38.903960 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0b66cff6-77fc-412a-96dd-63216d8cbebf tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] 10.222.0.23 "GET /compute/v2.1/servers/52f1bff4-4be0-4817-9ac5-aee8d7bf6258" status: 200 len: 1324 microversion: 2.1 time: 0.782300 Sep 10 11:57:38.911888 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2026/4070] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:38 2022] GET /compute/v2.1/servers/52f1bff4-4be0-4817-9ac5-aee8d7bf6258 => generated 1324 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:39.130237 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6c760e67-be2f-4cf4-a62b-061010a04d7d tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4072a30a60>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:39.204711 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6c760e67-be2f-4cf4-a62b-061010a04d7d tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ecb21bf2-1e4a-4b54-9ab7-b90b9f3a17d1" status: 200 len: 1454 microversion: 2.1 time: 0.084640 Sep 10 11:57:39.205631 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2027/4071] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:57:39 2022] GET /compute/v2.1/images/ecb21bf2-1e4a-4b54-9ab7-b90b9f3a17d1 => generated 1454 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:57:39.398203 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d518ec2c-6abc-4b5b-a14d-a4541529eef3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:39.410183 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d518ec2c-6abc-4b5b-a14d-a4541529eef3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:39.416753 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d518ec2c-6abc-4b5b-a14d-a4541529eef3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:39.422562 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d518ec2c-6abc-4b5b-a14d-a4541529eef3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1721 microversion: 2.20 time: 0.596440 Sep 10 11:57:39.423389 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2045/4072] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:57:38 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1721 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:57:39.790845 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e64a314e-3492-4725-90c4-23b437dc9101 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:39.792247 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e64a314e-3492-4725-90c4-23b437dc9101 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:39.818104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e64a314e-3492-4725-90c4-23b437dc9101 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:39.828003 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e64a314e-3492-4725-90c4-23b437dc9101 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:39.828834 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e64a314e-3492-4725-90c4-23b437dc9101 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:39.833603 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e64a314e-3492-4725-90c4-23b437dc9101 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:39.835896 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e64a314e-3492-4725-90c4-23b437dc9101 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:39.836608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e64a314e-3492-4725-90c4-23b437dc9101 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:39.931375 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-397172b3-1350-4971-8bd2-36b77ac179b6 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:39.931876 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:57:39.934104 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-397172b3-1350-4971-8bd2-36b77ac179b6 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] [instance: 52f1bff4-4be0-4817-9ac5-aee8d7bf6258] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:39.943875 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-397172b3-1350-4971-8bd2-36b77ac179b6 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:39.949044 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-397172b3-1350-4971-8bd2-36b77ac179b6 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:39.950622 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-397172b3-1350-4971-8bd2-36b77ac179b6 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:39.951593 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-397172b3-1350-4971-8bd2-36b77ac179b6 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:39.954344 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-397172b3-1350-4971-8bd2-36b77ac179b6 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:39.957312 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-397172b3-1350-4971-8bd2-36b77ac179b6 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:39.987146 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:57:40.218149 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e64a314e-3492-4725-90c4-23b437dc9101 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:40.281948 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-397172b3-1350-4971-8bd2-36b77ac179b6 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c9ac05b96f4e929836889598694eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb98d82404b64a35a8cb133741cc7520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:40.282111 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e64a314e-3492-4725-90c4-23b437dc9101 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1314 microversion: 2.1 time: 0.499178 Sep 10 11:57:40.286640 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2028/4073] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:39 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1314 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:40.291868 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-397172b3-1350-4971-8bd2-36b77ac179b6 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] 10.222.0.23 "GET /compute/v2.1/servers/52f1bff4-4be0-4817-9ac5-aee8d7bf6258" status: 200 len: 1324 microversion: 2.1 time: 0.365328 Sep 10 11:57:40.297455 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2046/4074] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:39 2022] GET /compute/v2.1/servers/52f1bff4-4be0-4817-9ac5-aee8d7bf6258 => generated 1324 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:40.305020 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-346bae67-c7f5-4677-9221-0e9d853f6f29 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f40729e7040>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:40.376445 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-346bae67-c7f5-4677-9221-0e9d853f6f29 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ecb21bf2-1e4a-4b54-9ab7-b90b9f3a17d1" status: 200 len: 1454 microversion: 2.1 time: 0.088776 Sep 10 11:57:40.377416 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2029/4075] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:57:40 2022] GET /compute/v2.1/images/ecb21bf2-1e4a-4b54-9ab7-b90b9f3a17d1 => generated 1454 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:40.453292 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e0c0ed89-25ab-4633-a27f-534f4192fd00 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:40.454410 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e0c0ed89-25ab-4633-a27f-534f4192fd00 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:40.462181 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0c0ed89-25ab-4633-a27f-534f4192fd00 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:40.463019 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0c0ed89-25ab-4633-a27f-534f4192fd00 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:40.463834 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0c0ed89-25ab-4633-a27f-534f4192fd00 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:40.464906 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0c0ed89-25ab-4633-a27f-534f4192fd00 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:40.465610 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0c0ed89-25ab-4633-a27f-534f4192fd00 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:40.466279 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0c0ed89-25ab-4633-a27f-534f4192fd00 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:40.648140 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:57:40.733797 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e0c0ed89-25ab-4633-a27f-534f4192fd00 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:40.746663 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e0c0ed89-25ab-4633-a27f-534f4192fd00 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:40.749452 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e0c0ed89-25ab-4633-a27f-534f4192fd00 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:40.753288 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e0c0ed89-25ab-4633-a27f-534f4192fd00 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1721 microversion: 2.20 time: 0.304129 Sep 10 11:57:40.759286 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2047/4076] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:57:40 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1721 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:57:41.309792 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4096dc50-ac47-4ade-8cef-448380d2eea9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:41.310446 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4096dc50-ac47-4ade-8cef-448380d2eea9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:41.324893 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e39581db-1f7a-4b08-8cd8-dd8ac22410a4 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:41.325711 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4096dc50-ac47-4ade-8cef-448380d2eea9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:41.326382 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e39581db-1f7a-4b08-8cd8-dd8ac22410a4 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] [instance: 52f1bff4-4be0-4817-9ac5-aee8d7bf6258] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:41.327155 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4096dc50-ac47-4ade-8cef-448380d2eea9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:41.328974 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4096dc50-ac47-4ade-8cef-448380d2eea9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:41.331822 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4096dc50-ac47-4ade-8cef-448380d2eea9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:41.332467 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4096dc50-ac47-4ade-8cef-448380d2eea9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:41.333337 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4096dc50-ac47-4ade-8cef-448380d2eea9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:41.344493 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e39581db-1f7a-4b08-8cd8-dd8ac22410a4 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:41.345301 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e39581db-1f7a-4b08-8cd8-dd8ac22410a4 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:41.345908 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e39581db-1f7a-4b08-8cd8-dd8ac22410a4 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:41.346804 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e39581db-1f7a-4b08-8cd8-dd8ac22410a4 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:41.347436 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e39581db-1f7a-4b08-8cd8-dd8ac22410a4 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:41.348019 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e39581db-1f7a-4b08-8cd8-dd8ac22410a4 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:41.615346 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e39581db-1f7a-4b08-8cd8-dd8ac22410a4 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c9ac05b96f4e929836889598694eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb98d82404b64a35a8cb133741cc7520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:41.628134 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e39581db-1f7a-4b08-8cd8-dd8ac22410a4 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] 10.222.0.23 "GET /compute/v2.1/servers/52f1bff4-4be0-4817-9ac5-aee8d7bf6258" status: 200 len: 1324 microversion: 2.1 time: 0.308009 Sep 10 11:57:41.631753 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2048/4077] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:41 2022] GET /compute/v2.1/servers/52f1bff4-4be0-4817-9ac5-aee8d7bf6258 => generated 1324 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:41.637923 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-52c3999f-f0a8-420a-86e7-16c822314779 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4073131940>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:41.651605 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4096dc50-ac47-4ade-8cef-448380d2eea9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:41.666714 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4096dc50-ac47-4ade-8cef-448380d2eea9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1502 microversion: 2.1 time: 0.360523 Sep 10 11:57:41.668576 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2030/4078] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:41 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1502 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:41.705945 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d55c8eb5-b6fd-41c8-9e77-d090222f8689 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:57:41.706513 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d55c8eb5-b6fd-41c8-9e77-d090222f8689 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:41.707571 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-52c3999f-f0a8-420a-86e7-16c822314779 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ecb21bf2-1e4a-4b54-9ab7-b90b9f3a17d1" status: 200 len: 1454 microversion: 2.1 time: 0.074524 Sep 10 11:57:41.708595 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2049/4079] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:57:41 2022] GET /compute/v2.1/images/ecb21bf2-1e4a-4b54-9ab7-b90b9f3a17d1 => generated 1454 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:41.726533 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d55c8eb5-b6fd-41c8-9e77-d090222f8689 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:41.727719 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d55c8eb5-b6fd-41c8-9e77-d090222f8689 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:41.728391 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d55c8eb5-b6fd-41c8-9e77-d090222f8689 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:41.729288 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d55c8eb5-b6fd-41c8-9e77-d090222f8689 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:41.729913 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d55c8eb5-b6fd-41c8-9e77-d090222f8689 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:41.730535 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d55c8eb5-b6fd-41c8-9e77-d090222f8689 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:41.785047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fdb4788d-d7b6-4c7e-9b4d-c01bc11e4907 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:41.785344 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-d55c8eb5-b6fd-41c8-9e77-d090222f8689 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lazy-loading 'flavor' on Instance uuid 7063ea81-230e-4cee-902b-76c44ebd2d74 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:57:41.785733 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fdb4788d-d7b6-4c7e-9b4d-c01bc11e4907 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:41.799198 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdb4788d-d7b6-4c7e-9b4d-c01bc11e4907 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:41.799709 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdb4788d-d7b6-4c7e-9b4d-c01bc11e4907 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:41.801338 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdb4788d-d7b6-4c7e-9b4d-c01bc11e4907 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:41.802141 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdb4788d-d7b6-4c7e-9b4d-c01bc11e4907 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:41.804785 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdb4788d-d7b6-4c7e-9b4d-c01bc11e4907 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:41.805506 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdb4788d-d7b6-4c7e-9b4d-c01bc11e4907 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:42.049591 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fdb4788d-d7b6-4c7e-9b4d-c01bc11e4907 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:42.062273 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fdb4788d-d7b6-4c7e-9b4d-c01bc11e4907 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:42.064049 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fdb4788d-d7b6-4c7e-9b4d-c01bc11e4907 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:42.065585 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fdb4788d-d7b6-4c7e-9b4d-c01bc11e4907 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1721 microversion: 2.20 time: 0.285482 Sep 10 11:57:42.066621 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2050/4080] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:57:41 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1721 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:57:42.201714 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d55c8eb5-b6fd-41c8-9e77-d090222f8689 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "POST /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74/action" status: 202 len: 0 microversion: 2.1 time: 0.510657 Sep 10 11:57:42.214868 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2031/4081] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:57:41 2022] POST /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74/action => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:57:42.223152 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-baaff1b4-bfe3-4821-8b71-0fe5a8929086 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:42.223933 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-baaff1b4-bfe3-4821-8b71-0fe5a8929086 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:42.233866 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-baaff1b4-bfe3-4821-8b71-0fe5a8929086 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:42.238315 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-baaff1b4-bfe3-4821-8b71-0fe5a8929086 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:42.238879 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-baaff1b4-bfe3-4821-8b71-0fe5a8929086 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:42.239767 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-baaff1b4-bfe3-4821-8b71-0fe5a8929086 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:42.241598 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-baaff1b4-bfe3-4821-8b71-0fe5a8929086 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:42.242147 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-baaff1b4-bfe3-4821-8b71-0fe5a8929086 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:42.438204 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-4bbfa914-d3b4-4695-a41f-b7d2fd1d96c1 req-ab4c7b80-f56d-4cb0-ad28-089f7226bb25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52f1bff4-4be0-4817-9ac5-aee8d7bf6258", "name": "network-vif-plugged", "status": "completed", "tag": "84efcd35-efa6-4c22-8ee5-29dd08fcf8b2"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:57:42.480855 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-4bbfa914-d3b4-4695-a41f-b7d2fd1d96c1 req-ab4c7b80-f56d-4cb0-ad28-089f7226bb25 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:42.481344 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-4bbfa914-d3b4-4695-a41f-b7d2fd1d96c1 req-ab4c7b80-f56d-4cb0-ad28-089f7226bb25 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:42.481788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-4bbfa914-d3b4-4695-a41f-b7d2fd1d96c1 req-ab4c7b80-f56d-4cb0-ad28-089f7226bb25 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:42.502989 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-4bbfa914-d3b4-4695-a41f-b7d2fd1d96c1 req-ab4c7b80-f56d-4cb0-ad28-089f7226bb25 service nova] Creating event network-vif-plugged:84efcd35-efa6-4c22-8ee5-29dd08fcf8b2 for instance 52f1bff4-4be0-4817-9ac5-aee8d7bf6258 on n-h1-856895-1 Sep 10 11:57:42.509285 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-baaff1b4-bfe3-4821-8b71-0fe5a8929086 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:42.520408 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-4bbfa914-d3b4-4695-a41f-b7d2fd1d96c1 req-ab4c7b80-f56d-4cb0-ad28-089f7226bb25 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089591 Sep 10 11:57:42.528812 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-baaff1b4-bfe3-4821-8b71-0fe5a8929086 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1508 microversion: 2.1 time: 0.308828 Sep 10 11:57:42.530413 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2051/4082] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:42 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1508 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:42.530900 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2032/4083] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:57:42.668153 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c3a8a94f-3d05-4f68-b121-4407225c0267 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:42.670035 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c3a8a94f-3d05-4f68-b121-4407225c0267 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] [instance: 52f1bff4-4be0-4817-9ac5-aee8d7bf6258] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:42.685616 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3a8a94f-3d05-4f68-b121-4407225c0267 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:42.686610 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3a8a94f-3d05-4f68-b121-4407225c0267 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:42.687290 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3a8a94f-3d05-4f68-b121-4407225c0267 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:42.688224 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3a8a94f-3d05-4f68-b121-4407225c0267 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:42.689256 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3a8a94f-3d05-4f68-b121-4407225c0267 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:42.690004 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3a8a94f-3d05-4f68-b121-4407225c0267 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:42.732704 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-93b35848-c81a-4fa5-94bb-4df52e9c8658 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4072a31550>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:42.839880 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-93b35848-c81a-4fa5-94bb-4df52e9c8658 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ecb21bf2-1e4a-4b54-9ab7-b90b9f3a17d1" status: 200 len: 1454 microversion: 2.1 time: 0.118889 Sep 10 11:57:42.853782 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2033/4084] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:57:42 2022] GET /compute/v2.1/images/ecb21bf2-1e4a-4b54-9ab7-b90b9f3a17d1 => generated 1454 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:43.049034 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c3a8a94f-3d05-4f68-b121-4407225c0267 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c9ac05b96f4e929836889598694eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb98d82404b64a35a8cb133741cc7520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:43.061266 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c3a8a94f-3d05-4f68-b121-4407225c0267 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] 10.222.0.23 "GET /compute/v2.1/servers/52f1bff4-4be0-4817-9ac5-aee8d7bf6258" status: 200 len: 1324 microversion: 2.1 time: 0.406561 Sep 10 11:57:43.062161 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2052/4085] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:42 2022] GET /compute/v2.1/servers/52f1bff4-4be0-4817-9ac5-aee8d7bf6258 => generated 1324 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:43.107228 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f76adab5-5586-4791-b355-33faa364bb97 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:43.108370 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f76adab5-5586-4791-b355-33faa364bb97 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:43.121392 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f76adab5-5586-4791-b355-33faa364bb97 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:43.125576 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f76adab5-5586-4791-b355-33faa364bb97 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:43.127596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f76adab5-5586-4791-b355-33faa364bb97 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:43.130620 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f76adab5-5586-4791-b355-33faa364bb97 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:43.131346 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f76adab5-5586-4791-b355-33faa364bb97 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:43.132024 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f76adab5-5586-4791-b355-33faa364bb97 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:43.362809 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f76adab5-5586-4791-b355-33faa364bb97 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:43.378122 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f76adab5-5586-4791-b355-33faa364bb97 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:43.380773 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f76adab5-5586-4791-b355-33faa364bb97 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:43.383387 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f76adab5-5586-4791-b355-33faa364bb97 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1724 microversion: 2.20 time: 0.289156 Sep 10 11:57:43.400721 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2034/4086] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:57:43 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1724 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:57:43.414338 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-03d3418d-2542-4a9b-b41a-cc112c737c7b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5715e11-b5ac-4e21-8017-c7dfcd9d19b6"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:57:43.417868 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-03d3418d-2542-4a9b-b41a-cc112c737c7b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:43.428976 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03d3418d-2542-4a9b-b41a-cc112c737c7b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:43.429718 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03d3418d-2542-4a9b-b41a-cc112c737c7b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:43.430317 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03d3418d-2542-4a9b-b41a-cc112c737c7b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:43.435340 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03d3418d-2542-4a9b-b41a-cc112c737c7b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:43.436016 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03d3418d-2542-4a9b-b41a-cc112c737c7b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:43.436461 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03d3418d-2542-4a9b-b41a-cc112c737c7b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:43.562640 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-633d2c94-6872-4836-a7eb-b0a1dd98a461 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:43.567592 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-633d2c94-6872-4836-a7eb-b0a1dd98a461 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:43.587749 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-633d2c94-6872-4836-a7eb-b0a1dd98a461 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:43.588729 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-633d2c94-6872-4836-a7eb-b0a1dd98a461 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:43.589387 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-633d2c94-6872-4836-a7eb-b0a1dd98a461 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:43.592438 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-633d2c94-6872-4836-a7eb-b0a1dd98a461 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:43.593469 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-633d2c94-6872-4836-a7eb-b0a1dd98a461 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:43.594170 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-633d2c94-6872-4836-a7eb-b0a1dd98a461 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:43.848318 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:57:44.016714 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-633d2c94-6872-4836-a7eb-b0a1dd98a461 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:44.039649 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-633d2c94-6872-4836-a7eb-b0a1dd98a461 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1508 microversion: 2.1 time: 0.485568 Sep 10 11:57:44.042829 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2035/4087] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:43 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1508 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:44.050545 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c93fe530-e173-4d78-af43-44b0e1758e44 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4072a73a60>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:44.158194 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c93fe530-e173-4d78-af43-44b0e1758e44 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ecb21bf2-1e4a-4b54-9ab7-b90b9f3a17d1" status: 200 len: 1454 microversion: 2.1 time: 0.113541 Sep 10 11:57:44.159055 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2036/4088] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:57:44 2022] GET /compute/v2.1/images/ecb21bf2-1e4a-4b54-9ab7-b90b9f3a17d1 => generated 1454 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:44.165671 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4dcaf5c9-2477-4287-9b84-ef2abb6c175b tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:44.168402 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-03d3418d-2542-4a9b-b41a-cc112c737c7b tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "POST /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.758170 Sep 10 11:57:44.175259 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2053/4089] 10.222.0.23 () {62 vars in 1364 bytes} [Sat Sep 10 11:57:43 2022] POST /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7/os-volume_attachments => generated 188 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 11:57:44.176424 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4dcaf5c9-2477-4287-9b84-ef2abb6c175b tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] [instance: 52f1bff4-4be0-4817-9ac5-aee8d7bf6258] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:44.189455 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4dcaf5c9-2477-4287-9b84-ef2abb6c175b tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:44.190151 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4dcaf5c9-2477-4287-9b84-ef2abb6c175b tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:44.191306 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4dcaf5c9-2477-4287-9b84-ef2abb6c175b tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:44.193087 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4dcaf5c9-2477-4287-9b84-ef2abb6c175b tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:44.193910 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4dcaf5c9-2477-4287-9b84-ef2abb6c175b tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:44.194507 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4dcaf5c9-2477-4287-9b84-ef2abb6c175b tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:44.483146 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7a78edfd-6896-4a72-a05a-8bd8ef8674e7 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:44.483696 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7a78edfd-6896-4a72-a05a-8bd8ef8674e7 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:44.500321 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7a78edfd-6896-4a72-a05a-8bd8ef8674e7 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:44.500833 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7a78edfd-6896-4a72-a05a-8bd8ef8674e7 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:44.501282 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7a78edfd-6896-4a72-a05a-8bd8ef8674e7 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:44.502071 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7a78edfd-6896-4a72-a05a-8bd8ef8674e7 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:44.508394 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7a78edfd-6896-4a72-a05a-8bd8ef8674e7 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:44.509917 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7a78edfd-6896-4a72-a05a-8bd8ef8674e7 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:44.982859 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7a78edfd-6896-4a72-a05a-8bd8ef8674e7 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "DELETE /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7/os-volume_attachments/d5715e11-b5ac-4e21-8017-c7dfcd9d19b6" status: 202 len: 0 microversion: 2.20 time: 0.507238 Sep 10 11:57:44.985420 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2054/4090] 10.222.0.23 () {60 vars in 1457 bytes} [Sat Sep 10 11:57:44 2022] DELETE /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7/os-volume_attachments/d5715e11-b5ac-4e21-8017-c7dfcd9d19b6 => generated 0 bytes in 511 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:57:44.992449 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-60ef8635-90fb-4fc2-b8e2-66c286acf81a req-827efe2f-ef96-422a-bf30-dfd3c41e722f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39f90b6f-123c-451f-8f7a-dbe291a5d4a7", "name": "network-vif-unplugged", "status": "completed", "tag": "c38ed82a-b2c8-4c91-b325-3aed6429f4b0"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:57:45.008340 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-60ef8635-90fb-4fc2-b8e2-66c286acf81a req-827efe2f-ef96-422a-bf30-dfd3c41e722f service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:45.009686 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-60ef8635-90fb-4fc2-b8e2-66c286acf81a req-827efe2f-ef96-422a-bf30-dfd3c41e722f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:45.010485 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-60ef8635-90fb-4fc2-b8e2-66c286acf81a req-827efe2f-ef96-422a-bf30-dfd3c41e722f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:45.023953 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.compute.server_external_events [req-60ef8635-90fb-4fc2-b8e2-66c286acf81a req-827efe2f-ef96-422a-bf30-dfd3c41e722f service nova] Unable to find a host for instance 39f90b6f-123c-451f-8f7a-dbe291a5d4a7. Dropping event network-vif-unplugged {{(pid=128777) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 10 11:57:45.025474 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-60ef8635-90fb-4fc2-b8e2-66c286acf81a req-827efe2f-ef96-422a-bf30-dfd3c41e722f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.038637 Sep 10 11:57:45.027033 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2055/4091] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 41 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 10 11:57:45.073590 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-06d416e7-dbb9-489e-a088-9ae0a05f3b96 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:45.074882 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-06d416e7-dbb9-489e-a088-9ae0a05f3b96 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:45.084177 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06d416e7-dbb9-489e-a088-9ae0a05f3b96 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:45.085046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06d416e7-dbb9-489e-a088-9ae0a05f3b96 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:45.085942 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06d416e7-dbb9-489e-a088-9ae0a05f3b96 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:45.087576 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06d416e7-dbb9-489e-a088-9ae0a05f3b96 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:45.088439 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06d416e7-dbb9-489e-a088-9ae0a05f3b96 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:45.089644 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06d416e7-dbb9-489e-a088-9ae0a05f3b96 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:45.159145 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4dcaf5c9-2477-4287-9b84-ef2abb6c175b tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c9ac05b96f4e929836889598694eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb98d82404b64a35a8cb133741cc7520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:45.177053 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4dcaf5c9-2477-4287-9b84-ef2abb6c175b tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] 10.222.0.23 "GET /compute/v2.1/servers/52f1bff4-4be0-4817-9ac5-aee8d7bf6258" status: 200 len: 1324 microversion: 2.1 time: 1.015610 Sep 10 11:57:45.179722 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2037/4092] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:44 2022] GET /compute/v2.1/servers/52f1bff4-4be0-4817-9ac5-aee8d7bf6258 => generated 1324 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:45.200300 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e89f1ca9-9eee-4d4d-bee2-634d2d702e59 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:57:45.201386 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e89f1ca9-9eee-4d4d-bee2-634d2d702e59 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:45.215756 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e89f1ca9-9eee-4d4d-bee2-634d2d702e59 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:45.216688 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e89f1ca9-9eee-4d4d-bee2-634d2d702e59 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:45.217415 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e89f1ca9-9eee-4d4d-bee2-634d2d702e59 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:45.218391 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e89f1ca9-9eee-4d4d-bee2-634d2d702e59 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:45.219103 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e89f1ca9-9eee-4d4d-bee2-634d2d702e59 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:45.220213 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e89f1ca9-9eee-4d4d-bee2-634d2d702e59 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:45.276206 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e89f1ca9-9eee-4d4d-bee2-634d2d702e59 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128776) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 10 11:57:45.447687 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e89f1ca9-9eee-4d4d-bee2-634d2d702e59 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "POST /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7/action" status: 202 len: 0 microversion: 2.20 time: 0.261939 Sep 10 11:57:45.452344 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2038/4093] 10.222.0.23 () {62 vars in 1319 bytes} [Sat Sep 10 11:57:45 2022] POST /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:57:45.469450 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0735af0b-4119-4320-8eb3-af11cce7a63b tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f40729cc790>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:45.529520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-06d416e7-dbb9-489e-a088-9ae0a05f3b96 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:45.549430 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-06d416e7-dbb9-489e-a088-9ae0a05f3b96 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1508 microversion: 2.1 time: 0.480727 Sep 10 11:57:45.553523 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2056/4094] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:45 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1508 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:57:45.567803 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-94c1a92e-534c-477b-abc9-09349ceada75 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:45.572392 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-94c1a92e-534c-477b-abc9-09349ceada75 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:45.593357 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94c1a92e-534c-477b-abc9-09349ceada75 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:45.594183 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94c1a92e-534c-477b-abc9-09349ceada75 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:45.597913 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94c1a92e-534c-477b-abc9-09349ceada75 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:45.599029 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94c1a92e-534c-477b-abc9-09349ceada75 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:45.599681 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94c1a92e-534c-477b-abc9-09349ceada75 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:45.600266 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94c1a92e-534c-477b-abc9-09349ceada75 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:45.976200 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-94c1a92e-534c-477b-abc9-09349ceada75 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:45.986858 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-94c1a92e-534c-477b-abc9-09349ceada75 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:45.999396 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-94c1a92e-534c-477b-abc9-09349ceada75 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:46.001201 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-94c1a92e-534c-477b-abc9-09349ceada75 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1672 microversion: 2.20 time: 0.445421 Sep 10 11:57:46.003634 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2057/4095] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:57:45 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1672 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:57:46.081048 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0735af0b-4119-4320-8eb3-af11cce7a63b tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ecb21bf2-1e4a-4b54-9ab7-b90b9f3a17d1" status: 200 len: 1454 microversion: 2.1 time: 0.627421 Sep 10 11:57:46.083580 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2039/4096] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:57:45 2022] GET /compute/v2.1/images/ecb21bf2-1e4a-4b54-9ab7-b90b9f3a17d1 => generated 1454 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:46.204881 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ce9a635a-8851-4ec8-9b7a-aeb75820904a tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:46.205596 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ce9a635a-8851-4ec8-9b7a-aeb75820904a tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] [instance: 52f1bff4-4be0-4817-9ac5-aee8d7bf6258] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:46.212880 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ce9a635a-8851-4ec8-9b7a-aeb75820904a tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:46.215914 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ce9a635a-8851-4ec8-9b7a-aeb75820904a tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:46.216364 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ce9a635a-8851-4ec8-9b7a-aeb75820904a tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:46.217088 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ce9a635a-8851-4ec8-9b7a-aeb75820904a tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:46.220643 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ce9a635a-8851-4ec8-9b7a-aeb75820904a tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:46.221217 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ce9a635a-8851-4ec8-9b7a-aeb75820904a tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:46.579880 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-99de8cad-7ef8-4eaa-aece-8244b44a2d50 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:46.580510 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-99de8cad-7ef8-4eaa-aece-8244b44a2d50 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:46.595191 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-99de8cad-7ef8-4eaa-aece-8244b44a2d50 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:46.595700 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-99de8cad-7ef8-4eaa-aece-8244b44a2d50 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:46.596154 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-99de8cad-7ef8-4eaa-aece-8244b44a2d50 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:46.596947 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-99de8cad-7ef8-4eaa-aece-8244b44a2d50 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:46.597592 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-99de8cad-7ef8-4eaa-aece-8244b44a2d50 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:46.598184 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-99de8cad-7ef8-4eaa-aece-8244b44a2d50 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:46.620500 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:57:46.657881 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ce9a635a-8851-4ec8-9b7a-aeb75820904a tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c9ac05b96f4e929836889598694eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb98d82404b64a35a8cb133741cc7520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:46.670985 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ce9a635a-8851-4ec8-9b7a-aeb75820904a tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] 10.222.0.23 "GET /compute/v2.1/servers/52f1bff4-4be0-4817-9ac5-aee8d7bf6258" status: 200 len: 1521 microversion: 2.1 time: 0.469828 Sep 10 11:57:46.686657 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2058/4097] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:46 2022] GET /compute/v2.1/servers/52f1bff4-4be0-4817-9ac5-aee8d7bf6258 => generated 1521 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:46.700117 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-07a71fe7-90a7-48dc-a130-c67971f7eeea tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:46.700851 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-07a71fe7-90a7-48dc-a130-c67971f7eeea tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] [instance: 52f1bff4-4be0-4817-9ac5-aee8d7bf6258] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:46.710769 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-07a71fe7-90a7-48dc-a130-c67971f7eeea tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:46.711301 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-07a71fe7-90a7-48dc-a130-c67971f7eeea tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:46.712330 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-07a71fe7-90a7-48dc-a130-c67971f7eeea tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:46.713250 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-07a71fe7-90a7-48dc-a130-c67971f7eeea tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:46.713714 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-07a71fe7-90a7-48dc-a130-c67971f7eeea tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:46.714169 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-07a71fe7-90a7-48dc-a130-c67971f7eeea tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:46.783037 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-07a71fe7-90a7-48dc-a130-c67971f7eeea tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] HTTP exception thrown: Action 999 not found Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-07a71fe7-90a7-48dc-a130-c67971f7eeea tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Request method failure captured: Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/52f1bff4-4be0-4817-9ac5-aee8d7bf6258/os-instance-actions/999 HTTP/1.1 Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHuoM6i2mZsjOGDvPwfjDi3vr3Qy882cQWH9JBGIVwMJ3_uPVjNYC_8xUDVplyLuDgiTQt0dO3iLZRXfXGFbHMDi76Si5IxsnVNQpJbDI8KpUumnNzewwgppAdvx-Slwzy_V1jpmCJf5Hl0cD3Xph1zpH7o-L7_CKSA3scFbpZ4nNR0 Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: bb98d82404b64a35a8cb133741cc7520 Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-507079121 Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bb98d82404b64a35a8cb133741cc7520"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bb98d82404b64a35a8cb133741cc7520"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bb98d82404b64a35a8cb133741cc7520", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bb98d82404b64a35a8cb133741cc7520"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-507079121 Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: bb98d82404b64a35a8cb133741cc7520 Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-507079121 Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-InstanceActionsNegativeTestJSON-507079121-project Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: e5c9ac05b96f4e929836889598694eb7 Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-507079121-project Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: exception: Action 999 not found Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'server_id': '52f1bff4-4be0-4817-9ac5-aee8d7bf6258', 'id': '999'} Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Sep 10 11:57:46.792215 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:57:46.796843 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-07a71fe7-90a7-48dc-a130-c67971f7eeea tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Returning 404 to user: Action 999 not found {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:57:46.797851 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-07a71fe7-90a7-48dc-a130-c67971f7eeea tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] 10.222.0.23 "GET /compute/v2.1/servers/52f1bff4-4be0-4817-9ac5-aee8d7bf6258/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.102002 Sep 10 11:57:46.798442 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2059/4098] 10.222.0.23 () {58 vars in 1308 bytes} [Sat Sep 10 11:57:46 2022] GET /compute/v2.1/servers/52f1bff4-4be0-4817-9ac5-aee8d7bf6258/os-instance-actions/999 => generated 66 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:57:46.809313 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c7017b1c-d33e-4ea5-a3f7-0a58f4dd7337 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Calling method '.version_select at 0x7f40736818b0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:46.817635 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c7017b1c-d33e-4ea5-a3f7-0a58f4dd7337 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] [instance: ee4e7a03-2903-47e7-b2a9-0dce3332d4ce] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:46.825163 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-c7017b1c-d33e-4ea5-a3f7-0a58f4dd7337 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] HTTP exception thrown: Instance ee4e7a03-2903-47e7-b2a9-0dce3332d4ce could not be found. Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c7017b1c-d33e-4ea5-a3f7-0a58f4dd7337 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Request method failure captured: Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/ee4e7a03-2903-47e7-b2a9-0dce3332d4ce/os-instance-actions HTTP/1.1 Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHuoM6i2mZsjOGDvPwfjDi3vr3Qy882cQWH9JBGIVwMJ3_uPVjNYC_8xUDVplyLuDgiTQt0dO3iLZRXfXGFbHMDi76Si5IxsnVNQpJbDI8KpUumnNzewwgppAdvx-Slwzy_V1jpmCJf5Hl0cD3Xph1zpH7o-L7_CKSA3scFbpZ4nNR0 Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: bb98d82404b64a35a8cb133741cc7520 Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-507079121 Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bb98d82404b64a35a8cb133741cc7520"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bb98d82404b64a35a8cb133741cc7520"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bb98d82404b64a35a8cb133741cc7520", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bb98d82404b64a35a8cb133741cc7520"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-507079121 Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: bb98d82404b64a35a8cb133741cc7520 Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-507079121 Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-InstanceActionsNegativeTestJSON-507079121-project Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: e5c9ac05b96f4e929836889598694eb7 Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-507079121-project Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance ee4e7a03-2903-47e7-b2a9-0dce3332d4ce could not be found. Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'server_id': 'ee4e7a03-2903-47e7-b2a9-0dce3332d4ce'} Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee4e7a03-2903-47e7-b2a9-0dce3332d4ce could not be found. Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:57:46.827087 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:57:46.830580 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee4e7a03-2903-47e7-b2a9-0dce3332d4ce could not be found. Sep 10 11:57:46.830580 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:57:46.830580 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:57:46.830580 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:57:46.830580 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:57:46.830580 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:57:46.830580 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:57:46.830580 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:57:46.830580 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:57:46.830580 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee4e7a03-2903-47e7-b2a9-0dce3332d4ce could not be found. Sep 10 11:57:46.830580 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:57:46.835743 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c7017b1c-d33e-4ea5-a3f7-0a58f4dd7337 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Returning 404 to user: Instance ee4e7a03-2903-47e7-b2a9-0dce3332d4ce could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:57:46.839542 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c7017b1c-d33e-4ea5-a3f7-0a58f4dd7337 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] 10.222.0.23 "GET /compute/v2.1/servers/ee4e7a03-2903-47e7-b2a9-0dce3332d4ce/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.032437 Sep 10 11:57:46.849721 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2060/4099] 10.222.0.23 () {58 vars in 1296 bytes} [Sat Sep 10 11:57:46 2022] GET /compute/v2.1/servers/ee4e7a03-2903-47e7-b2a9-0dce3332d4ce/os-instance-actions => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:57:46.867577 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-684f8f15-19b2-4a43-b2dc-aef25d288898 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:46.869497 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-684f8f15-19b2-4a43-b2dc-aef25d288898 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] [instance: 52f1bff4-4be0-4817-9ac5-aee8d7bf6258] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:46.890699 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-684f8f15-19b2-4a43-b2dc-aef25d288898 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:46.893744 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-684f8f15-19b2-4a43-b2dc-aef25d288898 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:46.894426 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-684f8f15-19b2-4a43-b2dc-aef25d288898 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:46.895697 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-684f8f15-19b2-4a43-b2dc-aef25d288898 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:46.896198 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-684f8f15-19b2-4a43-b2dc-aef25d288898 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:46.898483 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-684f8f15-19b2-4a43-b2dc-aef25d288898 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:46.989938 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-684f8f15-19b2-4a43-b2dc-aef25d288898 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] [instance: 52f1bff4-4be0-4817-9ac5-aee8d7bf6258] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:57:47.147743 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=100 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:57:47.205826 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-684f8f15-19b2-4a43-b2dc-aef25d288898 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] 10.222.0.23 "DELETE /compute/v2.1/servers/52f1bff4-4be0-4817-9ac5-aee8d7bf6258" status: 204 len: 0 microversion: 2.1 time: 0.354638 Sep 10 11:57:47.206687 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2061/4100] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:57:46 2022] DELETE /compute/v2.1/servers/52f1bff4-4be0-4817-9ac5-aee8d7bf6258 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:57:47.211988 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c53440d0-c845-496a-bc2f-77d9fa9aeb67 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:47.213046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c53440d0-c845-496a-bc2f-77d9fa9aeb67 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:47.224190 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c53440d0-c845-496a-bc2f-77d9fa9aeb67 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:47.224759 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c53440d0-c845-496a-bc2f-77d9fa9aeb67 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:47.227215 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c53440d0-c845-496a-bc2f-77d9fa9aeb67 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:47.228793 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c53440d0-c845-496a-bc2f-77d9fa9aeb67 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:47.229275 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c53440d0-c845-496a-bc2f-77d9fa9aeb67 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:47.230285 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c53440d0-c845-496a-bc2f-77d9fa9aeb67 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:47.251151 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-99de8cad-7ef8-4eaa-aece-8244b44a2d50 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:47.260636 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-99de8cad-7ef8-4eaa-aece-8244b44a2d50 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1508 microversion: 2.1 time: 0.684630 Sep 10 11:57:47.261221 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2040/4101] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:46 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1508 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:47.269015 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bdad5de6-2ada-4a62-afb7-68377e40bcc9 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f40729639d0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:47.355912 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bdad5de6-2ada-4a62-afb7-68377e40bcc9 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ecb21bf2-1e4a-4b54-9ab7-b90b9f3a17d1" status: 200 len: 1454 microversion: 2.1 time: 0.087081 Sep 10 11:57:47.355912 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2041/4102] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:57:47 2022] GET /compute/v2.1/images/ecb21bf2-1e4a-4b54-9ab7-b90b9f3a17d1 => generated 1454 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:47.359931 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7834392d-d2b0-4737-85be-22143f9f2fcb tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:47.361545 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7834392d-d2b0-4737-85be-22143f9f2fcb tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] [instance: 52f1bff4-4be0-4817-9ac5-aee8d7bf6258] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:47.382450 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7834392d-d2b0-4737-85be-22143f9f2fcb tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:47.383260 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7834392d-d2b0-4737-85be-22143f9f2fcb tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:47.383941 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7834392d-d2b0-4737-85be-22143f9f2fcb tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:47.385805 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7834392d-d2b0-4737-85be-22143f9f2fcb tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:47.386874 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7834392d-d2b0-4737-85be-22143f9f2fcb tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:47.387516 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7834392d-d2b0-4737-85be-22143f9f2fcb tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:47.742470 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c53440d0-c845-496a-bc2f-77d9fa9aeb67 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:47.758088 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c53440d0-c845-496a-bc2f-77d9fa9aeb67 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:47.771766 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c53440d0-c845-496a-bc2f-77d9fa9aeb67 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:47.773415 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c53440d0-c845-496a-bc2f-77d9fa9aeb67 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1672 microversion: 2.20 time: 0.565754 Sep 10 11:57:47.776371 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2062/4103] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:57:47 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1672 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:57:47.908676 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7834392d-d2b0-4737-85be-22143f9f2fcb tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c9ac05b96f4e929836889598694eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb98d82404b64a35a8cb133741cc7520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:47.933160 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7834392d-d2b0-4737-85be-22143f9f2fcb tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] 10.222.0.23 "GET /compute/v2.1/servers/52f1bff4-4be0-4817-9ac5-aee8d7bf6258" status: 200 len: 1527 microversion: 2.1 time: 0.573001 Sep 10 11:57:47.954033 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2042/4104] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:47 2022] GET /compute/v2.1/servers/52f1bff4-4be0-4817-9ac5-aee8d7bf6258 => generated 1527 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:48.289083 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4a3439c6-a4cf-4fa8-9289-b6643d201cb1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:48.289691 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4a3439c6-a4cf-4fa8-9289-b6643d201cb1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:48.296417 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a3439c6-a4cf-4fa8-9289-b6643d201cb1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:48.296905 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a3439c6-a4cf-4fa8-9289-b6643d201cb1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:48.297886 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a3439c6-a4cf-4fa8-9289-b6643d201cb1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:48.298107 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a3439c6-a4cf-4fa8-9289-b6643d201cb1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:48.298578 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a3439c6-a4cf-4fa8-9289-b6643d201cb1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:48.299012 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a3439c6-a4cf-4fa8-9289-b6643d201cb1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:48.370450 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-da41889b-effc-4c5d-8112-b89215421b9b tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4072a1aa60>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:48.451733 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-da41889b-effc-4c5d-8112-b89215421b9b tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ecb21bf2-1e4a-4b54-9ab7-b90b9f3a17d1" status: 200 len: 1454 microversion: 2.1 time: 0.086453 Sep 10 11:57:48.452336 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2043/4105] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:57:48 2022] GET /compute/v2.1/images/ecb21bf2-1e4a-4b54-9ab7-b90b9f3a17d1 => generated 1454 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:57:48.537075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4a3439c6-a4cf-4fa8-9289-b6643d201cb1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:48.553562 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4a3439c6-a4cf-4fa8-9289-b6643d201cb1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1508 microversion: 2.1 time: 0.265619 Sep 10 11:57:48.568285 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2063/4106] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:48 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1508 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:48.804458 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-60ff038c-36be-4641-84f3-494bb16d9437 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:48.805377 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-60ff038c-36be-4641-84f3-494bb16d9437 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:48.833707 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60ff038c-36be-4641-84f3-494bb16d9437 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:48.834972 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60ff038c-36be-4641-84f3-494bb16d9437 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:48.835994 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60ff038c-36be-4641-84f3-494bb16d9437 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:48.837750 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60ff038c-36be-4641-84f3-494bb16d9437 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:48.838661 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60ff038c-36be-4641-84f3-494bb16d9437 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:48.839329 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60ff038c-36be-4641-84f3-494bb16d9437 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:48.966882 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-dc55701a-8342-4205-8a38-0ba31113f6ec tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:48.967649 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-dc55701a-8342-4205-8a38-0ba31113f6ec tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] [instance: 52f1bff4-4be0-4817-9ac5-aee8d7bf6258] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:48.982626 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dc55701a-8342-4205-8a38-0ba31113f6ec tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:48.985735 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dc55701a-8342-4205-8a38-0ba31113f6ec tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:48.986548 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dc55701a-8342-4205-8a38-0ba31113f6ec tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:48.987582 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dc55701a-8342-4205-8a38-0ba31113f6ec tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:48.990573 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dc55701a-8342-4205-8a38-0ba31113f6ec tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:48.992340 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dc55701a-8342-4205-8a38-0ba31113f6ec tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:49.675385 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-dc55701a-8342-4205-8a38-0ba31113f6ec tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c9ac05b96f4e929836889598694eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb98d82404b64a35a8cb133741cc7520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:49.693708 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-dc55701a-8342-4205-8a38-0ba31113f6ec tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] 10.222.0.23 "GET /compute/v2.1/servers/52f1bff4-4be0-4817-9ac5-aee8d7bf6258" status: 200 len: 1485 microversion: 2.1 time: 0.727679 Sep 10 11:57:49.696877 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2064/4107] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:48 2022] GET /compute/v2.1/servers/52f1bff4-4be0-4817-9ac5-aee8d7bf6258 => generated 1485 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:57:49.722974 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-30258374-f839-4fe8-8880-d9df00f7efce tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f407358a5e0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:49.969491 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-60ff038c-36be-4641-84f3-494bb16d9437 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:49.986971 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-60ff038c-36be-4641-84f3-494bb16d9437 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:50.003806 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-60ff038c-36be-4641-84f3-494bb16d9437 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:50.007820 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-60ff038c-36be-4641-84f3-494bb16d9437 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1730 microversion: 2.20 time: 1.207914 Sep 10 11:57:50.031715 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2044/4108] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:57:48 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1730 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:57:50.053277 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-26ce1f58-4d6a-4592-be07-652479c6293a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:50.054258 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-26ce1f58-4d6a-4592-be07-652479c6293a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:50.085877 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-26ce1f58-4d6a-4592-be07-652479c6293a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:50.086705 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-26ce1f58-4d6a-4592-be07-652479c6293a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:50.087477 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-26ce1f58-4d6a-4592-be07-652479c6293a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:50.088424 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-26ce1f58-4d6a-4592-be07-652479c6293a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:50.089049 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-26ce1f58-4d6a-4592-be07-652479c6293a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:50.089642 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-26ce1f58-4d6a-4592-be07-652479c6293a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:50.686233 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-26ce1f58-4d6a-4592-be07-652479c6293a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:50.699062 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-26ce1f58-4d6a-4592-be07-652479c6293a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1508 microversion: 2.1 time: 0.666073 Sep 10 11:57:50.716192 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2045/4109] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:50 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1508 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:50.733553 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-afab4192-fec7-4910-8178-ffcfc58c3f9f req-e439d49f-c47e-4fa6-a02a-1fb1a469f5dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52f1bff4-4be0-4817-9ac5-aee8d7bf6258", "name": "network-vif-deleted", "tag": "84efcd35-efa6-4c22-8ee5-29dd08fcf8b2"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:57:50.751566 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-afab4192-fec7-4910-8178-ffcfc58c3f9f req-e439d49f-c47e-4fa6-a02a-1fb1a469f5dc service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:50.752053 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-afab4192-fec7-4910-8178-ffcfc58c3f9f req-e439d49f-c47e-4fa6-a02a-1fb1a469f5dc service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:50.752479 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-afab4192-fec7-4910-8178-ffcfc58c3f9f req-e439d49f-c47e-4fa6-a02a-1fb1a469f5dc service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:50.845455 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-afab4192-fec7-4910-8178-ffcfc58c3f9f req-e439d49f-c47e-4fa6-a02a-1fb1a469f5dc service nova] Creating event network-vif-deleted:84efcd35-efa6-4c22-8ee5-29dd08fcf8b2 for instance 52f1bff4-4be0-4817-9ac5-aee8d7bf6258 on n-h1-856895-1 Sep 10 11:57:50.866476 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-afab4192-fec7-4910-8178-ffcfc58c3f9f req-e439d49f-c47e-4fa6-a02a-1fb1a469f5dc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146870 Sep 10 11:57:50.867400 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2046/4110] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:57:50.886284 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ff8d814a-edb3-4460-be2d-d7bf08e490f0 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:50.891360 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ff8d814a-edb3-4460-be2d-d7bf08e490f0 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] [instance: 52f1bff4-4be0-4817-9ac5-aee8d7bf6258] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:50.912487 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff8d814a-edb3-4460-be2d-d7bf08e490f0 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:50.915366 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff8d814a-edb3-4460-be2d-d7bf08e490f0 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:50.916672 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff8d814a-edb3-4460-be2d-d7bf08e490f0 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:50.918144 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff8d814a-edb3-4460-be2d-d7bf08e490f0 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:50.920977 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff8d814a-edb3-4460-be2d-d7bf08e490f0 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:50.922406 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff8d814a-edb3-4460-be2d-d7bf08e490f0 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:51.037365 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff8d814a-edb3-4460-be2d-d7bf08e490f0 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:51.042026 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff8d814a-edb3-4460-be2d-d7bf08e490f0 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:51.043057 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff8d814a-edb3-4460-be2d-d7bf08e490f0 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:51.044772 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-ff8d814a-edb3-4460-be2d-d7bf08e490f0 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lazy-loading 'fault' on Instance uuid 52f1bff4-4be0-4817-9ac5-aee8d7bf6258 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:57:51.157534 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ff8d814a-edb3-4460-be2d-d7bf08e490f0 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c9ac05b96f4e929836889598694eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb98d82404b64a35a8cb133741cc7520', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:51.168064 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ff8d814a-edb3-4460-be2d-d7bf08e490f0 tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] 10.222.0.23 "GET /compute/v2.1/servers/52f1bff4-4be0-4817-9ac5-aee8d7bf6258" status: 200 len: 1314 microversion: 2.1 time: 0.293059 Sep 10 11:57:51.184529 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2047/4111] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:50 2022] GET /compute/v2.1/servers/52f1bff4-4be0-4817-9ac5-aee8d7bf6258 => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:51.203273 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ec021ac2-2dc2-443a-8b4e-f226e78fdad4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:51.205713 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ec021ac2-2dc2-443a-8b4e-f226e78fdad4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:51.218170 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec021ac2-2dc2-443a-8b4e-f226e78fdad4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:51.219011 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec021ac2-2dc2-443a-8b4e-f226e78fdad4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:51.221464 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec021ac2-2dc2-443a-8b4e-f226e78fdad4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:51.222887 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec021ac2-2dc2-443a-8b4e-f226e78fdad4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:51.224073 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec021ac2-2dc2-443a-8b4e-f226e78fdad4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:51.225045 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec021ac2-2dc2-443a-8b4e-f226e78fdad4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:51.569992 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ec021ac2-2dc2-443a-8b4e-f226e78fdad4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:51.584631 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ec021ac2-2dc2-443a-8b4e-f226e78fdad4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:51.590114 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ec021ac2-2dc2-443a-8b4e-f226e78fdad4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:51.592570 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ec021ac2-2dc2-443a-8b4e-f226e78fdad4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1730 microversion: 2.20 time: 0.401595 Sep 10 11:57:51.594644 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2048/4112] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:57:51 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1730 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:57:51.737507 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-55c7379c-dfba-43b8-8e96-b671f6ac607e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:51.739857 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-55c7379c-dfba-43b8-8e96-b671f6ac607e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:51.787916 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55c7379c-dfba-43b8-8e96-b671f6ac607e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:51.795109 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55c7379c-dfba-43b8-8e96-b671f6ac607e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:51.797186 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55c7379c-dfba-43b8-8e96-b671f6ac607e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:51.804184 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55c7379c-dfba-43b8-8e96-b671f6ac607e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:51.805831 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55c7379c-dfba-43b8-8e96-b671f6ac607e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:51.806823 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55c7379c-dfba-43b8-8e96-b671f6ac607e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:52.278873 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-55c7379c-dfba-43b8-8e96-b671f6ac607e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:52.290995 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-55c7379c-dfba-43b8-8e96-b671f6ac607e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1508 microversion: 2.1 time: 0.563018 Sep 10 11:57:52.293286 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2049/4113] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:51 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1508 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:52.304648 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d94258c1-00ce-4aef-8777-e8b2b513d48d tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:52.306226 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d94258c1-00ce-4aef-8777-e8b2b513d48d tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] [instance: 52f1bff4-4be0-4817-9ac5-aee8d7bf6258] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:52.324640 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d94258c1-00ce-4aef-8777-e8b2b513d48d tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:52.325243 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d94258c1-00ce-4aef-8777-e8b2b513d48d tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:52.325696 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d94258c1-00ce-4aef-8777-e8b2b513d48d tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:52.326471 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d94258c1-00ce-4aef-8777-e8b2b513d48d tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:52.326978 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d94258c1-00ce-4aef-8777-e8b2b513d48d tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:52.327515 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d94258c1-00ce-4aef-8777-e8b2b513d48d tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:52.369539 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-d94258c1-00ce-4aef-8777-e8b2b513d48d tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] HTTP exception thrown: Instance 52f1bff4-4be0-4817-9ac5-aee8d7bf6258 could not be found. Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d94258c1-00ce-4aef-8777-e8b2b513d48d tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Request method failure captured: Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/52f1bff4-4be0-4817-9ac5-aee8d7bf6258 HTTP/1.1 Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHuoM6i2mZsjOGDvPwfjDi3vr3Qy882cQWH9JBGIVwMJ3_uPVjNYC_8xUDVplyLuDgiTQt0dO3iLZRXfXGFbHMDi76Si5IxsnVNQpJbDI8KpUumnNzewwgppAdvx-Slwzy_V1jpmCJf5Hl0cD3Xph1zpH7o-L7_CKSA3scFbpZ4nNR0 Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: bb98d82404b64a35a8cb133741cc7520 Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-507079121 Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bb98d82404b64a35a8cb133741cc7520"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bb98d82404b64a35a8cb133741cc7520"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bb98d82404b64a35a8cb133741cc7520", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bb98d82404b64a35a8cb133741cc7520"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-507079121 Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: bb98d82404b64a35a8cb133741cc7520 Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-507079121 Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-InstanceActionsNegativeTestJSON-507079121-project Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: e5c9ac05b96f4e929836889598694eb7 Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-507079121-project Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 52f1bff4-4be0-4817-9ac5-aee8d7bf6258 could not be found. Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '52f1bff4-4be0-4817-9ac5-aee8d7bf6258'} Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52f1bff4-4be0-4817-9ac5-aee8d7bf6258 could not be found. Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52f1bff4-4be0-4817-9ac5-aee8d7bf6258 could not be found. Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:57:52.372710 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:57:52.377057 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:57:52.377057 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:57:52.377057 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:57:52.377057 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:57:52.377057 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:57:52.377057 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:57:52.377057 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52f1bff4-4be0-4817-9ac5-aee8d7bf6258 could not be found. Sep 10 11:57:52.377057 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:57:52.377057 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d94258c1-00ce-4aef-8777-e8b2b513d48d tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] Returning 404 to user: Instance 52f1bff4-4be0-4817-9ac5-aee8d7bf6258 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:57:52.377057 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d94258c1-00ce-4aef-8777-e8b2b513d48d tempest-InstanceActionsNegativeTestJSON-507079121 tempest-InstanceActionsNegativeTestJSON-507079121-project] 10.222.0.23 "GET /compute/v2.1/servers/52f1bff4-4be0-4817-9ac5-aee8d7bf6258" status: 404 len: 111 microversion: 2.1 time: 0.081776 Sep 10 11:57:52.378118 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2050/4114] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:52 2022] GET /compute/v2.1/servers/52f1bff4-4be0-4817-9ac5-aee8d7bf6258 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:57:52.630859 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a02c9f15-11f5-47b1-9846-400358e7ba2e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:52.631499 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a02c9f15-11f5-47b1-9846-400358e7ba2e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:52.656720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a02c9f15-11f5-47b1-9846-400358e7ba2e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:52.657224 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a02c9f15-11f5-47b1-9846-400358e7ba2e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:52.657673 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a02c9f15-11f5-47b1-9846-400358e7ba2e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:52.664532 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a02c9f15-11f5-47b1-9846-400358e7ba2e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:52.671722 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a02c9f15-11f5-47b1-9846-400358e7ba2e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:52.672263 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a02c9f15-11f5-47b1-9846-400358e7ba2e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:53.393605 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a02c9f15-11f5-47b1-9846-400358e7ba2e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:53.419837 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a02c9f15-11f5-47b1-9846-400358e7ba2e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:53.421615 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a02c9f15-11f5-47b1-9846-400358e7ba2e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:53.422855 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a02c9f15-11f5-47b1-9846-400358e7ba2e tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1730 microversion: 2.20 time: 0.801160 Sep 10 11:57:53.423454 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2051/4115] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:57:52 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1730 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:57:53.440747 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c5e786be-9e44-4fb2-978b-3fb71a732cbe tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:53.465055 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c5e786be-9e44-4fb2-978b-3fb71a732cbe tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:53.488154 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c5e786be-9e44-4fb2-978b-3fb71a732cbe tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:53.488988 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c5e786be-9e44-4fb2-978b-3fb71a732cbe tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:53.489622 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c5e786be-9e44-4fb2-978b-3fb71a732cbe tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:53.492332 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c5e786be-9e44-4fb2-978b-3fb71a732cbe tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:53.493566 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c5e786be-9e44-4fb2-978b-3fb71a732cbe tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:53.494893 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c5e786be-9e44-4fb2-978b-3fb71a732cbe tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:54.481964 n-d-856895-1 devstack@n-api.service[128777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 11:57:54.482677 n-d-856895-1 devstack@n-api.service[128777]: Sat Sep 10 11:57:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/images/ecb21bf2-1e4a-4b54-9ab7-b90b9f3a17d1 (ip 10.222.0.23) !!! Sep 10 11:57:54.788745 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c5e786be-9e44-4fb2-978b-3fb71a732cbe tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:54.797770 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c5e786be-9e44-4fb2-978b-3fb71a732cbe tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1508 microversion: 2.1 time: 1.361128 Sep 10 11:57:54.798472 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2052/4116] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:53 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1508 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:54.808077 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b714d7fa-9a98-4615-a89c-b7f2c3c5610c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:54.816527 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b714d7fa-9a98-4615-a89c-b7f2c3c5610c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:54.833818 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b714d7fa-9a98-4615-a89c-b7f2c3c5610c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:54.833945 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b714d7fa-9a98-4615-a89c-b7f2c3c5610c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:54.834471 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b714d7fa-9a98-4615-a89c-b7f2c3c5610c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:54.847799 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b714d7fa-9a98-4615-a89c-b7f2c3c5610c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:54.848309 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b714d7fa-9a98-4615-a89c-b7f2c3c5610c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:54.848979 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b714d7fa-9a98-4615-a89c-b7f2c3c5610c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:55.484911 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b714d7fa-9a98-4615-a89c-b7f2c3c5610c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:55.512713 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b714d7fa-9a98-4615-a89c-b7f2c3c5610c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:55.519837 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b714d7fa-9a98-4615-a89c-b7f2c3c5610c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:55.521112 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b714d7fa-9a98-4615-a89c-b7f2c3c5610c tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1730 microversion: 2.20 time: 0.716976 Sep 10 11:57:55.521691 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2053/4117] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:57:54 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1730 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:57:55.826831 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-32935982-70b8-4496-ba59-2f5ef2fb66d8 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:55.828557 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-32935982-70b8-4496-ba59-2f5ef2fb66d8 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:55.842838 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-32935982-70b8-4496-ba59-2f5ef2fb66d8 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:55.843658 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-32935982-70b8-4496-ba59-2f5ef2fb66d8 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:55.844274 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-32935982-70b8-4496-ba59-2f5ef2fb66d8 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:55.845891 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-32935982-70b8-4496-ba59-2f5ef2fb66d8 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:55.853512 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-32935982-70b8-4496-ba59-2f5ef2fb66d8 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:55.854206 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-32935982-70b8-4496-ba59-2f5ef2fb66d8 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:56.641963 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-32935982-70b8-4496-ba59-2f5ef2fb66d8 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:56.662236 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-32935982-70b8-4496-ba59-2f5ef2fb66d8 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1508 microversion: 2.1 time: 0.839357 Sep 10 11:57:56.664705 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2054/4118] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:55 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1508 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:57:56.676438 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7820e6f0-ce5d-4150-97bf-93044823a759 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:56.678787 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7820e6f0-ce5d-4150-97bf-93044823a759 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:56.703458 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7820e6f0-ce5d-4150-97bf-93044823a759 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:56.704319 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7820e6f0-ce5d-4150-97bf-93044823a759 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:56.705622 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7820e6f0-ce5d-4150-97bf-93044823a759 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:56.710010 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7820e6f0-ce5d-4150-97bf-93044823a759 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:56.712223 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7820e6f0-ce5d-4150-97bf-93044823a759 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:56.714478 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7820e6f0-ce5d-4150-97bf-93044823a759 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:56.814384 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-30258374-f839-4fe8-8880-d9df00f7efce tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ecb21bf2-1e4a-4b54-9ab7-b90b9f3a17d1" status: 200 len: 1463 microversion: 2.1 time: 7.115350 Sep 10 11:57:56.817691 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2065/4119] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:57:49 2022] GET /compute/v2.1/images/ecb21bf2-1e4a-4b54-9ab7-b90b9f3a17d1 => generated 1463 bytes in 7120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:56.984729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d3678501-13f9-47d2-936d-dde6718aa7a2 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1589187717", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "17497c8b-2eb6-48cf-b13f-a9ff9bb62142"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:57:57.150930 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-d3678501-13f9-47d2-936d-dde6718aa7a2 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] validate_networks() for [('17497c8b-2eb6-48cf-b13f-a9ff9bb62142', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:57:57.401095 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7820e6f0-ce5d-4150-97bf-93044823a759 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:57.418731 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7820e6f0-ce5d-4150-97bf-93044823a759 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:57.420597 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7820e6f0-ce5d-4150-97bf-93044823a759 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:57.424681 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7820e6f0-ce5d-4150-97bf-93044823a759 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1730 microversion: 2.20 time: 0.758626 Sep 10 11:57:57.431914 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2055/4120] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:57:56 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1730 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:57:57.448526 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7727b627-5076-4ca8-b6d3-a40f8e81723a tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4072987dc0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:57.716991 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7727b627-5076-4ca8-b6d3-a40f8e81723a tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/ecb21bf2-1e4a-4b54-9ab7-b90b9f3a17d1" status: 200 len: 1463 microversion: 2.1 time: 0.283422 Sep 10 11:57:57.722525 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2056/4121] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:57:57 2022] GET /compute/v2.1/images/ecb21bf2-1e4a-4b54-9ab7-b90b9f3a17d1 => generated 1463 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:57.730075 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f967954e-c24a-4a82-82c8-3af0448c1caa tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:57.731691 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f967954e-c24a-4a82-82c8-3af0448c1caa tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:57.749002 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f967954e-c24a-4a82-82c8-3af0448c1caa tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:57.751764 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f967954e-c24a-4a82-82c8-3af0448c1caa tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:57.752326 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f967954e-c24a-4a82-82c8-3af0448c1caa tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:57.753339 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f967954e-c24a-4a82-82c8-3af0448c1caa tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:57.760411 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f967954e-c24a-4a82-82c8-3af0448c1caa tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:57.760879 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f967954e-c24a-4a82-82c8-3af0448c1caa tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:59.013515 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f967954e-c24a-4a82-82c8-3af0448c1caa tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:59.027870 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f967954e-c24a-4a82-82c8-3af0448c1caa tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1508 microversion: 2.1 time: 1.300004 Sep 10 11:57:59.028534 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2057/4122] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:57 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1508 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:59.033200 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5d65c527-beb3-4d41-99e7-17160fd121eb tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:59.038234 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5d65c527-beb3-4d41-99e7-17160fd121eb tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] [instance: af31e6eb-f34c-4ae9-aede-bc4ca6949556] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:59.060463 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5d65c527-beb3-4d41-99e7-17160fd121eb tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:59.060968 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5d65c527-beb3-4d41-99e7-17160fd121eb tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:59.061608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5d65c527-beb3-4d41-99e7-17160fd121eb tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:59.062504 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5d65c527-beb3-4d41-99e7-17160fd121eb tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:59.063128 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5d65c527-beb3-4d41-99e7-17160fd121eb tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:59.063747 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5d65c527-beb3-4d41-99e7-17160fd121eb tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:59.558890 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5d65c527-beb3-4d41-99e7-17160fd121eb tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e27edecefe4d60a2dba4ba99055bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f245084ce3f409889039ba1ee751eed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:59.573119 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5d65c527-beb3-4d41-99e7-17160fd121eb tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/servers/af31e6eb-f34c-4ae9-aede-bc4ca6949556" status: 200 len: 1466 microversion: 2.1 time: 0.543283 Sep 10 11:57:59.583998 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2058/4123] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:57:59 2022] GET /compute/v2.1/servers/af31e6eb-f34c-4ae9-aede-bc4ca6949556 => generated 1466 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:57:59.591958 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e0460658-b6c4-494e-b70d-2a24a03174e4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:57:59.592586 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e0460658-b6c4-494e-b70d-2a24a03174e4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:57:59.606035 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e0460658-b6c4-494e-b70d-2a24a03174e4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:59.606808 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e0460658-b6c4-494e-b70d-2a24a03174e4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:59.607495 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e0460658-b6c4-494e-b70d-2a24a03174e4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:59.608404 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e0460658-b6c4-494e-b70d-2a24a03174e4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:59.611361 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e0460658-b6c4-494e-b70d-2a24a03174e4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:59.612020 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e0460658-b6c4-494e-b70d-2a24a03174e4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:59.683715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:57:59.910028 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d3678501-13f9-47d2-936d-dde6718aa7a2 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:57:59.910514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d3678501-13f9-47d2-936d-dde6718aa7a2 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:57:59.911062 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d3678501-13f9-47d2-936d-dde6718aa7a2 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:57:59.913913 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d3678501-13f9-47d2-936d-dde6718aa7a2 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:57:59.914578 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d3678501-13f9-47d2-936d-dde6718aa7a2 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:57:59.947581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3678501-13f9-47d2-936d-dde6718aa7a2 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:59.948116 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3678501-13f9-47d2-936d-dde6718aa7a2 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:59.948561 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3678501-13f9-47d2-936d-dde6718aa7a2 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:59.949323 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3678501-13f9-47d2-936d-dde6718aa7a2 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:57:59.949777 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3678501-13f9-47d2-936d-dde6718aa7a2 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:57:59.950204 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3678501-13f9-47d2-936d-dde6718aa7a2 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:57:59.961163 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e0460658-b6c4-494e-b70d-2a24a03174e4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:59.978279 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e0460658-b6c4-494e-b70d-2a24a03174e4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:59.980127 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e0460658-b6c4-494e-b70d-2a24a03174e4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:57:59.981549 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e0460658-b6c4-494e-b70d-2a24a03174e4 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1730 microversion: 2.20 time: 0.396283 Sep 10 11:57:59.986092 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2059/4124] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:57:59 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1730 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:57:59.995080 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-77239b8a-76d5-4cbd-a4e8-205b020703ff tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4072895ca0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:00.015403 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-d3678501-13f9-47d2-936d-dde6718aa7a2 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Getting quotas for project 99b14f9ce259485bb826e197aa4969fb. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:58:00.021303 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-d3678501-13f9-47d2-936d-dde6718aa7a2 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Getting quotas for user 772de5ce0ef24348a46b84bbeebcabbb and project 99b14f9ce259485bb826e197aa4969fb. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:58:00.035752 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d3678501-13f9-47d2-936d-dde6718aa7a2 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:58:00.038611 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d3678501-13f9-47d2-936d-dde6718aa7a2 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] [instance: ab2e742e-c678-4d28-9d95-e8b9b9443867] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:58:00.097444 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d3678501-13f9-47d2-936d-dde6718aa7a2 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 3.277201 Sep 10 11:58:00.104898 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2066/4125] 10.222.0.23 () {62 vars in 1188 bytes} [Sat Sep 10 11:57:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 3286 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 10 11:58:00.149572 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c5d537bf-f6b6-4f3e-a768-2384481ea31a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:00.150029 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c5d537bf-f6b6-4f3e-a768-2384481ea31a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:00.161806 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c5d537bf-f6b6-4f3e-a768-2384481ea31a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:00.163524 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c5d537bf-f6b6-4f3e-a768-2384481ea31a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:00.164572 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c5d537bf-f6b6-4f3e-a768-2384481ea31a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:00.165453 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c5d537bf-f6b6-4f3e-a768-2384481ea31a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:00.166072 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c5d537bf-f6b6-4f3e-a768-2384481ea31a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:00.167458 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c5d537bf-f6b6-4f3e-a768-2384481ea31a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:00.271669 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-77239b8a-76d5-4cbd-a4e8-205b020703ff tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images?changes-since=2022-09-10T11%3A55%3A40Z" status: 200 len: 2374 microversion: 2.1 time: 0.282552 Sep 10 11:58:00.276908 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2060/4126] 10.222.0.23 () {58 vars in 1199 bytes} [Sat Sep 10 11:57:59 2022] GET /compute/v2.1/images?changes-since=2022-09-10T11%3A55%3A40Z => generated 2374 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:00.281874 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e4ef13a8-3960-4e41-8f2d-2320a62244fc tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:00.297548 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e4ef13a8-3960-4e41-8f2d-2320a62244fc tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] [instance: ab2e742e-c678-4d28-9d95-e8b9b9443867] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:00.496036 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e4ef13a8-3960-4e41-8f2d-2320a62244fc tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:00.504685 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e4ef13a8-3960-4e41-8f2d-2320a62244fc tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:00.513200 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e4ef13a8-3960-4e41-8f2d-2320a62244fc tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:00.515569 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e4ef13a8-3960-4e41-8f2d-2320a62244fc tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] 10.222.0.23 "GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867" status: 200 len: 1262 microversion: 2.26 time: 0.236713 Sep 10 11:58:00.536212 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2061/4127] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:58:00 2022] GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867 => generated 1262 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:58:00.548337 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8a71dabd-5ff1-4bca-a6fe-13d2d7809d4b tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f407354d3a0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:00.717391 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c5d537bf-f6b6-4f3e-a768-2384481ea31a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:00.743244 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c5d537bf-f6b6-4f3e-a768-2384481ea31a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1508 microversion: 2.1 time: 0.636134 Sep 10 11:58:00.760076 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2067/4128] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:00 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1508 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:00.793538 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-5377d222-fc70-497b-bc2b-39eab0cc8a59 req-d1601c24-e11b-4a49-8bef-7c4611f30de3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af31e6eb-f34c-4ae9-aede-bc4ca6949556", "name": "network-vif-unplugged", "status": "completed", "tag": "3fe151c0-067d-4e53-a33f-9bab864a1662"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:58:00.798091 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8a71dabd-5ff1-4bca-a6fe-13d2d7809d4b tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-2076321451" status: 200 len: 485 microversion: 2.1 time: 0.257796 Sep 10 11:58:00.800037 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2062/4129] 10.222.0.23 () {58 vars in 1231 bytes} [Sat Sep 10 11:58:00 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-2076321451 => generated 485 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:58:00.815448 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7a78f82b-0648-4994-919a-7e773cbc30e3 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4072895af0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:00.840436 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-5377d222-fc70-497b-bc2b-39eab0cc8a59 req-d1601c24-e11b-4a49-8bef-7c4611f30de3 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:00.841516 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-5377d222-fc70-497b-bc2b-39eab0cc8a59 req-d1601c24-e11b-4a49-8bef-7c4611f30de3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:00.844795 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-5377d222-fc70-497b-bc2b-39eab0cc8a59 req-d1601c24-e11b-4a49-8bef-7c4611f30de3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:00.889053 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-5377d222-fc70-497b-bc2b-39eab0cc8a59 req-d1601c24-e11b-4a49-8bef-7c4611f30de3 service nova] Creating event network-vif-unplugged:3fe151c0-067d-4e53-a33f-9bab864a1662 for instance af31e6eb-f34c-4ae9-aede-bc4ca6949556 on n-h1-856895-1 Sep 10 11:58:00.904989 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-5377d222-fc70-497b-bc2b-39eab0cc8a59 req-d1601c24-e11b-4a49-8bef-7c4611f30de3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.143120 Sep 10 11:58:00.913034 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2068/4130] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:58:01.019025 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3d869db4-dc3b-4629-95a9-1a6cb2cf9030 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:01.020954 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3d869db4-dc3b-4629-95a9-1a6cb2cf9030 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:01.069296 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d869db4-dc3b-4629-95a9-1a6cb2cf9030 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:01.071224 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d869db4-dc3b-4629-95a9-1a6cb2cf9030 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:01.073239 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d869db4-dc3b-4629-95a9-1a6cb2cf9030 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:01.084093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d869db4-dc3b-4629-95a9-1a6cb2cf9030 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:01.085030 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d869db4-dc3b-4629-95a9-1a6cb2cf9030 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:01.088742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d869db4-dc3b-4629-95a9-1a6cb2cf9030 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:01.143958 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7a78f82b-0648-4994-919a-7e773cbc30e3 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images?server=af31e6eb-f34c-4ae9-aede-bc4ca6949556" status: 200 len: 957 microversion: 2.1 time: 0.331597 Sep 10 11:58:01.148588 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2063/4131] 10.222.0.23 () {58 vars in 1209 bytes} [Sat Sep 10 11:58:00 2022] GET /compute/v2.1/images?server=af31e6eb-f34c-4ae9-aede-bc4ca6949556 => generated 957 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:58:01.168648 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-107d2df0-76aa-452a-a39d-bb419da2e2d0 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4072a1ad30>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:01.304964 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-107d2df0-76aa-452a-a39d-bb419da2e2d0 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fv2.1%2Fservers%2Faed8ed81-cc9b-4d5b-b33d-9abb86e10cd7" status: 200 len: 485 microversion: 2.1 time: 0.148441 Sep 10 11:58:01.308615 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2064/4132] 10.222.0.23 () {58 vars in 1317 bytes} [Sat Sep 10 11:58:01 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fv2.1%2Fservers%2Faed8ed81-cc9b-4d5b-b33d-9abb86e10cd7 => generated 485 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:58:01.321613 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4d02c891-f45f-4883-85c6-6af9ae531410 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4072a48ee0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:01.434175 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4d02c891-f45f-4883-85c6-6af9ae531410 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fservers%2Faed8ed81-cc9b-4d5b-b33d-9abb86e10cd7" status: 200 len: 485 microversion: 2.1 time: 0.118365 Sep 10 11:58:01.434787 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2065/4133] 10.222.0.23 () {58 vars in 1303 bytes} [Sat Sep 10 11:58:01 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fservers%2Faed8ed81-cc9b-4d5b-b33d-9abb86e10cd7 => generated 485 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:58:01.453335 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-473be9bc-1bd8-4777-98c0-45b44350d10e tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4072895790>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:01.551416 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3d869db4-dc3b-4629-95a9-1a6cb2cf9030 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:01.574804 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3d869db4-dc3b-4629-95a9-1a6cb2cf9030 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:01.577519 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3d869db4-dc3b-4629-95a9-1a6cb2cf9030 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:01.578762 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3d869db4-dc3b-4629-95a9-1a6cb2cf9030 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1730 microversion: 2.20 time: 0.564143 Sep 10 11:58:01.594814 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2069/4134] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:58:01 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1730 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:58:01.606098 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e0b1c047-0306-40ba-a781-c49bd4a245ad tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:01.608555 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e0b1c047-0306-40ba-a781-c49bd4a245ad tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] [instance: ab2e742e-c678-4d28-9d95-e8b9b9443867] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:01.617576 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0b1c047-0306-40ba-a781-c49bd4a245ad tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:01.618283 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0b1c047-0306-40ba-a781-c49bd4a245ad tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:01.618878 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0b1c047-0306-40ba-a781-c49bd4a245ad tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:01.620198 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0b1c047-0306-40ba-a781-c49bd4a245ad tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:01.620937 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0b1c047-0306-40ba-a781-c49bd4a245ad tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:01.621393 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0b1c047-0306-40ba-a781-c49bd4a245ad tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:01.786024 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e0b1c047-0306-40ba-a781-c49bd4a245ad tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:01.810341 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e0b1c047-0306-40ba-a781-c49bd4a245ad tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:01.818590 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e0b1c047-0306-40ba-a781-c49bd4a245ad tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:01.823384 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e0b1c047-0306-40ba-a781-c49bd4a245ad tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] 10.222.0.23 "GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867" status: 200 len: 1266 microversion: 2.26 time: 0.225299 Sep 10 11:58:01.824814 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2070/4135] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:58:01 2022] GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867 => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:58:01.842993 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1eaa16e1-5ff3-4100-831d-71ba31e1ba52 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:01.845130 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1eaa16e1-5ff3-4100-831d-71ba31e1ba52 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:01.869556 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1eaa16e1-5ff3-4100-831d-71ba31e1ba52 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:01.870340 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1eaa16e1-5ff3-4100-831d-71ba31e1ba52 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:01.871038 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1eaa16e1-5ff3-4100-831d-71ba31e1ba52 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:01.872012 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1eaa16e1-5ff3-4100-831d-71ba31e1ba52 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:01.872702 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1eaa16e1-5ff3-4100-831d-71ba31e1ba52 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:01.873401 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1eaa16e1-5ff3-4100-831d-71ba31e1ba52 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:01.875072 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-473be9bc-1bd8-4777-98c0-45b44350d10e tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.430856 Sep 10 11:58:01.876448 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2066/4136] 10.222.0.23 () {58 vars in 1149 bytes} [Sat Sep 10 11:58:01 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:01.892956 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4504e889-945e-4d13-b476-9293a08a0c9f tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4072a731f0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:02.076880 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4504e889-945e-4d13-b476-9293a08a0c9f tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.188885 Sep 10 11:58:02.092763 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2067/4137] 10.222.0.23 () {58 vars in 1149 bytes} [Sat Sep 10 11:58:01 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:58:02.115399 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e4a05d5b-a8eb-445e-a354-11862d0370b9 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f407354dc10>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:02.343210 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1eaa16e1-5ff3-4100-831d-71ba31e1ba52 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:02.357460 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1eaa16e1-5ff3-4100-831d-71ba31e1ba52 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1508 microversion: 2.1 time: 0.529037 Sep 10 11:58:02.362241 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2071/4138] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:01 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1508 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:02.402142 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e4a05d5b-a8eb-445e-a354-11862d0370b9 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.305891 Sep 10 11:58:02.403870 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2068/4139] 10.222.0.23 () {58 vars in 1137 bytes} [Sat Sep 10 11:58:02 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:58:02.421828 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4c26af26-e24c-473f-a1dc-872f540af768 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4073be40d0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:02.610505 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4c26af26-e24c-473f-a1dc-872f540af768 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/detail?changes-since=2022-09-10T11%3A55%3A36Z" status: 200 len: 6333 microversion: 2.1 time: 0.194275 Sep 10 11:58:02.623199 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2072/4140] 10.222.0.23 () {58 vars in 1220 bytes} [Sat Sep 10 11:58:02 2022] GET /compute/v2.1/images/detail?changes-since=2022-09-10T11%3A55%3A36Z => generated 6333 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:02.638594 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3522e6b5-d54c-416b-a821-6b5d2b8d5fe2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:02.640629 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3522e6b5-d54c-416b-a821-6b5d2b8d5fe2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:02.654382 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-889bc79e-3c31-42ff-a852-806040cdb95c tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f407368b280>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:02.664600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3522e6b5-d54c-416b-a821-6b5d2b8d5fe2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:02.665495 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3522e6b5-d54c-416b-a821-6b5d2b8d5fe2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:02.668993 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3522e6b5-d54c-416b-a821-6b5d2b8d5fe2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:02.670801 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3522e6b5-d54c-416b-a821-6b5d2b8d5fe2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:02.674897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3522e6b5-d54c-416b-a821-6b5d2b8d5fe2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:02.677269 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3522e6b5-d54c-416b-a821-6b5d2b8d5fe2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:02.773214 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-889bc79e-3c31-42ff-a852-806040cdb95c tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-2076321451" status: 200 len: 665 microversion: 2.1 time: 0.131834 Sep 10 11:58:02.786825 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2073/4141] 10.222.0.23 () {58 vars in 1252 bytes} [Sat Sep 10 11:58:02 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-2076321451 => generated 665 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:58:02.801489 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8af65a71-885f-4146-968d-b4f88e49cd84 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4073be48b0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:02.943657 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8af65a71-885f-4146-968d-b4f88e49cd84 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fv2.1%2Fservers%2Faed8ed81-cc9b-4d5b-b33d-9abb86e10cd7" status: 200 len: 1467 microversion: 2.1 time: 0.151338 Sep 10 11:58:02.944946 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2074/4142] 10.222.0.23 () {58 vars in 1338 bytes} [Sat Sep 10 11:58:02 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fv2.1%2Fservers%2Faed8ed81-cc9b-4d5b-b33d-9abb86e10cd7 => generated 1467 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:58:02.956617 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c9e230d1-2d25-4be6-8d2e-8813fa7bd956 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:02.958859 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c9e230d1-2d25-4be6-8d2e-8813fa7bd956 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] [instance: ab2e742e-c678-4d28-9d95-e8b9b9443867] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:02.989651 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c9e230d1-2d25-4be6-8d2e-8813fa7bd956 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:02.993148 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c9e230d1-2d25-4be6-8d2e-8813fa7bd956 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:02.994065 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c9e230d1-2d25-4be6-8d2e-8813fa7bd956 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:02.996910 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c9e230d1-2d25-4be6-8d2e-8813fa7bd956 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:02.997521 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c9e230d1-2d25-4be6-8d2e-8813fa7bd956 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:02.998071 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c9e230d1-2d25-4be6-8d2e-8813fa7bd956 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:03.182994 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c9e230d1-2d25-4be6-8d2e-8813fa7bd956 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:03.196319 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c9e230d1-2d25-4be6-8d2e-8813fa7bd956 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:03.199057 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c9e230d1-2d25-4be6-8d2e-8813fa7bd956 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:03.211010 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c9e230d1-2d25-4be6-8d2e-8813fa7bd956 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] 10.222.0.23 "GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867" status: 200 len: 1314 microversion: 2.26 time: 0.255511 Sep 10 11:58:03.212347 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2075/4143] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:58:02 2022] GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:58:03.225459 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b7278b2c-078c-46be-8638-4fcc6d86ffb3 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f407368b940>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:03.293410 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3522e6b5-d54c-416b-a821-6b5d2b8d5fe2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:03.319326 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3522e6b5-d54c-416b-a821-6b5d2b8d5fe2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:03.327506 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3522e6b5-d54c-416b-a821-6b5d2b8d5fe2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:03.330413 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b7278b2c-078c-46be-8638-4fcc6d86ffb3 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fservers%2Faed8ed81-cc9b-4d5b-b33d-9abb86e10cd7" status: 200 len: 1467 microversion: 2.1 time: 0.116927 Sep 10 11:58:03.331399 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2076/4144] 10.222.0.23 () {58 vars in 1324 bytes} [Sat Sep 10 11:58:03 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.23%2Fcompute%2Fservers%2Faed8ed81-cc9b-4d5b-b33d-9abb86e10cd7 => generated 1467 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:03.347248 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3522e6b5-d54c-416b-a821-6b5d2b8d5fe2 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1730 microversion: 2.20 time: 0.718329 Sep 10 11:58:03.361591 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2069/4145] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:58:02 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1730 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:58:03.363587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2bbbdcca-6d46-466b-9e91-23d5de664401 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f40732be4c0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:03.387636 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-280b2545-914c-4845-a027-b8cc82bfad3e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:03.389443 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-280b2545-914c-4845-a027-b8cc82bfad3e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:03.397852 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-280b2545-914c-4845-a027-b8cc82bfad3e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:03.402463 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-280b2545-914c-4845-a027-b8cc82bfad3e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:03.403904 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-280b2545-914c-4845-a027-b8cc82bfad3e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:03.406836 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-280b2545-914c-4845-a027-b8cc82bfad3e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:03.408082 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-280b2545-914c-4845-a027-b8cc82bfad3e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:03.409315 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-280b2545-914c-4845-a027-b8cc82bfad3e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:03.419562 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:58:04.056864 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-280b2545-914c-4845-a027-b8cc82bfad3e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:04.073928 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-280b2545-914c-4845-a027-b8cc82bfad3e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1508 microversion: 2.1 time: 0.691898 Sep 10 11:58:04.090475 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2bbbdcca-6d46-466b-9e91-23d5de664401 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7108 microversion: 2.1 time: 0.746417 Sep 10 11:58:04.091125 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2070/4146] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:03 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1508 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:58:04.112276 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2077/4147] 10.222.0.23 () {58 vars in 1170 bytes} [Sat Sep 10 11:58:03 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7108 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:04.142689 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b5d39cf6-40f3-47d8-bcc2-dfe31e06fa87 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4072895b80>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:04.250459 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b007ffc2-6f9c-4bd3-afa5-76144a1eee16 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:04.251954 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b007ffc2-6f9c-4bd3-afa5-76144a1eee16 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] [instance: ab2e742e-c678-4d28-9d95-e8b9b9443867] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:04.272275 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b007ffc2-6f9c-4bd3-afa5-76144a1eee16 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:04.274263 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b007ffc2-6f9c-4bd3-afa5-76144a1eee16 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:04.277226 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b007ffc2-6f9c-4bd3-afa5-76144a1eee16 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:04.281269 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b007ffc2-6f9c-4bd3-afa5-76144a1eee16 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:04.282351 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b007ffc2-6f9c-4bd3-afa5-76144a1eee16 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:04.283710 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b007ffc2-6f9c-4bd3-afa5-76144a1eee16 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:04.385648 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b5d39cf6-40f3-47d8-bcc2-dfe31e06fa87 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4376 microversion: 2.1 time: 0.254699 Sep 10 11:58:04.387726 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2071/4148] 10.222.0.23 () {58 vars in 1170 bytes} [Sat Sep 10 11:58:04 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4376 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:04.398480 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c5415df6-ef4c-422d-be07-5bd565aad8e3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:04.405210 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c5415df6-ef4c-422d-be07-5bd565aad8e3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:04.439673 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c5415df6-ef4c-422d-be07-5bd565aad8e3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:04.441919 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c5415df6-ef4c-422d-be07-5bd565aad8e3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:04.443822 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c5415df6-ef4c-422d-be07-5bd565aad8e3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:04.445416 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c5415df6-ef4c-422d-be07-5bd565aad8e3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:04.448759 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c5415df6-ef4c-422d-be07-5bd565aad8e3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:04.449802 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c5415df6-ef4c-422d-be07-5bd565aad8e3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:04.516227 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b007ffc2-6f9c-4bd3-afa5-76144a1eee16 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:04.532883 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b007ffc2-6f9c-4bd3-afa5-76144a1eee16 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:04.536228 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b007ffc2-6f9c-4bd3-afa5-76144a1eee16 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:04.541505 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b007ffc2-6f9c-4bd3-afa5-76144a1eee16 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] 10.222.0.23 "GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867" status: 200 len: 1320 microversion: 2.26 time: 0.300838 Sep 10 11:58:04.546888 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2078/4149] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:58:04 2022] GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867 => generated 1320 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:58:04.562186 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e2e91096-6035-4582-827d-3581814072c3 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4073b95a60>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:04.621110 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e2e91096-6035-4582-827d-3581814072c3 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/c23d4d62-7ab9-4623-9273-7f44582aa2e1" status: 200 len: 784 microversion: 2.1 time: 0.070674 Sep 10 11:58:04.622295 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2079/4150] 10.222.0.23 () {58 vars in 1233 bytes} [Sat Sep 10 11:58:04 2022] GET /compute/v2.1/images/c23d4d62-7ab9-4623-9273-7f44582aa2e1 => generated 784 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:58:04.640517 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-57cc57ab-fd2c-4d30-b951-52d183bcb549 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f407368bee0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:04.724631 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-57cc57ab-fd2c-4d30-b951-52d183bcb549 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.091623 Sep 10 11:58:04.725224 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2080/4151] 10.222.0.23 () {58 vars in 1158 bytes} [Sat Sep 10 11:58:04 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:04.742707 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-13ea9d48-3abd-45f5-bafb-7b70cdf59d73 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4073b955e0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:04.933871 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c5415df6-ef4c-422d-be07-5bd565aad8e3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:04.950370 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c5415df6-ef4c-422d-be07-5bd565aad8e3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:04.951986 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c5415df6-ef4c-422d-be07-5bd565aad8e3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:04.953405 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c5415df6-ef4c-422d-be07-5bd565aad8e3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1730 microversion: 2.20 time: 0.564342 Sep 10 11:58:04.967188 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2072/4152] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:58:04 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1730 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:58:05.124937 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4e22eb9d-c981-4a5f-81cb-c5a6c078a8e5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:05.125485 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4e22eb9d-c981-4a5f-81cb-c5a6c078a8e5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:05.142625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e22eb9d-c981-4a5f-81cb-c5a6c078a8e5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:05.143477 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e22eb9d-c981-4a5f-81cb-c5a6c078a8e5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:05.143954 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e22eb9d-c981-4a5f-81cb-c5a6c078a8e5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:05.146905 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e22eb9d-c981-4a5f-81cb-c5a6c078a8e5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:05.147855 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e22eb9d-c981-4a5f-81cb-c5a6c078a8e5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:05.151281 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e22eb9d-c981-4a5f-81cb-c5a6c078a8e5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:05.559095 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4e22eb9d-c981-4a5f-81cb-c5a6c078a8e5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:05.574859 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4e22eb9d-c981-4a5f-81cb-c5a6c078a8e5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1508 microversion: 2.1 time: 0.453030 Sep 10 11:58:05.575531 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2073/4153] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:05 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1508 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:05.596631 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9dc37de6-2d73-4275-8f29-5df89f8e18a4 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:05.597874 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9dc37de6-2d73-4275-8f29-5df89f8e18a4 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] [instance: ab2e742e-c678-4d28-9d95-e8b9b9443867] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:05.611797 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9dc37de6-2d73-4275-8f29-5df89f8e18a4 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:05.612774 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9dc37de6-2d73-4275-8f29-5df89f8e18a4 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:05.613430 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9dc37de6-2d73-4275-8f29-5df89f8e18a4 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:05.614506 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9dc37de6-2d73-4275-8f29-5df89f8e18a4 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:05.635963 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9dc37de6-2d73-4275-8f29-5df89f8e18a4 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:05.636753 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9dc37de6-2d73-4275-8f29-5df89f8e18a4 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:05.918632 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-13ea9d48-3abd-45f5-bafb-7b70cdf59d73 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "DELETE /compute/v2.1/images/ecb21bf2-1e4a-4b54-9ab7-b90b9f3a17d1" status: 204 len: 0 microversion: 2.1 time: 1.180150 Sep 10 11:58:05.919870 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2081/4154] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:04 2022] DELETE /compute/v2.1/images/ecb21bf2-1e4a-4b54-9ab7-b90b9f3a17d1 => generated 0 bytes in 1182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:58:05.927983 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-37b1fefb-2fe8-48e8-9beb-a459041ebd6c tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4071f110d0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:06.041808 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9dc37de6-2d73-4275-8f29-5df89f8e18a4 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:06.052230 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9dc37de6-2d73-4275-8f29-5df89f8e18a4 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:06.053966 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9dc37de6-2d73-4275-8f29-5df89f8e18a4 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:06.055946 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9dc37de6-2d73-4275-8f29-5df89f8e18a4 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] 10.222.0.23 "GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867" status: 200 len: 1362 microversion: 2.26 time: 0.476537 Sep 10 11:58:06.056524 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2074/4155] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:58:05 2022] GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867 => generated 1362 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:58:06.079475 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1df12717-7b7a-4f91-be45-e22aec92c9b0 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:06.080343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1df12717-7b7a-4f91-be45-e22aec92c9b0 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:06.086575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1df12717-7b7a-4f91-be45-e22aec92c9b0 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:06.087339 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1df12717-7b7a-4f91-be45-e22aec92c9b0 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:06.087830 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1df12717-7b7a-4f91-be45-e22aec92c9b0 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:06.088549 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1df12717-7b7a-4f91-be45-e22aec92c9b0 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:06.089015 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1df12717-7b7a-4f91-be45-e22aec92c9b0 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:06.089456 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1df12717-7b7a-4f91-be45-e22aec92c9b0 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:06.292327 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1df12717-7b7a-4f91-be45-e22aec92c9b0 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:06.314219 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1df12717-7b7a-4f91-be45-e22aec92c9b0 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:06.321121 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1df12717-7b7a-4f91-be45-e22aec92c9b0 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:06.324253 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1df12717-7b7a-4f91-be45-e22aec92c9b0 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1730 microversion: 2.20 time: 0.251583 Sep 10 11:58:06.328506 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2075/4156] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:58:06 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1730 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:58:06.601267 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-16b5f42d-36e7-429e-90e9-83db40aaf43f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:06.602918 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-16b5f42d-36e7-429e-90e9-83db40aaf43f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:06.610097 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16b5f42d-36e7-429e-90e9-83db40aaf43f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:06.610665 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16b5f42d-36e7-429e-90e9-83db40aaf43f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:06.611208 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16b5f42d-36e7-429e-90e9-83db40aaf43f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:06.611987 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16b5f42d-36e7-429e-90e9-83db40aaf43f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:06.612685 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16b5f42d-36e7-429e-90e9-83db40aaf43f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:06.613167 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16b5f42d-36e7-429e-90e9-83db40aaf43f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:06.835138 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-16b5f42d-36e7-429e-90e9-83db40aaf43f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:06.848269 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-16b5f42d-36e7-429e-90e9-83db40aaf43f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1508 microversion: 2.1 time: 0.251161 Sep 10 11:58:06.848835 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2076/4157] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:06 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1508 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:58:06.918391 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-37b1fefb-2fe8-48e8-9beb-a459041ebd6c tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "DELETE /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76" status: 204 len: 0 microversion: 2.1 time: 0.994225 Sep 10 11:58:06.918968 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2082/4158] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:05 2022] DELETE /compute/v2.1/images/19f1b090-fba8-40dd-b3a6-8f5d5acbbf76 => generated 0 bytes in 996 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 11:58:06.926864 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e79bf8e3-b7da-4ca4-a95b-9f30c8868635 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4072c81940>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:07.087018 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7abfdc20-def0-4213-99a7-9693100473f2 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:07.087668 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7abfdc20-def0-4213-99a7-9693100473f2 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] [instance: ab2e742e-c678-4d28-9d95-e8b9b9443867] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:07.100656 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7abfdc20-def0-4213-99a7-9693100473f2 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:07.101820 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7abfdc20-def0-4213-99a7-9693100473f2 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:07.102538 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7abfdc20-def0-4213-99a7-9693100473f2 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:07.103294 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7abfdc20-def0-4213-99a7-9693100473f2 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:07.103761 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7abfdc20-def0-4213-99a7-9693100473f2 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:07.104184 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7abfdc20-def0-4213-99a7-9693100473f2 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:07.301080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7abfdc20-def0-4213-99a7-9693100473f2 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:07.315643 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7abfdc20-def0-4213-99a7-9693100473f2 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:07.317732 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7abfdc20-def0-4213-99a7-9693100473f2 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:07.319490 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7abfdc20-def0-4213-99a7-9693100473f2 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] 10.222.0.23 "GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867" status: 200 len: 1362 microversion: 2.26 time: 0.237691 Sep 10 11:58:07.321397 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2083/4159] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:58:07 2022] GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867 => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:58:07.353339 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-61983793-99b7-4b63-87bd-99abf6ab96cf tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:07.354501 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-61983793-99b7-4b63-87bd-99abf6ab96cf tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:07.361125 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61983793-99b7-4b63-87bd-99abf6ab96cf tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:07.361940 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61983793-99b7-4b63-87bd-99abf6ab96cf tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:07.362649 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61983793-99b7-4b63-87bd-99abf6ab96cf tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:07.363654 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61983793-99b7-4b63-87bd-99abf6ab96cf tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:07.364305 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61983793-99b7-4b63-87bd-99abf6ab96cf tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:07.364952 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61983793-99b7-4b63-87bd-99abf6ab96cf tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:07.544002 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-61983793-99b7-4b63-87bd-99abf6ab96cf tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:07.552515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-61983793-99b7-4b63-87bd-99abf6ab96cf tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:07.555586 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-61983793-99b7-4b63-87bd-99abf6ab96cf tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:07.558562 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-61983793-99b7-4b63-87bd-99abf6ab96cf tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1730 microversion: 2.20 time: 0.209580 Sep 10 11:58:07.572097 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2084/4160] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:58:07 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1730 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:58:07.736514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-cd2a9fc5-08b6-4226-a005-b65540e20793 req-1511bd6d-048e-424c-9bcf-ee7a7d83f69e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab2e742e-c678-4d28-9d95-e8b9b9443867", "tag": "8336b456-9ebc-4e1b-ba87-d18c785ff509"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:58:07.750704 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-cd2a9fc5-08b6-4226-a005-b65540e20793 req-1511bd6d-048e-424c-9bcf-ee7a7d83f69e service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:07.751395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-cd2a9fc5-08b6-4226-a005-b65540e20793 req-1511bd6d-048e-424c-9bcf-ee7a7d83f69e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:07.751886 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-cd2a9fc5-08b6-4226-a005-b65540e20793 req-1511bd6d-048e-424c-9bcf-ee7a7d83f69e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:07.772728 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-cd2a9fc5-08b6-4226-a005-b65540e20793 req-1511bd6d-048e-424c-9bcf-ee7a7d83f69e service nova] Creating event network-changed:8336b456-9ebc-4e1b-ba87-d18c785ff509 for instance ab2e742e-c678-4d28-9d95-e8b9b9443867 on n-h2-856895-1 Sep 10 11:58:07.781796 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-cd2a9fc5-08b6-4226-a005-b65540e20793 req-1511bd6d-048e-424c-9bcf-ee7a7d83f69e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048999 Sep 10 11:58:07.783999 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2085/4161] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:58:07.895816 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-518b3f95-d93d-4b73-abc9-b17022012c26 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:07.899539 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-518b3f95-d93d-4b73-abc9-b17022012c26 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:07.932246 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-518b3f95-d93d-4b73-abc9-b17022012c26 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:07.934734 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-518b3f95-d93d-4b73-abc9-b17022012c26 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:07.938254 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-518b3f95-d93d-4b73-abc9-b17022012c26 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:07.939040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-518b3f95-d93d-4b73-abc9-b17022012c26 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:07.939557 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-518b3f95-d93d-4b73-abc9-b17022012c26 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:07.940002 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-518b3f95-d93d-4b73-abc9-b17022012c26 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:08.077129 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e79bf8e3-b7da-4ca4-a95b-9f30c8868635 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "DELETE /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474" status: 204 len: 0 microversion: 2.1 time: 1.153974 Sep 10 11:58:08.078216 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2077/4162] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:06 2022] DELETE /compute/v2.1/images/ad034083-1161-493d-85cf-6400dd963474 => generated 0 bytes in 1156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:58:08.086193 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-531bcd3d-5d95-4bef-8242-9d00f1580f95 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:08.086701 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-531bcd3d-5d95-4bef-8242-9d00f1580f95 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] [instance: aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:08.094930 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-531bcd3d-5d95-4bef-8242-9d00f1580f95 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:08.095497 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-531bcd3d-5d95-4bef-8242-9d00f1580f95 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:08.095941 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-531bcd3d-5d95-4bef-8242-9d00f1580f95 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:08.096665 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-531bcd3d-5d95-4bef-8242-9d00f1580f95 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:08.097115 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-531bcd3d-5d95-4bef-8242-9d00f1580f95 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:08.097547 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-531bcd3d-5d95-4bef-8242-9d00f1580f95 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:08.139018 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-531bcd3d-5d95-4bef-8242-9d00f1580f95 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] [instance: aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:58:08.208257 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:58:08.230564 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-531bcd3d-5d95-4bef-8242-9d00f1580f95 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "DELETE /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7" status: 204 len: 0 microversion: 2.1 time: 0.147908 Sep 10 11:58:08.231878 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2078/4163] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:58:08 2022] DELETE /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:58:08.241039 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f6b97557-3dce-4757-a2bd-77712bcd1702 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:08.242187 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f6b97557-3dce-4757-a2bd-77712bcd1702 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] [instance: aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:08.249517 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f6b97557-3dce-4757-a2bd-77712bcd1702 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:08.250014 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f6b97557-3dce-4757-a2bd-77712bcd1702 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:08.250456 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f6b97557-3dce-4757-a2bd-77712bcd1702 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:08.251421 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f6b97557-3dce-4757-a2bd-77712bcd1702 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:08.252231 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f6b97557-3dce-4757-a2bd-77712bcd1702 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:08.253024 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f6b97557-3dce-4757-a2bd-77712bcd1702 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:08.292437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-518b3f95-d93d-4b73-abc9-b17022012c26 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:08.301029 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-518b3f95-d93d-4b73-abc9-b17022012c26 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1508 microversion: 2.1 time: 0.427514 Sep 10 11:58:08.301591 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2086/4164] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:07 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1508 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:08.353652 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c9f1a69e-502d-4c6e-a0d4-b8bed1985e32 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:08.354647 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c9f1a69e-502d-4c6e-a0d4-b8bed1985e32 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] [instance: ab2e742e-c678-4d28-9d95-e8b9b9443867] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:08.361786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c9f1a69e-502d-4c6e-a0d4-b8bed1985e32 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:08.362611 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c9f1a69e-502d-4c6e-a0d4-b8bed1985e32 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:08.363314 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c9f1a69e-502d-4c6e-a0d4-b8bed1985e32 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:08.364477 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c9f1a69e-502d-4c6e-a0d4-b8bed1985e32 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:08.365153 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c9f1a69e-502d-4c6e-a0d4-b8bed1985e32 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:08.365931 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c9f1a69e-502d-4c6e-a0d4-b8bed1985e32 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:08.600371 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f6b97557-3dce-4757-a2bd-77712bcd1702 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e27edecefe4d60a2dba4ba99055bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f245084ce3f409889039ba1ee751eed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:08.609503 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f6b97557-3dce-4757-a2bd-77712bcd1702 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7" status: 200 len: 1474 microversion: 2.1 time: 0.372882 Sep 10 11:58:08.610184 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2079/4165] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:08 2022] GET /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7 => generated 1474 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:08.616589 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1864464d-15db-4e7a-a1b1-774e692a1972 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:08.618124 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1864464d-15db-4e7a-a1b1-774e692a1972 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:08.625446 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1864464d-15db-4e7a-a1b1-774e692a1972 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:08.626198 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1864464d-15db-4e7a-a1b1-774e692a1972 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:08.626853 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1864464d-15db-4e7a-a1b1-774e692a1972 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:08.627803 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1864464d-15db-4e7a-a1b1-774e692a1972 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:08.629106 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1864464d-15db-4e7a-a1b1-774e692a1972 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:08.629756 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1864464d-15db-4e7a-a1b1-774e692a1972 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:08.809889 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c9f1a69e-502d-4c6e-a0d4-b8bed1985e32 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:08.818217 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c9f1a69e-502d-4c6e-a0d4-b8bed1985e32 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:08.819796 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c9f1a69e-502d-4c6e-a0d4-b8bed1985e32 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:08.821608 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c9f1a69e-502d-4c6e-a0d4-b8bed1985e32 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] 10.222.0.23 "GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867" status: 200 len: 1362 microversion: 2.26 time: 0.472066 Sep 10 11:58:08.822927 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2087/4166] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:58:08 2022] GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867 => generated 1362 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:58:08.998561 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1864464d-15db-4e7a-a1b1-774e692a1972 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:09.009708 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1864464d-15db-4e7a-a1b1-774e692a1972 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:09.011788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1864464d-15db-4e7a-a1b1-774e692a1972 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:09.013309 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1864464d-15db-4e7a-a1b1-774e692a1972 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1730 microversion: 2.20 time: 0.400933 Sep 10 11:58:09.014416 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2080/4167] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:58:08 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1730 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:58:09.042167 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-17e6f2e7-ffac-416a-91b1-eca704c3b4b8 req-d3409ca8-74e3-4334-b5ea-a091c993402a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39f90b6f-123c-451f-8f7a-dbe291a5d4a7", "name": "network-vif-plugged", "status": "completed", "tag": "c38ed82a-b2c8-4c91-b325-3aed6429f4b0"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:58:09.057408 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-17e6f2e7-ffac-416a-91b1-eca704c3b4b8 req-d3409ca8-74e3-4334-b5ea-a091c993402a service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:09.057907 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-17e6f2e7-ffac-416a-91b1-eca704c3b4b8 req-d3409ca8-74e3-4334-b5ea-a091c993402a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:09.058845 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-17e6f2e7-ffac-416a-91b1-eca704c3b4b8 req-d3409ca8-74e3-4334-b5ea-a091c993402a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:09.078908 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-17e6f2e7-ffac-416a-91b1-eca704c3b4b8 req-d3409ca8-74e3-4334-b5ea-a091c993402a service nova] Creating event network-vif-plugged:c38ed82a-b2c8-4c91-b325-3aed6429f4b0 for instance 39f90b6f-123c-451f-8f7a-dbe291a5d4a7 on n-h2-856895-1 Sep 10 11:58:09.089170 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-17e6f2e7-ffac-416a-91b1-eca704c3b4b8 req-d3409ca8-74e3-4334-b5ea-a091c993402a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074771 Sep 10 11:58:09.090901 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2088/4168] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:58:09.325090 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d8ff0d17-de32-46c1-80c5-11900292d8e4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:09.325853 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d8ff0d17-de32-46c1-80c5-11900292d8e4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:09.332044 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d8ff0d17-de32-46c1-80c5-11900292d8e4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:09.332624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d8ff0d17-de32-46c1-80c5-11900292d8e4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:09.333139 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d8ff0d17-de32-46c1-80c5-11900292d8e4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:09.333909 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d8ff0d17-de32-46c1-80c5-11900292d8e4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:09.334547 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d8ff0d17-de32-46c1-80c5-11900292d8e4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:09.334986 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d8ff0d17-de32-46c1-80c5-11900292d8e4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:09.471189 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d8ff0d17-de32-46c1-80c5-11900292d8e4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:09.479671 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d8ff0d17-de32-46c1-80c5-11900292d8e4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1529 microversion: 2.1 time: 0.159056 Sep 10 11:58:09.485404 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2081/4169] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:09 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1529 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:09.633954 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5de6ccc3-4f9c-47af-b762-378f3f2ba767 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:09.635017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5de6ccc3-4f9c-47af-b762-378f3f2ba767 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] [instance: aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:09.642775 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5de6ccc3-4f9c-47af-b762-378f3f2ba767 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:09.643719 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5de6ccc3-4f9c-47af-b762-378f3f2ba767 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:09.644476 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5de6ccc3-4f9c-47af-b762-378f3f2ba767 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:09.645558 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5de6ccc3-4f9c-47af-b762-378f3f2ba767 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:09.646084 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5de6ccc3-4f9c-47af-b762-378f3f2ba767 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:09.646735 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5de6ccc3-4f9c-47af-b762-378f3f2ba767 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:09.848777 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e0e36683-65dc-4b6e-805a-1c62bb533264 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:09.849729 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e0e36683-65dc-4b6e-805a-1c62bb533264 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] [instance: ab2e742e-c678-4d28-9d95-e8b9b9443867] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:09.864162 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e0e36683-65dc-4b6e-805a-1c62bb533264 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:09.865006 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e0e36683-65dc-4b6e-805a-1c62bb533264 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:09.865652 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e0e36683-65dc-4b6e-805a-1c62bb533264 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:09.866558 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e0e36683-65dc-4b6e-805a-1c62bb533264 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:09.867332 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e0e36683-65dc-4b6e-805a-1c62bb533264 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:09.868038 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e0e36683-65dc-4b6e-805a-1c62bb533264 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:10.002892 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:58:10.031093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:58:10.412672 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5de6ccc3-4f9c-47af-b762-378f3f2ba767 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e27edecefe4d60a2dba4ba99055bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f245084ce3f409889039ba1ee751eed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:10.422084 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5de6ccc3-4f9c-47af-b762-378f3f2ba767 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7" status: 200 len: 1474 microversion: 2.1 time: 0.793684 Sep 10 11:58:10.437925 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2089/4170] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:09 2022] GET /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7 => generated 1474 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:10.446893 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-87894b7d-a0f2-46fc-9d46-9a366eb795d8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:10.447867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-87894b7d-a0f2-46fc-9d46-9a366eb795d8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:10.454993 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87894b7d-a0f2-46fc-9d46-9a366eb795d8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:10.455762 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87894b7d-a0f2-46fc-9d46-9a366eb795d8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:10.456419 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87894b7d-a0f2-46fc-9d46-9a366eb795d8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:10.457413 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87894b7d-a0f2-46fc-9d46-9a366eb795d8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:10.458105 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87894b7d-a0f2-46fc-9d46-9a366eb795d8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:10.458802 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87894b7d-a0f2-46fc-9d46-9a366eb795d8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:10.503779 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:58:10.623264 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e0e36683-65dc-4b6e-805a-1c62bb533264 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:10.639840 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e0e36683-65dc-4b6e-805a-1c62bb533264 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:10.642195 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e0e36683-65dc-4b6e-805a-1c62bb533264 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:10.645271 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e0e36683-65dc-4b6e-805a-1c62bb533264 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] 10.222.0.23 "GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867" status: 200 len: 1362 microversion: 2.26 time: 0.800686 Sep 10 11:58:10.661130 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2082/4171] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:58:09 2022] GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867 => generated 1362 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:58:10.673769 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9d9981dc-dc7d-4c7c-a126-32d31d0c2b6d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:10.674405 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9d9981dc-dc7d-4c7c-a126-32d31d0c2b6d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:10.681986 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d9981dc-dc7d-4c7c-a126-32d31d0c2b6d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:10.682481 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d9981dc-dc7d-4c7c-a126-32d31d0c2b6d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:10.683007 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d9981dc-dc7d-4c7c-a126-32d31d0c2b6d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:10.683645 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d9981dc-dc7d-4c7c-a126-32d31d0c2b6d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:10.684272 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d9981dc-dc7d-4c7c-a126-32d31d0c2b6d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:10.685003 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d9981dc-dc7d-4c7c-a126-32d31d0c2b6d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:10.872322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-87894b7d-a0f2-46fc-9d46-9a366eb795d8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:10.903187 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-87894b7d-a0f2-46fc-9d46-9a366eb795d8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:10.905238 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-87894b7d-a0f2-46fc-9d46-9a366eb795d8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:10.907582 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-87894b7d-a0f2-46fc-9d46-9a366eb795d8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1730 microversion: 2.20 time: 0.470857 Sep 10 11:58:10.913104 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2090/4172] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:58:10 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1730 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:58:11.156672 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9d9981dc-dc7d-4c7c-a126-32d31d0c2b6d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:11.167439 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9d9981dc-dc7d-4c7c-a126-32d31d0c2b6d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1524 microversion: 2.1 time: 0.505054 Sep 10 11:58:11.171764 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2083/4173] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:10 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1524 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:11.223304 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-3a8b8639-5bf9-42d6-9cae-97fe93e444e2 req-c57b6526-07b8-4432-a280-4017c059d267 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7", "name": "network-vif-deleted", "tag": "83f19d9c-64d5-42d5-86ba-3993c5101e77"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:58:11.271722 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-3a8b8639-5bf9-42d6-9cae-97fe93e444e2 req-c57b6526-07b8-4432-a280-4017c059d267 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:11.272169 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-3a8b8639-5bf9-42d6-9cae-97fe93e444e2 req-c57b6526-07b8-4432-a280-4017c059d267 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:11.281425 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-3a8b8639-5bf9-42d6-9cae-97fe93e444e2 req-c57b6526-07b8-4432-a280-4017c059d267 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:11.318297 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-3a8b8639-5bf9-42d6-9cae-97fe93e444e2 req-c57b6526-07b8-4432-a280-4017c059d267 service nova] Creating event network-vif-deleted:83f19d9c-64d5-42d5-86ba-3993c5101e77 for instance aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7 on n-h1-856895-1 Sep 10 11:58:11.334701 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-3a8b8639-5bf9-42d6-9cae-97fe93e444e2 req-c57b6526-07b8-4432-a280-4017c059d267 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120413 Sep 10 11:58:11.336840 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2091/4174] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:58:11.447624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c235a56d-14a9-4c8e-82b2-a0c5099cfba0 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:11.450736 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c235a56d-14a9-4c8e-82b2-a0c5099cfba0 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] [instance: aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:11.478019 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c235a56d-14a9-4c8e-82b2-a0c5099cfba0 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:11.480666 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c235a56d-14a9-4c8e-82b2-a0c5099cfba0 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:11.483208 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c235a56d-14a9-4c8e-82b2-a0c5099cfba0 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:11.485534 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c235a56d-14a9-4c8e-82b2-a0c5099cfba0 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:11.486035 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c235a56d-14a9-4c8e-82b2-a0c5099cfba0 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:11.495901 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c235a56d-14a9-4c8e-82b2-a0c5099cfba0 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:11.599452 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c235a56d-14a9-4c8e-82b2-a0c5099cfba0 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:11.600021 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c235a56d-14a9-4c8e-82b2-a0c5099cfba0 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:11.600371 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c235a56d-14a9-4c8e-82b2-a0c5099cfba0 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:11.609590 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-c235a56d-14a9-4c8e-82b2-a0c5099cfba0 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lazy-loading 'fault' on Instance uuid aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:58:11.677993 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1a802724-5d80-42dd-8dd2-0eba95686b8c tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:11.679473 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1a802724-5d80-42dd-8dd2-0eba95686b8c tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] [instance: ab2e742e-c678-4d28-9d95-e8b9b9443867] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:11.695586 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1a802724-5d80-42dd-8dd2-0eba95686b8c tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:11.699193 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1a802724-5d80-42dd-8dd2-0eba95686b8c tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:11.700249 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1a802724-5d80-42dd-8dd2-0eba95686b8c tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:11.702322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1a802724-5d80-42dd-8dd2-0eba95686b8c tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:11.703759 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1a802724-5d80-42dd-8dd2-0eba95686b8c tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:11.705239 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1a802724-5d80-42dd-8dd2-0eba95686b8c tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:11.937079 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c235a56d-14a9-4c8e-82b2-a0c5099cfba0 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e27edecefe4d60a2dba4ba99055bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f245084ce3f409889039ba1ee751eed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:11.951141 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c235a56d-14a9-4c8e-82b2-a0c5099cfba0 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7" status: 200 len: 1308 microversion: 2.1 time: 0.509014 Sep 10 11:58:11.954440 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2084/4175] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:11 2022] GET /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7 => generated 1308 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:11.964052 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cdf24ee6-6d9d-46d4-936a-2605edb137c9 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:11.966190 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cdf24ee6-6d9d-46d4-936a-2605edb137c9 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:11.982524 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cdf24ee6-6d9d-46d4-936a-2605edb137c9 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:11.983029 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cdf24ee6-6d9d-46d4-936a-2605edb137c9 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:11.983807 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cdf24ee6-6d9d-46d4-936a-2605edb137c9 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:11.986555 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cdf24ee6-6d9d-46d4-936a-2605edb137c9 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:11.987376 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cdf24ee6-6d9d-46d4-936a-2605edb137c9 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:11.987823 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cdf24ee6-6d9d-46d4-936a-2605edb137c9 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:12.257051 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1a802724-5d80-42dd-8dd2-0eba95686b8c tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:12.274740 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1a802724-5d80-42dd-8dd2-0eba95686b8c tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:12.276834 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1a802724-5d80-42dd-8dd2-0eba95686b8c tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:12.292659 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1a802724-5d80-42dd-8dd2-0eba95686b8c tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] 10.222.0.23 "GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867" status: 200 len: 1362 microversion: 2.26 time: 0.619501 Sep 10 11:58:12.296762 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2092/4176] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:58:11 2022] GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867 => generated 1362 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:58:12.305784 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6950c89a-adf4-4099-92d3-ecd26957a531 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:12.313866 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6950c89a-adf4-4099-92d3-ecd26957a531 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:12.327205 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6950c89a-adf4-4099-92d3-ecd26957a531 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:12.328016 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6950c89a-adf4-4099-92d3-ecd26957a531 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:12.329003 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6950c89a-adf4-4099-92d3-ecd26957a531 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:12.329911 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6950c89a-adf4-4099-92d3-ecd26957a531 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:12.330794 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6950c89a-adf4-4099-92d3-ecd26957a531 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:12.331430 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6950c89a-adf4-4099-92d3-ecd26957a531 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:12.412362 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-cdf24ee6-6d9d-46d4-936a-2605edb137c9 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:12.424829 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-cdf24ee6-6d9d-46d4-936a-2605edb137c9 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:12.430308 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-cdf24ee6-6d9d-46d4-936a-2605edb137c9 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:12.433182 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cdf24ee6-6d9d-46d4-936a-2605edb137c9 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1730 microversion: 2.20 time: 0.476434 Sep 10 11:58:12.448881 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2085/4177] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:58:11 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1730 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:58:12.754519 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6950c89a-adf4-4099-92d3-ecd26957a531 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:12.784819 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6950c89a-adf4-4099-92d3-ecd26957a531 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1524 microversion: 2.1 time: 0.486348 Sep 10 11:58:12.795886 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2093/4178] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:12 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1524 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:12.978264 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9dc353ed-0a8d-4f3b-95ab-1c004f3598a7 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:12.980328 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9dc353ed-0a8d-4f3b-95ab-1c004f3598a7 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] [instance: aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:13.018556 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9dc353ed-0a8d-4f3b-95ab-1c004f3598a7 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:13.019424 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9dc353ed-0a8d-4f3b-95ab-1c004f3598a7 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:13.024696 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9dc353ed-0a8d-4f3b-95ab-1c004f3598a7 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:13.027497 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9dc353ed-0a8d-4f3b-95ab-1c004f3598a7 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:13.028697 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9dc353ed-0a8d-4f3b-95ab-1c004f3598a7 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:13.030768 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9dc353ed-0a8d-4f3b-95ab-1c004f3598a7 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:13.092185 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-9dc353ed-0a8d-4f3b-95ab-1c004f3598a7 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] HTTP exception thrown: Instance aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7 could not be found. Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9dc353ed-0a8d-4f3b-95ab-1c004f3598a7 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Request method failure captured: Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7 HTTP/1.1 Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHs3cRe66dbgigOFxoKprQIBx1JbKaFUiULXI9lgE1g3ExLzrvvWVDi564EmmrL-f68kNgBFfza-JQ6pLhliDM_uvJPsPisvUjAKC09-9RvomE9UQEC__f3zA-AyrKzZYRavyLOjqqZNJWPUr2MqyvpJsPixfHx22KkFus21wOlxDG8 Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 6f245084ce3f409889039ba1ee751eed Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ListImageFiltersTestJSON-1985560884 Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6f245084ce3f409889039ba1ee751eed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6f245084ce3f409889039ba1ee751eed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6f245084ce3f409889039ba1ee751eed", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6f245084ce3f409889039ba1ee751eed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ListImageFiltersTestJSON-1985560884 Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 6f245084ce3f409889039ba1ee751eed Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1985560884 Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ListImageFiltersTestJSON-1985560884-project Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 72e27edecefe4d60a2dba4ba99055bb1 Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ListImageFiltersTestJSON-1985560884-project Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7 could not be found. Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7'} Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7 could not be found. Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7 could not be found. Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:58:13.095925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:58:13.100632 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:58:13.100632 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:58:13.100632 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:58:13.100632 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:58:13.100632 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:58:13.100632 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7 could not be found. Sep 10 11:58:13.100632 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:58:13.105062 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9dc353ed-0a8d-4f3b-95ab-1c004f3598a7 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Returning 404 to user: Instance aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:58:13.106200 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9dc353ed-0a8d-4f3b-95ab-1c004f3598a7 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7" status: 404 len: 111 microversion: 2.1 time: 0.133504 Sep 10 11:58:13.118690 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-204cc552-d28f-4ad4-9fcd-f0f8dfbcf43b tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:13.119343 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-204cc552-d28f-4ad4-9fcd-f0f8dfbcf43b tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] [instance: af31e6eb-f34c-4ae9-aede-bc4ca6949556] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:13.129366 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-204cc552-d28f-4ad4-9fcd-f0f8dfbcf43b tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:13.129815 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2086/4179] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:12 2022] GET /compute/v2.1/servers/aed8ed81-cc9b-4d5b-b33d-9abb86e10cd7 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:58:13.130356 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-204cc552-d28f-4ad4-9fcd-f0f8dfbcf43b tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:13.130803 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-204cc552-d28f-4ad4-9fcd-f0f8dfbcf43b tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:13.136027 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-204cc552-d28f-4ad4-9fcd-f0f8dfbcf43b tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:13.136536 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-204cc552-d28f-4ad4-9fcd-f0f8dfbcf43b tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:13.137049 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-204cc552-d28f-4ad4-9fcd-f0f8dfbcf43b tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:13.185137 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-204cc552-d28f-4ad4-9fcd-f0f8dfbcf43b tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] [instance: af31e6eb-f34c-4ae9-aede-bc4ca6949556] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:58:13.192804 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=100 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:58:13.322869 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-087fd142-dc33-40cb-bcd1-aedaf505853f tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:13.325158 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-087fd142-dc33-40cb-bcd1-aedaf505853f tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] [instance: ab2e742e-c678-4d28-9d95-e8b9b9443867] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:13.340495 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-204cc552-d28f-4ad4-9fcd-f0f8dfbcf43b tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "DELETE /compute/v2.1/servers/af31e6eb-f34c-4ae9-aede-bc4ca6949556" status: 204 len: 0 microversion: 2.1 time: 0.225873 Sep 10 11:58:13.344299 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2094/4180] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:58:13 2022] DELETE /compute/v2.1/servers/af31e6eb-f34c-4ae9-aede-bc4ca6949556 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 11:58:13.349101 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-087fd142-dc33-40cb-bcd1-aedaf505853f tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:13.349608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-087fd142-dc33-40cb-bcd1-aedaf505853f tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:13.350116 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-087fd142-dc33-40cb-bcd1-aedaf505853f tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:13.353352 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-087fd142-dc33-40cb-bcd1-aedaf505853f tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:13.353978 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-087fd142-dc33-40cb-bcd1-aedaf505853f tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:13.356849 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-087fd142-dc33-40cb-bcd1-aedaf505853f tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:13.358070 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5fef6a91-fcc0-46ec-8e60-509de36b48a2 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:13.362833 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5fef6a91-fcc0-46ec-8e60-509de36b48a2 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] [instance: af31e6eb-f34c-4ae9-aede-bc4ca6949556] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:13.391442 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5fef6a91-fcc0-46ec-8e60-509de36b48a2 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:13.393479 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5fef6a91-fcc0-46ec-8e60-509de36b48a2 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:13.395541 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:58:13.395915 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5fef6a91-fcc0-46ec-8e60-509de36b48a2 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:13.399453 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5fef6a91-fcc0-46ec-8e60-509de36b48a2 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:13.400423 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5fef6a91-fcc0-46ec-8e60-509de36b48a2 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:13.401581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5fef6a91-fcc0-46ec-8e60-509de36b48a2 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:13.794898 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5fef6a91-fcc0-46ec-8e60-509de36b48a2 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e27edecefe4d60a2dba4ba99055bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f245084ce3f409889039ba1ee751eed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:13.807607 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5fef6a91-fcc0-46ec-8e60-509de36b48a2 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/servers/af31e6eb-f34c-4ae9-aede-bc4ca6949556" status: 200 len: 1472 microversion: 2.1 time: 0.458987 Sep 10 11:58:13.822746 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2095/4181] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:13 2022] GET /compute/v2.1/servers/af31e6eb-f34c-4ae9-aede-bc4ca6949556 => generated 1472 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:13.838849 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e53d33e1-51d3-46c1-8110-02e83ae2ec7a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:13.840077 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e53d33e1-51d3-46c1-8110-02e83ae2ec7a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:13.852580 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e53d33e1-51d3-46c1-8110-02e83ae2ec7a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:13.860149 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e53d33e1-51d3-46c1-8110-02e83ae2ec7a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:13.860771 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e53d33e1-51d3-46c1-8110-02e83ae2ec7a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:13.861692 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e53d33e1-51d3-46c1-8110-02e83ae2ec7a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:13.862355 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e53d33e1-51d3-46c1-8110-02e83ae2ec7a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:13.862805 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e53d33e1-51d3-46c1-8110-02e83ae2ec7a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:13.870510 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-087fd142-dc33-40cb-bcd1-aedaf505853f tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:13.883864 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-087fd142-dc33-40cb-bcd1-aedaf505853f tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:13.885345 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-087fd142-dc33-40cb-bcd1-aedaf505853f tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:13.886520 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-087fd142-dc33-40cb-bcd1-aedaf505853f tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] 10.222.0.23 "GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867" status: 200 len: 1362 microversion: 2.26 time: 0.568542 Sep 10 11:58:13.898393 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2087/4182] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:58:13 2022] GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867 => generated 1362 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:58:13.920045 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ed28a2cf-ef5a-4e3e-bfd4-fbfc01fe777c tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:13.920670 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ed28a2cf-ef5a-4e3e-bfd4-fbfc01fe777c tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:13.930980 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed28a2cf-ef5a-4e3e-bfd4-fbfc01fe777c tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:13.931510 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed28a2cf-ef5a-4e3e-bfd4-fbfc01fe777c tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:13.931958 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed28a2cf-ef5a-4e3e-bfd4-fbfc01fe777c tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:13.932674 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed28a2cf-ef5a-4e3e-bfd4-fbfc01fe777c tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:13.933140 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed28a2cf-ef5a-4e3e-bfd4-fbfc01fe777c tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:13.933573 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed28a2cf-ef5a-4e3e-bfd4-fbfc01fe777c tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:14.273860 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e53d33e1-51d3-46c1-8110-02e83ae2ec7a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:14.286947 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e53d33e1-51d3-46c1-8110-02e83ae2ec7a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:14.293138 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e53d33e1-51d3-46c1-8110-02e83ae2ec7a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:14.294833 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e53d33e1-51d3-46c1-8110-02e83ae2ec7a tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1730 microversion: 2.20 time: 0.470817 Sep 10 11:58:14.296410 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2096/4183] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:58:13 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1730 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:58:14.357068 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ed28a2cf-ef5a-4e3e-bfd4-fbfc01fe777c tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:14.367446 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ed28a2cf-ef5a-4e3e-bfd4-fbfc01fe777c tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1524 microversion: 2.1 time: 0.451090 Sep 10 11:58:14.369112 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2088/4184] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:13 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1524 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:14.838734 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-aa72adf2-f3aa-44f6-a830-3e5dc7de72d3 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:14.840424 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-aa72adf2-f3aa-44f6-a830-3e5dc7de72d3 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] [instance: af31e6eb-f34c-4ae9-aede-bc4ca6949556] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:14.861180 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa72adf2-f3aa-44f6-a830-3e5dc7de72d3 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:14.862301 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa72adf2-f3aa-44f6-a830-3e5dc7de72d3 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:14.862863 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa72adf2-f3aa-44f6-a830-3e5dc7de72d3 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:14.863633 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa72adf2-f3aa-44f6-a830-3e5dc7de72d3 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:14.864094 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa72adf2-f3aa-44f6-a830-3e5dc7de72d3 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:14.864523 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa72adf2-f3aa-44f6-a830-3e5dc7de72d3 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:14.918923 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f44bd5bc-b859-4624-bad2-2259f513fe7d tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:14.920673 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f44bd5bc-b859-4624-bad2-2259f513fe7d tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] [instance: ab2e742e-c678-4d28-9d95-e8b9b9443867] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:14.927691 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f44bd5bc-b859-4624-bad2-2259f513fe7d tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:14.937818 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f44bd5bc-b859-4624-bad2-2259f513fe7d tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:14.941652 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f44bd5bc-b859-4624-bad2-2259f513fe7d tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:14.944578 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f44bd5bc-b859-4624-bad2-2259f513fe7d tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:14.945227 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f44bd5bc-b859-4624-bad2-2259f513fe7d tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:14.950185 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f44bd5bc-b859-4624-bad2-2259f513fe7d tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:15.421865 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-aa72adf2-f3aa-44f6-a830-3e5dc7de72d3 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e27edecefe4d60a2dba4ba99055bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f245084ce3f409889039ba1ee751eed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:15.432291 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-aa72adf2-f3aa-44f6-a830-3e5dc7de72d3 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/servers/af31e6eb-f34c-4ae9-aede-bc4ca6949556" status: 200 len: 1472 microversion: 2.1 time: 0.599401 Sep 10 11:58:15.457454 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2097/4185] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:14 2022] GET /compute/v2.1/servers/af31e6eb-f34c-4ae9-aede-bc4ca6949556 => generated 1472 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:15.463282 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f44bd5bc-b859-4624-bad2-2259f513fe7d tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:15.470392 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-1bf6386c-032e-4a70-9db9-faae29d4b077 req-68524e3d-526c-4d9e-bfe1-559ae447590a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7063ea81-230e-4cee-902b-76c44ebd2d74", "name": "network-vif-plugged", "status": "completed", "tag": "31936436-071f-4346-af16-9b17b5da3199"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:58:15.488270 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-1bf6386c-032e-4a70-9db9-faae29d4b077 req-68524e3d-526c-4d9e-bfe1-559ae447590a service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:15.488859 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f44bd5bc-b859-4624-bad2-2259f513fe7d tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:15.489361 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-1bf6386c-032e-4a70-9db9-faae29d4b077 req-68524e3d-526c-4d9e-bfe1-559ae447590a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:15.490016 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-1bf6386c-032e-4a70-9db9-faae29d4b077 req-68524e3d-526c-4d9e-bfe1-559ae447590a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:15.490475 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f44bd5bc-b859-4624-bad2-2259f513fe7d tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:15.491711 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f44bd5bc-b859-4624-bad2-2259f513fe7d tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] 10.222.0.23 "GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867" status: 200 len: 1362 microversion: 2.26 time: 0.577132 Sep 10 11:58:15.505033 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-1bf6386c-032e-4a70-9db9-faae29d4b077 req-68524e3d-526c-4d9e-bfe1-559ae447590a service nova] Creating event network-vif-plugged:31936436-071f-4346-af16-9b17b5da3199 for instance 7063ea81-230e-4cee-902b-76c44ebd2d74 on n-h2-856895-1 Sep 10 11:58:15.506204 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2089/4186] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:58:14 2022] GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867 => generated 1362 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:58:15.515566 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-75973bbc-3eab-40ee-9a0c-dc672a155e65 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:15.516541 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-75973bbc-3eab-40ee-9a0c-dc672a155e65 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:15.520737 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-1bf6386c-032e-4a70-9db9-faae29d4b077 req-68524e3d-526c-4d9e-bfe1-559ae447590a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060528 Sep 10 11:58:15.522576 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2098/4187] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:58:15.533658 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75973bbc-3eab-40ee-9a0c-dc672a155e65 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:15.537359 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75973bbc-3eab-40ee-9a0c-dc672a155e65 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:15.538072 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75973bbc-3eab-40ee-9a0c-dc672a155e65 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:15.539364 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75973bbc-3eab-40ee-9a0c-dc672a155e65 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:15.540150 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75973bbc-3eab-40ee-9a0c-dc672a155e65 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:15.540496 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-49897d29-a20c-497f-8e43-eb93d52e7af8 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:15.541845 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75973bbc-3eab-40ee-9a0c-dc672a155e65 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:15.542442 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-49897d29-a20c-497f-8e43-eb93d52e7af8 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:15.559214 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-49897d29-a20c-497f-8e43-eb93d52e7af8 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:15.560171 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-49897d29-a20c-497f-8e43-eb93d52e7af8 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:15.561529 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-49897d29-a20c-497f-8e43-eb93d52e7af8 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:15.562590 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-49897d29-a20c-497f-8e43-eb93d52e7af8 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:15.563286 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-49897d29-a20c-497f-8e43-eb93d52e7af8 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:15.567913 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-49897d29-a20c-497f-8e43-eb93d52e7af8 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:15.865456 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-75973bbc-3eab-40ee-9a0c-dc672a155e65 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:15.887033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-75973bbc-3eab-40ee-9a0c-dc672a155e65 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:15.897445 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-75973bbc-3eab-40ee-9a0c-dc672a155e65 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:15.907188 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-75973bbc-3eab-40ee-9a0c-dc672a155e65 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1717 microversion: 2.20 time: 0.397857 Sep 10 11:58:15.911102 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2090/4188] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:58:15 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1717 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:58:15.944501 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-49897d29-a20c-497f-8e43-eb93d52e7af8 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:15.965708 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-49897d29-a20c-497f-8e43-eb93d52e7af8 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1524 microversion: 2.1 time: 0.438318 Sep 10 11:58:15.966334 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2099/4189] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:15 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1524 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:16.462733 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b8925423-71bf-4d27-9ce0-72d24b8ead43 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:16.463727 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b8925423-71bf-4d27-9ce0-72d24b8ead43 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] [instance: af31e6eb-f34c-4ae9-aede-bc4ca6949556] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:16.487589 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8925423-71bf-4d27-9ce0-72d24b8ead43 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:16.492651 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8925423-71bf-4d27-9ce0-72d24b8ead43 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:16.494506 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8925423-71bf-4d27-9ce0-72d24b8ead43 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:16.498830 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8925423-71bf-4d27-9ce0-72d24b8ead43 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:16.499421 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8925423-71bf-4d27-9ce0-72d24b8ead43 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:16.500110 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8925423-71bf-4d27-9ce0-72d24b8ead43 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:16.526781 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9ca5f887-f82a-4c87-af5a-d0dc367aabbf tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:16.527791 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9ca5f887-f82a-4c87-af5a-d0dc367aabbf tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] [instance: ab2e742e-c678-4d28-9d95-e8b9b9443867] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:16.543472 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9ca5f887-f82a-4c87-af5a-d0dc367aabbf tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:16.544179 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9ca5f887-f82a-4c87-af5a-d0dc367aabbf tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:16.544640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9ca5f887-f82a-4c87-af5a-d0dc367aabbf tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:16.548286 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9ca5f887-f82a-4c87-af5a-d0dc367aabbf tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:16.548787 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9ca5f887-f82a-4c87-af5a-d0dc367aabbf tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:16.549266 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9ca5f887-f82a-4c87-af5a-d0dc367aabbf tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:16.897387 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9ca5f887-f82a-4c87-af5a-d0dc367aabbf tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:16.910852 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9ca5f887-f82a-4c87-af5a-d0dc367aabbf tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:16.914698 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9ca5f887-f82a-4c87-af5a-d0dc367aabbf tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:16.918021 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9ca5f887-f82a-4c87-af5a-d0dc367aabbf tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] 10.222.0.23 "GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867" status: 200 len: 1362 microversion: 2.26 time: 0.396078 Sep 10 11:58:16.919248 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b8925423-71bf-4d27-9ce0-72d24b8ead43 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e27edecefe4d60a2dba4ba99055bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f245084ce3f409889039ba1ee751eed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:16.919415 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2100/4190] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:58:16 2022] GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867 => generated 1362 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 11:58:16.927930 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b8925423-71bf-4d27-9ce0-72d24b8ead43 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/servers/af31e6eb-f34c-4ae9-aede-bc4ca6949556" status: 200 len: 1472 microversion: 2.1 time: 0.474305 Sep 10 11:58:16.935627 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2091/4191] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:16 2022] GET /compute/v2.1/servers/af31e6eb-f34c-4ae9-aede-bc4ca6949556 => generated 1472 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:16.967489 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-a4dfc822-c580-48fd-9182-340f7c076e2d req-d08769b6-8f95-4d4c-a07d-a63057cbe074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af31e6eb-f34c-4ae9-aede-bc4ca6949556", "name": "network-vif-deleted", "tag": "3fe151c0-067d-4e53-a33f-9bab864a1662"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:58:16.982453 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a4dfc822-c580-48fd-9182-340f7c076e2d req-d08769b6-8f95-4d4c-a07d-a63057cbe074 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:16.990806 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a4dfc822-c580-48fd-9182-340f7c076e2d req-d08769b6-8f95-4d4c-a07d-a63057cbe074 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:16.995420 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-581a3514-1a9d-425d-bb2f-7b792afba350 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:16.996061 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-581a3514-1a9d-425d-bb2f-7b792afba350 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:17.000498 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a4dfc822-c580-48fd-9182-340f7c076e2d req-d08769b6-8f95-4d4c-a07d-a63057cbe074 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:17.005938 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-581a3514-1a9d-425d-bb2f-7b792afba350 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:17.006449 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-581a3514-1a9d-425d-bb2f-7b792afba350 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:17.009031 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-581a3514-1a9d-425d-bb2f-7b792afba350 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:17.010084 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-581a3514-1a9d-425d-bb2f-7b792afba350 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:17.012876 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-581a3514-1a9d-425d-bb2f-7b792afba350 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:17.013561 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-581a3514-1a9d-425d-bb2f-7b792afba350 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:17.029079 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-a4dfc822-c580-48fd-9182-340f7c076e2d req-d08769b6-8f95-4d4c-a07d-a63057cbe074 service nova] Creating event network-vif-deleted:3fe151c0-067d-4e53-a33f-9bab864a1662 for instance af31e6eb-f34c-4ae9-aede-bc4ca6949556 on n-h1-856895-1 Sep 10 11:58:17.044904 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-a4dfc822-c580-48fd-9182-340f7c076e2d req-d08769b6-8f95-4d4c-a07d-a63057cbe074 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082129 Sep 10 11:58:17.051790 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2101/4192] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:58:17.298304 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-581a3514-1a9d-425d-bb2f-7b792afba350 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:17.307986 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-581a3514-1a9d-425d-bb2f-7b792afba350 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1524 microversion: 2.1 time: 0.317923 Sep 10 11:58:17.308586 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2092/4193] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:16 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1524 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:58:17.614731 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-0193dcaa-faf9-4a48-a6e7-7fcf51914ad3 req-ae3f66a0-fd08-4513-a737-86a27dcaad78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab2e742e-c678-4d28-9d95-e8b9b9443867", "name": "network-vif-plugged", "status": "completed", "tag": "8336b456-9ebc-4e1b-ba87-d18c785ff509"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:58:17.630550 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:58:17.634459 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0193dcaa-faf9-4a48-a6e7-7fcf51914ad3 req-ae3f66a0-fd08-4513-a737-86a27dcaad78 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:17.635483 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0193dcaa-faf9-4a48-a6e7-7fcf51914ad3 req-ae3f66a0-fd08-4513-a737-86a27dcaad78 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:17.637352 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0193dcaa-faf9-4a48-a6e7-7fcf51914ad3 req-ae3f66a0-fd08-4513-a737-86a27dcaad78 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:17.712417 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-0193dcaa-faf9-4a48-a6e7-7fcf51914ad3 req-ae3f66a0-fd08-4513-a737-86a27dcaad78 service nova] Creating event network-vif-plugged:8336b456-9ebc-4e1b-ba87-d18c785ff509 for instance ab2e742e-c678-4d28-9d95-e8b9b9443867 on n-h2-856895-1 Sep 10 11:58:17.785177 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-0193dcaa-faf9-4a48-a6e7-7fcf51914ad3 req-ae3f66a0-fd08-4513-a737-86a27dcaad78 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180840 Sep 10 11:58:17.787518 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2102/4194] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:58:17.976376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a7b73c15-cd71-470d-9186-6f3f4d58229c tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:17.981323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-05f7a267-479c-464f-bcdc-bf4497fe01e2 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:17.984011 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-05f7a267-479c-464f-bcdc-bf4497fe01e2 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] [instance: ab2e742e-c678-4d28-9d95-e8b9b9443867] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:17.999287 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a7b73c15-cd71-470d-9186-6f3f4d58229c tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] [instance: af31e6eb-f34c-4ae9-aede-bc4ca6949556] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:18.040983 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05f7a267-479c-464f-bcdc-bf4497fe01e2 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:18.046069 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05f7a267-479c-464f-bcdc-bf4497fe01e2 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:18.049769 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05f7a267-479c-464f-bcdc-bf4497fe01e2 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:18.051320 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05f7a267-479c-464f-bcdc-bf4497fe01e2 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:18.053361 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05f7a267-479c-464f-bcdc-bf4497fe01e2 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:18.056584 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05f7a267-479c-464f-bcdc-bf4497fe01e2 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:18.084553 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a7b73c15-cd71-470d-9186-6f3f4d58229c tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:18.085062 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a7b73c15-cd71-470d-9186-6f3f4d58229c tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:18.085502 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a7b73c15-cd71-470d-9186-6f3f4d58229c tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:18.087036 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a7b73c15-cd71-470d-9186-6f3f4d58229c tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:18.087700 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a7b73c15-cd71-470d-9186-6f3f4d58229c tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:18.088300 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a7b73c15-cd71-470d-9186-6f3f4d58229c tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:18.121525 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-a7b73c15-cd71-470d-9186-6f3f4d58229c tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] HTTP exception thrown: Instance af31e6eb-f34c-4ae9-aede-bc4ca6949556 could not be found. Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a7b73c15-cd71-470d-9186-6f3f4d58229c tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Request method failure captured: Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/af31e6eb-f34c-4ae9-aede-bc4ca6949556 HTTP/1.1 Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHs3cRe66dbgigOFxoKprQIBx1JbKaFUiULXI9lgE1g3ExLzrvvWVDi564EmmrL-f68kNgBFfza-JQ6pLhliDM_uvJPsPisvUjAKC09-9RvomE9UQEC__f3zA-AyrKzZYRavyLOjqqZNJWPUr2MqyvpJsPixfHx22KkFus21wOlxDG8 Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 6f245084ce3f409889039ba1ee751eed Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ListImageFiltersTestJSON-1985560884 Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6f245084ce3f409889039ba1ee751eed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6f245084ce3f409889039ba1ee751eed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6f245084ce3f409889039ba1ee751eed", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6f245084ce3f409889039ba1ee751eed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ListImageFiltersTestJSON-1985560884 Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 6f245084ce3f409889039ba1ee751eed Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1985560884 Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ListImageFiltersTestJSON-1985560884-project Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 72e27edecefe4d60a2dba4ba99055bb1 Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ListImageFiltersTestJSON-1985560884-project Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance af31e6eb-f34c-4ae9-aede-bc4ca6949556 could not be found. Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'af31e6eb-f34c-4ae9-aede-bc4ca6949556'} Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af31e6eb-f34c-4ae9-aede-bc4ca6949556 could not be found. Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af31e6eb-f34c-4ae9-aede-bc4ca6949556 could not be found. Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:58:18.127731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:58:18.131620 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:58:18.131620 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:58:18.131620 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:58:18.131620 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:58:18.131620 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:58:18.131620 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af31e6eb-f34c-4ae9-aede-bc4ca6949556 could not be found. Sep 10 11:58:18.131620 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:58:18.131620 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a7b73c15-cd71-470d-9186-6f3f4d58229c tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Returning 404 to user: Instance af31e6eb-f34c-4ae9-aede-bc4ca6949556 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:58:18.131620 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a7b73c15-cd71-470d-9186-6f3f4d58229c tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "GET /compute/v2.1/servers/af31e6eb-f34c-4ae9-aede-bc4ca6949556" status: 404 len: 111 microversion: 2.1 time: 0.177571 Sep 10 11:58:18.137896 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2103/4195] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:17 2022] GET /compute/v2.1/servers/af31e6eb-f34c-4ae9-aede-bc4ca6949556 => generated 111 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:58:18.155495 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c4b68ab1-75ef-4194-ad76-9de996a9863e tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4073de3790>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:18.497323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-05f7a267-479c-464f-bcdc-bf4497fe01e2 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:18.508456 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-05f7a267-479c-464f-bcdc-bf4497fe01e2 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:18.510959 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-05f7a267-479c-464f-bcdc-bf4497fe01e2 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:18.513025 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-05f7a267-479c-464f-bcdc-bf4497fe01e2 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] 10.222.0.23 "GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867" status: 200 len: 1362 microversion: 2.26 time: 0.565160 Sep 10 11:58:18.514243 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2093/4196] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:58:17 2022] GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867 => generated 1362 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:58:18.521485 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-588a0601-64dc-4d6f-8c6b-d2123b161cb5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:18.522659 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-588a0601-64dc-4d6f-8c6b-d2123b161cb5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:18.531026 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-588a0601-64dc-4d6f-8c6b-d2123b161cb5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:18.532116 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-588a0601-64dc-4d6f-8c6b-d2123b161cb5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:18.532820 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-588a0601-64dc-4d6f-8c6b-d2123b161cb5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:18.533851 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-588a0601-64dc-4d6f-8c6b-d2123b161cb5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:18.534740 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-588a0601-64dc-4d6f-8c6b-d2123b161cb5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:18.535621 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-588a0601-64dc-4d6f-8c6b-d2123b161cb5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:18.846145 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-588a0601-64dc-4d6f-8c6b-d2123b161cb5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:18.864188 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-588a0601-64dc-4d6f-8c6b-d2123b161cb5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1524 microversion: 2.1 time: 0.348246 Sep 10 11:58:18.875860 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2094/4197] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:18 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1524 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:18.960854 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c4b68ab1-75ef-4194-ad76-9de996a9863e tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "DELETE /compute/v2.1/images/335e781f-56dc-4ac1-8e1d-4abb9ea32d8c" status: 204 len: 0 microversion: 2.1 time: 0.821343 Sep 10 11:58:18.965235 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2104/4198] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:18 2022] DELETE /compute/v2.1/images/335e781f-56dc-4ac1-8e1d-4abb9ea32d8c => generated 0 bytes in 824 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:58:18.970493 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-988a0d0f-459f-4e9a-b366-ab976c8d3bfd tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4072527f70>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:19.449068 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-101bbe0f-7ee9-4438-b431-fa83c19da6ff tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Action: 'create', calling method: .version_select at 0x7f407368ba60>, body: {"keypair": {"name": "tempest-keypair-1238815979", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwLjV2fQUJrCtWeILwhVE3naGdkjKx796CMNiqF3EzPdTaAhzU+XPvoSjve/mUI+wxgptEL06dLBv9L/pImU1J6cP+pj4JEzyv9pAsmq+bqOrlDXkYPuZaQYE9BTveM2A=="}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:58:19.464121 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-988a0d0f-459f-4e9a-b366-ab976c8d3bfd tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "DELETE /compute/v2.1/images/7befc81b-98f5-4a10-8312-e2558586f3cc" status: 204 len: 0 microversion: 2.1 time: 0.497241 Sep 10 11:58:19.465371 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2095/4199] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:18 2022] DELETE /compute/v2.1/images/7befc81b-98f5-4a10-8312-e2558586f3cc => generated 0 bytes in 499 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:58:19.472669 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-101bbe0f-7ee9-4438-b431-fa83c19da6ff tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Getting quotas for project 2410f9544bec4633988e1554111c9446. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:58:19.474063 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-20dbd2e6-d4a0-40eb-959e-00028831cd27 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] Calling method '.version_select at 0x7f4072c8b820>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:19.478796 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-101bbe0f-7ee9-4438-b431-fa83c19da6ff tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Getting quotas for user 8954f3256ddd49639ea57a9242a296d0 and project 2410f9544bec4633988e1554111c9446. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:58:19.547345 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-101bbe0f-7ee9-4438-b431-fa83c19da6ff tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.283253 Sep 10 11:58:19.548730 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2105/4200] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 11:58:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:58:19.576788 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2b924963-0070-40a0-a761-198530cc0624 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:19.578442 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2b924963-0070-40a0-a761-198530cc0624 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] [instance: ab2e742e-c678-4d28-9d95-e8b9b9443867] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:19.621344 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b924963-0070-40a0-a761-198530cc0624 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:19.625224 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b924963-0070-40a0-a761-198530cc0624 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:19.625884 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b924963-0070-40a0-a761-198530cc0624 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:19.634614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b924963-0070-40a0-a761-198530cc0624 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:19.637987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b924963-0070-40a0-a761-198530cc0624 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:19.638765 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b924963-0070-40a0-a761-198530cc0624 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:20.060157 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2b924963-0070-40a0-a761-198530cc0624 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:20.080807 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2b924963-0070-40a0-a761-198530cc0624 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:20.082529 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2b924963-0070-40a0-a761-198530cc0624 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:20.085516 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2b924963-0070-40a0-a761-198530cc0624 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] 10.222.0.23 "GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867" status: 200 len: 1362 microversion: 2.26 time: 0.533940 Sep 10 11:58:20.107219 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2106/4201] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:58:19 2022] GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867 => generated 1362 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:58:20.107219 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f8564abe-a608-41db-a820-3b4cd4c4edcd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:20.107219 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f8564abe-a608-41db-a820-3b4cd4c4edcd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:20.119453 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8564abe-a608-41db-a820-3b4cd4c4edcd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:20.122775 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8564abe-a608-41db-a820-3b4cd4c4edcd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:20.123539 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8564abe-a608-41db-a820-3b4cd4c4edcd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:20.124964 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8564abe-a608-41db-a820-3b4cd4c4edcd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:20.125732 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8564abe-a608-41db-a820-3b4cd4c4edcd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:20.126375 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8564abe-a608-41db-a820-3b4cd4c4edcd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:20.405376 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-20dbd2e6-d4a0-40eb-959e-00028831cd27 tempest-ListImageFiltersTestJSON-1985560884 tempest-ListImageFiltersTestJSON-1985560884-project] 10.222.0.23 "DELETE /compute/v2.1/images/6ecb4b95-c373-456b-9e15-ee7c9822bca3" status: 204 len: 0 microversion: 2.1 time: 0.935776 Sep 10 11:58:20.406617 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2096/4202] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:19 2022] DELETE /compute/v2.1/images/6ecb4b95-c373-456b-9e15-ee7c9822bca3 => generated 0 bytes in 937 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 11:58:20.485629 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f8564abe-a608-41db-a820-3b4cd4c4edcd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:20.497096 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f8564abe-a608-41db-a820-3b4cd4c4edcd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1524 microversion: 2.1 time: 0.397597 Sep 10 11:58:20.499794 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2107/4203] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:20 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1524 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:21.125674 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4eeec663-9f34-4778-8559-780ece02cd61 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:21.127434 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4eeec663-9f34-4778-8559-780ece02cd61 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] [instance: ab2e742e-c678-4d28-9d95-e8b9b9443867] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:21.130212 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2d49c0eb-b80e-4f4b-969f-a720cc75d795 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "740e34f5-a33d-4b3b-9cbb-e2cff5e52fad"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:58:21.136368 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2d49c0eb-b80e-4f4b-969f-a720cc75d795 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:21.151882 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4eeec663-9f34-4778-8559-780ece02cd61 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:21.152384 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4eeec663-9f34-4778-8559-780ece02cd61 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:21.152831 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4eeec663-9f34-4778-8559-780ece02cd61 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:21.153545 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4eeec663-9f34-4778-8559-780ece02cd61 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:21.168399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4eeec663-9f34-4778-8559-780ece02cd61 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:21.168865 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4eeec663-9f34-4778-8559-780ece02cd61 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:21.173624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d49c0eb-b80e-4f4b-969f-a720cc75d795 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:21.182784 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d49c0eb-b80e-4f4b-969f-a720cc75d795 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:21.183339 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d49c0eb-b80e-4f4b-969f-a720cc75d795 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:21.188981 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d49c0eb-b80e-4f4b-969f-a720cc75d795 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:21.193231 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d49c0eb-b80e-4f4b-969f-a720cc75d795 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:21.193763 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d49c0eb-b80e-4f4b-969f-a720cc75d795 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:21.702108 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4eeec663-9f34-4778-8559-780ece02cd61 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:21.712266 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4eeec663-9f34-4778-8559-780ece02cd61 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:21.713664 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4eeec663-9f34-4778-8559-780ece02cd61 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:21.714875 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4eeec663-9f34-4778-8559-780ece02cd61 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] 10.222.0.23 "GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867" status: 200 len: 1545 microversion: 2.26 time: 0.598276 Sep 10 11:58:21.734684 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2108/4204] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:58:21 2022] GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867 => generated 1545 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:58:21.742403 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b242063a-2af6-4230-a413-83ec2ca94c45 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:21.743020 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b242063a-2af6-4230-a413-83ec2ca94c45 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:21.771457 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b242063a-2af6-4230-a413-83ec2ca94c45 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:21.771965 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b242063a-2af6-4230-a413-83ec2ca94c45 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:21.772414 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b242063a-2af6-4230-a413-83ec2ca94c45 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:21.773133 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b242063a-2af6-4230-a413-83ec2ca94c45 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:21.774172 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b242063a-2af6-4230-a413-83ec2ca94c45 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:21.774757 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b242063a-2af6-4230-a413-83ec2ca94c45 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:21.989041 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2d49c0eb-b80e-4f4b-969f-a720cc75d795 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "POST /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.874572 Sep 10 11:58:22.000112 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2097/4205] 10.222.0.23 () {60 vars in 1323 bytes} [Sat Sep 10 11:58:21 2022] POST /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4/os-volume_attachments => generated 194 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:58:22.050684 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ad89f5d0-9b65-48e8-80a1-951418e45b58 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Calling method '.version_select at 0x7f4072895ca0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:22.087073 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad89f5d0-9b65-48e8-80a1-951418e45b58 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:22.099661 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad89f5d0-9b65-48e8-80a1-951418e45b58 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:22.100911 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad89f5d0-9b65-48e8-80a1-951418e45b58 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:22.103889 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ad89f5d0-9b65-48e8-80a1-951418e45b58 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] [instance: ab2e742e-c678-4d28-9d95-e8b9b9443867] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:22.139634 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad89f5d0-9b65-48e8-80a1-951418e45b58 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:22.141966 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad89f5d0-9b65-48e8-80a1-951418e45b58 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:22.144028 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad89f5d0-9b65-48e8-80a1-951418e45b58 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:22.149025 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad89f5d0-9b65-48e8-80a1-951418e45b58 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:22.152331 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad89f5d0-9b65-48e8-80a1-951418e45b58 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:22.155011 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad89f5d0-9b65-48e8-80a1-951418e45b58 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:22.164869 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b242063a-2af6-4230-a413-83ec2ca94c45 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:22.173364 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b242063a-2af6-4230-a413-83ec2ca94c45 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1524 microversion: 2.1 time: 0.437232 Sep 10 11:58:22.173952 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2109/4206] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:21 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1524 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:22.274975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad89f5d0-9b65-48e8-80a1-951418e45b58 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:22.291388 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad89f5d0-9b65-48e8-80a1-951418e45b58 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:22.291966 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad89f5d0-9b65-48e8-80a1-951418e45b58 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:22.339587 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad89f5d0-9b65-48e8-80a1-951418e45b58 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:22.342613 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad89f5d0-9b65-48e8-80a1-951418e45b58 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:22.344087 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad89f5d0-9b65-48e8-80a1-951418e45b58 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:22.463991 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-ad89f5d0-9b65-48e8-80a1-951418e45b58 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lazy-loading 'flavor' on Instance uuid ab2e742e-c678-4d28-9d95-e8b9b9443867 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:58:22.498282 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ad89f5d0-9b65-48e8-80a1-951418e45b58 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] 10.222.0.23 "PUT /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867/tags/tempest-tag-1589152474" status: 201 len: 0 microversion: 2.26 time: 0.477565 Sep 10 11:58:22.503817 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2098/4207] 10.222.0.23 () {62 vars in 1380 bytes} [Sat Sep 10 11:58:22 2022] PUT /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867/tags/tempest-tag-1589152474 => generated 0 bytes in 489 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 10 11:58:22.510384 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c8178e10-d3d0-4d93-a706-a40b76e48ec9 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Calling method '.version_select at 0x7f4073591160>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:22.522717 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c8178e10-d3d0-4d93-a706-a40b76e48ec9 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:22.531593 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c8178e10-d3d0-4d93-a706-a40b76e48ec9 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:22.532226 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c8178e10-d3d0-4d93-a706-a40b76e48ec9 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:22.585924 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c8178e10-d3d0-4d93-a706-a40b76e48ec9 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] 10.222.0.23 "GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867/tags/tempest-tag-1589152474" status: 204 len: 0 microversion: 2.26 time: 0.080581 Sep 10 11:58:22.590123 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2110/4208] 10.222.0.23 () {60 vars in 1361 bytes} [Sat Sep 10 11:58:22 2022] GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867/tags/tempest-tag-1589152474 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 10 11:58:22.598298 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1a5e3dae-47ca-44b2-9490-66b99e57d740 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Calling method '.version_select at 0x7f4072527670>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:22.620631 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a5e3dae-47ca-44b2-9490-66b99e57d740 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:22.623290 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a5e3dae-47ca-44b2-9490-66b99e57d740 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:22.625449 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a5e3dae-47ca-44b2-9490-66b99e57d740 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:22.626298 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1a5e3dae-47ca-44b2-9490-66b99e57d740 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] [instance: ab2e742e-c678-4d28-9d95-e8b9b9443867] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:22.643261 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a5e3dae-47ca-44b2-9490-66b99e57d740 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:22.644128 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a5e3dae-47ca-44b2-9490-66b99e57d740 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:22.645438 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a5e3dae-47ca-44b2-9490-66b99e57d740 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:22.648764 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a5e3dae-47ca-44b2-9490-66b99e57d740 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:22.649542 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a5e3dae-47ca-44b2-9490-66b99e57d740 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:22.651257 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a5e3dae-47ca-44b2-9490-66b99e57d740 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:22.713803 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a5e3dae-47ca-44b2-9490-66b99e57d740 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:22.714624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a5e3dae-47ca-44b2-9490-66b99e57d740 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:22.717320 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a5e3dae-47ca-44b2-9490-66b99e57d740 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:22.751685 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-1a5e3dae-47ca-44b2-9490-66b99e57d740 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lazy-loading 'flavor' on Instance uuid ab2e742e-c678-4d28-9d95-e8b9b9443867 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:58:22.788057 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1a5e3dae-47ca-44b2-9490-66b99e57d740 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867/tags" status: 204 len: 0 microversion: 2.26 time: 0.195859 Sep 10 11:58:22.799506 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2099/4209] 10.222.0.23 () {60 vars in 1295 bytes} [Sat Sep 10 11:58:22 2022] DELETE /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867/tags => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 11:58:22.802934 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f9350382-fbc0-4ae8-b913-648800ef4a1d tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Calling method '.version_select at 0x7f40735918b0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:22.814333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f9350382-fbc0-4ae8-b913-648800ef4a1d tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:22.814825 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f9350382-fbc0-4ae8-b913-648800ef4a1d tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:22.818567 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f9350382-fbc0-4ae8-b913-648800ef4a1d tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:22.843749 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f9350382-fbc0-4ae8-b913-648800ef4a1d tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] 10.222.0.23 "GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867/tags" status: 200 len: 12 microversion: 2.26 time: 0.044317 Sep 10 11:58:22.851451 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2111/4210] 10.222.0.23 () {60 vars in 1292 bytes} [Sat Sep 10 11:58:22 2022] GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867/tags => generated 12 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:58:22.857433 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-eaf8535a-ad35-4f79-895f-b1166a220390 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Calling method '.version_select at 0x7f4072ccd0d0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:22.886244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eaf8535a-ad35-4f79-895f-b1166a220390 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:22.890399 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eaf8535a-ad35-4f79-895f-b1166a220390 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:22.891092 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eaf8535a-ad35-4f79-895f-b1166a220390 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:22.892538 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-eaf8535a-ad35-4f79-895f-b1166a220390 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] [instance: ab2e742e-c678-4d28-9d95-e8b9b9443867] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:22.915919 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eaf8535a-ad35-4f79-895f-b1166a220390 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:22.924022 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eaf8535a-ad35-4f79-895f-b1166a220390 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:22.927790 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eaf8535a-ad35-4f79-895f-b1166a220390 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:22.931708 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eaf8535a-ad35-4f79-895f-b1166a220390 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:22.935705 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eaf8535a-ad35-4f79-895f-b1166a220390 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:22.939714 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eaf8535a-ad35-4f79-895f-b1166a220390 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:23.005402 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eaf8535a-ad35-4f79-895f-b1166a220390 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:23.009273 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eaf8535a-ad35-4f79-895f-b1166a220390 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:23.011241 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eaf8535a-ad35-4f79-895f-b1166a220390 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:23.035988 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eaf8535a-ad35-4f79-895f-b1166a220390 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:23.038971 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eaf8535a-ad35-4f79-895f-b1166a220390 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:23.040007 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eaf8535a-ad35-4f79-895f-b1166a220390 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:23.075482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:58:23.082763 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-eaf8535a-ad35-4f79-895f-b1166a220390 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lazy-loading 'flavor' on Instance uuid ab2e742e-c678-4d28-9d95-e8b9b9443867 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:58:23.125801 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-eaf8535a-ad35-4f79-895f-b1166a220390 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] 10.222.0.23 "PUT /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867/tags/tempest-tag-1963187731" status: 201 len: 0 microversion: 2.26 time: 0.275486 Sep 10 11:58:23.127603 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2100/4211] 10.222.0.23 () {62 vars in 1380 bytes} [Sat Sep 10 11:58:22 2022] PUT /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867/tags/tempest-tag-1963187731 => generated 0 bytes in 278 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 10 11:58:23.137376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cbbd35cd-f381-43bb-8816-5999d7404571 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Calling method '.version_select at 0x7f407369d9d0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:23.159853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cbbd35cd-f381-43bb-8816-5999d7404571 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:23.163851 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cbbd35cd-f381-43bb-8816-5999d7404571 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:23.165029 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cbbd35cd-f381-43bb-8816-5999d7404571 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:23.187188 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cbbd35cd-f381-43bb-8816-5999d7404571 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] 10.222.0.23 "GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867/tags" status: 200 len: 36 microversion: 2.26 time: 0.053823 Sep 10 11:58:23.199864 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7bf4f632-34d0-4538-a06b-62b669051cbb tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Calling method '.version_select at 0x7f4072c8b310>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:23.210510 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2112/4212] 10.222.0.23 () {60 vars in 1292 bytes} [Sat Sep 10 11:58:23 2022] GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867/tags => generated 36 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:23.222595 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4402d816-f381-4366-9e56-e25ae0bf2df2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:23.223421 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4402d816-f381-4366-9e56-e25ae0bf2df2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:23.223683 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7bf4f632-34d0-4538-a06b-62b669051cbb tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:23.224365 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7bf4f632-34d0-4538-a06b-62b669051cbb tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:23.226116 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7bf4f632-34d0-4538-a06b-62b669051cbb tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:23.230230 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7bf4f632-34d0-4538-a06b-62b669051cbb tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] [instance: ab2e742e-c678-4d28-9d95-e8b9b9443867] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:23.238802 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4402d816-f381-4366-9e56-e25ae0bf2df2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:23.246983 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7bf4f632-34d0-4538-a06b-62b669051cbb tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:23.247910 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4402d816-f381-4366-9e56-e25ae0bf2df2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:23.248523 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4402d816-f381-4366-9e56-e25ae0bf2df2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:23.249232 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7bf4f632-34d0-4538-a06b-62b669051cbb tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:23.251088 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4402d816-f381-4366-9e56-e25ae0bf2df2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:23.251799 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7bf4f632-34d0-4538-a06b-62b669051cbb tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:23.252927 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4402d816-f381-4366-9e56-e25ae0bf2df2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:23.253840 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7bf4f632-34d0-4538-a06b-62b669051cbb tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:23.255116 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4402d816-f381-4366-9e56-e25ae0bf2df2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:23.255928 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7bf4f632-34d0-4538-a06b-62b669051cbb tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:23.260455 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7bf4f632-34d0-4538-a06b-62b669051cbb tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:23.355464 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7bf4f632-34d0-4538-a06b-62b669051cbb tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:23.355920 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7bf4f632-34d0-4538-a06b-62b669051cbb tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:23.357675 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7bf4f632-34d0-4538-a06b-62b669051cbb tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:23.425147 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-7bf4f632-34d0-4538-a06b-62b669051cbb tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lazy-loading 'flavor' on Instance uuid ab2e742e-c678-4d28-9d95-e8b9b9443867 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:58:23.460602 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7bf4f632-34d0-4538-a06b-62b669051cbb tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867/tags/tempest-tag-1963187731" status: 204 len: 0 microversion: 2.26 time: 0.266114 Sep 10 11:58:23.466275 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2101/4213] 10.222.0.23 () {60 vars in 1364 bytes} [Sat Sep 10 11:58:23 2022] DELETE /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867/tags/tempest-tag-1963187731 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 10 11:58:23.479745 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a511adac-96cc-4a60-b0d9-d05ad8448314 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Calling method '.version_select at 0x7f4072c81160>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:23.495618 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a511adac-96cc-4a60-b0d9-d05ad8448314 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:23.497203 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a511adac-96cc-4a60-b0d9-d05ad8448314 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:23.497819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a511adac-96cc-4a60-b0d9-d05ad8448314 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:23.509099 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a511adac-96cc-4a60-b0d9-d05ad8448314 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] 10.222.0.23 "GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867/tags" status: 200 len: 12 microversion: 2.26 time: 0.038855 Sep 10 11:58:23.516450 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2102/4214] 10.222.0.23 () {60 vars in 1292 bytes} [Sat Sep 10 11:58:23 2022] GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867/tags => generated 12 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:23.521881 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-18b6e5b5-b878-4e0b-8b2d-390e5aa7606b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Calling method '.version_select at 0x7f40725278b0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:23.532309 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-18b6e5b5-b878-4e0b-8b2d-390e5aa7606b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:23.533146 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-18b6e5b5-b878-4e0b-8b2d-390e5aa7606b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:23.533794 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-18b6e5b5-b878-4e0b-8b2d-390e5aa7606b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:23.534530 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-18b6e5b5-b878-4e0b-8b2d-390e5aa7606b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] [instance: ab2e742e-c678-4d28-9d95-e8b9b9443867] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:23.541496 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-18b6e5b5-b878-4e0b-8b2d-390e5aa7606b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:23.542322 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-18b6e5b5-b878-4e0b-8b2d-390e5aa7606b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:23.542960 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-18b6e5b5-b878-4e0b-8b2d-390e5aa7606b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:23.543974 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-18b6e5b5-b878-4e0b-8b2d-390e5aa7606b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:23.544658 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-18b6e5b5-b878-4e0b-8b2d-390e5aa7606b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:23.545316 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-18b6e5b5-b878-4e0b-8b2d-390e5aa7606b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:23.594488 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-18b6e5b5-b878-4e0b-8b2d-390e5aa7606b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:23.599074 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-18b6e5b5-b878-4e0b-8b2d-390e5aa7606b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:23.599905 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-18b6e5b5-b878-4e0b-8b2d-390e5aa7606b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:23.628927 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-18b6e5b5-b878-4e0b-8b2d-390e5aa7606b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lazy-loading 'flavor' on Instance uuid ab2e742e-c678-4d28-9d95-e8b9b9443867 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:58:23.664796 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-18b6e5b5-b878-4e0b-8b2d-390e5aa7606b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867/tags" status: 204 len: 0 microversion: 2.26 time: 0.146900 Sep 10 11:58:23.666446 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2103/4215] 10.222.0.23 () {60 vars in 1295 bytes} [Sat Sep 10 11:58:23 2022] DELETE /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867/tags => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 11:58:23.687603 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-420ad72a-3009-4631-bdcc-f0468adffa7b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Calling method '.version_select at 0x7f407358a670>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:23.703857 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-420ad72a-3009-4631-bdcc-f0468adffa7b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:23.708784 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-420ad72a-3009-4631-bdcc-f0468adffa7b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:23.709466 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-420ad72a-3009-4631-bdcc-f0468adffa7b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:23.711131 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-420ad72a-3009-4631-bdcc-f0468adffa7b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] [instance: ab2e742e-c678-4d28-9d95-e8b9b9443867] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:23.729533 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-420ad72a-3009-4631-bdcc-f0468adffa7b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:23.731852 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-420ad72a-3009-4631-bdcc-f0468adffa7b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:23.732387 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-420ad72a-3009-4631-bdcc-f0468adffa7b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:23.734342 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-420ad72a-3009-4631-bdcc-f0468adffa7b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:23.735071 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-420ad72a-3009-4631-bdcc-f0468adffa7b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:23.736625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-420ad72a-3009-4631-bdcc-f0468adffa7b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:23.783405 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-420ad72a-3009-4631-bdcc-f0468adffa7b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:23.783988 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-420ad72a-3009-4631-bdcc-f0468adffa7b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:23.784502 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-420ad72a-3009-4631-bdcc-f0468adffa7b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:23.822704 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-420ad72a-3009-4631-bdcc-f0468adffa7b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:23.823214 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-420ad72a-3009-4631-bdcc-f0468adffa7b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:23.831193 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-420ad72a-3009-4631-bdcc-f0468adffa7b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:23.905177 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-420ad72a-3009-4631-bdcc-f0468adffa7b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lazy-loading 'flavor' on Instance uuid ab2e742e-c678-4d28-9d95-e8b9b9443867 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:58:23.952731 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-420ad72a-3009-4631-bdcc-f0468adffa7b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] 10.222.0.23 "PUT /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867/tags/tempest-tag-248533163" status: 201 len: 0 microversion: 2.26 time: 0.275952 Sep 10 11:58:23.953419 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2104/4216] 10.222.0.23 () {62 vars in 1377 bytes} [Sat Sep 10 11:58:23 2022] PUT /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867/tags/tempest-tag-248533163 => generated 0 bytes in 277 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Sep 10 11:58:23.981513 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-269da09e-06f9-4150-8934-5e2744e6d622 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Calling method '.version_select at 0x7f4073af71f0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:24.004060 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4402d816-f381-4366-9e56-e25ae0bf2df2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:24.014514 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4402d816-f381-4366-9e56-e25ae0bf2df2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1524 microversion: 2.1 time: 0.798394 Sep 10 11:58:24.015285 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-269da09e-06f9-4150-8934-5e2744e6d622 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:24.022301 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-269da09e-06f9-4150-8934-5e2744e6d622 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:24.022856 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-269da09e-06f9-4150-8934-5e2744e6d622 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:24.025357 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-269da09e-06f9-4150-8934-5e2744e6d622 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] [instance: ab2e742e-c678-4d28-9d95-e8b9b9443867] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:24.036846 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2113/4217] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:23 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1524 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:58:24.042404 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-269da09e-06f9-4150-8934-5e2744e6d622 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:24.042912 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-269da09e-06f9-4150-8934-5e2744e6d622 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:24.043389 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-269da09e-06f9-4150-8934-5e2744e6d622 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:24.049388 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-269da09e-06f9-4150-8934-5e2744e6d622 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:24.049969 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-269da09e-06f9-4150-8934-5e2744e6d622 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:24.050423 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-269da09e-06f9-4150-8934-5e2744e6d622 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:24.150077 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-269da09e-06f9-4150-8934-5e2744e6d622 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:24.150593 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-269da09e-06f9-4150-8934-5e2744e6d622 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:24.153500 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-269da09e-06f9-4150-8934-5e2744e6d622 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:24.180261 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-269da09e-06f9-4150-8934-5e2744e6d622 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:24.180751 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-269da09e-06f9-4150-8934-5e2744e6d622 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:24.181193 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-269da09e-06f9-4150-8934-5e2744e6d622 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:24.251378 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-269da09e-06f9-4150-8934-5e2744e6d622 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lazy-loading 'flavor' on Instance uuid ab2e742e-c678-4d28-9d95-e8b9b9443867 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:58:24.292013 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-269da09e-06f9-4150-8934-5e2744e6d622 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] 10.222.0.23 "PUT /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867/tags/tempest-tag-510033698" status: 201 len: 0 microversion: 2.26 time: 0.328885 Sep 10 11:58:24.294537 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2105/4218] 10.222.0.23 () {62 vars in 1377 bytes} [Sat Sep 10 11:58:23 2022] PUT /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867/tags/tempest-tag-510033698 => generated 0 bytes in 332 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Sep 10 11:58:24.304553 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d251b1cf-3117-4ba5-aec8-719a0da64a70 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Calling method '.version_select at 0x7f407329a940>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:24.327256 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-97694a3f-c6c7-4456-84ba-43b6a3f0c564 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1231746813", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2b93427c-8a73-4134-b29e-29ba6a3e29a6"}], "security_groups": [{"name": "tempest-securitygroup--1947396457"}], "key_name": "tempest-keypair-1238815979", "user_data": "}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:58:24.330774 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d251b1cf-3117-4ba5-aec8-719a0da64a70 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:24.331298 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d251b1cf-3117-4ba5-aec8-719a0da64a70 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:24.331732 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d251b1cf-3117-4ba5-aec8-719a0da64a70 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:24.345131 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d251b1cf-3117-4ba5-aec8-719a0da64a70 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] [instance: ab2e742e-c678-4d28-9d95-e8b9b9443867] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:24.373400 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d251b1cf-3117-4ba5-aec8-719a0da64a70 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:24.374089 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d251b1cf-3117-4ba5-aec8-719a0da64a70 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:24.375229 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d251b1cf-3117-4ba5-aec8-719a0da64a70 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:24.378192 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d251b1cf-3117-4ba5-aec8-719a0da64a70 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:24.378855 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d251b1cf-3117-4ba5-aec8-719a0da64a70 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:24.379473 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d251b1cf-3117-4ba5-aec8-719a0da64a70 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:24.465353 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d251b1cf-3117-4ba5-aec8-719a0da64a70 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:24.465917 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d251b1cf-3117-4ba5-aec8-719a0da64a70 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:24.466363 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d251b1cf-3117-4ba5-aec8-719a0da64a70 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:24.497902 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-d251b1cf-3117-4ba5-aec8-719a0da64a70 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lazy-loading 'flavor' on Instance uuid ab2e742e-c678-4d28-9d95-e8b9b9443867 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:58:24.534200 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d251b1cf-3117-4ba5-aec8-719a0da64a70 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867/tags" status: 204 len: 0 microversion: 2.26 time: 0.234180 Sep 10 11:58:24.537919 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2114/4219] 10.222.0.23 () {60 vars in 1295 bytes} [Sat Sep 10 11:58:24 2022] DELETE /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867/tags => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 11:58:24.556430 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d10d6f88-fb15-4b08-87ab-0a42511f15b8 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Calling method '.version_select at 0x7f4073757310>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:24.565441 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d10d6f88-fb15-4b08-87ab-0a42511f15b8 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:24.566126 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d10d6f88-fb15-4b08-87ab-0a42511f15b8 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:24.566728 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d10d6f88-fb15-4b08-87ab-0a42511f15b8 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:24.608008 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d10d6f88-fb15-4b08-87ab-0a42511f15b8 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] 10.222.0.23 "GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867/tags" status: 200 len: 12 microversion: 2.26 time: 0.066329 Sep 10 11:58:24.609306 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2115/4220] 10.222.0.23 () {60 vars in 1292 bytes} [Sat Sep 10 11:58:24 2022] GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867/tags => generated 12 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:24.621553 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c484328a-dd42-4242-a097-8e22e30bc93c tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Calling method '.version_select at 0x7f407329a040>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:24.646728 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-97694a3f-c6c7-4456-84ba-43b6a3f0c564 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] validate_networks() for [('2b93427c-8a73-4134-b29e-29ba6a3e29a6', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:58:24.650188 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c484328a-dd42-4242-a097-8e22e30bc93c tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:24.650850 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c484328a-dd42-4242-a097-8e22e30bc93c tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:24.651483 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c484328a-dd42-4242-a097-8e22e30bc93c tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:24.652121 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c484328a-dd42-4242-a097-8e22e30bc93c tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] [instance: ab2e742e-c678-4d28-9d95-e8b9b9443867] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:24.668664 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c484328a-dd42-4242-a097-8e22e30bc93c tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:24.669978 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c484328a-dd42-4242-a097-8e22e30bc93c tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:24.670580 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c484328a-dd42-4242-a097-8e22e30bc93c tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:24.675126 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c484328a-dd42-4242-a097-8e22e30bc93c tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:24.675818 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c484328a-dd42-4242-a097-8e22e30bc93c tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:24.691409 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c484328a-dd42-4242-a097-8e22e30bc93c tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:24.696786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1,nova_cell1:DELETE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:58:24.794187 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c484328a-dd42-4242-a097-8e22e30bc93c tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:24.794922 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c484328a-dd42-4242-a097-8e22e30bc93c tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:24.795761 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c484328a-dd42-4242-a097-8e22e30bc93c tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:24.816781 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-c484328a-dd42-4242-a097-8e22e30bc93c tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lazy-loading 'flavor' on Instance uuid ab2e742e-c678-4d28-9d95-e8b9b9443867 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:58:24.853280 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c484328a-dd42-4242-a097-8e22e30bc93c tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867/tags" status: 204 len: 0 microversion: 2.26 time: 0.237874 Sep 10 11:58:24.854212 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2116/4221] 10.222.0.23 () {60 vars in 1295 bytes} [Sat Sep 10 11:58:24 2022] DELETE /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867/tags => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 10 11:58:24.865705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d97da3a2-30b9-4b36-b0ee-0554dc97a8b1 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Calling method '.version_select at 0x7f407368bee0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:24.888498 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d97da3a2-30b9-4b36-b0ee-0554dc97a8b1 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:24.892402 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d97da3a2-30b9-4b36-b0ee-0554dc97a8b1 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:24.901056 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d97da3a2-30b9-4b36-b0ee-0554dc97a8b1 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:24.904517 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d97da3a2-30b9-4b36-b0ee-0554dc97a8b1 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] [instance: ab2e742e-c678-4d28-9d95-e8b9b9443867] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:24.916554 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d97da3a2-30b9-4b36-b0ee-0554dc97a8b1 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:24.920249 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d97da3a2-30b9-4b36-b0ee-0554dc97a8b1 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:24.921006 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d97da3a2-30b9-4b36-b0ee-0554dc97a8b1 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:24.921895 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d97da3a2-30b9-4b36-b0ee-0554dc97a8b1 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:24.924863 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d97da3a2-30b9-4b36-b0ee-0554dc97a8b1 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:24.925528 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d97da3a2-30b9-4b36-b0ee-0554dc97a8b1 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:24.994510 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d97da3a2-30b9-4b36-b0ee-0554dc97a8b1 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:24.995006 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d97da3a2-30b9-4b36-b0ee-0554dc97a8b1 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:24.995482 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d97da3a2-30b9-4b36-b0ee-0554dc97a8b1 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:25.029333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d97da3a2-30b9-4b36-b0ee-0554dc97a8b1 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:25.031996 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d97da3a2-30b9-4b36-b0ee-0554dc97a8b1 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:25.032605 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d97da3a2-30b9-4b36-b0ee-0554dc97a8b1 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:25.091680 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-d97da3a2-30b9-4b36-b0ee-0554dc97a8b1 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lazy-loading 'flavor' on Instance uuid ab2e742e-c678-4d28-9d95-e8b9b9443867 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:58:25.170610 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d97da3a2-30b9-4b36-b0ee-0554dc97a8b1 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] 10.222.0.23 "PUT /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867/tags/tempest-tag-875018085" status: 201 len: 0 microversion: 2.26 time: 0.306566 Sep 10 11:58:25.180191 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2117/4222] 10.222.0.23 () {62 vars in 1377 bytes} [Sat Sep 10 11:58:24 2022] PUT /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867/tags/tempest-tag-875018085 => generated 0 bytes in 315 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Sep 10 11:58:25.193322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ea38707d-6f4a-4540-86b5-cae84937025b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:25.199708 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ea38707d-6f4a-4540-86b5-cae84937025b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:25.228816 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea38707d-6f4a-4540-86b5-cae84937025b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:25.232459 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea38707d-6f4a-4540-86b5-cae84937025b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:25.233005 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea38707d-6f4a-4540-86b5-cae84937025b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:25.250016 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea38707d-6f4a-4540-86b5-cae84937025b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:25.250589 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea38707d-6f4a-4540-86b5-cae84937025b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:25.254620 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea38707d-6f4a-4540-86b5-cae84937025b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:27.353703 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-97694a3f-c6c7-4456-84ba-43b6a3f0c564 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:58:27.354449 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-97694a3f-c6c7-4456-84ba-43b6a3f0c564 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:58:27.355274 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-97694a3f-c6c7-4456-84ba-43b6a3f0c564 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:58:27.355781 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-97694a3f-c6c7-4456-84ba-43b6a3f0c564 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:58:27.356191 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-97694a3f-c6c7-4456-84ba-43b6a3f0c564 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:58:27.378814 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-97694a3f-c6c7-4456-84ba-43b6a3f0c564 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:27.379339 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-97694a3f-c6c7-4456-84ba-43b6a3f0c564 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:27.379852 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-97694a3f-c6c7-4456-84ba-43b6a3f0c564 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:27.380617 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-97694a3f-c6c7-4456-84ba-43b6a3f0c564 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:27.394521 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-97694a3f-c6c7-4456-84ba-43b6a3f0c564 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:27.395157 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-97694a3f-c6c7-4456-84ba-43b6a3f0c564 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:27.420854 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ea38707d-6f4a-4540-86b5-cae84937025b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:27.435157 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ea38707d-6f4a-4540-86b5-cae84937025b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1524 microversion: 2.1 time: 2.253103 Sep 10 11:58:27.435989 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2118/4223] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:25 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1524 bytes in 2260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:27.448155 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-aa40bc87-587f-44e1-bc9c-18f6b6189f7e tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Calling method '.version_select at 0x7f407383a790>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:27.449376 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-97694a3f-c6c7-4456-84ba-43b6a3f0c564 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Getting quotas for project 2410f9544bec4633988e1554111c9446. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:58:27.465188 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-97694a3f-c6c7-4456-84ba-43b6a3f0c564 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Getting quotas for user 8954f3256ddd49639ea57a9242a296d0 and project 2410f9544bec4633988e1554111c9446. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:58:27.478784 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa40bc87-587f-44e1-bc9c-18f6b6189f7e tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:27.490324 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa40bc87-587f-44e1-bc9c-18f6b6189f7e tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:27.493925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa40bc87-587f-44e1-bc9c-18f6b6189f7e tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:27.495379 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-97694a3f-c6c7-4456-84ba-43b6a3f0c564 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:58:27.497951 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-97694a3f-c6c7-4456-84ba-43b6a3f0c564 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:58:27.498302 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-aa40bc87-587f-44e1-bc9c-18f6b6189f7e tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] [instance: ab2e742e-c678-4d28-9d95-e8b9b9443867] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:27.560486 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa40bc87-587f-44e1-bc9c-18f6b6189f7e tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:27.562127 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa40bc87-587f-44e1-bc9c-18f6b6189f7e tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:27.565317 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa40bc87-587f-44e1-bc9c-18f6b6189f7e tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:27.567303 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa40bc87-587f-44e1-bc9c-18f6b6189f7e tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:27.568779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa40bc87-587f-44e1-bc9c-18f6b6189f7e tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:27.573703 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa40bc87-587f-44e1-bc9c-18f6b6189f7e tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:27.639326 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-97694a3f-c6c7-4456-84ba-43b6a3f0c564 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.317217 Sep 10 11:58:27.639979 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2106/4224] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:58:24 2022] POST /compute/v2.1/servers => generated 409 bytes in 3319 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:58:27.652187 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0b4cd273-22d8-4cdf-9aaf-d7452166e774 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:27.660525 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0b4cd273-22d8-4cdf-9aaf-d7452166e774 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:27.692706 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa40bc87-587f-44e1-bc9c-18f6b6189f7e tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:27.717658 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa40bc87-587f-44e1-bc9c-18f6b6189f7e tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:27.718116 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa40bc87-587f-44e1-bc9c-18f6b6189f7e tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:27.755595 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa40bc87-587f-44e1-bc9c-18f6b6189f7e tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:27.757082 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa40bc87-587f-44e1-bc9c-18f6b6189f7e tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:27.757770 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa40bc87-587f-44e1-bc9c-18f6b6189f7e tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:27.828798 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-aa40bc87-587f-44e1-bc9c-18f6b6189f7e tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lazy-loading 'flavor' on Instance uuid ab2e742e-c678-4d28-9d95-e8b9b9443867 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:58:27.835180 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0b4cd273-22d8-4cdf-9aaf-d7452166e774 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:27.843661 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0b4cd273-22d8-4cdf-9aaf-d7452166e774 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1239 microversion: 2.1 time: 0.195238 Sep 10 11:58:27.844235 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2107/4225] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:27 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1239 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:27.887203 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-aa40bc87-587f-44e1-bc9c-18f6b6189f7e tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] 10.222.0.23 "PUT /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867/tags/tempest-tag-1585424579" status: 201 len: 0 microversion: 2.26 time: 0.447273 Sep 10 11:58:27.888439 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2119/4226] 10.222.0.23 () {62 vars in 1380 bytes} [Sat Sep 10 11:58:27 2022] PUT /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867/tags/tempest-tag-1585424579 => generated 0 bytes in 452 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 10 11:58:27.899730 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1242480a-10e3-470d-9cc2-ffc32f2f19d6 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Action: 'update_all', calling method: .version_select at 0x7f40724c2310>, body: {"tags": ["tempest-tag-1073628942", "tempest-tag-1244487234"]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:58:27.919104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1242480a-10e3-470d-9cc2-ffc32f2f19d6 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:27.930866 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1242480a-10e3-470d-9cc2-ffc32f2f19d6 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:27.931632 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1242480a-10e3-470d-9cc2-ffc32f2f19d6 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:27.932301 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1242480a-10e3-470d-9cc2-ffc32f2f19d6 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] [instance: ab2e742e-c678-4d28-9d95-e8b9b9443867] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:27.957102 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1242480a-10e3-470d-9cc2-ffc32f2f19d6 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:27.960325 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1242480a-10e3-470d-9cc2-ffc32f2f19d6 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:27.961632 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1242480a-10e3-470d-9cc2-ffc32f2f19d6 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:27.965660 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1242480a-10e3-470d-9cc2-ffc32f2f19d6 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:27.966395 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1242480a-10e3-470d-9cc2-ffc32f2f19d6 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:27.967316 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1242480a-10e3-470d-9cc2-ffc32f2f19d6 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:28.012373 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1242480a-10e3-470d-9cc2-ffc32f2f19d6 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:28.013141 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1242480a-10e3-470d-9cc2-ffc32f2f19d6 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:28.013908 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1242480a-10e3-470d-9cc2-ffc32f2f19d6 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:28.061367 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-1242480a-10e3-470d-9cc2-ffc32f2f19d6 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lazy-loading 'flavor' on Instance uuid ab2e742e-c678-4d28-9d95-e8b9b9443867 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:58:28.109010 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1242480a-10e3-470d-9cc2-ffc32f2f19d6 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] 10.222.0.23 "PUT /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867/tags" status: 200 len: 62 microversion: 2.26 time: 0.214065 Sep 10 11:58:28.109839 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2108/4227] 10.222.0.23 () {62 vars in 1312 bytes} [Sat Sep 10 11:58:27 2022] PUT /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867/tags => generated 62 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:28.123543 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e1287d31-8a78-4b58-93eb-43345e9d1458 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Calling method '.version_select at 0x7f4073131b80>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:28.138266 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e1287d31-8a78-4b58-93eb-43345e9d1458 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:28.139927 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e1287d31-8a78-4b58-93eb-43345e9d1458 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:28.140495 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e1287d31-8a78-4b58-93eb-43345e9d1458 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:28.169529 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e1287d31-8a78-4b58-93eb-43345e9d1458 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] 10.222.0.23 "GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867/tags" status: 200 len: 62 microversion: 2.26 time: 0.050900 Sep 10 11:58:28.171682 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2120/4228] 10.222.0.23 () {60 vars in 1292 bytes} [Sat Sep 10 11:58:28 2022] GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867/tags => generated 62 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:28.182164 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9d26e748-48eb-4d3a-aab0-b5052500eee6 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Calling method '.version_select at 0x7f40729871f0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:28.197144 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d26e748-48eb-4d3a-aab0-b5052500eee6 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:28.197650 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d26e748-48eb-4d3a-aab0-b5052500eee6 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:28.201996 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d26e748-48eb-4d3a-aab0-b5052500eee6 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:28.202743 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9d26e748-48eb-4d3a-aab0-b5052500eee6 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] [instance: ab2e742e-c678-4d28-9d95-e8b9b9443867] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:28.220886 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:58:28.224588 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d26e748-48eb-4d3a-aab0-b5052500eee6 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:28.226584 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d26e748-48eb-4d3a-aab0-b5052500eee6 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:28.229394 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d26e748-48eb-4d3a-aab0-b5052500eee6 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:28.232897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d26e748-48eb-4d3a-aab0-b5052500eee6 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:28.234118 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d26e748-48eb-4d3a-aab0-b5052500eee6 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:28.235533 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d26e748-48eb-4d3a-aab0-b5052500eee6 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:28.305983 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d26e748-48eb-4d3a-aab0-b5052500eee6 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:28.310495 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d26e748-48eb-4d3a-aab0-b5052500eee6 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:28.311449 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d26e748-48eb-4d3a-aab0-b5052500eee6 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:28.354554 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-9d26e748-48eb-4d3a-aab0-b5052500eee6 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lazy-loading 'flavor' on Instance uuid ab2e742e-c678-4d28-9d95-e8b9b9443867 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:58:28.375865 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9d26e748-48eb-4d3a-aab0-b5052500eee6 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867/tags" status: 204 len: 0 microversion: 2.26 time: 0.199326 Sep 10 11:58:28.376832 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2109/4229] 10.222.0.23 () {60 vars in 1295 bytes} [Sat Sep 10 11:58:28 2022] DELETE /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867/tags => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 11:58:28.389486 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5001eda1-6cad-48e1-9363-f14e8887b673 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:28.390646 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5001eda1-6cad-48e1-9363-f14e8887b673 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] [instance: ab2e742e-c678-4d28-9d95-e8b9b9443867] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:28.408404 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5001eda1-6cad-48e1-9363-f14e8887b673 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:28.411658 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5001eda1-6cad-48e1-9363-f14e8887b673 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:28.413478 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5001eda1-6cad-48e1-9363-f14e8887b673 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:28.416572 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5001eda1-6cad-48e1-9363-f14e8887b673 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:28.417375 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5001eda1-6cad-48e1-9363-f14e8887b673 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:28.417843 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5001eda1-6cad-48e1-9363-f14e8887b673 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:28.464233 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ed4cca54-b394-407d-9e2b-b695b13a88aa tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:28.465118 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ed4cca54-b394-407d-9e2b-b695b13a88aa tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:28.481830 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed4cca54-b394-407d-9e2b-b695b13a88aa tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:28.483376 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed4cca54-b394-407d-9e2b-b695b13a88aa tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:28.484499 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed4cca54-b394-407d-9e2b-b695b13a88aa tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:28.486037 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed4cca54-b394-407d-9e2b-b695b13a88aa tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:28.490091 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed4cca54-b394-407d-9e2b-b695b13a88aa tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:28.490698 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed4cca54-b394-407d-9e2b-b695b13a88aa tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:28.521891 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5001eda1-6cad-48e1-9363-f14e8887b673 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] [instance: ab2e742e-c678-4d28-9d95-e8b9b9443867] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:58:28.841168 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ed4cca54-b394-407d-9e2b-b695b13a88aa tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:28.851841 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ed4cca54-b394-407d-9e2b-b695b13a88aa tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1524 microversion: 2.1 time: 0.389874 Sep 10 11:58:28.854062 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2110/4230] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:28 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1524 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:28.869381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-85293984-39d9-43ed-a8b6-73e0fa3a13fd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:28.870464 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-85293984-39d9-43ed-a8b6-73e0fa3a13fd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:28.875068 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5001eda1-6cad-48e1-9363-f14e8887b673 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867" status: 204 len: 0 microversion: 2.26 time: 0.492824 Sep 10 11:58:28.875923 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2121/4231] 10.222.0.23 () {60 vars in 1280 bytes} [Sat Sep 10 11:58:28 2022] DELETE /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 11:58:28.924441 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6d89f2cb-96c8-43d2-b4af-2298d06f1496 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:28.927698 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6d89f2cb-96c8-43d2-b4af-2298d06f1496 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] [instance: ab2e742e-c678-4d28-9d95-e8b9b9443867] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:28.942210 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d89f2cb-96c8-43d2-b4af-2298d06f1496 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:28.945371 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d89f2cb-96c8-43d2-b4af-2298d06f1496 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:28.946588 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d89f2cb-96c8-43d2-b4af-2298d06f1496 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:28.947365 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d89f2cb-96c8-43d2-b4af-2298d06f1496 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:28.949216 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d89f2cb-96c8-43d2-b4af-2298d06f1496 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:28.953110 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d89f2cb-96c8-43d2-b4af-2298d06f1496 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:29.037116 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-85293984-39d9-43ed-a8b6-73e0fa3a13fd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:29.050964 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-85293984-39d9-43ed-a8b6-73e0fa3a13fd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1239 microversion: 2.1 time: 0.185980 Sep 10 11:58:29.064965 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2111/4232] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:28 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1239 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:29.323064 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6d89f2cb-96c8-43d2-b4af-2298d06f1496 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:29.340129 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6d89f2cb-96c8-43d2-b4af-2298d06f1496 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:29.359227 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6d89f2cb-96c8-43d2-b4af-2298d06f1496 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:29.364977 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6d89f2cb-96c8-43d2-b4af-2298d06f1496 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] 10.222.0.23 "GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867" status: 200 len: 1551 microversion: 2.26 time: 0.482327 Sep 10 11:58:29.370800 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2122/4233] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:58:28 2022] GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867 => generated 1551 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:58:29.880390 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9a80fc63-f072-4a6a-9f63-6d94a73a455a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:29.880936 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9a80fc63-f072-4a6a-9f63-6d94a73a455a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:29.905830 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a80fc63-f072-4a6a-9f63-6d94a73a455a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:29.919921 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a80fc63-f072-4a6a-9f63-6d94a73a455a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:29.920830 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a80fc63-f072-4a6a-9f63-6d94a73a455a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:29.925310 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a80fc63-f072-4a6a-9f63-6d94a73a455a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:29.936290 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a80fc63-f072-4a6a-9f63-6d94a73a455a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:29.939854 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a80fc63-f072-4a6a-9f63-6d94a73a455a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:30.081081 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7529a472-1ba7-4f3c-b57a-fcbed7464066 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:30.082639 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7529a472-1ba7-4f3c-b57a-fcbed7464066 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:30.108740 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=4 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:58:30.120032 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7529a472-1ba7-4f3c-b57a-fcbed7464066 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:30.120732 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7529a472-1ba7-4f3c-b57a-fcbed7464066 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:30.121285 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7529a472-1ba7-4f3c-b57a-fcbed7464066 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:30.123971 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7529a472-1ba7-4f3c-b57a-fcbed7464066 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:30.127743 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7529a472-1ba7-4f3c-b57a-fcbed7464066 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:30.131841 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7529a472-1ba7-4f3c-b57a-fcbed7464066 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:30.402233 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7529a472-1ba7-4f3c-b57a-fcbed7464066 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:30.419981 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7529a472-1ba7-4f3c-b57a-fcbed7464066 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1291 microversion: 2.1 time: 0.340658 Sep 10 11:58:30.420655 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2123/4234] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:30 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1291 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:58:30.448994 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f1da7ec2-8d20-4bf5-80be-49f9455c4f3b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:30.450609 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f1da7ec2-8d20-4bf5-80be-49f9455c4f3b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] [instance: ab2e742e-c678-4d28-9d95-e8b9b9443867] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:30.453638 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9a80fc63-f072-4a6a-9f63-6d94a73a455a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:30.468523 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9a80fc63-f072-4a6a-9f63-6d94a73a455a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1524 microversion: 2.1 time: 0.592966 Sep 10 11:58:30.474798 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f1da7ec2-8d20-4bf5-80be-49f9455c4f3b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:30.479322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f1da7ec2-8d20-4bf5-80be-49f9455c4f3b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:30.480272 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f1da7ec2-8d20-4bf5-80be-49f9455c4f3b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:30.483701 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2112/4235] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:29 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1524 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:30.494868 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f1da7ec2-8d20-4bf5-80be-49f9455c4f3b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:30.496765 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f1da7ec2-8d20-4bf5-80be-49f9455c4f3b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:30.502726 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f1da7ec2-8d20-4bf5-80be-49f9455c4f3b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:31.361389 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f1da7ec2-8d20-4bf5-80be-49f9455c4f3b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:31.380026 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f1da7ec2-8d20-4bf5-80be-49f9455c4f3b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:31.385950 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f1da7ec2-8d20-4bf5-80be-49f9455c4f3b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:31.392145 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f1da7ec2-8d20-4bf5-80be-49f9455c4f3b tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] 10.222.0.23 "GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867" status: 200 len: 1551 microversion: 2.26 time: 0.968365 Sep 10 11:58:31.395844 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2124/4236] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:58:30 2022] GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867 => generated 1551 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:58:31.443632 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2630aff2-619e-45f8-8f00-9d6823f0e733 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:31.444922 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2630aff2-619e-45f8-8f00-9d6823f0e733 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:31.457911 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2630aff2-619e-45f8-8f00-9d6823f0e733 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:31.460616 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2630aff2-619e-45f8-8f00-9d6823f0e733 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:31.462949 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2630aff2-619e-45f8-8f00-9d6823f0e733 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:31.463980 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2630aff2-619e-45f8-8f00-9d6823f0e733 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:31.468181 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2630aff2-619e-45f8-8f00-9d6823f0e733 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:31.469236 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2630aff2-619e-45f8-8f00-9d6823f0e733 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:31.497820 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-08aedbc9-c152-4701-9607-970a3243a18f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:31.498713 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-08aedbc9-c152-4701-9607-970a3243a18f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:31.520729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-08aedbc9-c152-4701-9607-970a3243a18f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:31.521347 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-08aedbc9-c152-4701-9607-970a3243a18f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:31.521815 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-08aedbc9-c152-4701-9607-970a3243a18f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:31.522821 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-08aedbc9-c152-4701-9607-970a3243a18f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:31.523112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-08aedbc9-c152-4701-9607-970a3243a18f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:31.524221 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-08aedbc9-c152-4701-9607-970a3243a18f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:31.981723 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2630aff2-619e-45f8-8f00-9d6823f0e733 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:31.988233 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=89,nova_cell1:DELETE=4,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:58:31.990538 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2630aff2-619e-45f8-8f00-9d6823f0e733 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1297 microversion: 2.1 time: 0.550797 Sep 10 11:58:31.991136 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2113/4237] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:31 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1297 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:32.110901 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-08aedbc9-c152-4701-9607-970a3243a18f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:32.143323 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-08aedbc9-c152-4701-9607-970a3243a18f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1524 microversion: 2.1 time: 0.649218 Sep 10 11:58:32.159208 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2125/4238] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:31 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1524 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:32.191735 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-a50bd7f6-e119-4564-8fc3-9c12bea5180d req-23a33ae8-69c3-4b73-a8e4-d3b77ad00834 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab2e742e-c678-4d28-9d95-e8b9b9443867", "name": "network-vif-deleted", "tag": "8336b456-9ebc-4e1b-ba87-d18c785ff509"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:58:32.204224 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a50bd7f6-e119-4564-8fc3-9c12bea5180d req-23a33ae8-69c3-4b73-a8e4-d3b77ad00834 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:32.209109 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a50bd7f6-e119-4564-8fc3-9c12bea5180d req-23a33ae8-69c3-4b73-a8e4-d3b77ad00834 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:32.212464 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a50bd7f6-e119-4564-8fc3-9c12bea5180d req-23a33ae8-69c3-4b73-a8e4-d3b77ad00834 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:32.269729 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-a50bd7f6-e119-4564-8fc3-9c12bea5180d req-23a33ae8-69c3-4b73-a8e4-d3b77ad00834 service nova] Creating event network-vif-deleted:8336b456-9ebc-4e1b-ba87-d18c785ff509 for instance ab2e742e-c678-4d28-9d95-e8b9b9443867 on n-h2-856895-1 Sep 10 11:58:32.284124 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-a50bd7f6-e119-4564-8fc3-9c12bea5180d req-23a33ae8-69c3-4b73-a8e4-d3b77ad00834 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099822 Sep 10 11:58:32.290477 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2114/4239] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:58:32.423704 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-471455e1-5298-4f0f-867f-4e96109c55e4 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:32.424841 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-471455e1-5298-4f0f-867f-4e96109c55e4 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] [instance: ab2e742e-c678-4d28-9d95-e8b9b9443867] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:32.441760 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-471455e1-5298-4f0f-867f-4e96109c55e4 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:32.442667 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-471455e1-5298-4f0f-867f-4e96109c55e4 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:32.443672 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-471455e1-5298-4f0f-867f-4e96109c55e4 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:32.450863 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-471455e1-5298-4f0f-867f-4e96109c55e4 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:32.453641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-471455e1-5298-4f0f-867f-4e96109c55e4 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:32.454267 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-471455e1-5298-4f0f-867f-4e96109c55e4 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:32.548845 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-471455e1-5298-4f0f-867f-4e96109c55e4 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:32.552721 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-471455e1-5298-4f0f-867f-4e96109c55e4 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:32.553201 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-471455e1-5298-4f0f-867f-4e96109c55e4 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:32.553678 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-471455e1-5298-4f0f-867f-4e96109c55e4 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lazy-loading 'fault' on Instance uuid ab2e742e-c678-4d28-9d95-e8b9b9443867 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:58:33.021461 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-da8ab522-ae07-417c-bebe-66c756cfa238 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:33.022172 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-da8ab522-ae07-417c-bebe-66c756cfa238 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:33.039813 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da8ab522-ae07-417c-bebe-66c756cfa238 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:33.040314 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da8ab522-ae07-417c-bebe-66c756cfa238 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:33.040763 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da8ab522-ae07-417c-bebe-66c756cfa238 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:33.041485 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da8ab522-ae07-417c-bebe-66c756cfa238 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:33.041947 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da8ab522-ae07-417c-bebe-66c756cfa238 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:33.042385 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da8ab522-ae07-417c-bebe-66c756cfa238 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:33.229037 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-da8ab522-ae07-417c-bebe-66c756cfa238 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:33.244047 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-da8ab522-ae07-417c-bebe-66c756cfa238 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1297 microversion: 2.1 time: 0.227574 Sep 10 11:58:33.256885 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2115/4240] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:33 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1297 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:33.263839 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-471455e1-5298-4f0f-867f-4e96109c55e4 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:33.278123 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-47d9692e-3572-4706-8f3f-7478f881da0b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:33.278759 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-47d9692e-3572-4706-8f3f-7478f881da0b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:33.285401 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-471455e1-5298-4f0f-867f-4e96109c55e4 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:33.296175 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-47d9692e-3572-4706-8f3f-7478f881da0b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:33.296529 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-471455e1-5298-4f0f-867f-4e96109c55e4 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '772de5ce0ef24348a46b84bbeebcabbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b14f9ce259485bb826e197aa4969fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:33.298940 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-471455e1-5298-4f0f-867f-4e96109c55e4 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] 10.222.0.23 "GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867" status: 200 len: 1352 microversion: 2.26 time: 0.880135 Sep 10 11:58:33.299071 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-47d9692e-3572-4706-8f3f-7478f881da0b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:33.299444 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-47d9692e-3572-4706-8f3f-7478f881da0b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:33.300192 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-47d9692e-3572-4706-8f3f-7478f881da0b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:33.300662 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-47d9692e-3572-4706-8f3f-7478f881da0b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:33.303894 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-47d9692e-3572-4706-8f3f-7478f881da0b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:33.304287 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2126/4241] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:58:32 2022] GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867 => generated 1352 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:58:34.273569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-db08ba64-1db0-4cd8-8326-abc239590537 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:34.274469 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-db08ba64-1db0-4cd8-8326-abc239590537 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:34.294416 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db08ba64-1db0-4cd8-8326-abc239590537 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:34.294941 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db08ba64-1db0-4cd8-8326-abc239590537 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:34.295438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db08ba64-1db0-4cd8-8326-abc239590537 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:34.297818 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db08ba64-1db0-4cd8-8326-abc239590537 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:34.297818 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db08ba64-1db0-4cd8-8326-abc239590537 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:34.298125 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db08ba64-1db0-4cd8-8326-abc239590537 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:34.311025 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=91,nova_cell1:DELETE=1,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2,nova_cell1:UPDATE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:58:34.575081 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-47d9692e-3572-4706-8f3f-7478f881da0b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:34.593402 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-47d9692e-3572-4706-8f3f-7478f881da0b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1524 microversion: 2.1 time: 1.328048 Sep 10 11:58:34.594033 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2116/4242] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:33 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1524 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:34.629654 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a8815b3f-a1d9-40bb-b345-4a3116a3ca97 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:34.630499 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a8815b3f-a1d9-40bb-b345-4a3116a3ca97 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] [instance: ab2e742e-c678-4d28-9d95-e8b9b9443867] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:34.639475 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8815b3f-a1d9-40bb-b345-4a3116a3ca97 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:34.640305 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8815b3f-a1d9-40bb-b345-4a3116a3ca97 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:34.640967 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8815b3f-a1d9-40bb-b345-4a3116a3ca97 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:34.641939 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8815b3f-a1d9-40bb-b345-4a3116a3ca97 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:34.642866 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8815b3f-a1d9-40bb-b345-4a3116a3ca97 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:34.643543 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8815b3f-a1d9-40bb-b345-4a3116a3ca97 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:34.689372 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-a8815b3f-a1d9-40bb-b345-4a3116a3ca97 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] HTTP exception thrown: Instance ab2e742e-c678-4d28-9d95-e8b9b9443867 could not be found. Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a8815b3f-a1d9-40bb-b345-4a3116a3ca97 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Request method failure captured: Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867 HTTP/1.1 Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHvEJE6hT20U9WWMSs2w79SwEyAxWPMw1i3Hj9kpCSMuOPI_eDcsZD3t-2sja1NtC69e7kmB43f-G7NQr9J0C4y8teU3abvWr-fs44KGz0Qh28xg0N2pL5kzVId9RuMo8m_0UYiv4duYm1Drc-rHSKqSAyGt6HnuQvCN_jphFyZODZc Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: X-Openstack-Nova-Api-Version: 2.26 Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 99b14f9ce259485bb826e197aa4969fb Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServerTagsTestJSON-592138791 Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99b14f9ce259485bb826e197aa4969fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/99b14f9ce259485bb826e197aa4969fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_99b14f9ce259485bb826e197aa4969fb", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/99b14f9ce259485bb826e197aa4969fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServerTagsTestJSON-592138791 Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 99b14f9ce259485bb826e197aa4969fb Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServerTagsTestJSON-592138791 Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServerTagsTestJSON-592138791-project Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 772de5ce0ef24348a46b84bbeebcabbb Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServerTagsTestJSON-592138791-project Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance ab2e742e-c678-4d28-9d95-e8b9b9443867 could not be found. Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'ab2e742e-c678-4d28-9d95-e8b9b9443867'} Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab2e742e-c678-4d28-9d95-e8b9b9443867 could not be found. Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab2e742e-c678-4d28-9d95-e8b9b9443867 could not be found. Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:58:34.693082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:58:34.697844 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:58:34.697844 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:58:34.697844 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:58:34.697844 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:58:34.697844 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:58:34.697844 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab2e742e-c678-4d28-9d95-e8b9b9443867 could not be found. Sep 10 11:58:34.697844 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:58:34.700545 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a8815b3f-a1d9-40bb-b345-4a3116a3ca97 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] Returning 404 to user: Instance ab2e742e-c678-4d28-9d95-e8b9b9443867 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:58:34.707223 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a8815b3f-a1d9-40bb-b345-4a3116a3ca97 tempest-ServerTagsTestJSON-592138791 tempest-ServerTagsTestJSON-592138791-project] 10.222.0.23 "GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867" status: 404 len: 111 microversion: 2.26 time: 0.098784 Sep 10 11:58:34.708047 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2117/4243] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:58:34 2022] GET /compute/v2.1/servers/ab2e742e-c678-4d28-9d95-e8b9b9443867 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:58:35.320957 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-db08ba64-1db0-4cd8-8326-abc239590537 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:35.331347 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-db08ba64-1db0-4cd8-8326-abc239590537 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1365 microversion: 2.1 time: 1.061559 Sep 10 11:58:35.339243 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2127/4244] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:34 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1365 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:35.620137 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-802bc0c8-3c4c-49b2-916d-bd175d2ce348 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:35.621390 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-802bc0c8-3c4c-49b2-916d-bd175d2ce348 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:35.637455 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-802bc0c8-3c4c-49b2-916d-bd175d2ce348 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:35.637959 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-802bc0c8-3c4c-49b2-916d-bd175d2ce348 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:35.638451 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-802bc0c8-3c4c-49b2-916d-bd175d2ce348 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:35.639190 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-802bc0c8-3c4c-49b2-916d-bd175d2ce348 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:35.639652 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-802bc0c8-3c4c-49b2-916d-bd175d2ce348 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:35.640092 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-802bc0c8-3c4c-49b2-916d-bd175d2ce348 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:35.886065 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-7647d6ad-a7e5-424a-b221-74bef4d2ccb1 req-a56f1c87-85ac-4551-94c5-d6f71e1ea9ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64704ff7-229d-478b-9889-6b6cba53bd0f", "tag": "7f6388a0-8fe7-4ee5-821e-68c4889b9594"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:58:35.899572 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-7647d6ad-a7e5-424a-b221-74bef4d2ccb1 req-a56f1c87-85ac-4551-94c5-d6f71e1ea9ce service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:35.900406 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-7647d6ad-a7e5-424a-b221-74bef4d2ccb1 req-a56f1c87-85ac-4551-94c5-d6f71e1ea9ce service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:35.901138 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-7647d6ad-a7e5-424a-b221-74bef4d2ccb1 req-a56f1c87-85ac-4551-94c5-d6f71e1ea9ce service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:35.917670 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-7647d6ad-a7e5-424a-b221-74bef4d2ccb1 req-a56f1c87-85ac-4551-94c5-d6f71e1ea9ce service nova] Creating event network-changed:7f6388a0-8fe7-4ee5-821e-68c4889b9594 for instance 64704ff7-229d-478b-9889-6b6cba53bd0f on n-h1-856895-1 Sep 10 11:58:35.927546 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-7647d6ad-a7e5-424a-b221-74bef4d2ccb1 req-a56f1c87-85ac-4551-94c5-d6f71e1ea9ce service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046208 Sep 10 11:58:35.933392 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2128/4245] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:58:36.369502 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6c613cf1-62b4-478b-b03b-78ac04701bfd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:36.370967 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6c613cf1-62b4-478b-b03b-78ac04701bfd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:36.391672 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6c613cf1-62b4-478b-b03b-78ac04701bfd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:36.392370 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6c613cf1-62b4-478b-b03b-78ac04701bfd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:36.393077 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6c613cf1-62b4-478b-b03b-78ac04701bfd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:36.400413 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6c613cf1-62b4-478b-b03b-78ac04701bfd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:36.401985 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6c613cf1-62b4-478b-b03b-78ac04701bfd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:36.403192 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6c613cf1-62b4-478b-b03b-78ac04701bfd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:36.425921 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-802bc0c8-3c4c-49b2-916d-bd175d2ce348 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:36.437040 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-802bc0c8-3c4c-49b2-916d-bd175d2ce348 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1524 microversion: 2.1 time: 0.821771 Sep 10 11:58:36.456632 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2118/4246] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:35 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1524 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:36.887695 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6c613cf1-62b4-478b-b03b-78ac04701bfd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:36.916923 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6c613cf1-62b4-478b-b03b-78ac04701bfd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1365 microversion: 2.1 time: 0.549920 Sep 10 11:58:36.939806 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2129/4247] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:36 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1365 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:58:37.228197 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c72b77ba-b81c-49bb-9204-2573fbd2b23f tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Action: 'create', calling method: .version_select at 0x7f40724f7160>, body: {"keypair": {"name": "tempest-keypair-679466197", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKBE5ZwQVzs0QSZjFTqlUOi9q7JwCSEGfV/jSFxmi9HlQ2ug20OWc85WegJEXgjWCnQ46iyU2cjxplYk+d8U+3rHAhhXrrD1VQWdpVgsqcXb6VbQMIWXmyCWtjkoqrHqQ=="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:58:37.263687 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-c72b77ba-b81c-49bb-9204-2573fbd2b23f tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Getting quotas for project ce08caecb8b34510a7f6fde5774b62b2. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:58:37.278307 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-c72b77ba-b81c-49bb-9204-2573fbd2b23f tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Getting quotas for user bd23712ff5e149d9b61ca12312587fc5 and project ce08caecb8b34510a7f6fde5774b62b2. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:58:37.329117 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c72b77ba-b81c-49bb-9204-2573fbd2b23f tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.429307 Sep 10 11:58:37.353229 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2119/4248] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 11:58:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:58:37.468652 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-82932d3a-4070-44ec-a2a1-9e937b098c46 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:37.470013 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-82932d3a-4070-44ec-a2a1-9e937b098c46 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:37.484711 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82932d3a-4070-44ec-a2a1-9e937b098c46 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:37.486648 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82932d3a-4070-44ec-a2a1-9e937b098c46 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:37.487539 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82932d3a-4070-44ec-a2a1-9e937b098c46 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:37.488454 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82932d3a-4070-44ec-a2a1-9e937b098c46 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:37.491104 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82932d3a-4070-44ec-a2a1-9e937b098c46 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:37.493294 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82932d3a-4070-44ec-a2a1-9e937b098c46 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:37.824950 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-82932d3a-4070-44ec-a2a1-9e937b098c46 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:37.854845 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-82932d3a-4070-44ec-a2a1-9e937b098c46 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1524 microversion: 2.1 time: 0.390185 Sep 10 11:58:37.864076 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2130/4249] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:37 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1524 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:37.946451 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ab9726c0-4845-4a7a-9860-5c170a8d2516 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:37.947355 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ab9726c0-4845-4a7a-9860-5c170a8d2516 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:37.960204 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:58:37.973867 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab9726c0-4845-4a7a-9860-5c170a8d2516 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:37.977171 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab9726c0-4845-4a7a-9860-5c170a8d2516 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:37.978343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab9726c0-4845-4a7a-9860-5c170a8d2516 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:37.983000 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab9726c0-4845-4a7a-9860-5c170a8d2516 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:37.986930 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab9726c0-4845-4a7a-9860-5c170a8d2516 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:37.992567 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab9726c0-4845-4a7a-9860-5c170a8d2516 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:38.622765 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ab9726c0-4845-4a7a-9860-5c170a8d2516 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:38.635645 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ab9726c0-4845-4a7a-9860-5c170a8d2516 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1365 microversion: 2.1 time: 0.691397 Sep 10 11:58:38.637848 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2120/4250] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:37 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1365 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:38.900439 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6d5b031b-6307-4539-b033-3e18cc9198ed tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:38.901058 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6d5b031b-6307-4539-b033-3e18cc9198ed tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:38.917322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d5b031b-6307-4539-b033-3e18cc9198ed tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:38.923798 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d5b031b-6307-4539-b033-3e18cc9198ed tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:38.925097 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d5b031b-6307-4539-b033-3e18cc9198ed tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:38.935821 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d5b031b-6307-4539-b033-3e18cc9198ed tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:38.936550 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d5b031b-6307-4539-b033-3e18cc9198ed tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:38.937264 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d5b031b-6307-4539-b033-3e18cc9198ed tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:39.662993 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8e9a9c26-b2df-4e22-9194-2f8d684b667b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:39.664513 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8e9a9c26-b2df-4e22-9194-2f8d684b667b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:39.681256 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e9a9c26-b2df-4e22-9194-2f8d684b667b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:39.681819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e9a9c26-b2df-4e22-9194-2f8d684b667b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:39.682514 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e9a9c26-b2df-4e22-9194-2f8d684b667b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:39.683746 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e9a9c26-b2df-4e22-9194-2f8d684b667b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:39.684388 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e9a9c26-b2df-4e22-9194-2f8d684b667b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:39.689421 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e9a9c26-b2df-4e22-9194-2f8d684b667b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:39.801266 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6d5b031b-6307-4539-b033-3e18cc9198ed tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:39.819281 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6d5b031b-6307-4539-b033-3e18cc9198ed tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1524 microversion: 2.1 time: 0.919247 Sep 10 11:58:39.820486 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2131/4251] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:38 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1524 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:58:40.313402 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8e9a9c26-b2df-4e22-9194-2f8d684b667b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:40.338491 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8e9a9c26-b2df-4e22-9194-2f8d684b667b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1365 microversion: 2.1 time: 0.679155 Sep 10 11:58:40.349453 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2121/4252] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:39 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1365 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:40.396121 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-20307e4d-91af-428b-9112-b89280e1f4c6 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:58:40.399613 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-20307e4d-91af-428b-9112-b89280e1f4c6 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:40.412589 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-20307e4d-91af-428b-9112-b89280e1f4c6 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:40.414134 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-20307e4d-91af-428b-9112-b89280e1f4c6 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:40.414888 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-20307e4d-91af-428b-9112-b89280e1f4c6 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:40.415838 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-20307e4d-91af-428b-9112-b89280e1f4c6 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:40.416638 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-20307e4d-91af-428b-9112-b89280e1f4c6 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:40.417223 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-20307e4d-91af-428b-9112-b89280e1f4c6 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:40.452890 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-20307e4d-91af-428b-9112-b89280e1f4c6 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lazy-loading 'flavor' on Instance uuid 74075ab0-826c-4b95-9660-e3417ec2b1f4 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:58:40.848102 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-20307e4d-91af-428b-9112-b89280e1f4c6 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "POST /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4/action" status: 200 len: 32 microversion: 2.1 time: 0.456257 Sep 10 11:58:40.855793 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-105f18a1-1c87-40b2-83ae-4871549a26d4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:40.857558 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2132/4253] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:58:40 2022] POST /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4/action => generated 32 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 11:58:40.859468 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-105f18a1-1c87-40b2-83ae-4871549a26d4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:40.872404 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-62c01cd9-6c2f-4abe-8af1-88d3487c4d62 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:40.873686 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-62c01cd9-6c2f-4abe-8af1-88d3487c4d62 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:40.889492 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-62c01cd9-6c2f-4abe-8af1-88d3487c4d62 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:40.891004 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-105f18a1-1c87-40b2-83ae-4871549a26d4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:40.895356 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-105f18a1-1c87-40b2-83ae-4871549a26d4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:40.896149 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-105f18a1-1c87-40b2-83ae-4871549a26d4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:40.898921 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-62c01cd9-6c2f-4abe-8af1-88d3487c4d62 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:40.899754 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-62c01cd9-6c2f-4abe-8af1-88d3487c4d62 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:40.900685 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-62c01cd9-6c2f-4abe-8af1-88d3487c4d62 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:40.901345 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-62c01cd9-6c2f-4abe-8af1-88d3487c4d62 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:40.902480 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-62c01cd9-6c2f-4abe-8af1-88d3487c4d62 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:40.907354 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-105f18a1-1c87-40b2-83ae-4871549a26d4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:40.908365 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-105f18a1-1c87-40b2-83ae-4871549a26d4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:40.908979 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-105f18a1-1c87-40b2-83ae-4871549a26d4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:41.454202 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-62c01cd9-6c2f-4abe-8af1-88d3487c4d62 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:41.475305 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-62c01cd9-6c2f-4abe-8af1-88d3487c4d62 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4" status: 200 len: 1735 microversion: 2.1 time: 0.614501 Sep 10 11:58:41.493338 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2133/4254] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:40 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 => generated 1735 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:41.507903 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e0d91aae-9640-42b0-9c0a-d48fae1fc3e7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:41.512423 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e0d91aae-9640-42b0-9c0a-d48fae1fc3e7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:41.559237 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0d91aae-9640-42b0-9c0a-d48fae1fc3e7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:41.564898 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0d91aae-9640-42b0-9c0a-d48fae1fc3e7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:41.565600 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0d91aae-9640-42b0-9c0a-d48fae1fc3e7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:41.566872 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0d91aae-9640-42b0-9c0a-d48fae1fc3e7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:41.567519 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0d91aae-9640-42b0-9c0a-d48fae1fc3e7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:41.571615 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0d91aae-9640-42b0-9c0a-d48fae1fc3e7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:41.587647 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-105f18a1-1c87-40b2-83ae-4871549a26d4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:41.606081 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-105f18a1-1c87-40b2-83ae-4871549a26d4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1506 microversion: 2.1 time: 0.758625 Sep 10 11:58:41.608206 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2122/4255] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:40 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1506 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:41.972884 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e0d91aae-9640-42b0-9c0a-d48fae1fc3e7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:41.989456 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e0d91aae-9640-42b0-9c0a-d48fae1fc3e7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1365 microversion: 2.1 time: 0.488599 Sep 10 11:58:41.990450 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2134/4256] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:41 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1365 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:42.221933 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-81c75eb3-d819-4733-a8bb-d16020bccce5 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2134128648", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "c87ce69a-79e5-450e-b2ee-0c2808db4d34"}], "security_groups": [{"name": "tempest-securitygroup--968971163"}], "key_name": "tempest-keypair-679466197", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:58:42.448043 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-81c75eb3-d819-4733-a8bb-d16020bccce5 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] validate_networks() for [('c87ce69a-79e5-450e-b2ee-0c2808db4d34', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:58:42.515113 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-87e4ef6f-37e7-4c02-b3ca-5b1cb4866bc7 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:42.516608 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-87e4ef6f-37e7-4c02-b3ca-5b1cb4866bc7 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:42.532392 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87e4ef6f-37e7-4c02-b3ca-5b1cb4866bc7 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:42.533551 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87e4ef6f-37e7-4c02-b3ca-5b1cb4866bc7 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:42.534264 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87e4ef6f-37e7-4c02-b3ca-5b1cb4866bc7 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:42.535562 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87e4ef6f-37e7-4c02-b3ca-5b1cb4866bc7 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:42.537374 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87e4ef6f-37e7-4c02-b3ca-5b1cb4866bc7 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:42.538185 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87e4ef6f-37e7-4c02-b3ca-5b1cb4866bc7 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:42.872562 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-87e4ef6f-37e7-4c02-b3ca-5b1cb4866bc7 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:42.883773 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-87e4ef6f-37e7-4c02-b3ca-5b1cb4866bc7 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4" status: 200 len: 1735 microversion: 2.1 time: 0.371364 Sep 10 11:58:42.899262 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2135/4257] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:42 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 => generated 1735 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:58:42.899262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a74d7d5a-85f9-4dc4-8fd8-89d5d3e47ed7 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:42.899262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a74d7d5a-85f9-4dc4-8fd8-89d5d3e47ed7 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:42.916666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a74d7d5a-85f9-4dc4-8fd8-89d5d3e47ed7 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:42.918770 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a74d7d5a-85f9-4dc4-8fd8-89d5d3e47ed7 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:42.918770 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a74d7d5a-85f9-4dc4-8fd8-89d5d3e47ed7 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:42.919401 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a74d7d5a-85f9-4dc4-8fd8-89d5d3e47ed7 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:42.920102 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a74d7d5a-85f9-4dc4-8fd8-89d5d3e47ed7 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:42.925162 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a74d7d5a-85f9-4dc4-8fd8-89d5d3e47ed7 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:43.281105 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a74d7d5a-85f9-4dc4-8fd8-89d5d3e47ed7 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:43.291578 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a74d7d5a-85f9-4dc4-8fd8-89d5d3e47ed7 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1506 microversion: 2.1 time: 0.406111 Sep 10 11:58:43.293132 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2136/4258] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:42 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1506 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:43.299334 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1eb8f5b1-f742-4b82-b9da-f268ad9fdf3e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:43.299923 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1eb8f5b1-f742-4b82-b9da-f268ad9fdf3e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:43.322098 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1eb8f5b1-f742-4b82-b9da-f268ad9fdf3e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:43.322098 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1eb8f5b1-f742-4b82-b9da-f268ad9fdf3e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:43.322819 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1eb8f5b1-f742-4b82-b9da-f268ad9fdf3e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:43.323831 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1eb8f5b1-f742-4b82-b9da-f268ad9fdf3e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:43.324609 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1eb8f5b1-f742-4b82-b9da-f268ad9fdf3e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:43.325154 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1eb8f5b1-f742-4b82-b9da-f268ad9fdf3e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:43.603965 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-81c75eb3-d819-4733-a8bb-d16020bccce5 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Getting quotas for project ce08caecb8b34510a7f6fde5774b62b2. Resources: dict_keys(['metadata_items']) {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:58:43.610524 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-81c75eb3-d819-4733-a8bb-d16020bccce5 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Getting quotas for user bd23712ff5e149d9b61ca12312587fc5 and project ce08caecb8b34510a7f6fde5774b62b2. Resources: dict_keys(['metadata_items']) {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:58:43.615102 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1eb8f5b1-f742-4b82-b9da-f268ad9fdf3e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:43.624766 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-81c75eb3-d819-4733-a8bb-d16020bccce5 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:58:43.625126 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-81c75eb3-d819-4733-a8bb-d16020bccce5 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:58:43.625386 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1eb8f5b1-f742-4b82-b9da-f268ad9fdf3e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1365 microversion: 2.1 time: 0.330776 Sep 10 11:58:43.625857 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-81c75eb3-d819-4733-a8bb-d16020bccce5 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:58:43.626315 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2137/4259] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:43 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1365 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:43.626433 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-81c75eb3-d819-4733-a8bb-d16020bccce5 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:58:43.626904 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-81c75eb3-d819-4733-a8bb-d16020bccce5 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:58:43.634463 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-aab68ceb-d471-4a06-8853-c60f28d8c97e req-e19c98a8-afa7-4963-90f7-8d2886f17dbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7063ea81-230e-4cee-902b-76c44ebd2d74", "name": "network-vif-unplugged", "status": "completed", "tag": "31936436-071f-4346-af16-9b17b5da3199"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:58:43.637175 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81c75eb3-d819-4733-a8bb-d16020bccce5 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:43.637867 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81c75eb3-d819-4733-a8bb-d16020bccce5 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:43.638478 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81c75eb3-d819-4733-a8bb-d16020bccce5 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:43.639466 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81c75eb3-d819-4733-a8bb-d16020bccce5 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:43.640140 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81c75eb3-d819-4733-a8bb-d16020bccce5 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:43.640813 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81c75eb3-d819-4733-a8bb-d16020bccce5 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:43.647539 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-aab68ceb-d471-4a06-8853-c60f28d8c97e req-e19c98a8-afa7-4963-90f7-8d2886f17dbc service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:43.648947 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-aab68ceb-d471-4a06-8853-c60f28d8c97e req-e19c98a8-afa7-4963-90f7-8d2886f17dbc service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:43.650817 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-aab68ceb-d471-4a06-8853-c60f28d8c97e req-e19c98a8-afa7-4963-90f7-8d2886f17dbc service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:43.664609 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-81c75eb3-d819-4733-a8bb-d16020bccce5 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Getting quotas for project ce08caecb8b34510a7f6fde5774b62b2. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:58:43.670060 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-aab68ceb-d471-4a06-8853-c60f28d8c97e req-e19c98a8-afa7-4963-90f7-8d2886f17dbc service nova] Creating event network-vif-unplugged:31936436-071f-4346-af16-9b17b5da3199 for instance 7063ea81-230e-4cee-902b-76c44ebd2d74 on n-h2-856895-1 Sep 10 11:58:43.670644 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-81c75eb3-d819-4733-a8bb-d16020bccce5 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Getting quotas for user bd23712ff5e149d9b61ca12312587fc5 and project ce08caecb8b34510a7f6fde5774b62b2. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:58:43.675656 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-aab68ceb-d471-4a06-8853-c60f28d8c97e req-e19c98a8-afa7-4963-90f7-8d2886f17dbc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048078 Sep 10 11:58:43.676658 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2138/4260] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:58:43.687184 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-81c75eb3-d819-4733-a8bb-d16020bccce5 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:58:43.690288 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-81c75eb3-d819-4733-a8bb-d16020bccce5 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] [instance: c9b161da-e58a-43ac-accc-4c771baf68a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:58:43.763194 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-81c75eb3-d819-4733-a8bb-d16020bccce5 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.545540 Sep 10 11:58:43.765700 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2123/4261] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:58:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 1549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:58:43.782690 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f1f9e3f1-b662-493e-8de4-d1fda1c50f3f tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:43.783866 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f1f9e3f1-b662-493e-8de4-d1fda1c50f3f tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] [instance: c9b161da-e58a-43ac-accc-4c771baf68a4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:43.807742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:58:43.918488 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ca493d2b-c5b4-459b-b790-13dfc8addd68 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:43.920192 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ca493d2b-c5b4-459b-b790-13dfc8addd68 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:43.941386 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca493d2b-c5b4-459b-b790-13dfc8addd68 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:43.942178 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca493d2b-c5b4-459b-b790-13dfc8addd68 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:43.942737 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca493d2b-c5b4-459b-b790-13dfc8addd68 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:43.943666 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca493d2b-c5b4-459b-b790-13dfc8addd68 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:43.948236 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca493d2b-c5b4-459b-b790-13dfc8addd68 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:43.948856 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca493d2b-c5b4-459b-b790-13dfc8addd68 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:43.982141 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f1f9e3f1-b662-493e-8de4-d1fda1c50f3f tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd23712ff5e149d9b61ca12312587fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce08caecb8b34510a7f6fde5774b62b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:43.989324 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f1f9e3f1-b662-493e-8de4-d1fda1c50f3f tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] 10.222.0.23 "GET /compute/v2.1/servers/c9b161da-e58a-43ac-accc-4c771baf68a4" status: 200 len: 1269 microversion: 2.1 time: 0.211786 Sep 10 11:58:44.003198 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2139/4262] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:43 2022] GET /compute/v2.1/servers/c9b161da-e58a-43ac-accc-4c771baf68a4 => generated 1269 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:44.189081 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ca493d2b-c5b4-459b-b790-13dfc8addd68 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:44.199204 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ca493d2b-c5b4-459b-b790-13dfc8addd68 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4" status: 200 len: 1735 microversion: 2.1 time: 0.287784 Sep 10 11:58:44.216560 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2124/4263] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:43 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 => generated 1735 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:58:44.324339 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c8b7f4a2-f82a-4113-899b-f672f430df81 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:44.325398 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c8b7f4a2-f82a-4113-899b-f672f430df81 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:44.333464 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c8b7f4a2-f82a-4113-899b-f672f430df81 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:44.334268 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c8b7f4a2-f82a-4113-899b-f672f430df81 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:44.334955 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c8b7f4a2-f82a-4113-899b-f672f430df81 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:44.336334 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c8b7f4a2-f82a-4113-899b-f672f430df81 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:44.337123 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c8b7f4a2-f82a-4113-899b-f672f430df81 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:44.337926 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c8b7f4a2-f82a-4113-899b-f672f430df81 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:44.622051 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c8b7f4a2-f82a-4113-899b-f672f430df81 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:44.631394 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c8b7f4a2-f82a-4113-899b-f672f430df81 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 200 len: 1509 microversion: 2.1 time: 0.314716 Sep 10 11:58:44.646744 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2140/4264] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:44 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 1509 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:44.653906 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-22344cea-f0a4-4b3d-9495-41462ee725f5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:44.654556 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-22344cea-f0a4-4b3d-9495-41462ee725f5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:44.658688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f0ffde3d-cfb7-4654-860e-c418792a1dc1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:44.659330 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f0ffde3d-cfb7-4654-860e-c418792a1dc1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:44.668777 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f0ffde3d-cfb7-4654-860e-c418792a1dc1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:44.669635 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f0ffde3d-cfb7-4654-860e-c418792a1dc1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:44.670255 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f0ffde3d-cfb7-4654-860e-c418792a1dc1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:44.671137 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f0ffde3d-cfb7-4654-860e-c418792a1dc1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:44.671783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f0ffde3d-cfb7-4654-860e-c418792a1dc1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:44.672443 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f0ffde3d-cfb7-4654-860e-c418792a1dc1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:44.688848 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-22344cea-f0a4-4b3d-9495-41462ee725f5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:44.690410 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-22344cea-f0a4-4b3d-9495-41462ee725f5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:44.692378 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-22344cea-f0a4-4b3d-9495-41462ee725f5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:44.698379 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-22344cea-f0a4-4b3d-9495-41462ee725f5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:44.699741 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-22344cea-f0a4-4b3d-9495-41462ee725f5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:44.703636 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-22344cea-f0a4-4b3d-9495-41462ee725f5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:44.732566 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f0ffde3d-cfb7-4654-860e-c418792a1dc1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:58:44.747565 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.compute.api [None req-f0ffde3d-cfb7-4654-860e-c418792a1dc1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Working on deleting snapshot abcc588c-8cb6-456e-a1d7-00292e793ff6 from shelved instance... Sep 10 11:58:45.063791 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-22344cea-f0a4-4b3d-9495-41462ee725f5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:45.086972 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-22344cea-f0a4-4b3d-9495-41462ee725f5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1365 microversion: 2.1 time: 0.441971 Sep 10 11:58:45.089343 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2125/4265] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:44 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1365 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:45.096579 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f471c7d7-27f4-47fe-8f82-8adf63a5661b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:45.098145 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f471c7d7-27f4-47fe-8f82-8adf63a5661b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] [instance: c9b161da-e58a-43ac-accc-4c771baf68a4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:45.108296 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f471c7d7-27f4-47fe-8f82-8adf63a5661b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:45.113415 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f471c7d7-27f4-47fe-8f82-8adf63a5661b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:45.115559 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f471c7d7-27f4-47fe-8f82-8adf63a5661b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:45.118785 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f471c7d7-27f4-47fe-8f82-8adf63a5661b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:45.119377 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f471c7d7-27f4-47fe-8f82-8adf63a5661b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:45.119887 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f471c7d7-27f4-47fe-8f82-8adf63a5661b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:45.252604 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f471c7d7-27f4-47fe-8f82-8adf63a5661b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd23712ff5e149d9b61ca12312587fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce08caecb8b34510a7f6fde5774b62b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:45.263757 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f471c7d7-27f4-47fe-8f82-8adf63a5661b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] 10.222.0.23 "GET /compute/v2.1/servers/c9b161da-e58a-43ac-accc-4c771baf68a4" status: 200 len: 1265 microversion: 2.1 time: 0.173046 Sep 10 11:58:45.264529 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2126/4266] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:45 2022] GET /compute/v2.1/servers/c9b161da-e58a-43ac-accc-4c771baf68a4 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:45.272977 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-05bcef75-e74a-4115-a024-7b63bec69222 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:45.274481 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-05bcef75-e74a-4115-a024-7b63bec69222 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:45.295715 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05bcef75-e74a-4115-a024-7b63bec69222 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:45.295715 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05bcef75-e74a-4115-a024-7b63bec69222 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:45.295715 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05bcef75-e74a-4115-a024-7b63bec69222 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:45.295715 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05bcef75-e74a-4115-a024-7b63bec69222 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:45.297693 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05bcef75-e74a-4115-a024-7b63bec69222 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:45.298557 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05bcef75-e74a-4115-a024-7b63bec69222 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:45.497372 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-05bcef75-e74a-4115-a024-7b63bec69222 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:45.506100 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-05bcef75-e74a-4115-a024-7b63bec69222 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4" status: 200 len: 1735 microversion: 2.1 time: 0.240700 Sep 10 11:58:45.506851 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2127/4267] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:45 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 => generated 1735 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:45.698182 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-bda07ee1-b30b-44ef-a3ba-9fc2ee7c254c req-4f3a3b2f-e349-40a8-a8ea-8fd7072b51a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64704ff7-229d-478b-9889-6b6cba53bd0f", "name": "network-vif-plugged", "status": "completed", "tag": "7f6388a0-8fe7-4ee5-821e-68c4889b9594"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:58:45.718734 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-bda07ee1-b30b-44ef-a3ba-9fc2ee7c254c req-4f3a3b2f-e349-40a8-a8ea-8fd7072b51a5 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:45.720265 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-bda07ee1-b30b-44ef-a3ba-9fc2ee7c254c req-4f3a3b2f-e349-40a8-a8ea-8fd7072b51a5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:45.722676 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-bda07ee1-b30b-44ef-a3ba-9fc2ee7c254c req-4f3a3b2f-e349-40a8-a8ea-8fd7072b51a5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:45.749267 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-bda07ee1-b30b-44ef-a3ba-9fc2ee7c254c req-4f3a3b2f-e349-40a8-a8ea-8fd7072b51a5 service nova] Creating event network-vif-plugged:7f6388a0-8fe7-4ee5-821e-68c4889b9594 for instance 64704ff7-229d-478b-9889-6b6cba53bd0f on n-h1-856895-1 Sep 10 11:58:45.755349 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-bda07ee1-b30b-44ef-a3ba-9fc2ee7c254c req-4f3a3b2f-e349-40a8-a8ea-8fd7072b51a5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061219 Sep 10 11:58:45.756592 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2128/4268] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:58:46.016498 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f0ffde3d-cfb7-4654-860e-c418792a1dc1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Doing local delete in cell d31511aa-3734-4d55-9c57-4a88c62d4dfd(cell1) {{(pid=128777) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 10 11:58:46.017352 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f0ffde3d-cfb7-4654-860e-c418792a1dc1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:46.018061 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f0ffde3d-cfb7-4654-860e-c418792a1dc1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:46.018699 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f0ffde3d-cfb7-4654-860e-c418792a1dc1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:46.019114 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.compute.api [None req-f0ffde3d-cfb7-4654-860e-c418792a1dc1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 10 11:58:46.023361 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-f0ffde3d-cfb7-4654-860e-c418792a1dc1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] deallocate_for_instance() {{(pid=128777) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 10 11:58:46.126136 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3ef2d9b8-f44b-4e15-b01d-ff283856b5ee tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:46.136660 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3ef2d9b8-f44b-4e15-b01d-ff283856b5ee tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:46.153871 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3ef2d9b8-f44b-4e15-b01d-ff283856b5ee tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:46.154378 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3ef2d9b8-f44b-4e15-b01d-ff283856b5ee tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:46.154826 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3ef2d9b8-f44b-4e15-b01d-ff283856b5ee tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:46.156790 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3ef2d9b8-f44b-4e15-b01d-ff283856b5ee tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:46.157266 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3ef2d9b8-f44b-4e15-b01d-ff283856b5ee tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:46.157705 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3ef2d9b8-f44b-4e15-b01d-ff283856b5ee tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:46.419390 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3ef2d9b8-f44b-4e15-b01d-ff283856b5ee tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:46.435642 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3ef2d9b8-f44b-4e15-b01d-ff283856b5ee tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1365 microversion: 2.1 time: 0.323097 Sep 10 11:58:46.436759 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2129/4269] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:46 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1365 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:58:46.452224 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-71a2f619-1e7e-4a23-8969-c89934d71b92 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:46.453305 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-71a2f619-1e7e-4a23-8969-c89934d71b92 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] [instance: c9b161da-e58a-43ac-accc-4c771baf68a4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:46.469153 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-71a2f619-1e7e-4a23-8969-c89934d71b92 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:46.469657 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-71a2f619-1e7e-4a23-8969-c89934d71b92 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:46.470104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-71a2f619-1e7e-4a23-8969-c89934d71b92 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:46.475784 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-71a2f619-1e7e-4a23-8969-c89934d71b92 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:46.477173 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-71a2f619-1e7e-4a23-8969-c89934d71b92 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:46.478377 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-71a2f619-1e7e-4a23-8969-c89934d71b92 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:46.588952 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-71a2f619-1e7e-4a23-8969-c89934d71b92 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd23712ff5e149d9b61ca12312587fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce08caecb8b34510a7f6fde5774b62b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:46.601248 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-71a2f619-1e7e-4a23-8969-c89934d71b92 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] 10.222.0.23 "GET /compute/v2.1/servers/c9b161da-e58a-43ac-accc-4c771baf68a4" status: 200 len: 1327 microversion: 2.1 time: 0.156774 Sep 10 11:58:46.602031 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2130/4270] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:46 2022] GET /compute/v2.1/servers/c9b161da-e58a-43ac-accc-4c771baf68a4 => generated 1327 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:46.612102 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1b7bdd9e-91f4-4d5a-9548-3295e57a1cf8 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:46.614836 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1b7bdd9e-91f4-4d5a-9548-3295e57a1cf8 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:46.630487 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1b7bdd9e-91f4-4d5a-9548-3295e57a1cf8 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:46.631185 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1b7bdd9e-91f4-4d5a-9548-3295e57a1cf8 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:46.632590 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1b7bdd9e-91f4-4d5a-9548-3295e57a1cf8 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:46.638912 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1b7bdd9e-91f4-4d5a-9548-3295e57a1cf8 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:46.639686 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1b7bdd9e-91f4-4d5a-9548-3295e57a1cf8 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:46.640297 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1b7bdd9e-91f4-4d5a-9548-3295e57a1cf8 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:46.889523 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1b7bdd9e-91f4-4d5a-9548-3295e57a1cf8 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:46.898837 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1b7bdd9e-91f4-4d5a-9548-3295e57a1cf8 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4" status: 200 len: 1735 microversion: 2.1 time: 0.295483 Sep 10 11:58:46.904477 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2131/4271] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:46 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 => generated 1735 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:47.121405 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-f0ffde3d-cfb7-4654-860e-c418792a1dc1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Updating instance_info_cache with network_info: [] {{(pid=128777) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 10 11:58:47.146721 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:58:47.279494 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-486018ff-fdfe-4cfd-b032-6ad171fb7f04 tempest-QuotasTestJSON-663061568 tempest-QuotasTestJSON-663061568-project] Calling method '.version_select at 0x7f4072c8b0d0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:47.389441 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-486018ff-fdfe-4cfd-b032-6ad171fb7f04 tempest-QuotasTestJSON-663061568 tempest-QuotasTestJSON-663061568-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/efff9ffb899b4cd99b442231ed33725f/defaults" status: 200 len: 371 microversion: 2.1 time: 0.406526 Sep 10 11:58:47.393959 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2132/4272] 10.222.0.23 () {58 vars in 1269 bytes} [Sat Sep 10 11:58:46 2022] GET /compute/v2.1/os-quota-sets/efff9ffb899b4cd99b442231ed33725f/defaults => generated 371 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:58:47.403578 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-93aa4afc-67de-40eb-8f0c-b03eb72ee596 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:47.409108 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-93aa4afc-67de-40eb-8f0c-b03eb72ee596 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:47.411372 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f0ffde3d-cfb7-4654-860e-c418792a1dc1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 204 len: 0 microversion: 2.1 time: 2.755879 Sep 10 11:58:47.417095 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2141/4273] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:58:44 2022] DELETE /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 0 bytes in 2761 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:58:47.418219 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-93aa4afc-67de-40eb-8f0c-b03eb72ee596 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:47.418887 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-93aa4afc-67de-40eb-8f0c-b03eb72ee596 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:47.419522 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-93aa4afc-67de-40eb-8f0c-b03eb72ee596 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:47.420497 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-93aa4afc-67de-40eb-8f0c-b03eb72ee596 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:47.421139 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-93aa4afc-67de-40eb-8f0c-b03eb72ee596 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:47.421751 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-93aa4afc-67de-40eb-8f0c-b03eb72ee596 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:47.428685 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-48e1646d-453f-442d-b4e7-76368a34429c req-1c86ac1d-f71b-4284-a25a-30faafe1fd6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7063ea81-230e-4cee-902b-76c44ebd2d74", "name": "network-vif-deleted", "tag": "31936436-071f-4346-af16-9b17b5da3199"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:58:47.438789 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-48e1646d-453f-442d-b4e7-76368a34429c req-1c86ac1d-f71b-4284-a25a-30faafe1fd6d service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:47.439320 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-48e1646d-453f-442d-b4e7-76368a34429c req-1c86ac1d-f71b-4284-a25a-30faafe1fd6d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:47.439762 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-48e1646d-453f-442d-b4e7-76368a34429c req-1c86ac1d-f71b-4284-a25a-30faafe1fd6d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:47.452697 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.compute.server_external_events [req-48e1646d-453f-442d-b4e7-76368a34429c req-1c86ac1d-f71b-4284-a25a-30faafe1fd6d service nova] Unable to find a host for instance 7063ea81-230e-4cee-902b-76c44ebd2d74. Dropping event network-vif-deleted {{(pid=128777) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 10 11:58:47.453622 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-48e1646d-453f-442d-b4e7-76368a34429c req-1c86ac1d-f71b-4284-a25a-30faafe1fd6d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.035677 Sep 10 11:58:47.459673 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2142/4274] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 42 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 10 11:58:47.465483 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-544ff47e-5385-4c7d-87f5-9bb5ed4e9fa5 tempest-QuotasTestJSON-663061568 tempest-QuotasTestJSON-663061568-project] Calling method '.version_select at 0x7f407357ea60>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:47.469229 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-93aa4afc-67de-40eb-8f0c-b03eb72ee596 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.073826 Sep 10 11:58:47.470354 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2133/4275] 10.222.0.23 () {60 vars in 1343 bytes} [Sat Sep 10 11:58:47 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:47.475779 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ffdbab13-91eb-49dc-9898-9e1a8297ae64 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:47.476788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ffdbab13-91eb-49dc-9898-9e1a8297ae64 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:47.486573 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ffdbab13-91eb-49dc-9898-9e1a8297ae64 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:47.487468 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ffdbab13-91eb-49dc-9898-9e1a8297ae64 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:47.488681 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ffdbab13-91eb-49dc-9898-9e1a8297ae64 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:47.490667 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ffdbab13-91eb-49dc-9898-9e1a8297ae64 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:47.491546 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ffdbab13-91eb-49dc-9898-9e1a8297ae64 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:47.492265 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ffdbab13-91eb-49dc-9898-9e1a8297ae64 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:47.512562 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-ffdbab13-91eb-49dc-9898-9e1a8297ae64 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] HTTP exception thrown: Instance 7063ea81-230e-4cee-902b-76c44ebd2d74 could not be found. Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ffdbab13-91eb-49dc-9898-9e1a8297ae64 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Request method failure captured: Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 HTTP/1.1 Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHsd-AnnLZFS6-Lbfr9ATef_4cX6EE0Up-a_Ch8dobncDUqljTHX0YcK7WbJaaBcAlN6twvlZe9au1SNJQwC5-nItcb7pEhHjqWyH9GhqCmgS3jEbfUY8st6zk2hVKWMOxRl1E1nEdlCzWIcW0YZf7xPnP7IvCJy_UgVMW4-UpTlv4M Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2f92ad05650840f6bb4c8f6134b489ca", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-DeleteServersTestJSON-419044733 Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-DeleteServersTestJSON-419044733-project Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: d244789bea974bd99d0f1debebabb54a Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-DeleteServersTestJSON-419044733-project Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 7063ea81-230e-4cee-902b-76c44ebd2d74 could not be found. Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '7063ea81-230e-4cee-902b-76c44ebd2d74'} Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7063ea81-230e-4cee-902b-76c44ebd2d74 could not be found. Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7063ea81-230e-4cee-902b-76c44ebd2d74 could not be found. Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:58:47.515823 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:58:47.521234 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:58:47.521234 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:58:47.521234 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:58:47.521234 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:58:47.521234 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:58:47.521234 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7063ea81-230e-4cee-902b-76c44ebd2d74 could not be found. Sep 10 11:58:47.521234 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:58:47.523309 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ffdbab13-91eb-49dc-9898-9e1a8297ae64 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Returning 404 to user: Instance 7063ea81-230e-4cee-902b-76c44ebd2d74 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:58:47.524405 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ffdbab13-91eb-49dc-9898-9e1a8297ae64 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 404 len: 111 microversion: 2.1 time: 0.051425 Sep 10 11:58:47.528855 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2134/4276] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:47 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:58:47.536761 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-29f14402-c2d1-4c70-a96f-2988dd5583d6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:47.540562 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-29f14402-c2d1-4c70-a96f-2988dd5583d6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:47.555181 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-29f14402-c2d1-4c70-a96f-2988dd5583d6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:47.555973 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-29f14402-c2d1-4c70-a96f-2988dd5583d6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:47.558093 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-29f14402-c2d1-4c70-a96f-2988dd5583d6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:47.558950 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-29f14402-c2d1-4c70-a96f-2988dd5583d6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:47.559807 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-29f14402-c2d1-4c70-a96f-2988dd5583d6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:47.560343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-29f14402-c2d1-4c70-a96f-2988dd5583d6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:47.583042 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-544ff47e-5385-4c7d-87f5-9bb5ed4e9fa5 tempest-QuotasTestJSON-663061568 tempest-QuotasTestJSON-663061568-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/efff9ffb899b4cd99b442231ed33725f" status: 200 len: 371 microversion: 2.1 time: 0.121596 Sep 10 11:58:47.584026 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2143/4277] 10.222.0.23 () {58 vars in 1242 bytes} [Sat Sep 10 11:58:47 2022] GET /compute/v2.1/os-quota-sets/efff9ffb899b4cd99b442231ed33725f => generated 371 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:58:47.605019 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7f2a9e4f-f3e1-42a1-ba5c-cdcb7cd8ea55 tempest-QuotasTestJSON-663061568 tempest-QuotasTestJSON-663061568-project] Calling method '.version_select at 0x7f407b55f820>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:47.692211 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7f2a9e4f-f3e1-42a1-ba5c-cdcb7cd8ea55 tempest-QuotasTestJSON-663061568 tempest-QuotasTestJSON-663061568-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/efff9ffb899b4cd99b442231ed33725f/defaults" status: 200 len: 371 microversion: 2.1 time: 0.093467 Sep 10 11:58:47.692925 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2144/4278] 10.222.0.23 () {58 vars in 1269 bytes} [Sat Sep 10 11:58:47 2022] GET /compute/v2.1/os-quota-sets/efff9ffb899b4cd99b442231ed33725f/defaults => generated 371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:58:47.703952 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cdd4915e-a381-4bb0-b5f8-eed48d46fc78 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:47.704974 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cdd4915e-a381-4bb0-b5f8-eed48d46fc78 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] [instance: c9b161da-e58a-43ac-accc-4c771baf68a4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:47.731748 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cdd4915e-a381-4bb0-b5f8-eed48d46fc78 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:47.732800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cdd4915e-a381-4bb0-b5f8-eed48d46fc78 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:47.733485 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cdd4915e-a381-4bb0-b5f8-eed48d46fc78 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:47.734944 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cdd4915e-a381-4bb0-b5f8-eed48d46fc78 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:47.735960 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cdd4915e-a381-4bb0-b5f8-eed48d46fc78 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:47.739354 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cdd4915e-a381-4bb0-b5f8-eed48d46fc78 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:47.875867 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-29f14402-c2d1-4c70-a96f-2988dd5583d6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:47.880921 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:58:47.888123 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-29f14402-c2d1-4c70-a96f-2988dd5583d6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1365 microversion: 2.1 time: 0.361214 Sep 10 11:58:47.903405 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2135/4279] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:47 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1365 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:47.908851 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ca485816-f9ab-4e54-96ef-4a0002d731d9 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:47.909586 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ca485816-f9ab-4e54-96ef-4a0002d731d9 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:47.916743 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca485816-f9ab-4e54-96ef-4a0002d731d9 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:47.917454 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca485816-f9ab-4e54-96ef-4a0002d731d9 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:47.918101 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca485816-f9ab-4e54-96ef-4a0002d731d9 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:47.919078 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca485816-f9ab-4e54-96ef-4a0002d731d9 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:47.920311 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca485816-f9ab-4e54-96ef-4a0002d731d9 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:47.920913 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca485816-f9ab-4e54-96ef-4a0002d731d9 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:47.953238 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cdd4915e-a381-4bb0-b5f8-eed48d46fc78 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd23712ff5e149d9b61ca12312587fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce08caecb8b34510a7f6fde5774b62b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:47.954281 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ca485816-f9ab-4e54-96ef-4a0002d731d9 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:58:47.963893 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cdd4915e-a381-4bb0-b5f8-eed48d46fc78 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] 10.222.0.23 "GET /compute/v2.1/servers/c9b161da-e58a-43ac-accc-4c771baf68a4" status: 200 len: 1394 microversion: 2.1 time: 0.269834 Sep 10 11:58:47.975187 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2145/4280] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:47 2022] GET /compute/v2.1/servers/c9b161da-e58a-43ac-accc-4c771baf68a4 => generated 1394 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:47.975187 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-711774e7-9d90-4c81-8e45-74e50c6c0c20 tempest-QuotasTestJSON-663061568 tempest-QuotasTestJSON-663061568-project] Calling method '.version_select at 0x7f407357eaf0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:48.066719 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ca485816-f9ab-4e54-96ef-4a0002d731d9 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "DELETE /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 204 len: 0 microversion: 2.20 time: 0.161628 Sep 10 11:58:48.071385 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2136/4281] 10.222.0.23 () {60 vars in 1280 bytes} [Sat Sep 10 11:58:47 2022] DELETE /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 11:58:48.075239 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3adf444b-f0f1-4b6a-9694-ae44abe81133 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1040661998", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "471bef66-289e-44bc-a38f-0fbd7758b454"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:58:48.075787 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-711774e7-9d90-4c81-8e45-74e50c6c0c20 tempest-QuotasTestJSON-663061568 tempest-QuotasTestJSON-663061568-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/efff9ffb899b4cd99b442231ed33725f" status: 200 len: 371 microversion: 2.1 time: 0.109135 Sep 10 11:58:48.076621 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2146/4282] 10.222.0.23 () {58 vars in 1242 bytes} [Sat Sep 10 11:58:47 2022] GET /compute/v2.1/os-quota-sets/efff9ffb899b4cd99b442231ed33725f => generated 371 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:58:48.084761 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-849ca66f-2a36-41ac-8aac-f346d693a32a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:48.086280 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-849ca66f-2a36-41ac-8aac-f346d693a32a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:48.095423 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-849ca66f-2a36-41ac-8aac-f346d693a32a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:48.096114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-849ca66f-2a36-41ac-8aac-f346d693a32a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:48.096709 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-849ca66f-2a36-41ac-8aac-f346d693a32a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:48.097506 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-849ca66f-2a36-41ac-8aac-f346d693a32a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:48.098378 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-849ca66f-2a36-41ac-8aac-f346d693a32a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:48.098972 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-849ca66f-2a36-41ac-8aac-f346d693a32a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:48.145019 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-3adf444b-f0f1-4b6a-9694-ae44abe81133 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] validate_networks() for [('471bef66-289e-44bc-a38f-0fbd7758b454', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:58:48.345603 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-849ca66f-2a36-41ac-8aac-f346d693a32a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:48.355136 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-849ca66f-2a36-41ac-8aac-f346d693a32a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4" status: 200 len: 1735 microversion: 2.1 time: 0.276809 Sep 10 11:58:48.359786 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2147/4283] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:48 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 => generated 1735 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:48.364566 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c5e3856b-cdae-48ea-a9ef-ac89e187c7a3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:48.367840 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c5e3856b-cdae-48ea-a9ef-ac89e187c7a3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:48.376425 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c5e3856b-cdae-48ea-a9ef-ac89e187c7a3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:48.376912 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c5e3856b-cdae-48ea-a9ef-ac89e187c7a3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:48.377357 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c5e3856b-cdae-48ea-a9ef-ac89e187c7a3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:48.378053 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c5e3856b-cdae-48ea-a9ef-ac89e187c7a3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:48.378506 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c5e3856b-cdae-48ea-a9ef-ac89e187c7a3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:48.378929 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c5e3856b-cdae-48ea-a9ef-ac89e187c7a3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:48.588566 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c5e3856b-cdae-48ea-a9ef-ac89e187c7a3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:48.597012 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c5e3856b-cdae-48ea-a9ef-ac89e187c7a3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:48.598590 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c5e3856b-cdae-48ea-a9ef-ac89e187c7a3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:48.599903 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c5e3856b-cdae-48ea-a9ef-ac89e187c7a3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1723 microversion: 2.20 time: 0.239083 Sep 10 11:58:48.611444 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2148/4284] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:58:48 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:58:48.611444 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-747974be-1a31-41fa-bd30-b3d5981fc9fc tempest-QuotasTestJSON-663061568 tempest-QuotasTestJSON-663061568-project] Calling method '.version_select at 0x7f4073be4160>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:48.685351 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-747974be-1a31-41fa-bd30-b3d5981fc9fc tempest-QuotasTestJSON-663061568 tempest-QuotasTestJSON-663061568-project] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/efff9ffb899b4cd99b442231ed33725f?user_id=245bf829d70e4898a985d0b4c9ff3fd8" status: 200 len: 371 microversion: 2.1 time: 0.083353 Sep 10 11:58:48.686053 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2149/4285] 10.222.0.23 () {58 vars in 1323 bytes} [Sat Sep 10 11:58:48 2022] GET /compute/v2.1/os-quota-sets/efff9ffb899b4cd99b442231ed33725f?user_id=245bf829d70e4898a985d0b4c9ff3fd8 => generated 371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:58:48.690831 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-9e58bdd7-12e6-4eaf-9e96-1f61eaeb7499 req-1999a105-d937-440c-a6db-19c274f30bbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9b161da-e58a-43ac-accc-4c771baf68a4", "tag": "4c8550eb-2e3b-44c7-b2da-c3b96f9c999a"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:58:48.696850 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-3adf444b-f0f1-4b6a-9694-ae44abe81133 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:58:48.697343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-3adf444b-f0f1-4b6a-9694-ae44abe81133 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:58:48.697886 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-3adf444b-f0f1-4b6a-9694-ae44abe81133 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:58:48.698361 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-3adf444b-f0f1-4b6a-9694-ae44abe81133 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:58:48.698896 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-3adf444b-f0f1-4b6a-9694-ae44abe81133 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:58:48.701248 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:58:48.721854 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-9e58bdd7-12e6-4eaf-9e96-1f61eaeb7499 req-1999a105-d937-440c-a6db-19c274f30bbf service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:48.722335 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-9e58bdd7-12e6-4eaf-9e96-1f61eaeb7499 req-1999a105-d937-440c-a6db-19c274f30bbf service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:48.722769 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-9e58bdd7-12e6-4eaf-9e96-1f61eaeb7499 req-1999a105-d937-440c-a6db-19c274f30bbf service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:48.729289 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3adf444b-f0f1-4b6a-9694-ae44abe81133 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:48.730054 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3adf444b-f0f1-4b6a-9694-ae44abe81133 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:48.730667 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3adf444b-f0f1-4b6a-9694-ae44abe81133 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:48.732244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3adf444b-f0f1-4b6a-9694-ae44abe81133 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:48.732884 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3adf444b-f0f1-4b6a-9694-ae44abe81133 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:48.733475 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3adf444b-f0f1-4b6a-9694-ae44abe81133 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:48.737998 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-9e58bdd7-12e6-4eaf-9e96-1f61eaeb7499 req-1999a105-d937-440c-a6db-19c274f30bbf service nova] Creating event network-changed:4c8550eb-2e3b-44c7-b2da-c3b96f9c999a for instance c9b161da-e58a-43ac-accc-4c771baf68a4 on n-h2-856895-1 Sep 10 11:58:48.746224 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-9e58bdd7-12e6-4eaf-9e96-1f61eaeb7499 req-1999a105-d937-440c-a6db-19c274f30bbf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058862 Sep 10 11:58:48.747350 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2150/4286] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:58:48.759607 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-3adf444b-f0f1-4b6a-9694-ae44abe81133 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Getting quotas for project 2f92ad05650840f6bb4c8f6134b489ca. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:58:48.765361 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-3adf444b-f0f1-4b6a-9694-ae44abe81133 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Getting quotas for user d244789bea974bd99d0f1debebabb54a and project 2f92ad05650840f6bb4c8f6134b489ca. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:58:48.783129 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3adf444b-f0f1-4b6a-9694-ae44abe81133 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:58:48.785586 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3adf444b-f0f1-4b6a-9694-ae44abe81133 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: adde25b7-c5c7-46fa-b4e9-f80a11568f3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:58:48.849886 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3adf444b-f0f1-4b6a-9694-ae44abe81133 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.780289 Sep 10 11:58:48.855618 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2137/4287] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:58:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:58:48.868333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1bc76390-9984-42c2-a999-c871a9851d07 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:48.869713 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1bc76390-9984-42c2-a999-c871a9851d07 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: adde25b7-c5c7-46fa-b4e9-f80a11568f3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:48.917095 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7abea59b-3f16-4e41-b711-875f4f56fe18 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:48.917723 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7abea59b-3f16-4e41-b711-875f4f56fe18 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:48.939136 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7abea59b-3f16-4e41-b711-875f4f56fe18 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:48.940512 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7abea59b-3f16-4e41-b711-875f4f56fe18 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:48.941136 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7abea59b-3f16-4e41-b711-875f4f56fe18 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:48.943265 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7abea59b-3f16-4e41-b711-875f4f56fe18 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:48.946620 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7abea59b-3f16-4e41-b711-875f4f56fe18 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:48.950683 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7abea59b-3f16-4e41-b711-875f4f56fe18 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:49.559905 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1bc76390-9984-42c2-a999-c871a9851d07 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:49.567940 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1bc76390-9984-42c2-a999-c871a9851d07 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c" status: 200 len: 1215 microversion: 2.1 time: 0.706292 Sep 10 11:58:49.586347 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2151/4288] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:48 2022] GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c => generated 1215 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:49.603723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-293eb9ca-955c-4fb5-81e8-f826cc3ed43b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:49.604372 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-293eb9ca-955c-4fb5-81e8-f826cc3ed43b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] [instance: c9b161da-e58a-43ac-accc-4c771baf68a4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:49.625155 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-293eb9ca-955c-4fb5-81e8-f826cc3ed43b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:49.625578 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-293eb9ca-955c-4fb5-81e8-f826cc3ed43b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:49.626040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-293eb9ca-955c-4fb5-81e8-f826cc3ed43b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:49.626741 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-293eb9ca-955c-4fb5-81e8-f826cc3ed43b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:49.627229 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-293eb9ca-955c-4fb5-81e8-f826cc3ed43b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:49.633912 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-293eb9ca-955c-4fb5-81e8-f826cc3ed43b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:49.757987 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7abea59b-3f16-4e41-b711-875f4f56fe18 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:49.776253 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7abea59b-3f16-4e41-b711-875f4f56fe18 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1553 microversion: 2.1 time: 0.864738 Sep 10 11:58:49.784801 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2138/4289] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:48 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1553 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:58:49.801113 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7769daa0-f754-4506-a42e-b6930b7f52a5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:49.802833 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7769daa0-f754-4506-a42e-b6930b7f52a5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:49.829414 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7769daa0-f754-4506-a42e-b6930b7f52a5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:49.830134 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7769daa0-f754-4506-a42e-b6930b7f52a5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:49.830663 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7769daa0-f754-4506-a42e-b6930b7f52a5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:49.832458 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7769daa0-f754-4506-a42e-b6930b7f52a5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:49.834516 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7769daa0-f754-4506-a42e-b6930b7f52a5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:49.836552 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7769daa0-f754-4506-a42e-b6930b7f52a5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:49.971627 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-293eb9ca-955c-4fb5-81e8-f826cc3ed43b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd23712ff5e149d9b61ca12312587fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce08caecb8b34510a7f6fde5774b62b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:49.983967 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-293eb9ca-955c-4fb5-81e8-f826cc3ed43b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] 10.222.0.23 "GET /compute/v2.1/servers/c9b161da-e58a-43ac-accc-4c771baf68a4" status: 200 len: 1394 microversion: 2.1 time: 0.396039 Sep 10 11:58:49.986619 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2152/4290] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:49 2022] GET /compute/v2.1/servers/c9b161da-e58a-43ac-accc-4c771baf68a4 => generated 1394 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:50.005906 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7bd6d54b-12e5-4e9e-b64e-4552e92f62c3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:50.006593 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7bd6d54b-12e5-4e9e-b64e-4552e92f62c3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:50.015484 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7bd6d54b-12e5-4e9e-b64e-4552e92f62c3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:50.016053 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7bd6d54b-12e5-4e9e-b64e-4552e92f62c3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:50.016559 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7bd6d54b-12e5-4e9e-b64e-4552e92f62c3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:50.017350 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7bd6d54b-12e5-4e9e-b64e-4552e92f62c3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:50.017820 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7bd6d54b-12e5-4e9e-b64e-4552e92f62c3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:50.018245 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7bd6d54b-12e5-4e9e-b64e-4552e92f62c3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:50.078785 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7769daa0-f754-4506-a42e-b6930b7f52a5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:50.093210 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7769daa0-f754-4506-a42e-b6930b7f52a5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4" status: 200 len: 1735 microversion: 2.1 time: 0.305402 Sep 10 11:58:50.093826 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2139/4291] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:49 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 => generated 1735 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:50.108614 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0f645651-4371-4077-acc8-fe2df814905f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:50.111236 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0f645651-4371-4077-acc8-fe2df814905f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:50.137654 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f645651-4371-4077-acc8-fe2df814905f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:50.139000 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f645651-4371-4077-acc8-fe2df814905f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:50.140255 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f645651-4371-4077-acc8-fe2df814905f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:50.142604 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f645651-4371-4077-acc8-fe2df814905f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:50.143373 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f645651-4371-4077-acc8-fe2df814905f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:50.144082 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f645651-4371-4077-acc8-fe2df814905f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:50.242663 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7bd6d54b-12e5-4e9e-b64e-4552e92f62c3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:50.277489 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7bd6d54b-12e5-4e9e-b64e-4552e92f62c3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:50.279509 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7bd6d54b-12e5-4e9e-b64e-4552e92f62c3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:50.280994 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7bd6d54b-12e5-4e9e-b64e-4552e92f62c3 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1723 microversion: 2.20 time: 0.292701 Sep 10 11:58:50.283101 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2153/4292] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:58:49 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1723 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:58:50.313399 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0f645651-4371-4077-acc8-fe2df814905f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.215798 Sep 10 11:58:50.319945 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2140/4293] 10.222.0.23 () {58 vars in 1275 bytes} [Sat Sep 10 11:58:50 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f/os-interface => generated 285 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:58:50.598394 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2fd8f4d1-53b9-4906-b6b1-47ff719b12b9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:50.600376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2fd8f4d1-53b9-4906-b6b1-47ff719b12b9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: adde25b7-c5c7-46fa-b4e9-f80a11568f3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:50.624593 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fd8f4d1-53b9-4906-b6b1-47ff719b12b9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:50.625110 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fd8f4d1-53b9-4906-b6b1-47ff719b12b9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:50.625562 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fd8f4d1-53b9-4906-b6b1-47ff719b12b9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:50.628097 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fd8f4d1-53b9-4906-b6b1-47ff719b12b9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:50.628812 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fd8f4d1-53b9-4906-b6b1-47ff719b12b9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:50.631140 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fd8f4d1-53b9-4906-b6b1-47ff719b12b9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:50.795970 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2fd8f4d1-53b9-4906-b6b1-47ff719b12b9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:50.804131 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2fd8f4d1-53b9-4906-b6b1-47ff719b12b9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c" status: 200 len: 1267 microversion: 2.1 time: 0.213692 Sep 10 11:58:50.805352 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2154/4294] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:50 2022] GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c => generated 1267 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:51.011204 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-369b9a2f-7ac3-437c-a868-99b9305eb1ce tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:51.011847 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-369b9a2f-7ac3-437c-a868-99b9305eb1ce tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] [instance: c9b161da-e58a-43ac-accc-4c771baf68a4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:51.027330 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-369b9a2f-7ac3-437c-a868-99b9305eb1ce tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:51.027832 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-369b9a2f-7ac3-437c-a868-99b9305eb1ce tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:51.028333 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-369b9a2f-7ac3-437c-a868-99b9305eb1ce tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:51.029066 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-369b9a2f-7ac3-437c-a868-99b9305eb1ce tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:51.029522 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-369b9a2f-7ac3-437c-a868-99b9305eb1ce tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:51.029951 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-369b9a2f-7ac3-437c-a868-99b9305eb1ce tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:51.121700 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-42c2bb9b-cf86-45dc-86ef-8af0c1e91e2f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:51.122325 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-42c2bb9b-cf86-45dc-86ef-8af0c1e91e2f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:51.138712 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-42c2bb9b-cf86-45dc-86ef-8af0c1e91e2f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:51.139742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-42c2bb9b-cf86-45dc-86ef-8af0c1e91e2f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:51.139742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-42c2bb9b-cf86-45dc-86ef-8af0c1e91e2f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:51.140385 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-42c2bb9b-cf86-45dc-86ef-8af0c1e91e2f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:51.140853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-42c2bb9b-cf86-45dc-86ef-8af0c1e91e2f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:51.141290 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-42c2bb9b-cf86-45dc-86ef-8af0c1e91e2f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:51.499472 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-369b9a2f-7ac3-437c-a868-99b9305eb1ce tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd23712ff5e149d9b61ca12312587fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce08caecb8b34510a7f6fde5774b62b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:51.514662 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-369b9a2f-7ac3-437c-a868-99b9305eb1ce tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] 10.222.0.23 "GET /compute/v2.1/servers/c9b161da-e58a-43ac-accc-4c771baf68a4" status: 200 len: 1394 microversion: 2.1 time: 0.508304 Sep 10 11:58:51.515680 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2141/4295] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:51 2022] GET /compute/v2.1/servers/c9b161da-e58a-43ac-accc-4c771baf68a4 => generated 1394 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:51.526268 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1f148505-46ef-442b-bfde-169d58bc84cc tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:51.527434 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1f148505-46ef-442b-bfde-169d58bc84cc tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:51.540240 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f148505-46ef-442b-bfde-169d58bc84cc tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:51.540746 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f148505-46ef-442b-bfde-169d58bc84cc tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:51.541193 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f148505-46ef-442b-bfde-169d58bc84cc tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:51.541912 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f148505-46ef-442b-bfde-169d58bc84cc tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:51.542370 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f148505-46ef-442b-bfde-169d58bc84cc tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:51.543502 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f148505-46ef-442b-bfde-169d58bc84cc tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:51.599246 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-42c2bb9b-cf86-45dc-86ef-8af0c1e91e2f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:51.613048 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-42c2bb9b-cf86-45dc-86ef-8af0c1e91e2f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4" status: 200 len: 1735 microversion: 2.1 time: 0.495037 Sep 10 11:58:51.632587 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2155/4296] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:51 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 => generated 1735 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:58:51.697386 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1f148505-46ef-442b-bfde-169d58bc84cc tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:51.708985 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1f148505-46ef-442b-bfde-169d58bc84cc tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:51.712614 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1f148505-46ef-442b-bfde-169d58bc84cc tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '20a5848b40dc4fbaa2a25a41d92d383a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66677b88ab6b436da8477f213df0ed1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:51.714094 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1f148505-46ef-442b-bfde-169d58bc84cc tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 200 len: 1656 microversion: 2.20 time: 0.195490 Sep 10 11:58:51.715100 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2142/4297] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:58:51 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 1656 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 11:58:51.829233 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7d9adcd2-fc1c-4946-94a9-dfe2ed32b2e6 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:51.830303 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7d9adcd2-fc1c-4946-94a9-dfe2ed32b2e6 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: adde25b7-c5c7-46fa-b4e9-f80a11568f3c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:51.839333 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d9adcd2-fc1c-4946-94a9-dfe2ed32b2e6 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:51.840155 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d9adcd2-fc1c-4946-94a9-dfe2ed32b2e6 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:51.840963 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d9adcd2-fc1c-4946-94a9-dfe2ed32b2e6 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:51.841870 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d9adcd2-fc1c-4946-94a9-dfe2ed32b2e6 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:51.842525 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d9adcd2-fc1c-4946-94a9-dfe2ed32b2e6 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:51.843230 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d9adcd2-fc1c-4946-94a9-dfe2ed32b2e6 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:52.146953 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7d9adcd2-fc1c-4946-94a9-dfe2ed32b2e6 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:52.162200 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7d9adcd2-fc1c-4946-94a9-dfe2ed32b2e6 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c" status: 200 len: 1273 microversion: 2.1 time: 0.337323 Sep 10 11:58:52.162805 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2143/4298] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:51 2022] GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c => generated 1273 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:52.312324 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-28dc4201-68fa-4454-a0cf-e8c85e6cf29b req-b401dae3-d355-49ea-9f7d-cb7c137d4918 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39f90b6f-123c-451f-8f7a-dbe291a5d4a7", "name": "network-vif-deleted", "tag": "c38ed82a-b2c8-4c91-b325-3aed6429f4b0"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:58:52.332791 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-28dc4201-68fa-4454-a0cf-e8c85e6cf29b req-b401dae3-d355-49ea-9f7d-cb7c137d4918 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:52.340944 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-28dc4201-68fa-4454-a0cf-e8c85e6cf29b req-b401dae3-d355-49ea-9f7d-cb7c137d4918 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:52.342364 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-28dc4201-68fa-4454-a0cf-e8c85e6cf29b req-b401dae3-d355-49ea-9f7d-cb7c137d4918 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:52.363867 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-28dc4201-68fa-4454-a0cf-e8c85e6cf29b req-b401dae3-d355-49ea-9f7d-cb7c137d4918 service nova] Creating event network-vif-deleted:c38ed82a-b2c8-4c91-b325-3aed6429f4b0 for instance 39f90b6f-123c-451f-8f7a-dbe291a5d4a7 on n-h2-856895-1 Sep 10 11:58:52.364614 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-da18ae11-29e6-4768-bbca-f6b8c2973dcd req-138352da-b43c-471f-9e61-69d9462f9e37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64704ff7-229d-478b-9889-6b6cba53bd0f", "tag": "7f6388a0-8fe7-4ee5-821e-68c4889b9594"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:58:52.370144 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-28dc4201-68fa-4454-a0cf-e8c85e6cf29b req-b401dae3-d355-49ea-9f7d-cb7c137d4918 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.564725 Sep 10 11:58:52.377091 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2156/4299] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:58:52.379270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-da18ae11-29e6-4768-bbca-f6b8c2973dcd req-138352da-b43c-471f-9e61-69d9462f9e37 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:52.380035 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-da18ae11-29e6-4768-bbca-f6b8c2973dcd req-138352da-b43c-471f-9e61-69d9462f9e37 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:52.380572 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-da18ae11-29e6-4768-bbca-f6b8c2973dcd req-138352da-b43c-471f-9e61-69d9462f9e37 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:52.396314 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-da18ae11-29e6-4768-bbca-f6b8c2973dcd req-138352da-b43c-471f-9e61-69d9462f9e37 service nova] Creating event network-changed:7f6388a0-8fe7-4ee5-821e-68c4889b9594 for instance 64704ff7-229d-478b-9889-6b6cba53bd0f on n-h1-856895-1 Sep 10 11:58:52.404818 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-da18ae11-29e6-4768-bbca-f6b8c2973dcd req-138352da-b43c-471f-9e61-69d9462f9e37 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043181 Sep 10 11:58:52.407494 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2144/4300] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:58:52.543409 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b7c82c32-ecbf-46d2-bfab-5c2e513ede3c tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:52.544342 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b7c82c32-ecbf-46d2-bfab-5c2e513ede3c tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] [instance: c9b161da-e58a-43ac-accc-4c771baf68a4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:52.566971 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b7c82c32-ecbf-46d2-bfab-5c2e513ede3c tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:52.567860 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b7c82c32-ecbf-46d2-bfab-5c2e513ede3c tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:52.568699 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b7c82c32-ecbf-46d2-bfab-5c2e513ede3c tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:52.575867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b7c82c32-ecbf-46d2-bfab-5c2e513ede3c tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:52.578901 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b7c82c32-ecbf-46d2-bfab-5c2e513ede3c tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:52.579601 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b7c82c32-ecbf-46d2-bfab-5c2e513ede3c tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:52.648033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-02361abc-223c-48e9-b4f2-e4913c791c1e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:52.649136 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-02361abc-223c-48e9-b4f2-e4913c791c1e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:52.669170 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02361abc-223c-48e9-b4f2-e4913c791c1e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:52.671545 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02361abc-223c-48e9-b4f2-e4913c791c1e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:52.680015 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02361abc-223c-48e9-b4f2-e4913c791c1e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:52.681051 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02361abc-223c-48e9-b4f2-e4913c791c1e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:52.681545 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02361abc-223c-48e9-b4f2-e4913c791c1e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:52.681983 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02361abc-223c-48e9-b4f2-e4913c791c1e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:53.259959 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b7c82c32-ecbf-46d2-bfab-5c2e513ede3c tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd23712ff5e149d9b61ca12312587fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce08caecb8b34510a7f6fde5774b62b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:53.261152 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-02361abc-223c-48e9-b4f2-e4913c791c1e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:53.274184 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-02361abc-223c-48e9-b4f2-e4913c791c1e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4" status: 200 len: 1735 microversion: 2.1 time: 0.630530 Sep 10 11:58:53.279605 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2145/4301] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:52 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 => generated 1735 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:58:53.290336 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b7c82c32-ecbf-46d2-bfab-5c2e513ede3c tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] 10.222.0.23 "GET /compute/v2.1/servers/c9b161da-e58a-43ac-accc-4c771baf68a4" status: 200 len: 1394 microversion: 2.1 time: 0.737943 Sep 10 11:58:53.294142 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2157/4302] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:52 2022] GET /compute/v2.1/servers/c9b161da-e58a-43ac-accc-4c771baf68a4 => generated 1394 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:53.303829 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5d8e10cf-634d-4d89-b983-2dbf05f9ea47 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:53.304901 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5d8e10cf-634d-4d89-b983-2dbf05f9ea47 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:53.313192 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d8e10cf-634d-4d89-b983-2dbf05f9ea47 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:53.313895 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d8e10cf-634d-4d89-b983-2dbf05f9ea47 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:53.314491 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d8e10cf-634d-4d89-b983-2dbf05f9ea47 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:53.315401 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d8e10cf-634d-4d89-b983-2dbf05f9ea47 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:53.316006 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d8e10cf-634d-4d89-b983-2dbf05f9ea47 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:53.322538 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d8e10cf-634d-4d89-b983-2dbf05f9ea47 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:53.346971 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-5d8e10cf-634d-4d89-b983-2dbf05f9ea47 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] HTTP exception thrown: Instance 39f90b6f-123c-451f-8f7a-dbe291a5d4a7 could not be found. Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5d8e10cf-634d-4d89-b983-2dbf05f9ea47 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Request method failure captured: Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 HTTP/1.1 Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHphfhbI9Qteyjy3ZlWrVlKeCpT8zQm8i7n7Sggd45WVDD9yWc9UxuAh8PXlKHgR6Xe0vr_1iqbSyYTRkcahJaDM32Pgw8B1xZdS1O2rT-cXx_-R1ejO472cgUfAfw7CmlqdNhJE1X4u5IsFou0L-G1rp0byXvcTZ2mOtxrHGfiWFEQ Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: X-Openstack-Nova-Api-Version: 2.20 Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 66677b88ab6b436da8477f213df0ed1d Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-176716713 Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/66677b88ab6b436da8477f213df0ed1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/66677b88ab6b436da8477f213df0ed1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_66677b88ab6b436da8477f213df0ed1d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/66677b88ab6b436da8477f213df0ed1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-AttachVolumeShelveTestJSON-176716713 Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 66677b88ab6b436da8477f213df0ed1d Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-176716713 Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-AttachVolumeShelveTestJSON-176716713-project Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 20a5848b40dc4fbaa2a25a41d92d383a Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-AttachVolumeShelveTestJSON-176716713-project Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 39f90b6f-123c-451f-8f7a-dbe291a5d4a7 could not be found. Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '39f90b6f-123c-451f-8f7a-dbe291a5d4a7'} Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39f90b6f-123c-451f-8f7a-dbe291a5d4a7 could not be found. Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39f90b6f-123c-451f-8f7a-dbe291a5d4a7 could not be found. Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:58:53.349517 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:58:53.356197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:58:53.356197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:58:53.356197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:58:53.356197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:58:53.356197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:58:53.356197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:58:53.356197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39f90b6f-123c-451f-8f7a-dbe291a5d4a7 could not be found. Sep 10 11:58:53.356197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:58:53.356197 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5d8e10cf-634d-4d89-b983-2dbf05f9ea47 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Returning 404 to user: Instance 39f90b6f-123c-451f-8f7a-dbe291a5d4a7 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:58:53.356197 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5d8e10cf-634d-4d89-b983-2dbf05f9ea47 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 404 len: 111 microversion: 2.20 time: 0.055731 Sep 10 11:58:53.356197 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2158/4303] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:58:53 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:58:53.364446 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9f225dbc-dad3-4eae-bdc3-dbc4b2fa5fd2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:53.365083 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9f225dbc-dad3-4eae-bdc3-dbc4b2fa5fd2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: adde25b7-c5c7-46fa-b4e9-f80a11568f3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:53.372835 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9f225dbc-dad3-4eae-bdc3-dbc4b2fa5fd2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:53.374034 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9f225dbc-dad3-4eae-bdc3-dbc4b2fa5fd2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:53.374885 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9f225dbc-dad3-4eae-bdc3-dbc4b2fa5fd2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:53.376780 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9f225dbc-dad3-4eae-bdc3-dbc4b2fa5fd2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:53.377413 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9f225dbc-dad3-4eae-bdc3-dbc4b2fa5fd2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:53.378002 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9f225dbc-dad3-4eae-bdc3-dbc4b2fa5fd2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:53.517166 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7b809bcb-4a9d-4113-ae99-41cbaf93415c tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] Action: 'create', calling method: .version_select at 0x7f40729cca60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1840765393"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:58:53.774809 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9f225dbc-dad3-4eae-bdc3-dbc4b2fa5fd2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:53.799879 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9f225dbc-dad3-4eae-bdc3-dbc4b2fa5fd2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c" status: 200 len: 1315 microversion: 2.1 time: 0.442896 Sep 10 11:58:53.813819 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2159/4304] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:53 2022] GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c => generated 1315 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:53.825563 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-39837803-74b1-4062-beeb-34a8fefaed54 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '.version_select at 0x7f4071f11670>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:53.856109 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-39837803-74b1-4062-beeb-34a8fefaed54 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2083658485" status: 204 len: 0 microversion: 2.20 time: 0.034803 Sep 10 11:58:53.857328 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2160/4305] 10.222.0.23 () {60 vars in 1262 bytes} [Sat Sep 10 11:58:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2083658485 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 11:58:54.050557 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7b809bcb-4a9d-4113-ae99-41cbaf93415c tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.769638 Sep 10 11:58:54.051951 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2146/4306] 10.222.0.23 () {60 vars in 1155 bytes} [Sat Sep 10 11:58:53 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 772 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 10 11:58:54.066665 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5dc55e02-cc15-4eb4-82bd-8841e7f31414 tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] Calling method '.version_select at 0x7f407325c9d0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:54.205186 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5dc55e02-cc15-4eb4-82bd-8841e7f31414 tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/ffb90e5a-4e5a-4c9d-b00b-b1857027cc25" status: 200 len: 345 microversion: 2.1 time: 0.142794 Sep 10 11:58:54.206276 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2161/4307] 10.222.0.23 () {58 vars in 1245 bytes} [Sat Sep 10 11:58:54 2022] GET /compute/v2.1/os-volumes/ffb90e5a-4e5a-4c9d-b00b-b1857027cc25 => generated 345 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:58:54.303453 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-91775462-8389-4767-9415-d322e0b1977d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:54.305112 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-91775462-8389-4767-9415-d322e0b1977d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:54.318624 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cd0e3b14-6a95-4370-bd98-d73f0ead323b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:54.319055 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cd0e3b14-6a95-4370-bd98-d73f0ead323b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] [instance: c9b161da-e58a-43ac-accc-4c771baf68a4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:54.323337 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-91775462-8389-4767-9415-d322e0b1977d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:54.325960 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-91775462-8389-4767-9415-d322e0b1977d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:54.326707 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-91775462-8389-4767-9415-d322e0b1977d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:54.327714 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-91775462-8389-4767-9415-d322e0b1977d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:54.332152 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-91775462-8389-4767-9415-d322e0b1977d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:54.332858 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd0e3b14-6a95-4370-bd98-d73f0ead323b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:54.333007 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-91775462-8389-4767-9415-d322e0b1977d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:54.333724 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd0e3b14-6a95-4370-bd98-d73f0ead323b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:54.334327 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd0e3b14-6a95-4370-bd98-d73f0ead323b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:54.335307 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd0e3b14-6a95-4370-bd98-d73f0ead323b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:54.335954 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd0e3b14-6a95-4370-bd98-d73f0ead323b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:54.339915 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd0e3b14-6a95-4370-bd98-d73f0ead323b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:55.115439 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cd0e3b14-6a95-4370-bd98-d73f0ead323b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd23712ff5e149d9b61ca12312587fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce08caecb8b34510a7f6fde5774b62b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:55.128414 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cd0e3b14-6a95-4370-bd98-d73f0ead323b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] 10.222.0.23 "GET /compute/v2.1/servers/c9b161da-e58a-43ac-accc-4c771baf68a4" status: 200 len: 1394 microversion: 2.1 time: 0.814248 Sep 10 11:58:55.144025 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2162/4308] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:54 2022] GET /compute/v2.1/servers/c9b161da-e58a-43ac-accc-4c771baf68a4 => generated 1394 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:55.150283 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-03f5b0e7-c036-4ce3-a0a0-186ba25191ed tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:55.153682 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-03f5b0e7-c036-4ce3-a0a0-186ba25191ed tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: adde25b7-c5c7-46fa-b4e9-f80a11568f3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:55.169772 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03f5b0e7-c036-4ce3-a0a0-186ba25191ed tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:55.170461 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03f5b0e7-c036-4ce3-a0a0-186ba25191ed tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:55.171090 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03f5b0e7-c036-4ce3-a0a0-186ba25191ed tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:55.171993 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03f5b0e7-c036-4ce3-a0a0-186ba25191ed tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:55.172611 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03f5b0e7-c036-4ce3-a0a0-186ba25191ed tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:55.173199 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03f5b0e7-c036-4ce3-a0a0-186ba25191ed tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:55.465670 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-91775462-8389-4767-9415-d322e0b1977d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:55.477843 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-91775462-8389-4767-9415-d322e0b1977d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4" status: 200 len: 1735 microversion: 2.1 time: 1.179682 Sep 10 11:58:55.488708 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2147/4309] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:54 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 => generated 1735 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:55.503210 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fb5c628a-fc9a-429d-bce3-863d199d34ac tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] Calling method '.version_select at 0x7f40724fa5e0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:55.592899 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fb5c628a-fc9a-429d-bce3-863d199d34ac tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/ffb90e5a-4e5a-4c9d-b00b-b1857027cc25" status: 200 len: 345 microversion: 2.1 time: 0.101705 Sep 10 11:58:55.593589 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2148/4310] 10.222.0.23 () {58 vars in 1245 bytes} [Sat Sep 10 11:58:55 2022] GET /compute/v2.1/os-volumes/ffb90e5a-4e5a-4c9d-b00b-b1857027cc25 => generated 345 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:58:55.648744 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-6a277fd2-355c-4b2a-b708-efa9815e8b79 req-6fc3b051-d763-485b-a64b-382888c2cd21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9b161da-e58a-43ac-accc-4c771baf68a4", "name": "network-vif-plugged", "status": "completed", "tag": "4c8550eb-2e3b-44c7-b2da-c3b96f9c999a"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:58:55.668883 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6a277fd2-355c-4b2a-b708-efa9815e8b79 req-6fc3b051-d763-485b-a64b-382888c2cd21 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:55.669527 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6a277fd2-355c-4b2a-b708-efa9815e8b79 req-6fc3b051-d763-485b-a64b-382888c2cd21 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:55.671705 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6a277fd2-355c-4b2a-b708-efa9815e8b79 req-6fc3b051-d763-485b-a64b-382888c2cd21 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:55.704778 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-6a277fd2-355c-4b2a-b708-efa9815e8b79 req-6fc3b051-d763-485b-a64b-382888c2cd21 service nova] Creating event network-vif-plugged:4c8550eb-2e3b-44c7-b2da-c3b96f9c999a for instance c9b161da-e58a-43ac-accc-4c771baf68a4 on n-h2-856895-1 Sep 10 11:58:55.722263 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-6a277fd2-355c-4b2a-b708-efa9815e8b79 req-6fc3b051-d763-485b-a64b-382888c2cd21 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077458 Sep 10 11:58:55.724460 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2149/4311] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:58:55.729271 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-03f5b0e7-c036-4ce3-a0a0-186ba25191ed tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:55.739544 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-03f5b0e7-c036-4ce3-a0a0-186ba25191ed tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c" status: 200 len: 1315 microversion: 2.1 time: 0.594101 Sep 10 11:58:55.744205 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2163/4312] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:55 2022] GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c => generated 1315 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:55.979335 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-51cfe6c0-2496-44de-916d-07e069fb63cd req-2b7775a7-6eb5-4e88-a763-65540861c09f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adde25b7-c5c7-46fa-b4e9-f80a11568f3c", "tag": "201e79e3-8180-43b6-aad5-9e08ab11e679"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:58:55.990292 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-51cfe6c0-2496-44de-916d-07e069fb63cd req-2b7775a7-6eb5-4e88-a763-65540861c09f service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:55.991814 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-51cfe6c0-2496-44de-916d-07e069fb63cd req-2b7775a7-6eb5-4e88-a763-65540861c09f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:55.992530 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-51cfe6c0-2496-44de-916d-07e069fb63cd req-2b7775a7-6eb5-4e88-a763-65540861c09f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:56.006080 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-51cfe6c0-2496-44de-916d-07e069fb63cd req-2b7775a7-6eb5-4e88-a763-65540861c09f service nova] Creating event network-changed:201e79e3-8180-43b6-aad5-9e08ab11e679 for instance adde25b7-c5c7-46fa-b4e9-f80a11568f3c on n-h2-856895-1 Sep 10 11:58:56.012586 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-51cfe6c0-2496-44de-916d-07e069fb63cd req-2b7775a7-6eb5-4e88-a763-65540861c09f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038019 Sep 10 11:58:56.013640 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2150/4313] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:58:56.157148 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a1679740-ad44-4964-afa7-500f37c683e7 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:56.158061 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a1679740-ad44-4964-afa7-500f37c683e7 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] [instance: c9b161da-e58a-43ac-accc-4c771baf68a4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:56.166000 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a1679740-ad44-4964-afa7-500f37c683e7 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:56.166775 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a1679740-ad44-4964-afa7-500f37c683e7 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:56.167238 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a1679740-ad44-4964-afa7-500f37c683e7 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:56.167936 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a1679740-ad44-4964-afa7-500f37c683e7 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:56.168515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a1679740-ad44-4964-afa7-500f37c683e7 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:56.168944 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a1679740-ad44-4964-afa7-500f37c683e7 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:56.171895 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=13,nova_cell1:DELETE=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:58:56.434261 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a1679740-ad44-4964-afa7-500f37c683e7 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd23712ff5e149d9b61ca12312587fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce08caecb8b34510a7f6fde5774b62b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:56.442313 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a1679740-ad44-4964-afa7-500f37c683e7 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] 10.222.0.23 "GET /compute/v2.1/servers/c9b161da-e58a-43ac-accc-4c771baf68a4" status: 200 len: 1394 microversion: 2.1 time: 0.290400 Sep 10 11:58:56.443307 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2164/4314] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:56 2022] GET /compute/v2.1/servers/c9b161da-e58a-43ac-accc-4c771baf68a4 => generated 1394 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:56.512167 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-140e67a4-8b6f-42a0-9a34-04fb6da04f0a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:56.513409 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-140e67a4-8b6f-42a0-9a34-04fb6da04f0a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:56.521479 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-140e67a4-8b6f-42a0-9a34-04fb6da04f0a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:56.522205 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-140e67a4-8b6f-42a0-9a34-04fb6da04f0a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:56.522924 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-140e67a4-8b6f-42a0-9a34-04fb6da04f0a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:56.523914 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-140e67a4-8b6f-42a0-9a34-04fb6da04f0a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:56.524567 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-140e67a4-8b6f-42a0-9a34-04fb6da04f0a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:56.525520 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-140e67a4-8b6f-42a0-9a34-04fb6da04f0a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:56.609055 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7acb2f70-efd9-423e-bc6e-5048e771fc68 tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] Calling method '.version_select at 0x7f407308aa60>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:56.695115 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7acb2f70-efd9-423e-bc6e-5048e771fc68 tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/ffb90e5a-4e5a-4c9d-b00b-b1857027cc25" status: 200 len: 346 microversion: 2.1 time: 0.090468 Sep 10 11:58:56.704448 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2165/4315] 10.222.0.23 () {58 vars in 1245 bytes} [Sat Sep 10 11:58:56 2022] GET /compute/v2.1/os-volumes/ffb90e5a-4e5a-4c9d-b00b-b1857027cc25 => generated 346 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:58:56.709259 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6caeeae4-0e76-4903-b099-bec141d8dc94 tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] Action: 'create', calling method: .version_select at 0x7f407b52d8b0>, body: {"snapshot": {"volume_id": "ffb90e5a-4e5a-4c9d-b00b-b1857027cc25", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-861405428"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:58:56.832907 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-140e67a4-8b6f-42a0-9a34-04fb6da04f0a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:56.842604 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-140e67a4-8b6f-42a0-9a34-04fb6da04f0a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4" status: 200 len: 1735 microversion: 2.1 time: 0.340107 Sep 10 11:58:56.845270 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2151/4316] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:56 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 => generated 1735 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:56.855790 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-52cc4a2a-8798-4f03-98f3-937b776b9dc9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:56.858930 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-52cc4a2a-8798-4f03-98f3-937b776b9dc9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: adde25b7-c5c7-46fa-b4e9-f80a11568f3c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:56.887629 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52cc4a2a-8798-4f03-98f3-937b776b9dc9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:56.888079 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52cc4a2a-8798-4f03-98f3-937b776b9dc9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:56.888599 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52cc4a2a-8798-4f03-98f3-937b776b9dc9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:56.890974 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52cc4a2a-8798-4f03-98f3-937b776b9dc9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:56.891451 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52cc4a2a-8798-4f03-98f3-937b776b9dc9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:56.892159 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52cc4a2a-8798-4f03-98f3-937b776b9dc9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:57.001892 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6caeeae4-0e76-4903-b099-bec141d8dc94 tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] 10.222.0.23 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.296287 Sep 10 11:58:57.002499 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2166/4317] 10.222.0.23 () {60 vars in 1162 bytes} [Sat Sep 10 11:58:56 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:58:57.015677 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-34e7fa8d-559f-4c6c-8dd3-6e3085be2c51 tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] Calling method '.version_select at 0x7f407322c9d0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:57.054416 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-34e7fa8d-559f-4c6c-8dd3-6e3085be2c51 tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/3b9f3110-dc1d-4559-b4ce-faba160b1561" status: 200 len: 286 microversion: 2.1 time: 0.042346 Sep 10 11:58:57.055560 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2167/4318] 10.222.0.23 () {58 vars in 1251 bytes} [Sat Sep 10 11:58:57 2022] GET /compute/v2.1/os-snapshots/3b9f3110-dc1d-4559-b4ce-faba160b1561 => generated 286 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:58:57.066835 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-758e97cc-4ba7-4336-801e-9416831729f0 tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] Calling method '.version_select at 0x7f4073be4d30>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:57.109421 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-758e97cc-4ba7-4336-801e-9416831729f0 tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.045592 Sep 10 11:58:57.112005 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2168/4319] 10.222.0.23 () {58 vars in 1140 bytes} [Sat Sep 10 11:58:57 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:58:57.123368 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ab77ed5b-2aab-4a8c-bfa0-9a490bf7c13e tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] Calling method '.version_select at 0x7f40730534c0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:57.184410 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ab77ed5b-2aab-4a8c-bfa0-9a490bf7c13e tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/3b9f3110-dc1d-4559-b4ce-faba160b1561" status: 200 len: 286 microversion: 2.1 time: 0.065627 Sep 10 11:58:57.185211 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2169/4320] 10.222.0.23 () {58 vars in 1251 bytes} [Sat Sep 10 11:58:57 2022] GET /compute/v2.1/os-snapshots/3b9f3110-dc1d-4559-b4ce-faba160b1561 => generated 286 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:58:57.223324 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-52cc4a2a-8798-4f03-98f3-937b776b9dc9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:57.233296 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-52cc4a2a-8798-4f03-98f3-937b776b9dc9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c" status: 200 len: 1315 microversion: 2.1 time: 0.383227 Sep 10 11:58:57.250671 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2152/4321] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:56 2022] GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c => generated 1315 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:57.465725 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-763a081c-3d15-4237-9e1c-94d680a83f96 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:57.466270 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-763a081c-3d15-4237-9e1c-94d680a83f96 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] [instance: c9b161da-e58a-43ac-accc-4c771baf68a4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:57.472587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-763a081c-3d15-4237-9e1c-94d680a83f96 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:57.473359 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-763a081c-3d15-4237-9e1c-94d680a83f96 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:57.474011 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-763a081c-3d15-4237-9e1c-94d680a83f96 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:57.474937 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-763a081c-3d15-4237-9e1c-94d680a83f96 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:57.475665 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-763a081c-3d15-4237-9e1c-94d680a83f96 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:57.476432 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-763a081c-3d15-4237-9e1c-94d680a83f96 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:57.663753 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-763a081c-3d15-4237-9e1c-94d680a83f96 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd23712ff5e149d9b61ca12312587fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce08caecb8b34510a7f6fde5774b62b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:57.672063 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-763a081c-3d15-4237-9e1c-94d680a83f96 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] 10.222.0.23 "GET /compute/v2.1/servers/c9b161da-e58a-43ac-accc-4c771baf68a4" status: 200 len: 1575 microversion: 2.1 time: 0.210233 Sep 10 11:58:57.672659 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2170/4322] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:57 2022] GET /compute/v2.1/servers/c9b161da-e58a-43ac-accc-4c771baf68a4 => generated 1575 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:57.696145 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-42fa862a-1d26-462c-99d0-95d702df70e7 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:57.696699 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-42fa862a-1d26-462c-99d0-95d702df70e7 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] [instance: c9b161da-e58a-43ac-accc-4c771baf68a4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:57.704112 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42fa862a-1d26-462c-99d0-95d702df70e7 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:57.704605 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42fa862a-1d26-462c-99d0-95d702df70e7 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:57.705048 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42fa862a-1d26-462c-99d0-95d702df70e7 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:57.705803 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42fa862a-1d26-462c-99d0-95d702df70e7 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:57.706265 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42fa862a-1d26-462c-99d0-95d702df70e7 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:57.706703 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42fa862a-1d26-462c-99d0-95d702df70e7 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:57.796924 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-42fa862a-1d26-462c-99d0-95d702df70e7 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] 10.222.0.23 "GET /compute/v2.1/servers/c9b161da-e58a-43ac-accc-4c771baf68a4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.105477 Sep 10 11:58:57.797611 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2153/4323] 10.222.0.23 () {58 vars in 1275 bytes} [Sat Sep 10 11:58:57 2022] GET /compute/v2.1/servers/c9b161da-e58a-43ac-accc-4c771baf68a4/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:58:57.870869 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6ac1b19c-63f4-48ab-a36b-25dc509e8158 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:57.872099 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6ac1b19c-63f4-48ab-a36b-25dc509e8158 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:57.879693 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6ac1b19c-63f4-48ab-a36b-25dc509e8158 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:57.880644 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6ac1b19c-63f4-48ab-a36b-25dc509e8158 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:57.881283 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6ac1b19c-63f4-48ab-a36b-25dc509e8158 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:57.882764 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6ac1b19c-63f4-48ab-a36b-25dc509e8158 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:57.883596 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6ac1b19c-63f4-48ab-a36b-25dc509e8158 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:57.884385 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6ac1b19c-63f4-48ab-a36b-25dc509e8158 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:58.051541 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6ac1b19c-63f4-48ab-a36b-25dc509e8158 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:58.062646 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6ac1b19c-63f4-48ab-a36b-25dc509e8158 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4" status: 200 len: 1735 microversion: 2.1 time: 0.196905 Sep 10 11:58:58.064775 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2171/4324] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:57 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 => generated 1735 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:58.199651 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ae9ae853-1eef-4441-9418-4ffbeabd89d6 tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] Calling method '.version_select at 0x7f407248e670>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:58.257728 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d6af93cc-6234-4700-b864-3dc6d01b00a4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:58.258233 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d6af93cc-6234-4700-b864-3dc6d01b00a4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: adde25b7-c5c7-46fa-b4e9-f80a11568f3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:58.261045 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ae9ae853-1eef-4441-9418-4ffbeabd89d6 tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/3b9f3110-dc1d-4559-b4ce-faba160b1561" status: 200 len: 286 microversion: 2.1 time: 0.066801 Sep 10 11:58:58.262386 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2154/4325] 10.222.0.23 () {58 vars in 1251 bytes} [Sat Sep 10 11:58:58 2022] GET /compute/v2.1/os-snapshots/3b9f3110-dc1d-4559-b4ce-faba160b1561 => generated 286 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:58:58.269901 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d6af93cc-6234-4700-b864-3dc6d01b00a4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:58.270393 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d6af93cc-6234-4700-b864-3dc6d01b00a4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:58.270831 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d6af93cc-6234-4700-b864-3dc6d01b00a4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:58.281877 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d6af93cc-6234-4700-b864-3dc6d01b00a4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:58.282431 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d6af93cc-6234-4700-b864-3dc6d01b00a4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:58.282919 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d6af93cc-6234-4700-b864-3dc6d01b00a4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:58.387864 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f2515e1b-80a7-4a5f-acc1-782a6dbcf052 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:58.388390 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f2515e1b-80a7-4a5f-acc1-782a6dbcf052 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:58.401675 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f2515e1b-80a7-4a5f-acc1-782a6dbcf052 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:58.402190 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f2515e1b-80a7-4a5f-acc1-782a6dbcf052 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:58.402637 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f2515e1b-80a7-4a5f-acc1-782a6dbcf052 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:58.406479 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f2515e1b-80a7-4a5f-acc1-782a6dbcf052 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:58.408516 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f2515e1b-80a7-4a5f-acc1-782a6dbcf052 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:58.411477 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f2515e1b-80a7-4a5f-acc1-782a6dbcf052 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:58.465130 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-f2515e1b-80a7-4a5f-acc1-782a6dbcf052 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] HTTP exception thrown: Instance 39f90b6f-123c-451f-8f7a-dbe291a5d4a7 could not be found. Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f2515e1b-80a7-4a5f-acc1-782a6dbcf052 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Request method failure captured: Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 HTTP/1.1 Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHphfhbI9Qteyjy3ZlWrVlKeCpT8zQm8i7n7Sggd45WVDD9yWc9UxuAh8PXlKHgR6Xe0vr_1iqbSyYTRkcahJaDM32Pgw8B1xZdS1O2rT-cXx_-R1ejO472cgUfAfw7CmlqdNhJE1X4u5IsFou0L-G1rp0byXvcTZ2mOtxrHGfiWFEQ Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: X-Openstack-Nova-Api-Version: 2.20 Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 66677b88ab6b436da8477f213df0ed1d Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-176716713 Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/66677b88ab6b436da8477f213df0ed1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/66677b88ab6b436da8477f213df0ed1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_66677b88ab6b436da8477f213df0ed1d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/66677b88ab6b436da8477f213df0ed1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-AttachVolumeShelveTestJSON-176716713 Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 66677b88ab6b436da8477f213df0ed1d Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-176716713 Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-AttachVolumeShelveTestJSON-176716713-project Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 20a5848b40dc4fbaa2a25a41d92d383a Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-AttachVolumeShelveTestJSON-176716713-project Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 39f90b6f-123c-451f-8f7a-dbe291a5d4a7 could not be found. Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '39f90b6f-123c-451f-8f7a-dbe291a5d4a7'} Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39f90b6f-123c-451f-8f7a-dbe291a5d4a7 could not be found. Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:58:58.467093 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:58:58.470977 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39f90b6f-123c-451f-8f7a-dbe291a5d4a7 could not be found. Sep 10 11:58:58.470977 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:58:58.470977 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:58:58.470977 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:58:58.470977 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:58:58.470977 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:58:58.470977 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:58:58.470977 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:58:58.470977 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:58:58.470977 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39f90b6f-123c-451f-8f7a-dbe291a5d4a7 could not be found. Sep 10 11:58:58.470977 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:58:58.482315 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f2515e1b-80a7-4a5f-acc1-782a6dbcf052 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Returning 404 to user: Instance 39f90b6f-123c-451f-8f7a-dbe291a5d4a7 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:58:58.498375 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f2515e1b-80a7-4a5f-acc1-782a6dbcf052 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "DELETE /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 404 len: 111 microversion: 2.20 time: 0.108686 Sep 10 11:58:58.501589 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2155/4326] 10.222.0.23 () {60 vars in 1280 bytes} [Sat Sep 10 11:58:58 2022] DELETE /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 10 11:58:58.526357 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-558cadf3-605e-4195-80d9-c7094e2079c8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:58.530890 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-558cadf3-605e-4195-80d9-c7094e2079c8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 39f90b6f-123c-451f-8f7a-dbe291a5d4a7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:58.537445 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-558cadf3-605e-4195-80d9-c7094e2079c8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:58.538368 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-558cadf3-605e-4195-80d9-c7094e2079c8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:58.539316 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-558cadf3-605e-4195-80d9-c7094e2079c8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:58.540224 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-558cadf3-605e-4195-80d9-c7094e2079c8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:58.540869 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-558cadf3-605e-4195-80d9-c7094e2079c8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:58.552706 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-558cadf3-605e-4195-80d9-c7094e2079c8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:58.561778 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d6af93cc-6234-4700-b864-3dc6d01b00a4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:58.587664 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d6af93cc-6234-4700-b864-3dc6d01b00a4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c" status: 200 len: 1315 microversion: 2.1 time: 0.330445 Sep 10 11:58:58.609055 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2172/4327] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:58 2022] GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:58.653230 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-558cadf3-605e-4195-80d9-c7094e2079c8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] HTTP exception thrown: Instance 39f90b6f-123c-451f-8f7a-dbe291a5d4a7 could not be found. Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-558cadf3-605e-4195-80d9-c7094e2079c8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Request method failure captured: Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 HTTP/1.1 Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHphfhbI9Qteyjy3ZlWrVlKeCpT8zQm8i7n7Sggd45WVDD9yWc9UxuAh8PXlKHgR6Xe0vr_1iqbSyYTRkcahJaDM32Pgw8B1xZdS1O2rT-cXx_-R1ejO472cgUfAfw7CmlqdNhJE1X4u5IsFou0L-G1rp0byXvcTZ2mOtxrHGfiWFEQ Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: X-Openstack-Nova-Api-Version: 2.20 Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 66677b88ab6b436da8477f213df0ed1d Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-176716713 Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/66677b88ab6b436da8477f213df0ed1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/66677b88ab6b436da8477f213df0ed1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_66677b88ab6b436da8477f213df0ed1d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/66677b88ab6b436da8477f213df0ed1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-AttachVolumeShelveTestJSON-176716713 Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 66677b88ab6b436da8477f213df0ed1d Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-176716713 Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-AttachVolumeShelveTestJSON-176716713-project Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 20a5848b40dc4fbaa2a25a41d92d383a Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-AttachVolumeShelveTestJSON-176716713-project Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 39f90b6f-123c-451f-8f7a-dbe291a5d4a7 could not be found. Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '39f90b6f-123c-451f-8f7a-dbe291a5d4a7'} Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39f90b6f-123c-451f-8f7a-dbe291a5d4a7 could not be found. Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39f90b6f-123c-451f-8f7a-dbe291a5d4a7 could not be found. Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:58:58.661455 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:58:58.665749 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:58:58.665749 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:58:58.665749 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:58:58.665749 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:58:58.665749 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:58:58.665749 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:58:58.665749 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39f90b6f-123c-451f-8f7a-dbe291a5d4a7 could not be found. Sep 10 11:58:58.665749 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:58:58.667534 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-558cadf3-605e-4195-80d9-c7094e2079c8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Returning 404 to user: Instance 39f90b6f-123c-451f-8f7a-dbe291a5d4a7 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:58:58.668621 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-558cadf3-605e-4195-80d9-c7094e2079c8 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7" status: 404 len: 111 microversion: 2.20 time: 0.166022 Sep 10 11:58:58.672919 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2156/4328] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:58:58 2022] GET /compute/v2.1/servers/39f90b6f-123c-451f-8f7a-dbe291a5d4a7 => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:58:59.089800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7d765cf3-acef-4161-b5d7-e4364b3d49c5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:59.090430 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7d765cf3-acef-4161-b5d7-e4364b3d49c5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:59.137957 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d765cf3-acef-4161-b5d7-e4364b3d49c5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:59.139782 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d765cf3-acef-4161-b5d7-e4364b3d49c5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:59.140333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d765cf3-acef-4161-b5d7-e4364b3d49c5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:59.146382 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d765cf3-acef-4161-b5d7-e4364b3d49c5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:59.146951 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d765cf3-acef-4161-b5d7-e4364b3d49c5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:59.148054 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d765cf3-acef-4161-b5d7-e4364b3d49c5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:59.276017 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1e8421f5-1be3-4cc7-a5cf-bdd89dc920be tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] Calling method '.version_select at 0x7f40724bbd30>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:59.295910 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=4 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:58:59.301825 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=30 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:58:59.345318 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1e8421f5-1be3-4cc7-a5cf-bdd89dc920be tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/3b9f3110-dc1d-4559-b4ce-faba160b1561" status: 200 len: 287 microversion: 2.1 time: 0.075210 Sep 10 11:58:59.346487 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2157/4329] 10.222.0.23 () {58 vars in 1251 bytes} [Sat Sep 10 11:58:59 2022] GET /compute/v2.1/os-snapshots/3b9f3110-dc1d-4559-b4ce-faba160b1561 => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:58:59.358920 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b1d445ca-4ab9-488e-ab74-5fcae2519948 tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] Calling method '.version_select at 0x7f40724ea280>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:59.430035 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7d765cf3-acef-4161-b5d7-e4364b3d49c5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:58:59.442340 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7d765cf3-acef-4161-b5d7-e4364b3d49c5 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4" status: 200 len: 1735 microversion: 2.1 time: 0.358652 Sep 10 11:58:59.443780 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2173/4330] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:59 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 => generated 1735 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:58:59.529346 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b1d445ca-4ab9-488e-ab74-5fcae2519948 tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] 10.222.0.23 "DELETE /compute/v2.1/os-snapshots/3b9f3110-dc1d-4559-b4ce-faba160b1561" status: 202 len: 0 microversion: 2.1 time: 0.174187 Sep 10 11:58:59.529911 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2158/4331] 10.222.0.23 () {58 vars in 1254 bytes} [Sat Sep 10 11:58:59 2022] DELETE /compute/v2.1/os-snapshots/3b9f3110-dc1d-4559-b4ce-faba160b1561 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 11:58:59.550331 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-844977b5-d69b-4635-b1f9-b8706b59bbd6 tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] Calling method '.version_select at 0x7f4073102700>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:59.567955 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=12 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:58:59.615198 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-844977b5-d69b-4635-b1f9-b8706b59bbd6 tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/3b9f3110-dc1d-4559-b4ce-faba160b1561" status: 200 len: 286 microversion: 2.1 time: 0.078343 Sep 10 11:58:59.615761 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2174/4332] 10.222.0.23 () {58 vars in 1251 bytes} [Sat Sep 10 11:58:59 2022] GET /compute/v2.1/os-snapshots/3b9f3110-dc1d-4559-b4ce-faba160b1561 => generated 286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:58:59.615899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0f0fec83-ae7e-498f-9881-80f473d1f47a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:59.617008 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0f0fec83-ae7e-498f-9881-80f473d1f47a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: adde25b7-c5c7-46fa-b4e9-f80a11568f3c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:59.632401 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f0fec83-ae7e-498f-9881-80f473d1f47a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:59.633278 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f0fec83-ae7e-498f-9881-80f473d1f47a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:59.637682 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f0fec83-ae7e-498f-9881-80f473d1f47a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:59.638462 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f0fec83-ae7e-498f-9881-80f473d1f47a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:59.638939 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f0fec83-ae7e-498f-9881-80f473d1f47a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:59.646002 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f0fec83-ae7e-498f-9881-80f473d1f47a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:59.857970 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5dfb6ea7-40ff-4d49-b462-dc35bb4e1b97 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:58:59.861708 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5dfb6ea7-40ff-4d49-b462-dc35bb4e1b97 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] [instance: c9b161da-e58a-43ac-accc-4c771baf68a4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:58:59.877783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5dfb6ea7-40ff-4d49-b462-dc35bb4e1b97 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:59.880426 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5dfb6ea7-40ff-4d49-b462-dc35bb4e1b97 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:59.880903 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5dfb6ea7-40ff-4d49-b462-dc35bb4e1b97 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:58:59.881758 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5dfb6ea7-40ff-4d49-b462-dc35bb4e1b97 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:58:59.885694 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5dfb6ea7-40ff-4d49-b462-dc35bb4e1b97 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:58:59.886551 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5dfb6ea7-40ff-4d49-b462-dc35bb4e1b97 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:00.128507 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0f0fec83-ae7e-498f-9881-80f473d1f47a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:00.138670 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0f0fec83-ae7e-498f-9881-80f473d1f47a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c" status: 200 len: 1315 microversion: 2.1 time: 0.527004 Sep 10 11:59:00.143516 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2159/4333] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:59 2022] GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c => generated 1315 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:59:00.163862 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-b7c34d3c-354a-4928-b87a-11fa498d0d02 req-5a3fa87b-88d2-47ef-9fdb-9be7dcd95d29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9b161da-e58a-43ac-accc-4c771baf68a4", "tag": "4c8550eb-2e3b-44c7-b2da-c3b96f9c999a"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:59:00.186514 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-b7c34d3c-354a-4928-b87a-11fa498d0d02 req-5a3fa87b-88d2-47ef-9fdb-9be7dcd95d29 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:00.187295 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-b7c34d3c-354a-4928-b87a-11fa498d0d02 req-5a3fa87b-88d2-47ef-9fdb-9be7dcd95d29 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:00.187918 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-b7c34d3c-354a-4928-b87a-11fa498d0d02 req-5a3fa87b-88d2-47ef-9fdb-9be7dcd95d29 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:00.211795 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-b7c34d3c-354a-4928-b87a-11fa498d0d02 req-5a3fa87b-88d2-47ef-9fdb-9be7dcd95d29 service nova] Creating event network-changed:4c8550eb-2e3b-44c7-b2da-c3b96f9c999a for instance c9b161da-e58a-43ac-accc-4c771baf68a4 on n-h2-856895-1 Sep 10 11:59:00.222053 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-b7c34d3c-354a-4928-b87a-11fa498d0d02 req-5a3fa87b-88d2-47ef-9fdb-9be7dcd95d29 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076963 Sep 10 11:59:00.225966 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2160/4334] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:59:00.309027 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5dfb6ea7-40ff-4d49-b462-dc35bb4e1b97 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd23712ff5e149d9b61ca12312587fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce08caecb8b34510a7f6fde5774b62b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:00.318894 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5dfb6ea7-40ff-4d49-b462-dc35bb4e1b97 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] 10.222.0.23 "GET /compute/v2.1/servers/c9b161da-e58a-43ac-accc-4c771baf68a4" status: 200 len: 1575 microversion: 2.1 time: 0.468940 Sep 10 11:59:00.320425 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2175/4335] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:58:59 2022] GET /compute/v2.1/servers/c9b161da-e58a-43ac-accc-4c771baf68a4 => generated 1575 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:59:00.472685 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f6703d00-ebda-4a41-a090-e5bd240ae309 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:00.473412 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f6703d00-ebda-4a41-a090-e5bd240ae309 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:00.490098 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f6703d00-ebda-4a41-a090-e5bd240ae309 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:00.490742 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f6703d00-ebda-4a41-a090-e5bd240ae309 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:00.491936 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f6703d00-ebda-4a41-a090-e5bd240ae309 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:00.493083 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f6703d00-ebda-4a41-a090-e5bd240ae309 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:00.493291 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f6703d00-ebda-4a41-a090-e5bd240ae309 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:00.493756 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f6703d00-ebda-4a41-a090-e5bd240ae309 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:00.498835 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:59:00.628635 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4e8f39ae-e50a-4cb2-b283-96793b789553 tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] Calling method '.version_select at 0x7f40738dac10>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:00.677518 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4e8f39ae-e50a-4cb2-b283-96793b789553 tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/3b9f3110-dc1d-4559-b4ce-faba160b1561" status: 200 len: 286 microversion: 2.1 time: 0.052726 Sep 10 11:59:00.682625 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2176/4336] 10.222.0.23 () {58 vars in 1251 bytes} [Sat Sep 10 11:59:00 2022] GET /compute/v2.1/os-snapshots/3b9f3110-dc1d-4559-b4ce-faba160b1561 => generated 286 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 11:59:00.762367 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f6703d00-ebda-4a41-a090-e5bd240ae309 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:00.770792 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f6703d00-ebda-4a41-a090-e5bd240ae309 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4" status: 200 len: 1735 microversion: 2.1 time: 0.302912 Sep 10 11:59:00.787605 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2161/4337] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:00 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 => generated 1735 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:01.171145 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-72b8a57e-740d-4360-9f4c-2df61e2a9396 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:01.171944 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-72b8a57e-740d-4360-9f4c-2df61e2a9396 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: adde25b7-c5c7-46fa-b4e9-f80a11568f3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:01.194328 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-72b8a57e-740d-4360-9f4c-2df61e2a9396 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:01.195102 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-72b8a57e-740d-4360-9f4c-2df61e2a9396 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:01.195688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-72b8a57e-740d-4360-9f4c-2df61e2a9396 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:01.196538 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-72b8a57e-740d-4360-9f4c-2df61e2a9396 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:01.197517 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-72b8a57e-740d-4360-9f4c-2df61e2a9396 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:01.199747 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-72b8a57e-740d-4360-9f4c-2df61e2a9396 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:01.464873 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-40766ece-ddf6-4920-8040-99836330d957 req-b76cfe1a-7195-4746-8af9-4f3372799c5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adde25b7-c5c7-46fa-b4e9-f80a11568f3c", "name": "network-vif-plugged", "status": "completed", "tag": "201e79e3-8180-43b6-aad5-9e08ab11e679"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:59:01.482792 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-40766ece-ddf6-4920-8040-99836330d957 req-b76cfe1a-7195-4746-8af9-4f3372799c5e service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:01.484497 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-40766ece-ddf6-4920-8040-99836330d957 req-b76cfe1a-7195-4746-8af9-4f3372799c5e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:01.485063 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-40766ece-ddf6-4920-8040-99836330d957 req-b76cfe1a-7195-4746-8af9-4f3372799c5e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:01.499116 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-40766ece-ddf6-4920-8040-99836330d957 req-b76cfe1a-7195-4746-8af9-4f3372799c5e service nova] Creating event network-vif-plugged:201e79e3-8180-43b6-aad5-9e08ab11e679 for instance adde25b7-c5c7-46fa-b4e9-f80a11568f3c on n-h2-856895-1 Sep 10 11:59:01.510901 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-40766ece-ddf6-4920-8040-99836330d957 req-b76cfe1a-7195-4746-8af9-4f3372799c5e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050156 Sep 10 11:59:01.511894 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2162/4338] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:59:01.570646 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-72b8a57e-740d-4360-9f4c-2df61e2a9396 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:01.580111 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-72b8a57e-740d-4360-9f4c-2df61e2a9396 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c" status: 200 len: 1315 microversion: 2.1 time: 0.417638 Sep 10 11:59:01.581298 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2177/4339] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:01 2022] GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c => generated 1315 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:01.691485 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-beb8c7e8-4b32-40e8-8475-df7a23c18d8d tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] Calling method '.version_select at 0x7f4072ccdaf0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:01.793836 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7653d765-c4f4-40bf-94ab-0066bd5fbb51 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:01.794476 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7653d765-c4f4-40bf-94ab-0066bd5fbb51 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:01.803495 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7653d765-c4f4-40bf-94ab-0066bd5fbb51 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:01.808223 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-beb8c7e8-4b32-40e8-8475-df7a23c18d8d tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/3b9f3110-dc1d-4559-b4ce-faba160b1561" status: 200 len: 286 microversion: 2.1 time: 0.121881 Sep 10 11:59:01.809106 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2163/4340] 10.222.0.23 () {58 vars in 1251 bytes} [Sat Sep 10 11:59:01 2022] GET /compute/v2.1/os-snapshots/3b9f3110-dc1d-4559-b4ce-faba160b1561 => generated 286 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:59:01.811001 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7653d765-c4f4-40bf-94ab-0066bd5fbb51 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:01.812547 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7653d765-c4f4-40bf-94ab-0066bd5fbb51 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:01.814665 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7653d765-c4f4-40bf-94ab-0066bd5fbb51 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:01.817723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7653d765-c4f4-40bf-94ab-0066bd5fbb51 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:01.818244 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7653d765-c4f4-40bf-94ab-0066bd5fbb51 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:02.019920 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7653d765-c4f4-40bf-94ab-0066bd5fbb51 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:02.031527 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7653d765-c4f4-40bf-94ab-0066bd5fbb51 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4" status: 200 len: 1715 microversion: 2.1 time: 0.241323 Sep 10 11:59:02.032552 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2178/4341] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:01 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 => generated 1715 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:02.158748 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-be80c2d3-6eb6-41ae-99f8-d193c7f244ea tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:02.159615 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-be80c2d3-6eb6-41ae-99f8-d193c7f244ea tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:02.169862 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-be80c2d3-6eb6-41ae-99f8-d193c7f244ea tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:02.170685 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-be80c2d3-6eb6-41ae-99f8-d193c7f244ea tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:02.171675 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-be80c2d3-6eb6-41ae-99f8-d193c7f244ea tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:02.172596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-be80c2d3-6eb6-41ae-99f8-d193c7f244ea tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:02.173239 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-be80c2d3-6eb6-41ae-99f8-d193c7f244ea tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:02.173842 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-be80c2d3-6eb6-41ae-99f8-d193c7f244ea tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:02.320217 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-be80c2d3-6eb6-41ae-99f8-d193c7f244ea tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] HTTP exception thrown: Cannot 'detach_volume' instance 74075ab0-826c-4b95-9660-e3417ec2b1f4 while it is in vm_state rescued Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-be80c2d3-6eb6-41ae-99f8-d193c7f244ea tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Request method failure captured: Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4/os-volume_attachments/740e34f5-a33d-4b3b-9cbb-e2cff5e52fad HTTP/1.1 Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHsDb9McMbZ9alVjJ4oJKA7xoa0-QA-ERuLKN-wY-xgkYgjg-f1Qkk9v6xNr7bPpAGzBceBuhySDill-chXUItw0i1842Y9FDTX_ZkXuD1aeT9HQ_-qUH7OXi222TXPS2e9y3GtImQxVIp9JaCN7mrwULBVN7FoNXkYNRF6EUEoKMAw Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 8e8bc2c6ea1946bfbbf47d63b5fa4648 Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1615383257 Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e8bc2c6ea1946bfbbf47d63b5fa4648"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e8bc2c6ea1946bfbbf47d63b5fa4648"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8e8bc2c6ea1946bfbbf47d63b5fa4648", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8e8bc2c6ea1946bfbbf47d63b5fa4648"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1615383257 Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 8e8bc2c6ea1946bfbbf47d63b5fa4648 Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1615383257 Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServerRescueNegativeTestJSON-1615383257-project Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: bddddbd6718f472e951fd87a6ec00f8d Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1615383257-project Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: exception: Cannot 'detach_volume' instance 74075ab0-826c-4b95-9660-e3417ec2b1f4 while it is in vm_state rescued Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'server_id': '74075ab0-826c-4b95-9660-e3417ec2b1f4', 'id': '740e34f5-a33d-4b3b-9cbb-e2cff5e52fad'} Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 74075ab0-826c-4b95-9660-e3417ec2b1f4 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 74075ab0-826c-4b95-9660-e3417ec2b1f4 while it is in vm_state rescued Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:02.322537 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:02.326905 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:02.326905 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:02.326905 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:59:02.326905 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:59:02.326905 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 74075ab0-826c-4b95-9660-e3417ec2b1f4 while it is in vm_state rescued Sep 10 11:59:02.326905 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:02.328133 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-be80c2d3-6eb6-41ae-99f8-d193c7f244ea tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Returning 409 to user: Cannot 'detach_volume' instance 74075ab0-826c-4b95-9660-e3417ec2b1f4 while it is in vm_state rescued {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:59:02.329137 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-be80c2d3-6eb6-41ae-99f8-d193c7f244ea tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "DELETE /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4/os-volume_attachments/740e34f5-a33d-4b3b-9cbb-e2cff5e52fad" status: 409 len: 152 microversion: 2.1 time: 0.174859 Sep 10 11:59:02.330233 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2164/4342] 10.222.0.23 () {58 vars in 1416 bytes} [Sat Sep 10 11:59:02 2022] DELETE /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4/os-volume_attachments/740e34f5-a33d-4b3b-9cbb-e2cff5e52fad => generated 152 bytes in 176 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:59:02.339899 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-46950af1-9908-4100-8e42-d3d575e7518c tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:59:02.341007 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-46950af1-9908-4100-8e42-d3d575e7518c tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:02.348288 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46950af1-9908-4100-8e42-d3d575e7518c tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:02.348968 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46950af1-9908-4100-8e42-d3d575e7518c tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:02.349567 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46950af1-9908-4100-8e42-d3d575e7518c tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:02.350606 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46950af1-9908-4100-8e42-d3d575e7518c tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:02.351440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46950af1-9908-4100-8e42-d3d575e7518c tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:02.352021 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46950af1-9908-4100-8e42-d3d575e7518c tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:02.427597 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-46950af1-9908-4100-8e42-d3d575e7518c tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "POST /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4/action" status: 202 len: 0 microversion: 2.1 time: 0.092806 Sep 10 11:59:02.429161 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2179/4343] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:59:02 2022] POST /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:59:02.437527 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6fee4ca2-3fb4-4ac7-85e0-70904443d715 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:02.438497 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6fee4ca2-3fb4-4ac7-85e0-70904443d715 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:02.447816 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6fee4ca2-3fb4-4ac7-85e0-70904443d715 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:02.448614 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6fee4ca2-3fb4-4ac7-85e0-70904443d715 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:02.449238 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6fee4ca2-3fb4-4ac7-85e0-70904443d715 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:02.450387 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6fee4ca2-3fb4-4ac7-85e0-70904443d715 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:02.451086 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6fee4ca2-3fb4-4ac7-85e0-70904443d715 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:02.451711 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6fee4ca2-3fb4-4ac7-85e0-70904443d715 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:02.607088 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fbf0f956-f782-42a5-a92e-6ba3097a364a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:02.609406 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fbf0f956-f782-42a5-a92e-6ba3097a364a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: adde25b7-c5c7-46fa-b4e9-f80a11568f3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:02.621017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fbf0f956-f782-42a5-a92e-6ba3097a364a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:02.621829 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fbf0f956-f782-42a5-a92e-6ba3097a364a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:02.622548 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fbf0f956-f782-42a5-a92e-6ba3097a364a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:02.623390 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fbf0f956-f782-42a5-a92e-6ba3097a364a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:02.623949 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fbf0f956-f782-42a5-a92e-6ba3097a364a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:02.624472 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fbf0f956-f782-42a5-a92e-6ba3097a364a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:02.771904 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6fee4ca2-3fb4-4ac7-85e0-70904443d715 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:02.787365 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6fee4ca2-3fb4-4ac7-85e0-70904443d715 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4" status: 200 len: 1723 microversion: 2.1 time: 0.354106 Sep 10 11:59:02.788334 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2165/4344] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:02 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 => generated 1723 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:59:02.824448 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c2d99c92-ea9f-45d9-8012-9d047723c2b0 tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] Calling method '.version_select at 0x7f40724ea820>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:02.864272 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-c2d99c92-ea9f-45d9-8012-9d047723c2b0 tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] HTTP exception thrown: Snapshot 3b9f3110-dc1d-4559-b4ce-faba160b1561 could not be found. Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c2d99c92-ea9f-45d9-8012-9d047723c2b0 tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] Request method failure captured: Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/os-snapshots/3b9f3110-dc1d-4559-b4ce-faba160b1561 HTTP/1.1 Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHv8fEIud5bcp1mFvqY_GZZ6YMZeZFeqjmldYxT5d6PTWt3msPfEgES92lZwwUnmqWyiHen0X6skyDC4OPUuvwYXy4sA74jycFmwrCVluwLyhRTSe1c_JzRJlPhpDJaNxvUH3lLnpNLqSG1prrPhpG5qLABx_2PS5ZBWb6PSiCK_4Kc Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: fd1ed794bd214a74afbabaeddc8e0536 Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-845138542 Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fd1ed794bd214a74afbabaeddc8e0536"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fd1ed794bd214a74afbabaeddc8e0536"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fd1ed794bd214a74afbabaeddc8e0536", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fd1ed794bd214a74afbabaeddc8e0536"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-VolumesSnapshotsTestJSON-845138542 Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: fd1ed794bd214a74afbabaeddc8e0536 Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-845138542 Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-VolumesSnapshotsTestJSON-845138542-project Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 52a9308501f64da087002e3d93a7c4b5 Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-VolumesSnapshotsTestJSON-845138542-project Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: exception: Snapshot 3b9f3110-dc1d-4559-b4ce-faba160b1561 could not be found. Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '3b9f3110-dc1d-4559-b4ce-faba160b1561'} Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 3b9f3110-dc1d-4559-b4ce-faba160b1561 could not be found. (HTTP 404) (Request-ID: req-14220d25-0fd7-4076-b045-a09ceea9c1b4) Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 10 11:59:02.871333 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 10 11:59:02.876948 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 10 11:59:02.876948 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 10 11:59:02.876948 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 10 11:59:02.876948 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 10 11:59:02.876948 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 10 11:59:02.876948 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 10 11:59:02.876948 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 11:59:02.876948 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 11:59:02.876948 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 11:59:02.876948 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 11:59:02.876948 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 11:59:02.876948 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 11:59:02.876948 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 11:59:02.876948 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 11:59:02.876948 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 3b9f3110-dc1d-4559-b4ce-faba160b1561 could not be found. Sep 10 11:59:02.876948 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:02.876948 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:02.876948 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:02.876948 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:02.876948 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:02.876948 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:02.876948 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:59:02.876948 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:59:02.876948 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:59:02.876948 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:59:02.876948 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:59:02.876948 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:59:02.876948 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 10 11:59:02.876948 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:59:02.876948 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 3b9f3110-dc1d-4559-b4ce-faba160b1561 could not be found. Sep 10 11:59:02.876948 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:02.876948 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:02.876948 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:02.876948 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:02.876948 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:02.876948 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:02.876948 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:59:02.876948 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:59:02.876948 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 3b9f3110-dc1d-4559-b4ce-faba160b1561 could not be found. Sep 10 11:59:02.876948 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:02.876948 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c2d99c92-ea9f-45d9-8012-9d047723c2b0 tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] Returning 404 to user: Snapshot 3b9f3110-dc1d-4559-b4ce-faba160b1561 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:59:02.876948 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c2d99c92-ea9f-45d9-8012-9d047723c2b0 tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/3b9f3110-dc1d-4559-b4ce-faba160b1561" status: 404 len: 111 microversion: 2.1 time: 0.059883 Sep 10 11:59:02.880467 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2166/4345] 10.222.0.23 () {58 vars in 1251 bytes} [Sat Sep 10 11:59:02 2022] GET /compute/v2.1/os-snapshots/3b9f3110-dc1d-4559-b4ce-faba160b1561 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 11:59:02.899697 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f97d73c9-730c-401a-b4f6-e882a9ce4887 tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] Calling method '.version_select at 0x7f40724cf4c0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:02.938386 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fbf0f956-f782-42a5-a92e-6ba3097a364a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:02.952162 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fbf0f956-f782-42a5-a92e-6ba3097a364a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c" status: 200 len: 1315 microversion: 2.1 time: 0.350197 Sep 10 11:59:02.964026 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2180/4346] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:02 2022] GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:59:02.998771 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f97d73c9-730c-401a-b4f6-e882a9ce4887 tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/ffb90e5a-4e5a-4c9d-b00b-b1857027cc25" status: 202 len: 0 microversion: 2.1 time: 0.116026 Sep 10 11:59:02.999746 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2167/4347] 10.222.0.23 () {58 vars in 1248 bytes} [Sat Sep 10 11:59:02 2022] DELETE /compute/v2.1/os-volumes/ffb90e5a-4e5a-4c9d-b00b-b1857027cc25 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 11:59:03.019902 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d2bb1328-a417-4109-8fa3-68129a4faccb tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] Calling method '.version_select at 0x7f40730d2e50>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:03.094145 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d2bb1328-a417-4109-8fa3-68129a4faccb tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/ffb90e5a-4e5a-4c9d-b00b-b1857027cc25" status: 200 len: 345 microversion: 2.1 time: 0.080250 Sep 10 11:59:03.094819 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2181/4348] 10.222.0.23 () {58 vars in 1245 bytes} [Sat Sep 10 11:59:03 2022] GET /compute/v2.1/os-volumes/ffb90e5a-4e5a-4c9d-b00b-b1857027cc25 => generated 345 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:59:03.253888 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0cd3e913-6cfb-446a-8ad6-8fde949cbf82 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:03.254636 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0cd3e913-6cfb-446a-8ad6-8fde949cbf82 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:03.261202 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0cd3e913-6cfb-446a-8ad6-8fde949cbf82 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:03.261924 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0cd3e913-6cfb-446a-8ad6-8fde949cbf82 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:03.262554 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0cd3e913-6cfb-446a-8ad6-8fde949cbf82 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:03.263463 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0cd3e913-6cfb-446a-8ad6-8fde949cbf82 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:03.264115 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0cd3e913-6cfb-446a-8ad6-8fde949cbf82 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:03.264735 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0cd3e913-6cfb-446a-8ad6-8fde949cbf82 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:03.279258 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-0cd3e913-6cfb-446a-8ad6-8fde949cbf82 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] HTTP exception thrown: Instance 61ab78c6-917d-46d1-b3e2-9935ca45c8e2 could not be found. Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0cd3e913-6cfb-446a-8ad6-8fde949cbf82 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Request method failure captured: Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 HTTP/1.1 Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHphfhbI9Qteyjy3ZlWrVlKeCpT8zQm8i7n7Sggd45WVDD9yWc9UxuAh8PXlKHgR6Xe0vr_1iqbSyYTRkcahJaDM32Pgw8B1xZdS1O2rT-cXx_-R1ejO472cgUfAfw7CmlqdNhJE1X4u5IsFou0L-G1rp0byXvcTZ2mOtxrHGfiWFEQ Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: X-Openstack-Nova-Api-Version: 2.20 Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 66677b88ab6b436da8477f213df0ed1d Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-176716713 Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/66677b88ab6b436da8477f213df0ed1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/66677b88ab6b436da8477f213df0ed1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_66677b88ab6b436da8477f213df0ed1d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/66677b88ab6b436da8477f213df0ed1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-AttachVolumeShelveTestJSON-176716713 Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 66677b88ab6b436da8477f213df0ed1d Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-176716713 Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-AttachVolumeShelveTestJSON-176716713-project Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 20a5848b40dc4fbaa2a25a41d92d383a Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-AttachVolumeShelveTestJSON-176716713-project Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 61ab78c6-917d-46d1-b3e2-9935ca45c8e2 could not be found. Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '61ab78c6-917d-46d1-b3e2-9935ca45c8e2'} Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61ab78c6-917d-46d1-b3e2-9935ca45c8e2 could not be found. Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:59:03.281379 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:59:03.285049 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61ab78c6-917d-46d1-b3e2-9935ca45c8e2 could not be found. Sep 10 11:59:03.285049 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:03.285049 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:03.285049 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:03.285049 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:03.285049 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:03.285049 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:03.285049 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:59:03.285049 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:59:03.285049 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61ab78c6-917d-46d1-b3e2-9935ca45c8e2 could not be found. Sep 10 11:59:03.285049 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:03.287252 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0cd3e913-6cfb-446a-8ad6-8fde949cbf82 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Returning 404 to user: Instance 61ab78c6-917d-46d1-b3e2-9935ca45c8e2 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:59:03.288951 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0cd3e913-6cfb-446a-8ad6-8fde949cbf82 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "DELETE /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 404 len: 111 microversion: 2.20 time: 0.039006 Sep 10 11:59:03.290307 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2168/4349] 10.222.0.23 () {60 vars in 1280 bytes} [Sat Sep 10 11:59:03 2022] DELETE /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:59:03.298138 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-32ed421e-1e5d-4bd5-aea2-9634e1d02487 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:03.299091 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-32ed421e-1e5d-4bd5-aea2-9634e1d02487 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] [instance: 61ab78c6-917d-46d1-b3e2-9935ca45c8e2] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:03.308603 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32ed421e-1e5d-4bd5-aea2-9634e1d02487 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:03.309379 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32ed421e-1e5d-4bd5-aea2-9634e1d02487 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:03.310189 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32ed421e-1e5d-4bd5-aea2-9634e1d02487 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:03.311410 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32ed421e-1e5d-4bd5-aea2-9634e1d02487 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:03.312061 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32ed421e-1e5d-4bd5-aea2-9634e1d02487 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:03.312680 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32ed421e-1e5d-4bd5-aea2-9634e1d02487 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:03.330016 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-32ed421e-1e5d-4bd5-aea2-9634e1d02487 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] HTTP exception thrown: Instance 61ab78c6-917d-46d1-b3e2-9935ca45c8e2 could not be found. Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-32ed421e-1e5d-4bd5-aea2-9634e1d02487 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Request method failure captured: Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 HTTP/1.1 Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHphfhbI9Qteyjy3ZlWrVlKeCpT8zQm8i7n7Sggd45WVDD9yWc9UxuAh8PXlKHgR6Xe0vr_1iqbSyYTRkcahJaDM32Pgw8B1xZdS1O2rT-cXx_-R1ejO472cgUfAfw7CmlqdNhJE1X4u5IsFou0L-G1rp0byXvcTZ2mOtxrHGfiWFEQ Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: X-Openstack-Nova-Api-Version: 2.20 Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 66677b88ab6b436da8477f213df0ed1d Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-176716713 Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/66677b88ab6b436da8477f213df0ed1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/66677b88ab6b436da8477f213df0ed1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_66677b88ab6b436da8477f213df0ed1d", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/66677b88ab6b436da8477f213df0ed1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-AttachVolumeShelveTestJSON-176716713 Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 66677b88ab6b436da8477f213df0ed1d Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-176716713 Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-AttachVolumeShelveTestJSON-176716713-project Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 20a5848b40dc4fbaa2a25a41d92d383a Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-AttachVolumeShelveTestJSON-176716713-project Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 61ab78c6-917d-46d1-b3e2-9935ca45c8e2 could not be found. Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '61ab78c6-917d-46d1-b3e2-9935ca45c8e2'} Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61ab78c6-917d-46d1-b3e2-9935ca45c8e2 could not be found. Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61ab78c6-917d-46d1-b3e2-9935ca45c8e2 could not be found. Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:03.333075 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:03.337439 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:03.337439 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:03.337439 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:03.337439 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:03.337439 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:59:03.337439 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:59:03.337439 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61ab78c6-917d-46d1-b3e2-9935ca45c8e2 could not be found. Sep 10 11:59:03.337439 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:03.340021 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-32ed421e-1e5d-4bd5-aea2-9634e1d02487 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] Returning 404 to user: Instance 61ab78c6-917d-46d1-b3e2-9935ca45c8e2 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:59:03.341945 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-32ed421e-1e5d-4bd5-aea2-9634e1d02487 tempest-AttachVolumeShelveTestJSON-176716713 tempest-AttachVolumeShelveTestJSON-176716713-project] 10.222.0.23 "GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2" status: 404 len: 111 microversion: 2.20 time: 0.047071 Sep 10 11:59:03.343410 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2182/4350] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 11:59:03 2022] GET /compute/v2.1/servers/61ab78c6-917d-46d1-b3e2-9935ca45c8e2 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:59:03.815830 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-45021b97-36a0-4efd-a7c3-e2e1a7a5264e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:03.817121 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-45021b97-36a0-4efd-a7c3-e2e1a7a5264e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:03.825708 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-45021b97-36a0-4efd-a7c3-e2e1a7a5264e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:03.826239 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-45021b97-36a0-4efd-a7c3-e2e1a7a5264e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:03.826715 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-45021b97-36a0-4efd-a7c3-e2e1a7a5264e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:03.827940 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-45021b97-36a0-4efd-a7c3-e2e1a7a5264e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:03.828637 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-45021b97-36a0-4efd-a7c3-e2e1a7a5264e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:03.829392 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-45021b97-36a0-4efd-a7c3-e2e1a7a5264e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:03.978911 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ae625060-8e0a-4bd6-85ed-3c99f619c79f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:03.980428 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ae625060-8e0a-4bd6-85ed-3c99f619c79f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: adde25b7-c5c7-46fa-b4e9-f80a11568f3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:03.987135 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae625060-8e0a-4bd6-85ed-3c99f619c79f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:03.987895 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae625060-8e0a-4bd6-85ed-3c99f619c79f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:03.988569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae625060-8e0a-4bd6-85ed-3c99f619c79f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:03.989528 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae625060-8e0a-4bd6-85ed-3c99f619c79f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:03.990207 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae625060-8e0a-4bd6-85ed-3c99f619c79f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:03.990919 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae625060-8e0a-4bd6-85ed-3c99f619c79f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:04.185342 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-45021b97-36a0-4efd-a7c3-e2e1a7a5264e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:04.195565 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-45021b97-36a0-4efd-a7c3-e2e1a7a5264e tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4" status: 200 len: 1723 microversion: 2.1 time: 0.383599 Sep 10 11:59:04.203984 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2169/4351] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:03 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 => generated 1723 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:04.210317 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6da7bcd8-cc19-46f5-b067-61641eaf350f tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] Calling method '.version_select at 0x7f40724cf3a0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:04.270916 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ae625060-8e0a-4bd6-85ed-3c99f619c79f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:04.281125 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ae625060-8e0a-4bd6-85ed-3c99f619c79f tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c" status: 200 len: 1503 microversion: 2.1 time: 0.306995 Sep 10 11:59:04.282679 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2183/4352] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:03 2022] GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c => generated 1503 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:04.309499 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a1997dd6-0ef3-4731-ad69-22d7d79e2bfc tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:59:04.316116 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6da7bcd8-cc19-46f5-b067-61641eaf350f tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/ffb90e5a-4e5a-4c9d-b00b-b1857027cc25" status: 200 len: 345 microversion: 2.1 time: 0.110849 Sep 10 11:59:04.316882 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2170/4353] 10.222.0.23 () {58 vars in 1245 bytes} [Sat Sep 10 11:59:04 2022] GET /compute/v2.1/os-volumes/ffb90e5a-4e5a-4c9d-b00b-b1857027cc25 => generated 345 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:59:04.320575 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a1997dd6-0ef3-4731-ad69-22d7d79e2bfc tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:04.321480 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a1997dd6-0ef3-4731-ad69-22d7d79e2bfc tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:04.322141 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a1997dd6-0ef3-4731-ad69-22d7d79e2bfc tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:04.371052 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a1997dd6-0ef3-4731-ad69-22d7d79e2bfc tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: adde25b7-c5c7-46fa-b4e9-f80a11568f3c] Going to try to stop instance {{(pid=128777) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 10 11:59:04.444084 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a1997dd6-0ef3-4731-ad69-22d7d79e2bfc tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "POST /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c/action" status: 202 len: 0 microversion: 2.1 time: 0.138527 Sep 10 11:59:04.445133 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2184/4354] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:59:04 2022] POST /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 11:59:04.453167 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d3916f96-2711-4dba-98bc-da2b2062c475 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:04.453791 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d3916f96-2711-4dba-98bc-da2b2062c475 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: adde25b7-c5c7-46fa-b4e9-f80a11568f3c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:04.460787 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d3916f96-2711-4dba-98bc-da2b2062c475 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:04.461406 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d3916f96-2711-4dba-98bc-da2b2062c475 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:04.461903 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d3916f96-2711-4dba-98bc-da2b2062c475 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:04.462693 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d3916f96-2711-4dba-98bc-da2b2062c475 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:04.463204 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d3916f96-2711-4dba-98bc-da2b2062c475 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:04.464003 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d3916f96-2711-4dba-98bc-da2b2062c475 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:04.659282 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d3916f96-2711-4dba-98bc-da2b2062c475 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:04.668144 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d3916f96-2711-4dba-98bc-da2b2062c475 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c" status: 200 len: 1513 microversion: 2.1 time: 0.219173 Sep 10 11:59:04.668720 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2171/4355] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:04 2022] GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c => generated 1513 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:05.232494 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-650146e9-c355-4158-8a61-c91b4d1fcaea tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:05.233383 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-650146e9-c355-4158-8a61-c91b4d1fcaea tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:05.241425 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-650146e9-c355-4158-8a61-c91b4d1fcaea tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:05.242453 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-650146e9-c355-4158-8a61-c91b4d1fcaea tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:05.243217 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-650146e9-c355-4158-8a61-c91b4d1fcaea tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:05.244144 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-650146e9-c355-4158-8a61-c91b4d1fcaea tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:05.244718 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-650146e9-c355-4158-8a61-c91b4d1fcaea tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:05.245264 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-650146e9-c355-4158-8a61-c91b4d1fcaea tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:05.330286 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d356df33-88b8-45a7-bc49-6cff18bd086a tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] Calling method '.version_select at 0x7f40724eaca0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:05.369863 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-d356df33-88b8-45a7-bc49-6cff18bd086a tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] HTTP exception thrown: Volume ffb90e5a-4e5a-4c9d-b00b-b1857027cc25 could not be found. Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d356df33-88b8-45a7-bc49-6cff18bd086a tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] Request method failure captured: Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/os-volumes/ffb90e5a-4e5a-4c9d-b00b-b1857027cc25 HTTP/1.1 Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHv8fEIud5bcp1mFvqY_GZZ6YMZeZFeqjmldYxT5d6PTWt3msPfEgES92lZwwUnmqWyiHen0X6skyDC4OPUuvwYXy4sA74jycFmwrCVluwLyhRTSe1c_JzRJlPhpDJaNxvUH3lLnpNLqSG1prrPhpG5qLABx_2PS5ZBWb6PSiCK_4Kc Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: fd1ed794bd214a74afbabaeddc8e0536 Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-845138542 Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fd1ed794bd214a74afbabaeddc8e0536"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fd1ed794bd214a74afbabaeddc8e0536"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fd1ed794bd214a74afbabaeddc8e0536", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fd1ed794bd214a74afbabaeddc8e0536"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-VolumesSnapshotsTestJSON-845138542 Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: fd1ed794bd214a74afbabaeddc8e0536 Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-845138542 Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-VolumesSnapshotsTestJSON-845138542-project Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 52a9308501f64da087002e3d93a7c4b5 Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-VolumesSnapshotsTestJSON-845138542-project Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: exception: Volume ffb90e5a-4e5a-4c9d-b00b-b1857027cc25 could not be found. Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'ffb90e5a-4e5a-4c9d-b00b-b1857027cc25'} Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ffb90e5a-4e5a-4c9d-b00b-b1857027cc25 could not be found. (HTTP 404) (Request-ID: req-893a44b1-216c-41ce-bed1-b5e2d8a9700a) Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 10 11:59:05.371866 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 11:59:05.377513 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 11:59:05.377513 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 11:59:05.377513 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 11:59:05.377513 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 11:59:05.377513 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 11:59:05.377513 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 11:59:05.377513 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 11:59:05.377513 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 11:59:05.377513 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 11:59:05.377513 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 11:59:05.377513 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 11:59:05.377513 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 11:59:05.377513 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 11:59:05.377513 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ffb90e5a-4e5a-4c9d-b00b-b1857027cc25 could not be found. Sep 10 11:59:05.377513 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:05.377513 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:05.377513 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:05.377513 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:05.377513 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:05.377513 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:05.377513 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:59:05.377513 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:59:05.377513 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:59:05.377513 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:59:05.377513 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:59:05.377513 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:59:05.377513 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 10 11:59:05.377513 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:59:05.377513 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ffb90e5a-4e5a-4c9d-b00b-b1857027cc25 could not be found. Sep 10 11:59:05.377513 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:05.377513 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:05.377513 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:05.377513 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:05.377513 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:05.377513 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:05.377513 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:59:05.377513 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:59:05.377513 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ffb90e5a-4e5a-4c9d-b00b-b1857027cc25 could not be found. Sep 10 11:59:05.377513 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:05.377513 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d356df33-88b8-45a7-bc49-6cff18bd086a tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] Returning 404 to user: Volume ffb90e5a-4e5a-4c9d-b00b-b1857027cc25 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:59:05.377513 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d356df33-88b8-45a7-bc49-6cff18bd086a tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/ffb90e5a-4e5a-4c9d-b00b-b1857027cc25" status: 404 len: 109 microversion: 2.1 time: 0.047005 Sep 10 11:59:05.383507 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2172/4356] 10.222.0.23 () {58 vars in 1245 bytes} [Sat Sep 10 11:59:05 2022] GET /compute/v2.1/os-volumes/ffb90e5a-4e5a-4c9d-b00b-b1857027cc25 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 11:59:05.387734 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a4981bcb-d37c-4fe9-ab27-0f3462e37cc1 tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] Calling method '.version_select at 0x7f40736ff940>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:05.420712 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-a4981bcb-d37c-4fe9-ab27-0f3462e37cc1 tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] HTTP exception thrown: Volume ffb90e5a-4e5a-4c9d-b00b-b1857027cc25 could not be found. Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a4981bcb-d37c-4fe9-ab27-0f3462e37cc1 tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] Request method failure captured: Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/os-volumes/ffb90e5a-4e5a-4c9d-b00b-b1857027cc25 HTTP/1.1 Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHv8fEIud5bcp1mFvqY_GZZ6YMZeZFeqjmldYxT5d6PTWt3msPfEgES92lZwwUnmqWyiHen0X6skyDC4OPUuvwYXy4sA74jycFmwrCVluwLyhRTSe1c_JzRJlPhpDJaNxvUH3lLnpNLqSG1prrPhpG5qLABx_2PS5ZBWb6PSiCK_4Kc Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: fd1ed794bd214a74afbabaeddc8e0536 Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-845138542 Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fd1ed794bd214a74afbabaeddc8e0536"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fd1ed794bd214a74afbabaeddc8e0536"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fd1ed794bd214a74afbabaeddc8e0536", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fd1ed794bd214a74afbabaeddc8e0536"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-VolumesSnapshotsTestJSON-845138542 Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: fd1ed794bd214a74afbabaeddc8e0536 Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-845138542 Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-VolumesSnapshotsTestJSON-845138542-project Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 52a9308501f64da087002e3d93a7c4b5 Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-VolumesSnapshotsTestJSON-845138542-project Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: exception: Volume ffb90e5a-4e5a-4c9d-b00b-b1857027cc25 could not be found. Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'ffb90e5a-4e5a-4c9d-b00b-b1857027cc25'} Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ffb90e5a-4e5a-4c9d-b00b-b1857027cc25 could not be found. (HTTP 404) (Request-ID: req-726adf01-b9d2-4147-a69b-c17da41f976f) Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 10 11:59:05.421923 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 11:59:05.427405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 11:59:05.427405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 10 11:59:05.427405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 10 11:59:05.427405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 10 11:59:05.427405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 10 11:59:05.427405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 10 11:59:05.427405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 10 11:59:05.427405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 10 11:59:05.427405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 10 11:59:05.427405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 11:59:05.427405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 11:59:05.427405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 11:59:05.427405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 11:59:05.427405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ffb90e5a-4e5a-4c9d-b00b-b1857027cc25 could not be found. Sep 10 11:59:05.427405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:05.427405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:05.427405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:05.427405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:05.427405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:05.427405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:05.427405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:59:05.427405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:59:05.427405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:59:05.427405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:59:05.427405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:59:05.427405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:59:05.427405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 10 11:59:05.427405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:59:05.427405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ffb90e5a-4e5a-4c9d-b00b-b1857027cc25 could not be found. Sep 10 11:59:05.427405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:05.427405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:05.427405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:05.427405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:05.427405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:05.427405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:05.427405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:59:05.427405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:59:05.427405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ffb90e5a-4e5a-4c9d-b00b-b1857027cc25 could not be found. Sep 10 11:59:05.427405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:05.434246 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a4981bcb-d37c-4fe9-ab27-0f3462e37cc1 tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] Returning 404 to user: Volume ffb90e5a-4e5a-4c9d-b00b-b1857027cc25 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:59:05.434246 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a4981bcb-d37c-4fe9-ab27-0f3462e37cc1 tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/ffb90e5a-4e5a-4c9d-b00b-b1857027cc25" status: 404 len: 109 microversion: 2.1 time: 0.046799 Sep 10 11:59:05.434246 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2173/4357] 10.222.0.23 () {58 vars in 1248 bytes} [Sat Sep 10 11:59:05 2022] DELETE /compute/v2.1/os-volumes/ffb90e5a-4e5a-4c9d-b00b-b1857027cc25 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:59:05.444726 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0517bc70-3b79-4661-921d-b3a14d79b7b8 tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] Calling method '.version_select at 0x7f40724cf670>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:05.488622 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-0517bc70-3b79-4661-921d-b3a14d79b7b8 tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] HTTP exception thrown: Volume ffb90e5a-4e5a-4c9d-b00b-b1857027cc25 could not be found. Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0517bc70-3b79-4661-921d-b3a14d79b7b8 tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] Request method failure captured: Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/os-volumes/ffb90e5a-4e5a-4c9d-b00b-b1857027cc25 HTTP/1.1 Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHv8fEIud5bcp1mFvqY_GZZ6YMZeZFeqjmldYxT5d6PTWt3msPfEgES92lZwwUnmqWyiHen0X6skyDC4OPUuvwYXy4sA74jycFmwrCVluwLyhRTSe1c_JzRJlPhpDJaNxvUH3lLnpNLqSG1prrPhpG5qLABx_2PS5ZBWb6PSiCK_4Kc Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: fd1ed794bd214a74afbabaeddc8e0536 Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-845138542 Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fd1ed794bd214a74afbabaeddc8e0536"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fd1ed794bd214a74afbabaeddc8e0536"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fd1ed794bd214a74afbabaeddc8e0536", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fd1ed794bd214a74afbabaeddc8e0536"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-VolumesSnapshotsTestJSON-845138542 Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: fd1ed794bd214a74afbabaeddc8e0536 Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-845138542 Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-VolumesSnapshotsTestJSON-845138542-project Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 52a9308501f64da087002e3d93a7c4b5 Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-VolumesSnapshotsTestJSON-845138542-project Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: exception: Volume ffb90e5a-4e5a-4c9d-b00b-b1857027cc25 could not be found. Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'ffb90e5a-4e5a-4c9d-b00b-b1857027cc25'} Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ffb90e5a-4e5a-4c9d-b00b-b1857027cc25 could not be found. (HTTP 404) (Request-ID: req-c4374938-32e1-4917-b501-1b721e6e58d2) Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 10 11:59:05.490596 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 11:59:05.494972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 11:59:05.494972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 11:59:05.494972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 11:59:05.494972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 11:59:05.494972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 11:59:05.494972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 11:59:05.494972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 11:59:05.494972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 11:59:05.494972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 11:59:05.494972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 11:59:05.494972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 11:59:05.494972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 11:59:05.494972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 11:59:05.494972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ffb90e5a-4e5a-4c9d-b00b-b1857027cc25 could not be found. Sep 10 11:59:05.494972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:05.494972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:05.494972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:05.494972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:05.494972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:05.494972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:05.494972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:59:05.494972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:59:05.494972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:59:05.494972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:59:05.494972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:59:05.494972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:59:05.494972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 10 11:59:05.494972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:59:05.494972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ffb90e5a-4e5a-4c9d-b00b-b1857027cc25 could not be found. Sep 10 11:59:05.494972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:05.494972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:05.494972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:05.494972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:05.494972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:05.494972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:05.494972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:59:05.494972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:59:05.494972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ffb90e5a-4e5a-4c9d-b00b-b1857027cc25 could not be found. Sep 10 11:59:05.494972 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:05.494972 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0517bc70-3b79-4661-921d-b3a14d79b7b8 tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] Returning 404 to user: Volume ffb90e5a-4e5a-4c9d-b00b-b1857027cc25 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:59:05.494972 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0517bc70-3b79-4661-921d-b3a14d79b7b8 tempest-VolumesSnapshotsTestJSON-845138542 tempest-VolumesSnapshotsTestJSON-845138542-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/ffb90e5a-4e5a-4c9d-b00b-b1857027cc25" status: 404 len: 109 microversion: 2.1 time: 0.052705 Sep 10 11:59:05.499723 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2174/4358] 10.222.0.23 () {58 vars in 1245 bytes} [Sat Sep 10 11:59:05 2022] GET /compute/v2.1/os-volumes/ffb90e5a-4e5a-4c9d-b00b-b1857027cc25 => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:59:05.696219 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-269dcb46-f1b8-416b-98d2-2d81afbdb9bc tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:05.697885 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-269dcb46-f1b8-416b-98d2-2d81afbdb9bc tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: adde25b7-c5c7-46fa-b4e9-f80a11568f3c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:05.708463 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-269dcb46-f1b8-416b-98d2-2d81afbdb9bc tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:05.713395 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-269dcb46-f1b8-416b-98d2-2d81afbdb9bc tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:05.714172 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-269dcb46-f1b8-416b-98d2-2d81afbdb9bc tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:05.715663 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-269dcb46-f1b8-416b-98d2-2d81afbdb9bc tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:05.721710 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-269dcb46-f1b8-416b-98d2-2d81afbdb9bc tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:05.722801 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-269dcb46-f1b8-416b-98d2-2d81afbdb9bc tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:05.988522 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-650146e9-c355-4158-8a61-c91b4d1fcaea tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:05.999375 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-650146e9-c355-4158-8a61-c91b4d1fcaea tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4" status: 200 len: 1723 microversion: 2.1 time: 0.771384 Sep 10 11:59:06.017012 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2185/4359] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:05 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 => generated 1723 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:06.244944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-269dcb46-f1b8-416b-98d2-2d81afbdb9bc tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:06.254432 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-269dcb46-f1b8-416b-98d2-2d81afbdb9bc tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c" status: 200 len: 1513 microversion: 2.1 time: 0.564666 Sep 10 11:59:06.255235 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2175/4360] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:05 2022] GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c => generated 1513 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:59:07.034562 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d8ac3267-2155-42af-9695-884d928f7212 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:07.035260 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d8ac3267-2155-42af-9695-884d928f7212 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:07.041954 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d8ac3267-2155-42af-9695-884d928f7212 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:07.042439 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d8ac3267-2155-42af-9695-884d928f7212 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:07.042875 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d8ac3267-2155-42af-9695-884d928f7212 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:07.043642 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d8ac3267-2155-42af-9695-884d928f7212 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:07.044099 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d8ac3267-2155-42af-9695-884d928f7212 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:07.044525 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d8ac3267-2155-42af-9695-884d928f7212 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:07.280720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6870d8f3-ff3b-4ac1-9ba7-098a4ac30557 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:07.282081 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6870d8f3-ff3b-4ac1-9ba7-098a4ac30557 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: adde25b7-c5c7-46fa-b4e9-f80a11568f3c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:07.291851 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6870d8f3-ff3b-4ac1-9ba7-098a4ac30557 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:07.292447 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6870d8f3-ff3b-4ac1-9ba7-098a4ac30557 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:07.293008 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6870d8f3-ff3b-4ac1-9ba7-098a4ac30557 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:07.293815 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6870d8f3-ff3b-4ac1-9ba7-098a4ac30557 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:07.294435 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6870d8f3-ff3b-4ac1-9ba7-098a4ac30557 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:07.294965 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6870d8f3-ff3b-4ac1-9ba7-098a4ac30557 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:07.305111 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d8ac3267-2155-42af-9695-884d928f7212 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:07.318065 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d8ac3267-2155-42af-9695-884d928f7212 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4" status: 200 len: 1729 microversion: 2.1 time: 0.297643 Sep 10 11:59:07.318658 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2186/4361] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:07 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 => generated 1729 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:07.348183 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e8a7eebe-506e-48ca-a70f-bc8c06949a0d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:07.349218 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e8a7eebe-506e-48ca-a70f-bc8c06949a0d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:07.356171 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e8a7eebe-506e-48ca-a70f-bc8c06949a0d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:07.356951 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e8a7eebe-506e-48ca-a70f-bc8c06949a0d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:07.357568 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e8a7eebe-506e-48ca-a70f-bc8c06949a0d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:07.358439 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e8a7eebe-506e-48ca-a70f-bc8c06949a0d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:07.359064 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e8a7eebe-506e-48ca-a70f-bc8c06949a0d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:07.359726 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e8a7eebe-506e-48ca-a70f-bc8c06949a0d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:07.377431 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:59:07.547974 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e8a7eebe-506e-48ca-a70f-bc8c06949a0d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.204541 Sep 10 11:59:07.549045 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2187/4362] 10.222.0.23 () {58 vars in 1275 bytes} [Sat Sep 10 11:59:07 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4/os-interface => generated 284 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:59:07.637075 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6870d8f3-ff3b-4ac1-9ba7-098a4ac30557 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:07.647485 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6870d8f3-ff3b-4ac1-9ba7-098a4ac30557 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c" status: 200 len: 1513 microversion: 2.1 time: 0.372446 Sep 10 11:59:07.648553 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2176/4363] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:07 2022] GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c => generated 1513 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:08.672519 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cc7e592a-b9e0-4874-9598-9e7c7367c9ba tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:08.673467 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cc7e592a-b9e0-4874-9598-9e7c7367c9ba tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: adde25b7-c5c7-46fa-b4e9-f80a11568f3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:08.675550 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:59:08.702014 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc7e592a-b9e0-4874-9598-9e7c7367c9ba tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:08.703864 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc7e592a-b9e0-4874-9598-9e7c7367c9ba tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:08.706753 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc7e592a-b9e0-4874-9598-9e7c7367c9ba tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:08.708790 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc7e592a-b9e0-4874-9598-9e7c7367c9ba tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:08.710304 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc7e592a-b9e0-4874-9598-9e7c7367c9ba tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:08.713622 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc7e592a-b9e0-4874-9598-9e7c7367c9ba tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:09.146607 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cc7e592a-b9e0-4874-9598-9e7c7367c9ba tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:09.157447 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cc7e592a-b9e0-4874-9598-9e7c7367c9ba tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c" status: 200 len: 1513 microversion: 2.1 time: 0.490275 Sep 10 11:59:09.158738 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2188/4364] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:08 2022] GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c => generated 1513 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:09.344716 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-2e2114a4-16f2-4b10-ac1d-83dfbeb2d9b6 req-3149378e-c7e3-4709-b872-a3c50d674f8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74075ab0-826c-4b95-9660-e3417ec2b1f4", "tag": "d09e77fe-182b-48f1-88a4-905829b41a74"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:59:09.368026 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-2e2114a4-16f2-4b10-ac1d-83dfbeb2d9b6 req-3149378e-c7e3-4709-b872-a3c50d674f8c service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:09.368698 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-2e2114a4-16f2-4b10-ac1d-83dfbeb2d9b6 req-3149378e-c7e3-4709-b872-a3c50d674f8c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:09.369734 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-2e2114a4-16f2-4b10-ac1d-83dfbeb2d9b6 req-3149378e-c7e3-4709-b872-a3c50d674f8c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:09.403486 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-2e2114a4-16f2-4b10-ac1d-83dfbeb2d9b6 req-3149378e-c7e3-4709-b872-a3c50d674f8c service nova] Creating event network-changed:d09e77fe-182b-48f1-88a4-905829b41a74 for instance 74075ab0-826c-4b95-9660-e3417ec2b1f4 on n-h1-856895-1 Sep 10 11:59:09.410194 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-2e2114a4-16f2-4b10-ac1d-83dfbeb2d9b6 req-3149378e-c7e3-4709-b872-a3c50d674f8c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070865 Sep 10 11:59:09.413282 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2177/4365] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:59:10.184387 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9da8f3fe-cf37-47ad-b218-bac7bdd2ff8e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:10.185670 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9da8f3fe-cf37-47ad-b218-bac7bdd2ff8e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: adde25b7-c5c7-46fa-b4e9-f80a11568f3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:10.198448 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9da8f3fe-cf37-47ad-b218-bac7bdd2ff8e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:10.200295 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9da8f3fe-cf37-47ad-b218-bac7bdd2ff8e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:10.200980 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9da8f3fe-cf37-47ad-b218-bac7bdd2ff8e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:10.201962 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9da8f3fe-cf37-47ad-b218-bac7bdd2ff8e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:10.202635 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9da8f3fe-cf37-47ad-b218-bac7bdd2ff8e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:10.204100 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9da8f3fe-cf37-47ad-b218-bac7bdd2ff8e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:10.579115 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9da8f3fe-cf37-47ad-b218-bac7bdd2ff8e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:10.592675 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9da8f3fe-cf37-47ad-b218-bac7bdd2ff8e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c" status: 200 len: 1513 microversion: 2.1 time: 0.412198 Sep 10 11:59:10.595434 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2189/4366] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:10 2022] GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c => generated 1513 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:11.436387 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-7de1ed2d-e472-4739-a18f-e343597209bb req-0753f6b7-15ae-42b1-af32-f31e89701c33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74075ab0-826c-4b95-9660-e3417ec2b1f4", "tag": "d09e77fe-182b-48f1-88a4-905829b41a74"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:59:11.449821 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-7de1ed2d-e472-4739-a18f-e343597209bb req-0753f6b7-15ae-42b1-af32-f31e89701c33 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:11.450543 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-7de1ed2d-e472-4739-a18f-e343597209bb req-0753f6b7-15ae-42b1-af32-f31e89701c33 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:11.451510 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-7de1ed2d-e472-4739-a18f-e343597209bb req-0753f6b7-15ae-42b1-af32-f31e89701c33 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:11.476877 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-7de1ed2d-e472-4739-a18f-e343597209bb req-0753f6b7-15ae-42b1-af32-f31e89701c33 service nova] Creating event network-changed:d09e77fe-182b-48f1-88a4-905829b41a74 for instance 74075ab0-826c-4b95-9660-e3417ec2b1f4 on n-h1-856895-1 Sep 10 11:59:11.484217 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-7de1ed2d-e472-4739-a18f-e343597209bb req-0753f6b7-15ae-42b1-af32-f31e89701c33 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053777 Sep 10 11:59:11.488992 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2178/4367] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:59:11.622358 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6233711f-3bfb-4ca7-9a86-fe3cae75cbcc tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:11.623460 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6233711f-3bfb-4ca7-9a86-fe3cae75cbcc tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: adde25b7-c5c7-46fa-b4e9-f80a11568f3c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:11.632466 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6233711f-3bfb-4ca7-9a86-fe3cae75cbcc tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:11.633317 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6233711f-3bfb-4ca7-9a86-fe3cae75cbcc tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:11.633832 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6233711f-3bfb-4ca7-9a86-fe3cae75cbcc tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:11.634682 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6233711f-3bfb-4ca7-9a86-fe3cae75cbcc tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:11.635259 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6233711f-3bfb-4ca7-9a86-fe3cae75cbcc tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:11.635682 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6233711f-3bfb-4ca7-9a86-fe3cae75cbcc tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:11.778985 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-15974ff2-672e-4021-959d-160d61f4cf89 tempest-VolumesNegativeTest-309943525 tempest-VolumesNegativeTest-309943525-project] Action: 'create', calling method: .version_select at 0x7f4073244670>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1633825917", "metadata": {"Type": "work"}}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-15974ff2-672e-4021-959d-160d61f4cf89 tempest-VolumesNegativeTest-309943525 tempest-VolumesNegativeTest-309943525-project] Request method failure captured: Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 122 Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHwPQy-imcbB97IGfHqMLpL1VCREmikwWkcskXVnkavmbopTSXmsz6IXVXEjLU-xskTWmVZ02qFpFx3Zrcz3p3rYaII5elN45WUAg_vaoCFDGu0o9jMjgRBSYNDjDMnLATnCamg0RCA0Lo6OLVgtFXxZ456e0460CtbddpL9052bcpo Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: f8d95b15d0794376b785583c5f7d0f91 Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-VolumesNegativeTest-309943525 Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f8d95b15d0794376b785583c5f7d0f91"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f8d95b15d0794376b785583c5f7d0f91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f8d95b15d0794376b785583c5f7d0f91", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f8d95b15d0794376b785583c5f7d0f91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-VolumesNegativeTest-309943525 Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: f8d95b15d0794376b785583c5f7d0f91 Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-VolumesNegativeTest-309943525 Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-VolumesNegativeTest-309943525-project Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 700b0df5afac467bb51bd8785611a62e Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-VolumesNegativeTest-309943525-project Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1633825917", "metadata": {"Type": "work"}}} Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1633825917', 'metadata': {'Type': 'work'}}}} Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise error Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi '#$%' Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 11:59:11.784242 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 11:59:11.790185 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 10 11:59:11.790185 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:11.790185 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:11.790185 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:11.790185 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:11.790185 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:11.790185 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:11.790185 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 11:59:11.790185 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 11:59:11.790185 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 10 11:59:11.790185 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:11.793723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-15974ff2-672e-4021-959d-160d61f4cf89 tempest-VolumesNegativeTest-309943525 tempest-VolumesNegativeTest-309943525-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:59:11.794615 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-15974ff2-672e-4021-959d-160d61f4cf89 tempest-VolumesNegativeTest-309943525 tempest-VolumesNegativeTest-309943525-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.195854 Sep 10 11:59:11.795250 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2190/4368] 10.222.0.23 () {60 vars in 1156 bytes} [Sat Sep 10 11:59:11 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 197 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:59:11.809219 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-aefd0789-ed12-49e8-8d7b-e391ce498b72 tempest-VolumesNegativeTest-309943525 tempest-VolumesNegativeTest-309943525-project] Action: 'create', calling method: .version_select at 0x7f407310b670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-676727249", "metadata": {"Type": "work"}}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-aefd0789-ed12-49e8-8d7b-e391ce498b72 tempest-VolumesNegativeTest-309943525 tempest-VolumesNegativeTest-309943525-project] Request method failure captured: Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 119 Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHwPQy-imcbB97IGfHqMLpL1VCREmikwWkcskXVnkavmbopTSXmsz6IXVXEjLU-xskTWmVZ02qFpFx3Zrcz3p3rYaII5elN45WUAg_vaoCFDGu0o9jMjgRBSYNDjDMnLATnCamg0RCA0Lo6OLVgtFXxZ456e0460CtbddpL9052bcpo Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: f8d95b15d0794376b785583c5f7d0f91 Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-VolumesNegativeTest-309943525 Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f8d95b15d0794376b785583c5f7d0f91"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f8d95b15d0794376b785583c5f7d0f91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f8d95b15d0794376b785583c5f7d0f91", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f8d95b15d0794376b785583c5f7d0f91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-VolumesNegativeTest-309943525 Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: f8d95b15d0794376b785583c5f7d0f91 Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-VolumesNegativeTest-309943525 Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-VolumesNegativeTest-309943525-project Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 700b0df5afac467bb51bd8785611a62e Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-VolumesNegativeTest-309943525-project Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-676727249", "metadata": {"Type": "work"}}} Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-676727249', 'metadata': {'Type': 'work'}}}} Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise error Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi '0' Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 11:59:11.827715 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 11:59:11.831701 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 10 11:59:11.831701 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:11.831701 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:11.831701 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:11.831701 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:11.831701 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:11.831701 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:11.831701 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 11:59:11.831701 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 11:59:11.831701 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 10 11:59:11.831701 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:11.835631 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-aefd0789-ed12-49e8-8d7b-e391ce498b72 tempest-VolumesNegativeTest-309943525 tempest-VolumesNegativeTest-309943525-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:59:11.842773 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-aefd0789-ed12-49e8-8d7b-e391ce498b72 tempest-VolumesNegativeTest-309943525 tempest-VolumesNegativeTest-309943525-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.035580 Sep 10 11:59:11.849155 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2191/4369] 10.222.0.23 () {60 vars in 1156 bytes} [Sat Sep 10 11:59:11 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:59:11.862658 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b84fa3dd-88d2-44b6-b071-11a772ece743 tempest-VolumesNegativeTest-309943525 tempest-VolumesNegativeTest-309943525-project] Action: 'create', calling method: .version_select at 0x7f4072550af0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1875359794", "metadata": {"Type": "work"}}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b84fa3dd-88d2-44b6-b071-11a772ece743 tempest-VolumesNegativeTest-309943525 tempest-VolumesNegativeTest-309943525-project] Request method failure captured: Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 119 Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHwPQy-imcbB97IGfHqMLpL1VCREmikwWkcskXVnkavmbopTSXmsz6IXVXEjLU-xskTWmVZ02qFpFx3Zrcz3p3rYaII5elN45WUAg_vaoCFDGu0o9jMjgRBSYNDjDMnLATnCamg0RCA0Lo6OLVgtFXxZ456e0460CtbddpL9052bcpo Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: f8d95b15d0794376b785583c5f7d0f91 Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-VolumesNegativeTest-309943525 Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f8d95b15d0794376b785583c5f7d0f91"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f8d95b15d0794376b785583c5f7d0f91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f8d95b15d0794376b785583c5f7d0f91", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f8d95b15d0794376b785583c5f7d0f91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-VolumesNegativeTest-309943525 Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: f8d95b15d0794376b785583c5f7d0f91 Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-VolumesNegativeTest-309943525 Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-VolumesNegativeTest-309943525-project Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 700b0df5afac467bb51bd8785611a62e Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-VolumesNegativeTest-309943525-project Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1875359794", "metadata": {"Type": "work"}}} Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1875359794', 'metadata': {'Type': 'work'}}}} Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise error Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi '' Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 11:59:11.874558 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 11:59:11.887563 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 10 11:59:11.887563 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:11.887563 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:11.887563 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:11.887563 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:11.887563 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:11.887563 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:11.887563 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 11:59:11.887563 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 11:59:11.887563 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 10 11:59:11.887563 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:11.887563 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b84fa3dd-88d2-44b6-b071-11a772ece743 tempest-VolumesNegativeTest-309943525 tempest-VolumesNegativeTest-309943525-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:59:11.887563 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b84fa3dd-88d2-44b6-b071-11a772ece743 tempest-VolumesNegativeTest-309943525 tempest-VolumesNegativeTest-309943525-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.026335 Sep 10 11:59:11.887563 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2192/4370] 10.222.0.23 () {60 vars in 1156 bytes} [Sat Sep 10 11:59:11 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 11:59:11.901951 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6726568e-fd3b-4ef6-ba53-5f46f8e265a9 tempest-VolumesNegativeTest-309943525 tempest-VolumesNegativeTest-309943525-project] Calling method '.version_select at 0x7f407352fb80>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:11.962693 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-6726568e-fd3b-4ef6-ba53-5f46f8e265a9 tempest-VolumesNegativeTest-309943525 tempest-VolumesNegativeTest-309943525-project] HTTP exception thrown: Volume tempest-invalid-614451795 could not be found. Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6726568e-fd3b-4ef6-ba53-5f46f8e265a9 tempest-VolumesNegativeTest-309943525 tempest-VolumesNegativeTest-309943525-project] Request method failure captured: Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-614451795 HTTP/1.1 Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHwPQy-imcbB97IGfHqMLpL1VCREmikwWkcskXVnkavmbopTSXmsz6IXVXEjLU-xskTWmVZ02qFpFx3Zrcz3p3rYaII5elN45WUAg_vaoCFDGu0o9jMjgRBSYNDjDMnLATnCamg0RCA0Lo6OLVgtFXxZ456e0460CtbddpL9052bcpo Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: f8d95b15d0794376b785583c5f7d0f91 Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-VolumesNegativeTest-309943525 Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f8d95b15d0794376b785583c5f7d0f91"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f8d95b15d0794376b785583c5f7d0f91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f8d95b15d0794376b785583c5f7d0f91", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f8d95b15d0794376b785583c5f7d0f91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-VolumesNegativeTest-309943525 Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: f8d95b15d0794376b785583c5f7d0f91 Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-VolumesNegativeTest-309943525 Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-VolumesNegativeTest-309943525-project Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 700b0df5afac467bb51bd8785611a62e Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-VolumesNegativeTest-309943525-project Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: exception: Volume tempest-invalid-614451795 could not be found. Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'tempest-invalid-614451795'} Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-614451795 could not be found. (HTTP 404) (Request-ID: req-2f4d909a-71ac-48b0-9eaa-fc1ba9bcded6) Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 11:59:11.967614 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 11:59:11.972379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 10 11:59:11.972379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 10 11:59:11.972379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 10 11:59:11.972379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 10 11:59:11.972379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 10 11:59:11.972379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 10 11:59:11.972379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 10 11:59:11.972379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 10 11:59:11.972379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 11:59:11.972379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 11:59:11.972379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 11:59:11.972379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 11:59:11.972379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-614451795 could not be found. Sep 10 11:59:11.972379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:11.972379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:11.972379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:11.972379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:11.972379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:11.972379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:11.972379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:59:11.972379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:59:11.972379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:59:11.972379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:59:11.972379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:59:11.972379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:59:11.972379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 10 11:59:11.972379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:59:11.972379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-614451795 could not be found. Sep 10 11:59:11.972379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:11.972379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:11.972379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:11.972379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:11.972379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:11.972379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:11.972379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:59:11.972379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:59:11.972379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-614451795 could not be found. Sep 10 11:59:11.972379 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:11.972379 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6726568e-fd3b-4ef6-ba53-5f46f8e265a9 tempest-VolumesNegativeTest-309943525 tempest-VolumesNegativeTest-309943525-project] Returning 404 to user: Volume tempest-invalid-614451795 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:59:11.972379 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6726568e-fd3b-4ef6-ba53-5f46f8e265a9 tempest-VolumesNegativeTest-309943525 tempest-VolumesNegativeTest-309943525-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/tempest-invalid-614451795" status: 404 len: 98 microversion: 2.1 time: 0.079720 Sep 10 11:59:11.972379 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2193/4371] 10.222.0.23 () {58 vars in 1215 bytes} [Sat Sep 10 11:59:11 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-614451795 => generated 98 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 11:59:11.981647 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9aa64a1c-2967-4f4c-8b36-9299c856d37c tempest-VolumesNegativeTest-309943525 tempest-VolumesNegativeTest-309943525-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004454 Sep 10 11:59:11.982004 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2194/4372] 10.222.0.23 () {58 vars in 1140 bytes} [Sat Sep 10 11:59:11 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 10 11:59:12.001204 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1116ac8e-38df-4d5a-bf18-68e72dd228c6 tempest-VolumesNegativeTest-309943525 tempest-VolumesNegativeTest-309943525-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.013833 Sep 10 11:59:12.002128 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2195/4373] 10.222.0.23 () {58 vars in 1137 bytes} [Sat Sep 10 11:59:11 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 10 11:59:12.012314 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f02439bd-8b4a-4484-97be-0d17858280c5 tempest-VolumesNegativeTest-309943525 tempest-VolumesNegativeTest-309943525-project] Calling method '.version_select at 0x7f4072631f70>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:12.042339 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6233711f-3bfb-4ca7-9a86-fe3cae75cbcc tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:12.048418 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-f02439bd-8b4a-4484-97be-0d17858280c5 tempest-VolumesNegativeTest-309943525 tempest-VolumesNegativeTest-309943525-project] HTTP exception thrown: Volume a2440bb0-2d4d-428d-962a-59cc25350a5d could not be found. Sep 10 11:59:12.050454 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6233711f-3bfb-4ca7-9a86-fe3cae75cbcc tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c" status: 200 len: 1513 microversion: 2.1 time: 0.432493 Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f02439bd-8b4a-4484-97be-0d17858280c5 tempest-VolumesNegativeTest-309943525 tempest-VolumesNegativeTest-309943525-project] Request method failure captured: Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/os-volumes/a2440bb0-2d4d-428d-962a-59cc25350a5d HTTP/1.1 Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHwPQy-imcbB97IGfHqMLpL1VCREmikwWkcskXVnkavmbopTSXmsz6IXVXEjLU-xskTWmVZ02qFpFx3Zrcz3p3rYaII5elN45WUAg_vaoCFDGu0o9jMjgRBSYNDjDMnLATnCamg0RCA0Lo6OLVgtFXxZ456e0460CtbddpL9052bcpo Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: f8d95b15d0794376b785583c5f7d0f91 Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-VolumesNegativeTest-309943525 Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f8d95b15d0794376b785583c5f7d0f91"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f8d95b15d0794376b785583c5f7d0f91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f8d95b15d0794376b785583c5f7d0f91", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f8d95b15d0794376b785583c5f7d0f91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-VolumesNegativeTest-309943525 Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: f8d95b15d0794376b785583c5f7d0f91 Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-VolumesNegativeTest-309943525 Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-VolumesNegativeTest-309943525-project Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 700b0df5afac467bb51bd8785611a62e Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-VolumesNegativeTest-309943525-project Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: exception: Volume a2440bb0-2d4d-428d-962a-59cc25350a5d could not be found. Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'a2440bb0-2d4d-428d-962a-59cc25350a5d'} Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a2440bb0-2d4d-428d-962a-59cc25350a5d could not be found. (HTTP 404) (Request-ID: req-cd367de3-5d1e-45cb-94f3-20ec854f1b8f) Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 10 11:59:12.051067 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 11:59:12.055523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 11:59:12.055523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 10 11:59:12.055523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 10 11:59:12.055523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 10 11:59:12.055523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 10 11:59:12.055523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 10 11:59:12.055523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 10 11:59:12.055523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 10 11:59:12.055523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 10 11:59:12.055523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 11:59:12.055523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 11:59:12.055523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 11:59:12.055523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 11:59:12.055523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a2440bb0-2d4d-428d-962a-59cc25350a5d could not be found. Sep 10 11:59:12.055523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:12.055523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:12.055523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:12.055523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:12.055523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:12.055523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:12.055523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:59:12.055523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:59:12.055523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:59:12.055523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:59:12.055523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:59:12.055523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:59:12.055523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 10 11:59:12.055523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:59:12.055523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a2440bb0-2d4d-428d-962a-59cc25350a5d could not be found. Sep 10 11:59:12.055523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:12.055523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:12.055523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:12.055523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:12.055523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:12.055523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:12.055523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:59:12.055523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:59:12.055523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a2440bb0-2d4d-428d-962a-59cc25350a5d could not be found. Sep 10 11:59:12.055523 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:12.060612 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f02439bd-8b4a-4484-97be-0d17858280c5 tempest-VolumesNegativeTest-309943525 tempest-VolumesNegativeTest-309943525-project] Returning 404 to user: Volume a2440bb0-2d4d-428d-962a-59cc25350a5d could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:59:12.061685 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f02439bd-8b4a-4484-97be-0d17858280c5 tempest-VolumesNegativeTest-309943525 tempest-VolumesNegativeTest-309943525-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/a2440bb0-2d4d-428d-962a-59cc25350a5d" status: 404 len: 109 microversion: 2.1 time: 0.053625 Sep 10 11:59:12.062777 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2196/4374] 10.222.0.23 () {58 vars in 1248 bytes} [Sat Sep 10 11:59:12 2022] DELETE /compute/v2.1/os-volumes/a2440bb0-2d4d-428d-962a-59cc25350a5d => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:59:12.073690 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2ba7b314-f309-4234-aed8-9de351ac0f54 tempest-VolumesNegativeTest-309943525 tempest-VolumesNegativeTest-309943525-project] Calling method '.version_select at 0x7f407b5b0790>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:12.079632 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2179/4375] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:11 2022] GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c => generated 1513 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:12.107716 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-2ba7b314-f309-4234-aed8-9de351ac0f54 tempest-VolumesNegativeTest-309943525 tempest-VolumesNegativeTest-309943525-project] HTTP exception thrown: Volume 626c0070-797d-46d7-8916-5a420311ac8e could not be found. Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2ba7b314-f309-4234-aed8-9de351ac0f54 tempest-VolumesNegativeTest-309943525 tempest-VolumesNegativeTest-309943525-project] Request method failure captured: Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/os-volumes/626c0070-797d-46d7-8916-5a420311ac8e HTTP/1.1 Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHwPQy-imcbB97IGfHqMLpL1VCREmikwWkcskXVnkavmbopTSXmsz6IXVXEjLU-xskTWmVZ02qFpFx3Zrcz3p3rYaII5elN45WUAg_vaoCFDGu0o9jMjgRBSYNDjDMnLATnCamg0RCA0Lo6OLVgtFXxZ456e0460CtbddpL9052bcpo Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: f8d95b15d0794376b785583c5f7d0f91 Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-VolumesNegativeTest-309943525 Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f8d95b15d0794376b785583c5f7d0f91"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f8d95b15d0794376b785583c5f7d0f91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f8d95b15d0794376b785583c5f7d0f91", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f8d95b15d0794376b785583c5f7d0f91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-VolumesNegativeTest-309943525 Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: f8d95b15d0794376b785583c5f7d0f91 Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-VolumesNegativeTest-309943525 Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-VolumesNegativeTest-309943525-project Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 700b0df5afac467bb51bd8785611a62e Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-VolumesNegativeTest-309943525-project Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: method: Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: exception: Volume 626c0070-797d-46d7-8916-5a420311ac8e could not be found. Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '626c0070-797d-46d7-8916-5a420311ac8e'} Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 626c0070-797d-46d7-8916-5a420311ac8e could not be found. (HTTP 404) (Request-ID: req-7bfe7bb6-b99b-4239-acec-b0783133d31b) Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 10 11:59:12.109844 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 11:59:12.119608 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 11:59:12.119608 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 11:59:12.119608 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 11:59:12.119608 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 11:59:12.119608 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 11:59:12.119608 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 11:59:12.119608 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 11:59:12.119608 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 11:59:12.119608 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 11:59:12.119608 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 11:59:12.119608 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 11:59:12.119608 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 11:59:12.119608 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 11:59:12.119608 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 626c0070-797d-46d7-8916-5a420311ac8e could not be found. Sep 10 11:59:12.119608 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:12.119608 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:12.119608 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:12.119608 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:12.119608 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:12.119608 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:12.119608 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:59:12.119608 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:59:12.119608 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 11:59:12.119608 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 11:59:12.119608 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:59:12.119608 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:59:12.119608 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 10 11:59:12.119608 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:59:12.119608 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 626c0070-797d-46d7-8916-5a420311ac8e could not be found. Sep 10 11:59:12.119608 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:12.119608 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:12.119608 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:12.119608 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:12.119608 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:12.119608 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:12.119608 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:59:12.119608 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:59:12.119608 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 626c0070-797d-46d7-8916-5a420311ac8e could not be found. Sep 10 11:59:12.119608 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:12.119608 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2ba7b314-f309-4234-aed8-9de351ac0f54 tempest-VolumesNegativeTest-309943525 tempest-VolumesNegativeTest-309943525-project] Returning 404 to user: Volume 626c0070-797d-46d7-8916-5a420311ac8e could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:59:12.119608 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2ba7b314-f309-4234-aed8-9de351ac0f54 tempest-VolumesNegativeTest-309943525 tempest-VolumesNegativeTest-309943525-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/626c0070-797d-46d7-8916-5a420311ac8e" status: 404 len: 109 microversion: 2.1 time: 0.043752 Sep 10 11:59:12.119608 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2197/4376] 10.222.0.23 () {58 vars in 1245 bytes} [Sat Sep 10 11:59:12 2022] GET /compute/v2.1/os-volumes/626c0070-797d-46d7-8916-5a420311ac8e => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 11:59:13.075973 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f3a879fe-4e3f-4ac9-9833-1a856b7380e6 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:13.076484 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f3a879fe-4e3f-4ac9-9833-1a856b7380e6 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: adde25b7-c5c7-46fa-b4e9-f80a11568f3c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:13.086670 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3a879fe-4e3f-4ac9-9833-1a856b7380e6 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:13.087863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3a879fe-4e3f-4ac9-9833-1a856b7380e6 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:13.089459 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3a879fe-4e3f-4ac9-9833-1a856b7380e6 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:13.091445 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3a879fe-4e3f-4ac9-9833-1a856b7380e6 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:13.092170 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3a879fe-4e3f-4ac9-9833-1a856b7380e6 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:13.093343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3a879fe-4e3f-4ac9-9833-1a856b7380e6 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:13.265452 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f3a879fe-4e3f-4ac9-9833-1a856b7380e6 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:13.276414 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f3a879fe-4e3f-4ac9-9833-1a856b7380e6 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c" status: 200 len: 1513 microversion: 2.1 time: 0.205586 Sep 10 11:59:13.277746 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2180/4377] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:13 2022] GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c => generated 1513 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:14.300881 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0e0a78eb-929e-4d79-bd4a-2a8da0ab5880 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:14.302323 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0e0a78eb-929e-4d79-bd4a-2a8da0ab5880 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: adde25b7-c5c7-46fa-b4e9-f80a11568f3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:14.312205 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e0a78eb-929e-4d79-bd4a-2a8da0ab5880 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:14.313030 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e0a78eb-929e-4d79-bd4a-2a8da0ab5880 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:14.313663 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e0a78eb-929e-4d79-bd4a-2a8da0ab5880 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:14.314658 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e0a78eb-929e-4d79-bd4a-2a8da0ab5880 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:14.315486 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e0a78eb-929e-4d79-bd4a-2a8da0ab5880 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:14.316185 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e0a78eb-929e-4d79-bd4a-2a8da0ab5880 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:14.476001 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0e0a78eb-929e-4d79-bd4a-2a8da0ab5880 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:14.484817 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0e0a78eb-929e-4d79-bd4a-2a8da0ab5880 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c" status: 200 len: 1513 microversion: 2.1 time: 0.187845 Sep 10 11:59:14.485943 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2198/4378] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:14 2022] GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c => generated 1513 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:15.511461 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-83ec6242-a97d-4101-ab91-c63e8a7b3366 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:15.512719 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-83ec6242-a97d-4101-ab91-c63e8a7b3366 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: adde25b7-c5c7-46fa-b4e9-f80a11568f3c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:15.519876 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-83ec6242-a97d-4101-ab91-c63e8a7b3366 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:15.520317 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-83ec6242-a97d-4101-ab91-c63e8a7b3366 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:15.528697 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-83ec6242-a97d-4101-ab91-c63e8a7b3366 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:15.533043 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-83ec6242-a97d-4101-ab91-c63e8a7b3366 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:15.533729 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-83ec6242-a97d-4101-ab91-c63e8a7b3366 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:15.534486 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-83ec6242-a97d-4101-ab91-c63e8a7b3366 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:15.706725 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-83ec6242-a97d-4101-ab91-c63e8a7b3366 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:15.718277 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-83ec6242-a97d-4101-ab91-c63e8a7b3366 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c" status: 200 len: 1513 microversion: 2.1 time: 0.210804 Sep 10 11:59:15.718869 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2181/4379] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:15 2022] GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c => generated 1513 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:16.744178 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1f01bcd4-0de2-48f2-adf2-935fbe12c9f8 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:16.745607 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1f01bcd4-0de2-48f2-adf2-935fbe12c9f8 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: adde25b7-c5c7-46fa-b4e9-f80a11568f3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:16.753595 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1f01bcd4-0de2-48f2-adf2-935fbe12c9f8 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:16.754013 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1f01bcd4-0de2-48f2-adf2-935fbe12c9f8 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:16.754460 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1f01bcd4-0de2-48f2-adf2-935fbe12c9f8 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:16.755178 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1f01bcd4-0de2-48f2-adf2-935fbe12c9f8 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:16.755831 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1f01bcd4-0de2-48f2-adf2-935fbe12c9f8 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:16.756812 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1f01bcd4-0de2-48f2-adf2-935fbe12c9f8 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:16.903481 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1f01bcd4-0de2-48f2-adf2-935fbe12c9f8 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:16.913085 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1f01bcd4-0de2-48f2-adf2-935fbe12c9f8 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c" status: 200 len: 1513 microversion: 2.1 time: 0.174987 Sep 10 11:59:16.925310 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2199/4380] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:16 2022] GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c => generated 1513 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:17.937094 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5863b204-f32d-413a-9100-5d9082bfc734 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:17.938626 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5863b204-f32d-413a-9100-5d9082bfc734 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: adde25b7-c5c7-46fa-b4e9-f80a11568f3c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:17.948492 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5863b204-f32d-413a-9100-5d9082bfc734 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:17.949558 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5863b204-f32d-413a-9100-5d9082bfc734 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:17.950676 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5863b204-f32d-413a-9100-5d9082bfc734 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:17.951786 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5863b204-f32d-413a-9100-5d9082bfc734 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:17.952460 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5863b204-f32d-413a-9100-5d9082bfc734 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:17.953097 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5863b204-f32d-413a-9100-5d9082bfc734 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:18.143559 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5863b204-f32d-413a-9100-5d9082bfc734 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:18.152022 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5863b204-f32d-413a-9100-5d9082bfc734 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c" status: 200 len: 1513 microversion: 2.1 time: 0.219400 Sep 10 11:59:18.152605 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2182/4381] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:17 2022] GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c => generated 1513 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:19.176758 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c4332720-1e82-4438-a33b-dc15fdb165f4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:19.177306 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c4332720-1e82-4438-a33b-dc15fdb165f4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: adde25b7-c5c7-46fa-b4e9-f80a11568f3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:19.185165 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c4332720-1e82-4438-a33b-dc15fdb165f4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:19.185660 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c4332720-1e82-4438-a33b-dc15fdb165f4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:19.186104 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c4332720-1e82-4438-a33b-dc15fdb165f4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:19.186811 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c4332720-1e82-4438-a33b-dc15fdb165f4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:19.187298 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c4332720-1e82-4438-a33b-dc15fdb165f4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:19.187725 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c4332720-1e82-4438-a33b-dc15fdb165f4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:19.900376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c4332720-1e82-4438-a33b-dc15fdb165f4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:19.913048 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c4332720-1e82-4438-a33b-dc15fdb165f4 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c" status: 200 len: 1513 microversion: 2.1 time: 0.739893 Sep 10 11:59:19.918784 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2200/4382] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:19 2022] GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c => generated 1513 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:20.941751 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-60fe53f8-18f7-4b91-972f-e8a96d67fe63 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:20.943453 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-60fe53f8-18f7-4b91-972f-e8a96d67fe63 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: adde25b7-c5c7-46fa-b4e9-f80a11568f3c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:20.950281 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:59:20.960073 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60fe53f8-18f7-4b91-972f-e8a96d67fe63 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:20.963959 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60fe53f8-18f7-4b91-972f-e8a96d67fe63 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:20.969481 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60fe53f8-18f7-4b91-972f-e8a96d67fe63 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:20.970245 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60fe53f8-18f7-4b91-972f-e8a96d67fe63 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:20.971250 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60fe53f8-18f7-4b91-972f-e8a96d67fe63 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:20.971880 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60fe53f8-18f7-4b91-972f-e8a96d67fe63 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:21.227242 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-60fe53f8-18f7-4b91-972f-e8a96d67fe63 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:21.239655 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-60fe53f8-18f7-4b91-972f-e8a96d67fe63 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c" status: 200 len: 1513 microversion: 2.1 time: 0.300388 Sep 10 11:59:21.242525 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2183/4383] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:20 2022] GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c => generated 1513 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:22.265885 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3737ede9-0d29-4279-b32b-804b291633b1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:22.266497 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3737ede9-0d29-4279-b32b-804b291633b1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: adde25b7-c5c7-46fa-b4e9-f80a11568f3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:22.275499 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3737ede9-0d29-4279-b32b-804b291633b1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:22.276232 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3737ede9-0d29-4279-b32b-804b291633b1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:22.276665 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3737ede9-0d29-4279-b32b-804b291633b1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:22.277683 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3737ede9-0d29-4279-b32b-804b291633b1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:22.278294 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3737ede9-0d29-4279-b32b-804b291633b1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:22.278998 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3737ede9-0d29-4279-b32b-804b291633b1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:22.432082 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3737ede9-0d29-4279-b32b-804b291633b1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:22.440261 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3737ede9-0d29-4279-b32b-804b291633b1 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c" status: 200 len: 1513 microversion: 2.1 time: 0.178593 Sep 10 11:59:22.442283 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2201/4384] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:22 2022] GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c => generated 1513 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:23.465443 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6e66457a-7265-4268-a3ff-755803542a16 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:23.466234 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6e66457a-7265-4268-a3ff-755803542a16 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: adde25b7-c5c7-46fa-b4e9-f80a11568f3c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:23.475666 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e66457a-7265-4268-a3ff-755803542a16 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:23.476259 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e66457a-7265-4268-a3ff-755803542a16 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:23.476828 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e66457a-7265-4268-a3ff-755803542a16 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:23.477951 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e66457a-7265-4268-a3ff-755803542a16 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:23.478778 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e66457a-7265-4268-a3ff-755803542a16 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:23.479469 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e66457a-7265-4268-a3ff-755803542a16 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:23.660042 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6e66457a-7265-4268-a3ff-755803542a16 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:23.670836 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6e66457a-7265-4268-a3ff-755803542a16 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c" status: 200 len: 1513 microversion: 2.1 time: 0.208430 Sep 10 11:59:23.671665 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2184/4385] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:23 2022] GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c => generated 1513 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:24.694612 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2ea86f07-a97a-4aac-b042-2ee67449b806 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:24.695268 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2ea86f07-a97a-4aac-b042-2ee67449b806 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: adde25b7-c5c7-46fa-b4e9-f80a11568f3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:24.702466 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ea86f07-a97a-4aac-b042-2ee67449b806 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:24.702922 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ea86f07-a97a-4aac-b042-2ee67449b806 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:24.703590 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ea86f07-a97a-4aac-b042-2ee67449b806 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:24.704467 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ea86f07-a97a-4aac-b042-2ee67449b806 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:24.705097 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ea86f07-a97a-4aac-b042-2ee67449b806 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:24.705710 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ea86f07-a97a-4aac-b042-2ee67449b806 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:24.933783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2ea86f07-a97a-4aac-b042-2ee67449b806 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:24.946207 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2ea86f07-a97a-4aac-b042-2ee67449b806 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c" status: 200 len: 1513 microversion: 2.1 time: 0.256049 Sep 10 11:59:24.946808 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2202/4386] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:24 2022] GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c => generated 1513 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:25.976041 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3f93b7c3-d4a0-4327-a087-a4dd4c4fe722 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:25.976672 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3f93b7c3-d4a0-4327-a087-a4dd4c4fe722 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: adde25b7-c5c7-46fa-b4e9-f80a11568f3c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:25.994034 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3f93b7c3-d4a0-4327-a087-a4dd4c4fe722 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:25.994545 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3f93b7c3-d4a0-4327-a087-a4dd4c4fe722 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:25.994992 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3f93b7c3-d4a0-4327-a087-a4dd4c4fe722 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:25.995742 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3f93b7c3-d4a0-4327-a087-a4dd4c4fe722 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:25.996233 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3f93b7c3-d4a0-4327-a087-a4dd4c4fe722 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:25.996843 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3f93b7c3-d4a0-4327-a087-a4dd4c4fe722 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:26.162891 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3f93b7c3-d4a0-4327-a087-a4dd4c4fe722 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:26.171518 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3f93b7c3-d4a0-4327-a087-a4dd4c4fe722 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c" status: 200 len: 1513 microversion: 2.1 time: 0.199685 Sep 10 11:59:26.172765 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2185/4387] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:25 2022] GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c => generated 1513 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:27.197979 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-50304185-09eb-434f-bd2e-9ffe4016c268 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:27.200108 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-50304185-09eb-434f-bd2e-9ffe4016c268 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: adde25b7-c5c7-46fa-b4e9-f80a11568f3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:27.213260 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-50304185-09eb-434f-bd2e-9ffe4016c268 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:27.214046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-50304185-09eb-434f-bd2e-9ffe4016c268 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:27.214904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-50304185-09eb-434f-bd2e-9ffe4016c268 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:27.215794 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-50304185-09eb-434f-bd2e-9ffe4016c268 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:27.216410 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-50304185-09eb-434f-bd2e-9ffe4016c268 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:27.217017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-50304185-09eb-434f-bd2e-9ffe4016c268 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:27.380524 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-50304185-09eb-434f-bd2e-9ffe4016c268 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:27.391134 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-50304185-09eb-434f-bd2e-9ffe4016c268 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c" status: 200 len: 1513 microversion: 2.1 time: 0.199544 Sep 10 11:59:27.392053 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2203/4388] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:27 2022] GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c => generated 1513 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:28.416997 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a7c02f68-3604-4d19-a226-c699746c02cd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:28.418893 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a7c02f68-3604-4d19-a226-c699746c02cd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: adde25b7-c5c7-46fa-b4e9-f80a11568f3c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:28.435074 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a7c02f68-3604-4d19-a226-c699746c02cd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:28.436570 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a7c02f68-3604-4d19-a226-c699746c02cd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:28.437582 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a7c02f68-3604-4d19-a226-c699746c02cd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:28.438379 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a7c02f68-3604-4d19-a226-c699746c02cd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:28.438904 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a7c02f68-3604-4d19-a226-c699746c02cd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:28.439444 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a7c02f68-3604-4d19-a226-c699746c02cd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:28.678442 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a7c02f68-3604-4d19-a226-c699746c02cd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:28.688435 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a7c02f68-3604-4d19-a226-c699746c02cd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c" status: 200 len: 1513 microversion: 2.1 time: 0.276103 Sep 10 11:59:28.691974 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2186/4389] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:28 2022] GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c => generated 1513 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:29.715798 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a613ddaf-f4d5-482c-a390-9b07fa5dab14 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:29.717083 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a613ddaf-f4d5-482c-a390-9b07fa5dab14 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: adde25b7-c5c7-46fa-b4e9-f80a11568f3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:29.724243 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a613ddaf-f4d5-482c-a390-9b07fa5dab14 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:29.725766 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a613ddaf-f4d5-482c-a390-9b07fa5dab14 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:29.726502 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a613ddaf-f4d5-482c-a390-9b07fa5dab14 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:29.727455 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a613ddaf-f4d5-482c-a390-9b07fa5dab14 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:29.728375 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a613ddaf-f4d5-482c-a390-9b07fa5dab14 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:29.729015 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a613ddaf-f4d5-482c-a390-9b07fa5dab14 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:29.934188 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a613ddaf-f4d5-482c-a390-9b07fa5dab14 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:29.944139 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a613ddaf-f4d5-482c-a390-9b07fa5dab14 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c" status: 200 len: 1513 microversion: 2.1 time: 0.231335 Sep 10 11:59:29.945240 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2204/4390] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:29 2022] GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c => generated 1513 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:30.969024 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-27055a23-9694-4397-81b4-a1e9a7828b76 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:30.970270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-27055a23-9694-4397-81b4-a1e9a7828b76 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: adde25b7-c5c7-46fa-b4e9-f80a11568f3c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:30.978209 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27055a23-9694-4397-81b4-a1e9a7828b76 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:30.978774 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27055a23-9694-4397-81b4-a1e9a7828b76 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:30.979305 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27055a23-9694-4397-81b4-a1e9a7828b76 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:30.980071 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27055a23-9694-4397-81b4-a1e9a7828b76 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:30.980607 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27055a23-9694-4397-81b4-a1e9a7828b76 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:30.981161 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27055a23-9694-4397-81b4-a1e9a7828b76 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:30.985284 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=98 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:59:31.158924 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-27055a23-9694-4397-81b4-a1e9a7828b76 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:31.167825 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-27055a23-9694-4397-81b4-a1e9a7828b76 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c" status: 200 len: 1490 microversion: 2.1 time: 0.203276 Sep 10 11:59:31.168398 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2187/4391] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:30 2022] GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c => generated 1490 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:31.191027 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a9cf55ac-f1bb-4e48-92d9-301b7da2c139 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:31.191710 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a9cf55ac-f1bb-4e48-92d9-301b7da2c139 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: adde25b7-c5c7-46fa-b4e9-f80a11568f3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:31.198816 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9cf55ac-f1bb-4e48-92d9-301b7da2c139 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:31.199672 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9cf55ac-f1bb-4e48-92d9-301b7da2c139 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:31.200548 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9cf55ac-f1bb-4e48-92d9-301b7da2c139 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:31.204856 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9cf55ac-f1bb-4e48-92d9-301b7da2c139 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:31.207067 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9cf55ac-f1bb-4e48-92d9-301b7da2c139 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:31.207619 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9cf55ac-f1bb-4e48-92d9-301b7da2c139 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:31.236881 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a9cf55ac-f1bb-4e48-92d9-301b7da2c139 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: adde25b7-c5c7-46fa-b4e9-f80a11568f3c] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:59:31.345030 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a9cf55ac-f1bb-4e48-92d9-301b7da2c139 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "DELETE /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c" status: 204 len: 0 microversion: 2.1 time: 0.157516 Sep 10 11:59:31.346388 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2205/4392] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:59:31 2022] DELETE /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:59:31.355878 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7b8f4e4a-2328-4411-98c5-e6feec866b69 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:31.356672 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7b8f4e4a-2328-4411-98c5-e6feec866b69 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: adde25b7-c5c7-46fa-b4e9-f80a11568f3c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:31.366916 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7b8f4e4a-2328-4411-98c5-e6feec866b69 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:31.367719 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7b8f4e4a-2328-4411-98c5-e6feec866b69 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:31.368227 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7b8f4e4a-2328-4411-98c5-e6feec866b69 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:31.369182 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7b8f4e4a-2328-4411-98c5-e6feec866b69 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:31.369889 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7b8f4e4a-2328-4411-98c5-e6feec866b69 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:31.370462 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7b8f4e4a-2328-4411-98c5-e6feec866b69 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:31.590655 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7b8f4e4a-2328-4411-98c5-e6feec866b69 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:31.610908 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7b8f4e4a-2328-4411-98c5-e6feec866b69 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c" status: 200 len: 1496 microversion: 2.1 time: 0.260021 Sep 10 11:59:31.611837 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2188/4393] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:31 2022] GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c => generated 1496 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:32.645595 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6c5bfb84-8e3f-4e6d-b452-15f851495159 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:32.646899 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6c5bfb84-8e3f-4e6d-b452-15f851495159 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: adde25b7-c5c7-46fa-b4e9-f80a11568f3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:32.654805 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6c5bfb84-8e3f-4e6d-b452-15f851495159 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:32.655799 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6c5bfb84-8e3f-4e6d-b452-15f851495159 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:32.656488 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6c5bfb84-8e3f-4e6d-b452-15f851495159 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:32.658465 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6c5bfb84-8e3f-4e6d-b452-15f851495159 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:32.658925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6c5bfb84-8e3f-4e6d-b452-15f851495159 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:32.659719 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6c5bfb84-8e3f-4e6d-b452-15f851495159 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:32.973243 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6c5bfb84-8e3f-4e6d-b452-15f851495159 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:32.982572 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6c5bfb84-8e3f-4e6d-b452-15f851495159 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c" status: 200 len: 1496 microversion: 2.1 time: 0.341976 Sep 10 11:59:32.983551 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2206/4394] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:32 2022] GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c => generated 1496 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:33.572132 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-a7751665-1c1d-49c0-b3c9-8dff71c08a70 req-ddcf18f1-aad1-4e02-bd6e-fe4b3c5cde3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adde25b7-c5c7-46fa-b4e9-f80a11568f3c", "name": "network-vif-deleted", "tag": "201e79e3-8180-43b6-aad5-9e08ab11e679"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:59:33.619044 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a7751665-1c1d-49c0-b3c9-8dff71c08a70 req-ddcf18f1-aad1-4e02-bd6e-fe4b3c5cde3f service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:33.619565 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a7751665-1c1d-49c0-b3c9-8dff71c08a70 req-ddcf18f1-aad1-4e02-bd6e-fe4b3c5cde3f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:33.620049 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a7751665-1c1d-49c0-b3c9-8dff71c08a70 req-ddcf18f1-aad1-4e02-bd6e-fe4b3c5cde3f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:33.681404 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-a7751665-1c1d-49c0-b3c9-8dff71c08a70 req-ddcf18f1-aad1-4e02-bd6e-fe4b3c5cde3f service nova] Creating event network-vif-deleted:201e79e3-8180-43b6-aad5-9e08ab11e679 for instance adde25b7-c5c7-46fa-b4e9-f80a11568f3c on n-h2-856895-1 Sep 10 11:59:33.698774 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-a7751665-1c1d-49c0-b3c9-8dff71c08a70 req-ddcf18f1-aad1-4e02-bd6e-fe4b3c5cde3f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132957 Sep 10 11:59:33.701666 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2189/4395] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:59:34.012934 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-195e262e-e3d1-4364-afd7-53b625bba473 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:34.014332 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-195e262e-e3d1-4364-afd7-53b625bba473 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: adde25b7-c5c7-46fa-b4e9-f80a11568f3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:34.023143 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-195e262e-e3d1-4364-afd7-53b625bba473 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:34.023934 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-195e262e-e3d1-4364-afd7-53b625bba473 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:34.024584 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-195e262e-e3d1-4364-afd7-53b625bba473 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:34.025498 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-195e262e-e3d1-4364-afd7-53b625bba473 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:34.026270 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-195e262e-e3d1-4364-afd7-53b625bba473 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:34.027095 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-195e262e-e3d1-4364-afd7-53b625bba473 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:34.072659 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-195e262e-e3d1-4364-afd7-53b625bba473 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:34.073499 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-195e262e-e3d1-4364-afd7-53b625bba473 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:34.074139 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-195e262e-e3d1-4364-afd7-53b625bba473 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:34.074890 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-195e262e-e3d1-4364-afd7-53b625bba473 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lazy-loading 'fault' on Instance uuid adde25b7-c5c7-46fa-b4e9-f80a11568f3c {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:59:34.143615 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-195e262e-e3d1-4364-afd7-53b625bba473 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:34.173669 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-195e262e-e3d1-4364-afd7-53b625bba473 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c" status: 200 len: 1305 microversion: 2.1 time: 0.170872 Sep 10 11:59:34.176094 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2207/4396] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:34 2022] GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c => generated 1305 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:35.199622 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b0c25182-e415-431f-9169-a2840c3d6155 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:35.200967 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b0c25182-e415-431f-9169-a2840c3d6155 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: adde25b7-c5c7-46fa-b4e9-f80a11568f3c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:35.216317 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b0c25182-e415-431f-9169-a2840c3d6155 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:35.217299 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b0c25182-e415-431f-9169-a2840c3d6155 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:35.218083 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b0c25182-e415-431f-9169-a2840c3d6155 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:35.220007 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b0c25182-e415-431f-9169-a2840c3d6155 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:35.231483 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b0c25182-e415-431f-9169-a2840c3d6155 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:35.233821 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b0c25182-e415-431f-9169-a2840c3d6155 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:35.271007 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-b0c25182-e415-431f-9169-a2840c3d6155 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] HTTP exception thrown: Instance adde25b7-c5c7-46fa-b4e9-f80a11568f3c could not be found. Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b0c25182-e415-431f-9169-a2840c3d6155 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Request method failure captured: Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c HTTP/1.1 Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHsd-AnnLZFS6-Lbfr9ATef_4cX6EE0Up-a_Ch8dobncDUqljTHX0YcK7WbJaaBcAlN6twvlZe9au1SNJQwC5-nItcb7pEhHjqWyH9GhqCmgS3jEbfUY8st6zk2hVKWMOxRl1E1nEdlCzWIcW0YZf7xPnP7IvCJy_UgVMW4-UpTlv4M Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2f92ad05650840f6bb4c8f6134b489ca", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-DeleteServersTestJSON-419044733 Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-DeleteServersTestJSON-419044733-project Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: d244789bea974bd99d0f1debebabb54a Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-DeleteServersTestJSON-419044733-project Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance adde25b7-c5c7-46fa-b4e9-f80a11568f3c could not be found. Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'adde25b7-c5c7-46fa-b4e9-f80a11568f3c'} Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adde25b7-c5c7-46fa-b4e9-f80a11568f3c could not be found. Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adde25b7-c5c7-46fa-b4e9-f80a11568f3c could not be found. Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:35.273619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:35.277746 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:35.277746 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:35.277746 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:35.277746 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:59:35.277746 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:59:35.277746 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adde25b7-c5c7-46fa-b4e9-f80a11568f3c could not be found. Sep 10 11:59:35.277746 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:35.280593 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b0c25182-e415-431f-9169-a2840c3d6155 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Returning 404 to user: Instance adde25b7-c5c7-46fa-b4e9-f80a11568f3c could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:59:35.281861 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b0c25182-e415-431f-9169-a2840c3d6155 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c" status: 404 len: 111 microversion: 2.1 time: 0.088460 Sep 10 11:59:35.286891 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2190/4397] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:35 2022] GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:59:35.308520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-33baeaa8-8bbc-4987-b923-33e74d5367ea tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:35.319273 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-33baeaa8-8bbc-4987-b923-33e74d5367ea tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bd23712ff5e149d9b61ca12312587fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce08caecb8b34510a7f6fde5774b62b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:35.320649 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-33baeaa8-8bbc-4987-b923-33e74d5367ea tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Searching by: {'deleted': False, 'project_id': 'ce08caecb8b34510a7f6fde5774b62b2'} {{(pid=128777) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 11:59:35.339382 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-33baeaa8-8bbc-4987-b923-33e74d5367ea tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:35.341949 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-33baeaa8-8bbc-4987-b923-33e74d5367ea tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:35.342877 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-33baeaa8-8bbc-4987-b923-33e74d5367ea tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:35.343862 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-33baeaa8-8bbc-4987-b923-33e74d5367ea tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:35.344572 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-33baeaa8-8bbc-4987-b923-33e74d5367ea tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:35.345677 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-33baeaa8-8bbc-4987-b923-33e74d5367ea tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:35.385872 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.multi_cell_list [None req-33baeaa8-8bbc-4987-b923-33e74d5367ea tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128777) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 11:59:35.432184 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-33baeaa8-8bbc-4987-b923-33e74d5367ea tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.131934 Sep 10 11:59:35.434434 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2208/4398] 10.222.0.23 () {58 vars in 1125 bytes} [Sat Sep 10 11:59:35 2022] GET /compute/v2.1/servers => generated 334 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:59:35.448109 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c9d1ffd5-4dda-4142-903b-e54fc5f02951 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:35.452935 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c9d1ffd5-4dda-4142-903b-e54fc5f02951 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bd23712ff5e149d9b61ca12312587fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce08caecb8b34510a7f6fde5774b62b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:35.453817 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c9d1ffd5-4dda-4142-903b-e54fc5f02951 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Searching by: {'deleted': False, 'project_id': 'ce08caecb8b34510a7f6fde5774b62b2'} {{(pid=128776) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 11:59:35.475538 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9d1ffd5-4dda-4142-903b-e54fc5f02951 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:35.475944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9d1ffd5-4dda-4142-903b-e54fc5f02951 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:35.476386 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9d1ffd5-4dda-4142-903b-e54fc5f02951 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:35.477118 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9d1ffd5-4dda-4142-903b-e54fc5f02951 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:35.477571 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9d1ffd5-4dda-4142-903b-e54fc5f02951 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:35.499890 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9d1ffd5-4dda-4142-903b-e54fc5f02951 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:35.520974 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8eacb7d9-b5c1-4180-9a44-77915ff0c86a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-583349340", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "471bef66-289e-44bc-a38f-0fbd7758b454"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:59:35.567830 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.multi_cell_list [None req-c9d1ffd5-4dda-4142-903b-e54fc5f02951 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128776) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 11:59:35.633219 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-8eacb7d9-b5c1-4180-9a44-77915ff0c86a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] validate_networks() for [('471bef66-289e-44bc-a38f-0fbd7758b454', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 11:59:35.648640 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c9d1ffd5-4dda-4142-903b-e54fc5f02951 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd23712ff5e149d9b61ca12312587fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce08caecb8b34510a7f6fde5774b62b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:35.656746 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9d1ffd5-4dda-4142-903b-e54fc5f02951 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:35.657426 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9d1ffd5-4dda-4142-903b-e54fc5f02951 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:35.658104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9d1ffd5-4dda-4142-903b-e54fc5f02951 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:35.989991 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c9d1ffd5-4dda-4142-903b-e54fc5f02951 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 0.546137 Sep 10 11:59:35.991138 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2191/4399] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 11:59:35 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:36.027258 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ad398829-f8e9-43fa-a72e-372d2632fa3b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:36.041374 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ad398829-f8e9-43fa-a72e-372d2632fa3b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] 10.222.0.23 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019717 Sep 10 11:59:36.044078 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2192/4400] 10.222.0.23 () {58 vars in 1137 bytes} [Sat Sep 10 11:59:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:59:36.424546 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4265b7d0-622d-437e-8e81-2327d3920355 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:36.433473 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-8eacb7d9-b5c1-4180-9a44-77915ff0c86a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 11:59:36.433940 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-8eacb7d9-b5c1-4180-9a44-77915ff0c86a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 11:59:36.434384 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-8eacb7d9-b5c1-4180-9a44-77915ff0c86a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 11:59:36.434854 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-8eacb7d9-b5c1-4180-9a44-77915ff0c86a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 11:59:36.435316 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-8eacb7d9-b5c1-4180-9a44-77915ff0c86a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 11:59:36.437319 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4265b7d0-622d-437e-8e81-2327d3920355 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] [instance: c9b161da-e58a-43ac-accc-4c771baf68a4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:36.459516 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8eacb7d9-b5c1-4180-9a44-77915ff0c86a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:36.459516 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8eacb7d9-b5c1-4180-9a44-77915ff0c86a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:36.461117 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4265b7d0-622d-437e-8e81-2327d3920355 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:36.461624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4265b7d0-622d-437e-8e81-2327d3920355 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:36.462069 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4265b7d0-622d-437e-8e81-2327d3920355 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:36.462977 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4265b7d0-622d-437e-8e81-2327d3920355 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:36.463476 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4265b7d0-622d-437e-8e81-2327d3920355 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:36.463934 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4265b7d0-622d-437e-8e81-2327d3920355 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:36.468760 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8eacb7d9-b5c1-4180-9a44-77915ff0c86a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:36.469897 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8eacb7d9-b5c1-4180-9a44-77915ff0c86a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:36.470399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8eacb7d9-b5c1-4180-9a44-77915ff0c86a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:36.470846 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8eacb7d9-b5c1-4180-9a44-77915ff0c86a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:36.517462 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4265b7d0-622d-437e-8e81-2327d3920355 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] [instance: c9b161da-e58a-43ac-accc-4c771baf68a4] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:59:36.526446 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-8eacb7d9-b5c1-4180-9a44-77915ff0c86a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Getting quotas for project 2f92ad05650840f6bb4c8f6134b489ca. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 11:59:36.542282 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-8eacb7d9-b5c1-4180-9a44-77915ff0c86a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Getting quotas for user d244789bea974bd99d0f1debebabb54a and project 2f92ad05650840f6bb4c8f6134b489ca. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 11:59:36.564586 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8eacb7d9-b5c1-4180-9a44-77915ff0c86a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 11:59:36.566941 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8eacb7d9-b5c1-4180-9a44-77915ff0c86a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: dbbeb877-f666-4027-ad81-c7ba83bed007] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 11:59:36.669626 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8eacb7d9-b5c1-4180-9a44-77915ff0c86a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.152488 Sep 10 11:59:36.676583 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2209/4401] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 11:59:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1160 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 11:59:36.684276 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-19c2393b-8c25-475f-bcc0-08fe240cabbe tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:36.684910 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-19c2393b-8c25-475f-bcc0-08fe240cabbe tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: dbbeb877-f666-4027-ad81-c7ba83bed007] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:36.713303 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4265b7d0-622d-437e-8e81-2327d3920355 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c9b161da-e58a-43ac-accc-4c771baf68a4" status: 204 len: 0 microversion: 2.1 time: 0.293756 Sep 10 11:59:36.714859 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2193/4402] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:59:36 2022] DELETE /compute/v2.1/servers/c9b161da-e58a-43ac-accc-4c771baf68a4 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:59:36.729079 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-02f565a7-3353-4896-bcd8-5f314dd18b53 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:36.730622 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-02f565a7-3353-4896-bcd8-5f314dd18b53 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] [instance: c9b161da-e58a-43ac-accc-4c771baf68a4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:36.757505 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02f565a7-3353-4896-bcd8-5f314dd18b53 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:36.757940 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02f565a7-3353-4896-bcd8-5f314dd18b53 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:36.758514 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02f565a7-3353-4896-bcd8-5f314dd18b53 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:36.759147 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02f565a7-3353-4896-bcd8-5f314dd18b53 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:36.759632 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02f565a7-3353-4896-bcd8-5f314dd18b53 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:36.760072 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02f565a7-3353-4896-bcd8-5f314dd18b53 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:36.855130 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-19c2393b-8c25-475f-bcc0-08fe240cabbe tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:36.864432 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-19c2393b-8c25-475f-bcc0-08fe240cabbe tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007" status: 200 len: 1214 microversion: 2.1 time: 0.184677 Sep 10 11:59:36.865175 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2210/4403] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:36 2022] GET /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007 => generated 1214 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:59:37.213156 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-02f565a7-3353-4896-bcd8-5f314dd18b53 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd23712ff5e149d9b61ca12312587fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce08caecb8b34510a7f6fde5774b62b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:37.232455 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-02f565a7-3353-4896-bcd8-5f314dd18b53 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] 10.222.0.23 "GET /compute/v2.1/servers/c9b161da-e58a-43ac-accc-4c771baf68a4" status: 200 len: 1699 microversion: 2.1 time: 0.513056 Sep 10 11:59:37.233572 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2194/4404] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:36 2022] GET /compute/v2.1/servers/c9b161da-e58a-43ac-accc-4c771baf68a4 => generated 1699 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:37.892340 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e7606af4-6e6f-4bad-a39c-eeb845c6b97d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:37.893516 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e7606af4-6e6f-4bad-a39c-eeb845c6b97d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: dbbeb877-f666-4027-ad81-c7ba83bed007] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:37.907455 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e7606af4-6e6f-4bad-a39c-eeb845c6b97d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:37.908514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e7606af4-6e6f-4bad-a39c-eeb845c6b97d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:37.909292 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e7606af4-6e6f-4bad-a39c-eeb845c6b97d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:37.910489 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e7606af4-6e6f-4bad-a39c-eeb845c6b97d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:37.911112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e7606af4-6e6f-4bad-a39c-eeb845c6b97d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:37.912729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e7606af4-6e6f-4bad-a39c-eeb845c6b97d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:37.950934 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:59:38.033638 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e7606af4-6e6f-4bad-a39c-eeb845c6b97d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:38.060542 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e7606af4-6e6f-4bad-a39c-eeb845c6b97d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007" status: 200 len: 1210 microversion: 2.1 time: 0.164268 Sep 10 11:59:38.061170 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2211/4405] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:37 2022] GET /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007 => generated 1210 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 11:59:38.256209 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-41959f5c-a987-4fb2-aef2-8c15bca26af2 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:38.256863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-41959f5c-a987-4fb2-aef2-8c15bca26af2 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] [instance: c9b161da-e58a-43ac-accc-4c771baf68a4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:38.276909 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41959f5c-a987-4fb2-aef2-8c15bca26af2 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:38.277415 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41959f5c-a987-4fb2-aef2-8c15bca26af2 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:38.278905 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41959f5c-a987-4fb2-aef2-8c15bca26af2 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:38.281197 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41959f5c-a987-4fb2-aef2-8c15bca26af2 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:38.282805 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41959f5c-a987-4fb2-aef2-8c15bca26af2 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:38.283639 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41959f5c-a987-4fb2-aef2-8c15bca26af2 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:38.630144 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-41959f5c-a987-4fb2-aef2-8c15bca26af2 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd23712ff5e149d9b61ca12312587fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce08caecb8b34510a7f6fde5774b62b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:38.660087 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-41959f5c-a987-4fb2-aef2-8c15bca26af2 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] 10.222.0.23 "GET /compute/v2.1/servers/c9b161da-e58a-43ac-accc-4c771baf68a4" status: 200 len: 1699 microversion: 2.1 time: 0.404223 Sep 10 11:59:38.662532 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2195/4406] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:38 2022] GET /compute/v2.1/servers/c9b161da-e58a-43ac-accc-4c771baf68a4 => generated 1699 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:39.088165 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7ff0da2c-810a-45cd-90c5-5030699eed95 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:39.088783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7ff0da2c-810a-45cd-90c5-5030699eed95 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: dbbeb877-f666-4027-ad81-c7ba83bed007] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:39.100921 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:59:39.102413 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ff0da2c-810a-45cd-90c5-5030699eed95 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:39.103191 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ff0da2c-810a-45cd-90c5-5030699eed95 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:39.103640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ff0da2c-810a-45cd-90c5-5030699eed95 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:39.104359 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ff0da2c-810a-45cd-90c5-5030699eed95 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:39.104813 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ff0da2c-810a-45cd-90c5-5030699eed95 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:39.105245 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ff0da2c-810a-45cd-90c5-5030699eed95 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:39.208248 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7ff0da2c-810a-45cd-90c5-5030699eed95 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:39.217551 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7ff0da2c-810a-45cd-90c5-5030699eed95 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007" status: 200 len: 1272 microversion: 2.1 time: 0.134393 Sep 10 11:59:39.228521 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2212/4407] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:39 2022] GET /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007 => generated 1272 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:39.569216 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-ad0eb2f3-5fbc-42c3-ad82-d60845377940 req-04cae191-82d6-4639-a73d-cda1351373d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9b161da-e58a-43ac-accc-4c771baf68a4", "name": "network-vif-deleted", "tag": "4c8550eb-2e3b-44c7-b2da-c3b96f9c999a"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:59:39.608560 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ad0eb2f3-5fbc-42c3-ad82-d60845377940 req-04cae191-82d6-4639-a73d-cda1351373d3 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:39.610491 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ad0eb2f3-5fbc-42c3-ad82-d60845377940 req-04cae191-82d6-4639-a73d-cda1351373d3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:39.611204 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ad0eb2f3-5fbc-42c3-ad82-d60845377940 req-04cae191-82d6-4639-a73d-cda1351373d3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:39.652262 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-ad0eb2f3-5fbc-42c3-ad82-d60845377940 req-04cae191-82d6-4639-a73d-cda1351373d3 service nova] Creating event network-vif-deleted:4c8550eb-2e3b-44c7-b2da-c3b96f9c999a for instance c9b161da-e58a-43ac-accc-4c771baf68a4 on n-h2-856895-1 Sep 10 11:59:39.672061 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-ad0eb2f3-5fbc-42c3-ad82-d60845377940 req-04cae191-82d6-4639-a73d-cda1351373d3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106638 Sep 10 11:59:39.674220 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2196/4408] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:59:39.691288 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-61a4babf-054d-49c6-8d64-f0ed40c8c336 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:39.692017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-61a4babf-054d-49c6-8d64-f0ed40c8c336 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] [instance: c9b161da-e58a-43ac-accc-4c771baf68a4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:39.720375 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61a4babf-054d-49c6-8d64-f0ed40c8c336 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:39.721150 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61a4babf-054d-49c6-8d64-f0ed40c8c336 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:39.723973 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61a4babf-054d-49c6-8d64-f0ed40c8c336 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:39.729758 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61a4babf-054d-49c6-8d64-f0ed40c8c336 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:39.731542 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61a4babf-054d-49c6-8d64-f0ed40c8c336 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:39.734707 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61a4babf-054d-49c6-8d64-f0ed40c8c336 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:39.844387 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61a4babf-054d-49c6-8d64-f0ed40c8c336 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:39.844834 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61a4babf-054d-49c6-8d64-f0ed40c8c336 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:39.845298 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61a4babf-054d-49c6-8d64-f0ed40c8c336 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:39.847489 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-61a4babf-054d-49c6-8d64-f0ed40c8c336 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lazy-loading 'fault' on Instance uuid c9b161da-e58a-43ac-accc-4c771baf68a4 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:59:39.919046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-61a4babf-054d-49c6-8d64-f0ed40c8c336 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd23712ff5e149d9b61ca12312587fc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce08caecb8b34510a7f6fde5774b62b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:39.935914 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-61a4babf-054d-49c6-8d64-f0ed40c8c336 tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] 10.222.0.23 "GET /compute/v2.1/servers/c9b161da-e58a-43ac-accc-4c771baf68a4" status: 200 len: 1359 microversion: 2.1 time: 0.251052 Sep 10 11:59:39.939014 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2213/4409] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:39 2022] GET /compute/v2.1/servers/c9b161da-e58a-43ac-accc-4c771baf68a4 => generated 1359 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:40.244603 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-65d4f891-6c7f-4b0d-b223-a80753656e55 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:40.245822 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-65d4f891-6c7f-4b0d-b223-a80753656e55 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: dbbeb877-f666-4027-ad81-c7ba83bed007] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:40.261564 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65d4f891-6c7f-4b0d-b223-a80753656e55 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:40.274841 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65d4f891-6c7f-4b0d-b223-a80753656e55 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:40.277278 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65d4f891-6c7f-4b0d-b223-a80753656e55 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:40.279816 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65d4f891-6c7f-4b0d-b223-a80753656e55 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:40.283980 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65d4f891-6c7f-4b0d-b223-a80753656e55 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:40.285477 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65d4f891-6c7f-4b0d-b223-a80753656e55 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:40.428532 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-65d4f891-6c7f-4b0d-b223-a80753656e55 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:40.439973 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-65d4f891-6c7f-4b0d-b223-a80753656e55 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007" status: 200 len: 1272 microversion: 2.1 time: 0.201418 Sep 10 11:59:40.456191 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2197/4410] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:40 2022] GET /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007 => generated 1272 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:40.963066 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-dfff1525-0adf-4ffa-8244-7687a3686e8b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:40.963846 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-dfff1525-0adf-4ffa-8244-7687a3686e8b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] [instance: c9b161da-e58a-43ac-accc-4c771baf68a4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:40.976291 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dfff1525-0adf-4ffa-8244-7687a3686e8b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:40.976787 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dfff1525-0adf-4ffa-8244-7687a3686e8b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:40.977230 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dfff1525-0adf-4ffa-8244-7687a3686e8b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:40.982906 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dfff1525-0adf-4ffa-8244-7687a3686e8b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:40.983428 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dfff1525-0adf-4ffa-8244-7687a3686e8b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:40.983875 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dfff1525-0adf-4ffa-8244-7687a3686e8b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:41.026608 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-dfff1525-0adf-4ffa-8244-7687a3686e8b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] HTTP exception thrown: Instance c9b161da-e58a-43ac-accc-4c771baf68a4 could not be found. Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-dfff1525-0adf-4ffa-8244-7687a3686e8b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Request method failure captured: Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/c9b161da-e58a-43ac-accc-4c771baf68a4 HTTP/1.1 Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHvs8CVizu30FcKIHNdSGtutdyoxAG646S7ZftF50aif2SB8N_lzYOXvrOZFYJr9LahiG5eCyuHzGGqwcxZ6LznjeLb0-0iGxdEL_lhYU1NANUp6s15s5b1P6im9gwbYn0F0wlIRWZSRJBOODEJEIryYwMvLamDmVoh48QM90dr6-BY Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: ce08caecb8b34510a7f6fde5774b62b2 Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersTestJSON-422071077 Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ce08caecb8b34510a7f6fde5774b62b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ce08caecb8b34510a7f6fde5774b62b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ce08caecb8b34510a7f6fde5774b62b2", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ce08caecb8b34510a7f6fde5774b62b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersTestJSON-422071077 Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: ce08caecb8b34510a7f6fde5774b62b2 Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersTestJSON-422071077 Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersTestJSON-422071077-project Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: bd23712ff5e149d9b61ca12312587fc5 Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersTestJSON-422071077-project Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance c9b161da-e58a-43ac-accc-4c771baf68a4 could not be found. Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'c9b161da-e58a-43ac-accc-4c771baf68a4'} Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9b161da-e58a-43ac-accc-4c771baf68a4 could not be found. Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9b161da-e58a-43ac-accc-4c771baf68a4 could not be found. Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:41.029828 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:41.034345 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:41.034345 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:41.034345 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:59:41.034345 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:59:41.034345 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9b161da-e58a-43ac-accc-4c771baf68a4 could not be found. Sep 10 11:59:41.034345 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:41.038145 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-dfff1525-0adf-4ffa-8244-7687a3686e8b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Returning 404 to user: Instance c9b161da-e58a-43ac-accc-4c771baf68a4 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:59:41.040438 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-dfff1525-0adf-4ffa-8244-7687a3686e8b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] 10.222.0.23 "GET /compute/v2.1/servers/c9b161da-e58a-43ac-accc-4c771baf68a4" status: 404 len: 111 microversion: 2.1 time: 0.083273 Sep 10 11:59:41.051016 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4bb55d31-b1cb-4961-81cf-d2f4811efe3b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] Calling method '.version_select at 0x7f407240f040>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:41.057583 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2214/4411] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:40 2022] GET /compute/v2.1/servers/c9b161da-e58a-43ac-accc-4c771baf68a4 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:59:41.079591 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4bb55d31-b1cb-4961-81cf-d2f4811efe3b tempest-ServersTestJSON-422071077 tempest-ServersTestJSON-422071077-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-679466197" status: 202 len: 0 microversion: 2.1 time: 0.032527 Sep 10 11:59:41.085371 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2198/4412] 10.222.0.23 () {58 vars in 1218 bytes} [Sat Sep 10 11:59:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-679466197 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:59:41.465122 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f367f67c-21be-4ae8-a0f5-69b5db55fa23 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:41.465890 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f367f67c-21be-4ae8-a0f5-69b5db55fa23 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: dbbeb877-f666-4027-ad81-c7ba83bed007] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:41.478867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f367f67c-21be-4ae8-a0f5-69b5db55fa23 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:41.485877 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f367f67c-21be-4ae8-a0f5-69b5db55fa23 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:41.487509 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f367f67c-21be-4ae8-a0f5-69b5db55fa23 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:41.489305 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f367f67c-21be-4ae8-a0f5-69b5db55fa23 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:41.493667 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f367f67c-21be-4ae8-a0f5-69b5db55fa23 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:41.498609 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f367f67c-21be-4ae8-a0f5-69b5db55fa23 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:42.003114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f367f67c-21be-4ae8-a0f5-69b5db55fa23 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:42.015420 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f367f67c-21be-4ae8-a0f5-69b5db55fa23 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007" status: 200 len: 1314 microversion: 2.1 time: 0.555681 Sep 10 11:59:42.031612 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2215/4413] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:41 2022] GET /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007 => generated 1314 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:42.815097 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-4e9e93f7-52f2-4cde-8dc4-214a97b8c6e2 req-3de4fe0a-16c0-45e9-b8f0-23d0be954e28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbbeb877-f666-4027-ad81-c7ba83bed007", "tag": "d8fc8693-f37a-4be8-8569-a7d5c9e9ae8a"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:59:42.838906 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-4e9e93f7-52f2-4cde-8dc4-214a97b8c6e2 req-3de4fe0a-16c0-45e9-b8f0-23d0be954e28 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:42.841754 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-4e9e93f7-52f2-4cde-8dc4-214a97b8c6e2 req-3de4fe0a-16c0-45e9-b8f0-23d0be954e28 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:42.842373 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-4e9e93f7-52f2-4cde-8dc4-214a97b8c6e2 req-3de4fe0a-16c0-45e9-b8f0-23d0be954e28 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:42.862853 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-4e9e93f7-52f2-4cde-8dc4-214a97b8c6e2 req-3de4fe0a-16c0-45e9-b8f0-23d0be954e28 service nova] Creating event network-changed:d8fc8693-f37a-4be8-8569-a7d5c9e9ae8a for instance dbbeb877-f666-4027-ad81-c7ba83bed007 on n-h2-856895-1 Sep 10 11:59:42.869479 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-4e9e93f7-52f2-4cde-8dc4-214a97b8c6e2 req-3de4fe0a-16c0-45e9-b8f0-23d0be954e28 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058133 Sep 10 11:59:42.870839 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2199/4414] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:59:43.038217 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f885eed0-70d5-4bc1-9f11-9a77812e293d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:43.039511 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f885eed0-70d5-4bc1-9f11-9a77812e293d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: dbbeb877-f666-4027-ad81-c7ba83bed007] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:43.046900 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f885eed0-70d5-4bc1-9f11-9a77812e293d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:43.047428 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f885eed0-70d5-4bc1-9f11-9a77812e293d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:43.047872 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f885eed0-70d5-4bc1-9f11-9a77812e293d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:43.048588 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f885eed0-70d5-4bc1-9f11-9a77812e293d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:43.049045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f885eed0-70d5-4bc1-9f11-9a77812e293d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:43.049473 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f885eed0-70d5-4bc1-9f11-9a77812e293d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:43.499514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f885eed0-70d5-4bc1-9f11-9a77812e293d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:43.508540 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f885eed0-70d5-4bc1-9f11-9a77812e293d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007" status: 200 len: 1314 microversion: 2.1 time: 0.474478 Sep 10 11:59:43.509135 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2216/4415] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:43 2022] GET /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007 => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:44.534106 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a37f9656-672a-43ba-ace9-e43479365fe6 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:44.537890 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a37f9656-672a-43ba-ace9-e43479365fe6 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: dbbeb877-f666-4027-ad81-c7ba83bed007] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:44.559517 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a37f9656-672a-43ba-ace9-e43479365fe6 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:44.560326 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a37f9656-672a-43ba-ace9-e43479365fe6 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:44.560982 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a37f9656-672a-43ba-ace9-e43479365fe6 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:44.569513 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a37f9656-672a-43ba-ace9-e43479365fe6 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:44.570369 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a37f9656-672a-43ba-ace9-e43479365fe6 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:44.571414 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a37f9656-672a-43ba-ace9-e43479365fe6 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:45.104740 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a37f9656-672a-43ba-ace9-e43479365fe6 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:45.117596 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a37f9656-672a-43ba-ace9-e43479365fe6 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007" status: 200 len: 1314 microversion: 2.1 time: 0.588325 Sep 10 11:59:45.118992 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2200/4416] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:44 2022] GET /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007 => generated 1314 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:46.144146 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1e04311b-a991-422f-b458-a020b1cd7bc5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:46.145767 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1e04311b-a991-422f-b458-a020b1cd7bc5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: dbbeb877-f666-4027-ad81-c7ba83bed007] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:46.156075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1e04311b-a991-422f-b458-a020b1cd7bc5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:46.156769 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1e04311b-a991-422f-b458-a020b1cd7bc5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:46.157782 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1e04311b-a991-422f-b458-a020b1cd7bc5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:46.158651 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1e04311b-a991-422f-b458-a020b1cd7bc5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:46.159505 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1e04311b-a991-422f-b458-a020b1cd7bc5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:46.160142 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1e04311b-a991-422f-b458-a020b1cd7bc5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:46.351866 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1e04311b-a991-422f-b458-a020b1cd7bc5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:46.361974 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1e04311b-a991-422f-b458-a020b1cd7bc5 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007" status: 200 len: 1314 microversion: 2.1 time: 0.221934 Sep 10 11:59:46.365076 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2217/4417] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:46 2022] GET /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:47.386395 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-21eb34b5-fc83-4e11-bc54-d302abbf2cf0 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:47.387098 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-21eb34b5-fc83-4e11-bc54-d302abbf2cf0 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: dbbeb877-f666-4027-ad81-c7ba83bed007] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:47.391092 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:59:47.392567 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:59:47.411272 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-21eb34b5-fc83-4e11-bc54-d302abbf2cf0 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:47.411860 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-21eb34b5-fc83-4e11-bc54-d302abbf2cf0 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:47.423409 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-21eb34b5-fc83-4e11-bc54-d302abbf2cf0 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:47.424465 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-21eb34b5-fc83-4e11-bc54-d302abbf2cf0 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:47.425142 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-21eb34b5-fc83-4e11-bc54-d302abbf2cf0 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:47.425394 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-21eb34b5-fc83-4e11-bc54-d302abbf2cf0 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:47.566030 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=4 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:59:47.568195 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=8 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:59:47.679323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-21eb34b5-fc83-4e11-bc54-d302abbf2cf0 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:47.695332 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-21eb34b5-fc83-4e11-bc54-d302abbf2cf0 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007" status: 200 len: 1314 microversion: 2.1 time: 0.313042 Sep 10 11:59:47.696932 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2201/4418] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:47 2022] GET /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007 => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:47.969765 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-ac71cade-d9c9-4bff-9b40-43f51c5bc530 req-43068ac6-529b-437b-aafd-253963645495 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbbeb877-f666-4027-ad81-c7ba83bed007", "name": "network-vif-plugged", "status": "completed", "tag": "d8fc8693-f37a-4be8-8569-a7d5c9e9ae8a"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:59:47.980898 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-ac71cade-d9c9-4bff-9b40-43f51c5bc530 req-43068ac6-529b-437b-aafd-253963645495 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:47.981655 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-ac71cade-d9c9-4bff-9b40-43f51c5bc530 req-43068ac6-529b-437b-aafd-253963645495 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:47.982283 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-ac71cade-d9c9-4bff-9b40-43f51c5bc530 req-43068ac6-529b-437b-aafd-253963645495 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:47.997268 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-ac71cade-d9c9-4bff-9b40-43f51c5bc530 req-43068ac6-529b-437b-aafd-253963645495 service nova] Creating event network-vif-plugged:d8fc8693-f37a-4be8-8569-a7d5c9e9ae8a for instance dbbeb877-f666-4027-ad81-c7ba83bed007 on n-h2-856895-1 Sep 10 11:59:48.004204 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-ac71cade-d9c9-4bff-9b40-43f51c5bc530 req-43068ac6-529b-437b-aafd-253963645495 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.444580 Sep 10 11:59:48.005986 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2218/4419] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:59:48.723079 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0c7c36f6-d477-4158-9e09-800ce9b60557 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:48.724895 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0c7c36f6-d477-4158-9e09-800ce9b60557 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: dbbeb877-f666-4027-ad81-c7ba83bed007] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:48.741886 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c7c36f6-d477-4158-9e09-800ce9b60557 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:48.746138 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c7c36f6-d477-4158-9e09-800ce9b60557 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:48.747084 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c7c36f6-d477-4158-9e09-800ce9b60557 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:48.749630 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c7c36f6-d477-4158-9e09-800ce9b60557 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:48.750300 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c7c36f6-d477-4158-9e09-800ce9b60557 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:48.752934 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c7c36f6-d477-4158-9e09-800ce9b60557 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:49.098416 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0c7c36f6-d477-4158-9e09-800ce9b60557 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:49.160190 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0c7c36f6-d477-4158-9e09-800ce9b60557 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007" status: 200 len: 1314 microversion: 2.1 time: 0.440202 Sep 10 11:59:49.163156 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2202/4420] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:48 2022] GET /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007 => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:50.202710 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8e9445fe-1b82-4d24-993e-727d0e238c94 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:50.203812 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8e9445fe-1b82-4d24-993e-727d0e238c94 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: dbbeb877-f666-4027-ad81-c7ba83bed007] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:50.216695 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e9445fe-1b82-4d24-993e-727d0e238c94 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:50.217359 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e9445fe-1b82-4d24-993e-727d0e238c94 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:50.219111 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e9445fe-1b82-4d24-993e-727d0e238c94 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:50.220178 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e9445fe-1b82-4d24-993e-727d0e238c94 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:50.220641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e9445fe-1b82-4d24-993e-727d0e238c94 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:50.221366 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e9445fe-1b82-4d24-993e-727d0e238c94 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:50.386835 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8e9445fe-1b82-4d24-993e-727d0e238c94 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:50.396029 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8e9445fe-1b82-4d24-993e-727d0e238c94 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007" status: 200 len: 1502 microversion: 2.1 time: 0.209196 Sep 10 11:59:50.405028 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2219/4421] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:50 2022] GET /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007 => generated 1502 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:50.419580 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f2567162-5add-44c0-beca-c66c32ead6cd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:59:50.420133 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f2567162-5add-44c0-beca-c66c32ead6cd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: dbbeb877-f666-4027-ad81-c7ba83bed007] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:50.427370 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f2567162-5add-44c0-beca-c66c32ead6cd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:50.428096 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f2567162-5add-44c0-beca-c66c32ead6cd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:50.428708 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f2567162-5add-44c0-beca-c66c32ead6cd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:50.429602 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f2567162-5add-44c0-beca-c66c32ead6cd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:50.430705 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f2567162-5add-44c0-beca-c66c32ead6cd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:50.431363 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f2567162-5add-44c0-beca-c66c32ead6cd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:50.460674 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-f2567162-5add-44c0-beca-c66c32ead6cd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lazy-loading 'flavor' on Instance uuid dbbeb877-f666-4027-ad81-c7ba83bed007 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 11:59:50.555111 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f2567162-5add-44c0-beca-c66c32ead6cd tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "POST /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007/action" status: 202 len: 0 microversion: 2.1 time: 0.138798 Sep 10 11:59:50.556428 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2203/4422] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 11:59:50 2022] POST /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 11:59:50.565476 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a8fffb33-c5c4-4f88-9aab-a1f2de8a1d09 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:50.566316 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a8fffb33-c5c4-4f88-9aab-a1f2de8a1d09 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: dbbeb877-f666-4027-ad81-c7ba83bed007] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:50.580191 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a8fffb33-c5c4-4f88-9aab-a1f2de8a1d09 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:50.581111 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a8fffb33-c5c4-4f88-9aab-a1f2de8a1d09 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:50.582020 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a8fffb33-c5c4-4f88-9aab-a1f2de8a1d09 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:50.582973 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a8fffb33-c5c4-4f88-9aab-a1f2de8a1d09 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:50.584213 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a8fffb33-c5c4-4f88-9aab-a1f2de8a1d09 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:50.585149 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a8fffb33-c5c4-4f88-9aab-a1f2de8a1d09 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:51.500703 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a8fffb33-c5c4-4f88-9aab-a1f2de8a1d09 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:51.511711 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a8fffb33-c5c4-4f88-9aab-a1f2de8a1d09 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007" status: 200 len: 1510 microversion: 2.1 time: 0.950659 Sep 10 11:59:51.512656 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2220/4423] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:50 2022] GET /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007 => generated 1510 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:52.551572 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b2c05287-bf50-4941-8ab2-e206ba0b505b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:52.553123 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b2c05287-bf50-4941-8ab2-e206ba0b505b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: dbbeb877-f666-4027-ad81-c7ba83bed007] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:52.556605 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:59:52.572528 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2c05287-bf50-4941-8ab2-e206ba0b505b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:52.574259 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2c05287-bf50-4941-8ab2-e206ba0b505b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:52.575925 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2c05287-bf50-4941-8ab2-e206ba0b505b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:52.577287 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2c05287-bf50-4941-8ab2-e206ba0b505b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:52.579120 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2c05287-bf50-4941-8ab2-e206ba0b505b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:52.580871 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2c05287-bf50-4941-8ab2-e206ba0b505b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:52.612094 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 11:59:53.291340 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b2c05287-bf50-4941-8ab2-e206ba0b505b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:53.308571 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b2c05287-bf50-4941-8ab2-e206ba0b505b tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007" status: 200 len: 1493 microversion: 2.1 time: 0.763787 Sep 10 11:59:53.320699 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2204/4424] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:52 2022] GET /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007 => generated 1493 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:53.337364 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-dc4b3cbb-2dd7-4b44-ab67-11c3be212e05 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:53.339901 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-dc4b3cbb-2dd7-4b44-ab67-11c3be212e05 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: dbbeb877-f666-4027-ad81-c7ba83bed007] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:53.348444 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dc4b3cbb-2dd7-4b44-ab67-11c3be212e05 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:53.349269 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dc4b3cbb-2dd7-4b44-ab67-11c3be212e05 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:53.349988 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dc4b3cbb-2dd7-4b44-ab67-11c3be212e05 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:53.352789 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dc4b3cbb-2dd7-4b44-ab67-11c3be212e05 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:53.353714 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dc4b3cbb-2dd7-4b44-ab67-11c3be212e05 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:53.354256 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dc4b3cbb-2dd7-4b44-ab67-11c3be212e05 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:53.399949 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-dc4b3cbb-2dd7-4b44-ab67-11c3be212e05 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: dbbeb877-f666-4027-ad81-c7ba83bed007] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 11:59:53.562482 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-dc4b3cbb-2dd7-4b44-ab67-11c3be212e05 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "DELETE /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007" status: 204 len: 0 microversion: 2.1 time: 0.209934 Sep 10 11:59:53.577225 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2221/4425] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:59:53 2022] DELETE /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 11:59:53.589936 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f87ddc72-acf3-4ddf-b2ea-12517dbb065a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:53.590628 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f87ddc72-acf3-4ddf-b2ea-12517dbb065a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: dbbeb877-f666-4027-ad81-c7ba83bed007] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:53.609638 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f87ddc72-acf3-4ddf-b2ea-12517dbb065a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:53.610621 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f87ddc72-acf3-4ddf-b2ea-12517dbb065a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:53.613664 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f87ddc72-acf3-4ddf-b2ea-12517dbb065a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:53.618095 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f87ddc72-acf3-4ddf-b2ea-12517dbb065a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:53.619492 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f87ddc72-acf3-4ddf-b2ea-12517dbb065a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:53.620117 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f87ddc72-acf3-4ddf-b2ea-12517dbb065a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:53.981288 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f87ddc72-acf3-4ddf-b2ea-12517dbb065a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:53.994541 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f87ddc72-acf3-4ddf-b2ea-12517dbb065a tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007" status: 200 len: 1499 microversion: 2.1 time: 0.413040 Sep 10 11:59:53.995450 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2205/4426] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:53 2022] GET /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007 => generated 1499 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:55.034768 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7d467520-ae36-4b51-a3ca-e317be8f0c72 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:55.038989 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7d467520-ae36-4b51-a3ca-e317be8f0c72 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: dbbeb877-f666-4027-ad81-c7ba83bed007] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:55.076238 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d467520-ae36-4b51-a3ca-e317be8f0c72 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:55.076985 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d467520-ae36-4b51-a3ca-e317be8f0c72 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:55.077597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d467520-ae36-4b51-a3ca-e317be8f0c72 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:55.078509 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d467520-ae36-4b51-a3ca-e317be8f0c72 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:55.079137 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d467520-ae36-4b51-a3ca-e317be8f0c72 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:55.080055 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d467520-ae36-4b51-a3ca-e317be8f0c72 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:55.400429 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7d467520-ae36-4b51-a3ca-e317be8f0c72 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:55.414189 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7d467520-ae36-4b51-a3ca-e317be8f0c72 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007" status: 200 len: 1499 microversion: 2.1 time: 0.397470 Sep 10 11:59:55.415044 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2222/4427] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:55 2022] GET /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007 => generated 1499 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:56.445481 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b272fff8-2875-46d6-a777-f6f6abd81d46 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:56.446163 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b272fff8-2875-46d6-a777-f6f6abd81d46 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: dbbeb877-f666-4027-ad81-c7ba83bed007] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:56.465799 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b272fff8-2875-46d6-a777-f6f6abd81d46 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:56.468128 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b272fff8-2875-46d6-a777-f6f6abd81d46 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:56.468613 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b272fff8-2875-46d6-a777-f6f6abd81d46 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:56.471156 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b272fff8-2875-46d6-a777-f6f6abd81d46 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:56.472932 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b272fff8-2875-46d6-a777-f6f6abd81d46 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:56.476360 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b272fff8-2875-46d6-a777-f6f6abd81d46 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:56.916327 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-15b9f943-a9ed-408a-8941-b105346a2d76 req-56286fae-e686-4074-818a-d3584d03a25b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbbeb877-f666-4027-ad81-c7ba83bed007", "name": "network-vif-deleted", "tag": "d8fc8693-f37a-4be8-8569-a7d5c9e9ae8a"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 11:59:56.951088 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-15b9f943-a9ed-408a-8941-b105346a2d76 req-56286fae-e686-4074-818a-d3584d03a25b service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:56.952420 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-15b9f943-a9ed-408a-8941-b105346a2d76 req-56286fae-e686-4074-818a-d3584d03a25b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:56.954005 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-15b9f943-a9ed-408a-8941-b105346a2d76 req-56286fae-e686-4074-818a-d3584d03a25b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:57.018513 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-15b9f943-a9ed-408a-8941-b105346a2d76 req-56286fae-e686-4074-818a-d3584d03a25b service nova] Creating event network-vif-deleted:d8fc8693-f37a-4be8-8569-a7d5c9e9ae8a for instance dbbeb877-f666-4027-ad81-c7ba83bed007 on n-h2-856895-1 Sep 10 11:59:57.044432 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-15b9f943-a9ed-408a-8941-b105346a2d76 req-56286fae-e686-4074-818a-d3584d03a25b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135195 Sep 10 11:59:57.050484 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2223/4428] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 11:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 11:59:57.371142 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b272fff8-2875-46d6-a777-f6f6abd81d46 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd244789bea974bd99d0f1debebabb54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f92ad05650840f6bb4c8f6134b489ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 11:59:57.382023 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b272fff8-2875-46d6-a777-f6f6abd81d46 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007" status: 200 len: 1499 microversion: 2.1 time: 0.946316 Sep 10 11:59:57.382774 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2206/4429] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:56 2022] GET /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007 => generated 1499 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 11:59:58.412024 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a05cab83-1835-402c-894f-b55925e95b4e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:58.420222 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a05cab83-1835-402c-894f-b55925e95b4e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: dbbeb877-f666-4027-ad81-c7ba83bed007] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:58.449336 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a05cab83-1835-402c-894f-b55925e95b4e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:58.449844 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a05cab83-1835-402c-894f-b55925e95b4e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:58.450289 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a05cab83-1835-402c-894f-b55925e95b4e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:58.451011 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a05cab83-1835-402c-894f-b55925e95b4e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:58.458184 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a05cab83-1835-402c-894f-b55925e95b4e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:58.460048 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a05cab83-1835-402c-894f-b55925e95b4e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:58.487702 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-a05cab83-1835-402c-894f-b55925e95b4e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] HTTP exception thrown: Instance dbbeb877-f666-4027-ad81-c7ba83bed007 could not be found. Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a05cab83-1835-402c-894f-b55925e95b4e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Request method failure captured: Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007 HTTP/1.1 Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHsd-AnnLZFS6-Lbfr9ATef_4cX6EE0Up-a_Ch8dobncDUqljTHX0YcK7WbJaaBcAlN6twvlZe9au1SNJQwC5-nItcb7pEhHjqWyH9GhqCmgS3jEbfUY8st6zk2hVKWMOxRl1E1nEdlCzWIcW0YZf7xPnP7IvCJy_UgVMW4-UpTlv4M Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2f92ad05650840f6bb4c8f6134b489ca", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-DeleteServersTestJSON-419044733 Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-DeleteServersTestJSON-419044733-project Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: d244789bea974bd99d0f1debebabb54a Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-DeleteServersTestJSON-419044733-project Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance dbbeb877-f666-4027-ad81-c7ba83bed007 could not be found. Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'dbbeb877-f666-4027-ad81-c7ba83bed007'} Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbbeb877-f666-4027-ad81-c7ba83bed007 could not be found. Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbbeb877-f666-4027-ad81-c7ba83bed007 could not be found. Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:58.491153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:58.495958 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:58.495958 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:58.495958 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:58.495958 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:59:58.495958 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:59:58.495958 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbbeb877-f666-4027-ad81-c7ba83bed007 could not be found. Sep 10 11:59:58.495958 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:58.500055 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a05cab83-1835-402c-894f-b55925e95b4e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Returning 404 to user: Instance dbbeb877-f666-4027-ad81-c7ba83bed007 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:59:58.501174 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a05cab83-1835-402c-894f-b55925e95b4e tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007" status: 404 len: 111 microversion: 2.1 time: 0.099351 Sep 10 11:59:58.509978 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2224/4430] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:58 2022] GET /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:59:58.519931 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8e1a6c3c-566b-442f-97c1-3557de0cdb94 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:58.520541 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8e1a6c3c-566b-442f-97c1-3557de0cdb94 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: dbbeb877-f666-4027-ad81-c7ba83bed007] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:58.547940 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e1a6c3c-566b-442f-97c1-3557de0cdb94 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:58.548446 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e1a6c3c-566b-442f-97c1-3557de0cdb94 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:58.548909 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e1a6c3c-566b-442f-97c1-3557de0cdb94 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:58.549669 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e1a6c3c-566b-442f-97c1-3557de0cdb94 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:58.550126 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e1a6c3c-566b-442f-97c1-3557de0cdb94 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:58.550672 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e1a6c3c-566b-442f-97c1-3557de0cdb94 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:58.588018 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-8e1a6c3c-566b-442f-97c1-3557de0cdb94 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] HTTP exception thrown: Instance dbbeb877-f666-4027-ad81-c7ba83bed007 could not be found. Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8e1a6c3c-566b-442f-97c1-3557de0cdb94 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Request method failure captured: Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007 HTTP/1.1 Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHsd-AnnLZFS6-Lbfr9ATef_4cX6EE0Up-a_Ch8dobncDUqljTHX0YcK7WbJaaBcAlN6twvlZe9au1SNJQwC5-nItcb7pEhHjqWyH9GhqCmgS3jEbfUY8st6zk2hVKWMOxRl1E1nEdlCzWIcW0YZf7xPnP7IvCJy_UgVMW4-UpTlv4M Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2f92ad05650840f6bb4c8f6134b489ca", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-DeleteServersTestJSON-419044733 Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-DeleteServersTestJSON-419044733-project Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: d244789bea974bd99d0f1debebabb54a Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-DeleteServersTestJSON-419044733-project Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance dbbeb877-f666-4027-ad81-c7ba83bed007 could not be found. Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'dbbeb877-f666-4027-ad81-c7ba83bed007'} Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbbeb877-f666-4027-ad81-c7ba83bed007 could not be found. Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:59:58.613438 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:59:58.618627 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbbeb877-f666-4027-ad81-c7ba83bed007 could not be found. Sep 10 11:59:58.618627 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:58.618627 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:58.618627 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:58.618627 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:58.618627 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:58.618627 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:58.618627 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:59:58.618627 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:59:58.618627 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbbeb877-f666-4027-ad81-c7ba83bed007 could not be found. Sep 10 11:59:58.618627 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:58.618627 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8e1a6c3c-566b-442f-97c1-3557de0cdb94 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Returning 404 to user: Instance dbbeb877-f666-4027-ad81-c7ba83bed007 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:59:58.618627 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8e1a6c3c-566b-442f-97c1-3557de0cdb94 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "DELETE /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007" status: 404 len: 111 microversion: 2.1 time: 0.107562 Sep 10 11:59:58.627333 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2207/4431] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:59:58 2022] DELETE /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:59:58.628299 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3ed5616e-72e8-481a-bfde-c80b096a2df2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:58.628925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3ed5616e-72e8-481a-bfde-c80b096a2df2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: dbbeb877-f666-4027-ad81-c7ba83bed007] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:58.641119 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3ed5616e-72e8-481a-bfde-c80b096a2df2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:58.657068 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3ed5616e-72e8-481a-bfde-c80b096a2df2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:58.661765 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3ed5616e-72e8-481a-bfde-c80b096a2df2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:58.666354 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3ed5616e-72e8-481a-bfde-c80b096a2df2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:58.667018 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3ed5616e-72e8-481a-bfde-c80b096a2df2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:58.668643 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3ed5616e-72e8-481a-bfde-c80b096a2df2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:58.718092 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-3ed5616e-72e8-481a-bfde-c80b096a2df2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] HTTP exception thrown: Instance dbbeb877-f666-4027-ad81-c7ba83bed007 could not be found. Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3ed5616e-72e8-481a-bfde-c80b096a2df2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Request method failure captured: Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007 HTTP/1.1 Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHsd-AnnLZFS6-Lbfr9ATef_4cX6EE0Up-a_Ch8dobncDUqljTHX0YcK7WbJaaBcAlN6twvlZe9au1SNJQwC5-nItcb7pEhHjqWyH9GhqCmgS3jEbfUY8st6zk2hVKWMOxRl1E1nEdlCzWIcW0YZf7xPnP7IvCJy_UgVMW4-UpTlv4M Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2f92ad05650840f6bb4c8f6134b489ca", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-DeleteServersTestJSON-419044733 Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-DeleteServersTestJSON-419044733-project Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: d244789bea974bd99d0f1debebabb54a Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-DeleteServersTestJSON-419044733-project Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance dbbeb877-f666-4027-ad81-c7ba83bed007 could not be found. Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'dbbeb877-f666-4027-ad81-c7ba83bed007'} Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbbeb877-f666-4027-ad81-c7ba83bed007 could not be found. Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbbeb877-f666-4027-ad81-c7ba83bed007 could not be found. Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:58.722096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:58.726217 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:58.726217 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:58.726217 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:58.726217 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:59:58.726217 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:59:58.726217 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbbeb877-f666-4027-ad81-c7ba83bed007 could not be found. Sep 10 11:59:58.726217 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:58.726217 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3ed5616e-72e8-481a-bfde-c80b096a2df2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Returning 404 to user: Instance dbbeb877-f666-4027-ad81-c7ba83bed007 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:59:58.726715 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3ed5616e-72e8-481a-bfde-c80b096a2df2 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007" status: 404 len: 111 microversion: 2.1 time: 0.102285 Sep 10 11:59:58.735682 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2225/4432] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:58 2022] GET /compute/v2.1/servers/dbbeb877-f666-4027-ad81-c7ba83bed007 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:59:58.737661 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-326359d2-4098-414d-bbf5-d3670c64e6b0 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:58.738166 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-326359d2-4098-414d-bbf5-d3670c64e6b0 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: adde25b7-c5c7-46fa-b4e9-f80a11568f3c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:58.748481 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-326359d2-4098-414d-bbf5-d3670c64e6b0 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:58.749218 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-326359d2-4098-414d-bbf5-d3670c64e6b0 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:58.749854 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-326359d2-4098-414d-bbf5-d3670c64e6b0 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:58.751484 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-326359d2-4098-414d-bbf5-d3670c64e6b0 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:58.752337 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-326359d2-4098-414d-bbf5-d3670c64e6b0 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:58.752939 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-326359d2-4098-414d-bbf5-d3670c64e6b0 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:58.774441 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-326359d2-4098-414d-bbf5-d3670c64e6b0 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] HTTP exception thrown: Instance adde25b7-c5c7-46fa-b4e9-f80a11568f3c could not be found. Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-326359d2-4098-414d-bbf5-d3670c64e6b0 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Request method failure captured: Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c HTTP/1.1 Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHsd-AnnLZFS6-Lbfr9ATef_4cX6EE0Up-a_Ch8dobncDUqljTHX0YcK7WbJaaBcAlN6twvlZe9au1SNJQwC5-nItcb7pEhHjqWyH9GhqCmgS3jEbfUY8st6zk2hVKWMOxRl1E1nEdlCzWIcW0YZf7xPnP7IvCJy_UgVMW4-UpTlv4M Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2f92ad05650840f6bb4c8f6134b489ca", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-DeleteServersTestJSON-419044733 Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-DeleteServersTestJSON-419044733-project Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: d244789bea974bd99d0f1debebabb54a Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-DeleteServersTestJSON-419044733-project Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance adde25b7-c5c7-46fa-b4e9-f80a11568f3c could not be found. Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'adde25b7-c5c7-46fa-b4e9-f80a11568f3c'} Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adde25b7-c5c7-46fa-b4e9-f80a11568f3c could not be found. Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:59:58.777048 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:59:58.781590 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adde25b7-c5c7-46fa-b4e9-f80a11568f3c could not be found. Sep 10 11:59:58.781590 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:58.781590 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:58.781590 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:58.781590 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:58.781590 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:58.781590 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:58.781590 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:59:58.781590 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:59:58.781590 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adde25b7-c5c7-46fa-b4e9-f80a11568f3c could not be found. Sep 10 11:59:58.781590 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:58.783405 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-326359d2-4098-414d-bbf5-d3670c64e6b0 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Returning 404 to user: Instance adde25b7-c5c7-46fa-b4e9-f80a11568f3c could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:59:58.784436 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-326359d2-4098-414d-bbf5-d3670c64e6b0 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "DELETE /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c" status: 404 len: 111 microversion: 2.1 time: 0.051860 Sep 10 11:59:58.785521 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2208/4433] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:59:58 2022] DELETE /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 11:59:58.793313 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3a9e674a-7e33-4ee8-a021-54832136b22d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:58.793940 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3a9e674a-7e33-4ee8-a021-54832136b22d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: adde25b7-c5c7-46fa-b4e9-f80a11568f3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:58.809587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a9e674a-7e33-4ee8-a021-54832136b22d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:58.809993 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a9e674a-7e33-4ee8-a021-54832136b22d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:58.810436 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a9e674a-7e33-4ee8-a021-54832136b22d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:58.811150 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a9e674a-7e33-4ee8-a021-54832136b22d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:58.822241 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a9e674a-7e33-4ee8-a021-54832136b22d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:58.822773 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a9e674a-7e33-4ee8-a021-54832136b22d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:58.853786 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-3a9e674a-7e33-4ee8-a021-54832136b22d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] HTTP exception thrown: Instance adde25b7-c5c7-46fa-b4e9-f80a11568f3c could not be found. Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3a9e674a-7e33-4ee8-a021-54832136b22d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Request method failure captured: Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c HTTP/1.1 Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHsd-AnnLZFS6-Lbfr9ATef_4cX6EE0Up-a_Ch8dobncDUqljTHX0YcK7WbJaaBcAlN6twvlZe9au1SNJQwC5-nItcb7pEhHjqWyH9GhqCmgS3jEbfUY8st6zk2hVKWMOxRl1E1nEdlCzWIcW0YZf7xPnP7IvCJy_UgVMW4-UpTlv4M Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2f92ad05650840f6bb4c8f6134b489ca", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-DeleteServersTestJSON-419044733 Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-DeleteServersTestJSON-419044733-project Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: d244789bea974bd99d0f1debebabb54a Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-DeleteServersTestJSON-419044733-project Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance adde25b7-c5c7-46fa-b4e9-f80a11568f3c could not be found. Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'adde25b7-c5c7-46fa-b4e9-f80a11568f3c'} Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adde25b7-c5c7-46fa-b4e9-f80a11568f3c could not be found. Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adde25b7-c5c7-46fa-b4e9-f80a11568f3c could not be found. Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:58.856182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:58.860931 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:58.860931 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:58.860931 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:58.860931 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:59:58.860931 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:59:58.860931 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adde25b7-c5c7-46fa-b4e9-f80a11568f3c could not be found. Sep 10 11:59:58.860931 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:58.865051 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3a9e674a-7e33-4ee8-a021-54832136b22d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Returning 404 to user: Instance adde25b7-c5c7-46fa-b4e9-f80a11568f3c could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:59:58.869193 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3a9e674a-7e33-4ee8-a021-54832136b22d tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c" status: 404 len: 111 microversion: 2.1 time: 0.079594 Sep 10 11:59:58.870342 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2226/4434] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:58 2022] GET /compute/v2.1/servers/adde25b7-c5c7-46fa-b4e9-f80a11568f3c => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:59:58.878725 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4e55982e-f245-48fe-86d1-62faf787f6c8 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:58.879585 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4e55982e-f245-48fe-86d1-62faf787f6c8 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:58.888613 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e55982e-f245-48fe-86d1-62faf787f6c8 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:58.891052 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e55982e-f245-48fe-86d1-62faf787f6c8 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:58.891585 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e55982e-f245-48fe-86d1-62faf787f6c8 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:58.892454 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e55982e-f245-48fe-86d1-62faf787f6c8 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:58.893073 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e55982e-f245-48fe-86d1-62faf787f6c8 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:58.905949 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e55982e-f245-48fe-86d1-62faf787f6c8 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:58.947342 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-4e55982e-f245-48fe-86d1-62faf787f6c8 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] HTTP exception thrown: Instance 7063ea81-230e-4cee-902b-76c44ebd2d74 could not be found. Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4e55982e-f245-48fe-86d1-62faf787f6c8 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Request method failure captured: Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 HTTP/1.1 Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHsd-AnnLZFS6-Lbfr9ATef_4cX6EE0Up-a_Ch8dobncDUqljTHX0YcK7WbJaaBcAlN6twvlZe9au1SNJQwC5-nItcb7pEhHjqWyH9GhqCmgS3jEbfUY8st6zk2hVKWMOxRl1E1nEdlCzWIcW0YZf7xPnP7IvCJy_UgVMW4-UpTlv4M Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2f92ad05650840f6bb4c8f6134b489ca", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-DeleteServersTestJSON-419044733 Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-DeleteServersTestJSON-419044733-project Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: d244789bea974bd99d0f1debebabb54a Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-DeleteServersTestJSON-419044733-project Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 7063ea81-230e-4cee-902b-76c44ebd2d74 could not be found. Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '7063ea81-230e-4cee-902b-76c44ebd2d74'} Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7063ea81-230e-4cee-902b-76c44ebd2d74 could not be found. Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:59:58.949228 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:59:58.953682 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7063ea81-230e-4cee-902b-76c44ebd2d74 could not be found. Sep 10 11:59:58.953682 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:58.953682 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:58.953682 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:58.953682 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:58.953682 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:58.953682 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:58.953682 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:59:58.953682 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:59:58.953682 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7063ea81-230e-4cee-902b-76c44ebd2d74 could not be found. Sep 10 11:59:58.953682 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:58.955529 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4e55982e-f245-48fe-86d1-62faf787f6c8 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Returning 404 to user: Instance 7063ea81-230e-4cee-902b-76c44ebd2d74 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:59:58.956924 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4e55982e-f245-48fe-86d1-62faf787f6c8 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 404 len: 111 microversion: 2.1 time: 0.082143 Sep 10 11:59:58.959361 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2209/4435] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:59:58 2022] DELETE /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:59:58.970716 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3bc9ae53-b6dd-40af-96ab-9ce3b20ac3a9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:58.971781 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3bc9ae53-b6dd-40af-96ab-9ce3b20ac3a9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 7063ea81-230e-4cee-902b-76c44ebd2d74] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:58.978536 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3bc9ae53-b6dd-40af-96ab-9ce3b20ac3a9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:58.979421 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3bc9ae53-b6dd-40af-96ab-9ce3b20ac3a9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:58.980100 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3bc9ae53-b6dd-40af-96ab-9ce3b20ac3a9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:58.981027 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3bc9ae53-b6dd-40af-96ab-9ce3b20ac3a9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:58.981866 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3bc9ae53-b6dd-40af-96ab-9ce3b20ac3a9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:58.982512 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3bc9ae53-b6dd-40af-96ab-9ce3b20ac3a9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:58.999432 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-3bc9ae53-b6dd-40af-96ab-9ce3b20ac3a9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] HTTP exception thrown: Instance 7063ea81-230e-4cee-902b-76c44ebd2d74 could not be found. Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3bc9ae53-b6dd-40af-96ab-9ce3b20ac3a9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Request method failure captured: Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 HTTP/1.1 Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHsd-AnnLZFS6-Lbfr9ATef_4cX6EE0Up-a_Ch8dobncDUqljTHX0YcK7WbJaaBcAlN6twvlZe9au1SNJQwC5-nItcb7pEhHjqWyH9GhqCmgS3jEbfUY8st6zk2hVKWMOxRl1E1nEdlCzWIcW0YZf7xPnP7IvCJy_UgVMW4-UpTlv4M Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2f92ad05650840f6bb4c8f6134b489ca", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-DeleteServersTestJSON-419044733 Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-DeleteServersTestJSON-419044733-project Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: d244789bea974bd99d0f1debebabb54a Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-DeleteServersTestJSON-419044733-project Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 7063ea81-230e-4cee-902b-76c44ebd2d74 could not be found. Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '7063ea81-230e-4cee-902b-76c44ebd2d74'} Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7063ea81-230e-4cee-902b-76c44ebd2d74 could not be found. Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7063ea81-230e-4cee-902b-76c44ebd2d74 could not be found. Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:59.006576 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:59.010485 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:59.010485 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:59.010485 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:59.010485 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:59:59.010485 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:59:59.010485 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7063ea81-230e-4cee-902b-76c44ebd2d74 could not be found. Sep 10 11:59:59.010485 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:59.014892 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3bc9ae53-b6dd-40af-96ab-9ce3b20ac3a9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Returning 404 to user: Instance 7063ea81-230e-4cee-902b-76c44ebd2d74 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:59:59.016114 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3bc9ae53-b6dd-40af-96ab-9ce3b20ac3a9 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74" status: 404 len: 111 microversion: 2.1 time: 0.052656 Sep 10 11:59:59.019521 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2227/4436] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:58 2022] GET /compute/v2.1/servers/7063ea81-230e-4cee-902b-76c44ebd2d74 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 11:59:59.029918 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-399875c0-294a-40c7-9e14-75d8f1e9aa80 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:59.030435 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-399875c0-294a-40c7-9e14-75d8f1e9aa80 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 476ea519-5dea-4143-93b7-46458d92bab3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:59.041192 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-399875c0-294a-40c7-9e14-75d8f1e9aa80 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:59.041684 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-399875c0-294a-40c7-9e14-75d8f1e9aa80 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:59.042128 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-399875c0-294a-40c7-9e14-75d8f1e9aa80 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:59.042839 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-399875c0-294a-40c7-9e14-75d8f1e9aa80 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:59.043326 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-399875c0-294a-40c7-9e14-75d8f1e9aa80 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:59.043756 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-399875c0-294a-40c7-9e14-75d8f1e9aa80 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:59.078332 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-399875c0-294a-40c7-9e14-75d8f1e9aa80 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] HTTP exception thrown: Instance 476ea519-5dea-4143-93b7-46458d92bab3 could not be found. Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-399875c0-294a-40c7-9e14-75d8f1e9aa80 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Request method failure captured: Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3 HTTP/1.1 Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHsd-AnnLZFS6-Lbfr9ATef_4cX6EE0Up-a_Ch8dobncDUqljTHX0YcK7WbJaaBcAlN6twvlZe9au1SNJQwC5-nItcb7pEhHjqWyH9GhqCmgS3jEbfUY8st6zk2hVKWMOxRl1E1nEdlCzWIcW0YZf7xPnP7IvCJy_UgVMW4-UpTlv4M Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2f92ad05650840f6bb4c8f6134b489ca", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-DeleteServersTestJSON-419044733 Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-DeleteServersTestJSON-419044733-project Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: d244789bea974bd99d0f1debebabb54a Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-DeleteServersTestJSON-419044733-project Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 476ea519-5dea-4143-93b7-46458d92bab3 could not be found. Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '476ea519-5dea-4143-93b7-46458d92bab3'} Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 476ea519-5dea-4143-93b7-46458d92bab3 could not be found. Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:59:59.086014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:59:59.089837 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 476ea519-5dea-4143-93b7-46458d92bab3 could not be found. Sep 10 11:59:59.089837 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:59.089837 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:59.089837 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:59.089837 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:59.089837 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:59.089837 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:59.089837 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:59:59.089837 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:59:59.089837 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 476ea519-5dea-4143-93b7-46458d92bab3 could not be found. Sep 10 11:59:59.089837 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:59.097688 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-399875c0-294a-40c7-9e14-75d8f1e9aa80 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Returning 404 to user: Instance 476ea519-5dea-4143-93b7-46458d92bab3 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:59:59.099528 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-399875c0-294a-40c7-9e14-75d8f1e9aa80 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "DELETE /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3" status: 404 len: 111 microversion: 2.1 time: 0.074675 Sep 10 11:59:59.121309 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2210/4437] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:59:59 2022] DELETE /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:59:59.129847 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b936862c-7dfb-4d5b-9a58-2069e837ee95 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:59.130500 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b936862c-7dfb-4d5b-9a58-2069e837ee95 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 476ea519-5dea-4143-93b7-46458d92bab3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:59.146661 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b936862c-7dfb-4d5b-9a58-2069e837ee95 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:59.147701 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b936862c-7dfb-4d5b-9a58-2069e837ee95 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:59.148473 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b936862c-7dfb-4d5b-9a58-2069e837ee95 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:59.152873 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b936862c-7dfb-4d5b-9a58-2069e837ee95 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 11:59:59.153684 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b936862c-7dfb-4d5b-9a58-2069e837ee95 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 11:59:59.154450 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b936862c-7dfb-4d5b-9a58-2069e837ee95 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 11:59:59.194845 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-b936862c-7dfb-4d5b-9a58-2069e837ee95 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] HTTP exception thrown: Instance 476ea519-5dea-4143-93b7-46458d92bab3 could not be found. Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b936862c-7dfb-4d5b-9a58-2069e837ee95 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Request method failure captured: Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3 HTTP/1.1 Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHsd-AnnLZFS6-Lbfr9ATef_4cX6EE0Up-a_Ch8dobncDUqljTHX0YcK7WbJaaBcAlN6twvlZe9au1SNJQwC5-nItcb7pEhHjqWyH9GhqCmgS3jEbfUY8st6zk2hVKWMOxRl1E1nEdlCzWIcW0YZf7xPnP7IvCJy_UgVMW4-UpTlv4M Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2f92ad05650840f6bb4c8f6134b489ca", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-DeleteServersTestJSON-419044733 Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-DeleteServersTestJSON-419044733-project Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: d244789bea974bd99d0f1debebabb54a Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-DeleteServersTestJSON-419044733-project Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 476ea519-5dea-4143-93b7-46458d92bab3 could not be found. Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '476ea519-5dea-4143-93b7-46458d92bab3'} Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 476ea519-5dea-4143-93b7-46458d92bab3 could not be found. Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 476ea519-5dea-4143-93b7-46458d92bab3 could not be found. Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:59.196758 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:59.201269 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:59.201269 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:59.201269 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:59.201269 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:59:59.201269 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:59:59.201269 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 476ea519-5dea-4143-93b7-46458d92bab3 could not be found. Sep 10 11:59:59.201269 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:59.202993 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b936862c-7dfb-4d5b-9a58-2069e837ee95 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Returning 404 to user: Instance 476ea519-5dea-4143-93b7-46458d92bab3 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:59:59.204294 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b936862c-7dfb-4d5b-9a58-2069e837ee95 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3" status: 404 len: 111 microversion: 2.1 time: 0.078869 Sep 10 11:59:59.205378 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2228/4438] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:59 2022] GET /compute/v2.1/servers/476ea519-5dea-4143-93b7-46458d92bab3 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:59:59.216243 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-588dc373-ca94-452f-bf07-7ff4576cc4cb tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:59.216742 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-588dc373-ca94-452f-bf07-7ff4576cc4cb tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 5ec4b140-3d97-40f1-a497-1868e5eb56a5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:59.226909 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-588dc373-ca94-452f-bf07-7ff4576cc4cb tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] HTTP exception thrown: Instance 5ec4b140-3d97-40f1-a497-1868e5eb56a5 could not be found. Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-588dc373-ca94-452f-bf07-7ff4576cc4cb tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Request method failure captured: Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/servers/5ec4b140-3d97-40f1-a497-1868e5eb56a5 HTTP/1.1 Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHsd-AnnLZFS6-Lbfr9ATef_4cX6EE0Up-a_Ch8dobncDUqljTHX0YcK7WbJaaBcAlN6twvlZe9au1SNJQwC5-nItcb7pEhHjqWyH9GhqCmgS3jEbfUY8st6zk2hVKWMOxRl1E1nEdlCzWIcW0YZf7xPnP7IvCJy_UgVMW4-UpTlv4M Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2f92ad05650840f6bb4c8f6134b489ca", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-DeleteServersTestJSON-419044733 Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-DeleteServersTestJSON-419044733-project Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: d244789bea974bd99d0f1debebabb54a Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-DeleteServersTestJSON-419044733-project Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 5ec4b140-3d97-40f1-a497-1868e5eb56a5 could not be found. Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '5ec4b140-3d97-40f1-a497-1868e5eb56a5'} Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ec4b140-3d97-40f1-a497-1868e5eb56a5 could not be found. Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ec4b140-3d97-40f1-a497-1868e5eb56a5 could not be found. Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:59.228788 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:59.235630 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:59.235630 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:59.235630 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:59.235630 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:59:59.235630 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:59:59.235630 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ec4b140-3d97-40f1-a497-1868e5eb56a5 could not be found. Sep 10 11:59:59.235630 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 11:59:59.235630 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-588dc373-ca94-452f-bf07-7ff4576cc4cb tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Returning 404 to user: Instance 5ec4b140-3d97-40f1-a497-1868e5eb56a5 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:59:59.235630 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-588dc373-ca94-452f-bf07-7ff4576cc4cb tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5ec4b140-3d97-40f1-a497-1868e5eb56a5" status: 404 len: 111 microversion: 2.1 time: 0.019895 Sep 10 11:59:59.235630 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2211/4439] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 11:59:59 2022] DELETE /compute/v2.1/servers/5ec4b140-3d97-40f1-a497-1868e5eb56a5 => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 11:59:59.238833 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0a9c3c59-005e-4c3d-909f-d3c68eda7d5c tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 11:59:59.239691 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0a9c3c59-005e-4c3d-909f-d3c68eda7d5c tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 5ec4b140-3d97-40f1-a497-1868e5eb56a5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 11:59:59.252924 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-0a9c3c59-005e-4c3d-909f-d3c68eda7d5c tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] HTTP exception thrown: Instance 5ec4b140-3d97-40f1-a497-1868e5eb56a5 could not be found. Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0a9c3c59-005e-4c3d-909f-d3c68eda7d5c tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Request method failure captured: Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/5ec4b140-3d97-40f1-a497-1868e5eb56a5 HTTP/1.1 Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHsd-AnnLZFS6-Lbfr9ATef_4cX6EE0Up-a_Ch8dobncDUqljTHX0YcK7WbJaaBcAlN6twvlZe9au1SNJQwC5-nItcb7pEhHjqWyH9GhqCmgS3jEbfUY8st6zk2hVKWMOxRl1E1nEdlCzWIcW0YZf7xPnP7IvCJy_UgVMW4-UpTlv4M Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2f92ad05650840f6bb4c8f6134b489ca", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-DeleteServersTestJSON-419044733 Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-DeleteServersTestJSON-419044733-project Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: d244789bea974bd99d0f1debebabb54a Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-DeleteServersTestJSON-419044733-project Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 5ec4b140-3d97-40f1-a497-1868e5eb56a5 could not be found. Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '5ec4b140-3d97-40f1-a497-1868e5eb56a5'} Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ec4b140-3d97-40f1-a497-1868e5eb56a5 could not be found. Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ec4b140-3d97-40f1-a497-1868e5eb56a5 could not be found. Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 11:59:59.254504 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 11:59:59.261376 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 11:59:59.261376 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 11:59:59.261376 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 11:59:59.261376 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ec4b140-3d97-40f1-a497-1868e5eb56a5 could not be found. Sep 10 11:59:59.261376 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 11:59:59.271571 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0a9c3c59-005e-4c3d-909f-d3c68eda7d5c tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Returning 404 to user: Instance 5ec4b140-3d97-40f1-a497-1868e5eb56a5 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 11:59:59.271571 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0a9c3c59-005e-4c3d-909f-d3c68eda7d5c tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/5ec4b140-3d97-40f1-a497-1868e5eb56a5" status: 404 len: 111 microversion: 2.1 time: 0.035654 Sep 10 11:59:59.284911 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2229/4440] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 11:59:59 2022] GET /compute/v2.1/servers/5ec4b140-3d97-40f1-a497-1868e5eb56a5 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:00:01.440086 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5b5ab88e-265f-4f71-a3f6-4d7108580e60 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-255194166", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "06b1c8b6-b4ad-4538-9043-33684b3b5b43"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:00:01.574007 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-5b5ab88e-265f-4f71-a3f6-4d7108580e60 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] validate_networks() for [('06b1c8b6-b4ad-4538-9043-33684b3b5b43', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:00:02.990485 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-5b5ab88e-265f-4f71-a3f6-4d7108580e60 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:00:02.992405 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-5b5ab88e-265f-4f71-a3f6-4d7108580e60 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:00:02.993068 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-5b5ab88e-265f-4f71-a3f6-4d7108580e60 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:00:02.993685 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-5b5ab88e-265f-4f71-a3f6-4d7108580e60 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:00:02.994284 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-5b5ab88e-265f-4f71-a3f6-4d7108580e60 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:00:03.013725 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b5ab88e-265f-4f71-a3f6-4d7108580e60 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:03.014482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b5ab88e-265f-4f71-a3f6-4d7108580e60 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:03.015120 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b5ab88e-265f-4f71-a3f6-4d7108580e60 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:03.016655 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b5ab88e-265f-4f71-a3f6-4d7108580e60 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:03.019612 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b5ab88e-265f-4f71-a3f6-4d7108580e60 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:03.020422 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b5ab88e-265f-4f71-a3f6-4d7108580e60 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:03.065817 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-5b5ab88e-265f-4f71-a3f6-4d7108580e60 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Getting quotas for project f5b3564725094507aaa3ba0e23e24e45. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:00:03.080764 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-5b5ab88e-265f-4f71-a3f6-4d7108580e60 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Getting quotas for user bb9eb8af88f648878d231e7ce4ff11c0 and project f5b3564725094507aaa3ba0e23e24e45. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:00:03.112002 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5b5ab88e-265f-4f71-a3f6-4d7108580e60 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:00:03.115144 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5b5ab88e-265f-4f71-a3f6-4d7108580e60 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] [instance: cd080272-b545-40ab-9639-64f0665eba08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:00:03.215271 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5b5ab88e-265f-4f71-a3f6-4d7108580e60 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.014729 Sep 10 12:00:03.226587 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2212/4441] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:00:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:00:03.229067 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6abc34d0-c1bd-45f7-a9cf-6c6437b393f8 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:03.229696 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6abc34d0-c1bd-45f7-a9cf-6c6437b393f8 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] [instance: cd080272-b545-40ab-9639-64f0665eba08] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:03.360942 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6abc34d0-c1bd-45f7-a9cf-6c6437b393f8 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9eb8af88f648878d231e7ce4ff11c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b3564725094507aaa3ba0e23e24e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:03.369448 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6abc34d0-c1bd-45f7-a9cf-6c6437b393f8 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] 10.222.0.23 "GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08" status: 200 len: 1216 microversion: 2.1 time: 0.145561 Sep 10 12:00:03.383191 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2230/4442] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:03 2022] GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08 => generated 1216 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:04.400265 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7c9d4a0a-206c-4997-8fe6-e2c984de1c45 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:04.401783 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7c9d4a0a-206c-4997-8fe6-e2c984de1c45 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] [instance: cd080272-b545-40ab-9639-64f0665eba08] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:04.409469 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7c9d4a0a-206c-4997-8fe6-e2c984de1c45 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:04.415490 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7c9d4a0a-206c-4997-8fe6-e2c984de1c45 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:04.416175 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7c9d4a0a-206c-4997-8fe6-e2c984de1c45 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:04.417375 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7c9d4a0a-206c-4997-8fe6-e2c984de1c45 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:04.418046 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7c9d4a0a-206c-4997-8fe6-e2c984de1c45 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:04.418862 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7c9d4a0a-206c-4997-8fe6-e2c984de1c45 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:04.691665 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7c9d4a0a-206c-4997-8fe6-e2c984de1c45 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9eb8af88f648878d231e7ce4ff11c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b3564725094507aaa3ba0e23e24e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:04.702567 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7c9d4a0a-206c-4997-8fe6-e2c984de1c45 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] 10.222.0.23 "GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08" status: 200 len: 1268 microversion: 2.1 time: 0.309979 Sep 10 12:00:04.707943 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2213/4443] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:04 2022] GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08 => generated 1268 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:04.828212 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-994902e5-221a-447b-b1bb-d3f1331b3dbc tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:04.830793 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-994902e5-221a-447b-b1bb-d3f1331b3dbc tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:04.839434 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-994902e5-221a-447b-b1bb-d3f1331b3dbc tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:04.840654 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-994902e5-221a-447b-b1bb-d3f1331b3dbc tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:04.841406 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-994902e5-221a-447b-b1bb-d3f1331b3dbc tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:04.842778 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-994902e5-221a-447b-b1bb-d3f1331b3dbc tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:04.843630 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-994902e5-221a-447b-b1bb-d3f1331b3dbc tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:04.844773 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-994902e5-221a-447b-b1bb-d3f1331b3dbc tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:05.108318 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-994902e5-221a-447b-b1bb-d3f1331b3dbc tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lazy-loading 'services' on Instance uuid 74075ab0-826c-4b95-9660-e3417ec2b1f4 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:00:05.121309 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ec4009e8-aef8-4688-955b-55fd63dc35db tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:05.121825 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ec4009e8-aef8-4688-955b-55fd63dc35db tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 9da5b114-2ad4-41f0-897f-d4e2984f5a16] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:05.132267 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec4009e8-aef8-4688-955b-55fd63dc35db tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:05.132776 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec4009e8-aef8-4688-955b-55fd63dc35db tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:05.148207 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec4009e8-aef8-4688-955b-55fd63dc35db tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:05.150668 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec4009e8-aef8-4688-955b-55fd63dc35db tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:05.151434 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec4009e8-aef8-4688-955b-55fd63dc35db tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:05.152178 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec4009e8-aef8-4688-955b-55fd63dc35db tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:05.200321 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-ec4009e8-aef8-4688-955b-55fd63dc35db tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] HTTP exception thrown: Instance 9da5b114-2ad4-41f0-897f-d4e2984f5a16 could not be found. Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ec4009e8-aef8-4688-955b-55fd63dc35db tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Request method failure captured: Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16 HTTP/1.1 Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHsd-AnnLZFS6-Lbfr9ATef_4cX6EE0Up-a_Ch8dobncDUqljTHX0YcK7WbJaaBcAlN6twvlZe9au1SNJQwC5-nItcb7pEhHjqWyH9GhqCmgS3jEbfUY8st6zk2hVKWMOxRl1E1nEdlCzWIcW0YZf7xPnP7IvCJy_UgVMW4-UpTlv4M Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2f92ad05650840f6bb4c8f6134b489ca", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-DeleteServersTestJSON-419044733 Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-DeleteServersTestJSON-419044733-project Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: d244789bea974bd99d0f1debebabb54a Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-DeleteServersTestJSON-419044733-project Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 9da5b114-2ad4-41f0-897f-d4e2984f5a16 could not be found. Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '9da5b114-2ad4-41f0-897f-d4e2984f5a16'} Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9da5b114-2ad4-41f0-897f-d4e2984f5a16 could not be found. Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:00:05.202212 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:00:05.206245 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9da5b114-2ad4-41f0-897f-d4e2984f5a16 could not be found. Sep 10 12:00:05.206245 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:00:05.206245 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:00:05.206245 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:00:05.206245 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:00:05.206245 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:00:05.206245 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:00:05.206245 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:00:05.206245 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:00:05.206245 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9da5b114-2ad4-41f0-897f-d4e2984f5a16 could not be found. Sep 10 12:00:05.206245 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:00:05.210574 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ec4009e8-aef8-4688-955b-55fd63dc35db tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Returning 404 to user: Instance 9da5b114-2ad4-41f0-897f-d4e2984f5a16 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:00:05.227725 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ec4009e8-aef8-4688-955b-55fd63dc35db tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16" status: 404 len: 111 microversion: 2.1 time: 0.102376 Sep 10 12:00:05.233212 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2214/4444] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:00:05 2022] DELETE /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:00:05.264802 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3099816c-c663-41e5-b939-18c66b2d65d7 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:05.267277 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3099816c-c663-41e5-b939-18c66b2d65d7 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: 9da5b114-2ad4-41f0-897f-d4e2984f5a16] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:05.281054 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3099816c-c663-41e5-b939-18c66b2d65d7 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:05.281912 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3099816c-c663-41e5-b939-18c66b2d65d7 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:05.283856 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3099816c-c663-41e5-b939-18c66b2d65d7 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:05.284857 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3099816c-c663-41e5-b939-18c66b2d65d7 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:05.287841 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3099816c-c663-41e5-b939-18c66b2d65d7 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:05.288574 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3099816c-c663-41e5-b939-18c66b2d65d7 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:05.325012 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-3099816c-c663-41e5-b939-18c66b2d65d7 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] HTTP exception thrown: Instance 9da5b114-2ad4-41f0-897f-d4e2984f5a16 could not be found. Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3099816c-c663-41e5-b939-18c66b2d65d7 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Request method failure captured: Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16 HTTP/1.1 Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHsd-AnnLZFS6-Lbfr9ATef_4cX6EE0Up-a_Ch8dobncDUqljTHX0YcK7WbJaaBcAlN6twvlZe9au1SNJQwC5-nItcb7pEhHjqWyH9GhqCmgS3jEbfUY8st6zk2hVKWMOxRl1E1nEdlCzWIcW0YZf7xPnP7IvCJy_UgVMW4-UpTlv4M Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2f92ad05650840f6bb4c8f6134b489ca", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-DeleteServersTestJSON-419044733 Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-DeleteServersTestJSON-419044733-project Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: d244789bea974bd99d0f1debebabb54a Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-DeleteServersTestJSON-419044733-project Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 9da5b114-2ad4-41f0-897f-d4e2984f5a16 could not be found. Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '9da5b114-2ad4-41f0-897f-d4e2984f5a16'} Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9da5b114-2ad4-41f0-897f-d4e2984f5a16 could not be found. Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9da5b114-2ad4-41f0-897f-d4e2984f5a16 could not be found. Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:00:05.337072 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:00:05.341162 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:00:05.341162 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:00:05.341162 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:00:05.341162 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:00:05.341162 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:00:05.341162 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9da5b114-2ad4-41f0-897f-d4e2984f5a16 could not be found. Sep 10 12:00:05.341162 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:00:05.343302 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3099816c-c663-41e5-b939-18c66b2d65d7 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Returning 404 to user: Instance 9da5b114-2ad4-41f0-897f-d4e2984f5a16 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:00:05.345076 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3099816c-c663-41e5-b939-18c66b2d65d7 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16" status: 404 len: 111 microversion: 2.1 time: 0.107325 Sep 10 12:00:05.349142 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2215/4445] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:05 2022] GET /compute/v2.1/servers/9da5b114-2ad4-41f0-897f-d4e2984f5a16 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:00:05.354816 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d7d0eaaa-81b5-491e-8f80-4043cd09ba20 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:05.355750 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d7d0eaaa-81b5-491e-8f80-4043cd09ba20 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: e3157819-80a0-4ca3-9ad5-fe790fb7b2a1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:05.362888 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d7d0eaaa-81b5-491e-8f80-4043cd09ba20 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:05.363721 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d7d0eaaa-81b5-491e-8f80-4043cd09ba20 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:05.364424 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d7d0eaaa-81b5-491e-8f80-4043cd09ba20 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:05.365892 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d7d0eaaa-81b5-491e-8f80-4043cd09ba20 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:05.366594 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d7d0eaaa-81b5-491e-8f80-4043cd09ba20 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:05.367296 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d7d0eaaa-81b5-491e-8f80-4043cd09ba20 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:05.384020 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-d7d0eaaa-81b5-491e-8f80-4043cd09ba20 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] HTTP exception thrown: Instance e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 could not be found. Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d7d0eaaa-81b5-491e-8f80-4043cd09ba20 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Request method failure captured: Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/servers/e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 HTTP/1.1 Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHsd-AnnLZFS6-Lbfr9ATef_4cX6EE0Up-a_Ch8dobncDUqljTHX0YcK7WbJaaBcAlN6twvlZe9au1SNJQwC5-nItcb7pEhHjqWyH9GhqCmgS3jEbfUY8st6zk2hVKWMOxRl1E1nEdlCzWIcW0YZf7xPnP7IvCJy_UgVMW4-UpTlv4M Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2f92ad05650840f6bb4c8f6134b489ca", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-DeleteServersTestJSON-419044733 Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-DeleteServersTestJSON-419044733-project Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: d244789bea974bd99d0f1debebabb54a Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-DeleteServersTestJSON-419044733-project Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 could not be found. Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'e3157819-80a0-4ca3-9ad5-fe790fb7b2a1'} Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 could not be found. Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:00:05.386007 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:00:05.389830 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 could not be found. Sep 10 12:00:05.389830 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:00:05.389830 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:00:05.389830 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:00:05.389830 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:00:05.389830 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:00:05.389830 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:00:05.389830 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:00:05.389830 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:00:05.389830 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 could not be found. Sep 10 12:00:05.389830 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:00:05.392289 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d7d0eaaa-81b5-491e-8f80-4043cd09ba20 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Returning 404 to user: Instance e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:00:05.393501 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d7d0eaaa-81b5-491e-8f80-4043cd09ba20 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e3157819-80a0-4ca3-9ad5-fe790fb7b2a1" status: 404 len: 111 microversion: 2.1 time: 0.042823 Sep 10 12:00:05.394648 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2216/4446] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:00:05 2022] DELETE /compute/v2.1/servers/e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:00:05.410700 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2e470350-435c-4388-a6fb-dca704103e01 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:05.413256 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2e470350-435c-4388-a6fb-dca704103e01 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] [instance: e3157819-80a0-4ca3-9ad5-fe790fb7b2a1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:05.423421 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e470350-435c-4388-a6fb-dca704103e01 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:05.424254 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e470350-435c-4388-a6fb-dca704103e01 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:05.424923 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e470350-435c-4388-a6fb-dca704103e01 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:05.426101 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e470350-435c-4388-a6fb-dca704103e01 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:05.427775 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e470350-435c-4388-a6fb-dca704103e01 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:05.428460 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e470350-435c-4388-a6fb-dca704103e01 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:05.437725 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-994902e5-221a-447b-b1bb-d3f1331b3dbc tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "DELETE /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4/os-volume_attachments/740e34f5-a33d-4b3b-9cbb-e2cff5e52fad" status: 202 len: 0 microversion: 2.1 time: 0.609730 Sep 10 12:00:05.440996 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2231/4447] 10.222.0.23 () {58 vars in 1416 bytes} [Sat Sep 10 12:00:04 2022] DELETE /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4/os-volume_attachments/740e34f5-a33d-4b3b-9cbb-e2cff5e52fad => generated 0 bytes in 619 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:00:05.445887 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-2e470350-435c-4388-a6fb-dca704103e01 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] HTTP exception thrown: Instance e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 could not be found. Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2e470350-435c-4388-a6fb-dca704103e01 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Request method failure captured: Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 HTTP/1.1 Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHsd-AnnLZFS6-Lbfr9ATef_4cX6EE0Up-a_Ch8dobncDUqljTHX0YcK7WbJaaBcAlN6twvlZe9au1SNJQwC5-nItcb7pEhHjqWyH9GhqCmgS3jEbfUY8st6zk2hVKWMOxRl1E1nEdlCzWIcW0YZf7xPnP7IvCJy_UgVMW4-UpTlv4M Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2f92ad05650840f6bb4c8f6134b489ca", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2f92ad05650840f6bb4c8f6134b489ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-DeleteServersTestJSON-419044733 Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 2f92ad05650840f6bb4c8f6134b489ca Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-DeleteServersTestJSON-419044733 Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-DeleteServersTestJSON-419044733-project Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: d244789bea974bd99d0f1debebabb54a Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-DeleteServersTestJSON-419044733-project Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 could not be found. Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'e3157819-80a0-4ca3-9ad5-fe790fb7b2a1'} Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 could not be found. Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 could not be found. Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:00:05.447841 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:00:05.451774 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:00:05.451774 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:00:05.451774 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:00:05.451774 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:00:05.451774 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:00:05.451774 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 could not be found. Sep 10 12:00:05.451774 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:00:05.460146 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2e470350-435c-4388-a6fb-dca704103e01 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] Returning 404 to user: Instance e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:00:05.461751 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2e470350-435c-4388-a6fb-dca704103e01 tempest-DeleteServersTestJSON-419044733 tempest-DeleteServersTestJSON-419044733-project] 10.222.0.23 "GET /compute/v2.1/servers/e3157819-80a0-4ca3-9ad5-fe790fb7b2a1" status: 404 len: 111 microversion: 2.1 time: 0.059413 Sep 10 12:00:05.464735 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2217/4448] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:05 2022] GET /compute/v2.1/servers/e3157819-80a0-4ca3-9ad5-fe790fb7b2a1 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:00:05.466196 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8daadd5a-b1a5-4504-8c1b-f54c25150c6a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:05.483986 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8daadd5a-b1a5-4504-8c1b-f54c25150c6a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:05.504755 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8daadd5a-b1a5-4504-8c1b-f54c25150c6a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:05.508628 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8daadd5a-b1a5-4504-8c1b-f54c25150c6a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:05.509099 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8daadd5a-b1a5-4504-8c1b-f54c25150c6a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:05.509887 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8daadd5a-b1a5-4504-8c1b-f54c25150c6a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:05.510295 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8daadd5a-b1a5-4504-8c1b-f54c25150c6a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:05.510721 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8daadd5a-b1a5-4504-8c1b-f54c25150c6a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:05.558317 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:00:05.655373 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8daadd5a-b1a5-4504-8c1b-f54c25150c6a tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.209033 Sep 10 12:00:05.664134 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2232/4449] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:00:05 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4/os-volume_attachments => generated 197 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:00:05.731605 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-26593365-7a2c-4793-a7a6-ef053e2fd11e tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:05.732975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-26593365-7a2c-4793-a7a6-ef053e2fd11e tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] [instance: cd080272-b545-40ab-9639-64f0665eba08] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:05.746605 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-26593365-7a2c-4793-a7a6-ef053e2fd11e tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:05.747233 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-26593365-7a2c-4793-a7a6-ef053e2fd11e tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:05.747960 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-26593365-7a2c-4793-a7a6-ef053e2fd11e tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:05.748904 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-26593365-7a2c-4793-a7a6-ef053e2fd11e tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:05.749638 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-26593365-7a2c-4793-a7a6-ef053e2fd11e tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:05.750313 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-26593365-7a2c-4793-a7a6-ef053e2fd11e tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:05.948417 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-26593365-7a2c-4793-a7a6-ef053e2fd11e tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9eb8af88f648878d231e7ce4ff11c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b3564725094507aaa3ba0e23e24e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:05.994072 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-26593365-7a2c-4793-a7a6-ef053e2fd11e tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] 10.222.0.23 "GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08" status: 200 len: 1274 microversion: 2.1 time: 0.244581 Sep 10 12:00:05.996285 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2218/4450] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:05 2022] GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08 => generated 1274 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:06.674652 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cdde172d-d79f-4a92-b227-d7204b5c9198 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:06.685151 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3c5653b9-24f4-4a34-b96d-6abe67bf10a9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:06.685789 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3c5653b9-24f4-4a34-b96d-6abe67bf10a9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:06.689929 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cdde172d-d79f-4a92-b227-d7204b5c9198 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:06.708456 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3c5653b9-24f4-4a34-b96d-6abe67bf10a9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:06.711617 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3c5653b9-24f4-4a34-b96d-6abe67bf10a9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:06.712264 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3c5653b9-24f4-4a34-b96d-6abe67bf10a9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:06.715272 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cdde172d-d79f-4a92-b227-d7204b5c9198 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:06.718837 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3c5653b9-24f4-4a34-b96d-6abe67bf10a9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:06.720018 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cdde172d-d79f-4a92-b227-d7204b5c9198 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:06.720398 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3c5653b9-24f4-4a34-b96d-6abe67bf10a9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:06.721014 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3c5653b9-24f4-4a34-b96d-6abe67bf10a9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:06.721624 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cdde172d-d79f-4a92-b227-d7204b5c9198 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:06.725438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cdde172d-d79f-4a92-b227-d7204b5c9198 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:06.730340 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cdde172d-d79f-4a92-b227-d7204b5c9198 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:06.734399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cdde172d-d79f-4a92-b227-d7204b5c9198 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:06.845091 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cdde172d-d79f-4a92-b227-d7204b5c9198 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.177475 Sep 10 12:00:06.847421 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2233/4451] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:00:06 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4/os-volume_attachments => generated 197 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:00:07.022369 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-47c048bb-57b1-4f83-83c2-9697b903b682 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:07.023410 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-47c048bb-57b1-4f83-83c2-9697b903b682 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] [instance: cd080272-b545-40ab-9639-64f0665eba08] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:07.037557 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47c048bb-57b1-4f83-83c2-9697b903b682 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:07.038194 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47c048bb-57b1-4f83-83c2-9697b903b682 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:07.040004 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47c048bb-57b1-4f83-83c2-9697b903b682 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:07.043023 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47c048bb-57b1-4f83-83c2-9697b903b682 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:07.043657 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47c048bb-57b1-4f83-83c2-9697b903b682 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:07.045009 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47c048bb-57b1-4f83-83c2-9697b903b682 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:07.411818 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-47c048bb-57b1-4f83-83c2-9697b903b682 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9eb8af88f648878d231e7ce4ff11c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b3564725094507aaa3ba0e23e24e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:07.420242 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-47c048bb-57b1-4f83-83c2-9697b903b682 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] 10.222.0.23 "GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08" status: 200 len: 1274 microversion: 2.1 time: 0.403630 Sep 10 12:00:07.425990 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2234/4452] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:07 2022] GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08 => generated 1274 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:07.623559 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3c5653b9-24f4-4a34-b96d-6abe67bf10a9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:07.633156 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3c5653b9-24f4-4a34-b96d-6abe67bf10a9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.952867 Sep 10 12:00:07.634450 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2219/4453] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:06 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:00:07.658808 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f57ac397-371f-4ba9-8c55-7ac37f82da2a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:07.659494 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f57ac397-371f-4ba9-8c55-7ac37f82da2a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:07.672704 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f57ac397-371f-4ba9-8c55-7ac37f82da2a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:07.673402 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f57ac397-371f-4ba9-8c55-7ac37f82da2a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:07.673950 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f57ac397-371f-4ba9-8c55-7ac37f82da2a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:07.674876 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f57ac397-371f-4ba9-8c55-7ac37f82da2a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:07.675524 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f57ac397-371f-4ba9-8c55-7ac37f82da2a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:07.676064 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f57ac397-371f-4ba9-8c55-7ac37f82da2a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:07.860415 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dd6f9f85-b934-4685-8b49-767faa7f2067 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:07.863016 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-dd6f9f85-b934-4685-8b49-767faa7f2067 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:07.885427 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dd6f9f85-b934-4685-8b49-767faa7f2067 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:07.886346 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dd6f9f85-b934-4685-8b49-767faa7f2067 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:07.886801 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dd6f9f85-b934-4685-8b49-767faa7f2067 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:07.887890 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dd6f9f85-b934-4685-8b49-767faa7f2067 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:07.889371 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dd6f9f85-b934-4685-8b49-767faa7f2067 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:07.890335 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dd6f9f85-b934-4685-8b49-767faa7f2067 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:07.944956 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f57ac397-371f-4ba9-8c55-7ac37f82da2a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:07.954205 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f57ac397-371f-4ba9-8c55-7ac37f82da2a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.300328 Sep 10 12:00:07.960898 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2235/4454] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:07 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:07.971439 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-dd6f9f85-b934-4685-8b49-767faa7f2067 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106110 Sep 10 12:00:07.972921 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2220/4455] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:00:07 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:00:07.987822 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-60cbccb4-20ff-46bf-97c7-75ef0aa049f6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:07.989583 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-60cbccb4-20ff-46bf-97c7-75ef0aa049f6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:07.996520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-60cbccb4-20ff-46bf-97c7-75ef0aa049f6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:07.997342 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-60cbccb4-20ff-46bf-97c7-75ef0aa049f6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:07.997991 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-60cbccb4-20ff-46bf-97c7-75ef0aa049f6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:07.998934 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-60cbccb4-20ff-46bf-97c7-75ef0aa049f6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:07.999637 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-60cbccb4-20ff-46bf-97c7-75ef0aa049f6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:08.000278 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-60cbccb4-20ff-46bf-97c7-75ef0aa049f6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:08.452734 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-82fb28ad-c48c-4169-b213-ae7b088d1082 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:08.453554 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-82fb28ad-c48c-4169-b213-ae7b088d1082 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] [instance: cd080272-b545-40ab-9639-64f0665eba08] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:08.474943 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-82fb28ad-c48c-4169-b213-ae7b088d1082 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:08.475492 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-82fb28ad-c48c-4169-b213-ae7b088d1082 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:08.475941 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-82fb28ad-c48c-4169-b213-ae7b088d1082 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:08.482985 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-82fb28ad-c48c-4169-b213-ae7b088d1082 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:08.484608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-82fb28ad-c48c-4169-b213-ae7b088d1082 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:08.485065 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-82fb28ad-c48c-4169-b213-ae7b088d1082 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:08.790196 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-60cbccb4-20ff-46bf-97c7-75ef0aa049f6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:08.799771 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-60cbccb4-20ff-46bf-97c7-75ef0aa049f6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.815754 Sep 10 12:00:08.805510 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2236/4456] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:07 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:08.835653 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d1fea06e-d0ad-4790-ac8b-b795ad99ec7a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-2006662803"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:00:08.839114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d1fea06e-d0ad-4790-ac8b-b795ad99ec7a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:08.855817 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1fea06e-d0ad-4790-ac8b-b795ad99ec7a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:08.856637 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1fea06e-d0ad-4790-ac8b-b795ad99ec7a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:08.857258 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1fea06e-d0ad-4790-ac8b-b795ad99ec7a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:08.858159 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1fea06e-d0ad-4790-ac8b-b795ad99ec7a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:08.858786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1fea06e-d0ad-4790-ac8b-b795ad99ec7a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:08.860374 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1fea06e-d0ad-4790-ac8b-b795ad99ec7a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:09.076541 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-82fb28ad-c48c-4169-b213-ae7b088d1082 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9eb8af88f648878d231e7ce4ff11c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b3564725094507aaa3ba0e23e24e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:09.097824 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-82fb28ad-c48c-4169-b213-ae7b088d1082 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] 10.222.0.23 "GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08" status: 200 len: 1316 microversion: 2.1 time: 0.645088 Sep 10 12:00:09.100049 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2221/4457] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:08 2022] GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08 => generated 1316 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:00:09.112166 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6fe9c578-31fc-4b7a-b63c-f705cffb7c51 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:09.114801 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6fe9c578-31fc-4b7a-b63c-f705cffb7c51 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:09.138707 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6fe9c578-31fc-4b7a-b63c-f705cffb7c51 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:09.139234 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6fe9c578-31fc-4b7a-b63c-f705cffb7c51 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:09.139679 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6fe9c578-31fc-4b7a-b63c-f705cffb7c51 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:09.140394 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6fe9c578-31fc-4b7a-b63c-f705cffb7c51 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:09.140849 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6fe9c578-31fc-4b7a-b63c-f705cffb7c51 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:09.141740 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6fe9c578-31fc-4b7a-b63c-f705cffb7c51 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:09.210021 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6fe9c578-31fc-4b7a-b63c-f705cffb7c51 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106173 Sep 10 12:00:09.215532 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2222/4458] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:00:09 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:00:09.254055 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d1fea06e-d0ad-4790-ac8b-b795ad99ec7a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "POST /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f/action" status: 202 len: 0 microversion: 2.1 time: 0.425687 Sep 10 12:00:09.255470 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2237/4459] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:00:08 2022] POST /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f/action => generated 0 bytes in 428 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 10 12:00:10.131650 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cc8ec952-ca29-4f60-9a1b-991129287c75 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:10.133150 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cc8ec952-ca29-4f60-9a1b-991129287c75 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] [instance: cd080272-b545-40ab-9639-64f0665eba08] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:10.148323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cc8ec952-ca29-4f60-9a1b-991129287c75 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:10.148820 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cc8ec952-ca29-4f60-9a1b-991129287c75 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:10.153697 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cc8ec952-ca29-4f60-9a1b-991129287c75 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:10.156603 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cc8ec952-ca29-4f60-9a1b-991129287c75 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:10.157267 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cc8ec952-ca29-4f60-9a1b-991129287c75 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:10.157871 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cc8ec952-ca29-4f60-9a1b-991129287c75 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:10.224216 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4a0f8b98-ecde-4afa-98d3-3146f39a7b2d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:10.228365 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4a0f8b98-ecde-4afa-98d3-3146f39a7b2d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:10.259468 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:00:10.263638 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a0f8b98-ecde-4afa-98d3-3146f39a7b2d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:10.264146 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a0f8b98-ecde-4afa-98d3-3146f39a7b2d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:10.269638 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a0f8b98-ecde-4afa-98d3-3146f39a7b2d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:10.277053 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a0f8b98-ecde-4afa-98d3-3146f39a7b2d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:10.284676 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a0f8b98-ecde-4afa-98d3-3146f39a7b2d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:10.284676 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a0f8b98-ecde-4afa-98d3-3146f39a7b2d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:10.406649 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4a0f8b98-ecde-4afa-98d3-3146f39a7b2d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.188338 Sep 10 12:00:10.411821 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2238/4460] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:00:10 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:00:10.459630 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-51ba854d-cfe3-4e5c-94b4-7b638764db6c req-1103c704-3da4-45a2-a373-f4e3de4eb2d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd080272-b545-40ab-9639-64f0665eba08", "tag": "59254e6f-04f6-4f7d-8a19-cbff96560f59"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:00:10.480745 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-51ba854d-cfe3-4e5c-94b4-7b638764db6c req-1103c704-3da4-45a2-a373-f4e3de4eb2d6 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:10.483061 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-51ba854d-cfe3-4e5c-94b4-7b638764db6c req-1103c704-3da4-45a2-a373-f4e3de4eb2d6 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:10.483834 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-51ba854d-cfe3-4e5c-94b4-7b638764db6c req-1103c704-3da4-45a2-a373-f4e3de4eb2d6 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:10.517981 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-51ba854d-cfe3-4e5c-94b4-7b638764db6c req-1103c704-3da4-45a2-a373-f4e3de4eb2d6 service nova] Creating event network-changed:59254e6f-04f6-4f7d-8a19-cbff96560f59 for instance cd080272-b545-40ab-9639-64f0665eba08 on n-h2-856895-1 Sep 10 12:00:10.530496 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-51ba854d-cfe3-4e5c-94b4-7b638764db6c req-1103c704-3da4-45a2-a373-f4e3de4eb2d6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076910 Sep 10 12:00:10.537866 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2239/4461] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:00:10.697168 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-cc8ec952-ca29-4f60-9a1b-991129287c75 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9eb8af88f648878d231e7ce4ff11c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b3564725094507aaa3ba0e23e24e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:10.707567 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cc8ec952-ca29-4f60-9a1b-991129287c75 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] 10.222.0.23 "GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08" status: 200 len: 1316 microversion: 2.1 time: 0.578923 Sep 10 12:00:10.709094 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2223/4462] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:10 2022] GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08 => generated 1316 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:11.421269 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7b8738f2-e8f8-4f99-bb7c-c8a322092cc0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:11.426090 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7b8738f2-e8f8-4f99-bb7c-c8a322092cc0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:11.441614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b8738f2-e8f8-4f99-bb7c-c8a322092cc0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:11.444067 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b8738f2-e8f8-4f99-bb7c-c8a322092cc0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:11.444780 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b8738f2-e8f8-4f99-bb7c-c8a322092cc0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:11.445730 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b8738f2-e8f8-4f99-bb7c-c8a322092cc0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:11.446494 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b8738f2-e8f8-4f99-bb7c-c8a322092cc0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:11.446930 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b8738f2-e8f8-4f99-bb7c-c8a322092cc0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:11.511882 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7b8738f2-e8f8-4f99-bb7c-c8a322092cc0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095834 Sep 10 12:00:11.518406 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2240/4463] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:00:11 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:00:11.730933 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3560b5d6-96fb-4645-96bf-880bfc50d683 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:11.732270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3560b5d6-96fb-4645-96bf-880bfc50d683 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] [instance: cd080272-b545-40ab-9639-64f0665eba08] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:11.743794 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3560b5d6-96fb-4645-96bf-880bfc50d683 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:11.746483 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3560b5d6-96fb-4645-96bf-880bfc50d683 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:11.749137 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3560b5d6-96fb-4645-96bf-880bfc50d683 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:11.750178 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3560b5d6-96fb-4645-96bf-880bfc50d683 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:11.750817 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3560b5d6-96fb-4645-96bf-880bfc50d683 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:11.752562 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3560b5d6-96fb-4645-96bf-880bfc50d683 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:12.160161 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3560b5d6-96fb-4645-96bf-880bfc50d683 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9eb8af88f648878d231e7ce4ff11c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b3564725094507aaa3ba0e23e24e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:12.178571 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3560b5d6-96fb-4645-96bf-880bfc50d683 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] 10.222.0.23 "GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08" status: 200 len: 1316 microversion: 2.1 time: 0.451697 Sep 10 12:00:12.179788 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2224/4464] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:11 2022] GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08 => generated 1316 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:12.532582 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-317edac0-b4b7-48ab-a0c6-9716924c3038 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:12.539111 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-317edac0-b4b7-48ab-a0c6-9716924c3038 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:12.559677 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-317edac0-b4b7-48ab-a0c6-9716924c3038 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:12.566443 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-317edac0-b4b7-48ab-a0c6-9716924c3038 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:12.567877 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-317edac0-b4b7-48ab-a0c6-9716924c3038 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:12.572752 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-317edac0-b4b7-48ab-a0c6-9716924c3038 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:12.575731 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-317edac0-b4b7-48ab-a0c6-9716924c3038 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:12.576435 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-317edac0-b4b7-48ab-a0c6-9716924c3038 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:12.657751 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-317edac0-b4b7-48ab-a0c6-9716924c3038 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136364 Sep 10 12:00:12.659077 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2241/4465] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:00:12 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:00:13.202402 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:00:13.203636 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:00:13.210872 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1c597ef6-39eb-46ec-8fa9-1d05e3d3f80b tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:13.211517 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1c597ef6-39eb-46ec-8fa9-1d05e3d3f80b tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] [instance: cd080272-b545-40ab-9639-64f0665eba08] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:13.242159 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1c597ef6-39eb-46ec-8fa9-1d05e3d3f80b tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:13.242678 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1c597ef6-39eb-46ec-8fa9-1d05e3d3f80b tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:13.247580 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1c597ef6-39eb-46ec-8fa9-1d05e3d3f80b tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:13.248374 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1c597ef6-39eb-46ec-8fa9-1d05e3d3f80b tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:13.248857 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1c597ef6-39eb-46ec-8fa9-1d05e3d3f80b tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:13.251417 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1c597ef6-39eb-46ec-8fa9-1d05e3d3f80b tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:13.673468 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-07552f99-2a51-472b-b5f6-32eba9e37fdf tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:13.677317 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-07552f99-2a51-472b-b5f6-32eba9e37fdf tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:13.690454 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:00:13.702386 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-07552f99-2a51-472b-b5f6-32eba9e37fdf tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:13.702909 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-07552f99-2a51-472b-b5f6-32eba9e37fdf tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:13.706212 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-07552f99-2a51-472b-b5f6-32eba9e37fdf tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:13.707360 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-07552f99-2a51-472b-b5f6-32eba9e37fdf tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:13.708865 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-07552f99-2a51-472b-b5f6-32eba9e37fdf tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:13.709635 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-07552f99-2a51-472b-b5f6-32eba9e37fdf tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:13.725316 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1c597ef6-39eb-46ec-8fa9-1d05e3d3f80b tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9eb8af88f648878d231e7ce4ff11c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b3564725094507aaa3ba0e23e24e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:13.738047 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1c597ef6-39eb-46ec-8fa9-1d05e3d3f80b tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] 10.222.0.23 "GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08" status: 200 len: 1316 microversion: 2.1 time: 0.537063 Sep 10 12:00:13.739292 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2225/4466] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:13 2022] GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08 => generated 1316 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:13.806726 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-07552f99-2a51-472b-b5f6-32eba9e37fdf tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.137874 Sep 10 12:00:13.808386 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2242/4467] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:00:13 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4/os-volume_attachments => generated 25 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 10 12:00:13.947071 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ae88a185-0aa5-411f-98c0-f1164b256dda tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:00:13.950601 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ae88a185-0aa5-411f-98c0-f1164b256dda tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:13.965575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ae88a185-0aa5-411f-98c0-f1164b256dda tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:13.966080 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ae88a185-0aa5-411f-98c0-f1164b256dda tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:13.966559 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ae88a185-0aa5-411f-98c0-f1164b256dda tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:13.967235 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ae88a185-0aa5-411f-98c0-f1164b256dda tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:13.967698 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ae88a185-0aa5-411f-98c0-f1164b256dda tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:13.972475 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ae88a185-0aa5-411f-98c0-f1164b256dda tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:14.008490 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-ae88a185-0aa5-411f-98c0-f1164b256dda tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] HTTP exception thrown: Cannot 'reboot' instance 84f2edbd-a437-474e-bd57-10814851e180 while it is in vm_state rescued Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ae88a185-0aa5-411f-98c0-f1164b256dda tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Request method failure captured: Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180/action HTTP/1.1 Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 28 Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHsDb9McMbZ9alVjJ4oJKA7xoa0-QA-ERuLKN-wY-xgkYgjg-f1Qkk9v6xNr7bPpAGzBceBuhySDill-chXUItw0i1842Y9FDTX_ZkXuD1aeT9HQ_-qUH7OXi222TXPS2e9y3GtImQxVIp9JaCN7mrwULBVN7FoNXkYNRF6EUEoKMAw Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 8e8bc2c6ea1946bfbbf47d63b5fa4648 Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1615383257 Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e8bc2c6ea1946bfbbf47d63b5fa4648"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e8bc2c6ea1946bfbbf47d63b5fa4648"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8e8bc2c6ea1946bfbbf47d63b5fa4648", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8e8bc2c6ea1946bfbbf47d63b5fa4648"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1615383257 Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 8e8bc2c6ea1946bfbbf47d63b5fa4648 Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1615383257 Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServerRescueNegativeTestJSON-1615383257-project Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: bddddbd6718f472e951fd87a6ec00f8d Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1615383257-project Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: {"reboot": {"type": "HARD"}} Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: exception: Cannot 'reboot' instance 84f2edbd-a437-474e-bd57-10814851e180 while it is in vm_state rescued Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '84f2edbd-a437-474e-bd57-10814851e180', 'body': {'reboot': {'type': 'HARD'}}} Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 84f2edbd-a437-474e-bd57-10814851e180 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 12:00:14.011103 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 12:00:14.016626 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 84f2edbd-a437-474e-bd57-10814851e180 while it is in vm_state rescued Sep 10 12:00:14.016626 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:00:14.016626 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:00:14.016626 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:00:14.016626 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:00:14.016626 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:00:14.016626 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:00:14.016626 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:00:14.016626 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:00:14.016626 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 84f2edbd-a437-474e-bd57-10814851e180 while it is in vm_state rescued Sep 10 12:00:14.016626 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:00:14.019357 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ae88a185-0aa5-411f-98c0-f1164b256dda tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Returning 409 to user: Cannot 'reboot' instance 84f2edbd-a437-474e-bd57-10814851e180 while it is in vm_state rescued {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:00:14.020794 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ae88a185-0aa5-411f-98c0-f1164b256dda tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "POST /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180/action" status: 409 len: 145 microversion: 2.1 time: 0.079782 Sep 10 12:00:14.022074 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2226/4468] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:00:13 2022] POST /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180/action => generated 145 bytes in 82 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 10 12:00:14.033107 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4cb4ab73-8cb1-434b-8fa1-3b730a0b5bc7 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:00:14.036789 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4cb4ab73-8cb1-434b-8fa1-3b730a0b5bc7 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:14.054425 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4cb4ab73-8cb1-434b-8fa1-3b730a0b5bc7 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:14.055093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4cb4ab73-8cb1-434b-8fa1-3b730a0b5bc7 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:14.056147 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4cb4ab73-8cb1-434b-8fa1-3b730a0b5bc7 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:14.060537 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4cb4ab73-8cb1-434b-8fa1-3b730a0b5bc7 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:14.061203 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4cb4ab73-8cb1-434b-8fa1-3b730a0b5bc7 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:14.061802 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4cb4ab73-8cb1-434b-8fa1-3b730a0b5bc7 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:14.119868 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-4cb4ab73-8cb1-434b-8fa1-3b730a0b5bc7 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] HTTP exception thrown: Cannot 'rebuild' instance 84f2edbd-a437-474e-bd57-10814851e180 while it is in vm_state rescued Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4cb4ab73-8cb1-434b-8fa1-3b730a0b5bc7 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Request method failure captured: Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180/action HTTP/1.1 Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 65 Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHsDb9McMbZ9alVjJ4oJKA7xoa0-QA-ERuLKN-wY-xgkYgjg-f1Qkk9v6xNr7bPpAGzBceBuhySDill-chXUItw0i1842Y9FDTX_ZkXuD1aeT9HQ_-qUH7OXi222TXPS2e9y3GtImQxVIp9JaCN7mrwULBVN7FoNXkYNRF6EUEoKMAw Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 8e8bc2c6ea1946bfbbf47d63b5fa4648 Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1615383257 Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e8bc2c6ea1946bfbbf47d63b5fa4648"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e8bc2c6ea1946bfbbf47d63b5fa4648"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8e8bc2c6ea1946bfbbf47d63b5fa4648", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8e8bc2c6ea1946bfbbf47d63b5fa4648"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1615383257 Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 8e8bc2c6ea1946bfbbf47d63b5fa4648 Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1615383257 Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServerRescueNegativeTestJSON-1615383257-project Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: bddddbd6718f472e951fd87a6ec00f8d Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1615383257-project Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: {"rebuild": {"imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1"}} Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: exception: Cannot 'rebuild' instance 84f2edbd-a437-474e-bd57-10814851e180 while it is in vm_state rescued Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '84f2edbd-a437-474e-bd57-10814851e180', 'body': {'rebuild': {'imageRef': 'c23d4d62-7ab9-4623-9273-7f44582aa2e1'}}} Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 84f2edbd-a437-474e-bd57-10814851e180 in vm_state rescued. Cannot rebuild while the instance is in this state. Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:00:14.124915 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:00:14.128804 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:00:14.128804 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 10 12:00:14.128804 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Sep 10 12:00:14.128804 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 10 12:00:14.128804 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 12:00:14.128804 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 12:00:14.128804 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 84f2edbd-a437-474e-bd57-10814851e180 while it is in vm_state rescued Sep 10 12:00:14.128804 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:00:14.128804 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:00:14.128804 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:00:14.128804 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:00:14.128804 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:00:14.128804 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:00:14.128804 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:00:14.128804 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:00:14.128804 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 84f2edbd-a437-474e-bd57-10814851e180 while it is in vm_state rescued Sep 10 12:00:14.128804 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:00:14.128804 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4cb4ab73-8cb1-434b-8fa1-3b730a0b5bc7 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Returning 409 to user: Cannot 'rebuild' instance 84f2edbd-a437-474e-bd57-10814851e180 while it is in vm_state rescued {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:00:14.128804 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4cb4ab73-8cb1-434b-8fa1-3b730a0b5bc7 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "POST /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180/action" status: 409 len: 146 microversion: 2.1 time: 0.098674 Sep 10 12:00:14.128804 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2243/4469] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:00:14 2022] POST /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180/action => generated 146 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 12:00:14.138221 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-29c66d9e-8720-4357-b82a-92f610e7ebe2 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:14.138862 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-29c66d9e-8720-4357-b82a-92f610e7ebe2 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:14.148436 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-29c66d9e-8720-4357-b82a-92f610e7ebe2 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:14.150516 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-29c66d9e-8720-4357-b82a-92f610e7ebe2 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:14.151510 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-29c66d9e-8720-4357-b82a-92f610e7ebe2 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:14.155685 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-29c66d9e-8720-4357-b82a-92f610e7ebe2 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:14.156123 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-29c66d9e-8720-4357-b82a-92f610e7ebe2 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:14.156646 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-29c66d9e-8720-4357-b82a-92f610e7ebe2 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:14.243133 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-29c66d9e-8720-4357-b82a-92f610e7ebe2 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:00:14.308739 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:00:14.429031 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-29c66d9e-8720-4357-b82a-92f610e7ebe2 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "DELETE /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4" status: 204 len: 0 microversion: 2.1 time: 0.292653 Sep 10 12:00:14.430507 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2227/4470] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:00:14 2022] DELETE /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:00:14.437941 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-226e3d63-d9a3-40e6-8f85-f39b6b12d6b8 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:14.441092 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-226e3d63-d9a3-40e6-8f85-f39b6b12d6b8 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:14.461751 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-226e3d63-d9a3-40e6-8f85-f39b6b12d6b8 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:14.465079 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-226e3d63-d9a3-40e6-8f85-f39b6b12d6b8 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:14.466911 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-226e3d63-d9a3-40e6-8f85-f39b6b12d6b8 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:14.469304 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-226e3d63-d9a3-40e6-8f85-f39b6b12d6b8 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:14.470893 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-226e3d63-d9a3-40e6-8f85-f39b6b12d6b8 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:14.471387 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-226e3d63-d9a3-40e6-8f85-f39b6b12d6b8 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:14.770366 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2d0a7021-b5b2-4d9c-8fc7-a98f5a292019 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:14.773304 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2d0a7021-b5b2-4d9c-8fc7-a98f5a292019 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] [instance: cd080272-b545-40ab-9639-64f0665eba08] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:14.791350 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-226e3d63-d9a3-40e6-8f85-f39b6b12d6b8 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:14.813573 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d0a7021-b5b2-4d9c-8fc7-a98f5a292019 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:14.813573 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d0a7021-b5b2-4d9c-8fc7-a98f5a292019 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:14.813573 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d0a7021-b5b2-4d9c-8fc7-a98f5a292019 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:14.813573 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d0a7021-b5b2-4d9c-8fc7-a98f5a292019 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:14.813927 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-226e3d63-d9a3-40e6-8f85-f39b6b12d6b8 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4" status: 200 len: 1689 microversion: 2.1 time: 0.378326 Sep 10 12:00:14.814449 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2244/4471] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:14 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 => generated 1689 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:14.814566 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d0a7021-b5b2-4d9c-8fc7-a98f5a292019 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:14.815424 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d0a7021-b5b2-4d9c-8fc7-a98f5a292019 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:14.940066 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-b5f2671d-ce74-42df-898b-551f59eac88e req-32a535e2-b2cc-4ff7-bfeb-189b33da2856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64704ff7-229d-478b-9889-6b6cba53bd0f", "name": "network-vif-plugged", "status": "completed", "tag": "7f6388a0-8fe7-4ee5-821e-68c4889b9594"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:00:14.971825 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-b5f2671d-ce74-42df-898b-551f59eac88e req-32a535e2-b2cc-4ff7-bfeb-189b33da2856 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:14.976577 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-b5f2671d-ce74-42df-898b-551f59eac88e req-32a535e2-b2cc-4ff7-bfeb-189b33da2856 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:14.977098 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-b5f2671d-ce74-42df-898b-551f59eac88e req-32a535e2-b2cc-4ff7-bfeb-189b33da2856 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:15.008898 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-b5f2671d-ce74-42df-898b-551f59eac88e req-32a535e2-b2cc-4ff7-bfeb-189b33da2856 service nova] Creating event network-vif-plugged:7f6388a0-8fe7-4ee5-821e-68c4889b9594 for instance 64704ff7-229d-478b-9889-6b6cba53bd0f on n-h1-856895-1 Sep 10 12:00:15.019017 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-b5f2671d-ce74-42df-898b-551f59eac88e req-32a535e2-b2cc-4ff7-bfeb-189b33da2856 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086241 Sep 10 12:00:15.021349 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2245/4472] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:00:15.060467 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2d0a7021-b5b2-4d9c-8fc7-a98f5a292019 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9eb8af88f648878d231e7ce4ff11c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b3564725094507aaa3ba0e23e24e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:15.069515 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2d0a7021-b5b2-4d9c-8fc7-a98f5a292019 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] 10.222.0.23 "GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08" status: 200 len: 1316 microversion: 2.1 time: 0.306335 Sep 10 12:00:15.073363 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2228/4473] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:14 2022] GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08 => generated 1316 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:15.851511 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-be6f171d-638d-4006-9ec2-c9931d2041a9 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:15.852255 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-be6f171d-638d-4006-9ec2-c9931d2041a9 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:15.868235 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be6f171d-638d-4006-9ec2-c9931d2041a9 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:15.868733 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be6f171d-638d-4006-9ec2-c9931d2041a9 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:15.869183 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be6f171d-638d-4006-9ec2-c9931d2041a9 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:15.869952 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be6f171d-638d-4006-9ec2-c9931d2041a9 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:15.870429 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be6f171d-638d-4006-9ec2-c9931d2041a9 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:15.870860 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be6f171d-638d-4006-9ec2-c9931d2041a9 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:16.081571 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-be6f171d-638d-4006-9ec2-c9931d2041a9 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:16.093145 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-be6f171d-638d-4006-9ec2-c9931d2041a9 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4" status: 200 len: 1689 microversion: 2.1 time: 0.257951 Sep 10 12:00:16.094261 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2246/4474] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:15 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 => generated 1689 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:16.095641 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dffe96a5-a29b-42f8-98cf-223968098eea tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:16.096261 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-dffe96a5-a29b-42f8-98cf-223968098eea tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] [instance: cd080272-b545-40ab-9639-64f0665eba08] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:16.106943 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dffe96a5-a29b-42f8-98cf-223968098eea tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:16.109756 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dffe96a5-a29b-42f8-98cf-223968098eea tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:16.115890 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dffe96a5-a29b-42f8-98cf-223968098eea tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:16.119427 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dffe96a5-a29b-42f8-98cf-223968098eea tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:16.119427 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dffe96a5-a29b-42f8-98cf-223968098eea tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:16.122336 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dffe96a5-a29b-42f8-98cf-223968098eea tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:16.637497 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-dffe96a5-a29b-42f8-98cf-223968098eea tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9eb8af88f648878d231e7ce4ff11c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b3564725094507aaa3ba0e23e24e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:16.650352 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-dffe96a5-a29b-42f8-98cf-223968098eea tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] 10.222.0.23 "GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08" status: 200 len: 1316 microversion: 2.1 time: 0.559574 Sep 10 12:00:16.650948 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2229/4475] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:16 2022] GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08 => generated 1316 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:00:17.110528 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-a77a0a29-0bff-406a-abe5-00cd4edcbe7d req-fe8769a5-b499-4416-814f-643f5eee88c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd080272-b545-40ab-9639-64f0665eba08", "name": "network-vif-plugged", "status": "completed", "tag": "59254e6f-04f6-4f7d-8a19-cbff96560f59"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:00:17.124923 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-62d7b6d7-d453-441c-9e0e-80a0ea2fd290 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:17.125613 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-62d7b6d7-d453-441c-9e0e-80a0ea2fd290 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:17.133199 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a77a0a29-0bff-406a-abe5-00cd4edcbe7d req-fe8769a5-b499-4416-814f-643f5eee88c4 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:17.134137 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a77a0a29-0bff-406a-abe5-00cd4edcbe7d req-fe8769a5-b499-4416-814f-643f5eee88c4 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:17.134758 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a77a0a29-0bff-406a-abe5-00cd4edcbe7d req-fe8769a5-b499-4416-814f-643f5eee88c4 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:17.142286 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-62d7b6d7-d453-441c-9e0e-80a0ea2fd290 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:17.142784 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-62d7b6d7-d453-441c-9e0e-80a0ea2fd290 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:17.144659 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-62d7b6d7-d453-441c-9e0e-80a0ea2fd290 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:17.146440 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-62d7b6d7-d453-441c-9e0e-80a0ea2fd290 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:17.151967 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-62d7b6d7-d453-441c-9e0e-80a0ea2fd290 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:17.152598 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-62d7b6d7-d453-441c-9e0e-80a0ea2fd290 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:17.161876 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-a77a0a29-0bff-406a-abe5-00cd4edcbe7d req-fe8769a5-b499-4416-814f-643f5eee88c4 service nova] Creating event network-vif-plugged:59254e6f-04f6-4f7d-8a19-cbff96560f59 for instance cd080272-b545-40ab-9639-64f0665eba08 on n-h2-856895-1 Sep 10 12:00:17.167844 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-a77a0a29-0bff-406a-abe5-00cd4edcbe7d req-fe8769a5-b499-4416-814f-643f5eee88c4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061255 Sep 10 12:00:17.173961 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2247/4476] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:00:17.625557 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-62d7b6d7-d453-441c-9e0e-80a0ea2fd290 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:17.634663 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-62d7b6d7-d453-441c-9e0e-80a0ea2fd290 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4" status: 200 len: 1689 microversion: 2.1 time: 0.516476 Sep 10 12:00:17.640479 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2230/4477] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:17 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 => generated 1689 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:00:17.678155 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-84e9b6a2-f1a9-4068-85cb-d950c04bbe16 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:17.679345 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-84e9b6a2-f1a9-4068-85cb-d950c04bbe16 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] [instance: cd080272-b545-40ab-9639-64f0665eba08] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:17.700367 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-84e9b6a2-f1a9-4068-85cb-d950c04bbe16 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:17.700858 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-84e9b6a2-f1a9-4068-85cb-d950c04bbe16 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:17.701302 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-84e9b6a2-f1a9-4068-85cb-d950c04bbe16 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:17.708729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-84e9b6a2-f1a9-4068-85cb-d950c04bbe16 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:17.710165 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-84e9b6a2-f1a9-4068-85cb-d950c04bbe16 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:17.712338 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-84e9b6a2-f1a9-4068-85cb-d950c04bbe16 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:17.966786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-84e9b6a2-f1a9-4068-85cb-d950c04bbe16 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9eb8af88f648878d231e7ce4ff11c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b3564725094507aaa3ba0e23e24e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:17.975308 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-84e9b6a2-f1a9-4068-85cb-d950c04bbe16 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] 10.222.0.23 "GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08" status: 200 len: 1316 microversion: 2.1 time: 0.302235 Sep 10 12:00:17.988003 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2248/4478] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:17 2022] GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08 => generated 1316 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:18.671738 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-35b81d43-0318-42c4-81a4-a9e7feddac62 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:18.673590 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-35b81d43-0318-42c4-81a4-a9e7feddac62 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:18.691070 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-35b81d43-0318-42c4-81a4-a9e7feddac62 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:18.692775 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-35b81d43-0318-42c4-81a4-a9e7feddac62 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:18.693628 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-35b81d43-0318-42c4-81a4-a9e7feddac62 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:18.696268 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-35b81d43-0318-42c4-81a4-a9e7feddac62 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:18.697567 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-35b81d43-0318-42c4-81a4-a9e7feddac62 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:18.699520 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-35b81d43-0318-42c4-81a4-a9e7feddac62 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:19.000829 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f70b3139-5643-42cf-824a-dfb9664d3ebc tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:19.002095 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f70b3139-5643-42cf-824a-dfb9664d3ebc tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] [instance: cd080272-b545-40ab-9639-64f0665eba08] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:19.016904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f70b3139-5643-42cf-824a-dfb9664d3ebc tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:19.019316 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f70b3139-5643-42cf-824a-dfb9664d3ebc tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:19.020523 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f70b3139-5643-42cf-824a-dfb9664d3ebc tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:19.028438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f70b3139-5643-42cf-824a-dfb9664d3ebc tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:19.029114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f70b3139-5643-42cf-824a-dfb9664d3ebc tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:19.029754 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f70b3139-5643-42cf-824a-dfb9664d3ebc tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:19.464035 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-35b81d43-0318-42c4-81a4-a9e7feddac62 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:19.472718 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-35b81d43-0318-42c4-81a4-a9e7feddac62 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4" status: 200 len: 1689 microversion: 2.1 time: 0.807053 Sep 10 12:00:19.479101 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2231/4479] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:18 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 => generated 1689 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:19.572047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f70b3139-5643-42cf-824a-dfb9664d3ebc tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9eb8af88f648878d231e7ce4ff11c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b3564725094507aaa3ba0e23e24e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:19.586169 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f70b3139-5643-42cf-824a-dfb9664d3ebc tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] 10.222.0.23 "GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08" status: 200 len: 1505 microversion: 2.1 time: 0.589795 Sep 10 12:00:19.587472 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2249/4480] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:18 2022] GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08 => generated 1505 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:19.614309 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6edf742f-17bb-413d-8b39-7c3a719b244e tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:19.615414 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6edf742f-17bb-413d-8b39-7c3a719b244e tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] [instance: cd080272-b545-40ab-9639-64f0665eba08] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:19.624546 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6edf742f-17bb-413d-8b39-7c3a719b244e tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:19.626758 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6edf742f-17bb-413d-8b39-7c3a719b244e tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:19.627488 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6edf742f-17bb-413d-8b39-7c3a719b244e tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:19.629948 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6edf742f-17bb-413d-8b39-7c3a719b244e tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:19.632259 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6edf742f-17bb-413d-8b39-7c3a719b244e tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:19.632873 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6edf742f-17bb-413d-8b39-7c3a719b244e tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:19.705246 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6edf742f-17bb-413d-8b39-7c3a719b244e tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'bb9eb8af88f648878d231e7ce4ff11c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b3564725094507aaa3ba0e23e24e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:19.707519 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6edf742f-17bb-413d-8b39-7c3a719b244e tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] 10.222.0.23 "GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08/os-instance-actions/req-5b5ab88e-265f-4f71-a3f6-4d7108580e60" status: 200 len: 313 microversion: 2.1 time: 0.097538 Sep 10 12:00:19.709406 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2232/4481] 10.222.0.23 () {58 vars in 1419 bytes} [Sat Sep 10 12:00:19 2022] GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08/os-instance-actions/req-5b5ab88e-265f-4f71-a3f6-4d7108580e60 => generated 313 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:00:19.723687 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-119626a8-4dc7-4248-af53-ddc65855d002 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:00:19.726304 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-119626a8-4dc7-4248-af53-ddc65855d002 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] [instance: cd080272-b545-40ab-9639-64f0665eba08] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:19.740954 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-119626a8-4dc7-4248-af53-ddc65855d002 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:19.741500 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-119626a8-4dc7-4248-af53-ddc65855d002 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:19.751996 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-119626a8-4dc7-4248-af53-ddc65855d002 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:19.753138 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-119626a8-4dc7-4248-af53-ddc65855d002 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:19.753970 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-119626a8-4dc7-4248-af53-ddc65855d002 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:19.754651 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-119626a8-4dc7-4248-af53-ddc65855d002 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:19.759971 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:00:19.955519 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-119626a8-4dc7-4248-af53-ddc65855d002 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] 10.222.0.23 "POST /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08/action" status: 202 len: 0 microversion: 2.1 time: 0.230451 Sep 10 12:00:19.956946 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2250/4482] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:00:19 2022] POST /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:00:19.966081 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-efe79c83-d58e-44a6-be4f-6f49144f3e2a tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:19.967113 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-efe79c83-d58e-44a6-be4f-6f49144f3e2a tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] [instance: cd080272-b545-40ab-9639-64f0665eba08] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:19.980092 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-efe79c83-d58e-44a6-be4f-6f49144f3e2a tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:19.983092 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-efe79c83-d58e-44a6-be4f-6f49144f3e2a tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:19.985034 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-efe79c83-d58e-44a6-be4f-6f49144f3e2a tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:19.990156 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-efe79c83-d58e-44a6-be4f-6f49144f3e2a tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:19.991945 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-efe79c83-d58e-44a6-be4f-6f49144f3e2a tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:19.994410 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-efe79c83-d58e-44a6-be4f-6f49144f3e2a tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:20.504906 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bf3036bf-aba1-4490-8791-e35df072bb40 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:20.505551 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bf3036bf-aba1-4490-8791-e35df072bb40 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:20.525138 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bf3036bf-aba1-4490-8791-e35df072bb40 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:20.525636 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bf3036bf-aba1-4490-8791-e35df072bb40 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:20.526068 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bf3036bf-aba1-4490-8791-e35df072bb40 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:20.527445 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bf3036bf-aba1-4490-8791-e35df072bb40 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:20.527911 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bf3036bf-aba1-4490-8791-e35df072bb40 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:20.528351 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bf3036bf-aba1-4490-8791-e35df072bb40 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:20.834380 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bf3036bf-aba1-4490-8791-e35df072bb40 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:20.849649 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bf3036bf-aba1-4490-8791-e35df072bb40 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4" status: 200 len: 1621 microversion: 2.1 time: 0.349354 Sep 10 12:00:20.851760 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2251/4483] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:20 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 => generated 1621 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:00:20.931126 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-efe79c83-d58e-44a6-be4f-6f49144f3e2a tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9eb8af88f648878d231e7ce4ff11c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b3564725094507aaa3ba0e23e24e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:20.947721 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-efe79c83-d58e-44a6-be4f-6f49144f3e2a tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] 10.222.0.23 "GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08" status: 200 len: 1507 microversion: 2.1 time: 0.985492 Sep 10 12:00:20.950562 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2233/4484] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:19 2022] GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08 => generated 1507 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:21.875943 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4aeab828-4139-4964-b80e-f9c348001217 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:21.885235 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4aeab828-4139-4964-b80e-f9c348001217 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:21.901055 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4aeab828-4139-4964-b80e-f9c348001217 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:21.903840 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4aeab828-4139-4964-b80e-f9c348001217 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:21.904395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4aeab828-4139-4964-b80e-f9c348001217 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:21.909704 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4aeab828-4139-4964-b80e-f9c348001217 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:21.910964 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4aeab828-4139-4964-b80e-f9c348001217 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:21.913043 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4aeab828-4139-4964-b80e-f9c348001217 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:21.978729 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-693cf721-e810-406e-938f-eac0c3d17387 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:21.980030 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-693cf721-e810-406e-938f-eac0c3d17387 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] [instance: cd080272-b545-40ab-9639-64f0665eba08] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:22.006253 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-693cf721-e810-406e-938f-eac0c3d17387 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:22.007046 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-693cf721-e810-406e-938f-eac0c3d17387 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:22.008176 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-693cf721-e810-406e-938f-eac0c3d17387 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:22.009068 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-693cf721-e810-406e-938f-eac0c3d17387 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:22.009856 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-693cf721-e810-406e-938f-eac0c3d17387 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:22.010453 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-693cf721-e810-406e-938f-eac0c3d17387 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:22.493587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4aeab828-4139-4964-b80e-f9c348001217 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:22.512005 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4aeab828-4139-4964-b80e-f9c348001217 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4" status: 200 len: 1621 microversion: 2.1 time: 0.639855 Sep 10 12:00:22.535361 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2252/4485] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:21 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 => generated 1621 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:23.010816 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-693cf721-e810-406e-938f-eac0c3d17387 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9eb8af88f648878d231e7ce4ff11c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b3564725094507aaa3ba0e23e24e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:23.019689 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-693cf721-e810-406e-938f-eac0c3d17387 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] 10.222.0.23 "GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08" status: 200 len: 1507 microversion: 2.1 time: 1.046219 Sep 10 12:00:23.020362 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2234/4486] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:21 2022] GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08 => generated 1507 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:00:23.077822 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-58f890ce-7718-4586-bffa-909a292b6a7c req-b41e1f23-3132-46b9-bb47-c9448244ad3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74075ab0-826c-4b95-9660-e3417ec2b1f4", "name": "network-vif-deleted", "tag": "d09e77fe-182b-48f1-88a4-905829b41a74"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:00:23.109494 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-58f890ce-7718-4586-bffa-909a292b6a7c req-b41e1f23-3132-46b9-bb47-c9448244ad3e service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:23.111065 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-58f890ce-7718-4586-bffa-909a292b6a7c req-b41e1f23-3132-46b9-bb47-c9448244ad3e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:23.112318 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-58f890ce-7718-4586-bffa-909a292b6a7c req-b41e1f23-3132-46b9-bb47-c9448244ad3e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:23.143913 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-58f890ce-7718-4586-bffa-909a292b6a7c req-b41e1f23-3132-46b9-bb47-c9448244ad3e service nova] Creating event network-vif-deleted:d09e77fe-182b-48f1-88a4-905829b41a74 for instance 74075ab0-826c-4b95-9660-e3417ec2b1f4 on n-h1-856895-1 Sep 10 12:00:23.157894 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-58f890ce-7718-4586-bffa-909a292b6a7c req-b41e1f23-3132-46b9-bb47-c9448244ad3e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087074 Sep 10 12:00:23.159143 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2253/4487] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:00:23.543985 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-05984f37-7d91-4d53-b33c-8ef4fdcd45d3 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:23.544804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-05984f37-7d91-4d53-b33c-8ef4fdcd45d3 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:23.559521 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:00:23.564427 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05984f37-7d91-4d53-b33c-8ef4fdcd45d3 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:23.564974 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05984f37-7d91-4d53-b33c-8ef4fdcd45d3 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:23.565448 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05984f37-7d91-4d53-b33c-8ef4fdcd45d3 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:23.566205 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05984f37-7d91-4d53-b33c-8ef4fdcd45d3 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:23.566718 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05984f37-7d91-4d53-b33c-8ef4fdcd45d3 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:23.571196 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05984f37-7d91-4d53-b33c-8ef4fdcd45d3 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:23.639640 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05984f37-7d91-4d53-b33c-8ef4fdcd45d3 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:23.641184 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05984f37-7d91-4d53-b33c-8ef4fdcd45d3 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:23.641852 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05984f37-7d91-4d53-b33c-8ef4fdcd45d3 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:23.642842 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-05984f37-7d91-4d53-b33c-8ef4fdcd45d3 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lazy-loading 'fault' on Instance uuid 74075ab0-826c-4b95-9660-e3417ec2b1f4 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:00:23.881137 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-05984f37-7d91-4d53-b33c-8ef4fdcd45d3 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:23.912057 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-05984f37-7d91-4d53-b33c-8ef4fdcd45d3 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4" status: 200 len: 1335 microversion: 2.1 time: 0.373996 Sep 10 12:00:23.912719 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2235/4488] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:23 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 => generated 1335 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:24.048876 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2c358e8f-d36f-4f3f-86c0-d1e1a2d65648 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:24.049950 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2c358e8f-d36f-4f3f-86c0-d1e1a2d65648 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] [instance: cd080272-b545-40ab-9639-64f0665eba08] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:24.068552 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c358e8f-d36f-4f3f-86c0-d1e1a2d65648 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:24.069703 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c358e8f-d36f-4f3f-86c0-d1e1a2d65648 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:24.070399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c358e8f-d36f-4f3f-86c0-d1e1a2d65648 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:24.071779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c358e8f-d36f-4f3f-86c0-d1e1a2d65648 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:24.072787 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c358e8f-d36f-4f3f-86c0-d1e1a2d65648 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:24.075329 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c358e8f-d36f-4f3f-86c0-d1e1a2d65648 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:24.830916 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2c358e8f-d36f-4f3f-86c0-d1e1a2d65648 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9eb8af88f648878d231e7ce4ff11c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b3564725094507aaa3ba0e23e24e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:24.861891 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2c358e8f-d36f-4f3f-86c0-d1e1a2d65648 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] 10.222.0.23 "GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08" status: 200 len: 1512 microversion: 2.1 time: 0.821387 Sep 10 12:00:24.862537 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2254/4489] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:24 2022] GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08 => generated 1512 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:24.939927 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-beb61ea3-b4c0-40ff-a1b8-de06d122cbf4 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:24.941127 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-beb61ea3-b4c0-40ff-a1b8-de06d122cbf4 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 74075ab0-826c-4b95-9660-e3417ec2b1f4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:24.965018 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-beb61ea3-b4c0-40ff-a1b8-de06d122cbf4 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:24.971104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-beb61ea3-b4c0-40ff-a1b8-de06d122cbf4 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:24.971863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-beb61ea3-b4c0-40ff-a1b8-de06d122cbf4 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:24.972859 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-beb61ea3-b4c0-40ff-a1b8-de06d122cbf4 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:24.973507 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-beb61ea3-b4c0-40ff-a1b8-de06d122cbf4 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:24.977985 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-beb61ea3-b4c0-40ff-a1b8-de06d122cbf4 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:25.018151 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-beb61ea3-b4c0-40ff-a1b8-de06d122cbf4 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] HTTP exception thrown: Instance 74075ab0-826c-4b95-9660-e3417ec2b1f4 could not be found. Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-beb61ea3-b4c0-40ff-a1b8-de06d122cbf4 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Request method failure captured: Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 HTTP/1.1 Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHsDb9McMbZ9alVjJ4oJKA7xoa0-QA-ERuLKN-wY-xgkYgjg-f1Qkk9v6xNr7bPpAGzBceBuhySDill-chXUItw0i1842Y9FDTX_ZkXuD1aeT9HQ_-qUH7OXi222TXPS2e9y3GtImQxVIp9JaCN7mrwULBVN7FoNXkYNRF6EUEoKMAw Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 8e8bc2c6ea1946bfbbf47d63b5fa4648 Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1615383257 Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e8bc2c6ea1946bfbbf47d63b5fa4648"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e8bc2c6ea1946bfbbf47d63b5fa4648"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8e8bc2c6ea1946bfbbf47d63b5fa4648", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8e8bc2c6ea1946bfbbf47d63b5fa4648"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1615383257 Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 8e8bc2c6ea1946bfbbf47d63b5fa4648 Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1615383257 Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServerRescueNegativeTestJSON-1615383257-project Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: bddddbd6718f472e951fd87a6ec00f8d Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1615383257-project Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 74075ab0-826c-4b95-9660-e3417ec2b1f4 could not be found. Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '74075ab0-826c-4b95-9660-e3417ec2b1f4'} Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74075ab0-826c-4b95-9660-e3417ec2b1f4 could not be found. Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74075ab0-826c-4b95-9660-e3417ec2b1f4 could not be found. Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:00:25.020327 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:00:25.028544 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:00:25.028544 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:00:25.028544 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:00:25.028544 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:00:25.028544 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:00:25.028544 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:00:25.028544 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74075ab0-826c-4b95-9660-e3417ec2b1f4 could not be found. Sep 10 12:00:25.028544 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:00:25.034358 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-beb61ea3-b4c0-40ff-a1b8-de06d122cbf4 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Returning 404 to user: Instance 74075ab0-826c-4b95-9660-e3417ec2b1f4 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:00:25.036499 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-beb61ea3-b4c0-40ff-a1b8-de06d122cbf4 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4" status: 404 len: 111 microversion: 2.1 time: 0.099857 Sep 10 12:00:25.043640 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2236/4490] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:24 2022] GET /compute/v2.1/servers/74075ab0-826c-4b95-9660-e3417ec2b1f4 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:00:25.051641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-aae0cb53-a2c4-4834-8be9-2f331118580b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '.version_select at 0x7f40726b0f70>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:25.098816 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-aae0cb53-a2c4-4834-8be9-2f331118580b tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-842044496" status: 202 len: 0 microversion: 2.1 time: 0.051094 Sep 10 12:00:25.100038 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2255/4491] 10.222.0.23 () {58 vars in 1218 bytes} [Sat Sep 10 12:00:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-842044496 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:00:25.886793 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d59877c0-c961-4f5c-8e32-02cc79381640 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:25.887451 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d59877c0-c961-4f5c-8e32-02cc79381640 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] [instance: cd080272-b545-40ab-9639-64f0665eba08] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:25.911281 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d59877c0-c961-4f5c-8e32-02cc79381640 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:25.911792 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d59877c0-c961-4f5c-8e32-02cc79381640 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:25.912234 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d59877c0-c961-4f5c-8e32-02cc79381640 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:25.914139 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d59877c0-c961-4f5c-8e32-02cc79381640 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:25.914621 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d59877c0-c961-4f5c-8e32-02cc79381640 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:25.915056 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d59877c0-c961-4f5c-8e32-02cc79381640 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:26.341720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d59877c0-c961-4f5c-8e32-02cc79381640 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9eb8af88f648878d231e7ce4ff11c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b3564725094507aaa3ba0e23e24e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:26.352152 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d59877c0-c961-4f5c-8e32-02cc79381640 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] 10.222.0.23 "GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08" status: 200 len: 1505 microversion: 2.1 time: 0.469539 Sep 10 12:00:26.352747 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2237/4492] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:25 2022] GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08 => generated 1505 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:26.382967 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-36c399d2-fcba-4515-bc18-a1939cf0310c tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Calling method '.version_select at 0x7f40724150d0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:26.384380 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-36c399d2-fcba-4515-bc18-a1939cf0310c tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] [instance: cd080272-b545-40ab-9639-64f0665eba08] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:26.396633 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36c399d2-fcba-4515-bc18-a1939cf0310c tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:26.397345 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36c399d2-fcba-4515-bc18-a1939cf0310c tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:26.397977 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36c399d2-fcba-4515-bc18-a1939cf0310c tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:26.398957 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36c399d2-fcba-4515-bc18-a1939cf0310c tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:26.400142 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36c399d2-fcba-4515-bc18-a1939cf0310c tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:26.400755 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36c399d2-fcba-4515-bc18-a1939cf0310c tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:26.471947 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-36c399d2-fcba-4515-bc18-a1939cf0310c tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] 10.222.0.23 "GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.097278 Sep 10 12:00:26.485510 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2256/4493] 10.222.0.23 () {58 vars in 1296 bytes} [Sat Sep 10 12:00:26 2022] GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08/os-instance-actions => generated 611 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:00:26.493720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b40dcd78-a5cc-4a2d-aa39-b3d78b337aa5 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:26.494255 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b40dcd78-a5cc-4a2d-aa39-b3d78b337aa5 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] [instance: cd080272-b545-40ab-9639-64f0665eba08] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:26.515077 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b40dcd78-a5cc-4a2d-aa39-b3d78b337aa5 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:26.515619 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b40dcd78-a5cc-4a2d-aa39-b3d78b337aa5 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:26.516069 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b40dcd78-a5cc-4a2d-aa39-b3d78b337aa5 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:26.517908 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b40dcd78-a5cc-4a2d-aa39-b3d78b337aa5 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:26.518638 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b40dcd78-a5cc-4a2d-aa39-b3d78b337aa5 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:26.519479 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b40dcd78-a5cc-4a2d-aa39-b3d78b337aa5 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:26.590198 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b40dcd78-a5cc-4a2d-aa39-b3d78b337aa5 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] [instance: cd080272-b545-40ab-9639-64f0665eba08] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:00:26.751399 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b40dcd78-a5cc-4a2d-aa39-b3d78b337aa5 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08" status: 204 len: 0 microversion: 2.1 time: 0.264178 Sep 10 12:00:26.752657 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2238/4494] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:00:26 2022] DELETE /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:00:26.767439 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-30520ab2-fd7a-43b5-843d-b4665714f2dd tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:26.769223 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-30520ab2-fd7a-43b5-843d-b4665714f2dd tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] [instance: cd080272-b545-40ab-9639-64f0665eba08] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:26.785887 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30520ab2-fd7a-43b5-843d-b4665714f2dd tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:26.786525 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30520ab2-fd7a-43b5-843d-b4665714f2dd tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:26.786992 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30520ab2-fd7a-43b5-843d-b4665714f2dd tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:26.787768 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30520ab2-fd7a-43b5-843d-b4665714f2dd tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:26.788235 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30520ab2-fd7a-43b5-843d-b4665714f2dd tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:26.788672 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30520ab2-fd7a-43b5-843d-b4665714f2dd tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:27.466867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-30520ab2-fd7a-43b5-843d-b4665714f2dd tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9eb8af88f648878d231e7ce4ff11c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b3564725094507aaa3ba0e23e24e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:27.478920 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-30520ab2-fd7a-43b5-843d-b4665714f2dd tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] 10.222.0.23 "GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08" status: 200 len: 1511 microversion: 2.1 time: 0.717411 Sep 10 12:00:27.483469 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2257/4495] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:26 2022] GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08 => generated 1511 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:28.512967 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2bb1125e-c1df-488a-8c2a-4e3b2abdbb10 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:28.513738 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2bb1125e-c1df-488a-8c2a-4e3b2abdbb10 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] [instance: cd080272-b545-40ab-9639-64f0665eba08] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:28.544371 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2bb1125e-c1df-488a-8c2a-4e3b2abdbb10 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:28.544869 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2bb1125e-c1df-488a-8c2a-4e3b2abdbb10 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:28.545308 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2bb1125e-c1df-488a-8c2a-4e3b2abdbb10 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:28.552376 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2bb1125e-c1df-488a-8c2a-4e3b2abdbb10 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:28.555058 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2bb1125e-c1df-488a-8c2a-4e3b2abdbb10 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:28.557554 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2bb1125e-c1df-488a-8c2a-4e3b2abdbb10 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:29.504613 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2bb1125e-c1df-488a-8c2a-4e3b2abdbb10 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9eb8af88f648878d231e7ce4ff11c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b3564725094507aaa3ba0e23e24e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:29.519036 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2bb1125e-c1df-488a-8c2a-4e3b2abdbb10 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] 10.222.0.23 "GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08" status: 200 len: 1511 microversion: 2.1 time: 1.010182 Sep 10 12:00:29.519818 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2239/4496] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:28 2022] GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08 => generated 1511 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:30.542627 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-aebd16ed-14a3-45a4-9000-f88675a38924 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:30.563530 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-aebd16ed-14a3-45a4-9000-f88675a38924 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] [instance: cd080272-b545-40ab-9639-64f0665eba08] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:30.568047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aebd16ed-14a3-45a4-9000-f88675a38924 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:30.568622 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aebd16ed-14a3-45a4-9000-f88675a38924 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:30.586763 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aebd16ed-14a3-45a4-9000-f88675a38924 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:30.589564 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aebd16ed-14a3-45a4-9000-f88675a38924 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:30.590223 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aebd16ed-14a3-45a4-9000-f88675a38924 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:30.590830 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aebd16ed-14a3-45a4-9000-f88675a38924 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:30.800134 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-e0f7463b-4bda-4e10-99dc-40923d9f92cf req-1ad81fbf-eb3e-4f87-9354-75ef3f6fa263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd080272-b545-40ab-9639-64f0665eba08", "name": "network-vif-deleted", "tag": "59254e6f-04f6-4f7d-8a19-cbff96560f59"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:00:30.822679 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e0f7463b-4bda-4e10-99dc-40923d9f92cf req-1ad81fbf-eb3e-4f87-9354-75ef3f6fa263 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:30.823767 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e0f7463b-4bda-4e10-99dc-40923d9f92cf req-1ad81fbf-eb3e-4f87-9354-75ef3f6fa263 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:30.824436 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e0f7463b-4bda-4e10-99dc-40923d9f92cf req-1ad81fbf-eb3e-4f87-9354-75ef3f6fa263 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:30.843407 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-e0f7463b-4bda-4e10-99dc-40923d9f92cf req-1ad81fbf-eb3e-4f87-9354-75ef3f6fa263 service nova] Creating event network-vif-deleted:59254e6f-04f6-4f7d-8a19-cbff96560f59 for instance cd080272-b545-40ab-9639-64f0665eba08 on n-h2-856895-1 Sep 10 12:00:30.853005 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-e0f7463b-4bda-4e10-99dc-40923d9f92cf req-1ad81fbf-eb3e-4f87-9354-75ef3f6fa263 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061191 Sep 10 12:00:30.854720 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2240/4497] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:00:31.018246 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-aebd16ed-14a3-45a4-9000-f88675a38924 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9eb8af88f648878d231e7ce4ff11c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b3564725094507aaa3ba0e23e24e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:31.040943 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-aebd16ed-14a3-45a4-9000-f88675a38924 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] 10.222.0.23 "GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08" status: 200 len: 1469 microversion: 2.1 time: 0.502027 Sep 10 12:00:31.078833 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2258/4498] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:30 2022] GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08 => generated 1469 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:32.074739 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-18967e78-f7bf-410d-a9a0-b696077f29b6 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:32.077016 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-18967e78-f7bf-410d-a9a0-b696077f29b6 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] [instance: cd080272-b545-40ab-9639-64f0665eba08] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:32.101529 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-18967e78-f7bf-410d-a9a0-b696077f29b6 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:32.109183 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-18967e78-f7bf-410d-a9a0-b696077f29b6 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:32.109868 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-18967e78-f7bf-410d-a9a0-b696077f29b6 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:32.111590 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-18967e78-f7bf-410d-a9a0-b696077f29b6 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:32.115349 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-18967e78-f7bf-410d-a9a0-b696077f29b6 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:32.116322 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-18967e78-f7bf-410d-a9a0-b696077f29b6 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:32.159634 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-18967e78-f7bf-410d-a9a0-b696077f29b6 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] HTTP exception thrown: Instance cd080272-b545-40ab-9639-64f0665eba08 could not be found. Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-18967e78-f7bf-410d-a9a0-b696077f29b6 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Request method failure captured: Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08 HTTP/1.1 Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHxAcO8fh5pQv4L92T-SRAkX2BZOV0nII8QMCYYkqFF3DT2hMg9oOakM8ye_Cx3g6y3fP0Tezv9-8ExzVfO0NfJ_18PnatAICh2shyQa1wxm1iidICTlo4a7BsEUAMby7q148-cb4D1H9hSZmY7N8i09HoylxGRCMgw6Y6Nl1ZkUk3Y Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: f5b3564725094507aaa3ba0e23e24e45 Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-InstanceActionsTestJSON-252658058 Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f5b3564725094507aaa3ba0e23e24e45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f5b3564725094507aaa3ba0e23e24e45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f5b3564725094507aaa3ba0e23e24e45", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f5b3564725094507aaa3ba0e23e24e45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-InstanceActionsTestJSON-252658058 Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: f5b3564725094507aaa3ba0e23e24e45 Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-InstanceActionsTestJSON-252658058 Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-InstanceActionsTestJSON-252658058-project Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: bb9eb8af88f648878d231e7ce4ff11c0 Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-InstanceActionsTestJSON-252658058-project Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance cd080272-b545-40ab-9639-64f0665eba08 could not be found. Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'cd080272-b545-40ab-9639-64f0665eba08'} Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd080272-b545-40ab-9639-64f0665eba08 could not be found. Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd080272-b545-40ab-9639-64f0665eba08 could not be found. Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:00:32.165685 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:00:32.177671 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:00:32.177671 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:00:32.177671 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:00:32.177671 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:00:32.177671 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:00:32.177671 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd080272-b545-40ab-9639-64f0665eba08 could not be found. Sep 10 12:00:32.177671 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:00:32.181743 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-18967e78-f7bf-410d-a9a0-b696077f29b6 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] Returning 404 to user: Instance cd080272-b545-40ab-9639-64f0665eba08 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:00:32.186288 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-18967e78-f7bf-410d-a9a0-b696077f29b6 tempest-InstanceActionsTestJSON-252658058 tempest-InstanceActionsTestJSON-252658058-project] 10.222.0.23 "GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08" status: 404 len: 111 microversion: 2.1 time: 0.119311 Sep 10 12:00:32.189247 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2241/4499] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:32 2022] GET /compute/v2.1/servers/cd080272-b545-40ab-9639-64f0665eba08 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:00:33.125902 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ae7378ec-d2b2-468d-96bf-633416cf323d tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-483223917", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "e3e6a1e8-38ac-4b96-a2e9-310b36c89d39"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:00:33.228197 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-ae7378ec-d2b2-468d-96bf-633416cf323d tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] validate_networks() for [('e3e6a1e8-38ac-4b96-a2e9-310b36c89d39', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:00:34.690620 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-ae7378ec-d2b2-468d-96bf-633416cf323d tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:00:34.691886 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-ae7378ec-d2b2-468d-96bf-633416cf323d tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:00:34.692281 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-ae7378ec-d2b2-468d-96bf-633416cf323d tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:00:34.692833 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-ae7378ec-d2b2-468d-96bf-633416cf323d tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:00:34.693426 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-ae7378ec-d2b2-468d-96bf-633416cf323d tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:00:34.715667 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae7378ec-d2b2-468d-96bf-633416cf323d tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:34.716263 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae7378ec-d2b2-468d-96bf-633416cf323d tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:34.719292 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae7378ec-d2b2-468d-96bf-633416cf323d tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:34.722028 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae7378ec-d2b2-468d-96bf-633416cf323d tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:34.723345 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae7378ec-d2b2-468d-96bf-633416cf323d tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:34.724773 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae7378ec-d2b2-468d-96bf-633416cf323d tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:34.767901 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-ae7378ec-d2b2-468d-96bf-633416cf323d tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Getting quotas for project 0ff6d35a7d7a4bac8b6e02b6bf5cb41e. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:00:34.780372 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-ae7378ec-d2b2-468d-96bf-633416cf323d tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Getting quotas for user 0f38fd7a24614761ae0c368766006383 and project 0ff6d35a7d7a4bac8b6e02b6bf5cb41e. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:00:34.795448 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ae7378ec-d2b2-468d-96bf-633416cf323d tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Going to run 2 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:00:34.798056 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ae7378ec-d2b2-468d-96bf-633416cf323d tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: 9cf5a637-4f2b-4d72-97eb-90a453d9c016] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:00:34.851637 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ae7378ec-d2b2-468d-96bf-633416cf323d tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: f84b3473-dbad-4094-baed-338131a236a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=9cf5a637-4f2b-4d72-97eb-90a453d9c016,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:00:35.055823 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ae7378ec-d2b2-468d-96bf-633416cf323d tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.173165 Sep 10 12:00:35.061410 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2259/4500] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:00:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:00:35.071562 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a989786c-fafe-4edf-b2b6-74e092762132 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:35.076384 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a989786c-fafe-4edf-b2b6-74e092762132 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0f38fd7a24614761ae0c368766006383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff6d35a7d7a4bac8b6e02b6bf5cb41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:35.088322 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a989786c-fafe-4edf-b2b6-74e092762132 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Searching by: {'deleted': False, 'project_id': '0ff6d35a7d7a4bac8b6e02b6bf5cb41e'} {{(pid=128776) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 12:00:35.157978 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a989786c-fafe-4edf-b2b6-74e092762132 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:35.161332 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a989786c-fafe-4edf-b2b6-74e092762132 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:35.161875 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a989786c-fafe-4edf-b2b6-74e092762132 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:35.162724 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a989786c-fafe-4edf-b2b6-74e092762132 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:35.169149 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a989786c-fafe-4edf-b2b6-74e092762132 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:35.169811 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a989786c-fafe-4edf-b2b6-74e092762132 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:35.236391 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a989786c-fafe-4edf-b2b6-74e092762132 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.168906 Sep 10 12:00:35.237403 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2242/4501] 10.222.0.23 () {58 vars in 1125 bytes} [Sat Sep 10 12:00:35 2022] GET /compute/v2.1/servers => generated 675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:00:35.249403 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e1d03b43-f053-462b-9404-3eed071fa0b1 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:35.250145 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e1d03b43-f053-462b-9404-3eed071fa0b1 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: f84b3473-dbad-4094-baed-338131a236a3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:35.366589 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e1d03b43-f053-462b-9404-3eed071fa0b1 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f38fd7a24614761ae0c368766006383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff6d35a7d7a4bac8b6e02b6bf5cb41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:35.374980 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e1d03b43-f053-462b-9404-3eed071fa0b1 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "GET /compute/v2.1/servers/f84b3473-dbad-4094-baed-338131a236a3" status: 200 len: 1219 microversion: 2.1 time: 0.129575 Sep 10 12:00:35.375618 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2260/4502] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:35 2022] GET /compute/v2.1/servers/f84b3473-dbad-4094-baed-338131a236a3 => generated 1219 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:36.407942 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-828924d3-92c1-4185-8f08-156f543acc1f tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:36.409299 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-828924d3-92c1-4185-8f08-156f543acc1f tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: f84b3473-dbad-4094-baed-338131a236a3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:36.661676 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-828924d3-92c1-4185-8f08-156f543acc1f tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f38fd7a24614761ae0c368766006383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff6d35a7d7a4bac8b6e02b6bf5cb41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:36.669062 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-828924d3-92c1-4185-8f08-156f543acc1f tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "GET /compute/v2.1/servers/f84b3473-dbad-4094-baed-338131a236a3" status: 200 len: 1219 microversion: 2.1 time: 0.265190 Sep 10 12:00:36.687564 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2243/4503] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:36 2022] GET /compute/v2.1/servers/f84b3473-dbad-4094-baed-338131a236a3 => generated 1219 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:37.693978 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-33308447-77a5-4ed8-985f-06a7fa2ea9b4 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:37.694613 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-33308447-77a5-4ed8-985f-06a7fa2ea9b4 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: f84b3473-dbad-4094-baed-338131a236a3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:37.703775 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-33308447-77a5-4ed8-985f-06a7fa2ea9b4 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:37.704284 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-33308447-77a5-4ed8-985f-06a7fa2ea9b4 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:37.704746 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-33308447-77a5-4ed8-985f-06a7fa2ea9b4 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:37.705464 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-33308447-77a5-4ed8-985f-06a7fa2ea9b4 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:37.706006 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-33308447-77a5-4ed8-985f-06a7fa2ea9b4 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:37.706351 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-33308447-77a5-4ed8-985f-06a7fa2ea9b4 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:38.355828 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-33308447-77a5-4ed8-985f-06a7fa2ea9b4 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f38fd7a24614761ae0c368766006383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff6d35a7d7a4bac8b6e02b6bf5cb41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:38.369698 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-33308447-77a5-4ed8-985f-06a7fa2ea9b4 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "GET /compute/v2.1/servers/f84b3473-dbad-4094-baed-338131a236a3" status: 200 len: 1271 microversion: 2.1 time: 0.680232 Sep 10 12:00:38.372431 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2261/4504] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:37 2022] GET /compute/v2.1/servers/f84b3473-dbad-4094-baed-338131a236a3 => generated 1271 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:39.395019 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-60041df0-8478-42d9-a863-8552cc192732 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:39.396569 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-60041df0-8478-42d9-a863-8552cc192732 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: f84b3473-dbad-4094-baed-338131a236a3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:39.418633 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60041df0-8478-42d9-a863-8552cc192732 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:39.430198 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60041df0-8478-42d9-a863-8552cc192732 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:39.431216 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60041df0-8478-42d9-a863-8552cc192732 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:39.432979 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60041df0-8478-42d9-a863-8552cc192732 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:39.435912 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60041df0-8478-42d9-a863-8552cc192732 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:39.440370 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60041df0-8478-42d9-a863-8552cc192732 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:39.714757 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-60041df0-8478-42d9-a863-8552cc192732 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f38fd7a24614761ae0c368766006383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff6d35a7d7a4bac8b6e02b6bf5cb41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:39.724285 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-60041df0-8478-42d9-a863-8552cc192732 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "GET /compute/v2.1/servers/f84b3473-dbad-4094-baed-338131a236a3" status: 200 len: 1277 microversion: 2.1 time: 0.333447 Sep 10 12:00:39.744962 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2244/4505] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:39 2022] GET /compute/v2.1/servers/f84b3473-dbad-4094-baed-338131a236a3 => generated 1277 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:40.752952 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-08ed29e4-540e-4ee9-8449-88ec6a8d9161 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:40.754225 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-08ed29e4-540e-4ee9-8449-88ec6a8d9161 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: f84b3473-dbad-4094-baed-338131a236a3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:40.777649 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:00:40.784233 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-08ed29e4-540e-4ee9-8449-88ec6a8d9161 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:40.794670 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-08ed29e4-540e-4ee9-8449-88ec6a8d9161 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:40.799295 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-08ed29e4-540e-4ee9-8449-88ec6a8d9161 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:40.800209 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-08ed29e4-540e-4ee9-8449-88ec6a8d9161 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:40.804135 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-08ed29e4-540e-4ee9-8449-88ec6a8d9161 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:40.807725 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-08ed29e4-540e-4ee9-8449-88ec6a8d9161 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:42.341719 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-08ed29e4-540e-4ee9-8449-88ec6a8d9161 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f38fd7a24614761ae0c368766006383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff6d35a7d7a4bac8b6e02b6bf5cb41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:42.368328 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-08ed29e4-540e-4ee9-8449-88ec6a8d9161 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "GET /compute/v2.1/servers/f84b3473-dbad-4094-baed-338131a236a3" status: 200 len: 1319 microversion: 2.1 time: 1.619459 Sep 10 12:00:42.369543 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2262/4506] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:40 2022] GET /compute/v2.1/servers/f84b3473-dbad-4094-baed-338131a236a3 => generated 1319 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:43.401883 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3c97e4ff-25fa-40ae-8840-3b3e5977534b tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:43.402656 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3c97e4ff-25fa-40ae-8840-3b3e5977534b tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: f84b3473-dbad-4094-baed-338131a236a3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:43.413621 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3c97e4ff-25fa-40ae-8840-3b3e5977534b tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:43.427136 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3c97e4ff-25fa-40ae-8840-3b3e5977534b tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:43.428002 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3c97e4ff-25fa-40ae-8840-3b3e5977534b tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:43.436442 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3c97e4ff-25fa-40ae-8840-3b3e5977534b tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:43.437374 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3c97e4ff-25fa-40ae-8840-3b3e5977534b tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:43.440542 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3c97e4ff-25fa-40ae-8840-3b3e5977534b tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:43.538532 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:00:43.928648 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0bfab644-0a7a-479c-ac3c-e410e86f6f2d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:43.929218 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0bfab644-0a7a-479c-ac3c-e410e86f6f2d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:43.943694 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0bfab644-0a7a-479c-ac3c-e410e86f6f2d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:43.950349 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0bfab644-0a7a-479c-ac3c-e410e86f6f2d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:43.951092 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0bfab644-0a7a-479c-ac3c-e410e86f6f2d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:43.958852 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0bfab644-0a7a-479c-ac3c-e410e86f6f2d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:43.959624 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0bfab644-0a7a-479c-ac3c-e410e86f6f2d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:43.960226 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0bfab644-0a7a-479c-ac3c-e410e86f6f2d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:44.054550 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3c97e4ff-25fa-40ae-8840-3b3e5977534b tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f38fd7a24614761ae0c368766006383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff6d35a7d7a4bac8b6e02b6bf5cb41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:44.055125 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0bfab644-0a7a-479c-ac3c-e410e86f6f2d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:00:44.064240 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3c97e4ff-25fa-40ae-8840-3b3e5977534b tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "GET /compute/v2.1/servers/f84b3473-dbad-4094-baed-338131a236a3" status: 200 len: 1319 microversion: 2.1 time: 0.666277 Sep 10 12:00:44.085798 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2245/4507] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:43 2022] GET /compute/v2.1/servers/f84b3473-dbad-4094-baed-338131a236a3 => generated 1319 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:44.340790 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0bfab644-0a7a-479c-ac3c-e410e86f6f2d tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "DELETE /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180" status: 204 len: 0 microversion: 2.1 time: 0.416813 Sep 10 12:00:44.344359 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2263/4508] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:00:43 2022] DELETE /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:00:44.350071 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fdace8f8-8259-4e6b-b145-5662670072f0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:44.350699 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fdace8f8-8259-4e6b-b145-5662670072f0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:44.361940 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fdace8f8-8259-4e6b-b145-5662670072f0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:44.377619 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fdace8f8-8259-4e6b-b145-5662670072f0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:44.378419 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fdace8f8-8259-4e6b-b145-5662670072f0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:44.380038 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fdace8f8-8259-4e6b-b145-5662670072f0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:44.381624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fdace8f8-8259-4e6b-b145-5662670072f0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:44.383736 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fdace8f8-8259-4e6b-b145-5662670072f0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:45.119412 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7f99f486-a7b4-4440-b551-369bd60920e6 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:45.120775 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7f99f486-a7b4-4440-b551-369bd60920e6 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: f84b3473-dbad-4094-baed-338131a236a3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:45.127571 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:00:45.140276 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f99f486-a7b4-4440-b551-369bd60920e6 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:45.141038 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f99f486-a7b4-4440-b551-369bd60920e6 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:45.142628 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f99f486-a7b4-4440-b551-369bd60920e6 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:45.144090 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f99f486-a7b4-4440-b551-369bd60920e6 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:45.147618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f99f486-a7b4-4440-b551-369bd60920e6 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:45.148310 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f99f486-a7b4-4440-b551-369bd60920e6 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:45.200121 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:00:45.370703 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=8 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:00:45.377829 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fdace8f8-8259-4e6b-b145-5662670072f0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:45.391479 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fdace8f8-8259-4e6b-b145-5662670072f0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180" status: 200 len: 1507 microversion: 2.1 time: 1.041464 Sep 10 12:00:45.392685 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2246/4509] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:44 2022] GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180 => generated 1507 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:45.405409 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-74075838-fd92-4b38-9b20-46bb7ab169cd req-e8b98424-d484-4cd4-a969-d162c0bec77a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f84b3473-dbad-4094-baed-338131a236a3", "tag": "bda53eff-fe51-4ee2-9d1f-f88fd2e07f17"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:00:45.433114 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-74075838-fd92-4b38-9b20-46bb7ab169cd req-e8b98424-d484-4cd4-a969-d162c0bec77a service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:45.433894 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-74075838-fd92-4b38-9b20-46bb7ab169cd req-e8b98424-d484-4cd4-a969-d162c0bec77a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:45.434505 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-74075838-fd92-4b38-9b20-46bb7ab169cd req-e8b98424-d484-4cd4-a969-d162c0bec77a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:45.453313 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-74075838-fd92-4b38-9b20-46bb7ab169cd req-e8b98424-d484-4cd4-a969-d162c0bec77a service nova] Creating event network-changed:bda53eff-fe51-4ee2-9d1f-f88fd2e07f17 for instance f84b3473-dbad-4094-baed-338131a236a3 on n-h1-856895-1 Sep 10 12:00:45.465048 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-74075838-fd92-4b38-9b20-46bb7ab169cd req-e8b98424-d484-4cd4-a969-d162c0bec77a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070785 Sep 10 12:00:45.471246 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2247/4510] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:00:45.935305 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7f99f486-a7b4-4440-b551-369bd60920e6 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f38fd7a24614761ae0c368766006383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff6d35a7d7a4bac8b6e02b6bf5cb41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:45.949144 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7f99f486-a7b4-4440-b551-369bd60920e6 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "GET /compute/v2.1/servers/f84b3473-dbad-4094-baed-338131a236a3" status: 200 len: 1319 microversion: 2.1 time: 0.854275 Sep 10 12:00:45.971013 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2264/4511] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:45 2022] GET /compute/v2.1/servers/f84b3473-dbad-4094-baed-338131a236a3 => generated 1319 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:46.415714 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-816dc142-0152-4c5a-a4f1-e1d7ef9c72d0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:46.417086 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-816dc142-0152-4c5a-a4f1-e1d7ef9c72d0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:46.433731 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-816dc142-0152-4c5a-a4f1-e1d7ef9c72d0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:46.434235 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-816dc142-0152-4c5a-a4f1-e1d7ef9c72d0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:46.434685 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-816dc142-0152-4c5a-a4f1-e1d7ef9c72d0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:46.435431 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-816dc142-0152-4c5a-a4f1-e1d7ef9c72d0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:46.435902 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-816dc142-0152-4c5a-a4f1-e1d7ef9c72d0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:46.436341 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-816dc142-0152-4c5a-a4f1-e1d7ef9c72d0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:46.672088 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:00:46.973958 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e9c684be-b7c1-446c-8da1-10cb2c847486 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:46.975350 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e9c684be-b7c1-446c-8da1-10cb2c847486 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: f84b3473-dbad-4094-baed-338131a236a3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:46.986479 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e9c684be-b7c1-446c-8da1-10cb2c847486 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:47.006507 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e9c684be-b7c1-446c-8da1-10cb2c847486 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:47.007092 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e9c684be-b7c1-446c-8da1-10cb2c847486 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:47.008399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e9c684be-b7c1-446c-8da1-10cb2c847486 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:47.008399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e9c684be-b7c1-446c-8da1-10cb2c847486 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:47.008839 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e9c684be-b7c1-446c-8da1-10cb2c847486 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:48.007057 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-816dc142-0152-4c5a-a4f1-e1d7ef9c72d0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:48.023403 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-816dc142-0152-4c5a-a4f1-e1d7ef9c72d0 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180" status: 200 len: 1507 microversion: 2.1 time: 1.612276 Sep 10 12:00:48.046586 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2248/4512] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:46 2022] GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180 => generated 1507 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:48.052169 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-35d19573-44b4-49a9-ad3a-3b64e5ec23a9 req-589fd9a3-9aa2-498f-a70c-46cdc69fe8f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84f2edbd-a437-474e-bd57-10814851e180", "name": "network-vif-deleted", "tag": "55557b64-98f5-4620-a6c2-033018b54096"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:00:48.089099 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-35d19573-44b4-49a9-ad3a-3b64e5ec23a9 req-589fd9a3-9aa2-498f-a70c-46cdc69fe8f6 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:48.089633 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-35d19573-44b4-49a9-ad3a-3b64e5ec23a9 req-589fd9a3-9aa2-498f-a70c-46cdc69fe8f6 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:48.090086 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-35d19573-44b4-49a9-ad3a-3b64e5ec23a9 req-589fd9a3-9aa2-498f-a70c-46cdc69fe8f6 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:48.114975 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-35d19573-44b4-49a9-ad3a-3b64e5ec23a9 req-589fd9a3-9aa2-498f-a70c-46cdc69fe8f6 service nova] Creating event network-vif-deleted:55557b64-98f5-4620-a6c2-033018b54096 for instance 84f2edbd-a437-474e-bd57-10814851e180 on n-h2-856895-1 Sep 10 12:00:48.137504 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-35d19573-44b4-49a9-ad3a-3b64e5ec23a9 req-589fd9a3-9aa2-498f-a70c-46cdc69fe8f6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089424 Sep 10 12:00:48.138409 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2249/4513] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:00:48.295300 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e9c684be-b7c1-446c-8da1-10cb2c847486 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f38fd7a24614761ae0c368766006383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff6d35a7d7a4bac8b6e02b6bf5cb41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:48.306585 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e9c684be-b7c1-446c-8da1-10cb2c847486 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "GET /compute/v2.1/servers/f84b3473-dbad-4094-baed-338131a236a3" status: 200 len: 1319 microversion: 2.1 time: 1.336926 Sep 10 12:00:48.308689 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2265/4514] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:46 2022] GET /compute/v2.1/servers/f84b3473-dbad-4094-baed-338131a236a3 => generated 1319 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:00:48.581106 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-6a305ba4-31d2-452b-a67e-73c0d1081abf req-7b620cd5-abb6-4437-a8d0-e56ef2bfa441 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cf5a637-4f2b-4d72-97eb-90a453d9c016", "tag": "df2b6078-0258-45ea-a132-968de5aab2c1"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:00:48.601718 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6a305ba4-31d2-452b-a67e-73c0d1081abf req-7b620cd5-abb6-4437-a8d0-e56ef2bfa441 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:48.609095 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6a305ba4-31d2-452b-a67e-73c0d1081abf req-7b620cd5-abb6-4437-a8d0-e56ef2bfa441 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:48.609933 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6a305ba4-31d2-452b-a67e-73c0d1081abf req-7b620cd5-abb6-4437-a8d0-e56ef2bfa441 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:48.646298 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-6a305ba4-31d2-452b-a67e-73c0d1081abf req-7b620cd5-abb6-4437-a8d0-e56ef2bfa441 service nova] Creating event network-changed:df2b6078-0258-45ea-a132-968de5aab2c1 for instance 9cf5a637-4f2b-4d72-97eb-90a453d9c016 on n-h2-856895-1 Sep 10 12:00:48.673046 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-6a305ba4-31d2-452b-a67e-73c0d1081abf req-7b620cd5-abb6-4437-a8d0-e56ef2bfa441 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095719 Sep 10 12:00:48.677867 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2250/4515] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:00:49.054276 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-28bb4e10-3744-4085-aedb-bc4a70c2cb7f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:49.055068 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-28bb4e10-3744-4085-aedb-bc4a70c2cb7f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 84f2edbd-a437-474e-bd57-10814851e180] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:49.068919 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28bb4e10-3744-4085-aedb-bc4a70c2cb7f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:49.074456 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28bb4e10-3744-4085-aedb-bc4a70c2cb7f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:49.077533 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28bb4e10-3744-4085-aedb-bc4a70c2cb7f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:49.079789 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28bb4e10-3744-4085-aedb-bc4a70c2cb7f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:49.083487 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28bb4e10-3744-4085-aedb-bc4a70c2cb7f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:49.085293 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28bb4e10-3744-4085-aedb-bc4a70c2cb7f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:49.152039 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-28bb4e10-3744-4085-aedb-bc4a70c2cb7f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] HTTP exception thrown: Instance 84f2edbd-a437-474e-bd57-10814851e180 could not be found. Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-28bb4e10-3744-4085-aedb-bc4a70c2cb7f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Request method failure captured: Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180 HTTP/1.1 Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHsDb9McMbZ9alVjJ4oJKA7xoa0-QA-ERuLKN-wY-xgkYgjg-f1Qkk9v6xNr7bPpAGzBceBuhySDill-chXUItw0i1842Y9FDTX_ZkXuD1aeT9HQ_-qUH7OXi222TXPS2e9y3GtImQxVIp9JaCN7mrwULBVN7FoNXkYNRF6EUEoKMAw Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 8e8bc2c6ea1946bfbbf47d63b5fa4648 Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1615383257 Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e8bc2c6ea1946bfbbf47d63b5fa4648"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e8bc2c6ea1946bfbbf47d63b5fa4648"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8e8bc2c6ea1946bfbbf47d63b5fa4648", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8e8bc2c6ea1946bfbbf47d63b5fa4648"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1615383257 Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 8e8bc2c6ea1946bfbbf47d63b5fa4648 Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1615383257 Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServerRescueNegativeTestJSON-1615383257-project Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: bddddbd6718f472e951fd87a6ec00f8d Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1615383257-project Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 84f2edbd-a437-474e-bd57-10814851e180 could not be found. Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '84f2edbd-a437-474e-bd57-10814851e180'} Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84f2edbd-a437-474e-bd57-10814851e180 could not be found. Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84f2edbd-a437-474e-bd57-10814851e180 could not be found. Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:00:49.158668 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:00:49.164350 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:00:49.164350 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:00:49.164350 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:00:49.164350 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:00:49.164350 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:00:49.164350 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:00:49.164350 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84f2edbd-a437-474e-bd57-10814851e180 could not be found. Sep 10 12:00:49.164350 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:00:49.167034 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-28bb4e10-3744-4085-aedb-bc4a70c2cb7f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Returning 404 to user: Instance 84f2edbd-a437-474e-bd57-10814851e180 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:00:49.171393 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-28bb4e10-3744-4085-aedb-bc4a70c2cb7f tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180" status: 404 len: 111 microversion: 2.1 time: 0.121316 Sep 10 12:00:49.176144 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2266/4516] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:49 2022] GET /compute/v2.1/servers/84f2edbd-a437-474e-bd57-10814851e180 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:00:49.184863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0e6830e1-f6cb-437c-bda9-84b4055a7707 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:49.186086 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0e6830e1-f6cb-437c-bda9-84b4055a7707 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 51d91016-0b23-4d74-98b4-1c76652aacb5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:49.202628 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e6830e1-f6cb-437c-bda9-84b4055a7707 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:49.203243 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e6830e1-f6cb-437c-bda9-84b4055a7707 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:49.203810 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e6830e1-f6cb-437c-bda9-84b4055a7707 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:49.204640 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e6830e1-f6cb-437c-bda9-84b4055a7707 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:49.206975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e6830e1-f6cb-437c-bda9-84b4055a7707 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:49.210499 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e6830e1-f6cb-437c-bda9-84b4055a7707 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:49.303812 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0e6830e1-f6cb-437c-bda9-84b4055a7707 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 51d91016-0b23-4d74-98b4-1c76652aacb5] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:00:49.342859 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4f54f5c9-bb99-40dc-a14a-46d49b6e898b tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:49.345104 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4f54f5c9-bb99-40dc-a14a-46d49b6e898b tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: f84b3473-dbad-4094-baed-338131a236a3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:49.360373 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4f54f5c9-bb99-40dc-a14a-46d49b6e898b tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:49.376153 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4f54f5c9-bb99-40dc-a14a-46d49b6e898b tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:49.378546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4f54f5c9-bb99-40dc-a14a-46d49b6e898b tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:49.380494 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4f54f5c9-bb99-40dc-a14a-46d49b6e898b tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:49.385104 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4f54f5c9-bb99-40dc-a14a-46d49b6e898b tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:49.389556 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4f54f5c9-bb99-40dc-a14a-46d49b6e898b tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:49.553292 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0e6830e1-f6cb-437c-bda9-84b4055a7707 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "DELETE /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5" status: 204 len: 0 microversion: 2.1 time: 0.371283 Sep 10 12:00:49.555924 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2251/4517] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:00:49 2022] DELETE /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 12:00:49.570378 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7cb7d54f-0b01-41b2-ab76-105fcffd8b25 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:49.572527 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7cb7d54f-0b01-41b2-ab76-105fcffd8b25 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 51d91016-0b23-4d74-98b4-1c76652aacb5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:49.624344 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7cb7d54f-0b01-41b2-ab76-105fcffd8b25 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:49.624841 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7cb7d54f-0b01-41b2-ab76-105fcffd8b25 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:49.625279 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7cb7d54f-0b01-41b2-ab76-105fcffd8b25 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:49.625983 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7cb7d54f-0b01-41b2-ab76-105fcffd8b25 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:49.626447 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7cb7d54f-0b01-41b2-ab76-105fcffd8b25 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:49.626870 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7cb7d54f-0b01-41b2-ab76-105fcffd8b25 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:50.280429 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4f54f5c9-bb99-40dc-a14a-46d49b6e898b tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f38fd7a24614761ae0c368766006383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff6d35a7d7a4bac8b6e02b6bf5cb41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:50.284476 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:00:50.303325 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4f54f5c9-bb99-40dc-a14a-46d49b6e898b tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "GET /compute/v2.1/servers/f84b3473-dbad-4094-baed-338131a236a3" status: 200 len: 1319 microversion: 2.1 time: 0.971739 Sep 10 12:00:50.317169 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2267/4518] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:49 2022] GET /compute/v2.1/servers/f84b3473-dbad-4094-baed-338131a236a3 => generated 1319 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:50.374600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7cb7d54f-0b01-41b2-ab76-105fcffd8b25 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:50.387825 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7cb7d54f-0b01-41b2-ab76-105fcffd8b25 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5" status: 200 len: 1522 microversion: 2.1 time: 0.827437 Sep 10 12:00:50.412446 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2252/4519] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:49 2022] GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5 => generated 1522 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:51.342881 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-195da38e-dd56-422a-af99-a460f7f4def8 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:51.389422 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-195da38e-dd56-422a-af99-a460f7f4def8 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: f84b3473-dbad-4094-baed-338131a236a3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:51.409151 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-195da38e-dd56-422a-af99-a460f7f4def8 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:51.409745 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-195da38e-dd56-422a-af99-a460f7f4def8 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:51.411976 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-195da38e-dd56-422a-af99-a460f7f4def8 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:51.415242 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-195da38e-dd56-422a-af99-a460f7f4def8 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:51.415921 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-195da38e-dd56-422a-af99-a460f7f4def8 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:51.416530 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-195da38e-dd56-422a-af99-a460f7f4def8 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:51.416725 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2d214df2-c96b-4f42-a37b-198a715adc69 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:51.417343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2d214df2-c96b-4f42-a37b-198a715adc69 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 51d91016-0b23-4d74-98b4-1c76652aacb5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:51.437744 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d214df2-c96b-4f42-a37b-198a715adc69 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:51.438253 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d214df2-c96b-4f42-a37b-198a715adc69 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:51.441778 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d214df2-c96b-4f42-a37b-198a715adc69 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:51.444440 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d214df2-c96b-4f42-a37b-198a715adc69 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:51.444893 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d214df2-c96b-4f42-a37b-198a715adc69 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:51.449638 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d214df2-c96b-4f42-a37b-198a715adc69 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:51.785439 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-195da38e-dd56-422a-af99-a460f7f4def8 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f38fd7a24614761ae0c368766006383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff6d35a7d7a4bac8b6e02b6bf5cb41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:51.793733 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-195da38e-dd56-422a-af99-a460f7f4def8 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "GET /compute/v2.1/servers/f84b3473-dbad-4094-baed-338131a236a3" status: 200 len: 1319 microversion: 2.1 time: 0.455055 Sep 10 12:00:51.828316 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2268/4520] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:51 2022] GET /compute/v2.1/servers/f84b3473-dbad-4094-baed-338131a236a3 => generated 1319 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:52.132966 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2d214df2-c96b-4f42-a37b-198a715adc69 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:52.155053 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2d214df2-c96b-4f42-a37b-198a715adc69 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5" status: 200 len: 1522 microversion: 2.1 time: 0.732909 Sep 10 12:00:52.173889 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2253/4521] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:51 2022] GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5 => generated 1522 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:52.835499 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7f0eb63a-007f-44d8-9a03-87abb08da682 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:52.835998 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7f0eb63a-007f-44d8-9a03-87abb08da682 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: f84b3473-dbad-4094-baed-338131a236a3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:52.857787 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f0eb63a-007f-44d8-9a03-87abb08da682 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:52.858613 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f0eb63a-007f-44d8-9a03-87abb08da682 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:52.859294 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f0eb63a-007f-44d8-9a03-87abb08da682 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:52.861034 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f0eb63a-007f-44d8-9a03-87abb08da682 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:52.861674 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f0eb63a-007f-44d8-9a03-87abb08da682 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:52.862278 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f0eb63a-007f-44d8-9a03-87abb08da682 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:53.186539 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-698e6a74-dad9-47b9-a53b-17ccd270adfa tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:53.187189 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-698e6a74-dad9-47b9-a53b-17ccd270adfa tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 51d91016-0b23-4d74-98b4-1c76652aacb5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:53.201001 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-698e6a74-dad9-47b9-a53b-17ccd270adfa tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:53.203188 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-698e6a74-dad9-47b9-a53b-17ccd270adfa tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:53.204202 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-698e6a74-dad9-47b9-a53b-17ccd270adfa tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:53.205238 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-698e6a74-dad9-47b9-a53b-17ccd270adfa tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:53.205876 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-698e6a74-dad9-47b9-a53b-17ccd270adfa tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:53.206729 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-698e6a74-dad9-47b9-a53b-17ccd270adfa tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:53.228371 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7f0eb63a-007f-44d8-9a03-87abb08da682 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f38fd7a24614761ae0c368766006383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff6d35a7d7a4bac8b6e02b6bf5cb41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:53.236578 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7f0eb63a-007f-44d8-9a03-87abb08da682 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "GET /compute/v2.1/servers/f84b3473-dbad-4094-baed-338131a236a3" status: 200 len: 1319 microversion: 2.1 time: 0.405277 Sep 10 12:00:53.252273 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2269/4522] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:52 2022] GET /compute/v2.1/servers/f84b3473-dbad-4094-baed-338131a236a3 => generated 1319 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:53.553454 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-698e6a74-dad9-47b9-a53b-17ccd270adfa tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:53.580259 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-698e6a74-dad9-47b9-a53b-17ccd270adfa tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5" status: 200 len: 1522 microversion: 2.1 time: 0.396999 Sep 10 12:00:53.581939 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2254/4523] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:53 2022] GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5 => generated 1522 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:00:54.173936 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-36c1c9c1-f433-4e89-8dfd-234ff8e0790b req-a9c47689-e01b-4d45-865e-d57ff64f04f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cf5a637-4f2b-4d72-97eb-90a453d9c016", "name": "network-vif-plugged", "status": "completed", "tag": "df2b6078-0258-45ea-a132-968de5aab2c1"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:00:54.187540 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-36c1c9c1-f433-4e89-8dfd-234ff8e0790b req-a9c47689-e01b-4d45-865e-d57ff64f04f7 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:54.196108 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-36c1c9c1-f433-4e89-8dfd-234ff8e0790b req-a9c47689-e01b-4d45-865e-d57ff64f04f7 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:54.197081 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-36c1c9c1-f433-4e89-8dfd-234ff8e0790b req-a9c47689-e01b-4d45-865e-d57ff64f04f7 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:54.224681 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-36c1c9c1-f433-4e89-8dfd-234ff8e0790b req-a9c47689-e01b-4d45-865e-d57ff64f04f7 service nova] Creating event network-vif-plugged:df2b6078-0258-45ea-a132-968de5aab2c1 for instance 9cf5a637-4f2b-4d72-97eb-90a453d9c016 on n-h2-856895-1 Sep 10 12:00:54.235529 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-36c1c9c1-f433-4e89-8dfd-234ff8e0790b req-a9c47689-e01b-4d45-865e-d57ff64f04f7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064977 Sep 10 12:00:54.237664 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2270/4524] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:00:54.262595 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8c68ab3f-e7e6-4afe-a7bc-02ced2bc7823 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:54.266042 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8c68ab3f-e7e6-4afe-a7bc-02ced2bc7823 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: f84b3473-dbad-4094-baed-338131a236a3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:54.271142 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:00:54.279038 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8c68ab3f-e7e6-4afe-a7bc-02ced2bc7823 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:54.280977 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8c68ab3f-e7e6-4afe-a7bc-02ced2bc7823 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:54.281871 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8c68ab3f-e7e6-4afe-a7bc-02ced2bc7823 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:54.283400 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8c68ab3f-e7e6-4afe-a7bc-02ced2bc7823 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:54.284288 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8c68ab3f-e7e6-4afe-a7bc-02ced2bc7823 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:54.286070 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8c68ab3f-e7e6-4afe-a7bc-02ced2bc7823 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:54.617409 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bd83d249-2784-4f69-818a-e5f870c2f1d1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:54.618587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bd83d249-2784-4f69-818a-e5f870c2f1d1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 51d91016-0b23-4d74-98b4-1c76652aacb5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:54.629705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd83d249-2784-4f69-818a-e5f870c2f1d1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:54.630414 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd83d249-2784-4f69-818a-e5f870c2f1d1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:54.633264 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd83d249-2784-4f69-818a-e5f870c2f1d1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:54.636911 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd83d249-2784-4f69-818a-e5f870c2f1d1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:54.637514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd83d249-2784-4f69-818a-e5f870c2f1d1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:54.638169 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd83d249-2784-4f69-818a-e5f870c2f1d1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:54.829730 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bd83d249-2784-4f69-818a-e5f870c2f1d1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bddddbd6718f472e951fd87a6ec00f8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8bc2c6ea1946bfbbf47d63b5fa4648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:54.841957 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bd83d249-2784-4f69-818a-e5f870c2f1d1 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5" status: 200 len: 1480 microversion: 2.1 time: 0.239040 Sep 10 12:00:54.858591 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2271/4525] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:54 2022] GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5 => generated 1480 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:54.867365 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e5c30036-d634-4166-b48c-3820c8a9f9cf tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:54.869643 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e5c30036-d634-4166-b48c-3820c8a9f9cf tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:54.884661 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e5c30036-d634-4166-b48c-3820c8a9f9cf tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:54.885167 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e5c30036-d634-4166-b48c-3820c8a9f9cf tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:54.885606 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e5c30036-d634-4166-b48c-3820c8a9f9cf tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:54.886315 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e5c30036-d634-4166-b48c-3820c8a9f9cf tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:54.886771 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e5c30036-d634-4166-b48c-3820c8a9f9cf tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:54.887214 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e5c30036-d634-4166-b48c-3820c8a9f9cf tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:55.092386 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8c68ab3f-e7e6-4afe-a7bc-02ced2bc7823 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f38fd7a24614761ae0c368766006383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff6d35a7d7a4bac8b6e02b6bf5cb41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:55.109457 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8c68ab3f-e7e6-4afe-a7bc-02ced2bc7823 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "GET /compute/v2.1/servers/f84b3473-dbad-4094-baed-338131a236a3" status: 200 len: 1319 microversion: 2.1 time: 0.851124 Sep 10 12:00:55.111050 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2255/4526] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:54 2022] GET /compute/v2.1/servers/f84b3473-dbad-4094-baed-338131a236a3 => generated 1319 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:00:55.302847 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e5c30036-d634-4166-b48c-3820c8a9f9cf tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:55.313727 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e5c30036-d634-4166-b48c-3820c8a9f9cf tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.462202 Sep 10 12:00:55.323753 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2272/4527] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:54 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:55.347714 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f304b81f-c35d-44ae-89d8-aed767a2d0b4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-228503226"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:00:55.350618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f304b81f-c35d-44ae-89d8-aed767a2d0b4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:55.372121 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f304b81f-c35d-44ae-89d8-aed767a2d0b4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:55.372992 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f304b81f-c35d-44ae-89d8-aed767a2d0b4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:55.373679 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f304b81f-c35d-44ae-89d8-aed767a2d0b4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:55.382173 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f304b81f-c35d-44ae-89d8-aed767a2d0b4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:55.383016 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f304b81f-c35d-44ae-89d8-aed767a2d0b4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:55.383714 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f304b81f-c35d-44ae-89d8-aed767a2d0b4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:55.536403 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-7c3d85db-67f5-4a12-8104-1cf9c6c58a5c req-223f08fe-43ab-4e4b-aa34-9d3885dc4eec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51d91016-0b23-4d74-98b4-1c76652aacb5", "name": "network-vif-deleted", "tag": "9844db02-76f7-4542-ae21-8ec4bede55f6"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:00:55.556191 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-7c3d85db-67f5-4a12-8104-1cf9c6c58a5c req-223f08fe-43ab-4e4b-aa34-9d3885dc4eec service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:55.557220 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-7c3d85db-67f5-4a12-8104-1cf9c6c58a5c req-223f08fe-43ab-4e4b-aa34-9d3885dc4eec service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:55.558367 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-7c3d85db-67f5-4a12-8104-1cf9c6c58a5c req-223f08fe-43ab-4e4b-aa34-9d3885dc4eec service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:55.577959 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-7c3d85db-67f5-4a12-8104-1cf9c6c58a5c req-223f08fe-43ab-4e4b-aa34-9d3885dc4eec service nova] Creating event network-vif-deleted:9844db02-76f7-4542-ae21-8ec4bede55f6 for instance 51d91016-0b23-4d74-98b4-1c76652aacb5 on n-h1-856895-1 Sep 10 12:00:55.591363 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-7c3d85db-67f5-4a12-8104-1cf9c6c58a5c req-223f08fe-43ab-4e4b-aa34-9d3885dc4eec service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.463257 Sep 10 12:00:55.592760 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2256/4528] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:00:55.754524 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f304b81f-c35d-44ae-89d8-aed767a2d0b4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "POST /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f/action" status: 202 len: 0 microversion: 2.1 time: 0.410497 Sep 10 12:00:55.755560 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2273/4529] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:00:55 2022] POST /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f/action => generated 0 bytes in 413 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Sep 10 12:00:55.876232 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-93ce8456-2c48-40b0-a530-e9ca6d309b53 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:55.877697 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-93ce8456-2c48-40b0-a530-e9ca6d309b53 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] [instance: 51d91016-0b23-4d74-98b4-1c76652aacb5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:55.902853 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-93ce8456-2c48-40b0-a530-e9ca6d309b53 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:55.903659 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-93ce8456-2c48-40b0-a530-e9ca6d309b53 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:55.904858 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-93ce8456-2c48-40b0-a530-e9ca6d309b53 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:55.914061 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-93ce8456-2c48-40b0-a530-e9ca6d309b53 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:55.914800 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-93ce8456-2c48-40b0-a530-e9ca6d309b53 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:55.915407 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-93ce8456-2c48-40b0-a530-e9ca6d309b53 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:55.942025 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-93ce8456-2c48-40b0-a530-e9ca6d309b53 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] HTTP exception thrown: Instance 51d91016-0b23-4d74-98b4-1c76652aacb5 could not be found. Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-93ce8456-2c48-40b0-a530-e9ca6d309b53 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Request method failure captured: Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5 HTTP/1.1 Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHsDb9McMbZ9alVjJ4oJKA7xoa0-QA-ERuLKN-wY-xgkYgjg-f1Qkk9v6xNr7bPpAGzBceBuhySDill-chXUItw0i1842Y9FDTX_ZkXuD1aeT9HQ_-qUH7OXi222TXPS2e9y3GtImQxVIp9JaCN7mrwULBVN7FoNXkYNRF6EUEoKMAw Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 8e8bc2c6ea1946bfbbf47d63b5fa4648 Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1615383257 Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e8bc2c6ea1946bfbbf47d63b5fa4648"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8e8bc2c6ea1946bfbbf47d63b5fa4648"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8e8bc2c6ea1946bfbbf47d63b5fa4648", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8e8bc2c6ea1946bfbbf47d63b5fa4648"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1615383257 Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 8e8bc2c6ea1946bfbbf47d63b5fa4648 Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1615383257 Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServerRescueNegativeTestJSON-1615383257-project Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: bddddbd6718f472e951fd87a6ec00f8d Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1615383257-project Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 51d91016-0b23-4d74-98b4-1c76652aacb5 could not be found. Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '51d91016-0b23-4d74-98b4-1c76652aacb5'} Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51d91016-0b23-4d74-98b4-1c76652aacb5 could not be found. Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51d91016-0b23-4d74-98b4-1c76652aacb5 could not be found. Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:00:55.943916 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:00:55.948075 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:00:55.948075 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:00:55.948075 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:00:55.948075 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:00:55.948075 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:00:55.948075 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:00:55.948075 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51d91016-0b23-4d74-98b4-1c76652aacb5 could not be found. Sep 10 12:00:55.948075 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:00:55.948075 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-93ce8456-2c48-40b0-a530-e9ca6d309b53 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] Returning 404 to user: Instance 51d91016-0b23-4d74-98b4-1c76652aacb5 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:00:55.951954 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-93ce8456-2c48-40b0-a530-e9ca6d309b53 tempest-ServerRescueNegativeTestJSON-1615383257 tempest-ServerRescueNegativeTestJSON-1615383257-project] 10.222.0.23 "GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5" status: 404 len: 111 microversion: 2.1 time: 0.081161 Sep 10 12:00:55.955445 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2257/4530] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:55 2022] GET /compute/v2.1/servers/51d91016-0b23-4d74-98b4-1c76652aacb5 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:00:56.139684 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cf130946-0504-4fab-845d-d10f67ac2a12 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:56.140597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cf130946-0504-4fab-845d-d10f67ac2a12 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: f84b3473-dbad-4094-baed-338131a236a3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:56.155947 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cf130946-0504-4fab-845d-d10f67ac2a12 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:56.160681 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cf130946-0504-4fab-845d-d10f67ac2a12 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:56.161226 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cf130946-0504-4fab-845d-d10f67ac2a12 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:56.162206 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cf130946-0504-4fab-845d-d10f67ac2a12 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:56.162960 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cf130946-0504-4fab-845d-d10f67ac2a12 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:56.163605 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cf130946-0504-4fab-845d-d10f67ac2a12 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:56.257960 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-fd354642-ff0a-42bd-b3f5-2e2630e535cc req-51d7254b-e68c-401a-9266-d6283570e78c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f84b3473-dbad-4094-baed-338131a236a3", "name": "network-vif-plugged", "status": "completed", "tag": "bda53eff-fe51-4ee2-9d1f-f88fd2e07f17"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:00:56.282759 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-fd354642-ff0a-42bd-b3f5-2e2630e535cc req-51d7254b-e68c-401a-9266-d6283570e78c service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:56.283577 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-fd354642-ff0a-42bd-b3f5-2e2630e535cc req-51d7254b-e68c-401a-9266-d6283570e78c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:56.284325 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-fd354642-ff0a-42bd-b3f5-2e2630e535cc req-51d7254b-e68c-401a-9266-d6283570e78c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:56.303067 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-fd354642-ff0a-42bd-b3f5-2e2630e535cc req-51d7254b-e68c-401a-9266-d6283570e78c service nova] Creating event network-vif-plugged:bda53eff-fe51-4ee2-9d1f-f88fd2e07f17 for instance f84b3473-dbad-4094-baed-338131a236a3 on n-h1-856895-1 Sep 10 12:00:56.311722 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-fd354642-ff0a-42bd-b3f5-2e2630e535cc req-51d7254b-e68c-401a-9266-d6283570e78c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061965 Sep 10 12:00:56.312972 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2258/4531] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:00:56.651404 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cf130946-0504-4fab-845d-d10f67ac2a12 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f38fd7a24614761ae0c368766006383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff6d35a7d7a4bac8b6e02b6bf5cb41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:56.661199 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cf130946-0504-4fab-845d-d10f67ac2a12 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "GET /compute/v2.1/servers/f84b3473-dbad-4094-baed-338131a236a3" status: 200 len: 1319 microversion: 2.1 time: 0.526826 Sep 10 12:00:56.662505 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2274/4532] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:56 2022] GET /compute/v2.1/servers/f84b3473-dbad-4094-baed-338131a236a3 => generated 1319 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:57.685835 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-28b86cff-6a44-4214-8964-3cfd3e38cdc8 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:57.686564 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-28b86cff-6a44-4214-8964-3cfd3e38cdc8 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: f84b3473-dbad-4094-baed-338131a236a3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:57.699528 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28b86cff-6a44-4214-8964-3cfd3e38cdc8 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:57.700031 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28b86cff-6a44-4214-8964-3cfd3e38cdc8 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:57.723895 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28b86cff-6a44-4214-8964-3cfd3e38cdc8 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:57.725004 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28b86cff-6a44-4214-8964-3cfd3e38cdc8 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:57.726492 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28b86cff-6a44-4214-8964-3cfd3e38cdc8 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:57.726968 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28b86cff-6a44-4214-8964-3cfd3e38cdc8 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:58.433094 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-28b86cff-6a44-4214-8964-3cfd3e38cdc8 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f38fd7a24614761ae0c368766006383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff6d35a7d7a4bac8b6e02b6bf5cb41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:00:58.452832 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-28b86cff-6a44-4214-8964-3cfd3e38cdc8 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "GET /compute/v2.1/servers/f84b3473-dbad-4094-baed-338131a236a3" status: 200 len: 1319 microversion: 2.1 time: 0.764339 Sep 10 12:00:58.454511 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2259/4533] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:57 2022] GET /compute/v2.1/servers/f84b3473-dbad-4094-baed-338131a236a3 => generated 1319 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:00:59.479455 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e8d280cd-0f01-4aa2-933e-52edc299b28f tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:00:59.480090 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e8d280cd-0f01-4aa2-933e-52edc299b28f tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: f84b3473-dbad-4094-baed-338131a236a3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:00:59.492098 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e8d280cd-0f01-4aa2-933e-52edc299b28f tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:59.492607 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e8d280cd-0f01-4aa2-933e-52edc299b28f tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:59.496635 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e8d280cd-0f01-4aa2-933e-52edc299b28f tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:59.497233 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e8d280cd-0f01-4aa2-933e-52edc299b28f tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:59.497721 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e8d280cd-0f01-4aa2-933e-52edc299b28f tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:59.500775 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e8d280cd-0f01-4aa2-933e-52edc299b28f tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:59.691598 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-214d287d-3c93-41fc-99c9-fb8e5286c20e req-9b5354ee-789d-41f4-8738-1e11a4ce45e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64704ff7-229d-478b-9889-6b6cba53bd0f", "name": "network-vif-unplugged", "status": "completed", "tag": "7f6388a0-8fe7-4ee5-821e-68c4889b9594"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:00:59.718625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-214d287d-3c93-41fc-99c9-fb8e5286c20e req-9b5354ee-789d-41f4-8738-1e11a4ce45e4 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:00:59.719658 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-214d287d-3c93-41fc-99c9-fb8e5286c20e req-9b5354ee-789d-41f4-8738-1e11a4ce45e4 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:00:59.723974 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-214d287d-3c93-41fc-99c9-fb8e5286c20e req-9b5354ee-789d-41f4-8738-1e11a4ce45e4 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:00:59.759384 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-214d287d-3c93-41fc-99c9-fb8e5286c20e req-9b5354ee-789d-41f4-8738-1e11a4ce45e4 service nova] Creating event network-vif-unplugged:7f6388a0-8fe7-4ee5-821e-68c4889b9594 for instance 64704ff7-229d-478b-9889-6b6cba53bd0f on n-h1-856895-1 Sep 10 12:00:59.774462 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-214d287d-3c93-41fc-99c9-fb8e5286c20e req-9b5354ee-789d-41f4-8738-1e11a4ce45e4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088089 Sep 10 12:00:59.775084 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2260/4534] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:01:00.682725 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e8d280cd-0f01-4aa2-933e-52edc299b28f tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f38fd7a24614761ae0c368766006383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff6d35a7d7a4bac8b6e02b6bf5cb41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:00.702319 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e8d280cd-0f01-4aa2-933e-52edc299b28f tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "GET /compute/v2.1/servers/f84b3473-dbad-4094-baed-338131a236a3" status: 200 len: 1506 microversion: 2.1 time: 1.227298 Sep 10 12:01:00.703008 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2275/4535] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:00:59 2022] GET /compute/v2.1/servers/f84b3473-dbad-4094-baed-338131a236a3 => generated 1506 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:00.730023 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4a3431c9-6f6b-4903-bad6-81e3dd4df569 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:00.730812 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4a3431c9-6f6b-4903-bad6-81e3dd4df569 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: 9cf5a637-4f2b-4d72-97eb-90a453d9c016] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:00.752652 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4a3431c9-6f6b-4903-bad6-81e3dd4df569 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:00.754381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4a3431c9-6f6b-4903-bad6-81e3dd4df569 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:00.755909 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4a3431c9-6f6b-4903-bad6-81e3dd4df569 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:00.763038 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4a3431c9-6f6b-4903-bad6-81e3dd4df569 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:00.764478 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4a3431c9-6f6b-4903-bad6-81e3dd4df569 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:00.765388 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4a3431c9-6f6b-4903-bad6-81e3dd4df569 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:01.329720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4a3431c9-6f6b-4903-bad6-81e3dd4df569 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f38fd7a24614761ae0c368766006383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff6d35a7d7a4bac8b6e02b6bf5cb41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:01.367621 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4a3431c9-6f6b-4903-bad6-81e3dd4df569 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "GET /compute/v2.1/servers/9cf5a637-4f2b-4d72-97eb-90a453d9c016" status: 200 len: 1506 microversion: 2.1 time: 0.639476 Sep 10 12:01:01.377047 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2261/4536] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:00 2022] GET /compute/v2.1/servers/9cf5a637-4f2b-4d72-97eb-90a453d9c016 => generated 1506 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:01.397487 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-26b3bb25-c07c-4229-af59-7b6b4287d2f2 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:01.398145 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-26b3bb25-c07c-4229-af59-7b6b4287d2f2 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: 9cf5a637-4f2b-4d72-97eb-90a453d9c016] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:01.405496 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-26b3bb25-c07c-4229-af59-7b6b4287d2f2 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:01.406747 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-26b3bb25-c07c-4229-af59-7b6b4287d2f2 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:01.407468 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-26b3bb25-c07c-4229-af59-7b6b4287d2f2 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:01.408570 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-26b3bb25-c07c-4229-af59-7b6b4287d2f2 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:01.409853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-26b3bb25-c07c-4229-af59-7b6b4287d2f2 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:01.410979 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-26b3bb25-c07c-4229-af59-7b6b4287d2f2 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:01.463123 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-26b3bb25-c07c-4229-af59-7b6b4287d2f2 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: 9cf5a637-4f2b-4d72-97eb-90a453d9c016] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:01:01.652433 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-26b3bb25-c07c-4229-af59-7b6b4287d2f2 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9cf5a637-4f2b-4d72-97eb-90a453d9c016" status: 204 len: 0 microversion: 2.1 time: 0.260243 Sep 10 12:01:01.659137 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2276/4537] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:01:01 2022] DELETE /compute/v2.1/servers/9cf5a637-4f2b-4d72-97eb-90a453d9c016 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:01:01.670580 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-408d2ceb-5710-4445-80f3-0d50ba48db8f tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:01.671647 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-408d2ceb-5710-4445-80f3-0d50ba48db8f tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: f84b3473-dbad-4094-baed-338131a236a3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:01.680034 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-408d2ceb-5710-4445-80f3-0d50ba48db8f tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:01.680958 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-408d2ceb-5710-4445-80f3-0d50ba48db8f tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:01.681986 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-408d2ceb-5710-4445-80f3-0d50ba48db8f tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:01.683443 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-408d2ceb-5710-4445-80f3-0d50ba48db8f tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:01.684149 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-408d2ceb-5710-4445-80f3-0d50ba48db8f tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:01.684937 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-408d2ceb-5710-4445-80f3-0d50ba48db8f tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:01.718390 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-408d2ceb-5710-4445-80f3-0d50ba48db8f tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: f84b3473-dbad-4094-baed-338131a236a3] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:01:01.963036 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-408d2ceb-5710-4445-80f3-0d50ba48db8f tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f84b3473-dbad-4094-baed-338131a236a3" status: 204 len: 0 microversion: 2.1 time: 0.298050 Sep 10 12:01:01.977335 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2262/4538] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:01:01 2022] DELETE /compute/v2.1/servers/f84b3473-dbad-4094-baed-338131a236a3 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:01:02.241615 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7531bce5-cc2f-4e7f-8ffd-520a0965606b tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-634578272", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "e3e6a1e8-38ac-4b96-a2e9-310b36c89d39"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:01:02.333211 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-7531bce5-cc2f-4e7f-8ffd-520a0965606b tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] validate_networks() for [('e3e6a1e8-38ac-4b96-a2e9-310b36c89d39', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:01:03.182561 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-7b91c7c3-54da-4a87-bbab-e99b3731fb54 req-d1cdc8ea-ca8b-420b-911d-4dc85390fbf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64704ff7-229d-478b-9889-6b6cba53bd0f", "name": "network-vif-plugged", "status": "completed", "tag": "7f6388a0-8fe7-4ee5-821e-68c4889b9594"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:01:03.198927 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-7b91c7c3-54da-4a87-bbab-e99b3731fb54 req-d1cdc8ea-ca8b-420b-911d-4dc85390fbf1 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:03.199751 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-7b91c7c3-54da-4a87-bbab-e99b3731fb54 req-d1cdc8ea-ca8b-420b-911d-4dc85390fbf1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:03.200426 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-7b91c7c3-54da-4a87-bbab-e99b3731fb54 req-d1cdc8ea-ca8b-420b-911d-4dc85390fbf1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:03.204477 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:01:03.233867 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-7b91c7c3-54da-4a87-bbab-e99b3731fb54 req-d1cdc8ea-ca8b-420b-911d-4dc85390fbf1 service nova] Creating event network-vif-plugged:7f6388a0-8fe7-4ee5-821e-68c4889b9594 for instance 64704ff7-229d-478b-9889-6b6cba53bd0f on n-h1-856895-1 Sep 10 12:01:03.247153 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-7b91c7c3-54da-4a87-bbab-e99b3731fb54 req-d1cdc8ea-ca8b-420b-911d-4dc85390fbf1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069027 Sep 10 12:01:03.250910 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2263/4539] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:01:03.410033 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-7531bce5-cc2f-4e7f-8ffd-520a0965606b tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:01:03.410828 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-7531bce5-cc2f-4e7f-8ffd-520a0965606b tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:01:03.412436 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-7531bce5-cc2f-4e7f-8ffd-520a0965606b tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:01:03.412865 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-7531bce5-cc2f-4e7f-8ffd-520a0965606b tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:01:03.413287 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-7531bce5-cc2f-4e7f-8ffd-520a0965606b tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:01:03.442673 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7531bce5-cc2f-4e7f-8ffd-520a0965606b tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:03.443210 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7531bce5-cc2f-4e7f-8ffd-520a0965606b tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:03.443666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7531bce5-cc2f-4e7f-8ffd-520a0965606b tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:03.449976 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7531bce5-cc2f-4e7f-8ffd-520a0965606b tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:03.450516 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7531bce5-cc2f-4e7f-8ffd-520a0965606b tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:03.450966 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7531bce5-cc2f-4e7f-8ffd-520a0965606b tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:03.540389 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-7531bce5-cc2f-4e7f-8ffd-520a0965606b tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Getting quotas for project 0ff6d35a7d7a4bac8b6e02b6bf5cb41e. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:01:03.560573 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-7531bce5-cc2f-4e7f-8ffd-520a0965606b tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Getting quotas for user 0f38fd7a24614761ae0c368766006383 and project 0ff6d35a7d7a4bac8b6e02b6bf5cb41e. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:01:03.589688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7531bce5-cc2f-4e7f-8ffd-520a0965606b tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Going to run 2 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:01:03.601573 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7531bce5-cc2f-4e7f-8ffd-520a0965606b tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: cea2ee6c-f0c2-4178-857d-e97ceda7e87d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:01:03.695795 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7531bce5-cc2f-4e7f-8ffd-520a0965606b tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: 39ee2e7b-63b4-40df-872b-82f81caa61f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=cea2ee6c-f0c2-4178-857d-e97ceda7e87d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:01:03.836061 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7531bce5-cc2f-4e7f-8ffd-520a0965606b tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.611480 Sep 10 12:01:03.847643 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2af0c2de-008c-42f6-8f56-8b3c95ac417d tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:03.853818 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2277/4540] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:01:02 2022] POST /compute/v2.1/servers => generated 32 bytes in 1630 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 10 12:01:03.861821 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2af0c2de-008c-42f6-8f56-8b3c95ac417d tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0f38fd7a24614761ae0c368766006383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff6d35a7d7a4bac8b6e02b6bf5cb41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:03.864296 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2af0c2de-008c-42f6-8f56-8b3c95ac417d tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Searching by: {'deleted': False, 'project_id': '0ff6d35a7d7a4bac8b6e02b6bf5cb41e'} {{(pid=128776) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 12:01:03.926827 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2af0c2de-008c-42f6-8f56-8b3c95ac417d tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:03.927365 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2af0c2de-008c-42f6-8f56-8b3c95ac417d tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:03.927814 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2af0c2de-008c-42f6-8f56-8b3c95ac417d tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:03.934249 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2af0c2de-008c-42f6-8f56-8b3c95ac417d tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:03.934755 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2af0c2de-008c-42f6-8f56-8b3c95ac417d tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:03.938160 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2af0c2de-008c-42f6-8f56-8b3c95ac417d tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:04.064439 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.multi_cell_list [None req-2af0c2de-008c-42f6-8f56-8b3c95ac417d tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=128776) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 12:01:04.196316 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2af0c2de-008c-42f6-8f56-8b3c95ac417d tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1333 microversion: 2.1 time: 0.354391 Sep 10 12:01:04.210518 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bfa59447-7f64-4b33-8e43-21582e13514c tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:04.214124 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bfa59447-7f64-4b33-8e43-21582e13514c tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: 39ee2e7b-63b4-40df-872b-82f81caa61f9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:04.230749 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2264/4541] 10.222.0.23 () {58 vars in 1125 bytes} [Sat Sep 10 12:01:03 2022] GET /compute/v2.1/servers => generated 1333 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:04.522840 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bfa59447-7f64-4b33-8e43-21582e13514c tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f38fd7a24614761ae0c368766006383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff6d35a7d7a4bac8b6e02b6bf5cb41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:04.539978 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bfa59447-7f64-4b33-8e43-21582e13514c tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "GET /compute/v2.1/servers/39ee2e7b-63b4-40df-872b-82f81caa61f9" status: 200 len: 1217 microversion: 2.1 time: 0.333071 Sep 10 12:01:04.541475 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2278/4542] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:04 2022] GET /compute/v2.1/servers/39ee2e7b-63b4-40df-872b-82f81caa61f9 => generated 1217 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:05.498081 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-2e9868cb-de94-4a55-abb0-43e99b1e8db6 req-34a5efdc-f4af-4511-b37f-d58f5492586a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cf5a637-4f2b-4d72-97eb-90a453d9c016", "name": "network-vif-deleted", "tag": "df2b6078-0258-45ea-a132-968de5aab2c1"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:01:05.548952 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-2e9868cb-de94-4a55-abb0-43e99b1e8db6 req-34a5efdc-f4af-4511-b37f-d58f5492586a service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:05.553622 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-2e9868cb-de94-4a55-abb0-43e99b1e8db6 req-34a5efdc-f4af-4511-b37f-d58f5492586a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:05.558822 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-2e9868cb-de94-4a55-abb0-43e99b1e8db6 req-34a5efdc-f4af-4511-b37f-d58f5492586a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:05.581679 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0c42d00b-b5c0-4ca6-974c-319567937057 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:05.583864 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0c42d00b-b5c0-4ca6-974c-319567937057 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: 39ee2e7b-63b4-40df-872b-82f81caa61f9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:05.655963 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-2e9868cb-de94-4a55-abb0-43e99b1e8db6 req-34a5efdc-f4af-4511-b37f-d58f5492586a service nova] Creating event network-vif-deleted:df2b6078-0258-45ea-a132-968de5aab2c1 for instance 9cf5a637-4f2b-4d72-97eb-90a453d9c016 on n-h2-856895-1 Sep 10 12:01:05.704534 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-2e9868cb-de94-4a55-abb0-43e99b1e8db6 req-34a5efdc-f4af-4511-b37f-d58f5492586a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.207585 Sep 10 12:01:05.714242 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2265/4543] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:01:06.042590 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0c42d00b-b5c0-4ca6-974c-319567937057 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f38fd7a24614761ae0c368766006383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff6d35a7d7a4bac8b6e02b6bf5cb41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:06.055372 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0c42d00b-b5c0-4ca6-974c-319567937057 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "GET /compute/v2.1/servers/39ee2e7b-63b4-40df-872b-82f81caa61f9" status: 200 len: 1217 microversion: 2.1 time: 0.490136 Sep 10 12:01:06.056037 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2279/4544] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:05 2022] GET /compute/v2.1/servers/39ee2e7b-63b4-40df-872b-82f81caa61f9 => generated 1217 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:01:07.083287 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-beafceef-dae7-46f1-b857-e2abd1f43c9e tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:07.084174 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-beafceef-dae7-46f1-b857-e2abd1f43c9e tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: 39ee2e7b-63b4-40df-872b-82f81caa61f9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:07.102225 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-beafceef-dae7-46f1-b857-e2abd1f43c9e tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:07.103375 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-beafceef-dae7-46f1-b857-e2abd1f43c9e tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:07.104144 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-beafceef-dae7-46f1-b857-e2abd1f43c9e tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:07.105094 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-beafceef-dae7-46f1-b857-e2abd1f43c9e tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:07.105596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-beafceef-dae7-46f1-b857-e2abd1f43c9e tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:07.106024 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-beafceef-dae7-46f1-b857-e2abd1f43c9e tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:07.572427 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-beafceef-dae7-46f1-b857-e2abd1f43c9e tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f38fd7a24614761ae0c368766006383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff6d35a7d7a4bac8b6e02b6bf5cb41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:07.581738 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-beafceef-dae7-46f1-b857-e2abd1f43c9e tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "GET /compute/v2.1/servers/39ee2e7b-63b4-40df-872b-82f81caa61f9" status: 200 len: 1213 microversion: 2.1 time: 0.503258 Sep 10 12:01:07.588424 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2266/4545] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:07 2022] GET /compute/v2.1/servers/39ee2e7b-63b4-40df-872b-82f81caa61f9 => generated 1213 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:07.979228 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-93240a85-fc39-4c4c-a634-7d6ecc222933 req-90ca4081-6d66-47f4-84b1-3f14d35271e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f84b3473-dbad-4094-baed-338131a236a3", "name": "network-vif-deleted", "tag": "bda53eff-fe51-4ee2-9d1f-f88fd2e07f17"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:01:08.001311 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-93240a85-fc39-4c4c-a634-7d6ecc222933 req-90ca4081-6d66-47f4-84b1-3f14d35271e4 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:08.003509 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-93240a85-fc39-4c4c-a634-7d6ecc222933 req-90ca4081-6d66-47f4-84b1-3f14d35271e4 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:08.008502 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-93240a85-fc39-4c4c-a634-7d6ecc222933 req-90ca4081-6d66-47f4-84b1-3f14d35271e4 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:08.038560 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-93240a85-fc39-4c4c-a634-7d6ecc222933 req-90ca4081-6d66-47f4-84b1-3f14d35271e4 service nova] Creating event network-vif-deleted:bda53eff-fe51-4ee2-9d1f-f88fd2e07f17 for instance f84b3473-dbad-4094-baed-338131a236a3 on n-h1-856895-1 Sep 10 12:01:08.050490 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-93240a85-fc39-4c4c-a634-7d6ecc222933 req-90ca4081-6d66-47f4-84b1-3f14d35271e4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075763 Sep 10 12:01:08.062032 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2280/4546] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:01:08.615381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-826b8e41-0dbb-4c07-81b6-3b608cee9bb6 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:08.616221 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-826b8e41-0dbb-4c07-81b6-3b608cee9bb6 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: 39ee2e7b-63b4-40df-872b-82f81caa61f9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:08.630684 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-826b8e41-0dbb-4c07-81b6-3b608cee9bb6 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:08.642647 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-826b8e41-0dbb-4c07-81b6-3b608cee9bb6 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:08.648216 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-826b8e41-0dbb-4c07-81b6-3b608cee9bb6 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:08.649239 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-826b8e41-0dbb-4c07-81b6-3b608cee9bb6 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:08.651748 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-826b8e41-0dbb-4c07-81b6-3b608cee9bb6 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:08.655416 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-826b8e41-0dbb-4c07-81b6-3b608cee9bb6 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:08.943516 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-826b8e41-0dbb-4c07-81b6-3b608cee9bb6 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f38fd7a24614761ae0c368766006383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff6d35a7d7a4bac8b6e02b6bf5cb41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:08.957768 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-826b8e41-0dbb-4c07-81b6-3b608cee9bb6 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "GET /compute/v2.1/servers/39ee2e7b-63b4-40df-872b-82f81caa61f9" status: 200 len: 1287 microversion: 2.1 time: 0.343748 Sep 10 12:01:08.961175 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2267/4547] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:08 2022] GET /compute/v2.1/servers/39ee2e7b-63b4-40df-872b-82f81caa61f9 => generated 1287 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:09.986291 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3a154b52-c399-40b7-8a4c-b126ab9e39d6 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:09.987817 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3a154b52-c399-40b7-8a4c-b126ab9e39d6 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: 39ee2e7b-63b4-40df-872b-82f81caa61f9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:10.002284 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a154b52-c399-40b7-8a4c-b126ab9e39d6 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:10.003393 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a154b52-c399-40b7-8a4c-b126ab9e39d6 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:10.017392 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a154b52-c399-40b7-8a4c-b126ab9e39d6 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:10.021624 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a154b52-c399-40b7-8a4c-b126ab9e39d6 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:10.024764 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a154b52-c399-40b7-8a4c-b126ab9e39d6 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:10.027852 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a154b52-c399-40b7-8a4c-b126ab9e39d6 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:10.483542 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3a154b52-c399-40b7-8a4c-b126ab9e39d6 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f38fd7a24614761ae0c368766006383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff6d35a7d7a4bac8b6e02b6bf5cb41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:10.515990 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3a154b52-c399-40b7-8a4c-b126ab9e39d6 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "GET /compute/v2.1/servers/39ee2e7b-63b4-40df-872b-82f81caa61f9" status: 200 len: 1275 microversion: 2.1 time: 0.533834 Sep 10 12:01:10.520812 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2281/4548] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:09 2022] GET /compute/v2.1/servers/39ee2e7b-63b4-40df-872b-82f81caa61f9 => generated 1275 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:11.553154 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4142786b-1a41-4d82-827a-888557c6dca2 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:11.553791 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4142786b-1a41-4d82-827a-888557c6dca2 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: 39ee2e7b-63b4-40df-872b-82f81caa61f9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:11.603355 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4142786b-1a41-4d82-827a-888557c6dca2 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:11.604125 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4142786b-1a41-4d82-827a-888557c6dca2 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:11.604568 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4142786b-1a41-4d82-827a-888557c6dca2 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:11.605283 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4142786b-1a41-4d82-827a-888557c6dca2 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:11.605741 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4142786b-1a41-4d82-827a-888557c6dca2 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:11.606228 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4142786b-1a41-4d82-827a-888557c6dca2 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:11.873827 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-54c28aac-58af-4aed-9cef-02d90693ad1d tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-666100838", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "94ee32ab-93cb-47eb-8926-3915fc48828d"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:01:11.947283 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:01:12.006506 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4142786b-1a41-4d82-827a-888557c6dca2 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f38fd7a24614761ae0c368766006383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff6d35a7d7a4bac8b6e02b6bf5cb41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:12.023249 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4142786b-1a41-4d82-827a-888557c6dca2 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "GET /compute/v2.1/servers/39ee2e7b-63b4-40df-872b-82f81caa61f9" status: 200 len: 1275 microversion: 2.1 time: 0.474241 Sep 10 12:01:12.028690 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2268/4549] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:11 2022] GET /compute/v2.1/servers/39ee2e7b-63b4-40df-872b-82f81caa61f9 => generated 1275 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:12.040818 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-54c28aac-58af-4aed-9cef-02d90693ad1d tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] validate_networks() for [('94ee32ab-93cb-47eb-8926-3915fc48828d', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:01:13.048130 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2915c975-f93b-4e6d-9722-1a66fd0337ad tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:13.049519 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2915c975-f93b-4e6d-9722-1a66fd0337ad tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: 39ee2e7b-63b4-40df-872b-82f81caa61f9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:13.061711 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2915c975-f93b-4e6d-9722-1a66fd0337ad tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:13.068143 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2915c975-f93b-4e6d-9722-1a66fd0337ad tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:13.069354 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2915c975-f93b-4e6d-9722-1a66fd0337ad tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:13.070209 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2915c975-f93b-4e6d-9722-1a66fd0337ad tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:13.071809 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2915c975-f93b-4e6d-9722-1a66fd0337ad tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:13.073174 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2915c975-f93b-4e6d-9722-1a66fd0337ad tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:13.429372 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2915c975-f93b-4e6d-9722-1a66fd0337ad tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f38fd7a24614761ae0c368766006383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff6d35a7d7a4bac8b6e02b6bf5cb41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:13.452741 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2915c975-f93b-4e6d-9722-1a66fd0337ad tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "GET /compute/v2.1/servers/39ee2e7b-63b4-40df-872b-82f81caa61f9" status: 200 len: 1275 microversion: 2.1 time: 0.403323 Sep 10 12:01:13.453464 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2269/4550] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:13 2022] GET /compute/v2.1/servers/39ee2e7b-63b4-40df-872b-82f81caa61f9 => generated 1275 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:01:13.492447 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:01:14.347756 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-54c28aac-58af-4aed-9cef-02d90693ad1d tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:01:14.350565 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-54c28aac-58af-4aed-9cef-02d90693ad1d tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:01:14.352606 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-54c28aac-58af-4aed-9cef-02d90693ad1d tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:01:14.353479 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-54c28aac-58af-4aed-9cef-02d90693ad1d tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:01:14.355721 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-54c28aac-58af-4aed-9cef-02d90693ad1d tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:01:14.381956 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54c28aac-58af-4aed-9cef-02d90693ad1d tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:14.383554 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54c28aac-58af-4aed-9cef-02d90693ad1d tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:14.384311 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54c28aac-58af-4aed-9cef-02d90693ad1d tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:14.385217 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54c28aac-58af-4aed-9cef-02d90693ad1d tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:14.385848 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54c28aac-58af-4aed-9cef-02d90693ad1d tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:14.386450 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54c28aac-58af-4aed-9cef-02d90693ad1d tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:14.429526 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-54c28aac-58af-4aed-9cef-02d90693ad1d tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Getting quotas for project ccab258aa40a4a8c8ec619480b35ad37. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:01:14.436890 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-54c28aac-58af-4aed-9cef-02d90693ad1d tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Getting quotas for user ccb776df076341a8a5199fb7b3d08c30 and project ccab258aa40a4a8c8ec619480b35ad37. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:01:14.453220 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-54c28aac-58af-4aed-9cef-02d90693ad1d tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Going to run 3 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:01:14.456074 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-54c28aac-58af-4aed-9cef-02d90693ad1d tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] [instance: 559c6087-5a37-455c-820e-3815be504495] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:01:14.496533 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-77361a9e-d61e-4f61-9a31-ff7f664ac163 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:14.498054 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-77361a9e-d61e-4f61-9a31-ff7f664ac163 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: 39ee2e7b-63b4-40df-872b-82f81caa61f9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:14.507894 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:01:14.517580 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-77361a9e-d61e-4f61-9a31-ff7f664ac163 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:14.519950 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-77361a9e-d61e-4f61-9a31-ff7f664ac163 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:14.524436 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-77361a9e-d61e-4f61-9a31-ff7f664ac163 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:14.527050 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-77361a9e-d61e-4f61-9a31-ff7f664ac163 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:14.527798 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-54c28aac-58af-4aed-9cef-02d90693ad1d tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] [instance: fbe1a0db-64e5-43c0-b32e-38cf084525d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=559c6087-5a37-455c-820e-3815be504495,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:01:14.529881 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-77361a9e-d61e-4f61-9a31-ff7f664ac163 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:14.530808 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-77361a9e-d61e-4f61-9a31-ff7f664ac163 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:14.616545 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-54c28aac-58af-4aed-9cef-02d90693ad1d tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] [instance: 39ab672e-8334-4fc2-b645-bfb1f7631064] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=fbe1a0db-64e5-43c0-b32e-38cf084525d9,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:01:14.855593 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-54c28aac-58af-4aed-9cef-02d90693ad1d tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.287811 Sep 10 12:01:14.866682 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2282/4551] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:01:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 3304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:01:14.881100 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-108f999f-73db-42ca-be34-a9dd7a6d5556 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:14.896381 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-108f999f-73db-42ca-be34-a9dd7a6d5556 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ccb776df076341a8a5199fb7b3d08c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:14.897686 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-108f999f-73db-42ca-be34-a9dd7a6d5556 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Searching by: {'deleted': False, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37'} {{(pid=128777) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 12:01:14.954892 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-108f999f-73db-42ca-be34-a9dd7a6d5556 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:14.955427 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-108f999f-73db-42ca-be34-a9dd7a6d5556 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:14.956408 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-108f999f-73db-42ca-be34-a9dd7a6d5556 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:14.957144 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-108f999f-73db-42ca-be34-a9dd7a6d5556 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:14.963563 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-108f999f-73db-42ca-be34-a9dd7a6d5556 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:14.964092 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-108f999f-73db-42ca-be34-a9dd7a6d5556 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:15.017807 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-108f999f-73db-42ca-be34-a9dd7a6d5556 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.149557 Sep 10 12:01:15.036183 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2283/4552] 10.222.0.23 () {58 vars in 1125 bytes} [Sat Sep 10 12:01:14 2022] GET /compute/v2.1/servers => generated 1015 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:15.063908 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-00bb21a9-d26c-45a2-b4a1-22199be75aad tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:15.064710 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-00bb21a9-d26c-45a2-b4a1-22199be75aad tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] [instance: 39ab672e-8334-4fc2-b645-bfb1f7631064] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:15.809752 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-00bb21a9-d26c-45a2-b4a1-22199be75aad tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb776df076341a8a5199fb7b3d08c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:15.819285 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-00bb21a9-d26c-45a2-b4a1-22199be75aad tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "GET /compute/v2.1/servers/39ab672e-8334-4fc2-b645-bfb1f7631064" status: 200 len: 1222 microversion: 2.1 time: 0.781781 Sep 10 12:01:15.820109 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2284/4553] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:15 2022] GET /compute/v2.1/servers/39ab672e-8334-4fc2-b645-bfb1f7631064 => generated 1222 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:16.445956 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-8b71a260-b127-40de-8b0b-02a9bf60e2a5 req-17b490f4-59c4-43ef-a32e-4458e5bdca3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cea2ee6c-f0c2-4178-857d-e97ceda7e87d", "tag": "b1d8ee0b-e66b-485c-b804-4b8c387b2e7f"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:01:16.483507 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8b71a260-b127-40de-8b0b-02a9bf60e2a5 req-17b490f4-59c4-43ef-a32e-4458e5bdca3b service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:16.484188 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8b71a260-b127-40de-8b0b-02a9bf60e2a5 req-17b490f4-59c4-43ef-a32e-4458e5bdca3b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:16.484715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8b71a260-b127-40de-8b0b-02a9bf60e2a5 req-17b490f4-59c4-43ef-a32e-4458e5bdca3b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:16.513391 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-8b71a260-b127-40de-8b0b-02a9bf60e2a5 req-17b490f4-59c4-43ef-a32e-4458e5bdca3b service nova] Creating event network-changed:b1d8ee0b-e66b-485c-b804-4b8c387b2e7f for instance cea2ee6c-f0c2-4178-857d-e97ceda7e87d on n-h2-856895-1 Sep 10 12:01:16.528611 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-8b71a260-b127-40de-8b0b-02a9bf60e2a5 req-17b490f4-59c4-43ef-a32e-4458e5bdca3b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089116 Sep 10 12:01:16.529950 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2285/4554] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:01:16.678774 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-77361a9e-d61e-4f61-9a31-ff7f664ac163 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f38fd7a24614761ae0c368766006383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff6d35a7d7a4bac8b6e02b6bf5cb41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:16.697267 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-77361a9e-d61e-4f61-9a31-ff7f664ac163 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "GET /compute/v2.1/servers/39ee2e7b-63b4-40df-872b-82f81caa61f9" status: 200 len: 1317 microversion: 2.1 time: 2.205012 Sep 10 12:01:16.702478 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2270/4555] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:14 2022] GET /compute/v2.1/servers/39ee2e7b-63b4-40df-872b-82f81caa61f9 => generated 1317 bytes in 2213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:01:16.847001 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-df5f825c-a561-4846-a8df-7f1ad875383c tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:16.848534 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-df5f825c-a561-4846-a8df-7f1ad875383c tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] [instance: 39ab672e-8334-4fc2-b645-bfb1f7631064] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:17.729824 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a9396ce4-5513-4410-8bd6-5c4eb573f578 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:17.732131 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a9396ce4-5513-4410-8bd6-5c4eb573f578 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: 39ee2e7b-63b4-40df-872b-82f81caa61f9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:17.747589 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9396ce4-5513-4410-8bd6-5c4eb573f578 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:17.753306 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9396ce4-5513-4410-8bd6-5c4eb573f578 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:17.759729 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9396ce4-5513-4410-8bd6-5c4eb573f578 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:17.760819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9396ce4-5513-4410-8bd6-5c4eb573f578 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:17.761524 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9396ce4-5513-4410-8bd6-5c4eb573f578 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:17.762206 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9396ce4-5513-4410-8bd6-5c4eb573f578 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:17.889760 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-df5f825c-a561-4846-a8df-7f1ad875383c tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb776df076341a8a5199fb7b3d08c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:17.906650 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-df5f825c-a561-4846-a8df-7f1ad875383c tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "GET /compute/v2.1/servers/39ab672e-8334-4fc2-b645-bfb1f7631064" status: 200 len: 1222 microversion: 2.1 time: 1.058945 Sep 10 12:01:17.910514 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2286/4556] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:16 2022] GET /compute/v2.1/servers/39ab672e-8334-4fc2-b645-bfb1f7631064 => generated 1222 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:18.947450 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-efe6102e-fdc5-40ea-8dbb-a6ef6a4fd55e tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:18.948197 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-efe6102e-fdc5-40ea-8dbb-a6ef6a4fd55e tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] [instance: 39ab672e-8334-4fc2-b645-bfb1f7631064] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:18.980074 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-efe6102e-fdc5-40ea-8dbb-a6ef6a4fd55e tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:19.001396 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-efe6102e-fdc5-40ea-8dbb-a6ef6a4fd55e tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:19.007360 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-efe6102e-fdc5-40ea-8dbb-a6ef6a4fd55e tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:19.012580 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-efe6102e-fdc5-40ea-8dbb-a6ef6a4fd55e tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:19.020672 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-efe6102e-fdc5-40ea-8dbb-a6ef6a4fd55e tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:19.022567 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-efe6102e-fdc5-40ea-8dbb-a6ef6a4fd55e tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:19.552058 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-efe6102e-fdc5-40ea-8dbb-a6ef6a4fd55e tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb776df076341a8a5199fb7b3d08c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:19.566206 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-efe6102e-fdc5-40ea-8dbb-a6ef6a4fd55e tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "GET /compute/v2.1/servers/39ab672e-8334-4fc2-b645-bfb1f7631064" status: 200 len: 1280 microversion: 2.1 time: 0.630260 Sep 10 12:01:19.573020 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2287/4557] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:18 2022] GET /compute/v2.1/servers/39ab672e-8334-4fc2-b645-bfb1f7631064 => generated 1280 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:01:19.634265 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a9396ce4-5513-4410-8bd6-5c4eb573f578 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f38fd7a24614761ae0c368766006383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff6d35a7d7a4bac8b6e02b6bf5cb41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:19.643654 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a9396ce4-5513-4410-8bd6-5c4eb573f578 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "GET /compute/v2.1/servers/39ee2e7b-63b4-40df-872b-82f81caa61f9" status: 200 len: 1317 microversion: 2.1 time: 1.918486 Sep 10 12:01:19.661345 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2271/4558] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:17 2022] GET /compute/v2.1/servers/39ee2e7b-63b4-40df-872b-82f81caa61f9 => generated 1317 bytes in 1937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:01:20.592115 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-77ec3393-0533-4c64-a079-a2c29df6407a tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:20.595644 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-475e54b8-3a90-4213-8bc6-62170901b68f req-c2bc21c5-c642-4b6e-89ff-7f746f8cfae0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39ee2e7b-63b4-40df-872b-82f81caa61f9", "tag": "3a94dae5-9cbb-4609-8e73-b50faa359b76"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:01:20.598244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-77ec3393-0533-4c64-a079-a2c29df6407a tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] [instance: 39ab672e-8334-4fc2-b645-bfb1f7631064] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:20.626497 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-77ec3393-0533-4c64-a079-a2c29df6407a tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:20.629578 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-77ec3393-0533-4c64-a079-a2c29df6407a tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:20.632039 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-77ec3393-0533-4c64-a079-a2c29df6407a tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:20.633028 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-77ec3393-0533-4c64-a079-a2c29df6407a tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:20.634347 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-77ec3393-0533-4c64-a079-a2c29df6407a tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:20.636880 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-77ec3393-0533-4c64-a079-a2c29df6407a tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:20.638015 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-475e54b8-3a90-4213-8bc6-62170901b68f req-c2bc21c5-c642-4b6e-89ff-7f746f8cfae0 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:20.638491 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-475e54b8-3a90-4213-8bc6-62170901b68f req-c2bc21c5-c642-4b6e-89ff-7f746f8cfae0 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:20.639185 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-475e54b8-3a90-4213-8bc6-62170901b68f req-c2bc21c5-c642-4b6e-89ff-7f746f8cfae0 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:20.663350 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-475e54b8-3a90-4213-8bc6-62170901b68f req-c2bc21c5-c642-4b6e-89ff-7f746f8cfae0 service nova] Creating event network-changed:3a94dae5-9cbb-4609-8e73-b50faa359b76 for instance 39ee2e7b-63b4-40df-872b-82f81caa61f9 on n-h2-856895-1 Sep 10 12:01:20.677102 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-475e54b8-3a90-4213-8bc6-62170901b68f req-c2bc21c5-c642-4b6e-89ff-7f746f8cfae0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090420 Sep 10 12:01:20.677745 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2288/4559] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:01:20.683288 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-27ef5903-70c3-447d-a6ed-46680ae89ff3 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:20.690128 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-27ef5903-70c3-447d-a6ed-46680ae89ff3 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: 39ee2e7b-63b4-40df-872b-82f81caa61f9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:20.701888 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-27ef5903-70c3-447d-a6ed-46680ae89ff3 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:20.702270 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-27ef5903-70c3-447d-a6ed-46680ae89ff3 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:20.708199 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-27ef5903-70c3-447d-a6ed-46680ae89ff3 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:20.709169 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-27ef5903-70c3-447d-a6ed-46680ae89ff3 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:20.709669 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-27ef5903-70c3-447d-a6ed-46680ae89ff3 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:20.710098 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-27ef5903-70c3-447d-a6ed-46680ae89ff3 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:21.454203 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-77ec3393-0533-4c64-a079-a2c29df6407a tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb776df076341a8a5199fb7b3d08c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:21.470421 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-77ec3393-0533-4c64-a079-a2c29df6407a tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "GET /compute/v2.1/servers/39ab672e-8334-4fc2-b645-bfb1f7631064" status: 200 len: 1280 microversion: 2.1 time: 0.882019 Sep 10 12:01:21.472456 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2272/4560] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:20 2022] GET /compute/v2.1/servers/39ab672e-8334-4fc2-b645-bfb1f7631064 => generated 1280 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:22.055480 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-27ef5903-70c3-447d-a6ed-46680ae89ff3 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f38fd7a24614761ae0c368766006383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff6d35a7d7a4bac8b6e02b6bf5cb41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:22.075580 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:01:22.077984 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-27ef5903-70c3-447d-a6ed-46680ae89ff3 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "GET /compute/v2.1/servers/39ee2e7b-63b4-40df-872b-82f81caa61f9" status: 200 len: 1317 microversion: 2.1 time: 1.398849 Sep 10 12:01:22.078608 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2289/4561] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:20 2022] GET /compute/v2.1/servers/39ee2e7b-63b4-40df-872b-82f81caa61f9 => generated 1317 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:22.503451 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b71ec447-0ab5-41fc-b9fc-1313a2294181 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:22.504808 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b71ec447-0ab5-41fc-b9fc-1313a2294181 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] [instance: 39ab672e-8334-4fc2-b645-bfb1f7631064] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:22.535501 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b71ec447-0ab5-41fc-b9fc-1313a2294181 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:22.539125 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b71ec447-0ab5-41fc-b9fc-1313a2294181 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:22.542518 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b71ec447-0ab5-41fc-b9fc-1313a2294181 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:22.543592 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b71ec447-0ab5-41fc-b9fc-1313a2294181 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:22.547028 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b71ec447-0ab5-41fc-b9fc-1313a2294181 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:22.550624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b71ec447-0ab5-41fc-b9fc-1313a2294181 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:22.818651 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b71ec447-0ab5-41fc-b9fc-1313a2294181 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb776df076341a8a5199fb7b3d08c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:22.829393 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b71ec447-0ab5-41fc-b9fc-1313a2294181 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "GET /compute/v2.1/servers/39ab672e-8334-4fc2-b645-bfb1f7631064" status: 200 len: 1280 microversion: 2.1 time: 0.336446 Sep 10 12:01:22.831718 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2273/4562] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:22 2022] GET /compute/v2.1/servers/39ab672e-8334-4fc2-b645-bfb1f7631064 => generated 1280 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:23.109515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-60397960-eff1-431e-b1eb-25216c588ccd tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:23.110187 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-60397960-eff1-431e-b1eb-25216c588ccd tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: 39ee2e7b-63b4-40df-872b-82f81caa61f9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:23.142245 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-60397960-eff1-431e-b1eb-25216c588ccd tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:23.147805 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-60397960-eff1-431e-b1eb-25216c588ccd tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:23.148513 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-60397960-eff1-431e-b1eb-25216c588ccd tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:23.149460 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-60397960-eff1-431e-b1eb-25216c588ccd tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:23.149939 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-60397960-eff1-431e-b1eb-25216c588ccd tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:23.150372 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-60397960-eff1-431e-b1eb-25216c588ccd tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:23.858397 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-04efdc57-6c5f-416f-a005-977d3a6175fe tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:23.859055 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-04efdc57-6c5f-416f-a005-977d3a6175fe tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] [instance: 39ab672e-8334-4fc2-b645-bfb1f7631064] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:23.891513 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-04efdc57-6c5f-416f-a005-977d3a6175fe tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:23.892002 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-04efdc57-6c5f-416f-a005-977d3a6175fe tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:23.892441 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-04efdc57-6c5f-416f-a005-977d3a6175fe tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:23.893251 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-04efdc57-6c5f-416f-a005-977d3a6175fe tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:23.901019 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-04efdc57-6c5f-416f-a005-977d3a6175fe tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:23.901542 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-04efdc57-6c5f-416f-a005-977d3a6175fe tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:24.184558 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-60397960-eff1-431e-b1eb-25216c588ccd tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f38fd7a24614761ae0c368766006383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff6d35a7d7a4bac8b6e02b6bf5cb41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:24.201577 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-60397960-eff1-431e-b1eb-25216c588ccd tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "GET /compute/v2.1/servers/39ee2e7b-63b4-40df-872b-82f81caa61f9" status: 200 len: 1317 microversion: 2.1 time: 1.099608 Sep 10 12:01:24.205023 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2290/4563] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:23 2022] GET /compute/v2.1/servers/39ee2e7b-63b4-40df-872b-82f81caa61f9 => generated 1317 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:24.719463 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-04efdc57-6c5f-416f-a005-977d3a6175fe tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb776df076341a8a5199fb7b3d08c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:24.730957 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-c92b6ed8-c47b-44d2-b4e0-266096627f0e req-8a9a1653-196d-4562-ab20-9f42d02b6cff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cea2ee6c-f0c2-4178-857d-e97ceda7e87d", "name": "network-vif-plugged", "status": "completed", "tag": "b1d8ee0b-e66b-485c-b804-4b8c387b2e7f"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:01:24.737653 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-04efdc57-6c5f-416f-a005-977d3a6175fe tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "GET /compute/v2.1/servers/39ab672e-8334-4fc2-b645-bfb1f7631064" status: 200 len: 1280 microversion: 2.1 time: 0.883978 Sep 10 12:01:24.742633 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2274/4564] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:23 2022] GET /compute/v2.1/servers/39ab672e-8334-4fc2-b645-bfb1f7631064 => generated 1280 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:24.785806 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-c92b6ed8-c47b-44d2-b4e0-266096627f0e req-8a9a1653-196d-4562-ab20-9f42d02b6cff service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:24.791138 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-c92b6ed8-c47b-44d2-b4e0-266096627f0e req-8a9a1653-196d-4562-ab20-9f42d02b6cff service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:24.792882 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-c92b6ed8-c47b-44d2-b4e0-266096627f0e req-8a9a1653-196d-4562-ab20-9f42d02b6cff service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:24.841405 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-c92b6ed8-c47b-44d2-b4e0-266096627f0e req-8a9a1653-196d-4562-ab20-9f42d02b6cff service nova] Creating event network-vif-plugged:b1d8ee0b-e66b-485c-b804-4b8c387b2e7f for instance cea2ee6c-f0c2-4178-857d-e97ceda7e87d on n-h2-856895-1 Sep 10 12:01:24.859707 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-c92b6ed8-c47b-44d2-b4e0-266096627f0e req-8a9a1653-196d-4562-ab20-9f42d02b6cff service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139828 Sep 10 12:01:24.861327 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2291/4565] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:01:25.229194 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a79a6bd5-8ac7-4b79-bafb-67666a9eb1c9 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:25.231298 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a79a6bd5-8ac7-4b79-bafb-67666a9eb1c9 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: 39ee2e7b-63b4-40df-872b-82f81caa61f9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:25.235669 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:01:25.254642 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a79a6bd5-8ac7-4b79-bafb-67666a9eb1c9 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:25.255188 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a79a6bd5-8ac7-4b79-bafb-67666a9eb1c9 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:25.258218 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a79a6bd5-8ac7-4b79-bafb-67666a9eb1c9 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:25.258984 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a79a6bd5-8ac7-4b79-bafb-67666a9eb1c9 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:25.259491 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a79a6bd5-8ac7-4b79-bafb-67666a9eb1c9 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:25.260135 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a79a6bd5-8ac7-4b79-bafb-67666a9eb1c9 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:25.772285 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-14cf4c9a-5ebb-4865-9fc1-1afe871e4d4d tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:25.775551 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-14cf4c9a-5ebb-4865-9fc1-1afe871e4d4d tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] [instance: 39ab672e-8334-4fc2-b645-bfb1f7631064] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:25.777939 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=4 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:01:25.799039 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-14cf4c9a-5ebb-4865-9fc1-1afe871e4d4d tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:25.844381 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-14cf4c9a-5ebb-4865-9fc1-1afe871e4d4d tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.040s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:25.844972 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-14cf4c9a-5ebb-4865-9fc1-1afe871e4d4d tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:25.849157 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-14cf4c9a-5ebb-4865-9fc1-1afe871e4d4d tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:25.849779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-14cf4c9a-5ebb-4865-9fc1-1afe871e4d4d tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:25.850244 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-14cf4c9a-5ebb-4865-9fc1-1afe871e4d4d tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:27.895136 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=20 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:01:28.993614 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a79a6bd5-8ac7-4b79-bafb-67666a9eb1c9 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f38fd7a24614761ae0c368766006383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff6d35a7d7a4bac8b6e02b6bf5cb41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:29.011127 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a79a6bd5-8ac7-4b79-bafb-67666a9eb1c9 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "GET /compute/v2.1/servers/39ee2e7b-63b4-40df-872b-82f81caa61f9" status: 200 len: 1317 microversion: 2.1 time: 3.788658 Sep 10 12:01:29.014299 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2275/4566] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:25 2022] GET /compute/v2.1/servers/39ee2e7b-63b4-40df-872b-82f81caa61f9 => generated 1317 bytes in 3792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:29.034390 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-6b3f295e-0bee-4cd8-849a-d9bf1ce73d41 req-f6b7852c-a699-41b7-b5cb-c5592306fdc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbe1a0db-64e5-43c0-b32e-38cf084525d9", "tag": "93edc3cf-a9a1-40eb-a206-3fc7e191ebad"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:01:29.063634 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6b3f295e-0bee-4cd8-849a-d9bf1ce73d41 req-f6b7852c-a699-41b7-b5cb-c5592306fdc9 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:29.064463 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6b3f295e-0bee-4cd8-849a-d9bf1ce73d41 req-f6b7852c-a699-41b7-b5cb-c5592306fdc9 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:29.067468 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6b3f295e-0bee-4cd8-849a-d9bf1ce73d41 req-f6b7852c-a699-41b7-b5cb-c5592306fdc9 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:29.091301 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-6b3f295e-0bee-4cd8-849a-d9bf1ce73d41 req-f6b7852c-a699-41b7-b5cb-c5592306fdc9 service nova] Creating event network-changed:93edc3cf-a9a1-40eb-a206-3fc7e191ebad for instance fbe1a0db-64e5-43c0-b32e-38cf084525d9 on n-h1-856895-1 Sep 10 12:01:29.104551 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-6b3f295e-0bee-4cd8-849a-d9bf1ce73d41 req-f6b7852c-a699-41b7-b5cb-c5592306fdc9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087565 Sep 10 12:01:29.113071 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2276/4567] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:01:29.121473 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-a36b132f-07a9-4f11-a456-bcdbb8b42c08 req-81fe1876-4185-4f05-b49f-258488a83de2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39ee2e7b-63b4-40df-872b-82f81caa61f9", "name": "network-vif-plugged", "status": "completed", "tag": "3a94dae5-9cbb-4609-8e73-b50faa359b76"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:01:29.151430 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a36b132f-07a9-4f11-a456-bcdbb8b42c08 req-81fe1876-4185-4f05-b49f-258488a83de2 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:29.152928 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a36b132f-07a9-4f11-a456-bcdbb8b42c08 req-81fe1876-4185-4f05-b49f-258488a83de2 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:29.155018 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a36b132f-07a9-4f11-a456-bcdbb8b42c08 req-81fe1876-4185-4f05-b49f-258488a83de2 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:29.187511 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-a36b132f-07a9-4f11-a456-bcdbb8b42c08 req-81fe1876-4185-4f05-b49f-258488a83de2 service nova] Creating event network-vif-plugged:3a94dae5-9cbb-4609-8e73-b50faa359b76 for instance 39ee2e7b-63b4-40df-872b-82f81caa61f9 on n-h2-856895-1 Sep 10 12:01:29.206172 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-a36b132f-07a9-4f11-a456-bcdbb8b42c08 req-81fe1876-4185-4f05-b49f-258488a83de2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088948 Sep 10 12:01:29.213858 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-14cf4c9a-5ebb-4865-9fc1-1afe871e4d4d tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb776df076341a8a5199fb7b3d08c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:29.239652 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2277/4568] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:01:29.244153 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-14cf4c9a-5ebb-4865-9fc1-1afe871e4d4d tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "GET /compute/v2.1/servers/39ab672e-8334-4fc2-b645-bfb1f7631064" status: 200 len: 1322 microversion: 2.1 time: 3.483020 Sep 10 12:01:29.245189 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2292/4569] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:25 2022] GET /compute/v2.1/servers/39ab672e-8334-4fc2-b645-bfb1f7631064 => generated 1322 bytes in 3485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:01:30.041636 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-82134bb8-d0dd-43e1-9f1b-3e14f2467ea5 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:30.043696 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-82134bb8-d0dd-43e1-9f1b-3e14f2467ea5 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: 39ee2e7b-63b4-40df-872b-82f81caa61f9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:30.062608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-82134bb8-d0dd-43e1-9f1b-3e14f2467ea5 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:30.065141 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-82134bb8-d0dd-43e1-9f1b-3e14f2467ea5 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:30.071806 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-82134bb8-d0dd-43e1-9f1b-3e14f2467ea5 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:30.072845 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-82134bb8-d0dd-43e1-9f1b-3e14f2467ea5 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:30.073591 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-82134bb8-d0dd-43e1-9f1b-3e14f2467ea5 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:30.074187 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-82134bb8-d0dd-43e1-9f1b-3e14f2467ea5 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:30.274133 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-39bbb491-82c5-4f54-8f01-342f188e6051 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:30.287565 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-39bbb491-82c5-4f54-8f01-342f188e6051 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] [instance: 39ab672e-8334-4fc2-b645-bfb1f7631064] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:30.298013 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-39bbb491-82c5-4f54-8f01-342f188e6051 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:30.298784 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-39bbb491-82c5-4f54-8f01-342f188e6051 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:30.300004 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-39bbb491-82c5-4f54-8f01-342f188e6051 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:30.301059 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-39bbb491-82c5-4f54-8f01-342f188e6051 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:30.301683 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-39bbb491-82c5-4f54-8f01-342f188e6051 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:30.302279 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-39bbb491-82c5-4f54-8f01-342f188e6051 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:30.845571 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-39bbb491-82c5-4f54-8f01-342f188e6051 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb776df076341a8a5199fb7b3d08c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:30.858083 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-39bbb491-82c5-4f54-8f01-342f188e6051 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "GET /compute/v2.1/servers/39ab672e-8334-4fc2-b645-bfb1f7631064" status: 200 len: 1322 microversion: 2.1 time: 0.589406 Sep 10 12:01:30.876220 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2293/4570] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:30 2022] GET /compute/v2.1/servers/39ab672e-8334-4fc2-b645-bfb1f7631064 => generated 1322 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:30.889596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-82134bb8-d0dd-43e1-9f1b-3e14f2467ea5 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f38fd7a24614761ae0c368766006383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff6d35a7d7a4bac8b6e02b6bf5cb41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:30.921266 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-82134bb8-d0dd-43e1-9f1b-3e14f2467ea5 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "GET /compute/v2.1/servers/39ee2e7b-63b4-40df-872b-82f81caa61f9" status: 200 len: 1317 microversion: 2.1 time: 0.877944 Sep 10 12:01:30.924211 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2278/4571] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:30 2022] GET /compute/v2.1/servers/39ee2e7b-63b4-40df-872b-82f81caa61f9 => generated 1317 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:31.074692 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-7af3228b-8b3c-4dbd-9159-bc2793534afb req-6c884c15-110e-415f-8a5c-082fd96b6a9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "559c6087-5a37-455c-820e-3815be504495", "tag": "9645b2fa-f2c2-41f7-9cdc-69deff08885e"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:01:31.102877 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-7af3228b-8b3c-4dbd-9159-bc2793534afb req-6c884c15-110e-415f-8a5c-082fd96b6a9f service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:31.103593 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-7af3228b-8b3c-4dbd-9159-bc2793534afb req-6c884c15-110e-415f-8a5c-082fd96b6a9f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:31.104319 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-7af3228b-8b3c-4dbd-9159-bc2793534afb req-6c884c15-110e-415f-8a5c-082fd96b6a9f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:31.156852 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-7af3228b-8b3c-4dbd-9159-bc2793534afb req-6c884c15-110e-415f-8a5c-082fd96b6a9f service nova] Creating event network-changed:9645b2fa-f2c2-41f7-9cdc-69deff08885e for instance 559c6087-5a37-455c-820e-3815be504495 on n-h1-856895-1 Sep 10 12:01:31.181507 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-7af3228b-8b3c-4dbd-9159-bc2793534afb req-6c884c15-110e-415f-8a5c-082fd96b6a9f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106267 Sep 10 12:01:31.181746 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2294/4572] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:01:31.235489 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-012fc233-84a7-4b54-a25e-0f4db0c695d4 req-5610e76f-fb64-4071-9405-c58daa4aae59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39ab672e-8334-4fc2-b645-bfb1f7631064", "tag": "1bee300c-d638-40cf-92a1-82dfddf6ebd1"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:01:31.251270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-012fc233-84a7-4b54-a25e-0f4db0c695d4 req-5610e76f-fb64-4071-9405-c58daa4aae59 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:31.253029 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-012fc233-84a7-4b54-a25e-0f4db0c695d4 req-5610e76f-fb64-4071-9405-c58daa4aae59 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:31.253830 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-012fc233-84a7-4b54-a25e-0f4db0c695d4 req-5610e76f-fb64-4071-9405-c58daa4aae59 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:31.284778 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-012fc233-84a7-4b54-a25e-0f4db0c695d4 req-5610e76f-fb64-4071-9405-c58daa4aae59 service nova] Creating event network-changed:1bee300c-d638-40cf-92a1-82dfddf6ebd1 for instance 39ab672e-8334-4fc2-b645-bfb1f7631064 on n-h2-856895-1 Sep 10 12:01:31.292154 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-012fc233-84a7-4b54-a25e-0f4db0c695d4 req-5610e76f-fb64-4071-9405-c58daa4aae59 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062167 Sep 10 12:01:31.293249 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2279/4573] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:01:31.885603 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-91cb55f1-1fa1-421a-bb26-2155d7a0f314 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:31.886436 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-91cb55f1-1fa1-421a-bb26-2155d7a0f314 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] [instance: 39ab672e-8334-4fc2-b645-bfb1f7631064] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:31.900996 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-91cb55f1-1fa1-421a-bb26-2155d7a0f314 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:31.906899 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-91cb55f1-1fa1-421a-bb26-2155d7a0f314 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:31.909861 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-91cb55f1-1fa1-421a-bb26-2155d7a0f314 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:31.910704 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-91cb55f1-1fa1-421a-bb26-2155d7a0f314 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:31.914640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-91cb55f1-1fa1-421a-bb26-2155d7a0f314 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:31.917456 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-91cb55f1-1fa1-421a-bb26-2155d7a0f314 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:31.947610 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f3560f71-6c71-48f6-89d6-0ebe08ce397d tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:31.948375 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f3560f71-6c71-48f6-89d6-0ebe08ce397d tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: 39ee2e7b-63b4-40df-872b-82f81caa61f9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:31.959834 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3560f71-6c71-48f6-89d6-0ebe08ce397d tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:31.963722 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3560f71-6c71-48f6-89d6-0ebe08ce397d tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:31.964390 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3560f71-6c71-48f6-89d6-0ebe08ce397d tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:31.965940 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3560f71-6c71-48f6-89d6-0ebe08ce397d tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:31.966565 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3560f71-6c71-48f6-89d6-0ebe08ce397d tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:31.969057 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3560f71-6c71-48f6-89d6-0ebe08ce397d tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:33.111935 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-91cb55f1-1fa1-421a-bb26-2155d7a0f314 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb776df076341a8a5199fb7b3d08c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:33.122177 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-91cb55f1-1fa1-421a-bb26-2155d7a0f314 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "GET /compute/v2.1/servers/39ab672e-8334-4fc2-b645-bfb1f7631064" status: 200 len: 1322 microversion: 2.1 time: 1.242185 Sep 10 12:01:33.135577 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2295/4574] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:31 2022] GET /compute/v2.1/servers/39ab672e-8334-4fc2-b645-bfb1f7631064 => generated 1322 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:33.139352 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f3560f71-6c71-48f6-89d6-0ebe08ce397d tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f38fd7a24614761ae0c368766006383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff6d35a7d7a4bac8b6e02b6bf5cb41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:33.146669 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fc87f2c6-82dd-4d2c-9c7c-9554d2a0c8c9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:33.147453 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fc87f2c6-82dd-4d2c-9c7c-9554d2a0c8c9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:33.148462 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f3560f71-6c71-48f6-89d6-0ebe08ce397d tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "GET /compute/v2.1/servers/39ee2e7b-63b4-40df-872b-82f81caa61f9" status: 200 len: 1504 microversion: 2.1 time: 1.205386 Sep 10 12:01:33.154986 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc87f2c6-82dd-4d2c-9c7c-9554d2a0c8c9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:33.155963 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc87f2c6-82dd-4d2c-9c7c-9554d2a0c8c9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:33.156671 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc87f2c6-82dd-4d2c-9c7c-9554d2a0c8c9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:33.157859 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc87f2c6-82dd-4d2c-9c7c-9554d2a0c8c9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:33.158974 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc87f2c6-82dd-4d2c-9c7c-9554d2a0c8c9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:33.160165 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc87f2c6-82dd-4d2c-9c7c-9554d2a0c8c9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:33.163551 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2280/4575] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:31 2022] GET /compute/v2.1/servers/39ee2e7b-63b4-40df-872b-82f81caa61f9 => generated 1504 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:01:33.171806 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a9b47650-a5a6-4be3-a8b6-05074386d269 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:33.172689 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a9b47650-a5a6-4be3-a8b6-05074386d269 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: cea2ee6c-f0c2-4178-857d-e97ceda7e87d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:33.179418 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9b47650-a5a6-4be3-a8b6-05074386d269 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:33.180121 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9b47650-a5a6-4be3-a8b6-05074386d269 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:33.180731 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9b47650-a5a6-4be3-a8b6-05074386d269 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:33.182307 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9b47650-a5a6-4be3-a8b6-05074386d269 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:33.182937 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9b47650-a5a6-4be3-a8b6-05074386d269 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:33.183662 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9b47650-a5a6-4be3-a8b6-05074386d269 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:33.575894 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fc87f2c6-82dd-4d2c-9c7c-9554d2a0c8c9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:33.585527 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fc87f2c6-82dd-4d2c-9c7c-9554d2a0c8c9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1685 microversion: 2.1 time: 0.448715 Sep 10 12:01:33.591004 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a9b47650-a5a6-4be3-a8b6-05074386d269 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f38fd7a24614761ae0c368766006383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff6d35a7d7a4bac8b6e02b6bf5cb41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:33.607178 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a9b47650-a5a6-4be3-a8b6-05074386d269 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2ee6c-f0c2-4178-857d-e97ceda7e87d" status: 200 len: 1505 microversion: 2.1 time: 0.439063 Sep 10 12:01:33.608068 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2281/4576] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:33 2022] GET /compute/v2.1/servers/cea2ee6c-f0c2-4178-857d-e97ceda7e87d => generated 1505 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:33.609529 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2296/4577] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:33 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1685 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:33.636951 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cdecdd00-cc03-4c38-a633-2a99797a7a50 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:33.637658 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cdecdd00-cc03-4c38-a633-2a99797a7a50 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: cea2ee6c-f0c2-4178-857d-e97ceda7e87d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:33.659959 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cdecdd00-cc03-4c38-a633-2a99797a7a50 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:33.660837 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cdecdd00-cc03-4c38-a633-2a99797a7a50 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:33.661801 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cdecdd00-cc03-4c38-a633-2a99797a7a50 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:33.662727 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cdecdd00-cc03-4c38-a633-2a99797a7a50 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:33.665707 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cdecdd00-cc03-4c38-a633-2a99797a7a50 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:33.669485 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cdecdd00-cc03-4c38-a633-2a99797a7a50 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:33.776548 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cdecdd00-cc03-4c38-a633-2a99797a7a50 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: cea2ee6c-f0c2-4178-857d-e97ceda7e87d] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:01:33.779818 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:01:33.954594 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cdecdd00-cc03-4c38-a633-2a99797a7a50 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cea2ee6c-f0c2-4178-857d-e97ceda7e87d" status: 204 len: 0 microversion: 2.1 time: 0.321928 Sep 10 12:01:33.955882 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2282/4578] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:01:33 2022] DELETE /compute/v2.1/servers/cea2ee6c-f0c2-4178-857d-e97ceda7e87d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:01:33.966639 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-aa5e9840-334c-4130-ae35-dfc5590034a8 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:33.967812 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-aa5e9840-334c-4130-ae35-dfc5590034a8 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: 39ee2e7b-63b4-40df-872b-82f81caa61f9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:33.985391 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa5e9840-334c-4130-ae35-dfc5590034a8 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:33.985890 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa5e9840-334c-4130-ae35-dfc5590034a8 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:33.986399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa5e9840-334c-4130-ae35-dfc5590034a8 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:33.987326 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa5e9840-334c-4130-ae35-dfc5590034a8 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:33.987788 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa5e9840-334c-4130-ae35-dfc5590034a8 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:33.989027 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa5e9840-334c-4130-ae35-dfc5590034a8 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:34.057918 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-aa5e9840-334c-4130-ae35-dfc5590034a8 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: 39ee2e7b-63b4-40df-872b-82f81caa61f9] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:01:34.150549 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-05d68cbe-94ab-45e9-bdca-aa202671f181 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:34.152780 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-05d68cbe-94ab-45e9-bdca-aa202671f181 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] [instance: 39ab672e-8334-4fc2-b645-bfb1f7631064] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:34.168248 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05d68cbe-94ab-45e9-bdca-aa202671f181 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:34.168993 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05d68cbe-94ab-45e9-bdca-aa202671f181 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:34.169626 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05d68cbe-94ab-45e9-bdca-aa202671f181 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:34.173492 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05d68cbe-94ab-45e9-bdca-aa202671f181 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:34.174445 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05d68cbe-94ab-45e9-bdca-aa202671f181 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:34.175596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05d68cbe-94ab-45e9-bdca-aa202671f181 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:34.247073 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-aa5e9840-334c-4130-ae35-dfc5590034a8 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "DELETE /compute/v2.1/servers/39ee2e7b-63b4-40df-872b-82f81caa61f9" status: 204 len: 0 microversion: 2.1 time: 0.285535 Sep 10 12:01:34.249271 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2297/4579] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:01:33 2022] DELETE /compute/v2.1/servers/39ee2e7b-63b4-40df-872b-82f81caa61f9 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:01:34.267280 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2e8c0a94-14f8-4d69-a5cb-6194b008d89e tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:34.269764 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2e8c0a94-14f8-4d69-a5cb-6194b008d89e tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: cea2ee6c-f0c2-4178-857d-e97ceda7e87d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:34.284596 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2e8c0a94-14f8-4d69-a5cb-6194b008d89e tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:34.285496 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2e8c0a94-14f8-4d69-a5cb-6194b008d89e tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:34.286775 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2e8c0a94-14f8-4d69-a5cb-6194b008d89e tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:34.288342 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2e8c0a94-14f8-4d69-a5cb-6194b008d89e tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:34.289236 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2e8c0a94-14f8-4d69-a5cb-6194b008d89e tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:34.289918 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2e8c0a94-14f8-4d69-a5cb-6194b008d89e tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:34.666679 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-05d68cbe-94ab-45e9-bdca-aa202671f181 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb776df076341a8a5199fb7b3d08c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:34.680101 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-05d68cbe-94ab-45e9-bdca-aa202671f181 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "GET /compute/v2.1/servers/39ab672e-8334-4fc2-b645-bfb1f7631064" status: 200 len: 1322 microversion: 2.1 time: 0.533805 Sep 10 12:01:34.699597 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2283/4580] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:34 2022] GET /compute/v2.1/servers/39ab672e-8334-4fc2-b645-bfb1f7631064 => generated 1322 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:34.710297 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7f99c3c2-f0c9-40b3-81f4-686c8dad50b1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:34.713498 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7f99c3c2-f0c9-40b3-81f4-686c8dad50b1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:34.734671 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f99c3c2-f0c9-40b3-81f4-686c8dad50b1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:34.735499 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f99c3c2-f0c9-40b3-81f4-686c8dad50b1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:34.736119 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f99c3c2-f0c9-40b3-81f4-686c8dad50b1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:34.737848 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f99c3c2-f0c9-40b3-81f4-686c8dad50b1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:34.738485 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f99c3c2-f0c9-40b3-81f4-686c8dad50b1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:34.740343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f99c3c2-f0c9-40b3-81f4-686c8dad50b1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:34.750719 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2e8c0a94-14f8-4d69-a5cb-6194b008d89e tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f38fd7a24614761ae0c368766006383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff6d35a7d7a4bac8b6e02b6bf5cb41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:34.759482 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2e8c0a94-14f8-4d69-a5cb-6194b008d89e tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2ee6c-f0c2-4178-857d-e97ceda7e87d" status: 200 len: 1511 microversion: 2.1 time: 0.504236 Sep 10 12:01:34.762806 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2298/4581] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:34 2022] GET /compute/v2.1/servers/cea2ee6c-f0c2-4178-857d-e97ceda7e87d => generated 1511 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:35.199567 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7f99c3c2-f0c9-40b3-81f4-686c8dad50b1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:35.213586 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7f99c3c2-f0c9-40b3-81f4-686c8dad50b1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.512493 Sep 10 12:01:35.214401 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2284/4582] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:34 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:35.239941 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-246a2bc6-c7be-4619-8a44-1ca59eeb2636 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1692597407"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:01:35.242652 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-246a2bc6-c7be-4619-8a44-1ca59eeb2636 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:35.258397 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-246a2bc6-c7be-4619-8a44-1ca59eeb2636 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:35.258964 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-246a2bc6-c7be-4619-8a44-1ca59eeb2636 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:35.262567 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-246a2bc6-c7be-4619-8a44-1ca59eeb2636 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:35.263447 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-246a2bc6-c7be-4619-8a44-1ca59eeb2636 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:35.263929 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-246a2bc6-c7be-4619-8a44-1ca59eeb2636 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:35.264368 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-246a2bc6-c7be-4619-8a44-1ca59eeb2636 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:35.524840 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-246a2bc6-c7be-4619-8a44-1ca59eeb2636 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "POST /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f/action" status: 202 len: 0 microversion: 2.1 time: 0.289758 Sep 10 12:01:35.525634 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2299/4583] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:01:35 2022] POST /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 10 12:01:35.535193 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-75cb54f5-2f2b-44ef-bc3e-0d20fa178b64 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:35.536013 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-75cb54f5-2f2b-44ef-bc3e-0d20fa178b64 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:35.565855 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75cb54f5-2f2b-44ef-bc3e-0d20fa178b64 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:35.575748 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75cb54f5-2f2b-44ef-bc3e-0d20fa178b64 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:35.576325 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75cb54f5-2f2b-44ef-bc3e-0d20fa178b64 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:35.577158 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75cb54f5-2f2b-44ef-bc3e-0d20fa178b64 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:35.577910 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75cb54f5-2f2b-44ef-bc3e-0d20fa178b64 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:35.578575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75cb54f5-2f2b-44ef-bc3e-0d20fa178b64 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:35.709951 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ba8d938e-f821-40b6-b605-a6260ae0f5d6 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:35.710827 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ba8d938e-f821-40b6-b605-a6260ae0f5d6 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] [instance: 39ab672e-8334-4fc2-b645-bfb1f7631064] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:35.724557 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba8d938e-f821-40b6-b605-a6260ae0f5d6 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:35.725153 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba8d938e-f821-40b6-b605-a6260ae0f5d6 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:35.725714 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba8d938e-f821-40b6-b605-a6260ae0f5d6 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:35.727935 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba8d938e-f821-40b6-b605-a6260ae0f5d6 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:35.728342 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba8d938e-f821-40b6-b605-a6260ae0f5d6 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:35.731480 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba8d938e-f821-40b6-b605-a6260ae0f5d6 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:36.820331 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ba8d938e-f821-40b6-b605-a6260ae0f5d6 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb776df076341a8a5199fb7b3d08c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:36.832895 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ba8d938e-f821-40b6-b605-a6260ae0f5d6 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "GET /compute/v2.1/servers/39ab672e-8334-4fc2-b645-bfb1f7631064" status: 200 len: 1322 microversion: 2.1 time: 1.128256 Sep 10 12:01:36.865126 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2300/4584] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:35 2022] GET /compute/v2.1/servers/39ab672e-8334-4fc2-b645-bfb1f7631064 => generated 1322 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:01:36.865491 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-75cb54f5-2f2b-44ef-bc3e-0d20fa178b64 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:36.865491 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-75cb54f5-2f2b-44ef-bc3e-0d20fa178b64 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1682 microversion: 2.1 time: 1.327746 Sep 10 12:01:36.865491 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2285/4585] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:35 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1682 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:36.871984 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-730e28b2-2dc6-4f81-a152-032b22063b92 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:36.872609 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-730e28b2-2dc6-4f81-a152-032b22063b92 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: cea2ee6c-f0c2-4178-857d-e97ceda7e87d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:36.893112 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-cc1f6dbb-6e20-406c-800a-9a9a3c64474b req-62a19dc2-fec1-4fd8-b5b5-86b1cae6fe54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39ab672e-8334-4fc2-b645-bfb1f7631064", "name": "network-vif-plugged", "status": "completed", "tag": "1bee300c-d638-40cf-92a1-82dfddf6ebd1"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:01:36.902432 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-730e28b2-2dc6-4f81-a152-032b22063b92 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:36.903113 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-730e28b2-2dc6-4f81-a152-032b22063b92 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:36.903764 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-730e28b2-2dc6-4f81-a152-032b22063b92 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:36.904979 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-730e28b2-2dc6-4f81-a152-032b22063b92 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:36.905599 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-730e28b2-2dc6-4f81-a152-032b22063b92 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:36.906175 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-730e28b2-2dc6-4f81-a152-032b22063b92 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:36.927222 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-cc1f6dbb-6e20-406c-800a-9a9a3c64474b req-62a19dc2-fec1-4fd8-b5b5-86b1cae6fe54 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:36.928216 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-cc1f6dbb-6e20-406c-800a-9a9a3c64474b req-62a19dc2-fec1-4fd8-b5b5-86b1cae6fe54 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:36.930529 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-cc1f6dbb-6e20-406c-800a-9a9a3c64474b req-62a19dc2-fec1-4fd8-b5b5-86b1cae6fe54 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:36.974337 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-cc1f6dbb-6e20-406c-800a-9a9a3c64474b req-62a19dc2-fec1-4fd8-b5b5-86b1cae6fe54 service nova] Creating event network-vif-plugged:1bee300c-d638-40cf-92a1-82dfddf6ebd1 for instance 39ab672e-8334-4fc2-b645-bfb1f7631064 on n-h2-856895-1 Sep 10 12:01:36.993549 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-cc1f6dbb-6e20-406c-800a-9a9a3c64474b req-62a19dc2-fec1-4fd8-b5b5-86b1cae6fe54 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132295 Sep 10 12:01:37.004676 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2286/4586] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:01:37.605833 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-bed8e65d-9e95-420c-953a-38ea0568d02b req-1b41483a-a232-4dac-b9d6-d8d1b8713b84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cea2ee6c-f0c2-4178-857d-e97ceda7e87d", "name": "network-vif-deleted", "tag": "b1d8ee0b-e66b-485c-b804-4b8c387b2e7f"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:01:37.669879 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-bed8e65d-9e95-420c-953a-38ea0568d02b req-1b41483a-a232-4dac-b9d6-d8d1b8713b84 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:37.670389 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-bed8e65d-9e95-420c-953a-38ea0568d02b req-1b41483a-a232-4dac-b9d6-d8d1b8713b84 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:37.670830 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-bed8e65d-9e95-420c-953a-38ea0568d02b req-1b41483a-a232-4dac-b9d6-d8d1b8713b84 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:37.704702 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-bed8e65d-9e95-420c-953a-38ea0568d02b req-1b41483a-a232-4dac-b9d6-d8d1b8713b84 service nova] Creating event network-vif-deleted:b1d8ee0b-e66b-485c-b804-4b8c387b2e7f for instance cea2ee6c-f0c2-4178-857d-e97ceda7e87d on n-h2-856895-1 Sep 10 12:01:37.726422 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-bed8e65d-9e95-420c-953a-38ea0568d02b req-1b41483a-a232-4dac-b9d6-d8d1b8713b84 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119505 Sep 10 12:01:37.727896 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2287/4587] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:01:37.880615 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ac9901e6-60aa-4b6c-a6de-b74bf77b2f9c tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:37.882053 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ac9901e6-60aa-4b6c-a6de-b74bf77b2f9c tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] [instance: 39ab672e-8334-4fc2-b645-bfb1f7631064] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:37.891681 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac9901e6-60aa-4b6c-a6de-b74bf77b2f9c tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:37.897644 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac9901e6-60aa-4b6c-a6de-b74bf77b2f9c tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:37.904244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac9901e6-60aa-4b6c-a6de-b74bf77b2f9c tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:37.906597 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac9901e6-60aa-4b6c-a6de-b74bf77b2f9c tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:37.907307 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac9901e6-60aa-4b6c-a6de-b74bf77b2f9c tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:37.910767 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac9901e6-60aa-4b6c-a6de-b74bf77b2f9c tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:38.450617 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-730e28b2-2dc6-4f81-a152-032b22063b92 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f38fd7a24614761ae0c368766006383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff6d35a7d7a4bac8b6e02b6bf5cb41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:38.461466 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-730e28b2-2dc6-4f81-a152-032b22063b92 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2ee6c-f0c2-4178-857d-e97ceda7e87d" status: 200 len: 1511 microversion: 2.1 time: 1.622108 Sep 10 12:01:38.483337 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2301/4588] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:36 2022] GET /compute/v2.1/servers/cea2ee6c-f0c2-4178-857d-e97ceda7e87d => generated 1511 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:38.489652 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-06d0c2e4-b80b-4cd7-832e-50c84e4132d1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:38.504243 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-06d0c2e4-b80b-4cd7-832e-50c84e4132d1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:38.527903 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06d0c2e4-b80b-4cd7-832e-50c84e4132d1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:38.528454 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06d0c2e4-b80b-4cd7-832e-50c84e4132d1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:38.528847 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06d0c2e4-b80b-4cd7-832e-50c84e4132d1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:38.529561 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06d0c2e4-b80b-4cd7-832e-50c84e4132d1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:38.561813 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06d0c2e4-b80b-4cd7-832e-50c84e4132d1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:38.562265 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06d0c2e4-b80b-4cd7-832e-50c84e4132d1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:39.253483 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ac9901e6-60aa-4b6c-a6de-b74bf77b2f9c tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb776df076341a8a5199fb7b3d08c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:39.270298 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ac9901e6-60aa-4b6c-a6de-b74bf77b2f9c tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "GET /compute/v2.1/servers/39ab672e-8334-4fc2-b645-bfb1f7631064" status: 200 len: 1322 microversion: 2.1 time: 1.395622 Sep 10 12:01:39.273990 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2288/4589] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:37 2022] GET /compute/v2.1/servers/39ab672e-8334-4fc2-b645-bfb1f7631064 => generated 1322 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:39.292878 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-0a6174fa-bc88-4e6b-887e-5256a53e9993 req-f3222309-e42e-4baf-8147-218662dbfc84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbe1a0db-64e5-43c0-b32e-38cf084525d9", "name": "network-vif-plugged", "status": "completed", "tag": "93edc3cf-a9a1-40eb-a206-3fc7e191ebad"}, {"server_uuid": "64704ff7-229d-478b-9889-6b6cba53bd0f", "name": "network-vif-unplugged", "status": "completed", "tag": "7f6388a0-8fe7-4ee5-821e-68c4889b9594"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:01:39.341285 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-0a6174fa-bc88-4e6b-887e-5256a53e9993 req-f3222309-e42e-4baf-8147-218662dbfc84 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:39.342179 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-0a6174fa-bc88-4e6b-887e-5256a53e9993 req-f3222309-e42e-4baf-8147-218662dbfc84 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:39.342849 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-0a6174fa-bc88-4e6b-887e-5256a53e9993 req-f3222309-e42e-4baf-8147-218662dbfc84 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:39.387993 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-0a6174fa-bc88-4e6b-887e-5256a53e9993 req-f3222309-e42e-4baf-8147-218662dbfc84 service nova] Creating event network-vif-plugged:93edc3cf-a9a1-40eb-a206-3fc7e191ebad for instance fbe1a0db-64e5-43c0-b32e-38cf084525d9 on n-h1-856895-1 Sep 10 12:01:39.389305 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-0a6174fa-bc88-4e6b-887e-5256a53e9993 req-f3222309-e42e-4baf-8147-218662dbfc84 service nova] Creating event network-vif-unplugged:7f6388a0-8fe7-4ee5-821e-68c4889b9594 for instance 64704ff7-229d-478b-9889-6b6cba53bd0f on n-h1-856895-1 Sep 10 12:01:39.406666 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-0a6174fa-bc88-4e6b-887e-5256a53e9993 req-f3222309-e42e-4baf-8147-218662dbfc84 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.127284 Sep 10 12:01:39.407687 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2289/4590] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:01:39.415187 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-6b01b389-1aa8-4f9c-85d3-53da07893541 req-51223822-6385-429f-9f84-6874d06a1c5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39ee2e7b-63b4-40df-872b-82f81caa61f9", "name": "network-vif-deleted", "tag": "3a94dae5-9cbb-4609-8e73-b50faa359b76"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:01:39.435834 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-06d0c2e4-b80b-4cd7-832e-50c84e4132d1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:39.444606 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-06d0c2e4-b80b-4cd7-832e-50c84e4132d1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1682 microversion: 2.1 time: 0.960078 Sep 10 12:01:39.445192 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2302/4591] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:38 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1682 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:39.455984 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6b01b389-1aa8-4f9c-85d3-53da07893541 req-51223822-6385-429f-9f84-6874d06a1c5b service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:39.456480 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6b01b389-1aa8-4f9c-85d3-53da07893541 req-51223822-6385-429f-9f84-6874d06a1c5b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:39.459904 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6b01b389-1aa8-4f9c-85d3-53da07893541 req-51223822-6385-429f-9f84-6874d06a1c5b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:39.482174 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-6b01b389-1aa8-4f9c-85d3-53da07893541 req-51223822-6385-429f-9f84-6874d06a1c5b service nova] Creating event network-vif-deleted:3a94dae5-9cbb-4609-8e73-b50faa359b76 for instance 39ee2e7b-63b4-40df-872b-82f81caa61f9 on n-h2-856895-1 Sep 10 12:01:39.490295 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0a553d34-947a-4302-be0a-8a01e29f45e4 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:39.491024 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0a553d34-947a-4302-be0a-8a01e29f45e4 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: cea2ee6c-f0c2-4178-857d-e97ceda7e87d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:39.498346 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-6b01b389-1aa8-4f9c-85d3-53da07893541 req-51223822-6385-429f-9f84-6874d06a1c5b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088112 Sep 10 12:01:39.502503 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a553d34-947a-4302-be0a-8a01e29f45e4 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:39.503273 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2290/4592] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:01:39.508995 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a553d34-947a-4302-be0a-8a01e29f45e4 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:39.509598 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a553d34-947a-4302-be0a-8a01e29f45e4 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:39.510699 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a553d34-947a-4302-be0a-8a01e29f45e4 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:39.513927 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a553d34-947a-4302-be0a-8a01e29f45e4 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:39.514548 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a553d34-947a-4302-be0a-8a01e29f45e4 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:39.615540 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a553d34-947a-4302-be0a-8a01e29f45e4 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:39.616011 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a553d34-947a-4302-be0a-8a01e29f45e4 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:39.616518 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a553d34-947a-4302-be0a-8a01e29f45e4 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:39.617041 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-0a553d34-947a-4302-be0a-8a01e29f45e4 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lazy-loading 'fault' on Instance uuid cea2ee6c-f0c2-4178-857d-e97ceda7e87d {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:01:39.734046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0a553d34-947a-4302-be0a-8a01e29f45e4 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f38fd7a24614761ae0c368766006383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ff6d35a7d7a4bac8b6e02b6bf5cb41e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:39.748933 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0a553d34-947a-4302-be0a-8a01e29f45e4 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2ee6c-f0c2-4178-857d-e97ceda7e87d" status: 200 len: 1307 microversion: 2.1 time: 0.263457 Sep 10 12:01:39.764791 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2303/4593] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:39 2022] GET /compute/v2.1/servers/cea2ee6c-f0c2-4178-857d-e97ceda7e87d => generated 1307 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:40.301776 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a0890977-ca97-438f-8b91-39f8721e225a tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:40.302650 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a0890977-ca97-438f-8b91-39f8721e225a tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] [instance: 39ab672e-8334-4fc2-b645-bfb1f7631064] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:40.316205 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a0890977-ca97-438f-8b91-39f8721e225a tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:40.322672 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a0890977-ca97-438f-8b91-39f8721e225a tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:40.323343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a0890977-ca97-438f-8b91-39f8721e225a tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:40.329474 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a0890977-ca97-438f-8b91-39f8721e225a tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:40.336189 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a0890977-ca97-438f-8b91-39f8721e225a tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:40.336739 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a0890977-ca97-438f-8b91-39f8721e225a tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:40.473539 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-36b204d4-b781-4d60-be78-7ecc25198b34 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:40.474549 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-36b204d4-b781-4d60-be78-7ecc25198b34 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:40.494344 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36b204d4-b781-4d60-be78-7ecc25198b34 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:40.495619 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36b204d4-b781-4d60-be78-7ecc25198b34 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:40.496281 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36b204d4-b781-4d60-be78-7ecc25198b34 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:40.497251 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36b204d4-b781-4d60-be78-7ecc25198b34 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:40.497909 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36b204d4-b781-4d60-be78-7ecc25198b34 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:40.498522 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36b204d4-b781-4d60-be78-7ecc25198b34 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:40.593428 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:01:40.679876 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a0890977-ca97-438f-8b91-39f8721e225a tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb776df076341a8a5199fb7b3d08c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:40.706927 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a0890977-ca97-438f-8b91-39f8721e225a tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "GET /compute/v2.1/servers/39ab672e-8334-4fc2-b645-bfb1f7631064" status: 200 len: 1513 microversion: 2.1 time: 0.412617 Sep 10 12:01:40.727189 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2291/4594] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:40 2022] GET /compute/v2.1/servers/39ab672e-8334-4fc2-b645-bfb1f7631064 => generated 1513 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:40.740723 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c5a9caf9-0f3a-4fcb-91c0-aebc4d1f1dd3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:40.741654 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c5a9caf9-0f3a-4fcb-91c0-aebc4d1f1dd3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] [instance: fbe1a0db-64e5-43c0-b32e-38cf084525d9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:40.754543 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c5a9caf9-0f3a-4fcb-91c0-aebc4d1f1dd3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:40.755196 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c5a9caf9-0f3a-4fcb-91c0-aebc4d1f1dd3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:40.755615 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c5a9caf9-0f3a-4fcb-91c0-aebc4d1f1dd3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:40.757646 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c5a9caf9-0f3a-4fcb-91c0-aebc4d1f1dd3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:40.758988 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c5a9caf9-0f3a-4fcb-91c0-aebc4d1f1dd3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:40.760503 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c5a9caf9-0f3a-4fcb-91c0-aebc4d1f1dd3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:41.031215 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-36b204d4-b781-4d60-be78-7ecc25198b34 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:41.043869 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-36b204d4-b781-4d60-be78-7ecc25198b34 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1690 microversion: 2.1 time: 0.576083 Sep 10 12:01:41.054657 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2304/4595] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:40 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1690 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:41.063139 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ba13b020-9ba9-4dcf-bb0f-d638c2350d6f tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:41.070355 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ba13b020-9ba9-4dcf-bb0f-d638c2350d6f tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: cea2ee6c-f0c2-4178-857d-e97ceda7e87d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:41.085711 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba13b020-9ba9-4dcf-bb0f-d638c2350d6f tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:41.086208 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba13b020-9ba9-4dcf-bb0f-d638c2350d6f tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:41.086644 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba13b020-9ba9-4dcf-bb0f-d638c2350d6f tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:41.087388 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba13b020-9ba9-4dcf-bb0f-d638c2350d6f tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:41.087835 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba13b020-9ba9-4dcf-bb0f-d638c2350d6f tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:41.088259 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba13b020-9ba9-4dcf-bb0f-d638c2350d6f tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:41.137504 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-ba13b020-9ba9-4dcf-bb0f-d638c2350d6f tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] HTTP exception thrown: Instance cea2ee6c-f0c2-4178-857d-e97ceda7e87d could not be found. Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ba13b020-9ba9-4dcf-bb0f-d638c2350d6f tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Request method failure captured: Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/cea2ee6c-f0c2-4178-857d-e97ceda7e87d HTTP/1.1 Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHxgYFh9ChimCWk1yEcBB38yIvGdIVTpgJC0SxmJ99BBYePKyx2x8s_8KId9n4wXf10h-bqkhdKwwrr-aKPJquM5KUPJOeBv8VL3usfMscF1jGyS4h6ZwI3iRrBKLXB5iZCEI0NAVQjRZ2H_bzjD1jtNzugviMk_wpnRj44jukJ5j1Q Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 0ff6d35a7d7a4bac8b6e02b6bf5cb41e Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-MultipleCreateTestJSON-514532731 Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ff6d35a7d7a4bac8b6e02b6bf5cb41e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ff6d35a7d7a4bac8b6e02b6bf5cb41e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0ff6d35a7d7a4bac8b6e02b6bf5cb41e", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0ff6d35a7d7a4bac8b6e02b6bf5cb41e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-MultipleCreateTestJSON-514532731 Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 0ff6d35a7d7a4bac8b6e02b6bf5cb41e Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-MultipleCreateTestJSON-514532731 Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-MultipleCreateTestJSON-514532731-project Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 0f38fd7a24614761ae0c368766006383 Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-MultipleCreateTestJSON-514532731-project Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance cea2ee6c-f0c2-4178-857d-e97ceda7e87d could not be found. Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'cea2ee6c-f0c2-4178-857d-e97ceda7e87d'} Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cea2ee6c-f0c2-4178-857d-e97ceda7e87d could not be found. Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cea2ee6c-f0c2-4178-857d-e97ceda7e87d could not be found. Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:01:41.140293 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:01:41.145465 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:01:41.145465 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:01:41.145465 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:01:41.145465 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:01:41.145465 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:01:41.145465 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cea2ee6c-f0c2-4178-857d-e97ceda7e87d could not be found. Sep 10 12:01:41.145465 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:01:41.147366 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ba13b020-9ba9-4dcf-bb0f-d638c2350d6f tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Returning 404 to user: Instance cea2ee6c-f0c2-4178-857d-e97ceda7e87d could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:01:41.148479 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ba13b020-9ba9-4dcf-bb0f-d638c2350d6f tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "GET /compute/v2.1/servers/cea2ee6c-f0c2-4178-857d-e97ceda7e87d" status: 404 len: 111 microversion: 2.1 time: 0.092703 Sep 10 12:01:41.152432 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2305/4596] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:41 2022] GET /compute/v2.1/servers/cea2ee6c-f0c2-4178-857d-e97ceda7e87d => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:01:41.166069 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c5a9caf9-0f3a-4fcb-91c0-aebc4d1f1dd3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb776df076341a8a5199fb7b3d08c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:41.184909 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c5a9caf9-0f3a-4fcb-91c0-aebc4d1f1dd3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "GET /compute/v2.1/servers/fbe1a0db-64e5-43c0-b32e-38cf084525d9" status: 200 len: 1322 microversion: 2.1 time: 0.449526 Sep 10 12:01:41.201086 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2292/4597] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:40 2022] GET /compute/v2.1/servers/fbe1a0db-64e5-43c0-b32e-38cf084525d9 => generated 1322 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:01:41.206754 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a6704e08-bd26-41c6-b6f0-9b1f715fc000 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:41.207443 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a6704e08-bd26-41c6-b6f0-9b1f715fc000 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] [instance: 39ee2e7b-63b4-40df-872b-82f81caa61f9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:41.220206 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6704e08-bd26-41c6-b6f0-9b1f715fc000 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:41.221061 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6704e08-bd26-41c6-b6f0-9b1f715fc000 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:41.221842 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6704e08-bd26-41c6-b6f0-9b1f715fc000 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:41.222689 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6704e08-bd26-41c6-b6f0-9b1f715fc000 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:41.223388 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6704e08-bd26-41c6-b6f0-9b1f715fc000 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:41.223897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6704e08-bd26-41c6-b6f0-9b1f715fc000 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:41.272663 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-a6704e08-bd26-41c6-b6f0-9b1f715fc000 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] HTTP exception thrown: Instance 39ee2e7b-63b4-40df-872b-82f81caa61f9 could not be found. Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a6704e08-bd26-41c6-b6f0-9b1f715fc000 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Request method failure captured: Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/39ee2e7b-63b4-40df-872b-82f81caa61f9 HTTP/1.1 Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHxgYFh9ChimCWk1yEcBB38yIvGdIVTpgJC0SxmJ99BBYePKyx2x8s_8KId9n4wXf10h-bqkhdKwwrr-aKPJquM5KUPJOeBv8VL3usfMscF1jGyS4h6ZwI3iRrBKLXB5iZCEI0NAVQjRZ2H_bzjD1jtNzugviMk_wpnRj44jukJ5j1Q Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 0ff6d35a7d7a4bac8b6e02b6bf5cb41e Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-MultipleCreateTestJSON-514532731 Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ff6d35a7d7a4bac8b6e02b6bf5cb41e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0ff6d35a7d7a4bac8b6e02b6bf5cb41e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0ff6d35a7d7a4bac8b6e02b6bf5cb41e", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0ff6d35a7d7a4bac8b6e02b6bf5cb41e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-MultipleCreateTestJSON-514532731 Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 0ff6d35a7d7a4bac8b6e02b6bf5cb41e Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-MultipleCreateTestJSON-514532731 Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-MultipleCreateTestJSON-514532731-project Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 0f38fd7a24614761ae0c368766006383 Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-MultipleCreateTestJSON-514532731-project Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 39ee2e7b-63b4-40df-872b-82f81caa61f9 could not be found. Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '39ee2e7b-63b4-40df-872b-82f81caa61f9'} Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39ee2e7b-63b4-40df-872b-82f81caa61f9 could not be found. Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39ee2e7b-63b4-40df-872b-82f81caa61f9 could not be found. Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:01:41.275421 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:01:41.279423 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:01:41.279423 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:01:41.279423 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:01:41.279423 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:01:41.279423 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:01:41.279423 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39ee2e7b-63b4-40df-872b-82f81caa61f9 could not be found. Sep 10 12:01:41.279423 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:01:41.279423 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a6704e08-bd26-41c6-b6f0-9b1f715fc000 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] Returning 404 to user: Instance 39ee2e7b-63b4-40df-872b-82f81caa61f9 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:01:41.282396 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a6704e08-bd26-41c6-b6f0-9b1f715fc000 tempest-MultipleCreateTestJSON-514532731 tempest-MultipleCreateTestJSON-514532731-project] 10.222.0.23 "GET /compute/v2.1/servers/39ee2e7b-63b4-40df-872b-82f81caa61f9" status: 404 len: 111 microversion: 2.1 time: 0.085818 Sep 10 12:01:41.284427 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2293/4598] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:41 2022] GET /compute/v2.1/servers/39ee2e7b-63b4-40df-872b-82f81caa61f9 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:01:41.346037 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e780d2c4-a35f-4862-9c77-bdfa6c5a6e58 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-942394475", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "5a10f3ce-b3db-41f2-acaa-21e8715e6fe6"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:01:41.436266 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-e780d2c4-a35f-4862-9c77-bdfa6c5a6e58 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] validate_networks() for [('5a10f3ce-b3db-41f2-acaa-21e8715e6fe6', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:01:42.069133 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-00c2b182-1732-4943-be75-8d26652e0ef6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:42.071301 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-00c2b182-1732-4943-be75-8d26652e0ef6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:42.087692 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00c2b182-1732-4943-be75-8d26652e0ef6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:42.089736 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00c2b182-1732-4943-be75-8d26652e0ef6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:42.091825 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00c2b182-1732-4943-be75-8d26652e0ef6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:42.092820 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00c2b182-1732-4943-be75-8d26652e0ef6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:42.095736 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00c2b182-1732-4943-be75-8d26652e0ef6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:42.096455 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00c2b182-1732-4943-be75-8d26652e0ef6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:43.209822 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-00c2b182-1732-4943-be75-8d26652e0ef6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:43.222281 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-00c2b182-1732-4943-be75-8d26652e0ef6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1690 microversion: 2.1 time: 1.155448 Sep 10 12:01:43.225576 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2294/4599] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:42 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1690 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:01:43.243333 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d86b4f8f-9ed0-468d-a6db-5f5b08b9cd88 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:43.243968 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d86b4f8f-9ed0-468d-a6db-5f5b08b9cd88 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] [instance: fbe1a0db-64e5-43c0-b32e-38cf084525d9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:43.251609 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d86b4f8f-9ed0-468d-a6db-5f5b08b9cd88 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:43.255339 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d86b4f8f-9ed0-468d-a6db-5f5b08b9cd88 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:43.255860 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d86b4f8f-9ed0-468d-a6db-5f5b08b9cd88 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:43.259911 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d86b4f8f-9ed0-468d-a6db-5f5b08b9cd88 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:43.260498 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d86b4f8f-9ed0-468d-a6db-5f5b08b9cd88 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:43.260978 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d86b4f8f-9ed0-468d-a6db-5f5b08b9cd88 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:43.341557 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-e780d2c4-a35f-4862-9c77-bdfa6c5a6e58 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:01:43.342088 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-e780d2c4-a35f-4862-9c77-bdfa6c5a6e58 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:01:43.344069 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-e780d2c4-a35f-4862-9c77-bdfa6c5a6e58 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:01:43.344710 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-e780d2c4-a35f-4862-9c77-bdfa6c5a6e58 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:01:43.345433 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-e780d2c4-a35f-4862-9c77-bdfa6c5a6e58 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:01:43.357626 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:01:43.366882 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e780d2c4-a35f-4862-9c77-bdfa6c5a6e58 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:43.388258 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e780d2c4-a35f-4862-9c77-bdfa6c5a6e58 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:43.388837 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e780d2c4-a35f-4862-9c77-bdfa6c5a6e58 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:43.389827 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e780d2c4-a35f-4862-9c77-bdfa6c5a6e58 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:43.390315 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e780d2c4-a35f-4862-9c77-bdfa6c5a6e58 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:43.390756 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e780d2c4-a35f-4862-9c77-bdfa6c5a6e58 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:43.440035 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-e780d2c4-a35f-4862-9c77-bdfa6c5a6e58 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Getting quotas for project ac8b3e9f72234d9985fbc5fa7e7984ad. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:01:43.447575 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-e780d2c4-a35f-4862-9c77-bdfa6c5a6e58 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Getting quotas for user ef32131362a3442498234c0554f08305 and project ac8b3e9f72234d9985fbc5fa7e7984ad. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:01:43.464450 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e780d2c4-a35f-4862-9c77-bdfa6c5a6e58 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:01:43.467786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e780d2c4-a35f-4862-9c77-bdfa6c5a6e58 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: c9e5a917-1b95-4d2b-9d1b-067bb36aa869] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:01:43.585768 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e780d2c4-a35f-4862-9c77-bdfa6c5a6e58 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.430666 Sep 10 12:01:43.586466 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2306/4600] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:01:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2433 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:01:43.598079 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-09b9bfad-d480-49a6-8f35-430ad2984b34 req-a02b3c5d-3fa3-41e1-a947-b040f182a076 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "559c6087-5a37-455c-820e-3815be504495", "name": "network-vif-plugged", "status": "completed", "tag": "9645b2fa-f2c2-41f7-9cdc-69deff08885e"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:01:43.663991 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-09b9bfad-d480-49a6-8f35-430ad2984b34 req-a02b3c5d-3fa3-41e1-a947-b040f182a076 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:43.664468 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-09b9bfad-d480-49a6-8f35-430ad2984b34 req-a02b3c5d-3fa3-41e1-a947-b040f182a076 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:43.665354 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-09b9bfad-d480-49a6-8f35-430ad2984b34 req-a02b3c5d-3fa3-41e1-a947-b040f182a076 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:43.689671 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-09b9bfad-d480-49a6-8f35-430ad2984b34 req-a02b3c5d-3fa3-41e1-a947-b040f182a076 service nova] Creating event network-vif-plugged:9645b2fa-f2c2-41f7-9cdc-69deff08885e for instance 559c6087-5a37-455c-820e-3815be504495 on n-h1-856895-1 Sep 10 12:01:43.700238 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-09b9bfad-d480-49a6-8f35-430ad2984b34 req-a02b3c5d-3fa3-41e1-a947-b040f182a076 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110176 Sep 10 12:01:43.700861 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2307/4601] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:01:43.722035 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e1d2bfca-a87c-4e5e-9c8a-d065c59d7992 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:43.722979 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e1d2bfca-a87c-4e5e-9c8a-d065c59d7992 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: c9e5a917-1b95-4d2b-9d1b-067bb36aa869] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:43.736862 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d86b4f8f-9ed0-468d-a6db-5f5b08b9cd88 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb776df076341a8a5199fb7b3d08c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:43.751868 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d86b4f8f-9ed0-468d-a6db-5f5b08b9cd88 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "GET /compute/v2.1/servers/fbe1a0db-64e5-43c0-b32e-38cf084525d9" status: 200 len: 1513 microversion: 2.1 time: 0.518335 Sep 10 12:01:43.753087 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2295/4602] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:43 2022] GET /compute/v2.1/servers/fbe1a0db-64e5-43c0-b32e-38cf084525d9 => generated 1513 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:43.778871 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-51de2025-91b2-48ee-8a51-4550a04ff661 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:43.779811 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-51de2025-91b2-48ee-8a51-4550a04ff661 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] [instance: 559c6087-5a37-455c-820e-3815be504495] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:43.789257 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-51de2025-91b2-48ee-8a51-4550a04ff661 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:43.794072 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-51de2025-91b2-48ee-8a51-4550a04ff661 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:43.794731 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-51de2025-91b2-48ee-8a51-4550a04ff661 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:43.795703 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-51de2025-91b2-48ee-8a51-4550a04ff661 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:43.796333 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-51de2025-91b2-48ee-8a51-4550a04ff661 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:43.797490 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-51de2025-91b2-48ee-8a51-4550a04ff661 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:43.890310 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e1d2bfca-a87c-4e5e-9c8a-d065c59d7992 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:43.914127 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e1d2bfca-a87c-4e5e-9c8a-d065c59d7992 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/c9e5a917-1b95-4d2b-9d1b-067bb36aa869" status: 200 len: 1192 microversion: 2.1 time: 0.209738 Sep 10 12:01:43.914740 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2308/4603] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:43 2022] GET /compute/v2.1/servers/c9e5a917-1b95-4d2b-9d1b-067bb36aa869 => generated 1192 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:44.078839 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-51de2025-91b2-48ee-8a51-4550a04ff661 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb776df076341a8a5199fb7b3d08c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:44.102140 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-51de2025-91b2-48ee-8a51-4550a04ff661 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "GET /compute/v2.1/servers/559c6087-5a37-455c-820e-3815be504495" status: 200 len: 1322 microversion: 2.1 time: 0.327020 Sep 10 12:01:44.120144 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2296/4604] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:43 2022] GET /compute/v2.1/servers/559c6087-5a37-455c-820e-3815be504495 => generated 1322 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:44.253771 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fba195da-67f0-49a3-971f-cd283d6d17f6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:44.254453 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fba195da-67f0-49a3-971f-cd283d6d17f6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:44.271001 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fba195da-67f0-49a3-971f-cd283d6d17f6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:44.276048 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fba195da-67f0-49a3-971f-cd283d6d17f6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:44.277592 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fba195da-67f0-49a3-971f-cd283d6d17f6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:44.282116 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fba195da-67f0-49a3-971f-cd283d6d17f6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:44.282611 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fba195da-67f0-49a3-971f-cd283d6d17f6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:44.283628 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fba195da-67f0-49a3-971f-cd283d6d17f6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:44.942171 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1ecf00e7-f6a2-4959-8c03-05097f927ba6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:44.943085 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1ecf00e7-f6a2-4959-8c03-05097f927ba6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: c9e5a917-1b95-4d2b-9d1b-067bb36aa869] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:44.954320 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1ecf00e7-f6a2-4959-8c03-05097f927ba6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:44.957516 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1ecf00e7-f6a2-4959-8c03-05097f927ba6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:44.960763 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1ecf00e7-f6a2-4959-8c03-05097f927ba6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:44.961769 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1ecf00e7-f6a2-4959-8c03-05097f927ba6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:44.962610 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1ecf00e7-f6a2-4959-8c03-05097f927ba6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:44.963456 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1ecf00e7-f6a2-4959-8c03-05097f927ba6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:45.290343 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fba195da-67f0-49a3-971f-cd283d6d17f6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:45.303594 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fba195da-67f0-49a3-971f-cd283d6d17f6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1690 microversion: 2.1 time: 1.055062 Sep 10 12:01:45.305495 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2309/4605] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:44 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1690 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:45.311715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ded19f39-5931-416f-a01d-987ecbde2805 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:45.312646 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ded19f39-5931-416f-a01d-987ecbde2805 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] [instance: 559c6087-5a37-455c-820e-3815be504495] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:45.320818 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ded19f39-5931-416f-a01d-987ecbde2805 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:45.321674 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ded19f39-5931-416f-a01d-987ecbde2805 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:45.322544 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ded19f39-5931-416f-a01d-987ecbde2805 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:45.323520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ded19f39-5931-416f-a01d-987ecbde2805 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:45.324219 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ded19f39-5931-416f-a01d-987ecbde2805 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:45.326016 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ded19f39-5931-416f-a01d-987ecbde2805 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:45.388662 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1ecf00e7-f6a2-4959-8c03-05097f927ba6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:45.411462 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1ecf00e7-f6a2-4959-8c03-05097f927ba6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/c9e5a917-1b95-4d2b-9d1b-067bb36aa869" status: 200 len: 1244 microversion: 2.1 time: 0.474702 Sep 10 12:01:45.412320 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2297/4606] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:44 2022] GET /compute/v2.1/servers/c9e5a917-1b95-4d2b-9d1b-067bb36aa869 => generated 1244 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:01:45.718102 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-a0e8d4b4-8cfc-4d48-887e-e35471a3f2c4 req-a6e19514-c3fc-4eb1-9965-69b923346e6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64704ff7-229d-478b-9889-6b6cba53bd0f", "name": "network-vif-plugged", "status": "completed", "tag": "7f6388a0-8fe7-4ee5-821e-68c4889b9594"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:01:45.742699 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a0e8d4b4-8cfc-4d48-887e-e35471a3f2c4 req-a6e19514-c3fc-4eb1-9965-69b923346e6d service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:45.743753 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a0e8d4b4-8cfc-4d48-887e-e35471a3f2c4 req-a6e19514-c3fc-4eb1-9965-69b923346e6d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:45.744573 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a0e8d4b4-8cfc-4d48-887e-e35471a3f2c4 req-a6e19514-c3fc-4eb1-9965-69b923346e6d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:45.771822 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-a0e8d4b4-8cfc-4d48-887e-e35471a3f2c4 req-a6e19514-c3fc-4eb1-9965-69b923346e6d service nova] Creating event network-vif-plugged:7f6388a0-8fe7-4ee5-821e-68c4889b9594 for instance 64704ff7-229d-478b-9889-6b6cba53bd0f on n-h1-856895-1 Sep 10 12:01:45.780839 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-a0e8d4b4-8cfc-4d48-887e-e35471a3f2c4 req-a6e19514-c3fc-4eb1-9965-69b923346e6d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066540 Sep 10 12:01:45.785300 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2298/4607] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:01:46.004684 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ded19f39-5931-416f-a01d-987ecbde2805 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb776df076341a8a5199fb7b3d08c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:46.019203 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ded19f39-5931-416f-a01d-987ecbde2805 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "GET /compute/v2.1/servers/559c6087-5a37-455c-820e-3815be504495" status: 200 len: 1322 microversion: 2.1 time: 0.707911 Sep 10 12:01:46.035820 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2310/4608] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:45 2022] GET /compute/v2.1/servers/559c6087-5a37-455c-820e-3815be504495 => generated 1322 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:46.328782 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f395629c-c674-429d-8d7e-179d186767f1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:46.331226 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f395629c-c674-429d-8d7e-179d186767f1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:46.339299 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f395629c-c674-429d-8d7e-179d186767f1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:46.340124 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f395629c-c674-429d-8d7e-179d186767f1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:46.340746 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f395629c-c674-429d-8d7e-179d186767f1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:46.342335 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f395629c-c674-429d-8d7e-179d186767f1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:46.343009 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f395629c-c674-429d-8d7e-179d186767f1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:46.343760 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f395629c-c674-429d-8d7e-179d186767f1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:46.436051 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-def53418-1c7f-4424-8bd9-18794d6ecbb5 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:46.436819 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-def53418-1c7f-4424-8bd9-18794d6ecbb5 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: c9e5a917-1b95-4d2b-9d1b-067bb36aa869] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:46.449155 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-def53418-1c7f-4424-8bd9-18794d6ecbb5 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:46.449989 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-def53418-1c7f-4424-8bd9-18794d6ecbb5 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:46.450543 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-def53418-1c7f-4424-8bd9-18794d6ecbb5 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:46.451402 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-def53418-1c7f-4424-8bd9-18794d6ecbb5 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:46.451961 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-def53418-1c7f-4424-8bd9-18794d6ecbb5 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:46.453042 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-def53418-1c7f-4424-8bd9-18794d6ecbb5 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:46.663587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-def53418-1c7f-4424-8bd9-18794d6ecbb5 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:46.690312 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-def53418-1c7f-4424-8bd9-18794d6ecbb5 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/c9e5a917-1b95-4d2b-9d1b-067bb36aa869" status: 200 len: 1250 microversion: 2.1 time: 0.256299 Sep 10 12:01:46.694778 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2311/4609] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:46 2022] GET /compute/v2.1/servers/c9e5a917-1b95-4d2b-9d1b-067bb36aa869 => generated 1250 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:46.968349 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f395629c-c674-429d-8d7e-179d186767f1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:46.977185 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f395629c-c674-429d-8d7e-179d186767f1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1690 microversion: 2.1 time: 0.653384 Sep 10 12:01:46.992266 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2299/4610] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:46 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1690 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:47.044682 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0f7c3f35-61da-4055-8c90-fe64931655a3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:47.045652 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0f7c3f35-61da-4055-8c90-fe64931655a3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] [instance: 559c6087-5a37-455c-820e-3815be504495] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:47.056188 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0f7c3f35-61da-4055-8c90-fe64931655a3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:47.057123 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0f7c3f35-61da-4055-8c90-fe64931655a3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:47.057796 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0f7c3f35-61da-4055-8c90-fe64931655a3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:47.058742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0f7c3f35-61da-4055-8c90-fe64931655a3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:47.059463 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0f7c3f35-61da-4055-8c90-fe64931655a3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:47.060129 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0f7c3f35-61da-4055-8c90-fe64931655a3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:47.723521 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-aa431ba9-c3bc-4f2b-8bd5-83f0e6b03455 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:47.724890 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-aa431ba9-c3bc-4f2b-8bd5-83f0e6b03455 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: c9e5a917-1b95-4d2b-9d1b-067bb36aa869] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:47.738955 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aa431ba9-c3bc-4f2b-8bd5-83f0e6b03455 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:47.739817 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aa431ba9-c3bc-4f2b-8bd5-83f0e6b03455 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:47.742580 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aa431ba9-c3bc-4f2b-8bd5-83f0e6b03455 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:47.746452 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aa431ba9-c3bc-4f2b-8bd5-83f0e6b03455 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:47.747303 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aa431ba9-c3bc-4f2b-8bd5-83f0e6b03455 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:47.747972 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aa431ba9-c3bc-4f2b-8bd5-83f0e6b03455 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:48.075224 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-aa431ba9-c3bc-4f2b-8bd5-83f0e6b03455 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:48.083983 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-aa431ba9-c3bc-4f2b-8bd5-83f0e6b03455 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/c9e5a917-1b95-4d2b-9d1b-067bb36aa869" status: 200 len: 1250 microversion: 2.1 time: 0.366620 Sep 10 12:01:48.103588 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2300/4611] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:47 2022] GET /compute/v2.1/servers/c9e5a917-1b95-4d2b-9d1b-067bb36aa869 => generated 1250 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:01:48.108795 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-001cbf7f-7061-4c21-a0cd-e79bd8aa6fd5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:48.109412 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-001cbf7f-7061-4c21-a0cd-e79bd8aa6fd5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:48.130989 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-001cbf7f-7061-4c21-a0cd-e79bd8aa6fd5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:48.142247 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-001cbf7f-7061-4c21-a0cd-e79bd8aa6fd5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:48.143321 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-001cbf7f-7061-4c21-a0cd-e79bd8aa6fd5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:48.144246 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-001cbf7f-7061-4c21-a0cd-e79bd8aa6fd5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:48.144865 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-001cbf7f-7061-4c21-a0cd-e79bd8aa6fd5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:48.145461 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-001cbf7f-7061-4c21-a0cd-e79bd8aa6fd5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:48.376860 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0f7c3f35-61da-4055-8c90-fe64931655a3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb776df076341a8a5199fb7b3d08c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:48.386358 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0f7c3f35-61da-4055-8c90-fe64931655a3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "GET /compute/v2.1/servers/559c6087-5a37-455c-820e-3815be504495" status: 200 len: 1512 microversion: 2.1 time: 1.348169 Sep 10 12:01:48.399834 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2312/4612] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:47 2022] GET /compute/v2.1/servers/559c6087-5a37-455c-820e-3815be504495 => generated 1512 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:48.412432 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8db72c89-de0c-4756-abe4-cf35803f8a43 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:48.413257 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8db72c89-de0c-4756-abe4-cf35803f8a43 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] [instance: 559c6087-5a37-455c-820e-3815be504495] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:48.420057 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8db72c89-de0c-4756-abe4-cf35803f8a43 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:48.427563 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8db72c89-de0c-4756-abe4-cf35803f8a43 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:48.428048 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8db72c89-de0c-4756-abe4-cf35803f8a43 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:48.430316 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8db72c89-de0c-4756-abe4-cf35803f8a43 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:48.430800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8db72c89-de0c-4756-abe4-cf35803f8a43 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:48.431274 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8db72c89-de0c-4756-abe4-cf35803f8a43 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:48.520186 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8db72c89-de0c-4756-abe4-cf35803f8a43 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] [instance: 559c6087-5a37-455c-820e-3815be504495] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:01:48.736984 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8db72c89-de0c-4756-abe4-cf35803f8a43 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "DELETE /compute/v2.1/servers/559c6087-5a37-455c-820e-3815be504495" status: 204 len: 0 microversion: 2.1 time: 0.330322 Sep 10 12:01:48.741708 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2313/4613] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:01:48 2022] DELETE /compute/v2.1/servers/559c6087-5a37-455c-820e-3815be504495 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:01:48.756872 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fee71578-1abe-4b76-880f-289888ddf0a9 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:48.761050 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fee71578-1abe-4b76-880f-289888ddf0a9 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] [instance: 559c6087-5a37-455c-820e-3815be504495] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:48.771523 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fee71578-1abe-4b76-880f-289888ddf0a9 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:48.776351 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fee71578-1abe-4b76-880f-289888ddf0a9 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:48.777043 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fee71578-1abe-4b76-880f-289888ddf0a9 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:48.778863 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fee71578-1abe-4b76-880f-289888ddf0a9 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:48.779555 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fee71578-1abe-4b76-880f-289888ddf0a9 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:48.780159 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fee71578-1abe-4b76-880f-289888ddf0a9 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:49.427085 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-001cbf7f-7061-4c21-a0cd-e79bd8aa6fd5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:49.433033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:01:49.459693 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-001cbf7f-7061-4c21-a0cd-e79bd8aa6fd5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1685 microversion: 2.1 time: 1.349494 Sep 10 12:01:49.477331 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2301/4614] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:48 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1685 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:49.486678 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-359bf73d-7588-4f8e-90ae-97393e37f4cf tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:49.487562 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-359bf73d-7588-4f8e-90ae-97393e37f4cf tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: c9e5a917-1b95-4d2b-9d1b-067bb36aa869] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:49.517748 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-359bf73d-7588-4f8e-90ae-97393e37f4cf tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:49.518775 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-359bf73d-7588-4f8e-90ae-97393e37f4cf tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:49.519439 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-359bf73d-7588-4f8e-90ae-97393e37f4cf tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:49.520694 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-359bf73d-7588-4f8e-90ae-97393e37f4cf tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:49.521320 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-359bf73d-7588-4f8e-90ae-97393e37f4cf tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:49.521922 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-359bf73d-7588-4f8e-90ae-97393e37f4cf tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:49.845643 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fee71578-1abe-4b76-880f-289888ddf0a9 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb776df076341a8a5199fb7b3d08c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:49.860590 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fee71578-1abe-4b76-880f-289888ddf0a9 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "GET /compute/v2.1/servers/559c6087-5a37-455c-820e-3815be504495" status: 200 len: 1518 microversion: 2.1 time: 1.117377 Sep 10 12:01:49.879209 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2314/4615] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:48 2022] GET /compute/v2.1/servers/559c6087-5a37-455c-820e-3815be504495 => generated 1518 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:50.029971 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-359bf73d-7588-4f8e-90ae-97393e37f4cf tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:50.054484 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-359bf73d-7588-4f8e-90ae-97393e37f4cf tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/c9e5a917-1b95-4d2b-9d1b-067bb36aa869" status: 200 len: 1292 microversion: 2.1 time: 0.574615 Sep 10 12:01:50.066511 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2302/4616] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:49 2022] GET /compute/v2.1/servers/c9e5a917-1b95-4d2b-9d1b-067bb36aa869 => generated 1292 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:50.486717 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4af64388-79e2-462f-b97f-610887055990 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:50.487520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4af64388-79e2-462f-b97f-610887055990 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:50.497987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4af64388-79e2-462f-b97f-610887055990 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:50.499078 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4af64388-79e2-462f-b97f-610887055990 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:50.501274 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4af64388-79e2-462f-b97f-610887055990 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:50.503648 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4af64388-79e2-462f-b97f-610887055990 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:50.504131 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4af64388-79e2-462f-b97f-610887055990 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:50.504571 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4af64388-79e2-462f-b97f-610887055990 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:50.883641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4af64388-79e2-462f-b97f-610887055990 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:50.893692 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d6df29b3-da95-4b26-b926-008ea6e0e588 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:50.894317 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d6df29b3-da95-4b26-b926-008ea6e0e588 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] [instance: 559c6087-5a37-455c-820e-3815be504495] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:50.901884 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4af64388-79e2-462f-b97f-610887055990 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1685 microversion: 2.1 time: 0.419769 Sep 10 12:01:50.905068 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2315/4617] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:50 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1685 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:50.916681 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d6df29b3-da95-4b26-b926-008ea6e0e588 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:50.917191 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d6df29b3-da95-4b26-b926-008ea6e0e588 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:50.917640 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d6df29b3-da95-4b26-b926-008ea6e0e588 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:50.918364 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d6df29b3-da95-4b26-b926-008ea6e0e588 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:50.918823 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d6df29b3-da95-4b26-b926-008ea6e0e588 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:50.932338 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d6df29b3-da95-4b26-b926-008ea6e0e588 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:51.093583 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4eca888e-a47b-4362-800c-dc2f474635ad tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:51.094793 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4eca888e-a47b-4362-800c-dc2f474635ad tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: c9e5a917-1b95-4d2b-9d1b-067bb36aa869] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:51.107931 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4eca888e-a47b-4362-800c-dc2f474635ad tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:51.112202 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4eca888e-a47b-4362-800c-dc2f474635ad tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:51.114074 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4eca888e-a47b-4362-800c-dc2f474635ad tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:51.119532 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4eca888e-a47b-4362-800c-dc2f474635ad tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:51.121366 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4eca888e-a47b-4362-800c-dc2f474635ad tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:51.123710 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4eca888e-a47b-4362-800c-dc2f474635ad tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:51.289064 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d6df29b3-da95-4b26-b926-008ea6e0e588 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb776df076341a8a5199fb7b3d08c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:51.299582 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d6df29b3-da95-4b26-b926-008ea6e0e588 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "GET /compute/v2.1/servers/559c6087-5a37-455c-820e-3815be504495" status: 200 len: 1518 microversion: 2.1 time: 0.409551 Sep 10 12:01:51.300182 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2303/4618] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:50 2022] GET /compute/v2.1/servers/559c6087-5a37-455c-820e-3815be504495 => generated 1518 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:01:51.717080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4eca888e-a47b-4362-800c-dc2f474635ad tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:51.747718 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4eca888e-a47b-4362-800c-dc2f474635ad tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/c9e5a917-1b95-4d2b-9d1b-067bb36aa869" status: 200 len: 1292 microversion: 2.1 time: 0.646956 Sep 10 12:01:51.752050 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2316/4619] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:51 2022] GET /compute/v2.1/servers/c9e5a917-1b95-4d2b-9d1b-067bb36aa869 => generated 1292 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:51.938174 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d60ddcd3-fb89-41fd-8f5a-972c79340da5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:51.938816 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d60ddcd3-fb89-41fd-8f5a-972c79340da5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:51.959087 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d60ddcd3-fb89-41fd-8f5a-972c79340da5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:51.959627 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d60ddcd3-fb89-41fd-8f5a-972c79340da5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:51.960078 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d60ddcd3-fb89-41fd-8f5a-972c79340da5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:51.960807 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d60ddcd3-fb89-41fd-8f5a-972c79340da5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:51.987673 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d60ddcd3-fb89-41fd-8f5a-972c79340da5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:51.988453 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d60ddcd3-fb89-41fd-8f5a-972c79340da5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:52.337160 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-52794a83-daf8-46ca-aea7-8cb5e80de4e7 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:52.338558 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-52794a83-daf8-46ca-aea7-8cb5e80de4e7 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] [instance: 559c6087-5a37-455c-820e-3815be504495] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:52.362599 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-52794a83-daf8-46ca-aea7-8cb5e80de4e7 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:52.363263 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-52794a83-daf8-46ca-aea7-8cb5e80de4e7 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:52.363904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-52794a83-daf8-46ca-aea7-8cb5e80de4e7 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:52.369313 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-52794a83-daf8-46ca-aea7-8cb5e80de4e7 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:52.373048 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-52794a83-daf8-46ca-aea7-8cb5e80de4e7 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:52.373707 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-52794a83-daf8-46ca-aea7-8cb5e80de4e7 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:52.568740 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-52794a83-daf8-46ca-aea7-8cb5e80de4e7 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb776df076341a8a5199fb7b3d08c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:52.584198 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-52794a83-daf8-46ca-aea7-8cb5e80de4e7 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "GET /compute/v2.1/servers/559c6087-5a37-455c-820e-3815be504495" status: 200 len: 1476 microversion: 2.1 time: 0.255724 Sep 10 12:01:52.585384 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2317/4620] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:52 2022] GET /compute/v2.1/servers/559c6087-5a37-455c-820e-3815be504495 => generated 1476 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:52.735293 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-bdaa5c45-69d0-49cf-ad67-ee0d6f293ed5 req-cc2d5fb7-8263-44c2-adf5-531b9c952baf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "559c6087-5a37-455c-820e-3815be504495", "name": "network-vif-deleted", "tag": "9645b2fa-f2c2-41f7-9cdc-69deff08885e"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:01:52.758833 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-bdaa5c45-69d0-49cf-ad67-ee0d6f293ed5 req-cc2d5fb7-8263-44c2-adf5-531b9c952baf service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:52.760966 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-bdaa5c45-69d0-49cf-ad67-ee0d6f293ed5 req-cc2d5fb7-8263-44c2-adf5-531b9c952baf service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:52.763418 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-bdaa5c45-69d0-49cf-ad67-ee0d6f293ed5 req-cc2d5fb7-8263-44c2-adf5-531b9c952baf service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:52.802390 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-bdaa5c45-69d0-49cf-ad67-ee0d6f293ed5 req-cc2d5fb7-8263-44c2-adf5-531b9c952baf service nova] Creating event network-vif-deleted:9645b2fa-f2c2-41f7-9cdc-69deff08885e for instance 559c6087-5a37-455c-820e-3815be504495 on n-h1-856895-1 Sep 10 12:01:52.819492 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-bdaa5c45-69d0-49cf-ad67-ee0d6f293ed5 req-cc2d5fb7-8263-44c2-adf5-531b9c952baf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088342 Sep 10 12:01:52.825723 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2318/4621] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:01:52.844661 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-99f88212-0d19-4808-82ee-16e32323ed29 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:52.849956 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-99f88212-0d19-4808-82ee-16e32323ed29 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: c9e5a917-1b95-4d2b-9d1b-067bb36aa869] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:52.879225 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99f88212-0d19-4808-82ee-16e32323ed29 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:52.880033 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99f88212-0d19-4808-82ee-16e32323ed29 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:52.881691 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99f88212-0d19-4808-82ee-16e32323ed29 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:52.882529 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99f88212-0d19-4808-82ee-16e32323ed29 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:52.882998 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99f88212-0d19-4808-82ee-16e32323ed29 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:52.883462 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99f88212-0d19-4808-82ee-16e32323ed29 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:52.936291 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d60ddcd3-fb89-41fd-8f5a-972c79340da5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:52.946760 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d60ddcd3-fb89-41fd-8f5a-972c79340da5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1685 microversion: 2.1 time: 1.012516 Sep 10 12:01:52.969410 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2304/4622] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:51 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1685 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:53.000981 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-3b0c16ae-d847-4b97-b42a-e707ab2b72a6 req-304966f9-2f48-4dd8-826a-452fdc35ac59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9e5a917-1b95-4d2b-9d1b-067bb36aa869", "tag": "4e1366da-1da3-49ce-9191-e53716ae9233"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:01:53.039228 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-3b0c16ae-d847-4b97-b42a-e707ab2b72a6 req-304966f9-2f48-4dd8-826a-452fdc35ac59 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:53.039722 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-3b0c16ae-d847-4b97-b42a-e707ab2b72a6 req-304966f9-2f48-4dd8-826a-452fdc35ac59 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:53.040351 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-3b0c16ae-d847-4b97-b42a-e707ab2b72a6 req-304966f9-2f48-4dd8-826a-452fdc35ac59 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:53.055277 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-3b0c16ae-d847-4b97-b42a-e707ab2b72a6 req-304966f9-2f48-4dd8-826a-452fdc35ac59 service nova] Creating event network-changed:4e1366da-1da3-49ce-9191-e53716ae9233 for instance c9e5a917-1b95-4d2b-9d1b-067bb36aa869 on n-h2-856895-1 Sep 10 12:01:53.086067 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-3b0c16ae-d847-4b97-b42a-e707ab2b72a6 req-304966f9-2f48-4dd8-826a-452fdc35ac59 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115298 Sep 10 12:01:53.089149 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2305/4623] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:01:53.416375 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:01:53.603465 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-99f88212-0d19-4808-82ee-16e32323ed29 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:53.613733 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9ccc02b3-8011-4f33-b498-29dc554894a6 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:53.614807 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9ccc02b3-8011-4f33-b498-29dc554894a6 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] [instance: 559c6087-5a37-455c-820e-3815be504495] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:53.619651 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-99f88212-0d19-4808-82ee-16e32323ed29 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/c9e5a917-1b95-4d2b-9d1b-067bb36aa869" status: 200 len: 1292 microversion: 2.1 time: 0.791285 Sep 10 12:01:53.623993 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2319/4624] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:52 2022] GET /compute/v2.1/servers/c9e5a917-1b95-4d2b-9d1b-067bb36aa869 => generated 1292 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:53.630098 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ccc02b3-8011-4f33-b498-29dc554894a6 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:53.630871 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ccc02b3-8011-4f33-b498-29dc554894a6 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:53.631569 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ccc02b3-8011-4f33-b498-29dc554894a6 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:53.632501 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ccc02b3-8011-4f33-b498-29dc554894a6 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:53.633174 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ccc02b3-8011-4f33-b498-29dc554894a6 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:53.635964 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ccc02b3-8011-4f33-b498-29dc554894a6 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:53.710577 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ccc02b3-8011-4f33-b498-29dc554894a6 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:53.711343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ccc02b3-8011-4f33-b498-29dc554894a6 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:53.711886 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ccc02b3-8011-4f33-b498-29dc554894a6 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:53.712450 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-9ccc02b3-8011-4f33-b498-29dc554894a6 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lazy-loading 'fault' on Instance uuid 559c6087-5a37-455c-820e-3815be504495 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:01:53.970028 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e602d37a-6cb2-45e5-9a62-09649acd96f5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:53.970748 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e602d37a-6cb2-45e5-9a62-09649acd96f5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:53.973220 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=8 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:01:53.986531 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e602d37a-6cb2-45e5-9a62-09649acd96f5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:53.987034 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e602d37a-6cb2-45e5-9a62-09649acd96f5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:53.987506 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e602d37a-6cb2-45e5-9a62-09649acd96f5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:53.988227 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e602d37a-6cb2-45e5-9a62-09649acd96f5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:53.988692 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e602d37a-6cb2-45e5-9a62-09649acd96f5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:53.989124 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e602d37a-6cb2-45e5-9a62-09649acd96f5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:54.600419 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9ccc02b3-8011-4f33-b498-29dc554894a6 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb776df076341a8a5199fb7b3d08c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:54.610966 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9ccc02b3-8011-4f33-b498-29dc554894a6 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "GET /compute/v2.1/servers/559c6087-5a37-455c-820e-3815be504495" status: 200 len: 1312 microversion: 2.1 time: 1.002645 Sep 10 12:01:54.617667 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2306/4625] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:53 2022] GET /compute/v2.1/servers/559c6087-5a37-455c-820e-3815be504495 => generated 1312 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:01:54.650972 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-966b9dca-386f-4502-a7d1-d8bf181f3292 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:54.652398 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-966b9dca-386f-4502-a7d1-d8bf181f3292 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: c9e5a917-1b95-4d2b-9d1b-067bb36aa869] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:54.667753 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-966b9dca-386f-4502-a7d1-d8bf181f3292 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:54.668774 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-966b9dca-386f-4502-a7d1-d8bf181f3292 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:54.669413 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-966b9dca-386f-4502-a7d1-d8bf181f3292 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:54.670301 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-966b9dca-386f-4502-a7d1-d8bf181f3292 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:54.670923 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-966b9dca-386f-4502-a7d1-d8bf181f3292 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:54.671554 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-966b9dca-386f-4502-a7d1-d8bf181f3292 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:54.810414 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e602d37a-6cb2-45e5-9a62-09649acd96f5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:54.822106 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e602d37a-6cb2-45e5-9a62-09649acd96f5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1685 microversion: 2.1 time: 0.856005 Sep 10 12:01:54.851733 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2320/4626] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:53 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1685 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:01:55.084465 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-966b9dca-386f-4502-a7d1-d8bf181f3292 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:55.098251 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-966b9dca-386f-4502-a7d1-d8bf181f3292 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/c9e5a917-1b95-4d2b-9d1b-067bb36aa869" status: 200 len: 1292 microversion: 2.1 time: 0.458273 Sep 10 12:01:55.100981 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2307/4627] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:54 2022] GET /compute/v2.1/servers/c9e5a917-1b95-4d2b-9d1b-067bb36aa869 => generated 1292 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:55.664591 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-10cd334c-e80f-43a7-b2be-06182bfb94d3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:55.664591 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-10cd334c-e80f-43a7-b2be-06182bfb94d3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] [instance: 559c6087-5a37-455c-820e-3815be504495] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:55.664591 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-10cd334c-e80f-43a7-b2be-06182bfb94d3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:55.664591 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-10cd334c-e80f-43a7-b2be-06182bfb94d3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:55.664591 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-10cd334c-e80f-43a7-b2be-06182bfb94d3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:55.664591 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-10cd334c-e80f-43a7-b2be-06182bfb94d3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:55.664591 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-10cd334c-e80f-43a7-b2be-06182bfb94d3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:55.664591 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-10cd334c-e80f-43a7-b2be-06182bfb94d3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:55.744584 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-10cd334c-e80f-43a7-b2be-06182bfb94d3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] HTTP exception thrown: Instance 559c6087-5a37-455c-820e-3815be504495 could not be found. Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-10cd334c-e80f-43a7-b2be-06182bfb94d3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Request method failure captured: Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/559c6087-5a37-455c-820e-3815be504495 HTTP/1.1 Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHyH-JiQvM1nwSG6Az-qTmgsq6K4Vs2hJuTp8ENPR2zHb7tpjL_rSEqjngKH8PSHGsAfs_gSgdqNreqnDCT5_JLAfSGMzVTxhGmXrBhkO5nqm-5sj9uCkcWI5GfSUlxRpvgN3KVYoUNiATqNEGcSNg5Ssbk0WdhLu1n5zaGQuwOz3YA Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: ccab258aa40a4a8c8ec619480b35ad37 Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ListServersNegativeTestJSON-800505475 Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ccab258aa40a4a8c8ec619480b35ad37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ccab258aa40a4a8c8ec619480b35ad37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ccab258aa40a4a8c8ec619480b35ad37", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ccab258aa40a4a8c8ec619480b35ad37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ListServersNegativeTestJSON-800505475 Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: ccab258aa40a4a8c8ec619480b35ad37 Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-800505475 Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ListServersNegativeTestJSON-800505475-project Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: ccb776df076341a8a5199fb7b3d08c30 Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ListServersNegativeTestJSON-800505475-project Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 559c6087-5a37-455c-820e-3815be504495 could not be found. Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '559c6087-5a37-455c-820e-3815be504495'} Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 559c6087-5a37-455c-820e-3815be504495 could not be found. Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 559c6087-5a37-455c-820e-3815be504495 could not be found. Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:01:55.746759 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:01:55.751146 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:01:55.751146 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:01:55.751146 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:01:55.751146 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:01:55.751146 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:01:55.751146 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:01:55.751146 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 559c6087-5a37-455c-820e-3815be504495 could not be found. Sep 10 12:01:55.751146 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:01:55.755151 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-10cd334c-e80f-43a7-b2be-06182bfb94d3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Returning 404 to user: Instance 559c6087-5a37-455c-820e-3815be504495 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:01:55.756374 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-10cd334c-e80f-43a7-b2be-06182bfb94d3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "GET /compute/v2.1/servers/559c6087-5a37-455c-820e-3815be504495" status: 404 len: 111 microversion: 2.1 time: 0.115691 Sep 10 12:01:55.757168 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2321/4628] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:55 2022] GET /compute/v2.1/servers/559c6087-5a37-455c-820e-3815be504495 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:01:55.766635 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-12c43991-90a4-47b8-9c67-c43a86e48823 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:55.772331 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-12c43991-90a4-47b8-9c67-c43a86e48823 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ccb776df076341a8a5199fb7b3d08c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:55.776283 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-12c43991-90a4-47b8-9c67-c43a86e48823 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37'} {{(pid=128776) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 12:01:55.781186 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:01:55.784009 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-12c43991-90a4-47b8-9c67-c43a86e48823 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:55.796399 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-12c43991-90a4-47b8-9c67-c43a86e48823 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:55.796399 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-12c43991-90a4-47b8-9c67-c43a86e48823 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:55.796399 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-12c43991-90a4-47b8-9c67-c43a86e48823 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:55.808993 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-12c43991-90a4-47b8-9c67-c43a86e48823 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:55.815077 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-12c43991-90a4-47b8-9c67-c43a86e48823 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:55.855936 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2016ae2c-d5ae-4c07-99ae-b584f2581d36 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:55.857309 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2016ae2c-d5ae-4c07-99ae-b584f2581d36 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:55.879734 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2016ae2c-d5ae-4c07-99ae-b584f2581d36 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:55.890802 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2016ae2c-d5ae-4c07-99ae-b584f2581d36 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:55.891730 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2016ae2c-d5ae-4c07-99ae-b584f2581d36 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:55.892677 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2016ae2c-d5ae-4c07-99ae-b584f2581d36 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:55.897066 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2016ae2c-d5ae-4c07-99ae-b584f2581d36 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:55.902343 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2016ae2c-d5ae-4c07-99ae-b584f2581d36 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:56.646894 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2016ae2c-d5ae-4c07-99ae-b584f2581d36 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:56.658703 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2016ae2c-d5ae-4c07-99ae-b584f2581d36 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1685 microversion: 2.1 time: 0.806895 Sep 10 12:01:56.659339 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2322/4629] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:55 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1685 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:01:56.699724 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-31ccd49e-ede2-45d8-aa83-fd2682c443a2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:56.700345 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-31ccd49e-ede2-45d8-aa83-fd2682c443a2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: c9e5a917-1b95-4d2b-9d1b-067bb36aa869] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:56.727095 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-31ccd49e-ede2-45d8-aa83-fd2682c443a2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:56.735323 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-31ccd49e-ede2-45d8-aa83-fd2682c443a2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:56.736668 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-31ccd49e-ede2-45d8-aa83-fd2682c443a2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:56.737741 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-31ccd49e-ede2-45d8-aa83-fd2682c443a2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:56.738226 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-31ccd49e-ede2-45d8-aa83-fd2682c443a2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:56.738658 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-31ccd49e-ede2-45d8-aa83-fd2682c443a2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:56.846651 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-12c43991-90a4-47b8-9c67-c43a86e48823 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 1.082206 Sep 10 12:01:56.858015 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2308/4630] 10.222.0.23 () {58 vars in 1230 bytes} [Sat Sep 10 12:01:55 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 12:01:56.870717 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-19b7ebe0-6d39-4e04-81d0-d3a16569a3e2 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-19b7ebe0-6d39-4e04-81d0-d3a16569a3e2 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Request method failure captured: Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHyH-JiQvM1nwSG6Az-qTmgsq6K4Vs2hJuTp8ENPR2zHb7tpjL_rSEqjngKH8PSHGsAfs_gSgdqNreqnDCT5_JLAfSGMzVTxhGmXrBhkO5nqm-5sj9uCkcWI5GfSUlxRpvgN3KVYoUNiATqNEGcSNg5Ssbk0WdhLu1n5zaGQuwOz3YA Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: ccab258aa40a4a8c8ec619480b35ad37 Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ListServersNegativeTestJSON-800505475 Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ccab258aa40a4a8c8ec619480b35ad37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ccab258aa40a4a8c8ec619480b35ad37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ccab258aa40a4a8c8ec619480b35ad37", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ccab258aa40a4a8c8ec619480b35ad37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ListServersNegativeTestJSON-800505475 Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: ccab258aa40a4a8c8ec619480b35ad37 Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-800505475 Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ListServersNegativeTestJSON-800505475-project Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: ccb776df076341a8a5199fb7b3d08c30 Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ListServersNegativeTestJSON-800505475-project Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: action_args: {} Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise error Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi '2011/01/01' Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 10 12:01:56.893213 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 12:01:56.900818 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 12:01:56.900818 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 12:01:56.900818 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 12:01:56.900818 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 10 12:01:56.900818 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:01:56.900818 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:01:56.900818 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:01:56.900818 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:01:56.900818 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:01:56.900818 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:01:56.900818 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 12:01:56.900818 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 12:01:56.900818 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 10 12:01:56.900818 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:01:56.900818 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-19b7ebe0-6d39-4e04-81d0-d3a16569a3e2 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:01:56.900818 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-19b7ebe0-6d39-4e04-81d0-d3a16569a3e2 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.036197 Sep 10 12:01:56.904833 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2309/4631] 10.222.0.23 () {58 vars in 1182 bytes} [Sat Sep 10 12:01:56 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 12:01:56.919723 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f8ad45f6-97fb-4b96-8a16-3e519486da69 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:56.923007 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f8ad45f6-97fb-4b96-8a16-3e519486da69 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ccb776df076341a8a5199fb7b3d08c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:56.924915 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f8ad45f6-97fb-4b96-8a16-3e519486da69 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Searching by: {'deleted': False, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37'} {{(pid=128776) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 12:01:56.946157 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f8ad45f6-97fb-4b96-8a16-3e519486da69 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:56.946646 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f8ad45f6-97fb-4b96-8a16-3e519486da69 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:56.947091 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f8ad45f6-97fb-4b96-8a16-3e519486da69 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:56.947875 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f8ad45f6-97fb-4b96-8a16-3e519486da69 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:56.951483 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f8ad45f6-97fb-4b96-8a16-3e519486da69 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:56.952008 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f8ad45f6-97fb-4b96-8a16-3e519486da69 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:57.051111 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.multi_cell_list [None req-f8ad45f6-97fb-4b96-8a16-3e519486da69 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128776) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 12:01:57.129559 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f8ad45f6-97fb-4b96-8a16-3e519486da69 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.223471 Sep 10 12:01:57.139570 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2310/4632] 10.222.0.23 () {58 vars in 1125 bytes} [Sat Sep 10 12:01:56 2022] GET /compute/v2.1/servers => generated 681 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:01:57.151256 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f854d43b-56b3-490a-871d-985b101125b1 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:57.182538 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f854d43b-56b3-490a-871d-985b101125b1 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ccb776df076341a8a5199fb7b3d08c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:57.183769 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.compute.servers [None req-f854d43b-56b3-490a-871d-985b101125b1 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Removing options 'limit' from query {{(pid=128776) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 10 12:01:57.184942 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f854d43b-56b3-490a-871d-985b101125b1 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Searching by: {'deleted': False, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37'} {{(pid=128776) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 12:01:57.206878 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f854d43b-56b3-490a-871d-985b101125b1 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:57.207524 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f854d43b-56b3-490a-871d-985b101125b1 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:57.208219 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f854d43b-56b3-490a-871d-985b101125b1 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:57.210679 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f854d43b-56b3-490a-871d-985b101125b1 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:57.211480 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f854d43b-56b3-490a-871d-985b101125b1 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:57.212843 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f854d43b-56b3-490a-871d-985b101125b1 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:57.268844 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.multi_cell_list [None req-f854d43b-56b3-490a-871d-985b101125b1 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=128776) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 12:01:57.357840 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f854d43b-56b3-490a-871d-985b101125b1 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.217499 Sep 10 12:01:57.370920 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2311/4633] 10.222.0.23 () {58 vars in 1144 bytes} [Sat Sep 10 12:01:57 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:01:57.377287 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3f7cea21-5208-4de2-a499-104022a6b9df tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3f7cea21-5208-4de2-a499-104022a6b9df tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Request method failure captured: Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHyH-JiQvM1nwSG6Az-qTmgsq6K4Vs2hJuTp8ENPR2zHb7tpjL_rSEqjngKH8PSHGsAfs_gSgdqNreqnDCT5_JLAfSGMzVTxhGmXrBhkO5nqm-5sj9uCkcWI5GfSUlxRpvgN3KVYoUNiATqNEGcSNg5Ssbk0WdhLu1n5zaGQuwOz3YA Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: ccab258aa40a4a8c8ec619480b35ad37 Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ListServersNegativeTestJSON-800505475 Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ccab258aa40a4a8c8ec619480b35ad37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ccab258aa40a4a8c8ec619480b35ad37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ccab258aa40a4a8c8ec619480b35ad37", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ccab258aa40a4a8c8ec619480b35ad37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ListServersNegativeTestJSON-800505475 Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: ccab258aa40a4a8c8ec619480b35ad37 Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-800505475 Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ListServersNegativeTestJSON-800505475-project Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: ccb776df076341a8a5199fb7b3d08c30 Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ListServersNegativeTestJSON-800505475-project Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: action_args: {} Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise error Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi '-1' Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 10 12:01:57.387965 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 10 12:01:57.394627 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 12:01:57.394627 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 12:01:57.394627 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 12:01:57.394627 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 12:01:57.394627 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 10 12:01:57.394627 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:01:57.394627 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:01:57.394627 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:01:57.394627 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:01:57.394627 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:01:57.394627 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:01:57.394627 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 12:01:57.394627 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 12:01:57.394627 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 10 12:01:57.394627 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:01:57.394627 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3f7cea21-5208-4de2-a499-104022a6b9df tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:01:57.394627 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3f7cea21-5208-4de2-a499-104022a6b9df tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.019259 Sep 10 12:01:57.403511 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2312/4634] 10.222.0.23 () {58 vars in 1142 bytes} [Sat Sep 10 12:01:57 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 12:01:57.415997 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cf4e4291-7327-497b-a616-a27c921ccc23 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cf4e4291-7327-497b-a616-a27c921ccc23 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Request method failure captured: Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHyH-JiQvM1nwSG6Az-qTmgsq6K4Vs2hJuTp8ENPR2zHb7tpjL_rSEqjngKH8PSHGsAfs_gSgdqNreqnDCT5_JLAfSGMzVTxhGmXrBhkO5nqm-5sj9uCkcWI5GfSUlxRpvgN3KVYoUNiATqNEGcSNg5Ssbk0WdhLu1n5zaGQuwOz3YA Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: ccab258aa40a4a8c8ec619480b35ad37 Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ListServersNegativeTestJSON-800505475 Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ccab258aa40a4a8c8ec619480b35ad37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ccab258aa40a4a8c8ec619480b35ad37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ccab258aa40a4a8c8ec619480b35ad37", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ccab258aa40a4a8c8ec619480b35ad37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ListServersNegativeTestJSON-800505475 Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: ccab258aa40a4a8c8ec619480b35ad37 Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-800505475 Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ListServersNegativeTestJSON-800505475-project Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: ccb776df076341a8a5199fb7b3d08c30 Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ListServersNegativeTestJSON-800505475-project Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: action_args: {} Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise error Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'testing' Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 10 12:01:57.432156 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 10 12:01:57.436763 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 12:01:57.436763 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 12:01:57.436763 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 12:01:57.436763 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 12:01:57.436763 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 10 12:01:57.436763 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:01:57.436763 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:01:57.436763 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:01:57.436763 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:01:57.436763 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:01:57.436763 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:01:57.436763 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 12:01:57.436763 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 12:01:57.436763 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 10 12:01:57.436763 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:01:57.441224 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cf4e4291-7327-497b-a616-a27c921ccc23 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:01:57.441224 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cf4e4291-7327-497b-a616-a27c921ccc23 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.034570 Sep 10 12:01:57.453504 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2313/4635] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Sep 10 12:01:57 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 12:01:57.464745 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-87a9f69f-db9a-414b-a8da-2b81c12ef588 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:57.484342 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-87a9f69f-db9a-414b-a8da-2b81c12ef588 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ccb776df076341a8a5199fb7b3d08c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:57.485059 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-87a9f69f-db9a-414b-a8da-2b81c12ef588 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37'} {{(pid=128776) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 12:01:57.498808 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.compute.servers [None req-87a9f69f-db9a-414b-a8da-2b81c12ef588 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Flavor 'non_existing_flavor' could not be found {{(pid=128776) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Sep 10 12:01:57.503461 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-87a9f69f-db9a-414b-a8da-2b81c12ef588 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.046150 Sep 10 12:01:57.518333 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2314/4636] 10.222.0.23 () {58 vars in 1178 bytes} [Sat Sep 10 12:01:57 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 12:01:57.527986 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1fb9f3f7-9ce7-45a6-92fc-d350c91bb2d2 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:57.532929 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1fb9f3f7-9ce7-45a6-92fc-d350c91bb2d2 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ccb776df076341a8a5199fb7b3d08c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:57.533612 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1fb9f3f7-9ce7-45a6-92fc-d350c91bb2d2 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37'} {{(pid=128776) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 12:01:57.554776 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1fb9f3f7-9ce7-45a6-92fc-d350c91bb2d2 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:57.555325 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1fb9f3f7-9ce7-45a6-92fc-d350c91bb2d2 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:57.555726 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1fb9f3f7-9ce7-45a6-92fc-d350c91bb2d2 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:57.556446 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1fb9f3f7-9ce7-45a6-92fc-d350c91bb2d2 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:57.559419 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1fb9f3f7-9ce7-45a6-92fc-d350c91bb2d2 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:57.559934 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1fb9f3f7-9ce7-45a6-92fc-d350c91bb2d2 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:57.631332 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-31ccd49e-ede2-45d8-aa83-fd2682c443a2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:57.634315 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:01:57.648743 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-31ccd49e-ede2-45d8-aa83-fd2682c443a2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/c9e5a917-1b95-4d2b-9d1b-067bb36aa869" status: 200 len: 1292 microversion: 2.1 time: 0.961190 Sep 10 12:01:57.667748 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2323/4637] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:56 2022] GET /compute/v2.1/servers/c9e5a917-1b95-4d2b-9d1b-067bb36aa869 => generated 1292 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:57.686337 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ecd95742-6bdd-4747-8ff0-48030d379911 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:57.689007 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ecd95742-6bdd-4747-8ff0-48030d379911 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:57.718349 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ecd95742-6bdd-4747-8ff0-48030d379911 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:57.722158 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ecd95742-6bdd-4747-8ff0-48030d379911 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:57.722819 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ecd95742-6bdd-4747-8ff0-48030d379911 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:57.726633 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ecd95742-6bdd-4747-8ff0-48030d379911 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:57.727497 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ecd95742-6bdd-4747-8ff0-48030d379911 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:57.730020 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ecd95742-6bdd-4747-8ff0-48030d379911 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:57.799292 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1fb9f3f7-9ce7-45a6-92fc-d350c91bb2d2 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.279634 Sep 10 12:01:57.808864 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2315/4638] 10.222.0.23 () {58 vars in 1174 bytes} [Sat Sep 10 12:01:57 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 12:01:57.816869 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-38aa1d24-8f48-4971-bf68-284dbdc7e294 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:57.823883 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-38aa1d24-8f48-4971-bf68-284dbdc7e294 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ccb776df076341a8a5199fb7b3d08c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:57.829080 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-38aa1d24-8f48-4971-bf68-284dbdc7e294 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37'} {{(pid=128776) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 12:01:57.842314 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-38aa1d24-8f48-4971-bf68-284dbdc7e294 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:57.843588 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-38aa1d24-8f48-4971-bf68-284dbdc7e294 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:57.844827 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-38aa1d24-8f48-4971-bf68-284dbdc7e294 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:57.848543 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-38aa1d24-8f48-4971-bf68-284dbdc7e294 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:57.849152 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-38aa1d24-8f48-4971-bf68-284dbdc7e294 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:57.849737 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-38aa1d24-8f48-4971-bf68-284dbdc7e294 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:58.046543 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-38aa1d24-8f48-4971-bf68-284dbdc7e294 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.236096 Sep 10 12:01:58.047593 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2316/4639] 10.222.0.23 () {58 vars in 1184 bytes} [Sat Sep 10 12:01:57 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 10 12:01:58.061126 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-75bbbd7a-53ae-4b94-9c58-ad680b436aa2 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:58.079334 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-75bbbd7a-53ae-4b94-9c58-ad680b436aa2 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ccb776df076341a8a5199fb7b3d08c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:58.080883 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-75bbbd7a-53ae-4b94-9c58-ad680b436aa2 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Searching by: {'deleted': False, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37'} {{(pid=128776) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 12:01:58.087000 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75bbbd7a-53ae-4b94-9c58-ad680b436aa2 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:58.087659 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75bbbd7a-53ae-4b94-9c58-ad680b436aa2 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:58.088216 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75bbbd7a-53ae-4b94-9c58-ad680b436aa2 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:58.089065 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75bbbd7a-53ae-4b94-9c58-ad680b436aa2 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:58.089654 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75bbbd7a-53ae-4b94-9c58-ad680b436aa2 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:58.090413 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75bbbd7a-53ae-4b94-9c58-ad680b436aa2 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:58.148359 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.multi_cell_list [None req-75bbbd7a-53ae-4b94-9c58-ad680b436aa2 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128776) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 12:01:58.246358 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-75bbbd7a-53ae-4b94-9c58-ad680b436aa2 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb776df076341a8a5199fb7b3d08c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:58.265736 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75bbbd7a-53ae-4b94-9c58-ad680b436aa2 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:58.266233 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75bbbd7a-53ae-4b94-9c58-ad680b436aa2 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:58.266682 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75bbbd7a-53ae-4b94-9c58-ad680b436aa2 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:58.678778 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ecd95742-6bdd-4747-8ff0-48030d379911 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:58.695913 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ecd95742-6bdd-4747-8ff0-48030d379911 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1685 microversion: 2.1 time: 1.011112 Sep 10 12:01:58.712307 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2324/4640] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:57 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1685 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:58.732861 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-aedcc773-bbda-4b5b-94d6-b360cc44469d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:58.733509 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-aedcc773-bbda-4b5b-94d6-b360cc44469d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: c9e5a917-1b95-4d2b-9d1b-067bb36aa869] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:58.822891 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aedcc773-bbda-4b5b-94d6-b360cc44469d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:58.825706 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aedcc773-bbda-4b5b-94d6-b360cc44469d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:58.827354 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aedcc773-bbda-4b5b-94d6-b360cc44469d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:58.831605 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aedcc773-bbda-4b5b-94d6-b360cc44469d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:58.833686 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aedcc773-bbda-4b5b-94d6-b360cc44469d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:58.836864 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aedcc773-bbda-4b5b-94d6-b360cc44469d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:59.172020 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-75bbbd7a-53ae-4b94-9c58-ad680b436aa2 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 3019 microversion: 2.1 time: 1.114616 Sep 10 12:01:59.172965 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2317/4641] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 12:01:58 2022] GET /compute/v2.1/servers/detail => generated 3019 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:59.177644 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-884a945a-09f7-4f2e-bb5e-be8a0dfc92f8 req-9e3146e8-8276-403a-93bc-31fd75b6c237 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9e5a917-1b95-4d2b-9d1b-067bb36aa869", "name": "network-vif-plugged", "status": "completed", "tag": "4e1366da-1da3-49ce-9191-e53716ae9233"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:01:59.199403 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-884a945a-09f7-4f2e-bb5e-be8a0dfc92f8 req-9e3146e8-8276-403a-93bc-31fd75b6c237 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:59.199907 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-884a945a-09f7-4f2e-bb5e-be8a0dfc92f8 req-9e3146e8-8276-403a-93bc-31fd75b6c237 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:59.200359 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-884a945a-09f7-4f2e-bb5e-be8a0dfc92f8 req-9e3146e8-8276-403a-93bc-31fd75b6c237 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:59.232187 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-884a945a-09f7-4f2e-bb5e-be8a0dfc92f8 req-9e3146e8-8276-403a-93bc-31fd75b6c237 service nova] Creating event network-vif-plugged:4e1366da-1da3-49ce-9191-e53716ae9233 for instance c9e5a917-1b95-4d2b-9d1b-067bb36aa869 on n-h2-856895-1 Sep 10 12:01:59.253693 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-884a945a-09f7-4f2e-bb5e-be8a0dfc92f8 req-9e3146e8-8276-403a-93bc-31fd75b6c237 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079272 Sep 10 12:01:59.254990 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2318/4642] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:01:59.273162 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-16eb92a8-31ae-4471-8e04-9c23c53a71c0 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:59.311846 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-16eb92a8-31ae-4471-8e04-9c23c53a71c0 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ccb776df076341a8a5199fb7b3d08c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:59.326949 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-16eb92a8-31ae-4471-8e04-9c23c53a71c0 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.066995 Sep 10 12:01:59.339753 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2319/4643] 10.222.0.23 () {58 vars in 1178 bytes} [Sat Sep 10 12:01:59 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 12:01:59.345004 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-458a9ae0-d31b-461d-bc4d-4e1821cdf759 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:59.379740 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-458a9ae0-d31b-461d-bc4d-4e1821cdf759 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ccb776df076341a8a5199fb7b3d08c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:59.390766 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-458a9ae0-d31b-461d-bc4d-4e1821cdf759 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Searching by: {'deleted': False, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37'} {{(pid=128776) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 12:01:59.407023 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-458a9ae0-d31b-461d-bc4d-4e1821cdf759 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:59.414053 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-458a9ae0-d31b-461d-bc4d-4e1821cdf759 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:59.417048 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-458a9ae0-d31b-461d-bc4d-4e1821cdf759 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:59.420440 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-458a9ae0-d31b-461d-bc4d-4e1821cdf759 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:59.425826 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-458a9ae0-d31b-461d-bc4d-4e1821cdf759 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:59.426493 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-458a9ae0-d31b-461d-bc4d-4e1821cdf759 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:59.485929 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.multi_cell_list [None req-458a9ae0-d31b-461d-bc4d-4e1821cdf759 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128776) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 12:01:59.553238 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-458a9ae0-d31b-461d-bc4d-4e1821cdf759 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.211939 Sep 10 12:01:59.558502 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2320/4644] 10.222.0.23 () {58 vars in 1125 bytes} [Sat Sep 10 12:01:59 2022] GET /compute/v2.1/servers => generated 681 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:01:59.574325 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1949f28f-e1df-428d-95c7-76abcc1d5531 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:59.574959 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1949f28f-e1df-428d-95c7-76abcc1d5531 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] [instance: 559c6087-5a37-455c-820e-3815be504495] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:59.589951 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1949f28f-e1df-428d-95c7-76abcc1d5531 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:59.590492 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1949f28f-e1df-428d-95c7-76abcc1d5531 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:59.592128 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1949f28f-e1df-428d-95c7-76abcc1d5531 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:59.601220 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1949f28f-e1df-428d-95c7-76abcc1d5531 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:59.601999 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1949f28f-e1df-428d-95c7-76abcc1d5531 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:59.602626 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1949f28f-e1df-428d-95c7-76abcc1d5531 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:59.642815 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-1949f28f-e1df-428d-95c7-76abcc1d5531 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] HTTP exception thrown: Instance 559c6087-5a37-455c-820e-3815be504495 could not be found. Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1949f28f-e1df-428d-95c7-76abcc1d5531 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Request method failure captured: Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/servers/559c6087-5a37-455c-820e-3815be504495 HTTP/1.1 Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHyH-JiQvM1nwSG6Az-qTmgsq6K4Vs2hJuTp8ENPR2zHb7tpjL_rSEqjngKH8PSHGsAfs_gSgdqNreqnDCT5_JLAfSGMzVTxhGmXrBhkO5nqm-5sj9uCkcWI5GfSUlxRpvgN3KVYoUNiATqNEGcSNg5Ssbk0WdhLu1n5zaGQuwOz3YA Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: ccab258aa40a4a8c8ec619480b35ad37 Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ListServersNegativeTestJSON-800505475 Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ccab258aa40a4a8c8ec619480b35ad37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ccab258aa40a4a8c8ec619480b35ad37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ccab258aa40a4a8c8ec619480b35ad37", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ccab258aa40a4a8c8ec619480b35ad37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ListServersNegativeTestJSON-800505475 Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: ccab258aa40a4a8c8ec619480b35ad37 Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-800505475 Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ListServersNegativeTestJSON-800505475-project Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: ccb776df076341a8a5199fb7b3d08c30 Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ListServersNegativeTestJSON-800505475-project Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 559c6087-5a37-455c-820e-3815be504495 could not be found. Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '559c6087-5a37-455c-820e-3815be504495'} Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 559c6087-5a37-455c-820e-3815be504495 could not be found. Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:01:59.647482 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:01:59.652331 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 559c6087-5a37-455c-820e-3815be504495 could not be found. Sep 10 12:01:59.652331 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:01:59.652331 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:01:59.652331 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:01:59.652331 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:01:59.652331 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:01:59.652331 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:01:59.652331 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:01:59.652331 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:01:59.652331 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 559c6087-5a37-455c-820e-3815be504495 could not be found. Sep 10 12:01:59.652331 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:01:59.654692 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1949f28f-e1df-428d-95c7-76abcc1d5531 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Returning 404 to user: Instance 559c6087-5a37-455c-820e-3815be504495 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:01:59.664040 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1949f28f-e1df-428d-95c7-76abcc1d5531 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "DELETE /compute/v2.1/servers/559c6087-5a37-455c-820e-3815be504495" status: 404 len: 111 microversion: 2.1 time: 0.094154 Sep 10 12:01:59.665242 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2321/4645] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:01:59 2022] DELETE /compute/v2.1/servers/559c6087-5a37-455c-820e-3815be504495 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:01:59.672754 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-721344ae-e7eb-4f87-866a-65d415c8ab94 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:59.674048 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-721344ae-e7eb-4f87-866a-65d415c8ab94 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] [instance: fbe1a0db-64e5-43c0-b32e-38cf084525d9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:59.690867 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-721344ae-e7eb-4f87-866a-65d415c8ab94 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:59.691410 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-721344ae-e7eb-4f87-866a-65d415c8ab94 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:59.691861 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-721344ae-e7eb-4f87-866a-65d415c8ab94 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:59.692593 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-721344ae-e7eb-4f87-866a-65d415c8ab94 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:59.693033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-721344ae-e7eb-4f87-866a-65d415c8ab94 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:59.693465 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-721344ae-e7eb-4f87-866a-65d415c8ab94 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:59.783947 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-721344ae-e7eb-4f87-866a-65d415c8ab94 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] [instance: fbe1a0db-64e5-43c0-b32e-38cf084525d9] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:01:59.900286 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-721344ae-e7eb-4f87-866a-65d415c8ab94 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fbe1a0db-64e5-43c0-b32e-38cf084525d9" status: 204 len: 0 microversion: 2.1 time: 0.231007 Sep 10 12:01:59.902639 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2322/4646] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:01:59 2022] DELETE /compute/v2.1/servers/fbe1a0db-64e5-43c0-b32e-38cf084525d9 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:01:59.911432 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f3b45060-3752-43af-8dc8-ec7b35809cec tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:01:59.915828 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f3b45060-3752-43af-8dc8-ec7b35809cec tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:01:59.924636 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3b45060-3752-43af-8dc8-ec7b35809cec tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:59.933763 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3b45060-3752-43af-8dc8-ec7b35809cec tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:59.935147 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3b45060-3752-43af-8dc8-ec7b35809cec tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:59.936197 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3b45060-3752-43af-8dc8-ec7b35809cec tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:01:59.937115 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3b45060-3752-43af-8dc8-ec7b35809cec tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:01:59.939256 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3b45060-3752-43af-8dc8-ec7b35809cec tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:01:59.971063 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-aedcc773-bbda-4b5b-94d6-b360cc44469d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:01:59.981409 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-aedcc773-bbda-4b5b-94d6-b360cc44469d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/c9e5a917-1b95-4d2b-9d1b-067bb36aa869" status: 200 len: 1292 microversion: 2.1 time: 1.266592 Sep 10 12:01:59.982007 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2325/4647] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:58 2022] GET /compute/v2.1/servers/c9e5a917-1b95-4d2b-9d1b-067bb36aa869 => generated 1292 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:01:59.998577 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-45fe0f02-7fb1-4a3a-ace1-d04af6a57ace tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:00.003774 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-45fe0f02-7fb1-4a3a-ace1-d04af6a57ace tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] [instance: 39ab672e-8334-4fc2-b645-bfb1f7631064] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:00.032729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-45fe0f02-7fb1-4a3a-ace1-d04af6a57ace tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:00.033328 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-45fe0f02-7fb1-4a3a-ace1-d04af6a57ace tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:00.033851 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-45fe0f02-7fb1-4a3a-ace1-d04af6a57ace tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:00.034708 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-45fe0f02-7fb1-4a3a-ace1-d04af6a57ace tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:00.035208 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-45fe0f02-7fb1-4a3a-ace1-d04af6a57ace tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:00.036684 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-45fe0f02-7fb1-4a3a-ace1-d04af6a57ace tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:00.122185 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-45fe0f02-7fb1-4a3a-ace1-d04af6a57ace tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] [instance: 39ab672e-8334-4fc2-b645-bfb1f7631064] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:02:00.349603 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-45fe0f02-7fb1-4a3a-ace1-d04af6a57ace tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "DELETE /compute/v2.1/servers/39ab672e-8334-4fc2-b645-bfb1f7631064" status: 204 len: 0 microversion: 2.1 time: 0.354824 Sep 10 12:02:00.352838 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2326/4648] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:01:59 2022] DELETE /compute/v2.1/servers/39ab672e-8334-4fc2-b645-bfb1f7631064 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:02:00.374759 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ae049bcf-cdb1-4506-95fe-827c046133b3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:00.377733 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ae049bcf-cdb1-4506-95fe-827c046133b3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] [instance: 559c6087-5a37-455c-820e-3815be504495] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:00.404630 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae049bcf-cdb1-4506-95fe-827c046133b3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:00.406912 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae049bcf-cdb1-4506-95fe-827c046133b3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:00.407902 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae049bcf-cdb1-4506-95fe-827c046133b3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:00.409118 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae049bcf-cdb1-4506-95fe-827c046133b3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:00.417232 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae049bcf-cdb1-4506-95fe-827c046133b3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:00.418021 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae049bcf-cdb1-4506-95fe-827c046133b3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:00.445968 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-ae049bcf-cdb1-4506-95fe-827c046133b3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] HTTP exception thrown: Instance 559c6087-5a37-455c-820e-3815be504495 could not be found. Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ae049bcf-cdb1-4506-95fe-827c046133b3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Request method failure captured: Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/559c6087-5a37-455c-820e-3815be504495 HTTP/1.1 Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHyH-JiQvM1nwSG6Az-qTmgsq6K4Vs2hJuTp8ENPR2zHb7tpjL_rSEqjngKH8PSHGsAfs_gSgdqNreqnDCT5_JLAfSGMzVTxhGmXrBhkO5nqm-5sj9uCkcWI5GfSUlxRpvgN3KVYoUNiATqNEGcSNg5Ssbk0WdhLu1n5zaGQuwOz3YA Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: ccab258aa40a4a8c8ec619480b35ad37 Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ListServersNegativeTestJSON-800505475 Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ccab258aa40a4a8c8ec619480b35ad37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ccab258aa40a4a8c8ec619480b35ad37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ccab258aa40a4a8c8ec619480b35ad37", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ccab258aa40a4a8c8ec619480b35ad37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ListServersNegativeTestJSON-800505475 Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: ccab258aa40a4a8c8ec619480b35ad37 Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-800505475 Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ListServersNegativeTestJSON-800505475-project Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: ccb776df076341a8a5199fb7b3d08c30 Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ListServersNegativeTestJSON-800505475-project Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 559c6087-5a37-455c-820e-3815be504495 could not be found. Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '559c6087-5a37-455c-820e-3815be504495'} Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 559c6087-5a37-455c-820e-3815be504495 could not be found. Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 559c6087-5a37-455c-820e-3815be504495 could not be found. Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:02:00.450941 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:02:00.455038 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:02:00.455038 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:02:00.455038 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:02:00.455038 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:02:00.455038 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:02:00.455038 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:02:00.455038 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 559c6087-5a37-455c-820e-3815be504495 could not be found. Sep 10 12:02:00.455038 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:02:00.460127 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ae049bcf-cdb1-4506-95fe-827c046133b3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Returning 404 to user: Instance 559c6087-5a37-455c-820e-3815be504495 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:02:00.464024 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ae049bcf-cdb1-4506-95fe-827c046133b3 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "GET /compute/v2.1/servers/559c6087-5a37-455c-820e-3815be504495" status: 404 len: 111 microversion: 2.1 time: 0.105408 Sep 10 12:02:00.467484 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2327/4649] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:00 2022] GET /compute/v2.1/servers/559c6087-5a37-455c-820e-3815be504495 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:02:00.477289 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e08d32ed-cdbd-4ece-ad0a-1f72b77dcb37 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:00.479277 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e08d32ed-cdbd-4ece-ad0a-1f72b77dcb37 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] [instance: fbe1a0db-64e5-43c0-b32e-38cf084525d9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:00.500493 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e08d32ed-cdbd-4ece-ad0a-1f72b77dcb37 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:00.500966 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e08d32ed-cdbd-4ece-ad0a-1f72b77dcb37 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:00.509367 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e08d32ed-cdbd-4ece-ad0a-1f72b77dcb37 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:00.510157 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e08d32ed-cdbd-4ece-ad0a-1f72b77dcb37 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:00.516014 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e08d32ed-cdbd-4ece-ad0a-1f72b77dcb37 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:00.516590 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e08d32ed-cdbd-4ece-ad0a-1f72b77dcb37 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:01.046212 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f3b45060-3752-43af-8dc8-ec7b35809cec tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:01.050692 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:02:01.070890 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f3b45060-3752-43af-8dc8-ec7b35809cec tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1685 microversion: 2.1 time: 1.166683 Sep 10 12:02:01.076286 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2323/4650] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:01:59 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1685 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:01.087050 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-13160605-4b47-405b-aacf-aeb929edb1fe tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:01.088144 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-13160605-4b47-405b-aacf-aeb929edb1fe tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: c9e5a917-1b95-4d2b-9d1b-067bb36aa869] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:01.119311 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13160605-4b47-405b-aacf-aeb929edb1fe tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:01.125953 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13160605-4b47-405b-aacf-aeb929edb1fe tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:01.126744 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13160605-4b47-405b-aacf-aeb929edb1fe tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:01.127264 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13160605-4b47-405b-aacf-aeb929edb1fe tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:01.127865 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13160605-4b47-405b-aacf-aeb929edb1fe tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:01.128306 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13160605-4b47-405b-aacf-aeb929edb1fe tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:02.229773 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e08d32ed-cdbd-4ece-ad0a-1f72b77dcb37 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb776df076341a8a5199fb7b3d08c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:02.260603 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e08d32ed-cdbd-4ece-ad0a-1f72b77dcb37 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "GET /compute/v2.1/servers/fbe1a0db-64e5-43c0-b32e-38cf084525d9" status: 200 len: 1519 microversion: 2.1 time: 1.791213 Sep 10 12:02:02.278586 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2328/4651] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:00 2022] GET /compute/v2.1/servers/fbe1a0db-64e5-43c0-b32e-38cf084525d9 => generated 1519 bytes in 1805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:02.300686 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cff22965-27b1-4cb3-9265-d916522e3496 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:02.304929 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cff22965-27b1-4cb3-9265-d916522e3496 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:02.325754 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cff22965-27b1-4cb3-9265-d916522e3496 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:02.327109 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cff22965-27b1-4cb3-9265-d916522e3496 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:02.328104 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cff22965-27b1-4cb3-9265-d916522e3496 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:02.333251 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cff22965-27b1-4cb3-9265-d916522e3496 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:02.333746 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cff22965-27b1-4cb3-9265-d916522e3496 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:02.336537 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cff22965-27b1-4cb3-9265-d916522e3496 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:02.770475 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-13160605-4b47-405b-aacf-aeb929edb1fe tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:02.792568 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-13160605-4b47-405b-aacf-aeb929edb1fe tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/c9e5a917-1b95-4d2b-9d1b-067bb36aa869" status: 200 len: 1292 microversion: 2.1 time: 1.714707 Sep 10 12:02:02.795926 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2324/4652] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:01 2022] GET /compute/v2.1/servers/c9e5a917-1b95-4d2b-9d1b-067bb36aa869 => generated 1292 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:02.874107 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-115b4deb-1cca-4095-bdf8-007b7e5ae841 req-3e77d615-4576-41fb-af74-034625c20b9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbe1a0db-64e5-43c0-b32e-38cf084525d9", "name": "network-vif-deleted", "tag": "93edc3cf-a9a1-40eb-a206-3fc7e191ebad"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:02:02.910553 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-115b4deb-1cca-4095-bdf8-007b7e5ae841 req-3e77d615-4576-41fb-af74-034625c20b9a service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:02.912429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-115b4deb-1cca-4095-bdf8-007b7e5ae841 req-3e77d615-4576-41fb-af74-034625c20b9a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:02.912429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-115b4deb-1cca-4095-bdf8-007b7e5ae841 req-3e77d615-4576-41fb-af74-034625c20b9a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:02.934805 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-115b4deb-1cca-4095-bdf8-007b7e5ae841 req-3e77d615-4576-41fb-af74-034625c20b9a service nova] Creating event network-vif-deleted:93edc3cf-a9a1-40eb-a206-3fc7e191ebad for instance fbe1a0db-64e5-43c0-b32e-38cf084525d9 on n-h1-856895-1 Sep 10 12:02:02.950242 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-115b4deb-1cca-4095-bdf8-007b7e5ae841 req-3e77d615-4576-41fb-af74-034625c20b9a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079985 Sep 10 12:02:02.954799 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2325/4653] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:02:03.287784 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ec1d9b53-b148-4854-85a1-ec77dec63a76 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:03.288947 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ec1d9b53-b148-4854-85a1-ec77dec63a76 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] [instance: fbe1a0db-64e5-43c0-b32e-38cf084525d9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:03.306622 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec1d9b53-b148-4854-85a1-ec77dec63a76 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:03.310678 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec1d9b53-b148-4854-85a1-ec77dec63a76 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:03.311464 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec1d9b53-b148-4854-85a1-ec77dec63a76 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:03.315296 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec1d9b53-b148-4854-85a1-ec77dec63a76 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:03.318135 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec1d9b53-b148-4854-85a1-ec77dec63a76 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:03.324125 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec1d9b53-b148-4854-85a1-ec77dec63a76 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:03.389609 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec1d9b53-b148-4854-85a1-ec77dec63a76 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:03.390490 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec1d9b53-b148-4854-85a1-ec77dec63a76 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:03.391380 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec1d9b53-b148-4854-85a1-ec77dec63a76 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:03.392889 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-ec1d9b53-b148-4854-85a1-ec77dec63a76 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lazy-loading 'fault' on Instance uuid fbe1a0db-64e5-43c0-b32e-38cf084525d9 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:02:03.731095 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ec1d9b53-b148-4854-85a1-ec77dec63a76 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb776df076341a8a5199fb7b3d08c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:03.747680 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ec1d9b53-b148-4854-85a1-ec77dec63a76 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "GET /compute/v2.1/servers/fbe1a0db-64e5-43c0-b32e-38cf084525d9" status: 200 len: 1312 microversion: 2.1 time: 0.464402 Sep 10 12:02:03.749915 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2326/4654] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:03 2022] GET /compute/v2.1/servers/fbe1a0db-64e5-43c0-b32e-38cf084525d9 => generated 1312 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:03.820395 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3651d047-3b40-482d-b3d6-f182afc0b00d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:03.822813 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3651d047-3b40-482d-b3d6-f182afc0b00d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: c9e5a917-1b95-4d2b-9d1b-067bb36aa869] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:03.837593 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3651d047-3b40-482d-b3d6-f182afc0b00d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:03.838662 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3651d047-3b40-482d-b3d6-f182afc0b00d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:03.839835 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3651d047-3b40-482d-b3d6-f182afc0b00d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:03.843314 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3651d047-3b40-482d-b3d6-f182afc0b00d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:03.845110 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3651d047-3b40-482d-b3d6-f182afc0b00d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:03.846557 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3651d047-3b40-482d-b3d6-f182afc0b00d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:04.056313 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cff22965-27b1-4cb3-9265-d916522e3496 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:04.072679 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cff22965-27b1-4cb3-9265-d916522e3496 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1685 microversion: 2.1 time: 1.793702 Sep 10 12:02:04.076226 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2329/4655] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:02 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1685 bytes in 1798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:04.156681 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-60977539-19e1-4224-86bf-28204eb7b808 req-7ca7cf5b-c335-4f21-8584-91088cc962b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39ab672e-8334-4fc2-b645-bfb1f7631064", "name": "network-vif-unplugged", "status": "completed", "tag": "1bee300c-d638-40cf-92a1-82dfddf6ebd1"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:02:04.202897 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-60977539-19e1-4224-86bf-28204eb7b808 req-7ca7cf5b-c335-4f21-8584-91088cc962b6 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:04.209060 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-60977539-19e1-4224-86bf-28204eb7b808 req-7ca7cf5b-c335-4f21-8584-91088cc962b6 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:04.212673 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-60977539-19e1-4224-86bf-28204eb7b808 req-7ca7cf5b-c335-4f21-8584-91088cc962b6 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:04.266561 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-60977539-19e1-4224-86bf-28204eb7b808 req-7ca7cf5b-c335-4f21-8584-91088cc962b6 service nova] Creating event network-vif-unplugged:1bee300c-d638-40cf-92a1-82dfddf6ebd1 for instance 39ab672e-8334-4fc2-b645-bfb1f7631064 on n-h2-856895-1 Sep 10 12:02:04.280843 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-60977539-19e1-4224-86bf-28204eb7b808 req-7ca7cf5b-c335-4f21-8584-91088cc962b6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.126631 Sep 10 12:02:04.284523 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2330/4656] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:02:04.508000 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3651d047-3b40-482d-b3d6-f182afc0b00d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:04.640793 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3651d047-3b40-482d-b3d6-f182afc0b00d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/c9e5a917-1b95-4d2b-9d1b-067bb36aa869" status: 200 len: 1473 microversion: 2.1 time: 0.817383 Sep 10 12:02:04.643074 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2327/4657] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:03 2022] GET /compute/v2.1/servers/c9e5a917-1b95-4d2b-9d1b-067bb36aa869 => generated 1473 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:02:04.787181 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2fe29a53-dcbb-4e2e-a503-9038c5858267 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:04.790107 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2fe29a53-dcbb-4e2e-a503-9038c5858267 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] [instance: fbe1a0db-64e5-43c0-b32e-38cf084525d9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:04.807709 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fe29a53-dcbb-4e2e-a503-9038c5858267 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:04.812881 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fe29a53-dcbb-4e2e-a503-9038c5858267 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:04.818855 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fe29a53-dcbb-4e2e-a503-9038c5858267 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:04.823440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fe29a53-dcbb-4e2e-a503-9038c5858267 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:04.826796 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fe29a53-dcbb-4e2e-a503-9038c5858267 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:04.827525 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fe29a53-dcbb-4e2e-a503-9038c5858267 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:04.889103 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-2fe29a53-dcbb-4e2e-a503-9038c5858267 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] HTTP exception thrown: Instance fbe1a0db-64e5-43c0-b32e-38cf084525d9 could not be found. Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2fe29a53-dcbb-4e2e-a503-9038c5858267 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Request method failure captured: Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/fbe1a0db-64e5-43c0-b32e-38cf084525d9 HTTP/1.1 Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHyH-JiQvM1nwSG6Az-qTmgsq6K4Vs2hJuTp8ENPR2zHb7tpjL_rSEqjngKH8PSHGsAfs_gSgdqNreqnDCT5_JLAfSGMzVTxhGmXrBhkO5nqm-5sj9uCkcWI5GfSUlxRpvgN3KVYoUNiATqNEGcSNg5Ssbk0WdhLu1n5zaGQuwOz3YA Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: ccab258aa40a4a8c8ec619480b35ad37 Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ListServersNegativeTestJSON-800505475 Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ccab258aa40a4a8c8ec619480b35ad37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ccab258aa40a4a8c8ec619480b35ad37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ccab258aa40a4a8c8ec619480b35ad37", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ccab258aa40a4a8c8ec619480b35ad37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ListServersNegativeTestJSON-800505475 Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: ccab258aa40a4a8c8ec619480b35ad37 Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-800505475 Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ListServersNegativeTestJSON-800505475-project Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: ccb776df076341a8a5199fb7b3d08c30 Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ListServersNegativeTestJSON-800505475-project Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance fbe1a0db-64e5-43c0-b32e-38cf084525d9 could not be found. Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'fbe1a0db-64e5-43c0-b32e-38cf084525d9'} Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbe1a0db-64e5-43c0-b32e-38cf084525d9 could not be found. Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbe1a0db-64e5-43c0-b32e-38cf084525d9 could not be found. Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:02:04.893528 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:02:04.899663 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:02:04.899663 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:02:04.899663 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:02:04.899663 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:02:04.899663 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:02:04.899663 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:02:04.899663 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbe1a0db-64e5-43c0-b32e-38cf084525d9 could not be found. Sep 10 12:02:04.899663 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:02:04.902048 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2fe29a53-dcbb-4e2e-a503-9038c5858267 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Returning 404 to user: Instance fbe1a0db-64e5-43c0-b32e-38cf084525d9 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:02:04.903779 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2fe29a53-dcbb-4e2e-a503-9038c5858267 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "GET /compute/v2.1/servers/fbe1a0db-64e5-43c0-b32e-38cf084525d9" status: 404 len: 111 microversion: 2.1 time: 0.129570 Sep 10 12:02:04.905198 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2331/4658] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:04 2022] GET /compute/v2.1/servers/fbe1a0db-64e5-43c0-b32e-38cf084525d9 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 12:02:04.915778 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b3130602-d584-4ad8-b45d-f1da332bb56d tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:04.922094 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b3130602-d584-4ad8-b45d-f1da332bb56d tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] [instance: 39ab672e-8334-4fc2-b645-bfb1f7631064] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:04.932383 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b3130602-d584-4ad8-b45d-f1da332bb56d tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:04.933167 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b3130602-d584-4ad8-b45d-f1da332bb56d tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:04.934067 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b3130602-d584-4ad8-b45d-f1da332bb56d tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:04.935116 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b3130602-d584-4ad8-b45d-f1da332bb56d tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:04.935777 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b3130602-d584-4ad8-b45d-f1da332bb56d tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:04.936381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b3130602-d584-4ad8-b45d-f1da332bb56d tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:04.960466 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-27ed17df-275b-46a0-a7b5-b5605813cf98 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-826716891", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:02:05.072627 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-27ed17df-275b-46a0-a7b5-b5605813cf98 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] validate_networks() for [('5a10f3ce-b3db-41f2-acaa-21e8715e6fe6', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:02:05.342092 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b3130602-d584-4ad8-b45d-f1da332bb56d tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccb776df076341a8a5199fb7b3d08c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccab258aa40a4a8c8ec619480b35ad37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:05.353741 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b3130602-d584-4ad8-b45d-f1da332bb56d tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "GET /compute/v2.1/servers/39ab672e-8334-4fc2-b645-bfb1f7631064" status: 200 len: 1477 microversion: 2.1 time: 0.443910 Sep 10 12:02:05.355144 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2328/4659] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:04 2022] GET /compute/v2.1/servers/39ab672e-8334-4fc2-b645-bfb1f7631064 => generated 1477 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:05.364501 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f1eafbe9-152d-45bb-802d-8e2bd9a8519c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:05.365583 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f1eafbe9-152d-45bb-802d-8e2bd9a8519c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:05.381972 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1eafbe9-152d-45bb-802d-8e2bd9a8519c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:05.383720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1eafbe9-152d-45bb-802d-8e2bd9a8519c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:05.384436 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1eafbe9-152d-45bb-802d-8e2bd9a8519c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:05.385476 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1eafbe9-152d-45bb-802d-8e2bd9a8519c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:05.386176 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1eafbe9-152d-45bb-802d-8e2bd9a8519c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:05.386847 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1eafbe9-152d-45bb-802d-8e2bd9a8519c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:06.765270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f1eafbe9-152d-45bb-802d-8e2bd9a8519c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:06.787856 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f1eafbe9-152d-45bb-802d-8e2bd9a8519c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1685 microversion: 2.1 time: 1.422772 Sep 10 12:02:06.789167 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2329/4660] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:05 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1685 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:06.819290 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-1db258ad-16fe-43c0-a2cf-f3999ac4e6e7 req-d52d2fd4-4eb3-4e7a-bfdf-a84ecd233a44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39ab672e-8334-4fc2-b645-bfb1f7631064", "name": "network-vif-deleted", "tag": "1bee300c-d638-40cf-92a1-82dfddf6ebd1"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:02:06.829244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-1db258ad-16fe-43c0-a2cf-f3999ac4e6e7 req-d52d2fd4-4eb3-4e7a-bfdf-a84ecd233a44 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:06.830016 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-1db258ad-16fe-43c0-a2cf-f3999ac4e6e7 req-d52d2fd4-4eb3-4e7a-bfdf-a84ecd233a44 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:06.836122 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-1db258ad-16fe-43c0-a2cf-f3999ac4e6e7 req-d52d2fd4-4eb3-4e7a-bfdf-a84ecd233a44 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:06.859282 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-1db258ad-16fe-43c0-a2cf-f3999ac4e6e7 req-d52d2fd4-4eb3-4e7a-bfdf-a84ecd233a44 service nova] Creating event network-vif-deleted:1bee300c-d638-40cf-92a1-82dfddf6ebd1 for instance 39ab672e-8334-4fc2-b645-bfb1f7631064 on n-h2-856895-1 Sep 10 12:02:06.868960 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-1db258ad-16fe-43c0-a2cf-f3999ac4e6e7 req-d52d2fd4-4eb3-4e7a-bfdf-a84ecd233a44 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078427 Sep 10 12:02:06.871747 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2330/4661] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:02:06.882503 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a27a5d76-a43b-4895-a66b-6d364e21c4d5 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:06.890633 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a27a5d76-a43b-4895-a66b-6d364e21c4d5 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] [instance: 39ab672e-8334-4fc2-b645-bfb1f7631064] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:06.906324 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a27a5d76-a43b-4895-a66b-6d364e21c4d5 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:06.908692 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a27a5d76-a43b-4895-a66b-6d364e21c4d5 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:06.910478 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a27a5d76-a43b-4895-a66b-6d364e21c4d5 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:06.913724 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a27a5d76-a43b-4895-a66b-6d364e21c4d5 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:06.914390 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a27a5d76-a43b-4895-a66b-6d364e21c4d5 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:06.914990 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a27a5d76-a43b-4895-a66b-6d364e21c4d5 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:06.940498 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-a27a5d76-a43b-4895-a66b-6d364e21c4d5 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] HTTP exception thrown: Instance 39ab672e-8334-4fc2-b645-bfb1f7631064 could not be found. Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a27a5d76-a43b-4895-a66b-6d364e21c4d5 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Request method failure captured: Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/39ab672e-8334-4fc2-b645-bfb1f7631064 HTTP/1.1 Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHyH-JiQvM1nwSG6Az-qTmgsq6K4Vs2hJuTp8ENPR2zHb7tpjL_rSEqjngKH8PSHGsAfs_gSgdqNreqnDCT5_JLAfSGMzVTxhGmXrBhkO5nqm-5sj9uCkcWI5GfSUlxRpvgN3KVYoUNiATqNEGcSNg5Ssbk0WdhLu1n5zaGQuwOz3YA Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: ccab258aa40a4a8c8ec619480b35ad37 Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ListServersNegativeTestJSON-800505475 Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ccab258aa40a4a8c8ec619480b35ad37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ccab258aa40a4a8c8ec619480b35ad37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ccab258aa40a4a8c8ec619480b35ad37", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ccab258aa40a4a8c8ec619480b35ad37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ListServersNegativeTestJSON-800505475 Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: ccab258aa40a4a8c8ec619480b35ad37 Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-800505475 Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ListServersNegativeTestJSON-800505475-project Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: ccb776df076341a8a5199fb7b3d08c30 Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ListServersNegativeTestJSON-800505475-project Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 39ab672e-8334-4fc2-b645-bfb1f7631064 could not be found. Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '39ab672e-8334-4fc2-b645-bfb1f7631064'} Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39ab672e-8334-4fc2-b645-bfb1f7631064 could not be found. Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39ab672e-8334-4fc2-b645-bfb1f7631064 could not be found. Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:02:06.953206 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:02:06.957506 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:02:06.957506 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:02:06.957506 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:02:06.957506 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:02:06.957506 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:02:06.957506 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:02:06.957506 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39ab672e-8334-4fc2-b645-bfb1f7631064 could not be found. Sep 10 12:02:06.957506 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:02:06.959278 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a27a5d76-a43b-4895-a66b-6d364e21c4d5 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] Returning 404 to user: Instance 39ab672e-8334-4fc2-b645-bfb1f7631064 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:02:06.960377 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a27a5d76-a43b-4895-a66b-6d364e21c4d5 tempest-ListServersNegativeTestJSON-800505475 tempest-ListServersNegativeTestJSON-800505475-project] 10.222.0.23 "GET /compute/v2.1/servers/39ab672e-8334-4fc2-b645-bfb1f7631064" status: 404 len: 111 microversion: 2.1 time: 0.087312 Sep 10 12:02:06.961164 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2331/4662] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:06 2022] GET /compute/v2.1/servers/39ab672e-8334-4fc2-b645-bfb1f7631064 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:02:07.812185 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5fa09016-5003-4764-840b-aef61c72ef22 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:07.816019 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5fa09016-5003-4764-840b-aef61c72ef22 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:07.835485 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5fa09016-5003-4764-840b-aef61c72ef22 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:07.835988 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5fa09016-5003-4764-840b-aef61c72ef22 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:07.836440 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5fa09016-5003-4764-840b-aef61c72ef22 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:07.837170 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5fa09016-5003-4764-840b-aef61c72ef22 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:07.837639 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5fa09016-5003-4764-840b-aef61c72ef22 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:07.838069 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5fa09016-5003-4764-840b-aef61c72ef22 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:08.244893 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:02:08.848472 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-27ed17df-275b-46a0-a7b5-b5605813cf98 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:02:08.849065 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-27ed17df-275b-46a0-a7b5-b5605813cf98 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:02:08.849679 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-27ed17df-275b-46a0-a7b5-b5605813cf98 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:02:08.850560 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-27ed17df-275b-46a0-a7b5-b5605813cf98 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:02:08.850560 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-27ed17df-275b-46a0-a7b5-b5605813cf98 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:02:08.880455 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-27ed17df-275b-46a0-a7b5-b5605813cf98 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:08.881995 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-27ed17df-275b-46a0-a7b5-b5605813cf98 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:08.883140 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-27ed17df-275b-46a0-a7b5-b5605813cf98 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:08.885911 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-27ed17df-275b-46a0-a7b5-b5605813cf98 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:08.888458 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-27ed17df-275b-46a0-a7b5-b5605813cf98 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:08.890089 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-27ed17df-275b-46a0-a7b5-b5605813cf98 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:08.934091 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-27ed17df-275b-46a0-a7b5-b5605813cf98 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Getting quotas for project ac8b3e9f72234d9985fbc5fa7e7984ad. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:02:08.972178 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-27ed17df-275b-46a0-a7b5-b5605813cf98 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Getting quotas for user ef32131362a3442498234c0554f08305 and project ac8b3e9f72234d9985fbc5fa7e7984ad. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:02:09.045066 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-27ed17df-275b-46a0-a7b5-b5605813cf98 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:02:09.050535 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-27ed17df-275b-46a0-a7b5-b5605813cf98 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: edf9e114-8094-4b65-a61a-51b52e7fa165] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:02:09.180010 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-27ed17df-275b-46a0-a7b5-b5605813cf98 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.223699 Sep 10 12:02:09.181067 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2332/4663] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:02:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 4227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:02:09.194772 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-61656282-df43-49e8-99f1-9b3baef063e3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:09.195329 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-61656282-df43-49e8-99f1-9b3baef063e3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: edf9e114-8094-4b65-a61a-51b52e7fa165] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:09.247019 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-61656282-df43-49e8-99f1-9b3baef063e3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: edf9e114-8094-4b65-a61a-51b52e7fa165] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:02:09.309767 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:02:09.454547 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=14 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:02:09.473768 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5fa09016-5003-4764-840b-aef61c72ef22 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:09.484113 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5fa09016-5003-4764-840b-aef61c72ef22 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1685 microversion: 2.1 time: 1.676157 Sep 10 12:02:09.489761 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2332/4664] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:07 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1685 bytes in 1682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:02:09.834921 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-61656282-df43-49e8-99f1-9b3baef063e3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "DELETE /compute/v2.1/servers/edf9e114-8094-4b65-a61a-51b52e7fa165" status: 204 len: 0 microversion: 2.1 time: 0.644431 Sep 10 12:02:09.842063 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2333/4665] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:02:09 2022] DELETE /compute/v2.1/servers/edf9e114-8094-4b65-a61a-51b52e7fa165 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:02:09.852429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d0517470-bf88-4a36-842c-2f085c05765d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:09.853644 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d0517470-bf88-4a36-842c-2f085c05765d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: edf9e114-8094-4b65-a61a-51b52e7fa165] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:09.872315 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-d0517470-bf88-4a36-842c-2f085c05765d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] HTTP exception thrown: Instance edf9e114-8094-4b65-a61a-51b52e7fa165 could not be found. Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d0517470-bf88-4a36-842c-2f085c05765d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Request method failure captured: Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/edf9e114-8094-4b65-a61a-51b52e7fa165 HTTP/1.1 Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHykcWQYupGxhcLpb6v5AsrUV8qZ6sg9Ki1Jfb5jCMoRjGicsw0WManJo8IjBppMD5CxQdT4hQu3IHHi54G_V7lvb8EgCj19qVHNlr3p45qCyo-pmA_bA7FrmqWJZSaCbHLCvlYvItyJikej-C_PUFDVoe9D_fp0roxy7XQj-_YcxQA Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersTestJSON-793172710 Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ac8b3e9f72234d9985fbc5fa7e7984ad", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersTestJSON-793172710 Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersTestJSON-793172710 Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersTestJSON-793172710-project Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: ef32131362a3442498234c0554f08305 Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersTestJSON-793172710-project Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance edf9e114-8094-4b65-a61a-51b52e7fa165 could not be found. Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'edf9e114-8094-4b65-a61a-51b52e7fa165'} Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edf9e114-8094-4b65-a61a-51b52e7fa165 could not be found. Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edf9e114-8094-4b65-a61a-51b52e7fa165 could not be found. Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:02:09.875914 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:02:09.882854 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:02:09.882854 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:02:09.882854 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edf9e114-8094-4b65-a61a-51b52e7fa165 could not be found. Sep 10 12:02:09.882854 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:02:09.882854 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d0517470-bf88-4a36-842c-2f085c05765d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Returning 404 to user: Instance edf9e114-8094-4b65-a61a-51b52e7fa165 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:02:09.882854 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d0517470-bf88-4a36-842c-2f085c05765d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/edf9e114-8094-4b65-a61a-51b52e7fa165" status: 404 len: 111 microversion: 2.1 time: 0.037284 Sep 10 12:02:09.886341 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2333/4666] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:09 2022] GET /compute/v2.1/servers/edf9e114-8094-4b65-a61a-51b52e7fa165 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 12:02:09.977246 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-595d7ccb-b00a-4e82-b663-6907ad3f7247 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1132709079", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "5a10f3ce-b3db-41f2-acaa-21e8715e6fe6"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:02:10.074252 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-595d7ccb-b00a-4e82-b663-6907ad3f7247 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] validate_networks() for [('5a10f3ce-b3db-41f2-acaa-21e8715e6fe6', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:02:10.513253 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-733b8240-d92c-401a-8b84-2e2b84485aa0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:10.514483 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-733b8240-d92c-401a-8b84-2e2b84485aa0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:10.533735 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-733b8240-d92c-401a-8b84-2e2b84485aa0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:10.538347 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-733b8240-d92c-401a-8b84-2e2b84485aa0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:10.538847 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-733b8240-d92c-401a-8b84-2e2b84485aa0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:10.539690 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-733b8240-d92c-401a-8b84-2e2b84485aa0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:10.540180 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-733b8240-d92c-401a-8b84-2e2b84485aa0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:10.540796 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-733b8240-d92c-401a-8b84-2e2b84485aa0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:11.203630 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-595d7ccb-b00a-4e82-b663-6907ad3f7247 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:02:11.204744 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-595d7ccb-b00a-4e82-b663-6907ad3f7247 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:02:11.205407 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-595d7ccb-b00a-4e82-b663-6907ad3f7247 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:02:11.205996 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-595d7ccb-b00a-4e82-b663-6907ad3f7247 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:02:11.206491 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-595d7ccb-b00a-4e82-b663-6907ad3f7247 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:02:11.221796 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-595d7ccb-b00a-4e82-b663-6907ad3f7247 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:11.232221 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-595d7ccb-b00a-4e82-b663-6907ad3f7247 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:11.232840 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-595d7ccb-b00a-4e82-b663-6907ad3f7247 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:11.233803 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-595d7ccb-b00a-4e82-b663-6907ad3f7247 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:11.234355 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-595d7ccb-b00a-4e82-b663-6907ad3f7247 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:11.234903 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-595d7ccb-b00a-4e82-b663-6907ad3f7247 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:11.274805 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-595d7ccb-b00a-4e82-b663-6907ad3f7247 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Getting quotas for project ac8b3e9f72234d9985fbc5fa7e7984ad. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:02:11.289954 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-595d7ccb-b00a-4e82-b663-6907ad3f7247 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Getting quotas for user ef32131362a3442498234c0554f08305 and project ac8b3e9f72234d9985fbc5fa7e7984ad. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:02:11.320071 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-595d7ccb-b00a-4e82-b663-6907ad3f7247 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:02:11.321497 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-595d7ccb-b00a-4e82-b663-6907ad3f7247 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f6556ea4-d20e-4561-8793-d1d4412fad26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:02:11.399546 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-595d7ccb-b00a-4e82-b663-6907ad3f7247 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.426105 Sep 10 12:02:11.406733 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2334/4667] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:02:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1434 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:02:11.413422 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-78560874-aa76-476c-adea-c97ca6ad7427 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:11.414351 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-78560874-aa76-476c-adea-c97ca6ad7427 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f6556ea4-d20e-4561-8793-d1d4412fad26] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:11.834388 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-78560874-aa76-476c-adea-c97ca6ad7427 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:11.844670 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-78560874-aa76-476c-adea-c97ca6ad7427 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f6556ea4-d20e-4561-8793-d1d4412fad26" status: 200 len: 1221 microversion: 2.1 time: 0.435101 Sep 10 12:02:11.845410 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2335/4668] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:11 2022] GET /compute/v2.1/servers/f6556ea4-d20e-4561-8793-d1d4412fad26 => generated 1221 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:12.387506 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-733b8240-d92c-401a-8b84-2e2b84485aa0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:12.403876 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-733b8240-d92c-401a-8b84-2e2b84485aa0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1685 microversion: 2.1 time: 1.895020 Sep 10 12:02:12.421079 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2334/4669] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:10 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1685 bytes in 1913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:12.870490 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c6b2537e-8205-4b80-9c79-463c03a26a4b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:12.871363 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c6b2537e-8205-4b80-9c79-463c03a26a4b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f6556ea4-d20e-4561-8793-d1d4412fad26] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:12.897916 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c6b2537e-8205-4b80-9c79-463c03a26a4b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:12.901482 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c6b2537e-8205-4b80-9c79-463c03a26a4b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:12.901613 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c6b2537e-8205-4b80-9c79-463c03a26a4b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:12.902939 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c6b2537e-8205-4b80-9c79-463c03a26a4b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:12.904932 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c6b2537e-8205-4b80-9c79-463c03a26a4b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:12.908056 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c6b2537e-8205-4b80-9c79-463c03a26a4b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:13.353084 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c6b2537e-8205-4b80-9c79-463c03a26a4b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:13.362527 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c6b2537e-8205-4b80-9c79-463c03a26a4b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f6556ea4-d20e-4561-8793-d1d4412fad26" status: 200 len: 1273 microversion: 2.1 time: 0.497690 Sep 10 12:02:13.370387 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2336/4670] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:12 2022] GET /compute/v2.1/servers/f6556ea4-d20e-4561-8793-d1d4412fad26 => generated 1273 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:13.432207 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4e54f171-f620-402d-8e22-cda295c6edef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:13.434365 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4e54f171-f620-402d-8e22-cda295c6edef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:13.455131 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e54f171-f620-402d-8e22-cda295c6edef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:13.456246 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e54f171-f620-402d-8e22-cda295c6edef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:13.459244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e54f171-f620-402d-8e22-cda295c6edef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:13.462620 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e54f171-f620-402d-8e22-cda295c6edef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:13.463815 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e54f171-f620-402d-8e22-cda295c6edef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:13.464535 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e54f171-f620-402d-8e22-cda295c6edef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:14.097203 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4e54f171-f620-402d-8e22-cda295c6edef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:14.106043 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4e54f171-f620-402d-8e22-cda295c6edef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1685 microversion: 2.1 time: 0.678716 Sep 10 12:02:14.106868 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2335/4671] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:13 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1685 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:14.409456 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-997eb6e1-12a5-4b77-8708-73a54e9501cb tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:14.412185 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-997eb6e1-12a5-4b77-8708-73a54e9501cb tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f6556ea4-d20e-4561-8793-d1d4412fad26] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:14.446823 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-997eb6e1-12a5-4b77-8708-73a54e9501cb tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:14.447544 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-997eb6e1-12a5-4b77-8708-73a54e9501cb tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:14.449916 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-997eb6e1-12a5-4b77-8708-73a54e9501cb tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:14.450933 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-997eb6e1-12a5-4b77-8708-73a54e9501cb tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:14.451928 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-997eb6e1-12a5-4b77-8708-73a54e9501cb tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:14.453233 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-997eb6e1-12a5-4b77-8708-73a54e9501cb tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:14.643615 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-997eb6e1-12a5-4b77-8708-73a54e9501cb tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:14.680955 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-997eb6e1-12a5-4b77-8708-73a54e9501cb tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f6556ea4-d20e-4561-8793-d1d4412fad26" status: 200 len: 1279 microversion: 2.1 time: 0.286965 Sep 10 12:02:14.682751 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2337/4672] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:14 2022] GET /compute/v2.1/servers/f6556ea4-d20e-4561-8793-d1d4412fad26 => generated 1279 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:15.131557 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-20efefa0-3216-4cf2-8271-45b9019743e0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:15.133410 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-20efefa0-3216-4cf2-8271-45b9019743e0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:15.175875 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20efefa0-3216-4cf2-8271-45b9019743e0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:15.179478 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20efefa0-3216-4cf2-8271-45b9019743e0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:15.180216 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20efefa0-3216-4cf2-8271-45b9019743e0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:15.183444 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20efefa0-3216-4cf2-8271-45b9019743e0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:15.185263 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20efefa0-3216-4cf2-8271-45b9019743e0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:15.185974 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20efefa0-3216-4cf2-8271-45b9019743e0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:15.710239 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bb9f5fcb-e8c1-4bba-971f-c283ce9be2e9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:15.717310 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bb9f5fcb-e8c1-4bba-971f-c283ce9be2e9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f6556ea4-d20e-4561-8793-d1d4412fad26] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:15.741847 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bb9f5fcb-e8c1-4bba-971f-c283ce9be2e9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:15.742356 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bb9f5fcb-e8c1-4bba-971f-c283ce9be2e9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:15.742800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bb9f5fcb-e8c1-4bba-971f-c283ce9be2e9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:15.748970 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bb9f5fcb-e8c1-4bba-971f-c283ce9be2e9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:15.752789 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bb9f5fcb-e8c1-4bba-971f-c283ce9be2e9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:15.755980 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bb9f5fcb-e8c1-4bba-971f-c283ce9be2e9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:16.870885 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bb9f5fcb-e8c1-4bba-971f-c283ce9be2e9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:16.878822 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-20efefa0-3216-4cf2-8271-45b9019743e0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:16.890109 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bb9f5fcb-e8c1-4bba-971f-c283ce9be2e9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f6556ea4-d20e-4561-8793-d1d4412fad26" status: 200 len: 1321 microversion: 2.1 time: 1.181813 Sep 10 12:02:16.892102 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2338/4673] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:15 2022] GET /compute/v2.1/servers/f6556ea4-d20e-4561-8793-d1d4412fad26 => generated 1321 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:16.894292 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-20efefa0-3216-4cf2-8271-45b9019743e0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 1.767521 Sep 10 12:02:16.897706 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2336/4674] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:15 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 1772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:17.190816 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-35443570-0460-4370-a2fa-a30887408c79 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:17.191628 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-35443570-0460-4370-a2fa-a30887408c79 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:17.211066 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-35443570-0460-4370-a2fa-a30887408c79 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:17.214654 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-35443570-0460-4370-a2fa-a30887408c79 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:17.215400 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-35443570-0460-4370-a2fa-a30887408c79 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:17.221093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-35443570-0460-4370-a2fa-a30887408c79 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:17.229819 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-35443570-0460-4370-a2fa-a30887408c79 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:17.230520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-35443570-0460-4370-a2fa-a30887408c79 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:17.800484 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-35443570-0460-4370-a2fa-a30887408c79 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:17.818533 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-35443570-0460-4370-a2fa-a30887408c79 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.632319 Sep 10 12:02:17.819151 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2339/4675] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:17 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:17.917035 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3dbbf274-9ed0-4e4d-a2ea-438c6df8bbba tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:17.918254 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3dbbf274-9ed0-4e4d-a2ea-438c6df8bbba tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f6556ea4-d20e-4561-8793-d1d4412fad26] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:17.930780 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3dbbf274-9ed0-4e4d-a2ea-438c6df8bbba tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:17.940066 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3dbbf274-9ed0-4e4d-a2ea-438c6df8bbba tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:17.940853 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3dbbf274-9ed0-4e4d-a2ea-438c6df8bbba tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:17.943228 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3dbbf274-9ed0-4e4d-a2ea-438c6df8bbba tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:17.945177 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3dbbf274-9ed0-4e4d-a2ea-438c6df8bbba tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:17.946848 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3dbbf274-9ed0-4e4d-a2ea-438c6df8bbba tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:18.764065 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-5bf7b65a-ac4d-4d2d-8ac4-f5532f690608 req-041055dc-d698-4ceb-bfd0-b82c10ffa260 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6556ea4-d20e-4561-8793-d1d4412fad26", "tag": "d29790bc-2fc8-480c-94f5-b871a76ca54c"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:02:18.800549 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-5bf7b65a-ac4d-4d2d-8ac4-f5532f690608 req-041055dc-d698-4ceb-bfd0-b82c10ffa260 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:18.804039 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-5bf7b65a-ac4d-4d2d-8ac4-f5532f690608 req-041055dc-d698-4ceb-bfd0-b82c10ffa260 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:18.804736 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-5bf7b65a-ac4d-4d2d-8ac4-f5532f690608 req-041055dc-d698-4ceb-bfd0-b82c10ffa260 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:18.835577 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-5bf7b65a-ac4d-4d2d-8ac4-f5532f690608 req-041055dc-d698-4ceb-bfd0-b82c10ffa260 service nova] Creating event network-changed:d29790bc-2fc8-480c-94f5-b871a76ca54c for instance f6556ea4-d20e-4561-8793-d1d4412fad26 on n-h2-856895-1 Sep 10 12:02:18.848776 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-5bf7b65a-ac4d-4d2d-8ac4-f5532f690608 req-041055dc-d698-4ceb-bfd0-b82c10ffa260 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088647 Sep 10 12:02:18.850014 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2340/4676] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:02:18.919147 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3dbbf274-9ed0-4e4d-a2ea-438c6df8bbba tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:18.933167 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3dbbf274-9ed0-4e4d-a2ea-438c6df8bbba tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f6556ea4-d20e-4561-8793-d1d4412fad26" status: 200 len: 1321 microversion: 2.1 time: 1.019150 Sep 10 12:02:18.936086 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2337/4677] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:17 2022] GET /compute/v2.1/servers/f6556ea4-d20e-4561-8793-d1d4412fad26 => generated 1321 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:19.163918 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-e05f6753-20a6-47cd-b224-c9f26304e1e5 req-d45e95ad-c4a1-4379-a891-2f6e50738ce3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64704ff7-229d-478b-9889-6b6cba53bd0f", "name": "network-vif-unplugged", "status": "completed", "tag": "7f6388a0-8fe7-4ee5-821e-68c4889b9594"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:02:19.187070 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e05f6753-20a6-47cd-b224-c9f26304e1e5 req-d45e95ad-c4a1-4379-a891-2f6e50738ce3 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:19.187771 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e05f6753-20a6-47cd-b224-c9f26304e1e5 req-d45e95ad-c4a1-4379-a891-2f6e50738ce3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:19.188960 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e05f6753-20a6-47cd-b224-c9f26304e1e5 req-d45e95ad-c4a1-4379-a891-2f6e50738ce3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:19.209951 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-e05f6753-20a6-47cd-b224-c9f26304e1e5 req-d45e95ad-c4a1-4379-a891-2f6e50738ce3 service nova] Creating event network-vif-unplugged:7f6388a0-8fe7-4ee5-821e-68c4889b9594 for instance 64704ff7-229d-478b-9889-6b6cba53bd0f on n-h1-856895-1 Sep 10 12:02:19.222720 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-e05f6753-20a6-47cd-b224-c9f26304e1e5 req-d45e95ad-c4a1-4379-a891-2f6e50738ce3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063156 Sep 10 12:02:19.225645 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2341/4678] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:02:19.947553 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1e0bdc15-2a94-437e-8aee-20c9cab6d728 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:19.948912 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1e0bdc15-2a94-437e-8aee-20c9cab6d728 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:19.963277 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a033c431-202c-473a-b0fd-2c09ad4a4f9b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:19.964845 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a033c431-202c-473a-b0fd-2c09ad4a4f9b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f6556ea4-d20e-4561-8793-d1d4412fad26] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:19.974954 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a033c431-202c-473a-b0fd-2c09ad4a4f9b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:19.976881 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1e0bdc15-2a94-437e-8aee-20c9cab6d728 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:19.977605 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1e0bdc15-2a94-437e-8aee-20c9cab6d728 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:19.978244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1e0bdc15-2a94-437e-8aee-20c9cab6d728 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:19.978940 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a033c431-202c-473a-b0fd-2c09ad4a4f9b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:19.980144 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1e0bdc15-2a94-437e-8aee-20c9cab6d728 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:19.980762 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a033c431-202c-473a-b0fd-2c09ad4a4f9b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:19.981810 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a033c431-202c-473a-b0fd-2c09ad4a4f9b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:19.982489 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1e0bdc15-2a94-437e-8aee-20c9cab6d728 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:19.983106 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1e0bdc15-2a94-437e-8aee-20c9cab6d728 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:19.983866 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a033c431-202c-473a-b0fd-2c09ad4a4f9b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:19.989232 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a033c431-202c-473a-b0fd-2c09ad4a4f9b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:20.864119 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1e0bdc15-2a94-437e-8aee-20c9cab6d728 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:20.876432 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a033c431-202c-473a-b0fd-2c09ad4a4f9b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:20.877693 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1e0bdc15-2a94-437e-8aee-20c9cab6d728 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.934601 Sep 10 12:02:20.889073 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a033c431-202c-473a-b0fd-2c09ad4a4f9b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f6556ea4-d20e-4561-8793-d1d4412fad26" status: 200 len: 1321 microversion: 2.1 time: 0.931993 Sep 10 12:02:20.903754 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2338/4679] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:19 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:20.911456 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2d433e7a-826b-4ecf-b77f-a8a09b35eb87 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:20.916975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2d433e7a-826b-4ecf-b77f-a8a09b35eb87 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:20.920336 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2342/4680] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:19 2022] GET /compute/v2.1/servers/f6556ea4-d20e-4561-8793-d1d4412fad26 => generated 1321 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:20.935337 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d433e7a-826b-4ecf-b77f-a8a09b35eb87 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:20.936401 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d433e7a-826b-4ecf-b77f-a8a09b35eb87 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:20.940987 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d433e7a-826b-4ecf-b77f-a8a09b35eb87 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:20.941878 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d433e7a-826b-4ecf-b77f-a8a09b35eb87 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:20.942528 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d433e7a-826b-4ecf-b77f-a8a09b35eb87 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:20.943712 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d433e7a-826b-4ecf-b77f-a8a09b35eb87 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:21.905623 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2d433e7a-826b-4ecf-b77f-a8a09b35eb87 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:21.913674 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2d433e7a-826b-4ecf-b77f-a8a09b35eb87 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 1.008378 Sep 10 12:02:21.918482 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2339/4681] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:20 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:21.919940 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-29e94f4d-3da9-4dbe-99dc-7826487818c7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:21.920692 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-29e94f4d-3da9-4dbe-99dc-7826487818c7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f6556ea4-d20e-4561-8793-d1d4412fad26] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:21.927923 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=4 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:02:21.930128 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=16 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:02:21.944671 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-de1fc6b5-2647-40fe-8726-3da5e41a3d4b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:21.947078 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-de1fc6b5-2647-40fe-8726-3da5e41a3d4b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:21.949008 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29e94f4d-3da9-4dbe-99dc-7826487818c7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:21.950003 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29e94f4d-3da9-4dbe-99dc-7826487818c7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:21.951641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29e94f4d-3da9-4dbe-99dc-7826487818c7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:21.952661 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29e94f4d-3da9-4dbe-99dc-7826487818c7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:21.954829 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29e94f4d-3da9-4dbe-99dc-7826487818c7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:21.956029 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29e94f4d-3da9-4dbe-99dc-7826487818c7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:21.962666 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de1fc6b5-2647-40fe-8726-3da5e41a3d4b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:21.964356 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de1fc6b5-2647-40fe-8726-3da5e41a3d4b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:21.966038 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de1fc6b5-2647-40fe-8726-3da5e41a3d4b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:21.966799 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de1fc6b5-2647-40fe-8726-3da5e41a3d4b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:21.968744 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de1fc6b5-2647-40fe-8726-3da5e41a3d4b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:21.969487 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de1fc6b5-2647-40fe-8726-3da5e41a3d4b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:22.298385 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-29e94f4d-3da9-4dbe-99dc-7826487818c7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:22.314612 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-29e94f4d-3da9-4dbe-99dc-7826487818c7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f6556ea4-d20e-4561-8793-d1d4412fad26" status: 200 len: 1321 microversion: 2.1 time: 0.397694 Sep 10 12:02:22.334513 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2343/4682] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:21 2022] GET /compute/v2.1/servers/f6556ea4-d20e-4561-8793-d1d4412fad26 => generated 1321 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:22.367693 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-de1fc6b5-2647-40fe-8726-3da5e41a3d4b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:22.382177 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-de1fc6b5-2647-40fe-8726-3da5e41a3d4b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.435654 Sep 10 12:02:22.382884 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2340/4683] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:21 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:02:22.410388 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bc8475cd-b90f-4a9b-9168-680a088a1311 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:02:22.413144 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bc8475cd-b90f-4a9b-9168-680a088a1311 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:22.428985 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bc8475cd-b90f-4a9b-9168-680a088a1311 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:22.431364 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bc8475cd-b90f-4a9b-9168-680a088a1311 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:22.431851 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bc8475cd-b90f-4a9b-9168-680a088a1311 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:22.434760 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bc8475cd-b90f-4a9b-9168-680a088a1311 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:22.435280 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bc8475cd-b90f-4a9b-9168-680a088a1311 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:22.435732 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bc8475cd-b90f-4a9b-9168-680a088a1311 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:22.578818 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:02:22.620842 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bc8475cd-b90f-4a9b-9168-680a088a1311 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "POST /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f/action" status: 202 len: 0 microversion: 2.1 time: 0.213976 Sep 10 12:02:22.621532 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2344/4684] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:02:22 2022] POST /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:02:22.630892 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6f846738-2418-4980-a141-9d201947c22a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:22.631556 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6f846738-2418-4980-a141-9d201947c22a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:22.644152 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f846738-2418-4980-a141-9d201947c22a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:22.644733 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f846738-2418-4980-a141-9d201947c22a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:22.645273 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f846738-2418-4980-a141-9d201947c22a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:22.646049 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f846738-2418-4980-a141-9d201947c22a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:22.648137 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f846738-2418-4980-a141-9d201947c22a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:22.648920 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f846738-2418-4980-a141-9d201947c22a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:23.342334 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2f4a1b40-652e-43df-b603-c1239f5c1d66 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:23.343914 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2f4a1b40-652e-43df-b603-c1239f5c1d66 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f6556ea4-d20e-4561-8793-d1d4412fad26] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:23.358058 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f4a1b40-652e-43df-b603-c1239f5c1d66 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:23.358899 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f4a1b40-652e-43df-b603-c1239f5c1d66 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:23.361420 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f4a1b40-652e-43df-b603-c1239f5c1d66 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:23.362690 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f4a1b40-652e-43df-b603-c1239f5c1d66 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:23.363980 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f4a1b40-652e-43df-b603-c1239f5c1d66 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:23.365919 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f4a1b40-652e-43df-b603-c1239f5c1d66 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:23.459273 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6f846738-2418-4980-a141-9d201947c22a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:23.474881 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6f846738-2418-4980-a141-9d201947c22a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1674 microversion: 2.1 time: 0.848577 Sep 10 12:02:23.476815 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2341/4685] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:22 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1674 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:23.742647 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2f4a1b40-652e-43df-b603-c1239f5c1d66 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:23.757127 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2f4a1b40-652e-43df-b603-c1239f5c1d66 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f6556ea4-d20e-4561-8793-d1d4412fad26" status: 200 len: 1321 microversion: 2.1 time: 0.418885 Sep 10 12:02:23.758034 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2345/4686] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:23 2022] GET /compute/v2.1/servers/f6556ea4-d20e-4561-8793-d1d4412fad26 => generated 1321 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:23.875037 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dc226347-231d-4c36-bb7a-e6ae872d7dfe tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Action: 'create', calling method: .version_select at 0x7f407249f040>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1856980367", "policies": ["affinity"]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:02:23.937015 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-dc226347-231d-4c36-bb7a-e6ae872d7dfe tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Getting quotas for project 3723fdd806f448c1986e3dd235b09185. Resources: {'server_groups'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:02:23.946874 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-dc226347-231d-4c36-bb7a-e6ae872d7dfe tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Getting quotas for user 05d28e8b26f84c3ba10a4552b6b40930 and project 3723fdd806f448c1986e3dd235b09185. Resources: {'server_groups'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:02:23.989628 n-d-856895-1 devstack@n-api.service[128776]: ERROR oslo.messaging._drivers.impl_rabbit [None req-dc226347-231d-4c36-bb7a-e6ae872d7dfe tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] [191798a7-2c5e-4d74-b865-4708090abecb] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 10 12:02:24.361659 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-1a7db652-f67e-48f4-864a-c7ac702f80a7 req-d477b5ac-65d4-4a5b-a009-a93e3ed72b1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6556ea4-d20e-4561-8793-d1d4412fad26", "name": "network-vif-plugged", "status": "completed", "tag": "d29790bc-2fc8-480c-94f5-b871a76ca54c"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:02:24.382432 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-1a7db652-f67e-48f4-864a-c7ac702f80a7 req-d477b5ac-65d4-4a5b-a009-a93e3ed72b1e service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:24.382940 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-1a7db652-f67e-48f4-864a-c7ac702f80a7 req-d477b5ac-65d4-4a5b-a009-a93e3ed72b1e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:24.383438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-1a7db652-f67e-48f4-864a-c7ac702f80a7 req-d477b5ac-65d4-4a5b-a009-a93e3ed72b1e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:24.408287 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-1a7db652-f67e-48f4-864a-c7ac702f80a7 req-d477b5ac-65d4-4a5b-a009-a93e3ed72b1e service nova] Creating event network-vif-plugged:d29790bc-2fc8-480c-94f5-b871a76ca54c for instance f6556ea4-d20e-4561-8793-d1d4412fad26 on n-h2-856895-1 Sep 10 12:02:24.417371 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-1a7db652-f67e-48f4-864a-c7ac702f80a7 req-d477b5ac-65d4-4a5b-a009-a93e3ed72b1e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061144 Sep 10 12:02:24.423731 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2346/4687] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:02:24.506721 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-82b70771-d296-4958-8bad-aaf90c132d4c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:24.507749 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-82b70771-d296-4958-8bad-aaf90c132d4c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:24.514369 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82b70771-d296-4958-8bad-aaf90c132d4c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:24.515130 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82b70771-d296-4958-8bad-aaf90c132d4c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:24.515789 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82b70771-d296-4958-8bad-aaf90c132d4c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:24.516778 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82b70771-d296-4958-8bad-aaf90c132d4c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:24.517573 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82b70771-d296-4958-8bad-aaf90c132d4c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:24.518206 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82b70771-d296-4958-8bad-aaf90c132d4c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:24.700095 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-82b70771-d296-4958-8bad-aaf90c132d4c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:24.711778 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-82b70771-d296-4958-8bad-aaf90c132d4c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1674 microversion: 2.1 time: 0.209882 Sep 10 12:02:24.712379 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2347/4688] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:24 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1674 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:02:24.784586 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0bc4b56c-b001-4634-a2ae-7a3cfed7a0d4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:24.785210 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0bc4b56c-b001-4634-a2ae-7a3cfed7a0d4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f6556ea4-d20e-4561-8793-d1d4412fad26] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:24.794534 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0bc4b56c-b001-4634-a2ae-7a3cfed7a0d4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:24.795036 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0bc4b56c-b001-4634-a2ae-7a3cfed7a0d4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:24.795499 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0bc4b56c-b001-4634-a2ae-7a3cfed7a0d4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:24.796205 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0bc4b56c-b001-4634-a2ae-7a3cfed7a0d4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:24.796705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0bc4b56c-b001-4634-a2ae-7a3cfed7a0d4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:24.797076 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0bc4b56c-b001-4634-a2ae-7a3cfed7a0d4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:24.998610 n-d-856895-1 devstack@n-api.service[128776]: INFO oslo.messaging._drivers.impl_rabbit [None req-dc226347-231d-4c36-bb7a-e6ae872d7dfe tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] [191798a7-2c5e-4d74-b865-4708090abecb] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 58750. Sep 10 12:02:25.029574 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-dc226347-231d-4c36-bb7a-e6ae872d7dfe tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Getting quotas for project 3723fdd806f448c1986e3dd235b09185. Resources: {'server_groups'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:02:25.038250 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-dc226347-231d-4c36-bb7a-e6ae872d7dfe tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Getting quotas for user 05d28e8b26f84c3ba10a4552b6b40930 and project 3723fdd806f448c1986e3dd235b09185. Resources: {'server_groups'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:02:25.056561 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-dc226347-231d-4c36-bb7a-e6ae872d7dfe tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 1.433540 Sep 10 12:02:25.057718 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2342/4689] 10.222.0.23 () {60 vars in 1174 bytes} [Sat Sep 10 12:02:23 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:02:25.070226 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-09bee40d-2b4a-4a04-b5e4-5eeb4569ca2b tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Action: 'create', calling method: .version_select at 0x7f4072885c10>, body: {"server_group": {"name": "tempest-server-group-866615953", "policies": ["affinity"]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:02:25.090977 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:02:25.126094 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-09bee40d-2b4a-4a04-b5e4-5eeb4569ca2b tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Getting quotas for project 3723fdd806f448c1986e3dd235b09185. Resources: {'server_groups'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:02:25.148600 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0bc4b56c-b001-4634-a2ae-7a3cfed7a0d4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:25.153648 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-09bee40d-2b4a-4a04-b5e4-5eeb4569ca2b tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Getting quotas for user 05d28e8b26f84c3ba10a4552b6b40930 and project 3723fdd806f448c1986e3dd235b09185. Resources: {'server_groups'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:02:25.160891 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0bc4b56c-b001-4634-a2ae-7a3cfed7a0d4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f6556ea4-d20e-4561-8793-d1d4412fad26" status: 200 len: 1321 microversion: 2.1 time: 0.380656 Sep 10 12:02:25.162712 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2348/4690] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:24 2022] GET /compute/v2.1/servers/f6556ea4-d20e-4561-8793-d1d4412fad26 => generated 1321 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:02:25.235576 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-09bee40d-2b4a-4a04-b5e4-5eeb4569ca2b tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Getting quotas for project 3723fdd806f448c1986e3dd235b09185. Resources: {'server_groups'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:02:25.242053 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-09bee40d-2b4a-4a04-b5e4-5eeb4569ca2b tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Getting quotas for user 05d28e8b26f84c3ba10a4552b6b40930 and project 3723fdd806f448c1986e3dd235b09185. Resources: {'server_groups'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:02:25.257804 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-09bee40d-2b4a-4a04-b5e4-5eeb4569ca2b tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.191877 Sep 10 12:02:25.258768 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2343/4691] 10.222.0.23 () {60 vars in 1173 bytes} [Sat Sep 10 12:02:25 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:02:25.271500 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ac65925a-09b7-4cf3-843a-68f866c5fa02 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Action: 'create', calling method: .version_select at 0x7f4071ebbc10>, body: {"server_group": {"name": "tempest-server-group-866615953", "policies": ["affinity"]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:02:25.297025 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-ac65925a-09b7-4cf3-843a-68f866c5fa02 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Getting quotas for project 3723fdd806f448c1986e3dd235b09185. Resources: {'server_groups'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:02:25.304326 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-ac65925a-09b7-4cf3-843a-68f866c5fa02 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Getting quotas for user 05d28e8b26f84c3ba10a4552b6b40930 and project 3723fdd806f448c1986e3dd235b09185. Resources: {'server_groups'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:02:25.387675 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-ac65925a-09b7-4cf3-843a-68f866c5fa02 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Getting quotas for project 3723fdd806f448c1986e3dd235b09185. Resources: {'server_groups'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:02:25.398174 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-ac65925a-09b7-4cf3-843a-68f866c5fa02 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Getting quotas for user 05d28e8b26f84c3ba10a4552b6b40930 and project 3723fdd806f448c1986e3dd235b09185. Resources: {'server_groups'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:02:25.417740 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ac65925a-09b7-4cf3-843a-68f866c5fa02 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.151747 Sep 10 12:02:25.418767 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2349/4692] 10.222.0.23 () {60 vars in 1173 bytes} [Sat Sep 10 12:02:25 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:02:25.430825 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1ad0fb35-696c-4fc3-8ec2-d41a8dc97eb0 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:25.465918 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1ad0fb35-696c-4fc3-8ec2-d41a8dc97eb0 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/cd169b4b-a4ab-49b3-90c0-8b537a845421" status: 204 len: 0 microversion: 2.1 time: 0.039514 Sep 10 12:02:25.474414 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2344/4693] 10.222.0.23 () {58 vars in 1266 bytes} [Sat Sep 10 12:02:25 2022] DELETE /compute/v2.1/os-server-groups/cd169b4b-a4ab-49b3-90c0-8b537a845421 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:02:25.480077 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fd60323f-40ce-4717-bdb9-7a27b8e209e1 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:25.510279 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fd60323f-40ce-4717-bdb9-7a27b8e209e1 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.034244 Sep 10 12:02:25.510724 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2350/4694] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Sep 10 12:02:25 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:02:25.524063 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4b033fe6-1281-4f59-a131-8f718543b6cd tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:25.556796 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4b033fe6-1281-4f59-a131-8f718543b6cd tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/8f6a6605-9de4-47bd-81c6-8bf168aa42a9" status: 204 len: 0 microversion: 2.1 time: 0.037441 Sep 10 12:02:25.561362 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2345/4695] 10.222.0.23 () {58 vars in 1266 bytes} [Sat Sep 10 12:02:25 2022] DELETE /compute/v2.1/os-server-groups/8f6a6605-9de4-47bd-81c6-8bf168aa42a9 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:02:25.567929 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3cdd9e11-762d-4513-9f39-bfc28d08ea91 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:25.583376 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3cdd9e11-762d-4513-9f39-bfc28d08ea91 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.020720 Sep 10 12:02:25.583975 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2351/4696] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Sep 10 12:02:25 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:02:25.599614 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0b1372f5-e7b1-43b5-9d4c-6371edfc82ec tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Action: 'create', calling method: .version_select at 0x7f4072885f70>, body: {"server_group": {"name": "tempest-server-group-1152522778", "policies": ["affinity"]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:02:25.626622 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-0b1372f5-e7b1-43b5-9d4c-6371edfc82ec tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Getting quotas for project 3723fdd806f448c1986e3dd235b09185. Resources: {'server_groups'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:02:25.632474 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-0b1372f5-e7b1-43b5-9d4c-6371edfc82ec tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Getting quotas for user 05d28e8b26f84c3ba10a4552b6b40930 and project 3723fdd806f448c1986e3dd235b09185. Resources: {'server_groups'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:02:25.698702 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-0b1372f5-e7b1-43b5-9d4c-6371edfc82ec tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Getting quotas for project 3723fdd806f448c1986e3dd235b09185. Resources: {'server_groups'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:02:25.706444 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-0b1372f5-e7b1-43b5-9d4c-6371edfc82ec tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Getting quotas for user 05d28e8b26f84c3ba10a4552b6b40930 and project 3723fdd806f448c1986e3dd235b09185. Resources: {'server_groups'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:02:25.725976 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0b1372f5-e7b1-43b5-9d4c-6371edfc82ec tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.132891 Sep 10 12:02:25.727691 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2346/4697] 10.222.0.23 () {60 vars in 1173 bytes} [Sat Sep 10 12:02:25 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:02:25.738456 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-947395b8-775a-4dca-b706-ecd864e76992 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:25.742567 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-10ab9b88-7eb2-42af-b6c9-d9affe77b59d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:25.743603 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-10ab9b88-7eb2-42af-b6c9-d9affe77b59d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:25.753878 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10ab9b88-7eb2-42af-b6c9-d9affe77b59d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:25.754729 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10ab9b88-7eb2-42af-b6c9-d9affe77b59d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:25.755469 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10ab9b88-7eb2-42af-b6c9-d9affe77b59d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:25.756452 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10ab9b88-7eb2-42af-b6c9-d9affe77b59d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:25.757535 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10ab9b88-7eb2-42af-b6c9-d9affe77b59d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:25.758243 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10ab9b88-7eb2-42af-b6c9-d9affe77b59d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:25.801469 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-947395b8-775a-4dca-b706-ecd864e76992 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/729787f2-f11d-4421-a996-b961b2028ed1" status: 204 len: 0 microversion: 2.1 time: 0.067201 Sep 10 12:02:25.802264 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2352/4698] 10.222.0.23 () {58 vars in 1266 bytes} [Sat Sep 10 12:02:25 2022] DELETE /compute/v2.1/os-server-groups/729787f2-f11d-4421-a996-b961b2028ed1 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:02:25.810092 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d9f6a345-44cb-4d65-82d1-b0d987854a65 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:25.842016 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d9f6a345-44cb-4d65-82d1-b0d987854a65 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.035562 Sep 10 12:02:25.842587 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2353/4699] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Sep 10 12:02:25 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:02:25.855748 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-74116bdc-edba-454b-b2fd-f760138f8f0a tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Action: 'create', calling method: .version_select at 0x7f4071f37d30>, body: {"server_group": {"name": "tempest-server-group-1034211788", "policies": ["anti-affinity"]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:02:25.900680 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:DELETE=4,nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:02:25.927927 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-74116bdc-edba-454b-b2fd-f760138f8f0a tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Getting quotas for project 3723fdd806f448c1986e3dd235b09185. Resources: {'server_groups'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:02:25.935486 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-74116bdc-edba-454b-b2fd-f760138f8f0a tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Getting quotas for user 05d28e8b26f84c3ba10a4552b6b40930 and project 3723fdd806f448c1986e3dd235b09185. Resources: {'server_groups'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:02:26.094162 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-74116bdc-edba-454b-b2fd-f760138f8f0a tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Getting quotas for project 3723fdd806f448c1986e3dd235b09185. Resources: {'server_groups'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:02:26.113534 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-74116bdc-edba-454b-b2fd-f760138f8f0a tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Getting quotas for user 05d28e8b26f84c3ba10a4552b6b40930 and project 3723fdd806f448c1986e3dd235b09185. Resources: {'server_groups'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:02:26.132861 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-10ab9b88-7eb2-42af-b6c9-d9affe77b59d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:26.150302 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-10ab9b88-7eb2-42af-b6c9-d9affe77b59d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1674 microversion: 2.1 time: 0.412103 Sep 10 12:02:26.151462 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2347/4700] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:25 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1674 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:26.164617 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-74116bdc-edba-454b-b2fd-f760138f8f0a tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.313204 Sep 10 12:02:26.171909 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2354/4701] 10.222.0.23 () {60 vars in 1173 bytes} [Sat Sep 10 12:02:25 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:02:26.204114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8484c934-1d97-4e52-bdda-499b0fa93455 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:26.204374 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b41acc0d-635f-4926-9f37-8a86ee1c4680 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:26.204936 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b41acc0d-635f-4926-9f37-8a86ee1c4680 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f6556ea4-d20e-4561-8793-d1d4412fad26] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:26.227547 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b41acc0d-635f-4926-9f37-8a86ee1c4680 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:26.228376 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b41acc0d-635f-4926-9f37-8a86ee1c4680 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:26.228854 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b41acc0d-635f-4926-9f37-8a86ee1c4680 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:26.231373 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b41acc0d-635f-4926-9f37-8a86ee1c4680 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:26.232236 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b41acc0d-635f-4926-9f37-8a86ee1c4680 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:26.232868 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b41acc0d-635f-4926-9f37-8a86ee1c4680 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:26.240638 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:02:26.258952 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8484c934-1d97-4e52-bdda-499b0fa93455 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/3cce0cd0-16fc-4003-a53b-b6cbf3edc349" status: 204 len: 0 microversion: 2.1 time: 0.070229 Sep 10 12:02:26.260148 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2355/4702] 10.222.0.23 () {58 vars in 1266 bytes} [Sat Sep 10 12:02:26 2022] DELETE /compute/v2.1/os-server-groups/3cce0cd0-16fc-4003-a53b-b6cbf3edc349 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:02:26.276517 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-08fca75c-f530-46d4-af36-a0fc2dac06e5 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:26.310615 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-08fca75c-f530-46d4-af36-a0fc2dac06e5 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.044208 Sep 10 12:02:26.311868 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2356/4703] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Sep 10 12:02:26 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:02:26.568889 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-77fef87e-da46-477b-a93b-7e631d3e1371 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1384463127", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "f6a6c5ed-4f88-4778-9393-38958434b45d"}]}, "os:scheduler_hints": {"group": "89c9facc-b5b7-4041-ab6d-26d3524d39bf"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:02:26.693375 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-77fef87e-da46-477b-a93b-7e631d3e1371 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] validate_networks() for [('f6a6c5ed-4f88-4778-9393-38958434b45d', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:02:26.762712 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b41acc0d-635f-4926-9f37-8a86ee1c4680 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:26.775781 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b41acc0d-635f-4926-9f37-8a86ee1c4680 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f6556ea4-d20e-4561-8793-d1d4412fad26" status: 200 len: 1321 microversion: 2.1 time: 0.592670 Sep 10 12:02:26.776217 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2348/4704] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:26 2022] GET /compute/v2.1/servers/f6556ea4-d20e-4561-8793-d1d4412fad26 => generated 1321 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:02:27.177434 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f1ff0a3c-672c-49f1-b357-302c20e43a5c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:27.178461 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f1ff0a3c-672c-49f1-b357-302c20e43a5c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:27.191993 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1ff0a3c-672c-49f1-b357-302c20e43a5c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:27.194356 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1ff0a3c-672c-49f1-b357-302c20e43a5c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:27.196325 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1ff0a3c-672c-49f1-b357-302c20e43a5c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:27.197188 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1ff0a3c-672c-49f1-b357-302c20e43a5c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:27.200251 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1ff0a3c-672c-49f1-b357-302c20e43a5c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:27.200815 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1ff0a3c-672c-49f1-b357-302c20e43a5c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:27.457962 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-77fef87e-da46-477b-a93b-7e631d3e1371 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:02:27.458464 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-77fef87e-da46-477b-a93b-7e631d3e1371 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:02:27.459107 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-77fef87e-da46-477b-a93b-7e631d3e1371 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:02:27.459559 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-77fef87e-da46-477b-a93b-7e631d3e1371 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:02:27.460016 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-77fef87e-da46-477b-a93b-7e631d3e1371 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:02:27.482428 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-77fef87e-da46-477b-a93b-7e631d3e1371 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:27.482922 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-77fef87e-da46-477b-a93b-7e631d3e1371 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:27.496120 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f1ff0a3c-672c-49f1-b357-302c20e43a5c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:27.498505 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-77fef87e-da46-477b-a93b-7e631d3e1371 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:27.500141 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-77fef87e-da46-477b-a93b-7e631d3e1371 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:27.501566 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-77fef87e-da46-477b-a93b-7e631d3e1371 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:27.502124 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-77fef87e-da46-477b-a93b-7e631d3e1371 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:27.505467 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f1ff0a3c-672c-49f1-b357-302c20e43a5c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.333270 Sep 10 12:02:27.515217 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2349/4705] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:27 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:02:27.532781 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-822a3eae-03aa-41b0-9c09-50be5c401257 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:02:27.536875 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-77fef87e-da46-477b-a93b-7e631d3e1371 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Getting quotas for project 3723fdd806f448c1986e3dd235b09185. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:02:27.544533 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-822a3eae-03aa-41b0-9c09-50be5c401257 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:27.544938 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-77fef87e-da46-477b-a93b-7e631d3e1371 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Getting quotas for user 05d28e8b26f84c3ba10a4552b6b40930 and project 3723fdd806f448c1986e3dd235b09185. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:02:27.559062 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-822a3eae-03aa-41b0-9c09-50be5c401257 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:27.559571 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-822a3eae-03aa-41b0-9c09-50be5c401257 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:27.560290 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-822a3eae-03aa-41b0-9c09-50be5c401257 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:27.560973 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-822a3eae-03aa-41b0-9c09-50be5c401257 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:27.561603 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-822a3eae-03aa-41b0-9c09-50be5c401257 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:27.562235 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-822a3eae-03aa-41b0-9c09-50be5c401257 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:27.582547 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-77fef87e-da46-477b-a93b-7e631d3e1371 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:02:27.586658 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-77fef87e-da46-477b-a93b-7e631d3e1371 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] [instance: 2ddb58d0-8137-4755-80e1-eb12a4967bc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:02:27.638280 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-822a3eae-03aa-41b0-9c09-50be5c401257 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "POST /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f/action" status: 200 len: 324 microversion: 2.1 time: 0.111621 Sep 10 12:02:27.639530 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2350/4706] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:02:27 2022] POST /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f/action => generated 324 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:02:27.650302 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4c1be05a-0ad5-4c1e-9fbd-61af7555c049 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:27.651138 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4c1be05a-0ad5-4c1e-9fbd-61af7555c049 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:27.665586 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4c1be05a-0ad5-4c1e-9fbd-61af7555c049 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:27.667781 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4c1be05a-0ad5-4c1e-9fbd-61af7555c049 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:27.670398 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4c1be05a-0ad5-4c1e-9fbd-61af7555c049 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:27.671268 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4c1be05a-0ad5-4c1e-9fbd-61af7555c049 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:27.671827 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4c1be05a-0ad5-4c1e-9fbd-61af7555c049 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:27.672369 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4c1be05a-0ad5-4c1e-9fbd-61af7555c049 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:27.686223 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-77fef87e-da46-477b-a93b-7e631d3e1371 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Getting quotas for project 3723fdd806f448c1986e3dd235b09185. Resources: {'server_group_members'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:02:27.701862 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-77fef87e-da46-477b-a93b-7e631d3e1371 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Getting quotas for user 05d28e8b26f84c3ba10a4552b6b40930 and project 3723fdd806f448c1986e3dd235b09185. Resources: {'server_group_members'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:02:27.823704 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-77fef87e-da46-477b-a93b-7e631d3e1371 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Getting quotas for project 3723fdd806f448c1986e3dd235b09185. Resources: {'server_group_members'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:02:27.849958 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-77fef87e-da46-477b-a93b-7e631d3e1371 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Getting quotas for user 05d28e8b26f84c3ba10a4552b6b40930 and project 3723fdd806f448c1986e3dd235b09185. Resources: {'server_group_members'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:02:27.863815 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4c1be05a-0ad5-4c1e-9fbd-61af7555c049 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:27.874849 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4c1be05a-0ad5-4c1e-9fbd-61af7555c049 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.229017 Sep 10 12:02:27.876560 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2351/4707] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:27 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:27.888610 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f53c605a-530e-4da7-8fa0-3cfeba23dde7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:27.889452 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f53c605a-530e-4da7-8fa0-3cfeba23dde7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f6556ea4-d20e-4561-8793-d1d4412fad26] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:27.896803 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f53c605a-530e-4da7-8fa0-3cfeba23dde7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:27.897491 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f53c605a-530e-4da7-8fa0-3cfeba23dde7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:27.898097 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f53c605a-530e-4da7-8fa0-3cfeba23dde7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:27.900154 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f53c605a-530e-4da7-8fa0-3cfeba23dde7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:27.900971 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f53c605a-530e-4da7-8fa0-3cfeba23dde7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:27.901431 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f53c605a-530e-4da7-8fa0-3cfeba23dde7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:27.938673 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-77fef87e-da46-477b-a93b-7e631d3e1371 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.372500 Sep 10 12:02:27.940991 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2357/4708] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:02:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1379 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:02:27.959534 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2f01166e-aedb-4479-8228-cee4ba16904e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:27.963742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2f01166e-aedb-4479-8228-cee4ba16904e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:27.975413 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f01166e-aedb-4479-8228-cee4ba16904e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:28.003759 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f01166e-aedb-4479-8228-cee4ba16904e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:28.004236 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f01166e-aedb-4479-8228-cee4ba16904e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:28.004993 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f01166e-aedb-4479-8228-cee4ba16904e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:28.005459 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f01166e-aedb-4479-8228-cee4ba16904e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:28.005896 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f01166e-aedb-4479-8228-cee4ba16904e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:28.217666 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f53c605a-530e-4da7-8fa0-3cfeba23dde7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:28.230251 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f53c605a-530e-4da7-8fa0-3cfeba23dde7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f6556ea4-d20e-4561-8793-d1d4412fad26" status: 200 len: 1503 microversion: 2.1 time: 0.348329 Sep 10 12:02:28.239577 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2352/4709] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:27 2022] GET /compute/v2.1/servers/f6556ea4-d20e-4561-8793-d1d4412fad26 => generated 1503 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:28.257441 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-45c7ff74-bef6-4cf0-bdc7-e332399d5265 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:28.260857 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-45c7ff74-bef6-4cf0-bdc7-e332399d5265 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] [instance: 2ddb58d0-8137-4755-80e1-eb12a4967bc9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:28.405590 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-45c7ff74-bef6-4cf0-bdc7-e332399d5265 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d28e8b26f84c3ba10a4552b6b40930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3723fdd806f448c1986e3dd235b09185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:28.424957 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-45c7ff74-bef6-4cf0-bdc7-e332399d5265 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] 10.222.0.23 "GET /compute/v2.1/servers/2ddb58d0-8137-4755-80e1-eb12a4967bc9" status: 200 len: 1213 microversion: 2.1 time: 0.183661 Sep 10 12:02:28.434752 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2353/4710] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:28 2022] GET /compute/v2.1/servers/2ddb58d0-8137-4755-80e1-eb12a4967bc9 => generated 1213 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:28.439915 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e5bfe230-76af-41a2-af4c-efcdeaa3508b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:28.442784 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e5bfe230-76af-41a2-af4c-efcdeaa3508b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f6556ea4-d20e-4561-8793-d1d4412fad26] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:28.468787 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e5bfe230-76af-41a2-af4c-efcdeaa3508b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:28.471983 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e5bfe230-76af-41a2-af4c-efcdeaa3508b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:28.472269 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e5bfe230-76af-41a2-af4c-efcdeaa3508b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:28.473063 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e5bfe230-76af-41a2-af4c-efcdeaa3508b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:28.480753 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e5bfe230-76af-41a2-af4c-efcdeaa3508b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:28.481211 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e5bfe230-76af-41a2-af4c-efcdeaa3508b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:28.512172 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2f01166e-aedb-4479-8228-cee4ba16904e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:28.526681 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2f01166e-aedb-4479-8228-cee4ba16904e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.584287 Sep 10 12:02:28.527559 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2358/4711] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:27 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:28.559627 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-963abeef-7b3c-4c15-b112-b4e7ba323694 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:28.560258 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-963abeef-7b3c-4c15-b112-b4e7ba323694 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:28.569165 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-963abeef-7b3c-4c15-b112-b4e7ba323694 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:28.570723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-963abeef-7b3c-4c15-b112-b4e7ba323694 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:28.571555 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-963abeef-7b3c-4c15-b112-b4e7ba323694 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:28.574772 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-963abeef-7b3c-4c15-b112-b4e7ba323694 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:28.576260 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-963abeef-7b3c-4c15-b112-b4e7ba323694 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:28.582807 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-963abeef-7b3c-4c15-b112-b4e7ba323694 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:28.848270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e5bfe230-76af-41a2-af4c-efcdeaa3508b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:28.858415 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e5bfe230-76af-41a2-af4c-efcdeaa3508b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f6556ea4-d20e-4561-8793-d1d4412fad26" status: 200 len: 1503 microversion: 2.1 time: 0.432013 Sep 10 12:02:28.862610 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2354/4712] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:28 2022] GET /compute/v2.1/servers/f6556ea4-d20e-4561-8793-d1d4412fad26 => generated 1503 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:28.887670 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-450c3bf7-f97e-4959-b7a5-8c27fc158b6e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:28.888477 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-450c3bf7-f97e-4959-b7a5-8c27fc158b6e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f6556ea4-d20e-4561-8793-d1d4412fad26] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:28.901009 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-450c3bf7-f97e-4959-b7a5-8c27fc158b6e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:28.901796 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-450c3bf7-f97e-4959-b7a5-8c27fc158b6e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:28.903630 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-450c3bf7-f97e-4959-b7a5-8c27fc158b6e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:28.904398 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-450c3bf7-f97e-4959-b7a5-8c27fc158b6e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:28.904793 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-450c3bf7-f97e-4959-b7a5-8c27fc158b6e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:28.912315 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-450c3bf7-f97e-4959-b7a5-8c27fc158b6e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:28.965108 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-450c3bf7-f97e-4959-b7a5-8c27fc158b6e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f6556ea4-d20e-4561-8793-d1d4412fad26] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:02:29.048621 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-963abeef-7b3c-4c15-b112-b4e7ba323694 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:29.059650 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-963abeef-7b3c-4c15-b112-b4e7ba323694 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.509736 Sep 10 12:02:29.079498 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2359/4713] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:28 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:29.099771 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-282cb876-ce87-4ca2-9760-aa1d190013e8 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:29.101348 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-282cb876-ce87-4ca2-9760-aa1d190013e8 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:29.128919 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-450c3bf7-f97e-4959-b7a5-8c27fc158b6e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f6556ea4-d20e-4561-8793-d1d4412fad26" status: 204 len: 0 microversion: 2.1 time: 0.244895 Sep 10 12:02:29.131724 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2355/4714] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:02:28 2022] DELETE /compute/v2.1/servers/f6556ea4-d20e-4561-8793-d1d4412fad26 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 12:02:29.134539 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-282cb876-ce87-4ca2-9760-aa1d190013e8 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:29.135374 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-282cb876-ce87-4ca2-9760-aa1d190013e8 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:29.135834 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-282cb876-ce87-4ca2-9760-aa1d190013e8 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:29.136764 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-282cb876-ce87-4ca2-9760-aa1d190013e8 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:29.137138 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-282cb876-ce87-4ca2-9760-aa1d190013e8 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:29.137579 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-282cb876-ce87-4ca2-9760-aa1d190013e8 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:29.150695 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d4628a3d-ec59-4a6a-9853-7926c992da54 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:29.158062 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d4628a3d-ec59-4a6a-9853-7926c992da54 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f6556ea4-d20e-4561-8793-d1d4412fad26] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:29.166101 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d4628a3d-ec59-4a6a-9853-7926c992da54 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:29.168474 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d4628a3d-ec59-4a6a-9853-7926c992da54 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:29.171822 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d4628a3d-ec59-4a6a-9853-7926c992da54 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:29.173441 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d4628a3d-ec59-4a6a-9853-7926c992da54 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:29.175128 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d4628a3d-ec59-4a6a-9853-7926c992da54 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:29.178892 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d4628a3d-ec59-4a6a-9853-7926c992da54 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:29.592808 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-282cb876-ce87-4ca2-9760-aa1d190013e8 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:29.601582 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-282cb876-ce87-4ca2-9760-aa1d190013e8 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.518887 Sep 10 12:02:29.604841 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2360/4715] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:29 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:29.617493 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b2d3f54c-54bd-4340-9d18-e8ea21d26192 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:29.618272 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b2d3f54c-54bd-4340-9d18-e8ea21d26192 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] [instance: 2ddb58d0-8137-4755-80e1-eb12a4967bc9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:29.635562 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b2d3f54c-54bd-4340-9d18-e8ea21d26192 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:29.636094 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b2d3f54c-54bd-4340-9d18-e8ea21d26192 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:29.636912 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b2d3f54c-54bd-4340-9d18-e8ea21d26192 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:29.637256 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b2d3f54c-54bd-4340-9d18-e8ea21d26192 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:29.637715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b2d3f54c-54bd-4340-9d18-e8ea21d26192 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:29.638151 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b2d3f54c-54bd-4340-9d18-e8ea21d26192 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:29.937377 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d4628a3d-ec59-4a6a-9853-7926c992da54 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:29.954953 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d4628a3d-ec59-4a6a-9853-7926c992da54 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f6556ea4-d20e-4561-8793-d1d4412fad26" status: 200 len: 1509 microversion: 2.1 time: 0.820105 Sep 10 12:02:29.957729 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2356/4716] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:29 2022] GET /compute/v2.1/servers/f6556ea4-d20e-4561-8793-d1d4412fad26 => generated 1509 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:29.970365 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-37464335-80f4-4ece-81b4-7f5d3e5623ad tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-549081661", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "2b93427c-8a73-4134-b29e-29ba6a3e29a6"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:02:30.032580 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b2d3f54c-54bd-4340-9d18-e8ea21d26192 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d28e8b26f84c3ba10a4552b6b40930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3723fdd806f448c1986e3dd235b09185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:30.041726 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b2d3f54c-54bd-4340-9d18-e8ea21d26192 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] 10.222.0.23 "GET /compute/v2.1/servers/2ddb58d0-8137-4755-80e1-eb12a4967bc9" status: 200 len: 1265 microversion: 2.1 time: 0.435212 Sep 10 12:02:30.046063 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2361/4717] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:29 2022] GET /compute/v2.1/servers/2ddb58d0-8137-4755-80e1-eb12a4967bc9 => generated 1265 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:30.067139 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-37464335-80f4-4ece-81b4-7f5d3e5623ad tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] validate_networks() for [('2b93427c-8a73-4134-b29e-29ba6a3e29a6', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:02:30.982693 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-29aa426e-1b5a-44fd-ac93-864ce15b6c01 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:30.984112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-29aa426e-1b5a-44fd-ac93-864ce15b6c01 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f6556ea4-d20e-4561-8793-d1d4412fad26] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:30.991910 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29aa426e-1b5a-44fd-ac93-864ce15b6c01 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:30.992765 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29aa426e-1b5a-44fd-ac93-864ce15b6c01 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:30.993441 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29aa426e-1b5a-44fd-ac93-864ce15b6c01 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:30.994405 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29aa426e-1b5a-44fd-ac93-864ce15b6c01 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:30.995118 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29aa426e-1b5a-44fd-ac93-864ce15b6c01 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:30.995813 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29aa426e-1b5a-44fd-ac93-864ce15b6c01 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:31.407791 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-29aa426e-1b5a-44fd-ac93-864ce15b6c01 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:31.416511 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-29aa426e-1b5a-44fd-ac93-864ce15b6c01 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f6556ea4-d20e-4561-8793-d1d4412fad26" status: 200 len: 1509 microversion: 2.1 time: 0.437994 Sep 10 12:02:31.420259 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2362/4718] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:30 2022] GET /compute/v2.1/servers/f6556ea4-d20e-4561-8793-d1d4412fad26 => generated 1509 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:02:31.448064 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b960751b-89ff-47a5-8956-a8298982d6e9 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:31.448724 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b960751b-89ff-47a5-8956-a8298982d6e9 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] [instance: 2ddb58d0-8137-4755-80e1-eb12a4967bc9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:31.455709 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b960751b-89ff-47a5-8956-a8298982d6e9 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:31.456203 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b960751b-89ff-47a5-8956-a8298982d6e9 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:31.456641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b960751b-89ff-47a5-8956-a8298982d6e9 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:31.457352 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b960751b-89ff-47a5-8956-a8298982d6e9 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:31.458110 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b960751b-89ff-47a5-8956-a8298982d6e9 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:31.458542 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b960751b-89ff-47a5-8956-a8298982d6e9 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:31.581600 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b960751b-89ff-47a5-8956-a8298982d6e9 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d28e8b26f84c3ba10a4552b6b40930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3723fdd806f448c1986e3dd235b09185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:31.608411 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b960751b-89ff-47a5-8956-a8298982d6e9 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] 10.222.0.23 "GET /compute/v2.1/servers/2ddb58d0-8137-4755-80e1-eb12a4967bc9" status: 200 len: 1271 microversion: 2.1 time: 0.186032 Sep 10 12:02:31.620408 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2363/4719] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:31 2022] GET /compute/v2.1/servers/2ddb58d0-8137-4755-80e1-eb12a4967bc9 => generated 1271 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:31.664988 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-37464335-80f4-4ece-81b4-7f5d3e5623ad tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:02:31.665622 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-37464335-80f4-4ece-81b4-7f5d3e5623ad tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:02:31.666111 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-37464335-80f4-4ece-81b4-7f5d3e5623ad tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:02:31.667112 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-37464335-80f4-4ece-81b4-7f5d3e5623ad tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:02:31.667636 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-37464335-80f4-4ece-81b4-7f5d3e5623ad tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:02:31.681102 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-37464335-80f4-4ece-81b4-7f5d3e5623ad tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:31.681682 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-37464335-80f4-4ece-81b4-7f5d3e5623ad tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:31.682237 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-37464335-80f4-4ece-81b4-7f5d3e5623ad tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:31.683045 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-37464335-80f4-4ece-81b4-7f5d3e5623ad tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:31.695065 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-37464335-80f4-4ece-81b4-7f5d3e5623ad tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:31.695863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-37464335-80f4-4ece-81b4-7f5d3e5623ad tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:31.721290 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:02:31.742074 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-37464335-80f4-4ece-81b4-7f5d3e5623ad tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Getting quotas for project 2410f9544bec4633988e1554111c9446. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:02:31.752129 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-37464335-80f4-4ece-81b4-7f5d3e5623ad tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Getting quotas for user 8954f3256ddd49639ea57a9242a296d0 and project 2410f9544bec4633988e1554111c9446. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:02:31.782743 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-37464335-80f4-4ece-81b4-7f5d3e5623ad tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:02:31.785498 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-37464335-80f4-4ece-81b4-7f5d3e5623ad tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: d40780fb-43a4-47fa-821d-a2a69413ee0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:02:31.884759 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-37464335-80f4-4ece-81b4-7f5d3e5623ad tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.925774 Sep 10 12:02:31.886041 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2357/4720] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:02:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:02:31.898426 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2d85867e-4343-49e9-8cab-817be480d4cb tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:31.899052 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2d85867e-4343-49e9-8cab-817be480d4cb tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: d40780fb-43a4-47fa-821d-a2a69413ee0b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:32.302693 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2d85867e-4343-49e9-8cab-817be480d4cb tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:32.311575 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2d85867e-4343-49e9-8cab-817be480d4cb tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b" status: 200 len: 1214 microversion: 2.1 time: 0.417239 Sep 10 12:02:32.316436 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2364/4721] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:31 2022] GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b => generated 1214 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:32.447563 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8d7c0926-4262-4004-8c22-00a2ee2a9b62 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:32.448188 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8d7c0926-4262-4004-8c22-00a2ee2a9b62 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f6556ea4-d20e-4561-8793-d1d4412fad26] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:32.462840 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8d7c0926-4262-4004-8c22-00a2ee2a9b62 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:32.465459 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8d7c0926-4262-4004-8c22-00a2ee2a9b62 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:32.467185 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8d7c0926-4262-4004-8c22-00a2ee2a9b62 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:32.468746 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8d7c0926-4262-4004-8c22-00a2ee2a9b62 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:32.472696 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8d7c0926-4262-4004-8c22-00a2ee2a9b62 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:32.473870 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8d7c0926-4262-4004-8c22-00a2ee2a9b62 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:32.643926 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-42f2ac54-cd0d-4cef-be34-dfede74b684e tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:32.644449 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-42f2ac54-cd0d-4cef-be34-dfede74b684e tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] [instance: 2ddb58d0-8137-4755-80e1-eb12a4967bc9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:32.663935 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-42f2ac54-cd0d-4cef-be34-dfede74b684e tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:32.664349 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-42f2ac54-cd0d-4cef-be34-dfede74b684e tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:32.664788 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-42f2ac54-cd0d-4cef-be34-dfede74b684e tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:32.665501 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-42f2ac54-cd0d-4cef-be34-dfede74b684e tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:32.665957 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-42f2ac54-cd0d-4cef-be34-dfede74b684e tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:32.666382 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-42f2ac54-cd0d-4cef-be34-dfede74b684e tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:32.802468 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8d7c0926-4262-4004-8c22-00a2ee2a9b62 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:32.818171 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8d7c0926-4262-4004-8c22-00a2ee2a9b62 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f6556ea4-d20e-4561-8793-d1d4412fad26" status: 200 len: 1467 microversion: 2.1 time: 0.368165 Sep 10 12:02:32.824575 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2358/4722] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:32 2022] GET /compute/v2.1/servers/f6556ea4-d20e-4561-8793-d1d4412fad26 => generated 1467 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:32.841016 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-7f52ffd6-5221-482a-a719-6cb822cc252c req-844bf4e4-8a29-4217-942a-5ae342c58d20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6556ea4-d20e-4561-8793-d1d4412fad26", "name": "network-vif-deleted", "tag": "d29790bc-2fc8-480c-94f5-b871a76ca54c"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:02:32.869345 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-7f52ffd6-5221-482a-a719-6cb822cc252c req-844bf4e4-8a29-4217-942a-5ae342c58d20 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:32.877902 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-7f52ffd6-5221-482a-a719-6cb822cc252c req-844bf4e4-8a29-4217-942a-5ae342c58d20 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:32.880251 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-7f52ffd6-5221-482a-a719-6cb822cc252c req-844bf4e4-8a29-4217-942a-5ae342c58d20 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:32.920665 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-7f52ffd6-5221-482a-a719-6cb822cc252c req-844bf4e4-8a29-4217-942a-5ae342c58d20 service nova] Creating event network-vif-deleted:d29790bc-2fc8-480c-94f5-b871a76ca54c for instance f6556ea4-d20e-4561-8793-d1d4412fad26 on n-h2-856895-1 Sep 10 12:02:32.935194 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-7f52ffd6-5221-482a-a719-6cb822cc252c req-844bf4e4-8a29-4217-942a-5ae342c58d20 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109193 Sep 10 12:02:32.939405 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2359/4723] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:02:33.306893 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-42f2ac54-cd0d-4cef-be34-dfede74b684e tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d28e8b26f84c3ba10a4552b6b40930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3723fdd806f448c1986e3dd235b09185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:33.325685 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-42f2ac54-cd0d-4cef-be34-dfede74b684e tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] 10.222.0.23 "GET /compute/v2.1/servers/2ddb58d0-8137-4755-80e1-eb12a4967bc9" status: 200 len: 1313 microversion: 2.1 time: 0.686244 Sep 10 12:02:33.333175 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2365/4724] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:32 2022] GET /compute/v2.1/servers/2ddb58d0-8137-4755-80e1-eb12a4967bc9 => generated 1313 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:33.352343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-42d58585-9f96-42ea-b0dc-8ec193c5bd87 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:33.353314 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-42d58585-9f96-42ea-b0dc-8ec193c5bd87 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: d40780fb-43a4-47fa-821d-a2a69413ee0b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:33.369312 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42d58585-9f96-42ea-b0dc-8ec193c5bd87 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:33.370139 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42d58585-9f96-42ea-b0dc-8ec193c5bd87 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:33.370784 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42d58585-9f96-42ea-b0dc-8ec193c5bd87 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:33.371720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42d58585-9f96-42ea-b0dc-8ec193c5bd87 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:33.372356 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42d58585-9f96-42ea-b0dc-8ec193c5bd87 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:33.372949 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42d58585-9f96-42ea-b0dc-8ec193c5bd87 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:33.538878 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-42d58585-9f96-42ea-b0dc-8ec193c5bd87 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:33.552347 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-42d58585-9f96-42ea-b0dc-8ec193c5bd87 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b" status: 200 len: 1266 microversion: 2.1 time: 0.221645 Sep 10 12:02:33.553669 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2360/4725] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:33 2022] GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:02:33.854652 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-32d19398-df95-4901-9423-474ddd3afbae tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:33.855857 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-32d19398-df95-4901-9423-474ddd3afbae tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f6556ea4-d20e-4561-8793-d1d4412fad26] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:33.863805 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32d19398-df95-4901-9423-474ddd3afbae tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:33.871639 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32d19398-df95-4901-9423-474ddd3afbae tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:33.872395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32d19398-df95-4901-9423-474ddd3afbae tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:33.873374 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32d19398-df95-4901-9423-474ddd3afbae tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:33.874166 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32d19398-df95-4901-9423-474ddd3afbae tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:33.874892 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32d19398-df95-4901-9423-474ddd3afbae tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:33.909831 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-32d19398-df95-4901-9423-474ddd3afbae tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] HTTP exception thrown: Instance f6556ea4-d20e-4561-8793-d1d4412fad26 could not be found. Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-32d19398-df95-4901-9423-474ddd3afbae tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Request method failure captured: Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/f6556ea4-d20e-4561-8793-d1d4412fad26 HTTP/1.1 Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHykcWQYupGxhcLpb6v5AsrUV8qZ6sg9Ki1Jfb5jCMoRjGicsw0WManJo8IjBppMD5CxQdT4hQu3IHHi54G_V7lvb8EgCj19qVHNlr3p45qCyo-pmA_bA7FrmqWJZSaCbHLCvlYvItyJikej-C_PUFDVoe9D_fp0roxy7XQj-_YcxQA Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersTestJSON-793172710 Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ac8b3e9f72234d9985fbc5fa7e7984ad", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersTestJSON-793172710 Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersTestJSON-793172710 Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersTestJSON-793172710-project Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: ef32131362a3442498234c0554f08305 Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersTestJSON-793172710-project Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance f6556ea4-d20e-4561-8793-d1d4412fad26 could not be found. Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'f6556ea4-d20e-4561-8793-d1d4412fad26'} Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6556ea4-d20e-4561-8793-d1d4412fad26 could not be found. Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6556ea4-d20e-4561-8793-d1d4412fad26 could not be found. Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:02:33.912594 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:02:33.918073 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:02:33.918073 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:02:33.918073 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:02:33.918073 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:02:33.918073 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6556ea4-d20e-4561-8793-d1d4412fad26 could not be found. Sep 10 12:02:33.918073 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:02:33.919040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-32d19398-df95-4901-9423-474ddd3afbae tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Returning 404 to user: Instance f6556ea4-d20e-4561-8793-d1d4412fad26 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:02:33.923655 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-32d19398-df95-4901-9423-474ddd3afbae tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f6556ea4-d20e-4561-8793-d1d4412fad26" status: 404 len: 111 microversion: 2.1 time: 0.073365 Sep 10 12:02:33.924460 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2366/4726] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:33 2022] GET /compute/v2.1/servers/f6556ea4-d20e-4561-8793-d1d4412fad26 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:02:33.940872 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dc19e94b-e149-4fa6-9ea1-816ff8ea2bcc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Action: 'create', calling method: .version_select at 0x7f4072987f70>, body: {"keypair": {"name": "tempest-key-1096322848", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMU1LwFtkd2MJ5r21omTQieFk/TEkDDuskePXV9usHkhJWzlp3DO/QK/GGsFmxrysHsWcQft+r9OTJ+UYSRVOr4bcW1wCC4PGaSpJSZf7ZufBIsBxvXbjXej8a5fBuDmA=="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:02:33.962017 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-dc19e94b-e149-4fa6-9ea1-816ff8ea2bcc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Getting quotas for project ac8b3e9f72234d9985fbc5fa7e7984ad. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:02:33.969771 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-dc19e94b-e149-4fa6-9ea1-816ff8ea2bcc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Getting quotas for user ef32131362a3442498234c0554f08305 and project ac8b3e9f72234d9985fbc5fa7e7984ad. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:02:34.007464 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-dc19e94b-e149-4fa6-9ea1-816ff8ea2bcc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.072241 Sep 10 12:02:34.013826 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2361/4727] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 12:02:33 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:02:34.055036 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ffae17f8-5d02-445a-b617-afa61eda8001 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '.version_select at 0x7f40734eff70>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:34.071264 n-d-856895-1 devstack@n-api.service[128777]: WARNING oslo_db.sqlalchemy.utils [None req-ffae17f8-5d02-445a-b617-afa61eda8001 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 10 12:02:34.100156 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ffae17f8-5d02-445a-b617-afa61eda8001 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.064906 Sep 10 12:02:34.102494 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2367/4728] 10.222.0.23 () {58 vars in 1137 bytes} [Sat Sep 10 12:02:34 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:02:34.282200 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3bce3a90-70ee-4893-9e8c-f81dac4d2246 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1589153305", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "key_name": "tempest-key-1096322848", "networks": [{"uuid": "5a10f3ce-b3db-41f2-acaa-21e8715e6fe6"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:02:34.355492 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-3bce3a90-70ee-4893-9e8c-f81dac4d2246 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] validate_networks() for [('5a10f3ce-b3db-41f2-acaa-21e8715e6fe6', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:02:34.364129 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8d18e93d-a53d-419e-ac42-617c4996bf48 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:34.364755 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8d18e93d-a53d-419e-ac42-617c4996bf48 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] [instance: 2ddb58d0-8137-4755-80e1-eb12a4967bc9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:34.374628 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8d18e93d-a53d-419e-ac42-617c4996bf48 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:34.375216 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8d18e93d-a53d-419e-ac42-617c4996bf48 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:34.375669 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8d18e93d-a53d-419e-ac42-617c4996bf48 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:34.376391 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8d18e93d-a53d-419e-ac42-617c4996bf48 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:34.378384 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8d18e93d-a53d-419e-ac42-617c4996bf48 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:34.379522 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8d18e93d-a53d-419e-ac42-617c4996bf48 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:34.815622 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8d18e93d-a53d-419e-ac42-617c4996bf48 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d28e8b26f84c3ba10a4552b6b40930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3723fdd806f448c1986e3dd235b09185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:34.824517 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8d18e93d-a53d-419e-ac42-617c4996bf48 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] 10.222.0.23 "GET /compute/v2.1/servers/2ddb58d0-8137-4755-80e1-eb12a4967bc9" status: 200 len: 1313 microversion: 2.1 time: 0.466889 Sep 10 12:02:34.832892 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2368/4729] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:34 2022] GET /compute/v2.1/servers/2ddb58d0-8137-4755-80e1-eb12a4967bc9 => generated 1313 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:34.837935 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e947981f-8340-4198-8e4c-6b993111a164 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:34.845991 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e947981f-8340-4198-8e4c-6b993111a164 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: d40780fb-43a4-47fa-821d-a2a69413ee0b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:34.861690 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:02:34.863633 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e947981f-8340-4198-8e4c-6b993111a164 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:34.867389 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e947981f-8340-4198-8e4c-6b993111a164 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:34.868253 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e947981f-8340-4198-8e4c-6b993111a164 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:34.869207 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e947981f-8340-4198-8e4c-6b993111a164 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:34.869866 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e947981f-8340-4198-8e4c-6b993111a164 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:34.871711 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e947981f-8340-4198-8e4c-6b993111a164 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:35.099580 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e947981f-8340-4198-8e4c-6b993111a164 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:35.115022 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e947981f-8340-4198-8e4c-6b993111a164 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b" status: 200 len: 1272 microversion: 2.1 time: 0.280262 Sep 10 12:02:35.137586 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2369/4730] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:34 2022] GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b => generated 1272 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:35.563960 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-3bce3a90-70ee-4893-9e8c-f81dac4d2246 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:02:35.564559 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-3bce3a90-70ee-4893-9e8c-f81dac4d2246 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:02:35.565093 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-3bce3a90-70ee-4893-9e8c-f81dac4d2246 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:02:35.565618 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-3bce3a90-70ee-4893-9e8c-f81dac4d2246 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:02:35.566145 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-3bce3a90-70ee-4893-9e8c-f81dac4d2246 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:02:35.579723 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3bce3a90-70ee-4893-9e8c-f81dac4d2246 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:35.584689 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3bce3a90-70ee-4893-9e8c-f81dac4d2246 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:35.585265 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3bce3a90-70ee-4893-9e8c-f81dac4d2246 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:35.586245 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3bce3a90-70ee-4893-9e8c-f81dac4d2246 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:35.586818 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3bce3a90-70ee-4893-9e8c-f81dac4d2246 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:35.587390 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3bce3a90-70ee-4893-9e8c-f81dac4d2246 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:35.648566 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-3bce3a90-70ee-4893-9e8c-f81dac4d2246 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Getting quotas for project ac8b3e9f72234d9985fbc5fa7e7984ad. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:02:35.670857 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-3bce3a90-70ee-4893-9e8c-f81dac4d2246 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Getting quotas for user ef32131362a3442498234c0554f08305 and project ac8b3e9f72234d9985fbc5fa7e7984ad. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:02:35.705129 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3bce3a90-70ee-4893-9e8c-f81dac4d2246 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:02:35.713218 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3bce3a90-70ee-4893-9e8c-f81dac4d2246 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 00e23b21-ab07-4ce8-b66e-385261d61d7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:02:35.834630 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3bce3a90-70ee-4893-9e8c-f81dac4d2246 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.557959 Sep 10 12:02:35.841318 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2362/4731] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:02:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 12:02:35.846617 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-06fa7297-007a-4be1-a9b5-9b089b5e047c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:35.847284 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-06fa7297-007a-4be1-a9b5-9b089b5e047c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 00e23b21-ab07-4ce8-b66e-385261d61d7f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:35.855682 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fcdbfda5-b807-45be-8e39-b87f1a674bbf tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:35.856361 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fcdbfda5-b807-45be-8e39-b87f1a674bbf tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] [instance: 2ddb58d0-8137-4755-80e1-eb12a4967bc9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:35.865340 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fcdbfda5-b807-45be-8e39-b87f1a674bbf tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:35.865839 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fcdbfda5-b807-45be-8e39-b87f1a674bbf tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:35.866277 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fcdbfda5-b807-45be-8e39-b87f1a674bbf tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:35.888489 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fcdbfda5-b807-45be-8e39-b87f1a674bbf tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:35.890647 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fcdbfda5-b807-45be-8e39-b87f1a674bbf tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:35.891745 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fcdbfda5-b807-45be-8e39-b87f1a674bbf tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:36.022124 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-06fa7297-007a-4be1-a9b5-9b089b5e047c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:36.029247 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-06fa7297-007a-4be1-a9b5-9b089b5e047c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f" status: 200 len: 1229 microversion: 2.1 time: 0.186543 Sep 10 12:02:36.032724 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2370/4732] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:35 2022] GET /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f => generated 1229 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:36.144282 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-aa92e874-ea2b-4afb-9676-09c12f939c16 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:36.144909 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-aa92e874-ea2b-4afb-9676-09c12f939c16 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: d40780fb-43a4-47fa-821d-a2a69413ee0b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:36.177863 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa92e874-ea2b-4afb-9676-09c12f939c16 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:36.184891 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa92e874-ea2b-4afb-9676-09c12f939c16 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:36.186753 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa92e874-ea2b-4afb-9676-09c12f939c16 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:36.190492 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa92e874-ea2b-4afb-9676-09c12f939c16 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:36.191426 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa92e874-ea2b-4afb-9676-09c12f939c16 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:36.194435 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa92e874-ea2b-4afb-9676-09c12f939c16 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:37.075740 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-aa92e874-ea2b-4afb-9676-09c12f939c16 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:37.089620 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-aa92e874-ea2b-4afb-9676-09c12f939c16 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b" status: 200 len: 1314 microversion: 2.1 time: 0.949358 Sep 10 12:02:37.092177 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2371/4733] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:36 2022] GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b => generated 1314 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:02:37.117492 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fcdbfda5-b807-45be-8e39-b87f1a674bbf tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d28e8b26f84c3ba10a4552b6b40930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3723fdd806f448c1986e3dd235b09185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:37.138214 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fcdbfda5-b807-45be-8e39-b87f1a674bbf tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] 10.222.0.23 "GET /compute/v2.1/servers/2ddb58d0-8137-4755-80e1-eb12a4967bc9" status: 200 len: 1313 microversion: 2.1 time: 1.287174 Sep 10 12:02:37.139939 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-c6e43380-5150-440b-9bcb-cd184fb2138d req-a83fda0e-81e0-4468-ae6a-62e3de4e1362 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ddb58d0-8137-4755-80e1-eb12a4967bc9", "tag": "fc558740-2be6-40f9-91a3-311111c16b14"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:02:37.145735 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2363/4734] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:35 2022] GET /compute/v2.1/servers/2ddb58d0-8137-4755-80e1-eb12a4967bc9 => generated 1313 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:37.158767 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-70103458-9051-44f0-8e9c-8651d9258dc6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:37.166631 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-70103458-9051-44f0-8e9c-8651d9258dc6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 00e23b21-ab07-4ce8-b66e-385261d61d7f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:37.176093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-c6e43380-5150-440b-9bcb-cd184fb2138d req-a83fda0e-81e0-4468-ae6a-62e3de4e1362 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:37.179252 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-c6e43380-5150-440b-9bcb-cd184fb2138d req-a83fda0e-81e0-4468-ae6a-62e3de4e1362 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:37.181975 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-c6e43380-5150-440b-9bcb-cd184fb2138d req-a83fda0e-81e0-4468-ae6a-62e3de4e1362 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:37.185791 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-70103458-9051-44f0-8e9c-8651d9258dc6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:37.189881 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-70103458-9051-44f0-8e9c-8651d9258dc6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:37.193301 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-70103458-9051-44f0-8e9c-8651d9258dc6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:37.205092 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-70103458-9051-44f0-8e9c-8651d9258dc6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:37.207005 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-70103458-9051-44f0-8e9c-8651d9258dc6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:37.209961 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-70103458-9051-44f0-8e9c-8651d9258dc6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:37.237992 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-c6e43380-5150-440b-9bcb-cd184fb2138d req-a83fda0e-81e0-4468-ae6a-62e3de4e1362 service nova] Creating event network-changed:fc558740-2be6-40f9-91a3-311111c16b14 for instance 2ddb58d0-8137-4755-80e1-eb12a4967bc9 on n-h1-856895-1 Sep 10 12:02:37.248070 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-c6e43380-5150-440b-9bcb-cd184fb2138d req-a83fda0e-81e0-4468-ae6a-62e3de4e1362 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141709 Sep 10 12:02:37.251147 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2372/4735] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:02:37.368490 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-70103458-9051-44f0-8e9c-8651d9258dc6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:37.383885 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-70103458-9051-44f0-8e9c-8651d9258dc6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f" status: 200 len: 1281 microversion: 2.1 time: 0.235071 Sep 10 12:02:37.386534 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2364/4736] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:37 2022] GET /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f => generated 1281 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:38.125254 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bf9ea0a5-3bd2-4883-b531-fbce4ac361f1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:38.126603 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bf9ea0a5-3bd2-4883-b531-fbce4ac361f1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: d40780fb-43a4-47fa-821d-a2a69413ee0b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:38.149374 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:02:38.157810 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bf9ea0a5-3bd2-4883-b531-fbce4ac361f1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:38.158321 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bf9ea0a5-3bd2-4883-b531-fbce4ac361f1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:38.159994 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bf9ea0a5-3bd2-4883-b531-fbce4ac361f1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:38.162116 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bf9ea0a5-3bd2-4883-b531-fbce4ac361f1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:38.164255 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bf9ea0a5-3bd2-4883-b531-fbce4ac361f1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:38.165047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bf9ea0a5-3bd2-4883-b531-fbce4ac361f1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:38.172961 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ab3a88b4-7ecd-4143-aba9-ffe25c0a87ee tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:38.176826 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ab3a88b4-7ecd-4143-aba9-ffe25c0a87ee tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] [instance: 2ddb58d0-8137-4755-80e1-eb12a4967bc9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:38.191691 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab3a88b4-7ecd-4143-aba9-ffe25c0a87ee tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:38.193921 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab3a88b4-7ecd-4143-aba9-ffe25c0a87ee tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:38.194635 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab3a88b4-7ecd-4143-aba9-ffe25c0a87ee tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:38.197179 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab3a88b4-7ecd-4143-aba9-ffe25c0a87ee tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:38.198800 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab3a88b4-7ecd-4143-aba9-ffe25c0a87ee tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:38.205040 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab3a88b4-7ecd-4143-aba9-ffe25c0a87ee tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:38.591673 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bf9ea0a5-3bd2-4883-b531-fbce4ac361f1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:38.597254 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ab3a88b4-7ecd-4143-aba9-ffe25c0a87ee tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d28e8b26f84c3ba10a4552b6b40930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3723fdd806f448c1986e3dd235b09185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:38.601216 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bf9ea0a5-3bd2-4883-b531-fbce4ac361f1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b" status: 200 len: 1314 microversion: 2.1 time: 0.480163 Sep 10 12:02:38.601818 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2373/4737] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:38 2022] GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:38.622819 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-0aa055b6-9377-417a-956c-76d0437a7cdf req-4b1e9902-7379-4792-a769-64d1bca5f14f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d40780fb-43a4-47fa-821d-a2a69413ee0b", "tag": "00131652-1889-4a1b-b98b-7e9ab46ecfba"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:02:38.629741 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ab3a88b4-7ecd-4143-aba9-ffe25c0a87ee tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] 10.222.0.23 "GET /compute/v2.1/servers/2ddb58d0-8137-4755-80e1-eb12a4967bc9" status: 200 len: 1313 microversion: 2.1 time: 0.463651 Sep 10 12:02:38.633286 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2365/4738] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:38 2022] GET /compute/v2.1/servers/2ddb58d0-8137-4755-80e1-eb12a4967bc9 => generated 1313 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:02:38.642655 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6018984c-4df2-460f-91ae-39a90191e19f tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:38.644000 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6018984c-4df2-460f-91ae-39a90191e19f tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 00e23b21-ab07-4ce8-b66e-385261d61d7f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:38.644220 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0aa055b6-9377-417a-956c-76d0437a7cdf req-4b1e9902-7379-4792-a769-64d1bca5f14f service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:38.644729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0aa055b6-9377-417a-956c-76d0437a7cdf req-4b1e9902-7379-4792-a769-64d1bca5f14f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:38.645334 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0aa055b6-9377-417a-956c-76d0437a7cdf req-4b1e9902-7379-4792-a769-64d1bca5f14f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:38.658882 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6018984c-4df2-460f-91ae-39a90191e19f tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:38.660052 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6018984c-4df2-460f-91ae-39a90191e19f tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:38.661219 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6018984c-4df2-460f-91ae-39a90191e19f tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:38.662906 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6018984c-4df2-460f-91ae-39a90191e19f tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:38.664075 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6018984c-4df2-460f-91ae-39a90191e19f tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:38.665034 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6018984c-4df2-460f-91ae-39a90191e19f tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:38.674566 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-0aa055b6-9377-417a-956c-76d0437a7cdf req-4b1e9902-7379-4792-a769-64d1bca5f14f service nova] Creating event network-changed:00131652-1889-4a1b-b98b-7e9ab46ecfba for instance d40780fb-43a4-47fa-821d-a2a69413ee0b on n-h1-856895-1 Sep 10 12:02:38.679893 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-0aa055b6-9377-417a-956c-76d0437a7cdf req-4b1e9902-7379-4792-a769-64d1bca5f14f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076914 Sep 10 12:02:38.680620 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2374/4739] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:02:39.204126 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6018984c-4df2-460f-91ae-39a90191e19f tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:39.212678 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6018984c-4df2-460f-91ae-39a90191e19f tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f" status: 200 len: 1287 microversion: 2.1 time: 0.576699 Sep 10 12:02:39.227822 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2366/4740] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:38 2022] GET /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f => generated 1287 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:39.631580 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6b42d307-ea9c-4c01-9576-a4f0509eddca tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:39.632440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6b42d307-ea9c-4c01-9576-a4f0509eddca tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: d40780fb-43a4-47fa-821d-a2a69413ee0b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:39.639697 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6b42d307-ea9c-4c01-9576-a4f0509eddca tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:39.641502 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6b42d307-ea9c-4c01-9576-a4f0509eddca tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:39.641967 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6b42d307-ea9c-4c01-9576-a4f0509eddca tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:39.642695 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6b42d307-ea9c-4c01-9576-a4f0509eddca tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:39.643154 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6b42d307-ea9c-4c01-9576-a4f0509eddca tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:39.645029 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6b42d307-ea9c-4c01-9576-a4f0509eddca tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:39.664737 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:02:39.668667 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1b7495d3-712a-43d1-9215-df189bf2f3b6 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:39.669788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1b7495d3-712a-43d1-9215-df189bf2f3b6 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] [instance: 2ddb58d0-8137-4755-80e1-eb12a4967bc9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:39.686110 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1b7495d3-712a-43d1-9215-df189bf2f3b6 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:39.686622 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1b7495d3-712a-43d1-9215-df189bf2f3b6 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:39.687072 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1b7495d3-712a-43d1-9215-df189bf2f3b6 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:39.688566 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1b7495d3-712a-43d1-9215-df189bf2f3b6 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:39.700216 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1b7495d3-712a-43d1-9215-df189bf2f3b6 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:39.701786 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1b7495d3-712a-43d1-9215-df189bf2f3b6 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:39.731273 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:02:39.868025 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6b42d307-ea9c-4c01-9576-a4f0509eddca tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:39.878988 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6b42d307-ea9c-4c01-9576-a4f0509eddca tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b" status: 200 len: 1314 microversion: 2.1 time: 0.252624 Sep 10 12:02:39.880202 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2375/4741] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:39 2022] GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:39.914309 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1b7495d3-712a-43d1-9215-df189bf2f3b6 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d28e8b26f84c3ba10a4552b6b40930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3723fdd806f448c1986e3dd235b09185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:39.924528 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1b7495d3-712a-43d1-9215-df189bf2f3b6 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] 10.222.0.23 "GET /compute/v2.1/servers/2ddb58d0-8137-4755-80e1-eb12a4967bc9" status: 200 len: 1313 microversion: 2.1 time: 0.269210 Sep 10 12:02:39.925342 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2367/4742] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:39 2022] GET /compute/v2.1/servers/2ddb58d0-8137-4755-80e1-eb12a4967bc9 => generated 1313 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:40.237332 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8b2e64b7-47f2-4219-bdb1-16d14653fa53 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:40.238267 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8b2e64b7-47f2-4219-bdb1-16d14653fa53 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 00e23b21-ab07-4ce8-b66e-385261d61d7f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:40.244253 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b2e64b7-47f2-4219-bdb1-16d14653fa53 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:40.245017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b2e64b7-47f2-4219-bdb1-16d14653fa53 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:40.245695 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b2e64b7-47f2-4219-bdb1-16d14653fa53 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:40.246633 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b2e64b7-47f2-4219-bdb1-16d14653fa53 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:40.247357 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b2e64b7-47f2-4219-bdb1-16d14653fa53 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:40.248049 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b2e64b7-47f2-4219-bdb1-16d14653fa53 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:40.390714 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8b2e64b7-47f2-4219-bdb1-16d14653fa53 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:40.405306 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8b2e64b7-47f2-4219-bdb1-16d14653fa53 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f" status: 200 len: 1287 microversion: 2.1 time: 0.172360 Sep 10 12:02:40.405917 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2376/4743] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:40 2022] GET /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f => generated 1287 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:40.905116 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-05ba67a6-9e7f-4ce4-bdb7-fbf29846635d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:40.905791 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-05ba67a6-9e7f-4ce4-bdb7-fbf29846635d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: d40780fb-43a4-47fa-821d-a2a69413ee0b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:40.919805 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05ba67a6-9e7f-4ce4-bdb7-fbf29846635d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:40.920759 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05ba67a6-9e7f-4ce4-bdb7-fbf29846635d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:40.921446 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05ba67a6-9e7f-4ce4-bdb7-fbf29846635d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:40.923074 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05ba67a6-9e7f-4ce4-bdb7-fbf29846635d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:40.923866 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05ba67a6-9e7f-4ce4-bdb7-fbf29846635d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:40.924547 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05ba67a6-9e7f-4ce4-bdb7-fbf29846635d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:40.952589 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-46736320-f2b9-42e3-8f61-646aa548ed23 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:40.953379 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-46736320-f2b9-42e3-8f61-646aa548ed23 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] [instance: 2ddb58d0-8137-4755-80e1-eb12a4967bc9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:40.967698 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46736320-f2b9-42e3-8f61-646aa548ed23 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:40.968196 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46736320-f2b9-42e3-8f61-646aa548ed23 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:40.968666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46736320-f2b9-42e3-8f61-646aa548ed23 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:40.976448 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46736320-f2b9-42e3-8f61-646aa548ed23 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:40.977442 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46736320-f2b9-42e3-8f61-646aa548ed23 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:40.981936 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46736320-f2b9-42e3-8f61-646aa548ed23 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:41.261607 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-05ba67a6-9e7f-4ce4-bdb7-fbf29846635d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:41.273723 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-05ba67a6-9e7f-4ce4-bdb7-fbf29846635d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b" status: 200 len: 1314 microversion: 2.1 time: 0.373505 Sep 10 12:02:41.288439 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2368/4744] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:40 2022] GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:41.363588 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-46736320-f2b9-42e3-8f61-646aa548ed23 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d28e8b26f84c3ba10a4552b6b40930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3723fdd806f448c1986e3dd235b09185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:41.377471 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-46736320-f2b9-42e3-8f61-646aa548ed23 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] 10.222.0.23 "GET /compute/v2.1/servers/2ddb58d0-8137-4755-80e1-eb12a4967bc9" status: 200 len: 1313 microversion: 2.1 time: 0.429447 Sep 10 12:02:41.397971 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2377/4745] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:40 2022] GET /compute/v2.1/servers/2ddb58d0-8137-4755-80e1-eb12a4967bc9 => generated 1313 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:02:41.434780 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-656dd428-b180-4ef6-8019-3f8a48b93189 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:41.435505 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-656dd428-b180-4ef6-8019-3f8a48b93189 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 00e23b21-ab07-4ce8-b66e-385261d61d7f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:41.462827 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-656dd428-b180-4ef6-8019-3f8a48b93189 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:41.463397 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-656dd428-b180-4ef6-8019-3f8a48b93189 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:41.463858 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-656dd428-b180-4ef6-8019-3f8a48b93189 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:41.467317 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-656dd428-b180-4ef6-8019-3f8a48b93189 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:41.473193 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-656dd428-b180-4ef6-8019-3f8a48b93189 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:41.473934 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-656dd428-b180-4ef6-8019-3f8a48b93189 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:41.936245 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-656dd428-b180-4ef6-8019-3f8a48b93189 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:41.960227 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-656dd428-b180-4ef6-8019-3f8a48b93189 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f" status: 200 len: 1329 microversion: 2.1 time: 0.528461 Sep 10 12:02:41.961270 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2369/4746] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:41 2022] GET /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f => generated 1329 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:42.300407 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e4d0a339-c062-4da8-8579-509ff766ac93 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:42.301913 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e4d0a339-c062-4da8-8579-509ff766ac93 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: d40780fb-43a4-47fa-821d-a2a69413ee0b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:42.310858 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e4d0a339-c062-4da8-8579-509ff766ac93 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:42.311817 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e4d0a339-c062-4da8-8579-509ff766ac93 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:42.318432 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e4d0a339-c062-4da8-8579-509ff766ac93 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:42.321050 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e4d0a339-c062-4da8-8579-509ff766ac93 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:42.322680 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e4d0a339-c062-4da8-8579-509ff766ac93 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:42.324338 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e4d0a339-c062-4da8-8579-509ff766ac93 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:42.414595 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-84cba5b9-f72d-4a82-9399-afea4065c170 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:42.416095 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-84cba5b9-f72d-4a82-9399-afea4065c170 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] [instance: 2ddb58d0-8137-4755-80e1-eb12a4967bc9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:42.428827 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-84cba5b9-f72d-4a82-9399-afea4065c170 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:42.429649 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-84cba5b9-f72d-4a82-9399-afea4065c170 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:42.432189 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-84cba5b9-f72d-4a82-9399-afea4065c170 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:42.434835 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-84cba5b9-f72d-4a82-9399-afea4065c170 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:42.435714 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-84cba5b9-f72d-4a82-9399-afea4065c170 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:42.436408 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-84cba5b9-f72d-4a82-9399-afea4065c170 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:42.830112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e4d0a339-c062-4da8-8579-509ff766ac93 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:42.844552 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e4d0a339-c062-4da8-8579-509ff766ac93 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b" status: 200 len: 1314 microversion: 2.1 time: 0.545767 Sep 10 12:02:42.856754 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2378/4747] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:42 2022] GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b => generated 1314 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:42.985771 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cef73388-83a1-4f04-ad1a-d2744640dcb2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:42.986523 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cef73388-83a1-4f04-ad1a-d2744640dcb2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 00e23b21-ab07-4ce8-b66e-385261d61d7f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:42.996388 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cef73388-83a1-4f04-ad1a-d2744640dcb2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:42.999200 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cef73388-83a1-4f04-ad1a-d2744640dcb2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:43.000253 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cef73388-83a1-4f04-ad1a-d2744640dcb2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:43.002626 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cef73388-83a1-4f04-ad1a-d2744640dcb2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:43.003247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cef73388-83a1-4f04-ad1a-d2744640dcb2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:43.003753 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cef73388-83a1-4f04-ad1a-d2744640dcb2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:43.217802 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-84cba5b9-f72d-4a82-9399-afea4065c170 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d28e8b26f84c3ba10a4552b6b40930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3723fdd806f448c1986e3dd235b09185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:43.234523 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-84cba5b9-f72d-4a82-9399-afea4065c170 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] 10.222.0.23 "GET /compute/v2.1/servers/2ddb58d0-8137-4755-80e1-eb12a4967bc9" status: 200 len: 1313 microversion: 2.1 time: 0.828023 Sep 10 12:02:43.236712 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2370/4748] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:42 2022] GET /compute/v2.1/servers/2ddb58d0-8137-4755-80e1-eb12a4967bc9 => generated 1313 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:43.526173 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cef73388-83a1-4f04-ad1a-d2744640dcb2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:43.543374 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cef73388-83a1-4f04-ad1a-d2744640dcb2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f" status: 200 len: 1329 microversion: 2.1 time: 0.561327 Sep 10 12:02:43.546652 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2379/4749] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:42 2022] GET /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f => generated 1329 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:02:43.874177 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-50bf90a8-1abb-4b88-a9d9-d02c8c5cd550 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:43.875388 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-50bf90a8-1abb-4b88-a9d9-d02c8c5cd550 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: d40780fb-43a4-47fa-821d-a2a69413ee0b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:43.889977 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50bf90a8-1abb-4b88-a9d9-d02c8c5cd550 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:43.889977 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50bf90a8-1abb-4b88-a9d9-d02c8c5cd550 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:43.890901 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50bf90a8-1abb-4b88-a9d9-d02c8c5cd550 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:43.900351 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50bf90a8-1abb-4b88-a9d9-d02c8c5cd550 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:43.900960 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50bf90a8-1abb-4b88-a9d9-d02c8c5cd550 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:43.901432 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50bf90a8-1abb-4b88-a9d9-d02c8c5cd550 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:44.259760 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-53e8ca9d-60be-4e46-a19b-56f2a1fad1df tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:44.260387 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-53e8ca9d-60be-4e46-a19b-56f2a1fad1df tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] [instance: 2ddb58d0-8137-4755-80e1-eb12a4967bc9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:44.270992 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-53e8ca9d-60be-4e46-a19b-56f2a1fad1df tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:44.273991 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-53e8ca9d-60be-4e46-a19b-56f2a1fad1df tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:44.274477 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-53e8ca9d-60be-4e46-a19b-56f2a1fad1df tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:44.280135 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-53e8ca9d-60be-4e46-a19b-56f2a1fad1df tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:44.280913 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-53e8ca9d-60be-4e46-a19b-56f2a1fad1df tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:44.281568 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-53e8ca9d-60be-4e46-a19b-56f2a1fad1df tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:44.914767 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-50bf90a8-1abb-4b88-a9d9-d02c8c5cd550 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:44.938894 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-50bf90a8-1abb-4b88-a9d9-d02c8c5cd550 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b" status: 200 len: 1314 microversion: 2.1 time: 1.070007 Sep 10 12:02:44.943046 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2371/4750] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:43 2022] GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b => generated 1314 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:45.109520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-53e8ca9d-60be-4e46-a19b-56f2a1fad1df tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d28e8b26f84c3ba10a4552b6b40930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3723fdd806f448c1986e3dd235b09185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:45.120035 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-53e8ca9d-60be-4e46-a19b-56f2a1fad1df tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] 10.222.0.23 "GET /compute/v2.1/servers/2ddb58d0-8137-4755-80e1-eb12a4967bc9" status: 200 len: 1313 microversion: 2.1 time: 0.864926 Sep 10 12:02:45.141478 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2380/4751] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:44 2022] GET /compute/v2.1/servers/2ddb58d0-8137-4755-80e1-eb12a4967bc9 => generated 1313 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:45.147915 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cf66299f-66b2-4c7d-90da-256b4d99aeb4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:45.148556 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cf66299f-66b2-4c7d-90da-256b4d99aeb4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 00e23b21-ab07-4ce8-b66e-385261d61d7f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:45.157639 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cf66299f-66b2-4c7d-90da-256b4d99aeb4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:45.158149 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cf66299f-66b2-4c7d-90da-256b4d99aeb4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:45.158603 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cf66299f-66b2-4c7d-90da-256b4d99aeb4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:45.159755 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cf66299f-66b2-4c7d-90da-256b4d99aeb4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:45.160876 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cf66299f-66b2-4c7d-90da-256b4d99aeb4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:45.161745 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cf66299f-66b2-4c7d-90da-256b4d99aeb4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:45.247152 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c4df0271-2c57-4d76-a979-ee5609873bc2 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-2053901282", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "d336fafc-42af-439a-93f8-695366af2871"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:02:45.360628 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-c4df0271-2c57-4d76-a979-ee5609873bc2 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] validate_networks() for [('d336fafc-42af-439a-93f8-695366af2871', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:02:45.605456 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=4 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:02:45.684821 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=42 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:02:46.027247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=34 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:02:46.127800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cf66299f-66b2-4c7d-90da-256b4d99aeb4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:46.146676 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cf66299f-66b2-4c7d-90da-256b4d99aeb4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f" status: 200 len: 1329 microversion: 2.1 time: 1.003870 Sep 10 12:02:46.147738 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2381/4752] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:45 2022] GET /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f => generated 1329 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:46.153422 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-602456d7-f1c1-43e8-8d1a-55e13d1fc728 req-81805310-2fe7-49f7-bb78-c3c6eaf31940 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00e23b21-ab07-4ce8-b66e-385261d61d7f", "tag": "4620ee18-1cca-49b5-b625-83abd3ffec36"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:02:46.168340 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-602456d7-f1c1-43e8-8d1a-55e13d1fc728 req-81805310-2fe7-49f7-bb78-c3c6eaf31940 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:46.168807 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-602456d7-f1c1-43e8-8d1a-55e13d1fc728 req-81805310-2fe7-49f7-bb78-c3c6eaf31940 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:46.169301 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-602456d7-f1c1-43e8-8d1a-55e13d1fc728 req-81805310-2fe7-49f7-bb78-c3c6eaf31940 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:46.182088 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-602456d7-f1c1-43e8-8d1a-55e13d1fc728 req-81805310-2fe7-49f7-bb78-c3c6eaf31940 service nova] Creating event network-changed:4620ee18-1cca-49b5-b625-83abd3ffec36 for instance 00e23b21-ab07-4ce8-b66e-385261d61d7f on n-h2-856895-1 Sep 10 12:02:46.189980 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-602456d7-f1c1-43e8-8d1a-55e13d1fc728 req-81805310-2fe7-49f7-bb78-c3c6eaf31940 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040732 Sep 10 12:02:46.193694 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2382/4753] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:02:46.201512 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-476a66cf-081c-456c-980c-81957758a6ca req-2c446bee-e401-4998-87bb-539bfb4cb125 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ddb58d0-8137-4755-80e1-eb12a4967bc9", "name": "network-vif-plugged", "status": "completed", "tag": "fc558740-2be6-40f9-91a3-311111c16b14"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:02:46.213184 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-476a66cf-081c-456c-980c-81957758a6ca req-2c446bee-e401-4998-87bb-539bfb4cb125 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:46.213651 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-476a66cf-081c-456c-980c-81957758a6ca req-2c446bee-e401-4998-87bb-539bfb4cb125 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:46.214086 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-476a66cf-081c-456c-980c-81957758a6ca req-2c446bee-e401-4998-87bb-539bfb4cb125 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:46.227296 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-476a66cf-081c-456c-980c-81957758a6ca req-2c446bee-e401-4998-87bb-539bfb4cb125 service nova] Creating event network-vif-plugged:fc558740-2be6-40f9-91a3-311111c16b14 for instance 2ddb58d0-8137-4755-80e1-eb12a4967bc9 on n-h1-856895-1 Sep 10 12:02:46.232610 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-476a66cf-081c-456c-980c-81957758a6ca req-2c446bee-e401-4998-87bb-539bfb4cb125 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037479 Sep 10 12:02:46.236262 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2383/4754] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:02:46.242341 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a913d9bc-6ede-414a-bcfd-a15fcb31b088 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:46.243368 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a913d9bc-6ede-414a-bcfd-a15fcb31b088 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: d40780fb-43a4-47fa-821d-a2a69413ee0b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:46.250044 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a913d9bc-6ede-414a-bcfd-a15fcb31b088 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:46.250862 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a913d9bc-6ede-414a-bcfd-a15fcb31b088 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:46.251526 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a913d9bc-6ede-414a-bcfd-a15fcb31b088 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:46.252424 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a913d9bc-6ede-414a-bcfd-a15fcb31b088 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:46.253048 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a913d9bc-6ede-414a-bcfd-a15fcb31b088 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:46.253639 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a913d9bc-6ede-414a-bcfd-a15fcb31b088 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:47.341339 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a913d9bc-6ede-414a-bcfd-a15fcb31b088 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:47.355321 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-c4df0271-2c57-4d76-a979-ee5609873bc2 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:02:47.355812 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-c4df0271-2c57-4d76-a979-ee5609873bc2 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:02:47.356234 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-c4df0271-2c57-4d76-a979-ee5609873bc2 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:02:47.356658 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-c4df0271-2c57-4d76-a979-ee5609873bc2 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:02:47.357085 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-c4df0271-2c57-4d76-a979-ee5609873bc2 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:02:47.368322 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a913d9bc-6ede-414a-bcfd-a15fcb31b088 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b" status: 200 len: 1314 microversion: 2.1 time: 1.113647 Sep 10 12:02:47.370973 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2384/4755] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:46 2022] GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b => generated 1314 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:47.377651 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3e30dcb3-a99f-4fa8-bc67-7947eaebd386 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:47.379022 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3e30dcb3-a99f-4fa8-bc67-7947eaebd386 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] [instance: 2ddb58d0-8137-4755-80e1-eb12a4967bc9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:47.385530 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c4df0271-2c57-4d76-a979-ee5609873bc2 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:47.386035 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c4df0271-2c57-4d76-a979-ee5609873bc2 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:47.387498 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c4df0271-2c57-4d76-a979-ee5609873bc2 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:47.387999 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c4df0271-2c57-4d76-a979-ee5609873bc2 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:47.388534 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c4df0271-2c57-4d76-a979-ee5609873bc2 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:47.388978 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c4df0271-2c57-4d76-a979-ee5609873bc2 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:47.402319 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e30dcb3-a99f-4fa8-bc67-7947eaebd386 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:47.403647 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e30dcb3-a99f-4fa8-bc67-7947eaebd386 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:47.404541 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e30dcb3-a99f-4fa8-bc67-7947eaebd386 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:47.405927 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e30dcb3-a99f-4fa8-bc67-7947eaebd386 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:47.406413 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e30dcb3-a99f-4fa8-bc67-7947eaebd386 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:47.406853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e30dcb3-a99f-4fa8-bc67-7947eaebd386 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:47.439867 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-c4df0271-2c57-4d76-a979-ee5609873bc2 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Getting quotas for project 8dca2926629f443aa83845ea257b5c41. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:02:47.455540 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-c4df0271-2c57-4d76-a979-ee5609873bc2 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Getting quotas for user cdea57db9d224ce6afa19ed7f7ffa2bf and project 8dca2926629f443aa83845ea257b5c41. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:02:47.492282 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c4df0271-2c57-4d76-a979-ee5609873bc2 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:02:47.497454 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c4df0271-2c57-4d76-a979-ee5609873bc2 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] [instance: 0dcd0f7f-a335-41b6-89e2-ac441b1b8a62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:02:47.573344 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c4df0271-2c57-4d76-a979-ee5609873bc2 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.628924 Sep 10 12:02:47.580695 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2372/4756] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:02:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:02:47.593603 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-71e948c0-c327-4282-9350-7b37ff57692b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:47.594655 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-71e948c0-c327-4282-9350-7b37ff57692b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 00e23b21-ab07-4ce8-b66e-385261d61d7f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:47.605241 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-71e948c0-c327-4282-9350-7b37ff57692b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:47.606041 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-71e948c0-c327-4282-9350-7b37ff57692b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:47.606680 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-71e948c0-c327-4282-9350-7b37ff57692b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:47.607625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-71e948c0-c327-4282-9350-7b37ff57692b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:47.608259 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-71e948c0-c327-4282-9350-7b37ff57692b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:47.611130 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-71e948c0-c327-4282-9350-7b37ff57692b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:48.227484 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3e30dcb3-a99f-4fa8-bc67-7947eaebd386 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d28e8b26f84c3ba10a4552b6b40930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3723fdd806f448c1986e3dd235b09185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:48.243053 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3e30dcb3-a99f-4fa8-bc67-7947eaebd386 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] 10.222.0.23 "GET /compute/v2.1/servers/2ddb58d0-8137-4755-80e1-eb12a4967bc9" status: 200 len: 1313 microversion: 2.1 time: 0.866604 Sep 10 12:02:48.252731 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2385/4757] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:47 2022] GET /compute/v2.1/servers/2ddb58d0-8137-4755-80e1-eb12a4967bc9 => generated 1313 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:48.271824 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-71e948c0-c327-4282-9350-7b37ff57692b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:48.272119 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fccc4e85-2779-4197-9faf-379d139b33b4 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:48.276719 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fccc4e85-2779-4197-9faf-379d139b33b4 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] [instance: 0dcd0f7f-a335-41b6-89e2-ac441b1b8a62] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:48.281764 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-71e948c0-c327-4282-9350-7b37ff57692b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f" status: 200 len: 1329 microversion: 2.1 time: 0.699224 Sep 10 12:02:48.295855 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2373/4758] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:47 2022] GET /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f => generated 1329 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:48.395487 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6b6468d8-cd9e-45c8-9f83-a2606e9db0bc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:48.396991 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6b6468d8-cd9e-45c8-9f83-a2606e9db0bc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: d40780fb-43a4-47fa-821d-a2a69413ee0b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:48.411179 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6b6468d8-cd9e-45c8-9f83-a2606e9db0bc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:48.411856 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6b6468d8-cd9e-45c8-9f83-a2606e9db0bc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:48.414106 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6b6468d8-cd9e-45c8-9f83-a2606e9db0bc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:48.418225 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6b6468d8-cd9e-45c8-9f83-a2606e9db0bc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:48.420024 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6b6468d8-cd9e-45c8-9f83-a2606e9db0bc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:48.421345 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6b6468d8-cd9e-45c8-9f83-a2606e9db0bc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:48.447229 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fccc4e85-2779-4197-9faf-379d139b33b4 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea57db9d224ce6afa19ed7f7ffa2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dca2926629f443aa83845ea257b5c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:48.462742 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fccc4e85-2779-4197-9faf-379d139b33b4 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] 10.222.0.23 "GET /compute/v2.1/servers/0dcd0f7f-a335-41b6-89e2-ac441b1b8a62" status: 200 len: 1217 microversion: 2.1 time: 0.202422 Sep 10 12:02:48.465899 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2386/4759] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:48 2022] GET /compute/v2.1/servers/0dcd0f7f-a335-41b6-89e2-ac441b1b8a62 => generated 1217 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:48.806407 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6b6468d8-cd9e-45c8-9f83-a2606e9db0bc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:48.817962 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6b6468d8-cd9e-45c8-9f83-a2606e9db0bc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b" status: 200 len: 1314 microversion: 2.1 time: 0.428291 Sep 10 12:02:48.819251 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2374/4760] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:48 2022] GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b => generated 1314 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:49.278467 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ecdff8c4-0b3d-4961-8169-51014db8c306 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:49.279326 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ecdff8c4-0b3d-4961-8169-51014db8c306 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] [instance: 2ddb58d0-8137-4755-80e1-eb12a4967bc9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:49.305860 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dbc6dc34-7ec3-47c2-87e5-72af3f02f3f4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:49.306996 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-dbc6dc34-7ec3-47c2-87e5-72af3f02f3f4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 00e23b21-ab07-4ce8-b66e-385261d61d7f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:49.311875 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ecdff8c4-0b3d-4961-8169-51014db8c306 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:49.327450 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ecdff8c4-0b3d-4961-8169-51014db8c306 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:49.332717 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ecdff8c4-0b3d-4961-8169-51014db8c306 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:49.339935 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ecdff8c4-0b3d-4961-8169-51014db8c306 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:49.340530 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ecdff8c4-0b3d-4961-8169-51014db8c306 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:49.340984 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ecdff8c4-0b3d-4961-8169-51014db8c306 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:49.344715 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dbc6dc34-7ec3-47c2-87e5-72af3f02f3f4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:49.345234 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dbc6dc34-7ec3-47c2-87e5-72af3f02f3f4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:49.345687 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dbc6dc34-7ec3-47c2-87e5-72af3f02f3f4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:49.346428 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dbc6dc34-7ec3-47c2-87e5-72af3f02f3f4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:49.346892 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dbc6dc34-7ec3-47c2-87e5-72af3f02f3f4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:49.371795 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dbc6dc34-7ec3-47c2-87e5-72af3f02f3f4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:49.982742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ecdff8c4-0b3d-4961-8169-51014db8c306 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d28e8b26f84c3ba10a4552b6b40930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3723fdd806f448c1986e3dd235b09185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:50.014980 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ecdff8c4-0b3d-4961-8169-51014db8c306 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] 10.222.0.23 "GET /compute/v2.1/servers/2ddb58d0-8137-4755-80e1-eb12a4967bc9" status: 200 len: 1498 microversion: 2.1 time: 0.734019 Sep 10 12:02:50.018401 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2387/4761] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:49 2022] GET /compute/v2.1/servers/2ddb58d0-8137-4755-80e1-eb12a4967bc9 => generated 1498 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:50.029123 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-dbc6dc34-7ec3-47c2-87e5-72af3f02f3f4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:50.052087 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-dbc6dc34-7ec3-47c2-87e5-72af3f02f3f4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f" status: 200 len: 1329 microversion: 2.1 time: 0.744302 Sep 10 12:02:50.057668 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2375/4762] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:49 2022] GET /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f => generated 1329 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:02:50.067373 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-81258248-4312-4f48-ad6b-89b8a15c27d1 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:50.068242 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-81258248-4312-4f48-ad6b-89b8a15c27d1 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] [instance: 0dcd0f7f-a335-41b6-89e2-ac441b1b8a62] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:50.081478 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2b96e27f-3562-4bc3-b7c2-053d6fed189b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:50.082117 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2b96e27f-3562-4bc3-b7c2-053d6fed189b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: d40780fb-43a4-47fa-821d-a2a69413ee0b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:50.101871 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-81258248-4312-4f48-ad6b-89b8a15c27d1 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:50.102380 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-81258248-4312-4f48-ad6b-89b8a15c27d1 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:50.102828 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-81258248-4312-4f48-ad6b-89b8a15c27d1 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:50.103582 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-81258248-4312-4f48-ad6b-89b8a15c27d1 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:50.104045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-81258248-4312-4f48-ad6b-89b8a15c27d1 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:50.117310 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2b96e27f-3562-4bc3-b7c2-053d6fed189b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:50.117848 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2b96e27f-3562-4bc3-b7c2-053d6fed189b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:50.122698 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-81258248-4312-4f48-ad6b-89b8a15c27d1 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:50.125314 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2b96e27f-3562-4bc3-b7c2-053d6fed189b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:50.127336 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2b96e27f-3562-4bc3-b7c2-053d6fed189b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:50.130293 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2b96e27f-3562-4bc3-b7c2-053d6fed189b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:50.132589 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2b96e27f-3562-4bc3-b7c2-053d6fed189b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:50.419368 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-81258248-4312-4f48-ad6b-89b8a15c27d1 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea57db9d224ce6afa19ed7f7ffa2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dca2926629f443aa83845ea257b5c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:50.445935 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-81258248-4312-4f48-ad6b-89b8a15c27d1 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] 10.222.0.23 "GET /compute/v2.1/servers/0dcd0f7f-a335-41b6-89e2-ac441b1b8a62" status: 200 len: 1275 microversion: 2.1 time: 0.425413 Sep 10 12:02:50.449923 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2388/4763] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:50 2022] GET /compute/v2.1/servers/0dcd0f7f-a335-41b6-89e2-ac441b1b8a62 => generated 1275 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:50.460534 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d5bba7cd-76ab-4e8b-9a91-ebf3ce14fa5e tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:50.534136 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.compute.server_groups [None req-d5bba7cd-76ab-4e8b-9a91-ebf3ce14fa5e tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Querying cell d31511aa-3734-4d55-9c57-4a88c62d4dfd(cell1) for 1 instances {{(pid=128777) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 10 12:02:50.536814 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d5bba7cd-76ab-4e8b-9a91-ebf3ce14fa5e tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:50.536814 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d5bba7cd-76ab-4e8b-9a91-ebf3ce14fa5e tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:50.538340 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d5bba7cd-76ab-4e8b-9a91-ebf3ce14fa5e tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:50.619810 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d5bba7cd-76ab-4e8b-9a91-ebf3ce14fa5e tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/89c9facc-b5b7-4041-ab6d-26d3524d39bf" status: 200 len: 222 microversion: 2.1 time: 0.167643 Sep 10 12:02:50.625421 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2389/4764] 10.222.0.23 () {58 vars in 1263 bytes} [Sat Sep 10 12:02:50 2022] GET /compute/v2.1/os-server-groups/89c9facc-b5b7-4041-ab6d-26d3524d39bf => generated 222 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:02:50.642331 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1cbe6662-579b-42b6-b964-f5633b1b109d tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:50.644930 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1cbe6662-579b-42b6-b964-f5633b1b109d tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] [instance: 2ddb58d0-8137-4755-80e1-eb12a4967bc9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:50.646031 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2b96e27f-3562-4bc3-b7c2-053d6fed189b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:50.657651 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2b96e27f-3562-4bc3-b7c2-053d6fed189b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b" status: 200 len: 1314 microversion: 2.1 time: 0.592211 Sep 10 12:02:50.661948 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2376/4765] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:50 2022] GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b => generated 1314 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:50.670421 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1cbe6662-579b-42b6-b964-f5633b1b109d tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:50.672174 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1cbe6662-579b-42b6-b964-f5633b1b109d tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:50.673453 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1cbe6662-579b-42b6-b964-f5633b1b109d tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:50.674371 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1cbe6662-579b-42b6-b964-f5633b1b109d tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:50.677606 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1cbe6662-579b-42b6-b964-f5633b1b109d tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:50.678087 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1cbe6662-579b-42b6-b964-f5633b1b109d tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:50.745630 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1cbe6662-579b-42b6-b964-f5633b1b109d tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] [instance: 2ddb58d0-8137-4755-80e1-eb12a4967bc9] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:02:50.932881 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1cbe6662-579b-42b6-b964-f5633b1b109d tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2ddb58d0-8137-4755-80e1-eb12a4967bc9" status: 204 len: 0 microversion: 2.1 time: 0.304469 Sep 10 12:02:50.933884 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2390/4766] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:02:50 2022] DELETE /compute/v2.1/servers/2ddb58d0-8137-4755-80e1-eb12a4967bc9 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:02:50.947666 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e4b1f990-6c00-4f48-aaf0-8dd3b811ce71 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:50.948723 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e4b1f990-6c00-4f48-aaf0-8dd3b811ce71 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] [instance: 2ddb58d0-8137-4755-80e1-eb12a4967bc9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:50.956770 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4b1f990-6c00-4f48-aaf0-8dd3b811ce71 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:50.960681 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4b1f990-6c00-4f48-aaf0-8dd3b811ce71 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:50.962067 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4b1f990-6c00-4f48-aaf0-8dd3b811ce71 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:50.966079 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4b1f990-6c00-4f48-aaf0-8dd3b811ce71 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:50.966987 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4b1f990-6c00-4f48-aaf0-8dd3b811ce71 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:50.968776 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4b1f990-6c00-4f48-aaf0-8dd3b811ce71 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:51.082934 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d2cfdf4a-1500-4bad-8b4b-ce540c212057 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:51.083535 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d2cfdf4a-1500-4bad-8b4b-ce540c212057 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 00e23b21-ab07-4ce8-b66e-385261d61d7f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:51.093888 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d2cfdf4a-1500-4bad-8b4b-ce540c212057 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:51.099776 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d2cfdf4a-1500-4bad-8b4b-ce540c212057 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:51.100441 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d2cfdf4a-1500-4bad-8b4b-ce540c212057 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:51.101189 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d2cfdf4a-1500-4bad-8b4b-ce540c212057 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:51.101997 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d2cfdf4a-1500-4bad-8b4b-ce540c212057 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:51.104586 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d2cfdf4a-1500-4bad-8b4b-ce540c212057 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:52.048184 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e4b1f990-6c00-4f48-aaf0-8dd3b811ce71 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d28e8b26f84c3ba10a4552b6b40930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3723fdd806f448c1986e3dd235b09185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:52.061137 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e4b1f990-6c00-4f48-aaf0-8dd3b811ce71 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] 10.222.0.23 "GET /compute/v2.1/servers/2ddb58d0-8137-4755-80e1-eb12a4967bc9" status: 200 len: 1504 microversion: 2.1 time: 1.121996 Sep 10 12:02:52.061877 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2377/4767] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:50 2022] GET /compute/v2.1/servers/2ddb58d0-8137-4755-80e1-eb12a4967bc9 => generated 1504 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:52.081135 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-53a56289-fe69-4830-a910-f44e0348f2f3 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:52.081774 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-53a56289-fe69-4830-a910-f44e0348f2f3 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] [instance: 0dcd0f7f-a335-41b6-89e2-ac441b1b8a62] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:52.091876 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53a56289-fe69-4830-a910-f44e0348f2f3 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:52.092378 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53a56289-fe69-4830-a910-f44e0348f2f3 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:52.093852 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53a56289-fe69-4830-a910-f44e0348f2f3 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:52.098127 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53a56289-fe69-4830-a910-f44e0348f2f3 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:52.098643 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53a56289-fe69-4830-a910-f44e0348f2f3 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:52.099103 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53a56289-fe69-4830-a910-f44e0348f2f3 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:52.172628 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d2cfdf4a-1500-4bad-8b4b-ce540c212057 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:52.186038 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d2cfdf4a-1500-4bad-8b4b-ce540c212057 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f" status: 200 len: 1329 microversion: 2.1 time: 1.103724 Sep 10 12:02:52.188118 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2391/4768] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:51 2022] GET /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f => generated 1329 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:52.200622 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-bffb24cc-1c5b-4a95-b6f3-5c875dff6677 req-372d5755-c685-47fe-a06b-a82c2136645f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d40780fb-43a4-47fa-821d-a2a69413ee0b", "name": "network-vif-plugged", "status": "completed", "tag": "00131652-1889-4a1b-b98b-7e9ab46ecfba"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:02:52.214932 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-bffb24cc-1c5b-4a95-b6f3-5c875dff6677 req-372d5755-c685-47fe-a06b-a82c2136645f service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:52.215700 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-bffb24cc-1c5b-4a95-b6f3-5c875dff6677 req-372d5755-c685-47fe-a06b-a82c2136645f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:52.216974 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-bffb24cc-1c5b-4a95-b6f3-5c875dff6677 req-372d5755-c685-47fe-a06b-a82c2136645f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:52.235104 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-bffb24cc-1c5b-4a95-b6f3-5c875dff6677 req-372d5755-c685-47fe-a06b-a82c2136645f service nova] Creating event network-vif-plugged:00131652-1889-4a1b-b98b-7e9ab46ecfba for instance d40780fb-43a4-47fa-821d-a2a69413ee0b on n-h1-856895-1 Sep 10 12:02:52.240466 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-bffb24cc-1c5b-4a95-b6f3-5c875dff6677 req-372d5755-c685-47fe-a06b-a82c2136645f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050830 Sep 10 12:02:52.241661 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2392/4769] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:02:52.247549 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a9ab4967-6e45-41b3-93b3-db8529b2c9a4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:52.248704 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a9ab4967-6e45-41b3-93b3-db8529b2c9a4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: d40780fb-43a4-47fa-821d-a2a69413ee0b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:52.262705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9ab4967-6e45-41b3-93b3-db8529b2c9a4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:52.263626 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9ab4967-6e45-41b3-93b3-db8529b2c9a4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:52.264291 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9ab4967-6e45-41b3-93b3-db8529b2c9a4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:52.266101 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9ab4967-6e45-41b3-93b3-db8529b2c9a4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:52.266788 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9ab4967-6e45-41b3-93b3-db8529b2c9a4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:52.267991 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9ab4967-6e45-41b3-93b3-db8529b2c9a4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:52.721530 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a9ab4967-6e45-41b3-93b3-db8529b2c9a4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:52.724291 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:02:52.740022 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a9ab4967-6e45-41b3-93b3-db8529b2c9a4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b" status: 200 len: 1314 microversion: 2.1 time: 0.496352 Sep 10 12:02:52.742620 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2393/4770] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:52 2022] GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b => generated 1314 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:52.825425 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-53a56289-fe69-4830-a910-f44e0348f2f3 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea57db9d224ce6afa19ed7f7ffa2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dca2926629f443aa83845ea257b5c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:52.839147 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-53a56289-fe69-4830-a910-f44e0348f2f3 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] 10.222.0.23 "GET /compute/v2.1/servers/0dcd0f7f-a335-41b6-89e2-ac441b1b8a62" status: 200 len: 1317 microversion: 2.1 time: 0.775191 Sep 10 12:02:52.855298 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2378/4771] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:52 2022] GET /compute/v2.1/servers/0dcd0f7f-a335-41b6-89e2-ac441b1b8a62 => generated 1317 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:53.087782 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8215887b-ad58-4ce2-9887-3932fb44157b tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:53.088653 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8215887b-ad58-4ce2-9887-3932fb44157b tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] [instance: 2ddb58d0-8137-4755-80e1-eb12a4967bc9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:53.120064 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8215887b-ad58-4ce2-9887-3932fb44157b tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:53.122241 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8215887b-ad58-4ce2-9887-3932fb44157b tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:53.122939 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8215887b-ad58-4ce2-9887-3932fb44157b tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:53.126692 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8215887b-ad58-4ce2-9887-3932fb44157b tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:53.132392 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8215887b-ad58-4ce2-9887-3932fb44157b tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:53.133158 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8215887b-ad58-4ce2-9887-3932fb44157b tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:53.215954 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-acd941d8-f02d-4f1f-ac8f-1eb711145b3a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:53.217178 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-acd941d8-f02d-4f1f-ac8f-1eb711145b3a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 00e23b21-ab07-4ce8-b66e-385261d61d7f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:53.233588 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-acd941d8-f02d-4f1f-ac8f-1eb711145b3a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:53.238461 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-acd941d8-f02d-4f1f-ac8f-1eb711145b3a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:53.239689 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-acd941d8-f02d-4f1f-ac8f-1eb711145b3a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:53.241671 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-acd941d8-f02d-4f1f-ac8f-1eb711145b3a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:53.245717 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-acd941d8-f02d-4f1f-ac8f-1eb711145b3a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:53.247932 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-acd941d8-f02d-4f1f-ac8f-1eb711145b3a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:53.687709 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-acd941d8-f02d-4f1f-ac8f-1eb711145b3a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:53.690786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8215887b-ad58-4ce2-9887-3932fb44157b tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d28e8b26f84c3ba10a4552b6b40930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3723fdd806f448c1986e3dd235b09185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:53.703789 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8215887b-ad58-4ce2-9887-3932fb44157b tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] 10.222.0.23 "GET /compute/v2.1/servers/2ddb58d0-8137-4755-80e1-eb12a4967bc9" status: 200 len: 1504 microversion: 2.1 time: 0.618123 Sep 10 12:02:53.705406 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2394/4772] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:53 2022] GET /compute/v2.1/servers/2ddb58d0-8137-4755-80e1-eb12a4967bc9 => generated 1504 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:53.721674 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-acd941d8-f02d-4f1f-ac8f-1eb711145b3a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f" status: 200 len: 1329 microversion: 2.1 time: 0.515520 Sep 10 12:02:53.722494 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2379/4773] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:53 2022] GET /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f => generated 1329 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:02:53.766233 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a23bf3e8-27b7-4c2f-ac9c-37d57632afef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:53.766864 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a23bf3e8-27b7-4c2f-ac9c-37d57632afef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: d40780fb-43a4-47fa-821d-a2a69413ee0b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:53.775662 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a23bf3e8-27b7-4c2f-ac9c-37d57632afef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:53.775919 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a23bf3e8-27b7-4c2f-ac9c-37d57632afef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:53.780117 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a23bf3e8-27b7-4c2f-ac9c-37d57632afef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:53.783885 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a23bf3e8-27b7-4c2f-ac9c-37d57632afef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:53.784741 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a23bf3e8-27b7-4c2f-ac9c-37d57632afef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:53.785363 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a23bf3e8-27b7-4c2f-ac9c-37d57632afef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:53.871252 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9ac29b42-afdb-4c5c-b534-5dc05acf4de8 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:53.871893 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9ac29b42-afdb-4c5c-b534-5dc05acf4de8 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] [instance: 0dcd0f7f-a335-41b6-89e2-ac441b1b8a62] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:53.889946 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ac29b42-afdb-4c5c-b534-5dc05acf4de8 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:53.891515 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ac29b42-afdb-4c5c-b534-5dc05acf4de8 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:53.893493 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ac29b42-afdb-4c5c-b534-5dc05acf4de8 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:53.900381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ac29b42-afdb-4c5c-b534-5dc05acf4de8 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:53.901290 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ac29b42-afdb-4c5c-b534-5dc05acf4de8 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:53.904648 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ac29b42-afdb-4c5c-b534-5dc05acf4de8 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:54.332028 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a23bf3e8-27b7-4c2f-ac9c-37d57632afef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:54.342647 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a23bf3e8-27b7-4c2f-ac9c-37d57632afef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b" status: 200 len: 1314 microversion: 2.1 time: 0.581303 Sep 10 12:02:54.346906 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2395/4774] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:53 2022] GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b => generated 1314 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:54.357873 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-d7f5c20f-22a6-4d8c-8a10-0ae28ee3eefd req-d9c5a662-ef96-4c8f-9119-84d7d57ee94e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dcd0f7f-a335-41b6-89e2-ac441b1b8a62", "tag": "3d40e717-e8a2-4f17-830f-42ea6f1a2f90"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:02:54.364778 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9ac29b42-afdb-4c5c-b534-5dc05acf4de8 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea57db9d224ce6afa19ed7f7ffa2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dca2926629f443aa83845ea257b5c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:54.377447 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9ac29b42-afdb-4c5c-b534-5dc05acf4de8 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] 10.222.0.23 "GET /compute/v2.1/servers/0dcd0f7f-a335-41b6-89e2-ac441b1b8a62" status: 200 len: 1317 microversion: 2.1 time: 0.511291 Sep 10 12:02:54.389933 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d7f5c20f-22a6-4d8c-8a10-0ae28ee3eefd req-d9c5a662-ef96-4c8f-9119-84d7d57ee94e service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:54.391966 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d7f5c20f-22a6-4d8c-8a10-0ae28ee3eefd req-d9c5a662-ef96-4c8f-9119-84d7d57ee94e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:54.394230 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d7f5c20f-22a6-4d8c-8a10-0ae28ee3eefd req-d9c5a662-ef96-4c8f-9119-84d7d57ee94e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:54.398996 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2380/4775] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:53 2022] GET /compute/v2.1/servers/0dcd0f7f-a335-41b6-89e2-ac441b1b8a62 => generated 1317 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:02:54.409755 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-a52e80fb-63e8-43ff-81e6-ee0a9e78c8a4 req-67104807-669d-48ab-89f1-6fb7cf5831a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00e23b21-ab07-4ce8-b66e-385261d61d7f", "name": "network-vif-plugged", "status": "completed", "tag": "4620ee18-1cca-49b5-b625-83abd3ffec36"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:02:54.422455 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a52e80fb-63e8-43ff-81e6-ee0a9e78c8a4 req-67104807-669d-48ab-89f1-6fb7cf5831a3 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:54.423396 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a52e80fb-63e8-43ff-81e6-ee0a9e78c8a4 req-67104807-669d-48ab-89f1-6fb7cf5831a3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:54.423647 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-d7f5c20f-22a6-4d8c-8a10-0ae28ee3eefd req-d9c5a662-ef96-4c8f-9119-84d7d57ee94e service nova] Creating event network-changed:3d40e717-e8a2-4f17-830f-42ea6f1a2f90 for instance 0dcd0f7f-a335-41b6-89e2-ac441b1b8a62 on n-h2-856895-1 Sep 10 12:02:54.425246 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a52e80fb-63e8-43ff-81e6-ee0a9e78c8a4 req-67104807-669d-48ab-89f1-6fb7cf5831a3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:54.429218 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-d7f5c20f-22a6-4d8c-8a10-0ae28ee3eefd req-d9c5a662-ef96-4c8f-9119-84d7d57ee94e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080482 Sep 10 12:02:54.430813 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2396/4776] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:02:54.456487 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-a52e80fb-63e8-43ff-81e6-ee0a9e78c8a4 req-67104807-669d-48ab-89f1-6fb7cf5831a3 service nova] Creating event network-vif-plugged:4620ee18-1cca-49b5-b625-83abd3ffec36 for instance 00e23b21-ab07-4ce8-b66e-385261d61d7f on n-h2-856895-1 Sep 10 12:02:54.469483 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-a52e80fb-63e8-43ff-81e6-ee0a9e78c8a4 req-67104807-669d-48ab-89f1-6fb7cf5831a3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068517 Sep 10 12:02:54.470716 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2381/4777] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:02:54.728312 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8904dffd-4fb5-4a70-a0a6-3cf56251412b tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:54.729025 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8904dffd-4fb5-4a70-a0a6-3cf56251412b tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] [instance: 2ddb58d0-8137-4755-80e1-eb12a4967bc9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:54.746066 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b69ebde9-f673-4885-bc05-3b46358085f7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:54.746822 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b69ebde9-f673-4885-bc05-3b46358085f7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 00e23b21-ab07-4ce8-b66e-385261d61d7f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:54.750595 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:02:54.754677 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8904dffd-4fb5-4a70-a0a6-3cf56251412b tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:54.755256 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8904dffd-4fb5-4a70-a0a6-3cf56251412b tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:54.759583 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8904dffd-4fb5-4a70-a0a6-3cf56251412b tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:54.760710 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8904dffd-4fb5-4a70-a0a6-3cf56251412b tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:54.762078 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8904dffd-4fb5-4a70-a0a6-3cf56251412b tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:54.765842 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8904dffd-4fb5-4a70-a0a6-3cf56251412b tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:54.771183 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b69ebde9-f673-4885-bc05-3b46358085f7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:54.783855 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b69ebde9-f673-4885-bc05-3b46358085f7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:54.793171 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b69ebde9-f673-4885-bc05-3b46358085f7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:54.804903 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b69ebde9-f673-4885-bc05-3b46358085f7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:54.805412 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b69ebde9-f673-4885-bc05-3b46358085f7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:54.805869 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b69ebde9-f673-4885-bc05-3b46358085f7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:54.870840 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8904dffd-4fb5-4a70-a0a6-3cf56251412b tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:54.871367 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8904dffd-4fb5-4a70-a0a6-3cf56251412b tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:54.873464 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8904dffd-4fb5-4a70-a0a6-3cf56251412b tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:54.874557 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-8904dffd-4fb5-4a70-a0a6-3cf56251412b tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lazy-loading 'fault' on Instance uuid 2ddb58d0-8137-4755-80e1-eb12a4967bc9 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:02:54.995419 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8904dffd-4fb5-4a70-a0a6-3cf56251412b tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d28e8b26f84c3ba10a4552b6b40930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3723fdd806f448c1986e3dd235b09185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:55.006950 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8904dffd-4fb5-4a70-a0a6-3cf56251412b tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] 10.222.0.23 "GET /compute/v2.1/servers/2ddb58d0-8137-4755-80e1-eb12a4967bc9" status: 200 len: 1303 microversion: 2.1 time: 0.282817 Sep 10 12:02:55.008640 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2397/4778] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:54 2022] GET /compute/v2.1/servers/2ddb58d0-8137-4755-80e1-eb12a4967bc9 => generated 1303 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:55.371099 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f7944fdb-4628-4cb0-bef0-83e5abc1997a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:55.372792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f7944fdb-4628-4cb0-bef0-83e5abc1997a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: d40780fb-43a4-47fa-821d-a2a69413ee0b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:55.383406 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b69ebde9-f673-4885-bc05-3b46358085f7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:55.386303 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f7944fdb-4628-4cb0-bef0-83e5abc1997a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:55.386791 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f7944fdb-4628-4cb0-bef0-83e5abc1997a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:55.392842 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b69ebde9-f673-4885-bc05-3b46358085f7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f" status: 200 len: 1329 microversion: 2.1 time: 0.651115 Sep 10 12:02:55.399514 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2382/4779] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:54 2022] GET /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f => generated 1329 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:55.400922 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f7944fdb-4628-4cb0-bef0-83e5abc1997a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:55.401873 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f7944fdb-4628-4cb0-bef0-83e5abc1997a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:55.402369 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f7944fdb-4628-4cb0-bef0-83e5abc1997a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:55.402806 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f7944fdb-4628-4cb0-bef0-83e5abc1997a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:55.405644 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0616baf6-336c-4784-bd87-82090c4219dc tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:55.406984 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0616baf6-336c-4784-bd87-82090c4219dc tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] [instance: 0dcd0f7f-a335-41b6-89e2-ac441b1b8a62] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:55.420676 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0616baf6-336c-4784-bd87-82090c4219dc tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:55.421187 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0616baf6-336c-4784-bd87-82090c4219dc tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:55.421934 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0616baf6-336c-4784-bd87-82090c4219dc tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:55.422670 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0616baf6-336c-4784-bd87-82090c4219dc tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:55.429846 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0616baf6-336c-4784-bd87-82090c4219dc tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:55.430523 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0616baf6-336c-4784-bd87-82090c4219dc tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:55.947613 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0616baf6-336c-4784-bd87-82090c4219dc tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea57db9d224ce6afa19ed7f7ffa2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dca2926629f443aa83845ea257b5c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:55.958524 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0616baf6-336c-4784-bd87-82090c4219dc tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] 10.222.0.23 "GET /compute/v2.1/servers/0dcd0f7f-a335-41b6-89e2-ac441b1b8a62" status: 200 len: 1317 microversion: 2.1 time: 0.556563 Sep 10 12:02:55.960167 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2383/4780] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:55 2022] GET /compute/v2.1/servers/0dcd0f7f-a335-41b6-89e2-ac441b1b8a62 => generated 1317 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:02:55.970691 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f7944fdb-4628-4cb0-bef0-83e5abc1997a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:55.979010 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f7944fdb-4628-4cb0-bef0-83e5abc1997a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b" status: 200 len: 1501 microversion: 2.1 time: 0.614789 Sep 10 12:02:55.995913 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2398/4781] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:55 2022] GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b => generated 1501 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:02:56.003341 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7188e1a3-cbf5-4ca0-9786-bd4d1ae2e22f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:02:56.010028 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7188e1a3-cbf5-4ca0-9786-bd4d1ae2e22f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:56.010615 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7188e1a3-cbf5-4ca0-9786-bd4d1ae2e22f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:56.011137 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7188e1a3-cbf5-4ca0-9786-bd4d1ae2e22f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:56.035141 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bed40ff8-e42a-4461-a4cc-c3bdb1ecdfcf tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:56.035974 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bed40ff8-e42a-4461-a4cc-c3bdb1ecdfcf tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] [instance: 2ddb58d0-8137-4755-80e1-eb12a4967bc9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:56.045338 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bed40ff8-e42a-4461-a4cc-c3bdb1ecdfcf tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:56.047373 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bed40ff8-e42a-4461-a4cc-c3bdb1ecdfcf tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:56.048123 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bed40ff8-e42a-4461-a4cc-c3bdb1ecdfcf tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:56.050785 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7188e1a3-cbf5-4ca0-9786-bd4d1ae2e22f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: d40780fb-43a4-47fa-821d-a2a69413ee0b] Going to try to stop instance {{(pid=128776) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 10 12:02:56.051930 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bed40ff8-e42a-4461-a4cc-c3bdb1ecdfcf tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:56.052676 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bed40ff8-e42a-4461-a4cc-c3bdb1ecdfcf tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:56.053594 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bed40ff8-e42a-4461-a4cc-c3bdb1ecdfcf tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:56.084147 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:02:56.091509 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-bed40ff8-e42a-4461-a4cc-c3bdb1ecdfcf tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] HTTP exception thrown: Instance 2ddb58d0-8137-4755-80e1-eb12a4967bc9 could not be found. Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bed40ff8-e42a-4461-a4cc-c3bdb1ecdfcf tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Request method failure captured: Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/2ddb58d0-8137-4755-80e1-eb12a4967bc9 HTTP/1.1 Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHzPkOh5toNJ43iKlERzI-d1u0raTEIO0MdtCfpuhmifGhgrSas4KeILU27LHYPsb4dv3NryTSfp5-JRWZ46_K9hlUIY6zMDf0oV1e-6IKX6SLHtfgLFBiwjiNf0mGnmzXmnKs_tmOOfUGOGKB83TZnTiQHqjV_WbHcqneyahr6DPXI Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 3723fdd806f448c1986e3dd235b09185 Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServerGroupTestJSON-804248789 Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3723fdd806f448c1986e3dd235b09185"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3723fdd806f448c1986e3dd235b09185"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3723fdd806f448c1986e3dd235b09185", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3723fdd806f448c1986e3dd235b09185"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServerGroupTestJSON-804248789 Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 3723fdd806f448c1986e3dd235b09185 Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServerGroupTestJSON-804248789 Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServerGroupTestJSON-804248789-project Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 05d28e8b26f84c3ba10a4552b6b40930 Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServerGroupTestJSON-804248789-project Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 2ddb58d0-8137-4755-80e1-eb12a4967bc9 could not be found. Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '2ddb58d0-8137-4755-80e1-eb12a4967bc9'} Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ddb58d0-8137-4755-80e1-eb12a4967bc9 could not be found. Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ddb58d0-8137-4755-80e1-eb12a4967bc9 could not be found. Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:02:56.098860 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:02:56.104809 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:02:56.104809 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:02:56.104809 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:02:56.104809 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:02:56.104809 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:02:56.104809 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ddb58d0-8137-4755-80e1-eb12a4967bc9 could not be found. Sep 10 12:02:56.104809 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:02:56.106408 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bed40ff8-e42a-4461-a4cc-c3bdb1ecdfcf tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Returning 404 to user: Instance 2ddb58d0-8137-4755-80e1-eb12a4967bc9 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:02:56.110445 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bed40ff8-e42a-4461-a4cc-c3bdb1ecdfcf tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] 10.222.0.23 "GET /compute/v2.1/servers/2ddb58d0-8137-4755-80e1-eb12a4967bc9" status: 404 len: 111 microversion: 2.1 time: 0.077203 Sep 10 12:02:56.120679 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2399/4782] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:56 2022] GET /compute/v2.1/servers/2ddb58d0-8137-4755-80e1-eb12a4967bc9 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 12:02:56.138425 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8455947d-bd88-4023-a675-692576bdc88f tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:56.159278 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.compute.server_groups [None req-8455947d-bd88-4023-a675-692576bdc88f tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Querying cell d31511aa-3734-4d55-9c57-4a88c62d4dfd(cell1) for 1 instances {{(pid=128777) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 10 12:02:56.162326 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8455947d-bd88-4023-a675-692576bdc88f tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:56.163198 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8455947d-bd88-4023-a675-692576bdc88f tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:56.164225 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8455947d-bd88-4023-a675-692576bdc88f tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:56.183809 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8455947d-bd88-4023-a675-692576bdc88f tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.057222 Sep 10 12:02:56.191599 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2400/4783] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Sep 10 12:02:56 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:02:56.196859 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b90e3835-e6af-4138-b630-31514a7a9680 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:56.201906 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7188e1a3-cbf5-4ca0-9786-bd4d1ae2e22f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "POST /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b/action" status: 202 len: 0 microversion: 2.1 time: 0.156962 Sep 10 12:02:56.211445 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2384/4784] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:02:55 2022] POST /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:02:56.223126 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3bc6259e-d3a0-41a1-912d-54d4f047e20d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:56.228444 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3bc6259e-d3a0-41a1-912d-54d4f047e20d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: d40780fb-43a4-47fa-821d-a2a69413ee0b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:56.243112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.compute.server_groups [None req-b90e3835-e6af-4138-b630-31514a7a9680 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Querying cell d31511aa-3734-4d55-9c57-4a88c62d4dfd(cell1) for 1 instances {{(pid=128777) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 10 12:02:56.244025 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b90e3835-e6af-4138-b630-31514a7a9680 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:56.244517 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b90e3835-e6af-4138-b630-31514a7a9680 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:56.244957 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b90e3835-e6af-4138-b630-31514a7a9680 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:56.247853 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3bc6259e-d3a0-41a1-912d-54d4f047e20d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:56.257115 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3bc6259e-d3a0-41a1-912d-54d4f047e20d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:56.257948 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3bc6259e-d3a0-41a1-912d-54d4f047e20d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:56.258947 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3bc6259e-d3a0-41a1-912d-54d4f047e20d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:56.259869 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3bc6259e-d3a0-41a1-912d-54d4f047e20d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:56.260146 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b90e3835-e6af-4138-b630-31514a7a9680 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/89c9facc-b5b7-4041-ab6d-26d3524d39bf" status: 200 len: 184 microversion: 2.1 time: 0.067196 Sep 10 12:02:56.260849 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3bc6259e-d3a0-41a1-912d-54d4f047e20d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:56.274748 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2401/4785] 10.222.0.23 () {58 vars in 1263 bytes} [Sat Sep 10 12:02:56 2022] GET /compute/v2.1/os-server-groups/89c9facc-b5b7-4041-ab6d-26d3524d39bf => generated 184 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:02:56.286569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-17a01efa-0ee6-42f9-b0ea-99b4d31faa18 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:56.287107 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-17a01efa-0ee6-42f9-b0ea-99b4d31faa18 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] [instance: 2ddb58d0-8137-4755-80e1-eb12a4967bc9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:56.319774 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17a01efa-0ee6-42f9-b0ea-99b4d31faa18 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:56.320277 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17a01efa-0ee6-42f9-b0ea-99b4d31faa18 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:56.320719 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17a01efa-0ee6-42f9-b0ea-99b4d31faa18 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:56.321441 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17a01efa-0ee6-42f9-b0ea-99b4d31faa18 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:56.322035 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17a01efa-0ee6-42f9-b0ea-99b4d31faa18 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:56.322453 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17a01efa-0ee6-42f9-b0ea-99b4d31faa18 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:56.341808 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-17a01efa-0ee6-42f9-b0ea-99b4d31faa18 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] HTTP exception thrown: Instance 2ddb58d0-8137-4755-80e1-eb12a4967bc9 could not be found. Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-17a01efa-0ee6-42f9-b0ea-99b4d31faa18 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Request method failure captured: Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/servers/2ddb58d0-8137-4755-80e1-eb12a4967bc9 HTTP/1.1 Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHzPkOh5toNJ43iKlERzI-d1u0raTEIO0MdtCfpuhmifGhgrSas4KeILU27LHYPsb4dv3NryTSfp5-JRWZ46_K9hlUIY6zMDf0oV1e-6IKX6SLHtfgLFBiwjiNf0mGnmzXmnKs_tmOOfUGOGKB83TZnTiQHqjV_WbHcqneyahr6DPXI Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 3723fdd806f448c1986e3dd235b09185 Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServerGroupTestJSON-804248789 Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3723fdd806f448c1986e3dd235b09185"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3723fdd806f448c1986e3dd235b09185"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3723fdd806f448c1986e3dd235b09185", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3723fdd806f448c1986e3dd235b09185"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServerGroupTestJSON-804248789 Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 3723fdd806f448c1986e3dd235b09185 Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServerGroupTestJSON-804248789 Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServerGroupTestJSON-804248789-project Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 05d28e8b26f84c3ba10a4552b6b40930 Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServerGroupTestJSON-804248789-project Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 2ddb58d0-8137-4755-80e1-eb12a4967bc9 could not be found. Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '2ddb58d0-8137-4755-80e1-eb12a4967bc9'} Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ddb58d0-8137-4755-80e1-eb12a4967bc9 could not be found. Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:02:56.343697 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:02:56.349641 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ddb58d0-8137-4755-80e1-eb12a4967bc9 could not be found. Sep 10 12:02:56.349641 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:02:56.349641 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:02:56.349641 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:02:56.349641 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:02:56.349641 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:02:56.349641 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:02:56.349641 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:02:56.349641 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:02:56.349641 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ddb58d0-8137-4755-80e1-eb12a4967bc9 could not be found. Sep 10 12:02:56.349641 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:02:56.349641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-17a01efa-0ee6-42f9-b0ea-99b4d31faa18 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Returning 404 to user: Instance 2ddb58d0-8137-4755-80e1-eb12a4967bc9 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:02:56.349641 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-17a01efa-0ee6-42f9-b0ea-99b4d31faa18 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2ddb58d0-8137-4755-80e1-eb12a4967bc9" status: 404 len: 111 microversion: 2.1 time: 0.067352 Sep 10 12:02:56.349641 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2402/4786] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:02:56 2022] DELETE /compute/v2.1/servers/2ddb58d0-8137-4755-80e1-eb12a4967bc9 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:02:56.353512 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-782fe16d-42dd-472f-93d7-312f3716c234 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:56.354130 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-782fe16d-42dd-472f-93d7-312f3716c234 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] [instance: 2ddb58d0-8137-4755-80e1-eb12a4967bc9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:56.363876 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-782fe16d-42dd-472f-93d7-312f3716c234 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:56.364512 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-782fe16d-42dd-472f-93d7-312f3716c234 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:56.365187 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-782fe16d-42dd-472f-93d7-312f3716c234 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:56.365983 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-782fe16d-42dd-472f-93d7-312f3716c234 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:56.366706 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-782fe16d-42dd-472f-93d7-312f3716c234 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:56.367608 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-782fe16d-42dd-472f-93d7-312f3716c234 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:56.392663 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-782fe16d-42dd-472f-93d7-312f3716c234 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] HTTP exception thrown: Instance 2ddb58d0-8137-4755-80e1-eb12a4967bc9 could not be found. Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-782fe16d-42dd-472f-93d7-312f3716c234 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Request method failure captured: Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/2ddb58d0-8137-4755-80e1-eb12a4967bc9 HTTP/1.1 Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHzPkOh5toNJ43iKlERzI-d1u0raTEIO0MdtCfpuhmifGhgrSas4KeILU27LHYPsb4dv3NryTSfp5-JRWZ46_K9hlUIY6zMDf0oV1e-6IKX6SLHtfgLFBiwjiNf0mGnmzXmnKs_tmOOfUGOGKB83TZnTiQHqjV_WbHcqneyahr6DPXI Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 3723fdd806f448c1986e3dd235b09185 Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServerGroupTestJSON-804248789 Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3723fdd806f448c1986e3dd235b09185"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3723fdd806f448c1986e3dd235b09185"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3723fdd806f448c1986e3dd235b09185", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3723fdd806f448c1986e3dd235b09185"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServerGroupTestJSON-804248789 Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 3723fdd806f448c1986e3dd235b09185 Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServerGroupTestJSON-804248789 Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServerGroupTestJSON-804248789-project Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 05d28e8b26f84c3ba10a4552b6b40930 Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServerGroupTestJSON-804248789-project Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 2ddb58d0-8137-4755-80e1-eb12a4967bc9 could not be found. Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '2ddb58d0-8137-4755-80e1-eb12a4967bc9'} Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ddb58d0-8137-4755-80e1-eb12a4967bc9 could not be found. Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ddb58d0-8137-4755-80e1-eb12a4967bc9 could not be found. Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:02:56.394206 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:02:56.401065 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:02:56.401065 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:02:56.401065 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:02:56.401065 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:02:56.401065 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:02:56.401065 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ddb58d0-8137-4755-80e1-eb12a4967bc9 could not be found. Sep 10 12:02:56.401065 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:02:56.401065 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-782fe16d-42dd-472f-93d7-312f3716c234 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Returning 404 to user: Instance 2ddb58d0-8137-4755-80e1-eb12a4967bc9 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:02:56.401065 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-782fe16d-42dd-472f-93d7-312f3716c234 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] 10.222.0.23 "GET /compute/v2.1/servers/2ddb58d0-8137-4755-80e1-eb12a4967bc9" status: 404 len: 111 microversion: 2.1 time: 0.046690 Sep 10 12:02:56.401065 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2403/4787] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:56 2022] GET /compute/v2.1/servers/2ddb58d0-8137-4755-80e1-eb12a4967bc9 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:02:56.416548 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9e44f5ba-f297-46f8-885e-852d063e48a0 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:56.430332 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-9e44f5ba-f297-46f8-885e-852d063e48a0 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] HTTP exception thrown: Instance group 3cce0cd0-16fc-4003-a53b-b6cbf3edc349 could not be found. Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9e44f5ba-f297-46f8-885e-852d063e48a0 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Request method failure captured: Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/os-server-groups/3cce0cd0-16fc-4003-a53b-b6cbf3edc349 HTTP/1.1 Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHzPkOh5toNJ43iKlERzI-d1u0raTEIO0MdtCfpuhmifGhgrSas4KeILU27LHYPsb4dv3NryTSfp5-JRWZ46_K9hlUIY6zMDf0oV1e-6IKX6SLHtfgLFBiwjiNf0mGnmzXmnKs_tmOOfUGOGKB83TZnTiQHqjV_WbHcqneyahr6DPXI Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 3723fdd806f448c1986e3dd235b09185 Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServerGroupTestJSON-804248789 Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3723fdd806f448c1986e3dd235b09185"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3723fdd806f448c1986e3dd235b09185"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3723fdd806f448c1986e3dd235b09185", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3723fdd806f448c1986e3dd235b09185"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServerGroupTestJSON-804248789 Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 3723fdd806f448c1986e3dd235b09185 Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServerGroupTestJSON-804248789 Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServerGroupTestJSON-804248789-project Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 05d28e8b26f84c3ba10a4552b6b40930 Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServerGroupTestJSON-804248789-project Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance group 3cce0cd0-16fc-4003-a53b-b6cbf3edc349 could not be found. Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '3cce0cd0-16fc-4003-a53b-b6cbf3edc349'} Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 3cce0cd0-16fc-4003-a53b-b6cbf3edc349 could not be found. Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 3cce0cd0-16fc-4003-a53b-b6cbf3edc349 could not be found. Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:02:56.443339 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:02:56.454089 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:02:56.454089 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:02:56.454089 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:02:56.454089 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:02:56.454089 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 3cce0cd0-16fc-4003-a53b-b6cbf3edc349 could not be found. Sep 10 12:02:56.454089 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:02:56.454089 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9e44f5ba-f297-46f8-885e-852d063e48a0 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Returning 404 to user: Instance group 3cce0cd0-16fc-4003-a53b-b6cbf3edc349 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:02:56.454089 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9e44f5ba-f297-46f8-885e-852d063e48a0 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/3cce0cd0-16fc-4003-a53b-b6cbf3edc349" status: 404 len: 117 microversion: 2.1 time: 0.040963 Sep 10 12:02:56.454089 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2404/4788] 10.222.0.23 () {58 vars in 1266 bytes} [Sat Sep 10 12:02:56 2022] DELETE /compute/v2.1/os-server-groups/3cce0cd0-16fc-4003-a53b-b6cbf3edc349 => generated 117 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:02:56.454089 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-268fcafe-0c65-4030-a538-3fa55e8f3a9f tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:56.454089 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-268fcafe-0c65-4030-a538-3fa55e8f3a9f tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 00e23b21-ab07-4ce8-b66e-385261d61d7f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:56.461802 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-268fcafe-0c65-4030-a538-3fa55e8f3a9f tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:56.462222 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-268fcafe-0c65-4030-a538-3fa55e8f3a9f tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:56.462657 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-268fcafe-0c65-4030-a538-3fa55e8f3a9f tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:56.463658 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-268fcafe-0c65-4030-a538-3fa55e8f3a9f tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:56.464126 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-268fcafe-0c65-4030-a538-3fa55e8f3a9f tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:56.464852 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-268fcafe-0c65-4030-a538-3fa55e8f3a9f tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:56.574571 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3bc6259e-d3a0-41a1-912d-54d4f047e20d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:56.588277 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3bc6259e-d3a0-41a1-912d-54d4f047e20d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b" status: 200 len: 1511 microversion: 2.1 time: 0.372125 Sep 10 12:02:56.589775 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2385/4789] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:56 2022] GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b => generated 1511 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:56.595332 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-96bb695a-3cad-42c4-8356-d73832f29685 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:56.602902 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-96bb695a-3cad-42c4-8356-d73832f29685 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] HTTP exception thrown: Instance group 729787f2-f11d-4421-a996-b961b2028ed1 could not be found. Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-96bb695a-3cad-42c4-8356-d73832f29685 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Request method failure captured: Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/os-server-groups/729787f2-f11d-4421-a996-b961b2028ed1 HTTP/1.1 Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHzPkOh5toNJ43iKlERzI-d1u0raTEIO0MdtCfpuhmifGhgrSas4KeILU27LHYPsb4dv3NryTSfp5-JRWZ46_K9hlUIY6zMDf0oV1e-6IKX6SLHtfgLFBiwjiNf0mGnmzXmnKs_tmOOfUGOGKB83TZnTiQHqjV_WbHcqneyahr6DPXI Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 3723fdd806f448c1986e3dd235b09185 Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServerGroupTestJSON-804248789 Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3723fdd806f448c1986e3dd235b09185"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3723fdd806f448c1986e3dd235b09185"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3723fdd806f448c1986e3dd235b09185", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3723fdd806f448c1986e3dd235b09185"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServerGroupTestJSON-804248789 Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 3723fdd806f448c1986e3dd235b09185 Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServerGroupTestJSON-804248789 Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServerGroupTestJSON-804248789-project Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 05d28e8b26f84c3ba10a4552b6b40930 Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServerGroupTestJSON-804248789-project Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance group 729787f2-f11d-4421-a996-b961b2028ed1 could not be found. Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '729787f2-f11d-4421-a996-b961b2028ed1'} Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 729787f2-f11d-4421-a996-b961b2028ed1 could not be found. Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 729787f2-f11d-4421-a996-b961b2028ed1 could not be found. Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:02:56.606504 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:02:56.612226 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:02:56.612226 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:02:56.612226 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:02:56.612226 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:02:56.612226 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 729787f2-f11d-4421-a996-b961b2028ed1 could not be found. Sep 10 12:02:56.612226 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:02:56.613187 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-96bb695a-3cad-42c4-8356-d73832f29685 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Returning 404 to user: Instance group 729787f2-f11d-4421-a996-b961b2028ed1 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:02:56.614177 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-96bb695a-3cad-42c4-8356-d73832f29685 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/729787f2-f11d-4421-a996-b961b2028ed1" status: 404 len: 117 microversion: 2.1 time: 0.023251 Sep 10 12:02:56.615142 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2386/4790] 10.222.0.23 () {58 vars in 1266 bytes} [Sat Sep 10 12:02:56 2022] DELETE /compute/v2.1/os-server-groups/729787f2-f11d-4421-a996-b961b2028ed1 => generated 117 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:02:56.623207 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-15f7025a-b682-44db-902e-368dae5ef3ae tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:56.632929 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-15f7025a-b682-44db-902e-368dae5ef3ae tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] HTTP exception thrown: Instance group 8f6a6605-9de4-47bd-81c6-8bf168aa42a9 could not be found. Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-15f7025a-b682-44db-902e-368dae5ef3ae tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Request method failure captured: Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/os-server-groups/8f6a6605-9de4-47bd-81c6-8bf168aa42a9 HTTP/1.1 Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHzPkOh5toNJ43iKlERzI-d1u0raTEIO0MdtCfpuhmifGhgrSas4KeILU27LHYPsb4dv3NryTSfp5-JRWZ46_K9hlUIY6zMDf0oV1e-6IKX6SLHtfgLFBiwjiNf0mGnmzXmnKs_tmOOfUGOGKB83TZnTiQHqjV_WbHcqneyahr6DPXI Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 3723fdd806f448c1986e3dd235b09185 Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServerGroupTestJSON-804248789 Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3723fdd806f448c1986e3dd235b09185"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3723fdd806f448c1986e3dd235b09185"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3723fdd806f448c1986e3dd235b09185", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3723fdd806f448c1986e3dd235b09185"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServerGroupTestJSON-804248789 Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 3723fdd806f448c1986e3dd235b09185 Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServerGroupTestJSON-804248789 Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServerGroupTestJSON-804248789-project Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 05d28e8b26f84c3ba10a4552b6b40930 Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServerGroupTestJSON-804248789-project Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance group 8f6a6605-9de4-47bd-81c6-8bf168aa42a9 could not be found. Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '8f6a6605-9de4-47bd-81c6-8bf168aa42a9'} Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 8f6a6605-9de4-47bd-81c6-8bf168aa42a9 could not be found. Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 8f6a6605-9de4-47bd-81c6-8bf168aa42a9 could not be found. Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:02:56.634819 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:02:56.639843 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:02:56.639843 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:02:56.639843 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:02:56.639843 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:02:56.639843 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 8f6a6605-9de4-47bd-81c6-8bf168aa42a9 could not be found. Sep 10 12:02:56.639843 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:02:56.642202 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-15f7025a-b682-44db-902e-368dae5ef3ae tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Returning 404 to user: Instance group 8f6a6605-9de4-47bd-81c6-8bf168aa42a9 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:02:56.643357 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-15f7025a-b682-44db-902e-368dae5ef3ae tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/8f6a6605-9de4-47bd-81c6-8bf168aa42a9" status: 404 len: 117 microversion: 2.1 time: 0.024216 Sep 10 12:02:56.644114 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2387/4791] 10.222.0.23 () {58 vars in 1266 bytes} [Sat Sep 10 12:02:56 2022] DELETE /compute/v2.1/os-server-groups/8f6a6605-9de4-47bd-81c6-8bf168aa42a9 => generated 117 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 12:02:56.652185 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-240a1176-056b-4d11-8328-34508360697e tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:56.672939 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-240a1176-056b-4d11-8328-34508360697e tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] HTTP exception thrown: Instance group cd169b4b-a4ab-49b3-90c0-8b537a845421 could not be found. Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-240a1176-056b-4d11-8328-34508360697e tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Request method failure captured: Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/os-server-groups/cd169b4b-a4ab-49b3-90c0-8b537a845421 HTTP/1.1 Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHzPkOh5toNJ43iKlERzI-d1u0raTEIO0MdtCfpuhmifGhgrSas4KeILU27LHYPsb4dv3NryTSfp5-JRWZ46_K9hlUIY6zMDf0oV1e-6IKX6SLHtfgLFBiwjiNf0mGnmzXmnKs_tmOOfUGOGKB83TZnTiQHqjV_WbHcqneyahr6DPXI Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 3723fdd806f448c1986e3dd235b09185 Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServerGroupTestJSON-804248789 Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3723fdd806f448c1986e3dd235b09185"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3723fdd806f448c1986e3dd235b09185"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3723fdd806f448c1986e3dd235b09185", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3723fdd806f448c1986e3dd235b09185"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServerGroupTestJSON-804248789 Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 3723fdd806f448c1986e3dd235b09185 Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServerGroupTestJSON-804248789 Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServerGroupTestJSON-804248789-project Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 05d28e8b26f84c3ba10a4552b6b40930 Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServerGroupTestJSON-804248789-project Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance group cd169b4b-a4ab-49b3-90c0-8b537a845421 could not be found. Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'cd169b4b-a4ab-49b3-90c0-8b537a845421'} Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group cd169b4b-a4ab-49b3-90c0-8b537a845421 could not be found. Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group cd169b4b-a4ab-49b3-90c0-8b537a845421 could not be found. Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:02:56.677501 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:02:56.681992 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:02:56.681992 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:02:56.681992 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:02:56.681992 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:02:56.681992 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group cd169b4b-a4ab-49b3-90c0-8b537a845421 could not be found. Sep 10 12:02:56.681992 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:02:56.685023 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-240a1176-056b-4d11-8328-34508360697e tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Returning 404 to user: Instance group cd169b4b-a4ab-49b3-90c0-8b537a845421 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:02:56.686889 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-240a1176-056b-4d11-8328-34508360697e tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/cd169b4b-a4ab-49b3-90c0-8b537a845421" status: 404 len: 117 microversion: 2.1 time: 0.038731 Sep 10 12:02:56.695251 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2388/4792] 10.222.0.23 () {58 vars in 1266 bytes} [Sat Sep 10 12:02:56 2022] DELETE /compute/v2.1/os-server-groups/cd169b4b-a4ab-49b3-90c0-8b537a845421 => generated 117 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 12:02:56.702725 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-81d4cad1-8549-4d56-bd79-389d71b368e7 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:56.724039 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-268fcafe-0c65-4030-a538-3fa55e8f3a9f tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:56.745756 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-81d4cad1-8549-4d56-bd79-389d71b368e7 tempest-ServerGroupTestJSON-804248789 tempest-ServerGroupTestJSON-804248789-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/89c9facc-b5b7-4041-ab6d-26d3524d39bf" status: 204 len: 0 microversion: 2.1 time: 0.048473 Sep 10 12:02:56.754905 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2389/4793] 10.222.0.23 () {58 vars in 1266 bytes} [Sat Sep 10 12:02:56 2022] DELETE /compute/v2.1/os-server-groups/89c9facc-b5b7-4041-ab6d-26d3524d39bf => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:02:56.757976 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-268fcafe-0c65-4030-a538-3fa55e8f3a9f tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f" status: 200 len: 1329 microversion: 2.1 time: 0.309911 Sep 10 12:02:56.759006 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2405/4794] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:56 2022] GET /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f => generated 1329 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:56.839671 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-372ff558-3eb2-4da0-b1be-22218b89167c req-35940e0a-ab5d-441f-b6b1-37b42fd0e46c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ddb58d0-8137-4755-80e1-eb12a4967bc9", "name": "network-vif-deleted", "tag": "fc558740-2be6-40f9-91a3-311111c16b14"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:02:56.853205 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-372ff558-3eb2-4da0-b1be-22218b89167c req-35940e0a-ab5d-441f-b6b1-37b42fd0e46c service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:56.853828 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-372ff558-3eb2-4da0-b1be-22218b89167c req-35940e0a-ab5d-441f-b6b1-37b42fd0e46c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:56.863852 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-372ff558-3eb2-4da0-b1be-22218b89167c req-35940e0a-ab5d-441f-b6b1-37b42fd0e46c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:56.906847 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-372ff558-3eb2-4da0-b1be-22218b89167c req-35940e0a-ab5d-441f-b6b1-37b42fd0e46c service nova] Creating event network-vif-deleted:fc558740-2be6-40f9-91a3-311111c16b14 for instance 2ddb58d0-8137-4755-80e1-eb12a4967bc9 on n-h1-856895-1 Sep 10 12:02:56.915986 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-372ff558-3eb2-4da0-b1be-22218b89167c req-35940e0a-ab5d-441f-b6b1-37b42fd0e46c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080291 Sep 10 12:02:56.917273 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2390/4795] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:02:56.985369 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cef3c138-8a6a-4e4e-b63e-b7c66414962c tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:56.986154 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cef3c138-8a6a-4e4e-b63e-b7c66414962c tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] [instance: 0dcd0f7f-a335-41b6-89e2-ac441b1b8a62] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:56.999259 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cef3c138-8a6a-4e4e-b63e-b7c66414962c tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:57.000685 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cef3c138-8a6a-4e4e-b63e-b7c66414962c tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:57.001393 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cef3c138-8a6a-4e4e-b63e-b7c66414962c tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:57.002354 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cef3c138-8a6a-4e4e-b63e-b7c66414962c tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:57.003047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cef3c138-8a6a-4e4e-b63e-b7c66414962c tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:57.003749 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cef3c138-8a6a-4e4e-b63e-b7c66414962c tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:57.349317 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cef3c138-8a6a-4e4e-b63e-b7c66414962c tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea57db9d224ce6afa19ed7f7ffa2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dca2926629f443aa83845ea257b5c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:57.364164 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cef3c138-8a6a-4e4e-b63e-b7c66414962c tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] 10.222.0.23 "GET /compute/v2.1/servers/0dcd0f7f-a335-41b6-89e2-ac441b1b8a62" status: 200 len: 1317 microversion: 2.1 time: 0.383273 Sep 10 12:02:57.365245 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2406/4796] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:56 2022] GET /compute/v2.1/servers/0dcd0f7f-a335-41b6-89e2-ac441b1b8a62 => generated 1317 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:57.616061 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-263d6637-6ec3-4e4d-a1ad-2db2dc9e04cf tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:57.617788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-263d6637-6ec3-4e4d-a1ad-2db2dc9e04cf tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: d40780fb-43a4-47fa-821d-a2a69413ee0b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:57.620973 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:02:57.621712 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:02:57.636891 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-263d6637-6ec3-4e4d-a1ad-2db2dc9e04cf tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:57.642276 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-263d6637-6ec3-4e4d-a1ad-2db2dc9e04cf tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:57.642820 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-263d6637-6ec3-4e4d-a1ad-2db2dc9e04cf tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:57.643688 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-263d6637-6ec3-4e4d-a1ad-2db2dc9e04cf tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:57.644223 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-263d6637-6ec3-4e4d-a1ad-2db2dc9e04cf tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:57.644720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-263d6637-6ec3-4e4d-a1ad-2db2dc9e04cf tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:57.783923 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ede98726-7db9-437c-b648-bb3da0caa24c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:57.784582 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ede98726-7db9-437c-b648-bb3da0caa24c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 00e23b21-ab07-4ce8-b66e-385261d61d7f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:57.801143 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ede98726-7db9-437c-b648-bb3da0caa24c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:57.804513 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ede98726-7db9-437c-b648-bb3da0caa24c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:57.807860 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ede98726-7db9-437c-b648-bb3da0caa24c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:57.809613 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ede98726-7db9-437c-b648-bb3da0caa24c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:57.811478 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ede98726-7db9-437c-b648-bb3da0caa24c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:57.813930 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ede98726-7db9-437c-b648-bb3da0caa24c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:58.453363 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:02:58.818038 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ede98726-7db9-437c-b648-bb3da0caa24c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:58.829162 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ede98726-7db9-437c-b648-bb3da0caa24c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f" status: 200 len: 1510 microversion: 2.1 time: 1.048933 Sep 10 12:02:58.845914 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2407/4797] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:57 2022] GET /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f => generated 1510 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:58.861939 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-540384e1-8b38-44fb-9feb-6a15a37f1858 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:58.866162 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-540384e1-8b38-44fb-9feb-6a15a37f1858 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] [instance: 0dcd0f7f-a335-41b6-89e2-ac441b1b8a62] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:58.880381 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-540384e1-8b38-44fb-9feb-6a15a37f1858 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:58.881435 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-540384e1-8b38-44fb-9feb-6a15a37f1858 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:58.882314 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-540384e1-8b38-44fb-9feb-6a15a37f1858 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:58.884366 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-540384e1-8b38-44fb-9feb-6a15a37f1858 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:58.885028 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-540384e1-8b38-44fb-9feb-6a15a37f1858 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:58.886562 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-540384e1-8b38-44fb-9feb-6a15a37f1858 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:58.896964 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-263d6637-6ec3-4e4d-a1ad-2db2dc9e04cf tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:58.915513 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-263d6637-6ec3-4e4d-a1ad-2db2dc9e04cf tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b" status: 200 len: 1511 microversion: 2.1 time: 1.303472 Sep 10 12:02:58.925804 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2391/4798] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:57 2022] GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b => generated 1511 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:58.936224 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9290859e-2ce1-4293-87ae-7db28a2c283e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:58.941898 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9290859e-2ce1-4293-87ae-7db28a2c283e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 00e23b21-ab07-4ce8-b66e-385261d61d7f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:58.949619 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9290859e-2ce1-4293-87ae-7db28a2c283e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:58.965755 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9290859e-2ce1-4293-87ae-7db28a2c283e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:58.967902 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9290859e-2ce1-4293-87ae-7db28a2c283e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:58.971030 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9290859e-2ce1-4293-87ae-7db28a2c283e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:58.971668 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9290859e-2ce1-4293-87ae-7db28a2c283e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:58.973856 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9290859e-2ce1-4293-87ae-7db28a2c283e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:59.412514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-540384e1-8b38-44fb-9feb-6a15a37f1858 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea57db9d224ce6afa19ed7f7ffa2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dca2926629f443aa83845ea257b5c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:59.422004 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-540384e1-8b38-44fb-9feb-6a15a37f1858 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] 10.222.0.23 "GET /compute/v2.1/servers/0dcd0f7f-a335-41b6-89e2-ac441b1b8a62" status: 200 len: 1317 microversion: 2.1 time: 0.564813 Sep 10 12:02:59.427350 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2408/4799] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:58 2022] GET /compute/v2.1/servers/0dcd0f7f-a335-41b6-89e2-ac441b1b8a62 => generated 1317 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:59.541288 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9290859e-2ce1-4293-87ae-7db28a2c283e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:02:59.555302 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9290859e-2ce1-4293-87ae-7db28a2c283e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f" status: 200 len: 1510 microversion: 2.1 time: 0.627851 Sep 10 12:02:59.556915 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2392/4800] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:58 2022] GET /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f => generated 1510 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:02:59.585701 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0cf54755-2a03-4d50-85ab-379ff8edba09 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:59.587125 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0cf54755-2a03-4d50-85ab-379ff8edba09 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 00e23b21-ab07-4ce8-b66e-385261d61d7f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:59.596886 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0cf54755-2a03-4d50-85ab-379ff8edba09 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:59.597708 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0cf54755-2a03-4d50-85ab-379ff8edba09 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:59.598137 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0cf54755-2a03-4d50-85ab-379ff8edba09 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:59.598867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0cf54755-2a03-4d50-85ab-379ff8edba09 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:59.608026 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0cf54755-2a03-4d50-85ab-379ff8edba09 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:59.609323 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0cf54755-2a03-4d50-85ab-379ff8edba09 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:59.645546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0cf54755-2a03-4d50-85ab-379ff8edba09 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 00e23b21-ab07-4ce8-b66e-385261d61d7f] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:02:59.739008 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:02:59.762476 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0cf54755-2a03-4d50-85ab-379ff8edba09 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "DELETE /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f" status: 204 len: 0 microversion: 2.1 time: 0.179995 Sep 10 12:02:59.763967 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2409/4801] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:02:59 2022] DELETE /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:02:59.775451 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-216c1028-9e84-4bc2-ae56-72c95097503b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:59.776716 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-216c1028-9e84-4bc2-ae56-72c95097503b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 00e23b21-ab07-4ce8-b66e-385261d61d7f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:59.784910 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-216c1028-9e84-4bc2-ae56-72c95097503b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:59.785809 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-216c1028-9e84-4bc2-ae56-72c95097503b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:59.786435 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-216c1028-9e84-4bc2-ae56-72c95097503b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:59.787946 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-216c1028-9e84-4bc2-ae56-72c95097503b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:59.788779 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-216c1028-9e84-4bc2-ae56-72c95097503b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:59.789418 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-216c1028-9e84-4bc2-ae56-72c95097503b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:59.964396 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1e3a5d76-4f4c-4fe1-973f-ce272522c7ea tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:02:59.965751 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1e3a5d76-4f4c-4fe1-973f-ce272522c7ea tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: d40780fb-43a4-47fa-821d-a2a69413ee0b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:02:59.991729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1e3a5d76-4f4c-4fe1-973f-ce272522c7ea tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:02:59.993268 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1e3a5d76-4f4c-4fe1-973f-ce272522c7ea tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:02:59.994225 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1e3a5d76-4f4c-4fe1-973f-ce272522c7ea tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:02:59.997246 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1e3a5d76-4f4c-4fe1-973f-ce272522c7ea tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:00.007551 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1e3a5d76-4f4c-4fe1-973f-ce272522c7ea tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:00.008161 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1e3a5d76-4f4c-4fe1-973f-ce272522c7ea tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:00.385775 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-216c1028-9e84-4bc2-ae56-72c95097503b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:00.395748 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-216c1028-9e84-4bc2-ae56-72c95097503b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f" status: 200 len: 1516 microversion: 2.1 time: 0.627248 Sep 10 12:03:00.416811 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2393/4802] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:59 2022] GET /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f => generated 1516 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:00.450026 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f2a40415-80c6-45f8-886b-5b148ffb551b tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:00.450924 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f2a40415-80c6-45f8-886b-5b148ffb551b tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] [instance: 0dcd0f7f-a335-41b6-89e2-ac441b1b8a62] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:00.458752 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f2a40415-80c6-45f8-886b-5b148ffb551b tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:00.459281 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f2a40415-80c6-45f8-886b-5b148ffb551b tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:00.459927 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f2a40415-80c6-45f8-886b-5b148ffb551b tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:00.460817 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f2a40415-80c6-45f8-886b-5b148ffb551b tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:00.461449 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f2a40415-80c6-45f8-886b-5b148ffb551b tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:00.462069 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f2a40415-80c6-45f8-886b-5b148ffb551b tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:00.501604 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1e3a5d76-4f4c-4fe1-973f-ce272522c7ea tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:00.513865 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1e3a5d76-4f4c-4fe1-973f-ce272522c7ea tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b" status: 200 len: 1511 microversion: 2.1 time: 0.558982 Sep 10 12:03:00.527769 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2410/4803] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:02:59 2022] GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b => generated 1511 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:01.284815 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f2a40415-80c6-45f8-886b-5b148ffb551b tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea57db9d224ce6afa19ed7f7ffa2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dca2926629f443aa83845ea257b5c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:01.297092 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f2a40415-80c6-45f8-886b-5b148ffb551b tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] 10.222.0.23 "GET /compute/v2.1/servers/0dcd0f7f-a335-41b6-89e2-ac441b1b8a62" status: 200 len: 1317 microversion: 2.1 time: 0.847920 Sep 10 12:03:01.299655 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2394/4804] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:00 2022] GET /compute/v2.1/servers/0dcd0f7f-a335-41b6-89e2-ac441b1b8a62 => generated 1317 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:03:01.429643 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b642ff89-6cea-438e-a617-1f840a80e045 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:01.430904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b642ff89-6cea-438e-a617-1f840a80e045 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 00e23b21-ab07-4ce8-b66e-385261d61d7f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:01.444645 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b642ff89-6cea-438e-a617-1f840a80e045 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:01.446701 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b642ff89-6cea-438e-a617-1f840a80e045 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:01.447428 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b642ff89-6cea-438e-a617-1f840a80e045 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:01.448399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b642ff89-6cea-438e-a617-1f840a80e045 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:01.449096 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b642ff89-6cea-438e-a617-1f840a80e045 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:01.449702 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b642ff89-6cea-438e-a617-1f840a80e045 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:01.540588 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ecf749d3-f35b-4a91-9ad2-298c9afcec86 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:01.541228 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ecf749d3-f35b-4a91-9ad2-298c9afcec86 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: d40780fb-43a4-47fa-821d-a2a69413ee0b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:01.548578 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ecf749d3-f35b-4a91-9ad2-298c9afcec86 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:01.549357 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ecf749d3-f35b-4a91-9ad2-298c9afcec86 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:01.549996 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ecf749d3-f35b-4a91-9ad2-298c9afcec86 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:01.550938 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ecf749d3-f35b-4a91-9ad2-298c9afcec86 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:01.551634 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ecf749d3-f35b-4a91-9ad2-298c9afcec86 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:01.552241 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ecf749d3-f35b-4a91-9ad2-298c9afcec86 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:01.946133 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ecf749d3-f35b-4a91-9ad2-298c9afcec86 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:01.963433 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ecf749d3-f35b-4a91-9ad2-298c9afcec86 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b" status: 200 len: 1511 microversion: 2.1 time: 0.426195 Sep 10 12:03:01.969621 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2395/4805] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:01 2022] GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b => generated 1511 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:03:01.989516 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b642ff89-6cea-438e-a617-1f840a80e045 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:01.998048 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b642ff89-6cea-438e-a617-1f840a80e045 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f" status: 200 len: 1516 microversion: 2.1 time: 0.572547 Sep 10 12:03:02.011677 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2411/4806] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:01 2022] GET /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f => generated 1516 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:02.328863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c85dc544-89c1-4749-81c6-6dd3ba742c05 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:02.330434 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c85dc544-89c1-4749-81c6-6dd3ba742c05 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] [instance: 0dcd0f7f-a335-41b6-89e2-ac441b1b8a62] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:02.360026 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c85dc544-89c1-4749-81c6-6dd3ba742c05 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:02.360860 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c85dc544-89c1-4749-81c6-6dd3ba742c05 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:02.362487 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c85dc544-89c1-4749-81c6-6dd3ba742c05 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:02.365564 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c85dc544-89c1-4749-81c6-6dd3ba742c05 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:02.367099 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c85dc544-89c1-4749-81c6-6dd3ba742c05 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:02.370895 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c85dc544-89c1-4749-81c6-6dd3ba742c05 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:02.690298 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-8ba11d77-0289-450e-a896-218d77183371 req-ef0dc9f2-6668-4cd3-9d58-7e13afa823bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00e23b21-ab07-4ce8-b66e-385261d61d7f", "name": "network-vif-deleted", "tag": "4620ee18-1cca-49b5-b625-83abd3ffec36"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:03:02.735596 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8ba11d77-0289-450e-a896-218d77183371 req-ef0dc9f2-6668-4cd3-9d58-7e13afa823bf service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:02.736092 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8ba11d77-0289-450e-a896-218d77183371 req-ef0dc9f2-6668-4cd3-9d58-7e13afa823bf service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:02.736532 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8ba11d77-0289-450e-a896-218d77183371 req-ef0dc9f2-6668-4cd3-9d58-7e13afa823bf service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:02.767867 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-8ba11d77-0289-450e-a896-218d77183371 req-ef0dc9f2-6668-4cd3-9d58-7e13afa823bf service nova] Creating event network-vif-deleted:4620ee18-1cca-49b5-b625-83abd3ffec36 for instance 00e23b21-ab07-4ce8-b66e-385261d61d7f on n-h2-856895-1 Sep 10 12:03:02.777967 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-8ba11d77-0289-450e-a896-218d77183371 req-ef0dc9f2-6668-4cd3-9d58-7e13afa823bf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091851 Sep 10 12:03:02.783035 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2412/4807] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:03:02.993042 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b2940362-6b6d-4ea6-a687-3e5bba0c4435 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:02.994077 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b2940362-6b6d-4ea6-a687-3e5bba0c4435 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: d40780fb-43a4-47fa-821d-a2a69413ee0b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:03.008925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b2940362-6b6d-4ea6-a687-3e5bba0c4435 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:03.009428 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b2940362-6b6d-4ea6-a687-3e5bba0c4435 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:03.009878 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b2940362-6b6d-4ea6-a687-3e5bba0c4435 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:03.010652 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b2940362-6b6d-4ea6-a687-3e5bba0c4435 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:03.011148 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b2940362-6b6d-4ea6-a687-3e5bba0c4435 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:03.014491 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b2940362-6b6d-4ea6-a687-3e5bba0c4435 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:03.026492 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c85dc544-89c1-4749-81c6-6dd3ba742c05 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea57db9d224ce6afa19ed7f7ffa2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dca2926629f443aa83845ea257b5c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:03.034397 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c85dc544-89c1-4749-81c6-6dd3ba742c05 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] 10.222.0.23 "GET /compute/v2.1/servers/0dcd0f7f-a335-41b6-89e2-ac441b1b8a62" status: 200 len: 1317 microversion: 2.1 time: 0.710057 Sep 10 12:03:03.034991 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2396/4808] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:02 2022] GET /compute/v2.1/servers/0dcd0f7f-a335-41b6-89e2-ac441b1b8a62 => generated 1317 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:03.045385 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-192149ed-3207-41fb-9348-9aeb7198c4ed tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:03.060969 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-192149ed-3207-41fb-9348-9aeb7198c4ed tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 00e23b21-ab07-4ce8-b66e-385261d61d7f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:03.084526 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-192149ed-3207-41fb-9348-9aeb7198c4ed tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:03.085049 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-192149ed-3207-41fb-9348-9aeb7198c4ed tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:03.086645 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-192149ed-3207-41fb-9348-9aeb7198c4ed tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:03.088352 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-192149ed-3207-41fb-9348-9aeb7198c4ed tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:03.090573 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-192149ed-3207-41fb-9348-9aeb7198c4ed tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:03.091974 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-192149ed-3207-41fb-9348-9aeb7198c4ed tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:03.179320 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-192149ed-3207-41fb-9348-9aeb7198c4ed tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:03.179828 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-192149ed-3207-41fb-9348-9aeb7198c4ed tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:03.180279 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-192149ed-3207-41fb-9348-9aeb7198c4ed tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:03.180746 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-192149ed-3207-41fb-9348-9aeb7198c4ed tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lazy-loading 'fault' on Instance uuid 00e23b21-ab07-4ce8-b66e-385261d61d7f {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:03:03.352644 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-192149ed-3207-41fb-9348-9aeb7198c4ed tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:03.381335 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-192149ed-3207-41fb-9348-9aeb7198c4ed tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f" status: 200 len: 1319 microversion: 2.1 time: 0.341541 Sep 10 12:03:03.387434 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2397/4809] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:03 2022] GET /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f => generated 1319 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:03.528939 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b2940362-6b6d-4ea6-a687-3e5bba0c4435 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:03.554179 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b2940362-6b6d-4ea6-a687-3e5bba0c4435 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b" status: 200 len: 1511 microversion: 2.1 time: 0.564364 Sep 10 12:03:03.556195 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2413/4810] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:02 2022] GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b => generated 1511 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:03:03.564557 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-b359098f-23f5-4232-9842-8e8ac957c821 req-64c0fc13-a5eb-45ad-93d8-c40bb26bbf25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dcd0f7f-a335-41b6-89e2-ac441b1b8a62", "name": "network-vif-plugged", "status": "completed", "tag": "3d40e717-e8a2-4f17-830f-42ea6f1a2f90"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:03:03.609298 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-b359098f-23f5-4232-9842-8e8ac957c821 req-64c0fc13-a5eb-45ad-93d8-c40bb26bbf25 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:03.609647 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-b359098f-23f5-4232-9842-8e8ac957c821 req-64c0fc13-a5eb-45ad-93d8-c40bb26bbf25 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:03.610086 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-b359098f-23f5-4232-9842-8e8ac957c821 req-64c0fc13-a5eb-45ad-93d8-c40bb26bbf25 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:03.653503 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-b359098f-23f5-4232-9842-8e8ac957c821 req-64c0fc13-a5eb-45ad-93d8-c40bb26bbf25 service nova] Creating event network-vif-plugged:3d40e717-e8a2-4f17-830f-42ea6f1a2f90 for instance 0dcd0f7f-a335-41b6-89e2-ac441b1b8a62 on n-h2-856895-1 Sep 10 12:03:03.677057 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-b359098f-23f5-4232-9842-8e8ac957c821 req-64c0fc13-a5eb-45ad-93d8-c40bb26bbf25 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118039 Sep 10 12:03:03.677882 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2398/4811] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:03:04.061075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5c91ed2c-c9db-4e91-9e99-41d1ea3a3765 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:04.062570 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5c91ed2c-c9db-4e91-9e99-41d1ea3a3765 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] [instance: 0dcd0f7f-a335-41b6-89e2-ac441b1b8a62] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:04.073165 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c91ed2c-c9db-4e91-9e99-41d1ea3a3765 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:04.078683 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c91ed2c-c9db-4e91-9e99-41d1ea3a3765 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:04.080352 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c91ed2c-c9db-4e91-9e99-41d1ea3a3765 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:04.082170 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c91ed2c-c9db-4e91-9e99-41d1ea3a3765 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:04.084233 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c91ed2c-c9db-4e91-9e99-41d1ea3a3765 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:04.085047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c91ed2c-c9db-4e91-9e99-41d1ea3a3765 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:04.139746 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:03:04.408665 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-55af0189-7e21-4909-99c4-8b3d14a75202 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:04.409957 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-55af0189-7e21-4909-99c4-8b3d14a75202 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 00e23b21-ab07-4ce8-b66e-385261d61d7f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:04.419065 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55af0189-7e21-4909-99c4-8b3d14a75202 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:04.419839 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55af0189-7e21-4909-99c4-8b3d14a75202 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:04.420465 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55af0189-7e21-4909-99c4-8b3d14a75202 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:04.421909 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55af0189-7e21-4909-99c4-8b3d14a75202 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:04.422544 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55af0189-7e21-4909-99c4-8b3d14a75202 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:04.423142 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55af0189-7e21-4909-99c4-8b3d14a75202 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:04.461103 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-55af0189-7e21-4909-99c4-8b3d14a75202 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] HTTP exception thrown: Instance 00e23b21-ab07-4ce8-b66e-385261d61d7f could not be found. Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-55af0189-7e21-4909-99c4-8b3d14a75202 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Request method failure captured: Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f HTTP/1.1 Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHykcWQYupGxhcLpb6v5AsrUV8qZ6sg9Ki1Jfb5jCMoRjGicsw0WManJo8IjBppMD5CxQdT4hQu3IHHi54G_V7lvb8EgCj19qVHNlr3p45qCyo-pmA_bA7FrmqWJZSaCbHLCvlYvItyJikej-C_PUFDVoe9D_fp0roxy7XQj-_YcxQA Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersTestJSON-793172710 Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ac8b3e9f72234d9985fbc5fa7e7984ad", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersTestJSON-793172710 Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersTestJSON-793172710 Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersTestJSON-793172710-project Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: ef32131362a3442498234c0554f08305 Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersTestJSON-793172710-project Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 00e23b21-ab07-4ce8-b66e-385261d61d7f could not be found. Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '00e23b21-ab07-4ce8-b66e-385261d61d7f'} Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00e23b21-ab07-4ce8-b66e-385261d61d7f could not be found. Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00e23b21-ab07-4ce8-b66e-385261d61d7f could not be found. Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:03:04.463115 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:03:04.468754 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:03:04.468754 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:03:04.468754 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:03:04.468754 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:03:04.468754 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00e23b21-ab07-4ce8-b66e-385261d61d7f could not be found. Sep 10 12:03:04.468754 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:03:04.470097 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-55af0189-7e21-4909-99c4-8b3d14a75202 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Returning 404 to user: Instance 00e23b21-ab07-4ce8-b66e-385261d61d7f could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:03:04.471187 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-55af0189-7e21-4909-99c4-8b3d14a75202 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f" status: 404 len: 111 microversion: 2.1 time: 0.067296 Sep 10 12:03:04.471945 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2399/4812] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:04 2022] GET /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 12:03:04.480656 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-98f8b9b0-ba61-4f19-a442-5dedada35c15 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '.version_select at 0x7f407b59ab80>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:04.520186 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-98f8b9b0-ba61-4f19-a442-5dedada35c15 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-key-1096322848" status: 202 len: 0 microversion: 2.1 time: 0.043571 Sep 10 12:03:04.521131 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2400/4813] 10.222.0.23 () {58 vars in 1209 bytes} [Sat Sep 10 12:03:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1096322848 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 12:03:04.578008 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-42b9cdeb-7257-49e4-9c53-28daebd83ced tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:04.578910 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-42b9cdeb-7257-49e4-9c53-28daebd83ced tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: d40780fb-43a4-47fa-821d-a2a69413ee0b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:04.597815 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42b9cdeb-7257-49e4-9c53-28daebd83ced tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:04.603395 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42b9cdeb-7257-49e4-9c53-28daebd83ced tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:04.604134 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42b9cdeb-7257-49e4-9c53-28daebd83ced tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:04.605537 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42b9cdeb-7257-49e4-9c53-28daebd83ced tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:04.606193 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42b9cdeb-7257-49e4-9c53-28daebd83ced tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:04.606813 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42b9cdeb-7257-49e4-9c53-28daebd83ced tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:04.893713 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5c91ed2c-c9db-4e91-9e99-41d1ea3a3765 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea57db9d224ce6afa19ed7f7ffa2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dca2926629f443aa83845ea257b5c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:04.909035 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5c91ed2c-c9db-4e91-9e99-41d1ea3a3765 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] 10.222.0.23 "GET /compute/v2.1/servers/0dcd0f7f-a335-41b6-89e2-ac441b1b8a62" status: 200 len: 1317 microversion: 2.1 time: 0.854511 Sep 10 12:03:04.912665 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2414/4814] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:04 2022] GET /compute/v2.1/servers/0dcd0f7f-a335-41b6-89e2-ac441b1b8a62 => generated 1317 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:04.919089 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3edcaf25-1eb2-4ae3-ae53-0005c7aeb8c2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-345953184", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "5a10f3ce-b3db-41f2-acaa-21e8715e6fe6"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:03:05.041062 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-3edcaf25-1eb2-4ae3-ae53-0005c7aeb8c2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] validate_networks() for [('5a10f3ce-b3db-41f2-acaa-21e8715e6fe6', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:03:05.338604 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-42b9cdeb-7257-49e4-9c53-28daebd83ced tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:05.349426 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-42b9cdeb-7257-49e4-9c53-28daebd83ced tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b" status: 200 len: 1511 microversion: 2.1 time: 0.775337 Sep 10 12:03:05.363250 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2401/4815] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:04 2022] GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b => generated 1511 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:03:05.937194 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e72b13fe-d04e-4b17-ab0c-4b5344b88579 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:05.937830 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e72b13fe-d04e-4b17-ab0c-4b5344b88579 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] [instance: 0dcd0f7f-a335-41b6-89e2-ac441b1b8a62] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:05.948511 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e72b13fe-d04e-4b17-ab0c-4b5344b88579 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:05.949018 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e72b13fe-d04e-4b17-ab0c-4b5344b88579 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:05.953520 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e72b13fe-d04e-4b17-ab0c-4b5344b88579 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:05.954568 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e72b13fe-d04e-4b17-ab0c-4b5344b88579 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:05.956445 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e72b13fe-d04e-4b17-ab0c-4b5344b88579 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:05.957081 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e72b13fe-d04e-4b17-ab0c-4b5344b88579 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:06.314725 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-3edcaf25-1eb2-4ae3-ae53-0005c7aeb8c2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:03:06.315340 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-3edcaf25-1eb2-4ae3-ae53-0005c7aeb8c2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:03:06.315638 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-3edcaf25-1eb2-4ae3-ae53-0005c7aeb8c2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:03:06.316051 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-3edcaf25-1eb2-4ae3-ae53-0005c7aeb8c2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:03:06.316463 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-3edcaf25-1eb2-4ae3-ae53-0005c7aeb8c2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:03:06.337088 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3edcaf25-1eb2-4ae3-ae53-0005c7aeb8c2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:06.340439 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3edcaf25-1eb2-4ae3-ae53-0005c7aeb8c2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:06.341984 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3edcaf25-1eb2-4ae3-ae53-0005c7aeb8c2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:06.344849 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3edcaf25-1eb2-4ae3-ae53-0005c7aeb8c2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:06.345365 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3edcaf25-1eb2-4ae3-ae53-0005c7aeb8c2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:06.346985 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3edcaf25-1eb2-4ae3-ae53-0005c7aeb8c2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:06.396940 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-3edcaf25-1eb2-4ae3-ae53-0005c7aeb8c2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Getting quotas for project ac8b3e9f72234d9985fbc5fa7e7984ad. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:03:06.408136 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-3edcaf25-1eb2-4ae3-ae53-0005c7aeb8c2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Getting quotas for user ef32131362a3442498234c0554f08305 and project ac8b3e9f72234d9985fbc5fa7e7984ad. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:03:06.440441 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3edcaf25-1eb2-4ae3-ae53-0005c7aeb8c2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:03:06.443137 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3edcaf25-1eb2-4ae3-ae53-0005c7aeb8c2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 6b4ea83e-918c-426c-8355-6febdfbe2614] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:03:06.530108 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3edcaf25-1eb2-4ae3-ae53-0005c7aeb8c2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.616025 Sep 10 12:03:06.531824 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2415/4816] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:03:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:03:06.542963 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-29ab0e44-f292-45d5-b03c-91023156960d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:06.543710 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-29ab0e44-f292-45d5-b03c-91023156960d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: d40780fb-43a4-47fa-821d-a2a69413ee0b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:06.552405 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29ab0e44-f292-45d5-b03c-91023156960d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:06.553618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29ab0e44-f292-45d5-b03c-91023156960d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:06.554365 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29ab0e44-f292-45d5-b03c-91023156960d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:06.557719 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29ab0e44-f292-45d5-b03c-91023156960d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:06.559268 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e72b13fe-d04e-4b17-ab0c-4b5344b88579 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea57db9d224ce6afa19ed7f7ffa2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dca2926629f443aa83845ea257b5c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:06.560052 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29ab0e44-f292-45d5-b03c-91023156960d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:06.560764 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29ab0e44-f292-45d5-b03c-91023156960d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:06.568802 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e72b13fe-d04e-4b17-ab0c-4b5344b88579 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] 10.222.0.23 "GET /compute/v2.1/servers/0dcd0f7f-a335-41b6-89e2-ac441b1b8a62" status: 200 len: 1506 microversion: 2.1 time: 0.636140 Sep 10 12:03:06.587243 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2402/4817] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:05 2022] GET /compute/v2.1/servers/0dcd0f7f-a335-41b6-89e2-ac441b1b8a62 => generated 1506 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:06.588220 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a1710f86-b730-452e-b3d6-311274db81b0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:06.592210 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a1710f86-b730-452e-b3d6-311274db81b0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 6b4ea83e-918c-426c-8355-6febdfbe2614] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:06.698833 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a1710f86-b730-452e-b3d6-311274db81b0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:06.708226 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a1710f86-b730-452e-b3d6-311274db81b0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614" status: 200 len: 1208 microversion: 2.1 time: 0.129583 Sep 10 12:03:06.730165 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2403/4818] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:06 2022] GET /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614 => generated 1208 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:06.736483 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f3c21646-da31-43b7-934d-e710448e0d34 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:06.737226 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f3c21646-da31-43b7-934d-e710448e0d34 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] [instance: 0dcd0f7f-a335-41b6-89e2-ac441b1b8a62] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:06.744102 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3c21646-da31-43b7-934d-e710448e0d34 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:06.744936 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3c21646-da31-43b7-934d-e710448e0d34 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:06.745574 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3c21646-da31-43b7-934d-e710448e0d34 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:06.746485 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3c21646-da31-43b7-934d-e710448e0d34 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:06.747124 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3c21646-da31-43b7-934d-e710448e0d34 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:06.748261 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f3c21646-da31-43b7-934d-e710448e0d34 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:06.779483 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f3c21646-da31-43b7-934d-e710448e0d34 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] 10.222.0.23 "GET /compute/v2.1/servers/0dcd0f7f-a335-41b6-89e2-ac441b1b8a62/ips" status: 200 len: 109 microversion: 2.1 time: 0.047423 Sep 10 12:03:06.781235 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2404/4819] 10.222.0.23 () {58 vars in 1248 bytes} [Sat Sep 10 12:03:06 2022] GET /compute/v2.1/servers/0dcd0f7f-a335-41b6-89e2-ac441b1b8a62/ips => generated 109 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:03:06.793905 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3773d811-8ccb-4b34-855d-09535f48fcf7 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:06.794792 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3773d811-8ccb-4b34-855d-09535f48fcf7 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] [instance: 0dcd0f7f-a335-41b6-89e2-ac441b1b8a62] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:06.806723 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3773d811-8ccb-4b34-855d-09535f48fcf7 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:06.807796 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3773d811-8ccb-4b34-855d-09535f48fcf7 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:06.808734 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3773d811-8ccb-4b34-855d-09535f48fcf7 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:06.810162 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3773d811-8ccb-4b34-855d-09535f48fcf7 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:06.811183 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3773d811-8ccb-4b34-855d-09535f48fcf7 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:06.812677 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3773d811-8ccb-4b34-855d-09535f48fcf7 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:06.841393 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3773d811-8ccb-4b34-855d-09535f48fcf7 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] 10.222.0.23 "GET /compute/v2.1/servers/0dcd0f7f-a335-41b6-89e2-ac441b1b8a62/ips" status: 200 len: 109 microversion: 2.1 time: 0.051835 Sep 10 12:03:06.847211 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2405/4820] 10.222.0.23 () {58 vars in 1248 bytes} [Sat Sep 10 12:03:06 2022] GET /compute/v2.1/servers/0dcd0f7f-a335-41b6-89e2-ac441b1b8a62/ips => generated 109 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:03:06.858005 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-682868e5-5079-472d-8022-d5f28c872be3 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:06.858654 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-682868e5-5079-472d-8022-d5f28c872be3 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] [instance: 0dcd0f7f-a335-41b6-89e2-ac441b1b8a62] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:06.872366 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-682868e5-5079-472d-8022-d5f28c872be3 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:06.872866 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-682868e5-5079-472d-8022-d5f28c872be3 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:06.873305 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-682868e5-5079-472d-8022-d5f28c872be3 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:06.884591 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-682868e5-5079-472d-8022-d5f28c872be3 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:06.886018 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-682868e5-5079-472d-8022-d5f28c872be3 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:06.886517 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-682868e5-5079-472d-8022-d5f28c872be3 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:06.941199 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-682868e5-5079-472d-8022-d5f28c872be3 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] 10.222.0.23 "GET /compute/v2.1/servers/0dcd0f7f-a335-41b6-89e2-ac441b1b8a62/ips/tempest-ServerAddressesTestJSON-2066485671-network" status: 200 len: 94 microversion: 2.1 time: 0.087107 Sep 10 12:03:06.942242 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2406/4821] 10.222.0.23 () {58 vars in 1401 bytes} [Sat Sep 10 12:03:06 2022] GET /compute/v2.1/servers/0dcd0f7f-a335-41b6-89e2-ac441b1b8a62/ips/tempest-ServerAddressesTestJSON-2066485671-network => generated 94 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 12:03:06.968542 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b34ff906-b1ff-4921-a292-6ae637aac863 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:06.970778 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b34ff906-b1ff-4921-a292-6ae637aac863 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] [instance: 0dcd0f7f-a335-41b6-89e2-ac441b1b8a62] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:06.987939 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b34ff906-b1ff-4921-a292-6ae637aac863 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:06.991382 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b34ff906-b1ff-4921-a292-6ae637aac863 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:06.992179 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b34ff906-b1ff-4921-a292-6ae637aac863 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:06.995512 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b34ff906-b1ff-4921-a292-6ae637aac863 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:06.997261 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b34ff906-b1ff-4921-a292-6ae637aac863 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:06.997933 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b34ff906-b1ff-4921-a292-6ae637aac863 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:07.043413 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b34ff906-b1ff-4921-a292-6ae637aac863 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] [instance: 0dcd0f7f-a335-41b6-89e2-ac441b1b8a62] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:03:07.236635 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b34ff906-b1ff-4921-a292-6ae637aac863 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0dcd0f7f-a335-41b6-89e2-ac441b1b8a62" status: 204 len: 0 microversion: 2.1 time: 0.286752 Sep 10 12:03:07.238977 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2407/4822] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:03:06 2022] DELETE /compute/v2.1/servers/0dcd0f7f-a335-41b6-89e2-ac441b1b8a62 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:03:07.250463 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f8ceabc2-6587-4315-b4a9-e32f2e00352a tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:07.256349 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f8ceabc2-6587-4315-b4a9-e32f2e00352a tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] [instance: 0dcd0f7f-a335-41b6-89e2-ac441b1b8a62] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:07.265458 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f8ceabc2-6587-4315-b4a9-e32f2e00352a tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:07.272978 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f8ceabc2-6587-4315-b4a9-e32f2e00352a tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:07.273781 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f8ceabc2-6587-4315-b4a9-e32f2e00352a tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:07.274791 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f8ceabc2-6587-4315-b4a9-e32f2e00352a tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:07.275649 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f8ceabc2-6587-4315-b4a9-e32f2e00352a tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:07.276418 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f8ceabc2-6587-4315-b4a9-e32f2e00352a tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:07.281474 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:03:07.385977 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-29ab0e44-f292-45d5-b03c-91023156960d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:07.398381 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-29ab0e44-f292-45d5-b03c-91023156960d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b" status: 200 len: 1511 microversion: 2.1 time: 0.864707 Sep 10 12:03:07.407188 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2416/4823] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:06 2022] GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b => generated 1511 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:07.738374 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-05c861fa-a80b-447a-a8d9-af0e54dcd108 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:07.739244 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-05c861fa-a80b-447a-a8d9-af0e54dcd108 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 6b4ea83e-918c-426c-8355-6febdfbe2614] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:07.751724 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-05c861fa-a80b-447a-a8d9-af0e54dcd108 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:07.754215 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-05c861fa-a80b-447a-a8d9-af0e54dcd108 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:07.756847 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-05c861fa-a80b-447a-a8d9-af0e54dcd108 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:07.773585 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-05c861fa-a80b-447a-a8d9-af0e54dcd108 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:07.774275 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-05c861fa-a80b-447a-a8d9-af0e54dcd108 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:07.774735 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-05c861fa-a80b-447a-a8d9-af0e54dcd108 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:07.931495 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f8ceabc2-6587-4315-b4a9-e32f2e00352a tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea57db9d224ce6afa19ed7f7ffa2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dca2926629f443aa83845ea257b5c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:07.963070 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f8ceabc2-6587-4315-b4a9-e32f2e00352a tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] 10.222.0.23 "GET /compute/v2.1/servers/0dcd0f7f-a335-41b6-89e2-ac441b1b8a62" status: 200 len: 1512 microversion: 2.1 time: 0.712704 Sep 10 12:03:07.966685 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2408/4824] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:07 2022] GET /compute/v2.1/servers/0dcd0f7f-a335-41b6-89e2-ac441b1b8a62 => generated 1512 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:03:08.045055 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-05c861fa-a80b-447a-a8d9-af0e54dcd108 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:08.068686 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-05c861fa-a80b-447a-a8d9-af0e54dcd108 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614" status: 200 len: 1204 microversion: 2.1 time: 0.335737 Sep 10 12:03:08.082621 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2417/4825] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:07 2022] GET /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614 => generated 1204 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:08.428759 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-288259a4-b510-4b82-be28-03537a760e90 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:08.429662 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-288259a4-b510-4b82-be28-03537a760e90 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: d40780fb-43a4-47fa-821d-a2a69413ee0b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:08.446269 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-288259a4-b510-4b82-be28-03537a760e90 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:08.449213 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-288259a4-b510-4b82-be28-03537a760e90 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:08.452316 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-288259a4-b510-4b82-be28-03537a760e90 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:08.455758 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-288259a4-b510-4b82-be28-03537a760e90 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:08.459060 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-288259a4-b510-4b82-be28-03537a760e90 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:08.461528 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-288259a4-b510-4b82-be28-03537a760e90 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:08.992535 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-147d4d12-88ac-4a0f-8d54-e5e90b6b30b5 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:08.994301 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-147d4d12-88ac-4a0f-8d54-e5e90b6b30b5 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] [instance: 0dcd0f7f-a335-41b6-89e2-ac441b1b8a62] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:09.014877 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-147d4d12-88ac-4a0f-8d54-e5e90b6b30b5 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:09.016160 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-147d4d12-88ac-4a0f-8d54-e5e90b6b30b5 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:09.016988 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-147d4d12-88ac-4a0f-8d54-e5e90b6b30b5 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:09.018151 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-147d4d12-88ac-4a0f-8d54-e5e90b6b30b5 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:09.018985 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-147d4d12-88ac-4a0f-8d54-e5e90b6b30b5 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:09.019727 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-147d4d12-88ac-4a0f-8d54-e5e90b6b30b5 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:09.404156 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-288259a4-b510-4b82-be28-03537a760e90 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:09.413842 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-147d4d12-88ac-4a0f-8d54-e5e90b6b30b5 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea57db9d224ce6afa19ed7f7ffa2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dca2926629f443aa83845ea257b5c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:09.430595 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-147d4d12-88ac-4a0f-8d54-e5e90b6b30b5 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] 10.222.0.23 "GET /compute/v2.1/servers/0dcd0f7f-a335-41b6-89e2-ac441b1b8a62" status: 200 len: 1512 microversion: 2.1 time: 0.441441 Sep 10 12:03:09.431483 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2418/4826] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:08 2022] GET /compute/v2.1/servers/0dcd0f7f-a335-41b6-89e2-ac441b1b8a62 => generated 1512 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:03:09.431987 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-288259a4-b510-4b82-be28-03537a760e90 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b" status: 200 len: 1511 microversion: 2.1 time: 1.007192 Sep 10 12:03:09.434385 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2409/4827] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:08 2022] GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b => generated 1511 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:09.441150 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c526d79d-76f1-4177-bc04-30d69eaa8ea9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:09.442279 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c526d79d-76f1-4177-bc04-30d69eaa8ea9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 6b4ea83e-918c-426c-8355-6febdfbe2614] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:09.467665 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c526d79d-76f1-4177-bc04-30d69eaa8ea9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:09.468658 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c526d79d-76f1-4177-bc04-30d69eaa8ea9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:09.469298 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c526d79d-76f1-4177-bc04-30d69eaa8ea9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:09.470184 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c526d79d-76f1-4177-bc04-30d69eaa8ea9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:09.470811 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c526d79d-76f1-4177-bc04-30d69eaa8ea9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:09.471474 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c526d79d-76f1-4177-bc04-30d69eaa8ea9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:09.592536 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c526d79d-76f1-4177-bc04-30d69eaa8ea9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:09.602455 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c526d79d-76f1-4177-bc04-30d69eaa8ea9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614" status: 200 len: 1266 microversion: 2.1 time: 0.168851 Sep 10 12:03:09.603052 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2419/4828] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:09 2022] GET /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:10.459392 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7b6e763a-3b9b-467d-a9f9-ad2303f27137 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:10.460765 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7b6e763a-3b9b-467d-a9f9-ad2303f27137 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: d40780fb-43a4-47fa-821d-a2a69413ee0b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:10.463322 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fef9e794-57dd-46e1-9bcb-928b578afc42 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:10.465033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fef9e794-57dd-46e1-9bcb-928b578afc42 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] [instance: 0dcd0f7f-a335-41b6-89e2-ac441b1b8a62] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:10.471672 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b6e763a-3b9b-467d-a9f9-ad2303f27137 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:10.473337 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b6e763a-3b9b-467d-a9f9-ad2303f27137 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:10.477766 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b6e763a-3b9b-467d-a9f9-ad2303f27137 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:10.478625 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b6e763a-3b9b-467d-a9f9-ad2303f27137 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:10.479022 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b6e763a-3b9b-467d-a9f9-ad2303f27137 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:10.479803 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b6e763a-3b9b-467d-a9f9-ad2303f27137 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:10.480326 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fef9e794-57dd-46e1-9bcb-928b578afc42 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:10.481048 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fef9e794-57dd-46e1-9bcb-928b578afc42 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:10.481855 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fef9e794-57dd-46e1-9bcb-928b578afc42 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:10.482813 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fef9e794-57dd-46e1-9bcb-928b578afc42 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:10.483625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fef9e794-57dd-46e1-9bcb-928b578afc42 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:10.485527 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fef9e794-57dd-46e1-9bcb-928b578afc42 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:11.048973 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7b6e763a-3b9b-467d-a9f9-ad2303f27137 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:11.081219 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7b6e763a-3b9b-467d-a9f9-ad2303f27137 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b" status: 200 len: 1511 microversion: 2.1 time: 0.625860 Sep 10 12:03:11.087746 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2420/4829] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:10 2022] GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b => generated 1511 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:11.109871 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ecf4a1fe-b8b3-412d-ae6e-7a7a26797419 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:11.115053 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ecf4a1fe-b8b3-412d-ae6e-7a7a26797419 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 6b4ea83e-918c-426c-8355-6febdfbe2614] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:11.130916 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ecf4a1fe-b8b3-412d-ae6e-7a7a26797419 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:11.133845 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ecf4a1fe-b8b3-412d-ae6e-7a7a26797419 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:11.136716 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ecf4a1fe-b8b3-412d-ae6e-7a7a26797419 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:11.137923 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ecf4a1fe-b8b3-412d-ae6e-7a7a26797419 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:11.138843 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ecf4a1fe-b8b3-412d-ae6e-7a7a26797419 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:11.140524 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ecf4a1fe-b8b3-412d-ae6e-7a7a26797419 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:11.381330 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fef9e794-57dd-46e1-9bcb-928b578afc42 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea57db9d224ce6afa19ed7f7ffa2bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dca2926629f443aa83845ea257b5c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:11.390233 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fef9e794-57dd-46e1-9bcb-928b578afc42 tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] 10.222.0.23 "GET /compute/v2.1/servers/0dcd0f7f-a335-41b6-89e2-ac441b1b8a62" status: 200 len: 1512 microversion: 2.1 time: 0.932930 Sep 10 12:03:11.399662 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2410/4830] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:10 2022] GET /compute/v2.1/servers/0dcd0f7f-a335-41b6-89e2-ac441b1b8a62 => generated 1512 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:11.532937 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-29ac2308-d260-4540-9242-5b86d2a82e86 req-ef6b3470-d63f-4d67-ae80-260e0c42acfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dcd0f7f-a335-41b6-89e2-ac441b1b8a62", "name": "network-vif-deleted", "tag": "3d40e717-e8a2-4f17-830f-42ea6f1a2f90"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:03:11.576687 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-29ac2308-d260-4540-9242-5b86d2a82e86 req-ef6b3470-d63f-4d67-ae80-260e0c42acfe service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:11.577209 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-29ac2308-d260-4540-9242-5b86d2a82e86 req-ef6b3470-d63f-4d67-ae80-260e0c42acfe service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:11.577649 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-29ac2308-d260-4540-9242-5b86d2a82e86 req-ef6b3470-d63f-4d67-ae80-260e0c42acfe service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:11.635471 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-29ac2308-d260-4540-9242-5b86d2a82e86 req-ef6b3470-d63f-4d67-ae80-260e0c42acfe service nova] Creating event network-vif-deleted:3d40e717-e8a2-4f17-830f-42ea6f1a2f90 for instance 0dcd0f7f-a335-41b6-89e2-ac441b1b8a62 on n-h2-856895-1 Sep 10 12:03:11.660862 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-29ac2308-d260-4540-9242-5b86d2a82e86 req-ef6b3470-d63f-4d67-ae80-260e0c42acfe service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128978 Sep 10 12:03:11.662271 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2411/4831] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:03:11.849003 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ecf4a1fe-b8b3-412d-ae6e-7a7a26797419 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:11.857012 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ecf4a1fe-b8b3-412d-ae6e-7a7a26797419 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614" status: 200 len: 1308 microversion: 2.1 time: 0.767450 Sep 10 12:03:11.867582 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2421/4832] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:11 2022] GET /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614 => generated 1308 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:12.129299 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d45b867d-f206-4aa3-9de2-7e490313b733 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:12.130887 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d45b867d-f206-4aa3-9de2-7e490313b733 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: d40780fb-43a4-47fa-821d-a2a69413ee0b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:12.151759 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d45b867d-f206-4aa3-9de2-7e490313b733 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:12.152594 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d45b867d-f206-4aa3-9de2-7e490313b733 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:12.153257 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d45b867d-f206-4aa3-9de2-7e490313b733 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:12.157308 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d45b867d-f206-4aa3-9de2-7e490313b733 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:12.158005 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d45b867d-f206-4aa3-9de2-7e490313b733 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:12.161024 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d45b867d-f206-4aa3-9de2-7e490313b733 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:12.415533 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f3ab0b69-050d-41a9-9dfc-760f74c11f8d tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:12.416717 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f3ab0b69-050d-41a9-9dfc-760f74c11f8d tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] [instance: 0dcd0f7f-a335-41b6-89e2-ac441b1b8a62] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:12.425733 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f3ab0b69-050d-41a9-9dfc-760f74c11f8d tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:12.429491 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f3ab0b69-050d-41a9-9dfc-760f74c11f8d tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:12.430205 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f3ab0b69-050d-41a9-9dfc-760f74c11f8d tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:12.431099 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f3ab0b69-050d-41a9-9dfc-760f74c11f8d tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:12.432042 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f3ab0b69-050d-41a9-9dfc-760f74c11f8d tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:12.435736 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f3ab0b69-050d-41a9-9dfc-760f74c11f8d tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:12.485839 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-f3ab0b69-050d-41a9-9dfc-760f74c11f8d tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] HTTP exception thrown: Instance 0dcd0f7f-a335-41b6-89e2-ac441b1b8a62 could not be found. Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f3ab0b69-050d-41a9-9dfc-760f74c11f8d tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Request method failure captured: Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/0dcd0f7f-a335-41b6-89e2-ac441b1b8a62 HTTP/1.1 Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHzkbJZ_-60bZIQjKp2tEVh05X7MxzoTmYCfy7gmK69cZTCTZrl_O7V1QWdShyCjcD1CDn3TQiePuHw6EGrRGBjJMzt3oMGIzPId8dZZwI1HXjMlmJ7Df6pzWiRithKt51c0DiL1w43rRraeVDLM0KvIxjKNsbmYbufU4UUxXdcZ_GU Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 8dca2926629f443aa83845ea257b5c41 Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServerAddressesTestJSON-898281496 Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8dca2926629f443aa83845ea257b5c41"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8dca2926629f443aa83845ea257b5c41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8dca2926629f443aa83845ea257b5c41", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8dca2926629f443aa83845ea257b5c41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServerAddressesTestJSON-898281496 Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 8dca2926629f443aa83845ea257b5c41 Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServerAddressesTestJSON-898281496 Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServerAddressesTestJSON-898281496-project Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: cdea57db9d224ce6afa19ed7f7ffa2bf Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServerAddressesTestJSON-898281496-project Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 0dcd0f7f-a335-41b6-89e2-ac441b1b8a62 could not be found. Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '0dcd0f7f-a335-41b6-89e2-ac441b1b8a62'} Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dcd0f7f-a335-41b6-89e2-ac441b1b8a62 could not be found. Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dcd0f7f-a335-41b6-89e2-ac441b1b8a62 could not be found. Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:03:12.489793 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:03:12.495117 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:03:12.495117 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:03:12.495117 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:03:12.495117 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:03:12.495117 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:03:12.495117 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dcd0f7f-a335-41b6-89e2-ac441b1b8a62 could not be found. Sep 10 12:03:12.495117 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:03:12.499205 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f3ab0b69-050d-41a9-9dfc-760f74c11f8d tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] Returning 404 to user: Instance 0dcd0f7f-a335-41b6-89e2-ac441b1b8a62 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:03:12.500936 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f3ab0b69-050d-41a9-9dfc-760f74c11f8d tempest-ServerAddressesTestJSON-898281496 tempest-ServerAddressesTestJSON-898281496-project] 10.222.0.23 "GET /compute/v2.1/servers/0dcd0f7f-a335-41b6-89e2-ac441b1b8a62" status: 404 len: 111 microversion: 2.1 time: 0.090920 Sep 10 12:03:12.503795 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2422/4833] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:12 2022] GET /compute/v2.1/servers/0dcd0f7f-a335-41b6-89e2-ac441b1b8a62 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:03:12.881373 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b04ffa17-f6ad-44c3-b627-720c8e2bce7c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:12.882440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b04ffa17-f6ad-44c3-b627-720c8e2bce7c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 6b4ea83e-918c-426c-8355-6febdfbe2614] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:12.893664 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b04ffa17-f6ad-44c3-b627-720c8e2bce7c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:12.896879 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b04ffa17-f6ad-44c3-b627-720c8e2bce7c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:12.898597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b04ffa17-f6ad-44c3-b627-720c8e2bce7c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:12.902682 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b04ffa17-f6ad-44c3-b627-720c8e2bce7c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:12.903472 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b04ffa17-f6ad-44c3-b627-720c8e2bce7c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:12.904032 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b04ffa17-f6ad-44c3-b627-720c8e2bce7c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:12.959657 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d45b867d-f206-4aa3-9de2-7e490313b733 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:12.975858 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d45b867d-f206-4aa3-9de2-7e490313b733 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b" status: 200 len: 1511 microversion: 2.1 time: 0.851034 Sep 10 12:03:12.978128 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2412/4834] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:12 2022] GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b => generated 1511 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:13.247344 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b04ffa17-f6ad-44c3-b627-720c8e2bce7c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:13.257781 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b04ffa17-f6ad-44c3-b627-720c8e2bce7c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614" status: 200 len: 1308 microversion: 2.1 time: 0.380372 Sep 10 12:03:13.258383 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2423/4835] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:12 2022] GET /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614 => generated 1308 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:13.278694 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-f4f96b45-9c75-4916-b04f-cc721dd8db51 req-eecee37a-9978-4c1a-94b9-48c11330e633 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b4ea83e-918c-426c-8355-6febdfbe2614", "tag": "43c64c32-bbee-4029-a116-ea24bb510ae6"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:03:13.296776 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f4f96b45-9c75-4916-b04f-cc721dd8db51 req-eecee37a-9978-4c1a-94b9-48c11330e633 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:13.297767 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f4f96b45-9c75-4916-b04f-cc721dd8db51 req-eecee37a-9978-4c1a-94b9-48c11330e633 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:13.298453 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f4f96b45-9c75-4916-b04f-cc721dd8db51 req-eecee37a-9978-4c1a-94b9-48c11330e633 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:13.315284 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-f4f96b45-9c75-4916-b04f-cc721dd8db51 req-eecee37a-9978-4c1a-94b9-48c11330e633 service nova] Creating event network-changed:43c64c32-bbee-4029-a116-ea24bb510ae6 for instance 6b4ea83e-918c-426c-8355-6febdfbe2614 on n-h1-856895-1 Sep 10 12:03:13.322095 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-f4f96b45-9c75-4916-b04f-cc721dd8db51 req-eecee37a-9978-4c1a-94b9-48c11330e633 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046686 Sep 10 12:03:13.324427 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2413/4836] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:03:14.003753 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1f652a3c-7f6f-4fc0-b6c7-431e2f522255 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:14.004380 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1f652a3c-7f6f-4fc0-b6c7-431e2f522255 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: d40780fb-43a4-47fa-821d-a2a69413ee0b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:14.011432 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1f652a3c-7f6f-4fc0-b6c7-431e2f522255 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:14.011928 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1f652a3c-7f6f-4fc0-b6c7-431e2f522255 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:14.012368 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1f652a3c-7f6f-4fc0-b6c7-431e2f522255 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:14.013074 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1f652a3c-7f6f-4fc0-b6c7-431e2f522255 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:14.013535 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1f652a3c-7f6f-4fc0-b6c7-431e2f522255 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:14.014174 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1f652a3c-7f6f-4fc0-b6c7-431e2f522255 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:14.285727 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cb9112a8-ebfe-41d1-a827-c4c64775ffeb tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:14.287321 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cb9112a8-ebfe-41d1-a827-c4c64775ffeb tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 6b4ea83e-918c-426c-8355-6febdfbe2614] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:14.299933 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb9112a8-ebfe-41d1-a827-c4c64775ffeb tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:14.301289 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb9112a8-ebfe-41d1-a827-c4c64775ffeb tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:14.302180 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb9112a8-ebfe-41d1-a827-c4c64775ffeb tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:14.303456 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb9112a8-ebfe-41d1-a827-c4c64775ffeb tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:14.305504 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb9112a8-ebfe-41d1-a827-c4c64775ffeb tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:14.306148 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb9112a8-ebfe-41d1-a827-c4c64775ffeb tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:14.484974 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1f652a3c-7f6f-4fc0-b6c7-431e2f522255 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:14.505883 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1f652a3c-7f6f-4fc0-b6c7-431e2f522255 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b" status: 200 len: 1511 microversion: 2.1 time: 0.500221 Sep 10 12:03:14.508559 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2424/4837] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:13 2022] GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b => generated 1511 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:14.776297 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-cb9112a8-ebfe-41d1-a827-c4c64775ffeb tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:14.791535 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cb9112a8-ebfe-41d1-a827-c4c64775ffeb tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614" status: 200 len: 1308 microversion: 2.1 time: 0.510593 Sep 10 12:03:14.794534 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2414/4838] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:14 2022] GET /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614 => generated 1308 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:15.533113 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-99532730-8daa-4234-926a-7891ee2d4612 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:15.533738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-99532730-8daa-4234-926a-7891ee2d4612 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: d40780fb-43a4-47fa-821d-a2a69413ee0b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:15.545000 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99532730-8daa-4234-926a-7891ee2d4612 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:15.549712 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99532730-8daa-4234-926a-7891ee2d4612 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:15.550409 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99532730-8daa-4234-926a-7891ee2d4612 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:15.551973 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99532730-8daa-4234-926a-7891ee2d4612 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:15.553444 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99532730-8daa-4234-926a-7891ee2d4612 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:15.555016 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99532730-8daa-4234-926a-7891ee2d4612 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:15.818760 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f47a94a5-2772-4249-8d11-cffdc4678067 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:15.820664 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f47a94a5-2772-4249-8d11-cffdc4678067 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 6b4ea83e-918c-426c-8355-6febdfbe2614] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:15.831647 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f47a94a5-2772-4249-8d11-cffdc4678067 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:15.834936 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f47a94a5-2772-4249-8d11-cffdc4678067 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:15.835647 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f47a94a5-2772-4249-8d11-cffdc4678067 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:15.836588 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f47a94a5-2772-4249-8d11-cffdc4678067 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:15.837233 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f47a94a5-2772-4249-8d11-cffdc4678067 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:15.839812 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f47a94a5-2772-4249-8d11-cffdc4678067 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:16.370871 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:03:16.418989 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:03:16.461219 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-99532730-8daa-4234-926a-7891ee2d4612 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:16.471490 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-99532730-8daa-4234-926a-7891ee2d4612 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b" status: 200 len: 1511 microversion: 2.1 time: 0.943481 Sep 10 12:03:16.473843 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2425/4839] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:15 2022] GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b => generated 1511 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:16.575605 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f47a94a5-2772-4249-8d11-cffdc4678067 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:16.604747 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f47a94a5-2772-4249-8d11-cffdc4678067 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614" status: 200 len: 1308 microversion: 2.1 time: 0.786063 Sep 10 12:03:16.606683 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2415/4840] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:15 2022] GET /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614 => generated 1308 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:17.497332 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cd0d3644-8bde-4360-8b1a-80432f04a786 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:17.497967 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cd0d3644-8bde-4360-8b1a-80432f04a786 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: d40780fb-43a4-47fa-821d-a2a69413ee0b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:17.509567 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd0d3644-8bde-4360-8b1a-80432f04a786 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:17.510058 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd0d3644-8bde-4360-8b1a-80432f04a786 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:17.510549 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd0d3644-8bde-4360-8b1a-80432f04a786 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:17.531455 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd0d3644-8bde-4360-8b1a-80432f04a786 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:17.532437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd0d3644-8bde-4360-8b1a-80432f04a786 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:17.532723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd0d3644-8bde-4360-8b1a-80432f04a786 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:17.629776 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-38b6fc85-3b72-4c67-8e40-81ac70f6f4e0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:17.631097 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-38b6fc85-3b72-4c67-8e40-81ac70f6f4e0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 6b4ea83e-918c-426c-8355-6febdfbe2614] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:17.641380 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:03:17.649347 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-38b6fc85-3b72-4c67-8e40-81ac70f6f4e0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:17.649833 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-38b6fc85-3b72-4c67-8e40-81ac70f6f4e0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:17.650309 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-38b6fc85-3b72-4c67-8e40-81ac70f6f4e0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:17.650985 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-38b6fc85-3b72-4c67-8e40-81ac70f6f4e0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:17.658496 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-38b6fc85-3b72-4c67-8e40-81ac70f6f4e0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:17.658844 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-38b6fc85-3b72-4c67-8e40-81ac70f6f4e0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:18.135889 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cd0d3644-8bde-4360-8b1a-80432f04a786 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:18.149890 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cd0d3644-8bde-4360-8b1a-80432f04a786 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b" status: 200 len: 1511 microversion: 2.1 time: 0.657048 Sep 10 12:03:18.152158 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2426/4841] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:17 2022] GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b => generated 1511 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:18.232991 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-38b6fc85-3b72-4c67-8e40-81ac70f6f4e0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:18.243277 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-38b6fc85-3b72-4c67-8e40-81ac70f6f4e0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614" status: 200 len: 1308 microversion: 2.1 time: 0.617249 Sep 10 12:03:18.245601 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2416/4842] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:17 2022] GET /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614 => generated 1308 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:03:19.284497 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-db8b3ed4-7103-4df7-a99d-e8050a839224 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:19.287021 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-db8b3ed4-7103-4df7-a99d-e8050a839224 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 6b4ea83e-918c-426c-8355-6febdfbe2614] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:19.330371 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-db8b3ed4-7103-4df7-a99d-e8050a839224 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:19.330887 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-db8b3ed4-7103-4df7-a99d-e8050a839224 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:19.332951 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-db8b3ed4-7103-4df7-a99d-e8050a839224 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:19.338271 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-db8b3ed4-7103-4df7-a99d-e8050a839224 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:19.339321 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-db8b3ed4-7103-4df7-a99d-e8050a839224 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:19.343904 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-db8b3ed4-7103-4df7-a99d-e8050a839224 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:19.784824 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3cd40daf-0e2f-4242-84d8-d07e6ad24347 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:19.785915 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3cd40daf-0e2f-4242-84d8-d07e6ad24347 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: d40780fb-43a4-47fa-821d-a2a69413ee0b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:19.798925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3cd40daf-0e2f-4242-84d8-d07e6ad24347 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:19.799469 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3cd40daf-0e2f-4242-84d8-d07e6ad24347 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:19.799905 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3cd40daf-0e2f-4242-84d8-d07e6ad24347 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:19.802671 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3cd40daf-0e2f-4242-84d8-d07e6ad24347 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:19.804438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3cd40daf-0e2f-4242-84d8-d07e6ad24347 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:19.807268 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3cd40daf-0e2f-4242-84d8-d07e6ad24347 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:20.150141 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-db8b3ed4-7103-4df7-a99d-e8050a839224 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:20.167980 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-db8b3ed4-7103-4df7-a99d-e8050a839224 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614" status: 200 len: 1308 microversion: 2.1 time: 0.890893 Sep 10 12:03:20.168576 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2417/4843] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:19 2022] GET /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614 => generated 1308 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:20.439742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3cd40daf-0e2f-4242-84d8-d07e6ad24347 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:20.452114 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3cd40daf-0e2f-4242-84d8-d07e6ad24347 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b" status: 200 len: 1511 microversion: 2.1 time: 1.280998 Sep 10 12:03:20.452904 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2427/4844] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:19 2022] GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b => generated 1511 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:21.192907 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1aa77ff8-ff8d-47d3-b430-36be39031995 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:21.193523 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1aa77ff8-ff8d-47d3-b430-36be39031995 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 6b4ea83e-918c-426c-8355-6febdfbe2614] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:21.203763 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1aa77ff8-ff8d-47d3-b430-36be39031995 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:21.204256 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1aa77ff8-ff8d-47d3-b430-36be39031995 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:21.204690 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1aa77ff8-ff8d-47d3-b430-36be39031995 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:21.216195 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1aa77ff8-ff8d-47d3-b430-36be39031995 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:21.216913 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1aa77ff8-ff8d-47d3-b430-36be39031995 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:21.217737 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1aa77ff8-ff8d-47d3-b430-36be39031995 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:21.458708 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1aa77ff8-ff8d-47d3-b430-36be39031995 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:21.473414 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1aa77ff8-ff8d-47d3-b430-36be39031995 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614" status: 200 len: 1308 microversion: 2.1 time: 0.284106 Sep 10 12:03:21.478657 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2418/4845] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:21 2022] GET /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614 => generated 1308 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:21.483395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f8754feb-5b15-429a-a208-7053f88722a1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:21.484361 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f8754feb-5b15-429a-a208-7053f88722a1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: d40780fb-43a4-47fa-821d-a2a69413ee0b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:21.497910 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8754feb-5b15-429a-a208-7053f88722a1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:21.498482 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8754feb-5b15-429a-a208-7053f88722a1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:21.499194 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8754feb-5b15-429a-a208-7053f88722a1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:21.500181 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8754feb-5b15-429a-a208-7053f88722a1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:21.500728 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8754feb-5b15-429a-a208-7053f88722a1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:21.501089 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8754feb-5b15-429a-a208-7053f88722a1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:22.021318 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f8754feb-5b15-429a-a208-7053f88722a1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:22.032938 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f8754feb-5b15-429a-a208-7053f88722a1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b" status: 200 len: 1511 microversion: 2.1 time: 0.555717 Sep 10 12:03:22.039267 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2428/4846] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:21 2022] GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b => generated 1511 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:22.510586 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cb39c40b-fa2e-4252-a1f6-f9318537e0b5 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:22.511960 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cb39c40b-fa2e-4252-a1f6-f9318537e0b5 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 6b4ea83e-918c-426c-8355-6febdfbe2614] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:22.534464 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb39c40b-fa2e-4252-a1f6-f9318537e0b5 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:22.539752 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb39c40b-fa2e-4252-a1f6-f9318537e0b5 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:22.540507 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb39c40b-fa2e-4252-a1f6-f9318537e0b5 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:22.542697 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb39c40b-fa2e-4252-a1f6-f9318537e0b5 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:22.543461 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb39c40b-fa2e-4252-a1f6-f9318537e0b5 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:22.546165 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb39c40b-fa2e-4252-a1f6-f9318537e0b5 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:22.569599 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-8ffab655-f58b-43b1-9f46-c8bd5824dd5a req-9b6647b7-fd8a-45cc-80bd-bf6b72efc8d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b4ea83e-918c-426c-8355-6febdfbe2614", "name": "network-vif-plugged", "status": "completed", "tag": "43c64c32-bbee-4029-a116-ea24bb510ae6"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:03:22.595755 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8ffab655-f58b-43b1-9f46-c8bd5824dd5a req-9b6647b7-fd8a-45cc-80bd-bf6b72efc8d5 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:22.596242 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8ffab655-f58b-43b1-9f46-c8bd5824dd5a req-9b6647b7-fd8a-45cc-80bd-bf6b72efc8d5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:22.596673 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8ffab655-f58b-43b1-9f46-c8bd5824dd5a req-9b6647b7-fd8a-45cc-80bd-bf6b72efc8d5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:22.622650 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-8ffab655-f58b-43b1-9f46-c8bd5824dd5a req-9b6647b7-fd8a-45cc-80bd-bf6b72efc8d5 service nova] Creating event network-vif-plugged:43c64c32-bbee-4029-a116-ea24bb510ae6 for instance 6b4ea83e-918c-426c-8355-6febdfbe2614 on n-h1-856895-1 Sep 10 12:03:22.636798 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-8ffab655-f58b-43b1-9f46-c8bd5824dd5a req-9b6647b7-fd8a-45cc-80bd-bf6b72efc8d5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072549 Sep 10 12:03:22.639935 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2429/4847] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:03:23.057281 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-38e19343-15b9-4162-b42a-73e6699589bc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:23.058278 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-38e19343-15b9-4162-b42a-73e6699589bc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: d40780fb-43a4-47fa-821d-a2a69413ee0b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:23.066541 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-38e19343-15b9-4162-b42a-73e6699589bc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:23.067395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-38e19343-15b9-4162-b42a-73e6699589bc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:23.068033 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-38e19343-15b9-4162-b42a-73e6699589bc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:23.068951 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-38e19343-15b9-4162-b42a-73e6699589bc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:23.069582 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-38e19343-15b9-4162-b42a-73e6699589bc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:23.070692 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-38e19343-15b9-4162-b42a-73e6699589bc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:23.286451 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-cb39c40b-fa2e-4252-a1f6-f9318537e0b5 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:23.300152 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cb39c40b-fa2e-4252-a1f6-f9318537e0b5 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614" status: 200 len: 1308 microversion: 2.1 time: 0.795826 Sep 10 12:03:23.303571 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2419/4848] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:22 2022] GET /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614 => generated 1308 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:23.552573 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-38e19343-15b9-4162-b42a-73e6699589bc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:23.567222 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-38e19343-15b9-4162-b42a-73e6699589bc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b" status: 200 len: 1488 microversion: 2.1 time: 0.515400 Sep 10 12:03:23.575872 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2430/4849] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:23 2022] GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b => generated 1488 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:03:23.600213 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bc6ad31d-7e5f-46b9-afdf-c38e72a4a347 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:03:23.603465 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bc6ad31d-7e5f-46b9-afdf-c38e72a4a347 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:23.628253 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc6ad31d-7e5f-46b9-afdf-c38e72a4a347 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:23.630552 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc6ad31d-7e5f-46b9-afdf-c38e72a4a347 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:23.632025 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc6ad31d-7e5f-46b9-afdf-c38e72a4a347 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:23.633024 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc6ad31d-7e5f-46b9-afdf-c38e72a4a347 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:23.635814 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc6ad31d-7e5f-46b9-afdf-c38e72a4a347 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:23.636937 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc6ad31d-7e5f-46b9-afdf-c38e72a4a347 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:23.892965 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bc6ad31d-7e5f-46b9-afdf-c38e72a4a347 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "POST /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f/action" status: 200 len: 151 microversion: 2.1 time: 0.297235 Sep 10 12:03:23.894076 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2420/4850] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:03:23 2022] POST /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f/action => generated 151 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:03:23.904029 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-02d08607-47dd-4d95-a2a7-047fc71a6cd4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:23.905142 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-02d08607-47dd-4d95-a2a7-047fc71a6cd4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:23.921810 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02d08607-47dd-4d95-a2a7-047fc71a6cd4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:23.922593 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02d08607-47dd-4d95-a2a7-047fc71a6cd4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:23.923235 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02d08607-47dd-4d95-a2a7-047fc71a6cd4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:23.924133 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02d08607-47dd-4d95-a2a7-047fc71a6cd4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:23.924753 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02d08607-47dd-4d95-a2a7-047fc71a6cd4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:23.926869 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02d08607-47dd-4d95-a2a7-047fc71a6cd4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:24.257849 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-02d08607-47dd-4d95-a2a7-047fc71a6cd4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:24.296636 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-02d08607-47dd-4d95-a2a7-047fc71a6cd4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.391799 Sep 10 12:03:24.299577 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2431/4851] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:23 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:24.333766 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1668e073-ebf1-4734-adaa-0c11af5f9c51 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:24.333766 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1668e073-ebf1-4734-adaa-0c11af5f9c51 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:24.334502 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-71bd19fb-e2e9-46c1-8dc1-9867386399bd tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:24.335380 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-71bd19fb-e2e9-46c1-8dc1-9867386399bd tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 6b4ea83e-918c-426c-8355-6febdfbe2614] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:24.352470 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1668e073-ebf1-4734-adaa-0c11af5f9c51 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:24.352975 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71bd19fb-e2e9-46c1-8dc1-9867386399bd tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:24.353396 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71bd19fb-e2e9-46c1-8dc1-9867386399bd tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:24.353863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1668e073-ebf1-4734-adaa-0c11af5f9c51 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:24.354181 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71bd19fb-e2e9-46c1-8dc1-9867386399bd tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:24.354881 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71bd19fb-e2e9-46c1-8dc1-9867386399bd tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:24.356842 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1668e073-ebf1-4734-adaa-0c11af5f9c51 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:24.358766 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1668e073-ebf1-4734-adaa-0c11af5f9c51 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:24.362459 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1668e073-ebf1-4734-adaa-0c11af5f9c51 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:24.363676 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1668e073-ebf1-4734-adaa-0c11af5f9c51 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:24.369957 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71bd19fb-e2e9-46c1-8dc1-9867386399bd tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:24.370595 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71bd19fb-e2e9-46c1-8dc1-9867386399bd tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:25.053972 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-71bd19fb-e2e9-46c1-8dc1-9867386399bd tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:25.061980 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=100 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:03:25.072408 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-71bd19fb-e2e9-46c1-8dc1-9867386399bd tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614" status: 200 len: 1308 microversion: 2.1 time: 0.740480 Sep 10 12:03:25.073902 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2432/4852] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:24 2022] GET /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614 => generated 1308 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:25.098016 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1668e073-ebf1-4734-adaa-0c11af5f9c51 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:25.110084 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1668e073-ebf1-4734-adaa-0c11af5f9c51 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.783406 Sep 10 12:03:25.111677 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2421/4853] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:24 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:25.141374 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e0531f49-48e8-4f32-86a7-1dcf96ece740 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:25.142004 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e0531f49-48e8-4f32-86a7-1dcf96ece740 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:25.160136 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0531f49-48e8-4f32-86a7-1dcf96ece740 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:25.160943 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0531f49-48e8-4f32-86a7-1dcf96ece740 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:25.161407 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0531f49-48e8-4f32-86a7-1dcf96ece740 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:25.162187 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0531f49-48e8-4f32-86a7-1dcf96ece740 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:25.162581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0531f49-48e8-4f32-86a7-1dcf96ece740 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:25.163017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0531f49-48e8-4f32-86a7-1dcf96ece740 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:25.482261 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e0531f49-48e8-4f32-86a7-1dcf96ece740 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:25.501565 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e0531f49-48e8-4f32-86a7-1dcf96ece740 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.361657 Sep 10 12:03:25.504819 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2433/4854] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:25 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:25.530830 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c7faba08-964a-4cfd-8c23-b0b808972f0f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:25.531593 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c7faba08-964a-4cfd-8c23-b0b808972f0f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:25.534349 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:03:25.550889 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c7faba08-964a-4cfd-8c23-b0b808972f0f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:25.551528 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c7faba08-964a-4cfd-8c23-b0b808972f0f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:25.551976 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c7faba08-964a-4cfd-8c23-b0b808972f0f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:25.559798 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c7faba08-964a-4cfd-8c23-b0b808972f0f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:25.560410 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c7faba08-964a-4cfd-8c23-b0b808972f0f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:25.561355 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c7faba08-964a-4cfd-8c23-b0b808972f0f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:26.098060 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1c05accd-f8c8-46b0-9707-f588f934e865 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:26.098679 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1c05accd-f8c8-46b0-9707-f588f934e865 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 6b4ea83e-918c-426c-8355-6febdfbe2614] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:26.112192 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c05accd-f8c8-46b0-9707-f588f934e865 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:26.113058 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c05accd-f8c8-46b0-9707-f588f934e865 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:26.113678 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c05accd-f8c8-46b0-9707-f588f934e865 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:26.114555 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c05accd-f8c8-46b0-9707-f588f934e865 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:26.119651 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c05accd-f8c8-46b0-9707-f588f934e865 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:26.120317 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c05accd-f8c8-46b0-9707-f588f934e865 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:26.712703 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c7faba08-964a-4cfd-8c23-b0b808972f0f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:26.728745 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c7faba08-964a-4cfd-8c23-b0b808972f0f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 1.202893 Sep 10 12:03:26.728879 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2422/4855] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:25 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:26.957690 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3b3a71e9-2802-475a-85c5-5847641bf73e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-750811512", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "2b93427c-8a73-4134-b29e-29ba6a3e29a6"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:03:27.072120 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-3b3a71e9-2802-475a-85c5-5847641bf73e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] validate_networks() for [('2b93427c-8a73-4134-b29e-29ba6a3e29a6', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:03:27.317777 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1c05accd-f8c8-46b0-9707-f588f934e865 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:27.348520 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1c05accd-f8c8-46b0-9707-f588f934e865 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614" status: 200 len: 1489 microversion: 2.1 time: 1.245251 Sep 10 12:03:27.351198 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2434/4856] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:26 2022] GET /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614 => generated 1489 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:27.609186 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-abed5f3c-c2b9-42e8-a71d-6f6537932f60 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-345953184", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "5a10f3ce-b3db-41f2-acaa-21e8715e6fe6"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:03:27.706345 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-abed5f3c-c2b9-42e8-a71d-6f6537932f60 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] validate_networks() for [('5a10f3ce-b3db-41f2-acaa-21e8715e6fe6', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:03:29.804942 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-abed5f3c-c2b9-42e8-a71d-6f6537932f60 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:03:29.806792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-abed5f3c-c2b9-42e8-a71d-6f6537932f60 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:03:29.808010 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-abed5f3c-c2b9-42e8-a71d-6f6537932f60 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:03:29.808655 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-abed5f3c-c2b9-42e8-a71d-6f6537932f60 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:03:29.809292 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-abed5f3c-c2b9-42e8-a71d-6f6537932f60 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:03:29.811917 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:03:29.836293 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-abed5f3c-c2b9-42e8-a71d-6f6537932f60 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:29.837835 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-abed5f3c-c2b9-42e8-a71d-6f6537932f60 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:29.839137 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-abed5f3c-c2b9-42e8-a71d-6f6537932f60 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:29.841586 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-abed5f3c-c2b9-42e8-a71d-6f6537932f60 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:29.843715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-abed5f3c-c2b9-42e8-a71d-6f6537932f60 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:29.845433 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-abed5f3c-c2b9-42e8-a71d-6f6537932f60 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:29.939454 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-abed5f3c-c2b9-42e8-a71d-6f6537932f60 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Getting quotas for project ac8b3e9f72234d9985fbc5fa7e7984ad. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:03:29.976126 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-abed5f3c-c2b9-42e8-a71d-6f6537932f60 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Getting quotas for user ef32131362a3442498234c0554f08305 and project ac8b3e9f72234d9985fbc5fa7e7984ad. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:03:30.007451 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-abed5f3c-c2b9-42e8-a71d-6f6537932f60 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:03:30.009501 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-3b3a71e9-2802-475a-85c5-5847641bf73e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:03:30.009501 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-3b3a71e9-2802-475a-85c5-5847641bf73e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:03:30.010057 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-3b3a71e9-2802-475a-85c5-5847641bf73e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:03:30.010159 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-abed5f3c-c2b9-42e8-a71d-6f6537932f60 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: a7c6046f-aad9-4a21-9130-fa30cfa8cc1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:03:30.010328 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-3b3a71e9-2802-475a-85c5-5847641bf73e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:03:30.010599 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-3b3a71e9-2802-475a-85c5-5847641bf73e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:03:30.030602 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3b3a71e9-2802-475a-85c5-5847641bf73e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:30.031003 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3b3a71e9-2802-475a-85c5-5847641bf73e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:30.031479 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3b3a71e9-2802-475a-85c5-5847641bf73e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:30.032226 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3b3a71e9-2802-475a-85c5-5847641bf73e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:30.033063 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3b3a71e9-2802-475a-85c5-5847641bf73e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:30.033240 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3b3a71e9-2802-475a-85c5-5847641bf73e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:30.055153 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-3b3a71e9-2802-475a-85c5-5847641bf73e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Getting quotas for project 2410f9544bec4633988e1554111c9446. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:03:30.066340 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-3b3a71e9-2802-475a-85c5-5847641bf73e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Getting quotas for user 8954f3256ddd49639ea57a9242a296d0 and project 2410f9544bec4633988e1554111c9446. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:03:30.102565 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3b3a71e9-2802-475a-85c5-5847641bf73e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:03:30.106408 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3b3a71e9-2802-475a-85c5-5847641bf73e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: b161d8f6-56f1-472a-99bd-f05c1431efac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:03:30.193454 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-abed5f3c-c2b9-42e8-a71d-6f6537932f60 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.592596 Sep 10 12:03:30.200446 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2435/4857] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:03:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:03:30.212817 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3b3a71e9-2802-475a-85c5-5847641bf73e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.257210 Sep 10 12:03:30.213506 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2423/4858] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:03:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 3261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:03:30.230236 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5265c373-fd47-4d73-89a1-5ffab210c606 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:30.234432 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5265c373-fd47-4d73-89a1-5ffab210c606 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: a7c6046f-aad9-4a21-9130-fa30cfa8cc1b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:30.476069 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-11f039b5-c900-4a26-8d74-9fc1588ddd35 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1204804747", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "4cf2efdb-facd-4d46-b962-78192cf2010f"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:03:30.478022 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5265c373-fd47-4d73-89a1-5ffab210c606 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:30.492894 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5265c373-fd47-4d73-89a1-5ffab210c606 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/a7c6046f-aad9-4a21-9130-fa30cfa8cc1b" status: 200 len: 1208 microversion: 2.1 time: 0.275846 Sep 10 12:03:30.495724 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2424/4859] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:30 2022] GET /compute/v2.1/servers/a7c6046f-aad9-4a21-9130-fa30cfa8cc1b => generated 1208 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:30.512681 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-02a2a5ee-9dc1-4b33-857a-b0de841082cb tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:30.517891 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-02a2a5ee-9dc1-4b33-857a-b0de841082cb tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: b161d8f6-56f1-472a-99bd-f05c1431efac] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:30.637829 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-11f039b5-c900-4a26-8d74-9fc1588ddd35 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] validate_networks() for [('4cf2efdb-facd-4d46-b962-78192cf2010f', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:03:31.329844 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-02a2a5ee-9dc1-4b33-857a-b0de841082cb tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:31.339591 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-02a2a5ee-9dc1-4b33-857a-b0de841082cb tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac" status: 200 len: 1214 microversion: 2.1 time: 0.842471 Sep 10 12:03:31.345670 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2425/4860] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:30 2022] GET /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac => generated 1214 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:31.519064 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b00d7fcc-c5c1-49d5-9284-7780b0133b60 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:31.520252 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b00d7fcc-c5c1-49d5-9284-7780b0133b60 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: a7c6046f-aad9-4a21-9130-fa30cfa8cc1b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:31.731089 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b00d7fcc-c5c1-49d5-9284-7780b0133b60 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:31.739788 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b00d7fcc-c5c1-49d5-9284-7780b0133b60 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/a7c6046f-aad9-4a21-9130-fa30cfa8cc1b" status: 200 len: 1208 microversion: 2.1 time: 0.225642 Sep 10 12:03:31.743781 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2426/4861] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:31 2022] GET /compute/v2.1/servers/a7c6046f-aad9-4a21-9130-fa30cfa8cc1b => generated 1208 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:32.381506 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5e6674a7-e213-4992-9992-6efb739f3a65 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:32.382530 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5e6674a7-e213-4992-9992-6efb739f3a65 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: b161d8f6-56f1-472a-99bd-f05c1431efac] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:32.422643 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5e6674a7-e213-4992-9992-6efb739f3a65 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:32.424396 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5e6674a7-e213-4992-9992-6efb739f3a65 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:32.424964 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5e6674a7-e213-4992-9992-6efb739f3a65 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:32.430087 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5e6674a7-e213-4992-9992-6efb739f3a65 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:32.430925 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5e6674a7-e213-4992-9992-6efb739f3a65 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:32.436232 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5e6674a7-e213-4992-9992-6efb739f3a65 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:32.710976 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5e6674a7-e213-4992-9992-6efb739f3a65 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:32.739821 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5e6674a7-e213-4992-9992-6efb739f3a65 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac" status: 200 len: 1284 microversion: 2.1 time: 0.367635 Sep 10 12:03:32.745366 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2427/4862] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:32 2022] GET /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac => generated 1284 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:03:32.772205 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0b1a73f3-c9f6-4994-b543-f0220c4ec083 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:32.773130 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0b1a73f3-c9f6-4994-b543-f0220c4ec083 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: a7c6046f-aad9-4a21-9130-fa30cfa8cc1b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:32.789761 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0b1a73f3-c9f6-4994-b543-f0220c4ec083 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:32.797072 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0b1a73f3-c9f6-4994-b543-f0220c4ec083 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:32.797705 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0b1a73f3-c9f6-4994-b543-f0220c4ec083 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:32.798491 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0b1a73f3-c9f6-4994-b543-f0220c4ec083 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:32.798979 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0b1a73f3-c9f6-4994-b543-f0220c4ec083 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:32.807618 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0b1a73f3-c9f6-4994-b543-f0220c4ec083 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:33.132050 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0b1a73f3-c9f6-4994-b543-f0220c4ec083 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:33.149129 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0b1a73f3-c9f6-4994-b543-f0220c4ec083 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/a7c6046f-aad9-4a21-9130-fa30cfa8cc1b" status: 200 len: 1260 microversion: 2.1 time: 0.381358 Sep 10 12:03:33.170248 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2428/4863] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:32 2022] GET /compute/v2.1/servers/a7c6046f-aad9-4a21-9130-fa30cfa8cc1b => generated 1260 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:03:33.624546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-11f039b5-c900-4a26-8d74-9fc1588ddd35 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:03:33.625276 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-11f039b5-c900-4a26-8d74-9fc1588ddd35 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:03:33.625600 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-11f039b5-c900-4a26-8d74-9fc1588ddd35 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:03:33.626217 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-11f039b5-c900-4a26-8d74-9fc1588ddd35 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:03:33.626777 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-11f039b5-c900-4a26-8d74-9fc1588ddd35 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:03:33.658167 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-11f039b5-c900-4a26-8d74-9fc1588ddd35 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:33.659570 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-11f039b5-c900-4a26-8d74-9fc1588ddd35 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:33.661433 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-11f039b5-c900-4a26-8d74-9fc1588ddd35 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:33.663739 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-11f039b5-c900-4a26-8d74-9fc1588ddd35 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:33.664235 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-11f039b5-c900-4a26-8d74-9fc1588ddd35 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:33.665881 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-11f039b5-c900-4a26-8d74-9fc1588ddd35 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:33.714515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-11f039b5-c900-4a26-8d74-9fc1588ddd35 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Getting quotas for project 89d3785c3b25495b9c588d21a8d75684. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:03:33.721825 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-11f039b5-c900-4a26-8d74-9fc1588ddd35 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Getting quotas for user 862345bb47a242c288375194a92834f9 and project 89d3785c3b25495b9c588d21a8d75684. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:03:33.738444 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-11f039b5-c900-4a26-8d74-9fc1588ddd35 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:03:33.741379 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-11f039b5-c900-4a26-8d74-9fc1588ddd35 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:03:33.771570 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0ced7f19-135e-491b-8ef5-b97259fdf588 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:33.772333 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0ced7f19-135e-491b-8ef5-b97259fdf588 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: b161d8f6-56f1-472a-99bd-f05c1431efac] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:33.788040 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ced7f19-135e-491b-8ef5-b97259fdf588 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:33.791295 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ced7f19-135e-491b-8ef5-b97259fdf588 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:33.792922 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ced7f19-135e-491b-8ef5-b97259fdf588 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:33.793664 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ced7f19-135e-491b-8ef5-b97259fdf588 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:33.794136 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ced7f19-135e-491b-8ef5-b97259fdf588 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:33.799104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ced7f19-135e-491b-8ef5-b97259fdf588 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:33.865604 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-11f039b5-c900-4a26-8d74-9fc1588ddd35 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.663783 Sep 10 12:03:33.872092 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2436/4864] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:03:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 3665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:03:33.880129 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-035ec93d-5990-48e1-9734-975fa22f60dc tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:33.880754 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-035ec93d-5990-48e1-9734-975fa22f60dc tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:34.385016 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-035ec93d-5990-48e1-9734-975fa22f60dc tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:34.402714 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-035ec93d-5990-48e1-9734-975fa22f60dc tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1217 microversion: 2.1 time: 0.526619 Sep 10 12:03:34.406139 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2437/4865] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:33 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1217 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:03:34.417156 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0c81e984-3946-49b1-a7c0-2f64b4b94922 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:34.418204 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0c81e984-3946-49b1-a7c0-2f64b4b94922 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: a7c6046f-aad9-4a21-9130-fa30cfa8cc1b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:34.433248 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c81e984-3946-49b1-a7c0-2f64b4b94922 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:34.448350 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c81e984-3946-49b1-a7c0-2f64b4b94922 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:34.450757 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c81e984-3946-49b1-a7c0-2f64b4b94922 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:34.452603 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c81e984-3946-49b1-a7c0-2f64b4b94922 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:34.453716 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c81e984-3946-49b1-a7c0-2f64b4b94922 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:34.456728 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c81e984-3946-49b1-a7c0-2f64b4b94922 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:34.459029 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0ced7f19-135e-491b-8ef5-b97259fdf588 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:34.480293 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0ced7f19-135e-491b-8ef5-b97259fdf588 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac" status: 200 len: 1272 microversion: 2.1 time: 0.707072 Sep 10 12:03:34.488268 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2429/4866] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:33 2022] GET /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac => generated 1272 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:03:34.712351 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0c81e984-3946-49b1-a7c0-2f64b4b94922 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:34.732012 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0c81e984-3946-49b1-a7c0-2f64b4b94922 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/a7c6046f-aad9-4a21-9130-fa30cfa8cc1b" status: 200 len: 1266 microversion: 2.1 time: 0.324565 Sep 10 12:03:34.748548 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2438/4867] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:34 2022] GET /compute/v2.1/servers/a7c6046f-aad9-4a21-9130-fa30cfa8cc1b => generated 1266 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:35.439313 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-11576917-870a-4124-b645-af2c30a59c4d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:35.440882 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-11576917-870a-4124-b645-af2c30a59c4d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:35.457865 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-11576917-870a-4124-b645-af2c30a59c4d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:35.458639 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-11576917-870a-4124-b645-af2c30a59c4d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:35.461177 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-11576917-870a-4124-b645-af2c30a59c4d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:35.462183 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-11576917-870a-4124-b645-af2c30a59c4d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:35.462835 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-11576917-870a-4124-b645-af2c30a59c4d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:35.464664 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-11576917-870a-4124-b645-af2c30a59c4d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:35.516758 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c85a65e8-8e4b-412f-919f-c428764de4fc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:35.517385 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c85a65e8-8e4b-412f-919f-c428764de4fc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: b161d8f6-56f1-472a-99bd-f05c1431efac] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:35.530259 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:03:35.536432 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c85a65e8-8e4b-412f-919f-c428764de4fc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:35.539683 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c85a65e8-8e4b-412f-919f-c428764de4fc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:35.540181 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c85a65e8-8e4b-412f-919f-c428764de4fc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:35.551935 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c85a65e8-8e4b-412f-919f-c428764de4fc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:35.552442 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c85a65e8-8e4b-412f-919f-c428764de4fc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:35.552887 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c85a65e8-8e4b-412f-919f-c428764de4fc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:35.756279 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-11576917-870a-4124-b645-af2c30a59c4d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:35.764237 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-11576917-870a-4124-b645-af2c30a59c4d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1269 microversion: 2.1 time: 0.332337 Sep 10 12:03:35.764947 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2430/4868] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:35 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1269 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:35.786587 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2703b6ef-30a3-4e00-9f88-33ece5b89360 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:35.788960 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2703b6ef-30a3-4e00-9f88-33ece5b89360 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: a7c6046f-aad9-4a21-9130-fa30cfa8cc1b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:35.806466 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2703b6ef-30a3-4e00-9f88-33ece5b89360 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:35.806970 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2703b6ef-30a3-4e00-9f88-33ece5b89360 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:35.813140 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2703b6ef-30a3-4e00-9f88-33ece5b89360 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:35.816697 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2703b6ef-30a3-4e00-9f88-33ece5b89360 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:35.817393 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2703b6ef-30a3-4e00-9f88-33ece5b89360 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:35.820186 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2703b6ef-30a3-4e00-9f88-33ece5b89360 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:36.262654 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c85a65e8-8e4b-412f-919f-c428764de4fc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:36.276456 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c85a65e8-8e4b-412f-919f-c428764de4fc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac" status: 200 len: 1272 microversion: 2.1 time: 0.759700 Sep 10 12:03:36.279394 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2439/4869] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:35 2022] GET /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac => generated 1272 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:36.791787 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-27f1773a-9bfa-4e53-a39c-a68e407044fe tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:36.792810 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-27f1773a-9bfa-4e53-a39c-a68e407044fe tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:36.809282 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-27f1773a-9bfa-4e53-a39c-a68e407044fe tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:36.810108 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-27f1773a-9bfa-4e53-a39c-a68e407044fe tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:36.811299 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-27f1773a-9bfa-4e53-a39c-a68e407044fe tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:36.812228 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-27f1773a-9bfa-4e53-a39c-a68e407044fe tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:36.813356 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-27f1773a-9bfa-4e53-a39c-a68e407044fe tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:36.819960 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-27f1773a-9bfa-4e53-a39c-a68e407044fe tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:37.976937 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-27f1773a-9bfa-4e53-a39c-a68e407044fe tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:37.986531 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-27f1773a-9bfa-4e53-a39c-a68e407044fe tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1275 microversion: 2.1 time: 1.199712 Sep 10 12:03:37.993461 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2440/4870] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:36 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1275 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:38.003623 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2e704314-3399-4746-bbad-88cc3a4a0aee tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:38.004509 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2e704314-3399-4746-bbad-88cc3a4a0aee tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: b161d8f6-56f1-472a-99bd-f05c1431efac] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:38.020585 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2e704314-3399-4746-bbad-88cc3a4a0aee tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:38.023283 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2e704314-3399-4746-bbad-88cc3a4a0aee tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:38.024925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2e704314-3399-4746-bbad-88cc3a4a0aee tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:38.031020 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2e704314-3399-4746-bbad-88cc3a4a0aee tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:38.031754 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2e704314-3399-4746-bbad-88cc3a4a0aee tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:38.032354 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2e704314-3399-4746-bbad-88cc3a4a0aee tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:38.809421 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2703b6ef-30a3-4e00-9f88-33ece5b89360 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:38.824815 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2703b6ef-30a3-4e00-9f88-33ece5b89360 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/a7c6046f-aad9-4a21-9130-fa30cfa8cc1b" status: 200 len: 1308 microversion: 2.1 time: 3.047134 Sep 10 12:03:38.825409 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2431/4871] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:35 2022] GET /compute/v2.1/servers/a7c6046f-aad9-4a21-9130-fa30cfa8cc1b => generated 1308 bytes in 3060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:38.919549 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2e704314-3399-4746-bbad-88cc3a4a0aee tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:38.937020 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2e704314-3399-4746-bbad-88cc3a4a0aee tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac" status: 200 len: 1314 microversion: 2.1 time: 0.936491 Sep 10 12:03:38.937932 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2441/4872] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:37 2022] GET /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac => generated 1314 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:39.020386 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c419f92f-02b6-451a-a977-7ea5bba82755 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:39.021298 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c419f92f-02b6-451a-a977-7ea5bba82755 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:39.031834 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c419f92f-02b6-451a-a977-7ea5bba82755 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:39.035925 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c419f92f-02b6-451a-a977-7ea5bba82755 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:39.036574 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c419f92f-02b6-451a-a977-7ea5bba82755 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:39.041092 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c419f92f-02b6-451a-a977-7ea5bba82755 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:39.042173 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c419f92f-02b6-451a-a977-7ea5bba82755 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:39.042831 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c419f92f-02b6-451a-a977-7ea5bba82755 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:39.865454 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8eb7eb3a-02e5-4b77-a1af-434c11949b9d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:39.872081 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8eb7eb3a-02e5-4b77-a1af-434c11949b9d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: a7c6046f-aad9-4a21-9130-fa30cfa8cc1b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:39.890532 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c419f92f-02b6-451a-a977-7ea5bba82755 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:39.912956 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8eb7eb3a-02e5-4b77-a1af-434c11949b9d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:39.916281 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8eb7eb3a-02e5-4b77-a1af-434c11949b9d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:39.918819 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8eb7eb3a-02e5-4b77-a1af-434c11949b9d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:39.921272 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8eb7eb3a-02e5-4b77-a1af-434c11949b9d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:39.922083 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c419f92f-02b6-451a-a977-7ea5bba82755 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1317 microversion: 2.1 time: 0.904604 Sep 10 12:03:39.926893 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8eb7eb3a-02e5-4b77-a1af-434c11949b9d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:39.927952 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2432/4873] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:39 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1317 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:39.929224 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8eb7eb3a-02e5-4b77-a1af-434c11949b9d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:39.962920 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-94b6fbc8-5ee1-4d7d-a7c4-e0df251ab0e6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:39.963581 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-94b6fbc8-5ee1-4d7d-a7c4-e0df251ab0e6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: b161d8f6-56f1-472a-99bd-f05c1431efac] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:39.988808 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-94b6fbc8-5ee1-4d7d-a7c4-e0df251ab0e6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:39.989429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-94b6fbc8-5ee1-4d7d-a7c4-e0df251ab0e6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:39.992448 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-94b6fbc8-5ee1-4d7d-a7c4-e0df251ab0e6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:39.993257 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-94b6fbc8-5ee1-4d7d-a7c4-e0df251ab0e6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:39.993746 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-94b6fbc8-5ee1-4d7d-a7c4-e0df251ab0e6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:39.994193 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-94b6fbc8-5ee1-4d7d-a7c4-e0df251ab0e6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:40.048924 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:03:41.434252 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-94b6fbc8-5ee1-4d7d-a7c4-e0df251ab0e6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:41.458794 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-94b6fbc8-5ee1-4d7d-a7c4-e0df251ab0e6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac" status: 200 len: 1314 microversion: 2.1 time: 1.499782 Sep 10 12:03:41.459447 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2433/4874] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:39 2022] GET /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac => generated 1314 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:41.469300 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-ab56195a-fb5a-40e6-bd1d-f45fbecc6a6a req-3a01d05b-e08c-41b5-b333-ac2ece1dba3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7c6046f-aad9-4a21-9130-fa30cfa8cc1b", "tag": "634698db-6ea8-4269-8af2-c2f3a6ec9f94"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:03:41.477046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8eb7eb3a-02e5-4b77-a1af-434c11949b9d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:41.492600 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8eb7eb3a-02e5-4b77-a1af-434c11949b9d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/a7c6046f-aad9-4a21-9130-fa30cfa8cc1b" status: 200 len: 1308 microversion: 2.1 time: 1.645423 Sep 10 12:03:41.495674 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2442/4875] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:39 2022] GET /compute/v2.1/servers/a7c6046f-aad9-4a21-9130-fa30cfa8cc1b => generated 1308 bytes in 1650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:03:41.500429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ab56195a-fb5a-40e6-bd1d-f45fbecc6a6a req-3a01d05b-e08c-41b5-b333-ac2ece1dba3a service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:41.500923 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ab56195a-fb5a-40e6-bd1d-f45fbecc6a6a req-3a01d05b-e08c-41b5-b333-ac2ece1dba3a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:41.501363 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ab56195a-fb5a-40e6-bd1d-f45fbecc6a6a req-3a01d05b-e08c-41b5-b333-ac2ece1dba3a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:41.508979 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-271a60fe-6f6f-4513-8eb6-79508d6be8ac tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:41.510332 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-271a60fe-6f6f-4513-8eb6-79508d6be8ac tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:41.525682 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-ab56195a-fb5a-40e6-bd1d-f45fbecc6a6a req-3a01d05b-e08c-41b5-b333-ac2ece1dba3a service nova] Creating event network-changed:634698db-6ea8-4269-8af2-c2f3a6ec9f94 for instance a7c6046f-aad9-4a21-9130-fa30cfa8cc1b on n-h2-856895-1 Sep 10 12:03:41.531973 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-ab56195a-fb5a-40e6-bd1d-f45fbecc6a6a req-3a01d05b-e08c-41b5-b333-ac2ece1dba3a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071192 Sep 10 12:03:41.532605 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2434/4876] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:03:41.533332 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-271a60fe-6f6f-4513-8eb6-79508d6be8ac tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:41.535268 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-271a60fe-6f6f-4513-8eb6-79508d6be8ac tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:41.538542 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-271a60fe-6f6f-4513-8eb6-79508d6be8ac tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:41.542607 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-271a60fe-6f6f-4513-8eb6-79508d6be8ac tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:41.544093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-271a60fe-6f6f-4513-8eb6-79508d6be8ac tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:41.546784 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-271a60fe-6f6f-4513-8eb6-79508d6be8ac tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:42.426733 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-271a60fe-6f6f-4513-8eb6-79508d6be8ac tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:42.438492 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-271a60fe-6f6f-4513-8eb6-79508d6be8ac tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1317 microversion: 2.1 time: 0.940619 Sep 10 12:03:42.439828 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2443/4877] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:41 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1317 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:42.490330 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4ee3b7ee-fde6-48ae-87f5-23f22546e3fb tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:42.491478 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4ee3b7ee-fde6-48ae-87f5-23f22546e3fb tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: b161d8f6-56f1-472a-99bd-f05c1431efac] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:42.502143 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=12 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:03:42.506710 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ee3b7ee-fde6-48ae-87f5-23f22546e3fb tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:42.507575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ee3b7ee-fde6-48ae-87f5-23f22546e3fb tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:42.508265 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ee3b7ee-fde6-48ae-87f5-23f22546e3fb tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:42.509726 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ee3b7ee-fde6-48ae-87f5-23f22546e3fb tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:42.510439 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ee3b7ee-fde6-48ae-87f5-23f22546e3fb tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:42.511112 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ee3b7ee-fde6-48ae-87f5-23f22546e3fb tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:42.518230 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d78d3f7f-2834-43cf-8680-85dbc41f4f72 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:42.519961 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d78d3f7f-2834-43cf-8680-85dbc41f4f72 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: a7c6046f-aad9-4a21-9130-fa30cfa8cc1b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:42.527674 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d78d3f7f-2834-43cf-8680-85dbc41f4f72 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:42.533821 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d78d3f7f-2834-43cf-8680-85dbc41f4f72 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:42.534625 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d78d3f7f-2834-43cf-8680-85dbc41f4f72 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:42.537707 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d78d3f7f-2834-43cf-8680-85dbc41f4f72 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:42.538450 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d78d3f7f-2834-43cf-8680-85dbc41f4f72 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:42.542622 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d78d3f7f-2834-43cf-8680-85dbc41f4f72 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:43.240896 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d78d3f7f-2834-43cf-8680-85dbc41f4f72 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:43.258774 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4ee3b7ee-fde6-48ae-87f5-23f22546e3fb tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:43.260168 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d78d3f7f-2834-43cf-8680-85dbc41f4f72 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/a7c6046f-aad9-4a21-9130-fa30cfa8cc1b" status: 200 len: 1308 microversion: 2.1 time: 0.745949 Sep 10 12:03:43.269819 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4ee3b7ee-fde6-48ae-87f5-23f22546e3fb tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac" status: 200 len: 1314 microversion: 2.1 time: 0.785865 Sep 10 12:03:43.275809 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2444/4878] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:42 2022] GET /compute/v2.1/servers/a7c6046f-aad9-4a21-9130-fa30cfa8cc1b => generated 1308 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:43.286253 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2435/4879] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:42 2022] GET /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac => generated 1314 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:43.482169 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-be05e8ea-c43f-41e4-bb28-54c475ff91e5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:43.486205 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-be05e8ea-c43f-41e4-bb28-54c475ff91e5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:43.505138 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be05e8ea-c43f-41e4-bb28-54c475ff91e5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:43.506985 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be05e8ea-c43f-41e4-bb28-54c475ff91e5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:43.507853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be05e8ea-c43f-41e4-bb28-54c475ff91e5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:43.510056 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be05e8ea-c43f-41e4-bb28-54c475ff91e5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:43.512189 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be05e8ea-c43f-41e4-bb28-54c475ff91e5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:43.512929 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be05e8ea-c43f-41e4-bb28-54c475ff91e5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:43.517303 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-45623a86-c657-486d-806e-fe091f9d852b req-76053e35-6e6e-498b-986f-721172161b89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b161d8f6-56f1-472a-99bd-f05c1431efac", "tag": "1d2dfabb-74ce-4a1a-a0e4-d97023906eb9"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:03:43.555326 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-45623a86-c657-486d-806e-fe091f9d852b req-76053e35-6e6e-498b-986f-721172161b89 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:43.555810 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-45623a86-c657-486d-806e-fe091f9d852b req-76053e35-6e6e-498b-986f-721172161b89 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:43.559889 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-45623a86-c657-486d-806e-fe091f9d852b req-76053e35-6e6e-498b-986f-721172161b89 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:43.589207 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-45623a86-c657-486d-806e-fe091f9d852b req-76053e35-6e6e-498b-986f-721172161b89 service nova] Creating event network-changed:1d2dfabb-74ce-4a1a-a0e4-d97023906eb9 for instance b161d8f6-56f1-472a-99bd-f05c1431efac on n-h2-856895-1 Sep 10 12:03:43.602562 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-45623a86-c657-486d-806e-fe091f9d852b req-76053e35-6e6e-498b-986f-721172161b89 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092412 Sep 10 12:03:43.604308 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2436/4880] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:03:43.618842 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-a35bb4ad-aff7-4132-8395-c8bc235e3f91 req-605f7457-2453-400c-be94-8f74b0cdeec8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac1538e5-6edc-4ccb-b7a9-c2e90284e004", "tag": "264e21dc-6813-4623-838f-df7e536eeb78"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:03:43.642711 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a35bb4ad-aff7-4132-8395-c8bc235e3f91 req-605f7457-2453-400c-be94-8f74b0cdeec8 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:43.643212 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a35bb4ad-aff7-4132-8395-c8bc235e3f91 req-605f7457-2453-400c-be94-8f74b0cdeec8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:43.643647 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a35bb4ad-aff7-4132-8395-c8bc235e3f91 req-605f7457-2453-400c-be94-8f74b0cdeec8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:43.673807 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-a35bb4ad-aff7-4132-8395-c8bc235e3f91 req-605f7457-2453-400c-be94-8f74b0cdeec8 service nova] Creating event network-changed:264e21dc-6813-4623-838f-df7e536eeb78 for instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 on n-h1-856895-1 Sep 10 12:03:43.679666 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-a35bb4ad-aff7-4132-8395-c8bc235e3f91 req-605f7457-2453-400c-be94-8f74b0cdeec8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072307 Sep 10 12:03:43.680297 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2437/4881] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:03:43.690708 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=4 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:03:44.295604 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-be05e8ea-c43f-41e4-bb28-54c475ff91e5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:44.296614 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6c001491-f256-414e-96e8-9b8bdc20dffc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:44.298120 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6c001491-f256-414e-96e8-9b8bdc20dffc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: a7c6046f-aad9-4a21-9130-fa30cfa8cc1b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:44.307258 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6c001491-f256-414e-96e8-9b8bdc20dffc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:44.309240 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6c001491-f256-414e-96e8-9b8bdc20dffc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:44.309575 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-be05e8ea-c43f-41e4-bb28-54c475ff91e5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1317 microversion: 2.1 time: 0.851275 Sep 10 12:03:44.310462 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6c001491-f256-414e-96e8-9b8bdc20dffc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:44.312469 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6c001491-f256-414e-96e8-9b8bdc20dffc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:44.319620 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2445/4882] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:43 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1317 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:44.321019 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f42794ab-c147-4f0e-9e8b-32d4778be201 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:44.321173 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6c001491-f256-414e-96e8-9b8bdc20dffc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:44.321538 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6c001491-f256-414e-96e8-9b8bdc20dffc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:44.322143 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f42794ab-c147-4f0e-9e8b-32d4778be201 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: b161d8f6-56f1-472a-99bd-f05c1431efac] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:44.342984 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f42794ab-c147-4f0e-9e8b-32d4778be201 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:44.344006 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f42794ab-c147-4f0e-9e8b-32d4778be201 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:44.344826 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f42794ab-c147-4f0e-9e8b-32d4778be201 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:44.347757 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f42794ab-c147-4f0e-9e8b-32d4778be201 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:44.348562 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f42794ab-c147-4f0e-9e8b-32d4778be201 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:44.349179 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f42794ab-c147-4f0e-9e8b-32d4778be201 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:44.393129 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=14 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:03:45.037168 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f42794ab-c147-4f0e-9e8b-32d4778be201 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:45.050186 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f42794ab-c147-4f0e-9e8b-32d4778be201 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac" status: 200 len: 1314 microversion: 2.1 time: 0.736075 Sep 10 12:03:45.056170 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2446/4883] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:44 2022] GET /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac => generated 1314 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:45.339633 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c18896d4-6248-4400-9296-d60e8f6bd0a1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:45.340569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c18896d4-6248-4400-9296-d60e8f6bd0a1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:45.353061 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c18896d4-6248-4400-9296-d60e8f6bd0a1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:45.353477 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c18896d4-6248-4400-9296-d60e8f6bd0a1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:45.353906 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c18896d4-6248-4400-9296-d60e8f6bd0a1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:45.354895 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c18896d4-6248-4400-9296-d60e8f6bd0a1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:45.357646 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c18896d4-6248-4400-9296-d60e8f6bd0a1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:45.358373 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c18896d4-6248-4400-9296-d60e8f6bd0a1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:45.507953 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6c001491-f256-414e-96e8-9b8bdc20dffc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:45.518913 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6c001491-f256-414e-96e8-9b8bdc20dffc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/a7c6046f-aad9-4a21-9130-fa30cfa8cc1b" status: 200 len: 1308 microversion: 2.1 time: 1.236141 Sep 10 12:03:45.521255 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2438/4884] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:44 2022] GET /compute/v2.1/servers/a7c6046f-aad9-4a21-9130-fa30cfa8cc1b => generated 1308 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:45.927368 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c18896d4-6248-4400-9296-d60e8f6bd0a1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:45.945871 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c18896d4-6248-4400-9296-d60e8f6bd0a1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1317 microversion: 2.1 time: 0.612947 Sep 10 12:03:45.947380 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2447/4885] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:45 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1317 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:03:46.082198 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-93786e9f-3312-492f-af68-93a857f70ed1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:46.082837 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-93786e9f-3312-492f-af68-93a857f70ed1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: b161d8f6-56f1-472a-99bd-f05c1431efac] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:46.111640 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-93786e9f-3312-492f-af68-93a857f70ed1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:46.112159 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-93786e9f-3312-492f-af68-93a857f70ed1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:46.117229 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-93786e9f-3312-492f-af68-93a857f70ed1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:46.119488 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-93786e9f-3312-492f-af68-93a857f70ed1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:46.128881 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-93786e9f-3312-492f-af68-93a857f70ed1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:46.129870 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-93786e9f-3312-492f-af68-93a857f70ed1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:46.543904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-80c31164-2a3e-4c37-b9bd-33b9f8203f46 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:46.545278 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-80c31164-2a3e-4c37-b9bd-33b9f8203f46 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: a7c6046f-aad9-4a21-9130-fa30cfa8cc1b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:46.561444 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-80c31164-2a3e-4c37-b9bd-33b9f8203f46 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:46.562125 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-80c31164-2a3e-4c37-b9bd-33b9f8203f46 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:46.562765 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-80c31164-2a3e-4c37-b9bd-33b9f8203f46 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:46.563711 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-80c31164-2a3e-4c37-b9bd-33b9f8203f46 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:46.564444 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-80c31164-2a3e-4c37-b9bd-33b9f8203f46 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:46.565129 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-80c31164-2a3e-4c37-b9bd-33b9f8203f46 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:46.603017 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-93786e9f-3312-492f-af68-93a857f70ed1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:46.614528 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-93786e9f-3312-492f-af68-93a857f70ed1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac" status: 200 len: 1314 microversion: 2.1 time: 0.536727 Sep 10 12:03:46.615122 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2439/4886] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:46 2022] GET /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac => generated 1314 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:46.790335 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0db9e568-7051-4c51-a2dd-6deef8fcfb86 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-900017092", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "0807131c-07f5-42db-b4ba-899807544b90"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:03:46.928398 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-0db9e568-7051-4c51-a2dd-6deef8fcfb86 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] validate_networks() for [('0807131c-07f5-42db-b4ba-899807544b90', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:03:47.153099 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-80c31164-2a3e-4c37-b9bd-33b9f8203f46 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:47.165855 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-80c31164-2a3e-4c37-b9bd-33b9f8203f46 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/a7c6046f-aad9-4a21-9130-fa30cfa8cc1b" status: 200 len: 1308 microversion: 2.1 time: 0.626160 Sep 10 12:03:47.180841 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2448/4887] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:46 2022] GET /compute/v2.1/servers/a7c6046f-aad9-4a21-9130-fa30cfa8cc1b => generated 1308 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:47.192479 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9afc70bf-52e7-4048-9f24-f7aab8978144 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:47.193507 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9afc70bf-52e7-4048-9f24-f7aab8978144 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:47.202015 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9afc70bf-52e7-4048-9f24-f7aab8978144 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:47.202835 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9afc70bf-52e7-4048-9f24-f7aab8978144 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:47.203523 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9afc70bf-52e7-4048-9f24-f7aab8978144 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:47.205206 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9afc70bf-52e7-4048-9f24-f7aab8978144 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:47.205895 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9afc70bf-52e7-4048-9f24-f7aab8978144 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:47.207090 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9afc70bf-52e7-4048-9f24-f7aab8978144 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:47.645294 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9afc70bf-52e7-4048-9f24-f7aab8978144 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:47.660698 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9afc70bf-52e7-4048-9f24-f7aab8978144 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1317 microversion: 2.1 time: 0.474207 Sep 10 12:03:47.661626 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2449/4888] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:47 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1317 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:47.675591 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-5fd0613d-2687-4030-8893-a541b9a3e890 req-899ae961-266c-4bb7-9ade-964a39dd8403 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7c6046f-aad9-4a21-9130-fa30cfa8cc1b", "name": "network-vif-plugged", "status": "completed", "tag": "634698db-6ea8-4269-8af2-c2f3a6ec9f94"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:03:47.705259 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-5fd0613d-2687-4030-8893-a541b9a3e890 req-899ae961-266c-4bb7-9ade-964a39dd8403 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:47.706397 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-5fd0613d-2687-4030-8893-a541b9a3e890 req-899ae961-266c-4bb7-9ade-964a39dd8403 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:47.706855 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-5fd0613d-2687-4030-8893-a541b9a3e890 req-899ae961-266c-4bb7-9ade-964a39dd8403 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:47.734397 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-5fd0613d-2687-4030-8893-a541b9a3e890 req-899ae961-266c-4bb7-9ade-964a39dd8403 service nova] Creating event network-vif-plugged:634698db-6ea8-4269-8af2-c2f3a6ec9f94 for instance a7c6046f-aad9-4a21-9130-fa30cfa8cc1b on n-h2-856895-1 Sep 10 12:03:47.742230 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-5fd0613d-2687-4030-8893-a541b9a3e890 req-899ae961-266c-4bb7-9ade-964a39dd8403 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078195 Sep 10 12:03:47.743478 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2450/4889] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:03:47.749842 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0ca2be6f-5418-49c2-bdf1-445970a49f4e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:47.750884 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0ca2be6f-5418-49c2-bdf1-445970a49f4e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: b161d8f6-56f1-472a-99bd-f05c1431efac] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:47.765561 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ca2be6f-5418-49c2-bdf1-445970a49f4e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:47.766430 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ca2be6f-5418-49c2-bdf1-445970a49f4e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:47.767107 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ca2be6f-5418-49c2-bdf1-445970a49f4e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:47.770544 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ca2be6f-5418-49c2-bdf1-445970a49f4e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:47.771843 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ca2be6f-5418-49c2-bdf1-445970a49f4e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:47.772512 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ca2be6f-5418-49c2-bdf1-445970a49f4e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:48.387146 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-0db9e568-7051-4c51-a2dd-6deef8fcfb86 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:03:48.387743 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-0db9e568-7051-4c51-a2dd-6deef8fcfb86 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:03:48.388087 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-0db9e568-7051-4c51-a2dd-6deef8fcfb86 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:03:48.389310 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-0db9e568-7051-4c51-a2dd-6deef8fcfb86 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:03:48.390273 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-0db9e568-7051-4c51-a2dd-6deef8fcfb86 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:03:48.404785 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0db9e568-7051-4c51-a2dd-6deef8fcfb86 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:48.405763 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0db9e568-7051-4c51-a2dd-6deef8fcfb86 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:48.407788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0db9e568-7051-4c51-a2dd-6deef8fcfb86 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:48.410110 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0db9e568-7051-4c51-a2dd-6deef8fcfb86 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:48.410842 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0db9e568-7051-4c51-a2dd-6deef8fcfb86 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:48.411890 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0db9e568-7051-4c51-a2dd-6deef8fcfb86 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:48.464705 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-0db9e568-7051-4c51-a2dd-6deef8fcfb86 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Getting quotas for project c06b377382724d7d877c6b989cfd7271. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:03:48.475274 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-0db9e568-7051-4c51-a2dd-6deef8fcfb86 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Getting quotas for user e70a2fcdb2714a28a87e63f169ff9fc0 and project c06b377382724d7d877c6b989cfd7271. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:03:48.503665 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0db9e568-7051-4c51-a2dd-6deef8fcfb86 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:03:48.519393 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0db9e568-7051-4c51-a2dd-6deef8fcfb86 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] [instance: 6f3b842d-0cd0-4656-a69a-d409e3628f13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:03:48.646854 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0db9e568-7051-4c51-a2dd-6deef8fcfb86 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.027536 Sep 10 12:03:48.651471 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2440/4890] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:03:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2034 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:03:48.664550 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9a3821cd-f037-4ca0-973d-89fd766891f0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:48.665550 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9a3821cd-f037-4ca0-973d-89fd766891f0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: a7c6046f-aad9-4a21-9130-fa30cfa8cc1b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:48.698072 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a3821cd-f037-4ca0-973d-89fd766891f0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:48.700101 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a3821cd-f037-4ca0-973d-89fd766891f0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:48.702567 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a3821cd-f037-4ca0-973d-89fd766891f0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:48.704358 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a3821cd-f037-4ca0-973d-89fd766891f0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:48.706018 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a3821cd-f037-4ca0-973d-89fd766891f0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:48.707375 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a3821cd-f037-4ca0-973d-89fd766891f0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:49.111785 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0ca2be6f-5418-49c2-bdf1-445970a49f4e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:49.149965 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0ca2be6f-5418-49c2-bdf1-445970a49f4e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac" status: 200 len: 1314 microversion: 2.1 time: 1.404846 Sep 10 12:03:49.152285 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2451/4891] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:47 2022] GET /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac => generated 1314 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:49.176427 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1e3701a2-aaef-461f-a2a7-e609f3dddd9c tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:49.179824 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1e3701a2-aaef-461f-a2a7-e609f3dddd9c tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] [instance: 6f3b842d-0cd0-4656-a69a-d409e3628f13] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:49.539067 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1e3701a2-aaef-461f-a2a7-e609f3dddd9c tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70a2fcdb2714a28a87e63f169ff9fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b377382724d7d877c6b989cfd7271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:49.548574 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1e3701a2-aaef-461f-a2a7-e609f3dddd9c tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] 10.222.0.23 "GET /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13" status: 200 len: 1215 microversion: 2.1 time: 0.382977 Sep 10 12:03:49.552092 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2452/4892] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:49 2022] GET /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13 => generated 1215 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:49.568036 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5e6033e6-a57c-4574-8593-6dab2b377817 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:49.569200 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5e6033e6-a57c-4574-8593-6dab2b377817 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:49.589242 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5e6033e6-a57c-4574-8593-6dab2b377817 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:49.590044 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5e6033e6-a57c-4574-8593-6dab2b377817 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:49.590683 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5e6033e6-a57c-4574-8593-6dab2b377817 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:49.594140 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5e6033e6-a57c-4574-8593-6dab2b377817 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:49.594815 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5e6033e6-a57c-4574-8593-6dab2b377817 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:49.595279 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5e6033e6-a57c-4574-8593-6dab2b377817 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:49.620440 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9a3821cd-f037-4ca0-973d-89fd766891f0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:49.640480 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9a3821cd-f037-4ca0-973d-89fd766891f0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/a7c6046f-aad9-4a21-9130-fa30cfa8cc1b" status: 200 len: 1308 microversion: 2.1 time: 0.977950 Sep 10 12:03:49.642568 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2441/4893] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:48 2022] GET /compute/v2.1/servers/a7c6046f-aad9-4a21-9130-fa30cfa8cc1b => generated 1308 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:49.655738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=100 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:03:49.968748 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5e6033e6-a57c-4574-8593-6dab2b377817 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:49.985155 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5e6033e6-a57c-4574-8593-6dab2b377817 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1317 microversion: 2.1 time: 0.430855 Sep 10 12:03:49.985771 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2453/4894] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:49 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1317 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:50.179731 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5b80e4e3-db42-402f-91aa-f3eba2cf1f72 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:50.180364 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5b80e4e3-db42-402f-91aa-f3eba2cf1f72 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: b161d8f6-56f1-472a-99bd-f05c1431efac] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:50.196260 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b80e4e3-db42-402f-91aa-f3eba2cf1f72 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:50.196789 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b80e4e3-db42-402f-91aa-f3eba2cf1f72 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:50.197388 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b80e4e3-db42-402f-91aa-f3eba2cf1f72 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:50.197946 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b80e4e3-db42-402f-91aa-f3eba2cf1f72 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:50.198404 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b80e4e3-db42-402f-91aa-f3eba2cf1f72 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:50.216076 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b80e4e3-db42-402f-91aa-f3eba2cf1f72 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:50.580164 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bd04d786-db57-469c-8aa6-33ee98bf4ec6 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:50.580734 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bd04d786-db57-469c-8aa6-33ee98bf4ec6 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] [instance: 6f3b842d-0cd0-4656-a69a-d409e3628f13] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:50.603037 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd04d786-db57-469c-8aa6-33ee98bf4ec6 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:50.610420 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd04d786-db57-469c-8aa6-33ee98bf4ec6 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:50.611015 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd04d786-db57-469c-8aa6-33ee98bf4ec6 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:50.612005 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd04d786-db57-469c-8aa6-33ee98bf4ec6 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:50.618905 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd04d786-db57-469c-8aa6-33ee98bf4ec6 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:50.619450 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd04d786-db57-469c-8aa6-33ee98bf4ec6 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:50.743724 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5b80e4e3-db42-402f-91aa-f3eba2cf1f72 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:50.754561 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5b80e4e3-db42-402f-91aa-f3eba2cf1f72 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac" status: 200 len: 1314 microversion: 2.1 time: 0.579227 Sep 10 12:03:50.759887 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2442/4895] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:50 2022] GET /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac => generated 1314 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:50.771814 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a8f3a919-f0ce-45ff-be32-5fcaca54d51d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:50.772758 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a8f3a919-f0ce-45ff-be32-5fcaca54d51d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: a7c6046f-aad9-4a21-9130-fa30cfa8cc1b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:50.789836 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8f3a919-f0ce-45ff-be32-5fcaca54d51d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:50.792449 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8f3a919-f0ce-45ff-be32-5fcaca54d51d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:50.793586 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8f3a919-f0ce-45ff-be32-5fcaca54d51d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:50.796841 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8f3a919-f0ce-45ff-be32-5fcaca54d51d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:50.799052 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8f3a919-f0ce-45ff-be32-5fcaca54d51d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:50.801732 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8f3a919-f0ce-45ff-be32-5fcaca54d51d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:51.010887 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bd04d786-db57-469c-8aa6-33ee98bf4ec6 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70a2fcdb2714a28a87e63f169ff9fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b377382724d7d877c6b989cfd7271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:51.020626 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bd04d786-db57-469c-8aa6-33ee98bf4ec6 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] 10.222.0.23 "GET /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13" status: 200 len: 1267 microversion: 2.1 time: 0.446258 Sep 10 12:03:51.021487 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2454/4896] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:50 2022] GET /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13 => generated 1267 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:51.026782 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b733d8c6-a08a-4712-b624-77c199d288a8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:51.027856 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b733d8c6-a08a-4712-b624-77c199d288a8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:51.040116 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b733d8c6-a08a-4712-b624-77c199d288a8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:51.040969 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b733d8c6-a08a-4712-b624-77c199d288a8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:51.041711 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b733d8c6-a08a-4712-b624-77c199d288a8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:51.043004 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b733d8c6-a08a-4712-b624-77c199d288a8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:51.043671 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b733d8c6-a08a-4712-b624-77c199d288a8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:51.044104 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b733d8c6-a08a-4712-b624-77c199d288a8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:51.256503 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a8f3a919-f0ce-45ff-be32-5fcaca54d51d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:51.271481 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a8f3a919-f0ce-45ff-be32-5fcaca54d51d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/a7c6046f-aad9-4a21-9130-fa30cfa8cc1b" status: 200 len: 1489 microversion: 2.1 time: 0.508548 Sep 10 12:03:51.275312 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2443/4897] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:50 2022] GET /compute/v2.1/servers/a7c6046f-aad9-4a21-9130-fa30cfa8cc1b => generated 1489 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:51.297347 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-95ebf0f2-a4fb-4787-895d-f71f923703a9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:51.297973 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-95ebf0f2-a4fb-4787-895d-f71f923703a9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 6b4ea83e-918c-426c-8355-6febdfbe2614] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:51.313880 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-95ebf0f2-a4fb-4787-895d-f71f923703a9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:51.314603 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-95ebf0f2-a4fb-4787-895d-f71f923703a9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:51.315211 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-95ebf0f2-a4fb-4787-895d-f71f923703a9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:51.315961 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-95ebf0f2-a4fb-4787-895d-f71f923703a9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:51.316569 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-95ebf0f2-a4fb-4787-895d-f71f923703a9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:51.317269 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-95ebf0f2-a4fb-4787-895d-f71f923703a9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:51.785291 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b733d8c6-a08a-4712-b624-77c199d288a8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:51.798078 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b733d8c6-a08a-4712-b624-77c199d288a8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1317 microversion: 2.1 time: 0.775194 Sep 10 12:03:51.799295 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2455/4898] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:51 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1317 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:51.816336 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b1a7d845-8cf9-423d-bba4-c2f5ee2cbda9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:51.819838 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b1a7d845-8cf9-423d-bba4-c2f5ee2cbda9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: b161d8f6-56f1-472a-99bd-f05c1431efac] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:51.835141 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1a7d845-8cf9-423d-bba4-c2f5ee2cbda9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:51.837433 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1a7d845-8cf9-423d-bba4-c2f5ee2cbda9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:51.838158 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1a7d845-8cf9-423d-bba4-c2f5ee2cbda9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:51.840137 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1a7d845-8cf9-423d-bba4-c2f5ee2cbda9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:51.840975 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1a7d845-8cf9-423d-bba4-c2f5ee2cbda9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:51.842639 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1a7d845-8cf9-423d-bba4-c2f5ee2cbda9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:52.046786 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-95ebf0f2-a4fb-4787-895d-f71f923703a9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:52.094186 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-95ebf0f2-a4fb-4787-895d-f71f923703a9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614" status: 200 len: 1489 microversion: 2.1 time: 0.801217 Sep 10 12:03:52.127863 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2444/4899] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:51 2022] GET /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614 => generated 1489 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:52.156853 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b5e584ba-8689-4af9-8f49-d85638edbc4f tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:52.158549 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b5e584ba-8689-4af9-8f49-d85638edbc4f tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] [instance: 6f3b842d-0cd0-4656-a69a-d409e3628f13] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:52.176407 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b5e584ba-8689-4af9-8f49-d85638edbc4f tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:52.177190 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b5e584ba-8689-4af9-8f49-d85638edbc4f tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:52.181401 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b5e584ba-8689-4af9-8f49-d85638edbc4f tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:52.182636 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b5e584ba-8689-4af9-8f49-d85638edbc4f tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:52.184531 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b5e584ba-8689-4af9-8f49-d85638edbc4f tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:52.195407 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b5e584ba-8689-4af9-8f49-d85638edbc4f tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:52.378343 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b1a7d845-8cf9-423d-bba4-c2f5ee2cbda9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:52.402141 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b1a7d845-8cf9-423d-bba4-c2f5ee2cbda9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac" status: 200 len: 1314 microversion: 2.1 time: 0.591437 Sep 10 12:03:52.415706 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2456/4900] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:51 2022] GET /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac => generated 1314 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:52.425403 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ac53bea1-f639-4d5f-af70-aa6d0a5547d9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:52.426045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ac53bea1-f639-4d5f-af70-aa6d0a5547d9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: a7c6046f-aad9-4a21-9130-fa30cfa8cc1b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:52.459597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac53bea1-f639-4d5f-af70-aa6d0a5547d9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:52.461875 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac53bea1-f639-4d5f-af70-aa6d0a5547d9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:52.462372 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac53bea1-f639-4d5f-af70-aa6d0a5547d9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:52.463141 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac53bea1-f639-4d5f-af70-aa6d0a5547d9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:52.463641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac53bea1-f639-4d5f-af70-aa6d0a5547d9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:52.472381 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac53bea1-f639-4d5f-af70-aa6d0a5547d9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:52.589315 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b5e584ba-8689-4af9-8f49-d85638edbc4f tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70a2fcdb2714a28a87e63f169ff9fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b377382724d7d877c6b989cfd7271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:52.601910 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b5e584ba-8689-4af9-8f49-d85638edbc4f tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] 10.222.0.23 "GET /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13" status: 200 len: 1273 microversion: 2.1 time: 0.471493 Sep 10 12:03:52.603205 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2445/4901] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:52 2022] GET /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13 => generated 1273 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:52.824787 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e906c7a5-451b-4940-90fc-8cc3b685ea92 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:52.825914 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e906c7a5-451b-4940-90fc-8cc3b685ea92 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:52.839554 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e906c7a5-451b-4940-90fc-8cc3b685ea92 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:52.840356 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e906c7a5-451b-4940-90fc-8cc3b685ea92 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:52.841009 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e906c7a5-451b-4940-90fc-8cc3b685ea92 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:52.842493 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e906c7a5-451b-4940-90fc-8cc3b685ea92 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:52.843353 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e906c7a5-451b-4940-90fc-8cc3b685ea92 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:52.843797 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e906c7a5-451b-4940-90fc-8cc3b685ea92 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:53.330247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ac53bea1-f639-4d5f-af70-aa6d0a5547d9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:53.341735 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ac53bea1-f639-4d5f-af70-aa6d0a5547d9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/a7c6046f-aad9-4a21-9130-fa30cfa8cc1b" status: 200 len: 1489 microversion: 2.1 time: 0.924248 Sep 10 12:03:53.342615 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2457/4902] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:52 2022] GET /compute/v2.1/servers/a7c6046f-aad9-4a21-9130-fa30cfa8cc1b => generated 1489 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:53.353370 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-fb0f178c-4516-4ba0-9076-5510e9113c03 req-60bc207d-793b-493a-97cc-189a2f0b41c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac1538e5-6edc-4ccb-b7a9-c2e90284e004", "name": "network-vif-plugged", "status": "completed", "tag": "264e21dc-6813-4623-838f-df7e536eeb78"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:03:53.381622 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-fb0f178c-4516-4ba0-9076-5510e9113c03 req-60bc207d-793b-493a-97cc-189a2f0b41c2 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:53.382406 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-fb0f178c-4516-4ba0-9076-5510e9113c03 req-60bc207d-793b-493a-97cc-189a2f0b41c2 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:53.383562 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-fb0f178c-4516-4ba0-9076-5510e9113c03 req-60bc207d-793b-493a-97cc-189a2f0b41c2 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:53.407360 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-fb0f178c-4516-4ba0-9076-5510e9113c03 req-60bc207d-793b-493a-97cc-189a2f0b41c2 service nova] Creating event network-vif-plugged:264e21dc-6813-4623-838f-df7e536eeb78 for instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 on n-h1-856895-1 Sep 10 12:03:53.412706 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-fb0f178c-4516-4ba0-9076-5510e9113c03 req-60bc207d-793b-493a-97cc-189a2f0b41c2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062926 Sep 10 12:03:53.414199 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2458/4903] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:03:53.421678 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3ec68bfd-bcc2-4576-8500-1597d01bbcf0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:53.422197 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3ec68bfd-bcc2-4576-8500-1597d01bbcf0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: a7c6046f-aad9-4a21-9130-fa30cfa8cc1b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:53.431417 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3ec68bfd-bcc2-4576-8500-1597d01bbcf0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:53.432144 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3ec68bfd-bcc2-4576-8500-1597d01bbcf0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:53.432610 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3ec68bfd-bcc2-4576-8500-1597d01bbcf0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:53.433395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3ec68bfd-bcc2-4576-8500-1597d01bbcf0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:53.433865 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3ec68bfd-bcc2-4576-8500-1597d01bbcf0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:53.434581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3ec68bfd-bcc2-4576-8500-1597d01bbcf0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:53.470863 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3ec68bfd-bcc2-4576-8500-1597d01bbcf0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: a7c6046f-aad9-4a21-9130-fa30cfa8cc1b] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:03:53.541065 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e906c7a5-451b-4940-90fc-8cc3b685ea92 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:53.563759 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e906c7a5-451b-4940-90fc-8cc3b685ea92 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1317 microversion: 2.1 time: 0.739821 Sep 10 12:03:53.568036 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2446/4904] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:52 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1317 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:53.588924 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0fec366e-2f04-4567-8735-b73e6ba60546 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:53.589576 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0fec366e-2f04-4567-8735-b73e6ba60546 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: b161d8f6-56f1-472a-99bd-f05c1431efac] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:53.613965 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0fec366e-2f04-4567-8735-b73e6ba60546 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:53.614474 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0fec366e-2f04-4567-8735-b73e6ba60546 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:53.614918 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0fec366e-2f04-4567-8735-b73e6ba60546 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:53.615677 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0fec366e-2f04-4567-8735-b73e6ba60546 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:53.616142 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0fec366e-2f04-4567-8735-b73e6ba60546 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:53.634799 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0fec366e-2f04-4567-8735-b73e6ba60546 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:53.704192 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3ec68bfd-bcc2-4576-8500-1597d01bbcf0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a7c6046f-aad9-4a21-9130-fa30cfa8cc1b" status: 204 len: 0 microversion: 2.1 time: 0.288060 Sep 10 12:03:53.704803 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2459/4905] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:03:53 2022] DELETE /compute/v2.1/servers/a7c6046f-aad9-4a21-9130-fa30cfa8cc1b => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:03:53.711444 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6d59af2d-6dc6-4c86-afcd-fd0f48c692c3 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:53.724307 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6d59af2d-6dc6-4c86-afcd-fd0f48c692c3 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] [instance: 6f3b842d-0cd0-4656-a69a-d409e3628f13] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:53.731739 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d59af2d-6dc6-4c86-afcd-fd0f48c692c3 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:53.732607 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d59af2d-6dc6-4c86-afcd-fd0f48c692c3 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:53.733487 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d59af2d-6dc6-4c86-afcd-fd0f48c692c3 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:53.734714 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d59af2d-6dc6-4c86-afcd-fd0f48c692c3 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:53.735430 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d59af2d-6dc6-4c86-afcd-fd0f48c692c3 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:53.736087 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d59af2d-6dc6-4c86-afcd-fd0f48c692c3 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:53.973868 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6d59af2d-6dc6-4c86-afcd-fd0f48c692c3 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70a2fcdb2714a28a87e63f169ff9fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b377382724d7d877c6b989cfd7271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:53.984241 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6d59af2d-6dc6-4c86-afcd-fd0f48c692c3 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] 10.222.0.23 "GET /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13" status: 200 len: 1273 microversion: 2.1 time: 0.277918 Sep 10 12:03:54.006247 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2460/4906] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:53 2022] GET /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13 => generated 1273 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:54.018697 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f35b4dbf-fe31-4f8e-9c57-4001ddaca6bc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:54.024841 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f35b4dbf-fe31-4f8e-9c57-4001ddaca6bc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: a7c6046f-aad9-4a21-9130-fa30cfa8cc1b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:54.043433 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f35b4dbf-fe31-4f8e-9c57-4001ddaca6bc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:54.043946 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f35b4dbf-fe31-4f8e-9c57-4001ddaca6bc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:54.044456 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f35b4dbf-fe31-4f8e-9c57-4001ddaca6bc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:54.045690 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f35b4dbf-fe31-4f8e-9c57-4001ddaca6bc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:54.046280 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f35b4dbf-fe31-4f8e-9c57-4001ddaca6bc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:54.046720 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f35b4dbf-fe31-4f8e-9c57-4001ddaca6bc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:54.457090 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0fec366e-2f04-4567-8735-b73e6ba60546 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:54.478159 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0fec366e-2f04-4567-8735-b73e6ba60546 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac" status: 200 len: 1314 microversion: 2.1 time: 0.907697 Sep 10 12:03:54.482112 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2447/4907] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:53 2022] GET /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac => generated 1314 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:54.590236 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0e8921ce-d8ce-4d27-a612-2cac1cb3f1c5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:54.592344 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0e8921ce-d8ce-4d27-a612-2cac1cb3f1c5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:54.601002 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e8921ce-d8ce-4d27-a612-2cac1cb3f1c5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:54.605531 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e8921ce-d8ce-4d27-a612-2cac1cb3f1c5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:54.606002 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e8921ce-d8ce-4d27-a612-2cac1cb3f1c5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:54.606757 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e8921ce-d8ce-4d27-a612-2cac1cb3f1c5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:54.607354 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e8921ce-d8ce-4d27-a612-2cac1cb3f1c5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:54.607797 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e8921ce-d8ce-4d27-a612-2cac1cb3f1c5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:54.790310 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f35b4dbf-fe31-4f8e-9c57-4001ddaca6bc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:54.806293 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f35b4dbf-fe31-4f8e-9c57-4001ddaca6bc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/a7c6046f-aad9-4a21-9130-fa30cfa8cc1b" status: 200 len: 1495 microversion: 2.1 time: 0.793057 Sep 10 12:03:54.806996 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2461/4908] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:54 2022] GET /compute/v2.1/servers/a7c6046f-aad9-4a21-9130-fa30cfa8cc1b => generated 1495 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:55.011229 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-57e15925-4224-483e-a62f-3eb7a0454b78 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:55.012175 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-57e15925-4224-483e-a62f-3eb7a0454b78 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] [instance: 6f3b842d-0cd0-4656-a69a-d409e3628f13] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:55.031667 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57e15925-4224-483e-a62f-3eb7a0454b78 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:55.032618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57e15925-4224-483e-a62f-3eb7a0454b78 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:55.033282 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57e15925-4224-483e-a62f-3eb7a0454b78 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:55.034549 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57e15925-4224-483e-a62f-3eb7a0454b78 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:55.035248 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57e15925-4224-483e-a62f-3eb7a0454b78 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:55.036079 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57e15925-4224-483e-a62f-3eb7a0454b78 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:55.588265 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0e8921ce-d8ce-4d27-a612-2cac1cb3f1c5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:55.611685 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0e8921ce-d8ce-4d27-a612-2cac1cb3f1c5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1317 microversion: 2.1 time: 1.024535 Sep 10 12:03:55.615524 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2448/4909] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:54 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1317 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:03:55.675113 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-c5c8f257-7e4f-4e44-8b4b-4b1c292e6b87 req-adba0284-24a4-474e-87cb-1bf79f56dc52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b161d8f6-56f1-472a-99bd-f05c1431efac", "name": "network-vif-plugged", "status": "completed", "tag": "1d2dfabb-74ce-4a1a-a0e4-d97023906eb9"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:03:55.705215 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-57e15925-4224-483e-a62f-3eb7a0454b78 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70a2fcdb2714a28a87e63f169ff9fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b377382724d7d877c6b989cfd7271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:55.733759 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:03:55.734239 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-57e15925-4224-483e-a62f-3eb7a0454b78 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] 10.222.0.23 "GET /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13" status: 200 len: 1315 microversion: 2.1 time: 0.723198 Sep 10 12:03:55.747549 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2462/4910] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:55 2022] GET /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13 => generated 1315 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:03:55.758902 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-c5c8f257-7e4f-4e44-8b4b-4b1c292e6b87 req-adba0284-24a4-474e-87cb-1bf79f56dc52 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:55.759565 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-c5c8f257-7e4f-4e44-8b4b-4b1c292e6b87 req-adba0284-24a4-474e-87cb-1bf79f56dc52 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:55.759692 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c7f4ef45-b8d3-48e3-bc6b-de510001fa3c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:55.760129 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-c5c8f257-7e4f-4e44-8b4b-4b1c292e6b87 req-adba0284-24a4-474e-87cb-1bf79f56dc52 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:55.761978 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c7f4ef45-b8d3-48e3-bc6b-de510001fa3c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: b161d8f6-56f1-472a-99bd-f05c1431efac] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:55.776680 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7f4ef45-b8d3-48e3-bc6b-de510001fa3c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:55.777183 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7f4ef45-b8d3-48e3-bc6b-de510001fa3c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:55.777690 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7f4ef45-b8d3-48e3-bc6b-de510001fa3c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:55.778410 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7f4ef45-b8d3-48e3-bc6b-de510001fa3c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:55.780345 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7f4ef45-b8d3-48e3-bc6b-de510001fa3c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:55.782200 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7f4ef45-b8d3-48e3-bc6b-de510001fa3c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:55.783625 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-c5c8f257-7e4f-4e44-8b4b-4b1c292e6b87 req-adba0284-24a4-474e-87cb-1bf79f56dc52 service nova] Creating event network-vif-plugged:1d2dfabb-74ce-4a1a-a0e4-d97023906eb9 for instance b161d8f6-56f1-472a-99bd-f05c1431efac on n-h2-856895-1 Sep 10 12:03:55.801728 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-c5c8f257-7e4f-4e44-8b4b-4b1c292e6b87 req-adba0284-24a4-474e-87cb-1bf79f56dc52 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182608 Sep 10 12:03:55.802843 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2449/4911] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:03:55.834797 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bb0e2ad1-099f-4c6b-aa59-8f4b0fc49bb4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:55.835637 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bb0e2ad1-099f-4c6b-aa59-8f4b0fc49bb4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: a7c6046f-aad9-4a21-9130-fa30cfa8cc1b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:55.845758 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bb0e2ad1-099f-4c6b-aa59-8f4b0fc49bb4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:55.851948 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bb0e2ad1-099f-4c6b-aa59-8f4b0fc49bb4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:55.852825 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bb0e2ad1-099f-4c6b-aa59-8f4b0fc49bb4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:55.853828 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bb0e2ad1-099f-4c6b-aa59-8f4b0fc49bb4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:55.854514 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bb0e2ad1-099f-4c6b-aa59-8f4b0fc49bb4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:55.855473 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bb0e2ad1-099f-4c6b-aa59-8f4b0fc49bb4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:55.861214 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:03:56.334778 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c7f4ef45-b8d3-48e3-bc6b-de510001fa3c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:56.340352 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bb0e2ad1-099f-4c6b-aa59-8f4b0fc49bb4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:56.352056 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c7f4ef45-b8d3-48e3-bc6b-de510001fa3c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac" status: 200 len: 1314 microversion: 2.1 time: 0.603704 Sep 10 12:03:56.367188 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bb0e2ad1-099f-4c6b-aa59-8f4b0fc49bb4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/a7c6046f-aad9-4a21-9130-fa30cfa8cc1b" status: 200 len: 1495 microversion: 2.1 time: 0.519258 Sep 10 12:03:56.367594 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2463/4912] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:55 2022] GET /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac => generated 1314 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:56.369768 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2450/4913] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:55 2022] GET /compute/v2.1/servers/a7c6046f-aad9-4a21-9130-fa30cfa8cc1b => generated 1495 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:03:56.638779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a0fa0d75-0965-43c6-9163-fced9e835555 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:56.639480 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a0fa0d75-0965-43c6-9163-fced9e835555 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:56.668213 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a0fa0d75-0965-43c6-9163-fced9e835555 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:56.677475 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a0fa0d75-0965-43c6-9163-fced9e835555 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:56.680236 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a0fa0d75-0965-43c6-9163-fced9e835555 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:56.681348 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a0fa0d75-0965-43c6-9163-fced9e835555 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:56.682165 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a0fa0d75-0965-43c6-9163-fced9e835555 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:56.682794 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a0fa0d75-0965-43c6-9163-fced9e835555 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:56.824807 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-8f1543a5-712f-4fc4-88a8-5222ca31c3ff req-fc572e11-3d63-45dd-a30d-99b3071e9911 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7c6046f-aad9-4a21-9130-fa30cfa8cc1b", "name": "network-vif-deleted", "tag": "634698db-6ea8-4269-8af2-c2f3a6ec9f94"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:03:56.850803 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-8f1543a5-712f-4fc4-88a8-5222ca31c3ff req-fc572e11-3d63-45dd-a30d-99b3071e9911 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:56.851337 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-8f1543a5-712f-4fc4-88a8-5222ca31c3ff req-fc572e11-3d63-45dd-a30d-99b3071e9911 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:56.851820 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-8f1543a5-712f-4fc4-88a8-5222ca31c3ff req-fc572e11-3d63-45dd-a30d-99b3071e9911 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:56.882793 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-8f1543a5-712f-4fc4-88a8-5222ca31c3ff req-fc572e11-3d63-45dd-a30d-99b3071e9911 service nova] Creating event network-vif-deleted:634698db-6ea8-4269-8af2-c2f3a6ec9f94 for instance a7c6046f-aad9-4a21-9130-fa30cfa8cc1b on n-h2-856895-1 Sep 10 12:03:56.911033 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-8f1543a5-712f-4fc4-88a8-5222ca31c3ff req-fc572e11-3d63-45dd-a30d-99b3071e9911 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.238780 Sep 10 12:03:56.912608 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2451/4914] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:03:56.924325 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1589d875-7681-4c44-8a67-070bdbcde39a tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:56.925739 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1589d875-7681-4c44-8a67-070bdbcde39a tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] [instance: 6f3b842d-0cd0-4656-a69a-d409e3628f13] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:56.948061 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1589d875-7681-4c44-8a67-070bdbcde39a tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:56.948793 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1589d875-7681-4c44-8a67-070bdbcde39a tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:56.949421 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1589d875-7681-4c44-8a67-070bdbcde39a tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:56.950472 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1589d875-7681-4c44-8a67-070bdbcde39a tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:56.951319 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1589d875-7681-4c44-8a67-070bdbcde39a tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:56.951929 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1589d875-7681-4c44-8a67-070bdbcde39a tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:57.367516 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a0fa0d75-0965-43c6-9163-fced9e835555 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:57.385564 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a0fa0d75-0965-43c6-9163-fced9e835555 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.751522 Sep 10 12:03:57.386771 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2464/4915] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:56 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:57.400942 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-328b24a3-d639-4d51-b144-7c243256df38 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:57.402445 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-328b24a3-d639-4d51-b144-7c243256df38 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: b161d8f6-56f1-472a-99bd-f05c1431efac] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:57.410352 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-328b24a3-d639-4d51-b144-7c243256df38 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:57.411756 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-328b24a3-d639-4d51-b144-7c243256df38 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:57.412527 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-328b24a3-d639-4d51-b144-7c243256df38 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:57.413481 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-328b24a3-d639-4d51-b144-7c243256df38 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:57.414149 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-328b24a3-d639-4d51-b144-7c243256df38 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:57.415267 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-328b24a3-d639-4d51-b144-7c243256df38 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:57.540099 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1589d875-7681-4c44-8a67-070bdbcde39a tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70a2fcdb2714a28a87e63f169ff9fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b377382724d7d877c6b989cfd7271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:57.569354 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1589d875-7681-4c44-8a67-070bdbcde39a tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] 10.222.0.23 "GET /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13" status: 200 len: 1315 microversion: 2.1 time: 0.653278 Sep 10 12:03:57.571444 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2452/4916] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:56 2022] GET /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13 => generated 1315 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:57.583473 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fb3100f3-cf72-4e2c-ac7c-3290c68a4350 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:57.584323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fb3100f3-cf72-4e2c-ac7c-3290c68a4350 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: a7c6046f-aad9-4a21-9130-fa30cfa8cc1b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:57.594365 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fb3100f3-cf72-4e2c-ac7c-3290c68a4350 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:57.595356 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fb3100f3-cf72-4e2c-ac7c-3290c68a4350 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:57.596055 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fb3100f3-cf72-4e2c-ac7c-3290c68a4350 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:57.598600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fb3100f3-cf72-4e2c-ac7c-3290c68a4350 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:57.599785 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fb3100f3-cf72-4e2c-ac7c-3290c68a4350 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:57.600758 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fb3100f3-cf72-4e2c-ac7c-3290c68a4350 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:57.677371 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fb3100f3-cf72-4e2c-ac7c-3290c68a4350 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:57.678839 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fb3100f3-cf72-4e2c-ac7c-3290c68a4350 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:57.680228 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fb3100f3-cf72-4e2c-ac7c-3290c68a4350 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:57.681264 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-fb3100f3-cf72-4e2c-ac7c-3290c68a4350 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lazy-loading 'fault' on Instance uuid a7c6046f-aad9-4a21-9130-fa30cfa8cc1b {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:03:57.836118 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fb3100f3-cf72-4e2c-ac7c-3290c68a4350 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:57.849248 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-328b24a3-d639-4d51-b144-7c243256df38 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:57.865080 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-328b24a3-d639-4d51-b144-7c243256df38 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac" status: 200 len: 1501 microversion: 2.1 time: 0.475334 Sep 10 12:03:57.866578 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2465/4917] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:57 2022] GET /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac => generated 1501 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:57.881316 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fb3100f3-cf72-4e2c-ac7c-3290c68a4350 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/a7c6046f-aad9-4a21-9130-fa30cfa8cc1b" status: 200 len: 1298 microversion: 2.1 time: 0.287869 Sep 10 12:03:57.886497 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5188beb2-2a06-4794-a912-f7ca33232345 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2145800916", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "4cf2efdb-facd-4d46-b962-78192cf2010f"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:03:57.887445 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2453/4918] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:57 2022] GET /compute/v2.1/servers/a7c6046f-aad9-4a21-9130-fa30cfa8cc1b => generated 1298 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:57.907987 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-fd176c1a-8db0-4bee-afba-e31832259c5f req-a878bdad-0d88-4e4e-b203-bcb2ce46270d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f3b842d-0cd0-4656-a69a-d409e3628f13", "tag": "d7eb6a17-8635-4fdb-888c-369f06fa03db"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:03:57.931109 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-fd176c1a-8db0-4bee-afba-e31832259c5f req-a878bdad-0d88-4e4e-b203-bcb2ce46270d service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:57.931933 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-fd176c1a-8db0-4bee-afba-e31832259c5f req-a878bdad-0d88-4e4e-b203-bcb2ce46270d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:57.932563 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-fd176c1a-8db0-4bee-afba-e31832259c5f req-a878bdad-0d88-4e4e-b203-bcb2ce46270d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:57.959757 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-fd176c1a-8db0-4bee-afba-e31832259c5f req-a878bdad-0d88-4e4e-b203-bcb2ce46270d service nova] Creating event network-changed:d7eb6a17-8635-4fdb-888c-369f06fa03db for instance 6f3b842d-0cd0-4656-a69a-d409e3628f13 on n-h2-856895-1 Sep 10 12:03:57.977000 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-fd176c1a-8db0-4bee-afba-e31832259c5f req-a878bdad-0d88-4e4e-b203-bcb2ce46270d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086837 Sep 10 12:03:57.977882 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2454/4919] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:03:57.983503 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f98f73e3-a3db-42aa-896b-35a44f7f70f5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:03:57.985868 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f98f73e3-a3db-42aa-896b-35a44f7f70f5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: b161d8f6-56f1-472a-99bd-f05c1431efac] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:57.994295 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-5188beb2-2a06-4794-a912-f7ca33232345 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] validate_networks() for [('4cf2efdb-facd-4d46-b962-78192cf2010f', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:03:58.000597 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f98f73e3-a3db-42aa-896b-35a44f7f70f5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:58.001105 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f98f73e3-a3db-42aa-896b-35a44f7f70f5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:58.001552 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f98f73e3-a3db-42aa-896b-35a44f7f70f5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:58.005433 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f98f73e3-a3db-42aa-896b-35a44f7f70f5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:58.005925 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f98f73e3-a3db-42aa-896b-35a44f7f70f5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:58.006378 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f98f73e3-a3db-42aa-896b-35a44f7f70f5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:58.065633 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f98f73e3-a3db-42aa-896b-35a44f7f70f5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "POST /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac/action" status: 200 len: 14 microversion: 2.1 time: 0.086221 Sep 10 12:03:58.067122 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2455/4920] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:03:57 2022] POST /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 12:03:58.597623 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e70c2c00-b179-4906-876a-1e5d8ac3984f tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:58.598337 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e70c2c00-b179-4906-876a-1e5d8ac3984f tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] [instance: 6f3b842d-0cd0-4656-a69a-d409e3628f13] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:58.608073 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:03:58.610209 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:03:58.612864 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e70c2c00-b179-4906-876a-1e5d8ac3984f tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:58.613613 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e70c2c00-b179-4906-876a-1e5d8ac3984f tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:58.614278 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e70c2c00-b179-4906-876a-1e5d8ac3984f tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:58.615240 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e70c2c00-b179-4906-876a-1e5d8ac3984f tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:58.616035 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e70c2c00-b179-4906-876a-1e5d8ac3984f tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:58.616652 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e70c2c00-b179-4906-876a-1e5d8ac3984f tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:58.906043 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e70c2c00-b179-4906-876a-1e5d8ac3984f tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70a2fcdb2714a28a87e63f169ff9fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b377382724d7d877c6b989cfd7271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:58.941585 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-5188beb2-2a06-4794-a912-f7ca33232345 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:03:58.942986 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-5188beb2-2a06-4794-a912-f7ca33232345 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:03:58.943703 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-5188beb2-2a06-4794-a912-f7ca33232345 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:03:58.944460 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-5188beb2-2a06-4794-a912-f7ca33232345 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:03:58.945390 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-5188beb2-2a06-4794-a912-f7ca33232345 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:03:58.949949 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:03:58.951765 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e70c2c00-b179-4906-876a-1e5d8ac3984f tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] 10.222.0.23 "GET /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13" status: 200 len: 1315 microversion: 2.1 time: 0.337642 Sep 10 12:03:58.954838 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2456/4921] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:58 2022] GET /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13 => generated 1315 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:58.972206 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-483fb5ac-32a7-4aa6-ac6f-925df7157e5e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:58.974672 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-483fb5ac-32a7-4aa6-ac6f-925df7157e5e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: a7c6046f-aad9-4a21-9130-fa30cfa8cc1b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:58.986236 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5188beb2-2a06-4794-a912-f7ca33232345 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:58.987289 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-483fb5ac-32a7-4aa6-ac6f-925df7157e5e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:58.987874 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5188beb2-2a06-4794-a912-f7ca33232345 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:58.988078 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-483fb5ac-32a7-4aa6-ac6f-925df7157e5e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:58.988876 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5188beb2-2a06-4794-a912-f7ca33232345 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:58.989906 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-483fb5ac-32a7-4aa6-ac6f-925df7157e5e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:58.990269 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5188beb2-2a06-4794-a912-f7ca33232345 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:58.991190 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5188beb2-2a06-4794-a912-f7ca33232345 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:58.991898 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-483fb5ac-32a7-4aa6-ac6f-925df7157e5e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:58.992102 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5188beb2-2a06-4794-a912-f7ca33232345 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:58.992751 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-483fb5ac-32a7-4aa6-ac6f-925df7157e5e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:58.993304 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-483fb5ac-32a7-4aa6-ac6f-925df7157e5e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:59.012507 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-483fb5ac-32a7-4aa6-ac6f-925df7157e5e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] HTTP exception thrown: Instance a7c6046f-aad9-4a21-9130-fa30cfa8cc1b could not be found. Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-483fb5ac-32a7-4aa6-ac6f-925df7157e5e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Request method failure captured: Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/a7c6046f-aad9-4a21-9130-fa30cfa8cc1b HTTP/1.1 Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHykcWQYupGxhcLpb6v5AsrUV8qZ6sg9Ki1Jfb5jCMoRjGicsw0WManJo8IjBppMD5CxQdT4hQu3IHHi54G_V7lvb8EgCj19qVHNlr3p45qCyo-pmA_bA7FrmqWJZSaCbHLCvlYvItyJikej-C_PUFDVoe9D_fp0roxy7XQj-_YcxQA Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersTestJSON-793172710 Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ac8b3e9f72234d9985fbc5fa7e7984ad", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersTestJSON-793172710 Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersTestJSON-793172710 Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersTestJSON-793172710-project Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: ef32131362a3442498234c0554f08305 Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersTestJSON-793172710-project Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance a7c6046f-aad9-4a21-9130-fa30cfa8cc1b could not be found. Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'a7c6046f-aad9-4a21-9130-fa30cfa8cc1b'} Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7c6046f-aad9-4a21-9130-fa30cfa8cc1b could not be found. Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7c6046f-aad9-4a21-9130-fa30cfa8cc1b could not be found. Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:03:59.016323 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:03:59.024122 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:03:59.024122 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:03:59.024122 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:03:59.024122 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:03:59.024122 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7c6046f-aad9-4a21-9130-fa30cfa8cc1b could not be found. Sep 10 12:03:59.024122 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:03:59.024122 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-483fb5ac-32a7-4aa6-ac6f-925df7157e5e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Returning 404 to user: Instance a7c6046f-aad9-4a21-9130-fa30cfa8cc1b could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:03:59.024122 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-483fb5ac-32a7-4aa6-ac6f-925df7157e5e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/a7c6046f-aad9-4a21-9130-fa30cfa8cc1b" status: 404 len: 111 microversion: 2.1 time: 0.066086 Sep 10 12:03:59.025477 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2457/4922] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:58 2022] GET /compute/v2.1/servers/a7c6046f-aad9-4a21-9130-fa30cfa8cc1b => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:03:59.048287 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7f2d3b38-855c-43b1-98ba-83dffff00fda tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:59.049020 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7f2d3b38-855c-43b1-98ba-83dffff00fda tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 6b4ea83e-918c-426c-8355-6febdfbe2614] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:59.055351 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-5188beb2-2a06-4794-a912-f7ca33232345 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Getting quotas for project 89d3785c3b25495b9c588d21a8d75684. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:03:59.060951 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f2d3b38-855c-43b1-98ba-83dffff00fda tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:59.061813 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f2d3b38-855c-43b1-98ba-83dffff00fda tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:59.064632 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f2d3b38-855c-43b1-98ba-83dffff00fda tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:59.065978 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f2d3b38-855c-43b1-98ba-83dffff00fda tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:59.074423 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f2d3b38-855c-43b1-98ba-83dffff00fda tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:59.075947 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f2d3b38-855c-43b1-98ba-83dffff00fda tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:59.084765 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-5188beb2-2a06-4794-a912-f7ca33232345 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Getting quotas for user 862345bb47a242c288375194a92834f9 and project 89d3785c3b25495b9c588d21a8d75684. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:03:59.162860 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7f2d3b38-855c-43b1-98ba-83dffff00fda tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 6b4ea83e-918c-426c-8355-6febdfbe2614] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:03:59.166548 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5188beb2-2a06-4794-a912-f7ca33232345 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:03:59.175262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5188beb2-2a06-4794-a912-f7ca33232345 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: d4d4927f-4127-4a75-8c38-f462dda83d23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:03:59.325207 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5188beb2-2a06-4794-a912-f7ca33232345 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.454096 Sep 10 12:03:59.328873 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2466/4923] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:03:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1461 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:03:59.340315 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-746d13e4-603d-4eb1-b5a1-3bf309d680dc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:03:59.341008 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7f2d3b38-855c-43b1-98ba-83dffff00fda tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614" status: 204 len: 0 microversion: 2.1 time: 0.305420 Sep 10 12:03:59.344552 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2458/4924] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:03:59 2022] DELETE /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:03:59.348042 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-746d13e4-603d-4eb1-b5a1-3bf309d680dc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: b161d8f6-56f1-472a-99bd-f05c1431efac] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:59.373054 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-746d13e4-603d-4eb1-b5a1-3bf309d680dc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:59.374139 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-746d13e4-603d-4eb1-b5a1-3bf309d680dc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:59.374795 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-746d13e4-603d-4eb1-b5a1-3bf309d680dc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:59.375883 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-746d13e4-603d-4eb1-b5a1-3bf309d680dc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:59.376505 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-746d13e4-603d-4eb1-b5a1-3bf309d680dc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:59.377124 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-746d13e4-603d-4eb1-b5a1-3bf309d680dc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:59.395272 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f51789b6-9bfc-4b3d-ab88-134d482f7aab tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:59.398178 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f51789b6-9bfc-4b3d-ab88-134d482f7aab tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: d4d4927f-4127-4a75-8c38-f462dda83d23] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:59.582672 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-746d13e4-603d-4eb1-b5a1-3bf309d680dc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "POST /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac/action" status: 200 len: 14 microversion: 2.1 time: 0.248999 Sep 10 12:03:59.583350 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2467/4925] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:03:59 2022] POST /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac/action => generated 14 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 12:03:59.589325 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5d547b79-a9b1-4770-888c-8401fc91fdb2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:59.590545 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5d547b79-a9b1-4770-888c-8401fc91fdb2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 6b4ea83e-918c-426c-8355-6febdfbe2614] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:03:59.606567 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d547b79-a9b1-4770-888c-8401fc91fdb2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:59.615353 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d547b79-a9b1-4770-888c-8401fc91fdb2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:59.617511 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d547b79-a9b1-4770-888c-8401fc91fdb2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:59.619765 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d547b79-a9b1-4770-888c-8401fc91fdb2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:03:59.621474 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d547b79-a9b1-4770-888c-8401fc91fdb2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:03:59.625509 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f51789b6-9bfc-4b3d-ab88-134d482f7aab tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:03:59.626317 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d547b79-a9b1-4770-888c-8401fc91fdb2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:03:59.639378 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f51789b6-9bfc-4b3d-ab88-134d482f7aab tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23" status: 200 len: 1217 microversion: 2.1 time: 0.292873 Sep 10 12:03:59.640522 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2459/4926] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:59 2022] GET /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23 => generated 1217 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:03:59.991228 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a5ab6134-f8c6-4e23-aebe-767979bd9e7e tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:03:59.996359 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a5ab6134-f8c6-4e23-aebe-767979bd9e7e tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] [instance: 6f3b842d-0cd0-4656-a69a-d409e3628f13] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:00.030271 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a5ab6134-f8c6-4e23-aebe-767979bd9e7e tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:00.031155 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a5ab6134-f8c6-4e23-aebe-767979bd9e7e tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:00.031864 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a5ab6134-f8c6-4e23-aebe-767979bd9e7e tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:00.032774 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a5ab6134-f8c6-4e23-aebe-767979bd9e7e tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:00.033394 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a5ab6134-f8c6-4e23-aebe-767979bd9e7e tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:00.033970 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a5ab6134-f8c6-4e23-aebe-767979bd9e7e tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:00.266950 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5d547b79-a9b1-4770-888c-8401fc91fdb2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:00.278671 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5d547b79-a9b1-4770-888c-8401fc91fdb2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614" status: 200 len: 1495 microversion: 2.1 time: 0.693249 Sep 10 12:04:00.279695 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2468/4927] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:59 2022] GET /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614 => generated 1495 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:00.594961 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5ba30e0c-e180-4dc2-926a-5f83094bdb93 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:00.597357 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5ba30e0c-e180-4dc2-926a-5f83094bdb93 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: b161d8f6-56f1-472a-99bd-f05c1431efac] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:00.603914 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a5ab6134-f8c6-4e23-aebe-767979bd9e7e tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70a2fcdb2714a28a87e63f169ff9fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b377382724d7d877c6b989cfd7271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:00.621660 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a5ab6134-f8c6-4e23-aebe-767979bd9e7e tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] 10.222.0.23 "GET /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13" status: 200 len: 1315 microversion: 2.1 time: 0.646732 Sep 10 12:04:00.624545 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2460/4928] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:03:59 2022] GET /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13 => generated 1315 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:04:00.633214 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ba30e0c-e180-4dc2-926a-5f83094bdb93 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:00.633961 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ba30e0c-e180-4dc2-926a-5f83094bdb93 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:00.634595 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ba30e0c-e180-4dc2-926a-5f83094bdb93 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:00.635519 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ba30e0c-e180-4dc2-926a-5f83094bdb93 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:00.636138 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ba30e0c-e180-4dc2-926a-5f83094bdb93 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:00.636729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ba30e0c-e180-4dc2-926a-5f83094bdb93 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:00.662808 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-900b4ec3-90bb-4985-9283-5d005d26342b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:00.663764 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-900b4ec3-90bb-4985-9283-5d005d26342b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: d4d4927f-4127-4a75-8c38-f462dda83d23] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:00.675196 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-900b4ec3-90bb-4985-9283-5d005d26342b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:00.681540 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-900b4ec3-90bb-4985-9283-5d005d26342b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:00.692239 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-900b4ec3-90bb-4985-9283-5d005d26342b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:00.693305 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-900b4ec3-90bb-4985-9283-5d005d26342b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:00.694081 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-900b4ec3-90bb-4985-9283-5d005d26342b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:00.694686 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-900b4ec3-90bb-4985-9283-5d005d26342b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:00.740177 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5ba30e0c-e180-4dc2-926a-5f83094bdb93 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "POST /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac/action" status: 200 len: 14 microversion: 2.1 time: 0.149476 Sep 10 12:04:00.747736 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2469/4929] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:04:00 2022] POST /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 10 12:04:00.863528 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-900b4ec3-90bb-4985-9283-5d005d26342b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:00.874991 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-900b4ec3-90bb-4985-9283-5d005d26342b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23" status: 200 len: 1213 microversion: 2.1 time: 0.216729 Sep 10 12:04:00.878393 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2461/4930] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:00 2022] GET /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23 => generated 1213 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:01.305953 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1c036d22-f899-40e7-94a1-9fbd9df110fc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:01.307564 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1c036d22-f899-40e7-94a1-9fbd9df110fc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 6b4ea83e-918c-426c-8355-6febdfbe2614] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:01.324923 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c036d22-f899-40e7-94a1-9fbd9df110fc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:01.326550 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c036d22-f899-40e7-94a1-9fbd9df110fc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:01.327404 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c036d22-f899-40e7-94a1-9fbd9df110fc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:01.330849 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c036d22-f899-40e7-94a1-9fbd9df110fc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:01.331666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c036d22-f899-40e7-94a1-9fbd9df110fc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:01.334157 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c036d22-f899-40e7-94a1-9fbd9df110fc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:01.378835 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:04:01.650218 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4ec54d58-de40-4274-b780-7ed5429cced3 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:01.651485 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4ec54d58-de40-4274-b780-7ed5429cced3 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] [instance: 6f3b842d-0cd0-4656-a69a-d409e3628f13] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:01.675036 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ec54d58-de40-4274-b780-7ed5429cced3 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:01.676142 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ec54d58-de40-4274-b780-7ed5429cced3 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:01.679845 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ec54d58-de40-4274-b780-7ed5429cced3 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:01.680848 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ec54d58-de40-4274-b780-7ed5429cced3 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:01.681515 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ec54d58-de40-4274-b780-7ed5429cced3 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:01.682133 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ec54d58-de40-4274-b780-7ed5429cced3 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:02.197650 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1c036d22-f899-40e7-94a1-9fbd9df110fc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:02.208127 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1c036d22-f899-40e7-94a1-9fbd9df110fc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614" status: 200 len: 1495 microversion: 2.1 time: 0.906703 Sep 10 12:04:02.220447 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2470/4931] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:01 2022] GET /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614 => generated 1495 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:02.226586 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bcecf132-264c-47e5-8e82-8aa231814108 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:02.229090 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bcecf132-264c-47e5-8e82-8aa231814108 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: b161d8f6-56f1-472a-99bd-f05c1431efac] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:02.241377 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bcecf132-264c-47e5-8e82-8aa231814108 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:02.252081 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bcecf132-264c-47e5-8e82-8aa231814108 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:02.252813 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bcecf132-264c-47e5-8e82-8aa231814108 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:02.253759 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bcecf132-264c-47e5-8e82-8aa231814108 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:02.254388 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bcecf132-264c-47e5-8e82-8aa231814108 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:02.254999 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bcecf132-264c-47e5-8e82-8aa231814108 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:02.262494 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4ec54d58-de40-4274-b780-7ed5429cced3 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70a2fcdb2714a28a87e63f169ff9fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b377382724d7d877c6b989cfd7271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:02.284473 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4ec54d58-de40-4274-b780-7ed5429cced3 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] 10.222.0.23 "GET /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13" status: 200 len: 1315 microversion: 2.1 time: 0.638504 Sep 10 12:04:02.285691 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2462/4932] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:01 2022] GET /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13 => generated 1315 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:02.293690 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9d8e560e-30b9-4eed-8456-e73e429b03bf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:02.300463 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9d8e560e-30b9-4eed-8456-e73e429b03bf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: d4d4927f-4127-4a75-8c38-f462dda83d23] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:02.320893 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d8e560e-30b9-4eed-8456-e73e429b03bf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:02.321831 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d8e560e-30b9-4eed-8456-e73e429b03bf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:02.322506 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d8e560e-30b9-4eed-8456-e73e429b03bf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:02.323434 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d8e560e-30b9-4eed-8456-e73e429b03bf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:02.324140 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d8e560e-30b9-4eed-8456-e73e429b03bf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:02.332649 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d8e560e-30b9-4eed-8456-e73e429b03bf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:02.357002 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bcecf132-264c-47e5-8e82-8aa231814108 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "POST /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac/action" status: 200 len: 14 microversion: 2.1 time: 0.134680 Sep 10 12:04:02.364038 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2471/4933] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:04:02 2022] POST /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 12:04:02.475697 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9d8e560e-30b9-4eed-8456-e73e429b03bf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:02.490046 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9d8e560e-30b9-4eed-8456-e73e429b03bf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23" status: 200 len: 1275 microversion: 2.1 time: 0.199655 Sep 10 12:04:02.491122 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2463/4934] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:02 2022] GET /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23 => generated 1275 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:02.772760 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-9dfdf71c-aeba-4263-8fc7-ffe71459829e req-b7496b64-24ac-4479-83e8-fe1dbb530460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b4ea83e-918c-426c-8355-6febdfbe2614", "name": "network-vif-deleted", "tag": "43c64c32-bbee-4029-a116-ea24bb510ae6"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:02.824930 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-9dfdf71c-aeba-4263-8fc7-ffe71459829e req-b7496b64-24ac-4479-83e8-fe1dbb530460 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:02.833061 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-9dfdf71c-aeba-4263-8fc7-ffe71459829e req-b7496b64-24ac-4479-83e8-fe1dbb530460 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:02.851604 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-9dfdf71c-aeba-4263-8fc7-ffe71459829e req-b7496b64-24ac-4479-83e8-fe1dbb530460 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:02.890403 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-9dfdf71c-aeba-4263-8fc7-ffe71459829e req-b7496b64-24ac-4479-83e8-fe1dbb530460 service nova] Creating event network-vif-deleted:43c64c32-bbee-4029-a116-ea24bb510ae6 for instance 6b4ea83e-918c-426c-8355-6febdfbe2614 on n-h1-856895-1 Sep 10 12:04:02.896792 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-9dfdf71c-aeba-4263-8fc7-ffe71459829e req-b7496b64-24ac-4479-83e8-fe1dbb530460 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132303 Sep 10 12:04:02.898659 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2472/4935] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:04:03.249277 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a9da1cd7-8c26-46db-8281-54b931fd1e6b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:03.249879 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a9da1cd7-8c26-46db-8281-54b931fd1e6b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 6b4ea83e-918c-426c-8355-6febdfbe2614] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:03.265310 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9da1cd7-8c26-46db-8281-54b931fd1e6b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:03.266108 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9da1cd7-8c26-46db-8281-54b931fd1e6b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:03.269670 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9da1cd7-8c26-46db-8281-54b931fd1e6b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:03.270731 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9da1cd7-8c26-46db-8281-54b931fd1e6b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:03.272063 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9da1cd7-8c26-46db-8281-54b931fd1e6b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:03.272694 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9da1cd7-8c26-46db-8281-54b931fd1e6b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:03.314602 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-886b52e2-48cb-410d-ad17-7109a727da81 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:03.319036 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-886b52e2-48cb-410d-ad17-7109a727da81 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] [instance: 6f3b842d-0cd0-4656-a69a-d409e3628f13] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:03.330127 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-886b52e2-48cb-410d-ad17-7109a727da81 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:03.332292 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-886b52e2-48cb-410d-ad17-7109a727da81 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:03.336457 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-886b52e2-48cb-410d-ad17-7109a727da81 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:03.339994 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-886b52e2-48cb-410d-ad17-7109a727da81 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:03.341972 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-886b52e2-48cb-410d-ad17-7109a727da81 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:03.343190 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-886b52e2-48cb-410d-ad17-7109a727da81 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:03.343485 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9da1cd7-8c26-46db-8281-54b931fd1e6b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:03.355658 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9da1cd7-8c26-46db-8281-54b931fd1e6b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:03.356147 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9da1cd7-8c26-46db-8281-54b931fd1e6b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:03.357400 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-a9da1cd7-8c26-46db-8281-54b931fd1e6b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lazy-loading 'fault' on Instance uuid 6b4ea83e-918c-426c-8355-6febdfbe2614 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:04:03.491770 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a9da1cd7-8c26-46db-8281-54b931fd1e6b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:03.512639 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a9da1cd7-8c26-46db-8281-54b931fd1e6b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614" status: 200 len: 1298 microversion: 2.1 time: 0.268038 Sep 10 12:04:03.514273 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2464/4936] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:03 2022] GET /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614 => generated 1298 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:03.519110 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7e211048-91d3-4779-bfb9-b1736581137e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:03.526442 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7e211048-91d3-4779-bfb9-b1736581137e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: b161d8f6-56f1-472a-99bd-f05c1431efac] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:03.539293 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7e211048-91d3-4779-bfb9-b1736581137e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:03.539797 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7e211048-91d3-4779-bfb9-b1736581137e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:03.544175 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7e211048-91d3-4779-bfb9-b1736581137e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:03.545219 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7e211048-91d3-4779-bfb9-b1736581137e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:03.545945 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7e211048-91d3-4779-bfb9-b1736581137e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:03.546504 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7e211048-91d3-4779-bfb9-b1736581137e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:03.656224 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7e211048-91d3-4779-bfb9-b1736581137e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "POST /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac/action" status: 200 len: 14 microversion: 2.1 time: 0.136189 Sep 10 12:04:03.658992 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2465/4937] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:04:03 2022] POST /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 12:04:03.670600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c8e6b3b7-4f5a-4fcc-bdec-90f1bc4b0794 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:03.690526 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c8e6b3b7-4f5a-4fcc-bdec-90f1bc4b0794 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: d4d4927f-4127-4a75-8c38-f462dda83d23] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:03.731206 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c8e6b3b7-4f5a-4fcc-bdec-90f1bc4b0794 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:03.733447 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c8e6b3b7-4f5a-4fcc-bdec-90f1bc4b0794 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:03.734440 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c8e6b3b7-4f5a-4fcc-bdec-90f1bc4b0794 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:03.737230 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c8e6b3b7-4f5a-4fcc-bdec-90f1bc4b0794 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:03.737935 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c8e6b3b7-4f5a-4fcc-bdec-90f1bc4b0794 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:03.738872 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c8e6b3b7-4f5a-4fcc-bdec-90f1bc4b0794 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:03.777469 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-886b52e2-48cb-410d-ad17-7109a727da81 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70a2fcdb2714a28a87e63f169ff9fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b377382724d7d877c6b989cfd7271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:03.786243 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-886b52e2-48cb-410d-ad17-7109a727da81 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] 10.222.0.23 "GET /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13" status: 200 len: 1315 microversion: 2.1 time: 0.477863 Sep 10 12:04:03.790436 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2473/4938] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:03 2022] GET /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13 => generated 1315 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:04:03.863218 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c8e6b3b7-4f5a-4fcc-bdec-90f1bc4b0794 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:03.880304 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c8e6b3b7-4f5a-4fcc-bdec-90f1bc4b0794 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23" status: 200 len: 1275 microversion: 2.1 time: 0.214775 Sep 10 12:04:03.892320 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2466/4939] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:03 2022] GET /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23 => generated 1275 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:04.538822 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-607acda4-3cd9-49d1-8c3c-857dafd860a7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:04.539994 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-607acda4-3cd9-49d1-8c3c-857dafd860a7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 6b4ea83e-918c-426c-8355-6febdfbe2614] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:04.558543 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-607acda4-3cd9-49d1-8c3c-857dafd860a7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:04.559364 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-607acda4-3cd9-49d1-8c3c-857dafd860a7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:04.560965 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-607acda4-3cd9-49d1-8c3c-857dafd860a7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:04.562098 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-607acda4-3cd9-49d1-8c3c-857dafd860a7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:04.562829 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-607acda4-3cd9-49d1-8c3c-857dafd860a7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:04.563528 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-607acda4-3cd9-49d1-8c3c-857dafd860a7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:04.584403 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-607acda4-3cd9-49d1-8c3c-857dafd860a7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] HTTP exception thrown: Instance 6b4ea83e-918c-426c-8355-6febdfbe2614 could not be found. Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-607acda4-3cd9-49d1-8c3c-857dafd860a7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Request method failure captured: Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614 HTTP/1.1 Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHykcWQYupGxhcLpb6v5AsrUV8qZ6sg9Ki1Jfb5jCMoRjGicsw0WManJo8IjBppMD5CxQdT4hQu3IHHi54G_V7lvb8EgCj19qVHNlr3p45qCyo-pmA_bA7FrmqWJZSaCbHLCvlYvItyJikej-C_PUFDVoe9D_fp0roxy7XQj-_YcxQA Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersTestJSON-793172710 Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ac8b3e9f72234d9985fbc5fa7e7984ad", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersTestJSON-793172710 Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersTestJSON-793172710 Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersTestJSON-793172710-project Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: ef32131362a3442498234c0554f08305 Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersTestJSON-793172710-project Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 6b4ea83e-918c-426c-8355-6febdfbe2614 could not be found. Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '6b4ea83e-918c-426c-8355-6febdfbe2614'} Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b4ea83e-918c-426c-8355-6febdfbe2614 could not be found. Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b4ea83e-918c-426c-8355-6febdfbe2614 could not be found. Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:04.586526 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:04.592087 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:04.592087 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:04.592087 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:04:04.592087 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:04:04.592087 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b4ea83e-918c-426c-8355-6febdfbe2614 could not be found. Sep 10 12:04:04.592087 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:04.592087 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-607acda4-3cd9-49d1-8c3c-857dafd860a7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Returning 404 to user: Instance 6b4ea83e-918c-426c-8355-6febdfbe2614 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:04:04.594067 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-607acda4-3cd9-49d1-8c3c-857dafd860a7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614" status: 404 len: 111 microversion: 2.1 time: 0.060296 Sep 10 12:04:04.594943 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2474/4940] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:04 2022] GET /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:04:04.668153 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b42fcc04-e1dd-409e-a13c-8b9e0270b294 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:04.671146 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b42fcc04-e1dd-409e-a13c-8b9e0270b294 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: b161d8f6-56f1-472a-99bd-f05c1431efac] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:04.688840 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b42fcc04-e1dd-409e-a13c-8b9e0270b294 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:04.689629 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b42fcc04-e1dd-409e-a13c-8b9e0270b294 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:04.691770 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b42fcc04-e1dd-409e-a13c-8b9e0270b294 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:04.692720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b42fcc04-e1dd-409e-a13c-8b9e0270b294 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:04.699877 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b42fcc04-e1dd-409e-a13c-8b9e0270b294 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:04.701221 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b42fcc04-e1dd-409e-a13c-8b9e0270b294 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:04.752050 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-10a18a13-07f9-4890-9947-591dc62336a9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1428387122", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "5a10f3ce-b3db-41f2-acaa-21e8715e6fe6"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:04.846333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-10a18a13-07f9-4890-9947-591dc62336a9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] validate_networks() for [('5a10f3ce-b3db-41f2-acaa-21e8715e6fe6', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:04:04.868494 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b42fcc04-e1dd-409e-a13c-8b9e0270b294 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "POST /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac/action" status: 200 len: 14 microversion: 2.1 time: 0.204293 Sep 10 12:04:04.872022 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2467/4941] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:04:04 2022] POST /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac/action => generated 14 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 12:04:04.879093 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-63b9e433-b099-4bbb-bc85-3a697d59947a tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:04.888077 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-63b9e433-b099-4bbb-bc85-3a697d59947a tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] [instance: 6f3b842d-0cd0-4656-a69a-d409e3628f13] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:04.896267 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-63b9e433-b099-4bbb-bc85-3a697d59947a tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:04.896761 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-63b9e433-b099-4bbb-bc85-3a697d59947a tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:04.897203 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-63b9e433-b099-4bbb-bc85-3a697d59947a tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:04.897915 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-63b9e433-b099-4bbb-bc85-3a697d59947a tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:04.898374 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-63b9e433-b099-4bbb-bc85-3a697d59947a tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:04.898805 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-63b9e433-b099-4bbb-bc85-3a697d59947a tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:04.930837 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:04:05.681096 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-63b9e433-b099-4bbb-bc85-3a697d59947a tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70a2fcdb2714a28a87e63f169ff9fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b377382724d7d877c6b989cfd7271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:05.692241 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-63b9e433-b099-4bbb-bc85-3a697d59947a tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] 10.222.0.23 "GET /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13" status: 200 len: 1315 microversion: 2.1 time: 0.818161 Sep 10 12:04:05.714412 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2468/4942] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:04 2022] GET /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13 => generated 1315 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:05.726626 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3422afbc-696c-47f2-9e1f-bb389cd2374b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:05.727304 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3422afbc-696c-47f2-9e1f-bb389cd2374b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: d4d4927f-4127-4a75-8c38-f462dda83d23] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:05.744192 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3422afbc-696c-47f2-9e1f-bb389cd2374b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:05.744698 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3422afbc-696c-47f2-9e1f-bb389cd2374b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:05.745144 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3422afbc-696c-47f2-9e1f-bb389cd2374b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:05.745866 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3422afbc-696c-47f2-9e1f-bb389cd2374b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:05.746332 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3422afbc-696c-47f2-9e1f-bb389cd2374b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:05.746758 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3422afbc-696c-47f2-9e1f-bb389cd2374b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:06.221910 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-10a18a13-07f9-4890-9947-591dc62336a9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:04:06.222512 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-10a18a13-07f9-4890-9947-591dc62336a9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:04:06.222996 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-10a18a13-07f9-4890-9947-591dc62336a9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:04:06.223428 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-10a18a13-07f9-4890-9947-591dc62336a9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:04:06.223841 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-10a18a13-07f9-4890-9947-591dc62336a9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:04:06.244499 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-10a18a13-07f9-4890-9947-591dc62336a9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:06.244984 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-10a18a13-07f9-4890-9947-591dc62336a9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:06.245417 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-10a18a13-07f9-4890-9947-591dc62336a9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:06.246145 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-10a18a13-07f9-4890-9947-591dc62336a9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:06.252701 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-10a18a13-07f9-4890-9947-591dc62336a9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:06.253443 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-10a18a13-07f9-4890-9947-591dc62336a9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:06.298270 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-10a18a13-07f9-4890-9947-591dc62336a9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Getting quotas for project ac8b3e9f72234d9985fbc5fa7e7984ad. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:04:06.307528 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-10a18a13-07f9-4890-9947-591dc62336a9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Getting quotas for user ef32131362a3442498234c0554f08305 and project ac8b3e9f72234d9985fbc5fa7e7984ad. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:04:06.345238 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-10a18a13-07f9-4890-9947-591dc62336a9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:04:06.350034 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-10a18a13-07f9-4890-9947-591dc62336a9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: eb38cda8-93a7-4327-944f-409c17070fd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:04:06.352061 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3422afbc-696c-47f2-9e1f-bb389cd2374b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:06.361739 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3422afbc-696c-47f2-9e1f-bb389cd2374b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23" status: 200 len: 1317 microversion: 2.1 time: 0.646052 Sep 10 12:04:06.365176 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2469/4943] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:05 2022] GET /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23 => generated 1317 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:06.374070 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ec33157f-6920-466d-8ae0-85806bceef52 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:06.381835 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ec33157f-6920-466d-8ae0-85806bceef52 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: b161d8f6-56f1-472a-99bd-f05c1431efac] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:06.397890 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec33157f-6920-466d-8ae0-85806bceef52 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:06.398723 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec33157f-6920-466d-8ae0-85806bceef52 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:06.399382 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec33157f-6920-466d-8ae0-85806bceef52 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:06.400302 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec33157f-6920-466d-8ae0-85806bceef52 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:06.400941 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec33157f-6920-466d-8ae0-85806bceef52 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:06.411990 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec33157f-6920-466d-8ae0-85806bceef52 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:06.481743 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ec33157f-6920-466d-8ae0-85806bceef52 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "POST /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac/action" status: 200 len: 14 microversion: 2.1 time: 0.113461 Sep 10 12:04:06.482516 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-10a18a13-07f9-4890-9947-591dc62336a9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.734003 Sep 10 12:04:06.482877 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2470/4944] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:04:06 2022] POST /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 12:04:06.485755 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2475/4945] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:04:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 12:04:06.497193 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c3f7cbfd-9b72-47e3-a098-c101d17d9b0c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:06.497840 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c3f7cbfd-9b72-47e3-a098-c101d17d9b0c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: eb38cda8-93a7-4327-944f-409c17070fd7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:06.498364 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-4a567bc7-0209-4c4f-987c-da38713f2f9b req-fc284010-80e7-4915-b3c8-c81ea167155f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4d4927f-4127-4a75-8c38-f462dda83d23", "tag": "876ef81d-0b12-446a-84b1-6e79a7232b38"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:06.530387 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-4a567bc7-0209-4c4f-987c-da38713f2f9b req-fc284010-80e7-4915-b3c8-c81ea167155f service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:06.531305 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-4a567bc7-0209-4c4f-987c-da38713f2f9b req-fc284010-80e7-4915-b3c8-c81ea167155f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:06.533047 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-4a567bc7-0209-4c4f-987c-da38713f2f9b req-fc284010-80e7-4915-b3c8-c81ea167155f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:06.550363 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-4a567bc7-0209-4c4f-987c-da38713f2f9b req-fc284010-80e7-4915-b3c8-c81ea167155f service nova] Creating event network-changed:876ef81d-0b12-446a-84b1-6e79a7232b38 for instance d4d4927f-4127-4a75-8c38-f462dda83d23 on n-h2-856895-1 Sep 10 12:04:06.557542 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-4a567bc7-0209-4c4f-987c-da38713f2f9b req-fc284010-80e7-4915-b3c8-c81ea167155f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072741 Sep 10 12:04:06.559352 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2471/4946] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:04:06.724661 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a07def31-abfd-40fa-8bc7-980ed212a275 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:06.737705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c3f7cbfd-9b72-47e3-a098-c101d17d9b0c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:06.737923 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a07def31-abfd-40fa-8bc7-980ed212a275 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] [instance: 6f3b842d-0cd0-4656-a69a-d409e3628f13] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:06.756662 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c3f7cbfd-9b72-47e3-a098-c101d17d9b0c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7" status: 200 len: 1209 microversion: 2.1 time: 0.260798 Sep 10 12:04:06.758112 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a07def31-abfd-40fa-8bc7-980ed212a275 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:06.760549 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2476/4947] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:06 2022] GET /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7 => generated 1209 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:06.767638 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a07def31-abfd-40fa-8bc7-980ed212a275 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:06.768345 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a07def31-abfd-40fa-8bc7-980ed212a275 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:06.769208 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a07def31-abfd-40fa-8bc7-980ed212a275 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:06.770599 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a07def31-abfd-40fa-8bc7-980ed212a275 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:06.772139 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a07def31-abfd-40fa-8bc7-980ed212a275 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:07.109772 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a07def31-abfd-40fa-8bc7-980ed212a275 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70a2fcdb2714a28a87e63f169ff9fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b377382724d7d877c6b989cfd7271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:07.130062 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a07def31-abfd-40fa-8bc7-980ed212a275 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] 10.222.0.23 "GET /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13" status: 200 len: 1315 microversion: 2.1 time: 0.406848 Sep 10 12:04:07.132859 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2472/4948] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:06 2022] GET /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13 => generated 1315 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:04:07.395014 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2bbd4a8a-ae41-40de-905c-2fef8ddfd6e0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:07.396584 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2bbd4a8a-ae41-40de-905c-2fef8ddfd6e0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: d4d4927f-4127-4a75-8c38-f462dda83d23] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:07.421681 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2bbd4a8a-ae41-40de-905c-2fef8ddfd6e0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:07.422660 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2bbd4a8a-ae41-40de-905c-2fef8ddfd6e0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:07.424612 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2bbd4a8a-ae41-40de-905c-2fef8ddfd6e0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:07.428380 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2bbd4a8a-ae41-40de-905c-2fef8ddfd6e0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:07.429945 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2bbd4a8a-ae41-40de-905c-2fef8ddfd6e0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:07.432761 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2bbd4a8a-ae41-40de-905c-2fef8ddfd6e0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:07.494248 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3d4f5356-ebc3-4757-84b5-f662de45cfb9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:07.496888 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3d4f5356-ebc3-4757-84b5-f662de45cfb9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: b161d8f6-56f1-472a-99bd-f05c1431efac] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:07.532215 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3d4f5356-ebc3-4757-84b5-f662de45cfb9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:07.534701 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3d4f5356-ebc3-4757-84b5-f662de45cfb9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:07.536997 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3d4f5356-ebc3-4757-84b5-f662de45cfb9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:07.539555 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3d4f5356-ebc3-4757-84b5-f662de45cfb9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:07.546369 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3d4f5356-ebc3-4757-84b5-f662de45cfb9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:07.547462 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3d4f5356-ebc3-4757-84b5-f662de45cfb9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:07.648461 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3d4f5356-ebc3-4757-84b5-f662de45cfb9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "POST /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac/action" status: 200 len: 14 microversion: 2.1 time: 0.158718 Sep 10 12:04:07.653877 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2473/4949] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:04:07 2022] POST /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac/action => generated 14 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 10 12:04:07.789752 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-214e27ab-0bf7-4fae-9ab4-c4ddd021d36d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:07.791177 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-214e27ab-0bf7-4fae-9ab4-c4ddd021d36d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: eb38cda8-93a7-4327-944f-409c17070fd7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:07.804418 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-214e27ab-0bf7-4fae-9ab4-c4ddd021d36d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:07.804911 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-214e27ab-0bf7-4fae-9ab4-c4ddd021d36d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:07.805358 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-214e27ab-0bf7-4fae-9ab4-c4ddd021d36d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:07.808724 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-214e27ab-0bf7-4fae-9ab4-c4ddd021d36d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:07.812414 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-214e27ab-0bf7-4fae-9ab4-c4ddd021d36d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:07.813264 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-214e27ab-0bf7-4fae-9ab4-c4ddd021d36d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:08.368198 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-214e27ab-0bf7-4fae-9ab4-c4ddd021d36d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:08.378346 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-214e27ab-0bf7-4fae-9ab4-c4ddd021d36d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7" status: 200 len: 1213 microversion: 2.1 time: 0.595747 Sep 10 12:04:08.379550 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2474/4950] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:07 2022] GET /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7 => generated 1213 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:04:08.384525 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8e921e8e-4fa1-45a3-bdc0-e6512a12dbbd tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:08.385441 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8e921e8e-4fa1-45a3-bdc0-e6512a12dbbd tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] [instance: 6f3b842d-0cd0-4656-a69a-d409e3628f13] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:08.397019 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e921e8e-4fa1-45a3-bdc0-e6512a12dbbd tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:08.399057 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e921e8e-4fa1-45a3-bdc0-e6512a12dbbd tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:08.399846 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e921e8e-4fa1-45a3-bdc0-e6512a12dbbd tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:08.400832 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e921e8e-4fa1-45a3-bdc0-e6512a12dbbd tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:08.401537 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e921e8e-4fa1-45a3-bdc0-e6512a12dbbd tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:08.402220 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e921e8e-4fa1-45a3-bdc0-e6512a12dbbd tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:08.575204 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2bbd4a8a-ae41-40de-905c-2fef8ddfd6e0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:08.608700 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2bbd4a8a-ae41-40de-905c-2fef8ddfd6e0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23" status: 200 len: 1317 microversion: 2.1 time: 1.219314 Sep 10 12:04:08.610986 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2477/4951] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:07 2022] GET /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23 => generated 1317 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:08.672348 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9ad031a2-8095-4eaa-ab62-a626f79d0c6e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:08.675763 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9ad031a2-8095-4eaa-ab62-a626f79d0c6e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: b161d8f6-56f1-472a-99bd-f05c1431efac] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:08.683075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9ad031a2-8095-4eaa-ab62-a626f79d0c6e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:08.684114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9ad031a2-8095-4eaa-ab62-a626f79d0c6e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:08.686026 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9ad031a2-8095-4eaa-ab62-a626f79d0c6e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:08.686972 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9ad031a2-8095-4eaa-ab62-a626f79d0c6e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:08.688254 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9ad031a2-8095-4eaa-ab62-a626f79d0c6e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:08.689250 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9ad031a2-8095-4eaa-ab62-a626f79d0c6e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:08.771727 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8e921e8e-4fa1-45a3-bdc0-e6512a12dbbd tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70a2fcdb2714a28a87e63f169ff9fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b377382724d7d877c6b989cfd7271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:08.782554 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8e921e8e-4fa1-45a3-bdc0-e6512a12dbbd tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] 10.222.0.23 "GET /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13" status: 200 len: 1315 microversion: 2.1 time: 0.401654 Sep 10 12:04:08.783767 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2475/4952] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:08 2022] GET /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13 => generated 1315 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:09.406126 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b7cc1ef2-5cbf-455c-bb2c-18c590887551 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:09.407471 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b7cc1ef2-5cbf-455c-bb2c-18c590887551 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: eb38cda8-93a7-4327-944f-409c17070fd7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:09.423104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7cc1ef2-5cbf-455c-bb2c-18c590887551 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:09.423880 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7cc1ef2-5cbf-455c-bb2c-18c590887551 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:09.424489 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7cc1ef2-5cbf-455c-bb2c-18c590887551 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:09.425399 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7cc1ef2-5cbf-455c-bb2c-18c590887551 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:09.426025 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7cc1ef2-5cbf-455c-bb2c-18c590887551 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:09.426626 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7cc1ef2-5cbf-455c-bb2c-18c590887551 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:09.517193 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b7cc1ef2-5cbf-455c-bb2c-18c590887551 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:09.531840 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9ad031a2-8095-4eaa-ab62-a626f79d0c6e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "POST /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac/action" status: 200 len: 14 microversion: 2.1 time: 0.874343 Sep 10 12:04:09.533984 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2478/4953] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:04:08 2022] POST /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac/action => generated 14 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 10 12:04:09.535517 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b7cc1ef2-5cbf-455c-bb2c-18c590887551 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7" status: 200 len: 1267 microversion: 2.1 time: 0.125942 Sep 10 12:04:09.552708 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2476/4954] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:09 2022] GET /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7 => generated 1267 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:04:09.634714 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b3c5e463-ffae-4f1c-b476-e98d608656ea tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:09.636124 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b3c5e463-ffae-4f1c-b476-e98d608656ea tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: d4d4927f-4127-4a75-8c38-f462dda83d23] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:09.645929 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b3c5e463-ffae-4f1c-b476-e98d608656ea tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:09.647553 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b3c5e463-ffae-4f1c-b476-e98d608656ea tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:09.648179 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b3c5e463-ffae-4f1c-b476-e98d608656ea tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:09.649721 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b3c5e463-ffae-4f1c-b476-e98d608656ea tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:09.650381 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b3c5e463-ffae-4f1c-b476-e98d608656ea tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:09.651004 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b3c5e463-ffae-4f1c-b476-e98d608656ea tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:09.822219 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-18c15e90-2998-45da-b5d2-6bdb94ddc7ae tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:09.823129 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-18c15e90-2998-45da-b5d2-6bdb94ddc7ae tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] [instance: 6f3b842d-0cd0-4656-a69a-d409e3628f13] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:09.842655 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:04:09.849630 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-18c15e90-2998-45da-b5d2-6bdb94ddc7ae tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:09.850648 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-18c15e90-2998-45da-b5d2-6bdb94ddc7ae tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:09.854022 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-18c15e90-2998-45da-b5d2-6bdb94ddc7ae tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:09.856205 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-18c15e90-2998-45da-b5d2-6bdb94ddc7ae tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:09.874240 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-18c15e90-2998-45da-b5d2-6bdb94ddc7ae tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:09.875565 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-18c15e90-2998-45da-b5d2-6bdb94ddc7ae tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:10.086137 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b3c5e463-ffae-4f1c-b476-e98d608656ea tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:10.101677 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b3c5e463-ffae-4f1c-b476-e98d608656ea tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23" status: 200 len: 1317 microversion: 2.1 time: 0.468921 Sep 10 12:04:10.120360 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2479/4955] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:09 2022] GET /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23 => generated 1317 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:10.319200 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-18c15e90-2998-45da-b5d2-6bdb94ddc7ae tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70a2fcdb2714a28a87e63f169ff9fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b377382724d7d877c6b989cfd7271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:10.330386 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-18c15e90-2998-45da-b5d2-6bdb94ddc7ae tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] 10.222.0.23 "GET /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13" status: 200 len: 1315 microversion: 2.1 time: 0.524086 Sep 10 12:04:10.340496 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2477/4956] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:09 2022] GET /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13 => generated 1315 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:10.388971 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-f6c83707-b99d-48ad-af13-72f6042025bb req-1fd0dd4f-4486-4d4d-b8fb-4700076d721a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f3b842d-0cd0-4656-a69a-d409e3628f13", "name": "network-vif-plugged", "status": "completed", "tag": "d7eb6a17-8635-4fdb-888c-369f06fa03db"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:10.449190 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-f6c83707-b99d-48ad-af13-72f6042025bb req-1fd0dd4f-4486-4d4d-b8fb-4700076d721a service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:10.449642 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-f6c83707-b99d-48ad-af13-72f6042025bb req-1fd0dd4f-4486-4d4d-b8fb-4700076d721a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:10.450160 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-f6c83707-b99d-48ad-af13-72f6042025bb req-1fd0dd4f-4486-4d4d-b8fb-4700076d721a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:10.473172 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-f6c83707-b99d-48ad-af13-72f6042025bb req-1fd0dd4f-4486-4d4d-b8fb-4700076d721a service nova] Creating event network-vif-plugged:d7eb6a17-8635-4fdb-888c-369f06fa03db for instance 6f3b842d-0cd0-4656-a69a-d409e3628f13 on n-h2-856895-1 Sep 10 12:04:10.480927 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-f6c83707-b99d-48ad-af13-72f6042025bb req-1fd0dd4f-4486-4d4d-b8fb-4700076d721a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103869 Sep 10 12:04:10.483779 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2480/4957] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:04:10.546562 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8913ad2a-1a43-460d-b394-04c9b60abdab tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:10.548596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8913ad2a-1a43-460d-b394-04c9b60abdab tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: b161d8f6-56f1-472a-99bd-f05c1431efac] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:10.563287 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6eb2bcae-8e3b-49f8-a7b5-d4c7f82d4f2a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:10.565421 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6eb2bcae-8e3b-49f8-a7b5-d4c7f82d4f2a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: eb38cda8-93a7-4327-944f-409c17070fd7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:10.567399 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8913ad2a-1a43-460d-b394-04c9b60abdab tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:10.575388 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8913ad2a-1a43-460d-b394-04c9b60abdab tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:10.576004 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6eb2bcae-8e3b-49f8-a7b5-d4c7f82d4f2a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:10.576182 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8913ad2a-1a43-460d-b394-04c9b60abdab tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:10.576850 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6eb2bcae-8e3b-49f8-a7b5-d4c7f82d4f2a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:10.576989 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8913ad2a-1a43-460d-b394-04c9b60abdab tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:10.577425 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8913ad2a-1a43-460d-b394-04c9b60abdab tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:10.577847 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6eb2bcae-8e3b-49f8-a7b5-d4c7f82d4f2a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:10.578006 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8913ad2a-1a43-460d-b394-04c9b60abdab tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:10.585162 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6eb2bcae-8e3b-49f8-a7b5-d4c7f82d4f2a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:10.585857 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6eb2bcae-8e3b-49f8-a7b5-d4c7f82d4f2a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:10.586528 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6eb2bcae-8e3b-49f8-a7b5-d4c7f82d4f2a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:10.688163 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8913ad2a-1a43-460d-b394-04c9b60abdab tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "POST /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac/action" status: 200 len: 8198 microversion: 2.1 time: 0.146122 Sep 10 12:04:10.689343 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2478/4958] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:04:10 2022] POST /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac/action => generated 8198 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:10.701484 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4a88efe3-0ac0-49f6-b334-d7f133a9a84f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:10.702404 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4a88efe3-0ac0-49f6-b334-d7f133a9a84f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:10.719871 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4a88efe3-0ac0-49f6-b334-d7f133a9a84f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:10.720622 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4a88efe3-0ac0-49f6-b334-d7f133a9a84f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:10.721247 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4a88efe3-0ac0-49f6-b334-d7f133a9a84f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:10.722271 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4a88efe3-0ac0-49f6-b334-d7f133a9a84f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:10.722897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4a88efe3-0ac0-49f6-b334-d7f133a9a84f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:10.723583 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4a88efe3-0ac0-49f6-b334-d7f133a9a84f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:11.056255 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6eb2bcae-8e3b-49f8-a7b5-d4c7f82d4f2a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:11.067363 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6eb2bcae-8e3b-49f8-a7b5-d4c7f82d4f2a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7" status: 200 len: 1309 microversion: 2.1 time: 0.510890 Sep 10 12:04:11.071935 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2481/4959] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:10 2022] GET /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7 => generated 1309 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:11.128587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b81b4926-d780-43d8-9ba3-68edb61f3a98 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:11.129387 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b81b4926-d780-43d8-9ba3-68edb61f3a98 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: d4d4927f-4127-4a75-8c38-f462dda83d23] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:11.143609 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b81b4926-d780-43d8-9ba3-68edb61f3a98 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:11.144513 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b81b4926-d780-43d8-9ba3-68edb61f3a98 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:11.145558 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b81b4926-d780-43d8-9ba3-68edb61f3a98 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:11.146524 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b81b4926-d780-43d8-9ba3-68edb61f3a98 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:11.147255 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b81b4926-d780-43d8-9ba3-68edb61f3a98 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:11.147925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b81b4926-d780-43d8-9ba3-68edb61f3a98 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:11.187788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4a88efe3-0ac0-49f6-b334-d7f133a9a84f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:11.195954 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4a88efe3-0ac0-49f6-b334-d7f133a9a84f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.501096 Sep 10 12:04:11.199135 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2479/4960] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:10 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:04:11.225495 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9ba56005-772c-49be-af2e-b5fc70c72edc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:11.226136 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9ba56005-772c-49be-af2e-b5fc70c72edc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:11.239642 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ba56005-772c-49be-af2e-b5fc70c72edc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:11.240724 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ba56005-772c-49be-af2e-b5fc70c72edc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:11.242015 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ba56005-772c-49be-af2e-b5fc70c72edc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:11.242948 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ba56005-772c-49be-af2e-b5fc70c72edc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:11.243621 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ba56005-772c-49be-af2e-b5fc70c72edc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:11.244381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ba56005-772c-49be-af2e-b5fc70c72edc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:11.660306 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b81b4926-d780-43d8-9ba3-68edb61f3a98 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:11.676556 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b81b4926-d780-43d8-9ba3-68edb61f3a98 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23" status: 200 len: 1317 microversion: 2.1 time: 0.552149 Sep 10 12:04:11.691262 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2482/4961] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:11 2022] GET /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23 => generated 1317 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:11.691262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-304989f1-ce6a-45ce-9946-19aa0d84e52f tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:11.691262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-304989f1-ce6a-45ce-9946-19aa0d84e52f tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] [instance: 6f3b842d-0cd0-4656-a69a-d409e3628f13] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:11.706614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-304989f1-ce6a-45ce-9946-19aa0d84e52f tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:11.707139 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-304989f1-ce6a-45ce-9946-19aa0d84e52f tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:11.707625 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-304989f1-ce6a-45ce-9946-19aa0d84e52f tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:11.708365 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-304989f1-ce6a-45ce-9946-19aa0d84e52f tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:11.708835 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-304989f1-ce6a-45ce-9946-19aa0d84e52f tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:11.709270 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-304989f1-ce6a-45ce-9946-19aa0d84e52f tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:12.010346 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9ba56005-772c-49be-af2e-b5fc70c72edc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:12.025782 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9ba56005-772c-49be-af2e-b5fc70c72edc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.806278 Sep 10 12:04:12.026595 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2480/4962] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:11 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:04:12.053221 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b05d141a-f0b3-4c64-ada2-4ff808c63824 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:12.053859 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b05d141a-f0b3-4c64-ada2-4ff808c63824 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:12.069662 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b05d141a-f0b3-4c64-ada2-4ff808c63824 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:12.070290 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b05d141a-f0b3-4c64-ada2-4ff808c63824 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:12.070761 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b05d141a-f0b3-4c64-ada2-4ff808c63824 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:12.074167 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b05d141a-f0b3-4c64-ada2-4ff808c63824 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:12.074877 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b05d141a-f0b3-4c64-ada2-4ff808c63824 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:12.078569 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b05d141a-f0b3-4c64-ada2-4ff808c63824 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:12.204855 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-304989f1-ce6a-45ce-9946-19aa0d84e52f tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70a2fcdb2714a28a87e63f169ff9fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b377382724d7d877c6b989cfd7271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:12.221735 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-304989f1-ce6a-45ce-9946-19aa0d84e52f tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] 10.222.0.23 "GET /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13" status: 200 len: 1315 microversion: 2.1 time: 0.542982 Sep 10 12:04:12.223439 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2483/4963] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:11 2022] GET /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13 => generated 1315 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:12.236729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cd95a571-c083-4999-9bab-7e8adcf731fc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:12.242474 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cd95a571-c083-4999-9bab-7e8adcf731fc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: eb38cda8-93a7-4327-944f-409c17070fd7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:12.250657 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd95a571-c083-4999-9bab-7e8adcf731fc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:12.258224 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd95a571-c083-4999-9bab-7e8adcf731fc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:12.259080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd95a571-c083-4999-9bab-7e8adcf731fc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:12.260200 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd95a571-c083-4999-9bab-7e8adcf731fc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:12.261047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd95a571-c083-4999-9bab-7e8adcf731fc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:12.261760 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd95a571-c083-4999-9bab-7e8adcf731fc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:13.275136 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cd95a571-c083-4999-9bab-7e8adcf731fc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:13.292078 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cd95a571-c083-4999-9bab-7e8adcf731fc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7" status: 200 len: 1309 microversion: 2.1 time: 1.066081 Sep 10 12:04:13.310464 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2484/4964] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:12 2022] GET /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7 => generated 1309 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:13.329483 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ac7d192d-6003-4cb2-8d65-9a2d0861d78f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:13.332529 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ac7d192d-6003-4cb2-8d65-9a2d0861d78f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: d4d4927f-4127-4a75-8c38-f462dda83d23] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:13.339762 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b05d141a-f0b3-4c64-ada2-4ff808c63824 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:13.342499 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac7d192d-6003-4cb2-8d65-9a2d0861d78f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:13.343370 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac7d192d-6003-4cb2-8d65-9a2d0861d78f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:13.343989 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac7d192d-6003-4cb2-8d65-9a2d0861d78f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:13.345415 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac7d192d-6003-4cb2-8d65-9a2d0861d78f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:13.346073 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac7d192d-6003-4cb2-8d65-9a2d0861d78f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:13.346679 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac7d192d-6003-4cb2-8d65-9a2d0861d78f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:13.350565 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b05d141a-f0b3-4c64-ada2-4ff808c63824 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 1.301308 Sep 10 12:04:13.351176 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2481/4965] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:12 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:13.373804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-8472e432-96cb-425d-8c95-bfc709447e28 req-2482dad5-f530-4960-8323-ac38c78d5277 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb38cda8-93a7-4327-944f-409c17070fd7", "tag": "81f9fb2f-8546-4237-ad5a-a2d6393c633d"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:13.399606 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-8472e432-96cb-425d-8c95-bfc709447e28 req-2482dad5-f530-4960-8323-ac38c78d5277 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:13.400350 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-8472e432-96cb-425d-8c95-bfc709447e28 req-2482dad5-f530-4960-8323-ac38c78d5277 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:13.401135 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-8472e432-96cb-425d-8c95-bfc709447e28 req-2482dad5-f530-4960-8323-ac38c78d5277 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:13.418014 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-8472e432-96cb-425d-8c95-bfc709447e28 req-2482dad5-f530-4960-8323-ac38c78d5277 service nova] Creating event network-changed:81f9fb2f-8546-4237-ad5a-a2d6393c633d for instance eb38cda8-93a7-4327-944f-409c17070fd7 on n-h1-856895-1 Sep 10 12:04:13.430263 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-8472e432-96cb-425d-8c95-bfc709447e28 req-2482dad5-f530-4960-8323-ac38c78d5277 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070499 Sep 10 12:04:13.431041 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2482/4966] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:04:13.442129 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-abf6fbbb-f39b-4323-a480-697d75a708d9 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:13.443283 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-abf6fbbb-f39b-4323-a480-697d75a708d9 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] [instance: 6f3b842d-0cd0-4656-a69a-d409e3628f13] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:13.452233 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-abf6fbbb-f39b-4323-a480-697d75a708d9 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:13.452849 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-abf6fbbb-f39b-4323-a480-697d75a708d9 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:13.453398 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-abf6fbbb-f39b-4323-a480-697d75a708d9 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:13.467524 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-abf6fbbb-f39b-4323-a480-697d75a708d9 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:13.468940 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-abf6fbbb-f39b-4323-a480-697d75a708d9 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:13.469687 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-abf6fbbb-f39b-4323-a480-697d75a708d9 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:14.150344 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ac7d192d-6003-4cb2-8d65-9a2d0861d78f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:14.162006 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ac7d192d-6003-4cb2-8d65-9a2d0861d78f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23" status: 200 len: 1317 microversion: 2.1 time: 0.848799 Sep 10 12:04:14.163129 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2485/4967] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:13 2022] GET /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23 => generated 1317 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:14.168077 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ab0d96de-de71-488a-89a3-bc94de42d48b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:14.169047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ab0d96de-de71-488a-89a3-bc94de42d48b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:14.175415 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ab0d96de-de71-488a-89a3-bc94de42d48b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:14.176329 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ab0d96de-de71-488a-89a3-bc94de42d48b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:14.177012 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ab0d96de-de71-488a-89a3-bc94de42d48b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:14.177960 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ab0d96de-de71-488a-89a3-bc94de42d48b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:14.178662 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ab0d96de-de71-488a-89a3-bc94de42d48b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:14.179362 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ab0d96de-de71-488a-89a3-bc94de42d48b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:14.350224 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-abf6fbbb-f39b-4323-a480-697d75a708d9 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70a2fcdb2714a28a87e63f169ff9fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b377382724d7d877c6b989cfd7271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:14.362876 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-abf6fbbb-f39b-4323-a480-697d75a708d9 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] 10.222.0.23 "GET /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13" status: 200 len: 1503 microversion: 2.1 time: 0.927855 Sep 10 12:04:14.364509 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2483/4968] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:13 2022] GET /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13 => generated 1503 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:14.377728 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-88a358fe-a0d7-445b-8f90-b8b1ba7a0647 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:14.378359 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-88a358fe-a0d7-445b-8f90-b8b1ba7a0647 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: eb38cda8-93a7-4327-944f-409c17070fd7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:14.394065 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-88a358fe-a0d7-445b-8f90-b8b1ba7a0647 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:14.394565 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-88a358fe-a0d7-445b-8f90-b8b1ba7a0647 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:14.395007 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-88a358fe-a0d7-445b-8f90-b8b1ba7a0647 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:14.395738 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-88a358fe-a0d7-445b-8f90-b8b1ba7a0647 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:14.401982 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-88a358fe-a0d7-445b-8f90-b8b1ba7a0647 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:14.402888 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-88a358fe-a0d7-445b-8f90-b8b1ba7a0647 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:14.873994 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-88a358fe-a0d7-445b-8f90-b8b1ba7a0647 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:14.875206 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ab0d96de-de71-488a-89a3-bc94de42d48b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:14.893545 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ab0d96de-de71-488a-89a3-bc94de42d48b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.728180 Sep 10 12:04:14.893959 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-88a358fe-a0d7-445b-8f90-b8b1ba7a0647 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7" status: 200 len: 1309 microversion: 2.1 time: 0.524923 Sep 10 12:04:14.894820 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2486/4969] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:14 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:14.901696 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cfe6182d-28f3-4182-b513-e812ee3c48d5 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:14.902854 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cfe6182d-28f3-4182-b513-e812ee3c48d5 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] [instance: 6f3b842d-0cd0-4656-a69a-d409e3628f13] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:14.917221 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cfe6182d-28f3-4182-b513-e812ee3c48d5 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:14.919706 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2484/4970] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:14 2022] GET /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7 => generated 1309 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:14.920186 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cfe6182d-28f3-4182-b513-e812ee3c48d5 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:14.920659 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cfe6182d-28f3-4182-b513-e812ee3c48d5 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:14.923544 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cfe6182d-28f3-4182-b513-e812ee3c48d5 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:14.926224 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cfe6182d-28f3-4182-b513-e812ee3c48d5 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:14.926680 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cfe6182d-28f3-4182-b513-e812ee3c48d5 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:14.931980 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-224dc6cb-3038-4a3d-8f6b-f634c26981f4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:14.933786 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-224dc6cb-3038-4a3d-8f6b-f634c26981f4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:14.943323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-224dc6cb-3038-4a3d-8f6b-f634c26981f4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:14.944190 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-224dc6cb-3038-4a3d-8f6b-f634c26981f4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:14.944901 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-224dc6cb-3038-4a3d-8f6b-f634c26981f4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:14.945791 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-224dc6cb-3038-4a3d-8f6b-f634c26981f4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:14.947464 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-224dc6cb-3038-4a3d-8f6b-f634c26981f4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:14.948158 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-224dc6cb-3038-4a3d-8f6b-f634c26981f4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:15.011398 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-224dc6cb-3038-4a3d-8f6b-f634c26981f4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Locking {{(pid=128776) lock /opt/stack/nova/nova/compute/api.py:4845}} Sep 10 12:04:15.092204 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cfe6182d-28f3-4182-b513-e812ee3c48d5 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.195664 Sep 10 12:04:15.093730 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2487/4971] 10.222.0.23 () {58 vars in 1296 bytes} [Sat Sep 10 12:04:14 2022] DELETE /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13/os-server-password => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:04:15.109203 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2db138fd-5be8-4a0d-9666-a2f8ca571ba8 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:15.112795 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2db138fd-5be8-4a0d-9666-a2f8ca571ba8 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] [instance: 6f3b842d-0cd0-4656-a69a-d409e3628f13] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:15.124743 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:04:15.135071 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2db138fd-5be8-4a0d-9666-a2f8ca571ba8 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:15.143778 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2db138fd-5be8-4a0d-9666-a2f8ca571ba8 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:15.144442 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2db138fd-5be8-4a0d-9666-a2f8ca571ba8 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:15.156137 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2db138fd-5be8-4a0d-9666-a2f8ca571ba8 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:15.158144 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2db138fd-5be8-4a0d-9666-a2f8ca571ba8 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:15.159345 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2db138fd-5be8-4a0d-9666-a2f8ca571ba8 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:15.182098 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-224dc6cb-3038-4a3d-8f6b-f634c26981f4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "POST /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f/action" status: 202 len: 0 microversion: 2.1 time: 0.260215 Sep 10 12:04:15.188350 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2485/4972] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:04:14 2022] POST /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:04:15.193438 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5ab0925f-ec6b-44ad-a02a-975b2d726af1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:15.194063 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5ab0925f-ec6b-44ad-a02a-975b2d726af1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: d4d4927f-4127-4a75-8c38-f462dda83d23] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:15.212548 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ab0925f-ec6b-44ad-a02a-975b2d726af1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:15.213051 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ab0925f-ec6b-44ad-a02a-975b2d726af1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:15.213487 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ab0925f-ec6b-44ad-a02a-975b2d726af1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:15.214194 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ab0925f-ec6b-44ad-a02a-975b2d726af1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:15.214648 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ab0925f-ec6b-44ad-a02a-975b2d726af1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:15.215072 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ab0925f-ec6b-44ad-a02a-975b2d726af1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:15.220608 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2db138fd-5be8-4a0d-9666-a2f8ca571ba8 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] 10.222.0.23 "GET /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.121731 Sep 10 12:04:15.228964 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2488/4973] 10.222.0.23 () {58 vars in 1293 bytes} [Sat Sep 10 12:04:15 2022] GET /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13/os-server-password => generated 16 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 12:04:15.243254 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-40b72db4-84f2-438f-9d65-282021954366 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:15.244650 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-40b72db4-84f2-438f-9d65-282021954366 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:15.267285 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40b72db4-84f2-438f-9d65-282021954366 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:15.267984 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40b72db4-84f2-438f-9d65-282021954366 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:15.268645 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40b72db4-84f2-438f-9d65-282021954366 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:15.269497 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40b72db4-84f2-438f-9d65-282021954366 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:15.270069 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40b72db4-84f2-438f-9d65-282021954366 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:15.271607 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40b72db4-84f2-438f-9d65-282021954366 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:15.682373 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-40b72db4-84f2-438f-9d65-282021954366 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:15.708086 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-40b72db4-84f2-438f-9d65-282021954366 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.475981 Sep 10 12:04:15.712269 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2489/4974] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:15 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:15.718631 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e478f998-d0c1-4853-8a87-d7e358ffc4b1 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:15.719131 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e478f998-d0c1-4853-8a87-d7e358ffc4b1 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] [instance: 6f3b842d-0cd0-4656-a69a-d409e3628f13] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:15.731327 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e478f998-d0c1-4853-8a87-d7e358ffc4b1 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:15.734279 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e478f998-d0c1-4853-8a87-d7e358ffc4b1 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:15.737380 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e478f998-d0c1-4853-8a87-d7e358ffc4b1 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:15.740930 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e478f998-d0c1-4853-8a87-d7e358ffc4b1 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:15.743024 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e478f998-d0c1-4853-8a87-d7e358ffc4b1 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:15.745435 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e478f998-d0c1-4853-8a87-d7e358ffc4b1 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:15.781881 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=4 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:04:15.818309 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e478f998-d0c1-4853-8a87-d7e358ffc4b1 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] [instance: 6f3b842d-0cd0-4656-a69a-d409e3628f13] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:04:15.986370 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5ab0925f-ec6b-44ad-a02a-975b2d726af1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:16.003186 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5ab0925f-ec6b-44ad-a02a-975b2d726af1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23" status: 200 len: 1317 microversion: 2.1 time: 0.813641 Sep 10 12:04:16.016139 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2486/4975] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:15 2022] GET /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23 => generated 1317 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:16.023835 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e478f998-d0c1-4853-8a87-d7e358ffc4b1 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13" status: 204 len: 0 microversion: 2.1 time: 0.308090 Sep 10 12:04:16.028833 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-53c23452-c917-4486-8a9d-c23da958d462 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:16.031768 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2490/4976] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:04:15 2022] DELETE /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:04:16.035024 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53c23452-c917-4486-8a9d-c23da958d462 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:16.035506 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53c23452-c917-4486-8a9d-c23da958d462 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:16.036221 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53c23452-c917-4486-8a9d-c23da958d462 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:16.049102 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c482af38-0beb-491e-a2d8-c667cea210d7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:16.049809 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c482af38-0beb-491e-a2d8-c667cea210d7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: eb38cda8-93a7-4327-944f-409c17070fd7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:16.062569 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-53c23452-c917-4486-8a9d-c23da958d462 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] HTTP exception thrown: Instance 64704ff7-229d-478b-9889-6b6cba53bd0f is locked Sep 10 12:04:16.063475 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c482af38-0beb-491e-a2d8-c667cea210d7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-53c23452-c917-4486-8a9d-c23da958d462 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Request method failure captured: Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f/action HTTP/1.1 Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 15 Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHvbGvNacfdgMYX0C1NknJJq9YUW5dAORIKr9a4TrFfNiItRSkWndeAJm51SFO_cJls_yRa1COZxQcBgB_PB3er0wolcL9nuODxO-4gh3bsdBy7gHemAEX8Q3MA6WCbAN3U14zQhI8ymqbFJWvUom1mViWhPQ5y3ASbmVvOZSfPd2oE Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 2410f9544bec4633988e1554111c9446 Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServerActionsTestJSON-1996815151 Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2410f9544bec4633988e1554111c9446"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2410f9544bec4633988e1554111c9446"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2410f9544bec4633988e1554111c9446", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2410f9544bec4633988e1554111c9446"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServerActionsTestJSON-1996815151 Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 2410f9544bec4633988e1554111c9446 Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServerActionsTestJSON-1996815151 Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServerActionsTestJSON-1996815151-project Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 8954f3256ddd49639ea57a9242a296d0 Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServerActionsTestJSON-1996815151-project Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: {"os-stop": {}} Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 64704ff7-229d-478b-9889-6b6cba53bd0f is locked Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '64704ff7-229d-478b-9889-6b6cba53bd0f', 'body': {'os-stop': {}}} Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 64704ff7-229d-478b-9889-6b6cba53bd0f is locked Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 64704ff7-229d-478b-9889-6b6cba53bd0f is locked Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64704ff7-229d-478b-9889-6b6cba53bd0f is locked Sep 10 12:04:16.064219 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:16.069571 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-53c23452-c917-4486-8a9d-c23da958d462 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Returning 409 to user: Instance 64704ff7-229d-478b-9889-6b6cba53bd0f is locked {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:04:16.069571 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-53c23452-c917-4486-8a9d-c23da958d462 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "POST /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f/action" status: 409 len: 107 microversion: 2.1 time: 0.047560 Sep 10 12:04:16.069761 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2487/4977] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:04:16 2022] POST /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f/action => generated 107 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 12:04:16.071386 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c482af38-0beb-491e-a2d8-c667cea210d7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:16.072248 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c482af38-0beb-491e-a2d8-c667cea210d7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:16.073796 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c482af38-0beb-491e-a2d8-c667cea210d7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:16.074556 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c482af38-0beb-491e-a2d8-c667cea210d7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:16.075625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a60fabd0-46e1-4ab9-9c6c-38c54de93b0c tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:16.076242 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a60fabd0-46e1-4ab9-9c6c-38c54de93b0c tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] [instance: 6f3b842d-0cd0-4656-a69a-d409e3628f13] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:16.076530 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c482af38-0beb-491e-a2d8-c667cea210d7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:16.084376 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a60fabd0-46e1-4ab9-9c6c-38c54de93b0c tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:16.084876 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a60fabd0-46e1-4ab9-9c6c-38c54de93b0c tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:16.085317 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a60fabd0-46e1-4ab9-9c6c-38c54de93b0c tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:16.086033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a60fabd0-46e1-4ab9-9c6c-38c54de93b0c tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:16.086488 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a60fabd0-46e1-4ab9-9c6c-38c54de93b0c tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:16.086913 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a60fabd0-46e1-4ab9-9c6c-38c54de93b0c tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:16.263032 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=4 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:04:16.314407 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c482af38-0beb-491e-a2d8-c667cea210d7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:16.323490 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a60fabd0-46e1-4ab9-9c6c-38c54de93b0c tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70a2fcdb2714a28a87e63f169ff9fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b377382724d7d877c6b989cfd7271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:16.332585 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c482af38-0beb-491e-a2d8-c667cea210d7 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7" status: 200 len: 1309 microversion: 2.1 time: 0.298532 Sep 10 12:04:16.333187 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2491/4978] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:16 2022] GET /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7 => generated 1309 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:16.347956 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e14396e2-d3b8-4c4d-be26-d55b687207a7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:16.348820 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e14396e2-d3b8-4c4d-be26-d55b687207a7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:16.350452 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a60fabd0-46e1-4ab9-9c6c-38c54de93b0c tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] 10.222.0.23 "GET /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13" status: 200 len: 1509 microversion: 2.1 time: 0.279583 Sep 10 12:04:16.360896 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e14396e2-d3b8-4c4d-be26-d55b687207a7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:16.361371 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e14396e2-d3b8-4c4d-be26-d55b687207a7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:16.361811 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e14396e2-d3b8-4c4d-be26-d55b687207a7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:16.362506 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e14396e2-d3b8-4c4d-be26-d55b687207a7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:16.362958 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e14396e2-d3b8-4c4d-be26-d55b687207a7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:16.363405 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e14396e2-d3b8-4c4d-be26-d55b687207a7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:16.370803 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2488/4979] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:16 2022] GET /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13 => generated 1509 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:16.421126 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e14396e2-d3b8-4c4d-be26-d55b687207a7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Unlocking {{(pid=128777) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 10 12:04:16.487800 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e14396e2-d3b8-4c4d-be26-d55b687207a7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "POST /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f/action" status: 202 len: 0 microversion: 2.1 time: 0.153119 Sep 10 12:04:16.489580 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2492/4980] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:04:16 2022] POST /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:04:16.497630 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f00ec15a-2780-4533-bc32-a106bf2cc77a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:16.506868 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f00ec15a-2780-4533-bc32-a106bf2cc77a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:16.507408 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f00ec15a-2780-4533-bc32-a106bf2cc77a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:16.508048 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f00ec15a-2780-4533-bc32-a106bf2cc77a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:16.534150 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f00ec15a-2780-4533-bc32-a106bf2cc77a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Going to try to stop instance {{(pid=128776) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 10 12:04:16.608056 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f00ec15a-2780-4533-bc32-a106bf2cc77a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "POST /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f/action" status: 202 len: 0 microversion: 2.1 time: 0.113452 Sep 10 12:04:16.609164 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2489/4981] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:04:16 2022] POST /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:04:16.616886 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-38b16b06-26e4-45b7-825c-2d7bede925bd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:16.617966 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-38b16b06-26e4-45b7-825c-2d7bede925bd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:16.626318 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-38b16b06-26e4-45b7-825c-2d7bede925bd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:16.627379 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-38b16b06-26e4-45b7-825c-2d7bede925bd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:16.628290 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-38b16b06-26e4-45b7-825c-2d7bede925bd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:16.629746 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-38b16b06-26e4-45b7-825c-2d7bede925bd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:16.630481 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-38b16b06-26e4-45b7-825c-2d7bede925bd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:16.631260 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-38b16b06-26e4-45b7-825c-2d7bede925bd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:16.754035 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=16 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:04:16.857520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-38b16b06-26e4-45b7-825c-2d7bede925bd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:16.868997 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-38b16b06-26e4-45b7-825c-2d7bede925bd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1682 microversion: 2.1 time: 0.255263 Sep 10 12:04:16.870867 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2493/4982] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:16 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1682 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:17.033436 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5bcebae8-93ff-4441-bb50-d059a5fa11d8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:17.036060 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5bcebae8-93ff-4441-bb50-d059a5fa11d8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: d4d4927f-4127-4a75-8c38-f462dda83d23] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:17.048820 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5bcebae8-93ff-4441-bb50-d059a5fa11d8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:17.049865 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5bcebae8-93ff-4441-bb50-d059a5fa11d8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:17.050786 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5bcebae8-93ff-4441-bb50-d059a5fa11d8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:17.053669 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5bcebae8-93ff-4441-bb50-d059a5fa11d8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:17.054682 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5bcebae8-93ff-4441-bb50-d059a5fa11d8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:17.055314 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5bcebae8-93ff-4441-bb50-d059a5fa11d8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:17.358839 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a882c329-e866-4d3a-8cf2-92f86c5a0a2c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:17.360099 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a882c329-e866-4d3a-8cf2-92f86c5a0a2c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: eb38cda8-93a7-4327-944f-409c17070fd7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:17.373519 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a882c329-e866-4d3a-8cf2-92f86c5a0a2c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:17.375679 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a882c329-e866-4d3a-8cf2-92f86c5a0a2c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:17.376828 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a882c329-e866-4d3a-8cf2-92f86c5a0a2c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:17.377755 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a882c329-e866-4d3a-8cf2-92f86c5a0a2c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:17.378498 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a882c329-e866-4d3a-8cf2-92f86c5a0a2c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:17.379131 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a882c329-e866-4d3a-8cf2-92f86c5a0a2c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:17.538185 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5bcebae8-93ff-4441-bb50-d059a5fa11d8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:17.547093 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5bcebae8-93ff-4441-bb50-d059a5fa11d8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23" status: 200 len: 1317 microversion: 2.1 time: 0.519948 Sep 10 12:04:17.547709 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2490/4983] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:17 2022] GET /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23 => generated 1317 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:17.567939 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5a7067af-5d8a-4904-bc0d-bb92d0f0442d tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:17.568578 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5a7067af-5d8a-4904-bc0d-bb92d0f0442d tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] [instance: 6f3b842d-0cd0-4656-a69a-d409e3628f13] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:17.595930 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5a7067af-5d8a-4904-bc0d-bb92d0f0442d tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:17.596806 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5a7067af-5d8a-4904-bc0d-bb92d0f0442d tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:17.597502 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5a7067af-5d8a-4904-bc0d-bb92d0f0442d tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:17.598872 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5a7067af-5d8a-4904-bc0d-bb92d0f0442d tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:17.600297 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5a7067af-5d8a-4904-bc0d-bb92d0f0442d tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:17.600998 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5a7067af-5d8a-4904-bc0d-bb92d0f0442d tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:17.809254 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a882c329-e866-4d3a-8cf2-92f86c5a0a2c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:17.820334 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a882c329-e866-4d3a-8cf2-92f86c5a0a2c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7" status: 200 len: 1309 microversion: 2.1 time: 0.466243 Sep 10 12:04:17.837901 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2494/4984] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:17 2022] GET /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7 => generated 1309 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:04:17.837901 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-a1bc66ac-bee2-4292-b56b-937552523713 req-96313ac2-e517-48b9-842a-77e276fe13e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4d4927f-4127-4a75-8c38-f462dda83d23", "name": "network-vif-plugged", "status": "completed", "tag": "876ef81d-0b12-446a-84b1-6e79a7232b38"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:17.861735 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a1bc66ac-bee2-4292-b56b-937552523713 req-96313ac2-e517-48b9-842a-77e276fe13e1 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:17.862688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a1bc66ac-bee2-4292-b56b-937552523713 req-96313ac2-e517-48b9-842a-77e276fe13e1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:17.863259 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a1bc66ac-bee2-4292-b56b-937552523713 req-96313ac2-e517-48b9-842a-77e276fe13e1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:17.891856 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-a1bc66ac-bee2-4292-b56b-937552523713 req-96313ac2-e517-48b9-842a-77e276fe13e1 service nova] Creating event network-vif-plugged:876ef81d-0b12-446a-84b1-6e79a7232b38 for instance d4d4927f-4127-4a75-8c38-f462dda83d23 on n-h2-856895-1 Sep 10 12:04:17.903888 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-a1bc66ac-bee2-4292-b56b-937552523713 req-96313ac2-e517-48b9-842a-77e276fe13e1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077027 Sep 10 12:04:17.905316 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2495/4985] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:04:17.915550 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e5266b28-abb3-42ab-91e1-224c1f48076f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:17.916794 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e5266b28-abb3-42ab-91e1-224c1f48076f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:17.925426 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e5266b28-abb3-42ab-91e1-224c1f48076f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:17.926233 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e5266b28-abb3-42ab-91e1-224c1f48076f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:17.927075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e5266b28-abb3-42ab-91e1-224c1f48076f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:17.928121 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e5266b28-abb3-42ab-91e1-224c1f48076f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:17.928947 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e5266b28-abb3-42ab-91e1-224c1f48076f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:17.929677 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e5266b28-abb3-42ab-91e1-224c1f48076f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:18.102477 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5a7067af-5d8a-4904-bc0d-bb92d0f0442d tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70a2fcdb2714a28a87e63f169ff9fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b377382724d7d877c6b989cfd7271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:18.117635 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5a7067af-5d8a-4904-bc0d-bb92d0f0442d tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] 10.222.0.23 "GET /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13" status: 200 len: 1509 microversion: 2.1 time: 0.553694 Sep 10 12:04:18.118519 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2491/4986] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:17 2022] GET /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13 => generated 1509 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:18.524970 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e5266b28-abb3-42ab-91e1-224c1f48076f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:18.534327 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e5266b28-abb3-42ab-91e1-224c1f48076f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1682 microversion: 2.1 time: 0.627430 Sep 10 12:04:18.545024 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2496/4987] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:17 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1682 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:18.570112 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0a1c3c3f-5cd2-44eb-90f4-7c1ac31c480b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:18.571129 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0a1c3c3f-5cd2-44eb-90f4-7c1ac31c480b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: d4d4927f-4127-4a75-8c38-f462dda83d23] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:18.584012 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0a1c3c3f-5cd2-44eb-90f4-7c1ac31c480b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:18.589153 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0a1c3c3f-5cd2-44eb-90f4-7c1ac31c480b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:18.589928 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0a1c3c3f-5cd2-44eb-90f4-7c1ac31c480b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:18.592900 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0a1c3c3f-5cd2-44eb-90f4-7c1ac31c480b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:18.593726 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0a1c3c3f-5cd2-44eb-90f4-7c1ac31c480b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:18.598084 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0a1c3c3f-5cd2-44eb-90f4-7c1ac31c480b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:18.845676 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5cac0145-960d-4c15-a912-c913c4491637 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:18.846592 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5cac0145-960d-4c15-a912-c913c4491637 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: eb38cda8-93a7-4327-944f-409c17070fd7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:18.858822 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5cac0145-960d-4c15-a912-c913c4491637 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:18.859639 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5cac0145-960d-4c15-a912-c913c4491637 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:18.860272 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5cac0145-960d-4c15-a912-c913c4491637 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:18.860976 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5cac0145-960d-4c15-a912-c913c4491637 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:18.861421 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5cac0145-960d-4c15-a912-c913c4491637 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:18.864826 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5cac0145-960d-4c15-a912-c913c4491637 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:19.432657 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5cac0145-960d-4c15-a912-c913c4491637 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:19.446320 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5cac0145-960d-4c15-a912-c913c4491637 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7" status: 200 len: 1309 microversion: 2.1 time: 0.600640 Sep 10 12:04:19.447534 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2497/4988] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:18 2022] GET /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7 => generated 1309 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:19.463099 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d74feb69-f45f-4bb0-9113-c146b913d0fb tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:19.464267 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d74feb69-f45f-4bb0-9113-c146b913d0fb tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] [instance: 6f3b842d-0cd0-4656-a69a-d409e3628f13] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:19.477083 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d74feb69-f45f-4bb0-9113-c146b913d0fb tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:19.478843 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d74feb69-f45f-4bb0-9113-c146b913d0fb tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:19.479329 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d74feb69-f45f-4bb0-9113-c146b913d0fb tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:19.483314 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d74feb69-f45f-4bb0-9113-c146b913d0fb tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:19.484330 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d74feb69-f45f-4bb0-9113-c146b913d0fb tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:19.484880 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d74feb69-f45f-4bb0-9113-c146b913d0fb tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:19.526870 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0a1c3c3f-5cd2-44eb-90f4-7c1ac31c480b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:19.542616 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0a1c3c3f-5cd2-44eb-90f4-7c1ac31c480b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23" status: 200 len: 1317 microversion: 2.1 time: 0.976354 Sep 10 12:04:19.551626 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2492/4989] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:18 2022] GET /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23 => generated 1317 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:19.571830 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-147be899-e102-43fc-a78a-297554be83dc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:19.572608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-147be899-e102-43fc-a78a-297554be83dc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:19.585071 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:04:19.599634 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-147be899-e102-43fc-a78a-297554be83dc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:19.601805 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-147be899-e102-43fc-a78a-297554be83dc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:19.604398 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-147be899-e102-43fc-a78a-297554be83dc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:19.606859 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-147be899-e102-43fc-a78a-297554be83dc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:19.611879 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-147be899-e102-43fc-a78a-297554be83dc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:19.616207 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-147be899-e102-43fc-a78a-297554be83dc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:19.898070 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d74feb69-f45f-4bb0-9113-c146b913d0fb tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e70a2fcdb2714a28a87e63f169ff9fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c06b377382724d7d877c6b989cfd7271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:19.938898 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d74feb69-f45f-4bb0-9113-c146b913d0fb tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] 10.222.0.23 "GET /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13" status: 200 len: 1467 microversion: 2.1 time: 0.489805 Sep 10 12:04:19.951075 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2498/4990] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:19 2022] GET /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13 => generated 1467 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:19.967828 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-2e561c0f-90bc-46f7-8b7a-ef964683b52d req-2835a507-4b78-4c5b-b35a-ee75ffa687a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f3b842d-0cd0-4656-a69a-d409e3628f13", "name": "network-vif-deleted", "tag": "d7eb6a17-8635-4fdb-888c-369f06fa03db"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:19.974604 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:04:20.002201 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-2e561c0f-90bc-46f7-8b7a-ef964683b52d req-2835a507-4b78-4c5b-b35a-ee75ffa687a1 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:20.010356 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-2e561c0f-90bc-46f7-8b7a-ef964683b52d req-2835a507-4b78-4c5b-b35a-ee75ffa687a1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:20.011025 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-2e561c0f-90bc-46f7-8b7a-ef964683b52d req-2835a507-4b78-4c5b-b35a-ee75ffa687a1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:20.050937 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-2e561c0f-90bc-46f7-8b7a-ef964683b52d req-2835a507-4b78-4c5b-b35a-ee75ffa687a1 service nova] Creating event network-vif-deleted:d7eb6a17-8635-4fdb-888c-369f06fa03db for instance 6f3b842d-0cd0-4656-a69a-d409e3628f13 on n-h2-856895-1 Sep 10 12:04:20.057503 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-2e561c0f-90bc-46f7-8b7a-ef964683b52d req-2835a507-4b78-4c5b-b35a-ee75ffa687a1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103045 Sep 10 12:04:20.069252 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2499/4991] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:04:20.227024 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-147be899-e102-43fc-a78a-297554be83dc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:20.238939 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-147be899-e102-43fc-a78a-297554be83dc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1682 microversion: 2.1 time: 0.671453 Sep 10 12:04:20.240989 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2493/4992] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:19 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1682 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:20.472194 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cacce7a3-c36e-4226-85d8-6bb5fec0af46 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:20.472907 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cacce7a3-c36e-4226-85d8-6bb5fec0af46 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: eb38cda8-93a7-4327-944f-409c17070fd7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:20.491524 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cacce7a3-c36e-4226-85d8-6bb5fec0af46 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:20.492014 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cacce7a3-c36e-4226-85d8-6bb5fec0af46 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:20.492447 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cacce7a3-c36e-4226-85d8-6bb5fec0af46 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:20.493143 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cacce7a3-c36e-4226-85d8-6bb5fec0af46 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:20.493594 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cacce7a3-c36e-4226-85d8-6bb5fec0af46 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:20.494021 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cacce7a3-c36e-4226-85d8-6bb5fec0af46 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:20.567079 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-afc47310-9004-4e4f-8fa3-93bc3338fc42 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:20.568373 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-afc47310-9004-4e4f-8fa3-93bc3338fc42 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: d4d4927f-4127-4a75-8c38-f462dda83d23] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:20.576489 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-afc47310-9004-4e4f-8fa3-93bc3338fc42 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:20.576988 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-afc47310-9004-4e4f-8fa3-93bc3338fc42 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:20.584441 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-afc47310-9004-4e4f-8fa3-93bc3338fc42 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:20.586677 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-afc47310-9004-4e4f-8fa3-93bc3338fc42 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:20.587546 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-afc47310-9004-4e4f-8fa3-93bc3338fc42 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:20.588581 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-afc47310-9004-4e4f-8fa3-93bc3338fc42 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:20.972017 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-afc47310-9004-4e4f-8fa3-93bc3338fc42 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:20.975201 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cacce7a3-c36e-4226-85d8-6bb5fec0af46 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:20.986047 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cacce7a3-c36e-4226-85d8-6bb5fec0af46 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7" status: 200 len: 1309 microversion: 2.1 time: 0.518171 Sep 10 12:04:20.987791 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2500/4993] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:20 2022] GET /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7 => generated 1309 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:20.992629 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e25e1c20-d413-4e04-a58c-a33f425686e2 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:20.993443 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e25e1c20-d413-4e04-a58c-a33f425686e2 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] [instance: 6f3b842d-0cd0-4656-a69a-d409e3628f13] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:21.000401 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e25e1c20-d413-4e04-a58c-a33f425686e2 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:21.000889 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e25e1c20-d413-4e04-a58c-a33f425686e2 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:21.001322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e25e1c20-d413-4e04-a58c-a33f425686e2 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:21.002232 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e25e1c20-d413-4e04-a58c-a33f425686e2 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:21.002686 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e25e1c20-d413-4e04-a58c-a33f425686e2 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:21.003337 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e25e1c20-d413-4e04-a58c-a33f425686e2 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:21.011912 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-afc47310-9004-4e4f-8fa3-93bc3338fc42 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23" status: 200 len: 1506 microversion: 2.1 time: 0.447232 Sep 10 12:04:21.013132 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2494/4994] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:20 2022] GET /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23 => generated 1506 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:04:21.036970 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-95bad2a2-7d58-4783-a916-ae9cae8d0862 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:21.037708 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-95bad2a2-7d58-4783-a916-ae9cae8d0862 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: d4d4927f-4127-4a75-8c38-f462dda83d23] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:21.041267 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-e25e1c20-d413-4e04-a58c-a33f425686e2 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] HTTP exception thrown: Instance 6f3b842d-0cd0-4656-a69a-d409e3628f13 could not be found. Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e25e1c20-d413-4e04-a58c-a33f425686e2 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Request method failure captured: Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13 HTTP/1.1 Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH0i41-owU4Y-NsaNCtTLkE5H4YX4f6XLai4oOQ9aAI4CtWQcgTW-4luOw8NWroxgmpji9qWtvamaubD9Ex393CFM3w6aXULcU_qeeYH88V5F6SMwzpdUBBDz755TfDCLKoa-LxmNYO4BEpiQTT5PHiM6etMdF4QVECXTgxBoVIJrYw Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: c06b377382724d7d877c6b989cfd7271 Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServerPasswordTestJSON-255182013 Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c06b377382724d7d877c6b989cfd7271"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c06b377382724d7d877c6b989cfd7271"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c06b377382724d7d877c6b989cfd7271", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c06b377382724d7d877c6b989cfd7271"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServerPasswordTestJSON-255182013 Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: c06b377382724d7d877c6b989cfd7271 Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServerPasswordTestJSON-255182013 Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServerPasswordTestJSON-255182013-project Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: e70a2fcdb2714a28a87e63f169ff9fc0 Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServerPasswordTestJSON-255182013-project Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 6f3b842d-0cd0-4656-a69a-d409e3628f13 could not be found. Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '6f3b842d-0cd0-4656-a69a-d409e3628f13'} Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f3b842d-0cd0-4656-a69a-d409e3628f13 could not be found. Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f3b842d-0cd0-4656-a69a-d409e3628f13 could not be found. Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:21.043283 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:21.048677 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:21.048677 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:21.048677 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:21.048677 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:04:21.048677 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:04:21.048677 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f3b842d-0cd0-4656-a69a-d409e3628f13 could not be found. Sep 10 12:04:21.048677 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:21.048677 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e25e1c20-d413-4e04-a58c-a33f425686e2 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] Returning 404 to user: Instance 6f3b842d-0cd0-4656-a69a-d409e3628f13 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:04:21.048677 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e25e1c20-d413-4e04-a58c-a33f425686e2 tempest-ServerPasswordTestJSON-255182013 tempest-ServerPasswordTestJSON-255182013-project] 10.222.0.23 "GET /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13" status: 404 len: 111 microversion: 2.1 time: 0.056372 Sep 10 12:04:21.048677 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2501/4995] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:20 2022] GET /compute/v2.1/servers/6f3b842d-0cd0-4656-a69a-d409e3628f13 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:04:21.049624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-95bad2a2-7d58-4783-a916-ae9cae8d0862 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:21.049624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-95bad2a2-7d58-4783-a916-ae9cae8d0862 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:21.049624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-95bad2a2-7d58-4783-a916-ae9cae8d0862 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:21.068615 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-95bad2a2-7d58-4783-a916-ae9cae8d0862 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:21.069222 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-95bad2a2-7d58-4783-a916-ae9cae8d0862 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:21.069680 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-95bad2a2-7d58-4783-a916-ae9cae8d0862 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:21.135469 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-95bad2a2-7d58-4783-a916-ae9cae8d0862 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: d4d4927f-4127-4a75-8c38-f462dda83d23] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:04:21.265349 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-73563c03-112c-4cf3-9910-999fc3a84161 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:21.266136 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-73563c03-112c-4cf3-9910-999fc3a84161 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:21.276925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-73563c03-112c-4cf3-9910-999fc3a84161 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:21.277434 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-73563c03-112c-4cf3-9910-999fc3a84161 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:21.278739 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-73563c03-112c-4cf3-9910-999fc3a84161 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:21.284135 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-73563c03-112c-4cf3-9910-999fc3a84161 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:21.284682 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-73563c03-112c-4cf3-9910-999fc3a84161 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:21.285147 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-73563c03-112c-4cf3-9910-999fc3a84161 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:21.375428 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-95bad2a2-7d58-4783-a916-ae9cae8d0862 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23" status: 204 len: 0 microversion: 2.1 time: 0.338189 Sep 10 12:04:21.379937 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2495/4996] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:04:21 2022] DELETE /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 12:04:21.392596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-163a9de0-6c6a-44a6-8db0-6d9ae0f93063 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:21.394742 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-163a9de0-6c6a-44a6-8db0-6d9ae0f93063 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: d4d4927f-4127-4a75-8c38-f462dda83d23] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:21.415641 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-163a9de0-6c6a-44a6-8db0-6d9ae0f93063 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:21.416980 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-163a9de0-6c6a-44a6-8db0-6d9ae0f93063 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:21.419869 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-163a9de0-6c6a-44a6-8db0-6d9ae0f93063 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:21.420684 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-163a9de0-6c6a-44a6-8db0-6d9ae0f93063 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:21.421173 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-163a9de0-6c6a-44a6-8db0-6d9ae0f93063 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:21.421624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-163a9de0-6c6a-44a6-8db0-6d9ae0f93063 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:21.810516 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-73563c03-112c-4cf3-9910-999fc3a84161 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:21.817152 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-163a9de0-6c6a-44a6-8db0-6d9ae0f93063 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:21.823630 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-73563c03-112c-4cf3-9910-999fc3a84161 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1682 microversion: 2.1 time: 0.563126 Sep 10 12:04:21.827642 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-163a9de0-6c6a-44a6-8db0-6d9ae0f93063 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23" status: 200 len: 1512 microversion: 2.1 time: 0.445660 Sep 10 12:04:21.828131 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2502/4997] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:21 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1682 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:04:21.830687 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2496/4998] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:21 2022] GET /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23 => generated 1512 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:21.857728 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-b691a6d1-60c4-4c3a-a0c6-55ddd406bb69 req-2604c478-4cc4-4258-b52a-075f0c1a0f3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb38cda8-93a7-4327-944f-409c17070fd7", "name": "network-vif-plugged", "status": "completed", "tag": "81f9fb2f-8546-4237-ad5a-a2d6393c633d"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:21.877148 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-b691a6d1-60c4-4c3a-a0c6-55ddd406bb69 req-2604c478-4cc4-4258-b52a-075f0c1a0f3a service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:21.877941 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-b691a6d1-60c4-4c3a-a0c6-55ddd406bb69 req-2604c478-4cc4-4258-b52a-075f0c1a0f3a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:21.878557 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-b691a6d1-60c4-4c3a-a0c6-55ddd406bb69 req-2604c478-4cc4-4258-b52a-075f0c1a0f3a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:21.893467 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-b691a6d1-60c4-4c3a-a0c6-55ddd406bb69 req-2604c478-4cc4-4258-b52a-075f0c1a0f3a service nova] Creating event network-vif-plugged:81f9fb2f-8546-4237-ad5a-a2d6393c633d for instance eb38cda8-93a7-4327-944f-409c17070fd7 on n-h1-856895-1 Sep 10 12:04:21.900272 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-b691a6d1-60c4-4c3a-a0c6-55ddd406bb69 req-2604c478-4cc4-4258-b52a-075f0c1a0f3a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058140 Sep 10 12:04:21.901591 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2503/4999] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:04:22.015773 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-109d17b2-6ed6-4a48-82fb-f80e8048c90b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:22.016798 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-109d17b2-6ed6-4a48-82fb-f80e8048c90b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: eb38cda8-93a7-4327-944f-409c17070fd7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:22.026496 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-109d17b2-6ed6-4a48-82fb-f80e8048c90b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:22.027388 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-109d17b2-6ed6-4a48-82fb-f80e8048c90b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:22.028134 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-109d17b2-6ed6-4a48-82fb-f80e8048c90b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:22.029175 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-109d17b2-6ed6-4a48-82fb-f80e8048c90b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:22.029858 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-109d17b2-6ed6-4a48-82fb-f80e8048c90b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:22.030511 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-109d17b2-6ed6-4a48-82fb-f80e8048c90b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:22.332537 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-109d17b2-6ed6-4a48-82fb-f80e8048c90b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:22.346262 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-109d17b2-6ed6-4a48-82fb-f80e8048c90b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7" status: 200 len: 1309 microversion: 2.1 time: 0.337614 Sep 10 12:04:22.347483 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2497/5000] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:22 2022] GET /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7 => generated 1309 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:22.851107 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cffe87d4-3ff8-42c4-b701-74d956ec91bf tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:22.851888 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cffe87d4-3ff8-42c4-b701-74d956ec91bf tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:22.854134 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-755f91e7-e817-44b6-b952-2cc184b9ee79 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:22.855312 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-755f91e7-e817-44b6-b952-2cc184b9ee79 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: d4d4927f-4127-4a75-8c38-f462dda83d23] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:22.862966 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cffe87d4-3ff8-42c4-b701-74d956ec91bf tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:22.863508 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cffe87d4-3ff8-42c4-b701-74d956ec91bf tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:22.863955 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cffe87d4-3ff8-42c4-b701-74d956ec91bf tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:22.864678 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cffe87d4-3ff8-42c4-b701-74d956ec91bf tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:22.865142 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cffe87d4-3ff8-42c4-b701-74d956ec91bf tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:22.865578 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cffe87d4-3ff8-42c4-b701-74d956ec91bf tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:22.870142 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-755f91e7-e817-44b6-b952-2cc184b9ee79 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:22.873507 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-755f91e7-e817-44b6-b952-2cc184b9ee79 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:22.874272 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-755f91e7-e817-44b6-b952-2cc184b9ee79 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:22.876374 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-755f91e7-e817-44b6-b952-2cc184b9ee79 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:22.879456 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-755f91e7-e817-44b6-b952-2cc184b9ee79 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:22.880224 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-755f91e7-e817-44b6-b952-2cc184b9ee79 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:23.470196 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cffe87d4-3ff8-42c4-b701-74d956ec91bf tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:23.478283 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cffe87d4-3ff8-42c4-b701-74d956ec91bf tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1682 microversion: 2.1 time: 0.631979 Sep 10 12:04:23.492041 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2504/5001] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:22 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1682 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:23.502428 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e263f68a-1f15-4c81-8814-dc6058b4dc4d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:23.503368 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e263f68a-1f15-4c81-8814-dc6058b4dc4d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: eb38cda8-93a7-4327-944f-409c17070fd7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:23.509723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e263f68a-1f15-4c81-8814-dc6058b4dc4d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:23.510487 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e263f68a-1f15-4c81-8814-dc6058b4dc4d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:23.511868 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e263f68a-1f15-4c81-8814-dc6058b4dc4d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:23.512940 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e263f68a-1f15-4c81-8814-dc6058b4dc4d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:23.513685 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e263f68a-1f15-4c81-8814-dc6058b4dc4d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:23.514292 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e263f68a-1f15-4c81-8814-dc6058b4dc4d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:23.561740 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:04:23.577943 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-755f91e7-e817-44b6-b952-2cc184b9ee79 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:23.589761 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-755f91e7-e817-44b6-b952-2cc184b9ee79 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23" status: 200 len: 1512 microversion: 2.1 time: 0.739804 Sep 10 12:04:23.594257 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2498/5002] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:22 2022] GET /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23 => generated 1512 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:04:23.967917 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e263f68a-1f15-4c81-8814-dc6058b4dc4d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:23.981898 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e263f68a-1f15-4c81-8814-dc6058b4dc4d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7" status: 200 len: 1309 microversion: 2.1 time: 0.487865 Sep 10 12:04:23.982540 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2505/5003] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:23 2022] GET /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7 => generated 1309 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:24.349441 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-ec18dc62-3a6d-47ec-8dd6-1afa2ebb6149 req-7d05b552-3811-4123-b7ce-98535aa14a7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4d4927f-4127-4a75-8c38-f462dda83d23", "name": "network-vif-deleted", "tag": "876ef81d-0b12-446a-84b1-6e79a7232b38"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:24.374579 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ec18dc62-3a6d-47ec-8dd6-1afa2ebb6149 req-7d05b552-3811-4123-b7ce-98535aa14a7d service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:24.375466 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ec18dc62-3a6d-47ec-8dd6-1afa2ebb6149 req-7d05b552-3811-4123-b7ce-98535aa14a7d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:24.376095 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ec18dc62-3a6d-47ec-8dd6-1afa2ebb6149 req-7d05b552-3811-4123-b7ce-98535aa14a7d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:24.381298 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:04:24.392146 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-ec18dc62-3a6d-47ec-8dd6-1afa2ebb6149 req-7d05b552-3811-4123-b7ce-98535aa14a7d service nova] Creating event network-vif-deleted:876ef81d-0b12-446a-84b1-6e79a7232b38 for instance d4d4927f-4127-4a75-8c38-f462dda83d23 on n-h2-856895-1 Sep 10 12:04:24.404682 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-ec18dc62-3a6d-47ec-8dd6-1afa2ebb6149 req-7d05b552-3811-4123-b7ce-98535aa14a7d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058816 Sep 10 12:04:24.406092 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2499/5004] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:04:24.508341 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d217f4e1-7815-4387-bced-ee11d995c0f7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:24.508987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d217f4e1-7815-4387-bced-ee11d995c0f7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:24.518401 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d217f4e1-7815-4387-bced-ee11d995c0f7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:24.519358 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d217f4e1-7815-4387-bced-ee11d995c0f7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:24.520324 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d217f4e1-7815-4387-bced-ee11d995c0f7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:24.521647 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d217f4e1-7815-4387-bced-ee11d995c0f7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:24.522355 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d217f4e1-7815-4387-bced-ee11d995c0f7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:24.523010 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d217f4e1-7815-4387-bced-ee11d995c0f7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:24.618090 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8315fcc8-5cfe-4fb1-abe2-e94abbd5d75f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:24.618803 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8315fcc8-5cfe-4fb1-abe2-e94abbd5d75f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: d4d4927f-4127-4a75-8c38-f462dda83d23] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:24.634193 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8315fcc8-5cfe-4fb1-abe2-e94abbd5d75f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:24.634685 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8315fcc8-5cfe-4fb1-abe2-e94abbd5d75f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:24.635126 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8315fcc8-5cfe-4fb1-abe2-e94abbd5d75f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:24.638298 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8315fcc8-5cfe-4fb1-abe2-e94abbd5d75f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:24.638959 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8315fcc8-5cfe-4fb1-abe2-e94abbd5d75f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:24.639429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8315fcc8-5cfe-4fb1-abe2-e94abbd5d75f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:24.738860 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8315fcc8-5cfe-4fb1-abe2-e94abbd5d75f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:24.739633 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8315fcc8-5cfe-4fb1-abe2-e94abbd5d75f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:24.740239 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8315fcc8-5cfe-4fb1-abe2-e94abbd5d75f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:24.740918 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-8315fcc8-5cfe-4fb1-abe2-e94abbd5d75f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lazy-loading 'fault' on Instance uuid d4d4927f-4127-4a75-8c38-f462dda83d23 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:04:25.205264 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8315fcc8-5cfe-4fb1-abe2-e94abbd5d75f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:25.217249 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8315fcc8-5cfe-4fb1-abe2-e94abbd5d75f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23" status: 200 len: 1307 microversion: 2.1 time: 0.604018 Sep 10 12:04:25.217851 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2500/5005] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:24 2022] GET /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23 => generated 1307 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:25.226953 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6d4bf7ea-1d7c-4cde-9e77-52305b96da4e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:25.232296 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6d4bf7ea-1d7c-4cde-9e77-52305b96da4e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: eb38cda8-93a7-4327-944f-409c17070fd7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:25.248420 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6d4bf7ea-1d7c-4cde-9e77-52305b96da4e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:25.251987 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6d4bf7ea-1d7c-4cde-9e77-52305b96da4e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:25.252988 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6d4bf7ea-1d7c-4cde-9e77-52305b96da4e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:25.253991 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6d4bf7ea-1d7c-4cde-9e77-52305b96da4e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:25.254635 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6d4bf7ea-1d7c-4cde-9e77-52305b96da4e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:25.257913 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6d4bf7ea-1d7c-4cde-9e77-52305b96da4e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:25.629148 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d217f4e1-7815-4387-bced-ee11d995c0f7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:25.641812 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d217f4e1-7815-4387-bced-ee11d995c0f7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1682 microversion: 2.1 time: 1.137890 Sep 10 12:04:25.647468 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2506/5006] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:24 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1682 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:25.775341 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6d4bf7ea-1d7c-4cde-9e77-52305b96da4e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:25.790389 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6d4bf7ea-1d7c-4cde-9e77-52305b96da4e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7" status: 200 len: 1491 microversion: 2.1 time: 0.566163 Sep 10 12:04:25.792716 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2501/5007] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:25 2022] GET /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7 => generated 1491 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:25.819713 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a293e30d-af1b-4943-80bc-29d14bad5880 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:25.824221 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a293e30d-af1b-4943-80bc-29d14bad5880 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: eb38cda8-93a7-4327-944f-409c17070fd7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:25.841903 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a293e30d-af1b-4943-80bc-29d14bad5880 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:25.842533 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a293e30d-af1b-4943-80bc-29d14bad5880 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:25.843201 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a293e30d-af1b-4943-80bc-29d14bad5880 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:25.844146 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a293e30d-af1b-4943-80bc-29d14bad5880 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:25.846585 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a293e30d-af1b-4943-80bc-29d14bad5880 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:25.847151 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a293e30d-af1b-4943-80bc-29d14bad5880 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:25.999155 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a293e30d-af1b-4943-80bc-29d14bad5880 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "PUT /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7" status: 200 len: 1086 microversion: 2.1 time: 0.183774 Sep 10 12:04:26.000615 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2507/5008] 10.222.0.23 () {60 vars in 1256 bytes} [Sat Sep 10 12:04:25 2022] PUT /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7 => generated 1086 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:04:26.020794 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-443a33db-51e6-484b-b4ce-0e570a727189 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:26.022199 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-443a33db-51e6-484b-b4ce-0e570a727189 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: eb38cda8-93a7-4327-944f-409c17070fd7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:26.037509 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-443a33db-51e6-484b-b4ce-0e570a727189 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:26.038002 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-443a33db-51e6-484b-b4ce-0e570a727189 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:26.038854 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-443a33db-51e6-484b-b4ce-0e570a727189 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:26.039989 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-443a33db-51e6-484b-b4ce-0e570a727189 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:26.040453 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-443a33db-51e6-484b-b4ce-0e570a727189 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:26.040878 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-443a33db-51e6-484b-b4ce-0e570a727189 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:26.244658 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-25f3de4c-6236-4bbf-8198-437857c75357 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:26.245682 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-25f3de4c-6236-4bbf-8198-437857c75357 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: d4d4927f-4127-4a75-8c38-f462dda83d23] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:26.252687 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25f3de4c-6236-4bbf-8198-437857c75357 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:26.253514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25f3de4c-6236-4bbf-8198-437857c75357 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:26.254449 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25f3de4c-6236-4bbf-8198-437857c75357 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:26.255447 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25f3de4c-6236-4bbf-8198-437857c75357 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:26.255966 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25f3de4c-6236-4bbf-8198-437857c75357 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:26.256629 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25f3de4c-6236-4bbf-8198-437857c75357 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:26.281490 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-25f3de4c-6236-4bbf-8198-437857c75357 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] HTTP exception thrown: Instance d4d4927f-4127-4a75-8c38-f462dda83d23 could not be found. Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-25f3de4c-6236-4bbf-8198-437857c75357 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23 HTTP/1.1 Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance d4d4927f-4127-4a75-8c38-f462dda83d23 could not be found. Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'd4d4927f-4127-4a75-8c38-f462dda83d23'} Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4d4927f-4127-4a75-8c38-f462dda83d23 could not be found. Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4d4927f-4127-4a75-8c38-f462dda83d23 could not be found. Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:26.284118 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:26.291521 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:26.291521 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:26.291521 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:26.291521 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:04:26.291521 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:04:26.291521 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4d4927f-4127-4a75-8c38-f462dda83d23 could not be found. Sep 10 12:04:26.291521 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:26.292886 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-25f3de4c-6236-4bbf-8198-437857c75357 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 404 to user: Instance d4d4927f-4127-4a75-8c38-f462dda83d23 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:04:26.295358 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-25f3de4c-6236-4bbf-8198-437857c75357 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23" status: 404 len: 111 microversion: 2.1 time: 0.054476 Sep 10 12:04:26.296791 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2508/5009] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:26 2022] GET /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 12:04:26.306588 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0b3126bf-9f61-43c9-871c-8467e5bcf982 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:26.307584 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0b3126bf-9f61-43c9-871c-8467e5bcf982 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:26.314335 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0b3126bf-9f61-43c9-871c-8467e5bcf982 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:26.315072 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0b3126bf-9f61-43c9-871c-8467e5bcf982 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:26.315800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0b3126bf-9f61-43c9-871c-8467e5bcf982 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:26.316715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0b3126bf-9f61-43c9-871c-8467e5bcf982 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:26.317392 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0b3126bf-9f61-43c9-871c-8467e5bcf982 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:26.318427 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0b3126bf-9f61-43c9-871c-8467e5bcf982 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:26.472590 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-443a33db-51e6-484b-b4ce-0e570a727189 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:26.487994 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-443a33db-51e6-484b-b4ce-0e570a727189 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7" status: 200 len: 1512 microversion: 2.1 time: 0.471187 Sep 10 12:04:26.489215 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2502/5010] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:26 2022] GET /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7 => generated 1512 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:26.515830 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9e35e068-941d-40d8-8b30-d306666c534c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:26.516840 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9e35e068-941d-40d8-8b30-d306666c534c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: eb38cda8-93a7-4327-944f-409c17070fd7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:26.525925 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9e35e068-941d-40d8-8b30-d306666c534c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:26.529156 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9e35e068-941d-40d8-8b30-d306666c534c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:26.529878 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9e35e068-941d-40d8-8b30-d306666c534c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:26.530862 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9e35e068-941d-40d8-8b30-d306666c534c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:26.531604 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9e35e068-941d-40d8-8b30-d306666c534c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:26.535716 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9e35e068-941d-40d8-8b30-d306666c534c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:26.786804 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0b3126bf-9f61-43c9-871c-8467e5bcf982 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:26.797930 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0b3126bf-9f61-43c9-871c-8467e5bcf982 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.495592 Sep 10 12:04:26.818283 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2509/5011] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:26 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:26.819088 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1a42064b-9b97-416b-9349-80004cb589db tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:26.821442 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1a42064b-9b97-416b-9349-80004cb589db tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:26.832010 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1a42064b-9b97-416b-9349-80004cb589db tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:26.832557 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1a42064b-9b97-416b-9349-80004cb589db tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:26.833256 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1a42064b-9b97-416b-9349-80004cb589db tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:26.834527 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1a42064b-9b97-416b-9349-80004cb589db tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:26.835806 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1a42064b-9b97-416b-9349-80004cb589db tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:26.836494 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1a42064b-9b97-416b-9349-80004cb589db tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:26.930092 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9e35e068-941d-40d8-8b30-d306666c534c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:26.939143 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9e35e068-941d-40d8-8b30-d306666c534c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7" status: 200 len: 1512 microversion: 2.1 time: 0.427329 Sep 10 12:04:26.940013 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2503/5012] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:26 2022] GET /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7 => generated 1512 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:04:26.952034 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-22fe092c-ae9c-4b34-8d82-8be47ffaea26 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "4cf2efdb-facd-4d46-b962-78192cf2010f"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-22fe092c-ae9c-4b34-8d82-8be47ffaea26 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 163 Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: {"server": {"name": 12345, "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "4cf2efdb-facd-4d46-b962-78192cf2010f"}]}} Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'c23d4d62-7ab9-4623-9273-7f44582aa2e1', 'flavorRef': '452', 'networks': [{'uuid': '4cf2efdb-facd-4d46-b962-78192cf2010f'}]}}} Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise error Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 12345 Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 12:04:26.967121 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 12:04:26.972733 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 12:04:26.972733 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 10 12:04:26.972733 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:26.972733 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:26.972733 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:26.972733 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:26.972733 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:26.972733 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:26.972733 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 12:04:26.972733 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 12:04:26.972733 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 10 12:04:26.972733 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:26.973992 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-22fe092c-ae9c-4b34-8d82-8be47ffaea26 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:04:26.975052 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-22fe092c-ae9c-4b34-8d82-8be47ffaea26 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.033784 Sep 10 12:04:26.975764 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2504/5013] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:04:26 2022] POST /compute/v2.1/servers => generated 127 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 12:04:26.982693 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-89f40ccd-0559-4dbd-83e2-e8847c669efc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:26.983655 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-89f40ccd-0559-4dbd-83e2-e8847c669efc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: eb38cda8-93a7-4327-944f-409c17070fd7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:26.991739 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89f40ccd-0559-4dbd-83e2-e8847c669efc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:26.992706 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89f40ccd-0559-4dbd-83e2-e8847c669efc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:26.993397 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89f40ccd-0559-4dbd-83e2-e8847c669efc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:27.007951 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89f40ccd-0559-4dbd-83e2-e8847c669efc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:27.008791 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89f40ccd-0559-4dbd-83e2-e8847c669efc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:27.012643 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89f40ccd-0559-4dbd-83e2-e8847c669efc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:27.075621 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-89f40ccd-0559-4dbd-83e2-e8847c669efc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: eb38cda8-93a7-4327-944f-409c17070fd7] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:04:27.266694 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-89f40ccd-0559-4dbd-83e2-e8847c669efc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "DELETE /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7" status: 204 len: 0 microversion: 2.1 time: 0.287996 Sep 10 12:04:27.268564 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2505/5014] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:04:26 2022] DELETE /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:04:27.275622 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-09332b9c-621e-4f25-97a7-dc3b1f70bfa1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:27.276438 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-09332b9c-621e-4f25-97a7-dc3b1f70bfa1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:27.285676 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-09332b9c-621e-4f25-97a7-dc3b1f70bfa1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:27.287012 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-09332b9c-621e-4f25-97a7-dc3b1f70bfa1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:27.288337 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-09332b9c-621e-4f25-97a7-dc3b1f70bfa1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:27.290531 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-09332b9c-621e-4f25-97a7-dc3b1f70bfa1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:27.291262 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-09332b9c-621e-4f25-97a7-dc3b1f70bfa1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:27.291730 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-09332b9c-621e-4f25-97a7-dc3b1f70bfa1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:27.319457 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1a42064b-9b97-416b-9349-80004cb589db tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:27.331942 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1a42064b-9b97-416b-9349-80004cb589db tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1682 microversion: 2.1 time: 0.520633 Sep 10 12:04:27.335284 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2510/5015] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:26 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1682 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:27.346218 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-25647d63-85f4-49b3-a8e6-ee6c2037edbe tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:27.347106 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-25647d63-85f4-49b3-a8e6-ee6c2037edbe tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: eb38cda8-93a7-4327-944f-409c17070fd7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:27.357909 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25647d63-85f4-49b3-a8e6-ee6c2037edbe tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:27.358407 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25647d63-85f4-49b3-a8e6-ee6c2037edbe tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:27.358849 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25647d63-85f4-49b3-a8e6-ee6c2037edbe tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:27.359750 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25647d63-85f4-49b3-a8e6-ee6c2037edbe tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:27.360508 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25647d63-85f4-49b3-a8e6-ee6c2037edbe tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:27.361737 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25647d63-85f4-49b3-a8e6-ee6c2037edbe tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:27.696730 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-09332b9c-621e-4f25-97a7-dc3b1f70bfa1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:27.706154 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-09332b9c-621e-4f25-97a7-dc3b1f70bfa1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.436200 Sep 10 12:04:27.706763 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2506/5016] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:27 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:27.737203 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0581b804-ad4b-4005-a0c2-fee8e2d4c2ca tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:27.745199 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0581b804-ad4b-4005-a0c2-fee8e2d4c2ca tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:27.759084 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0581b804-ad4b-4005-a0c2-fee8e2d4c2ca tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:27.759794 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0581b804-ad4b-4005-a0c2-fee8e2d4c2ca tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:27.761316 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0581b804-ad4b-4005-a0c2-fee8e2d4c2ca tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:27.768584 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0581b804-ad4b-4005-a0c2-fee8e2d4c2ca tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:27.768992 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0581b804-ad4b-4005-a0c2-fee8e2d4c2ca tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:27.769535 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0581b804-ad4b-4005-a0c2-fee8e2d4c2ca tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:27.770891 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-25647d63-85f4-49b3-a8e6-ee6c2037edbe tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:27.787019 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-25647d63-85f4-49b3-a8e6-ee6c2037edbe tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7" status: 200 len: 1518 microversion: 2.1 time: 0.449993 Sep 10 12:04:27.787690 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2511/5017] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:27 2022] GET /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7 => generated 1518 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:28.050819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0581b804-ad4b-4005-a0c2-fee8e2d4c2ca tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:28.068036 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0581b804-ad4b-4005-a0c2-fee8e2d4c2ca tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.336869 Sep 10 12:04:28.086356 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2507/5018] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:27 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:04:28.360611 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7e22d9fe-2ca4-4120-a3ff-570713452e5a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:28.361515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7e22d9fe-2ca4-4120-a3ff-570713452e5a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:28.379321 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e22d9fe-2ca4-4120-a3ff-570713452e5a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:28.380288 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e22d9fe-2ca4-4120-a3ff-570713452e5a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:28.380959 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e22d9fe-2ca4-4120-a3ff-570713452e5a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:28.381990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e22d9fe-2ca4-4120-a3ff-570713452e5a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:28.382691 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e22d9fe-2ca4-4120-a3ff-570713452e5a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:28.383511 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e22d9fe-2ca4-4120-a3ff-570713452e5a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:28.678457 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7e22d9fe-2ca4-4120-a3ff-570713452e5a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:28.688217 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7e22d9fe-2ca4-4120-a3ff-570713452e5a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1659 microversion: 2.1 time: 0.334112 Sep 10 12:04:28.693821 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2512/5019] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:28 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1659 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:28.719798 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-883e00a5-04c9-4802-8e8c-ce7257cecca2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:28.730009 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-883e00a5-04c9-4802-8e8c-ce7257cecca2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:28.730959 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-883e00a5-04c9-4802-8e8c-ce7257cecca2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:28.731669 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-883e00a5-04c9-4802-8e8c-ce7257cecca2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:28.769436 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-883e00a5-04c9-4802-8e8c-ce7257cecca2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Going to try to start instance {{(pid=128776) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 10 12:04:28.814082 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cf06df5d-398b-4674-89e8-132832dfaeb0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:28.815069 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cf06df5d-398b-4674-89e8-132832dfaeb0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: eb38cda8-93a7-4327-944f-409c17070fd7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:28.833875 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cf06df5d-398b-4674-89e8-132832dfaeb0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:28.834554 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cf06df5d-398b-4674-89e8-132832dfaeb0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:28.836022 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cf06df5d-398b-4674-89e8-132832dfaeb0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:28.837871 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cf06df5d-398b-4674-89e8-132832dfaeb0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:28.839764 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cf06df5d-398b-4674-89e8-132832dfaeb0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:28.841506 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cf06df5d-398b-4674-89e8-132832dfaeb0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:28.894923 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-883e00a5-04c9-4802-8e8c-ce7257cecca2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "POST /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f/action" status: 202 len: 0 microversion: 2.1 time: 0.175706 Sep 10 12:04:28.904230 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2508/5020] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:04:28 2022] POST /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:04:28.932242 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-64977ffc-5ccb-458a-964c-e5c273a4fb2e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:28.934683 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-64977ffc-5ccb-458a-964c-e5c273a4fb2e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:28.951781 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-64977ffc-5ccb-458a-964c-e5c273a4fb2e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:28.955444 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-64977ffc-5ccb-458a-964c-e5c273a4fb2e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:28.955999 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-64977ffc-5ccb-458a-964c-e5c273a4fb2e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:28.956971 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-64977ffc-5ccb-458a-964c-e5c273a4fb2e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:28.957443 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-64977ffc-5ccb-458a-964c-e5c273a4fb2e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:28.957886 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-64977ffc-5ccb-458a-964c-e5c273a4fb2e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:29.682468 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cf06df5d-398b-4674-89e8-132832dfaeb0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:29.694542 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cf06df5d-398b-4674-89e8-132832dfaeb0 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7" status: 200 len: 1518 microversion: 2.1 time: 0.886525 Sep 10 12:04:29.695239 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2513/5021] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:28 2022] GET /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7 => generated 1518 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:29.747363 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-64977ffc-5ccb-458a-964c-e5c273a4fb2e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:29.757845 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-64977ffc-5ccb-458a-964c-e5c273a4fb2e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1668 microversion: 2.1 time: 0.850437 Sep 10 12:04:29.771992 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2509/5022] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:28 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1668 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:30.725761 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-97c66179-deee-46be-990a-e9a87c6e831e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:30.727288 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-97c66179-deee-46be-990a-e9a87c6e831e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: eb38cda8-93a7-4327-944f-409c17070fd7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:30.739021 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-97c66179-deee-46be-990a-e9a87c6e831e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:30.739905 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-97c66179-deee-46be-990a-e9a87c6e831e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:30.740611 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-97c66179-deee-46be-990a-e9a87c6e831e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:30.742330 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-97c66179-deee-46be-990a-e9a87c6e831e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:30.743053 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-97c66179-deee-46be-990a-e9a87c6e831e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:30.743755 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-97c66179-deee-46be-990a-e9a87c6e831e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:30.785417 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-881f61c2-81b1-4aa3-920e-32cdb759d3ef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:30.786853 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-881f61c2-81b1-4aa3-920e-32cdb759d3ef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:30.801713 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-881f61c2-81b1-4aa3-920e-32cdb759d3ef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:30.803483 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-881f61c2-81b1-4aa3-920e-32cdb759d3ef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:30.804174 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-881f61c2-81b1-4aa3-920e-32cdb759d3ef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:30.807527 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-881f61c2-81b1-4aa3-920e-32cdb759d3ef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:30.809108 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-881f61c2-81b1-4aa3-920e-32cdb759d3ef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:30.809836 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-881f61c2-81b1-4aa3-920e-32cdb759d3ef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:31.416866 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-881f61c2-81b1-4aa3-920e-32cdb759d3ef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:31.428407 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-881f61c2-81b1-4aa3-920e-32cdb759d3ef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1668 microversion: 2.1 time: 0.647730 Sep 10 12:04:31.431362 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2510/5023] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:30 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1668 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:31.462988 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-106d9409-48c8-4a8d-8346-1504df52f2bb tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-981757020", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "5c6bff80-9c48-47ec-b8a4-e0f30076e79c", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "4cf2efdb-facd-4d46-b962-78192cf2010f"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:31.542614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-97c66179-deee-46be-990a-e9a87c6e831e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:31.553173 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-97c66179-deee-46be-990a-e9a87c6e831e tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7" status: 200 len: 1518 microversion: 2.1 time: 0.834105 Sep 10 12:04:31.569963 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2514/5024] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:30 2022] GET /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7 => generated 1518 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:31.604425 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-106d9409-48c8-4a8d-8346-1504df52f2bb tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] HTTP exception thrown: Block Device 5c6bff80-9c48-47ec-b8a4-e0f30076e79c is not bootable. Sep 10 12:04:31.612632 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-9858977d-088b-400a-be31-164726ce70d4 req-342925b9-dcb7-4a83-b2e1-e9650ec38afc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb38cda8-93a7-4327-944f-409c17070fd7", "name": "network-vif-deleted", "tag": "81f9fb2f-8546-4237-ad5a-a2d6393c633d"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-106d9409-48c8-4a8d-8346-1504df52f2bb tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 357 Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-981757020", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "5c6bff80-9c48-47ec-b8a4-e0f30076e79c", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "4cf2efdb-facd-4d46-b962-78192cf2010f"}]}} Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: exception: Block Device 5c6bff80-9c48-47ec-b8a4-e0f30076e79c is not bootable. Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-981757020', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '5c6bff80-9c48-47ec-b8a4-e0f30076e79c'}], 'networks': [{'uuid': '4cf2efdb-facd-4d46-b962-78192cf2010f'}]}}} Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 5c6bff80-9c48-47ec-b8a4-e0f30076e79c is not bootable. Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:04:31.619326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:04:31.626528 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:04:31.626528 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:04:31.626528 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:04:31.626528 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 10 12:04:31.626528 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 10 12:04:31.626528 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 10 12:04:31.626528 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 5c6bff80-9c48-47ec-b8a4-e0f30076e79c is not bootable. Sep 10 12:04:31.626528 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:31.626528 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:31.626528 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:31.626528 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:31.626528 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:31.626528 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:31.626528 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:04:31.626528 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:04:31.626528 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 5c6bff80-9c48-47ec-b8a4-e0f30076e79c is not bootable. Sep 10 12:04:31.626528 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:31.630388 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-106d9409-48c8-4a8d-8346-1504df52f2bb tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 400 to user: Block Device 5c6bff80-9c48-47ec-b8a4-e0f30076e79c is not bootable. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:04:31.631625 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-106d9409-48c8-4a8d-8346-1504df52f2bb tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.182243 Sep 10 12:04:31.632464 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2511/5025] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:04:31 2022] POST /compute/v2.1/servers => generated 110 bytes in 200 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 12:04:31.641685 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-9858977d-088b-400a-be31-164726ce70d4 req-342925b9-dcb7-4a83-b2e1-e9650ec38afc service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:31.642173 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-9858977d-088b-400a-be31-164726ce70d4 req-342925b9-dcb7-4a83-b2e1-e9650ec38afc service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:31.644709 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-9858977d-088b-400a-be31-164726ce70d4 req-342925b9-dcb7-4a83-b2e1-e9650ec38afc service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:31.655847 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bb530e8e-8acc-4dcd-8a10-6a39394ebf45 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:31.656687 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bb530e8e-8acc-4dcd-8a10-6a39394ebf45 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:31.671601 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-9858977d-088b-400a-be31-164726ce70d4 req-342925b9-dcb7-4a83-b2e1-e9650ec38afc service nova] Creating event network-vif-deleted:81f9fb2f-8546-4237-ad5a-a2d6393c633d for instance eb38cda8-93a7-4327-944f-409c17070fd7 on n-h1-856895-1 Sep 10 12:04:31.682895 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-9858977d-088b-400a-be31-164726ce70d4 req-342925b9-dcb7-4a83-b2e1-e9650ec38afc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111367 Sep 10 12:04:31.684552 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bb530e8e-8acc-4dcd-8a10-6a39394ebf45 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:31.685086 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bb530e8e-8acc-4dcd-8a10-6a39394ebf45 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:31.685495 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2515/5026] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:04:31.685622 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bb530e8e-8acc-4dcd-8a10-6a39394ebf45 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:31.686250 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bb530e8e-8acc-4dcd-8a10-6a39394ebf45 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:31.695912 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bb530e8e-8acc-4dcd-8a10-6a39394ebf45 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:31.698701 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bb530e8e-8acc-4dcd-8a10-6a39394ebf45 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:32.220173 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bb530e8e-8acc-4dcd-8a10-6a39394ebf45 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:32.230342 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bb530e8e-8acc-4dcd-8a10-6a39394ebf45 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.593287 Sep 10 12:04:32.243862 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2512/5027] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:31 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:04:32.268756 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d3b59bb0-d9f1-441d-bea3-e22a7fb6cef8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:32.270206 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d3b59bb0-d9f1-441d-bea3-e22a7fb6cef8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:32.291228 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3b59bb0-d9f1-441d-bea3-e22a7fb6cef8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:32.294508 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3b59bb0-d9f1-441d-bea3-e22a7fb6cef8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:32.296687 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3b59bb0-d9f1-441d-bea3-e22a7fb6cef8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:32.300522 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3b59bb0-d9f1-441d-bea3-e22a7fb6cef8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:32.301364 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3b59bb0-d9f1-441d-bea3-e22a7fb6cef8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:32.302548 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3b59bb0-d9f1-441d-bea3-e22a7fb6cef8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:32.593367 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d3b59bb0-d9f1-441d-bea3-e22a7fb6cef8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:32.610669 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d3b59bb0-d9f1-441d-bea3-e22a7fb6cef8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.347861 Sep 10 12:04:32.618457 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2516/5028] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:32 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:32.649623 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1a2f2fc3-0213-465c-8b70-36c97cac195d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:32.658827 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1a2f2fc3-0213-465c-8b70-36c97cac195d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:32.674315 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1a2f2fc3-0213-465c-8b70-36c97cac195d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:32.674811 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1a2f2fc3-0213-465c-8b70-36c97cac195d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:32.677884 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1a2f2fc3-0213-465c-8b70-36c97cac195d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:32.679990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1a2f2fc3-0213-465c-8b70-36c97cac195d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:32.683353 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1a2f2fc3-0213-465c-8b70-36c97cac195d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:32.684343 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1a2f2fc3-0213-465c-8b70-36c97cac195d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:32.800972 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-83744130-d5c4-44ab-8f84-32663eec6eb3 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1993366768", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": "none"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:32.923051 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-83744130-d5c4-44ab-8f84-32663eec6eb3 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:04:32.924326 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-83744130-d5c4-44ab-8f84-32663eec6eb3 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:04:32.926215 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-83744130-d5c4-44ab-8f84-32663eec6eb3 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:04:32.926586 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-83744130-d5c4-44ab-8f84-32663eec6eb3 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:04:32.927007 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-83744130-d5c4-44ab-8f84-32663eec6eb3 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:04:32.960092 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-83744130-d5c4-44ab-8f84-32663eec6eb3 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:32.960544 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-83744130-d5c4-44ab-8f84-32663eec6eb3 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:32.961083 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-83744130-d5c4-44ab-8f84-32663eec6eb3 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:32.962317 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-83744130-d5c4-44ab-8f84-32663eec6eb3 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:32.976901 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-83744130-d5c4-44ab-8f84-32663eec6eb3 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:32.977746 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-83744130-d5c4-44ab-8f84-32663eec6eb3 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:33.016486 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-83744130-d5c4-44ab-8f84-32663eec6eb3 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Getting quotas for project 283b4509c8b1437fb934fee330e58364. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:04:33.028333 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-83744130-d5c4-44ab-8f84-32663eec6eb3 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Getting quotas for user 908efd576c014da99c327cff818aa9d1 and project 283b4509c8b1437fb934fee330e58364. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:04:33.033098 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1a2f2fc3-0213-465c-8b70-36c97cac195d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:33.046703 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1a2f2fc3-0213-465c-8b70-36c97cac195d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.426733 Sep 10 12:04:33.048097 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2517/5029] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:32 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:33.054118 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-48d0d4cd-3fbf-4c89-9315-cba5b89d4487 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:33.055327 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-48d0d4cd-3fbf-4c89-9315-cba5b89d4487 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: eb38cda8-93a7-4327-944f-409c17070fd7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:33.060034 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-83744130-d5c4-44ab-8f84-32663eec6eb3 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:04:33.072147 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48d0d4cd-3fbf-4c89-9315-cba5b89d4487 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:33.072624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-83744130-d5c4-44ab-8f84-32663eec6eb3 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 8a925e1e-383f-4039-ab9b-49ef63acf268] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:04:33.073222 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48d0d4cd-3fbf-4c89-9315-cba5b89d4487 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:33.073889 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48d0d4cd-3fbf-4c89-9315-cba5b89d4487 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:33.087556 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48d0d4cd-3fbf-4c89-9315-cba5b89d4487 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:33.088718 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48d0d4cd-3fbf-4c89-9315-cba5b89d4487 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:33.089806 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48d0d4cd-3fbf-4c89-9315-cba5b89d4487 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:33.162089 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-48d0d4cd-3fbf-4c89-9315-cba5b89d4487 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] HTTP exception thrown: Instance eb38cda8-93a7-4327-944f-409c17070fd7 could not be found. Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-48d0d4cd-3fbf-4c89-9315-cba5b89d4487 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Request method failure captured: Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7 HTTP/1.1 Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHykcWQYupGxhcLpb6v5AsrUV8qZ6sg9Ki1Jfb5jCMoRjGicsw0WManJo8IjBppMD5CxQdT4hQu3IHHi54G_V7lvb8EgCj19qVHNlr3p45qCyo-pmA_bA7FrmqWJZSaCbHLCvlYvItyJikej-C_PUFDVoe9D_fp0roxy7XQj-_YcxQA Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersTestJSON-793172710 Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ac8b3e9f72234d9985fbc5fa7e7984ad", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersTestJSON-793172710 Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersTestJSON-793172710 Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersTestJSON-793172710-project Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: ef32131362a3442498234c0554f08305 Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersTestJSON-793172710-project Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance eb38cda8-93a7-4327-944f-409c17070fd7 could not be found. Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'eb38cda8-93a7-4327-944f-409c17070fd7'} Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb38cda8-93a7-4327-944f-409c17070fd7 could not be found. Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb38cda8-93a7-4327-944f-409c17070fd7 could not be found. Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:33.166532 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:33.172564 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:33.172564 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:33.172564 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:04:33.172564 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:04:33.172564 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb38cda8-93a7-4327-944f-409c17070fd7 could not be found. Sep 10 12:04:33.172564 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:33.175596 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-48d0d4cd-3fbf-4c89-9315-cba5b89d4487 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Returning 404 to user: Instance eb38cda8-93a7-4327-944f-409c17070fd7 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:04:33.177482 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-48d0d4cd-3fbf-4c89-9315-cba5b89d4487 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7" status: 404 len: 111 microversion: 2.1 time: 0.127802 Sep 10 12:04:33.179304 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2518/5030] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:33 2022] GET /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:04:33.199222 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6cef1323-f2ed-4223-8dac-d447da14c967 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:33.200551 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6cef1323-f2ed-4223-8dac-d447da14c967 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:33.207692 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6cef1323-f2ed-4223-8dac-d447da14c967 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:33.208416 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6cef1323-f2ed-4223-8dac-d447da14c967 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:33.209097 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6cef1323-f2ed-4223-8dac-d447da14c967 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:33.209594 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-83744130-d5c4-44ab-8f84-32663eec6eb3 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.774243 Sep 10 12:04:33.210283 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2513/5031] 10.222.0.23 () {62 vars in 1188 bytes} [Sat Sep 10 12:04:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 10 12:04:33.210528 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6cef1323-f2ed-4223-8dac-d447da14c967 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:33.211225 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6cef1323-f2ed-4223-8dac-d447da14c967 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:33.211873 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6cef1323-f2ed-4223-8dac-d447da14c967 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:33.240900 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9b0fa795-0d51-4fe9-ba3b-6e3b22bc0566 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:33.249775 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9b0fa795-0d51-4fe9-ba3b-6e3b22bc0566 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 8a925e1e-383f-4039-ab9b-49ef63acf268] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:33.390969 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9b0fa795-0d51-4fe9-ba3b-6e3b22bc0566 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:33.407470 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9b0fa795-0d51-4fe9-ba3b-6e3b22bc0566 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:33.410574 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9b0fa795-0d51-4fe9-ba3b-6e3b22bc0566 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:33.413564 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9b0fa795-0d51-4fe9-ba3b-6e3b22bc0566 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/8a925e1e-383f-4039-ab9b-49ef63acf268" status: 200 len: 1278 microversion: 2.47 time: 0.184043 Sep 10 12:04:33.415102 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2514/5032] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:04:33 2022] GET /compute/v2.1/servers/8a925e1e-383f-4039-ab9b-49ef63acf268 => generated 1278 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:04:33.420786 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-aef686a2-6a62-4f27-abfd-1b3ab2e6bae9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-995806416", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "5a10f3ce-b3db-41f2-acaa-21e8715e6fe6"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:33.606881 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-aef686a2-6a62-4f27-abfd-1b3ab2e6bae9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] validate_networks() for [('5a10f3ce-b3db-41f2-acaa-21e8715e6fe6', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:04:33.803550 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6cef1323-f2ed-4223-8dac-d447da14c967 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:33.825010 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6cef1323-f2ed-4223-8dac-d447da14c967 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.642885 Sep 10 12:04:33.828672 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2519/5033] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:33 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:33.841595 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ba4fb5e1-af8d-4cd6-87e6-71a327b48acb tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1454694855", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": "none"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:33.931279 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-ba4fb5e1-af8d-4cd6-87e6-71a327b48acb tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:04:33.932857 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-ba4fb5e1-af8d-4cd6-87e6-71a327b48acb tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:04:33.936659 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-ba4fb5e1-af8d-4cd6-87e6-71a327b48acb tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:04:33.937475 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-ba4fb5e1-af8d-4cd6-87e6-71a327b48acb tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:04:33.938145 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-ba4fb5e1-af8d-4cd6-87e6-71a327b48acb tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:04:33.955710 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba4fb5e1-af8d-4cd6-87e6-71a327b48acb tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:33.957094 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba4fb5e1-af8d-4cd6-87e6-71a327b48acb tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:33.957795 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba4fb5e1-af8d-4cd6-87e6-71a327b48acb tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:33.958767 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba4fb5e1-af8d-4cd6-87e6-71a327b48acb tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:33.959633 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba4fb5e1-af8d-4cd6-87e6-71a327b48acb tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:33.960329 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba4fb5e1-af8d-4cd6-87e6-71a327b48acb tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:33.986358 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-ba4fb5e1-af8d-4cd6-87e6-71a327b48acb tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Getting quotas for project 283b4509c8b1437fb934fee330e58364. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:04:34.009449 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-ba4fb5e1-af8d-4cd6-87e6-71a327b48acb tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Getting quotas for user 908efd576c014da99c327cff818aa9d1 and project 283b4509c8b1437fb934fee330e58364. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:04:34.032115 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ba4fb5e1-af8d-4cd6-87e6-71a327b48acb tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:04:34.034527 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ba4fb5e1-af8d-4cd6-87e6-71a327b48acb tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:04:34.097431 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ba4fb5e1-af8d-4cd6-87e6-71a327b48acb tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.265113 Sep 10 12:04:34.110720 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2520/5034] 10.222.0.23 () {62 vars in 1188 bytes} [Sat Sep 10 12:04:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 274 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 10 12:04:34.135762 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c29c8ea6-a605-4371-961a-060aadeabddc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:34.136778 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c29c8ea6-a605-4371-961a-060aadeabddc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:34.172305 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c29c8ea6-a605-4371-961a-060aadeabddc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:34.173039 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c29c8ea6-a605-4371-961a-060aadeabddc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:34.178455 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c29c8ea6-a605-4371-961a-060aadeabddc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:34.180783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c29c8ea6-a605-4371-961a-060aadeabddc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:34.182189 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c29c8ea6-a605-4371-961a-060aadeabddc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:34.182818 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c29c8ea6-a605-4371-961a-060aadeabddc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:34.304358 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c29c8ea6-a605-4371-961a-060aadeabddc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Unlocking {{(pid=128777) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 10 12:04:34.408327 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:04:34.425826 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c29c8ea6-a605-4371-961a-060aadeabddc tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "POST /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f/action" status: 202 len: 0 microversion: 2.1 time: 0.320626 Sep 10 12:04:34.431650 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2521/5035] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:04:34 2022] POST /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:04:34.435187 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ff5b686a-97e9-4acc-9303-314695fca2db tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:34.437683 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-aef686a2-6a62-4f27-abfd-1b3ab2e6bae9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:04:34.438150 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-aef686a2-6a62-4f27-abfd-1b3ab2e6bae9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:04:34.438244 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ff5b686a-97e9-4acc-9303-314695fca2db tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:34.438578 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-aef686a2-6a62-4f27-abfd-1b3ab2e6bae9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:04:34.438993 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-aef686a2-6a62-4f27-abfd-1b3ab2e6bae9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:04:34.439441 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-aef686a2-6a62-4f27-abfd-1b3ab2e6bae9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:04:34.468782 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aef686a2-6a62-4f27-abfd-1b3ab2e6bae9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:34.469279 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aef686a2-6a62-4f27-abfd-1b3ab2e6bae9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:34.469724 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aef686a2-6a62-4f27-abfd-1b3ab2e6bae9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:34.470606 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aef686a2-6a62-4f27-abfd-1b3ab2e6bae9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:34.471024 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aef686a2-6a62-4f27-abfd-1b3ab2e6bae9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:34.471367 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aef686a2-6a62-4f27-abfd-1b3ab2e6bae9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:34.500831 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ff5b686a-97e9-4acc-9303-314695fca2db tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "PUT /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739" status: 200 len: 992 microversion: 2.47 time: 0.072568 Sep 10 12:04:34.511228 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2522/5036] 10.222.0.23 () {62 vars in 1297 bytes} [Sat Sep 10 12:04:34 2022] PUT /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739 => generated 992 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 12:04:34.511228 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fc43fb4a-d403-4bd7-9e50-16eb5d959693 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:34.511228 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fc43fb4a-d403-4bd7-9e50-16eb5d959693 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:34.531767 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc43fb4a-d403-4bd7-9e50-16eb5d959693 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:34.533092 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-aef686a2-6a62-4f27-abfd-1b3ab2e6bae9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Getting quotas for project ac8b3e9f72234d9985fbc5fa7e7984ad. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:04:34.534283 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc43fb4a-d403-4bd7-9e50-16eb5d959693 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:34.536454 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc43fb4a-d403-4bd7-9e50-16eb5d959693 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:34.537300 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc43fb4a-d403-4bd7-9e50-16eb5d959693 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:34.540028 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc43fb4a-d403-4bd7-9e50-16eb5d959693 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:34.540587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc43fb4a-d403-4bd7-9e50-16eb5d959693 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:34.547437 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-aef686a2-6a62-4f27-abfd-1b3ab2e6bae9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Getting quotas for user ef32131362a3442498234c0554f08305 and project ac8b3e9f72234d9985fbc5fa7e7984ad. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:04:34.578869 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-aef686a2-6a62-4f27-abfd-1b3ab2e6bae9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:04:34.590608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-aef686a2-6a62-4f27-abfd-1b3ab2e6bae9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:04:34.754917 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-aef686a2-6a62-4f27-abfd-1b3ab2e6bae9 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.337946 Sep 10 12:04:34.755937 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2515/5037] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:04:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1340 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:04:34.773009 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8aa055a4-4ced-45a7-ba70-a6fbd12e6bf8 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:34.780915 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8aa055a4-4ced-45a7-ba70-a6fbd12e6bf8 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:34.994500 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8aa055a4-4ced-45a7-ba70-a6fbd12e6bf8 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:35.005322 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8aa055a4-4ced-45a7-ba70-a6fbd12e6bf8 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:35.008388 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8aa055a4-4ced-45a7-ba70-a6fbd12e6bf8 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:35.012473 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8aa055a4-4ced-45a7-ba70-a6fbd12e6bf8 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739" status: 200 len: 1278 microversion: 2.47 time: 0.253161 Sep 10 12:04:35.031337 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2516/5038] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:04:34 2022] GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739 => generated 1278 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:04:35.039743 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-43b6a1cd-bb5a-47c5-8750-faa4504758a3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:35.040619 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-43b6a1cd-bb5a-47c5-8750-faa4504758a3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:35.124383 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fc43fb4a-d403-4bd7-9e50-16eb5d959693 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:35.133466 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fc43fb4a-d403-4bd7-9e50-16eb5d959693 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.630186 Sep 10 12:04:35.138138 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2523/5039] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:34 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:35.172934 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-82f259c3-3431-481a-8d9f-f8e62f189045 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:35.173947 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-43b6a1cd-bb5a-47c5-8750-faa4504758a3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:35.175028 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-82f259c3-3431-481a-8d9f-f8e62f189045 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:35.187218 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-43b6a1cd-bb5a-47c5-8750-faa4504758a3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1208 microversion: 2.1 time: 0.152289 Sep 10 12:04:35.188929 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2517/5040] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:35 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1208 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:35.190447 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82f259c3-3431-481a-8d9f-f8e62f189045 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:35.192257 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82f259c3-3431-481a-8d9f-f8e62f189045 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:35.192803 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82f259c3-3431-481a-8d9f-f8e62f189045 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:35.193869 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82f259c3-3431-481a-8d9f-f8e62f189045 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:35.194436 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82f259c3-3431-481a-8d9f-f8e62f189045 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:35.194973 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82f259c3-3431-481a-8d9f-f8e62f189045 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:35.484869 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-82f259c3-3431-481a-8d9f-f8e62f189045 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:35.508984 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-82f259c3-3431-481a-8d9f-f8e62f189045 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.354007 Sep 10 12:04:35.510643 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2524/5041] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:35 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:04:35.533040 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4db9c6e5-7d8e-4461-86a3-25f2af2ba42b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:35.533764 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4db9c6e5-7d8e-4461-86a3-25f2af2ba42b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:35.542898 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4db9c6e5-7d8e-4461-86a3-25f2af2ba42b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:35.543766 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4db9c6e5-7d8e-4461-86a3-25f2af2ba42b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:35.544415 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4db9c6e5-7d8e-4461-86a3-25f2af2ba42b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:35.546079 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4db9c6e5-7d8e-4461-86a3-25f2af2ba42b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:35.546759 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4db9c6e5-7d8e-4461-86a3-25f2af2ba42b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:35.547456 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4db9c6e5-7d8e-4461-86a3-25f2af2ba42b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:35.770402 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4e3c112b-0d37-4847-93ab-751bab87884f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1892739828", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "destination_type": "local"}, {"source_type": "volume", "uuid": "e5d247b0-58f8-4459-990e-cdc01e939a93", "destination_type": "invalid"}], "networks": [{"uuid": "4cf2efdb-facd-4d46-b962-78192cf2010f"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4e3c112b-0d37-4847-93ab-751bab87884f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 495 Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1892739828", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "destination_type": "local"}, {"source_type": "volume", "uuid": "e5d247b0-58f8-4459-990e-cdc01e939a93", "destination_type": "invalid"}], "networks": [{"uuid": "4cf2efdb-facd-4d46-b962-78192cf2010f"}]}} Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1892739828', 'imageRef': 'c23d4d62-7ab9-4623-9273-7f44582aa2e1', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'c23d4d62-7ab9-4623-9273-7f44582aa2e1', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'e5d247b0-58f8-4459-990e-cdc01e939a93', 'destination_type': 'invalid'}], 'networks': [{'uuid': '4cf2efdb-facd-4d46-b962-78192cf2010f'}]}}} Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise error Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi 'invalid' Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:04:35.780985 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:04:35.785215 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:04:35.785215 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:04:35.785215 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:04:35.785215 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 12:04:35.785215 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 12:04:35.785215 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 12:04:35.785215 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 12:04:35.785215 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 12:04:35.785215 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 12:04:35.785215 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 10 12:04:35.785215 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:35.785215 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:35.785215 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:35.785215 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:35.785215 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:35.785215 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:35.785215 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 12:04:35.785215 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 12:04:35.785215 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 10 12:04:35.785215 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:35.785215 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4e3c112b-0d37-4847-93ab-751bab87884f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:04:35.785215 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4e3c112b-0d37-4847-93ab-751bab87884f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.017047 Sep 10 12:04:35.790432 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2525/5042] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:04:35 2022] POST /compute/v2.1/servers => generated 155 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 12:04:35.801602 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6056f4c6-8891-4e94-ae2d-896795efa19b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:35.802165 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4db9c6e5-7d8e-4461-86a3-25f2af2ba42b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:35.803905 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6056f4c6-8891-4e94-ae2d-896795efa19b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:35.811445 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4db9c6e5-7d8e-4461-86a3-25f2af2ba42b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.282523 Sep 10 12:04:35.816384 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6056f4c6-8891-4e94-ae2d-896795efa19b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:35.817055 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6056f4c6-8891-4e94-ae2d-896795efa19b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:35.817495 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6056f4c6-8891-4e94-ae2d-896795efa19b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:35.818202 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6056f4c6-8891-4e94-ae2d-896795efa19b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:35.818660 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6056f4c6-8891-4e94-ae2d-896795efa19b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:35.819084 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6056f4c6-8891-4e94-ae2d-896795efa19b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:35.820180 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2518/5043] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:35 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:35.843619 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ac50fc66-32e1-46d3-8702-9f3a71b2e551 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:35.844555 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ac50fc66-32e1-46d3-8702-9f3a71b2e551 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:35.859078 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac50fc66-32e1-46d3-8702-9f3a71b2e551 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:35.859797 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac50fc66-32e1-46d3-8702-9f3a71b2e551 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:35.860414 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac50fc66-32e1-46d3-8702-9f3a71b2e551 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:35.861343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac50fc66-32e1-46d3-8702-9f3a71b2e551 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:35.862216 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac50fc66-32e1-46d3-8702-9f3a71b2e551 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:35.863256 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ac50fc66-32e1-46d3-8702-9f3a71b2e551 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:35.916020 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:04:35.996062 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ac50fc66-32e1-46d3-8702-9f3a71b2e551 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "POST /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f/action" status: 202 len: 0 microversion: 2.1 time: 0.155802 Sep 10 12:04:35.998031 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2519/5044] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:04:35 2022] POST /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 12:04:36.021556 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cf333dd2-cc5d-47e7-bf8e-61b33dae2f34 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:36.023182 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cf333dd2-cc5d-47e7-bf8e-61b33dae2f34 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:36.025742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6056f4c6-8891-4e94-ae2d-896795efa19b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:36.026113 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:04:36.035927 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cf333dd2-cc5d-47e7-bf8e-61b33dae2f34 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:36.037163 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cf333dd2-cc5d-47e7-bf8e-61b33dae2f34 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:36.037803 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cf333dd2-cc5d-47e7-bf8e-61b33dae2f34 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:36.039795 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6056f4c6-8891-4e94-ae2d-896795efa19b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.247921 Sep 10 12:04:36.040611 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cf333dd2-cc5d-47e7-bf8e-61b33dae2f34 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:36.041138 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cf333dd2-cc5d-47e7-bf8e-61b33dae2f34 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:36.041753 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cf333dd2-cc5d-47e7-bf8e-61b33dae2f34 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:36.060853 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2526/5045] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:35 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:36.067369 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6f2517ac-30a9-4800-bfab-87c53381ec89 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:36.068722 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6f2517ac-30a9-4800-bfab-87c53381ec89 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:36.076868 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6f2517ac-30a9-4800-bfab-87c53381ec89 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:36.077810 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6f2517ac-30a9-4800-bfab-87c53381ec89 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:36.078537 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6f2517ac-30a9-4800-bfab-87c53381ec89 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:36.079428 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6f2517ac-30a9-4800-bfab-87c53381ec89 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:36.080229 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6f2517ac-30a9-4800-bfab-87c53381ec89 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:36.081678 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6f2517ac-30a9-4800-bfab-87c53381ec89 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:36.204211 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6f2517ac-30a9-4800-bfab-87c53381ec89 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:36.224496 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6f2517ac-30a9-4800-bfab-87c53381ec89 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:36.229670 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6f2517ac-30a9-4800-bfab-87c53381ec89 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:36.231208 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6f2517ac-30a9-4800-bfab-87c53381ec89 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739" status: 200 len: 1330 microversion: 2.47 time: 0.169264 Sep 10 12:04:36.252439 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2527/5046] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:04:36 2022] GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739 => generated 1330 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:04:36.267880 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0905c28f-53e9-4089-88d7-fcdeeea7d401 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:36.268651 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0905c28f-53e9-4089-88d7-fcdeeea7d401 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:36.277111 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0905c28f-53e9-4089-88d7-fcdeeea7d401 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:36.277971 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0905c28f-53e9-4089-88d7-fcdeeea7d401 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:36.278710 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0905c28f-53e9-4089-88d7-fcdeeea7d401 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:36.280183 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0905c28f-53e9-4089-88d7-fcdeeea7d401 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:36.280858 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0905c28f-53e9-4089-88d7-fcdeeea7d401 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:36.281474 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0905c28f-53e9-4089-88d7-fcdeeea7d401 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:36.299483 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-cf333dd2-cc5d-47e7-bf8e-61b33dae2f34 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:36.310143 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cf333dd2-cc5d-47e7-bf8e-61b33dae2f34 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1677 microversion: 2.1 time: 0.298015 Sep 10 12:04:36.311435 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2520/5047] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:36 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1677 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:36.330836 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9ef8b657-4397-412f-8e54-c93106e00a32 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:36.331504 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9ef8b657-4397-412f-8e54-c93106e00a32 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:36.345448 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ef8b657-4397-412f-8e54-c93106e00a32 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:36.347627 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ef8b657-4397-412f-8e54-c93106e00a32 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:36.349596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ef8b657-4397-412f-8e54-c93106e00a32 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:36.350545 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ef8b657-4397-412f-8e54-c93106e00a32 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:36.352005 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ef8b657-4397-412f-8e54-c93106e00a32 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:36.353532 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ef8b657-4397-412f-8e54-c93106e00a32 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:36.504970 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9ef8b657-4397-412f-8e54-c93106e00a32 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:36.514262 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9ef8b657-4397-412f-8e54-c93106e00a32 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1260 microversion: 2.1 time: 0.201492 Sep 10 12:04:36.516071 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2521/5048] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:36 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1260 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:36.723347 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0905c28f-53e9-4089-88d7-fcdeeea7d401 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:36.740806 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0905c28f-53e9-4089-88d7-fcdeeea7d401 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.486124 Sep 10 12:04:36.743621 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2528/5049] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:36 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:36.861519 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7da860ef-2693-4bbf-adb1-0f3695280ad3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1606987634", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "4cf2efdb-facd-4d46-b962-78192cf2010f"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7da860ef-2693-4bbf-adb1-0f3695280ad3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 492 Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1606987634", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "4cf2efdb-facd-4d46-b962-78192cf2010f"}]}} Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1606987634', 'imageRef': 'c23d4d62-7ab9-4623-9273-7f44582aa2e1', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '4cf2efdb-facd-4d46-b962-78192cf2010f'}]}}} Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise error Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:36.871925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Sep 10 12:04:36.876155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Sep 10 12:04:36.876155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:36.876155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:36.876155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:36.876155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:36.876155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:36.876155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:36.876155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:04:36.876155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:04:36.876155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:04:36.876155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:04:36.876155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:04:36.876155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:04:36.876155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 12:04:36.876155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 12:04:36.876155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 12:04:36.876155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 12:04:36.876155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 12:04:36.876155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 12:04:36.876155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 10 12:04:36.876155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:36.876155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:36.876155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:36.876155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:36.876155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:36.876155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:36.876155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 12:04:36.876155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 12:04:36.876155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 10 12:04:36.876155 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:36.879906 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7da860ef-2693-4bbf-adb1-0f3695280ad3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:04:36.881179 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7da860ef-2693-4bbf-adb1-0f3695280ad3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.023719 Sep 10 12:04:36.883277 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2522/5050] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:04:36 2022] POST /compute/v2.1/servers => generated 624 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 12:04:36.893276 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d18c042c-83e8-41f2-815f-8d99f6c75540 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:36.893895 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d18c042c-83e8-41f2-815f-8d99f6c75540 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:36.906723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d18c042c-83e8-41f2-815f-8d99f6c75540 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:36.907139 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d18c042c-83e8-41f2-815f-8d99f6c75540 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:36.907847 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d18c042c-83e8-41f2-815f-8d99f6c75540 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:36.908656 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d18c042c-83e8-41f2-815f-8d99f6c75540 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:36.909307 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d18c042c-83e8-41f2-815f-8d99f6c75540 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:36.909957 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d18c042c-83e8-41f2-815f-8d99f6c75540 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:37.258136 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6247ec21-c83f-4c5c-b785-c2f6ac4fc203 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:37.258982 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6247ec21-c83f-4c5c-b785-c2f6ac4fc203 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:37.269881 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6247ec21-c83f-4c5c-b785-c2f6ac4fc203 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:37.271777 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6247ec21-c83f-4c5c-b785-c2f6ac4fc203 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:37.272335 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6247ec21-c83f-4c5c-b785-c2f6ac4fc203 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:37.273320 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6247ec21-c83f-4c5c-b785-c2f6ac4fc203 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:37.274031 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6247ec21-c83f-4c5c-b785-c2f6ac4fc203 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:37.275553 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6247ec21-c83f-4c5c-b785-c2f6ac4fc203 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:37.414585 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d18c042c-83e8-41f2-815f-8d99f6c75540 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:37.423620 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d18c042c-83e8-41f2-815f-8d99f6c75540 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.536796 Sep 10 12:04:37.435549 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2529/5051] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:36 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:37.443091 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f839e133-8ff8-4a93-a9ef-2e70c22f1b99 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:37.444015 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f839e133-8ff8-4a93-a9ef-2e70c22f1b99 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:37.450004 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6247ec21-c83f-4c5c-b785-c2f6ac4fc203 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:37.452489 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f839e133-8ff8-4a93-a9ef-2e70c22f1b99 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:37.452986 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f839e133-8ff8-4a93-a9ef-2e70c22f1b99 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:37.453426 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f839e133-8ff8-4a93-a9ef-2e70c22f1b99 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:37.454133 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f839e133-8ff8-4a93-a9ef-2e70c22f1b99 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:37.454592 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f839e133-8ff8-4a93-a9ef-2e70c22f1b99 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:37.455025 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f839e133-8ff8-4a93-a9ef-2e70c22f1b99 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:37.461930 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6247ec21-c83f-4c5c-b785-c2f6ac4fc203 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:37.463704 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6247ec21-c83f-4c5c-b785-c2f6ac4fc203 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:37.466367 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6247ec21-c83f-4c5c-b785-c2f6ac4fc203 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739" status: 200 len: 1330 microversion: 2.47 time: 0.211838 Sep 10 12:04:37.481693 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2523/5052] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:04:37 2022] GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739 => generated 1330 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 12:04:37.486693 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-54c89eb2-56b0-4d13-a997-a2d389b76542 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:37.492256 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-54c89eb2-56b0-4d13-a997-a2d389b76542 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:37.499474 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-54c89eb2-56b0-4d13-a997-a2d389b76542 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:37.500317 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-54c89eb2-56b0-4d13-a997-a2d389b76542 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:37.501005 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-54c89eb2-56b0-4d13-a997-a2d389b76542 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:37.503415 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-54c89eb2-56b0-4d13-a997-a2d389b76542 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:37.504731 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-54c89eb2-56b0-4d13-a997-a2d389b76542 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:37.505504 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-54c89eb2-56b0-4d13-a997-a2d389b76542 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:38.009276 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f839e133-8ff8-4a93-a9ef-2e70c22f1b99 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:38.019459 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f839e133-8ff8-4a93-a9ef-2e70c22f1b99 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1657 microversion: 2.1 time: 0.582586 Sep 10 12:04:38.019979 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2530/5053] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:37 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1657 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:38.025341 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a25e6727-b43e-4982-800b-4e56eb9f0e96 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:38.026212 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a25e6727-b43e-4982-800b-4e56eb9f0e96 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:38.034505 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a25e6727-b43e-4982-800b-4e56eb9f0e96 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:38.035311 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a25e6727-b43e-4982-800b-4e56eb9f0e96 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:38.035943 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a25e6727-b43e-4982-800b-4e56eb9f0e96 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:38.036847 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a25e6727-b43e-4982-800b-4e56eb9f0e96 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:38.037906 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a25e6727-b43e-4982-800b-4e56eb9f0e96 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:38.038519 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a25e6727-b43e-4982-800b-4e56eb9f0e96 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:38.040099 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-54c89eb2-56b0-4d13-a997-a2d389b76542 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:38.054283 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-54c89eb2-56b0-4d13-a997-a2d389b76542 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.571368 Sep 10 12:04:38.054878 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2524/5054] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:37 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:38.068655 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1c042da8-5b84-41a5-bccd-48d3784622ef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:38.069220 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1c042da8-5b84-41a5-bccd-48d3784622ef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:38.078964 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1c042da8-5b84-41a5-bccd-48d3784622ef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:38.079493 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1c042da8-5b84-41a5-bccd-48d3784622ef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:38.079961 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1c042da8-5b84-41a5-bccd-48d3784622ef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:38.080654 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1c042da8-5b84-41a5-bccd-48d3784622ef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:38.081116 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1c042da8-5b84-41a5-bccd-48d3784622ef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:38.081546 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1c042da8-5b84-41a5-bccd-48d3784622ef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:38.188309 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1c042da8-5b84-41a5-bccd-48d3784622ef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "POST /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f/action" status: 202 len: 0 microversion: 2.1 time: 0.132081 Sep 10 12:04:38.196606 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2525/5055] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:04:38 2022] POST /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:04:38.205657 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c1a760be-5a11-4046-affd-48319b23fe96 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "4cf2efdb-facd-4d46-b962-78192cf2010f"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c1a760be-5a11-4046-affd-48319b23fe96 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 416 Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "4cf2efdb-facd-4d46-b962-78192cf2010f"}]}} Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'c23d4d62-7ab9-4623-9273-7f44582aa2e1', 'flavorRef': '452', 'networks': [{'uuid': '4cf2efdb-facd-4d46-b962-78192cf2010f'}]}}} Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise error Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:38.210836 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:38.215999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:38.215999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:38.215999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:38.215999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:38.215999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:04:38.215999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:04:38.215999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:04:38.215999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:04:38.215999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:04:38.215999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:04:38.215999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 12:04:38.215999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 12:04:38.215999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 12:04:38.215999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 12:04:38.215999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 12:04:38.215999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 12:04:38.215999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 12:04:38.215999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:38.215999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:38.215999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:38.215999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:38.215999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:38.215999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:38.215999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 12:04:38.215999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 12:04:38.215999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 12:04:38.215999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:38.220613 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c1a760be-5a11-4046-affd-48319b23fe96 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:04:38.222701 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c1a760be-5a11-4046-affd-48319b23fe96 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.021546 Sep 10 12:04:38.223695 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2526/5056] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:04:38 2022] POST /compute/v2.1/servers => generated 619 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 12:04:38.233137 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a25e6727-b43e-4982-800b-4e56eb9f0e96 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:38.233899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6caa3e58-8523-4efe-8d79-0c7d7263ad8d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:38.235232 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6caa3e58-8523-4efe-8d79-0c7d7263ad8d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:38.243785 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a25e6727-b43e-4982-800b-4e56eb9f0e96 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1266 microversion: 2.1 time: 0.222383 Sep 10 12:04:38.244424 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2531/5057] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:38 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:38.247843 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6caa3e58-8523-4efe-8d79-0c7d7263ad8d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:38.248501 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6caa3e58-8523-4efe-8d79-0c7d7263ad8d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:38.249153 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6caa3e58-8523-4efe-8d79-0c7d7263ad8d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:38.250041 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6caa3e58-8523-4efe-8d79-0c7d7263ad8d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:38.250902 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6caa3e58-8523-4efe-8d79-0c7d7263ad8d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:38.251035 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6caa3e58-8523-4efe-8d79-0c7d7263ad8d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:38.264657 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-29de644c-fd1d-4273-a202-6aac1a827e57 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:38.265610 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-29de644c-fd1d-4273-a202-6aac1a827e57 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:38.276008 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29de644c-fd1d-4273-a202-6aac1a827e57 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:38.277850 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29de644c-fd1d-4273-a202-6aac1a827e57 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:38.278774 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29de644c-fd1d-4273-a202-6aac1a827e57 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:38.282461 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29de644c-fd1d-4273-a202-6aac1a827e57 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:38.283426 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29de644c-fd1d-4273-a202-6aac1a827e57 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:38.284080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29de644c-fd1d-4273-a202-6aac1a827e57 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:38.694117 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6caa3e58-8523-4efe-8d79-0c7d7263ad8d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:38.711344 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6caa3e58-8523-4efe-8d79-0c7d7263ad8d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1664 microversion: 2.1 time: 0.483862 Sep 10 12:04:38.731424 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2527/5058] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:38 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1664 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:38.737469 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ef2e77fb-ffc5-4981-a74e-ca7b6b892e67 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:38.738438 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ef2e77fb-ffc5-4981-a74e-ca7b6b892e67 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:38.744964 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ef2e77fb-ffc5-4981-a74e-ca7b6b892e67 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:38.745827 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ef2e77fb-ffc5-4981-a74e-ca7b6b892e67 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:38.747133 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ef2e77fb-ffc5-4981-a74e-ca7b6b892e67 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:38.748164 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ef2e77fb-ffc5-4981-a74e-ca7b6b892e67 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:38.748865 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ef2e77fb-ffc5-4981-a74e-ca7b6b892e67 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:38.749575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ef2e77fb-ffc5-4981-a74e-ca7b6b892e67 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:38.753582 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-29de644c-fd1d-4273-a202-6aac1a827e57 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:38.767817 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-29de644c-fd1d-4273-a202-6aac1a827e57 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.522357 Sep 10 12:04:38.768415 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2532/5059] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:38 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:38.792271 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f55eacf4-8426-4c5b-8cd8-9354a10b8622 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:38.793438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f55eacf4-8426-4c5b-8cd8-9354a10b8622 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:38.801401 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f55eacf4-8426-4c5b-8cd8-9354a10b8622 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:38.801904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f55eacf4-8426-4c5b-8cd8-9354a10b8622 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:38.802349 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f55eacf4-8426-4c5b-8cd8-9354a10b8622 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:38.803054 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f55eacf4-8426-4c5b-8cd8-9354a10b8622 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:38.803545 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f55eacf4-8426-4c5b-8cd8-9354a10b8622 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:38.803970 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f55eacf4-8426-4c5b-8cd8-9354a10b8622 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:38.875429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ef2e77fb-ffc5-4981-a74e-ca7b6b892e67 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:38.897855 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ef2e77fb-ffc5-4981-a74e-ca7b6b892e67 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:38.905458 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ef2e77fb-ffc5-4981-a74e-ca7b6b892e67 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:38.908364 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ef2e77fb-ffc5-4981-a74e-ca7b6b892e67 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739" status: 200 len: 1336 microversion: 2.47 time: 0.174901 Sep 10 12:04:38.924411 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2528/5060] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:04:38 2022] GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739 => generated 1336 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:04:39.272864 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6c00a910-4cc1-4e3d-9a70-43e51d36b311 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:39.273614 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6c00a910-4cc1-4e3d-9a70-43e51d36b311 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:39.282269 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6c00a910-4cc1-4e3d-9a70-43e51d36b311 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:39.283122 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6c00a910-4cc1-4e3d-9a70-43e51d36b311 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:39.283809 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6c00a910-4cc1-4e3d-9a70-43e51d36b311 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:39.284677 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6c00a910-4cc1-4e3d-9a70-43e51d36b311 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:39.285132 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6c00a910-4cc1-4e3d-9a70-43e51d36b311 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:39.286341 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6c00a910-4cc1-4e3d-9a70-43e51d36b311 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:39.447367 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6c00a910-4cc1-4e3d-9a70-43e51d36b311 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:39.460768 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6c00a910-4cc1-4e3d-9a70-43e51d36b311 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1266 microversion: 2.1 time: 0.192868 Sep 10 12:04:39.461388 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2529/5061] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:39 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:04:39.547005 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f55eacf4-8426-4c5b-8cd8-9354a10b8622 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:39.566261 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f55eacf4-8426-4c5b-8cd8-9354a10b8622 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.777694 Sep 10 12:04:39.566887 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2533/5062] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:38 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:04:39.674564 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-034abf8e-40bf-4477-91a9-6ee844729caf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1854516968", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": -1, "networks": [{"uuid": "4cf2efdb-facd-4d46-b962-78192cf2010f"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:39.738897 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e0f9884b-6225-4eb5-9f93-2b6fceb570ea tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:39.739772 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e0f9884b-6225-4eb5-9f93-2b6fceb570ea tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:39.739936 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-034abf8e-40bf-4477-91a9-6ee844729caf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] HTTP exception thrown: Flavor -1 could not be found. Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-034abf8e-40bf-4477-91a9-6ee844729caf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 206 Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1854516968", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": -1, "networks": [{"uuid": "4cf2efdb-facd-4d46-b962-78192cf2010f"}]}} Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: exception: Flavor -1 could not be found. Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1854516968', 'imageRef': 'c23d4d62-7ab9-4623-9273-7f44582aa2e1', 'flavorRef': -1, 'networks': [{'uuid': '4cf2efdb-facd-4d46-b962-78192cf2010f'}]}}} Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:04:39.748564 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:04:39.754604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:04:39.754604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:04:39.754604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:04:39.754604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:04:39.754604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 10 12:04:39.754604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 10 12:04:39.754604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 10 12:04:39.754604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Sep 10 12:04:39.754604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:39.754604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:39.754604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:39.754604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:39.754604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:39.754604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:39.754604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:04:39.754604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:04:39.754604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Sep 10 12:04:39.754604 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:39.760102 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-034abf8e-40bf-4477-91a9-6ee844729caf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:04:39.761219 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-034abf8e-40bf-4477-91a9-6ee844729caf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.093838 Sep 10 12:04:39.762383 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2530/5063] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:04:39 2022] POST /compute/v2.1/servers => generated 73 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 10 12:04:39.762523 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0f9884b-6225-4eb5-9f93-2b6fceb570ea tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:39.763057 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0f9884b-6225-4eb5-9f93-2b6fceb570ea tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:39.763543 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0f9884b-6225-4eb5-9f93-2b6fceb570ea tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:39.764290 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0f9884b-6225-4eb5-9f93-2b6fceb570ea tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:39.764751 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0f9884b-6225-4eb5-9f93-2b6fceb570ea tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:39.765188 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0f9884b-6225-4eb5-9f93-2b6fceb570ea tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:39.772191 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4fa5199f-47e3-44bc-8983-e8a59de36085 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:39.773170 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4fa5199f-47e3-44bc-8983-e8a59de36085 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:39.794495 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fa5199f-47e3-44bc-8983-e8a59de36085 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:39.797554 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fa5199f-47e3-44bc-8983-e8a59de36085 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:39.798112 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fa5199f-47e3-44bc-8983-e8a59de36085 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:39.801206 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fa5199f-47e3-44bc-8983-e8a59de36085 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:39.803190 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fa5199f-47e3-44bc-8983-e8a59de36085 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:39.804869 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fa5199f-47e3-44bc-8983-e8a59de36085 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:40.268211 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e0f9884b-6225-4eb5-9f93-2b6fceb570ea tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:40.281534 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4fa5199f-47e3-44bc-8983-e8a59de36085 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:40.284311 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e0f9884b-6225-4eb5-9f93-2b6fceb570ea tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.546435 Sep 10 12:04:40.302701 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2534/5064] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:39 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:40.312273 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4fa5199f-47e3-44bc-8983-e8a59de36085 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.544560 Sep 10 12:04:40.315623 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2531/5065] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:39 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:40.331535 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1493bad2-3432-4e98-9e30-b5a4a8c858a0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:40.336970 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-229d3993-359a-4f6b-ad8e-687005cfbc77 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:40.340745 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-229d3993-359a-4f6b-ad8e-687005cfbc77 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:40.344511 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1493bad2-3432-4e98-9e30-b5a4a8c858a0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:40.361401 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1493bad2-3432-4e98-9e30-b5a4a8c858a0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:40.363954 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-229d3993-359a-4f6b-ad8e-687005cfbc77 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:40.364475 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-229d3993-359a-4f6b-ad8e-687005cfbc77 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:40.364918 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1493bad2-3432-4e98-9e30-b5a4a8c858a0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:40.366376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1493bad2-3432-4e98-9e30-b5a4a8c858a0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:40.367153 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-229d3993-359a-4f6b-ad8e-687005cfbc77 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:40.368125 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1493bad2-3432-4e98-9e30-b5a4a8c858a0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:40.369350 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1493bad2-3432-4e98-9e30-b5a4a8c858a0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:40.370009 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1493bad2-3432-4e98-9e30-b5a4a8c858a0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:40.372605 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-229d3993-359a-4f6b-ad8e-687005cfbc77 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:40.373158 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-229d3993-359a-4f6b-ad8e-687005cfbc77 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:40.376553 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-229d3993-359a-4f6b-ad8e-687005cfbc77 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:40.601345 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1493bad2-3432-4e98-9e30-b5a4a8c858a0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:40.616299 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1493bad2-3432-4e98-9e30-b5a4a8c858a0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:40.618293 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1493bad2-3432-4e98-9e30-b5a4a8c858a0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:40.619792 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1493bad2-3432-4e98-9e30-b5a4a8c858a0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739" status: 200 len: 1336 microversion: 2.47 time: 0.309083 Sep 10 12:04:40.620612 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2535/5066] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:04:40 2022] GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739 => generated 1336 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:04:40.635605 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e967af0b-6e95-4632-bc5a-c0493fa3ff12 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:40.637308 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e967af0b-6e95-4632-bc5a-c0493fa3ff12 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:40.648312 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e967af0b-6e95-4632-bc5a-c0493fa3ff12 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:40.649239 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e967af0b-6e95-4632-bc5a-c0493fa3ff12 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:40.649855 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e967af0b-6e95-4632-bc5a-c0493fa3ff12 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:40.650881 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e967af0b-6e95-4632-bc5a-c0493fa3ff12 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:40.651546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e967af0b-6e95-4632-bc5a-c0493fa3ff12 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:40.652219 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e967af0b-6e95-4632-bc5a-c0493fa3ff12 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:40.825953 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-229d3993-359a-4f6b-ad8e-687005cfbc77 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:40.842032 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-229d3993-359a-4f6b-ad8e-687005cfbc77 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.523262 Sep 10 12:04:40.845237 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2532/5067] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:40 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:40.852638 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5453722e-89d0-4437-a081-8edd0fd2c0ce tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:40.853690 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5453722e-89d0-4437-a081-8edd0fd2c0ce tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:40.867105 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5453722e-89d0-4437-a081-8edd0fd2c0ce tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:40.867981 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5453722e-89d0-4437-a081-8edd0fd2c0ce tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:40.870449 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5453722e-89d0-4437-a081-8edd0fd2c0ce tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:40.873048 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5453722e-89d0-4437-a081-8edd0fd2c0ce tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:40.873940 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5453722e-89d0-4437-a081-8edd0fd2c0ce tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:40.874566 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5453722e-89d0-4437-a081-8edd0fd2c0ce tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:41.382042 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5453722e-89d0-4437-a081-8edd0fd2c0ce tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:41.392762 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5453722e-89d0-4437-a081-8edd0fd2c0ce tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1308 microversion: 2.1 time: 0.545351 Sep 10 12:04:41.402795 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2533/5068] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:40 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1308 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:41.416921 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-23567659-2c3f-4e60-9064-60667c34588b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:41.417505 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-23567659-2c3f-4e60-9064-60667c34588b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:41.423122 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e967af0b-6e95-4632-bc5a-c0493fa3ff12 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:41.438330 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e967af0b-6e95-4632-bc5a-c0493fa3ff12 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.814125 Sep 10 12:04:41.439430 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2536/5069] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:40 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:41.439639 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-23567659-2c3f-4e60-9064-60667c34588b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:41.440284 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-23567659-2c3f-4e60-9064-60667c34588b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:41.440742 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-23567659-2c3f-4e60-9064-60667c34588b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:41.441495 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-23567659-2c3f-4e60-9064-60667c34588b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:41.441950 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-23567659-2c3f-4e60-9064-60667c34588b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:41.442384 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-23567659-2c3f-4e60-9064-60667c34588b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:41.508102 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2e351f4c-6b36-4f8f-9e4a-ef8bc44f3185 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-989015555", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "4cf2efdb-facd-4d46-b962-78192cf2010f"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2e351f4c-6b36-4f8f-9e4a-ef8bc44f3185 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 172 Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-989015555", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "4cf2efdb-facd-4d46-b962-78192cf2010f"}]}} Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-989015555', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '4cf2efdb-facd-4d46-b962-78192cf2010f'}]}}} Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise error Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi -1 Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 12:04:41.514274 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 12:04:41.519894 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 12:04:41.519894 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 12:04:41.519894 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 12:04:41.519894 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 10 12:04:41.519894 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:41.519894 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:41.519894 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:41.519894 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:41.519894 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:41.519894 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:41.519894 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 12:04:41.519894 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 12:04:41.519894 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 10 12:04:41.519894 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:41.521299 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2e351f4c-6b36-4f8f-9e4a-ef8bc44f3185 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:04:41.524466 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2e351f4c-6b36-4f8f-9e4a-ef8bc44f3185 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.020229 Sep 10 12:04:41.529447 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2537/5070] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:04:41 2022] POST /compute/v2.1/servers => generated 145 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 12:04:41.535724 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bcb341de-94a5-418b-9b57-52fec0d61cb5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:41.536347 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bcb341de-94a5-418b-9b57-52fec0d61cb5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:41.545607 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bcb341de-94a5-418b-9b57-52fec0d61cb5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:41.546114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bcb341de-94a5-418b-9b57-52fec0d61cb5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:41.546555 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bcb341de-94a5-418b-9b57-52fec0d61cb5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:41.547324 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bcb341de-94a5-418b-9b57-52fec0d61cb5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:41.547789 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bcb341de-94a5-418b-9b57-52fec0d61cb5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:41.548224 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bcb341de-94a5-418b-9b57-52fec0d61cb5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:41.784145 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-23567659-2c3f-4e60-9064-60667c34588b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:41.794353 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-23567659-2c3f-4e60-9064-60667c34588b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.388705 Sep 10 12:04:41.795621 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2534/5071] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:41 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:41.801617 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c206ee96-406f-48c1-aca8-e1ba911b9173 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:41.802415 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c206ee96-406f-48c1-aca8-e1ba911b9173 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:41.810419 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c206ee96-406f-48c1-aca8-e1ba911b9173 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:41.810921 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c206ee96-406f-48c1-aca8-e1ba911b9173 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:41.811438 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c206ee96-406f-48c1-aca8-e1ba911b9173 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:41.812106 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c206ee96-406f-48c1-aca8-e1ba911b9173 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:41.812565 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c206ee96-406f-48c1-aca8-e1ba911b9173 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:41.813214 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c206ee96-406f-48c1-aca8-e1ba911b9173 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:41.935064 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bcb341de-94a5-418b-9b57-52fec0d61cb5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:41.938755 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c206ee96-406f-48c1-aca8-e1ba911b9173 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:41.946376 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bcb341de-94a5-418b-9b57-52fec0d61cb5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.415723 Sep 10 12:04:41.947865 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2538/5072] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:41 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:41.948813 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c206ee96-406f-48c1-aca8-e1ba911b9173 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:41.952072 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c206ee96-406f-48c1-aca8-e1ba911b9173 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:41.953524 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c206ee96-406f-48c1-aca8-e1ba911b9173 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739" status: 200 len: 1357 microversion: 2.47 time: 0.156557 Sep 10 12:04:41.961167 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-93de55e5-a5ce-4045-8409-f13073736678 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:41.962983 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-93de55e5-a5ce-4045-8409-f13073736678 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:41.967641 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2535/5073] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:04:41 2022] GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:04:41.973683 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-93de55e5-a5ce-4045-8409-f13073736678 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:41.975710 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-93de55e5-a5ce-4045-8409-f13073736678 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:41.979616 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-93de55e5-a5ce-4045-8409-f13073736678 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:41.980925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-93de55e5-a5ce-4045-8409-f13073736678 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:41.981593 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-93de55e5-a5ce-4045-8409-f13073736678 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:41.982145 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-93de55e5-a5ce-4045-8409-f13073736678 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:41.982822 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4290e5e7-949c-44ee-9ffc-22a07513f84d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:41.984869 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4290e5e7-949c-44ee-9ffc-22a07513f84d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:41.991984 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4290e5e7-949c-44ee-9ffc-22a07513f84d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:41.992561 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4290e5e7-949c-44ee-9ffc-22a07513f84d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:41.993273 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4290e5e7-949c-44ee-9ffc-22a07513f84d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:41.994222 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4290e5e7-949c-44ee-9ffc-22a07513f84d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:41.994908 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4290e5e7-949c-44ee-9ffc-22a07513f84d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:41.995730 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4290e5e7-949c-44ee-9ffc-22a07513f84d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:42.316441 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-93de55e5-a5ce-4045-8409-f13073736678 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:42.335875 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-93de55e5-a5ce-4045-8409-f13073736678 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.381854 Sep 10 12:04:42.336995 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2539/5074] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:41 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:42.344128 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-265692aa-4a22-4557-b6a1-679ddcbdf4f9 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:42.352863 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-265692aa-4a22-4557-b6a1-679ddcbdf4f9 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:42.356217 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4290e5e7-949c-44ee-9ffc-22a07513f84d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:42.365828 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4290e5e7-949c-44ee-9ffc-22a07513f84d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.390786 Sep 10 12:04:42.366583 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2536/5075] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:41 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:42.370249 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-265692aa-4a22-4557-b6a1-679ddcbdf4f9 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:42.370988 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-265692aa-4a22-4557-b6a1-679ddcbdf4f9 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:42.371738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-265692aa-4a22-4557-b6a1-679ddcbdf4f9 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:42.372792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-265692aa-4a22-4557-b6a1-679ddcbdf4f9 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:42.374369 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-6b84b06f-345a-4dd1-b3cf-63d8170f6885 req-8e8e43a2-bc84-417f-8b50-f80a0de275ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2da647c-6fe1-4674-9b1f-7f54bd2d3b15", "tag": "aaea91dd-f8c4-4f10-b87a-80388d1b174f"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:42.374994 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-265692aa-4a22-4557-b6a1-679ddcbdf4f9 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:42.375577 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-265692aa-4a22-4557-b6a1-679ddcbdf4f9 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:42.389269 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6b84b06f-345a-4dd1-b3cf-63d8170f6885 req-8e8e43a2-bc84-417f-8b50-f80a0de275ed service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:42.390284 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6b84b06f-345a-4dd1-b3cf-63d8170f6885 req-8e8e43a2-bc84-417f-8b50-f80a0de275ed service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:42.390877 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6b84b06f-345a-4dd1-b3cf-63d8170f6885 req-8e8e43a2-bc84-417f-8b50-f80a0de275ed service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:42.437103 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-6b84b06f-345a-4dd1-b3cf-63d8170f6885 req-8e8e43a2-bc84-417f-8b50-f80a0de275ed service nova] Creating event network-changed:aaea91dd-f8c4-4f10-b87a-80388d1b174f for instance f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 on n-h1-856895-1 Sep 10 12:04:42.445770 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-6b84b06f-345a-4dd1-b3cf-63d8170f6885 req-8e8e43a2-bc84-417f-8b50-f80a0de275ed service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077504 Sep 10 12:04:42.447093 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2537/5076] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:04:42.454699 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2e5018e9-45dd-435c-b300-acaeb955f24f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:42.456035 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2e5018e9-45dd-435c-b300-acaeb955f24f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:42.469702 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e5018e9-45dd-435c-b300-acaeb955f24f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:42.470526 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e5018e9-45dd-435c-b300-acaeb955f24f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:42.471144 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e5018e9-45dd-435c-b300-acaeb955f24f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:42.472118 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e5018e9-45dd-435c-b300-acaeb955f24f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:42.473350 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e5018e9-45dd-435c-b300-acaeb955f24f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:42.474293 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e5018e9-45dd-435c-b300-acaeb955f24f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:42.484072 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:04:42.554510 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:04:42.558557 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-265692aa-4a22-4557-b6a1-679ddcbdf4f9 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:04:42.559755 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-265692aa-4a22-4557-b6a1-679ddcbdf4f9 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:04:42.571281 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-265692aa-4a22-4557-b6a1-679ddcbdf4f9 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:04:42.571744 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-265692aa-4a22-4557-b6a1-679ddcbdf4f9 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:04:42.572409 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-265692aa-4a22-4557-b6a1-679ddcbdf4f9 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:04:42.597096 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=99 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:04:42.664930 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-265692aa-4a22-4557-b6a1-679ddcbdf4f9 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:42.672107 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-265692aa-4a22-4557-b6a1-679ddcbdf4f9 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:42.672969 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-265692aa-4a22-4557-b6a1-679ddcbdf4f9 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:42.673651 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-265692aa-4a22-4557-b6a1-679ddcbdf4f9 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:42.674887 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-265692aa-4a22-4557-b6a1-679ddcbdf4f9 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:42.675399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-265692aa-4a22-4557-b6a1-679ddcbdf4f9 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:42.684237 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-265692aa-4a22-4557-b6a1-679ddcbdf4f9 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:42.729438 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-265692aa-4a22-4557-b6a1-679ddcbdf4f9 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "POST /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739/action" status: 202 len: 1079 microversion: 2.47 time: 0.390992 Sep 10 12:04:42.740445 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2540/5077] 10.222.0.23 () {62 vars in 1319 bytes} [Sat Sep 10 12:04:42 2022] POST /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739/action => generated 1079 bytes in 403 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 10 12:04:42.749309 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1b986228-e743-46ae-ac41-a141e710575b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:42.750318 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1b986228-e743-46ae-ac41-a141e710575b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:42.760344 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b986228-e743-46ae-ac41-a141e710575b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:42.761230 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b986228-e743-46ae-ac41-a141e710575b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:42.762385 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b986228-e743-46ae-ac41-a141e710575b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:42.763576 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b986228-e743-46ae-ac41-a141e710575b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:42.764296 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b986228-e743-46ae-ac41-a141e710575b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:42.765300 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b986228-e743-46ae-ac41-a141e710575b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:42.896167 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2e5018e9-45dd-435c-b300-acaeb955f24f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:42.908785 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2e5018e9-45dd-435c-b300-acaeb955f24f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.460269 Sep 10 12:04:42.909821 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2538/5078] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:42 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:42.924102 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-648010be-4d35-40c3-a06b-e82659b17dcc tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-817572524", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:42.929540 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-648010be-4d35-40c3-a06b-e82659b17dcc tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-648010be-4d35-40c3-a06b-e82659b17dcc tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 215 Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-817572524", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-817572524', 'imageRef': 'c23d4d62-7ab9-4623-9273-7f44582aa2e1', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._validate_network_id( Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:42.941904 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:42.949220 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:42.949220 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:42.949220 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:42.949220 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:42.949220 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:04:42.949220 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:04:42.949220 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 10 12:04:42.949220 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:42.952810 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-648010be-4d35-40c3-a06b-e82659b17dcc tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:04:42.953951 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-648010be-4d35-40c3-a06b-e82659b17dcc tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.042788 Sep 10 12:04:42.955091 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2539/5079] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:04:42 2022] POST /compute/v2.1/servers => generated 123 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 12:04:42.962478 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c3bfe792-9b0b-45a7-a96c-2078ba9e902b tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:42.963518 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c3bfe792-9b0b-45a7-a96c-2078ba9e902b tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:42.974200 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3bfe792-9b0b-45a7-a96c-2078ba9e902b tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:42.974979 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3bfe792-9b0b-45a7-a96c-2078ba9e902b tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:42.975697 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3bfe792-9b0b-45a7-a96c-2078ba9e902b tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:42.976684 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3bfe792-9b0b-45a7-a96c-2078ba9e902b tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:42.983142 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3bfe792-9b0b-45a7-a96c-2078ba9e902b tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:42.983899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3bfe792-9b0b-45a7-a96c-2078ba9e902b tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:43.046843 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1b986228-e743-46ae-ac41-a141e710575b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:43.055540 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1b986228-e743-46ae-ac41-a141e710575b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1308 microversion: 2.1 time: 0.312964 Sep 10 12:04:43.071896 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2541/5080] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:42 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1308 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:43.079995 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-abda3e4c-7ffa-4287-87c6-5444719ae86c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:43.080908 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-abda3e4c-7ffa-4287-87c6-5444719ae86c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:43.088640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-abda3e4c-7ffa-4287-87c6-5444719ae86c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:43.089137 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-abda3e4c-7ffa-4287-87c6-5444719ae86c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:43.090472 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-abda3e4c-7ffa-4287-87c6-5444719ae86c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:43.091434 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-abda3e4c-7ffa-4287-87c6-5444719ae86c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:43.092075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-abda3e4c-7ffa-4287-87c6-5444719ae86c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:43.092681 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-abda3e4c-7ffa-4287-87c6-5444719ae86c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:43.166281 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c3bfe792-9b0b-45a7-a96c-2078ba9e902b tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:43.177747 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c3bfe792-9b0b-45a7-a96c-2078ba9e902b tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:43.179928 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c3bfe792-9b0b-45a7-a96c-2078ba9e902b tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:43.181764 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c3bfe792-9b0b-45a7-a96c-2078ba9e902b tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739" status: 200 len: 1366 microversion: 2.47 time: 0.225134 Sep 10 12:04:43.182564 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2540/5081] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:04:42 2022] GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:04:43.188046 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ab188b95-1068-4124-bb35-52ff7a8ca931 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:43.188917 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ab188b95-1068-4124-bb35-52ff7a8ca931 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:43.197860 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab188b95-1068-4124-bb35-52ff7a8ca931 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:43.198697 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab188b95-1068-4124-bb35-52ff7a8ca931 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:43.200173 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab188b95-1068-4124-bb35-52ff7a8ca931 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:43.201139 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab188b95-1068-4124-bb35-52ff7a8ca931 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:43.202477 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab188b95-1068-4124-bb35-52ff7a8ca931 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:43.211821 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab188b95-1068-4124-bb35-52ff7a8ca931 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:43.491882 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-abda3e4c-7ffa-4287-87c6-5444719ae86c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:43.505876 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-abda3e4c-7ffa-4287-87c6-5444719ae86c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.432496 Sep 10 12:04:43.510590 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2542/5082] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:43 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:43.531396 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ab188b95-1068-4124-bb35-52ff7a8ca931 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:43.539618 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ab188b95-1068-4124-bb35-52ff7a8ca931 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.355524 Sep 10 12:04:43.556088 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2541/5083] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:43 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:43.565935 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d5123fe0-ef4f-4c53-9e99-07d0d437143e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:43.567936 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d5123fe0-ef4f-4c53-9e99-07d0d437143e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:43.574875 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d5123fe0-ef4f-4c53-9e99-07d0d437143e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:43.575673 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d5123fe0-ef4f-4c53-9e99-07d0d437143e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:43.576458 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d5123fe0-ef4f-4c53-9e99-07d0d437143e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:43.577583 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d5123fe0-ef4f-4c53-9e99-07d0d437143e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:43.578225 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d5123fe0-ef4f-4c53-9e99-07d0d437143e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:43.579025 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d5123fe0-ef4f-4c53-9e99-07d0d437143e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:43.818390 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d5123fe0-ef4f-4c53-9e99-07d0d437143e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:43.830477 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d5123fe0-ef4f-4c53-9e99-07d0d437143e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.268326 Sep 10 12:04:43.852089 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2543/5084] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:43 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:44.003742 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a42a03be-6eb7-4dbf-9637-49b7a69b4666 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-795483856", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "key_name": "tempest-key-404510046", "networks": [{"uuid": "4cf2efdb-facd-4d46-b962-78192cf2010f"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:44.088054 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-a42a03be-6eb7-4dbf-9637-49b7a69b4666 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] validate_networks() for [('4cf2efdb-facd-4d46-b962-78192cf2010f', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:04:44.092278 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5c14f5ba-15d0-4d0a-a0ff-1feac44b1345 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:44.094872 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5c14f5ba-15d0-4d0a-a0ff-1feac44b1345 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:44.097103 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:04:44.097772 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:04:44.107886 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c14f5ba-15d0-4d0a-a0ff-1feac44b1345 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:44.108650 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c14f5ba-15d0-4d0a-a0ff-1feac44b1345 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:44.109273 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c14f5ba-15d0-4d0a-a0ff-1feac44b1345 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:44.110401 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c14f5ba-15d0-4d0a-a0ff-1feac44b1345 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:44.111040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c14f5ba-15d0-4d0a-a0ff-1feac44b1345 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:44.112330 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c14f5ba-15d0-4d0a-a0ff-1feac44b1345 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:44.445033 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5c14f5ba-15d0-4d0a-a0ff-1feac44b1345 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:44.454722 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5c14f5ba-15d0-4d0a-a0ff-1feac44b1345 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1308 microversion: 2.1 time: 0.373252 Sep 10 12:04:44.468048 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2544/5085] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:44 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1308 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:44.477017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fa36bb44-382c-48ed-aed5-3a4b39b3d370 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:44.478476 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fa36bb44-382c-48ed-aed5-3a4b39b3d370 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:44.486853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fa36bb44-382c-48ed-aed5-3a4b39b3d370 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:44.487692 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fa36bb44-382c-48ed-aed5-3a4b39b3d370 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:44.488799 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fa36bb44-382c-48ed-aed5-3a4b39b3d370 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:44.489764 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fa36bb44-382c-48ed-aed5-3a4b39b3d370 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:44.490416 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fa36bb44-382c-48ed-aed5-3a4b39b3d370 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:44.491022 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fa36bb44-382c-48ed-aed5-3a4b39b3d370 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:44.494158 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=4 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:04:44.516677 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-a42a03be-6eb7-4dbf-9637-49b7a69b4666 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] HTTP exception thrown: Invalid key_name provided. Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a42a03be-6eb7-4dbf-9637-49b7a69b4666 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 245 Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-795483856", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "key_name": "tempest-key-404510046", "networks": [{"uuid": "4cf2efdb-facd-4d46-b962-78192cf2010f"}]}} Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: exception: Invalid key_name provided. Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-795483856', 'imageRef': 'c23d4d62-7ab9-4623-9273-7f44582aa2e1', 'flavorRef': '452', 'key_name': 'tempest-key-404510046', 'networks': [{'uuid': '4cf2efdb-facd-4d46-b962-78192cf2010f'}]}}} Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-404510046 not found for user 862345bb47a242c288375194a92834f9 Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:44.520619 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:44.526240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:44.526240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:04:44.526240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:04:44.526240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:04:44.526240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:04:44.526240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:04:44.526240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:04:44.526240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:04:44.526240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:04:44.526240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:04:44.526240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:04:44.526240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 10 12:04:44.526240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Sep 10 12:04:44.526240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 10 12:04:44.526240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Sep 10 12:04:44.526240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:44.526240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:44.526240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:44.526240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:44.526240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:44.526240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:44.526240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:04:44.526240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:04:44.526240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Sep 10 12:04:44.526240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:44.534175 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a42a03be-6eb7-4dbf-9637-49b7a69b4666 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 400 to user: Invalid key_name provided. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:04:44.536748 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a42a03be-6eb7-4dbf-9637-49b7a69b4666 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.536264 Sep 10 12:04:44.537625 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2542/5086] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:04:43 2022] POST /compute/v2.1/servers => generated 70 bytes in 538 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 10 12:04:44.547595 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-aed7467d-f9ae-48f4-939e-722057bd9a50 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:44.553364 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-aed7467d-f9ae-48f4-939e-722057bd9a50 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:44.582400 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aed7467d-f9ae-48f4-939e-722057bd9a50 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:44.584840 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aed7467d-f9ae-48f4-939e-722057bd9a50 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:44.585673 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aed7467d-f9ae-48f4-939e-722057bd9a50 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:44.587030 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aed7467d-f9ae-48f4-939e-722057bd9a50 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:44.588234 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aed7467d-f9ae-48f4-939e-722057bd9a50 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:44.589165 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aed7467d-f9ae-48f4-939e-722057bd9a50 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:44.640559 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fa36bb44-382c-48ed-aed5-3a4b39b3d370 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:44.650202 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fa36bb44-382c-48ed-aed5-3a4b39b3d370 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:44.661556 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fa36bb44-382c-48ed-aed5-3a4b39b3d370 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:44.663063 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fa36bb44-382c-48ed-aed5-3a4b39b3d370 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739" status: 200 len: 1366 microversion: 2.47 time: 0.193601 Sep 10 12:04:44.684575 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2545/5087] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:04:44 2022] GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:04:44.822783 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-aed7467d-f9ae-48f4-939e-722057bd9a50 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:44.834188 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-aed7467d-f9ae-48f4-939e-722057bd9a50 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.291703 Sep 10 12:04:44.835540 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2543/5088] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:44 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:04:44.861603 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-46da8421-9936-4d3f-9eca-cc4ccd858903 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:44.862455 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-46da8421-9936-4d3f-9eca-cc4ccd858903 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:44.869780 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46da8421-9936-4d3f-9eca-cc4ccd858903 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:44.870481 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46da8421-9936-4d3f-9eca-cc4ccd858903 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:44.871928 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46da8421-9936-4d3f-9eca-cc4ccd858903 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:44.872918 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46da8421-9936-4d3f-9eca-cc4ccd858903 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:44.873579 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46da8421-9936-4d3f-9eca-cc4ccd858903 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:44.874320 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46da8421-9936-4d3f-9eca-cc4ccd858903 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:45.045947 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-46da8421-9936-4d3f-9eca-cc4ccd858903 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:45.054839 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-46da8421-9936-4d3f-9eca-cc4ccd858903 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.197376 Sep 10 12:04:45.055761 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2546/5089] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:44 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:45.226273 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1f3a2059-126b-4fac-afc2-68abe3aea6ed tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-247074428", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "4cf2efdb-facd-4d46-b962-78192cf2010f"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:45.256192 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=18 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:04:45.373161 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.security_group_api [None req-1f3a2059-126b-4fac-afc2-68abe3aea6ed tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Neutron security group does_not_exist not found {{(pid=128776) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Sep 10 12:04:45.373766 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-1f3a2059-126b-4fac-afc2-68abe3aea6ed tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1f3a2059-126b-4fac-afc2-68abe3aea6ed tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 257 Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-247074428", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "4cf2efdb-facd-4d46-b962-78192cf2010f"}]}} Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: exception: Unable to find security_group with name or id 'does_not_exist' Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-247074428', 'imageRef': 'c23d4d62-7ab9-4623-9273-7f44582aa2e1', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '4cf2efdb-facd-4d46-b962-78192cf2010f'}]}}} Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Sep 10 12:04:45.384601 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:45.389958 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1f3a2059-126b-4fac-afc2-68abe3aea6ed tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:04:45.398896 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1f3a2059-126b-4fac-afc2-68abe3aea6ed tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.165371 Sep 10 12:04:45.398896 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2544/5090] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:04:45 2022] POST /compute/v2.1/servers => generated 106 bytes in 167 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 12:04:45.406282 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e92b2d43-3101-40a8-b797-1f467b220ae9 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:45.406495 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e92b2d43-3101-40a8-b797-1f467b220ae9 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:45.417409 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e92b2d43-3101-40a8-b797-1f467b220ae9 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:45.417978 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e92b2d43-3101-40a8-b797-1f467b220ae9 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:45.418554 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e92b2d43-3101-40a8-b797-1f467b220ae9 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:45.419304 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e92b2d43-3101-40a8-b797-1f467b220ae9 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:45.420084 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e92b2d43-3101-40a8-b797-1f467b220ae9 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:45.421376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e92b2d43-3101-40a8-b797-1f467b220ae9 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:45.480827 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-75784279-02f2-4a85-b383-955d3a0e4518 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:45.481376 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-75784279-02f2-4a85-b383-955d3a0e4518 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:45.490324 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75784279-02f2-4a85-b383-955d3a0e4518 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:45.490828 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75784279-02f2-4a85-b383-955d3a0e4518 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:45.491295 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75784279-02f2-4a85-b383-955d3a0e4518 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:45.492043 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75784279-02f2-4a85-b383-955d3a0e4518 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:45.492507 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75784279-02f2-4a85-b383-955d3a0e4518 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:45.495714 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75784279-02f2-4a85-b383-955d3a0e4518 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:45.691458 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e92b2d43-3101-40a8-b797-1f467b220ae9 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:45.701601 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e92b2d43-3101-40a8-b797-1f467b220ae9 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.305665 Sep 10 12:04:45.702772 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2547/5091] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:45 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:45.708027 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-af2c08bb-65d3-4695-b4af-171064b0e82f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:45.708872 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-af2c08bb-65d3-4695-b4af-171064b0e82f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:45.715706 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-af2c08bb-65d3-4695-b4af-171064b0e82f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:45.716714 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-af2c08bb-65d3-4695-b4af-171064b0e82f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:45.717315 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-af2c08bb-65d3-4695-b4af-171064b0e82f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:45.718287 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-af2c08bb-65d3-4695-b4af-171064b0e82f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:45.718903 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-af2c08bb-65d3-4695-b4af-171064b0e82f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:45.719519 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-af2c08bb-65d3-4695-b4af-171064b0e82f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:46.272233 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-af2c08bb-65d3-4695-b4af-171064b0e82f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:46.281154 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-af2c08bb-65d3-4695-b4af-171064b0e82f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:46.282596 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-af2c08bb-65d3-4695-b4af-171064b0e82f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:46.283836 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-af2c08bb-65d3-4695-b4af-171064b0e82f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739" status: 200 len: 1366 microversion: 2.47 time: 0.579888 Sep 10 12:04:46.284619 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2548/5092] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:04:45 2022] GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739 => generated 1366 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:04:46.308290 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0408e2b4-773d-4452-8720-a47be3ce55cf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:46.309946 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0408e2b4-773d-4452-8720-a47be3ce55cf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:46.316853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0408e2b4-773d-4452-8720-a47be3ce55cf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:46.317340 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0408e2b4-773d-4452-8720-a47be3ce55cf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:46.317931 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0408e2b4-773d-4452-8720-a47be3ce55cf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:46.318774 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0408e2b4-773d-4452-8720-a47be3ce55cf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:46.319512 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0408e2b4-773d-4452-8720-a47be3ce55cf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:46.320210 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0408e2b4-773d-4452-8720-a47be3ce55cf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:46.326368 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-75784279-02f2-4a85-b383-955d3a0e4518 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:46.335458 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-75784279-02f2-4a85-b383-955d3a0e4518 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1308 microversion: 2.1 time: 0.859345 Sep 10 12:04:46.339274 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2545/5093] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:45 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1308 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:04:46.619822 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0408e2b4-773d-4452-8720-a47be3ce55cf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:46.631946 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0408e2b4-773d-4452-8720-a47be3ce55cf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.329990 Sep 10 12:04:46.634900 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2549/5094] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:46 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:46.659136 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5ccf747c-6b0f-4997-9e10-803530d4a191 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:46.659690 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5ccf747c-6b0f-4997-9e10-803530d4a191 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: 6cced9e8-062d-49f4-aca8-0d059d59c49a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:46.674309 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-5ccf747c-6b0f-4997-9e10-803530d4a191 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] HTTP exception thrown: Instance 6cced9e8-062d-49f4-aca8-0d059d59c49a could not be found. Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5ccf747c-6b0f-4997-9e10-803530d4a191 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/servers/6cced9e8-062d-49f4-aca8-0d059d59c49a HTTP/1.1 Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 6cced9e8-062d-49f4-aca8-0d059d59c49a could not be found. Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '6cced9e8-062d-49f4-aca8-0d059d59c49a'} Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cced9e8-062d-49f4-aca8-0d059d59c49a could not be found. Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cced9e8-062d-49f4-aca8-0d059d59c49a could not be found. Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:46.675935 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:46.678977 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:46.678977 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:46.678977 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:46.678977 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:46.678977 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:04:46.678977 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:04:46.678977 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cced9e8-062d-49f4-aca8-0d059d59c49a could not be found. Sep 10 12:04:46.678977 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:46.678977 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5ccf747c-6b0f-4997-9e10-803530d4a191 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 404 to user: Instance 6cced9e8-062d-49f4-aca8-0d059d59c49a could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:04:46.678977 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5ccf747c-6b0f-4997-9e10-803530d4a191 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6cced9e8-062d-49f4-aca8-0d059d59c49a" status: 404 len: 111 microversion: 2.1 time: 0.022131 Sep 10 12:04:46.678977 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2546/5095] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:04:46 2022] DELETE /compute/v2.1/servers/6cced9e8-062d-49f4-aca8-0d059d59c49a => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:04:46.687588 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-084b6dda-660c-43c8-8a66-1d4f5dee388f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:46.688222 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-084b6dda-660c-43c8-8a66-1d4f5dee388f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:46.695925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-084b6dda-660c-43c8-8a66-1d4f5dee388f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:46.711881 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-084b6dda-660c-43c8-8a66-1d4f5dee388f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:46.712353 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-084b6dda-660c-43c8-8a66-1d4f5dee388f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:46.713116 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-084b6dda-660c-43c8-8a66-1d4f5dee388f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:46.713587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-084b6dda-660c-43c8-8a66-1d4f5dee388f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:46.714020 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-084b6dda-660c-43c8-8a66-1d4f5dee388f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:47.037708 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-084b6dda-660c-43c8-8a66-1d4f5dee388f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:47.046572 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-084b6dda-660c-43c8-8a66-1d4f5dee388f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.363795 Sep 10 12:04:47.051443 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2550/5096] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:46 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:47.074381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c1d1e624-6b24-4631-9d75-1dd53e9489b2 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:47.076007 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c1d1e624-6b24-4631-9d75-1dd53e9489b2 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:47.086750 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1d1e624-6b24-4631-9d75-1dd53e9489b2 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:47.087273 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1d1e624-6b24-4631-9d75-1dd53e9489b2 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:47.087720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1d1e624-6b24-4631-9d75-1dd53e9489b2 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:47.093276 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1d1e624-6b24-4631-9d75-1dd53e9489b2 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:47.093922 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1d1e624-6b24-4631-9d75-1dd53e9489b2 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:47.094371 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1d1e624-6b24-4631-9d75-1dd53e9489b2 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:47.281015 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c1d1e624-6b24-4631-9d75-1dd53e9489b2 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:47.290010 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c1d1e624-6b24-4631-9d75-1dd53e9489b2 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.219987 Sep 10 12:04:47.290594 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2547/5097] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:47 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:04:47.313632 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ee253244-5f9b-4a3b-92bb-bd2d3c394bde tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:47.314108 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ee253244-5f9b-4a3b-92bb-bd2d3c394bde tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Failed to fetch instance by id 9223372036854775808 {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 10 12:04:47.314628 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-ee253244-5f9b-4a3b-92bb-bd2d3c394bde tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ee253244-5f9b-4a3b-92bb-bd2d3c394bde tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 9223372036854775808 could not be found. Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '9223372036854775808'} Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:47.316182 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:47.319842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:47.319842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:04:47.319842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:04:47.319842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Sep 10 12:04:47.319842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:47.319842 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ee253244-5f9b-4a3b-92bb-bd2d3c394bde tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:04:47.319842 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ee253244-5f9b-4a3b-92bb-bd2d3c394bde tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.009832 Sep 10 12:04:47.328587 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-59ae7efb-cf04-4976-8a37-a66637e301f0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:47.329208 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-59ae7efb-cf04-4976-8a37-a66637e301f0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:47.338066 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2551/5098] 10.222.0.23 () {58 vars in 1188 bytes} [Sat Sep 10 12:04:47 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 12:04:47.340699 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-59ae7efb-cf04-4976-8a37-a66637e301f0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:47.341201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-59ae7efb-cf04-4976-8a37-a66637e301f0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:47.341736 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-59ae7efb-cf04-4976-8a37-a66637e301f0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:47.342339 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-59ae7efb-cf04-4976-8a37-a66637e301f0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:47.342797 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-59ae7efb-cf04-4976-8a37-a66637e301f0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:47.343254 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-59ae7efb-cf04-4976-8a37-a66637e301f0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:47.354100 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8a7a5109-19d8-412f-b49f-1b0c51ab03b1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:47.355782 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8a7a5109-19d8-412f-b49f-1b0c51ab03b1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:47.372425 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a7a5109-19d8-412f-b49f-1b0c51ab03b1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:47.373205 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a7a5109-19d8-412f-b49f-1b0c51ab03b1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:47.373658 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a7a5109-19d8-412f-b49f-1b0c51ab03b1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:47.374389 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a7a5109-19d8-412f-b49f-1b0c51ab03b1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:47.375826 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a7a5109-19d8-412f-b49f-1b0c51ab03b1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:47.376472 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a7a5109-19d8-412f-b49f-1b0c51ab03b1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:47.492092 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-59ae7efb-cf04-4976-8a37-a66637e301f0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:47.502084 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-59ae7efb-cf04-4976-8a37-a66637e301f0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:47.503710 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-59ae7efb-cf04-4976-8a37-a66637e301f0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:47.506881 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-59ae7efb-cf04-4976-8a37-a66637e301f0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739" status: 200 len: 1366 microversion: 2.47 time: 0.184594 Sep 10 12:04:47.507704 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2548/5099] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:04:47 2022] GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:04:47.523963 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bd0a7bee-0288-4948-bd19-9c976245da1b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:47.527478 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bd0a7bee-0288-4948-bd19-9c976245da1b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:47.547785 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd0a7bee-0288-4948-bd19-9c976245da1b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:47.549323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd0a7bee-0288-4948-bd19-9c976245da1b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:47.550123 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd0a7bee-0288-4948-bd19-9c976245da1b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:47.554641 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd0a7bee-0288-4948-bd19-9c976245da1b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:47.557313 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd0a7bee-0288-4948-bd19-9c976245da1b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:47.558402 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd0a7bee-0288-4948-bd19-9c976245da1b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:47.650236 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8a7a5109-19d8-412f-b49f-1b0c51ab03b1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:47.664412 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8a7a5109-19d8-412f-b49f-1b0c51ab03b1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.325012 Sep 10 12:04:47.665297 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2552/5100] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:47 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:47.697559 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b2db3f60-e5a0-41bd-9034-475618850c45 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:47.698313 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b2db3f60-e5a0-41bd-9034-475618850c45 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:47.706661 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b2db3f60-e5a0-41bd-9034-475618850c45 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:47.707623 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b2db3f60-e5a0-41bd-9034-475618850c45 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:47.708221 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b2db3f60-e5a0-41bd-9034-475618850c45 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:47.709091 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b2db3f60-e5a0-41bd-9034-475618850c45 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:47.709700 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b2db3f60-e5a0-41bd-9034-475618850c45 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:47.710265 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b2db3f60-e5a0-41bd-9034-475618850c45 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:47.941916 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bd0a7bee-0288-4948-bd19-9c976245da1b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:47.957757 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bd0a7bee-0288-4948-bd19-9c976245da1b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1308 microversion: 2.1 time: 0.447597 Sep 10 12:04:47.958584 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2549/5101] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:47 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1308 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:47.982420 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b2db3f60-e5a0-41bd-9034-475618850c45 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:47.990244 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b2db3f60-e5a0-41bd-9034-475618850c45 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.298354 Sep 10 12:04:47.991150 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2553/5102] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:47 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:48.013482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fa81b9a0-f46e-4a69-bc76-3c9e1febd26d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:48.014186 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fa81b9a0-f46e-4a69-bc76-3c9e1febd26d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Failed to fetch instance by id -1 {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 10 12:04:48.014839 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-fa81b9a0-f46e-4a69-bc76-3c9e1febd26d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] HTTP exception thrown: Instance -1 could not be found. Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fa81b9a0-f46e-4a69-bc76-3c9e1febd26d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance -1 could not be found. Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '-1'} Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:48.016525 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:48.020081 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:04:48.020081 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:04:48.020081 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Sep 10 12:04:48.020081 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:48.020926 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fa81b9a0-f46e-4a69-bc76-3c9e1febd26d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 404 to user: Instance -1 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:04:48.022079 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fa81b9a0-f46e-4a69-bc76-3c9e1febd26d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.012577 Sep 10 12:04:48.026287 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2550/5103] 10.222.0.23 () {58 vars in 1137 bytes} [Sat Sep 10 12:04:48 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 12:04:48.032171 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-28c5c8e9-4b49-4159-97da-029232f3e1f6 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:48.032888 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-28c5c8e9-4b49-4159-97da-029232f3e1f6 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:48.039064 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28c5c8e9-4b49-4159-97da-029232f3e1f6 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:48.039702 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28c5c8e9-4b49-4159-97da-029232f3e1f6 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:48.040147 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28c5c8e9-4b49-4159-97da-029232f3e1f6 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:48.040862 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28c5c8e9-4b49-4159-97da-029232f3e1f6 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:48.041400 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28c5c8e9-4b49-4159-97da-029232f3e1f6 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:48.043388 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28c5c8e9-4b49-4159-97da-029232f3e1f6 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:48.242879 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-28c5c8e9-4b49-4159-97da-029232f3e1f6 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:48.256676 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-28c5c8e9-4b49-4159-97da-029232f3e1f6 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.229225 Sep 10 12:04:48.257849 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2554/5104] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:48 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:04:48.283458 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fa7711d8-762d-4ff1-810f-f4eaf8a96dc8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:48.284222 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fa7711d8-762d-4ff1-810f-f4eaf8a96dc8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:48.293682 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa7711d8-762d-4ff1-810f-f4eaf8a96dc8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:48.294690 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa7711d8-762d-4ff1-810f-f4eaf8a96dc8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:48.295349 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa7711d8-762d-4ff1-810f-f4eaf8a96dc8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:48.296268 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa7711d8-762d-4ff1-810f-f4eaf8a96dc8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:48.296902 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa7711d8-762d-4ff1-810f-f4eaf8a96dc8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:48.297509 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa7711d8-762d-4ff1-810f-f4eaf8a96dc8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:48.537749 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8c5e7f69-0903-41d1-b995-290221923410 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:48.538524 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8c5e7f69-0903-41d1-b995-290221923410 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:48.541541 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fa7711d8-762d-4ff1-810f-f4eaf8a96dc8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:48.553795 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c5e7f69-0903-41d1-b995-290221923410 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:48.554309 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c5e7f69-0903-41d1-b995-290221923410 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:48.554748 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c5e7f69-0903-41d1-b995-290221923410 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:48.556860 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fa7711d8-762d-4ff1-810f-f4eaf8a96dc8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.277247 Sep 10 12:04:48.558282 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2551/5105] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:48 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:04:48.564140 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c5e7f69-0903-41d1-b995-290221923410 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:48.565828 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c5e7f69-0903-41d1-b995-290221923410 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:48.566486 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c5e7f69-0903-41d1-b995-290221923410 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:48.582881 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-abf3a77a-8689-4fcd-84be-7be3182b6162 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:48.584070 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-abf3a77a-8689-4fcd-84be-7be3182b6162 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: 4a7456df-4076-4920-a460-28ca9becae23] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:48.606959 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-abf3a77a-8689-4fcd-84be-7be3182b6162 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] HTTP exception thrown: Instance 4a7456df-4076-4920-a460-28ca9becae23 could not be found. Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-abf3a77a-8689-4fcd-84be-7be3182b6162 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/servers/4a7456df-4076-4920-a460-28ca9becae23/action HTTP/1.1 Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 19 Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: {"forceDelete": {}} Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 4a7456df-4076-4920-a460-28ca9becae23 could not be found. Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '4a7456df-4076-4920-a460-28ca9becae23', 'body': {'forceDelete': {}}} Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a7456df-4076-4920-a460-28ca9becae23 could not be found. Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a7456df-4076-4920-a460-28ca9becae23 could not be found. Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:48.620747 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:48.624396 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:04:48.624396 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:04:48.624396 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a7456df-4076-4920-a460-28ca9becae23 could not be found. Sep 10 12:04:48.624396 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:48.627024 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-abf3a77a-8689-4fcd-84be-7be3182b6162 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 404 to user: Instance 4a7456df-4076-4920-a460-28ca9becae23 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:04:48.629213 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-abf3a77a-8689-4fcd-84be-7be3182b6162 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "POST /compute/v2.1/servers/4a7456df-4076-4920-a460-28ca9becae23/action" status: 404 len: 111 microversion: 2.1 time: 0.052423 Sep 10 12:04:48.630368 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2552/5106] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:04:48 2022] POST /compute/v2.1/servers/4a7456df-4076-4920-a460-28ca9becae23/action => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 12:04:48.639979 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-351e141d-9687-45d5-81c4-9e8599caa152 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:48.640602 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-351e141d-9687-45d5-81c4-9e8599caa152 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:48.660436 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-351e141d-9687-45d5-81c4-9e8599caa152 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:48.662091 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-351e141d-9687-45d5-81c4-9e8599caa152 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:48.662900 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-351e141d-9687-45d5-81c4-9e8599caa152 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:48.664488 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-351e141d-9687-45d5-81c4-9e8599caa152 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:48.665131 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-351e141d-9687-45d5-81c4-9e8599caa152 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:48.665864 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-351e141d-9687-45d5-81c4-9e8599caa152 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:48.701672 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8c5e7f69-0903-41d1-b995-290221923410 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:48.711610 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8c5e7f69-0903-41d1-b995-290221923410 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:48.713591 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8c5e7f69-0903-41d1-b995-290221923410 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:48.714833 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8c5e7f69-0903-41d1-b995-290221923410 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739" status: 200 len: 1366 microversion: 2.47 time: 0.181750 Sep 10 12:04:48.727821 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2555/5107] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:04:48 2022] GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:04:48.934488 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-351e141d-9687-45d5-81c4-9e8599caa152 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:48.958351 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-351e141d-9687-45d5-81c4-9e8599caa152 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.323704 Sep 10 12:04:48.959545 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2553/5108] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:48 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:04:48.985613 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b60a678c-be65-48a3-bafd-9fb72351f25a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:48.987462 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b60a678c-be65-48a3-bafd-9fb72351f25a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:48.987734 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b22f7fe9-e138-4e1a-885d-01eba56dcedf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:48.988408 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b22f7fe9-e138-4e1a-885d-01eba56dcedf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:48.997732 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b60a678c-be65-48a3-bafd-9fb72351f25a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:48.998706 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b60a678c-be65-48a3-bafd-9fb72351f25a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:48.999846 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b60a678c-be65-48a3-bafd-9fb72351f25a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:49.001292 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b60a678c-be65-48a3-bafd-9fb72351f25a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:49.002570 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b22f7fe9-e138-4e1a-885d-01eba56dcedf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:49.002967 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b60a678c-be65-48a3-bafd-9fb72351f25a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:49.005145 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b22f7fe9-e138-4e1a-885d-01eba56dcedf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:49.005613 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b22f7fe9-e138-4e1a-885d-01eba56dcedf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:49.006094 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b60a678c-be65-48a3-bafd-9fb72351f25a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:49.006647 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b22f7fe9-e138-4e1a-885d-01eba56dcedf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:49.007121 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b22f7fe9-e138-4e1a-885d-01eba56dcedf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:49.007968 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b22f7fe9-e138-4e1a-885d-01eba56dcedf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:49.263725 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b60a678c-be65-48a3-bafd-9fb72351f25a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:49.272629 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b60a678c-be65-48a3-bafd-9fb72351f25a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1308 microversion: 2.1 time: 0.293387 Sep 10 12:04:49.273570 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2556/5109] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:48 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1308 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:49.280658 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b22f7fe9-e138-4e1a-885d-01eba56dcedf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:49.288541 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b22f7fe9-e138-4e1a-885d-01eba56dcedf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.305559 Sep 10 12:04:49.289106 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2554/5110] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:48 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:49.310883 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-eafb3ace-a176-4a53-a6e9-58be107d41c3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:49.313273 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-eafb3ace-a176-4a53-a6e9-58be107d41c3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: c24dc1f5-1b3d-4afb-8de8-0ce3b328d7a6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:49.318678 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-eafb3ace-a176-4a53-a6e9-58be107d41c3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] HTTP exception thrown: Instance c24dc1f5-1b3d-4afb-8de8-0ce3b328d7a6 could not be found. Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-eafb3ace-a176-4a53-a6e9-58be107d41c3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers/c24dc1f5-1b3d-4afb-8de8-0ce3b328d7a6/action HTTP/1.1 Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 39 Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: {"os-getConsoleOutput": {"length": 10}} Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance c24dc1f5-1b3d-4afb-8de8-0ce3b328d7a6 could not be found. Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'c24dc1f5-1b3d-4afb-8de8-0ce3b328d7a6', 'body': {'os-getConsoleOutput': {'length': 10}}} Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c24dc1f5-1b3d-4afb-8de8-0ce3b328d7a6 could not be found. Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c24dc1f5-1b3d-4afb-8de8-0ce3b328d7a6 could not be found. Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:49.323364 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:49.327809 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:49.327809 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:49.327809 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:04:49.327809 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:04:49.327809 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c24dc1f5-1b3d-4afb-8de8-0ce3b328d7a6 could not be found. Sep 10 12:04:49.327809 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:49.327809 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-eafb3ace-a176-4a53-a6e9-58be107d41c3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 404 to user: Instance c24dc1f5-1b3d-4afb-8de8-0ce3b328d7a6 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:04:49.327809 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-eafb3ace-a176-4a53-a6e9-58be107d41c3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "POST /compute/v2.1/servers/c24dc1f5-1b3d-4afb-8de8-0ce3b328d7a6/action" status: 404 len: 111 microversion: 2.1 time: 0.019067 Sep 10 12:04:49.327809 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2557/5111] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:04:49 2022] POST /compute/v2.1/servers/c24dc1f5-1b3d-4afb-8de8-0ce3b328d7a6/action => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:04:49.334589 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-55a620bf-1bde-4197-a1f5-b87de8e70d72 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:49.335236 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-55a620bf-1bde-4197-a1f5-b87de8e70d72 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:49.344747 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55a620bf-1bde-4197-a1f5-b87de8e70d72 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:49.345240 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55a620bf-1bde-4197-a1f5-b87de8e70d72 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:49.345683 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55a620bf-1bde-4197-a1f5-b87de8e70d72 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:49.346394 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55a620bf-1bde-4197-a1f5-b87de8e70d72 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:49.346817 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55a620bf-1bde-4197-a1f5-b87de8e70d72 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:49.347266 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55a620bf-1bde-4197-a1f5-b87de8e70d72 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:49.511283 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-55a620bf-1bde-4197-a1f5-b87de8e70d72 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:49.519592 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-55a620bf-1bde-4197-a1f5-b87de8e70d72 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.188808 Sep 10 12:04:49.520100 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2555/5112] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:49 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:49.548886 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8d4c449c-e8ae-4d83-8619-c3bc9083840c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:49.550656 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8d4c449c-e8ae-4d83-8619-c3bc9083840c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:49.556516 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8d4c449c-e8ae-4d83-8619-c3bc9083840c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:49.557005 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8d4c449c-e8ae-4d83-8619-c3bc9083840c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:49.557447 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8d4c449c-e8ae-4d83-8619-c3bc9083840c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:49.558214 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8d4c449c-e8ae-4d83-8619-c3bc9083840c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:49.558925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8d4c449c-e8ae-4d83-8619-c3bc9083840c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:49.559407 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8d4c449c-e8ae-4d83-8619-c3bc9083840c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:49.563579 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:04:49.741591 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a5b7874f-a48a-49b3-b4ab-5dacce7ad180 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:49.742211 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a5b7874f-a48a-49b3-b4ab-5dacce7ad180 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:49.750852 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a5b7874f-a48a-49b3-b4ab-5dacce7ad180 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:49.755953 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a5b7874f-a48a-49b3-b4ab-5dacce7ad180 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:49.756447 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a5b7874f-a48a-49b3-b4ab-5dacce7ad180 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:49.757232 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a5b7874f-a48a-49b3-b4ab-5dacce7ad180 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:49.757699 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a5b7874f-a48a-49b3-b4ab-5dacce7ad180 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:49.758133 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a5b7874f-a48a-49b3-b4ab-5dacce7ad180 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:49.893274 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8d4c449c-e8ae-4d83-8619-c3bc9083840c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:49.895819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a5b7874f-a48a-49b3-b4ab-5dacce7ad180 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:49.905568 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8d4c449c-e8ae-4d83-8619-c3bc9083840c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.363997 Sep 10 12:04:49.906930 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2558/5113] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:49 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:49.928095 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a5b7874f-a48a-49b3-b4ab-5dacce7ad180 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:49.932096 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-095346c0-e13b-4ee2-a8b3-763ad87c4ebd tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:49.932436 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a5b7874f-a48a-49b3-b4ab-5dacce7ad180 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:49.933503 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-095346c0-e13b-4ee2-a8b3-763ad87c4ebd tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: 4ac51dcd-6a17-44bd-bdcd-c387ea9ffefb] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:49.933756 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a5b7874f-a48a-49b3-b4ab-5dacce7ad180 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739" status: 200 len: 1366 microversion: 2.47 time: 0.196070 Sep 10 12:04:49.934562 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2556/5114] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:04:49 2022] GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 12:04:49.940189 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-095346c0-e13b-4ee2-a8b3-763ad87c4ebd tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] HTTP exception thrown: Instance 4ac51dcd-6a17-44bd-bdcd-c387ea9ffefb could not be found. Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-095346c0-e13b-4ee2-a8b3-763ad87c4ebd tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/4ac51dcd-6a17-44bd-bdcd-c387ea9ffefb HTTP/1.1 Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 4ac51dcd-6a17-44bd-bdcd-c387ea9ffefb could not be found. Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '4ac51dcd-6a17-44bd-bdcd-c387ea9ffefb'} Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ac51dcd-6a17-44bd-bdcd-c387ea9ffefb could not be found. Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ac51dcd-6a17-44bd-bdcd-c387ea9ffefb could not be found. Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:49.943197 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:49.946794 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:49.946794 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:04:49.946794 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:04:49.946794 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ac51dcd-6a17-44bd-bdcd-c387ea9ffefb could not be found. Sep 10 12:04:49.946794 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:49.948203 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-095346c0-e13b-4ee2-a8b3-763ad87c4ebd tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 404 to user: Instance 4ac51dcd-6a17-44bd-bdcd-c387ea9ffefb could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:04:49.949907 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-095346c0-e13b-4ee2-a8b3-763ad87c4ebd tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/4ac51dcd-6a17-44bd-bdcd-c387ea9ffefb" status: 404 len: 111 microversion: 2.1 time: 0.022964 Sep 10 12:04:49.951180 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2559/5115] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:49 2022] GET /compute/v2.1/servers/4ac51dcd-6a17-44bd-bdcd-c387ea9ffefb => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:04:49.960471 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0ad07a81-b161-472d-8b6d-92b411ef43df tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:49.961609 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0ad07a81-b161-472d-8b6d-92b411ef43df tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:49.973674 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ad07a81-b161-472d-8b6d-92b411ef43df tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:49.974323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ad07a81-b161-472d-8b6d-92b411ef43df tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:49.974931 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ad07a81-b161-472d-8b6d-92b411ef43df tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:49.976287 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ad07a81-b161-472d-8b6d-92b411ef43df tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:49.976897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ad07a81-b161-472d-8b6d-92b411ef43df tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:49.977745 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ad07a81-b161-472d-8b6d-92b411ef43df tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:50.254808 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0ad07a81-b161-472d-8b6d-92b411ef43df tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:50.264755 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0ad07a81-b161-472d-8b6d-92b411ef43df tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.308311 Sep 10 12:04:50.265495 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2557/5116] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:49 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:50.288886 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9cb889b3-1244-4372-8cb4-bb139c4be275 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:50.289413 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9cb889b3-1244-4372-8cb4-bb139c4be275 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:50.296524 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3a7c64bf-b2a6-4673-8e47-25c956a59f5a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:50.297246 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3a7c64bf-b2a6-4673-8e47-25c956a59f5a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:50.297991 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9cb889b3-1244-4372-8cb4-bb139c4be275 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:50.298798 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9cb889b3-1244-4372-8cb4-bb139c4be275 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:50.299478 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9cb889b3-1244-4372-8cb4-bb139c4be275 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:50.300585 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9cb889b3-1244-4372-8cb4-bb139c4be275 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:50.301395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9cb889b3-1244-4372-8cb4-bb139c4be275 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:50.302054 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9cb889b3-1244-4372-8cb4-bb139c4be275 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:50.307695 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3a7c64bf-b2a6-4673-8e47-25c956a59f5a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:50.308989 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3a7c64bf-b2a6-4673-8e47-25c956a59f5a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:50.309589 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3a7c64bf-b2a6-4673-8e47-25c956a59f5a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:50.310303 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3a7c64bf-b2a6-4673-8e47-25c956a59f5a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:50.311034 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3a7c64bf-b2a6-4673-8e47-25c956a59f5a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:50.311651 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3a7c64bf-b2a6-4673-8e47-25c956a59f5a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:50.625740 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3a7c64bf-b2a6-4673-8e47-25c956a59f5a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:50.642424 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9cb889b3-1244-4372-8cb4-bb139c4be275 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:50.647835 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3a7c64bf-b2a6-4673-8e47-25c956a59f5a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1308 microversion: 2.1 time: 0.346967 Sep 10 12:04:50.657080 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2558/5117] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:50 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1308 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:04:50.675384 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9cb889b3-1244-4372-8cb4-bb139c4be275 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.390980 Sep 10 12:04:50.677164 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2560/5118] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:50 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:50.826435 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e28c4394-5066-4810-8028-14a8209020d3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1066231881", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "4cf2efdb-facd-4d46-b962-78192cf2010f"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e28c4394-5066-4810-8028-14a8209020d3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 238 Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1066231881", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "4cf2efdb-facd-4d46-b962-78192cf2010f"}]}} Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1066231881', 'imageRef': 'c23d4d62-7ab9-4623-9273-7f44582aa2e1', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '4cf2efdb-facd-4d46-b962-78192cf2010f'}]}}} Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise error Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:50.845809 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:50.849061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:50.849061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:50.849061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:04:50.849061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:04:50.849061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:04:50.849061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:04:50.849061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:04:50.849061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:04:50.849061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 12:04:50.849061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 12:04:50.849061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 12:04:50.849061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 12:04:50.849061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 12:04:50.849061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 12:04:50.849061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 10 12:04:50.849061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:50.849061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:50.849061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:50.849061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:50.849061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:50.849061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:50.849061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 12:04:50.849061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 12:04:50.849061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 10 12:04:50.849061 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:50.853546 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e28c4394-5066-4810-8028-14a8209020d3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:04:50.855573 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e28c4394-5066-4810-8028-14a8209020d3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.036604 Sep 10 12:04:50.857599 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2559/5119] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:04:50 2022] POST /compute/v2.1/servers => generated 139 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 12:04:50.868146 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ac2a8dd6-6250-4ef5-b1d2-1aaf2e7e03b9 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:50.868974 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ac2a8dd6-6250-4ef5-b1d2-1aaf2e7e03b9 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:50.880072 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac2a8dd6-6250-4ef5-b1d2-1aaf2e7e03b9 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:50.881661 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac2a8dd6-6250-4ef5-b1d2-1aaf2e7e03b9 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:50.882501 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac2a8dd6-6250-4ef5-b1d2-1aaf2e7e03b9 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:50.883447 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac2a8dd6-6250-4ef5-b1d2-1aaf2e7e03b9 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:50.884981 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac2a8dd6-6250-4ef5-b1d2-1aaf2e7e03b9 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:50.885511 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac2a8dd6-6250-4ef5-b1d2-1aaf2e7e03b9 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:50.960619 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a4d5f30d-2af7-4cc1-81c2-bc7cf1e13726 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:50.961620 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a4d5f30d-2af7-4cc1-81c2-bc7cf1e13726 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:50.970631 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a4d5f30d-2af7-4cc1-81c2-bc7cf1e13726 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:50.971296 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a4d5f30d-2af7-4cc1-81c2-bc7cf1e13726 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:50.971979 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a4d5f30d-2af7-4cc1-81c2-bc7cf1e13726 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:50.972867 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a4d5f30d-2af7-4cc1-81c2-bc7cf1e13726 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:50.973522 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a4d5f30d-2af7-4cc1-81c2-bc7cf1e13726 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:50.974159 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a4d5f30d-2af7-4cc1-81c2-bc7cf1e13726 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:51.085062 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a4d5f30d-2af7-4cc1-81c2-bc7cf1e13726 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:51.098950 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a4d5f30d-2af7-4cc1-81c2-bc7cf1e13726 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:51.110493 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a4d5f30d-2af7-4cc1-81c2-bc7cf1e13726 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:51.112326 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a4d5f30d-2af7-4cc1-81c2-bc7cf1e13726 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739" status: 200 len: 1366 microversion: 2.47 time: 0.155593 Sep 10 12:04:51.113941 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2560/5120] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:04:50 2022] GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 12:04:51.225060 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ac2a8dd6-6250-4ef5-b1d2-1aaf2e7e03b9 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:51.245383 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ac2a8dd6-6250-4ef5-b1d2-1aaf2e7e03b9 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.380339 Sep 10 12:04:51.249013 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2561/5121] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:50 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:51.279420 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2a3fefaa-6470-47ac-82e9-f7011983f244 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:51.280040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2a3fefaa-6470-47ac-82e9-f7011983f244 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:51.290633 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a3fefaa-6470-47ac-82e9-f7011983f244 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:51.291132 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a3fefaa-6470-47ac-82e9-f7011983f244 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:51.291605 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a3fefaa-6470-47ac-82e9-f7011983f244 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:51.292326 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a3fefaa-6470-47ac-82e9-f7011983f244 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:51.293502 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a3fefaa-6470-47ac-82e9-f7011983f244 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:51.293953 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a3fefaa-6470-47ac-82e9-f7011983f244 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:51.472647 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-18fd4b4e-a625-4ceb-936d-701c76e85996 req-9f228d3b-6afc-423f-934a-e6a484be5a9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2da647c-6fe1-4674-9b1f-7f54bd2d3b15", "name": "network-vif-plugged", "status": "completed", "tag": "aaea91dd-f8c4-4f10-b87a-80388d1b174f"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:51.485282 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-18fd4b4e-a625-4ceb-936d-701c76e85996 req-9f228d3b-6afc-423f-934a-e6a484be5a9d service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:51.486206 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-18fd4b4e-a625-4ceb-936d-701c76e85996 req-9f228d3b-6afc-423f-934a-e6a484be5a9d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:51.486803 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-18fd4b4e-a625-4ceb-936d-701c76e85996 req-9f228d3b-6afc-423f-934a-e6a484be5a9d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:51.501306 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-18fd4b4e-a625-4ceb-936d-701c76e85996 req-9f228d3b-6afc-423f-934a-e6a484be5a9d service nova] Creating event network-vif-plugged:aaea91dd-f8c4-4f10-b87a-80388d1b174f for instance f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 on n-h1-856895-1 Sep 10 12:04:51.508307 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-18fd4b4e-a625-4ceb-936d-701c76e85996 req-9f228d3b-6afc-423f-934a-e6a484be5a9d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.293472 Sep 10 12:04:51.514146 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2561/5122] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:04:51.609879 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2a3fefaa-6470-47ac-82e9-f7011983f244 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:51.629368 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2a3fefaa-6470-47ac-82e9-f7011983f244 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.353215 Sep 10 12:04:51.631409 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2562/5123] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:51 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:51.688171 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-00a8e4e3-c70d-4a86-bd1c-07ca39b98dec tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:51.689623 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-00a8e4e3-c70d-4a86-bd1c-07ca39b98dec tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:51.708868 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00a8e4e3-c70d-4a86-bd1c-07ca39b98dec tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:51.709587 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00a8e4e3-c70d-4a86-bd1c-07ca39b98dec tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:51.710652 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00a8e4e3-c70d-4a86-bd1c-07ca39b98dec tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:51.710837 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00a8e4e3-c70d-4a86-bd1c-07ca39b98dec tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:51.711476 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00a8e4e3-c70d-4a86-bd1c-07ca39b98dec tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:51.711908 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00a8e4e3-c70d-4a86-bd1c-07ca39b98dec tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:51.733831 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:04:51.838956 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-799c9682-67b7-4cea-8fd6-f4887dfde052 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1609159278", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "4cf2efdb-facd-4d46-b962-78192cf2010f"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-799c9682-67b7-4cea-8fd6-f4887dfde052 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 235 Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1609159278", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "4cf2efdb-facd-4d46-b962-78192cf2010f"}]}} Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1609159278', 'imageRef': 'c23d4d62-7ab9-4623-9273-7f44582aa2e1', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '4cf2efdb-facd-4d46-b962-78192cf2010f'}]}}} Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise error Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi 'notvalid' Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:51.844973 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:51.848180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:51.848180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:51.848180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:04:51.848180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:04:51.848180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:04:51.848180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:04:51.848180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:04:51.848180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:04:51.848180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 12:04:51.848180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 12:04:51.848180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 12:04:51.848180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 12:04:51.848180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 12:04:51.848180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 12:04:51.848180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 10 12:04:51.848180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:51.848180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:51.848180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:51.848180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:51.848180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:51.848180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:51.848180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 12:04:51.848180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 12:04:51.848180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 10 12:04:51.848180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:51.854330 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-799c9682-67b7-4cea-8fd6-f4887dfde052 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:04:51.856321 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-799c9682-67b7-4cea-8fd6-f4887dfde052 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.020871 Sep 10 12:04:51.857033 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2563/5124] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:04:51 2022] POST /compute/v2.1/servers => generated 133 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 12:04:51.873200 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1faa70e3-2b3f-4eb8-a2aa-bd983657375e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:51.876868 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1faa70e3-2b3f-4eb8-a2aa-bd983657375e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:51.884869 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1faa70e3-2b3f-4eb8-a2aa-bd983657375e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:51.885374 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1faa70e3-2b3f-4eb8-a2aa-bd983657375e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:51.885936 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1faa70e3-2b3f-4eb8-a2aa-bd983657375e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:51.886793 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1faa70e3-2b3f-4eb8-a2aa-bd983657375e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:51.887301 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1faa70e3-2b3f-4eb8-a2aa-bd983657375e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:51.887743 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1faa70e3-2b3f-4eb8-a2aa-bd983657375e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:51.950280 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-00a8e4e3-c70d-4a86-bd1c-07ca39b98dec tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:51.961228 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-00a8e4e3-c70d-4a86-bd1c-07ca39b98dec tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1308 microversion: 2.1 time: 0.282549 Sep 10 12:04:51.963951 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2562/5125] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:51 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1308 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:52.090429 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1faa70e3-2b3f-4eb8-a2aa-bd983657375e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:52.098942 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1faa70e3-2b3f-4eb8-a2aa-bd983657375e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.236726 Sep 10 12:04:52.099636 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2564/5126] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:51 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:04:52.126242 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9f47d941-f6e3-466d-aafd-55adb15bb7e8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:52.126763 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9f47d941-f6e3-466d-aafd-55adb15bb7e8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:52.133043 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9f47d941-f6e3-466d-aafd-55adb15bb7e8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:52.133587 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9f47d941-f6e3-466d-aafd-55adb15bb7e8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:52.134025 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9f47d941-f6e3-466d-aafd-55adb15bb7e8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:52.134872 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9f47d941-f6e3-466d-aafd-55adb15bb7e8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:52.135500 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9f47d941-f6e3-466d-aafd-55adb15bb7e8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:52.136835 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9f47d941-f6e3-466d-aafd-55adb15bb7e8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:52.146396 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6cf2a949-4913-4c91-8d8c-7c82f856d1d6 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:52.147410 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6cf2a949-4913-4c91-8d8c-7c82f856d1d6 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:52.153905 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6cf2a949-4913-4c91-8d8c-7c82f856d1d6 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:52.154636 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6cf2a949-4913-4c91-8d8c-7c82f856d1d6 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:52.155372 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6cf2a949-4913-4c91-8d8c-7c82f856d1d6 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:52.156036 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6cf2a949-4913-4c91-8d8c-7c82f856d1d6 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:52.156648 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6cf2a949-4913-4c91-8d8c-7c82f856d1d6 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:52.157075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6cf2a949-4913-4c91-8d8c-7c82f856d1d6 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:52.257527 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6cf2a949-4913-4c91-8d8c-7c82f856d1d6 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:52.269400 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6cf2a949-4913-4c91-8d8c-7c82f856d1d6 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:52.270855 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6cf2a949-4913-4c91-8d8c-7c82f856d1d6 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:52.272092 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6cf2a949-4913-4c91-8d8c-7c82f856d1d6 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739" status: 200 len: 1366 microversion: 2.47 time: 0.136217 Sep 10 12:04:52.272659 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2565/5127] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:04:52 2022] GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739 => generated 1366 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:04:52.380538 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9f47d941-f6e3-466d-aafd-55adb15bb7e8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:52.390427 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9f47d941-f6e3-466d-aafd-55adb15bb7e8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.268316 Sep 10 12:04:52.391120 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2563/5128] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:52 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:52.412962 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bd96a873-ae8b-480a-876f-7a3c3e2f8e1f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:52.413505 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bd96a873-ae8b-480a-876f-7a3c3e2f8e1f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: f7047242-67c0-4b12-a43c-e7c7d94e74b7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:52.419461 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-bd96a873-ae8b-480a-876f-7a3c3e2f8e1f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] HTTP exception thrown: Instance f7047242-67c0-4b12-a43c-e7c7d94e74b7 could not be found. Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bd96a873-ae8b-480a-876f-7a3c3e2f8e1f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers/f7047242-67c0-4b12-a43c-e7c7d94e74b7/action HTTP/1.1 Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 13 Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: {"pause": {}} Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance f7047242-67c0-4b12-a43c-e7c7d94e74b7 could not be found. Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'f7047242-67c0-4b12-a43c-e7c7d94e74b7', 'body': {'pause': {}}} Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7047242-67c0-4b12-a43c-e7c7d94e74b7 could not be found. Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7047242-67c0-4b12-a43c-e7c7d94e74b7 could not be found. Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:52.423904 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:52.427069 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:04:52.427069 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:04:52.427069 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7047242-67c0-4b12-a43c-e7c7d94e74b7 could not be found. Sep 10 12:04:52.427069 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:52.427069 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bd96a873-ae8b-480a-876f-7a3c3e2f8e1f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 404 to user: Instance f7047242-67c0-4b12-a43c-e7c7d94e74b7 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:04:52.427069 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bd96a873-ae8b-480a-876f-7a3c3e2f8e1f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "POST /compute/v2.1/servers/f7047242-67c0-4b12-a43c-e7c7d94e74b7/action" status: 404 len: 111 microversion: 2.1 time: 0.016634 Sep 10 12:04:52.429431 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2566/5129] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:04:52 2022] POST /compute/v2.1/servers/f7047242-67c0-4b12-a43c-e7c7d94e74b7/action => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:04:52.438328 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-37b2910a-0244-433c-9b27-3a6d27ae1bb8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:52.439275 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-37b2910a-0244-433c-9b27-3a6d27ae1bb8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:52.446145 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-37b2910a-0244-433c-9b27-3a6d27ae1bb8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:52.446725 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-37b2910a-0244-433c-9b27-3a6d27ae1bb8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:52.447307 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-37b2910a-0244-433c-9b27-3a6d27ae1bb8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:52.448231 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-37b2910a-0244-433c-9b27-3a6d27ae1bb8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:52.450056 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-37b2910a-0244-433c-9b27-3a6d27ae1bb8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:52.450773 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-37b2910a-0244-433c-9b27-3a6d27ae1bb8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:52.655799 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-37b2910a-0244-433c-9b27-3a6d27ae1bb8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:52.665692 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-37b2910a-0244-433c-9b27-3a6d27ae1bb8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.231066 Sep 10 12:04:52.667108 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2564/5130] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:52 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:52.693468 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c9a2f2ab-3419-459a-9f57-96478b760798 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:52.694938 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c9a2f2ab-3419-459a-9f57-96478b760798 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:52.703759 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c9a2f2ab-3419-459a-9f57-96478b760798 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:52.704828 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c9a2f2ab-3419-459a-9f57-96478b760798 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:52.705618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c9a2f2ab-3419-459a-9f57-96478b760798 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:52.707728 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c9a2f2ab-3419-459a-9f57-96478b760798 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:52.708431 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c9a2f2ab-3419-459a-9f57-96478b760798 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:52.709072 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c9a2f2ab-3419-459a-9f57-96478b760798 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:52.939815 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c9a2f2ab-3419-459a-9f57-96478b760798 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:52.949579 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c9a2f2ab-3419-459a-9f57-96478b760798 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.260327 Sep 10 12:04:52.950485 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2567/5131] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:52 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:52.973767 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-535d3e2c-de57-4687-ac81-ce6f6b7c3da1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:52.974303 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-535d3e2c-de57-4687-ac81-ce6f6b7c3da1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:52.982494 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-535d3e2c-de57-4687-ac81-ce6f6b7c3da1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:52.983615 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-535d3e2c-de57-4687-ac81-ce6f6b7c3da1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:52.984218 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-535d3e2c-de57-4687-ac81-ce6f6b7c3da1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:52.985124 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-535d3e2c-de57-4687-ac81-ce6f6b7c3da1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:52.985735 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-535d3e2c-de57-4687-ac81-ce6f6b7c3da1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:52.986317 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-535d3e2c-de57-4687-ac81-ce6f6b7c3da1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:52.989405 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6281017c-66a0-4f01-8eed-7be87bd8fd17 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:52.990175 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6281017c-66a0-4f01-8eed-7be87bd8fd17 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:53.005751 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6281017c-66a0-4f01-8eed-7be87bd8fd17 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:53.010868 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6281017c-66a0-4f01-8eed-7be87bd8fd17 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:53.011661 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6281017c-66a0-4f01-8eed-7be87bd8fd17 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:53.012518 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6281017c-66a0-4f01-8eed-7be87bd8fd17 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:53.013928 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6281017c-66a0-4f01-8eed-7be87bd8fd17 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:53.014608 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6281017c-66a0-4f01-8eed-7be87bd8fd17 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:53.139577 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-535d3e2c-de57-4687-ac81-ce6f6b7c3da1 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "POST /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004/action" status: 202 len: 0 microversion: 2.1 time: 0.169636 Sep 10 12:04:53.142755 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2565/5132] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:04:52 2022] POST /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:04:53.149303 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ba7826d8-6af3-436b-b8cd-e5dfc6f8b6bc tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:53.150241 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ba7826d8-6af3-436b-b8cd-e5dfc6f8b6bc tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:53.158018 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ba7826d8-6af3-436b-b8cd-e5dfc6f8b6bc tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:53.158665 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ba7826d8-6af3-436b-b8cd-e5dfc6f8b6bc tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:53.159360 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ba7826d8-6af3-436b-b8cd-e5dfc6f8b6bc tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:53.160209 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ba7826d8-6af3-436b-b8cd-e5dfc6f8b6bc tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:53.160899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ba7826d8-6af3-436b-b8cd-e5dfc6f8b6bc tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:53.161560 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ba7826d8-6af3-436b-b8cd-e5dfc6f8b6bc tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:53.540431 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6281017c-66a0-4f01-8eed-7be87bd8fd17 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:53.549569 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6281017c-66a0-4f01-8eed-7be87bd8fd17 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1308 microversion: 2.1 time: 0.567420 Sep 10 12:04:53.566832 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2568/5133] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:52 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1308 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:53.573034 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3d30da93-b1cf-40d7-a01b-112f8be7b258 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:53.574527 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3d30da93-b1cf-40d7-a01b-112f8be7b258 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:53.581583 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d30da93-b1cf-40d7-a01b-112f8be7b258 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:53.582471 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d30da93-b1cf-40d7-a01b-112f8be7b258 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:53.583220 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d30da93-b1cf-40d7-a01b-112f8be7b258 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:53.584205 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d30da93-b1cf-40d7-a01b-112f8be7b258 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:53.584927 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d30da93-b1cf-40d7-a01b-112f8be7b258 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:53.585558 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d30da93-b1cf-40d7-a01b-112f8be7b258 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:53.595134 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ba7826d8-6af3-436b-b8cd-e5dfc6f8b6bc tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:53.608724 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ba7826d8-6af3-436b-b8cd-e5dfc6f8b6bc tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1512 microversion: 2.1 time: 0.464096 Sep 10 12:04:53.609347 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2566/5134] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:53 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1512 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:53.723540 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3d30da93-b1cf-40d7-a01b-112f8be7b258 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:53.736419 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3d30da93-b1cf-40d7-a01b-112f8be7b258 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:53.738904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3d30da93-b1cf-40d7-a01b-112f8be7b258 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:53.740593 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3d30da93-b1cf-40d7-a01b-112f8be7b258 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739" status: 200 len: 1366 microversion: 2.47 time: 0.171777 Sep 10 12:04:53.741390 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2569/5135] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:04:53 2022] GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:04:54.585422 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5b89dd3f-5e49-4492-8805-338d3b58255d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:54.588419 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5b89dd3f-5e49-4492-8805-338d3b58255d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:54.606054 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b89dd3f-5e49-4492-8805-338d3b58255d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:54.606677 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b89dd3f-5e49-4492-8805-338d3b58255d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:54.606845 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b89dd3f-5e49-4492-8805-338d3b58255d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:54.615362 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b89dd3f-5e49-4492-8805-338d3b58255d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:54.615362 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b89dd3f-5e49-4492-8805-338d3b58255d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:54.616152 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b89dd3f-5e49-4492-8805-338d3b58255d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:54.640421 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-75916880-14e3-4861-9450-bb9bbf6a5342 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:54.641641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-75916880-14e3-4861-9450-bb9bbf6a5342 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:54.653608 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-75916880-14e3-4861-9450-bb9bbf6a5342 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:54.654111 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-75916880-14e3-4861-9450-bb9bbf6a5342 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:54.654550 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-75916880-14e3-4861-9450-bb9bbf6a5342 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:54.655453 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-75916880-14e3-4861-9450-bb9bbf6a5342 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:54.655916 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-75916880-14e3-4861-9450-bb9bbf6a5342 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:54.656359 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-75916880-14e3-4861-9450-bb9bbf6a5342 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:54.875524 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5b89dd3f-5e49-4492-8805-338d3b58255d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:54.901695 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5b89dd3f-5e49-4492-8805-338d3b58255d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1490 microversion: 2.1 time: 0.323053 Sep 10 12:04:54.904585 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2567/5136] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:54 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1490 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:54.911813 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c6f44e63-9e1c-4b79-92cd-8ecee7a7efb0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:54.912839 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c6f44e63-9e1c-4b79-92cd-8ecee7a7efb0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:54.913411 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-75916880-14e3-4861-9450-bb9bbf6a5342 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:54.922443 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-75916880-14e3-4861-9450-bb9bbf6a5342 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1492 microversion: 2.1 time: 0.286874 Sep 10 12:04:54.924245 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2570/5137] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:54 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1492 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:54.933064 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cedb5af6-16a8-4995-a408-1a04edc7fb1d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-984929474"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:54.935097 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c6f44e63-9e1c-4b79-92cd-8ecee7a7efb0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:54.935882 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c6f44e63-9e1c-4b79-92cd-8ecee7a7efb0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:54.939335 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c6f44e63-9e1c-4b79-92cd-8ecee7a7efb0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:54.939335 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c6f44e63-9e1c-4b79-92cd-8ecee7a7efb0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:54.939335 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c6f44e63-9e1c-4b79-92cd-8ecee7a7efb0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:54.939656 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cedb5af6-16a8-4995-a408-1a04edc7fb1d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:54.939727 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c6f44e63-9e1c-4b79-92cd-8ecee7a7efb0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:54.947737 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cedb5af6-16a8-4995-a408-1a04edc7fb1d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:54.948247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cedb5af6-16a8-4995-a408-1a04edc7fb1d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:54.949387 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cedb5af6-16a8-4995-a408-1a04edc7fb1d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:54.950408 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cedb5af6-16a8-4995-a408-1a04edc7fb1d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:54.950907 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cedb5af6-16a8-4995-a408-1a04edc7fb1d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:54.952035 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cedb5af6-16a8-4995-a408-1a04edc7fb1d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:55.023830 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c6f44e63-9e1c-4b79-92cd-8ecee7a7efb0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:55.025914 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cedb5af6-16a8-4995-a408-1a04edc7fb1d tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "PUT /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1075 microversion: 2.1 time: 0.097618 Sep 10 12:04:55.027437 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2571/5138] 10.222.0.23 () {60 vars in 1256 bytes} [Sat Sep 10 12:04:54 2022] PUT /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1075 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:04:55.034125 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-11322d28-998e-44b1-bacc-85e55de7e078 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:55.035002 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-11322d28-998e-44b1-bacc-85e55de7e078 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:55.041746 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-11322d28-998e-44b1-bacc-85e55de7e078 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:55.042514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-11322d28-998e-44b1-bacc-85e55de7e078 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:55.043313 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-11322d28-998e-44b1-bacc-85e55de7e078 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:55.044576 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-11322d28-998e-44b1-bacc-85e55de7e078 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:55.045269 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-11322d28-998e-44b1-bacc-85e55de7e078 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:55.046140 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-11322d28-998e-44b1-bacc-85e55de7e078 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:55.051872 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c6f44e63-9e1c-4b79-92cd-8ecee7a7efb0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:55.055575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c6f44e63-9e1c-4b79-92cd-8ecee7a7efb0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:55.056807 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c6f44e63-9e1c-4b79-92cd-8ecee7a7efb0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739" status: 200 len: 1366 microversion: 2.47 time: 0.150215 Sep 10 12:04:55.075019 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2568/5139] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:04:54 2022] GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:04:55.076163 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-11322d28-998e-44b1-bacc-85e55de7e078 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] HTTP exception thrown: Cannot 'pause' instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 while it is in vm_state paused Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-11322d28-998e-44b1-bacc-85e55de7e078 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004/action HTTP/1.1 Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 13 Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: {"pause": {}} Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: exception: Cannot 'pause' instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 while it is in vm_state paused Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'ac1538e5-6edc-4ccb-b7a9-c2e90284e004', 'body': {'pause': {}}} Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 in vm_state paused. Cannot pause while the instance is in this state. Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 while it is in vm_state paused Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:55.077819 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:55.081663 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:55.081663 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:04:55.081663 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:04:55.081663 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 while it is in vm_state paused Sep 10 12:04:55.081663 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:55.082818 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-11322d28-998e-44b1-bacc-85e55de7e078 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 409 to user: Cannot 'pause' instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 while it is in vm_state paused {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:04:55.083625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e5ff5231-ad00-4dcb-bf53-bf6d76c91dc5 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:55.084195 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-11322d28-998e-44b1-bacc-85e55de7e078 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "POST /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004/action" status: 409 len: 143 microversion: 2.1 time: 0.055470 Sep 10 12:04:55.084305 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e5ff5231-ad00-4dcb-bf53-bf6d76c91dc5 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:55.085072 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2572/5140] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:04:55 2022] POST /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004/action => generated 143 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 12:04:55.091194 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e5ff5231-ad00-4dcb-bf53-bf6d76c91dc5 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:55.091934 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e5ff5231-ad00-4dcb-bf53-bf6d76c91dc5 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:55.092534 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e5ff5231-ad00-4dcb-bf53-bf6d76c91dc5 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:55.093402 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e5ff5231-ad00-4dcb-bf53-bf6d76c91dc5 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:55.094019 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e5ff5231-ad00-4dcb-bf53-bf6d76c91dc5 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:55.094605 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e5ff5231-ad00-4dcb-bf53-bf6d76c91dc5 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:55.098081 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d3832ed1-7168-49b0-baec-816ed4b3fe03 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:55.098903 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d3832ed1-7168-49b0-baec-816ed4b3fe03 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:55.106166 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3832ed1-7168-49b0-baec-816ed4b3fe03 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:55.106686 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3832ed1-7168-49b0-baec-816ed4b3fe03 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:55.107248 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3832ed1-7168-49b0-baec-816ed4b3fe03 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:55.109614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3832ed1-7168-49b0-baec-816ed4b3fe03 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:55.110308 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3832ed1-7168-49b0-baec-816ed4b3fe03 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:55.110931 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3832ed1-7168-49b0-baec-816ed4b3fe03 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:55.210471 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d3832ed1-7168-49b0-baec-816ed4b3fe03 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "POST /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004/action" status: 202 len: 0 microversion: 2.1 time: 0.116177 Sep 10 12:04:55.211394 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2573/5141] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:04:55 2022] POST /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:04:55.228326 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-512fcf8c-f2c6-4ae3-adca-ba64b7e4742a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:55.230604 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-512fcf8c-f2c6-4ae3-adca-ba64b7e4742a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:55.247005 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-512fcf8c-f2c6-4ae3-adca-ba64b7e4742a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:55.247503 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-512fcf8c-f2c6-4ae3-adca-ba64b7e4742a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:55.250906 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-512fcf8c-f2c6-4ae3-adca-ba64b7e4742a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:55.252164 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-512fcf8c-f2c6-4ae3-adca-ba64b7e4742a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:55.252795 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-512fcf8c-f2c6-4ae3-adca-ba64b7e4742a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:55.253382 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-512fcf8c-f2c6-4ae3-adca-ba64b7e4742a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:55.305298 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e5ff5231-ad00-4dcb-bf53-bf6d76c91dc5 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:55.326197 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e5ff5231-ad00-4dcb-bf53-bf6d76c91dc5 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1501 microversion: 2.1 time: 0.249971 Sep 10 12:04:55.331745 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2569/5142] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:55 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1501 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:55.359607 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-00b0c172-3c7b-44a1-8b77-77fdc56e9527 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:55.360765 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-00b0c172-3c7b-44a1-8b77-77fdc56e9527 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:55.373712 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00b0c172-3c7b-44a1-8b77-77fdc56e9527 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:55.375985 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00b0c172-3c7b-44a1-8b77-77fdc56e9527 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:55.377525 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00b0c172-3c7b-44a1-8b77-77fdc56e9527 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:55.378354 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00b0c172-3c7b-44a1-8b77-77fdc56e9527 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:55.379744 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00b0c172-3c7b-44a1-8b77-77fdc56e9527 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:55.383210 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-00b0c172-3c7b-44a1-8b77-77fdc56e9527 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:55.700538 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-512fcf8c-f2c6-4ae3-adca-ba64b7e4742a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:55.710213 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-512fcf8c-f2c6-4ae3-adca-ba64b7e4742a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1499 microversion: 2.1 time: 0.493506 Sep 10 12:04:55.711317 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2574/5143] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:55 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1499 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:55.800652 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-00b0c172-3c7b-44a1-8b77-77fdc56e9527 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:55.810082 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-00b0c172-3c7b-44a1-8b77-77fdc56e9527 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1501 microversion: 2.1 time: 0.454151 Sep 10 12:04:55.810711 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2570/5144] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:55 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1501 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:04:55.835713 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3f69b895-ca19-4550-801d-1116ec2cff55 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:55.845667 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3f69b895-ca19-4550-801d-1116ec2cff55 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:55.846406 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3f69b895-ca19-4550-801d-1116ec2cff55 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:55.847047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3f69b895-ca19-4550-801d-1116ec2cff55 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:55.876964 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3f69b895-ca19-4550-801d-1116ec2cff55 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Going to try to stop instance {{(pid=128777) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 10 12:04:55.906621 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:04:55.937710 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3f69b895-ca19-4550-801d-1116ec2cff55 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "POST /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15/action" status: 202 len: 0 microversion: 2.1 time: 0.106401 Sep 10 12:04:55.948134 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2575/5145] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:04:55 2022] POST /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:04:55.956653 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-82847f8c-560f-4d38-931f-481586d8a497 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:55.957845 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-82847f8c-560f-4d38-931f-481586d8a497 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:55.968914 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-82847f8c-560f-4d38-931f-481586d8a497 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:55.969511 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-82847f8c-560f-4d38-931f-481586d8a497 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:55.970034 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-82847f8c-560f-4d38-931f-481586d8a497 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:55.970824 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-82847f8c-560f-4d38-931f-481586d8a497 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:55.971418 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-82847f8c-560f-4d38-931f-481586d8a497 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:55.972085 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-82847f8c-560f-4d38-931f-481586d8a497 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:56.091676 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7390b5ac-8e22-43bc-a900-dabb6ed4b495 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:56.093071 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7390b5ac-8e22-43bc-a900-dabb6ed4b495 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:56.111666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7390b5ac-8e22-43bc-a900-dabb6ed4b495 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:56.114812 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7390b5ac-8e22-43bc-a900-dabb6ed4b495 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:56.123569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7390b5ac-8e22-43bc-a900-dabb6ed4b495 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:56.124677 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7390b5ac-8e22-43bc-a900-dabb6ed4b495 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:56.126627 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7390b5ac-8e22-43bc-a900-dabb6ed4b495 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:56.128581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7390b5ac-8e22-43bc-a900-dabb6ed4b495 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:56.173764 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-82847f8c-560f-4d38-931f-481586d8a497 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:56.185579 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-82847f8c-560f-4d38-931f-481586d8a497 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1511 microversion: 2.1 time: 0.233228 Sep 10 12:04:56.186721 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2571/5146] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:55 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1511 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:04:56.251461 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7390b5ac-8e22-43bc-a900-dabb6ed4b495 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:56.264352 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7390b5ac-8e22-43bc-a900-dabb6ed4b495 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:56.265718 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7390b5ac-8e22-43bc-a900-dabb6ed4b495 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:56.266969 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7390b5ac-8e22-43bc-a900-dabb6ed4b495 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739" status: 200 len: 1366 microversion: 2.47 time: 0.180794 Sep 10 12:04:56.267930 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2576/5147] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:04:56 2022] GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 12:04:56.738064 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3cbd9f41-31b4-45de-a32c-2d5cae4a3e74 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:56.738585 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3cbd9f41-31b4-45de-a32c-2d5cae4a3e74 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:56.769515 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3cbd9f41-31b4-45de-a32c-2d5cae4a3e74 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:56.770560 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3cbd9f41-31b4-45de-a32c-2d5cae4a3e74 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:56.771113 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3cbd9f41-31b4-45de-a32c-2d5cae4a3e74 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:56.772007 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3cbd9f41-31b4-45de-a32c-2d5cae4a3e74 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:56.772576 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3cbd9f41-31b4-45de-a32c-2d5cae4a3e74 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:56.773142 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3cbd9f41-31b4-45de-a32c-2d5cae4a3e74 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:56.984127 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3cbd9f41-31b4-45de-a32c-2d5cae4a3e74 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:56.994323 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3cbd9f41-31b4-45de-a32c-2d5cae4a3e74 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.260651 Sep 10 12:04:56.996879 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2572/5148] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:56 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:57.045264 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a6320645-d6f5-4e49-9067-597e68006d31 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:57.051908 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a6320645-d6f5-4e49-9067-597e68006d31 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:57.082910 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a6320645-d6f5-4e49-9067-597e68006d31 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:57.083770 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a6320645-d6f5-4e49-9067-597e68006d31 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:57.084368 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a6320645-d6f5-4e49-9067-597e68006d31 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:57.085854 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a6320645-d6f5-4e49-9067-597e68006d31 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:57.086474 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a6320645-d6f5-4e49-9067-597e68006d31 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:57.087063 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a6320645-d6f5-4e49-9067-597e68006d31 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:57.219126 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bb2b4103-de75-481f-8432-79aaa888a5b5 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:57.219794 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bb2b4103-de75-481f-8432-79aaa888a5b5 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:57.226534 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bb2b4103-de75-481f-8432-79aaa888a5b5 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:57.227033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bb2b4103-de75-481f-8432-79aaa888a5b5 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:57.228016 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bb2b4103-de75-481f-8432-79aaa888a5b5 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:57.228932 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bb2b4103-de75-481f-8432-79aaa888a5b5 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:57.229506 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bb2b4103-de75-481f-8432-79aaa888a5b5 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:57.231115 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bb2b4103-de75-481f-8432-79aaa888a5b5 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:57.359795 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a6320645-d6f5-4e49-9067-597e68006d31 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:57.367841 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a6320645-d6f5-4e49-9067-597e68006d31 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.346496 Sep 10 12:04:57.369547 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2577/5149] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:57 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:57.378744 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-41587dfc-d082-4567-aa94-d73c8f899194 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:57.380064 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-41587dfc-d082-4567-aa94-d73c8f899194 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:57.387740 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-41587dfc-d082-4567-aa94-d73c8f899194 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:57.388423 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-41587dfc-d082-4567-aa94-d73c8f899194 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:57.389055 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-41587dfc-d082-4567-aa94-d73c8f899194 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:57.389906 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-41587dfc-d082-4567-aa94-d73c8f899194 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:57.390504 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-41587dfc-d082-4567-aa94-d73c8f899194 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:57.391074 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-41587dfc-d082-4567-aa94-d73c8f899194 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:57.509563 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-41587dfc-d082-4567-aa94-d73c8f899194 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:57.514067 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bb2b4103-de75-481f-8432-79aaa888a5b5 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:57.520420 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-41587dfc-d082-4567-aa94-d73c8f899194 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:57.523194 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-41587dfc-d082-4567-aa94-d73c8f899194 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:57.523438 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bb2b4103-de75-481f-8432-79aaa888a5b5 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1511 microversion: 2.1 time: 0.311329 Sep 10 12:04:57.524041 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2573/5150] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:57 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1511 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:57.535307 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-41587dfc-d082-4567-aa94-d73c8f899194 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739" status: 200 len: 1366 microversion: 2.47 time: 0.154029 Sep 10 12:04:57.539210 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2578/5151] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:04:57 2022] GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:04:57.539352 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b7aafedd-59db-4ddc-96c4-acd838fd88d5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:57.542942 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b7aafedd-59db-4ddc-96c4-acd838fd88d5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: d4d4927f-4127-4a75-8c38-f462dda83d23] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:57.556368 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:04:57.560689 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7aafedd-59db-4ddc-96c4-acd838fd88d5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:57.561719 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7aafedd-59db-4ddc-96c4-acd838fd88d5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:57.563582 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7aafedd-59db-4ddc-96c4-acd838fd88d5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:57.564625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7aafedd-59db-4ddc-96c4-acd838fd88d5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:57.565278 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7aafedd-59db-4ddc-96c4-acd838fd88d5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:57.566447 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7aafedd-59db-4ddc-96c4-acd838fd88d5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:57.585650 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-b7aafedd-59db-4ddc-96c4-acd838fd88d5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] HTTP exception thrown: Instance d4d4927f-4127-4a75-8c38-f462dda83d23 could not be found. Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b7aafedd-59db-4ddc-96c4-acd838fd88d5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23/action HTTP/1.1 Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 28 Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: {"reboot": {"type": "SOFT"}} Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance d4d4927f-4127-4a75-8c38-f462dda83d23 could not be found. Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'd4d4927f-4127-4a75-8c38-f462dda83d23', 'body': {'reboot': {'type': 'SOFT'}}} Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4d4927f-4127-4a75-8c38-f462dda83d23 could not be found. Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:04:57.588207 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:04:57.592676 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4d4927f-4127-4a75-8c38-f462dda83d23 could not be found. Sep 10 12:04:57.592676 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:57.592676 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:57.592676 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:57.592676 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:57.592676 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:57.592676 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:57.592676 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:04:57.592676 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:04:57.592676 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4d4927f-4127-4a75-8c38-f462dda83d23 could not be found. Sep 10 12:04:57.592676 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:04:57.594052 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b7aafedd-59db-4ddc-96c4-acd838fd88d5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 404 to user: Instance d4d4927f-4127-4a75-8c38-f462dda83d23 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:04:57.595078 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b7aafedd-59db-4ddc-96c4-acd838fd88d5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "POST /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23/action" status: 404 len: 111 microversion: 2.1 time: 0.066715 Sep 10 12:04:57.599768 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2574/5152] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:04:57 2022] POST /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23/action => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:04:57.606224 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-76b0e7c3-d8a5-4098-9928-5725e915e1ea tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:57.606945 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-76b0e7c3-d8a5-4098-9928-5725e915e1ea tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:57.614100 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-76b0e7c3-d8a5-4098-9928-5725e915e1ea tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:57.614603 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-76b0e7c3-d8a5-4098-9928-5725e915e1ea tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:57.615053 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-76b0e7c3-d8a5-4098-9928-5725e915e1ea tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:57.615797 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-76b0e7c3-d8a5-4098-9928-5725e915e1ea tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:57.616344 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-76b0e7c3-d8a5-4098-9928-5725e915e1ea tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:57.616782 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-76b0e7c3-d8a5-4098-9928-5725e915e1ea tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:57.774946 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-76b0e7c3-d8a5-4098-9928-5725e915e1ea tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:57.784091 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-76b0e7c3-d8a5-4098-9928-5725e915e1ea tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.182636 Sep 10 12:04:57.785352 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2579/5153] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:57 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:04:57.812487 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e9372b63-5dff-4a69-bfa5-1c2b074356ef tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:57.813121 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e9372b63-5dff-4a69-bfa5-1c2b074356ef tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:57.820083 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e9372b63-5dff-4a69-bfa5-1c2b074356ef tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:57.820838 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e9372b63-5dff-4a69-bfa5-1c2b074356ef tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:57.821433 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e9372b63-5dff-4a69-bfa5-1c2b074356ef tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:57.822343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e9372b63-5dff-4a69-bfa5-1c2b074356ef tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:57.822977 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e9372b63-5dff-4a69-bfa5-1c2b074356ef tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:57.823469 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e9372b63-5dff-4a69-bfa5-1c2b074356ef tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:58.045309 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e9372b63-5dff-4a69-bfa5-1c2b074356ef tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:58.061586 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e9372b63-5dff-4a69-bfa5-1c2b074356ef tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.254886 Sep 10 12:04:58.062364 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2575/5154] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:57 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:58.085512 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-55d969d3-6bb2-4a4f-8ce4-315dc93d4183 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:58.088608 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-55d969d3-6bb2-4a4f-8ce4-315dc93d4183 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: 7ebe04fe-d2d0-499c-ae1e-88b25edc3bf4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:58.098713 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-55d969d3-6bb2-4a4f-8ce4-315dc93d4183 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] HTTP exception thrown: Instance 7ebe04fe-d2d0-499c-ae1e-88b25edc3bf4 could not be found. Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-55d969d3-6bb2-4a4f-8ce4-315dc93d4183 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers/7ebe04fe-d2d0-499c-ae1e-88b25edc3bf4/action HTTP/1.1 Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 28 Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: {"reboot": {"type": "SOFT"}} Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 7ebe04fe-d2d0-499c-ae1e-88b25edc3bf4 could not be found. Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '7ebe04fe-d2d0-499c-ae1e-88b25edc3bf4', 'body': {'reboot': {'type': 'SOFT'}}} Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ebe04fe-d2d0-499c-ae1e-88b25edc3bf4 could not be found. Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ebe04fe-d2d0-499c-ae1e-88b25edc3bf4 could not be found. Sep 10 12:04:58.100889 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:58.105385 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:58.105385 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:58.105385 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:58.105385 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:58.105385 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:58.105385 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:04:58.105385 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:04:58.105385 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ebe04fe-d2d0-499c-ae1e-88b25edc3bf4 could not be found. Sep 10 12:04:58.105385 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:58.108315 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-55d969d3-6bb2-4a4f-8ce4-315dc93d4183 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 404 to user: Instance 7ebe04fe-d2d0-499c-ae1e-88b25edc3bf4 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:04:58.109106 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-55d969d3-6bb2-4a4f-8ce4-315dc93d4183 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "POST /compute/v2.1/servers/7ebe04fe-d2d0-499c-ae1e-88b25edc3bf4/action" status: 404 len: 111 microversion: 2.1 time: 0.028160 Sep 10 12:04:58.109844 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2580/5155] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:04:58 2022] POST /compute/v2.1/servers/7ebe04fe-d2d0-499c-ae1e-88b25edc3bf4/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:04:58.124090 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-87c5de33-ea93-445d-bc1a-ea1623075019 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:58.124959 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-87c5de33-ea93-445d-bc1a-ea1623075019 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:58.143683 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-87c5de33-ea93-445d-bc1a-ea1623075019 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:58.144397 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-87c5de33-ea93-445d-bc1a-ea1623075019 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:58.145130 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-87c5de33-ea93-445d-bc1a-ea1623075019 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:58.147408 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-87c5de33-ea93-445d-bc1a-ea1623075019 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:58.148044 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-87c5de33-ea93-445d-bc1a-ea1623075019 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:58.148633 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-87c5de33-ea93-445d-bc1a-ea1623075019 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:58.339761 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-87c5de33-ea93-445d-bc1a-ea1623075019 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:58.347801 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-87c5de33-ea93-445d-bc1a-ea1623075019 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.230453 Sep 10 12:04:58.348367 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2576/5156] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:58 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:58.376811 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-81915062-c8b6-461e-9192-7672f9dba39b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:58.378423 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-81915062-c8b6-461e-9192-7672f9dba39b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:58.385069 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-81915062-c8b6-461e-9192-7672f9dba39b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:58.385730 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-81915062-c8b6-461e-9192-7672f9dba39b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:58.386436 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-81915062-c8b6-461e-9192-7672f9dba39b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:58.387395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-81915062-c8b6-461e-9192-7672f9dba39b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:58.388010 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-81915062-c8b6-461e-9192-7672f9dba39b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:58.388596 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-81915062-c8b6-461e-9192-7672f9dba39b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:58.551921 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-557c2d9b-cd63-4650-b2d6-5687f2655791 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:58.552944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-557c2d9b-cd63-4650-b2d6-5687f2655791 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:58.561417 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-557c2d9b-cd63-4650-b2d6-5687f2655791 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:58.562186 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-557c2d9b-cd63-4650-b2d6-5687f2655791 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:58.565818 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-81915062-c8b6-461e-9192-7672f9dba39b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:58.569522 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-557c2d9b-cd63-4650-b2d6-5687f2655791 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:58.570446 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-557c2d9b-cd63-4650-b2d6-5687f2655791 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:58.571072 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-557c2d9b-cd63-4650-b2d6-5687f2655791 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:58.571679 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-557c2d9b-cd63-4650-b2d6-5687f2655791 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:58.574761 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-81915062-c8b6-461e-9192-7672f9dba39b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.201664 Sep 10 12:04:58.587198 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2581/5157] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:58 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:58.587198 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4ef1d24f-6f0a-455b-a4dd-5749961fcab6 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:58.587198 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4ef1d24f-6f0a-455b-a4dd-5749961fcab6 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:58.592482 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ef1d24f-6f0a-455b-a4dd-5749961fcab6 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:58.592980 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ef1d24f-6f0a-455b-a4dd-5749961fcab6 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:58.593419 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ef1d24f-6f0a-455b-a4dd-5749961fcab6 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:58.594205 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ef1d24f-6f0a-455b-a4dd-5749961fcab6 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:58.594663 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ef1d24f-6f0a-455b-a4dd-5749961fcab6 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:58.595298 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ef1d24f-6f0a-455b-a4dd-5749961fcab6 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:58.695554 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4ef1d24f-6f0a-455b-a4dd-5749961fcab6 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:58.710919 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4ef1d24f-6f0a-455b-a4dd-5749961fcab6 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:58.712882 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4ef1d24f-6f0a-455b-a4dd-5749961fcab6 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:58.714352 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4ef1d24f-6f0a-455b-a4dd-5749961fcab6 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739" status: 200 len: 1366 microversion: 2.47 time: 0.137195 Sep 10 12:04:58.715584 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2582/5158] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:04:58 2022] GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739 => generated 1366 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:04:58.723553 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cadf6cc9-537d-4513-b8d7-1526dff2e4b3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:58.728452 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cadf6cc9-537d-4513-b8d7-1526dff2e4b3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: d4d4927f-4127-4a75-8c38-f462dda83d23] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:58.736534 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cadf6cc9-537d-4513-b8d7-1526dff2e4b3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:58.737170 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cadf6cc9-537d-4513-b8d7-1526dff2e4b3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:58.737715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cadf6cc9-537d-4513-b8d7-1526dff2e4b3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:58.738529 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cadf6cc9-537d-4513-b8d7-1526dff2e4b3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:58.739111 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cadf6cc9-537d-4513-b8d7-1526dff2e4b3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:58.739783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cadf6cc9-537d-4513-b8d7-1526dff2e4b3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:58.755183 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-cadf6cc9-537d-4513-b8d7-1526dff2e4b3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] HTTP exception thrown: Instance d4d4927f-4127-4a75-8c38-f462dda83d23 could not be found. Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cadf6cc9-537d-4513-b8d7-1526dff2e4b3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23/action HTTP/1.1 Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 65 Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: {"rebuild": {"imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1"}} Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance d4d4927f-4127-4a75-8c38-f462dda83d23 could not be found. Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'd4d4927f-4127-4a75-8c38-f462dda83d23', 'body': {'rebuild': {'imageRef': 'c23d4d62-7ab9-4623-9273-7f44582aa2e1'}}} Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4d4927f-4127-4a75-8c38-f462dda83d23 could not be found. Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 10 12:04:58.757188 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 10 12:04:58.761124 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 10 12:04:58.761124 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:04:58.761124 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:04:58.761124 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:04:58.761124 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:04:58.761124 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4d4927f-4127-4a75-8c38-f462dda83d23 could not be found. Sep 10 12:04:58.761124 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:58.761124 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:58.761124 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:58.761124 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:58.761124 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:58.761124 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:58.761124 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:04:58.761124 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:04:58.761124 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4d4927f-4127-4a75-8c38-f462dda83d23 could not be found. Sep 10 12:04:58.761124 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:58.762315 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cadf6cc9-537d-4513-b8d7-1526dff2e4b3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 404 to user: Instance d4d4927f-4127-4a75-8c38-f462dda83d23 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:04:58.763842 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cadf6cc9-537d-4513-b8d7-1526dff2e4b3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "POST /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23/action" status: 404 len: 111 microversion: 2.1 time: 0.046343 Sep 10 12:04:58.768624 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2583/5159] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:04:58 2022] POST /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:04:58.775030 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3d02ae1c-9108-4e55-8fa5-1a4809c176bb tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:58.776412 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3d02ae1c-9108-4e55-8fa5-1a4809c176bb tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:58.783190 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d02ae1c-9108-4e55-8fa5-1a4809c176bb tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:58.783939 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d02ae1c-9108-4e55-8fa5-1a4809c176bb tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:58.784515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d02ae1c-9108-4e55-8fa5-1a4809c176bb tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:58.785338 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d02ae1c-9108-4e55-8fa5-1a4809c176bb tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:58.786451 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d02ae1c-9108-4e55-8fa5-1a4809c176bb tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:58.786998 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d02ae1c-9108-4e55-8fa5-1a4809c176bb tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:58.798152 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-557c2d9b-cd63-4650-b2d6-5687f2655791 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:58.806402 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-557c2d9b-cd63-4650-b2d6-5687f2655791 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1511 microversion: 2.1 time: 0.259063 Sep 10 12:04:58.807210 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2577/5160] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:58 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1511 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:04:58.941841 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3d02ae1c-9108-4e55-8fa5-1a4809c176bb tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:58.966499 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3d02ae1c-9108-4e55-8fa5-1a4809c176bb tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.196630 Sep 10 12:04:58.983371 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2584/5161] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:58 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:58.991524 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-15367a1d-0185-4c8b-bae6-ee3ed5218704 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:58.992739 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-15367a1d-0185-4c8b-bae6-ee3ed5218704 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:59.002832 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-15367a1d-0185-4c8b-bae6-ee3ed5218704 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:59.003756 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-15367a1d-0185-4c8b-bae6-ee3ed5218704 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:59.004557 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-15367a1d-0185-4c8b-bae6-ee3ed5218704 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:59.005485 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-15367a1d-0185-4c8b-bae6-ee3ed5218704 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:59.006292 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-15367a1d-0185-4c8b-bae6-ee3ed5218704 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:59.007222 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-15367a1d-0185-4c8b-bae6-ee3ed5218704 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:59.308736 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-15367a1d-0185-4c8b-bae6-ee3ed5218704 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:59.313050 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:04:59.320024 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-15367a1d-0185-4c8b-bae6-ee3ed5218704 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.332748 Sep 10 12:04:59.348864 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ee86a507-2d74-4382-b8cb-df1b2ff9b951 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:04:59.349358 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2578/5162] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:58 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:59.352679 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ee86a507-2d74-4382-b8cb-df1b2ff9b951 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: 60e12ae5-7c12-48e9-8db3-d1ce1c086924] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:59.366794 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-ee86a507-2d74-4382-b8cb-df1b2ff9b951 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] HTTP exception thrown: Instance 60e12ae5-7c12-48e9-8db3-d1ce1c086924 could not be found. Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ee86a507-2d74-4382-b8cb-df1b2ff9b951 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers/60e12ae5-7c12-48e9-8db3-d1ce1c086924/action HTTP/1.1 Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 65 Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: {"rebuild": {"imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1"}} Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 60e12ae5-7c12-48e9-8db3-d1ce1c086924 could not be found. Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '60e12ae5-7c12-48e9-8db3-d1ce1c086924', 'body': {'rebuild': {'imageRef': 'c23d4d62-7ab9-4623-9273-7f44582aa2e1'}}} Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60e12ae5-7c12-48e9-8db3-d1ce1c086924 could not be found. Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 10 12:04:59.370279 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:04:59.376070 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:04:59.376070 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:04:59.376070 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:04:59.376070 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60e12ae5-7c12-48e9-8db3-d1ce1c086924 could not be found. Sep 10 12:04:59.376070 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:59.376070 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:04:59.376070 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:59.376070 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:04:59.376070 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:04:59.376070 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:04:59.376070 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:04:59.376070 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:04:59.376070 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60e12ae5-7c12-48e9-8db3-d1ce1c086924 could not be found. Sep 10 12:04:59.376070 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:04:59.376070 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ee86a507-2d74-4382-b8cb-df1b2ff9b951 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 404 to user: Instance 60e12ae5-7c12-48e9-8db3-d1ce1c086924 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:04:59.376070 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ee86a507-2d74-4382-b8cb-df1b2ff9b951 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "POST /compute/v2.1/servers/60e12ae5-7c12-48e9-8db3-d1ce1c086924/action" status: 404 len: 111 microversion: 2.1 time: 0.027772 Sep 10 12:04:59.381580 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2585/5163] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:04:59 2022] POST /compute/v2.1/servers/60e12ae5-7c12-48e9-8db3-d1ce1c086924/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:04:59.387575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bfea533e-76e0-488c-86fd-cd015e36cbfe tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:59.388469 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bfea533e-76e0-488c-86fd-cd015e36cbfe tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:59.406873 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bfea533e-76e0-488c-86fd-cd015e36cbfe tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:59.407413 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bfea533e-76e0-488c-86fd-cd015e36cbfe tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:59.407874 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bfea533e-76e0-488c-86fd-cd015e36cbfe tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:59.408685 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bfea533e-76e0-488c-86fd-cd015e36cbfe tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:59.409041 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bfea533e-76e0-488c-86fd-cd015e36cbfe tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:59.409474 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bfea533e-76e0-488c-86fd-cd015e36cbfe tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:59.668783 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bfea533e-76e0-488c-86fd-cd015e36cbfe tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:59.678667 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bfea533e-76e0-488c-86fd-cd015e36cbfe tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.294866 Sep 10 12:04:59.681116 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2579/5164] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:59 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:04:59.705036 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e2bd256f-6d73-4fdf-9bc3-a558e761ff4b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:59.705666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e2bd256f-6d73-4fdf-9bc3-a558e761ff4b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:59.719639 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e2bd256f-6d73-4fdf-9bc3-a558e761ff4b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:59.720163 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e2bd256f-6d73-4fdf-9bc3-a558e761ff4b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:59.720771 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e2bd256f-6d73-4fdf-9bc3-a558e761ff4b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:59.721924 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e2bd256f-6d73-4fdf-9bc3-a558e761ff4b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:59.724785 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e2bd256f-6d73-4fdf-9bc3-a558e761ff4b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:59.725210 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e2bd256f-6d73-4fdf-9bc3-a558e761ff4b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:59.746395 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-deab8300-6d40-4a26-96e1-741aa83c4238 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:59.747393 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-deab8300-6d40-4a26-96e1-741aa83c4238 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:59.767401 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-deab8300-6d40-4a26-96e1-741aa83c4238 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:59.767932 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-deab8300-6d40-4a26-96e1-741aa83c4238 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:59.768548 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-deab8300-6d40-4a26-96e1-741aa83c4238 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:59.769501 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-deab8300-6d40-4a26-96e1-741aa83c4238 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:59.770021 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-deab8300-6d40-4a26-96e1-741aa83c4238 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:59.771801 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-deab8300-6d40-4a26-96e1-741aa83c4238 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:59.899938 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-deab8300-6d40-4a26-96e1-741aa83c4238 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:59.917798 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-deab8300-6d40-4a26-96e1-741aa83c4238 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:59.919727 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-deab8300-6d40-4a26-96e1-741aa83c4238 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:04:59.921109 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-deab8300-6d40-4a26-96e1-741aa83c4238 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739" status: 200 len: 1366 microversion: 2.47 time: 0.180335 Sep 10 12:04:59.935674 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2580/5165] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:04:59 2022] GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:04:59.947499 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e16ea87a-61ba-4134-9cb5-bf8ea7195deb tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:04:59.948142 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e16ea87a-61ba-4134-9cb5-bf8ea7195deb tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:04:59.955085 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e16ea87a-61ba-4134-9cb5-bf8ea7195deb tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:59.955647 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e16ea87a-61ba-4134-9cb5-bf8ea7195deb tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:59.956157 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e16ea87a-61ba-4134-9cb5-bf8ea7195deb tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:04:59.957075 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e16ea87a-61ba-4134-9cb5-bf8ea7195deb tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:04:59.957543 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e16ea87a-61ba-4134-9cb5-bf8ea7195deb tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:04:59.957980 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e16ea87a-61ba-4134-9cb5-bf8ea7195deb tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:00.101892 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e2bd256f-6d73-4fdf-9bc3-a558e761ff4b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:00.116643 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e2bd256f-6d73-4fdf-9bc3-a558e761ff4b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.410082 Sep 10 12:05:00.117815 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2586/5166] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:59 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:00.145560 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9bab5817-2e10-40ff-8827-84a80ecc79b0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:05:00.146344 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9bab5817-2e10-40ff-8827-84a80ecc79b0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: 4e4e15b9-1683-48c9-a008-5299ee742f0a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:00.155320 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-9bab5817-2e10-40ff-8827-84a80ecc79b0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] HTTP exception thrown: Instance 4e4e15b9-1683-48c9-a008-5299ee742f0a could not be found. Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9bab5817-2e10-40ff-8827-84a80ecc79b0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers/4e4e15b9-1683-48c9-a008-5299ee742f0a/action HTTP/1.1 Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 15 Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: {"restore": {}} Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 4e4e15b9-1683-48c9-a008-5299ee742f0a could not be found. Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '4e4e15b9-1683-48c9-a008-5299ee742f0a', 'body': {'restore': {}}} Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e4e15b9-1683-48c9-a008-5299ee742f0a could not be found. Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e4e15b9-1683-48c9-a008-5299ee742f0a could not be found. Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:00.158180 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:00.161521 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:05:00.161521 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:05:00.161521 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e4e15b9-1683-48c9-a008-5299ee742f0a could not be found. Sep 10 12:05:00.161521 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:00.161521 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9bab5817-2e10-40ff-8827-84a80ecc79b0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 404 to user: Instance 4e4e15b9-1683-48c9-a008-5299ee742f0a could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:05:00.161521 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9bab5817-2e10-40ff-8827-84a80ecc79b0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "POST /compute/v2.1/servers/4e4e15b9-1683-48c9-a008-5299ee742f0a/action" status: 404 len: 111 microversion: 2.1 time: 0.019089 Sep 10 12:05:00.165960 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2587/5167] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:05:00 2022] POST /compute/v2.1/servers/4e4e15b9-1683-48c9-a008-5299ee742f0a/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 12:05:00.181024 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0daf0fe4-debd-461c-9529-5be52eeb5c5a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:00.181712 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0daf0fe4-debd-461c-9529-5be52eeb5c5a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:00.197244 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0daf0fe4-debd-461c-9529-5be52eeb5c5a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:00.197821 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0daf0fe4-debd-461c-9529-5be52eeb5c5a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:00.198361 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0daf0fe4-debd-461c-9529-5be52eeb5c5a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:00.199208 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0daf0fe4-debd-461c-9529-5be52eeb5c5a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:00.199752 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0daf0fe4-debd-461c-9529-5be52eeb5c5a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:00.200254 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0daf0fe4-debd-461c-9529-5be52eeb5c5a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:00.326880 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e16ea87a-61ba-4134-9cb5-bf8ea7195deb tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:00.335670 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e16ea87a-61ba-4134-9cb5-bf8ea7195deb tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1511 microversion: 2.1 time: 0.398532 Sep 10 12:05:00.336480 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2581/5168] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:04:59 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1511 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:00.472814 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0daf0fe4-debd-461c-9529-5be52eeb5c5a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:00.482788 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0daf0fe4-debd-461c-9529-5be52eeb5c5a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.313884 Sep 10 12:05:00.483479 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2588/5169] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:00 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:00.508864 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a2ab766a-173f-448f-b80a-68a4d07a0d71 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:00.509491 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a2ab766a-173f-448f-b80a-68a4d07a0d71 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:00.516178 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2ab766a-173f-448f-b80a-68a4d07a0d71 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:00.516684 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2ab766a-173f-448f-b80a-68a4d07a0d71 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:00.517119 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2ab766a-173f-448f-b80a-68a4d07a0d71 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:00.517836 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2ab766a-173f-448f-b80a-68a4d07a0d71 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:00.518530 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2ab766a-173f-448f-b80a-68a4d07a0d71 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:00.518733 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2ab766a-173f-448f-b80a-68a4d07a0d71 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:00.732204 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a2ab766a-173f-448f-b80a-68a4d07a0d71 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:00.746646 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a2ab766a-173f-448f-b80a-68a4d07a0d71 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.241622 Sep 10 12:05:00.756297 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2582/5170] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:00 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:00.771109 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0bfb91a4-bbed-4e12-92d1-68fb41961f19 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:05:00.772107 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0bfb91a4-bbed-4e12-92d1-68fb41961f19 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:00.784539 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0bfb91a4-bbed-4e12-92d1-68fb41961f19 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:00.785085 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0bfb91a4-bbed-4e12-92d1-68fb41961f19 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:00.785608 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0bfb91a4-bbed-4e12-92d1-68fb41961f19 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:00.786252 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0bfb91a4-bbed-4e12-92d1-68fb41961f19 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:00.786719 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0bfb91a4-bbed-4e12-92d1-68fb41961f19 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:00.787153 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0bfb91a4-bbed-4e12-92d1-68fb41961f19 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:00.813337 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-0bfb91a4-bbed-4e12-92d1-68fb41961f19 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] HTTP exception thrown: Cannot 'restore' instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 while it is in vm_state active Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0bfb91a4-bbed-4e12-92d1-68fb41961f19 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004/action HTTP/1.1 Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 15 Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: {"restore": {}} Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: exception: Cannot 'restore' instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 while it is in vm_state active Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'ac1538e5-6edc-4ccb-b7a9-c2e90284e004', 'body': {'restore': {}}} Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 in vm_state active. Cannot restore while the instance is in this state. Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 while it is in vm_state active Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:00.815328 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:00.818482 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:00.818482 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:05:00.818482 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:05:00.818482 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 while it is in vm_state active Sep 10 12:05:00.818482 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:00.819945 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0bfb91a4-bbed-4e12-92d1-68fb41961f19 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 409 to user: Cannot 'restore' instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 while it is in vm_state active {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:05:00.820973 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0bfb91a4-bbed-4e12-92d1-68fb41961f19 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "POST /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004/action" status: 409 len: 145 microversion: 2.1 time: 0.054179 Sep 10 12:05:00.822204 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2589/5171] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:05:00 2022] POST /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004/action => generated 145 bytes in 56 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 12:05:00.830902 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-358ffa68-6a87-4415-8398-d89b228d12bd tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:00.831568 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-358ffa68-6a87-4415-8398-d89b228d12bd tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:00.838326 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-358ffa68-6a87-4415-8398-d89b228d12bd tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:00.838801 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-358ffa68-6a87-4415-8398-d89b228d12bd tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:00.839849 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-358ffa68-6a87-4415-8398-d89b228d12bd tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:00.840547 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-358ffa68-6a87-4415-8398-d89b228d12bd tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:00.840994 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-358ffa68-6a87-4415-8398-d89b228d12bd tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:00.841415 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-358ffa68-6a87-4415-8398-d89b228d12bd tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:00.960444 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-53c3dd27-191c-4252-8402-a9ce26ee8d16 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:00.961065 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-53c3dd27-191c-4252-8402-a9ce26ee8d16 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:00.977225 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-53c3dd27-191c-4252-8402-a9ce26ee8d16 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:00.977952 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-53c3dd27-191c-4252-8402-a9ce26ee8d16 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:00.978540 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-53c3dd27-191c-4252-8402-a9ce26ee8d16 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:00.979454 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-53c3dd27-191c-4252-8402-a9ce26ee8d16 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:00.980351 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-53c3dd27-191c-4252-8402-a9ce26ee8d16 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:00.980993 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-53c3dd27-191c-4252-8402-a9ce26ee8d16 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:01.063197 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-358ffa68-6a87-4415-8398-d89b228d12bd tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:01.071215 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-358ffa68-6a87-4415-8398-d89b228d12bd tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.244089 Sep 10 12:05:01.072072 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2583/5172] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:00 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:01.080182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-53c3dd27-191c-4252-8402-a9ce26ee8d16 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:01.099425 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1b169066-e5fd-49b7-a707-bacb92334a70 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:01.100132 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1b169066-e5fd-49b7-a707-bacb92334a70 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:01.106385 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-53c3dd27-191c-4252-8402-a9ce26ee8d16 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:01.114552 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-53c3dd27-191c-4252-8402-a9ce26ee8d16 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:01.115045 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1b169066-e5fd-49b7-a707-bacb92334a70 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:01.116326 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-53c3dd27-191c-4252-8402-a9ce26ee8d16 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739" status: 200 len: 1366 microversion: 2.47 time: 0.159824 Sep 10 12:05:01.116879 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1b169066-e5fd-49b7-a707-bacb92334a70 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:01.117336 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1b169066-e5fd-49b7-a707-bacb92334a70 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:01.118059 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1b169066-e5fd-49b7-a707-bacb92334a70 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:01.118517 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1b169066-e5fd-49b7-a707-bacb92334a70 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:01.131186 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1b169066-e5fd-49b7-a707-bacb92334a70 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:01.131586 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2590/5173] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:05:00 2022] GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:05:01.337470 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1b169066-e5fd-49b7-a707-bacb92334a70 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:01.349363 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1b169066-e5fd-49b7-a707-bacb92334a70 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.253817 Sep 10 12:05:01.351779 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2584/5174] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:01 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:01.364395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-53ff3160-f0e2-4c40-b93a-444ed7754e1a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:01.365277 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-53ff3160-f0e2-4c40-b93a-444ed7754e1a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:01.369767 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=100 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:05:01.380864 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-53ff3160-f0e2-4c40-b93a-444ed7754e1a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:01.382796 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-53ff3160-f0e2-4c40-b93a-444ed7754e1a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:01.383827 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-53ff3160-f0e2-4c40-b93a-444ed7754e1a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:01.385117 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-53ff3160-f0e2-4c40-b93a-444ed7754e1a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:01.385659 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-53ff3160-f0e2-4c40-b93a-444ed7754e1a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:01.387626 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-53ff3160-f0e2-4c40-b93a-444ed7754e1a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:01.391872 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b71b6b35-cbcd-425e-864a-cfe396627844 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:05:01.392462 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b71b6b35-cbcd-425e-864a-cfe396627844 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: 90262393-2810-466b-bfbe-4f989d3dcd3e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:01.412071 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-b71b6b35-cbcd-425e-864a-cfe396627844 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] HTTP exception thrown: Instance 90262393-2810-466b-bfbe-4f989d3dcd3e could not be found. Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b71b6b35-cbcd-425e-864a-cfe396627844 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/servers/90262393-2810-466b-bfbe-4f989d3dcd3e/action HTTP/1.1 Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 14 Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: {"resume": {}} Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 90262393-2810-466b-bfbe-4f989d3dcd3e could not be found. Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '90262393-2810-466b-bfbe-4f989d3dcd3e', 'body': {'resume': {}}} Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90262393-2810-466b-bfbe-4f989d3dcd3e could not be found. Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90262393-2810-466b-bfbe-4f989d3dcd3e could not be found. Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:01.430536 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:01.434322 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:05:01.434322 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:05:01.434322 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90262393-2810-466b-bfbe-4f989d3dcd3e could not be found. Sep 10 12:05:01.434322 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:01.461751 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b71b6b35-cbcd-425e-864a-cfe396627844 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 404 to user: Instance 90262393-2810-466b-bfbe-4f989d3dcd3e could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:05:01.462942 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b71b6b35-cbcd-425e-864a-cfe396627844 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "POST /compute/v2.1/servers/90262393-2810-466b-bfbe-4f989d3dcd3e/action" status: 404 len: 111 microversion: 2.1 time: 0.076952 Sep 10 12:05:01.464491 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2585/5175] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:05:01 2022] POST /compute/v2.1/servers/90262393-2810-466b-bfbe-4f989d3dcd3e/action => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 12:05:01.472425 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-72e7753a-2df9-47d8-b336-b37f42091744 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:01.483940 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-72e7753a-2df9-47d8-b336-b37f42091744 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:01.491441 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-72e7753a-2df9-47d8-b336-b37f42091744 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:01.492195 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-72e7753a-2df9-47d8-b336-b37f42091744 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:01.492835 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-72e7753a-2df9-47d8-b336-b37f42091744 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:01.493738 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-72e7753a-2df9-47d8-b336-b37f42091744 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:01.494391 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-72e7753a-2df9-47d8-b336-b37f42091744 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:01.495024 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-72e7753a-2df9-47d8-b336-b37f42091744 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:01.617835 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-53ff3160-f0e2-4c40-b93a-444ed7754e1a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:01.630765 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-53ff3160-f0e2-4c40-b93a-444ed7754e1a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1511 microversion: 2.1 time: 0.269687 Sep 10 12:05:01.631820 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2591/5176] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:01 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1511 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:01.759723 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-72e7753a-2df9-47d8-b336-b37f42091744 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:01.772850 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-72e7753a-2df9-47d8-b336-b37f42091744 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.303913 Sep 10 12:05:01.790807 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2586/5177] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:01 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:05:01.798712 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-69eed1a1-90ce-42ad-a7c9-cf6cc735eb01 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:01.799956 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-69eed1a1-90ce-42ad-a7c9-cf6cc735eb01 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:01.809772 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-69eed1a1-90ce-42ad-a7c9-cf6cc735eb01 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:01.810679 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-69eed1a1-90ce-42ad-a7c9-cf6cc735eb01 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:01.811394 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-69eed1a1-90ce-42ad-a7c9-cf6cc735eb01 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:01.812332 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-69eed1a1-90ce-42ad-a7c9-cf6cc735eb01 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:01.812990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-69eed1a1-90ce-42ad-a7c9-cf6cc735eb01 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:01.814091 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-69eed1a1-90ce-42ad-a7c9-cf6cc735eb01 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:02.014358 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-69eed1a1-90ce-42ad-a7c9-cf6cc735eb01 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:02.026036 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-69eed1a1-90ce-42ad-a7c9-cf6cc735eb01 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.231137 Sep 10 12:05:02.027602 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2592/5178] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:01 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:02.060548 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f80c2a4d-d035-466b-8bcb-227fe1e13332 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:05:02.061395 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f80c2a4d-d035-466b-8bcb-227fe1e13332 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:02.084990 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f80c2a4d-d035-466b-8bcb-227fe1e13332 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:02.086941 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f80c2a4d-d035-466b-8bcb-227fe1e13332 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:02.087486 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f80c2a4d-d035-466b-8bcb-227fe1e13332 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:02.088471 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f80c2a4d-d035-466b-8bcb-227fe1e13332 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:02.090270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f80c2a4d-d035-466b-8bcb-227fe1e13332 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:02.090813 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f80c2a4d-d035-466b-8bcb-227fe1e13332 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:02.146180 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fc3db201-f2a1-4105-930c-29a887f6d8e4 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:02.147147 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fc3db201-f2a1-4105-930c-29a887f6d8e4 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:02.159369 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc3db201-f2a1-4105-930c-29a887f6d8e4 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:02.163493 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc3db201-f2a1-4105-930c-29a887f6d8e4 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:02.164115 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc3db201-f2a1-4105-930c-29a887f6d8e4 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:02.165094 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc3db201-f2a1-4105-930c-29a887f6d8e4 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:02.166814 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-f80c2a4d-d035-466b-8bcb-227fe1e13332 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] HTTP exception thrown: Cannot 'resume' instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 while it is in vm_state active Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f80c2a4d-d035-466b-8bcb-227fe1e13332 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004/action HTTP/1.1 Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 14 Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: {"resume": {}} Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: exception: Cannot 'resume' instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 while it is in vm_state active Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'ac1538e5-6edc-4ccb-b7a9-c2e90284e004', 'body': {'resume': {}}} Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 in vm_state active. Cannot resume while the instance is in this state. Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 while it is in vm_state active Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:02.168983 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:02.174053 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:02.174053 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:02.174053 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:02.174053 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:05:02.174053 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:05:02.174053 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 while it is in vm_state active Sep 10 12:05:02.174053 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:02.174400 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc3db201-f2a1-4105-930c-29a887f6d8e4 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:02.174400 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc3db201-f2a1-4105-930c-29a887f6d8e4 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:02.175595 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f80c2a4d-d035-466b-8bcb-227fe1e13332 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 409 to user: Cannot 'resume' instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 while it is in vm_state active {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:05:02.176709 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f80c2a4d-d035-466b-8bcb-227fe1e13332 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "POST /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004/action" status: 409 len: 144 microversion: 2.1 time: 0.128821 Sep 10 12:05:02.180868 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2587/5179] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:05:02 2022] POST /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004/action => generated 144 bytes in 133 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 12:05:02.187898 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1279ab36-a7cf-43b0-b599-90dfd5b53111 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:02.188795 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1279ab36-a7cf-43b0-b599-90dfd5b53111 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:02.195681 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1279ab36-a7cf-43b0-b599-90dfd5b53111 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:02.196447 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1279ab36-a7cf-43b0-b599-90dfd5b53111 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:02.197127 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1279ab36-a7cf-43b0-b599-90dfd5b53111 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:02.198058 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1279ab36-a7cf-43b0-b599-90dfd5b53111 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:02.198824 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1279ab36-a7cf-43b0-b599-90dfd5b53111 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:02.199729 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1279ab36-a7cf-43b0-b599-90dfd5b53111 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:02.391962 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fc3db201-f2a1-4105-930c-29a887f6d8e4 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:02.403600 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fc3db201-f2a1-4105-930c-29a887f6d8e4 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:02.405726 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fc3db201-f2a1-4105-930c-29a887f6d8e4 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:02.407688 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fc3db201-f2a1-4105-930c-29a887f6d8e4 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739" status: 200 len: 1366 microversion: 2.47 time: 0.265462 Sep 10 12:05:02.422588 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2593/5180] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:05:02 2022] GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739 => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:05:02.438268 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1279ab36-a7cf-43b0-b599-90dfd5b53111 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:02.449148 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1279ab36-a7cf-43b0-b599-90dfd5b53111 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.266184 Sep 10 12:05:02.450784 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2588/5181] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:02 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:02.487551 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6961884a-a706-4a26-986a-a991939dddbc tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:02.488568 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6961884a-a706-4a26-986a-a991939dddbc tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:02.495515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6961884a-a706-4a26-986a-a991939dddbc tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:02.496518 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6961884a-a706-4a26-986a-a991939dddbc tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:02.497111 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6961884a-a706-4a26-986a-a991939dddbc tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:02.498073 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6961884a-a706-4a26-986a-a991939dddbc tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:02.498686 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6961884a-a706-4a26-986a-a991939dddbc tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:02.500118 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6961884a-a706-4a26-986a-a991939dddbc tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:02.659747 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1000be87-bc17-4529-a868-2ae675a762a3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:02.660602 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1000be87-bc17-4529-a868-2ae675a762a3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:02.681385 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1000be87-bc17-4529-a868-2ae675a762a3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:02.681933 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1000be87-bc17-4529-a868-2ae675a762a3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:02.682407 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1000be87-bc17-4529-a868-2ae675a762a3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:02.684686 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1000be87-bc17-4529-a868-2ae675a762a3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:02.684686 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1000be87-bc17-4529-a868-2ae675a762a3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:02.684686 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1000be87-bc17-4529-a868-2ae675a762a3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:02.720597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6961884a-a706-4a26-986a-a991939dddbc tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:02.729482 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6961884a-a706-4a26-986a-a991939dddbc tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.250537 Sep 10 12:05:02.739566 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2594/5182] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:02 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:02.835097 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4d48eeb0-9ab6-4e46-bec3-7510969c016d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "4cf2efdb-facd-4d46-b962-78192cf2010f"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4d48eeb0-9ab6-4e46-bec3-7510969c016d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 160 Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: {"server": {"name": "", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "4cf2efdb-facd-4d46-b962-78192cf2010f"}]}} Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'body': {'server': {'name': '', 'imageRef': 'c23d4d62-7ab9-4623-9273-7f44582aa2e1', 'flavorRef': '452', 'networks': [{'uuid': '4cf2efdb-facd-4d46-b962-78192cf2010f'}]}}} Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise error Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi '' Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 12:05:02.839700 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 12:05:02.851824 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 12:05:02.851824 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 10 12:05:02.851824 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:02.851824 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:02.851824 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:02.851824 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:02.851824 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:02.851824 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:02.851824 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 12:05:02.851824 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 12:05:02.851824 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 10 12:05:02.851824 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:02.859137 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4d48eeb0-9ab6-4e46-bec3-7510969c016d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:05:02.860514 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4d48eeb0-9ab6-4e46-bec3-7510969c016d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.035663 Sep 10 12:05:02.864113 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2595/5183] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:05:02 2022] POST /compute/v2.1/servers => generated 108 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 12:05:02.876307 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-431b0492-7dd3-44b5-a760-cf79db0344be tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:02.879481 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-431b0492-7dd3-44b5-a760-cf79db0344be tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:02.888350 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-431b0492-7dd3-44b5-a760-cf79db0344be tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:02.888652 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-431b0492-7dd3-44b5-a760-cf79db0344be tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:02.889098 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-431b0492-7dd3-44b5-a760-cf79db0344be tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:02.889977 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-431b0492-7dd3-44b5-a760-cf79db0344be tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:02.890653 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-431b0492-7dd3-44b5-a760-cf79db0344be tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:02.891066 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-431b0492-7dd3-44b5-a760-cf79db0344be tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:02.939326 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1000be87-bc17-4529-a868-2ae675a762a3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:02.953039 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1000be87-bc17-4529-a868-2ae675a762a3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1511 microversion: 2.1 time: 0.298158 Sep 10 12:05:02.953936 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2589/5184] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:02 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1511 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:03.148031 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-431b0492-7dd3-44b5-a760-cf79db0344be tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:03.164668 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-431b0492-7dd3-44b5-a760-cf79db0344be tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.290840 Sep 10 12:05:03.180458 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2596/5185] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:02 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:03.192792 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2fa0378e-1c61-4bf8-a0a9-4f8579de3d90 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:03.193423 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2fa0378e-1c61-4bf8-a0a9-4f8579de3d90 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:03.203024 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2fa0378e-1c61-4bf8-a0a9-4f8579de3d90 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:03.203625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2fa0378e-1c61-4bf8-a0a9-4f8579de3d90 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:03.203922 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2fa0378e-1c61-4bf8-a0a9-4f8579de3d90 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:03.204629 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2fa0378e-1c61-4bf8-a0a9-4f8579de3d90 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:03.205322 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2fa0378e-1c61-4bf8-a0a9-4f8579de3d90 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:03.205986 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2fa0378e-1c61-4bf8-a0a9-4f8579de3d90 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:03.407368 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2fa0378e-1c61-4bf8-a0a9-4f8579de3d90 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:03.424713 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2fa0378e-1c61-4bf8-a0a9-4f8579de3d90 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.235983 Sep 10 12:05:03.425494 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2590/5186] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:03 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:03.434779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3b06f34d-682a-44de-a20b-6c68ff8574d2 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:03.436093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3b06f34d-682a-44de-a20b-6c68ff8574d2 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:03.453093 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d76ed543-8699-4c70-8828-7330952704f0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:05:03.454758 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d76ed543-8699-4c70-8828-7330952704f0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ba4fc54f-1e6d-4c90-aad2-32e87884c07a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:03.468431 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3b06f34d-682a-44de-a20b-6c68ff8574d2 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:03.468954 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3b06f34d-682a-44de-a20b-6c68ff8574d2 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:03.469073 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-d76ed543-8699-4c70-8828-7330952704f0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] HTTP exception thrown: Instance ba4fc54f-1e6d-4c90-aad2-32e87884c07a could not be found. Sep 10 12:05:03.469407 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3b06f34d-682a-44de-a20b-6c68ff8574d2 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:03.472109 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3b06f34d-682a-44de-a20b-6c68ff8574d2 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:03.472658 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3b06f34d-682a-44de-a20b-6c68ff8574d2 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:03.473108 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3b06f34d-682a-44de-a20b-6c68ff8574d2 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d76ed543-8699-4c70-8828-7330952704f0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/servers/ba4fc54f-1e6d-4c90-aad2-32e87884c07a/action HTTP/1.1 Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 14 Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: {"shelve": {}} Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance ba4fc54f-1e6d-4c90-aad2-32e87884c07a could not be found. Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'ba4fc54f-1e6d-4c90-aad2-32e87884c07a', 'body': {'shelve': {}}} Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba4fc54f-1e6d-4c90-aad2-32e87884c07a could not be found. Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba4fc54f-1e6d-4c90-aad2-32e87884c07a could not be found. Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:03.473215 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:03.476515 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:05:03.476515 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:05:03.476515 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba4fc54f-1e6d-4c90-aad2-32e87884c07a could not be found. Sep 10 12:05:03.476515 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:03.476515 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d76ed543-8699-4c70-8828-7330952704f0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 404 to user: Instance ba4fc54f-1e6d-4c90-aad2-32e87884c07a could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:05:03.476515 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d76ed543-8699-4c70-8828-7330952704f0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "POST /compute/v2.1/servers/ba4fc54f-1e6d-4c90-aad2-32e87884c07a/action" status: 404 len: 111 microversion: 2.1 time: 0.028690 Sep 10 12:05:03.483287 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:05:03.484144 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2591/5187] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:05:03 2022] POST /compute/v2.1/servers/ba4fc54f-1e6d-4c90-aad2-32e87884c07a/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:05:03.491353 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-436f40f2-4797-4ea7-90cc-25dca5bbe648 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:03.495934 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-436f40f2-4797-4ea7-90cc-25dca5bbe648 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:03.510289 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-436f40f2-4797-4ea7-90cc-25dca5bbe648 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:03.512273 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-436f40f2-4797-4ea7-90cc-25dca5bbe648 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:03.514185 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-436f40f2-4797-4ea7-90cc-25dca5bbe648 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:03.516710 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-436f40f2-4797-4ea7-90cc-25dca5bbe648 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:03.519059 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-436f40f2-4797-4ea7-90cc-25dca5bbe648 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:03.520185 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-436f40f2-4797-4ea7-90cc-25dca5bbe648 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:03.695596 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3b06f34d-682a-44de-a20b-6c68ff8574d2 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:03.704343 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3b06f34d-682a-44de-a20b-6c68ff8574d2 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:03.705880 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3b06f34d-682a-44de-a20b-6c68ff8574d2 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:03.707008 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3b06f34d-682a-44de-a20b-6c68ff8574d2 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739" status: 200 len: 1366 microversion: 2.47 time: 0.276501 Sep 10 12:05:03.707635 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2597/5188] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:05:03 2022] GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739 => generated 1366 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:05:03.891425 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-436f40f2-4797-4ea7-90cc-25dca5bbe648 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:03.912710 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-436f40f2-4797-4ea7-90cc-25dca5bbe648 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.427706 Sep 10 12:05:03.916043 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2592/5189] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:03 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:03.944415 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-dd0dc575-c73f-4f02-bf7c-4ac60fe01593 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:03.945061 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-dd0dc575-c73f-4f02-bf7c-4ac60fe01593 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:03.953190 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd0dc575-c73f-4f02-bf7c-4ac60fe01593 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:03.954018 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd0dc575-c73f-4f02-bf7c-4ac60fe01593 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:03.954729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd0dc575-c73f-4f02-bf7c-4ac60fe01593 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:03.956399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd0dc575-c73f-4f02-bf7c-4ac60fe01593 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:03.957083 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd0dc575-c73f-4f02-bf7c-4ac60fe01593 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:03.957734 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd0dc575-c73f-4f02-bf7c-4ac60fe01593 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:03.977786 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0c4e3591-5ffe-4647-9446-a46f1989aa94 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:03.978647 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0c4e3591-5ffe-4647-9446-a46f1989aa94 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:03.989060 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c4e3591-5ffe-4647-9446-a46f1989aa94 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:03.990205 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c4e3591-5ffe-4647-9446-a46f1989aa94 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:03.991690 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c4e3591-5ffe-4647-9446-a46f1989aa94 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:03.993890 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c4e3591-5ffe-4647-9446-a46f1989aa94 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:03.995059 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c4e3591-5ffe-4647-9446-a46f1989aa94 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:03.995429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c4e3591-5ffe-4647-9446-a46f1989aa94 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:04.183624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0c4e3591-5ffe-4647-9446-a46f1989aa94 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:04.197021 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0c4e3591-5ffe-4647-9446-a46f1989aa94 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1511 microversion: 2.1 time: 0.224923 Sep 10 12:05:04.211569 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2593/5190] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:03 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1511 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:04.288783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-dd0dc575-c73f-4f02-bf7c-4ac60fe01593 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:04.298659 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-dd0dc575-c73f-4f02-bf7c-4ac60fe01593 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.358413 Sep 10 12:05:04.299497 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2598/5191] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:03 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:04.325384 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8a89555c-1b22-4f93-b7d0-cd2b4ec3f4f5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:05:04.325936 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8a89555c-1b22-4f93-b7d0-cd2b4ec3f4f5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:04.332993 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a89555c-1b22-4f93-b7d0-cd2b4ec3f4f5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:04.333495 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a89555c-1b22-4f93-b7d0-cd2b4ec3f4f5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:04.334146 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a89555c-1b22-4f93-b7d0-cd2b4ec3f4f5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:04.335014 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a89555c-1b22-4f93-b7d0-cd2b4ec3f4f5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:04.336353 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a89555c-1b22-4f93-b7d0-cd2b4ec3f4f5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:04.336994 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8a89555c-1b22-4f93-b7d0-cd2b4ec3f4f5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:04.362455 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-8a89555c-1b22-4f93-b7d0-cd2b4ec3f4f5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lazy-loading 'flavor' on Instance uuid ac1538e5-6edc-4ccb-b7a9-c2e90284e004 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:05:04.635024 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8a89555c-1b22-4f93-b7d0-cd2b4ec3f4f5 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "POST /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004/action" status: 202 len: 0 microversion: 2.1 time: 0.314265 Sep 10 12:05:04.637018 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2594/5192] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:05:04 2022] POST /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:05:04.646083 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d1225dd0-a21e-4c38-9e6c-8c9a0aca2cbe tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:04.646861 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d1225dd0-a21e-4c38-9e6c-8c9a0aca2cbe tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:04.657359 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1225dd0-a21e-4c38-9e6c-8c9a0aca2cbe tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:04.658172 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1225dd0-a21e-4c38-9e6c-8c9a0aca2cbe tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:04.658989 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1225dd0-a21e-4c38-9e6c-8c9a0aca2cbe tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:04.659928 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1225dd0-a21e-4c38-9e6c-8c9a0aca2cbe tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:04.660658 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1225dd0-a21e-4c38-9e6c-8c9a0aca2cbe tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:04.661217 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1225dd0-a21e-4c38-9e6c-8c9a0aca2cbe tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:04.746573 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7be30fa1-298d-4ebd-bd65-7ecf9f21c812 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:04.748577 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7be30fa1-298d-4ebd-bd65-7ecf9f21c812 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:04.758429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7be30fa1-298d-4ebd-bd65-7ecf9f21c812 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:04.758946 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7be30fa1-298d-4ebd-bd65-7ecf9f21c812 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:04.759429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7be30fa1-298d-4ebd-bd65-7ecf9f21c812 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:04.767321 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7be30fa1-298d-4ebd-bd65-7ecf9f21c812 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:04.768184 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7be30fa1-298d-4ebd-bd65-7ecf9f21c812 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:04.769831 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7be30fa1-298d-4ebd-bd65-7ecf9f21c812 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:04.921381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7be30fa1-298d-4ebd-bd65-7ecf9f21c812 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:04.929652 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:05:04.941556 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7be30fa1-298d-4ebd-bd65-7ecf9f21c812 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:04.943652 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d1225dd0-a21e-4c38-9e6c-8c9a0aca2cbe tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:04.949204 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7be30fa1-298d-4ebd-bd65-7ecf9f21c812 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:04.951572 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7be30fa1-298d-4ebd-bd65-7ecf9f21c812 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739" status: 200 len: 1366 microversion: 2.47 time: 0.209501 Sep 10 12:05:04.957072 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2595/5193] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:05:04 2022] GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 12:05:04.969393 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d1225dd0-a21e-4c38-9e6c-8c9a0aca2cbe tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1513 microversion: 2.1 time: 0.327130 Sep 10 12:05:04.970007 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2599/5194] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:04 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1513 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:05.223860 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d85de3cb-e7d9-45c8-ae25-021d899d8360 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:05.224718 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d85de3cb-e7d9-45c8-ae25-021d899d8360 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:05.231354 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d85de3cb-e7d9-45c8-ae25-021d899d8360 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:05.232059 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d85de3cb-e7d9-45c8-ae25-021d899d8360 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:05.232641 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d85de3cb-e7d9-45c8-ae25-021d899d8360 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:05.233506 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d85de3cb-e7d9-45c8-ae25-021d899d8360 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:05.233966 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d85de3cb-e7d9-45c8-ae25-021d899d8360 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:05.234402 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d85de3cb-e7d9-45c8-ae25-021d899d8360 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:05.393579 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d85de3cb-e7d9-45c8-ae25-021d899d8360 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:05.404587 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d85de3cb-e7d9-45c8-ae25-021d899d8360 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1511 microversion: 2.1 time: 0.185650 Sep 10 12:05:05.406243 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2596/5195] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:05 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1511 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:05.981256 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2905b4dd-7934-4060-8a6f-fb6d2c4abea7 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:05.982673 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2905b4dd-7934-4060-8a6f-fb6d2c4abea7 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:05.998295 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2905b4dd-7934-4060-8a6f-fb6d2c4abea7 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:06.001262 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5560bf57-9383-4716-8da8-14765ad949d6 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:06.007115 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5560bf57-9383-4716-8da8-14765ad949d6 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:06.015707 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5560bf57-9383-4716-8da8-14765ad949d6 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:06.016202 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5560bf57-9383-4716-8da8-14765ad949d6 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:06.016649 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5560bf57-9383-4716-8da8-14765ad949d6 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:06.017366 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5560bf57-9383-4716-8da8-14765ad949d6 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:06.017724 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2905b4dd-7934-4060-8a6f-fb6d2c4abea7 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:06.017845 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5560bf57-9383-4716-8da8-14765ad949d6 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:06.018246 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5560bf57-9383-4716-8da8-14765ad949d6 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:06.019848 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2905b4dd-7934-4060-8a6f-fb6d2c4abea7 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:06.020823 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2905b4dd-7934-4060-8a6f-fb6d2c4abea7 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:06.022615 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2905b4dd-7934-4060-8a6f-fb6d2c4abea7 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:06.024662 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2905b4dd-7934-4060-8a6f-fb6d2c4abea7 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:06.236329 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2905b4dd-7934-4060-8a6f-fb6d2c4abea7 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:06.244535 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2905b4dd-7934-4060-8a6f-fb6d2c4abea7 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:06.246821 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2905b4dd-7934-4060-8a6f-fb6d2c4abea7 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:06.248049 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2905b4dd-7934-4060-8a6f-fb6d2c4abea7 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739" status: 200 len: 1366 microversion: 2.47 time: 0.271171 Sep 10 12:05:06.263536 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2600/5196] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:05:05 2022] GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739 => generated 1366 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 12:05:06.355968 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5560bf57-9383-4716-8da8-14765ad949d6 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:06.368344 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5560bf57-9383-4716-8da8-14765ad949d6 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1513 microversion: 2.1 time: 0.378990 Sep 10 12:05:06.384523 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2597/5197] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:05 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1513 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:06.433540 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-77130975-7db2-4a3b-bfac-ae4446927ad6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:06.434142 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-77130975-7db2-4a3b-bfac-ae4446927ad6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:06.440891 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-77130975-7db2-4a3b-bfac-ae4446927ad6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:06.441623 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-77130975-7db2-4a3b-bfac-ae4446927ad6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:06.442295 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-77130975-7db2-4a3b-bfac-ae4446927ad6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:06.443251 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-77130975-7db2-4a3b-bfac-ae4446927ad6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:06.443916 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-77130975-7db2-4a3b-bfac-ae4446927ad6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:06.444549 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-77130975-7db2-4a3b-bfac-ae4446927ad6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:06.707118 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-77130975-7db2-4a3b-bfac-ae4446927ad6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:06.717535 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-77130975-7db2-4a3b-bfac-ae4446927ad6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1511 microversion: 2.1 time: 0.288215 Sep 10 12:05:06.718960 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2601/5198] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:06 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1511 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:07.277750 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-39ba3325-5baa-4a24-b8bf-8d2e4d883e0f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:07.279395 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-39ba3325-5baa-4a24-b8bf-8d2e4d883e0f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:07.289539 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-39ba3325-5baa-4a24-b8bf-8d2e4d883e0f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:07.290260 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-39ba3325-5baa-4a24-b8bf-8d2e4d883e0f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:07.290858 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-39ba3325-5baa-4a24-b8bf-8d2e4d883e0f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:07.291803 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-39ba3325-5baa-4a24-b8bf-8d2e4d883e0f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:07.292461 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-39ba3325-5baa-4a24-b8bf-8d2e4d883e0f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:07.293053 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-39ba3325-5baa-4a24-b8bf-8d2e4d883e0f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:07.397972 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-dc290568-2622-4344-9ce1-2055bd2fc878 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:07.399494 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-dc290568-2622-4344-9ce1-2055bd2fc878 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:07.413877 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-39ba3325-5baa-4a24-b8bf-8d2e4d883e0f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:07.415629 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dc290568-2622-4344-9ce1-2055bd2fc878 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:07.419925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dc290568-2622-4344-9ce1-2055bd2fc878 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:07.421093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dc290568-2622-4344-9ce1-2055bd2fc878 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:07.425670 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dc290568-2622-4344-9ce1-2055bd2fc878 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:07.427315 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-39ba3325-5baa-4a24-b8bf-8d2e4d883e0f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:07.429672 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-39ba3325-5baa-4a24-b8bf-8d2e4d883e0f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:07.430260 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dc290568-2622-4344-9ce1-2055bd2fc878 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:07.430797 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dc290568-2622-4344-9ce1-2055bd2fc878 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:07.431300 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-39ba3325-5baa-4a24-b8bf-8d2e4d883e0f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739" status: 200 len: 1366 microversion: 2.47 time: 0.161167 Sep 10 12:05:07.458896 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2598/5199] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:05:07 2022] GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739 => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 12:05:07.699918 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-dc290568-2622-4344-9ce1-2055bd2fc878 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:07.710367 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-dc290568-2622-4344-9ce1-2055bd2fc878 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1513 microversion: 2.1 time: 0.316431 Sep 10 12:05:07.724295 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2602/5200] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:07 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1513 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:05:07.741496 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-58ac5fbe-22fc-4b10-8627-fa97675eb7c6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:07.742120 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-58ac5fbe-22fc-4b10-8627-fa97675eb7c6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:07.752226 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-58ac5fbe-22fc-4b10-8627-fa97675eb7c6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:07.754970 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-58ac5fbe-22fc-4b10-8627-fa97675eb7c6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:07.755443 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-58ac5fbe-22fc-4b10-8627-fa97675eb7c6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:07.763904 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-58ac5fbe-22fc-4b10-8627-fa97675eb7c6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:07.764588 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-58ac5fbe-22fc-4b10-8627-fa97675eb7c6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:07.765184 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-58ac5fbe-22fc-4b10-8627-fa97675eb7c6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:07.959625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-58ac5fbe-22fc-4b10-8627-fa97675eb7c6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:07.970103 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-58ac5fbe-22fc-4b10-8627-fa97675eb7c6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1511 microversion: 2.1 time: 0.232791 Sep 10 12:05:07.983203 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2599/5201] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:07 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1511 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:08.462385 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-aee8f378-cb87-4b27-8536-402d0ec79b38 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:08.463011 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-aee8f378-cb87-4b27-8536-402d0ec79b38 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:08.476098 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aee8f378-cb87-4b27-8536-402d0ec79b38 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:08.476922 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aee8f378-cb87-4b27-8536-402d0ec79b38 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:08.477470 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aee8f378-cb87-4b27-8536-402d0ec79b38 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:08.479188 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aee8f378-cb87-4b27-8536-402d0ec79b38 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:08.479744 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aee8f378-cb87-4b27-8536-402d0ec79b38 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:08.480451 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aee8f378-cb87-4b27-8536-402d0ec79b38 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:08.586919 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-aee8f378-cb87-4b27-8536-402d0ec79b38 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:08.597261 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-aee8f378-cb87-4b27-8536-402d0ec79b38 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:08.598712 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-aee8f378-cb87-4b27-8536-402d0ec79b38 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:08.599973 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-aee8f378-cb87-4b27-8536-402d0ec79b38 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739" status: 200 len: 1366 microversion: 2.47 time: 0.141531 Sep 10 12:05:08.600944 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2603/5202] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:05:08 2022] GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739 => generated 1366 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:05:08.737970 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-10c81d45-341d-4b38-b1ad-18b1a23a20fa tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:08.738503 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-10c81d45-341d-4b38-b1ad-18b1a23a20fa tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:08.746968 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10c81d45-341d-4b38-b1ad-18b1a23a20fa tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:08.747955 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10c81d45-341d-4b38-b1ad-18b1a23a20fa tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:08.748405 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10c81d45-341d-4b38-b1ad-18b1a23a20fa tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:08.749261 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10c81d45-341d-4b38-b1ad-18b1a23a20fa tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:08.750015 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10c81d45-341d-4b38-b1ad-18b1a23a20fa tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:08.750466 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10c81d45-341d-4b38-b1ad-18b1a23a20fa tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:08.957683 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-10c81d45-341d-4b38-b1ad-18b1a23a20fa tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:08.965648 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-10c81d45-341d-4b38-b1ad-18b1a23a20fa tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1513 microversion: 2.1 time: 0.231633 Sep 10 12:05:08.966763 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2600/5203] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:08 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1513 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:08.997381 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1d974cab-c874-49f5-b0bc-5c1ca409bca3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:08.998271 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1d974cab-c874-49f5-b0bc-5c1ca409bca3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:09.005234 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d974cab-c874-49f5-b0bc-5c1ca409bca3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:09.005831 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d974cab-c874-49f5-b0bc-5c1ca409bca3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:09.006280 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d974cab-c874-49f5-b0bc-5c1ca409bca3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:09.007002 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d974cab-c874-49f5-b0bc-5c1ca409bca3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:09.007491 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d974cab-c874-49f5-b0bc-5c1ca409bca3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:09.008161 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d974cab-c874-49f5-b0bc-5c1ca409bca3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:09.241749 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1d974cab-c874-49f5-b0bc-5c1ca409bca3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:09.253345 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1d974cab-c874-49f5-b0bc-5c1ca409bca3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1511 microversion: 2.1 time: 0.261342 Sep 10 12:05:09.259132 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2604/5204] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:08 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1511 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:09.626801 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4be722f5-e356-42e8-ba51-150db439b802 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:09.627674 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4be722f5-e356-42e8-ba51-150db439b802 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:09.637819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4be722f5-e356-42e8-ba51-150db439b802 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:09.638387 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4be722f5-e356-42e8-ba51-150db439b802 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:09.638850 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4be722f5-e356-42e8-ba51-150db439b802 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:09.639753 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4be722f5-e356-42e8-ba51-150db439b802 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:09.640420 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4be722f5-e356-42e8-ba51-150db439b802 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:09.641489 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4be722f5-e356-42e8-ba51-150db439b802 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:09.786920 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4be722f5-e356-42e8-ba51-150db439b802 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:09.800120 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4be722f5-e356-42e8-ba51-150db439b802 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:09.801989 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4be722f5-e356-42e8-ba51-150db439b802 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:09.804893 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4be722f5-e356-42e8-ba51-150db439b802 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739" status: 200 len: 1366 microversion: 2.47 time: 0.181709 Sep 10 12:05:09.811895 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2601/5205] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:05:09 2022] GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739 => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:05:09.990988 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d49e9c1d-b443-4312-a4d4-7815392ed4cf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:09.992321 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d49e9c1d-b443-4312-a4d4-7815392ed4cf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:10.001395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d49e9c1d-b443-4312-a4d4-7815392ed4cf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:10.002439 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d49e9c1d-b443-4312-a4d4-7815392ed4cf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:10.003039 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d49e9c1d-b443-4312-a4d4-7815392ed4cf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:10.005450 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d49e9c1d-b443-4312-a4d4-7815392ed4cf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:10.006119 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d49e9c1d-b443-4312-a4d4-7815392ed4cf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:10.006718 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d49e9c1d-b443-4312-a4d4-7815392ed4cf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:10.211876 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d49e9c1d-b443-4312-a4d4-7815392ed4cf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:10.223963 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d49e9c1d-b443-4312-a4d4-7815392ed4cf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1513 microversion: 2.1 time: 0.238425 Sep 10 12:05:10.250860 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2605/5206] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:09 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1513 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:10.287602 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1fa33b9e-6541-4ebf-83d0-d33dcbb32053 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:10.288329 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1fa33b9e-6541-4ebf-83d0-d33dcbb32053 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:10.296207 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1fa33b9e-6541-4ebf-83d0-d33dcbb32053 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:10.296996 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1fa33b9e-6541-4ebf-83d0-d33dcbb32053 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:10.297627 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1fa33b9e-6541-4ebf-83d0-d33dcbb32053 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:10.299075 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1fa33b9e-6541-4ebf-83d0-d33dcbb32053 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:10.299649 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1fa33b9e-6541-4ebf-83d0-d33dcbb32053 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:10.300151 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1fa33b9e-6541-4ebf-83d0-d33dcbb32053 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:10.479254 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1fa33b9e-6541-4ebf-83d0-d33dcbb32053 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:10.490573 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1fa33b9e-6541-4ebf-83d0-d33dcbb32053 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1511 microversion: 2.1 time: 0.208459 Sep 10 12:05:10.491397 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2602/5207] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:10 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1511 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:10.836782 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0c7003a3-d223-4082-810c-109f8202e036 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:10.837147 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0c7003a3-d223-4082-810c-109f8202e036 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:10.847880 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c7003a3-d223-4082-810c-109f8202e036 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:10.848379 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c7003a3-d223-4082-810c-109f8202e036 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:10.848823 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c7003a3-d223-4082-810c-109f8202e036 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:10.849529 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c7003a3-d223-4082-810c-109f8202e036 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:10.851927 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c7003a3-d223-4082-810c-109f8202e036 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:10.852381 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c7003a3-d223-4082-810c-109f8202e036 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:10.952299 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0c7003a3-d223-4082-810c-109f8202e036 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:10.977043 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0c7003a3-d223-4082-810c-109f8202e036 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:10.978725 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0c7003a3-d223-4082-810c-109f8202e036 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:10.980530 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0c7003a3-d223-4082-810c-109f8202e036 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739" status: 200 len: 1366 microversion: 2.47 time: 0.147822 Sep 10 12:05:10.990527 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2606/5208] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:05:10 2022] GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:05:11.255035 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e12d4d00-cda5-461f-b301-38567c750277 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:11.256249 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e12d4d00-cda5-461f-b301-38567c750277 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:11.265313 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e12d4d00-cda5-461f-b301-38567c750277 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:11.266057 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e12d4d00-cda5-461f-b301-38567c750277 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:11.266803 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e12d4d00-cda5-461f-b301-38567c750277 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:11.267739 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e12d4d00-cda5-461f-b301-38567c750277 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:11.268340 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e12d4d00-cda5-461f-b301-38567c750277 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:11.268933 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e12d4d00-cda5-461f-b301-38567c750277 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:11.518240 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a082d827-01ed-4fbe-a38d-f7bee16e9b56 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:11.519104 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a082d827-01ed-4fbe-a38d-f7bee16e9b56 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:11.530484 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a082d827-01ed-4fbe-a38d-f7bee16e9b56 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:11.531232 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a082d827-01ed-4fbe-a38d-f7bee16e9b56 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:11.531863 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a082d827-01ed-4fbe-a38d-f7bee16e9b56 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:11.532830 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a082d827-01ed-4fbe-a38d-f7bee16e9b56 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:11.533600 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a082d827-01ed-4fbe-a38d-f7bee16e9b56 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:11.534190 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a082d827-01ed-4fbe-a38d-f7bee16e9b56 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:11.616731 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e12d4d00-cda5-461f-b301-38567c750277 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:11.633129 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e12d4d00-cda5-461f-b301-38567c750277 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1513 microversion: 2.1 time: 0.382815 Sep 10 12:05:11.636814 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2603/5209] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:11 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1513 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:05:12.014476 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ecb94ad8-d012-4212-83fa-36f87d5f56e5 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:12.015194 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ecb94ad8-d012-4212-83fa-36f87d5f56e5 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:12.029826 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ecb94ad8-d012-4212-83fa-36f87d5f56e5 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:12.030523 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ecb94ad8-d012-4212-83fa-36f87d5f56e5 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:12.030975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ecb94ad8-d012-4212-83fa-36f87d5f56e5 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:12.031732 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ecb94ad8-d012-4212-83fa-36f87d5f56e5 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:12.032214 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ecb94ad8-d012-4212-83fa-36f87d5f56e5 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:12.032726 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ecb94ad8-d012-4212-83fa-36f87d5f56e5 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:12.290167 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ecb94ad8-d012-4212-83fa-36f87d5f56e5 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:12.302010 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ecb94ad8-d012-4212-83fa-36f87d5f56e5 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:12.303986 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ecb94ad8-d012-4212-83fa-36f87d5f56e5 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:12.305408 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ecb94ad8-d012-4212-83fa-36f87d5f56e5 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739" status: 200 len: 1366 microversion: 2.47 time: 0.296035 Sep 10 12:05:12.327356 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2604/5210] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:05:12 2022] GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739 => generated 1366 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 12:05:12.341192 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a082d827-01ed-4fbe-a38d-f7bee16e9b56 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:12.351531 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a082d827-01ed-4fbe-a38d-f7bee16e9b56 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1511 microversion: 2.1 time: 0.837153 Sep 10 12:05:12.353454 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2607/5211] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:11 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1511 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:05:12.664917 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-066dd46b-e95e-46bf-9bcf-7b67b0942674 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:12.665560 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-066dd46b-e95e-46bf-9bcf-7b67b0942674 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:12.676893 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-066dd46b-e95e-46bf-9bcf-7b67b0942674 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:12.677466 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-066dd46b-e95e-46bf-9bcf-7b67b0942674 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:12.677927 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-066dd46b-e95e-46bf-9bcf-7b67b0942674 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:12.680484 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-066dd46b-e95e-46bf-9bcf-7b67b0942674 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:12.681261 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-066dd46b-e95e-46bf-9bcf-7b67b0942674 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:12.683969 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-066dd46b-e95e-46bf-9bcf-7b67b0942674 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:12.957044 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-066dd46b-e95e-46bf-9bcf-7b67b0942674 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:12.972683 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-066dd46b-e95e-46bf-9bcf-7b67b0942674 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1513 microversion: 2.1 time: 0.315763 Sep 10 12:05:12.973882 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2605/5212] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:12 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1513 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:13.332194 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a417eff4-f6a8-4860-86a6-809b98c355a2 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:13.332975 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a417eff4-f6a8-4860-86a6-809b98c355a2 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:13.346977 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a417eff4-f6a8-4860-86a6-809b98c355a2 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:13.347518 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a417eff4-f6a8-4860-86a6-809b98c355a2 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:13.348134 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a417eff4-f6a8-4860-86a6-809b98c355a2 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:13.350062 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a417eff4-f6a8-4860-86a6-809b98c355a2 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:13.352219 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a417eff4-f6a8-4860-86a6-809b98c355a2 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:13.353031 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a417eff4-f6a8-4860-86a6-809b98c355a2 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:13.377393 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-581576de-6d48-467f-a064-fa637dfad60a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:13.378024 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-581576de-6d48-467f-a064-fa637dfad60a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:13.386972 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-581576de-6d48-467f-a064-fa637dfad60a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:13.398464 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-581576de-6d48-467f-a064-fa637dfad60a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:13.398971 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-581576de-6d48-467f-a064-fa637dfad60a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:13.399760 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-581576de-6d48-467f-a064-fa637dfad60a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:13.400240 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-581576de-6d48-467f-a064-fa637dfad60a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:13.400674 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-581576de-6d48-467f-a064-fa637dfad60a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:13.532217 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a417eff4-f6a8-4860-86a6-809b98c355a2 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:13.542493 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a417eff4-f6a8-4860-86a6-809b98c355a2 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:13.545207 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a417eff4-f6a8-4860-86a6-809b98c355a2 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:13.546634 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a417eff4-f6a8-4860-86a6-809b98c355a2 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739" status: 200 len: 1366 microversion: 2.47 time: 0.218398 Sep 10 12:05:13.547712 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2608/5213] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:05:13 2022] GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:05:13.735466 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-581576de-6d48-467f-a064-fa637dfad60a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:13.751043 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-581576de-6d48-467f-a064-fa637dfad60a tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1511 microversion: 2.1 time: 0.377417 Sep 10 12:05:13.752823 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2606/5214] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:13 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1511 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:14.000150 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-723dd384-b9c0-4a00-84f9-900d2c7fa66b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:14.001209 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-723dd384-b9c0-4a00-84f9-900d2c7fa66b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:14.008541 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-723dd384-b9c0-4a00-84f9-900d2c7fa66b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:14.009393 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-723dd384-b9c0-4a00-84f9-900d2c7fa66b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:14.010050 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-723dd384-b9c0-4a00-84f9-900d2c7fa66b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:14.011776 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-723dd384-b9c0-4a00-84f9-900d2c7fa66b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:14.012683 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-723dd384-b9c0-4a00-84f9-900d2c7fa66b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:14.013338 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-723dd384-b9c0-4a00-84f9-900d2c7fa66b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:14.284204 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-723dd384-b9c0-4a00-84f9-900d2c7fa66b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:14.314122 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-723dd384-b9c0-4a00-84f9-900d2c7fa66b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1513 microversion: 2.1 time: 0.317904 Sep 10 12:05:14.319891 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2609/5215] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:13 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1513 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:14.573897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-65893bda-37db-4d43-b234-29055f80e07d tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:14.574547 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-65893bda-37db-4d43-b234-29055f80e07d tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:14.584617 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65893bda-37db-4d43-b234-29055f80e07d tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:14.585105 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65893bda-37db-4d43-b234-29055f80e07d tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:14.585548 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65893bda-37db-4d43-b234-29055f80e07d tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:14.586257 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65893bda-37db-4d43-b234-29055f80e07d tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:14.586714 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65893bda-37db-4d43-b234-29055f80e07d tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:14.587144 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65893bda-37db-4d43-b234-29055f80e07d tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:14.676422 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-65893bda-37db-4d43-b234-29055f80e07d tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:14.692480 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-65893bda-37db-4d43-b234-29055f80e07d tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:14.694347 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-65893bda-37db-4d43-b234-29055f80e07d tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:14.695811 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-65893bda-37db-4d43-b234-29055f80e07d tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739" status: 200 len: 1366 microversion: 2.47 time: 0.127026 Sep 10 12:05:14.696876 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2607/5216] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:05:14 2022] GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739 => generated 1366 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:05:14.775051 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-46934e3f-b556-4ade-aa76-a5d0f559244c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:14.775613 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-46934e3f-b556-4ade-aa76-a5d0f559244c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:14.782915 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46934e3f-b556-4ade-aa76-a5d0f559244c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:14.783424 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46934e3f-b556-4ade-aa76-a5d0f559244c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:14.783861 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46934e3f-b556-4ade-aa76-a5d0f559244c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:14.784557 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46934e3f-b556-4ade-aa76-a5d0f559244c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:14.785010 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46934e3f-b556-4ade-aa76-a5d0f559244c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:14.785435 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46934e3f-b556-4ade-aa76-a5d0f559244c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:14.993814 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-46934e3f-b556-4ade-aa76-a5d0f559244c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:15.002232 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-46934e3f-b556-4ade-aa76-a5d0f559244c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1511 microversion: 2.1 time: 0.231180 Sep 10 12:05:15.002824 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2610/5217] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:14 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1511 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:15.347614 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ee0d3943-c60a-4ab8-97b2-4821ec85019a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:15.348793 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ee0d3943-c60a-4ab8-97b2-4821ec85019a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:15.361457 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ee0d3943-c60a-4ab8-97b2-4821ec85019a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:15.379950 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ee0d3943-c60a-4ab8-97b2-4821ec85019a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:15.381980 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ee0d3943-c60a-4ab8-97b2-4821ec85019a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:15.384140 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ee0d3943-c60a-4ab8-97b2-4821ec85019a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:15.384942 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ee0d3943-c60a-4ab8-97b2-4821ec85019a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:15.385584 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ee0d3943-c60a-4ab8-97b2-4821ec85019a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:15.711968 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ee0d3943-c60a-4ab8-97b2-4821ec85019a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:15.723551 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-914b3629-a634-4a7e-a238-0367d4f0b8a0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:15.724190 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-914b3629-a634-4a7e-a238-0367d4f0b8a0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:15.726512 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ee0d3943-c60a-4ab8-97b2-4821ec85019a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1513 microversion: 2.1 time: 0.387415 Sep 10 12:05:15.727918 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2608/5218] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:15 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1513 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:15.747191 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-914b3629-a634-4a7e-a238-0367d4f0b8a0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:15.747883 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-914b3629-a634-4a7e-a238-0367d4f0b8a0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:15.748733 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-914b3629-a634-4a7e-a238-0367d4f0b8a0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:15.749563 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-914b3629-a634-4a7e-a238-0367d4f0b8a0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:15.750165 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-914b3629-a634-4a7e-a238-0367d4f0b8a0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:15.751446 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-914b3629-a634-4a7e-a238-0367d4f0b8a0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:15.930301 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-914b3629-a634-4a7e-a238-0367d4f0b8a0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:15.945087 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-914b3629-a634-4a7e-a238-0367d4f0b8a0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:15.949930 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-914b3629-a634-4a7e-a238-0367d4f0b8a0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:15.951611 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-914b3629-a634-4a7e-a238-0367d4f0b8a0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739" status: 200 len: 1372 microversion: 2.47 time: 0.233261 Sep 10 12:05:15.952822 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2611/5219] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:05:15 2022] GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739 => generated 1372 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:05:16.027965 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1800190c-9578-47e0-81ff-5eb401b1a2ff tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:16.028602 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1800190c-9578-47e0-81ff-5eb401b1a2ff tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:16.042183 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1800190c-9578-47e0-81ff-5eb401b1a2ff tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:16.043598 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1800190c-9578-47e0-81ff-5eb401b1a2ff tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:16.044418 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1800190c-9578-47e0-81ff-5eb401b1a2ff tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:16.050240 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1800190c-9578-47e0-81ff-5eb401b1a2ff tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:16.050797 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1800190c-9578-47e0-81ff-5eb401b1a2ff tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:16.051372 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1800190c-9578-47e0-81ff-5eb401b1a2ff tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:16.324158 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1800190c-9578-47e0-81ff-5eb401b1a2ff tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:16.332881 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1800190c-9578-47e0-81ff-5eb401b1a2ff tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1511 microversion: 2.1 time: 0.310686 Sep 10 12:05:16.333471 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2609/5220] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:16 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1511 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:16.750010 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f1fa6da6-79f0-4a89-8a53-47d709b8d77e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:16.750843 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f1fa6da6-79f0-4a89-8a53-47d709b8d77e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:16.764999 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f1fa6da6-79f0-4a89-8a53-47d709b8d77e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:16.765729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f1fa6da6-79f0-4a89-8a53-47d709b8d77e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:16.766346 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f1fa6da6-79f0-4a89-8a53-47d709b8d77e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:16.767229 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f1fa6da6-79f0-4a89-8a53-47d709b8d77e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:16.767898 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f1fa6da6-79f0-4a89-8a53-47d709b8d77e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:16.768524 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f1fa6da6-79f0-4a89-8a53-47d709b8d77e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:16.986162 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a19dfbd3-edd6-42ad-8ded-ec374a0195cd tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:16.986784 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a19dfbd3-edd6-42ad-8ded-ec374a0195cd tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:17.004399 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a19dfbd3-edd6-42ad-8ded-ec374a0195cd tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:17.006470 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a19dfbd3-edd6-42ad-8ded-ec374a0195cd tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:17.007957 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a19dfbd3-edd6-42ad-8ded-ec374a0195cd tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:17.009799 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a19dfbd3-edd6-42ad-8ded-ec374a0195cd tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:17.011182 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a19dfbd3-edd6-42ad-8ded-ec374a0195cd tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:17.011772 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a19dfbd3-edd6-42ad-8ded-ec374a0195cd tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:17.175260 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a19dfbd3-edd6-42ad-8ded-ec374a0195cd tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:17.189610 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a19dfbd3-edd6-42ad-8ded-ec374a0195cd tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:17.191974 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a19dfbd3-edd6-42ad-8ded-ec374a0195cd tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:17.193857 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a19dfbd3-edd6-42ad-8ded-ec374a0195cd tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739" status: 200 len: 1372 microversion: 2.47 time: 0.211542 Sep 10 12:05:17.195791 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2610/5221] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:05:16 2022] GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739 => generated 1372 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 12:05:17.263717 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f1fa6da6-79f0-4a89-8a53-47d709b8d77e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:17.274054 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f1fa6da6-79f0-4a89-8a53-47d709b8d77e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1513 microversion: 2.1 time: 0.527847 Sep 10 12:05:17.274660 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2612/5222] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:16 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1513 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:17.359954 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2e6fe67e-8eba-4ddb-aa0c-f244415d1689 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:17.360832 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2e6fe67e-8eba-4ddb-aa0c-f244415d1689 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:17.370917 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e6fe67e-8eba-4ddb-aa0c-f244415d1689 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:17.372107 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e6fe67e-8eba-4ddb-aa0c-f244415d1689 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:17.372650 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e6fe67e-8eba-4ddb-aa0c-f244415d1689 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:17.373565 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e6fe67e-8eba-4ddb-aa0c-f244415d1689 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:17.374486 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e6fe67e-8eba-4ddb-aa0c-f244415d1689 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:17.375352 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e6fe67e-8eba-4ddb-aa0c-f244415d1689 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:17.549035 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2e6fe67e-8eba-4ddb-aa0c-f244415d1689 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:17.559382 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2e6fe67e-8eba-4ddb-aa0c-f244415d1689 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1511 microversion: 2.1 time: 0.204402 Sep 10 12:05:17.560339 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2611/5223] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:17 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1511 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:18.223477 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cb86697c-f1ce-4ac4-8366-5c52b2d160c2 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:18.224165 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cb86697c-f1ce-4ac4-8366-5c52b2d160c2 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:18.234865 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb86697c-f1ce-4ac4-8366-5c52b2d160c2 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:18.235398 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb86697c-f1ce-4ac4-8366-5c52b2d160c2 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:18.235842 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb86697c-f1ce-4ac4-8366-5c52b2d160c2 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:18.236562 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb86697c-f1ce-4ac4-8366-5c52b2d160c2 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:18.239806 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb86697c-f1ce-4ac4-8366-5c52b2d160c2 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:18.242778 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb86697c-f1ce-4ac4-8366-5c52b2d160c2 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:18.297451 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ffdea137-ec42-4abc-a80f-49b6e6603908 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:18.298810 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ffdea137-ec42-4abc-a80f-49b6e6603908 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:18.306922 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ffdea137-ec42-4abc-a80f-49b6e6603908 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:18.307929 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ffdea137-ec42-4abc-a80f-49b6e6603908 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:18.308580 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ffdea137-ec42-4abc-a80f-49b6e6603908 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:18.309459 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ffdea137-ec42-4abc-a80f-49b6e6603908 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:18.310098 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ffdea137-ec42-4abc-a80f-49b6e6603908 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:18.310534 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ffdea137-ec42-4abc-a80f-49b6e6603908 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:18.333276 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:05:18.376590 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cb86697c-f1ce-4ac4-8366-5c52b2d160c2 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:18.379641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=100 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:05:18.389810 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cb86697c-f1ce-4ac4-8366-5c52b2d160c2 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:18.392813 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cb86697c-f1ce-4ac4-8366-5c52b2d160c2 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:18.394914 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cb86697c-f1ce-4ac4-8366-5c52b2d160c2 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739" status: 200 len: 1357 microversion: 2.47 time: 0.175012 Sep 10 12:05:18.396400 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2613/5224] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:05:18 2022] GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739 => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:05:18.425194 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2a6cb43a-b705-476c-a384-28c7a7105b36 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:18.433851 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2a6cb43a-b705-476c-a384-28c7a7105b36 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:18.435090 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2a6cb43a-b705-476c-a384-28c7a7105b36 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Searching by: {'deleted': False, 'project_id': '283b4509c8b1437fb934fee330e58364'} {{(pid=128777) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 12:05:18.444413 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a6cb43a-b705-476c-a384-28c7a7105b36 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:18.445169 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a6cb43a-b705-476c-a384-28c7a7105b36 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:18.445963 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a6cb43a-b705-476c-a384-28c7a7105b36 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:18.450691 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a6cb43a-b705-476c-a384-28c7a7105b36 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:18.453397 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a6cb43a-b705-476c-a384-28c7a7105b36 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:18.457185 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a6cb43a-b705-476c-a384-28c7a7105b36 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:18.536435 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ffdea137-ec42-4abc-a80f-49b6e6603908 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:18.549458 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ffdea137-ec42-4abc-a80f-49b6e6603908 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1513 microversion: 2.1 time: 0.255822 Sep 10 12:05:18.551204 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2612/5225] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:18 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1513 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:18.583875 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-965c26f7-6b15-4fb0-bc59-758196965706 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:18.584734 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-965c26f7-6b15-4fb0-bc59-758196965706 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:18.601811 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-965c26f7-6b15-4fb0-bc59-758196965706 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:18.602314 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-965c26f7-6b15-4fb0-bc59-758196965706 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:18.602755 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-965c26f7-6b15-4fb0-bc59-758196965706 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:18.606034 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.multi_cell_list [None req-2a6cb43a-b705-476c-a384-28c7a7105b36 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128777) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 12:05:18.606351 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-965c26f7-6b15-4fb0-bc59-758196965706 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:18.606827 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-965c26f7-6b15-4fb0-bc59-758196965706 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:18.607297 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-965c26f7-6b15-4fb0-bc59-758196965706 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:18.696721 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2a6cb43a-b705-476c-a384-28c7a7105b36 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:18.705182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a6cb43a-b705-476c-a384-28c7a7105b36 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:18.705897 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a6cb43a-b705-476c-a384-28c7a7105b36 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:18.706514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a6cb43a-b705-476c-a384-28c7a7105b36 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:18.719591 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2a6cb43a-b705-476c-a384-28c7a7105b36 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:18.721411 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2a6cb43a-b705-476c-a384-28c7a7105b36 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:18.777814 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2a6cb43a-b705-476c-a384-28c7a7105b36 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.356519 Sep 10 12:05:18.779989 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2614/5226] 10.222.0.23 () {60 vars in 1187 bytes} [Sat Sep 10 12:05:18 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 12:05:18.816799 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4bddff3a-f433-4237-8140-2077f4577a4f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:18.817663 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4bddff3a-f433-4237-8140-2077f4577a4f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:18.825166 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4bddff3a-f433-4237-8140-2077f4577a4f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:18.825969 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4bddff3a-f433-4237-8140-2077f4577a4f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:18.826793 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4bddff3a-f433-4237-8140-2077f4577a4f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:18.827796 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4bddff3a-f433-4237-8140-2077f4577a4f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:18.828474 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4bddff3a-f433-4237-8140-2077f4577a4f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:18.829093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4bddff3a-f433-4237-8140-2077f4577a4f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:18.849738 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-965c26f7-6b15-4fb0-bc59-758196965706 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:18.863192 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-965c26f7-6b15-4fb0-bc59-758196965706 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1511 microversion: 2.1 time: 0.285192 Sep 10 12:05:18.868699 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2613/5227] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:18 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1511 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:18.882660 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4bddff3a-f433-4237-8140-2077f4577a4f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:05:19.015836 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4bddff3a-f433-4237-8140-2077f4577a4f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739" status: 204 len: 0 microversion: 2.47 time: 0.203737 Sep 10 12:05:19.019989 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2615/5228] 10.222.0.23 () {60 vars in 1280 bytes} [Sat Sep 10 12:05:18 2022] DELETE /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 10 12:05:19.025281 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4210d865-c7da-4ca9-b7db-46f2d56d0986 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:19.026630 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4210d865-c7da-4ca9-b7db-46f2d56d0986 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:19.033124 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4210d865-c7da-4ca9-b7db-46f2d56d0986 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:19.033615 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4210d865-c7da-4ca9-b7db-46f2d56d0986 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:19.034203 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4210d865-c7da-4ca9-b7db-46f2d56d0986 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:19.035056 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4210d865-c7da-4ca9-b7db-46f2d56d0986 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:19.035693 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4210d865-c7da-4ca9-b7db-46f2d56d0986 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:19.036268 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4210d865-c7da-4ca9-b7db-46f2d56d0986 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:19.166906 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4210d865-c7da-4ca9-b7db-46f2d56d0986 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:19.181755 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4210d865-c7da-4ca9-b7db-46f2d56d0986 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:19.184777 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4210d865-c7da-4ca9-b7db-46f2d56d0986 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:19.186185 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4210d865-c7da-4ca9-b7db-46f2d56d0986 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739" status: 200 len: 1363 microversion: 2.47 time: 0.164952 Sep 10 12:05:19.187234 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2614/5229] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:05:19 2022] GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:05:19.576315 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2369c934-9efb-41ed-ab48-51e6db5cb00a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:19.577154 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2369c934-9efb-41ed-ab48-51e6db5cb00a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:19.591640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2369c934-9efb-41ed-ab48-51e6db5cb00a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:19.593825 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2369c934-9efb-41ed-ab48-51e6db5cb00a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:19.594922 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2369c934-9efb-41ed-ab48-51e6db5cb00a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:19.597117 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2369c934-9efb-41ed-ab48-51e6db5cb00a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:19.597674 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2369c934-9efb-41ed-ab48-51e6db5cb00a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:19.598285 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2369c934-9efb-41ed-ab48-51e6db5cb00a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:19.777904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2369c934-9efb-41ed-ab48-51e6db5cb00a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:19.798242 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2369c934-9efb-41ed-ab48-51e6db5cb00a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1513 microversion: 2.1 time: 0.219389 Sep 10 12:05:19.815193 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2616/5230] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:19 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1513 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:19.897250 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b7bc3791-3f81-485b-80ca-3a71ad1a3332 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:19.897974 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b7bc3791-3f81-485b-80ca-3a71ad1a3332 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:19.912750 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7bc3791-3f81-485b-80ca-3a71ad1a3332 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:19.913342 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7bc3791-3f81-485b-80ca-3a71ad1a3332 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:19.913854 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7bc3791-3f81-485b-80ca-3a71ad1a3332 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:19.914633 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7bc3791-3f81-485b-80ca-3a71ad1a3332 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:19.915178 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7bc3791-3f81-485b-80ca-3a71ad1a3332 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:19.917771 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7bc3791-3f81-485b-80ca-3a71ad1a3332 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:20.150037 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b7bc3791-3f81-485b-80ca-3a71ad1a3332 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:20.161295 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b7bc3791-3f81-485b-80ca-3a71ad1a3332 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1511 microversion: 2.1 time: 0.267883 Sep 10 12:05:20.163329 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2615/5231] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:19 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1511 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:20.214607 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7e79d86a-27ad-446a-b8e7-b868d4f5395a tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:20.215386 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7e79d86a-27ad-446a-b8e7-b868d4f5395a tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:20.225431 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e79d86a-27ad-446a-b8e7-b868d4f5395a tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:20.225931 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e79d86a-27ad-446a-b8e7-b868d4f5395a tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:20.226377 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e79d86a-27ad-446a-b8e7-b868d4f5395a tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:20.227092 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e79d86a-27ad-446a-b8e7-b868d4f5395a tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:20.227593 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e79d86a-27ad-446a-b8e7-b868d4f5395a tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:20.228023 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e79d86a-27ad-446a-b8e7-b868d4f5395a tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:20.366631 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7e79d86a-27ad-446a-b8e7-b868d4f5395a tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:20.376867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7e79d86a-27ad-446a-b8e7-b868d4f5395a tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:20.378361 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7e79d86a-27ad-446a-b8e7-b868d4f5395a tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:20.379676 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7e79d86a-27ad-446a-b8e7-b868d4f5395a tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739" status: 200 len: 1363 microversion: 2.47 time: 0.169265 Sep 10 12:05:20.380568 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2617/5232] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:05:20 2022] GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:05:20.827520 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-acb59a34-fce4-4b88-9d61-9bafff22ee65 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:20.828561 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-acb59a34-fce4-4b88-9d61-9bafff22ee65 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:20.835180 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-acb59a34-fce4-4b88-9d61-9bafff22ee65 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:20.835753 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-acb59a34-fce4-4b88-9d61-9bafff22ee65 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:20.836556 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-acb59a34-fce4-4b88-9d61-9bafff22ee65 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:20.837461 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-acb59a34-fce4-4b88-9d61-9bafff22ee65 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:20.838016 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-acb59a34-fce4-4b88-9d61-9bafff22ee65 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:20.838775 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-acb59a34-fce4-4b88-9d61-9bafff22ee65 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:21.024325 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-acb59a34-fce4-4b88-9d61-9bafff22ee65 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:21.034422 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-acb59a34-fce4-4b88-9d61-9bafff22ee65 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1513 microversion: 2.1 time: 0.212007 Sep 10 12:05:21.035631 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2616/5233] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:20 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1513 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:21.186734 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-806bc871-39b0-46e5-9567-5f01bee85a56 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:21.187501 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-806bc871-39b0-46e5-9567-5f01bee85a56 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:21.196437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-806bc871-39b0-46e5-9567-5f01bee85a56 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:21.197137 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-806bc871-39b0-46e5-9567-5f01bee85a56 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:21.197580 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-806bc871-39b0-46e5-9567-5f01bee85a56 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:21.198840 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-806bc871-39b0-46e5-9567-5f01bee85a56 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:21.199330 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-806bc871-39b0-46e5-9567-5f01bee85a56 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:21.209932 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-806bc871-39b0-46e5-9567-5f01bee85a56 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:21.410775 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6f15f41b-531b-4aa1-a9f0-3299c5f148e5 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:21.411482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6f15f41b-531b-4aa1-a9f0-3299c5f148e5 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 1ce6592d-8005-40eb-a05d-273d3dcc4739] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:21.437896 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f15f41b-531b-4aa1-a9f0-3299c5f148e5 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:21.438407 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f15f41b-531b-4aa1-a9f0-3299c5f148e5 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:21.438851 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f15f41b-531b-4aa1-a9f0-3299c5f148e5 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:21.439608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f15f41b-531b-4aa1-a9f0-3299c5f148e5 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:21.450885 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f15f41b-531b-4aa1-a9f0-3299c5f148e5 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:21.451372 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f15f41b-531b-4aa1-a9f0-3299c5f148e5 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:21.471438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-806bc871-39b0-46e5-9567-5f01bee85a56 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:21.491082 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-806bc871-39b0-46e5-9567-5f01bee85a56 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1511 microversion: 2.1 time: 0.308116 Sep 10 12:05:21.493842 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2618/5234] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:21 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1511 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:21.501490 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-6f15f41b-531b-4aa1-a9f0-3299c5f148e5 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] HTTP exception thrown: Instance 1ce6592d-8005-40eb-a05d-273d3dcc4739 could not be found. Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6f15f41b-531b-4aa1-a9f0-3299c5f148e5 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Request method failure captured: Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739 HTTP/1.1 Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH1QTQK6bRDmC_OHWScZQQEeepaSOUfMLy3XQBaEGB66PO4q55whd6XzOHH_OyxZzZSKXzwGMZZJ0SmSw37vvFdOSMqXUsgps9SRdjZx-Wgc4Cy0MIeD7qN7ILYnFfc2uG2XMKXLWYRvUbQDy-UAa2meFtb97OYryyh9efinIrYESJo Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: X-Openstack-Nova-Api-Version: 2.47 Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 283b4509c8b1437fb934fee330e58364 Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServerShowV247Test-1318460385 Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/283b4509c8b1437fb934fee330e58364"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/283b4509c8b1437fb934fee330e58364"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_283b4509c8b1437fb934fee330e58364", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/283b4509c8b1437fb934fee330e58364"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServerShowV247Test-1318460385 Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 283b4509c8b1437fb934fee330e58364 Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServerShowV247Test-1318460385 Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServerShowV247Test-1318460385-project Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 908efd576c014da99c327cff818aa9d1 Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServerShowV247Test-1318460385-project Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 1ce6592d-8005-40eb-a05d-273d3dcc4739 could not be found. Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '1ce6592d-8005-40eb-a05d-273d3dcc4739'} Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ce6592d-8005-40eb-a05d-273d3dcc4739 could not be found. Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ce6592d-8005-40eb-a05d-273d3dcc4739 could not be found. Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:21.511512 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:21.515300 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:21.515300 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:21.515300 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:21.515300 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:05:21.515300 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:05:21.515300 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ce6592d-8005-40eb-a05d-273d3dcc4739 could not be found. Sep 10 12:05:21.515300 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:21.518320 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6f15f41b-531b-4aa1-a9f0-3299c5f148e5 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Returning 404 to user: Instance 1ce6592d-8005-40eb-a05d-273d3dcc4739 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:05:21.519844 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6f15f41b-531b-4aa1-a9f0-3299c5f148e5 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739" status: 404 len: 111 microversion: 2.47 time: 0.113462 Sep 10 12:05:21.521653 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2617/5235] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:05:21 2022] GET /compute/v2.1/servers/1ce6592d-8005-40eb-a05d-273d3dcc4739 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 12:05:21.532226 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c25e66b7-e463-406b-9021-fd435bb0e7a3 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:21.532825 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c25e66b7-e463-406b-9021-fd435bb0e7a3 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 8a925e1e-383f-4039-ab9b-49ef63acf268] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:21.541271 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c25e66b7-e463-406b-9021-fd435bb0e7a3 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:21.542088 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c25e66b7-e463-406b-9021-fd435bb0e7a3 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:21.542542 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c25e66b7-e463-406b-9021-fd435bb0e7a3 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:21.543448 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c25e66b7-e463-406b-9021-fd435bb0e7a3 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:21.544003 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c25e66b7-e463-406b-9021-fd435bb0e7a3 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:21.544520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c25e66b7-e463-406b-9021-fd435bb0e7a3 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:21.583789 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c25e66b7-e463-406b-9021-fd435bb0e7a3 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 8a925e1e-383f-4039-ab9b-49ef63acf268] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:05:21.750552 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c25e66b7-e463-406b-9021-fd435bb0e7a3 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8a925e1e-383f-4039-ab9b-49ef63acf268" status: 204 len: 0 microversion: 2.47 time: 0.223904 Sep 10 12:05:21.751403 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2619/5236] 10.222.0.23 () {60 vars in 1280 bytes} [Sat Sep 10 12:05:21 2022] DELETE /compute/v2.1/servers/8a925e1e-383f-4039-ab9b-49ef63acf268 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 12:05:21.761162 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-60a84a43-f29a-42f6-bb7f-04acc0ccaf7f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:21.762081 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-60a84a43-f29a-42f6-bb7f-04acc0ccaf7f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 8a925e1e-383f-4039-ab9b-49ef63acf268] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:21.781948 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60a84a43-f29a-42f6-bb7f-04acc0ccaf7f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:21.782644 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60a84a43-f29a-42f6-bb7f-04acc0ccaf7f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:21.783317 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60a84a43-f29a-42f6-bb7f-04acc0ccaf7f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:21.784304 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60a84a43-f29a-42f6-bb7f-04acc0ccaf7f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:21.784837 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60a84a43-f29a-42f6-bb7f-04acc0ccaf7f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:21.785398 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60a84a43-f29a-42f6-bb7f-04acc0ccaf7f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:21.959887 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-60a84a43-f29a-42f6-bb7f-04acc0ccaf7f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:21.973402 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-60a84a43-f29a-42f6-bb7f-04acc0ccaf7f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:21.982443 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-60a84a43-f29a-42f6-bb7f-04acc0ccaf7f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:21.985429 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-60a84a43-f29a-42f6-bb7f-04acc0ccaf7f tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/8a925e1e-383f-4039-ab9b-49ef63acf268" status: 200 len: 1363 microversion: 2.47 time: 0.229661 Sep 10 12:05:21.989408 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2618/5237] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:05:21 2022] GET /compute/v2.1/servers/8a925e1e-383f-4039-ab9b-49ef63acf268 => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:05:22.063364 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-132c12e5-7924-4cfd-8fb4-9c80aa493327 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:22.064925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-132c12e5-7924-4cfd-8fb4-9c80aa493327 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:22.089881 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-132c12e5-7924-4cfd-8fb4-9c80aa493327 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:22.091509 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-132c12e5-7924-4cfd-8fb4-9c80aa493327 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:22.092239 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-132c12e5-7924-4cfd-8fb4-9c80aa493327 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:22.093752 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-132c12e5-7924-4cfd-8fb4-9c80aa493327 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:22.094748 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-132c12e5-7924-4cfd-8fb4-9c80aa493327 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:22.095475 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-132c12e5-7924-4cfd-8fb4-9c80aa493327 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:22.517482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7352b410-c4d1-4d4b-ad1e-a3e47a0aaf29 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:22.518128 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7352b410-c4d1-4d4b-ad1e-a3e47a0aaf29 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:22.535631 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7352b410-c4d1-4d4b-ad1e-a3e47a0aaf29 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:22.536132 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7352b410-c4d1-4d4b-ad1e-a3e47a0aaf29 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:22.536568 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7352b410-c4d1-4d4b-ad1e-a3e47a0aaf29 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:22.537281 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7352b410-c4d1-4d4b-ad1e-a3e47a0aaf29 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:22.537734 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7352b410-c4d1-4d4b-ad1e-a3e47a0aaf29 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:22.538160 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7352b410-c4d1-4d4b-ad1e-a3e47a0aaf29 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:22.565397 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-132c12e5-7924-4cfd-8fb4-9c80aa493327 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:22.577066 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-132c12e5-7924-4cfd-8fb4-9c80aa493327 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1534 microversion: 2.1 time: 0.519933 Sep 10 12:05:22.591880 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2620/5238] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:22 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1534 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:22.733348 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7352b410-c4d1-4d4b-ad1e-a3e47a0aaf29 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:22.742944 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7352b410-c4d1-4d4b-ad1e-a3e47a0aaf29 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1488 microversion: 2.1 time: 0.229245 Sep 10 12:05:22.743977 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2619/5239] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:22 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1488 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:05:22.766775 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ef484bb2-c54f-45a0-9ee8-616591652d4c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-307789640"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:05:22.769478 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ef484bb2-c54f-45a0-9ee8-616591652d4c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:22.776335 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ef484bb2-c54f-45a0-9ee8-616591652d4c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:22.777127 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ef484bb2-c54f-45a0-9ee8-616591652d4c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:22.777747 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ef484bb2-c54f-45a0-9ee8-616591652d4c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:22.778635 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ef484bb2-c54f-45a0-9ee8-616591652d4c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:22.779286 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ef484bb2-c54f-45a0-9ee8-616591652d4c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:22.779864 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ef484bb2-c54f-45a0-9ee8-616591652d4c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:22.880429 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ef484bb2-c54f-45a0-9ee8-616591652d4c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "PUT /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1061 microversion: 2.1 time: 0.117342 Sep 10 12:05:22.898831 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2621/5240] 10.222.0.23 () {60 vars in 1256 bytes} [Sat Sep 10 12:05:22 2022] PUT /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1061 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:22.900600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d66c7244-1def-4ddd-b2c4-ffd13dc0d6d6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:22.901955 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d66c7244-1def-4ddd-b2c4-ffd13dc0d6d6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:22.909705 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d66c7244-1def-4ddd-b2c4-ffd13dc0d6d6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:22.910225 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d66c7244-1def-4ddd-b2c4-ffd13dc0d6d6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:22.910656 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d66c7244-1def-4ddd-b2c4-ffd13dc0d6d6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:22.911688 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d66c7244-1def-4ddd-b2c4-ffd13dc0d6d6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:22.912118 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d66c7244-1def-4ddd-b2c4-ffd13dc0d6d6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:22.912537 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d66c7244-1def-4ddd-b2c4-ffd13dc0d6d6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:23.018403 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b065f8c9-77ef-4994-9e24-638821ba82d3 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:23.019215 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b065f8c9-77ef-4994-9e24-638821ba82d3 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 8a925e1e-383f-4039-ab9b-49ef63acf268] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:23.032158 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b065f8c9-77ef-4994-9e24-638821ba82d3 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:23.032962 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b065f8c9-77ef-4994-9e24-638821ba82d3 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:23.033704 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b065f8c9-77ef-4994-9e24-638821ba82d3 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:23.034617 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b065f8c9-77ef-4994-9e24-638821ba82d3 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:23.038775 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b065f8c9-77ef-4994-9e24-638821ba82d3 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:23.039639 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b065f8c9-77ef-4994-9e24-638821ba82d3 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:23.211134 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b065f8c9-77ef-4994-9e24-638821ba82d3 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:23.223684 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b065f8c9-77ef-4994-9e24-638821ba82d3 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:23.228554 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b065f8c9-77ef-4994-9e24-638821ba82d3 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:23.229545 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d66c7244-1def-4ddd-b2c4-ffd13dc0d6d6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:23.231495 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b065f8c9-77ef-4994-9e24-638821ba82d3 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/8a925e1e-383f-4039-ab9b-49ef63acf268" status: 200 len: 1363 microversion: 2.47 time: 0.216965 Sep 10 12:05:23.233087 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2622/5241] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:05:23 2022] GET /compute/v2.1/servers/8a925e1e-383f-4039-ab9b-49ef63acf268 => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 12:05:23.240934 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d66c7244-1def-4ddd-b2c4-ffd13dc0d6d6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1488 microversion: 2.1 time: 0.344322 Sep 10 12:05:23.262227 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2620/5242] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:22 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1488 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:05:23.269715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-49b12499-429b-4e6b-9f80-e0aec12e0cd6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:23.270614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-49b12499-429b-4e6b-9f80-e0aec12e0cd6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:23.277970 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-49b12499-429b-4e6b-9f80-e0aec12e0cd6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:23.278513 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-49b12499-429b-4e6b-9f80-e0aec12e0cd6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:23.278952 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-49b12499-429b-4e6b-9f80-e0aec12e0cd6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:23.279832 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-49b12499-429b-4e6b-9f80-e0aec12e0cd6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:23.280435 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-49b12499-429b-4e6b-9f80-e0aec12e0cd6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:23.280872 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-49b12499-429b-4e6b-9f80-e0aec12e0cd6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:23.502855 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-49b12499-429b-4e6b-9f80-e0aec12e0cd6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:23.512042 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-49b12499-429b-4e6b-9f80-e0aec12e0cd6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1488 microversion: 2.1 time: 0.246696 Sep 10 12:05:23.512869 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2623/5243] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:23 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1488 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:23.536747 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c55ecc29-2305-45fc-8253-ed74af4f6323 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:23.537301 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c55ecc29-2305-45fc-8253-ed74af4f6323 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:23.545078 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c55ecc29-2305-45fc-8253-ed74af4f6323 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:23.545835 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c55ecc29-2305-45fc-8253-ed74af4f6323 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:23.546456 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c55ecc29-2305-45fc-8253-ed74af4f6323 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:23.547397 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c55ecc29-2305-45fc-8253-ed74af4f6323 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:23.548055 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c55ecc29-2305-45fc-8253-ed74af4f6323 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:23.548684 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c55ecc29-2305-45fc-8253-ed74af4f6323 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:23.579100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c55ecc29-2305-45fc-8253-ed74af4f6323 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:05:23.604948 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1e44d65f-a302-454e-9bc7-b058b9fa7a6e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:23.606210 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1e44d65f-a302-454e-9bc7-b058b9fa7a6e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:23.621195 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1e44d65f-a302-454e-9bc7-b058b9fa7a6e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:23.621995 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1e44d65f-a302-454e-9bc7-b058b9fa7a6e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:23.622640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1e44d65f-a302-454e-9bc7-b058b9fa7a6e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:23.623639 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1e44d65f-a302-454e-9bc7-b058b9fa7a6e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:23.624286 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1e44d65f-a302-454e-9bc7-b058b9fa7a6e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:23.626530 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1e44d65f-a302-454e-9bc7-b058b9fa7a6e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:23.734319 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:05:23.748368 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c55ecc29-2305-45fc-8253-ed74af4f6323 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 204 len: 0 microversion: 2.1 time: 0.217064 Sep 10 12:05:23.750481 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2621/5244] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:05:23 2022] DELETE /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 12:05:23.771342 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-47f88db4-5f09-4885-9a36-b0ce7ed21a99 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:23.776564 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-47f88db4-5f09-4885-9a36-b0ce7ed21a99 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:23.815845 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-47f88db4-5f09-4885-9a36-b0ce7ed21a99 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:23.821299 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-47f88db4-5f09-4885-9a36-b0ce7ed21a99 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:23.826025 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-47f88db4-5f09-4885-9a36-b0ce7ed21a99 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:23.835936 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-47f88db4-5f09-4885-9a36-b0ce7ed21a99 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:23.836773 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-47f88db4-5f09-4885-9a36-b0ce7ed21a99 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:23.858202 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-47f88db4-5f09-4885-9a36-b0ce7ed21a99 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:24.041266 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1e44d65f-a302-454e-9bc7-b058b9fa7a6e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:24.068059 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1e44d65f-a302-454e-9bc7-b058b9fa7a6e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1534 microversion: 2.1 time: 0.467963 Sep 10 12:05:24.094269 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2624/5245] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:23 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1534 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:24.205733 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-47f88db4-5f09-4885-9a36-b0ce7ed21a99 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:24.249188 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-47f88db4-5f09-4885-9a36-b0ce7ed21a99 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1494 microversion: 2.1 time: 0.493138 Sep 10 12:05:24.250381 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2622/5246] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:23 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1494 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:24.270594 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b0c737af-d60d-41cb-9073-d14653bc0fe0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:24.272526 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b0c737af-d60d-41cb-9073-d14653bc0fe0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 8a925e1e-383f-4039-ab9b-49ef63acf268] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:24.290624 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0c737af-d60d-41cb-9073-d14653bc0fe0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:24.293056 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0c737af-d60d-41cb-9073-d14653bc0fe0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:24.293778 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0c737af-d60d-41cb-9073-d14653bc0fe0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:24.294382 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0c737af-d60d-41cb-9073-d14653bc0fe0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:24.294842 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0c737af-d60d-41cb-9073-d14653bc0fe0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:24.295392 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0c737af-d60d-41cb-9073-d14653bc0fe0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:24.356784 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0c737af-d60d-41cb-9073-d14653bc0fe0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:24.357181 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0c737af-d60d-41cb-9073-d14653bc0fe0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:24.357638 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0c737af-d60d-41cb-9073-d14653bc0fe0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:24.358232 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-b0c737af-d60d-41cb-9073-d14653bc0fe0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lazy-loading 'fault' on Instance uuid 8a925e1e-383f-4039-ab9b-49ef63acf268 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:05:24.361502 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:05:24.412064 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b0c737af-d60d-41cb-9073-d14653bc0fe0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:24.422303 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b0c737af-d60d-41cb-9073-d14653bc0fe0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:24.423824 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b0c737af-d60d-41cb-9073-d14653bc0fe0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '908efd576c014da99c327cff818aa9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283b4509c8b1437fb934fee330e58364', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:24.425019 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b0c737af-d60d-41cb-9073-d14653bc0fe0 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/8a925e1e-383f-4039-ab9b-49ef63acf268" status: 200 len: 1368 microversion: 2.47 time: 0.162266 Sep 10 12:05:24.425593 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2625/5247] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:05:24 2022] GET /compute/v2.1/servers/8a925e1e-383f-4039-ab9b-49ef63acf268 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:05:25.097875 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8b3a121e-23a5-4288-9bdf-c61c8f0c2261 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:25.098556 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8b3a121e-23a5-4288-9bdf-c61c8f0c2261 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:25.106122 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8b3a121e-23a5-4288-9bdf-c61c8f0c2261 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:25.106982 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8b3a121e-23a5-4288-9bdf-c61c8f0c2261 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:25.107664 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8b3a121e-23a5-4288-9bdf-c61c8f0c2261 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:25.108619 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8b3a121e-23a5-4288-9bdf-c61c8f0c2261 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:25.109301 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8b3a121e-23a5-4288-9bdf-c61c8f0c2261 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:25.109937 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8b3a121e-23a5-4288-9bdf-c61c8f0c2261 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:25.273358 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8522c45d-52b1-45f3-abdd-3e67473f444f tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:25.273915 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8522c45d-52b1-45f3-abdd-3e67473f444f tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:25.287879 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8522c45d-52b1-45f3-abdd-3e67473f444f tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:25.292134 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8522c45d-52b1-45f3-abdd-3e67473f444f tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:25.293264 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8522c45d-52b1-45f3-abdd-3e67473f444f tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:25.294515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8522c45d-52b1-45f3-abdd-3e67473f444f tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:25.295355 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8522c45d-52b1-45f3-abdd-3e67473f444f tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:25.296325 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8522c45d-52b1-45f3-abdd-3e67473f444f tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:25.546588 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8b3a121e-23a5-4288-9bdf-c61c8f0c2261 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:25.566761 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8b3a121e-23a5-4288-9bdf-c61c8f0c2261 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1534 microversion: 2.1 time: 0.471535 Sep 10 12:05:25.568018 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2623/5248] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:25 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1534 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:25.574314 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-8748485e-a2d2-4fe2-ad25-56d69b95322c req-f970dfbf-ae50-44e2-a40c-a1b3450cc799 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac1538e5-6edc-4ccb-b7a9-c2e90284e004", "name": "network-vif-plugged", "status": "completed", "tag": "264e21dc-6813-4623-838f-df7e536eeb78"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:05:25.603789 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-8748485e-a2d2-4fe2-ad25-56d69b95322c req-f970dfbf-ae50-44e2-a40c-a1b3450cc799 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:25.604173 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-8748485e-a2d2-4fe2-ad25-56d69b95322c req-f970dfbf-ae50-44e2-a40c-a1b3450cc799 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:25.604532 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-8748485e-a2d2-4fe2-ad25-56d69b95322c req-f970dfbf-ae50-44e2-a40c-a1b3450cc799 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:25.639924 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-8748485e-a2d2-4fe2-ad25-56d69b95322c req-f970dfbf-ae50-44e2-a40c-a1b3450cc799 service nova] Creating event network-vif-plugged:264e21dc-6813-4623-838f-df7e536eeb78 for instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 on n-h1-856895-1 Sep 10 12:05:25.657061 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-8748485e-a2d2-4fe2-ad25-56d69b95322c req-f970dfbf-ae50-44e2-a40c-a1b3450cc799 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085478 Sep 10 12:05:25.660548 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2624/5249] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:05:25.675379 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-75487c59-8422-43d7-a9bc-544fc1e30ac6 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:25.675710 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-75487c59-8422-43d7-a9bc-544fc1e30ac6 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] [instance: 8a925e1e-383f-4039-ab9b-49ef63acf268] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:25.694201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75487c59-8422-43d7-a9bc-544fc1e30ac6 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:25.695507 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75487c59-8422-43d7-a9bc-544fc1e30ac6 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:25.695971 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75487c59-8422-43d7-a9bc-544fc1e30ac6 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:25.696718 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75487c59-8422-43d7-a9bc-544fc1e30ac6 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:25.697187 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75487c59-8422-43d7-a9bc-544fc1e30ac6 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:25.703018 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75487c59-8422-43d7-a9bc-544fc1e30ac6 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:25.734223 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8522c45d-52b1-45f3-abdd-3e67473f444f tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:25.748181 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8522c45d-52b1-45f3-abdd-3e67473f444f tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1494 microversion: 2.1 time: 0.478823 Sep 10 12:05:25.749206 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2626/5250] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:25 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1494 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:25.754856 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-75487c59-8422-43d7-a9bc-544fc1e30ac6 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] HTTP exception thrown: Instance 8a925e1e-383f-4039-ab9b-49ef63acf268 could not be found. Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-75487c59-8422-43d7-a9bc-544fc1e30ac6 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Request method failure captured: Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/8a925e1e-383f-4039-ab9b-49ef63acf268 HTTP/1.1 Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH1QTQK6bRDmC_OHWScZQQEeepaSOUfMLy3XQBaEGB66PO4q55whd6XzOHH_OyxZzZSKXzwGMZZJ0SmSw37vvFdOSMqXUsgps9SRdjZx-Wgc4Cy0MIeD7qN7ILYnFfc2uG2XMKXLWYRvUbQDy-UAa2meFtb97OYryyh9efinIrYESJo Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: X-Openstack-Nova-Api-Version: 2.47 Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 283b4509c8b1437fb934fee330e58364 Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServerShowV247Test-1318460385 Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/283b4509c8b1437fb934fee330e58364"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/283b4509c8b1437fb934fee330e58364"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_283b4509c8b1437fb934fee330e58364", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/283b4509c8b1437fb934fee330e58364"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServerShowV247Test-1318460385 Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 283b4509c8b1437fb934fee330e58364 Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServerShowV247Test-1318460385 Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServerShowV247Test-1318460385-project Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 908efd576c014da99c327cff818aa9d1 Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServerShowV247Test-1318460385-project Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 8a925e1e-383f-4039-ab9b-49ef63acf268 could not be found. Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '8a925e1e-383f-4039-ab9b-49ef63acf268'} Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a925e1e-383f-4039-ab9b-49ef63acf268 could not be found. Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a925e1e-383f-4039-ab9b-49ef63acf268 could not be found. Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:25.756650 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:25.760276 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:25.760276 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:25.760276 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:25.760276 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:05:25.760276 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:05:25.760276 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a925e1e-383f-4039-ab9b-49ef63acf268 could not be found. Sep 10 12:05:25.760276 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:25.765988 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-75487c59-8422-43d7-a9bc-544fc1e30ac6 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] Returning 404 to user: Instance 8a925e1e-383f-4039-ab9b-49ef63acf268 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:05:25.767882 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-75487c59-8422-43d7-a9bc-544fc1e30ac6 tempest-ServerShowV247Test-1318460385 tempest-ServerShowV247Test-1318460385-project] 10.222.0.23 "GET /compute/v2.1/servers/8a925e1e-383f-4039-ab9b-49ef63acf268" status: 404 len: 111 microversion: 2.47 time: 0.105049 Sep 10 12:05:25.770282 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2625/5251] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:05:25 2022] GET /compute/v2.1/servers/8a925e1e-383f-4039-ab9b-49ef63acf268 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 12:05:26.596806 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d831e46a-ff30-4e43-9624-3235e099c002 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:26.597587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d831e46a-ff30-4e43-9624-3235e099c002 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:26.603887 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-55964cb4-40f1-4218-9ac2-ffc1f36f157c req-4963d489-8809-4dea-84b1-d0b5d0e7edc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2da647c-6fe1-4674-9b1f-7f54bd2d3b15", "name": "network-vif-deleted", "tag": "aaea91dd-f8c4-4f10-b87a-80388d1b174f"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:05:26.615832 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d831e46a-ff30-4e43-9624-3235e099c002 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:26.617017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d831e46a-ff30-4e43-9624-3235e099c002 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:26.617474 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d831e46a-ff30-4e43-9624-3235e099c002 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:26.623637 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d831e46a-ff30-4e43-9624-3235e099c002 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:26.624145 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d831e46a-ff30-4e43-9624-3235e099c002 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:26.624592 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d831e46a-ff30-4e43-9624-3235e099c002 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:26.630139 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-55964cb4-40f1-4218-9ac2-ffc1f36f157c req-4963d489-8809-4dea-84b1-d0b5d0e7edc5 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:26.645097 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-55964cb4-40f1-4218-9ac2-ffc1f36f157c req-4963d489-8809-4dea-84b1-d0b5d0e7edc5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:26.645710 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-55964cb4-40f1-4218-9ac2-ffc1f36f157c req-4963d489-8809-4dea-84b1-d0b5d0e7edc5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:26.680307 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-55964cb4-40f1-4218-9ac2-ffc1f36f157c req-4963d489-8809-4dea-84b1-d0b5d0e7edc5 service nova] Creating event network-vif-deleted:aaea91dd-f8c4-4f10-b87a-80388d1b174f for instance f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 on n-h1-856895-1 Sep 10 12:05:26.695697 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-55964cb4-40f1-4218-9ac2-ffc1f36f157c req-4963d489-8809-4dea-84b1-d0b5d0e7edc5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095335 Sep 10 12:05:26.703227 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2626/5252] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:05:26.777379 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cad343d6-8854-4f9c-9218-14fd7ab82080 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:26.778100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cad343d6-8854-4f9c-9218-14fd7ab82080 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:26.797419 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cad343d6-8854-4f9c-9218-14fd7ab82080 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:26.797926 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cad343d6-8854-4f9c-9218-14fd7ab82080 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:26.798363 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cad343d6-8854-4f9c-9218-14fd7ab82080 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:26.807657 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cad343d6-8854-4f9c-9218-14fd7ab82080 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:26.808288 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cad343d6-8854-4f9c-9218-14fd7ab82080 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:26.808928 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cad343d6-8854-4f9c-9218-14fd7ab82080 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:26.892976 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cad343d6-8854-4f9c-9218-14fd7ab82080 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:26.893488 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cad343d6-8854-4f9c-9218-14fd7ab82080 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:26.894868 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cad343d6-8854-4f9c-9218-14fd7ab82080 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:26.902785 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-cad343d6-8854-4f9c-9218-14fd7ab82080 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lazy-loading 'fault' on Instance uuid f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:05:27.003349 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d831e46a-ff30-4e43-9624-3235e099c002 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:27.016748 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d831e46a-ff30-4e43-9624-3235e099c002 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1529 microversion: 2.1 time: 0.426190 Sep 10 12:05:27.024055 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2627/5253] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:26 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1529 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:27.141294 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-cad343d6-8854-4f9c-9218-14fd7ab82080 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:27.151800 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cad343d6-8854-4f9c-9218-14fd7ab82080 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 200 len: 1309 microversion: 2.1 time: 0.378117 Sep 10 12:05:27.155108 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2627/5254] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:26 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 1309 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:05:28.045255 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8275070e-8ffe-4729-9817-0b7af78e2435 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:28.045892 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8275070e-8ffe-4729-9817-0b7af78e2435 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:28.066480 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8275070e-8ffe-4729-9817-0b7af78e2435 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:28.067330 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8275070e-8ffe-4729-9817-0b7af78e2435 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:28.067928 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8275070e-8ffe-4729-9817-0b7af78e2435 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:28.070385 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8275070e-8ffe-4729-9817-0b7af78e2435 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:28.072047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8275070e-8ffe-4729-9817-0b7af78e2435 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:28.073992 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8275070e-8ffe-4729-9817-0b7af78e2435 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:28.183021 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-926ec104-e6bc-4034-b398-ba6640b9dc32 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:28.183934 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-926ec104-e6bc-4034-b398-ba6640b9dc32 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:28.197544 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-926ec104-e6bc-4034-b398-ba6640b9dc32 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:28.198790 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-926ec104-e6bc-4034-b398-ba6640b9dc32 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:28.199295 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-926ec104-e6bc-4034-b398-ba6640b9dc32 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:28.200012 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-926ec104-e6bc-4034-b398-ba6640b9dc32 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:28.200473 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-926ec104-e6bc-4034-b398-ba6640b9dc32 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:28.200901 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-926ec104-e6bc-4034-b398-ba6640b9dc32 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:28.255533 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-926ec104-e6bc-4034-b398-ba6640b9dc32 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] HTTP exception thrown: Instance f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 could not be found. Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-926ec104-e6bc-4034-b398-ba6640b9dc32 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Request method failure captured: Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 HTTP/1.1 Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHykcWQYupGxhcLpb6v5AsrUV8qZ6sg9Ki1Jfb5jCMoRjGicsw0WManJo8IjBppMD5CxQdT4hQu3IHHi54G_V7lvb8EgCj19qVHNlr3p45qCyo-pmA_bA7FrmqWJZSaCbHLCvlYvItyJikej-C_PUFDVoe9D_fp0roxy7XQj-_YcxQA Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersTestJSON-793172710 Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ac8b3e9f72234d9985fbc5fa7e7984ad", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersTestJSON-793172710 Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersTestJSON-793172710 Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersTestJSON-793172710-project Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: ef32131362a3442498234c0554f08305 Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersTestJSON-793172710-project Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 could not be found. Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'f2da647c-6fe1-4674-9b1f-7f54bd2d3b15'} Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 could not be found. Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 could not be found. Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.260592 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:28.265906 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:28.265906 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:28.265906 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:05:28.265906 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:05:28.265906 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 could not be found. Sep 10 12:05:28.265906 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.265906 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-926ec104-e6bc-4034-b398-ba6640b9dc32 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Returning 404 to user: Instance f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:05:28.265906 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-926ec104-e6bc-4034-b398-ba6640b9dc32 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 404 len: 111 microversion: 2.1 time: 0.084993 Sep 10 12:05:28.265906 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2628/5255] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:28 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:05:28.282945 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cb46f16e-8f5b-4c60-b8ad-830393e35032 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:28.289287 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cb46f16e-8f5b-4c60-b8ad-830393e35032 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:28.314413 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb46f16e-8f5b-4c60-b8ad-830393e35032 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:28.317353 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb46f16e-8f5b-4c60-b8ad-830393e35032 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:28.317784 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb46f16e-8f5b-4c60-b8ad-830393e35032 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:28.318532 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb46f16e-8f5b-4c60-b8ad-830393e35032 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:28.318996 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb46f16e-8f5b-4c60-b8ad-830393e35032 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:28.319461 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb46f16e-8f5b-4c60-b8ad-830393e35032 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:28.354509 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-cb46f16e-8f5b-4c60-b8ad-830393e35032 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] HTTP exception thrown: Instance f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 could not be found. Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cb46f16e-8f5b-4c60-b8ad-830393e35032 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Request method failure captured: Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 HTTP/1.1 Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHykcWQYupGxhcLpb6v5AsrUV8qZ6sg9Ki1Jfb5jCMoRjGicsw0WManJo8IjBppMD5CxQdT4hQu3IHHi54G_V7lvb8EgCj19qVHNlr3p45qCyo-pmA_bA7FrmqWJZSaCbHLCvlYvItyJikej-C_PUFDVoe9D_fp0roxy7XQj-_YcxQA Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersTestJSON-793172710 Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ac8b3e9f72234d9985fbc5fa7e7984ad", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersTestJSON-793172710 Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersTestJSON-793172710 Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersTestJSON-793172710-project Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: ef32131362a3442498234c0554f08305 Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersTestJSON-793172710-project Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 could not be found. Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'f2da647c-6fe1-4674-9b1f-7f54bd2d3b15'} Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 could not be found. Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:05:28.363943 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 could not be found. Sep 10 12:05:28.368050 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.368050 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:28.368050 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.368050 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:28.368050 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:28.368050 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:28.368050 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:05:28.368050 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:05:28.368050 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 could not be found. Sep 10 12:05:28.368050 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.368050 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cb46f16e-8f5b-4c60-b8ad-830393e35032 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Returning 404 to user: Instance f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:05:28.368734 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cb46f16e-8f5b-4c60-b8ad-830393e35032 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 404 len: 111 microversion: 2.1 time: 0.093557 Sep 10 12:05:28.370926 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2629/5256] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:05:28 2022] DELETE /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 12:05:28.385724 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0e929e78-c566-43d9-956c-51de67388e1b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:28.386416 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0e929e78-c566-43d9-956c-51de67388e1b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f2da647c-6fe1-4674-9b1f-7f54bd2d3b15] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:28.407762 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e929e78-c566-43d9-956c-51de67388e1b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:28.410685 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e929e78-c566-43d9-956c-51de67388e1b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:28.411258 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e929e78-c566-43d9-956c-51de67388e1b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:28.411984 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e929e78-c566-43d9-956c-51de67388e1b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:28.412448 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e929e78-c566-43d9-956c-51de67388e1b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:28.412878 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e929e78-c566-43d9-956c-51de67388e1b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:28.425417 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8275070e-8ffe-4729-9817-0b7af78e2435 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:28.433944 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8275070e-8ffe-4729-9817-0b7af78e2435 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1529 microversion: 2.1 time: 0.395793 Sep 10 12:05:28.445169 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2628/5257] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:28 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1529 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:28.460328 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-0e929e78-c566-43d9-956c-51de67388e1b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] HTTP exception thrown: Instance f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 could not be found. Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0e929e78-c566-43d9-956c-51de67388e1b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Request method failure captured: Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 HTTP/1.1 Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHykcWQYupGxhcLpb6v5AsrUV8qZ6sg9Ki1Jfb5jCMoRjGicsw0WManJo8IjBppMD5CxQdT4hQu3IHHi54G_V7lvb8EgCj19qVHNlr3p45qCyo-pmA_bA7FrmqWJZSaCbHLCvlYvItyJikej-C_PUFDVoe9D_fp0roxy7XQj-_YcxQA Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersTestJSON-793172710 Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ac8b3e9f72234d9985fbc5fa7e7984ad", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersTestJSON-793172710 Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersTestJSON-793172710 Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersTestJSON-793172710-project Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: ef32131362a3442498234c0554f08305 Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersTestJSON-793172710-project Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 could not be found. Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'f2da647c-6fe1-4674-9b1f-7f54bd2d3b15'} Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 could not be found. Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 could not be found. Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.462344 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:28.466446 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:28.466446 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:28.466446 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:05:28.466446 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:05:28.466446 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 could not be found. Sep 10 12:05:28.466446 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.466446 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0e929e78-c566-43d9-956c-51de67388e1b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Returning 404 to user: Instance f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:05:28.466446 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0e929e78-c566-43d9-956c-51de67388e1b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15" status: 404 len: 111 microversion: 2.1 time: 0.088351 Sep 10 12:05:28.468793 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2630/5258] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:28 2022] GET /compute/v2.1/servers/f2da647c-6fe1-4674-9b1f-7f54bd2d3b15 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:05:28.474413 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-302655f1-bcaa-4838-9354-bb68f7814cd4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:28.475462 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-302655f1-bcaa-4838-9354-bb68f7814cd4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: eb38cda8-93a7-4327-944f-409c17070fd7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:28.485327 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-302655f1-bcaa-4838-9354-bb68f7814cd4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:28.486308 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-302655f1-bcaa-4838-9354-bb68f7814cd4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:28.487043 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-302655f1-bcaa-4838-9354-bb68f7814cd4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:28.488255 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-302655f1-bcaa-4838-9354-bb68f7814cd4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:28.488930 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-302655f1-bcaa-4838-9354-bb68f7814cd4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:28.489572 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-302655f1-bcaa-4838-9354-bb68f7814cd4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:28.511188 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-302655f1-bcaa-4838-9354-bb68f7814cd4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] HTTP exception thrown: Instance eb38cda8-93a7-4327-944f-409c17070fd7 could not be found. Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-302655f1-bcaa-4838-9354-bb68f7814cd4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Request method failure captured: Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7 HTTP/1.1 Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHykcWQYupGxhcLpb6v5AsrUV8qZ6sg9Ki1Jfb5jCMoRjGicsw0WManJo8IjBppMD5CxQdT4hQu3IHHi54G_V7lvb8EgCj19qVHNlr3p45qCyo-pmA_bA7FrmqWJZSaCbHLCvlYvItyJikej-C_PUFDVoe9D_fp0roxy7XQj-_YcxQA Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersTestJSON-793172710 Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ac8b3e9f72234d9985fbc5fa7e7984ad", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersTestJSON-793172710 Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersTestJSON-793172710 Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersTestJSON-793172710-project Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: ef32131362a3442498234c0554f08305 Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersTestJSON-793172710-project Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance eb38cda8-93a7-4327-944f-409c17070fd7 could not be found. Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'eb38cda8-93a7-4327-944f-409c17070fd7'} Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb38cda8-93a7-4327-944f-409c17070fd7 could not be found. Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:05:28.513586 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb38cda8-93a7-4327-944f-409c17070fd7 could not be found. Sep 10 12:05:28.516933 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.516933 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:28.516933 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.516933 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:28.516933 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:28.516933 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:28.516933 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:05:28.516933 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:05:28.516933 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb38cda8-93a7-4327-944f-409c17070fd7 could not be found. Sep 10 12:05:28.516933 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.557077 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-302655f1-bcaa-4838-9354-bb68f7814cd4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Returning 404 to user: Instance eb38cda8-93a7-4327-944f-409c17070fd7 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:05:28.558403 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-302655f1-bcaa-4838-9354-bb68f7814cd4 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "DELETE /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7" status: 404 len: 111 microversion: 2.1 time: 0.088801 Sep 10 12:05:28.562398 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2629/5259] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:05:28 2022] DELETE /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 12:05:28.571987 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b7fb23f3-d1aa-4279-a442-75371317c257 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:28.573785 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b7fb23f3-d1aa-4279-a442-75371317c257 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: eb38cda8-93a7-4327-944f-409c17070fd7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:28.593382 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7fb23f3-d1aa-4279-a442-75371317c257 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:28.595667 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7fb23f3-d1aa-4279-a442-75371317c257 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:28.596463 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7fb23f3-d1aa-4279-a442-75371317c257 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:28.599561 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7fb23f3-d1aa-4279-a442-75371317c257 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:28.602217 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7fb23f3-d1aa-4279-a442-75371317c257 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:28.603196 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7fb23f3-d1aa-4279-a442-75371317c257 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:28.625174 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-b7fb23f3-d1aa-4279-a442-75371317c257 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] HTTP exception thrown: Instance eb38cda8-93a7-4327-944f-409c17070fd7 could not be found. Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b7fb23f3-d1aa-4279-a442-75371317c257 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Request method failure captured: Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7 HTTP/1.1 Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHykcWQYupGxhcLpb6v5AsrUV8qZ6sg9Ki1Jfb5jCMoRjGicsw0WManJo8IjBppMD5CxQdT4hQu3IHHi54G_V7lvb8EgCj19qVHNlr3p45qCyo-pmA_bA7FrmqWJZSaCbHLCvlYvItyJikej-C_PUFDVoe9D_fp0roxy7XQj-_YcxQA Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersTestJSON-793172710 Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ac8b3e9f72234d9985fbc5fa7e7984ad", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersTestJSON-793172710 Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersTestJSON-793172710 Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersTestJSON-793172710-project Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: ef32131362a3442498234c0554f08305 Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersTestJSON-793172710-project Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance eb38cda8-93a7-4327-944f-409c17070fd7 could not be found. Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'eb38cda8-93a7-4327-944f-409c17070fd7'} Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb38cda8-93a7-4327-944f-409c17070fd7 could not be found. Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb38cda8-93a7-4327-944f-409c17070fd7 could not be found. Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.626724 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:28.630887 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:28.630887 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:28.630887 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:05:28.630887 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:05:28.630887 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb38cda8-93a7-4327-944f-409c17070fd7 could not be found. Sep 10 12:05:28.630887 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.630887 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b7fb23f3-d1aa-4279-a442-75371317c257 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Returning 404 to user: Instance eb38cda8-93a7-4327-944f-409c17070fd7 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:05:28.630887 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b7fb23f3-d1aa-4279-a442-75371317c257 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7" status: 404 len: 111 microversion: 2.1 time: 0.061400 Sep 10 12:05:28.632054 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2631/5260] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:28 2022] GET /compute/v2.1/servers/eb38cda8-93a7-4327-944f-409c17070fd7 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:05:28.639353 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b16e1b89-bdbf-4a7f-8c49-1fdba7ea2170 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:28.639865 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b16e1b89-bdbf-4a7f-8c49-1fdba7ea2170 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: a7c6046f-aad9-4a21-9130-fa30cfa8cc1b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:28.644151 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:05:28.656633 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b16e1b89-bdbf-4a7f-8c49-1fdba7ea2170 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:28.659409 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b16e1b89-bdbf-4a7f-8c49-1fdba7ea2170 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:28.660082 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b16e1b89-bdbf-4a7f-8c49-1fdba7ea2170 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:28.660984 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b16e1b89-bdbf-4a7f-8c49-1fdba7ea2170 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:28.661598 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b16e1b89-bdbf-4a7f-8c49-1fdba7ea2170 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:28.663405 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b16e1b89-bdbf-4a7f-8c49-1fdba7ea2170 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:28.716377 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:05:28.717793 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-b16e1b89-bdbf-4a7f-8c49-1fdba7ea2170 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] HTTP exception thrown: Instance a7c6046f-aad9-4a21-9130-fa30cfa8cc1b could not be found. Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b16e1b89-bdbf-4a7f-8c49-1fdba7ea2170 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Request method failure captured: Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/servers/a7c6046f-aad9-4a21-9130-fa30cfa8cc1b HTTP/1.1 Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHykcWQYupGxhcLpb6v5AsrUV8qZ6sg9Ki1Jfb5jCMoRjGicsw0WManJo8IjBppMD5CxQdT4hQu3IHHi54G_V7lvb8EgCj19qVHNlr3p45qCyo-pmA_bA7FrmqWJZSaCbHLCvlYvItyJikej-C_PUFDVoe9D_fp0roxy7XQj-_YcxQA Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersTestJSON-793172710 Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ac8b3e9f72234d9985fbc5fa7e7984ad", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersTestJSON-793172710 Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersTestJSON-793172710 Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersTestJSON-793172710-project Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: ef32131362a3442498234c0554f08305 Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersTestJSON-793172710-project Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance a7c6046f-aad9-4a21-9130-fa30cfa8cc1b could not be found. Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'a7c6046f-aad9-4a21-9130-fa30cfa8cc1b'} Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7c6046f-aad9-4a21-9130-fa30cfa8cc1b could not be found. Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:05:28.719777 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7c6046f-aad9-4a21-9130-fa30cfa8cc1b could not be found. Sep 10 12:05:28.723791 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.723791 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:28.723791 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.723791 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:28.723791 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:28.723791 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:28.723791 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:05:28.723791 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:05:28.723791 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7c6046f-aad9-4a21-9130-fa30cfa8cc1b could not be found. Sep 10 12:05:28.723791 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.723791 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b16e1b89-bdbf-4a7f-8c49-1fdba7ea2170 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Returning 404 to user: Instance a7c6046f-aad9-4a21-9130-fa30cfa8cc1b could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:05:28.723791 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b16e1b89-bdbf-4a7f-8c49-1fdba7ea2170 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a7c6046f-aad9-4a21-9130-fa30cfa8cc1b" status: 404 len: 111 microversion: 2.1 time: 0.087932 Sep 10 12:05:28.725977 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2630/5261] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:05:28 2022] DELETE /compute/v2.1/servers/a7c6046f-aad9-4a21-9130-fa30cfa8cc1b => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:05:28.730612 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-571eb6b1-e9ad-4687-b5c8-a1c9eb79e2e2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:28.731716 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-571eb6b1-e9ad-4687-b5c8-a1c9eb79e2e2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: a7c6046f-aad9-4a21-9130-fa30cfa8cc1b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:28.760728 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-571eb6b1-e9ad-4687-b5c8-a1c9eb79e2e2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:28.763469 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-571eb6b1-e9ad-4687-b5c8-a1c9eb79e2e2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:28.765999 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-571eb6b1-e9ad-4687-b5c8-a1c9eb79e2e2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:28.768782 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-571eb6b1-e9ad-4687-b5c8-a1c9eb79e2e2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:28.770123 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-571eb6b1-e9ad-4687-b5c8-a1c9eb79e2e2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:28.770885 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-571eb6b1-e9ad-4687-b5c8-a1c9eb79e2e2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:28.805371 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-571eb6b1-e9ad-4687-b5c8-a1c9eb79e2e2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] HTTP exception thrown: Instance a7c6046f-aad9-4a21-9130-fa30cfa8cc1b could not be found. Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-571eb6b1-e9ad-4687-b5c8-a1c9eb79e2e2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Request method failure captured: Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/a7c6046f-aad9-4a21-9130-fa30cfa8cc1b HTTP/1.1 Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHykcWQYupGxhcLpb6v5AsrUV8qZ6sg9Ki1Jfb5jCMoRjGicsw0WManJo8IjBppMD5CxQdT4hQu3IHHi54G_V7lvb8EgCj19qVHNlr3p45qCyo-pmA_bA7FrmqWJZSaCbHLCvlYvItyJikej-C_PUFDVoe9D_fp0roxy7XQj-_YcxQA Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersTestJSON-793172710 Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ac8b3e9f72234d9985fbc5fa7e7984ad", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersTestJSON-793172710 Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersTestJSON-793172710 Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersTestJSON-793172710-project Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: ef32131362a3442498234c0554f08305 Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersTestJSON-793172710-project Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance a7c6046f-aad9-4a21-9130-fa30cfa8cc1b could not be found. Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'a7c6046f-aad9-4a21-9130-fa30cfa8cc1b'} Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7c6046f-aad9-4a21-9130-fa30cfa8cc1b could not be found. Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7c6046f-aad9-4a21-9130-fa30cfa8cc1b could not be found. Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.807433 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:28.812284 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:28.812284 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:28.812284 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:05:28.812284 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:05:28.812284 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7c6046f-aad9-4a21-9130-fa30cfa8cc1b could not be found. Sep 10 12:05:28.812284 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.814184 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-571eb6b1-e9ad-4687-b5c8-a1c9eb79e2e2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Returning 404 to user: Instance a7c6046f-aad9-4a21-9130-fa30cfa8cc1b could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:05:28.815300 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-571eb6b1-e9ad-4687-b5c8-a1c9eb79e2e2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/a7c6046f-aad9-4a21-9130-fa30cfa8cc1b" status: 404 len: 111 microversion: 2.1 time: 0.089331 Sep 10 12:05:28.816183 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2632/5262] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:28 2022] GET /compute/v2.1/servers/a7c6046f-aad9-4a21-9130-fa30cfa8cc1b => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 12:05:28.825750 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6b3385b0-824b-474f-a158-aa6d60ec49fe tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:28.827525 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6b3385b0-824b-474f-a158-aa6d60ec49fe tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 6b4ea83e-918c-426c-8355-6febdfbe2614] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:28.841604 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6b3385b0-824b-474f-a158-aa6d60ec49fe tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:28.843647 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6b3385b0-824b-474f-a158-aa6d60ec49fe tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:28.844757 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6b3385b0-824b-474f-a158-aa6d60ec49fe tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:28.845800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6b3385b0-824b-474f-a158-aa6d60ec49fe tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:28.846496 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6b3385b0-824b-474f-a158-aa6d60ec49fe tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:28.847459 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6b3385b0-824b-474f-a158-aa6d60ec49fe tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:28.867427 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-6b3385b0-824b-474f-a158-aa6d60ec49fe tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] HTTP exception thrown: Instance 6b4ea83e-918c-426c-8355-6febdfbe2614 could not be found. Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6b3385b0-824b-474f-a158-aa6d60ec49fe tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Request method failure captured: Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614 HTTP/1.1 Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHykcWQYupGxhcLpb6v5AsrUV8qZ6sg9Ki1Jfb5jCMoRjGicsw0WManJo8IjBppMD5CxQdT4hQu3IHHi54G_V7lvb8EgCj19qVHNlr3p45qCyo-pmA_bA7FrmqWJZSaCbHLCvlYvItyJikej-C_PUFDVoe9D_fp0roxy7XQj-_YcxQA Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersTestJSON-793172710 Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ac8b3e9f72234d9985fbc5fa7e7984ad", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersTestJSON-793172710 Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersTestJSON-793172710 Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersTestJSON-793172710-project Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: ef32131362a3442498234c0554f08305 Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersTestJSON-793172710-project Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 6b4ea83e-918c-426c-8355-6febdfbe2614 could not be found. Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '6b4ea83e-918c-426c-8355-6febdfbe2614'} Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b4ea83e-918c-426c-8355-6febdfbe2614 could not be found. Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:05:28.871061 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b4ea83e-918c-426c-8355-6febdfbe2614 could not be found. Sep 10 12:05:28.874595 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.874595 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:28.874595 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.874595 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:28.874595 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:28.874595 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:28.874595 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:05:28.874595 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:05:28.874595 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b4ea83e-918c-426c-8355-6febdfbe2614 could not be found. Sep 10 12:05:28.874595 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.879945 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6b3385b0-824b-474f-a158-aa6d60ec49fe tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Returning 404 to user: Instance 6b4ea83e-918c-426c-8355-6febdfbe2614 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:05:28.881511 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6b3385b0-824b-474f-a158-aa6d60ec49fe tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614" status: 404 len: 111 microversion: 2.1 time: 0.060958 Sep 10 12:05:28.882819 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2631/5263] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:05:28 2022] DELETE /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:05:28.890814 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-aa0c4ac0-c13a-44f0-8f4a-6cd77fbff05b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:28.891537 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-aa0c4ac0-c13a-44f0-8f4a-6cd77fbff05b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 6b4ea83e-918c-426c-8355-6febdfbe2614] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:28.898342 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aa0c4ac0-c13a-44f0-8f4a-6cd77fbff05b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:28.898840 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aa0c4ac0-c13a-44f0-8f4a-6cd77fbff05b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:28.899320 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aa0c4ac0-c13a-44f0-8f4a-6cd77fbff05b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:28.900035 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aa0c4ac0-c13a-44f0-8f4a-6cd77fbff05b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:28.901047 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aa0c4ac0-c13a-44f0-8f4a-6cd77fbff05b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:28.923516 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aa0c4ac0-c13a-44f0-8f4a-6cd77fbff05b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:28.966459 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:05:28.967876 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-aa0c4ac0-c13a-44f0-8f4a-6cd77fbff05b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] HTTP exception thrown: Instance 6b4ea83e-918c-426c-8355-6febdfbe2614 could not be found. Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-aa0c4ac0-c13a-44f0-8f4a-6cd77fbff05b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Request method failure captured: Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614 HTTP/1.1 Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHykcWQYupGxhcLpb6v5AsrUV8qZ6sg9Ki1Jfb5jCMoRjGicsw0WManJo8IjBppMD5CxQdT4hQu3IHHi54G_V7lvb8EgCj19qVHNlr3p45qCyo-pmA_bA7FrmqWJZSaCbHLCvlYvItyJikej-C_PUFDVoe9D_fp0roxy7XQj-_YcxQA Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersTestJSON-793172710 Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ac8b3e9f72234d9985fbc5fa7e7984ad", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersTestJSON-793172710 Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersTestJSON-793172710 Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersTestJSON-793172710-project Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: ef32131362a3442498234c0554f08305 Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersTestJSON-793172710-project Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 6b4ea83e-918c-426c-8355-6febdfbe2614 could not be found. Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '6b4ea83e-918c-426c-8355-6febdfbe2614'} Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b4ea83e-918c-426c-8355-6febdfbe2614 could not be found. Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b4ea83e-918c-426c-8355-6febdfbe2614 could not be found. Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.969489 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:28.973565 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:28.973565 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:28.973565 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:05:28.973565 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:05:28.973565 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b4ea83e-918c-426c-8355-6febdfbe2614 could not be found. Sep 10 12:05:28.973565 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:28.973565 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-aa0c4ac0-c13a-44f0-8f4a-6cd77fbff05b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Returning 404 to user: Instance 6b4ea83e-918c-426c-8355-6febdfbe2614 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:05:28.973565 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-aa0c4ac0-c13a-44f0-8f4a-6cd77fbff05b tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614" status: 404 len: 111 microversion: 2.1 time: 0.084046 Sep 10 12:05:28.980746 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ce7a2d22-3004-47a8-93d1-55d16ff61f15 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:28.981262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ce7a2d22-3004-47a8-93d1-55d16ff61f15 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 00e23b21-ab07-4ce8-b66e-385261d61d7f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:28.989820 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ce7a2d22-3004-47a8-93d1-55d16ff61f15 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:28.990325 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ce7a2d22-3004-47a8-93d1-55d16ff61f15 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:28.990774 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ce7a2d22-3004-47a8-93d1-55d16ff61f15 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:28.995339 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2633/5264] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:28 2022] GET /compute/v2.1/servers/6b4ea83e-918c-426c-8355-6febdfbe2614 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:05:28.996166 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ce7a2d22-3004-47a8-93d1-55d16ff61f15 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:28.998267 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ce7a2d22-3004-47a8-93d1-55d16ff61f15 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:29.000105 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ce7a2d22-3004-47a8-93d1-55d16ff61f15 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:29.030798 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-ce7a2d22-3004-47a8-93d1-55d16ff61f15 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] HTTP exception thrown: Instance 00e23b21-ab07-4ce8-b66e-385261d61d7f could not be found. Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ce7a2d22-3004-47a8-93d1-55d16ff61f15 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Request method failure captured: Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f HTTP/1.1 Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHykcWQYupGxhcLpb6v5AsrUV8qZ6sg9Ki1Jfb5jCMoRjGicsw0WManJo8IjBppMD5CxQdT4hQu3IHHi54G_V7lvb8EgCj19qVHNlr3p45qCyo-pmA_bA7FrmqWJZSaCbHLCvlYvItyJikej-C_PUFDVoe9D_fp0roxy7XQj-_YcxQA Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersTestJSON-793172710 Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ac8b3e9f72234d9985fbc5fa7e7984ad", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersTestJSON-793172710 Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersTestJSON-793172710 Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersTestJSON-793172710-project Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: ef32131362a3442498234c0554f08305 Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersTestJSON-793172710-project Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 00e23b21-ab07-4ce8-b66e-385261d61d7f could not be found. Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '00e23b21-ab07-4ce8-b66e-385261d61d7f'} Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00e23b21-ab07-4ce8-b66e-385261d61d7f could not be found. Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:05:29.032538 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00e23b21-ab07-4ce8-b66e-385261d61d7f could not be found. Sep 10 12:05:29.035913 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:29.035913 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:29.035913 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:29.035913 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:29.035913 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:29.035913 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:29.035913 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:05:29.035913 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:05:29.035913 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00e23b21-ab07-4ce8-b66e-385261d61d7f could not be found. Sep 10 12:05:29.035913 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:29.035913 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ce7a2d22-3004-47a8-93d1-55d16ff61f15 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Returning 404 to user: Instance 00e23b21-ab07-4ce8-b66e-385261d61d7f could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:05:29.035913 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ce7a2d22-3004-47a8-93d1-55d16ff61f15 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "DELETE /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f" status: 404 len: 111 microversion: 2.1 time: 0.058255 Sep 10 12:05:29.038382 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2632/5265] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:05:28 2022] DELETE /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:05:29.046408 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-319bb089-af2c-4b33-afaa-8a963b0175dc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:29.048247 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-319bb089-af2c-4b33-afaa-8a963b0175dc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: 00e23b21-ab07-4ce8-b66e-385261d61d7f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:29.055226 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-319bb089-af2c-4b33-afaa-8a963b0175dc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:29.055745 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-319bb089-af2c-4b33-afaa-8a963b0175dc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:29.056187 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-319bb089-af2c-4b33-afaa-8a963b0175dc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:29.057099 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-319bb089-af2c-4b33-afaa-8a963b0175dc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:29.057535 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-319bb089-af2c-4b33-afaa-8a963b0175dc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:29.057977 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-319bb089-af2c-4b33-afaa-8a963b0175dc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:29.078702 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-319bb089-af2c-4b33-afaa-8a963b0175dc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] HTTP exception thrown: Instance 00e23b21-ab07-4ce8-b66e-385261d61d7f could not be found. Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-319bb089-af2c-4b33-afaa-8a963b0175dc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Request method failure captured: Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f HTTP/1.1 Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHykcWQYupGxhcLpb6v5AsrUV8qZ6sg9Ki1Jfb5jCMoRjGicsw0WManJo8IjBppMD5CxQdT4hQu3IHHi54G_V7lvb8EgCj19qVHNlr3p45qCyo-pmA_bA7FrmqWJZSaCbHLCvlYvItyJikej-C_PUFDVoe9D_fp0roxy7XQj-_YcxQA Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersTestJSON-793172710 Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ac8b3e9f72234d9985fbc5fa7e7984ad", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersTestJSON-793172710 Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersTestJSON-793172710 Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersTestJSON-793172710-project Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: ef32131362a3442498234c0554f08305 Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersTestJSON-793172710-project Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 00e23b21-ab07-4ce8-b66e-385261d61d7f could not be found. Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '00e23b21-ab07-4ce8-b66e-385261d61d7f'} Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00e23b21-ab07-4ce8-b66e-385261d61d7f could not be found. Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00e23b21-ab07-4ce8-b66e-385261d61d7f could not be found. Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:29.080869 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:29.084335 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:29.084335 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:29.084335 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:05:29.084335 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:05:29.084335 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00e23b21-ab07-4ce8-b66e-385261d61d7f could not be found. Sep 10 12:05:29.084335 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:29.084335 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-319bb089-af2c-4b33-afaa-8a963b0175dc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Returning 404 to user: Instance 00e23b21-ab07-4ce8-b66e-385261d61d7f could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:05:29.084335 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-319bb089-af2c-4b33-afaa-8a963b0175dc tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f" status: 404 len: 111 microversion: 2.1 time: 0.043600 Sep 10 12:05:29.093203 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b4afe07e-f249-484e-aec4-b42781576b69 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:29.093809 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b4afe07e-f249-484e-aec4-b42781576b69 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f6556ea4-d20e-4561-8793-d1d4412fad26] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:29.098988 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2634/5266] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:29 2022] GET /compute/v2.1/servers/00e23b21-ab07-4ce8-b66e-385261d61d7f => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:05:29.101459 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b4afe07e-f249-484e-aec4-b42781576b69 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:29.101952 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b4afe07e-f249-484e-aec4-b42781576b69 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:29.102389 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b4afe07e-f249-484e-aec4-b42781576b69 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:29.103092 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b4afe07e-f249-484e-aec4-b42781576b69 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:29.103585 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b4afe07e-f249-484e-aec4-b42781576b69 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:29.105366 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b4afe07e-f249-484e-aec4-b42781576b69 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:29.132183 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-b4afe07e-f249-484e-aec4-b42781576b69 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] HTTP exception thrown: Instance f6556ea4-d20e-4561-8793-d1d4412fad26 could not be found. Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b4afe07e-f249-484e-aec4-b42781576b69 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Request method failure captured: Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/servers/f6556ea4-d20e-4561-8793-d1d4412fad26 HTTP/1.1 Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHykcWQYupGxhcLpb6v5AsrUV8qZ6sg9Ki1Jfb5jCMoRjGicsw0WManJo8IjBppMD5CxQdT4hQu3IHHi54G_V7lvb8EgCj19qVHNlr3p45qCyo-pmA_bA7FrmqWJZSaCbHLCvlYvItyJikej-C_PUFDVoe9D_fp0roxy7XQj-_YcxQA Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersTestJSON-793172710 Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ac8b3e9f72234d9985fbc5fa7e7984ad", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersTestJSON-793172710 Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersTestJSON-793172710 Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersTestJSON-793172710-project Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: ef32131362a3442498234c0554f08305 Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersTestJSON-793172710-project Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance f6556ea4-d20e-4561-8793-d1d4412fad26 could not be found. Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'f6556ea4-d20e-4561-8793-d1d4412fad26'} Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6556ea4-d20e-4561-8793-d1d4412fad26 could not be found. Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:05:29.135083 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6556ea4-d20e-4561-8793-d1d4412fad26 could not be found. Sep 10 12:05:29.138635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:29.138635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:29.138635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:29.138635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:29.138635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:29.138635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:29.138635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:05:29.138635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:05:29.138635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6556ea4-d20e-4561-8793-d1d4412fad26 could not be found. Sep 10 12:05:29.138635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:29.138635 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b4afe07e-f249-484e-aec4-b42781576b69 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Returning 404 to user: Instance f6556ea4-d20e-4561-8793-d1d4412fad26 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:05:29.138635 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b4afe07e-f249-484e-aec4-b42781576b69 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f6556ea4-d20e-4561-8793-d1d4412fad26" status: 404 len: 111 microversion: 2.1 time: 0.049599 Sep 10 12:05:29.146244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cfdfcbb5-67f0-4dcc-8ec5-67a7ddd7eaa3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:29.146867 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cfdfcbb5-67f0-4dcc-8ec5-67a7ddd7eaa3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: f6556ea4-d20e-4561-8793-d1d4412fad26] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:29.160571 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cfdfcbb5-67f0-4dcc-8ec5-67a7ddd7eaa3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:29.161066 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cfdfcbb5-67f0-4dcc-8ec5-67a7ddd7eaa3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:29.162868 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cfdfcbb5-67f0-4dcc-8ec5-67a7ddd7eaa3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:29.163614 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cfdfcbb5-67f0-4dcc-8ec5-67a7ddd7eaa3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:29.164075 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cfdfcbb5-67f0-4dcc-8ec5-67a7ddd7eaa3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:29.164513 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cfdfcbb5-67f0-4dcc-8ec5-67a7ddd7eaa3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:29.166977 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2633/5267] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:05:29 2022] DELETE /compute/v2.1/servers/f6556ea4-d20e-4561-8793-d1d4412fad26 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:05:29.198394 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-cfdfcbb5-67f0-4dcc-8ec5-67a7ddd7eaa3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] HTTP exception thrown: Instance f6556ea4-d20e-4561-8793-d1d4412fad26 could not be found. Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cfdfcbb5-67f0-4dcc-8ec5-67a7ddd7eaa3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Request method failure captured: Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/f6556ea4-d20e-4561-8793-d1d4412fad26 HTTP/1.1 Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHykcWQYupGxhcLpb6v5AsrUV8qZ6sg9Ki1Jfb5jCMoRjGicsw0WManJo8IjBppMD5CxQdT4hQu3IHHi54G_V7lvb8EgCj19qVHNlr3p45qCyo-pmA_bA7FrmqWJZSaCbHLCvlYvItyJikej-C_PUFDVoe9D_fp0roxy7XQj-_YcxQA Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersTestJSON-793172710 Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ac8b3e9f72234d9985fbc5fa7e7984ad", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersTestJSON-793172710 Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersTestJSON-793172710 Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersTestJSON-793172710-project Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: ef32131362a3442498234c0554f08305 Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersTestJSON-793172710-project Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance f6556ea4-d20e-4561-8793-d1d4412fad26 could not be found. Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'f6556ea4-d20e-4561-8793-d1d4412fad26'} Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6556ea4-d20e-4561-8793-d1d4412fad26 could not be found. Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6556ea4-d20e-4561-8793-d1d4412fad26 could not be found. Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:29.199999 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:29.203497 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:29.203497 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:29.203497 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:05:29.203497 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:05:29.203497 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6556ea4-d20e-4561-8793-d1d4412fad26 could not be found. Sep 10 12:05:29.203497 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:29.203497 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cfdfcbb5-67f0-4dcc-8ec5-67a7ddd7eaa3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Returning 404 to user: Instance f6556ea4-d20e-4561-8793-d1d4412fad26 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:05:29.203497 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cfdfcbb5-67f0-4dcc-8ec5-67a7ddd7eaa3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/f6556ea4-d20e-4561-8793-d1d4412fad26" status: 404 len: 111 microversion: 2.1 time: 0.059386 Sep 10 12:05:29.217611 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d5d6ef73-ebfd-4102-be88-c82b5689e6dd tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:29.218118 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d5d6ef73-ebfd-4102-be88-c82b5689e6dd tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: edf9e114-8094-4b65-a61a-51b52e7fa165] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:29.221098 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:05:29.222533 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2635/5268] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:29 2022] GET /compute/v2.1/servers/f6556ea4-d20e-4561-8793-d1d4412fad26 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:05:29.231193 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-d5d6ef73-ebfd-4102-be88-c82b5689e6dd tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] HTTP exception thrown: Instance edf9e114-8094-4b65-a61a-51b52e7fa165 could not be found. Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d5d6ef73-ebfd-4102-be88-c82b5689e6dd tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Request method failure captured: Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/servers/edf9e114-8094-4b65-a61a-51b52e7fa165 HTTP/1.1 Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHykcWQYupGxhcLpb6v5AsrUV8qZ6sg9Ki1Jfb5jCMoRjGicsw0WManJo8IjBppMD5CxQdT4hQu3IHHi54G_V7lvb8EgCj19qVHNlr3p45qCyo-pmA_bA7FrmqWJZSaCbHLCvlYvItyJikej-C_PUFDVoe9D_fp0roxy7XQj-_YcxQA Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersTestJSON-793172710 Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ac8b3e9f72234d9985fbc5fa7e7984ad", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersTestJSON-793172710 Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersTestJSON-793172710 Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersTestJSON-793172710-project Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: ef32131362a3442498234c0554f08305 Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersTestJSON-793172710-project Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance edf9e114-8094-4b65-a61a-51b52e7fa165 could not be found. Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'edf9e114-8094-4b65-a61a-51b52e7fa165'} Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edf9e114-8094-4b65-a61a-51b52e7fa165 could not be found. Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edf9e114-8094-4b65-a61a-51b52e7fa165 could not be found. Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:29.232763 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:29.236237 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:29.236237 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:29.236237 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:29.236237 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:05:29.236237 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:05:29.236237 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edf9e114-8094-4b65-a61a-51b52e7fa165 could not be found. Sep 10 12:05:29.236237 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:29.236237 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d5d6ef73-ebfd-4102-be88-c82b5689e6dd tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Returning 404 to user: Instance edf9e114-8094-4b65-a61a-51b52e7fa165 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:05:29.236237 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d5d6ef73-ebfd-4102-be88-c82b5689e6dd tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "DELETE /compute/v2.1/servers/edf9e114-8094-4b65-a61a-51b52e7fa165" status: 404 len: 111 microversion: 2.1 time: 0.021646 Sep 10 12:05:29.238187 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2634/5269] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:05:29 2022] DELETE /compute/v2.1/servers/edf9e114-8094-4b65-a61a-51b52e7fa165 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:05:29.243430 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d69ad308-3fb7-4c51-b19e-667ef0c6710c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:29.244178 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d69ad308-3fb7-4c51-b19e-667ef0c6710c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: edf9e114-8094-4b65-a61a-51b52e7fa165] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:29.250545 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-d69ad308-3fb7-4c51-b19e-667ef0c6710c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] HTTP exception thrown: Instance edf9e114-8094-4b65-a61a-51b52e7fa165 could not be found. Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d69ad308-3fb7-4c51-b19e-667ef0c6710c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Request method failure captured: Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/edf9e114-8094-4b65-a61a-51b52e7fa165 HTTP/1.1 Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHykcWQYupGxhcLpb6v5AsrUV8qZ6sg9Ki1Jfb5jCMoRjGicsw0WManJo8IjBppMD5CxQdT4hQu3IHHi54G_V7lvb8EgCj19qVHNlr3p45qCyo-pmA_bA7FrmqWJZSaCbHLCvlYvItyJikej-C_PUFDVoe9D_fp0roxy7XQj-_YcxQA Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersTestJSON-793172710 Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ac8b3e9f72234d9985fbc5fa7e7984ad", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersTestJSON-793172710 Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersTestJSON-793172710 Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersTestJSON-793172710-project Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: ef32131362a3442498234c0554f08305 Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersTestJSON-793172710-project Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance edf9e114-8094-4b65-a61a-51b52e7fa165 could not be found. Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'edf9e114-8094-4b65-a61a-51b52e7fa165'} Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edf9e114-8094-4b65-a61a-51b52e7fa165 could not be found. Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edf9e114-8094-4b65-a61a-51b52e7fa165 could not be found. Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:29.253407 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:29.257690 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:05:29.257690 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:05:29.257690 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edf9e114-8094-4b65-a61a-51b52e7fa165 could not be found. Sep 10 12:05:29.257690 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:05:29.258859 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d69ad308-3fb7-4c51-b19e-667ef0c6710c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Returning 404 to user: Instance edf9e114-8094-4b65-a61a-51b52e7fa165 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:05:29.260665 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d69ad308-3fb7-4c51-b19e-667ef0c6710c tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/edf9e114-8094-4b65-a61a-51b52e7fa165" status: 404 len: 111 microversion: 2.1 time: 0.020472 Sep 10 12:05:29.261408 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2636/5270] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:29 2022] GET /compute/v2.1/servers/edf9e114-8094-4b65-a61a-51b52e7fa165 => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:05:29.270481 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-58fb5a47-14bf-4bd3-9720-594d1cbd03c3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:29.271494 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-58fb5a47-14bf-4bd3-9720-594d1cbd03c3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: c9e5a917-1b95-4d2b-9d1b-067bb36aa869] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:29.280590 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-58fb5a47-14bf-4bd3-9720-594d1cbd03c3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:29.281569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-58fb5a47-14bf-4bd3-9720-594d1cbd03c3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:29.282269 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-58fb5a47-14bf-4bd3-9720-594d1cbd03c3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:29.283198 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-58fb5a47-14bf-4bd3-9720-594d1cbd03c3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:29.284581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-58fb5a47-14bf-4bd3-9720-594d1cbd03c3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:29.285305 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-58fb5a47-14bf-4bd3-9720-594d1cbd03c3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:29.337076 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-58fb5a47-14bf-4bd3-9720-594d1cbd03c3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: c9e5a917-1b95-4d2b-9d1b-067bb36aa869] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:05:29.459398 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b8dfa00b-b817-4332-aec6-783e81fc44f3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:29.460129 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b8dfa00b-b817-4332-aec6-783e81fc44f3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:29.480438 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8dfa00b-b817-4332-aec6-783e81fc44f3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:29.484237 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8dfa00b-b817-4332-aec6-783e81fc44f3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:29.484881 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8dfa00b-b817-4332-aec6-783e81fc44f3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:29.487793 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8dfa00b-b817-4332-aec6-783e81fc44f3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:29.490934 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8dfa00b-b817-4332-aec6-783e81fc44f3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:29.492976 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8dfa00b-b817-4332-aec6-783e81fc44f3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:29.527686 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-58fb5a47-14bf-4bd3-9720-594d1cbd03c3 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c9e5a917-1b95-4d2b-9d1b-067bb36aa869" status: 204 len: 0 microversion: 2.1 time: 0.261454 Sep 10 12:05:29.531940 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2635/5271] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:05:29 2022] DELETE /compute/v2.1/servers/c9e5a917-1b95-4d2b-9d1b-067bb36aa869 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:05:29.538688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-45d83275-4926-4f44-8275-ec760b3a5de2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:29.543571 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-45d83275-4926-4f44-8275-ec760b3a5de2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: c9e5a917-1b95-4d2b-9d1b-067bb36aa869] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:29.554185 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-45d83275-4926-4f44-8275-ec760b3a5de2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:29.555119 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-45d83275-4926-4f44-8275-ec760b3a5de2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:29.556604 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-45d83275-4926-4f44-8275-ec760b3a5de2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:29.558212 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-45d83275-4926-4f44-8275-ec760b3a5de2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:29.562167 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-45d83275-4926-4f44-8275-ec760b3a5de2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:29.562787 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-45d83275-4926-4f44-8275-ec760b3a5de2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:30.027783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-45d83275-4926-4f44-8275-ec760b3a5de2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:30.048487 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-45d83275-4926-4f44-8275-ec760b3a5de2 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/c9e5a917-1b95-4d2b-9d1b-067bb36aa869" status: 200 len: 1479 microversion: 2.1 time: 0.515133 Sep 10 12:05:30.049360 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2636/5272] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:29 2022] GET /compute/v2.1/servers/c9e5a917-1b95-4d2b-9d1b-067bb36aa869 => generated 1479 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:30.092422 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b8dfa00b-b817-4332-aec6-783e81fc44f3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:30.105346 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b8dfa00b-b817-4332-aec6-783e81fc44f3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1529 microversion: 2.1 time: 0.650486 Sep 10 12:05:30.106495 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2637/5273] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:29 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1529 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:05:31.076726 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9d487c55-e642-4ea9-80b4-9c5a69ec1d90 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:31.077520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9d487c55-e642-4ea9-80b4-9c5a69ec1d90 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: c9e5a917-1b95-4d2b-9d1b-067bb36aa869] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:31.097242 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9d487c55-e642-4ea9-80b4-9c5a69ec1d90 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:31.097923 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9d487c55-e642-4ea9-80b4-9c5a69ec1d90 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:31.098495 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9d487c55-e642-4ea9-80b4-9c5a69ec1d90 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:31.099365 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9d487c55-e642-4ea9-80b4-9c5a69ec1d90 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:31.099937 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9d487c55-e642-4ea9-80b4-9c5a69ec1d90 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:31.100479 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9d487c55-e642-4ea9-80b4-9c5a69ec1d90 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:31.131393 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f882aa38-80b7-4738-8234-0841063bb728 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:31.132721 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f882aa38-80b7-4738-8234-0841063bb728 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:31.164163 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f882aa38-80b7-4738-8234-0841063bb728 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:31.165819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f882aa38-80b7-4738-8234-0841063bb728 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:31.166321 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f882aa38-80b7-4738-8234-0841063bb728 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:31.168144 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f882aa38-80b7-4738-8234-0841063bb728 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:31.169950 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f882aa38-80b7-4738-8234-0841063bb728 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:31.171231 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f882aa38-80b7-4738-8234-0841063bb728 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:31.662502 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9d487c55-e642-4ea9-80b4-9c5a69ec1d90 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:31.671753 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9d487c55-e642-4ea9-80b4-9c5a69ec1d90 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/c9e5a917-1b95-4d2b-9d1b-067bb36aa869" status: 200 len: 1479 microversion: 2.1 time: 0.599478 Sep 10 12:05:31.673125 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f882aa38-80b7-4738-8234-0841063bb728 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:31.679946 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2637/5274] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:31 2022] GET /compute/v2.1/servers/c9e5a917-1b95-4d2b-9d1b-067bb36aa869 => generated 1479 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:31.695323 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f882aa38-80b7-4738-8234-0841063bb728 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1529 microversion: 2.1 time: 0.556141 Sep 10 12:05:31.701821 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2638/5275] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:31 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1529 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:32.702609 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c20a3152-6354-40af-8a7e-5553611e94a6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:32.703217 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c20a3152-6354-40af-8a7e-5553611e94a6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: c9e5a917-1b95-4d2b-9d1b-067bb36aa869] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:32.709067 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-79206ead-fc78-4219-bacb-fa36d25233e6 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:32.709831 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-79206ead-fc78-4219-bacb-fa36d25233e6 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:32.717614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c20a3152-6354-40af-8a7e-5553611e94a6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:32.718114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c20a3152-6354-40af-8a7e-5553611e94a6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:32.718552 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c20a3152-6354-40af-8a7e-5553611e94a6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:32.719295 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c20a3152-6354-40af-8a7e-5553611e94a6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:32.719753 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c20a3152-6354-40af-8a7e-5553611e94a6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:32.720180 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c20a3152-6354-40af-8a7e-5553611e94a6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:32.724264 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79206ead-fc78-4219-bacb-fa36d25233e6 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:32.729395 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79206ead-fc78-4219-bacb-fa36d25233e6 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:32.729984 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79206ead-fc78-4219-bacb-fa36d25233e6 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:32.731199 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79206ead-fc78-4219-bacb-fa36d25233e6 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:32.732314 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79206ead-fc78-4219-bacb-fa36d25233e6 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:32.732984 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79206ead-fc78-4219-bacb-fa36d25233e6 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:32.977910 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c20a3152-6354-40af-8a7e-5553611e94a6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef32131362a3442498234c0554f08305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8b3e9f72234d9985fbc5fa7e7984ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:32.991753 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c20a3152-6354-40af-8a7e-5553611e94a6 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/c9e5a917-1b95-4d2b-9d1b-067bb36aa869" status: 200 len: 1437 microversion: 2.1 time: 0.293484 Sep 10 12:05:32.999029 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2638/5276] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:32 2022] GET /compute/v2.1/servers/c9e5a917-1b95-4d2b-9d1b-067bb36aa869 => generated 1437 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:05:33.004238 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-85dfa36f-a97d-4d78-9ed5-fbdb70407f96 req-cd8317dc-f0eb-4ad8-b6b7-76947545cc6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9e5a917-1b95-4d2b-9d1b-067bb36aa869", "name": "network-vif-deleted", "tag": "4e1366da-1da3-49ce-9191-e53716ae9233"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:05:33.029585 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-85dfa36f-a97d-4d78-9ed5-fbdb70407f96 req-cd8317dc-f0eb-4ad8-b6b7-76947545cc6b service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:33.030610 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-85dfa36f-a97d-4d78-9ed5-fbdb70407f96 req-cd8317dc-f0eb-4ad8-b6b7-76947545cc6b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:33.031521 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-85dfa36f-a97d-4d78-9ed5-fbdb70407f96 req-cd8317dc-f0eb-4ad8-b6b7-76947545cc6b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:33.055435 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-85dfa36f-a97d-4d78-9ed5-fbdb70407f96 req-cd8317dc-f0eb-4ad8-b6b7-76947545cc6b service nova] Creating event network-vif-deleted:4e1366da-1da3-49ce-9191-e53716ae9233 for instance c9e5a917-1b95-4d2b-9d1b-067bb36aa869 on n-h2-856895-1 Sep 10 12:05:33.071373 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-85dfa36f-a97d-4d78-9ed5-fbdb70407f96 req-cd8317dc-f0eb-4ad8-b6b7-76947545cc6b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070699 Sep 10 12:05:33.072869 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2639/5277] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:05:33.436179 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-79206ead-fc78-4219-bacb-fa36d25233e6 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:33.448492 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-79206ead-fc78-4219-bacb-fa36d25233e6 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1529 microversion: 2.1 time: 0.742100 Sep 10 12:05:33.450390 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2639/5278] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:32 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1529 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:05:34.019103 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8e18ba96-3c7b-4aef-b594-93b9f27d8892 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:34.020772 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8e18ba96-3c7b-4aef-b594-93b9f27d8892 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] [instance: c9e5a917-1b95-4d2b-9d1b-067bb36aa869] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:34.037705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e18ba96-3c7b-4aef-b594-93b9f27d8892 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:34.039806 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e18ba96-3c7b-4aef-b594-93b9f27d8892 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:34.041607 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e18ba96-3c7b-4aef-b594-93b9f27d8892 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:34.044213 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e18ba96-3c7b-4aef-b594-93b9f27d8892 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:34.046080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e18ba96-3c7b-4aef-b594-93b9f27d8892 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:34.046932 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e18ba96-3c7b-4aef-b594-93b9f27d8892 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:34.105018 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-8e18ba96-3c7b-4aef-b594-93b9f27d8892 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] HTTP exception thrown: Instance c9e5a917-1b95-4d2b-9d1b-067bb36aa869 could not be found. Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8e18ba96-3c7b-4aef-b594-93b9f27d8892 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Request method failure captured: Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/c9e5a917-1b95-4d2b-9d1b-067bb36aa869 HTTP/1.1 Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHykcWQYupGxhcLpb6v5AsrUV8qZ6sg9Ki1Jfb5jCMoRjGicsw0WManJo8IjBppMD5CxQdT4hQu3IHHi54G_V7lvb8EgCj19qVHNlr3p45qCyo-pmA_bA7FrmqWJZSaCbHLCvlYvItyJikej-C_PUFDVoe9D_fp0roxy7XQj-_YcxQA Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersTestJSON-793172710 Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ac8b3e9f72234d9985fbc5fa7e7984ad", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ac8b3e9f72234d9985fbc5fa7e7984ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersTestJSON-793172710 Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: ac8b3e9f72234d9985fbc5fa7e7984ad Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersTestJSON-793172710 Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersTestJSON-793172710-project Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: ef32131362a3442498234c0554f08305 Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersTestJSON-793172710-project Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance c9e5a917-1b95-4d2b-9d1b-067bb36aa869 could not be found. Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'c9e5a917-1b95-4d2b-9d1b-067bb36aa869'} Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9e5a917-1b95-4d2b-9d1b-067bb36aa869 could not be found. Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9e5a917-1b95-4d2b-9d1b-067bb36aa869 could not be found. Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:34.108033 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:05:34.112822 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:05:34.112822 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:05:34.112822 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:05:34.112822 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:05:34.112822 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9e5a917-1b95-4d2b-9d1b-067bb36aa869 could not be found. Sep 10 12:05:34.112822 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:05:34.115408 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8e18ba96-3c7b-4aef-b594-93b9f27d8892 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] Returning 404 to user: Instance c9e5a917-1b95-4d2b-9d1b-067bb36aa869 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:05:34.116565 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8e18ba96-3c7b-4aef-b594-93b9f27d8892 tempest-ServersTestJSON-793172710 tempest-ServersTestJSON-793172710-project] 10.222.0.23 "GET /compute/v2.1/servers/c9e5a917-1b95-4d2b-9d1b-067bb36aa869" status: 404 len: 111 microversion: 2.1 time: 0.103004 Sep 10 12:05:34.117828 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2640/5279] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:34 2022] GET /compute/v2.1/servers/c9e5a917-1b95-4d2b-9d1b-067bb36aa869 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:05:34.482585 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-852ba3fd-10ea-46a6-a81f-c5103ec2254a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:34.483913 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-852ba3fd-10ea-46a6-a81f-c5103ec2254a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:34.506616 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-852ba3fd-10ea-46a6-a81f-c5103ec2254a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:34.507476 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-852ba3fd-10ea-46a6-a81f-c5103ec2254a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:34.508145 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-852ba3fd-10ea-46a6-a81f-c5103ec2254a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:34.509526 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-852ba3fd-10ea-46a6-a81f-c5103ec2254a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:34.510863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-852ba3fd-10ea-46a6-a81f-c5103ec2254a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:34.513342 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-852ba3fd-10ea-46a6-a81f-c5103ec2254a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:35.301346 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-852ba3fd-10ea-46a6-a81f-c5103ec2254a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:35.314571 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-852ba3fd-10ea-46a6-a81f-c5103ec2254a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1529 microversion: 2.1 time: 0.838048 Sep 10 12:05:35.316514 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2640/5280] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:34 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1529 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:36.339562 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-247452fc-ae77-49a7-af26-fe0c2fb7e42d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:36.340217 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-247452fc-ae77-49a7-af26-fe0c2fb7e42d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:36.352379 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-247452fc-ae77-49a7-af26-fe0c2fb7e42d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:36.352874 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-247452fc-ae77-49a7-af26-fe0c2fb7e42d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:36.360265 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-247452fc-ae77-49a7-af26-fe0c2fb7e42d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:36.361050 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-247452fc-ae77-49a7-af26-fe0c2fb7e42d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:36.361536 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-247452fc-ae77-49a7-af26-fe0c2fb7e42d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:36.361978 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-247452fc-ae77-49a7-af26-fe0c2fb7e42d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:36.489488 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a6a49f48-1887-46de-bcfa-ab1f21e40715 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:05:36.491927 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a6a49f48-1887-46de-bcfa-ab1f21e40715 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:36.507032 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6a49f48-1887-46de-bcfa-ab1f21e40715 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:36.507824 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6a49f48-1887-46de-bcfa-ab1f21e40715 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:36.508447 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6a49f48-1887-46de-bcfa-ab1f21e40715 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:36.509324 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6a49f48-1887-46de-bcfa-ab1f21e40715 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:36.510237 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6a49f48-1887-46de-bcfa-ab1f21e40715 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:36.510974 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6a49f48-1887-46de-bcfa-ab1f21e40715 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:36.738185 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a6a49f48-1887-46de-bcfa-ab1f21e40715 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "POST /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f/action" status: 202 len: 0 microversion: 2.1 time: 0.255963 Sep 10 12:05:36.743914 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2641/5281] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:05:36 2022] POST /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 12:05:36.766022 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-245fbebd-fd64-49da-9654-b6ac07176352 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:36.778609 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-245fbebd-fd64-49da-9654-b6ac07176352 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:36.801752 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-245fbebd-fd64-49da-9654-b6ac07176352 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:36.810823 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-245fbebd-fd64-49da-9654-b6ac07176352 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:36.812252 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-245fbebd-fd64-49da-9654-b6ac07176352 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:36.813046 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-245fbebd-fd64-49da-9654-b6ac07176352 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:36.813535 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-245fbebd-fd64-49da-9654-b6ac07176352 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:36.813978 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-245fbebd-fd64-49da-9654-b6ac07176352 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:37.088705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-247452fc-ae77-49a7-af26-fe0c2fb7e42d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:37.107721 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-247452fc-ae77-49a7-af26-fe0c2fb7e42d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1529 microversion: 2.1 time: 0.762577 Sep 10 12:05:37.111954 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2641/5282] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:36 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1529 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:38.137642 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-df4bd642-0c11-430a-9a8c-9c8ace44d0e4 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:38.138460 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-df4bd642-0c11-430a-9a8c-9c8ace44d0e4 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:38.151106 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-df4bd642-0c11-430a-9a8c-9c8ace44d0e4 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:38.154274 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-df4bd642-0c11-430a-9a8c-9c8ace44d0e4 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:38.154916 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-df4bd642-0c11-430a-9a8c-9c8ace44d0e4 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:38.158767 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-df4bd642-0c11-430a-9a8c-9c8ace44d0e4 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:38.159472 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-df4bd642-0c11-430a-9a8c-9c8ace44d0e4 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:38.163666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-df4bd642-0c11-430a-9a8c-9c8ace44d0e4 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:38.630164 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-245fbebd-fd64-49da-9654-b6ac07176352 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:38.648846 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-245fbebd-fd64-49da-9654-b6ac07176352 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1674 microversion: 2.1 time: 1.894026 Sep 10 12:05:38.670448 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2642/5283] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:36 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1674 bytes in 1917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:39.305862 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-df4bd642-0c11-430a-9a8c-9c8ace44d0e4 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:39.323325 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-df4bd642-0c11-430a-9a8c-9c8ace44d0e4 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1529 microversion: 2.1 time: 1.187860 Sep 10 12:05:39.324526 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2642/5284] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:38 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1529 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:05:39.676514 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-41e1c002-71ee-40d4-b4d6-3ece8fb7cbae tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:39.678482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-41e1c002-71ee-40d4-b4d6-3ece8fb7cbae tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:39.691239 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41e1c002-71ee-40d4-b4d6-3ece8fb7cbae tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:39.699005 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41e1c002-71ee-40d4-b4d6-3ece8fb7cbae tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:39.702264 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41e1c002-71ee-40d4-b4d6-3ece8fb7cbae tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:39.703315 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41e1c002-71ee-40d4-b4d6-3ece8fb7cbae tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:39.706633 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41e1c002-71ee-40d4-b4d6-3ece8fb7cbae tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:39.711206 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41e1c002-71ee-40d4-b4d6-3ece8fb7cbae tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:40.353150 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1c3b6387-cb90-4082-a707-ea338c7d75a3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:40.353891 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1c3b6387-cb90-4082-a707-ea338c7d75a3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:40.382112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c3b6387-cb90-4082-a707-ea338c7d75a3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:40.387466 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c3b6387-cb90-4082-a707-ea338c7d75a3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:40.388270 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c3b6387-cb90-4082-a707-ea338c7d75a3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:40.390116 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c3b6387-cb90-4082-a707-ea338c7d75a3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:40.397077 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c3b6387-cb90-4082-a707-ea338c7d75a3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:40.397818 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c3b6387-cb90-4082-a707-ea338c7d75a3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:40.485194 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-41e1c002-71ee-40d4-b4d6-3ece8fb7cbae tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:40.500413 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-41e1c002-71ee-40d4-b4d6-3ece8fb7cbae tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1674 microversion: 2.1 time: 0.828052 Sep 10 12:05:40.503115 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2643/5285] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:39 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1674 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:40.978336 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1c3b6387-cb90-4082-a707-ea338c7d75a3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:40.996814 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1c3b6387-cb90-4082-a707-ea338c7d75a3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1529 microversion: 2.1 time: 0.648094 Sep 10 12:05:41.000774 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2643/5286] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:40 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1529 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:05:41.529623 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7f23da09-0dac-4ca4-b620-4e984a185423 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:41.532619 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7f23da09-0dac-4ca4-b620-4e984a185423 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:41.559713 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f23da09-0dac-4ca4-b620-4e984a185423 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:41.560443 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f23da09-0dac-4ca4-b620-4e984a185423 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:41.561047 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f23da09-0dac-4ca4-b620-4e984a185423 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:41.564373 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f23da09-0dac-4ca4-b620-4e984a185423 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:41.565133 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f23da09-0dac-4ca4-b620-4e984a185423 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:41.566928 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f23da09-0dac-4ca4-b620-4e984a185423 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:42.025162 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-214185ba-4594-47d7-979b-b67a34c0f806 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:42.026548 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-214185ba-4594-47d7-979b-b67a34c0f806 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:42.043149 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-214185ba-4594-47d7-979b-b67a34c0f806 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:42.044100 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-214185ba-4594-47d7-979b-b67a34c0f806 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:42.045177 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-214185ba-4594-47d7-979b-b67a34c0f806 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:42.046903 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-214185ba-4594-47d7-979b-b67a34c0f806 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:42.048130 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-214185ba-4594-47d7-979b-b67a34c0f806 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:42.052109 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-214185ba-4594-47d7-979b-b67a34c0f806 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:42.355683 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7f23da09-0dac-4ca4-b620-4e984a185423 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:42.368327 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7f23da09-0dac-4ca4-b620-4e984a185423 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1679 microversion: 2.1 time: 0.843842 Sep 10 12:05:42.369699 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2644/5287] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:41 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1679 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:42.805958 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-214185ba-4594-47d7-979b-b67a34c0f806 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:42.814904 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-214185ba-4594-47d7-979b-b67a34c0f806 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1529 microversion: 2.1 time: 0.794543 Sep 10 12:05:42.828942 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2644/5288] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:42 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1529 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:43.417282 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6a9492e9-a67e-439e-887d-04973fde4afa tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:43.419524 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6a9492e9-a67e-439e-887d-04973fde4afa tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:43.430270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6a9492e9-a67e-439e-887d-04973fde4afa tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:43.431112 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6a9492e9-a67e-439e-887d-04973fde4afa tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:43.432036 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6a9492e9-a67e-439e-887d-04973fde4afa tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:43.432983 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6a9492e9-a67e-439e-887d-04973fde4afa tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:43.433662 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6a9492e9-a67e-439e-887d-04973fde4afa tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:43.434321 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6a9492e9-a67e-439e-887d-04973fde4afa tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:43.843050 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fb041b2d-4d53-4f93-929f-0a2bc6414844 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:43.844523 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fb041b2d-4d53-4f93-929f-0a2bc6414844 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:43.865039 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fb041b2d-4d53-4f93-929f-0a2bc6414844 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:43.865887 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fb041b2d-4d53-4f93-929f-0a2bc6414844 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:43.866570 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fb041b2d-4d53-4f93-929f-0a2bc6414844 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:43.867584 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fb041b2d-4d53-4f93-929f-0a2bc6414844 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:43.868264 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fb041b2d-4d53-4f93-929f-0a2bc6414844 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:43.871884 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fb041b2d-4d53-4f93-929f-0a2bc6414844 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:44.724625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6a9492e9-a67e-439e-887d-04973fde4afa tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:44.736190 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6a9492e9-a67e-439e-887d-04973fde4afa tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1679 microversion: 2.1 time: 1.344910 Sep 10 12:05:44.744637 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2645/5289] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:43 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1679 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:44.974485 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fb041b2d-4d53-4f93-929f-0a2bc6414844 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:45.027988 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fb041b2d-4d53-4f93-929f-0a2bc6414844 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1529 microversion: 2.1 time: 1.188906 Sep 10 12:05:45.048795 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2645/5290] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:43 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1529 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:05:45.772788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a0924d56-6f47-4a45-b293-c6dfd2bc488b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:45.773421 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a0924d56-6f47-4a45-b293-c6dfd2bc488b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:45.794158 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a0924d56-6f47-4a45-b293-c6dfd2bc488b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:45.794656 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a0924d56-6f47-4a45-b293-c6dfd2bc488b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:45.808114 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a0924d56-6f47-4a45-b293-c6dfd2bc488b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:45.810840 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a0924d56-6f47-4a45-b293-c6dfd2bc488b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:45.811546 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a0924d56-6f47-4a45-b293-c6dfd2bc488b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:45.812612 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a0924d56-6f47-4a45-b293-c6dfd2bc488b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:46.057027 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-12c6402c-2f63-4ef6-b721-6da0a4989d65 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:46.058529 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-12c6402c-2f63-4ef6-b721-6da0a4989d65 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:46.084688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-12c6402c-2f63-4ef6-b721-6da0a4989d65 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:46.085294 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-12c6402c-2f63-4ef6-b721-6da0a4989d65 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:46.085659 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-12c6402c-2f63-4ef6-b721-6da0a4989d65 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:46.086374 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-12c6402c-2f63-4ef6-b721-6da0a4989d65 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:46.086836 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-12c6402c-2f63-4ef6-b721-6da0a4989d65 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:46.093894 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-12c6402c-2f63-4ef6-b721-6da0a4989d65 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:46.146176 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:05:46.339228 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a0924d56-6f47-4a45-b293-c6dfd2bc488b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:46.355757 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a0924d56-6f47-4a45-b293-c6dfd2bc488b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.583010 Sep 10 12:05:46.356279 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2646/5291] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:45 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:46.457966 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-12c6402c-2f63-4ef6-b721-6da0a4989d65 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:46.467895 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-12c6402c-2f63-4ef6-b721-6da0a4989d65 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1529 microversion: 2.1 time: 0.416543 Sep 10 12:05:46.469187 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2646/5292] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:46 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1529 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:47.497024 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3f3d16de-dbf7-42bf-9d00-cbd4a9a94a80 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:47.499009 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3f3d16de-dbf7-42bf-9d00-cbd4a9a94a80 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:47.515283 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3f3d16de-dbf7-42bf-9d00-cbd4a9a94a80 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:47.517169 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3f3d16de-dbf7-42bf-9d00-cbd4a9a94a80 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:47.517885 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3f3d16de-dbf7-42bf-9d00-cbd4a9a94a80 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:47.520359 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3f3d16de-dbf7-42bf-9d00-cbd4a9a94a80 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:47.522529 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3f3d16de-dbf7-42bf-9d00-cbd4a9a94a80 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:47.523943 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3f3d16de-dbf7-42bf-9d00-cbd4a9a94a80 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:48.123920 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3f3d16de-dbf7-42bf-9d00-cbd4a9a94a80 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:48.133692 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3f3d16de-dbf7-42bf-9d00-cbd4a9a94a80 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1529 microversion: 2.1 time: 0.644017 Sep 10 12:05:48.140202 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2647/5293] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:47 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1529 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:49.164052 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fe7d664e-c0d2-43b9-8e75-b6712b3bd637 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:49.165369 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fe7d664e-c0d2-43b9-8e75-b6712b3bd637 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:49.185260 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fe7d664e-c0d2-43b9-8e75-b6712b3bd637 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:49.193447 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fe7d664e-c0d2-43b9-8e75-b6712b3bd637 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:49.195258 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fe7d664e-c0d2-43b9-8e75-b6712b3bd637 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:49.206758 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fe7d664e-c0d2-43b9-8e75-b6712b3bd637 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:49.207606 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fe7d664e-c0d2-43b9-8e75-b6712b3bd637 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:49.210986 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fe7d664e-c0d2-43b9-8e75-b6712b3bd637 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:49.701661 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fe7d664e-c0d2-43b9-8e75-b6712b3bd637 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:49.715692 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fe7d664e-c0d2-43b9-8e75-b6712b3bd637 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1529 microversion: 2.1 time: 0.555450 Sep 10 12:05:49.724766 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2647/5294] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:49 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1529 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:50.742054 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5cb1a266-2ad4-468c-8a39-462ef2d9ef29 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:50.743404 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5cb1a266-2ad4-468c-8a39-462ef2d9ef29 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:50.757426 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5cb1a266-2ad4-468c-8a39-462ef2d9ef29 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:50.758177 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5cb1a266-2ad4-468c-8a39-462ef2d9ef29 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:50.760584 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5cb1a266-2ad4-468c-8a39-462ef2d9ef29 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:50.761851 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5cb1a266-2ad4-468c-8a39-462ef2d9ef29 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:50.762473 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5cb1a266-2ad4-468c-8a39-462ef2d9ef29 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:50.764057 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5cb1a266-2ad4-468c-8a39-462ef2d9ef29 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:51.155908 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5cb1a266-2ad4-468c-8a39-462ef2d9ef29 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:51.167137 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5cb1a266-2ad4-468c-8a39-462ef2d9ef29 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1529 microversion: 2.1 time: 0.428834 Sep 10 12:05:51.170249 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2648/5295] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:50 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1529 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:52.196312 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a1e727ad-853b-430c-ba81-7b652a711e32 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:52.198852 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a1e727ad-853b-430c-ba81-7b652a711e32 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:52.217398 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a1e727ad-853b-430c-ba81-7b652a711e32 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:52.222659 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a1e727ad-853b-430c-ba81-7b652a711e32 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:52.223612 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a1e727ad-853b-430c-ba81-7b652a711e32 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:52.225267 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a1e727ad-853b-430c-ba81-7b652a711e32 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:52.230994 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a1e727ad-853b-430c-ba81-7b652a711e32 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:52.232875 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a1e727ad-853b-430c-ba81-7b652a711e32 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:52.787363 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a1e727ad-853b-430c-ba81-7b652a711e32 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:52.831193 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a1e727ad-853b-430c-ba81-7b652a711e32 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1511 microversion: 2.1 time: 0.641711 Sep 10 12:05:52.858369 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2648/5296] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:52 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1511 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:53.862219 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c6106d6b-5872-493d-a8d7-b10cd162bd1b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:53.863939 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c6106d6b-5872-493d-a8d7-b10cd162bd1b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:53.865728 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=58 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:05:53.886863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c6106d6b-5872-493d-a8d7-b10cd162bd1b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:53.889021 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c6106d6b-5872-493d-a8d7-b10cd162bd1b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:53.889678 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c6106d6b-5872-493d-a8d7-b10cd162bd1b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:53.890587 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c6106d6b-5872-493d-a8d7-b10cd162bd1b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:53.897181 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c6106d6b-5872-493d-a8d7-b10cd162bd1b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:53.897809 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c6106d6b-5872-493d-a8d7-b10cd162bd1b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:55.650871 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c6106d6b-5872-493d-a8d7-b10cd162bd1b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:55.666796 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c6106d6b-5872-493d-a8d7-b10cd162bd1b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1511 microversion: 2.1 time: 1.803810 Sep 10 12:05:55.686938 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2649/5297] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:53 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1511 bytes in 1830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:56.694498 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3b3af2d4-29ca-466d-a591-c47af03cbde4 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:56.695739 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3b3af2d4-29ca-466d-a591-c47af03cbde4 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:56.723231 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3b3af2d4-29ca-466d-a591-c47af03cbde4 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:56.727922 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3b3af2d4-29ca-466d-a591-c47af03cbde4 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:56.730589 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3b3af2d4-29ca-466d-a591-c47af03cbde4 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:56.732093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3b3af2d4-29ca-466d-a591-c47af03cbde4 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:56.734275 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3b3af2d4-29ca-466d-a591-c47af03cbde4 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:56.738109 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3b3af2d4-29ca-466d-a591-c47af03cbde4 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:58.221201 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3b3af2d4-29ca-466d-a591-c47af03cbde4 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:58.231779 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3b3af2d4-29ca-466d-a591-c47af03cbde4 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1511 microversion: 2.1 time: 1.541554 Sep 10 12:05:58.245199 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2649/5298] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:56 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1511 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:59.033867 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-7aa0816e-291c-4dd2-b578-858507e257b7 req-5cfedfdf-d0d0-4016-b324-cea42006585d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac1538e5-6edc-4ccb-b7a9-c2e90284e004", "name": "network-vif-unplugged", "status": "completed", "tag": "264e21dc-6813-4623-838f-df7e536eeb78"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:05:59.056887 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-7aa0816e-291c-4dd2-b578-858507e257b7 req-5cfedfdf-d0d0-4016-b324-cea42006585d service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:59.057405 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-7aa0816e-291c-4dd2-b578-858507e257b7 req-5cfedfdf-d0d0-4016-b324-cea42006585d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:59.057853 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-7aa0816e-291c-4dd2-b578-858507e257b7 req-5cfedfdf-d0d0-4016-b324-cea42006585d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:59.085844 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.compute.server_external_events [req-7aa0816e-291c-4dd2-b578-858507e257b7 req-5cfedfdf-d0d0-4016-b324-cea42006585d service nova] Unable to find a host for instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004. Dropping event network-vif-unplugged {{(pid=128776) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 10 12:05:59.092707 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-7aa0816e-291c-4dd2-b578-858507e257b7 req-5cfedfdf-d0d0-4016-b324-cea42006585d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.057560 Sep 10 12:05:59.099109 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2650/5299] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 70 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 10 12:05:59.291256 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-88efad62-e1cb-4247-82d0-c43da5360144 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:59.292468 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-88efad62-e1cb-4247-82d0-c43da5360144 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:59.296069 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:05:59.320116 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-88efad62-e1cb-4247-82d0-c43da5360144 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:59.322077 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-88efad62-e1cb-4247-82d0-c43da5360144 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:59.322691 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-88efad62-e1cb-4247-82d0-c43da5360144 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:59.326200 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-88efad62-e1cb-4247-82d0-c43da5360144 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:59.326880 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-88efad62-e1cb-4247-82d0-c43da5360144 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:59.327524 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-88efad62-e1cb-4247-82d0-c43da5360144 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:59.721902 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-88efad62-e1cb-4247-82d0-c43da5360144 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:05:59.753234 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-88efad62-e1cb-4247-82d0-c43da5360144 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1454 microversion: 2.1 time: 0.464561 Sep 10 12:05:59.755520 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2650/5300] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:59 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1454 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:05:59.785877 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7af28a07-1c4e-4676-80e7-06fac166c5e6 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:05:59.786422 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7af28a07-1c4e-4676-80e7-06fac166c5e6 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:05:59.799185 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7af28a07-1c4e-4676-80e7-06fac166c5e6 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:59.799701 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7af28a07-1c4e-4676-80e7-06fac166c5e6 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:59.800150 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7af28a07-1c4e-4676-80e7-06fac166c5e6 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:59.800877 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7af28a07-1c4e-4676-80e7-06fac166c5e6 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:05:59.801333 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7af28a07-1c4e-4676-80e7-06fac166c5e6 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:05:59.815289 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7af28a07-1c4e-4676-80e7-06fac166c5e6 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:05:59.827400 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:06:00.426713 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7af28a07-1c4e-4676-80e7-06fac166c5e6 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:00.438870 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7af28a07-1c4e-4676-80e7-06fac166c5e6 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1454 microversion: 2.1 time: 0.656864 Sep 10 12:06:00.467962 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2651/5301] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:05:59 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1454 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:00.546988 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b2d89e51-8aca-4499-b100-776279635cb0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:06:00.548548 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b2d89e51-8aca-4499-b100-776279635cb0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:00.577925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b2d89e51-8aca-4499-b100-776279635cb0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:00.578608 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b2d89e51-8aca-4499-b100-776279635cb0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:00.583580 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b2d89e51-8aca-4499-b100-776279635cb0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:00.585580 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b2d89e51-8aca-4499-b100-776279635cb0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:00.588411 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b2d89e51-8aca-4499-b100-776279635cb0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:00.594743 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b2d89e51-8aca-4499-b100-776279635cb0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:00.682234 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-b2d89e51-8aca-4499-b100-776279635cb0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lazy-loading 'flavor' on Instance uuid ac1538e5-6edc-4ccb-b7a9-c2e90284e004 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:06:00.730101 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-b2d89e51-8aca-4499-b100-776279635cb0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] HTTP exception thrown: Cannot 'shelve' instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 while it is in vm_state shelved_offloaded Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b2d89e51-8aca-4499-b100-776279635cb0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004/action HTTP/1.1 Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 14 Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: {"shelve": {}} Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: exception: Cannot 'shelve' instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 while it is in vm_state shelved_offloaded Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'ac1538e5-6edc-4ccb-b7a9-c2e90284e004', 'body': {'shelve': {}}} Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 10 12:06:00.736833 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 12:06:00.741171 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 12:06:00.741171 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 while it is in vm_state shelved_offloaded Sep 10 12:06:00.741171 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:06:00.741171 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:06:00.741171 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:06:00.741171 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:00.741171 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:06:00.741171 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:06:00.741171 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:06:00.741171 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:06:00.741171 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 while it is in vm_state shelved_offloaded Sep 10 12:06:00.741171 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:06:00.741171 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b2d89e51-8aca-4499-b100-776279635cb0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 409 to user: Cannot 'shelve' instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 while it is in vm_state shelved_offloaded {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:06:00.746593 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b2d89e51-8aca-4499-b100-776279635cb0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "POST /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004/action" status: 409 len: 155 microversion: 2.1 time: 0.205100 Sep 10 12:06:00.748001 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2651/5302] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:06:00 2022] POST /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004/action => generated 155 bytes in 207 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 12:06:00.757083 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-10afea2d-9ece-4f14-b4ef-8c3680b87ff8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:06:00.757714 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-10afea2d-9ece-4f14-b4ef-8c3680b87ff8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:00.776043 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10afea2d-9ece-4f14-b4ef-8c3680b87ff8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:00.776726 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10afea2d-9ece-4f14-b4ef-8c3680b87ff8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:00.777184 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10afea2d-9ece-4f14-b4ef-8c3680b87ff8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:00.777936 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10afea2d-9ece-4f14-b4ef-8c3680b87ff8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:00.778397 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10afea2d-9ece-4f14-b4ef-8c3680b87ff8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:00.778826 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10afea2d-9ece-4f14-b4ef-8c3680b87ff8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:00.896487 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-10afea2d-9ece-4f14-b4ef-8c3680b87ff8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128776) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 10 12:06:01.147571 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-10afea2d-9ece-4f14-b4ef-8c3680b87ff8 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "POST /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004/action" status: 202 len: 0 microversion: 2.1 time: 0.395320 Sep 10 12:06:01.157005 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cff5d208-ab2b-471f-959f-90837d635960 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:01.159312 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cff5d208-ab2b-471f-959f-90837d635960 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:01.164377 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2652/5303] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:06:00 2022] POST /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004/action => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:06:01.168717 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cff5d208-ab2b-471f-959f-90837d635960 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:01.171807 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cff5d208-ab2b-471f-959f-90837d635960 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:01.172474 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cff5d208-ab2b-471f-959f-90837d635960 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:01.173373 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cff5d208-ab2b-471f-959f-90837d635960 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:01.175393 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cff5d208-ab2b-471f-959f-90837d635960 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:01.177780 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cff5d208-ab2b-471f-959f-90837d635960 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:01.517237 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cff5d208-ab2b-471f-959f-90837d635960 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:01.533671 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cff5d208-ab2b-471f-959f-90837d635960 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1462 microversion: 2.1 time: 0.379541 Sep 10 12:06:01.534307 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2652/5304] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:01 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1462 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:01.685840 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7828c02e-3211-40f2-a929-26402f2c7eaa tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1039891228", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "9b7d241e-3628-4ae1-a998-486bc078ad6f"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:06:01.800762 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-7828c02e-3211-40f2-a929-26402f2c7eaa tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] validate_networks() for [('9b7d241e-3628-4ae1-a998-486bc078ad6f', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:06:02.562146 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-33d4c2e4-b217-4257-b6fa-836b3a500029 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:02.562775 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-33d4c2e4-b217-4257-b6fa-836b3a500029 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:02.577588 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-33d4c2e4-b217-4257-b6fa-836b3a500029 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:02.578474 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-33d4c2e4-b217-4257-b6fa-836b3a500029 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:02.579105 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-33d4c2e4-b217-4257-b6fa-836b3a500029 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:02.580137 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-33d4c2e4-b217-4257-b6fa-836b3a500029 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:02.582138 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-33d4c2e4-b217-4257-b6fa-836b3a500029 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:02.582827 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-33d4c2e4-b217-4257-b6fa-836b3a500029 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:02.653085 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-7828c02e-3211-40f2-a929-26402f2c7eaa tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:06:02.654345 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-7828c02e-3211-40f2-a929-26402f2c7eaa tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:06:02.655199 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-7828c02e-3211-40f2-a929-26402f2c7eaa tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:06:02.656088 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-7828c02e-3211-40f2-a929-26402f2c7eaa tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:06:02.656510 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-7828c02e-3211-40f2-a929-26402f2c7eaa tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:06:02.673193 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7828c02e-3211-40f2-a929-26402f2c7eaa tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:02.673680 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7828c02e-3211-40f2-a929-26402f2c7eaa tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:02.674117 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7828c02e-3211-40f2-a929-26402f2c7eaa tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:02.674847 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7828c02e-3211-40f2-a929-26402f2c7eaa tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:02.675341 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7828c02e-3211-40f2-a929-26402f2c7eaa tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:02.675769 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7828c02e-3211-40f2-a929-26402f2c7eaa tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:02.728900 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-7828c02e-3211-40f2-a929-26402f2c7eaa tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Getting quotas for project 19fe115abe204e118121c15906b8d0b8. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:06:02.735660 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-7828c02e-3211-40f2-a929-26402f2c7eaa tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Getting quotas for user 8ac233e966c54c8c86e5dd3a4745d57b and project 19fe115abe204e118121c15906b8d0b8. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:06:02.776647 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7828c02e-3211-40f2-a929-26402f2c7eaa tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:06:02.781274 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7828c02e-3211-40f2-a929-26402f2c7eaa tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] [instance: 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:06:02.900258 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7828c02e-3211-40f2-a929-26402f2c7eaa tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.427276 Sep 10 12:06:02.905266 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-33d4c2e4-b217-4257-b6fa-836b3a500029 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:02.909675 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2653/5305] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:06:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1442 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 12:06:02.922829 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4b151d16-0119-4b7b-b5c2-f8b6687933cd tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:02.923995 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-33d4c2e4-b217-4257-b6fa-836b3a500029 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1462 microversion: 2.1 time: 0.361659 Sep 10 12:06:02.925164 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4b151d16-0119-4b7b-b5c2-f8b6687933cd tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] [instance: 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:02.926867 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2653/5306] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:02 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1462 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:06:03.043056 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4b151d16-0119-4b7b-b5c2-f8b6687933cd tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac233e966c54c8c86e5dd3a4745d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fe115abe204e118121c15906b8d0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:03.052311 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4b151d16-0119-4b7b-b5c2-f8b6687933cd tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] 10.222.0.23 "GET /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069" status: 200 len: 1228 microversion: 2.1 time: 0.140775 Sep 10 12:06:03.068463 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2654/5307] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:02 2022] GET /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 => generated 1228 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:03.950739 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c783d470-ba65-470c-b0d6-fee0b012a770 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:03.951393 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c783d470-ba65-470c-b0d6-fee0b012a770 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:03.965978 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c783d470-ba65-470c-b0d6-fee0b012a770 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:03.967445 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c783d470-ba65-470c-b0d6-fee0b012a770 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:03.969149 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c783d470-ba65-470c-b0d6-fee0b012a770 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:03.970150 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c783d470-ba65-470c-b0d6-fee0b012a770 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:03.972415 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c783d470-ba65-470c-b0d6-fee0b012a770 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:03.973960 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c783d470-ba65-470c-b0d6-fee0b012a770 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:04.075896 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3452166e-d16c-49c9-b45c-2c7735b8042a tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:04.076547 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3452166e-d16c-49c9-b45c-2c7735b8042a tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] [instance: 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:04.093332 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3452166e-d16c-49c9-b45c-2c7735b8042a tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:04.094136 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3452166e-d16c-49c9-b45c-2c7735b8042a tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:04.094883 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3452166e-d16c-49c9-b45c-2c7735b8042a tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:04.097574 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3452166e-d16c-49c9-b45c-2c7735b8042a tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:04.098223 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3452166e-d16c-49c9-b45c-2c7735b8042a tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:04.103350 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3452166e-d16c-49c9-b45c-2c7735b8042a tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:04.286480 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3452166e-d16c-49c9-b45c-2c7735b8042a tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac233e966c54c8c86e5dd3a4745d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fe115abe204e118121c15906b8d0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:04.290007 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c783d470-ba65-470c-b0d6-fee0b012a770 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:04.301693 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c783d470-ba65-470c-b0d6-fee0b012a770 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1464 microversion: 2.1 time: 0.355166 Sep 10 12:06:04.302981 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2654/5308] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:03 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1464 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:04.320816 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3452166e-d16c-49c9-b45c-2c7735b8042a tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] 10.222.0.23 "GET /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069" status: 200 len: 1232 microversion: 2.1 time: 0.247777 Sep 10 12:06:04.323958 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2655/5309] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:04 2022] GET /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 => generated 1232 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:05.329086 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b6d0a2b9-6890-46ee-83a7-873dc2e607ec tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:05.329949 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b6d0a2b9-6890-46ee-83a7-873dc2e607ec tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:05.347503 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b6d0a2b9-6890-46ee-83a7-873dc2e607ec tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:05.351255 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-190eeb93-8692-463f-b43d-116346c5f4c7 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:05.351838 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-190eeb93-8692-463f-b43d-116346c5f4c7 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] [instance: 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:05.352301 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b6d0a2b9-6890-46ee-83a7-873dc2e607ec tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:05.353008 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b6d0a2b9-6890-46ee-83a7-873dc2e607ec tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:05.353937 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b6d0a2b9-6890-46ee-83a7-873dc2e607ec tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:05.354580 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b6d0a2b9-6890-46ee-83a7-873dc2e607ec tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:05.356237 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b6d0a2b9-6890-46ee-83a7-873dc2e607ec tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:05.369444 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-190eeb93-8692-463f-b43d-116346c5f4c7 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:05.369925 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-190eeb93-8692-463f-b43d-116346c5f4c7 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:05.370373 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-190eeb93-8692-463f-b43d-116346c5f4c7 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:05.389713 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-190eeb93-8692-463f-b43d-116346c5f4c7 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:05.390236 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-190eeb93-8692-463f-b43d-116346c5f4c7 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:05.390688 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-190eeb93-8692-463f-b43d-116346c5f4c7 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:05.804415 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-190eeb93-8692-463f-b43d-116346c5f4c7 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac233e966c54c8c86e5dd3a4745d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fe115abe204e118121c15906b8d0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:05.834571 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-190eeb93-8692-463f-b43d-116346c5f4c7 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] 10.222.0.23 "GET /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069" status: 200 len: 1280 microversion: 2.1 time: 0.488918 Sep 10 12:06:05.836862 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2656/5310] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:05 2022] GET /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 => generated 1280 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:06:06.170333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b6d0a2b9-6890-46ee-83a7-873dc2e607ec tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:06.188180 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b6d0a2b9-6890-46ee-83a7-873dc2e607ec tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1520 microversion: 2.1 time: 0.864596 Sep 10 12:06:06.190161 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2655/5311] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:05 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1520 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:06.868897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-329dda02-d982-4ce7-93e0-5cf1b77bff8a tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:06.870199 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-329dda02-d982-4ce7-93e0-5cf1b77bff8a tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] [instance: 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:06.891933 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-329dda02-d982-4ce7-93e0-5cf1b77bff8a tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:06.893005 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-329dda02-d982-4ce7-93e0-5cf1b77bff8a tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:06.894855 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-329dda02-d982-4ce7-93e0-5cf1b77bff8a tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:06.896823 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-329dda02-d982-4ce7-93e0-5cf1b77bff8a tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:06.898526 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-329dda02-d982-4ce7-93e0-5cf1b77bff8a tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:06.901807 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-329dda02-d982-4ce7-93e0-5cf1b77bff8a tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:07.504865 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-329dda02-d982-4ce7-93e0-5cf1b77bff8a tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac233e966c54c8c86e5dd3a4745d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fe115abe204e118121c15906b8d0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:07.521164 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-329dda02-d982-4ce7-93e0-5cf1b77bff8a tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] 10.222.0.23 "GET /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069" status: 200 len: 1286 microversion: 2.1 time: 0.653978 Sep 10 12:06:07.535884 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2657/5312] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:06 2022] GET /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 => generated 1286 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:07.547647 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a95958f5-5ff4-4f33-a4f2-93152fc46266 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:07.548781 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a95958f5-5ff4-4f33-a4f2-93152fc46266 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:07.578382 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a95958f5-5ff4-4f33-a4f2-93152fc46266 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:07.579546 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a95958f5-5ff4-4f33-a4f2-93152fc46266 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:07.580207 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a95958f5-5ff4-4f33-a4f2-93152fc46266 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:07.586245 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a95958f5-5ff4-4f33-a4f2-93152fc46266 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:07.587617 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a95958f5-5ff4-4f33-a4f2-93152fc46266 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:07.596437 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a95958f5-5ff4-4f33-a4f2-93152fc46266 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:07.692800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-16243d3e-070f-4a7a-a650-fcb4ee6c06c0 req-3bc96825-b2a7-492c-af0f-588a0a9b95ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac1538e5-6edc-4ccb-b7a9-c2e90284e004", "tag": "264e21dc-6813-4623-838f-df7e536eeb78"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:06:07.742082 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-16243d3e-070f-4a7a-a650-fcb4ee6c06c0 req-3bc96825-b2a7-492c-af0f-588a0a9b95ef service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:07.749618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-16243d3e-070f-4a7a-a650-fcb4ee6c06c0 req-3bc96825-b2a7-492c-af0f-588a0a9b95ef service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:07.753391 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-16243d3e-070f-4a7a-a650-fcb4ee6c06c0 req-3bc96825-b2a7-492c-af0f-588a0a9b95ef service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:07.800580 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-16243d3e-070f-4a7a-a650-fcb4ee6c06c0 req-3bc96825-b2a7-492c-af0f-588a0a9b95ef service nova] Creating event network-changed:264e21dc-6813-4623-838f-df7e536eeb78 for instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 on n-h2-856895-1 Sep 10 12:06:07.811655 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-16243d3e-070f-4a7a-a650-fcb4ee6c06c0 req-3bc96825-b2a7-492c-af0f-588a0a9b95ef service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.809631 Sep 10 12:06:07.818873 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2656/5313] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:06:07.982683 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a95958f5-5ff4-4f33-a4f2-93152fc46266 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:08.007006 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a95958f5-5ff4-4f33-a4f2-93152fc46266 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1520 microversion: 2.1 time: 0.467015 Sep 10 12:06:08.009248 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2658/5314] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:07 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1520 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:08.566169 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a109ee80-99b8-45cc-9f1e-758fcaa4c126 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:08.567411 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a109ee80-99b8-45cc-9f1e-758fcaa4c126 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] [instance: 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:08.578693 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a109ee80-99b8-45cc-9f1e-758fcaa4c126 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:08.579631 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a109ee80-99b8-45cc-9f1e-758fcaa4c126 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:08.580331 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a109ee80-99b8-45cc-9f1e-758fcaa4c126 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:08.581830 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a109ee80-99b8-45cc-9f1e-758fcaa4c126 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:08.583181 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a109ee80-99b8-45cc-9f1e-758fcaa4c126 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:08.583845 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a109ee80-99b8-45cc-9f1e-758fcaa4c126 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:08.937655 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a109ee80-99b8-45cc-9f1e-758fcaa4c126 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac233e966c54c8c86e5dd3a4745d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fe115abe204e118121c15906b8d0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:08.964375 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a109ee80-99b8-45cc-9f1e-758fcaa4c126 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] 10.222.0.23 "GET /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069" status: 200 len: 1286 microversion: 2.1 time: 0.399600 Sep 10 12:06:08.970576 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2657/5315] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:08 2022] GET /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 => generated 1286 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:09.033104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-40bce6ef-824b-4d65-a44f-1c31854ad62e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:09.035772 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-40bce6ef-824b-4d65-a44f-1c31854ad62e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:09.054190 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-40bce6ef-824b-4d65-a44f-1c31854ad62e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:09.054912 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-40bce6ef-824b-4d65-a44f-1c31854ad62e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:09.056523 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-40bce6ef-824b-4d65-a44f-1c31854ad62e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:09.057700 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-40bce6ef-824b-4d65-a44f-1c31854ad62e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:09.058617 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-40bce6ef-824b-4d65-a44f-1c31854ad62e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:09.059651 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-40bce6ef-824b-4d65-a44f-1c31854ad62e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:09.732427 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-40bce6ef-824b-4d65-a44f-1c31854ad62e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:09.753984 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-40bce6ef-824b-4d65-a44f-1c31854ad62e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1520 microversion: 2.1 time: 0.726709 Sep 10 12:06:09.759392 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2659/5316] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:09 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1520 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:09.997039 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bc1008f0-dd7e-49bb-9550-74ccd6885b9d tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:09.998032 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bc1008f0-dd7e-49bb-9550-74ccd6885b9d tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] [instance: 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:10.031455 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bc1008f0-dd7e-49bb-9550-74ccd6885b9d tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:10.037997 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bc1008f0-dd7e-49bb-9550-74ccd6885b9d tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:10.041355 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bc1008f0-dd7e-49bb-9550-74ccd6885b9d tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:10.044994 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bc1008f0-dd7e-49bb-9550-74ccd6885b9d tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:10.048148 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bc1008f0-dd7e-49bb-9550-74ccd6885b9d tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:10.053961 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bc1008f0-dd7e-49bb-9550-74ccd6885b9d tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:10.575225 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bc1008f0-dd7e-49bb-9550-74ccd6885b9d tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac233e966c54c8c86e5dd3a4745d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fe115abe204e118121c15906b8d0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:10.593356 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bc1008f0-dd7e-49bb-9550-74ccd6885b9d tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] 10.222.0.23 "GET /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069" status: 200 len: 1328 microversion: 2.1 time: 0.602082 Sep 10 12:06:10.600164 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2658/5317] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:09 2022] GET /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 => generated 1328 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:10.786916 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d1d3783e-1123-4c46-bdb1-75a8cf4340f7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:10.787571 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d1d3783e-1123-4c46-bdb1-75a8cf4340f7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:10.802278 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d1d3783e-1123-4c46-bdb1-75a8cf4340f7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:10.808553 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d1d3783e-1123-4c46-bdb1-75a8cf4340f7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:10.809037 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d1d3783e-1123-4c46-bdb1-75a8cf4340f7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:10.809794 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d1d3783e-1123-4c46-bdb1-75a8cf4340f7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:10.810260 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d1d3783e-1123-4c46-bdb1-75a8cf4340f7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:10.810693 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d1d3783e-1123-4c46-bdb1-75a8cf4340f7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:11.307792 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d1d3783e-1123-4c46-bdb1-75a8cf4340f7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:11.317028 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d1d3783e-1123-4c46-bdb1-75a8cf4340f7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1520 microversion: 2.1 time: 0.535766 Sep 10 12:06:11.321506 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2660/5318] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:10 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1520 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:11.627852 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a8ec8908-dcf2-44fe-b959-da37fbbcc4aa tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:11.629485 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a8ec8908-dcf2-44fe-b959-da37fbbcc4aa tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] [instance: 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:11.658817 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a8ec8908-dcf2-44fe-b959-da37fbbcc4aa tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:11.661794 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a8ec8908-dcf2-44fe-b959-da37fbbcc4aa tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:11.663219 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a8ec8908-dcf2-44fe-b959-da37fbbcc4aa tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:11.667056 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a8ec8908-dcf2-44fe-b959-da37fbbcc4aa tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:11.670613 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a8ec8908-dcf2-44fe-b959-da37fbbcc4aa tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:11.673247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a8ec8908-dcf2-44fe-b959-da37fbbcc4aa tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:12.348841 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-820100de-129e-43e7-8b3e-3f99d1dacb07 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:12.349459 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-820100de-129e-43e7-8b3e-3f99d1dacb07 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:12.377776 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-820100de-129e-43e7-8b3e-3f99d1dacb07 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:12.378303 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-820100de-129e-43e7-8b3e-3f99d1dacb07 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:12.378749 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-820100de-129e-43e7-8b3e-3f99d1dacb07 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:12.388442 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-820100de-129e-43e7-8b3e-3f99d1dacb07 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:12.389040 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-820100de-129e-43e7-8b3e-3f99d1dacb07 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:12.389493 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-820100de-129e-43e7-8b3e-3f99d1dacb07 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:12.671413 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a8ec8908-dcf2-44fe-b959-da37fbbcc4aa tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac233e966c54c8c86e5dd3a4745d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fe115abe204e118121c15906b8d0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:12.680959 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a8ec8908-dcf2-44fe-b959-da37fbbcc4aa tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] 10.222.0.23 "GET /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069" status: 200 len: 1328 microversion: 2.1 time: 1.060304 Sep 10 12:06:12.681562 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2659/5319] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:11 2022] GET /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 => generated 1328 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:06:12.695392 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:06:12.771101 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-820100de-129e-43e7-8b3e-3f99d1dacb07 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:12.783715 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-820100de-129e-43e7-8b3e-3f99d1dacb07 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1520 microversion: 2.1 time: 0.438774 Sep 10 12:06:12.795584 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2661/5320] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:12 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1520 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:13.563593 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-72466d64-4fbe-46bb-b31c-e0bc9f0329aa req-78c99e3e-b4b5-4790-b50b-c90553bc3499 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a1e2b4c-7f7f-4556-913a-fac2f3ac5069", "tag": "c1c99cac-0c16-4dd5-b655-9f22bed8b7c3"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:06:13.582627 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-72466d64-4fbe-46bb-b31c-e0bc9f0329aa req-78c99e3e-b4b5-4790-b50b-c90553bc3499 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:13.585804 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-72466d64-4fbe-46bb-b31c-e0bc9f0329aa req-78c99e3e-b4b5-4790-b50b-c90553bc3499 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:13.589290 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-72466d64-4fbe-46bb-b31c-e0bc9f0329aa req-78c99e3e-b4b5-4790-b50b-c90553bc3499 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:13.622185 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-72466d64-4fbe-46bb-b31c-e0bc9f0329aa req-78c99e3e-b4b5-4790-b50b-c90553bc3499 service nova] Creating event network-changed:c1c99cac-0c16-4dd5-b655-9f22bed8b7c3 for instance 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 on n-h2-856895-1 Sep 10 12:06:13.634387 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-72466d64-4fbe-46bb-b31c-e0bc9f0329aa req-78c99e3e-b4b5-4790-b50b-c90553bc3499 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075240 Sep 10 12:06:13.638295 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2660/5321] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:06:13.710177 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4fdb345b-68fd-4c05-a74e-326cb39f009e tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:13.712298 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4fdb345b-68fd-4c05-a74e-326cb39f009e tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] [instance: 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:13.727736 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=8 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:06:13.733402 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fdb345b-68fd-4c05-a74e-326cb39f009e tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:13.737645 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fdb345b-68fd-4c05-a74e-326cb39f009e tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:13.740811 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fdb345b-68fd-4c05-a74e-326cb39f009e tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:13.742324 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fdb345b-68fd-4c05-a74e-326cb39f009e tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:13.747349 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fdb345b-68fd-4c05-a74e-326cb39f009e tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:13.748930 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fdb345b-68fd-4c05-a74e-326cb39f009e tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:13.811901 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2d1b0d31-9686-4acb-a3aa-a164085af821 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:13.812837 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2d1b0d31-9686-4acb-a3aa-a164085af821 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:13.841346 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2d1b0d31-9686-4acb-a3aa-a164085af821 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:13.842222 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2d1b0d31-9686-4acb-a3aa-a164085af821 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:13.843408 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2d1b0d31-9686-4acb-a3aa-a164085af821 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:13.854159 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2d1b0d31-9686-4acb-a3aa-a164085af821 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:13.854639 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2d1b0d31-9686-4acb-a3aa-a164085af821 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:13.861168 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2d1b0d31-9686-4acb-a3aa-a164085af821 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:14.715354 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4fdb345b-68fd-4c05-a74e-326cb39f009e tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac233e966c54c8c86e5dd3a4745d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fe115abe204e118121c15906b8d0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:14.724157 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4fdb345b-68fd-4c05-a74e-326cb39f009e tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] 10.222.0.23 "GET /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069" status: 200 len: 1328 microversion: 2.1 time: 1.020461 Sep 10 12:06:14.724765 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2662/5322] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:13 2022] GET /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 => generated 1328 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:14.739361 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2d1b0d31-9686-4acb-a3aa-a164085af821 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:14.748071 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2d1b0d31-9686-4acb-a3aa-a164085af821 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1520 microversion: 2.1 time: 0.941824 Sep 10 12:06:14.749229 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2661/5323] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:13 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1520 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:15.751186 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cbf8b2e0-2bc5-4719-9227-8d99161e23d1 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:15.752906 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cbf8b2e0-2bc5-4719-9227-8d99161e23d1 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] [instance: 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:15.761672 n-d-856895-1 devstack@n-api.service[128776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 12:06:15.762201 n-d-856895-1 devstack@n-api.service[128776]: Sat Sep 10 12:06:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 (ip 10.222.0.23) !!! Sep 10 12:06:15.766336 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cbf8b2e0-2bc5-4719-9227-8d99161e23d1 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:15.767056 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cbf8b2e0-2bc5-4719-9227-8d99161e23d1 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:15.767705 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cbf8b2e0-2bc5-4719-9227-8d99161e23d1 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:15.769324 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cbf8b2e0-2bc5-4719-9227-8d99161e23d1 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:15.769933 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cbf8b2e0-2bc5-4719-9227-8d99161e23d1 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:15.770516 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cbf8b2e0-2bc5-4719-9227-8d99161e23d1 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:15.778187 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-75413636-76a3-4ce2-ac9d-2a8f324f9a1d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:15.779452 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-75413636-76a3-4ce2-ac9d-2a8f324f9a1d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:15.797994 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-75413636-76a3-4ce2-ac9d-2a8f324f9a1d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:15.801415 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-75413636-76a3-4ce2-ac9d-2a8f324f9a1d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:15.802054 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-75413636-76a3-4ce2-ac9d-2a8f324f9a1d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:15.807110 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-75413636-76a3-4ce2-ac9d-2a8f324f9a1d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:15.807918 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-75413636-76a3-4ce2-ac9d-2a8f324f9a1d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:15.809154 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-75413636-76a3-4ce2-ac9d-2a8f324f9a1d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:16.419379 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-cbf8b2e0-2bc5-4719-9227-8d99161e23d1 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac233e966c54c8c86e5dd3a4745d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fe115abe204e118121c15906b8d0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:16.435980 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cbf8b2e0-2bc5-4719-9227-8d99161e23d1 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] 10.222.0.23 "GET /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069" status: 200 len: 1328 microversion: 2.1 time: 0.689933 Sep 10 12:06:16.436432 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-75413636-76a3-4ce2-ac9d-2a8f324f9a1d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:16.440082 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=92 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:06:16.441124 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2663/5324] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:15 2022] GET /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 => generated 1328 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:16.472713 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-75413636-76a3-4ce2-ac9d-2a8f324f9a1d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1520 microversion: 2.1 time: 0.700361 Sep 10 12:06:16.474754 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2662/5325] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:15 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1520 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:17.469875 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f4856c69-f052-4fed-a2f8-6cafb52b13a9 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:17.470522 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f4856c69-f052-4fed-a2f8-6cafb52b13a9 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] [instance: 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:17.482519 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4856c69-f052-4fed-a2f8-6cafb52b13a9 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:17.484520 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4856c69-f052-4fed-a2f8-6cafb52b13a9 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:17.485030 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4856c69-f052-4fed-a2f8-6cafb52b13a9 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:17.485774 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4856c69-f052-4fed-a2f8-6cafb52b13a9 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:17.486235 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4856c69-f052-4fed-a2f8-6cafb52b13a9 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:17.486661 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4856c69-f052-4fed-a2f8-6cafb52b13a9 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:17.503670 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-54123d26-707a-4d1e-94c7-f4ff07803b00 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:17.504852 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-54123d26-707a-4d1e-94c7-f4ff07803b00 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:17.520691 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54123d26-707a-4d1e-94c7-f4ff07803b00 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:17.521521 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54123d26-707a-4d1e-94c7-f4ff07803b00 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:17.522181 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54123d26-707a-4d1e-94c7-f4ff07803b00 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:17.523062 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54123d26-707a-4d1e-94c7-f4ff07803b00 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:17.523722 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54123d26-707a-4d1e-94c7-f4ff07803b00 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:17.526839 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54123d26-707a-4d1e-94c7-f4ff07803b00 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:18.478463 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-54123d26-707a-4d1e-94c7-f4ff07803b00 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:18.488024 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f4856c69-f052-4fed-a2f8-6cafb52b13a9 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac233e966c54c8c86e5dd3a4745d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fe115abe204e118121c15906b8d0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:18.496432 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-54123d26-707a-4d1e-94c7-f4ff07803b00 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1520 microversion: 2.1 time: 0.992499 Sep 10 12:06:18.507493 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2663/5326] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:17 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1520 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:18.508041 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f4856c69-f052-4fed-a2f8-6cafb52b13a9 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] 10.222.0.23 "GET /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069" status: 200 len: 1328 microversion: 2.1 time: 1.037578 Sep 10 12:06:18.508041 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2664/5327] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:17 2022] GET /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 => generated 1328 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:19.532368 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9adbba5c-c318-4102-9661-f132fc21bed2 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:19.532927 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-102d683d-ea72-4e47-8e91-4291f0ec6793 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:19.534262 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-102d683d-ea72-4e47-8e91-4291f0ec6793 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] [instance: 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:19.534839 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9adbba5c-c318-4102-9661-f132fc21bed2 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:19.553982 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9adbba5c-c318-4102-9661-f132fc21bed2 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:19.554509 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9adbba5c-c318-4102-9661-f132fc21bed2 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:19.554958 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9adbba5c-c318-4102-9661-f132fc21bed2 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:19.555325 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-102d683d-ea72-4e47-8e91-4291f0ec6793 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:19.556470 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-102d683d-ea72-4e47-8e91-4291f0ec6793 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:19.558026 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-102d683d-ea72-4e47-8e91-4291f0ec6793 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:19.558996 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9adbba5c-c318-4102-9661-f132fc21bed2 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:19.559934 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-102d683d-ea72-4e47-8e91-4291f0ec6793 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:19.560943 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-102d683d-ea72-4e47-8e91-4291f0ec6793 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:19.569604 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9adbba5c-c318-4102-9661-f132fc21bed2 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:19.569604 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9adbba5c-c318-4102-9661-f132fc21bed2 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:19.570108 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-102d683d-ea72-4e47-8e91-4291f0ec6793 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:20.249081 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-102d683d-ea72-4e47-8e91-4291f0ec6793 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac233e966c54c8c86e5dd3a4745d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fe115abe204e118121c15906b8d0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:20.274777 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-102d683d-ea72-4e47-8e91-4291f0ec6793 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] 10.222.0.23 "GET /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069" status: 200 len: 1328 microversion: 2.1 time: 0.748189 Sep 10 12:06:20.279361 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2665/5328] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:19 2022] GET /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 => generated 1328 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:20.408109 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9adbba5c-c318-4102-9661-f132fc21bed2 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:20.417336 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9adbba5c-c318-4102-9661-f132fc21bed2 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1520 microversion: 2.1 time: 0.897660 Sep 10 12:06:20.424995 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2664/5329] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:19 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1520 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:21.308192 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7d684706-5d43-4658-94ed-1ef5008af899 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:21.309494 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7d684706-5d43-4658-94ed-1ef5008af899 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] [instance: 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:21.327752 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d684706-5d43-4658-94ed-1ef5008af899 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:21.328273 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d684706-5d43-4658-94ed-1ef5008af899 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:21.328702 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d684706-5d43-4658-94ed-1ef5008af899 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:21.329490 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d684706-5d43-4658-94ed-1ef5008af899 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:21.330029 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d684706-5d43-4658-94ed-1ef5008af899 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:21.330529 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d684706-5d43-4658-94ed-1ef5008af899 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:21.451409 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d5e914c8-7b74-4520-b743-8245134c8089 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:21.452024 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d5e914c8-7b74-4520-b743-8245134c8089 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:21.466474 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d5e914c8-7b74-4520-b743-8245134c8089 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:21.478734 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d5e914c8-7b74-4520-b743-8245134c8089 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:21.480601 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d5e914c8-7b74-4520-b743-8245134c8089 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:21.484128 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d5e914c8-7b74-4520-b743-8245134c8089 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:21.488319 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d5e914c8-7b74-4520-b743-8245134c8089 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:21.489368 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d5e914c8-7b74-4520-b743-8245134c8089 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:21.746216 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7d684706-5d43-4658-94ed-1ef5008af899 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac233e966c54c8c86e5dd3a4745d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fe115abe204e118121c15906b8d0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:21.754672 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7d684706-5d43-4658-94ed-1ef5008af899 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] 10.222.0.23 "GET /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069" status: 200 len: 1328 microversion: 2.1 time: 0.452070 Sep 10 12:06:21.759746 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2666/5330] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:21 2022] GET /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 => generated 1328 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:21.767415 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0b21ec35-2641-41cc-86f1-0b820bdbe740 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-365511315", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "d2b4bf2e-0237-4936-aa9f-bf43786fc0db"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:06:21.915457 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-0b21ec35-2641-41cc-86f1-0b820bdbe740 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] validate_networks() for [('d2b4bf2e-0237-4936-aa9f-bf43786fc0db', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:06:21.954154 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d5e914c8-7b74-4520-b743-8245134c8089 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:21.962408 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d5e914c8-7b74-4520-b743-8245134c8089 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1520 microversion: 2.1 time: 0.514631 Sep 10 12:06:21.982272 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2665/5331] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:21 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1520 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:22.049003 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-8ec6619a-019d-4a4e-976d-cf4bd729ded8 req-d67b5446-8cbe-4591-9f7a-e7612c6d224b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a1e2b4c-7f7f-4556-913a-fac2f3ac5069", "name": "network-vif-plugged", "status": "completed", "tag": "c1c99cac-0c16-4dd5-b655-9f22bed8b7c3"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:06:22.080811 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8ec6619a-019d-4a4e-976d-cf4bd729ded8 req-d67b5446-8cbe-4591-9f7a-e7612c6d224b service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:22.081937 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8ec6619a-019d-4a4e-976d-cf4bd729ded8 req-d67b5446-8cbe-4591-9f7a-e7612c6d224b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:22.082617 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8ec6619a-019d-4a4e-976d-cf4bd729ded8 req-d67b5446-8cbe-4591-9f7a-e7612c6d224b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:22.108860 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-8ec6619a-019d-4a4e-976d-cf4bd729ded8 req-d67b5446-8cbe-4591-9f7a-e7612c6d224b service nova] Creating event network-vif-plugged:c1c99cac-0c16-4dd5-b655-9f22bed8b7c3 for instance 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 on n-h2-856895-1 Sep 10 12:06:22.124903 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-8ec6619a-019d-4a4e-976d-cf4bd729ded8 req-d67b5446-8cbe-4591-9f7a-e7612c6d224b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081801 Sep 10 12:06:22.129786 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2666/5332] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:06:22.784512 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-68f368c1-fed3-4cd3-b637-677581095808 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:22.786033 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-68f368c1-fed3-4cd3-b637-677581095808 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] [instance: 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:22.818046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-68f368c1-fed3-4cd3-b637-677581095808 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:22.818866 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-68f368c1-fed3-4cd3-b637-677581095808 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:22.826781 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-68f368c1-fed3-4cd3-b637-677581095808 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:22.828074 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-68f368c1-fed3-4cd3-b637-677581095808 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:22.830849 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-68f368c1-fed3-4cd3-b637-677581095808 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:22.831507 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-68f368c1-fed3-4cd3-b637-677581095808 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:23.031928 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-0b21ec35-2641-41cc-86f1-0b820bdbe740 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:06:23.033007 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-0b21ec35-2641-41cc-86f1-0b820bdbe740 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:06:23.033650 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-0b21ec35-2641-41cc-86f1-0b820bdbe740 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:06:23.034273 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-0b21ec35-2641-41cc-86f1-0b820bdbe740 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:06:23.034848 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-0b21ec35-2641-41cc-86f1-0b820bdbe740 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:06:23.061168 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0b21ec35-2641-41cc-86f1-0b820bdbe740 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:23.061920 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0b21ec35-2641-41cc-86f1-0b820bdbe740 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:23.062534 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0b21ec35-2641-41cc-86f1-0b820bdbe740 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:23.066931 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0b21ec35-2641-41cc-86f1-0b820bdbe740 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:23.067673 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0b21ec35-2641-41cc-86f1-0b820bdbe740 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:23.068283 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0b21ec35-2641-41cc-86f1-0b820bdbe740 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:23.105133 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-0b21ec35-2641-41cc-86f1-0b820bdbe740 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Getting quotas for project c7b5a220528a4b2b99bb816a78e7de95. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:06:23.131760 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-0b21ec35-2641-41cc-86f1-0b820bdbe740 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Getting quotas for user 0dcbed59a8854e848afb2960fd6af525 and project c7b5a220528a4b2b99bb816a78e7de95. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:06:23.163334 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0b21ec35-2641-41cc-86f1-0b820bdbe740 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:06:23.167000 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-68f368c1-fed3-4cd3-b637-677581095808 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac233e966c54c8c86e5dd3a4745d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fe115abe204e118121c15906b8d0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:23.168613 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0b21ec35-2641-41cc-86f1-0b820bdbe740 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] [instance: 7b8ebc08-605e-45d8-9e2d-5e07c7be2353] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:06:23.185250 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-68f368c1-fed3-4cd3-b637-677581095808 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] 10.222.0.23 "GET /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069" status: 200 len: 1328 microversion: 2.1 time: 0.406398 Sep 10 12:06:23.186814 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2667/5333] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:22 2022] GET /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 => generated 1328 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:23.192849 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f580e756-dfc6-4cce-9aa7-efa5ab1a5d42 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:23.193670 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f580e756-dfc6-4cce-9aa7-efa5ab1a5d42 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:23.202111 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f580e756-dfc6-4cce-9aa7-efa5ab1a5d42 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:23.202802 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f580e756-dfc6-4cce-9aa7-efa5ab1a5d42 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:23.203444 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f580e756-dfc6-4cce-9aa7-efa5ab1a5d42 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:23.204395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f580e756-dfc6-4cce-9aa7-efa5ab1a5d42 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:23.205060 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f580e756-dfc6-4cce-9aa7-efa5ab1a5d42 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:23.205793 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f580e756-dfc6-4cce-9aa7-efa5ab1a5d42 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:23.227872 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0b21ec35-2641-41cc-86f1-0b820bdbe740 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.466235 Sep 10 12:06:23.234909 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2667/5334] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:06:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:06:23.240109 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-903d3aeb-c8a0-41e0-96f4-8d16f961a5dc tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:23.240742 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-903d3aeb-c8a0-41e0-96f4-8d16f961a5dc tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] [instance: 7b8ebc08-605e-45d8-9e2d-5e07c7be2353] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:23.410366 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-903d3aeb-c8a0-41e0-96f4-8d16f961a5dc tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcbed59a8854e848afb2960fd6af525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b5a220528a4b2b99bb816a78e7de95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:23.420983 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-903d3aeb-c8a0-41e0-96f4-8d16f961a5dc tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] 10.222.0.23 "GET /compute/v2.1/servers/7b8ebc08-605e-45d8-9e2d-5e07c7be2353" status: 200 len: 1213 microversion: 2.1 time: 0.184593 Sep 10 12:06:23.422923 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2668/5335] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:23 2022] GET /compute/v2.1/servers/7b8ebc08-605e-45d8-9e2d-5e07c7be2353 => generated 1213 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:24.050286 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f580e756-dfc6-4cce-9aa7-efa5ab1a5d42 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:24.062709 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f580e756-dfc6-4cce-9aa7-efa5ab1a5d42 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1520 microversion: 2.1 time: 0.874103 Sep 10 12:06:24.063645 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2668/5336] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:23 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1520 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:24.213095 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e75949d2-2fc6-4d94-976a-2ff24cb9176b tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:24.214018 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e75949d2-2fc6-4d94-976a-2ff24cb9176b tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] [instance: 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:24.216098 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:06:24.222672 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e75949d2-2fc6-4d94-976a-2ff24cb9176b tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:24.223181 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e75949d2-2fc6-4d94-976a-2ff24cb9176b tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:24.223654 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e75949d2-2fc6-4d94-976a-2ff24cb9176b tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:24.224346 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e75949d2-2fc6-4d94-976a-2ff24cb9176b tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:24.224964 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e75949d2-2fc6-4d94-976a-2ff24cb9176b tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:24.225570 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e75949d2-2fc6-4d94-976a-2ff24cb9176b tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:24.443852 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e75949d2-2fc6-4d94-976a-2ff24cb9176b tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac233e966c54c8c86e5dd3a4745d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fe115abe204e118121c15906b8d0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:24.450884 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-184145a3-0dd7-49a7-a0ea-a14fa000d87f tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:24.451791 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-184145a3-0dd7-49a7-a0ea-a14fa000d87f tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] [instance: 7b8ebc08-605e-45d8-9e2d-5e07c7be2353] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:24.459530 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e75949d2-2fc6-4d94-976a-2ff24cb9176b tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] 10.222.0.23 "GET /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069" status: 200 len: 1328 microversion: 2.1 time: 0.250433 Sep 10 12:06:24.460981 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2669/5337] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:24 2022] GET /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 => generated 1328 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:24.477201 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-184145a3-0dd7-49a7-a0ea-a14fa000d87f tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:24.478406 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-184145a3-0dd7-49a7-a0ea-a14fa000d87f tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:24.479129 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-184145a3-0dd7-49a7-a0ea-a14fa000d87f tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:24.480148 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-184145a3-0dd7-49a7-a0ea-a14fa000d87f tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:24.481553 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-184145a3-0dd7-49a7-a0ea-a14fa000d87f tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:24.483015 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-184145a3-0dd7-49a7-a0ea-a14fa000d87f tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:24.616488 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-184145a3-0dd7-49a7-a0ea-a14fa000d87f tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcbed59a8854e848afb2960fd6af525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b5a220528a4b2b99bb816a78e7de95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:24.630289 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-184145a3-0dd7-49a7-a0ea-a14fa000d87f tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] 10.222.0.23 "GET /compute/v2.1/servers/7b8ebc08-605e-45d8-9e2d-5e07c7be2353" status: 200 len: 1273 microversion: 2.1 time: 0.187148 Sep 10 12:06:24.634866 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2669/5338] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:24 2022] GET /compute/v2.1/servers/7b8ebc08-605e-45d8-9e2d-5e07c7be2353 => generated 1273 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:25.086006 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e1a57042-d8ee-4847-a881-dea3728c4bcf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:25.087391 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e1a57042-d8ee-4847-a881-dea3728c4bcf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:25.093653 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e1a57042-d8ee-4847-a881-dea3728c4bcf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:25.094263 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e1a57042-d8ee-4847-a881-dea3728c4bcf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:25.094968 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e1a57042-d8ee-4847-a881-dea3728c4bcf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:25.095791 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e1a57042-d8ee-4847-a881-dea3728c4bcf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:25.096482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e1a57042-d8ee-4847-a881-dea3728c4bcf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:25.097019 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e1a57042-d8ee-4847-a881-dea3728c4bcf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:25.100617 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:06:25.378804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e1a57042-d8ee-4847-a881-dea3728c4bcf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:25.394518 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e1a57042-d8ee-4847-a881-dea3728c4bcf tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1520 microversion: 2.1 time: 0.311880 Sep 10 12:06:25.407189 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2670/5339] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:25 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1520 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:25.484211 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c09e4718-9b6a-4f0f-be8e-f74014925e0a tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:25.484840 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c09e4718-9b6a-4f0f-be8e-f74014925e0a tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] [instance: 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:25.492219 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c09e4718-9b6a-4f0f-be8e-f74014925e0a tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:25.493303 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c09e4718-9b6a-4f0f-be8e-f74014925e0a tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:25.493748 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c09e4718-9b6a-4f0f-be8e-f74014925e0a tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:25.494461 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c09e4718-9b6a-4f0f-be8e-f74014925e0a tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:25.494911 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c09e4718-9b6a-4f0f-be8e-f74014925e0a tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:25.495552 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c09e4718-9b6a-4f0f-be8e-f74014925e0a tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:25.662448 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-628ecb79-914e-4bce-b880-025c0ff564eb tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:25.663438 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-628ecb79-914e-4bce-b880-025c0ff564eb tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] [instance: 7b8ebc08-605e-45d8-9e2d-5e07c7be2353] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:25.676059 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-628ecb79-914e-4bce-b880-025c0ff564eb tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:25.676761 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-628ecb79-914e-4bce-b880-025c0ff564eb tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:25.678362 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-628ecb79-914e-4bce-b880-025c0ff564eb tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:25.680059 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-628ecb79-914e-4bce-b880-025c0ff564eb tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:25.681077 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-628ecb79-914e-4bce-b880-025c0ff564eb tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:25.681689 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-628ecb79-914e-4bce-b880-025c0ff564eb tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:25.760535 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c09e4718-9b6a-4f0f-be8e-f74014925e0a tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac233e966c54c8c86e5dd3a4745d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fe115abe204e118121c15906b8d0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:25.774433 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c09e4718-9b6a-4f0f-be8e-f74014925e0a tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] 10.222.0.23 "GET /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069" status: 200 len: 1528 microversion: 2.1 time: 0.292383 Sep 10 12:06:25.776920 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2670/5340] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:25 2022] GET /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 => generated 1528 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:25.800292 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d838eabc-ca30-46d7-b6c4-d7a05a71c403 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:25.801139 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d838eabc-ca30-46d7-b6c4-d7a05a71c403 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] [instance: 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:25.809440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d838eabc-ca30-46d7-b6c4-d7a05a71c403 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:25.810121 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d838eabc-ca30-46d7-b6c4-d7a05a71c403 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:25.810732 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d838eabc-ca30-46d7-b6c4-d7a05a71c403 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:25.811876 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d838eabc-ca30-46d7-b6c4-d7a05a71c403 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:25.812664 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d838eabc-ca30-46d7-b6c4-d7a05a71c403 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:25.813298 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d838eabc-ca30-46d7-b6c4-d7a05a71c403 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:25.986214 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-628ecb79-914e-4bce-b880-025c0ff564eb tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcbed59a8854e848afb2960fd6af525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b5a220528a4b2b99bb816a78e7de95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:25.999374 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-628ecb79-914e-4bce-b880-025c0ff564eb tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] 10.222.0.23 "GET /compute/v2.1/servers/7b8ebc08-605e-45d8-9e2d-5e07c7be2353" status: 200 len: 1313 microversion: 2.1 time: 0.342069 Sep 10 12:06:26.000015 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2671/5341] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:25 2022] GET /compute/v2.1/servers/7b8ebc08-605e-45d8-9e2d-5e07c7be2353 => generated 1313 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:26.082517 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d838eabc-ca30-46d7-b6c4-d7a05a71c403 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac233e966c54c8c86e5dd3a4745d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fe115abe204e118121c15906b8d0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:26.091940 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d838eabc-ca30-46d7-b6c4-d7a05a71c403 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] 10.222.0.23 "GET /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069" status: 200 len: 1528 microversion: 2.1 time: 0.295942 Sep 10 12:06:26.108190 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2671/5342] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:25 2022] GET /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 => generated 1528 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:26.422407 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e9d719b1-d7c9-4c64-b8ed-1aa61939495e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:26.423189 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e9d719b1-d7c9-4c64-b8ed-1aa61939495e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:26.431771 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e9d719b1-d7c9-4c64-b8ed-1aa61939495e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:26.432380 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e9d719b1-d7c9-4c64-b8ed-1aa61939495e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:26.432810 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e9d719b1-d7c9-4c64-b8ed-1aa61939495e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:26.438659 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e9d719b1-d7c9-4c64-b8ed-1aa61939495e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:26.439088 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e9d719b1-d7c9-4c64-b8ed-1aa61939495e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:26.440967 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e9d719b1-d7c9-4c64-b8ed-1aa61939495e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:26.533632 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-01c406cb-cf14-4aa3-9dbb-ffdb71d431de tempest-ServersNegativeTestMultiTenantJSON-1964046971 tempest-ServersNegativeTestMultiTenantJSON-1964046971-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:26.534759 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-01c406cb-cf14-4aa3-9dbb-ffdb71d431de tempest-ServersNegativeTestMultiTenantJSON-1964046971 tempest-ServersNegativeTestMultiTenantJSON-1964046971-project] [instance: 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:26.543478 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01c406cb-cf14-4aa3-9dbb-ffdb71d431de tempest-ServersNegativeTestMultiTenantJSON-1964046971 tempest-ServersNegativeTestMultiTenantJSON-1964046971-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:26.544293 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01c406cb-cf14-4aa3-9dbb-ffdb71d431de tempest-ServersNegativeTestMultiTenantJSON-1964046971 tempest-ServersNegativeTestMultiTenantJSON-1964046971-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:26.544903 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01c406cb-cf14-4aa3-9dbb-ffdb71d431de tempest-ServersNegativeTestMultiTenantJSON-1964046971 tempest-ServersNegativeTestMultiTenantJSON-1964046971-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:26.546379 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01c406cb-cf14-4aa3-9dbb-ffdb71d431de tempest-ServersNegativeTestMultiTenantJSON-1964046971 tempest-ServersNegativeTestMultiTenantJSON-1964046971-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:26.547729 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01c406cb-cf14-4aa3-9dbb-ffdb71d431de tempest-ServersNegativeTestMultiTenantJSON-1964046971 tempest-ServersNegativeTestMultiTenantJSON-1964046971-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:26.548521 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01c406cb-cf14-4aa3-9dbb-ffdb71d431de tempest-ServersNegativeTestMultiTenantJSON-1964046971 tempest-ServersNegativeTestMultiTenantJSON-1964046971-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:26.573545 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-01c406cb-cf14-4aa3-9dbb-ffdb71d431de tempest-ServersNegativeTestMultiTenantJSON-1964046971 tempest-ServersNegativeTestMultiTenantJSON-1964046971-project] HTTP exception thrown: Instance 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 could not be found. Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-01c406cb-cf14-4aa3-9dbb-ffdb71d431de tempest-ServersNegativeTestMultiTenantJSON-1964046971 tempest-ServersNegativeTestMultiTenantJSON-1964046971-project] Request method failure captured: Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 HTTP/1.1 Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH2p-jagvmHg0g4psEZK9kvHgmJJvtKs8sA5kM3Zz4EqN9wH6Qrg24HNKhIMrout-sIqzLUTMCpzH36NTDw5heJXIFJ2E3km4doyy3895rDwZwDXApq7ewGbyA2R-4P0S70tiTtbFEbw9wSOieSpkFEXWxlx4zsiehxYMVz4LL0x-DA Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: bca9975ec30946c39886eb3ba3d2d2f9 Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1964046971 Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bca9975ec30946c39886eb3ba3d2d2f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bca9975ec30946c39886eb3ba3d2d2f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bca9975ec30946c39886eb3ba3d2d2f9", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bca9975ec30946c39886eb3ba3d2d2f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1964046971 Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: bca9975ec30946c39886eb3ba3d2d2f9 Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1964046971 Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1964046971-project Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 9b811dbcba6d4e2b9be65fb25f66fb6a Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1964046971-project Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 could not be found. Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '8a1e2b4c-7f7f-4556-913a-fac2f3ac5069'} Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 could not be found. Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:06:26.576600 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:06:26.580868 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 could not be found. Sep 10 12:06:26.580868 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:06:26.580868 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:06:26.580868 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:06:26.580868 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:26.580868 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:06:26.580868 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:06:26.580868 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:06:26.580868 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:06:26.580868 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 could not be found. Sep 10 12:06:26.580868 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:06:26.582369 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-01c406cb-cf14-4aa3-9dbb-ffdb71d431de tempest-ServersNegativeTestMultiTenantJSON-1964046971 tempest-ServersNegativeTestMultiTenantJSON-1964046971-project] Returning 404 to user: Instance 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:06:26.583433 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-01c406cb-cf14-4aa3-9dbb-ffdb71d431de tempest-ServersNegativeTestMultiTenantJSON-1964046971 tempest-ServersNegativeTestMultiTenantJSON-1964046971-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069" status: 404 len: 111 microversion: 2.1 time: 0.466912 Sep 10 12:06:26.584518 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2672/5343] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:06:26 2022] DELETE /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 => generated 111 bytes in 469 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:06:26.594685 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6e60afc0-1c9f-4630-a56d-021a893b5568 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:26.595733 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6e60afc0-1c9f-4630-a56d-021a893b5568 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] [instance: 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:26.604527 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e60afc0-1c9f-4630-a56d-021a893b5568 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:26.605720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e60afc0-1c9f-4630-a56d-021a893b5568 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:26.606333 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e60afc0-1c9f-4630-a56d-021a893b5568 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:26.607409 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e60afc0-1c9f-4630-a56d-021a893b5568 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:26.608154 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e60afc0-1c9f-4630-a56d-021a893b5568 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:26.608756 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e60afc0-1c9f-4630-a56d-021a893b5568 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:26.870416 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e9d719b1-d7c9-4c64-b8ed-1aa61939495e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:26.893207 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e9d719b1-d7c9-4c64-b8ed-1aa61939495e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1520 microversion: 2.1 time: 0.474589 Sep 10 12:06:26.894069 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2672/5344] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:26 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1520 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:06:26.923428 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6e60afc0-1c9f-4630-a56d-021a893b5568 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac233e966c54c8c86e5dd3a4745d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fe115abe204e118121c15906b8d0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:26.955848 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6e60afc0-1c9f-4630-a56d-021a893b5568 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] 10.222.0.23 "GET /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069" status: 200 len: 1528 microversion: 2.1 time: 0.360763 Sep 10 12:06:26.956678 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2673/5345] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:26 2022] GET /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 => generated 1528 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:06:26.983928 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b4f18e04-fd3f-4428-82df-cda90c6e72e1 tempest-ServersNegativeTestMultiTenantJSON-1964046971 tempest-ServersNegativeTestMultiTenantJSON-1964046971-project] Action: 'update', calling method: >, body: {"server": {"name": "8a1e2b4c-7f7f-4556-913a-fac2f3ac5069_new"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:06:26.987917 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b4f18e04-fd3f-4428-82df-cda90c6e72e1 tempest-ServersNegativeTestMultiTenantJSON-1964046971 tempest-ServersNegativeTestMultiTenantJSON-1964046971-project] [instance: 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:26.996611 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b4f18e04-fd3f-4428-82df-cda90c6e72e1 tempest-ServersNegativeTestMultiTenantJSON-1964046971 tempest-ServersNegativeTestMultiTenantJSON-1964046971-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:26.997331 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b4f18e04-fd3f-4428-82df-cda90c6e72e1 tempest-ServersNegativeTestMultiTenantJSON-1964046971 tempest-ServersNegativeTestMultiTenantJSON-1964046971-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:26.997982 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b4f18e04-fd3f-4428-82df-cda90c6e72e1 tempest-ServersNegativeTestMultiTenantJSON-1964046971 tempest-ServersNegativeTestMultiTenantJSON-1964046971-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:26.999542 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b4f18e04-fd3f-4428-82df-cda90c6e72e1 tempest-ServersNegativeTestMultiTenantJSON-1964046971 tempest-ServersNegativeTestMultiTenantJSON-1964046971-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:27.000186 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b4f18e04-fd3f-4428-82df-cda90c6e72e1 tempest-ServersNegativeTestMultiTenantJSON-1964046971 tempest-ServersNegativeTestMultiTenantJSON-1964046971-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:27.000903 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b4f18e04-fd3f-4428-82df-cda90c6e72e1 tempest-ServersNegativeTestMultiTenantJSON-1964046971 tempest-ServersNegativeTestMultiTenantJSON-1964046971-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:27.023130 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c0709b00-4dfe-41fd-a35c-8f12ac5fe76a tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:27.024534 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c0709b00-4dfe-41fd-a35c-8f12ac5fe76a tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] [instance: 7b8ebc08-605e-45d8-9e2d-5e07c7be2353] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:27.037848 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0709b00-4dfe-41fd-a35c-8f12ac5fe76a tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:27.042186 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0709b00-4dfe-41fd-a35c-8f12ac5fe76a tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:27.045767 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0709b00-4dfe-41fd-a35c-8f12ac5fe76a tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:27.046762 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0709b00-4dfe-41fd-a35c-8f12ac5fe76a tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:27.050244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0709b00-4dfe-41fd-a35c-8f12ac5fe76a tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:27.052150 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0709b00-4dfe-41fd-a35c-8f12ac5fe76a tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:27.071755 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-b4f18e04-fd3f-4428-82df-cda90c6e72e1 tempest-ServersNegativeTestMultiTenantJSON-1964046971 tempest-ServersNegativeTestMultiTenantJSON-1964046971-project] HTTP exception thrown: Instance 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 could not be found. Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b4f18e04-fd3f-4428-82df-cda90c6e72e1 tempest-ServersNegativeTestMultiTenantJSON-1964046971 tempest-ServersNegativeTestMultiTenantJSON-1964046971-project] Request method failure captured: Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: request: PUT /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 HTTP/1.1 Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 64 Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH2p-jagvmHg0g4psEZK9kvHgmJJvtKs8sA5kM3Zz4EqN9wH6Qrg24HNKhIMrout-sIqzLUTMCpzH36NTDw5heJXIFJ2E3km4doyy3895rDwZwDXApq7ewGbyA2R-4P0S70tiTtbFEbw9wSOieSpkFEXWxlx4zsiehxYMVz4LL0x-DA Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: bca9975ec30946c39886eb3ba3d2d2f9 Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1964046971 Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bca9975ec30946c39886eb3ba3d2d2f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/bca9975ec30946c39886eb3ba3d2d2f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_bca9975ec30946c39886eb3ba3d2d2f9", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/bca9975ec30946c39886eb3ba3d2d2f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1964046971 Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: bca9975ec30946c39886eb3ba3d2d2f9 Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1964046971 Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1964046971-project Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 9b811dbcba6d4e2b9be65fb25f66fb6a Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1964046971-project Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: {"server": {"name": "8a1e2b4c-7f7f-4556-913a-fac2f3ac5069_new"}} Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 could not be found. Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '8a1e2b4c-7f7f-4556-913a-fac2f3ac5069', 'body': {'server': {'name': '8a1e2b4c-7f7f-4556-913a-fac2f3ac5069_new'}}} Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 could not be found. Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:06:27.080425 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 10 12:06:27.084740 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 10 12:06:27.084740 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 10 12:06:27.084740 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:06:27.084740 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:06:27.084740 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:06:27.084740 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:06:27.084740 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 could not be found. Sep 10 12:06:27.084740 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:06:27.084740 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:06:27.084740 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:06:27.084740 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:27.084740 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:06:27.084740 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:06:27.084740 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:06:27.084740 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:06:27.084740 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 could not be found. Sep 10 12:06:27.084740 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:06:27.087794 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b4f18e04-fd3f-4428-82df-cda90c6e72e1 tempest-ServersNegativeTestMultiTenantJSON-1964046971 tempest-ServersNegativeTestMultiTenantJSON-1964046971-project] Returning 404 to user: Instance 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:06:27.089219 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b4f18e04-fd3f-4428-82df-cda90c6e72e1 tempest-ServersNegativeTestMultiTenantJSON-1964046971 tempest-ServersNegativeTestMultiTenantJSON-1964046971-project] 10.222.0.23 "PUT /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069" status: 404 len: 111 microversion: 2.1 time: 0.113361 Sep 10 12:06:27.090105 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2673/5346] 10.222.0.23 () {60 vars in 1256 bytes} [Sat Sep 10 12:06:26 2022] PUT /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:06:27.104793 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a5a8ffca-9a4d-464a-bd8c-ac0f706d6767 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:27.106988 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a5a8ffca-9a4d-464a-bd8c-ac0f706d6767 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] [instance: 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:27.124107 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5a8ffca-9a4d-464a-bd8c-ac0f706d6767 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:27.125264 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5a8ffca-9a4d-464a-bd8c-ac0f706d6767 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:27.126168 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5a8ffca-9a4d-464a-bd8c-ac0f706d6767 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:27.127092 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5a8ffca-9a4d-464a-bd8c-ac0f706d6767 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:27.127739 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5a8ffca-9a4d-464a-bd8c-ac0f706d6767 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:27.128443 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5a8ffca-9a4d-464a-bd8c-ac0f706d6767 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:27.180266 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a5a8ffca-9a4d-464a-bd8c-ac0f706d6767 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] [instance: 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:06:27.432620 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a5a8ffca-9a4d-464a-bd8c-ac0f706d6767 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069" status: 204 len: 0 microversion: 2.1 time: 0.331766 Sep 10 12:06:27.433490 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2674/5347] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:06:27 2022] DELETE /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:06:27.439694 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-be740da2-e7be-4698-8ef6-dd32669d8763 req-b5514a4c-fa5d-4af4-bc16-515ce10ef69b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b8ebc08-605e-45d8-9e2d-5e07c7be2353", "tag": "e593592b-8b9d-404f-a172-cf642d5c220b"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:06:27.452135 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-be740da2-e7be-4698-8ef6-dd32669d8763 req-b5514a4c-fa5d-4af4-bc16-515ce10ef69b service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:27.452936 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-be740da2-e7be-4698-8ef6-dd32669d8763 req-b5514a4c-fa5d-4af4-bc16-515ce10ef69b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:27.453750 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-be740da2-e7be-4698-8ef6-dd32669d8763 req-b5514a4c-fa5d-4af4-bc16-515ce10ef69b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:27.467533 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-be740da2-e7be-4698-8ef6-dd32669d8763 req-b5514a4c-fa5d-4af4-bc16-515ce10ef69b service nova] Creating event network-changed:e593592b-8b9d-404f-a172-cf642d5c220b for instance 7b8ebc08-605e-45d8-9e2d-5e07c7be2353 on n-h1-856895-1 Sep 10 12:06:27.471845 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c0709b00-4dfe-41fd-a35c-8f12ac5fe76a tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcbed59a8854e848afb2960fd6af525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b5a220528a4b2b99bb816a78e7de95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:27.473981 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-be740da2-e7be-4698-8ef6-dd32669d8763 req-b5514a4c-fa5d-4af4-bc16-515ce10ef69b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038788 Sep 10 12:06:27.475050 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2675/5348] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:06:27.480628 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-563db139-19aa-4fd0-9595-8029c1b2538a tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:27.481342 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-563db139-19aa-4fd0-9595-8029c1b2538a tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] [instance: 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:27.485144 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c0709b00-4dfe-41fd-a35c-8f12ac5fe76a tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] 10.222.0.23 "GET /compute/v2.1/servers/7b8ebc08-605e-45d8-9e2d-5e07c7be2353" status: 200 len: 1313 microversion: 2.1 time: 0.467044 Sep 10 12:06:27.486741 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2674/5349] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:27 2022] GET /compute/v2.1/servers/7b8ebc08-605e-45d8-9e2d-5e07c7be2353 => generated 1313 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:27.487875 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-563db139-19aa-4fd0-9595-8029c1b2538a tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:27.488531 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-563db139-19aa-4fd0-9595-8029c1b2538a tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:27.489293 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-563db139-19aa-4fd0-9595-8029c1b2538a tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:27.490269 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-563db139-19aa-4fd0-9595-8029c1b2538a tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:27.490870 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-563db139-19aa-4fd0-9595-8029c1b2538a tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:27.491510 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-563db139-19aa-4fd0-9595-8029c1b2538a tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:27.736163 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-563db139-19aa-4fd0-9595-8029c1b2538a tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac233e966c54c8c86e5dd3a4745d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fe115abe204e118121c15906b8d0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:27.746435 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-563db139-19aa-4fd0-9595-8029c1b2538a tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] 10.222.0.23 "GET /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069" status: 200 len: 1534 microversion: 2.1 time: 0.270068 Sep 10 12:06:27.760002 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2676/5350] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:27 2022] GET /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 => generated 1534 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:27.919279 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-66dc3df3-7697-454d-a238-4c8a8a6e22ad tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:27.919970 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-66dc3df3-7697-454d-a238-4c8a8a6e22ad tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:27.928281 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-66dc3df3-7697-454d-a238-4c8a8a6e22ad tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:27.929535 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-66dc3df3-7697-454d-a238-4c8a8a6e22ad tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:27.936317 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-66dc3df3-7697-454d-a238-4c8a8a6e22ad tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:27.939989 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-66dc3df3-7697-454d-a238-4c8a8a6e22ad tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:27.940869 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-66dc3df3-7697-454d-a238-4c8a8a6e22ad tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:27.941580 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-66dc3df3-7697-454d-a238-4c8a8a6e22ad tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:28.298848 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-66dc3df3-7697-454d-a238-4c8a8a6e22ad tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:28.308596 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-66dc3df3-7697-454d-a238-4c8a8a6e22ad tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1520 microversion: 2.1 time: 0.395015 Sep 10 12:06:28.309407 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2675/5351] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:27 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1520 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:28.510626 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6d7a3281-e286-4c54-9109-05547d409f12 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:28.511907 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6d7a3281-e286-4c54-9109-05547d409f12 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] [instance: 7b8ebc08-605e-45d8-9e2d-5e07c7be2353] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:28.521160 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d7a3281-e286-4c54-9109-05547d409f12 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:28.521972 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d7a3281-e286-4c54-9109-05547d409f12 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:28.522577 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d7a3281-e286-4c54-9109-05547d409f12 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:28.524746 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d7a3281-e286-4c54-9109-05547d409f12 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:28.525092 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d7a3281-e286-4c54-9109-05547d409f12 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:28.525699 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d7a3281-e286-4c54-9109-05547d409f12 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:28.719177 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6d7a3281-e286-4c54-9109-05547d409f12 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcbed59a8854e848afb2960fd6af525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b5a220528a4b2b99bb816a78e7de95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:28.730098 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6d7a3281-e286-4c54-9109-05547d409f12 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] 10.222.0.23 "GET /compute/v2.1/servers/7b8ebc08-605e-45d8-9e2d-5e07c7be2353" status: 200 len: 1313 microversion: 2.1 time: 0.223972 Sep 10 12:06:28.745863 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2677/5352] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:28 2022] GET /compute/v2.1/servers/7b8ebc08-605e-45d8-9e2d-5e07c7be2353 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:28.774606 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3ebf809f-c330-4bcf-b4f7-738320d018d5 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:28.774606 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3ebf809f-c330-4bcf-b4f7-738320d018d5 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] [instance: 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:28.782731 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3ebf809f-c330-4bcf-b4f7-738320d018d5 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:28.783697 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3ebf809f-c330-4bcf-b4f7-738320d018d5 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:28.784884 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3ebf809f-c330-4bcf-b4f7-738320d018d5 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:28.786054 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3ebf809f-c330-4bcf-b4f7-738320d018d5 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:28.786954 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3ebf809f-c330-4bcf-b4f7-738320d018d5 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:28.788376 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3ebf809f-c330-4bcf-b4f7-738320d018d5 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:29.042926 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3ebf809f-c330-4bcf-b4f7-738320d018d5 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac233e966c54c8c86e5dd3a4745d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fe115abe204e118121c15906b8d0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:29.057567 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3ebf809f-c330-4bcf-b4f7-738320d018d5 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] 10.222.0.23 "GET /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069" status: 200 len: 1534 microversion: 2.1 time: 0.289208 Sep 10 12:06:29.062653 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2676/5353] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:28 2022] GET /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 => generated 1534 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:06:29.337032 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-89869996-eee8-4aba-99f8-676aff537e1b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:29.337985 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-89869996-eee8-4aba-99f8-676aff537e1b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:29.350458 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-89869996-eee8-4aba-99f8-676aff537e1b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:29.351339 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-89869996-eee8-4aba-99f8-676aff537e1b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:29.352710 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-89869996-eee8-4aba-99f8-676aff537e1b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:29.354225 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-89869996-eee8-4aba-99f8-676aff537e1b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:29.356580 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-89869996-eee8-4aba-99f8-676aff537e1b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:29.357283 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-89869996-eee8-4aba-99f8-676aff537e1b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:29.590338 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-89869996-eee8-4aba-99f8-676aff537e1b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:29.599722 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-89869996-eee8-4aba-99f8-676aff537e1b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1520 microversion: 2.1 time: 0.270461 Sep 10 12:06:29.603895 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2678/5354] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:29 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1520 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:29.782009 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-52552f0f-bfad-4d6c-94bc-9e807f42d1f6 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:29.785356 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-52552f0f-bfad-4d6c-94bc-9e807f42d1f6 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] [instance: 7b8ebc08-605e-45d8-9e2d-5e07c7be2353] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:29.805680 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-d1a17aa4-ee68-46cd-a00e-82507601840b req-bdd903f9-73a3-4a39-a75b-4121c729aaa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a1e2b4c-7f7f-4556-913a-fac2f3ac5069", "name": "network-vif-deleted", "tag": "c1c99cac-0c16-4dd5-b655-9f22bed8b7c3"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:06:29.815497 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:06:29.816589 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52552f0f-bfad-4d6c-94bc-9e807f42d1f6 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:29.817348 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52552f0f-bfad-4d6c-94bc-9e807f42d1f6 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:29.818185 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52552f0f-bfad-4d6c-94bc-9e807f42d1f6 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:29.820011 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52552f0f-bfad-4d6c-94bc-9e807f42d1f6 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:29.820811 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52552f0f-bfad-4d6c-94bc-9e807f42d1f6 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:29.821472 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52552f0f-bfad-4d6c-94bc-9e807f42d1f6 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:29.830452 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d1a17aa4-ee68-46cd-a00e-82507601840b req-bdd903f9-73a3-4a39-a75b-4121c729aaa4 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:29.843661 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d1a17aa4-ee68-46cd-a00e-82507601840b req-bdd903f9-73a3-4a39-a75b-4121c729aaa4 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:29.844728 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d1a17aa4-ee68-46cd-a00e-82507601840b req-bdd903f9-73a3-4a39-a75b-4121c729aaa4 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:29.877279 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-d1a17aa4-ee68-46cd-a00e-82507601840b req-bdd903f9-73a3-4a39-a75b-4121c729aaa4 service nova] Creating event network-vif-deleted:c1c99cac-0c16-4dd5-b655-9f22bed8b7c3 for instance 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 on n-h2-856895-1 Sep 10 12:06:29.889226 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-d1a17aa4-ee68-46cd-a00e-82507601840b req-bdd903f9-73a3-4a39-a75b-4121c729aaa4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089612 Sep 10 12:06:29.890513 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2679/5355] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:06:30.090478 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-310e74d0-d3e1-4b67-a7df-3015331f9b75 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:30.091305 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-310e74d0-d3e1-4b67-a7df-3015331f9b75 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] [instance: 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:30.112206 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-310e74d0-d3e1-4b67-a7df-3015331f9b75 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:30.116146 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-310e74d0-d3e1-4b67-a7df-3015331f9b75 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:30.116839 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-310e74d0-d3e1-4b67-a7df-3015331f9b75 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:30.120085 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-310e74d0-d3e1-4b67-a7df-3015331f9b75 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:30.123495 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-310e74d0-d3e1-4b67-a7df-3015331f9b75 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:30.123944 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-310e74d0-d3e1-4b67-a7df-3015331f9b75 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:30.161248 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:06:30.199424 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-310e74d0-d3e1-4b67-a7df-3015331f9b75 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:30.200306 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-310e74d0-d3e1-4b67-a7df-3015331f9b75 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:30.201283 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-310e74d0-d3e1-4b67-a7df-3015331f9b75 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:30.202655 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-310e74d0-d3e1-4b67-a7df-3015331f9b75 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lazy-loading 'fault' on Instance uuid 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:06:30.310643 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-310e74d0-d3e1-4b67-a7df-3015331f9b75 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac233e966c54c8c86e5dd3a4745d57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fe115abe204e118121c15906b8d0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:30.327896 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-310e74d0-d3e1-4b67-a7df-3015331f9b75 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] 10.222.0.23 "GET /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069" status: 200 len: 1318 microversion: 2.1 time: 0.243399 Sep 10 12:06:30.329624 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2680/5356] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:30 2022] GET /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:06:30.341245 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-c358863b-0a79-435b-910b-be9a06185766 req-c3d021c3-f461-4944-b958-4991e0c002da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac1538e5-6edc-4ccb-b7a9-c2e90284e004", "name": "network-vif-plugged", "status": "completed", "tag": "264e21dc-6813-4623-838f-df7e536eeb78"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:06:30.374696 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-c358863b-0a79-435b-910b-be9a06185766 req-c3d021c3-f461-4944-b958-4991e0c002da service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:30.375223 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-c358863b-0a79-435b-910b-be9a06185766 req-c3d021c3-f461-4944-b958-4991e0c002da service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:30.375671 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-c358863b-0a79-435b-910b-be9a06185766 req-c3d021c3-f461-4944-b958-4991e0c002da service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:30.428338 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-c358863b-0a79-435b-910b-be9a06185766 req-c3d021c3-f461-4944-b958-4991e0c002da service nova] Creating event network-vif-plugged:264e21dc-6813-4623-838f-df7e536eeb78 for instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 on n-h2-856895-1 Sep 10 12:06:30.428743 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-52552f0f-bfad-4d6c-94bc-9e807f42d1f6 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcbed59a8854e848afb2960fd6af525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b5a220528a4b2b99bb816a78e7de95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:30.436894 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-c358863b-0a79-435b-910b-be9a06185766 req-c3d021c3-f461-4944-b958-4991e0c002da service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104190 Sep 10 12:06:30.438977 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2681/5357] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:06:30.453551 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-52552f0f-bfad-4d6c-94bc-9e807f42d1f6 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] 10.222.0.23 "GET /compute/v2.1/servers/7b8ebc08-605e-45d8-9e2d-5e07c7be2353" status: 200 len: 1313 microversion: 2.1 time: 0.690484 Sep 10 12:06:30.454395 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2677/5358] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:29 2022] GET /compute/v2.1/servers/7b8ebc08-605e-45d8-9e2d-5e07c7be2353 => generated 1313 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:30.632303 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9762300a-84f8-4adb-bd25-2a9c3729f274 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:30.633684 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9762300a-84f8-4adb-bd25-2a9c3729f274 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:30.646290 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9762300a-84f8-4adb-bd25-2a9c3729f274 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:30.646789 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9762300a-84f8-4adb-bd25-2a9c3729f274 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:30.650761 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9762300a-84f8-4adb-bd25-2a9c3729f274 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:30.651560 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9762300a-84f8-4adb-bd25-2a9c3729f274 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:30.654268 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9762300a-84f8-4adb-bd25-2a9c3729f274 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:30.654731 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9762300a-84f8-4adb-bd25-2a9c3729f274 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:31.357164 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-082c967c-ea97-4797-85e6-3d1fbb963a26 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:31.358891 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-082c967c-ea97-4797-85e6-3d1fbb963a26 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] [instance: 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:31.376627 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-082c967c-ea97-4797-85e6-3d1fbb963a26 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:31.377481 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-082c967c-ea97-4797-85e6-3d1fbb963a26 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:31.380137 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-082c967c-ea97-4797-85e6-3d1fbb963a26 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:31.382503 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-082c967c-ea97-4797-85e6-3d1fbb963a26 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:31.385599 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-082c967c-ea97-4797-85e6-3d1fbb963a26 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:31.386365 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-082c967c-ea97-4797-85e6-3d1fbb963a26 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:31.401423 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9762300a-84f8-4adb-bd25-2a9c3729f274 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:31.411029 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9762300a-84f8-4adb-bd25-2a9c3729f274 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1520 microversion: 2.1 time: 0.784847 Sep 10 12:06:31.418165 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2682/5359] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:30 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1520 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:31.472623 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-082c967c-ea97-4797-85e6-3d1fbb963a26 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] HTTP exception thrown: Instance 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 could not be found. Sep 10 12:06:31.489126 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a2d139a4-2898-4ff0-b1e5-1d44ea370976 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:31.490144 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a2d139a4-2898-4ff0-b1e5-1d44ea370976 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] [instance: 7b8ebc08-605e-45d8-9e2d-5e07c7be2353] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-082c967c-ea97-4797-85e6-3d1fbb963a26 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Request method failure captured: Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 HTTP/1.1 Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH2ZSogSm7wjYjPX8bAJalLjc7UMKbzbghG867PHiafV-TIBwB_-GQm3Lg_d_ikHf-WMwPhlWdqtFQG8t2_It-yJCyaLDDFWhgmNzoZVkYjt6dy9ZHB3f64yW84sdKYNHIvJqJOHAro9-_fyxzSTBavqf4KeIQLIxd4i0mXNL_4n9xk Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 19fe115abe204e118121c15906b8d0b8 Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-927114244 Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/19fe115abe204e118121c15906b8d0b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/19fe115abe204e118121c15906b8d0b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_19fe115abe204e118121c15906b8d0b8", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/19fe115abe204e118121c15906b8d0b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-927114244 Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 19fe115abe204e118121c15906b8d0b8 Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-927114244 Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersNegativeTestMultiTenantJSON-927114244-project Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 8ac233e966c54c8c86e5dd3a4745d57b Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-927114244-project Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 could not be found. Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '8a1e2b4c-7f7f-4556-913a-fac2f3ac5069'} Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 could not be found. Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 could not be found. Sep 10 12:06:31.490647 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:06:31.494536 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:06:31.494536 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:06:31.494536 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:31.494536 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:06:31.494536 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:06:31.494536 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:06:31.494536 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:06:31.494536 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 could not be found. Sep 10 12:06:31.494536 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:06:31.495030 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-082c967c-ea97-4797-85e6-3d1fbb963a26 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] Returning 404 to user: Instance 8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:06:31.496666 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-082c967c-ea97-4797-85e6-3d1fbb963a26 tempest-ServersNegativeTestMultiTenantJSON-927114244 tempest-ServersNegativeTestMultiTenantJSON-927114244-project] 10.222.0.23 "GET /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069" status: 404 len: 111 microversion: 2.1 time: 0.144158 Sep 10 12:06:31.497702 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2678/5360] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:31 2022] GET /compute/v2.1/servers/8a1e2b4c-7f7f-4556-913a-fac2f3ac5069 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 12:06:31.512023 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a2d139a4-2898-4ff0-b1e5-1d44ea370976 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:31.512827 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a2d139a4-2898-4ff0-b1e5-1d44ea370976 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:31.513461 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a2d139a4-2898-4ff0-b1e5-1d44ea370976 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:31.532468 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a2d139a4-2898-4ff0-b1e5-1d44ea370976 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:31.532876 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a2d139a4-2898-4ff0-b1e5-1d44ea370976 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:31.536668 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a2d139a4-2898-4ff0-b1e5-1d44ea370976 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:32.435899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-41a5b028-9ed5-4715-8c62-31fc73fa1fe4 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:32.436595 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-41a5b028-9ed5-4715-8c62-31fc73fa1fe4 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:32.444750 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41a5b028-9ed5-4715-8c62-31fc73fa1fe4 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:32.447248 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41a5b028-9ed5-4715-8c62-31fc73fa1fe4 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:32.447772 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41a5b028-9ed5-4715-8c62-31fc73fa1fe4 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:32.455656 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41a5b028-9ed5-4715-8c62-31fc73fa1fe4 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:32.461769 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41a5b028-9ed5-4715-8c62-31fc73fa1fe4 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:32.462585 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41a5b028-9ed5-4715-8c62-31fc73fa1fe4 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:32.927142 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a2d139a4-2898-4ff0-b1e5-1d44ea370976 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcbed59a8854e848afb2960fd6af525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b5a220528a4b2b99bb816a78e7de95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:32.940375 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a2d139a4-2898-4ff0-b1e5-1d44ea370976 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] 10.222.0.23 "GET /compute/v2.1/servers/7b8ebc08-605e-45d8-9e2d-5e07c7be2353" status: 200 len: 1313 microversion: 2.1 time: 1.460627 Sep 10 12:06:32.940985 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2683/5361] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:31 2022] GET /compute/v2.1/servers/7b8ebc08-605e-45d8-9e2d-5e07c7be2353 => generated 1313 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:06:33.071049 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-41a5b028-9ed5-4715-8c62-31fc73fa1fe4 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:33.095453 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:06:33.101895 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-41a5b028-9ed5-4715-8c62-31fc73fa1fe4 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1520 microversion: 2.1 time: 0.669797 Sep 10 12:06:33.116035 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2679/5362] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:32 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1520 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:33.967546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2ab62d7f-651d-4d03-9486-73c55fbd76d3 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:33.968218 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2ab62d7f-651d-4d03-9486-73c55fbd76d3 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] [instance: 7b8ebc08-605e-45d8-9e2d-5e07c7be2353] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:33.986349 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ab62d7f-651d-4d03-9486-73c55fbd76d3 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:33.986838 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ab62d7f-651d-4d03-9486-73c55fbd76d3 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:33.989118 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ab62d7f-651d-4d03-9486-73c55fbd76d3 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:33.989902 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ab62d7f-651d-4d03-9486-73c55fbd76d3 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:33.990371 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ab62d7f-651d-4d03-9486-73c55fbd76d3 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:33.990800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ab62d7f-651d-4d03-9486-73c55fbd76d3 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:34.145447 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-63200dce-82ec-49c4-baaa-c8ff5644a9d3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:34.148837 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-63200dce-82ec-49c4-baaa-c8ff5644a9d3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:34.170223 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=8 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:06:34.175915 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-63200dce-82ec-49c4-baaa-c8ff5644a9d3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:34.177375 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-63200dce-82ec-49c4-baaa-c8ff5644a9d3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:34.178565 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-63200dce-82ec-49c4-baaa-c8ff5644a9d3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:34.212002 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-63200dce-82ec-49c4-baaa-c8ff5644a9d3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:34.212718 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-63200dce-82ec-49c4-baaa-c8ff5644a9d3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:34.215148 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-63200dce-82ec-49c4-baaa-c8ff5644a9d3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:34.478725 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2ab62d7f-651d-4d03-9486-73c55fbd76d3 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcbed59a8854e848afb2960fd6af525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b5a220528a4b2b99bb816a78e7de95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:34.495428 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2ab62d7f-651d-4d03-9486-73c55fbd76d3 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] 10.222.0.23 "GET /compute/v2.1/servers/7b8ebc08-605e-45d8-9e2d-5e07c7be2353" status: 200 len: 1313 microversion: 2.1 time: 0.533427 Sep 10 12:06:34.496221 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2684/5363] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:33 2022] GET /compute/v2.1/servers/7b8ebc08-605e-45d8-9e2d-5e07c7be2353 => generated 1313 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:34.617668 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-63200dce-82ec-49c4-baaa-c8ff5644a9d3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:34.629032 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-63200dce-82ec-49c4-baaa-c8ff5644a9d3 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.501397 Sep 10 12:06:34.631692 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2680/5364] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:34 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:06:34.657847 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bbea5e67-bcf4-4eec-b69b-07fdb8dce712 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:34.658352 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bbea5e67-bcf4-4eec-b69b-07fdb8dce712 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:34.677249 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bbea5e67-bcf4-4eec-b69b-07fdb8dce712 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:34.684368 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bbea5e67-bcf4-4eec-b69b-07fdb8dce712 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:34.687849 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bbea5e67-bcf4-4eec-b69b-07fdb8dce712 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:34.691905 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bbea5e67-bcf4-4eec-b69b-07fdb8dce712 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:34.692523 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bbea5e67-bcf4-4eec-b69b-07fdb8dce712 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:34.695863 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bbea5e67-bcf4-4eec-b69b-07fdb8dce712 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:35.021249 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a05bdc3d-73ed-4f4d-886d-1c498a9e4105 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:35.022271 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a05bdc3d-73ed-4f4d-886d-1c498a9e4105 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:35.051477 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a05bdc3d-73ed-4f4d-886d-1c498a9e4105 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:35.051477 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a05bdc3d-73ed-4f4d-886d-1c498a9e4105 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:35.051477 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a05bdc3d-73ed-4f4d-886d-1c498a9e4105 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:35.052468 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a05bdc3d-73ed-4f4d-886d-1c498a9e4105 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:35.054014 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a05bdc3d-73ed-4f4d-886d-1c498a9e4105 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:35.055772 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a05bdc3d-73ed-4f4d-886d-1c498a9e4105 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:35.068847 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bbea5e67-bcf4-4eec-b69b-07fdb8dce712 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:35.099286 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bbea5e67-bcf4-4eec-b69b-07fdb8dce712 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.426810 Sep 10 12:06:35.100550 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2685/5365] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:34 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:35.141490 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8547e38d-cd53-46cc-aa87-191a8892ef3c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:35.142137 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8547e38d-cd53-46cc-aa87-191a8892ef3c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:35.171436 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8547e38d-cd53-46cc-aa87-191a8892ef3c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:35.178900 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8547e38d-cd53-46cc-aa87-191a8892ef3c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:35.180149 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8547e38d-cd53-46cc-aa87-191a8892ef3c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:35.183911 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8547e38d-cd53-46cc-aa87-191a8892ef3c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:35.184567 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8547e38d-cd53-46cc-aa87-191a8892ef3c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:35.185206 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8547e38d-cd53-46cc-aa87-191a8892ef3c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:35.806355 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8547e38d-cd53-46cc-aa87-191a8892ef3c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:35.831503 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8547e38d-cd53-46cc-aa87-191a8892ef3c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.690679 Sep 10 12:06:35.832542 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2686/5366] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:35 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:35.837603 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2d9be71c-cfcd-413d-987b-7825ba887854 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:35.838533 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2d9be71c-cfcd-413d-987b-7825ba887854 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] [instance: 7b8ebc08-605e-45d8-9e2d-5e07c7be2353] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:35.858853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2d9be71c-cfcd-413d-987b-7825ba887854 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:35.859559 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2d9be71c-cfcd-413d-987b-7825ba887854 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:35.860104 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2d9be71c-cfcd-413d-987b-7825ba887854 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:35.861305 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2d9be71c-cfcd-413d-987b-7825ba887854 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:35.861880 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2d9be71c-cfcd-413d-987b-7825ba887854 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:35.862418 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2d9be71c-cfcd-413d-987b-7825ba887854 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:35.931049 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a05bdc3d-73ed-4f4d-886d-1c498a9e4105 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:35.954053 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a05bdc3d-73ed-4f4d-886d-1c498a9e4105 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.939808 Sep 10 12:06:35.957029 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2681/5367] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:35 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:35.970174 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9910a15d-7e68-4429-83d0-bab875306010 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:06:35.987116 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-9910a15d-7e68-4429-83d0-bab875306010 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] HTTP exception thrown: Instance 3d4ab01d-8bbc-41d0-844c-b644ff3311a8 has no mapping to a cell. Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9910a15d-7e68-4429-83d0-bab875306010 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/servers/3d4ab01d-8bbc-41d0-844c-b644ff3311a8/action HTTP/1.1 Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 15 Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: {"os-stop": {}} Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 3d4ab01d-8bbc-41d0-844c-b644ff3311a8 has no mapping to a cell. Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '3d4ab01d-8bbc-41d0-844c-b644ff3311a8', 'body': {'os-stop': {}}} Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 3d4ab01d-8bbc-41d0-844c-b644ff3311a8 has no mapping to a cell. Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:06:36.003668 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d4ab01d-8bbc-41d0-844c-b644ff3311a8 has no mapping to a cell. Sep 10 12:06:36.009933 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:06:36.009933 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:06:36.009933 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:06:36.009933 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:36.009933 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:06:36.009933 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:06:36.009933 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:06:36.009933 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:06:36.009933 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d4ab01d-8bbc-41d0-844c-b644ff3311a8 has no mapping to a cell. Sep 10 12:06:36.009933 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:06:36.016603 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9910a15d-7e68-4429-83d0-bab875306010 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 404 to user: Instance 3d4ab01d-8bbc-41d0-844c-b644ff3311a8 has no mapping to a cell. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:06:36.017982 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9910a15d-7e68-4429-83d0-bab875306010 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "POST /compute/v2.1/servers/3d4ab01d-8bbc-41d0-844c-b644ff3311a8/action" status: 404 len: 117 microversion: 2.1 time: 0.059810 Sep 10 12:06:36.019037 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2682/5368] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:06:35 2022] POST /compute/v2.1/servers/3d4ab01d-8bbc-41d0-844c-b644ff3311a8/action => generated 117 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:06:36.033057 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-52f0c44d-3c0a-4ad8-b529-4ce8f37170ad tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:36.037146 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-52f0c44d-3c0a-4ad8-b529-4ce8f37170ad tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:36.047415 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52f0c44d-3c0a-4ad8-b529-4ce8f37170ad tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:36.048131 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52f0c44d-3c0a-4ad8-b529-4ce8f37170ad tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:36.048900 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52f0c44d-3c0a-4ad8-b529-4ce8f37170ad tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:36.050330 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52f0c44d-3c0a-4ad8-b529-4ce8f37170ad tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:36.051174 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52f0c44d-3c0a-4ad8-b529-4ce8f37170ad tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:36.051757 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52f0c44d-3c0a-4ad8-b529-4ce8f37170ad tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:36.188252 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2d9be71c-cfcd-413d-987b-7825ba887854 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcbed59a8854e848afb2960fd6af525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b5a220528a4b2b99bb816a78e7de95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:36.207034 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2d9be71c-cfcd-413d-987b-7825ba887854 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] 10.222.0.23 "GET /compute/v2.1/servers/7b8ebc08-605e-45d8-9e2d-5e07c7be2353" status: 200 len: 1313 microversion: 2.1 time: 0.369079 Sep 10 12:06:36.220804 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2687/5369] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:35 2022] GET /compute/v2.1/servers/7b8ebc08-605e-45d8-9e2d-5e07c7be2353 => generated 1313 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:36.239760 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d983f8c6-949b-46b7-8ff7-9eba3e9f32aa tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:36.241759 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d983f8c6-949b-46b7-8ff7-9eba3e9f32aa tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:36.267096 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d983f8c6-949b-46b7-8ff7-9eba3e9f32aa tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:36.269440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d983f8c6-949b-46b7-8ff7-9eba3e9f32aa tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:36.272260 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d983f8c6-949b-46b7-8ff7-9eba3e9f32aa tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:36.275408 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d983f8c6-949b-46b7-8ff7-9eba3e9f32aa tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:36.276253 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d983f8c6-949b-46b7-8ff7-9eba3e9f32aa tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:36.277767 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d983f8c6-949b-46b7-8ff7-9eba3e9f32aa tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:36.549182 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-52f0c44d-3c0a-4ad8-b529-4ce8f37170ad tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:36.579600 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-52f0c44d-3c0a-4ad8-b529-4ce8f37170ad tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.558787 Sep 10 12:06:36.580812 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2683/5370] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:36 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:36.586744 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-67bd3bb5-2c2c-439c-b36b-d99af716c64e req-089d2e45-8616-4d26-9435-fdacb5ea1b37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b8ebc08-605e-45d8-9e2d-5e07c7be2353", "name": "network-vif-plugged", "status": "completed", "tag": "e593592b-8b9d-404f-a172-cf642d5c220b"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:06:36.630422 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-67bd3bb5-2c2c-439c-b36b-d99af716c64e req-089d2e45-8616-4d26-9435-fdacb5ea1b37 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:36.631146 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-67bd3bb5-2c2c-439c-b36b-d99af716c64e req-089d2e45-8616-4d26-9435-fdacb5ea1b37 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:36.634934 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-67bd3bb5-2c2c-439c-b36b-d99af716c64e req-089d2e45-8616-4d26-9435-fdacb5ea1b37 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:36.653094 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-67bd3bb5-2c2c-439c-b36b-d99af716c64e req-089d2e45-8616-4d26-9435-fdacb5ea1b37 service nova] Creating event network-vif-plugged:e593592b-8b9d-404f-a172-cf642d5c220b for instance 7b8ebc08-605e-45d8-9e2d-5e07c7be2353 on n-h1-856895-1 Sep 10 12:06:36.660124 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-67bd3bb5-2c2c-439c-b36b-d99af716c64e req-089d2e45-8616-4d26-9435-fdacb5ea1b37 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077525 Sep 10 12:06:36.661253 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2684/5371] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:06:36.670069 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c6b1ec03-0fb8-4334-9813-2af250d1180f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:36.672848 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c6b1ec03-0fb8-4334-9813-2af250d1180f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:36.682450 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c6b1ec03-0fb8-4334-9813-2af250d1180f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:36.683474 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c6b1ec03-0fb8-4334-9813-2af250d1180f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:36.684280 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c6b1ec03-0fb8-4334-9813-2af250d1180f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:36.686796 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c6b1ec03-0fb8-4334-9813-2af250d1180f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:36.687492 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c6b1ec03-0fb8-4334-9813-2af250d1180f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:36.688811 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c6b1ec03-0fb8-4334-9813-2af250d1180f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:36.998157 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d983f8c6-949b-46b7-8ff7-9eba3e9f32aa tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:37.011715 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d983f8c6-949b-46b7-8ff7-9eba3e9f32aa tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.778882 Sep 10 12:06:37.013473 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2688/5372] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:36 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:37.043827 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f745ccc7-4bd4-45bd-b718-1152da9c3d3c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:37.044469 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f745ccc7-4bd4-45bd-b718-1152da9c3d3c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:37.054462 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f745ccc7-4bd4-45bd-b718-1152da9c3d3c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:37.055605 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f745ccc7-4bd4-45bd-b718-1152da9c3d3c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:37.056968 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f745ccc7-4bd4-45bd-b718-1152da9c3d3c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:37.057978 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f745ccc7-4bd4-45bd-b718-1152da9c3d3c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:37.058654 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f745ccc7-4bd4-45bd-b718-1152da9c3d3c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:37.059303 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f745ccc7-4bd4-45bd-b718-1152da9c3d3c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:37.269895 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c6b1ec03-0fb8-4334-9813-2af250d1180f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:37.277529 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c6b1ec03-0fb8-4334-9813-2af250d1180f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.614853 Sep 10 12:06:37.287696 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2685/5373] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:36 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:37.307707 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2c75af74-9aea-46e5-a900-2085c3c12f2b tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:37.308572 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2c75af74-9aea-46e5-a900-2085c3c12f2b tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] [instance: 7b8ebc08-605e-45d8-9e2d-5e07c7be2353] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:37.321156 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2c75af74-9aea-46e5-a900-2085c3c12f2b tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:37.321985 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2c75af74-9aea-46e5-a900-2085c3c12f2b tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:37.322574 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2c75af74-9aea-46e5-a900-2085c3c12f2b tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:37.323710 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2c75af74-9aea-46e5-a900-2085c3c12f2b tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:37.324317 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2c75af74-9aea-46e5-a900-2085c3c12f2b tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:37.324968 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2c75af74-9aea-46e5-a900-2085c3c12f2b tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:37.449742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f745ccc7-4bd4-45bd-b718-1152da9c3d3c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:37.458434 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f745ccc7-4bd4-45bd-b718-1152da9c3d3c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.420828 Sep 10 12:06:37.459696 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2689/5374] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:37 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:37.465562 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bebc7192-51a2-414d-8bbc-85b62226f8cf tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:37.466462 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bebc7192-51a2-414d-8bbc-85b62226f8cf tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:37.472830 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bebc7192-51a2-414d-8bbc-85b62226f8cf tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:37.473600 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bebc7192-51a2-414d-8bbc-85b62226f8cf tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:37.474322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bebc7192-51a2-414d-8bbc-85b62226f8cf tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:37.475497 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bebc7192-51a2-414d-8bbc-85b62226f8cf tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:37.476164 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bebc7192-51a2-414d-8bbc-85b62226f8cf tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:37.477679 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bebc7192-51a2-414d-8bbc-85b62226f8cf tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:38.134892 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2c75af74-9aea-46e5-a900-2085c3c12f2b tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcbed59a8854e848afb2960fd6af525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b5a220528a4b2b99bb816a78e7de95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:38.143980 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2c75af74-9aea-46e5-a900-2085c3c12f2b tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] 10.222.0.23 "GET /compute/v2.1/servers/7b8ebc08-605e-45d8-9e2d-5e07c7be2353" status: 200 len: 1313 microversion: 2.1 time: 0.854964 Sep 10 12:06:38.146065 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2686/5375] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:37 2022] GET /compute/v2.1/servers/7b8ebc08-605e-45d8-9e2d-5e07c7be2353 => generated 1313 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:38.158753 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a99dd74e-306c-47ec-a400-3485a2bdd0d7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:06:38.159561 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a99dd74e-306c-47ec-a400-3485a2bdd0d7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: da831c1c-df40-4d74-9a1c-9ea88b6bb57e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:38.182776 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-a99dd74e-306c-47ec-a400-3485a2bdd0d7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] HTTP exception thrown: Instance da831c1c-df40-4d74-9a1c-9ea88b6bb57e could not be found. Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a99dd74e-306c-47ec-a400-3485a2bdd0d7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/servers/da831c1c-df40-4d74-9a1c-9ea88b6bb57e/action HTTP/1.1 Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 15 Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: {"suspend": {}} Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance da831c1c-df40-4d74-9a1c-9ea88b6bb57e could not be found. Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'da831c1c-df40-4d74-9a1c-9ea88b6bb57e', 'body': {'suspend': {}}} Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da831c1c-df40-4d74-9a1c-9ea88b6bb57e could not be found. Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da831c1c-df40-4d74-9a1c-9ea88b6bb57e could not be found. Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:06:38.184776 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:06:38.188382 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:06:38.188382 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:06:38.188382 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da831c1c-df40-4d74-9a1c-9ea88b6bb57e could not be found. Sep 10 12:06:38.188382 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:06:38.189936 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a99dd74e-306c-47ec-a400-3485a2bdd0d7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 404 to user: Instance da831c1c-df40-4d74-9a1c-9ea88b6bb57e could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:06:38.191231 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a99dd74e-306c-47ec-a400-3485a2bdd0d7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "POST /compute/v2.1/servers/da831c1c-df40-4d74-9a1c-9ea88b6bb57e/action" status: 404 len: 111 microversion: 2.1 time: 0.043722 Sep 10 12:06:38.192079 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2687/5376] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:06:38 2022] POST /compute/v2.1/servers/da831c1c-df40-4d74-9a1c-9ea88b6bb57e/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:06:38.202043 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ae5891be-c91d-4f42-beb5-d00c67a860ae tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:38.203040 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ae5891be-c91d-4f42-beb5-d00c67a860ae tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:38.214552 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ae5891be-c91d-4f42-beb5-d00c67a860ae tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:38.215452 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ae5891be-c91d-4f42-beb5-d00c67a860ae tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:38.216119 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ae5891be-c91d-4f42-beb5-d00c67a860ae tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:38.217507 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ae5891be-c91d-4f42-beb5-d00c67a860ae tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:38.218301 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ae5891be-c91d-4f42-beb5-d00c67a860ae tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:38.219085 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ae5891be-c91d-4f42-beb5-d00c67a860ae tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:38.220275 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bebc7192-51a2-414d-8bbc-85b62226f8cf tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:38.232682 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bebc7192-51a2-414d-8bbc-85b62226f8cf tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.771726 Sep 10 12:06:38.236891 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2690/5377] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:37 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:38.383663 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f9f03f12-0f25-4963-9aba-8a40a7fe88c0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-250371406", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "2b93427c-8a73-4134-b29e-29ba6a3e29a6"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:06:38.454437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-f9f03f12-0f25-4963-9aba-8a40a7fe88c0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] validate_networks() for [('2b93427c-8a73-4134-b29e-29ba6a3e29a6', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:06:38.529551 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ae5891be-c91d-4f42-beb5-d00c67a860ae tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:38.537872 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ae5891be-c91d-4f42-beb5-d00c67a860ae tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.340985 Sep 10 12:06:38.539189 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2688/5378] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:38 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:38.564675 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-85601264-80c4-4a35-ad42-22ddd21f616d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:38.565303 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-85601264-80c4-4a35-ad42-22ddd21f616d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:38.582746 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85601264-80c4-4a35-ad42-22ddd21f616d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:38.585752 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85601264-80c4-4a35-ad42-22ddd21f616d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:38.586734 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85601264-80c4-4a35-ad42-22ddd21f616d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:38.594775 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85601264-80c4-4a35-ad42-22ddd21f616d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:38.595833 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85601264-80c4-4a35-ad42-22ddd21f616d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:38.596337 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85601264-80c4-4a35-ad42-22ddd21f616d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:39.027809 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-85601264-80c4-4a35-ad42-22ddd21f616d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:39.041101 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-85601264-80c4-4a35-ad42-22ddd21f616d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.480452 Sep 10 12:06:39.043989 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2689/5379] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:38 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:39.074120 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8bac1147-4b37-4b81-a5a9-0c7e6265dc53 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:06:39.074753 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8bac1147-4b37-4b81-a5a9-0c7e6265dc53 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:39.085483 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8bac1147-4b37-4b81-a5a9-0c7e6265dc53 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:39.086908 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8bac1147-4b37-4b81-a5a9-0c7e6265dc53 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:39.088412 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8bac1147-4b37-4b81-a5a9-0c7e6265dc53 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:39.089664 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8bac1147-4b37-4b81-a5a9-0c7e6265dc53 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:39.090291 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8bac1147-4b37-4b81-a5a9-0c7e6265dc53 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:39.090908 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8bac1147-4b37-4b81-a5a9-0c7e6265dc53 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:39.132590 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-8bac1147-4b37-4b81-a5a9-0c7e6265dc53 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lazy-loading 'flavor' on Instance uuid ac1538e5-6edc-4ccb-b7a9-c2e90284e004 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:06:39.136817 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:06:39.248003 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8bac1147-4b37-4b81-a5a9-0c7e6265dc53 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "POST /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004/action" status: 202 len: 0 microversion: 2.1 time: 0.180219 Sep 10 12:06:39.248837 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2690/5380] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:06:39 2022] POST /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:06:39.260747 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-72c94f09-e79c-4574-b3dd-97cc12e699e8 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:39.264439 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-72c94f09-e79c-4574-b3dd-97cc12e699e8 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] [instance: 7b8ebc08-605e-45d8-9e2d-5e07c7be2353] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:39.282898 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-72c94f09-e79c-4574-b3dd-97cc12e699e8 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:39.283427 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-72c94f09-e79c-4574-b3dd-97cc12e699e8 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:39.284041 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-72c94f09-e79c-4574-b3dd-97cc12e699e8 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:39.285010 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-72c94f09-e79c-4574-b3dd-97cc12e699e8 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:39.285683 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-72c94f09-e79c-4574-b3dd-97cc12e699e8 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:39.286327 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-72c94f09-e79c-4574-b3dd-97cc12e699e8 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:39.671033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-72c94f09-e79c-4574-b3dd-97cc12e699e8 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcbed59a8854e848afb2960fd6af525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b5a220528a4b2b99bb816a78e7de95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:39.683979 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-72c94f09-e79c-4574-b3dd-97cc12e699e8 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] 10.222.0.23 "GET /compute/v2.1/servers/7b8ebc08-605e-45d8-9e2d-5e07c7be2353" status: 200 len: 1497 microversion: 2.1 time: 0.432894 Sep 10 12:06:39.686151 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2691/5381] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:39 2022] GET /compute/v2.1/servers/7b8ebc08-605e-45d8-9e2d-5e07c7be2353 => generated 1497 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:39.705654 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-73d8bb40-903c-4d5d-b5cb-70517ddef589 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:39.706291 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-73d8bb40-903c-4d5d-b5cb-70517ddef589 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:39.720679 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-73d8bb40-903c-4d5d-b5cb-70517ddef589 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:39.721321 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-73d8bb40-903c-4d5d-b5cb-70517ddef589 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:39.721626 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-73d8bb40-903c-4d5d-b5cb-70517ddef589 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:39.722342 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-73d8bb40-903c-4d5d-b5cb-70517ddef589 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:39.726999 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-73d8bb40-903c-4d5d-b5cb-70517ddef589 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:39.728047 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-73d8bb40-903c-4d5d-b5cb-70517ddef589 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:39.946950 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-f9f03f12-0f25-4963-9aba-8a40a7fe88c0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:06:39.947425 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-f9f03f12-0f25-4963-9aba-8a40a7fe88c0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:06:39.947930 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-f9f03f12-0f25-4963-9aba-8a40a7fe88c0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:06:39.948642 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-f9f03f12-0f25-4963-9aba-8a40a7fe88c0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:06:39.949081 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-f9f03f12-0f25-4963-9aba-8a40a7fe88c0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:06:39.964586 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f9f03f12-0f25-4963-9aba-8a40a7fe88c0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:39.965091 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f9f03f12-0f25-4963-9aba-8a40a7fe88c0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:39.965540 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f9f03f12-0f25-4963-9aba-8a40a7fe88c0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:39.966280 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f9f03f12-0f25-4963-9aba-8a40a7fe88c0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:39.966747 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f9f03f12-0f25-4963-9aba-8a40a7fe88c0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:39.967198 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f9f03f12-0f25-4963-9aba-8a40a7fe88c0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:40.014761 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-f9f03f12-0f25-4963-9aba-8a40a7fe88c0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Getting quotas for project 2410f9544bec4633988e1554111c9446. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:06:40.025433 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-f9f03f12-0f25-4963-9aba-8a40a7fe88c0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Getting quotas for user 8954f3256ddd49639ea57a9242a296d0 and project 2410f9544bec4633988e1554111c9446. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:06:40.070910 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f9f03f12-0f25-4963-9aba-8a40a7fe88c0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:06:40.077927 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f9f03f12-0f25-4963-9aba-8a40a7fe88c0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: f4c6978c-b7f7-426b-b92a-2f50b1940b2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:06:40.228578 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f9f03f12-0f25-4963-9aba-8a40a7fe88c0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.852746 Sep 10 12:06:40.234399 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2691/5382] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:06:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:06:40.248243 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b1c4c7bd-b274-4172-b50a-36f1dacd3163 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:40.249127 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b1c4c7bd-b274-4172-b50a-36f1dacd3163 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: f4c6978c-b7f7-426b-b92a-2f50b1940b2f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:40.502528 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-73d8bb40-903c-4d5d-b5cb-70517ddef589 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:40.516977 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-73d8bb40-903c-4d5d-b5cb-70517ddef589 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1515 microversion: 2.1 time: 0.828677 Sep 10 12:06:40.517778 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2692/5383] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:39 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1515 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:40.529050 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b1c4c7bd-b274-4172-b50a-36f1dacd3163 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:40.541081 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b1c4c7bd-b274-4172-b50a-36f1dacd3163 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/f4c6978c-b7f7-426b-b92a-2f50b1940b2f" status: 200 len: 1214 microversion: 2.1 time: 0.295018 Sep 10 12:06:40.543545 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2692/5384] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:40 2022] GET /compute/v2.1/servers/f4c6978c-b7f7-426b-b92a-2f50b1940b2f => generated 1214 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:06:40.544370 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b9885a50-7c66-48f3-af34-f59b0d8f3fe8 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:40.545106 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b9885a50-7c66-48f3-af34-f59b0d8f3fe8 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] [instance: 7b8ebc08-605e-45d8-9e2d-5e07c7be2353] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:40.560432 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9885a50-7c66-48f3-af34-f59b0d8f3fe8 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:40.560948 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9885a50-7c66-48f3-af34-f59b0d8f3fe8 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:40.561388 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9885a50-7c66-48f3-af34-f59b0d8f3fe8 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:40.563773 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9885a50-7c66-48f3-af34-f59b0d8f3fe8 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:40.566259 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9885a50-7c66-48f3-af34-f59b0d8f3fe8 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:40.567048 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9885a50-7c66-48f3-af34-f59b0d8f3fe8 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:40.643661 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b9885a50-7c66-48f3-af34-f59b0d8f3fe8 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] [instance: 7b8ebc08-605e-45d8-9e2d-5e07c7be2353] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:06:40.813076 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b9885a50-7c66-48f3-af34-f59b0d8f3fe8 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7b8ebc08-605e-45d8-9e2d-5e07c7be2353" status: 204 len: 0 microversion: 2.1 time: 0.289984 Sep 10 12:06:40.828835 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2693/5385] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:06:40 2022] DELETE /compute/v2.1/servers/7b8ebc08-605e-45d8-9e2d-5e07c7be2353 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:06:40.837970 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-db544c99-5d94-4458-a801-0f902a839e97 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:40.838601 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-db544c99-5d94-4458-a801-0f902a839e97 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] [instance: 7b8ebc08-605e-45d8-9e2d-5e07c7be2353] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:40.850283 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db544c99-5d94-4458-a801-0f902a839e97 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:40.852280 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db544c99-5d94-4458-a801-0f902a839e97 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:40.852717 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db544c99-5d94-4458-a801-0f902a839e97 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:40.854557 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db544c99-5d94-4458-a801-0f902a839e97 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:40.856132 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db544c99-5d94-4458-a801-0f902a839e97 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:40.856583 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db544c99-5d94-4458-a801-0f902a839e97 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:41.225903 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-db544c99-5d94-4458-a801-0f902a839e97 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcbed59a8854e848afb2960fd6af525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b5a220528a4b2b99bb816a78e7de95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:41.252671 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-db544c99-5d94-4458-a801-0f902a839e97 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] 10.222.0.23 "GET /compute/v2.1/servers/7b8ebc08-605e-45d8-9e2d-5e07c7be2353" status: 200 len: 1503 microversion: 2.1 time: 0.419195 Sep 10 12:06:41.253284 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2693/5386] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:40 2022] GET /compute/v2.1/servers/7b8ebc08-605e-45d8-9e2d-5e07c7be2353 => generated 1503 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:41.543309 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-eff99f7e-e053-4ee7-a574-57e142af996e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:41.544278 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-eff99f7e-e053-4ee7-a574-57e142af996e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:41.552319 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eff99f7e-e053-4ee7-a574-57e142af996e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:41.553611 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eff99f7e-e053-4ee7-a574-57e142af996e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:41.554228 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eff99f7e-e053-4ee7-a574-57e142af996e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:41.558540 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eff99f7e-e053-4ee7-a574-57e142af996e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:41.559046 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eff99f7e-e053-4ee7-a574-57e142af996e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:41.559542 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eff99f7e-e053-4ee7-a574-57e142af996e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:41.569786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-62e55cf4-3f82-452c-88c5-70865e40167d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:41.571755 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-62e55cf4-3f82-452c-88c5-70865e40167d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: f4c6978c-b7f7-426b-b92a-2f50b1940b2f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:41.580512 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-62e55cf4-3f82-452c-88c5-70865e40167d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:41.581376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-62e55cf4-3f82-452c-88c5-70865e40167d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:41.582080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-62e55cf4-3f82-452c-88c5-70865e40167d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:41.584047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-62e55cf4-3f82-452c-88c5-70865e40167d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:41.584541 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-62e55cf4-3f82-452c-88c5-70865e40167d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:41.584988 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-62e55cf4-3f82-452c-88c5-70865e40167d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:41.698506 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-62e55cf4-3f82-452c-88c5-70865e40167d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:41.707941 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-62e55cf4-3f82-452c-88c5-70865e40167d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/f4c6978c-b7f7-426b-b92a-2f50b1940b2f" status: 200 len: 1266 microversion: 2.1 time: 0.143945 Sep 10 12:06:41.719772 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2694/5387] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:41 2022] GET /compute/v2.1/servers/f4c6978c-b7f7-426b-b92a-2f50b1940b2f => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:06:41.797255 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-eff99f7e-e053-4ee7-a574-57e142af996e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:41.806322 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-eff99f7e-e053-4ee7-a574-57e142af996e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1498 microversion: 2.1 time: 0.267580 Sep 10 12:06:41.807341 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2694/5388] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:41 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1498 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:41.834917 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-afd0b302-49ff-4a00-82cc-d230fcc8e866 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:06:41.835871 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-afd0b302-49ff-4a00-82cc-d230fcc8e866 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:41.843826 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-afd0b302-49ff-4a00-82cc-d230fcc8e866 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:41.847304 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-afd0b302-49ff-4a00-82cc-d230fcc8e866 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:41.847933 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-afd0b302-49ff-4a00-82cc-d230fcc8e866 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:41.848769 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-afd0b302-49ff-4a00-82cc-d230fcc8e866 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:41.849538 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-afd0b302-49ff-4a00-82cc-d230fcc8e866 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:41.851502 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-afd0b302-49ff-4a00-82cc-d230fcc8e866 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:41.880305 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-afd0b302-49ff-4a00-82cc-d230fcc8e866 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lazy-loading 'flavor' on Instance uuid ac1538e5-6edc-4ccb-b7a9-c2e90284e004 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:06:41.895849 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-afd0b302-49ff-4a00-82cc-d230fcc8e866 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] HTTP exception thrown: Cannot 'suspend' instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 while it is in vm_state suspended Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-afd0b302-49ff-4a00-82cc-d230fcc8e866 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004/action HTTP/1.1 Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 15 Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: {"suspend": {}} Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: exception: Cannot 'suspend' instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 while it is in vm_state suspended Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'ac1538e5-6edc-4ccb-b7a9-c2e90284e004', 'body': {'suspend': {}}} Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 in vm_state suspended. Cannot suspend while the instance is in this state. Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Sep 10 12:06:41.898340 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 10 12:06:41.902720 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 12:06:41.902720 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 12:06:41.902720 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 while it is in vm_state suspended Sep 10 12:06:41.902720 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:06:41.902720 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:06:41.902720 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:06:41.902720 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:41.902720 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:06:41.902720 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:06:41.902720 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:06:41.902720 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:06:41.902720 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 while it is in vm_state suspended Sep 10 12:06:41.902720 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:06:41.907210 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-afd0b302-49ff-4a00-82cc-d230fcc8e866 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 409 to user: Cannot 'suspend' instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 while it is in vm_state suspended {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:06:41.908439 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-afd0b302-49ff-4a00-82cc-d230fcc8e866 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "POST /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004/action" status: 409 len: 148 microversion: 2.1 time: 0.081186 Sep 10 12:06:41.912248 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2695/5389] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:06:41 2022] POST /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004/action => generated 148 bytes in 86 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 12:06:41.918646 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bfdce539-7381-40c2-b5e4-35f493fea00c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:06:41.920420 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bfdce539-7381-40c2-b5e4-35f493fea00c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:41.926858 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bfdce539-7381-40c2-b5e4-35f493fea00c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:41.927447 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bfdce539-7381-40c2-b5e4-35f493fea00c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:41.928089 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bfdce539-7381-40c2-b5e4-35f493fea00c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:41.928771 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bfdce539-7381-40c2-b5e4-35f493fea00c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:41.930006 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bfdce539-7381-40c2-b5e4-35f493fea00c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:41.930560 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bfdce539-7381-40c2-b5e4-35f493fea00c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:42.004718 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bfdce539-7381-40c2-b5e4-35f493fea00c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "POST /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004/action" status: 202 len: 0 microversion: 2.1 time: 0.090509 Sep 10 12:06:42.006347 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2695/5390] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:06:41 2022] POST /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:06:42.017005 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-396152e3-6f5c-4608-8268-e157b1dec60a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:42.017955 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-396152e3-6f5c-4608-8268-e157b1dec60a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:42.030737 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-396152e3-6f5c-4608-8268-e157b1dec60a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:42.032639 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-396152e3-6f5c-4608-8268-e157b1dec60a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:42.033254 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-396152e3-6f5c-4608-8268-e157b1dec60a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:42.034121 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-396152e3-6f5c-4608-8268-e157b1dec60a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:42.034730 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-396152e3-6f5c-4608-8268-e157b1dec60a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:42.035587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-396152e3-6f5c-4608-8268-e157b1dec60a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:42.278743 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-319ba84d-d4fb-4617-abce-24c5cded2d1a tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:42.279779 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-319ba84d-d4fb-4617-abce-24c5cded2d1a tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] [instance: 7b8ebc08-605e-45d8-9e2d-5e07c7be2353] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:42.296243 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-319ba84d-d4fb-4617-abce-24c5cded2d1a tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:42.297149 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-319ba84d-d4fb-4617-abce-24c5cded2d1a tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:42.307770 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-319ba84d-d4fb-4617-abce-24c5cded2d1a tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:42.309514 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-319ba84d-d4fb-4617-abce-24c5cded2d1a tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:42.310165 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-319ba84d-d4fb-4617-abce-24c5cded2d1a tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:42.311764 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-319ba84d-d4fb-4617-abce-24c5cded2d1a tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:43.022719 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-396152e3-6f5c-4608-8268-e157b1dec60a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:43.031359 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-396152e3-6f5c-4608-8268-e157b1dec60a tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1504 microversion: 2.1 time: 1.020406 Sep 10 12:06:43.031947 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2696/5391] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:42 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1504 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:43.063638 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d83bb983-103c-44f9-a1a3-132b39c85b6a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:43.065032 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d83bb983-103c-44f9-a1a3-132b39c85b6a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: f4c6978c-b7f7-426b-b92a-2f50b1940b2f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:43.073715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d83bb983-103c-44f9-a1a3-132b39c85b6a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:43.074497 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d83bb983-103c-44f9-a1a3-132b39c85b6a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:43.075053 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d83bb983-103c-44f9-a1a3-132b39c85b6a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:43.075860 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d83bb983-103c-44f9-a1a3-132b39c85b6a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:43.076535 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d83bb983-103c-44f9-a1a3-132b39c85b6a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:43.077285 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d83bb983-103c-44f9-a1a3-132b39c85b6a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:43.358837 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d83bb983-103c-44f9-a1a3-132b39c85b6a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:43.372186 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d83bb983-103c-44f9-a1a3-132b39c85b6a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/f4c6978c-b7f7-426b-b92a-2f50b1940b2f" status: 200 len: 1272 microversion: 2.1 time: 0.317821 Sep 10 12:06:43.387485 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2697/5392] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:43 2022] GET /compute/v2.1/servers/f4c6978c-b7f7-426b-b92a-2f50b1940b2f => generated 1272 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:43.609369 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-319ba84d-d4fb-4617-abce-24c5cded2d1a tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcbed59a8854e848afb2960fd6af525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b5a220528a4b2b99bb816a78e7de95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:43.623571 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-319ba84d-d4fb-4617-abce-24c5cded2d1a tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] 10.222.0.23 "GET /compute/v2.1/servers/7b8ebc08-605e-45d8-9e2d-5e07c7be2353" status: 200 len: 1503 microversion: 2.1 time: 1.350765 Sep 10 12:06:43.624972 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2696/5393] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:42 2022] GET /compute/v2.1/servers/7b8ebc08-605e-45d8-9e2d-5e07c7be2353 => generated 1503 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:06:44.064015 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-214eeef9-eac5-4b35-b079-f5ac51e6a41c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:44.064793 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-214eeef9-eac5-4b35-b079-f5ac51e6a41c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:44.095415 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-214eeef9-eac5-4b35-b079-f5ac51e6a41c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:44.095987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-214eeef9-eac5-4b35-b079-f5ac51e6a41c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:44.096496 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-214eeef9-eac5-4b35-b079-f5ac51e6a41c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:44.097457 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-214eeef9-eac5-4b35-b079-f5ac51e6a41c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:44.099448 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-214eeef9-eac5-4b35-b079-f5ac51e6a41c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:44.099961 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-214eeef9-eac5-4b35-b079-f5ac51e6a41c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:44.407045 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-171bab16-3054-4b50-a7f2-1ed13d0d8e53 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:44.409096 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-171bab16-3054-4b50-a7f2-1ed13d0d8e53 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: f4c6978c-b7f7-426b-b92a-2f50b1940b2f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:44.430841 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-171bab16-3054-4b50-a7f2-1ed13d0d8e53 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:44.432699 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-171bab16-3054-4b50-a7f2-1ed13d0d8e53 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:44.434394 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-171bab16-3054-4b50-a7f2-1ed13d0d8e53 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:44.438303 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-171bab16-3054-4b50-a7f2-1ed13d0d8e53 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:44.441042 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-171bab16-3054-4b50-a7f2-1ed13d0d8e53 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:44.441519 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-171bab16-3054-4b50-a7f2-1ed13d0d8e53 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:44.624551 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-171bab16-3054-4b50-a7f2-1ed13d0d8e53 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:44.635485 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-171bab16-3054-4b50-a7f2-1ed13d0d8e53 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/f4c6978c-b7f7-426b-b92a-2f50b1940b2f" status: 200 len: 1272 microversion: 2.1 time: 0.241280 Sep 10 12:06:44.636525 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2697/5394] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:44 2022] GET /compute/v2.1/servers/f4c6978c-b7f7-426b-b92a-2f50b1940b2f => generated 1272 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:06:44.641972 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-214eeef9-eac5-4b35-b079-f5ac51e6a41c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:44.657514 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-214eeef9-eac5-4b35-b079-f5ac51e6a41c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1504 microversion: 2.1 time: 0.602836 Sep 10 12:06:44.658356 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2698/5395] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:44 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1504 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:44.662626 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-35c56fbd-5cb0-44e8-9f6d-7bff1b8fc1be req-0b374017-0eca-4994-ba1e-877e3aaa62b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b8ebc08-605e-45d8-9e2d-5e07c7be2353", "name": "network-vif-deleted", "tag": "e593592b-8b9d-404f-a172-cf642d5c220b"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:06:44.664633 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d3dbbf2f-822d-460d-acc9-4c9d80c8747d tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:44.665452 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d3dbbf2f-822d-460d-acc9-4c9d80c8747d tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] [instance: 7b8ebc08-605e-45d8-9e2d-5e07c7be2353] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:44.677775 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3dbbf2f-822d-460d-acc9-4c9d80c8747d tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:44.681176 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3dbbf2f-822d-460d-acc9-4c9d80c8747d tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:44.682076 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3dbbf2f-822d-460d-acc9-4c9d80c8747d tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:44.683039 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3dbbf2f-822d-460d-acc9-4c9d80c8747d tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:44.683882 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3dbbf2f-822d-460d-acc9-4c9d80c8747d tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:44.686090 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3dbbf2f-822d-460d-acc9-4c9d80c8747d tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:44.692225 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=100 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:06:44.697884 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-35c56fbd-5cb0-44e8-9f6d-7bff1b8fc1be req-0b374017-0eca-4994-ba1e-877e3aaa62b6 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:44.698946 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-35c56fbd-5cb0-44e8-9f6d-7bff1b8fc1be req-0b374017-0eca-4994-ba1e-877e3aaa62b6 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:44.699848 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-35c56fbd-5cb0-44e8-9f6d-7bff1b8fc1be req-0b374017-0eca-4994-ba1e-877e3aaa62b6 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:44.735200 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-35c56fbd-5cb0-44e8-9f6d-7bff1b8fc1be req-0b374017-0eca-4994-ba1e-877e3aaa62b6 service nova] Creating event network-vif-deleted:e593592b-8b9d-404f-a172-cf642d5c220b for instance 7b8ebc08-605e-45d8-9e2d-5e07c7be2353 on n-h1-856895-1 Sep 10 12:06:44.759816 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-35c56fbd-5cb0-44e8-9f6d-7bff1b8fc1be req-0b374017-0eca-4994-ba1e-877e3aaa62b6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121829 Sep 10 12:06:44.760443 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2698/5396] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:06:44.829780 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d3dbbf2f-822d-460d-acc9-4c9d80c8747d tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcbed59a8854e848afb2960fd6af525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b5a220528a4b2b99bb816a78e7de95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:44.840523 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d3dbbf2f-822d-460d-acc9-4c9d80c8747d tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] 10.222.0.23 "GET /compute/v2.1/servers/7b8ebc08-605e-45d8-9e2d-5e07c7be2353" status: 200 len: 1298 microversion: 2.1 time: 0.180923 Sep 10 12:06:44.843924 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2699/5397] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:44 2022] GET /compute/v2.1/servers/7b8ebc08-605e-45d8-9e2d-5e07c7be2353 => generated 1298 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:45.659246 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5e12a15f-7b0d-4728-993a-7b3c2a5d52e9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:45.660000 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5e12a15f-7b0d-4728-993a-7b3c2a5d52e9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: f4c6978c-b7f7-426b-b92a-2f50b1940b2f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:45.668013 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5e12a15f-7b0d-4728-993a-7b3c2a5d52e9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:45.668728 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5e12a15f-7b0d-4728-993a-7b3c2a5d52e9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:45.669419 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5e12a15f-7b0d-4728-993a-7b3c2a5d52e9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:45.670202 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5e12a15f-7b0d-4728-993a-7b3c2a5d52e9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:45.670937 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5e12a15f-7b0d-4728-993a-7b3c2a5d52e9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:45.671451 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5e12a15f-7b0d-4728-993a-7b3c2a5d52e9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:45.681454 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0befe9b9-9e74-4ba1-bea4-e9dbc4473564 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:45.682603 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0befe9b9-9e74-4ba1-bea4-e9dbc4473564 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:45.690422 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0befe9b9-9e74-4ba1-bea4-e9dbc4473564 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:45.691143 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0befe9b9-9e74-4ba1-bea4-e9dbc4473564 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:45.691790 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0befe9b9-9e74-4ba1-bea4-e9dbc4473564 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:45.692746 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0befe9b9-9e74-4ba1-bea4-e9dbc4473564 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:45.693363 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0befe9b9-9e74-4ba1-bea4-e9dbc4473564 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:45.693947 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0befe9b9-9e74-4ba1-bea4-e9dbc4473564 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:46.043077 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5e12a15f-7b0d-4728-993a-7b3c2a5d52e9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:46.064133 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0befe9b9-9e74-4ba1-bea4-e9dbc4473564 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:46.079909 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5e12a15f-7b0d-4728-993a-7b3c2a5d52e9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/f4c6978c-b7f7-426b-b92a-2f50b1940b2f" status: 200 len: 1314 microversion: 2.1 time: 0.425672 Sep 10 12:06:46.081959 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0befe9b9-9e74-4ba1-bea4-e9dbc4473564 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.404015 Sep 10 12:06:46.098081 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2700/5398] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:45 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:46.099093 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2699/5399] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:45 2022] GET /compute/v2.1/servers/f4c6978c-b7f7-426b-b92a-2f50b1940b2f => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:46.114848 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-476296a9-492b-4e42-83d6-caa2fe5145c5 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:46.116344 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-476296a9-492b-4e42-83d6-caa2fe5145c5 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] [instance: 7b8ebc08-605e-45d8-9e2d-5e07c7be2353] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:46.139841 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-476296a9-492b-4e42-83d6-caa2fe5145c5 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:46.140335 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-476296a9-492b-4e42-83d6-caa2fe5145c5 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:46.140772 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-476296a9-492b-4e42-83d6-caa2fe5145c5 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:46.140952 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-39e07a61-7956-4a5a-b45f-24aa46ba219f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:46.141478 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-476296a9-492b-4e42-83d6-caa2fe5145c5 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:46.141787 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-39e07a61-7956-4a5a-b45f-24aa46ba219f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:46.141928 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-476296a9-492b-4e42-83d6-caa2fe5145c5 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:46.142356 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-476296a9-492b-4e42-83d6-caa2fe5145c5 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:46.150292 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-39e07a61-7956-4a5a-b45f-24aa46ba219f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:46.150901 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-39e07a61-7956-4a5a-b45f-24aa46ba219f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:46.151487 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-39e07a61-7956-4a5a-b45f-24aa46ba219f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:46.155517 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-39e07a61-7956-4a5a-b45f-24aa46ba219f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:46.155517 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-39e07a61-7956-4a5a-b45f-24aa46ba219f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:46.155517 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-39e07a61-7956-4a5a-b45f-24aa46ba219f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:46.166287 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-476296a9-492b-4e42-83d6-caa2fe5145c5 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] HTTP exception thrown: Instance 7b8ebc08-605e-45d8-9e2d-5e07c7be2353 could not be found. Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-476296a9-492b-4e42-83d6-caa2fe5145c5 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Request method failure captured: Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/7b8ebc08-605e-45d8-9e2d-5e07c7be2353 HTTP/1.1 Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH258nXHw8nveNuMwZARhDQigg_x8SxtiKJJ_EbK57K6AKTKeqvec1n9x6rAmfEAXQQ7fswXZ0VRVNODle7QYD0DEK6nel-3JYZKAp9Paoy_rS-xuSSfdAEaKciBlbiBWOGuS-IVRiVDK31t6CzwqI5v30M8EhV_mG7sIKVv-Rk1Sfw Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: c7b5a220528a4b2b99bb816a78e7de95 Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-VolumesActionsTest-2056808459 Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7b5a220528a4b2b99bb816a78e7de95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7b5a220528a4b2b99bb816a78e7de95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c7b5a220528a4b2b99bb816a78e7de95", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c7b5a220528a4b2b99bb816a78e7de95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-VolumesActionsTest-2056808459 Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: c7b5a220528a4b2b99bb816a78e7de95 Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-VolumesActionsTest-2056808459 Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-VolumesActionsTest-2056808459-project Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 0dcbed59a8854e848afb2960fd6af525 Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-VolumesActionsTest-2056808459-project Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 7b8ebc08-605e-45d8-9e2d-5e07c7be2353 could not be found. Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '7b8ebc08-605e-45d8-9e2d-5e07c7be2353'} Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b8ebc08-605e-45d8-9e2d-5e07c7be2353 could not be found. Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b8ebc08-605e-45d8-9e2d-5e07c7be2353 could not be found. Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:06:46.169448 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:06:46.173626 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:46.173626 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:06:46.173626 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:06:46.173626 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:06:46.173626 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:06:46.173626 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b8ebc08-605e-45d8-9e2d-5e07c7be2353 could not be found. Sep 10 12:06:46.173626 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:06:46.175034 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-476296a9-492b-4e42-83d6-caa2fe5145c5 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Returning 404 to user: Instance 7b8ebc08-605e-45d8-9e2d-5e07c7be2353 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:06:46.176160 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-476296a9-492b-4e42-83d6-caa2fe5145c5 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] 10.222.0.23 "GET /compute/v2.1/servers/7b8ebc08-605e-45d8-9e2d-5e07c7be2353" status: 404 len: 111 microversion: 2.1 time: 0.076322 Sep 10 12:06:46.177179 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2701/5400] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:46 2022] GET /compute/v2.1/servers/7b8ebc08-605e-45d8-9e2d-5e07c7be2353 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:06:46.362876 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0b63cf44-5051-4b43-a050-993c5dec58db tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-199145879", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "d2b4bf2e-0237-4936-aa9f-bf43786fc0db"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:06:46.437836 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-39e07a61-7956-4a5a-b45f-24aa46ba219f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:46.446497 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-39e07a61-7956-4a5a-b45f-24aa46ba219f tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.336971 Sep 10 12:06:46.447540 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-0b63cf44-5051-4b43-a050-993c5dec58db tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] validate_networks() for [('d2b4bf2e-0237-4936-aa9f-bf43786fc0db', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:06:46.452737 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2700/5401] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:46 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:06:46.481291 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-55d9c9c9-db63-4a90-9bfb-7323c24b982c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:06:46.481832 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-55d9c9c9-db63-4a90-9bfb-7323c24b982c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: 73926ef0-74d3-45d7-9a89-4d4c46264ed2] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:46.490500 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-55d9c9c9-db63-4a90-9bfb-7323c24b982c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] HTTP exception thrown: Instance 73926ef0-74d3-45d7-9a89-4d4c46264ed2 could not be found. Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-55d9c9c9-db63-4a90-9bfb-7323c24b982c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/servers/73926ef0-74d3-45d7-9a89-4d4c46264ed2/action HTTP/1.1 Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 15 Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: {"unpause": {}} Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 73926ef0-74d3-45d7-9a89-4d4c46264ed2 could not be found. Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '73926ef0-74d3-45d7-9a89-4d4c46264ed2', 'body': {'unpause': {}}} Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73926ef0-74d3-45d7-9a89-4d4c46264ed2 could not be found. Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73926ef0-74d3-45d7-9a89-4d4c46264ed2 could not be found. Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:06:46.493325 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:06:46.498294 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:06:46.498294 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:06:46.498294 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73926ef0-74d3-45d7-9a89-4d4c46264ed2 could not be found. Sep 10 12:06:46.498294 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:06:46.498294 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-55d9c9c9-db63-4a90-9bfb-7323c24b982c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 404 to user: Instance 73926ef0-74d3-45d7-9a89-4d4c46264ed2 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:06:46.498294 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-55d9c9c9-db63-4a90-9bfb-7323c24b982c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "POST /compute/v2.1/servers/73926ef0-74d3-45d7-9a89-4d4c46264ed2/action" status: 404 len: 111 microversion: 2.1 time: 0.017954 Sep 10 12:06:46.503032 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2701/5402] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:06:46 2022] POST /compute/v2.1/servers/73926ef0-74d3-45d7-9a89-4d4c46264ed2/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:06:46.517608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7851aabb-e623-4249-9dbd-6e1c1505da51 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:46.518336 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7851aabb-e623-4249-9dbd-6e1c1505da51 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:46.541216 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7851aabb-e623-4249-9dbd-6e1c1505da51 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:46.543312 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7851aabb-e623-4249-9dbd-6e1c1505da51 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:46.543957 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7851aabb-e623-4249-9dbd-6e1c1505da51 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:46.545546 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7851aabb-e623-4249-9dbd-6e1c1505da51 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:46.546604 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7851aabb-e623-4249-9dbd-6e1c1505da51 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:46.547474 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7851aabb-e623-4249-9dbd-6e1c1505da51 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:46.957840 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7851aabb-e623-4249-9dbd-6e1c1505da51 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:46.969915 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7851aabb-e623-4249-9dbd-6e1c1505da51 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.459464 Sep 10 12:06:46.970552 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2702/5403] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:46 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:06:46.975343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-ba66cb6b-dd81-41d0-bf39-722f9377be24 req-3f21b384-0130-46df-9b0c-aa9296277f17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4c6978c-b7f7-426b-b92a-2f50b1940b2f", "tag": "5df64599-3408-4ea3-9731-91e1f9bc70ad"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:06:46.985905 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ba66cb6b-dd81-41d0-bf39-722f9377be24 req-3f21b384-0130-46df-9b0c-aa9296277f17 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:46.986386 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ba66cb6b-dd81-41d0-bf39-722f9377be24 req-3f21b384-0130-46df-9b0c-aa9296277f17 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:46.987000 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ba66cb6b-dd81-41d0-bf39-722f9377be24 req-3f21b384-0130-46df-9b0c-aa9296277f17 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:47.018124 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-ba66cb6b-dd81-41d0-bf39-722f9377be24 req-3f21b384-0130-46df-9b0c-aa9296277f17 service nova] Creating event network-changed:5df64599-3408-4ea3-9731-91e1f9bc70ad for instance f4c6978c-b7f7-426b-b92a-2f50b1940b2f on n-h2-856895-1 Sep 10 12:06:47.024264 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-ba66cb6b-dd81-41d0-bf39-722f9377be24 req-3f21b384-0130-46df-9b0c-aa9296277f17 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052198 Sep 10 12:06:47.025079 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2703/5404] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:06:47.031685 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-532970de-c7cd-46a9-8fe5-698e034e3fec tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:47.032700 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-532970de-c7cd-46a9-8fe5-698e034e3fec tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:47.040687 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-532970de-c7cd-46a9-8fe5-698e034e3fec tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:47.041464 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-532970de-c7cd-46a9-8fe5-698e034e3fec tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:47.042118 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-532970de-c7cd-46a9-8fe5-698e034e3fec tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:47.043017 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-532970de-c7cd-46a9-8fe5-698e034e3fec tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:47.043706 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-532970de-c7cd-46a9-8fe5-698e034e3fec tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:47.044322 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-532970de-c7cd-46a9-8fe5-698e034e3fec tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:47.359150 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-532970de-c7cd-46a9-8fe5-698e034e3fec tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:47.375268 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-532970de-c7cd-46a9-8fe5-698e034e3fec tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.345507 Sep 10 12:06:47.376301 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2704/5405] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:47 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:47.381212 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e48b0dcf-22b2-4441-ab02-399f9c0cb7ce tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:47.382101 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e48b0dcf-22b2-4441-ab02-399f9c0cb7ce tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: f4c6978c-b7f7-426b-b92a-2f50b1940b2f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:47.388863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e48b0dcf-22b2-4441-ab02-399f9c0cb7ce tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:47.389530 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e48b0dcf-22b2-4441-ab02-399f9c0cb7ce tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:47.390159 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e48b0dcf-22b2-4441-ab02-399f9c0cb7ce tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:47.391010 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e48b0dcf-22b2-4441-ab02-399f9c0cb7ce tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:47.391644 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e48b0dcf-22b2-4441-ab02-399f9c0cb7ce tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:47.392274 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e48b0dcf-22b2-4441-ab02-399f9c0cb7ce tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:47.410346 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:06:47.884332 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-0b63cf44-5051-4b43-a050-993c5dec58db tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:06:47.885656 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-0b63cf44-5051-4b43-a050-993c5dec58db tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:06:47.886480 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-0b63cf44-5051-4b43-a050-993c5dec58db tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:06:47.887314 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-0b63cf44-5051-4b43-a050-993c5dec58db tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:06:47.889474 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-0b63cf44-5051-4b43-a050-993c5dec58db tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:06:47.907210 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0b63cf44-5051-4b43-a050-993c5dec58db tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:47.907937 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0b63cf44-5051-4b43-a050-993c5dec58db tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:47.908680 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0b63cf44-5051-4b43-a050-993c5dec58db tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:47.910352 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0b63cf44-5051-4b43-a050-993c5dec58db tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:47.911404 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0b63cf44-5051-4b43-a050-993c5dec58db tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:47.912520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0b63cf44-5051-4b43-a050-993c5dec58db tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:47.962049 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-0b63cf44-5051-4b43-a050-993c5dec58db tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Getting quotas for project c7b5a220528a4b2b99bb816a78e7de95. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:06:47.969107 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-0b63cf44-5051-4b43-a050-993c5dec58db tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Getting quotas for user 0dcbed59a8854e848afb2960fd6af525 and project c7b5a220528a4b2b99bb816a78e7de95. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:06:47.986059 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0b63cf44-5051-4b43-a050-993c5dec58db tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:06:47.989725 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0b63cf44-5051-4b43-a050-993c5dec58db tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] [instance: d0010d88-9014-48c4-8974-0a14ecf0e3ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:06:48.058076 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0b63cf44-5051-4b43-a050-993c5dec58db tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.698963 Sep 10 12:06:48.060229 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2702/5406] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:06:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 12:06:48.066898 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a7501883-6b2e-4e42-a114-9b1e2e2c00ea tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:06:48.067861 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a7501883-6b2e-4e42-a114-9b1e2e2c00ea tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:48.078787 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a7501883-6b2e-4e42-a114-9b1e2e2c00ea tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:48.079808 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a7501883-6b2e-4e42-a114-9b1e2e2c00ea tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:48.081750 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a7501883-6b2e-4e42-a114-9b1e2e2c00ea tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:48.091813 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a7501883-6b2e-4e42-a114-9b1e2e2c00ea tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:48.093010 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a7501883-6b2e-4e42-a114-9b1e2e2c00ea tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:48.093916 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a7501883-6b2e-4e42-a114-9b1e2e2c00ea tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:48.129584 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e48b0dcf-22b2-4441-ab02-399f9c0cb7ce tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:48.151245 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e48b0dcf-22b2-4441-ab02-399f9c0cb7ce tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/f4c6978c-b7f7-426b-b92a-2f50b1940b2f" status: 200 len: 1314 microversion: 2.1 time: 0.773595 Sep 10 12:06:48.151835 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2705/5407] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:47 2022] GET /compute/v2.1/servers/f4c6978c-b7f7-426b-b92a-2f50b1940b2f => generated 1314 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:48.172616 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9835a1b3-c665-42f9-ab90-48077e89f0a2 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:48.173241 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9835a1b3-c665-42f9-ab90-48077e89f0a2 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] [instance: d0010d88-9014-48c4-8974-0a14ecf0e3ba] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:48.181982 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-a7501883-6b2e-4e42-a114-9b1e2e2c00ea tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] HTTP exception thrown: Cannot 'unpause' instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 while it is in vm_state active Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a7501883-6b2e-4e42-a114-9b1e2e2c00ea tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004/action HTTP/1.1 Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 15 Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: {"unpause": {}} Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: exception: Cannot 'unpause' instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 while it is in vm_state active Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'ac1538e5-6edc-4ccb-b7a9-c2e90284e004', 'body': {'unpause': {}}} Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 in vm_state active. Cannot unpause while the instance is in this state. Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 while it is in vm_state active Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:48.185153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:06:48.188731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:06:48.188731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:06:48.188731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:06:48.188731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 while it is in vm_state active Sep 10 12:06:48.188731 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:06:48.190722 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a7501883-6b2e-4e42-a114-9b1e2e2c00ea tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 409 to user: Cannot 'unpause' instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 while it is in vm_state active {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:06:48.192104 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a7501883-6b2e-4e42-a114-9b1e2e2c00ea tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "POST /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004/action" status: 409 len: 145 microversion: 2.1 time: 0.130156 Sep 10 12:06:48.197721 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2703/5408] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:06:48 2022] POST /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004/action => generated 145 bytes in 136 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 12:06:48.204369 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5cffe725-df65-4e7e-8400-803bbfc4bbc0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:48.205238 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5cffe725-df65-4e7e-8400-803bbfc4bbc0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:48.215540 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5cffe725-df65-4e7e-8400-803bbfc4bbc0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:48.216165 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5cffe725-df65-4e7e-8400-803bbfc4bbc0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:48.216785 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5cffe725-df65-4e7e-8400-803bbfc4bbc0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:48.217653 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5cffe725-df65-4e7e-8400-803bbfc4bbc0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:48.218441 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5cffe725-df65-4e7e-8400-803bbfc4bbc0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:48.219871 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5cffe725-df65-4e7e-8400-803bbfc4bbc0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:48.333596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9835a1b3-c665-42f9-ab90-48077e89f0a2 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcbed59a8854e848afb2960fd6af525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b5a220528a4b2b99bb816a78e7de95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:48.347252 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9835a1b3-c665-42f9-ab90-48077e89f0a2 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] 10.222.0.23 "GET /compute/v2.1/servers/d0010d88-9014-48c4-8974-0a14ecf0e3ba" status: 200 len: 1213 microversion: 2.1 time: 0.185403 Sep 10 12:06:48.348526 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2706/5409] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:48 2022] GET /compute/v2.1/servers/d0010d88-9014-48c4-8974-0a14ecf0e3ba => generated 1213 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:48.513361 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5cffe725-df65-4e7e-8400-803bbfc4bbc0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:48.522608 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5cffe725-df65-4e7e-8400-803bbfc4bbc0 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.323199 Sep 10 12:06:48.524246 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2704/5410] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:48 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:48.550107 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3d89ca6e-a8d6-472d-acc2-33d46f35f630 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:48.550735 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3d89ca6e-a8d6-472d-acc2-33d46f35f630 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:48.576863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3d89ca6e-a8d6-472d-acc2-33d46f35f630 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:48.577386 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3d89ca6e-a8d6-472d-acc2-33d46f35f630 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:48.577837 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3d89ca6e-a8d6-472d-acc2-33d46f35f630 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:48.578559 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3d89ca6e-a8d6-472d-acc2-33d46f35f630 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:48.579024 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3d89ca6e-a8d6-472d-acc2-33d46f35f630 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:48.584100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3d89ca6e-a8d6-472d-acc2-33d46f35f630 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:48.955255 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3d89ca6e-a8d6-472d-acc2-33d46f35f630 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:48.974011 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3d89ca6e-a8d6-472d-acc2-33d46f35f630 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.427690 Sep 10 12:06:48.979834 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2707/5411] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:48 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:49.000460 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c6e60a66-700f-4601-9177-f753df6f3068 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:06:49.003009 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c6e60a66-700f-4601-9177-f753df6f3068 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: e3d58df0-5ccb-4bbe-838b-9b0a94b9aed7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:49.011431 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-c6e60a66-700f-4601-9177-f753df6f3068 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] HTTP exception thrown: Instance e3d58df0-5ccb-4bbe-838b-9b0a94b9aed7 could not be found. Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c6e60a66-700f-4601-9177-f753df6f3068 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers/e3d58df0-5ccb-4bbe-838b-9b0a94b9aed7/action HTTP/1.1 Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 18 Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: {"unshelve": null} Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance e3d58df0-5ccb-4bbe-838b-9b0a94b9aed7 could not be found. Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'e3d58df0-5ccb-4bbe-838b-9b0a94b9aed7', 'body': {'unshelve': None}} Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3d58df0-5ccb-4bbe-838b-9b0a94b9aed7 could not be found. Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3d58df0-5ccb-4bbe-838b-9b0a94b9aed7 could not be found. Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:06:49.014463 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:06:49.018684 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:06:49.018684 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:49.018684 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:06:49.018684 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:06:49.018684 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:06:49.018684 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:06:49.018684 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3d58df0-5ccb-4bbe-838b-9b0a94b9aed7 could not be found. Sep 10 12:06:49.018684 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:06:49.021313 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c6e60a66-700f-4601-9177-f753df6f3068 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 404 to user: Instance e3d58df0-5ccb-4bbe-838b-9b0a94b9aed7 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:06:49.023270 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c6e60a66-700f-4601-9177-f753df6f3068 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "POST /compute/v2.1/servers/e3d58df0-5ccb-4bbe-838b-9b0a94b9aed7/action" status: 404 len: 111 microversion: 2.1 time: 0.027267 Sep 10 12:06:49.036528 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-04d16f6d-51f9-463b-bb00-7ee6d92e48df tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:49.039721 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-04d16f6d-51f9-463b-bb00-7ee6d92e48df tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:49.044903 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2705/5412] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:06:48 2022] POST /compute/v2.1/servers/e3d58df0-5ccb-4bbe-838b-9b0a94b9aed7/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:06:49.051495 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-04d16f6d-51f9-463b-bb00-7ee6d92e48df tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:49.052181 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-04d16f6d-51f9-463b-bb00-7ee6d92e48df tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:49.053216 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-04d16f6d-51f9-463b-bb00-7ee6d92e48df tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:49.054711 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-04d16f6d-51f9-463b-bb00-7ee6d92e48df tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:49.055627 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-04d16f6d-51f9-463b-bb00-7ee6d92e48df tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:49.056274 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-04d16f6d-51f9-463b-bb00-7ee6d92e48df tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:49.176018 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b1ac1eed-177b-4307-91a8-e4198e5a56ef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:49.176634 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b1ac1eed-177b-4307-91a8-e4198e5a56ef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: f4c6978c-b7f7-426b-b92a-2f50b1940b2f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:49.188492 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1ac1eed-177b-4307-91a8-e4198e5a56ef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:49.192398 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1ac1eed-177b-4307-91a8-e4198e5a56ef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:49.193303 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1ac1eed-177b-4307-91a8-e4198e5a56ef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:49.198857 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1ac1eed-177b-4307-91a8-e4198e5a56ef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:49.199586 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1ac1eed-177b-4307-91a8-e4198e5a56ef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:49.200292 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1ac1eed-177b-4307-91a8-e4198e5a56ef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:49.282973 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-04d16f6d-51f9-463b-bb00-7ee6d92e48df tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:49.297472 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-04d16f6d-51f9-463b-bb00-7ee6d92e48df tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.268212 Sep 10 12:06:49.298967 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2708/5413] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:49 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:49.325277 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6354fedc-aa23-4a90-b832-597603d99b3c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:49.326144 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6354fedc-aa23-4a90-b832-597603d99b3c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:49.333274 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6354fedc-aa23-4a90-b832-597603d99b3c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:49.333905 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6354fedc-aa23-4a90-b832-597603d99b3c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:49.334523 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6354fedc-aa23-4a90-b832-597603d99b3c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:49.335555 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6354fedc-aa23-4a90-b832-597603d99b3c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:49.336282 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6354fedc-aa23-4a90-b832-597603d99b3c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:49.337403 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6354fedc-aa23-4a90-b832-597603d99b3c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:49.649388 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6354fedc-aa23-4a90-b832-597603d99b3c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:49.673096 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6354fedc-aa23-4a90-b832-597603d99b3c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.353278 Sep 10 12:06:49.673945 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2709/5414] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:49 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:06:49.678829 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ba2457b8-bafa-4ce4-83d5-39f7b9a8cfdd tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:49.685059 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ba2457b8-bafa-4ce4-83d5-39f7b9a8cfdd tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] [instance: d0010d88-9014-48c4-8974-0a14ecf0e3ba] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:49.695824 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ba2457b8-bafa-4ce4-83d5-39f7b9a8cfdd tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:49.696332 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ba2457b8-bafa-4ce4-83d5-39f7b9a8cfdd tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:49.696777 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ba2457b8-bafa-4ce4-83d5-39f7b9a8cfdd tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:49.697504 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ba2457b8-bafa-4ce4-83d5-39f7b9a8cfdd tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:49.698081 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ba2457b8-bafa-4ce4-83d5-39f7b9a8cfdd tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:49.698516 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ba2457b8-bafa-4ce4-83d5-39f7b9a8cfdd tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:49.734217 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b1ac1eed-177b-4307-91a8-e4198e5a56ef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:49.750554 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b1ac1eed-177b-4307-91a8-e4198e5a56ef tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/f4c6978c-b7f7-426b-b92a-2f50b1940b2f" status: 200 len: 1314 microversion: 2.1 time: 0.576630 Sep 10 12:06:49.762078 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2706/5415] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:49 2022] GET /compute/v2.1/servers/f4c6978c-b7f7-426b-b92a-2f50b1940b2f => generated 1314 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:06:49.771605 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-386eb0fa-19b8-4deb-b7af-e3abb665165b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:06:49.772265 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-386eb0fa-19b8-4deb-b7af-e3abb665165b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:49.790408 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-386eb0fa-19b8-4deb-b7af-e3abb665165b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:49.791084 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-386eb0fa-19b8-4deb-b7af-e3abb665165b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:49.791678 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-386eb0fa-19b8-4deb-b7af-e3abb665165b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:49.792582 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-386eb0fa-19b8-4deb-b7af-e3abb665165b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:49.793198 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-386eb0fa-19b8-4deb-b7af-e3abb665165b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:49.793741 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-386eb0fa-19b8-4deb-b7af-e3abb665165b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:49.818882 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ba2457b8-bafa-4ce4-83d5-39f7b9a8cfdd tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcbed59a8854e848afb2960fd6af525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b5a220528a4b2b99bb816a78e7de95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:49.831635 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ba2457b8-bafa-4ce4-83d5-39f7b9a8cfdd tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] 10.222.0.23 "GET /compute/v2.1/servers/d0010d88-9014-48c4-8974-0a14ecf0e3ba" status: 200 len: 1265 microversion: 2.1 time: 0.154683 Sep 10 12:06:49.832240 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2710/5416] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:49 2022] GET /compute/v2.1/servers/d0010d88-9014-48c4-8974-0a14ecf0e3ba => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:49.852128 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-386eb0fa-19b8-4deb-b7af-e3abb665165b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] HTTP exception thrown: Cannot 'unshelve' instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 while it is in vm_state active Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-386eb0fa-19b8-4deb-b7af-e3abb665165b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004/action HTTP/1.1 Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 18 Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: {"unshelve": null} Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: exception: Cannot 'unshelve' instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 while it is in vm_state active Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'ac1538e5-6edc-4ccb-b7a9-c2e90284e004', 'body': {'unshelve': None}} Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 in vm_state active. Cannot unshelve while the instance is in this state. Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 10 12:06:49.853977 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 10 12:06:49.858796 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 while it is in vm_state active Sep 10 12:06:49.858796 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:06:49.858796 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:06:49.858796 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:06:49.858796 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:49.858796 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:06:49.858796 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:06:49.858796 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:06:49.858796 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:06:49.858796 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 while it is in vm_state active Sep 10 12:06:49.858796 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:06:49.861995 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-386eb0fa-19b8-4deb-b7af-e3abb665165b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 409 to user: Cannot 'unshelve' instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 while it is in vm_state active {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:06:49.863065 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-386eb0fa-19b8-4deb-b7af-e3abb665165b tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "POST /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004/action" status: 409 len: 146 microversion: 2.1 time: 0.107998 Sep 10 12:06:49.864217 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2707/5417] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:06:49 2022] POST /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004/action => generated 146 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 10 12:06:49.875225 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-89c5ac2c-ed64-4182-bacc-61320e3c8682 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:49.875824 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-89c5ac2c-ed64-4182-bacc-61320e3c8682 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:49.907098 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89c5ac2c-ed64-4182-bacc-61320e3c8682 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:49.909212 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89c5ac2c-ed64-4182-bacc-61320e3c8682 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:49.911494 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89c5ac2c-ed64-4182-bacc-61320e3c8682 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:49.915431 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89c5ac2c-ed64-4182-bacc-61320e3c8682 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:49.916271 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89c5ac2c-ed64-4182-bacc-61320e3c8682 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:49.916876 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89c5ac2c-ed64-4182-bacc-61320e3c8682 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:50.295471 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-89c5ac2c-ed64-4182-bacc-61320e3c8682 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:50.309378 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-89c5ac2c-ed64-4182-bacc-61320e3c8682 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.438208 Sep 10 12:06:50.310285 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2711/5418] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:49 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:50.338633 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5800584d-e54e-40fc-82ec-5278312ea9e7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:50.339298 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5800584d-e54e-40fc-82ec-5278312ea9e7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:50.345929 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5800584d-e54e-40fc-82ec-5278312ea9e7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:50.346422 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5800584d-e54e-40fc-82ec-5278312ea9e7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:50.346929 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5800584d-e54e-40fc-82ec-5278312ea9e7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:50.347611 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5800584d-e54e-40fc-82ec-5278312ea9e7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:50.348078 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5800584d-e54e-40fc-82ec-5278312ea9e7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:50.348515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5800584d-e54e-40fc-82ec-5278312ea9e7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:50.610465 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5800584d-e54e-40fc-82ec-5278312ea9e7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:50.627774 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5800584d-e54e-40fc-82ec-5278312ea9e7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.293028 Sep 10 12:06:50.634304 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2708/5419] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:50 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:50.652764 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5774c412-fa6e-4aa6-883a-78af9e3e2873 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-435302278_updated"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:06:50.655471 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5774c412-fa6e-4aa6-883a-78af9e3e2873 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: bbd0158c-f8d5-4ecd-91e8-e9a48d40721c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:50.661169 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-5774c412-fa6e-4aa6-883a-78af9e3e2873 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] HTTP exception thrown: Instance bbd0158c-f8d5-4ecd-91e8-e9a48d40721c could not be found. Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5774c412-fa6e-4aa6-883a-78af9e3e2873 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: request: PUT /compute/v2.1/servers/bbd0158c-f8d5-4ecd-91e8-e9a48d40721c HTTP/1.1 Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 80 Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-435302278_updated"}} Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance bbd0158c-f8d5-4ecd-91e8-e9a48d40721c could not be found. Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'bbd0158c-f8d5-4ecd-91e8-e9a48d40721c', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-435302278_updated'}}} Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbd0158c-f8d5-4ecd-91e8-e9a48d40721c could not be found. Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 10 12:06:50.662924 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:06:50.666608 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:06:50.666608 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:06:50.666608 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:06:50.666608 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbd0158c-f8d5-4ecd-91e8-e9a48d40721c could not be found. Sep 10 12:06:50.666608 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:06:50.666608 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:06:50.666608 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:06:50.666608 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:50.666608 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:06:50.666608 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:06:50.666608 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:06:50.666608 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:06:50.666608 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbd0158c-f8d5-4ecd-91e8-e9a48d40721c could not be found. Sep 10 12:06:50.666608 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:06:50.666608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5774c412-fa6e-4aa6-883a-78af9e3e2873 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 404 to user: Instance bbd0158c-f8d5-4ecd-91e8-e9a48d40721c could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:06:50.666608 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5774c412-fa6e-4aa6-883a-78af9e3e2873 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "PUT /compute/v2.1/servers/bbd0158c-f8d5-4ecd-91e8-e9a48d40721c" status: 404 len: 111 microversion: 2.1 time: 0.018079 Sep 10 12:06:50.666608 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2712/5420] 10.222.0.23 () {60 vars in 1256 bytes} [Sat Sep 10 12:06:50 2022] PUT /compute/v2.1/servers/bbd0158c-f8d5-4ecd-91e8-e9a48d40721c => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:06:50.682440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c06d00e5-7065-4c4b-93be-9c75e04ecc31 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:50.683772 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c06d00e5-7065-4c4b-93be-9c75e04ecc31 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:50.692822 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c06d00e5-7065-4c4b-93be-9c75e04ecc31 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:50.696227 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c06d00e5-7065-4c4b-93be-9c75e04ecc31 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:50.696924 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c06d00e5-7065-4c4b-93be-9c75e04ecc31 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:50.697664 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c06d00e5-7065-4c4b-93be-9c75e04ecc31 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:50.698130 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c06d00e5-7065-4c4b-93be-9c75e04ecc31 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:50.698566 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c06d00e5-7065-4c4b-93be-9c75e04ecc31 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:50.778786 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-373fc521-1b50-4d8a-a21c-ba320ca6b532 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:50.779437 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-373fc521-1b50-4d8a-a21c-ba320ca6b532 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: f4c6978c-b7f7-426b-b92a-2f50b1940b2f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:50.787573 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-373fc521-1b50-4d8a-a21c-ba320ca6b532 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:50.788463 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-373fc521-1b50-4d8a-a21c-ba320ca6b532 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:50.789698 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-373fc521-1b50-4d8a-a21c-ba320ca6b532 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:50.790580 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-373fc521-1b50-4d8a-a21c-ba320ca6b532 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:50.791233 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-373fc521-1b50-4d8a-a21c-ba320ca6b532 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:50.791819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-373fc521-1b50-4d8a-a21c-ba320ca6b532 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:51.125042 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c06d00e5-7065-4c4b-93be-9c75e04ecc31 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:51.130354 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-373fc521-1b50-4d8a-a21c-ba320ca6b532 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:51.138649 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-373fc521-1b50-4d8a-a21c-ba320ca6b532 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/f4c6978c-b7f7-426b-b92a-2f50b1940b2f" status: 200 len: 1314 microversion: 2.1 time: 0.363704 Sep 10 12:06:51.142150 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2713/5421] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:50 2022] GET /compute/v2.1/servers/f4c6978c-b7f7-426b-b92a-2f50b1940b2f => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:06:51.144404 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c06d00e5-7065-4c4b-93be-9c75e04ecc31 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.468991 Sep 10 12:06:51.145030 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2709/5422] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:50 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:51.170457 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bed1165b-535e-4da4-8bae-0406aae00106 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:51.172958 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-12a7064c-d496-4c4f-8861-3dafbca272af tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:51.173134 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bed1165b-535e-4da4-8bae-0406aae00106 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] [instance: d0010d88-9014-48c4-8974-0a14ecf0e3ba] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:51.173900 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-12a7064c-d496-4c4f-8861-3dafbca272af tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:51.183015 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-12a7064c-d496-4c4f-8861-3dafbca272af tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:51.185148 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-12a7064c-d496-4c4f-8861-3dafbca272af tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:51.186655 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-12a7064c-d496-4c4f-8861-3dafbca272af tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:51.188943 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-12a7064c-d496-4c4f-8861-3dafbca272af tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:51.189271 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bed1165b-535e-4da4-8bae-0406aae00106 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:51.189791 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-12a7064c-d496-4c4f-8861-3dafbca272af tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:51.190722 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-12a7064c-d496-4c4f-8861-3dafbca272af tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:51.190883 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bed1165b-535e-4da4-8bae-0406aae00106 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:51.191480 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bed1165b-535e-4da4-8bae-0406aae00106 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:51.193042 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bed1165b-535e-4da4-8bae-0406aae00106 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:51.196730 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bed1165b-535e-4da4-8bae-0406aae00106 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:51.197311 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bed1165b-535e-4da4-8bae-0406aae00106 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:51.551343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bed1165b-535e-4da4-8bae-0406aae00106 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcbed59a8854e848afb2960fd6af525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b5a220528a4b2b99bb816a78e7de95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:51.561077 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bed1165b-535e-4da4-8bae-0406aae00106 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] 10.222.0.23 "GET /compute/v2.1/servers/d0010d88-9014-48c4-8974-0a14ecf0e3ba" status: 200 len: 1313 microversion: 2.1 time: 0.417576 Sep 10 12:06:51.562037 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2714/5423] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:51 2022] GET /compute/v2.1/servers/d0010d88-9014-48c4-8974-0a14ecf0e3ba => generated 1313 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:51.603568 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-12a7064c-d496-4c4f-8861-3dafbca272af tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:51.616208 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-12a7064c-d496-4c4f-8861-3dafbca272af tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.447773 Sep 10 12:06:51.619921 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2710/5424] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:51 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:06:51.646472 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c20b3a97-2541-49e7-91ba-71775db7a4e9 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c20b3a97-2541-49e7-91ba-71775db7a4e9 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: request: PUT /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 HTTP/1.1 Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 280 Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'ac1538e5-6edc-4ccb-b7a9-c2e90284e004', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise error Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:06:51.654422 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:51.657737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:06:51.657737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:06:51.657737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:06:51.657737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:06:51.657737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:06:51.657737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:06:51.657737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:06:51.657737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:06:51.657737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 12:06:51.657737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 12:06:51.657737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 12:06:51.657737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 12:06:51.657737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 12:06:51.657737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 12:06:51.657737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 12:06:51.657737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:06:51.657737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:06:51.657737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:06:51.657737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:51.657737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:06:51.657737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:06:51.657737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 12:06:51.657737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 12:06:51.657737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 10 12:06:51.657737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:06:51.657737 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c20b3a97-2541-49e7-91ba-71775db7a4e9 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:06:51.657737 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c20b3a97-2541-49e7-91ba-71775db7a4e9 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "PUT /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 400 len: 619 microversion: 2.1 time: 0.015448 Sep 10 12:06:51.660051 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2715/5425] 10.222.0.23 () {60 vars in 1257 bytes} [Sat Sep 10 12:06:51 2022] PUT /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 619 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 12:06:51.666740 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-61c8fefa-a5a4-47e9-abd6-6b8b4b492299 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:51.667751 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-61c8fefa-a5a4-47e9-abd6-6b8b4b492299 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:51.682616 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61c8fefa-a5a4-47e9-abd6-6b8b4b492299 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:51.683453 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61c8fefa-a5a4-47e9-abd6-6b8b4b492299 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:51.684080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61c8fefa-a5a4-47e9-abd6-6b8b4b492299 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:51.684963 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61c8fefa-a5a4-47e9-abd6-6b8b4b492299 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:51.685601 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61c8fefa-a5a4-47e9-abd6-6b8b4b492299 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:51.686191 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61c8fefa-a5a4-47e9-abd6-6b8b4b492299 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:51.989957 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-61c8fefa-a5a4-47e9-abd6-6b8b4b492299 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:51.999727 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-61c8fefa-a5a4-47e9-abd6-6b8b4b492299 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.337605 Sep 10 12:06:52.002739 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2711/5426] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:51 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:52.028492 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-81c1125b-adcb-4c0d-bfcd-19522ff871c7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:52.029971 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-81c1125b-adcb-4c0d-bfcd-19522ff871c7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:52.044456 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:06:52.049491 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81c1125b-adcb-4c0d-bfcd-19522ff871c7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:52.050340 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81c1125b-adcb-4c0d-bfcd-19522ff871c7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:52.052361 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81c1125b-adcb-4c0d-bfcd-19522ff871c7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:52.053821 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81c1125b-adcb-4c0d-bfcd-19522ff871c7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:52.054812 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81c1125b-adcb-4c0d-bfcd-19522ff871c7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:52.055872 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81c1125b-adcb-4c0d-bfcd-19522ff871c7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:52.171924 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-71c80eda-39d6-455d-9eff-17478b2aa2fb tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:52.172542 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-71c80eda-39d6-455d-9eff-17478b2aa2fb tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: f4c6978c-b7f7-426b-b92a-2f50b1940b2f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:52.179486 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71c80eda-39d6-455d-9eff-17478b2aa2fb tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:52.180105 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71c80eda-39d6-455d-9eff-17478b2aa2fb tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:52.180559 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71c80eda-39d6-455d-9eff-17478b2aa2fb tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:52.181267 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71c80eda-39d6-455d-9eff-17478b2aa2fb tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:52.181726 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71c80eda-39d6-455d-9eff-17478b2aa2fb tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:52.182153 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71c80eda-39d6-455d-9eff-17478b2aa2fb tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:52.592737 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-81c1125b-adcb-4c0d-bfcd-19522ff871c7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:52.606532 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-81c1125b-adcb-4c0d-bfcd-19522ff871c7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.584408 Sep 10 12:06:52.609227 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2716/5427] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:52 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:52.622821 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a18050ea-7c23-4e68-aef0-00c86f661db3 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:52.623691 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a18050ea-7c23-4e68-aef0-00c86f661db3 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] [instance: d0010d88-9014-48c4-8974-0a14ecf0e3ba] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:52.630653 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a18050ea-7c23-4e68-aef0-00c86f661db3 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:52.642320 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a18050ea-7c23-4e68-aef0-00c86f661db3 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:52.645270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a18050ea-7c23-4e68-aef0-00c86f661db3 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:52.646573 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a18050ea-7c23-4e68-aef0-00c86f661db3 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:52.647320 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a18050ea-7c23-4e68-aef0-00c86f661db3 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:52.647437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-71c80eda-39d6-455d-9eff-17478b2aa2fb tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:52.649995 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a18050ea-7c23-4e68-aef0-00c86f661db3 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:52.664402 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-71c80eda-39d6-455d-9eff-17478b2aa2fb tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/f4c6978c-b7f7-426b-b92a-2f50b1940b2f" status: 200 len: 1314 microversion: 2.1 time: 0.496279 Sep 10 12:06:52.665623 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2712/5428] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:52 2022] GET /compute/v2.1/servers/f4c6978c-b7f7-426b-b92a-2f50b1940b2f => generated 1314 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:06:52.671136 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bf33c9b4-640b-46e0-8848-fbc0fd3e9d1d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bf33c9b4-640b-46e0-8848-fbc0fd3e9d1d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: request: PUT /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 HTTP/1.1 Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 24 Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: {"server": {"name": ""}} Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'ac1538e5-6edc-4ccb-b7a9-c2e90284e004', 'body': {'server': {'name': ''}}} Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise error Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi '' Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 12:06:52.675140 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 12:06:52.680794 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 10 12:06:52.680794 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:06:52.680794 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:06:52.680794 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:06:52.680794 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:06:52.680794 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:06:52.680794 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:06:52.680794 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 12:06:52.680794 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 12:06:52.680794 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 10 12:06:52.680794 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:06:52.688394 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bf33c9b4-640b-46e0-8848-fbc0fd3e9d1d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:06:52.689506 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bf33c9b4-640b-46e0-8848-fbc0fd3e9d1d tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "PUT /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 400 len: 108 microversion: 2.1 time: 0.022161 Sep 10 12:06:52.691270 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2713/5429] 10.222.0.23 () {60 vars in 1256 bytes} [Sat Sep 10 12:06:52 2022] PUT /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 108 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 12:06:52.699459 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3e39697e-3448-42b3-a117-f06eac6f002e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:52.712054 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3e39697e-3448-42b3-a117-f06eac6f002e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:52.714273 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:06:52.722421 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e39697e-3448-42b3-a117-f06eac6f002e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:52.722958 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e39697e-3448-42b3-a117-f06eac6f002e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:52.723433 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e39697e-3448-42b3-a117-f06eac6f002e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:52.724146 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e39697e-3448-42b3-a117-f06eac6f002e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:52.724610 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e39697e-3448-42b3-a117-f06eac6f002e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:52.725044 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e39697e-3448-42b3-a117-f06eac6f002e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:53.101775 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a18050ea-7c23-4e68-aef0-00c86f661db3 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcbed59a8854e848afb2960fd6af525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b5a220528a4b2b99bb816a78e7de95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:53.124862 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a18050ea-7c23-4e68-aef0-00c86f661db3 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] 10.222.0.23 "GET /compute/v2.1/servers/d0010d88-9014-48c4-8974-0a14ecf0e3ba" status: 200 len: 1313 microversion: 2.1 time: 0.513953 Sep 10 12:06:53.127851 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2717/5430] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:52 2022] GET /compute/v2.1/servers/d0010d88-9014-48c4-8974-0a14ecf0e3ba => generated 1313 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:53.139786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3e39697e-3448-42b3-a117-f06eac6f002e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:53.149640 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3e39697e-3448-42b3-a117-f06eac6f002e tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1507 microversion: 2.1 time: 0.453839 Sep 10 12:06:53.152196 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2714/5431] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:52 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1507 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:53.409201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-4acf9424-e406-4fc8-bcb9-89cefa7d3a84 req-420e555b-ef9e-4cf4-bb3d-2d5db6d691a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0010d88-9014-48c4-8974-0a14ecf0e3ba", "tag": "1c0e22d7-716d-46d1-a0a7-d792c1d08555"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:06:53.447952 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-4acf9424-e406-4fc8-bcb9-89cefa7d3a84 req-420e555b-ef9e-4cf4-bb3d-2d5db6d691a6 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:53.450968 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-4acf9424-e406-4fc8-bcb9-89cefa7d3a84 req-420e555b-ef9e-4cf4-bb3d-2d5db6d691a6 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:53.452139 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-4acf9424-e406-4fc8-bcb9-89cefa7d3a84 req-420e555b-ef9e-4cf4-bb3d-2d5db6d691a6 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:53.486728 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-4acf9424-e406-4fc8-bcb9-89cefa7d3a84 req-420e555b-ef9e-4cf4-bb3d-2d5db6d691a6 service nova] Creating event network-changed:1c0e22d7-716d-46d1-a0a7-d792c1d08555 for instance d0010d88-9014-48c4-8974-0a14ecf0e3ba on n-h1-856895-1 Sep 10 12:06:53.500399 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-4acf9424-e406-4fc8-bcb9-89cefa7d3a84 req-420e555b-ef9e-4cf4-bb3d-2d5db6d691a6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093267 Sep 10 12:06:53.502064 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2718/5432] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:06:53.693482 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0f346d9f-baee-46ea-925f-9a2884bc0ee0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:53.695456 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0f346d9f-baee-46ea-925f-9a2884bc0ee0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: f4c6978c-b7f7-426b-b92a-2f50b1940b2f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:53.716680 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0f346d9f-baee-46ea-925f-9a2884bc0ee0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:53.725655 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0f346d9f-baee-46ea-925f-9a2884bc0ee0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:53.726223 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0f346d9f-baee-46ea-925f-9a2884bc0ee0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:53.726987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0f346d9f-baee-46ea-925f-9a2884bc0ee0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:53.727482 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0f346d9f-baee-46ea-925f-9a2884bc0ee0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:53.727916 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0f346d9f-baee-46ea-925f-9a2884bc0ee0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:54.150649 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a61f7d72-59c5-43c4-bcd5-51cace12ef92 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:54.151398 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a61f7d72-59c5-43c4-bcd5-51cace12ef92 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] [instance: d0010d88-9014-48c4-8974-0a14ecf0e3ba] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:54.166504 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a61f7d72-59c5-43c4-bcd5-51cace12ef92 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:54.167482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a61f7d72-59c5-43c4-bcd5-51cace12ef92 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:54.173804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a61f7d72-59c5-43c4-bcd5-51cace12ef92 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:54.174870 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a61f7d72-59c5-43c4-bcd5-51cace12ef92 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:54.175577 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a61f7d72-59c5-43c4-bcd5-51cace12ef92 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:54.176206 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a61f7d72-59c5-43c4-bcd5-51cace12ef92 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:54.365281 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0f346d9f-baee-46ea-925f-9a2884bc0ee0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:54.374621 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0f346d9f-baee-46ea-925f-9a2884bc0ee0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/f4c6978c-b7f7-426b-b92a-2f50b1940b2f" status: 200 len: 1314 microversion: 2.1 time: 0.685807 Sep 10 12:06:54.375240 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2715/5433] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:53 2022] GET /compute/v2.1/servers/f4c6978c-b7f7-426b-b92a-2f50b1940b2f => generated 1314 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:54.395597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-5c9d8fd7-ec61-4868-8246-739223d8256b req-b10010ca-71d0-46b2-bd2c-3e46008e22e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4c6978c-b7f7-426b-b92a-2f50b1940b2f", "name": "network-vif-plugged", "status": "completed", "tag": "5df64599-3408-4ea3-9731-91e1f9bc70ad"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:06:54.406571 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-5c9d8fd7-ec61-4868-8246-739223d8256b req-b10010ca-71d0-46b2-bd2c-3e46008e22e5 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:54.407096 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-5c9d8fd7-ec61-4868-8246-739223d8256b req-b10010ca-71d0-46b2-bd2c-3e46008e22e5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:54.407572 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-5c9d8fd7-ec61-4868-8246-739223d8256b req-b10010ca-71d0-46b2-bd2c-3e46008e22e5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:54.421452 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-5c9d8fd7-ec61-4868-8246-739223d8256b req-b10010ca-71d0-46b2-bd2c-3e46008e22e5 service nova] Creating event network-vif-plugged:5df64599-3408-4ea3-9731-91e1f9bc70ad for instance f4c6978c-b7f7-426b-b92a-2f50b1940b2f on n-h2-856895-1 Sep 10 12:06:54.427086 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-5c9d8fd7-ec61-4868-8246-739223d8256b req-b10010ca-71d0-46b2-bd2c-3e46008e22e5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035148 Sep 10 12:06:54.428440 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2716/5434] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:06:55.334859 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a61f7d72-59c5-43c4-bcd5-51cace12ef92 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcbed59a8854e848afb2960fd6af525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b5a220528a4b2b99bb816a78e7de95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:55.343461 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a61f7d72-59c5-43c4-bcd5-51cace12ef92 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] 10.222.0.23 "GET /compute/v2.1/servers/d0010d88-9014-48c4-8974-0a14ecf0e3ba" status: 200 len: 1313 microversion: 2.1 time: 1.197143 Sep 10 12:06:55.344057 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2719/5435] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:54 2022] GET /compute/v2.1/servers/d0010d88-9014-48c4-8974-0a14ecf0e3ba => generated 1313 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:55.400327 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d23ae8d9-b568-4349-b6f2-253639f7d20f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:55.401242 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d23ae8d9-b568-4349-b6f2-253639f7d20f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: f4c6978c-b7f7-426b-b92a-2f50b1940b2f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:55.414372 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d23ae8d9-b568-4349-b6f2-253639f7d20f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:55.416286 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d23ae8d9-b568-4349-b6f2-253639f7d20f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:55.418028 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d23ae8d9-b568-4349-b6f2-253639f7d20f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:55.420708 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d23ae8d9-b568-4349-b6f2-253639f7d20f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:55.422337 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d23ae8d9-b568-4349-b6f2-253639f7d20f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:55.423542 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d23ae8d9-b568-4349-b6f2-253639f7d20f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:55.691662 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d23ae8d9-b568-4349-b6f2-253639f7d20f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:55.705477 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d23ae8d9-b568-4349-b6f2-253639f7d20f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/f4c6978c-b7f7-426b-b92a-2f50b1940b2f" status: 200 len: 1314 microversion: 2.1 time: 0.308811 Sep 10 12:06:55.722827 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2717/5436] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:55 2022] GET /compute/v2.1/servers/f4c6978c-b7f7-426b-b92a-2f50b1940b2f => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:56.199055 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e48074c5-537b-4eac-9c1a-2b4e1a8c80dc tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Action: 'create', calling method: .version_select at 0x7f40721df550>, body: {"keypair": {"name": "tempest-keypair-1776930657", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB2ArlnUcav5uvDkK8dSTf1aItpivlc2G8cyZYCuPeRu0LTnNlMhcFvcBIxCGlMwmAGdehqQMS8ilGYALG+nA9C7j6aBksx37YzlGGtyw+IMmZ7ArSXeof3Z7RPtZ/iaCg=="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:06:56.217201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-e48074c5-537b-4eac-9c1a-2b4e1a8c80dc tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Getting quotas for project 03301ecc81fe426bafc4be81413d1265. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:06:56.224023 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-e48074c5-537b-4eac-9c1a-2b4e1a8c80dc tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Getting quotas for user 199d923de84c45789188543de904314a and project 03301ecc81fe426bafc4be81413d1265. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:06:56.261620 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e48074c5-537b-4eac-9c1a-2b4e1a8c80dc tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.364484 Sep 10 12:06:56.262578 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2720/5437] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 12:06:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:06:56.372521 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b28a9105-1380-498d-b6e8-ec0e0313504a tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:56.373367 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b28a9105-1380-498d-b6e8-ec0e0313504a tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] [instance: d0010d88-9014-48c4-8974-0a14ecf0e3ba] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:56.381043 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b28a9105-1380-498d-b6e8-ec0e0313504a tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:56.382172 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b28a9105-1380-498d-b6e8-ec0e0313504a tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:56.382983 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b28a9105-1380-498d-b6e8-ec0e0313504a tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:56.384972 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b28a9105-1380-498d-b6e8-ec0e0313504a tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:56.385722 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b28a9105-1380-498d-b6e8-ec0e0313504a tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:56.386663 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b28a9105-1380-498d-b6e8-ec0e0313504a tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:56.669162 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b28a9105-1380-498d-b6e8-ec0e0313504a tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcbed59a8854e848afb2960fd6af525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b5a220528a4b2b99bb816a78e7de95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:56.679084 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b28a9105-1380-498d-b6e8-ec0e0313504a tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] 10.222.0.23 "GET /compute/v2.1/servers/d0010d88-9014-48c4-8974-0a14ecf0e3ba" status: 200 len: 1313 microversion: 2.1 time: 0.314416 Sep 10 12:06:56.679931 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2718/5438] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:56 2022] GET /compute/v2.1/servers/d0010d88-9014-48c4-8974-0a14ecf0e3ba => generated 1313 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:56.731893 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-322abad8-653e-432d-bc3a-f37cb4e69e43 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:56.738778 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-322abad8-653e-432d-bc3a-f37cb4e69e43 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: f4c6978c-b7f7-426b-b92a-2f50b1940b2f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:56.754775 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-322abad8-653e-432d-bc3a-f37cb4e69e43 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:56.759536 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-322abad8-653e-432d-bc3a-f37cb4e69e43 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:56.761593 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-322abad8-653e-432d-bc3a-f37cb4e69e43 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:56.762511 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-322abad8-653e-432d-bc3a-f37cb4e69e43 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:56.766598 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-322abad8-653e-432d-bc3a-f37cb4e69e43 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:56.769468 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-322abad8-653e-432d-bc3a-f37cb4e69e43 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:57.058316 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-322abad8-653e-432d-bc3a-f37cb4e69e43 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:57.070859 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-322abad8-653e-432d-bc3a-f37cb4e69e43 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/f4c6978c-b7f7-426b-b92a-2f50b1940b2f" status: 200 len: 1501 microversion: 2.1 time: 0.340865 Sep 10 12:06:57.072062 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2721/5439] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:56 2022] GET /compute/v2.1/servers/f4c6978c-b7f7-426b-b92a-2f50b1940b2f => generated 1501 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:57.098578 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1d38f54e-4e6f-435b-a0ec-0cf973869cc7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:06:57.099352 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1d38f54e-4e6f-435b-a0ec-0cf973869cc7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: f4c6978c-b7f7-426b-b92a-2f50b1940b2f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:57.109889 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d38f54e-4e6f-435b-a0ec-0cf973869cc7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:57.113153 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d38f54e-4e6f-435b-a0ec-0cf973869cc7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:57.114784 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d38f54e-4e6f-435b-a0ec-0cf973869cc7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:57.116923 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d38f54e-4e6f-435b-a0ec-0cf973869cc7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:57.121737 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d38f54e-4e6f-435b-a0ec-0cf973869cc7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:57.122387 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d38f54e-4e6f-435b-a0ec-0cf973869cc7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:57.374391 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.network.security_group_api [None req-1d38f54e-4e6f-435b-a0ec-0cf973869cc7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Removing security group d37e8270-17f0-4e9e-b770-fc384d5a111b from port 5df64599-3408-4ea3-9731-91e1f9bc70ad Sep 10 12:06:57.707070 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fa618a7c-043d-4b62-8f39-b9baeb296a15 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:57.708086 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fa618a7c-043d-4b62-8f39-b9baeb296a15 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] [instance: d0010d88-9014-48c4-8974-0a14ecf0e3ba] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:57.726921 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa618a7c-043d-4b62-8f39-b9baeb296a15 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:57.727943 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa618a7c-043d-4b62-8f39-b9baeb296a15 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:57.728567 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa618a7c-043d-4b62-8f39-b9baeb296a15 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:57.729584 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa618a7c-043d-4b62-8f39-b9baeb296a15 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:57.730207 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa618a7c-043d-4b62-8f39-b9baeb296a15 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:57.731068 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa618a7c-043d-4b62-8f39-b9baeb296a15 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:57.942686 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=4 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:06:57.982523 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=14 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:06:58.267605 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fa618a7c-043d-4b62-8f39-b9baeb296a15 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcbed59a8854e848afb2960fd6af525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b5a220528a4b2b99bb816a78e7de95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:58.292251 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fa618a7c-043d-4b62-8f39-b9baeb296a15 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] 10.222.0.23 "GET /compute/v2.1/servers/d0010d88-9014-48c4-8974-0a14ecf0e3ba" status: 200 len: 1313 microversion: 2.1 time: 0.586142 Sep 10 12:06:58.315469 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2722/5440] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:57 2022] GET /compute/v2.1/servers/d0010d88-9014-48c4-8974-0a14ecf0e3ba => generated 1313 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:06:58.317852 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1d38f54e-4e6f-435b-a0ec-0cf973869cc7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "POST /compute/v2.1/servers/f4c6978c-b7f7-426b-b92a-2f50b1940b2f/action" status: 202 len: 0 microversion: 2.1 time: 1.216775 Sep 10 12:06:58.322707 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2719/5441] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:06:57 2022] POST /compute/v2.1/servers/f4c6978c-b7f7-426b-b92a-2f50b1940b2f/action => generated 0 bytes in 1225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:06:58.329614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a78f0916-dc5f-4c54-8466-c819add0ec61 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:58.330421 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a78f0916-dc5f-4c54-8466-c819add0ec61 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: f4c6978c-b7f7-426b-b92a-2f50b1940b2f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:58.332222 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-bf9e3a6f-397a-4138-a519-e14f3c756c77 req-37af9c45-1a2f-4eff-8e2c-95b7906345e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4c6978c-b7f7-426b-b92a-2f50b1940b2f", "tag": "5df64599-3408-4ea3-9731-91e1f9bc70ad"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:06:58.343211 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a78f0916-dc5f-4c54-8466-c819add0ec61 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:58.343952 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a78f0916-dc5f-4c54-8466-c819add0ec61 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:58.344408 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a78f0916-dc5f-4c54-8466-c819add0ec61 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:58.345135 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a78f0916-dc5f-4c54-8466-c819add0ec61 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:58.345604 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a78f0916-dc5f-4c54-8466-c819add0ec61 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:58.346094 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a78f0916-dc5f-4c54-8466-c819add0ec61 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:58.368592 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-bf9e3a6f-397a-4138-a519-e14f3c756c77 req-37af9c45-1a2f-4eff-8e2c-95b7906345e3 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:58.369226 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-bf9e3a6f-397a-4138-a519-e14f3c756c77 req-37af9c45-1a2f-4eff-8e2c-95b7906345e3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:58.369788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-bf9e3a6f-397a-4138-a519-e14f3c756c77 req-37af9c45-1a2f-4eff-8e2c-95b7906345e3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:58.384873 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-bf9e3a6f-397a-4138-a519-e14f3c756c77 req-37af9c45-1a2f-4eff-8e2c-95b7906345e3 service nova] Creating event network-changed:5df64599-3408-4ea3-9731-91e1f9bc70ad for instance f4c6978c-b7f7-426b-b92a-2f50b1940b2f on n-h2-856895-1 Sep 10 12:06:58.390869 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-bf9e3a6f-397a-4138-a519-e14f3c756c77 req-37af9c45-1a2f-4eff-8e2c-95b7906345e3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069282 Sep 10 12:06:58.392148 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2723/5442] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:06:58.699956 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a78f0916-dc5f-4c54-8466-c819add0ec61 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:58.703223 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=100 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:06:58.718295 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a78f0916-dc5f-4c54-8466-c819add0ec61 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/f4c6978c-b7f7-426b-b92a-2f50b1940b2f" status: 200 len: 1459 microversion: 2.1 time: 0.392412 Sep 10 12:06:58.719261 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2720/5443] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:58 2022] GET /compute/v2.1/servers/f4c6978c-b7f7-426b-b92a-2f50b1940b2f => generated 1459 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:58.748633 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b783ca5c-2bc7-47b9-bce9-65e693ad1ae6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:58.750314 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b783ca5c-2bc7-47b9-bce9-65e693ad1ae6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:58.761475 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b783ca5c-2bc7-47b9-bce9-65e693ad1ae6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:58.761980 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b783ca5c-2bc7-47b9-bce9-65e693ad1ae6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:58.762433 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b783ca5c-2bc7-47b9-bce9-65e693ad1ae6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:58.763148 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b783ca5c-2bc7-47b9-bce9-65e693ad1ae6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:58.763647 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b783ca5c-2bc7-47b9-bce9-65e693ad1ae6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:58.764223 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b783ca5c-2bc7-47b9-bce9-65e693ad1ae6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:58.968152 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fd0bf3cd-5835-4c8b-805c-2bb33afbcfc8 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1220742840", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e2e68d89-2e9a-4de9-a725-df4c3e2e169e"}], "security_groups": [{"name": "tempest-securitygroup--1583433736"}], "key_name": "tempest-keypair-1776930657", "user_data": "}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:06:59.416482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b783ca5c-2bc7-47b9-bce9-65e693ad1ae6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:59.428613 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b783ca5c-2bc7-47b9-bce9-65e693ad1ae6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.682420 Sep 10 12:06:59.429504 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2724/5444] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:58 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:59.440895 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c8b8b114-51f0-47bd-aeb8-e948d0c0e701 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:59.443895 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c8b8b114-51f0-47bd-aeb8-e948d0c0e701 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] [instance: d0010d88-9014-48c4-8974-0a14ecf0e3ba] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:59.459785 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c8b8b114-51f0-47bd-aeb8-e948d0c0e701 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:59.461182 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c8b8b114-51f0-47bd-aeb8-e948d0c0e701 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:59.461858 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c8b8b114-51f0-47bd-aeb8-e948d0c0e701 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:59.462801 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c8b8b114-51f0-47bd-aeb8-e948d0c0e701 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:59.466864 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c8b8b114-51f0-47bd-aeb8-e948d0c0e701 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:59.467632 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c8b8b114-51f0-47bd-aeb8-e948d0c0e701 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:59.565092 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-fd0bf3cd-5835-4c8b-805c-2bb33afbcfc8 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] validate_networks() for [('e2e68d89-2e9a-4de9-a725-df4c3e2e169e', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:06:59.952843 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c8b8b114-51f0-47bd-aeb8-e948d0c0e701 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcbed59a8854e848afb2960fd6af525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b5a220528a4b2b99bb816a78e7de95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:06:59.962275 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c8b8b114-51f0-47bd-aeb8-e948d0c0e701 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] 10.222.0.23 "GET /compute/v2.1/servers/d0010d88-9014-48c4-8974-0a14ecf0e3ba" status: 200 len: 1313 microversion: 2.1 time: 0.525844 Sep 10 12:06:59.979722 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2725/5445] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:59 2022] GET /compute/v2.1/servers/d0010d88-9014-48c4-8974-0a14ecf0e3ba => generated 1313 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:06:59.985127 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b7c9727b-94aa-4137-be93-9bf687afddad tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:06:59.985958 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b7c9727b-94aa-4137-be93-9bf687afddad tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:06:59.993497 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7c9727b-94aa-4137-be93-9bf687afddad tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:59.994597 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7c9727b-94aa-4137-be93-9bf687afddad tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:59.995257 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7c9727b-94aa-4137-be93-9bf687afddad tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:06:59.996409 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7c9727b-94aa-4137-be93-9bf687afddad tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:06:59.997077 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7c9727b-94aa-4137-be93-9bf687afddad tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:06:59.997702 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7c9727b-94aa-4137-be93-9bf687afddad tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:00.465715 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b7c9727b-94aa-4137-be93-9bf687afddad tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:00.484153 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b7c9727b-94aa-4137-be93-9bf687afddad tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.502533 Sep 10 12:07:00.499189 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2726/5446] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:06:59 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:00.499189 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1bcd1b69-7ec1-4b4f-8395-8088aca1a5dc tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:00.499189 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1bcd1b69-7ec1-4b4f-8395-8088aca1a5dc tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: d4d4927f-4127-4a75-8c38-f462dda83d23] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:00.504707 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1bcd1b69-7ec1-4b4f-8395-8088aca1a5dc tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:00.505979 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1bcd1b69-7ec1-4b4f-8395-8088aca1a5dc tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:00.506604 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1bcd1b69-7ec1-4b4f-8395-8088aca1a5dc tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:00.507581 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1bcd1b69-7ec1-4b4f-8395-8088aca1a5dc tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:00.508484 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1bcd1b69-7ec1-4b4f-8395-8088aca1a5dc tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:00.510405 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1bcd1b69-7ec1-4b4f-8395-8088aca1a5dc tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:00.554084 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-1bcd1b69-7ec1-4b4f-8395-8088aca1a5dc tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] HTTP exception thrown: Instance d4d4927f-4127-4a75-8c38-f462dda83d23 could not be found. Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1bcd1b69-7ec1-4b4f-8395-8088aca1a5dc tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23 HTTP/1.1 Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance d4d4927f-4127-4a75-8c38-f462dda83d23 could not be found. Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'd4d4927f-4127-4a75-8c38-f462dda83d23'} Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4d4927f-4127-4a75-8c38-f462dda83d23 could not be found. Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:07:00.559546 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:07:00.563425 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4d4927f-4127-4a75-8c38-f462dda83d23 could not be found. Sep 10 12:07:00.563425 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:07:00.563425 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:07:00.563425 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:07:00.563425 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:07:00.563425 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:07:00.563425 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:07:00.563425 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:07:00.563425 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:07:00.563425 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4d4927f-4127-4a75-8c38-f462dda83d23 could not be found. Sep 10 12:07:00.563425 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:07:00.566914 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1bcd1b69-7ec1-4b4f-8395-8088aca1a5dc tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 404 to user: Instance d4d4927f-4127-4a75-8c38-f462dda83d23 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:07:00.569186 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1bcd1b69-7ec1-4b4f-8395-8088aca1a5dc tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23" status: 404 len: 111 microversion: 2.1 time: 0.081723 Sep 10 12:07:00.572704 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2727/5447] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:07:00 2022] DELETE /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:07:00.584013 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4bfaf9c5-022b-4e81-81ba-d8f61968995b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:00.587012 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4bfaf9c5-022b-4e81-81ba-d8f61968995b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:00.596903 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4bfaf9c5-022b-4e81-81ba-d8f61968995b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:00.597702 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4bfaf9c5-022b-4e81-81ba-d8f61968995b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:00.598482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4bfaf9c5-022b-4e81-81ba-d8f61968995b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:00.599553 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4bfaf9c5-022b-4e81-81ba-d8f61968995b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:00.600493 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4bfaf9c5-022b-4e81-81ba-d8f61968995b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:00.601168 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4bfaf9c5-022b-4e81-81ba-d8f61968995b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:00.646351 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:07:00.807708 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-fd0bf3cd-5835-4c8b-805c-2bb33afbcfc8 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:07:00.808269 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-fd0bf3cd-5835-4c8b-805c-2bb33afbcfc8 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:07:00.808681 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-fd0bf3cd-5835-4c8b-805c-2bb33afbcfc8 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:07:00.809103 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-fd0bf3cd-5835-4c8b-805c-2bb33afbcfc8 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:07:00.809585 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-fd0bf3cd-5835-4c8b-805c-2bb33afbcfc8 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:07:00.827937 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fd0bf3cd-5835-4c8b-805c-2bb33afbcfc8 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:00.828515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fd0bf3cd-5835-4c8b-805c-2bb33afbcfc8 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:00.829316 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fd0bf3cd-5835-4c8b-805c-2bb33afbcfc8 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:00.834441 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fd0bf3cd-5835-4c8b-805c-2bb33afbcfc8 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:00.834687 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fd0bf3cd-5835-4c8b-805c-2bb33afbcfc8 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:00.835655 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fd0bf3cd-5835-4c8b-805c-2bb33afbcfc8 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:00.845844 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4bfaf9c5-022b-4e81-81ba-d8f61968995b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:00.856709 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4bfaf9c5-022b-4e81-81ba-d8f61968995b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.279707 Sep 10 12:07:00.857677 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2728/5448] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:00 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:00.863016 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7f8e7504-6081-462c-80cd-f72a922f744c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:00.864109 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7f8e7504-6081-462c-80cd-f72a922f744c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: d4d4927f-4127-4a75-8c38-f462dda83d23] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:00.872419 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f8e7504-6081-462c-80cd-f72a922f744c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:00.873257 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f8e7504-6081-462c-80cd-f72a922f744c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:00.873913 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f8e7504-6081-462c-80cd-f72a922f744c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:00.874852 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f8e7504-6081-462c-80cd-f72a922f744c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:00.876409 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f8e7504-6081-462c-80cd-f72a922f744c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:00.877100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f8e7504-6081-462c-80cd-f72a922f744c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:00.895557 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-7f8e7504-6081-462c-80cd-f72a922f744c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] HTTP exception thrown: Instance d4d4927f-4127-4a75-8c38-f462dda83d23 could not be found. Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7f8e7504-6081-462c-80cd-f72a922f744c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23 HTTP/1.1 Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance d4d4927f-4127-4a75-8c38-f462dda83d23 could not be found. Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'd4d4927f-4127-4a75-8c38-f462dda83d23'} Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4d4927f-4127-4a75-8c38-f462dda83d23 could not be found. Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4d4927f-4127-4a75-8c38-f462dda83d23 could not be found. Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:07:00.898411 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:07:00.903001 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:07:00.903001 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:07:00.903001 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:07:00.903001 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:07:00.903001 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:07:00.903001 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4d4927f-4127-4a75-8c38-f462dda83d23 could not be found. Sep 10 12:07:00.903001 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:07:00.903001 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7f8e7504-6081-462c-80cd-f72a922f744c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 404 to user: Instance d4d4927f-4127-4a75-8c38-f462dda83d23 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:07:00.907991 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-fd0bf3cd-5835-4c8b-805c-2bb33afbcfc8 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Getting quotas for project 03301ecc81fe426bafc4be81413d1265. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:07:00.911898 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7f8e7504-6081-462c-80cd-f72a922f744c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23" status: 404 len: 111 microversion: 2.1 time: 0.052401 Sep 10 12:07:00.916498 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2729/5449] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:00 2022] GET /compute/v2.1/servers/d4d4927f-4127-4a75-8c38-f462dda83d23 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:07:00.918316 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1a450c91-bdab-4d2f-9040-44ff1c98c7d4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:00.918948 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1a450c91-bdab-4d2f-9040-44ff1c98c7d4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:00.923860 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-fd0bf3cd-5835-4c8b-805c-2bb33afbcfc8 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Getting quotas for user 199d923de84c45789188543de904314a and project 03301ecc81fe426bafc4be81413d1265. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:07:00.926104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a450c91-bdab-4d2f-9040-44ff1c98c7d4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:00.926104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a450c91-bdab-4d2f-9040-44ff1c98c7d4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:00.926689 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a450c91-bdab-4d2f-9040-44ff1c98c7d4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:00.927440 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a450c91-bdab-4d2f-9040-44ff1c98c7d4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:00.928144 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a450c91-bdab-4d2f-9040-44ff1c98c7d4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:00.929486 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a450c91-bdab-4d2f-9040-44ff1c98c7d4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:00.952237 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fd0bf3cd-5835-4c8b-805c-2bb33afbcfc8 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:07:00.955636 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fd0bf3cd-5835-4c8b-805c-2bb33afbcfc8 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: f4da91bc-acbf-487b-b305-a619df7ad3f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:07:01.033908 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fd0bf3cd-5835-4c8b-805c-2bb33afbcfc8 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.070058 Sep 10 12:07:01.034673 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2721/5450] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:06:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 2073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 12:07:01.040041 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cefc132f-9f9a-4506-8e04-54768b4f0393 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:01.040546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cefc132f-9f9a-4506-8e04-54768b4f0393 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:01.061600 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cefc132f-9f9a-4506-8e04-54768b4f0393 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:01.062110 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cefc132f-9f9a-4506-8e04-54768b4f0393 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:01.062559 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cefc132f-9f9a-4506-8e04-54768b4f0393 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:01.063312 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cefc132f-9f9a-4506-8e04-54768b4f0393 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:01.063777 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cefc132f-9f9a-4506-8e04-54768b4f0393 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:01.064213 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cefc132f-9f9a-4506-8e04-54768b4f0393 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:01.110782 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cefc132f-9f9a-4506-8e04-54768b4f0393 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:07:01.318384 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cefc132f-9f9a-4506-8e04-54768b4f0393 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 204 len: 0 microversion: 2.1 time: 0.282307 Sep 10 12:07:01.319524 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2722/5451] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:07:01 2022] DELETE /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:07:01.326408 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cb28f5c1-fc60-408b-af67-f50c31da0c8f tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:01.328538 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cb28f5c1-fc60-408b-af67-f50c31da0c8f tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] [instance: d0010d88-9014-48c4-8974-0a14ecf0e3ba] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:01.346059 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb28f5c1-fc60-408b-af67-f50c31da0c8f tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:01.346967 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb28f5c1-fc60-408b-af67-f50c31da0c8f tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:01.347525 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb28f5c1-fc60-408b-af67-f50c31da0c8f tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:01.349675 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb28f5c1-fc60-408b-af67-f50c31da0c8f tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:01.352586 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb28f5c1-fc60-408b-af67-f50c31da0c8f tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:01.353320 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb28f5c1-fc60-408b-af67-f50c31da0c8f tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:01.458824 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1a450c91-bdab-4d2f-9040-44ff1c98c7d4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:01.473059 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1a450c91-bdab-4d2f-9040-44ff1c98c7d4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.556562 Sep 10 12:07:01.477470 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2730/5452] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:00 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:01.493106 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-de1d653d-70b8-4d53-a394-56dd9eb9ca6f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:01.494105 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-de1d653d-70b8-4d53-a394-56dd9eb9ca6f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: f4da91bc-acbf-487b-b305-a619df7ad3f8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:01.777404 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-de1d653d-70b8-4d53-a394-56dd9eb9ca6f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:01.786274 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-de1d653d-70b8-4d53-a394-56dd9eb9ca6f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8" status: 200 len: 1242 microversion: 2.1 time: 0.305078 Sep 10 12:07:01.794737 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2731/5453] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:01 2022] GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8 => generated 1242 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:01.809934 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2a523a22-274e-4fc8-80d6-7b1bb5812e2c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:01.813643 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2a523a22-274e-4fc8-80d6-7b1bb5812e2c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:01.833042 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2a523a22-274e-4fc8-80d6-7b1bb5812e2c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:01.833546 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2a523a22-274e-4fc8-80d6-7b1bb5812e2c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:01.835303 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2a523a22-274e-4fc8-80d6-7b1bb5812e2c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:01.837467 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2a523a22-274e-4fc8-80d6-7b1bb5812e2c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:01.839966 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2a523a22-274e-4fc8-80d6-7b1bb5812e2c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:01.841648 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2a523a22-274e-4fc8-80d6-7b1bb5812e2c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:01.864984 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cb28f5c1-fc60-408b-af67-f50c31da0c8f tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcbed59a8854e848afb2960fd6af525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b5a220528a4b2b99bb816a78e7de95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:01.882730 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cb28f5c1-fc60-408b-af67-f50c31da0c8f tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] 10.222.0.23 "GET /compute/v2.1/servers/d0010d88-9014-48c4-8974-0a14ecf0e3ba" status: 200 len: 1313 microversion: 2.1 time: 0.561242 Sep 10 12:07:01.883356 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2723/5454] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:01 2022] GET /compute/v2.1/servers/d0010d88-9014-48c4-8974-0a14ecf0e3ba => generated 1313 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:01.893419 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a750b0de-4df1-43f1-862e-03489937bfb2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1419580521", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "2b93427c-8a73-4134-b29e-29ba6a3e29a6"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:07:02.015475 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-a750b0de-4df1-43f1-862e-03489937bfb2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] validate_networks() for [('2b93427c-8a73-4134-b29e-29ba6a3e29a6', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:07:02.227638 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2a523a22-274e-4fc8-80d6-7b1bb5812e2c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:02.236701 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2a523a22-274e-4fc8-80d6-7b1bb5812e2c tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1513 microversion: 2.1 time: 0.438651 Sep 10 12:07:02.237915 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2732/5455] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:01 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1513 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:02.243474 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-d8a41234-4595-4d5f-9d1b-cb42418642cf req-c442fcb5-e13f-4740-ad67-0e7015db4e8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0010d88-9014-48c4-8974-0a14ecf0e3ba", "name": "network-vif-plugged", "status": "completed", "tag": "1c0e22d7-716d-46d1-a0a7-d792c1d08555"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:07:02.254430 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d8a41234-4595-4d5f-9d1b-cb42418642cf req-c442fcb5-e13f-4740-ad67-0e7015db4e8b service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:02.255246 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d8a41234-4595-4d5f-9d1b-cb42418642cf req-c442fcb5-e13f-4740-ad67-0e7015db4e8b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:02.256172 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d8a41234-4595-4d5f-9d1b-cb42418642cf req-c442fcb5-e13f-4740-ad67-0e7015db4e8b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:02.273151 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-d8a41234-4595-4d5f-9d1b-cb42418642cf req-c442fcb5-e13f-4740-ad67-0e7015db4e8b service nova] Creating event network-vif-plugged:1c0e22d7-716d-46d1-a0a7-d792c1d08555 for instance d0010d88-9014-48c4-8974-0a14ecf0e3ba on n-h1-856895-1 Sep 10 12:07:02.279402 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-d8a41234-4595-4d5f-9d1b-cb42418642cf req-c442fcb5-e13f-4740-ad67-0e7015db4e8b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040032 Sep 10 12:07:02.280214 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2733/5456] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:07:02.635346 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-a750b0de-4df1-43f1-862e-03489937bfb2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:07:02.635871 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-a750b0de-4df1-43f1-862e-03489937bfb2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:07:02.636530 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-a750b0de-4df1-43f1-862e-03489937bfb2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:07:02.637087 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-a750b0de-4df1-43f1-862e-03489937bfb2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:07:02.637776 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-a750b0de-4df1-43f1-862e-03489937bfb2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:07:02.650582 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a750b0de-4df1-43f1-862e-03489937bfb2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:02.651660 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a750b0de-4df1-43f1-862e-03489937bfb2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:02.652614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a750b0de-4df1-43f1-862e-03489937bfb2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:02.653426 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a750b0de-4df1-43f1-862e-03489937bfb2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:02.655328 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a750b0de-4df1-43f1-862e-03489937bfb2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:02.655771 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a750b0de-4df1-43f1-862e-03489937bfb2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:02.676236 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-a750b0de-4df1-43f1-862e-03489937bfb2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Getting quotas for project 2410f9544bec4633988e1554111c9446. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:07:02.684666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-a750b0de-4df1-43f1-862e-03489937bfb2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Getting quotas for user 8954f3256ddd49639ea57a9242a296d0 and project 2410f9544bec4633988e1554111c9446. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:07:02.703132 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a750b0de-4df1-43f1-862e-03489937bfb2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:07:02.705609 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a750b0de-4df1-43f1-862e-03489937bfb2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:07:02.764122 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a750b0de-4df1-43f1-862e-03489937bfb2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.879289 Sep 10 12:07:02.764787 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2724/5457] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:07:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:07:02.776573 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4cee5dd0-f4b7-46dd-bf21-ca7826edbce3 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:02.777285 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4cee5dd0-f4b7-46dd-bf21-ca7826edbce3 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:02.820054 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4cf2a444-fca4-408d-ae27-1193e517e852 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:02.820683 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4cf2a444-fca4-408d-ae27-1193e517e852 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: f4da91bc-acbf-487b-b305-a619df7ad3f8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:02.840861 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4cee5dd0-f4b7-46dd-bf21-ca7826edbce3 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:02.844093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4cf2a444-fca4-408d-ae27-1193e517e852 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:02.844646 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4cf2a444-fca4-408d-ae27-1193e517e852 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:02.845285 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4cf2a444-fca4-408d-ae27-1193e517e852 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:02.846003 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4cf2a444-fca4-408d-ae27-1193e517e852 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:02.846465 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4cf2a444-fca4-408d-ae27-1193e517e852 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:02.847919 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4cf2a444-fca4-408d-ae27-1193e517e852 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:02.848294 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4cee5dd0-f4b7-46dd-bf21-ca7826edbce3 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64" status: 200 len: 1215 microversion: 2.1 time: 0.075997 Sep 10 12:07:02.848873 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2734/5458] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:02 2022] GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 => generated 1215 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:02.910222 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4fc449d8-d218-4437-8c82-f112395a1db6 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:02.910844 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4fc449d8-d218-4437-8c82-f112395a1db6 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] [instance: d0010d88-9014-48c4-8974-0a14ecf0e3ba] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:02.936244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fc449d8-d218-4437-8c82-f112395a1db6 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:02.936816 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4cf2a444-fca4-408d-ae27-1193e517e852 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:02.937428 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fc449d8-d218-4437-8c82-f112395a1db6 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:02.938076 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fc449d8-d218-4437-8c82-f112395a1db6 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:02.941170 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fc449d8-d218-4437-8c82-f112395a1db6 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:02.941658 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fc449d8-d218-4437-8c82-f112395a1db6 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:02.946124 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4cf2a444-fca4-408d-ae27-1193e517e852 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8" status: 200 len: 1238 microversion: 2.1 time: 0.130800 Sep 10 12:07:02.946307 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fc449d8-d218-4437-8c82-f112395a1db6 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:02.947307 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2725/5459] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:02 2022] GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8 => generated 1238 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:07:03.266497 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-57a9f97b-bace-4196-86fe-df91e59a85c7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:03.267706 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-57a9f97b-bace-4196-86fe-df91e59a85c7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:03.276109 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57a9f97b-bace-4196-86fe-df91e59a85c7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:03.277037 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57a9f97b-bace-4196-86fe-df91e59a85c7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:03.277955 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57a9f97b-bace-4196-86fe-df91e59a85c7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:03.278888 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57a9f97b-bace-4196-86fe-df91e59a85c7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:03.279606 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57a9f97b-bace-4196-86fe-df91e59a85c7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:03.280218 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57a9f97b-bace-4196-86fe-df91e59a85c7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:03.318079 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4fc449d8-d218-4437-8c82-f112395a1db6 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcbed59a8854e848afb2960fd6af525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b5a220528a4b2b99bb816a78e7de95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:03.331255 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4fc449d8-d218-4437-8c82-f112395a1db6 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] 10.222.0.23 "GET /compute/v2.1/servers/d0010d88-9014-48c4-8974-0a14ecf0e3ba" status: 200 len: 1313 microversion: 2.1 time: 0.425035 Sep 10 12:07:03.339026 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2735/5460] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:02 2022] GET /compute/v2.1/servers/d0010d88-9014-48c4-8974-0a14ecf0e3ba => generated 1313 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:07:03.875407 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1284f877-96ec-418a-8d74-6bcf650bcd2c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:03.877142 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1284f877-96ec-418a-8d74-6bcf650bcd2c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:03.908814 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1284f877-96ec-418a-8d74-6bcf650bcd2c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:03.909765 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1284f877-96ec-418a-8d74-6bcf650bcd2c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:03.912327 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1284f877-96ec-418a-8d74-6bcf650bcd2c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:03.921629 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1284f877-96ec-418a-8d74-6bcf650bcd2c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:03.923143 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1284f877-96ec-418a-8d74-6bcf650bcd2c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:03.924886 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1284f877-96ec-418a-8d74-6bcf650bcd2c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:03.956516 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-57a9f97b-bace-4196-86fe-df91e59a85c7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862345bb47a242c288375194a92834f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d3785c3b25495b9c588d21a8d75684', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:03.968519 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-57a9f97b-bace-4196-86fe-df91e59a85c7 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 200 len: 1513 microversion: 2.1 time: 0.709615 Sep 10 12:07:03.969737 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2726/5461] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:03 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 1513 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:07:03.974381 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2c6f722b-d53b-430f-8e05-f532312d1573 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:03.975004 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2c6f722b-d53b-430f-8e05-f532312d1573 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: f4da91bc-acbf-487b-b305-a619df7ad3f8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:03.994387 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c6f722b-d53b-430f-8e05-f532312d1573 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:03.994886 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c6f722b-d53b-430f-8e05-f532312d1573 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:03.995360 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c6f722b-d53b-430f-8e05-f532312d1573 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:03.996073 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c6f722b-d53b-430f-8e05-f532312d1573 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:03.996532 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c6f722b-d53b-430f-8e05-f532312d1573 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:03.996963 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c6f722b-d53b-430f-8e05-f532312d1573 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:04.096753 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1284f877-96ec-418a-8d74-6bcf650bcd2c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:04.112142 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1284f877-96ec-418a-8d74-6bcf650bcd2c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64" status: 200 len: 1267 microversion: 2.1 time: 0.242487 Sep 10 12:07:04.113280 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2736/5462] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:03 2022] GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 => generated 1267 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:04.141315 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2c6f722b-d53b-430f-8e05-f532312d1573 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:04.151477 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2c6f722b-d53b-430f-8e05-f532312d1573 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8" status: 200 len: 1300 microversion: 2.1 time: 0.180568 Sep 10 12:07:04.152656 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2727/5463] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:03 2022] GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8 => generated 1300 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:04.327247 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-7ea9b799-15e7-4186-b0fc-385b9ef14453 req-2193bfa9-3333-4679-9869-6f5a71791919 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac1538e5-6edc-4ccb-b7a9-c2e90284e004", "name": "network-vif-deleted", "tag": "264e21dc-6813-4623-838f-df7e536eeb78"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:07:04.347198 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-7ea9b799-15e7-4186-b0fc-385b9ef14453 req-2193bfa9-3333-4679-9869-6f5a71791919 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:04.347970 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-7ea9b799-15e7-4186-b0fc-385b9ef14453 req-2193bfa9-3333-4679-9869-6f5a71791919 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:04.348815 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-7ea9b799-15e7-4186-b0fc-385b9ef14453 req-2193bfa9-3333-4679-9869-6f5a71791919 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:04.372631 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2f0ad1c9-0d7c-4cf3-b59d-a42faf202a84 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:04.374472 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2f0ad1c9-0d7c-4cf3-b59d-a42faf202a84 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] [instance: d0010d88-9014-48c4-8974-0a14ecf0e3ba] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:04.375586 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-7ea9b799-15e7-4186-b0fc-385b9ef14453 req-2193bfa9-3333-4679-9869-6f5a71791919 service nova] Creating event network-vif-deleted:264e21dc-6813-4623-838f-df7e536eeb78 for instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 on n-h2-856895-1 Sep 10 12:07:04.385507 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f0ad1c9-0d7c-4cf3-b59d-a42faf202a84 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:04.386173 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f0ad1c9-0d7c-4cf3-b59d-a42faf202a84 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:04.386830 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f0ad1c9-0d7c-4cf3-b59d-a42faf202a84 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:04.387768 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f0ad1c9-0d7c-4cf3-b59d-a42faf202a84 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:04.388445 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f0ad1c9-0d7c-4cf3-b59d-a42faf202a84 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:04.389113 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f0ad1c9-0d7c-4cf3-b59d-a42faf202a84 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:04.393557 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-7ea9b799-15e7-4186-b0fc-385b9ef14453 req-2193bfa9-3333-4679-9869-6f5a71791919 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073846 Sep 10 12:07:04.394812 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2737/5464] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:07:04.804838 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2f0ad1c9-0d7c-4cf3-b59d-a42faf202a84 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcbed59a8854e848afb2960fd6af525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b5a220528a4b2b99bb816a78e7de95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:04.815047 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2f0ad1c9-0d7c-4cf3-b59d-a42faf202a84 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] 10.222.0.23 "GET /compute/v2.1/servers/d0010d88-9014-48c4-8974-0a14ecf0e3ba" status: 200 len: 1497 microversion: 2.1 time: 0.453382 Sep 10 12:07:04.815911 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2728/5465] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:04 2022] GET /compute/v2.1/servers/d0010d88-9014-48c4-8974-0a14ecf0e3ba => generated 1497 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:04.998269 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e7b9ced8-6557-43f5-b18e-b02dc7f57368 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:04.999669 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e7b9ced8-6557-43f5-b18e-b02dc7f57368 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] [instance: ac1538e5-6edc-4ccb-b7a9-c2e90284e004] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:05.010433 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7b9ced8-6557-43f5-b18e-b02dc7f57368 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:05.011310 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7b9ced8-6557-43f5-b18e-b02dc7f57368 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:05.011976 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7b9ced8-6557-43f5-b18e-b02dc7f57368 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:05.013074 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7b9ced8-6557-43f5-b18e-b02dc7f57368 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:05.025445 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7b9ced8-6557-43f5-b18e-b02dc7f57368 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:05.026959 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7b9ced8-6557-43f5-b18e-b02dc7f57368 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:05.053325 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-e7b9ced8-6557-43f5-b18e-b02dc7f57368 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] HTTP exception thrown: Instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 could not be found. Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e7b9ced8-6557-43f5-b18e-b02dc7f57368 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Request method failure captured: Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 HTTP/1.1 Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH0QIte6Q9xySGTVVIyaQXn4rXCwN01thm0T_U61jcPkWZBC58DG1nLqvL9maSF_iECNIrXpRJAL1P_GfsbOshiQRWAcNtBaW3Qt0xCxhT3Rrg0PDE64SirbAHgs3ZLOr5RoYe8Mg770P5Kf8t_MC5xv8o0A71Iy9jKDXGTGobRVpkk Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89d3785c3b25495b9c588d21a8d75684", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89d3785c3b25495b9c588d21a8d75684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 89d3785c3b25495b9c588d21a8d75684 Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1777586559 Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 862345bb47a242c288375194a92834f9 Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersNegativeTestJSON-1777586559-project Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 could not be found. Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'ac1538e5-6edc-4ccb-b7a9-c2e90284e004'} Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 could not be found. Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 could not be found. Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:07:05.056237 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:07:05.060444 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:07:05.060444 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:07:05.060444 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:07:05.060444 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:07:05.060444 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:07:05.060444 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 could not be found. Sep 10 12:07:05.060444 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:07:05.060444 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e7b9ced8-6557-43f5-b18e-b02dc7f57368 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] Returning 404 to user: Instance ac1538e5-6edc-4ccb-b7a9-c2e90284e004 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:07:05.061131 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e7b9ced8-6557-43f5-b18e-b02dc7f57368 tempest-ServersNegativeTestJSON-1777586559 tempest-ServersNegativeTestJSON-1777586559-project] 10.222.0.23 "GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004" status: 404 len: 111 microversion: 2.1 time: 0.067186 Sep 10 12:07:05.064905 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2738/5466] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:04 2022] GET /compute/v2.1/servers/ac1538e5-6edc-4ccb-b7a9-c2e90284e004 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:07:05.137421 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e727f9a7-41ab-42f3-b279-f3aac55dba86 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:05.138048 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e727f9a7-41ab-42f3-b279-f3aac55dba86 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:05.146108 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e727f9a7-41ab-42f3-b279-f3aac55dba86 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:05.146618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e727f9a7-41ab-42f3-b279-f3aac55dba86 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:05.147027 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e727f9a7-41ab-42f3-b279-f3aac55dba86 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:05.155206 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e727f9a7-41ab-42f3-b279-f3aac55dba86 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:05.155737 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e727f9a7-41ab-42f3-b279-f3aac55dba86 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:05.156191 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e727f9a7-41ab-42f3-b279-f3aac55dba86 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:05.175433 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-98a4137c-a841-4c3b-9afc-4c4b99a6ad0b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:05.176370 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-98a4137c-a841-4c3b-9afc-4c4b99a6ad0b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: f4da91bc-acbf-487b-b305-a619df7ad3f8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:05.182902 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-98a4137c-a841-4c3b-9afc-4c4b99a6ad0b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:05.185826 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-98a4137c-a841-4c3b-9afc-4c4b99a6ad0b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:05.187655 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-98a4137c-a841-4c3b-9afc-4c4b99a6ad0b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:05.190253 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-98a4137c-a841-4c3b-9afc-4c4b99a6ad0b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:05.192329 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-98a4137c-a841-4c3b-9afc-4c4b99a6ad0b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:05.193348 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-98a4137c-a841-4c3b-9afc-4c4b99a6ad0b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:05.393411 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e727f9a7-41ab-42f3-b279-f3aac55dba86 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:05.405950 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e727f9a7-41ab-42f3-b279-f3aac55dba86 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64" status: 200 len: 1273 microversion: 2.1 time: 0.272344 Sep 10 12:07:05.407109 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2729/5467] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:05 2022] GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 => generated 1273 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:05.504051 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e215e1da-6bf7-48c9-ab76-033b3a2529d2 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:05.504911 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e215e1da-6bf7-48c9-ab76-033b3a2529d2 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] [instance: d0010d88-9014-48c4-8974-0a14ecf0e3ba] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:05.514299 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e215e1da-6bf7-48c9-ab76-033b3a2529d2 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:05.514842 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e215e1da-6bf7-48c9-ab76-033b3a2529d2 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:05.515931 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e215e1da-6bf7-48c9-ab76-033b3a2529d2 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:05.516749 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e215e1da-6bf7-48c9-ab76-033b3a2529d2 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:05.517707 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e215e1da-6bf7-48c9-ab76-033b3a2529d2 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:05.518638 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e215e1da-6bf7-48c9-ab76-033b3a2529d2 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:05.551447 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e215e1da-6bf7-48c9-ab76-033b3a2529d2 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] [instance: d0010d88-9014-48c4-8974-0a14ecf0e3ba] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:07:05.642885 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-98a4137c-a841-4c3b-9afc-4c4b99a6ad0b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:05.655964 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-98a4137c-a841-4c3b-9afc-4c4b99a6ad0b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8" status: 200 len: 1368 microversion: 2.1 time: 0.484316 Sep 10 12:07:05.660310 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2739/5468] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:05 2022] GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8 => generated 1368 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:07:05.662748 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e215e1da-6bf7-48c9-ab76-033b3a2529d2 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d0010d88-9014-48c4-8974-0a14ecf0e3ba" status: 204 len: 0 microversion: 2.1 time: 0.162393 Sep 10 12:07:05.666200 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2730/5469] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:07:05 2022] DELETE /compute/v2.1/servers/d0010d88-9014-48c4-8974-0a14ecf0e3ba => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 12:07:05.686324 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d9e3c20f-4134-41f9-aa27-13796ef2d3e6 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:05.686952 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d9e3c20f-4134-41f9-aa27-13796ef2d3e6 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] [instance: d0010d88-9014-48c4-8974-0a14ecf0e3ba] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:05.708183 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d9e3c20f-4134-41f9-aa27-13796ef2d3e6 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:05.713188 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d9e3c20f-4134-41f9-aa27-13796ef2d3e6 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:05.718811 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d9e3c20f-4134-41f9-aa27-13796ef2d3e6 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:05.719993 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d9e3c20f-4134-41f9-aa27-13796ef2d3e6 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:05.721475 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d9e3c20f-4134-41f9-aa27-13796ef2d3e6 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:05.722330 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d9e3c20f-4134-41f9-aa27-13796ef2d3e6 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:06.089961 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d9e3c20f-4134-41f9-aa27-13796ef2d3e6 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcbed59a8854e848afb2960fd6af525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b5a220528a4b2b99bb816a78e7de95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:06.101393 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d9e3c20f-4134-41f9-aa27-13796ef2d3e6 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] 10.222.0.23 "GET /compute/v2.1/servers/d0010d88-9014-48c4-8974-0a14ecf0e3ba" status: 200 len: 1503 microversion: 2.1 time: 0.423241 Sep 10 12:07:06.102340 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2740/5470] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:05 2022] GET /compute/v2.1/servers/d0010d88-9014-48c4-8974-0a14ecf0e3ba => generated 1503 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:06.434145 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a9102c92-bd69-481d-a28b-84eed2700f73 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:06.436558 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a9102c92-bd69-481d-a28b-84eed2700f73 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:06.446193 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-f7b4309e-bd40-4696-8930-e7356a0d0c80 req-b200c8c9-5552-4651-93af-78ca8629c8d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4da91bc-acbf-487b-b305-a619df7ad3f8", "tag": "252ed3a1-8f35-4360-884d-18b174b63873"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:07:06.448815 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9102c92-bd69-481d-a28b-84eed2700f73 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:06.449543 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9102c92-bd69-481d-a28b-84eed2700f73 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:06.450184 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9102c92-bd69-481d-a28b-84eed2700f73 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:06.451080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9102c92-bd69-481d-a28b-84eed2700f73 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:06.451787 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9102c92-bd69-481d-a28b-84eed2700f73 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:06.452423 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9102c92-bd69-481d-a28b-84eed2700f73 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:06.469476 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f7b4309e-bd40-4696-8930-e7356a0d0c80 req-b200c8c9-5552-4651-93af-78ca8629c8d5 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:06.470441 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f7b4309e-bd40-4696-8930-e7356a0d0c80 req-b200c8c9-5552-4651-93af-78ca8629c8d5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:06.470886 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f7b4309e-bd40-4696-8930-e7356a0d0c80 req-b200c8c9-5552-4651-93af-78ca8629c8d5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:06.489666 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-f7b4309e-bd40-4696-8930-e7356a0d0c80 req-b200c8c9-5552-4651-93af-78ca8629c8d5 service nova] Creating event network-changed:252ed3a1-8f35-4360-884d-18b174b63873 for instance f4da91bc-acbf-487b-b305-a619df7ad3f8 on n-h2-856895-1 Sep 10 12:07:06.496267 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-f7b4309e-bd40-4696-8930-e7356a0d0c80 req-b200c8c9-5552-4651-93af-78ca8629c8d5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055959 Sep 10 12:07:06.497568 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2741/5471] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:07:06.689706 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9f22930d-67c9-4698-ab61-fcc0013df19b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:06.690768 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9f22930d-67c9-4698-ab61-fcc0013df19b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: f4da91bc-acbf-487b-b305-a619df7ad3f8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:06.699197 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9f22930d-67c9-4698-ab61-fcc0013df19b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:06.699706 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9f22930d-67c9-4698-ab61-fcc0013df19b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:06.700149 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9f22930d-67c9-4698-ab61-fcc0013df19b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:06.701164 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9f22930d-67c9-4698-ab61-fcc0013df19b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:06.701623 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9f22930d-67c9-4698-ab61-fcc0013df19b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:06.702054 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9f22930d-67c9-4698-ab61-fcc0013df19b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:06.764161 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a9102c92-bd69-481d-a28b-84eed2700f73 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:06.780468 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a9102c92-bd69-481d-a28b-84eed2700f73 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64" status: 200 len: 1315 microversion: 2.1 time: 0.353891 Sep 10 12:07:06.782073 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2731/5472] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:06 2022] GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:07.107443 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9f22930d-67c9-4698-ab61-fcc0013df19b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:07.118392 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9f22930d-67c9-4698-ab61-fcc0013df19b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8" status: 200 len: 1368 microversion: 2.1 time: 0.434266 Sep 10 12:07:07.119763 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2742/5473] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:06 2022] GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8 => generated 1368 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:07:07.136812 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-573c40f8-42fd-4703-9160-70c7182cacee tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:07.138515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-573c40f8-42fd-4703-9160-70c7182cacee tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] [instance: d0010d88-9014-48c4-8974-0a14ecf0e3ba] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:07.159437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-573c40f8-42fd-4703-9160-70c7182cacee tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:07.159904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-573c40f8-42fd-4703-9160-70c7182cacee tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:07.162476 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-573c40f8-42fd-4703-9160-70c7182cacee tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:07.167961 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-573c40f8-42fd-4703-9160-70c7182cacee tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:07.168670 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-573c40f8-42fd-4703-9160-70c7182cacee tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:07.169300 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-573c40f8-42fd-4703-9160-70c7182cacee tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:07.538356 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-573c40f8-42fd-4703-9160-70c7182cacee tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcbed59a8854e848afb2960fd6af525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b5a220528a4b2b99bb816a78e7de95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:07.548141 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-573c40f8-42fd-4703-9160-70c7182cacee tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] 10.222.0.23 "GET /compute/v2.1/servers/d0010d88-9014-48c4-8974-0a14ecf0e3ba" status: 200 len: 1503 microversion: 2.1 time: 0.418673 Sep 10 12:07:07.548743 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2732/5474] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:07 2022] GET /compute/v2.1/servers/d0010d88-9014-48c4-8974-0a14ecf0e3ba => generated 1503 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:07.681858 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-e936a0e0-8517-4ae0-9e8d-1b044b784c5d req-1e2a6844-2a64-4ad0-bfd1-3b694c3aa095 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55d5cbf7-6438-4f5b-96b3-719e9f3f7a64", "tag": "c6eb0ad3-74e3-40f5-a84c-64f4d0d21125"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:07:07.693159 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e936a0e0-8517-4ae0-9e8d-1b044b784c5d req-1e2a6844-2a64-4ad0-bfd1-3b694c3aa095 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:07.694530 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e936a0e0-8517-4ae0-9e8d-1b044b784c5d req-1e2a6844-2a64-4ad0-bfd1-3b694c3aa095 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:07.695087 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e936a0e0-8517-4ae0-9e8d-1b044b784c5d req-1e2a6844-2a64-4ad0-bfd1-3b694c3aa095 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:07.708441 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-e936a0e0-8517-4ae0-9e8d-1b044b784c5d req-1e2a6844-2a64-4ad0-bfd1-3b694c3aa095 service nova] Creating event network-changed:c6eb0ad3-74e3-40f5-a84c-64f4d0d21125 for instance 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 on n-h2-856895-1 Sep 10 12:07:07.729305 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-e936a0e0-8517-4ae0-9e8d-1b044b784c5d req-1e2a6844-2a64-4ad0-bfd1-3b694c3aa095 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051530 Sep 10 12:07:07.729947 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2743/5475] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:07:07.805668 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-76054b43-840d-4f27-aa68-64a1aab60556 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:07.806570 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-76054b43-840d-4f27-aa68-64a1aab60556 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:07.815728 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-76054b43-840d-4f27-aa68-64a1aab60556 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:07.816432 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-76054b43-840d-4f27-aa68-64a1aab60556 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:07.817047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-76054b43-840d-4f27-aa68-64a1aab60556 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:07.817909 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-76054b43-840d-4f27-aa68-64a1aab60556 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:07.818388 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-76054b43-840d-4f27-aa68-64a1aab60556 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:07.818845 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-76054b43-840d-4f27-aa68-64a1aab60556 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:08.076659 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-76054b43-840d-4f27-aa68-64a1aab60556 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:08.085433 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-76054b43-840d-4f27-aa68-64a1aab60556 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64" status: 200 len: 1315 microversion: 2.1 time: 0.284365 Sep 10 12:07:08.099645 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2733/5476] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:07 2022] GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:08.153670 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4c4a4ca8-6199-4d2c-b15b-095ea7539b8c tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:08.156541 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4c4a4ca8-6199-4d2c-b15b-095ea7539b8c tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: f4da91bc-acbf-487b-b305-a619df7ad3f8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:08.165105 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4c4a4ca8-6199-4d2c-b15b-095ea7539b8c tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:08.166940 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4c4a4ca8-6199-4d2c-b15b-095ea7539b8c tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:08.167872 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4c4a4ca8-6199-4d2c-b15b-095ea7539b8c tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:08.172110 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4c4a4ca8-6199-4d2c-b15b-095ea7539b8c tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:08.172886 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4c4a4ca8-6199-4d2c-b15b-095ea7539b8c tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:08.173645 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4c4a4ca8-6199-4d2c-b15b-095ea7539b8c tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:08.528155 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4c4a4ca8-6199-4d2c-b15b-095ea7539b8c tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:08.543443 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4c4a4ca8-6199-4d2c-b15b-095ea7539b8c tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8" status: 200 len: 1368 microversion: 2.1 time: 0.401727 Sep 10 12:07:08.562564 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2744/5477] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:08 2022] GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8 => generated 1368 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:08.573278 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2df79ad4-de6e-4d63-8d56-dbdbeb7a202d tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:08.573901 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2df79ad4-de6e-4d63-8d56-dbdbeb7a202d tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] [instance: d0010d88-9014-48c4-8974-0a14ecf0e3ba] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:08.589690 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2df79ad4-de6e-4d63-8d56-dbdbeb7a202d tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:08.590199 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2df79ad4-de6e-4d63-8d56-dbdbeb7a202d tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:08.590638 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2df79ad4-de6e-4d63-8d56-dbdbeb7a202d tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:08.591384 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2df79ad4-de6e-4d63-8d56-dbdbeb7a202d tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:08.591846 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2df79ad4-de6e-4d63-8d56-dbdbeb7a202d tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:08.592278 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2df79ad4-de6e-4d63-8d56-dbdbeb7a202d tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:08.640897 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2df79ad4-de6e-4d63-8d56-dbdbeb7a202d tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:08.642006 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2df79ad4-de6e-4d63-8d56-dbdbeb7a202d tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:08.642493 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2df79ad4-de6e-4d63-8d56-dbdbeb7a202d tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:08.642968 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-2df79ad4-de6e-4d63-8d56-dbdbeb7a202d tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lazy-loading 'fault' on Instance uuid d0010d88-9014-48c4-8974-0a14ecf0e3ba {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:07:08.734211 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2df79ad4-de6e-4d63-8d56-dbdbeb7a202d tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcbed59a8854e848afb2960fd6af525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b5a220528a4b2b99bb816a78e7de95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:08.742140 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2df79ad4-de6e-4d63-8d56-dbdbeb7a202d tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] 10.222.0.23 "GET /compute/v2.1/servers/d0010d88-9014-48c4-8974-0a14ecf0e3ba" status: 200 len: 1303 microversion: 2.1 time: 0.174482 Sep 10 12:07:08.746944 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2734/5478] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:08 2022] GET /compute/v2.1/servers/d0010d88-9014-48c4-8974-0a14ecf0e3ba => generated 1303 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:09.116989 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-06bdd844-3416-4366-8139-b0adda739c26 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:09.119515 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-06bdd844-3416-4366-8139-b0adda739c26 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:09.140079 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-06bdd844-3416-4366-8139-b0adda739c26 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:09.140578 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-06bdd844-3416-4366-8139-b0adda739c26 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:09.141032 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-06bdd844-3416-4366-8139-b0adda739c26 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:09.141746 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-06bdd844-3416-4366-8139-b0adda739c26 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:09.152244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-06bdd844-3416-4366-8139-b0adda739c26 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:09.152700 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-06bdd844-3416-4366-8139-b0adda739c26 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:09.310087 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-06bdd844-3416-4366-8139-b0adda739c26 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:09.318828 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-06bdd844-3416-4366-8139-b0adda739c26 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64" status: 200 len: 1315 microversion: 2.1 time: 0.212305 Sep 10 12:07:09.320218 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2745/5479] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:09 2022] GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:09.573007 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2c13b4e9-310f-4dd7-aba8-19c2d49dd76a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:09.574715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2c13b4e9-310f-4dd7-aba8-19c2d49dd76a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: f4da91bc-acbf-487b-b305-a619df7ad3f8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:09.587082 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c13b4e9-310f-4dd7-aba8-19c2d49dd76a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:09.589153 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c13b4e9-310f-4dd7-aba8-19c2d49dd76a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:09.590235 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c13b4e9-310f-4dd7-aba8-19c2d49dd76a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:09.591811 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c13b4e9-310f-4dd7-aba8-19c2d49dd76a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:09.592553 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c13b4e9-310f-4dd7-aba8-19c2d49dd76a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:09.593329 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c13b4e9-310f-4dd7-aba8-19c2d49dd76a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:09.636691 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:07:09.769865 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5acc61a5-680f-4544-aab7-77e9dde78856 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:09.770537 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5acc61a5-680f-4544-aab7-77e9dde78856 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] [instance: d0010d88-9014-48c4-8974-0a14ecf0e3ba] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:09.781049 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5acc61a5-680f-4544-aab7-77e9dde78856 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:09.782810 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5acc61a5-680f-4544-aab7-77e9dde78856 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:09.784196 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5acc61a5-680f-4544-aab7-77e9dde78856 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:09.788226 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5acc61a5-680f-4544-aab7-77e9dde78856 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:09.795262 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5acc61a5-680f-4544-aab7-77e9dde78856 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:09.798045 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5acc61a5-680f-4544-aab7-77e9dde78856 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:09.852071 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-5acc61a5-680f-4544-aab7-77e9dde78856 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] HTTP exception thrown: Instance d0010d88-9014-48c4-8974-0a14ecf0e3ba could not be found. Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5acc61a5-680f-4544-aab7-77e9dde78856 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Request method failure captured: Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/d0010d88-9014-48c4-8974-0a14ecf0e3ba HTTP/1.1 Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH258nXHw8nveNuMwZARhDQigg_x8SxtiKJJ_EbK57K6AKTKeqvec1n9x6rAmfEAXQQ7fswXZ0VRVNODle7QYD0DEK6nel-3JYZKAp9Paoy_rS-xuSSfdAEaKciBlbiBWOGuS-IVRiVDK31t6CzwqI5v30M8EhV_mG7sIKVv-Rk1Sfw Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: c7b5a220528a4b2b99bb816a78e7de95 Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-VolumesActionsTest-2056808459 Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7b5a220528a4b2b99bb816a78e7de95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c7b5a220528a4b2b99bb816a78e7de95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c7b5a220528a4b2b99bb816a78e7de95", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c7b5a220528a4b2b99bb816a78e7de95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-VolumesActionsTest-2056808459 Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: c7b5a220528a4b2b99bb816a78e7de95 Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-VolumesActionsTest-2056808459 Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-VolumesActionsTest-2056808459-project Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 0dcbed59a8854e848afb2960fd6af525 Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-VolumesActionsTest-2056808459-project Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance d0010d88-9014-48c4-8974-0a14ecf0e3ba could not be found. Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'd0010d88-9014-48c4-8974-0a14ecf0e3ba'} Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0010d88-9014-48c4-8974-0a14ecf0e3ba could not be found. Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0010d88-9014-48c4-8974-0a14ecf0e3ba could not be found. Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:07:09.857950 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:07:09.863149 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:07:09.863149 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:07:09.863149 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:07:09.863149 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:07:09.863149 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:07:09.863149 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0010d88-9014-48c4-8974-0a14ecf0e3ba could not be found. Sep 10 12:07:09.863149 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:07:09.868353 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5acc61a5-680f-4544-aab7-77e9dde78856 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] Returning 404 to user: Instance d0010d88-9014-48c4-8974-0a14ecf0e3ba could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:07:09.870045 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5acc61a5-680f-4544-aab7-77e9dde78856 tempest-VolumesActionsTest-2056808459 tempest-VolumesActionsTest-2056808459-project] 10.222.0.23 "GET /compute/v2.1/servers/d0010d88-9014-48c4-8974-0a14ecf0e3ba" status: 404 len: 111 microversion: 2.1 time: 0.104847 Sep 10 12:07:09.871299 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2746/5480] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:09 2022] GET /compute/v2.1/servers/d0010d88-9014-48c4-8974-0a14ecf0e3ba => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 12:07:09.893798 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-80c3ec75-c72e-4d00-9932-81216f589157 req-dcdac10b-2e24-485d-85fd-4818a8c15502 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0010d88-9014-48c4-8974-0a14ecf0e3ba", "name": "network-vif-deleted", "tag": "1c0e22d7-716d-46d1-a0a7-d792c1d08555"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:07:09.906610 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-80c3ec75-c72e-4d00-9932-81216f589157 req-dcdac10b-2e24-485d-85fd-4818a8c15502 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:09.907563 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-80c3ec75-c72e-4d00-9932-81216f589157 req-dcdac10b-2e24-485d-85fd-4818a8c15502 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:09.908206 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-80c3ec75-c72e-4d00-9932-81216f589157 req-dcdac10b-2e24-485d-85fd-4818a8c15502 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:09.921785 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-80c3ec75-c72e-4d00-9932-81216f589157 req-dcdac10b-2e24-485d-85fd-4818a8c15502 service nova] Creating event network-vif-deleted:1c0e22d7-716d-46d1-a0a7-d792c1d08555 for instance d0010d88-9014-48c4-8974-0a14ecf0e3ba on n-h1-856895-1 Sep 10 12:07:09.930765 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-80c3ec75-c72e-4d00-9932-81216f589157 req-dcdac10b-2e24-485d-85fd-4818a8c15502 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041176 Sep 10 12:07:09.933782 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2747/5481] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:07:09.990091 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2c13b4e9-310f-4dd7-aba8-19c2d49dd76a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:09.998967 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2c13b4e9-310f-4dd7-aba8-19c2d49dd76a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8" status: 200 len: 1368 microversion: 2.1 time: 0.434427 Sep 10 12:07:10.000112 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2735/5482] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:09 2022] GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8 => generated 1368 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:07:10.345462 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f9fbe01d-12ee-49af-962f-4ee4ab405eb0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:10.346335 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f9fbe01d-12ee-49af-962f-4ee4ab405eb0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:10.359713 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f9fbe01d-12ee-49af-962f-4ee4ab405eb0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:10.360206 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f9fbe01d-12ee-49af-962f-4ee4ab405eb0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:10.360523 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f9fbe01d-12ee-49af-962f-4ee4ab405eb0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:10.375335 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f9fbe01d-12ee-49af-962f-4ee4ab405eb0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:10.376203 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f9fbe01d-12ee-49af-962f-4ee4ab405eb0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:10.378319 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f9fbe01d-12ee-49af-962f-4ee4ab405eb0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:10.664604 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f9fbe01d-12ee-49af-962f-4ee4ab405eb0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:10.678466 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f9fbe01d-12ee-49af-962f-4ee4ab405eb0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64" status: 200 len: 1315 microversion: 2.1 time: 0.339876 Sep 10 12:07:10.679100 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2748/5483] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:10 2022] GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:11.026434 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7e786ec8-acc6-49fc-a225-3cbb96095657 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:11.027200 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7e786ec8-acc6-49fc-a225-3cbb96095657 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: f4da91bc-acbf-487b-b305-a619df7ad3f8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:11.034221 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e786ec8-acc6-49fc-a225-3cbb96095657 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:11.040895 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e786ec8-acc6-49fc-a225-3cbb96095657 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:11.041654 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e786ec8-acc6-49fc-a225-3cbb96095657 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:11.043101 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e786ec8-acc6-49fc-a225-3cbb96095657 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:11.045558 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e786ec8-acc6-49fc-a225-3cbb96095657 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:11.046099 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e786ec8-acc6-49fc-a225-3cbb96095657 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:11.422619 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7e786ec8-acc6-49fc-a225-3cbb96095657 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:11.441770 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7e786ec8-acc6-49fc-a225-3cbb96095657 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8" status: 200 len: 1368 microversion: 2.1 time: 0.421124 Sep 10 12:07:11.445012 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2736/5484] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:11 2022] GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8 => generated 1368 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:11.704201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0aa320fa-38cf-4b92-9b4c-ca7a64c6d4a5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:11.705386 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0aa320fa-38cf-4b92-9b4c-ca7a64c6d4a5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:11.720936 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0aa320fa-38cf-4b92-9b4c-ca7a64c6d4a5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:11.721614 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0aa320fa-38cf-4b92-9b4c-ca7a64c6d4a5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:11.727203 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0aa320fa-38cf-4b92-9b4c-ca7a64c6d4a5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:11.728155 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0aa320fa-38cf-4b92-9b4c-ca7a64c6d4a5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:11.732890 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0aa320fa-38cf-4b92-9b4c-ca7a64c6d4a5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:11.735001 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0aa320fa-38cf-4b92-9b4c-ca7a64c6d4a5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:12.234569 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0aa320fa-38cf-4b92-9b4c-ca7a64c6d4a5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:12.245665 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0aa320fa-38cf-4b92-9b4c-ca7a64c6d4a5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64" status: 200 len: 1315 microversion: 2.1 time: 0.545797 Sep 10 12:07:12.246256 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2749/5485] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:11 2022] GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 => generated 1315 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:12.379795 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-c37b56a1-178d-4912-a02c-7ecdf4e43ed4 req-77e6c852-6db8-4547-9459-4fcfe90017fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4da91bc-acbf-487b-b305-a619df7ad3f8", "name": "network-vif-plugged", "status": "completed", "tag": "252ed3a1-8f35-4360-884d-18b174b63873"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:07:12.398159 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-c37b56a1-178d-4912-a02c-7ecdf4e43ed4 req-77e6c852-6db8-4547-9459-4fcfe90017fe service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:12.398952 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-c37b56a1-178d-4912-a02c-7ecdf4e43ed4 req-77e6c852-6db8-4547-9459-4fcfe90017fe service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:12.400058 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-c37b56a1-178d-4912-a02c-7ecdf4e43ed4 req-77e6c852-6db8-4547-9459-4fcfe90017fe service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:12.440292 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-c37b56a1-178d-4912-a02c-7ecdf4e43ed4 req-77e6c852-6db8-4547-9459-4fcfe90017fe service nova] Creating event network-vif-plugged:252ed3a1-8f35-4360-884d-18b174b63873 for instance f4da91bc-acbf-487b-b305-a619df7ad3f8 on n-h2-856895-1 Sep 10 12:07:12.447021 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-c37b56a1-178d-4912-a02c-7ecdf4e43ed4 req-77e6c852-6db8-4547-9459-4fcfe90017fe service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071738 Sep 10 12:07:12.447992 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2737/5486] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:07:12.473139 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e7e78264-38a1-4bb7-8f08-a4d15b09018b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:12.473767 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e7e78264-38a1-4bb7-8f08-a4d15b09018b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: f4da91bc-acbf-487b-b305-a619df7ad3f8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:12.500851 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7e78264-38a1-4bb7-8f08-a4d15b09018b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:12.506153 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7e78264-38a1-4bb7-8f08-a4d15b09018b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:12.507048 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7e78264-38a1-4bb7-8f08-a4d15b09018b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:12.508414 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7e78264-38a1-4bb7-8f08-a4d15b09018b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:12.517798 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7e78264-38a1-4bb7-8f08-a4d15b09018b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:12.518350 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7e78264-38a1-4bb7-8f08-a4d15b09018b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:12.831412 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e7e78264-38a1-4bb7-8f08-a4d15b09018b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:12.846701 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e7e78264-38a1-4bb7-8f08-a4d15b09018b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8" status: 200 len: 1368 microversion: 2.1 time: 0.377578 Sep 10 12:07:12.848334 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2750/5487] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:12 2022] GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8 => generated 1368 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:13.265873 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=4 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:07:13.266648 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=12 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:07:13.276062 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c9a70d09-895b-47d1-a555-9d3d82580818 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:13.278204 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c9a70d09-895b-47d1-a555-9d3d82580818 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:13.308012 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c9a70d09-895b-47d1-a555-9d3d82580818 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:13.309275 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c9a70d09-895b-47d1-a555-9d3d82580818 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:13.309873 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c9a70d09-895b-47d1-a555-9d3d82580818 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:13.310703 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c9a70d09-895b-47d1-a555-9d3d82580818 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:13.311275 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c9a70d09-895b-47d1-a555-9d3d82580818 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:13.312040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c9a70d09-895b-47d1-a555-9d3d82580818 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:13.881147 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-254a13da-cbe7-42ec-aec6-d1be4be0f1ba tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:13.881147 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-254a13da-cbe7-42ec-aec6-d1be4be0f1ba tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: f4da91bc-acbf-487b-b305-a619df7ad3f8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:13.903635 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=10 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:07:13.922172 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-254a13da-cbe7-42ec-aec6-d1be4be0f1ba tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:13.939969 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-254a13da-cbe7-42ec-aec6-d1be4be0f1ba tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:13.948685 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-254a13da-cbe7-42ec-aec6-d1be4be0f1ba tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:13.952298 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-254a13da-cbe7-42ec-aec6-d1be4be0f1ba tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:13.957020 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-254a13da-cbe7-42ec-aec6-d1be4be0f1ba tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:13.964333 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-254a13da-cbe7-42ec-aec6-d1be4be0f1ba tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:14.019375 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c9a70d09-895b-47d1-a555-9d3d82580818 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:14.036704 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c9a70d09-895b-47d1-a555-9d3d82580818 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64" status: 200 len: 1315 microversion: 2.1 time: 0.771592 Sep 10 12:07:14.059500 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2738/5488] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:13 2022] GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 => generated 1315 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:14.292790 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-254a13da-cbe7-42ec-aec6-d1be4be0f1ba tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:14.301264 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-254a13da-cbe7-42ec-aec6-d1be4be0f1ba tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8" status: 200 len: 1368 microversion: 2.1 time: 0.431242 Sep 10 12:07:14.321216 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2751/5489] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:13 2022] GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8 => generated 1368 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:15.066419 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4c561b34-6ea2-44bd-bd8a-55159f7f35da tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:15.067385 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4c561b34-6ea2-44bd-bd8a-55159f7f35da tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:15.079908 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4c561b34-6ea2-44bd-bd8a-55159f7f35da tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:15.080716 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4c561b34-6ea2-44bd-bd8a-55159f7f35da tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:15.083395 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4c561b34-6ea2-44bd-bd8a-55159f7f35da tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:15.086611 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4c561b34-6ea2-44bd-bd8a-55159f7f35da tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:15.087269 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4c561b34-6ea2-44bd-bd8a-55159f7f35da tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:15.088281 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4c561b34-6ea2-44bd-bd8a-55159f7f35da tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:15.095631 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:07:15.248366 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-06130afd-9bb4-4eea-9556-e15b4f84d478 tempest-PortsAdminExtendedAttrsTestJSON-1648493811 tempest-PortsAdminExtendedAttrsTestJSON-1648493811-project-admin] Calling method '.version_select at 0x7f40725404c0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:15.253576 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06130afd-9bb4-4eea-9556-e15b4f84d478 tempest-PortsAdminExtendedAttrsTestJSON-1648493811 tempest-PortsAdminExtendedAttrsTestJSON-1648493811-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:15.258618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06130afd-9bb4-4eea-9556-e15b4f84d478 tempest-PortsAdminExtendedAttrsTestJSON-1648493811 tempest-PortsAdminExtendedAttrsTestJSON-1648493811-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:15.260393 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06130afd-9bb4-4eea-9556-e15b4f84d478 tempest-PortsAdminExtendedAttrsTestJSON-1648493811 tempest-PortsAdminExtendedAttrsTestJSON-1648493811-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:15.313968 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06130afd-9bb4-4eea-9556-e15b4f84d478 tempest-PortsAdminExtendedAttrsTestJSON-1648493811 tempest-PortsAdminExtendedAttrsTestJSON-1648493811-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:15.314481 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06130afd-9bb4-4eea-9556-e15b4f84d478 tempest-PortsAdminExtendedAttrsTestJSON-1648493811 tempest-PortsAdminExtendedAttrsTestJSON-1648493811-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:15.314934 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06130afd-9bb4-4eea-9556-e15b4f84d478 tempest-PortsAdminExtendedAttrsTestJSON-1648493811 tempest-PortsAdminExtendedAttrsTestJSON-1648493811-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:15.344126 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06130afd-9bb4-4eea-9556-e15b4f84d478 tempest-PortsAdminExtendedAttrsTestJSON-1648493811 tempest-PortsAdminExtendedAttrsTestJSON-1648493811-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:15.344633 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06130afd-9bb4-4eea-9556-e15b4f84d478 tempest-PortsAdminExtendedAttrsTestJSON-1648493811 tempest-PortsAdminExtendedAttrsTestJSON-1648493811-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:15.345088 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06130afd-9bb4-4eea-9556-e15b4f84d478 tempest-PortsAdminExtendedAttrsTestJSON-1648493811 tempest-PortsAdminExtendedAttrsTestJSON-1648493811-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:15.354628 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-06130afd-9bb4-4eea-9556-e15b4f84d478 tempest-PortsAdminExtendedAttrsTestJSON-1648493811 tempest-PortsAdminExtendedAttrsTestJSON-1648493811-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.525405 Sep 10 12:07:15.355838 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2739/5490] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 12:07:14 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:07:15.361735 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2fcf60d1-9c9b-4180-9e6c-e67091133d5b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:15.362864 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2fcf60d1-9c9b-4180-9e6c-e67091133d5b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: f4da91bc-acbf-487b-b305-a619df7ad3f8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:15.370763 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fcf60d1-9c9b-4180-9e6c-e67091133d5b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:15.371347 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fcf60d1-9c9b-4180-9e6c-e67091133d5b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:15.371800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fcf60d1-9c9b-4180-9e6c-e67091133d5b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:15.373265 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fcf60d1-9c9b-4180-9e6c-e67091133d5b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:15.374671 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fcf60d1-9c9b-4180-9e6c-e67091133d5b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:15.375322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fcf60d1-9c9b-4180-9e6c-e67091133d5b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:15.415785 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4c561b34-6ea2-44bd-bd8a-55159f7f35da tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:15.428055 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4c561b34-6ea2-44bd-bd8a-55159f7f35da tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64" status: 200 len: 1315 microversion: 2.1 time: 0.363586 Sep 10 12:07:15.429040 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2752/5491] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:15 2022] GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:07:15.634891 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2fcf60d1-9c9b-4180-9e6c-e67091133d5b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:15.645771 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2fcf60d1-9c9b-4180-9e6c-e67091133d5b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8" status: 200 len: 1559 microversion: 2.1 time: 0.288680 Sep 10 12:07:15.646656 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2740/5492] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:15 2022] GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8 => generated 1559 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:15.670678 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a3cb7a7b-64cf-4816-9544-6931de23e77e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:15.671698 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a3cb7a7b-64cf-4816-9544-6931de23e77e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: f4da91bc-acbf-487b-b305-a619df7ad3f8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:15.680842 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a3cb7a7b-64cf-4816-9544-6931de23e77e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:15.681715 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a3cb7a7b-64cf-4816-9544-6931de23e77e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:15.683693 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a3cb7a7b-64cf-4816-9544-6931de23e77e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:15.684603 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a3cb7a7b-64cf-4816-9544-6931de23e77e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:15.685068 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a3cb7a7b-64cf-4816-9544-6931de23e77e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:15.688074 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a3cb7a7b-64cf-4816-9544-6931de23e77e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:15.899388 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a3cb7a7b-64cf-4816-9544-6931de23e77e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.231451 Sep 10 12:07:15.900332 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2753/5493] 10.222.0.23 () {58 vars in 1275 bytes} [Sat Sep 10 12:07:15 2022] GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8/os-interface => generated 285 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:07:16.143189 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-d65f66bf-36ee-43db-ab0d-007735666ad0 req-cc02f4c0-b6dd-4318-b5f5-4928dc294003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55d5cbf7-6438-4f5b-96b3-719e9f3f7a64", "name": "network-vif-plugged", "status": "completed", "tag": "c6eb0ad3-74e3-40f5-a84c-64f4d0d21125"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:07:16.162016 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:07:16.164669 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d65f66bf-36ee-43db-ab0d-007735666ad0 req-cc02f4c0-b6dd-4318-b5f5-4928dc294003 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:16.168090 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d65f66bf-36ee-43db-ab0d-007735666ad0 req-cc02f4c0-b6dd-4318-b5f5-4928dc294003 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:16.168849 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d65f66bf-36ee-43db-ab0d-007735666ad0 req-cc02f4c0-b6dd-4318-b5f5-4928dc294003 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:16.197330 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-d65f66bf-36ee-43db-ab0d-007735666ad0 req-cc02f4c0-b6dd-4318-b5f5-4928dc294003 service nova] Creating event network-vif-plugged:c6eb0ad3-74e3-40f5-a84c-64f4d0d21125 for instance 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 on n-h2-856895-1 Sep 10 12:07:16.203698 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-d65f66bf-36ee-43db-ab0d-007735666ad0 req-cc02f4c0-b6dd-4318-b5f5-4928dc294003 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064870 Sep 10 12:07:16.216314 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2741/5494] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:07:16.456015 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-351fa380-bc84-489b-a919-7db0a3d14363 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:16.456641 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-351fa380-bc84-489b-a919-7db0a3d14363 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:16.466460 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-351fa380-bc84-489b-a919-7db0a3d14363 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:16.472061 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-351fa380-bc84-489b-a919-7db0a3d14363 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:16.472752 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-351fa380-bc84-489b-a919-7db0a3d14363 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:16.473892 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-351fa380-bc84-489b-a919-7db0a3d14363 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:16.474531 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-351fa380-bc84-489b-a919-7db0a3d14363 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:16.475175 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-351fa380-bc84-489b-a919-7db0a3d14363 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:16.710531 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-351fa380-bc84-489b-a919-7db0a3d14363 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:16.741218 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-351fa380-bc84-489b-a919-7db0a3d14363 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64" status: 200 len: 1315 microversion: 2.1 time: 0.288148 Sep 10 12:07:16.745959 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2754/5495] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:16 2022] GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:17.557772 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-fe31d839-95c6-41da-90fd-9b16a97ffa87 req-6f3de05d-b82a-47a8-ab62-90f78e8626e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4da91bc-acbf-487b-b305-a619df7ad3f8", "tag": "252ed3a1-8f35-4360-884d-18b174b63873"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:07:17.576927 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-fe31d839-95c6-41da-90fd-9b16a97ffa87 req-6f3de05d-b82a-47a8-ab62-90f78e8626e9 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:17.578704 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-fe31d839-95c6-41da-90fd-9b16a97ffa87 req-6f3de05d-b82a-47a8-ab62-90f78e8626e9 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:17.581920 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-fe31d839-95c6-41da-90fd-9b16a97ffa87 req-6f3de05d-b82a-47a8-ab62-90f78e8626e9 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:17.608977 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-fe31d839-95c6-41da-90fd-9b16a97ffa87 req-6f3de05d-b82a-47a8-ab62-90f78e8626e9 service nova] Creating event network-changed:252ed3a1-8f35-4360-884d-18b174b63873 for instance f4da91bc-acbf-487b-b305-a619df7ad3f8 on n-h2-856895-1 Sep 10 12:07:17.630450 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-fe31d839-95c6-41da-90fd-9b16a97ffa87 req-6f3de05d-b82a-47a8-ab62-90f78e8626e9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077697 Sep 10 12:07:17.632472 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2742/5496] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:07:17.770540 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b7d4a466-74dd-4870-9405-d4e43edda36c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:17.772914 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b7d4a466-74dd-4870-9405-d4e43edda36c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:17.781613 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7d4a466-74dd-4870-9405-d4e43edda36c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:17.791580 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7d4a466-74dd-4870-9405-d4e43edda36c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:17.792059 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7d4a466-74dd-4870-9405-d4e43edda36c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:17.792812 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7d4a466-74dd-4870-9405-d4e43edda36c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:17.793277 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7d4a466-74dd-4870-9405-d4e43edda36c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:17.793750 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7d4a466-74dd-4870-9405-d4e43edda36c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:18.182579 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b7d4a466-74dd-4870-9405-d4e43edda36c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:18.220827 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b7d4a466-74dd-4870-9405-d4e43edda36c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64" status: 200 len: 1315 microversion: 2.1 time: 0.454481 Sep 10 12:07:18.226480 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2755/5497] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:17 2022] GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 => generated 1315 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:19.252678 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8a84f230-32ce-40f8-ad7d-17a27a2c511d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:19.254634 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8a84f230-32ce-40f8-ad7d-17a27a2c511d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:19.269961 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a84f230-32ce-40f8-ad7d-17a27a2c511d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:19.271507 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a84f230-32ce-40f8-ad7d-17a27a2c511d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:19.273540 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a84f230-32ce-40f8-ad7d-17a27a2c511d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:19.276324 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a84f230-32ce-40f8-ad7d-17a27a2c511d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:19.276989 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a84f230-32ce-40f8-ad7d-17a27a2c511d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:19.277700 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a84f230-32ce-40f8-ad7d-17a27a2c511d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:19.613111 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8a84f230-32ce-40f8-ad7d-17a27a2c511d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:19.625343 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8a84f230-32ce-40f8-ad7d-17a27a2c511d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64" status: 200 len: 1502 microversion: 2.1 time: 0.379859 Sep 10 12:07:19.639382 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2743/5498] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:19 2022] GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 => generated 1502 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:19.654450 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-42de30b6-14c6-4f37-a85b-d504068b07a2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:07:19.654999 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-42de30b6-14c6-4f37-a85b-d504068b07a2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:19.668792 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42de30b6-14c6-4f37-a85b-d504068b07a2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:19.669302 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42de30b6-14c6-4f37-a85b-d504068b07a2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:19.669753 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42de30b6-14c6-4f37-a85b-d504068b07a2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:19.673898 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42de30b6-14c6-4f37-a85b-d504068b07a2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:19.674399 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42de30b6-14c6-4f37-a85b-d504068b07a2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:19.674846 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42de30b6-14c6-4f37-a85b-d504068b07a2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:19.846881 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-42de30b6-14c6-4f37-a85b-d504068b07a2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "POST /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64/action" status: 202 len: 0 microversion: 2.1 time: 0.196018 Sep 10 12:07:19.851392 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2756/5499] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:07:19 2022] POST /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:07:19.862036 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b6d6dfb0-590f-47cc-ac53-92b565fddb21 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:19.863028 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b6d6dfb0-590f-47cc-ac53-92b565fddb21 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:19.877236 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b6d6dfb0-590f-47cc-ac53-92b565fddb21 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:19.879017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b6d6dfb0-590f-47cc-ac53-92b565fddb21 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:19.881006 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b6d6dfb0-590f-47cc-ac53-92b565fddb21 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:19.884083 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b6d6dfb0-590f-47cc-ac53-92b565fddb21 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:19.885031 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b6d6dfb0-590f-47cc-ac53-92b565fddb21 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:19.886761 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b6d6dfb0-590f-47cc-ac53-92b565fddb21 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:20.470545 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b6d6dfb0-590f-47cc-ac53-92b565fddb21 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:20.496824 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b6d6dfb0-590f-47cc-ac53-92b565fddb21 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64" status: 200 len: 1507 microversion: 2.1 time: 0.637404 Sep 10 12:07:20.505163 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2744/5500] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:19 2022] GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 => generated 1507 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:21.526427 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-87dea8d3-7279-4dfd-ae5e-c8dd5a16cde2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:21.527156 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-87dea8d3-7279-4dfd-ae5e-c8dd5a16cde2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:21.538553 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-87dea8d3-7279-4dfd-ae5e-c8dd5a16cde2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:21.541465 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-87dea8d3-7279-4dfd-ae5e-c8dd5a16cde2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:21.543261 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-87dea8d3-7279-4dfd-ae5e-c8dd5a16cde2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:21.544019 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-87dea8d3-7279-4dfd-ae5e-c8dd5a16cde2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:21.545958 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-87dea8d3-7279-4dfd-ae5e-c8dd5a16cde2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:21.551366 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-87dea8d3-7279-4dfd-ae5e-c8dd5a16cde2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:22.032248 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-87dea8d3-7279-4dfd-ae5e-c8dd5a16cde2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:22.042517 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-87dea8d3-7279-4dfd-ae5e-c8dd5a16cde2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64" status: 200 len: 1487 microversion: 2.1 time: 0.522027 Sep 10 12:07:22.047273 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2757/5501] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:21 2022] GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 => generated 1487 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:22.074286 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-32ebcb82-670d-4b51-81c9-947997fcdacd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:07:22.075701 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-32ebcb82-670d-4b51-81c9-947997fcdacd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:22.088436 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32ebcb82-670d-4b51-81c9-947997fcdacd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:22.090618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32ebcb82-670d-4b51-81c9-947997fcdacd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:22.092548 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32ebcb82-670d-4b51-81c9-947997fcdacd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:22.093498 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32ebcb82-670d-4b51-81c9-947997fcdacd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:22.095094 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32ebcb82-670d-4b51-81c9-947997fcdacd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:22.096595 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32ebcb82-670d-4b51-81c9-947997fcdacd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:22.150533 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-32ebcb82-670d-4b51-81c9-947997fcdacd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lazy-loading 'flavor' on Instance uuid 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:07:22.712736 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-32ebcb82-670d-4b51-81c9-947997fcdacd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "POST /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64/action" status: 202 len: 0 microversion: 2.1 time: 0.643270 Sep 10 12:07:22.716464 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2745/5502] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:07:22 2022] POST /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64/action => generated 0 bytes in 648 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:07:22.734195 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-85b5f3e9-96ae-466a-bd3c-6564df1fa2ae tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:22.734854 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-85b5f3e9-96ae-466a-bd3c-6564df1fa2ae tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:22.768987 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:07:22.780643 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85b5f3e9-96ae-466a-bd3c-6564df1fa2ae tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:22.783585 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85b5f3e9-96ae-466a-bd3c-6564df1fa2ae tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:22.786722 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85b5f3e9-96ae-466a-bd3c-6564df1fa2ae tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:22.791811 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85b5f3e9-96ae-466a-bd3c-6564df1fa2ae tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:22.797432 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85b5f3e9-96ae-466a-bd3c-6564df1fa2ae tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:22.798885 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85b5f3e9-96ae-466a-bd3c-6564df1fa2ae tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:23.286925 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-85b5f3e9-96ae-466a-bd3c-6564df1fa2ae tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:23.302207 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-85b5f3e9-96ae-466a-bd3c-6564df1fa2ae tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64" status: 200 len: 1493 microversion: 2.1 time: 0.572957 Sep 10 12:07:23.328121 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2758/5503] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:22 2022] GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 => generated 1493 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:24.343371 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-662935fe-352c-4112-a526-9e41412e6a87 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:24.345590 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-662935fe-352c-4112-a526-9e41412e6a87 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:24.364232 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-662935fe-352c-4112-a526-9e41412e6a87 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:24.377009 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-662935fe-352c-4112-a526-9e41412e6a87 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:24.379434 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-662935fe-352c-4112-a526-9e41412e6a87 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:24.379434 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-662935fe-352c-4112-a526-9e41412e6a87 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:24.379858 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-662935fe-352c-4112-a526-9e41412e6a87 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:24.384506 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-662935fe-352c-4112-a526-9e41412e6a87 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:25.048122 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-662935fe-352c-4112-a526-9e41412e6a87 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:25.074335 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-662935fe-352c-4112-a526-9e41412e6a87 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64" status: 200 len: 1514 microversion: 2.1 time: 0.725884 Sep 10 12:07:25.077863 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2746/5504] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:24 2022] GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 => generated 1514 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:26.120908 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-17fe929d-0836-450e-b8f4-5e405d8bf0c0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:26.122178 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-17fe929d-0836-450e-b8f4-5e405d8bf0c0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:26.155069 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17fe929d-0836-450e-b8f4-5e405d8bf0c0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:26.157089 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17fe929d-0836-450e-b8f4-5e405d8bf0c0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:26.159977 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17fe929d-0836-450e-b8f4-5e405d8bf0c0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:26.163389 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17fe929d-0836-450e-b8f4-5e405d8bf0c0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:26.168722 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17fe929d-0836-450e-b8f4-5e405d8bf0c0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:26.169282 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17fe929d-0836-450e-b8f4-5e405d8bf0c0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:26.562252 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-17fe929d-0836-450e-b8f4-5e405d8bf0c0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:26.578348 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-17fe929d-0836-450e-b8f4-5e405d8bf0c0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64" status: 200 len: 1509 microversion: 2.1 time: 0.470137 Sep 10 12:07:26.578960 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2759/5505] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:26 2022] GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 => generated 1509 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:27.612075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-21d26acf-3069-48c3-a3a0-5a21f880ed6c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:27.613412 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-21d26acf-3069-48c3-a3a0-5a21f880ed6c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:27.623788 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-21d26acf-3069-48c3-a3a0-5a21f880ed6c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:27.628437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-21d26acf-3069-48c3-a3a0-5a21f880ed6c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:27.630099 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-21d26acf-3069-48c3-a3a0-5a21f880ed6c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:27.631240 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-21d26acf-3069-48c3-a3a0-5a21f880ed6c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:27.633821 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-21d26acf-3069-48c3-a3a0-5a21f880ed6c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:27.635218 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-21d26acf-3069-48c3-a3a0-5a21f880ed6c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:28.275301 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-48f7a512-fa9d-4330-af17-c21e96354d25 req-f8b9001b-edbd-4589-9d4f-1e70d2cd6aeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55d5cbf7-6438-4f5b-96b3-719e9f3f7a64", "name": "network-vif-plugged", "status": "completed", "tag": "c6eb0ad3-74e3-40f5-a84c-64f4d0d21125"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:07:28.321639 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-48f7a512-fa9d-4330-af17-c21e96354d25 req-f8b9001b-edbd-4589-9d4f-1e70d2cd6aeb service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:28.322488 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-48f7a512-fa9d-4330-af17-c21e96354d25 req-f8b9001b-edbd-4589-9d4f-1e70d2cd6aeb service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:28.324527 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-48f7a512-fa9d-4330-af17-c21e96354d25 req-f8b9001b-edbd-4589-9d4f-1e70d2cd6aeb service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:28.366840 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-48f7a512-fa9d-4330-af17-c21e96354d25 req-f8b9001b-edbd-4589-9d4f-1e70d2cd6aeb service nova] Creating event network-vif-plugged:c6eb0ad3-74e3-40f5-a84c-64f4d0d21125 for instance 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 on n-h2-856895-1 Sep 10 12:07:28.386764 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-48f7a512-fa9d-4330-af17-c21e96354d25 req-f8b9001b-edbd-4589-9d4f-1e70d2cd6aeb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117278 Sep 10 12:07:28.397179 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2760/5506] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:07:28.782515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-21d26acf-3069-48c3-a3a0-5a21f880ed6c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:28.796302 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-21d26acf-3069-48c3-a3a0-5a21f880ed6c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64" status: 200 len: 1509 microversion: 2.1 time: 1.188447 Sep 10 12:07:28.821287 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2747/5507] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:27 2022] GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 => generated 1509 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:29.656312 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-39501912-9753-4860-93aa-6182fb4c3076 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Action: 'create', calling method: .version_select at 0x7f40721d23a0>, body: {"keypair": {"name": "tempest-keypair-374776183", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBaxc+DBtTSH8ikltG4UowI0fWlWrLjJCEVm65HAJ+7xb9H6EDIVeR1kpMydtjpbg8oJOqk0LS/EnFwpxNuLDn06fXm0qNkCbO1petRNBTi+u5/C2EbKtgy8TJjR7lzRoA=="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:07:29.698070 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-39501912-9753-4860-93aa-6182fb4c3076 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Getting quotas for project cb76b960181842b4aeb9ff8f75796df5. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:07:29.711478 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-39501912-9753-4860-93aa-6182fb4c3076 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Getting quotas for user 0bf9ca0c6fc34699b8a9eb711ed77347 and project cb76b960181842b4aeb9ff8f75796df5. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:07:29.815375 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-39501912-9753-4860-93aa-6182fb4c3076 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.505875 Sep 10 12:07:29.817352 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2761/5508] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 12:07:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:07:29.830238 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8976c44c-a76d-49ad-a619-7c2eba29f55e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:29.830848 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8976c44c-a76d-49ad-a619-7c2eba29f55e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:29.854273 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8976c44c-a76d-49ad-a619-7c2eba29f55e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:29.854900 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8976c44c-a76d-49ad-a619-7c2eba29f55e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:29.855793 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8976c44c-a76d-49ad-a619-7c2eba29f55e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:29.857149 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8976c44c-a76d-49ad-a619-7c2eba29f55e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:29.858133 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8976c44c-a76d-49ad-a619-7c2eba29f55e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:29.858832 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8976c44c-a76d-49ad-a619-7c2eba29f55e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:31.552026 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8976c44c-a76d-49ad-a619-7c2eba29f55e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:31.581729 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8976c44c-a76d-49ad-a619-7c2eba29f55e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64" status: 200 len: 1509 microversion: 2.1 time: 1.757462 Sep 10 12:07:31.595187 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2748/5509] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:29 2022] GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 => generated 1509 bytes in 1759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:32.611672 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-12511dce-d293-447b-a900-71e550f0b332 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:32.617824 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-12511dce-d293-447b-a900-71e550f0b332 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:32.660391 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-12511dce-d293-447b-a900-71e550f0b332 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:32.669168 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-12511dce-d293-447b-a900-71e550f0b332 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:32.675872 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-12511dce-d293-447b-a900-71e550f0b332 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:32.685163 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-12511dce-d293-447b-a900-71e550f0b332 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:32.686133 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-12511dce-d293-447b-a900-71e550f0b332 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:32.686819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-12511dce-d293-447b-a900-71e550f0b332 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:33.089333 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-12511dce-d293-447b-a900-71e550f0b332 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:33.104959 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-12511dce-d293-447b-a900-71e550f0b332 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64" status: 200 len: 1509 microversion: 2.1 time: 0.498317 Sep 10 12:07:33.145414 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2762/5510] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:32 2022] GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 => generated 1509 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:34.137284 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8ee7a568-8209-4d3f-97d1-2652723fe3f0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:34.138015 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8ee7a568-8209-4d3f-97d1-2652723fe3f0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:34.152225 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8ee7a568-8209-4d3f-97d1-2652723fe3f0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:34.153167 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8ee7a568-8209-4d3f-97d1-2652723fe3f0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:34.163110 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8ee7a568-8209-4d3f-97d1-2652723fe3f0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:34.177766 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8ee7a568-8209-4d3f-97d1-2652723fe3f0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:34.180449 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8ee7a568-8209-4d3f-97d1-2652723fe3f0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:34.186964 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8ee7a568-8209-4d3f-97d1-2652723fe3f0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:34.452723 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5e8cc02e-cacb-4ddb-94a7-1243dc26905b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-291677201", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0107e8a7-6fe9-4577-ae40-71d2188e1194"}], "security_groups": [{"name": "tempest-securitygroup--1101650987"}], "key_name": "tempest-keypair-374776183", "user_data": "}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:07:34.587709 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8ee7a568-8209-4d3f-97d1-2652723fe3f0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:34.605085 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8ee7a568-8209-4d3f-97d1-2652723fe3f0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64" status: 200 len: 1509 microversion: 2.1 time: 0.473074 Sep 10 12:07:34.608662 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2749/5511] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:34 2022] GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 => generated 1509 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:35.642588 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0f708de3-3b5d-4385-9dee-3969f1cf7de1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:35.644437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0f708de3-3b5d-4385-9dee-3969f1cf7de1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:35.679503 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0f708de3-3b5d-4385-9dee-3969f1cf7de1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:35.680826 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0f708de3-3b5d-4385-9dee-3969f1cf7de1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:35.682711 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0f708de3-3b5d-4385-9dee-3969f1cf7de1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:35.686077 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0f708de3-3b5d-4385-9dee-3969f1cf7de1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:35.689878 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0f708de3-3b5d-4385-9dee-3969f1cf7de1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:35.695948 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0f708de3-3b5d-4385-9dee-3969f1cf7de1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:36.153523 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0f708de3-3b5d-4385-9dee-3969f1cf7de1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:36.164591 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0f708de3-3b5d-4385-9dee-3969f1cf7de1 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64" status: 200 len: 1509 microversion: 2.1 time: 0.536920 Sep 10 12:07:36.168387 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2750/5512] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:35 2022] GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 => generated 1509 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:37.201706 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e290df67-dc69-46bd-8855-33ff21567b97 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:37.203509 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e290df67-dc69-46bd-8855-33ff21567b97 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:37.213058 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e290df67-dc69-46bd-8855-33ff21567b97 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:37.213804 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e290df67-dc69-46bd-8855-33ff21567b97 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:37.214419 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e290df67-dc69-46bd-8855-33ff21567b97 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:37.215376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e290df67-dc69-46bd-8855-33ff21567b97 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:37.215991 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e290df67-dc69-46bd-8855-33ff21567b97 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:37.216572 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e290df67-dc69-46bd-8855-33ff21567b97 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:37.733483 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e290df67-dc69-46bd-8855-33ff21567b97 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:37.744327 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:07:37.750828 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e290df67-dc69-46bd-8855-33ff21567b97 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64" status: 200 len: 1509 microversion: 2.1 time: 0.559344 Sep 10 12:07:37.763947 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2751/5513] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:37 2022] GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 => generated 1509 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:07:38.794735 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3662e908-4530-4ac7-8394-ebe1c3289909 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:38.796268 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3662e908-4530-4ac7-8394-ebe1c3289909 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:38.819872 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3662e908-4530-4ac7-8394-ebe1c3289909 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:38.822773 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3662e908-4530-4ac7-8394-ebe1c3289909 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:38.824046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3662e908-4530-4ac7-8394-ebe1c3289909 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:38.828152 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3662e908-4530-4ac7-8394-ebe1c3289909 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:38.828923 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3662e908-4530-4ac7-8394-ebe1c3289909 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:38.829577 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3662e908-4530-4ac7-8394-ebe1c3289909 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:39.320260 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3662e908-4530-4ac7-8394-ebe1c3289909 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:39.337800 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3662e908-4530-4ac7-8394-ebe1c3289909 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64" status: 200 len: 1509 microversion: 2.1 time: 0.547459 Sep 10 12:07:39.338908 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2752/5514] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:38 2022] GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 => generated 1509 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:07:39.746897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=4 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:07:40.366584 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e6f8958f-3d83-4eef-8336-b1bcb5b46dbd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:40.367487 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e6f8958f-3d83-4eef-8336-b1bcb5b46dbd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:40.382693 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e6f8958f-3d83-4eef-8336-b1bcb5b46dbd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:40.385443 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e6f8958f-3d83-4eef-8336-b1bcb5b46dbd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:40.386018 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e6f8958f-3d83-4eef-8336-b1bcb5b46dbd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:40.387943 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e6f8958f-3d83-4eef-8336-b1bcb5b46dbd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:40.390510 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e6f8958f-3d83-4eef-8336-b1bcb5b46dbd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:40.393028 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e6f8958f-3d83-4eef-8336-b1bcb5b46dbd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:40.786602 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e6f8958f-3d83-4eef-8336-b1bcb5b46dbd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:40.799011 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e6f8958f-3d83-4eef-8336-b1bcb5b46dbd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64" status: 200 len: 1509 microversion: 2.1 time: 0.433271 Sep 10 12:07:40.801102 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2753/5515] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:40 2022] GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 => generated 1509 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:41.826928 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4b8d2361-5c0e-441e-8318-f147aac91252 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:41.828371 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4b8d2361-5c0e-441e-8318-f147aac91252 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:41.842549 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b8d2361-5c0e-441e-8318-f147aac91252 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:41.843350 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b8d2361-5c0e-441e-8318-f147aac91252 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:41.843964 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b8d2361-5c0e-441e-8318-f147aac91252 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:41.844850 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b8d2361-5c0e-441e-8318-f147aac91252 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:41.847877 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b8d2361-5c0e-441e-8318-f147aac91252 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:41.848697 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b8d2361-5c0e-441e-8318-f147aac91252 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:42.269851 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4b8d2361-5c0e-441e-8318-f147aac91252 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:42.282843 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4b8d2361-5c0e-441e-8318-f147aac91252 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64" status: 200 len: 1509 microversion: 2.1 time: 0.459799 Sep 10 12:07:42.287191 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2754/5516] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:41 2022] GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 => generated 1509 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:43.093975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:07:43.309879 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-85c94461-122e-4f80-b9d1-757fbf0e68c3 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:43.310440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-85c94461-122e-4f80-b9d1-757fbf0e68c3 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:43.320687 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-85c94461-122e-4f80-b9d1-757fbf0e68c3 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:43.321724 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-85c94461-122e-4f80-b9d1-757fbf0e68c3 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:43.322415 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-85c94461-122e-4f80-b9d1-757fbf0e68c3 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:43.323453 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-85c94461-122e-4f80-b9d1-757fbf0e68c3 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:43.324080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-85c94461-122e-4f80-b9d1-757fbf0e68c3 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:43.324944 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-85c94461-122e-4f80-b9d1-757fbf0e68c3 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:43.649091 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-85c94461-122e-4f80-b9d1-757fbf0e68c3 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:43.660256 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-85c94461-122e-4f80-b9d1-757fbf0e68c3 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64" status: 200 len: 1509 microversion: 2.1 time: 0.354144 Sep 10 12:07:43.663712 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2755/5517] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:43 2022] GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 => generated 1509 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:44.487922 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:07:44.686141 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0e272a6f-073c-4bc8-a285-71c7feb20eeb tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:44.687078 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0e272a6f-073c-4bc8-a285-71c7feb20eeb tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:44.708083 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e272a6f-073c-4bc8-a285-71c7feb20eeb tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:44.709050 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e272a6f-073c-4bc8-a285-71c7feb20eeb tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:44.710034 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e272a6f-073c-4bc8-a285-71c7feb20eeb tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:44.712344 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e272a6f-073c-4bc8-a285-71c7feb20eeb tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:44.712344 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e272a6f-073c-4bc8-a285-71c7feb20eeb tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:44.712564 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e272a6f-073c-4bc8-a285-71c7feb20eeb tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:44.928758 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0e272a6f-073c-4bc8-a285-71c7feb20eeb tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:44.940486 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0e272a6f-073c-4bc8-a285-71c7feb20eeb tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64" status: 200 len: 1509 microversion: 2.1 time: 0.259608 Sep 10 12:07:44.941101 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2756/5518] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:44 2022] GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 => generated 1509 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:45.217033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-5e8cc02e-cacb-4ddb-94a7-1243dc26905b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] validate_networks() for [('0107e8a7-6fe9-4577-ae40-71d2188e1194', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:07:45.877040 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-5e8cc02e-cacb-4ddb-94a7-1243dc26905b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:07:45.881509 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-5e8cc02e-cacb-4ddb-94a7-1243dc26905b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:07:45.882249 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-5e8cc02e-cacb-4ddb-94a7-1243dc26905b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:07:45.882886 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-5e8cc02e-cacb-4ddb-94a7-1243dc26905b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:07:45.883626 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-5e8cc02e-cacb-4ddb-94a7-1243dc26905b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:07:45.897844 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5e8cc02e-cacb-4ddb-94a7-1243dc26905b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:45.898669 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5e8cc02e-cacb-4ddb-94a7-1243dc26905b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:45.899335 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5e8cc02e-cacb-4ddb-94a7-1243dc26905b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:45.900422 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5e8cc02e-cacb-4ddb-94a7-1243dc26905b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:45.901061 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5e8cc02e-cacb-4ddb-94a7-1243dc26905b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:45.901775 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5e8cc02e-cacb-4ddb-94a7-1243dc26905b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:45.926386 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-5e8cc02e-cacb-4ddb-94a7-1243dc26905b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Getting quotas for project cb76b960181842b4aeb9ff8f75796df5. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:07:45.934150 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-5e8cc02e-cacb-4ddb-94a7-1243dc26905b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Getting quotas for user 0bf9ca0c6fc34699b8a9eb711ed77347 and project cb76b960181842b4aeb9ff8f75796df5. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:07:45.951403 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5e8cc02e-cacb-4ddb-94a7-1243dc26905b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:07:45.953839 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5e8cc02e-cacb-4ddb-94a7-1243dc26905b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:07:45.966356 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6a6eac39-b052-4390-9174-bac4f0c56bb9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:45.967004 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6a6eac39-b052-4390-9174-bac4f0c56bb9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:45.992502 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6a6eac39-b052-4390-9174-bac4f0c56bb9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:45.993068 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6a6eac39-b052-4390-9174-bac4f0c56bb9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:45.995708 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6a6eac39-b052-4390-9174-bac4f0c56bb9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:45.997607 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6a6eac39-b052-4390-9174-bac4f0c56bb9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:45.999112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6a6eac39-b052-4390-9174-bac4f0c56bb9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:46.002154 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6a6eac39-b052-4390-9174-bac4f0c56bb9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:46.111499 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5e8cc02e-cacb-4ddb-94a7-1243dc26905b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 11.662249 Sep 10 12:07:46.122931 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2763/5519] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:07:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 11675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:07:46.127908 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4e1e6443-d3e8-45b6-b786-5c7172a1576c tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:46.128522 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4e1e6443-d3e8-45b6-b786-5c7172a1576c tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:46.263077 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4e1e6443-d3e8-45b6-b786-5c7172a1576c tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:46.276936 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4e1e6443-d3e8-45b6-b786-5c7172a1576c tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1236 microversion: 2.1 time: 0.152757 Sep 10 12:07:46.287957 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2764/5520] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:46 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1236 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:46.355930 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6a6eac39-b052-4390-9174-bac4f0c56bb9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:46.376305 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6a6eac39-b052-4390-9174-bac4f0c56bb9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64" status: 200 len: 1509 microversion: 2.1 time: 0.413327 Sep 10 12:07:46.377167 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2757/5521] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:45 2022] GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 => generated 1509 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:07:47.317118 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-277fe37e-9fe0-4611-abf5-ee1254d2d9dd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:47.319698 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-277fe37e-9fe0-4611-abf5-ee1254d2d9dd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:47.345302 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-277fe37e-9fe0-4611-abf5-ee1254d2d9dd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:47.358225 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-277fe37e-9fe0-4611-abf5-ee1254d2d9dd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:47.363266 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-277fe37e-9fe0-4611-abf5-ee1254d2d9dd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:47.364838 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-277fe37e-9fe0-4611-abf5-ee1254d2d9dd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:47.371228 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-277fe37e-9fe0-4611-abf5-ee1254d2d9dd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:47.372610 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-277fe37e-9fe0-4611-abf5-ee1254d2d9dd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:47.400664 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9dead968-81fe-4938-8f6f-0b526dfe9809 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:47.401603 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9dead968-81fe-4938-8f6f-0b526dfe9809 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:47.412754 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9dead968-81fe-4938-8f6f-0b526dfe9809 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:47.413510 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9dead968-81fe-4938-8f6f-0b526dfe9809 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:47.413960 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9dead968-81fe-4938-8f6f-0b526dfe9809 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:47.414978 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9dead968-81fe-4938-8f6f-0b526dfe9809 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:47.415625 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9dead968-81fe-4938-8f6f-0b526dfe9809 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:47.416210 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9dead968-81fe-4938-8f6f-0b526dfe9809 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:47.476415 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-277fe37e-9fe0-4611-abf5-ee1254d2d9dd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:47.488521 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-277fe37e-9fe0-4611-abf5-ee1254d2d9dd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1232 microversion: 2.1 time: 0.185486 Sep 10 12:07:47.489486 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2765/5522] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:47 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1232 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:47.745185 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9dead968-81fe-4938-8f6f-0b526dfe9809 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:47.754327 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9dead968-81fe-4938-8f6f-0b526dfe9809 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64" status: 200 len: 1506 microversion: 2.1 time: 0.357403 Sep 10 12:07:47.758618 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2758/5523] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:47 2022] GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 => generated 1506 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:48.520080 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b0cf96ed-7d0a-448d-b0b9-1e5373dc6782 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:48.522074 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b0cf96ed-7d0a-448d-b0b9-1e5373dc6782 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:48.530149 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b0cf96ed-7d0a-448d-b0b9-1e5373dc6782 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:48.530651 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b0cf96ed-7d0a-448d-b0b9-1e5373dc6782 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:48.531094 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b0cf96ed-7d0a-448d-b0b9-1e5373dc6782 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:48.532182 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b0cf96ed-7d0a-448d-b0b9-1e5373dc6782 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:48.532807 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b0cf96ed-7d0a-448d-b0b9-1e5373dc6782 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:48.533401 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b0cf96ed-7d0a-448d-b0b9-1e5373dc6782 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:48.659030 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b0cf96ed-7d0a-448d-b0b9-1e5373dc6782 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:48.668184 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b0cf96ed-7d0a-448d-b0b9-1e5373dc6782 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1294 microversion: 2.1 time: 0.153988 Sep 10 12:07:48.669170 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2766/5524] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:48 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1294 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:48.785694 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-255efa41-58a8-4181-92ca-2ca924028300 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:48.787203 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-255efa41-58a8-4181-92ca-2ca924028300 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:48.791432 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=36 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:07:48.805198 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-255efa41-58a8-4181-92ca-2ca924028300 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:48.805696 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-255efa41-58a8-4181-92ca-2ca924028300 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:48.806130 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-255efa41-58a8-4181-92ca-2ca924028300 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:48.810752 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-255efa41-58a8-4181-92ca-2ca924028300 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:48.813063 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-255efa41-58a8-4181-92ca-2ca924028300 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:48.813797 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-255efa41-58a8-4181-92ca-2ca924028300 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:49.308931 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-255efa41-58a8-4181-92ca-2ca924028300 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:49.347730 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-255efa41-58a8-4181-92ca-2ca924028300 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64" status: 200 len: 1506 microversion: 2.1 time: 0.565591 Sep 10 12:07:49.362128 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2759/5525] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:48 2022] GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 => generated 1506 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:49.695371 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9233e96a-0928-41f0-b669-a6f7d3b2f594 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:49.697724 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9233e96a-0928-41f0-b669-a6f7d3b2f594 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:49.715434 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9233e96a-0928-41f0-b669-a6f7d3b2f594 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:49.721634 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9233e96a-0928-41f0-b669-a6f7d3b2f594 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:49.722713 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9233e96a-0928-41f0-b669-a6f7d3b2f594 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:49.724969 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9233e96a-0928-41f0-b669-a6f7d3b2f594 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:49.726864 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9233e96a-0928-41f0-b669-a6f7d3b2f594 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:49.734599 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9233e96a-0928-41f0-b669-a6f7d3b2f594 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:50.348284 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-eb707ede-eec6-45d7-a8c5-0e2400630d8e req-0277ec14-d9b0-4d5f-9d8a-544abc8fac66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55d5cbf7-6438-4f5b-96b3-719e9f3f7a64", "name": "network-vif-unplugged", "status": "completed", "tag": "c6eb0ad3-74e3-40f5-a84c-64f4d0d21125"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:07:50.374634 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-eb707ede-eec6-45d7-a8c5-0e2400630d8e req-0277ec14-d9b0-4d5f-9d8a-544abc8fac66 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:50.376967 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-eb707ede-eec6-45d7-a8c5-0e2400630d8e req-0277ec14-d9b0-4d5f-9d8a-544abc8fac66 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:50.379234 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-eb707ede-eec6-45d7-a8c5-0e2400630d8e req-0277ec14-d9b0-4d5f-9d8a-544abc8fac66 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:50.410487 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.compute.server_external_events [req-eb707ede-eec6-45d7-a8c5-0e2400630d8e req-0277ec14-d9b0-4d5f-9d8a-544abc8fac66 service nova] Unable to find a host for instance 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64. Dropping event network-vif-unplugged {{(pid=128777) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 10 12:07:50.412692 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-eb707ede-eec6-45d7-a8c5-0e2400630d8e req-0277ec14-d9b0-4d5f-9d8a-544abc8fac66 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.069799 Sep 10 12:07:50.418244 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2760/5526] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 76 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 10 12:07:50.434856 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0be9cae8-1679-490d-b20e-dcacfc5e8eea tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:50.436929 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0be9cae8-1679-490d-b20e-dcacfc5e8eea tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:50.459443 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0be9cae8-1679-490d-b20e-dcacfc5e8eea tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:50.461124 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0be9cae8-1679-490d-b20e-dcacfc5e8eea tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:50.463241 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0be9cae8-1679-490d-b20e-dcacfc5e8eea tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:50.465416 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0be9cae8-1679-490d-b20e-dcacfc5e8eea tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:50.466167 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0be9cae8-1679-490d-b20e-dcacfc5e8eea tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:50.468448 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0be9cae8-1679-490d-b20e-dcacfc5e8eea tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:50.544530 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9233e96a-0928-41f0-b669-a6f7d3b2f594 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:50.563969 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9233e96a-0928-41f0-b669-a6f7d3b2f594 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1362 microversion: 2.1 time: 0.872525 Sep 10 12:07:50.565529 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2767/5527] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:49 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1362 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:50.813754 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0be9cae8-1679-490d-b20e-dcacfc5e8eea tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:50.824795 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0be9cae8-1679-490d-b20e-dcacfc5e8eea tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64" status: 200 len: 1449 microversion: 2.1 time: 0.404381 Sep 10 12:07:50.832740 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2761/5528] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:50 2022] GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 => generated 1449 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:50.854227 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e77b5784-6a41-4c9b-bde7-7b8726f14024 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:50.855962 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e77b5784-6a41-4c9b-bde7-7b8726f14024 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:50.863734 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e77b5784-6a41-4c9b-bde7-7b8726f14024 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:50.865120 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e77b5784-6a41-4c9b-bde7-7b8726f14024 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:50.866002 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e77b5784-6a41-4c9b-bde7-7b8726f14024 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:50.867345 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e77b5784-6a41-4c9b-bde7-7b8726f14024 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:50.868073 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e77b5784-6a41-4c9b-bde7-7b8726f14024 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:50.868720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e77b5784-6a41-4c9b-bde7-7b8726f14024 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:51.380425 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e77b5784-6a41-4c9b-bde7-7b8726f14024 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:51.392483 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e77b5784-6a41-4c9b-bde7-7b8726f14024 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.542169 Sep 10 12:07:51.405787 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2768/5529] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:50 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:51.458614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e0ca5e1e-c059-44fd-991d-edb59f52d134 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:51.459424 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e0ca5e1e-c059-44fd-991d-edb59f52d134 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:51.471039 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0ca5e1e-c059-44fd-991d-edb59f52d134 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:51.471867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0ca5e1e-c059-44fd-991d-edb59f52d134 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:51.473355 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0ca5e1e-c059-44fd-991d-edb59f52d134 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:51.478875 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0ca5e1e-c059-44fd-991d-edb59f52d134 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:51.481238 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0ca5e1e-c059-44fd-991d-edb59f52d134 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:51.483027 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0ca5e1e-c059-44fd-991d-edb59f52d134 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:51.588009 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-72c6710c-541a-481c-9ab0-bdd126fd3819 req-f96b8533-02f9-4ba7-953d-434f9560ebaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20f0d900-aeea-4f7c-9b92-bf9363ba21c9", "tag": "48fef716-4256-4d09-b758-89e39be42dfb"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:07:51.619135 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-72c6710c-541a-481c-9ab0-bdd126fd3819 req-f96b8533-02f9-4ba7-953d-434f9560ebaa service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:51.620119 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-72c6710c-541a-481c-9ab0-bdd126fd3819 req-f96b8533-02f9-4ba7-953d-434f9560ebaa service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:51.620751 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-72c6710c-541a-481c-9ab0-bdd126fd3819 req-f96b8533-02f9-4ba7-953d-434f9560ebaa service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:51.640257 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-72c6710c-541a-481c-9ab0-bdd126fd3819 req-f96b8533-02f9-4ba7-953d-434f9560ebaa service nova] Creating event network-changed:48fef716-4256-4d09-b758-89e39be42dfb for instance 20f0d900-aeea-4f7c-9b92-bf9363ba21c9 on n-h1-856895-1 Sep 10 12:07:51.647737 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-72c6710c-541a-481c-9ab0-bdd126fd3819 req-f96b8533-02f9-4ba7-953d-434f9560ebaa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070355 Sep 10 12:07:51.649138 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2769/5530] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:07:51.656037 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3736cb9c-72ca-4de0-aa3a-4696f70c16f7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:51.657006 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3736cb9c-72ca-4de0-aa3a-4696f70c16f7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:51.667612 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3736cb9c-72ca-4de0-aa3a-4696f70c16f7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:51.668379 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3736cb9c-72ca-4de0-aa3a-4696f70c16f7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:51.669013 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3736cb9c-72ca-4de0-aa3a-4696f70c16f7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:51.670002 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3736cb9c-72ca-4de0-aa3a-4696f70c16f7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:51.670645 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3736cb9c-72ca-4de0-aa3a-4696f70c16f7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:51.671280 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3736cb9c-72ca-4de0-aa3a-4696f70c16f7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:51.955338 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e0ca5e1e-c059-44fd-991d-edb59f52d134 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:51.970567 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e0ca5e1e-c059-44fd-991d-edb59f52d134 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.518003 Sep 10 12:07:51.974843 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2762/5531] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:51 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:52.007557 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2fd8bf70-3028-4611-93b8-4251aba0525e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:52.008854 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2fd8bf70-3028-4611-93b8-4251aba0525e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:52.022522 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fd8bf70-3028-4611-93b8-4251aba0525e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:52.024445 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fd8bf70-3028-4611-93b8-4251aba0525e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:52.025547 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fd8bf70-3028-4611-93b8-4251aba0525e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:52.027742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fd8bf70-3028-4611-93b8-4251aba0525e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:52.031628 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fd8bf70-3028-4611-93b8-4251aba0525e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:52.032520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fd8bf70-3028-4611-93b8-4251aba0525e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:52.332959 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3736cb9c-72ca-4de0-aa3a-4696f70c16f7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:52.342822 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3736cb9c-72ca-4de0-aa3a-4696f70c16f7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1362 microversion: 2.1 time: 0.692207 Sep 10 12:07:52.353247 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2770/5532] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:51 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1362 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:52.463259 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2fd8bf70-3028-4611-93b8-4251aba0525e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:52.480468 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2fd8bf70-3028-4611-93b8-4251aba0525e tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.478367 Sep 10 12:07:52.485187 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2763/5533] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:52 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:52.514801 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0f8d0d34-d045-4924-b869-f9b581f4f15c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:52.515583 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0f8d0d34-d045-4924-b869-f9b581f4f15c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:52.526737 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f8d0d34-d045-4924-b869-f9b581f4f15c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:52.528356 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f8d0d34-d045-4924-b869-f9b581f4f15c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:52.528976 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f8d0d34-d045-4924-b869-f9b581f4f15c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:52.531408 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f8d0d34-d045-4924-b869-f9b581f4f15c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:52.532825 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f8d0d34-d045-4924-b869-f9b581f4f15c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:52.533336 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f8d0d34-d045-4924-b869-f9b581f4f15c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:52.854098 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0f8d0d34-d045-4924-b869-f9b581f4f15c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:52.867519 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0f8d0d34-d045-4924-b869-f9b581f4f15c tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.357036 Sep 10 12:07:52.869165 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2771/5534] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:52 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:52.893302 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-83a7ba79-7907-4e8f-b5c7-49bac0c2cf58 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:07:52.901148 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-83a7ba79-7907-4e8f-b5c7-49bac0c2cf58 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:52.902084 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-83a7ba79-7907-4e8f-b5c7-49bac0c2cf58 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:52.902632 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-83a7ba79-7907-4e8f-b5c7-49bac0c2cf58 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:52.933818 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-83a7ba79-7907-4e8f-b5c7-49bac0c2cf58 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Going to try to stop instance {{(pid=128777) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 10 12:07:52.993893 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-83a7ba79-7907-4e8f-b5c7-49bac0c2cf58 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "POST /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f/action" status: 202 len: 0 microversion: 2.1 time: 0.104133 Sep 10 12:07:52.994749 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2764/5535] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:07:52 2022] POST /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:07:53.003465 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a8522c9d-3557-402d-a29d-774e893962d3 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:53.004314 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a8522c9d-3557-402d-a29d-774e893962d3 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:53.012169 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8522c9d-3557-402d-a29d-774e893962d3 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:53.012906 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8522c9d-3557-402d-a29d-774e893962d3 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:53.013702 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8522c9d-3557-402d-a29d-774e893962d3 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:53.014568 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8522c9d-3557-402d-a29d-774e893962d3 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:53.015193 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8522c9d-3557-402d-a29d-774e893962d3 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:53.015764 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8522c9d-3557-402d-a29d-774e893962d3 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:53.101751 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ad8737f0-f47c-47da-af73-040e934d73c5 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:53.103518 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ad8737f0-f47c-47da-af73-040e934d73c5 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: f4da91bc-acbf-487b-b305-a619df7ad3f8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:53.111565 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ad8737f0-f47c-47da-af73-040e934d73c5 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:53.112309 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ad8737f0-f47c-47da-af73-040e934d73c5 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:53.112916 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ad8737f0-f47c-47da-af73-040e934d73c5 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:53.113789 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ad8737f0-f47c-47da-af73-040e934d73c5 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:53.114475 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ad8737f0-f47c-47da-af73-040e934d73c5 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:53.115286 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ad8737f0-f47c-47da-af73-040e934d73c5 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:53.151533 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ad8737f0-f47c-47da-af73-040e934d73c5 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8/ips" status: 200 len: 151 microversion: 2.1 time: 0.056927 Sep 10 12:07:53.157207 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2765/5536] 10.222.0.23 () {58 vars in 1248 bytes} [Sat Sep 10 12:07:53 2022] GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8/ips => generated 151 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:07:53.267396 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a8522c9d-3557-402d-a29d-774e893962d3 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:53.279926 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a8522c9d-3557-402d-a29d-774e893962d3 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1682 microversion: 2.1 time: 0.280185 Sep 10 12:07:53.283252 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2772/5537] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:52 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1682 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:53.378505 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-757aa4d9-04e8-4569-ac1b-c608d858d86e tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:53.379127 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-757aa4d9-04e8-4569-ac1b-c608d858d86e tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:53.386605 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-757aa4d9-04e8-4569-ac1b-c608d858d86e tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:53.388627 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-757aa4d9-04e8-4569-ac1b-c608d858d86e tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:53.394244 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-757aa4d9-04e8-4569-ac1b-c608d858d86e tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:53.395260 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-757aa4d9-04e8-4569-ac1b-c608d858d86e tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:53.395929 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-757aa4d9-04e8-4569-ac1b-c608d858d86e tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:53.396645 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-757aa4d9-04e8-4569-ac1b-c608d858d86e tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:53.750596 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-757aa4d9-04e8-4569-ac1b-c608d858d86e tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:53.764334 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-757aa4d9-04e8-4569-ac1b-c608d858d86e tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1362 microversion: 2.1 time: 0.389606 Sep 10 12:07:53.775272 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2766/5538] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:53 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1362 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:54.306950 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-120d9334-8f7b-413d-b0bf-b6e9cc02aa39 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:54.309413 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-120d9334-8f7b-413d-b0bf-b6e9cc02aa39 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:54.329319 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-120d9334-8f7b-413d-b0bf-b6e9cc02aa39 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:54.330060 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-120d9334-8f7b-413d-b0bf-b6e9cc02aa39 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:54.333886 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-120d9334-8f7b-413d-b0bf-b6e9cc02aa39 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:54.335505 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-120d9334-8f7b-413d-b0bf-b6e9cc02aa39 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:54.337129 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-120d9334-8f7b-413d-b0bf-b6e9cc02aa39 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:54.337752 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-120d9334-8f7b-413d-b0bf-b6e9cc02aa39 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:54.807506 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c621a822-9e97-4c9e-ba97-d5d0929b0931 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:54.808875 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c621a822-9e97-4c9e-ba97-d5d0929b0931 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:54.823705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c621a822-9e97-4c9e-ba97-d5d0929b0931 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:54.824792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c621a822-9e97-4c9e-ba97-d5d0929b0931 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:54.825432 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c621a822-9e97-4c9e-ba97-d5d0929b0931 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:54.826349 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c621a822-9e97-4c9e-ba97-d5d0929b0931 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:54.827017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c621a822-9e97-4c9e-ba97-d5d0929b0931 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:54.827821 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c621a822-9e97-4c9e-ba97-d5d0929b0931 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:55.739085 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-120d9334-8f7b-413d-b0bf-b6e9cc02aa39 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:55.747129 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-120d9334-8f7b-413d-b0bf-b6e9cc02aa39 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1682 microversion: 2.1 time: 1.444942 Sep 10 12:07:55.755707 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2773/5539] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:54 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1682 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:55.813031 n-d-856895-1 devstack@n-api.service[128777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 12:07:55.813518 n-d-856895-1 devstack@n-api.service[128777]: Sat Sep 10 12:07:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 (ip 10.222.0.23) !!! Sep 10 12:07:55.980977 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c621a822-9e97-4c9e-ba97-d5d0929b0931 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:55.997276 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c621a822-9e97-4c9e-ba97-d5d0929b0931 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1362 microversion: 2.1 time: 1.198393 Sep 10 12:07:55.998649 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2767/5540] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:54 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1362 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:07:56.045014 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a8b01c80-1d9a-488c-a306-16d276b3985a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e930db60-b47d-45ef-bcf9-d6588d795558"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:07:56.047618 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a8b01c80-1d9a-488c-a306-16d276b3985a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: f4da91bc-acbf-487b-b305-a619df7ad3f8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:56.067688 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:07:56.075867 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8b01c80-1d9a-488c-a306-16d276b3985a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:56.076471 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8b01c80-1d9a-488c-a306-16d276b3985a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:56.076924 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8b01c80-1d9a-488c-a306-16d276b3985a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:56.085585 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8b01c80-1d9a-488c-a306-16d276b3985a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:56.085971 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8b01c80-1d9a-488c-a306-16d276b3985a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:56.086433 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8b01c80-1d9a-488c-a306-16d276b3985a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:56.286302 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=8 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:07:56.651835 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a8b01c80-1d9a-488c-a306-16d276b3985a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "POST /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.612165 Sep 10 12:07:56.652904 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2774/5541] 10.222.0.23 () {60 vars in 1323 bytes} [Sat Sep 10 12:07:56 2022] POST /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8/os-volume_attachments => generated 194 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:07:56.771079 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-489b99b9-d468-4f46-a9ce-e1bef5982c89 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:56.771860 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-489b99b9-d468-4f46-a9ce-e1bef5982c89 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:56.787539 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-489b99b9-d468-4f46-a9ce-e1bef5982c89 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:56.800452 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-489b99b9-d468-4f46-a9ce-e1bef5982c89 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:56.801058 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-489b99b9-d468-4f46-a9ce-e1bef5982c89 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:56.803991 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-489b99b9-d468-4f46-a9ce-e1bef5982c89 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:56.804508 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-489b99b9-d468-4f46-a9ce-e1bef5982c89 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:56.804975 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-489b99b9-d468-4f46-a9ce-e1bef5982c89 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:56.872137 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:07:57.025064 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6fda5c6f-ced4-4dc1-8205-250602a56c9d tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:57.026677 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6fda5c6f-ced4-4dc1-8205-250602a56c9d tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:57.053976 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6fda5c6f-ced4-4dc1-8205-250602a56c9d tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:57.059849 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6fda5c6f-ced4-4dc1-8205-250602a56c9d tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:57.060751 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6fda5c6f-ced4-4dc1-8205-250602a56c9d tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:57.064132 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6fda5c6f-ced4-4dc1-8205-250602a56c9d tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:57.069361 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6fda5c6f-ced4-4dc1-8205-250602a56c9d tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:57.070164 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6fda5c6f-ced4-4dc1-8205-250602a56c9d tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:57.183869 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-489b99b9-d468-4f46-a9ce-e1bef5982c89 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:57.192678 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-489b99b9-d468-4f46-a9ce-e1bef5982c89 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1682 microversion: 2.1 time: 0.425886 Sep 10 12:07:57.199970 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2768/5542] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:56 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1682 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:57.325751 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6fda5c6f-ced4-4dc1-8205-250602a56c9d tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:57.339620 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6fda5c6f-ced4-4dc1-8205-250602a56c9d tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1362 microversion: 2.1 time: 0.318822 Sep 10 12:07:57.340805 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2775/5543] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:57 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1362 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:58.223035 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-65c19b91-ba3e-443a-a4b1-81b9233fe4aa tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:58.224517 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-65c19b91-ba3e-443a-a4b1-81b9233fe4aa tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:58.233475 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-65c19b91-ba3e-443a-a4b1-81b9233fe4aa tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:58.233976 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-65c19b91-ba3e-443a-a4b1-81b9233fe4aa tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:58.234430 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-65c19b91-ba3e-443a-a4b1-81b9233fe4aa tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:58.235144 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-65c19b91-ba3e-443a-a4b1-81b9233fe4aa tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:58.235632 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-65c19b91-ba3e-443a-a4b1-81b9233fe4aa tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:58.236068 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-65c19b91-ba3e-443a-a4b1-81b9233fe4aa tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:58.365948 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0ac868ac-d426-46ec-b89e-7672c1890c99 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:58.367303 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0ac868ac-d426-46ec-b89e-7672c1890c99 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:58.381364 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ac868ac-d426-46ec-b89e-7672c1890c99 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:58.383877 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ac868ac-d426-46ec-b89e-7672c1890c99 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:58.384896 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ac868ac-d426-46ec-b89e-7672c1890c99 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:58.386753 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ac868ac-d426-46ec-b89e-7672c1890c99 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:58.388716 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ac868ac-d426-46ec-b89e-7672c1890c99 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:58.389464 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ac868ac-d426-46ec-b89e-7672c1890c99 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:58.528038 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-65c19b91-ba3e-443a-a4b1-81b9233fe4aa tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:58.537878 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-65c19b91-ba3e-443a-a4b1-81b9233fe4aa tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1682 microversion: 2.1 time: 0.318778 Sep 10 12:07:58.542219 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2769/5544] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:58 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1682 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:59.178632 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0ac868ac-d426-46ec-b89e-7672c1890c99 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:59.189823 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0ac868ac-d426-46ec-b89e-7672c1890c99 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1362 microversion: 2.1 time: 0.829186 Sep 10 12:07:59.191904 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2776/5545] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:58 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1362 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:07:59.571319 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b9c6eed7-d26e-431a-bb33-abb57d359f8b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:07:59.572150 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b9c6eed7-d26e-431a-bb33-abb57d359f8b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:07:59.579818 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9c6eed7-d26e-431a-bb33-abb57d359f8b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:59.580489 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9c6eed7-d26e-431a-bb33-abb57d359f8b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:59.581178 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9c6eed7-d26e-431a-bb33-abb57d359f8b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:59.582079 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9c6eed7-d26e-431a-bb33-abb57d359f8b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:07:59.582549 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9c6eed7-d26e-431a-bb33-abb57d359f8b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:07:59.583194 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9c6eed7-d26e-431a-bb33-abb57d359f8b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:07:59.853286 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b9c6eed7-d26e-431a-bb33-abb57d359f8b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:07:59.870641 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b9c6eed7-d26e-431a-bb33-abb57d359f8b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1682 microversion: 2.1 time: 0.303679 Sep 10 12:07:59.884590 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2770/5546] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:07:59 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1682 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:08:00.220169 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8021ece0-cc11-4b71-beb9-e10a91597680 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:00.222690 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8021ece0-cc11-4b71-beb9-e10a91597680 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:00.234220 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8021ece0-cc11-4b71-beb9-e10a91597680 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:00.235509 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8021ece0-cc11-4b71-beb9-e10a91597680 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:00.236248 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8021ece0-cc11-4b71-beb9-e10a91597680 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:00.237291 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8021ece0-cc11-4b71-beb9-e10a91597680 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:00.237912 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8021ece0-cc11-4b71-beb9-e10a91597680 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:00.238577 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8021ece0-cc11-4b71-beb9-e10a91597680 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:00.498380 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8021ece0-cc11-4b71-beb9-e10a91597680 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:00.510287 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8021ece0-cc11-4b71-beb9-e10a91597680 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1362 microversion: 2.1 time: 0.299330 Sep 10 12:08:00.511136 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2777/5547] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:00 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1362 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:08:00.579111 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-ddbe8a93-3adc-40a2-92f6-9e5f9d2e1713 req-f00733d3-4fa9-43e7-af62-eb1aa36671b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20f0d900-aeea-4f7c-9b92-bf9363ba21c9", "name": "network-vif-plugged", "status": "completed", "tag": "48fef716-4256-4d09-b758-89e39be42dfb"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:08:00.601971 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-ddbe8a93-3adc-40a2-92f6-9e5f9d2e1713 req-f00733d3-4fa9-43e7-af62-eb1aa36671b9 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:00.605295 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-ddbe8a93-3adc-40a2-92f6-9e5f9d2e1713 req-f00733d3-4fa9-43e7-af62-eb1aa36671b9 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:00.608457 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-ddbe8a93-3adc-40a2-92f6-9e5f9d2e1713 req-f00733d3-4fa9-43e7-af62-eb1aa36671b9 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:00.645940 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-ddbe8a93-3adc-40a2-92f6-9e5f9d2e1713 req-f00733d3-4fa9-43e7-af62-eb1aa36671b9 service nova] Creating event network-vif-plugged:48fef716-4256-4d09-b758-89e39be42dfb for instance 20f0d900-aeea-4f7c-9b92-bf9363ba21c9 on n-h1-856895-1 Sep 10 12:08:00.656209 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-ddbe8a93-3adc-40a2-92f6-9e5f9d2e1713 req-f00733d3-4fa9-43e7-af62-eb1aa36671b9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081026 Sep 10 12:08:00.658915 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2771/5548] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:08:00.894993 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-756c0fe8-4095-414b-870a-213d3aa4cde7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:00.896406 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-756c0fe8-4095-414b-870a-213d3aa4cde7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:00.912625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-756c0fe8-4095-414b-870a-213d3aa4cde7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:00.922229 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-756c0fe8-4095-414b-870a-213d3aa4cde7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:00.923004 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-756c0fe8-4095-414b-870a-213d3aa4cde7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:00.925324 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-756c0fe8-4095-414b-870a-213d3aa4cde7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:00.928584 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-756c0fe8-4095-414b-870a-213d3aa4cde7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:00.929328 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-756c0fe8-4095-414b-870a-213d3aa4cde7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:01.209528 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-756c0fe8-4095-414b-870a-213d3aa4cde7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:01.224822 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-756c0fe8-4095-414b-870a-213d3aa4cde7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1682 microversion: 2.1 time: 0.333220 Sep 10 12:08:01.227112 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2778/5549] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:00 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1682 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:01.534933 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7b9fdc33-3a4a-47f7-a8f7-f39ce51c4577 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:01.535686 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7b9fdc33-3a4a-47f7-a8f7-f39ce51c4577 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:01.548501 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b9fdc33-3a4a-47f7-a8f7-f39ce51c4577 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:01.548999 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b9fdc33-3a4a-47f7-a8f7-f39ce51c4577 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:01.549438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b9fdc33-3a4a-47f7-a8f7-f39ce51c4577 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:01.554329 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b9fdc33-3a4a-47f7-a8f7-f39ce51c4577 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:01.554983 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b9fdc33-3a4a-47f7-a8f7-f39ce51c4577 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:01.555464 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b9fdc33-3a4a-47f7-a8f7-f39ce51c4577 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:01.979525 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7b9fdc33-3a4a-47f7-a8f7-f39ce51c4577 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:01.996721 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7b9fdc33-3a4a-47f7-a8f7-f39ce51c4577 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1362 microversion: 2.1 time: 0.466416 Sep 10 12:08:02.008519 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2772/5550] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:01 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1362 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:02.251247 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-adff655f-4bb9-4a02-b92d-fc82f45dc7a2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:02.252878 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-adff655f-4bb9-4a02-b92d-fc82f45dc7a2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:02.273595 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-adff655f-4bb9-4a02-b92d-fc82f45dc7a2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:02.276159 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-adff655f-4bb9-4a02-b92d-fc82f45dc7a2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:02.277914 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-adff655f-4bb9-4a02-b92d-fc82f45dc7a2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:02.278755 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-adff655f-4bb9-4a02-b92d-fc82f45dc7a2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:02.282115 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-adff655f-4bb9-4a02-b92d-fc82f45dc7a2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:02.282569 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-adff655f-4bb9-4a02-b92d-fc82f45dc7a2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:02.589125 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-adff655f-4bb9-4a02-b92d-fc82f45dc7a2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:02.600166 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-adff655f-4bb9-4a02-b92d-fc82f45dc7a2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1682 microversion: 2.1 time: 0.354078 Sep 10 12:08:02.601457 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2779/5551] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:02 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1682 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:03.031948 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-18b35f50-18eb-42dd-8284-9dfd9637dc2b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:03.032714 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-18b35f50-18eb-42dd-8284-9dfd9637dc2b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:03.051530 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-18b35f50-18eb-42dd-8284-9dfd9637dc2b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:03.052054 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-18b35f50-18eb-42dd-8284-9dfd9637dc2b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:03.053789 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-18b35f50-18eb-42dd-8284-9dfd9637dc2b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:03.057049 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-18b35f50-18eb-42dd-8284-9dfd9637dc2b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:03.057550 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-18b35f50-18eb-42dd-8284-9dfd9637dc2b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:03.058004 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-18b35f50-18eb-42dd-8284-9dfd9637dc2b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:03.451401 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-18b35f50-18eb-42dd-8284-9dfd9637dc2b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:03.468912 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-18b35f50-18eb-42dd-8284-9dfd9637dc2b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1548 microversion: 2.1 time: 0.441137 Sep 10 12:08:03.470489 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2773/5552] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:03 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1548 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:03.494768 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5df88701-e479-49cf-8d8d-0fa5e62e58ff tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:03.495897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5df88701-e479-49cf-8d8d-0fa5e62e58ff tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:03.515400 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5df88701-e479-49cf-8d8d-0fa5e62e58ff tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:03.516227 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5df88701-e479-49cf-8d8d-0fa5e62e58ff tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:03.517212 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5df88701-e479-49cf-8d8d-0fa5e62e58ff tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:03.518167 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5df88701-e479-49cf-8d8d-0fa5e62e58ff tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:03.518879 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5df88701-e479-49cf-8d8d-0fa5e62e58ff tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:03.519633 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5df88701-e479-49cf-8d8d-0fa5e62e58ff tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:03.550864 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:08:03.628639 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-dde85d7e-aca9-40a1-bb8e-2246c065f7c4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:03.630662 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-dde85d7e-aca9-40a1-bb8e-2246c065f7c4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:03.635777 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5df88701-e479-49cf-8d8d-0fa5e62e58ff tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.146532 Sep 10 12:08:03.636843 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2780/5553] 10.222.0.23 () {58 vars in 1275 bytes} [Sat Sep 10 12:08:03 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9/os-interface => generated 284 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:08:03.645883 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dde85d7e-aca9-40a1-bb8e-2246c065f7c4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:03.646584 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dde85d7e-aca9-40a1-bb8e-2246c065f7c4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:03.647296 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dde85d7e-aca9-40a1-bb8e-2246c065f7c4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:03.648115 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dde85d7e-aca9-40a1-bb8e-2246c065f7c4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:03.648794 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dde85d7e-aca9-40a1-bb8e-2246c065f7c4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:03.651791 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dde85d7e-aca9-40a1-bb8e-2246c065f7c4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:04.985575 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-dde85d7e-aca9-40a1-bb8e-2246c065f7c4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:05.000834 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-dde85d7e-aca9-40a1-bb8e-2246c065f7c4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1682 microversion: 2.1 time: 1.375465 Sep 10 12:08:05.003634 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2774/5554] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:03 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1682 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:08:06.029947 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b1136d86-4c05-4b1e-8486-e65ecc788df5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:06.031425 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b1136d86-4c05-4b1e-8486-e65ecc788df5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:06.047680 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b1136d86-4c05-4b1e-8486-e65ecc788df5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:06.048571 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b1136d86-4c05-4b1e-8486-e65ecc788df5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:06.050777 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b1136d86-4c05-4b1e-8486-e65ecc788df5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:06.052780 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b1136d86-4c05-4b1e-8486-e65ecc788df5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:06.053686 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b1136d86-4c05-4b1e-8486-e65ecc788df5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:06.054341 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b1136d86-4c05-4b1e-8486-e65ecc788df5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:06.342179 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b1136d86-4c05-4b1e-8486-e65ecc788df5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:06.357414 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b1136d86-4c05-4b1e-8486-e65ecc788df5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1659 microversion: 2.1 time: 0.328449 Sep 10 12:08:06.370486 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2781/5555] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:06 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1659 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:06.385433 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-65ab91ab-9829-4e72-8082-939c14e38b58 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:08:06.401668 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-65ab91ab-9829-4e72-8082-939c14e38b58 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:06.402456 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-65ab91ab-9829-4e72-8082-939c14e38b58 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:06.407961 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-65ab91ab-9829-4e72-8082-939c14e38b58 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:06.442163 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-9948b644-e507-4012-a962-8103e1e36541 req-0ed45f4b-e360-441f-b950-54c14cc4534d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20f0d900-aeea-4f7c-9b92-bf9363ba21c9", "tag": "48fef716-4256-4d09-b758-89e39be42dfb"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:08:06.460914 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-9948b644-e507-4012-a962-8103e1e36541 req-0ed45f4b-e360-441f-b950-54c14cc4534d service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:06.461670 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-9948b644-e507-4012-a962-8103e1e36541 req-0ed45f4b-e360-441f-b950-54c14cc4534d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:06.462607 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-9948b644-e507-4012-a962-8103e1e36541 req-0ed45f4b-e360-441f-b950-54c14cc4534d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:06.471226 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-65ab91ab-9829-4e72-8082-939c14e38b58 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Going to try to start instance {{(pid=128777) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 10 12:08:06.494664 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-9948b644-e507-4012-a962-8103e1e36541 req-0ed45f4b-e360-441f-b950-54c14cc4534d service nova] Creating event network-changed:48fef716-4256-4d09-b758-89e39be42dfb for instance 20f0d900-aeea-4f7c-9b92-bf9363ba21c9 on n-h1-856895-1 Sep 10 12:08:06.503106 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-9948b644-e507-4012-a962-8103e1e36541 req-0ed45f4b-e360-441f-b950-54c14cc4534d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062854 Sep 10 12:08:06.506992 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2782/5556] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:08:06.548918 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-65ab91ab-9829-4e72-8082-939c14e38b58 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "POST /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f/action" status: 202 len: 0 microversion: 2.1 time: 0.167414 Sep 10 12:08:06.549944 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2775/5557] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:08:06 2022] POST /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:08:06.559120 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4c39775d-c354-4604-be8a-bfb24fb796bd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:06.559934 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4c39775d-c354-4604-be8a-bfb24fb796bd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:06.569968 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4c39775d-c354-4604-be8a-bfb24fb796bd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:06.570782 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4c39775d-c354-4604-be8a-bfb24fb796bd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:06.571425 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4c39775d-c354-4604-be8a-bfb24fb796bd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:06.573424 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4c39775d-c354-4604-be8a-bfb24fb796bd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:06.574191 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4c39775d-c354-4604-be8a-bfb24fb796bd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:06.575050 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4c39775d-c354-4604-be8a-bfb24fb796bd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:07.279030 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4c39775d-c354-4604-be8a-bfb24fb796bd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:07.294962 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4c39775d-c354-4604-be8a-bfb24fb796bd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1668 microversion: 2.1 time: 0.740669 Sep 10 12:08:07.311541 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2783/5558] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:06 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1668 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:08.329160 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a9f36b79-ea48-4b35-9e56-b078ba8bdb3d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:08.330049 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a9f36b79-ea48-4b35-9e56-b078ba8bdb3d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:08.338170 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9f36b79-ea48-4b35-9e56-b078ba8bdb3d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:08.339151 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9f36b79-ea48-4b35-9e56-b078ba8bdb3d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:08.339826 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9f36b79-ea48-4b35-9e56-b078ba8bdb3d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:08.340753 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9f36b79-ea48-4b35-9e56-b078ba8bdb3d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:08.342063 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9f36b79-ea48-4b35-9e56-b078ba8bdb3d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:08.342597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9f36b79-ea48-4b35-9e56-b078ba8bdb3d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:08.674358 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a9f36b79-ea48-4b35-9e56-b078ba8bdb3d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:08.688732 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a9f36b79-ea48-4b35-9e56-b078ba8bdb3d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1668 microversion: 2.1 time: 0.366554 Sep 10 12:08:08.690572 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2776/5559] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:08 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1668 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:09.718603 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c001115a-c440-456e-ac50-d3af6cef2dec tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:09.719360 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c001115a-c440-456e-ac50-d3af6cef2dec tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:09.732253 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c001115a-c440-456e-ac50-d3af6cef2dec tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:09.733625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c001115a-c440-456e-ac50-d3af6cef2dec tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:09.735613 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c001115a-c440-456e-ac50-d3af6cef2dec tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:09.737327 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c001115a-c440-456e-ac50-d3af6cef2dec tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:09.738015 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c001115a-c440-456e-ac50-d3af6cef2dec tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:09.738613 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c001115a-c440-456e-ac50-d3af6cef2dec tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:09.948511 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c001115a-c440-456e-ac50-d3af6cef2dec tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:09.958630 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c001115a-c440-456e-ac50-d3af6cef2dec tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.247538 Sep 10 12:08:09.959828 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2784/5560] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:09 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:09.985833 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7d78e9eb-b658-4cad-aca5-79809e03f3fd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:09.986452 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7d78e9eb-b658-4cad-aca5-79809e03f3fd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:10.000831 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d78e9eb-b658-4cad-aca5-79809e03f3fd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:10.001606 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d78e9eb-b658-4cad-aca5-79809e03f3fd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:10.002220 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d78e9eb-b658-4cad-aca5-79809e03f3fd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:10.003105 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d78e9eb-b658-4cad-aca5-79809e03f3fd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:10.003597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d78e9eb-b658-4cad-aca5-79809e03f3fd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:10.004030 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d78e9eb-b658-4cad-aca5-79809e03f3fd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:10.249911 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7d78e9eb-b658-4cad-aca5-79809e03f3fd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:10.261759 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7d78e9eb-b658-4cad-aca5-79809e03f3fd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.279613 Sep 10 12:08:10.295997 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-58eeabd4-06b5-4243-a1f0-ebc99b267121 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:10.296941 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2777/5561] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:09 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:10.297305 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-58eeabd4-06b5-4243-a1f0-ebc99b267121 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:10.306362 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-58eeabd4-06b5-4243-a1f0-ebc99b267121 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:10.307273 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-58eeabd4-06b5-4243-a1f0-ebc99b267121 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:10.307899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-58eeabd4-06b5-4243-a1f0-ebc99b267121 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:10.308776 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-58eeabd4-06b5-4243-a1f0-ebc99b267121 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:10.309406 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-58eeabd4-06b5-4243-a1f0-ebc99b267121 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:10.309998 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-58eeabd4-06b5-4243-a1f0-ebc99b267121 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:10.717066 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-58eeabd4-06b5-4243-a1f0-ebc99b267121 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:10.745288 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-58eeabd4-06b5-4243-a1f0-ebc99b267121 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.450765 Sep 10 12:08:10.746082 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2785/5562] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:10 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:10.774086 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bfd90dba-529b-41d2-9d88-8bddd1b740a5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:10.774936 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bfd90dba-529b-41d2-9d88-8bddd1b740a5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:10.782557 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bfd90dba-529b-41d2-9d88-8bddd1b740a5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:10.783051 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bfd90dba-529b-41d2-9d88-8bddd1b740a5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:10.796413 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bfd90dba-529b-41d2-9d88-8bddd1b740a5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:10.798201 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bfd90dba-529b-41d2-9d88-8bddd1b740a5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:10.800613 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bfd90dba-529b-41d2-9d88-8bddd1b740a5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:10.805720 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bfd90dba-529b-41d2-9d88-8bddd1b740a5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:11.069031 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bfd90dba-529b-41d2-9d88-8bddd1b740a5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:11.078127 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bfd90dba-529b-41d2-9d88-8bddd1b740a5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.310909 Sep 10 12:08:11.088124 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2778/5563] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:10 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:11.106178 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f4c361a0-dd85-49ad-ae8a-8cdee7d42b1f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:11.106800 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f4c361a0-dd85-49ad-ae8a-8cdee7d42b1f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:11.115125 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4c361a0-dd85-49ad-ae8a-8cdee7d42b1f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:11.115675 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4c361a0-dd85-49ad-ae8a-8cdee7d42b1f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:11.116121 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4c361a0-dd85-49ad-ae8a-8cdee7d42b1f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:11.116839 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4c361a0-dd85-49ad-ae8a-8cdee7d42b1f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:11.117568 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4c361a0-dd85-49ad-ae8a-8cdee7d42b1f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:11.118005 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4c361a0-dd85-49ad-ae8a-8cdee7d42b1f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:11.411506 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f4c361a0-dd85-49ad-ae8a-8cdee7d42b1f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:11.420969 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f4c361a0-dd85-49ad-ae8a-8cdee7d42b1f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.318885 Sep 10 12:08:11.437191 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2786/5564] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:11 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:11.463335 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4c59318b-be3e-4347-b748-2dc342f3490b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:08:11.464573 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4c59318b-be3e-4347-b748-2dc342f3490b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:11.500062 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4c59318b-be3e-4347-b748-2dc342f3490b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:11.500569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4c59318b-be3e-4347-b748-2dc342f3490b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:11.501012 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4c59318b-be3e-4347-b748-2dc342f3490b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:11.501732 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4c59318b-be3e-4347-b748-2dc342f3490b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:11.502171 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4c59318b-be3e-4347-b748-2dc342f3490b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:11.502595 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4c59318b-be3e-4347-b748-2dc342f3490b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:11.559513 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-4c59318b-be3e-4347-b748-2dc342f3490b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lazy-loading 'flavor' on Instance uuid 64704ff7-229d-478b-9889-6b6cba53bd0f {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:08:11.767468 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4c59318b-be3e-4347-b748-2dc342f3490b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "POST /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f/action" status: 202 len: 0 microversion: 2.1 time: 0.310237 Sep 10 12:08:11.773175 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2779/5565] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:08:11 2022] POST /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:08:11.794412 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b94f1ac3-7833-4099-a33a-6a5e260eb0ab tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:11.795047 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b94f1ac3-7833-4099-a33a-6a5e260eb0ab tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:11.822593 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b94f1ac3-7833-4099-a33a-6a5e260eb0ab tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:11.823171 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b94f1ac3-7833-4099-a33a-6a5e260eb0ab tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:11.826978 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b94f1ac3-7833-4099-a33a-6a5e260eb0ab tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:11.828848 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b94f1ac3-7833-4099-a33a-6a5e260eb0ab tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:11.829321 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b94f1ac3-7833-4099-a33a-6a5e260eb0ab tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:11.829756 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b94f1ac3-7833-4099-a33a-6a5e260eb0ab tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:11.974858 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b53daeba-d129-4a36-93a9-4e70e2ee5973 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Action: 'create', calling method: .version_select at 0x7f4073830550>, body: {"keypair": {"name": "tempest-keypair-608658947", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHsKjuEHUhTOOTfFGg9i7vhYZoTa50fv1hTPUeFIKdYRRvSfAYSeNIc4fyrjXHD+aNnQG1B6/q7hvlDtVQEFn2UFO88zQLnZuz2o6ahYHy9sZxEembRCybNSL9HPmBZ/g=="}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:08:12.038074 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-b53daeba-d129-4a36-93a9-4e70e2ee5973 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Getting quotas for project 03301ecc81fe426bafc4be81413d1265. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:08:12.051738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-b53daeba-d129-4a36-93a9-4e70e2ee5973 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Getting quotas for user 199d923de84c45789188543de904314a and project 03301ecc81fe426bafc4be81413d1265. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:08:12.155678 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b53daeba-d129-4a36-93a9-4e70e2ee5973 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.184119 Sep 10 12:08:12.157474 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2780/5566] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 12:08:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:08:12.177769 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b94f1ac3-7833-4099-a33a-6a5e260eb0ab tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:12.190454 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b94f1ac3-7833-4099-a33a-6a5e260eb0ab tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1680 microversion: 2.1 time: 0.414234 Sep 10 12:08:12.232119 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2787/5567] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:11 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1680 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:13.239569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4e292691-e1d7-4aa1-99ca-5213758eeb4b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:13.241095 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4e292691-e1d7-4aa1-99ca-5213758eeb4b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:13.263779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e292691-e1d7-4aa1-99ca-5213758eeb4b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:13.267045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e292691-e1d7-4aa1-99ca-5213758eeb4b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:13.267736 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e292691-e1d7-4aa1-99ca-5213758eeb4b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:13.276251 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e292691-e1d7-4aa1-99ca-5213758eeb4b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:13.276956 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e292691-e1d7-4aa1-99ca-5213758eeb4b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:13.277982 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e292691-e1d7-4aa1-99ca-5213758eeb4b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:13.591400 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4e292691-e1d7-4aa1-99ca-5213758eeb4b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:13.608245 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4e292691-e1d7-4aa1-99ca-5213758eeb4b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1663 microversion: 2.1 time: 0.376091 Sep 10 12:08:13.608770 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2781/5568] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:13 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1663 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:13.638801 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-55e446ce-c5be-4efa-ab48-5aba33c83051 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:08:13.640686 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-55e446ce-c5be-4efa-ab48-5aba33c83051 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:13.661614 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55e446ce-c5be-4efa-ab48-5aba33c83051 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:13.663116 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55e446ce-c5be-4efa-ab48-5aba33c83051 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:13.663828 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55e446ce-c5be-4efa-ab48-5aba33c83051 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:13.664780 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55e446ce-c5be-4efa-ab48-5aba33c83051 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:13.665472 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55e446ce-c5be-4efa-ab48-5aba33c83051 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:13.666278 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55e446ce-c5be-4efa-ab48-5aba33c83051 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:13.839899 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-55e446ce-c5be-4efa-ab48-5aba33c83051 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "POST /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f/action" status: 202 len: 0 microversion: 2.1 time: 0.205717 Sep 10 12:08:13.840567 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2788/5569] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:08:13 2022] POST /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:08:13.858867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-98eb98e6-8a09-4c52-bf4a-41152f6793c4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:13.860488 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-98eb98e6-8a09-4c52-bf4a-41152f6793c4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:13.889123 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98eb98e6-8a09-4c52-bf4a-41152f6793c4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:13.889947 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98eb98e6-8a09-4c52-bf4a-41152f6793c4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:13.892540 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98eb98e6-8a09-4c52-bf4a-41152f6793c4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:13.898209 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98eb98e6-8a09-4c52-bf4a-41152f6793c4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:13.898723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98eb98e6-8a09-4c52-bf4a-41152f6793c4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:13.899143 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98eb98e6-8a09-4c52-bf4a-41152f6793c4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:14.810779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-98eb98e6-8a09-4c52-bf4a-41152f6793c4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:14.833657 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-98eb98e6-8a09-4c52-bf4a-41152f6793c4 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1669 microversion: 2.1 time: 0.985767 Sep 10 12:08:14.834985 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2782/5570] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:13 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1669 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:15.862444 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-45dfd8b5-6577-4b4b-bf3d-6e9f39348001 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:15.864636 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-45dfd8b5-6577-4b4b-bf3d-6e9f39348001 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:15.891357 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:08:15.908906 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-45dfd8b5-6577-4b4b-bf3d-6e9f39348001 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:15.910306 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-45dfd8b5-6577-4b4b-bf3d-6e9f39348001 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:15.915058 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-45dfd8b5-6577-4b4b-bf3d-6e9f39348001 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:15.919586 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-45dfd8b5-6577-4b4b-bf3d-6e9f39348001 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:15.920279 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-45dfd8b5-6577-4b4b-bf3d-6e9f39348001 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:15.922020 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-45dfd8b5-6577-4b4b-bf3d-6e9f39348001 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:16.090645 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-48cc9480-4c9c-47d6-9871-4b64e99c55a3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-857319202", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e2e68d89-2e9a-4de9-a725-df4c3e2e169e"}], "security_groups": [{"name": "tempest-securitygroup--1309211759"}], "key_name": "tempest-keypair-608658947", "user_data": "}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:08:16.240441 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-45dfd8b5-6577-4b4b-bf3d-6e9f39348001 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:16.255306 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-45dfd8b5-6577-4b4b-bf3d-6e9f39348001 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1669 microversion: 2.1 time: 0.396064 Sep 10 12:08:16.256642 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2789/5571] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:15 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1669 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:16.315127 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-48cc9480-4c9c-47d6-9871-4b64e99c55a3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] validate_networks() for [('e2e68d89-2e9a-4de9-a725-df4c3e2e169e', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:08:17.281142 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-48cc9480-4c9c-47d6-9871-4b64e99c55a3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:08:17.282546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-48cc9480-4c9c-47d6-9871-4b64e99c55a3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:08:17.282686 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3489bebe-b6b3-4598-98d4-6251cae6a2d6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:17.283444 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3489bebe-b6b3-4598-98d4-6251cae6a2d6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:17.283823 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-48cc9480-4c9c-47d6-9871-4b64e99c55a3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:08:17.284400 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-48cc9480-4c9c-47d6-9871-4b64e99c55a3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:08:17.284998 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-48cc9480-4c9c-47d6-9871-4b64e99c55a3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:08:17.300181 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3489bebe-b6b3-4598-98d4-6251cae6a2d6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:17.300831 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3489bebe-b6b3-4598-98d4-6251cae6a2d6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:17.302060 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3489bebe-b6b3-4598-98d4-6251cae6a2d6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:17.303131 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3489bebe-b6b3-4598-98d4-6251cae6a2d6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:17.305488 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3489bebe-b6b3-4598-98d4-6251cae6a2d6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:17.306101 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3489bebe-b6b3-4598-98d4-6251cae6a2d6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:17.307202 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48cc9480-4c9c-47d6-9871-4b64e99c55a3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:17.309280 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48cc9480-4c9c-47d6-9871-4b64e99c55a3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:17.313449 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48cc9480-4c9c-47d6-9871-4b64e99c55a3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:17.314573 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48cc9480-4c9c-47d6-9871-4b64e99c55a3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:17.315302 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48cc9480-4c9c-47d6-9871-4b64e99c55a3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:17.315910 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48cc9480-4c9c-47d6-9871-4b64e99c55a3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:17.370301 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-48cc9480-4c9c-47d6-9871-4b64e99c55a3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Getting quotas for project 03301ecc81fe426bafc4be81413d1265. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:08:17.378049 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-48cc9480-4c9c-47d6-9871-4b64e99c55a3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Getting quotas for user 199d923de84c45789188543de904314a and project 03301ecc81fe426bafc4be81413d1265. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:08:17.436025 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-48cc9480-4c9c-47d6-9871-4b64e99c55a3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:08:17.438629 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-48cc9480-4c9c-47d6-9871-4b64e99c55a3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 5f777fb8-adb1-47fd-aced-8b338fa6052e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:08:17.559972 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-48cc9480-4c9c-47d6-9871-4b64e99c55a3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.473884 Sep 10 12:08:17.560699 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2783/5572] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:08:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 1475 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:08:17.576285 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-919b1cec-dcc9-4ddb-ab9d-4c9527d9ee18 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:17.576920 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-919b1cec-dcc9-4ddb-ab9d-4c9527d9ee18 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 5f777fb8-adb1-47fd-aced-8b338fa6052e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:17.710943 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3489bebe-b6b3-4598-98d4-6251cae6a2d6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:17.725266 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3489bebe-b6b3-4598-98d4-6251cae6a2d6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1669 microversion: 2.1 time: 0.446693 Sep 10 12:08:17.725507 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-919b1cec-dcc9-4ddb-ab9d-4c9527d9ee18 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:17.726193 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2790/5573] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:17 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1669 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:17.734595 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-919b1cec-dcc9-4ddb-ab9d-4c9527d9ee18 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e" status: 200 len: 1240 microversion: 2.1 time: 0.162111 Sep 10 12:08:17.743048 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2784/5574] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:17 2022] GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e => generated 1240 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:18.766173 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-54ee5c26-326d-4128-be92-8760ce8506c2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:18.766861 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-54ee5c26-326d-4128-be92-8760ce8506c2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:18.771014 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-27e08314-8b4c-4279-821c-8a60423d215d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:18.772376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-27e08314-8b4c-4279-821c-8a60423d215d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 5f777fb8-adb1-47fd-aced-8b338fa6052e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:18.776287 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-54ee5c26-326d-4128-be92-8760ce8506c2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:18.776944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-54ee5c26-326d-4128-be92-8760ce8506c2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:18.777440 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-54ee5c26-326d-4128-be92-8760ce8506c2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:18.778552 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-54ee5c26-326d-4128-be92-8760ce8506c2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:18.779452 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-54ee5c26-326d-4128-be92-8760ce8506c2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:18.779589 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-54ee5c26-326d-4128-be92-8760ce8506c2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:18.782637 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-27e08314-8b4c-4279-821c-8a60423d215d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:18.783333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-27e08314-8b4c-4279-821c-8a60423d215d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:18.783998 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-27e08314-8b4c-4279-821c-8a60423d215d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:18.784865 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-27e08314-8b4c-4279-821c-8a60423d215d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:18.786210 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-27e08314-8b4c-4279-821c-8a60423d215d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:18.786994 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-27e08314-8b4c-4279-821c-8a60423d215d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:18.897505 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-27e08314-8b4c-4279-821c-8a60423d215d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:18.900430 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:08:18.914206 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-27e08314-8b4c-4279-821c-8a60423d215d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e" status: 200 len: 1292 microversion: 2.1 time: 0.148417 Sep 10 12:08:18.923610 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2785/5575] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:18 2022] GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e => generated 1292 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:08:19.309693 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-54ee5c26-326d-4128-be92-8760ce8506c2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:19.321435 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-54ee5c26-326d-4128-be92-8760ce8506c2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.560275 Sep 10 12:08:19.336130 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2791/5576] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:18 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:19.346354 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-648c33b5-2105-4ae4-97b7-94f9e0b24c71 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:19.348289 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-648c33b5-2105-4ae4-97b7-94f9e0b24c71 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:19.357799 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:08:19.360140 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-648c33b5-2105-4ae4-97b7-94f9e0b24c71 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:19.360898 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-648c33b5-2105-4ae4-97b7-94f9e0b24c71 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:19.361739 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-648c33b5-2105-4ae4-97b7-94f9e0b24c71 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:19.362810 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-648c33b5-2105-4ae4-97b7-94f9e0b24c71 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:19.364238 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-648c33b5-2105-4ae4-97b7-94f9e0b24c71 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:19.365293 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-648c33b5-2105-4ae4-97b7-94f9e0b24c71 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:19.600520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-648c33b5-2105-4ae4-97b7-94f9e0b24c71 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:19.612100 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-648c33b5-2105-4ae4-97b7-94f9e0b24c71 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1672 microversion: 2.1 time: 0.270859 Sep 10 12:08:19.615367 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2786/5577] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:19 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1672 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:19.648234 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-622050b8-4467-4b9f-b085-c26e12945a6f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:19.649147 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-622050b8-4467-4b9f-b085-c26e12945a6f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:19.656979 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-622050b8-4467-4b9f-b085-c26e12945a6f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:19.657969 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-622050b8-4467-4b9f-b085-c26e12945a6f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:19.658684 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-622050b8-4467-4b9f-b085-c26e12945a6f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:19.659751 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-622050b8-4467-4b9f-b085-c26e12945a6f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:19.664327 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-622050b8-4467-4b9f-b085-c26e12945a6f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:19.665101 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-622050b8-4467-4b9f-b085-c26e12945a6f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:19.709131 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-622050b8-4467-4b9f-b085-c26e12945a6f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:08:19.720081 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.compute.api [None req-622050b8-4467-4b9f-b085-c26e12945a6f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] Working on deleting snapshot 8b1088ae-6b58-4fcc-bd12-e262bfa7e183 from shelved instance... Sep 10 12:08:19.939105 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b5ba4f95-6b31-408e-bbaa-ca1917d8c7cb tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:19.939795 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b5ba4f95-6b31-408e-bbaa-ca1917d8c7cb tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 5f777fb8-adb1-47fd-aced-8b338fa6052e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:19.955099 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5ba4f95-6b31-408e-bbaa-ca1917d8c7cb tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:19.955668 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5ba4f95-6b31-408e-bbaa-ca1917d8c7cb tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:19.956255 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5ba4f95-6b31-408e-bbaa-ca1917d8c7cb tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:19.957702 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5ba4f95-6b31-408e-bbaa-ca1917d8c7cb tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:19.958375 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5ba4f95-6b31-408e-bbaa-ca1917d8c7cb tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:19.960184 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5ba4f95-6b31-408e-bbaa-ca1917d8c7cb tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:20.145496 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b5ba4f95-6b31-408e-bbaa-ca1917d8c7cb tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:20.157119 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b5ba4f95-6b31-408e-bbaa-ca1917d8c7cb tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e" status: 200 len: 1298 microversion: 2.1 time: 0.222807 Sep 10 12:08:20.159151 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2787/5578] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:19 2022] GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e => generated 1298 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:20.870963 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-622050b8-4467-4b9f-b085-c26e12945a6f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] Doing local delete in cell d31511aa-3734-4d55-9c57-4a88c62d4dfd(cell1) {{(pid=128776) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 10 12:08:20.873307 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-622050b8-4467-4b9f-b085-c26e12945a6f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:20.874061 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-622050b8-4467-4b9f-b085-c26e12945a6f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:20.875480 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-622050b8-4467-4b9f-b085-c26e12945a6f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:20.875975 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.compute.api [None req-622050b8-4467-4b9f-b085-c26e12945a6f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 10 12:08:20.891491 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-622050b8-4467-4b9f-b085-c26e12945a6f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] deallocate_for_instance() {{(pid=128776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 10 12:08:21.182221 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2fb274b4-3ece-47e9-982e-a9215d716cec tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:21.183480 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2fb274b4-3ece-47e9-982e-a9215d716cec tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 5f777fb8-adb1-47fd-aced-8b338fa6052e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:21.198570 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fb274b4-3ece-47e9-982e-a9215d716cec tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:21.199358 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fb274b4-3ece-47e9-982e-a9215d716cec tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:21.201189 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fb274b4-3ece-47e9-982e-a9215d716cec tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:21.204283 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fb274b4-3ece-47e9-982e-a9215d716cec tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:21.204965 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fb274b4-3ece-47e9-982e-a9215d716cec tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:21.205568 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fb274b4-3ece-47e9-982e-a9215d716cec tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:21.518898 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2fb274b4-3ece-47e9-982e-a9215d716cec tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:21.539463 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2fb274b4-3ece-47e9-982e-a9215d716cec tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e" status: 200 len: 1366 microversion: 2.1 time: 0.361717 Sep 10 12:08:21.542307 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2788/5579] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:21 2022] GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e => generated 1366 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:21.835371 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-024c9b32-4c95-4de8-9102-60e011ebdbc3 req-0dc4f2c0-aba4-47f1-94cd-67cbee7aeb85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55d5cbf7-6438-4f5b-96b3-719e9f3f7a64", "name": "network-vif-deleted", "tag": "c6eb0ad3-74e3-40f5-a84c-64f4d0d21125"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:08:21.843963 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-622050b8-4467-4b9f-b085-c26e12945a6f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] Updating instance_info_cache with network_info: [] {{(pid=128776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 10 12:08:21.861807 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-024c9b32-4c95-4de8-9102-60e011ebdbc3 req-0dc4f2c0-aba4-47f1-94cd-67cbee7aeb85 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:21.862379 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-024c9b32-4c95-4de8-9102-60e011ebdbc3 req-0dc4f2c0-aba4-47f1-94cd-67cbee7aeb85 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:21.862737 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-024c9b32-4c95-4de8-9102-60e011ebdbc3 req-0dc4f2c0-aba4-47f1-94cd-67cbee7aeb85 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:21.909960 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.compute.server_external_events [req-024c9b32-4c95-4de8-9102-60e011ebdbc3 req-0dc4f2c0-aba4-47f1-94cd-67cbee7aeb85 service nova] Unable to find a host for instance 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64. Dropping event network-vif-deleted {{(pid=128777) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 10 12:08:21.920447 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-024c9b32-4c95-4de8-9102-60e011ebdbc3 req-0dc4f2c0-aba4-47f1-94cd-67cbee7aeb85 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.084012 Sep 10 12:08:21.921782 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2789/5580] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 91 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 10 12:08:22.372522 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=7,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:08:22.412620 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-622050b8-4467-4b9f-b085-c26e12945a6f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "DELETE /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64" status: 204 len: 0 microversion: 2.1 time: 2.775508 Sep 10 12:08:22.418351 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2792/5581] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:08:19 2022] DELETE /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 => generated 0 bytes in 2779 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:08:22.423744 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9fb69287-04d2-44a1-bfc3-4d25132e86d6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:22.424374 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9fb69287-04d2-44a1-bfc3-4d25132e86d6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:22.434725 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9fb69287-04d2-44a1-bfc3-4d25132e86d6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:22.435270 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9fb69287-04d2-44a1-bfc3-4d25132e86d6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:22.437725 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9fb69287-04d2-44a1-bfc3-4d25132e86d6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:22.438499 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9fb69287-04d2-44a1-bfc3-4d25132e86d6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:22.438979 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9fb69287-04d2-44a1-bfc3-4d25132e86d6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:22.439442 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9fb69287-04d2-44a1-bfc3-4d25132e86d6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:22.476763 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-9fb69287-04d2-44a1-bfc3-4d25132e86d6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] HTTP exception thrown: Instance 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 could not be found. Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9fb69287-04d2-44a1-bfc3-4d25132e86d6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Request method failure captured: Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 HTTP/1.1 Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHvbGvNacfdgMYX0C1NknJJq9YUW5dAORIKr9a4TrFfNiItRSkWndeAJm51SFO_cJls_yRa1COZxQcBgB_PB3er0wolcL9nuODxO-4gh3bsdBy7gHemAEX8Q3MA6WCbAN3U14zQhI8ymqbFJWvUom1mViWhPQ5y3ASbmVvOZSfPd2oE Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 2410f9544bec4633988e1554111c9446 Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServerActionsTestJSON-1996815151 Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2410f9544bec4633988e1554111c9446"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2410f9544bec4633988e1554111c9446"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2410f9544bec4633988e1554111c9446", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2410f9544bec4633988e1554111c9446"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServerActionsTestJSON-1996815151 Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 2410f9544bec4633988e1554111c9446 Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServerActionsTestJSON-1996815151 Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServerActionsTestJSON-1996815151-project Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 8954f3256ddd49639ea57a9242a296d0 Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServerActionsTestJSON-1996815151-project Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 could not be found. Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '55d5cbf7-6438-4f5b-96b3-719e9f3f7a64'} Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 could not be found. Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 could not be found. Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:08:22.482009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:08:22.487066 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:08:22.487066 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:08:22.487066 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:08:22.487066 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:08:22.487066 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:08:22.487066 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 could not be found. Sep 10 12:08:22.487066 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:08:22.509252 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9fb69287-04d2-44a1-bfc3-4d25132e86d6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Returning 404 to user: Instance 55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:08:22.510176 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9fb69287-04d2-44a1-bfc3-4d25132e86d6 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64" status: 404 len: 111 microversion: 2.1 time: 0.091903 Sep 10 12:08:22.514330 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2790/5582] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:22 2022] GET /compute/v2.1/servers/55d5cbf7-6438-4f5b-96b3-719e9f3f7a64 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:08:22.523717 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1e895157-8f6b-4aab-8ed4-d90f868f91f0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:22.525770 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1e895157-8f6b-4aab-8ed4-d90f868f91f0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: f4c6978c-b7f7-426b-b92a-2f50b1940b2f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:22.535350 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1e895157-8f6b-4aab-8ed4-d90f868f91f0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:22.536158 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1e895157-8f6b-4aab-8ed4-d90f868f91f0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:22.540060 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1e895157-8f6b-4aab-8ed4-d90f868f91f0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:22.542356 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1e895157-8f6b-4aab-8ed4-d90f868f91f0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:22.543123 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1e895157-8f6b-4aab-8ed4-d90f868f91f0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:22.543762 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1e895157-8f6b-4aab-8ed4-d90f868f91f0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:22.568572 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f8ba7500-52ac-45ab-ab9d-ca6f6916b8d6 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:22.569200 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f8ba7500-52ac-45ab-ab9d-ca6f6916b8d6 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 5f777fb8-adb1-47fd-aced-8b338fa6052e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:22.585949 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1e895157-8f6b-4aab-8ed4-d90f868f91f0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: f4c6978c-b7f7-426b-b92a-2f50b1940b2f] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:08:22.594872 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8ba7500-52ac-45ab-ab9d-ca6f6916b8d6 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:22.599203 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8ba7500-52ac-45ab-ab9d-ca6f6916b8d6 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:22.599685 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8ba7500-52ac-45ab-ab9d-ca6f6916b8d6 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:22.600424 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8ba7500-52ac-45ab-ab9d-ca6f6916b8d6 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:22.600889 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8ba7500-52ac-45ab-ab9d-ca6f6916b8d6 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:22.601319 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8ba7500-52ac-45ab-ab9d-ca6f6916b8d6 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:22.711409 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1e895157-8f6b-4aab-8ed4-d90f868f91f0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f4c6978c-b7f7-426b-b92a-2f50b1940b2f" status: 204 len: 0 microversion: 2.1 time: 0.191848 Sep 10 12:08:22.717074 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2793/5583] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:08:22 2022] DELETE /compute/v2.1/servers/f4c6978c-b7f7-426b-b92a-2f50b1940b2f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:08:22.735964 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-63bed7cf-4c11-4661-b13b-5ddf9e02edd5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:22.736745 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-63bed7cf-4c11-4661-b13b-5ddf9e02edd5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: f4c6978c-b7f7-426b-b92a-2f50b1940b2f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:22.748740 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-63bed7cf-4c11-4661-b13b-5ddf9e02edd5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:22.749806 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-63bed7cf-4c11-4661-b13b-5ddf9e02edd5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:22.750642 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-63bed7cf-4c11-4661-b13b-5ddf9e02edd5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:22.752317 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-63bed7cf-4c11-4661-b13b-5ddf9e02edd5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:22.753226 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-63bed7cf-4c11-4661-b13b-5ddf9e02edd5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:22.754728 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-63bed7cf-4c11-4661-b13b-5ddf9e02edd5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:23.106154 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f8ba7500-52ac-45ab-ab9d-ca6f6916b8d6 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:23.125385 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f8ba7500-52ac-45ab-ab9d-ca6f6916b8d6 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e" status: 200 len: 1366 microversion: 2.1 time: 0.561274 Sep 10 12:08:23.140168 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2791/5584] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:22 2022] GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e => generated 1366 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:08:23.140418 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-63bed7cf-4c11-4661-b13b-5ddf9e02edd5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:23.148459 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-63bed7cf-4c11-4661-b13b-5ddf9e02edd5 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/f4c6978c-b7f7-426b-b92a-2f50b1940b2f" status: 200 len: 1465 microversion: 2.1 time: 0.426895 Sep 10 12:08:23.149408 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2794/5585] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:22 2022] GET /compute/v2.1/servers/f4c6978c-b7f7-426b-b92a-2f50b1940b2f => generated 1465 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:23.171271 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-97e07c09-cc47-48fa-b117-49e7ff897cf6 req-898e305e-9fc9-451a-aaa4-fc4eb6515212 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f777fb8-adb1-47fd-aced-8b338fa6052e", "tag": "609fd4e8-589c-4be1-9346-b197c8445b70"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:08:23.188378 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-97e07c09-cc47-48fa-b117-49e7ff897cf6 req-898e305e-9fc9-451a-aaa4-fc4eb6515212 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:23.189318 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-97e07c09-cc47-48fa-b117-49e7ff897cf6 req-898e305e-9fc9-451a-aaa4-fc4eb6515212 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:23.189985 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-97e07c09-cc47-48fa-b117-49e7ff897cf6 req-898e305e-9fc9-451a-aaa4-fc4eb6515212 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:23.207745 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-97e07c09-cc47-48fa-b117-49e7ff897cf6 req-898e305e-9fc9-451a-aaa4-fc4eb6515212 service nova] Creating event network-changed:609fd4e8-589c-4be1-9346-b197c8445b70 for instance 5f777fb8-adb1-47fd-aced-8b338fa6052e on n-h2-856895-1 Sep 10 12:08:23.215094 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-97e07c09-cc47-48fa-b117-49e7ff897cf6 req-898e305e-9fc9-451a-aaa4-fc4eb6515212 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049385 Sep 10 12:08:23.221110 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2792/5586] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:08:24.150549 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-053f8a84-1f3b-4efc-8e19-a00d2afbdd4b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:24.151102 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-053f8a84-1f3b-4efc-8e19-a00d2afbdd4b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 5f777fb8-adb1-47fd-aced-8b338fa6052e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:24.161248 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-053f8a84-1f3b-4efc-8e19-a00d2afbdd4b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:24.162070 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-053f8a84-1f3b-4efc-8e19-a00d2afbdd4b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:24.162698 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-053f8a84-1f3b-4efc-8e19-a00d2afbdd4b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:24.163676 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-053f8a84-1f3b-4efc-8e19-a00d2afbdd4b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:24.164302 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-053f8a84-1f3b-4efc-8e19-a00d2afbdd4b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:24.164904 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-053f8a84-1f3b-4efc-8e19-a00d2afbdd4b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:24.173819 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-72e446e1-3068-4aad-a541-8b3be24efbf0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:24.175231 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-72e446e1-3068-4aad-a541-8b3be24efbf0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: f4c6978c-b7f7-426b-b92a-2f50b1940b2f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:24.192244 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-72e446e1-3068-4aad-a541-8b3be24efbf0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:24.193100 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-72e446e1-3068-4aad-a541-8b3be24efbf0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:24.193749 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-72e446e1-3068-4aad-a541-8b3be24efbf0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:24.197728 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-72e446e1-3068-4aad-a541-8b3be24efbf0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:24.198480 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-72e446e1-3068-4aad-a541-8b3be24efbf0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:24.199466 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-72e446e1-3068-4aad-a541-8b3be24efbf0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:24.573032 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-72e446e1-3068-4aad-a541-8b3be24efbf0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:24.594858 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-72e446e1-3068-4aad-a541-8b3be24efbf0 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/f4c6978c-b7f7-426b-b92a-2f50b1940b2f" status: 200 len: 1465 microversion: 2.1 time: 0.425321 Sep 10 12:08:24.595491 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2793/5587] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:24 2022] GET /compute/v2.1/servers/f4c6978c-b7f7-426b-b92a-2f50b1940b2f => generated 1465 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:08:24.935673 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-053f8a84-1f3b-4efc-8e19-a00d2afbdd4b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:24.961638 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-053f8a84-1f3b-4efc-8e19-a00d2afbdd4b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e" status: 200 len: 1366 microversion: 2.1 time: 0.814857 Sep 10 12:08:24.981594 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2795/5588] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:24 2022] GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e => generated 1366 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:25.624973 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-59047a39-c85f-4d80-9a83-3dc4790ea1c2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:25.625937 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-59047a39-c85f-4d80-9a83-3dc4790ea1c2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: f4c6978c-b7f7-426b-b92a-2f50b1940b2f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:25.662186 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59047a39-c85f-4d80-9a83-3dc4790ea1c2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:25.664950 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59047a39-c85f-4d80-9a83-3dc4790ea1c2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:25.665807 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59047a39-c85f-4d80-9a83-3dc4790ea1c2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:25.668677 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59047a39-c85f-4d80-9a83-3dc4790ea1c2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:25.669617 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59047a39-c85f-4d80-9a83-3dc4790ea1c2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:25.673821 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59047a39-c85f-4d80-9a83-3dc4790ea1c2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:25.838505 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-a79061a2-75a1-43a7-91f0-0b2030b1366e req-22ed80d9-5455-4ee0-8172-7fbdde072879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4c6978c-b7f7-426b-b92a-2f50b1940b2f", "name": "network-vif-deleted", "tag": "5df64599-3408-4ea3-9731-91e1f9bc70ad"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:08:25.839523 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-59047a39-c85f-4d80-9a83-3dc4790ea1c2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:25.859064 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-59047a39-c85f-4d80-9a83-3dc4790ea1c2 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/f4c6978c-b7f7-426b-b92a-2f50b1940b2f" status: 200 len: 1465 microversion: 2.1 time: 0.242599 Sep 10 12:08:25.861166 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2794/5589] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:25 2022] GET /compute/v2.1/servers/f4c6978c-b7f7-426b-b92a-2f50b1940b2f => generated 1465 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:25.867180 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a79061a2-75a1-43a7-91f0-0b2030b1366e req-22ed80d9-5455-4ee0-8172-7fbdde072879 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:25.871389 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a79061a2-75a1-43a7-91f0-0b2030b1366e req-22ed80d9-5455-4ee0-8172-7fbdde072879 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:25.872063 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a79061a2-75a1-43a7-91f0-0b2030b1366e req-22ed80d9-5455-4ee0-8172-7fbdde072879 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:25.903877 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-a79061a2-75a1-43a7-91f0-0b2030b1366e req-22ed80d9-5455-4ee0-8172-7fbdde072879 service nova] Creating event network-vif-deleted:5df64599-3408-4ea3-9731-91e1f9bc70ad for instance f4c6978c-b7f7-426b-b92a-2f50b1940b2f on n-h2-856895-1 Sep 10 12:08:25.913966 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-a79061a2-75a1-43a7-91f0-0b2030b1366e req-22ed80d9-5455-4ee0-8172-7fbdde072879 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079294 Sep 10 12:08:25.917977 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2796/5590] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:08:25.992041 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5a9a7235-b60b-473c-b97d-a79d0db36b8f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:25.992686 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5a9a7235-b60b-473c-b97d-a79d0db36b8f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 5f777fb8-adb1-47fd-aced-8b338fa6052e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:25.999908 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5a9a7235-b60b-473c-b97d-a79d0db36b8f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:26.000442 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5a9a7235-b60b-473c-b97d-a79d0db36b8f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:26.000765 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5a9a7235-b60b-473c-b97d-a79d0db36b8f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:26.002220 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5a9a7235-b60b-473c-b97d-a79d0db36b8f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:26.002708 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5a9a7235-b60b-473c-b97d-a79d0db36b8f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:26.003146 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5a9a7235-b60b-473c-b97d-a79d0db36b8f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:26.094103 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-96d1e6c4-f10f-4b88-a40f-c05ba5e0b4fe tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1222721625", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:08:26.182371 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-96d1e6c4-f10f-4b88-a40f-c05ba5e0b4fe tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] validate_networks() for None {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:08:26.477394 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5a9a7235-b60b-473c-b97d-a79d0db36b8f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:26.490449 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5a9a7235-b60b-473c-b97d-a79d0db36b8f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e" status: 200 len: 1366 microversion: 2.1 time: 0.503791 Sep 10 12:08:26.491446 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2795/5591] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:25 2022] GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e => generated 1366 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:26.641452 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-96d1e6c4-f10f-4b88-a40f-c05ba5e0b4fe tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:08:26.642080 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-96d1e6c4-f10f-4b88-a40f-c05ba5e0b4fe tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:08:26.642699 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-96d1e6c4-f10f-4b88-a40f-c05ba5e0b4fe tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:08:26.643119 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-96d1e6c4-f10f-4b88-a40f-c05ba5e0b4fe tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:08:26.643561 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-96d1e6c4-f10f-4b88-a40f-c05ba5e0b4fe tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:08:26.652807 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-96d1e6c4-f10f-4b88-a40f-c05ba5e0b4fe tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:26.653297 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-96d1e6c4-f10f-4b88-a40f-c05ba5e0b4fe tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:26.653735 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-96d1e6c4-f10f-4b88-a40f-c05ba5e0b4fe tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:26.654459 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-96d1e6c4-f10f-4b88-a40f-c05ba5e0b4fe tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:26.662785 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-96d1e6c4-f10f-4b88-a40f-c05ba5e0b4fe tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:26.669802 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-96d1e6c4-f10f-4b88-a40f-c05ba5e0b4fe tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:26.689850 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-96d1e6c4-f10f-4b88-a40f-c05ba5e0b4fe tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Getting quotas for project e5e93992bf3f458ba21e305e747f0075. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:08:26.696396 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-96d1e6c4-f10f-4b88-a40f-c05ba5e0b4fe tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Getting quotas for user f17689334f524764820a7d4cd944641b and project e5e93992bf3f458ba21e305e747f0075. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:08:26.714682 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-96d1e6c4-f10f-4b88-a40f-c05ba5e0b4fe tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:08:26.722347 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-96d1e6c4-f10f-4b88-a40f-c05ba5e0b4fe tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] [instance: b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:08:26.791274 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-96d1e6c4-f10f-4b88-a40f-c05ba5e0b4fe tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.701699 Sep 10 12:08:26.804313 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2797/5592] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:08:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 12:08:26.817048 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5a441663-31b9-4c39-bffe-0fb172532f31 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:26.818988 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5a441663-31b9-4c39-bffe-0fb172532f31 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] [instance: b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:26.886779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5a441663-31b9-4c39-bffe-0fb172532f31 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f17689334f524764820a7d4cd944641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e93992bf3f458ba21e305e747f0075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:26.895429 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5a441663-31b9-4c39-bffe-0fb172532f31 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] 10.222.0.23 "GET /compute/v2.1/servers/b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3" status: 200 len: 1214 microversion: 2.1 time: 0.083390 Sep 10 12:08:26.896170 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2796/5593] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:26 2022] GET /compute/v2.1/servers/b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:26.897073 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-13916e9f-9104-4677-8260-c652c7a1d8ca tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:26.897728 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-13916e9f-9104-4677-8260-c652c7a1d8ca tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: f4c6978c-b7f7-426b-b92a-2f50b1940b2f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:26.909028 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13916e9f-9104-4677-8260-c652c7a1d8ca tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:26.909633 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13916e9f-9104-4677-8260-c652c7a1d8ca tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:26.911442 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13916e9f-9104-4677-8260-c652c7a1d8ca tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:26.912374 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13916e9f-9104-4677-8260-c652c7a1d8ca tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:26.912956 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13916e9f-9104-4677-8260-c652c7a1d8ca tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:26.914400 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13916e9f-9104-4677-8260-c652c7a1d8ca tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:26.932107 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-13916e9f-9104-4677-8260-c652c7a1d8ca tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] HTTP exception thrown: Instance f4c6978c-b7f7-426b-b92a-2f50b1940b2f could not be found. Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-13916e9f-9104-4677-8260-c652c7a1d8ca tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Request method failure captured: Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/f4c6978c-b7f7-426b-b92a-2f50b1940b2f HTTP/1.1 Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHvbGvNacfdgMYX0C1NknJJq9YUW5dAORIKr9a4TrFfNiItRSkWndeAJm51SFO_cJls_yRa1COZxQcBgB_PB3er0wolcL9nuODxO-4gh3bsdBy7gHemAEX8Q3MA6WCbAN3U14zQhI8ymqbFJWvUom1mViWhPQ5y3ASbmVvOZSfPd2oE Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 2410f9544bec4633988e1554111c9446 Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServerActionsTestJSON-1996815151 Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2410f9544bec4633988e1554111c9446"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2410f9544bec4633988e1554111c9446"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2410f9544bec4633988e1554111c9446", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2410f9544bec4633988e1554111c9446"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServerActionsTestJSON-1996815151 Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 2410f9544bec4633988e1554111c9446 Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServerActionsTestJSON-1996815151 Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServerActionsTestJSON-1996815151-project Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 8954f3256ddd49639ea57a9242a296d0 Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServerActionsTestJSON-1996815151-project Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance f4c6978c-b7f7-426b-b92a-2f50b1940b2f could not be found. Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'f4c6978c-b7f7-426b-b92a-2f50b1940b2f'} Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4c6978c-b7f7-426b-b92a-2f50b1940b2f could not be found. Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4c6978c-b7f7-426b-b92a-2f50b1940b2f could not be found. Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:08:26.934334 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:08:26.938926 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:08:26.938926 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:08:26.938926 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:08:26.938926 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:08:26.938926 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:08:26.938926 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4c6978c-b7f7-426b-b92a-2f50b1940b2f could not be found. Sep 10 12:08:26.938926 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:08:26.938926 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-13916e9f-9104-4677-8260-c652c7a1d8ca tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Returning 404 to user: Instance f4c6978c-b7f7-426b-b92a-2f50b1940b2f could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:08:26.938926 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-13916e9f-9104-4677-8260-c652c7a1d8ca tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/f4c6978c-b7f7-426b-b92a-2f50b1940b2f" status: 404 len: 111 microversion: 2.1 time: 0.053046 Sep 10 12:08:26.943907 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2798/5594] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:26 2022] GET /compute/v2.1/servers/f4c6978c-b7f7-426b-b92a-2f50b1940b2f => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:08:26.948429 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6ca45a48-a15d-4a90-855a-d1b10a5d6be9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:26.949014 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6ca45a48-a15d-4a90-855a-d1b10a5d6be9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: b161d8f6-56f1-472a-99bd-f05c1431efac] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:26.956219 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6ca45a48-a15d-4a90-855a-d1b10a5d6be9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:26.956715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6ca45a48-a15d-4a90-855a-d1b10a5d6be9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:26.957963 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6ca45a48-a15d-4a90-855a-d1b10a5d6be9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:26.958776 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6ca45a48-a15d-4a90-855a-d1b10a5d6be9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:26.959274 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6ca45a48-a15d-4a90-855a-d1b10a5d6be9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:26.959709 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6ca45a48-a15d-4a90-855a-d1b10a5d6be9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:26.989209 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6ca45a48-a15d-4a90-855a-d1b10a5d6be9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: b161d8f6-56f1-472a-99bd-f05c1431efac] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:08:27.100966 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6ca45a48-a15d-4a90-855a-d1b10a5d6be9 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac" status: 204 len: 0 microversion: 2.1 time: 0.154978 Sep 10 12:08:27.101807 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2797/5595] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:08:26 2022] DELETE /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:08:27.115588 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-702aca7f-66bb-49bd-8abb-da8beb10762b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:27.116598 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-702aca7f-66bb-49bd-8abb-da8beb10762b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: b161d8f6-56f1-472a-99bd-f05c1431efac] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:27.123593 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-702aca7f-66bb-49bd-8abb-da8beb10762b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:27.124109 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-702aca7f-66bb-49bd-8abb-da8beb10762b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:27.125974 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-702aca7f-66bb-49bd-8abb-da8beb10762b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:27.126867 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-702aca7f-66bb-49bd-8abb-da8beb10762b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:27.127366 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-702aca7f-66bb-49bd-8abb-da8beb10762b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:27.127832 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-702aca7f-66bb-49bd-8abb-da8beb10762b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:27.400407 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-702aca7f-66bb-49bd-8abb-da8beb10762b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:27.422972 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-702aca7f-66bb-49bd-8abb-da8beb10762b tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac" status: 200 len: 1507 microversion: 2.1 time: 0.316783 Sep 10 12:08:27.435501 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2799/5596] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:27 2022] GET /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac => generated 1507 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:08:27.518769 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-82094a7e-d130-45ad-9d11-08644442960b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:27.520575 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-82094a7e-d130-45ad-9d11-08644442960b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 5f777fb8-adb1-47fd-aced-8b338fa6052e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:27.523297 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:08:27.543839 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82094a7e-d130-45ad-9d11-08644442960b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:27.544894 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82094a7e-d130-45ad-9d11-08644442960b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:27.545471 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82094a7e-d130-45ad-9d11-08644442960b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:27.546597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82094a7e-d130-45ad-9d11-08644442960b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:27.547206 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82094a7e-d130-45ad-9d11-08644442960b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:27.547899 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82094a7e-d130-45ad-9d11-08644442960b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:27.857549 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-82094a7e-d130-45ad-9d11-08644442960b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:27.871875 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-82094a7e-d130-45ad-9d11-08644442960b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e" status: 200 len: 1366 microversion: 2.1 time: 0.358688 Sep 10 12:08:27.874359 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2798/5597] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:27 2022] GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e => generated 1366 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:27.919578 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ed105f28-053a-48ef-9f7c-a5f7476b806a tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:27.922669 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ed105f28-053a-48ef-9f7c-a5f7476b806a tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] [instance: b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:27.934699 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed105f28-053a-48ef-9f7c-a5f7476b806a tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:27.935527 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed105f28-053a-48ef-9f7c-a5f7476b806a tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:27.936678 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed105f28-053a-48ef-9f7c-a5f7476b806a tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:27.938549 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed105f28-053a-48ef-9f7c-a5f7476b806a tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:27.940212 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed105f28-053a-48ef-9f7c-a5f7476b806a tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:27.940830 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed105f28-053a-48ef-9f7c-a5f7476b806a tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:28.074737 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ed105f28-053a-48ef-9f7c-a5f7476b806a tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f17689334f524764820a7d4cd944641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e93992bf3f458ba21e305e747f0075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:28.090562 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ed105f28-053a-48ef-9f7c-a5f7476b806a tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] 10.222.0.23 "GET /compute/v2.1/servers/b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3" status: 200 len: 1266 microversion: 2.1 time: 0.175952 Sep 10 12:08:28.109513 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2800/5598] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:27 2022] GET /compute/v2.1/servers/b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:28.448082 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a1d0b293-cfa5-4702-9557-549d10623390 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:28.448711 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a1d0b293-cfa5-4702-9557-549d10623390 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: b161d8f6-56f1-472a-99bd-f05c1431efac] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:28.465619 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a1d0b293-cfa5-4702-9557-549d10623390 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:28.466389 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a1d0b293-cfa5-4702-9557-549d10623390 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:28.467029 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a1d0b293-cfa5-4702-9557-549d10623390 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:28.467951 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a1d0b293-cfa5-4702-9557-549d10623390 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:28.468576 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a1d0b293-cfa5-4702-9557-549d10623390 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:28.469162 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a1d0b293-cfa5-4702-9557-549d10623390 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:28.896288 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-882a4490-6c01-48dd-be4a-d479db528103 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:28.897223 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-882a4490-6c01-48dd-be4a-d479db528103 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 5f777fb8-adb1-47fd-aced-8b338fa6052e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:28.902548 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a1d0b293-cfa5-4702-9557-549d10623390 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:28.906396 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-882a4490-6c01-48dd-be4a-d479db528103 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:28.906904 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-882a4490-6c01-48dd-be4a-d479db528103 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:28.911625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-882a4490-6c01-48dd-be4a-d479db528103 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:28.912694 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-882a4490-6c01-48dd-be4a-d479db528103 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:28.913338 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-882a4490-6c01-48dd-be4a-d479db528103 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:28.913949 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-882a4490-6c01-48dd-be4a-d479db528103 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:28.933305 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a1d0b293-cfa5-4702-9557-549d10623390 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac" status: 200 len: 1507 microversion: 2.1 time: 0.488867 Sep 10 12:08:28.934919 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2799/5599] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:28 2022] GET /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac => generated 1507 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:29.114383 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9bf69f73-995c-4f40-b7ec-6b38646c6c67 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:29.117061 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9bf69f73-995c-4f40-b7ec-6b38646c6c67 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] [instance: b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:29.128989 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9bf69f73-995c-4f40-b7ec-6b38646c6c67 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:29.131875 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9bf69f73-995c-4f40-b7ec-6b38646c6c67 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:29.133147 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9bf69f73-995c-4f40-b7ec-6b38646c6c67 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:29.143358 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9bf69f73-995c-4f40-b7ec-6b38646c6c67 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:29.144803 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9bf69f73-995c-4f40-b7ec-6b38646c6c67 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:29.145465 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9bf69f73-995c-4f40-b7ec-6b38646c6c67 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:29.270988 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9bf69f73-995c-4f40-b7ec-6b38646c6c67 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f17689334f524764820a7d4cd944641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e93992bf3f458ba21e305e747f0075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:29.289161 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9bf69f73-995c-4f40-b7ec-6b38646c6c67 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] 10.222.0.23 "GET /compute/v2.1/servers/b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3" status: 200 len: 1272 microversion: 2.1 time: 0.178855 Sep 10 12:08:29.290321 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2800/5600] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:29 2022] GET /compute/v2.1/servers/b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3 => generated 1272 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:08:29.311337 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-db67b69a-894e-4117-a9d6-16508445a8ea req-d7dca5ae-9243-4e3e-87e5-2424e8dd111b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b161d8f6-56f1-472a-99bd-f05c1431efac", "name": "network-vif-deleted", "tag": "1d2dfabb-74ce-4a1a-a0e4-d97023906eb9"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:08:29.326275 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-db67b69a-894e-4117-a9d6-16508445a8ea req-d7dca5ae-9243-4e3e-87e5-2424e8dd111b service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:29.330773 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-db67b69a-894e-4117-a9d6-16508445a8ea req-d7dca5ae-9243-4e3e-87e5-2424e8dd111b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:29.331620 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-db67b69a-894e-4117-a9d6-16508445a8ea req-d7dca5ae-9243-4e3e-87e5-2424e8dd111b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:29.360196 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-db67b69a-894e-4117-a9d6-16508445a8ea req-d7dca5ae-9243-4e3e-87e5-2424e8dd111b service nova] Creating event network-vif-deleted:1d2dfabb-74ce-4a1a-a0e4-d97023906eb9 for instance b161d8f6-56f1-472a-99bd-f05c1431efac on n-h2-856895-1 Sep 10 12:08:29.371453 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-db67b69a-894e-4117-a9d6-16508445a8ea req-d7dca5ae-9243-4e3e-87e5-2424e8dd111b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064023 Sep 10 12:08:29.375485 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2801/5601] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:08:29.688694 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-882a4490-6c01-48dd-be4a-d479db528103 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:29.708324 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-882a4490-6c01-48dd-be4a-d479db528103 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e" status: 200 len: 1366 microversion: 2.1 time: 0.816320 Sep 10 12:08:29.709028 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2801/5602] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:28 2022] GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e => generated 1366 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:08:29.960884 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ffe35ed5-dcfe-42f4-9634-e37f6ca1c444 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:29.962415 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ffe35ed5-dcfe-42f4-9634-e37f6ca1c444 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: b161d8f6-56f1-472a-99bd-f05c1431efac] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:29.979109 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ffe35ed5-dcfe-42f4-9634-e37f6ca1c444 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:29.991863 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ffe35ed5-dcfe-42f4-9634-e37f6ca1c444 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:29.992470 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ffe35ed5-dcfe-42f4-9634-e37f6ca1c444 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:29.993310 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ffe35ed5-dcfe-42f4-9634-e37f6ca1c444 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:29.994009 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ffe35ed5-dcfe-42f4-9634-e37f6ca1c444 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:29.994640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ffe35ed5-dcfe-42f4-9634-e37f6ca1c444 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:30.057253 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ffe35ed5-dcfe-42f4-9634-e37f6ca1c444 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:30.059822 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ffe35ed5-dcfe-42f4-9634-e37f6ca1c444 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:30.060448 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ffe35ed5-dcfe-42f4-9634-e37f6ca1c444 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:30.061020 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-ffe35ed5-dcfe-42f4-9634-e37f6ca1c444 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lazy-loading 'fault' on Instance uuid b161d8f6-56f1-472a-99bd-f05c1431efac {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:08:30.193442 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ffe35ed5-dcfe-42f4-9634-e37f6ca1c444 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:30.201346 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ffe35ed5-dcfe-42f4-9634-e37f6ca1c444 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac" status: 200 len: 1304 microversion: 2.1 time: 0.245542 Sep 10 12:08:30.216467 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2802/5603] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:29 2022] GET /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac => generated 1304 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:30.313170 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-eeb371a2-1ee7-4e92-a1f2-5980cbbbd3db tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:30.313805 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-eeb371a2-1ee7-4e92-a1f2-5980cbbbd3db tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] [instance: b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:30.328671 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eeb371a2-1ee7-4e92-a1f2-5980cbbbd3db tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:30.329273 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eeb371a2-1ee7-4e92-a1f2-5980cbbbd3db tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:30.329816 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eeb371a2-1ee7-4e92-a1f2-5980cbbbd3db tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:30.331030 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eeb371a2-1ee7-4e92-a1f2-5980cbbbd3db tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:30.332755 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eeb371a2-1ee7-4e92-a1f2-5980cbbbd3db tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:30.333575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eeb371a2-1ee7-4e92-a1f2-5980cbbbd3db tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:30.439214 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-eeb371a2-1ee7-4e92-a1f2-5980cbbbd3db tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f17689334f524764820a7d4cd944641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e93992bf3f458ba21e305e747f0075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:30.450822 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-eeb371a2-1ee7-4e92-a1f2-5980cbbbd3db tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] 10.222.0.23 "GET /compute/v2.1/servers/b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3" status: 200 len: 1272 microversion: 2.1 time: 0.141468 Sep 10 12:08:30.452322 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2802/5604] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:30 2022] GET /compute/v2.1/servers/b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3 => generated 1272 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:30.735300 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c570920c-1158-4f6c-a8d4-0b457710ccd5 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:30.736120 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c570920c-1158-4f6c-a8d4-0b457710ccd5 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 5f777fb8-adb1-47fd-aced-8b338fa6052e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:30.743812 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c570920c-1158-4f6c-a8d4-0b457710ccd5 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:30.744333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c570920c-1158-4f6c-a8d4-0b457710ccd5 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:30.744771 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c570920c-1158-4f6c-a8d4-0b457710ccd5 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:30.745482 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c570920c-1158-4f6c-a8d4-0b457710ccd5 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:30.745936 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c570920c-1158-4f6c-a8d4-0b457710ccd5 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:30.746544 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c570920c-1158-4f6c-a8d4-0b457710ccd5 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:30.949525 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c570920c-1158-4f6c-a8d4-0b457710ccd5 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:30.958489 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c570920c-1158-4f6c-a8d4-0b457710ccd5 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e" status: 200 len: 1366 microversion: 2.1 time: 0.228177 Sep 10 12:08:30.975350 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2803/5605] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:30 2022] GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:31.227019 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-49613caf-74ee-4458-888c-26557e2516b7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:31.228248 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-49613caf-74ee-4458-888c-26557e2516b7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: b161d8f6-56f1-472a-99bd-f05c1431efac] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:31.236047 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-49613caf-74ee-4458-888c-26557e2516b7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:31.236795 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-49613caf-74ee-4458-888c-26557e2516b7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:31.237394 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-49613caf-74ee-4458-888c-26557e2516b7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:31.238674 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-49613caf-74ee-4458-888c-26557e2516b7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:31.239899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-49613caf-74ee-4458-888c-26557e2516b7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:31.240679 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-49613caf-74ee-4458-888c-26557e2516b7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:31.256162 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-49613caf-74ee-4458-888c-26557e2516b7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] HTTP exception thrown: Instance b161d8f6-56f1-472a-99bd-f05c1431efac could not be found. Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-49613caf-74ee-4458-888c-26557e2516b7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Request method failure captured: Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac HTTP/1.1 Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHvbGvNacfdgMYX0C1NknJJq9YUW5dAORIKr9a4TrFfNiItRSkWndeAJm51SFO_cJls_yRa1COZxQcBgB_PB3er0wolcL9nuODxO-4gh3bsdBy7gHemAEX8Q3MA6WCbAN3U14zQhI8ymqbFJWvUom1mViWhPQ5y3ASbmVvOZSfPd2oE Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 2410f9544bec4633988e1554111c9446 Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServerActionsTestJSON-1996815151 Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2410f9544bec4633988e1554111c9446"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2410f9544bec4633988e1554111c9446"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2410f9544bec4633988e1554111c9446", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2410f9544bec4633988e1554111c9446"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServerActionsTestJSON-1996815151 Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 2410f9544bec4633988e1554111c9446 Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServerActionsTestJSON-1996815151 Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServerActionsTestJSON-1996815151-project Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 8954f3256ddd49639ea57a9242a296d0 Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServerActionsTestJSON-1996815151-project Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance b161d8f6-56f1-472a-99bd-f05c1431efac could not be found. Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'b161d8f6-56f1-472a-99bd-f05c1431efac'} Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b161d8f6-56f1-472a-99bd-f05c1431efac could not be found. Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b161d8f6-56f1-472a-99bd-f05c1431efac could not be found. Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:08:31.258082 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:08:31.262650 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:08:31.262650 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:08:31.262650 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:08:31.262650 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:08:31.262650 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:08:31.262650 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b161d8f6-56f1-472a-99bd-f05c1431efac could not be found. Sep 10 12:08:31.262650 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:08:31.268469 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-49613caf-74ee-4458-888c-26557e2516b7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Returning 404 to user: Instance b161d8f6-56f1-472a-99bd-f05c1431efac could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:08:31.270452 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-49613caf-74ee-4458-888c-26557e2516b7 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac" status: 404 len: 111 microversion: 2.1 time: 0.048198 Sep 10 12:08:31.274708 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2803/5606] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:31 2022] GET /compute/v2.1/servers/b161d8f6-56f1-472a-99bd-f05c1431efac => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:08:31.280106 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2750eedb-1c7d-4e5c-8105-8255e1887e3a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:31.280695 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2750eedb-1c7d-4e5c-8105-8255e1887e3a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: d40780fb-43a4-47fa-821d-a2a69413ee0b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:31.296505 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2750eedb-1c7d-4e5c-8105-8255e1887e3a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:31.297281 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2750eedb-1c7d-4e5c-8105-8255e1887e3a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:31.297919 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2750eedb-1c7d-4e5c-8105-8255e1887e3a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:31.298805 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2750eedb-1c7d-4e5c-8105-8255e1887e3a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:31.299453 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2750eedb-1c7d-4e5c-8105-8255e1887e3a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:31.300045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2750eedb-1c7d-4e5c-8105-8255e1887e3a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:31.307929 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:08:31.392146 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2750eedb-1c7d-4e5c-8105-8255e1887e3a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: d40780fb-43a4-47fa-821d-a2a69413ee0b] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:08:31.475392 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-428de1df-c297-4e95-a865-da561edb7023 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:31.480000 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-428de1df-c297-4e95-a865-da561edb7023 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] [instance: b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:31.496624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-428de1df-c297-4e95-a865-da561edb7023 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:31.497260 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-428de1df-c297-4e95-a865-da561edb7023 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:31.497720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-428de1df-c297-4e95-a865-da561edb7023 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:31.498444 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-428de1df-c297-4e95-a865-da561edb7023 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:31.498899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-428de1df-c297-4e95-a865-da561edb7023 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:31.499357 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-428de1df-c297-4e95-a865-da561edb7023 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:31.597780 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2750eedb-1c7d-4e5c-8105-8255e1887e3a tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b" status: 204 len: 0 microversion: 2.1 time: 0.321584 Sep 10 12:08:31.598795 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2804/5607] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:08:31 2022] DELETE /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:08:31.608473 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9b66c400-88c4-4780-ad0f-09cadc1155a8 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:31.609287 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9b66c400-88c4-4780-ad0f-09cadc1155a8 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: d40780fb-43a4-47fa-821d-a2a69413ee0b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:31.627475 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9b66c400-88c4-4780-ad0f-09cadc1155a8 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:31.628347 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9b66c400-88c4-4780-ad0f-09cadc1155a8 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:31.630262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9b66c400-88c4-4780-ad0f-09cadc1155a8 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:31.631259 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9b66c400-88c4-4780-ad0f-09cadc1155a8 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:31.632187 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9b66c400-88c4-4780-ad0f-09cadc1155a8 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:31.632863 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9b66c400-88c4-4780-ad0f-09cadc1155a8 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:32.510913 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9b66c400-88c4-4780-ad0f-09cadc1155a8 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:32.520406 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9b66c400-88c4-4780-ad0f-09cadc1155a8 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b" status: 200 len: 1494 microversion: 2.1 time: 0.916413 Sep 10 12:08:32.527076 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2805/5608] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:31 2022] GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b => generated 1494 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:08:32.537449 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d106cc17-6bab-4db8-86ff-45caf0870dc3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:32.543909 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d106cc17-6bab-4db8-86ff-45caf0870dc3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 5f777fb8-adb1-47fd-aced-8b338fa6052e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:32.559812 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d106cc17-6bab-4db8-86ff-45caf0870dc3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:32.560849 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d106cc17-6bab-4db8-86ff-45caf0870dc3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:32.562787 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d106cc17-6bab-4db8-86ff-45caf0870dc3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:32.565310 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d106cc17-6bab-4db8-86ff-45caf0870dc3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:32.567544 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d106cc17-6bab-4db8-86ff-45caf0870dc3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:32.568716 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d106cc17-6bab-4db8-86ff-45caf0870dc3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:32.598878 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-428de1df-c297-4e95-a865-da561edb7023 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f17689334f524764820a7d4cd944641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e93992bf3f458ba21e305e747f0075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:32.609776 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-428de1df-c297-4e95-a865-da561edb7023 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] 10.222.0.23 "GET /compute/v2.1/servers/b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3" status: 200 len: 1314 microversion: 2.1 time: 1.139361 Sep 10 12:08:32.612168 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2804/5609] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:31 2022] GET /compute/v2.1/servers/b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3 => generated 1314 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:32.634252 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-d5cedbd3-44f1-4d64-b3cb-961a7494e6ec req-da27d508-8374-42db-a224-4b9846c8612c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f777fb8-adb1-47fd-aced-8b338fa6052e", "name": "network-vif-plugged", "status": "completed", "tag": "609fd4e8-589c-4be1-9346-b197c8445b70"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:08:32.664819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d5cedbd3-44f1-4d64-b3cb-961a7494e6ec req-da27d508-8374-42db-a224-4b9846c8612c service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:32.665236 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d5cedbd3-44f1-4d64-b3cb-961a7494e6ec req-da27d508-8374-42db-a224-4b9846c8612c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:32.665672 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d5cedbd3-44f1-4d64-b3cb-961a7494e6ec req-da27d508-8374-42db-a224-4b9846c8612c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:32.699131 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-d5cedbd3-44f1-4d64-b3cb-961a7494e6ec req-da27d508-8374-42db-a224-4b9846c8612c service nova] Creating event network-vif-plugged:609fd4e8-589c-4be1-9346-b197c8445b70 for instance 5f777fb8-adb1-47fd-aced-8b338fa6052e on n-h2-856895-1 Sep 10 12:08:32.715013 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-d5cedbd3-44f1-4d64-b3cb-961a7494e6ec req-da27d508-8374-42db-a224-4b9846c8612c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100781 Sep 10 12:08:32.716342 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2805/5610] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:08:32.981948 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-fc1f0a10-f8ad-4ac6-809f-77c1e7725298 req-bc772760-f361-4c6d-9bce-30e9616e6392 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3", "tag": "a2124c2d-7d6d-485a-97aa-f251c7ea097d"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:08:32.994425 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-fc1f0a10-f8ad-4ac6-809f-77c1e7725298 req-bc772760-f361-4c6d-9bce-30e9616e6392 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:32.995236 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-fc1f0a10-f8ad-4ac6-809f-77c1e7725298 req-bc772760-f361-4c6d-9bce-30e9616e6392 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:32.995946 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-fc1f0a10-f8ad-4ac6-809f-77c1e7725298 req-bc772760-f361-4c6d-9bce-30e9616e6392 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:33.008832 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-fc1f0a10-f8ad-4ac6-809f-77c1e7725298 req-bc772760-f361-4c6d-9bce-30e9616e6392 service nova] Creating event network-changed:a2124c2d-7d6d-485a-97aa-f251c7ea097d for instance b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3 on n-h1-856895-1 Sep 10 12:08:33.016108 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-fc1f0a10-f8ad-4ac6-809f-77c1e7725298 req-bc772760-f361-4c6d-9bce-30e9616e6392 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038296 Sep 10 12:08:33.018411 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2806/5611] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:08:33.225454 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d106cc17-6bab-4db8-86ff-45caf0870dc3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:33.236403 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d106cc17-6bab-4db8-86ff-45caf0870dc3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e" status: 200 len: 1366 microversion: 2.1 time: 0.707999 Sep 10 12:08:33.237008 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2806/5612] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:32 2022] GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e => generated 1366 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:33.556663 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5a971a9e-5573-419d-9714-c24cf87e5947 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:33.557397 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5a971a9e-5573-419d-9714-c24cf87e5947 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: d40780fb-43a4-47fa-821d-a2a69413ee0b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:33.570506 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5a971a9e-5573-419d-9714-c24cf87e5947 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:33.573711 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5a971a9e-5573-419d-9714-c24cf87e5947 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:33.574176 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5a971a9e-5573-419d-9714-c24cf87e5947 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:33.575504 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5a971a9e-5573-419d-9714-c24cf87e5947 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:33.578233 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5a971a9e-5573-419d-9714-c24cf87e5947 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:33.578998 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5a971a9e-5573-419d-9714-c24cf87e5947 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:33.639252 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-32873ff1-0381-4c3c-acad-b22ee312dfbd tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:33.639887 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-32873ff1-0381-4c3c-acad-b22ee312dfbd tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] [instance: b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:33.652688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32873ff1-0381-4c3c-acad-b22ee312dfbd tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:33.655411 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32873ff1-0381-4c3c-acad-b22ee312dfbd tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:33.655874 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32873ff1-0381-4c3c-acad-b22ee312dfbd tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:33.656599 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32873ff1-0381-4c3c-acad-b22ee312dfbd tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:33.657071 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32873ff1-0381-4c3c-acad-b22ee312dfbd tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:33.664219 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32873ff1-0381-4c3c-acad-b22ee312dfbd tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:34.087490 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5a971a9e-5573-419d-9714-c24cf87e5947 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:34.100430 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5a971a9e-5573-419d-9714-c24cf87e5947 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b" status: 200 len: 1494 microversion: 2.1 time: 0.550980 Sep 10 12:08:34.101357 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2807/5613] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:33 2022] GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b => generated 1494 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:34.111716 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-32873ff1-0381-4c3c-acad-b22ee312dfbd tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f17689334f524764820a7d4cd944641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e93992bf3f458ba21e305e747f0075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:34.151521 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-32873ff1-0381-4c3c-acad-b22ee312dfbd tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] 10.222.0.23 "GET /compute/v2.1/servers/b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3" status: 200 len: 1314 microversion: 2.1 time: 0.516770 Sep 10 12:08:34.155890 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2807/5614] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:33 2022] GET /compute/v2.1/servers/b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3 => generated 1314 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:08:34.265297 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ea2923d4-0d09-46e3-bc53-a2fc1babfb89 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:34.266336 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ea2923d4-0d09-46e3-bc53-a2fc1babfb89 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 5f777fb8-adb1-47fd-aced-8b338fa6052e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:34.273708 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea2923d4-0d09-46e3-bc53-a2fc1babfb89 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:34.274547 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea2923d4-0d09-46e3-bc53-a2fc1babfb89 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:34.275217 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea2923d4-0d09-46e3-bc53-a2fc1babfb89 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:34.276208 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea2923d4-0d09-46e3-bc53-a2fc1babfb89 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:34.276880 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea2923d4-0d09-46e3-bc53-a2fc1babfb89 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:34.277515 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea2923d4-0d09-46e3-bc53-a2fc1babfb89 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:34.439349 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-5c49724f-db90-44d3-abf8-ded5309a7b9b req-76e1c711-ec8c-47f7-beb8-fc2a84265056 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d40780fb-43a4-47fa-821d-a2a69413ee0b", "name": "network-vif-deleted", "tag": "00131652-1889-4a1b-b98b-7e9ab46ecfba"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:08:34.452815 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-5c49724f-db90-44d3-abf8-ded5309a7b9b req-76e1c711-ec8c-47f7-beb8-fc2a84265056 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:34.453581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-5c49724f-db90-44d3-abf8-ded5309a7b9b req-76e1c711-ec8c-47f7-beb8-fc2a84265056 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:34.454181 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-5c49724f-db90-44d3-abf8-ded5309a7b9b req-76e1c711-ec8c-47f7-beb8-fc2a84265056 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:34.482854 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-5c49724f-db90-44d3-abf8-ded5309a7b9b req-76e1c711-ec8c-47f7-beb8-fc2a84265056 service nova] Creating event network-vif-deleted:00131652-1889-4a1b-b98b-7e9ab46ecfba for instance d40780fb-43a4-47fa-821d-a2a69413ee0b on n-h1-856895-1 Sep 10 12:08:34.489332 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-5c49724f-db90-44d3-abf8-ded5309a7b9b req-76e1c711-ec8c-47f7-beb8-fc2a84265056 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053046 Sep 10 12:08:34.490116 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2808/5615] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:08:34.626474 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ea2923d4-0d09-46e3-bc53-a2fc1babfb89 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:34.639958 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ea2923d4-0d09-46e3-bc53-a2fc1babfb89 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e" status: 200 len: 1366 microversion: 2.1 time: 0.379083 Sep 10 12:08:34.641122 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2808/5616] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:34 2022] GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e => generated 1366 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:35.128057 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b183c2bf-20ae-4ca5-9abf-f44c0af8eb45 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:35.128763 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b183c2bf-20ae-4ca5-9abf-f44c0af8eb45 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: d40780fb-43a4-47fa-821d-a2a69413ee0b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:35.142394 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b183c2bf-20ae-4ca5-9abf-f44c0af8eb45 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:35.143130 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b183c2bf-20ae-4ca5-9abf-f44c0af8eb45 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:35.144748 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b183c2bf-20ae-4ca5-9abf-f44c0af8eb45 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:35.146387 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b183c2bf-20ae-4ca5-9abf-f44c0af8eb45 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:35.147013 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b183c2bf-20ae-4ca5-9abf-f44c0af8eb45 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:35.154577 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b183c2bf-20ae-4ca5-9abf-f44c0af8eb45 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:35.178572 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a8bfa095-4cbb-4c7a-91fc-9495be19179a tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:35.179268 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a8bfa095-4cbb-4c7a-91fc-9495be19179a tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] [instance: b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:35.198294 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8bfa095-4cbb-4c7a-91fc-9495be19179a tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:35.198924 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8bfa095-4cbb-4c7a-91fc-9495be19179a tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:35.199593 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8bfa095-4cbb-4c7a-91fc-9495be19179a tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:35.200548 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8bfa095-4cbb-4c7a-91fc-9495be19179a tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:35.201118 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8bfa095-4cbb-4c7a-91fc-9495be19179a tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:35.201806 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8bfa095-4cbb-4c7a-91fc-9495be19179a tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:35.308389 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b183c2bf-20ae-4ca5-9abf-f44c0af8eb45 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:35.321079 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b183c2bf-20ae-4ca5-9abf-f44c0af8eb45 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b" status: 200 len: 1452 microversion: 2.1 time: 0.198697 Sep 10 12:08:35.342333 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2809/5617] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:35 2022] GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b => generated 1452 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:35.545615 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a8bfa095-4cbb-4c7a-91fc-9495be19179a tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f17689334f524764820a7d4cd944641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e93992bf3f458ba21e305e747f0075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:35.554240 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:UPDATE=11,nova_cell1:DELETE=2,nova_cell1:SELECT=86,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:08:35.560613 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a8bfa095-4cbb-4c7a-91fc-9495be19179a tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] 10.222.0.23 "GET /compute/v2.1/servers/b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3" status: 200 len: 1314 microversion: 2.1 time: 0.385911 Sep 10 12:08:35.574934 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2809/5618] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:35 2022] GET /compute/v2.1/servers/b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3 => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:08:35.665624 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9f4e2ef6-105c-4de4-b7fd-4b540f74103f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:35.666984 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9f4e2ef6-105c-4de4-b7fd-4b540f74103f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 5f777fb8-adb1-47fd-aced-8b338fa6052e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:35.682349 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9f4e2ef6-105c-4de4-b7fd-4b540f74103f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:35.686874 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9f4e2ef6-105c-4de4-b7fd-4b540f74103f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:35.688751 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9f4e2ef6-105c-4de4-b7fd-4b540f74103f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:35.690123 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9f4e2ef6-105c-4de4-b7fd-4b540f74103f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:35.690896 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9f4e2ef6-105c-4de4-b7fd-4b540f74103f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:35.692219 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9f4e2ef6-105c-4de4-b7fd-4b540f74103f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:36.244295 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9f4e2ef6-105c-4de4-b7fd-4b540f74103f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:36.254308 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9f4e2ef6-105c-4de4-b7fd-4b540f74103f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e" status: 200 len: 1556 microversion: 2.1 time: 0.592435 Sep 10 12:08:36.254919 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2810/5619] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:35 2022] GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e => generated 1556 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:36.289950 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-41d35fd1-c459-4932-9030-8e7d72a08ca9 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:36.290960 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-41d35fd1-c459-4932-9030-8e7d72a08ca9 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 5f777fb8-adb1-47fd-aced-8b338fa6052e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:36.311517 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41d35fd1-c459-4932-9030-8e7d72a08ca9 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:36.312211 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41d35fd1-c459-4932-9030-8e7d72a08ca9 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:36.312949 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41d35fd1-c459-4932-9030-8e7d72a08ca9 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:36.313996 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41d35fd1-c459-4932-9030-8e7d72a08ca9 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:36.315059 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41d35fd1-c459-4932-9030-8e7d72a08ca9 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:36.318992 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41d35fd1-c459-4932-9030-8e7d72a08ca9 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:36.349165 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-87aedf4d-4f7e-4a0f-85ea-05f5ef67b254 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:36.349890 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-87aedf4d-4f7e-4a0f-85ea-05f5ef67b254 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: d40780fb-43a4-47fa-821d-a2a69413ee0b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:36.361758 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87aedf4d-4f7e-4a0f-85ea-05f5ef67b254 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:36.371034 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87aedf4d-4f7e-4a0f-85ea-05f5ef67b254 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:36.371516 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87aedf4d-4f7e-4a0f-85ea-05f5ef67b254 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:36.372270 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87aedf4d-4f7e-4a0f-85ea-05f5ef67b254 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:36.372733 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87aedf4d-4f7e-4a0f-85ea-05f5ef67b254 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:36.373165 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87aedf4d-4f7e-4a0f-85ea-05f5ef67b254 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:36.443355 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87aedf4d-4f7e-4a0f-85ea-05f5ef67b254 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:36.444115 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87aedf4d-4f7e-4a0f-85ea-05f5ef67b254 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:36.444749 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87aedf4d-4f7e-4a0f-85ea-05f5ef67b254 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:36.445363 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-87aedf4d-4f7e-4a0f-85ea-05f5ef67b254 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lazy-loading 'fault' on Instance uuid d40780fb-43a4-47fa-821d-a2a69413ee0b {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:08:36.644101 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-87aedf4d-4f7e-4a0f-85ea-05f5ef67b254 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:36.651114 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-41d35fd1-c459-4932-9030-8e7d72a08ca9 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.375768 Sep 10 12:08:36.651895 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2810/5620] 10.222.0.23 () {58 vars in 1275 bytes} [Sat Sep 10 12:08:36 2022] GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e/os-interface => generated 284 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:08:36.663054 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-60358ba8-e9dd-4aeb-87d2-27cbbf4e5e9b tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:36.663941 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-60358ba8-e9dd-4aeb-87d2-27cbbf4e5e9b tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] [instance: b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:36.667827 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-87aedf4d-4f7e-4a0f-85ea-05f5ef67b254 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b" status: 200 len: 1304 microversion: 2.1 time: 0.322479 Sep 10 12:08:36.669176 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2811/5621] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:36 2022] GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b => generated 1304 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:36.670743 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60358ba8-e9dd-4aeb-87d2-27cbbf4e5e9b tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:36.671287 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60358ba8-e9dd-4aeb-87d2-27cbbf4e5e9b tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:36.671739 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60358ba8-e9dd-4aeb-87d2-27cbbf4e5e9b tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:36.672456 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60358ba8-e9dd-4aeb-87d2-27cbbf4e5e9b tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:36.672922 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60358ba8-e9dd-4aeb-87d2-27cbbf4e5e9b tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:36.673357 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60358ba8-e9dd-4aeb-87d2-27cbbf4e5e9b tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:36.689065 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:08:36.709582 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:08:37.268432 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-60358ba8-e9dd-4aeb-87d2-27cbbf4e5e9b tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f17689334f524764820a7d4cd944641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e93992bf3f458ba21e305e747f0075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:37.283447 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-60358ba8-e9dd-4aeb-87d2-27cbbf4e5e9b tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] 10.222.0.23 "GET /compute/v2.1/servers/b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3" status: 200 len: 1314 microversion: 2.1 time: 0.626138 Sep 10 12:08:37.285427 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2811/5622] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:36 2022] GET /compute/v2.1/servers/b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3 => generated 1314 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:37.697711 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-332a62ee-b013-4313-92d3-1772bb68d67f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:37.699792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-332a62ee-b013-4313-92d3-1772bb68d67f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: d40780fb-43a4-47fa-821d-a2a69413ee0b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:37.703832 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=14 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:08:37.718623 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-332a62ee-b013-4313-92d3-1772bb68d67f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:37.720423 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-332a62ee-b013-4313-92d3-1772bb68d67f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:37.721779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-332a62ee-b013-4313-92d3-1772bb68d67f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:37.725282 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-332a62ee-b013-4313-92d3-1772bb68d67f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:37.726442 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-332a62ee-b013-4313-92d3-1772bb68d67f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:37.728730 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-332a62ee-b013-4313-92d3-1772bb68d67f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:37.754418 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-332a62ee-b013-4313-92d3-1772bb68d67f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] HTTP exception thrown: Instance d40780fb-43a4-47fa-821d-a2a69413ee0b could not be found. Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-332a62ee-b013-4313-92d3-1772bb68d67f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Request method failure captured: Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b HTTP/1.1 Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHHvbGvNacfdgMYX0C1NknJJq9YUW5dAORIKr9a4TrFfNiItRSkWndeAJm51SFO_cJls_yRa1COZxQcBgB_PB3er0wolcL9nuODxO-4gh3bsdBy7gHemAEX8Q3MA6WCbAN3U14zQhI8ymqbFJWvUom1mViWhPQ5y3ASbmVvOZSfPd2oE Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 2410f9544bec4633988e1554111c9446 Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServerActionsTestJSON-1996815151 Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2410f9544bec4633988e1554111c9446"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2410f9544bec4633988e1554111c9446"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2410f9544bec4633988e1554111c9446", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2410f9544bec4633988e1554111c9446"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServerActionsTestJSON-1996815151 Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 2410f9544bec4633988e1554111c9446 Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServerActionsTestJSON-1996815151 Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServerActionsTestJSON-1996815151-project Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 8954f3256ddd49639ea57a9242a296d0 Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServerActionsTestJSON-1996815151-project Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance d40780fb-43a4-47fa-821d-a2a69413ee0b could not be found. Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'd40780fb-43a4-47fa-821d-a2a69413ee0b'} Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d40780fb-43a4-47fa-821d-a2a69413ee0b could not be found. Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d40780fb-43a4-47fa-821d-a2a69413ee0b could not be found. Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:08:37.757096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:08:37.761250 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:08:37.761250 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:08:37.761250 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:08:37.761250 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:08:37.761250 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:08:37.761250 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d40780fb-43a4-47fa-821d-a2a69413ee0b could not be found. Sep 10 12:08:37.761250 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:08:37.763197 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-332a62ee-b013-4313-92d3-1772bb68d67f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Returning 404 to user: Instance d40780fb-43a4-47fa-821d-a2a69413ee0b could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:08:37.764607 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-332a62ee-b013-4313-92d3-1772bb68d67f tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b" status: 404 len: 111 microversion: 2.1 time: 0.073157 Sep 10 12:08:37.766073 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2812/5623] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:37 2022] GET /compute/v2.1/servers/d40780fb-43a4-47fa-821d-a2a69413ee0b => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:08:37.777647 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c1e8c114-739c-4474-8fcb-0fb659395c17 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:37.778366 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c1e8c114-739c-4474-8fcb-0fb659395c17 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:37.795141 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1e8c114-739c-4474-8fcb-0fb659395c17 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:37.795680 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1e8c114-739c-4474-8fcb-0fb659395c17 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:37.799866 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1e8c114-739c-4474-8fcb-0fb659395c17 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:37.803377 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1e8c114-739c-4474-8fcb-0fb659395c17 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:37.804131 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1e8c114-739c-4474-8fcb-0fb659395c17 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:37.804765 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1e8c114-739c-4474-8fcb-0fb659395c17 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:37.850729 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c1e8c114-739c-4474-8fcb-0fb659395c17 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:08:38.045032 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c1e8c114-739c-4474-8fcb-0fb659395c17 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "DELETE /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 204 len: 0 microversion: 2.1 time: 0.271691 Sep 10 12:08:38.046243 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2812/5624] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:08:37 2022] DELETE /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:08:38.056709 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7fdda0e0-aebf-462f-8eec-b9f13423e693 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:38.057345 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7fdda0e0-aebf-462f-8eec-b9f13423e693 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:38.068460 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7fdda0e0-aebf-462f-8eec-b9f13423e693 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:38.069645 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7fdda0e0-aebf-462f-8eec-b9f13423e693 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:38.070543 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7fdda0e0-aebf-462f-8eec-b9f13423e693 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:38.071834 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7fdda0e0-aebf-462f-8eec-b9f13423e693 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:38.072461 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7fdda0e0-aebf-462f-8eec-b9f13423e693 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:38.073059 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7fdda0e0-aebf-462f-8eec-b9f13423e693 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:38.316698 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-447fa499-1cf0-49f4-ad8e-6f4906f8f896 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:38.319205 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-447fa499-1cf0-49f4-ad8e-6f4906f8f896 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] [instance: b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:38.345768 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-447fa499-1cf0-49f4-ad8e-6f4906f8f896 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:38.350256 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-447fa499-1cf0-49f4-ad8e-6f4906f8f896 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:38.350919 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7fdda0e0-aebf-462f-8eec-b9f13423e693 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:38.351596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-447fa499-1cf0-49f4-ad8e-6f4906f8f896 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:38.352615 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-447fa499-1cf0-49f4-ad8e-6f4906f8f896 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:38.353326 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-447fa499-1cf0-49f4-ad8e-6f4906f8f896 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:38.354366 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-447fa499-1cf0-49f4-ad8e-6f4906f8f896 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:38.361478 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7fdda0e0-aebf-462f-8eec-b9f13423e693 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1678 microversion: 2.1 time: 0.309080 Sep 10 12:08:38.362083 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2813/5625] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:38 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1678 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:38.645346 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-447fa499-1cf0-49f4-ad8e-6f4906f8f896 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f17689334f524764820a7d4cd944641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e93992bf3f458ba21e305e747f0075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:38.656492 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-447fa499-1cf0-49f4-ad8e-6f4906f8f896 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] 10.222.0.23 "GET /compute/v2.1/servers/b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3" status: 200 len: 1314 microversion: 2.1 time: 0.346833 Sep 10 12:08:38.659005 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2813/5626] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:38 2022] GET /compute/v2.1/servers/b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3 => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:38.861118 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-9ea91280-93ac-4161-8454-a5116bed1155 req-31fa68a0-2353-488e-a185-081bbe345e3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f777fb8-adb1-47fd-aced-8b338fa6052e", "tag": "609fd4e8-589c-4be1-9346-b197c8445b70"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:08:38.874002 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-9ea91280-93ac-4161-8454-a5116bed1155 req-31fa68a0-2353-488e-a185-081bbe345e3b service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:38.874715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-9ea91280-93ac-4161-8454-a5116bed1155 req-31fa68a0-2353-488e-a185-081bbe345e3b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:38.889508 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-9ea91280-93ac-4161-8454-a5116bed1155 req-31fa68a0-2353-488e-a185-081bbe345e3b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:38.906989 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-9ea91280-93ac-4161-8454-a5116bed1155 req-31fa68a0-2353-488e-a185-081bbe345e3b service nova] Creating event network-changed:609fd4e8-589c-4be1-9346-b197c8445b70 for instance 5f777fb8-adb1-47fd-aced-8b338fa6052e on n-h2-856895-1 Sep 10 12:08:38.913321 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-9ea91280-93ac-4161-8454-a5116bed1155 req-31fa68a0-2353-488e-a185-081bbe345e3b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058936 Sep 10 12:08:38.914582 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2814/5627] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:08:39.386333 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-056ec3cb-6f45-4f2b-ad20-729626142999 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:39.387672 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-056ec3cb-6f45-4f2b-ad20-729626142999 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:39.424638 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-056ec3cb-6f45-4f2b-ad20-729626142999 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:39.425470 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-056ec3cb-6f45-4f2b-ad20-729626142999 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:39.429144 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-056ec3cb-6f45-4f2b-ad20-729626142999 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:39.431561 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-056ec3cb-6f45-4f2b-ad20-729626142999 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:39.435880 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-056ec3cb-6f45-4f2b-ad20-729626142999 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:39.438031 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-056ec3cb-6f45-4f2b-ad20-729626142999 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:39.687376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9246ad79-cda8-45d7-add7-13ce38ed8c39 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:39.688411 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9246ad79-cda8-45d7-add7-13ce38ed8c39 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] [instance: b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:39.705804 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9246ad79-cda8-45d7-add7-13ce38ed8c39 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:39.707193 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9246ad79-cda8-45d7-add7-13ce38ed8c39 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:39.710108 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9246ad79-cda8-45d7-add7-13ce38ed8c39 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:39.711083 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9246ad79-cda8-45d7-add7-13ce38ed8c39 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:39.711751 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9246ad79-cda8-45d7-add7-13ce38ed8c39 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:39.712417 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9246ad79-cda8-45d7-add7-13ce38ed8c39 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:40.833917 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-056ec3cb-6f45-4f2b-ad20-729626142999 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:40.839063 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9246ad79-cda8-45d7-add7-13ce38ed8c39 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f17689334f524764820a7d4cd944641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e93992bf3f458ba21e305e747f0075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:40.844621 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-056ec3cb-6f45-4f2b-ad20-729626142999 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1678 microversion: 2.1 time: 1.462970 Sep 10 12:08:40.845223 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2814/5628] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:39 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1678 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:40.854236 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9246ad79-cda8-45d7-add7-13ce38ed8c39 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] 10.222.0.23 "GET /compute/v2.1/servers/b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3" status: 200 len: 1314 microversion: 2.1 time: 1.173409 Sep 10 12:08:40.874741 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2815/5629] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:39 2022] GET /compute/v2.1/servers/b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3 => generated 1314 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:41.049473 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-397e3184-3f34-453e-bd94-db68f69ae6aa req-628748fe-f20a-4693-89d2-fe177a59062c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3", "name": "network-vif-plugged", "status": "completed", "tag": "a2124c2d-7d6d-485a-97aa-f251c7ea097d"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:08:41.059301 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-397e3184-3f34-453e-bd94-db68f69ae6aa req-628748fe-f20a-4693-89d2-fe177a59062c service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:41.060036 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-397e3184-3f34-453e-bd94-db68f69ae6aa req-628748fe-f20a-4693-89d2-fe177a59062c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:41.060627 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-397e3184-3f34-453e-bd94-db68f69ae6aa req-628748fe-f20a-4693-89d2-fe177a59062c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:41.082249 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-397e3184-3f34-453e-bd94-db68f69ae6aa req-628748fe-f20a-4693-89d2-fe177a59062c service nova] Creating event network-vif-plugged:a2124c2d-7d6d-485a-97aa-f251c7ea097d for instance b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3 on n-h1-856895-1 Sep 10 12:08:41.110527 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-397e3184-3f34-453e-bd94-db68f69ae6aa req-628748fe-f20a-4693-89d2-fe177a59062c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064776 Sep 10 12:08:41.111539 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2815/5630] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:08:41.875762 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d1fac286-3911-4924-bdb6-26a400002a96 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:41.879560 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d1fac286-3911-4924-bdb6-26a400002a96 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:41.885740 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9601522d-9767-480c-a087-b9664a29fdcb tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:41.886546 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9601522d-9767-480c-a087-b9664a29fdcb tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] [instance: b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:41.893579 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1fac286-3911-4924-bdb6-26a400002a96 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:41.894980 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1fac286-3911-4924-bdb6-26a400002a96 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:41.895651 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1fac286-3911-4924-bdb6-26a400002a96 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:41.899447 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9601522d-9767-480c-a087-b9664a29fdcb tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:41.900681 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1fac286-3911-4924-bdb6-26a400002a96 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:41.901179 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1fac286-3911-4924-bdb6-26a400002a96 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:41.901629 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1fac286-3911-4924-bdb6-26a400002a96 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:41.904901 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9601522d-9767-480c-a087-b9664a29fdcb tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:41.911503 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9601522d-9767-480c-a087-b9664a29fdcb tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:41.912844 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9601522d-9767-480c-a087-b9664a29fdcb tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:41.915439 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9601522d-9767-480c-a087-b9664a29fdcb tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:41.916291 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9601522d-9767-480c-a087-b9664a29fdcb tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:42.138424 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d1fac286-3911-4924-bdb6-26a400002a96 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:42.167213 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d1fac286-3911-4924-bdb6-26a400002a96 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1610 microversion: 2.1 time: 0.296518 Sep 10 12:08:42.168248 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2816/5631] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:41 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1610 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:42.325906 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-7dd8cc7b-5c1c-4286-a51c-cc08c94fbdb1 req-a357a27c-78bf-4c36-b192-572d103f7fa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64704ff7-229d-478b-9889-6b6cba53bd0f", "name": "network-vif-deleted", "tag": "7f6388a0-8fe7-4ee5-821e-68c4889b9594"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:08:42.345950 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-7dd8cc7b-5c1c-4286-a51c-cc08c94fbdb1 req-a357a27c-78bf-4c36-b192-572d103f7fa4 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:42.346657 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-7dd8cc7b-5c1c-4286-a51c-cc08c94fbdb1 req-a357a27c-78bf-4c36-b192-572d103f7fa4 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:42.348109 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-7dd8cc7b-5c1c-4286-a51c-cc08c94fbdb1 req-a357a27c-78bf-4c36-b192-572d103f7fa4 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:42.365897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9601522d-9767-480c-a087-b9664a29fdcb tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f17689334f524764820a7d4cd944641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e93992bf3f458ba21e305e747f0075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:42.369534 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-7dd8cc7b-5c1c-4286-a51c-cc08c94fbdb1 req-a357a27c-78bf-4c36-b192-572d103f7fa4 service nova] Creating event network-vif-deleted:7f6388a0-8fe7-4ee5-821e-68c4889b9594 for instance 64704ff7-229d-478b-9889-6b6cba53bd0f on n-h1-856895-1 Sep 10 12:08:42.374156 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9601522d-9767-480c-a087-b9664a29fdcb tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] 10.222.0.23 "GET /compute/v2.1/servers/b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3" status: 200 len: 1314 microversion: 2.1 time: 0.496342 Sep 10 12:08:42.382724 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-7dd8cc7b-5c1c-4286-a51c-cc08c94fbdb1 req-a357a27c-78bf-4c36-b192-572d103f7fa4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060340 Sep 10 12:08:42.388081 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2817/5632] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:08:42.395078 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2816/5633] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:41 2022] GET /compute/v2.1/servers/b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3 => generated 1314 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:43.062641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-56babe15-dd95-4be7-91bf-6c5bdf36afb7 tempest-TestAggregatesBasicOps-740064460 tempest-TestAggregatesBasicOps-740064460-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-296198744", "availability_zone": "foo_zone"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:08:43.070486 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.aggregate [None req-56babe15-dd95-4be7-91bf-6c5bdf36afb7 tempest-TestAggregatesBasicOps-740064460 tempest-TestAggregatesBasicOps-740064460-project-admin] Generated uuid 7cc7a6bb-831a-4ffd-bb26-defa3c232dfe for aggregate {{(pid=128777) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 10 12:08:43.145802 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-56babe15-dd95-4be7-91bf-6c5bdf36afb7 tempest-TestAggregatesBasicOps-740064460 tempest-TestAggregatesBasicOps-740064460-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.420791 Sep 10 12:08:43.146774 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2818/5634] 10.222.0.23 () {60 vars in 1164 bytes} [Sat Sep 10 12:08:42 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:08:43.158535 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8e105240-57cc-41a7-8994-c114ee80425d tempest-TestAggregatesBasicOps-740064460 tempest-TestAggregatesBasicOps-740064460-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:08:43.200989 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b073d8ad-04ca-4151-8da3-712ffc3d6b29 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:43.203837 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8e105240-57cc-41a7-8994-c114ee80425d tempest-TestAggregatesBasicOps-740064460 tempest-TestAggregatesBasicOps-740064460-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.041141 Sep 10 12:08:43.205614 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2817/5635] 10.222.0.23 () {60 vars in 1194 bytes} [Sat Sep 10 12:08:43 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:08:43.209942 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b073d8ad-04ca-4151-8da3-712ffc3d6b29 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:43.217545 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0aa897f0-2b1a-44f4-8560-fea7ceafcbd3 tempest-TestAggregatesBasicOps-740064460 tempest-TestAggregatesBasicOps-740064460-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:43.218860 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b073d8ad-04ca-4151-8da3-712ffc3d6b29 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:43.219663 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b073d8ad-04ca-4151-8da3-712ffc3d6b29 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:43.220618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b073d8ad-04ca-4151-8da3-712ffc3d6b29 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:43.224007 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b073d8ad-04ca-4151-8da3-712ffc3d6b29 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:43.224789 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b073d8ad-04ca-4151-8da3-712ffc3d6b29 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:43.226160 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b073d8ad-04ca-4151-8da3-712ffc3d6b29 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:43.228375 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0aa897f0-2b1a-44f4-8560-fea7ceafcbd3 tempest-TestAggregatesBasicOps-740064460 tempest-TestAggregatesBasicOps-740064460-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:43.231101 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0aa897f0-2b1a-44f4-8560-fea7ceafcbd3 tempest-TestAggregatesBasicOps-740064460 tempest-TestAggregatesBasicOps-740064460-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:43.231786 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0aa897f0-2b1a-44f4-8560-fea7ceafcbd3 tempest-TestAggregatesBasicOps-740064460 tempest-TestAggregatesBasicOps-740064460-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:43.234966 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0aa897f0-2b1a-44f4-8560-fea7ceafcbd3 tempest-TestAggregatesBasicOps-740064460 tempest-TestAggregatesBasicOps-740064460-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:43.236962 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0aa897f0-2b1a-44f4-8560-fea7ceafcbd3 tempest-TestAggregatesBasicOps-740064460 tempest-TestAggregatesBasicOps-740064460-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:43.237446 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0aa897f0-2b1a-44f4-8560-fea7ceafcbd3 tempest-TestAggregatesBasicOps-740064460 tempest-TestAggregatesBasicOps-740064460-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:43.292472 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b073d8ad-04ca-4151-8da3-712ffc3d6b29 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:43.292868 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b073d8ad-04ca-4151-8da3-712ffc3d6b29 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:43.293538 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b073d8ad-04ca-4151-8da3-712ffc3d6b29 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:43.294195 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-b073d8ad-04ca-4151-8da3-712ffc3d6b29 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lazy-loading 'fault' on Instance uuid 64704ff7-229d-478b-9889-6b6cba53bd0f {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:08:43.297460 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0aa897f0-2b1a-44f4-8560-fea7ceafcbd3 tempest-TestAggregatesBasicOps-740064460 tempest-TestAggregatesBasicOps-740064460-project-admin] 10.222.0.23 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.083841 Sep 10 12:08:43.298223 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2818/5636] 10.222.0.23 () {58 vars in 1176 bytes} [Sat Sep 10 12:08:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:08:43.323797 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3c597be0-f4c5-4dd9-a01d-ca86dc618b61 tempest-TestAggregatesBasicOps-740064460 tempest-TestAggregatesBasicOps-740064460-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:43.337076 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=4 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:08:43.355499 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b073d8ad-04ca-4151-8da3-712ffc3d6b29 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8954f3256ddd49639ea57a9242a296d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2410f9544bec4633988e1554111c9446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:43.356507 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3c597be0-f4c5-4dd9-a01d-ca86dc618b61 tempest-TestAggregatesBasicOps-740064460 tempest-TestAggregatesBasicOps-740064460-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.035857 Sep 10 12:08:43.357172 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2819/5637] 10.222.0.23 () {58 vars in 1143 bytes} [Sat Sep 10 12:08:43 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:08:43.370204 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1c8fe2ef-cc0c-40fa-b1ae-6692acab4733 tempest-TestAggregatesBasicOps-740064460 tempest-TestAggregatesBasicOps-740064460-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-856895-1"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:08:43.380234 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b073d8ad-04ca-4151-8da3-712ffc3d6b29 tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 200 len: 1329 microversion: 2.1 time: 0.190037 Sep 10 12:08:43.382875 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2819/5638] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:43 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 1329 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:08:43.402653 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b6cd401d-d761-43d9-bbef-f849cdd02c6b tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:43.404636 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b6cd401d-d761-43d9-bbef-f849cdd02c6b tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] [instance: b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:43.405105 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1c8fe2ef-cc0c-40fa-b1ae-6692acab4733 tempest-TestAggregatesBasicOps-740064460 tempest-TestAggregatesBasicOps-740064460-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:43.406326 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1c8fe2ef-cc0c-40fa-b1ae-6692acab4733 tempest-TestAggregatesBasicOps-740064460 tempest-TestAggregatesBasicOps-740064460-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:43.407100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1c8fe2ef-cc0c-40fa-b1ae-6692acab4733 tempest-TestAggregatesBasicOps-740064460 tempest-TestAggregatesBasicOps-740064460-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:43.434647 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b6cd401d-d761-43d9-bbef-f849cdd02c6b tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:43.435750 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b6cd401d-d761-43d9-bbef-f849cdd02c6b tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:43.436847 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b6cd401d-d761-43d9-bbef-f849cdd02c6b tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:43.438369 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b6cd401d-d761-43d9-bbef-f849cdd02c6b tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:43.439402 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b6cd401d-d761-43d9-bbef-f849cdd02c6b tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:43.440207 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b6cd401d-d761-43d9-bbef-f849cdd02c6b tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:43.660945 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1c8fe2ef-cc0c-40fa-b1ae-6692acab4733 tempest-TestAggregatesBasicOps-740064460 tempest-TestAggregatesBasicOps-740064460-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.295414 Sep 10 12:08:43.661449 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b6cd401d-d761-43d9-bbef-f849cdd02c6b tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f17689334f524764820a7d4cd944641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e93992bf3f458ba21e305e747f0075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:08:43.662090 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2820/5639] 10.222.0.23 () {60 vars in 1194 bytes} [Sat Sep 10 12:08:43 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:08:43.670568 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b6cd401d-d761-43d9-bbef-f849cdd02c6b tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] 10.222.0.23 "GET /compute/v2.1/servers/b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3" status: 200 len: 1462 microversion: 2.1 time: 0.274056 Sep 10 12:08:43.674101 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3ef18253-e292-46e1-abc0-484f09d7799b tempest-TestAggregatesBasicOps-740064460 tempest-TestAggregatesBasicOps-740064460-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:43.684304 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2820/5640] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:43 2022] GET /compute/v2.1/servers/b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3 => generated 1462 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:08:43.690704 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3ef18253-e292-46e1-abc0-484f09d7799b tempest-TestAggregatesBasicOps-740064460 tempest-TestAggregatesBasicOps-740064460-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.019374 Sep 10 12:08:43.691445 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2821/5641] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Sep 10 12:08:43 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:08:43.697315 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a5922617-7491-458f-b581-a46385b98c3f tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18a30d4c-a4d1-416a-954e-1486c0c760b9", "device": "/dev/sdb"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:08:43.700401 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a5922617-7491-458f-b581-a46385b98c3f tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] [instance: b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:43.708025 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a74f0032-90fb-48b1-bb45-e18296c87d4c tempest-TestAggregatesBasicOps-740064460 tempest-TestAggregatesBasicOps-740064460-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-841493226", "availability_zone": "foo_zone"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:08:43.708484 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5922617-7491-458f-b581-a46385b98c3f tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:43.709150 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5922617-7491-458f-b581-a46385b98c3f tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:43.709753 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5922617-7491-458f-b581-a46385b98c3f tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:43.710629 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5922617-7491-458f-b581-a46385b98c3f tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:43.711264 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5922617-7491-458f-b581-a46385b98c3f tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:43.711841 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5922617-7491-458f-b581-a46385b98c3f tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:43.865119 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a74f0032-90fb-48b1-bb45-e18296c87d4c tempest-TestAggregatesBasicOps-740064460 tempest-TestAggregatesBasicOps-740064460-project-admin] 10.222.0.23 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.163166 Sep 10 12:08:43.866717 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2822/5642] 10.222.0.23 () {60 vars in 1173 bytes} [Sat Sep 10 12:08:43 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:08:43.878933 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:08:43.885521 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-da83ac17-a46f-4db4-88c2-546d076a0aa1 tempest-TestAggregatesBasicOps-740064460 tempest-TestAggregatesBasicOps-740064460-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:08:43.916523 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-da83ac17-a46f-4db4-88c2-546d076a0aa1 tempest-TestAggregatesBasicOps-740064460 tempest-TestAggregatesBasicOps-740064460-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.036050 Sep 10 12:08:43.917382 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2823/5643] 10.222.0.23 () {60 vars in 1194 bytes} [Sat Sep 10 12:08:43 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:08:43.936381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cde5757c-0372-4aa5-a4af-e523422aa4b4 tempest-TestAggregatesBasicOps-740064460 tempest-TestAggregatesBasicOps-740064460-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:43.947390 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cde5757c-0372-4aa5-a4af-e523422aa4b4 tempest-TestAggregatesBasicOps-740064460 tempest-TestAggregatesBasicOps-740064460-project-admin] 10.222.0.23 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.014726 Sep 10 12:08:43.948876 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2824/5644] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Sep 10 12:08:43 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:08:43.968223 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-774df159-9860-48ab-be4c-5a0f766f115c tempest-TestAggregatesBasicOps-740064460 tempest-TestAggregatesBasicOps-740064460-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-856895-1"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:08:43.983761 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-774df159-9860-48ab-be4c-5a0f766f115c tempest-TestAggregatesBasicOps-740064460 tempest-TestAggregatesBasicOps-740064460-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:43.984525 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-774df159-9860-48ab-be4c-5a0f766f115c tempest-TestAggregatesBasicOps-740064460 tempest-TestAggregatesBasicOps-740064460-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:43.985437 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-774df159-9860-48ab-be4c-5a0f766f115c tempest-TestAggregatesBasicOps-740064460 tempest-TestAggregatesBasicOps-740064460-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:44.053039 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a5922617-7491-458f-b581-a46385b98c3f tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] 10.222.0.23 "POST /compute/v2.1/servers/b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.347300 Sep 10 12:08:44.054622 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2821/5645] 10.222.0.23 () {60 vars in 1323 bytes} [Sat Sep 10 12:08:43 2022] POST /compute/v2.1/servers/b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3/os-volume_attachments => generated 194 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:08:44.165121 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-774df159-9860-48ab-be4c-5a0f766f115c tempest-TestAggregatesBasicOps-740064460 tempest-TestAggregatesBasicOps-740064460-project-admin] 10.222.0.23 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.202111 Sep 10 12:08:44.167649 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2825/5646] 10.222.0.23 () {60 vars in 1194 bytes} [Sat Sep 10 12:08:43 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:08:44.179815 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4468921c-45b8-401c-b8d2-4c15ae15c629 tempest-TestAggregatesBasicOps-740064460 tempest-TestAggregatesBasicOps-740064460-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:44.193326 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:08:44.210965 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4468921c-45b8-401c-b8d2-4c15ae15c629 tempest-TestAggregatesBasicOps-740064460 tempest-TestAggregatesBasicOps-740064460-project-admin] 10.222.0.23 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.036920 Sep 10 12:08:44.217924 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2822/5647] 10.222.0.23 () {58 vars in 1155 bytes} [Sat Sep 10 12:08:44 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 10 12:08:44.412322 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-48eb61ea-806a-479d-ab8f-77ff37cbb4fd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:44.414560 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-48eb61ea-806a-479d-ab8f-77ff37cbb4fd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] [instance: 64704ff7-229d-478b-9889-6b6cba53bd0f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:08:44.431742 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-48eb61ea-806a-479d-ab8f-77ff37cbb4fd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:44.432559 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-48eb61ea-806a-479d-ab8f-77ff37cbb4fd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:44.433180 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-48eb61ea-806a-479d-ab8f-77ff37cbb4fd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:44.434219 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-48eb61ea-806a-479d-ab8f-77ff37cbb4fd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:08:44.434876 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-48eb61ea-806a-479d-ab8f-77ff37cbb4fd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:08:44.435628 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-48eb61ea-806a-479d-ab8f-77ff37cbb4fd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:08:44.460045 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-48eb61ea-806a-479d-ab8f-77ff37cbb4fd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] HTTP exception thrown: Instance 64704ff7-229d-478b-9889-6b6cba53bd0f could not be found. Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-48eb61ea-806a-479d-ab8f-77ff37cbb4fd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Request method failure captured: Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f HTTP/1.1 Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHHvbGvNacfdgMYX0C1NknJJq9YUW5dAORIKr9a4TrFfNiItRSkWndeAJm51SFO_cJls_yRa1COZxQcBgB_PB3er0wolcL9nuODxO-4gh3bsdBy7gHemAEX8Q3MA6WCbAN3U14zQhI8ymqbFJWvUom1mViWhPQ5y3ASbmVvOZSfPd2oE Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 2410f9544bec4633988e1554111c9446 Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServerActionsTestJSON-1996815151 Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2410f9544bec4633988e1554111c9446"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/2410f9544bec4633988e1554111c9446"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_2410f9544bec4633988e1554111c9446", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/2410f9544bec4633988e1554111c9446"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServerActionsTestJSON-1996815151 Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 2410f9544bec4633988e1554111c9446 Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServerActionsTestJSON-1996815151 Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServerActionsTestJSON-1996815151-project Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 8954f3256ddd49639ea57a9242a296d0 Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServerActionsTestJSON-1996815151-project Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 64704ff7-229d-478b-9889-6b6cba53bd0f could not be found. Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '64704ff7-229d-478b-9889-6b6cba53bd0f'} Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64704ff7-229d-478b-9889-6b6cba53bd0f could not be found. Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64704ff7-229d-478b-9889-6b6cba53bd0f could not be found. Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:08:44.462982 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:08:44.468063 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:08:44.468063 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:08:44.468063 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:08:44.468063 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:08:44.468063 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:08:44.468063 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64704ff7-229d-478b-9889-6b6cba53bd0f could not be found. Sep 10 12:08:44.468063 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:08:44.470540 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-48eb61ea-806a-479d-ab8f-77ff37cbb4fd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Returning 404 to user: Instance 64704ff7-229d-478b-9889-6b6cba53bd0f could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:08:44.472858 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-48eb61ea-806a-479d-ab8f-77ff37cbb4fd tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f" status: 404 len: 111 microversion: 2.1 time: 0.065607 Sep 10 12:08:44.473920 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2826/5648] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:08:44 2022] GET /compute/v2.1/servers/64704ff7-229d-478b-9889-6b6cba53bd0f => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:08:44.483474 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5b7c2865-176a-48eb-a562-3a1e4d15d53d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] Calling method '.version_select at 0x7f407368bc10>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:08:44.515046 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5b7c2865-176a-48eb-a562-3a1e4d15d53d tempest-ServerActionsTestJSON-1996815151 tempest-ServerActionsTestJSON-1996815151-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1238815979" status: 202 len: 0 microversion: 2.1 time: 0.036804 Sep 10 12:08:44.515696 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2823/5649] 10.222.0.23 () {58 vars in 1221 bytes} [Sat Sep 10 12:08:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1238815979 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:09:02.651184 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:09:02.653967 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=2,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:09:02.656416 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:09:02.882203 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4ad4281c-cc78-42d3-9d0f-608c7c374d3d tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1443017889", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "90f2b755-a9ad-47f6-a671-a52ea9249ea4"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:09:02.989595 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-4ad4281c-cc78-42d3-9d0f-608c7c374d3d tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] validate_networks() for [('90f2b755-a9ad-47f6-a671-a52ea9249ea4', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:09:03.759982 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-4ad4281c-cc78-42d3-9d0f-608c7c374d3d tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:09:03.760613 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-4ad4281c-cc78-42d3-9d0f-608c7c374d3d tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:09:03.760887 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-4ad4281c-cc78-42d3-9d0f-608c7c374d3d tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:09:03.761914 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-4ad4281c-cc78-42d3-9d0f-608c7c374d3d tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:09:03.762940 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-4ad4281c-cc78-42d3-9d0f-608c7c374d3d tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:09:03.783093 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ad4281c-cc78-42d3-9d0f-608c7c374d3d tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:03.784169 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ad4281c-cc78-42d3-9d0f-608c7c374d3d tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:03.784630 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ad4281c-cc78-42d3-9d0f-608c7c374d3d tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:03.785381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ad4281c-cc78-42d3-9d0f-608c7c374d3d tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:03.785842 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ad4281c-cc78-42d3-9d0f-608c7c374d3d tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:03.786273 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ad4281c-cc78-42d3-9d0f-608c7c374d3d tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:03.842243 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-4ad4281c-cc78-42d3-9d0f-608c7c374d3d tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Getting quotas for project 8b4ef782c352400f9c7fc56781ded1e6. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:09:03.851347 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-4ad4281c-cc78-42d3-9d0f-608c7c374d3d tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Getting quotas for user 6f118157cdc24b8ab7d6c5f2c3eb010b and project 8b4ef782c352400f9c7fc56781ded1e6. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:09:03.898530 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4ad4281c-cc78-42d3-9d0f-608c7c374d3d tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:09:03.901103 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4ad4281c-cc78-42d3-9d0f-608c7c374d3d tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] [instance: 9a2ff223-8c41-42e2-842e-ce20821d30c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:09:04.005444 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4ad4281c-cc78-42d3-9d0f-608c7c374d3d tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.356892 Sep 10 12:09:04.006701 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2827/5650] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:09:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1359 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:09:04.017863 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-06acccaf-8c7b-4a58-a8cd-d7e7f2d87c4d tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:04.019710 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-06acccaf-8c7b-4a58-a8cd-d7e7f2d87c4d tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] [instance: 9a2ff223-8c41-42e2-842e-ce20821d30c8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:04.027111 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=4,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:09:04.028044 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:DELETE=3,nova_api:SELECT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:09:04.169213 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-06acccaf-8c7b-4a58-a8cd-d7e7f2d87c4d tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f118157cdc24b8ab7d6c5f2c3eb010b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ef782c352400f9c7fc56781ded1e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:04.181738 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-06acccaf-8c7b-4a58-a8cd-d7e7f2d87c4d tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] 10.222.0.23 "GET /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8" status: 200 len: 1225 microversion: 2.1 time: 0.167887 Sep 10 12:09:04.182338 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2824/5651] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:04 2022] GET /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8 => generated 1225 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:05.227607 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fbeeb9db-ee39-4592-ac7b-aca69a2f69d5 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:05.229562 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fbeeb9db-ee39-4592-ac7b-aca69a2f69d5 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] [instance: 9a2ff223-8c41-42e2-842e-ce20821d30c8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:05.417882 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fbeeb9db-ee39-4592-ac7b-aca69a2f69d5 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f118157cdc24b8ab7d6c5f2c3eb010b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ef782c352400f9c7fc56781ded1e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:05.428327 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fbeeb9db-ee39-4592-ac7b-aca69a2f69d5 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] 10.222.0.23 "GET /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8" status: 200 len: 1225 microversion: 2.1 time: 0.217181 Sep 10 12:09:05.470029 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2828/5652] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:05 2022] GET /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8 => generated 1225 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:06.460353 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a58107e8-5763-4373-9dec-143dc4e4e2fd tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:06.460954 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a58107e8-5763-4373-9dec-143dc4e4e2fd tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] [instance: 9a2ff223-8c41-42e2-842e-ce20821d30c8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:06.484290 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a58107e8-5763-4373-9dec-143dc4e4e2fd tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:06.487439 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a58107e8-5763-4373-9dec-143dc4e4e2fd tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:06.488152 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a58107e8-5763-4373-9dec-143dc4e4e2fd tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:06.490371 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a58107e8-5763-4373-9dec-143dc4e4e2fd tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:06.493050 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a58107e8-5763-4373-9dec-143dc4e4e2fd tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:06.508560 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a58107e8-5763-4373-9dec-143dc4e4e2fd tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:06.711770 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a58107e8-5763-4373-9dec-143dc4e4e2fd tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f118157cdc24b8ab7d6c5f2c3eb010b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ef782c352400f9c7fc56781ded1e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:06.776776 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a58107e8-5763-4373-9dec-143dc4e4e2fd tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] 10.222.0.23 "GET /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8" status: 200 len: 1285 microversion: 2.1 time: 0.326910 Sep 10 12:09:06.789759 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2825/5653] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:06 2022] GET /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8 => generated 1285 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:07.816197 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4fbf576b-0f57-49fc-8b5a-5c90deabe67a tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:07.817470 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4fbf576b-0f57-49fc-8b5a-5c90deabe67a tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] [instance: 9a2ff223-8c41-42e2-842e-ce20821d30c8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:07.833488 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fbf576b-0f57-49fc-8b5a-5c90deabe67a tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:07.834347 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fbf576b-0f57-49fc-8b5a-5c90deabe67a tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:07.835014 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fbf576b-0f57-49fc-8b5a-5c90deabe67a tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:07.844389 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fbf576b-0f57-49fc-8b5a-5c90deabe67a tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:07.847556 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fbf576b-0f57-49fc-8b5a-5c90deabe67a tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:07.848268 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fbf576b-0f57-49fc-8b5a-5c90deabe67a tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:08.053015 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4fbf576b-0f57-49fc-8b5a-5c90deabe67a tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f118157cdc24b8ab7d6c5f2c3eb010b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ef782c352400f9c7fc56781ded1e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:08.074127 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4fbf576b-0f57-49fc-8b5a-5c90deabe67a tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] 10.222.0.23 "GET /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8" status: 200 len: 1283 microversion: 2.1 time: 0.263931 Sep 10 12:09:08.075583 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2829/5654] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:07 2022] GET /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8 => generated 1283 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:09.101868 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8c327dda-51ae-4eca-8252-ad9ae83fe9fa tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:09.103239 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8c327dda-51ae-4eca-8252-ad9ae83fe9fa tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] [instance: 9a2ff223-8c41-42e2-842e-ce20821d30c8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:09.126065 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c327dda-51ae-4eca-8252-ad9ae83fe9fa tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:09.126907 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c327dda-51ae-4eca-8252-ad9ae83fe9fa tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:09.130208 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c327dda-51ae-4eca-8252-ad9ae83fe9fa tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:09.131548 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c327dda-51ae-4eca-8252-ad9ae83fe9fa tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:09.132246 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c327dda-51ae-4eca-8252-ad9ae83fe9fa tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:09.141573 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c327dda-51ae-4eca-8252-ad9ae83fe9fa tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:09.507191 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8c327dda-51ae-4eca-8252-ad9ae83fe9fa tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f118157cdc24b8ab7d6c5f2c3eb010b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ef782c352400f9c7fc56781ded1e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:09.520195 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8c327dda-51ae-4eca-8252-ad9ae83fe9fa tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] 10.222.0.23 "GET /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8" status: 200 len: 1283 microversion: 2.1 time: 0.422781 Sep 10 12:09:09.524617 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2826/5655] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:09 2022] GET /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8 => generated 1283 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:10.562743 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a3af652f-cfcc-41b0-962a-77377b6c9f14 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:10.563437 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a3af652f-cfcc-41b0-962a-77377b6c9f14 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] [instance: 9a2ff223-8c41-42e2-842e-ce20821d30c8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:10.579621 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a3af652f-cfcc-41b0-962a-77377b6c9f14 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:10.580226 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a3af652f-cfcc-41b0-962a-77377b6c9f14 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:10.585749 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a3af652f-cfcc-41b0-962a-77377b6c9f14 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:10.586550 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a3af652f-cfcc-41b0-962a-77377b6c9f14 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:10.587049 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a3af652f-cfcc-41b0-962a-77377b6c9f14 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:10.587508 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a3af652f-cfcc-41b0-962a-77377b6c9f14 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:10.895526 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a3af652f-cfcc-41b0-962a-77377b6c9f14 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f118157cdc24b8ab7d6c5f2c3eb010b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ef782c352400f9c7fc56781ded1e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:10.945775 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a3af652f-cfcc-41b0-962a-77377b6c9f14 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] 10.222.0.23 "GET /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8" status: 200 len: 1325 microversion: 2.1 time: 0.378681 Sep 10 12:09:10.952003 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2830/5656] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:10 2022] GET /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8 => generated 1325 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:11.551546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-3e8b26e9-a8b5-46be-a46b-ec6df2cb2345 req-71f48306-044c-4790-a7dc-915e0ea0983a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a2ff223-8c41-42e2-842e-ce20821d30c8", "tag": "b19aa0f1-855b-4662-96a9-88a3313aead6"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:09:11.586336 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-3e8b26e9-a8b5-46be-a46b-ec6df2cb2345 req-71f48306-044c-4790-a7dc-915e0ea0983a service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:11.591182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-3e8b26e9-a8b5-46be-a46b-ec6df2cb2345 req-71f48306-044c-4790-a7dc-915e0ea0983a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:11.593666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-3e8b26e9-a8b5-46be-a46b-ec6df2cb2345 req-71f48306-044c-4790-a7dc-915e0ea0983a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:11.636141 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-3e8b26e9-a8b5-46be-a46b-ec6df2cb2345 req-71f48306-044c-4790-a7dc-915e0ea0983a service nova] Creating event network-changed:b19aa0f1-855b-4662-96a9-88a3313aead6 for instance 9a2ff223-8c41-42e2-842e-ce20821d30c8 on n-h1-856895-1 Sep 10 12:09:11.656967 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-3e8b26e9-a8b5-46be-a46b-ec6df2cb2345 req-71f48306-044c-4790-a7dc-915e0ea0983a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118943 Sep 10 12:09:11.663408 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2827/5657] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:09:11.768865 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e41a614c-f660-48e7-a337-38e4d7c33764 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:11.770381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e41a614c-f660-48e7-a337-38e4d7c33764 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 5f777fb8-adb1-47fd-aced-8b338fa6052e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:11.779648 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e41a614c-f660-48e7-a337-38e4d7c33764 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:11.781666 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e41a614c-f660-48e7-a337-38e4d7c33764 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:11.781666 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e41a614c-f660-48e7-a337-38e4d7c33764 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:11.782344 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e41a614c-f660-48e7-a337-38e4d7c33764 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:11.791456 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e41a614c-f660-48e7-a337-38e4d7c33764 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:11.792227 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e41a614c-f660-48e7-a337-38e4d7c33764 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:11.848333 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e41a614c-f660-48e7-a337-38e4d7c33764 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e/ips" status: 200 len: 150 microversion: 2.1 time: 0.084014 Sep 10 12:09:11.849562 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2831/5658] 10.222.0.23 () {58 vars in 1248 bytes} [Sat Sep 10 12:09:11 2022] GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e/ips => generated 150 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:09:11.866555 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a4ca1229-1ae0-473e-84d3-7c3c5ac8313e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e930db60-b47d-45ef-bcf9-d6588d795558"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:09:11.869375 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a4ca1229-1ae0-473e-84d3-7c3c5ac8313e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 5f777fb8-adb1-47fd-aced-8b338fa6052e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:11.878302 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a4ca1229-1ae0-473e-84d3-7c3c5ac8313e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:11.879190 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a4ca1229-1ae0-473e-84d3-7c3c5ac8313e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:11.880365 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a4ca1229-1ae0-473e-84d3-7c3c5ac8313e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:11.881440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a4ca1229-1ae0-473e-84d3-7c3c5ac8313e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:11.882118 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a4ca1229-1ae0-473e-84d3-7c3c5ac8313e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:11.882788 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a4ca1229-1ae0-473e-84d3-7c3c5ac8313e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:11.979132 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c6f8428f-bfea-44a2-bbeb-b33f2aacdadb tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:11.979789 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c6f8428f-bfea-44a2-bbeb-b33f2aacdadb tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] [instance: 9a2ff223-8c41-42e2-842e-ce20821d30c8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:11.992791 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c6f8428f-bfea-44a2-bbeb-b33f2aacdadb tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:11.993328 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c6f8428f-bfea-44a2-bbeb-b33f2aacdadb tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:11.994035 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c6f8428f-bfea-44a2-bbeb-b33f2aacdadb tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:11.997560 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c6f8428f-bfea-44a2-bbeb-b33f2aacdadb tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:11.998519 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c6f8428f-bfea-44a2-bbeb-b33f2aacdadb tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:11.999591 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c6f8428f-bfea-44a2-bbeb-b33f2aacdadb tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:12.178533 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-a4ca1229-1ae0-473e-84d3-7c3c5ac8313e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] HTTP exception thrown: Invalid volume: volume e930db60-b47d-45ef-bcf9-d6588d795558 is already attached to instances: f4da91bc-acbf-487b-b305-a619df7ad3f8 Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a4ca1229-1ae0-473e-84d3-7c3c5ac8313e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Request method failure captured: Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e/os-volume_attachments HTTP/1.1 Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 74 Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH3f6GUP-vcGJKgYs9rYAE6OawiTmJHgZl9vlhfSbv7R_wFrnAHrNyTqDc0RuEPZi57XGfLqPVxCZc47_xRjBpcGZLWUDdhEHCEh6mtOoaNkeHxMKPICZdCuDCfpAFF9D9M9RMYBjoFdk7vZER1xOY4aTKlTJ8XZrlR1gs_K7sdx9WY Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 03301ecc81fe426bafc4be81413d1265 Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-AttachVolumeNegativeTest-637078285 Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/03301ecc81fe426bafc4be81413d1265"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/03301ecc81fe426bafc4be81413d1265"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_03301ecc81fe426bafc4be81413d1265", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/03301ecc81fe426bafc4be81413d1265"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-AttachVolumeNegativeTest-637078285 Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 03301ecc81fe426bafc4be81413d1265 Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-637078285 Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-AttachVolumeNegativeTest-637078285-project Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 199d923de84c45789188543de904314a Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-AttachVolumeNegativeTest-637078285-project Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: {"volumeAttachment": {"volumeId": "e930db60-b47d-45ef-bcf9-d6588d795558"}} Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: exception: Invalid volume: volume e930db60-b47d-45ef-bcf9-d6588d795558 is already attached to instances: f4da91bc-acbf-487b-b305-a619df7ad3f8 Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'server_id': '5f777fb8-adb1-47fd-aced-8b338fa6052e', 'body': {'volumeAttachment': {'volumeId': 'e930db60-b47d-45ef-bcf9-d6588d795558'}}} Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e930db60-b47d-45ef-bcf9-d6588d795558 is already attached to instances: f4da91bc-acbf-487b-b305-a619df7ad3f8 Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:09:12.180424 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:09:12.184578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:09:12.184578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:09:12.184578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 10 12:09:12.184578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 10 12:09:12.184578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e930db60-b47d-45ef-bcf9-d6588d795558 is already attached to instances: f4da91bc-acbf-487b-b305-a619df7ad3f8 Sep 10 12:09:12.184578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:09:12.184578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:09:12.184578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:09:12.184578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:09:12.184578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:09:12.184578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:09:12.184578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:09:12.184578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:09:12.184578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e930db60-b47d-45ef-bcf9-d6588d795558 is already attached to instances: f4da91bc-acbf-487b-b305-a619df7ad3f8 Sep 10 12:09:12.184578 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:09:12.184578 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a4ca1229-1ae0-473e-84d3-7c3c5ac8313e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Returning 400 to user: Invalid volume: volume e930db60-b47d-45ef-bcf9-d6588d795558 is already attached to instances: f4da91bc-acbf-487b-b305-a619df7ad3f8 {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:09:12.190386 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a4ca1229-1ae0-473e-84d3-7c3c5ac8313e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "POST /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.330816 Sep 10 12:09:12.191049 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2828/5659] 10.222.0.23 () {60 vars in 1323 bytes} [Sat Sep 10 12:09:11 2022] POST /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e/os-volume_attachments => generated 174 bytes in 334 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 10 12:09:12.218191 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d6641e10-99b7-4b43-ab35-7a630ed3276a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:12.222586 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d6641e10-99b7-4b43-ab35-7a630ed3276a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 5f777fb8-adb1-47fd-aced-8b338fa6052e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:12.248093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d6641e10-99b7-4b43-ab35-7a630ed3276a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:12.248581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d6641e10-99b7-4b43-ab35-7a630ed3276a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:12.249023 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d6641e10-99b7-4b43-ab35-7a630ed3276a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:12.249760 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d6641e10-99b7-4b43-ab35-7a630ed3276a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:12.250208 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d6641e10-99b7-4b43-ab35-7a630ed3276a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:12.250635 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d6641e10-99b7-4b43-ab35-7a630ed3276a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:12.326806 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d6641e10-99b7-4b43-ab35-7a630ed3276a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 5f777fb8-adb1-47fd-aced-8b338fa6052e] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:09:12.468263 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c6f8428f-bfea-44a2-bbeb-b33f2aacdadb tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f118157cdc24b8ab7d6c5f2c3eb010b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ef782c352400f9c7fc56781ded1e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:12.485409 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c6f8428f-bfea-44a2-bbeb-b33f2aacdadb tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] 10.222.0.23 "GET /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8" status: 200 len: 1325 microversion: 2.1 time: 0.510831 Sep 10 12:09:12.486842 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2832/5660] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:11 2022] GET /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8 => generated 1325 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:12.506275 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d6641e10-99b7-4b43-ab35-7a630ed3276a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e" status: 204 len: 0 microversion: 2.1 time: 0.308688 Sep 10 12:09:12.511380 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2829/5661] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:09:12 2022] DELETE /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:09:12.531651 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d999512b-f222-484d-807a-c3edfeae8b41 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:12.532403 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d999512b-f222-484d-807a-c3edfeae8b41 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 5f777fb8-adb1-47fd-aced-8b338fa6052e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:12.561104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d999512b-f222-484d-807a-c3edfeae8b41 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:12.561925 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d999512b-f222-484d-807a-c3edfeae8b41 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:12.563304 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d999512b-f222-484d-807a-c3edfeae8b41 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:12.565719 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d999512b-f222-484d-807a-c3edfeae8b41 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:12.566292 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d999512b-f222-484d-807a-c3edfeae8b41 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:12.566860 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d999512b-f222-484d-807a-c3edfeae8b41 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:12.770134 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d999512b-f222-484d-807a-c3edfeae8b41 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:12.798037 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d999512b-f222-484d-807a-c3edfeae8b41 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e" status: 200 len: 1681 microversion: 2.1 time: 0.281730 Sep 10 12:09:12.801163 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2833/5662] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:12 2022] GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e => generated 1681 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:13.523845 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8e33f487-ccd8-446d-bfd3-0f315dd55daa tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:13.525242 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8e33f487-ccd8-446d-bfd3-0f315dd55daa tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] [instance: 9a2ff223-8c41-42e2-842e-ce20821d30c8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:13.539236 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e33f487-ccd8-446d-bfd3-0f315dd55daa tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:13.539938 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e33f487-ccd8-446d-bfd3-0f315dd55daa tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:13.540666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e33f487-ccd8-446d-bfd3-0f315dd55daa tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:13.541667 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e33f487-ccd8-446d-bfd3-0f315dd55daa tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:13.544375 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e33f487-ccd8-446d-bfd3-0f315dd55daa tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:13.545200 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e33f487-ccd8-446d-bfd3-0f315dd55daa tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:13.812958 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8e33f487-ccd8-446d-bfd3-0f315dd55daa tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f118157cdc24b8ab7d6c5f2c3eb010b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ef782c352400f9c7fc56781ded1e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:13.825803 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5eaa4a20-4b07-4bcc-83d4-cac5c72b2b89 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:13.827071 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5eaa4a20-4b07-4bcc-83d4-cac5c72b2b89 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 5f777fb8-adb1-47fd-aced-8b338fa6052e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:13.840023 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8e33f487-ccd8-446d-bfd3-0f315dd55daa tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] 10.222.0.23 "GET /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8" status: 200 len: 1325 microversion: 2.1 time: 0.330523 Sep 10 12:09:13.840992 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:09:13.842418 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2830/5663] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:13 2022] GET /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8 => generated 1325 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:13.845492 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5eaa4a20-4b07-4bcc-83d4-cac5c72b2b89 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:13.847302 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5eaa4a20-4b07-4bcc-83d4-cac5c72b2b89 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:13.847945 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5eaa4a20-4b07-4bcc-83d4-cac5c72b2b89 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:13.848928 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5eaa4a20-4b07-4bcc-83d4-cac5c72b2b89 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:13.849654 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5eaa4a20-4b07-4bcc-83d4-cac5c72b2b89 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:13.850265 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5eaa4a20-4b07-4bcc-83d4-cac5c72b2b89 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:14.216903 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5eaa4a20-4b07-4bcc-83d4-cac5c72b2b89 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:14.258291 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5eaa4a20-4b07-4bcc-83d4-cac5c72b2b89 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e" status: 200 len: 1681 microversion: 2.1 time: 0.438179 Sep 10 12:09:14.261787 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2834/5664] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:13 2022] GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e => generated 1681 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:09:14.870550 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:09:14.917787 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bd531805-7663-4699-ae0c-2e26654187a5 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:14.919633 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bd531805-7663-4699-ae0c-2e26654187a5 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] [instance: 9a2ff223-8c41-42e2-842e-ce20821d30c8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:14.937722 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd531805-7663-4699-ae0c-2e26654187a5 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:14.939636 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd531805-7663-4699-ae0c-2e26654187a5 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:14.940782 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd531805-7663-4699-ae0c-2e26654187a5 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:14.947151 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd531805-7663-4699-ae0c-2e26654187a5 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:14.949349 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd531805-7663-4699-ae0c-2e26654187a5 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:14.951924 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd531805-7663-4699-ae0c-2e26654187a5 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:15.292843 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a6778aca-0e04-47f5-b292-14f2556ae9df tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:15.294082 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a6778aca-0e04-47f5-b292-14f2556ae9df tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 5f777fb8-adb1-47fd-aced-8b338fa6052e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:15.304530 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6778aca-0e04-47f5-b292-14f2556ae9df tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:15.307796 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6778aca-0e04-47f5-b292-14f2556ae9df tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:15.308409 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6778aca-0e04-47f5-b292-14f2556ae9df tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:15.309159 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6778aca-0e04-47f5-b292-14f2556ae9df tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:15.309674 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6778aca-0e04-47f5-b292-14f2556ae9df tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:15.310110 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6778aca-0e04-47f5-b292-14f2556ae9df tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:15.427219 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=8 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:09:15.596555 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a6778aca-0e04-47f5-b292-14f2556ae9df tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:15.612958 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a6778aca-0e04-47f5-b292-14f2556ae9df tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e" status: 200 len: 1613 microversion: 2.1 time: 0.334682 Sep 10 12:09:15.613803 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2835/5665] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:15 2022] GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e => generated 1613 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:09:15.694765 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bd531805-7663-4699-ae0c-2e26654187a5 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f118157cdc24b8ab7d6c5f2c3eb010b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ef782c352400f9c7fc56781ded1e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:15.731910 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bd531805-7663-4699-ae0c-2e26654187a5 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] 10.222.0.23 "GET /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8" status: 200 len: 1325 microversion: 2.1 time: 0.860806 Sep 10 12:09:15.733351 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2831/5666] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:14 2022] GET /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8 => generated 1325 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:16.652395 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ea0d9a8f-7a2b-49eb-a277-2637b5a4149d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:16.653179 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ea0d9a8f-7a2b-49eb-a277-2637b5a4149d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 5f777fb8-adb1-47fd-aced-8b338fa6052e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:16.678158 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea0d9a8f-7a2b-49eb-a277-2637b5a4149d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:16.686973 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea0d9a8f-7a2b-49eb-a277-2637b5a4149d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:16.687628 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea0d9a8f-7a2b-49eb-a277-2637b5a4149d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:16.691825 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea0d9a8f-7a2b-49eb-a277-2637b5a4149d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:16.692448 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea0d9a8f-7a2b-49eb-a277-2637b5a4149d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:16.693302 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea0d9a8f-7a2b-49eb-a277-2637b5a4149d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:16.759560 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2a585c1a-506f-48d1-a4d5-132ef37062ee tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:16.760336 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2a585c1a-506f-48d1-a4d5-132ef37062ee tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] [instance: 9a2ff223-8c41-42e2-842e-ce20821d30c8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:16.781640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a585c1a-506f-48d1-a4d5-132ef37062ee tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:16.787983 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a585c1a-506f-48d1-a4d5-132ef37062ee tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:16.789325 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a585c1a-506f-48d1-a4d5-132ef37062ee tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:16.792145 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a585c1a-506f-48d1-a4d5-132ef37062ee tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:16.801603 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a585c1a-506f-48d1-a4d5-132ef37062ee tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:16.810430 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a585c1a-506f-48d1-a4d5-132ef37062ee tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:18.024634 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ea0d9a8f-7a2b-49eb-a277-2637b5a4149d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:18.042663 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ea0d9a8f-7a2b-49eb-a277-2637b5a4149d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e" status: 200 len: 1613 microversion: 2.1 time: 1.405654 Sep 10 12:09:18.059981 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2836/5667] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:16 2022] GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e => generated 1613 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:18.189166 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2a585c1a-506f-48d1-a4d5-132ef37062ee tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f118157cdc24b8ab7d6c5f2c3eb010b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ef782c352400f9c7fc56781ded1e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:18.202037 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2a585c1a-506f-48d1-a4d5-132ef37062ee tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] 10.222.0.23 "GET /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8" status: 200 len: 1325 microversion: 2.1 time: 1.444456 Sep 10 12:09:18.216335 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2832/5668] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:16 2022] GET /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8 => generated 1325 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:18.405033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-1429ad28-4948-4321-9eff-1b176d2f05e2 req-61837418-43c5-4d0a-98f3-01fd411f233f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f777fb8-adb1-47fd-aced-8b338fa6052e", "name": "network-vif-deleted", "tag": "609fd4e8-589c-4be1-9346-b197c8445b70"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:09:18.428964 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-1429ad28-4948-4321-9eff-1b176d2f05e2 req-61837418-43c5-4d0a-98f3-01fd411f233f service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:18.430062 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-1429ad28-4948-4321-9eff-1b176d2f05e2 req-61837418-43c5-4d0a-98f3-01fd411f233f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:18.430702 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-1429ad28-4948-4321-9eff-1b176d2f05e2 req-61837418-43c5-4d0a-98f3-01fd411f233f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:18.456319 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-1429ad28-4948-4321-9eff-1b176d2f05e2 req-61837418-43c5-4d0a-98f3-01fd411f233f service nova] Creating event network-vif-deleted:609fd4e8-589c-4be1-9346-b197c8445b70 for instance 5f777fb8-adb1-47fd-aced-8b338fa6052e on n-h2-856895-1 Sep 10 12:09:18.466131 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-1429ad28-4948-4321-9eff-1b176d2f05e2 req-61837418-43c5-4d0a-98f3-01fd411f233f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.401218 Sep 10 12:09:18.467312 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2837/5669] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:09:19.090986 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-84531267-8f0e-42eb-9416-52ba94002293 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:19.092963 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-84531267-8f0e-42eb-9416-52ba94002293 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 5f777fb8-adb1-47fd-aced-8b338fa6052e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:19.144558 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-84531267-8f0e-42eb-9416-52ba94002293 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:19.165696 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-84531267-8f0e-42eb-9416-52ba94002293 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:19.166551 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-84531267-8f0e-42eb-9416-52ba94002293 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:19.167686 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-84531267-8f0e-42eb-9416-52ba94002293 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:19.184714 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-84531267-8f0e-42eb-9416-52ba94002293 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:19.185873 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-84531267-8f0e-42eb-9416-52ba94002293 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:19.229998 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a7db83d5-0907-4ba9-a1b2-e0d335fafa3c tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:19.232444 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a7db83d5-0907-4ba9-a1b2-e0d335fafa3c tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] [instance: 9a2ff223-8c41-42e2-842e-ce20821d30c8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:19.277733 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a7db83d5-0907-4ba9-a1b2-e0d335fafa3c tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:19.279604 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a7db83d5-0907-4ba9-a1b2-e0d335fafa3c tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:19.280578 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a7db83d5-0907-4ba9-a1b2-e0d335fafa3c tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:19.282085 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a7db83d5-0907-4ba9-a1b2-e0d335fafa3c tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:19.289277 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a7db83d5-0907-4ba9-a1b2-e0d335fafa3c tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:19.290168 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a7db83d5-0907-4ba9-a1b2-e0d335fafa3c tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:19.290836 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-84531267-8f0e-42eb-9416-52ba94002293 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] HTTP exception thrown: Instance 5f777fb8-adb1-47fd-aced-8b338fa6052e could not be found. Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-84531267-8f0e-42eb-9416-52ba94002293 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Request method failure captured: Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e HTTP/1.1 Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH3f6GUP-vcGJKgYs9rYAE6OawiTmJHgZl9vlhfSbv7R_wFrnAHrNyTqDc0RuEPZi57XGfLqPVxCZc47_xRjBpcGZLWUDdhEHCEh6mtOoaNkeHxMKPICZdCuDCfpAFF9D9M9RMYBjoFdk7vZER1xOY4aTKlTJ8XZrlR1gs_K7sdx9WY Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 03301ecc81fe426bafc4be81413d1265 Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-AttachVolumeNegativeTest-637078285 Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/03301ecc81fe426bafc4be81413d1265"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/03301ecc81fe426bafc4be81413d1265"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_03301ecc81fe426bafc4be81413d1265", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/03301ecc81fe426bafc4be81413d1265"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-AttachVolumeNegativeTest-637078285 Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 03301ecc81fe426bafc4be81413d1265 Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-637078285 Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-AttachVolumeNegativeTest-637078285-project Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 199d923de84c45789188543de904314a Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-AttachVolumeNegativeTest-637078285-project Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 5f777fb8-adb1-47fd-aced-8b338fa6052e could not be found. Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '5f777fb8-adb1-47fd-aced-8b338fa6052e'} Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f777fb8-adb1-47fd-aced-8b338fa6052e could not be found. Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f777fb8-adb1-47fd-aced-8b338fa6052e could not be found. Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:09:19.293552 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:09:19.299783 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:09:19.299783 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:09:19.299783 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:09:19.299783 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:09:19.299783 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:09:19.299783 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f777fb8-adb1-47fd-aced-8b338fa6052e could not be found. Sep 10 12:09:19.299783 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:09:19.308908 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-84531267-8f0e-42eb-9416-52ba94002293 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Returning 404 to user: Instance 5f777fb8-adb1-47fd-aced-8b338fa6052e could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:09:19.310899 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-84531267-8f0e-42eb-9416-52ba94002293 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e" status: 404 len: 111 microversion: 2.1 time: 0.226877 Sep 10 12:09:19.312658 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2833/5670] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:19 2022] GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e => generated 111 bytes in 229 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:09:19.332584 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6106630b-fc2c-4e43-8525-9b7f5a4ff626 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '.version_select at 0x7f40735911f0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:19.375686 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6106630b-fc2c-4e43-8525-9b7f5a4ff626 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-608658947" status: 202 len: 0 microversion: 2.1 time: 0.054995 Sep 10 12:09:19.376696 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2834/5671] 10.222.0.23 () {58 vars in 1218 bytes} [Sat Sep 10 12:09:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-608658947 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:09:19.891931 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a7db83d5-0907-4ba9-a1b2-e0d335fafa3c tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f118157cdc24b8ab7d6c5f2c3eb010b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ef782c352400f9c7fc56781ded1e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:19.911381 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a7db83d5-0907-4ba9-a1b2-e0d335fafa3c tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] 10.222.0.23 "GET /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8" status: 200 len: 1325 microversion: 2.1 time: 0.682818 Sep 10 12:09:19.924706 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2838/5672] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:19 2022] GET /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8 => generated 1325 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:09:20.487202 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-164c7c88-095b-4a59-baee-1cae52f700ab tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:20.488405 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-164c7c88-095b-4a59-baee-1cae52f700ab tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:20.504325 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-164c7c88-095b-4a59-baee-1cae52f700ab tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:20.504833 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-164c7c88-095b-4a59-baee-1cae52f700ab tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:20.505281 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-164c7c88-095b-4a59-baee-1cae52f700ab tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:20.506000 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-164c7c88-095b-4a59-baee-1cae52f700ab tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:20.506463 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-164c7c88-095b-4a59-baee-1cae52f700ab tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:20.506895 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-164c7c88-095b-4a59-baee-1cae52f700ab tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:20.543338 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-164c7c88-095b-4a59-baee-1cae52f700ab tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9/ips" status: 200 len: 146 microversion: 2.1 time: 0.060991 Sep 10 12:09:20.555584 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2835/5673] 10.222.0.23 () {58 vars in 1248 bytes} [Sat Sep 10 12:09:20 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9/ips => generated 146 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:09:20.938888 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e2de3347-4211-4d95-b617-7fe8d4c4bce3 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:20.941162 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e2de3347-4211-4d95-b617-7fe8d4c4bce3 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] [instance: 9a2ff223-8c41-42e2-842e-ce20821d30c8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:20.964685 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e2de3347-4211-4d95-b617-7fe8d4c4bce3 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:20.965844 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e2de3347-4211-4d95-b617-7fe8d4c4bce3 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:20.969735 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e2de3347-4211-4d95-b617-7fe8d4c4bce3 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:20.970843 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e2de3347-4211-4d95-b617-7fe8d4c4bce3 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:20.971828 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e2de3347-4211-4d95-b617-7fe8d4c4bce3 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:20.974088 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e2de3347-4211-4d95-b617-7fe8d4c4bce3 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:21.383545 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e2de3347-4211-4d95-b617-7fe8d4c4bce3 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f118157cdc24b8ab7d6c5f2c3eb010b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ef782c352400f9c7fc56781ded1e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:21.396226 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e2de3347-4211-4d95-b617-7fe8d4c4bce3 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] 10.222.0.23 "GET /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8" status: 200 len: 1325 microversion: 2.1 time: 0.462162 Sep 10 12:09:21.414796 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2839/5674] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:20 2022] GET /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8 => generated 1325 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:21.447922 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f50bb4bc-197d-4d95-9621-98b718edd50a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:21.462010 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f50bb4bc-197d-4d95-9621-98b718edd50a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: f4da91bc-acbf-487b-b305-a619df7ad3f8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:21.475342 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f50bb4bc-197d-4d95-9621-98b718edd50a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:21.476166 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f50bb4bc-197d-4d95-9621-98b718edd50a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:21.476818 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f50bb4bc-197d-4d95-9621-98b718edd50a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:21.477737 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f50bb4bc-197d-4d95-9621-98b718edd50a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:21.478663 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f50bb4bc-197d-4d95-9621-98b718edd50a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:21.479345 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f50bb4bc-197d-4d95-9621-98b718edd50a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:21.688744 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-f50bb4bc-197d-4d95-9621-98b718edd50a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lazy-loading 'services' on Instance uuid f4da91bc-acbf-487b-b305-a619df7ad3f8 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:09:21.950741 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f50bb4bc-197d-4d95-9621-98b718edd50a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8/os-volume_attachments/e930db60-b47d-45ef-bcf9-d6588d795558" status: 202 len: 0 microversion: 2.1 time: 0.506230 Sep 10 12:09:21.951494 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2840/5675] 10.222.0.23 () {58 vars in 1416 bytes} [Sat Sep 10 12:09:21 2022] DELETE /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8/os-volume_attachments/e930db60-b47d-45ef-bcf9-d6588d795558 => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:09:21.964322 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-86bdc314-8e67-44ec-b052-631cbf5d08ad tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:21.968835 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-86bdc314-8e67-44ec-b052-631cbf5d08ad tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: f4da91bc-acbf-487b-b305-a619df7ad3f8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:21.993649 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86bdc314-8e67-44ec-b052-631cbf5d08ad tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:21.994403 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86bdc314-8e67-44ec-b052-631cbf5d08ad tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:21.995450 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86bdc314-8e67-44ec-b052-631cbf5d08ad tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:21.996937 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86bdc314-8e67-44ec-b052-631cbf5d08ad tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:21.997636 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86bdc314-8e67-44ec-b052-631cbf5d08ad tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:21.998548 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86bdc314-8e67-44ec-b052-631cbf5d08ad tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:22.039974 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a7531333-bf4b-4a82-baca-9ff0a560c68c tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Action: 'create', calling method: .version_select at 0x7f40738cf1f0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-123270911", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTbuhwQq0WYF7JWYVpAzCjA/won4sZqPf6wD/I2a72x+DAyHzaCkQW2j6BIFSMU6fySOb85ir+VpfF58CdLbwWxHhzIOxt18rjpm7qQ7LR9tETRM3IWFe65AicP90i/sA=="}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:09:22.091935 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-a7531333-bf4b-4a82-baca-9ff0a560c68c tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Getting quotas for project 5e89542829e1491681b317a2c748bbbc. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:09:22.098710 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-86bdc314-8e67-44ec-b052-631cbf5d08ad tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140209 Sep 10 12:09:22.107961 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-a7531333-bf4b-4a82-baca-9ff0a560c68c tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Getting quotas for user da5a85b4b060444abea51d5ef25c3378 and project 5e89542829e1491681b317a2c748bbbc. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:09:22.109243 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2841/5676] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:09:21 2022] GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:09:22.144447 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a7531333-bf4b-4a82-baca-9ff0a560c68c tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.865327 Sep 10 12:09:22.146127 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2836/5677] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 12:09:21 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:09:22.328913 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-2751746b-637a-49cd-b3f5-1f589118cef2 req-b2ada148-e096-4c5d-b868-46a597b8d733 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a2ff223-8c41-42e2-842e-ce20821d30c8", "name": "network-vif-plugged", "status": "completed", "tag": "b19aa0f1-855b-4662-96a9-88a3313aead6"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:09:22.354140 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-2751746b-637a-49cd-b3f5-1f589118cef2 req-b2ada148-e096-4c5d-b868-46a597b8d733 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:22.355369 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-2751746b-637a-49cd-b3f5-1f589118cef2 req-b2ada148-e096-4c5d-b868-46a597b8d733 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:22.358403 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-2751746b-637a-49cd-b3f5-1f589118cef2 req-b2ada148-e096-4c5d-b868-46a597b8d733 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:22.384852 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-2751746b-637a-49cd-b3f5-1f589118cef2 req-b2ada148-e096-4c5d-b868-46a597b8d733 service nova] Creating event network-vif-plugged:b19aa0f1-855b-4662-96a9-88a3313aead6 for instance 9a2ff223-8c41-42e2-842e-ce20821d30c8 on n-h1-856895-1 Sep 10 12:09:22.399720 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-2751746b-637a-49cd-b3f5-1f589118cef2 req-b2ada148-e096-4c5d-b868-46a597b8d733 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074839 Sep 10 12:09:22.401978 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2842/5678] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:09:22.427008 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-913b44a3-1a2f-4169-b331-3aa36dc0a3b0 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:22.427850 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-913b44a3-1a2f-4169-b331-3aa36dc0a3b0 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] [instance: 9a2ff223-8c41-42e2-842e-ce20821d30c8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:22.473085 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-913b44a3-1a2f-4169-b331-3aa36dc0a3b0 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:22.473688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-913b44a3-1a2f-4169-b331-3aa36dc0a3b0 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:22.474447 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-913b44a3-1a2f-4169-b331-3aa36dc0a3b0 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:22.474930 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-913b44a3-1a2f-4169-b331-3aa36dc0a3b0 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:22.484001 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-913b44a3-1a2f-4169-b331-3aa36dc0a3b0 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:22.484560 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-913b44a3-1a2f-4169-b331-3aa36dc0a3b0 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:23.126893 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-660a4b7f-827e-437a-b6cb-c52e698b69a9 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:23.128550 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-913b44a3-1a2f-4169-b331-3aa36dc0a3b0 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f118157cdc24b8ab7d6c5f2c3eb010b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ef782c352400f9c7fc56781ded1e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:23.130095 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-660a4b7f-827e-437a-b6cb-c52e698b69a9 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: f4da91bc-acbf-487b-b305-a619df7ad3f8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:23.149423 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-913b44a3-1a2f-4169-b331-3aa36dc0a3b0 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] 10.222.0.23 "GET /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8" status: 200 len: 1325 microversion: 2.1 time: 0.727347 Sep 10 12:09:23.155427 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2837/5679] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:22 2022] GET /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8 => generated 1325 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:23.169684 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-660a4b7f-827e-437a-b6cb-c52e698b69a9 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:23.171437 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-660a4b7f-827e-437a-b6cb-c52e698b69a9 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:23.172110 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-660a4b7f-827e-437a-b6cb-c52e698b69a9 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:23.173023 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-660a4b7f-827e-437a-b6cb-c52e698b69a9 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:23.174149 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-660a4b7f-827e-437a-b6cb-c52e698b69a9 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:23.175028 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-660a4b7f-827e-437a-b6cb-c52e698b69a9 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:23.248170 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-660a4b7f-827e-437a-b6cb-c52e698b69a9 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129383 Sep 10 12:09:23.255071 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2843/5680] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:09:23 2022] GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:09:24.182624 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1fee4ee7-3d36-4a94-b001-db4985624af3 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:24.182624 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1fee4ee7-3d36-4a94-b001-db4985624af3 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] [instance: 9a2ff223-8c41-42e2-842e-ce20821d30c8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:24.193744 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1fee4ee7-3d36-4a94-b001-db4985624af3 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:24.194236 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1fee4ee7-3d36-4a94-b001-db4985624af3 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:24.194683 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1fee4ee7-3d36-4a94-b001-db4985624af3 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:24.195420 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1fee4ee7-3d36-4a94-b001-db4985624af3 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:24.195888 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1fee4ee7-3d36-4a94-b001-db4985624af3 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:24.196324 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1fee4ee7-3d36-4a94-b001-db4985624af3 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:24.262802 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-311d3202-f00f-4824-81e4-12d29451ad6a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:24.265098 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-311d3202-f00f-4824-81e4-12d29451ad6a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: f4da91bc-acbf-487b-b305-a619df7ad3f8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:24.287651 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-311d3202-f00f-4824-81e4-12d29451ad6a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:24.290306 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-311d3202-f00f-4824-81e4-12d29451ad6a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:24.291467 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-311d3202-f00f-4824-81e4-12d29451ad6a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:24.296058 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-311d3202-f00f-4824-81e4-12d29451ad6a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:24.297156 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-311d3202-f00f-4824-81e4-12d29451ad6a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:24.297670 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-311d3202-f00f-4824-81e4-12d29451ad6a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:24.346167 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-311d3202-f00f-4824-81e4-12d29451ad6a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087667 Sep 10 12:09:24.347007 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2844/5681] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:09:24 2022] GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:09:24.352148 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-407a7f3c-8c1d-462f-806a-d1da81d3672c tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b762e325-1846-4ae8-9cff-6b92b38631c4"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:09:24.355044 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-407a7f3c-8c1d-462f-806a-d1da81d3672c tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:24.362938 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-407a7f3c-8c1d-462f-806a-d1da81d3672c tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:24.363688 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-407a7f3c-8c1d-462f-806a-d1da81d3672c tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:24.364362 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-407a7f3c-8c1d-462f-806a-d1da81d3672c tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:24.365315 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-407a7f3c-8c1d-462f-806a-d1da81d3672c tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:24.365950 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-407a7f3c-8c1d-462f-806a-d1da81d3672c tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:24.366526 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-407a7f3c-8c1d-462f-806a-d1da81d3672c tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:24.499120 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1fee4ee7-3d36-4a94-b001-db4985624af3 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f118157cdc24b8ab7d6c5f2c3eb010b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ef782c352400f9c7fc56781ded1e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:24.508528 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1fee4ee7-3d36-4a94-b001-db4985624af3 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] 10.222.0.23 "GET /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8" status: 200 len: 1325 microversion: 2.1 time: 0.334338 Sep 10 12:09:24.509662 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2838/5682] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:24 2022] GET /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8 => generated 1325 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:24.514694 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-09d9e9fa-a26a-4b1a-b6bc-7d62650c35f8 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-584742599", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-123270911", "security_groups": [{"name": "tempest-secgroup-smoke-363112207"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "12aa13ac-8656-44e1-9582-4b8f57082508"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:09:24.711624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:09:24.774476 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-09d9e9fa-a26a-4b1a-b6bc-7d62650c35f8 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] validate_networks() for [('12aa13ac-8656-44e1-9582-4b8f57082508', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:09:24.916520 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-407a7f3c-8c1d-462f-806a-d1da81d3672c tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "POST /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.567993 Sep 10 12:09:24.924514 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2845/5683] 10.222.0.23 () {60 vars in 1323 bytes} [Sat Sep 10 12:09:24 2022] POST /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9/os-volume_attachments => generated 194 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:09:25.362099 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c28523d1-87b1-4c09-b09c-13dff7f51e3b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:25.365185 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c28523d1-87b1-4c09-b09c-13dff7f51e3b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: f4da91bc-acbf-487b-b305-a619df7ad3f8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:25.381407 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c28523d1-87b1-4c09-b09c-13dff7f51e3b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:25.381917 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c28523d1-87b1-4c09-b09c-13dff7f51e3b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:25.382365 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c28523d1-87b1-4c09-b09c-13dff7f51e3b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:25.383083 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c28523d1-87b1-4c09-b09c-13dff7f51e3b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:25.383594 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c28523d1-87b1-4c09-b09c-13dff7f51e3b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:25.384029 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c28523d1-87b1-4c09-b09c-13dff7f51e3b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:25.426059 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c28523d1-87b1-4c09-b09c-13dff7f51e3b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070779 Sep 10 12:09:25.426945 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2846/5684] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:09:25 2022] GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:09:25.473909 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-09d9e9fa-a26a-4b1a-b6bc-7d62650c35f8 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Getting quotas for project 5e89542829e1491681b317a2c748bbbc. Resources: dict_keys(['metadata_items']) {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:09:25.479296 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-09d9e9fa-a26a-4b1a-b6bc-7d62650c35f8 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Getting quotas for user da5a85b4b060444abea51d5ef25c3378 and project 5e89542829e1491681b317a2c748bbbc. Resources: dict_keys(['metadata_items']) {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:09:25.493030 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-09d9e9fa-a26a-4b1a-b6bc-7d62650c35f8 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:09:25.493464 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-09d9e9fa-a26a-4b1a-b6bc-7d62650c35f8 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:09:25.493946 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-09d9e9fa-a26a-4b1a-b6bc-7d62650c35f8 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:09:25.494360 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-09d9e9fa-a26a-4b1a-b6bc-7d62650c35f8 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:09:25.494779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-09d9e9fa-a26a-4b1a-b6bc-7d62650c35f8 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:09:25.504601 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-09d9e9fa-a26a-4b1a-b6bc-7d62650c35f8 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:25.505097 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-09d9e9fa-a26a-4b1a-b6bc-7d62650c35f8 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:25.505747 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-09d9e9fa-a26a-4b1a-b6bc-7d62650c35f8 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:25.508982 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-09d9e9fa-a26a-4b1a-b6bc-7d62650c35f8 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:25.509651 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-09d9e9fa-a26a-4b1a-b6bc-7d62650c35f8 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:25.511293 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-09d9e9fa-a26a-4b1a-b6bc-7d62650c35f8 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:25.533444 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a9aec95b-6429-4aaa-9fe1-66aeba8e9637 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:25.534070 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a9aec95b-6429-4aaa-9fe1-66aeba8e9637 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] [instance: 9a2ff223-8c41-42e2-842e-ce20821d30c8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:25.536842 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-09d9e9fa-a26a-4b1a-b6bc-7d62650c35f8 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Getting quotas for project 5e89542829e1491681b317a2c748bbbc. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:09:25.541159 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9aec95b-6429-4aaa-9fe1-66aeba8e9637 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:25.541658 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9aec95b-6429-4aaa-9fe1-66aeba8e9637 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:25.542098 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9aec95b-6429-4aaa-9fe1-66aeba8e9637 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:25.542877 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9aec95b-6429-4aaa-9fe1-66aeba8e9637 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:25.543295 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9aec95b-6429-4aaa-9fe1-66aeba8e9637 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:25.543932 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9aec95b-6429-4aaa-9fe1-66aeba8e9637 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:25.544551 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-09d9e9fa-a26a-4b1a-b6bc-7d62650c35f8 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Getting quotas for user da5a85b4b060444abea51d5ef25c3378 and project 5e89542829e1491681b317a2c748bbbc. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:09:25.562204 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-09d9e9fa-a26a-4b1a-b6bc-7d62650c35f8 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:09:25.565860 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-09d9e9fa-a26a-4b1a-b6bc-7d62650c35f8 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] [instance: 79d4afff-11d8-4d63-b972-5d9c220b44c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:09:25.635061 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-09d9e9fa-a26a-4b1a-b6bc-7d62650c35f8 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.124080 Sep 10 12:09:25.636233 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2839/5685] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:09:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 1126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:09:25.649085 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a5f648e4-b418-4a57-ac4d-185148259de3 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:25.650067 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a5f648e4-b418-4a57-ac4d-185148259de3 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] [instance: 79d4afff-11d8-4d63-b972-5d9c220b44c6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:25.758360 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a5f648e4-b418-4a57-ac4d-185148259de3 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5a85b4b060444abea51d5ef25c3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e89542829e1491681b317a2c748bbbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:25.763350 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a9aec95b-6429-4aaa-9fe1-66aeba8e9637 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f118157cdc24b8ab7d6c5f2c3eb010b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ef782c352400f9c7fc56781ded1e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:25.768450 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a5f648e4-b418-4a57-ac4d-185148259de3 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] 10.222.0.23 "GET /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6" status: 200 len: 1301 microversion: 2.1 time: 0.122672 Sep 10 12:09:25.770267 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2840/5686] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:25 2022] GET /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6 => generated 1301 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:25.774457 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a9aec95b-6429-4aaa-9fe1-66aeba8e9637 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] 10.222.0.23 "GET /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8" status: 200 len: 1521 microversion: 2.1 time: 0.244883 Sep 10 12:09:25.786571 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2847/5687] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:25 2022] GET /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:09:25.802209 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2acc6837-b7c9-4147-9c52-0adf680c2c24 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:25.803010 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2acc6837-b7c9-4147-9c52-0adf680c2c24 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] [instance: 9a2ff223-8c41-42e2-842e-ce20821d30c8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:25.810357 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2acc6837-b7c9-4147-9c52-0adf680c2c24 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:25.812986 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2acc6837-b7c9-4147-9c52-0adf680c2c24 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:25.813733 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2acc6837-b7c9-4147-9c52-0adf680c2c24 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:25.815911 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2acc6837-b7c9-4147-9c52-0adf680c2c24 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:25.816690 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2acc6837-b7c9-4147-9c52-0adf680c2c24 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:25.817373 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2acc6837-b7c9-4147-9c52-0adf680c2c24 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:25.846555 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-2acc6837-b7c9-4147-9c52-0adf680c2c24 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] HTTP exception thrown: Instance is not a member of specified network Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2acc6837-b7c9-4147-9c52-0adf680c2c24 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Request method failure captured: Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8/ips/invalid HTTP/1.1 Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH5esyeAHoHVGwOPTS5KRtPGmHR5KbhdUG7UrV_RadM74ABRrX3ZUGCd0hRQ5qImj9GVn9j1jV89BiTYgR3TWL9p0GxD4D8m0cUicQIp_pEWq9HkWkA-GqJeVr8QdtSu01ODuHY4L1O26i1rJ2Q9XIC3E6XudKdzkEbT5XO9CQceKM8 Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 8b4ef782c352400f9c7fc56781ded1e6 Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1308940923 Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8b4ef782c352400f9c7fc56781ded1e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8b4ef782c352400f9c7fc56781ded1e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8b4ef782c352400f9c7fc56781ded1e6", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8b4ef782c352400f9c7fc56781ded1e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1308940923 Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 8b4ef782c352400f9c7fc56781ded1e6 Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1308940923 Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServerAddressesNegativeTestJSON-1308940923-project Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 6f118157cdc24b8ab7d6c5f2c3eb010b Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1308940923-project Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance is not a member of specified network Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'server_id': '9a2ff223-8c41-42e2-842e-ce20821d30c8', 'id': 'invalid'} Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Sep 10 12:09:25.855310 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:09:25.860470 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2acc6837-b7c9-4147-9c52-0adf680c2c24 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Returning 404 to user: Instance is not a member of specified network {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:09:25.862982 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2acc6837-b7c9-4147-9c52-0adf680c2c24 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] 10.222.0.23 "GET /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.065653 Sep 10 12:09:25.867853 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2841/5688] 10.222.0.23 () {58 vars in 1272 bytes} [Sat Sep 10 12:09:25 2022] GET /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8/ips/invalid => generated 91 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 12:09:25.873123 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f15ae206-1224-4116-a929-72555f7990d8 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:25.873454 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f15ae206-1224-4116-a929-72555f7990d8 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Failed to fetch instance by id 999 {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 10 12:09:25.873972 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-f15ae206-1224-4116-a929-72555f7990d8 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] HTTP exception thrown: Instance 999 could not be found. Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f15ae206-1224-4116-a929-72555f7990d8 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Request method failure captured: Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH5esyeAHoHVGwOPTS5KRtPGmHR5KbhdUG7UrV_RadM74ABRrX3ZUGCd0hRQ5qImj9GVn9j1jV89BiTYgR3TWL9p0GxD4D8m0cUicQIp_pEWq9HkWkA-GqJeVr8QdtSu01ODuHY4L1O26i1rJ2Q9XIC3E6XudKdzkEbT5XO9CQceKM8 Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 8b4ef782c352400f9c7fc56781ded1e6 Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1308940923 Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8b4ef782c352400f9c7fc56781ded1e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8b4ef782c352400f9c7fc56781ded1e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8b4ef782c352400f9c7fc56781ded1e6", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8b4ef782c352400f9c7fc56781ded1e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1308940923 Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 8b4ef782c352400f9c7fc56781ded1e6 Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1308940923 Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServerAddressesNegativeTestJSON-1308940923-project Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 6f118157cdc24b8ab7d6c5f2c3eb010b Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1308940923-project Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 999 could not be found. Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'server_id': '999'} Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 10 12:09:25.875894 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:09:25.879810 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f15ae206-1224-4116-a929-72555f7990d8 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Returning 404 to user: Instance 999 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:09:25.879810 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f15ae206-1224-4116-a929-72555f7990d8 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] 10.222.0.23 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.008449 Sep 10 12:09:25.879810 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2848/5689] 10.222.0.23 () {58 vars in 1149 bytes} [Sat Sep 10 12:09:25 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 10 12:09:25.888675 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-81413376-b540-4ae8-944e-fc09e14d66a7 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:25.889172 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-81413376-b540-4ae8-944e-fc09e14d66a7 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] [instance: 9a2ff223-8c41-42e2-842e-ce20821d30c8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:25.897692 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-81413376-b540-4ae8-944e-fc09e14d66a7 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:25.898252 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-81413376-b540-4ae8-944e-fc09e14d66a7 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:25.898698 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-81413376-b540-4ae8-944e-fc09e14d66a7 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:25.899467 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-81413376-b540-4ae8-944e-fc09e14d66a7 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:25.899925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-81413376-b540-4ae8-944e-fc09e14d66a7 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:25.900350 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-81413376-b540-4ae8-944e-fc09e14d66a7 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:25.974735 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-81413376-b540-4ae8-944e-fc09e14d66a7 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] [instance: 9a2ff223-8c41-42e2-842e-ce20821d30c8] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:09:26.108522 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-81413376-b540-4ae8-944e-fc09e14d66a7 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8" status: 204 len: 0 microversion: 2.1 time: 0.222456 Sep 10 12:09:26.109804 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2842/5690] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:09:25 2022] DELETE /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:09:26.119935 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f5214c29-9b1d-48f2-94a2-b2b81347c895 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:26.121117 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f5214c29-9b1d-48f2-94a2-b2b81347c895 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] [instance: 9a2ff223-8c41-42e2-842e-ce20821d30c8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:26.133769 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f5214c29-9b1d-48f2-94a2-b2b81347c895 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:26.139974 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f5214c29-9b1d-48f2-94a2-b2b81347c895 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:26.142010 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f5214c29-9b1d-48f2-94a2-b2b81347c895 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:26.143648 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f5214c29-9b1d-48f2-94a2-b2b81347c895 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:26.144518 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f5214c29-9b1d-48f2-94a2-b2b81347c895 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:26.145217 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f5214c29-9b1d-48f2-94a2-b2b81347c895 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:26.379212 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f5214c29-9b1d-48f2-94a2-b2b81347c895 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f118157cdc24b8ab7d6c5f2c3eb010b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ef782c352400f9c7fc56781ded1e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:26.389043 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f5214c29-9b1d-48f2-94a2-b2b81347c895 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] 10.222.0.23 "GET /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8" status: 200 len: 1527 microversion: 2.1 time: 0.274397 Sep 10 12:09:26.389848 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2849/5691] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:26 2022] GET /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8 => generated 1527 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:26.440080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-91c84758-d64e-4628-aaea-7d83a4b1607f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:26.443555 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-91c84758-d64e-4628-aaea-7d83a4b1607f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: f4da91bc-acbf-487b-b305-a619df7ad3f8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:26.457053 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-91c84758-d64e-4628-aaea-7d83a4b1607f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:26.457496 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-91c84758-d64e-4628-aaea-7d83a4b1607f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:26.458041 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-91c84758-d64e-4628-aaea-7d83a4b1607f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:26.459308 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-91c84758-d64e-4628-aaea-7d83a4b1607f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:26.459857 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-91c84758-d64e-4628-aaea-7d83a4b1607f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:26.461358 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-91c84758-d64e-4628-aaea-7d83a4b1607f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:26.497580 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:09:26.508177 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-91c84758-d64e-4628-aaea-7d83a4b1607f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073940 Sep 10 12:09:26.514351 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2843/5692] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:09:26 2022] GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:09:26.793104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3c2186c8-434d-4def-99ed-cbf2cd7f7174 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:26.794185 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3c2186c8-434d-4def-99ed-cbf2cd7f7174 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] [instance: 79d4afff-11d8-4d63-b972-5d9c220b44c6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:26.819055 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3c2186c8-434d-4def-99ed-cbf2cd7f7174 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:26.819507 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3c2186c8-434d-4def-99ed-cbf2cd7f7174 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:26.819953 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3c2186c8-434d-4def-99ed-cbf2cd7f7174 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:26.820661 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3c2186c8-434d-4def-99ed-cbf2cd7f7174 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:26.822614 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3c2186c8-434d-4def-99ed-cbf2cd7f7174 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:26.823049 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3c2186c8-434d-4def-99ed-cbf2cd7f7174 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:26.918870 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3c2186c8-434d-4def-99ed-cbf2cd7f7174 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5a85b4b060444abea51d5ef25c3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e89542829e1491681b317a2c748bbbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:26.928807 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3c2186c8-434d-4def-99ed-cbf2cd7f7174 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] 10.222.0.23 "GET /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6" status: 200 len: 1353 microversion: 2.1 time: 0.141342 Sep 10 12:09:26.930068 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2850/5693] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:26 2022] GET /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6 => generated 1353 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:27.413393 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1e3e5990-5660-47c8-b760-c9c2c3af7ddf tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:27.414318 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1e3e5990-5660-47c8-b760-c9c2c3af7ddf tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] [instance: 9a2ff223-8c41-42e2-842e-ce20821d30c8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:27.421591 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1e3e5990-5660-47c8-b760-c9c2c3af7ddf tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:27.422218 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1e3e5990-5660-47c8-b760-c9c2c3af7ddf tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:27.422870 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1e3e5990-5660-47c8-b760-c9c2c3af7ddf tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:27.424566 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1e3e5990-5660-47c8-b760-c9c2c3af7ddf tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:27.425131 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1e3e5990-5660-47c8-b760-c9c2c3af7ddf tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:27.425661 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1e3e5990-5660-47c8-b760-c9c2c3af7ddf tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:27.521944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3fee712d-fd9d-4b49-89c9-f92467a6a979 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:27.524336 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3fee712d-fd9d-4b49-89c9-f92467a6a979 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: f4da91bc-acbf-487b-b305-a619df7ad3f8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:27.552792 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3fee712d-fd9d-4b49-89c9-f92467a6a979 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:27.553292 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3fee712d-fd9d-4b49-89c9-f92467a6a979 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:27.553737 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3fee712d-fd9d-4b49-89c9-f92467a6a979 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:27.554453 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3fee712d-fd9d-4b49-89c9-f92467a6a979 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:27.556792 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3fee712d-fd9d-4b49-89c9-f92467a6a979 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:27.557508 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3fee712d-fd9d-4b49-89c9-f92467a6a979 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:27.615932 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3fee712d-fd9d-4b49-89c9-f92467a6a979 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096895 Sep 10 12:09:27.622353 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2851/5694] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:09:27 2022] GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:09:27.687494 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1e3e5990-5660-47c8-b760-c9c2c3af7ddf tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f118157cdc24b8ab7d6c5f2c3eb010b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ef782c352400f9c7fc56781ded1e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:27.698093 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1e3e5990-5660-47c8-b760-c9c2c3af7ddf tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] 10.222.0.23 "GET /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8" status: 200 len: 1527 microversion: 2.1 time: 0.288790 Sep 10 12:09:27.714745 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2844/5695] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:27 2022] GET /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8 => generated 1527 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:27.960349 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4903b271-7f38-4135-bf83-4da8c7909f82 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:27.961258 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4903b271-7f38-4135-bf83-4da8c7909f82 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] [instance: 79d4afff-11d8-4d63-b972-5d9c220b44c6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:27.972243 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4903b271-7f38-4135-bf83-4da8c7909f82 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:27.973210 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4903b271-7f38-4135-bf83-4da8c7909f82 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:27.989360 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4903b271-7f38-4135-bf83-4da8c7909f82 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:27.990490 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4903b271-7f38-4135-bf83-4da8c7909f82 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:27.993385 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4903b271-7f38-4135-bf83-4da8c7909f82 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:27.996168 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4903b271-7f38-4135-bf83-4da8c7909f82 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:28.274439 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4903b271-7f38-4135-bf83-4da8c7909f82 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5a85b4b060444abea51d5ef25c3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e89542829e1491681b317a2c748bbbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:28.289420 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4903b271-7f38-4135-bf83-4da8c7909f82 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] 10.222.0.23 "GET /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6" status: 200 len: 1359 microversion: 2.1 time: 0.339513 Sep 10 12:09:28.290405 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2852/5696] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:27 2022] GET /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6 => generated 1359 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:28.630500 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-344a9400-6d40-41d2-bfde-1e07a2e9311c tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:28.639795 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-344a9400-6d40-41d2-bfde-1e07a2e9311c tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: f4da91bc-acbf-487b-b305-a619df7ad3f8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:28.687556 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-344a9400-6d40-41d2-bfde-1e07a2e9311c tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:28.688274 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-344a9400-6d40-41d2-bfde-1e07a2e9311c tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:28.692650 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-344a9400-6d40-41d2-bfde-1e07a2e9311c tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:28.696936 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-344a9400-6d40-41d2-bfde-1e07a2e9311c tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:28.697504 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-344a9400-6d40-41d2-bfde-1e07a2e9311c tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:28.697968 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-344a9400-6d40-41d2-bfde-1e07a2e9311c tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:28.725847 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d0081191-ab38-407d-93c3-576014f48c1c tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:28.727340 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d0081191-ab38-407d-93c3-576014f48c1c tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] [instance: 9a2ff223-8c41-42e2-842e-ce20821d30c8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:28.739001 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d0081191-ab38-407d-93c3-576014f48c1c tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:28.749451 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d0081191-ab38-407d-93c3-576014f48c1c tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:28.753249 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d0081191-ab38-407d-93c3-576014f48c1c tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:28.754228 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d0081191-ab38-407d-93c3-576014f48c1c tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:28.756390 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d0081191-ab38-407d-93c3-576014f48c1c tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:28.757028 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d0081191-ab38-407d-93c3-576014f48c1c tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:28.865951 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d0081191-ab38-407d-93c3-576014f48c1c tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f118157cdc24b8ab7d6c5f2c3eb010b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b4ef782c352400f9c7fc56781ded1e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:28.870996 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-344a9400-6d40-41d2-bfde-1e07a2e9311c tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.245164 Sep 10 12:09:28.875073 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d0081191-ab38-407d-93c3-576014f48c1c tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] 10.222.0.23 "GET /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8" status: 200 len: 1485 microversion: 2.1 time: 0.154954 Sep 10 12:09:28.876355 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2845/5698] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:09:28 2022] GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8/os-volume_attachments => generated 197 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:09:28.876559 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2853/5698] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:28 2022] GET /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8 => generated 1485 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:09:28.891940 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-699004d8-66f7-41cf-909b-37ac271f6ea5 req-5008d276-20e4-43c8-a7c8-c8dc92b753af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a2ff223-8c41-42e2-842e-ce20821d30c8", "name": "network-vif-deleted", "tag": "b19aa0f1-855b-4662-96a9-88a3313aead6"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:09:28.913446 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-699004d8-66f7-41cf-909b-37ac271f6ea5 req-5008d276-20e4-43c8-a7c8-c8dc92b753af service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:28.914910 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-699004d8-66f7-41cf-909b-37ac271f6ea5 req-5008d276-20e4-43c8-a7c8-c8dc92b753af service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:28.918390 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-699004d8-66f7-41cf-909b-37ac271f6ea5 req-5008d276-20e4-43c8-a7c8-c8dc92b753af service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:28.952653 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-699004d8-66f7-41cf-909b-37ac271f6ea5 req-5008d276-20e4-43c8-a7c8-c8dc92b753af service nova] Creating event network-vif-deleted:b19aa0f1-855b-4662-96a9-88a3313aead6 for instance 9a2ff223-8c41-42e2-842e-ce20821d30c8 on n-h1-856895-1 Sep 10 12:09:28.965766 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-699004d8-66f7-41cf-909b-37ac271f6ea5 req-5008d276-20e4-43c8-a7c8-c8dc92b753af service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083416 Sep 10 12:09:28.967199 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2846/5699] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:09:29.313426 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a1d66539-8979-4b62-998c-81ec245b37fd tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:29.314932 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a1d66539-8979-4b62-998c-81ec245b37fd tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] [instance: 79d4afff-11d8-4d63-b972-5d9c220b44c6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:29.326495 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a1d66539-8979-4b62-998c-81ec245b37fd tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:29.332247 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a1d66539-8979-4b62-998c-81ec245b37fd tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:29.333548 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a1d66539-8979-4b62-998c-81ec245b37fd tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:29.334572 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a1d66539-8979-4b62-998c-81ec245b37fd tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:29.335238 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a1d66539-8979-4b62-998c-81ec245b37fd tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:29.335876 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a1d66539-8979-4b62-998c-81ec245b37fd tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:29.686582 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a1d66539-8979-4b62-998c-81ec245b37fd tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5a85b4b060444abea51d5ef25c3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e89542829e1491681b317a2c748bbbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:29.700963 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a1d66539-8979-4b62-998c-81ec245b37fd tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] 10.222.0.23 "GET /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6" status: 200 len: 1426 microversion: 2.1 time: 0.390477 Sep 10 12:09:29.701587 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2854/5700] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:29 2022] GET /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6 => generated 1426 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:29.826582 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-d3dbbb0f-e0b0-432a-804c-ee790c84322f req-e411dccd-6e72-4766-8709-ed0fcf9a1bf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79d4afff-11d8-4d63-b972-5d9c220b44c6", "tag": "f527e147-043b-4458-9562-cd8b9f942e3b"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:09:29.835014 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:09:29.843142 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d3dbbb0f-e0b0-432a-804c-ee790c84322f req-e411dccd-6e72-4766-8709-ed0fcf9a1bf6 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:29.848493 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d3dbbb0f-e0b0-432a-804c-ee790c84322f req-e411dccd-6e72-4766-8709-ed0fcf9a1bf6 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:29.849209 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d3dbbb0f-e0b0-432a-804c-ee790c84322f req-e411dccd-6e72-4766-8709-ed0fcf9a1bf6 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:29.886902 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a7bfadab-6f0e-47b8-85e1-ce1e0283ceb2 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:29.889988 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a7bfadab-6f0e-47b8-85e1-ce1e0283ceb2 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: f4da91bc-acbf-487b-b305-a619df7ad3f8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:29.900832 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-d3dbbb0f-e0b0-432a-804c-ee790c84322f req-e411dccd-6e72-4766-8709-ed0fcf9a1bf6 service nova] Creating event network-changed:f527e147-043b-4458-9562-cd8b9f942e3b for instance 79d4afff-11d8-4d63-b972-5d9c220b44c6 on n-h2-856895-1 Sep 10 12:09:29.910030 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a7bfadab-6f0e-47b8-85e1-ce1e0283ceb2 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:29.911155 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a7bfadab-6f0e-47b8-85e1-ce1e0283ceb2 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:29.911803 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a7bfadab-6f0e-47b8-85e1-ce1e0283ceb2 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:29.912688 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a7bfadab-6f0e-47b8-85e1-ce1e0283ceb2 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:29.913302 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a7bfadab-6f0e-47b8-85e1-ce1e0283ceb2 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:29.913887 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a7bfadab-6f0e-47b8-85e1-ce1e0283ceb2 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:29.917564 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-d3dbbb0f-e0b0-432a-804c-ee790c84322f req-e411dccd-6e72-4766-8709-ed0fcf9a1bf6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102621 Sep 10 12:09:29.921555 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2847/5701] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:09:29.932108 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-24e209ec-3779-4029-88ac-86964372b687 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:29.933820 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-24e209ec-3779-4029-88ac-86964372b687 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] [instance: 9a2ff223-8c41-42e2-842e-ce20821d30c8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:29.951858 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-24e209ec-3779-4029-88ac-86964372b687 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:29.954386 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-24e209ec-3779-4029-88ac-86964372b687 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:29.957342 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-24e209ec-3779-4029-88ac-86964372b687 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:29.960690 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-24e209ec-3779-4029-88ac-86964372b687 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:29.962689 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-24e209ec-3779-4029-88ac-86964372b687 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:29.963528 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-24e209ec-3779-4029-88ac-86964372b687 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:29.972225 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a7bfadab-6f0e-47b8-85e1-ce1e0283ceb2 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089468 Sep 10 12:09:29.973455 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2855/5702] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:09:29 2022] GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:09:29.987956 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-24e209ec-3779-4029-88ac-86964372b687 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] HTTP exception thrown: Instance 9a2ff223-8c41-42e2-842e-ce20821d30c8 could not be found. Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-24e209ec-3779-4029-88ac-86964372b687 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Request method failure captured: Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8 HTTP/1.1 Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH5esyeAHoHVGwOPTS5KRtPGmHR5KbhdUG7UrV_RadM74ABRrX3ZUGCd0hRQ5qImj9GVn9j1jV89BiTYgR3TWL9p0GxD4D8m0cUicQIp_pEWq9HkWkA-GqJeVr8QdtSu01ODuHY4L1O26i1rJ2Q9XIC3E6XudKdzkEbT5XO9CQceKM8 Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 8b4ef782c352400f9c7fc56781ded1e6 Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1308940923 Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8b4ef782c352400f9c7fc56781ded1e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8b4ef782c352400f9c7fc56781ded1e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8b4ef782c352400f9c7fc56781ded1e6", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8b4ef782c352400f9c7fc56781ded1e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1308940923 Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 8b4ef782c352400f9c7fc56781ded1e6 Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1308940923 Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServerAddressesNegativeTestJSON-1308940923-project Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 6f118157cdc24b8ab7d6c5f2c3eb010b Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1308940923-project Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 9a2ff223-8c41-42e2-842e-ce20821d30c8 could not be found. Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '9a2ff223-8c41-42e2-842e-ce20821d30c8'} Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a2ff223-8c41-42e2-842e-ce20821d30c8 could not be found. Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a2ff223-8c41-42e2-842e-ce20821d30c8 could not be found. Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:09:29.989983 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:09:29.994103 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:09:29.994103 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:09:29.994103 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:09:29.994103 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:09:29.994103 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:09:29.994103 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:09:29.994103 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a2ff223-8c41-42e2-842e-ce20821d30c8 could not be found. Sep 10 12:09:29.994103 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:09:29.996386 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-24e209ec-3779-4029-88ac-86964372b687 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] Returning 404 to user: Instance 9a2ff223-8c41-42e2-842e-ce20821d30c8 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:09:29.997704 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-24e209ec-3779-4029-88ac-86964372b687 tempest-ServerAddressesNegativeTestJSON-1308940923 tempest-ServerAddressesNegativeTestJSON-1308940923-project] 10.222.0.23 "GET /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8" status: 404 len: 111 microversion: 2.1 time: 0.074824 Sep 10 12:09:29.998841 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2848/5703] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:29 2022] GET /compute/v2.1/servers/9a2ff223-8c41-42e2-842e-ce20821d30c8 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:09:30.724419 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-323f8f9e-19f6-405a-b171-a031481b434d tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:30.725043 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-323f8f9e-19f6-405a-b171-a031481b434d tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] [instance: 79d4afff-11d8-4d63-b972-5d9c220b44c6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:30.740321 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-323f8f9e-19f6-405a-b171-a031481b434d tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:30.740825 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-323f8f9e-19f6-405a-b171-a031481b434d tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:30.744218 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-323f8f9e-19f6-405a-b171-a031481b434d tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:30.745177 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-323f8f9e-19f6-405a-b171-a031481b434d tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:30.748650 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-323f8f9e-19f6-405a-b171-a031481b434d tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:30.749268 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-323f8f9e-19f6-405a-b171-a031481b434d tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:30.987061 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7b65bbf6-22a8-4a75-a8f4-8d6844ca0765 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:30.989578 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7b65bbf6-22a8-4a75-a8f4-8d6844ca0765 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: f4da91bc-acbf-487b-b305-a619df7ad3f8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:31.005560 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b65bbf6-22a8-4a75-a8f4-8d6844ca0765 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:31.007404 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b65bbf6-22a8-4a75-a8f4-8d6844ca0765 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:31.008907 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b65bbf6-22a8-4a75-a8f4-8d6844ca0765 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:31.011973 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b65bbf6-22a8-4a75-a8f4-8d6844ca0765 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:31.012676 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b65bbf6-22a8-4a75-a8f4-8d6844ca0765 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:31.013278 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b65bbf6-22a8-4a75-a8f4-8d6844ca0765 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:31.079636 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7b65bbf6-22a8-4a75-a8f4-8d6844ca0765 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097795 Sep 10 12:09:31.081385 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2849/5704] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:09:30 2022] GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:09:31.231111 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-323f8f9e-19f6-405a-b171-a031481b434d tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5a85b4b060444abea51d5ef25c3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e89542829e1491681b317a2c748bbbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:31.239979 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-323f8f9e-19f6-405a-b171-a031481b434d tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] 10.222.0.23 "GET /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6" status: 200 len: 1426 microversion: 2.1 time: 0.519792 Sep 10 12:09:31.240555 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2856/5705] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:30 2022] GET /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6 => generated 1426 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:32.093200 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-917d7a63-9418-495b-9bff-9274f976c75a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:32.096881 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-917d7a63-9418-495b-9bff-9274f976c75a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: f4da91bc-acbf-487b-b305-a619df7ad3f8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:32.114880 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-917d7a63-9418-495b-9bff-9274f976c75a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:32.115414 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-917d7a63-9418-495b-9bff-9274f976c75a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:32.115854 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-917d7a63-9418-495b-9bff-9274f976c75a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:32.116571 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-917d7a63-9418-495b-9bff-9274f976c75a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:32.117023 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-917d7a63-9418-495b-9bff-9274f976c75a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:32.117449 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-917d7a63-9418-495b-9bff-9274f976c75a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:32.187873 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-917d7a63-9418-495b-9bff-9274f976c75a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.098558 Sep 10 12:09:32.189582 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2850/5706] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:09:32 2022] GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8/os-volume_attachments => generated 25 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 12:09:32.265628 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4a6cbd81-6a5f-4cb3-8308-8a6a95b6bcea tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:32.266256 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4a6cbd81-6a5f-4cb3-8308-8a6a95b6bcea tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] [instance: 79d4afff-11d8-4d63-b972-5d9c220b44c6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:32.284924 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4a6cbd81-6a5f-4cb3-8308-8a6a95b6bcea tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:32.286479 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4a6cbd81-6a5f-4cb3-8308-8a6a95b6bcea tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:32.287745 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4a6cbd81-6a5f-4cb3-8308-8a6a95b6bcea tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:32.289710 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4a6cbd81-6a5f-4cb3-8308-8a6a95b6bcea tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:32.295080 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4a6cbd81-6a5f-4cb3-8308-8a6a95b6bcea tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:32.296016 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4a6cbd81-6a5f-4cb3-8308-8a6a95b6bcea tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:32.323729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d11179ea-15ac-47d0-9710-11ea07429e8a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:32.324486 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d11179ea-15ac-47d0-9710-11ea07429e8a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: f4da91bc-acbf-487b-b305-a619df7ad3f8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:32.337754 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d11179ea-15ac-47d0-9710-11ea07429e8a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:32.341517 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d11179ea-15ac-47d0-9710-11ea07429e8a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:32.342064 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d11179ea-15ac-47d0-9710-11ea07429e8a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:32.343484 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d11179ea-15ac-47d0-9710-11ea07429e8a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:32.345806 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d11179ea-15ac-47d0-9710-11ea07429e8a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:32.347967 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d11179ea-15ac-47d0-9710-11ea07429e8a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:32.421233 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d11179ea-15ac-47d0-9710-11ea07429e8a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: f4da91bc-acbf-487b-b305-a619df7ad3f8] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:09:32.561331 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d11179ea-15ac-47d0-9710-11ea07429e8a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8" status: 204 len: 0 microversion: 2.1 time: 0.240982 Sep 10 12:09:32.564043 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2851/5707] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:09:32 2022] DELETE /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 12:09:32.574944 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9d00f550-4c7e-479f-8d74-0ca163c03b03 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:32.576251 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9d00f550-4c7e-479f-8d74-0ca163c03b03 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: f4da91bc-acbf-487b-b305-a619df7ad3f8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:32.583743 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9d00f550-4c7e-479f-8d74-0ca163c03b03 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:32.584909 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9d00f550-4c7e-479f-8d74-0ca163c03b03 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:32.585622 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9d00f550-4c7e-479f-8d74-0ca163c03b03 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:32.587002 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9d00f550-4c7e-479f-8d74-0ca163c03b03 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:32.587866 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9d00f550-4c7e-479f-8d74-0ca163c03b03 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:32.588765 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9d00f550-4c7e-479f-8d74-0ca163c03b03 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:32.857415 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4a6cbd81-6a5f-4cb3-8308-8a6a95b6bcea tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5a85b4b060444abea51d5ef25c3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e89542829e1491681b317a2c748bbbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:32.869571 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4a6cbd81-6a5f-4cb3-8308-8a6a95b6bcea tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] 10.222.0.23 "GET /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6" status: 200 len: 1426 microversion: 2.1 time: 0.609513 Sep 10 12:09:32.888475 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2857/5708] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:32 2022] GET /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6 => generated 1426 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:33.131997 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9d00f550-4c7e-479f-8d74-0ca163c03b03 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:33.148997 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9d00f550-4c7e-479f-8d74-0ca163c03b03 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8" status: 200 len: 1684 microversion: 2.1 time: 0.577529 Sep 10 12:09:33.150487 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2852/5709] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:32 2022] GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8 => generated 1684 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:33.896665 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b7f10ad0-93c5-4343-9e2e-2fe1dad3d9f6 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:33.897940 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b7f10ad0-93c5-4343-9e2e-2fe1dad3d9f6 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] [instance: 79d4afff-11d8-4d63-b972-5d9c220b44c6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:33.902639 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:09:33.922996 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7f10ad0-93c5-4343-9e2e-2fe1dad3d9f6 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:33.928690 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7f10ad0-93c5-4343-9e2e-2fe1dad3d9f6 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:33.929266 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7f10ad0-93c5-4343-9e2e-2fe1dad3d9f6 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:33.930030 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7f10ad0-93c5-4343-9e2e-2fe1dad3d9f6 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:33.930548 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7f10ad0-93c5-4343-9e2e-2fe1dad3d9f6 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:33.930988 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7f10ad0-93c5-4343-9e2e-2fe1dad3d9f6 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:34.181460 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b7f10ad0-93c5-4343-9e2e-2fe1dad3d9f6 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5a85b4b060444abea51d5ef25c3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e89542829e1491681b317a2c748bbbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:34.181751 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0e44d1d1-07b0-4194-be92-20530ac28e5b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:34.182233 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0e44d1d1-07b0-4194-be92-20530ac28e5b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: f4da91bc-acbf-487b-b305-a619df7ad3f8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:34.192143 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b7f10ad0-93c5-4343-9e2e-2fe1dad3d9f6 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] 10.222.0.23 "GET /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6" status: 200 len: 1426 microversion: 2.1 time: 0.300123 Sep 10 12:09:34.195152 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e44d1d1-07b0-4194-be92-20530ac28e5b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:34.203901 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e44d1d1-07b0-4194-be92-20530ac28e5b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:34.204331 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e44d1d1-07b0-4194-be92-20530ac28e5b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:34.205343 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2858/5710] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:33 2022] GET /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6 => generated 1426 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:34.206997 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e44d1d1-07b0-4194-be92-20530ac28e5b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:34.207526 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e44d1d1-07b0-4194-be92-20530ac28e5b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:34.207974 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e44d1d1-07b0-4194-be92-20530ac28e5b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:35.160477 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0e44d1d1-07b0-4194-be92-20530ac28e5b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:35.171956 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0e44d1d1-07b0-4194-be92-20530ac28e5b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8" status: 200 len: 1684 microversion: 2.1 time: 0.994295 Sep 10 12:09:35.179105 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2853/5711] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:34 2022] GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8 => generated 1684 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:09:35.217094 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-99c95bdc-0ffa-4237-ba06-2ce14c545a62 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:35.218519 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-99c95bdc-0ffa-4237-ba06-2ce14c545a62 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] [instance: 79d4afff-11d8-4d63-b972-5d9c220b44c6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:35.231116 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-99c95bdc-0ffa-4237-ba06-2ce14c545a62 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:35.234042 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-99c95bdc-0ffa-4237-ba06-2ce14c545a62 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:35.234812 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-99c95bdc-0ffa-4237-ba06-2ce14c545a62 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:35.237171 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-99c95bdc-0ffa-4237-ba06-2ce14c545a62 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:35.237900 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-99c95bdc-0ffa-4237-ba06-2ce14c545a62 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:35.239640 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-99c95bdc-0ffa-4237-ba06-2ce14c545a62 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:35.524924 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-99c95bdc-0ffa-4237-ba06-2ce14c545a62 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5a85b4b060444abea51d5ef25c3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e89542829e1491681b317a2c748bbbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:35.536369 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-99c95bdc-0ffa-4237-ba06-2ce14c545a62 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] 10.222.0.23 "GET /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6" status: 200 len: 1426 microversion: 2.1 time: 0.323618 Sep 10 12:09:35.539911 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2859/5712] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:35 2022] GET /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6 => generated 1426 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:36.203879 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-78c467c1-46d7-47a0-81d5-3f57b487d20d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:36.204932 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-78c467c1-46d7-47a0-81d5-3f57b487d20d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: f4da91bc-acbf-487b-b305-a619df7ad3f8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:36.211769 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:09:36.214657 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=16 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:09:36.231698 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78c467c1-46d7-47a0-81d5-3f57b487d20d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:36.232202 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78c467c1-46d7-47a0-81d5-3f57b487d20d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:36.232645 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78c467c1-46d7-47a0-81d5-3f57b487d20d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:36.233981 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78c467c1-46d7-47a0-81d5-3f57b487d20d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:36.234699 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78c467c1-46d7-47a0-81d5-3f57b487d20d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:36.235550 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78c467c1-46d7-47a0-81d5-3f57b487d20d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:36.549257 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-78c467c1-46d7-47a0-81d5-3f57b487d20d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:36.563821 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-78c467c1-46d7-47a0-81d5-3f57b487d20d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8" status: 200 len: 1684 microversion: 2.1 time: 0.364187 Sep 10 12:09:36.566188 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d38667c2-26a2-49ea-9412-202f8a144d2e tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:36.566830 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d38667c2-26a2-49ea-9412-202f8a144d2e tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] [instance: 79d4afff-11d8-4d63-b972-5d9c220b44c6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:36.582166 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d38667c2-26a2-49ea-9412-202f8a144d2e tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:36.582677 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d38667c2-26a2-49ea-9412-202f8a144d2e tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:36.583127 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d38667c2-26a2-49ea-9412-202f8a144d2e tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:36.583878 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d38667c2-26a2-49ea-9412-202f8a144d2e tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:36.584347 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d38667c2-26a2-49ea-9412-202f8a144d2e tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:36.587315 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2854/5713] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:36 2022] GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8 => generated 1684 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:36.607963 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d38667c2-26a2-49ea-9412-202f8a144d2e tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:37.010013 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d38667c2-26a2-49ea-9412-202f8a144d2e tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5a85b4b060444abea51d5ef25c3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e89542829e1491681b317a2c748bbbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:37.022552 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d38667c2-26a2-49ea-9412-202f8a144d2e tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] 10.222.0.23 "GET /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6" status: 200 len: 1426 microversion: 2.1 time: 0.457632 Sep 10 12:09:37.024271 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2860/5714] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:36 2022] GET /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6 => generated 1426 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:09:37.222876 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-bd973505-433b-4322-95e9-4d5dae99608c req-5d0eb629-acbd-49bc-a440-0e21ced3890e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4da91bc-acbf-487b-b305-a619df7ad3f8", "name": "network-vif-deleted", "tag": "252ed3a1-8f35-4360-884d-18b174b63873"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:09:37.267578 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-bd973505-433b-4322-95e9-4d5dae99608c req-5d0eb629-acbd-49bc-a440-0e21ced3890e service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:37.268075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-bd973505-433b-4322-95e9-4d5dae99608c req-5d0eb629-acbd-49bc-a440-0e21ced3890e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:37.268629 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-bd973505-433b-4322-95e9-4d5dae99608c req-5d0eb629-acbd-49bc-a440-0e21ced3890e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:37.278149 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-325071cb-c448-432e-ac65-dde6bfe61155 req-573e42d5-d486-4b3a-806f-204a93b36018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79d4afff-11d8-4d63-b972-5d9c220b44c6", "name": "network-vif-plugged", "status": "completed", "tag": "f527e147-043b-4458-9562-cd8b9f942e3b"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:09:37.309604 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-325071cb-c448-432e-ac65-dde6bfe61155 req-573e42d5-d486-4b3a-806f-204a93b36018 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:37.310180 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-325071cb-c448-432e-ac65-dde6bfe61155 req-573e42d5-d486-4b3a-806f-204a93b36018 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:37.310639 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-325071cb-c448-432e-ac65-dde6bfe61155 req-573e42d5-d486-4b3a-806f-204a93b36018 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:37.312491 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-bd973505-433b-4322-95e9-4d5dae99608c req-5d0eb629-acbd-49bc-a440-0e21ced3890e service nova] Creating event network-vif-deleted:252ed3a1-8f35-4360-884d-18b174b63873 for instance f4da91bc-acbf-487b-b305-a619df7ad3f8 on n-h2-856895-1 Sep 10 12:09:37.326041 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-bd973505-433b-4322-95e9-4d5dae99608c req-5d0eb629-acbd-49bc-a440-0e21ced3890e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106441 Sep 10 12:09:37.328466 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2855/5715] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:09:37.354102 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-325071cb-c448-432e-ac65-dde6bfe61155 req-573e42d5-d486-4b3a-806f-204a93b36018 service nova] Creating event network-vif-plugged:f527e147-043b-4458-9562-cd8b9f942e3b for instance 79d4afff-11d8-4d63-b972-5d9c220b44c6 on n-h2-856895-1 Sep 10 12:09:37.381910 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-325071cb-c448-432e-ac65-dde6bfe61155 req-573e42d5-d486-4b3a-806f-204a93b36018 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101612 Sep 10 12:09:37.382843 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2861/5716] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:09:37.605646 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-66b6e38d-b84a-414a-aab8-15ea787f8922 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:37.609109 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-66b6e38d-b84a-414a-aab8-15ea787f8922 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: f4da91bc-acbf-487b-b305-a619df7ad3f8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:37.623234 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66b6e38d-b84a-414a-aab8-15ea787f8922 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:37.624573 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66b6e38d-b84a-414a-aab8-15ea787f8922 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:37.625463 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66b6e38d-b84a-414a-aab8-15ea787f8922 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:37.627442 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66b6e38d-b84a-414a-aab8-15ea787f8922 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:37.628452 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66b6e38d-b84a-414a-aab8-15ea787f8922 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:37.629111 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66b6e38d-b84a-414a-aab8-15ea787f8922 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:37.675692 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66b6e38d-b84a-414a-aab8-15ea787f8922 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:37.676616 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66b6e38d-b84a-414a-aab8-15ea787f8922 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:37.677282 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66b6e38d-b84a-414a-aab8-15ea787f8922 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:37.677959 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-66b6e38d-b84a-414a-aab8-15ea787f8922 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lazy-loading 'fault' on Instance uuid f4da91bc-acbf-487b-b305-a619df7ad3f8 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:09:37.761277 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-66b6e38d-b84a-414a-aab8-15ea787f8922 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:37.773603 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-66b6e38d-b84a-414a-aab8-15ea787f8922 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8" status: 200 len: 1332 microversion: 2.1 time: 0.183095 Sep 10 12:09:37.783225 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2856/5717] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:37 2022] GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8 => generated 1332 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:38.052469 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0c3e8f99-b7b0-4b7c-ac2f-61395ea321e0 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:38.053195 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0c3e8f99-b7b0-4b7c-ac2f-61395ea321e0 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] [instance: 79d4afff-11d8-4d63-b972-5d9c220b44c6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:38.068916 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c3e8f99-b7b0-4b7c-ac2f-61395ea321e0 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:38.070246 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c3e8f99-b7b0-4b7c-ac2f-61395ea321e0 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:38.075377 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c3e8f99-b7b0-4b7c-ac2f-61395ea321e0 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:38.076866 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c3e8f99-b7b0-4b7c-ac2f-61395ea321e0 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:38.077582 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c3e8f99-b7b0-4b7c-ac2f-61395ea321e0 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:38.078368 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c3e8f99-b7b0-4b7c-ac2f-61395ea321e0 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:38.390201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0c3e8f99-b7b0-4b7c-ac2f-61395ea321e0 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5a85b4b060444abea51d5ef25c3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e89542829e1491681b317a2c748bbbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:38.399338 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0c3e8f99-b7b0-4b7c-ac2f-61395ea321e0 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] 10.222.0.23 "GET /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6" status: 200 len: 1426 microversion: 2.1 time: 0.353042 Sep 10 12:09:38.400236 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2862/5718] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:38 2022] GET /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6 => generated 1426 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:38.798238 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6f59154e-ab18-4898-81c9-a2146fa337a8 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:38.800031 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6f59154e-ab18-4898-81c9-a2146fa337a8 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: f4da91bc-acbf-487b-b305-a619df7ad3f8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:38.815049 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6f59154e-ab18-4898-81c9-a2146fa337a8 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:38.816006 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6f59154e-ab18-4898-81c9-a2146fa337a8 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:38.816644 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6f59154e-ab18-4898-81c9-a2146fa337a8 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:38.820533 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6f59154e-ab18-4898-81c9-a2146fa337a8 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:38.821275 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6f59154e-ab18-4898-81c9-a2146fa337a8 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:38.821931 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6f59154e-ab18-4898-81c9-a2146fa337a8 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:38.857915 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-6f59154e-ab18-4898-81c9-a2146fa337a8 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] HTTP exception thrown: Instance f4da91bc-acbf-487b-b305-a619df7ad3f8 could not be found. Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6f59154e-ab18-4898-81c9-a2146fa337a8 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Request method failure captured: Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8 HTTP/1.1 Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH3f6GUP-vcGJKgYs9rYAE6OawiTmJHgZl9vlhfSbv7R_wFrnAHrNyTqDc0RuEPZi57XGfLqPVxCZc47_xRjBpcGZLWUDdhEHCEh6mtOoaNkeHxMKPICZdCuDCfpAFF9D9M9RMYBjoFdk7vZER1xOY4aTKlTJ8XZrlR1gs_K7sdx9WY Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 03301ecc81fe426bafc4be81413d1265 Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-AttachVolumeNegativeTest-637078285 Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/03301ecc81fe426bafc4be81413d1265"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/03301ecc81fe426bafc4be81413d1265"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_03301ecc81fe426bafc4be81413d1265", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/03301ecc81fe426bafc4be81413d1265"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-AttachVolumeNegativeTest-637078285 Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 03301ecc81fe426bafc4be81413d1265 Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-637078285 Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-AttachVolumeNegativeTest-637078285-project Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 199d923de84c45789188543de904314a Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-AttachVolumeNegativeTest-637078285-project Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance f4da91bc-acbf-487b-b305-a619df7ad3f8 could not be found. Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'f4da91bc-acbf-487b-b305-a619df7ad3f8'} Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4da91bc-acbf-487b-b305-a619df7ad3f8 could not be found. Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4da91bc-acbf-487b-b305-a619df7ad3f8 could not be found. Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:09:38.863298 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:09:38.867204 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:09:38.867204 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:09:38.867204 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:09:38.867204 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:09:38.867204 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:09:38.867204 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4da91bc-acbf-487b-b305-a619df7ad3f8 could not be found. Sep 10 12:09:38.867204 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:09:38.870991 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6f59154e-ab18-4898-81c9-a2146fa337a8 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Returning 404 to user: Instance f4da91bc-acbf-487b-b305-a619df7ad3f8 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:09:38.872097 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6f59154e-ab18-4898-81c9-a2146fa337a8 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8" status: 404 len: 111 microversion: 2.1 time: 0.078159 Sep 10 12:09:38.873352 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2857/5719] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:38 2022] GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:09:38.883115 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fbadd108-f37d-4ba8-a011-2c635df99586 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '.version_select at 0x7f4072459d30>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:38.922036 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fbadd108-f37d-4ba8-a011-2c635df99586 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1776930657" status: 202 len: 0 microversion: 2.1 time: 0.043945 Sep 10 12:09:38.922854 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2863/5720] 10.222.0.23 () {58 vars in 1221 bytes} [Sat Sep 10 12:09:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1776930657 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 12:09:39.432385 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-dee704d0-f68b-4075-af2c-ac0cb3ad620c tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:39.432385 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-dee704d0-f68b-4075-af2c-ac0cb3ad620c tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] [instance: 79d4afff-11d8-4d63-b972-5d9c220b44c6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:39.448023 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dee704d0-f68b-4075-af2c-ac0cb3ad620c tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:39.448570 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dee704d0-f68b-4075-af2c-ac0cb3ad620c tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:39.448836 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dee704d0-f68b-4075-af2c-ac0cb3ad620c tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:39.449574 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dee704d0-f68b-4075-af2c-ac0cb3ad620c tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:39.452300 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dee704d0-f68b-4075-af2c-ac0cb3ad620c tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:39.481778 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dee704d0-f68b-4075-af2c-ac0cb3ad620c tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:39.808840 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-dee704d0-f68b-4075-af2c-ac0cb3ad620c tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5a85b4b060444abea51d5ef25c3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e89542829e1491681b317a2c748bbbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:39.822063 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-dee704d0-f68b-4075-af2c-ac0cb3ad620c tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] 10.222.0.23 "GET /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6" status: 200 len: 1604 microversion: 2.1 time: 0.403604 Sep 10 12:09:39.834491 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2858/5721] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:39 2022] GET /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6 => generated 1604 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:39.851295 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-203654bd-7d83-4d71-9e77-8189de0f3a5b tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:39.852678 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-203654bd-7d83-4d71-9e77-8189de0f3a5b tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] [instance: 79d4afff-11d8-4d63-b972-5d9c220b44c6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:39.860716 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-203654bd-7d83-4d71-9e77-8189de0f3a5b tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:39.861720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-203654bd-7d83-4d71-9e77-8189de0f3a5b tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:39.863434 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-203654bd-7d83-4d71-9e77-8189de0f3a5b tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:39.864833 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-203654bd-7d83-4d71-9e77-8189de0f3a5b tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:39.866316 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-203654bd-7d83-4d71-9e77-8189de0f3a5b tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:39.867355 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-203654bd-7d83-4d71-9e77-8189de0f3a5b tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:39.875078 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:09:40.260607 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-203654bd-7d83-4d71-9e77-8189de0f3a5b tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5a85b4b060444abea51d5ef25c3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e89542829e1491681b317a2c748bbbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:40.275914 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-203654bd-7d83-4d71-9e77-8189de0f3a5b tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] 10.222.0.23 "GET /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6" status: 200 len: 1604 microversion: 2.1 time: 0.430678 Sep 10 12:09:40.276533 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2864/5722] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:39 2022] GET /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6 => generated 1604 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:40.300571 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-db99b167-224d-478a-8c50-f02d5f4416b5 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:40.301792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-db99b167-224d-478a-8c50-f02d5f4416b5 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] [instance: 79d4afff-11d8-4d63-b972-5d9c220b44c6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:40.308599 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db99b167-224d-478a-8c50-f02d5f4416b5 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:40.309159 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db99b167-224d-478a-8c50-f02d5f4416b5 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:40.309597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db99b167-224d-478a-8c50-f02d5f4416b5 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:40.310363 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db99b167-224d-478a-8c50-f02d5f4416b5 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:40.310832 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db99b167-224d-478a-8c50-f02d5f4416b5 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:40.311736 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db99b167-224d-478a-8c50-f02d5f4416b5 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:40.575792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-db99b167-224d-478a-8c50-f02d5f4416b5 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5a85b4b060444abea51d5ef25c3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e89542829e1491681b317a2c748bbbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:40.586407 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-db99b167-224d-478a-8c50-f02d5f4416b5 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] 10.222.0.23 "GET /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6" status: 200 len: 1604 microversion: 2.1 time: 0.291043 Sep 10 12:09:40.587661 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2859/5723] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:40 2022] GET /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6 => generated 1604 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:40.732824 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4aae8e49-a27b-4807-9b07-81a5fe9456a4 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Action: 'create', calling method: .version_select at 0x7f4072217820>, body: {"keypair": {"name": "tempest-keypair-2103385494", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIKZ386JukVkOp01LN61cEYN5i7G2uAnJfbhYdBHXPLnqDJsFz4oR1wZu2cwTM4ZhD8nzXR48Gu+mIRONw56Ot3WdsHFLyaHsDWpqYPLXBHdTofTL3hida7kGmmu/e52g=="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:09:40.753184 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-4aae8e49-a27b-4807-9b07-81a5fe9456a4 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Getting quotas for project 03301ecc81fe426bafc4be81413d1265. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:09:40.759364 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-4aae8e49-a27b-4807-9b07-81a5fe9456a4 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Getting quotas for user 199d923de84c45789188543de904314a and project 03301ecc81fe426bafc4be81413d1265. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:09:40.787393 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4aae8e49-a27b-4807-9b07-81a5fe9456a4 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.059239 Sep 10 12:09:40.788008 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2865/5724] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 12:09:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:09:44.201072 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-a9eb1244-15d4-4219-8e5f-2b5cf0acc303 req-54ef7fd4-195c-4fe1-b2c3-bd0c8f154439 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79d4afff-11d8-4d63-b972-5d9c220b44c6", "tag": "f527e147-043b-4458-9562-cd8b9f942e3b"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:09:44.228997 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a9eb1244-15d4-4219-8e5f-2b5cf0acc303 req-54ef7fd4-195c-4fe1-b2c3-bd0c8f154439 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:44.229968 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a9eb1244-15d4-4219-8e5f-2b5cf0acc303 req-54ef7fd4-195c-4fe1-b2c3-bd0c8f154439 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:44.230418 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a9eb1244-15d4-4219-8e5f-2b5cf0acc303 req-54ef7fd4-195c-4fe1-b2c3-bd0c8f154439 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:44.260949 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-a9eb1244-15d4-4219-8e5f-2b5cf0acc303 req-54ef7fd4-195c-4fe1-b2c3-bd0c8f154439 service nova] Creating event network-changed:f527e147-043b-4458-9562-cd8b9f942e3b for instance 79d4afff-11d8-4d63-b972-5d9c220b44c6 on n-h2-856895-1 Sep 10 12:09:44.302286 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-a9eb1244-15d4-4219-8e5f-2b5cf0acc303 req-54ef7fd4-195c-4fe1-b2c3-bd0c8f154439 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102154 Sep 10 12:09:44.303252 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2860/5725] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:09:44.716896 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c72a47e9-3f58-48dd-8f87-745e72f0a358 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:09:44.730477 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c72a47e9-3f58-48dd-8f87-745e72f0a358 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:44.731273 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c72a47e9-3f58-48dd-8f87-745e72f0a358 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:44.731721 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c72a47e9-3f58-48dd-8f87-745e72f0a358 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:44.792928 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c72a47e9-3f58-48dd-8f87-745e72f0a358 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Going to try to stop instance {{(pid=128776) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 10 12:09:44.909495 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c72a47e9-3f58-48dd-8f87-745e72f0a358 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "POST /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9/action" status: 202 len: 0 microversion: 2.1 time: 0.197687 Sep 10 12:09:44.912599 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2866/5726] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:09:44 2022] POST /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 12:09:44.928091 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bfd774a0-2e39-4766-b221-a4f132fe1f2f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:44.928955 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bfd774a0-2e39-4766-b221-a4f132fe1f2f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:44.946783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bfd774a0-2e39-4766-b221-a4f132fe1f2f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:44.947645 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bfd774a0-2e39-4766-b221-a4f132fe1f2f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:44.948261 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bfd774a0-2e39-4766-b221-a4f132fe1f2f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:44.949147 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bfd774a0-2e39-4766-b221-a4f132fe1f2f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:44.950113 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bfd774a0-2e39-4766-b221-a4f132fe1f2f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:44.951896 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bfd774a0-2e39-4766-b221-a4f132fe1f2f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:45.279418 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bfd774a0-2e39-4766-b221-a4f132fe1f2f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:45.292699 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bfd774a0-2e39-4766-b221-a4f132fe1f2f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1723 microversion: 2.1 time: 0.375843 Sep 10 12:09:45.294099 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2861/5727] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:44 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1723 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:45.322298 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8f85844e-f612-4bb0-8e82-80aa5198ce77 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1716048695", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e2e68d89-2e9a-4de9-a725-df4c3e2e169e"}], "security_groups": [{"name": "tempest-securitygroup--1925360400"}], "key_name": "tempest-keypair-2103385494", "user_data": "}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:09:45.474108 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-8f85844e-f612-4bb0-8e82-80aa5198ce77 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] validate_networks() for [('e2e68d89-2e9a-4de9-a725-df4c3e2e169e', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:09:45.998000 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-8f85844e-f612-4bb0-8e82-80aa5198ce77 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:09:45.998662 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-8f85844e-f612-4bb0-8e82-80aa5198ce77 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:09:45.999459 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-8f85844e-f612-4bb0-8e82-80aa5198ce77 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:09:46.000244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-8f85844e-f612-4bb0-8e82-80aa5198ce77 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:09:46.000868 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-8f85844e-f612-4bb0-8e82-80aa5198ce77 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:09:46.020463 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8f85844e-f612-4bb0-8e82-80aa5198ce77 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:46.020967 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8f85844e-f612-4bb0-8e82-80aa5198ce77 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:46.021426 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8f85844e-f612-4bb0-8e82-80aa5198ce77 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:46.022158 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8f85844e-f612-4bb0-8e82-80aa5198ce77 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:46.022624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8f85844e-f612-4bb0-8e82-80aa5198ce77 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:46.023060 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8f85844e-f612-4bb0-8e82-80aa5198ce77 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:46.060791 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-8f85844e-f612-4bb0-8e82-80aa5198ce77 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Getting quotas for project 03301ecc81fe426bafc4be81413d1265. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:09:46.067644 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-8f85844e-f612-4bb0-8e82-80aa5198ce77 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Getting quotas for user 199d923de84c45789188543de904314a and project 03301ecc81fe426bafc4be81413d1265. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:09:46.082849 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8f85844e-f612-4bb0-8e82-80aa5198ce77 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:09:46.085663 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8f85844e-f612-4bb0-8e82-80aa5198ce77 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 13779716-4716-4ab0-8699-416f441eecea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:09:46.183730 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8f85844e-f612-4bb0-8e82-80aa5198ce77 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.865995 Sep 10 12:09:46.191942 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2867/5728] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:09:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:09:46.197106 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-172130fc-6f75-4e70-8628-c0a4587dd460 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:46.197946 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-172130fc-6f75-4e70-8628-c0a4587dd460 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 13779716-4716-4ab0-8699-416f441eecea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:46.318020 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ef613b3f-61a1-4bbd-90ee-e3ea03fc1d4c tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:46.318975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ef613b3f-61a1-4bbd-90ee-e3ea03fc1d4c tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:46.339126 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ef613b3f-61a1-4bbd-90ee-e3ea03fc1d4c tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:46.346643 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ef613b3f-61a1-4bbd-90ee-e3ea03fc1d4c tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:46.351636 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ef613b3f-61a1-4bbd-90ee-e3ea03fc1d4c tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:46.352731 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ef613b3f-61a1-4bbd-90ee-e3ea03fc1d4c tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:46.353199 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ef613b3f-61a1-4bbd-90ee-e3ea03fc1d4c tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:46.353664 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ef613b3f-61a1-4bbd-90ee-e3ea03fc1d4c tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:46.381337 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-172130fc-6f75-4e70-8628-c0a4587dd460 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:46.390961 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-172130fc-6f75-4e70-8628-c0a4587dd460 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea" status: 200 len: 1242 microversion: 2.1 time: 0.197701 Sep 10 12:09:46.392113 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2862/5729] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:46 2022] GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea => generated 1242 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:46.722471 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ef613b3f-61a1-4bbd-90ee-e3ea03fc1d4c tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:46.734840 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ef613b3f-61a1-4bbd-90ee-e3ea03fc1d4c tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1723 microversion: 2.1 time: 0.421369 Sep 10 12:09:46.736660 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2868/5730] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:46 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1723 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:09:47.415382 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-be980604-1a35-4592-8cec-eca5c4695a80 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:47.416275 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-be980604-1a35-4592-8cec-eca5c4695a80 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 13779716-4716-4ab0-8699-416f441eecea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:47.431155 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be980604-1a35-4592-8cec-eca5c4695a80 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:47.432640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be980604-1a35-4592-8cec-eca5c4695a80 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:47.434163 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be980604-1a35-4592-8cec-eca5c4695a80 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:47.436645 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be980604-1a35-4592-8cec-eca5c4695a80 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:47.438749 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be980604-1a35-4592-8cec-eca5c4695a80 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:47.439663 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be980604-1a35-4592-8cec-eca5c4695a80 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:47.494310 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:09:47.666835 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-be980604-1a35-4592-8cec-eca5c4695a80 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:47.680284 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-be980604-1a35-4592-8cec-eca5c4695a80 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea" status: 200 len: 1238 microversion: 2.1 time: 0.266795 Sep 10 12:09:47.680916 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2863/5731] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:47 2022] GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea => generated 1238 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:47.762010 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-42bc6aa6-370a-41de-8251-fd9a8b5b7657 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:47.763024 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-42bc6aa6-370a-41de-8251-fd9a8b5b7657 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:47.771671 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42bc6aa6-370a-41de-8251-fd9a8b5b7657 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:47.772396 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42bc6aa6-370a-41de-8251-fd9a8b5b7657 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:47.773003 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42bc6aa6-370a-41de-8251-fd9a8b5b7657 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:47.773959 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42bc6aa6-370a-41de-8251-fd9a8b5b7657 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:47.785698 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42bc6aa6-370a-41de-8251-fd9a8b5b7657 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:47.786923 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-42bc6aa6-370a-41de-8251-fd9a8b5b7657 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:48.045274 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-42bc6aa6-370a-41de-8251-fd9a8b5b7657 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:48.058712 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-42bc6aa6-370a-41de-8251-fd9a8b5b7657 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1723 microversion: 2.1 time: 0.302122 Sep 10 12:09:48.062381 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2869/5732] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:47 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1723 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:48.706471 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7ebaf9a7-384b-45c7-a7f9-55f62efa22a3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:48.707767 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7ebaf9a7-384b-45c7-a7f9-55f62efa22a3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 13779716-4716-4ab0-8699-416f441eecea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:48.717032 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ebaf9a7-384b-45c7-a7f9-55f62efa22a3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:48.717573 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ebaf9a7-384b-45c7-a7f9-55f62efa22a3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:48.718013 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ebaf9a7-384b-45c7-a7f9-55f62efa22a3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:48.718866 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ebaf9a7-384b-45c7-a7f9-55f62efa22a3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:48.719503 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ebaf9a7-384b-45c7-a7f9-55f62efa22a3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:48.720056 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ebaf9a7-384b-45c7-a7f9-55f62efa22a3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:49.084680 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8c894214-e47f-4d4f-b530-3cba7237af31 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:49.085359 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8c894214-e47f-4d4f-b530-3cba7237af31 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:49.113095 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8c894214-e47f-4d4f-b530-3cba7237af31 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:49.117100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8c894214-e47f-4d4f-b530-3cba7237af31 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:49.122767 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8c894214-e47f-4d4f-b530-3cba7237af31 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:49.129500 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8c894214-e47f-4d4f-b530-3cba7237af31 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:49.129998 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8c894214-e47f-4d4f-b530-3cba7237af31 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:49.130453 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8c894214-e47f-4d4f-b530-3cba7237af31 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:49.281883 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7ebaf9a7-384b-45c7-a7f9-55f62efa22a3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:49.295728 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7ebaf9a7-384b-45c7-a7f9-55f62efa22a3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea" status: 200 len: 1300 microversion: 2.1 time: 0.588939 Sep 10 12:09:49.296595 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2864/5733] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:48 2022] GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea => generated 1300 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:49.539501 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3960556e-de4d-4cc0-ae1f-c1de1fe3d7fc tempest-ServerGroup264TestJSON-534589917 tempest-ServerGroup264TestJSON-534589917-project] Action: 'create', calling method: .version_select at 0x7f40725af280>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:09:49.549242 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8c894214-e47f-4d4f-b530-3cba7237af31 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:49.587496 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8c894214-e47f-4d4f-b530-3cba7237af31 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1723 microversion: 2.1 time: 0.506832 Sep 10 12:09:49.587722 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2870/5734] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:49 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1723 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:09:49.605607 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-3960556e-de4d-4cc0-ae1f-c1de1fe3d7fc tempest-ServerGroup264TestJSON-534589917 tempest-ServerGroup264TestJSON-534589917-project] Getting quotas for project e04fc6a7466943a992ef5456471a59aa. Resources: {'server_groups'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:09:49.618979 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-3960556e-de4d-4cc0-ae1f-c1de1fe3d7fc tempest-ServerGroup264TestJSON-534589917 tempest-ServerGroup264TestJSON-534589917-project] Getting quotas for user 2aa59d389a0340bfbf3c0167102296c5 and project e04fc6a7466943a992ef5456471a59aa. Resources: {'server_groups'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:09:49.694189 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-3960556e-de4d-4cc0-ae1f-c1de1fe3d7fc tempest-ServerGroup264TestJSON-534589917 tempest-ServerGroup264TestJSON-534589917-project] Getting quotas for project e04fc6a7466943a992ef5456471a59aa. Resources: {'server_groups'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:09:49.699823 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-3960556e-de4d-4cc0-ae1f-c1de1fe3d7fc tempest-ServerGroup264TestJSON-534589917 tempest-ServerGroup264TestJSON-534589917-project] Getting quotas for user 2aa59d389a0340bfbf3c0167102296c5 and project e04fc6a7466943a992ef5456471a59aa. Resources: {'server_groups'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:09:49.722465 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3960556e-de4d-4cc0-ae1f-c1de1fe3d7fc tempest-ServerGroup264TestJSON-534589917 tempest-ServerGroup264TestJSON-534589917-project] 10.222.0.23 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.424873 Sep 10 12:09:49.723391 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2865/5735] 10.222.0.23 () {62 vars in 1214 bytes} [Sat Sep 10 12:09:49 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 12:09:49.738503 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-38f0e839-8375-4139-aeb7-48a74241ea82 tempest-ServerGroup264TestJSON-534589917 tempest-ServerGroup264TestJSON-534589917-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:49.763085 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-38f0e839-8375-4139-aeb7-48a74241ea82 tempest-ServerGroup264TestJSON-534589917 tempest-ServerGroup264TestJSON-534589917-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.031876 Sep 10 12:09:49.770328 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2871/5736] 10.222.0.23 () {60 vars in 1193 bytes} [Sat Sep 10 12:09:49 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 12:09:49.775783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d89ee610-4ee9-438c-b9a1-ddf3355cce6b tempest-ServerGroup264TestJSON-534589917 tempest-ServerGroup264TestJSON-534589917-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:49.790986 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d89ee610-4ee9-438c-b9a1-ddf3355cce6b tempest-ServerGroup264TestJSON-534589917 tempest-ServerGroup264TestJSON-534589917-project] 10.222.0.23 "GET /compute/v2.1/os-server-groups/0deeda14-672b-4b6e-b288-bf823e1a103a" status: 200 len: 235 microversion: 2.64 time: 0.019048 Sep 10 12:09:49.793213 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2866/5737] 10.222.0.23 () {60 vars in 1304 bytes} [Sat Sep 10 12:09:49 2022] GET /compute/v2.1/os-server-groups/0deeda14-672b-4b6e-b288-bf823e1a103a => generated 235 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 12:09:49.803669 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-60d9d0b6-4ac2-4855-a279-659505a6b0ea tempest-ServerGroup264TestJSON-534589917 tempest-ServerGroup264TestJSON-534589917-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:49.851503 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-60d9d0b6-4ac2-4855-a279-659505a6b0ea tempest-ServerGroup264TestJSON-534589917 tempest-ServerGroup264TestJSON-534589917-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/0deeda14-672b-4b6e-b288-bf823e1a103a" status: 204 len: 0 microversion: 2.64 time: 0.051672 Sep 10 12:09:49.852101 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2872/5738] 10.222.0.23 () {60 vars in 1307 bytes} [Sat Sep 10 12:09:49 2022] DELETE /compute/v2.1/os-server-groups/0deeda14-672b-4b6e-b288-bf823e1a103a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 12:09:49.865651 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f1ce37bd-4a8e-49de-90d7-a6be99c3e6e5 tempest-ServerGroup264TestJSON-534589917 tempest-ServerGroup264TestJSON-534589917-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:49.874381 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-f1ce37bd-4a8e-49de-90d7-a6be99c3e6e5 tempest-ServerGroup264TestJSON-534589917 tempest-ServerGroup264TestJSON-534589917-project] HTTP exception thrown: Instance group 0deeda14-672b-4b6e-b288-bf823e1a103a could not be found. Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f1ce37bd-4a8e-49de-90d7-a6be99c3e6e5 tempest-ServerGroup264TestJSON-534589917 tempest-ServerGroup264TestJSON-534589917-project] Request method failure captured: Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/os-server-groups/0deeda14-672b-4b6e-b288-bf823e1a103a HTTP/1.1 Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH6Nk7Ze3YgqPKNZ0UDFL3FvsU3pzCej19hNB_MY2jvvSwbdSN_n7YEhRsWAoBqAjlSGdUpzspP_W7RCIEj-uAiba6auN4U_3Ril6p5pUfJKxPq6vB_TfAhd1TJpCNa7GlYCrAfvW6vJ3Dw3vgqybXFx5DWnw0MoYBykFOvqlYHqyCs Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: X-Openstack-Nova-Api-Version: 2.64 Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: e04fc6a7466943a992ef5456471a59aa Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServerGroup264TestJSON-534589917 Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e04fc6a7466943a992ef5456471a59aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e04fc6a7466943a992ef5456471a59aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e04fc6a7466943a992ef5456471a59aa", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e04fc6a7466943a992ef5456471a59aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServerGroup264TestJSON-534589917 Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: e04fc6a7466943a992ef5456471a59aa Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServerGroup264TestJSON-534589917 Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServerGroup264TestJSON-534589917-project Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 2aa59d389a0340bfbf3c0167102296c5 Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServerGroup264TestJSON-534589917-project Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance group 0deeda14-672b-4b6e-b288-bf823e1a103a could not be found. Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '0deeda14-672b-4b6e-b288-bf823e1a103a'} Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 0deeda14-672b-4b6e-b288-bf823e1a103a could not be found. Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 0deeda14-672b-4b6e-b288-bf823e1a103a could not be found. Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:09:49.876300 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:09:49.884934 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:09:49.884934 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:09:49.884934 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:09:49.884934 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:09:49.884934 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 0deeda14-672b-4b6e-b288-bf823e1a103a could not be found. Sep 10 12:09:49.884934 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:09:49.884934 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f1ce37bd-4a8e-49de-90d7-a6be99c3e6e5 tempest-ServerGroup264TestJSON-534589917 tempest-ServerGroup264TestJSON-534589917-project] Returning 404 to user: Instance group 0deeda14-672b-4b6e-b288-bf823e1a103a could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:09:49.884934 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f1ce37bd-4a8e-49de-90d7-a6be99c3e6e5 tempest-ServerGroup264TestJSON-534589917 tempest-ServerGroup264TestJSON-534589917-project] 10.222.0.23 "DELETE /compute/v2.1/os-server-groups/0deeda14-672b-4b6e-b288-bf823e1a103a" status: 404 len: 117 microversion: 2.64 time: 0.020180 Sep 10 12:09:49.884934 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2867/5739] 10.222.0.23 () {60 vars in 1307 bytes} [Sat Sep 10 12:09:49 2022] DELETE /compute/v2.1/os-server-groups/0deeda14-672b-4b6e-b288-bf823e1a103a => generated 117 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 12:09:50.324385 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-65e76c9f-aeac-41e7-9fa2-187f960e88f4 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:50.325565 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-65e76c9f-aeac-41e7-9fa2-187f960e88f4 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 13779716-4716-4ab0-8699-416f441eecea] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:50.342223 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65e76c9f-aeac-41e7-9fa2-187f960e88f4 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:50.344134 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65e76c9f-aeac-41e7-9fa2-187f960e88f4 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:50.346643 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65e76c9f-aeac-41e7-9fa2-187f960e88f4 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:50.349574 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65e76c9f-aeac-41e7-9fa2-187f960e88f4 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:50.350705 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65e76c9f-aeac-41e7-9fa2-187f960e88f4 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:50.353035 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65e76c9f-aeac-41e7-9fa2-187f960e88f4 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:50.608578 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0472ac02-cb84-422f-a185-6aafdc487fd5 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:50.609629 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0472ac02-cb84-422f-a185-6aafdc487fd5 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:50.628049 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0472ac02-cb84-422f-a185-6aafdc487fd5 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:50.634492 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0472ac02-cb84-422f-a185-6aafdc487fd5 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:50.635334 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0472ac02-cb84-422f-a185-6aafdc487fd5 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:50.640582 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0472ac02-cb84-422f-a185-6aafdc487fd5 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:50.643124 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0472ac02-cb84-422f-a185-6aafdc487fd5 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:50.643837 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0472ac02-cb84-422f-a185-6aafdc487fd5 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:51.111763 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-65e76c9f-aeac-41e7-9fa2-187f960e88f4 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:51.123262 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-65e76c9f-aeac-41e7-9fa2-187f960e88f4 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea" status: 200 len: 1368 microversion: 2.1 time: 0.802799 Sep 10 12:09:51.132161 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2873/5740] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:50 2022] GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea => generated 1368 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:51.284096 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0472ac02-cb84-422f-a185-6aafdc487fd5 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:51.292616 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0472ac02-cb84-422f-a185-6aafdc487fd5 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1723 microversion: 2.1 time: 0.688169 Sep 10 12:09:51.293397 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2868/5741] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:50 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1723 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:09:52.147194 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0b20592b-6a1c-41d5-b554-7ba8ef9476cc tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:52.148280 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0b20592b-6a1c-41d5-b554-7ba8ef9476cc tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 13779716-4716-4ab0-8699-416f441eecea] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:52.188750 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0b20592b-6a1c-41d5-b554-7ba8ef9476cc tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:52.192987 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0b20592b-6a1c-41d5-b554-7ba8ef9476cc tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:52.194651 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0b20592b-6a1c-41d5-b554-7ba8ef9476cc tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:52.196798 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0b20592b-6a1c-41d5-b554-7ba8ef9476cc tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:52.197852 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0b20592b-6a1c-41d5-b554-7ba8ef9476cc tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:52.200101 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0b20592b-6a1c-41d5-b554-7ba8ef9476cc tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:52.324070 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-794413b3-66b3-48e5-b8fe-576a9eb959b2 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:52.324716 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-794413b3-66b3-48e5-b8fe-576a9eb959b2 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:52.341441 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-794413b3-66b3-48e5-b8fe-576a9eb959b2 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:52.341944 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-794413b3-66b3-48e5-b8fe-576a9eb959b2 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:52.342397 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-794413b3-66b3-48e5-b8fe-576a9eb959b2 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:52.343117 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-794413b3-66b3-48e5-b8fe-576a9eb959b2 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:52.343609 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-794413b3-66b3-48e5-b8fe-576a9eb959b2 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:52.344044 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-794413b3-66b3-48e5-b8fe-576a9eb959b2 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:52.728356 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-794413b3-66b3-48e5-b8fe-576a9eb959b2 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:52.730498 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0b20592b-6a1c-41d5-b554-7ba8ef9476cc tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:52.742539 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0b20592b-6a1c-41d5-b554-7ba8ef9476cc tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea" status: 200 len: 1368 microversion: 2.1 time: 0.598713 Sep 10 12:09:52.744021 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2874/5742] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:52 2022] GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea => generated 1368 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:52.747621 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-794413b3-66b3-48e5-b8fe-576a9eb959b2 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1723 microversion: 2.1 time: 0.431485 Sep 10 12:09:52.748440 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2869/5743] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:52 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1723 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:09:52.951743 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-8b5f10f8-75c0-436c-8761-90aefd5aa157 req-934c2e38-be94-4d79-b9f5-35c4faefcbd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13779716-4716-4ab0-8699-416f441eecea", "tag": "2808f936-b22f-44f6-83e8-ce7b20f58226"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:09:52.982633 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-8b5f10f8-75c0-436c-8761-90aefd5aa157 req-934c2e38-be94-4d79-b9f5-35c4faefcbd0 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:52.983148 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-8b5f10f8-75c0-436c-8761-90aefd5aa157 req-934c2e38-be94-4d79-b9f5-35c4faefcbd0 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:52.983642 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-8b5f10f8-75c0-436c-8761-90aefd5aa157 req-934c2e38-be94-4d79-b9f5-35c4faefcbd0 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:53.015706 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-8b5f10f8-75c0-436c-8761-90aefd5aa157 req-934c2e38-be94-4d79-b9f5-35c4faefcbd0 service nova] Creating event network-changed:2808f936-b22f-44f6-83e8-ce7b20f58226 for instance 13779716-4716-4ab0-8699-416f441eecea on n-h1-856895-1 Sep 10 12:09:53.046137 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-8b5f10f8-75c0-436c-8761-90aefd5aa157 req-934c2e38-be94-4d79-b9f5-35c4faefcbd0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100518 Sep 10 12:09:53.047436 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2875/5744] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:09:53.767941 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-eb20de1a-b2e3-435d-95a9-6e6b95289101 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:53.768847 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-eb20de1a-b2e3-435d-95a9-6e6b95289101 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 13779716-4716-4ab0-8699-416f441eecea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:53.783871 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8587d46e-6aed-4971-936c-f457065946b4 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:53.784620 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8587d46e-6aed-4971-936c-f457065946b4 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:53.790591 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb20de1a-b2e3-435d-95a9-6e6b95289101 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:53.791100 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb20de1a-b2e3-435d-95a9-6e6b95289101 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:53.793333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb20de1a-b2e3-435d-95a9-6e6b95289101 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:53.794388 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb20de1a-b2e3-435d-95a9-6e6b95289101 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:53.796523 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb20de1a-b2e3-435d-95a9-6e6b95289101 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:53.797940 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb20de1a-b2e3-435d-95a9-6e6b95289101 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:53.805732 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8587d46e-6aed-4971-936c-f457065946b4 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:53.806243 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8587d46e-6aed-4971-936c-f457065946b4 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:53.806694 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8587d46e-6aed-4971-936c-f457065946b4 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:53.807577 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8587d46e-6aed-4971-936c-f457065946b4 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:53.808043 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8587d46e-6aed-4971-936c-f457065946b4 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:53.808485 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8587d46e-6aed-4971-936c-f457065946b4 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:54.168198 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-eb20de1a-b2e3-435d-95a9-6e6b95289101 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:54.179616 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-eb20de1a-b2e3-435d-95a9-6e6b95289101 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea" status: 200 len: 1368 microversion: 2.1 time: 0.417211 Sep 10 12:09:54.189414 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2870/5745] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:53 2022] GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea => generated 1368 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:54.302301 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8587d46e-6aed-4971-936c-f457065946b4 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:54.313803 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8587d46e-6aed-4971-936c-f457065946b4 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1723 microversion: 2.1 time: 0.540510 Sep 10 12:09:54.320836 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2876/5746] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:53 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1723 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:55.211915 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6fdd43f6-1d3b-42e3-bfa4-d24927c066a6 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:55.212581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6fdd43f6-1d3b-42e3-bfa4-d24927c066a6 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 13779716-4716-4ab0-8699-416f441eecea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:55.227604 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6fdd43f6-1d3b-42e3-bfa4-d24927c066a6 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:55.228038 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6fdd43f6-1d3b-42e3-bfa4-d24927c066a6 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:55.228584 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6fdd43f6-1d3b-42e3-bfa4-d24927c066a6 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:55.229352 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6fdd43f6-1d3b-42e3-bfa4-d24927c066a6 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:55.229814 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6fdd43f6-1d3b-42e3-bfa4-d24927c066a6 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:55.230247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6fdd43f6-1d3b-42e3-bfa4-d24927c066a6 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:55.348289 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-92a56d91-d98a-41c7-8c44-2d80016437f8 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:55.348942 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-92a56d91-d98a-41c7-8c44-2d80016437f8 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:55.360140 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-92a56d91-d98a-41c7-8c44-2d80016437f8 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:55.361017 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-92a56d91-d98a-41c7-8c44-2d80016437f8 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:55.361510 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-92a56d91-d98a-41c7-8c44-2d80016437f8 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:55.362262 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-92a56d91-d98a-41c7-8c44-2d80016437f8 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:55.362693 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-92a56d91-d98a-41c7-8c44-2d80016437f8 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:55.363194 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-92a56d91-d98a-41c7-8c44-2d80016437f8 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:55.526306 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6fdd43f6-1d3b-42e3-bfa4-d24927c066a6 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:55.567123 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6fdd43f6-1d3b-42e3-bfa4-d24927c066a6 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea" status: 200 len: 1368 microversion: 2.1 time: 0.365542 Sep 10 12:09:55.572010 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2871/5747] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:55 2022] GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea => generated 1368 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:55.657285 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-92a56d91-d98a-41c7-8c44-2d80016437f8 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:55.665826 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-92a56d91-d98a-41c7-8c44-2d80016437f8 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1723 microversion: 2.1 time: 0.323070 Sep 10 12:09:55.666944 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2877/5748] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:55 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1723 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:56.598591 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d65c9d75-2681-411f-ac2f-208f4c32f00a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:56.599381 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d65c9d75-2681-411f-ac2f-208f4c32f00a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 13779716-4716-4ab0-8699-416f441eecea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:56.613861 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d65c9d75-2681-411f-ac2f-208f4c32f00a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:56.614502 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d65c9d75-2681-411f-ac2f-208f4c32f00a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:56.614963 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d65c9d75-2681-411f-ac2f-208f4c32f00a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:56.615850 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d65c9d75-2681-411f-ac2f-208f4c32f00a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:56.616326 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d65c9d75-2681-411f-ac2f-208f4c32f00a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:56.616746 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d65c9d75-2681-411f-ac2f-208f4c32f00a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:56.694928 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fe5b06ad-af36-43d9-a4a8-f32f5842f33b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:56.697719 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fe5b06ad-af36-43d9-a4a8-f32f5842f33b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:56.709130 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:09:56.714930 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=10 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:09:56.717319 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe5b06ad-af36-43d9-a4a8-f32f5842f33b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:56.717819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe5b06ad-af36-43d9-a4a8-f32f5842f33b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:56.718267 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe5b06ad-af36-43d9-a4a8-f32f5842f33b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:56.718994 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe5b06ad-af36-43d9-a4a8-f32f5842f33b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:56.719637 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe5b06ad-af36-43d9-a4a8-f32f5842f33b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:56.728017 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe5b06ad-af36-43d9-a4a8-f32f5842f33b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:56.978525 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d65c9d75-2681-411f-ac2f-208f4c32f00a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:56.994695 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d65c9d75-2681-411f-ac2f-208f4c32f00a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea" status: 200 len: 1368 microversion: 2.1 time: 0.403574 Sep 10 12:09:56.996917 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2872/5749] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:56 2022] GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea => generated 1368 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:57.115052 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fe5b06ad-af36-43d9-a4a8-f32f5842f33b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:57.131995 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fe5b06ad-af36-43d9-a4a8-f32f5842f33b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1723 microversion: 2.1 time: 0.441031 Sep 10 12:09:57.148168 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2878/5750] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:56 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1723 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:58.025432 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-131dbfb2-1c8e-498a-9025-06aad276dab9 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:58.026117 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-131dbfb2-1c8e-498a-9025-06aad276dab9 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 13779716-4716-4ab0-8699-416f441eecea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:58.033713 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-131dbfb2-1c8e-498a-9025-06aad276dab9 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:58.034317 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-131dbfb2-1c8e-498a-9025-06aad276dab9 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:58.034769 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-131dbfb2-1c8e-498a-9025-06aad276dab9 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:58.035500 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-131dbfb2-1c8e-498a-9025-06aad276dab9 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:58.035955 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-131dbfb2-1c8e-498a-9025-06aad276dab9 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:58.036577 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-131dbfb2-1c8e-498a-9025-06aad276dab9 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:58.229356 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-131dbfb2-1c8e-498a-9025-06aad276dab9 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:58.239115 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-131dbfb2-1c8e-498a-9025-06aad276dab9 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea" status: 200 len: 1368 microversion: 2.1 time: 0.221385 Sep 10 12:09:58.243901 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2873/5751] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:58 2022] GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea => generated 1368 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:58.253743 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4847b4a4-8aed-453e-9388-ca7120c0c2a3 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:58.255752 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4847b4a4-8aed-453e-9388-ca7120c0c2a3 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:58.265460 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4847b4a4-8aed-453e-9388-ca7120c0c2a3 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:58.265460 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4847b4a4-8aed-453e-9388-ca7120c0c2a3 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:58.265460 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4847b4a4-8aed-453e-9388-ca7120c0c2a3 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:58.265790 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4847b4a4-8aed-453e-9388-ca7120c0c2a3 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:58.266451 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4847b4a4-8aed-453e-9388-ca7120c0c2a3 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:58.267050 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4847b4a4-8aed-453e-9388-ca7120c0c2a3 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:58.302453 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-35618c67-e00e-4768-a6a9-b761010e458b tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-503086947", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": "none"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:09:58.370042 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-35618c67-e00e-4768-a6a9-b761010e458b tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:09:58.370689 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-35618c67-e00e-4768-a6a9-b761010e458b tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:09:58.371478 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-35618c67-e00e-4768-a6a9-b761010e458b tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:09:58.372048 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-35618c67-e00e-4768-a6a9-b761010e458b tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:09:58.372819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-35618c67-e00e-4768-a6a9-b761010e458b tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:09:58.382917 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-35618c67-e00e-4768-a6a9-b761010e458b tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:58.383435 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-35618c67-e00e-4768-a6a9-b761010e458b tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:58.383877 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-35618c67-e00e-4768-a6a9-b761010e458b tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:58.384602 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-35618c67-e00e-4768-a6a9-b761010e458b tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:58.385054 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-35618c67-e00e-4768-a6a9-b761010e458b tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:58.385473 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-35618c67-e00e-4768-a6a9-b761010e458b tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:58.411859 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-35618c67-e00e-4768-a6a9-b761010e458b tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Getting quotas for project 8f448f327401481993607f9c08a50aac. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:09:58.417887 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-35618c67-e00e-4768-a6a9-b761010e458b tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Getting quotas for user a6aaa314a0a84cd88c8ac368fd6b92ee and project 8f448f327401481993607f9c08a50aac. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:09:58.434445 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-35618c67-e00e-4768-a6a9-b761010e458b tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:09:58.437837 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-35618c67-e00e-4768-a6a9-b761010e458b tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] [instance: a0aad895-68c0-4e8f-b3dd-9d78074bbcbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:09:58.475399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4847b4a4-8aed-453e-9388-ca7120c0c2a3 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:58.486431 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4847b4a4-8aed-453e-9388-ca7120c0c2a3 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1723 microversion: 2.1 time: 0.240949 Sep 10 12:09:58.487031 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2874/5752] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:58 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:58.509030 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-35618c67-e00e-4768-a6a9-b761010e458b tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.386885 Sep 10 12:09:58.510446 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2879/5753] 10.222.0.23 () {62 vars in 1188 bytes} [Sat Sep 10 12:09:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 389 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 10 12:09:58.522291 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3a431443-b83b-4c1a-b209-92ab431f8907 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:58.522930 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3a431443-b83b-4c1a-b209-92ab431f8907 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] [instance: a0aad895-68c0-4e8f-b3dd-9d78074bbcbd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:58.585705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3a431443-b83b-4c1a-b209-92ab431f8907 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:58.614298 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3a431443-b83b-4c1a-b209-92ab431f8907 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:58.616557 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3a431443-b83b-4c1a-b209-92ab431f8907 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:58.617945 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3a431443-b83b-4c1a-b209-92ab431f8907 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] 10.222.0.23 "GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd" status: 200 len: 1277 microversion: 2.54 time: 0.099770 Sep 10 12:09:58.627895 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2875/5754] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:09:58 2022] GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd => generated 1277 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 12:09:59.265257 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-85aee580-e44b-40eb-b680-52c1732d5432 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:59.266886 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-85aee580-e44b-40eb-b680-52c1732d5432 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 13779716-4716-4ab0-8699-416f441eecea] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:59.284720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85aee580-e44b-40eb-b680-52c1732d5432 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:59.285410 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85aee580-e44b-40eb-b680-52c1732d5432 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:59.286022 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85aee580-e44b-40eb-b680-52c1732d5432 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:59.286942 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85aee580-e44b-40eb-b680-52c1732d5432 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:59.287620 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85aee580-e44b-40eb-b680-52c1732d5432 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:59.288291 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85aee580-e44b-40eb-b680-52c1732d5432 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:59.510756 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6e2c9c09-0ab9-473b-a361-fb3d602f4b21 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:59.512247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6e2c9c09-0ab9-473b-a361-fb3d602f4b21 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:59.528095 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6e2c9c09-0ab9-473b-a361-fb3d602f4b21 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:59.528604 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6e2c9c09-0ab9-473b-a361-fb3d602f4b21 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:59.531336 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6e2c9c09-0ab9-473b-a361-fb3d602f4b21 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:59.535128 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6e2c9c09-0ab9-473b-a361-fb3d602f4b21 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:59.536140 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6e2c9c09-0ab9-473b-a361-fb3d602f4b21 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:59.536785 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6e2c9c09-0ab9-473b-a361-fb3d602f4b21 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:59.537009 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-85aee580-e44b-40eb-b680-52c1732d5432 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:59.545800 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-85aee580-e44b-40eb-b680-52c1732d5432 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea" status: 200 len: 1368 microversion: 2.1 time: 0.284401 Sep 10 12:09:59.551944 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2880/5755] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:59 2022] GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea => generated 1368 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:09:59.646096 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1e08d263-1a4c-4bba-9bed-394ba4b1405a tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:09:59.646941 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1e08d263-1a4c-4bba-9bed-394ba4b1405a tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] [instance: a0aad895-68c0-4e8f-b3dd-9d78074bbcbd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:09:59.654644 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1e08d263-1a4c-4bba-9bed-394ba4b1405a tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:59.655461 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1e08d263-1a4c-4bba-9bed-394ba4b1405a tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:59.656141 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1e08d263-1a4c-4bba-9bed-394ba4b1405a tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:59.657772 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1e08d263-1a4c-4bba-9bed-394ba4b1405a tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:09:59.658466 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1e08d263-1a4c-4bba-9bed-394ba4b1405a tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:09:59.659186 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1e08d263-1a4c-4bba-9bed-394ba4b1405a tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:09:59.809811 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6e2c9c09-0ab9-473b-a361-fb3d602f4b21 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:59.816895 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1e08d263-1a4c-4bba-9bed-394ba4b1405a tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:59.832490 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6e2c9c09-0ab9-473b-a361-fb3d602f4b21 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1723 microversion: 2.1 time: 0.326445 Sep 10 12:09:59.835977 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1e08d263-1a4c-4bba-9bed-394ba4b1405a tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:59.838028 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1e08d263-1a4c-4bba-9bed-394ba4b1405a tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:09:59.852611 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2876/5756] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:09:59 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1723 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:09:59.858057 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1e08d263-1a4c-4bba-9bed-394ba4b1405a tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] 10.222.0.23 "GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd" status: 200 len: 1329 microversion: 2.54 time: 0.213109 Sep 10 12:09:59.859222 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2881/5757] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:09:59 2022] GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd => generated 1329 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:00.573872 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b220cdc6-6d9c-4135-a9fd-e20ee287d027 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:00.576128 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b220cdc6-6d9c-4135-a9fd-e20ee287d027 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 13779716-4716-4ab0-8699-416f441eecea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:00.584257 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:10:00.586301 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b220cdc6-6d9c-4135-a9fd-e20ee287d027 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:00.587052 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b220cdc6-6d9c-4135-a9fd-e20ee287d027 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:00.587866 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b220cdc6-6d9c-4135-a9fd-e20ee287d027 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:00.588795 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b220cdc6-6d9c-4135-a9fd-e20ee287d027 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:00.591333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b220cdc6-6d9c-4135-a9fd-e20ee287d027 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:00.591874 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b220cdc6-6d9c-4135-a9fd-e20ee287d027 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:00.774174 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b220cdc6-6d9c-4135-a9fd-e20ee287d027 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:00.782757 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b220cdc6-6d9c-4135-a9fd-e20ee287d027 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea" status: 200 len: 1368 microversion: 2.1 time: 0.212723 Sep 10 12:10:00.783746 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2877/5758] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:10:00 2022] GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea => generated 1368 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:10:00.866336 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7484221d-c31a-44ad-80b8-ea6d75f318e7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:00.867076 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7484221d-c31a-44ad-80b8-ea6d75f318e7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:00.878514 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7484221d-c31a-44ad-80b8-ea6d75f318e7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:00.879011 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7484221d-c31a-44ad-80b8-ea6d75f318e7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:00.879490 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7484221d-c31a-44ad-80b8-ea6d75f318e7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:00.880201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7484221d-c31a-44ad-80b8-ea6d75f318e7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:00.885334 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7484221d-c31a-44ad-80b8-ea6d75f318e7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:00.885971 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7484221d-c31a-44ad-80b8-ea6d75f318e7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:00.892943 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-774c5022-2ad9-40ea-9871-a5b674d7ed33 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:00.893601 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-774c5022-2ad9-40ea-9871-a5b674d7ed33 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] [instance: a0aad895-68c0-4e8f-b3dd-9d78074bbcbd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:00.904584 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-774c5022-2ad9-40ea-9871-a5b674d7ed33 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:00.905254 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-774c5022-2ad9-40ea-9871-a5b674d7ed33 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:00.905835 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-774c5022-2ad9-40ea-9871-a5b674d7ed33 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:00.906555 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-774c5022-2ad9-40ea-9871-a5b674d7ed33 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:00.907685 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-774c5022-2ad9-40ea-9871-a5b674d7ed33 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:00.908118 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-774c5022-2ad9-40ea-9871-a5b674d7ed33 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:00.998219 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-774c5022-2ad9-40ea-9871-a5b674d7ed33 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:01.010751 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-774c5022-2ad9-40ea-9871-a5b674d7ed33 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:01.014427 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-774c5022-2ad9-40ea-9871-a5b674d7ed33 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:01.015744 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-774c5022-2ad9-40ea-9871-a5b674d7ed33 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] 10.222.0.23 "GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd" status: 200 len: 1335 microversion: 2.54 time: 0.129491 Sep 10 12:10:01.016552 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2878/5759] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:00 2022] GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd => generated 1335 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 12:10:01.176912 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7484221d-c31a-44ad-80b8-ea6d75f318e7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:01.186838 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7484221d-c31a-44ad-80b8-ea6d75f318e7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1723 microversion: 2.1 time: 0.324274 Sep 10 12:10:01.188959 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2882/5760] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:10:00 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1723 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:10:01.262158 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-92dbdd0f-8fa5-4f4c-9eaa-2dbe7ebdfc2f tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-231266776", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "15f254a9-4cb2-4a90-8651-88ad1376414f"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:10:01.318873 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-92dbdd0f-8fa5-4f4c-9eaa-2dbe7ebdfc2f tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] validate_networks() for [('15f254a9-4cb2-4a90-8651-88ad1376414f', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:10:01.454494 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-fe903914-dba1-4dff-a2f8-15b69e4727c8 req-69df43d4-1616-415d-861a-c7feb78eeddb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13779716-4716-4ab0-8699-416f441eecea", "name": "network-vif-plugged", "status": "completed", "tag": "2808f936-b22f-44f6-83e8-ce7b20f58226"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:10:01.465556 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-fe903914-dba1-4dff-a2f8-15b69e4727c8 req-69df43d4-1616-415d-861a-c7feb78eeddb service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:01.466240 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-fe903914-dba1-4dff-a2f8-15b69e4727c8 req-69df43d4-1616-415d-861a-c7feb78eeddb service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:01.467019 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-fe903914-dba1-4dff-a2f8-15b69e4727c8 req-69df43d4-1616-415d-861a-c7feb78eeddb service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:01.479147 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-fe903914-dba1-4dff-a2f8-15b69e4727c8 req-69df43d4-1616-415d-861a-c7feb78eeddb service nova] Creating event network-vif-plugged:2808f936-b22f-44f6-83e8-ce7b20f58226 for instance 13779716-4716-4ab0-8699-416f441eecea on n-h1-856895-1 Sep 10 12:10:01.486699 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-fe903914-dba1-4dff-a2f8-15b69e4727c8 req-69df43d4-1616-415d-861a-c7feb78eeddb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155416 Sep 10 12:10:01.487606 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2883/5761] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:10:01.771749 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-92dbdd0f-8fa5-4f4c-9eaa-2dbe7ebdfc2f tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:10:01.772226 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-92dbdd0f-8fa5-4f4c-9eaa-2dbe7ebdfc2f tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:10:01.772640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-92dbdd0f-8fa5-4f4c-9eaa-2dbe7ebdfc2f tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:10:01.773053 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-92dbdd0f-8fa5-4f4c-9eaa-2dbe7ebdfc2f tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:10:01.773466 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-92dbdd0f-8fa5-4f4c-9eaa-2dbe7ebdfc2f tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:10:01.783064 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92dbdd0f-8fa5-4f4c-9eaa-2dbe7ebdfc2f tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:01.783576 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92dbdd0f-8fa5-4f4c-9eaa-2dbe7ebdfc2f tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:01.784012 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92dbdd0f-8fa5-4f4c-9eaa-2dbe7ebdfc2f tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:01.784742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92dbdd0f-8fa5-4f4c-9eaa-2dbe7ebdfc2f tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:01.785200 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92dbdd0f-8fa5-4f4c-9eaa-2dbe7ebdfc2f tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:01.785624 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-92dbdd0f-8fa5-4f4c-9eaa-2dbe7ebdfc2f tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:01.805368 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-92dbdd0f-8fa5-4f4c-9eaa-2dbe7ebdfc2f tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Getting quotas for project 4238c6353bb84f41b1dee58fd8395e41. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:10:01.808679 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e4a5f942-e34a-4c6c-aa73-6d2715ea98aa tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:01.809488 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e4a5f942-e34a-4c6c-aa73-6d2715ea98aa tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 13779716-4716-4ab0-8699-416f441eecea] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:01.810690 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-92dbdd0f-8fa5-4f4c-9eaa-2dbe7ebdfc2f tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Getting quotas for user 20ed72c3edf944c6bd5a60de122fe9b0 and project 4238c6353bb84f41b1dee58fd8395e41. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:10:01.812860 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=4,nova_api:INSERT=7 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:10:01.817142 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4a5f942-e34a-4c6c-aa73-6d2715ea98aa tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:01.817998 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4a5f942-e34a-4c6c-aa73-6d2715ea98aa tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:01.818876 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4a5f942-e34a-4c6c-aa73-6d2715ea98aa tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:01.819826 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4a5f942-e34a-4c6c-aa73-6d2715ea98aa tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:01.820490 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4a5f942-e34a-4c6c-aa73-6d2715ea98aa tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:01.820991 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4a5f942-e34a-4c6c-aa73-6d2715ea98aa tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:01.824397 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-92dbdd0f-8fa5-4f4c-9eaa-2dbe7ebdfc2f tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:10:01.827765 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-92dbdd0f-8fa5-4f4c-9eaa-2dbe7ebdfc2f tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] [instance: bce7d28b-43a8-4308-80f9-b1413ff622bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:10:01.877101 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-92dbdd0f-8fa5-4f4c-9eaa-2dbe7ebdfc2f tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.773414 Sep 10 12:10:01.877758 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2879/5762] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:10:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:10:01.889077 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7b6d4961-d85e-4052-9b9b-e3035ece8dae tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:01.889843 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7b6d4961-d85e-4052-9b9b-e3035ece8dae tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] [instance: bce7d28b-43a8-4308-80f9-b1413ff622bc] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:01.968353 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7b6d4961-d85e-4052-9b9b-e3035ece8dae tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ed72c3edf944c6bd5a60de122fe9b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4238c6353bb84f41b1dee58fd8395e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:01.979570 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7b6d4961-d85e-4052-9b9b-e3035ece8dae tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] 10.222.0.23 "GET /compute/v2.1/servers/bce7d28b-43a8-4308-80f9-b1413ff622bc" status: 200 len: 1213 microversion: 2.1 time: 0.094183 Sep 10 12:10:01.980631 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2880/5763] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:10:01 2022] GET /compute/v2.1/servers/bce7d28b-43a8-4308-80f9-b1413ff622bc => generated 1213 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:10:02.000317 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e4a5f942-e34a-4c6c-aa73-6d2715ea98aa tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:02.008953 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e4a5f942-e34a-4c6c-aa73-6d2715ea98aa tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea" status: 200 len: 1368 microversion: 2.1 time: 0.206065 Sep 10 12:10:02.009541 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2884/5764] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:10:01 2022] GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea => generated 1368 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:10:02.049540 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2ee8c44b-69c4-4c25-a84b-d3dc220d1ab8 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:02.050265 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2ee8c44b-69c4-4c25-a84b-d3dc220d1ab8 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] [instance: a0aad895-68c0-4e8f-b3dd-9d78074bbcbd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:02.060695 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ee8c44b-69c4-4c25-a84b-d3dc220d1ab8 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:02.061321 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ee8c44b-69c4-4c25-a84b-d3dc220d1ab8 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:02.061864 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ee8c44b-69c4-4c25-a84b-d3dc220d1ab8 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:02.063586 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ee8c44b-69c4-4c25-a84b-d3dc220d1ab8 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:02.064569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ee8c44b-69c4-4c25-a84b-d3dc220d1ab8 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:02.065079 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ee8c44b-69c4-4c25-a84b-d3dc220d1ab8 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:02.151597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2ee8c44b-69c4-4c25-a84b-d3dc220d1ab8 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:02.161179 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2ee8c44b-69c4-4c25-a84b-d3dc220d1ab8 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:02.162854 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2ee8c44b-69c4-4c25-a84b-d3dc220d1ab8 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:02.164222 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2ee8c44b-69c4-4c25-a84b-d3dc220d1ab8 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] 10.222.0.23 "GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd" status: 200 len: 1335 microversion: 2.54 time: 0.126290 Sep 10 12:10:02.165155 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2881/5765] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:02 2022] GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd => generated 1335 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:02.211933 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-717cbb2a-ac6f-44f3-9a58-9c3f0cecb52b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:02.213027 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-717cbb2a-ac6f-44f3-9a58-9c3f0cecb52b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:02.219808 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-717cbb2a-ac6f-44f3-9a58-9c3f0cecb52b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:02.220384 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-717cbb2a-ac6f-44f3-9a58-9c3f0cecb52b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:02.220897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-717cbb2a-ac6f-44f3-9a58-9c3f0cecb52b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:02.221840 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-717cbb2a-ac6f-44f3-9a58-9c3f0cecb52b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:02.222375 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-717cbb2a-ac6f-44f3-9a58-9c3f0cecb52b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:02.222900 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-717cbb2a-ac6f-44f3-9a58-9c3f0cecb52b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:02.247042 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:10:02.391805 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-717cbb2a-ac6f-44f3-9a58-9c3f0cecb52b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:02.401908 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-717cbb2a-ac6f-44f3-9a58-9c3f0cecb52b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1723 microversion: 2.1 time: 0.194900 Sep 10 12:10:02.402707 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2885/5766] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:10:02 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:10:03.008666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8b7a2aef-d32b-40bf-ac89-659df60e5879 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:03.010325 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8b7a2aef-d32b-40bf-ac89-659df60e5879 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] [instance: bce7d28b-43a8-4308-80f9-b1413ff622bc] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:03.017014 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b7a2aef-d32b-40bf-ac89-659df60e5879 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:03.017645 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b7a2aef-d32b-40bf-ac89-659df60e5879 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:03.018176 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b7a2aef-d32b-40bf-ac89-659df60e5879 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:03.019111 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b7a2aef-d32b-40bf-ac89-659df60e5879 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:03.019677 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b7a2aef-d32b-40bf-ac89-659df60e5879 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:03.020320 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b7a2aef-d32b-40bf-ac89-659df60e5879 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:03.033233 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4e4b1bcd-acee-4e06-85d4-7ae797cdef49 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:03.033943 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4e4b1bcd-acee-4e06-85d4-7ae797cdef49 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 13779716-4716-4ab0-8699-416f441eecea] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:03.041471 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e4b1bcd-acee-4e06-85d4-7ae797cdef49 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:03.041990 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e4b1bcd-acee-4e06-85d4-7ae797cdef49 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:03.042440 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e4b1bcd-acee-4e06-85d4-7ae797cdef49 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:03.043182 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e4b1bcd-acee-4e06-85d4-7ae797cdef49 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:03.043692 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e4b1bcd-acee-4e06-85d4-7ae797cdef49 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:03.044088 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e4b1bcd-acee-4e06-85d4-7ae797cdef49 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:03.110812 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8b7a2aef-d32b-40bf-ac89-659df60e5879 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ed72c3edf944c6bd5a60de122fe9b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4238c6353bb84f41b1dee58fd8395e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:03.119724 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8b7a2aef-d32b-40bf-ac89-659df60e5879 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] 10.222.0.23 "GET /compute/v2.1/servers/bce7d28b-43a8-4308-80f9-b1413ff622bc" status: 200 len: 1265 microversion: 2.1 time: 0.115182 Sep 10 12:10:03.120378 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2882/5767] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:10:03 2022] GET /compute/v2.1/servers/bce7d28b-43a8-4308-80f9-b1413ff622bc => generated 1265 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:10:03.192154 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d259c85a-eb9b-4fcf-bcc4-7af44e0c1cfb tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:03.192783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d259c85a-eb9b-4fcf-bcc4-7af44e0c1cfb tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] [instance: a0aad895-68c0-4e8f-b3dd-9d78074bbcbd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:03.202998 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d259c85a-eb9b-4fcf-bcc4-7af44e0c1cfb tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:03.204327 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d259c85a-eb9b-4fcf-bcc4-7af44e0c1cfb tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:03.206696 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d259c85a-eb9b-4fcf-bcc4-7af44e0c1cfb tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:03.207675 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d259c85a-eb9b-4fcf-bcc4-7af44e0c1cfb tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:03.211363 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d259c85a-eb9b-4fcf-bcc4-7af44e0c1cfb tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:03.211926 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d259c85a-eb9b-4fcf-bcc4-7af44e0c1cfb tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:03.259152 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4e4b1bcd-acee-4e06-85d4-7ae797cdef49 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:03.268325 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4e4b1bcd-acee-4e06-85d4-7ae797cdef49 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea" status: 200 len: 1368 microversion: 2.1 time: 0.239713 Sep 10 12:10:03.269211 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2886/5768] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:10:03 2022] GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea => generated 1368 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:10:03.316084 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d259c85a-eb9b-4fcf-bcc4-7af44e0c1cfb tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:03.324375 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d259c85a-eb9b-4fcf-bcc4-7af44e0c1cfb tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:03.325840 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d259c85a-eb9b-4fcf-bcc4-7af44e0c1cfb tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:03.327227 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d259c85a-eb9b-4fcf-bcc4-7af44e0c1cfb tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] 10.222.0.23 "GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd" status: 200 len: 1356 microversion: 2.54 time: 0.139982 Sep 10 12:10:03.327608 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2883/5769] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:03 2022] GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd => generated 1356 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 12:10:03.355277 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5bee5f3a-9f79-47db-8a48-c3e3da77d25f tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Action: 'create', calling method: .version_select at 0x7f407222a940>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1527595779", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhAmsIZcITXILVexkJfoOysKDlj2RKzNHeMzl7dP0djd8IlEl+9jrVT86HwUslrAoXom+EgJvKJHlsih3FSlUSJonuYiRoYJSmEkDY1l8LeGaHS8baj91uq6wQWpcEVaQ=="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:10:03.371657 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-5bee5f3a-9f79-47db-8a48-c3e3da77d25f tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Getting quotas for project 8f448f327401481993607f9c08a50aac. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:10:03.378309 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-5bee5f3a-9f79-47db-8a48-c3e3da77d25f tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Getting quotas for user a6aaa314a0a84cd88c8ac368fd6b92ee and project 8f448f327401481993607f9c08a50aac. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:10:03.405088 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5bee5f3a-9f79-47db-8a48-c3e3da77d25f tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.053686 Sep 10 12:10:03.405918 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2887/5770] 10.222.0.23 () {62 vars in 1200 bytes} [Sat Sep 10 12:10:03 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 55 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 10 12:10:03.417532 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-16d42764-2af2-4c3a-9480-e30925dbefb1 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1527595779", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:10:03.420511 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-16d42764-2af2-4c3a-9480-e30925dbefb1 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] [instance: a0aad895-68c0-4e8f-b3dd-9d78074bbcbd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:03.426654 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bc1504a1-17d8-4707-ae63-734c12ebeb4b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:03.427425 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-16d42764-2af2-4c3a-9480-e30925dbefb1 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:03.427579 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bc1504a1-17d8-4707-ae63-734c12ebeb4b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:03.427922 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-16d42764-2af2-4c3a-9480-e30925dbefb1 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:03.428361 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-16d42764-2af2-4c3a-9480-e30925dbefb1 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:03.429054 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-16d42764-2af2-4c3a-9480-e30925dbefb1 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:03.429687 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-16d42764-2af2-4c3a-9480-e30925dbefb1 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:03.430110 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-16d42764-2af2-4c3a-9480-e30925dbefb1 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:03.433697 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc1504a1-17d8-4707-ae63-734c12ebeb4b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:03.435502 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc1504a1-17d8-4707-ae63-734c12ebeb4b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:03.435975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc1504a1-17d8-4707-ae63-734c12ebeb4b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:03.436693 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc1504a1-17d8-4707-ae63-734c12ebeb4b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:03.437160 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc1504a1-17d8-4707-ae63-734c12ebeb4b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:03.437592 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc1504a1-17d8-4707-ae63-734c12ebeb4b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:03.526935 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-16d42764-2af2-4c3a-9480-e30925dbefb1 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:10:03.527431 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-16d42764-2af2-4c3a-9480-e30925dbefb1 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:10:03.528007 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-16d42764-2af2-4c3a-9480-e30925dbefb1 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:10:03.528497 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-16d42764-2af2-4c3a-9480-e30925dbefb1 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:10:03.529106 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-16d42764-2af2-4c3a-9480-e30925dbefb1 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:10:03.565209 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:10:03.589556 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bc1504a1-17d8-4707-ae63-734c12ebeb4b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:03.600086 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bc1504a1-17d8-4707-ae63-734c12ebeb4b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1723 microversion: 2.1 time: 0.178188 Sep 10 12:10:03.600690 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2888/5771] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:10:03 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:10:03.617472 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-16d42764-2af2-4c3a-9480-e30925dbefb1 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] [instance: a0aad895-68c0-4e8f-b3dd-9d78074bbcbd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:03.623565 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-16d42764-2af2-4c3a-9480-e30925dbefb1 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:03.624060 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-16d42764-2af2-4c3a-9480-e30925dbefb1 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:03.624502 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-16d42764-2af2-4c3a-9480-e30925dbefb1 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:03.625238 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-16d42764-2af2-4c3a-9480-e30925dbefb1 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:03.626361 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-16d42764-2af2-4c3a-9480-e30925dbefb1 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:03.626796 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-16d42764-2af2-4c3a-9480-e30925dbefb1 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:03.660518 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-16d42764-2af2-4c3a-9480-e30925dbefb1 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] 10.222.0.23 "POST /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd/action" status: 202 len: 1139 microversion: 2.54 time: 0.247334 Sep 10 12:10:03.661069 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2884/5772] 10.222.0.23 () {62 vars in 1320 bytes} [Sat Sep 10 12:10:03 2022] POST /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd/action => generated 1139 bytes in 249 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 10 12:10:03.682188 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ebbb738a-4842-4f9e-a1de-a03c70822f2f tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:03.683305 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ebbb738a-4842-4f9e-a1de-a03c70822f2f tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] [instance: a0aad895-68c0-4e8f-b3dd-9d78074bbcbd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:03.691840 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ebbb738a-4842-4f9e-a1de-a03c70822f2f tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:03.692965 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ebbb738a-4842-4f9e-a1de-a03c70822f2f tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:03.693606 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ebbb738a-4842-4f9e-a1de-a03c70822f2f tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:03.694509 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ebbb738a-4842-4f9e-a1de-a03c70822f2f tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:03.695235 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ebbb738a-4842-4f9e-a1de-a03c70822f2f tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:03.695890 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ebbb738a-4842-4f9e-a1de-a03c70822f2f tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:03.833853 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ebbb738a-4842-4f9e-a1de-a03c70822f2f tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:03.842424 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ebbb738a-4842-4f9e-a1de-a03c70822f2f tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:03.845331 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ebbb738a-4842-4f9e-a1de-a03c70822f2f tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:03.847001 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ebbb738a-4842-4f9e-a1de-a03c70822f2f tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] 10.222.0.23 "GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd" status: 200 len: 1408 microversion: 2.54 time: 0.169023 Sep 10 12:10:03.848142 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2889/5773] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:03 2022] GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:04.145901 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d5e4b9a0-73ce-4ac2-86bb-af8bf8fbd960 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:04.146665 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d5e4b9a0-73ce-4ac2-86bb-af8bf8fbd960 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] [instance: bce7d28b-43a8-4308-80f9-b1413ff622bc] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:04.155687 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d5e4b9a0-73ce-4ac2-86bb-af8bf8fbd960 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:04.156261 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d5e4b9a0-73ce-4ac2-86bb-af8bf8fbd960 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:04.157558 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d5e4b9a0-73ce-4ac2-86bb-af8bf8fbd960 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:04.158263 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d5e4b9a0-73ce-4ac2-86bb-af8bf8fbd960 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:04.158897 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d5e4b9a0-73ce-4ac2-86bb-af8bf8fbd960 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:04.159361 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d5e4b9a0-73ce-4ac2-86bb-af8bf8fbd960 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:04.250981 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d5e4b9a0-73ce-4ac2-86bb-af8bf8fbd960 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ed72c3edf944c6bd5a60de122fe9b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4238c6353bb84f41b1dee58fd8395e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:04.272173 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d5e4b9a0-73ce-4ac2-86bb-af8bf8fbd960 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] 10.222.0.23 "GET /compute/v2.1/servers/bce7d28b-43a8-4308-80f9-b1413ff622bc" status: 200 len: 1271 microversion: 2.1 time: 0.131372 Sep 10 12:10:04.274038 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2885/5774] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:10:04 2022] GET /compute/v2.1/servers/bce7d28b-43a8-4308-80f9-b1413ff622bc => generated 1271 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:10:04.300149 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6a74efa5-bfaf-446c-8319-1ec033a3282b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:04.301571 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6a74efa5-bfaf-446c-8319-1ec033a3282b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 13779716-4716-4ab0-8699-416f441eecea] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:04.310178 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6a74efa5-bfaf-446c-8319-1ec033a3282b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:04.310776 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6a74efa5-bfaf-446c-8319-1ec033a3282b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:04.311333 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6a74efa5-bfaf-446c-8319-1ec033a3282b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:04.312178 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6a74efa5-bfaf-446c-8319-1ec033a3282b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:04.312750 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6a74efa5-bfaf-446c-8319-1ec033a3282b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:04.313977 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6a74efa5-bfaf-446c-8319-1ec033a3282b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:04.523417 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6a74efa5-bfaf-446c-8319-1ec033a3282b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:04.533755 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6a74efa5-bfaf-446c-8319-1ec033a3282b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea" status: 200 len: 1558 microversion: 2.1 time: 0.243091 Sep 10 12:10:04.534887 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2890/5775] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:10:04 2022] GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea => generated 1558 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:10:04.557195 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2f3a4fbe-fbe0-498a-90c8-53257a393149 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:04.558119 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2f3a4fbe-fbe0-498a-90c8-53257a393149 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 13779716-4716-4ab0-8699-416f441eecea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:04.565307 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f3a4fbe-fbe0-498a-90c8-53257a393149 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:04.565902 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f3a4fbe-fbe0-498a-90c8-53257a393149 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:04.567534 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f3a4fbe-fbe0-498a-90c8-53257a393149 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:04.568371 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f3a4fbe-fbe0-498a-90c8-53257a393149 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:04.568904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f3a4fbe-fbe0-498a-90c8-53257a393149 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:04.569415 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f3a4fbe-fbe0-498a-90c8-53257a393149 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:04.626837 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-46b9cb79-e07e-45fb-b5e9-8a1760a888a9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:04.627781 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-46b9cb79-e07e-45fb-b5e9-8a1760a888a9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:04.634064 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-46b9cb79-e07e-45fb-b5e9-8a1760a888a9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:04.634647 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-46b9cb79-e07e-45fb-b5e9-8a1760a888a9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:04.635214 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-46b9cb79-e07e-45fb-b5e9-8a1760a888a9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:04.635932 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-46b9cb79-e07e-45fb-b5e9-8a1760a888a9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:04.636397 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-46b9cb79-e07e-45fb-b5e9-8a1760a888a9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:04.636832 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-46b9cb79-e07e-45fb-b5e9-8a1760a888a9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:04.728297 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2f3a4fbe-fbe0-498a-90c8-53257a393149 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.174990 Sep 10 12:10:04.729675 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2886/5776] 10.222.0.23 () {58 vars in 1275 bytes} [Sat Sep 10 12:10:04 2022] GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea/os-interface => generated 284 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:10:04.849222 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-46b9cb79-e07e-45fb-b5e9-8a1760a888a9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:04.864257 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-46b9cb79-e07e-45fb-b5e9-8a1760a888a9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1723 microversion: 2.1 time: 0.242137 Sep 10 12:10:04.865567 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2891/5777] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:10:04 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:10:04.885613 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5a146336-f45a-4d01-9a93-5aedbd36e53e tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:04.886592 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5a146336-f45a-4d01-9a93-5aedbd36e53e tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] [instance: a0aad895-68c0-4e8f-b3dd-9d78074bbcbd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:04.894657 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5a146336-f45a-4d01-9a93-5aedbd36e53e tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:04.895497 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5a146336-f45a-4d01-9a93-5aedbd36e53e tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:04.896165 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5a146336-f45a-4d01-9a93-5aedbd36e53e tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:04.897096 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5a146336-f45a-4d01-9a93-5aedbd36e53e tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:04.898347 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5a146336-f45a-4d01-9a93-5aedbd36e53e tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:04.899033 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5a146336-f45a-4d01-9a93-5aedbd36e53e tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:04.978055 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5a146336-f45a-4d01-9a93-5aedbd36e53e tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:04.991139 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5a146336-f45a-4d01-9a93-5aedbd36e53e tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:04.993595 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5a146336-f45a-4d01-9a93-5aedbd36e53e tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:04.995417 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5a146336-f45a-4d01-9a93-5aedbd36e53e tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] 10.222.0.23 "GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd" status: 200 len: 1408 microversion: 2.54 time: 0.114095 Sep 10 12:10:04.997421 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2887/5778] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:04 2022] GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd => generated 1408 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:05.296215 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4e2f482c-b129-4c9d-af1b-5897893198e0 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:05.298208 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4e2f482c-b129-4c9d-af1b-5897893198e0 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] [instance: bce7d28b-43a8-4308-80f9-b1413ff622bc] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:05.304646 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e2f482c-b129-4c9d-af1b-5897893198e0 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:05.305915 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e2f482c-b129-4c9d-af1b-5897893198e0 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:05.306588 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e2f482c-b129-4c9d-af1b-5897893198e0 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:05.307582 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e2f482c-b129-4c9d-af1b-5897893198e0 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:05.308269 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e2f482c-b129-4c9d-af1b-5897893198e0 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:05.308924 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e2f482c-b129-4c9d-af1b-5897893198e0 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:05.569565 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4e2f482c-b129-4c9d-af1b-5897893198e0 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ed72c3edf944c6bd5a60de122fe9b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4238c6353bb84f41b1dee58fd8395e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:05.581212 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4e2f482c-b129-4c9d-af1b-5897893198e0 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] 10.222.0.23 "GET /compute/v2.1/servers/bce7d28b-43a8-4308-80f9-b1413ff622bc" status: 200 len: 1313 microversion: 2.1 time: 0.288529 Sep 10 12:10:05.582470 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2892/5779] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:10:05 2022] GET /compute/v2.1/servers/bce7d28b-43a8-4308-80f9-b1413ff622bc => generated 1313 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:10:05.887010 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ae2fe037-551d-4d8b-88e2-8100ca4d5d09 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:05.887777 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ae2fe037-551d-4d8b-88e2-8100ca4d5d09 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:05.903313 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae2fe037-551d-4d8b-88e2-8100ca4d5d09 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:05.904130 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae2fe037-551d-4d8b-88e2-8100ca4d5d09 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:05.904770 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae2fe037-551d-4d8b-88e2-8100ca4d5d09 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:05.906218 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae2fe037-551d-4d8b-88e2-8100ca4d5d09 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:05.906770 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae2fe037-551d-4d8b-88e2-8100ca4d5d09 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:05.907260 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae2fe037-551d-4d8b-88e2-8100ca4d5d09 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:06.004837 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-8c444807-f022-4c18-9db4-8fd0ea262ca5 req-48834131-1909-409c-8df0-47160cc287c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bce7d28b-43a8-4308-80f9-b1413ff622bc", "tag": "7d4a6f08-9dd8-4e20-9105-10d291cf0afb"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:10:06.016842 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-8c444807-f022-4c18-9db4-8fd0ea262ca5 req-48834131-1909-409c-8df0-47160cc287c1 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:06.017516 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-8c444807-f022-4c18-9db4-8fd0ea262ca5 req-48834131-1909-409c-8df0-47160cc287c1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:06.018129 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-8c444807-f022-4c18-9db4-8fd0ea262ca5 req-48834131-1909-409c-8df0-47160cc287c1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:06.031384 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-8c444807-f022-4c18-9db4-8fd0ea262ca5 req-48834131-1909-409c-8df0-47160cc287c1 service nova] Creating event network-changed:7d4a6f08-9dd8-4e20-9105-10d291cf0afb for instance bce7d28b-43a8-4308-80f9-b1413ff622bc on n-h1-856895-1 Sep 10 12:10:06.037229 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-8c444807-f022-4c18-9db4-8fd0ea262ca5 req-48834131-1909-409c-8df0-47160cc287c1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038311 Sep 10 12:10:06.038188 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2893/5780] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:10:06.057212 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e2773351-9b26-4ee5-9ff5-c1c1d9cadef4 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:06.058386 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e2773351-9b26-4ee5-9ff5-c1c1d9cadef4 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] [instance: a0aad895-68c0-4e8f-b3dd-9d78074bbcbd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:06.066615 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e2773351-9b26-4ee5-9ff5-c1c1d9cadef4 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:06.067385 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e2773351-9b26-4ee5-9ff5-c1c1d9cadef4 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:06.067984 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e2773351-9b26-4ee5-9ff5-c1c1d9cadef4 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:06.068880 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e2773351-9b26-4ee5-9ff5-c1c1d9cadef4 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:06.069496 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e2773351-9b26-4ee5-9ff5-c1c1d9cadef4 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:06.070796 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e2773351-9b26-4ee5-9ff5-c1c1d9cadef4 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:06.185852 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e2773351-9b26-4ee5-9ff5-c1c1d9cadef4 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:06.201007 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e2773351-9b26-4ee5-9ff5-c1c1d9cadef4 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:06.202425 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e2773351-9b26-4ee5-9ff5-c1c1d9cadef4 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:06.208462 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e2773351-9b26-4ee5-9ff5-c1c1d9cadef4 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] 10.222.0.23 "GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd" status: 200 len: 1408 microversion: 2.54 time: 0.166985 Sep 10 12:10:06.209430 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2894/5781] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:06 2022] GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd => generated 1408 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:06.236085 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-47614acb-cd6b-4f9a-a8c0-bc626d7a8e05 req-cfe92599-3d64-4b85-8659-cb0fc817fa9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13779716-4716-4ab0-8699-416f441eecea", "tag": "2808f936-b22f-44f6-83e8-ce7b20f58226"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:10:06.251786 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-47614acb-cd6b-4f9a-a8c0-bc626d7a8e05 req-cfe92599-3d64-4b85-8659-cb0fc817fa9b service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:06.252577 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-47614acb-cd6b-4f9a-a8c0-bc626d7a8e05 req-cfe92599-3d64-4b85-8659-cb0fc817fa9b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:06.253176 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-47614acb-cd6b-4f9a-a8c0-bc626d7a8e05 req-cfe92599-3d64-4b85-8659-cb0fc817fa9b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:06.266996 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-47614acb-cd6b-4f9a-a8c0-bc626d7a8e05 req-cfe92599-3d64-4b85-8659-cb0fc817fa9b service nova] Creating event network-changed:2808f936-b22f-44f6-83e8-ce7b20f58226 for instance 13779716-4716-4ab0-8699-416f441eecea on n-h1-856895-1 Sep 10 12:10:06.273119 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-47614acb-cd6b-4f9a-a8c0-bc626d7a8e05 req-cfe92599-3d64-4b85-8659-cb0fc817fa9b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040771 Sep 10 12:10:06.274528 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2895/5782] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:10:06.301860 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ae2fe037-551d-4d8b-88e2-8100ca4d5d09 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:06.312292 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ae2fe037-551d-4d8b-88e2-8100ca4d5d09 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1723 microversion: 2.1 time: 0.428995 Sep 10 12:10:06.314549 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2888/5783] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:10:05 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1723 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:10:06.612033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4e01473a-5dd0-493f-beab-b032e0505736 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:06.613618 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4e01473a-5dd0-493f-beab-b032e0505736 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] [instance: bce7d28b-43a8-4308-80f9-b1413ff622bc] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:06.628805 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e01473a-5dd0-493f-beab-b032e0505736 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:06.630920 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e01473a-5dd0-493f-beab-b032e0505736 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:06.633934 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e01473a-5dd0-493f-beab-b032e0505736 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:06.635473 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e01473a-5dd0-493f-beab-b032e0505736 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:06.635961 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e01473a-5dd0-493f-beab-b032e0505736 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:06.641100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e01473a-5dd0-493f-beab-b032e0505736 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:06.788956 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4e01473a-5dd0-493f-beab-b032e0505736 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ed72c3edf944c6bd5a60de122fe9b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4238c6353bb84f41b1dee58fd8395e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:06.797942 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4e01473a-5dd0-493f-beab-b032e0505736 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] 10.222.0.23 "GET /compute/v2.1/servers/bce7d28b-43a8-4308-80f9-b1413ff622bc" status: 200 len: 1313 microversion: 2.1 time: 0.193168 Sep 10 12:10:06.798612 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2896/5784] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:10:06 2022] GET /compute/v2.1/servers/bce7d28b-43a8-4308-80f9-b1413ff622bc => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:10:07.235785 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1d0a2294-2881-4aa3-b9f1-8b0b3d4a54b9 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:07.237383 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1d0a2294-2881-4aa3-b9f1-8b0b3d4a54b9 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] [instance: a0aad895-68c0-4e8f-b3dd-9d78074bbcbd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:07.244683 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d0a2294-2881-4aa3-b9f1-8b0b3d4a54b9 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:07.245176 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d0a2294-2881-4aa3-b9f1-8b0b3d4a54b9 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:07.245611 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d0a2294-2881-4aa3-b9f1-8b0b3d4a54b9 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:07.246313 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d0a2294-2881-4aa3-b9f1-8b0b3d4a54b9 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:07.246767 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d0a2294-2881-4aa3-b9f1-8b0b3d4a54b9 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:07.247787 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d0a2294-2881-4aa3-b9f1-8b0b3d4a54b9 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:07.324293 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1d0a2294-2881-4aa3-b9f1-8b0b3d4a54b9 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:07.333526 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1d0a2294-2881-4aa3-b9f1-8b0b3d4a54b9 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:07.334990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1d0a2294-2881-4aa3-b9f1-8b0b3d4a54b9 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:07.336335 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1d0a2294-2881-4aa3-b9f1-8b0b3d4a54b9 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] 10.222.0.23 "GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd" status: 200 len: 1408 microversion: 2.54 time: 0.105170 Sep 10 12:10:07.336902 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2889/5785] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:07 2022] GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd => generated 1408 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:07.339724 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ca7fe3ff-ca2b-44ba-adb1-628a94b2c51a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:07.340423 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ca7fe3ff-ca2b-44ba-adb1-628a94b2c51a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:07.347564 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca7fe3ff-ca2b-44ba-adb1-628a94b2c51a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:07.348933 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca7fe3ff-ca2b-44ba-adb1-628a94b2c51a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:07.349593 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca7fe3ff-ca2b-44ba-adb1-628a94b2c51a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:07.351392 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca7fe3ff-ca2b-44ba-adb1-628a94b2c51a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:07.351968 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca7fe3ff-ca2b-44ba-adb1-628a94b2c51a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:07.352407 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca7fe3ff-ca2b-44ba-adb1-628a94b2c51a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:07.499315 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ca7fe3ff-ca2b-44ba-adb1-628a94b2c51a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:07.508348 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ca7fe3ff-ca2b-44ba-adb1-628a94b2c51a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1723 microversion: 2.1 time: 0.173005 Sep 10 12:10:07.508922 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2897/5786] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:10:07 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:10:07.821417 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-95248853-ec54-419f-b411-728d8d9fd1dd tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:07.821985 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-95248853-ec54-419f-b411-728d8d9fd1dd tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] [instance: bce7d28b-43a8-4308-80f9-b1413ff622bc] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:07.827920 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-95248853-ec54-419f-b411-728d8d9fd1dd tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:07.829685 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-95248853-ec54-419f-b411-728d8d9fd1dd tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:07.830125 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-95248853-ec54-419f-b411-728d8d9fd1dd tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:07.830809 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-95248853-ec54-419f-b411-728d8d9fd1dd tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:07.831284 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-95248853-ec54-419f-b411-728d8d9fd1dd tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:07.831708 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-95248853-ec54-419f-b411-728d8d9fd1dd tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:07.964166 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-95248853-ec54-419f-b411-728d8d9fd1dd tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ed72c3edf944c6bd5a60de122fe9b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4238c6353bb84f41b1dee58fd8395e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:07.973040 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-95248853-ec54-419f-b411-728d8d9fd1dd tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] 10.222.0.23 "GET /compute/v2.1/servers/bce7d28b-43a8-4308-80f9-b1413ff622bc" status: 200 len: 1313 microversion: 2.1 time: 0.155723 Sep 10 12:10:07.973628 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2890/5787] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:10:07 2022] GET /compute/v2.1/servers/bce7d28b-43a8-4308-80f9-b1413ff622bc => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:10:08.362920 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-206a3c9a-aa87-4cbb-955d-487b79c71864 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:08.363560 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-206a3c9a-aa87-4cbb-955d-487b79c71864 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] [instance: a0aad895-68c0-4e8f-b3dd-9d78074bbcbd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:08.370522 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-206a3c9a-aa87-4cbb-955d-487b79c71864 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:08.371046 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-206a3c9a-aa87-4cbb-955d-487b79c71864 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:08.371510 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-206a3c9a-aa87-4cbb-955d-487b79c71864 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:08.372210 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-206a3c9a-aa87-4cbb-955d-487b79c71864 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:08.372668 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-206a3c9a-aa87-4cbb-955d-487b79c71864 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:08.373099 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-206a3c9a-aa87-4cbb-955d-487b79c71864 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:08.406123 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:10:08.440852 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-206a3c9a-aa87-4cbb-955d-487b79c71864 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:08.449321 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-206a3c9a-aa87-4cbb-955d-487b79c71864 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:08.451116 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-206a3c9a-aa87-4cbb-955d-487b79c71864 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:08.452373 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-206a3c9a-aa87-4cbb-955d-487b79c71864 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] 10.222.0.23 "GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd" status: 200 len: 1408 microversion: 2.54 time: 0.094067 Sep 10 12:10:08.453116 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2898/5788] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:08 2022] GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd => generated 1408 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:08.532367 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-70948c9b-9e41-4a85-a9f2-99feb20d48c4 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:08.532983 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-70948c9b-9e41-4a85-a9f2-99feb20d48c4 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:08.539884 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-70948c9b-9e41-4a85-a9f2-99feb20d48c4 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:08.540366 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-70948c9b-9e41-4a85-a9f2-99feb20d48c4 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:08.540801 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-70948c9b-9e41-4a85-a9f2-99feb20d48c4 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:08.541488 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-70948c9b-9e41-4a85-a9f2-99feb20d48c4 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:08.541938 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-70948c9b-9e41-4a85-a9f2-99feb20d48c4 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:08.542360 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-70948c9b-9e41-4a85-a9f2-99feb20d48c4 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:08.686119 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-70948c9b-9e41-4a85-a9f2-99feb20d48c4 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:08.695684 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-70948c9b-9e41-4a85-a9f2-99feb20d48c4 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1723 microversion: 2.1 time: 0.167631 Sep 10 12:10:08.696639 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2891/5789] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:10:08 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:10:08.997914 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c75f6a9e-0435-40f0-b1bd-d0485a1bc30e tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:08.998540 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c75f6a9e-0435-40f0-b1bd-d0485a1bc30e tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] [instance: bce7d28b-43a8-4308-80f9-b1413ff622bc] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:09.007205 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c75f6a9e-0435-40f0-b1bd-d0485a1bc30e tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:09.007644 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c75f6a9e-0435-40f0-b1bd-d0485a1bc30e tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:09.008166 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c75f6a9e-0435-40f0-b1bd-d0485a1bc30e tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:09.009161 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c75f6a9e-0435-40f0-b1bd-d0485a1bc30e tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:09.009728 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c75f6a9e-0435-40f0-b1bd-d0485a1bc30e tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:09.011592 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c75f6a9e-0435-40f0-b1bd-d0485a1bc30e tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:09.264351 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c75f6a9e-0435-40f0-b1bd-d0485a1bc30e tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ed72c3edf944c6bd5a60de122fe9b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4238c6353bb84f41b1dee58fd8395e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:09.273464 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c75f6a9e-0435-40f0-b1bd-d0485a1bc30e tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] 10.222.0.23 "GET /compute/v2.1/servers/bce7d28b-43a8-4308-80f9-b1413ff622bc" status: 200 len: 1313 microversion: 2.1 time: 0.279716 Sep 10 12:10:09.274352 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2899/5790] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:10:08 2022] GET /compute/v2.1/servers/bce7d28b-43a8-4308-80f9-b1413ff622bc => generated 1313 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:10:09.478013 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-86314d7c-b6e4-4522-bdb9-4b78a0ce93f7 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:09.478537 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-86314d7c-b6e4-4522-bdb9-4b78a0ce93f7 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] [instance: a0aad895-68c0-4e8f-b3dd-9d78074bbcbd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:09.485867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-86314d7c-b6e4-4522-bdb9-4b78a0ce93f7 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:09.486374 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-86314d7c-b6e4-4522-bdb9-4b78a0ce93f7 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:09.486912 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-86314d7c-b6e4-4522-bdb9-4b78a0ce93f7 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:09.487742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-86314d7c-b6e4-4522-bdb9-4b78a0ce93f7 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:09.488312 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-86314d7c-b6e4-4522-bdb9-4b78a0ce93f7 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:09.488938 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-86314d7c-b6e4-4522-bdb9-4b78a0ce93f7 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:09.557150 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-86314d7c-b6e4-4522-bdb9-4b78a0ce93f7 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:09.566661 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-86314d7c-b6e4-4522-bdb9-4b78a0ce93f7 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:09.568159 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-86314d7c-b6e4-4522-bdb9-4b78a0ce93f7 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:09.569346 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-86314d7c-b6e4-4522-bdb9-4b78a0ce93f7 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] 10.222.0.23 "GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd" status: 200 len: 1408 microversion: 2.54 time: 0.095429 Sep 10 12:10:09.569921 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2892/5791] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:09 2022] GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd => generated 1408 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:09.719465 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bc0e16a5-f792-4688-9962-d008844f0b92 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:09.720081 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bc0e16a5-f792-4688-9962-d008844f0b92 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:09.727187 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc0e16a5-f792-4688-9962-d008844f0b92 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:09.727680 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc0e16a5-f792-4688-9962-d008844f0b92 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:09.728186 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc0e16a5-f792-4688-9962-d008844f0b92 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:09.728830 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc0e16a5-f792-4688-9962-d008844f0b92 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:09.729290 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc0e16a5-f792-4688-9962-d008844f0b92 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:09.729724 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc0e16a5-f792-4688-9962-d008844f0b92 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:09.871112 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bc0e16a5-f792-4688-9962-d008844f0b92 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:09.880367 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bc0e16a5-f792-4688-9962-d008844f0b92 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1723 microversion: 2.1 time: 0.164831 Sep 10 12:10:09.880971 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2900/5792] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:10:09 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:10:10.297381 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-99fd72bb-5855-4512-b67c-a79276111f29 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:10.297962 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-99fd72bb-5855-4512-b67c-a79276111f29 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] [instance: bce7d28b-43a8-4308-80f9-b1413ff622bc] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:10.304040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99fd72bb-5855-4512-b67c-a79276111f29 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:10.304525 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99fd72bb-5855-4512-b67c-a79276111f29 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:10.304974 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99fd72bb-5855-4512-b67c-a79276111f29 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:10.305657 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99fd72bb-5855-4512-b67c-a79276111f29 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:10.306108 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99fd72bb-5855-4512-b67c-a79276111f29 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:10.306536 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99fd72bb-5855-4512-b67c-a79276111f29 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:10.437312 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-99fd72bb-5855-4512-b67c-a79276111f29 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ed72c3edf944c6bd5a60de122fe9b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4238c6353bb84f41b1dee58fd8395e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:10.445299 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-99fd72bb-5855-4512-b67c-a79276111f29 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] 10.222.0.23 "GET /compute/v2.1/servers/bce7d28b-43a8-4308-80f9-b1413ff622bc" status: 200 len: 1313 microversion: 2.1 time: 0.152198 Sep 10 12:10:10.445877 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2893/5793] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:10:10 2022] GET /compute/v2.1/servers/bce7d28b-43a8-4308-80f9-b1413ff622bc => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:10:10.595472 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-521b364e-dc2a-48b0-829d-8eb5eb8cdc60 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:10.596089 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-521b364e-dc2a-48b0-829d-8eb5eb8cdc60 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] [instance: a0aad895-68c0-4e8f-b3dd-9d78074bbcbd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:10.602085 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-521b364e-dc2a-48b0-829d-8eb5eb8cdc60 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:10.602566 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-521b364e-dc2a-48b0-829d-8eb5eb8cdc60 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:10.603001 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-521b364e-dc2a-48b0-829d-8eb5eb8cdc60 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:10.603833 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-521b364e-dc2a-48b0-829d-8eb5eb8cdc60 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:10.604288 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-521b364e-dc2a-48b0-829d-8eb5eb8cdc60 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:10.604711 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-521b364e-dc2a-48b0-829d-8eb5eb8cdc60 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:10.670544 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-521b364e-dc2a-48b0-829d-8eb5eb8cdc60 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:10.680308 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-521b364e-dc2a-48b0-829d-8eb5eb8cdc60 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:10.681926 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-521b364e-dc2a-48b0-829d-8eb5eb8cdc60 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:10.683276 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-521b364e-dc2a-48b0-829d-8eb5eb8cdc60 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] 10.222.0.23 "GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd" status: 200 len: 1408 microversion: 2.54 time: 0.091879 Sep 10 12:10:10.683947 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2901/5794] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:10 2022] GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd => generated 1408 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:10.903551 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b53722a5-7c71-455e-bd51-846de00591a9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:10.904159 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b53722a5-7c71-455e-bd51-846de00591a9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:10.910753 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b53722a5-7c71-455e-bd51-846de00591a9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:10.911275 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b53722a5-7c71-455e-bd51-846de00591a9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:10.911709 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b53722a5-7c71-455e-bd51-846de00591a9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:10.912427 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b53722a5-7c71-455e-bd51-846de00591a9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:10.912879 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b53722a5-7c71-455e-bd51-846de00591a9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:10.913300 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b53722a5-7c71-455e-bd51-846de00591a9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:11.060681 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b53722a5-7c71-455e-bd51-846de00591a9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:11.070353 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b53722a5-7c71-455e-bd51-846de00591a9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1723 microversion: 2.1 time: 0.170690 Sep 10 12:10:11.071047 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2894/5795] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:10:10 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:10:11.469943 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-50884f8a-58d3-40ed-a2de-7d5f63f68bf0 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:11.470595 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-50884f8a-58d3-40ed-a2de-7d5f63f68bf0 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] [instance: bce7d28b-43a8-4308-80f9-b1413ff622bc] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:11.477727 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50884f8a-58d3-40ed-a2de-7d5f63f68bf0 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:11.478265 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50884f8a-58d3-40ed-a2de-7d5f63f68bf0 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:11.478707 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50884f8a-58d3-40ed-a2de-7d5f63f68bf0 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:11.479442 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50884f8a-58d3-40ed-a2de-7d5f63f68bf0 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:11.479949 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50884f8a-58d3-40ed-a2de-7d5f63f68bf0 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:11.480386 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50884f8a-58d3-40ed-a2de-7d5f63f68bf0 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:11.623926 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-50884f8a-58d3-40ed-a2de-7d5f63f68bf0 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ed72c3edf944c6bd5a60de122fe9b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4238c6353bb84f41b1dee58fd8395e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:11.633183 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-50884f8a-58d3-40ed-a2de-7d5f63f68bf0 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] 10.222.0.23 "GET /compute/v2.1/servers/bce7d28b-43a8-4308-80f9-b1413ff622bc" status: 200 len: 1313 microversion: 2.1 time: 0.167687 Sep 10 12:10:11.634153 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2902/5796] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:10:11 2022] GET /compute/v2.1/servers/bce7d28b-43a8-4308-80f9-b1413ff622bc => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:10:11.709754 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-72e23d8d-b081-458d-858e-5a53938a5353 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:11.710416 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-72e23d8d-b081-458d-858e-5a53938a5353 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] [instance: a0aad895-68c0-4e8f-b3dd-9d78074bbcbd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:11.716951 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-72e23d8d-b081-458d-858e-5a53938a5353 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:11.717437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-72e23d8d-b081-458d-858e-5a53938a5353 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:11.717882 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-72e23d8d-b081-458d-858e-5a53938a5353 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:11.718584 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-72e23d8d-b081-458d-858e-5a53938a5353 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:11.719045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-72e23d8d-b081-458d-858e-5a53938a5353 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:11.719596 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-72e23d8d-b081-458d-858e-5a53938a5353 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:11.791391 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-72e23d8d-b081-458d-858e-5a53938a5353 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:11.793955 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:10:11.807076 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-72e23d8d-b081-458d-858e-5a53938a5353 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:11.809560 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-72e23d8d-b081-458d-858e-5a53938a5353 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:11.811781 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-72e23d8d-b081-458d-858e-5a53938a5353 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] 10.222.0.23 "GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd" status: 200 len: 1408 microversion: 2.54 time: 0.105954 Sep 10 12:10:11.828052 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2895/5797] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:11 2022] GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd => generated 1408 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:12.094648 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-da1f59f1-b87f-4493-9d41-96b6bcf130fe tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:12.095270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-da1f59f1-b87f-4493-9d41-96b6bcf130fe tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:12.101533 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da1f59f1-b87f-4493-9d41-96b6bcf130fe tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:12.102022 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da1f59f1-b87f-4493-9d41-96b6bcf130fe tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:12.102472 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da1f59f1-b87f-4493-9d41-96b6bcf130fe tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:12.103185 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da1f59f1-b87f-4493-9d41-96b6bcf130fe tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:12.103641 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da1f59f1-b87f-4493-9d41-96b6bcf130fe tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:12.104072 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da1f59f1-b87f-4493-9d41-96b6bcf130fe tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:12.241730 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-da1f59f1-b87f-4493-9d41-96b6bcf130fe tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:12.250338 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-da1f59f1-b87f-4493-9d41-96b6bcf130fe tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1723 microversion: 2.1 time: 0.160237 Sep 10 12:10:12.250924 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2903/5798] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:10:12 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:10:12.659334 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-98835517-1d51-47f4-9d42-88c4e2ff21ff tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:12.659334 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-98835517-1d51-47f4-9d42-88c4e2ff21ff tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] [instance: bce7d28b-43a8-4308-80f9-b1413ff622bc] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:12.670647 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=20 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:10:12.677627 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98835517-1d51-47f4-9d42-88c4e2ff21ff tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:12.678126 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98835517-1d51-47f4-9d42-88c4e2ff21ff tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:12.678562 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98835517-1d51-47f4-9d42-88c4e2ff21ff tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:12.679306 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98835517-1d51-47f4-9d42-88c4e2ff21ff tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:12.679762 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98835517-1d51-47f4-9d42-88c4e2ff21ff tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:12.680193 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98835517-1d51-47f4-9d42-88c4e2ff21ff tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:12.832094 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-98835517-1d51-47f4-9d42-88c4e2ff21ff tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ed72c3edf944c6bd5a60de122fe9b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4238c6353bb84f41b1dee58fd8395e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:12.841408 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c4500e6f-d3d7-41e8-bab3-c0f13c228c6d tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:12.842068 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-98835517-1d51-47f4-9d42-88c4e2ff21ff tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] 10.222.0.23 "GET /compute/v2.1/servers/bce7d28b-43a8-4308-80f9-b1413ff622bc" status: 200 len: 1313 microversion: 2.1 time: 0.189263 Sep 10 12:10:12.842440 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2896/5799] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:10:12 2022] GET /compute/v2.1/servers/bce7d28b-43a8-4308-80f9-b1413ff622bc => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:10:12.843124 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c4500e6f-d3d7-41e8-bab3-c0f13c228c6d tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] [instance: a0aad895-68c0-4e8f-b3dd-9d78074bbcbd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:12.853228 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c4500e6f-d3d7-41e8-bab3-c0f13c228c6d tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:12.853946 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c4500e6f-d3d7-41e8-bab3-c0f13c228c6d tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:12.854556 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c4500e6f-d3d7-41e8-bab3-c0f13c228c6d tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:12.855566 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c4500e6f-d3d7-41e8-bab3-c0f13c228c6d tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:12.856494 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c4500e6f-d3d7-41e8-bab3-c0f13c228c6d tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:12.857352 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c4500e6f-d3d7-41e8-bab3-c0f13c228c6d tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:12.882192 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:10:12.935401 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c4500e6f-d3d7-41e8-bab3-c0f13c228c6d tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:12.944547 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c4500e6f-d3d7-41e8-bab3-c0f13c228c6d tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:12.946188 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c4500e6f-d3d7-41e8-bab3-c0f13c228c6d tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:12.947423 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c4500e6f-d3d7-41e8-bab3-c0f13c228c6d tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] 10.222.0.23 "GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd" status: 200 len: 1408 microversion: 2.54 time: 0.111993 Sep 10 12:10:12.948006 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2904/5800] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:12 2022] GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd => generated 1408 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:13.274655 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4fa2640a-0155-4851-bf16-e2222ba234bf tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:13.275284 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4fa2640a-0155-4851-bf16-e2222ba234bf tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:13.290535 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4fa2640a-0155-4851-bf16-e2222ba234bf tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:13.291040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4fa2640a-0155-4851-bf16-e2222ba234bf tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:13.291667 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4fa2640a-0155-4851-bf16-e2222ba234bf tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:13.292204 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4fa2640a-0155-4851-bf16-e2222ba234bf tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:13.292669 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4fa2640a-0155-4851-bf16-e2222ba234bf tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:13.293090 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4fa2640a-0155-4851-bf16-e2222ba234bf tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:13.435210 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-a760a7af-5335-46ec-b9d1-e0daacf453c8 req-f57e661e-ecab-4138-9925-76ea8f01a6dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bce7d28b-43a8-4308-80f9-b1413ff622bc", "name": "network-vif-plugged", "status": "completed", "tag": "7d4a6f08-9dd8-4e20-9105-10d291cf0afb"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:10:13.452211 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=10 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:10:13.463871 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4fa2640a-0155-4851-bf16-e2222ba234bf tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:13.472649 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a760a7af-5335-46ec-b9d1-e0daacf453c8 req-f57e661e-ecab-4138-9925-76ea8f01a6dd service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:13.473222 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a760a7af-5335-46ec-b9d1-e0daacf453c8 req-f57e661e-ecab-4138-9925-76ea8f01a6dd service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:13.473742 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a760a7af-5335-46ec-b9d1-e0daacf453c8 req-f57e661e-ecab-4138-9925-76ea8f01a6dd service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:13.474691 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4fa2640a-0155-4851-bf16-e2222ba234bf tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1723 microversion: 2.1 time: 0.203815 Sep 10 12:10:13.475585 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2897/5801] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:10:13 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:10:13.491071 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-a760a7af-5335-46ec-b9d1-e0daacf453c8 req-f57e661e-ecab-4138-9925-76ea8f01a6dd service nova] Creating event network-vif-plugged:7d4a6f08-9dd8-4e20-9105-10d291cf0afb for instance bce7d28b-43a8-4308-80f9-b1413ff622bc on n-h1-856895-1 Sep 10 12:10:13.497411 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-a760a7af-5335-46ec-b9d1-e0daacf453c8 req-f57e661e-ecab-4138-9925-76ea8f01a6dd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065784 Sep 10 12:10:13.498485 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2905/5802] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:10:13.866584 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b3d00a9a-8c06-4143-a750-b21b5e1ac3ba tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:13.867048 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b3d00a9a-8c06-4143-a750-b21b5e1ac3ba tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] [instance: bce7d28b-43a8-4308-80f9-b1413ff622bc] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:13.874612 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b3d00a9a-8c06-4143-a750-b21b5e1ac3ba tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:13.875908 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b3d00a9a-8c06-4143-a750-b21b5e1ac3ba tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:13.876347 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b3d00a9a-8c06-4143-a750-b21b5e1ac3ba tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:13.877849 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b3d00a9a-8c06-4143-a750-b21b5e1ac3ba tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:13.878319 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b3d00a9a-8c06-4143-a750-b21b5e1ac3ba tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:13.878752 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b3d00a9a-8c06-4143-a750-b21b5e1ac3ba tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:13.974735 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d357c93c-6f06-4843-abb5-e451f60abed7 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:13.975532 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d357c93c-6f06-4843-abb5-e451f60abed7 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] [instance: a0aad895-68c0-4e8f-b3dd-9d78074bbcbd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:13.982701 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d357c93c-6f06-4843-abb5-e451f60abed7 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:13.983345 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d357c93c-6f06-4843-abb5-e451f60abed7 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:13.984862 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d357c93c-6f06-4843-abb5-e451f60abed7 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:13.987415 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d357c93c-6f06-4843-abb5-e451f60abed7 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:13.987957 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d357c93c-6f06-4843-abb5-e451f60abed7 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:13.988410 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d357c93c-6f06-4843-abb5-e451f60abed7 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:14.033269 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b3d00a9a-8c06-4143-a750-b21b5e1ac3ba tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ed72c3edf944c6bd5a60de122fe9b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4238c6353bb84f41b1dee58fd8395e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:14.041613 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b3d00a9a-8c06-4143-a750-b21b5e1ac3ba tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] 10.222.0.23 "GET /compute/v2.1/servers/bce7d28b-43a8-4308-80f9-b1413ff622bc" status: 200 len: 1313 microversion: 2.1 time: 0.179532 Sep 10 12:10:14.042790 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2898/5803] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:10:13 2022] GET /compute/v2.1/servers/bce7d28b-43a8-4308-80f9-b1413ff622bc => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:10:14.063734 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d357c93c-6f06-4843-abb5-e451f60abed7 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:14.073194 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d357c93c-6f06-4843-abb5-e451f60abed7 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:14.074878 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d357c93c-6f06-4843-abb5-e451f60abed7 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:14.076116 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d357c93c-6f06-4843-abb5-e451f60abed7 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] 10.222.0.23 "GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd" status: 200 len: 1408 microversion: 2.54 time: 0.106754 Sep 10 12:10:14.077056 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2906/5804] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:13 2022] GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd => generated 1408 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 12:10:14.498333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4e1e9883-0363-44df-bd97-d249564d5729 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:14.499027 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4e1e9883-0363-44df-bd97-d249564d5729 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:14.505763 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e1e9883-0363-44df-bd97-d249564d5729 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:14.506258 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e1e9883-0363-44df-bd97-d249564d5729 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:14.506705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e1e9883-0363-44df-bd97-d249564d5729 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:14.507473 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e1e9883-0363-44df-bd97-d249564d5729 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:14.507935 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e1e9883-0363-44df-bd97-d249564d5729 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:14.508390 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e1e9883-0363-44df-bd97-d249564d5729 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:14.667888 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4e1e9883-0363-44df-bd97-d249564d5729 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:14.677711 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4e1e9883-0363-44df-bd97-d249564d5729 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1700 microversion: 2.1 time: 0.183333 Sep 10 12:10:14.678299 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2899/5805] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:10:14 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1700 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:10:14.701902 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bfa67b00-59e4-4b7d-9eb6-1c7bc4c91c09 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:10:14.709029 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bfa67b00-59e4-4b7d-9eb6-1c7bc4c91c09 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:14.709738 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bfa67b00-59e4-4b7d-9eb6-1c7bc4c91c09 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:14.710161 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bfa67b00-59e4-4b7d-9eb6-1c7bc4c91c09 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:14.734720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bfa67b00-59e4-4b7d-9eb6-1c7bc4c91c09 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Going to try to start instance {{(pid=128776) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 10 12:10:14.778848 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bfa67b00-59e4-4b7d-9eb6-1c7bc4c91c09 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "POST /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9/action" status: 202 len: 0 microversion: 2.1 time: 0.080971 Sep 10 12:10:14.779647 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2907/5806] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:10:14 2022] POST /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:10:14.789011 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2a8f8bc4-5348-40c8-aaf0-859a0b39bad9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:14.789790 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2a8f8bc4-5348-40c8-aaf0-859a0b39bad9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:14.796525 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a8f8bc4-5348-40c8-aaf0-859a0b39bad9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:14.797136 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a8f8bc4-5348-40c8-aaf0-859a0b39bad9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:14.797846 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a8f8bc4-5348-40c8-aaf0-859a0b39bad9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:14.799396 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a8f8bc4-5348-40c8-aaf0-859a0b39bad9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:14.800466 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a8f8bc4-5348-40c8-aaf0-859a0b39bad9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:14.801000 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a8f8bc4-5348-40c8-aaf0-859a0b39bad9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:14.828890 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:10:15.000128 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2a8f8bc4-5348-40c8-aaf0-859a0b39bad9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:15.008961 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2a8f8bc4-5348-40c8-aaf0-859a0b39bad9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1709 microversion: 2.1 time: 0.223973 Sep 10 12:10:15.009475 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2900/5807] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:10:14 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1709 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:10:15.067635 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5da3c584-0aca-4628-833d-f5ee58d961aa tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:15.068376 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5da3c584-0aca-4628-833d-f5ee58d961aa tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] [instance: bce7d28b-43a8-4308-80f9-b1413ff622bc] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:15.074686 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5da3c584-0aca-4628-833d-f5ee58d961aa tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:15.075241 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5da3c584-0aca-4628-833d-f5ee58d961aa tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:15.075691 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5da3c584-0aca-4628-833d-f5ee58d961aa tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:15.076400 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5da3c584-0aca-4628-833d-f5ee58d961aa tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:15.076865 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5da3c584-0aca-4628-833d-f5ee58d961aa tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:15.077304 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5da3c584-0aca-4628-833d-f5ee58d961aa tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:15.106529 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-25619336-28df-41d6-ba82-827a92fe84da tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:15.108381 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-25619336-28df-41d6-ba82-827a92fe84da tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] [instance: a0aad895-68c0-4e8f-b3dd-9d78074bbcbd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:15.126108 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25619336-28df-41d6-ba82-827a92fe84da tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:15.126836 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25619336-28df-41d6-ba82-827a92fe84da tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:15.127490 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25619336-28df-41d6-ba82-827a92fe84da tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:15.136124 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25619336-28df-41d6-ba82-827a92fe84da tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:15.137109 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25619336-28df-41d6-ba82-827a92fe84da tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:15.137955 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25619336-28df-41d6-ba82-827a92fe84da tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:15.235511 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-25619336-28df-41d6-ba82-827a92fe84da tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:15.245285 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-25619336-28df-41d6-ba82-827a92fe84da tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:15.247063 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-25619336-28df-41d6-ba82-827a92fe84da tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:15.248353 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-25619336-28df-41d6-ba82-827a92fe84da tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] 10.222.0.23 "GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd" status: 200 len: 1408 microversion: 2.54 time: 0.147026 Sep 10 12:10:15.248931 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2901/5808] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:15 2022] GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd => generated 1408 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:15.350990 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5da3c584-0aca-4628-833d-f5ee58d961aa tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ed72c3edf944c6bd5a60de122fe9b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4238c6353bb84f41b1dee58fd8395e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:15.360128 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5da3c584-0aca-4628-833d-f5ee58d961aa tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] 10.222.0.23 "GET /compute/v2.1/servers/bce7d28b-43a8-4308-80f9-b1413ff622bc" status: 200 len: 1313 microversion: 2.1 time: 0.297902 Sep 10 12:10:15.362868 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2908/5809] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:10:15 2022] GET /compute/v2.1/servers/bce7d28b-43a8-4308-80f9-b1413ff622bc => generated 1313 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:10:15.877177 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a6517c8f-02af-4a43-b5f5-c72f40aa7366 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:15.877835 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a6517c8f-02af-4a43-b5f5-c72f40aa7366 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] [instance: b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:15.884650 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a6517c8f-02af-4a43-b5f5-c72f40aa7366 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:15.885134 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a6517c8f-02af-4a43-b5f5-c72f40aa7366 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:15.885645 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a6517c8f-02af-4a43-b5f5-c72f40aa7366 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:15.886335 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a6517c8f-02af-4a43-b5f5-c72f40aa7366 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:15.886786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a6517c8f-02af-4a43-b5f5-c72f40aa7366 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:15.887235 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a6517c8f-02af-4a43-b5f5-c72f40aa7366 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:15.976743 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-a6517c8f-02af-4a43-b5f5-c72f40aa7366 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lazy-loading 'services' on Instance uuid b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:10:16.032034 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8cb91c03-0cfb-42c8-95f5-673d0dd86b4c tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:16.033217 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8cb91c03-0cfb-42c8-95f5-673d0dd86b4c tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:16.040721 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8cb91c03-0cfb-42c8-95f5-673d0dd86b4c tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:16.043779 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8cb91c03-0cfb-42c8-95f5-673d0dd86b4c tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:16.044361 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8cb91c03-0cfb-42c8-95f5-673d0dd86b4c tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:16.045326 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8cb91c03-0cfb-42c8-95f5-673d0dd86b4c tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:16.046351 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8cb91c03-0cfb-42c8-95f5-673d0dd86b4c tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:16.047187 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8cb91c03-0cfb-42c8-95f5-673d0dd86b4c tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:16.058580 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a6517c8f-02af-4a43-b5f5-c72f40aa7366 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3/os-volume_attachments/18a30d4c-a4d1-416a-954e-1486c0c760b9" status: 202 len: 0 microversion: 2.1 time: 0.185574 Sep 10 12:10:16.059483 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2902/5810] 10.222.0.23 () {58 vars in 1416 bytes} [Sat Sep 10 12:10:15 2022] DELETE /compute/v2.1/servers/b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3/os-volume_attachments/18a30d4c-a4d1-416a-954e-1486c0c760b9 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:10:16.210333 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8cb91c03-0cfb-42c8-95f5-673d0dd86b4c tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:16.218800 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8cb91c03-0cfb-42c8-95f5-673d0dd86b4c tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1709 microversion: 2.1 time: 0.190619 Sep 10 12:10:16.219415 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2909/5811] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:10:16 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1709 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:10:16.276977 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c641103b-4a40-4ff1-887b-72fd9aaa34b5 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:16.277859 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c641103b-4a40-4ff1-887b-72fd9aaa34b5 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] [instance: a0aad895-68c0-4e8f-b3dd-9d78074bbcbd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:16.285072 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c641103b-4a40-4ff1-887b-72fd9aaa34b5 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:16.285723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c641103b-4a40-4ff1-887b-72fd9aaa34b5 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:16.286404 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c641103b-4a40-4ff1-887b-72fd9aaa34b5 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:16.287465 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c641103b-4a40-4ff1-887b-72fd9aaa34b5 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:16.287966 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c641103b-4a40-4ff1-887b-72fd9aaa34b5 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:16.288395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c641103b-4a40-4ff1-887b-72fd9aaa34b5 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:16.356943 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c641103b-4a40-4ff1-887b-72fd9aaa34b5 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:16.365287 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c641103b-4a40-4ff1-887b-72fd9aaa34b5 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:16.366743 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c641103b-4a40-4ff1-887b-72fd9aaa34b5 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:16.368002 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c641103b-4a40-4ff1-887b-72fd9aaa34b5 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] 10.222.0.23 "GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd" status: 200 len: 1408 microversion: 2.54 time: 0.095334 Sep 10 12:10:16.368572 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2903/5812] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:16 2022] GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd => generated 1408 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:16.383064 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d3908a97-7b8a-400a-80b9-7963aaac6bd5 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:16.383956 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d3908a97-7b8a-400a-80b9-7963aaac6bd5 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] [instance: bce7d28b-43a8-4308-80f9-b1413ff622bc] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:16.391015 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d3908a97-7b8a-400a-80b9-7963aaac6bd5 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:16.391544 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d3908a97-7b8a-400a-80b9-7963aaac6bd5 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:16.391983 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d3908a97-7b8a-400a-80b9-7963aaac6bd5 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:16.394494 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d3908a97-7b8a-400a-80b9-7963aaac6bd5 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:16.395392 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d3908a97-7b8a-400a-80b9-7963aaac6bd5 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:16.395830 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d3908a97-7b8a-400a-80b9-7963aaac6bd5 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:16.537098 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d3908a97-7b8a-400a-80b9-7963aaac6bd5 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ed72c3edf944c6bd5a60de122fe9b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4238c6353bb84f41b1dee58fd8395e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:16.544894 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d3908a97-7b8a-400a-80b9-7963aaac6bd5 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] 10.222.0.23 "GET /compute/v2.1/servers/bce7d28b-43a8-4308-80f9-b1413ff622bc" status: 200 len: 1498 microversion: 2.1 time: 0.165723 Sep 10 12:10:16.545471 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2910/5813] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:10:16 2022] GET /compute/v2.1/servers/bce7d28b-43a8-4308-80f9-b1413ff622bc => generated 1498 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:10:17.242752 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-de756015-a5d2-466c-933d-8d429de195f9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:17.244404 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-de756015-a5d2-466c-933d-8d429de195f9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:17.252421 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-de756015-a5d2-466c-933d-8d429de195f9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:17.252997 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-de756015-a5d2-466c-933d-8d429de195f9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:17.253545 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-de756015-a5d2-466c-933d-8d429de195f9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:17.254607 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-de756015-a5d2-466c-933d-8d429de195f9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:17.255187 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-de756015-a5d2-466c-933d-8d429de195f9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:17.255720 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-de756015-a5d2-466c-933d-8d429de195f9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:17.395077 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e6e9e097-c76e-4996-be4a-00a48c39ce4f tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:17.396658 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e6e9e097-c76e-4996-be4a-00a48c39ce4f tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] [instance: a0aad895-68c0-4e8f-b3dd-9d78074bbcbd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:17.401959 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-de756015-a5d2-466c-933d-8d429de195f9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:17.405836 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6e9e097-c76e-4996-be4a-00a48c39ce4f tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:17.406582 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6e9e097-c76e-4996-be4a-00a48c39ce4f tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:17.407264 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6e9e097-c76e-4996-be4a-00a48c39ce4f tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:17.408409 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6e9e097-c76e-4996-be4a-00a48c39ce4f tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:17.409136 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6e9e097-c76e-4996-be4a-00a48c39ce4f tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:17.409795 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6e9e097-c76e-4996-be4a-00a48c39ce4f tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:17.414779 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-de756015-a5d2-466c-933d-8d429de195f9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1713 microversion: 2.1 time: 0.175700 Sep 10 12:10:17.428630 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2904/5814] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:10:17 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1713 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:10:17.485032 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e6e9e097-c76e-4996-be4a-00a48c39ce4f tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:17.494019 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e6e9e097-c76e-4996-be4a-00a48c39ce4f tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:17.495600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e6e9e097-c76e-4996-be4a-00a48c39ce4f tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:17.496959 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e6e9e097-c76e-4996-be4a-00a48c39ce4f tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] 10.222.0.23 "GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd" status: 200 len: 1408 microversion: 2.54 time: 0.106633 Sep 10 12:10:17.497662 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2911/5815] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:17 2022] GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd => generated 1408 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 12:10:17.934291 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-57cebbb0-f643-4f68-ba02-bf5d77ae0def tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:17.934787 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-57cebbb0-f643-4f68-ba02-bf5d77ae0def tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] [instance: 79d4afff-11d8-4d63-b972-5d9c220b44c6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:17.943891 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57cebbb0-f643-4f68-ba02-bf5d77ae0def tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:17.944527 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57cebbb0-f643-4f68-ba02-bf5d77ae0def tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:17.945071 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57cebbb0-f643-4f68-ba02-bf5d77ae0def tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:17.945848 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57cebbb0-f643-4f68-ba02-bf5d77ae0def tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:17.946378 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57cebbb0-f643-4f68-ba02-bf5d77ae0def tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:17.947021 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57cebbb0-f643-4f68-ba02-bf5d77ae0def tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:17.973503 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-57cebbb0-f643-4f68-ba02-bf5d77ae0def tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] 10.222.0.23 "GET /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.043244 Sep 10 12:10:17.974095 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2905/5816] 10.222.0.23 () {58 vars in 1293 bytes} [Sat Sep 10 12:10:17 2022] GET /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6/os-server-password => generated 116 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:10:18.525038 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-329e44c8-f052-4d8a-9fb9-859fed436f6d tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:18.525038 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-329e44c8-f052-4d8a-9fb9-859fed436f6d tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] [instance: a0aad895-68c0-4e8f-b3dd-9d78074bbcbd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:18.531250 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-329e44c8-f052-4d8a-9fb9-859fed436f6d tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:18.531923 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-329e44c8-f052-4d8a-9fb9-859fed436f6d tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:18.532920 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-329e44c8-f052-4d8a-9fb9-859fed436f6d tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:18.533909 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-329e44c8-f052-4d8a-9fb9-859fed436f6d tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:18.534374 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-329e44c8-f052-4d8a-9fb9-859fed436f6d tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:18.534812 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-329e44c8-f052-4d8a-9fb9-859fed436f6d tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:18.622133 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-329e44c8-f052-4d8a-9fb9-859fed436f6d tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:18.631395 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-329e44c8-f052-4d8a-9fb9-859fed436f6d tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:18.632876 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-329e44c8-f052-4d8a-9fb9-859fed436f6d tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:18.634165 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-329e44c8-f052-4d8a-9fb9-859fed436f6d tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] 10.222.0.23 "GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd" status: 200 len: 1408 microversion: 2.54 time: 0.114889 Sep 10 12:10:18.639734 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2912/5817] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:18 2022] GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd => generated 1408 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:18.939950 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c344fe50-febb-4379-807d-65e17140c14d tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:18.940664 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c344fe50-febb-4379-807d-65e17140c14d tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] [instance: bce7d28b-43a8-4308-80f9-b1413ff622bc] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:18.947262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c344fe50-febb-4379-807d-65e17140c14d tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:18.947742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c344fe50-febb-4379-807d-65e17140c14d tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:18.948174 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c344fe50-febb-4379-807d-65e17140c14d tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:18.948861 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c344fe50-febb-4379-807d-65e17140c14d tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:18.949309 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c344fe50-febb-4379-807d-65e17140c14d tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:18.949730 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c344fe50-febb-4379-807d-65e17140c14d tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:18.976376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c344fe50-febb-4379-807d-65e17140c14d tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] [instance: bce7d28b-43a8-4308-80f9-b1413ff622bc] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:10:19.055073 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c344fe50-febb-4379-807d-65e17140c14d tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bce7d28b-43a8-4308-80f9-b1413ff622bc" status: 204 len: 0 microversion: 2.1 time: 0.118825 Sep 10 12:10:19.058885 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2906/5818] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:10:18 2022] DELETE /compute/v2.1/servers/bce7d28b-43a8-4308-80f9-b1413ff622bc => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 12:10:19.065215 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7d03c151-c84f-4713-956a-67c63d854427 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:19.065890 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7d03c151-c84f-4713-956a-67c63d854427 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] [instance: bce7d28b-43a8-4308-80f9-b1413ff622bc] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:19.071916 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d03c151-c84f-4713-956a-67c63d854427 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:19.072406 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d03c151-c84f-4713-956a-67c63d854427 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:19.072870 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d03c151-c84f-4713-956a-67c63d854427 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:19.073567 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d03c151-c84f-4713-956a-67c63d854427 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:19.074025 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d03c151-c84f-4713-956a-67c63d854427 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:19.074454 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d03c151-c84f-4713-956a-67c63d854427 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:19.207430 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7d03c151-c84f-4713-956a-67c63d854427 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ed72c3edf944c6bd5a60de122fe9b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4238c6353bb84f41b1dee58fd8395e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:19.215301 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7d03c151-c84f-4713-956a-67c63d854427 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] 10.222.0.23 "GET /compute/v2.1/servers/bce7d28b-43a8-4308-80f9-b1413ff622bc" status: 200 len: 1504 microversion: 2.1 time: 0.155228 Sep 10 12:10:19.215885 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2913/5819] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:10:19 2022] GET /compute/v2.1/servers/bce7d28b-43a8-4308-80f9-b1413ff622bc => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:10:19.662021 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-09a252f8-6568-487f-aaba-7351f9495c1c tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:19.662733 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-09a252f8-6568-487f-aaba-7351f9495c1c tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] [instance: a0aad895-68c0-4e8f-b3dd-9d78074bbcbd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:19.668789 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-09a252f8-6568-487f-aaba-7351f9495c1c tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:19.669276 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-09a252f8-6568-487f-aaba-7351f9495c1c tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:19.669788 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-09a252f8-6568-487f-aaba-7351f9495c1c tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:19.670482 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-09a252f8-6568-487f-aaba-7351f9495c1c tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:19.670934 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-09a252f8-6568-487f-aaba-7351f9495c1c tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:19.671391 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-09a252f8-6568-487f-aaba-7351f9495c1c tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:19.742632 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-09a252f8-6568-487f-aaba-7351f9495c1c tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:19.750972 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-09a252f8-6568-487f-aaba-7351f9495c1c tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:19.752590 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-09a252f8-6568-487f-aaba-7351f9495c1c tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:19.753763 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-09a252f8-6568-487f-aaba-7351f9495c1c tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] 10.222.0.23 "GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd" status: 200 len: 1408 microversion: 2.54 time: 0.097182 Sep 10 12:10:19.754333 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2907/5820] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:19 2022] GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd => generated 1408 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:20.239262 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a38c270c-b0f8-4a63-9e6e-658925208727 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:20.240014 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a38c270c-b0f8-4a63-9e6e-658925208727 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] [instance: bce7d28b-43a8-4308-80f9-b1413ff622bc] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:20.246987 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a38c270c-b0f8-4a63-9e6e-658925208727 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:20.247507 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a38c270c-b0f8-4a63-9e6e-658925208727 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:20.247945 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a38c270c-b0f8-4a63-9e6e-658925208727 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:20.248638 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a38c270c-b0f8-4a63-9e6e-658925208727 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:20.249092 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a38c270c-b0f8-4a63-9e6e-658925208727 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:20.249516 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a38c270c-b0f8-4a63-9e6e-658925208727 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:20.387910 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a38c270c-b0f8-4a63-9e6e-658925208727 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ed72c3edf944c6bd5a60de122fe9b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4238c6353bb84f41b1dee58fd8395e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:20.411579 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a38c270c-b0f8-4a63-9e6e-658925208727 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] 10.222.0.23 "GET /compute/v2.1/servers/bce7d28b-43a8-4308-80f9-b1413ff622bc" status: 200 len: 1504 microversion: 2.1 time: 0.176155 Sep 10 12:10:20.423858 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2914/5821] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:10:20 2022] GET /compute/v2.1/servers/bce7d28b-43a8-4308-80f9-b1413ff622bc => generated 1504 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:10:20.779416 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-690c3635-fd58-49b5-afe6-427df4c7c8dd tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:20.780151 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-690c3635-fd58-49b5-afe6-427df4c7c8dd tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] [instance: a0aad895-68c0-4e8f-b3dd-9d78074bbcbd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:20.799604 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-690c3635-fd58-49b5-afe6-427df4c7c8dd tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:20.800195 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-690c3635-fd58-49b5-afe6-427df4c7c8dd tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:20.800718 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-690c3635-fd58-49b5-afe6-427df4c7c8dd tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:20.801516 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-690c3635-fd58-49b5-afe6-427df4c7c8dd tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:20.802048 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-690c3635-fd58-49b5-afe6-427df4c7c8dd tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:20.802552 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-690c3635-fd58-49b5-afe6-427df4c7c8dd tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:20.892790 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-690c3635-fd58-49b5-afe6-427df4c7c8dd tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:20.906517 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-690c3635-fd58-49b5-afe6-427df4c7c8dd tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:20.909186 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-690c3635-fd58-49b5-afe6-427df4c7c8dd tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:20.910592 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-690c3635-fd58-49b5-afe6-427df4c7c8dd tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] 10.222.0.23 "GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd" status: 200 len: 1408 microversion: 2.54 time: 0.135180 Sep 10 12:10:20.912817 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2908/5822] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:20 2022] GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd => generated 1408 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:21.302645 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-7f9b49c2-0929-492d-92e5-27c6b1724566 req-66e2a89a-4758-4dde-8e9c-063ff8dedb0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bce7d28b-43a8-4308-80f9-b1413ff622bc", "name": "network-vif-deleted", "tag": "7d4a6f08-9dd8-4e20-9105-10d291cf0afb"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:10:21.317535 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-7f9b49c2-0929-492d-92e5-27c6b1724566 req-66e2a89a-4758-4dde-8e9c-063ff8dedb0c service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:21.318037 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-7f9b49c2-0929-492d-92e5-27c6b1724566 req-66e2a89a-4758-4dde-8e9c-063ff8dedb0c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:21.318678 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-7f9b49c2-0929-492d-92e5-27c6b1724566 req-66e2a89a-4758-4dde-8e9c-063ff8dedb0c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:21.334590 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-7f9b49c2-0929-492d-92e5-27c6b1724566 req-66e2a89a-4758-4dde-8e9c-063ff8dedb0c service nova] Creating event network-vif-deleted:7d4a6f08-9dd8-4e20-9105-10d291cf0afb for instance bce7d28b-43a8-4308-80f9-b1413ff622bc on n-h1-856895-1 Sep 10 12:10:21.341907 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-7f9b49c2-0929-492d-92e5-27c6b1724566 req-66e2a89a-4758-4dde-8e9c-063ff8dedb0c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045509 Sep 10 12:10:21.342536 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2915/5823] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:10:21.439386 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9b7fbe2a-da57-4884-94fc-9e21537da66b tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:21.440217 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9b7fbe2a-da57-4884-94fc-9e21537da66b tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] [instance: bce7d28b-43a8-4308-80f9-b1413ff622bc] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:21.450557 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9b7fbe2a-da57-4884-94fc-9e21537da66b tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:21.451058 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9b7fbe2a-da57-4884-94fc-9e21537da66b tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:21.451525 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9b7fbe2a-da57-4884-94fc-9e21537da66b tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:21.452234 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9b7fbe2a-da57-4884-94fc-9e21537da66b tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:21.452693 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9b7fbe2a-da57-4884-94fc-9e21537da66b tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:21.453124 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9b7fbe2a-da57-4884-94fc-9e21537da66b tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:21.508106 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9b7fbe2a-da57-4884-94fc-9e21537da66b tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:21.508829 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9b7fbe2a-da57-4884-94fc-9e21537da66b tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:21.508986 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-28d7a3d6-2e5d-4e23-9580-b21c29e105b3 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:21.509579 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9b7fbe2a-da57-4884-94fc-9e21537da66b tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:21.509709 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-28d7a3d6-2e5d-4e23-9580-b21c29e105b3 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] [instance: b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:21.510303 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-9b7fbe2a-da57-4884-94fc-9e21537da66b tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lazy-loading 'fault' on Instance uuid bce7d28b-43a8-4308-80f9-b1413ff622bc {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:10:21.518097 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28d7a3d6-2e5d-4e23-9580-b21c29e105b3 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:21.519617 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28d7a3d6-2e5d-4e23-9580-b21c29e105b3 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:21.520487 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28d7a3d6-2e5d-4e23-9580-b21c29e105b3 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:21.521418 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28d7a3d6-2e5d-4e23-9580-b21c29e105b3 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:21.522256 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28d7a3d6-2e5d-4e23-9580-b21c29e105b3 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:21.522905 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28d7a3d6-2e5d-4e23-9580-b21c29e105b3 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:21.560793 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9b7fbe2a-da57-4884-94fc-9e21537da66b tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ed72c3edf944c6bd5a60de122fe9b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4238c6353bb84f41b1dee58fd8395e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:21.569131 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9b7fbe2a-da57-4884-94fc-9e21537da66b tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] 10.222.0.23 "GET /compute/v2.1/servers/bce7d28b-43a8-4308-80f9-b1413ff622bc" status: 200 len: 1303 microversion: 2.1 time: 0.134075 Sep 10 12:10:21.569861 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2909/5824] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:10:21 2022] GET /compute/v2.1/servers/bce7d28b-43a8-4308-80f9-b1413ff622bc => generated 1303 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:10:21.577967 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-28d7a3d6-2e5d-4e23-9580-b21c29e105b3 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] [instance: b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:10:21.675624 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-28d7a3d6-2e5d-4e23-9580-b21c29e105b3 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3" status: 204 len: 0 microversion: 2.1 time: 0.170704 Sep 10 12:10:21.676473 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2916/5825] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:10:21 2022] DELETE /compute/v2.1/servers/b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:10:21.684443 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5bc08bac-3222-4c91-912f-8303bc4a2dda tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:21.685078 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5bc08bac-3222-4c91-912f-8303bc4a2dda tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] [instance: b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:21.692070 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5bc08bac-3222-4c91-912f-8303bc4a2dda tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:21.692495 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5bc08bac-3222-4c91-912f-8303bc4a2dda tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:21.692942 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5bc08bac-3222-4c91-912f-8303bc4a2dda tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:21.693645 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5bc08bac-3222-4c91-912f-8303bc4a2dda tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:21.694108 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5bc08bac-3222-4c91-912f-8303bc4a2dda tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:21.694539 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5bc08bac-3222-4c91-912f-8303bc4a2dda tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:21.833478 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5bc08bac-3222-4c91-912f-8303bc4a2dda tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f17689334f524764820a7d4cd944641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e93992bf3f458ba21e305e747f0075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:21.841430 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5bc08bac-3222-4c91-912f-8303bc4a2dda tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] 10.222.0.23 "GET /compute/v2.1/servers/b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3" status: 200 len: 1468 microversion: 2.1 time: 0.160836 Sep 10 12:10:21.842012 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2910/5826] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:10:21 2022] GET /compute/v2.1/servers/b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3 => generated 1468 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:10:21.936539 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c71ef665-5676-4d8c-999e-066e3087318b tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:21.937257 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c71ef665-5676-4d8c-999e-066e3087318b tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] [instance: a0aad895-68c0-4e8f-b3dd-9d78074bbcbd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:21.944155 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c71ef665-5676-4d8c-999e-066e3087318b tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:21.944589 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c71ef665-5676-4d8c-999e-066e3087318b tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:21.945025 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c71ef665-5676-4d8c-999e-066e3087318b tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:21.945745 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c71ef665-5676-4d8c-999e-066e3087318b tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:21.946315 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c71ef665-5676-4d8c-999e-066e3087318b tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:21.946773 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c71ef665-5676-4d8c-999e-066e3087318b tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:22.022680 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c71ef665-5676-4d8c-999e-066e3087318b tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:22.030863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c71ef665-5676-4d8c-999e-066e3087318b tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:22.032357 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c71ef665-5676-4d8c-999e-066e3087318b tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:22.033700 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c71ef665-5676-4d8c-999e-066e3087318b tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] 10.222.0.23 "GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd" status: 200 len: 1408 microversion: 2.54 time: 0.101674 Sep 10 12:10:22.034264 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2917/5827] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:21 2022] GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd => generated 1408 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:22.593506 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3d7bd878-1420-4d14-b130-06e161ffd459 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:22.594144 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3d7bd878-1420-4d14-b130-06e161ffd459 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] [instance: bce7d28b-43a8-4308-80f9-b1413ff622bc] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:22.600831 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d7bd878-1420-4d14-b130-06e161ffd459 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:22.601320 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d7bd878-1420-4d14-b130-06e161ffd459 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:22.601758 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d7bd878-1420-4d14-b130-06e161ffd459 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:22.602451 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d7bd878-1420-4d14-b130-06e161ffd459 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:22.602910 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d7bd878-1420-4d14-b130-06e161ffd459 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:22.603378 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d7bd878-1420-4d14-b130-06e161ffd459 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:22.631800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:10:22.635743 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d7bd878-1420-4d14-b130-06e161ffd459 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:22.636225 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d7bd878-1420-4d14-b130-06e161ffd459 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:22.636661 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d7bd878-1420-4d14-b130-06e161ffd459 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:22.637109 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-3d7bd878-1420-4d14-b130-06e161ffd459 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lazy-loading 'fault' on Instance uuid bce7d28b-43a8-4308-80f9-b1413ff622bc {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:10:22.681465 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3d7bd878-1420-4d14-b130-06e161ffd459 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ed72c3edf944c6bd5a60de122fe9b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4238c6353bb84f41b1dee58fd8395e41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:22.689208 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3d7bd878-1420-4d14-b130-06e161ffd459 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] 10.222.0.23 "GET /compute/v2.1/servers/bce7d28b-43a8-4308-80f9-b1413ff622bc" status: 200 len: 1303 microversion: 2.1 time: 0.099573 Sep 10 12:10:22.689777 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2911/5828] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:10:22 2022] GET /compute/v2.1/servers/bce7d28b-43a8-4308-80f9-b1413ff622bc => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:10:22.866224 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-674027ff-15e5-4514-b926-9e0b38371e8a tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:22.866797 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-674027ff-15e5-4514-b926-9e0b38371e8a tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] [instance: b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:22.873547 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-674027ff-15e5-4514-b926-9e0b38371e8a tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:22.874025 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-674027ff-15e5-4514-b926-9e0b38371e8a tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:22.874458 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-674027ff-15e5-4514-b926-9e0b38371e8a tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:22.875142 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-674027ff-15e5-4514-b926-9e0b38371e8a tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:22.875615 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-674027ff-15e5-4514-b926-9e0b38371e8a tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:22.876039 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-674027ff-15e5-4514-b926-9e0b38371e8a tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:23.009632 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-674027ff-15e5-4514-b926-9e0b38371e8a tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f17689334f524764820a7d4cd944641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e93992bf3f458ba21e305e747f0075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:23.018013 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-674027ff-15e5-4514-b926-9e0b38371e8a tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] 10.222.0.23 "GET /compute/v2.1/servers/b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3" status: 200 len: 1468 microversion: 2.1 time: 0.155844 Sep 10 12:10:23.018580 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2918/5829] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:10:22 2022] GET /compute/v2.1/servers/b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3 => generated 1468 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:10:23.057865 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0376687f-755c-488f-b28a-2bd4d2eda27a tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:23.058482 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0376687f-755c-488f-b28a-2bd4d2eda27a tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] [instance: a0aad895-68c0-4e8f-b3dd-9d78074bbcbd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:23.065618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0376687f-755c-488f-b28a-2bd4d2eda27a tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:23.066101 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0376687f-755c-488f-b28a-2bd4d2eda27a tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:23.066533 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0376687f-755c-488f-b28a-2bd4d2eda27a tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:23.067242 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0376687f-755c-488f-b28a-2bd4d2eda27a tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:23.067702 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0376687f-755c-488f-b28a-2bd4d2eda27a tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:23.068126 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0376687f-755c-488f-b28a-2bd4d2eda27a tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:23.137043 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0376687f-755c-488f-b28a-2bd4d2eda27a tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:23.146200 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0376687f-755c-488f-b28a-2bd4d2eda27a tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:23.147707 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0376687f-755c-488f-b28a-2bd4d2eda27a tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:23.148887 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0376687f-755c-488f-b28a-2bd4d2eda27a tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] 10.222.0.23 "GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd" status: 200 len: 1408 microversion: 2.54 time: 0.094906 Sep 10 12:10:23.149451 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2912/5830] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:23 2022] GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd => generated 1408 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:23.712303 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-08537e84-6333-4cc3-ba0f-03a863160829 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:23.712836 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-08537e84-6333-4cc3-ba0f-03a863160829 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] [instance: bce7d28b-43a8-4308-80f9-b1413ff622bc] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:23.718916 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-08537e84-6333-4cc3-ba0f-03a863160829 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:23.719493 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-08537e84-6333-4cc3-ba0f-03a863160829 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:23.719975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-08537e84-6333-4cc3-ba0f-03a863160829 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:23.720694 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-08537e84-6333-4cc3-ba0f-03a863160829 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:23.721150 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-08537e84-6333-4cc3-ba0f-03a863160829 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:23.721583 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-08537e84-6333-4cc3-ba0f-03a863160829 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:23.735040 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-08537e84-6333-4cc3-ba0f-03a863160829 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] HTTP exception thrown: Instance bce7d28b-43a8-4308-80f9-b1413ff622bc could not be found. Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-08537e84-6333-4cc3-ba0f-03a863160829 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Request method failure captured: Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/bce7d28b-43a8-4308-80f9-b1413ff622bc HTTP/1.1 Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH6XSvk9rvXkiSvgyaimU87323C484F44yo6MJk8rNv8rsivlPjy5aCd7bVUBFYUk9fLuR_auRcA3IRE7WLsTg_Icklk6sjk7kJXQhVlc6neM7b8mStqQRwGyOh8gM7X-MyoQwtcV9BQYggbMkKIL_vGd6xIuphrconJ_GTNrZ33yN0 Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 4238c6353bb84f41b1dee58fd8395e41 Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-VolumesActionsTest-2004901359 Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4238c6353bb84f41b1dee58fd8395e41"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4238c6353bb84f41b1dee58fd8395e41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4238c6353bb84f41b1dee58fd8395e41", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4238c6353bb84f41b1dee58fd8395e41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-VolumesActionsTest-2004901359 Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 4238c6353bb84f41b1dee58fd8395e41 Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-VolumesActionsTest-2004901359 Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-VolumesActionsTest-2004901359-project Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 20ed72c3edf944c6bd5a60de122fe9b0 Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-VolumesActionsTest-2004901359-project Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance bce7d28b-43a8-4308-80f9-b1413ff622bc could not be found. Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'bce7d28b-43a8-4308-80f9-b1413ff622bc'} Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bce7d28b-43a8-4308-80f9-b1413ff622bc could not be found. Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bce7d28b-43a8-4308-80f9-b1413ff622bc could not be found. Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:10:23.737326 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:10:23.742587 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:10:23.742587 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:10:23.742587 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:10:23.742587 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:10:23.742587 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:10:23.742587 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bce7d28b-43a8-4308-80f9-b1413ff622bc could not be found. Sep 10 12:10:23.742587 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:10:23.742587 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-08537e84-6333-4cc3-ba0f-03a863160829 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] Returning 404 to user: Instance bce7d28b-43a8-4308-80f9-b1413ff622bc could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:10:23.742587 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-08537e84-6333-4cc3-ba0f-03a863160829 tempest-VolumesActionsTest-2004901359 tempest-VolumesActionsTest-2004901359-project] 10.222.0.23 "GET /compute/v2.1/servers/bce7d28b-43a8-4308-80f9-b1413ff622bc" status: 404 len: 111 microversion: 2.1 time: 0.030526 Sep 10 12:10:23.742587 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2919/5831] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:10:23 2022] GET /compute/v2.1/servers/bce7d28b-43a8-4308-80f9-b1413ff622bc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:10:24.042571 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5e88a594-c34c-478c-96d9-2649d603a932 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:24.043475 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5e88a594-c34c-478c-96d9-2649d603a932 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] [instance: b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:24.050684 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5e88a594-c34c-478c-96d9-2649d603a932 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:24.051288 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5e88a594-c34c-478c-96d9-2649d603a932 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:24.051807 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5e88a594-c34c-478c-96d9-2649d603a932 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:24.052630 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5e88a594-c34c-478c-96d9-2649d603a932 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:24.053158 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5e88a594-c34c-478c-96d9-2649d603a932 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:24.053666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5e88a594-c34c-478c-96d9-2649d603a932 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:24.175529 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-06073593-b762-4a71-8222-36e4976d0a3d tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:24.176190 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-06073593-b762-4a71-8222-36e4976d0a3d tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] [instance: a0aad895-68c0-4e8f-b3dd-9d78074bbcbd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:24.183576 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-06073593-b762-4a71-8222-36e4976d0a3d tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:24.184075 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-06073593-b762-4a71-8222-36e4976d0a3d tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:24.184521 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-06073593-b762-4a71-8222-36e4976d0a3d tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:24.185233 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-06073593-b762-4a71-8222-36e4976d0a3d tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:24.185696 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-06073593-b762-4a71-8222-36e4976d0a3d tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:24.186131 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-06073593-b762-4a71-8222-36e4976d0a3d tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:24.212525 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:10:24.303559 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-06073593-b762-4a71-8222-36e4976d0a3d tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:24.312717 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-06073593-b762-4a71-8222-36e4976d0a3d tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:24.314854 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-06073593-b762-4a71-8222-36e4976d0a3d tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:24.316275 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-06073593-b762-4a71-8222-36e4976d0a3d tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] 10.222.0.23 "GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd" status: 200 len: 1408 microversion: 2.54 time: 0.145167 Sep 10 12:10:24.331970 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2920/5832] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:24 2022] GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 12:10:24.336848 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5e88a594-c34c-478c-96d9-2649d603a932 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f17689334f524764820a7d4cd944641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e93992bf3f458ba21e305e747f0075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:24.346169 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5e88a594-c34c-478c-96d9-2649d603a932 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] 10.222.0.23 "GET /compute/v2.1/servers/b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3" status: 200 len: 1468 microversion: 2.1 time: 0.307278 Sep 10 12:10:24.346770 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2913/5833] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:10:24 2022] GET /compute/v2.1/servers/b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3 => generated 1468 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:10:24.915470 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-bb791423-9bac-47de-802b-7b5bc88c9221 req-9d9d148e-6f24-498e-a0aa-e9396f7b028c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3", "name": "network-vif-deleted", "tag": "a2124c2d-7d6d-485a-97aa-f251c7ea097d"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:10:24.926546 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-bb791423-9bac-47de-802b-7b5bc88c9221 req-9d9d148e-6f24-498e-a0aa-e9396f7b028c service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:24.927029 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-bb791423-9bac-47de-802b-7b5bc88c9221 req-9d9d148e-6f24-498e-a0aa-e9396f7b028c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:24.927489 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-bb791423-9bac-47de-802b-7b5bc88c9221 req-9d9d148e-6f24-498e-a0aa-e9396f7b028c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:24.939811 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-bb791423-9bac-47de-802b-7b5bc88c9221 req-9d9d148e-6f24-498e-a0aa-e9396f7b028c service nova] Creating event network-vif-deleted:a2124c2d-7d6d-485a-97aa-f251c7ea097d for instance b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3 on n-h1-856895-1 Sep 10 12:10:24.947114 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-bb791423-9bac-47de-802b-7b5bc88c9221 req-9d9d148e-6f24-498e-a0aa-e9396f7b028c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036103 Sep 10 12:10:24.947765 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2921/5834] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:10:25.343704 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4c406173-dc25-4058-94d0-7a891d540de3 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:25.344675 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4c406173-dc25-4058-94d0-7a891d540de3 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] [instance: a0aad895-68c0-4e8f-b3dd-9d78074bbcbd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:25.352875 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4c406173-dc25-4058-94d0-7a891d540de3 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:25.353276 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4c406173-dc25-4058-94d0-7a891d540de3 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:25.353905 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4c406173-dc25-4058-94d0-7a891d540de3 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:25.355029 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4c406173-dc25-4058-94d0-7a891d540de3 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:25.355506 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4c406173-dc25-4058-94d0-7a891d540de3 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:25.356258 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4c406173-dc25-4058-94d0-7a891d540de3 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:25.370558 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dc691a10-4ca4-4e6d-98ae-7891176e88eb tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:25.371458 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-dc691a10-4ca4-4e6d-98ae-7891176e88eb tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] [instance: b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:25.380064 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dc691a10-4ca4-4e6d-98ae-7891176e88eb tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:25.380557 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dc691a10-4ca4-4e6d-98ae-7891176e88eb tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:25.381157 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dc691a10-4ca4-4e6d-98ae-7891176e88eb tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:25.381874 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dc691a10-4ca4-4e6d-98ae-7891176e88eb tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:25.382330 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dc691a10-4ca4-4e6d-98ae-7891176e88eb tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:25.382755 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dc691a10-4ca4-4e6d-98ae-7891176e88eb tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:25.389990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:10:25.421912 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dc691a10-4ca4-4e6d-98ae-7891176e88eb tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:25.422668 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dc691a10-4ca4-4e6d-98ae-7891176e88eb tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:25.423576 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dc691a10-4ca4-4e6d-98ae-7891176e88eb tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:25.424605 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-dc691a10-4ca4-4e6d-98ae-7891176e88eb tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lazy-loading 'fault' on Instance uuid b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:10:25.448036 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4c406173-dc25-4058-94d0-7a891d540de3 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:25.458100 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4c406173-dc25-4058-94d0-7a891d540de3 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:25.459595 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4c406173-dc25-4058-94d0-7a891d540de3 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:25.461099 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4c406173-dc25-4058-94d0-7a891d540de3 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] 10.222.0.23 "GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd" status: 200 len: 1408 microversion: 2.54 time: 0.121304 Sep 10 12:10:25.461992 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2914/5835] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:25 2022] GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd => generated 1408 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:25.480492 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-dc691a10-4ca4-4e6d-98ae-7891176e88eb tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f17689334f524764820a7d4cd944641b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e93992bf3f458ba21e305e747f0075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:25.490738 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-dc691a10-4ca4-4e6d-98ae-7891176e88eb tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] 10.222.0.23 "GET /compute/v2.1/servers/b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3" status: 200 len: 1304 microversion: 2.1 time: 0.124437 Sep 10 12:10:25.491355 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2922/5836] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:10:25 2022] GET /compute/v2.1/servers/b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3 => generated 1304 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:10:26.488148 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-79d79915-0a37-47a3-8866-6a8e2713ffba tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:26.488749 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-79d79915-0a37-47a3-8866-6a8e2713ffba tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] [instance: a0aad895-68c0-4e8f-b3dd-9d78074bbcbd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:26.496056 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-79d79915-0a37-47a3-8866-6a8e2713ffba tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:26.496545 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-79d79915-0a37-47a3-8866-6a8e2713ffba tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:26.496976 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-79d79915-0a37-47a3-8866-6a8e2713ffba tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:26.497673 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-79d79915-0a37-47a3-8866-6a8e2713ffba tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:26.498129 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-79d79915-0a37-47a3-8866-6a8e2713ffba tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:26.498552 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-79d79915-0a37-47a3-8866-6a8e2713ffba tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:26.514093 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-de3f0642-f0bb-4e9f-be6d-545ada3fdab3 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:26.514680 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-de3f0642-f0bb-4e9f-be6d-545ada3fdab3 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] [instance: b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:26.523486 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de3f0642-f0bb-4e9f-be6d-545ada3fdab3 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:26.523996 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de3f0642-f0bb-4e9f-be6d-545ada3fdab3 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:26.524428 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de3f0642-f0bb-4e9f-be6d-545ada3fdab3 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:26.525139 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de3f0642-f0bb-4e9f-be6d-545ada3fdab3 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:26.525596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de3f0642-f0bb-4e9f-be6d-545ada3fdab3 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:26.526641 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de3f0642-f0bb-4e9f-be6d-545ada3fdab3 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:26.540937 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-de3f0642-f0bb-4e9f-be6d-545ada3fdab3 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] HTTP exception thrown: Instance b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3 could not be found. Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-de3f0642-f0bb-4e9f-be6d-545ada3fdab3 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Request method failure captured: Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3 HTTP/1.1 Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH42L7PPCOKgpBGN4sg2hrSsJ_J4H79Bs8sTCJ7X1pjZ9wU1mH77SOPF-SHsuUuoXFWmhHusaiZCqyaN0RpfAT3LstWehU9QA2gLiv4YjYuHps9Hs2ODBSqVi6Zhh41pgAt3Bv3r6jLN8Z-4lZ3gQ-Yf0zv4WzgzEg2TTXnerDL24lk Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: e5e93992bf3f458ba21e305e747f0075 Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-VolumesBackupsTest-550962268 Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5e93992bf3f458ba21e305e747f0075"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5e93992bf3f458ba21e305e747f0075"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e5e93992bf3f458ba21e305e747f0075", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e5e93992bf3f458ba21e305e747f0075"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-VolumesBackupsTest-550962268 Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: e5e93992bf3f458ba21e305e747f0075 Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-VolumesBackupsTest-550962268 Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-VolumesBackupsTest-550962268-project Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: f17689334f524764820a7d4cd944641b Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-VolumesBackupsTest-550962268-project Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3 could not be found. Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3'} Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3 could not be found. Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3 could not be found. Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:10:26.542966 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:10:26.547727 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:10:26.547727 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:10:26.547727 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:10:26.547727 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:10:26.547727 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:10:26.547727 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3 could not be found. Sep 10 12:10:26.547727 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:10:26.549139 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-de3f0642-f0bb-4e9f-be6d-545ada3fdab3 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] Returning 404 to user: Instance b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:10:26.550043 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-de3f0642-f0bb-4e9f-be6d-545ada3fdab3 tempest-VolumesBackupsTest-550962268 tempest-VolumesBackupsTest-550962268-project] 10.222.0.23 "GET /compute/v2.1/servers/b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3" status: 404 len: 111 microversion: 2.1 time: 0.040026 Sep 10 12:10:26.550802 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2923/5837] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:10:26 2022] GET /compute/v2.1/servers/b5d5d96a-b3fe-4ce8-a100-8c4664c2c9c3 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 12:10:26.574423 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-79d79915-0a37-47a3-8866-6a8e2713ffba tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:26.583692 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-79d79915-0a37-47a3-8866-6a8e2713ffba tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:26.585212 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-79d79915-0a37-47a3-8866-6a8e2713ffba tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:26.586445 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-79d79915-0a37-47a3-8866-6a8e2713ffba tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] 10.222.0.23 "GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd" status: 200 len: 1408 microversion: 2.54 time: 0.102331 Sep 10 12:10:26.587071 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2915/5838] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:26 2022] GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd => generated 1408 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:27.613192 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-67e77573-17aa-4f17-94de-0a4d6c0490c6 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:27.613844 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-67e77573-17aa-4f17-94de-0a4d6c0490c6 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] [instance: a0aad895-68c0-4e8f-b3dd-9d78074bbcbd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:27.622484 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67e77573-17aa-4f17-94de-0a4d6c0490c6 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:27.623409 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67e77573-17aa-4f17-94de-0a4d6c0490c6 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:27.639354 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67e77573-17aa-4f17-94de-0a4d6c0490c6 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:27.644985 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67e77573-17aa-4f17-94de-0a4d6c0490c6 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:27.646023 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67e77573-17aa-4f17-94de-0a4d6c0490c6 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:27.647389 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67e77573-17aa-4f17-94de-0a4d6c0490c6 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:27.774224 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-67e77573-17aa-4f17-94de-0a4d6c0490c6 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:27.784155 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-67e77573-17aa-4f17-94de-0a4d6c0490c6 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:27.785811 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-67e77573-17aa-4f17-94de-0a4d6c0490c6 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:27.787099 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-67e77573-17aa-4f17-94de-0a4d6c0490c6 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] 10.222.0.23 "GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd" status: 200 len: 1408 microversion: 2.54 time: 0.177999 Sep 10 12:10:27.795220 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2924/5839] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:27 2022] GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd => generated 1408 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:28.813985 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-08f922e0-0333-422c-94db-3c2cd5a206c1 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:28.814727 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-08f922e0-0333-422c-94db-3c2cd5a206c1 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] [instance: a0aad895-68c0-4e8f-b3dd-9d78074bbcbd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:28.822464 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-08f922e0-0333-422c-94db-3c2cd5a206c1 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:28.823038 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-08f922e0-0333-422c-94db-3c2cd5a206c1 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:28.823586 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-08f922e0-0333-422c-94db-3c2cd5a206c1 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:28.824359 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-08f922e0-0333-422c-94db-3c2cd5a206c1 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:28.824831 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-08f922e0-0333-422c-94db-3c2cd5a206c1 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:28.825529 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-08f922e0-0333-422c-94db-3c2cd5a206c1 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:28.895325 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-08f922e0-0333-422c-94db-3c2cd5a206c1 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:28.903931 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-08f922e0-0333-422c-94db-3c2cd5a206c1 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:28.905389 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-08f922e0-0333-422c-94db-3c2cd5a206c1 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:28.906614 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-08f922e0-0333-422c-94db-3c2cd5a206c1 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] 10.222.0.23 "GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd" status: 200 len: 1408 microversion: 2.54 time: 0.096624 Sep 10 12:10:28.919488 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2916/5840] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:28 2022] GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd => generated 1408 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 12:10:29.933455 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5df62143-8aa4-48ce-8c84-1693c7813e77 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:29.935328 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5df62143-8aa4-48ce-8c84-1693c7813e77 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] [instance: a0aad895-68c0-4e8f-b3dd-9d78074bbcbd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:29.943381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:10:29.944873 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5df62143-8aa4-48ce-8c84-1693c7813e77 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:29.945420 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5df62143-8aa4-48ce-8c84-1693c7813e77 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:29.945859 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5df62143-8aa4-48ce-8c84-1693c7813e77 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:29.946796 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5df62143-8aa4-48ce-8c84-1693c7813e77 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:29.947269 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5df62143-8aa4-48ce-8c84-1693c7813e77 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:29.947857 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5df62143-8aa4-48ce-8c84-1693c7813e77 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:30.052044 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5df62143-8aa4-48ce-8c84-1693c7813e77 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:30.064523 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5df62143-8aa4-48ce-8c84-1693c7813e77 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:30.067638 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5df62143-8aa4-48ce-8c84-1693c7813e77 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:30.069217 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5df62143-8aa4-48ce-8c84-1693c7813e77 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] 10.222.0.23 "GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd" status: 200 len: 1408 microversion: 2.54 time: 0.140195 Sep 10 12:10:30.070366 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2925/5841] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:29 2022] GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd => generated 1408 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:31.100626 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3e5738ae-a307-4cbb-9e9d-7b2fd13e43fd tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:31.101257 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3e5738ae-a307-4cbb-9e9d-7b2fd13e43fd tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] [instance: a0aad895-68c0-4e8f-b3dd-9d78074bbcbd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:31.109326 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e5738ae-a307-4cbb-9e9d-7b2fd13e43fd tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:31.110097 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e5738ae-a307-4cbb-9e9d-7b2fd13e43fd tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:31.110589 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e5738ae-a307-4cbb-9e9d-7b2fd13e43fd tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:31.111351 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e5738ae-a307-4cbb-9e9d-7b2fd13e43fd tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:31.112361 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e5738ae-a307-4cbb-9e9d-7b2fd13e43fd tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:31.113037 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3e5738ae-a307-4cbb-9e9d-7b2fd13e43fd tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:31.194496 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3e5738ae-a307-4cbb-9e9d-7b2fd13e43fd tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:31.206283 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3e5738ae-a307-4cbb-9e9d-7b2fd13e43fd tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:31.207797 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3e5738ae-a307-4cbb-9e9d-7b2fd13e43fd tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:31.209310 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3e5738ae-a307-4cbb-9e9d-7b2fd13e43fd tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] 10.222.0.23 "GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd" status: 200 len: 1414 microversion: 2.54 time: 0.113303 Sep 10 12:10:31.215218 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2917/5842] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:31 2022] GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd => generated 1414 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:32.237950 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dde5d398-73cb-4cfc-8c12-8714be95d5e8 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:32.238562 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-dde5d398-73cb-4cfc-8c12-8714be95d5e8 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] [instance: a0aad895-68c0-4e8f-b3dd-9d78074bbcbd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:32.254395 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dde5d398-73cb-4cfc-8c12-8714be95d5e8 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:32.255007 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dde5d398-73cb-4cfc-8c12-8714be95d5e8 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:32.255704 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dde5d398-73cb-4cfc-8c12-8714be95d5e8 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:32.256510 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dde5d398-73cb-4cfc-8c12-8714be95d5e8 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:32.257058 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dde5d398-73cb-4cfc-8c12-8714be95d5e8 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:32.257596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dde5d398-73cb-4cfc-8c12-8714be95d5e8 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:32.397332 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-dde5d398-73cb-4cfc-8c12-8714be95d5e8 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:32.410827 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-dde5d398-73cb-4cfc-8c12-8714be95d5e8 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:32.412596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-dde5d398-73cb-4cfc-8c12-8714be95d5e8 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:32.417543 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-dde5d398-73cb-4cfc-8c12-8714be95d5e8 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] 10.222.0.23 "GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd" status: 200 len: 1414 microversion: 2.54 time: 0.182450 Sep 10 12:10:32.418399 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2926/5843] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:32 2022] GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd => generated 1414 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:33.446310 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d2efff78-5cba-40f4-85da-24f0a3661069 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:33.446940 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d2efff78-5cba-40f4-85da-24f0a3661069 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] [instance: a0aad895-68c0-4e8f-b3dd-9d78074bbcbd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:33.454965 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d2efff78-5cba-40f4-85da-24f0a3661069 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:33.455622 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d2efff78-5cba-40f4-85da-24f0a3661069 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:33.456021 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d2efff78-5cba-40f4-85da-24f0a3661069 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:33.456731 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d2efff78-5cba-40f4-85da-24f0a3661069 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:33.457186 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d2efff78-5cba-40f4-85da-24f0a3661069 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:33.457613 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d2efff78-5cba-40f4-85da-24f0a3661069 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:33.528047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d2efff78-5cba-40f4-85da-24f0a3661069 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:33.537912 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d2efff78-5cba-40f4-85da-24f0a3661069 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:33.539387 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d2efff78-5cba-40f4-85da-24f0a3661069 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:33.540558 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d2efff78-5cba-40f4-85da-24f0a3661069 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] 10.222.0.23 "GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd" status: 200 len: 1399 microversion: 2.54 time: 0.098952 Sep 10 12:10:33.541113 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2918/5844] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:33 2022] GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd => generated 1399 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:33.566471 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f69003d2-a0b9-4a90-9a31-ef4913441ab5 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Calling method '.version_select at 0x7f4073665670>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:33.596299 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f69003d2-a0b9-4a90-9a31-ef4913441ab5 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1527595779" status: 204 len: 0 microversion: 2.54 time: 0.034685 Sep 10 12:10:33.601412 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2927/5845] 10.222.0.23 () {60 vars in 1319 bytes} [Sat Sep 10 12:10:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1527595779 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 10 12:10:33.613359 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9849006f-f5ad-431b-ae78-801c1f590b45 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:33.614065 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9849006f-f5ad-431b-ae78-801c1f590b45 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] [instance: a0aad895-68c0-4e8f-b3dd-9d78074bbcbd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:33.621519 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9849006f-f5ad-431b-ae78-801c1f590b45 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:33.623017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9849006f-f5ad-431b-ae78-801c1f590b45 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:33.623972 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9849006f-f5ad-431b-ae78-801c1f590b45 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:33.625111 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9849006f-f5ad-431b-ae78-801c1f590b45 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:33.625727 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9849006f-f5ad-431b-ae78-801c1f590b45 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:33.626478 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9849006f-f5ad-431b-ae78-801c1f590b45 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:33.660926 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9849006f-f5ad-431b-ae78-801c1f590b45 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] [instance: a0aad895-68c0-4e8f-b3dd-9d78074bbcbd] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:10:33.753722 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9849006f-f5ad-431b-ae78-801c1f590b45 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd" status: 204 len: 0 microversion: 2.54 time: 0.147239 Sep 10 12:10:33.754235 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2919/5846] 10.222.0.23 () {60 vars in 1280 bytes} [Sat Sep 10 12:10:33 2022] DELETE /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 12:10:33.762517 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c763ee64-78ee-4177-9f72-332a9da1cda5 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:33.763186 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c763ee64-78ee-4177-9f72-332a9da1cda5 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] [instance: a0aad895-68c0-4e8f-b3dd-9d78074bbcbd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:33.780587 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c763ee64-78ee-4177-9f72-332a9da1cda5 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:33.785899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c763ee64-78ee-4177-9f72-332a9da1cda5 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:33.786698 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c763ee64-78ee-4177-9f72-332a9da1cda5 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:33.787663 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c763ee64-78ee-4177-9f72-332a9da1cda5 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:33.788353 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c763ee64-78ee-4177-9f72-332a9da1cda5 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:33.788772 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c763ee64-78ee-4177-9f72-332a9da1cda5 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:33.891631 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c763ee64-78ee-4177-9f72-332a9da1cda5 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:33.903194 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c763ee64-78ee-4177-9f72-332a9da1cda5 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:33.906194 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c763ee64-78ee-4177-9f72-332a9da1cda5 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:33.909074 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c763ee64-78ee-4177-9f72-332a9da1cda5 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] 10.222.0.23 "GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd" status: 200 len: 1405 microversion: 2.54 time: 0.150663 Sep 10 12:10:33.910436 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2928/5847] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:33 2022] GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd => generated 1405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 12:10:34.936363 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d26eb87b-53ca-4012-8718-77fae8ab1e6b tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:34.937660 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d26eb87b-53ca-4012-8718-77fae8ab1e6b tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] [instance: a0aad895-68c0-4e8f-b3dd-9d78074bbcbd] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:34.944760 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d26eb87b-53ca-4012-8718-77fae8ab1e6b tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:34.945485 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d26eb87b-53ca-4012-8718-77fae8ab1e6b tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:34.946084 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d26eb87b-53ca-4012-8718-77fae8ab1e6b tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:34.946949 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d26eb87b-53ca-4012-8718-77fae8ab1e6b tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:34.947600 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d26eb87b-53ca-4012-8718-77fae8ab1e6b tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:34.948198 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d26eb87b-53ca-4012-8718-77fae8ab1e6b tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:35.028397 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d26eb87b-53ca-4012-8718-77fae8ab1e6b tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:35.038570 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d26eb87b-53ca-4012-8718-77fae8ab1e6b tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:35.040268 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d26eb87b-53ca-4012-8718-77fae8ab1e6b tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6aaa314a0a84cd88c8ac368fd6b92ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f448f327401481993607f9c08a50aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:35.041766 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d26eb87b-53ca-4012-8718-77fae8ab1e6b tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] 10.222.0.23 "GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd" status: 200 len: 1405 microversion: 2.54 time: 0.110404 Sep 10 12:10:35.042845 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2920/5848] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:34 2022] GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd => generated 1405 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:36.069217 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ee2dafb6-a9ba-47e3-8308-a8362cecf665 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:36.069775 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ee2dafb6-a9ba-47e3-8308-a8362cecf665 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] [instance: a0aad895-68c0-4e8f-b3dd-9d78074bbcbd] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:36.080678 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ee2dafb6-a9ba-47e3-8308-a8362cecf665 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:36.081175 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ee2dafb6-a9ba-47e3-8308-a8362cecf665 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:36.081952 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ee2dafb6-a9ba-47e3-8308-a8362cecf665 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:36.082992 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ee2dafb6-a9ba-47e3-8308-a8362cecf665 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:36.083770 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ee2dafb6-a9ba-47e3-8308-a8362cecf665 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:36.084364 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ee2dafb6-a9ba-47e3-8308-a8362cecf665 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:36.106487 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-ee2dafb6-a9ba-47e3-8308-a8362cecf665 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] HTTP exception thrown: Instance a0aad895-68c0-4e8f-b3dd-9d78074bbcbd could not be found. Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ee2dafb6-a9ba-47e3-8308-a8362cecf665 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Request method failure captured: Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd HTTP/1.1 Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH6VGds7mjWvM0TtSMmVhTn8JvIfwc3Um1n6rrb0zhsX30FIkHsJdDU6tw8D0ag4KWC5Ivb_zWL4XR3lh5Io8840QNKDwhZMV531YVcwkGHJPIe8DkPAoPvMNP8cBrcs32E5hcLNxl6RJ137ciU9yyjtSu77xG0q2ZoufQXm1YIgFCg Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: X-Openstack-Nova-Api-Version: 2.54 Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 8f448f327401481993607f9c08a50aac Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServerShowV254Test-257768186 Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8f448f327401481993607f9c08a50aac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/8f448f327401481993607f9c08a50aac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_8f448f327401481993607f9c08a50aac", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/8f448f327401481993607f9c08a50aac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServerShowV254Test-257768186 Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 8f448f327401481993607f9c08a50aac Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServerShowV254Test-257768186 Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServerShowV254Test-257768186-project Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: a6aaa314a0a84cd88c8ac368fd6b92ee Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServerShowV254Test-257768186-project Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance a0aad895-68c0-4e8f-b3dd-9d78074bbcbd could not be found. Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'a0aad895-68c0-4e8f-b3dd-9d78074bbcbd'} Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0aad895-68c0-4e8f-b3dd-9d78074bbcbd could not be found. Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0aad895-68c0-4e8f-b3dd-9d78074bbcbd could not be found. Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:10:36.109395 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:10:36.115902 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:10:36.115902 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:10:36.115902 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:10:36.115902 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:10:36.115902 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:10:36.115902 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0aad895-68c0-4e8f-b3dd-9d78074bbcbd could not be found. Sep 10 12:10:36.115902 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:10:36.115902 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ee2dafb6-a9ba-47e3-8308-a8362cecf665 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] Returning 404 to user: Instance a0aad895-68c0-4e8f-b3dd-9d78074bbcbd could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:10:36.122516 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ee2dafb6-a9ba-47e3-8308-a8362cecf665 tempest-ServerShowV254Test-257768186 tempest-ServerShowV254Test-257768186-project] 10.222.0.23 "GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd" status: 404 len: 111 microversion: 2.54 time: 0.057304 Sep 10 12:10:36.135579 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2929/5849] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:36 2022] GET /compute/v2.1/servers/a0aad895-68c0-4e8f-b3dd-9d78074bbcbd => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 12:10:37.857141 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-729a6cc2-8cb8-404a-b2cf-7655c5be5e9b tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1219900431", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": "none"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:10:37.925095 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-729a6cc2-8cb8-404a-b2cf-7655c5be5e9b tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:10:37.925530 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-729a6cc2-8cb8-404a-b2cf-7655c5be5e9b tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:10:37.926013 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-729a6cc2-8cb8-404a-b2cf-7655c5be5e9b tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:10:37.926428 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-729a6cc2-8cb8-404a-b2cf-7655c5be5e9b tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:10:37.926845 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-729a6cc2-8cb8-404a-b2cf-7655c5be5e9b tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:10:37.936335 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-729a6cc2-8cb8-404a-b2cf-7655c5be5e9b tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:37.937070 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-729a6cc2-8cb8-404a-b2cf-7655c5be5e9b tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:37.937509 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-729a6cc2-8cb8-404a-b2cf-7655c5be5e9b tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:37.938403 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-729a6cc2-8cb8-404a-b2cf-7655c5be5e9b tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:37.938902 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-729a6cc2-8cb8-404a-b2cf-7655c5be5e9b tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:37.939453 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-729a6cc2-8cb8-404a-b2cf-7655c5be5e9b tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:37.958098 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-729a6cc2-8cb8-404a-b2cf-7655c5be5e9b tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Getting quotas for project 967b5cd68ebb40d7a3f2176aad2c29f5. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:10:37.963482 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-729a6cc2-8cb8-404a-b2cf-7655c5be5e9b tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Getting quotas for user 64e5e037bd644c44859b1c248d11834a and project 967b5cd68ebb40d7a3f2176aad2c29f5. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:10:37.978565 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-729a6cc2-8cb8-404a-b2cf-7655c5be5e9b tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:10:37.980924 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-729a6cc2-8cb8-404a-b2cf-7655c5be5e9b tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] [instance: 51e04298-77b1-413e-8fbd-f31ac2e7d35e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:10:38.030892 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-729a6cc2-8cb8-404a-b2cf-7655c5be5e9b tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.332007 Sep 10 12:10:38.032359 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2921/5850] 10.222.0.23 () {62 vars in 1188 bytes} [Sat Sep 10 12:10:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 334 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 10 12:10:38.049172 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f5b14054-491d-4d98-8f43-864611211b17 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:38.049812 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f5b14054-491d-4d98-8f43-864611211b17 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] [instance: 51e04298-77b1-413e-8fbd-f31ac2e7d35e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:38.152990 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f5b14054-491d-4d98-8f43-864611211b17 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:38.165064 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f5b14054-491d-4d98-8f43-864611211b17 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:38.167081 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f5b14054-491d-4d98-8f43-864611211b17 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:38.169192 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f5b14054-491d-4d98-8f43-864611211b17 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] 10.222.0.23 "GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e" status: 200 len: 1278 microversion: 2.57 time: 0.129362 Sep 10 12:10:38.183198 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2930/5851] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:38 2022] GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e => generated 1278 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:39.200656 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-25715246-6737-4e0a-8cd9-f18b42cea853 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:39.201174 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-25715246-6737-4e0a-8cd9-f18b42cea853 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] [instance: 51e04298-77b1-413e-8fbd-f31ac2e7d35e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:39.222768 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25715246-6737-4e0a-8cd9-f18b42cea853 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:39.223282 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25715246-6737-4e0a-8cd9-f18b42cea853 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:39.223910 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25715246-6737-4e0a-8cd9-f18b42cea853 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:39.224776 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25715246-6737-4e0a-8cd9-f18b42cea853 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:39.225390 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25715246-6737-4e0a-8cd9-f18b42cea853 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:39.225982 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25715246-6737-4e0a-8cd9-f18b42cea853 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:39.306428 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-25715246-6737-4e0a-8cd9-f18b42cea853 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:39.317631 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-25715246-6737-4e0a-8cd9-f18b42cea853 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:39.320284 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-25715246-6737-4e0a-8cd9-f18b42cea853 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:39.322029 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-25715246-6737-4e0a-8cd9-f18b42cea853 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] 10.222.0.23 "GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e" status: 200 len: 1330 microversion: 2.57 time: 0.126377 Sep 10 12:10:39.323195 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2922/5852] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:39 2022] GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e => generated 1330 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:40.348997 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c981a87f-4520-4830-86be-87745f63b5dd tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:40.349890 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c981a87f-4520-4830-86be-87745f63b5dd tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] [instance: 51e04298-77b1-413e-8fbd-f31ac2e7d35e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:40.368041 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c981a87f-4520-4830-86be-87745f63b5dd tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:40.368554 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c981a87f-4520-4830-86be-87745f63b5dd tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:40.369004 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c981a87f-4520-4830-86be-87745f63b5dd tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:40.369755 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c981a87f-4520-4830-86be-87745f63b5dd tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:40.370224 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c981a87f-4520-4830-86be-87745f63b5dd tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:40.370666 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c981a87f-4520-4830-86be-87745f63b5dd tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:40.442439 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c981a87f-4520-4830-86be-87745f63b5dd tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:40.452907 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c981a87f-4520-4830-86be-87745f63b5dd tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:40.457074 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c981a87f-4520-4830-86be-87745f63b5dd tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:40.458394 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c981a87f-4520-4830-86be-87745f63b5dd tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] 10.222.0.23 "GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e" status: 200 len: 1336 microversion: 2.57 time: 0.114525 Sep 10 12:10:40.459744 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2931/5853] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:40 2022] GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e => generated 1336 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:41.489235 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-67bb265a-22ac-4716-83d2-258a6a15eb46 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:41.496884 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-67bb265a-22ac-4716-83d2-258a6a15eb46 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] [instance: 51e04298-77b1-413e-8fbd-f31ac2e7d35e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:41.514420 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-67bb265a-22ac-4716-83d2-258a6a15eb46 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:41.515484 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-67bb265a-22ac-4716-83d2-258a6a15eb46 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:41.516206 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-67bb265a-22ac-4716-83d2-258a6a15eb46 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:41.517928 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-67bb265a-22ac-4716-83d2-258a6a15eb46 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:41.518887 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-67bb265a-22ac-4716-83d2-258a6a15eb46 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:41.519913 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-67bb265a-22ac-4716-83d2-258a6a15eb46 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:41.618509 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-67bb265a-22ac-4716-83d2-258a6a15eb46 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:41.631747 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-67bb265a-22ac-4716-83d2-258a6a15eb46 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:41.633813 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-67bb265a-22ac-4716-83d2-258a6a15eb46 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:41.635802 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-67bb265a-22ac-4716-83d2-258a6a15eb46 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] 10.222.0.23 "GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e" status: 200 len: 1357 microversion: 2.57 time: 0.151015 Sep 10 12:10:41.642861 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2923/5854] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:41 2022] GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:41.666872 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5ce9bbfd-13c1-482f-ae68-c577739b8493 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:10:41.670569 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5ce9bbfd-13c1-482f-ae68-c577739b8493 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] [instance: 51e04298-77b1-413e-8fbd-f31ac2e7d35e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:41.678755 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ce9bbfd-13c1-482f-ae68-c577739b8493 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:41.679260 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ce9bbfd-13c1-482f-ae68-c577739b8493 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:41.679900 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ce9bbfd-13c1-482f-ae68-c577739b8493 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:41.680608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ce9bbfd-13c1-482f-ae68-c577739b8493 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:41.681228 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ce9bbfd-13c1-482f-ae68-c577739b8493 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:41.681832 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ce9bbfd-13c1-482f-ae68-c577739b8493 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:41.783264 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-5ce9bbfd-13c1-482f-ae68-c577739b8493 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:10:41.783691 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-5ce9bbfd-13c1-482f-ae68-c577739b8493 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:10:41.784170 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-5ce9bbfd-13c1-482f-ae68-c577739b8493 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:10:41.784583 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-5ce9bbfd-13c1-482f-ae68-c577739b8493 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:10:41.785005 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-5ce9bbfd-13c1-482f-ae68-c577739b8493 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:10:41.868164 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5ce9bbfd-13c1-482f-ae68-c577739b8493 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] [instance: 51e04298-77b1-413e-8fbd-f31ac2e7d35e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:41.875147 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ce9bbfd-13c1-482f-ae68-c577739b8493 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:41.875852 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ce9bbfd-13c1-482f-ae68-c577739b8493 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:41.876305 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ce9bbfd-13c1-482f-ae68-c577739b8493 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:41.877201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ce9bbfd-13c1-482f-ae68-c577739b8493 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:41.878190 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ce9bbfd-13c1-482f-ae68-c577739b8493 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:41.879124 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ce9bbfd-13c1-482f-ae68-c577739b8493 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:41.930203 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5ce9bbfd-13c1-482f-ae68-c577739b8493 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] 10.222.0.23 "POST /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e/action" status: 202 len: 1138 microversion: 2.57 time: 0.267228 Sep 10 12:10:41.931496 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2932/5855] 10.222.0.23 () {62 vars in 1320 bytes} [Sat Sep 10 12:10:41 2022] POST /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e/action => generated 1138 bytes in 269 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 10 12:10:41.957585 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-00b75089-3ec7-40e8-9df3-d31dcc88d438 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:41.959002 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-00b75089-3ec7-40e8-9df3-d31dcc88d438 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] [instance: 51e04298-77b1-413e-8fbd-f31ac2e7d35e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:41.978032 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-00b75089-3ec7-40e8-9df3-d31dcc88d438 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:41.979949 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-00b75089-3ec7-40e8-9df3-d31dcc88d438 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:41.980634 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-00b75089-3ec7-40e8-9df3-d31dcc88d438 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:41.982712 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-00b75089-3ec7-40e8-9df3-d31dcc88d438 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:41.986569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-00b75089-3ec7-40e8-9df3-d31dcc88d438 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:41.988224 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-00b75089-3ec7-40e8-9df3-d31dcc88d438 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:42.097051 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-00b75089-3ec7-40e8-9df3-d31dcc88d438 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:42.108294 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-00b75089-3ec7-40e8-9df3-d31dcc88d438 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:42.111359 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-00b75089-3ec7-40e8-9df3-d31dcc88d438 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:42.112564 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-00b75089-3ec7-40e8-9df3-d31dcc88d438 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] 10.222.0.23 "GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e" status: 200 len: 1366 microversion: 2.57 time: 0.160980 Sep 10 12:10:42.113660 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2924/5856] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:41 2022] GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:43.148674 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8c20a62c-0c9a-46cf-b05b-f6da80800946 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:43.149850 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8c20a62c-0c9a-46cf-b05b-f6da80800946 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] [instance: 51e04298-77b1-413e-8fbd-f31ac2e7d35e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:43.157648 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8c20a62c-0c9a-46cf-b05b-f6da80800946 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:43.158137 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8c20a62c-0c9a-46cf-b05b-f6da80800946 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:43.158582 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8c20a62c-0c9a-46cf-b05b-f6da80800946 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:43.159319 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8c20a62c-0c9a-46cf-b05b-f6da80800946 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:43.159783 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8c20a62c-0c9a-46cf-b05b-f6da80800946 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:43.160217 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8c20a62c-0c9a-46cf-b05b-f6da80800946 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:43.280665 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8c20a62c-0c9a-46cf-b05b-f6da80800946 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:43.295339 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8c20a62c-0c9a-46cf-b05b-f6da80800946 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:43.296804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8c20a62c-0c9a-46cf-b05b-f6da80800946 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:43.299445 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8c20a62c-0c9a-46cf-b05b-f6da80800946 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] 10.222.0.23 "GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e" status: 200 len: 1366 microversion: 2.57 time: 0.155626 Sep 10 12:10:43.300180 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2933/5857] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:43 2022] GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:44.331197 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bec0ed6b-f7ae-4910-9a78-1a714f1496b2 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:44.332104 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bec0ed6b-f7ae-4910-9a78-1a714f1496b2 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] [instance: 51e04298-77b1-413e-8fbd-f31ac2e7d35e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:44.344029 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bec0ed6b-f7ae-4910-9a78-1a714f1496b2 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:44.349202 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bec0ed6b-f7ae-4910-9a78-1a714f1496b2 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:44.350493 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bec0ed6b-f7ae-4910-9a78-1a714f1496b2 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:44.351704 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bec0ed6b-f7ae-4910-9a78-1a714f1496b2 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:44.353893 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bec0ed6b-f7ae-4910-9a78-1a714f1496b2 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:44.354568 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bec0ed6b-f7ae-4910-9a78-1a714f1496b2 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:44.442499 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bec0ed6b-f7ae-4910-9a78-1a714f1496b2 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:44.450764 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bec0ed6b-f7ae-4910-9a78-1a714f1496b2 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:44.452330 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bec0ed6b-f7ae-4910-9a78-1a714f1496b2 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:44.454626 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bec0ed6b-f7ae-4910-9a78-1a714f1496b2 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] 10.222.0.23 "GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e" status: 200 len: 1366 microversion: 2.57 time: 0.128674 Sep 10 12:10:44.455295 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2925/5858] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:44 2022] GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e => generated 1366 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:45.481405 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0e0a0c19-d908-4e4e-ad82-f8357e7ee186 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:45.482032 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0e0a0c19-d908-4e4e-ad82-f8357e7ee186 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] [instance: 51e04298-77b1-413e-8fbd-f31ac2e7d35e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:45.489627 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e0a0c19-d908-4e4e-ad82-f8357e7ee186 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:45.490403 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e0a0c19-d908-4e4e-ad82-f8357e7ee186 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:45.491033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e0a0c19-d908-4e4e-ad82-f8357e7ee186 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:45.492183 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e0a0c19-d908-4e4e-ad82-f8357e7ee186 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:45.492809 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e0a0c19-d908-4e4e-ad82-f8357e7ee186 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:45.493404 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e0a0c19-d908-4e4e-ad82-f8357e7ee186 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:45.570496 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0e0a0c19-d908-4e4e-ad82-f8357e7ee186 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:45.582151 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0e0a0c19-d908-4e4e-ad82-f8357e7ee186 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:45.583960 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0e0a0c19-d908-4e4e-ad82-f8357e7ee186 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:45.587020 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0e0a0c19-d908-4e4e-ad82-f8357e7ee186 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] 10.222.0.23 "GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e" status: 200 len: 1366 microversion: 2.57 time: 0.109565 Sep 10 12:10:45.588130 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2934/5859] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:45 2022] GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e => generated 1366 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:46.614850 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-82bcc65f-ba97-47f6-93f3-47a34b2ce49b tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:46.615782 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-82bcc65f-ba97-47f6-93f3-47a34b2ce49b tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] [instance: 51e04298-77b1-413e-8fbd-f31ac2e7d35e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:46.626998 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82bcc65f-ba97-47f6-93f3-47a34b2ce49b tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:46.627529 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82bcc65f-ba97-47f6-93f3-47a34b2ce49b tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:46.627973 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82bcc65f-ba97-47f6-93f3-47a34b2ce49b tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:46.628874 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82bcc65f-ba97-47f6-93f3-47a34b2ce49b tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:46.629348 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82bcc65f-ba97-47f6-93f3-47a34b2ce49b tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:46.629780 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82bcc65f-ba97-47f6-93f3-47a34b2ce49b tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:46.724176 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-82bcc65f-ba97-47f6-93f3-47a34b2ce49b tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:46.734364 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-82bcc65f-ba97-47f6-93f3-47a34b2ce49b tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:46.736056 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-82bcc65f-ba97-47f6-93f3-47a34b2ce49b tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:46.737290 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-82bcc65f-ba97-47f6-93f3-47a34b2ce49b tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] 10.222.0.23 "GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e" status: 200 len: 1366 microversion: 2.57 time: 0.128089 Sep 10 12:10:46.738583 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2926/5860] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:46 2022] GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e => generated 1366 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:47.764807 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9fa5027c-148a-4e77-abf5-93cd87c6a0f4 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:47.767081 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9fa5027c-148a-4e77-abf5-93cd87c6a0f4 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] [instance: 51e04298-77b1-413e-8fbd-f31ac2e7d35e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:47.774114 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fa5027c-148a-4e77-abf5-93cd87c6a0f4 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:47.774608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fa5027c-148a-4e77-abf5-93cd87c6a0f4 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:47.775054 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fa5027c-148a-4e77-abf5-93cd87c6a0f4 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:47.775972 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fa5027c-148a-4e77-abf5-93cd87c6a0f4 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:47.776438 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fa5027c-148a-4e77-abf5-93cd87c6a0f4 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:47.777086 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fa5027c-148a-4e77-abf5-93cd87c6a0f4 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:47.882373 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9fa5027c-148a-4e77-abf5-93cd87c6a0f4 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:47.894615 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9fa5027c-148a-4e77-abf5-93cd87c6a0f4 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:47.897660 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9fa5027c-148a-4e77-abf5-93cd87c6a0f4 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:47.899119 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9fa5027c-148a-4e77-abf5-93cd87c6a0f4 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] 10.222.0.23 "GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e" status: 200 len: 1366 microversion: 2.57 time: 0.138361 Sep 10 12:10:47.913206 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2935/5861] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:47 2022] GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e => generated 1366 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:48.926936 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f39e1e15-c520-451d-86c3-f9c5ed6f8cb8 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:48.928043 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f39e1e15-c520-451d-86c3-f9c5ed6f8cb8 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] [instance: 51e04298-77b1-413e-8fbd-f31ac2e7d35e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:48.931030 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:10:48.931979 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:10:48.938760 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f39e1e15-c520-451d-86c3-f9c5ed6f8cb8 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:48.939009 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f39e1e15-c520-451d-86c3-f9c5ed6f8cb8 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:48.939578 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f39e1e15-c520-451d-86c3-f9c5ed6f8cb8 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:48.940366 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f39e1e15-c520-451d-86c3-f9c5ed6f8cb8 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:48.940883 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f39e1e15-c520-451d-86c3-f9c5ed6f8cb8 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:48.941320 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f39e1e15-c520-451d-86c3-f9c5ed6f8cb8 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:49.013336 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f39e1e15-c520-451d-86c3-f9c5ed6f8cb8 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:49.024280 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f39e1e15-c520-451d-86c3-f9c5ed6f8cb8 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:49.026263 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f39e1e15-c520-451d-86c3-f9c5ed6f8cb8 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:49.027509 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f39e1e15-c520-451d-86c3-f9c5ed6f8cb8 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] 10.222.0.23 "GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e" status: 200 len: 1366 microversion: 2.57 time: 0.105667 Sep 10 12:10:49.028309 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2927/5862] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:48 2022] GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e => generated 1366 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:50.053885 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-56b2f11c-d14e-4047-9d04-970f384125d0 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:50.054659 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-56b2f11c-d14e-4047-9d04-970f384125d0 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] [instance: 51e04298-77b1-413e-8fbd-f31ac2e7d35e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:50.056639 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:10:50.065156 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-56b2f11c-d14e-4047-9d04-970f384125d0 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:50.065659 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-56b2f11c-d14e-4047-9d04-970f384125d0 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:50.066094 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-56b2f11c-d14e-4047-9d04-970f384125d0 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:50.067027 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-56b2f11c-d14e-4047-9d04-970f384125d0 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:50.067512 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-56b2f11c-d14e-4047-9d04-970f384125d0 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:50.067945 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-56b2f11c-d14e-4047-9d04-970f384125d0 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:50.154718 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-56b2f11c-d14e-4047-9d04-970f384125d0 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:50.165383 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-56b2f11c-d14e-4047-9d04-970f384125d0 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:50.166876 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-56b2f11c-d14e-4047-9d04-970f384125d0 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:50.168209 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-56b2f11c-d14e-4047-9d04-970f384125d0 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] 10.222.0.23 "GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e" status: 200 len: 1366 microversion: 2.57 time: 0.118360 Sep 10 12:10:50.168781 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2936/5863] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:50 2022] GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e => generated 1366 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 12:10:51.194764 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7c33354c-d4a8-4ea2-819b-0e33300b257f tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:51.195733 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7c33354c-d4a8-4ea2-819b-0e33300b257f tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] [instance: 51e04298-77b1-413e-8fbd-f31ac2e7d35e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:51.203302 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c33354c-d4a8-4ea2-819b-0e33300b257f tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:51.203934 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c33354c-d4a8-4ea2-819b-0e33300b257f tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:51.204445 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c33354c-d4a8-4ea2-819b-0e33300b257f tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:51.205259 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c33354c-d4a8-4ea2-819b-0e33300b257f tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:51.205783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c33354c-d4a8-4ea2-819b-0e33300b257f tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:51.206320 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c33354c-d4a8-4ea2-819b-0e33300b257f tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:51.276920 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7c33354c-d4a8-4ea2-819b-0e33300b257f tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:51.286240 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7c33354c-d4a8-4ea2-819b-0e33300b257f tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:51.288023 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7c33354c-d4a8-4ea2-819b-0e33300b257f tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:51.289393 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7c33354c-d4a8-4ea2-819b-0e33300b257f tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] 10.222.0.23 "GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e" status: 200 len: 1366 microversion: 2.57 time: 0.098624 Sep 10 12:10:51.290027 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2928/5864] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:51 2022] GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e => generated 1366 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:52.316877 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a2604a13-b2ba-4578-81dc-48e425d3f4ab tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:52.317510 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a2604a13-b2ba-4578-81dc-48e425d3f4ab tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] [instance: 51e04298-77b1-413e-8fbd-f31ac2e7d35e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:52.325008 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2604a13-b2ba-4578-81dc-48e425d3f4ab tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:52.325510 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2604a13-b2ba-4578-81dc-48e425d3f4ab tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:52.325956 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2604a13-b2ba-4578-81dc-48e425d3f4ab tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:52.326738 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2604a13-b2ba-4578-81dc-48e425d3f4ab tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:52.327115 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2604a13-b2ba-4578-81dc-48e425d3f4ab tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:52.327592 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2604a13-b2ba-4578-81dc-48e425d3f4ab tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:52.414269 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a2604a13-b2ba-4578-81dc-48e425d3f4ab tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:52.426387 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a2604a13-b2ba-4578-81dc-48e425d3f4ab tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:52.428277 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a2604a13-b2ba-4578-81dc-48e425d3f4ab tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:52.429697 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a2604a13-b2ba-4578-81dc-48e425d3f4ab tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] 10.222.0.23 "GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e" status: 200 len: 1366 microversion: 2.57 time: 0.117907 Sep 10 12:10:52.430435 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2937/5865] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:52 2022] GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e => generated 1366 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:53.457845 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7dc6e82a-4633-4ce3-816f-0c2083cd3f87 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:53.458612 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7dc6e82a-4633-4ce3-816f-0c2083cd3f87 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] [instance: 51e04298-77b1-413e-8fbd-f31ac2e7d35e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:53.465132 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:10:53.466962 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7dc6e82a-4633-4ce3-816f-0c2083cd3f87 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:53.467587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7dc6e82a-4633-4ce3-816f-0c2083cd3f87 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:53.468262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7dc6e82a-4633-4ce3-816f-0c2083cd3f87 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:53.469556 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7dc6e82a-4633-4ce3-816f-0c2083cd3f87 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:53.470288 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7dc6e82a-4633-4ce3-816f-0c2083cd3f87 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:53.470939 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7dc6e82a-4633-4ce3-816f-0c2083cd3f87 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:53.551232 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7dc6e82a-4633-4ce3-816f-0c2083cd3f87 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:53.559845 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7dc6e82a-4633-4ce3-816f-0c2083cd3f87 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:53.561535 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7dc6e82a-4633-4ce3-816f-0c2083cd3f87 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:53.563496 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7dc6e82a-4633-4ce3-816f-0c2083cd3f87 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] 10.222.0.23 "GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e" status: 200 len: 1366 microversion: 2.57 time: 0.109802 Sep 10 12:10:53.579713 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2929/5866] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:53 2022] GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e => generated 1366 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:54.592782 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-578b0ccb-35ef-4722-a8c8-51d3bd663d2c tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:54.594883 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-578b0ccb-35ef-4722-a8c8-51d3bd663d2c tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] [instance: 51e04298-77b1-413e-8fbd-f31ac2e7d35e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:54.604495 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-578b0ccb-35ef-4722-a8c8-51d3bd663d2c tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:54.605204 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-578b0ccb-35ef-4722-a8c8-51d3bd663d2c tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:54.605927 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-578b0ccb-35ef-4722-a8c8-51d3bd663d2c tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:54.607575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-578b0ccb-35ef-4722-a8c8-51d3bd663d2c tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:54.608311 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-578b0ccb-35ef-4722-a8c8-51d3bd663d2c tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:54.609247 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-578b0ccb-35ef-4722-a8c8-51d3bd663d2c tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:54.614201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:10:54.690360 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-578b0ccb-35ef-4722-a8c8-51d3bd663d2c tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:54.699679 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-578b0ccb-35ef-4722-a8c8-51d3bd663d2c tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:54.701704 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-578b0ccb-35ef-4722-a8c8-51d3bd663d2c tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:54.702704 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-578b0ccb-35ef-4722-a8c8-51d3bd663d2c tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] 10.222.0.23 "GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e" status: 200 len: 1366 microversion: 2.57 time: 0.115530 Sep 10 12:10:54.704485 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2938/5867] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:54 2022] GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e => generated 1366 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:55.729049 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2a8146bb-9999-4897-ab02-c798aa256c7e tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:55.729770 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2a8146bb-9999-4897-ab02-c798aa256c7e tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] [instance: 51e04298-77b1-413e-8fbd-f31ac2e7d35e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:55.737462 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a8146bb-9999-4897-ab02-c798aa256c7e tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:55.738042 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a8146bb-9999-4897-ab02-c798aa256c7e tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:55.738546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a8146bb-9999-4897-ab02-c798aa256c7e tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:55.739378 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a8146bb-9999-4897-ab02-c798aa256c7e tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:55.739948 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a8146bb-9999-4897-ab02-c798aa256c7e tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:55.740450 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a8146bb-9999-4897-ab02-c798aa256c7e tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:55.745001 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:10:55.810936 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2a8146bb-9999-4897-ab02-c798aa256c7e tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:55.819564 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2a8146bb-9999-4897-ab02-c798aa256c7e tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:55.821116 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2a8146bb-9999-4897-ab02-c798aa256c7e tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:55.822436 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2a8146bb-9999-4897-ab02-c798aa256c7e tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] 10.222.0.23 "GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e" status: 200 len: 1366 microversion: 2.57 time: 0.097457 Sep 10 12:10:55.823091 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2930/5868] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:55 2022] GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e => generated 1366 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:56.853547 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-662c7983-a909-4e23-818a-1a8006e60727 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:56.854209 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-662c7983-a909-4e23-818a-1a8006e60727 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] [instance: 51e04298-77b1-413e-8fbd-f31ac2e7d35e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:56.863133 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-662c7983-a909-4e23-818a-1a8006e60727 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:56.863590 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-662c7983-a909-4e23-818a-1a8006e60727 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:56.864036 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-662c7983-a909-4e23-818a-1a8006e60727 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:56.864755 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-662c7983-a909-4e23-818a-1a8006e60727 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:56.865249 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-662c7983-a909-4e23-818a-1a8006e60727 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:56.865679 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-662c7983-a909-4e23-818a-1a8006e60727 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:56.939760 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-662c7983-a909-4e23-818a-1a8006e60727 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:56.948493 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-662c7983-a909-4e23-818a-1a8006e60727 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:56.950192 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-662c7983-a909-4e23-818a-1a8006e60727 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:56.951404 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-662c7983-a909-4e23-818a-1a8006e60727 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] 10.222.0.23 "GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e" status: 200 len: 1366 microversion: 2.57 time: 0.105624 Sep 10 12:10:56.952352 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2939/5869] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:56 2022] GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e => generated 1366 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:57.978290 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e9ffc079-1921-4ac6-aa84-4bd60ece4eea tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:57.979066 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e9ffc079-1921-4ac6-aa84-4bd60ece4eea tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] [instance: 51e04298-77b1-413e-8fbd-f31ac2e7d35e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:57.987459 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e9ffc079-1921-4ac6-aa84-4bd60ece4eea tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:57.987959 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e9ffc079-1921-4ac6-aa84-4bd60ece4eea tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:57.988401 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e9ffc079-1921-4ac6-aa84-4bd60ece4eea tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:57.989254 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e9ffc079-1921-4ac6-aa84-4bd60ece4eea tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:57.989727 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e9ffc079-1921-4ac6-aa84-4bd60ece4eea tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:57.990152 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e9ffc079-1921-4ac6-aa84-4bd60ece4eea tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:58.057990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e9ffc079-1921-4ac6-aa84-4bd60ece4eea tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:58.066670 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e9ffc079-1921-4ac6-aa84-4bd60ece4eea tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:58.068429 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e9ffc079-1921-4ac6-aa84-4bd60ece4eea tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:58.069624 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e9ffc079-1921-4ac6-aa84-4bd60ece4eea tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] 10.222.0.23 "GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e" status: 200 len: 1366 microversion: 2.57 time: 0.095547 Sep 10 12:10:58.070198 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2931/5870] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:57 2022] GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e => generated 1366 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:10:59.096968 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0e02aa8a-b68b-4d84-be34-40827452df2e tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:10:59.097600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0e02aa8a-b68b-4d84-be34-40827452df2e tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] [instance: 51e04298-77b1-413e-8fbd-f31ac2e7d35e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:10:59.104136 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e02aa8a-b68b-4d84-be34-40827452df2e tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:59.104636 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e02aa8a-b68b-4d84-be34-40827452df2e tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:59.105082 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e02aa8a-b68b-4d84-be34-40827452df2e tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:59.105784 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e02aa8a-b68b-4d84-be34-40827452df2e tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:10:59.106510 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e02aa8a-b68b-4d84-be34-40827452df2e tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:10:59.106943 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e02aa8a-b68b-4d84-be34-40827452df2e tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:10:59.177883 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0e02aa8a-b68b-4d84-be34-40827452df2e tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:59.186333 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0e02aa8a-b68b-4d84-be34-40827452df2e tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:59.188577 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0e02aa8a-b68b-4d84-be34-40827452df2e tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:10:59.189771 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0e02aa8a-b68b-4d84-be34-40827452df2e tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] 10.222.0.23 "GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e" status: 200 len: 1366 microversion: 2.57 time: 0.097834 Sep 10 12:10:59.190343 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2940/5871] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:10:59 2022] GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e => generated 1366 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:11:00.218039 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-644796b8-8e94-4e6b-94e1-f09476607ff8 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:00.219465 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-644796b8-8e94-4e6b-94e1-f09476607ff8 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] [instance: 51e04298-77b1-413e-8fbd-f31ac2e7d35e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:00.227123 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-644796b8-8e94-4e6b-94e1-f09476607ff8 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:00.227963 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-644796b8-8e94-4e6b-94e1-f09476607ff8 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:00.228602 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-644796b8-8e94-4e6b-94e1-f09476607ff8 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:00.229372 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-644796b8-8e94-4e6b-94e1-f09476607ff8 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:00.230065 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-644796b8-8e94-4e6b-94e1-f09476607ff8 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:00.230544 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-644796b8-8e94-4e6b-94e1-f09476607ff8 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:00.332093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-644796b8-8e94-4e6b-94e1-f09476607ff8 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:00.346198 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-644796b8-8e94-4e6b-94e1-f09476607ff8 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:00.347664 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-644796b8-8e94-4e6b-94e1-f09476607ff8 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:00.348850 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-644796b8-8e94-4e6b-94e1-f09476607ff8 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] 10.222.0.23 "GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e" status: 200 len: 1366 microversion: 2.57 time: 0.134865 Sep 10 12:11:00.349448 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2932/5872] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:11:00 2022] GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e => generated 1366 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:11:01.374191 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9e73dd81-a356-431b-891e-162d4106c387 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:01.375782 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9e73dd81-a356-431b-891e-162d4106c387 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] [instance: 51e04298-77b1-413e-8fbd-f31ac2e7d35e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:01.379114 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:11:01.384557 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9e73dd81-a356-431b-891e-162d4106c387 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:01.385216 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9e73dd81-a356-431b-891e-162d4106c387 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:01.385657 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9e73dd81-a356-431b-891e-162d4106c387 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:01.386360 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9e73dd81-a356-431b-891e-162d4106c387 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:01.386816 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9e73dd81-a356-431b-891e-162d4106c387 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:01.387277 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9e73dd81-a356-431b-891e-162d4106c387 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:01.472357 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9e73dd81-a356-431b-891e-162d4106c387 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:01.481768 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9e73dd81-a356-431b-891e-162d4106c387 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:01.483362 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9e73dd81-a356-431b-891e-162d4106c387 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:01.485020 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9e73dd81-a356-431b-891e-162d4106c387 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] 10.222.0.23 "GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e" status: 200 len: 1366 microversion: 2.57 time: 0.114388 Sep 10 12:11:01.485896 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2941/5873] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:11:01 2022] GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e => generated 1366 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:11:02.512095 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cda02a6f-8d6d-4162-a108-59605f503241 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:02.514047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cda02a6f-8d6d-4162-a108-59605f503241 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] [instance: 51e04298-77b1-413e-8fbd-f31ac2e7d35e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:02.520680 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cda02a6f-8d6d-4162-a108-59605f503241 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:02.521174 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cda02a6f-8d6d-4162-a108-59605f503241 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:02.521824 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cda02a6f-8d6d-4162-a108-59605f503241 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:02.522688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cda02a6f-8d6d-4162-a108-59605f503241 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:02.523347 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cda02a6f-8d6d-4162-a108-59605f503241 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:02.523941 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cda02a6f-8d6d-4162-a108-59605f503241 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:02.634591 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cda02a6f-8d6d-4162-a108-59605f503241 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:02.644694 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cda02a6f-8d6d-4162-a108-59605f503241 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:02.646440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cda02a6f-8d6d-4162-a108-59605f503241 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:02.647810 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cda02a6f-8d6d-4162-a108-59605f503241 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] 10.222.0.23 "GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e" status: 200 len: 1366 microversion: 2.57 time: 0.139734 Sep 10 12:11:02.648541 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2933/5874] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:11:02 2022] GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e => generated 1366 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:11:03.675751 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ec803251-d452-4261-abc7-8d0bef6a0e3e tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:03.676966 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ec803251-d452-4261-abc7-8d0bef6a0e3e tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] [instance: 51e04298-77b1-413e-8fbd-f31ac2e7d35e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:03.686630 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec803251-d452-4261-abc7-8d0bef6a0e3e tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:03.688052 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec803251-d452-4261-abc7-8d0bef6a0e3e tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:03.688707 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec803251-d452-4261-abc7-8d0bef6a0e3e tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:03.689950 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec803251-d452-4261-abc7-8d0bef6a0e3e tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:03.690575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec803251-d452-4261-abc7-8d0bef6a0e3e tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:03.691202 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec803251-d452-4261-abc7-8d0bef6a0e3e tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:03.764415 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ec803251-d452-4261-abc7-8d0bef6a0e3e tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:03.774968 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ec803251-d452-4261-abc7-8d0bef6a0e3e tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:03.776838 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ec803251-d452-4261-abc7-8d0bef6a0e3e tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:03.778148 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ec803251-d452-4261-abc7-8d0bef6a0e3e tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] 10.222.0.23 "GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e" status: 200 len: 1366 microversion: 2.57 time: 0.107219 Sep 10 12:11:03.791652 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2942/5875] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:11:03 2022] GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e => generated 1366 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:11:04.806093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-896d569d-6ba5-4258-bb32-d6006dc20649 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:04.807291 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-896d569d-6ba5-4258-bb32-d6006dc20649 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] [instance: 51e04298-77b1-413e-8fbd-f31ac2e7d35e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:04.815864 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-896d569d-6ba5-4258-bb32-d6006dc20649 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:04.816548 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-896d569d-6ba5-4258-bb32-d6006dc20649 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:04.817213 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-896d569d-6ba5-4258-bb32-d6006dc20649 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:04.818086 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-896d569d-6ba5-4258-bb32-d6006dc20649 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:04.818853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-896d569d-6ba5-4258-bb32-d6006dc20649 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:04.819475 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-896d569d-6ba5-4258-bb32-d6006dc20649 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:04.890714 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-896d569d-6ba5-4258-bb32-d6006dc20649 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:04.900456 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-896d569d-6ba5-4258-bb32-d6006dc20649 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:04.902224 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-896d569d-6ba5-4258-bb32-d6006dc20649 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:04.903538 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-896d569d-6ba5-4258-bb32-d6006dc20649 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] 10.222.0.23 "GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e" status: 200 len: 1366 microversion: 2.57 time: 0.101403 Sep 10 12:11:04.915937 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2934/5876] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:11:04 2022] GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e => generated 1366 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:11:05.930312 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-58c97047-2b98-4e50-895a-08e9a261cbd5 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:05.931828 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-58c97047-2b98-4e50-895a-08e9a261cbd5 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] [instance: 51e04298-77b1-413e-8fbd-f31ac2e7d35e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:05.940512 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-58c97047-2b98-4e50-895a-08e9a261cbd5 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:05.941379 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-58c97047-2b98-4e50-895a-08e9a261cbd5 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:05.942076 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-58c97047-2b98-4e50-895a-08e9a261cbd5 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:05.943065 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-58c97047-2b98-4e50-895a-08e9a261cbd5 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:05.943863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-58c97047-2b98-4e50-895a-08e9a261cbd5 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:05.944521 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-58c97047-2b98-4e50-895a-08e9a261cbd5 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:06.021287 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-58c97047-2b98-4e50-895a-08e9a261cbd5 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:06.033332 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-58c97047-2b98-4e50-895a-08e9a261cbd5 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:06.035474 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-58c97047-2b98-4e50-895a-08e9a261cbd5 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:06.036793 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-58c97047-2b98-4e50-895a-08e9a261cbd5 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] 10.222.0.23 "GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e" status: 200 len: 1366 microversion: 2.57 time: 0.110515 Sep 10 12:11:06.037530 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2943/5877] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:11:05 2022] GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e => generated 1366 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:11:07.063737 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-943ebd24-227e-4d0b-8087-84f1693cb698 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:07.064355 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-943ebd24-227e-4d0b-8087-84f1693cb698 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] [instance: 51e04298-77b1-413e-8fbd-f31ac2e7d35e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:07.071447 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-943ebd24-227e-4d0b-8087-84f1693cb698 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:07.071934 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-943ebd24-227e-4d0b-8087-84f1693cb698 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:07.072369 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-943ebd24-227e-4d0b-8087-84f1693cb698 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:07.073054 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-943ebd24-227e-4d0b-8087-84f1693cb698 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:07.073508 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-943ebd24-227e-4d0b-8087-84f1693cb698 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:07.073933 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-943ebd24-227e-4d0b-8087-84f1693cb698 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:07.145847 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-943ebd24-227e-4d0b-8087-84f1693cb698 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:07.154510 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-943ebd24-227e-4d0b-8087-84f1693cb698 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:07.156255 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-943ebd24-227e-4d0b-8087-84f1693cb698 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:07.157645 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-943ebd24-227e-4d0b-8087-84f1693cb698 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] 10.222.0.23 "GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e" status: 200 len: 1366 microversion: 2.57 time: 0.099019 Sep 10 12:11:07.158313 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2935/5878] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:11:07 2022] GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e => generated 1366 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:11:08.185780 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-babfca41-d99f-479f-bf5c-3e6ae3811e4d tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:08.186407 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-babfca41-d99f-479f-bf5c-3e6ae3811e4d tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] [instance: 51e04298-77b1-413e-8fbd-f31ac2e7d35e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:08.195771 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-babfca41-d99f-479f-bf5c-3e6ae3811e4d tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:08.196271 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-babfca41-d99f-479f-bf5c-3e6ae3811e4d tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:08.196710 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-babfca41-d99f-479f-bf5c-3e6ae3811e4d tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:08.197573 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-babfca41-d99f-479f-bf5c-3e6ae3811e4d tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:08.198044 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-babfca41-d99f-479f-bf5c-3e6ae3811e4d tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:08.198479 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-babfca41-d99f-479f-bf5c-3e6ae3811e4d tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:08.271507 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-babfca41-d99f-479f-bf5c-3e6ae3811e4d tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:08.281319 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-babfca41-d99f-479f-bf5c-3e6ae3811e4d tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:08.283251 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-babfca41-d99f-479f-bf5c-3e6ae3811e4d tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:08.284453 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-babfca41-d99f-479f-bf5c-3e6ae3811e4d tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] 10.222.0.23 "GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e" status: 200 len: 1366 microversion: 2.57 time: 0.102894 Sep 10 12:11:08.285052 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2944/5879] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:11:08 2022] GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e => generated 1366 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:11:09.310091 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c3b1b04f-c1f2-4079-9b4a-83ac9b6dd5d2 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:09.310689 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c3b1b04f-c1f2-4079-9b4a-83ac9b6dd5d2 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] [instance: 51e04298-77b1-413e-8fbd-f31ac2e7d35e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:09.318330 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3b1b04f-c1f2-4079-9b4a-83ac9b6dd5d2 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:09.318813 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3b1b04f-c1f2-4079-9b4a-83ac9b6dd5d2 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:09.319286 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3b1b04f-c1f2-4079-9b4a-83ac9b6dd5d2 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:09.320044 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3b1b04f-c1f2-4079-9b4a-83ac9b6dd5d2 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:09.320505 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3b1b04f-c1f2-4079-9b4a-83ac9b6dd5d2 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:09.320932 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3b1b04f-c1f2-4079-9b4a-83ac9b6dd5d2 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:09.387191 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c3b1b04f-c1f2-4079-9b4a-83ac9b6dd5d2 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:09.396919 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c3b1b04f-c1f2-4079-9b4a-83ac9b6dd5d2 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:09.398544 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c3b1b04f-c1f2-4079-9b4a-83ac9b6dd5d2 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:09.399861 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c3b1b04f-c1f2-4079-9b4a-83ac9b6dd5d2 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] 10.222.0.23 "GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e" status: 200 len: 1372 microversion: 2.57 time: 0.093802 Sep 10 12:11:09.400435 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2936/5880] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:11:09 2022] GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:11:10.426665 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8af46391-5b6d-4c02-98b0-fcd844492304 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:10.427591 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8af46391-5b6d-4c02-98b0-fcd844492304 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] [instance: 51e04298-77b1-413e-8fbd-f31ac2e7d35e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:10.434869 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8af46391-5b6d-4c02-98b0-fcd844492304 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:10.435521 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8af46391-5b6d-4c02-98b0-fcd844492304 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:10.436081 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8af46391-5b6d-4c02-98b0-fcd844492304 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:10.437576 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8af46391-5b6d-4c02-98b0-fcd844492304 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:10.438280 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8af46391-5b6d-4c02-98b0-fcd844492304 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:10.438801 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8af46391-5b6d-4c02-98b0-fcd844492304 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:10.505355 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8af46391-5b6d-4c02-98b0-fcd844492304 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:10.513895 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8af46391-5b6d-4c02-98b0-fcd844492304 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:10.516097 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8af46391-5b6d-4c02-98b0-fcd844492304 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:10.517283 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8af46391-5b6d-4c02-98b0-fcd844492304 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] 10.222.0.23 "GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e" status: 200 len: 1372 microversion: 2.57 time: 0.094579 Sep 10 12:11:10.518443 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2945/5881] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:11:10 2022] GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:11:11.544114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b5132490-4273-42f2-913f-81d483406556 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:11.544830 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b5132490-4273-42f2-913f-81d483406556 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] [instance: 51e04298-77b1-413e-8fbd-f31ac2e7d35e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:11.553298 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5132490-4273-42f2-913f-81d483406556 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:11.553882 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5132490-4273-42f2-913f-81d483406556 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:11.554402 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5132490-4273-42f2-913f-81d483406556 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:11.555197 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5132490-4273-42f2-913f-81d483406556 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:11.555666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5132490-4273-42f2-913f-81d483406556 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:11.556100 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5132490-4273-42f2-913f-81d483406556 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:11.632485 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b5132490-4273-42f2-913f-81d483406556 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:11.649449 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b5132490-4273-42f2-913f-81d483406556 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:11.651099 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b5132490-4273-42f2-913f-81d483406556 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:11.652388 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b5132490-4273-42f2-913f-81d483406556 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] 10.222.0.23 "GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e" status: 200 len: 1357 microversion: 2.57 time: 0.112252 Sep 10 12:11:11.653033 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2937/5882] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:11:11 2022] GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e => generated 1357 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 10 12:11:11.682425 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d535a23c-3138-4133-ad03-61efc29a3f0a tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:11.682943 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d535a23c-3138-4133-ad03-61efc29a3f0a tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] [instance: 51e04298-77b1-413e-8fbd-f31ac2e7d35e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:11.691075 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d535a23c-3138-4133-ad03-61efc29a3f0a tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:11.691610 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d535a23c-3138-4133-ad03-61efc29a3f0a tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:11.692058 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d535a23c-3138-4133-ad03-61efc29a3f0a tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:11.692904 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d535a23c-3138-4133-ad03-61efc29a3f0a tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:11.693424 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d535a23c-3138-4133-ad03-61efc29a3f0a tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:11.693883 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d535a23c-3138-4133-ad03-61efc29a3f0a tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:11.730218 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d535a23c-3138-4133-ad03-61efc29a3f0a tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] [instance: 51e04298-77b1-413e-8fbd-f31ac2e7d35e] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:11:11.824963 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d535a23c-3138-4133-ad03-61efc29a3f0a tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] 10.222.0.23 "DELETE /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e" status: 204 len: 0 microversion: 2.57 time: 0.145643 Sep 10 12:11:11.825605 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2946/5883] 10.222.0.23 () {60 vars in 1280 bytes} [Sat Sep 10 12:11:11 2022] DELETE /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 10 12:11:11.835768 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0733839c-94f5-4fad-b32f-c1e68146bf09 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:11.836535 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0733839c-94f5-4fad-b32f-c1e68146bf09 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] [instance: 51e04298-77b1-413e-8fbd-f31ac2e7d35e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:11.842860 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0733839c-94f5-4fad-b32f-c1e68146bf09 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:11.844300 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0733839c-94f5-4fad-b32f-c1e68146bf09 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:11.849866 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0733839c-94f5-4fad-b32f-c1e68146bf09 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:11.854661 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0733839c-94f5-4fad-b32f-c1e68146bf09 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:11.858508 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0733839c-94f5-4fad-b32f-c1e68146bf09 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:11.859689 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0733839c-94f5-4fad-b32f-c1e68146bf09 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:11.940480 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0733839c-94f5-4fad-b32f-c1e68146bf09 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:11.949012 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0733839c-94f5-4fad-b32f-c1e68146bf09 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:11.950564 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0733839c-94f5-4fad-b32f-c1e68146bf09 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:11.951830 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0733839c-94f5-4fad-b32f-c1e68146bf09 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] 10.222.0.23 "GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e" status: 200 len: 1363 microversion: 2.57 time: 0.121542 Sep 10 12:11:11.954026 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2938/5884] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:11:11 2022] GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e => generated 1363 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 12:11:12.794666 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-21eea134-baa5-4479-ab46-de2ab71b449b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:12.796048 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-21eea134-baa5-4479-ab46-de2ab71b449b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:12.804829 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-21eea134-baa5-4479-ab46-de2ab71b449b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:12.805264 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-21eea134-baa5-4479-ab46-de2ab71b449b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:12.805979 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-21eea134-baa5-4479-ab46-de2ab71b449b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:12.807448 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-21eea134-baa5-4479-ab46-de2ab71b449b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:12.808169 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-21eea134-baa5-4479-ab46-de2ab71b449b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:12.808824 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-21eea134-baa5-4479-ab46-de2ab71b449b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:12.897775 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-21eea134-baa5-4479-ab46-de2ab71b449b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lazy-loading 'services' on Instance uuid 20f0d900-aeea-4f7c-9b92-bf9363ba21c9 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:11:12.976295 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-21eea134-baa5-4479-ab46-de2ab71b449b tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "DELETE /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9/os-volume_attachments/b762e325-1846-4ae8-9cff-6b92b38631c4" status: 202 len: 0 microversion: 2.1 time: 0.185884 Sep 10 12:11:12.976969 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2947/5885] 10.222.0.23 () {58 vars in 1416 bytes} [Sat Sep 10 12:11:12 2022] DELETE /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9/os-volume_attachments/b762e325-1846-4ae8-9cff-6b92b38631c4 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:11:12.981365 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-809c2bfd-6051-4978-a5bf-b006f23435e6 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:12.982202 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-809c2bfd-6051-4978-a5bf-b006f23435e6 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] [instance: 51e04298-77b1-413e-8fbd-f31ac2e7d35e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:13.001990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-809c2bfd-6051-4978-a5bf-b006f23435e6 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:13.002531 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-809c2bfd-6051-4978-a5bf-b006f23435e6 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:13.003024 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-809c2bfd-6051-4978-a5bf-b006f23435e6 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:13.003890 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-809c2bfd-6051-4978-a5bf-b006f23435e6 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:13.004354 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-809c2bfd-6051-4978-a5bf-b006f23435e6 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:13.004785 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-809c2bfd-6051-4978-a5bf-b006f23435e6 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:13.116712 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-809c2bfd-6051-4978-a5bf-b006f23435e6 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:13.128360 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-809c2bfd-6051-4978-a5bf-b006f23435e6 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:13.130347 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-809c2bfd-6051-4978-a5bf-b006f23435e6 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64e5e037bd644c44859b1c248d11834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5cd68ebb40d7a3f2176aad2c29f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:13.131855 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-809c2bfd-6051-4978-a5bf-b006f23435e6 tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] 10.222.0.23 "GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e" status: 200 len: 1363 microversion: 2.57 time: 0.157693 Sep 10 12:11:13.132968 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2939/5886] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:11:12 2022] GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 10 12:11:14.159711 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f31e953a-6bdf-427b-91aa-f7c3c37432fd tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:14.160352 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f31e953a-6bdf-427b-91aa-f7c3c37432fd tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] [instance: 51e04298-77b1-413e-8fbd-f31ac2e7d35e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:14.169377 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f31e953a-6bdf-427b-91aa-f7c3c37432fd tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:14.170130 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f31e953a-6bdf-427b-91aa-f7c3c37432fd tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:14.171081 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f31e953a-6bdf-427b-91aa-f7c3c37432fd tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:14.172029 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f31e953a-6bdf-427b-91aa-f7c3c37432fd tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:14.172703 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f31e953a-6bdf-427b-91aa-f7c3c37432fd tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:14.173332 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f31e953a-6bdf-427b-91aa-f7c3c37432fd tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:14.192091 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-f31e953a-6bdf-427b-91aa-f7c3c37432fd tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] HTTP exception thrown: Instance 51e04298-77b1-413e-8fbd-f31ac2e7d35e could not be found. Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f31e953a-6bdf-427b-91aa-f7c3c37432fd tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Request method failure captured: Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e HTTP/1.1 Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH690Sh-WRddM9sI7fpOVg4Dpa13VmpsUMKGGIwgmd8pG-aLw8M6k8j61TZsRiQYDJGmJUFzQ4xae0YlnAOQg2f_-aH-t8abpHdBR-66rB6EG12kuDTN8b2swFKBWsvLbs7vN4_4JE7t4DeDjnXSMKgw7RphygWBNfG9STC59svn96A Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: X-Openstack-Nova-Api-Version: 2.57 Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 967b5cd68ebb40d7a3f2176aad2c29f5 Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServerShowV257Test-42608430 Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/967b5cd68ebb40d7a3f2176aad2c29f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/967b5cd68ebb40d7a3f2176aad2c29f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_967b5cd68ebb40d7a3f2176aad2c29f5", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/967b5cd68ebb40d7a3f2176aad2c29f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServerShowV257Test-42608430 Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 967b5cd68ebb40d7a3f2176aad2c29f5 Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServerShowV257Test-42608430 Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServerShowV257Test-42608430-project Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 64e5e037bd644c44859b1c248d11834a Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServerShowV257Test-42608430-project Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 51e04298-77b1-413e-8fbd-f31ac2e7d35e could not be found. Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '51e04298-77b1-413e-8fbd-f31ac2e7d35e'} Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51e04298-77b1-413e-8fbd-f31ac2e7d35e could not be found. Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51e04298-77b1-413e-8fbd-f31ac2e7d35e could not be found. Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:11:14.194111 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:11:14.199637 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:11:14.199637 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:11:14.199637 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:11:14.199637 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:11:14.199637 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:11:14.199637 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51e04298-77b1-413e-8fbd-f31ac2e7d35e could not be found. Sep 10 12:11:14.199637 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:11:14.201014 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f31e953a-6bdf-427b-91aa-f7c3c37432fd tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] Returning 404 to user: Instance 51e04298-77b1-413e-8fbd-f31ac2e7d35e could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:11:14.202106 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f31e953a-6bdf-427b-91aa-f7c3c37432fd tempest-ServerShowV257Test-42608430 tempest-ServerShowV257Test-42608430-project] 10.222.0.23 "GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e" status: 404 len: 111 microversion: 2.57 time: 0.047869 Sep 10 12:11:14.203912 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2948/5887] 10.222.0.23 () {60 vars in 1277 bytes} [Sat Sep 10 12:11:14 2022] GET /compute/v2.1/servers/51e04298-77b1-413e-8fbd-f31ac2e7d35e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 10 12:11:16.879007 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0672a1b6-bdae-4922-9869-d5963c9d85fc tempest-ComputeTenantNetworksTest-946240238 tempest-ComputeTenantNetworksTest-946240238-project] Calling method '.version_select at 0x7f4073065e50>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:17.029759 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0672a1b6-bdae-4922-9869-d5963c9d85fc tempest-ComputeTenantNetworksTest-946240238 tempest-ComputeTenantNetworksTest-946240238-project] 10.222.0.23 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.307879 Sep 10 12:11:17.030363 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2940/5888] 10.222.0.23 () {58 vars in 1158 bytes} [Sat Sep 10 12:11:16 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:11:17.042085 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-40da50d8-a284-4e89-af71-18b67ae7bd20 tempest-ComputeTenantNetworksTest-946240238 tempest-ComputeTenantNetworksTest-946240238-project] Calling method '.version_select at 0x7f4072ccd9d0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:17.149824 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-40da50d8-a284-4e89-af71-18b67ae7bd20 tempest-ComputeTenantNetworksTest-946240238 tempest-ComputeTenantNetworksTest-946240238-project] 10.222.0.23 "GET /compute/v2.1/os-tenant-networks/79897c5c-dfaf-42dc-82d9-ebe69005dbae" status: 200 len: 140 microversion: 2.1 time: 0.111533 Sep 10 12:11:17.150420 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2949/5889] 10.222.0.23 () {58 vars in 1269 bytes} [Sat Sep 10 12:11:17 2022] GET /compute/v2.1/os-tenant-networks/79897c5c-dfaf-42dc-82d9-ebe69005dbae => generated 140 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:11:19.182773 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-30ba39a3-054d-4014-bf9c-ab85fe32c44b tempest-VolumesGetTestJSON-114563570 tempest-VolumesGetTestJSON-114563570-project] Action: 'create', calling method: .version_select at 0x7f4071b91040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1871983129", "metadata": {"Type": "work"}}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:11:19.533085 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-30ba39a3-054d-4014-bf9c-ab85fe32c44b tempest-VolumesGetTestJSON-114563570 tempest-VolumesGetTestJSON-114563570-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.522387 Sep 10 12:11:19.533889 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2941/5890] 10.222.0.23 () {60 vars in 1156 bytes} [Sat Sep 10 12:11:19 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 524 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 10 12:11:19.546740 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1f1f9d2e-0d87-47f9-9c09-b32920b1e823 tempest-VolumesGetTestJSON-114563570 tempest-VolumesGetTestJSON-114563570-project] Calling method '.version_select at 0x7f407b5eaaf0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:19.647893 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1f1f9d2e-0d87-47f9-9c09-b32920b1e823 tempest-VolumesGetTestJSON-114563570 tempest-VolumesGetTestJSON-114563570-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/89cd21ef-4c82-4009-a5dc-7a9351ee48b8" status: 200 len: 353 microversion: 2.1 time: 0.104798 Sep 10 12:11:19.648491 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2950/5891] 10.222.0.23 () {58 vars in 1245 bytes} [Sat Sep 10 12:11:19 2022] GET /compute/v2.1/os-volumes/89cd21ef-4c82-4009-a5dc-7a9351ee48b8 => generated 353 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:11:19.683995 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-aec85d58-f999-44b4-bc12-03b7f138dd91 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:11:19.701400 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aec85d58-f999-44b4-bc12-03b7f138dd91 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:19.701980 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aec85d58-f999-44b4-bc12-03b7f138dd91 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:19.703070 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aec85d58-f999-44b4-bc12-03b7f138dd91 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:19.730895 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-aec85d58-f999-44b4-bc12-03b7f138dd91 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Going to try to stop instance {{(pid=128777) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 10 12:11:19.779541 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-aec85d58-f999-44b4-bc12-03b7f138dd91 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "POST /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9/action" status: 202 len: 0 microversion: 2.1 time: 0.099512 Sep 10 12:11:19.781261 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2942/5892] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:11:19 2022] POST /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:11:19.794765 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-40e2626a-9fcf-4188-beec-fed742e978a1 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:19.799640 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-40e2626a-9fcf-4188-beec-fed742e978a1 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:19.819729 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-40e2626a-9fcf-4188-beec-fed742e978a1 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:19.820244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-40e2626a-9fcf-4188-beec-fed742e978a1 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:19.820694 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-40e2626a-9fcf-4188-beec-fed742e978a1 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:19.831985 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-40e2626a-9fcf-4188-beec-fed742e978a1 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:19.834399 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-40e2626a-9fcf-4188-beec-fed742e978a1 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:19.834873 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-40e2626a-9fcf-4188-beec-fed742e978a1 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:20.024361 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-40e2626a-9fcf-4188-beec-fed742e978a1 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:20.033476 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-40e2626a-9fcf-4188-beec-fed742e978a1 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1677 microversion: 2.1 time: 0.246456 Sep 10 12:11:20.034413 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2951/5893] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:11:19 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1677 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:11:20.663586 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-18619d4d-6600-452b-bc96-7e5f81855281 tempest-VolumesGetTestJSON-114563570 tempest-VolumesGetTestJSON-114563570-project] Calling method '.version_select at 0x7f4071b911f0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:20.738386 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-18619d4d-6600-452b-bc96-7e5f81855281 tempest-VolumesGetTestJSON-114563570 tempest-VolumesGetTestJSON-114563570-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/89cd21ef-4c82-4009-a5dc-7a9351ee48b8" status: 200 len: 354 microversion: 2.1 time: 0.079859 Sep 10 12:11:20.739004 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2943/5894] 10.222.0.23 () {58 vars in 1245 bytes} [Sat Sep 10 12:11:20 2022] GET /compute/v2.1/os-volumes/89cd21ef-4c82-4009-a5dc-7a9351ee48b8 => generated 354 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:11:20.753444 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c6f9a898-6ff2-445a-9575-aa408a3162c2 tempest-VolumesGetTestJSON-114563570 tempest-VolumesGetTestJSON-114563570-project] Calling method '.version_select at 0x7f4073678790>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:20.808480 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c6f9a898-6ff2-445a-9575-aa408a3162c2 tempest-VolumesGetTestJSON-114563570 tempest-VolumesGetTestJSON-114563570-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/89cd21ef-4c82-4009-a5dc-7a9351ee48b8" status: 200 len: 354 microversion: 2.1 time: 0.059908 Sep 10 12:11:20.809651 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2952/5895] 10.222.0.23 () {58 vars in 1245 bytes} [Sat Sep 10 12:11:20 2022] GET /compute/v2.1/os-volumes/89cd21ef-4c82-4009-a5dc-7a9351ee48b8 => generated 354 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:11:20.826524 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-336cffa4-715d-4739-bc3c-4d0684556465 tempest-VolumesGetTestJSON-114563570 tempest-VolumesGetTestJSON-114563570-project] Calling method '.version_select at 0x7f407358ac10>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:20.945707 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-336cffa4-715d-4739-bc3c-4d0684556465 tempest-VolumesGetTestJSON-114563570 tempest-VolumesGetTestJSON-114563570-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/89cd21ef-4c82-4009-a5dc-7a9351ee48b8" status: 202 len: 0 microversion: 2.1 time: 0.123043 Sep 10 12:11:20.946395 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2944/5896] 10.222.0.23 () {58 vars in 1248 bytes} [Sat Sep 10 12:11:20 2022] DELETE /compute/v2.1/os-volumes/89cd21ef-4c82-4009-a5dc-7a9351ee48b8 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:11:20.954614 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-72ab7f22-a137-49a6-8875-f64db22e5cdb tempest-VolumesGetTestJSON-114563570 tempest-VolumesGetTestJSON-114563570-project] Calling method '.version_select at 0x7f4072c8b790>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:21.026118 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-72ab7f22-a137-49a6-8875-f64db22e5cdb tempest-VolumesGetTestJSON-114563570 tempest-VolumesGetTestJSON-114563570-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/89cd21ef-4c82-4009-a5dc-7a9351ee48b8" status: 200 len: 353 microversion: 2.1 time: 0.075396 Sep 10 12:11:21.026778 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2953/5897] 10.222.0.23 () {58 vars in 1245 bytes} [Sat Sep 10 12:11:20 2022] GET /compute/v2.1/os-volumes/89cd21ef-4c82-4009-a5dc-7a9351ee48b8 => generated 353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:11:21.066818 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-94b947c5-a9a4-4c6e-aef0-7347a8353a98 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:21.067864 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-94b947c5-a9a4-4c6e-aef0-7347a8353a98 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:21.075429 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94b947c5-a9a4-4c6e-aef0-7347a8353a98 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:21.076143 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94b947c5-a9a4-4c6e-aef0-7347a8353a98 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:21.076757 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94b947c5-a9a4-4c6e-aef0-7347a8353a98 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:21.078479 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94b947c5-a9a4-4c6e-aef0-7347a8353a98 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:21.079339 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94b947c5-a9a4-4c6e-aef0-7347a8353a98 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:21.079937 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94b947c5-a9a4-4c6e-aef0-7347a8353a98 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:21.243769 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-94b947c5-a9a4-4c6e-aef0-7347a8353a98 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:21.254237 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-94b947c5-a9a4-4c6e-aef0-7347a8353a98 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1677 microversion: 2.1 time: 0.192186 Sep 10 12:11:21.271783 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2945/5898] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:11:21 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1677 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:11:21.302199 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-29c61512-fe0d-4ada-904d-f4cb51dc8397 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:21.302705 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-29c61512-fe0d-4ada-904d-f4cb51dc8397 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 13779716-4716-4ab0-8699-416f441eecea] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:21.313302 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-29c61512-fe0d-4ada-904d-f4cb51dc8397 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:21.314503 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-29c61512-fe0d-4ada-904d-f4cb51dc8397 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:21.315328 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-29c61512-fe0d-4ada-904d-f4cb51dc8397 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:21.316230 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-29c61512-fe0d-4ada-904d-f4cb51dc8397 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:21.316863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-29c61512-fe0d-4ada-904d-f4cb51dc8397 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:21.317485 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-29c61512-fe0d-4ada-904d-f4cb51dc8397 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:21.343882 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-29c61512-fe0d-4ada-904d-f4cb51dc8397 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea/ips" status: 200 len: 149 microversion: 2.1 time: 0.046231 Sep 10 12:11:21.352461 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2954/5899] 10.222.0.23 () {58 vars in 1248 bytes} [Sat Sep 10 12:11:21 2022] GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea/ips => generated 149 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:11:22.041440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f74635b9-8f18-4058-8568-5cfe9951cd76 tempest-VolumesGetTestJSON-114563570 tempest-VolumesGetTestJSON-114563570-project] Calling method '.version_select at 0x7f4071bdd670>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:22.159519 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f74635b9-8f18-4058-8568-5cfe9951cd76 tempest-VolumesGetTestJSON-114563570 tempest-VolumesGetTestJSON-114563570-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/89cd21ef-4c82-4009-a5dc-7a9351ee48b8" status: 200 len: 353 microversion: 2.1 time: 0.121898 Sep 10 12:11:22.166437 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2946/5900] 10.222.0.23 () {58 vars in 1245 bytes} [Sat Sep 10 12:11:22 2022] GET /compute/v2.1/os-volumes/89cd21ef-4c82-4009-a5dc-7a9351ee48b8 => generated 353 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:11:22.282248 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7d6c2fe5-547b-4cd5-a075-27d49439d0fd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:22.282770 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7d6c2fe5-547b-4cd5-a075-27d49439d0fd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:22.290649 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d6c2fe5-547b-4cd5-a075-27d49439d0fd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:22.291145 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d6c2fe5-547b-4cd5-a075-27d49439d0fd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:22.305446 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d6c2fe5-547b-4cd5-a075-27d49439d0fd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:22.305446 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d6c2fe5-547b-4cd5-a075-27d49439d0fd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:22.305446 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d6c2fe5-547b-4cd5-a075-27d49439d0fd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:22.305446 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d6c2fe5-547b-4cd5-a075-27d49439d0fd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:22.584794 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7d6c2fe5-547b-4cd5-a075-27d49439d0fd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:22.593480 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7d6c2fe5-547b-4cd5-a075-27d49439d0fd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1677 microversion: 2.1 time: 0.315780 Sep 10 12:11:22.595930 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2955/5901] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:11:22 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1677 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:11:23.173880 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-70dff6dd-3b8b-4fdf-8193-a827309a6934 tempest-VolumesGetTestJSON-114563570 tempest-VolumesGetTestJSON-114563570-project] Calling method '.version_select at 0x7f4071b76af0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:23.247087 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-70dff6dd-3b8b-4fdf-8193-a827309a6934 tempest-VolumesGetTestJSON-114563570 tempest-VolumesGetTestJSON-114563570-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/89cd21ef-4c82-4009-a5dc-7a9351ee48b8" status: 200 len: 353 microversion: 2.1 time: 0.070593 Sep 10 12:11:23.247816 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2947/5902] 10.222.0.23 () {58 vars in 1245 bytes} [Sat Sep 10 12:11:23 2022] GET /compute/v2.1/os-volumes/89cd21ef-4c82-4009-a5dc-7a9351ee48b8 => generated 353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:11:23.624927 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4b2e707e-f533-408a-a2b1-29aa11db8f84 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:23.625615 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4b2e707e-f533-408a-a2b1-29aa11db8f84 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:23.633296 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b2e707e-f533-408a-a2b1-29aa11db8f84 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:23.634206 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b2e707e-f533-408a-a2b1-29aa11db8f84 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:23.634869 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b2e707e-f533-408a-a2b1-29aa11db8f84 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:23.635989 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b2e707e-f533-408a-a2b1-29aa11db8f84 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:23.636382 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b2e707e-f533-408a-a2b1-29aa11db8f84 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:23.636911 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b2e707e-f533-408a-a2b1-29aa11db8f84 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:23.788383 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4b2e707e-f533-408a-a2b1-29aa11db8f84 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:23.797342 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4b2e707e-f533-408a-a2b1-29aa11db8f84 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1677 microversion: 2.1 time: 0.177923 Sep 10 12:11:23.799348 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2956/5903] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:11:23 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:11:23.948803 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2032b915-2bc9-41af-97c6-2ac0d055ebfc tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d6be66b-6e8d-46fd-96ba-a5dffd7fe91d"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:11:23.952185 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2032b915-2bc9-41af-97c6-2ac0d055ebfc tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 13779716-4716-4ab0-8699-416f441eecea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:23.959779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=26 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:11:23.959779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2032b915-2bc9-41af-97c6-2ac0d055ebfc tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:23.960251 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2032b915-2bc9-41af-97c6-2ac0d055ebfc tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:23.960697 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2032b915-2bc9-41af-97c6-2ac0d055ebfc tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:23.961404 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2032b915-2bc9-41af-97c6-2ac0d055ebfc tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:23.961855 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2032b915-2bc9-41af-97c6-2ac0d055ebfc tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:23.962277 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2032b915-2bc9-41af-97c6-2ac0d055ebfc tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:24.262559 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d5a46eb1-1248-4232-9437-573b0a36f1dc tempest-VolumesGetTestJSON-114563570 tempest-VolumesGetTestJSON-114563570-project] Calling method '.version_select at 0x7f4072e6c430>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:24.309419 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-d5a46eb1-1248-4232-9437-573b0a36f1dc tempest-VolumesGetTestJSON-114563570 tempest-VolumesGetTestJSON-114563570-project] HTTP exception thrown: Volume 89cd21ef-4c82-4009-a5dc-7a9351ee48b8 could not be found. Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d5a46eb1-1248-4232-9437-573b0a36f1dc tempest-VolumesGetTestJSON-114563570 tempest-VolumesGetTestJSON-114563570-project] Request method failure captured: Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/os-volumes/89cd21ef-4c82-4009-a5dc-7a9351ee48b8 HTTP/1.1 Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH7myg-gWytq-cP47LcSHxzsPqA1MLWlZx2BNoo_AhJEqIoDt_9YUl0RsNo8tZBIuGCHNoDFJd9rvrmtliH83P0Np5Bpeq2GnRsEeZ8b0aDCWl3gRf8GaSayydieUjWhhA7BkzJBu0Xs-RoDySv-dVTm701Ewf2jfmlwne3AsqUmhZE Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: b9c957f28c684a31addabf49ed18cc4c Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-VolumesGetTestJSON-114563570 Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b9c957f28c684a31addabf49ed18cc4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b9c957f28c684a31addabf49ed18cc4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b9c957f28c684a31addabf49ed18cc4c", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b9c957f28c684a31addabf49ed18cc4c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-VolumesGetTestJSON-114563570 Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: b9c957f28c684a31addabf49ed18cc4c Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-VolumesGetTestJSON-114563570 Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-VolumesGetTestJSON-114563570-project Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 99449a92fb524982910dec0157f4bdd5 Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-VolumesGetTestJSON-114563570-project Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: method: Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: exception: Volume 89cd21ef-4c82-4009-a5dc-7a9351ee48b8 could not be found. Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '89cd21ef-4c82-4009-a5dc-7a9351ee48b8'} Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 89cd21ef-4c82-4009-a5dc-7a9351ee48b8 could not be found. (HTTP 404) (Request-ID: req-dbe0a489-1dbf-48ce-b8f7-c0c29210d98d) Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 10 12:11:24.313274 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 10 12:11:24.317356 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 10 12:11:24.317356 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 10 12:11:24.317356 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 10 12:11:24.317356 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 10 12:11:24.317356 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 10 12:11:24.317356 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 10 12:11:24.317356 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 10 12:11:24.317356 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 10 12:11:24.317356 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 10 12:11:24.317356 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 10 12:11:24.317356 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 10 12:11:24.317356 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 10 12:11:24.317356 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 10 12:11:24.317356 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 89cd21ef-4c82-4009-a5dc-7a9351ee48b8 could not be found. Sep 10 12:11:24.317356 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:11:24.317356 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:11:24.317356 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:11:24.317356 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:11:24.317356 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:11:24.317356 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:11:24.317356 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:11:24.317356 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:11:24.317356 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 10 12:11:24.317356 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 10 12:11:24.317356 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:11:24.317356 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:11:24.317356 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 10 12:11:24.317356 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:11:24.317356 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 89cd21ef-4c82-4009-a5dc-7a9351ee48b8 could not be found. Sep 10 12:11:24.317356 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:11:24.317356 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:11:24.317356 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:11:24.317356 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:11:24.317356 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:11:24.317356 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:11:24.317356 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:11:24.317356 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:11:24.317356 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 89cd21ef-4c82-4009-a5dc-7a9351ee48b8 could not be found. Sep 10 12:11:24.317356 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:11:24.329749 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2032b915-2bc9-41af-97c6-2ac0d055ebfc tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "POST /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.375577 Sep 10 12:11:24.329749 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2948/5904] 10.222.0.23 () {60 vars in 1323 bytes} [Sat Sep 10 12:11:23 2022] POST /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea/os-volume_attachments => generated 194 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:11:24.331515 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d5a46eb1-1248-4232-9437-573b0a36f1dc tempest-VolumesGetTestJSON-114563570 tempest-VolumesGetTestJSON-114563570-project] Returning 404 to user: Volume 89cd21ef-4c82-4009-a5dc-7a9351ee48b8 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:11:24.332739 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d5a46eb1-1248-4232-9437-573b0a36f1dc tempest-VolumesGetTestJSON-114563570 tempest-VolumesGetTestJSON-114563570-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/89cd21ef-4c82-4009-a5dc-7a9351ee48b8" status: 404 len: 109 microversion: 2.1 time: 0.074712 Sep 10 12:11:24.337412 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2957/5905] 10.222.0.23 () {58 vars in 1245 bytes} [Sat Sep 10 12:11:24 2022] GET /compute/v2.1/os-volumes/89cd21ef-4c82-4009-a5dc-7a9351ee48b8 => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:11:24.824932 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-23d45fe6-9fcf-4ab9-bb72-5d816fa0629a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:24.826057 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-23d45fe6-9fcf-4ab9-bb72-5d816fa0629a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:24.834956 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-23d45fe6-9fcf-4ab9-bb72-5d816fa0629a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:24.839429 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-23d45fe6-9fcf-4ab9-bb72-5d816fa0629a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:24.840883 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-23d45fe6-9fcf-4ab9-bb72-5d816fa0629a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:24.844531 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-23d45fe6-9fcf-4ab9-bb72-5d816fa0629a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:24.846160 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-23d45fe6-9fcf-4ab9-bb72-5d816fa0629a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:24.846829 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-23d45fe6-9fcf-4ab9-bb72-5d816fa0629a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:25.079778 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-23d45fe6-9fcf-4ab9-bb72-5d816fa0629a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:25.093712 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-23d45fe6-9fcf-4ab9-bb72-5d816fa0629a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1677 microversion: 2.1 time: 0.272304 Sep 10 12:11:25.094612 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2949/5906] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:11:24 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1677 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:11:26.125074 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3b435cb0-193a-49df-a758-6c785a84abe7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:26.125707 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3b435cb0-193a-49df-a758-6c785a84abe7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:26.145934 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3b435cb0-193a-49df-a758-6c785a84abe7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:26.146443 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3b435cb0-193a-49df-a758-6c785a84abe7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:26.146896 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3b435cb0-193a-49df-a758-6c785a84abe7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:26.151295 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3b435cb0-193a-49df-a758-6c785a84abe7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:26.151913 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3b435cb0-193a-49df-a758-6c785a84abe7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:26.152369 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3b435cb0-193a-49df-a758-6c785a84abe7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:26.161404 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:11:26.364884 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3b435cb0-193a-49df-a758-6c785a84abe7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:26.377934 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3b435cb0-193a-49df-a758-6c785a84abe7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1677 microversion: 2.1 time: 0.260882 Sep 10 12:11:26.388040 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2958/5907] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:11:26 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1677 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:11:27.403727 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c726bf81-843c-434e-887e-a97451cf5311 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:27.405247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c726bf81-843c-434e-887e-a97451cf5311 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:27.413362 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c726bf81-843c-434e-887e-a97451cf5311 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:27.414429 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c726bf81-843c-434e-887e-a97451cf5311 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:27.415532 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c726bf81-843c-434e-887e-a97451cf5311 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:27.416413 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c726bf81-843c-434e-887e-a97451cf5311 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:27.417036 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c726bf81-843c-434e-887e-a97451cf5311 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:27.417626 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c726bf81-843c-434e-887e-a97451cf5311 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:27.450944 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:11:27.679437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c726bf81-843c-434e-887e-a97451cf5311 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:27.689037 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c726bf81-843c-434e-887e-a97451cf5311 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1677 microversion: 2.1 time: 0.289457 Sep 10 12:11:27.690206 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2950/5908] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:11:27 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1677 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:11:28.717405 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a4f43bac-d30e-48ee-8fac-d91cdecc8e02 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:28.718676 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a4f43bac-d30e-48ee-8fac-d91cdecc8e02 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:28.760852 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a4f43bac-d30e-48ee-8fac-d91cdecc8e02 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:28.790030 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a4f43bac-d30e-48ee-8fac-d91cdecc8e02 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:28.790531 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a4f43bac-d30e-48ee-8fac-d91cdecc8e02 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:28.791370 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a4f43bac-d30e-48ee-8fac-d91cdecc8e02 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:28.792037 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a4f43bac-d30e-48ee-8fac-d91cdecc8e02 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:28.792672 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a4f43bac-d30e-48ee-8fac-d91cdecc8e02 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:29.081554 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a4f43bac-d30e-48ee-8fac-d91cdecc8e02 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:29.094334 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a4f43bac-d30e-48ee-8fac-d91cdecc8e02 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1677 microversion: 2.1 time: 0.381870 Sep 10 12:11:29.115611 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2959/5909] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:11:28 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1677 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:11:30.121731 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-db64af52-68a2-4b39-9f7a-e46f4a43b86e tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:30.123140 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-db64af52-68a2-4b39-9f7a-e46f4a43b86e tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:30.142438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db64af52-68a2-4b39-9f7a-e46f4a43b86e tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:30.143594 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db64af52-68a2-4b39-9f7a-e46f4a43b86e tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:30.144144 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db64af52-68a2-4b39-9f7a-e46f4a43b86e tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:30.144732 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db64af52-68a2-4b39-9f7a-e46f4a43b86e tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:30.145222 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db64af52-68a2-4b39-9f7a-e46f4a43b86e tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:30.145604 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db64af52-68a2-4b39-9f7a-e46f4a43b86e tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:30.394546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-db64af52-68a2-4b39-9f7a-e46f4a43b86e tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:30.402641 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-db64af52-68a2-4b39-9f7a-e46f4a43b86e tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1677 microversion: 2.1 time: 0.286087 Sep 10 12:11:30.415740 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2951/5910] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:11:30 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1677 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:11:31.428640 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d7682737-2c66-4a77-9e68-91ff38c56a00 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:31.429948 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d7682737-2c66-4a77-9e68-91ff38c56a00 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:31.439020 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:11:31.440998 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d7682737-2c66-4a77-9e68-91ff38c56a00 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:31.442572 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d7682737-2c66-4a77-9e68-91ff38c56a00 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:31.443539 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d7682737-2c66-4a77-9e68-91ff38c56a00 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:31.444445 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d7682737-2c66-4a77-9e68-91ff38c56a00 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:31.445517 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d7682737-2c66-4a77-9e68-91ff38c56a00 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:31.446144 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d7682737-2c66-4a77-9e68-91ff38c56a00 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:31.706545 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d7682737-2c66-4a77-9e68-91ff38c56a00 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:31.719142 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d7682737-2c66-4a77-9e68-91ff38c56a00 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1677 microversion: 2.1 time: 0.295241 Sep 10 12:11:31.733957 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2960/5911] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:11:31 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1677 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:11:32.745339 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1ce669f9-9753-49c6-874b-84156da670ef tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:32.745960 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1ce669f9-9753-49c6-874b-84156da670ef tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:32.758209 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ce669f9-9753-49c6-874b-84156da670ef tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:32.758700 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ce669f9-9753-49c6-874b-84156da670ef tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:32.759320 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ce669f9-9753-49c6-874b-84156da670ef tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:32.759857 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ce669f9-9753-49c6-874b-84156da670ef tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:32.760320 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ce669f9-9753-49c6-874b-84156da670ef tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:32.760748 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ce669f9-9753-49c6-874b-84156da670ef tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:32.913279 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1ce669f9-9753-49c6-874b-84156da670ef tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:32.922903 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1ce669f9-9753-49c6-874b-84156da670ef tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1677 microversion: 2.1 time: 0.181401 Sep 10 12:11:32.923813 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2952/5912] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:11:32 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1677 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:11:33.947550 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-92e6be34-f261-4cc2-bff8-24f4f2d43546 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:33.949120 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-92e6be34-f261-4cc2-bff8-24f4f2d43546 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:33.958390 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-92e6be34-f261-4cc2-bff8-24f4f2d43546 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:33.959402 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-92e6be34-f261-4cc2-bff8-24f4f2d43546 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:33.960276 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-92e6be34-f261-4cc2-bff8-24f4f2d43546 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:33.963155 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-92e6be34-f261-4cc2-bff8-24f4f2d43546 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:33.963898 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-92e6be34-f261-4cc2-bff8-24f4f2d43546 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:33.964535 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-92e6be34-f261-4cc2-bff8-24f4f2d43546 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:34.169119 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-92e6be34-f261-4cc2-bff8-24f4f2d43546 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:34.178153 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-92e6be34-f261-4cc2-bff8-24f4f2d43546 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1677 microversion: 2.1 time: 0.234548 Sep 10 12:11:34.179097 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2961/5913] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:11:33 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1677 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:11:35.203233 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-28d8d11b-1ae0-40d6-b72d-f3966ae2abf3 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:35.204050 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-28d8d11b-1ae0-40d6-b72d-f3966ae2abf3 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:35.213387 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28d8d11b-1ae0-40d6-b72d-f3966ae2abf3 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:35.214096 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28d8d11b-1ae0-40d6-b72d-f3966ae2abf3 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:35.214676 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28d8d11b-1ae0-40d6-b72d-f3966ae2abf3 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:35.215759 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28d8d11b-1ae0-40d6-b72d-f3966ae2abf3 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:35.216392 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28d8d11b-1ae0-40d6-b72d-f3966ae2abf3 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:35.217011 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28d8d11b-1ae0-40d6-b72d-f3966ae2abf3 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:35.460281 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-28d8d11b-1ae0-40d6-b72d-f3966ae2abf3 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:35.469915 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-28d8d11b-1ae0-40d6-b72d-f3966ae2abf3 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1677 microversion: 2.1 time: 0.271855 Sep 10 12:11:35.481727 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2953/5914] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:11:35 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1677 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:11:36.494068 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-68ce3a48-1dec-49d5-9f9f-e848fcff11a6 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:36.494693 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-68ce3a48-1dec-49d5-9f9f-e848fcff11a6 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:36.502861 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-68ce3a48-1dec-49d5-9f9f-e848fcff11a6 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:36.503650 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-68ce3a48-1dec-49d5-9f9f-e848fcff11a6 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:36.504329 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-68ce3a48-1dec-49d5-9f9f-e848fcff11a6 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:36.505516 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-68ce3a48-1dec-49d5-9f9f-e848fcff11a6 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:36.506050 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-68ce3a48-1dec-49d5-9f9f-e848fcff11a6 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:36.506557 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-68ce3a48-1dec-49d5-9f9f-e848fcff11a6 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:36.684410 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-68ce3a48-1dec-49d5-9f9f-e848fcff11a6 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:36.695612 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-68ce3a48-1dec-49d5-9f9f-e848fcff11a6 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1654 microversion: 2.1 time: 0.205371 Sep 10 12:11:36.713657 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2962/5915] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:11:36 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1654 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:11:36.723322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-48a731a4-eeee-4798-92d6-705604fda9b7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:11:36.732321 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48a731a4-eeee-4798-92d6-705604fda9b7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:36.733767 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48a731a4-eeee-4798-92d6-705604fda9b7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:36.734590 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48a731a4-eeee-4798-92d6-705604fda9b7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:36.767295 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-48a731a4-eeee-4798-92d6-705604fda9b7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Going to try to start instance {{(pid=128777) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 10 12:11:36.831244 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-48a731a4-eeee-4798-92d6-705604fda9b7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "POST /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9/action" status: 202 len: 0 microversion: 2.1 time: 0.115241 Sep 10 12:11:36.835503 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2954/5916] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:11:36 2022] POST /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:11:36.843048 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b69bd041-0b62-45d8-b97c-62b09f9f0870 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:36.844907 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b69bd041-0b62-45d8-b97c-62b09f9f0870 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:36.857469 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b69bd041-0b62-45d8-b97c-62b09f9f0870 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:36.859108 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b69bd041-0b62-45d8-b97c-62b09f9f0870 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:36.859853 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b69bd041-0b62-45d8-b97c-62b09f9f0870 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:36.861715 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b69bd041-0b62-45d8-b97c-62b09f9f0870 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:36.862439 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b69bd041-0b62-45d8-b97c-62b09f9f0870 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:36.863086 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b69bd041-0b62-45d8-b97c-62b09f9f0870 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:37.382474 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b69bd041-0b62-45d8-b97c-62b09f9f0870 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:37.396704 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b69bd041-0b62-45d8-b97c-62b09f9f0870 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1663 microversion: 2.1 time: 0.559549 Sep 10 12:11:37.411923 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2963/5917] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:11:36 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1663 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:11:37.660213 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9846bce0-6aa2-4456-ad17-ec277d2ab0ed tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d6be66b-6e8d-46fd-96ba-a5dffd7fe91d"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:11:37.663665 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9846bce0-6aa2-4456-ad17-ec277d2ab0ed tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 13779716-4716-4ab0-8699-416f441eecea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:37.675938 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9846bce0-6aa2-4456-ad17-ec277d2ab0ed tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:37.676737 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9846bce0-6aa2-4456-ad17-ec277d2ab0ed tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:37.678014 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9846bce0-6aa2-4456-ad17-ec277d2ab0ed tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:37.678940 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9846bce0-6aa2-4456-ad17-ec277d2ab0ed tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:37.679748 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9846bce0-6aa2-4456-ad17-ec277d2ab0ed tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:37.680413 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9846bce0-6aa2-4456-ad17-ec277d2ab0ed tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:37.839201 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-9846bce0-6aa2-4456-ad17-ec277d2ab0ed tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] HTTP exception thrown: Invalid volume: volume 0d6be66b-6e8d-46fd-96ba-a5dffd7fe91d is already attached to instances: 13779716-4716-4ab0-8699-416f441eecea Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9846bce0-6aa2-4456-ad17-ec277d2ab0ed tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Request method failure captured: Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea/os-volume_attachments HTTP/1.1 Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 74 Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH3f6GUP-vcGJKgYs9rYAE6OawiTmJHgZl9vlhfSbv7R_wFrnAHrNyTqDc0RuEPZi57XGfLqPVxCZc47_xRjBpcGZLWUDdhEHCEh6mtOoaNkeHxMKPICZdCuDCfpAFF9D9M9RMYBjoFdk7vZER1xOY4aTKlTJ8XZrlR1gs_K7sdx9WY Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 03301ecc81fe426bafc4be81413d1265 Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-AttachVolumeNegativeTest-637078285 Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/03301ecc81fe426bafc4be81413d1265"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/03301ecc81fe426bafc4be81413d1265"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_03301ecc81fe426bafc4be81413d1265", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/03301ecc81fe426bafc4be81413d1265"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-AttachVolumeNegativeTest-637078285 Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 03301ecc81fe426bafc4be81413d1265 Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-637078285 Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-AttachVolumeNegativeTest-637078285-project Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 199d923de84c45789188543de904314a Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-AttachVolumeNegativeTest-637078285-project Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: {"volumeAttachment": {"volumeId": "0d6be66b-6e8d-46fd-96ba-a5dffd7fe91d"}} Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: exception: Invalid volume: volume 0d6be66b-6e8d-46fd-96ba-a5dffd7fe91d is already attached to instances: 13779716-4716-4ab0-8699-416f441eecea Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'server_id': '13779716-4716-4ab0-8699-416f441eecea', 'body': {'volumeAttachment': {'volumeId': '0d6be66b-6e8d-46fd-96ba-a5dffd7fe91d'}}} Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0d6be66b-6e8d-46fd-96ba-a5dffd7fe91d is already attached to instances: 13779716-4716-4ab0-8699-416f441eecea Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:11:37.840934 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:11:37.845516 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:11:37.845516 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:11:37.845516 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 10 12:11:37.845516 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 10 12:11:37.845516 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0d6be66b-6e8d-46fd-96ba-a5dffd7fe91d is already attached to instances: 13779716-4716-4ab0-8699-416f441eecea Sep 10 12:11:37.845516 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:11:37.845516 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:11:37.845516 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:11:37.845516 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:11:37.845516 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:11:37.845516 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:11:37.845516 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:11:37.845516 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:11:37.845516 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0d6be66b-6e8d-46fd-96ba-a5dffd7fe91d is already attached to instances: 13779716-4716-4ab0-8699-416f441eecea Sep 10 12:11:37.845516 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:11:37.845516 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9846bce0-6aa2-4456-ad17-ec277d2ab0ed tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Returning 400 to user: Invalid volume: volume 0d6be66b-6e8d-46fd-96ba-a5dffd7fe91d is already attached to instances: 13779716-4716-4ab0-8699-416f441eecea {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:11:37.845516 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9846bce0-6aa2-4456-ad17-ec277d2ab0ed tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "POST /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.188748 Sep 10 12:11:37.845516 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2955/5918] 10.222.0.23 () {60 vars in 1323 bytes} [Sat Sep 10 12:11:37 2022] POST /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea/os-volume_attachments => generated 174 bytes in 190 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 10 12:11:37.958116 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-255cbe53-3f86-4c7b-8534-31f5b0971d43 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:37.959137 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-255cbe53-3f86-4c7b-8534-31f5b0971d43 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 13779716-4716-4ab0-8699-416f441eecea] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:37.974099 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-255cbe53-3f86-4c7b-8534-31f5b0971d43 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:37.974956 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-255cbe53-3f86-4c7b-8534-31f5b0971d43 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:37.975783 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-255cbe53-3f86-4c7b-8534-31f5b0971d43 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:37.978832 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-255cbe53-3f86-4c7b-8534-31f5b0971d43 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:37.979504 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-255cbe53-3f86-4c7b-8534-31f5b0971d43 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:37.980456 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-255cbe53-3f86-4c7b-8534-31f5b0971d43 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:38.157974 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-255cbe53-3f86-4c7b-8534-31f5b0971d43 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lazy-loading 'services' on Instance uuid 13779716-4716-4ab0-8699-416f441eecea {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:11:38.281669 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-255cbe53-3f86-4c7b-8534-31f5b0971d43 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "DELETE /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea/os-volume_attachments/0d6be66b-6e8d-46fd-96ba-a5dffd7fe91d" status: 202 len: 0 microversion: 2.1 time: 0.334163 Sep 10 12:11:38.286029 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2964/5919] 10.222.0.23 () {58 vars in 1416 bytes} [Sat Sep 10 12:11:37 2022] DELETE /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea/os-volume_attachments/0d6be66b-6e8d-46fd-96ba-a5dffd7fe91d => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:11:38.290760 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-44ca5ede-4ab1-409d-9083-9df66f88338b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:38.293238 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-44ca5ede-4ab1-409d-9083-9df66f88338b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 13779716-4716-4ab0-8699-416f441eecea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:38.302102 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-44ca5ede-4ab1-409d-9083-9df66f88338b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:38.302865 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-44ca5ede-4ab1-409d-9083-9df66f88338b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:38.304746 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-44ca5ede-4ab1-409d-9083-9df66f88338b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:38.305798 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-44ca5ede-4ab1-409d-9083-9df66f88338b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:38.306424 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-44ca5ede-4ab1-409d-9083-9df66f88338b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:38.307012 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-44ca5ede-4ab1-409d-9083-9df66f88338b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:38.368434 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-44ca5ede-4ab1-409d-9083-9df66f88338b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081652 Sep 10 12:11:38.369742 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2956/5920] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:11:38 2022] GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:11:38.424255 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2c46387b-e27c-4a21-88eb-b9172dd21fdd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:38.425154 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2c46387b-e27c-4a21-88eb-b9172dd21fdd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:38.440031 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2c46387b-e27c-4a21-88eb-b9172dd21fdd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:38.440537 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2c46387b-e27c-4a21-88eb-b9172dd21fdd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:38.441181 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2c46387b-e27c-4a21-88eb-b9172dd21fdd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:38.442053 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2c46387b-e27c-4a21-88eb-b9172dd21fdd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:38.442518 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2c46387b-e27c-4a21-88eb-b9172dd21fdd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:38.442948 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2c46387b-e27c-4a21-88eb-b9172dd21fdd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:38.660541 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2c46387b-e27c-4a21-88eb-b9172dd21fdd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:38.669994 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2c46387b-e27c-4a21-88eb-b9172dd21fdd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1663 microversion: 2.1 time: 0.251581 Sep 10 12:11:38.688352 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2965/5921] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:11:38 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1663 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:11:39.382927 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8b20e908-740a-46ce-9a74-2c5eb51a28b0 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:39.386329 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8b20e908-740a-46ce-9a74-2c5eb51a28b0 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 13779716-4716-4ab0-8699-416f441eecea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:39.400397 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b20e908-740a-46ce-9a74-2c5eb51a28b0 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:39.400825 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b20e908-740a-46ce-9a74-2c5eb51a28b0 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:39.408205 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b20e908-740a-46ce-9a74-2c5eb51a28b0 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:39.408362 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b20e908-740a-46ce-9a74-2c5eb51a28b0 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:39.408730 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b20e908-740a-46ce-9a74-2c5eb51a28b0 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:39.409168 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b20e908-740a-46ce-9a74-2c5eb51a28b0 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:39.458927 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8b20e908-740a-46ce-9a74-2c5eb51a28b0 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080822 Sep 10 12:11:39.464010 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2957/5922] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:11:39 2022] GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:11:39.700250 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-60043959-d78d-4187-b71d-3fb115db9ad9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:39.701570 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-60043959-d78d-4187-b71d-3fb115db9ad9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:39.712305 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60043959-d78d-4187-b71d-3fb115db9ad9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:39.715481 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60043959-d78d-4187-b71d-3fb115db9ad9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:39.716092 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60043959-d78d-4187-b71d-3fb115db9ad9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:39.717971 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60043959-d78d-4187-b71d-3fb115db9ad9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:39.721247 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60043959-d78d-4187-b71d-3fb115db9ad9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:39.722026 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60043959-d78d-4187-b71d-3fb115db9ad9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:39.967063 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-60043959-d78d-4187-b71d-3fb115db9ad9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:39.978524 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-60043959-d78d-4187-b71d-3fb115db9ad9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1667 microversion: 2.1 time: 0.282430 Sep 10 12:11:39.980181 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2966/5923] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:11:39 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1667 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:11:40.471102 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f493b6f9-53e1-45d8-b826-bb971709d475 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:40.474125 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f493b6f9-53e1-45d8-b826-bb971709d475 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 13779716-4716-4ab0-8699-416f441eecea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:40.486687 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f493b6f9-53e1-45d8-b826-bb971709d475 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:40.491795 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f493b6f9-53e1-45d8-b826-bb971709d475 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:40.492604 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f493b6f9-53e1-45d8-b826-bb971709d475 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:40.495236 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f493b6f9-53e1-45d8-b826-bb971709d475 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:40.496305 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f493b6f9-53e1-45d8-b826-bb971709d475 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:40.497834 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f493b6f9-53e1-45d8-b826-bb971709d475 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:40.542388 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f493b6f9-53e1-45d8-b826-bb971709d475 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075628 Sep 10 12:11:40.543480 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2958/5924] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:11:40 2022] GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:11:41.554054 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a10abca7-7220-4133-a7ca-e1d242379ee3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:41.560331 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a10abca7-7220-4133-a7ca-e1d242379ee3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 13779716-4716-4ab0-8699-416f441eecea] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:41.587538 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a10abca7-7220-4133-a7ca-e1d242379ee3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:41.587538 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a10abca7-7220-4133-a7ca-e1d242379ee3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:41.587538 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a10abca7-7220-4133-a7ca-e1d242379ee3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:41.587538 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a10abca7-7220-4133-a7ca-e1d242379ee3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:41.587538 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a10abca7-7220-4133-a7ca-e1d242379ee3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:41.587538 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a10abca7-7220-4133-a7ca-e1d242379ee3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:41.644609 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a10abca7-7220-4133-a7ca-e1d242379ee3 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094504 Sep 10 12:11:41.645873 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2967/5925] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:11:41 2022] GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:11:42.660852 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-225a036f-9f45-4130-8f8a-ce83c3d6f4ab tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:42.666391 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-225a036f-9f45-4130-8f8a-ce83c3d6f4ab tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 13779716-4716-4ab0-8699-416f441eecea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:42.683962 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-225a036f-9f45-4130-8f8a-ce83c3d6f4ab tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:42.686837 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-225a036f-9f45-4130-8f8a-ce83c3d6f4ab tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:42.689194 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-225a036f-9f45-4130-8f8a-ce83c3d6f4ab tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:42.690255 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-225a036f-9f45-4130-8f8a-ce83c3d6f4ab tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:42.692018 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-225a036f-9f45-4130-8f8a-ce83c3d6f4ab tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:42.693900 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-225a036f-9f45-4130-8f8a-ce83c3d6f4ab tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:42.776148 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-225a036f-9f45-4130-8f8a-ce83c3d6f4ab tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119585 Sep 10 12:11:42.780403 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2959/5926] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:11:42 2022] GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:11:43.790347 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4ba216ae-7f2c-43a8-bd9e-e46b8846549a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:43.793302 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4ba216ae-7f2c-43a8-bd9e-e46b8846549a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 13779716-4716-4ab0-8699-416f441eecea] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:43.805004 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ba216ae-7f2c-43a8-bd9e-e46b8846549a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:43.805935 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ba216ae-7f2c-43a8-bd9e-e46b8846549a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:43.809585 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ba216ae-7f2c-43a8-bd9e-e46b8846549a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:43.811687 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ba216ae-7f2c-43a8-bd9e-e46b8846549a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:43.813768 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ba216ae-7f2c-43a8-bd9e-e46b8846549a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:43.814401 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ba216ae-7f2c-43a8-bd9e-e46b8846549a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:43.864075 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4ba216ae-7f2c-43a8-bd9e-e46b8846549a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078005 Sep 10 12:11:43.865126 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2968/5927] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:11:43 2022] GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:11:44.878369 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-149e957c-a4b4-4a4d-bc41-93c98159eb10 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:44.883185 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-149e957c-a4b4-4a4d-bc41-93c98159eb10 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 13779716-4716-4ab0-8699-416f441eecea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:44.891613 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-149e957c-a4b4-4a4d-bc41-93c98159eb10 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:44.892366 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-149e957c-a4b4-4a4d-bc41-93c98159eb10 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:44.893020 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-149e957c-a4b4-4a4d-bc41-93c98159eb10 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:44.893913 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-149e957c-a4b4-4a4d-bc41-93c98159eb10 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:44.894559 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-149e957c-a4b4-4a4d-bc41-93c98159eb10 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:44.895451 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-149e957c-a4b4-4a4d-bc41-93c98159eb10 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:44.928991 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-149e957c-a4b4-4a4d-bc41-93c98159eb10 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055512 Sep 10 12:11:44.930234 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2960/5928] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:11:44 2022] GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 12:11:45.044184 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-30db9756-6059-4f22-97b9-ea5a7e4cd959 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:45.045350 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-30db9756-6059-4f22-97b9-ea5a7e4cd959 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 13779716-4716-4ab0-8699-416f441eecea] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:45.053149 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-30db9756-6059-4f22-97b9-ea5a7e4cd959 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:45.053903 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-30db9756-6059-4f22-97b9-ea5a7e4cd959 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:45.054540 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-30db9756-6059-4f22-97b9-ea5a7e4cd959 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:45.056117 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-30db9756-6059-4f22-97b9-ea5a7e4cd959 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:45.056913 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-30db9756-6059-4f22-97b9-ea5a7e4cd959 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:45.057522 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-30db9756-6059-4f22-97b9-ea5a7e4cd959 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:45.090496 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-30db9756-6059-4f22-97b9-ea5a7e4cd959 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 13779716-4716-4ab0-8699-416f441eecea] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:11:45.209206 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-30db9756-6059-4f22-97b9-ea5a7e4cd959 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "DELETE /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea" status: 204 len: 0 microversion: 2.1 time: 0.168981 Sep 10 12:11:45.209791 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2969/5929] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:11:45 2022] DELETE /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:11:45.223739 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-16c73426-5a29-453d-9a17-736b51a6b135 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:45.224352 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-16c73426-5a29-453d-9a17-736b51a6b135 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 13779716-4716-4ab0-8699-416f441eecea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:45.230397 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-16c73426-5a29-453d-9a17-736b51a6b135 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:45.233901 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-16c73426-5a29-453d-9a17-736b51a6b135 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:45.234451 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-16c73426-5a29-453d-9a17-736b51a6b135 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:45.235174 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-16c73426-5a29-453d-9a17-736b51a6b135 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:45.235640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-16c73426-5a29-453d-9a17-736b51a6b135 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:45.236067 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-16c73426-5a29-453d-9a17-736b51a6b135 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:45.446683 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-16c73426-5a29-453d-9a17-736b51a6b135 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:45.461653 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-16c73426-5a29-453d-9a17-736b51a6b135 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea" status: 200 len: 1682 microversion: 2.1 time: 0.241635 Sep 10 12:11:45.462753 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2961/5930] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:11:45 2022] GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea => generated 1682 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:11:46.487736 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a2da22e3-14ff-4a15-a3db-6cf13ec075ac tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:46.488406 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a2da22e3-14ff-4a15-a3db-6cf13ec075ac tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 13779716-4716-4ab0-8699-416f441eecea] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:46.496637 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2da22e3-14ff-4a15-a3db-6cf13ec075ac tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:46.497244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2da22e3-14ff-4a15-a3db-6cf13ec075ac tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:46.497694 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2da22e3-14ff-4a15-a3db-6cf13ec075ac tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:46.499437 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2da22e3-14ff-4a15-a3db-6cf13ec075ac tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:46.500083 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2da22e3-14ff-4a15-a3db-6cf13ec075ac tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:46.500689 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2da22e3-14ff-4a15-a3db-6cf13ec075ac tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:46.763363 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a2da22e3-14ff-4a15-a3db-6cf13ec075ac tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:46.771926 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a2da22e3-14ff-4a15-a3db-6cf13ec075ac tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea" status: 200 len: 1682 microversion: 2.1 time: 0.289242 Sep 10 12:11:46.773090 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2970/5931] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:11:46 2022] GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea => generated 1682 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:11:47.799047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8fcaad13-e344-4f30-a849-3fd5394f90a2 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:47.800401 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8fcaad13-e344-4f30-a849-3fd5394f90a2 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 13779716-4716-4ab0-8699-416f441eecea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:47.808703 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8fcaad13-e344-4f30-a849-3fd5394f90a2 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:47.809450 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8fcaad13-e344-4f30-a849-3fd5394f90a2 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:47.810086 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8fcaad13-e344-4f30-a849-3fd5394f90a2 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:47.811887 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8fcaad13-e344-4f30-a849-3fd5394f90a2 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:47.812528 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8fcaad13-e344-4f30-a849-3fd5394f90a2 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:47.813262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8fcaad13-e344-4f30-a849-3fd5394f90a2 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:48.158539 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8fcaad13-e344-4f30-a849-3fd5394f90a2 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:48.177604 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8fcaad13-e344-4f30-a849-3fd5394f90a2 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea" status: 200 len: 1682 microversion: 2.1 time: 0.383039 Sep 10 12:11:48.196274 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2962/5932] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:11:47 2022] GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea => generated 1682 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:11:49.202228 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-78175a31-0dbc-4028-8b3f-d1b39a91f17a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:49.202903 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-78175a31-0dbc-4028-8b3f-d1b39a91f17a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 13779716-4716-4ab0-8699-416f441eecea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:49.221277 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78175a31-0dbc-4028-8b3f-d1b39a91f17a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:49.245114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78175a31-0dbc-4028-8b3f-d1b39a91f17a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:49.250995 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78175a31-0dbc-4028-8b3f-d1b39a91f17a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:49.260303 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78175a31-0dbc-4028-8b3f-d1b39a91f17a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:49.262936 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78175a31-0dbc-4028-8b3f-d1b39a91f17a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:49.266977 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78175a31-0dbc-4028-8b3f-d1b39a91f17a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:49.424222 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78175a31-0dbc-4028-8b3f-d1b39a91f17a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:49.425915 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78175a31-0dbc-4028-8b3f-d1b39a91f17a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:49.426381 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78175a31-0dbc-4028-8b3f-d1b39a91f17a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:49.430366 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-78175a31-0dbc-4028-8b3f-d1b39a91f17a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lazy-loading 'fault' on Instance uuid 13779716-4716-4ab0-8699-416f441eecea {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:11:49.470776 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-d69a9d10-6656-4c19-a64d-4ce128cd41d6 req-4431dca2-1524-47cd-a44e-932376a05f21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13779716-4716-4ab0-8699-416f441eecea", "name": "network-vif-deleted", "tag": "2808f936-b22f-44f6-83e8-ce7b20f58226"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:11:49.486512 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d69a9d10-6656-4c19-a64d-4ce128cd41d6 req-4431dca2-1524-47cd-a44e-932376a05f21 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:49.487441 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d69a9d10-6656-4c19-a64d-4ce128cd41d6 req-4431dca2-1524-47cd-a44e-932376a05f21 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:49.488164 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d69a9d10-6656-4c19-a64d-4ce128cd41d6 req-4431dca2-1524-47cd-a44e-932376a05f21 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:49.505815 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-d69a9d10-6656-4c19-a64d-4ce128cd41d6 req-4431dca2-1524-47cd-a44e-932376a05f21 service nova] Creating event network-vif-deleted:2808f936-b22f-44f6-83e8-ce7b20f58226 for instance 13779716-4716-4ab0-8699-416f441eecea on n-h1-856895-1 Sep 10 12:11:49.511131 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-d69a9d10-6656-4c19-a64d-4ce128cd41d6 req-4431dca2-1524-47cd-a44e-932376a05f21 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.538736 Sep 10 12:11:49.511987 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2971/5933] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:11:49.555218 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-78175a31-0dbc-4028-8b3f-d1b39a91f17a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:49.566363 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-78175a31-0dbc-4028-8b3f-d1b39a91f17a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea" status: 200 len: 1332 microversion: 2.1 time: 0.368086 Sep 10 12:11:49.579332 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2963/5934] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:11:49 2022] GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea => generated 1332 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:11:50.592730 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bc748440-4e1d-4dbc-98d3-c8d216e3c9fe tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:50.594192 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bc748440-4e1d-4dbc-98d3-c8d216e3c9fe tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 13779716-4716-4ab0-8699-416f441eecea] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:50.617518 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc748440-4e1d-4dbc-98d3-c8d216e3c9fe tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:50.622423 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc748440-4e1d-4dbc-98d3-c8d216e3c9fe tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:50.624014 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc748440-4e1d-4dbc-98d3-c8d216e3c9fe tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:50.625043 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc748440-4e1d-4dbc-98d3-c8d216e3c9fe tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:50.625763 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc748440-4e1d-4dbc-98d3-c8d216e3c9fe tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:50.627797 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc748440-4e1d-4dbc-98d3-c8d216e3c9fe tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:50.661089 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-bc748440-4e1d-4dbc-98d3-c8d216e3c9fe tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] HTTP exception thrown: Instance 13779716-4716-4ab0-8699-416f441eecea could not be found. Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bc748440-4e1d-4dbc-98d3-c8d216e3c9fe tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Request method failure captured: Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea HTTP/1.1 Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH3f6GUP-vcGJKgYs9rYAE6OawiTmJHgZl9vlhfSbv7R_wFrnAHrNyTqDc0RuEPZi57XGfLqPVxCZc47_xRjBpcGZLWUDdhEHCEh6mtOoaNkeHxMKPICZdCuDCfpAFF9D9M9RMYBjoFdk7vZER1xOY4aTKlTJ8XZrlR1gs_K7sdx9WY Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 03301ecc81fe426bafc4be81413d1265 Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-AttachVolumeNegativeTest-637078285 Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/03301ecc81fe426bafc4be81413d1265"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/03301ecc81fe426bafc4be81413d1265"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_03301ecc81fe426bafc4be81413d1265", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/03301ecc81fe426bafc4be81413d1265"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-AttachVolumeNegativeTest-637078285 Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 03301ecc81fe426bafc4be81413d1265 Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-637078285 Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-AttachVolumeNegativeTest-637078285-project Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 199d923de84c45789188543de904314a Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-AttachVolumeNegativeTest-637078285-project Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 13779716-4716-4ab0-8699-416f441eecea could not be found. Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '13779716-4716-4ab0-8699-416f441eecea'} Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13779716-4716-4ab0-8699-416f441eecea could not be found. Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13779716-4716-4ab0-8699-416f441eecea could not be found. Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:11:50.666949 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:11:50.673131 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:11:50.673131 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:11:50.673131 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:11:50.673131 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:11:50.673131 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:11:50.673131 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13779716-4716-4ab0-8699-416f441eecea could not be found. Sep 10 12:11:50.673131 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:11:50.673131 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bc748440-4e1d-4dbc-98d3-c8d216e3c9fe tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Returning 404 to user: Instance 13779716-4716-4ab0-8699-416f441eecea could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:11:50.679352 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bc748440-4e1d-4dbc-98d3-c8d216e3c9fe tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea" status: 404 len: 111 microversion: 2.1 time: 0.091825 Sep 10 12:11:50.684023 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2972/5935] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:11:50 2022] GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:11:50.690161 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3eff8895-19da-49ea-a311-a7f7729749dd tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '.version_select at 0x7f4071b91040>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:50.733568 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3eff8895-19da-49ea-a311-a7f7729749dd tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2103385494" status: 202 len: 0 microversion: 2.1 time: 0.047635 Sep 10 12:11:50.737963 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2964/5936] 10.222.0.23 () {58 vars in 1221 bytes} [Sat Sep 10 12:11:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2103385494 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:11:52.388443 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f232a6df-737c-4d42-9b0a-ce76cded9023 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Action: 'create', calling method: .version_select at 0x7f407357f160>, body: {"keypair": {"name": "tempest-keypair-1550188924", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8YGDsk2oVOLejQfZEUEkgD3NXBOsnpxI9BgkIoexbwXeKZPy393bj7/wirBWv6a9GfjtYwv1LKu9xvqqjfPnZX7NDMMh1VnxzRxkf0Toei5MGWmUm5+eA9BuJ4H5FzuA=="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:11:52.419634 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-f232a6df-737c-4d42-9b0a-ce76cded9023 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Getting quotas for project 03301ecc81fe426bafc4be81413d1265. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:11:52.426694 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-f232a6df-737c-4d42-9b0a-ce76cded9023 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Getting quotas for user 199d923de84c45789188543de904314a and project 03301ecc81fe426bafc4be81413d1265. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:11:52.458938 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f232a6df-737c-4d42-9b0a-ce76cded9023 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.075530 Sep 10 12:11:52.465659 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2973/5937] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 12:11:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:11:54.832466 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c7f26484-3835-446e-8c3a-9e1e2eb96524 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-472890288", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e2e68d89-2e9a-4de9-a725-df4c3e2e169e"}], "security_groups": [{"name": "tempest-securitygroup--1759103877"}], "key_name": "tempest-keypair-1550188924", "user_data": "}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:11:54.881113 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:11:54.995717 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-c7f26484-3835-446e-8c3a-9e1e2eb96524 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] validate_networks() for [('e2e68d89-2e9a-4de9-a725-df4c3e2e169e', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:11:55.754630 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-c7f26484-3835-446e-8c3a-9e1e2eb96524 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:11:55.755067 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-c7f26484-3835-446e-8c3a-9e1e2eb96524 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:11:55.755581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-c7f26484-3835-446e-8c3a-9e1e2eb96524 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:11:55.755997 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-c7f26484-3835-446e-8c3a-9e1e2eb96524 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:11:55.756417 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-c7f26484-3835-446e-8c3a-9e1e2eb96524 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:11:55.766879 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7f26484-3835-446e-8c3a-9e1e2eb96524 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:55.767423 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7f26484-3835-446e-8c3a-9e1e2eb96524 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:55.767907 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7f26484-3835-446e-8c3a-9e1e2eb96524 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:55.769248 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7f26484-3835-446e-8c3a-9e1e2eb96524 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:55.769746 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7f26484-3835-446e-8c3a-9e1e2eb96524 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:55.770247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7f26484-3835-446e-8c3a-9e1e2eb96524 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:55.794565 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-c7f26484-3835-446e-8c3a-9e1e2eb96524 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Getting quotas for project 03301ecc81fe426bafc4be81413d1265. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:11:55.801729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-c7f26484-3835-446e-8c3a-9e1e2eb96524 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Getting quotas for user 199d923de84c45789188543de904314a and project 03301ecc81fe426bafc4be81413d1265. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:11:55.818372 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c7f26484-3835-446e-8c3a-9e1e2eb96524 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:11:55.821185 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c7f26484-3835-446e-8c3a-9e1e2eb96524 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:11:55.880537 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c7f26484-3835-446e-8c3a-9e1e2eb96524 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.056018 Sep 10 12:11:55.882185 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2965/5938] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:11:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 1058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:11:56.193672 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cd503a1c-5514-4d1a-ab11-2689964d11ab tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:56.194173 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cd503a1c-5514-4d1a-ab11-2689964d11ab tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:56.647893 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-cd503a1c-5514-4d1a-ab11-2689964d11ab tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:56.658329 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cd503a1c-5514-4d1a-ab11-2689964d11ab tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32" status: 200 len: 1241 microversion: 2.1 time: 0.767364 Sep 10 12:11:56.659105 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2974/5939] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:11:55 2022] GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 => generated 1241 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:11:57.685777 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-58e95b09-ad75-40f0-9026-b65b90de63d2 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:57.686960 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-58e95b09-ad75-40f0-9026-b65b90de63d2 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:57.699338 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-58e95b09-ad75-40f0-9026-b65b90de63d2 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:57.701531 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-58e95b09-ad75-40f0-9026-b65b90de63d2 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:57.702184 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-58e95b09-ad75-40f0-9026-b65b90de63d2 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:57.703210 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-58e95b09-ad75-40f0-9026-b65b90de63d2 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:57.703897 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-58e95b09-ad75-40f0-9026-b65b90de63d2 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:57.705091 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-58e95b09-ad75-40f0-9026-b65b90de63d2 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:57.712953 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:11:57.856897 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-58e95b09-ad75-40f0-9026-b65b90de63d2 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:57.872137 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-58e95b09-ad75-40f0-9026-b65b90de63d2 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32" status: 200 len: 1299 microversion: 2.1 time: 0.192927 Sep 10 12:11:57.885256 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2966/5940] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:11:57 2022] GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 => generated 1299 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:11:58.914342 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5cdfc588-f70d-4ac5-b15a-e88aa3f657e5 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:11:58.915019 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5cdfc588-f70d-4ac5-b15a-e88aa3f657e5 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:11:58.923581 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5cdfc588-f70d-4ac5-b15a-e88aa3f657e5 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:58.924080 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5cdfc588-f70d-4ac5-b15a-e88aa3f657e5 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:58.924512 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5cdfc588-f70d-4ac5-b15a-e88aa3f657e5 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:58.925364 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5cdfc588-f70d-4ac5-b15a-e88aa3f657e5 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:11:58.925828 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5cdfc588-f70d-4ac5-b15a-e88aa3f657e5 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:11:58.926263 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5cdfc588-f70d-4ac5-b15a-e88aa3f657e5 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:11:58.929907 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:11:59.479388 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5cdfc588-f70d-4ac5-b15a-e88aa3f657e5 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:11:59.498974 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5cdfc588-f70d-4ac5-b15a-e88aa3f657e5 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32" status: 200 len: 1367 microversion: 2.1 time: 0.588805 Sep 10 12:11:59.500138 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2975/5941] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:11:58 2022] GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 => generated 1367 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:12:00.521786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fd4172e8-9ad1-4b05-934c-ab6e41f3b53e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:12:00.523012 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fd4172e8-9ad1-4b05-934c-ab6e41f3b53e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:12:00.541442 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fd4172e8-9ad1-4b05-934c-ab6e41f3b53e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:00.544738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fd4172e8-9ad1-4b05-934c-ab6e41f3b53e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:00.546870 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fd4172e8-9ad1-4b05-934c-ab6e41f3b53e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:00.549262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fd4172e8-9ad1-4b05-934c-ab6e41f3b53e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:00.550250 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fd4172e8-9ad1-4b05-934c-ab6e41f3b53e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:00.552629 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fd4172e8-9ad1-4b05-934c-ab6e41f3b53e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:00.976229 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fd4172e8-9ad1-4b05-934c-ab6e41f3b53e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:12:00.991884 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fd4172e8-9ad1-4b05-934c-ab6e41f3b53e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32" status: 200 len: 1367 microversion: 2.1 time: 0.473849 Sep 10 12:12:00.992742 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2967/5942] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:12:00 2022] GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 => generated 1367 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:12:01.011286 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-45f237b3-8057-4e99-8639-7e7368a1dfd1 req-541d19aa-de0b-41f3-802f-a62f9438cf03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c1bb60f-ebea-4e31-9c65-2c7b45af3e32", "tag": "1e3ca497-9731-45ff-97b5-f0c92bf11053"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:12:01.026359 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-45f237b3-8057-4e99-8639-7e7368a1dfd1 req-541d19aa-de0b-41f3-802f-a62f9438cf03 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:01.027110 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-45f237b3-8057-4e99-8639-7e7368a1dfd1 req-541d19aa-de0b-41f3-802f-a62f9438cf03 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:01.027800 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-45f237b3-8057-4e99-8639-7e7368a1dfd1 req-541d19aa-de0b-41f3-802f-a62f9438cf03 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:01.049002 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-45f237b3-8057-4e99-8639-7e7368a1dfd1 req-541d19aa-de0b-41f3-802f-a62f9438cf03 service nova] Creating event network-changed:1e3ca497-9731-45ff-97b5-f0c92bf11053 for instance 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 on n-h1-856895-1 Sep 10 12:12:01.061016 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-45f237b3-8057-4e99-8639-7e7368a1dfd1 req-541d19aa-de0b-41f3-802f-a62f9438cf03 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053231 Sep 10 12:12:01.062167 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2976/5943] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:12:02.014080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-adf015de-a00e-4cbe-b7b8-cb09faab3f64 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:12:02.014941 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-adf015de-a00e-4cbe-b7b8-cb09faab3f64 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:12:02.022728 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-adf015de-a00e-4cbe-b7b8-cb09faab3f64 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:02.023346 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-adf015de-a00e-4cbe-b7b8-cb09faab3f64 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:02.023856 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-adf015de-a00e-4cbe-b7b8-cb09faab3f64 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:02.024782 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-adf015de-a00e-4cbe-b7b8-cb09faab3f64 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:02.025316 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-adf015de-a00e-4cbe-b7b8-cb09faab3f64 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:02.025919 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-adf015de-a00e-4cbe-b7b8-cb09faab3f64 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:02.219553 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-adf015de-a00e-4cbe-b7b8-cb09faab3f64 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:12:02.228282 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-adf015de-a00e-4cbe-b7b8-cb09faab3f64 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32" status: 200 len: 1367 microversion: 2.1 time: 0.217836 Sep 10 12:12:02.233707 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2968/5944] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:12:02 2022] GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:12:03.259061 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5bb36483-7435-44ef-bf7c-f820c0b4bcee tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:12:03.259927 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5bb36483-7435-44ef-bf7c-f820c0b4bcee tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:12:03.262546 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:12:03.269715 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5bb36483-7435-44ef-bf7c-f820c0b4bcee tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:03.270366 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5bb36483-7435-44ef-bf7c-f820c0b4bcee tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:03.270800 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5bb36483-7435-44ef-bf7c-f820c0b4bcee tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:03.271527 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5bb36483-7435-44ef-bf7c-f820c0b4bcee tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:03.271975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5bb36483-7435-44ef-bf7c-f820c0b4bcee tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:03.272406 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5bb36483-7435-44ef-bf7c-f820c0b4bcee tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:03.460171 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5bb36483-7435-44ef-bf7c-f820c0b4bcee tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:12:03.469746 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5bb36483-7435-44ef-bf7c-f820c0b4bcee tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32" status: 200 len: 1367 microversion: 2.1 time: 0.215736 Sep 10 12:12:03.478135 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2977/5945] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:12:03 2022] GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:12:03.480603 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8e77bc5d-9804-45cb-9bfe-db23ce638fbf tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1204356322", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "81792b86-4fce-4f38-a0cc-de3c164bb7d5"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:12:03.537860 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-8e77bc5d-9804-45cb-9bfe-db23ce638fbf tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] validate_networks() for [('81792b86-4fce-4f38-a0cc-de3c164bb7d5', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:12:04.062977 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-8e77bc5d-9804-45cb-9bfe-db23ce638fbf tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:12:04.064088 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-8e77bc5d-9804-45cb-9bfe-db23ce638fbf tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:12:04.064786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-8e77bc5d-9804-45cb-9bfe-db23ce638fbf tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:12:04.065387 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-8e77bc5d-9804-45cb-9bfe-db23ce638fbf tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:12:04.065798 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-8e77bc5d-9804-45cb-9bfe-db23ce638fbf tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:12:04.078060 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e77bc5d-9804-45cb-9bfe-db23ce638fbf tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:04.080461 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e77bc5d-9804-45cb-9bfe-db23ce638fbf tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:04.081234 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e77bc5d-9804-45cb-9bfe-db23ce638fbf tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:04.082774 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e77bc5d-9804-45cb-9bfe-db23ce638fbf tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:04.083470 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e77bc5d-9804-45cb-9bfe-db23ce638fbf tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:04.084084 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e77bc5d-9804-45cb-9bfe-db23ce638fbf tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:04.106446 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-8e77bc5d-9804-45cb-9bfe-db23ce638fbf tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Getting quotas for project d9535c16997f458394066e442d036efe. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:12:04.114937 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-8e77bc5d-9804-45cb-9bfe-db23ce638fbf tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Getting quotas for user 8e9b0de88baf482a8aadf98bc6eb590f and project d9535c16997f458394066e442d036efe. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:12:04.146465 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8e77bc5d-9804-45cb-9bfe-db23ce638fbf tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:12:04.149447 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8e77bc5d-9804-45cb-9bfe-db23ce638fbf tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] [instance: 51ee6df0-6521-4947-8c07-511d295cd115] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:12:04.217237 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8e77bc5d-9804-45cb-9bfe-db23ce638fbf tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.740893 Sep 10 12:12:04.218691 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2969/5946] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:12:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:12:04.247489 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1983e0e9-1333-4aff-bc7a-4ce0c36269fa tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:12:04.248757 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1983e0e9-1333-4aff-bc7a-4ce0c36269fa tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] [instance: 51ee6df0-6521-4947-8c07-511d295cd115] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:12:04.369895 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1983e0e9-1333-4aff-bc7a-4ce0c36269fa tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9b0de88baf482a8aadf98bc6eb590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9535c16997f458394066e442d036efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:12:04.379706 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1983e0e9-1333-4aff-bc7a-4ce0c36269fa tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] 10.222.0.23 "GET /compute/v2.1/servers/51ee6df0-6521-4947-8c07-511d295cd115" status: 200 len: 1219 microversion: 2.1 time: 0.149258 Sep 10 12:12:04.387241 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2978/5947] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:12:04 2022] GET /compute/v2.1/servers/51ee6df0-6521-4947-8c07-511d295cd115 => generated 1219 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:12:04.494115 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b14a41e5-be3a-47eb-a2e9-1c53667d78db tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:12:04.494798 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b14a41e5-be3a-47eb-a2e9-1c53667d78db tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:12:04.507911 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b14a41e5-be3a-47eb-a2e9-1c53667d78db tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:04.508403 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b14a41e5-be3a-47eb-a2e9-1c53667d78db tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:04.508925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b14a41e5-be3a-47eb-a2e9-1c53667d78db tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:04.509629 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b14a41e5-be3a-47eb-a2e9-1c53667d78db tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:04.510169 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b14a41e5-be3a-47eb-a2e9-1c53667d78db tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:04.510602 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b14a41e5-be3a-47eb-a2e9-1c53667d78db tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:05.062217 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b14a41e5-be3a-47eb-a2e9-1c53667d78db tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:12:05.070513 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b14a41e5-be3a-47eb-a2e9-1c53667d78db tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32" status: 200 len: 1367 microversion: 2.1 time: 0.580251 Sep 10 12:12:05.071097 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2970/5948] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:12:04 2022] GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 => generated 1367 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:12:05.413174 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e6f65158-5163-40da-855d-2fca3ef9f20d tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:12:05.414539 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e6f65158-5163-40da-855d-2fca3ef9f20d tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] [instance: 51ee6df0-6521-4947-8c07-511d295cd115] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:12:05.423318 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6f65158-5163-40da-855d-2fca3ef9f20d tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:05.424163 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6f65158-5163-40da-855d-2fca3ef9f20d tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:05.424862 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6f65158-5163-40da-855d-2fca3ef9f20d tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:05.426205 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6f65158-5163-40da-855d-2fca3ef9f20d tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:05.427253 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6f65158-5163-40da-855d-2fca3ef9f20d tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:05.428085 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6f65158-5163-40da-855d-2fca3ef9f20d tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:05.527242 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e6f65158-5163-40da-855d-2fca3ef9f20d tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9b0de88baf482a8aadf98bc6eb590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9535c16997f458394066e442d036efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:12:05.540347 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e6f65158-5163-40da-855d-2fca3ef9f20d tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] 10.222.0.23 "GET /compute/v2.1/servers/51ee6df0-6521-4947-8c07-511d295cd115" status: 200 len: 1271 microversion: 2.1 time: 0.131500 Sep 10 12:12:05.541216 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2979/5949] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:12:05 2022] GET /compute/v2.1/servers/51ee6df0-6521-4947-8c07-511d295cd115 => generated 1271 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:12:06.095012 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2116d240-5e84-48c5-9139-633f89cc7a94 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:12:06.096486 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2116d240-5e84-48c5-9139-633f89cc7a94 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:12:06.108823 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2116d240-5e84-48c5-9139-633f89cc7a94 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:06.110771 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2116d240-5e84-48c5-9139-633f89cc7a94 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:06.114105 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2116d240-5e84-48c5-9139-633f89cc7a94 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:06.115075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2116d240-5e84-48c5-9139-633f89cc7a94 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:06.115762 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2116d240-5e84-48c5-9139-633f89cc7a94 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:06.116521 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2116d240-5e84-48c5-9139-633f89cc7a94 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:06.375942 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2116d240-5e84-48c5-9139-633f89cc7a94 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:12:06.386056 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2116d240-5e84-48c5-9139-633f89cc7a94 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32" status: 200 len: 1367 microversion: 2.1 time: 0.295882 Sep 10 12:12:06.400400 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2971/5950] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:12:06 2022] GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 => generated 1367 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:12:06.570662 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ab894b19-5ca3-4bb7-88ad-82d8cc6bf994 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:12:06.573020 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ab894b19-5ca3-4bb7-88ad-82d8cc6bf994 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] [instance: 51ee6df0-6521-4947-8c07-511d295cd115] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:12:06.587389 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab894b19-5ca3-4bb7-88ad-82d8cc6bf994 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:06.588154 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab894b19-5ca3-4bb7-88ad-82d8cc6bf994 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:06.589046 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab894b19-5ca3-4bb7-88ad-82d8cc6bf994 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:06.591297 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab894b19-5ca3-4bb7-88ad-82d8cc6bf994 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:06.592526 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab894b19-5ca3-4bb7-88ad-82d8cc6bf994 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:06.593149 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab894b19-5ca3-4bb7-88ad-82d8cc6bf994 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:07.175828 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ab894b19-5ca3-4bb7-88ad-82d8cc6bf994 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9b0de88baf482a8aadf98bc6eb590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9535c16997f458394066e442d036efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:12:07.184176 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ab894b19-5ca3-4bb7-88ad-82d8cc6bf994 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] 10.222.0.23 "GET /compute/v2.1/servers/51ee6df0-6521-4947-8c07-511d295cd115" status: 200 len: 1319 microversion: 2.1 time: 0.620386 Sep 10 12:12:07.203415 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2980/5951] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:12:06 2022] GET /compute/v2.1/servers/51ee6df0-6521-4947-8c07-511d295cd115 => generated 1319 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:12:07.417803 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-30fa8d36-221c-419e-957f-1acecfebcebe tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:12:07.418742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-30fa8d36-221c-419e-957f-1acecfebcebe tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:12:07.428016 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30fa8d36-221c-419e-957f-1acecfebcebe tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:07.428559 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30fa8d36-221c-419e-957f-1acecfebcebe tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:07.429176 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30fa8d36-221c-419e-957f-1acecfebcebe tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:07.429898 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30fa8d36-221c-419e-957f-1acecfebcebe tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:07.430422 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30fa8d36-221c-419e-957f-1acecfebcebe tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:07.430866 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30fa8d36-221c-419e-957f-1acecfebcebe tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:07.501630 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-f0e91f12-2c70-404b-9339-603fd9042ad3 req-67b619d9-ffab-480a-bfd3-922ffbdd343b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51ee6df0-6521-4947-8c07-511d295cd115", "tag": "a0db988c-13e1-40a0-b9e7-e92b00ca81a7"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:12:07.520193 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f0e91f12-2c70-404b-9339-603fd9042ad3 req-67b619d9-ffab-480a-bfd3-922ffbdd343b service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:07.522900 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f0e91f12-2c70-404b-9339-603fd9042ad3 req-67b619d9-ffab-480a-bfd3-922ffbdd343b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:07.525122 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f0e91f12-2c70-404b-9339-603fd9042ad3 req-67b619d9-ffab-480a-bfd3-922ffbdd343b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:07.549446 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-f0e91f12-2c70-404b-9339-603fd9042ad3 req-67b619d9-ffab-480a-bfd3-922ffbdd343b service nova] Creating event network-changed:a0db988c-13e1-40a0-b9e7-e92b00ca81a7 for instance 51ee6df0-6521-4947-8c07-511d295cd115 on n-h2-856895-1 Sep 10 12:12:07.570952 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-f0e91f12-2c70-404b-9339-603fd9042ad3 req-67b619d9-ffab-480a-bfd3-922ffbdd343b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073869 Sep 10 12:12:07.573592 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2981/5952] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:12:07.649927 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-30fa8d36-221c-419e-957f-1acecfebcebe tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:12:07.660872 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-30fa8d36-221c-419e-957f-1acecfebcebe tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32" status: 200 len: 1367 microversion: 2.1 time: 0.251257 Sep 10 12:12:07.662378 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2972/5953] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:12:07 2022] GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:12:08.214173 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-133a8f37-8479-4612-bddb-3f98f5bd93b7 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:12:08.214894 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-133a8f37-8479-4612-bddb-3f98f5bd93b7 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] [instance: 51ee6df0-6521-4947-8c07-511d295cd115] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:12:08.221852 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-133a8f37-8479-4612-bddb-3f98f5bd93b7 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:08.222633 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-133a8f37-8479-4612-bddb-3f98f5bd93b7 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:08.223080 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-133a8f37-8479-4612-bddb-3f98f5bd93b7 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:08.223819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-133a8f37-8479-4612-bddb-3f98f5bd93b7 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:08.224288 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-133a8f37-8479-4612-bddb-3f98f5bd93b7 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:08.224781 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-133a8f37-8479-4612-bddb-3f98f5bd93b7 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:08.387813 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-afd4d4d2-8639-409f-9e66-b0815ebde8cd req-59801319-a850-44a8-b660-71ac371bb8b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c1bb60f-ebea-4e31-9c65-2c7b45af3e32", "name": "network-vif-plugged", "status": "completed", "tag": "1e3ca497-9731-45ff-97b5-f0c92bf11053"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:12:08.403024 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-afd4d4d2-8639-409f-9e66-b0815ebde8cd req-59801319-a850-44a8-b660-71ac371bb8b6 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:08.406122 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-afd4d4d2-8639-409f-9e66-b0815ebde8cd req-59801319-a850-44a8-b660-71ac371bb8b6 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:08.407587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-afd4d4d2-8639-409f-9e66-b0815ebde8cd req-59801319-a850-44a8-b660-71ac371bb8b6 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:08.433742 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-afd4d4d2-8639-409f-9e66-b0815ebde8cd req-59801319-a850-44a8-b660-71ac371bb8b6 service nova] Creating event network-vif-plugged:1e3ca497-9731-45ff-97b5-f0c92bf11053 for instance 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 on n-h1-856895-1 Sep 10 12:12:08.438642 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-133a8f37-8479-4612-bddb-3f98f5bd93b7 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9b0de88baf482a8aadf98bc6eb590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9535c16997f458394066e442d036efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:12:08.452146 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-133a8f37-8479-4612-bddb-3f98f5bd93b7 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] 10.222.0.23 "GET /compute/v2.1/servers/51ee6df0-6521-4947-8c07-511d295cd115" status: 200 len: 1319 microversion: 2.1 time: 0.242877 Sep 10 12:12:08.452771 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2982/5954] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:12:08 2022] GET /compute/v2.1/servers/51ee6df0-6521-4947-8c07-511d295cd115 => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:12:08.470386 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-afd4d4d2-8639-409f-9e66-b0815ebde8cd req-59801319-a850-44a8-b660-71ac371bb8b6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090942 Sep 10 12:12:08.470992 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2973/5955] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:12:08.686913 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-19953ffc-996d-40e4-a90d-a72f9b0e45be tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:12:08.687583 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-19953ffc-996d-40e4-a90d-a72f9b0e45be tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:12:08.694502 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19953ffc-996d-40e4-a90d-a72f9b0e45be tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:08.701456 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19953ffc-996d-40e4-a90d-a72f9b0e45be tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:08.702272 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19953ffc-996d-40e4-a90d-a72f9b0e45be tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:08.703291 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19953ffc-996d-40e4-a90d-a72f9b0e45be tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:08.703994 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19953ffc-996d-40e4-a90d-a72f9b0e45be tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:08.704688 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19953ffc-996d-40e4-a90d-a72f9b0e45be tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:08.918730 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-19953ffc-996d-40e4-a90d-a72f9b0e45be tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:12:08.929851 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-19953ffc-996d-40e4-a90d-a72f9b0e45be tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32" status: 200 len: 1367 microversion: 2.1 time: 0.248077 Sep 10 12:12:08.931025 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2983/5956] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:12:08 2022] GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:12:09.479397 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fe10a4de-836b-4692-a852-af21e8f93717 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:12:09.480372 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fe10a4de-836b-4692-a852-af21e8f93717 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] [instance: 51ee6df0-6521-4947-8c07-511d295cd115] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:12:09.490207 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fe10a4de-836b-4692-a852-af21e8f93717 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:09.490981 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fe10a4de-836b-4692-a852-af21e8f93717 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:09.491674 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fe10a4de-836b-4692-a852-af21e8f93717 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:09.492641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fe10a4de-836b-4692-a852-af21e8f93717 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:09.493351 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fe10a4de-836b-4692-a852-af21e8f93717 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:09.494012 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fe10a4de-836b-4692-a852-af21e8f93717 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:09.689475 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fe10a4de-836b-4692-a852-af21e8f93717 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9b0de88baf482a8aadf98bc6eb590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9535c16997f458394066e442d036efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:12:09.700415 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fe10a4de-836b-4692-a852-af21e8f93717 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] 10.222.0.23 "GET /compute/v2.1/servers/51ee6df0-6521-4947-8c07-511d295cd115" status: 200 len: 1319 microversion: 2.1 time: 0.223700 Sep 10 12:12:09.710566 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2974/5957] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:12:09 2022] GET /compute/v2.1/servers/51ee6df0-6521-4947-8c07-511d295cd115 => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:12:09.954175 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-50768729-7d86-4355-9c11-56a8fb195f72 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:12:09.955632 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-50768729-7d86-4355-9c11-56a8fb195f72 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:12:09.975875 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50768729-7d86-4355-9c11-56a8fb195f72 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:09.976796 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50768729-7d86-4355-9c11-56a8fb195f72 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:09.977479 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50768729-7d86-4355-9c11-56a8fb195f72 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:09.978557 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50768729-7d86-4355-9c11-56a8fb195f72 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:09.979308 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50768729-7d86-4355-9c11-56a8fb195f72 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:09.980037 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50768729-7d86-4355-9c11-56a8fb195f72 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:10.288356 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-50768729-7d86-4355-9c11-56a8fb195f72 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:12:10.297577 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-50768729-7d86-4355-9c11-56a8fb195f72 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32" status: 200 len: 1367 microversion: 2.1 time: 0.347896 Sep 10 12:12:10.298316 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2984/5958] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:12:09 2022] GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 => generated 1367 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:12:10.728529 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4703e07b-a6ef-4419-8af0-4d71a766a7f5 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:12:10.729734 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4703e07b-a6ef-4419-8af0-4d71a766a7f5 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] [instance: 51ee6df0-6521-4947-8c07-511d295cd115] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:12:10.737818 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4703e07b-a6ef-4419-8af0-4d71a766a7f5 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:10.738641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4703e07b-a6ef-4419-8af0-4d71a766a7f5 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:10.739285 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4703e07b-a6ef-4419-8af0-4d71a766a7f5 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:10.740188 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4703e07b-a6ef-4419-8af0-4d71a766a7f5 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:10.740678 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4703e07b-a6ef-4419-8af0-4d71a766a7f5 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:10.741164 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4703e07b-a6ef-4419-8af0-4d71a766a7f5 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:10.940646 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4703e07b-a6ef-4419-8af0-4d71a766a7f5 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9b0de88baf482a8aadf98bc6eb590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9535c16997f458394066e442d036efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:12:10.951882 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4703e07b-a6ef-4419-8af0-4d71a766a7f5 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] 10.222.0.23 "GET /compute/v2.1/servers/51ee6df0-6521-4947-8c07-511d295cd115" status: 200 len: 1319 microversion: 2.1 time: 0.227212 Sep 10 12:12:10.952488 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2975/5959] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:12:10 2022] GET /compute/v2.1/servers/51ee6df0-6521-4947-8c07-511d295cd115 => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:12:11.321963 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-97f48cf2-2c57-4e7f-a300-8731a85da536 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:12:11.331537 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-97f48cf2-2c57-4e7f-a300-8731a85da536 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:12:11.348249 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-97f48cf2-2c57-4e7f-a300-8731a85da536 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:11.352283 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-97f48cf2-2c57-4e7f-a300-8731a85da536 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:11.353077 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-97f48cf2-2c57-4e7f-a300-8731a85da536 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:11.356457 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-97f48cf2-2c57-4e7f-a300-8731a85da536 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:11.357550 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-97f48cf2-2c57-4e7f-a300-8731a85da536 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:11.361766 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-97f48cf2-2c57-4e7f-a300-8731a85da536 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:11.565262 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-97f48cf2-2c57-4e7f-a300-8731a85da536 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:12:11.578967 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-97f48cf2-2c57-4e7f-a300-8731a85da536 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32" status: 200 len: 1558 microversion: 2.1 time: 0.261062 Sep 10 12:12:11.581121 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2985/5960] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:12:11 2022] GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 => generated 1558 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:12:11.607027 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5c777cc4-fc6a-43a7-8314-ee6bf03ce9d4 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:12:11.607027 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5c777cc4-fc6a-43a7-8314-ee6bf03ce9d4 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:12:11.613944 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c777cc4-fc6a-43a7-8314-ee6bf03ce9d4 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:11.614765 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c777cc4-fc6a-43a7-8314-ee6bf03ce9d4 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:11.615368 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c777cc4-fc6a-43a7-8314-ee6bf03ce9d4 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:11.616201 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c777cc4-fc6a-43a7-8314-ee6bf03ce9d4 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:11.616768 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c777cc4-fc6a-43a7-8314-ee6bf03ce9d4 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:11.617306 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c777cc4-fc6a-43a7-8314-ee6bf03ce9d4 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:11.745114 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5c777cc4-fc6a-43a7-8314-ee6bf03ce9d4 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.142263 Sep 10 12:12:11.748728 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2976/5961] 10.222.0.23 () {58 vars in 1275 bytes} [Sat Sep 10 12:12:11 2022] GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32/os-interface => generated 285 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:12:11.975764 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-242bae9b-fa61-426a-8716-cf68a44ab77a tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:12:11.977141 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-242bae9b-fa61-426a-8716-cf68a44ab77a tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] [instance: 51ee6df0-6521-4947-8c07-511d295cd115] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:12:11.989155 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-242bae9b-fa61-426a-8716-cf68a44ab77a tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:11.989896 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-242bae9b-fa61-426a-8716-cf68a44ab77a tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:11.990590 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-242bae9b-fa61-426a-8716-cf68a44ab77a tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:11.991517 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-242bae9b-fa61-426a-8716-cf68a44ab77a tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:11.992151 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-242bae9b-fa61-426a-8716-cf68a44ab77a tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:11.992751 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-242bae9b-fa61-426a-8716-cf68a44ab77a tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:12.202339 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-242bae9b-fa61-426a-8716-cf68a44ab77a tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9b0de88baf482a8aadf98bc6eb590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9535c16997f458394066e442d036efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:12:12.210604 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-242bae9b-fa61-426a-8716-cf68a44ab77a tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] 10.222.0.23 "GET /compute/v2.1/servers/51ee6df0-6521-4947-8c07-511d295cd115" status: 200 len: 1319 microversion: 2.1 time: 0.239374 Sep 10 12:12:12.211340 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2986/5962] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:12:11 2022] GET /compute/v2.1/servers/51ee6df0-6521-4947-8c07-511d295cd115 => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:12:12.838703 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-347f9553-2d2a-4d01-86ea-d0071782aaea req-9d634ec4-c34d-461d-acef-9f3338504be9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c1bb60f-ebea-4e31-9c65-2c7b45af3e32", "tag": "1e3ca497-9731-45ff-97b5-f0c92bf11053"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:12:12.863253 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-347f9553-2d2a-4d01-86ea-d0071782aaea req-9d634ec4-c34d-461d-acef-9f3338504be9 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:12.863742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-347f9553-2d2a-4d01-86ea-d0071782aaea req-9d634ec4-c34d-461d-acef-9f3338504be9 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:12.864172 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-347f9553-2d2a-4d01-86ea-d0071782aaea req-9d634ec4-c34d-461d-acef-9f3338504be9 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:12.881255 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-347f9553-2d2a-4d01-86ea-d0071782aaea req-9d634ec4-c34d-461d-acef-9f3338504be9 service nova] Creating event network-changed:1e3ca497-9731-45ff-97b5-f0c92bf11053 for instance 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 on n-h1-856895-1 Sep 10 12:12:12.886762 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-347f9553-2d2a-4d01-86ea-d0071782aaea req-9d634ec4-c34d-461d-acef-9f3338504be9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052522 Sep 10 12:12:12.887704 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2977/5963] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:12:13.235981 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9758da0e-8ae3-4bb7-ad69-ad18428e3b11 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:12:13.237401 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9758da0e-8ae3-4bb7-ad69-ad18428e3b11 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] [instance: 51ee6df0-6521-4947-8c07-511d295cd115] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:12:13.249923 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9758da0e-8ae3-4bb7-ad69-ad18428e3b11 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:13.250326 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9758da0e-8ae3-4bb7-ad69-ad18428e3b11 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:13.250759 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9758da0e-8ae3-4bb7-ad69-ad18428e3b11 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:13.262130 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9758da0e-8ae3-4bb7-ad69-ad18428e3b11 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:13.262879 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9758da0e-8ae3-4bb7-ad69-ad18428e3b11 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:13.263485 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9758da0e-8ae3-4bb7-ad69-ad18428e3b11 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:13.358842 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-0df64866-c06a-42f8-8b3c-38b3f28b281d req-41fcdcd9-dd4c-4fe5-b627-b76c8006b695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51ee6df0-6521-4947-8c07-511d295cd115", "name": "network-vif-plugged", "status": "completed", "tag": "a0db988c-13e1-40a0-b9e7-e92b00ca81a7"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:12:13.382587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0df64866-c06a-42f8-8b3c-38b3f28b281d req-41fcdcd9-dd4c-4fe5-b627-b76c8006b695 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:13.383072 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0df64866-c06a-42f8-8b3c-38b3f28b281d req-41fcdcd9-dd4c-4fe5-b627-b76c8006b695 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:13.383540 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0df64866-c06a-42f8-8b3c-38b3f28b281d req-41fcdcd9-dd4c-4fe5-b627-b76c8006b695 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:13.420965 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-0df64866-c06a-42f8-8b3c-38b3f28b281d req-41fcdcd9-dd4c-4fe5-b627-b76c8006b695 service nova] Creating event network-vif-plugged:a0db988c-13e1-40a0-b9e7-e92b00ca81a7 for instance 51ee6df0-6521-4947-8c07-511d295cd115 on n-h2-856895-1 Sep 10 12:12:13.432121 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-0df64866-c06a-42f8-8b3c-38b3f28b281d req-41fcdcd9-dd4c-4fe5-b627-b76c8006b695 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079631 Sep 10 12:12:13.434198 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2978/5964] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:12:13.667547 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9758da0e-8ae3-4bb7-ad69-ad18428e3b11 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9b0de88baf482a8aadf98bc6eb590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9535c16997f458394066e442d036efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:12:13.678449 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9758da0e-8ae3-4bb7-ad69-ad18428e3b11 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] 10.222.0.23 "GET /compute/v2.1/servers/51ee6df0-6521-4947-8c07-511d295cd115" status: 200 len: 1319 microversion: 2.1 time: 0.448349 Sep 10 12:12:13.679057 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2987/5965] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:12:13 2022] GET /compute/v2.1/servers/51ee6df0-6521-4947-8c07-511d295cd115 => generated 1319 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:12:14.701988 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=4 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:12:14.703976 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=12 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:12:14.709300 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1c3e0633-ce5d-4f77-89ec-2da86e2c8988 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:12:14.710405 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1c3e0633-ce5d-4f77-89ec-2da86e2c8988 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] [instance: 51ee6df0-6521-4947-8c07-511d295cd115] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:12:14.739473 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c3e0633-ce5d-4f77-89ec-2da86e2c8988 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:14.739972 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c3e0633-ce5d-4f77-89ec-2da86e2c8988 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:14.740406 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c3e0633-ce5d-4f77-89ec-2da86e2c8988 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:14.741113 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c3e0633-ce5d-4f77-89ec-2da86e2c8988 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:14.741566 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c3e0633-ce5d-4f77-89ec-2da86e2c8988 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:14.741990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c3e0633-ce5d-4f77-89ec-2da86e2c8988 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:15.003094 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1c3e0633-ce5d-4f77-89ec-2da86e2c8988 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9b0de88baf482a8aadf98bc6eb590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9535c16997f458394066e442d036efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:12:15.013243 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1c3e0633-ce5d-4f77-89ec-2da86e2c8988 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] 10.222.0.23 "GET /compute/v2.1/servers/51ee6df0-6521-4947-8c07-511d295cd115" status: 200 len: 1319 microversion: 2.1 time: 0.313095 Sep 10 12:12:15.027184 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2979/5966] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:12:14 2022] GET /compute/v2.1/servers/51ee6df0-6521-4947-8c07-511d295cd115 => generated 1319 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:12:16.037704 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-425b9e19-1122-4e7a-bc34-cec8acde562d tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:12:16.038622 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-425b9e19-1122-4e7a-bc34-cec8acde562d tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] [instance: 51ee6df0-6521-4947-8c07-511d295cd115] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:12:16.041913 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=8 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:12:16.048870 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-425b9e19-1122-4e7a-bc34-cec8acde562d tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:16.049381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-425b9e19-1122-4e7a-bc34-cec8acde562d tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:16.050161 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-425b9e19-1122-4e7a-bc34-cec8acde562d tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:16.050541 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-425b9e19-1122-4e7a-bc34-cec8acde562d tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:16.051007 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-425b9e19-1122-4e7a-bc34-cec8acde562d tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:16.051467 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-425b9e19-1122-4e7a-bc34-cec8acde562d tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:16.252518 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-425b9e19-1122-4e7a-bc34-cec8acde562d tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9b0de88baf482a8aadf98bc6eb590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9535c16997f458394066e442d036efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:12:16.261846 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-425b9e19-1122-4e7a-bc34-cec8acde562d tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] 10.222.0.23 "GET /compute/v2.1/servers/51ee6df0-6521-4947-8c07-511d295cd115" status: 200 len: 1508 microversion: 2.1 time: 0.228382 Sep 10 12:12:16.262587 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2988/5967] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:12:16 2022] GET /compute/v2.1/servers/51ee6df0-6521-4947-8c07-511d295cd115 => generated 1508 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:12:40.890280 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9c8e4f40-b9e8-46f8-9736-df7e8896c3f5 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b85ae5f6-98b5-44df-b836-458256ad65e6", "device": "/dev/sdb"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:12:40.892784 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9c8e4f40-b9e8-46f8-9736-df7e8896c3f5 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] [instance: 51ee6df0-6521-4947-8c07-511d295cd115] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:12:40.895567 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:12:40.896357 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=65 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:12:40.913816 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9c8e4f40-b9e8-46f8-9736-df7e8896c3f5 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:40.924614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9c8e4f40-b9e8-46f8-9736-df7e8896c3f5 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:40.925249 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9c8e4f40-b9e8-46f8-9736-df7e8896c3f5 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:40.926129 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9c8e4f40-b9e8-46f8-9736-df7e8896c3f5 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:40.926937 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9c8e4f40-b9e8-46f8-9736-df7e8896c3f5 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:40.928174 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9c8e4f40-b9e8-46f8-9736-df7e8896c3f5 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:41.281270 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9c8e4f40-b9e8-46f8-9736-df7e8896c3f5 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] 10.222.0.23 "POST /compute/v2.1/servers/51ee6df0-6521-4947-8c07-511d295cd115/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.399567 Sep 10 12:12:41.282495 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2980/5968] 10.222.0.23 () {60 vars in 1323 bytes} [Sat Sep 10 12:12:40 2022] POST /compute/v2.1/servers/51ee6df0-6521-4947-8c07-511d295cd115/os-volume_attachments => generated 194 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:12:43.501100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e42ec8b0-a859-4095-8ad6-6649ab56e129 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:12:43.510364 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e42ec8b0-a859-4095-8ad6-6649ab56e129 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:12:43.519187 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=25 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:12:43.520333 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=69 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:12:43.522177 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e42ec8b0-a859-4095-8ad6-6649ab56e129 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:43.523046 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e42ec8b0-a859-4095-8ad6-6649ab56e129 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:43.525992 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e42ec8b0-a859-4095-8ad6-6649ab56e129 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:43.528248 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e42ec8b0-a859-4095-8ad6-6649ab56e129 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:43.529337 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e42ec8b0-a859-4095-8ad6-6649ab56e129 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:43.530089 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e42ec8b0-a859-4095-8ad6-6649ab56e129 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:43.580044 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e42ec8b0-a859-4095-8ad6-6649ab56e129 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.090281 Sep 10 12:12:43.588145 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2989/5969] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:12:43 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9/os-volume_attachments => generated 25 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 12:12:43.682601 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e13e33d7-489f-4af8-9bc2-35d79d9570dd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:12:43.684804 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e13e33d7-489f-4af8-9bc2-35d79d9570dd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:12:43.707800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e13e33d7-489f-4af8-9bc2-35d79d9570dd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:43.707800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e13e33d7-489f-4af8-9bc2-35d79d9570dd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:43.707800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e13e33d7-489f-4af8-9bc2-35d79d9570dd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:43.708277 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e13e33d7-489f-4af8-9bc2-35d79d9570dd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:43.709593 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e13e33d7-489f-4af8-9bc2-35d79d9570dd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:43.710304 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e13e33d7-489f-4af8-9bc2-35d79d9570dd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:43.749833 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e13e33d7-489f-4af8-9bc2-35d79d9570dd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:12:43.874167 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e13e33d7-489f-4af8-9bc2-35d79d9570dd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "DELETE /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 204 len: 0 microversion: 2.1 time: 0.196062 Sep 10 12:12:43.880611 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2981/5970] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:12:43 2022] DELETE /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:12:43.886039 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-02b8d5a3-c429-4cf8-a24d-8d9d18f55010 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:12:43.886698 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-02b8d5a3-c429-4cf8-a24d-8d9d18f55010 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:12:43.893529 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02b8d5a3-c429-4cf8-a24d-8d9d18f55010 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:43.894035 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02b8d5a3-c429-4cf8-a24d-8d9d18f55010 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:43.894672 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02b8d5a3-c429-4cf8-a24d-8d9d18f55010 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:43.895629 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02b8d5a3-c429-4cf8-a24d-8d9d18f55010 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:43.896281 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02b8d5a3-c429-4cf8-a24d-8d9d18f55010 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:43.896873 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02b8d5a3-c429-4cf8-a24d-8d9d18f55010 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:44.169996 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-02b8d5a3-c429-4cf8-a24d-8d9d18f55010 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:12:44.181874 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-02b8d5a3-c429-4cf8-a24d-8d9d18f55010 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1673 microversion: 2.1 time: 0.299694 Sep 10 12:12:44.183121 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2990/5971] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:12:43 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1673 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:12:45.207387 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9c491477-faaf-4e72-916b-818f8da23738 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:12:45.208654 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9c491477-faaf-4e72-916b-818f8da23738 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:12:45.216255 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9c491477-faaf-4e72-916b-818f8da23738 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:45.217050 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9c491477-faaf-4e72-916b-818f8da23738 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:45.217672 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9c491477-faaf-4e72-916b-818f8da23738 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:45.218544 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9c491477-faaf-4e72-916b-818f8da23738 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:45.219180 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9c491477-faaf-4e72-916b-818f8da23738 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:45.222518 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9c491477-faaf-4e72-916b-818f8da23738 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:45.490728 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9c491477-faaf-4e72-916b-818f8da23738 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:12:45.508283 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9c491477-faaf-4e72-916b-818f8da23738 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1673 microversion: 2.1 time: 0.305113 Sep 10 12:12:45.509206 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2982/5972] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:12:45 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1673 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:12:46.540205 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ed45f4f1-d791-44c7-ab7e-d0c4886faed9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:12:46.544894 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ed45f4f1-d791-44c7-ab7e-d0c4886faed9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:12:46.559254 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed45f4f1-d791-44c7-ab7e-d0c4886faed9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:46.559819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed45f4f1-d791-44c7-ab7e-d0c4886faed9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:46.560265 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed45f4f1-d791-44c7-ab7e-d0c4886faed9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:46.561811 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed45f4f1-d791-44c7-ab7e-d0c4886faed9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:46.562314 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed45f4f1-d791-44c7-ab7e-d0c4886faed9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:46.562758 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed45f4f1-d791-44c7-ab7e-d0c4886faed9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:46.949670 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ed45f4f1-d791-44c7-ab7e-d0c4886faed9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:12:46.983305 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ed45f4f1-d791-44c7-ab7e-d0c4886faed9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1673 microversion: 2.1 time: 0.454188 Sep 10 12:12:46.998411 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2991/5973] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:12:46 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1673 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:12:47.798193 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-9ddd469c-33f9-4306-bccf-207e1b864aea req-adeb02da-74aa-4089-8fa7-da479fab8cfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20f0d900-aeea-4f7c-9b92-bf9363ba21c9", "name": "network-vif-deleted", "tag": "48fef716-4256-4d09-b758-89e39be42dfb"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:12:47.859808 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-9ddd469c-33f9-4306-bccf-207e1b864aea req-adeb02da-74aa-4089-8fa7-da479fab8cfc service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:47.860966 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-9ddd469c-33f9-4306-bccf-207e1b864aea req-adeb02da-74aa-4089-8fa7-da479fab8cfc service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:47.867542 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-9ddd469c-33f9-4306-bccf-207e1b864aea req-adeb02da-74aa-4089-8fa7-da479fab8cfc service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:47.911505 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-9ddd469c-33f9-4306-bccf-207e1b864aea req-adeb02da-74aa-4089-8fa7-da479fab8cfc service nova] Creating event network-vif-deleted:48fef716-4256-4d09-b758-89e39be42dfb for instance 20f0d900-aeea-4f7c-9b92-bf9363ba21c9 on n-h1-856895-1 Sep 10 12:12:47.932661 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-9ddd469c-33f9-4306-bccf-207e1b864aea req-adeb02da-74aa-4089-8fa7-da479fab8cfc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138535 Sep 10 12:12:47.935458 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2983/5974] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:12:48.015183 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b2e88f86-ad05-41b7-b134-b8093a17322f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:12:48.016512 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b2e88f86-ad05-41b7-b134-b8093a17322f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:12:48.037962 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2e88f86-ad05-41b7-b134-b8093a17322f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:48.039857 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2e88f86-ad05-41b7-b134-b8093a17322f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:48.041876 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2e88f86-ad05-41b7-b134-b8093a17322f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:48.045210 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2e88f86-ad05-41b7-b134-b8093a17322f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:48.048162 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2e88f86-ad05-41b7-b134-b8093a17322f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:48.051690 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2e88f86-ad05-41b7-b134-b8093a17322f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:48.130411 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2e88f86-ad05-41b7-b134-b8093a17322f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:48.131062 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2e88f86-ad05-41b7-b134-b8093a17322f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:48.131697 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2e88f86-ad05-41b7-b134-b8093a17322f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:48.132665 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-b2e88f86-ad05-41b7-b134-b8093a17322f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lazy-loading 'fault' on Instance uuid 20f0d900-aeea-4f7c-9b92-bf9363ba21c9 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:12:48.210930 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b2e88f86-ad05-41b7-b134-b8093a17322f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:12:48.222551 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b2e88f86-ad05-41b7-b134-b8093a17322f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 200 len: 1326 microversion: 2.1 time: 0.213772 Sep 10 12:12:48.223934 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2992/5975] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:12:48 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 1326 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:12:49.247391 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2479521f-f111-4983-b886-d8247ad7cd62 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:12:49.248125 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2479521f-f111-4983-b886-d8247ad7cd62 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:12:49.261134 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2479521f-f111-4983-b886-d8247ad7cd62 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:49.273774 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2479521f-f111-4983-b886-d8247ad7cd62 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:49.274531 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2479521f-f111-4983-b886-d8247ad7cd62 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:49.275509 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2479521f-f111-4983-b886-d8247ad7cd62 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:49.276148 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2479521f-f111-4983-b886-d8247ad7cd62 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:49.276755 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2479521f-f111-4983-b886-d8247ad7cd62 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:49.321177 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-2479521f-f111-4983-b886-d8247ad7cd62 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] HTTP exception thrown: Instance 20f0d900-aeea-4f7c-9b92-bf9363ba21c9 could not be found. Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2479521f-f111-4983-b886-d8247ad7cd62 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Request method failure captured: Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 HTTP/1.1 Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH4B7Hlzcs3MLVMb7O3bD4Cme547xcvQj47IKSRK4h4ySQVvRVGP2kTNBsccR_p4Vx8tQTGKKPnwc0ojhohb83JhwfmTgV0YS958jL7EGJKKVQHAhSZiGpzXn5Q9y4pTsNX73gwSXNFFHcX0MVCu9Ri-O0vbn_n9BwoH_JZvT6g7btw Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: cb76b960181842b4aeb9ff8f75796df5 Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-AttachVolumeTestJSON-1165343922 Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cb76b960181842b4aeb9ff8f75796df5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cb76b960181842b4aeb9ff8f75796df5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cb76b960181842b4aeb9ff8f75796df5", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cb76b960181842b4aeb9ff8f75796df5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-AttachVolumeTestJSON-1165343922 Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: cb76b960181842b4aeb9ff8f75796df5 Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1165343922 Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-AttachVolumeTestJSON-1165343922-project Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 0bf9ca0c6fc34699b8a9eb711ed77347 Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-AttachVolumeTestJSON-1165343922-project Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 20f0d900-aeea-4f7c-9b92-bf9363ba21c9 could not be found. Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '20f0d900-aeea-4f7c-9b92-bf9363ba21c9'} Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20f0d900-aeea-4f7c-9b92-bf9363ba21c9 could not be found. Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20f0d900-aeea-4f7c-9b92-bf9363ba21c9 could not be found. Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:12:49.323030 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:12:49.329308 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:12:49.329308 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:12:49.329308 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:12:49.329308 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:12:49.329308 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:12:49.329308 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20f0d900-aeea-4f7c-9b92-bf9363ba21c9 could not be found. Sep 10 12:12:49.329308 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:12:49.331177 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2479521f-f111-4983-b886-d8247ad7cd62 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Returning 404 to user: Instance 20f0d900-aeea-4f7c-9b92-bf9363ba21c9 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:12:49.332263 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2479521f-f111-4983-b886-d8247ad7cd62 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 404 len: 111 microversion: 2.1 time: 0.090006 Sep 10 12:12:49.336138 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2984/5976] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:12:49 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:12:49.344763 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7b768c42-efd2-42d5-bc80-b94b14d0d909 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '.version_select at 0x7f4072e704c0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:12:49.385472 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7b768c42-efd2-42d5-bc80-b94b14d0d909 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-374776183" status: 202 len: 0 microversion: 2.1 time: 0.044870 Sep 10 12:12:49.386097 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2993/5977] 10.222.0.23 () {58 vars in 1218 bytes} [Sat Sep 10 12:12:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-374776183 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:12:50.930698 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e24ab6c4-98c4-4434-a21b-996f9f6ea979 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Action: 'create', calling method: .version_select at 0x7f4071f29dc0>, body: {"keypair": {"name": "tempest-keypair-1177899615", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD82Pybzj0Qi8VQi0sdcHgTiWPfNeedQr9LSALAQN6aW3W667aCXa1kK7AseWkfYtjY+kpnUcjUGRGj1anKM8xx8ZXSzPRY1JT+Nvtf4mto29c3ULGNcqmCGz7MThSRGHA=="}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:12:50.970390 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-e24ab6c4-98c4-4434-a21b-996f9f6ea979 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Getting quotas for project cb76b960181842b4aeb9ff8f75796df5. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:12:50.992688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-e24ab6c4-98c4-4434-a21b-996f9f6ea979 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Getting quotas for user 0bf9ca0c6fc34699b8a9eb711ed77347 and project cb76b960181842b4aeb9ff8f75796df5. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:12:51.064142 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e24ab6c4-98c4-4434-a21b-996f9f6ea979 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.142337 Sep 10 12:12:51.064774 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2985/5978] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 12:12:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:12:53.630623 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0c153974-88a8-4178-994f-c24852afc793 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2108823548", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0107e8a7-6fe9-4577-ae40-71d2188e1194"}], "security_groups": [{"name": "tempest-securitygroup--1852604998"}], "key_name": "tempest-keypair-1177899615", "user_data": "}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:12:53.762915 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-0c153974-88a8-4178-994f-c24852afc793 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] validate_networks() for [('0107e8a7-6fe9-4577-ae40-71d2188e1194', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:12:54.279308 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-0c153974-88a8-4178-994f-c24852afc793 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:12:54.279613 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-0c153974-88a8-4178-994f-c24852afc793 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:12:54.280019 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-0c153974-88a8-4178-994f-c24852afc793 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:12:54.280417 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-0c153974-88a8-4178-994f-c24852afc793 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:12:54.280867 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-0c153974-88a8-4178-994f-c24852afc793 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:12:54.291511 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c153974-88a8-4178-994f-c24852afc793 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:54.292003 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c153974-88a8-4178-994f-c24852afc793 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:54.292480 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c153974-88a8-4178-994f-c24852afc793 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:54.293786 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c153974-88a8-4178-994f-c24852afc793 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:54.294252 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c153974-88a8-4178-994f-c24852afc793 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:54.294682 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c153974-88a8-4178-994f-c24852afc793 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:54.318769 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-0c153974-88a8-4178-994f-c24852afc793 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Getting quotas for project cb76b960181842b4aeb9ff8f75796df5. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:12:54.326947 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-0c153974-88a8-4178-994f-c24852afc793 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Getting quotas for user 0bf9ca0c6fc34699b8a9eb711ed77347 and project cb76b960181842b4aeb9ff8f75796df5. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:12:54.351368 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0c153974-88a8-4178-994f-c24852afc793 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:12:54.357834 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0c153974-88a8-4178-994f-c24852afc793 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 6f29b62d-e533-481d-9a55-194953db02bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:12:54.435371 n-d-856895-1 devstack@n-api.service[128776]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0c153974-88a8-4178-994f-c24852afc793 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [3546e893-383c-408c-b52a-b9224010d84e] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 10 12:12:55.448341 n-d-856895-1 devstack@n-api.service[128776]: INFO oslo.messaging._drivers.impl_rabbit [None req-0c153974-88a8-4178-994f-c24852afc793 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [3546e893-383c-408c-b52a-b9224010d84e] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 45334. Sep 10 12:12:55.455879 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0c153974-88a8-4178-994f-c24852afc793 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.830823 Sep 10 12:12:55.457300 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2994/5979] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:12:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 1834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:12:55.468809 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-224fabdc-1a97-48a5-b530-cada4347a3e2 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:12:55.469625 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-224fabdc-1a97-48a5-b530-cada4347a3e2 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 6f29b62d-e533-481d-9a55-194953db02bc] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:12:55.575880 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-224fabdc-1a97-48a5-b530-cada4347a3e2 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:12:55.594821 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-224fabdc-1a97-48a5-b530-cada4347a3e2 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc" status: 200 len: 1238 microversion: 2.1 time: 0.129942 Sep 10 12:12:55.616137 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2986/5980] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:12:55 2022] GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc => generated 1238 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:12:56.625183 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dfce782f-6d8f-4aec-80fb-e9c93450ab4a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:12:56.625806 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-dfce782f-6d8f-4aec-80fb-e9c93450ab4a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 6f29b62d-e533-481d-9a55-194953db02bc] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:12:56.634097 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dfce782f-6d8f-4aec-80fb-e9c93450ab4a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:56.634870 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dfce782f-6d8f-4aec-80fb-e9c93450ab4a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:56.635570 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dfce782f-6d8f-4aec-80fb-e9c93450ab4a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:56.637685 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dfce782f-6d8f-4aec-80fb-e9c93450ab4a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:56.638365 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dfce782f-6d8f-4aec-80fb-e9c93450ab4a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:56.639031 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dfce782f-6d8f-4aec-80fb-e9c93450ab4a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:56.738458 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-dfce782f-6d8f-4aec-80fb-e9c93450ab4a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:12:56.762392 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-dfce782f-6d8f-4aec-80fb-e9c93450ab4a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc" status: 200 len: 1290 microversion: 2.1 time: 0.142118 Sep 10 12:12:56.765146 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2995/5981] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:12:56 2022] GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc => generated 1290 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:12:57.817896 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-462845e3-75df-4938-90be-f367ae273d3a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:12:57.819619 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-462845e3-75df-4938-90be-f367ae273d3a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 6f29b62d-e533-481d-9a55-194953db02bc] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:12:57.848686 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-462845e3-75df-4938-90be-f367ae273d3a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:57.851387 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-462845e3-75df-4938-90be-f367ae273d3a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:57.852852 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-462845e3-75df-4938-90be-f367ae273d3a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:57.857551 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-462845e3-75df-4938-90be-f367ae273d3a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:57.862133 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-462845e3-75df-4938-90be-f367ae273d3a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:57.863260 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-462845e3-75df-4938-90be-f367ae273d3a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:58.213078 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-462845e3-75df-4938-90be-f367ae273d3a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:12:58.229084 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-462845e3-75df-4938-90be-f367ae273d3a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc" status: 200 len: 1364 microversion: 2.1 time: 0.425865 Sep 10 12:12:58.230909 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2987/5982] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:12:57 2022] GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc => generated 1364 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:12:59.256151 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-da7abd5d-4ea2-48e2-9206-f8bf38844423 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:12:59.257606 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-da7abd5d-4ea2-48e2-9206-f8bf38844423 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 6f29b62d-e533-481d-9a55-194953db02bc] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:12:59.269534 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-d5b4ebd4-bf87-49dc-b55f-8de7fcb73a44 req-92895763-aeb1-4e40-a0d3-c61c77a60317 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f29b62d-e533-481d-9a55-194953db02bc", "tag": "ef622768-be1a-4d83-973f-ee254195c7be"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:12:59.287558 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da7abd5d-4ea2-48e2-9206-f8bf38844423 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:59.288249 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da7abd5d-4ea2-48e2-9206-f8bf38844423 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:59.288716 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da7abd5d-4ea2-48e2-9206-f8bf38844423 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:59.293756 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d5b4ebd4-bf87-49dc-b55f-8de7fcb73a44 req-92895763-aeb1-4e40-a0d3-c61c77a60317 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:59.294975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da7abd5d-4ea2-48e2-9206-f8bf38844423 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:12:59.295572 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da7abd5d-4ea2-48e2-9206-f8bf38844423 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:59.295948 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da7abd5d-4ea2-48e2-9206-f8bf38844423 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:59.304687 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d5b4ebd4-bf87-49dc-b55f-8de7fcb73a44 req-92895763-aeb1-4e40-a0d3-c61c77a60317 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:12:59.305276 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d5b4ebd4-bf87-49dc-b55f-8de7fcb73a44 req-92895763-aeb1-4e40-a0d3-c61c77a60317 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:12:59.338111 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-d5b4ebd4-bf87-49dc-b55f-8de7fcb73a44 req-92895763-aeb1-4e40-a0d3-c61c77a60317 service nova] Creating event network-changed:ef622768-be1a-4d83-973f-ee254195c7be for instance 6f29b62d-e533-481d-9a55-194953db02bc on n-h1-856895-1 Sep 10 12:12:59.368574 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-d5b4ebd4-bf87-49dc-b55f-8de7fcb73a44 req-92895763-aeb1-4e40-a0d3-c61c77a60317 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102614 Sep 10 12:12:59.377521 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2988/5983] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:13:00.084878 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-da7abd5d-4ea2-48e2-9206-f8bf38844423 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:13:00.093668 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-da7abd5d-4ea2-48e2-9206-f8bf38844423 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc" status: 200 len: 1364 microversion: 2.1 time: 0.841505 Sep 10 12:13:00.099085 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2996/5984] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:12:59 2022] GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc => generated 1364 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:13:01.124834 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c6c6b1e9-5d1e-49d5-b208-b3ea605963cf tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:13:01.125657 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c6c6b1e9-5d1e-49d5-b208-b3ea605963cf tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 6f29b62d-e533-481d-9a55-194953db02bc] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:13:01.133085 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c6c6b1e9-5d1e-49d5-b208-b3ea605963cf tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:01.133863 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c6c6b1e9-5d1e-49d5-b208-b3ea605963cf tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:01.134478 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c6c6b1e9-5d1e-49d5-b208-b3ea605963cf tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:01.135384 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c6c6b1e9-5d1e-49d5-b208-b3ea605963cf tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:01.136056 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c6c6b1e9-5d1e-49d5-b208-b3ea605963cf tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:01.137056 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c6c6b1e9-5d1e-49d5-b208-b3ea605963cf tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:01.397559 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c6c6b1e9-5d1e-49d5-b208-b3ea605963cf tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:13:01.406688 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c6c6b1e9-5d1e-49d5-b208-b3ea605963cf tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc" status: 200 len: 1364 microversion: 2.1 time: 0.286759 Sep 10 12:13:01.407684 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2989/5985] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:13:01 2022] GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc => generated 1364 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:13:02.435513 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-070ad99a-2a3e-4822-a46f-e72054a6e925 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:13:02.436165 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-070ad99a-2a3e-4822-a46f-e72054a6e925 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 6f29b62d-e533-481d-9a55-194953db02bc] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:13:02.450702 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-070ad99a-2a3e-4822-a46f-e72054a6e925 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:02.451272 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-070ad99a-2a3e-4822-a46f-e72054a6e925 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:02.451917 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-070ad99a-2a3e-4822-a46f-e72054a6e925 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:02.452421 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-070ad99a-2a3e-4822-a46f-e72054a6e925 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:02.452890 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-070ad99a-2a3e-4822-a46f-e72054a6e925 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:02.453327 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-070ad99a-2a3e-4822-a46f-e72054a6e925 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:02.846887 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-070ad99a-2a3e-4822-a46f-e72054a6e925 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:13:02.858653 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-070ad99a-2a3e-4822-a46f-e72054a6e925 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc" status: 200 len: 1364 microversion: 2.1 time: 0.429016 Sep 10 12:13:02.866233 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2997/5986] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:13:02 2022] GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc => generated 1364 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:13:03.881843 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c34609ee-0adf-418d-aabc-491ddd5d678a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:13:03.882705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c34609ee-0adf-418d-aabc-491ddd5d678a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 6f29b62d-e533-481d-9a55-194953db02bc] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:13:03.894014 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c34609ee-0adf-418d-aabc-491ddd5d678a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:03.894517 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c34609ee-0adf-418d-aabc-491ddd5d678a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:03.894969 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c34609ee-0adf-418d-aabc-491ddd5d678a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:03.895710 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c34609ee-0adf-418d-aabc-491ddd5d678a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:03.896385 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c34609ee-0adf-418d-aabc-491ddd5d678a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:03.896606 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c34609ee-0adf-418d-aabc-491ddd5d678a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:04.223933 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c34609ee-0adf-418d-aabc-491ddd5d678a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:13:04.232808 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c34609ee-0adf-418d-aabc-491ddd5d678a tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc" status: 200 len: 1364 microversion: 2.1 time: 0.354801 Sep 10 12:13:04.248050 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2990/5987] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:13:03 2022] GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc => generated 1364 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:13:05.256907 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-27926c38-f642-402c-bf38-2dcb1a148377 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:13:05.258049 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-27926c38-f642-402c-bf38-2dcb1a148377 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 6f29b62d-e533-481d-9a55-194953db02bc] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:13:05.264748 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:13:05.265474 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:13:05.274124 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27926c38-f642-402c-bf38-2dcb1a148377 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:05.274628 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27926c38-f642-402c-bf38-2dcb1a148377 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:05.275071 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27926c38-f642-402c-bf38-2dcb1a148377 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:05.277060 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27926c38-f642-402c-bf38-2dcb1a148377 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:05.283794 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27926c38-f642-402c-bf38-2dcb1a148377 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:05.284255 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27926c38-f642-402c-bf38-2dcb1a148377 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:05.551720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-27926c38-f642-402c-bf38-2dcb1a148377 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:13:05.564458 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-27926c38-f642-402c-bf38-2dcb1a148377 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc" status: 200 len: 1364 microversion: 2.1 time: 0.311326 Sep 10 12:13:05.565057 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2998/5988] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:13:05 2022] GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc => generated 1364 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:13:06.358994 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-e4671d13-9ead-4b5d-8f5e-5fcab2db547a req-15a40e6b-b5bd-4787-ab7e-1d0a3565008c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f29b62d-e533-481d-9a55-194953db02bc", "name": "network-vif-plugged", "status": "completed", "tag": "ef622768-be1a-4d83-973f-ee254195c7be"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:13:06.379372 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:13:06.381740 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e4671d13-9ead-4b5d-8f5e-5fcab2db547a req-15a40e6b-b5bd-4787-ab7e-1d0a3565008c service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:06.382457 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e4671d13-9ead-4b5d-8f5e-5fcab2db547a req-15a40e6b-b5bd-4787-ab7e-1d0a3565008c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:06.382976 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e4671d13-9ead-4b5d-8f5e-5fcab2db547a req-15a40e6b-b5bd-4787-ab7e-1d0a3565008c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:06.414093 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-e4671d13-9ead-4b5d-8f5e-5fcab2db547a req-15a40e6b-b5bd-4787-ab7e-1d0a3565008c service nova] Creating event network-vif-plugged:ef622768-be1a-4d83-973f-ee254195c7be for instance 6f29b62d-e533-481d-9a55-194953db02bc on n-h1-856895-1 Sep 10 12:13:06.421324 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-e4671d13-9ead-4b5d-8f5e-5fcab2db547a req-15a40e6b-b5bd-4787-ab7e-1d0a3565008c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066098 Sep 10 12:13:06.422787 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2991/5989] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:13:06.592000 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b8f43bfc-9421-47a1-9115-5c0e60bf82b7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:13:06.593230 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b8f43bfc-9421-47a1-9115-5c0e60bf82b7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 6f29b62d-e533-481d-9a55-194953db02bc] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:13:06.607329 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8f43bfc-9421-47a1-9115-5c0e60bf82b7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:06.608096 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8f43bfc-9421-47a1-9115-5c0e60bf82b7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:06.608732 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8f43bfc-9421-47a1-9115-5c0e60bf82b7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:06.609638 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8f43bfc-9421-47a1-9115-5c0e60bf82b7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:06.611581 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8f43bfc-9421-47a1-9115-5c0e60bf82b7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:06.612231 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8f43bfc-9421-47a1-9115-5c0e60bf82b7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:06.847964 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b8f43bfc-9421-47a1-9115-5c0e60bf82b7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:13:06.882169 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b8f43bfc-9421-47a1-9115-5c0e60bf82b7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc" status: 200 len: 1364 microversion: 2.1 time: 0.298216 Sep 10 12:13:06.891614 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 2999/5990] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:13:06 2022] GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc => generated 1364 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:13:07.918843 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-dd58f4d1-262b-4698-94f5-e23506386403 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:13:07.919601 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-dd58f4d1-262b-4698-94f5-e23506386403 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 6f29b62d-e533-481d-9a55-194953db02bc] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:13:07.939914 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd58f4d1-262b-4698-94f5-e23506386403 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:07.940723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd58f4d1-262b-4698-94f5-e23506386403 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:07.941386 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd58f4d1-262b-4698-94f5-e23506386403 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:07.942520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd58f4d1-262b-4698-94f5-e23506386403 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:07.943255 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd58f4d1-262b-4698-94f5-e23506386403 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:07.943961 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd58f4d1-262b-4698-94f5-e23506386403 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:08.227754 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-dd58f4d1-262b-4698-94f5-e23506386403 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:13:08.238518 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-dd58f4d1-262b-4698-94f5-e23506386403 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc" status: 200 len: 1364 microversion: 2.1 time: 0.325994 Sep 10 12:13:08.239196 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2992/5991] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:13:07 2022] GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc => generated 1364 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:13:09.268958 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-093da55e-f17f-48b6-8903-1a836a6f777e tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:13:09.270283 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-093da55e-f17f-48b6-8903-1a836a6f777e tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 6f29b62d-e533-481d-9a55-194953db02bc] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:13:09.280960 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-093da55e-f17f-48b6-8903-1a836a6f777e tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:09.281469 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-093da55e-f17f-48b6-8903-1a836a6f777e tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:09.281915 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-093da55e-f17f-48b6-8903-1a836a6f777e tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:09.289929 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-093da55e-f17f-48b6-8903-1a836a6f777e tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:09.290650 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-093da55e-f17f-48b6-8903-1a836a6f777e tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:09.291316 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-093da55e-f17f-48b6-8903-1a836a6f777e tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:09.501760 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-093da55e-f17f-48b6-8903-1a836a6f777e tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:13:09.510338 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-093da55e-f17f-48b6-8903-1a836a6f777e tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc" status: 200 len: 1550 microversion: 2.1 time: 0.245229 Sep 10 12:13:09.531411 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3000/5992] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:13:09 2022] GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc => generated 1550 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:13:09.537593 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2f3e64d8-dc34-4b53-b340-cb9eb93e39f7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:13:09.538106 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2f3e64d8-dc34-4b53-b340-cb9eb93e39f7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 6f29b62d-e533-481d-9a55-194953db02bc] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:13:09.563931 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f3e64d8-dc34-4b53-b340-cb9eb93e39f7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:09.565324 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f3e64d8-dc34-4b53-b340-cb9eb93e39f7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:09.566116 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f3e64d8-dc34-4b53-b340-cb9eb93e39f7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:09.584649 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f3e64d8-dc34-4b53-b340-cb9eb93e39f7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:09.585491 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f3e64d8-dc34-4b53-b340-cb9eb93e39f7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:09.587076 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f3e64d8-dc34-4b53-b340-cb9eb93e39f7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:09.764855 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2f3e64d8-dc34-4b53-b340-cb9eb93e39f7 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.233432 Sep 10 12:13:09.765474 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2993/5993] 10.222.0.23 () {58 vars in 1275 bytes} [Sat Sep 10 12:13:09 2022] GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc/os-interface => generated 284 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:13:11.754821 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-d4c2b6bf-2f8d-4f53-8667-84b79c5ee80a req-9c1c2d6d-cc74-4334-bfec-454504575b41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f29b62d-e533-481d-9a55-194953db02bc", "tag": "ef622768-be1a-4d83-973f-ee254195c7be"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:13:11.784264 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d4c2b6bf-2f8d-4f53-8667-84b79c5ee80a req-9c1c2d6d-cc74-4334-bfec-454504575b41 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:11.785567 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d4c2b6bf-2f8d-4f53-8667-84b79c5ee80a req-9c1c2d6d-cc74-4334-bfec-454504575b41 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:11.786025 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d4c2b6bf-2f8d-4f53-8667-84b79c5ee80a req-9c1c2d6d-cc74-4334-bfec-454504575b41 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:11.806996 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-d4c2b6bf-2f8d-4f53-8667-84b79c5ee80a req-9c1c2d6d-cc74-4334-bfec-454504575b41 service nova] Creating event network-changed:ef622768-be1a-4d83-973f-ee254195c7be for instance 6f29b62d-e533-481d-9a55-194953db02bc on n-h1-856895-1 Sep 10 12:13:11.813860 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-d4c2b6bf-2f8d-4f53-8667-84b79c5ee80a req-9c1c2d6d-cc74-4334-bfec-454504575b41 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068267 Sep 10 12:13:11.815249 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3001/5994] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:13:14.042036 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4b4e779c-647f-4a0f-8501-fe8405577633 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:13:14.042593 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4b4e779c-647f-4a0f-8501-fe8405577633 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] [instance: 51ee6df0-6521-4947-8c07-511d295cd115] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:13:14.044551 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:13:14.050302 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b4e779c-647f-4a0f-8501-fe8405577633 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:14.050797 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b4e779c-647f-4a0f-8501-fe8405577633 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:14.051273 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b4e779c-647f-4a0f-8501-fe8405577633 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:14.051978 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b4e779c-647f-4a0f-8501-fe8405577633 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:14.052434 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b4e779c-647f-4a0f-8501-fe8405577633 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:14.052861 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b4e779c-647f-4a0f-8501-fe8405577633 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:14.057787 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:13:14.153467 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-4b4e779c-647f-4a0f-8501-fe8405577633 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lazy-loading 'services' on Instance uuid 51ee6df0-6521-4947-8c07-511d295cd115 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:13:14.239687 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4b4e779c-647f-4a0f-8501-fe8405577633 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] 10.222.0.23 "DELETE /compute/v2.1/servers/51ee6df0-6521-4947-8c07-511d295cd115/os-volume_attachments/b85ae5f6-98b5-44df-b836-458256ad65e6" status: 202 len: 0 microversion: 2.1 time: 0.202785 Sep 10 12:13:14.240811 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2994/5995] 10.222.0.23 () {58 vars in 1416 bytes} [Sat Sep 10 12:13:14 2022] DELETE /compute/v2.1/servers/51ee6df0-6521-4947-8c07-511d295cd115/os-volume_attachments/b85ae5f6-98b5-44df-b836-458256ad65e6 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:13:17.794628 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-68aafa0b-16a5-4fe6-a77b-555a55a98fc1 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:13:17.795275 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-68aafa0b-16a5-4fe6-a77b-555a55a98fc1 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:13:17.798814 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:13:17.816970 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-68aafa0b-16a5-4fe6-a77b-555a55a98fc1 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:17.817885 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-68aafa0b-16a5-4fe6-a77b-555a55a98fc1 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:17.818532 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-68aafa0b-16a5-4fe6-a77b-555a55a98fc1 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:17.819586 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-68aafa0b-16a5-4fe6-a77b-555a55a98fc1 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:17.824014 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-68aafa0b-16a5-4fe6-a77b-555a55a98fc1 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:17.824776 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-68aafa0b-16a5-4fe6-a77b-555a55a98fc1 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:17.840726 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=67 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:13:17.894912 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-68aafa0b-16a5-4fe6-a77b-555a55a98fc1 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32/ips" status: 200 len: 151 microversion: 2.1 time: 0.113696 Sep 10 12:13:17.896440 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3002/5996] 10.222.0.23 () {58 vars in 1248 bytes} [Sat Sep 10 12:13:17 2022] GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32/ips => generated 151 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:13:20.735819 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-113e6a45-4cc8-4566-8238-d9339d5a3e9e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f93af7d-315d-4844-ae59-ef6a1b4db879"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:13:20.738531 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-113e6a45-4cc8-4566-8238-d9339d5a3e9e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:13:20.746098 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-113e6a45-4cc8-4566-8238-d9339d5a3e9e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:20.746952 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-113e6a45-4cc8-4566-8238-d9339d5a3e9e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:20.747716 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-113e6a45-4cc8-4566-8238-d9339d5a3e9e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:20.748658 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-113e6a45-4cc8-4566-8238-d9339d5a3e9e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:20.749357 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-113e6a45-4cc8-4566-8238-d9339d5a3e9e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:20.750012 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-113e6a45-4cc8-4566-8238-d9339d5a3e9e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:21.300946 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-113e6a45-4cc8-4566-8238-d9339d5a3e9e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "POST /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.571390 Sep 10 12:13:21.302298 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2995/5997] 10.222.0.23 () {60 vars in 1323 bytes} [Sat Sep 10 12:13:20 2022] POST /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32/os-volume_attachments => generated 194 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:13:22.258290 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e22343a9-695a-4bbd-803c-c549860f4cee tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:13:22.258865 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e22343a9-695a-4bbd-803c-c549860f4cee tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] [instance: 51ee6df0-6521-4947-8c07-511d295cd115] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:13:22.278340 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e22343a9-695a-4bbd-803c-c549860f4cee tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:22.278833 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e22343a9-695a-4bbd-803c-c549860f4cee tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:22.279295 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e22343a9-695a-4bbd-803c-c549860f4cee tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:22.280224 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e22343a9-695a-4bbd-803c-c549860f4cee tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:22.280849 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e22343a9-695a-4bbd-803c-c549860f4cee tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:22.281443 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e22343a9-695a-4bbd-803c-c549860f4cee tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:22.344082 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e22343a9-695a-4bbd-803c-c549860f4cee tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] [instance: 51ee6df0-6521-4947-8c07-511d295cd115] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:13:22.513477 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e22343a9-695a-4bbd-803c-c549860f4cee tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] 10.222.0.23 "DELETE /compute/v2.1/servers/51ee6df0-6521-4947-8c07-511d295cd115" status: 204 len: 0 microversion: 2.1 time: 0.258804 Sep 10 12:13:22.514127 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3003/5998] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:13:22 2022] DELETE /compute/v2.1/servers/51ee6df0-6521-4947-8c07-511d295cd115 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:13:22.527924 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1c8fb197-951f-4d0c-9abf-e807c0cb911c tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:13:22.528807 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1c8fb197-951f-4d0c-9abf-e807c0cb911c tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] [instance: 51ee6df0-6521-4947-8c07-511d295cd115] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:13:22.545705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c8fb197-951f-4d0c-9abf-e807c0cb911c tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:22.546290 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c8fb197-951f-4d0c-9abf-e807c0cb911c tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:22.546957 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c8fb197-951f-4d0c-9abf-e807c0cb911c tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:22.547783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c8fb197-951f-4d0c-9abf-e807c0cb911c tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:22.548333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c8fb197-951f-4d0c-9abf-e807c0cb911c tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:22.548877 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c8fb197-951f-4d0c-9abf-e807c0cb911c tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:22.867232 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1c8fb197-951f-4d0c-9abf-e807c0cb911c tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9b0de88baf482a8aadf98bc6eb590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9535c16997f458394066e442d036efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:13:22.884473 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1c8fb197-951f-4d0c-9abf-e807c0cb911c tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] 10.222.0.23 "GET /compute/v2.1/servers/51ee6df0-6521-4947-8c07-511d295cd115" status: 200 len: 1514 microversion: 2.1 time: 0.365191 Sep 10 12:13:22.886144 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2996/5999] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:13:22 2022] GET /compute/v2.1/servers/51ee6df0-6521-4947-8c07-511d295cd115 => generated 1514 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:13:23.910607 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ce5d7f98-578e-46ab-bc21-ff55e9e71bf6 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:13:23.912612 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ce5d7f98-578e-46ab-bc21-ff55e9e71bf6 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] [instance: 51ee6df0-6521-4947-8c07-511d295cd115] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:13:23.921069 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ce5d7f98-578e-46ab-bc21-ff55e9e71bf6 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:23.922572 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ce5d7f98-578e-46ab-bc21-ff55e9e71bf6 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:23.923385 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ce5d7f98-578e-46ab-bc21-ff55e9e71bf6 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:23.924487 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ce5d7f98-578e-46ab-bc21-ff55e9e71bf6 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:23.925394 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ce5d7f98-578e-46ab-bc21-ff55e9e71bf6 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:23.926069 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ce5d7f98-578e-46ab-bc21-ff55e9e71bf6 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:24.171178 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ce5d7f98-578e-46ab-bc21-ff55e9e71bf6 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9b0de88baf482a8aadf98bc6eb590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9535c16997f458394066e442d036efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:13:24.181393 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ce5d7f98-578e-46ab-bc21-ff55e9e71bf6 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] 10.222.0.23 "GET /compute/v2.1/servers/51ee6df0-6521-4947-8c07-511d295cd115" status: 200 len: 1514 microversion: 2.1 time: 0.276459 Sep 10 12:13:24.197681 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3004/6000] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:13:23 2022] GET /compute/v2.1/servers/51ee6df0-6521-4947-8c07-511d295cd115 => generated 1514 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:13:25.045298 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-3a25e43a-db2a-4d0b-9950-f1b13251a594 req-8e4a5466-d916-4d24-90ec-8380677bbb9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51ee6df0-6521-4947-8c07-511d295cd115", "name": "network-vif-deleted", "tag": "a0db988c-13e1-40a0-b9e7-e92b00ca81a7"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:13:25.078054 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-3a25e43a-db2a-4d0b-9950-f1b13251a594 req-8e4a5466-d916-4d24-90ec-8380677bbb9c service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:25.078605 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-3a25e43a-db2a-4d0b-9950-f1b13251a594 req-8e4a5466-d916-4d24-90ec-8380677bbb9c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:25.079343 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-3a25e43a-db2a-4d0b-9950-f1b13251a594 req-8e4a5466-d916-4d24-90ec-8380677bbb9c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:25.092817 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-3a25e43a-db2a-4d0b-9950-f1b13251a594 req-8e4a5466-d916-4d24-90ec-8380677bbb9c service nova] Creating event network-vif-deleted:a0db988c-13e1-40a0-b9e7-e92b00ca81a7 for instance 51ee6df0-6521-4947-8c07-511d295cd115 on n-h2-856895-1 Sep 10 12:13:25.098266 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-3a25e43a-db2a-4d0b-9950-f1b13251a594 req-8e4a5466-d916-4d24-90ec-8380677bbb9c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057664 Sep 10 12:13:25.099498 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2997/6001] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:13:25.208358 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-57dc4ad9-75b4-42c2-b51c-f3c4162c6dbe tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:13:25.209643 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-57dc4ad9-75b4-42c2-b51c-f3c4162c6dbe tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] [instance: 51ee6df0-6521-4947-8c07-511d295cd115] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:13:25.218741 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-57dc4ad9-75b4-42c2-b51c-f3c4162c6dbe tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:25.219729 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-57dc4ad9-75b4-42c2-b51c-f3c4162c6dbe tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:25.220455 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-57dc4ad9-75b4-42c2-b51c-f3c4162c6dbe tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:25.222426 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-57dc4ad9-75b4-42c2-b51c-f3c4162c6dbe tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:25.224016 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-57dc4ad9-75b4-42c2-b51c-f3c4162c6dbe tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:25.225104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-57dc4ad9-75b4-42c2-b51c-f3c4162c6dbe tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:25.294284 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-57dc4ad9-75b4-42c2-b51c-f3c4162c6dbe tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:25.294899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-57dc4ad9-75b4-42c2-b51c-f3c4162c6dbe tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:25.295553 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-57dc4ad9-75b4-42c2-b51c-f3c4162c6dbe tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:25.296144 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-57dc4ad9-75b4-42c2-b51c-f3c4162c6dbe tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lazy-loading 'fault' on Instance uuid 51ee6df0-6521-4947-8c07-511d295cd115 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:13:25.477887 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-57dc4ad9-75b4-42c2-b51c-f3c4162c6dbe tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9b0de88baf482a8aadf98bc6eb590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9535c16997f458394066e442d036efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:13:25.491385 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-57dc4ad9-75b4-42c2-b51c-f3c4162c6dbe tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] 10.222.0.23 "GET /compute/v2.1/servers/51ee6df0-6521-4947-8c07-511d295cd115" status: 200 len: 1309 microversion: 2.1 time: 0.289166 Sep 10 12:13:25.492556 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3005/6002] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:13:25 2022] GET /compute/v2.1/servers/51ee6df0-6521-4947-8c07-511d295cd115 => generated 1309 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:13:26.526711 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-54d0700b-29f8-4296-9f57-42f3d0afe26b tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:13:26.528100 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-54d0700b-29f8-4296-9f57-42f3d0afe26b tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] [instance: 51ee6df0-6521-4947-8c07-511d295cd115] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:13:26.535670 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54d0700b-29f8-4296-9f57-42f3d0afe26b tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:26.536395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54d0700b-29f8-4296-9f57-42f3d0afe26b tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:26.537017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54d0700b-29f8-4296-9f57-42f3d0afe26b tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:26.537911 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54d0700b-29f8-4296-9f57-42f3d0afe26b tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:26.538546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54d0700b-29f8-4296-9f57-42f3d0afe26b tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:26.539188 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54d0700b-29f8-4296-9f57-42f3d0afe26b tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:26.556810 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-54d0700b-29f8-4296-9f57-42f3d0afe26b tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] HTTP exception thrown: Instance 51ee6df0-6521-4947-8c07-511d295cd115 could not be found. Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-54d0700b-29f8-4296-9f57-42f3d0afe26b tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Request method failure captured: Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/51ee6df0-6521-4947-8c07-511d295cd115 HTTP/1.1 Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH7PAl1ia75DfWAE1b4bGg_UAIJkg8RWCAP2OKyRYafrsl3ko2QhRGlLDGZdIYZ_t7ZJkNoTUNC0WI8S6wq8PMomMF9aC78MVfBaBcHBqPIHLnrprYNKAyD7OiCyyPuvSgm-DG0h6DSB7J1Sgek3GA8NySmi5Ew15P1KtczsQJfL8Og Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: d9535c16997f458394066e442d036efe Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-VolumesSnapshotTestJSON-560118678 Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9535c16997f458394066e442d036efe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9535c16997f458394066e442d036efe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d9535c16997f458394066e442d036efe", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d9535c16997f458394066e442d036efe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-VolumesSnapshotTestJSON-560118678 Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: d9535c16997f458394066e442d036efe Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-560118678 Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-VolumesSnapshotTestJSON-560118678-project Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 8e9b0de88baf482a8aadf98bc6eb590f Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-VolumesSnapshotTestJSON-560118678-project Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 51ee6df0-6521-4947-8c07-511d295cd115 could not be found. Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '51ee6df0-6521-4947-8c07-511d295cd115'} Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51ee6df0-6521-4947-8c07-511d295cd115 could not be found. Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51ee6df0-6521-4947-8c07-511d295cd115 could not be found. Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:13:26.559330 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:13:26.564851 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:13:26.564851 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:13:26.564851 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:13:26.564851 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:13:26.564851 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:13:26.564851 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51ee6df0-6521-4947-8c07-511d295cd115 could not be found. Sep 10 12:13:26.564851 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:13:26.566249 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-54d0700b-29f8-4296-9f57-42f3d0afe26b tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Returning 404 to user: Instance 51ee6df0-6521-4947-8c07-511d295cd115 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:13:26.567390 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-54d0700b-29f8-4296-9f57-42f3d0afe26b tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] 10.222.0.23 "GET /compute/v2.1/servers/51ee6df0-6521-4947-8c07-511d295cd115" status: 404 len: 111 microversion: 2.1 time: 0.052373 Sep 10 12:13:26.568378 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2998/6003] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:13:26 2022] GET /compute/v2.1/servers/51ee6df0-6521-4947-8c07-511d295cd115 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:13:33.831971 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fcf9d8da-ea9d-4a6e-b7cb-32cd0963c139 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:13:33.832497 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fcf9d8da-ea9d-4a6e-b7cb-32cd0963c139 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:13:33.840703 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fcf9d8da-ea9d-4a6e-b7cb-32cd0963c139 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:33.840968 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fcf9d8da-ea9d-4a6e-b7cb-32cd0963c139 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:33.841413 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fcf9d8da-ea9d-4a6e-b7cb-32cd0963c139 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:33.842130 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fcf9d8da-ea9d-4a6e-b7cb-32cd0963c139 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:33.842799 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fcf9d8da-ea9d-4a6e-b7cb-32cd0963c139 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:33.843255 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fcf9d8da-ea9d-4a6e-b7cb-32cd0963c139 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:33.935936 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-fcf9d8da-ea9d-4a6e-b7cb-32cd0963c139 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lazy-loading 'services' on Instance uuid 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:13:34.020349 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fcf9d8da-ea9d-4a6e-b7cb-32cd0963c139 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32/os-volume_attachments/7f93af7d-315d-4844-ae59-ef6a1b4db879" status: 202 len: 0 microversion: 2.1 time: 0.193342 Sep 10 12:13:34.025301 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3006/6004] 10.222.0.23 () {58 vars in 1416 bytes} [Sat Sep 10 12:13:33 2022] DELETE /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32/os-volume_attachments/7f93af7d-315d-4844-ae59-ef6a1b4db879 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:13:34.030269 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-99953b85-794b-46c4-98b9-5501edccfa12 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:13:34.033052 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-99953b85-794b-46c4-98b9-5501edccfa12 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:13:34.039537 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99953b85-794b-46c4-98b9-5501edccfa12 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:34.040024 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99953b85-794b-46c4-98b9-5501edccfa12 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:34.040453 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99953b85-794b-46c4-98b9-5501edccfa12 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:34.041975 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99953b85-794b-46c4-98b9-5501edccfa12 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:34.042799 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99953b85-794b-46c4-98b9-5501edccfa12 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:34.045108 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99953b85-794b-46c4-98b9-5501edccfa12 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:34.082195 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-99953b85-794b-46c4-98b9-5501edccfa12 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056507 Sep 10 12:13:34.082787 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 2999/6005] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:13:34 2022] GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:13:34.969630 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4897e168-9a3d-4177-b34b-ad267327b4e0 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1265177910", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "81792b86-4fce-4f38-a0cc-de3c164bb7d5"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:13:35.034631 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-4897e168-9a3d-4177-b34b-ad267327b4e0 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] validate_networks() for [('81792b86-4fce-4f38-a0cc-de3c164bb7d5', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:13:35.095155 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cdcad0a6-beb7-451f-a568-cbe75fff8fe0 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:13:35.097872 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cdcad0a6-beb7-451f-a568-cbe75fff8fe0 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:13:35.105617 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cdcad0a6-beb7-451f-a568-cbe75fff8fe0 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:35.106596 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cdcad0a6-beb7-451f-a568-cbe75fff8fe0 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:35.107239 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cdcad0a6-beb7-451f-a568-cbe75fff8fe0 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:35.108119 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cdcad0a6-beb7-451f-a568-cbe75fff8fe0 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:35.108739 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cdcad0a6-beb7-451f-a568-cbe75fff8fe0 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:35.109334 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cdcad0a6-beb7-451f-a568-cbe75fff8fe0 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:35.162782 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cdcad0a6-beb7-451f-a568-cbe75fff8fe0 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071752 Sep 10 12:13:35.164011 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3000/6006] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:13:35 2022] GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:13:35.737196 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-4897e168-9a3d-4177-b34b-ad267327b4e0 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:13:35.738479 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-4897e168-9a3d-4177-b34b-ad267327b4e0 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:13:35.739532 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-4897e168-9a3d-4177-b34b-ad267327b4e0 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:13:35.740401 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-4897e168-9a3d-4177-b34b-ad267327b4e0 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:13:35.742277 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-4897e168-9a3d-4177-b34b-ad267327b4e0 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:13:35.755442 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4897e168-9a3d-4177-b34b-ad267327b4e0 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:35.758041 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4897e168-9a3d-4177-b34b-ad267327b4e0 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:35.758692 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4897e168-9a3d-4177-b34b-ad267327b4e0 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:35.760800 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4897e168-9a3d-4177-b34b-ad267327b4e0 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:35.764415 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4897e168-9a3d-4177-b34b-ad267327b4e0 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:35.765032 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4897e168-9a3d-4177-b34b-ad267327b4e0 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:35.790614 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-4897e168-9a3d-4177-b34b-ad267327b4e0 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Getting quotas for project d9535c16997f458394066e442d036efe. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:13:35.797414 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-4897e168-9a3d-4177-b34b-ad267327b4e0 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Getting quotas for user 8e9b0de88baf482a8aadf98bc6eb590f and project d9535c16997f458394066e442d036efe. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:13:35.812755 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4897e168-9a3d-4177-b34b-ad267327b4e0 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:13:35.815397 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4897e168-9a3d-4177-b34b-ad267327b4e0 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] [instance: 621db181-73f9-4ef3-ab2e-844486796b53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:13:35.884606 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4897e168-9a3d-4177-b34b-ad267327b4e0 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.921659 Sep 10 12:13:35.885407 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3007/6007] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:13:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:13:35.898126 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cdfc5f1b-b42f-48ba-a774-f43d74911761 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:13:35.899099 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cdfc5f1b-b42f-48ba-a774-f43d74911761 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] [instance: 621db181-73f9-4ef3-ab2e-844486796b53] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:13:35.996142 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cdfc5f1b-b42f-48ba-a774-f43d74911761 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9b0de88baf482a8aadf98bc6eb590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9535c16997f458394066e442d036efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:13:36.004086 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cdfc5f1b-b42f-48ba-a774-f43d74911761 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] 10.222.0.23 "GET /compute/v2.1/servers/621db181-73f9-4ef3-ab2e-844486796b53" status: 200 len: 1219 microversion: 2.1 time: 0.110677 Sep 10 12:13:36.005046 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3001/6008] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:13:35 2022] GET /compute/v2.1/servers/621db181-73f9-4ef3-ab2e-844486796b53 => generated 1219 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:13:36.178388 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e4150d79-d651-43fc-88e5-9f48fee46868 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:13:36.181144 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e4150d79-d651-43fc-88e5-9f48fee46868 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:13:36.198628 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4150d79-d651-43fc-88e5-9f48fee46868 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:36.199133 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4150d79-d651-43fc-88e5-9f48fee46868 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:36.199599 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4150d79-d651-43fc-88e5-9f48fee46868 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:36.212123 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4150d79-d651-43fc-88e5-9f48fee46868 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:36.213371 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4150d79-d651-43fc-88e5-9f48fee46868 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:36.215415 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4150d79-d651-43fc-88e5-9f48fee46868 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:36.276096 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e4150d79-d651-43fc-88e5-9f48fee46868 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102149 Sep 10 12:13:36.277968 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3008/6009] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:13:36 2022] GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:13:37.027832 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ccf28ba3-3d5a-4a2f-ac94-f6e15bfc3c51 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:13:37.029107 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ccf28ba3-3d5a-4a2f-ac94-f6e15bfc3c51 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] [instance: 621db181-73f9-4ef3-ab2e-844486796b53] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:13:37.040800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ccf28ba3-3d5a-4a2f-ac94-f6e15bfc3c51 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:37.043101 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ccf28ba3-3d5a-4a2f-ac94-f6e15bfc3c51 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:37.043572 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ccf28ba3-3d5a-4a2f-ac94-f6e15bfc3c51 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:37.052162 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ccf28ba3-3d5a-4a2f-ac94-f6e15bfc3c51 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:37.053190 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ccf28ba3-3d5a-4a2f-ac94-f6e15bfc3c51 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:37.053846 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ccf28ba3-3d5a-4a2f-ac94-f6e15bfc3c51 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:37.146457 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ccf28ba3-3d5a-4a2f-ac94-f6e15bfc3c51 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9b0de88baf482a8aadf98bc6eb590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9535c16997f458394066e442d036efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:13:37.156191 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ccf28ba3-3d5a-4a2f-ac94-f6e15bfc3c51 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] 10.222.0.23 "GET /compute/v2.1/servers/621db181-73f9-4ef3-ab2e-844486796b53" status: 200 len: 1271 microversion: 2.1 time: 0.132673 Sep 10 12:13:37.157470 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3002/6010] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:13:37 2022] GET /compute/v2.1/servers/621db181-73f9-4ef3-ab2e-844486796b53 => generated 1271 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:13:37.289789 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7efbc0c3-c64d-46ea-a83b-dd0df81aa6b4 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:13:37.292920 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7efbc0c3-c64d-46ea-a83b-dd0df81aa6b4 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:13:37.306049 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7efbc0c3-c64d-46ea-a83b-dd0df81aa6b4 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:37.313793 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7efbc0c3-c64d-46ea-a83b-dd0df81aa6b4 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:37.314490 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7efbc0c3-c64d-46ea-a83b-dd0df81aa6b4 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:37.315433 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7efbc0c3-c64d-46ea-a83b-dd0df81aa6b4 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:37.316054 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7efbc0c3-c64d-46ea-a83b-dd0df81aa6b4 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:37.316647 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7efbc0c3-c64d-46ea-a83b-dd0df81aa6b4 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:37.377826 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7efbc0c3-c64d-46ea-a83b-dd0df81aa6b4 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092212 Sep 10 12:13:37.379152 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3009/6011] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:13:37 2022] GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:13:38.181688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4fbf6f67-7ddb-4521-8afa-1c036e64cdc6 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:13:38.182873 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4fbf6f67-7ddb-4521-8afa-1c036e64cdc6 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] [instance: 621db181-73f9-4ef3-ab2e-844486796b53] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:13:38.204906 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4fbf6f67-7ddb-4521-8afa-1c036e64cdc6 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:38.211511 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4fbf6f67-7ddb-4521-8afa-1c036e64cdc6 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:38.212038 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4fbf6f67-7ddb-4521-8afa-1c036e64cdc6 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:38.213333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4fbf6f67-7ddb-4521-8afa-1c036e64cdc6 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:38.213932 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4fbf6f67-7ddb-4521-8afa-1c036e64cdc6 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:38.214366 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4fbf6f67-7ddb-4521-8afa-1c036e64cdc6 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:38.347555 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4fbf6f67-7ddb-4521-8afa-1c036e64cdc6 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9b0de88baf482a8aadf98bc6eb590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9535c16997f458394066e442d036efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:13:38.371610 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4fbf6f67-7ddb-4521-8afa-1c036e64cdc6 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] 10.222.0.23 "GET /compute/v2.1/servers/621db181-73f9-4ef3-ab2e-844486796b53" status: 200 len: 1277 microversion: 2.1 time: 0.194047 Sep 10 12:13:38.372293 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3003/6012] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:13:38 2022] GET /compute/v2.1/servers/621db181-73f9-4ef3-ab2e-844486796b53 => generated 1277 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:13:38.391207 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b88da2fd-0295-42de-85c3-342672169f8a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:13:38.395258 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b88da2fd-0295-42de-85c3-342672169f8a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:13:38.409488 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b88da2fd-0295-42de-85c3-342672169f8a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:38.410195 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b88da2fd-0295-42de-85c3-342672169f8a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:38.410809 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b88da2fd-0295-42de-85c3-342672169f8a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:38.411752 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b88da2fd-0295-42de-85c3-342672169f8a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:38.412379 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b88da2fd-0295-42de-85c3-342672169f8a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:38.412982 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b88da2fd-0295-42de-85c3-342672169f8a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:38.460896 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b88da2fd-0295-42de-85c3-342672169f8a tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073733 Sep 10 12:13:38.461797 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3010/6013] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:13:38 2022] GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:13:39.402419 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7975622e-7239-412b-8864-e9a90f55c613 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:13:39.404583 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7975622e-7239-412b-8864-e9a90f55c613 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] [instance: 621db181-73f9-4ef3-ab2e-844486796b53] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:13:39.424130 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7975622e-7239-412b-8864-e9a90f55c613 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:39.424882 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7975622e-7239-412b-8864-e9a90f55c613 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:39.425518 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7975622e-7239-412b-8864-e9a90f55c613 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:39.426433 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7975622e-7239-412b-8864-e9a90f55c613 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:39.429273 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7975622e-7239-412b-8864-e9a90f55c613 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:39.429969 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7975622e-7239-412b-8864-e9a90f55c613 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:39.473555 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-839b2fff-31b8-4801-85e5-820e10a06ed9 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:13:39.476364 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-839b2fff-31b8-4801-85e5-820e10a06ed9 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:13:39.490843 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-839b2fff-31b8-4801-85e5-820e10a06ed9 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:39.495829 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-839b2fff-31b8-4801-85e5-820e10a06ed9 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:39.496289 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-839b2fff-31b8-4801-85e5-820e10a06ed9 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:39.497022 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-839b2fff-31b8-4801-85e5-820e10a06ed9 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:39.499345 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-839b2fff-31b8-4801-85e5-820e10a06ed9 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:39.499819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-839b2fff-31b8-4801-85e5-820e10a06ed9 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:39.569480 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-839b2fff-31b8-4801-85e5-820e10a06ed9 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100182 Sep 10 12:13:39.577419 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3011/6014] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:13:39 2022] GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:13:39.732076 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7975622e-7239-412b-8864-e9a90f55c613 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9b0de88baf482a8aadf98bc6eb590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9535c16997f458394066e442d036efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:13:39.769616 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7975622e-7239-412b-8864-e9a90f55c613 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] 10.222.0.23 "GET /compute/v2.1/servers/621db181-73f9-4ef3-ab2e-844486796b53" status: 200 len: 1319 microversion: 2.1 time: 0.369859 Sep 10 12:13:39.783560 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3004/6015] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:13:39 2022] GET /compute/v2.1/servers/621db181-73f9-4ef3-ab2e-844486796b53 => generated 1319 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:13:40.127351 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-2b02e7c3-1e19-4ddd-9125-b03e072e7368 req-f14d5c6b-18cb-4813-94cf-8c8d354d4a18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "621db181-73f9-4ef3-ab2e-844486796b53", "tag": "37e8848f-7451-4df4-9635-b0d7d1e3764d"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:13:40.151976 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-2b02e7c3-1e19-4ddd-9125-b03e072e7368 req-f14d5c6b-18cb-4813-94cf-8c8d354d4a18 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:40.152587 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-2b02e7c3-1e19-4ddd-9125-b03e072e7368 req-f14d5c6b-18cb-4813-94cf-8c8d354d4a18 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:40.153056 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-2b02e7c3-1e19-4ddd-9125-b03e072e7368 req-f14d5c6b-18cb-4813-94cf-8c8d354d4a18 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:40.166342 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-2b02e7c3-1e19-4ddd-9125-b03e072e7368 req-f14d5c6b-18cb-4813-94cf-8c8d354d4a18 service nova] Creating event network-changed:37e8848f-7451-4df4-9635-b0d7d1e3764d for instance 621db181-73f9-4ef3-ab2e-844486796b53 on n-h2-856895-1 Sep 10 12:13:40.172570 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-2b02e7c3-1e19-4ddd-9125-b03e072e7368 req-f14d5c6b-18cb-4813-94cf-8c8d354d4a18 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049313 Sep 10 12:13:40.173585 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3012/6016] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:13:40.584035 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e31831e5-eaea-4234-a138-563ef8e4fb0c tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:13:40.588966 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e31831e5-eaea-4234-a138-563ef8e4fb0c tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:13:40.599501 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e31831e5-eaea-4234-a138-563ef8e4fb0c tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:40.600352 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e31831e5-eaea-4234-a138-563ef8e4fb0c tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:40.600984 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e31831e5-eaea-4234-a138-563ef8e4fb0c tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:40.602029 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e31831e5-eaea-4234-a138-563ef8e4fb0c tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:40.603148 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e31831e5-eaea-4234-a138-563ef8e4fb0c tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:40.604462 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e31831e5-eaea-4234-a138-563ef8e4fb0c tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:40.690612 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e31831e5-eaea-4234-a138-563ef8e4fb0c tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.109412 Sep 10 12:13:40.692983 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3005/6017] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:13:40 2022] GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32/os-volume_attachments => generated 25 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 12:13:40.770238 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c4a5d3e1-bdf7-42ba-bce8-d7409e30811e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:13:40.771067 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c4a5d3e1-bdf7-42ba-bce8-d7409e30811e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:13:40.782214 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c4a5d3e1-bdf7-42ba-bce8-d7409e30811e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:40.783104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c4a5d3e1-bdf7-42ba-bce8-d7409e30811e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:40.783571 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c4a5d3e1-bdf7-42ba-bce8-d7409e30811e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:40.784496 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c4a5d3e1-bdf7-42ba-bce8-d7409e30811e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:40.785476 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c4a5d3e1-bdf7-42ba-bce8-d7409e30811e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:40.786085 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c4a5d3e1-bdf7-42ba-bce8-d7409e30811e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:40.799069 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-be91ffa8-7eee-465e-834a-b19fbcf35d32 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:13:40.800068 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-be91ffa8-7eee-465e-834a-b19fbcf35d32 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] [instance: 621db181-73f9-4ef3-ab2e-844486796b53] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:13:40.808748 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be91ffa8-7eee-465e-834a-b19fbcf35d32 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:40.809779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be91ffa8-7eee-465e-834a-b19fbcf35d32 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:40.810603 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be91ffa8-7eee-465e-834a-b19fbcf35d32 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:40.813502 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be91ffa8-7eee-465e-834a-b19fbcf35d32 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:40.814388 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be91ffa8-7eee-465e-834a-b19fbcf35d32 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:40.815220 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be91ffa8-7eee-465e-834a-b19fbcf35d32 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:40.825979 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c4a5d3e1-bdf7-42ba-bce8-d7409e30811e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:13:40.954584 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c4a5d3e1-bdf7-42ba-bce8-d7409e30811e tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32" status: 204 len: 0 microversion: 2.1 time: 0.189912 Sep 10 12:13:40.958074 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3013/6018] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:13:40 2022] DELETE /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 12:13:40.968371 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-834c9778-cd60-445a-839d-8cde11a2dbc2 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:13:40.970010 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-834c9778-cd60-445a-839d-8cde11a2dbc2 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:13:40.980179 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-834c9778-cd60-445a-839d-8cde11a2dbc2 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:40.988946 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-834c9778-cd60-445a-839d-8cde11a2dbc2 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:40.989968 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-834c9778-cd60-445a-839d-8cde11a2dbc2 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:40.990743 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-834c9778-cd60-445a-839d-8cde11a2dbc2 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:40.991245 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-834c9778-cd60-445a-839d-8cde11a2dbc2 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:40.991845 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-834c9778-cd60-445a-839d-8cde11a2dbc2 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:41.144801 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-be91ffa8-7eee-465e-834a-b19fbcf35d32 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9b0de88baf482a8aadf98bc6eb590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9535c16997f458394066e442d036efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:13:41.153957 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-be91ffa8-7eee-465e-834a-b19fbcf35d32 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] 10.222.0.23 "GET /compute/v2.1/servers/621db181-73f9-4ef3-ab2e-844486796b53" status: 200 len: 1319 microversion: 2.1 time: 0.364200 Sep 10 12:13:41.157691 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3006/6019] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:13:40 2022] GET /compute/v2.1/servers/621db181-73f9-4ef3-ab2e-844486796b53 => generated 1319 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:13:41.204291 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-834c9778-cd60-445a-839d-8cde11a2dbc2 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:13:41.213094 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-834c9778-cd60-445a-839d-8cde11a2dbc2 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32" status: 200 len: 1683 microversion: 2.1 time: 0.249229 Sep 10 12:13:41.214052 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3014/6020] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:13:40 2022] GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 => generated 1683 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:13:42.181535 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e61f9c75-faf2-4d5a-bcdf-c1b0ef80a7b5 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:13:42.182418 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e61f9c75-faf2-4d5a-bcdf-c1b0ef80a7b5 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] [instance: 621db181-73f9-4ef3-ab2e-844486796b53] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:13:42.190694 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e61f9c75-faf2-4d5a-bcdf-c1b0ef80a7b5 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:42.191226 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e61f9c75-faf2-4d5a-bcdf-c1b0ef80a7b5 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:42.191946 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e61f9c75-faf2-4d5a-bcdf-c1b0ef80a7b5 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:42.192670 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e61f9c75-faf2-4d5a-bcdf-c1b0ef80a7b5 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:42.193140 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e61f9c75-faf2-4d5a-bcdf-c1b0ef80a7b5 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:42.193578 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e61f9c75-faf2-4d5a-bcdf-c1b0ef80a7b5 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:42.241182 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-df27dbb8-e513-4468-b632-43725701746f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:13:42.241804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-df27dbb8-e513-4468-b632-43725701746f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:13:42.251446 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-df27dbb8-e513-4468-b632-43725701746f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:42.256638 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-df27dbb8-e513-4468-b632-43725701746f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:42.257493 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-df27dbb8-e513-4468-b632-43725701746f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:42.258482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-df27dbb8-e513-4468-b632-43725701746f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:42.259405 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-df27dbb8-e513-4468-b632-43725701746f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:42.260897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-df27dbb8-e513-4468-b632-43725701746f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:42.403729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e61f9c75-faf2-4d5a-bcdf-c1b0ef80a7b5 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9b0de88baf482a8aadf98bc6eb590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9535c16997f458394066e442d036efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:13:42.413780 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e61f9c75-faf2-4d5a-bcdf-c1b0ef80a7b5 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] 10.222.0.23 "GET /compute/v2.1/servers/621db181-73f9-4ef3-ab2e-844486796b53" status: 200 len: 1319 microversion: 2.1 time: 0.236378 Sep 10 12:13:42.420353 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3007/6021] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:13:42 2022] GET /compute/v2.1/servers/621db181-73f9-4ef3-ab2e-844486796b53 => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:13:42.519201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-df27dbb8-e513-4468-b632-43725701746f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:13:42.529908 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-df27dbb8-e513-4468-b632-43725701746f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32" status: 200 len: 1683 microversion: 2.1 time: 0.295736 Sep 10 12:13:42.541405 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3015/6022] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:13:42 2022] GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 => generated 1683 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:13:43.443308 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7d127dbc-2996-491b-8021-a28a6f40f10e tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:13:43.443922 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7d127dbc-2996-491b-8021-a28a6f40f10e tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] [instance: 621db181-73f9-4ef3-ab2e-844486796b53] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:13:43.455180 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d127dbc-2996-491b-8021-a28a6f40f10e tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:43.455696 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d127dbc-2996-491b-8021-a28a6f40f10e tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:43.456144 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d127dbc-2996-491b-8021-a28a6f40f10e tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:43.456881 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d127dbc-2996-491b-8021-a28a6f40f10e tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:43.457349 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d127dbc-2996-491b-8021-a28a6f40f10e tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:43.457785 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d127dbc-2996-491b-8021-a28a6f40f10e tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:43.553805 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-96b2d13b-2d44-474c-96ea-d4bc053b3586 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:13:43.555182 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-96b2d13b-2d44-474c-96ea-d4bc053b3586 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:13:43.563048 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-96b2d13b-2d44-474c-96ea-d4bc053b3586 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:43.576061 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-96b2d13b-2d44-474c-96ea-d4bc053b3586 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:43.576830 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-96b2d13b-2d44-474c-96ea-d4bc053b3586 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:43.577799 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-96b2d13b-2d44-474c-96ea-d4bc053b3586 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:43.578447 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-96b2d13b-2d44-474c-96ea-d4bc053b3586 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:43.579081 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-96b2d13b-2d44-474c-96ea-d4bc053b3586 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:43.584151 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:13:43.761234 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-96b2d13b-2d44-474c-96ea-d4bc053b3586 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:13:43.774431 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-96b2d13b-2d44-474c-96ea-d4bc053b3586 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32" status: 200 len: 1615 microversion: 2.1 time: 0.224590 Sep 10 12:13:43.775587 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3016/6023] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:13:43 2022] GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 => generated 1615 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:13:43.861252 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7d127dbc-2996-491b-8021-a28a6f40f10e tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9b0de88baf482a8aadf98bc6eb590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9535c16997f458394066e442d036efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:13:43.875664 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7d127dbc-2996-491b-8021-a28a6f40f10e tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] 10.222.0.23 "GET /compute/v2.1/servers/621db181-73f9-4ef3-ab2e-844486796b53" status: 200 len: 1319 microversion: 2.1 time: 0.433010 Sep 10 12:13:43.877198 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3008/6024] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:13:43 2022] GET /compute/v2.1/servers/621db181-73f9-4ef3-ab2e-844486796b53 => generated 1319 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:13:44.336130 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-39a49912-6b97-462d-a393-08fa2210c80c req-e7a0e004-4135-470d-a6b2-08c63a6aa3d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c1bb60f-ebea-4e31-9c65-2c7b45af3e32", "name": "network-vif-deleted", "tag": "1e3ca497-9731-45ff-97b5-f0c92bf11053"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:13:44.357736 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-39a49912-6b97-462d-a393-08fa2210c80c req-e7a0e004-4135-470d-a6b2-08c63a6aa3d7 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:44.358883 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-39a49912-6b97-462d-a393-08fa2210c80c req-e7a0e004-4135-470d-a6b2-08c63a6aa3d7 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:44.359359 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-39a49912-6b97-462d-a393-08fa2210c80c req-e7a0e004-4135-470d-a6b2-08c63a6aa3d7 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:44.379539 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-39a49912-6b97-462d-a393-08fa2210c80c req-e7a0e004-4135-470d-a6b2-08c63a6aa3d7 service nova] Creating event network-vif-deleted:1e3ca497-9731-45ff-97b5-f0c92bf11053 for instance 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 on n-h1-856895-1 Sep 10 12:13:44.386483 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-39a49912-6b97-462d-a393-08fa2210c80c req-e7a0e004-4135-470d-a6b2-08c63a6aa3d7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055638 Sep 10 12:13:44.387078 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3017/6025] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:13:44.803330 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b8a77835-914e-4cce-9b71-73237bc56b6d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:13:44.804601 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b8a77835-914e-4cce-9b71-73237bc56b6d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:13:44.812385 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=32 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:13:44.814028 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b8a77835-914e-4cce-9b71-73237bc56b6d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:44.814717 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b8a77835-914e-4cce-9b71-73237bc56b6d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:44.815409 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b8a77835-914e-4cce-9b71-73237bc56b6d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:44.816336 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b8a77835-914e-4cce-9b71-73237bc56b6d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:44.817000 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b8a77835-914e-4cce-9b71-73237bc56b6d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:44.817785 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b8a77835-914e-4cce-9b71-73237bc56b6d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:44.823703 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:13:44.860097 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b8a77835-914e-4cce-9b71-73237bc56b6d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:44.860806 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b8a77835-914e-4cce-9b71-73237bc56b6d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:44.861423 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b8a77835-914e-4cce-9b71-73237bc56b6d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:44.862430 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-b8a77835-914e-4cce-9b71-73237bc56b6d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lazy-loading 'fault' on Instance uuid 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:13:44.904763 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-99dc0d14-b960-475d-b719-6018a62670c6 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:13:44.905795 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-99dc0d14-b960-475d-b719-6018a62670c6 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] [instance: 621db181-73f9-4ef3-ab2e-844486796b53] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:13:44.913786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b8a77835-914e-4cce-9b71-73237bc56b6d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199d923de84c45789188543de904314a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03301ecc81fe426bafc4be81413d1265', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:13:44.923554 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b8a77835-914e-4cce-9b71-73237bc56b6d tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32" status: 200 len: 1331 microversion: 2.1 time: 0.124042 Sep 10 12:13:44.925159 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3009/6026] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:13:44 2022] GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 => generated 1331 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:13:44.926893 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-99dc0d14-b960-475d-b719-6018a62670c6 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:44.927546 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-99dc0d14-b960-475d-b719-6018a62670c6 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:44.928261 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-99dc0d14-b960-475d-b719-6018a62670c6 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:44.929096 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-99dc0d14-b960-475d-b719-6018a62670c6 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:44.931928 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-99dc0d14-b960-475d-b719-6018a62670c6 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:44.934039 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-99dc0d14-b960-475d-b719-6018a62670c6 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:45.159859 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-99dc0d14-b960-475d-b719-6018a62670c6 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9b0de88baf482a8aadf98bc6eb590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9535c16997f458394066e442d036efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:13:45.169678 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-99dc0d14-b960-475d-b719-6018a62670c6 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] 10.222.0.23 "GET /compute/v2.1/servers/621db181-73f9-4ef3-ab2e-844486796b53" status: 200 len: 1319 microversion: 2.1 time: 0.270085 Sep 10 12:13:45.170955 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3018/6027] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:13:44 2022] GET /compute/v2.1/servers/621db181-73f9-4ef3-ab2e-844486796b53 => generated 1319 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:13:45.902099 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-189adb08-2669-42ff-9ff6-ee8ee2df568b req-b8aa2969-74ca-4cff-bbb9-593457384988 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "621db181-73f9-4ef3-ab2e-844486796b53", "name": "network-vif-plugged", "status": "completed", "tag": "37e8848f-7451-4df4-9635-b0d7d1e3764d"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:13:45.927700 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-189adb08-2669-42ff-9ff6-ee8ee2df568b req-b8aa2969-74ca-4cff-bbb9-593457384988 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:45.928185 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-189adb08-2669-42ff-9ff6-ee8ee2df568b req-b8aa2969-74ca-4cff-bbb9-593457384988 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:45.928622 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-189adb08-2669-42ff-9ff6-ee8ee2df568b req-b8aa2969-74ca-4cff-bbb9-593457384988 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:45.955557 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f57cc41a-6278-460b-af35-71be7d873440 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:13:45.956635 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f57cc41a-6278-460b-af35-71be7d873440 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:13:45.960622 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:13:45.961300 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:13:45.973474 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-189adb08-2669-42ff-9ff6-ee8ee2df568b req-b8aa2969-74ca-4cff-bbb9-593457384988 service nova] Creating event network-vif-plugged:37e8848f-7451-4df4-9635-b0d7d1e3764d for instance 621db181-73f9-4ef3-ab2e-844486796b53 on n-h2-856895-1 Sep 10 12:13:45.981949 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f57cc41a-6278-460b-af35-71be7d873440 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:45.982847 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f57cc41a-6278-460b-af35-71be7d873440 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:45.983618 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f57cc41a-6278-460b-af35-71be7d873440 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:45.984548 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f57cc41a-6278-460b-af35-71be7d873440 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:45.985185 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f57cc41a-6278-460b-af35-71be7d873440 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:45.985378 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-189adb08-2669-42ff-9ff6-ee8ee2df568b req-b8aa2969-74ca-4cff-bbb9-593457384988 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089019 Sep 10 12:13:45.986360 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f57cc41a-6278-460b-af35-71be7d873440 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:45.986557 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3010/6028] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:13:46.024724 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-f57cc41a-6278-460b-af35-71be7d873440 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] HTTP exception thrown: Instance 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 could not be found. Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f57cc41a-6278-460b-af35-71be7d873440 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Request method failure captured: Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 HTTP/1.1 Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH3f6GUP-vcGJKgYs9rYAE6OawiTmJHgZl9vlhfSbv7R_wFrnAHrNyTqDc0RuEPZi57XGfLqPVxCZc47_xRjBpcGZLWUDdhEHCEh6mtOoaNkeHxMKPICZdCuDCfpAFF9D9M9RMYBjoFdk7vZER1xOY4aTKlTJ8XZrlR1gs_K7sdx9WY Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 03301ecc81fe426bafc4be81413d1265 Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-AttachVolumeNegativeTest-637078285 Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/03301ecc81fe426bafc4be81413d1265"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/03301ecc81fe426bafc4be81413d1265"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_03301ecc81fe426bafc4be81413d1265", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/03301ecc81fe426bafc4be81413d1265"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-AttachVolumeNegativeTest-637078285 Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 03301ecc81fe426bafc4be81413d1265 Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-637078285 Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-AttachVolumeNegativeTest-637078285-project Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 199d923de84c45789188543de904314a Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-AttachVolumeNegativeTest-637078285-project Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 could not be found. Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '4c1bb60f-ebea-4e31-9c65-2c7b45af3e32'} Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 could not be found. Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 could not be found. Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:13:46.027474 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:13:46.043517 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:13:46.043517 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:13:46.043517 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:13:46.043517 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:13:46.043517 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:13:46.043517 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 could not be found. Sep 10 12:13:46.043517 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:13:46.043517 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f57cc41a-6278-460b-af35-71be7d873440 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Returning 404 to user: Instance 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:13:46.043517 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f57cc41a-6278-460b-af35-71be7d873440 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32" status: 404 len: 111 microversion: 2.1 time: 0.077162 Sep 10 12:13:46.043517 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3019/6029] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:13:45 2022] GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:13:46.048823 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d4aceb93-3eb9-4a43-b4ed-5bec760034d4 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '.version_select at 0x7f4071f29af0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:13:46.055658 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:13:46.087370 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d4aceb93-3eb9-4a43-b4ed-5bec760034d4 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1550188924" status: 202 len: 0 microversion: 2.1 time: 0.051953 Sep 10 12:13:46.089015 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3011/6030] 10.222.0.23 () {58 vars in 1221 bytes} [Sat Sep 10 12:13:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1550188924 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:13:46.195143 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a0fe9d99-254f-4d4a-b07a-9b161c1b41b3 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:13:46.195912 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a0fe9d99-254f-4d4a-b07a-9b161c1b41b3 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] [instance: 621db181-73f9-4ef3-ab2e-844486796b53] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:13:46.208710 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a0fe9d99-254f-4d4a-b07a-9b161c1b41b3 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:46.209343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a0fe9d99-254f-4d4a-b07a-9b161c1b41b3 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:46.209918 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a0fe9d99-254f-4d4a-b07a-9b161c1b41b3 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:46.210755 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a0fe9d99-254f-4d4a-b07a-9b161c1b41b3 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:46.215784 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a0fe9d99-254f-4d4a-b07a-9b161c1b41b3 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:46.216588 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a0fe9d99-254f-4d4a-b07a-9b161c1b41b3 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:46.544964 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a0fe9d99-254f-4d4a-b07a-9b161c1b41b3 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9b0de88baf482a8aadf98bc6eb590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9535c16997f458394066e442d036efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:13:46.563074 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a0fe9d99-254f-4d4a-b07a-9b161c1b41b3 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] 10.222.0.23 "GET /compute/v2.1/servers/621db181-73f9-4ef3-ab2e-844486796b53" status: 200 len: 1319 microversion: 2.1 time: 0.372070 Sep 10 12:13:46.575192 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3020/6031] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:13:46 2022] GET /compute/v2.1/servers/621db181-73f9-4ef3-ab2e-844486796b53 => generated 1319 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:13:47.589397 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4631854a-1d25-4cd0-b466-d4893331434f tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:13:47.590812 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4631854a-1d25-4cd0-b466-d4893331434f tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] [instance: 621db181-73f9-4ef3-ab2e-844486796b53] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:13:47.598145 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4631854a-1d25-4cd0-b466-d4893331434f tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:47.598639 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4631854a-1d25-4cd0-b466-d4893331434f tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:47.599308 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4631854a-1d25-4cd0-b466-d4893331434f tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:47.600513 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4631854a-1d25-4cd0-b466-d4893331434f tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:47.601161 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4631854a-1d25-4cd0-b466-d4893331434f tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:47.601621 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4631854a-1d25-4cd0-b466-d4893331434f tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:47.895857 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4631854a-1d25-4cd0-b466-d4893331434f tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9b0de88baf482a8aadf98bc6eb590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9535c16997f458394066e442d036efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:13:47.904836 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4631854a-1d25-4cd0-b466-d4893331434f tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] 10.222.0.23 "GET /compute/v2.1/servers/621db181-73f9-4ef3-ab2e-844486796b53" status: 200 len: 1508 microversion: 2.1 time: 0.320440 Sep 10 12:13:47.919308 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3012/6032] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:13:47 2022] GET /compute/v2.1/servers/621db181-73f9-4ef3-ab2e-844486796b53 => generated 1508 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:13:47.928725 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9238eba3-ac4a-4b98-b4d7-09f52da0b1c3 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be7ce0df-015f-4d7b-8d9f-2132d98d7cbb", "device": "/dev/sdb"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:13:47.931185 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9238eba3-ac4a-4b98-b4d7-09f52da0b1c3 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] [instance: 621db181-73f9-4ef3-ab2e-844486796b53] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:13:47.936324 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:13:47.940095 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9238eba3-ac4a-4b98-b4d7-09f52da0b1c3 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:47.940588 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9238eba3-ac4a-4b98-b4d7-09f52da0b1c3 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:47.941224 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9238eba3-ac4a-4b98-b4d7-09f52da0b1c3 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:47.941935 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9238eba3-ac4a-4b98-b4d7-09f52da0b1c3 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:47.942396 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9238eba3-ac4a-4b98-b4d7-09f52da0b1c3 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:47.942825 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9238eba3-ac4a-4b98-b4d7-09f52da0b1c3 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:48.227139 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9238eba3-ac4a-4b98-b4d7-09f52da0b1c3 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] 10.222.0.23 "POST /compute/v2.1/servers/621db181-73f9-4ef3-ab2e-844486796b53/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301923 Sep 10 12:13:48.228415 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3021/6033] 10.222.0.23 () {60 vars in 1323 bytes} [Sat Sep 10 12:13:47 2022] POST /compute/v2.1/servers/621db181-73f9-4ef3-ab2e-844486796b53/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:13:52.830362 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bd26d56d-4a3b-4abd-b211-55722db49a61 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:13:52.831068 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bd26d56d-4a3b-4abd-b211-55722db49a61 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:13:52.842552 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd26d56d-4a3b-4abd-b211-55722db49a61 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:52.844456 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd26d56d-4a3b-4abd-b211-55722db49a61 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:52.845486 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd26d56d-4a3b-4abd-b211-55722db49a61 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:52.846414 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd26d56d-4a3b-4abd-b211-55722db49a61 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:52.847065 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd26d56d-4a3b-4abd-b211-55722db49a61 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:52.847535 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd26d56d-4a3b-4abd-b211-55722db49a61 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:52.893251 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-bd26d56d-4a3b-4abd-b211-55722db49a61 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] HTTP exception thrown: Instance 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 could not be found. Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bd26d56d-4a3b-4abd-b211-55722db49a61 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Request method failure captured: Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 HTTP/1.1 Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH3f6GUP-vcGJKgYs9rYAE6OawiTmJHgZl9vlhfSbv7R_wFrnAHrNyTqDc0RuEPZi57XGfLqPVxCZc47_xRjBpcGZLWUDdhEHCEh6mtOoaNkeHxMKPICZdCuDCfpAFF9D9M9RMYBjoFdk7vZER1xOY4aTKlTJ8XZrlR1gs_K7sdx9WY Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 03301ecc81fe426bafc4be81413d1265 Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-AttachVolumeNegativeTest-637078285 Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/03301ecc81fe426bafc4be81413d1265"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/03301ecc81fe426bafc4be81413d1265"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_03301ecc81fe426bafc4be81413d1265", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/03301ecc81fe426bafc4be81413d1265"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-AttachVolumeNegativeTest-637078285 Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 03301ecc81fe426bafc4be81413d1265 Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-637078285 Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-AttachVolumeNegativeTest-637078285-project Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 199d923de84c45789188543de904314a Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-AttachVolumeNegativeTest-637078285-project Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 could not be found. Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '4c1bb60f-ebea-4e31-9c65-2c7b45af3e32'} Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 could not be found. Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:13:52.895286 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:13:52.900587 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 could not be found. Sep 10 12:13:52.900587 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:13:52.900587 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:13:52.900587 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:13:52.900587 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:13:52.900587 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:13:52.900587 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:13:52.900587 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:13:52.900587 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:13:52.900587 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 could not be found. Sep 10 12:13:52.900587 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:13:52.900587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bd26d56d-4a3b-4abd-b211-55722db49a61 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Returning 404 to user: Instance 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:13:52.900587 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bd26d56d-4a3b-4abd-b211-55722db49a61 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32" status: 404 len: 111 microversion: 2.1 time: 0.074087 Sep 10 12:13:52.904541 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3013/6034] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:13:52 2022] DELETE /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:13:52.909399 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b4f4b574-5d8c-4342-b1c2-7876db234448 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:13:52.910128 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b4f4b574-5d8c-4342-b1c2-7876db234448 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:13:52.933340 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b4f4b574-5d8c-4342-b1c2-7876db234448 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:52.934063 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b4f4b574-5d8c-4342-b1c2-7876db234448 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:52.935778 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b4f4b574-5d8c-4342-b1c2-7876db234448 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:52.937075 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b4f4b574-5d8c-4342-b1c2-7876db234448 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:13:52.939873 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b4f4b574-5d8c-4342-b1c2-7876db234448 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:13:52.940591 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b4f4b574-5d8c-4342-b1c2-7876db234448 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:13:52.972109 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-b4f4b574-5d8c-4342-b1c2-7876db234448 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] HTTP exception thrown: Instance 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 could not be found. Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b4f4b574-5d8c-4342-b1c2-7876db234448 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Request method failure captured: Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 HTTP/1.1 Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH3f6GUP-vcGJKgYs9rYAE6OawiTmJHgZl9vlhfSbv7R_wFrnAHrNyTqDc0RuEPZi57XGfLqPVxCZc47_xRjBpcGZLWUDdhEHCEh6mtOoaNkeHxMKPICZdCuDCfpAFF9D9M9RMYBjoFdk7vZER1xOY4aTKlTJ8XZrlR1gs_K7sdx9WY Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 03301ecc81fe426bafc4be81413d1265 Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-AttachVolumeNegativeTest-637078285 Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/03301ecc81fe426bafc4be81413d1265"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/03301ecc81fe426bafc4be81413d1265"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_03301ecc81fe426bafc4be81413d1265", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/03301ecc81fe426bafc4be81413d1265"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-AttachVolumeNegativeTest-637078285 Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 03301ecc81fe426bafc4be81413d1265 Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-637078285 Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-AttachVolumeNegativeTest-637078285-project Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 199d923de84c45789188543de904314a Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-AttachVolumeNegativeTest-637078285-project Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 could not be found. Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '4c1bb60f-ebea-4e31-9c65-2c7b45af3e32'} Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 could not be found. Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 could not be found. Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:13:52.975863 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:13:52.982307 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:13:52.982307 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:13:52.982307 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:13:52.982307 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:13:52.982307 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:13:52.982307 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 could not be found. Sep 10 12:13:52.982307 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:13:52.983886 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b4f4b574-5d8c-4342-b1c2-7876db234448 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Returning 404 to user: Instance 4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:13:52.984996 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b4f4b574-5d8c-4342-b1c2-7876db234448 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32" status: 404 len: 111 microversion: 2.1 time: 0.079910 Sep 10 12:13:52.985859 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3022/6035] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:13:52 2022] GET /compute/v2.1/servers/4c1bb60f-ebea-4e31-9c65-2c7b45af3e32 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:14:01.769718 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7904cc5c-193d-47da-91c3-254baa8952c7 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:14:01.775686 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7904cc5c-193d-47da-91c3-254baa8952c7 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 13779716-4716-4ab0-8699-416f441eecea] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:14:01.786255 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7904cc5c-193d-47da-91c3-254baa8952c7 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:01.786903 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7904cc5c-193d-47da-91c3-254baa8952c7 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:01.787664 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7904cc5c-193d-47da-91c3-254baa8952c7 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:01.788533 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7904cc5c-193d-47da-91c3-254baa8952c7 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:01.789370 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7904cc5c-193d-47da-91c3-254baa8952c7 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:01.790185 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7904cc5c-193d-47da-91c3-254baa8952c7 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:01.814112 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-7904cc5c-193d-47da-91c3-254baa8952c7 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] HTTP exception thrown: Instance 13779716-4716-4ab0-8699-416f441eecea could not be found. Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7904cc5c-193d-47da-91c3-254baa8952c7 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Request method failure captured: Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea HTTP/1.1 Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH3f6GUP-vcGJKgYs9rYAE6OawiTmJHgZl9vlhfSbv7R_wFrnAHrNyTqDc0RuEPZi57XGfLqPVxCZc47_xRjBpcGZLWUDdhEHCEh6mtOoaNkeHxMKPICZdCuDCfpAFF9D9M9RMYBjoFdk7vZER1xOY4aTKlTJ8XZrlR1gs_K7sdx9WY Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 03301ecc81fe426bafc4be81413d1265 Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-AttachVolumeNegativeTest-637078285 Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/03301ecc81fe426bafc4be81413d1265"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/03301ecc81fe426bafc4be81413d1265"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_03301ecc81fe426bafc4be81413d1265", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/03301ecc81fe426bafc4be81413d1265"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-AttachVolumeNegativeTest-637078285 Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 03301ecc81fe426bafc4be81413d1265 Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-637078285 Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-AttachVolumeNegativeTest-637078285-project Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 199d923de84c45789188543de904314a Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-AttachVolumeNegativeTest-637078285-project Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 13779716-4716-4ab0-8699-416f441eecea could not be found. Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '13779716-4716-4ab0-8699-416f441eecea'} Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13779716-4716-4ab0-8699-416f441eecea could not be found. Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:14:01.816334 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:14:01.819947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13779716-4716-4ab0-8699-416f441eecea could not be found. Sep 10 12:14:01.819947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:14:01.819947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:14:01.819947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:14:01.819947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:14:01.819947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:14:01.819947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:14:01.819947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:14:01.819947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:14:01.819947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13779716-4716-4ab0-8699-416f441eecea could not be found. Sep 10 12:14:01.819947 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:14:01.822438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7904cc5c-193d-47da-91c3-254baa8952c7 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Returning 404 to user: Instance 13779716-4716-4ab0-8699-416f441eecea could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:14:01.827603 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7904cc5c-193d-47da-91c3-254baa8952c7 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "DELETE /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea" status: 404 len: 111 microversion: 2.1 time: 0.060316 Sep 10 12:14:01.829007 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3014/6036] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:14:01 2022] DELETE /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:14:01.838471 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f543592c-a2cc-4e5f-a2e4-dbfb1a15cf62 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:14:01.839101 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f543592c-a2cc-4e5f-a2e4-dbfb1a15cf62 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 13779716-4716-4ab0-8699-416f441eecea] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:14:01.847730 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f543592c-a2cc-4e5f-a2e4-dbfb1a15cf62 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:01.848730 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f543592c-a2cc-4e5f-a2e4-dbfb1a15cf62 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:01.849305 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f543592c-a2cc-4e5f-a2e4-dbfb1a15cf62 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:01.850316 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f543592c-a2cc-4e5f-a2e4-dbfb1a15cf62 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:01.850848 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f543592c-a2cc-4e5f-a2e4-dbfb1a15cf62 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:01.851316 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f543592c-a2cc-4e5f-a2e4-dbfb1a15cf62 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:01.880081 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-f543592c-a2cc-4e5f-a2e4-dbfb1a15cf62 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] HTTP exception thrown: Instance 13779716-4716-4ab0-8699-416f441eecea could not be found. Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f543592c-a2cc-4e5f-a2e4-dbfb1a15cf62 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Request method failure captured: Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea HTTP/1.1 Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH3f6GUP-vcGJKgYs9rYAE6OawiTmJHgZl9vlhfSbv7R_wFrnAHrNyTqDc0RuEPZi57XGfLqPVxCZc47_xRjBpcGZLWUDdhEHCEh6mtOoaNkeHxMKPICZdCuDCfpAFF9D9M9RMYBjoFdk7vZER1xOY4aTKlTJ8XZrlR1gs_K7sdx9WY Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 03301ecc81fe426bafc4be81413d1265 Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-AttachVolumeNegativeTest-637078285 Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/03301ecc81fe426bafc4be81413d1265"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/03301ecc81fe426bafc4be81413d1265"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_03301ecc81fe426bafc4be81413d1265", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/03301ecc81fe426bafc4be81413d1265"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-AttachVolumeNegativeTest-637078285 Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 03301ecc81fe426bafc4be81413d1265 Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-637078285 Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-AttachVolumeNegativeTest-637078285-project Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 199d923de84c45789188543de904314a Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-AttachVolumeNegativeTest-637078285-project Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 13779716-4716-4ab0-8699-416f441eecea could not be found. Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '13779716-4716-4ab0-8699-416f441eecea'} Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13779716-4716-4ab0-8699-416f441eecea could not be found. Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13779716-4716-4ab0-8699-416f441eecea could not be found. Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:14:01.881956 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:14:01.888792 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:14:01.888792 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:14:01.888792 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:14:01.888792 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:14:01.888792 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:14:01.888792 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13779716-4716-4ab0-8699-416f441eecea could not be found. Sep 10 12:14:01.888792 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:14:01.888792 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f543592c-a2cc-4e5f-a2e4-dbfb1a15cf62 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Returning 404 to user: Instance 13779716-4716-4ab0-8699-416f441eecea could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:14:01.888792 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f543592c-a2cc-4e5f-a2e4-dbfb1a15cf62 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea" status: 404 len: 111 microversion: 2.1 time: 0.050502 Sep 10 12:14:01.888792 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3023/6037] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:14:01 2022] GET /compute/v2.1/servers/13779716-4716-4ab0-8699-416f441eecea => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:14:01.895556 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-13d92993-305d-46e9-9912-0f9899f3842f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:14:01.896066 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-13d92993-305d-46e9-9912-0f9899f3842f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 5f777fb8-adb1-47fd-aced-8b338fa6052e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:14:01.902577 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-13d92993-305d-46e9-9912-0f9899f3842f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:01.903067 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-13d92993-305d-46e9-9912-0f9899f3842f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:01.903676 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-13d92993-305d-46e9-9912-0f9899f3842f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:01.904565 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-13d92993-305d-46e9-9912-0f9899f3842f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:01.905021 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-13d92993-305d-46e9-9912-0f9899f3842f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:01.905544 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-13d92993-305d-46e9-9912-0f9899f3842f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:01.925766 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-13d92993-305d-46e9-9912-0f9899f3842f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] HTTP exception thrown: Instance 5f777fb8-adb1-47fd-aced-8b338fa6052e could not be found. Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-13d92993-305d-46e9-9912-0f9899f3842f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Request method failure captured: Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e HTTP/1.1 Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH3f6GUP-vcGJKgYs9rYAE6OawiTmJHgZl9vlhfSbv7R_wFrnAHrNyTqDc0RuEPZi57XGfLqPVxCZc47_xRjBpcGZLWUDdhEHCEh6mtOoaNkeHxMKPICZdCuDCfpAFF9D9M9RMYBjoFdk7vZER1xOY4aTKlTJ8XZrlR1gs_K7sdx9WY Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 03301ecc81fe426bafc4be81413d1265 Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-AttachVolumeNegativeTest-637078285 Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/03301ecc81fe426bafc4be81413d1265"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/03301ecc81fe426bafc4be81413d1265"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_03301ecc81fe426bafc4be81413d1265", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/03301ecc81fe426bafc4be81413d1265"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-AttachVolumeNegativeTest-637078285 Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 03301ecc81fe426bafc4be81413d1265 Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-637078285 Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-AttachVolumeNegativeTest-637078285-project Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 199d923de84c45789188543de904314a Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-AttachVolumeNegativeTest-637078285-project Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 5f777fb8-adb1-47fd-aced-8b338fa6052e could not be found. Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '5f777fb8-adb1-47fd-aced-8b338fa6052e'} Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f777fb8-adb1-47fd-aced-8b338fa6052e could not be found. Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:14:01.927397 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:14:01.931546 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f777fb8-adb1-47fd-aced-8b338fa6052e could not be found. Sep 10 12:14:01.931546 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:14:01.931546 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:14:01.931546 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:14:01.931546 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:14:01.931546 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:14:01.931546 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:14:01.931546 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:14:01.931546 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:14:01.931546 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f777fb8-adb1-47fd-aced-8b338fa6052e could not be found. Sep 10 12:14:01.931546 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:14:01.933664 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-13d92993-305d-46e9-9912-0f9899f3842f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Returning 404 to user: Instance 5f777fb8-adb1-47fd-aced-8b338fa6052e could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:14:01.935008 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-13d92993-305d-46e9-9912-0f9899f3842f tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e" status: 404 len: 111 microversion: 2.1 time: 0.046580 Sep 10 12:14:01.935793 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3015/6038] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:14:01 2022] DELETE /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:14:01.944941 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dfd5c907-7d88-4abe-9bf0-0fd66c8a8c4b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:14:01.945568 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-dfd5c907-7d88-4abe-9bf0-0fd66c8a8c4b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: 5f777fb8-adb1-47fd-aced-8b338fa6052e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:14:01.952659 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dfd5c907-7d88-4abe-9bf0-0fd66c8a8c4b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:01.953426 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dfd5c907-7d88-4abe-9bf0-0fd66c8a8c4b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:01.954145 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dfd5c907-7d88-4abe-9bf0-0fd66c8a8c4b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:01.955074 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dfd5c907-7d88-4abe-9bf0-0fd66c8a8c4b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:01.955733 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dfd5c907-7d88-4abe-9bf0-0fd66c8a8c4b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:01.956335 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dfd5c907-7d88-4abe-9bf0-0fd66c8a8c4b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:01.972956 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-dfd5c907-7d88-4abe-9bf0-0fd66c8a8c4b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] HTTP exception thrown: Instance 5f777fb8-adb1-47fd-aced-8b338fa6052e could not be found. Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dfd5c907-7d88-4abe-9bf0-0fd66c8a8c4b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Request method failure captured: Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e HTTP/1.1 Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH3f6GUP-vcGJKgYs9rYAE6OawiTmJHgZl9vlhfSbv7R_wFrnAHrNyTqDc0RuEPZi57XGfLqPVxCZc47_xRjBpcGZLWUDdhEHCEh6mtOoaNkeHxMKPICZdCuDCfpAFF9D9M9RMYBjoFdk7vZER1xOY4aTKlTJ8XZrlR1gs_K7sdx9WY Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 03301ecc81fe426bafc4be81413d1265 Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-AttachVolumeNegativeTest-637078285 Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/03301ecc81fe426bafc4be81413d1265"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/03301ecc81fe426bafc4be81413d1265"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_03301ecc81fe426bafc4be81413d1265", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/03301ecc81fe426bafc4be81413d1265"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-AttachVolumeNegativeTest-637078285 Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 03301ecc81fe426bafc4be81413d1265 Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-637078285 Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-AttachVolumeNegativeTest-637078285-project Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 199d923de84c45789188543de904314a Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-AttachVolumeNegativeTest-637078285-project Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 5f777fb8-adb1-47fd-aced-8b338fa6052e could not be found. Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '5f777fb8-adb1-47fd-aced-8b338fa6052e'} Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f777fb8-adb1-47fd-aced-8b338fa6052e could not be found. Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f777fb8-adb1-47fd-aced-8b338fa6052e could not be found. Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:14:01.974981 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:14:01.979476 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:14:01.979476 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:14:01.979476 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:14:01.979476 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:14:01.979476 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:14:01.979476 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f777fb8-adb1-47fd-aced-8b338fa6052e could not be found. Sep 10 12:14:01.979476 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:14:01.986489 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dfd5c907-7d88-4abe-9bf0-0fd66c8a8c4b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Returning 404 to user: Instance 5f777fb8-adb1-47fd-aced-8b338fa6052e could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:14:01.987813 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-dfd5c907-7d88-4abe-9bf0-0fd66c8a8c4b tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e" status: 404 len: 111 microversion: 2.1 time: 0.047228 Sep 10 12:14:01.988894 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3024/6039] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:14:01 2022] GET /compute/v2.1/servers/5f777fb8-adb1-47fd-aced-8b338fa6052e => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:14:07.711098 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d0acd749-8972-458d-adcd-a0be7747b8e6 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:14:07.711818 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d0acd749-8972-458d-adcd-a0be7747b8e6 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: f4da91bc-acbf-487b-b305-a619df7ad3f8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:14:07.723637 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d0acd749-8972-458d-adcd-a0be7747b8e6 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:07.724756 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d0acd749-8972-458d-adcd-a0be7747b8e6 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:07.725349 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d0acd749-8972-458d-adcd-a0be7747b8e6 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:07.726319 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d0acd749-8972-458d-adcd-a0be7747b8e6 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:07.726957 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d0acd749-8972-458d-adcd-a0be7747b8e6 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:07.728368 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d0acd749-8972-458d-adcd-a0be7747b8e6 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:07.777779 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-d0acd749-8972-458d-adcd-a0be7747b8e6 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] HTTP exception thrown: Instance f4da91bc-acbf-487b-b305-a619df7ad3f8 could not be found. Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d0acd749-8972-458d-adcd-a0be7747b8e6 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Request method failure captured: Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8 HTTP/1.1 Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH3f6GUP-vcGJKgYs9rYAE6OawiTmJHgZl9vlhfSbv7R_wFrnAHrNyTqDc0RuEPZi57XGfLqPVxCZc47_xRjBpcGZLWUDdhEHCEh6mtOoaNkeHxMKPICZdCuDCfpAFF9D9M9RMYBjoFdk7vZER1xOY4aTKlTJ8XZrlR1gs_K7sdx9WY Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 03301ecc81fe426bafc4be81413d1265 Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-AttachVolumeNegativeTest-637078285 Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/03301ecc81fe426bafc4be81413d1265"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/03301ecc81fe426bafc4be81413d1265"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_03301ecc81fe426bafc4be81413d1265", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/03301ecc81fe426bafc4be81413d1265"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-AttachVolumeNegativeTest-637078285 Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 03301ecc81fe426bafc4be81413d1265 Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-637078285 Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-AttachVolumeNegativeTest-637078285-project Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 199d923de84c45789188543de904314a Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-AttachVolumeNegativeTest-637078285-project Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance f4da91bc-acbf-487b-b305-a619df7ad3f8 could not be found. Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'f4da91bc-acbf-487b-b305-a619df7ad3f8'} Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4da91bc-acbf-487b-b305-a619df7ad3f8 could not be found. Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:14:07.781926 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:14:07.785060 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4da91bc-acbf-487b-b305-a619df7ad3f8 could not be found. Sep 10 12:14:07.785060 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:14:07.785060 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:14:07.785060 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:14:07.785060 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:14:07.785060 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:14:07.785060 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:14:07.785060 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:14:07.785060 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:14:07.785060 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4da91bc-acbf-487b-b305-a619df7ad3f8 could not be found. Sep 10 12:14:07.785060 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:14:07.785060 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d0acd749-8972-458d-adcd-a0be7747b8e6 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Returning 404 to user: Instance f4da91bc-acbf-487b-b305-a619df7ad3f8 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:14:07.785060 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d0acd749-8972-458d-adcd-a0be7747b8e6 tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8" status: 404 len: 111 microversion: 2.1 time: 0.076787 Sep 10 12:14:07.786926 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3016/6040] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:14:07 2022] DELETE /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:14:07.792243 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-53f68a61-010f-4c76-a713-527d8f42bbac tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:14:07.792991 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-53f68a61-010f-4c76-a713-527d8f42bbac tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] [instance: f4da91bc-acbf-487b-b305-a619df7ad3f8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:14:07.804597 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53f68a61-010f-4c76-a713-527d8f42bbac tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:07.805905 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53f68a61-010f-4c76-a713-527d8f42bbac tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:07.809951 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53f68a61-010f-4c76-a713-527d8f42bbac tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:07.810938 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53f68a61-010f-4c76-a713-527d8f42bbac tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:07.811697 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53f68a61-010f-4c76-a713-527d8f42bbac tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:07.812348 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53f68a61-010f-4c76-a713-527d8f42bbac tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:07.840457 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-53f68a61-010f-4c76-a713-527d8f42bbac tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] HTTP exception thrown: Instance f4da91bc-acbf-487b-b305-a619df7ad3f8 could not be found. Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-53f68a61-010f-4c76-a713-527d8f42bbac tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Request method failure captured: Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8 HTTP/1.1 Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH3f6GUP-vcGJKgYs9rYAE6OawiTmJHgZl9vlhfSbv7R_wFrnAHrNyTqDc0RuEPZi57XGfLqPVxCZc47_xRjBpcGZLWUDdhEHCEh6mtOoaNkeHxMKPICZdCuDCfpAFF9D9M9RMYBjoFdk7vZER1xOY4aTKlTJ8XZrlR1gs_K7sdx9WY Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 03301ecc81fe426bafc4be81413d1265 Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-AttachVolumeNegativeTest-637078285 Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/03301ecc81fe426bafc4be81413d1265"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/03301ecc81fe426bafc4be81413d1265"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_03301ecc81fe426bafc4be81413d1265", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/03301ecc81fe426bafc4be81413d1265"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-AttachVolumeNegativeTest-637078285 Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 03301ecc81fe426bafc4be81413d1265 Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-637078285 Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-AttachVolumeNegativeTest-637078285-project Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 199d923de84c45789188543de904314a Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-AttachVolumeNegativeTest-637078285-project Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance f4da91bc-acbf-487b-b305-a619df7ad3f8 could not be found. Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'f4da91bc-acbf-487b-b305-a619df7ad3f8'} Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4da91bc-acbf-487b-b305-a619df7ad3f8 could not be found. Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4da91bc-acbf-487b-b305-a619df7ad3f8 could not be found. Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:14:07.843484 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:14:07.846807 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:14:07.846807 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:14:07.846807 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:14:07.846807 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:14:07.846807 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:14:07.846807 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4da91bc-acbf-487b-b305-a619df7ad3f8 could not be found. Sep 10 12:14:07.846807 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:14:07.850590 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-53f68a61-010f-4c76-a713-527d8f42bbac tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] Returning 404 to user: Instance f4da91bc-acbf-487b-b305-a619df7ad3f8 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:14:07.854574 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-53f68a61-010f-4c76-a713-527d8f42bbac tempest-AttachVolumeNegativeTest-637078285 tempest-AttachVolumeNegativeTest-637078285-project] 10.222.0.23 "GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8" status: 404 len: 111 microversion: 2.1 time: 0.066262 Sep 10 12:14:07.855766 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3025/6041] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:14:07 2022] GET /compute/v2.1/servers/f4da91bc-acbf-487b-b305-a619df7ad3f8 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:14:16.823884 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ac7e02a8-2296-4d30-9a4c-07abb3c74ebd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:14:16.824361 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ac7e02a8-2296-4d30-9a4c-07abb3c74ebd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 6f29b62d-e533-481d-9a55-194953db02bc] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:14:16.835089 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:14:16.860843 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac7e02a8-2296-4d30-9a4c-07abb3c74ebd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:16.861359 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac7e02a8-2296-4d30-9a4c-07abb3c74ebd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:16.861810 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac7e02a8-2296-4d30-9a4c-07abb3c74ebd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:16.862538 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac7e02a8-2296-4d30-9a4c-07abb3c74ebd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:16.863003 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac7e02a8-2296-4d30-9a4c-07abb3c74ebd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:16.863472 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac7e02a8-2296-4d30-9a4c-07abb3c74ebd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:16.891774 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=24 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:14:16.993563 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ac7e02a8-2296-4d30-9a4c-07abb3c74ebd tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc/ips" status: 200 len: 146 microversion: 2.1 time: 0.172247 Sep 10 12:14:16.999267 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3017/6042] 10.222.0.23 () {58 vars in 1248 bytes} [Sat Sep 10 12:14:16 2022] GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc/ips => generated 146 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:14:20.150043 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-20385178-550e-49b4-b29a-b95cfaf52753 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "707f63cf-b5bd-45dc-94b5-f7a919f317ea"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:14:20.153801 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-20385178-550e-49b4-b29a-b95cfaf52753 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 6f29b62d-e533-481d-9a55-194953db02bc] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:14:20.158105 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=9 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:14:20.177152 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:14:20.183270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20385178-550e-49b4-b29a-b95cfaf52753 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:20.183994 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20385178-550e-49b4-b29a-b95cfaf52753 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:20.184625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20385178-550e-49b4-b29a-b95cfaf52753 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:20.185497 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20385178-550e-49b4-b29a-b95cfaf52753 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:20.186110 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20385178-550e-49b4-b29a-b95cfaf52753 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:20.186691 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20385178-550e-49b4-b29a-b95cfaf52753 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:20.750408 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-20385178-550e-49b4-b29a-b95cfaf52753 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "POST /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.604948 Sep 10 12:14:20.751042 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3026/6043] 10.222.0.23 () {60 vars in 1323 bytes} [Sat Sep 10 12:14:20 2022] POST /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc/os-volume_attachments => generated 194 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:14:20.915835 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9e80e36b-9686-4af7-89ce-3706dbc65a9b tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:14:20.917242 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9e80e36b-9686-4af7-89ce-3706dbc65a9b tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] [instance: 621db181-73f9-4ef3-ab2e-844486796b53] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:14:20.925183 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9e80e36b-9686-4af7-89ce-3706dbc65a9b tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:20.926262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9e80e36b-9686-4af7-89ce-3706dbc65a9b tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:20.927809 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9e80e36b-9686-4af7-89ce-3706dbc65a9b tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:20.929301 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9e80e36b-9686-4af7-89ce-3706dbc65a9b tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:20.931698 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9e80e36b-9686-4af7-89ce-3706dbc65a9b tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:20.932699 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9e80e36b-9686-4af7-89ce-3706dbc65a9b tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:21.154376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-9e80e36b-9686-4af7-89ce-3706dbc65a9b tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lazy-loading 'services' on Instance uuid 621db181-73f9-4ef3-ab2e-844486796b53 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:14:21.315322 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9e80e36b-9686-4af7-89ce-3706dbc65a9b tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] 10.222.0.23 "DELETE /compute/v2.1/servers/621db181-73f9-4ef3-ab2e-844486796b53/os-volume_attachments/be7ce0df-015f-4d7b-8d9f-2132d98d7cbb" status: 202 len: 0 microversion: 2.1 time: 0.405347 Sep 10 12:14:21.316541 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3018/6044] 10.222.0.23 () {58 vars in 1416 bytes} [Sat Sep 10 12:14:20 2022] DELETE /compute/v2.1/servers/621db181-73f9-4ef3-ab2e-844486796b53/os-volume_attachments/be7ce0df-015f-4d7b-8d9f-2132d98d7cbb => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:14:21.758265 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4fd55bc8-65da-4fe7-b4c2-5da9f599b148 tempest-VolumesTestJSON-1857696191 tempest-VolumesTestJSON-1857696191-project] Calling method '.version_select at 0x7f4071b91700>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:14:21.853374 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4fd55bc8-65da-4fe7-b4c2-5da9f599b148 tempest-VolumesTestJSON-1857696191 tempest-VolumesTestJSON-1857696191-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/90f018b2-14b0-4f30-81a9-4f4ddef75b53" status: 200 len: 351 microversion: 2.1 time: 0.101327 Sep 10 12:14:21.866122 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3019/6045] 10.222.0.23 () {58 vars in 1245 bytes} [Sat Sep 10 12:14:21 2022] GET /compute/v2.1/os-volumes/90f018b2-14b0-4f30-81a9-4f4ddef75b53 => generated 351 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:14:22.014663 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-523db650-2202-4305-9710-764a77a80da4 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:14:22.015796 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-523db650-2202-4305-9710-764a77a80da4 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] [instance: 79d4afff-11d8-4d63-b972-5d9c220b44c6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:14:22.033948 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-523db650-2202-4305-9710-764a77a80da4 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:22.034873 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-523db650-2202-4305-9710-764a77a80da4 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:22.037424 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-523db650-2202-4305-9710-764a77a80da4 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:22.040964 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-523db650-2202-4305-9710-764a77a80da4 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:22.041470 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-523db650-2202-4305-9710-764a77a80da4 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:22.042000 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-523db650-2202-4305-9710-764a77a80da4 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:22.087015 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-523db650-2202-4305-9710-764a77a80da4 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] [instance: 79d4afff-11d8-4d63-b972-5d9c220b44c6] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:14:22.346935 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-523db650-2202-4305-9710-764a77a80da4 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] 10.222.0.23 "DELETE /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6" status: 204 len: 0 microversion: 2.1 time: 0.920922 Sep 10 12:14:22.353163 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3027/6046] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:14:21 2022] DELETE /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6 => generated 0 bytes in 928 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:14:22.360771 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-816a7526-966f-4dae-a407-ebc6a1994605 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:14:22.362604 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-816a7526-966f-4dae-a407-ebc6a1994605 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] [instance: 79d4afff-11d8-4d63-b972-5d9c220b44c6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:14:22.388202 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-816a7526-966f-4dae-a407-ebc6a1994605 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:22.392569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-816a7526-966f-4dae-a407-ebc6a1994605 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:22.393111 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-816a7526-966f-4dae-a407-ebc6a1994605 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:22.396228 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-816a7526-966f-4dae-a407-ebc6a1994605 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:22.398375 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-816a7526-966f-4dae-a407-ebc6a1994605 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:22.404357 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-816a7526-966f-4dae-a407-ebc6a1994605 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:22.872567 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-816a7526-966f-4dae-a407-ebc6a1994605 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5a85b4b060444abea51d5ef25c3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e89542829e1491681b317a2c748bbbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:14:22.883651 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-816a7526-966f-4dae-a407-ebc6a1994605 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] 10.222.0.23 "GET /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6" status: 200 len: 1728 microversion: 2.1 time: 0.525635 Sep 10 12:14:22.884585 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3020/6047] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:14:22 2022] GET /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6 => generated 1728 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:14:23.908229 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cc2f6b83-b334-49fb-8c2c-5fd1b3f3b51b tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:14:23.909534 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cc2f6b83-b334-49fb-8c2c-5fd1b3f3b51b tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] [instance: 79d4afff-11d8-4d63-b972-5d9c220b44c6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:14:23.935733 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cc2f6b83-b334-49fb-8c2c-5fd1b3f3b51b tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:23.936505 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cc2f6b83-b334-49fb-8c2c-5fd1b3f3b51b tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:23.939200 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cc2f6b83-b334-49fb-8c2c-5fd1b3f3b51b tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:23.940109 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cc2f6b83-b334-49fb-8c2c-5fd1b3f3b51b tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:23.942061 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cc2f6b83-b334-49fb-8c2c-5fd1b3f3b51b tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:23.942954 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cc2f6b83-b334-49fb-8c2c-5fd1b3f3b51b tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:24.412300 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-cc2f6b83-b334-49fb-8c2c-5fd1b3f3b51b tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5a85b4b060444abea51d5ef25c3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e89542829e1491681b317a2c748bbbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:14:24.420645 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cc2f6b83-b334-49fb-8c2c-5fd1b3f3b51b tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] 10.222.0.23 "GET /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6" status: 200 len: 1728 microversion: 2.1 time: 0.516628 Sep 10 12:14:24.421249 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3028/6048] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:14:23 2022] GET /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6 => generated 1728 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:14:25.106891 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-c96bf11f-970c-4247-bc63-ee16809e34df req-df924a73-0839-4b74-a57f-c5b802309695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79d4afff-11d8-4d63-b972-5d9c220b44c6", "name": "network-vif-deleted", "tag": "f527e147-043b-4458-9562-cd8b9f942e3b"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:14:25.133694 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-c96bf11f-970c-4247-bc63-ee16809e34df req-df924a73-0839-4b74-a57f-c5b802309695 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:25.143621 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-c96bf11f-970c-4247-bc63-ee16809e34df req-df924a73-0839-4b74-a57f-c5b802309695 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:25.161533 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-c96bf11f-970c-4247-bc63-ee16809e34df req-df924a73-0839-4b74-a57f-c5b802309695 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:25.188380 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-c96bf11f-970c-4247-bc63-ee16809e34df req-df924a73-0839-4b74-a57f-c5b802309695 service nova] Creating event network-vif-deleted:f527e147-043b-4458-9562-cd8b9f942e3b for instance 79d4afff-11d8-4d63-b972-5d9c220b44c6 on n-h2-856895-1 Sep 10 12:14:25.208254 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-c96bf11f-970c-4247-bc63-ee16809e34df req-df924a73-0839-4b74-a57f-c5b802309695 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109292 Sep 10 12:14:25.211349 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3021/6049] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:14:25.446926 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a4e5c8cc-74b3-4ce7-8633-90a0fc90a5fe tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:14:25.448476 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a4e5c8cc-74b3-4ce7-8633-90a0fc90a5fe tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] [instance: 79d4afff-11d8-4d63-b972-5d9c220b44c6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:14:25.457257 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a4e5c8cc-74b3-4ce7-8633-90a0fc90a5fe tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:25.458010 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a4e5c8cc-74b3-4ce7-8633-90a0fc90a5fe tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:25.458672 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a4e5c8cc-74b3-4ce7-8633-90a0fc90a5fe tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:25.459361 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a4e5c8cc-74b3-4ce7-8633-90a0fc90a5fe tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:25.459816 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a4e5c8cc-74b3-4ce7-8633-90a0fc90a5fe tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:25.460388 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a4e5c8cc-74b3-4ce7-8633-90a0fc90a5fe tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:25.531045 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a4e5c8cc-74b3-4ce7-8633-90a0fc90a5fe tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:25.531568 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a4e5c8cc-74b3-4ce7-8633-90a0fc90a5fe tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:25.532013 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a4e5c8cc-74b3-4ce7-8633-90a0fc90a5fe tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:25.532586 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-a4e5c8cc-74b3-4ce7-8633-90a0fc90a5fe tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lazy-loading 'fault' on Instance uuid 79d4afff-11d8-4d63-b972-5d9c220b44c6 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:14:25.621047 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a4e5c8cc-74b3-4ce7-8633-90a0fc90a5fe tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5a85b4b060444abea51d5ef25c3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e89542829e1491681b317a2c748bbbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:14:25.639889 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a4e5c8cc-74b3-4ce7-8633-90a0fc90a5fe tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] 10.222.0.23 "GET /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6" status: 200 len: 1387 microversion: 2.1 time: 0.197696 Sep 10 12:14:25.640718 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3029/6050] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:14:25 2022] GET /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6 => generated 1387 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:14:26.667210 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e2bd23f3-b8d4-4914-a6a1-ffc1718d9be2 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:14:26.668257 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e2bd23f3-b8d4-4914-a6a1-ffc1718d9be2 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] [instance: 79d4afff-11d8-4d63-b972-5d9c220b44c6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:14:26.686040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e2bd23f3-b8d4-4914-a6a1-ffc1718d9be2 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:26.688367 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e2bd23f3-b8d4-4914-a6a1-ffc1718d9be2 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:26.689136 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e2bd23f3-b8d4-4914-a6a1-ffc1718d9be2 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:26.690854 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e2bd23f3-b8d4-4914-a6a1-ffc1718d9be2 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:26.700272 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e2bd23f3-b8d4-4914-a6a1-ffc1718d9be2 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:26.701072 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e2bd23f3-b8d4-4914-a6a1-ffc1718d9be2 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:26.743342 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-e2bd23f3-b8d4-4914-a6a1-ffc1718d9be2 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] HTTP exception thrown: Instance 79d4afff-11d8-4d63-b972-5d9c220b44c6 could not be found. Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e2bd23f3-b8d4-4914-a6a1-ffc1718d9be2 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Request method failure captured: Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6 HTTP/1.1 Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH5mFjGm0VzMGzbo4vL99NiebPrhq9oH7MwAME8j9TTO_GWJ1ZquCLsG5YmcVKzLo0GgUFlGJ0mbvRc5AOe0x9bLA0KE08ewlY3s0jlHaleDeCO3lDsHr6xKSlV5A79muKGNT7Rq2xEG4P698Lx9Vsz8fy3pjFHZJIhYxAWuWv8rSBo Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 5e89542829e1491681b317a2c748bbbc Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-TestServerBasicOps-720056092 Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5e89542829e1491681b317a2c748bbbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5e89542829e1491681b317a2c748bbbc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5e89542829e1491681b317a2c748bbbc", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5e89542829e1491681b317a2c748bbbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-TestServerBasicOps-720056092 Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 5e89542829e1491681b317a2c748bbbc Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-TestServerBasicOps-720056092 Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-TestServerBasicOps-720056092-project Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: da5a85b4b060444abea51d5ef25c3378 Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-TestServerBasicOps-720056092-project Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 79d4afff-11d8-4d63-b972-5d9c220b44c6 could not be found. Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '79d4afff-11d8-4d63-b972-5d9c220b44c6'} Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79d4afff-11d8-4d63-b972-5d9c220b44c6 could not be found. Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79d4afff-11d8-4d63-b972-5d9c220b44c6 could not be found. Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:14:26.745273 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:14:26.749153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:14:26.749153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:14:26.749153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:14:26.749153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:14:26.749153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:14:26.749153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79d4afff-11d8-4d63-b972-5d9c220b44c6 could not be found. Sep 10 12:14:26.749153 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:14:26.751015 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e2bd23f3-b8d4-4914-a6a1-ffc1718d9be2 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Returning 404 to user: Instance 79d4afff-11d8-4d63-b972-5d9c220b44c6 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:14:26.752102 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e2bd23f3-b8d4-4914-a6a1-ffc1718d9be2 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] 10.222.0.23 "GET /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6" status: 404 len: 111 microversion: 2.1 time: 0.090175 Sep 10 12:14:26.760327 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3022/6051] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:14:26 2022] GET /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:14:27.448474 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-16fc41fe-3165-41fb-9f12-a6581447e322 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:14:27.449046 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-16fc41fe-3165-41fb-9f12-a6581447e322 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] [instance: 79d4afff-11d8-4d63-b972-5d9c220b44c6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:14:27.459576 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16fc41fe-3165-41fb-9f12-a6581447e322 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:27.460302 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16fc41fe-3165-41fb-9f12-a6581447e322 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:27.460857 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16fc41fe-3165-41fb-9f12-a6581447e322 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:27.462501 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16fc41fe-3165-41fb-9f12-a6581447e322 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:27.463076 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16fc41fe-3165-41fb-9f12-a6581447e322 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:27.463649 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16fc41fe-3165-41fb-9f12-a6581447e322 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:27.484970 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-16fc41fe-3165-41fb-9f12-a6581447e322 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] HTTP exception thrown: Instance 79d4afff-11d8-4d63-b972-5d9c220b44c6 could not be found. Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-16fc41fe-3165-41fb-9f12-a6581447e322 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Request method failure captured: Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6 HTTP/1.1 Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH5mFjGm0VzMGzbo4vL99NiebPrhq9oH7MwAME8j9TTO_GWJ1ZquCLsG5YmcVKzLo0GgUFlGJ0mbvRc5AOe0x9bLA0KE08ewlY3s0jlHaleDeCO3lDsHr6xKSlV5A79muKGNT7Rq2xEG4P698Lx9Vsz8fy3pjFHZJIhYxAWuWv8rSBo Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 5e89542829e1491681b317a2c748bbbc Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-TestServerBasicOps-720056092 Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5e89542829e1491681b317a2c748bbbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5e89542829e1491681b317a2c748bbbc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5e89542829e1491681b317a2c748bbbc", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5e89542829e1491681b317a2c748bbbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-TestServerBasicOps-720056092 Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 5e89542829e1491681b317a2c748bbbc Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-TestServerBasicOps-720056092 Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-TestServerBasicOps-720056092-project Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: da5a85b4b060444abea51d5ef25c3378 Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-TestServerBasicOps-720056092-project Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 79d4afff-11d8-4d63-b972-5d9c220b44c6 could not be found. Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '79d4afff-11d8-4d63-b972-5d9c220b44c6'} Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79d4afff-11d8-4d63-b972-5d9c220b44c6 could not be found. Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:14:27.487786 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:14:27.492629 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79d4afff-11d8-4d63-b972-5d9c220b44c6 could not be found. Sep 10 12:14:27.492629 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:14:27.492629 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:14:27.492629 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:14:27.492629 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:14:27.492629 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:14:27.492629 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:14:27.492629 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:14:27.492629 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:14:27.492629 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79d4afff-11d8-4d63-b972-5d9c220b44c6 could not be found. Sep 10 12:14:27.492629 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:14:27.496273 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-16fc41fe-3165-41fb-9f12-a6581447e322 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Returning 404 to user: Instance 79d4afff-11d8-4d63-b972-5d9c220b44c6 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:14:27.497349 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-16fc41fe-3165-41fb-9f12-a6581447e322 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] 10.222.0.23 "DELETE /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6" status: 404 len: 111 microversion: 2.1 time: 0.054556 Sep 10 12:14:27.498423 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3030/6052] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:14:27 2022] DELETE /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:14:27.506610 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-493c4b05-519f-4a82-9359-c06ad056bae6 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:14:27.507530 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-493c4b05-519f-4a82-9359-c06ad056bae6 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] [instance: 79d4afff-11d8-4d63-b972-5d9c220b44c6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:14:27.515017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-493c4b05-519f-4a82-9359-c06ad056bae6 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:27.515807 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-493c4b05-519f-4a82-9359-c06ad056bae6 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:27.516418 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-493c4b05-519f-4a82-9359-c06ad056bae6 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:27.517344 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-493c4b05-519f-4a82-9359-c06ad056bae6 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:27.517953 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-493c4b05-519f-4a82-9359-c06ad056bae6 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:27.518663 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-493c4b05-519f-4a82-9359-c06ad056bae6 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:27.544231 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-493c4b05-519f-4a82-9359-c06ad056bae6 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] HTTP exception thrown: Instance 79d4afff-11d8-4d63-b972-5d9c220b44c6 could not be found. Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-493c4b05-519f-4a82-9359-c06ad056bae6 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Request method failure captured: Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6 HTTP/1.1 Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH5mFjGm0VzMGzbo4vL99NiebPrhq9oH7MwAME8j9TTO_GWJ1ZquCLsG5YmcVKzLo0GgUFlGJ0mbvRc5AOe0x9bLA0KE08ewlY3s0jlHaleDeCO3lDsHr6xKSlV5A79muKGNT7Rq2xEG4P698Lx9Vsz8fy3pjFHZJIhYxAWuWv8rSBo Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 5e89542829e1491681b317a2c748bbbc Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-TestServerBasicOps-720056092 Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5e89542829e1491681b317a2c748bbbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5e89542829e1491681b317a2c748bbbc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5e89542829e1491681b317a2c748bbbc", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5e89542829e1491681b317a2c748bbbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-TestServerBasicOps-720056092 Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 5e89542829e1491681b317a2c748bbbc Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-TestServerBasicOps-720056092 Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-TestServerBasicOps-720056092-project Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: da5a85b4b060444abea51d5ef25c3378 Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-TestServerBasicOps-720056092-project Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 79d4afff-11d8-4d63-b972-5d9c220b44c6 could not be found. Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '79d4afff-11d8-4d63-b972-5d9c220b44c6'} Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79d4afff-11d8-4d63-b972-5d9c220b44c6 could not be found. Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79d4afff-11d8-4d63-b972-5d9c220b44c6 could not be found. Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:14:27.546289 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:14:27.549498 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:14:27.549498 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:14:27.549498 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:14:27.549498 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:14:27.549498 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:14:27.549498 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79d4afff-11d8-4d63-b972-5d9c220b44c6 could not be found. Sep 10 12:14:27.549498 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:14:27.552011 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-493c4b05-519f-4a82-9359-c06ad056bae6 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Returning 404 to user: Instance 79d4afff-11d8-4d63-b972-5d9c220b44c6 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:14:27.554046 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-493c4b05-519f-4a82-9359-c06ad056bae6 tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] 10.222.0.23 "GET /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6" status: 404 len: 111 microversion: 2.1 time: 0.051532 Sep 10 12:14:27.555188 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3023/6053] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:14:27 2022] GET /compute/v2.1/servers/79d4afff-11d8-4d63-b972-5d9c220b44c6 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:14:27.772629 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e0437fb2-87bc-429b-ae91-a460560b600d tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] Calling method '.version_select at 0x7f4073c3f310>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:14:27.796526 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e0437fb2-87bc-429b-ae91-a460560b600d tempest-TestServerBasicOps-720056092 tempest-TestServerBasicOps-720056092-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-123270911" status: 202 len: 0 microversion: 2.1 time: 0.027792 Sep 10 12:14:27.797695 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3031/6054] 10.222.0.23 () {58 vars in 1251 bytes} [Sat Sep 10 12:14:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-123270911 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:14:28.799056 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-34bd15c2-a440-4372-84b5-cf56dfeebd88 tempest-VolumesTestJSON-1857696191 tempest-VolumesTestJSON-1857696191-project] Calling method '.version_select at 0x7f4073757ca0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:14:28.869414 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-47291d3c-4d03-46cc-99f2-3061a22105ed tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:14:28.870035 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-47291d3c-4d03-46cc-99f2-3061a22105ed tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] [instance: 621db181-73f9-4ef3-ab2e-844486796b53] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:14:28.898176 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-47291d3c-4d03-46cc-99f2-3061a22105ed tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:28.898996 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-47291d3c-4d03-46cc-99f2-3061a22105ed tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:28.899852 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-47291d3c-4d03-46cc-99f2-3061a22105ed tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:28.901442 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-47291d3c-4d03-46cc-99f2-3061a22105ed tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:28.905485 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-47291d3c-4d03-46cc-99f2-3061a22105ed tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:28.912477 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-47291d3c-4d03-46cc-99f2-3061a22105ed tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:28.983944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-47291d3c-4d03-46cc-99f2-3061a22105ed tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] [instance: 621db181-73f9-4ef3-ab2e-844486796b53] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:14:29.061385 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-34bd15c2-a440-4372-84b5-cf56dfeebd88 tempest-VolumesTestJSON-1857696191 tempest-VolumesTestJSON-1857696191-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/e18fb9af-a354-4f84-a6c5-716812600d12" status: 200 len: 350 microversion: 2.1 time: 0.271858 Sep 10 12:14:29.069950 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3024/6055] 10.222.0.23 () {58 vars in 1245 bytes} [Sat Sep 10 12:14:28 2022] GET /compute/v2.1/os-volumes/e18fb9af-a354-4f84-a6c5-716812600d12 => generated 350 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:14:29.120550 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-47291d3c-4d03-46cc-99f2-3061a22105ed tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] 10.222.0.23 "DELETE /compute/v2.1/servers/621db181-73f9-4ef3-ab2e-844486796b53" status: 204 len: 0 microversion: 2.1 time: 0.256475 Sep 10 12:14:29.121909 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3032/6056] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:14:28 2022] DELETE /compute/v2.1/servers/621db181-73f9-4ef3-ab2e-844486796b53 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:14:29.131700 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d2fde679-ba3a-4039-a37c-0e9718ac0352 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:14:29.132515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d2fde679-ba3a-4039-a37c-0e9718ac0352 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] [instance: 621db181-73f9-4ef3-ab2e-844486796b53] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:14:29.142733 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d2fde679-ba3a-4039-a37c-0e9718ac0352 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:29.143461 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d2fde679-ba3a-4039-a37c-0e9718ac0352 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:29.144454 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d2fde679-ba3a-4039-a37c-0e9718ac0352 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:29.145346 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d2fde679-ba3a-4039-a37c-0e9718ac0352 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:29.146178 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d2fde679-ba3a-4039-a37c-0e9718ac0352 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:29.146772 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d2fde679-ba3a-4039-a37c-0e9718ac0352 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:29.499561 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d2fde679-ba3a-4039-a37c-0e9718ac0352 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9b0de88baf482a8aadf98bc6eb590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9535c16997f458394066e442d036efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:14:29.510184 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d2fde679-ba3a-4039-a37c-0e9718ac0352 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] 10.222.0.23 "GET /compute/v2.1/servers/621db181-73f9-4ef3-ab2e-844486796b53" status: 200 len: 1514 microversion: 2.1 time: 0.383523 Sep 10 12:14:29.515241 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3025/6057] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:14:29 2022] GET /compute/v2.1/servers/621db181-73f9-4ef3-ab2e-844486796b53 => generated 1514 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:14:30.544124 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-db4748c3-7990-4c32-a791-b22313458928 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:14:30.545645 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-db4748c3-7990-4c32-a791-b22313458928 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] [instance: 621db181-73f9-4ef3-ab2e-844486796b53] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:14:30.561498 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-db4748c3-7990-4c32-a791-b22313458928 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:30.562230 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-db4748c3-7990-4c32-a791-b22313458928 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:30.563330 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-db4748c3-7990-4c32-a791-b22313458928 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:30.564049 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-db4748c3-7990-4c32-a791-b22313458928 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:30.564510 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-db4748c3-7990-4c32-a791-b22313458928 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:30.564935 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-db4748c3-7990-4c32-a791-b22313458928 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:30.961423 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-db4748c3-7990-4c32-a791-b22313458928 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9b0de88baf482a8aadf98bc6eb590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9535c16997f458394066e442d036efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:14:30.969524 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-db4748c3-7990-4c32-a791-b22313458928 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] 10.222.0.23 "GET /compute/v2.1/servers/621db181-73f9-4ef3-ab2e-844486796b53" status: 200 len: 1514 microversion: 2.1 time: 0.431534 Sep 10 12:14:30.973193 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3033/6058] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:14:30 2022] GET /compute/v2.1/servers/621db181-73f9-4ef3-ab2e-844486796b53 => generated 1514 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:14:31.780990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-be350951-d14e-4c75-a4c8-7cdca9bb8ce7 tempest-VolumesTestJSON-1857696191 tempest-VolumesTestJSON-1857696191-project] Calling method '.version_select at 0x7f4073eabd30>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:14:31.847234 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-be350951-d14e-4c75-a4c8-7cdca9bb8ce7 tempest-VolumesTestJSON-1857696191 tempest-VolumesTestJSON-1857696191-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/3299deef-403e-494c-ba21-2ae847ab22af" status: 200 len: 351 microversion: 2.1 time: 0.069989 Sep 10 12:14:31.847936 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3026/6059] 10.222.0.23 () {58 vars in 1245 bytes} [Sat Sep 10 12:14:31 2022] GET /compute/v2.1/os-volumes/3299deef-403e-494c-ba21-2ae847ab22af => generated 351 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:14:31.862610 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e3727d6a-a9c3-4db0-a985-9817272ec9b8 tempest-VolumesTestJSON-1857696191 tempest-VolumesTestJSON-1857696191-project] Calling method '.version_select at 0x7f40733cb040>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:14:31.984260 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e3727d6a-a9c3-4db0-a985-9817272ec9b8 tempest-VolumesTestJSON-1857696191 tempest-VolumesTestJSON-1857696191-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.125756 Sep 10 12:14:31.985316 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3034/6060] 10.222.0.23 () {58 vars in 1134 bytes} [Sat Sep 10 12:14:31 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:14:32.002213 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9240b1f4-43d5-4f96-be81-2b5b7a6b8a7f tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:14:32.002733 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-34efecad-fa10-4cef-96e0-434439d3cb7a tempest-VolumesTestJSON-1857696191 tempest-VolumesTestJSON-1857696191-project] Calling method '.version_select at 0x7f4073453700>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:14:32.003494 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9240b1f4-43d5-4f96-be81-2b5b7a6b8a7f tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] [instance: 621db181-73f9-4ef3-ab2e-844486796b53] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:14:32.015880 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9240b1f4-43d5-4f96-be81-2b5b7a6b8a7f tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:32.016610 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9240b1f4-43d5-4f96-be81-2b5b7a6b8a7f tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:32.017236 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9240b1f4-43d5-4f96-be81-2b5b7a6b8a7f tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:32.018092 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9240b1f4-43d5-4f96-be81-2b5b7a6b8a7f tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:32.020447 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9240b1f4-43d5-4f96-be81-2b5b7a6b8a7f tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:32.021094 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9240b1f4-43d5-4f96-be81-2b5b7a6b8a7f tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:32.127147 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-34efecad-fa10-4cef-96e0-434439d3cb7a tempest-VolumesTestJSON-1857696191 tempest-VolumesTestJSON-1857696191-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.127995 Sep 10 12:14:32.138118 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3035/6061] 10.222.0.23 () {58 vars in 1149 bytes} [Sat Sep 10 12:14:31 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:14:32.143109 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6c1082bd-8354-47d8-a354-87c5f71ad7eb tempest-VolumesTestJSON-1857696191 tempest-VolumesTestJSON-1857696191-project] Calling method '.version_select at 0x7f4073453d30>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:14:32.224830 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9240b1f4-43d5-4f96-be81-2b5b7a6b8a7f tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9b0de88baf482a8aadf98bc6eb590f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9535c16997f458394066e442d036efe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:14:32.239262 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9240b1f4-43d5-4f96-be81-2b5b7a6b8a7f tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] 10.222.0.23 "GET /compute/v2.1/servers/621db181-73f9-4ef3-ab2e-844486796b53" status: 200 len: 1472 microversion: 2.1 time: 0.241682 Sep 10 12:14:32.239906 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3027/6062] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:14:31 2022] GET /compute/v2.1/servers/621db181-73f9-4ef3-ab2e-844486796b53 => generated 1472 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:14:32.258191 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-495ca777-e5b2-447e-9242-da402108bf54 req-86a557bd-512d-4747-b403-f6fe9540a26e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "621db181-73f9-4ef3-ab2e-844486796b53", "name": "network-vif-deleted", "tag": "37e8848f-7451-4df4-9635-b0d7d1e3764d"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:14:32.277700 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-495ca777-e5b2-447e-9242-da402108bf54 req-86a557bd-512d-4747-b403-f6fe9540a26e service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:32.278299 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-495ca777-e5b2-447e-9242-da402108bf54 req-86a557bd-512d-4747-b403-f6fe9540a26e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:32.278856 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-495ca777-e5b2-447e-9242-da402108bf54 req-86a557bd-512d-4747-b403-f6fe9540a26e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:32.297382 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-495ca777-e5b2-447e-9242-da402108bf54 req-86a557bd-512d-4747-b403-f6fe9540a26e service nova] Creating event network-vif-deleted:37e8848f-7451-4df4-9635-b0d7d1e3764d for instance 621db181-73f9-4ef3-ab2e-844486796b53 on n-h2-856895-1 Sep 10 12:14:32.317204 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-495ca777-e5b2-447e-9242-da402108bf54 req-86a557bd-512d-4747-b403-f6fe9540a26e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062714 Sep 10 12:14:32.318101 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3028/6063] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:14:32.595026 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6c1082bd-8354-47d8-a354-87c5f71ad7eb tempest-VolumesTestJSON-1857696191 tempest-VolumesTestJSON-1857696191-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.455570 Sep 10 12:14:32.596272 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3036/6064] 10.222.0.23 () {58 vars in 1134 bytes} [Sat Sep 10 12:14:32 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:14:32.610908 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-91c31045-5736-4700-b881-b0030f2516aa tempest-VolumesTestJSON-1857696191 tempest-VolumesTestJSON-1857696191-project] Calling method '.version_select at 0x7f4073065d30>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:14:32.798042 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-91c31045-5736-4700-b881-b0030f2516aa tempest-VolumesTestJSON-1857696191 tempest-VolumesTestJSON-1857696191-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.191906 Sep 10 12:14:32.799650 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3029/6065] 10.222.0.23 () {58 vars in 1167 bytes} [Sat Sep 10 12:14:32 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:14:32.814089 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ed46f9e1-668c-4098-9298-8aa6317a0895 tempest-VolumesTestJSON-1857696191 tempest-VolumesTestJSON-1857696191-project] Calling method '.version_select at 0x7f4073c3f5e0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:14:33.026022 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ed46f9e1-668c-4098-9298-8aa6317a0895 tempest-VolumesTestJSON-1857696191 tempest-VolumesTestJSON-1857696191-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.216001 Sep 10 12:14:33.026837 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3037/6066] 10.222.0.23 () {58 vars in 1170 bytes} [Sat Sep 10 12:14:32 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:14:33.045278 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2e3f2529-a536-4cd3-8e1f-a1a30925132f tempest-VolumesTestJSON-1857696191 tempest-VolumesTestJSON-1857696191-project] Calling method '.version_select at 0x7f4073114dc0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:14:33.266699 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2e3f2529-a536-4cd3-8e1f-a1a30925132f tempest-VolumesTestJSON-1857696191 tempest-VolumesTestJSON-1857696191-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.226847 Sep 10 12:14:33.277684 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3030/6067] 10.222.0.23 () {58 vars in 1155 bytes} [Sat Sep 10 12:14:33 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:14:33.277866 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d63def84-2b22-41e8-beec-9b85f26e6354 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:14:33.277866 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d63def84-2b22-41e8-beec-9b85f26e6354 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] [instance: 621db181-73f9-4ef3-ab2e-844486796b53] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:14:33.283284 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d63def84-2b22-41e8-beec-9b85f26e6354 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:33.283480 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-42dc9831-37a4-4cd6-ba9b-11e8fe546b53 tempest-VolumesTestJSON-1857696191 tempest-VolumesTestJSON-1857696191-project] Calling method '.version_select at 0x7f4071fb5ca0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:14:33.283789 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d63def84-2b22-41e8-beec-9b85f26e6354 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:33.284340 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d63def84-2b22-41e8-beec-9b85f26e6354 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:33.285076 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d63def84-2b22-41e8-beec-9b85f26e6354 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:33.285691 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d63def84-2b22-41e8-beec-9b85f26e6354 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:33.286022 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d63def84-2b22-41e8-beec-9b85f26e6354 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:33.318059 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-d63def84-2b22-41e8-beec-9b85f26e6354 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] HTTP exception thrown: Instance 621db181-73f9-4ef3-ab2e-844486796b53 could not be found. Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d63def84-2b22-41e8-beec-9b85f26e6354 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Request method failure captured: Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/621db181-73f9-4ef3-ab2e-844486796b53 HTTP/1.1 Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH7PAl1ia75DfWAE1b4bGg_UAIJkg8RWCAP2OKyRYafrsl3ko2QhRGlLDGZdIYZ_t7ZJkNoTUNC0WI8S6wq8PMomMF9aC78MVfBaBcHBqPIHLnrprYNKAyD7OiCyyPuvSgm-DG0h6DSB7J1Sgek3GA8NySmi5Ew15P1KtczsQJfL8Og Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: d9535c16997f458394066e442d036efe Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-VolumesSnapshotTestJSON-560118678 Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9535c16997f458394066e442d036efe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d9535c16997f458394066e442d036efe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d9535c16997f458394066e442d036efe", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d9535c16997f458394066e442d036efe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-VolumesSnapshotTestJSON-560118678 Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: d9535c16997f458394066e442d036efe Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-560118678 Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-VolumesSnapshotTestJSON-560118678-project Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 8e9b0de88baf482a8aadf98bc6eb590f Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-VolumesSnapshotTestJSON-560118678-project Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 621db181-73f9-4ef3-ab2e-844486796b53 could not be found. Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '621db181-73f9-4ef3-ab2e-844486796b53'} Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 621db181-73f9-4ef3-ab2e-844486796b53 could not be found. Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 621db181-73f9-4ef3-ab2e-844486796b53 could not be found. Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:14:33.319936 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:14:33.324089 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:14:33.324089 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:14:33.324089 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:14:33.324089 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:14:33.324089 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:14:33.324089 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 621db181-73f9-4ef3-ab2e-844486796b53 could not be found. Sep 10 12:14:33.324089 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:14:33.345172 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d63def84-2b22-41e8-beec-9b85f26e6354 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] Returning 404 to user: Instance 621db181-73f9-4ef3-ab2e-844486796b53 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:14:33.346290 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d63def84-2b22-41e8-beec-9b85f26e6354 tempest-VolumesSnapshotTestJSON-560118678 tempest-VolumesSnapshotTestJSON-560118678-project] 10.222.0.23 "GET /compute/v2.1/servers/621db181-73f9-4ef3-ab2e-844486796b53" status: 404 len: 111 microversion: 2.1 time: 0.087377 Sep 10 12:14:33.351284 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3038/6068] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:14:33 2022] GET /compute/v2.1/servers/621db181-73f9-4ef3-ab2e-844486796b53 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 12:14:33.404962 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-42dc9831-37a4-4cd6-ba9b-11e8fe546b53 tempest-VolumesTestJSON-1857696191 tempest-VolumesTestJSON-1857696191-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.125802 Sep 10 12:14:33.406176 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3031/6069] 10.222.0.23 () {58 vars in 1188 bytes} [Sat Sep 10 12:14:33 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:14:33.421834 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-145a9ed9-452e-4330-959e-98cc1cecac65 tempest-VolumesTestJSON-1857696191 tempest-VolumesTestJSON-1857696191-project] Calling method '.version_select at 0x7f4073453ee0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:14:33.958105 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-145a9ed9-452e-4330-959e-98cc1cecac65 tempest-VolumesTestJSON-1857696191 tempest-VolumesTestJSON-1857696191-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.541987 Sep 10 12:14:33.958674 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3039/6070] 10.222.0.23 () {58 vars in 1155 bytes} [Sat Sep 10 12:14:33 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:14:45.542004 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-facea470-f15f-4743-9e4a-bf3d23aa8cf2 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:14:45.545075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-facea470-f15f-4743-9e4a-bf3d23aa8cf2 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 6f29b62d-e533-481d-9a55-194953db02bc] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:14:45.554897 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=17 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:14:45.556423 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=38,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:14:45.558888 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-facea470-f15f-4743-9e4a-bf3d23aa8cf2 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:45.559605 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-facea470-f15f-4743-9e4a-bf3d23aa8cf2 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:45.560204 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-facea470-f15f-4743-9e4a-bf3d23aa8cf2 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:45.561422 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-facea470-f15f-4743-9e4a-bf3d23aa8cf2 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:45.562104 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-facea470-f15f-4743-9e4a-bf3d23aa8cf2 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:45.563019 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-facea470-f15f-4743-9e4a-bf3d23aa8cf2 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:45.634490 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-facea470-f15f-4743-9e4a-bf3d23aa8cf2 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096270 Sep 10 12:14:45.652986 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:14:45.655397 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:14:45.655914 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3032/6071] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:14:45 2022] GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:14:45.662003 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-61abe4fc-c6ad-4da1-8edf-c9c18caee98f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:14:45.663057 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-61abe4fc-c6ad-4da1-8edf-c9c18caee98f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 6f29b62d-e533-481d-9a55-194953db02bc] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:14:45.671607 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-61abe4fc-c6ad-4da1-8edf-c9c18caee98f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:45.672294 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-61abe4fc-c6ad-4da1-8edf-c9c18caee98f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:45.673239 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-61abe4fc-c6ad-4da1-8edf-c9c18caee98f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:45.674108 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-61abe4fc-c6ad-4da1-8edf-c9c18caee98f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:45.674717 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-61abe4fc-c6ad-4da1-8edf-c9c18caee98f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:45.675406 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-61abe4fc-c6ad-4da1-8edf-c9c18caee98f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:45.740963 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-61abe4fc-c6ad-4da1-8edf-c9c18caee98f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc/os-volume_attachments/707f63cf-b5bd-45dc-94b5-f7a919f317ea" status: 200 len: 194 microversion: 2.1 time: 0.095565 Sep 10 12:14:45.746992 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3040/6072] 10.222.0.23 () {58 vars in 1413 bytes} [Sat Sep 10 12:14:45 2022] GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc/os-volume_attachments/707f63cf-b5bd-45dc-94b5-f7a919f317ea => generated 194 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:14:48.467278 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bd69d3cc-2875-4847-962e-292e5d8da919 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3bb872bb-3c58-4dea-aa12-c8587fe943c3"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:14:48.469892 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bd69d3cc-2875-4847-962e-292e5d8da919 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 6f29b62d-e533-481d-9a55-194953db02bc] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:14:48.489925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd69d3cc-2875-4847-962e-292e5d8da919 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:48.494529 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd69d3cc-2875-4847-962e-292e5d8da919 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:48.495612 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd69d3cc-2875-4847-962e-292e5d8da919 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:48.496977 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd69d3cc-2875-4847-962e-292e5d8da919 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:14:48.500835 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd69d3cc-2875-4847-962e-292e5d8da919 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:14:48.501678 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd69d3cc-2875-4847-962e-292e5d8da919 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:14:49.162122 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bd69d3cc-2875-4847-962e-292e5d8da919 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "POST /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.696946 Sep 10 12:14:49.191769 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3033/6073] 10.222.0.23 () {60 vars in 1323 bytes} [Sat Sep 10 12:14:48 2022] POST /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc/os-volume_attachments => generated 194 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:15:03.839776 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7a911e8e-d01f-4da7-8fe2-3fc1cf2de082 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:15:03.842223 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7a911e8e-d01f-4da7-8fe2-3fc1cf2de082 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 6f29b62d-e533-481d-9a55-194953db02bc] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:15:03.845978 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:15:03.846645 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:15:03.852431 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a911e8e-d01f-4da7-8fe2-3fc1cf2de082 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:15:03.852934 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a911e8e-d01f-4da7-8fe2-3fc1cf2de082 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:15:03.853384 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a911e8e-d01f-4da7-8fe2-3fc1cf2de082 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:15:03.854119 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a911e8e-d01f-4da7-8fe2-3fc1cf2de082 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:15:03.854582 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a911e8e-d01f-4da7-8fe2-3fc1cf2de082 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:15:03.855143 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a911e8e-d01f-4da7-8fe2-3fc1cf2de082 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:15:03.902161 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7a911e8e-d01f-4da7-8fe2-3fc1cf2de082 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.067310 Sep 10 12:15:03.908959 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3041/6074] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:15:03 2022] GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc/os-volume_attachments => generated 371 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:15:04.050621 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=4 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:15:04.052283 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:15:04.065047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7f3e8815-13e5-4770-b9c6-cadc7f3c6f62 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:15:04.065880 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7f3e8815-13e5-4770-b9c6-cadc7f3c6f62 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 6f29b62d-e533-481d-9a55-194953db02bc] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:15:04.078889 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f3e8815-13e5-4770-b9c6-cadc7f3c6f62 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:15:04.079586 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f3e8815-13e5-4770-b9c6-cadc7f3c6f62 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:15:04.080606 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f3e8815-13e5-4770-b9c6-cadc7f3c6f62 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:15:04.082371 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f3e8815-13e5-4770-b9c6-cadc7f3c6f62 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:15:04.083047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f3e8815-13e5-4770-b9c6-cadc7f3c6f62 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:15:04.084228 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f3e8815-13e5-4770-b9c6-cadc7f3c6f62 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:15:04.143674 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7f3e8815-13e5-4770-b9c6-cadc7f3c6f62 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc/os-volume_attachments/707f63cf-b5bd-45dc-94b5-f7a919f317ea" status: 200 len: 194 microversion: 2.1 time: 0.095337 Sep 10 12:15:04.146655 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3034/6075] 10.222.0.23 () {58 vars in 1413 bytes} [Sat Sep 10 12:15:04 2022] GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc/os-volume_attachments/707f63cf-b5bd-45dc-94b5-f7a919f317ea => generated 194 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:15:04.157477 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7590ef47-0719-4e73-9793-2896ef6913d0 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:15:04.158245 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7590ef47-0719-4e73-9793-2896ef6913d0 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 6f29b62d-e533-481d-9a55-194953db02bc] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:15:04.176817 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7590ef47-0719-4e73-9793-2896ef6913d0 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:15:04.180064 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7590ef47-0719-4e73-9793-2896ef6913d0 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:15:04.180604 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7590ef47-0719-4e73-9793-2896ef6913d0 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:15:04.182779 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7590ef47-0719-4e73-9793-2896ef6913d0 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:15:04.183376 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7590ef47-0719-4e73-9793-2896ef6913d0 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:15:04.184779 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7590ef47-0719-4e73-9793-2896ef6913d0 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:15:04.368191 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-7590ef47-0719-4e73-9793-2896ef6913d0 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lazy-loading 'services' on Instance uuid 6f29b62d-e533-481d-9a55-194953db02bc {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:15:04.495906 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7590ef47-0719-4e73-9793-2896ef6913d0 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc/os-volume_attachments/707f63cf-b5bd-45dc-94b5-f7a919f317ea" status: 202 len: 0 microversion: 2.1 time: 0.342450 Sep 10 12:15:04.497011 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3042/6076] 10.222.0.23 () {58 vars in 1416 bytes} [Sat Sep 10 12:15:04 2022] DELETE /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc/os-volume_attachments/707f63cf-b5bd-45dc-94b5-f7a919f317ea => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:15:11.706582 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-22fd658e-d49c-49a6-89cd-22dbfad3bf2f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:15:11.707705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-22fd658e-d49c-49a6-89cd-22dbfad3bf2f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 6f29b62d-e533-481d-9a55-194953db02bc] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:15:11.739235 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-22fd658e-d49c-49a6-89cd-22dbfad3bf2f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:15:11.742999 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-22fd658e-d49c-49a6-89cd-22dbfad3bf2f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:15:11.743725 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-22fd658e-d49c-49a6-89cd-22dbfad3bf2f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:15:11.746542 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-22fd658e-d49c-49a6-89cd-22dbfad3bf2f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:15:11.747632 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-22fd658e-d49c-49a6-89cd-22dbfad3bf2f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:15:11.748914 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-22fd658e-d49c-49a6-89cd-22dbfad3bf2f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:15:11.826400 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-22fd658e-d49c-49a6-89cd-22dbfad3bf2f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc/os-volume_attachments/3bb872bb-3c58-4dea-aa12-c8587fe943c3" status: 200 len: 194 microversion: 2.1 time: 0.123960 Sep 10 12:15:11.832889 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3035/6077] 10.222.0.23 () {58 vars in 1413 bytes} [Sat Sep 10 12:15:11 2022] GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc/os-volume_attachments/3bb872bb-3c58-4dea-aa12-c8587fe943c3 => generated 194 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:15:11.848198 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-59cf8eb7-43fa-48c0-a25e-795c206eb4b9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:15:11.851846 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-59cf8eb7-43fa-48c0-a25e-795c206eb4b9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 6f29b62d-e533-481d-9a55-194953db02bc] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:15:11.861205 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-59cf8eb7-43fa-48c0-a25e-795c206eb4b9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:15:11.861995 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-59cf8eb7-43fa-48c0-a25e-795c206eb4b9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:15:11.862660 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-59cf8eb7-43fa-48c0-a25e-795c206eb4b9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:15:11.863615 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-59cf8eb7-43fa-48c0-a25e-795c206eb4b9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:15:11.864320 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-59cf8eb7-43fa-48c0-a25e-795c206eb4b9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:15:11.864842 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-59cf8eb7-43fa-48c0-a25e-795c206eb4b9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:15:11.970080 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-59cf8eb7-43fa-48c0-a25e-795c206eb4b9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lazy-loading 'services' on Instance uuid 6f29b62d-e533-481d-9a55-194953db02bc {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:15:12.068294 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-59cf8eb7-43fa-48c0-a25e-795c206eb4b9 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc/os-volume_attachments/3bb872bb-3c58-4dea-aa12-c8587fe943c3" status: 202 len: 0 microversion: 2.1 time: 0.233562 Sep 10 12:15:12.071492 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3043/6078] 10.222.0.23 () {58 vars in 1416 bytes} [Sat Sep 10 12:15:11 2022] DELETE /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc/os-volume_attachments/3bb872bb-3c58-4dea-aa12-c8587fe943c3 => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:15:19.010213 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f032d217-e4dd-4d2a-a3e9-7470f69c9c8d tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:15:19.012995 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f032d217-e4dd-4d2a-a3e9-7470f69c9c8d tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 6f29b62d-e533-481d-9a55-194953db02bc] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:15:19.021465 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f032d217-e4dd-4d2a-a3e9-7470f69c9c8d tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:15:19.022790 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f032d217-e4dd-4d2a-a3e9-7470f69c9c8d tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:15:19.023417 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f032d217-e4dd-4d2a-a3e9-7470f69c9c8d tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:15:19.024377 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f032d217-e4dd-4d2a-a3e9-7470f69c9c8d tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:15:19.024882 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f032d217-e4dd-4d2a-a3e9-7470f69c9c8d tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:15:19.025407 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f032d217-e4dd-4d2a-a3e9-7470f69c9c8d tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:15:19.095192 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f032d217-e4dd-4d2a-a3e9-7470f69c9c8d tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.090708 Sep 10 12:15:19.097399 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3036/6079] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:15:19 2022] GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc/os-volume_attachments => generated 25 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 12:15:19.347156 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-908a5fe2-356f-459a-88ea-21403e953517 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:15:19.349802 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-908a5fe2-356f-459a-88ea-21403e953517 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 6f29b62d-e533-481d-9a55-194953db02bc] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:15:19.359343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-908a5fe2-356f-459a-88ea-21403e953517 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:15:19.359940 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-908a5fe2-356f-459a-88ea-21403e953517 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:15:19.360451 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-908a5fe2-356f-459a-88ea-21403e953517 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:15:19.361237 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-908a5fe2-356f-459a-88ea-21403e953517 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:15:19.362939 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-908a5fe2-356f-459a-88ea-21403e953517 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:15:19.363487 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-908a5fe2-356f-459a-88ea-21403e953517 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:15:19.431679 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-908a5fe2-356f-459a-88ea-21403e953517 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.093652 Sep 10 12:15:19.435229 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3044/6080] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:15:19 2022] GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc/os-volume_attachments => generated 25 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 12:15:19.550408 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-86cd47c2-9cb0-4cc8-84f7-86c527af52fb tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:15:19.551790 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-86cd47c2-9cb0-4cc8-84f7-86c527af52fb tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 6f29b62d-e533-481d-9a55-194953db02bc] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:15:19.565761 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-86cd47c2-9cb0-4cc8-84f7-86c527af52fb tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:15:19.567148 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-86cd47c2-9cb0-4cc8-84f7-86c527af52fb tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:15:19.569076 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-86cd47c2-9cb0-4cc8-84f7-86c527af52fb tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:15:19.570897 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-86cd47c2-9cb0-4cc8-84f7-86c527af52fb tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:15:19.573779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-86cd47c2-9cb0-4cc8-84f7-86c527af52fb tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:15:19.574350 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-86cd47c2-9cb0-4cc8-84f7-86c527af52fb tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:15:19.612874 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-86cd47c2-9cb0-4cc8-84f7-86c527af52fb tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 6f29b62d-e533-481d-9a55-194953db02bc] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:15:19.821185 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-86cd47c2-9cb0-4cc8-84f7-86c527af52fb tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc" status: 204 len: 0 microversion: 2.1 time: 0.273865 Sep 10 12:15:19.825764 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3037/6081] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:15:19 2022] DELETE /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:15:19.841278 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d1cd7e2f-7c93-491c-8aef-cc92a6f415ec tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:15:19.844231 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d1cd7e2f-7c93-491c-8aef-cc92a6f415ec tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 6f29b62d-e533-481d-9a55-194953db02bc] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:15:19.864906 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d1cd7e2f-7c93-491c-8aef-cc92a6f415ec tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:15:19.867747 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d1cd7e2f-7c93-491c-8aef-cc92a6f415ec tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:15:19.868459 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d1cd7e2f-7c93-491c-8aef-cc92a6f415ec tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:15:19.869475 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d1cd7e2f-7c93-491c-8aef-cc92a6f415ec tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:15:19.873856 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d1cd7e2f-7c93-491c-8aef-cc92a6f415ec tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:15:19.875329 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d1cd7e2f-7c93-491c-8aef-cc92a6f415ec tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:15:20.189696 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d1cd7e2f-7c93-491c-8aef-cc92a6f415ec tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:15:20.202278 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d1cd7e2f-7c93-491c-8aef-cc92a6f415ec tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc" status: 200 len: 1675 microversion: 2.1 time: 0.374559 Sep 10 12:15:20.203456 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3045/6082] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:15:19 2022] GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc => generated 1675 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:15:21.232126 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fa042703-bc5b-4d7f-836c-171af4717bdb tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:15:21.233448 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fa042703-bc5b-4d7f-836c-171af4717bdb tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 6f29b62d-e533-481d-9a55-194953db02bc] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:15:21.259641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fa042703-bc5b-4d7f-836c-171af4717bdb tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:15:21.260553 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fa042703-bc5b-4d7f-836c-171af4717bdb tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:15:21.262553 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fa042703-bc5b-4d7f-836c-171af4717bdb tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:15:21.265866 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fa042703-bc5b-4d7f-836c-171af4717bdb tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:15:21.270102 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fa042703-bc5b-4d7f-836c-171af4717bdb tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:15:21.273702 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fa042703-bc5b-4d7f-836c-171af4717bdb tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:15:21.528975 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fa042703-bc5b-4d7f-836c-171af4717bdb tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:15:21.538334 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fa042703-bc5b-4d7f-836c-171af4717bdb tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc" status: 200 len: 1675 microversion: 2.1 time: 0.312809 Sep 10 12:15:21.552866 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3038/6083] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:15:21 2022] GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc => generated 1675 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:15:22.569128 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-920e8c99-6869-40aa-82f3-8d690991f678 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:15:22.569944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-920e8c99-6869-40aa-82f3-8d690991f678 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 6f29b62d-e533-481d-9a55-194953db02bc] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:15:22.579073 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-920e8c99-6869-40aa-82f3-8d690991f678 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:15:22.579611 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-920e8c99-6869-40aa-82f3-8d690991f678 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:15:22.588679 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-920e8c99-6869-40aa-82f3-8d690991f678 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:15:22.589629 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-920e8c99-6869-40aa-82f3-8d690991f678 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:15:22.590479 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-920e8c99-6869-40aa-82f3-8d690991f678 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:15:22.591274 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-920e8c99-6869-40aa-82f3-8d690991f678 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:15:22.965471 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-920e8c99-6869-40aa-82f3-8d690991f678 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:15:22.973591 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-920e8c99-6869-40aa-82f3-8d690991f678 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc" status: 200 len: 1675 microversion: 2.1 time: 0.408601 Sep 10 12:15:22.979328 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3046/6084] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:15:22 2022] GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc => generated 1675 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:15:23.703114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-1db0346c-0055-42e3-b45c-e5030e0f6c35 req-46f615b8-0dec-4201-9d94-4877ba5a200a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f29b62d-e533-481d-9a55-194953db02bc", "name": "network-vif-deleted", "tag": "ef622768-be1a-4d83-973f-ee254195c7be"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:15:23.749268 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-1db0346c-0055-42e3-b45c-e5030e0f6c35 req-46f615b8-0dec-4201-9d94-4877ba5a200a service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:15:23.749754 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-1db0346c-0055-42e3-b45c-e5030e0f6c35 req-46f615b8-0dec-4201-9d94-4877ba5a200a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:15:23.750189 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-1db0346c-0055-42e3-b45c-e5030e0f6c35 req-46f615b8-0dec-4201-9d94-4877ba5a200a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:15:23.809986 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-1db0346c-0055-42e3-b45c-e5030e0f6c35 req-46f615b8-0dec-4201-9d94-4877ba5a200a service nova] Creating event network-vif-deleted:ef622768-be1a-4d83-973f-ee254195c7be for instance 6f29b62d-e533-481d-9a55-194953db02bc on n-h1-856895-1 Sep 10 12:15:23.826019 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-1db0346c-0055-42e3-b45c-e5030e0f6c35 req-46f615b8-0dec-4201-9d94-4877ba5a200a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127624 Sep 10 12:15:23.837442 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3039/6085] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:15:23.999293 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-552a639e-387f-491a-af99-ffd0e1c2e379 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:15:23.999917 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-552a639e-387f-491a-af99-ffd0e1c2e379 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 6f29b62d-e533-481d-9a55-194953db02bc] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:15:24.023211 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-552a639e-387f-491a-af99-ffd0e1c2e379 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:15:24.023709 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-552a639e-387f-491a-af99-ffd0e1c2e379 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:15:24.024152 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-552a639e-387f-491a-af99-ffd0e1c2e379 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:15:24.024865 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-552a639e-387f-491a-af99-ffd0e1c2e379 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:15:24.025320 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-552a639e-387f-491a-af99-ffd0e1c2e379 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:15:24.025752 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-552a639e-387f-491a-af99-ffd0e1c2e379 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:15:24.114344 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-552a639e-387f-491a-af99-ffd0e1c2e379 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:15:24.115845 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-552a639e-387f-491a-af99-ffd0e1c2e379 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:15:24.116754 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-552a639e-387f-491a-af99-ffd0e1c2e379 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:15:24.117887 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-552a639e-387f-491a-af99-ffd0e1c2e379 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lazy-loading 'fault' on Instance uuid 6f29b62d-e533-481d-9a55-194953db02bc {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:15:24.196209 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-552a639e-387f-491a-af99-ffd0e1c2e379 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf9ca0c6fc34699b8a9eb711ed77347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb76b960181842b4aeb9ff8f75796df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:15:24.211880 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-552a639e-387f-491a-af99-ffd0e1c2e379 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc" status: 200 len: 1328 microversion: 2.1 time: 0.215329 Sep 10 12:15:24.212637 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3047/6086] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:15:23 2022] GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc => generated 1328 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:15:25.249963 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-36a838ed-0d88-4ddb-8f0e-5874223ea140 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:15:25.250689 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-36a838ed-0d88-4ddb-8f0e-5874223ea140 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 6f29b62d-e533-481d-9a55-194953db02bc] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:15:25.259108 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36a838ed-0d88-4ddb-8f0e-5874223ea140 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:15:25.260047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36a838ed-0d88-4ddb-8f0e-5874223ea140 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:15:25.261071 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36a838ed-0d88-4ddb-8f0e-5874223ea140 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:15:25.262780 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36a838ed-0d88-4ddb-8f0e-5874223ea140 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:15:25.263665 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36a838ed-0d88-4ddb-8f0e-5874223ea140 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:15:25.264281 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36a838ed-0d88-4ddb-8f0e-5874223ea140 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:15:25.278295 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-36a838ed-0d88-4ddb-8f0e-5874223ea140 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] HTTP exception thrown: Instance 6f29b62d-e533-481d-9a55-194953db02bc could not be found. Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-36a838ed-0d88-4ddb-8f0e-5874223ea140 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Request method failure captured: Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc HTTP/1.1 Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH4B7Hlzcs3MLVMb7O3bD4Cme547xcvQj47IKSRK4h4ySQVvRVGP2kTNBsccR_p4Vx8tQTGKKPnwc0ojhohb83JhwfmTgV0YS958jL7EGJKKVQHAhSZiGpzXn5Q9y4pTsNX73gwSXNFFHcX0MVCu9Ri-O0vbn_n9BwoH_JZvT6g7btw Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: cb76b960181842b4aeb9ff8f75796df5 Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-AttachVolumeTestJSON-1165343922 Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cb76b960181842b4aeb9ff8f75796df5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cb76b960181842b4aeb9ff8f75796df5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cb76b960181842b4aeb9ff8f75796df5", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cb76b960181842b4aeb9ff8f75796df5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-AttachVolumeTestJSON-1165343922 Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: cb76b960181842b4aeb9ff8f75796df5 Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1165343922 Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-AttachVolumeTestJSON-1165343922-project Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 0bf9ca0c6fc34699b8a9eb711ed77347 Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-AttachVolumeTestJSON-1165343922-project Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 6f29b62d-e533-481d-9a55-194953db02bc could not be found. Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '6f29b62d-e533-481d-9a55-194953db02bc'} Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f29b62d-e533-481d-9a55-194953db02bc could not be found. Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f29b62d-e533-481d-9a55-194953db02bc could not be found. Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:15:25.280107 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:15:25.283951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:15:25.283951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:15:25.283951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:15:25.283951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:15:25.283951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:15:25.283951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f29b62d-e533-481d-9a55-194953db02bc could not be found. Sep 10 12:15:25.283951 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:15:25.283951 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-36a838ed-0d88-4ddb-8f0e-5874223ea140 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Returning 404 to user: Instance 6f29b62d-e533-481d-9a55-194953db02bc could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:15:25.283951 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-36a838ed-0d88-4ddb-8f0e-5874223ea140 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc" status: 404 len: 111 microversion: 2.1 time: 0.038282 Sep 10 12:15:25.283951 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3040/6087] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:15:25 2022] GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:15:25.291116 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-db875860-b7ac-442c-9219-8b8ddda9cc6d tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '.version_select at 0x7f40733cb790>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:15:25.313405 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-db875860-b7ac-442c-9219-8b8ddda9cc6d tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1177899615" status: 202 len: 0 microversion: 2.1 time: 0.026673 Sep 10 12:15:25.314331 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3048/6088] 10.222.0.23 () {58 vars in 1221 bytes} [Sat Sep 10 12:15:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1177899615 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:15:35.138075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-095384f0-de95-4b3a-ac7e-e422d4b8bb01 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:15:35.138075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-095384f0-de95-4b3a-ac7e-e422d4b8bb01 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 6f29b62d-e533-481d-9a55-194953db02bc] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:15:35.165569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:15:35.167685 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-095384f0-de95-4b3a-ac7e-e422d4b8bb01 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:15:35.168302 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-095384f0-de95-4b3a-ac7e-e422d4b8bb01 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:15:35.168936 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-095384f0-de95-4b3a-ac7e-e422d4b8bb01 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:15:35.169666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-095384f0-de95-4b3a-ac7e-e422d4b8bb01 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:15:35.170131 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-095384f0-de95-4b3a-ac7e-e422d4b8bb01 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:15:35.170565 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-095384f0-de95-4b3a-ac7e-e422d4b8bb01 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:15:35.201151 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-095384f0-de95-4b3a-ac7e-e422d4b8bb01 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] HTTP exception thrown: Instance 6f29b62d-e533-481d-9a55-194953db02bc could not be found. Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-095384f0-de95-4b3a-ac7e-e422d4b8bb01 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Request method failure captured: Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc HTTP/1.1 Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH4B7Hlzcs3MLVMb7O3bD4Cme547xcvQj47IKSRK4h4ySQVvRVGP2kTNBsccR_p4Vx8tQTGKKPnwc0ojhohb83JhwfmTgV0YS958jL7EGJKKVQHAhSZiGpzXn5Q9y4pTsNX73gwSXNFFHcX0MVCu9Ri-O0vbn_n9BwoH_JZvT6g7btw Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: cb76b960181842b4aeb9ff8f75796df5 Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-AttachVolumeTestJSON-1165343922 Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cb76b960181842b4aeb9ff8f75796df5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cb76b960181842b4aeb9ff8f75796df5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cb76b960181842b4aeb9ff8f75796df5", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cb76b960181842b4aeb9ff8f75796df5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-AttachVolumeTestJSON-1165343922 Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: cb76b960181842b4aeb9ff8f75796df5 Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1165343922 Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-AttachVolumeTestJSON-1165343922-project Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 0bf9ca0c6fc34699b8a9eb711ed77347 Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-AttachVolumeTestJSON-1165343922-project Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 6f29b62d-e533-481d-9a55-194953db02bc could not be found. Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '6f29b62d-e533-481d-9a55-194953db02bc'} Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f29b62d-e533-481d-9a55-194953db02bc could not be found. Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:15:35.202772 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:15:35.206587 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f29b62d-e533-481d-9a55-194953db02bc could not be found. Sep 10 12:15:35.206587 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:15:35.206587 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:15:35.206587 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:15:35.206587 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:15:35.206587 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:15:35.206587 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:15:35.206587 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:15:35.206587 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:15:35.206587 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f29b62d-e533-481d-9a55-194953db02bc could not be found. Sep 10 12:15:35.206587 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:15:35.206587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-095384f0-de95-4b3a-ac7e-e422d4b8bb01 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Returning 404 to user: Instance 6f29b62d-e533-481d-9a55-194953db02bc could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:15:35.206587 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-095384f0-de95-4b3a-ac7e-e422d4b8bb01 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc" status: 404 len: 111 microversion: 2.1 time: 0.077601 Sep 10 12:15:35.206587 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3041/6089] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:15:35 2022] DELETE /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:15:35.213267 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5da3af84-5d2a-4885-bb03-e6e0289f9065 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:15:35.213900 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5da3af84-5d2a-4885-bb03-e6e0289f9065 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 6f29b62d-e533-481d-9a55-194953db02bc] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:15:35.222735 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=50,nova_cell1:INSERT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:15:35.223515 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:15:35.227200 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5da3af84-5d2a-4885-bb03-e6e0289f9065 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:15:35.228124 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5da3af84-5d2a-4885-bb03-e6e0289f9065 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:15:35.228652 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5da3af84-5d2a-4885-bb03-e6e0289f9065 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:15:35.229930 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5da3af84-5d2a-4885-bb03-e6e0289f9065 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:15:35.230587 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5da3af84-5d2a-4885-bb03-e6e0289f9065 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:15:35.231029 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5da3af84-5d2a-4885-bb03-e6e0289f9065 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:15:35.251345 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-5da3af84-5d2a-4885-bb03-e6e0289f9065 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] HTTP exception thrown: Instance 6f29b62d-e533-481d-9a55-194953db02bc could not be found. Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5da3af84-5d2a-4885-bb03-e6e0289f9065 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Request method failure captured: Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc HTTP/1.1 Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH4B7Hlzcs3MLVMb7O3bD4Cme547xcvQj47IKSRK4h4ySQVvRVGP2kTNBsccR_p4Vx8tQTGKKPnwc0ojhohb83JhwfmTgV0YS958jL7EGJKKVQHAhSZiGpzXn5Q9y4pTsNX73gwSXNFFHcX0MVCu9Ri-O0vbn_n9BwoH_JZvT6g7btw Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: cb76b960181842b4aeb9ff8f75796df5 Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-AttachVolumeTestJSON-1165343922 Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cb76b960181842b4aeb9ff8f75796df5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cb76b960181842b4aeb9ff8f75796df5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cb76b960181842b4aeb9ff8f75796df5", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cb76b960181842b4aeb9ff8f75796df5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-AttachVolumeTestJSON-1165343922 Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: cb76b960181842b4aeb9ff8f75796df5 Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1165343922 Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-AttachVolumeTestJSON-1165343922-project Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 0bf9ca0c6fc34699b8a9eb711ed77347 Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-AttachVolumeTestJSON-1165343922-project Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 6f29b62d-e533-481d-9a55-194953db02bc could not be found. Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '6f29b62d-e533-481d-9a55-194953db02bc'} Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f29b62d-e533-481d-9a55-194953db02bc could not be found. Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f29b62d-e533-481d-9a55-194953db02bc could not be found. Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:15:35.253547 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:15:35.258494 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:15:35.258494 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:15:35.258494 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:15:35.258494 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:15:35.258494 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:15:35.258494 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f29b62d-e533-481d-9a55-194953db02bc could not be found. Sep 10 12:15:35.258494 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:15:35.258494 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5da3af84-5d2a-4885-bb03-e6e0289f9065 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Returning 404 to user: Instance 6f29b62d-e533-481d-9a55-194953db02bc could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:15:35.258494 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5da3af84-5d2a-4885-bb03-e6e0289f9065 tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc" status: 404 len: 111 microversion: 2.1 time: 0.045737 Sep 10 12:15:35.259923 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3049/6090] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:15:35 2022] GET /compute/v2.1/servers/6f29b62d-e533-481d-9a55-194953db02bc => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:15:39.742187 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c29c20e0-53e4-44c9-a41e-eb4648feac3f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:15:39.743361 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c29c20e0-53e4-44c9-a41e-eb4648feac3f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:15:39.750620 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c29c20e0-53e4-44c9-a41e-eb4648feac3f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:15:39.751400 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c29c20e0-53e4-44c9-a41e-eb4648feac3f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:15:39.752187 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c29c20e0-53e4-44c9-a41e-eb4648feac3f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:15:39.753103 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c29c20e0-53e4-44c9-a41e-eb4648feac3f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:15:39.753682 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c29c20e0-53e4-44c9-a41e-eb4648feac3f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:15:39.754459 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c29c20e0-53e4-44c9-a41e-eb4648feac3f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:15:39.770981 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-c29c20e0-53e4-44c9-a41e-eb4648feac3f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] HTTP exception thrown: Instance 20f0d900-aeea-4f7c-9b92-bf9363ba21c9 could not be found. Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c29c20e0-53e4-44c9-a41e-eb4648feac3f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Request method failure captured: Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 HTTP/1.1 Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH4B7Hlzcs3MLVMb7O3bD4Cme547xcvQj47IKSRK4h4ySQVvRVGP2kTNBsccR_p4Vx8tQTGKKPnwc0ojhohb83JhwfmTgV0YS958jL7EGJKKVQHAhSZiGpzXn5Q9y4pTsNX73gwSXNFFHcX0MVCu9Ri-O0vbn_n9BwoH_JZvT6g7btw Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: cb76b960181842b4aeb9ff8f75796df5 Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-AttachVolumeTestJSON-1165343922 Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cb76b960181842b4aeb9ff8f75796df5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cb76b960181842b4aeb9ff8f75796df5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cb76b960181842b4aeb9ff8f75796df5", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cb76b960181842b4aeb9ff8f75796df5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-AttachVolumeTestJSON-1165343922 Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: cb76b960181842b4aeb9ff8f75796df5 Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1165343922 Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-AttachVolumeTestJSON-1165343922-project Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 0bf9ca0c6fc34699b8a9eb711ed77347 Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-AttachVolumeTestJSON-1165343922-project Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 20f0d900-aeea-4f7c-9b92-bf9363ba21c9 could not be found. Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '20f0d900-aeea-4f7c-9b92-bf9363ba21c9'} Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20f0d900-aeea-4f7c-9b92-bf9363ba21c9 could not be found. Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:15:39.772773 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:15:39.776568 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20f0d900-aeea-4f7c-9b92-bf9363ba21c9 could not be found. Sep 10 12:15:39.776568 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:15:39.776568 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:15:39.776568 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:15:39.776568 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:15:39.776568 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:15:39.776568 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:15:39.776568 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:15:39.776568 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:15:39.776568 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20f0d900-aeea-4f7c-9b92-bf9363ba21c9 could not be found. Sep 10 12:15:39.776568 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:15:39.778346 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c29c20e0-53e4-44c9-a41e-eb4648feac3f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Returning 404 to user: Instance 20f0d900-aeea-4f7c-9b92-bf9363ba21c9 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:15:39.779475 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c29c20e0-53e4-44c9-a41e-eb4648feac3f tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "DELETE /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 404 len: 111 microversion: 2.1 time: 0.042087 Sep 10 12:15:39.788390 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8742eb8d-503d-4560-9a4d-07898bf75caa tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:15:39.790264 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8742eb8d-503d-4560-9a4d-07898bf75caa tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] [instance: 20f0d900-aeea-4f7c-9b92-bf9363ba21c9] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:15:39.792450 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3042/6091] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:15:39 2022] DELETE /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:15:39.800200 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8742eb8d-503d-4560-9a4d-07898bf75caa tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:15:39.800932 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8742eb8d-503d-4560-9a4d-07898bf75caa tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:15:39.801560 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8742eb8d-503d-4560-9a4d-07898bf75caa tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:15:39.803007 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8742eb8d-503d-4560-9a4d-07898bf75caa tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:15:39.803545 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8742eb8d-503d-4560-9a4d-07898bf75caa tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:15:39.804186 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8742eb8d-503d-4560-9a4d-07898bf75caa tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:15:39.820007 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-8742eb8d-503d-4560-9a4d-07898bf75caa tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] HTTP exception thrown: Instance 20f0d900-aeea-4f7c-9b92-bf9363ba21c9 could not be found. Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8742eb8d-503d-4560-9a4d-07898bf75caa tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Request method failure captured: Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 HTTP/1.1 Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHH4B7Hlzcs3MLVMb7O3bD4Cme547xcvQj47IKSRK4h4ySQVvRVGP2kTNBsccR_p4Vx8tQTGKKPnwc0ojhohb83JhwfmTgV0YS958jL7EGJKKVQHAhSZiGpzXn5Q9y4pTsNX73gwSXNFFHcX0MVCu9Ri-O0vbn_n9BwoH_JZvT6g7btw Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: cb76b960181842b4aeb9ff8f75796df5 Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-AttachVolumeTestJSON-1165343922 Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cb76b960181842b4aeb9ff8f75796df5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cb76b960181842b4aeb9ff8f75796df5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cb76b960181842b4aeb9ff8f75796df5", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cb76b960181842b4aeb9ff8f75796df5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-AttachVolumeTestJSON-1165343922 Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: cb76b960181842b4aeb9ff8f75796df5 Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1165343922 Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-AttachVolumeTestJSON-1165343922-project Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 0bf9ca0c6fc34699b8a9eb711ed77347 Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-AttachVolumeTestJSON-1165343922-project Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 20f0d900-aeea-4f7c-9b92-bf9363ba21c9 could not be found. Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '20f0d900-aeea-4f7c-9b92-bf9363ba21c9'} Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20f0d900-aeea-4f7c-9b92-bf9363ba21c9 could not be found. Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20f0d900-aeea-4f7c-9b92-bf9363ba21c9 could not be found. Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:15:39.821811 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:15:39.825405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:15:39.825405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:15:39.825405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:15:39.825405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:15:39.825405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:15:39.825405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20f0d900-aeea-4f7c-9b92-bf9363ba21c9 could not be found. Sep 10 12:15:39.825405 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:15:39.825405 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8742eb8d-503d-4560-9a4d-07898bf75caa tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] Returning 404 to user: Instance 20f0d900-aeea-4f7c-9b92-bf9363ba21c9 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:15:39.825405 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8742eb8d-503d-4560-9a4d-07898bf75caa tempest-AttachVolumeTestJSON-1165343922 tempest-AttachVolumeTestJSON-1165343922-project] 10.222.0.23 "GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9" status: 404 len: 111 microversion: 2.1 time: 0.038830 Sep 10 12:15:39.825405 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3050/6092] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:15:39 2022] GET /compute/v2.1/servers/20f0d900-aeea-4f7c-9b92-bf9363ba21c9 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:15:41.917369 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5d248af5-4f4e-4624-ba26-c5c86694c793 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1975260411 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1975260411-project-admin] Calling method '.version_select at 0x7f4073be7040>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:15:41.919135 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d248af5-4f4e-4624-ba26-c5c86694c793 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1975260411 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1975260411-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:15:41.919632 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d248af5-4f4e-4624-ba26-c5c86694c793 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1975260411 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1975260411-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:15:41.920066 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d248af5-4f4e-4624-ba26-c5c86694c793 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1975260411 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1975260411-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:15:41.922908 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:15:41.937052 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d248af5-4f4e-4624-ba26-c5c86694c793 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1975260411 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1975260411-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:15:41.937531 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d248af5-4f4e-4624-ba26-c5c86694c793 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1975260411 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1975260411-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:15:41.937969 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d248af5-4f4e-4624-ba26-c5c86694c793 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1975260411 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1975260411-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:15:41.950152 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d248af5-4f4e-4624-ba26-c5c86694c793 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1975260411 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1975260411-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:15:41.950632 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d248af5-4f4e-4624-ba26-c5c86694c793 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1975260411 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1975260411-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:15:41.951080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d248af5-4f4e-4624-ba26-c5c86694c793 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1975260411 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1975260411-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:15:41.957273 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5d248af5-4f4e-4624-ba26-c5c86694c793 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1975260411 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1975260411-project-admin] 10.222.0.23 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.243130 Sep 10 12:15:41.958772 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3043/6093] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 12:15:41 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:15:48.237916 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-913891da-de1d-4dff-bc2a-362aadab4fae tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Action: 'create', calling method: .version_select at 0x7f4073af71f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1495890959", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOHXu7MecL2cFc6r2cN/UgCW8F77K/xf3Hp2tTlxe50yKQLlqNZU4eua4I7lRCioee5tsm6dcmMPLvNxX34HUdlTxB2alOOMISoov43vmM9o+S3mZVS9nnNSuoXJIf8uqw=="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:15:48.255717 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-913891da-de1d-4dff-bc2a-362aadab4fae tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Getting quotas for project 68cfd58791b5445b9a52bc02a5eb255b. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:15:48.262579 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-913891da-de1d-4dff-bc2a-362aadab4fae tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Getting quotas for user fbd98ab9ebde4e84b03aed2e694ddf04 and project 68cfd58791b5445b9a52bc02a5eb255b. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:15:48.291824 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-913891da-de1d-4dff-bc2a-362aadab4fae tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.414739 Sep 10 12:15:48.292463 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3051/6094] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 12:15:47 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:15:58.491635 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a29e7c5e-91dc-4f10-9c01-ac2f079ac299 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1100594697", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "049990d7-112b-449b-9264-63ae9726c2a6"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1495890959", "security_groups": [{"name": "tempest-secgroup-smoke-1824800951"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:15:58.547188 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=7 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:15:58.553080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=5 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:15:58.865586 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-a29e7c5e-91dc-4f10-9c01-ac2f079ac299 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] validate_networks() for [('049990d7-112b-449b-9264-63ae9726c2a6', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:15:59.577699 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-a29e7c5e-91dc-4f10-9c01-ac2f079ac299 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:15:59.578309 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-a29e7c5e-91dc-4f10-9c01-ac2f079ac299 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:15:59.578959 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-a29e7c5e-91dc-4f10-9c01-ac2f079ac299 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:15:59.579414 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-a29e7c5e-91dc-4f10-9c01-ac2f079ac299 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:15:59.579996 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-a29e7c5e-91dc-4f10-9c01-ac2f079ac299 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:15:59.592412 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a29e7c5e-91dc-4f10-9c01-ac2f079ac299 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:15:59.594768 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a29e7c5e-91dc-4f10-9c01-ac2f079ac299 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:15:59.595353 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a29e7c5e-91dc-4f10-9c01-ac2f079ac299 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:15:59.596557 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a29e7c5e-91dc-4f10-9c01-ac2f079ac299 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:15:59.597483 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a29e7c5e-91dc-4f10-9c01-ac2f079ac299 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:15:59.598504 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a29e7c5e-91dc-4f10-9c01-ac2f079ac299 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:15:59.623463 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-a29e7c5e-91dc-4f10-9c01-ac2f079ac299 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Getting quotas for project 68cfd58791b5445b9a52bc02a5eb255b. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:15:59.630300 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-a29e7c5e-91dc-4f10-9c01-ac2f079ac299 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Getting quotas for user fbd98ab9ebde4e84b03aed2e694ddf04 and project 68cfd58791b5445b9a52bc02a5eb255b. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:15:59.651448 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a29e7c5e-91dc-4f10-9c01-ac2f079ac299 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:15:59.656582 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a29e7c5e-91dc-4f10-9c01-ac2f079ac299 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:15:59.717446 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a29e7c5e-91dc-4f10-9c01-ac2f079ac299 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.231209 Sep 10 12:15:59.718560 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3044/6095] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:15:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 1233 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 12:15:59.727495 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=4 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:15:59.729115 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=4 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:15:59.730076 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:15:59.735269 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-69fb09a7-7014-40bb-883d-2a79d5123de5 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:15:59.736278 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-69fb09a7-7014-40bb-883d-2a79d5123de5 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:15:59.863838 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-69fb09a7-7014-40bb-883d-2a79d5123de5 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:15:59.873089 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-69fb09a7-7014-40bb-883d-2a79d5123de5 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317" status: 200 len: 1267 microversion: 2.1 time: 0.147133 Sep 10 12:15:59.874355 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3052/6096] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:15:59 2022] GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:16:00.903708 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-392c01fc-c3e7-49e9-a47c-c93971797fab tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:16:00.904896 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-392c01fc-c3e7-49e9-a47c-c93971797fab tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:16:00.914010 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-392c01fc-c3e7-49e9-a47c-c93971797fab tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:16:00.914748 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-392c01fc-c3e7-49e9-a47c-c93971797fab tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:16:00.917461 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-392c01fc-c3e7-49e9-a47c-c93971797fab tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:16:00.918419 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-392c01fc-c3e7-49e9-a47c-c93971797fab tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:16:00.918908 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-392c01fc-c3e7-49e9-a47c-c93971797fab tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:16:00.919368 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-392c01fc-c3e7-49e9-a47c-c93971797fab tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:16:01.042002 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-392c01fc-c3e7-49e9-a47c-c93971797fab tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:16:01.062997 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-392c01fc-c3e7-49e9-a47c-c93971797fab tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317" status: 200 len: 1263 microversion: 2.1 time: 0.168527 Sep 10 12:16:01.066265 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3045/6097] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:16:00 2022] GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317 => generated 1263 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:16:02.090981 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2592f743-b8a1-4441-82f9-d8aee42c5ae6 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:16:02.091769 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2592f743-b8a1-4441-82f9-d8aee42c5ae6 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:16:02.127151 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2592f743-b8a1-4441-82f9-d8aee42c5ae6 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:16:02.127733 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2592f743-b8a1-4441-82f9-d8aee42c5ae6 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:16:02.128205 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2592f743-b8a1-4441-82f9-d8aee42c5ae6 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:16:02.128975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2592f743-b8a1-4441-82f9-d8aee42c5ae6 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:16:02.129561 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2592f743-b8a1-4441-82f9-d8aee42c5ae6 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:16:02.130064 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2592f743-b8a1-4441-82f9-d8aee42c5ae6 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:16:02.341390 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2592f743-b8a1-4441-82f9-d8aee42c5ae6 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:16:02.357238 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2592f743-b8a1-4441-82f9-d8aee42c5ae6 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317" status: 200 len: 1325 microversion: 2.1 time: 0.268566 Sep 10 12:16:02.358952 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3053/6098] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:16:02 2022] GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317 => generated 1325 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:16:03.383917 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1ca2bf1f-ed50-48ea-ba70-4d261e0520a5 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:16:03.386391 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1ca2bf1f-ed50-48ea-ba70-4d261e0520a5 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:16:03.398513 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ca2bf1f-ed50-48ea-ba70-4d261e0520a5 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:16:03.399022 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ca2bf1f-ed50-48ea-ba70-4d261e0520a5 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:16:03.399504 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ca2bf1f-ed50-48ea-ba70-4d261e0520a5 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:16:03.400255 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ca2bf1f-ed50-48ea-ba70-4d261e0520a5 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:16:03.404772 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ca2bf1f-ed50-48ea-ba70-4d261e0520a5 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:16:03.406099 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ca2bf1f-ed50-48ea-ba70-4d261e0520a5 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:16:03.724510 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1ca2bf1f-ed50-48ea-ba70-4d261e0520a5 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:16:03.734827 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1ca2bf1f-ed50-48ea-ba70-4d261e0520a5 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317" status: 200 len: 1393 microversion: 2.1 time: 0.356049 Sep 10 12:16:03.736206 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3046/6099] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:16:03 2022] GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317 => generated 1393 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:16:04.330676 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-7cdf2e66-4cd7-49dd-9eb4-0148ff59e53c req-2261f959-8163-4372-a37d-f09678fb79ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cf74b1d-6a20-4859-8c19-3b5a58907317", "tag": "1eabf7cc-88d5-44e8-b139-2261b2e28604"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:16:04.375027 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-7cdf2e66-4cd7-49dd-9eb4-0148ff59e53c req-2261f959-8163-4372-a37d-f09678fb79ac service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:16:04.375558 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-7cdf2e66-4cd7-49dd-9eb4-0148ff59e53c req-2261f959-8163-4372-a37d-f09678fb79ac service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:16:04.379909 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-7cdf2e66-4cd7-49dd-9eb4-0148ff59e53c req-2261f959-8163-4372-a37d-f09678fb79ac service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:16:04.412083 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-7cdf2e66-4cd7-49dd-9eb4-0148ff59e53c req-2261f959-8163-4372-a37d-f09678fb79ac service nova] Creating event network-changed:1eabf7cc-88d5-44e8-b139-2261b2e28604 for instance 6cf74b1d-6a20-4859-8c19-3b5a58907317 on n-h1-856895-1 Sep 10 12:16:04.420877 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-7cdf2e66-4cd7-49dd-9eb4-0148ff59e53c req-2261f959-8163-4372-a37d-f09678fb79ac service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091399 Sep 10 12:16:04.421763 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3054/6100] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:16:04.762016 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1f4b69cc-430b-4db5-a2e3-702383cf5c6c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:16:04.762909 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1f4b69cc-430b-4db5-a2e3-702383cf5c6c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:16:04.775956 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1f4b69cc-430b-4db5-a2e3-702383cf5c6c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:16:04.779790 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1f4b69cc-430b-4db5-a2e3-702383cf5c6c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:16:04.780252 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1f4b69cc-430b-4db5-a2e3-702383cf5c6c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:16:04.781776 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1f4b69cc-430b-4db5-a2e3-702383cf5c6c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:16:04.783321 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1f4b69cc-430b-4db5-a2e3-702383cf5c6c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:16:04.785181 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1f4b69cc-430b-4db5-a2e3-702383cf5c6c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:16:05.149509 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1f4b69cc-430b-4db5-a2e3-702383cf5c6c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:16:05.173019 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1f4b69cc-430b-4db5-a2e3-702383cf5c6c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317" status: 200 len: 1393 microversion: 2.1 time: 0.414372 Sep 10 12:16:05.174475 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3047/6101] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:16:04 2022] GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317 => generated 1393 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:16:06.199919 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-561ada34-6c25-4da7-b68a-2932e700a2fe tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:16:06.200655 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-561ada34-6c25-4da7-b68a-2932e700a2fe tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:16:06.213775 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-561ada34-6c25-4da7-b68a-2932e700a2fe tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:16:06.215267 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-561ada34-6c25-4da7-b68a-2932e700a2fe tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:16:06.216052 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-561ada34-6c25-4da7-b68a-2932e700a2fe tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:16:06.227644 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-561ada34-6c25-4da7-b68a-2932e700a2fe tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:16:06.228327 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-561ada34-6c25-4da7-b68a-2932e700a2fe tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:16:06.229477 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-561ada34-6c25-4da7-b68a-2932e700a2fe tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:16:06.674843 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-561ada34-6c25-4da7-b68a-2932e700a2fe tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:16:06.690238 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-561ada34-6c25-4da7-b68a-2932e700a2fe tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317" status: 200 len: 1393 microversion: 2.1 time: 0.496015 Sep 10 12:16:06.696048 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3055/6102] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:16:06 2022] GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317 => generated 1393 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:16:07.725429 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4fee57f6-8533-40c8-8622-d14142c1166f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:16:07.727520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4fee57f6-8533-40c8-8622-d14142c1166f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:16:07.738773 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4fee57f6-8533-40c8-8622-d14142c1166f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:16:07.739995 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4fee57f6-8533-40c8-8622-d14142c1166f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:16:07.740676 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4fee57f6-8533-40c8-8622-d14142c1166f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:16:07.741654 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4fee57f6-8533-40c8-8622-d14142c1166f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:16:07.742350 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4fee57f6-8533-40c8-8622-d14142c1166f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:16:07.743007 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4fee57f6-8533-40c8-8622-d14142c1166f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:16:07.967494 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4fee57f6-8533-40c8-8622-d14142c1166f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:16:07.982164 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4fee57f6-8533-40c8-8622-d14142c1166f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317" status: 200 len: 1393 microversion: 2.1 time: 0.264158 Sep 10 12:16:07.999892 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3048/6103] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:16:07 2022] GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317 => generated 1393 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:16:09.009766 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-50a308d9-eb42-4cfc-aca1-c28bf1588f2a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:16:09.011138 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-50a308d9-eb42-4cfc-aca1-c28bf1588f2a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:16:09.028582 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50a308d9-eb42-4cfc-aca1-c28bf1588f2a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:16:09.030156 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50a308d9-eb42-4cfc-aca1-c28bf1588f2a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:16:09.030846 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50a308d9-eb42-4cfc-aca1-c28bf1588f2a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:16:09.031908 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50a308d9-eb42-4cfc-aca1-c28bf1588f2a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:16:09.035028 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50a308d9-eb42-4cfc-aca1-c28bf1588f2a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:16:09.036451 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50a308d9-eb42-4cfc-aca1-c28bf1588f2a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:16:09.336698 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-50a308d9-eb42-4cfc-aca1-c28bf1588f2a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:16:09.346082 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-50a308d9-eb42-4cfc-aca1-c28bf1588f2a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317" status: 200 len: 1393 microversion: 2.1 time: 0.341010 Sep 10 12:16:09.348477 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3056/6104] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:16:09 2022] GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317 => generated 1393 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:16:10.371694 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f327cc9f-a795-4224-a569-bd9907a342e3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:16:10.372991 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f327cc9f-a795-4224-a569-bd9907a342e3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:16:10.380862 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:16:10.381871 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:16:10.383771 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f327cc9f-a795-4224-a569-bd9907a342e3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:16:10.384715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f327cc9f-a795-4224-a569-bd9907a342e3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:16:10.385403 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f327cc9f-a795-4224-a569-bd9907a342e3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:16:10.386783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f327cc9f-a795-4224-a569-bd9907a342e3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:16:10.387552 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f327cc9f-a795-4224-a569-bd9907a342e3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:16:10.388638 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f327cc9f-a795-4224-a569-bd9907a342e3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:16:10.580035 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f327cc9f-a795-4224-a569-bd9907a342e3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:16:10.589788 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f327cc9f-a795-4224-a569-bd9907a342e3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317" status: 200 len: 1393 microversion: 2.1 time: 0.222525 Sep 10 12:16:10.591129 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3049/6105] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:16:10 2022] GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317 => generated 1393 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:16:11.194126 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:16:11.463037 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-31a2b5b1-10f8-46c9-9412-55f2a1c7a2f1 req-c9be4b9d-1826-4004-b90d-08cb8c8afb56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cf74b1d-6a20-4859-8c19-3b5a58907317", "name": "network-vif-plugged", "status": "completed", "tag": "1eabf7cc-88d5-44e8-b139-2261b2e28604"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:16:11.474788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-31a2b5b1-10f8-46c9-9412-55f2a1c7a2f1 req-c9be4b9d-1826-4004-b90d-08cb8c8afb56 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:16:11.475310 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-31a2b5b1-10f8-46c9-9412-55f2a1c7a2f1 req-c9be4b9d-1826-4004-b90d-08cb8c8afb56 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:16:11.475761 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-31a2b5b1-10f8-46c9-9412-55f2a1c7a2f1 req-c9be4b9d-1826-4004-b90d-08cb8c8afb56 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:16:11.487878 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-31a2b5b1-10f8-46c9-9412-55f2a1c7a2f1 req-c9be4b9d-1826-4004-b90d-08cb8c8afb56 service nova] Creating event network-vif-plugged:1eabf7cc-88d5-44e8-b139-2261b2e28604 for instance 6cf74b1d-6a20-4859-8c19-3b5a58907317 on n-h1-856895-1 Sep 10 12:16:11.494229 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-31a2b5b1-10f8-46c9-9412-55f2a1c7a2f1 req-c9be4b9d-1826-4004-b90d-08cb8c8afb56 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.306803 Sep 10 12:16:11.495194 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3057/6106] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:16:11.614377 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f2a811eb-2e98-449d-8483-dea1a8c971e7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:16:11.616009 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f2a811eb-2e98-449d-8483-dea1a8c971e7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:16:11.628838 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f2a811eb-2e98-449d-8483-dea1a8c971e7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:16:11.629929 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f2a811eb-2e98-449d-8483-dea1a8c971e7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:16:11.631712 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f2a811eb-2e98-449d-8483-dea1a8c971e7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:16:11.635642 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f2a811eb-2e98-449d-8483-dea1a8c971e7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:16:11.636344 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f2a811eb-2e98-449d-8483-dea1a8c971e7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:16:11.636951 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f2a811eb-2e98-449d-8483-dea1a8c971e7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:16:11.857779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f2a811eb-2e98-449d-8483-dea1a8c971e7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:16:11.867222 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f2a811eb-2e98-449d-8483-dea1a8c971e7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317" status: 200 len: 1393 microversion: 2.1 time: 0.257347 Sep 10 12:16:11.883501 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3050/6107] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:16:11 2022] GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317 => generated 1393 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:16:12.892866 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9e0f43db-0891-434a-96d7-bea4585a983e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:16:12.895065 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9e0f43db-0891-434a-96d7-bea4585a983e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:16:12.908900 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9e0f43db-0891-434a-96d7-bea4585a983e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:16:12.909667 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9e0f43db-0891-434a-96d7-bea4585a983e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:16:12.911206 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9e0f43db-0891-434a-96d7-bea4585a983e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:16:12.915820 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9e0f43db-0891-434a-96d7-bea4585a983e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:16:12.917746 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9e0f43db-0891-434a-96d7-bea4585a983e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:16:12.920047 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9e0f43db-0891-434a-96d7-bea4585a983e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:16:13.243139 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9e0f43db-0891-434a-96d7-bea4585a983e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:16:13.252807 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9e0f43db-0891-434a-96d7-bea4585a983e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317" status: 200 len: 1393 microversion: 2.1 time: 0.365800 Sep 10 12:16:13.258006 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3058/6108] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:16:12 2022] GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317 => generated 1393 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:16:14.302713 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7bf62645-c8da-41bb-a204-9f7bf761343d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:16:14.306267 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7bf62645-c8da-41bb-a204-9f7bf761343d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:16:14.330138 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7bf62645-c8da-41bb-a204-9f7bf761343d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:16:14.330979 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7bf62645-c8da-41bb-a204-9f7bf761343d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:16:14.333088 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7bf62645-c8da-41bb-a204-9f7bf761343d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:16:14.336705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7bf62645-c8da-41bb-a204-9f7bf761343d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:16:14.337717 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7bf62645-c8da-41bb-a204-9f7bf761343d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:16:14.338960 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7bf62645-c8da-41bb-a204-9f7bf761343d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:16:14.651509 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7bf62645-c8da-41bb-a204-9f7bf761343d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:16:14.663077 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7bf62645-c8da-41bb-a204-9f7bf761343d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317" status: 200 len: 1564 microversion: 2.1 time: 0.384110 Sep 10 12:16:14.665272 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3051/6109] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:16:14 2022] GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317 => generated 1564 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:16:14.690098 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-20702fe9-1502-4b7d-b999-27f76f406a98 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:16:14.690911 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-20702fe9-1502-4b7d-b999-27f76f406a98 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:16:14.703533 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20702fe9-1502-4b7d-b999-27f76f406a98 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:16:14.704032 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20702fe9-1502-4b7d-b999-27f76f406a98 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:16:14.704482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20702fe9-1502-4b7d-b999-27f76f406a98 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:16:14.706866 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20702fe9-1502-4b7d-b999-27f76f406a98 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:16:14.707432 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20702fe9-1502-4b7d-b999-27f76f406a98 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:16:14.707872 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20702fe9-1502-4b7d-b999-27f76f406a98 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:16:14.983102 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-20702fe9-1502-4b7d-b999-27f76f406a98 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:16:14.993545 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-20702fe9-1502-4b7d-b999-27f76f406a98 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317" status: 200 len: 1564 microversion: 2.1 time: 0.309952 Sep 10 12:16:14.994455 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3059/6110] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:16:14 2022] GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317 => generated 1564 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:16:17.196759 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0c6ffc0a-2983-4fb2-b766-3d1347ce5eb4 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:16:17.198496 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0c6ffc0a-2983-4fb2-b766-3d1347ce5eb4 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:16:17.211969 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c6ffc0a-2983-4fb2-b766-3d1347ce5eb4 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:16:17.217378 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c6ffc0a-2983-4fb2-b766-3d1347ce5eb4 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:16:17.217781 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c6ffc0a-2983-4fb2-b766-3d1347ce5eb4 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:16:17.218588 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c6ffc0a-2983-4fb2-b766-3d1347ce5eb4 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:16:17.219002 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c6ffc0a-2983-4fb2-b766-3d1347ce5eb4 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:16:17.219466 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c6ffc0a-2983-4fb2-b766-3d1347ce5eb4 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:16:17.460238 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0c6ffc0a-2983-4fb2-b766-3d1347ce5eb4 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:16:17.469676 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0c6ffc0a-2983-4fb2-b766-3d1347ce5eb4 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317" status: 200 len: 1564 microversion: 2.1 time: 0.276873 Sep 10 12:16:17.471762 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3052/6111] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:16:17 2022] GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317 => generated 1564 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:16:17.552682 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-e29da4f5-dfc7-4abb-b107-802a691d152b req-b7eff27c-9ad8-4833-8fba-ca27d4494c7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cf74b1d-6a20-4859-8c19-3b5a58907317", "tag": "1eabf7cc-88d5-44e8-b139-2261b2e28604"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:16:17.575287 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e29da4f5-dfc7-4abb-b107-802a691d152b req-b7eff27c-9ad8-4833-8fba-ca27d4494c7b service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:16:17.579582 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e29da4f5-dfc7-4abb-b107-802a691d152b req-b7eff27c-9ad8-4833-8fba-ca27d4494c7b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:16:17.580670 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e29da4f5-dfc7-4abb-b107-802a691d152b req-b7eff27c-9ad8-4833-8fba-ca27d4494c7b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:16:17.600169 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-e29da4f5-dfc7-4abb-b107-802a691d152b req-b7eff27c-9ad8-4833-8fba-ca27d4494c7b service nova] Creating event network-changed:1eabf7cc-88d5-44e8-b139-2261b2e28604 for instance 6cf74b1d-6a20-4859-8c19-3b5a58907317 on n-h1-856895-1 Sep 10 12:16:17.636970 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-e29da4f5-dfc7-4abb-b107-802a691d152b req-b7eff27c-9ad8-4833-8fba-ca27d4494c7b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.413535 Sep 10 12:16:17.642376 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3060/6112] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:16:49.947728 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ff082940-df06-4ea5-981f-0ae7f2d79231 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:16:49.951581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ff082940-df06-4ea5-981f-0ae7f2d79231 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:16:49.955544 n-d-856895-1 devstack@n-api.service[128777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 12:16:49.956314 n-d-856895-1 devstack@n-api.service[128777]: Sat Sep 10 12:16:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317/action (ip 10.222.0.23) !!! Sep 10 12:16:49.957352 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:16:49.958058 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=50 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:16:49.963291 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ff082940-df06-4ea5-981f-0ae7f2d79231 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:16:49.963771 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ff082940-df06-4ea5-981f-0ae7f2d79231 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:16:49.964404 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ff082940-df06-4ea5-981f-0ae7f2d79231 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:16:49.965106 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ff082940-df06-4ea5-981f-0ae7f2d79231 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:16:49.965728 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ff082940-df06-4ea5-981f-0ae7f2d79231 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:16:49.966160 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ff082940-df06-4ea5-981f-0ae7f2d79231 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:16:50.041769 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ff082940-df06-4ea5-981f-0ae7f2d79231 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "POST /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317/action" status: 200 len: 24569 microversion: 2.1 time: 0.097486 Sep 10 12:16:50.043700 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3053/6113] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:16:49 2022] POST /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317/action => generated 24569 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 12:17:20.491704 n-d-856895-1 devstack@n-api.service[128776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 12:17:20.492498 n-d-856895-1 devstack@n-api.service[128776]: Sat Sep 10 12:17:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317 (ip 10.222.0.23) !!! Sep 10 12:17:20.494105 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=20 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:17:20.494946 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=36 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:17:20.500228 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-41112fcf-2076-4b60-b6d7-56bda1d476ac tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:17:20.501849 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-41112fcf-2076-4b60-b6d7-56bda1d476ac tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:17:20.515580 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41112fcf-2076-4b60-b6d7-56bda1d476ac tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:20.516078 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41112fcf-2076-4b60-b6d7-56bda1d476ac tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:20.516658 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41112fcf-2076-4b60-b6d7-56bda1d476ac tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:20.518369 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41112fcf-2076-4b60-b6d7-56bda1d476ac tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:20.519410 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41112fcf-2076-4b60-b6d7-56bda1d476ac tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:20.520030 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41112fcf-2076-4b60-b6d7-56bda1d476ac tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:21.372918 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-41112fcf-2076-4b60-b6d7-56bda1d476ac tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317" status: 200 len: 1834 microversion: 2.1 time: 0.883698 Sep 10 12:17:21.411251 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3061/6114] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:17:20 2022] GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317 => generated 1834 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:17:21.414061 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-02b94100-feaa-4eb7-a0bd-8421b8630bc8 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:17:21.415446 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-02b94100-feaa-4eb7-a0bd-8421b8630bc8 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:17:21.418689 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=4 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:17:21.420005 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:17:21.432949 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02b94100-feaa-4eb7-a0bd-8421b8630bc8 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:21.433390 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02b94100-feaa-4eb7-a0bd-8421b8630bc8 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:21.433995 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02b94100-feaa-4eb7-a0bd-8421b8630bc8 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:21.434553 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02b94100-feaa-4eb7-a0bd-8421b8630bc8 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:21.435022 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02b94100-feaa-4eb7-a0bd-8421b8630bc8 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:21.443731 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02b94100-feaa-4eb7-a0bd-8421b8630bc8 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:21.952924 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-02b94100-feaa-4eb7-a0bd-8421b8630bc8 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:17:21.983205 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-02b94100-feaa-4eb7-a0bd-8421b8630bc8 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317" status: 200 len: 1683 microversion: 2.1 time: 0.574276 Sep 10 12:17:21.985729 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3054/6115] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:17:21 2022] GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317 => generated 1683 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:17:22.201234 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8e908608-135a-4a3e-bfd1-cad70193920c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:17:22.204291 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8e908608-135a-4a3e-bfd1-cad70193920c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:17:22.224481 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e908608-135a-4a3e-bfd1-cad70193920c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:22.228895 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e908608-135a-4a3e-bfd1-cad70193920c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:22.229479 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e908608-135a-4a3e-bfd1-cad70193920c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:22.232713 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e908608-135a-4a3e-bfd1-cad70193920c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:22.234296 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e908608-135a-4a3e-bfd1-cad70193920c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:22.235415 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e908608-135a-4a3e-bfd1-cad70193920c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:22.327828 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8e908608-135a-4a3e-bfd1-cad70193920c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "POST /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317/action" status: 200 len: 32642 microversion: 2.1 time: 0.130253 Sep 10 12:17:22.329155 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3062/6116] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:17:22 2022] POST /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317/action => generated 32642 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 12:17:22.528489 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-accd3958-660c-41fb-b864-999bab2a7f12 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:17:22.530295 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-accd3958-660c-41fb-b864-999bab2a7f12 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:17:22.550464 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-accd3958-660c-41fb-b864-999bab2a7f12 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:22.554502 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-accd3958-660c-41fb-b864-999bab2a7f12 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:22.555629 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-accd3958-660c-41fb-b864-999bab2a7f12 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:22.559001 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-accd3958-660c-41fb-b864-999bab2a7f12 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:22.560203 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-accd3958-660c-41fb-b864-999bab2a7f12 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:22.570022 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-accd3958-660c-41fb-b864-999bab2a7f12 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:22.998322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-accd3958-660c-41fb-b864-999bab2a7f12 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '64835652a9aa4f478aad24a9b7a86031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56aceede5b8f49909ef3334082c453be', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:17:22.998953 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-accd3958-660c-41fb-b864-999bab2a7f12 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] flavor_id is None. Assuming migration. {{(pid=128777) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 10 12:17:22.999430 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-accd3958-660c-41fb-b864-999bab2a7f12 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128777) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 12:17:23.311449 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-accd3958-660c-41fb-b864-999bab2a7f12 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317/action" status: 202 len: 0 microversion: 2.1 time: 0.790422 Sep 10 12:17:23.312169 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3055/6117] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:17:22 2022] POST /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317/action => generated 0 bytes in 793 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:17:23.327258 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c41612e1-33bc-485a-b908-e1ca8f2fa03e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:17:23.327997 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c41612e1-33bc-485a-b908-e1ca8f2fa03e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:17:23.347430 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c41612e1-33bc-485a-b908-e1ca8f2fa03e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:23.348330 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c41612e1-33bc-485a-b908-e1ca8f2fa03e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:23.348330 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c41612e1-33bc-485a-b908-e1ca8f2fa03e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:23.349053 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c41612e1-33bc-485a-b908-e1ca8f2fa03e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:23.349515 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c41612e1-33bc-485a-b908-e1ca8f2fa03e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:23.349948 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c41612e1-33bc-485a-b908-e1ca8f2fa03e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:23.642565 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c41612e1-33bc-485a-b908-e1ca8f2fa03e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:17:23.654157 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c41612e1-33bc-485a-b908-e1ca8f2fa03e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317" status: 200 len: 1692 microversion: 2.1 time: 0.335967 Sep 10 12:17:23.655560 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3063/6118] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:17:23 2022] GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317 => generated 1692 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:17:24.680808 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-18d4bebc-25cc-4ac6-a7da-22ab6cecf6ee tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:17:24.681587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-18d4bebc-25cc-4ac6-a7da-22ab6cecf6ee tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:17:24.688118 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-18d4bebc-25cc-4ac6-a7da-22ab6cecf6ee tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:24.688779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-18d4bebc-25cc-4ac6-a7da-22ab6cecf6ee tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:24.689749 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-18d4bebc-25cc-4ac6-a7da-22ab6cecf6ee tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:24.690655 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-18d4bebc-25cc-4ac6-a7da-22ab6cecf6ee tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:24.691458 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-18d4bebc-25cc-4ac6-a7da-22ab6cecf6ee tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:24.692068 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-18d4bebc-25cc-4ac6-a7da-22ab6cecf6ee tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:24.998990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-18d4bebc-25cc-4ac6-a7da-22ab6cecf6ee tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:17:25.011371 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-18d4bebc-25cc-4ac6-a7da-22ab6cecf6ee tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317" status: 200 len: 1692 microversion: 2.1 time: 0.336303 Sep 10 12:17:25.013369 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3056/6119] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:17:24 2022] GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317 => generated 1692 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:17:26.036107 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ed440ef8-36bd-478b-9761-91ede8952f39 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:17:26.037323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ed440ef8-36bd-478b-9761-91ede8952f39 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:17:26.051186 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed440ef8-36bd-478b-9761-91ede8952f39 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:26.051861 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed440ef8-36bd-478b-9761-91ede8952f39 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:26.052653 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed440ef8-36bd-478b-9761-91ede8952f39 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:26.053544 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed440ef8-36bd-478b-9761-91ede8952f39 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:26.054168 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed440ef8-36bd-478b-9761-91ede8952f39 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:26.054839 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ed440ef8-36bd-478b-9761-91ede8952f39 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:26.316261 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ed440ef8-36bd-478b-9761-91ede8952f39 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:17:26.338075 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ed440ef8-36bd-478b-9761-91ede8952f39 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317" status: 200 len: 1692 microversion: 2.1 time: 0.305932 Sep 10 12:17:26.343756 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3064/6120] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:17:26 2022] GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317 => generated 1692 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:17:27.369767 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-25c7eca3-ad34-4994-a988-ccfcadce369a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:17:27.370419 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-25c7eca3-ad34-4994-a988-ccfcadce369a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:17:27.387361 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25c7eca3-ad34-4994-a988-ccfcadce369a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:27.388510 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25c7eca3-ad34-4994-a988-ccfcadce369a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:27.389289 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25c7eca3-ad34-4994-a988-ccfcadce369a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:27.390239 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25c7eca3-ad34-4994-a988-ccfcadce369a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:27.390867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25c7eca3-ad34-4994-a988-ccfcadce369a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:27.391685 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25c7eca3-ad34-4994-a988-ccfcadce369a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:27.597286 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-25c7eca3-ad34-4994-a988-ccfcadce369a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:17:27.605327 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-25c7eca3-ad34-4994-a988-ccfcadce369a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317" status: 200 len: 1697 microversion: 2.1 time: 0.241171 Sep 10 12:17:27.606699 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3057/6121] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:17:27 2022] GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317 => generated 1697 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:17:28.631083 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-472bee36-8858-4c8b-99e7-df922191d7bb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:17:28.631929 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-472bee36-8858-4c8b-99e7-df922191d7bb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:17:28.645413 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-472bee36-8858-4c8b-99e7-df922191d7bb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:28.646032 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-472bee36-8858-4c8b-99e7-df922191d7bb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:28.648988 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-472bee36-8858-4c8b-99e7-df922191d7bb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:28.650023 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-472bee36-8858-4c8b-99e7-df922191d7bb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:28.651526 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-472bee36-8858-4c8b-99e7-df922191d7bb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:28.652087 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-472bee36-8858-4c8b-99e7-df922191d7bb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:28.909033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-472bee36-8858-4c8b-99e7-df922191d7bb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:17:28.918395 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-472bee36-8858-4c8b-99e7-df922191d7bb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317" status: 200 len: 1697 microversion: 2.1 time: 0.292512 Sep 10 12:17:28.919016 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3065/6122] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:17:28 2022] GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317 => generated 1697 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:17:29.945831 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-39c99f40-d8f8-46fd-a37c-13415c61037f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:17:29.947796 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-39c99f40-d8f8-46fd-a37c-13415c61037f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:17:29.972120 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-39c99f40-d8f8-46fd-a37c-13415c61037f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:29.972829 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-39c99f40-d8f8-46fd-a37c-13415c61037f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:29.974769 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-39c99f40-d8f8-46fd-a37c-13415c61037f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:29.976826 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-39c99f40-d8f8-46fd-a37c-13415c61037f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:29.977944 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-39c99f40-d8f8-46fd-a37c-13415c61037f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:29.979399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-39c99f40-d8f8-46fd-a37c-13415c61037f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:30.178244 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-39c99f40-d8f8-46fd-a37c-13415c61037f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:17:30.196345 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-39c99f40-d8f8-46fd-a37c-13415c61037f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317" status: 200 len: 1697 microversion: 2.1 time: 0.255535 Sep 10 12:17:30.197555 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3058/6123] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:17:29 2022] GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317 => generated 1697 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:17:31.220608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c205dc27-f851-42d1-91d4-484a2c4e2be8 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:17:31.221243 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c205dc27-f851-42d1-91d4-484a2c4e2be8 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:17:31.240079 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c205dc27-f851-42d1-91d4-484a2c4e2be8 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:31.240594 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c205dc27-f851-42d1-91d4-484a2c4e2be8 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:31.241040 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c205dc27-f851-42d1-91d4-484a2c4e2be8 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:31.241764 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c205dc27-f851-42d1-91d4-484a2c4e2be8 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:31.242230 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c205dc27-f851-42d1-91d4-484a2c4e2be8 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:31.242668 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c205dc27-f851-42d1-91d4-484a2c4e2be8 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:31.429119 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c205dc27-f851-42d1-91d4-484a2c4e2be8 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:17:31.442982 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c205dc27-f851-42d1-91d4-484a2c4e2be8 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317" status: 200 len: 1697 microversion: 2.1 time: 0.225694 Sep 10 12:17:31.444408 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3066/6124] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:17:31 2022] GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317 => generated 1697 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:17:32.468430 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0560290f-3479-4fa6-95ad-164fa41b3085 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:17:32.469059 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0560290f-3479-4fa6-95ad-164fa41b3085 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:17:32.481109 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0560290f-3479-4fa6-95ad-164fa41b3085 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:32.482147 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0560290f-3479-4fa6-95ad-164fa41b3085 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:32.482876 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0560290f-3479-4fa6-95ad-164fa41b3085 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:32.483909 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0560290f-3479-4fa6-95ad-164fa41b3085 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:32.484381 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0560290f-3479-4fa6-95ad-164fa41b3085 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:32.484820 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0560290f-3479-4fa6-95ad-164fa41b3085 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:32.690756 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0560290f-3479-4fa6-95ad-164fa41b3085 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:17:32.697025 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0560290f-3479-4fa6-95ad-164fa41b3085 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317" status: 200 len: 1697 microversion: 2.1 time: 0.232555 Sep 10 12:17:32.697964 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3059/6125] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:17:32 2022] GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317 => generated 1697 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:17:33.726214 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f4855f4c-9596-4aa9-964a-c9943865395f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:17:33.726828 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f4855f4c-9596-4aa9-964a-c9943865395f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:17:33.734657 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4855f4c-9596-4aa9-964a-c9943865395f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:33.735487 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4855f4c-9596-4aa9-964a-c9943865395f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:33.735935 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4855f4c-9596-4aa9-964a-c9943865395f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:33.736651 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4855f4c-9596-4aa9-964a-c9943865395f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:33.737113 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4855f4c-9596-4aa9-964a-c9943865395f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:33.737547 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4855f4c-9596-4aa9-964a-c9943865395f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:33.915696 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f4855f4c-9596-4aa9-964a-c9943865395f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:17:33.933209 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f4855f4c-9596-4aa9-964a-c9943865395f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317" status: 200 len: 1697 microversion: 2.1 time: 0.211603 Sep 10 12:17:33.933897 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3067/6126] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:17:33 2022] GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317 => generated 1697 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:17:34.974073 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-edc06227-e5cd-4f4c-810c-632367b370ec tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:17:34.976305 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-edc06227-e5cd-4f4c-810c-632367b370ec tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:17:34.990224 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-edc06227-e5cd-4f4c-810c-632367b370ec tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:34.992644 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-edc06227-e5cd-4f4c-810c-632367b370ec tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:34.993333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-edc06227-e5cd-4f4c-810c-632367b370ec tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:34.995003 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-edc06227-e5cd-4f4c-810c-632367b370ec tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:34.995985 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-edc06227-e5cd-4f4c-810c-632367b370ec tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:34.997416 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-edc06227-e5cd-4f4c-810c-632367b370ec tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:35.267386 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-edc06227-e5cd-4f4c-810c-632367b370ec tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:17:35.279112 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-edc06227-e5cd-4f4c-810c-632367b370ec tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317" status: 200 len: 1697 microversion: 2.1 time: 0.323581 Sep 10 12:17:35.298629 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3060/6127] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:17:34 2022] GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317 => generated 1697 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:17:36.308612 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2939b9e4-8ccd-4a7a-bd8d-ba87b5ba28d1 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:17:36.310163 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2939b9e4-8ccd-4a7a-bd8d-ba87b5ba28d1 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:17:36.320494 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2939b9e4-8ccd-4a7a-bd8d-ba87b5ba28d1 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:36.321322 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2939b9e4-8ccd-4a7a-bd8d-ba87b5ba28d1 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:36.321988 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2939b9e4-8ccd-4a7a-bd8d-ba87b5ba28d1 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:36.322975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2939b9e4-8ccd-4a7a-bd8d-ba87b5ba28d1 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:36.323928 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2939b9e4-8ccd-4a7a-bd8d-ba87b5ba28d1 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:36.326527 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2939b9e4-8ccd-4a7a-bd8d-ba87b5ba28d1 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:36.506483 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2939b9e4-8ccd-4a7a-bd8d-ba87b5ba28d1 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:17:36.514525 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2939b9e4-8ccd-4a7a-bd8d-ba87b5ba28d1 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317" status: 200 len: 1697 microversion: 2.1 time: 0.209727 Sep 10 12:17:36.515098 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3068/6128] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:17:36 2022] GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317 => generated 1697 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:17:37.540531 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e005b4c2-5c0b-4a03-ae7b-434d489b1714 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:17:37.541231 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e005b4c2-5c0b-4a03-ae7b-434d489b1714 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:17:37.550138 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e005b4c2-5c0b-4a03-ae7b-434d489b1714 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:37.550638 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e005b4c2-5c0b-4a03-ae7b-434d489b1714 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:37.551079 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e005b4c2-5c0b-4a03-ae7b-434d489b1714 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:37.553209 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e005b4c2-5c0b-4a03-ae7b-434d489b1714 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:37.553680 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e005b4c2-5c0b-4a03-ae7b-434d489b1714 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:37.554110 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e005b4c2-5c0b-4a03-ae7b-434d489b1714 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:37.770288 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e005b4c2-5c0b-4a03-ae7b-434d489b1714 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:17:37.779330 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e005b4c2-5c0b-4a03-ae7b-434d489b1714 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317" status: 200 len: 1697 microversion: 2.1 time: 0.243248 Sep 10 12:17:37.780493 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3061/6129] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:17:37 2022] GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317 => generated 1697 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:17:38.807480 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a1d8b037-e506-49fc-93b5-68cac26aa3b7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:17:38.810622 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a1d8b037-e506-49fc-93b5-68cac26aa3b7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:17:38.826857 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a1d8b037-e506-49fc-93b5-68cac26aa3b7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:38.847971 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a1d8b037-e506-49fc-93b5-68cac26aa3b7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:38.848494 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a1d8b037-e506-49fc-93b5-68cac26aa3b7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:38.849313 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a1d8b037-e506-49fc-93b5-68cac26aa3b7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:38.849847 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a1d8b037-e506-49fc-93b5-68cac26aa3b7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:38.850290 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a1d8b037-e506-49fc-93b5-68cac26aa3b7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:39.124932 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a1d8b037-e506-49fc-93b5-68cac26aa3b7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:17:39.164599 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a1d8b037-e506-49fc-93b5-68cac26aa3b7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317" status: 200 len: 1696 microversion: 2.1 time: 0.363584 Sep 10 12:17:39.167483 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3069/6130] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:17:38 2022] GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317 => generated 1696 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:17:39.709239 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-3f097f5f-ebc7-4bec-bbf4-c28db145889c req-f5f4cbd8-5bdd-41d0-8239-5c1092fbf854 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cf74b1d-6a20-4859-8c19-3b5a58907317", "name": "network-vif-unplugged", "status": "completed", "tag": "1eabf7cc-88d5-44e8-b139-2261b2e28604"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:17:39.726195 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-3f097f5f-ebc7-4bec-bbf4-c28db145889c req-f5f4cbd8-5bdd-41d0-8239-5c1092fbf854 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:39.733760 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-3f097f5f-ebc7-4bec-bbf4-c28db145889c req-f5f4cbd8-5bdd-41d0-8239-5c1092fbf854 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:39.735995 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-3f097f5f-ebc7-4bec-bbf4-c28db145889c req-f5f4cbd8-5bdd-41d0-8239-5c1092fbf854 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:39.759365 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-3f097f5f-ebc7-4bec-bbf4-c28db145889c req-f5f4cbd8-5bdd-41d0-8239-5c1092fbf854 service nova] Creating event network-vif-unplugged:1eabf7cc-88d5-44e8-b139-2261b2e28604 for instance 6cf74b1d-6a20-4859-8c19-3b5a58907317 on n-h2-856895-1 Sep 10 12:17:39.769446 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [req-3f097f5f-ebc7-4bec-bbf4-c28db145889c req-f5f4cbd8-5bdd-41d0-8239-5c1092fbf854 service nova] Instance 6cf74b1d-6a20-4859-8c19-3b5a58907317 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856895-1', 'n-h1-856895-1'} {{(pid=128777) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 12:17:39.785744 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-3f097f5f-ebc7-4bec-bbf4-c28db145889c req-f5f4cbd8-5bdd-41d0-8239-5c1092fbf854 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.296306 Sep 10 12:17:39.787722 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3062/6131] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:17:40.190068 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3ee982cd-308b-44ff-bbfd-c496222f16eb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:17:40.190699 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3ee982cd-308b-44ff-bbfd-c496222f16eb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:17:40.202374 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3ee982cd-308b-44ff-bbfd-c496222f16eb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:40.207725 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3ee982cd-308b-44ff-bbfd-c496222f16eb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:40.208190 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3ee982cd-308b-44ff-bbfd-c496222f16eb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:40.208945 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3ee982cd-308b-44ff-bbfd-c496222f16eb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:40.209410 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3ee982cd-308b-44ff-bbfd-c496222f16eb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:40.209838 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3ee982cd-308b-44ff-bbfd-c496222f16eb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:40.558712 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3ee982cd-308b-44ff-bbfd-c496222f16eb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:17:40.573011 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3ee982cd-308b-44ff-bbfd-c496222f16eb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317" status: 200 len: 1696 microversion: 2.1 time: 0.387298 Sep 10 12:17:40.588034 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3070/6132] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:17:40 2022] GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317 => generated 1696 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:17:41.603714 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-58461c94-3aa9-4b5a-a326-d9e15bbbf7b4 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:17:41.604458 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-58461c94-3aa9-4b5a-a326-d9e15bbbf7b4 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:17:41.612815 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-58461c94-3aa9-4b5a-a326-d9e15bbbf7b4 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:41.613668 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-58461c94-3aa9-4b5a-a326-d9e15bbbf7b4 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:41.614119 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-58461c94-3aa9-4b5a-a326-d9e15bbbf7b4 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:41.615053 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-58461c94-3aa9-4b5a-a326-d9e15bbbf7b4 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:41.615784 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-58461c94-3aa9-4b5a-a326-d9e15bbbf7b4 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:41.616224 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-58461c94-3aa9-4b5a-a326-d9e15bbbf7b4 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:41.851702 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-e1e4dab9-e390-4a49-b884-faeb8be41847 req-f060dd92-57be-4765-a57d-87c5aa40da5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cf74b1d-6a20-4859-8c19-3b5a58907317", "tag": "1eabf7cc-88d5-44e8-b139-2261b2e28604"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:17:41.852839 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-58461c94-3aa9-4b5a-a326-d9e15bbbf7b4 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:17:41.861331 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-58461c94-3aa9-4b5a-a326-d9e15bbbf7b4 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317" status: 200 len: 1694 microversion: 2.1 time: 0.263131 Sep 10 12:17:41.863233 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3063/6133] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:17:41 2022] GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317 => generated 1694 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:17:41.869951 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e1e4dab9-e390-4a49-b884-faeb8be41847 req-f060dd92-57be-4765-a57d-87c5aa40da5d service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:41.870694 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e1e4dab9-e390-4a49-b884-faeb8be41847 req-f060dd92-57be-4765-a57d-87c5aa40da5d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:41.871392 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e1e4dab9-e390-4a49-b884-faeb8be41847 req-f060dd92-57be-4765-a57d-87c5aa40da5d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:41.892050 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-e1e4dab9-e390-4a49-b884-faeb8be41847 req-f060dd92-57be-4765-a57d-87c5aa40da5d service nova] Creating event network-changed:1eabf7cc-88d5-44e8-b139-2261b2e28604 for instance 6cf74b1d-6a20-4859-8c19-3b5a58907317 on n-h2-856895-1 Sep 10 12:17:41.899455 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [req-e1e4dab9-e390-4a49-b884-faeb8be41847 req-f060dd92-57be-4765-a57d-87c5aa40da5d service nova] Instance 6cf74b1d-6a20-4859-8c19-3b5a58907317 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856895-1', 'n-h1-856895-1'} {{(pid=128776) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 12:17:41.918487 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-e1e4dab9-e390-4a49-b884-faeb8be41847 req-f060dd92-57be-4765-a57d-87c5aa40da5d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072074 Sep 10 12:17:41.919655 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3071/6134] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:17:42.886824 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-43eb787c-3a8b-4676-ad0f-5e56af909144 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:17:42.887597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-43eb787c-3a8b-4676-ad0f-5e56af909144 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:17:42.896098 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-43eb787c-3a8b-4676-ad0f-5e56af909144 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:42.896858 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-43eb787c-3a8b-4676-ad0f-5e56af909144 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:42.897506 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-43eb787c-3a8b-4676-ad0f-5e56af909144 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:42.898399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-43eb787c-3a8b-4676-ad0f-5e56af909144 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:42.899022 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-43eb787c-3a8b-4676-ad0f-5e56af909144 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:42.899674 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-43eb787c-3a8b-4676-ad0f-5e56af909144 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:43.441566 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-43eb787c-3a8b-4676-ad0f-5e56af909144 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:17:43.449891 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-43eb787c-3a8b-4676-ad0f-5e56af909144 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317" status: 200 len: 1691 microversion: 2.1 time: 0.567028 Sep 10 12:17:43.456250 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3064/6135] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:17:42 2022] GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317 => generated 1691 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:17:43.480495 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f1f32b45-16ce-446a-b1bf-5b3a892fc22f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:17:43.481938 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f1f32b45-16ce-446a-b1bf-5b3a892fc22f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:17:43.490929 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1f32b45-16ce-446a-b1bf-5b3a892fc22f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:43.491477 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1f32b45-16ce-446a-b1bf-5b3a892fc22f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:43.491927 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1f32b45-16ce-446a-b1bf-5b3a892fc22f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:43.493091 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1f32b45-16ce-446a-b1bf-5b3a892fc22f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:43.493557 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1f32b45-16ce-446a-b1bf-5b3a892fc22f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:43.494225 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1f32b45-16ce-446a-b1bf-5b3a892fc22f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:43.567728 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f1f32b45-16ce-446a-b1bf-5b3a892fc22f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "POST /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317/action" status: 204 len: 0 microversion: 2.1 time: 0.091299 Sep 10 12:17:43.569106 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3072/6136] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:17:43 2022] POST /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317/action => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:17:43.577559 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8e2a0987-78e7-46a4-87bf-cefe259016f3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:17:43.578184 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8e2a0987-78e7-46a4-87bf-cefe259016f3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:17:43.585169 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e2a0987-78e7-46a4-87bf-cefe259016f3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:43.585951 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e2a0987-78e7-46a4-87bf-cefe259016f3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:43.586813 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e2a0987-78e7-46a4-87bf-cefe259016f3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:43.588011 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e2a0987-78e7-46a4-87bf-cefe259016f3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:43.588726 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e2a0987-78e7-46a4-87bf-cefe259016f3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:43.589536 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e2a0987-78e7-46a4-87bf-cefe259016f3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:43.978369 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8e2a0987-78e7-46a4-87bf-cefe259016f3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:17:43.999610 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8e2a0987-78e7-46a4-87bf-cefe259016f3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317" status: 200 len: 1691 microversion: 2.1 time: 0.426123 Sep 10 12:17:44.000220 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3065/6137] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:17:43 2022] GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317 => generated 1691 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:17:44.723577 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-dc8b9358-bec8-47db-b81c-64b5f36ae9ea req-3902e888-af36-4c8a-9bc5-078650a3f40a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cf74b1d-6a20-4859-8c19-3b5a58907317", "name": "network-vif-plugged", "status": "completed", "tag": "1eabf7cc-88d5-44e8-b139-2261b2e28604"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:17:44.744590 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-dc8b9358-bec8-47db-b81c-64b5f36ae9ea req-3902e888-af36-4c8a-9bc5-078650a3f40a service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:44.745080 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-dc8b9358-bec8-47db-b81c-64b5f36ae9ea req-3902e888-af36-4c8a-9bc5-078650a3f40a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:44.745519 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-dc8b9358-bec8-47db-b81c-64b5f36ae9ea req-3902e888-af36-4c8a-9bc5-078650a3f40a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:44.774196 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-dc8b9358-bec8-47db-b81c-64b5f36ae9ea req-3902e888-af36-4c8a-9bc5-078650a3f40a service nova] Creating event network-vif-plugged:1eabf7cc-88d5-44e8-b139-2261b2e28604 for instance 6cf74b1d-6a20-4859-8c19-3b5a58907317 on n-h2-856895-1 Sep 10 12:17:44.789705 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [req-dc8b9358-bec8-47db-b81c-64b5f36ae9ea req-3902e888-af36-4c8a-9bc5-078650a3f40a service nova] Instance 6cf74b1d-6a20-4859-8c19-3b5a58907317 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856895-1', 'n-h1-856895-1'} {{(pid=128776) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 12:17:44.822364 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-dc8b9358-bec8-47db-b81c-64b5f36ae9ea req-3902e888-af36-4c8a-9bc5-078650a3f40a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104668 Sep 10 12:17:44.823449 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3073/6138] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:17:45.028948 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-885ae16b-bac8-40d0-ab40-9bc90ab44056 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:17:45.030499 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-885ae16b-bac8-40d0-ab40-9bc90ab44056 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:17:45.044615 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-885ae16b-bac8-40d0-ab40-9bc90ab44056 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:45.051107 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-885ae16b-bac8-40d0-ab40-9bc90ab44056 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:45.051938 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-885ae16b-bac8-40d0-ab40-9bc90ab44056 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:45.052933 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-885ae16b-bac8-40d0-ab40-9bc90ab44056 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:45.053625 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-885ae16b-bac8-40d0-ab40-9bc90ab44056 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:45.054689 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-885ae16b-bac8-40d0-ab40-9bc90ab44056 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:45.279198 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-885ae16b-bac8-40d0-ab40-9bc90ab44056 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:17:45.289017 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-885ae16b-bac8-40d0-ab40-9bc90ab44056 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317" status: 200 len: 1691 microversion: 2.1 time: 0.264071 Sep 10 12:17:45.304774 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3066/6139] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:17:45 2022] GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317 => generated 1691 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:17:46.315893 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0cc5b318-5c3c-4fd9-974a-f717c3e58874 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:17:46.316657 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0cc5b318-5c3c-4fd9-974a-f717c3e58874 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:17:46.336003 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0cc5b318-5c3c-4fd9-974a-f717c3e58874 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:46.336511 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0cc5b318-5c3c-4fd9-974a-f717c3e58874 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:46.337224 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0cc5b318-5c3c-4fd9-974a-f717c3e58874 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:46.348197 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0cc5b318-5c3c-4fd9-974a-f717c3e58874 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:17:46.348771 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0cc5b318-5c3c-4fd9-974a-f717c3e58874 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:17:46.349285 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0cc5b318-5c3c-4fd9-974a-f717c3e58874 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:17:46.567676 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0cc5b318-5c3c-4fd9-974a-f717c3e58874 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:17:46.578964 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0cc5b318-5c3c-4fd9-974a-f717c3e58874 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317" status: 200 len: 1683 microversion: 2.1 time: 0.267484 Sep 10 12:17:46.580113 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3074/6140] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:17:46 2022] GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317 => generated 1683 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:18:04.545166 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b13fb326-7fed-4e90-b550-8c3653f8a0a5 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-879376162", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:18:04.554164 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=28 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:18:04.555321 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:18:04.808098 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-b13fb326-7fed-4e90-b550-8c3653f8a0a5 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] validate_networks() for None {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:18:05.020194 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-b13fb326-7fed-4e90-b550-8c3653f8a0a5 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:18:05.020796 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-b13fb326-7fed-4e90-b550-8c3653f8a0a5 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:18:05.021463 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-b13fb326-7fed-4e90-b550-8c3653f8a0a5 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:18:05.021913 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-b13fb326-7fed-4e90-b550-8c3653f8a0a5 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:18:05.022379 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-b13fb326-7fed-4e90-b550-8c3653f8a0a5 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:18:05.034048 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b13fb326-7fed-4e90-b550-8c3653f8a0a5 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:05.034838 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b13fb326-7fed-4e90-b550-8c3653f8a0a5 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:05.035322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b13fb326-7fed-4e90-b550-8c3653f8a0a5 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:05.036097 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b13fb326-7fed-4e90-b550-8c3653f8a0a5 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:05.036600 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b13fb326-7fed-4e90-b550-8c3653f8a0a5 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:05.037225 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b13fb326-7fed-4e90-b550-8c3653f8a0a5 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:05.057344 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-b13fb326-7fed-4e90-b550-8c3653f8a0a5 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Getting quotas for project 383674b69b924a19a5fb09d36822f928. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:18:05.074597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-b13fb326-7fed-4e90-b550-8c3653f8a0a5 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Getting quotas for user b30499a106a04407819545db3ee86c3d and project 383674b69b924a19a5fb09d36822f928. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:18:05.100129 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b13fb326-7fed-4e90-b550-8c3653f8a0a5 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:18:05.102745 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b13fb326-7fed-4e90-b550-8c3653f8a0a5 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] [instance: 80c43167-b331-4b25-9c3f-2d2e398af0a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:18:05.158764 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b13fb326-7fed-4e90-b550-8c3653f8a0a5 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.617746 Sep 10 12:18:05.159454 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3067/6141] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:18:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:18:05.171224 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-95e92d30-6fe9-4edf-8212-48ed96ac9c04 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:18:05.173648 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-95e92d30-6fe9-4edf-8212-48ed96ac9c04 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] [instance: 80c43167-b331-4b25-9c3f-2d2e398af0a1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:18:05.179258 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=28 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:18:05.180180 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:18:05.431819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-95e92d30-6fe9-4edf-8212-48ed96ac9c04 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b30499a106a04407819545db3ee86c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383674b69b924a19a5fb09d36822f928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:18:05.466753 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-95e92d30-6fe9-4edf-8212-48ed96ac9c04 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] 10.222.0.23 "GET /compute/v2.1/servers/80c43167-b331-4b25-9c3f-2d2e398af0a1" status: 200 len: 1214 microversion: 2.1 time: 0.290473 Sep 10 12:18:05.478253 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3075/6142] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:18:05 2022] GET /compute/v2.1/servers/80c43167-b331-4b25-9c3f-2d2e398af0a1 => generated 1214 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:18:06.494491 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-615e5a97-4808-411f-99bb-52b2aa21e108 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:18:06.495791 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-615e5a97-4808-411f-99bb-52b2aa21e108 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] [instance: 80c43167-b331-4b25-9c3f-2d2e398af0a1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:18:06.509014 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-615e5a97-4808-411f-99bb-52b2aa21e108 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:06.514082 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-615e5a97-4808-411f-99bb-52b2aa21e108 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:06.515011 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-615e5a97-4808-411f-99bb-52b2aa21e108 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:06.516963 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-615e5a97-4808-411f-99bb-52b2aa21e108 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:06.517756 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-615e5a97-4808-411f-99bb-52b2aa21e108 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:06.518443 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-615e5a97-4808-411f-99bb-52b2aa21e108 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:06.649007 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-615e5a97-4808-411f-99bb-52b2aa21e108 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b30499a106a04407819545db3ee86c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383674b69b924a19a5fb09d36822f928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:18:06.661450 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-615e5a97-4808-411f-99bb-52b2aa21e108 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] 10.222.0.23 "GET /compute/v2.1/servers/80c43167-b331-4b25-9c3f-2d2e398af0a1" status: 200 len: 1284 microversion: 2.1 time: 0.172421 Sep 10 12:18:06.678757 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3068/6143] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:18:06 2022] GET /compute/v2.1/servers/80c43167-b331-4b25-9c3f-2d2e398af0a1 => generated 1284 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:18:06.826204 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d33e754e-1215-4a2d-b371-ce8e2f29c301 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:18:06.829208 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d33e754e-1215-4a2d-b371-ce8e2f29c301 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:18:06.836939 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d33e754e-1215-4a2d-b371-ce8e2f29c301 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:06.837441 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d33e754e-1215-4a2d-b371-ce8e2f29c301 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:06.837883 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d33e754e-1215-4a2d-b371-ce8e2f29c301 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:06.838765 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d33e754e-1215-4a2d-b371-ce8e2f29c301 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:06.839438 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d33e754e-1215-4a2d-b371-ce8e2f29c301 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:06.839870 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d33e754e-1215-4a2d-b371-ce8e2f29c301 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:06.904471 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d33e754e-1215-4a2d-b371-ce8e2f29c301 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "POST /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317/action" status: 200 len: 24581 microversion: 2.1 time: 0.082117 Sep 10 12:18:06.906529 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3076/6144] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:18:06 2022] POST /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317/action => generated 24581 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 12:18:07.687970 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7e454294-ea7d-4ad5-87c1-b0c47f8d6b52 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:18:07.689107 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7e454294-ea7d-4ad5-87c1-b0c47f8d6b52 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] [instance: 80c43167-b331-4b25-9c3f-2d2e398af0a1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:18:07.699455 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e454294-ea7d-4ad5-87c1-b0c47f8d6b52 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:07.700422 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e454294-ea7d-4ad5-87c1-b0c47f8d6b52 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:07.700973 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e454294-ea7d-4ad5-87c1-b0c47f8d6b52 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:07.701767 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e454294-ea7d-4ad5-87c1-b0c47f8d6b52 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:07.702523 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e454294-ea7d-4ad5-87c1-b0c47f8d6b52 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:07.703090 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7e454294-ea7d-4ad5-87c1-b0c47f8d6b52 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:07.962068 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7e454294-ea7d-4ad5-87c1-b0c47f8d6b52 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b30499a106a04407819545db3ee86c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383674b69b924a19a5fb09d36822f928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:18:07.972718 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7e454294-ea7d-4ad5-87c1-b0c47f8d6b52 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] 10.222.0.23 "GET /compute/v2.1/servers/80c43167-b331-4b25-9c3f-2d2e398af0a1" status: 200 len: 1314 microversion: 2.1 time: 0.290398 Sep 10 12:18:07.974482 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3069/6145] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:18:07 2022] GET /compute/v2.1/servers/80c43167-b331-4b25-9c3f-2d2e398af0a1 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:18:08.324166 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-5d2eab9e-baae-4995-92d5-ecd5a26a2953 req-650ed21a-413e-4fdb-933a-0a4994c3fb83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80c43167-b331-4b25-9c3f-2d2e398af0a1", "tag": "ee0a6181-8f97-4d9b-8768-174bf4ebc829"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:18:08.337149 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-5d2eab9e-baae-4995-92d5-ecd5a26a2953 req-650ed21a-413e-4fdb-933a-0a4994c3fb83 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:08.338004 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-5d2eab9e-baae-4995-92d5-ecd5a26a2953 req-650ed21a-413e-4fdb-933a-0a4994c3fb83 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:08.339151 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-5d2eab9e-baae-4995-92d5-ecd5a26a2953 req-650ed21a-413e-4fdb-933a-0a4994c3fb83 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:08.366494 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-5d2eab9e-baae-4995-92d5-ecd5a26a2953 req-650ed21a-413e-4fdb-933a-0a4994c3fb83 service nova] Creating event network-changed:ee0a6181-8f97-4d9b-8768-174bf4ebc829 for instance 80c43167-b331-4b25-9c3f-2d2e398af0a1 on n-h2-856895-1 Sep 10 12:18:08.375032 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-5d2eab9e-baae-4995-92d5-ecd5a26a2953 req-650ed21a-413e-4fdb-933a-0a4994c3fb83 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055399 Sep 10 12:18:08.376056 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3077/6146] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:18:08.998081 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2647e603-6411-4937-b01d-191ae683c986 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:18:08.998728 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2647e603-6411-4937-b01d-191ae683c986 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] [instance: 80c43167-b331-4b25-9c3f-2d2e398af0a1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:18:09.006260 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2647e603-6411-4937-b01d-191ae683c986 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:09.006756 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2647e603-6411-4937-b01d-191ae683c986 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:09.007221 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2647e603-6411-4937-b01d-191ae683c986 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:09.007966 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2647e603-6411-4937-b01d-191ae683c986 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:09.008428 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2647e603-6411-4937-b01d-191ae683c986 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:09.008859 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2647e603-6411-4937-b01d-191ae683c986 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:09.173870 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2647e603-6411-4937-b01d-191ae683c986 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b30499a106a04407819545db3ee86c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383674b69b924a19a5fb09d36822f928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:18:09.181929 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2647e603-6411-4937-b01d-191ae683c986 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] 10.222.0.23 "GET /compute/v2.1/servers/80c43167-b331-4b25-9c3f-2d2e398af0a1" status: 200 len: 1314 microversion: 2.1 time: 0.187842 Sep 10 12:18:09.182914 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3070/6147] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:18:08 2022] GET /compute/v2.1/servers/80c43167-b331-4b25-9c3f-2d2e398af0a1 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:18:10.206165 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f8c86507-10ce-442d-87cb-4a32090e3d58 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:18:10.207803 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f8c86507-10ce-442d-87cb-4a32090e3d58 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] [instance: 80c43167-b331-4b25-9c3f-2d2e398af0a1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:18:10.215439 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f8c86507-10ce-442d-87cb-4a32090e3d58 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:10.216403 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f8c86507-10ce-442d-87cb-4a32090e3d58 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:10.217246 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f8c86507-10ce-442d-87cb-4a32090e3d58 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:10.218689 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f8c86507-10ce-442d-87cb-4a32090e3d58 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:10.219499 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f8c86507-10ce-442d-87cb-4a32090e3d58 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:10.220173 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f8c86507-10ce-442d-87cb-4a32090e3d58 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:10.362250 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f8c86507-10ce-442d-87cb-4a32090e3d58 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b30499a106a04407819545db3ee86c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383674b69b924a19a5fb09d36822f928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:18:10.370539 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f8c86507-10ce-442d-87cb-4a32090e3d58 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] 10.222.0.23 "GET /compute/v2.1/servers/80c43167-b331-4b25-9c3f-2d2e398af0a1" status: 200 len: 1314 microversion: 2.1 time: 0.169711 Sep 10 12:18:10.371688 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3078/6148] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:18:10 2022] GET /compute/v2.1/servers/80c43167-b331-4b25-9c3f-2d2e398af0a1 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:18:11.394370 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c1030b7e-d77e-4544-b883-0c2881049c0f tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:18:11.394896 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c1030b7e-d77e-4544-b883-0c2881049c0f tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] [instance: 80c43167-b331-4b25-9c3f-2d2e398af0a1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:18:11.401598 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1030b7e-d77e-4544-b883-0c2881049c0f tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:11.402093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1030b7e-d77e-4544-b883-0c2881049c0f tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:11.402538 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1030b7e-d77e-4544-b883-0c2881049c0f tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:11.403277 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1030b7e-d77e-4544-b883-0c2881049c0f tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:11.403743 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1030b7e-d77e-4544-b883-0c2881049c0f tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:11.404176 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1030b7e-d77e-4544-b883-0c2881049c0f tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:11.549112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c1030b7e-d77e-4544-b883-0c2881049c0f tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b30499a106a04407819545db3ee86c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383674b69b924a19a5fb09d36822f928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:18:11.557304 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c1030b7e-d77e-4544-b883-0c2881049c0f tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] 10.222.0.23 "GET /compute/v2.1/servers/80c43167-b331-4b25-9c3f-2d2e398af0a1" status: 200 len: 1314 microversion: 2.1 time: 0.167391 Sep 10 12:18:11.558103 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3071/6149] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:18:11 2022] GET /compute/v2.1/servers/80c43167-b331-4b25-9c3f-2d2e398af0a1 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:18:12.581478 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e1be0fa8-929a-4525-a6d3-777e65481c0b tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:18:12.582672 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e1be0fa8-929a-4525-a6d3-777e65481c0b tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] [instance: 80c43167-b331-4b25-9c3f-2d2e398af0a1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:18:12.589927 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e1be0fa8-929a-4525-a6d3-777e65481c0b tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:12.590420 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e1be0fa8-929a-4525-a6d3-777e65481c0b tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:12.590917 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e1be0fa8-929a-4525-a6d3-777e65481c0b tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:12.591710 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e1be0fa8-929a-4525-a6d3-777e65481c0b tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:12.592319 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e1be0fa8-929a-4525-a6d3-777e65481c0b tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:12.592868 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e1be0fa8-929a-4525-a6d3-777e65481c0b tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:12.738987 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e1be0fa8-929a-4525-a6d3-777e65481c0b tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b30499a106a04407819545db3ee86c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383674b69b924a19a5fb09d36822f928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:18:12.751762 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e1be0fa8-929a-4525-a6d3-777e65481c0b tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] 10.222.0.23 "GET /compute/v2.1/servers/80c43167-b331-4b25-9c3f-2d2e398af0a1" status: 200 len: 1314 microversion: 2.1 time: 0.174668 Sep 10 12:18:12.752403 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3079/6150] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:18:12 2022] GET /compute/v2.1/servers/80c43167-b331-4b25-9c3f-2d2e398af0a1 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:18:13.119756 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-24d2a1d3-4069-4a52-b3bb-4bc43335a28a tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:18:13.120556 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-24d2a1d3-4069-4a52-b3bb-4bc43335a28a tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:18:13.129293 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-24d2a1d3-4069-4a52-b3bb-4bc43335a28a tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:13.130028 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-24d2a1d3-4069-4a52-b3bb-4bc43335a28a tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:13.130640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-24d2a1d3-4069-4a52-b3bb-4bc43335a28a tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:13.132088 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-24d2a1d3-4069-4a52-b3bb-4bc43335a28a tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:13.132789 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-24d2a1d3-4069-4a52-b3bb-4bc43335a28a tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:13.133282 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-24d2a1d3-4069-4a52-b3bb-4bc43335a28a tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:13.304154 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-24d2a1d3-4069-4a52-b3bb-4bc43335a28a tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317" status: 200 len: 1834 microversion: 2.1 time: 0.188445 Sep 10 12:18:13.304755 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3072/6151] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:18:13 2022] GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317 => generated 1834 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:18:13.776633 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8586d633-baa0-4793-9c7b-4d4d4c73914a tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:18:13.777376 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8586d633-baa0-4793-9c7b-4d4d4c73914a tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] [instance: 80c43167-b331-4b25-9c3f-2d2e398af0a1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:18:13.788309 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8586d633-baa0-4793-9c7b-4d4d4c73914a tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:13.788929 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8586d633-baa0-4793-9c7b-4d4d4c73914a tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:13.790058 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8586d633-baa0-4793-9c7b-4d4d4c73914a tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:13.790930 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8586d633-baa0-4793-9c7b-4d4d4c73914a tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:13.791457 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8586d633-baa0-4793-9c7b-4d4d4c73914a tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:13.791902 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8586d633-baa0-4793-9c7b-4d4d4c73914a tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:14.076227 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8586d633-baa0-4793-9c7b-4d4d4c73914a tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b30499a106a04407819545db3ee86c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383674b69b924a19a5fb09d36822f928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:18:14.090167 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8586d633-baa0-4793-9c7b-4d4d4c73914a tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] 10.222.0.23 "GET /compute/v2.1/servers/80c43167-b331-4b25-9c3f-2d2e398af0a1" status: 200 len: 1314 microversion: 2.1 time: 0.318545 Sep 10 12:18:14.104161 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3080/6152] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:18:13 2022] GET /compute/v2.1/servers/80c43167-b331-4b25-9c3f-2d2e398af0a1 => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:18:14.817177 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-d35b5fb7-4102-49ae-b445-c8831df05773 req-cae046af-eeaf-438d-ae75-4be22951ffea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80c43167-b331-4b25-9c3f-2d2e398af0a1", "name": "network-vif-plugged", "status": "completed", "tag": "ee0a6181-8f97-4d9b-8768-174bf4ebc829"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:18:14.829087 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d35b5fb7-4102-49ae-b445-c8831df05773 req-cae046af-eeaf-438d-ae75-4be22951ffea service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:14.829570 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d35b5fb7-4102-49ae-b445-c8831df05773 req-cae046af-eeaf-438d-ae75-4be22951ffea service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:14.830011 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d35b5fb7-4102-49ae-b445-c8831df05773 req-cae046af-eeaf-438d-ae75-4be22951ffea service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:14.842244 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-d35b5fb7-4102-49ae-b445-c8831df05773 req-cae046af-eeaf-438d-ae75-4be22951ffea service nova] Creating event network-vif-plugged:ee0a6181-8f97-4d9b-8768-174bf4ebc829 for instance 80c43167-b331-4b25-9c3f-2d2e398af0a1 on n-h2-856895-1 Sep 10 12:18:14.851519 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-d35b5fb7-4102-49ae-b445-c8831df05773 req-cae046af-eeaf-438d-ae75-4be22951ffea service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038002 Sep 10 12:18:14.852116 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3073/6153] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:18:14.944503 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3a001059-180a-4457-a34d-6cc7b6b67276 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:18:14.945068 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3a001059-180a-4457-a34d-6cc7b6b67276 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:18:14.955677 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-32f581b4-842e-492c-9154-fecc3391a971 req-35ee1f08-140e-4a08-8117-9bcb54761e86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cf74b1d-6a20-4859-8c19-3b5a58907317", "tag": "1eabf7cc-88d5-44e8-b139-2261b2e28604"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:18:14.962560 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3a001059-180a-4457-a34d-6cc7b6b67276 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:14.962964 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3a001059-180a-4457-a34d-6cc7b6b67276 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:14.964734 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3a001059-180a-4457-a34d-6cc7b6b67276 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:14.965916 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3a001059-180a-4457-a34d-6cc7b6b67276 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:14.967330 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3a001059-180a-4457-a34d-6cc7b6b67276 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:14.967622 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3a001059-180a-4457-a34d-6cc7b6b67276 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:14.970816 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-32f581b4-842e-492c-9154-fecc3391a971 req-35ee1f08-140e-4a08-8117-9bcb54761e86 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:14.972144 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-32f581b4-842e-492c-9154-fecc3391a971 req-35ee1f08-140e-4a08-8117-9bcb54761e86 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:14.972976 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-32f581b4-842e-492c-9154-fecc3391a971 req-35ee1f08-140e-4a08-8117-9bcb54761e86 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:14.986953 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-32f581b4-842e-492c-9154-fecc3391a971 req-35ee1f08-140e-4a08-8117-9bcb54761e86 service nova] Creating event network-changed:1eabf7cc-88d5-44e8-b139-2261b2e28604 for instance 6cf74b1d-6a20-4859-8c19-3b5a58907317 on n-h2-856895-1 Sep 10 12:18:14.993538 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-32f581b4-842e-492c-9154-fecc3391a971 req-35ee1f08-140e-4a08-8117-9bcb54761e86 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044521 Sep 10 12:18:14.994738 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3074/6154] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:18:15.016317 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3a001059-180a-4457-a34d-6cc7b6b67276 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:18:15.112962 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:18:15.114664 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:18:15.120267 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3512bbf0-2d93-4efd-afeb-58f3a7783bc5 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:18:15.121918 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3512bbf0-2d93-4efd-afeb-58f3a7783bc5 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] [instance: 80c43167-b331-4b25-9c3f-2d2e398af0a1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:18:15.126287 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3a001059-180a-4457-a34d-6cc7b6b67276 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317" status: 204 len: 0 microversion: 2.1 time: 0.185938 Sep 10 12:18:15.126958 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3081/6155] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:18:14 2022] DELETE /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 12:18:15.136297 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c610be09-c6fc-4789-bece-69b70bb0e136 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:18:15.137110 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c610be09-c6fc-4789-bece-69b70bb0e136 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:18:15.138296 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3512bbf0-2d93-4efd-afeb-58f3a7783bc5 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:15.145515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3512bbf0-2d93-4efd-afeb-58f3a7783bc5 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:15.146284 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3512bbf0-2d93-4efd-afeb-58f3a7783bc5 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:15.147091 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c610be09-c6fc-4789-bece-69b70bb0e136 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:15.147571 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3512bbf0-2d93-4efd-afeb-58f3a7783bc5 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:15.147785 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c610be09-c6fc-4789-bece-69b70bb0e136 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:15.148077 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c610be09-c6fc-4789-bece-69b70bb0e136 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:15.148420 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3512bbf0-2d93-4efd-afeb-58f3a7783bc5 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:15.148866 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3512bbf0-2d93-4efd-afeb-58f3a7783bc5 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:15.149233 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c610be09-c6fc-4789-bece-69b70bb0e136 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:15.149700 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c610be09-c6fc-4789-bece-69b70bb0e136 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:15.150182 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c610be09-c6fc-4789-bece-69b70bb0e136 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:15.398796 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c610be09-c6fc-4789-bece-69b70bb0e136 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:18:15.404281 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3512bbf0-2d93-4efd-afeb-58f3a7783bc5 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b30499a106a04407819545db3ee86c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383674b69b924a19a5fb09d36822f928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:18:15.413370 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3512bbf0-2d93-4efd-afeb-58f3a7783bc5 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] 10.222.0.23 "GET /compute/v2.1/servers/80c43167-b331-4b25-9c3f-2d2e398af0a1" status: 200 len: 1314 microversion: 2.1 time: 0.301309 Sep 10 12:18:15.414918 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3075/6156] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:18:15 2022] GET /compute/v2.1/servers/80c43167-b331-4b25-9c3f-2d2e398af0a1 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:18:15.416620 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c610be09-c6fc-4789-bece-69b70bb0e136 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317" status: 200 len: 1689 microversion: 2.1 time: 0.284863 Sep 10 12:18:15.429849 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3082/6157] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:18:15 2022] GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317 => generated 1689 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:18:16.442257 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-baa4d2bd-8955-4253-94e5-29b4d5c00d1e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:18:16.445093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-41f27748-2437-4dc1-bfad-d2ac4c034799 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:18:16.446029 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-baa4d2bd-8955-4253-94e5-29b4d5c00d1e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:18:16.446616 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-41f27748-2437-4dc1-bfad-d2ac4c034799 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] [instance: 80c43167-b331-4b25-9c3f-2d2e398af0a1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:18:16.448690 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:18:16.460727 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-41f27748-2437-4dc1-bfad-d2ac4c034799 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:16.462917 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-baa4d2bd-8955-4253-94e5-29b4d5c00d1e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:16.463318 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-41f27748-2437-4dc1-bfad-d2ac4c034799 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:16.463772 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-41f27748-2437-4dc1-bfad-d2ac4c034799 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:16.464494 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-41f27748-2437-4dc1-bfad-d2ac4c034799 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:16.464962 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-41f27748-2437-4dc1-bfad-d2ac4c034799 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:16.465399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-41f27748-2437-4dc1-bfad-d2ac4c034799 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:16.470832 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-baa4d2bd-8955-4253-94e5-29b4d5c00d1e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:16.471549 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-baa4d2bd-8955-4253-94e5-29b4d5c00d1e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:16.472468 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-baa4d2bd-8955-4253-94e5-29b4d5c00d1e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:16.472946 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-baa4d2bd-8955-4253-94e5-29b4d5c00d1e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:16.473516 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-baa4d2bd-8955-4253-94e5-29b4d5c00d1e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:16.734533 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-baa4d2bd-8955-4253-94e5-29b4d5c00d1e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:18:16.744389 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-41f27748-2437-4dc1-bfad-d2ac4c034799 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b30499a106a04407819545db3ee86c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383674b69b924a19a5fb09d36822f928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:18:16.754473 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-41f27748-2437-4dc1-bfad-d2ac4c034799 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] 10.222.0.23 "GET /compute/v2.1/servers/80c43167-b331-4b25-9c3f-2d2e398af0a1" status: 200 len: 1314 microversion: 2.1 time: 0.319409 Sep 10 12:18:16.761012 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3076/6158] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:18:16 2022] GET /compute/v2.1/servers/80c43167-b331-4b25-9c3f-2d2e398af0a1 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:18:16.764496 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-baa4d2bd-8955-4253-94e5-29b4d5c00d1e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317" status: 200 len: 1689 microversion: 2.1 time: 0.326170 Sep 10 12:18:16.766349 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3083/6159] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:18:16 2022] GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317 => generated 1689 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:18:17.476923 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-c42be259-538a-4c3f-bf61-b0d3becc597e req-df597b52-5486-471e-8d30-efa50cd23914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cf74b1d-6a20-4859-8c19-3b5a58907317", "name": "network-vif-deleted", "tag": "1eabf7cc-88d5-44e8-b139-2261b2e28604"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:18:17.488088 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-c42be259-538a-4c3f-bf61-b0d3becc597e req-df597b52-5486-471e-8d30-efa50cd23914 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:17.488572 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-c42be259-538a-4c3f-bf61-b0d3becc597e req-df597b52-5486-471e-8d30-efa50cd23914 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:17.489265 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-c42be259-538a-4c3f-bf61-b0d3becc597e req-df597b52-5486-471e-8d30-efa50cd23914 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:17.501265 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-c42be259-538a-4c3f-bf61-b0d3becc597e req-df597b52-5486-471e-8d30-efa50cd23914 service nova] Creating event network-vif-deleted:1eabf7cc-88d5-44e8-b139-2261b2e28604 for instance 6cf74b1d-6a20-4859-8c19-3b5a58907317 on n-h2-856895-1 Sep 10 12:18:17.506387 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-c42be259-538a-4c3f-bf61-b0d3becc597e req-df597b52-5486-471e-8d30-efa50cd23914 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033268 Sep 10 12:18:17.507021 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3077/6160] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:18:17.784446 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8cf05769-846e-4634-bbea-c4739edd3b43 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:18:17.785765 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8cf05769-846e-4634-bbea-c4739edd3b43 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] [instance: 80c43167-b331-4b25-9c3f-2d2e398af0a1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:18:17.799670 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7c93aad7-810a-49c3-9a52-40738de7b94d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:18:17.800531 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7c93aad7-810a-49c3-9a52-40738de7b94d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 6cf74b1d-6a20-4859-8c19-3b5a58907317] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:18:17.805781 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8cf05769-846e-4634-bbea-c4739edd3b43 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:17.806926 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8cf05769-846e-4634-bbea-c4739edd3b43 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:17.807794 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8cf05769-846e-4634-bbea-c4739edd3b43 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:17.808869 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8cf05769-846e-4634-bbea-c4739edd3b43 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:17.809578 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8cf05769-846e-4634-bbea-c4739edd3b43 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:17.810315 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8cf05769-846e-4634-bbea-c4739edd3b43 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:17.815710 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c93aad7-810a-49c3-9a52-40738de7b94d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:17.816320 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c93aad7-810a-49c3-9a52-40738de7b94d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:17.818354 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c93aad7-810a-49c3-9a52-40738de7b94d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:17.819293 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c93aad7-810a-49c3-9a52-40738de7b94d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:17.819840 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c93aad7-810a-49c3-9a52-40738de7b94d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:17.823901 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c93aad7-810a-49c3-9a52-40738de7b94d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:17.856023 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-7c93aad7-810a-49c3-9a52-40738de7b94d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] HTTP exception thrown: Instance 6cf74b1d-6a20-4859-8c19-3b5a58907317 could not be found. Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7c93aad7-810a-49c3-9a52-40738de7b94d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Request method failure captured: Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317 HTTP/1.1 Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH_yhS9kjuGqOnMliECmKXRPPzhZsHLNJh-k2Dy3sZVddODjZkI9QVirO2WV-k2QGWioorUvQwYXUbLO2mq09vb7kUE53WetDg0b2epWCfO81IA_d1hE4us0m3Xe_F7464Bi0Mnf9Ik8sGoKIy1FuftdqKYzeLjY2ezWMG2puAQMwhw Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 68cfd58791b5445b9a52bc02a5eb255b Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-223880240 Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/68cfd58791b5445b9a52bc02a5eb255b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/68cfd58791b5445b9a52bc02a5eb255b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_68cfd58791b5445b9a52bc02a5eb255b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/68cfd58791b5445b9a52bc02a5eb255b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-TestNetworkAdvancedServerOps-223880240 Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 68cfd58791b5445b9a52bc02a5eb255b Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-223880240 Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-TestNetworkAdvancedServerOps-223880240-project Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: fbd98ab9ebde4e84b03aed2e694ddf04 Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-TestNetworkAdvancedServerOps-223880240-project Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 6cf74b1d-6a20-4859-8c19-3b5a58907317 could not be found. Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '6cf74b1d-6a20-4859-8c19-3b5a58907317'} Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cf74b1d-6a20-4859-8c19-3b5a58907317 could not be found. Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cf74b1d-6a20-4859-8c19-3b5a58907317 could not be found. Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:18:17.858009 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:18:17.864849 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:18:17.864849 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:18:17.864849 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:18:17.864849 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:18:17.864849 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:18:17.864849 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:18:17.864849 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cf74b1d-6a20-4859-8c19-3b5a58907317 could not be found. Sep 10 12:18:17.864849 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:18:17.864849 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7c93aad7-810a-49c3-9a52-40738de7b94d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Returning 404 to user: Instance 6cf74b1d-6a20-4859-8c19-3b5a58907317 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:18:17.864849 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7c93aad7-810a-49c3-9a52-40738de7b94d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317" status: 404 len: 111 microversion: 2.1 time: 0.066402 Sep 10 12:18:17.875177 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3078/6161] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:18:17 2022] GET /compute/v2.1/servers/6cf74b1d-6a20-4859-8c19-3b5a58907317 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 12:18:18.015327 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8cf05769-846e-4634-bbea-c4739edd3b43 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b30499a106a04407819545db3ee86c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383674b69b924a19a5fb09d36822f928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:18:18.025735 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8cf05769-846e-4634-bbea-c4739edd3b43 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] 10.222.0.23 "GET /compute/v2.1/servers/80c43167-b331-4b25-9c3f-2d2e398af0a1" status: 200 len: 1463 microversion: 2.1 time: 0.247864 Sep 10 12:18:18.036254 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3084/6162] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:18:17 2022] GET /compute/v2.1/servers/80c43167-b331-4b25-9c3f-2d2e398af0a1 => generated 1463 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:18:18.085608 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fec8e9df-ae8b-4930-a68d-5c762c49488e tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:18:18.086120 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fec8e9df-ae8b-4930-a68d-5c762c49488e tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] [instance: 80c43167-b331-4b25-9c3f-2d2e398af0a1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:18:18.097248 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fec8e9df-ae8b-4930-a68d-5c762c49488e tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:18.097935 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fec8e9df-ae8b-4930-a68d-5c762c49488e tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:18.098555 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fec8e9df-ae8b-4930-a68d-5c762c49488e tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:18.099294 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fec8e9df-ae8b-4930-a68d-5c762c49488e tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:18.099918 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fec8e9df-ae8b-4930-a68d-5c762c49488e tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:18.100514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fec8e9df-ae8b-4930-a68d-5c762c49488e tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:18.136200 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fec8e9df-ae8b-4930-a68d-5c762c49488e tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] [instance: 80c43167-b331-4b25-9c3f-2d2e398af0a1] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:18:18.254976 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fec8e9df-ae8b-4930-a68d-5c762c49488e tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] 10.222.0.23 "DELETE /compute/v2.1/servers/80c43167-b331-4b25-9c3f-2d2e398af0a1" status: 204 len: 0 microversion: 2.1 time: 0.171808 Sep 10 12:18:18.256409 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3079/6163] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:18:18 2022] DELETE /compute/v2.1/servers/80c43167-b331-4b25-9c3f-2d2e398af0a1 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:18:18.265286 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3fa52b8c-e697-4ae3-850b-dd2ddabde994 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:18:18.266771 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3fa52b8c-e697-4ae3-850b-dd2ddabde994 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] [instance: 80c43167-b331-4b25-9c3f-2d2e398af0a1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:18:18.274200 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3fa52b8c-e697-4ae3-850b-dd2ddabde994 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:18.274936 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3fa52b8c-e697-4ae3-850b-dd2ddabde994 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:18.275693 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3fa52b8c-e697-4ae3-850b-dd2ddabde994 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:18.276480 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3fa52b8c-e697-4ae3-850b-dd2ddabde994 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:18.277059 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3fa52b8c-e697-4ae3-850b-dd2ddabde994 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:18.277560 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3fa52b8c-e697-4ae3-850b-dd2ddabde994 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:18.425768 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3fa52b8c-e697-4ae3-850b-dd2ddabde994 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b30499a106a04407819545db3ee86c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383674b69b924a19a5fb09d36822f928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:18:18.438189 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3fa52b8c-e697-4ae3-850b-dd2ddabde994 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] 10.222.0.23 "GET /compute/v2.1/servers/80c43167-b331-4b25-9c3f-2d2e398af0a1" status: 200 len: 1469 microversion: 2.1 time: 0.177305 Sep 10 12:18:18.438876 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3085/6164] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:18:18 2022] GET /compute/v2.1/servers/80c43167-b331-4b25-9c3f-2d2e398af0a1 => generated 1469 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:18:19.462245 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4f32d399-4943-49c8-8169-b84ecf90c443 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:18:19.462963 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4f32d399-4943-49c8-8169-b84ecf90c443 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] [instance: 80c43167-b331-4b25-9c3f-2d2e398af0a1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:18:19.486130 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4f32d399-4943-49c8-8169-b84ecf90c443 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:19.489491 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4f32d399-4943-49c8-8169-b84ecf90c443 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:19.489950 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4f32d399-4943-49c8-8169-b84ecf90c443 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:19.499327 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4f32d399-4943-49c8-8169-b84ecf90c443 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:19.499855 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4f32d399-4943-49c8-8169-b84ecf90c443 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:19.500324 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4f32d399-4943-49c8-8169-b84ecf90c443 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:19.820244 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4f32d399-4943-49c8-8169-b84ecf90c443 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b30499a106a04407819545db3ee86c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383674b69b924a19a5fb09d36822f928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:18:19.837807 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4f32d399-4943-49c8-8169-b84ecf90c443 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] 10.222.0.23 "GET /compute/v2.1/servers/80c43167-b331-4b25-9c3f-2d2e398af0a1" status: 200 len: 1469 microversion: 2.1 time: 0.379767 Sep 10 12:18:19.839341 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3080/6165] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:18:19 2022] GET /compute/v2.1/servers/80c43167-b331-4b25-9c3f-2d2e398af0a1 => generated 1469 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:18:20.268320 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-298f5e43-c581-4214-8415-c09ccaffd011 req-df59bedf-fdb2-442f-a41f-6f8ffb288260 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80c43167-b331-4b25-9c3f-2d2e398af0a1", "name": "network-vif-deleted", "tag": "ee0a6181-8f97-4d9b-8768-174bf4ebc829"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:18:20.279705 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-298f5e43-c581-4214-8415-c09ccaffd011 req-df59bedf-fdb2-442f-a41f-6f8ffb288260 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:20.280262 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-298f5e43-c581-4214-8415-c09ccaffd011 req-df59bedf-fdb2-442f-a41f-6f8ffb288260 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:20.281682 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-298f5e43-c581-4214-8415-c09ccaffd011 req-df59bedf-fdb2-442f-a41f-6f8ffb288260 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:20.295737 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-298f5e43-c581-4214-8415-c09ccaffd011 req-df59bedf-fdb2-442f-a41f-6f8ffb288260 service nova] Creating event network-vif-deleted:ee0a6181-8f97-4d9b-8768-174bf4ebc829 for instance 80c43167-b331-4b25-9c3f-2d2e398af0a1 on n-h2-856895-1 Sep 10 12:18:20.304164 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-298f5e43-c581-4214-8415-c09ccaffd011 req-df59bedf-fdb2-442f-a41f-6f8ffb288260 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039487 Sep 10 12:18:20.305248 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3086/6166] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:18:20.866063 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8292d14c-85e6-4445-aa18-37614490e6ee tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:18:20.867880 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8292d14c-85e6-4445-aa18-37614490e6ee tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] [instance: 80c43167-b331-4b25-9c3f-2d2e398af0a1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:18:20.883557 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8292d14c-85e6-4445-aa18-37614490e6ee tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:20.888223 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8292d14c-85e6-4445-aa18-37614490e6ee tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:20.889787 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8292d14c-85e6-4445-aa18-37614490e6ee tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:20.892389 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8292d14c-85e6-4445-aa18-37614490e6ee tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:20.893120 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8292d14c-85e6-4445-aa18-37614490e6ee tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:20.897028 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8292d14c-85e6-4445-aa18-37614490e6ee tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:20.979350 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8292d14c-85e6-4445-aa18-37614490e6ee tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:20.980188 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8292d14c-85e6-4445-aa18-37614490e6ee tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:20.982708 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8292d14c-85e6-4445-aa18-37614490e6ee tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:20.983410 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-8292d14c-85e6-4445-aa18-37614490e6ee tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lazy-loading 'fault' on Instance uuid 80c43167-b331-4b25-9c3f-2d2e398af0a1 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:18:21.448514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8292d14c-85e6-4445-aa18-37614490e6ee tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b30499a106a04407819545db3ee86c3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383674b69b924a19a5fb09d36822f928', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:18:21.457930 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8292d14c-85e6-4445-aa18-37614490e6ee tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] 10.222.0.23 "GET /compute/v2.1/servers/80c43167-b331-4b25-9c3f-2d2e398af0a1" status: 200 len: 1304 microversion: 2.1 time: 0.599078 Sep 10 12:18:21.463750 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3081/6167] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:18:20 2022] GET /compute/v2.1/servers/80c43167-b331-4b25-9c3f-2d2e398af0a1 => generated 1304 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:18:22.486781 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c80a17dc-6c7d-4024-adb6-2e214b820f97 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:18:22.487543 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c80a17dc-6c7d-4024-adb6-2e214b820f97 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] [instance: 80c43167-b331-4b25-9c3f-2d2e398af0a1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:18:22.506815 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c80a17dc-6c7d-4024-adb6-2e214b820f97 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:22.507595 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c80a17dc-6c7d-4024-adb6-2e214b820f97 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:22.508231 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c80a17dc-6c7d-4024-adb6-2e214b820f97 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:22.510348 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c80a17dc-6c7d-4024-adb6-2e214b820f97 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:22.511055 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c80a17dc-6c7d-4024-adb6-2e214b820f97 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:22.511832 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c80a17dc-6c7d-4024-adb6-2e214b820f97 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:22.549614 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-c80a17dc-6c7d-4024-adb6-2e214b820f97 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] HTTP exception thrown: Instance 80c43167-b331-4b25-9c3f-2d2e398af0a1 could not be found. Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c80a17dc-6c7d-4024-adb6-2e214b820f97 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Request method failure captured: Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/80c43167-b331-4b25-9c3f-2d2e398af0a1 HTTP/1.1 Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHIB6xnjoe_ioG78i6oPEuS7-C-oAF0sa8oWsx1BVcvYQCiITTB83Dw23yugLToLCZn69Z8-SDTcywdvF-WodR1tE5HOIyuYYKciYanuXF7WrbZSIiRF4NRLWGgDaygJEuet8xCEMERcDN06E67UVkXJe42K9eg-XSbg1QREdFJ4e7XU Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 383674b69b924a19a5fb09d36822f928 Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-VolumesNegativeTest-1271927639 Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/383674b69b924a19a5fb09d36822f928"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/383674b69b924a19a5fb09d36822f928"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_383674b69b924a19a5fb09d36822f928", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/383674b69b924a19a5fb09d36822f928"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-VolumesNegativeTest-1271927639 Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 383674b69b924a19a5fb09d36822f928 Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-VolumesNegativeTest-1271927639 Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-VolumesNegativeTest-1271927639-project Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: b30499a106a04407819545db3ee86c3d Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-VolumesNegativeTest-1271927639-project Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 80c43167-b331-4b25-9c3f-2d2e398af0a1 could not be found. Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '80c43167-b331-4b25-9c3f-2d2e398af0a1'} Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80c43167-b331-4b25-9c3f-2d2e398af0a1 could not be found. Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80c43167-b331-4b25-9c3f-2d2e398af0a1 could not be found. Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:18:22.554633 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:18:22.558838 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:18:22.558838 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:18:22.558838 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:18:22.558838 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:18:22.558838 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:18:22.558838 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80c43167-b331-4b25-9c3f-2d2e398af0a1 could not be found. Sep 10 12:18:22.558838 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:18:22.561091 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c80a17dc-6c7d-4024-adb6-2e214b820f97 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] Returning 404 to user: Instance 80c43167-b331-4b25-9c3f-2d2e398af0a1 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:18:22.563118 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c80a17dc-6c7d-4024-adb6-2e214b820f97 tempest-VolumesNegativeTest-1271927639 tempest-VolumesNegativeTest-1271927639-project] 10.222.0.23 "GET /compute/v2.1/servers/80c43167-b331-4b25-9c3f-2d2e398af0a1" status: 404 len: 111 microversion: 2.1 time: 0.082478 Sep 10 12:18:22.578877 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3087/6168] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:18:22 2022] GET /compute/v2.1/servers/80c43167-b331-4b25-9c3f-2d2e398af0a1 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:18:22.677038 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4001f43e-5569-43ed-85fc-594d1b8b54b4 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '.version_select at 0x7f4071b919d0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:18:22.724878 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4001f43e-5569-43ed-85fc-594d1b8b54b4 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1495890959" status: 202 len: 0 microversion: 2.1 time: 0.052325 Sep 10 12:18:22.726913 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3082/6169] 10.222.0.23 () {58 vars in 1284 bytes} [Sat Sep 10 12:18:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1495890959 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:18:22.777909 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f0cf5609-8923-4db9-afce-bb794e522b46 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Action: 'create', calling method: .version_select at 0x7f40734de1f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1251518159", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnSdCPPGaO8ssRmrXmCI2vXTXz03VwPlWtN/DegX2tp6hgY/f1SSwIIdLeUtilcH6ntwkK3U/Irfy/8ptRz73fzh+tWvBgmVNnAQCie3NzQECyuUaMZSO7t7aR9FHIoNA=="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:18:22.818182 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-f0cf5609-8923-4db9-afce-bb794e522b46 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Getting quotas for project 68cfd58791b5445b9a52bc02a5eb255b. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:18:22.826003 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-f0cf5609-8923-4db9-afce-bb794e522b46 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Getting quotas for user fbd98ab9ebde4e84b03aed2e694ddf04 and project 68cfd58791b5445b9a52bc02a5eb255b. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:18:22.848875 n-d-856895-1 devstack@n-api.service[128776]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f0cf5609-8923-4db9-afce-bb794e522b46 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [191798a7-2c5e-4d74-b865-4708090abecb] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 10 12:18:23.862158 n-d-856895-1 devstack@n-api.service[128776]: INFO oslo.messaging._drivers.impl_rabbit [None req-f0cf5609-8923-4db9-afce-bb794e522b46 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [191798a7-2c5e-4d74-b865-4708090abecb] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 55148. Sep 10 12:18:23.881919 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f0cf5609-8923-4db9-afce-bb794e522b46 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.108401 Sep 10 12:18:23.882485 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3088/6170] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 12:18:22 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:18:33.833147 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:18:33.834676 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:18:33.841133 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-650c0c20-0866-46e3-8a8d-1cffd2945177 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-979621250", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "687c04a6-20e5-4c6e-82da-01c93f364432"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1251518159", "security_groups": [{"name": "tempest-secgroup-smoke-1078955547"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:18:34.023268 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-650c0c20-0866-46e3-8a8d-1cffd2945177 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] validate_networks() for [('687c04a6-20e5-4c6e-82da-01c93f364432', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:18:35.153327 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-650c0c20-0866-46e3-8a8d-1cffd2945177 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:18:35.153914 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-650c0c20-0866-46e3-8a8d-1cffd2945177 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:18:35.154789 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-650c0c20-0866-46e3-8a8d-1cffd2945177 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:18:35.156388 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-650c0c20-0866-46e3-8a8d-1cffd2945177 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:18:35.157012 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-650c0c20-0866-46e3-8a8d-1cffd2945177 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:18:35.167777 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-650c0c20-0866-46e3-8a8d-1cffd2945177 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:35.168365 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-650c0c20-0866-46e3-8a8d-1cffd2945177 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:35.169045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-650c0c20-0866-46e3-8a8d-1cffd2945177 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:35.169871 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-650c0c20-0866-46e3-8a8d-1cffd2945177 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:35.170488 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-650c0c20-0866-46e3-8a8d-1cffd2945177 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:35.171823 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-650c0c20-0866-46e3-8a8d-1cffd2945177 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:35.191374 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-650c0c20-0866-46e3-8a8d-1cffd2945177 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Getting quotas for project 68cfd58791b5445b9a52bc02a5eb255b. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:18:35.198035 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-650c0c20-0866-46e3-8a8d-1cffd2945177 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Getting quotas for user fbd98ab9ebde4e84b03aed2e694ddf04 and project 68cfd58791b5445b9a52bc02a5eb255b. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:18:35.212933 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-650c0c20-0866-46e3-8a8d-1cffd2945177 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:18:35.216174 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-650c0c20-0866-46e3-8a8d-1cffd2945177 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:18:35.286871 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-650c0c20-0866-46e3-8a8d-1cffd2945177 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.457316 Sep 10 12:18:35.294856 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3083/6171] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:18:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 1466 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:18:35.300748 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4cb04ef9-5127-4fda-9ca5-98a8e76d6938 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:18:35.302683 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4cb04ef9-5127-4fda-9ca5-98a8e76d6938 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:18:35.314987 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:18:35.318051 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=4 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:18:35.318709 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:18:35.446394 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4cb04ef9-5127-4fda-9ca5-98a8e76d6938 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:18:35.458515 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4cb04ef9-5127-4fda-9ca5-98a8e76d6938 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1266 microversion: 2.1 time: 0.161770 Sep 10 12:18:35.459329 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3089/6172] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:18:35 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:18:36.487723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-23ebd035-64ef-41d4-b8d8-0dd675d4408c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:18:36.488353 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-23ebd035-64ef-41d4-b8d8-0dd675d4408c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:18:36.513993 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-23ebd035-64ef-41d4-b8d8-0dd675d4408c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:36.514563 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-23ebd035-64ef-41d4-b8d8-0dd675d4408c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:36.515010 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-23ebd035-64ef-41d4-b8d8-0dd675d4408c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:36.515754 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-23ebd035-64ef-41d4-b8d8-0dd675d4408c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:36.516221 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-23ebd035-64ef-41d4-b8d8-0dd675d4408c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:36.516653 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-23ebd035-64ef-41d4-b8d8-0dd675d4408c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:36.595035 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-23ebd035-64ef-41d4-b8d8-0dd675d4408c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:18:36.610106 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-23ebd035-64ef-41d4-b8d8-0dd675d4408c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1318 microversion: 2.1 time: 0.124088 Sep 10 12:18:36.611174 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3084/6173] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:18:36 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1318 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:18:37.633719 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-51081212-2b50-4289-8a17-2cba092536f5 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:18:37.634342 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-51081212-2b50-4289-8a17-2cba092536f5 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:18:37.646597 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-51081212-2b50-4289-8a17-2cba092536f5 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:37.648842 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-51081212-2b50-4289-8a17-2cba092536f5 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:37.649635 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-51081212-2b50-4289-8a17-2cba092536f5 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:37.651628 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-51081212-2b50-4289-8a17-2cba092536f5 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:37.652365 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-51081212-2b50-4289-8a17-2cba092536f5 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:37.652804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-51081212-2b50-4289-8a17-2cba092536f5 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:37.851360 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-51081212-2b50-4289-8a17-2cba092536f5 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:18:37.861839 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-51081212-2b50-4289-8a17-2cba092536f5 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1392 microversion: 2.1 time: 0.231910 Sep 10 12:18:37.862801 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3090/6174] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:18:37 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1392 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:18:38.784355 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-a809c545-97bf-474d-9890-afc71f2bac19 req-b66f45b7-6b53-4544-bc03-c6c89424a6ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "192b2f43-548e-45bc-bc01-10bffeb7ab3c", "tag": "bd279f8b-43ea-40d1-8c74-7a20609e24db"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:18:38.825472 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a809c545-97bf-474d-9890-afc71f2bac19 req-b66f45b7-6b53-4544-bc03-c6c89424a6ea service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:38.838986 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a809c545-97bf-474d-9890-afc71f2bac19 req-b66f45b7-6b53-4544-bc03-c6c89424a6ea service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:38.839726 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a809c545-97bf-474d-9890-afc71f2bac19 req-b66f45b7-6b53-4544-bc03-c6c89424a6ea service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:38.861466 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-a809c545-97bf-474d-9890-afc71f2bac19 req-b66f45b7-6b53-4544-bc03-c6c89424a6ea service nova] Creating event network-changed:bd279f8b-43ea-40d1-8c74-7a20609e24db for instance 192b2f43-548e-45bc-bc01-10bffeb7ab3c on n-h1-856895-1 Sep 10 12:18:38.867796 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-a809c545-97bf-474d-9890-afc71f2bac19 req-b66f45b7-6b53-4544-bc03-c6c89424a6ea service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093112 Sep 10 12:18:38.868900 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3085/6175] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:18:38.887745 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-97621608-344d-47f2-ae69-09809563d83b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:18:38.888447 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-97621608-344d-47f2-ae69-09809563d83b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:18:38.897440 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-97621608-344d-47f2-ae69-09809563d83b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:38.898222 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-97621608-344d-47f2-ae69-09809563d83b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:38.898842 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-97621608-344d-47f2-ae69-09809563d83b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:38.900454 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-97621608-344d-47f2-ae69-09809563d83b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:38.901272 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-97621608-344d-47f2-ae69-09809563d83b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:38.901913 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-97621608-344d-47f2-ae69-09809563d83b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:39.070903 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-97621608-344d-47f2-ae69-09809563d83b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:18:39.082312 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-97621608-344d-47f2-ae69-09809563d83b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1392 microversion: 2.1 time: 0.197791 Sep 10 12:18:39.083688 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3091/6176] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:18:38 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1392 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:18:40.108361 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ab9ecf1b-4009-4ca3-b814-0a144a3adfeb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:18:40.109197 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ab9ecf1b-4009-4ca3-b814-0a144a3adfeb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:18:40.124779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ab9ecf1b-4009-4ca3-b814-0a144a3adfeb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:40.125417 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ab9ecf1b-4009-4ca3-b814-0a144a3adfeb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:40.125900 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ab9ecf1b-4009-4ca3-b814-0a144a3adfeb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:40.126644 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ab9ecf1b-4009-4ca3-b814-0a144a3adfeb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:40.127320 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ab9ecf1b-4009-4ca3-b814-0a144a3adfeb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:40.127757 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ab9ecf1b-4009-4ca3-b814-0a144a3adfeb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:40.276681 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ab9ecf1b-4009-4ca3-b814-0a144a3adfeb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:18:40.285662 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ab9ecf1b-4009-4ca3-b814-0a144a3adfeb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1392 microversion: 2.1 time: 0.183516 Sep 10 12:18:40.286370 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3086/6177] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:18:40 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1392 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:18:41.309941 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6b87b47f-cac0-430a-9e7f-2500ac09bfb3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:18:41.310484 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6b87b47f-cac0-430a-9e7f-2500ac09bfb3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:18:41.317906 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6b87b47f-cac0-430a-9e7f-2500ac09bfb3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:41.318402 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6b87b47f-cac0-430a-9e7f-2500ac09bfb3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:41.318846 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6b87b47f-cac0-430a-9e7f-2500ac09bfb3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:41.319591 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6b87b47f-cac0-430a-9e7f-2500ac09bfb3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:41.320051 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6b87b47f-cac0-430a-9e7f-2500ac09bfb3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:41.320483 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6b87b47f-cac0-430a-9e7f-2500ac09bfb3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:41.568807 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6b87b47f-cac0-430a-9e7f-2500ac09bfb3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:18:41.578655 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6b87b47f-cac0-430a-9e7f-2500ac09bfb3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1392 microversion: 2.1 time: 0.272689 Sep 10 12:18:41.579519 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3092/6178] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:18:41 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1392 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:18:42.605949 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c1ef6dc2-d4dc-4845-af36-5a016d6ce69b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:18:42.607055 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c1ef6dc2-d4dc-4845-af36-5a016d6ce69b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:18:42.614152 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1ef6dc2-d4dc-4845-af36-5a016d6ce69b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:42.614647 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1ef6dc2-d4dc-4845-af36-5a016d6ce69b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:42.615091 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1ef6dc2-d4dc-4845-af36-5a016d6ce69b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:42.615867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1ef6dc2-d4dc-4845-af36-5a016d6ce69b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:42.616331 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1ef6dc2-d4dc-4845-af36-5a016d6ce69b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:42.616985 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1ef6dc2-d4dc-4845-af36-5a016d6ce69b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:42.772799 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c1ef6dc2-d4dc-4845-af36-5a016d6ce69b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:18:42.781161 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c1ef6dc2-d4dc-4845-af36-5a016d6ce69b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1392 microversion: 2.1 time: 0.179106 Sep 10 12:18:42.781999 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3087/6179] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:18:42 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1392 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:18:43.806783 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8390e3f2-b250-4646-b7fe-29f8aa12d885 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:18:43.808377 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8390e3f2-b250-4646-b7fe-29f8aa12d885 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:18:43.817977 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8390e3f2-b250-4646-b7fe-29f8aa12d885 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:43.818802 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8390e3f2-b250-4646-b7fe-29f8aa12d885 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:43.819851 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8390e3f2-b250-4646-b7fe-29f8aa12d885 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:43.820819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8390e3f2-b250-4646-b7fe-29f8aa12d885 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:43.821522 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8390e3f2-b250-4646-b7fe-29f8aa12d885 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:43.822192 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8390e3f2-b250-4646-b7fe-29f8aa12d885 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:43.930463 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-e32dfde1-3df7-4c48-9c13-399bae8ec5f2 req-2ab13615-6a5f-4f09-b0d3-788efa8229f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "192b2f43-548e-45bc-bc01-10bffeb7ab3c", "name": "network-vif-plugged", "status": "completed", "tag": "bd279f8b-43ea-40d1-8c74-7a20609e24db"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:18:43.943908 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e32dfde1-3df7-4c48-9c13-399bae8ec5f2 req-2ab13615-6a5f-4f09-b0d3-788efa8229f3 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:43.944684 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e32dfde1-3df7-4c48-9c13-399bae8ec5f2 req-2ab13615-6a5f-4f09-b0d3-788efa8229f3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:43.945373 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e32dfde1-3df7-4c48-9c13-399bae8ec5f2 req-2ab13615-6a5f-4f09-b0d3-788efa8229f3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:43.960819 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-e32dfde1-3df7-4c48-9c13-399bae8ec5f2 req-2ab13615-6a5f-4f09-b0d3-788efa8229f3 service nova] Creating event network-vif-plugged:bd279f8b-43ea-40d1-8c74-7a20609e24db for instance 192b2f43-548e-45bc-bc01-10bffeb7ab3c on n-h1-856895-1 Sep 10 12:18:43.967212 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-e32dfde1-3df7-4c48-9c13-399bae8ec5f2 req-2ab13615-6a5f-4f09-b0d3-788efa8229f3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042049 Sep 10 12:18:43.968431 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3088/6180] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:18:43.987072 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8390e3f2-b250-4646-b7fe-29f8aa12d885 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:18:43.999494 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8390e3f2-b250-4646-b7fe-29f8aa12d885 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1392 microversion: 2.1 time: 0.196924 Sep 10 12:18:44.011906 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3093/6181] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:18:43 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1392 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:18:45.025822 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-40a4d30f-9ab5-4c6a-a690-34126838f319 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:18:45.027149 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-40a4d30f-9ab5-4c6a-a690-34126838f319 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:18:45.037801 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40a4d30f-9ab5-4c6a-a690-34126838f319 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:45.039695 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40a4d30f-9ab5-4c6a-a690-34126838f319 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:45.040407 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40a4d30f-9ab5-4c6a-a690-34126838f319 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:45.043279 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40a4d30f-9ab5-4c6a-a690-34126838f319 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:45.043863 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40a4d30f-9ab5-4c6a-a690-34126838f319 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:45.045778 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40a4d30f-9ab5-4c6a-a690-34126838f319 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:45.182482 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:18:45.208048 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:18:45.228096 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-40a4d30f-9ab5-4c6a-a690-34126838f319 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:18:45.241797 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-40a4d30f-9ab5-4c6a-a690-34126838f319 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1392 microversion: 2.1 time: 0.221106 Sep 10 12:18:45.243571 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3089/6182] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:18:45 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1392 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:18:46.269999 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e437988e-02dd-409c-915b-683f58bdbdb7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:18:46.271274 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e437988e-02dd-409c-915b-683f58bdbdb7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:18:46.277872 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:18:46.281705 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e437988e-02dd-409c-915b-683f58bdbdb7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:46.282452 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e437988e-02dd-409c-915b-683f58bdbdb7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:46.283085 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e437988e-02dd-409c-915b-683f58bdbdb7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:46.284058 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e437988e-02dd-409c-915b-683f58bdbdb7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:46.284760 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e437988e-02dd-409c-915b-683f58bdbdb7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:46.285418 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e437988e-02dd-409c-915b-683f58bdbdb7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:46.486583 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e437988e-02dd-409c-915b-683f58bdbdb7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:18:46.497717 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e437988e-02dd-409c-915b-683f58bdbdb7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1563 microversion: 2.1 time: 0.233996 Sep 10 12:18:46.511522 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3094/6183] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:18:46 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1563 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:18:46.524201 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-813a9e47-085c-4c75-8334-096bc87457e7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:18:46.525067 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-813a9e47-085c-4c75-8334-096bc87457e7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:18:46.534035 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-813a9e47-085c-4c75-8334-096bc87457e7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:46.534869 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-813a9e47-085c-4c75-8334-096bc87457e7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:46.535803 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-813a9e47-085c-4c75-8334-096bc87457e7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:46.536615 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-813a9e47-085c-4c75-8334-096bc87457e7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:46.537922 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-813a9e47-085c-4c75-8334-096bc87457e7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:46.538686 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-813a9e47-085c-4c75-8334-096bc87457e7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:46.697756 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-813a9e47-085c-4c75-8334-096bc87457e7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:18:46.710921 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-813a9e47-085c-4c75-8334-096bc87457e7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1563 microversion: 2.1 time: 0.192079 Sep 10 12:18:46.712392 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3090/6184] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:18:46 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1563 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:18:48.527227 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-28df32e7-b460-4e4a-be96-d90ffb55a361 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:18:48.527970 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-28df32e7-b460-4e4a-be96-d90ffb55a361 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:18:48.534085 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-e5ac0459-7b74-401b-96a0-de64d046dd1b req-0c744b34-b72c-47bd-9e1d-53241b3956a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "192b2f43-548e-45bc-bc01-10bffeb7ab3c", "tag": "bd279f8b-43ea-40d1-8c74-7a20609e24db"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:18:48.540467 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28df32e7-b460-4e4a-be96-d90ffb55a361 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:48.541288 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28df32e7-b460-4e4a-be96-d90ffb55a361 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:48.542025 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28df32e7-b460-4e4a-be96-d90ffb55a361 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:48.547116 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28df32e7-b460-4e4a-be96-d90ffb55a361 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:48.547651 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28df32e7-b460-4e4a-be96-d90ffb55a361 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:48.547884 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e5ac0459-7b74-401b-96a0-de64d046dd1b req-0c744b34-b72c-47bd-9e1d-53241b3956a4 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:18:48.548100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28df32e7-b460-4e4a-be96-d90ffb55a361 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:48.548877 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e5ac0459-7b74-401b-96a0-de64d046dd1b req-0c744b34-b72c-47bd-9e1d-53241b3956a4 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:18:48.549490 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e5ac0459-7b74-401b-96a0-de64d046dd1b req-0c744b34-b72c-47bd-9e1d-53241b3956a4 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:18:48.579963 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-e5ac0459-7b74-401b-96a0-de64d046dd1b req-0c744b34-b72c-47bd-9e1d-53241b3956a4 service nova] Creating event network-changed:bd279f8b-43ea-40d1-8c74-7a20609e24db for instance 192b2f43-548e-45bc-bc01-10bffeb7ab3c on n-h1-856895-1 Sep 10 12:18:48.597960 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-e5ac0459-7b74-401b-96a0-de64d046dd1b req-0c744b34-b72c-47bd-9e1d-53241b3956a4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068974 Sep 10 12:18:48.600546 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3091/6185] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:18:48.805426 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-28df32e7-b460-4e4a-be96-d90ffb55a361 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:18:48.816372 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-28df32e7-b460-4e4a-be96-d90ffb55a361 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1563 microversion: 2.1 time: 0.291628 Sep 10 12:18:48.817175 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3095/6186] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:18:48 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1563 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:19:07.959579 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:19:07.960328 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=38 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:19:08.220990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bf42837b-5b1b-4a58-8b7c-712602d5a61c tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1706104692", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "90989626-eadc-4752-ae3e-c1c793147358"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:19:08.280570 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-bf42837b-5b1b-4a58-8b7c-712602d5a61c tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] validate_networks() for [('90989626-eadc-4752-ae3e-c1c793147358', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:19:08.645431 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-bf42837b-5b1b-4a58-8b7c-712602d5a61c tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:19:08.646094 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-bf42837b-5b1b-4a58-8b7c-712602d5a61c tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:19:08.646744 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-bf42837b-5b1b-4a58-8b7c-712602d5a61c tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:19:08.647230 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-bf42837b-5b1b-4a58-8b7c-712602d5a61c tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:19:08.647647 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-bf42837b-5b1b-4a58-8b7c-712602d5a61c tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:19:08.662429 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bf42837b-5b1b-4a58-8b7c-712602d5a61c tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:08.662919 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bf42837b-5b1b-4a58-8b7c-712602d5a61c tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:08.663407 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bf42837b-5b1b-4a58-8b7c-712602d5a61c tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:08.664146 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bf42837b-5b1b-4a58-8b7c-712602d5a61c tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:08.664605 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bf42837b-5b1b-4a58-8b7c-712602d5a61c tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:08.665036 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bf42837b-5b1b-4a58-8b7c-712602d5a61c tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:08.682986 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-bf42837b-5b1b-4a58-8b7c-712602d5a61c tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Getting quotas for project edadca3d287c465bac185ae7b00c9536. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:19:08.688307 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-bf42837b-5b1b-4a58-8b7c-712602d5a61c tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Getting quotas for user c1ca5ce7175c4ffab7f61765c9ef1e37 and project edadca3d287c465bac185ae7b00c9536. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:19:08.700870 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bf42837b-5b1b-4a58-8b7c-712602d5a61c tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:19:08.703327 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bf42837b-5b1b-4a58-8b7c-712602d5a61c tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] [instance: fd69dc49-0dfc-46fe-aa89-77156a60edd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:19:08.751014 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bf42837b-5b1b-4a58-8b7c-712602d5a61c tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.793487 Sep 10 12:19:08.751870 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3092/6187] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:19:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:19:08.764810 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4fe53644-3e79-4433-90f7-052b70a36a22 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:08.765762 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4fe53644-3e79-4433-90f7-052b70a36a22 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] [instance: fd69dc49-0dfc-46fe-aa89-77156a60edd6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:08.768815 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=16 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:19:08.769780 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=36 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:19:08.834119 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4fe53644-3e79-4433-90f7-052b70a36a22 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ca5ce7175c4ffab7f61765c9ef1e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edadca3d287c465bac185ae7b00c9536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:19:08.845898 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4fe53644-3e79-4433-90f7-052b70a36a22 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] 10.222.0.23 "GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6" status: 200 len: 1215 microversion: 2.1 time: 0.086859 Sep 10 12:19:08.846657 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3096/6188] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:08 2022] GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6 => generated 1215 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:19:09.870730 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-55404002-0113-440c-bb98-a8b89e6e2387 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:09.871417 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-55404002-0113-440c-bb98-a8b89e6e2387 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] [instance: fd69dc49-0dfc-46fe-aa89-77156a60edd6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:09.881679 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-55404002-0113-440c-bb98-a8b89e6e2387 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:09.882491 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-55404002-0113-440c-bb98-a8b89e6e2387 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:09.883206 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-55404002-0113-440c-bb98-a8b89e6e2387 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:09.884111 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-55404002-0113-440c-bb98-a8b89e6e2387 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:09.884879 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-55404002-0113-440c-bb98-a8b89e6e2387 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:09.885517 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-55404002-0113-440c-bb98-a8b89e6e2387 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:09.971684 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-55404002-0113-440c-bb98-a8b89e6e2387 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ca5ce7175c4ffab7f61765c9ef1e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edadca3d287c465bac185ae7b00c9536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:19:09.982675 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-55404002-0113-440c-bb98-a8b89e6e2387 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] 10.222.0.23 "GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6" status: 200 len: 1275 microversion: 2.1 time: 0.116581 Sep 10 12:19:09.983529 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3093/6189] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:09 2022] GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6 => generated 1275 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:19:11.005908 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-950ed17d-9a09-4648-8b26-03447d1db2c5 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:11.006535 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-950ed17d-9a09-4648-8b26-03447d1db2c5 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] [instance: fd69dc49-0dfc-46fe-aa89-77156a60edd6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:11.015323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-950ed17d-9a09-4648-8b26-03447d1db2c5 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:11.015818 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-950ed17d-9a09-4648-8b26-03447d1db2c5 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:11.016495 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-950ed17d-9a09-4648-8b26-03447d1db2c5 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:11.017380 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-950ed17d-9a09-4648-8b26-03447d1db2c5 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:11.020197 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-950ed17d-9a09-4648-8b26-03447d1db2c5 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:11.020855 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-950ed17d-9a09-4648-8b26-03447d1db2c5 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:11.242754 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-950ed17d-9a09-4648-8b26-03447d1db2c5 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ca5ce7175c4ffab7f61765c9ef1e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edadca3d287c465bac185ae7b00c9536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:19:11.251573 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-950ed17d-9a09-4648-8b26-03447d1db2c5 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] 10.222.0.23 "GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6" status: 200 len: 1315 microversion: 2.1 time: 0.249487 Sep 10 12:19:11.252165 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3097/6190] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:11 2022] GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:19:11.357276 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-8ff05bdf-256e-48e4-92fd-b89b74b6b8ea req-d942c132-e79a-4498-b076-d76cb3415245 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd69dc49-0dfc-46fe-aa89-77156a60edd6", "tag": "50e51885-25cd-43ab-8854-72619bbdb57f"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:19:11.372557 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8ff05bdf-256e-48e4-92fd-b89b74b6b8ea req-d942c132-e79a-4498-b076-d76cb3415245 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:11.373459 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8ff05bdf-256e-48e4-92fd-b89b74b6b8ea req-d942c132-e79a-4498-b076-d76cb3415245 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:11.374692 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8ff05bdf-256e-48e4-92fd-b89b74b6b8ea req-d942c132-e79a-4498-b076-d76cb3415245 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:11.390166 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-8ff05bdf-256e-48e4-92fd-b89b74b6b8ea req-d942c132-e79a-4498-b076-d76cb3415245 service nova] Creating event network-changed:50e51885-25cd-43ab-8854-72619bbdb57f for instance fd69dc49-0dfc-46fe-aa89-77156a60edd6 on n-h2-856895-1 Sep 10 12:19:11.397394 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-8ff05bdf-256e-48e4-92fd-b89b74b6b8ea req-d942c132-e79a-4498-b076-d76cb3415245 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044948 Sep 10 12:19:11.398657 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3094/6191] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:19:12.275037 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d3ed5ada-89cb-45d8-a224-a6cd7c7cf9e1 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:12.275995 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d3ed5ada-89cb-45d8-a224-a6cd7c7cf9e1 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] [instance: fd69dc49-0dfc-46fe-aa89-77156a60edd6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:12.283708 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d3ed5ada-89cb-45d8-a224-a6cd7c7cf9e1 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:12.284210 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d3ed5ada-89cb-45d8-a224-a6cd7c7cf9e1 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:12.284658 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d3ed5ada-89cb-45d8-a224-a6cd7c7cf9e1 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:12.285407 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d3ed5ada-89cb-45d8-a224-a6cd7c7cf9e1 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:12.285868 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d3ed5ada-89cb-45d8-a224-a6cd7c7cf9e1 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:12.286306 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d3ed5ada-89cb-45d8-a224-a6cd7c7cf9e1 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:12.427558 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d3ed5ada-89cb-45d8-a224-a6cd7c7cf9e1 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ca5ce7175c4ffab7f61765c9ef1e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edadca3d287c465bac185ae7b00c9536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:19:12.435948 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d3ed5ada-89cb-45d8-a224-a6cd7c7cf9e1 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] 10.222.0.23 "GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6" status: 200 len: 1315 microversion: 2.1 time: 0.164745 Sep 10 12:19:12.436546 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3098/6192] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:12 2022] GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:19:13.458595 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cc0d7dc0-3081-4f01-9de8-cc675309a90e tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:13.460158 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cc0d7dc0-3081-4f01-9de8-cc675309a90e tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] [instance: fd69dc49-0dfc-46fe-aa89-77156a60edd6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:13.467429 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc0d7dc0-3081-4f01-9de8-cc675309a90e tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:13.467922 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc0d7dc0-3081-4f01-9de8-cc675309a90e tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:13.468362 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc0d7dc0-3081-4f01-9de8-cc675309a90e tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:13.469063 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc0d7dc0-3081-4f01-9de8-cc675309a90e tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:13.469521 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc0d7dc0-3081-4f01-9de8-cc675309a90e tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:13.469951 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cc0d7dc0-3081-4f01-9de8-cc675309a90e tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:13.605947 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cc0d7dc0-3081-4f01-9de8-cc675309a90e tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ca5ce7175c4ffab7f61765c9ef1e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edadca3d287c465bac185ae7b00c9536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:19:13.614428 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cc0d7dc0-3081-4f01-9de8-cc675309a90e tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] 10.222.0.23 "GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6" status: 200 len: 1315 microversion: 2.1 time: 0.160233 Sep 10 12:19:13.615016 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3095/6193] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:13 2022] GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:19:14.638634 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-21f2eaa0-800c-471d-bb8d-100cffdeae04 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:14.639913 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-21f2eaa0-800c-471d-bb8d-100cffdeae04 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] [instance: fd69dc49-0dfc-46fe-aa89-77156a60edd6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:14.646582 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-21f2eaa0-800c-471d-bb8d-100cffdeae04 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:14.647063 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-21f2eaa0-800c-471d-bb8d-100cffdeae04 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:14.647535 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-21f2eaa0-800c-471d-bb8d-100cffdeae04 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:14.648222 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-21f2eaa0-800c-471d-bb8d-100cffdeae04 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:14.648728 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-21f2eaa0-800c-471d-bb8d-100cffdeae04 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:14.649107 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-21f2eaa0-800c-471d-bb8d-100cffdeae04 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:14.786979 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-21f2eaa0-800c-471d-bb8d-100cffdeae04 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ca5ce7175c4ffab7f61765c9ef1e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edadca3d287c465bac185ae7b00c9536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:19:14.795498 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-21f2eaa0-800c-471d-bb8d-100cffdeae04 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] 10.222.0.23 "GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6" status: 200 len: 1315 microversion: 2.1 time: 0.161464 Sep 10 12:19:14.796084 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3099/6194] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:14 2022] GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:19:15.819552 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8a75443d-7005-4e2a-877a-a915e640b149 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:15.820213 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8a75443d-7005-4e2a-877a-a915e640b149 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] [instance: fd69dc49-0dfc-46fe-aa89-77156a60edd6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:15.828484 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a75443d-7005-4e2a-877a-a915e640b149 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:15.829052 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a75443d-7005-4e2a-877a-a915e640b149 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:15.829595 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a75443d-7005-4e2a-877a-a915e640b149 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:15.830431 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a75443d-7005-4e2a-877a-a915e640b149 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:15.831093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a75443d-7005-4e2a-877a-a915e640b149 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:15.831637 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a75443d-7005-4e2a-877a-a915e640b149 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:15.967194 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8a75443d-7005-4e2a-877a-a915e640b149 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ca5ce7175c4ffab7f61765c9ef1e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edadca3d287c465bac185ae7b00c9536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:19:15.975366 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8a75443d-7005-4e2a-877a-a915e640b149 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] 10.222.0.23 "GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6" status: 200 len: 1315 microversion: 2.1 time: 0.159916 Sep 10 12:19:15.975947 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3096/6195] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:15 2022] GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:19:16.999196 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ad60aaf1-224c-456b-85bd-1ee6480f786e tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:17.000538 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ad60aaf1-224c-456b-85bd-1ee6480f786e tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] [instance: fd69dc49-0dfc-46fe-aa89-77156a60edd6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:17.008836 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad60aaf1-224c-456b-85bd-1ee6480f786e tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:17.009399 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad60aaf1-224c-456b-85bd-1ee6480f786e tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:17.009874 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad60aaf1-224c-456b-85bd-1ee6480f786e tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:17.010588 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad60aaf1-224c-456b-85bd-1ee6480f786e tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:17.011057 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad60aaf1-224c-456b-85bd-1ee6480f786e tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:17.011516 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad60aaf1-224c-456b-85bd-1ee6480f786e tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:17.055785 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-0f011fbe-cd78-4ceb-9cb4-3d4100a3a482 req-c8285f26-355b-4b1b-ac82-b458baf219cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd69dc49-0dfc-46fe-aa89-77156a60edd6", "name": "network-vif-plugged", "status": "completed", "tag": "50e51885-25cd-43ab-8854-72619bbdb57f"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:19:17.090182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0f011fbe-cd78-4ceb-9cb4-3d4100a3a482 req-c8285f26-355b-4b1b-ac82-b458baf219cb service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:17.090739 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0f011fbe-cd78-4ceb-9cb4-3d4100a3a482 req-c8285f26-355b-4b1b-ac82-b458baf219cb service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:17.091349 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0f011fbe-cd78-4ceb-9cb4-3d4100a3a482 req-c8285f26-355b-4b1b-ac82-b458baf219cb service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:17.108277 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-0f011fbe-cd78-4ceb-9cb4-3d4100a3a482 req-c8285f26-355b-4b1b-ac82-b458baf219cb service nova] Creating event network-vif-plugged:50e51885-25cd-43ab-8854-72619bbdb57f for instance fd69dc49-0dfc-46fe-aa89-77156a60edd6 on n-h2-856895-1 Sep 10 12:19:17.131488 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-0f011fbe-cd78-4ceb-9cb4-3d4100a3a482 req-c8285f26-355b-4b1b-ac82-b458baf219cb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075576 Sep 10 12:19:17.131488 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3097/6196] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:19:17.205637 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ad60aaf1-224c-456b-85bd-1ee6480f786e tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ca5ce7175c4ffab7f61765c9ef1e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edadca3d287c465bac185ae7b00c9536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:19:17.214491 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ad60aaf1-224c-456b-85bd-1ee6480f786e tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] 10.222.0.23 "GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6" status: 200 len: 1315 microversion: 2.1 time: 0.220156 Sep 10 12:19:17.215086 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3100/6197] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:16 2022] GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:19:18.247631 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-faccecc2-535d-4b1f-a0d2-789daff3c170 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:18.249122 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-faccecc2-535d-4b1f-a0d2-789daff3c170 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] [instance: fd69dc49-0dfc-46fe-aa89-77156a60edd6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:18.256075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-faccecc2-535d-4b1f-a0d2-789daff3c170 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:18.256918 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-faccecc2-535d-4b1f-a0d2-789daff3c170 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:18.257592 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-faccecc2-535d-4b1f-a0d2-789daff3c170 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:18.258542 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-faccecc2-535d-4b1f-a0d2-789daff3c170 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:18.259255 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-faccecc2-535d-4b1f-a0d2-789daff3c170 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:18.259915 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-faccecc2-535d-4b1f-a0d2-789daff3c170 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:18.405998 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-faccecc2-535d-4b1f-a0d2-789daff3c170 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ca5ce7175c4ffab7f61765c9ef1e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edadca3d287c465bac185ae7b00c9536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:19:18.414492 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-faccecc2-535d-4b1f-a0d2-789daff3c170 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] 10.222.0.23 "GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6" status: 200 len: 1315 microversion: 2.1 time: 0.175863 Sep 10 12:19:18.415209 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3098/6198] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:18 2022] GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:19:19.438322 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0f1ab2da-f128-47ba-862b-41b6794b053c tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:19.438877 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0f1ab2da-f128-47ba-862b-41b6794b053c tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] [instance: fd69dc49-0dfc-46fe-aa89-77156a60edd6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:19.442068 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:19:19.448173 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f1ab2da-f128-47ba-862b-41b6794b053c tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:19.448679 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f1ab2da-f128-47ba-862b-41b6794b053c tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:19.449121 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f1ab2da-f128-47ba-862b-41b6794b053c tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:19.449854 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f1ab2da-f128-47ba-862b-41b6794b053c tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:19.451039 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f1ab2da-f128-47ba-862b-41b6794b053c tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:19.451712 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f1ab2da-f128-47ba-862b-41b6794b053c tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:19.593629 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0f1ab2da-f128-47ba-862b-41b6794b053c tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ca5ce7175c4ffab7f61765c9ef1e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edadca3d287c465bac185ae7b00c9536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:19:19.602556 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0f1ab2da-f128-47ba-862b-41b6794b053c tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] 10.222.0.23 "GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6" status: 200 len: 1501 microversion: 2.1 time: 0.168151 Sep 10 12:19:19.603325 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3101/6199] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:19 2022] GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6 => generated 1501 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:19:19.625556 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0a5de834-2b8c-4208-862a-dca7f6c2666f tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:19.626183 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0a5de834-2b8c-4208-862a-dca7f6c2666f tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] [instance: fd69dc49-0dfc-46fe-aa89-77156a60edd6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:19.629166 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:19:19.629824 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:19:19.634729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a5de834-2b8c-4208-862a-dca7f6c2666f tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:19.635250 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a5de834-2b8c-4208-862a-dca7f6c2666f tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:19.635694 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a5de834-2b8c-4208-862a-dca7f6c2666f tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:19.636404 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a5de834-2b8c-4208-862a-dca7f6c2666f tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:19.636867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a5de834-2b8c-4208-862a-dca7f6c2666f tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:19.637298 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a5de834-2b8c-4208-862a-dca7f6c2666f tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:19.779637 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0a5de834-2b8c-4208-862a-dca7f6c2666f tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ca5ce7175c4ffab7f61765c9ef1e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edadca3d287c465bac185ae7b00c9536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:19:19.795027 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0a5de834-2b8c-4208-862a-dca7f6c2666f tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] 10.222.0.23 "GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6" status: 200 len: 1501 microversion: 2.1 time: 0.172966 Sep 10 12:19:19.795685 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3099/6200] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:19 2022] GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6 => generated 1501 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:19:19.817872 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2a86e162-6d0f-4072-96fd-8baed4305388 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:19:19.818501 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2a86e162-6d0f-4072-96fd-8baed4305388 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] [instance: fd69dc49-0dfc-46fe-aa89-77156a60edd6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:19.825195 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2a86e162-6d0f-4072-96fd-8baed4305388 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:19.825769 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2a86e162-6d0f-4072-96fd-8baed4305388 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:19.826284 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2a86e162-6d0f-4072-96fd-8baed4305388 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:19.827058 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2a86e162-6d0f-4072-96fd-8baed4305388 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:19.827648 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2a86e162-6d0f-4072-96fd-8baed4305388 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:19.828151 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2a86e162-6d0f-4072-96fd-8baed4305388 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:19.851670 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-2a86e162-6d0f-4072-96fd-8baed4305388 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lazy-loading 'flavor' on Instance uuid fd69dc49-0dfc-46fe-aa89-77156a60edd6 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:19:19.925787 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2a86e162-6d0f-4072-96fd-8baed4305388 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] 10.222.0.23 "POST /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6/action" status: 202 len: 0 microversion: 2.1 time: 0.111510 Sep 10 12:19:19.926786 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3102/6201] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:19:19 2022] POST /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:19:19.935096 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ad38c447-d4d5-472e-a594-ae8419716184 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:19.936026 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ad38c447-d4d5-472e-a594-ae8419716184 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] [instance: fd69dc49-0dfc-46fe-aa89-77156a60edd6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:19.943463 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ad38c447-d4d5-472e-a594-ae8419716184 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:19.943928 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ad38c447-d4d5-472e-a594-ae8419716184 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:19.944346 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ad38c447-d4d5-472e-a594-ae8419716184 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:19.945025 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ad38c447-d4d5-472e-a594-ae8419716184 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:19.945592 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ad38c447-d4d5-472e-a594-ae8419716184 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:19.946111 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ad38c447-d4d5-472e-a594-ae8419716184 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:20.082467 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ad38c447-d4d5-472e-a594-ae8419716184 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ca5ce7175c4ffab7f61765c9ef1e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edadca3d287c465bac185ae7b00c9536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:19:20.090498 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ad38c447-d4d5-472e-a594-ae8419716184 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] 10.222.0.23 "GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6" status: 200 len: 1509 microversion: 2.1 time: 0.159768 Sep 10 12:19:20.091819 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3100/6202] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:19 2022] GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:19:21.115894 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d4580857-2678-4700-9de4-7958f33bf74a tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:21.117519 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d4580857-2678-4700-9de4-7958f33bf74a tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] [instance: fd69dc49-0dfc-46fe-aa89-77156a60edd6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:21.125055 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d4580857-2678-4700-9de4-7958f33bf74a tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:21.125677 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d4580857-2678-4700-9de4-7958f33bf74a tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:21.126225 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d4580857-2678-4700-9de4-7958f33bf74a tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:21.127034 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d4580857-2678-4700-9de4-7958f33bf74a tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:21.127729 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d4580857-2678-4700-9de4-7958f33bf74a tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:21.128266 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d4580857-2678-4700-9de4-7958f33bf74a tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:21.275045 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d4580857-2678-4700-9de4-7958f33bf74a tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ca5ce7175c4ffab7f61765c9ef1e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edadca3d287c465bac185ae7b00c9536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:19:21.292236 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d4580857-2678-4700-9de4-7958f33bf74a tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] 10.222.0.23 "GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6" status: 200 len: 1492 microversion: 2.1 time: 0.181920 Sep 10 12:19:21.293040 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3103/6203] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:21 2022] GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6 => generated 1492 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:19:21.315807 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-35c7ba5f-32f9-462a-8d1a-9062981d230a tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:19:21.316358 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-35c7ba5f-32f9-462a-8d1a-9062981d230a tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] [instance: fd69dc49-0dfc-46fe-aa89-77156a60edd6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:21.323316 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-35c7ba5f-32f9-462a-8d1a-9062981d230a tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:21.323800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-35c7ba5f-32f9-462a-8d1a-9062981d230a tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:21.324447 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-35c7ba5f-32f9-462a-8d1a-9062981d230a tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:21.326331 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-35c7ba5f-32f9-462a-8d1a-9062981d230a tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:21.326800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-35c7ba5f-32f9-462a-8d1a-9062981d230a tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:21.327260 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-35c7ba5f-32f9-462a-8d1a-9062981d230a tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:21.402594 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-35c7ba5f-32f9-462a-8d1a-9062981d230a tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] 10.222.0.23 "POST /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6/action" status: 202 len: 0 microversion: 2.1 time: 0.090678 Sep 10 12:19:21.406658 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3101/6204] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:19:21 2022] POST /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:19:21.417455 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4fae5539-86fb-4640-8d11-3b75f4020f4e tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:21.418086 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4fae5539-86fb-4640-8d11-3b75f4020f4e tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] [instance: fd69dc49-0dfc-46fe-aa89-77156a60edd6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:21.443445 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fae5539-86fb-4640-8d11-3b75f4020f4e tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:21.443950 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fae5539-86fb-4640-8d11-3b75f4020f4e tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:21.444417 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fae5539-86fb-4640-8d11-3b75f4020f4e tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:21.445144 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fae5539-86fb-4640-8d11-3b75f4020f4e tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:21.445638 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fae5539-86fb-4640-8d11-3b75f4020f4e tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:21.446076 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fae5539-86fb-4640-8d11-3b75f4020f4e tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:21.628394 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4fae5539-86fb-4640-8d11-3b75f4020f4e tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ca5ce7175c4ffab7f61765c9ef1e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edadca3d287c465bac185ae7b00c9536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:19:21.638448 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4fae5539-86fb-4640-8d11-3b75f4020f4e tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] 10.222.0.23 "GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6" status: 200 len: 1498 microversion: 2.1 time: 0.229251 Sep 10 12:19:21.640267 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3104/6205] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:21 2022] GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6 => generated 1498 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:19:22.164457 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2a764eb5-9273-4276-bfe6-6e9d978f0035 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:19:22.167624 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2a764eb5-9273-4276-bfe6-6e9d978f0035 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:22.176977 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a764eb5-9273-4276-bfe6-6e9d978f0035 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:22.177804 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a764eb5-9273-4276-bfe6-6e9d978f0035 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:22.178438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a764eb5-9273-4276-bfe6-6e9d978f0035 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:22.179588 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a764eb5-9273-4276-bfe6-6e9d978f0035 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:22.180225 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a764eb5-9273-4276-bfe6-6e9d978f0035 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:22.180824 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a764eb5-9273-4276-bfe6-6e9d978f0035 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:22.251388 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2a764eb5-9273-4276-bfe6-6e9d978f0035 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "POST /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c/action" status: 200 len: 24575 microversion: 2.1 time: 0.100922 Sep 10 12:19:22.258078 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3102/6206] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:19:22 2022] POST /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c/action => generated 24575 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 12:19:22.664547 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-584e7d73-7a13-4e33-bb54-584e4c30f87b tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:22.665403 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-584e7d73-7a13-4e33-bb54-584e4c30f87b tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] [instance: fd69dc49-0dfc-46fe-aa89-77156a60edd6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:22.674353 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-584e7d73-7a13-4e33-bb54-584e4c30f87b tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:22.674943 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-584e7d73-7a13-4e33-bb54-584e4c30f87b tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:22.675429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-584e7d73-7a13-4e33-bb54-584e4c30f87b tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:22.676266 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-584e7d73-7a13-4e33-bb54-584e4c30f87b tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:22.676630 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-584e7d73-7a13-4e33-bb54-584e4c30f87b tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:22.677042 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-584e7d73-7a13-4e33-bb54-584e4c30f87b tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:22.847050 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-584e7d73-7a13-4e33-bb54-584e4c30f87b tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ca5ce7175c4ffab7f61765c9ef1e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edadca3d287c465bac185ae7b00c9536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:19:22.855892 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-584e7d73-7a13-4e33-bb54-584e4c30f87b tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] 10.222.0.23 "GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6" status: 200 len: 1498 microversion: 2.1 time: 0.195323 Sep 10 12:19:22.859220 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3105/6207] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:22 2022] GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6 => generated 1498 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:19:23.883776 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-676410dd-8d37-424a-ae95-da400ad6c45c tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:23.885066 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-676410dd-8d37-424a-ae95-da400ad6c45c tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] [instance: fd69dc49-0dfc-46fe-aa89-77156a60edd6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:23.892990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-676410dd-8d37-424a-ae95-da400ad6c45c tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:23.893480 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-676410dd-8d37-424a-ae95-da400ad6c45c tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:23.893919 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-676410dd-8d37-424a-ae95-da400ad6c45c tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:23.894618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-676410dd-8d37-424a-ae95-da400ad6c45c tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:23.895075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-676410dd-8d37-424a-ae95-da400ad6c45c tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:23.895525 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-676410dd-8d37-424a-ae95-da400ad6c45c tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:24.032949 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-676410dd-8d37-424a-ae95-da400ad6c45c tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ca5ce7175c4ffab7f61765c9ef1e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edadca3d287c465bac185ae7b00c9536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:19:24.040912 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-676410dd-8d37-424a-ae95-da400ad6c45c tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] 10.222.0.23 "GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6" status: 200 len: 1501 microversion: 2.1 time: 0.161453 Sep 10 12:19:24.041580 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3103/6208] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:23 2022] GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6 => generated 1501 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:19:24.064262 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7819e88c-9a3f-4fdb-9d25-e218c48d37fc tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:19:24.064875 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7819e88c-9a3f-4fdb-9d25-e218c48d37fc tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] [instance: fd69dc49-0dfc-46fe-aa89-77156a60edd6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:24.071748 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7819e88c-9a3f-4fdb-9d25-e218c48d37fc tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:24.072243 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7819e88c-9a3f-4fdb-9d25-e218c48d37fc tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:24.072692 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7819e88c-9a3f-4fdb-9d25-e218c48d37fc tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:24.073390 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7819e88c-9a3f-4fdb-9d25-e218c48d37fc tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:24.073852 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7819e88c-9a3f-4fdb-9d25-e218c48d37fc tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:24.074289 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7819e88c-9a3f-4fdb-9d25-e218c48d37fc tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:24.100232 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-7819e88c-9a3f-4fdb-9d25-e218c48d37fc tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lazy-loading 'flavor' on Instance uuid fd69dc49-0dfc-46fe-aa89-77156a60edd6 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:19:24.173448 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7819e88c-9a3f-4fdb-9d25-e218c48d37fc tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] 10.222.0.23 "POST /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6/action" status: 202 len: 0 microversion: 2.1 time: 0.112882 Sep 10 12:19:24.174659 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3106/6209] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:19:24 2022] POST /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:19:24.184035 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-32755723-4b8f-4008-a591-7a76b1adfd06 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:24.185214 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-32755723-4b8f-4008-a591-7a76b1adfd06 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] [instance: fd69dc49-0dfc-46fe-aa89-77156a60edd6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:24.193148 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32755723-4b8f-4008-a591-7a76b1adfd06 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:24.193733 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32755723-4b8f-4008-a591-7a76b1adfd06 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:24.194273 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32755723-4b8f-4008-a591-7a76b1adfd06 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:24.195304 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32755723-4b8f-4008-a591-7a76b1adfd06 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:24.195848 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32755723-4b8f-4008-a591-7a76b1adfd06 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:24.196355 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32755723-4b8f-4008-a591-7a76b1adfd06 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:24.358045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-32755723-4b8f-4008-a591-7a76b1adfd06 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ca5ce7175c4ffab7f61765c9ef1e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edadca3d287c465bac185ae7b00c9536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:19:24.365875 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-32755723-4b8f-4008-a591-7a76b1adfd06 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] 10.222.0.23 "GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6" status: 200 len: 1509 microversion: 2.1 time: 0.187418 Sep 10 12:19:24.366461 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3104/6210] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:24 2022] GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6 => generated 1509 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:19:25.390982 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-002c6493-9c17-4e6b-83cc-16d1d312946f tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:25.392503 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-002c6493-9c17-4e6b-83cc-16d1d312946f tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] [instance: fd69dc49-0dfc-46fe-aa89-77156a60edd6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:25.400405 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-002c6493-9c17-4e6b-83cc-16d1d312946f tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:25.400939 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-002c6493-9c17-4e6b-83cc-16d1d312946f tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:25.401389 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-002c6493-9c17-4e6b-83cc-16d1d312946f tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:25.402113 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-002c6493-9c17-4e6b-83cc-16d1d312946f tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:25.402578 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-002c6493-9c17-4e6b-83cc-16d1d312946f tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:25.403659 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-002c6493-9c17-4e6b-83cc-16d1d312946f tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:25.636525 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-002c6493-9c17-4e6b-83cc-16d1d312946f tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ca5ce7175c4ffab7f61765c9ef1e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edadca3d287c465bac185ae7b00c9536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:19:25.646294 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-002c6493-9c17-4e6b-83cc-16d1d312946f tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] 10.222.0.23 "GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6" status: 200 len: 1492 microversion: 2.1 time: 0.259905 Sep 10 12:19:25.647011 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3107/6211] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:25 2022] GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6 => generated 1492 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:19:25.670471 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-61944bcb-d0f0-4843-b4f2-685884601bdb tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:19:25.671056 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-61944bcb-d0f0-4843-b4f2-685884601bdb tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] [instance: fd69dc49-0dfc-46fe-aa89-77156a60edd6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:25.678064 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61944bcb-d0f0-4843-b4f2-685884601bdb tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:25.678505 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61944bcb-d0f0-4843-b4f2-685884601bdb tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:25.678952 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61944bcb-d0f0-4843-b4f2-685884601bdb tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:25.679731 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61944bcb-d0f0-4843-b4f2-685884601bdb tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:25.680186 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61944bcb-d0f0-4843-b4f2-685884601bdb tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:25.680611 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61944bcb-d0f0-4843-b4f2-685884601bdb tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:25.751432 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-61944bcb-d0f0-4843-b4f2-685884601bdb tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] 10.222.0.23 "POST /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6/action" status: 202 len: 0 microversion: 2.1 time: 0.085041 Sep 10 12:19:25.755035 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3105/6212] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:19:25 2022] POST /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:19:25.760323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6acec8a5-9ae3-40e4-88dd-b19a31b3da46 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:25.760950 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6acec8a5-9ae3-40e4-88dd-b19a31b3da46 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] [instance: fd69dc49-0dfc-46fe-aa89-77156a60edd6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:25.768091 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6acec8a5-9ae3-40e4-88dd-b19a31b3da46 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:25.768596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6acec8a5-9ae3-40e4-88dd-b19a31b3da46 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:25.769048 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6acec8a5-9ae3-40e4-88dd-b19a31b3da46 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:25.769768 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6acec8a5-9ae3-40e4-88dd-b19a31b3da46 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:25.770294 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6acec8a5-9ae3-40e4-88dd-b19a31b3da46 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:25.770729 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6acec8a5-9ae3-40e4-88dd-b19a31b3da46 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:25.958996 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6acec8a5-9ae3-40e4-88dd-b19a31b3da46 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ca5ce7175c4ffab7f61765c9ef1e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edadca3d287c465bac185ae7b00c9536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:19:25.967918 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6acec8a5-9ae3-40e4-88dd-b19a31b3da46 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] 10.222.0.23 "GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6" status: 200 len: 1498 microversion: 2.1 time: 0.211513 Sep 10 12:19:25.968502 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3108/6213] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:25 2022] GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6 => generated 1498 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:19:27.016984 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-59665835-fb9e-4804-b594-817482bddc36 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:27.017710 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-59665835-fb9e-4804-b594-817482bddc36 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] [instance: fd69dc49-0dfc-46fe-aa89-77156a60edd6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:27.026752 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59665835-fb9e-4804-b594-817482bddc36 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:27.028253 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59665835-fb9e-4804-b594-817482bddc36 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:27.030357 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59665835-fb9e-4804-b594-817482bddc36 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:27.031966 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59665835-fb9e-4804-b594-817482bddc36 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:27.038341 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59665835-fb9e-4804-b594-817482bddc36 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:27.040756 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59665835-fb9e-4804-b594-817482bddc36 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:27.228500 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-59665835-fb9e-4804-b594-817482bddc36 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ca5ce7175c4ffab7f61765c9ef1e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edadca3d287c465bac185ae7b00c9536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:19:27.238633 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-59665835-fb9e-4804-b594-817482bddc36 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] 10.222.0.23 "GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6" status: 200 len: 1498 microversion: 2.1 time: 0.247923 Sep 10 12:19:27.239268 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3106/6214] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:26 2022] GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6 => generated 1498 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:19:28.267175 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-93d46d12-c0a3-4dfa-a868-25627e6af2f3 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:28.268114 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-93d46d12-c0a3-4dfa-a868-25627e6af2f3 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] [instance: fd69dc49-0dfc-46fe-aa89-77156a60edd6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:28.274169 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-93d46d12-c0a3-4dfa-a868-25627e6af2f3 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:28.274660 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-93d46d12-c0a3-4dfa-a868-25627e6af2f3 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:28.275102 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-93d46d12-c0a3-4dfa-a868-25627e6af2f3 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:28.275826 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-93d46d12-c0a3-4dfa-a868-25627e6af2f3 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:28.276287 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-93d46d12-c0a3-4dfa-a868-25627e6af2f3 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:28.276746 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-93d46d12-c0a3-4dfa-a868-25627e6af2f3 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:28.414790 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-93d46d12-c0a3-4dfa-a868-25627e6af2f3 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ca5ce7175c4ffab7f61765c9ef1e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edadca3d287c465bac185ae7b00c9536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:19:28.423935 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-93d46d12-c0a3-4dfa-a868-25627e6af2f3 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] 10.222.0.23 "GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6" status: 200 len: 1501 microversion: 2.1 time: 0.165340 Sep 10 12:19:28.424561 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3109/6215] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:28 2022] GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6 => generated 1501 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:19:28.445850 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-422ee1f3-30ca-41c1-8bdf-a1dbec1b1819 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:28.446434 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-422ee1f3-30ca-41c1-8bdf-a1dbec1b1819 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] [instance: fd69dc49-0dfc-46fe-aa89-77156a60edd6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:28.454456 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-422ee1f3-30ca-41c1-8bdf-a1dbec1b1819 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:28.454957 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-422ee1f3-30ca-41c1-8bdf-a1dbec1b1819 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:28.455442 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-422ee1f3-30ca-41c1-8bdf-a1dbec1b1819 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:28.456182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-422ee1f3-30ca-41c1-8bdf-a1dbec1b1819 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:28.456645 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-422ee1f3-30ca-41c1-8bdf-a1dbec1b1819 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:28.457238 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-422ee1f3-30ca-41c1-8bdf-a1dbec1b1819 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:28.485031 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-422ee1f3-30ca-41c1-8bdf-a1dbec1b1819 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] [instance: fd69dc49-0dfc-46fe-aa89-77156a60edd6] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:19:28.520326 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:19:28.581563 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-422ee1f3-30ca-41c1-8bdf-a1dbec1b1819 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6" status: 204 len: 0 microversion: 2.1 time: 0.139341 Sep 10 12:19:28.582104 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3107/6216] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:19:28 2022] DELETE /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:19:28.590599 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-50b880e9-97d8-4cf3-93eb-0032e1bfa8cd tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:28.591306 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-50b880e9-97d8-4cf3-93eb-0032e1bfa8cd tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] [instance: fd69dc49-0dfc-46fe-aa89-77156a60edd6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:28.597443 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50b880e9-97d8-4cf3-93eb-0032e1bfa8cd tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:28.597933 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50b880e9-97d8-4cf3-93eb-0032e1bfa8cd tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:28.598371 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50b880e9-97d8-4cf3-93eb-0032e1bfa8cd tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:28.599079 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50b880e9-97d8-4cf3-93eb-0032e1bfa8cd tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:28.599580 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50b880e9-97d8-4cf3-93eb-0032e1bfa8cd tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:28.600013 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50b880e9-97d8-4cf3-93eb-0032e1bfa8cd tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:28.604095 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:19:28.750692 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-50b880e9-97d8-4cf3-93eb-0032e1bfa8cd tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ca5ce7175c4ffab7f61765c9ef1e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edadca3d287c465bac185ae7b00c9536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:19:28.759121 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-50b880e9-97d8-4cf3-93eb-0032e1bfa8cd tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] 10.222.0.23 "GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6" status: 200 len: 1507 microversion: 2.1 time: 0.172565 Sep 10 12:19:28.759717 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3110/6217] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:28 2022] GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6 => generated 1507 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:19:29.784618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2de0e4c8-6198-4ba6-96e3-d6ff491f3b4e tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:29.786003 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2de0e4c8-6198-4ba6-96e3-d6ff491f3b4e tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] [instance: fd69dc49-0dfc-46fe-aa89-77156a60edd6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:29.793137 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2de0e4c8-6198-4ba6-96e3-d6ff491f3b4e tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:29.794205 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2de0e4c8-6198-4ba6-96e3-d6ff491f3b4e tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:29.794649 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2de0e4c8-6198-4ba6-96e3-d6ff491f3b4e tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:29.795388 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2de0e4c8-6198-4ba6-96e3-d6ff491f3b4e tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:29.795875 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2de0e4c8-6198-4ba6-96e3-d6ff491f3b4e tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:29.796312 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2de0e4c8-6198-4ba6-96e3-d6ff491f3b4e tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:29.937039 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2de0e4c8-6198-4ba6-96e3-d6ff491f3b4e tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ca5ce7175c4ffab7f61765c9ef1e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edadca3d287c465bac185ae7b00c9536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:19:29.946134 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2de0e4c8-6198-4ba6-96e3-d6ff491f3b4e tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] 10.222.0.23 "GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6" status: 200 len: 1507 microversion: 2.1 time: 0.166090 Sep 10 12:19:29.946997 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3108/6218] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:29 2022] GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6 => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:19:30.914431 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-633555e6-fb4a-40b2-a7fc-ebd1d6d4951c req-c0760f88-68ef-4d45-bfa5-316d0b86e527 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd69dc49-0dfc-46fe-aa89-77156a60edd6", "name": "network-vif-deleted", "tag": "50e51885-25cd-43ab-8854-72619bbdb57f"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:19:30.925963 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-633555e6-fb4a-40b2-a7fc-ebd1d6d4951c req-c0760f88-68ef-4d45-bfa5-316d0b86e527 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:30.926734 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-633555e6-fb4a-40b2-a7fc-ebd1d6d4951c req-c0760f88-68ef-4d45-bfa5-316d0b86e527 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:30.927288 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-633555e6-fb4a-40b2-a7fc-ebd1d6d4951c req-c0760f88-68ef-4d45-bfa5-316d0b86e527 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:30.939477 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-633555e6-fb4a-40b2-a7fc-ebd1d6d4951c req-c0760f88-68ef-4d45-bfa5-316d0b86e527 service nova] Creating event network-vif-deleted:50e51885-25cd-43ab-8854-72619bbdb57f for instance fd69dc49-0dfc-46fe-aa89-77156a60edd6 on n-h2-856895-1 Sep 10 12:19:30.944958 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-633555e6-fb4a-40b2-a7fc-ebd1d6d4951c req-c0760f88-68ef-4d45-bfa5-316d0b86e527 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040763 Sep 10 12:19:30.945803 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3111/6219] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:19:30.971903 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-85daae08-817a-4534-85a4-87327feab831 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:30.973123 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-85daae08-817a-4534-85a4-87327feab831 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] [instance: fd69dc49-0dfc-46fe-aa89-77156a60edd6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:30.980790 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-85daae08-817a-4534-85a4-87327feab831 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:30.981289 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-85daae08-817a-4534-85a4-87327feab831 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:30.982056 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-85daae08-817a-4534-85a4-87327feab831 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:30.982712 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-85daae08-817a-4534-85a4-87327feab831 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:30.983196 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-85daae08-817a-4534-85a4-87327feab831 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:30.983644 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-85daae08-817a-4534-85a4-87327feab831 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:31.054438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-85daae08-817a-4534-85a4-87327feab831 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ca5ce7175c4ffab7f61765c9ef1e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edadca3d287c465bac185ae7b00c9536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:19:31.064471 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-85daae08-817a-4534-85a4-87327feab831 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] 10.222.0.23 "GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6" status: 200 len: 1300 microversion: 2.1 time: 0.097229 Sep 10 12:19:31.065287 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3109/6220] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:30 2022] GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6 => generated 1300 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:19:32.090384 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4701fb19-a8f1-472d-8832-771b1cfa4ab6 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:32.093627 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4701fb19-a8f1-472d-8832-771b1cfa4ab6 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] [instance: fd69dc49-0dfc-46fe-aa89-77156a60edd6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:32.098149 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4701fb19-a8f1-472d-8832-771b1cfa4ab6 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:32.098836 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4701fb19-a8f1-472d-8832-771b1cfa4ab6 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:32.099563 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4701fb19-a8f1-472d-8832-771b1cfa4ab6 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:32.100470 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4701fb19-a8f1-472d-8832-771b1cfa4ab6 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:32.101185 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4701fb19-a8f1-472d-8832-771b1cfa4ab6 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:32.101619 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4701fb19-a8f1-472d-8832-771b1cfa4ab6 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:32.116671 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-4701fb19-a8f1-472d-8832-771b1cfa4ab6 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] HTTP exception thrown: Instance fd69dc49-0dfc-46fe-aa89-77156a60edd6 could not be found. Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4701fb19-a8f1-472d-8832-771b1cfa4ab6 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Request method failure captured: Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6 HTTP/1.1 Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHIC6Dr_BHB9N6GBOjmS6QG_RQnGpaEtWFs_Mz80HKybz9lmDr9qB74jQ7JvwSTcILz5MN49z6d4mGAbXCWrMYCfXWZ5wDYdoTBsfUZRUbg0cCoEzQRGKdupSl8vj-Kb5pECriCVnWRnQ5_LvQTVoNIAWx4YsGxs6o2YKS7gWF4IBSZ0 Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: edadca3d287c465bac185ae7b00c9536 Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-TestServerAdvancedOps-1365996967 Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/edadca3d287c465bac185ae7b00c9536"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/edadca3d287c465bac185ae7b00c9536"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_edadca3d287c465bac185ae7b00c9536", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/edadca3d287c465bac185ae7b00c9536"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-TestServerAdvancedOps-1365996967 Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: edadca3d287c465bac185ae7b00c9536 Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-TestServerAdvancedOps-1365996967 Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-TestServerAdvancedOps-1365996967-project Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: c1ca5ce7175c4ffab7f61765c9ef1e37 Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-TestServerAdvancedOps-1365996967-project Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance fd69dc49-0dfc-46fe-aa89-77156a60edd6 could not be found. Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'fd69dc49-0dfc-46fe-aa89-77156a60edd6'} Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd69dc49-0dfc-46fe-aa89-77156a60edd6 could not be found. Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd69dc49-0dfc-46fe-aa89-77156a60edd6 could not be found. Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:19:32.118918 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:19:32.127103 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:19:32.127103 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:19:32.127103 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:19:32.127103 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:19:32.127103 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:19:32.127103 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd69dc49-0dfc-46fe-aa89-77156a60edd6 could not be found. Sep 10 12:19:32.127103 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:19:32.127103 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4701fb19-a8f1-472d-8832-771b1cfa4ab6 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] Returning 404 to user: Instance fd69dc49-0dfc-46fe-aa89-77156a60edd6 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:19:32.127103 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4701fb19-a8f1-472d-8832-771b1cfa4ab6 tempest-TestServerAdvancedOps-1365996967 tempest-TestServerAdvancedOps-1365996967-project] 10.222.0.23 "GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6" status: 404 len: 111 microversion: 2.1 time: 0.035230 Sep 10 12:19:32.127103 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3112/6221] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:32 2022] GET /compute/v2.1/servers/fd69dc49-0dfc-46fe-aa89-77156a60edd6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:19:46.097383 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:19:46.098871 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:19:46.229905 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4bd74206-80fe-4891-9466-b7bc58bd47f3 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:46.231973 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4bd74206-80fe-4891-9466-b7bc58bd47f3 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:46.232457 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4bd74206-80fe-4891-9466-b7bc58bd47f3 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:46.232892 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4bd74206-80fe-4891-9466-b7bc58bd47f3 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:46.233615 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4bd74206-80fe-4891-9466-b7bc58bd47f3 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:46.234062 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4bd74206-80fe-4891-9466-b7bc58bd47f3 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:46.234479 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4bd74206-80fe-4891-9466-b7bc58bd47f3 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:46.259815 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4bd74206-80fe-4891-9466-b7bc58bd47f3 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] 10.222.0.23 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.167968 Sep 10 12:19:46.260416 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3110/6222] 10.222.0.23 () {58 vars in 1185 bytes} [Sat Sep 10 12:19:46 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:19:46.369418 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-75991b4b-b8be-4cc3-a26d-487d009280a1 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1190239612", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "availability_zone": "nova:n-h2-856895-1", "networks": [{"uuid": "22fe7d46-1f84-4376-b821-31c4162450fa"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:19:46.378070 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=36 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:19:46.378744 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=8 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:19:46.444910 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-75991b4b-b8be-4cc3-a26d-487d009280a1 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] validate_networks() for [('22fe7d46-1f84-4376-b821-31c4162450fa', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:19:47.040490 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-75991b4b-b8be-4cc3-a26d-487d009280a1 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:19:47.041024 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-75991b4b-b8be-4cc3-a26d-487d009280a1 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:19:47.041610 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-75991b4b-b8be-4cc3-a26d-487d009280a1 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:19:47.042127 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-75991b4b-b8be-4cc3-a26d-487d009280a1 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:19:47.042795 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-75991b4b-b8be-4cc3-a26d-487d009280a1 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:19:47.053109 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75991b4b-b8be-4cc3-a26d-487d009280a1 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:47.053788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75991b4b-b8be-4cc3-a26d-487d009280a1 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:47.054430 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75991b4b-b8be-4cc3-a26d-487d009280a1 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:47.055316 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75991b4b-b8be-4cc3-a26d-487d009280a1 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:47.055884 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75991b4b-b8be-4cc3-a26d-487d009280a1 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:47.056417 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-75991b4b-b8be-4cc3-a26d-487d009280a1 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:47.077900 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-75991b4b-b8be-4cc3-a26d-487d009280a1 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Getting quotas for project 055a7454feb24da4a800e7e59138da5e. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:19:47.083725 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-75991b4b-b8be-4cc3-a26d-487d009280a1 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Getting quotas for user ff647004c0b04d7d98d196ee692da0d6 and project 055a7454feb24da4a800e7e59138da5e. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:19:47.097849 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-75991b4b-b8be-4cc3-a26d-487d009280a1 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:19:47.100650 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-75991b4b-b8be-4cc3-a26d-487d009280a1 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] [instance: eaa1298b-6554-42d7-b461-451be52ebe04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:19:47.161063 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-75991b4b-b8be-4cc3-a26d-487d009280a1 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.795341 Sep 10 12:19:47.162035 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3113/6223] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:19:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:19:47.173690 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-453a9491-0256-4973-a86d-cb2b2c14103c tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:47.174332 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-453a9491-0256-4973-a86d-cb2b2c14103c tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] [instance: eaa1298b-6554-42d7-b461-451be52ebe04] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:47.255792 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-453a9491-0256-4973-a86d-cb2b2c14103c tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/eaa1298b-6554-42d7-b461-451be52ebe04" status: 200 len: 1329 microversion: 2.1 time: 0.085804 Sep 10 12:19:47.256418 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3111/6224] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:47 2022] GET /compute/v2.1/servers/eaa1298b-6554-42d7-b461-451be52ebe04 => generated 1329 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:19:48.291072 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-84d37366-b757-43fe-8054-74218d2d2a66 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:48.297404 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-84d37366-b757-43fe-8054-74218d2d2a66 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] [instance: eaa1298b-6554-42d7-b461-451be52ebe04] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:48.306781 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-84d37366-b757-43fe-8054-74218d2d2a66 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:48.307941 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-84d37366-b757-43fe-8054-74218d2d2a66 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:48.310113 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-84d37366-b757-43fe-8054-74218d2d2a66 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:48.311089 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-84d37366-b757-43fe-8054-74218d2d2a66 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:48.311876 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-84d37366-b757-43fe-8054-74218d2d2a66 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:48.312503 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-84d37366-b757-43fe-8054-74218d2d2a66 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:48.496015 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-84d37366-b757-43fe-8054-74218d2d2a66 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/eaa1298b-6554-42d7-b461-451be52ebe04" status: 200 len: 1424 microversion: 2.1 time: 0.208013 Sep 10 12:19:48.499021 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3114/6225] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:48 2022] GET /compute/v2.1/servers/eaa1298b-6554-42d7-b461-451be52ebe04 => generated 1424 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:19:49.521924 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f10214f3-456c-4bd7-840d-39ee7f176e4b tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:49.523286 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f10214f3-456c-4bd7-840d-39ee7f176e4b tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] [instance: eaa1298b-6554-42d7-b461-451be52ebe04] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:49.536041 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f10214f3-456c-4bd7-840d-39ee7f176e4b tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:49.536538 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f10214f3-456c-4bd7-840d-39ee7f176e4b tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:49.536982 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f10214f3-456c-4bd7-840d-39ee7f176e4b tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:49.537699 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f10214f3-456c-4bd7-840d-39ee7f176e4b tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:49.538161 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f10214f3-456c-4bd7-840d-39ee7f176e4b tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:49.538593 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f10214f3-456c-4bd7-840d-39ee7f176e4b tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:49.765438 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f10214f3-456c-4bd7-840d-39ee7f176e4b tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/eaa1298b-6554-42d7-b461-451be52ebe04" status: 200 len: 1464 microversion: 2.1 time: 0.247349 Sep 10 12:19:49.767861 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3112/6226] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:49 2022] GET /compute/v2.1/servers/eaa1298b-6554-42d7-b461-451be52ebe04 => generated 1464 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:19:50.051831 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-1b466b8b-5300-4e1a-a534-bb3670041331 req-0c4697fd-0a92-4ff0-9603-29043c3d4bf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaa1298b-6554-42d7-b461-451be52ebe04", "tag": "e04f949a-b4da-40b8-93dd-c1a11896a5aa"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:19:50.068151 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-1b466b8b-5300-4e1a-a534-bb3670041331 req-0c4697fd-0a92-4ff0-9603-29043c3d4bf7 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:50.068781 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-1b466b8b-5300-4e1a-a534-bb3670041331 req-0c4697fd-0a92-4ff0-9603-29043c3d4bf7 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:50.069899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-1b466b8b-5300-4e1a-a534-bb3670041331 req-0c4697fd-0a92-4ff0-9603-29043c3d4bf7 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:50.093049 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-1b466b8b-5300-4e1a-a534-bb3670041331 req-0c4697fd-0a92-4ff0-9603-29043c3d4bf7 service nova] Creating event network-changed:e04f949a-b4da-40b8-93dd-c1a11896a5aa for instance eaa1298b-6554-42d7-b461-451be52ebe04 on n-h2-856895-1 Sep 10 12:19:50.099498 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-1b466b8b-5300-4e1a-a534-bb3670041331 req-0c4697fd-0a92-4ff0-9603-29043c3d4bf7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052554 Sep 10 12:19:50.100346 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3115/6227] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:19:50.793828 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4be684f1-9044-4eaf-9396-290c9051416b tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:50.795282 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4be684f1-9044-4eaf-9396-290c9051416b tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] [instance: eaa1298b-6554-42d7-b461-451be52ebe04] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:50.802922 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4be684f1-9044-4eaf-9396-290c9051416b tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:50.803460 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4be684f1-9044-4eaf-9396-290c9051416b tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:50.804227 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4be684f1-9044-4eaf-9396-290c9051416b tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:50.805173 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4be684f1-9044-4eaf-9396-290c9051416b tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:50.805803 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4be684f1-9044-4eaf-9396-290c9051416b tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:50.806398 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4be684f1-9044-4eaf-9396-290c9051416b tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:50.955788 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4be684f1-9044-4eaf-9396-290c9051416b tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/eaa1298b-6554-42d7-b461-451be52ebe04" status: 200 len: 1464 microversion: 2.1 time: 0.167797 Sep 10 12:19:50.956970 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3113/6228] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:50 2022] GET /compute/v2.1/servers/eaa1298b-6554-42d7-b461-451be52ebe04 => generated 1464 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:19:51.980655 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6f178bc6-4c54-41fa-b256-19db7c425d1f tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:51.982682 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6f178bc6-4c54-41fa-b256-19db7c425d1f tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] [instance: eaa1298b-6554-42d7-b461-451be52ebe04] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:51.989203 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f178bc6-4c54-41fa-b256-19db7c425d1f tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:51.990126 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f178bc6-4c54-41fa-b256-19db7c425d1f tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:51.991063 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f178bc6-4c54-41fa-b256-19db7c425d1f tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:51.992441 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f178bc6-4c54-41fa-b256-19db7c425d1f tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:51.992868 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f178bc6-4c54-41fa-b256-19db7c425d1f tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:51.993224 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6f178bc6-4c54-41fa-b256-19db7c425d1f tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:52.273482 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6f178bc6-4c54-41fa-b256-19db7c425d1f tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/eaa1298b-6554-42d7-b461-451be52ebe04" status: 200 len: 1464 microversion: 2.1 time: 0.298553 Sep 10 12:19:52.280953 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3116/6229] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:51 2022] GET /compute/v2.1/servers/eaa1298b-6554-42d7-b461-451be52ebe04 => generated 1464 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:19:52.685493 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-223c7674-132c-46ce-b5a3-80a85b3da4d9 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:52.687746 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-223c7674-132c-46ce-b5a3-80a85b3da4d9 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:52.697384 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-223c7674-132c-46ce-b5a3-80a85b3da4d9 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:52.697880 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-223c7674-132c-46ce-b5a3-80a85b3da4d9 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:52.698325 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-223c7674-132c-46ce-b5a3-80a85b3da4d9 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:52.699028 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-223c7674-132c-46ce-b5a3-80a85b3da4d9 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:52.699543 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-223c7674-132c-46ce-b5a3-80a85b3da4d9 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:52.700038 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-223c7674-132c-46ce-b5a3-80a85b3da4d9 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:52.901347 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-223c7674-132c-46ce-b5a3-80a85b3da4d9 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1832 microversion: 2.1 time: 0.220953 Sep 10 12:19:52.902722 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3114/6230] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:52 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1832 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:19:52.938631 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-53cddd8f-14f2-4b7a-9179-024f7cfd9bb0 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:52.940048 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-53cddd8f-14f2-4b7a-9179-024f7cfd9bb0 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:52.955931 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53cddd8f-14f2-4b7a-9179-024f7cfd9bb0 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:52.957190 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53cddd8f-14f2-4b7a-9179-024f7cfd9bb0 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:52.957817 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53cddd8f-14f2-4b7a-9179-024f7cfd9bb0 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:52.960483 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53cddd8f-14f2-4b7a-9179-024f7cfd9bb0 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:52.960789 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53cddd8f-14f2-4b7a-9179-024f7cfd9bb0 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:52.961908 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-53cddd8f-14f2-4b7a-9179-024f7cfd9bb0 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:53.181851 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-53cddd8f-14f2-4b7a-9179-024f7cfd9bb0 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:19:53.194365 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-53cddd8f-14f2-4b7a-9179-024f7cfd9bb0 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1681 microversion: 2.1 time: 0.265059 Sep 10 12:19:53.195964 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3117/6231] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:52 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1681 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:19:53.301399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2b00c5c5-5e82-41a5-8d77-d7610166df30 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:53.302856 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2b00c5c5-5e82-41a5-8d77-d7610166df30 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] [instance: eaa1298b-6554-42d7-b461-451be52ebe04] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:53.316037 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b00c5c5-5e82-41a5-8d77-d7610166df30 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:53.316541 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b00c5c5-5e82-41a5-8d77-d7610166df30 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:53.316978 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b00c5c5-5e82-41a5-8d77-d7610166df30 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:53.317954 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b00c5c5-5e82-41a5-8d77-d7610166df30 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:53.318952 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b00c5c5-5e82-41a5-8d77-d7610166df30 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:53.320204 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b00c5c5-5e82-41a5-8d77-d7610166df30 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:53.334658 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e6b5d70d-5917-44ae-a9e1-c663cc1a3e8f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:19:53.343691 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e6b5d70d-5917-44ae-a9e1-c663cc1a3e8f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:53.357620 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6b5d70d-5917-44ae-a9e1-c663cc1a3e8f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:53.358141 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6b5d70d-5917-44ae-a9e1-c663cc1a3e8f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:53.359555 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6b5d70d-5917-44ae-a9e1-c663cc1a3e8f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:53.360535 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6b5d70d-5917-44ae-a9e1-c663cc1a3e8f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:53.360947 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6b5d70d-5917-44ae-a9e1-c663cc1a3e8f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:53.361404 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6b5d70d-5917-44ae-a9e1-c663cc1a3e8f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:53.464800 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e6b5d70d-5917-44ae-a9e1-c663cc1a3e8f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "POST /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c/action" status: 200 len: 32650 microversion: 2.1 time: 0.134212 Sep 10 12:19:53.467592 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3118/6232] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:19:53 2022] POST /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c/action => generated 32650 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 12:19:53.571041 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2b00c5c5-5e82-41a5-8d77-d7610166df30 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/eaa1298b-6554-42d7-b461-451be52ebe04" status: 200 len: 1464 microversion: 2.1 time: 0.273668 Sep 10 12:19:53.572442 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3115/6233] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:53 2022] GET /compute/v2.1/servers/eaa1298b-6554-42d7-b461-451be52ebe04 => generated 1464 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:19:53.696579 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-edb553c5-d070-4a1c-a66d-0f75e9183a74 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:19:53.697855 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-edb553c5-d070-4a1c-a66d-0f75e9183a74 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:53.712697 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-edb553c5-d070-4a1c-a66d-0f75e9183a74 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:53.713893 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-edb553c5-d070-4a1c-a66d-0f75e9183a74 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:53.714480 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-edb553c5-d070-4a1c-a66d-0f75e9183a74 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:53.716479 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-edb553c5-d070-4a1c-a66d-0f75e9183a74 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:53.717168 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-edb553c5-d070-4a1c-a66d-0f75e9183a74 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:53.717607 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-edb553c5-d070-4a1c-a66d-0f75e9183a74 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:53.778654 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-edb553c5-d070-4a1c-a66d-0f75e9183a74 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '64835652a9aa4f478aad24a9b7a86031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56aceede5b8f49909ef3334082c453be', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:19:53.779856 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-edb553c5-d070-4a1c-a66d-0f75e9183a74 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] flavor_id is None. Assuming migration. {{(pid=128776) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 10 12:19:53.780518 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-edb553c5-d070-4a1c-a66d-0f75e9183a74 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128776) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 12:19:54.145090 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-edb553c5-d070-4a1c-a66d-0f75e9183a74 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c/action" status: 202 len: 0 microversion: 2.1 time: 0.456269 Sep 10 12:19:54.145732 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3119/6234] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:19:53 2022] POST /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c/action => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:19:54.155327 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4841e4a0-c832-4cb3-9d00-f7085021c588 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:54.156631 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4841e4a0-c832-4cb3-9d00-f7085021c588 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:54.165847 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4841e4a0-c832-4cb3-9d00-f7085021c588 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:54.166642 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4841e4a0-c832-4cb3-9d00-f7085021c588 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:54.168569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4841e4a0-c832-4cb3-9d00-f7085021c588 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:54.171501 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4841e4a0-c832-4cb3-9d00-f7085021c588 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:54.171701 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4841e4a0-c832-4cb3-9d00-f7085021c588 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:54.172314 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4841e4a0-c832-4cb3-9d00-f7085021c588 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:54.354172 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4841e4a0-c832-4cb3-9d00-f7085021c588 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:19:54.365168 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4841e4a0-c832-4cb3-9d00-f7085021c588 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1690 microversion: 2.1 time: 0.214115 Sep 10 12:19:54.366195 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3116/6235] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:54 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1690 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:19:54.606331 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-420694da-6db0-402c-8dab-ef103dcd20b6 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:54.608890 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-420694da-6db0-402c-8dab-ef103dcd20b6 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] [instance: eaa1298b-6554-42d7-b461-451be52ebe04] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:54.619385 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-420694da-6db0-402c-8dab-ef103dcd20b6 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:54.620242 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-420694da-6db0-402c-8dab-ef103dcd20b6 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:54.620978 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-420694da-6db0-402c-8dab-ef103dcd20b6 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:54.622533 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-420694da-6db0-402c-8dab-ef103dcd20b6 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:54.623111 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-420694da-6db0-402c-8dab-ef103dcd20b6 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:54.624513 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-420694da-6db0-402c-8dab-ef103dcd20b6 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:54.838506 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-420694da-6db0-402c-8dab-ef103dcd20b6 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/eaa1298b-6554-42d7-b461-451be52ebe04" status: 200 len: 1464 microversion: 2.1 time: 0.236140 Sep 10 12:19:54.839106 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3120/6236] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:54 2022] GET /compute/v2.1/servers/eaa1298b-6554-42d7-b461-451be52ebe04 => generated 1464 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:19:55.330379 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-a8150cd6-b342-4978-ac5a-d7b2089a83b3 req-b1ee5864-0bd2-4f64-9e86-b3f499936a68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaa1298b-6554-42d7-b461-451be52ebe04", "name": "network-vif-plugged", "status": "completed", "tag": "e04f949a-b4da-40b8-93dd-c1a11896a5aa"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:19:55.362020 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a8150cd6-b342-4978-ac5a-d7b2089a83b3 req-b1ee5864-0bd2-4f64-9e86-b3f499936a68 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:55.366915 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a8150cd6-b342-4978-ac5a-d7b2089a83b3 req-b1ee5864-0bd2-4f64-9e86-b3f499936a68 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:55.367994 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a8150cd6-b342-4978-ac5a-d7b2089a83b3 req-b1ee5864-0bd2-4f64-9e86-b3f499936a68 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:55.395325 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-a8150cd6-b342-4978-ac5a-d7b2089a83b3 req-b1ee5864-0bd2-4f64-9e86-b3f499936a68 service nova] Creating event network-vif-plugged:e04f949a-b4da-40b8-93dd-c1a11896a5aa for instance eaa1298b-6554-42d7-b461-451be52ebe04 on n-h2-856895-1 Sep 10 12:19:55.404559 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8da579a4-5fd0-4a36-b098-d19d0b548610 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:55.405455 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8da579a4-5fd0-4a36-b098-d19d0b548610 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:55.414391 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-a8150cd6-b342-4978-ac5a-d7b2089a83b3 req-b1ee5864-0bd2-4f64-9e86-b3f499936a68 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095767 Sep 10 12:19:55.415771 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3117/6237] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:19:55.417531 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8da579a4-5fd0-4a36-b098-d19d0b548610 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:55.418925 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8da579a4-5fd0-4a36-b098-d19d0b548610 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:55.419959 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8da579a4-5fd0-4a36-b098-d19d0b548610 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:55.422426 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8da579a4-5fd0-4a36-b098-d19d0b548610 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:55.425122 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8da579a4-5fd0-4a36-b098-d19d0b548610 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:55.425856 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8da579a4-5fd0-4a36-b098-d19d0b548610 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:55.788298 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8da579a4-5fd0-4a36-b098-d19d0b548610 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:19:55.796605 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8da579a4-5fd0-4a36-b098-d19d0b548610 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1690 microversion: 2.1 time: 0.396183 Sep 10 12:19:55.797285 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3121/6238] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:55 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1690 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:19:55.866194 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4fbb4644-d684-4b7e-ab2f-a48bb62f42cb tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:55.866902 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4fbb4644-d684-4b7e-ab2f-a48bb62f42cb tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] [instance: eaa1298b-6554-42d7-b461-451be52ebe04] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:55.873827 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4fbb4644-d684-4b7e-ab2f-a48bb62f42cb tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:55.874314 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4fbb4644-d684-4b7e-ab2f-a48bb62f42cb tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:55.874751 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4fbb4644-d684-4b7e-ab2f-a48bb62f42cb tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:55.875507 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4fbb4644-d684-4b7e-ab2f-a48bb62f42cb tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:55.875992 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4fbb4644-d684-4b7e-ab2f-a48bb62f42cb tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:55.876613 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4fbb4644-d684-4b7e-ab2f-a48bb62f42cb tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:56.011497 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4fbb4644-d684-4b7e-ab2f-a48bb62f42cb tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/eaa1298b-6554-42d7-b461-451be52ebe04" status: 200 len: 1464 microversion: 2.1 time: 0.149228 Sep 10 12:19:56.012385 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3118/6239] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:55 2022] GET /compute/v2.1/servers/eaa1298b-6554-42d7-b461-451be52ebe04 => generated 1464 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:19:56.820761 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-01f7185e-46e6-431c-a050-968922ed1bbf tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:56.821380 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-01f7185e-46e6-431c-a050-968922ed1bbf tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:56.828739 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01f7185e-46e6-431c-a050-968922ed1bbf tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:56.829556 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01f7185e-46e6-431c-a050-968922ed1bbf tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:56.830395 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01f7185e-46e6-431c-a050-968922ed1bbf tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:56.831334 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01f7185e-46e6-431c-a050-968922ed1bbf tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:56.831966 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01f7185e-46e6-431c-a050-968922ed1bbf tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:56.832568 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01f7185e-46e6-431c-a050-968922ed1bbf tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:57.002617 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-01f7185e-46e6-431c-a050-968922ed1bbf tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:19:57.011153 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-01f7185e-46e6-431c-a050-968922ed1bbf tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1690 microversion: 2.1 time: 0.194192 Sep 10 12:19:57.012314 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3122/6240] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:56 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1690 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:19:57.035938 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d9938373-65f3-4c26-b18f-1f040c5b74e7 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:57.037322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d9938373-65f3-4c26-b18f-1f040c5b74e7 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] [instance: eaa1298b-6554-42d7-b461-451be52ebe04] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:57.039503 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:19:57.047714 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d9938373-65f3-4c26-b18f-1f040c5b74e7 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:57.048224 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d9938373-65f3-4c26-b18f-1f040c5b74e7 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:57.048780 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d9938373-65f3-4c26-b18f-1f040c5b74e7 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:57.049666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d9938373-65f3-4c26-b18f-1f040c5b74e7 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:57.050164 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d9938373-65f3-4c26-b18f-1f040c5b74e7 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:57.050581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d9938373-65f3-4c26-b18f-1f040c5b74e7 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:57.201436 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d9938373-65f3-4c26-b18f-1f040c5b74e7 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/eaa1298b-6554-42d7-b461-451be52ebe04" status: 200 len: 1650 microversion: 2.1 time: 0.169673 Sep 10 12:19:57.201812 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3119/6241] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:57 2022] GET /compute/v2.1/servers/eaa1298b-6554-42d7-b461-451be52ebe04 => generated 1650 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:19:57.224461 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-55b662dd-7e6c-4682-84e6-fcc3bb3a7f25 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:57.224937 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-55b662dd-7e6c-4682-84e6-fcc3bb3a7f25 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] [instance: eaa1298b-6554-42d7-b461-451be52ebe04] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:57.229133 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:19:57.230025 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:19:57.236002 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55b662dd-7e6c-4682-84e6-fcc3bb3a7f25 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:57.236697 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55b662dd-7e6c-4682-84e6-fcc3bb3a7f25 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:57.237426 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55b662dd-7e6c-4682-84e6-fcc3bb3a7f25 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:57.238020 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55b662dd-7e6c-4682-84e6-fcc3bb3a7f25 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:57.238652 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55b662dd-7e6c-4682-84e6-fcc3bb3a7f25 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:57.239081 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55b662dd-7e6c-4682-84e6-fcc3bb3a7f25 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:57.383737 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-55b662dd-7e6c-4682-84e6-fcc3bb3a7f25 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/eaa1298b-6554-42d7-b461-451be52ebe04" status: 200 len: 1650 microversion: 2.1 time: 0.163034 Sep 10 12:19:57.384326 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3123/6242] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:57 2022] GET /compute/v2.1/servers/eaa1298b-6554-42d7-b461-451be52ebe04 => generated 1650 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:19:57.408131 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7affa1c5-7626-424f-827a-9e5aa8ea1d99 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:57.409554 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7affa1c5-7626-424f-827a-9e5aa8ea1d99 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] [instance: eaa1298b-6554-42d7-b461-451be52ebe04] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:57.411506 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:19:57.417049 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7affa1c5-7626-424f-827a-9e5aa8ea1d99 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:57.417535 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7affa1c5-7626-424f-827a-9e5aa8ea1d99 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:57.417982 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7affa1c5-7626-424f-827a-9e5aa8ea1d99 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:57.419273 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7affa1c5-7626-424f-827a-9e5aa8ea1d99 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:57.419736 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7affa1c5-7626-424f-827a-9e5aa8ea1d99 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:57.420164 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7affa1c5-7626-424f-827a-9e5aa8ea1d99 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:57.553315 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7affa1c5-7626-424f-827a-9e5aa8ea1d99 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/eaa1298b-6554-42d7-b461-451be52ebe04" status: 200 len: 1650 microversion: 2.1 time: 0.151355 Sep 10 12:19:57.553901 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3120/6243] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:57 2022] GET /compute/v2.1/servers/eaa1298b-6554-42d7-b461-451be52ebe04 => generated 1650 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:19:57.614414 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8efb8d92-4b9d-4d55-9d0a-1f91953d4481 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1594414207", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "availability_zone": "nova:n-h1-856895-1", "networks": [{"uuid": "22fe7d46-1f84-4376-b821-31c4162450fa"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:19:57.674515 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-8efb8d92-4b9d-4d55-9d0a-1f91953d4481 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] validate_networks() for [('22fe7d46-1f84-4376-b821-31c4162450fa', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:19:58.036413 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d64f6958-657c-4114-b3ae-6074fd0feb5c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:58.036913 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-8efb8d92-4b9d-4d55-9d0a-1f91953d4481 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:19:58.037271 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d64f6958-657c-4114-b3ae-6074fd0feb5c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:58.037357 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-8efb8d92-4b9d-4d55-9d0a-1f91953d4481 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:19:58.037753 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-8efb8d92-4b9d-4d55-9d0a-1f91953d4481 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:19:58.038167 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-8efb8d92-4b9d-4d55-9d0a-1f91953d4481 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:19:58.038917 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-8efb8d92-4b9d-4d55-9d0a-1f91953d4481 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:19:58.044908 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d64f6958-657c-4114-b3ae-6074fd0feb5c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:58.045474 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d64f6958-657c-4114-b3ae-6074fd0feb5c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:58.045839 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d64f6958-657c-4114-b3ae-6074fd0feb5c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:58.046812 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d64f6958-657c-4114-b3ae-6074fd0feb5c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:58.047004 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d64f6958-657c-4114-b3ae-6074fd0feb5c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:58.047435 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d64f6958-657c-4114-b3ae-6074fd0feb5c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:58.049006 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8efb8d92-4b9d-4d55-9d0a-1f91953d4481 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:58.049652 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8efb8d92-4b9d-4d55-9d0a-1f91953d4481 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:58.050100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8efb8d92-4b9d-4d55-9d0a-1f91953d4481 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:58.050831 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8efb8d92-4b9d-4d55-9d0a-1f91953d4481 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:58.052708 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8efb8d92-4b9d-4d55-9d0a-1f91953d4481 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:58.052708 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8efb8d92-4b9d-4d55-9d0a-1f91953d4481 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:58.070793 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-8efb8d92-4b9d-4d55-9d0a-1f91953d4481 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Getting quotas for project 055a7454feb24da4a800e7e59138da5e. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:19:58.076555 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-8efb8d92-4b9d-4d55-9d0a-1f91953d4481 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Getting quotas for user ff647004c0b04d7d98d196ee692da0d6 and project 055a7454feb24da4a800e7e59138da5e. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:19:58.090672 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8efb8d92-4b9d-4d55-9d0a-1f91953d4481 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:19:58.093144 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8efb8d92-4b9d-4d55-9d0a-1f91953d4481 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] [instance: 0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:19:58.160850 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8efb8d92-4b9d-4d55-9d0a-1f91953d4481 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.550084 Sep 10 12:19:58.162096 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3124/6244] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:19:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:19:58.173650 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b5af15f8-c28b-4915-bf39-ee7461192c27 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:58.174284 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b5af15f8-c28b-4915-bf39-ee7461192c27 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] [instance: 0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:58.225990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d64f6958-657c-4114-b3ae-6074fd0feb5c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:19:58.236433 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d64f6958-657c-4114-b3ae-6074fd0feb5c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1695 microversion: 2.1 time: 0.203924 Sep 10 12:19:58.237678 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3121/6245] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:58 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1695 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:19:58.258373 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b5af15f8-c28b-4915-bf39-ee7461192c27 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b" status: 200 len: 1329 microversion: 2.1 time: 0.088370 Sep 10 12:19:58.259283 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3125/6246] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:58 2022] GET /compute/v2.1/servers/0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b => generated 1329 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:19:59.261174 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-979218fa-13e1-40be-b333-c66e36d3125f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:59.261806 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-979218fa-13e1-40be-b333-c66e36d3125f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:59.269292 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-979218fa-13e1-40be-b333-c66e36d3125f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:59.269837 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-979218fa-13e1-40be-b333-c66e36d3125f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:59.270283 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-979218fa-13e1-40be-b333-c66e36d3125f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:59.271005 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-979218fa-13e1-40be-b333-c66e36d3125f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:59.271494 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-979218fa-13e1-40be-b333-c66e36d3125f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:59.271931 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-979218fa-13e1-40be-b333-c66e36d3125f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:59.282122 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d51d8f61-5556-4101-a37d-573ac3084864 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:19:59.282780 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d51d8f61-5556-4101-a37d-573ac3084864 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] [instance: 0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:19:59.290078 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d51d8f61-5556-4101-a37d-573ac3084864 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:59.290548 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d51d8f61-5556-4101-a37d-573ac3084864 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:59.291058 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d51d8f61-5556-4101-a37d-573ac3084864 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:59.291891 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d51d8f61-5556-4101-a37d-573ac3084864 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:19:59.292429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d51d8f61-5556-4101-a37d-573ac3084864 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:19:59.292869 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d51d8f61-5556-4101-a37d-573ac3084864 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:19:59.390135 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d51d8f61-5556-4101-a37d-573ac3084864 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b" status: 200 len: 1424 microversion: 2.1 time: 0.111809 Sep 10 12:19:59.406618 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3126/6247] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:59 2022] GET /compute/v2.1/servers/0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b => generated 1424 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:19:59.451888 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-979218fa-13e1-40be-b333-c66e36d3125f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:19:59.459947 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-979218fa-13e1-40be-b333-c66e36d3125f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1695 microversion: 2.1 time: 0.202901 Sep 10 12:19:59.460624 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3122/6248] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:19:59 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1695 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:20:00.414716 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9794dda9-4e65-424b-a7f1-a1cc16a606a7 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:00.416003 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9794dda9-4e65-424b-a7f1-a1cc16a606a7 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] [instance: 0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:00.426575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9794dda9-4e65-424b-a7f1-a1cc16a606a7 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:00.427427 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9794dda9-4e65-424b-a7f1-a1cc16a606a7 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:00.427955 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9794dda9-4e65-424b-a7f1-a1cc16a606a7 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:00.428731 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9794dda9-4e65-424b-a7f1-a1cc16a606a7 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:00.429258 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9794dda9-4e65-424b-a7f1-a1cc16a606a7 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:00.429750 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9794dda9-4e65-424b-a7f1-a1cc16a606a7 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:00.485643 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-34f3a63f-6349-4eb8-8ed8-a73036b5a35a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:00.486178 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-34f3a63f-6349-4eb8-8ed8-a73036b5a35a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:00.495747 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-34f3a63f-6349-4eb8-8ed8-a73036b5a35a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:00.497017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-34f3a63f-6349-4eb8-8ed8-a73036b5a35a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:00.498858 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-34f3a63f-6349-4eb8-8ed8-a73036b5a35a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:00.499693 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-34f3a63f-6349-4eb8-8ed8-a73036b5a35a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:00.500267 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-34f3a63f-6349-4eb8-8ed8-a73036b5a35a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:00.500709 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-34f3a63f-6349-4eb8-8ed8-a73036b5a35a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:00.630904 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9794dda9-4e65-424b-a7f1-a1cc16a606a7 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b" status: 200 len: 1464 microversion: 2.1 time: 0.220924 Sep 10 12:20:00.632175 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3127/6249] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:20:00 2022] GET /compute/v2.1/servers/0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b => generated 1464 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:20:00.665598 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-a04358c1-9f57-423b-92e6-27d91beb8cfb req-a0061c3b-8b6e-4f8a-aa36-2af6bd008a65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b", "tag": "a707f848-bcf9-43e3-8930-527cf233c04f"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:20:00.683655 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a04358c1-9f57-423b-92e6-27d91beb8cfb req-a0061c3b-8b6e-4f8a-aa36-2af6bd008a65 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:00.684407 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a04358c1-9f57-423b-92e6-27d91beb8cfb req-a0061c3b-8b6e-4f8a-aa36-2af6bd008a65 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:00.685045 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-a04358c1-9f57-423b-92e6-27d91beb8cfb req-a0061c3b-8b6e-4f8a-aa36-2af6bd008a65 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:00.710894 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-a04358c1-9f57-423b-92e6-27d91beb8cfb req-a0061c3b-8b6e-4f8a-aa36-2af6bd008a65 service nova] Creating event network-changed:a707f848-bcf9-43e3-8930-527cf233c04f for instance 0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b on n-h1-856895-1 Sep 10 12:20:00.716923 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-a04358c1-9f57-423b-92e6-27d91beb8cfb req-a0061c3b-8b6e-4f8a-aa36-2af6bd008a65 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064137 Sep 10 12:20:00.717979 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3128/6250] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:20:00.721574 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-34f3a63f-6349-4eb8-8ed8-a73036b5a35a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:20:00.730369 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-34f3a63f-6349-4eb8-8ed8-a73036b5a35a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1695 microversion: 2.1 time: 0.250174 Sep 10 12:20:00.730967 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3123/6251] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:20:00 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1695 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:20:01.669673 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4ff3985a-46a0-44a1-b1d3-4837186e775d tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:01.670394 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4ff3985a-46a0-44a1-b1d3-4837186e775d tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] [instance: 0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:01.677218 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ff3985a-46a0-44a1-b1d3-4837186e775d tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:01.677717 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ff3985a-46a0-44a1-b1d3-4837186e775d tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:01.678164 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ff3985a-46a0-44a1-b1d3-4837186e775d tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:01.678876 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ff3985a-46a0-44a1-b1d3-4837186e775d tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:01.679373 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ff3985a-46a0-44a1-b1d3-4837186e775d tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:01.679812 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ff3985a-46a0-44a1-b1d3-4837186e775d tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:01.755403 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c76c3d8c-a2c8-43e4-bf15-f4b705a2d010 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:01.755788 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c76c3d8c-a2c8-43e4-bf15-f4b705a2d010 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:01.762467 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c76c3d8c-a2c8-43e4-bf15-f4b705a2d010 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:01.763615 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c76c3d8c-a2c8-43e4-bf15-f4b705a2d010 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:01.764308 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c76c3d8c-a2c8-43e4-bf15-f4b705a2d010 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:01.765028 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c76c3d8c-a2c8-43e4-bf15-f4b705a2d010 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:01.765522 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c76c3d8c-a2c8-43e4-bf15-f4b705a2d010 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:01.766217 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c76c3d8c-a2c8-43e4-bf15-f4b705a2d010 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:01.834159 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4ff3985a-46a0-44a1-b1d3-4837186e775d tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b" status: 200 len: 1464 microversion: 2.1 time: 0.169433 Sep 10 12:20:01.834757 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3129/6252] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:20:01 2022] GET /compute/v2.1/servers/0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b => generated 1464 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:20:01.919501 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c76c3d8c-a2c8-43e4-bf15-f4b705a2d010 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:20:01.927226 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c76c3d8c-a2c8-43e4-bf15-f4b705a2d010 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1695 microversion: 2.1 time: 0.176714 Sep 10 12:20:01.927803 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3124/6253] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:20:01 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1695 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:20:02.856382 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d9fb594b-a9ef-4922-9edd-5eb8b4e3ddf0 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:02.857290 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d9fb594b-a9ef-4922-9edd-5eb8b4e3ddf0 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] [instance: 0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:02.864227 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d9fb594b-a9ef-4922-9edd-5eb8b4e3ddf0 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:02.864708 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d9fb594b-a9ef-4922-9edd-5eb8b4e3ddf0 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:02.865148 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d9fb594b-a9ef-4922-9edd-5eb8b4e3ddf0 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:02.865838 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d9fb594b-a9ef-4922-9edd-5eb8b4e3ddf0 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:02.866290 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d9fb594b-a9ef-4922-9edd-5eb8b4e3ddf0 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:02.866717 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d9fb594b-a9ef-4922-9edd-5eb8b4e3ddf0 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:02.952673 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-34dcdcdf-6625-4a30-b8a8-ccef9b7cb097 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:02.953846 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-34dcdcdf-6625-4a30-b8a8-ccef9b7cb097 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:02.963371 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-34dcdcdf-6625-4a30-b8a8-ccef9b7cb097 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:02.963874 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-34dcdcdf-6625-4a30-b8a8-ccef9b7cb097 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:02.964325 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-34dcdcdf-6625-4a30-b8a8-ccef9b7cb097 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:02.965041 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-34dcdcdf-6625-4a30-b8a8-ccef9b7cb097 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:02.965638 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-34dcdcdf-6625-4a30-b8a8-ccef9b7cb097 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:02.966871 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-34dcdcdf-6625-4a30-b8a8-ccef9b7cb097 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:03.014799 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d9fb594b-a9ef-4922-9edd-5eb8b4e3ddf0 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b" status: 200 len: 1464 microversion: 2.1 time: 0.162132 Sep 10 12:20:03.028386 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3130/6254] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:20:02 2022] GET /compute/v2.1/servers/0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b => generated 1464 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:20:03.172653 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-34dcdcdf-6625-4a30-b8a8-ccef9b7cb097 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:20:03.186185 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-34dcdcdf-6625-4a30-b8a8-ccef9b7cb097 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1695 microversion: 2.1 time: 0.238554 Sep 10 12:20:03.187135 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3125/6255] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:20:02 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1695 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:20:04.051461 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2568250e-f5f4-4be4-8580-455cb960a74c tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:04.052192 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2568250e-f5f4-4be4-8580-455cb960a74c tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] [instance: 0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:04.060197 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2568250e-f5f4-4be4-8580-455cb960a74c tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:04.060907 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2568250e-f5f4-4be4-8580-455cb960a74c tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:04.061399 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2568250e-f5f4-4be4-8580-455cb960a74c tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:04.062111 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2568250e-f5f4-4be4-8580-455cb960a74c tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:04.062571 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2568250e-f5f4-4be4-8580-455cb960a74c tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:04.063002 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2568250e-f5f4-4be4-8580-455cb960a74c tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:04.196269 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:20:04.201455 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2568250e-f5f4-4be4-8580-455cb960a74c tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b" status: 200 len: 1464 microversion: 2.1 time: 0.153840 Sep 10 12:20:04.202055 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3131/6256] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:20:04 2022] GET /compute/v2.1/servers/0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b => generated 1464 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:20:04.210075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d289c19a-10ff-4147-84e3-5a0d21625adc tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:04.210843 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d289c19a-10ff-4147-84e3-5a0d21625adc tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:04.218687 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d289c19a-10ff-4147-84e3-5a0d21625adc tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:04.219442 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d289c19a-10ff-4147-84e3-5a0d21625adc tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:04.220106 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d289c19a-10ff-4147-84e3-5a0d21625adc tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:04.221096 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d289c19a-10ff-4147-84e3-5a0d21625adc tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:04.221625 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d289c19a-10ff-4147-84e3-5a0d21625adc tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:04.222293 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d289c19a-10ff-4147-84e3-5a0d21625adc tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:04.382331 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d289c19a-10ff-4147-84e3-5a0d21625adc tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:20:04.392704 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d289c19a-10ff-4147-84e3-5a0d21625adc tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1695 microversion: 2.1 time: 0.186467 Sep 10 12:20:04.394082 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3126/6257] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:20:04 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1695 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:20:05.225736 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b4f3ca74-fae3-483d-b703-6347190d1c0a tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:05.226366 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b4f3ca74-fae3-483d-b703-6347190d1c0a tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] [instance: 0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:05.235557 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b4f3ca74-fae3-483d-b703-6347190d1c0a tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:05.236053 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b4f3ca74-fae3-483d-b703-6347190d1c0a tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:05.236496 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b4f3ca74-fae3-483d-b703-6347190d1c0a tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:05.237199 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b4f3ca74-fae3-483d-b703-6347190d1c0a tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:05.237736 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b4f3ca74-fae3-483d-b703-6347190d1c0a tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:05.238173 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b4f3ca74-fae3-483d-b703-6347190d1c0a tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:05.365650 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b4f3ca74-fae3-483d-b703-6347190d1c0a tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b" status: 200 len: 1464 microversion: 2.1 time: 0.143707 Sep 10 12:20:05.366461 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3132/6258] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:20:05 2022] GET /compute/v2.1/servers/0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b => generated 1464 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:20:05.417137 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f282b708-9ee8-49e1-85fa-37f264c2c62e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:05.417777 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f282b708-9ee8-49e1-85fa-37f264c2c62e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:05.425593 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f282b708-9ee8-49e1-85fa-37f264c2c62e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:05.426072 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f282b708-9ee8-49e1-85fa-37f264c2c62e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:05.426511 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f282b708-9ee8-49e1-85fa-37f264c2c62e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:05.427279 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f282b708-9ee8-49e1-85fa-37f264c2c62e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:05.427744 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f282b708-9ee8-49e1-85fa-37f264c2c62e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:05.428169 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f282b708-9ee8-49e1-85fa-37f264c2c62e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:05.569931 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f282b708-9ee8-49e1-85fa-37f264c2c62e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:20:05.578255 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f282b708-9ee8-49e1-85fa-37f264c2c62e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1695 microversion: 2.1 time: 0.165015 Sep 10 12:20:05.578860 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3127/6259] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:20:05 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1695 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:20:06.345397 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-fe73887a-6b83-4419-bbf9-73903bd433d4 req-d418a7bf-056b-4dd5-82e6-e1d63922972e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b", "name": "network-vif-plugged", "status": "completed", "tag": "a707f848-bcf9-43e3-8930-527cf233c04f"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:20:06.358547 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-fe73887a-6b83-4419-bbf9-73903bd433d4 req-d418a7bf-056b-4dd5-82e6-e1d63922972e service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:06.359257 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-fe73887a-6b83-4419-bbf9-73903bd433d4 req-d418a7bf-056b-4dd5-82e6-e1d63922972e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:06.359965 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-fe73887a-6b83-4419-bbf9-73903bd433d4 req-d418a7bf-056b-4dd5-82e6-e1d63922972e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:06.374832 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-fe73887a-6b83-4419-bbf9-73903bd433d4 req-d418a7bf-056b-4dd5-82e6-e1d63922972e service nova] Creating event network-vif-plugged:a707f848-bcf9-43e3-8930-527cf233c04f for instance 0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b on n-h1-856895-1 Sep 10 12:20:06.382000 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-fe73887a-6b83-4419-bbf9-73903bd433d4 req-d418a7bf-056b-4dd5-82e6-e1d63922972e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041593 Sep 10 12:20:06.382915 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3133/6260] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:20:06.394667 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7b624119-6a42-4326-a12c-4bf33f620097 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:06.395978 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7b624119-6a42-4326-a12c-4bf33f620097 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] [instance: 0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:06.401855 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b624119-6a42-4326-a12c-4bf33f620097 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:06.402356 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b624119-6a42-4326-a12c-4bf33f620097 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:06.402822 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b624119-6a42-4326-a12c-4bf33f620097 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:06.404397 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b624119-6a42-4326-a12c-4bf33f620097 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:06.404846 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b624119-6a42-4326-a12c-4bf33f620097 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:06.405288 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b624119-6a42-4326-a12c-4bf33f620097 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:06.585333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=100 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:20:06.591699 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7b624119-6a42-4326-a12c-4bf33f620097 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b" status: 200 len: 1464 microversion: 2.1 time: 0.202375 Sep 10 12:20:06.592302 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3128/6261] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:20:06 2022] GET /compute/v2.1/servers/0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b => generated 1464 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:20:06.611673 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c0974fa4-918e-4489-8dae-033c4b74647f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:06.612869 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c0974fa4-918e-4489-8dae-033c4b74647f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:06.619214 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0974fa4-918e-4489-8dae-033c4b74647f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:06.619838 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0974fa4-918e-4489-8dae-033c4b74647f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:06.620366 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0974fa4-918e-4489-8dae-033c4b74647f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:06.621183 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0974fa4-918e-4489-8dae-033c4b74647f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:06.621792 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0974fa4-918e-4489-8dae-033c4b74647f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:06.622969 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0974fa4-918e-4489-8dae-033c4b74647f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:06.762694 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c0974fa4-918e-4489-8dae-033c4b74647f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:20:06.771388 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c0974fa4-918e-4489-8dae-033c4b74647f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1695 microversion: 2.1 time: 0.173177 Sep 10 12:20:06.772444 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3134/6262] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:20:06 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1695 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:20:07.614240 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e33cd47c-cfc0-40d1-9280-bd76d2a731d8 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:07.614884 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e33cd47c-cfc0-40d1-9280-bd76d2a731d8 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] [instance: 0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:07.623017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e33cd47c-cfc0-40d1-9280-bd76d2a731d8 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:07.623742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e33cd47c-cfc0-40d1-9280-bd76d2a731d8 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:07.624325 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e33cd47c-cfc0-40d1-9280-bd76d2a731d8 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:07.625025 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e33cd47c-cfc0-40d1-9280-bd76d2a731d8 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:07.625490 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e33cd47c-cfc0-40d1-9280-bd76d2a731d8 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:07.625922 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e33cd47c-cfc0-40d1-9280-bd76d2a731d8 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:07.761581 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e33cd47c-cfc0-40d1-9280-bd76d2a731d8 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b" status: 200 len: 1464 microversion: 2.1 time: 0.151335 Sep 10 12:20:07.762310 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3129/6263] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:20:07 2022] GET /compute/v2.1/servers/0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b => generated 1464 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:20:07.797712 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-40bf2d86-50f6-4e5f-87ac-af9eddf323b7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:07.799106 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-40bf2d86-50f6-4e5f-87ac-af9eddf323b7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:07.806679 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-40bf2d86-50f6-4e5f-87ac-af9eddf323b7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:07.808106 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-40bf2d86-50f6-4e5f-87ac-af9eddf323b7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:07.808532 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-40bf2d86-50f6-4e5f-87ac-af9eddf323b7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:07.809396 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-40bf2d86-50f6-4e5f-87ac-af9eddf323b7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:07.809905 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-40bf2d86-50f6-4e5f-87ac-af9eddf323b7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:07.810346 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-40bf2d86-50f6-4e5f-87ac-af9eddf323b7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:07.956468 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-40bf2d86-50f6-4e5f-87ac-af9eddf323b7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:20:07.971093 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-40bf2d86-50f6-4e5f-87ac-af9eddf323b7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1695 microversion: 2.1 time: 0.178555 Sep 10 12:20:07.972239 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3135/6264] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:20:07 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1695 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:20:08.786406 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-168897b9-7925-4331-92e7-992cf35ff592 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:08.787046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-168897b9-7925-4331-92e7-992cf35ff592 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] [instance: 0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:08.794243 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-168897b9-7925-4331-92e7-992cf35ff592 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:08.794737 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-168897b9-7925-4331-92e7-992cf35ff592 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:08.795203 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-168897b9-7925-4331-92e7-992cf35ff592 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:08.796161 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-168897b9-7925-4331-92e7-992cf35ff592 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:08.796864 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-168897b9-7925-4331-92e7-992cf35ff592 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:08.797399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-168897b9-7925-4331-92e7-992cf35ff592 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:08.936384 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-168897b9-7925-4331-92e7-992cf35ff592 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b" status: 200 len: 1649 microversion: 2.1 time: 0.153761 Sep 10 12:20:08.947713 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3130/6265] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:20:08 2022] GET /compute/v2.1/servers/0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b => generated 1649 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:20:08.960899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-35deb575-36b8-4ef7-b252-b20750a5e6ef tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:08.961667 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-35deb575-36b8-4ef7-b252-b20750a5e6ef tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] [instance: 0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:08.967174 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:20:08.967886 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=8 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:20:08.970849 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-35deb575-36b8-4ef7-b252-b20750a5e6ef tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:08.971544 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-35deb575-36b8-4ef7-b252-b20750a5e6ef tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:08.971991 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-35deb575-36b8-4ef7-b252-b20750a5e6ef tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:08.972723 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-35deb575-36b8-4ef7-b252-b20750a5e6ef tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:08.973423 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-35deb575-36b8-4ef7-b252-b20750a5e6ef tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:08.973918 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-35deb575-36b8-4ef7-b252-b20750a5e6ef tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:08.996345 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fc74d1fb-08f3-4210-a672-b07a56aa7e34 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:08.998742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fc74d1fb-08f3-4210-a672-b07a56aa7e34 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:09.005553 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc74d1fb-08f3-4210-a672-b07a56aa7e34 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:09.008337 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc74d1fb-08f3-4210-a672-b07a56aa7e34 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:09.008337 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc74d1fb-08f3-4210-a672-b07a56aa7e34 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:09.008337 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc74d1fb-08f3-4210-a672-b07a56aa7e34 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:09.008337 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc74d1fb-08f3-4210-a672-b07a56aa7e34 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:09.008337 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc74d1fb-08f3-4210-a672-b07a56aa7e34 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:09.181471 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-35deb575-36b8-4ef7-b252-b20750a5e6ef tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b" status: 200 len: 1649 microversion: 2.1 time: 0.224494 Sep 10 12:20:09.196262 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3136/6266] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:20:08 2022] GET /compute/v2.1/servers/0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b => generated 1649 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:20:09.203484 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fc74d1fb-08f3-4210-a672-b07a56aa7e34 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:20:09.207115 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-85e4ed55-0e41-4664-8125-3f75d3775a07 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:09.208050 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-85e4ed55-0e41-4664-8125-3f75d3775a07 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] [instance: 0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:09.211988 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fc74d1fb-08f3-4210-a672-b07a56aa7e34 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1695 microversion: 2.1 time: 0.220106 Sep 10 12:20:09.214247 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85e4ed55-0e41-4664-8125-3f75d3775a07 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:09.214803 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85e4ed55-0e41-4664-8125-3f75d3775a07 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:09.215341 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85e4ed55-0e41-4664-8125-3f75d3775a07 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:09.216165 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85e4ed55-0e41-4664-8125-3f75d3775a07 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:09.216721 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85e4ed55-0e41-4664-8125-3f75d3775a07 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:09.217219 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-85e4ed55-0e41-4664-8125-3f75d3775a07 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:09.225662 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3131/6267] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:20:08 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1695 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:20:09.355835 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-85e4ed55-0e41-4664-8125-3f75d3775a07 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b" status: 200 len: 1649 microversion: 2.1 time: 0.152818 Sep 10 12:20:09.357509 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3137/6268] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:20:09 2022] GET /compute/v2.1/servers/0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b => generated 1649 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:20:09.379591 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8824503f-eb32-4967-aad2-51aec7011848 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:09.380333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8824503f-eb32-4967-aad2-51aec7011848 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] [instance: 0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:09.386807 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8824503f-eb32-4967-aad2-51aec7011848 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:09.387306 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8824503f-eb32-4967-aad2-51aec7011848 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:09.387992 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8824503f-eb32-4967-aad2-51aec7011848 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:09.388758 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8824503f-eb32-4967-aad2-51aec7011848 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:09.389226 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8824503f-eb32-4967-aad2-51aec7011848 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:09.389663 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8824503f-eb32-4967-aad2-51aec7011848 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:09.418313 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8824503f-eb32-4967-aad2-51aec7011848 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] [instance: 0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:20:09.503733 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8824503f-eb32-4967-aad2-51aec7011848 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] 10.222.0.23 "DELETE /compute/v2.1/servers/0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b" status: 204 len: 0 microversion: 2.1 time: 0.127308 Sep 10 12:20:09.507463 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3132/6269] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:20:09 2022] DELETE /compute/v2.1/servers/0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:20:09.512395 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c0b9e8d9-3c64-4dd0-a13f-5148561e4a2d tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:09.513178 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c0b9e8d9-3c64-4dd0-a13f-5148561e4a2d tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] [instance: 0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:09.519716 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0b9e8d9-3c64-4dd0-a13f-5148561e4a2d tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:09.520199 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0b9e8d9-3c64-4dd0-a13f-5148561e4a2d tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:09.520637 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0b9e8d9-3c64-4dd0-a13f-5148561e4a2d tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:09.521344 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0b9e8d9-3c64-4dd0-a13f-5148561e4a2d tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:09.521810 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0b9e8d9-3c64-4dd0-a13f-5148561e4a2d tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:09.522234 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0b9e8d9-3c64-4dd0-a13f-5148561e4a2d tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:09.655377 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c0b9e8d9-3c64-4dd0-a13f-5148561e4a2d tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b" status: 200 len: 1655 microversion: 2.1 time: 0.146651 Sep 10 12:20:09.656165 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3138/6270] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:20:09 2022] GET /compute/v2.1/servers/0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b => generated 1655 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:20:10.238044 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-735e0207-647a-4403-a080-5c6a175517bb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:10.238754 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-735e0207-647a-4403-a080-5c6a175517bb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:10.245819 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-735e0207-647a-4403-a080-5c6a175517bb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:10.246291 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-735e0207-647a-4403-a080-5c6a175517bb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:10.246997 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-735e0207-647a-4403-a080-5c6a175517bb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:10.248265 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-735e0207-647a-4403-a080-5c6a175517bb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:10.248715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-735e0207-647a-4403-a080-5c6a175517bb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:10.249276 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-735e0207-647a-4403-a080-5c6a175517bb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:10.397937 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-735e0207-647a-4403-a080-5c6a175517bb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:20:10.406032 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-735e0207-647a-4403-a080-5c6a175517bb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1695 microversion: 2.1 time: 0.172544 Sep 10 12:20:10.406614 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3133/6271] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:20:10 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1695 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:20:10.679106 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-279e9f4e-62c2-4424-aba0-0bc2803cba6f tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:10.679750 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-279e9f4e-62c2-4424-aba0-0bc2803cba6f tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] [instance: 0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:10.686756 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-279e9f4e-62c2-4424-aba0-0bc2803cba6f tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:10.687272 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-279e9f4e-62c2-4424-aba0-0bc2803cba6f tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:10.687710 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-279e9f4e-62c2-4424-aba0-0bc2803cba6f tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:10.688403 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-279e9f4e-62c2-4424-aba0-0bc2803cba6f tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:10.688861 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-279e9f4e-62c2-4424-aba0-0bc2803cba6f tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:10.689283 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-279e9f4e-62c2-4424-aba0-0bc2803cba6f tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:10.827353 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-279e9f4e-62c2-4424-aba0-0bc2803cba6f tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b" status: 200 len: 1655 microversion: 2.1 time: 0.151979 Sep 10 12:20:10.828128 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3139/6272] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:20:10 2022] GET /compute/v2.1/servers/0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b => generated 1655 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:20:11.430301 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0856c18a-adcb-4005-84d5-8a0256d8665b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:11.430930 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0856c18a-adcb-4005-84d5-8a0256d8665b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:11.438956 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0856c18a-adcb-4005-84d5-8a0256d8665b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:11.439706 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0856c18a-adcb-4005-84d5-8a0256d8665b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:11.440327 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0856c18a-adcb-4005-84d5-8a0256d8665b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:11.441211 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0856c18a-adcb-4005-84d5-8a0256d8665b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:11.441824 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0856c18a-adcb-4005-84d5-8a0256d8665b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:11.442409 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0856c18a-adcb-4005-84d5-8a0256d8665b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:11.607492 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-faa7d23d-b59a-47a2-b97b-aea78a738842 req-90f70913-a845-43ab-9bc5-d2c53fbf441c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b", "name": "network-vif-deleted", "tag": "a707f848-bcf9-43e3-8930-527cf233c04f"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:20:11.618984 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-faa7d23d-b59a-47a2-b97b-aea78a738842 req-90f70913-a845-43ab-9bc5-d2c53fbf441c service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:11.620914 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-faa7d23d-b59a-47a2-b97b-aea78a738842 req-90f70913-a845-43ab-9bc5-d2c53fbf441c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:11.621427 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-faa7d23d-b59a-47a2-b97b-aea78a738842 req-90f70913-a845-43ab-9bc5-d2c53fbf441c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:11.636388 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-faa7d23d-b59a-47a2-b97b-aea78a738842 req-90f70913-a845-43ab-9bc5-d2c53fbf441c service nova] Creating event network-vif-deleted:a707f848-bcf9-43e3-8930-527cf233c04f for instance 0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b on n-h1-856895-1 Sep 10 12:20:11.643119 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-faa7d23d-b59a-47a2-b97b-aea78a738842 req-90f70913-a845-43ab-9bc5-d2c53fbf441c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040990 Sep 10 12:20:11.648834 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3140/6273] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:20:11.690806 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0856c18a-adcb-4005-84d5-8a0256d8665b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:20:11.702054 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0856c18a-adcb-4005-84d5-8a0256d8665b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1695 microversion: 2.1 time: 0.275679 Sep 10 12:20:11.719927 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3134/6274] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:20:11 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1695 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:20:11.854299 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b6fa85b7-411b-4fb5-a9b8-4bdb6880f382 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:11.855031 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b6fa85b7-411b-4fb5-a9b8-4bdb6880f382 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] [instance: 0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:11.863667 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b6fa85b7-411b-4fb5-a9b8-4bdb6880f382 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:11.864377 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b6fa85b7-411b-4fb5-a9b8-4bdb6880f382 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:11.864864 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b6fa85b7-411b-4fb5-a9b8-4bdb6880f382 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:11.865761 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b6fa85b7-411b-4fb5-a9b8-4bdb6880f382 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:11.866313 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b6fa85b7-411b-4fb5-a9b8-4bdb6880f382 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:11.866747 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b6fa85b7-411b-4fb5-a9b8-4bdb6880f382 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:11.898747 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b6fa85b7-411b-4fb5-a9b8-4bdb6880f382 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:11.899275 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b6fa85b7-411b-4fb5-a9b8-4bdb6880f382 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:11.899721 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b6fa85b7-411b-4fb5-a9b8-4bdb6880f382 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:11.900184 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-b6fa85b7-411b-4fb5-a9b8-4bdb6880f382 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lazy-loading 'fault' on Instance uuid 0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:20:11.952432 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b6fa85b7-411b-4fb5-a9b8-4bdb6880f382 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b" status: 200 len: 1454 microversion: 2.1 time: 0.104918 Sep 10 12:20:11.953016 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3141/6275] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:20:11 2022] GET /compute/v2.1/servers/0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b => generated 1454 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:20:12.728587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-76ed86e1-1f8d-42c3-8f05-d6e4195c60ff tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:12.729141 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-76ed86e1-1f8d-42c3-8f05-d6e4195c60ff tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:12.736401 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-76ed86e1-1f8d-42c3-8f05-d6e4195c60ff tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:12.736889 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-76ed86e1-1f8d-42c3-8f05-d6e4195c60ff tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:12.737328 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-76ed86e1-1f8d-42c3-8f05-d6e4195c60ff tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:12.738054 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-76ed86e1-1f8d-42c3-8f05-d6e4195c60ff tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:12.738512 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-76ed86e1-1f8d-42c3-8f05-d6e4195c60ff tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:12.738995 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-76ed86e1-1f8d-42c3-8f05-d6e4195c60ff tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:12.873759 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-76ed86e1-1f8d-42c3-8f05-d6e4195c60ff tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:20:12.881820 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-76ed86e1-1f8d-42c3-8f05-d6e4195c60ff tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1695 microversion: 2.1 time: 0.157182 Sep 10 12:20:12.882545 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3135/6276] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:20:12 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:20:12.976308 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8e4c70f3-75b6-4c77-b139-0c289a858fad tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:12.977065 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8e4c70f3-75b6-4c77-b139-0c289a858fad tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] [instance: 0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:12.984795 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e4c70f3-75b6-4c77-b139-0c289a858fad tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:12.985197 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e4c70f3-75b6-4c77-b139-0c289a858fad tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:12.985631 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e4c70f3-75b6-4c77-b139-0c289a858fad tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:12.986332 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e4c70f3-75b6-4c77-b139-0c289a858fad tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:12.986784 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e4c70f3-75b6-4c77-b139-0c289a858fad tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:12.987233 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e4c70f3-75b6-4c77-b139-0c289a858fad tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:13.002205 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-8e4c70f3-75b6-4c77-b139-0c289a858fad tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] HTTP exception thrown: Instance 0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b could not be found. Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8e4c70f3-75b6-4c77-b139-0c289a858fad tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Request method failure captured: Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b HTTP/1.1 Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHIDiHfRc5CziLbYHteYcycnxr2_Ls4Dv6Z9Iveg-BmShGtCeyULY8IiV5BuoI9UWdhNaXaXQRT-t9m2XlpcpeQ2BudMcdWsdNUk5STwE6aUdFfdwJOenCWlfWzO-zH3cQ0JF4nxseJMwR5TMomwU0Fg6hFr7oeA-SZZKHb0_1LpTgOk Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 055a7454feb24da4a800e7e59138da5e Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-TestServerMultinode-1584413328 Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,admin,member Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,admin,member Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/055a7454feb24da4a800e7e59138da5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/055a7454feb24da4a800e7e59138da5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_055a7454feb24da4a800e7e59138da5e", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/055a7454feb24da4a800e7e59138da5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-TestServerMultinode-1584413328 Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 055a7454feb24da4a800e7e59138da5e Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-TestServerMultinode-1584413328 Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-TestServerMultinode-1584413328-project-admin Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: ff647004c0b04d7d98d196ee692da0d6 Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-TestServerMultinode-1584413328-project-admin Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b could not be found. Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b'} Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b could not be found. Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b could not be found. Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:20:13.003931 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:20:13.010984 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:20:13.010984 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:20:13.010984 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:20:13.010984 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:20:13.010984 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:20:13.010984 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b could not be found. Sep 10 12:20:13.010984 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:20:13.010984 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8e4c70f3-75b6-4c77-b139-0c289a858fad tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Returning 404 to user: Instance 0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:20:13.010984 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8e4c70f3-75b6-4c77-b139-0c289a858fad tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b" status: 404 len: 111 microversion: 2.1 time: 0.032916 Sep 10 12:20:13.010984 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3142/6277] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:20:12 2022] GET /compute/v2.1/servers/0c9e2f7c-f06f-4687-81c5-33f5bbba4f9b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:20:13.014900 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1b0c1cd9-7759-43b5-bd98-28d175a76d4e tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:13.015427 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1b0c1cd9-7759-43b5-bd98-28d175a76d4e tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] [instance: eaa1298b-6554-42d7-b461-451be52ebe04] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:13.021530 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b0c1cd9-7759-43b5-bd98-28d175a76d4e tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:13.022019 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b0c1cd9-7759-43b5-bd98-28d175a76d4e tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:13.022457 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b0c1cd9-7759-43b5-bd98-28d175a76d4e tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:13.023129 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b0c1cd9-7759-43b5-bd98-28d175a76d4e tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:13.023938 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b0c1cd9-7759-43b5-bd98-28d175a76d4e tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:13.024046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b0c1cd9-7759-43b5-bd98-28d175a76d4e tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:13.050079 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1b0c1cd9-7759-43b5-bd98-28d175a76d4e tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] [instance: eaa1298b-6554-42d7-b461-451be52ebe04] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:20:13.126682 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1b0c1cd9-7759-43b5-bd98-28d175a76d4e tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] 10.222.0.23 "DELETE /compute/v2.1/servers/eaa1298b-6554-42d7-b461-451be52ebe04" status: 204 len: 0 microversion: 2.1 time: 0.115455 Sep 10 12:20:13.126682 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3136/6278] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:20:13 2022] DELETE /compute/v2.1/servers/eaa1298b-6554-42d7-b461-451be52ebe04 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:20:13.134781 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-554301b9-62cb-46b5-991a-2c8e7bbf8669 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:13.135688 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-554301b9-62cb-46b5-991a-2c8e7bbf8669 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] [instance: eaa1298b-6554-42d7-b461-451be52ebe04] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:13.139606 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:20:13.143429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-554301b9-62cb-46b5-991a-2c8e7bbf8669 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:13.144767 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-554301b9-62cb-46b5-991a-2c8e7bbf8669 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:13.145214 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-554301b9-62cb-46b5-991a-2c8e7bbf8669 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:13.146093 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-554301b9-62cb-46b5-991a-2c8e7bbf8669 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:13.146559 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-554301b9-62cb-46b5-991a-2c8e7bbf8669 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:13.146993 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-554301b9-62cb-46b5-991a-2c8e7bbf8669 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:13.277282 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-554301b9-62cb-46b5-991a-2c8e7bbf8669 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/eaa1298b-6554-42d7-b461-451be52ebe04" status: 200 len: 1656 microversion: 2.1 time: 0.146126 Sep 10 12:20:13.277862 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3143/6279] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:20:13 2022] GET /compute/v2.1/servers/eaa1298b-6554-42d7-b461-451be52ebe04 => generated 1656 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:20:13.907388 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b9c4f00f-1551-4c93-8cab-a078170649bb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:13.908095 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b9c4f00f-1551-4c93-8cab-a078170649bb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:13.916811 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9c4f00f-1551-4c93-8cab-a078170649bb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:13.917293 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9c4f00f-1551-4c93-8cab-a078170649bb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:13.917731 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9c4f00f-1551-4c93-8cab-a078170649bb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:13.918457 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9c4f00f-1551-4c93-8cab-a078170649bb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:13.919321 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9c4f00f-1551-4c93-8cab-a078170649bb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:13.919748 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9c4f00f-1551-4c93-8cab-a078170649bb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:14.057602 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b9c4f00f-1551-4c93-8cab-a078170649bb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:20:14.066403 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b9c4f00f-1551-4c93-8cab-a078170649bb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1695 microversion: 2.1 time: 0.164106 Sep 10 12:20:14.066996 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3137/6280] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:20:13 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1695 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:20:14.301340 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-92ffc99a-4636-4276-8b68-d79210e62c85 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:14.302875 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-92ffc99a-4636-4276-8b68-d79210e62c85 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] [instance: eaa1298b-6554-42d7-b461-451be52ebe04] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:14.311357 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-92ffc99a-4636-4276-8b68-d79210e62c85 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:14.311880 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-92ffc99a-4636-4276-8b68-d79210e62c85 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:14.312321 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-92ffc99a-4636-4276-8b68-d79210e62c85 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:14.313349 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-92ffc99a-4636-4276-8b68-d79210e62c85 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:14.314142 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-92ffc99a-4636-4276-8b68-d79210e62c85 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:14.314925 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-92ffc99a-4636-4276-8b68-d79210e62c85 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:14.464481 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-92ffc99a-4636-4276-8b68-d79210e62c85 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/eaa1298b-6554-42d7-b461-451be52ebe04" status: 200 len: 1656 microversion: 2.1 time: 0.167078 Sep 10 12:20:14.465313 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3144/6281] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:20:14 2022] GET /compute/v2.1/servers/eaa1298b-6554-42d7-b461-451be52ebe04 => generated 1656 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:20:15.013621 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-870afcc1-814f-47d0-a3b8-463bd201e4cd req-eafbc471-5c97-4943-a5e7-4b6f4d27d7ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaa1298b-6554-42d7-b461-451be52ebe04", "name": "network-vif-deleted", "tag": "e04f949a-b4da-40b8-93dd-c1a11896a5aa"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:20:15.035276 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-870afcc1-814f-47d0-a3b8-463bd201e4cd req-eafbc471-5c97-4943-a5e7-4b6f4d27d7ae service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:15.035823 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-870afcc1-814f-47d0-a3b8-463bd201e4cd req-eafbc471-5c97-4943-a5e7-4b6f4d27d7ae service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:15.038573 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-870afcc1-814f-47d0-a3b8-463bd201e4cd req-eafbc471-5c97-4943-a5e7-4b6f4d27d7ae service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:15.066044 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-870afcc1-814f-47d0-a3b8-463bd201e4cd req-eafbc471-5c97-4943-a5e7-4b6f4d27d7ae service nova] Creating event network-vif-deleted:e04f949a-b4da-40b8-93dd-c1a11896a5aa for instance eaa1298b-6554-42d7-b461-451be52ebe04 on n-h2-856895-1 Sep 10 12:20:15.090057 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-86bdb53e-db03-4612-8e65-96608d89da8b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:15.091693 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-86bdb53e-db03-4612-8e65-96608d89da8b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:15.101431 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-870afcc1-814f-47d0-a3b8-463bd201e4cd req-eafbc471-5c97-4943-a5e7-4b6f4d27d7ae service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073108 Sep 10 12:20:15.102424 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3138/6282] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:20:15.110455 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86bdb53e-db03-4612-8e65-96608d89da8b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:15.112054 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86bdb53e-db03-4612-8e65-96608d89da8b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:15.112722 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86bdb53e-db03-4612-8e65-96608d89da8b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:15.113656 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86bdb53e-db03-4612-8e65-96608d89da8b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:15.114298 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86bdb53e-db03-4612-8e65-96608d89da8b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:15.114940 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86bdb53e-db03-4612-8e65-96608d89da8b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:15.370677 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-8dbd6b52-80d7-4464-b153-11c636e291ab req-ae9a0dc5-6604-4693-809f-0f5ee3fc63f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "192b2f43-548e-45bc-bc01-10bffeb7ab3c", "name": "network-vif-unplugged", "status": "completed", "tag": "bd279f8b-43ea-40d1-8c74-7a20609e24db"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:20:15.385188 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8dbd6b52-80d7-4464-b153-11c636e291ab req-ae9a0dc5-6604-4693-809f-0f5ee3fc63f0 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:15.386447 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-86bdb53e-db03-4612-8e65-96608d89da8b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:20:15.392615 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8dbd6b52-80d7-4464-b153-11c636e291ab req-ae9a0dc5-6604-4693-809f-0f5ee3fc63f0 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:15.393596 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8dbd6b52-80d7-4464-b153-11c636e291ab req-ae9a0dc5-6604-4693-809f-0f5ee3fc63f0 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:15.397272 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-86bdb53e-db03-4612-8e65-96608d89da8b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1694 microversion: 2.1 time: 0.311082 Sep 10 12:20:15.403200 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3145/6283] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:20:15 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1694 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:20:15.423834 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-8dbd6b52-80d7-4464-b153-11c636e291ab req-ae9a0dc5-6604-4693-809f-0f5ee3fc63f0 service nova] Creating event network-vif-unplugged:bd279f8b-43ea-40d1-8c74-7a20609e24db for instance 192b2f43-548e-45bc-bc01-10bffeb7ab3c on n-h2-856895-1 Sep 10 12:20:15.432228 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [req-8dbd6b52-80d7-4464-b153-11c636e291ab req-ae9a0dc5-6604-4693-809f-0f5ee3fc63f0 service nova] Instance 192b2f43-548e-45bc-bc01-10bffeb7ab3c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856895-1', 'n-h1-856895-1'} {{(pid=128777) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 12:20:15.448797 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-8dbd6b52-80d7-4464-b153-11c636e291ab req-ae9a0dc5-6604-4693-809f-0f5ee3fc63f0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083433 Sep 10 12:20:15.449723 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3139/6284] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:20:15.488699 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-96c7a515-80af-4157-b129-56af334b3fdb tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:15.489631 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-96c7a515-80af-4157-b129-56af334b3fdb tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] [instance: eaa1298b-6554-42d7-b461-451be52ebe04] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:15.496438 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-96c7a515-80af-4157-b129-56af334b3fdb tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:15.497871 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-96c7a515-80af-4157-b129-56af334b3fdb tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:15.498486 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-96c7a515-80af-4157-b129-56af334b3fdb tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:15.499624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-96c7a515-80af-4157-b129-56af334b3fdb tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:15.500257 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-96c7a515-80af-4157-b129-56af334b3fdb tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:15.500861 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-96c7a515-80af-4157-b129-56af334b3fdb tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:15.545959 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-96c7a515-80af-4157-b129-56af334b3fdb tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:15.546660 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-96c7a515-80af-4157-b129-56af334b3fdb tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:15.547290 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-96c7a515-80af-4157-b129-56af334b3fdb tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:15.548015 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-96c7a515-80af-4157-b129-56af334b3fdb tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lazy-loading 'fault' on Instance uuid eaa1298b-6554-42d7-b461-451be52ebe04 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:20:15.617348 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-96c7a515-80af-4157-b129-56af334b3fdb tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/eaa1298b-6554-42d7-b461-451be52ebe04" status: 200 len: 1454 microversion: 2.1 time: 0.132303 Sep 10 12:20:15.620350 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3146/6285] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:20:15 2022] GET /compute/v2.1/servers/eaa1298b-6554-42d7-b461-451be52ebe04 => generated 1454 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:20:16.423838 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8554446f-4477-49e7-b316-a1501aa411e6 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:16.424496 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8554446f-4477-49e7-b316-a1501aa411e6 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:16.426425 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:20:16.431614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8554446f-4477-49e7-b316-a1501aa411e6 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:16.432098 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8554446f-4477-49e7-b316-a1501aa411e6 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:16.432532 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8554446f-4477-49e7-b316-a1501aa411e6 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:16.433224 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8554446f-4477-49e7-b316-a1501aa411e6 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:16.433673 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8554446f-4477-49e7-b316-a1501aa411e6 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:16.434095 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8554446f-4477-49e7-b316-a1501aa411e6 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:16.581828 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8554446f-4477-49e7-b316-a1501aa411e6 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:20:16.589928 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8554446f-4477-49e7-b316-a1501aa411e6 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1694 microversion: 2.1 time: 0.171673 Sep 10 12:20:16.601545 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3140/6286] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:20:16 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1694 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:20:16.644422 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-06fad740-428f-429b-8a88-ed82d62307a4 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:16.645053 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-06fad740-428f-429b-8a88-ed82d62307a4 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] [instance: eaa1298b-6554-42d7-b461-451be52ebe04] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:16.652663 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-06fad740-428f-429b-8a88-ed82d62307a4 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:16.653715 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-06fad740-428f-429b-8a88-ed82d62307a4 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:16.654355 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-06fad740-428f-429b-8a88-ed82d62307a4 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:16.655138 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-06fad740-428f-429b-8a88-ed82d62307a4 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:16.655626 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-06fad740-428f-429b-8a88-ed82d62307a4 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:16.656068 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-06fad740-428f-429b-8a88-ed82d62307a4 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:16.671748 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-06fad740-428f-429b-8a88-ed82d62307a4 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] HTTP exception thrown: Instance eaa1298b-6554-42d7-b461-451be52ebe04 could not be found. Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-06fad740-428f-429b-8a88-ed82d62307a4 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Request method failure captured: Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/eaa1298b-6554-42d7-b461-451be52ebe04 HTTP/1.1 Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHIDiHfRc5CziLbYHteYcycnxr2_Ls4Dv6Z9Iveg-BmShGtCeyULY8IiV5BuoI9UWdhNaXaXQRT-t9m2XlpcpeQ2BudMcdWsdNUk5STwE6aUdFfdwJOenCWlfWzO-zH3cQ0JF4nxseJMwR5TMomwU0Fg6hFr7oeA-SZZKHb0_1LpTgOk Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 055a7454feb24da4a800e7e59138da5e Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-TestServerMultinode-1584413328 Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,admin,member Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,admin,member Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/055a7454feb24da4a800e7e59138da5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/055a7454feb24da4a800e7e59138da5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_055a7454feb24da4a800e7e59138da5e", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/055a7454feb24da4a800e7e59138da5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-TestServerMultinode-1584413328 Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 055a7454feb24da4a800e7e59138da5e Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-TestServerMultinode-1584413328 Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-TestServerMultinode-1584413328-project-admin Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: ff647004c0b04d7d98d196ee692da0d6 Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-TestServerMultinode-1584413328-project-admin Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance eaa1298b-6554-42d7-b461-451be52ebe04 could not be found. Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'eaa1298b-6554-42d7-b461-451be52ebe04'} Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaa1298b-6554-42d7-b461-451be52ebe04 could not be found. Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaa1298b-6554-42d7-b461-451be52ebe04 could not be found. Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:20:16.673319 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:20:16.678223 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:20:16.678223 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:20:16.678223 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:20:16.678223 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:20:16.678223 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:20:16.678223 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaa1298b-6554-42d7-b461-451be52ebe04 could not be found. Sep 10 12:20:16.678223 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:20:16.678223 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-06fad740-428f-429b-8a88-ed82d62307a4 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] Returning 404 to user: Instance eaa1298b-6554-42d7-b461-451be52ebe04 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:20:16.678223 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-06fad740-428f-429b-8a88-ed82d62307a4 tempest-TestServerMultinode-1584413328 tempest-TestServerMultinode-1584413328-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/eaa1298b-6554-42d7-b461-451be52ebe04" status: 404 len: 111 microversion: 2.1 time: 0.034387 Sep 10 12:20:16.678223 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3147/6287] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:20:16 2022] GET /compute/v2.1/servers/eaa1298b-6554-42d7-b461-451be52ebe04 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:20:17.549016 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-90d85a64-78bd-4e53-9c76-fa46c8fc734b req-45cf8f6f-3fd4-4db4-9e51-c737b62bf7b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "192b2f43-548e-45bc-bc01-10bffeb7ab3c", "tag": "bd279f8b-43ea-40d1-8c74-7a20609e24db"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:20:17.560299 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-90d85a64-78bd-4e53-9c76-fa46c8fc734b req-45cf8f6f-3fd4-4db4-9e51-c737b62bf7b9 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:17.560789 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-90d85a64-78bd-4e53-9c76-fa46c8fc734b req-45cf8f6f-3fd4-4db4-9e51-c737b62bf7b9 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:17.561225 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-90d85a64-78bd-4e53-9c76-fa46c8fc734b req-45cf8f6f-3fd4-4db4-9e51-c737b62bf7b9 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:17.573849 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-90d85a64-78bd-4e53-9c76-fa46c8fc734b req-45cf8f6f-3fd4-4db4-9e51-c737b62bf7b9 service nova] Creating event network-changed:bd279f8b-43ea-40d1-8c74-7a20609e24db for instance 192b2f43-548e-45bc-bc01-10bffeb7ab3c on n-h2-856895-1 Sep 10 12:20:17.579707 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [req-90d85a64-78bd-4e53-9c76-fa46c8fc734b req-45cf8f6f-3fd4-4db4-9e51-c737b62bf7b9 service nova] Instance 192b2f43-548e-45bc-bc01-10bffeb7ab3c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856895-1', 'n-h1-856895-1'} {{(pid=128777) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 12:20:17.591141 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-90d85a64-78bd-4e53-9c76-fa46c8fc734b req-45cf8f6f-3fd4-4db4-9e51-c737b62bf7b9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045684 Sep 10 12:20:17.591999 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3141/6288] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:20:17.613904 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a5b6cb48-5116-480e-a292-804e955fc61c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:17.614527 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a5b6cb48-5116-480e-a292-804e955fc61c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:17.621104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a5b6cb48-5116-480e-a292-804e955fc61c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:17.621605 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a5b6cb48-5116-480e-a292-804e955fc61c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:17.622815 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a5b6cb48-5116-480e-a292-804e955fc61c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:17.623659 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a5b6cb48-5116-480e-a292-804e955fc61c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:17.624304 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a5b6cb48-5116-480e-a292-804e955fc61c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:17.624908 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a5b6cb48-5116-480e-a292-804e955fc61c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:17.775613 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a5b6cb48-5116-480e-a292-804e955fc61c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:20:17.783742 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a5b6cb48-5116-480e-a292-804e955fc61c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1692 microversion: 2.1 time: 0.173561 Sep 10 12:20:17.784638 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3148/6289] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:20:17 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1692 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:20:18.809977 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-06472740-bb93-48ac-9ca9-be433b5889ca tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:18.810844 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-06472740-bb93-48ac-9ca9-be433b5889ca tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:18.818335 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06472740-bb93-48ac-9ca9-be433b5889ca tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:18.818821 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06472740-bb93-48ac-9ca9-be433b5889ca tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:18.819293 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06472740-bb93-48ac-9ca9-be433b5889ca tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:18.819990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06472740-bb93-48ac-9ca9-be433b5889ca tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:18.820447 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06472740-bb93-48ac-9ca9-be433b5889ca tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:18.820870 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06472740-bb93-48ac-9ca9-be433b5889ca tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:18.999035 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-06472740-bb93-48ac-9ca9-be433b5889ca tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:20:19.008373 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-06472740-bb93-48ac-9ca9-be433b5889ca tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1689 microversion: 2.1 time: 0.203795 Sep 10 12:20:19.009250 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3142/6290] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:20:18 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1689 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:20:19.033165 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fc69aca9-4e84-48e3-ac7b-eaa9e46e4eb9 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:20:19.034305 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fc69aca9-4e84-48e3-ac7b-eaa9e46e4eb9 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:19.041926 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc69aca9-4e84-48e3-ac7b-eaa9e46e4eb9 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:19.043064 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc69aca9-4e84-48e3-ac7b-eaa9e46e4eb9 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:19.044731 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc69aca9-4e84-48e3-ac7b-eaa9e46e4eb9 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:19.045699 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc69aca9-4e84-48e3-ac7b-eaa9e46e4eb9 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:19.046569 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc69aca9-4e84-48e3-ac7b-eaa9e46e4eb9 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:19.047252 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc69aca9-4e84-48e3-ac7b-eaa9e46e4eb9 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:19.123738 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=100 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:20:19.184090 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fc69aca9-4e84-48e3-ac7b-eaa9e46e4eb9 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "POST /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c/action" status: 202 len: 0 microversion: 2.1 time: 0.156282 Sep 10 12:20:19.185575 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3149/6291] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:20:19 2022] POST /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:20:19.193881 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2b82a4ea-b2b7-4d48-895e-e42f3e73ad3b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:19.194511 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2b82a4ea-b2b7-4d48-895e-e42f3e73ad3b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:19.201975 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b82a4ea-b2b7-4d48-895e-e42f3e73ad3b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:19.203003 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b82a4ea-b2b7-4d48-895e-e42f3e73ad3b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:19.203450 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b82a4ea-b2b7-4d48-895e-e42f3e73ad3b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:19.204192 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b82a4ea-b2b7-4d48-895e-e42f3e73ad3b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:19.204753 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b82a4ea-b2b7-4d48-895e-e42f3e73ad3b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:19.205448 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b82a4ea-b2b7-4d48-895e-e42f3e73ad3b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:19.242356 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:20:19.553314 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2b82a4ea-b2b7-4d48-895e-e42f3e73ad3b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:20:19.564742 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2b82a4ea-b2b7-4d48-895e-e42f3e73ad3b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1688 microversion: 2.1 time: 0.374845 Sep 10 12:20:19.567933 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3143/6292] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:20:19 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1688 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:20:20.593308 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0a20d280-1a1b-4d46-94c6-d3e757bc9fe5 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:20.594031 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0a20d280-1a1b-4d46-94c6-d3e757bc9fe5 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:20.602317 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0a20d280-1a1b-4d46-94c6-d3e757bc9fe5 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:20.602813 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0a20d280-1a1b-4d46-94c6-d3e757bc9fe5 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:20.603281 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0a20d280-1a1b-4d46-94c6-d3e757bc9fe5 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:20.603994 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0a20d280-1a1b-4d46-94c6-d3e757bc9fe5 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:20.604456 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0a20d280-1a1b-4d46-94c6-d3e757bc9fe5 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:20.604889 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0a20d280-1a1b-4d46-94c6-d3e757bc9fe5 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:20.905863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0a20d280-1a1b-4d46-94c6-d3e757bc9fe5 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:20:20.917315 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0a20d280-1a1b-4d46-94c6-d3e757bc9fe5 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1688 microversion: 2.1 time: 0.328905 Sep 10 12:20:20.918200 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3150/6293] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:20:20 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1688 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:20:21.941982 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a0959bfb-9616-42d6-b35d-9d23a2d8e94c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:21.942829 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a0959bfb-9616-42d6-b35d-9d23a2d8e94c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:21.954503 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a0959bfb-9616-42d6-b35d-9d23a2d8e94c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:21.956062 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a0959bfb-9616-42d6-b35d-9d23a2d8e94c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:21.956809 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a0959bfb-9616-42d6-b35d-9d23a2d8e94c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:21.958790 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a0959bfb-9616-42d6-b35d-9d23a2d8e94c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:21.960234 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a0959bfb-9616-42d6-b35d-9d23a2d8e94c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:21.960779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a0959bfb-9616-42d6-b35d-9d23a2d8e94c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:22.132791 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-8dc490b3-e145-413f-aacb-5a69aec8b7d4 req-bd4fd906-cb5e-4411-af13-6ca511c32e8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "192b2f43-548e-45bc-bc01-10bffeb7ab3c", "name": "network-vif-plugged", "status": "completed", "tag": "bd279f8b-43ea-40d1-8c74-7a20609e24db"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:20:22.165068 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-8dc490b3-e145-413f-aacb-5a69aec8b7d4 req-bd4fd906-cb5e-4411-af13-6ca511c32e8e service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:22.174072 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-8dc490b3-e145-413f-aacb-5a69aec8b7d4 req-bd4fd906-cb5e-4411-af13-6ca511c32e8e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:22.179065 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-8dc490b3-e145-413f-aacb-5a69aec8b7d4 req-bd4fd906-cb5e-4411-af13-6ca511c32e8e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:22.237951 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-8dc490b3-e145-413f-aacb-5a69aec8b7d4 req-bd4fd906-cb5e-4411-af13-6ca511c32e8e service nova] Creating event network-vif-plugged:bd279f8b-43ea-40d1-8c74-7a20609e24db for instance 192b2f43-548e-45bc-bc01-10bffeb7ab3c on n-h2-856895-1 Sep 10 12:20:22.258963 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [req-8dc490b3-e145-413f-aacb-5a69aec8b7d4 req-bd4fd906-cb5e-4411-af13-6ca511c32e8e service nova] Instance 192b2f43-548e-45bc-bc01-10bffeb7ab3c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856895-1', 'n-h1-856895-1'} {{(pid=128776) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 12:20:22.278236 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-8dc490b3-e145-413f-aacb-5a69aec8b7d4 req-bd4fd906-cb5e-4411-af13-6ca511c32e8e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150563 Sep 10 12:20:22.279516 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3151/6294] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:20:22.296216 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a0959bfb-9616-42d6-b35d-9d23a2d8e94c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:20:22.305989 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a0959bfb-9616-42d6-b35d-9d23a2d8e94c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1688 microversion: 2.1 time: 0.368052 Sep 10 12:20:22.323289 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3144/6295] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:20:21 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1688 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:20:23.305155 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-766b2e02-be47-47de-9b7d-c9c77349a339 req-ebb39895-b4b6-40cf-964c-632c7df51972 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "192b2f43-548e-45bc-bc01-10bffeb7ab3c", "name": "network-vif-unplugged", "status": "completed", "tag": "bd279f8b-43ea-40d1-8c74-7a20609e24db"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:20:23.316406 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-766b2e02-be47-47de-9b7d-c9c77349a339 req-ebb39895-b4b6-40cf-964c-632c7df51972 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:23.317002 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-766b2e02-be47-47de-9b7d-c9c77349a339 req-ebb39895-b4b6-40cf-964c-632c7df51972 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:23.317516 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-766b2e02-be47-47de-9b7d-c9c77349a339 req-ebb39895-b4b6-40cf-964c-632c7df51972 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:23.332291 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-33ec3184-83f2-400a-996f-3bbb3b790e5d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:23.333028 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-33ec3184-83f2-400a-996f-3bbb3b790e5d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:23.342581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-33ec3184-83f2-400a-996f-3bbb3b790e5d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:23.346455 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-766b2e02-be47-47de-9b7d-c9c77349a339 req-ebb39895-b4b6-40cf-964c-632c7df51972 service nova] Creating event network-vif-unplugged:bd279f8b-43ea-40d1-8c74-7a20609e24db for instance 192b2f43-548e-45bc-bc01-10bffeb7ab3c on n-h1-856895-1 Sep 10 12:20:23.348580 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-33ec3184-83f2-400a-996f-3bbb3b790e5d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:23.350214 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-33ec3184-83f2-400a-996f-3bbb3b790e5d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:23.351042 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-33ec3184-83f2-400a-996f-3bbb3b790e5d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:23.354552 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [req-766b2e02-be47-47de-9b7d-c9c77349a339 req-ebb39895-b4b6-40cf-964c-632c7df51972 service nova] Instance 192b2f43-548e-45bc-bc01-10bffeb7ab3c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856895-1', 'n-h1-856895-1'} {{(pid=128776) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 12:20:23.355248 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-33ec3184-83f2-400a-996f-3bbb3b790e5d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:23.355783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-33ec3184-83f2-400a-996f-3bbb3b790e5d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:23.374363 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-766b2e02-be47-47de-9b7d-c9c77349a339 req-ebb39895-b4b6-40cf-964c-632c7df51972 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074247 Sep 10 12:20:23.375340 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3152/6296] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:20:23.559362 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-33ec3184-83f2-400a-996f-3bbb3b790e5d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:20:23.567950 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-33ec3184-83f2-400a-996f-3bbb3b790e5d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1688 microversion: 2.1 time: 0.239501 Sep 10 12:20:23.569209 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3145/6297] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:20:23 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1688 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:20:24.594471 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-111c7670-c4fb-4975-801f-d83874abdfac tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:24.595215 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-111c7670-c4fb-4975-801f-d83874abdfac tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:24.614599 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-111c7670-c4fb-4975-801f-d83874abdfac tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:24.615095 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-111c7670-c4fb-4975-801f-d83874abdfac tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:24.633572 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-111c7670-c4fb-4975-801f-d83874abdfac tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:24.633572 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-111c7670-c4fb-4975-801f-d83874abdfac tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:24.633572 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-111c7670-c4fb-4975-801f-d83874abdfac tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:24.633572 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-111c7670-c4fb-4975-801f-d83874abdfac tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:24.798358 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-111c7670-c4fb-4975-801f-d83874abdfac tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:20:24.807600 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-111c7670-c4fb-4975-801f-d83874abdfac tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1688 microversion: 2.1 time: 0.218263 Sep 10 12:20:24.809030 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3153/6298] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:20:24 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1688 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:20:25.433403 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-0b2e691e-ff73-4a15-b160-b09d8e0aa5c0 req-8f927017-2449-487b-a915-87172229505c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "192b2f43-548e-45bc-bc01-10bffeb7ab3c", "tag": "bd279f8b-43ea-40d1-8c74-7a20609e24db"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:20:25.447882 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0b2e691e-ff73-4a15-b160-b09d8e0aa5c0 req-8f927017-2449-487b-a915-87172229505c service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:25.448796 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0b2e691e-ff73-4a15-b160-b09d8e0aa5c0 req-8f927017-2449-487b-a915-87172229505c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:25.449403 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0b2e691e-ff73-4a15-b160-b09d8e0aa5c0 req-8f927017-2449-487b-a915-87172229505c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:25.462878 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-0b2e691e-ff73-4a15-b160-b09d8e0aa5c0 req-8f927017-2449-487b-a915-87172229505c service nova] Creating event network-changed:bd279f8b-43ea-40d1-8c74-7a20609e24db for instance 192b2f43-548e-45bc-bc01-10bffeb7ab3c on n-h1-856895-1 Sep 10 12:20:25.469544 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [req-0b2e691e-ff73-4a15-b160-b09d8e0aa5c0 req-8f927017-2449-487b-a915-87172229505c service nova] Instance 192b2f43-548e-45bc-bc01-10bffeb7ab3c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856895-1', 'n-h1-856895-1'} {{(pid=128777) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 12:20:25.485630 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-0b2e691e-ff73-4a15-b160-b09d8e0aa5c0 req-8f927017-2449-487b-a915-87172229505c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055877 Sep 10 12:20:25.487587 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3146/6299] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:20:25.833809 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e9c139d2-45ee-4422-9cf9-66e798c27dcd tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:25.834439 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e9c139d2-45ee-4422-9cf9-66e798c27dcd tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:25.841719 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e9c139d2-45ee-4422-9cf9-66e798c27dcd tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:25.842222 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e9c139d2-45ee-4422-9cf9-66e798c27dcd tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:25.842669 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e9c139d2-45ee-4422-9cf9-66e798c27dcd tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:25.843413 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e9c139d2-45ee-4422-9cf9-66e798c27dcd tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:25.843878 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e9c139d2-45ee-4422-9cf9-66e798c27dcd tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:25.844312 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e9c139d2-45ee-4422-9cf9-66e798c27dcd tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:26.097244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e9c139d2-45ee-4422-9cf9-66e798c27dcd tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:20:26.113168 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e9c139d2-45ee-4422-9cf9-66e798c27dcd tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1688 microversion: 2.1 time: 0.284108 Sep 10 12:20:26.114006 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3154/6300] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:20:25 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1688 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:20:27.138306 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-312218cc-b2a8-433d-8433-4ed32c38577b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:27.139059 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-312218cc-b2a8-433d-8433-4ed32c38577b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:27.147496 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-312218cc-b2a8-433d-8433-4ed32c38577b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:27.147991 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-312218cc-b2a8-433d-8433-4ed32c38577b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:27.148655 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-312218cc-b2a8-433d-8433-4ed32c38577b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:27.149364 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-312218cc-b2a8-433d-8433-4ed32c38577b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:27.150199 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-312218cc-b2a8-433d-8433-4ed32c38577b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:27.151217 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-312218cc-b2a8-433d-8433-4ed32c38577b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:27.367520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-312218cc-b2a8-433d-8433-4ed32c38577b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:20:27.377006 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-312218cc-b2a8-433d-8433-4ed32c38577b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1688 microversion: 2.1 time: 0.243724 Sep 10 12:20:27.377862 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3147/6301] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:20:27 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1688 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:20:28.402060 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-867e1e7c-32eb-46a9-abc8-2bcb36485bed tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:20:28.402678 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-867e1e7c-32eb-46a9-abc8-2bcb36485bed tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:20:28.415154 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-867e1e7c-32eb-46a9-abc8-2bcb36485bed tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:28.420676 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-867e1e7c-32eb-46a9-abc8-2bcb36485bed tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:28.421874 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-867e1e7c-32eb-46a9-abc8-2bcb36485bed tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:28.423796 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-867e1e7c-32eb-46a9-abc8-2bcb36485bed tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:28.424580 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-867e1e7c-32eb-46a9-abc8-2bcb36485bed tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:28.425202 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-867e1e7c-32eb-46a9-abc8-2bcb36485bed tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:28.778893 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-867e1e7c-32eb-46a9-abc8-2bcb36485bed tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:20:28.791596 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-867e1e7c-32eb-46a9-abc8-2bcb36485bed tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1681 microversion: 2.1 time: 0.392915 Sep 10 12:20:28.793090 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3155/6302] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:20:28 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1681 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:20:30.583859 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-938342a4-b205-439d-81d4-23413d01dc93 req-5608075f-41a8-4951-995c-196c76573cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "192b2f43-548e-45bc-bc01-10bffeb7ab3c", "name": "network-vif-plugged", "status": "completed", "tag": "bd279f8b-43ea-40d1-8c74-7a20609e24db"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:20:30.598899 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-938342a4-b205-439d-81d4-23413d01dc93 req-5608075f-41a8-4951-995c-196c76573cc3 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:20:30.599426 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-938342a4-b205-439d-81d4-23413d01dc93 req-5608075f-41a8-4951-995c-196c76573cc3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:20:30.600089 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-938342a4-b205-439d-81d4-23413d01dc93 req-5608075f-41a8-4951-995c-196c76573cc3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:20:30.614926 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-938342a4-b205-439d-81d4-23413d01dc93 req-5608075f-41a8-4951-995c-196c76573cc3 service nova] Creating event network-vif-plugged:bd279f8b-43ea-40d1-8c74-7a20609e24db for instance 192b2f43-548e-45bc-bc01-10bffeb7ab3c on n-h1-856895-1 Sep 10 12:20:30.621695 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-938342a4-b205-439d-81d4-23413d01dc93 req-5608075f-41a8-4951-995c-196c76573cc3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042718 Sep 10 12:20:30.623363 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3148/6303] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:21:01.074136 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=30 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:21:01.074923 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=36,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:21:01.247742 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-abcef141-d970-4966-b51a-eaeb0c775227 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:21:01.250636 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-abcef141-d970-4966-b51a-eaeb0c775227 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:21:01.256754 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-abcef141-d970-4966-b51a-eaeb0c775227 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:01.257243 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-abcef141-d970-4966-b51a-eaeb0c775227 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:01.257822 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-abcef141-d970-4966-b51a-eaeb0c775227 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:01.258527 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-abcef141-d970-4966-b51a-eaeb0c775227 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:01.258990 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-abcef141-d970-4966-b51a-eaeb0c775227 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:01.259444 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-abcef141-d970-4966-b51a-eaeb0c775227 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:01.337723 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-abcef141-d970-4966-b51a-eaeb0c775227 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "POST /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c/action" status: 200 len: 63014 microversion: 2.1 time: 0.268492 Sep 10 12:21:01.338328 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3156/6304] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:21:01 2022] POST /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c/action => generated 63014 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 10 12:21:17.790162 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=17 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:21:17.790807 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=26 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:21:17.906314 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6d4a33c6-34ce-4c35-9a2f-68a6c0f76ab9 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:21:17.907119 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6d4a33c6-34ce-4c35-9a2f-68a6c0f76ab9 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:21:17.913498 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d4a33c6-34ce-4c35-9a2f-68a6c0f76ab9 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:17.914061 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d4a33c6-34ce-4c35-9a2f-68a6c0f76ab9 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:17.914583 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d4a33c6-34ce-4c35-9a2f-68a6c0f76ab9 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:17.915308 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d4a33c6-34ce-4c35-9a2f-68a6c0f76ab9 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:17.915772 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d4a33c6-34ce-4c35-9a2f-68a6c0f76ab9 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:17.916206 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d4a33c6-34ce-4c35-9a2f-68a6c0f76ab9 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:18.045229 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6d4a33c6-34ce-4c35-9a2f-68a6c0f76ab9 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1832 microversion: 2.1 time: 0.260307 Sep 10 12:21:18.045906 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3149/6305] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:21:17 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1832 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:21:18.925046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-239541c9-d724-42fc-b36c-f785d8dee24d req-984d6cd6-e5da-4a3a-adc2-8b214724828b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "192b2f43-548e-45bc-bc01-10bffeb7ab3c", "tag": "bd279f8b-43ea-40d1-8c74-7a20609e24db"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:21:18.931611 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-14e88b0d-8c9a-496b-9b71-b5d0c1d8c991 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:21:18.932220 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-14e88b0d-8c9a-496b-9b71-b5d0c1d8c991 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:21:18.939370 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:21:18.940667 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-239541c9-d724-42fc-b36c-f785d8dee24d req-984d6cd6-e5da-4a3a-adc2-8b214724828b service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:18.941190 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=4 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:21:18.941323 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-239541c9-d724-42fc-b36c-f785d8dee24d req-984d6cd6-e5da-4a3a-adc2-8b214724828b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:18.941887 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-239541c9-d724-42fc-b36c-f785d8dee24d req-984d6cd6-e5da-4a3a-adc2-8b214724828b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:18.943879 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-14e88b0d-8c9a-496b-9b71-b5d0c1d8c991 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:18.944667 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-14e88b0d-8c9a-496b-9b71-b5d0c1d8c991 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:18.945574 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-14e88b0d-8c9a-496b-9b71-b5d0c1d8c991 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:18.947893 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-14e88b0d-8c9a-496b-9b71-b5d0c1d8c991 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:18.948641 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-14e88b0d-8c9a-496b-9b71-b5d0c1d8c991 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:18.949320 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-14e88b0d-8c9a-496b-9b71-b5d0c1d8c991 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:18.957607 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-239541c9-d724-42fc-b36c-f785d8dee24d req-984d6cd6-e5da-4a3a-adc2-8b214724828b service nova] Creating event network-changed:bd279f8b-43ea-40d1-8c74-7a20609e24db for instance 192b2f43-548e-45bc-bc01-10bffeb7ab3c on n-h1-856895-1 Sep 10 12:21:18.963655 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-239541c9-d724-42fc-b36c-f785d8dee24d req-984d6cd6-e5da-4a3a-adc2-8b214724828b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042613 Sep 10 12:21:18.971049 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3150/6306] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:21:18.987742 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-14e88b0d-8c9a-496b-9b71-b5d0c1d8c991 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:21:19.091112 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-14e88b0d-8c9a-496b-9b71-b5d0c1d8c991 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "DELETE /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 204 len: 0 microversion: 2.1 time: 0.173262 Sep 10 12:21:19.101595 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f20d2291-eaf0-4c5e-8917-825f4f3ca089 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:21:19.102323 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f20d2291-eaf0-4c5e-8917-825f4f3ca089 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:21:19.105485 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3157/6307] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:21:18 2022] DELETE /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:21:19.113708 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f20d2291-eaf0-4c5e-8917-825f4f3ca089 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:19.114246 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f20d2291-eaf0-4c5e-8917-825f4f3ca089 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:19.114699 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f20d2291-eaf0-4c5e-8917-825f4f3ca089 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:19.115653 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f20d2291-eaf0-4c5e-8917-825f4f3ca089 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:19.116165 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f20d2291-eaf0-4c5e-8917-825f4f3ca089 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:19.116586 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f20d2291-eaf0-4c5e-8917-825f4f3ca089 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:19.271855 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f20d2291-eaf0-4c5e-8917-825f4f3ca089 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:21:19.279963 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f20d2291-eaf0-4c5e-8917-825f4f3ca089 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1687 microversion: 2.1 time: 0.183135 Sep 10 12:21:19.281075 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3151/6308] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:21:19 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1687 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:21:20.306701 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c3ee89a8-a38d-44cf-b584-54ddf8dc8422 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:21:20.308171 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c3ee89a8-a38d-44cf-b584-54ddf8dc8422 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:21:20.317313 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3ee89a8-a38d-44cf-b584-54ddf8dc8422 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:20.318341 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3ee89a8-a38d-44cf-b584-54ddf8dc8422 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:20.319375 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3ee89a8-a38d-44cf-b584-54ddf8dc8422 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:20.320315 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3ee89a8-a38d-44cf-b584-54ddf8dc8422 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:20.320958 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3ee89a8-a38d-44cf-b584-54ddf8dc8422 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:20.321727 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c3ee89a8-a38d-44cf-b584-54ddf8dc8422 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:20.461531 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c3ee89a8-a38d-44cf-b584-54ddf8dc8422 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:21:20.471534 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c3ee89a8-a38d-44cf-b584-54ddf8dc8422 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1687 microversion: 2.1 time: 0.169916 Sep 10 12:21:20.472429 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3158/6309] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:21:20 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1687 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:21:21.408242 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-04eb8434-4104-42fe-93a8-043dbf935525 req-580425af-1201-41f5-8920-ca218cef7f80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "192b2f43-548e-45bc-bc01-10bffeb7ab3c", "name": "network-vif-deleted", "tag": "bd279f8b-43ea-40d1-8c74-7a20609e24db"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:21:21.419980 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-04eb8434-4104-42fe-93a8-043dbf935525 req-580425af-1201-41f5-8920-ca218cef7f80 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:21.419980 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-04eb8434-4104-42fe-93a8-043dbf935525 req-580425af-1201-41f5-8920-ca218cef7f80 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:21.421584 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-04eb8434-4104-42fe-93a8-043dbf935525 req-580425af-1201-41f5-8920-ca218cef7f80 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:21.434369 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-04eb8434-4104-42fe-93a8-043dbf935525 req-580425af-1201-41f5-8920-ca218cef7f80 service nova] Creating event network-vif-deleted:bd279f8b-43ea-40d1-8c74-7a20609e24db for instance 192b2f43-548e-45bc-bc01-10bffeb7ab3c on n-h1-856895-1 Sep 10 12:21:21.439894 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-04eb8434-4104-42fe-93a8-043dbf935525 req-580425af-1201-41f5-8920-ca218cef7f80 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036225 Sep 10 12:21:21.441174 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3152/6310] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:21:21.497619 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-15675a1b-2c0e-4cd5-90ed-107987af76da tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:21:21.498428 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-15675a1b-2c0e-4cd5-90ed-107987af76da tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:21:21.511660 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-15675a1b-2c0e-4cd5-90ed-107987af76da tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:21.512467 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-15675a1b-2c0e-4cd5-90ed-107987af76da tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:21.513110 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-15675a1b-2c0e-4cd5-90ed-107987af76da tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:21.514059 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-15675a1b-2c0e-4cd5-90ed-107987af76da tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:21.515295 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-15675a1b-2c0e-4cd5-90ed-107987af76da tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:21.516104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-15675a1b-2c0e-4cd5-90ed-107987af76da tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:21.611078 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-15675a1b-2c0e-4cd5-90ed-107987af76da tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:21:21.620336 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-15675a1b-2c0e-4cd5-90ed-107987af76da tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 200 len: 1351 microversion: 2.1 time: 0.128274 Sep 10 12:21:21.622106 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3159/6311] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:21:21 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 1351 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:21:22.646639 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-67caf25e-5722-453e-8e7b-48e3b2c57405 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:21:22.647440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-67caf25e-5722-453e-8e7b-48e3b2c57405 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 192b2f43-548e-45bc-bc01-10bffeb7ab3c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:21:22.653687 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-67caf25e-5722-453e-8e7b-48e3b2c57405 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:22.654214 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-67caf25e-5722-453e-8e7b-48e3b2c57405 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:22.654658 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-67caf25e-5722-453e-8e7b-48e3b2c57405 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:22.656023 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-67caf25e-5722-453e-8e7b-48e3b2c57405 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:22.656476 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-67caf25e-5722-453e-8e7b-48e3b2c57405 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:22.656905 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-67caf25e-5722-453e-8e7b-48e3b2c57405 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:22.670837 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-67caf25e-5722-453e-8e7b-48e3b2c57405 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] HTTP exception thrown: Instance 192b2f43-548e-45bc-bc01-10bffeb7ab3c could not be found. Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-67caf25e-5722-453e-8e7b-48e3b2c57405 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Request method failure captured: Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c HTTP/1.1 Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH_yhS9kjuGqOnMliECmKXRPPzhZsHLNJh-k2Dy3sZVddODjZkI9QVirO2WV-k2QGWioorUvQwYXUbLO2mq09vb7kUE53WetDg0b2epWCfO81IA_d1hE4us0m3Xe_F7464Bi0Mnf9Ik8sGoKIy1FuftdqKYzeLjY2ezWMG2puAQMwhw Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 68cfd58791b5445b9a52bc02a5eb255b Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-223880240 Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/68cfd58791b5445b9a52bc02a5eb255b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/68cfd58791b5445b9a52bc02a5eb255b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_68cfd58791b5445b9a52bc02a5eb255b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/68cfd58791b5445b9a52bc02a5eb255b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-TestNetworkAdvancedServerOps-223880240 Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 68cfd58791b5445b9a52bc02a5eb255b Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-223880240 Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-TestNetworkAdvancedServerOps-223880240-project Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: fbd98ab9ebde4e84b03aed2e694ddf04 Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-TestNetworkAdvancedServerOps-223880240-project Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 192b2f43-548e-45bc-bc01-10bffeb7ab3c could not be found. Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '192b2f43-548e-45bc-bc01-10bffeb7ab3c'} Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 192b2f43-548e-45bc-bc01-10bffeb7ab3c could not be found. Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 192b2f43-548e-45bc-bc01-10bffeb7ab3c could not be found. Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:21:22.672557 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:21:22.677927 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:21:22.677927 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:21:22.677927 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:21:22.677927 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:21:22.677927 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:21:22.677927 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:21:22.677927 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 192b2f43-548e-45bc-bc01-10bffeb7ab3c could not be found. Sep 10 12:21:22.677927 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:21:22.677927 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-67caf25e-5722-453e-8e7b-48e3b2c57405 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Returning 404 to user: Instance 192b2f43-548e-45bc-bc01-10bffeb7ab3c could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:21:22.677927 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-67caf25e-5722-453e-8e7b-48e3b2c57405 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c" status: 404 len: 111 microversion: 2.1 time: 0.032493 Sep 10 12:21:22.677927 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3153/6312] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:21:22 2022] GET /compute/v2.1/servers/192b2f43-548e-45bc-bc01-10bffeb7ab3c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:21:26.183010 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ed3844d9-57eb-4435-a533-da54004017ee tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '.version_select at 0x7f407b5eaaf0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:21:26.212650 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ed3844d9-57eb-4435-a533-da54004017ee tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1251518159" status: 202 len: 0 microversion: 2.1 time: 0.033568 Sep 10 12:21:26.220115 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3160/6313] 10.222.0.23 () {58 vars in 1284 bytes} [Sat Sep 10 12:21:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1251518159 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:21:26.254430 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a43b326a-c6e8-4f18-9380-9cc8aa19028c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Action: 'create', calling method: .version_select at 0x7f4073162d30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1835965802", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLHdYvnep83TIWso/bp13Uh/AuUy439QOZb7LjYSLWtH2v3BOXVWl+CcfmB/sNHw53Kqxnx4vb6fkvaBEioNG6o4MnII28sk9NbZm9wxXmBLRTfyWWUwie4CayVS9k/MbQ=="}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:21:26.272734 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-a43b326a-c6e8-4f18-9380-9cc8aa19028c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Getting quotas for project 68cfd58791b5445b9a52bc02a5eb255b. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:21:26.277901 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-a43b326a-c6e8-4f18-9380-9cc8aa19028c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Getting quotas for user fbd98ab9ebde4e84b03aed2e694ddf04 and project 68cfd58791b5445b9a52bc02a5eb255b. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:21:26.302115 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a43b326a-c6e8-4f18-9380-9cc8aa19028c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.051700 Sep 10 12:21:26.302727 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3154/6314] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 12:21:26 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:21:32.020492 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:21:32.024518 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4ad3ed62-fc52-40dc-a2fc-1130a666ab1d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-391367064", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "63185de3-825b-43b1-83ae-da8c1a611ee2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1835965802", "security_groups": [{"name": "tempest-secgroup-smoke-1011888472"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:21:32.154015 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-4ad3ed62-fc52-40dc-a2fc-1130a666ab1d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] validate_networks() for [('63185de3-825b-43b1-83ae-da8c1a611ee2', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:21:32.734342 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-4ad3ed62-fc52-40dc-a2fc-1130a666ab1d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:21:32.735096 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-4ad3ed62-fc52-40dc-a2fc-1130a666ab1d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:21:32.735801 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-4ad3ed62-fc52-40dc-a2fc-1130a666ab1d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:21:32.736391 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-4ad3ed62-fc52-40dc-a2fc-1130a666ab1d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:21:32.736972 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-4ad3ed62-fc52-40dc-a2fc-1130a666ab1d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:21:32.750677 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ad3ed62-fc52-40dc-a2fc-1130a666ab1d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:32.751745 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ad3ed62-fc52-40dc-a2fc-1130a666ab1d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:32.752404 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ad3ed62-fc52-40dc-a2fc-1130a666ab1d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:32.753342 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ad3ed62-fc52-40dc-a2fc-1130a666ab1d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:32.754137 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ad3ed62-fc52-40dc-a2fc-1130a666ab1d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:32.754744 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ad3ed62-fc52-40dc-a2fc-1130a666ab1d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:32.790514 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-4ad3ed62-fc52-40dc-a2fc-1130a666ab1d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Getting quotas for project 68cfd58791b5445b9a52bc02a5eb255b. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:21:32.798320 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-4ad3ed62-fc52-40dc-a2fc-1130a666ab1d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Getting quotas for user fbd98ab9ebde4e84b03aed2e694ddf04 and project 68cfd58791b5445b9a52bc02a5eb255b. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:21:32.817033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4ad3ed62-fc52-40dc-a2fc-1130a666ab1d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:21:32.820145 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4ad3ed62-fc52-40dc-a2fc-1130a666ab1d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: d95ef740-125c-44a7-b33f-8e2a347639f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:21:32.897229 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4ad3ed62-fc52-40dc-a2fc-1130a666ab1d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.878607 Sep 10 12:21:32.899569 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3161/6315] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:21:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:21:32.912221 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d17a1a7d-f8e1-4b74-a4b3-11e1f1414ec3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:21:32.913595 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d17a1a7d-f8e1-4b74-a4b3-11e1f1414ec3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: d95ef740-125c-44a7-b33f-8e2a347639f1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:21:32.917254 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=18 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:21:33.001403 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d17a1a7d-f8e1-4b74-a4b3-11e1f1414ec3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:21:33.008898 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d17a1a7d-f8e1-4b74-a4b3-11e1f1414ec3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1" status: 200 len: 1266 microversion: 2.1 time: 0.101762 Sep 10 12:21:33.010750 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3155/6316] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:21:32 2022] GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1 => generated 1266 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:21:34.040052 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-55637e22-2baf-4491-8402-789ae4648380 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:21:34.040860 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-55637e22-2baf-4491-8402-789ae4648380 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: d95ef740-125c-44a7-b33f-8e2a347639f1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:21:34.049192 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55637e22-2baf-4491-8402-789ae4648380 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:34.049820 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55637e22-2baf-4491-8402-789ae4648380 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:34.050484 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55637e22-2baf-4491-8402-789ae4648380 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:34.051246 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55637e22-2baf-4491-8402-789ae4648380 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:34.051888 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55637e22-2baf-4491-8402-789ae4648380 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:34.052537 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55637e22-2baf-4491-8402-789ae4648380 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:34.133235 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-55637e22-2baf-4491-8402-789ae4648380 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:21:34.144171 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-55637e22-2baf-4491-8402-789ae4648380 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1" status: 200 len: 1318 microversion: 2.1 time: 0.110991 Sep 10 12:21:34.144901 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3162/6317] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:21:34 2022] GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1 => generated 1318 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:21:35.170826 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0e852c02-2848-46db-a1bd-2e0a3aa50e45 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:21:35.172188 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0e852c02-2848-46db-a1bd-2e0a3aa50e45 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: d95ef740-125c-44a7-b33f-8e2a347639f1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:21:35.193658 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e852c02-2848-46db-a1bd-2e0a3aa50e45 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:35.195731 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e852c02-2848-46db-a1bd-2e0a3aa50e45 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:35.196184 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e852c02-2848-46db-a1bd-2e0a3aa50e45 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:35.196917 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e852c02-2848-46db-a1bd-2e0a3aa50e45 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:35.200733 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e852c02-2848-46db-a1bd-2e0a3aa50e45 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:35.201182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0e852c02-2848-46db-a1bd-2e0a3aa50e45 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:35.280043 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0e852c02-2848-46db-a1bd-2e0a3aa50e45 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:21:35.288466 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0e852c02-2848-46db-a1bd-2e0a3aa50e45 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1" status: 200 len: 1324 microversion: 2.1 time: 0.124243 Sep 10 12:21:35.289777 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3156/6318] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:21:35 2022] GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1 => generated 1324 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:21:36.200816 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-0e97a665-666d-40a0-b112-ffbfe6630ef0 req-737e282c-afb5-4ab9-97d9-160306377f46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d95ef740-125c-44a7-b33f-8e2a347639f1", "tag": "6b36f2dd-378e-4a9e-8b7e-e606079806f2"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:21:36.216282 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-0e97a665-666d-40a0-b112-ffbfe6630ef0 req-737e282c-afb5-4ab9-97d9-160306377f46 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:36.219825 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-0e97a665-666d-40a0-b112-ffbfe6630ef0 req-737e282c-afb5-4ab9-97d9-160306377f46 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:36.220601 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-0e97a665-666d-40a0-b112-ffbfe6630ef0 req-737e282c-afb5-4ab9-97d9-160306377f46 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:36.242513 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-0e97a665-666d-40a0-b112-ffbfe6630ef0 req-737e282c-afb5-4ab9-97d9-160306377f46 service nova] Creating event network-changed:6b36f2dd-378e-4a9e-8b7e-e606079806f2 for instance d95ef740-125c-44a7-b33f-8e2a347639f1 on n-h1-856895-1 Sep 10 12:21:36.250752 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-0e97a665-666d-40a0-b112-ffbfe6630ef0 req-737e282c-afb5-4ab9-97d9-160306377f46 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060350 Sep 10 12:21:36.251597 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3163/6319] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:21:36.318049 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ed63dd1e-ad09-40c2-9c0a-1e87fb36ddbe tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:21:36.318673 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ed63dd1e-ad09-40c2-9c0a-1e87fb36ddbe tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: d95ef740-125c-44a7-b33f-8e2a347639f1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:21:36.325928 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ed63dd1e-ad09-40c2-9c0a-1e87fb36ddbe tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:36.327081 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ed63dd1e-ad09-40c2-9c0a-1e87fb36ddbe tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:36.327815 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ed63dd1e-ad09-40c2-9c0a-1e87fb36ddbe tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:36.328544 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ed63dd1e-ad09-40c2-9c0a-1e87fb36ddbe tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:36.329043 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ed63dd1e-ad09-40c2-9c0a-1e87fb36ddbe tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:36.329482 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ed63dd1e-ad09-40c2-9c0a-1e87fb36ddbe tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:36.531536 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ed63dd1e-ad09-40c2-9c0a-1e87fb36ddbe tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:21:36.548104 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ed63dd1e-ad09-40c2-9c0a-1e87fb36ddbe tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1" status: 200 len: 1392 microversion: 2.1 time: 0.234112 Sep 10 12:21:36.553271 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3157/6320] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:21:36 2022] GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1 => generated 1392 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:21:37.578917 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b68e18c1-1c7c-4537-9ef8-1b4cd768a9f8 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:21:37.579886 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b68e18c1-1c7c-4537-9ef8-1b4cd768a9f8 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: d95ef740-125c-44a7-b33f-8e2a347639f1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:21:37.586572 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b68e18c1-1c7c-4537-9ef8-1b4cd768a9f8 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:37.587222 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b68e18c1-1c7c-4537-9ef8-1b4cd768a9f8 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:37.587672 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b68e18c1-1c7c-4537-9ef8-1b4cd768a9f8 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:37.588374 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b68e18c1-1c7c-4537-9ef8-1b4cd768a9f8 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:37.588835 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b68e18c1-1c7c-4537-9ef8-1b4cd768a9f8 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:37.589392 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b68e18c1-1c7c-4537-9ef8-1b4cd768a9f8 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:37.731913 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b68e18c1-1c7c-4537-9ef8-1b4cd768a9f8 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:21:37.740370 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b68e18c1-1c7c-4537-9ef8-1b4cd768a9f8 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1" status: 200 len: 1392 microversion: 2.1 time: 0.167086 Sep 10 12:21:37.740960 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3164/6321] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:21:37 2022] GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:21:38.763862 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-089d602a-43cd-4f02-8d89-956483542ed4 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:21:38.764622 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-089d602a-43cd-4f02-8d89-956483542ed4 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: d95ef740-125c-44a7-b33f-8e2a347639f1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:21:38.771882 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-089d602a-43cd-4f02-8d89-956483542ed4 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:38.772375 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-089d602a-43cd-4f02-8d89-956483542ed4 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:38.772818 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-089d602a-43cd-4f02-8d89-956483542ed4 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:38.773528 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-089d602a-43cd-4f02-8d89-956483542ed4 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:38.774040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-089d602a-43cd-4f02-8d89-956483542ed4 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:38.774471 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-089d602a-43cd-4f02-8d89-956483542ed4 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:38.914375 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-089d602a-43cd-4f02-8d89-956483542ed4 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:21:38.922338 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-089d602a-43cd-4f02-8d89-956483542ed4 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1" status: 200 len: 1392 microversion: 2.1 time: 0.162622 Sep 10 12:21:38.923037 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3158/6322] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:21:38 2022] GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:21:39.945527 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-72ecb79f-6179-4789-b583-02dd01f1c823 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:21:39.946156 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-72ecb79f-6179-4789-b583-02dd01f1c823 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: d95ef740-125c-44a7-b33f-8e2a347639f1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:21:39.953143 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-72ecb79f-6179-4789-b583-02dd01f1c823 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:39.953635 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-72ecb79f-6179-4789-b583-02dd01f1c823 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:39.954714 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-72ecb79f-6179-4789-b583-02dd01f1c823 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:39.954883 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-72ecb79f-6179-4789-b583-02dd01f1c823 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:39.955560 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-72ecb79f-6179-4789-b583-02dd01f1c823 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:39.956030 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-72ecb79f-6179-4789-b583-02dd01f1c823 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:40.096816 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-72ecb79f-6179-4789-b583-02dd01f1c823 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:21:40.104584 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-72ecb79f-6179-4789-b583-02dd01f1c823 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1" status: 200 len: 1392 microversion: 2.1 time: 0.163097 Sep 10 12:21:40.105168 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3165/6323] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:21:39 2022] GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:21:41.129072 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cece5326-ef15-4b36-b243-b0a83f81ade6 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:21:41.134833 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cece5326-ef15-4b36-b243-b0a83f81ade6 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: d95ef740-125c-44a7-b33f-8e2a347639f1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:21:41.142519 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cece5326-ef15-4b36-b243-b0a83f81ade6 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:41.143011 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cece5326-ef15-4b36-b243-b0a83f81ade6 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:41.143484 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cece5326-ef15-4b36-b243-b0a83f81ade6 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:41.144217 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cece5326-ef15-4b36-b243-b0a83f81ade6 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:41.144683 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cece5326-ef15-4b36-b243-b0a83f81ade6 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:41.145118 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cece5326-ef15-4b36-b243-b0a83f81ade6 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:41.294228 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cece5326-ef15-4b36-b243-b0a83f81ade6 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:21:41.303474 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cece5326-ef15-4b36-b243-b0a83f81ade6 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1" status: 200 len: 1392 microversion: 2.1 time: 0.178227 Sep 10 12:21:41.304089 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3159/6324] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:21:41 2022] GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1 => generated 1392 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:21:42.328483 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1a5c6dcf-fe5f-442a-935a-3b170b4d378e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:21:42.329182 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1a5c6dcf-fe5f-442a-935a-3b170b4d378e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: d95ef740-125c-44a7-b33f-8e2a347639f1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:21:42.336109 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a5c6dcf-fe5f-442a-935a-3b170b4d378e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:42.336592 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a5c6dcf-fe5f-442a-935a-3b170b4d378e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:42.337029 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a5c6dcf-fe5f-442a-935a-3b170b4d378e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:42.337716 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a5c6dcf-fe5f-442a-935a-3b170b4d378e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:42.338168 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a5c6dcf-fe5f-442a-935a-3b170b4d378e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:42.338596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a5c6dcf-fe5f-442a-935a-3b170b4d378e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:42.475490 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1a5c6dcf-fe5f-442a-935a-3b170b4d378e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:21:42.483538 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1a5c6dcf-fe5f-442a-935a-3b170b4d378e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1" status: 200 len: 1392 microversion: 2.1 time: 0.159701 Sep 10 12:21:42.484398 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3166/6325] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:21:42 2022] GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:21:42.864990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-a50ffa19-8b57-4cec-8d97-921a58fb888d req-67295014-229c-40eb-a75e-e31fe415dddc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d95ef740-125c-44a7-b33f-8e2a347639f1", "name": "network-vif-plugged", "status": "completed", "tag": "6b36f2dd-378e-4a9e-8b7e-e606079806f2"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:21:42.875830 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a50ffa19-8b57-4cec-8d97-921a58fb888d req-67295014-229c-40eb-a75e-e31fe415dddc service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:42.876314 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a50ffa19-8b57-4cec-8d97-921a58fb888d req-67295014-229c-40eb-a75e-e31fe415dddc service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:42.876750 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a50ffa19-8b57-4cec-8d97-921a58fb888d req-67295014-229c-40eb-a75e-e31fe415dddc service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:42.891195 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-a50ffa19-8b57-4cec-8d97-921a58fb888d req-67295014-229c-40eb-a75e-e31fe415dddc service nova] Creating event network-vif-plugged:6b36f2dd-378e-4a9e-8b7e-e606079806f2 for instance d95ef740-125c-44a7-b33f-8e2a347639f1 on n-h1-856895-1 Sep 10 12:21:42.896494 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-a50ffa19-8b57-4cec-8d97-921a58fb888d req-67295014-229c-40eb-a75e-e31fe415dddc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107426 Sep 10 12:21:42.897158 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3160/6326] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:21:43.507424 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5b3e98b9-9ded-4f0d-822d-bac21f97f485 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:21:43.508132 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5b3e98b9-9ded-4f0d-822d-bac21f97f485 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: d95ef740-125c-44a7-b33f-8e2a347639f1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:21:43.510104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:21:43.510953 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:21:43.518026 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b3e98b9-9ded-4f0d-822d-bac21f97f485 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:43.518511 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b3e98b9-9ded-4f0d-822d-bac21f97f485 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:43.519024 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b3e98b9-9ded-4f0d-822d-bac21f97f485 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:43.519666 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b3e98b9-9ded-4f0d-822d-bac21f97f485 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:43.520127 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b3e98b9-9ded-4f0d-822d-bac21f97f485 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:43.520558 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b3e98b9-9ded-4f0d-822d-bac21f97f485 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:43.663231 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5b3e98b9-9ded-4f0d-822d-bac21f97f485 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:21:43.671869 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5b3e98b9-9ded-4f0d-822d-bac21f97f485 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1" status: 200 len: 1392 microversion: 2.1 time: 0.168363 Sep 10 12:21:43.672611 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3167/6327] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:21:43 2022] GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1 => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:21:44.692645 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:21:44.697995 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-32b5add3-aad3-4ba8-96ef-6df103e492af tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:21:44.698747 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-32b5add3-aad3-4ba8-96ef-6df103e492af tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: d95ef740-125c-44a7-b33f-8e2a347639f1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:21:44.706785 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32b5add3-aad3-4ba8-96ef-6df103e492af tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:44.707415 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32b5add3-aad3-4ba8-96ef-6df103e492af tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:44.707936 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32b5add3-aad3-4ba8-96ef-6df103e492af tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:44.708800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32b5add3-aad3-4ba8-96ef-6df103e492af tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:44.709356 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32b5add3-aad3-4ba8-96ef-6df103e492af tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:44.709805 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32b5add3-aad3-4ba8-96ef-6df103e492af tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:44.851198 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-32b5add3-aad3-4ba8-96ef-6df103e492af tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:21:44.860173 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-32b5add3-aad3-4ba8-96ef-6df103e492af tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1" status: 200 len: 1565 microversion: 2.1 time: 0.168575 Sep 10 12:21:44.860754 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3161/6328] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:21:44 2022] GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1 => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:21:44.882732 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-097fc452-bb75-4db0-b725-860859ae555a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:21:44.883370 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-097fc452-bb75-4db0-b725-860859ae555a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: d95ef740-125c-44a7-b33f-8e2a347639f1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:21:44.890384 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-097fc452-bb75-4db0-b725-860859ae555a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:44.890862 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-097fc452-bb75-4db0-b725-860859ae555a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:44.891324 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-097fc452-bb75-4db0-b725-860859ae555a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:44.892008 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-097fc452-bb75-4db0-b725-860859ae555a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:44.892465 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-097fc452-bb75-4db0-b725-860859ae555a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:44.892890 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-097fc452-bb75-4db0-b725-860859ae555a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:45.034119 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-097fc452-bb75-4db0-b725-860859ae555a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:21:45.044781 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-097fc452-bb75-4db0-b725-860859ae555a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1" status: 200 len: 1565 microversion: 2.1 time: 0.165966 Sep 10 12:21:45.045388 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3168/6329] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:21:44 2022] GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1 => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:21:46.832555 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-472bfb84-c61f-4bd9-a2a1-925fe492a165 req-27b61618-a86d-4995-89fd-e1cd8bc2a67c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d95ef740-125c-44a7-b33f-8e2a347639f1", "tag": "6b36f2dd-378e-4a9e-8b7e-e606079806f2"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:21:46.840669 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5a606a6e-3ca8-4b5e-82e3-9f980e2b79e8 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:21:46.841275 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5a606a6e-3ca8-4b5e-82e3-9f980e2b79e8 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: d95ef740-125c-44a7-b33f-8e2a347639f1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:21:46.853541 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5a606a6e-3ca8-4b5e-82e3-9f980e2b79e8 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:46.854047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5a606a6e-3ca8-4b5e-82e3-9f980e2b79e8 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:46.854493 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5a606a6e-3ca8-4b5e-82e3-9f980e2b79e8 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:46.855284 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5a606a6e-3ca8-4b5e-82e3-9f980e2b79e8 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:46.855681 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5a606a6e-3ca8-4b5e-82e3-9f980e2b79e8 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:46.856113 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5a606a6e-3ca8-4b5e-82e3-9f980e2b79e8 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:46.870994 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-472bfb84-c61f-4bd9-a2a1-925fe492a165 req-27b61618-a86d-4995-89fd-e1cd8bc2a67c service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:21:46.871532 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-472bfb84-c61f-4bd9-a2a1-925fe492a165 req-27b61618-a86d-4995-89fd-e1cd8bc2a67c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:21:46.871971 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-472bfb84-c61f-4bd9-a2a1-925fe492a165 req-27b61618-a86d-4995-89fd-e1cd8bc2a67c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:21:46.888158 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-472bfb84-c61f-4bd9-a2a1-925fe492a165 req-27b61618-a86d-4995-89fd-e1cd8bc2a67c service nova] Creating event network-changed:6b36f2dd-378e-4a9e-8b7e-e606079806f2 for instance d95ef740-125c-44a7-b33f-8e2a347639f1 on n-h1-856895-1 Sep 10 12:21:46.897537 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-472bfb84-c61f-4bd9-a2a1-925fe492a165 req-27b61618-a86d-4995-89fd-e1cd8bc2a67c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068076 Sep 10 12:21:46.898949 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3169/6330] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:21:47.127474 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5a606a6e-3ca8-4b5e-82e3-9f980e2b79e8 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:21:47.140519 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5a606a6e-3ca8-4b5e-82e3-9f980e2b79e8 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1" status: 200 len: 1565 microversion: 2.1 time: 0.315237 Sep 10 12:21:47.155186 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3162/6331] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:21:46 2022] GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1 => generated 1565 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:22:20.788389 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-81bf16ac-0076-4989-9990-213fe6c57084 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:22:20.789011 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-81bf16ac-0076-4989-9990-213fe6c57084 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: d95ef740-125c-44a7-b33f-8e2a347639f1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:22:20.791420 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:22:20.792549 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=42 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:22:20.800983 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81bf16ac-0076-4989-9990-213fe6c57084 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:20.801560 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81bf16ac-0076-4989-9990-213fe6c57084 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:20.802091 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81bf16ac-0076-4989-9990-213fe6c57084 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:20.802878 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81bf16ac-0076-4989-9990-213fe6c57084 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:20.803665 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81bf16ac-0076-4989-9990-213fe6c57084 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:20.804364 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81bf16ac-0076-4989-9990-213fe6c57084 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:20.877793 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-81bf16ac-0076-4989-9990-213fe6c57084 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "POST /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1/action" status: 200 len: 24565 microversion: 2.1 time: 0.097997 Sep 10 12:22:20.886848 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3170/6332] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:22:20 2022] POST /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1/action => generated 24565 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 12:22:27.494916 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0bb4902e-ff7f-4e6b-a187-66ac39014df3 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Action: 'create', calling method: .version_select at 0x7f40730531f0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1443142318", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEN0qumz1eu32LpC7VLX5BZz6vTT5Kor6j76eZtP5vJcWDm+I3yuqWl4q/JTcR+JnmpvQm6JNexuIKJv+EKj7Bg7inInaeOyoI3t+a+1tZbkmzT3dQz5stQP4CA9HLxUpg=="}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:22:27.501685 n-d-856895-1 devstack@n-api.service[128777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 12:22:27.501835 n-d-856895-1 devstack@n-api.service[128777]: Sat Sep 10 12:22:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.23) !!! Sep 10 12:22:27.504106 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:22:27.504806 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=38 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:22:27.521222 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-0bb4902e-ff7f-4e6b-a187-66ac39014df3 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Getting quotas for project a57d94ff8ba94e86b94d3fa48c8aa75c. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:22:27.526274 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-0bb4902e-ff7f-4e6b-a187-66ac39014df3 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Getting quotas for user 1abeceefe2f94cb3a03a4241b4379b2f and project a57d94ff8ba94e86b94d3fa48c8aa75c. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:22:27.549430 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0bb4902e-ff7f-4e6b-a187-66ac39014df3 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.058394 Sep 10 12:22:27.550121 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3163/6333] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 12:22:27 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:22:28.507563 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7a9877e9-10cb-4322-a940-894e8b173f25 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1792783759", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "16a5fdfc-4cc9-4265-9708-29db43a160b4", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1443142318", "security_groups": [{"name": "tempest-secgroup-smoke-310570354"}], "networks": [{"uuid": "0fd32393-94b4-449d-8cbb-eafa68cc7fa9"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:22:28.623359 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-7a9877e9-10cb-4322-a940-894e8b173f25 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] validate_networks() for [('0fd32393-94b4-449d-8cbb-eafa68cc7fa9', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:22:28.995910 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-7a9877e9-10cb-4322-a940-894e8b173f25 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:22:28.996337 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-7a9877e9-10cb-4322-a940-894e8b173f25 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:22:28.996814 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-7a9877e9-10cb-4322-a940-894e8b173f25 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:22:28.997226 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-7a9877e9-10cb-4322-a940-894e8b173f25 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:22:28.997640 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-7a9877e9-10cb-4322-a940-894e8b173f25 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:22:29.006918 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a9877e9-10cb-4322-a940-894e8b173f25 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:29.007426 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a9877e9-10cb-4322-a940-894e8b173f25 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:29.007863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a9877e9-10cb-4322-a940-894e8b173f25 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:29.008583 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a9877e9-10cb-4322-a940-894e8b173f25 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:29.009035 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a9877e9-10cb-4322-a940-894e8b173f25 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:29.009459 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a9877e9-10cb-4322-a940-894e8b173f25 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:29.027011 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-7a9877e9-10cb-4322-a940-894e8b173f25 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Getting quotas for project a57d94ff8ba94e86b94d3fa48c8aa75c. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:22:29.032343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-7a9877e9-10cb-4322-a940-894e8b173f25 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Getting quotas for user 1abeceefe2f94cb3a03a4241b4379b2f and project a57d94ff8ba94e86b94d3fa48c8aa75c. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:22:29.090272 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7a9877e9-10cb-4322-a940-894e8b173f25 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:22:29.092520 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7a9877e9-10cb-4322-a940-894e8b173f25 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] [instance: 874173da-ff29-46c8-b7e3-cd7e48a7f6ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='16a5fdfc-4cc9-4265-9708-29db43a160b4',volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:22:29.221671 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7a9877e9-10cb-4322-a940-894e8b173f25 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.718519 Sep 10 12:22:29.222324 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3171/6334] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:22:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:22:29.235655 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c4f831cb-e1be-419c-94b3-289e53c9c508 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:22:29.236274 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c4f831cb-e1be-419c-94b3-289e53c9c508 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] [instance: 874173da-ff29-46c8-b7e3-cd7e48a7f6ec] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:22:29.291352 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c4f831cb-e1be-419c-94b3-289e53c9c508 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1abeceefe2f94cb3a03a4241b4379b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57d94ff8ba94e86b94d3fa48c8aa75c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:22:29.299039 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c4f831cb-e1be-419c-94b3-289e53c9c508 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] 10.222.0.23 "GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec" status: 200 len: 1099 microversion: 2.1 time: 0.069227 Sep 10 12:22:29.299861 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3164/6335] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:22:29 2022] GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec => generated 1099 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:22:30.322229 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-13519a22-dde8-40ea-b9d6-10a9b19b5d19 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:22:30.323070 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-13519a22-dde8-40ea-b9d6-10a9b19b5d19 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] [instance: 874173da-ff29-46c8-b7e3-cd7e48a7f6ec] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:22:30.379087 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-13519a22-dde8-40ea-b9d6-10a9b19b5d19 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1abeceefe2f94cb3a03a4241b4379b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57d94ff8ba94e86b94d3fa48c8aa75c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:22:30.385932 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-13519a22-dde8-40ea-b9d6-10a9b19b5d19 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] 10.222.0.23 "GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec" status: 200 len: 1099 microversion: 2.1 time: 0.067692 Sep 10 12:22:30.386550 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3172/6336] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:22:30 2022] GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec => generated 1099 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:22:31.410660 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6a505905-7e05-4d4d-8699-a63f506cf420 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:22:31.411364 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6a505905-7e05-4d4d-8699-a63f506cf420 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] [instance: 874173da-ff29-46c8-b7e3-cd7e48a7f6ec] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:22:31.465702 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6a505905-7e05-4d4d-8699-a63f506cf420 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1abeceefe2f94cb3a03a4241b4379b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57d94ff8ba94e86b94d3fa48c8aa75c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:22:31.474267 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6a505905-7e05-4d4d-8699-a63f506cf420 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] 10.222.0.23 "GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec" status: 200 len: 1099 microversion: 2.1 time: 0.068391 Sep 10 12:22:31.474853 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3165/6337] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:22:31 2022] GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec => generated 1099 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:22:32.497636 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0b653b13-206f-48bf-be00-5218ba2596ba tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:22:32.498218 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0b653b13-206f-48bf-be00-5218ba2596ba tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] [instance: 874173da-ff29-46c8-b7e3-cd7e48a7f6ec] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:22:32.556669 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0b653b13-206f-48bf-be00-5218ba2596ba tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1abeceefe2f94cb3a03a4241b4379b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57d94ff8ba94e86b94d3fa48c8aa75c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:22:32.564119 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0b653b13-206f-48bf-be00-5218ba2596ba tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] 10.222.0.23 "GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec" status: 200 len: 1099 microversion: 2.1 time: 0.070411 Sep 10 12:22:32.579342 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3173/6338] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:22:32 2022] GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec => generated 1099 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:22:33.586184 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-552ee377-e270-4a60-81b1-798067791993 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:22:33.586729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-552ee377-e270-4a60-81b1-798067791993 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] [instance: 874173da-ff29-46c8-b7e3-cd7e48a7f6ec] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:22:33.594250 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-552ee377-e270-4a60-81b1-798067791993 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:33.594735 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-552ee377-e270-4a60-81b1-798067791993 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:33.595197 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-552ee377-e270-4a60-81b1-798067791993 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:33.595895 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-552ee377-e270-4a60-81b1-798067791993 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:33.596351 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-552ee377-e270-4a60-81b1-798067791993 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:33.596778 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-552ee377-e270-4a60-81b1-798067791993 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:33.656781 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-552ee377-e270-4a60-81b1-798067791993 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1abeceefe2f94cb3a03a4241b4379b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57d94ff8ba94e86b94d3fa48c8aa75c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:22:33.664528 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-552ee377-e270-4a60-81b1-798067791993 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] 10.222.0.23 "GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec" status: 200 len: 1149 microversion: 2.1 time: 0.082550 Sep 10 12:22:33.665099 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3166/6339] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:22:33 2022] GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec => generated 1149 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:22:34.688451 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e963ac9b-56d4-4fbb-98f4-5844c32e5db2 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:22:34.690064 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e963ac9b-56d4-4fbb-98f4-5844c32e5db2 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] [instance: 874173da-ff29-46c8-b7e3-cd7e48a7f6ec] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:22:34.699033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e963ac9b-56d4-4fbb-98f4-5844c32e5db2 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:34.699983 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e963ac9b-56d4-4fbb-98f4-5844c32e5db2 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:34.700668 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e963ac9b-56d4-4fbb-98f4-5844c32e5db2 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:34.701563 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e963ac9b-56d4-4fbb-98f4-5844c32e5db2 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:34.702205 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e963ac9b-56d4-4fbb-98f4-5844c32e5db2 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:34.702819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e963ac9b-56d4-4fbb-98f4-5844c32e5db2 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:34.769823 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e963ac9b-56d4-4fbb-98f4-5844c32e5db2 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1abeceefe2f94cb3a03a4241b4379b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57d94ff8ba94e86b94d3fa48c8aa75c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:22:34.778628 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e963ac9b-56d4-4fbb-98f4-5844c32e5db2 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] 10.222.0.23 "GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec" status: 200 len: 1215 microversion: 2.1 time: 0.095576 Sep 10 12:22:34.779220 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3174/6340] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:22:34 2022] GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec => generated 1215 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:22:35.738617 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-c9623a21-ef1f-44ec-87ba-1f30ccbea1a1 req-a425f2c8-f7ff-42a0-8e60-db5de3126b8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "874173da-ff29-46c8-b7e3-cd7e48a7f6ec", "tag": "ba9b8043-7f68-4531-94cb-da752ffe711a"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:22:35.750569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-c9623a21-ef1f-44ec-87ba-1f30ccbea1a1 req-a425f2c8-f7ff-42a0-8e60-db5de3126b8b service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:35.751064 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-c9623a21-ef1f-44ec-87ba-1f30ccbea1a1 req-a425f2c8-f7ff-42a0-8e60-db5de3126b8b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:35.752174 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-c9623a21-ef1f-44ec-87ba-1f30ccbea1a1 req-a425f2c8-f7ff-42a0-8e60-db5de3126b8b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:35.763524 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-c9623a21-ef1f-44ec-87ba-1f30ccbea1a1 req-a425f2c8-f7ff-42a0-8e60-db5de3126b8b service nova] Creating event network-changed:ba9b8043-7f68-4531-94cb-da752ffe711a for instance 874173da-ff29-46c8-b7e3-cd7e48a7f6ec on n-h2-856895-1 Sep 10 12:22:35.769193 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-c9623a21-ef1f-44ec-87ba-1f30ccbea1a1 req-a425f2c8-f7ff-42a0-8e60-db5de3126b8b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117064 Sep 10 12:22:35.770046 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3167/6341] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:22:35.803028 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-81b888d1-7b6c-4b10-8055-0dc90161e0f0 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:22:35.803949 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-81b888d1-7b6c-4b10-8055-0dc90161e0f0 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] [instance: 874173da-ff29-46c8-b7e3-cd7e48a7f6ec] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:22:35.811388 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81b888d1-7b6c-4b10-8055-0dc90161e0f0 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:35.812104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81b888d1-7b6c-4b10-8055-0dc90161e0f0 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:35.812804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81b888d1-7b6c-4b10-8055-0dc90161e0f0 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:35.813980 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81b888d1-7b6c-4b10-8055-0dc90161e0f0 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:35.814517 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81b888d1-7b6c-4b10-8055-0dc90161e0f0 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:35.815023 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81b888d1-7b6c-4b10-8055-0dc90161e0f0 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:35.967067 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-81b888d1-7b6c-4b10-8055-0dc90161e0f0 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1abeceefe2f94cb3a03a4241b4379b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57d94ff8ba94e86b94d3fa48c8aa75c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:22:35.975590 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-81b888d1-7b6c-4b10-8055-0dc90161e0f0 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] 10.222.0.23 "GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec" status: 200 len: 1282 microversion: 2.1 time: 0.176553 Sep 10 12:22:35.983677 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3175/6342] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:22:35 2022] GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec => generated 1282 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:22:36.998737 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-81daa1b3-a144-4758-b7ea-c5b8801238b6 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:22:36.999444 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-81daa1b3-a144-4758-b7ea-c5b8801238b6 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] [instance: 874173da-ff29-46c8-b7e3-cd7e48a7f6ec] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:22:37.006868 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-81daa1b3-a144-4758-b7ea-c5b8801238b6 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:37.007468 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-81daa1b3-a144-4758-b7ea-c5b8801238b6 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:37.007914 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-81daa1b3-a144-4758-b7ea-c5b8801238b6 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:37.008625 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-81daa1b3-a144-4758-b7ea-c5b8801238b6 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:37.009086 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-81daa1b3-a144-4758-b7ea-c5b8801238b6 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:37.009524 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-81daa1b3-a144-4758-b7ea-c5b8801238b6 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:37.223130 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-81daa1b3-a144-4758-b7ea-c5b8801238b6 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1abeceefe2f94cb3a03a4241b4379b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57d94ff8ba94e86b94d3fa48c8aa75c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:22:37.231608 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-81daa1b3-a144-4758-b7ea-c5b8801238b6 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] 10.222.0.23 "GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec" status: 200 len: 1282 microversion: 2.1 time: 0.237306 Sep 10 12:22:37.232452 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3168/6343] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:22:36 2022] GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec => generated 1282 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:22:38.256135 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8ed5e85a-e15d-4b6c-acda-56e74f7cff3d tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:22:38.256783 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8ed5e85a-e15d-4b6c-acda-56e74f7cff3d tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] [instance: 874173da-ff29-46c8-b7e3-cd7e48a7f6ec] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:22:38.264171 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8ed5e85a-e15d-4b6c-acda-56e74f7cff3d tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:38.265330 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8ed5e85a-e15d-4b6c-acda-56e74f7cff3d tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:38.265811 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8ed5e85a-e15d-4b6c-acda-56e74f7cff3d tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:38.266539 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8ed5e85a-e15d-4b6c-acda-56e74f7cff3d tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:38.267676 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8ed5e85a-e15d-4b6c-acda-56e74f7cff3d tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:38.268121 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8ed5e85a-e15d-4b6c-acda-56e74f7cff3d tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:38.411942 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8ed5e85a-e15d-4b6c-acda-56e74f7cff3d tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1abeceefe2f94cb3a03a4241b4379b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57d94ff8ba94e86b94d3fa48c8aa75c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:22:38.419781 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8ed5e85a-e15d-4b6c-acda-56e74f7cff3d tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] 10.222.0.23 "GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec" status: 200 len: 1282 microversion: 2.1 time: 0.167852 Sep 10 12:22:38.420364 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3176/6344] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:22:38 2022] GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec => generated 1282 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:22:39.443142 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-97ee4fa5-7cb9-4ed5-b3c7-40102dd1eb91 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:22:39.443823 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-97ee4fa5-7cb9-4ed5-b3c7-40102dd1eb91 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] [instance: 874173da-ff29-46c8-b7e3-cd7e48a7f6ec] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:22:39.450831 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-97ee4fa5-7cb9-4ed5-b3c7-40102dd1eb91 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:39.451296 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-97ee4fa5-7cb9-4ed5-b3c7-40102dd1eb91 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:39.451735 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-97ee4fa5-7cb9-4ed5-b3c7-40102dd1eb91 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:39.452435 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-97ee4fa5-7cb9-4ed5-b3c7-40102dd1eb91 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:39.452893 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-97ee4fa5-7cb9-4ed5-b3c7-40102dd1eb91 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:39.453322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-97ee4fa5-7cb9-4ed5-b3c7-40102dd1eb91 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:39.585745 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-97ee4fa5-7cb9-4ed5-b3c7-40102dd1eb91 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1abeceefe2f94cb3a03a4241b4379b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57d94ff8ba94e86b94d3fa48c8aa75c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:22:39.594007 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-97ee4fa5-7cb9-4ed5-b3c7-40102dd1eb91 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] 10.222.0.23 "GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec" status: 200 len: 1270 microversion: 2.1 time: 0.154829 Sep 10 12:22:39.594590 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3169/6345] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:22:39 2022] GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec => generated 1270 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:22:40.617827 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-de90de6d-b2f2-4023-ac3c-141c455178f5 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:22:40.618454 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-de90de6d-b2f2-4023-ac3c-141c455178f5 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] [instance: 874173da-ff29-46c8-b7e3-cd7e48a7f6ec] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:22:40.620471 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:22:40.627525 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de90de6d-b2f2-4023-ac3c-141c455178f5 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:40.628018 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de90de6d-b2f2-4023-ac3c-141c455178f5 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:40.628458 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de90de6d-b2f2-4023-ac3c-141c455178f5 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:40.629157 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de90de6d-b2f2-4023-ac3c-141c455178f5 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:40.629612 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de90de6d-b2f2-4023-ac3c-141c455178f5 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:40.630045 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de90de6d-b2f2-4023-ac3c-141c455178f5 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:40.763679 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-de90de6d-b2f2-4023-ac3c-141c455178f5 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1abeceefe2f94cb3a03a4241b4379b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57d94ff8ba94e86b94d3fa48c8aa75c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:22:40.771645 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-de90de6d-b2f2-4023-ac3c-141c455178f5 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] 10.222.0.23 "GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec" status: 200 len: 1270 microversion: 2.1 time: 0.158006 Sep 10 12:22:40.772214 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3177/6346] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:22:40 2022] GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec => generated 1270 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:22:41.794660 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-43a154b5-4a8a-4daa-b697-439c1096245d tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:22:41.795312 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-43a154b5-4a8a-4daa-b697-439c1096245d tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] [instance: 874173da-ff29-46c8-b7e3-cd7e48a7f6ec] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:22:41.798138 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=8 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:22:41.803618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-43a154b5-4a8a-4daa-b697-439c1096245d tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:41.804103 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-43a154b5-4a8a-4daa-b697-439c1096245d tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:41.804542 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-43a154b5-4a8a-4daa-b697-439c1096245d tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:41.805245 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-43a154b5-4a8a-4daa-b697-439c1096245d tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:41.805729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-43a154b5-4a8a-4daa-b697-439c1096245d tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:41.806162 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-43a154b5-4a8a-4daa-b697-439c1096245d tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:41.943623 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-43a154b5-4a8a-4daa-b697-439c1096245d tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1abeceefe2f94cb3a03a4241b4379b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57d94ff8ba94e86b94d3fa48c8aa75c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:22:41.951302 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-43a154b5-4a8a-4daa-b697-439c1096245d tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] 10.222.0.23 "GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec" status: 200 len: 1270 microversion: 2.1 time: 0.160624 Sep 10 12:22:41.952126 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3170/6347] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:22:41 2022] GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec => generated 1270 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:22:42.974482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e572d3fc-c239-4e58-975f-9a26fcd94e6a tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:22:42.975125 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e572d3fc-c239-4e58-975f-9a26fcd94e6a tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] [instance: 874173da-ff29-46c8-b7e3-cd7e48a7f6ec] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:22:42.978325 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=10 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:22:42.984143 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e572d3fc-c239-4e58-975f-9a26fcd94e6a tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:42.984647 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e572d3fc-c239-4e58-975f-9a26fcd94e6a tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:42.985084 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e572d3fc-c239-4e58-975f-9a26fcd94e6a tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:42.986037 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e572d3fc-c239-4e58-975f-9a26fcd94e6a tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:42.986489 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e572d3fc-c239-4e58-975f-9a26fcd94e6a tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:42.986917 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e572d3fc-c239-4e58-975f-9a26fcd94e6a tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:43.118592 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e572d3fc-c239-4e58-975f-9a26fcd94e6a tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1abeceefe2f94cb3a03a4241b4379b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57d94ff8ba94e86b94d3fa48c8aa75c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:22:43.127458 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e572d3fc-c239-4e58-975f-9a26fcd94e6a tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] 10.222.0.23 "GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec" status: 200 len: 1270 microversion: 2.1 time: 0.156374 Sep 10 12:22:43.128034 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3178/6348] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:22:42 2022] GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec => generated 1270 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:22:44.153436 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-02a2df3c-0bb4-4bdc-a160-5bc1f017b71b tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:22:44.154156 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-02a2df3c-0bb4-4bdc-a160-5bc1f017b71b tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] [instance: 874173da-ff29-46c8-b7e3-cd7e48a7f6ec] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:22:44.161721 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02a2df3c-0bb4-4bdc-a160-5bc1f017b71b tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:44.162206 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02a2df3c-0bb4-4bdc-a160-5bc1f017b71b tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:44.162646 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02a2df3c-0bb4-4bdc-a160-5bc1f017b71b tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:44.163386 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02a2df3c-0bb4-4bdc-a160-5bc1f017b71b tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:44.163847 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02a2df3c-0bb4-4bdc-a160-5bc1f017b71b tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:44.164278 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02a2df3c-0bb4-4bdc-a160-5bc1f017b71b tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:44.302447 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-02a2df3c-0bb4-4bdc-a160-5bc1f017b71b tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1abeceefe2f94cb3a03a4241b4379b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57d94ff8ba94e86b94d3fa48c8aa75c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:22:44.310243 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-02a2df3c-0bb4-4bdc-a160-5bc1f017b71b tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] 10.222.0.23 "GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec" status: 200 len: 1270 microversion: 2.1 time: 0.160751 Sep 10 12:22:44.311030 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3171/6349] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:22:44 2022] GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec => generated 1270 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:22:45.333087 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-32491c6f-86be-4db2-b472-6d5ac1c18991 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:22:45.333709 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-32491c6f-86be-4db2-b472-6d5ac1c18991 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] [instance: 874173da-ff29-46c8-b7e3-cd7e48a7f6ec] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:22:45.340613 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-32491c6f-86be-4db2-b472-6d5ac1c18991 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:45.341099 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-32491c6f-86be-4db2-b472-6d5ac1c18991 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:45.341542 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-32491c6f-86be-4db2-b472-6d5ac1c18991 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:45.342240 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-32491c6f-86be-4db2-b472-6d5ac1c18991 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:45.342697 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-32491c6f-86be-4db2-b472-6d5ac1c18991 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:45.343131 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-32491c6f-86be-4db2-b472-6d5ac1c18991 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:45.474459 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-32491c6f-86be-4db2-b472-6d5ac1c18991 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1abeceefe2f94cb3a03a4241b4379b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57d94ff8ba94e86b94d3fa48c8aa75c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:22:45.482156 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-32491c6f-86be-4db2-b472-6d5ac1c18991 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] 10.222.0.23 "GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec" status: 200 len: 1270 microversion: 2.1 time: 0.153306 Sep 10 12:22:45.482733 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3179/6350] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:22:45 2022] GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec => generated 1270 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:22:46.506169 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-31c91fc7-a836-432d-92e4-f3fb2da5d37d tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:22:46.506733 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-31c91fc7-a836-432d-92e4-f3fb2da5d37d tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] [instance: 874173da-ff29-46c8-b7e3-cd7e48a7f6ec] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:22:46.513546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-31c91fc7-a836-432d-92e4-f3fb2da5d37d tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:46.514022 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-31c91fc7-a836-432d-92e4-f3fb2da5d37d tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:46.514454 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-31c91fc7-a836-432d-92e4-f3fb2da5d37d tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:46.515182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-31c91fc7-a836-432d-92e4-f3fb2da5d37d tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:46.515632 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-31c91fc7-a836-432d-92e4-f3fb2da5d37d tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:46.516056 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-31c91fc7-a836-432d-92e4-f3fb2da5d37d tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:46.651457 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-31c91fc7-a836-432d-92e4-f3fb2da5d37d tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1abeceefe2f94cb3a03a4241b4379b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57d94ff8ba94e86b94d3fa48c8aa75c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:22:46.659282 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-31c91fc7-a836-432d-92e4-f3fb2da5d37d tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] 10.222.0.23 "GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec" status: 200 len: 1270 microversion: 2.1 time: 0.157144 Sep 10 12:22:46.659857 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3172/6351] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:22:46 2022] GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec => generated 1270 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:22:47.681886 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-51871d42-bd9b-401a-9992-871a59d19549 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:22:47.682510 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-51871d42-bd9b-401a-9992-871a59d19549 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] [instance: 874173da-ff29-46c8-b7e3-cd7e48a7f6ec] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:22:47.690200 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-51871d42-bd9b-401a-9992-871a59d19549 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:47.690675 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-51871d42-bd9b-401a-9992-871a59d19549 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:47.691115 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-51871d42-bd9b-401a-9992-871a59d19549 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:47.691836 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-51871d42-bd9b-401a-9992-871a59d19549 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:47.692294 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-51871d42-bd9b-401a-9992-871a59d19549 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:47.692728 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-51871d42-bd9b-401a-9992-871a59d19549 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:47.823437 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-51871d42-bd9b-401a-9992-871a59d19549 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1abeceefe2f94cb3a03a4241b4379b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57d94ff8ba94e86b94d3fa48c8aa75c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:22:47.831268 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-51871d42-bd9b-401a-9992-871a59d19549 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] 10.222.0.23 "GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec" status: 200 len: 1270 microversion: 2.1 time: 0.153280 Sep 10 12:22:47.831843 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3180/6352] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:22:47 2022] GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec => generated 1270 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:22:48.853906 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-281543dd-1f5c-42ad-ad17-716fbb2a1856 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:22:48.854527 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-281543dd-1f5c-42ad-ad17-716fbb2a1856 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] [instance: 874173da-ff29-46c8-b7e3-cd7e48a7f6ec] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:22:48.861645 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-281543dd-1f5c-42ad-ad17-716fbb2a1856 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:48.862131 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-281543dd-1f5c-42ad-ad17-716fbb2a1856 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:48.862568 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-281543dd-1f5c-42ad-ad17-716fbb2a1856 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:48.863299 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-281543dd-1f5c-42ad-ad17-716fbb2a1856 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:48.863756 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-281543dd-1f5c-42ad-ad17-716fbb2a1856 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:48.864187 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-281543dd-1f5c-42ad-ad17-716fbb2a1856 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:48.996356 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-281543dd-1f5c-42ad-ad17-716fbb2a1856 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1abeceefe2f94cb3a03a4241b4379b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57d94ff8ba94e86b94d3fa48c8aa75c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:22:49.004566 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-281543dd-1f5c-42ad-ad17-716fbb2a1856 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] 10.222.0.23 "GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec" status: 200 len: 1270 microversion: 2.1 time: 0.154577 Sep 10 12:22:49.005144 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3173/6353] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:22:48 2022] GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec => generated 1270 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:22:50.028350 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-19623114-4eaf-4f79-aea4-faf20eea1fd3 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:22:50.028999 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-19623114-4eaf-4f79-aea4-faf20eea1fd3 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] [instance: 874173da-ff29-46c8-b7e3-cd7e48a7f6ec] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:22:50.037210 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19623114-4eaf-4f79-aea4-faf20eea1fd3 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:50.037702 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19623114-4eaf-4f79-aea4-faf20eea1fd3 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:50.038143 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19623114-4eaf-4f79-aea4-faf20eea1fd3 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:50.038845 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19623114-4eaf-4f79-aea4-faf20eea1fd3 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:50.039344 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19623114-4eaf-4f79-aea4-faf20eea1fd3 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:50.039774 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-19623114-4eaf-4f79-aea4-faf20eea1fd3 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:50.069062 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-dd5d3e1a-2bea-4c6b-9088-5e6012f99b42 req-28d198fe-1aea-4b6e-ac46-a711a5007111 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "874173da-ff29-46c8-b7e3-cd7e48a7f6ec", "name": "network-vif-plugged", "status": "completed", "tag": "ba9b8043-7f68-4531-94cb-da752ffe711a"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:22:50.080563 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-dd5d3e1a-2bea-4c6b-9088-5e6012f99b42 req-28d198fe-1aea-4b6e-ac46-a711a5007111 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:50.081091 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-dd5d3e1a-2bea-4c6b-9088-5e6012f99b42 req-28d198fe-1aea-4b6e-ac46-a711a5007111 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:50.081542 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-dd5d3e1a-2bea-4c6b-9088-5e6012f99b42 req-28d198fe-1aea-4b6e-ac46-a711a5007111 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:50.092992 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-dd5d3e1a-2bea-4c6b-9088-5e6012f99b42 req-28d198fe-1aea-4b6e-ac46-a711a5007111 service nova] Creating event network-vif-plugged:ba9b8043-7f68-4531-94cb-da752ffe711a for instance 874173da-ff29-46c8-b7e3-cd7e48a7f6ec on n-h2-856895-1 Sep 10 12:22:50.098788 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-dd5d3e1a-2bea-4c6b-9088-5e6012f99b42 req-28d198fe-1aea-4b6e-ac46-a711a5007111 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034483 Sep 10 12:22:50.099440 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3174/6354] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:22:50.205892 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-19623114-4eaf-4f79-aea4-faf20eea1fd3 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1abeceefe2f94cb3a03a4241b4379b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57d94ff8ba94e86b94d3fa48c8aa75c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:22:50.213903 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-19623114-4eaf-4f79-aea4-faf20eea1fd3 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] 10.222.0.23 "GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec" status: 200 len: 1270 microversion: 2.1 time: 0.189649 Sep 10 12:22:50.214485 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3181/6355] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:22:50 2022] GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec => generated 1270 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:22:51.239243 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-540e0202-52b8-463f-90a8-38fd5a86f6a9 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:22:51.239953 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-540e0202-52b8-463f-90a8-38fd5a86f6a9 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] [instance: 874173da-ff29-46c8-b7e3-cd7e48a7f6ec] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:22:51.246260 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-540e0202-52b8-463f-90a8-38fd5a86f6a9 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:51.246745 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-540e0202-52b8-463f-90a8-38fd5a86f6a9 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:51.247215 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-540e0202-52b8-463f-90a8-38fd5a86f6a9 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:51.247919 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-540e0202-52b8-463f-90a8-38fd5a86f6a9 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:51.248377 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-540e0202-52b8-463f-90a8-38fd5a86f6a9 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:51.248807 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-540e0202-52b8-463f-90a8-38fd5a86f6a9 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:51.264923 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e02e8890-8182-471b-a518-cf7c5f7f6ed9 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:22:51.265911 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e02e8890-8182-471b-a518-cf7c5f7f6ed9 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: d95ef740-125c-44a7-b33f-8e2a347639f1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:22:51.270803 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:22:51.276323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e02e8890-8182-471b-a518-cf7c5f7f6ed9 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:51.277128 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e02e8890-8182-471b-a518-cf7c5f7f6ed9 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:51.277578 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e02e8890-8182-471b-a518-cf7c5f7f6ed9 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:51.278294 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e02e8890-8182-471b-a518-cf7c5f7f6ed9 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:51.278757 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e02e8890-8182-471b-a518-cf7c5f7f6ed9 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:51.279214 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e02e8890-8182-471b-a518-cf7c5f7f6ed9 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:51.283011 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=55 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:22:51.458379 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-540e0202-52b8-463f-90a8-38fd5a86f6a9 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1abeceefe2f94cb3a03a4241b4379b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57d94ff8ba94e86b94d3fa48c8aa75c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:22:51.466488 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-540e0202-52b8-463f-90a8-38fd5a86f6a9 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] 10.222.0.23 "GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec" status: 200 len: 1460 microversion: 2.1 time: 0.232912 Sep 10 12:22:51.466998 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e02e8890-8182-471b-a518-cf7c5f7f6ed9 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:22:51.467551 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3175/6356] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:22:51 2022] GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec => generated 1460 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:22:51.474857 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e02e8890-8182-471b-a518-cf7c5f7f6ed9 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1" status: 200 len: 1683 microversion: 2.1 time: 0.214810 Sep 10 12:22:51.475546 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3182/6357] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:22:51 2022] GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1 => generated 1683 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:22:51.488398 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-de758c90-ab18-4b11-81ae-f7f9e02a3584 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:22:51.489072 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-de758c90-ab18-4b11-81ae-f7f9e02a3584 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] [instance: 874173da-ff29-46c8-b7e3-cd7e48a7f6ec] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:22:51.494954 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-de758c90-ab18-4b11-81ae-f7f9e02a3584 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:51.495469 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-de758c90-ab18-4b11-81ae-f7f9e02a3584 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:51.495900 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-de758c90-ab18-4b11-81ae-f7f9e02a3584 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:51.496588 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-de758c90-ab18-4b11-81ae-f7f9e02a3584 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:51.497044 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-de758c90-ab18-4b11-81ae-f7f9e02a3584 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:51.497466 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-de758c90-ab18-4b11-81ae-f7f9e02a3584 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:51.605475 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1fc3eedc-181a-4a59-bfc9-714d7d16bbbd tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:22:51.607812 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1fc3eedc-181a-4a59-bfc9-714d7d16bbbd tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: d95ef740-125c-44a7-b33f-8e2a347639f1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:22:51.614542 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1fc3eedc-181a-4a59-bfc9-714d7d16bbbd tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:51.615038 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1fc3eedc-181a-4a59-bfc9-714d7d16bbbd tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:51.615526 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1fc3eedc-181a-4a59-bfc9-714d7d16bbbd tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:51.616244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1fc3eedc-181a-4a59-bfc9-714d7d16bbbd tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:51.616690 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1fc3eedc-181a-4a59-bfc9-714d7d16bbbd tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:51.617118 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1fc3eedc-181a-4a59-bfc9-714d7d16bbbd tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:51.654605 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-de758c90-ab18-4b11-81ae-f7f9e02a3584 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1abeceefe2f94cb3a03a4241b4379b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57d94ff8ba94e86b94d3fa48c8aa75c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:22:51.663011 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-de758c90-ab18-4b11-81ae-f7f9e02a3584 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] 10.222.0.23 "GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec" status: 200 len: 1460 microversion: 2.1 time: 0.178702 Sep 10 12:22:51.663611 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3176/6358] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:22:51 2022] GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec => generated 1460 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:22:51.685482 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1fc3eedc-181a-4a59-bfc9-714d7d16bbbd tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "POST /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1/action" status: 200 len: 32639 microversion: 2.1 time: 0.084272 Sep 10 12:22:51.686450 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3183/6359] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:22:51 2022] POST /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1/action => generated 32639 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 10 12:22:51.870456 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9afae0d5-a9ed-4e12-a692-d1416102db6c tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:22:51.871075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9afae0d5-a9ed-4e12-a692-d1416102db6c tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] [instance: d95ef740-125c-44a7-b33f-8e2a347639f1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:22:51.877967 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9afae0d5-a9ed-4e12-a692-d1416102db6c tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:51.878455 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9afae0d5-a9ed-4e12-a692-d1416102db6c tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:51.878891 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9afae0d5-a9ed-4e12-a692-d1416102db6c tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:51.879618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9afae0d5-a9ed-4e12-a692-d1416102db6c tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:51.880075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9afae0d5-a9ed-4e12-a692-d1416102db6c tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:51.880504 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9afae0d5-a9ed-4e12-a692-d1416102db6c tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:52.103587 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9afae0d5-a9ed-4e12-a692-d1416102db6c tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1" status: 200 len: 1834 microversion: 2.1 time: 0.236878 Sep 10 12:22:52.104191 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3177/6360] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:22:51 2022] GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1 => generated 1834 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:22:52.135696 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d3879acd-0c65-4f41-b4f1-078e5bade3e7 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:22:52.138757 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d3879acd-0c65-4f41-b4f1-078e5bade3e7 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] [instance: d95ef740-125c-44a7-b33f-8e2a347639f1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:22:52.146465 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d3879acd-0c65-4f41-b4f1-078e5bade3e7 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:52.146982 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d3879acd-0c65-4f41-b4f1-078e5bade3e7 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:52.147448 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d3879acd-0c65-4f41-b4f1-078e5bade3e7 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:52.148153 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d3879acd-0c65-4f41-b4f1-078e5bade3e7 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:52.148613 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d3879acd-0c65-4f41-b4f1-078e5bade3e7 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:52.149056 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d3879acd-0c65-4f41-b4f1-078e5bade3e7 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:52.175029 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-d3879acd-0c65-4f41-b4f1-078e5bade3e7 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Lazy-loading 'flavor' on Instance uuid d95ef740-125c-44a7-b33f-8e2a347639f1 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:22:52.188016 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d3879acd-0c65-4f41-b4f1-078e5bade3e7 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] [instance: d95ef740-125c-44a7-b33f-8e2a347639f1] Going to try to live migrate instance to another host {{(pid=128776) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 10 12:22:53.564732 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-6a12239a-3e8c-465e-bd29-b7d713cba1cc req-0177940a-871e-4e32-ac70-7b5ee15ba551 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "874173da-ff29-46c8-b7e3-cd7e48a7f6ec", "tag": "ba9b8043-7f68-4531-94cb-da752ffe711a"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:22:53.574597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-6a12239a-3e8c-465e-bd29-b7d713cba1cc req-0177940a-871e-4e32-ac70-7b5ee15ba551 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:53.575018 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-6a12239a-3e8c-465e-bd29-b7d713cba1cc req-0177940a-871e-4e32-ac70-7b5ee15ba551 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:53.575466 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-6a12239a-3e8c-465e-bd29-b7d713cba1cc req-0177940a-871e-4e32-ac70-7b5ee15ba551 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:53.590508 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-6a12239a-3e8c-465e-bd29-b7d713cba1cc req-0177940a-871e-4e32-ac70-7b5ee15ba551 service nova] Creating event network-changed:ba9b8043-7f68-4531-94cb-da752ffe711a for instance 874173da-ff29-46c8-b7e3-cd7e48a7f6ec on n-h2-856895-1 Sep 10 12:22:53.596057 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-6a12239a-3e8c-465e-bd29-b7d713cba1cc req-0177940a-871e-4e32-ac70-7b5ee15ba551 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107929 Sep 10 12:22:53.596855 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3178/6361] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:22:53.618175 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d3879acd-0c65-4f41-b4f1-078e5bade3e7 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1/action" status: 202 len: 0 microversion: 2.1 time: 1.486647 Sep 10 12:22:53.622998 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3184/6362] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:22:52 2022] POST /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1/action => generated 0 bytes in 1489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:22:53.632596 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c10ec823-4f59-4ef4-9699-44d876e05b48 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:22:53.635329 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c10ec823-4f59-4ef4-9699-44d876e05b48 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: d95ef740-125c-44a7-b33f-8e2a347639f1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:22:53.651568 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c10ec823-4f59-4ef4-9699-44d876e05b48 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:53.652502 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c10ec823-4f59-4ef4-9699-44d876e05b48 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:53.653384 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c10ec823-4f59-4ef4-9699-44d876e05b48 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:53.654722 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c10ec823-4f59-4ef4-9699-44d876e05b48 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:53.655626 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c10ec823-4f59-4ef4-9699-44d876e05b48 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:53.656321 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c10ec823-4f59-4ef4-9699-44d876e05b48 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:53.951425 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c10ec823-4f59-4ef4-9699-44d876e05b48 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:22:53.960445 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c10ec823-4f59-4ef4-9699-44d876e05b48 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1" status: 200 len: 1693 microversion: 2.1 time: 0.335352 Sep 10 12:22:53.972278 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3179/6363] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:22:53 2022] GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1 => generated 1693 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:22:54.987582 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b14da79c-951c-4f6e-a1d0-eb63b15c88ee tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:22:54.988305 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b14da79c-951c-4f6e-a1d0-eb63b15c88ee tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: d95ef740-125c-44a7-b33f-8e2a347639f1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:22:54.996049 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b14da79c-951c-4f6e-a1d0-eb63b15c88ee tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:54.996624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b14da79c-951c-4f6e-a1d0-eb63b15c88ee tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:54.997143 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b14da79c-951c-4f6e-a1d0-eb63b15c88ee tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:54.997925 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b14da79c-951c-4f6e-a1d0-eb63b15c88ee tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:54.998463 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b14da79c-951c-4f6e-a1d0-eb63b15c88ee tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:54.998990 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b14da79c-951c-4f6e-a1d0-eb63b15c88ee tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:55.322209 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b14da79c-951c-4f6e-a1d0-eb63b15c88ee tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:22:55.332156 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b14da79c-951c-4f6e-a1d0-eb63b15c88ee tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1" status: 200 len: 1693 microversion: 2.1 time: 0.349613 Sep 10 12:22:55.333071 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3185/6364] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:22:54 2022] GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1 => generated 1693 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:22:55.653955 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-a4280ee2-4595-41cd-b9f1-9303108a4e70 req-e8aa225b-23b8-4109-9ffc-10f1931d53f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "874173da-ff29-46c8-b7e3-cd7e48a7f6ec", "tag": "ba9b8043-7f68-4531-94cb-da752ffe711a"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:22:55.668215 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a4280ee2-4595-41cd-b9f1-9303108a4e70 req-e8aa225b-23b8-4109-9ffc-10f1931d53f3 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:55.669497 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a4280ee2-4595-41cd-b9f1-9303108a4e70 req-e8aa225b-23b8-4109-9ffc-10f1931d53f3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:55.669946 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a4280ee2-4595-41cd-b9f1-9303108a4e70 req-e8aa225b-23b8-4109-9ffc-10f1931d53f3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:55.683785 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-a4280ee2-4595-41cd-b9f1-9303108a4e70 req-e8aa225b-23b8-4109-9ffc-10f1931d53f3 service nova] Creating event network-changed:ba9b8043-7f68-4531-94cb-da752ffe711a for instance 874173da-ff29-46c8-b7e3-cd7e48a7f6ec on n-h2-856895-1 Sep 10 12:22:55.690638 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-a4280ee2-4595-41cd-b9f1-9303108a4e70 req-e8aa225b-23b8-4109-9ffc-10f1931d53f3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041339 Sep 10 12:22:55.691327 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3180/6365] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:22:56.363006 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-957ce803-28a1-416e-a00e-9f5a7d830458 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:22:56.363678 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-957ce803-28a1-416e-a00e-9f5a7d830458 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: d95ef740-125c-44a7-b33f-8e2a347639f1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:22:56.371474 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-957ce803-28a1-416e-a00e-9f5a7d830458 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:56.372253 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-957ce803-28a1-416e-a00e-9f5a7d830458 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:56.372879 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-957ce803-28a1-416e-a00e-9f5a7d830458 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:56.373777 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-957ce803-28a1-416e-a00e-9f5a7d830458 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:56.374422 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-957ce803-28a1-416e-a00e-9f5a7d830458 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:56.375015 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-957ce803-28a1-416e-a00e-9f5a7d830458 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:56.574268 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-957ce803-28a1-416e-a00e-9f5a7d830458 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:22:56.583575 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-957ce803-28a1-416e-a00e-9f5a7d830458 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1" status: 200 len: 1693 microversion: 2.1 time: 0.225281 Sep 10 12:22:56.584331 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3186/6366] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:22:56 2022] GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1 => generated 1693 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:22:57.608944 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-633a7bb9-132b-4fc8-a9c0-f98964e9c327 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:22:57.609576 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-633a7bb9-132b-4fc8-a9c0-f98964e9c327 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: d95ef740-125c-44a7-b33f-8e2a347639f1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:22:57.612670 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:22:57.618160 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-633a7bb9-132b-4fc8-a9c0-f98964e9c327 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:57.618645 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-633a7bb9-132b-4fc8-a9c0-f98964e9c327 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:57.619086 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-633a7bb9-132b-4fc8-a9c0-f98964e9c327 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:57.619815 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-633a7bb9-132b-4fc8-a9c0-f98964e9c327 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:57.620301 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-633a7bb9-132b-4fc8-a9c0-f98964e9c327 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:57.620727 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-633a7bb9-132b-4fc8-a9c0-f98964e9c327 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:57.625410 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=75 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:22:57.713928 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-79e6bd3e-5887-4afd-93e0-d4508a60ae52 req-c4f16540-a4c9-4c44-913e-081a5075b970 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "874173da-ff29-46c8-b7e3-cd7e48a7f6ec", "tag": "ba9b8043-7f68-4531-94cb-da752ffe711a"}, {"server_uuid": "d95ef740-125c-44a7-b33f-8e2a347639f1", "name": "network-vif-unplugged", "status": "completed", "tag": "6b36f2dd-378e-4a9e-8b7e-e606079806f2"}, {"name": "network-changed", "server_uuid": "d95ef740-125c-44a7-b33f-8e2a347639f1", "tag": "6b36f2dd-378e-4a9e-8b7e-e606079806f2"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:22:57.725854 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-79e6bd3e-5887-4afd-93e0-d4508a60ae52 req-c4f16540-a4c9-4c44-913e-081a5075b970 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:57.726339 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-79e6bd3e-5887-4afd-93e0-d4508a60ae52 req-c4f16540-a4c9-4c44-913e-081a5075b970 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:57.726775 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-79e6bd3e-5887-4afd-93e0-d4508a60ae52 req-c4f16540-a4c9-4c44-913e-081a5075b970 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:57.740418 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-79e6bd3e-5887-4afd-93e0-d4508a60ae52 req-c4f16540-a4c9-4c44-913e-081a5075b970 service nova] Creating event network-changed:ba9b8043-7f68-4531-94cb-da752ffe711a for instance 874173da-ff29-46c8-b7e3-cd7e48a7f6ec on n-h2-856895-1 Sep 10 12:22:57.740930 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-79e6bd3e-5887-4afd-93e0-d4508a60ae52 req-c4f16540-a4c9-4c44-913e-081a5075b970 service nova] Creating event network-vif-unplugged:6b36f2dd-378e-4a9e-8b7e-e606079806f2 for instance d95ef740-125c-44a7-b33f-8e2a347639f1 on n-h1-856895-1 Sep 10 12:22:57.741432 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-79e6bd3e-5887-4afd-93e0-d4508a60ae52 req-c4f16540-a4c9-4c44-913e-081a5075b970 service nova] Creating event network-changed:6b36f2dd-378e-4a9e-8b7e-e606079806f2 for instance d95ef740-125c-44a7-b33f-8e2a347639f1 on n-h1-856895-1 Sep 10 12:22:57.749895 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-79e6bd3e-5887-4afd-93e0-d4508a60ae52 req-c4f16540-a4c9-4c44-913e-081a5075b970 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.039760 Sep 10 12:22:57.750572 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3187/6367] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:22:57.765121 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-633a7bb9-132b-4fc8-a9c0-f98964e9c327 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:22:57.773355 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-633a7bb9-132b-4fc8-a9c0-f98964e9c327 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1" status: 200 len: 1693 microversion: 2.1 time: 0.169553 Sep 10 12:22:57.773978 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3181/6368] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:22:57 2022] GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1 => generated 1693 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:22:58.799883 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-65e8e4ec-f9a2-4b27-b4ec-7caccb57b746 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:22:58.800526 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-65e8e4ec-f9a2-4b27-b4ec-7caccb57b746 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: d95ef740-125c-44a7-b33f-8e2a347639f1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:22:58.807040 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65e8e4ec-f9a2-4b27-b4ec-7caccb57b746 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:58.807560 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65e8e4ec-f9a2-4b27-b4ec-7caccb57b746 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:58.808020 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65e8e4ec-f9a2-4b27-b4ec-7caccb57b746 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:58.808705 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65e8e4ec-f9a2-4b27-b4ec-7caccb57b746 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:58.809166 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65e8e4ec-f9a2-4b27-b4ec-7caccb57b746 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:58.809600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-65e8e4ec-f9a2-4b27-b4ec-7caccb57b746 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:58.942554 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-65e8e4ec-f9a2-4b27-b4ec-7caccb57b746 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:22:58.950300 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-65e8e4ec-f9a2-4b27-b4ec-7caccb57b746 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1" status: 200 len: 1693 microversion: 2.1 time: 0.156189 Sep 10 12:22:58.950880 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3188/6369] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:22:58 2022] GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1 => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:22:59.972792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-574a4272-557e-4572-938f-7e87e904fb3f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:22:59.973413 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-574a4272-557e-4572-938f-7e87e904fb3f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: d95ef740-125c-44a7-b33f-8e2a347639f1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:22:59.980083 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-574a4272-557e-4572-938f-7e87e904fb3f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:59.980573 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-574a4272-557e-4572-938f-7e87e904fb3f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:59.981009 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-574a4272-557e-4572-938f-7e87e904fb3f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:22:59.981697 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-574a4272-557e-4572-938f-7e87e904fb3f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:22:59.982359 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-574a4272-557e-4572-938f-7e87e904fb3f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:22:59.982567 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-574a4272-557e-4572-938f-7e87e904fb3f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:00.412127 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-574a4272-557e-4572-938f-7e87e904fb3f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:23:00.419875 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-574a4272-557e-4572-938f-7e87e904fb3f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1" status: 200 len: 1693 microversion: 2.1 time: 0.451181 Sep 10 12:23:00.420475 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3182/6370] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:22:59 2022] GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1 => generated 1693 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:23:01.442885 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6e44972a-7b52-4f61-8c5d-6f808f53f9cc tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:23:01.443484 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6e44972a-7b52-4f61-8c5d-6f808f53f9cc tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: d95ef740-125c-44a7-b33f-8e2a347639f1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:23:01.450418 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e44972a-7b52-4f61-8c5d-6f808f53f9cc tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:01.450903 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e44972a-7b52-4f61-8c5d-6f808f53f9cc tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:01.451383 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e44972a-7b52-4f61-8c5d-6f808f53f9cc tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:01.452075 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e44972a-7b52-4f61-8c5d-6f808f53f9cc tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:01.452540 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e44972a-7b52-4f61-8c5d-6f808f53f9cc tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:01.452974 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e44972a-7b52-4f61-8c5d-6f808f53f9cc tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:01.631780 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6e44972a-7b52-4f61-8c5d-6f808f53f9cc tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:23:01.639562 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6e44972a-7b52-4f61-8c5d-6f808f53f9cc tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1" status: 200 len: 1693 microversion: 2.1 time: 0.200671 Sep 10 12:23:01.640144 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3189/6371] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:23:01 2022] GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1 => generated 1693 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:23:02.664431 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-64a41182-254e-4f42-9279-af9b14e9b932 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:23:02.665228 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-64a41182-254e-4f42-9279-af9b14e9b932 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: d95ef740-125c-44a7-b33f-8e2a347639f1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:23:02.672222 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-64a41182-254e-4f42-9279-af9b14e9b932 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:02.672720 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-64a41182-254e-4f42-9279-af9b14e9b932 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:02.673169 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-64a41182-254e-4f42-9279-af9b14e9b932 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:02.674848 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-64a41182-254e-4f42-9279-af9b14e9b932 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:02.675352 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-64a41182-254e-4f42-9279-af9b14e9b932 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:02.675791 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-64a41182-254e-4f42-9279-af9b14e9b932 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:02.899759 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-64a41182-254e-4f42-9279-af9b14e9b932 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:23:02.909150 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-64a41182-254e-4f42-9279-af9b14e9b932 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1" status: 200 len: 1693 microversion: 2.1 time: 0.248772 Sep 10 12:23:02.909908 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3183/6372] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:23:02 2022] GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1 => generated 1693 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:23:03.934632 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8d30f4c4-5942-4c26-aba9-d90daf6d2d48 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:23:03.935280 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8d30f4c4-5942-4c26-aba9-d90daf6d2d48 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: d95ef740-125c-44a7-b33f-8e2a347639f1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:23:03.942381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8d30f4c4-5942-4c26-aba9-d90daf6d2d48 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:03.942858 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8d30f4c4-5942-4c26-aba9-d90daf6d2d48 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:03.943321 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8d30f4c4-5942-4c26-aba9-d90daf6d2d48 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:03.944006 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8d30f4c4-5942-4c26-aba9-d90daf6d2d48 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:03.944473 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8d30f4c4-5942-4c26-aba9-d90daf6d2d48 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:03.944883 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8d30f4c4-5942-4c26-aba9-d90daf6d2d48 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:04.076967 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8d30f4c4-5942-4c26-aba9-d90daf6d2d48 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:23:04.085452 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8d30f4c4-5942-4c26-aba9-d90daf6d2d48 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1" status: 200 len: 1683 microversion: 2.1 time: 0.154750 Sep 10 12:23:04.086032 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3190/6373] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:23:03 2022] GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:23:04.109496 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-01f4fb8f-b264-4520-b832-c6f7741bcca9 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:23:04.110031 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-01f4fb8f-b264-4520-b832-c6f7741bcca9 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] [instance: d95ef740-125c-44a7-b33f-8e2a347639f1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:23:04.117389 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-01f4fb8f-b264-4520-b832-c6f7741bcca9 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:04.117881 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-01f4fb8f-b264-4520-b832-c6f7741bcca9 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:04.118326 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-01f4fb8f-b264-4520-b832-c6f7741bcca9 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:04.119032 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-01f4fb8f-b264-4520-b832-c6f7741bcca9 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:04.119520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-01f4fb8f-b264-4520-b832-c6f7741bcca9 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:04.119955 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-01f4fb8f-b264-4520-b832-c6f7741bcca9 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:04.253112 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-01f4fb8f-b264-4520-b832-c6f7741bcca9 tempest-TestNetworkAdvancedServerOps-403119196 tempest-TestNetworkAdvancedServerOps-403119196-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1" status: 200 len: 1834 microversion: 2.1 time: 0.147380 Sep 10 12:23:04.253694 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3184/6374] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:23:04 2022] GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1 => generated 1834 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:23:04.277019 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2b3e8fd4-5177-48e3-a962-1fb63897feb6 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:23:04.277645 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2b3e8fd4-5177-48e3-a962-1fb63897feb6 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: d95ef740-125c-44a7-b33f-8e2a347639f1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:23:04.283710 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2b3e8fd4-5177-48e3-a962-1fb63897feb6 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:04.284195 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2b3e8fd4-5177-48e3-a962-1fb63897feb6 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:04.284634 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2b3e8fd4-5177-48e3-a962-1fb63897feb6 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:04.285327 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2b3e8fd4-5177-48e3-a962-1fb63897feb6 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:04.285787 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2b3e8fd4-5177-48e3-a962-1fb63897feb6 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:04.286220 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2b3e8fd4-5177-48e3-a962-1fb63897feb6 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:04.424580 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2b3e8fd4-5177-48e3-a962-1fb63897feb6 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:23:04.432333 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2b3e8fd4-5177-48e3-a962-1fb63897feb6 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1" status: 200 len: 1683 microversion: 2.1 time: 0.159463 Sep 10 12:23:04.432906 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3191/6375] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:23:04 2022] GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:23:04.527830 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0afa4339-1604-4738-8388-dcc05e278643 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:23:04.530636 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0afa4339-1604-4738-8388-dcc05e278643 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: d95ef740-125c-44a7-b33f-8e2a347639f1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:23:04.537329 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0afa4339-1604-4738-8388-dcc05e278643 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:04.537809 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0afa4339-1604-4738-8388-dcc05e278643 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:04.538244 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0afa4339-1604-4738-8388-dcc05e278643 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:04.538934 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0afa4339-1604-4738-8388-dcc05e278643 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:04.539421 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0afa4339-1604-4738-8388-dcc05e278643 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:04.539842 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0afa4339-1604-4738-8388-dcc05e278643 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:04.594030 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0afa4339-1604-4738-8388-dcc05e278643 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "POST /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1/action" status: 200 len: 38637 microversion: 2.1 time: 0.069996 Sep 10 12:23:04.594673 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3185/6376] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:23:04 2022] POST /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1/action => generated 38637 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 12:23:05.561443 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-201f697d-e509-4f83-9829-75d41a9bb6d9 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:23:05.562071 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-201f697d-e509-4f83-9829-75d41a9bb6d9 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: d95ef740-125c-44a7-b33f-8e2a347639f1] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:23:05.563386 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-f8f7dd49-4b34-429f-8bff-826163061983 req-c8df1ad3-250e-4c78-be9a-a727cc278937 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d95ef740-125c-44a7-b33f-8e2a347639f1", "tag": "6b36f2dd-378e-4a9e-8b7e-e606079806f2"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:23:05.569751 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-201f697d-e509-4f83-9829-75d41a9bb6d9 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:05.570376 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-201f697d-e509-4f83-9829-75d41a9bb6d9 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:05.570946 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-201f697d-e509-4f83-9829-75d41a9bb6d9 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:05.571814 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-201f697d-e509-4f83-9829-75d41a9bb6d9 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:05.572382 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-201f697d-e509-4f83-9829-75d41a9bb6d9 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:05.572920 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-201f697d-e509-4f83-9829-75d41a9bb6d9 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:05.574190 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-f8f7dd49-4b34-429f-8bff-826163061983 req-c8df1ad3-250e-4c78-be9a-a727cc278937 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:05.574892 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-f8f7dd49-4b34-429f-8bff-826163061983 req-c8df1ad3-250e-4c78-be9a-a727cc278937 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:05.575663 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-f8f7dd49-4b34-429f-8bff-826163061983 req-c8df1ad3-250e-4c78-be9a-a727cc278937 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:05.588680 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-f8f7dd49-4b34-429f-8bff-826163061983 req-c8df1ad3-250e-4c78-be9a-a727cc278937 service nova] Creating event network-changed:6b36f2dd-378e-4a9e-8b7e-e606079806f2 for instance d95ef740-125c-44a7-b33f-8e2a347639f1 on n-h2-856895-1 Sep 10 12:23:05.593886 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-f8f7dd49-4b34-429f-8bff-826163061983 req-c8df1ad3-250e-4c78-be9a-a727cc278937 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034397 Sep 10 12:23:05.594503 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3186/6377] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:23:05.605223 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-201f697d-e509-4f83-9829-75d41a9bb6d9 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: d95ef740-125c-44a7-b33f-8e2a347639f1] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:23:05.691643 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-201f697d-e509-4f83-9829-75d41a9bb6d9 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1" status: 204 len: 0 microversion: 2.1 time: 0.133515 Sep 10 12:23:05.692654 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3192/6378] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:23:05 2022] DELETE /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:23:05.702635 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a72272f4-7158-452d-aa6c-4b607f41b811 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:23:05.703534 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a72272f4-7158-452d-aa6c-4b607f41b811 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: d95ef740-125c-44a7-b33f-8e2a347639f1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:23:05.712846 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a72272f4-7158-452d-aa6c-4b607f41b811 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:05.713505 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a72272f4-7158-452d-aa6c-4b607f41b811 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:05.714049 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a72272f4-7158-452d-aa6c-4b607f41b811 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:05.714893 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a72272f4-7158-452d-aa6c-4b607f41b811 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:05.715494 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a72272f4-7158-452d-aa6c-4b607f41b811 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:05.716215 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a72272f4-7158-452d-aa6c-4b607f41b811 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:06.004423 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a72272f4-7158-452d-aa6c-4b607f41b811 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:23:06.013310 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a72272f4-7158-452d-aa6c-4b607f41b811 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1" status: 200 len: 1689 microversion: 2.1 time: 0.315746 Sep 10 12:23:06.013897 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3187/6379] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:23:05 2022] GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1 => generated 1689 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:23:06.699777 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-22acaa01-03a0-4df2-9a7a-fe0f37d98d3e req-801eb287-6ffb-4e39-b062-522d1e84c94c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d95ef740-125c-44a7-b33f-8e2a347639f1", "name": "network-vif-deleted", "tag": "6b36f2dd-378e-4a9e-8b7e-e606079806f2"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:23:06.719433 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-22acaa01-03a0-4df2-9a7a-fe0f37d98d3e req-801eb287-6ffb-4e39-b062-522d1e84c94c service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:06.720156 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-22acaa01-03a0-4df2-9a7a-fe0f37d98d3e req-801eb287-6ffb-4e39-b062-522d1e84c94c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:06.721720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-22acaa01-03a0-4df2-9a7a-fe0f37d98d3e req-801eb287-6ffb-4e39-b062-522d1e84c94c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:06.737462 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-22acaa01-03a0-4df2-9a7a-fe0f37d98d3e req-801eb287-6ffb-4e39-b062-522d1e84c94c service nova] Creating event network-vif-deleted:6b36f2dd-378e-4a9e-8b7e-e606079806f2 for instance d95ef740-125c-44a7-b33f-8e2a347639f1 on n-h2-856895-1 Sep 10 12:23:06.742950 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-22acaa01-03a0-4df2-9a7a-fe0f37d98d3e req-801eb287-6ffb-4e39-b062-522d1e84c94c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047481 Sep 10 12:23:06.743952 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3193/6380] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:23:07.038672 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4cd18163-0b0f-4289-92b5-b88b2f88d89c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:23:07.039348 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4cd18163-0b0f-4289-92b5-b88b2f88d89c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: d95ef740-125c-44a7-b33f-8e2a347639f1] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:23:07.046347 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4cd18163-0b0f-4289-92b5-b88b2f88d89c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:07.046836 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4cd18163-0b0f-4289-92b5-b88b2f88d89c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:07.047337 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4cd18163-0b0f-4289-92b5-b88b2f88d89c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:07.048042 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4cd18163-0b0f-4289-92b5-b88b2f88d89c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:07.049076 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4cd18163-0b0f-4289-92b5-b88b2f88d89c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:07.050169 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4cd18163-0b0f-4289-92b5-b88b2f88d89c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:07.065918 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-4cd18163-0b0f-4289-92b5-b88b2f88d89c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] HTTP exception thrown: Instance d95ef740-125c-44a7-b33f-8e2a347639f1 could not be found. Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4cd18163-0b0f-4289-92b5-b88b2f88d89c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Request method failure captured: Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1 HTTP/1.1 Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH_yhS9kjuGqOnMliECmKXRPPzhZsHLNJh-k2Dy3sZVddODjZkI9QVirO2WV-k2QGWioorUvQwYXUbLO2mq09vb7kUE53WetDg0b2epWCfO81IA_d1hE4us0m3Xe_F7464Bi0Mnf9Ik8sGoKIy1FuftdqKYzeLjY2ezWMG2puAQMwhw Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 68cfd58791b5445b9a52bc02a5eb255b Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-223880240 Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/68cfd58791b5445b9a52bc02a5eb255b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/68cfd58791b5445b9a52bc02a5eb255b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_68cfd58791b5445b9a52bc02a5eb255b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/68cfd58791b5445b9a52bc02a5eb255b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-TestNetworkAdvancedServerOps-223880240 Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 68cfd58791b5445b9a52bc02a5eb255b Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-223880240 Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-TestNetworkAdvancedServerOps-223880240-project Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: fbd98ab9ebde4e84b03aed2e694ddf04 Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-TestNetworkAdvancedServerOps-223880240-project Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance d95ef740-125c-44a7-b33f-8e2a347639f1 could not be found. Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'd95ef740-125c-44a7-b33f-8e2a347639f1'} Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d95ef740-125c-44a7-b33f-8e2a347639f1 could not be found. Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d95ef740-125c-44a7-b33f-8e2a347639f1 could not be found. Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:23:07.067635 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:23:07.072648 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:23:07.072648 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:23:07.072648 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:23:07.072648 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:23:07.072648 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:23:07.072648 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:23:07.072648 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d95ef740-125c-44a7-b33f-8e2a347639f1 could not be found. Sep 10 12:23:07.072648 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:23:07.072648 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4cd18163-0b0f-4289-92b5-b88b2f88d89c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Returning 404 to user: Instance d95ef740-125c-44a7-b33f-8e2a347639f1 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:23:07.072648 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4cd18163-0b0f-4289-92b5-b88b2f88d89c tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1" status: 404 len: 111 microversion: 2.1 time: 0.034425 Sep 10 12:23:07.073629 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3188/6381] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:23:07 2022] GET /compute/v2.1/servers/d95ef740-125c-44a7-b33f-8e2a347639f1 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:23:10.544900 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3213b736-24aa-4b8e-8ce9-088321365ada tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '.version_select at 0x7f40720edf70>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:23:10.566483 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3213b736-24aa-4b8e-8ce9-088321365ada tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1835965802" status: 202 len: 0 microversion: 2.1 time: 0.025677 Sep 10 12:23:10.567143 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3194/6382] 10.222.0.23 () {58 vars in 1284 bytes} [Sat Sep 10 12:23:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1835965802 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:23:10.597077 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-12d978c8-bde2-4c66-9c07-cf19feff241e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Action: 'create', calling method: .version_select at 0x7f407368bc10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-711872619", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGcTBFIHg2YOQg+YNw9xEb7Sxy4V7wrNTkSCc6ZgTMnbiOY0EHeGHhGfqo7s3h1xFqnct7CgTMz+eRMh/sAA4aIiMuCARG0nG4HLin2oYAMJtAs5eU9tZHZwXFBNynKseQ=="}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:23:10.615293 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-12d978c8-bde2-4c66-9c07-cf19feff241e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Getting quotas for project 68cfd58791b5445b9a52bc02a5eb255b. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:23:10.620324 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-12d978c8-bde2-4c66-9c07-cf19feff241e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Getting quotas for user fbd98ab9ebde4e84b03aed2e694ddf04 and project 68cfd58791b5445b9a52bc02a5eb255b. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:23:10.645505 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-12d978c8-bde2-4c66-9c07-cf19feff241e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.053680 Sep 10 12:23:10.646285 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3189/6383] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 12:23:10 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:23:16.119873 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7757454d-dc21-44c4-8ed0-1631f4802d36 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1525910811", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "b881cab1-59df-415d-955a-5fca9c1e7bc3"}], "key_name": "tempest-TestNetworkAdvancedServerOps-711872619", "security_groups": [{"name": "tempest-secgroup-smoke-1785153592"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:23:16.338419 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-7757454d-dc21-44c4-8ed0-1631f4802d36 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] validate_networks() for [('b881cab1-59df-415d-955a-5fca9c1e7bc3', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:23:16.729309 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:23:17.253840 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-7757454d-dc21-44c4-8ed0-1631f4802d36 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:23:17.254421 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-7757454d-dc21-44c4-8ed0-1631f4802d36 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:23:17.254734 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-7757454d-dc21-44c4-8ed0-1631f4802d36 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:23:17.255342 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-7757454d-dc21-44c4-8ed0-1631f4802d36 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:23:17.255766 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-7757454d-dc21-44c4-8ed0-1631f4802d36 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:23:17.265473 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7757454d-dc21-44c4-8ed0-1631f4802d36 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:17.266085 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7757454d-dc21-44c4-8ed0-1631f4802d36 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:17.266570 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7757454d-dc21-44c4-8ed0-1631f4802d36 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:17.268049 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7757454d-dc21-44c4-8ed0-1631f4802d36 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:17.268514 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7757454d-dc21-44c4-8ed0-1631f4802d36 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:17.268950 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7757454d-dc21-44c4-8ed0-1631f4802d36 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:17.286737 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-7757454d-dc21-44c4-8ed0-1631f4802d36 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Getting quotas for project 68cfd58791b5445b9a52bc02a5eb255b. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:23:17.292211 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-7757454d-dc21-44c4-8ed0-1631f4802d36 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Getting quotas for user fbd98ab9ebde4e84b03aed2e694ddf04 and project 68cfd58791b5445b9a52bc02a5eb255b. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:23:17.305177 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7757454d-dc21-44c4-8ed0-1631f4802d36 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:23:17.307703 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7757454d-dc21-44c4-8ed0-1631f4802d36 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 0cd2d0dd-638b-4857-807b-092fcb76f632] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:23:17.362662 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7757454d-dc21-44c4-8ed0-1631f4802d36 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.247367 Sep 10 12:23:17.363416 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3195/6384] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:23:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 1249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:23:17.374763 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2dc7462b-4c6f-400f-b662-4f35410d5be0 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:23:17.375426 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2dc7462b-4c6f-400f-b662-4f35410d5be0 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 0cd2d0dd-638b-4857-807b-092fcb76f632] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:23:17.379016 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=37 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:23:17.451033 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2dc7462b-4c6f-400f-b662-4f35410d5be0 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:23:17.459419 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2dc7462b-4c6f-400f-b662-4f35410d5be0 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632" status: 200 len: 1266 microversion: 2.1 time: 0.088512 Sep 10 12:23:17.460046 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3190/6385] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:23:17 2022] GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632 => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:23:18.488059 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-858771f1-72a4-4189-a28c-940e1056ff04 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:23:18.490198 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-858771f1-72a4-4189-a28c-940e1056ff04 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 0cd2d0dd-638b-4857-807b-092fcb76f632] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:23:18.501436 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-858771f1-72a4-4189-a28c-940e1056ff04 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:18.502763 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-858771f1-72a4-4189-a28c-940e1056ff04 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:18.503925 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-858771f1-72a4-4189-a28c-940e1056ff04 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:18.505458 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-858771f1-72a4-4189-a28c-940e1056ff04 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:18.506593 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-858771f1-72a4-4189-a28c-940e1056ff04 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:18.508115 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-858771f1-72a4-4189-a28c-940e1056ff04 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:18.623506 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-858771f1-72a4-4189-a28c-940e1056ff04 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:23:18.634467 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-858771f1-72a4-4189-a28c-940e1056ff04 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632" status: 200 len: 1336 microversion: 2.1 time: 0.155783 Sep 10 12:23:18.635526 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3196/6386] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:23:18 2022] GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632 => generated 1336 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:23:19.662294 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8a3e1d71-8312-4cea-8f5c-d723ea37de9d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:23:19.662986 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8a3e1d71-8312-4cea-8f5c-d723ea37de9d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 0cd2d0dd-638b-4857-807b-092fcb76f632] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:23:19.672153 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a3e1d71-8312-4cea-8f5c-d723ea37de9d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:19.672776 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a3e1d71-8312-4cea-8f5c-d723ea37de9d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:19.673981 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a3e1d71-8312-4cea-8f5c-d723ea37de9d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:19.674705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a3e1d71-8312-4cea-8f5c-d723ea37de9d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:19.675344 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a3e1d71-8312-4cea-8f5c-d723ea37de9d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:19.675957 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a3e1d71-8312-4cea-8f5c-d723ea37de9d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:19.911490 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8a3e1d71-8312-4cea-8f5c-d723ea37de9d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:23:19.919384 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8a3e1d71-8312-4cea-8f5c-d723ea37de9d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632" status: 200 len: 1392 microversion: 2.1 time: 0.262145 Sep 10 12:23:19.920051 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3191/6387] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:23:19 2022] GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632 => generated 1392 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:23:20.278179 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-af276327-b22f-4dc9-a611-fc837372f6f7 req-8b873d1f-6491-4207-aade-93eceb04a7e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cd2d0dd-638b-4857-807b-092fcb76f632", "tag": "a7bb23ff-ef1e-43ff-8f71-d71e28f94406"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:23:20.290655 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-af276327-b22f-4dc9-a611-fc837372f6f7 req-8b873d1f-6491-4207-aade-93eceb04a7e1 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:20.291120 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-af276327-b22f-4dc9-a611-fc837372f6f7 req-8b873d1f-6491-4207-aade-93eceb04a7e1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:20.291599 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-af276327-b22f-4dc9-a611-fc837372f6f7 req-8b873d1f-6491-4207-aade-93eceb04a7e1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:20.303977 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-af276327-b22f-4dc9-a611-fc837372f6f7 req-8b873d1f-6491-4207-aade-93eceb04a7e1 service nova] Creating event network-changed:a7bb23ff-ef1e-43ff-8f71-d71e28f94406 for instance 0cd2d0dd-638b-4857-807b-092fcb76f632 on n-h1-856895-1 Sep 10 12:23:20.309083 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-af276327-b22f-4dc9-a611-fc837372f6f7 req-8b873d1f-6491-4207-aade-93eceb04a7e1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034768 Sep 10 12:23:20.310023 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3197/6388] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:23:20.946627 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a286f345-e031-4ced-8259-1cf1865abb3d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:23:20.947473 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a286f345-e031-4ced-8259-1cf1865abb3d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 0cd2d0dd-638b-4857-807b-092fcb76f632] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:23:20.953717 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a286f345-e031-4ced-8259-1cf1865abb3d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:20.954249 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a286f345-e031-4ced-8259-1cf1865abb3d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:20.955705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a286f345-e031-4ced-8259-1cf1865abb3d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:20.955926 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a286f345-e031-4ced-8259-1cf1865abb3d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:20.956336 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a286f345-e031-4ced-8259-1cf1865abb3d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:20.956758 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a286f345-e031-4ced-8259-1cf1865abb3d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:21.106476 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a286f345-e031-4ced-8259-1cf1865abb3d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:23:21.115264 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a286f345-e031-4ced-8259-1cf1865abb3d tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632" status: 200 len: 1392 microversion: 2.1 time: 0.173699 Sep 10 12:23:21.115854 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3192/6389] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:23:20 2022] GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632 => generated 1392 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:23:22.139741 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-55eb2841-fe0d-4615-be77-d46e8725160b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:23:22.140478 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-55eb2841-fe0d-4615-be77-d46e8725160b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 0cd2d0dd-638b-4857-807b-092fcb76f632] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:23:22.143058 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:23:22.148765 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55eb2841-fe0d-4615-be77-d46e8725160b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:22.149176 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55eb2841-fe0d-4615-be77-d46e8725160b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:22.149621 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55eb2841-fe0d-4615-be77-d46e8725160b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:22.150319 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55eb2841-fe0d-4615-be77-d46e8725160b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:22.150779 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55eb2841-fe0d-4615-be77-d46e8725160b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:22.151242 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55eb2841-fe0d-4615-be77-d46e8725160b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:22.290600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-55eb2841-fe0d-4615-be77-d46e8725160b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:23:22.298501 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-55eb2841-fe0d-4615-be77-d46e8725160b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632" status: 200 len: 1392 microversion: 2.1 time: 0.163872 Sep 10 12:23:22.299078 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3198/6390] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:23:22 2022] GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:23:23.322738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c90d61ef-2d8e-4fb7-b715-9631c06d945e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:23:23.323403 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c90d61ef-2d8e-4fb7-b715-9631c06d945e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 0cd2d0dd-638b-4857-807b-092fcb76f632] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:23:23.331408 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c90d61ef-2d8e-4fb7-b715-9631c06d945e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:23.331905 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c90d61ef-2d8e-4fb7-b715-9631c06d945e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:23.332347 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c90d61ef-2d8e-4fb7-b715-9631c06d945e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:23.333056 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c90d61ef-2d8e-4fb7-b715-9631c06d945e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:23.333516 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c90d61ef-2d8e-4fb7-b715-9631c06d945e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:23.333948 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c90d61ef-2d8e-4fb7-b715-9631c06d945e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:23.473455 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c90d61ef-2d8e-4fb7-b715-9631c06d945e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:23:23.482210 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c90d61ef-2d8e-4fb7-b715-9631c06d945e tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632" status: 200 len: 1392 microversion: 2.1 time: 0.163316 Sep 10 12:23:23.482785 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3193/6391] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:23:23 2022] GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:23:24.506132 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4dbc86df-8399-48ba-ab91-5f325a99faf1 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:23:24.506671 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4dbc86df-8399-48ba-ab91-5f325a99faf1 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 0cd2d0dd-638b-4857-807b-092fcb76f632] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:23:24.513441 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4dbc86df-8399-48ba-ab91-5f325a99faf1 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:24.513922 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4dbc86df-8399-48ba-ab91-5f325a99faf1 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:24.515085 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4dbc86df-8399-48ba-ab91-5f325a99faf1 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:24.515860 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4dbc86df-8399-48ba-ab91-5f325a99faf1 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:24.516338 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4dbc86df-8399-48ba-ab91-5f325a99faf1 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:24.516808 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4dbc86df-8399-48ba-ab91-5f325a99faf1 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:24.660281 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4dbc86df-8399-48ba-ab91-5f325a99faf1 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:23:24.667969 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4dbc86df-8399-48ba-ab91-5f325a99faf1 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632" status: 200 len: 1392 microversion: 2.1 time: 0.166262 Sep 10 12:23:24.668535 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3199/6392] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:23:24 2022] GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:23:25.293626 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-d5a7cdb4-6f81-433b-aa34-fec0c6b198ce req-20fb2d63-262f-45ba-9572-c9f71ad4c8ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cd2d0dd-638b-4857-807b-092fcb76f632", "name": "network-vif-plugged", "status": "completed", "tag": "a7bb23ff-ef1e-43ff-8f71-d71e28f94406"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:23:25.304707 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d5a7cdb4-6f81-433b-aa34-fec0c6b198ce req-20fb2d63-262f-45ba-9572-c9f71ad4c8ce service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:25.305196 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d5a7cdb4-6f81-433b-aa34-fec0c6b198ce req-20fb2d63-262f-45ba-9572-c9f71ad4c8ce service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:25.305624 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d5a7cdb4-6f81-433b-aa34-fec0c6b198ce req-20fb2d63-262f-45ba-9572-c9f71ad4c8ce service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:25.321108 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-d5a7cdb4-6f81-433b-aa34-fec0c6b198ce req-20fb2d63-262f-45ba-9572-c9f71ad4c8ce service nova] Creating event network-vif-plugged:a7bb23ff-ef1e-43ff-8f71-d71e28f94406 for instance 0cd2d0dd-638b-4857-807b-092fcb76f632 on n-h1-856895-1 Sep 10 12:23:25.326280 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-d5a7cdb4-6f81-433b-aa34-fec0c6b198ce req-20fb2d63-262f-45ba-9572-c9f71ad4c8ce service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036424 Sep 10 12:23:25.326906 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3194/6393] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:23:25.692146 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-07cdaa63-bac4-4c7f-890a-304d191ceacb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:23:25.693077 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-07cdaa63-bac4-4c7f-890a-304d191ceacb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 0cd2d0dd-638b-4857-807b-092fcb76f632] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:23:25.699267 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-07cdaa63-bac4-4c7f-890a-304d191ceacb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:25.699749 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-07cdaa63-bac4-4c7f-890a-304d191ceacb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:25.700184 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-07cdaa63-bac4-4c7f-890a-304d191ceacb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:25.700868 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-07cdaa63-bac4-4c7f-890a-304d191ceacb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:25.701321 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-07cdaa63-bac4-4c7f-890a-304d191ceacb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:25.701746 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-07cdaa63-bac4-4c7f-890a-304d191ceacb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:25.836737 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-07cdaa63-bac4-4c7f-890a-304d191ceacb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:23:25.844493 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-07cdaa63-bac4-4c7f-890a-304d191ceacb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632" status: 200 len: 1392 microversion: 2.1 time: 0.157316 Sep 10 12:23:25.845072 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3200/6394] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:23:25 2022] GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:23:26.869734 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f37f209c-3845-4e45-8539-60b599ad6379 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:23:26.870372 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f37f209c-3845-4e45-8539-60b599ad6379 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 0cd2d0dd-638b-4857-807b-092fcb76f632] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:23:26.877455 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f37f209c-3845-4e45-8539-60b599ad6379 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:26.877947 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f37f209c-3845-4e45-8539-60b599ad6379 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:26.878982 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f37f209c-3845-4e45-8539-60b599ad6379 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:26.879716 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f37f209c-3845-4e45-8539-60b599ad6379 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:26.880176 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f37f209c-3845-4e45-8539-60b599ad6379 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:26.880603 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f37f209c-3845-4e45-8539-60b599ad6379 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:27.017504 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f37f209c-3845-4e45-8539-60b599ad6379 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:23:27.026127 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f37f209c-3845-4e45-8539-60b599ad6379 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632" status: 200 len: 1565 microversion: 2.1 time: 0.161705 Sep 10 12:23:27.026693 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3195/6395] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:23:26 2022] GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632 => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:23:27.048622 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b64bc686-4bcd-48c1-9d8c-3cf268348426 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:23:27.049254 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b64bc686-4bcd-48c1-9d8c-3cf268348426 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 0cd2d0dd-638b-4857-807b-092fcb76f632] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:23:27.057056 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b64bc686-4bcd-48c1-9d8c-3cf268348426 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:27.057547 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b64bc686-4bcd-48c1-9d8c-3cf268348426 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:27.057990 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b64bc686-4bcd-48c1-9d8c-3cf268348426 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:27.058739 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b64bc686-4bcd-48c1-9d8c-3cf268348426 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:27.059227 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b64bc686-4bcd-48c1-9d8c-3cf268348426 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:27.059661 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b64bc686-4bcd-48c1-9d8c-3cf268348426 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:27.202368 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b64bc686-4bcd-48c1-9d8c-3cf268348426 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:23:27.211410 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b64bc686-4bcd-48c1-9d8c-3cf268348426 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632" status: 200 len: 1565 microversion: 2.1 time: 0.166533 Sep 10 12:23:27.212014 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3201/6396] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:23:27 2022] GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632 => generated 1565 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:23:29.207880 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-992f747c-7afa-4dc9-8526-95c06b2a6e15 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:23:29.208623 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-992f747c-7afa-4dc9-8526-95c06b2a6e15 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 0cd2d0dd-638b-4857-807b-092fcb76f632] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:23:29.210372 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-dca07275-d859-4f18-84ee-67c1233dfcfe req-cba7be9d-e034-47ff-96ac-60ba9e33dea9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cd2d0dd-638b-4857-807b-092fcb76f632", "tag": "a7bb23ff-ef1e-43ff-8f71-d71e28f94406"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:23:29.215719 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:23:29.218123 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:23:29.220064 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-992f747c-7afa-4dc9-8526-95c06b2a6e15 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:29.220376 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:23:29.221081 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:23:29.221223 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-992f747c-7afa-4dc9-8526-95c06b2a6e15 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:29.222397 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-992f747c-7afa-4dc9-8526-95c06b2a6e15 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:29.223946 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-992f747c-7afa-4dc9-8526-95c06b2a6e15 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:29.224659 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-992f747c-7afa-4dc9-8526-95c06b2a6e15 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:29.224872 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-dca07275-d859-4f18-84ee-67c1233dfcfe req-cba7be9d-e034-47ff-96ac-60ba9e33dea9 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:29.225692 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-dca07275-d859-4f18-84ee-67c1233dfcfe req-cba7be9d-e034-47ff-96ac-60ba9e33dea9 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:29.225980 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-992f747c-7afa-4dc9-8526-95c06b2a6e15 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:29.227034 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-dca07275-d859-4f18-84ee-67c1233dfcfe req-cba7be9d-e034-47ff-96ac-60ba9e33dea9 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:29.245187 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-dca07275-d859-4f18-84ee-67c1233dfcfe req-cba7be9d-e034-47ff-96ac-60ba9e33dea9 service nova] Creating event network-changed:a7bb23ff-ef1e-43ff-8f71-d71e28f94406 for instance 0cd2d0dd-638b-4857-807b-092fcb76f632 on n-h1-856895-1 Sep 10 12:23:29.251370 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-dca07275-d859-4f18-84ee-67c1233dfcfe req-cba7be9d-e034-47ff-96ac-60ba9e33dea9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052639 Sep 10 12:23:29.253086 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3202/6397] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:23:29.477764 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-992f747c-7afa-4dc9-8526-95c06b2a6e15 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:23:29.495514 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-992f747c-7afa-4dc9-8526-95c06b2a6e15 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632" status: 200 len: 1565 microversion: 2.1 time: 0.302058 Sep 10 12:23:29.497200 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3196/6398] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:23:29 2022] GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632 => generated 1565 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:23:29.593101 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-8d2d6bda-1824-4cc8-930e-78a1cd96970e req-8c3ab873-ca41-4bf3-a564-05e4f1652680 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "874173da-ff29-46c8-b7e3-cd7e48a7f6ec", "tag": "ba9b8043-7f68-4531-94cb-da752ffe711a"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:23:29.600237 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f40b5dc1-9889-41fd-ab32-a257c374d107 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:23:29.601222 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f40b5dc1-9889-41fd-ab32-a257c374d107 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] [instance: 874173da-ff29-46c8-b7e3-cd7e48a7f6ec] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:23:29.620610 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f40b5dc1-9889-41fd-ab32-a257c374d107 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:29.622625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f40b5dc1-9889-41fd-ab32-a257c374d107 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:29.624146 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f40b5dc1-9889-41fd-ab32-a257c374d107 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:29.625886 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f40b5dc1-9889-41fd-ab32-a257c374d107 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:29.626241 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8d2d6bda-1824-4cc8-930e-78a1cd96970e req-8c3ab873-ca41-4bf3-a564-05e4f1652680 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:29.627017 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f40b5dc1-9889-41fd-ab32-a257c374d107 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:29.627919 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8d2d6bda-1824-4cc8-930e-78a1cd96970e req-8c3ab873-ca41-4bf3-a564-05e4f1652680 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:29.628263 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f40b5dc1-9889-41fd-ab32-a257c374d107 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:29.629300 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8d2d6bda-1824-4cc8-930e-78a1cd96970e req-8c3ab873-ca41-4bf3-a564-05e4f1652680 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:29.665811 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-8d2d6bda-1824-4cc8-930e-78a1cd96970e req-8c3ab873-ca41-4bf3-a564-05e4f1652680 service nova] Creating event network-changed:ba9b8043-7f68-4531-94cb-da752ffe711a for instance 874173da-ff29-46c8-b7e3-cd7e48a7f6ec on n-h2-856895-1 Sep 10 12:23:29.670584 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f40b5dc1-9889-41fd-ab32-a257c374d107 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] [instance: 874173da-ff29-46c8-b7e3-cd7e48a7f6ec] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:23:29.678763 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-8d2d6bda-1824-4cc8-930e-78a1cd96970e req-8c3ab873-ca41-4bf3-a564-05e4f1652680 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089398 Sep 10 12:23:29.684688 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3197/6399] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:23:29.858224 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f40b5dc1-9889-41fd-ab32-a257c374d107 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] 10.222.0.23 "DELETE /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec" status: 204 len: 0 microversion: 2.1 time: 0.274735 Sep 10 12:23:29.860521 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3203/6400] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:23:29 2022] DELETE /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:23:29.873387 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1723973c-ff1c-4d1d-b5f3-e42ea622f143 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:23:29.874416 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1723973c-ff1c-4d1d-b5f3-e42ea622f143 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] [instance: 874173da-ff29-46c8-b7e3-cd7e48a7f6ec] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:23:29.891448 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1723973c-ff1c-4d1d-b5f3-e42ea622f143 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:29.893279 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1723973c-ff1c-4d1d-b5f3-e42ea622f143 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:29.894604 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1723973c-ff1c-4d1d-b5f3-e42ea622f143 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:29.897598 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1723973c-ff1c-4d1d-b5f3-e42ea622f143 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:29.898983 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1723973c-ff1c-4d1d-b5f3-e42ea622f143 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:29.900314 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1723973c-ff1c-4d1d-b5f3-e42ea622f143 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:30.126566 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1723973c-ff1c-4d1d-b5f3-e42ea622f143 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1abeceefe2f94cb3a03a4241b4379b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57d94ff8ba94e86b94d3fa48c8aa75c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:23:30.135616 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1723973c-ff1c-4d1d-b5f3-e42ea622f143 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] 10.222.0.23 "GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec" status: 200 len: 1585 microversion: 2.1 time: 0.270314 Sep 10 12:23:30.146080 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3198/6401] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:23:29 2022] GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec => generated 1585 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:23:31.163333 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c375a106-170b-49b1-815c-a2df5d57d198 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:23:31.164174 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c375a106-170b-49b1-815c-a2df5d57d198 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] [instance: 874173da-ff29-46c8-b7e3-cd7e48a7f6ec] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:23:31.171079 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c375a106-170b-49b1-815c-a2df5d57d198 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:31.171601 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c375a106-170b-49b1-815c-a2df5d57d198 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:31.172056 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c375a106-170b-49b1-815c-a2df5d57d198 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:31.172758 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c375a106-170b-49b1-815c-a2df5d57d198 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:31.173224 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c375a106-170b-49b1-815c-a2df5d57d198 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:31.173656 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c375a106-170b-49b1-815c-a2df5d57d198 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:31.305737 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c375a106-170b-49b1-815c-a2df5d57d198 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1abeceefe2f94cb3a03a4241b4379b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57d94ff8ba94e86b94d3fa48c8aa75c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:23:31.313613 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c375a106-170b-49b1-815c-a2df5d57d198 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] 10.222.0.23 "GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec" status: 200 len: 1585 microversion: 2.1 time: 0.155278 Sep 10 12:23:31.314205 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3204/6402] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:23:31 2022] GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec => generated 1585 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:23:31.874575 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-0e410fa8-9c53-4c28-987b-ec085ad3be44 req-78f1a821-547b-490b-ae71-56c363a63dd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "874173da-ff29-46c8-b7e3-cd7e48a7f6ec", "name": "network-vif-deleted", "tag": "ba9b8043-7f68-4531-94cb-da752ffe711a"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:23:31.885708 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0e410fa8-9c53-4c28-987b-ec085ad3be44 req-78f1a821-547b-490b-ae71-56c363a63dd6 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:31.886265 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0e410fa8-9c53-4c28-987b-ec085ad3be44 req-78f1a821-547b-490b-ae71-56c363a63dd6 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:31.886848 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0e410fa8-9c53-4c28-987b-ec085ad3be44 req-78f1a821-547b-490b-ae71-56c363a63dd6 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:31.901732 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-0e410fa8-9c53-4c28-987b-ec085ad3be44 req-78f1a821-547b-490b-ae71-56c363a63dd6 service nova] Creating event network-vif-deleted:ba9b8043-7f68-4531-94cb-da752ffe711a for instance 874173da-ff29-46c8-b7e3-cd7e48a7f6ec on n-h2-856895-1 Sep 10 12:23:31.906684 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-0e410fa8-9c53-4c28-987b-ec085ad3be44 req-78f1a821-547b-490b-ae71-56c363a63dd6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035756 Sep 10 12:23:31.907259 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3199/6403] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:23:32.337395 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-168b7030-fdaf-478c-acee-0705af23f4e7 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:23:32.338013 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-168b7030-fdaf-478c-acee-0705af23f4e7 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] [instance: 874173da-ff29-46c8-b7e3-cd7e48a7f6ec] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:23:32.345093 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-168b7030-fdaf-478c-acee-0705af23f4e7 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:32.345583 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-168b7030-fdaf-478c-acee-0705af23f4e7 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:32.346027 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-168b7030-fdaf-478c-acee-0705af23f4e7 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:32.346726 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-168b7030-fdaf-478c-acee-0705af23f4e7 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:32.347242 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-168b7030-fdaf-478c-acee-0705af23f4e7 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:32.347945 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-168b7030-fdaf-478c-acee-0705af23f4e7 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:32.411768 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-168b7030-fdaf-478c-acee-0705af23f4e7 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1abeceefe2f94cb3a03a4241b4379b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57d94ff8ba94e86b94d3fa48c8aa75c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:23:32.419852 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-168b7030-fdaf-478c-acee-0705af23f4e7 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] 10.222.0.23 "GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec" status: 200 len: 1230 microversion: 2.1 time: 0.086364 Sep 10 12:23:32.420439 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3205/6404] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:23:32 2022] GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec => generated 1230 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:23:33.444899 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a576344a-51af-437a-9795-bb64246ae8d9 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:23:33.445502 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a576344a-51af-437a-9795-bb64246ae8d9 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] [instance: 874173da-ff29-46c8-b7e3-cd7e48a7f6ec] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:23:33.452515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a576344a-51af-437a-9795-bb64246ae8d9 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:33.453003 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a576344a-51af-437a-9795-bb64246ae8d9 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:33.453438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a576344a-51af-437a-9795-bb64246ae8d9 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:33.454140 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a576344a-51af-437a-9795-bb64246ae8d9 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:33.454589 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a576344a-51af-437a-9795-bb64246ae8d9 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:33.455014 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a576344a-51af-437a-9795-bb64246ae8d9 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:33.523039 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a576344a-51af-437a-9795-bb64246ae8d9 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1abeceefe2f94cb3a03a4241b4379b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57d94ff8ba94e86b94d3fa48c8aa75c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:23:33.531469 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a576344a-51af-437a-9795-bb64246ae8d9 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] 10.222.0.23 "GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec" status: 200 len: 1230 microversion: 2.1 time: 0.091800 Sep 10 12:23:33.532269 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3200/6405] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:23:33 2022] GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec => generated 1230 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:23:34.555907 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1a56505e-bc39-4559-b5a6-550ab46f0a49 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:23:34.556473 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1a56505e-bc39-4559-b5a6-550ab46f0a49 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] [instance: 874173da-ff29-46c8-b7e3-cd7e48a7f6ec] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:23:34.563111 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a56505e-bc39-4559-b5a6-550ab46f0a49 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:34.563623 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a56505e-bc39-4559-b5a6-550ab46f0a49 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:34.564066 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a56505e-bc39-4559-b5a6-550ab46f0a49 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:34.564768 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a56505e-bc39-4559-b5a6-550ab46f0a49 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:34.565230 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a56505e-bc39-4559-b5a6-550ab46f0a49 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:34.566296 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a56505e-bc39-4559-b5a6-550ab46f0a49 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:34.630625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1a56505e-bc39-4559-b5a6-550ab46f0a49 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1abeceefe2f94cb3a03a4241b4379b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57d94ff8ba94e86b94d3fa48c8aa75c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:23:34.638574 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1a56505e-bc39-4559-b5a6-550ab46f0a49 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] 10.222.0.23 "GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec" status: 200 len: 1230 microversion: 2.1 time: 0.086951 Sep 10 12:23:34.639079 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3206/6406] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:23:34 2022] GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec => generated 1230 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:23:35.662959 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-712cf965-76f6-4e66-ae3a-dd78cb5f0e80 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:23:35.663606 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-712cf965-76f6-4e66-ae3a-dd78cb5f0e80 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] [instance: 874173da-ff29-46c8-b7e3-cd7e48a7f6ec] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:23:35.670376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-712cf965-76f6-4e66-ae3a-dd78cb5f0e80 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:35.671462 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-712cf965-76f6-4e66-ae3a-dd78cb5f0e80 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:35.671901 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-712cf965-76f6-4e66-ae3a-dd78cb5f0e80 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:35.672593 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-712cf965-76f6-4e66-ae3a-dd78cb5f0e80 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:35.673050 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-712cf965-76f6-4e66-ae3a-dd78cb5f0e80 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:35.673475 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-712cf965-76f6-4e66-ae3a-dd78cb5f0e80 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:35.743177 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-712cf965-76f6-4e66-ae3a-dd78cb5f0e80 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1abeceefe2f94cb3a03a4241b4379b2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57d94ff8ba94e86b94d3fa48c8aa75c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:23:35.751082 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-712cf965-76f6-4e66-ae3a-dd78cb5f0e80 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] 10.222.0.23 "GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec" status: 200 len: 1230 microversion: 2.1 time: 0.092748 Sep 10 12:23:35.751692 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3201/6407] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:23:35 2022] GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec => generated 1230 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:23:36.774789 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b204b890-5c0f-45a7-9831-5afe3e7942e9 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:23:36.775436 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b204b890-5c0f-45a7-9831-5afe3e7942e9 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] [instance: 874173da-ff29-46c8-b7e3-cd7e48a7f6ec] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:23:36.782435 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b204b890-5c0f-45a7-9831-5afe3e7942e9 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:36.782922 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b204b890-5c0f-45a7-9831-5afe3e7942e9 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:36.783397 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b204b890-5c0f-45a7-9831-5afe3e7942e9 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:36.784094 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b204b890-5c0f-45a7-9831-5afe3e7942e9 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:23:36.784585 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b204b890-5c0f-45a7-9831-5afe3e7942e9 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:23:36.785009 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b204b890-5c0f-45a7-9831-5afe3e7942e9 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:23:36.801436 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-b204b890-5c0f-45a7-9831-5afe3e7942e9 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] HTTP exception thrown: Instance 874173da-ff29-46c8-b7e3-cd7e48a7f6ec could not be found. Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b204b890-5c0f-45a7-9831-5afe3e7942e9 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Request method failure captured: Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec HTTP/1.1 Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHIEPq_ZnLLSgKwSWO2mRcSn6eHkuRwnEBHRRjVFm4MdZFnPrXOJuq3IVGsuLdqQUVWHxNAMd_BMpt4anUpuQOkKmV7Q9Nk9diH8Zx8FpJAmA2Ey3oBdFDpaAmQ1r2__LTW9Y_mTUrO5RGDxbIHMhB8EGeR5E6UelXqRz6rbQ3YDAFDA Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: a57d94ff8ba94e86b94d3fa48c8aa75c Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-TestVolumeBackupRestore-1310390602 Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a57d94ff8ba94e86b94d3fa48c8aa75c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a57d94ff8ba94e86b94d3fa48c8aa75c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a57d94ff8ba94e86b94d3fa48c8aa75c", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a57d94ff8ba94e86b94d3fa48c8aa75c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-TestVolumeBackupRestore-1310390602 Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: a57d94ff8ba94e86b94d3fa48c8aa75c Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1310390602 Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-TestVolumeBackupRestore-1310390602-project Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 1abeceefe2f94cb3a03a4241b4379b2f Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-TestVolumeBackupRestore-1310390602-project Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 874173da-ff29-46c8-b7e3-cd7e48a7f6ec could not be found. Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '874173da-ff29-46c8-b7e3-cd7e48a7f6ec'} Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 874173da-ff29-46c8-b7e3-cd7e48a7f6ec could not be found. Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 874173da-ff29-46c8-b7e3-cd7e48a7f6ec could not be found. Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:23:36.803152 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:23:36.809159 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:23:36.809159 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:23:36.809159 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:23:36.809159 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:23:36.809159 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:23:36.809159 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 874173da-ff29-46c8-b7e3-cd7e48a7f6ec could not be found. Sep 10 12:23:36.809159 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:23:36.809159 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b204b890-5c0f-45a7-9831-5afe3e7942e9 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Returning 404 to user: Instance 874173da-ff29-46c8-b7e3-cd7e48a7f6ec could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:23:36.809159 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b204b890-5c0f-45a7-9831-5afe3e7942e9 tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] 10.222.0.23 "GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec" status: 404 len: 111 microversion: 2.1 time: 0.033832 Sep 10 12:23:36.809159 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3207/6408] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:23:36 2022] GET /compute/v2.1/servers/874173da-ff29-46c8-b7e3-cd7e48a7f6ec => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:23:36.961790 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d529ecad-e6f7-47ea-b62c-f3e73508c82c tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] Calling method '.version_select at 0x7f4073162280>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:23:36.986715 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d529ecad-e6f7-47ea-b62c-f3e73508c82c tempest-TestVolumeBackupRestore-1310390602 tempest-TestVolumeBackupRestore-1310390602-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1443142318" status: 202 len: 0 microversion: 2.1 time: 0.028570 Sep 10 12:23:36.988264 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3202/6409] 10.222.0.23 () {58 vars in 1269 bytes} [Sat Sep 10 12:23:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1443142318 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:24:02.874481 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ca704ca8-7ac8-4a74-b418-d7dd57e3a75b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:24:02.876652 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ca704ca8-7ac8-4a74-b418-d7dd57e3a75b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 0cd2d0dd-638b-4857-807b-092fcb76f632] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:24:02.879792 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:24:02.880464 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:24:02.886663 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca704ca8-7ac8-4a74-b418-d7dd57e3a75b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:02.887150 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca704ca8-7ac8-4a74-b418-d7dd57e3a75b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:02.887608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca704ca8-7ac8-4a74-b418-d7dd57e3a75b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:02.888294 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca704ca8-7ac8-4a74-b418-d7dd57e3a75b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:02.888750 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca704ca8-7ac8-4a74-b418-d7dd57e3a75b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:02.889175 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca704ca8-7ac8-4a74-b418-d7dd57e3a75b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:02.966268 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ca704ca8-7ac8-4a74-b418-d7dd57e3a75b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "POST /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632/action" status: 200 len: 24570 microversion: 2.1 time: 0.095762 Sep 10 12:24:02.966959 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3208/6410] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:24:02 2022] POST /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632/action => generated 24570 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 12:24:33.370842 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=54 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:24:33.371648 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:24:33.376804 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-28de7ecf-b90c-4bf9-95d4-e425e8e78c23 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:24:33.380001 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-28de7ecf-b90c-4bf9-95d4-e425e8e78c23 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 0cd2d0dd-638b-4857-807b-092fcb76f632] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:24:33.388400 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28de7ecf-b90c-4bf9-95d4-e425e8e78c23 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:33.388823 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28de7ecf-b90c-4bf9-95d4-e425e8e78c23 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:33.389263 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28de7ecf-b90c-4bf9-95d4-e425e8e78c23 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:33.389986 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28de7ecf-b90c-4bf9-95d4-e425e8e78c23 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:33.390440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28de7ecf-b90c-4bf9-95d4-e425e8e78c23 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:33.390871 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28de7ecf-b90c-4bf9-95d4-e425e8e78c23 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:33.468801 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-28de7ecf-b90c-4bf9-95d4-e425e8e78c23 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:24:33.469233 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-28de7ecf-b90c-4bf9-95d4-e425e8e78c23 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:24:33.469712 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-28de7ecf-b90c-4bf9-95d4-e425e8e78c23 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:24:33.470124 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-28de7ecf-b90c-4bf9-95d4-e425e8e78c23 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:24:33.470539 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-28de7ecf-b90c-4bf9-95d4-e425e8e78c23 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:24:33.531001 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-28de7ecf-b90c-4bf9-95d4-e425e8e78c23 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 0cd2d0dd-638b-4857-807b-092fcb76f632] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:24:33.537222 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28de7ecf-b90c-4bf9-95d4-e425e8e78c23 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:33.537769 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28de7ecf-b90c-4bf9-95d4-e425e8e78c23 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:33.538215 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28de7ecf-b90c-4bf9-95d4-e425e8e78c23 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:33.538925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28de7ecf-b90c-4bf9-95d4-e425e8e78c23 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:33.539417 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28de7ecf-b90c-4bf9-95d4-e425e8e78c23 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:33.539884 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28de7ecf-b90c-4bf9-95d4-e425e8e78c23 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:33.566652 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-28de7ecf-b90c-4bf9-95d4-e425e8e78c23 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "POST /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632/action" status: 202 len: 1138 microversion: 2.1 time: 0.197797 Sep 10 12:24:33.567647 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3203/6411] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:24:33 2022] POST /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632/action => generated 1138 bytes in 199 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 10 12:24:33.587562 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-86313fa7-504c-45d9-bb25-087b696aa4e7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:24:33.589049 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-86313fa7-504c-45d9-bb25-087b696aa4e7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 0cd2d0dd-638b-4857-807b-092fcb76f632] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:24:33.591861 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:24:33.592751 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=4 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:24:33.600582 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86313fa7-504c-45d9-bb25-087b696aa4e7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:33.601080 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86313fa7-504c-45d9-bb25-087b696aa4e7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:33.601511 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86313fa7-504c-45d9-bb25-087b696aa4e7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:33.602217 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86313fa7-504c-45d9-bb25-087b696aa4e7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:33.602695 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86313fa7-504c-45d9-bb25-087b696aa4e7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:33.603105 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86313fa7-504c-45d9-bb25-087b696aa4e7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:33.744069 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-86313fa7-504c-45d9-bb25-087b696aa4e7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:24:33.751928 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-86313fa7-504c-45d9-bb25-087b696aa4e7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632" status: 200 len: 1692 microversion: 2.1 time: 0.168625 Sep 10 12:24:33.752494 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3209/6412] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:24:33 2022] GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632 => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:24:34.777124 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-50908256-28e5-428d-b023-a2bb092ee2fe tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:24:34.777653 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-50908256-28e5-428d-b023-a2bb092ee2fe tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 0cd2d0dd-638b-4857-807b-092fcb76f632] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:24:34.785428 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-50908256-28e5-428d-b023-a2bb092ee2fe tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:34.785912 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-50908256-28e5-428d-b023-a2bb092ee2fe tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:34.786345 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-50908256-28e5-428d-b023-a2bb092ee2fe tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:34.787032 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-50908256-28e5-428d-b023-a2bb092ee2fe tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:34.787515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-50908256-28e5-428d-b023-a2bb092ee2fe tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:34.787939 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-50908256-28e5-428d-b023-a2bb092ee2fe tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:34.922568 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-50908256-28e5-428d-b023-a2bb092ee2fe tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:24:34.930473 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-50908256-28e5-428d-b023-a2bb092ee2fe tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632" status: 200 len: 1692 microversion: 2.1 time: 0.157421 Sep 10 12:24:34.931051 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3204/6413] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:24:34 2022] GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:24:35.953917 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8073e2ad-e8c7-4d23-9ccd-0bb2450c0bbd tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:24:35.954517 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8073e2ad-e8c7-4d23-9ccd-0bb2450c0bbd tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 0cd2d0dd-638b-4857-807b-092fcb76f632] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:24:35.962175 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8073e2ad-e8c7-4d23-9ccd-0bb2450c0bbd tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:35.962654 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8073e2ad-e8c7-4d23-9ccd-0bb2450c0bbd tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:35.963087 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8073e2ad-e8c7-4d23-9ccd-0bb2450c0bbd tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:35.963796 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8073e2ad-e8c7-4d23-9ccd-0bb2450c0bbd tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:35.964251 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8073e2ad-e8c7-4d23-9ccd-0bb2450c0bbd tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:35.964674 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8073e2ad-e8c7-4d23-9ccd-0bb2450c0bbd tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:36.094933 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8073e2ad-e8c7-4d23-9ccd-0bb2450c0bbd tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:24:36.106175 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8073e2ad-e8c7-4d23-9ccd-0bb2450c0bbd tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632" status: 200 len: 1692 microversion: 2.1 time: 0.156151 Sep 10 12:24:36.106754 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3210/6414] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:24:35 2022] GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:24:37.131641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-502d9063-636e-406a-9c47-9c5f157a7d0b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:24:37.132283 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-502d9063-636e-406a-9c47-9c5f157a7d0b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 0cd2d0dd-638b-4857-807b-092fcb76f632] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:24:37.139240 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-502d9063-636e-406a-9c47-9c5f157a7d0b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:37.139721 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-502d9063-636e-406a-9c47-9c5f157a7d0b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:37.140155 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-502d9063-636e-406a-9c47-9c5f157a7d0b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:37.140839 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-502d9063-636e-406a-9c47-9c5f157a7d0b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:37.141288 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-502d9063-636e-406a-9c47-9c5f157a7d0b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:37.141712 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-502d9063-636e-406a-9c47-9c5f157a7d0b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:37.278896 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-502d9063-636e-406a-9c47-9c5f157a7d0b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:24:37.286753 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-502d9063-636e-406a-9c47-9c5f157a7d0b tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632" status: 200 len: 1692 microversion: 2.1 time: 0.159809 Sep 10 12:24:37.287349 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3205/6415] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:24:37 2022] GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:24:38.309948 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-44f79bb6-da04-4a77-9778-ec9f3e00e8a3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:24:38.310580 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-44f79bb6-da04-4a77-9778-ec9f3e00e8a3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 0cd2d0dd-638b-4857-807b-092fcb76f632] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:24:38.317778 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-44f79bb6-da04-4a77-9778-ec9f3e00e8a3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:38.318269 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-44f79bb6-da04-4a77-9778-ec9f3e00e8a3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:38.318712 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-44f79bb6-da04-4a77-9778-ec9f3e00e8a3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:38.319439 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-44f79bb6-da04-4a77-9778-ec9f3e00e8a3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:38.319901 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-44f79bb6-da04-4a77-9778-ec9f3e00e8a3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:38.320336 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-44f79bb6-da04-4a77-9778-ec9f3e00e8a3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:38.535211 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-44f79bb6-da04-4a77-9778-ec9f3e00e8a3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:24:38.543055 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-44f79bb6-da04-4a77-9778-ec9f3e00e8a3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632" status: 200 len: 1692 microversion: 2.1 time: 0.237036 Sep 10 12:24:38.543676 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3211/6416] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:24:38 2022] GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632 => generated 1692 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:24:39.566622 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6e9fd41b-7913-447e-9910-c372345f9ad2 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:24:39.567277 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6e9fd41b-7913-447e-9910-c372345f9ad2 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 0cd2d0dd-638b-4857-807b-092fcb76f632] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:24:39.573982 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6e9fd41b-7913-447e-9910-c372345f9ad2 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:39.574462 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6e9fd41b-7913-447e-9910-c372345f9ad2 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:39.574895 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6e9fd41b-7913-447e-9910-c372345f9ad2 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:39.575604 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6e9fd41b-7913-447e-9910-c372345f9ad2 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:39.576057 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6e9fd41b-7913-447e-9910-c372345f9ad2 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:39.576611 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6e9fd41b-7913-447e-9910-c372345f9ad2 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:39.717683 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6e9fd41b-7913-447e-9910-c372345f9ad2 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:24:39.725684 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6e9fd41b-7913-447e-9910-c372345f9ad2 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632" status: 200 len: 1692 microversion: 2.1 time: 0.163691 Sep 10 12:24:39.726259 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3206/6417] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:24:39 2022] GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632 => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:24:40.749578 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0cf436ff-a2e0-400e-b36f-0998528e50a9 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:24:40.750199 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0cf436ff-a2e0-400e-b36f-0998528e50a9 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 0cd2d0dd-638b-4857-807b-092fcb76f632] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:24:40.758244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0cf436ff-a2e0-400e-b36f-0998528e50a9 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:40.758730 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0cf436ff-a2e0-400e-b36f-0998528e50a9 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:40.759186 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0cf436ff-a2e0-400e-b36f-0998528e50a9 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:40.759884 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0cf436ff-a2e0-400e-b36f-0998528e50a9 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:40.760345 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0cf436ff-a2e0-400e-b36f-0998528e50a9 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:40.760777 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0cf436ff-a2e0-400e-b36f-0998528e50a9 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:40.895046 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0cf436ff-a2e0-400e-b36f-0998528e50a9 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:24:40.902952 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0cf436ff-a2e0-400e-b36f-0998528e50a9 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632" status: 200 len: 1692 microversion: 2.1 time: 0.157267 Sep 10 12:24:40.903559 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3212/6418] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:24:40 2022] GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:24:41.925968 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-125ce025-4a69-4382-b305-f2220645de5f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:24:41.927232 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-125ce025-4a69-4382-b305-f2220645de5f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 0cd2d0dd-638b-4857-807b-092fcb76f632] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:24:41.933957 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-125ce025-4a69-4382-b305-f2220645de5f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:41.934529 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-125ce025-4a69-4382-b305-f2220645de5f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:41.934902 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-125ce025-4a69-4382-b305-f2220645de5f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:41.936267 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-125ce025-4a69-4382-b305-f2220645de5f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:41.936734 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-125ce025-4a69-4382-b305-f2220645de5f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:41.937182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-125ce025-4a69-4382-b305-f2220645de5f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:42.077111 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-125ce025-4a69-4382-b305-f2220645de5f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:24:42.085257 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-125ce025-4a69-4382-b305-f2220645de5f tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632" status: 200 len: 1692 microversion: 2.1 time: 0.163364 Sep 10 12:24:42.085846 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3207/6419] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:24:41 2022] GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632 => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:24:43.108228 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9fc92c9d-e72e-4175-8143-f8cee459615a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:24:43.108843 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9fc92c9d-e72e-4175-8143-f8cee459615a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 0cd2d0dd-638b-4857-807b-092fcb76f632] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:24:43.116146 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fc92c9d-e72e-4175-8143-f8cee459615a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:43.116632 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fc92c9d-e72e-4175-8143-f8cee459615a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:43.117069 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fc92c9d-e72e-4175-8143-f8cee459615a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:43.117797 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fc92c9d-e72e-4175-8143-f8cee459615a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:43.118250 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fc92c9d-e72e-4175-8143-f8cee459615a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:43.118675 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9fc92c9d-e72e-4175-8143-f8cee459615a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:43.254752 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9fc92c9d-e72e-4175-8143-f8cee459615a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:24:43.262500 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9fc92c9d-e72e-4175-8143-f8cee459615a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632" status: 200 len: 1692 microversion: 2.1 time: 0.158249 Sep 10 12:24:43.263073 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3213/6420] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:24:43 2022] GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:24:44.286599 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-abfafa57-ddbf-431c-8be4-504d66d069fb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:24:44.287279 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-abfafa57-ddbf-431c-8be4-504d66d069fb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 0cd2d0dd-638b-4857-807b-092fcb76f632] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:24:44.294175 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-abfafa57-ddbf-431c-8be4-504d66d069fb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:44.294659 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-abfafa57-ddbf-431c-8be4-504d66d069fb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:44.295098 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-abfafa57-ddbf-431c-8be4-504d66d069fb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:44.295813 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-abfafa57-ddbf-431c-8be4-504d66d069fb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:44.296273 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-abfafa57-ddbf-431c-8be4-504d66d069fb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:44.296699 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-abfafa57-ddbf-431c-8be4-504d66d069fb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:44.428274 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-abfafa57-ddbf-431c-8be4-504d66d069fb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:24:44.436017 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-abfafa57-ddbf-431c-8be4-504d66d069fb tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632" status: 200 len: 1692 microversion: 2.1 time: 0.154088 Sep 10 12:24:44.436601 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3208/6421] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:24:44 2022] GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632 => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:24:45.459848 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5cc41b94-7a07-4581-ba74-a177af55e694 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:24:45.460439 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5cc41b94-7a07-4581-ba74-a177af55e694 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 0cd2d0dd-638b-4857-807b-092fcb76f632] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:24:45.467212 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5cc41b94-7a07-4581-ba74-a177af55e694 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:45.467699 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5cc41b94-7a07-4581-ba74-a177af55e694 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:45.468147 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5cc41b94-7a07-4581-ba74-a177af55e694 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:45.468840 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5cc41b94-7a07-4581-ba74-a177af55e694 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:45.469301 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5cc41b94-7a07-4581-ba74-a177af55e694 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:45.469733 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5cc41b94-7a07-4581-ba74-a177af55e694 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:45.608057 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5cc41b94-7a07-4581-ba74-a177af55e694 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:24:45.616594 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5cc41b94-7a07-4581-ba74-a177af55e694 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632" status: 200 len: 1692 microversion: 2.1 time: 0.160889 Sep 10 12:24:45.617169 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3214/6422] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:24:45 2022] GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:24:46.639869 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4434d93a-48c7-48df-8024-a2cd9a17cd93 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:24:46.640494 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4434d93a-48c7-48df-8024-a2cd9a17cd93 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 0cd2d0dd-638b-4857-807b-092fcb76f632] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:24:46.647355 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4434d93a-48c7-48df-8024-a2cd9a17cd93 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:46.647837 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4434d93a-48c7-48df-8024-a2cd9a17cd93 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:46.648273 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4434d93a-48c7-48df-8024-a2cd9a17cd93 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:46.648961 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4434d93a-48c7-48df-8024-a2cd9a17cd93 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:46.649416 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4434d93a-48c7-48df-8024-a2cd9a17cd93 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:46.649844 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4434d93a-48c7-48df-8024-a2cd9a17cd93 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:46.781301 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4434d93a-48c7-48df-8024-a2cd9a17cd93 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:24:46.789301 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4434d93a-48c7-48df-8024-a2cd9a17cd93 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632" status: 200 len: 1692 microversion: 2.1 time: 0.153413 Sep 10 12:24:46.789883 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3209/6423] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:24:46 2022] GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632 => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:24:47.813555 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-da84928d-74ab-4617-8921-0b77e2520540 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:24:47.814174 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-da84928d-74ab-4617-8921-0b77e2520540 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 0cd2d0dd-638b-4857-807b-092fcb76f632] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:24:47.822071 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da84928d-74ab-4617-8921-0b77e2520540 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:47.822553 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da84928d-74ab-4617-8921-0b77e2520540 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:47.822991 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da84928d-74ab-4617-8921-0b77e2520540 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:47.823740 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da84928d-74ab-4617-8921-0b77e2520540 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:47.824197 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da84928d-74ab-4617-8921-0b77e2520540 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:47.824621 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da84928d-74ab-4617-8921-0b77e2520540 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:47.961239 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-da84928d-74ab-4617-8921-0b77e2520540 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:24:47.969038 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-da84928d-74ab-4617-8921-0b77e2520540 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632" status: 200 len: 1692 microversion: 2.1 time: 0.159485 Sep 10 12:24:47.969665 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3215/6424] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:24:47 2022] GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:24:48.992903 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2ca9a97e-27df-4e89-81c7-8436198e74a3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:24:48.993563 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2ca9a97e-27df-4e89-81c7-8436198e74a3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 0cd2d0dd-638b-4857-807b-092fcb76f632] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:24:49.000394 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ca9a97e-27df-4e89-81c7-8436198e74a3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:49.000876 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ca9a97e-27df-4e89-81c7-8436198e74a3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:49.001320 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ca9a97e-27df-4e89-81c7-8436198e74a3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:49.002005 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ca9a97e-27df-4e89-81c7-8436198e74a3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:49.002524 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ca9a97e-27df-4e89-81c7-8436198e74a3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:49.002949 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ca9a97e-27df-4e89-81c7-8436198e74a3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:49.137688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2ca9a97e-27df-4e89-81c7-8436198e74a3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:24:49.146436 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2ca9a97e-27df-4e89-81c7-8436198e74a3 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632" status: 200 len: 1692 microversion: 2.1 time: 0.157472 Sep 10 12:24:49.147008 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3210/6425] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:24:48 2022] GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:24:50.169669 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cbbfb1cf-877a-4f48-b6b1-f0db9d46d011 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:24:50.170296 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cbbfb1cf-877a-4f48-b6b1-f0db9d46d011 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 0cd2d0dd-638b-4857-807b-092fcb76f632] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:24:50.177882 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cbbfb1cf-877a-4f48-b6b1-f0db9d46d011 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:50.178368 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cbbfb1cf-877a-4f48-b6b1-f0db9d46d011 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:50.178815 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cbbfb1cf-877a-4f48-b6b1-f0db9d46d011 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:50.179542 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cbbfb1cf-877a-4f48-b6b1-f0db9d46d011 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:50.180001 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cbbfb1cf-877a-4f48-b6b1-f0db9d46d011 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:50.180433 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cbbfb1cf-877a-4f48-b6b1-f0db9d46d011 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:50.314915 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-cbbfb1cf-877a-4f48-b6b1-f0db9d46d011 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:24:50.322798 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cbbfb1cf-877a-4f48-b6b1-f0db9d46d011 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632" status: 200 len: 1692 microversion: 2.1 time: 0.157079 Sep 10 12:24:50.323403 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3216/6426] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:24:50 2022] GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:24:51.346720 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bb8f9b71-a3c5-4d44-b71c-0e9c844f3c0a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:24:51.347395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bb8f9b71-a3c5-4d44-b71c-0e9c844f3c0a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 0cd2d0dd-638b-4857-807b-092fcb76f632] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:24:51.354358 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bb8f9b71-a3c5-4d44-b71c-0e9c844f3c0a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:51.354847 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bb8f9b71-a3c5-4d44-b71c-0e9c844f3c0a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:51.355328 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bb8f9b71-a3c5-4d44-b71c-0e9c844f3c0a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:51.356027 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bb8f9b71-a3c5-4d44-b71c-0e9c844f3c0a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:51.356489 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bb8f9b71-a3c5-4d44-b71c-0e9c844f3c0a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:51.356924 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bb8f9b71-a3c5-4d44-b71c-0e9c844f3c0a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:51.489948 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bb8f9b71-a3c5-4d44-b71c-0e9c844f3c0a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:24:51.497720 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bb8f9b71-a3c5-4d44-b71c-0e9c844f3c0a tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632" status: 200 len: 1698 microversion: 2.1 time: 0.155023 Sep 10 12:24:51.498297 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3211/6427] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:24:51 2022] GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632 => generated 1698 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:24:52.521540 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-641672ca-135e-430f-9d0b-d3f0970563c7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:24:52.522095 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-641672ca-135e-430f-9d0b-d3f0970563c7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 0cd2d0dd-638b-4857-807b-092fcb76f632] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:24:52.528973 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-641672ca-135e-430f-9d0b-d3f0970563c7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:52.529462 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-641672ca-135e-430f-9d0b-d3f0970563c7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:52.529895 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-641672ca-135e-430f-9d0b-d3f0970563c7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:52.530584 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-641672ca-135e-430f-9d0b-d3f0970563c7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:52.531034 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-641672ca-135e-430f-9d0b-d3f0970563c7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:52.531484 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-641672ca-135e-430f-9d0b-d3f0970563c7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:52.666372 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-641672ca-135e-430f-9d0b-d3f0970563c7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:24:52.674714 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-641672ca-135e-430f-9d0b-d3f0970563c7 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632" status: 200 len: 1698 microversion: 2.1 time: 0.156833 Sep 10 12:24:52.675389 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3217/6428] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:24:52 2022] GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632 => generated 1698 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:24:53.699418 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0d9ecd68-05d3-4ac3-89f8-e908b46a5010 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:24:53.700004 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0d9ecd68-05d3-4ac3-89f8-e908b46a5010 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 0cd2d0dd-638b-4857-807b-092fcb76f632] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:24:53.706759 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d9ecd68-05d3-4ac3-89f8-e908b46a5010 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:53.707269 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d9ecd68-05d3-4ac3-89f8-e908b46a5010 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:53.707708 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d9ecd68-05d3-4ac3-89f8-e908b46a5010 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:53.708403 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d9ecd68-05d3-4ac3-89f8-e908b46a5010 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:53.708854 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d9ecd68-05d3-4ac3-89f8-e908b46a5010 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:53.709279 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d9ecd68-05d3-4ac3-89f8-e908b46a5010 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:53.790050 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-2b3aa8ef-a4d3-4a17-938c-339a39fb94e2 req-17474fff-4174-4847-a722-d65e85f1b5cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cd2d0dd-638b-4857-807b-092fcb76f632", "name": "network-vif-unplugged", "status": "completed", "tag": "a7bb23ff-ef1e-43ff-8f71-d71e28f94406"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:24:53.802264 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-2b3aa8ef-a4d3-4a17-938c-339a39fb94e2 req-17474fff-4174-4847-a722-d65e85f1b5cd service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:53.802743 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-2b3aa8ef-a4d3-4a17-938c-339a39fb94e2 req-17474fff-4174-4847-a722-d65e85f1b5cd service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:53.803192 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-2b3aa8ef-a4d3-4a17-938c-339a39fb94e2 req-17474fff-4174-4847-a722-d65e85f1b5cd service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:53.814574 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-2b3aa8ef-a4d3-4a17-938c-339a39fb94e2 req-17474fff-4174-4847-a722-d65e85f1b5cd service nova] Creating event network-vif-unplugged:a7bb23ff-ef1e-43ff-8f71-d71e28f94406 for instance 0cd2d0dd-638b-4857-807b-092fcb76f632 on n-h1-856895-1 Sep 10 12:24:53.821870 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-2b3aa8ef-a4d3-4a17-938c-339a39fb94e2 req-17474fff-4174-4847-a722-d65e85f1b5cd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035990 Sep 10 12:24:53.822590 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3218/6429] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:24:53.849832 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0d9ecd68-05d3-4ac3-89f8-e908b46a5010 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:24:53.858217 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0d9ecd68-05d3-4ac3-89f8-e908b46a5010 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632" status: 200 len: 1698 microversion: 2.1 time: 0.162836 Sep 10 12:24:53.858802 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3212/6430] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:24:53 2022] GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632 => generated 1698 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:24:54.884660 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-810926e2-447d-468a-8a5b-a020262209d0 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:24:54.886263 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-810926e2-447d-468a-8a5b-a020262209d0 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 0cd2d0dd-638b-4857-807b-092fcb76f632] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:24:54.893469 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-810926e2-447d-468a-8a5b-a020262209d0 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:54.893974 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-810926e2-447d-468a-8a5b-a020262209d0 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:54.894414 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-810926e2-447d-468a-8a5b-a020262209d0 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:54.895111 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-810926e2-447d-468a-8a5b-a020262209d0 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:54.895593 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-810926e2-447d-468a-8a5b-a020262209d0 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:54.896024 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-810926e2-447d-468a-8a5b-a020262209d0 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:55.041941 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-810926e2-447d-468a-8a5b-a020262209d0 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:24:55.050519 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-810926e2-447d-468a-8a5b-a020262209d0 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632" status: 200 len: 1683 microversion: 2.1 time: 0.171168 Sep 10 12:24:55.051139 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3219/6431] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:24:54 2022] GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632 => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:24:55.995727 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-350523dc-9370-4841-8b66-237f3985bb6d req-f92fcf1f-1fa2-4311-b2a0-4844935329af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cd2d0dd-638b-4857-807b-092fcb76f632", "name": "network-vif-plugged", "status": "completed", "tag": "a7bb23ff-ef1e-43ff-8f71-d71e28f94406"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:24:56.006756 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-350523dc-9370-4841-8b66-237f3985bb6d req-f92fcf1f-1fa2-4311-b2a0-4844935329af service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:24:56.007650 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-350523dc-9370-4841-8b66-237f3985bb6d req-f92fcf1f-1fa2-4311-b2a0-4844935329af service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:24:56.007798 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-350523dc-9370-4841-8b66-237f3985bb6d req-f92fcf1f-1fa2-4311-b2a0-4844935329af service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:24:56.020560 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-350523dc-9370-4841-8b66-237f3985bb6d req-f92fcf1f-1fa2-4311-b2a0-4844935329af service nova] Creating event network-vif-plugged:a7bb23ff-ef1e-43ff-8f71-d71e28f94406 for instance 0cd2d0dd-638b-4857-807b-092fcb76f632 on n-h1-856895-1 Sep 10 12:24:56.028015 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-350523dc-9370-4841-8b66-237f3985bb6d req-f92fcf1f-1fa2-4311-b2a0-4844935329af service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035636 Sep 10 12:24:56.029344 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3213/6432] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:25:29.295044 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d21da355-a8ac-4483-88b2-7653f0ea99bc tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:25:29.297294 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d21da355-a8ac-4483-88b2-7653f0ea99bc tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 0cd2d0dd-638b-4857-807b-092fcb76f632] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:25:29.299714 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=22 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:25:29.300529 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=62 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:25:29.306470 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d21da355-a8ac-4483-88b2-7653f0ea99bc tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:25:29.306961 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d21da355-a8ac-4483-88b2-7653f0ea99bc tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:25:29.307433 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d21da355-a8ac-4483-88b2-7653f0ea99bc tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:25:29.308131 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d21da355-a8ac-4483-88b2-7653f0ea99bc tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:25:29.308611 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d21da355-a8ac-4483-88b2-7653f0ea99bc tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:25:29.309036 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d21da355-a8ac-4483-88b2-7653f0ea99bc tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:25:29.378541 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d21da355-a8ac-4483-88b2-7653f0ea99bc tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "POST /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632/action" status: 200 len: 24566 microversion: 2.1 time: 0.087470 Sep 10 12:25:29.379236 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3220/6433] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:25:29 2022] POST /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632/action => generated 24566 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 12:26:00.620500 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=26 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:26:00.621240 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:26:00.625928 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-79814749-2b45-4c8a-80e6-23a868131427 req-99ad579e-f4ba-46de-8791-b44939248b6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cd2d0dd-638b-4857-807b-092fcb76f632", "tag": "a7bb23ff-ef1e-43ff-8f71-d71e28f94406"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:26:00.626415 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-70ec4304-be13-480d-a37b-4f22cc0ad380 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:26:00.626785 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-70ec4304-be13-480d-a37b-4f22cc0ad380 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 0cd2d0dd-638b-4857-807b-092fcb76f632] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:26:00.633571 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:26:00.634217 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=4 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:26:00.635596 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-70ec4304-be13-480d-a37b-4f22cc0ad380 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:26:00.636175 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-70ec4304-be13-480d-a37b-4f22cc0ad380 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:26:00.636813 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-70ec4304-be13-480d-a37b-4f22cc0ad380 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:26:00.637750 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-70ec4304-be13-480d-a37b-4f22cc0ad380 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:26:00.638285 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-70ec4304-be13-480d-a37b-4f22cc0ad380 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:26:00.638793 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-70ec4304-be13-480d-a37b-4f22cc0ad380 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:26:00.640548 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-79814749-2b45-4c8a-80e6-23a868131427 req-99ad579e-f4ba-46de-8791-b44939248b6b service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:26:00.641198 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-79814749-2b45-4c8a-80e6-23a868131427 req-99ad579e-f4ba-46de-8791-b44939248b6b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:26:00.641645 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-79814749-2b45-4c8a-80e6-23a868131427 req-99ad579e-f4ba-46de-8791-b44939248b6b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:26:00.656200 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-79814749-2b45-4c8a-80e6-23a868131427 req-99ad579e-f4ba-46de-8791-b44939248b6b service nova] Creating event network-changed:a7bb23ff-ef1e-43ff-8f71-d71e28f94406 for instance 0cd2d0dd-638b-4857-807b-092fcb76f632 on n-h1-856895-1 Sep 10 12:26:00.662299 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-79814749-2b45-4c8a-80e6-23a868131427 req-99ad579e-f4ba-46de-8791-b44939248b6b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040751 Sep 10 12:26:00.663711 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3221/6434] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:26:00.671398 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-70ec4304-be13-480d-a37b-4f22cc0ad380 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 0cd2d0dd-638b-4857-807b-092fcb76f632] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:26:00.759002 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-70ec4304-be13-480d-a37b-4f22cc0ad380 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632" status: 204 len: 0 microversion: 2.1 time: 0.141290 Sep 10 12:26:00.759583 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3214/6435] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:26:00 2022] DELETE /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:26:00.770749 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-da180fde-28c6-4a62-b1ba-044dfd119df2 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:26:00.771501 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-da180fde-28c6-4a62-b1ba-044dfd119df2 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 0cd2d0dd-638b-4857-807b-092fcb76f632] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:26:00.778543 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da180fde-28c6-4a62-b1ba-044dfd119df2 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:26:00.779037 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da180fde-28c6-4a62-b1ba-044dfd119df2 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:26:00.779506 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da180fde-28c6-4a62-b1ba-044dfd119df2 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:26:00.780212 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da180fde-28c6-4a62-b1ba-044dfd119df2 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:26:00.780672 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da180fde-28c6-4a62-b1ba-044dfd119df2 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:26:00.781103 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da180fde-28c6-4a62-b1ba-044dfd119df2 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:26:00.921763 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-da180fde-28c6-4a62-b1ba-044dfd119df2 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:26:00.929859 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-da180fde-28c6-4a62-b1ba-044dfd119df2 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632" status: 200 len: 1689 microversion: 2.1 time: 0.163877 Sep 10 12:26:00.930470 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3222/6436] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:26:00 2022] GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632 => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:26:02.201658 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-36726308-5339-4f99-b0cf-adc0a455a565 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:26:02.202478 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-36726308-5339-4f99-b0cf-adc0a455a565 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 0cd2d0dd-638b-4857-807b-092fcb76f632] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:26:02.209325 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36726308-5339-4f99-b0cf-adc0a455a565 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:26:02.209810 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36726308-5339-4f99-b0cf-adc0a455a565 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:26:02.210277 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36726308-5339-4f99-b0cf-adc0a455a565 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:26:02.210966 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36726308-5339-4f99-b0cf-adc0a455a565 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:26:02.211456 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36726308-5339-4f99-b0cf-adc0a455a565 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:26:02.211912 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-36726308-5339-4f99-b0cf-adc0a455a565 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:26:02.431198 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-36726308-5339-4f99-b0cf-adc0a455a565 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd98ab9ebde4e84b03aed2e694ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cfd58791b5445b9a52bc02a5eb255b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:26:02.442775 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-36726308-5339-4f99-b0cf-adc0a455a565 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632" status: 200 len: 1689 microversion: 2.1 time: 0.492424 Sep 10 12:26:02.443902 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3215/6437] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:26:01 2022] GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632 => generated 1689 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:26:02.826592 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-448f6317-e1e4-415e-8dcf-73660691b432 req-f662f628-8e41-451d-b7f5-c3b735933cbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cd2d0dd-638b-4857-807b-092fcb76f632", "name": "network-vif-deleted", "tag": "a7bb23ff-ef1e-43ff-8f71-d71e28f94406"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:26:02.837837 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-448f6317-e1e4-415e-8dcf-73660691b432 req-f662f628-8e41-451d-b7f5-c3b735933cbb service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:26:02.838327 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-448f6317-e1e4-415e-8dcf-73660691b432 req-f662f628-8e41-451d-b7f5-c3b735933cbb service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:26:02.838779 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-448f6317-e1e4-415e-8dcf-73660691b432 req-f662f628-8e41-451d-b7f5-c3b735933cbb service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:26:02.851576 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-448f6317-e1e4-415e-8dcf-73660691b432 req-f662f628-8e41-451d-b7f5-c3b735933cbb service nova] Creating event network-vif-deleted:a7bb23ff-ef1e-43ff-8f71-d71e28f94406 for instance 0cd2d0dd-638b-4857-807b-092fcb76f632 on n-h1-856895-1 Sep 10 12:26:02.856593 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-448f6317-e1e4-415e-8dcf-73660691b432 req-f662f628-8e41-451d-b7f5-c3b735933cbb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033789 Sep 10 12:26:02.857280 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3223/6438] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:26:03.468435 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-87277793-8132-42f7-861d-0d6d7b04a1a1 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:26:03.469096 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-87277793-8132-42f7-861d-0d6d7b04a1a1 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [instance: 0cd2d0dd-638b-4857-807b-092fcb76f632] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:26:03.476139 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87277793-8132-42f7-861d-0d6d7b04a1a1 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:26:03.476635 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87277793-8132-42f7-861d-0d6d7b04a1a1 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:26:03.477080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87277793-8132-42f7-861d-0d6d7b04a1a1 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:26:03.477781 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87277793-8132-42f7-861d-0d6d7b04a1a1 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:26:03.478254 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87277793-8132-42f7-861d-0d6d7b04a1a1 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:26:03.478717 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87277793-8132-42f7-861d-0d6d7b04a1a1 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:26:03.492287 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-87277793-8132-42f7-861d-0d6d7b04a1a1 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] HTTP exception thrown: Instance 0cd2d0dd-638b-4857-807b-092fcb76f632 could not be found. Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-87277793-8132-42f7-861d-0d6d7b04a1a1 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Request method failure captured: Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632 HTTP/1.1 Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHH_yhS9kjuGqOnMliECmKXRPPzhZsHLNJh-k2Dy3sZVddODjZkI9QVirO2WV-k2QGWioorUvQwYXUbLO2mq09vb7kUE53WetDg0b2epWCfO81IA_d1hE4us0m3Xe_F7464Bi0Mnf9Ik8sGoKIy1FuftdqKYzeLjY2ezWMG2puAQMwhw Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 68cfd58791b5445b9a52bc02a5eb255b Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-223880240 Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/68cfd58791b5445b9a52bc02a5eb255b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/68cfd58791b5445b9a52bc02a5eb255b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_68cfd58791b5445b9a52bc02a5eb255b", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/68cfd58791b5445b9a52bc02a5eb255b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-TestNetworkAdvancedServerOps-223880240 Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 68cfd58791b5445b9a52bc02a5eb255b Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-223880240 Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-TestNetworkAdvancedServerOps-223880240-project Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: fbd98ab9ebde4e84b03aed2e694ddf04 Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-TestNetworkAdvancedServerOps-223880240-project Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 0cd2d0dd-638b-4857-807b-092fcb76f632 could not be found. Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '0cd2d0dd-638b-4857-807b-092fcb76f632'} Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cd2d0dd-638b-4857-807b-092fcb76f632 could not be found. Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cd2d0dd-638b-4857-807b-092fcb76f632 could not be found. Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:26:03.493935 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:26:03.498884 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:26:03.498884 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:26:03.498884 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:26:03.498884 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:26:03.498884 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:26:03.498884 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:26:03.498884 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cd2d0dd-638b-4857-807b-092fcb76f632 could not be found. Sep 10 12:26:03.498884 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:26:03.498884 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-87277793-8132-42f7-861d-0d6d7b04a1a1 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Returning 404 to user: Instance 0cd2d0dd-638b-4857-807b-092fcb76f632 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:26:03.498884 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-87277793-8132-42f7-861d-0d6d7b04a1a1 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632" status: 404 len: 111 microversion: 2.1 time: 0.030876 Sep 10 12:26:03.498884 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3216/6439] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:26:03 2022] GET /compute/v2.1/servers/0cd2d0dd-638b-4857-807b-092fcb76f632 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:26:06.782768 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a96f06f2-ce5d-477f-ab4a-2e7e40fdbb94 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] Calling method '.version_select at 0x7f40720f7f70>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:26:06.791499 n-d-856895-1 devstack@n-api.service[128776]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a96f06f2-ce5d-477f-ab4a-2e7e40fdbb94 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [191798a7-2c5e-4d74-b865-4708090abecb] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 10 12:26:07.797765 n-d-856895-1 devstack@n-api.service[128776]: INFO oslo.messaging._drivers.impl_rabbit [None req-a96f06f2-ce5d-477f-ab4a-2e7e40fdbb94 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] [191798a7-2c5e-4d74-b865-4708090abecb] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 59586. Sep 10 12:26:07.819992 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a96f06f2-ce5d-477f-ab4a-2e7e40fdbb94 tempest-TestNetworkAdvancedServerOps-223880240 tempest-TestNetworkAdvancedServerOps-223880240-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-711872619" status: 202 len: 0 microversion: 2.1 time: 1.043132 Sep 10 12:26:07.820576 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3224/6440] 10.222.0.23 () {58 vars in 1281 bytes} [Sat Sep 10 12:26:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-711872619 => generated 0 bytes in 1045 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:26:10.694773 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1c947e54-39cd-41cb-b0c6-06d976acc629 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Action: 'create', calling method: .version_select at 0x7f4071e888b0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-2129620565", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8cd5xMdj2168Dftrmj6gkQFJuKOuueTylSDiySRqnFl9XbQ2OMOuzFFJTHdLI0OZn6aTk9Cao9/kMFxTgUN0IjO/Mqvwssj/ptzXVX8eh/Y9xDGGZo4p7OJHKIKmSBkw=="}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:26:10.710588 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-1c947e54-39cd-41cb-b0c6-06d976acc629 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Getting quotas for project 19e6efe2d4bb49b7979aa1679df9db03. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:26:10.716558 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-1c947e54-39cd-41cb-b0c6-06d976acc629 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Getting quotas for user 26839a721c854ad3b1ca8e86d0d043e4 and project 19e6efe2d4bb49b7979aa1679df9db03. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:26:10.730633 n-d-856895-1 devstack@n-api.service[128777]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1c947e54-39cd-41cb-b0c6-06d976acc629 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] [d8176aba-d45a-4571-89f5-c08f8cc142e0] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 10 12:26:11.736768 n-d-856895-1 devstack@n-api.service[128777]: INFO oslo.messaging._drivers.impl_rabbit [None req-1c947e54-39cd-41cb-b0c6-06d976acc629 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] [d8176aba-d45a-4571-89f5-c08f8cc142e0] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 59658. Sep 10 12:26:11.753361 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1c947e54-39cd-41cb-b0c6-06d976acc629 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 1.222266 Sep 10 12:26:11.753983 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3217/6441] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 12:26:10 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:26:16.974822 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=10 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:26:16.977418 n-d-856895-1 devstack@n-api.service[128776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 12:26:16.977820 n-d-856895-1 devstack@n-api.service[128776]: Sat Sep 10 12:26:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Sep 10 12:26:16.982467 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8d51a1c1-20f2-4fd2-98da-238a775aaabe tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-389200634-access_point-382266488", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "819b6a72-73ab-4acd-9080-c6102ec4b98e"}], "key_name": "tempest-TestSecurityGroupsBasicOps-2129620565", "security_groups": [{"name": "tempest-secgroup_access--647107350"}, {"name": "tempest-secgroup_general--500410690"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:26:17.156032 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-8d51a1c1-20f2-4fd2-98da-238a775aaabe tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] validate_networks() for [('819b6a72-73ab-4acd-9080-c6102ec4b98e', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:26:17.600974 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-8d51a1c1-20f2-4fd2-98da-238a775aaabe tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:26:17.601402 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-8d51a1c1-20f2-4fd2-98da-238a775aaabe tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:26:17.601875 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-8d51a1c1-20f2-4fd2-98da-238a775aaabe tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:26:17.602285 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-8d51a1c1-20f2-4fd2-98da-238a775aaabe tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:26:17.602698 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-8d51a1c1-20f2-4fd2-98da-238a775aaabe tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:26:17.612044 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8d51a1c1-20f2-4fd2-98da-238a775aaabe tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:26:17.612607 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8d51a1c1-20f2-4fd2-98da-238a775aaabe tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:26:17.613112 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8d51a1c1-20f2-4fd2-98da-238a775aaabe tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:26:17.615193 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8d51a1c1-20f2-4fd2-98da-238a775aaabe tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:26:17.615751 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8d51a1c1-20f2-4fd2-98da-238a775aaabe tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:26:17.616439 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8d51a1c1-20f2-4fd2-98da-238a775aaabe tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:26:17.634112 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-8d51a1c1-20f2-4fd2-98da-238a775aaabe tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Getting quotas for project 19e6efe2d4bb49b7979aa1679df9db03. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:26:17.639488 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-8d51a1c1-20f2-4fd2-98da-238a775aaabe tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Getting quotas for user 26839a721c854ad3b1ca8e86d0d043e4 and project 19e6efe2d4bb49b7979aa1679df9db03. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:26:17.652547 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8d51a1c1-20f2-4fd2-98da-238a775aaabe tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:26:17.654589 n-d-856895-1 devstack@n-api.service[128776]: WARNING nova.utils [None req-8d51a1c1-20f2-4fd2-98da-238a775aaabe tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-389200634-access_point-382266488 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-389200634-acc Sep 10 12:26:17.655534 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8d51a1c1-20f2-4fd2-98da-238a775aaabe tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] [instance: fc511d41-2a6e-4c17-a3b6-ab88e83ec01f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:26:17.705586 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8d51a1c1-20f2-4fd2-98da-238a775aaabe tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 456 microversion: 2.1 time: 0.732630 Sep 10 12:26:17.706439 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3225/6442] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:26:16 2022] POST /compute/v2.1/servers => generated 456 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:26:17.716379 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:26:17.720411 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-827337a3-b8e0-4a0c-8cf2-e4ccb4276b42 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:26:17.721042 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-827337a3-b8e0-4a0c-8cf2-e4ccb4276b42 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] [instance: fc511d41-2a6e-4c17-a3b6-ab88e83ec01f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:26:17.784304 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-827337a3-b8e0-4a0c-8cf2-e4ccb4276b42 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26839a721c854ad3b1ca8e86d0d043e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e6efe2d4bb49b7979aa1679df9db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:26:17.791529 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-827337a3-b8e0-4a0c-8cf2-e4ccb4276b42 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] 10.222.0.23 "GET /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f" status: 200 len: 1293 microversion: 2.1 time: 0.077364 Sep 10 12:26:17.792112 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3218/6443] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:26:17 2022] GET /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f => generated 1293 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:26:18.821871 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-df53e642-a73a-4d6e-9e49-80ea8c304e57 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:26:18.823800 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-df53e642-a73a-4d6e-9e49-80ea8c304e57 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] [instance: fc511d41-2a6e-4c17-a3b6-ab88e83ec01f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:26:18.898007 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-df53e642-a73a-4d6e-9e49-80ea8c304e57 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26839a721c854ad3b1ca8e86d0d043e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e6efe2d4bb49b7979aa1679df9db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:26:18.905711 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-df53e642-a73a-4d6e-9e49-80ea8c304e57 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] 10.222.0.23 "GET /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f" status: 200 len: 1293 microversion: 2.1 time: 0.093664 Sep 10 12:26:18.920149 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3226/6444] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:26:18 2022] GET /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f => generated 1293 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:26:19.930491 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-02b51d5d-5261-4cd0-8f4e-7a4f981377de tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:26:19.931108 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-02b51d5d-5261-4cd0-8f4e-7a4f981377de tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] [instance: fc511d41-2a6e-4c17-a3b6-ab88e83ec01f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:26:19.937983 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02b51d5d-5261-4cd0-8f4e-7a4f981377de tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:26:19.938467 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02b51d5d-5261-4cd0-8f4e-7a4f981377de tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:26:19.938904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02b51d5d-5261-4cd0-8f4e-7a4f981377de tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:26:19.939625 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02b51d5d-5261-4cd0-8f4e-7a4f981377de tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:26:19.940085 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02b51d5d-5261-4cd0-8f4e-7a4f981377de tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:26:19.940512 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02b51d5d-5261-4cd0-8f4e-7a4f981377de tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:26:20.002939 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-02b51d5d-5261-4cd0-8f4e-7a4f981377de tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26839a721c854ad3b1ca8e86d0d043e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e6efe2d4bb49b7979aa1679df9db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:26:20.011858 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-02b51d5d-5261-4cd0-8f4e-7a4f981377de tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] 10.222.0.23 "GET /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f" status: 200 len: 1297 microversion: 2.1 time: 0.085196 Sep 10 12:26:20.012453 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3219/6445] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:26:19 2022] GET /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f => generated 1297 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:26:21.035677 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-729c696b-ce74-4d40-93b8-b72b0c7762fa tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:26:21.036350 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-729c696b-ce74-4d40-93b8-b72b0c7762fa tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] [instance: fc511d41-2a6e-4c17-a3b6-ab88e83ec01f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:26:21.045006 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-729c696b-ce74-4d40-93b8-b72b0c7762fa tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:26:21.045572 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-729c696b-ce74-4d40-93b8-b72b0c7762fa tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:26:21.046106 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-729c696b-ce74-4d40-93b8-b72b0c7762fa tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:26:21.046915 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-729c696b-ce74-4d40-93b8-b72b0c7762fa tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:26:21.047630 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-729c696b-ce74-4d40-93b8-b72b0c7762fa tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:26:21.048238 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-729c696b-ce74-4d40-93b8-b72b0c7762fa tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:26:21.117401 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-729c696b-ce74-4d40-93b8-b72b0c7762fa tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26839a721c854ad3b1ca8e86d0d043e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e6efe2d4bb49b7979aa1679df9db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:26:21.125308 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-729c696b-ce74-4d40-93b8-b72b0c7762fa tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] 10.222.0.23 "GET /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f" status: 200 len: 1351 microversion: 2.1 time: 0.093830 Sep 10 12:26:21.125884 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3227/6446] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:26:21 2022] GET /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f => generated 1351 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:26:22.149344 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c6e1c6a0-c6d7-43be-ba51-5ce2b69094a5 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:26:22.150067 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c6e1c6a0-c6d7-43be-ba51-5ce2b69094a5 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] [instance: fc511d41-2a6e-4c17-a3b6-ab88e83ec01f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:26:22.157935 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c6e1c6a0-c6d7-43be-ba51-5ce2b69094a5 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:26:22.158511 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c6e1c6a0-c6d7-43be-ba51-5ce2b69094a5 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:26:22.159020 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c6e1c6a0-c6d7-43be-ba51-5ce2b69094a5 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:26:22.160040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c6e1c6a0-c6d7-43be-ba51-5ce2b69094a5 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:26:22.160572 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c6e1c6a0-c6d7-43be-ba51-5ce2b69094a5 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:26:22.161611 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c6e1c6a0-c6d7-43be-ba51-5ce2b69094a5 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:26:22.308850 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c6e1c6a0-c6d7-43be-ba51-5ce2b69094a5 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26839a721c854ad3b1ca8e86d0d043e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e6efe2d4bb49b7979aa1679df9db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:26:22.316798 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c6e1c6a0-c6d7-43be-ba51-5ce2b69094a5 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] 10.222.0.23 "GET /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f" status: 200 len: 1469 microversion: 2.1 time: 0.171678 Sep 10 12:26:22.317397 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3220/6447] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:26:22 2022] GET /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f => generated 1469 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:26:22.375155 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-ee3d5bad-a3b2-47f4-8e4c-145a16db3833 req-4fdc0b11-9fb4-4fac-843b-91a80ba639fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc511d41-2a6e-4c17-a3b6-ab88e83ec01f", "tag": "a67b9aed-c2ce-4cd2-9941-02663ed7a73c"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:26:22.386666 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ee3d5bad-a3b2-47f4-8e4c-145a16db3833 req-4fdc0b11-9fb4-4fac-843b-91a80ba639fd service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:26:22.387218 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ee3d5bad-a3b2-47f4-8e4c-145a16db3833 req-4fdc0b11-9fb4-4fac-843b-91a80ba639fd service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:26:22.387978 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ee3d5bad-a3b2-47f4-8e4c-145a16db3833 req-4fdc0b11-9fb4-4fac-843b-91a80ba639fd service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:26:22.400106 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-ee3d5bad-a3b2-47f4-8e4c-145a16db3833 req-4fdc0b11-9fb4-4fac-843b-91a80ba639fd service nova] Creating event network-changed:a67b9aed-c2ce-4cd2-9941-02663ed7a73c for instance fc511d41-2a6e-4c17-a3b6-ab88e83ec01f on n-h1-856895-1 Sep 10 12:26:22.405171 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-ee3d5bad-a3b2-47f4-8e4c-145a16db3833 req-4fdc0b11-9fb4-4fac-843b-91a80ba639fd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034489 Sep 10 12:26:22.405810 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3228/6448] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:26:23.338848 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cb510dda-56b0-466a-abcb-df725b683fde tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:26:23.339584 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cb510dda-56b0-466a-abcb-df725b683fde tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] [instance: fc511d41-2a6e-4c17-a3b6-ab88e83ec01f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:26:23.346448 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb510dda-56b0-466a-abcb-df725b683fde tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:26:23.346934 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb510dda-56b0-466a-abcb-df725b683fde tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:26:23.347407 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb510dda-56b0-466a-abcb-df725b683fde tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:26:23.348101 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb510dda-56b0-466a-abcb-df725b683fde tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:26:23.348560 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb510dda-56b0-466a-abcb-df725b683fde tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:26:23.348993 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb510dda-56b0-466a-abcb-df725b683fde tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:26:23.492896 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cb510dda-56b0-466a-abcb-df725b683fde tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26839a721c854ad3b1ca8e86d0d043e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e6efe2d4bb49b7979aa1679df9db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:26:23.501292 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cb510dda-56b0-466a-abcb-df725b683fde tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] 10.222.0.23 "GET /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f" status: 200 len: 1469 microversion: 2.1 time: 0.166374 Sep 10 12:26:23.501911 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3221/6449] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:26:23 2022] GET /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f => generated 1469 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:26:24.526847 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0cdb58d4-9caa-4f42-99b6-67a7237dfb79 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:26:24.527582 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0cdb58d4-9caa-4f42-99b6-67a7237dfb79 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] [instance: fc511d41-2a6e-4c17-a3b6-ab88e83ec01f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:26:24.533839 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0cdb58d4-9caa-4f42-99b6-67a7237dfb79 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:26:24.534324 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0cdb58d4-9caa-4f42-99b6-67a7237dfb79 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:26:24.534764 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0cdb58d4-9caa-4f42-99b6-67a7237dfb79 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:26:24.535486 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0cdb58d4-9caa-4f42-99b6-67a7237dfb79 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:26:24.535944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0cdb58d4-9caa-4f42-99b6-67a7237dfb79 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:26:24.536372 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0cdb58d4-9caa-4f42-99b6-67a7237dfb79 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:26:24.684433 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0cdb58d4-9caa-4f42-99b6-67a7237dfb79 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26839a721c854ad3b1ca8e86d0d043e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e6efe2d4bb49b7979aa1679df9db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:26:24.692214 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0cdb58d4-9caa-4f42-99b6-67a7237dfb79 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] 10.222.0.23 "GET /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f" status: 200 len: 1469 microversion: 2.1 time: 0.171235 Sep 10 12:26:24.692874 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3229/6450] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:26:24 2022] GET /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f => generated 1469 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:26:25.715017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-782cda31-77ba-42fe-b4db-b1104a9be1b5 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:26:25.715666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-782cda31-77ba-42fe-b4db-b1104a9be1b5 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] [instance: fc511d41-2a6e-4c17-a3b6-ab88e83ec01f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:26:25.722422 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-782cda31-77ba-42fe-b4db-b1104a9be1b5 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:26:25.722901 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-782cda31-77ba-42fe-b4db-b1104a9be1b5 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:26:25.723367 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-782cda31-77ba-42fe-b4db-b1104a9be1b5 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:26:25.724062 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-782cda31-77ba-42fe-b4db-b1104a9be1b5 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:26:25.724518 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-782cda31-77ba-42fe-b4db-b1104a9be1b5 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:26:25.724945 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-782cda31-77ba-42fe-b4db-b1104a9be1b5 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:26:25.871738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-782cda31-77ba-42fe-b4db-b1104a9be1b5 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26839a721c854ad3b1ca8e86d0d043e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e6efe2d4bb49b7979aa1679df9db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:26:25.879384 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-782cda31-77ba-42fe-b4db-b1104a9be1b5 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] 10.222.0.23 "GET /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f" status: 200 len: 1469 microversion: 2.1 time: 0.168265 Sep 10 12:26:25.879955 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3222/6451] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:26:25 2022] GET /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f => generated 1469 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:26:26.902595 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5fcd23c4-b6ea-44c3-af5e-84bb8cdabdbd tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:26:26.903234 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5fcd23c4-b6ea-44c3-af5e-84bb8cdabdbd tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] [instance: fc511d41-2a6e-4c17-a3b6-ab88e83ec01f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:26:26.910148 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5fcd23c4-b6ea-44c3-af5e-84bb8cdabdbd tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:26:26.910641 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5fcd23c4-b6ea-44c3-af5e-84bb8cdabdbd tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:26:26.911079 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5fcd23c4-b6ea-44c3-af5e-84bb8cdabdbd tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:26:26.912453 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5fcd23c4-b6ea-44c3-af5e-84bb8cdabdbd tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:26:26.913013 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5fcd23c4-b6ea-44c3-af5e-84bb8cdabdbd tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:26:26.913455 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5fcd23c4-b6ea-44c3-af5e-84bb8cdabdbd tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:26:27.055733 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5fcd23c4-b6ea-44c3-af5e-84bb8cdabdbd tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26839a721c854ad3b1ca8e86d0d043e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e6efe2d4bb49b7979aa1679df9db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:26:27.063409 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5fcd23c4-b6ea-44c3-af5e-84bb8cdabdbd tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] 10.222.0.23 "GET /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f" status: 200 len: 1469 microversion: 2.1 time: 0.164773 Sep 10 12:26:27.063990 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3230/6452] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:26:26 2022] GET /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f => generated 1469 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:26:28.087139 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-dfa2f93f-b267-4630-9c7e-42b21e28c627 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:26:28.088087 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-dfa2f93f-b267-4630-9c7e-42b21e28c627 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] [instance: fc511d41-2a6e-4c17-a3b6-ab88e83ec01f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:26:28.090778 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:26:28.096105 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dfa2f93f-b267-4630-9c7e-42b21e28c627 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:26:28.096591 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dfa2f93f-b267-4630-9c7e-42b21e28c627 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:26:28.097030 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dfa2f93f-b267-4630-9c7e-42b21e28c627 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:26:28.097732 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dfa2f93f-b267-4630-9c7e-42b21e28c627 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:26:28.098188 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dfa2f93f-b267-4630-9c7e-42b21e28c627 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:26:28.098618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dfa2f93f-b267-4630-9c7e-42b21e28c627 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:26:28.255638 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-dfa2f93f-b267-4630-9c7e-42b21e28c627 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26839a721c854ad3b1ca8e86d0d043e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e6efe2d4bb49b7979aa1679df9db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:26:28.263531 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-dfa2f93f-b267-4630-9c7e-42b21e28c627 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] 10.222.0.23 "GET /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f" status: 200 len: 1469 microversion: 2.1 time: 0.180824 Sep 10 12:26:28.264116 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3223/6453] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:26:28 2022] GET /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f => generated 1469 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:26:29.285872 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-74f14347-2a45-4177-9ccd-b02fa84b1217 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:26:29.286575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-74f14347-2a45-4177-9ccd-b02fa84b1217 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] [instance: fc511d41-2a6e-4c17-a3b6-ab88e83ec01f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:26:29.288709 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:26:29.289831 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=8 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:26:29.295711 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-74f14347-2a45-4177-9ccd-b02fa84b1217 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:26:29.296190 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-74f14347-2a45-4177-9ccd-b02fa84b1217 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:26:29.296625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-74f14347-2a45-4177-9ccd-b02fa84b1217 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:26:29.297311 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-74f14347-2a45-4177-9ccd-b02fa84b1217 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:26:29.297762 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-74f14347-2a45-4177-9ccd-b02fa84b1217 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:26:29.298183 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-74f14347-2a45-4177-9ccd-b02fa84b1217 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:26:29.438079 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-74f14347-2a45-4177-9ccd-b02fa84b1217 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26839a721c854ad3b1ca8e86d0d043e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e6efe2d4bb49b7979aa1679df9db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:26:29.445939 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-74f14347-2a45-4177-9ccd-b02fa84b1217 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] 10.222.0.23 "GET /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f" status: 200 len: 1469 microversion: 2.1 time: 0.163916 Sep 10 12:26:29.446505 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3231/6454] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:26:29 2022] GET /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f => generated 1469 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:26:30.321113 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-354c9367-5787-4cb1-91f9-f2934799fd9d req-a9cc4873-283a-4967-a972-7a5d3a82fe96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc511d41-2a6e-4c17-a3b6-ab88e83ec01f", "name": "network-vif-plugged", "status": "completed", "tag": "a67b9aed-c2ce-4cd2-9941-02663ed7a73c"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:26:30.331685 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-354c9367-5787-4cb1-91f9-f2934799fd9d req-a9cc4873-283a-4967-a972-7a5d3a82fe96 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:26:30.332161 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-354c9367-5787-4cb1-91f9-f2934799fd9d req-a9cc4873-283a-4967-a972-7a5d3a82fe96 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:26:30.332799 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-354c9367-5787-4cb1-91f9-f2934799fd9d req-a9cc4873-283a-4967-a972-7a5d3a82fe96 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:26:30.351325 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-354c9367-5787-4cb1-91f9-f2934799fd9d req-a9cc4873-283a-4967-a972-7a5d3a82fe96 service nova] Creating event network-vif-plugged:a67b9aed-c2ce-4cd2-9941-02663ed7a73c for instance fc511d41-2a6e-4c17-a3b6-ab88e83ec01f on n-h1-856895-1 Sep 10 12:26:30.356339 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-354c9367-5787-4cb1-91f9-f2934799fd9d req-a9cc4873-283a-4967-a972-7a5d3a82fe96 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039103 Sep 10 12:26:30.356953 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3224/6455] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:26:30.469564 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-52e4865e-a8be-407f-88ef-e0c461460183 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:26:30.470317 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-52e4865e-a8be-407f-88ef-e0c461460183 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] [instance: fc511d41-2a6e-4c17-a3b6-ab88e83ec01f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:26:30.478011 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52e4865e-a8be-407f-88ef-e0c461460183 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:26:30.478506 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52e4865e-a8be-407f-88ef-e0c461460183 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:26:30.478949 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52e4865e-a8be-407f-88ef-e0c461460183 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:26:30.479678 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52e4865e-a8be-407f-88ef-e0c461460183 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:26:30.480139 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52e4865e-a8be-407f-88ef-e0c461460183 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:26:30.480572 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52e4865e-a8be-407f-88ef-e0c461460183 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:26:30.633006 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-52e4865e-a8be-407f-88ef-e0c461460183 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26839a721c854ad3b1ca8e86d0d043e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e6efe2d4bb49b7979aa1679df9db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:26:30.640710 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-52e4865e-a8be-407f-88ef-e0c461460183 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] 10.222.0.23 "GET /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f" status: 200 len: 1469 microversion: 2.1 time: 0.175046 Sep 10 12:26:30.641275 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3232/6456] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:26:30 2022] GET /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f => generated 1469 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:26:31.665992 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3f5b60ec-ebbd-4732-99d9-56df37925c13 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:26:31.666705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3f5b60ec-ebbd-4732-99d9-56df37925c13 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] [instance: fc511d41-2a6e-4c17-a3b6-ab88e83ec01f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:26:31.668662 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:26:31.674079 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3f5b60ec-ebbd-4732-99d9-56df37925c13 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:26:31.674561 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3f5b60ec-ebbd-4732-99d9-56df37925c13 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:26:31.675002 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3f5b60ec-ebbd-4732-99d9-56df37925c13 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:26:31.675720 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3f5b60ec-ebbd-4732-99d9-56df37925c13 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:26:31.676181 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3f5b60ec-ebbd-4732-99d9-56df37925c13 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:26:31.676611 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3f5b60ec-ebbd-4732-99d9-56df37925c13 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:26:31.819404 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3f5b60ec-ebbd-4732-99d9-56df37925c13 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26839a721c854ad3b1ca8e86d0d043e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e6efe2d4bb49b7979aa1679df9db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:26:31.827439 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3f5b60ec-ebbd-4732-99d9-56df37925c13 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] 10.222.0.23 "GET /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f" status: 200 len: 1469 microversion: 2.1 time: 0.166647 Sep 10 12:26:31.828019 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3225/6457] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:26:31 2022] GET /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f => generated 1469 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:26:32.852239 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f1604d24-486b-44a1-8fb9-75269d7ec7b8 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:26:32.852849 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f1604d24-486b-44a1-8fb9-75269d7ec7b8 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] [instance: fc511d41-2a6e-4c17-a3b6-ab88e83ec01f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:26:32.855555 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:26:32.860895 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1604d24-486b-44a1-8fb9-75269d7ec7b8 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:26:32.861377 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1604d24-486b-44a1-8fb9-75269d7ec7b8 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:26:32.861809 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1604d24-486b-44a1-8fb9-75269d7ec7b8 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:26:32.862493 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1604d24-486b-44a1-8fb9-75269d7ec7b8 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:26:32.863262 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1604d24-486b-44a1-8fb9-75269d7ec7b8 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:26:32.863955 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f1604d24-486b-44a1-8fb9-75269d7ec7b8 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:26:33.007853 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f1604d24-486b-44a1-8fb9-75269d7ec7b8 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26839a721c854ad3b1ca8e86d0d043e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e6efe2d4bb49b7979aa1679df9db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:26:33.015612 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f1604d24-486b-44a1-8fb9-75269d7ec7b8 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] 10.222.0.23 "GET /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f" status: 200 len: 1640 microversion: 2.1 time: 0.167997 Sep 10 12:26:33.016178 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3233/6458] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:26:32 2022] GET /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f => generated 1640 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:26:33.037932 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-93ee8388-a3d6-4bb1-94b0-c38873abd310 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:26:33.038544 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-93ee8388-a3d6-4bb1-94b0-c38873abd310 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] [instance: fc511d41-2a6e-4c17-a3b6-ab88e83ec01f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:26:33.045153 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-93ee8388-a3d6-4bb1-94b0-c38873abd310 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:26:33.045632 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-93ee8388-a3d6-4bb1-94b0-c38873abd310 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:26:33.046065 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-93ee8388-a3d6-4bb1-94b0-c38873abd310 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:26:33.046749 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-93ee8388-a3d6-4bb1-94b0-c38873abd310 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:26:33.047224 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-93ee8388-a3d6-4bb1-94b0-c38873abd310 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:26:33.047652 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-93ee8388-a3d6-4bb1-94b0-c38873abd310 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:26:33.193470 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-93ee8388-a3d6-4bb1-94b0-c38873abd310 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26839a721c854ad3b1ca8e86d0d043e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e6efe2d4bb49b7979aa1679df9db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:26:33.201211 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-93ee8388-a3d6-4bb1-94b0-c38873abd310 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] 10.222.0.23 "GET /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f" status: 200 len: 1640 microversion: 2.1 time: 0.167346 Sep 10 12:26:33.201734 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3226/6459] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:26:33 2022] GET /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f => generated 1640 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:26:33.224545 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8466ffe3-4235-4e79-bca2-5f678c0c33ea tempest-TestSecurityGroupsBasicOps-450898973 tempest-TestSecurityGroupsBasicOps-450898973-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:26:33.225139 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8466ffe3-4235-4e79-bca2-5f678c0c33ea tempest-TestSecurityGroupsBasicOps-450898973 tempest-TestSecurityGroupsBasicOps-450898973-project-admin] [instance: fc511d41-2a6e-4c17-a3b6-ab88e83ec01f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:26:33.231191 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8466ffe3-4235-4e79-bca2-5f678c0c33ea tempest-TestSecurityGroupsBasicOps-450898973 tempest-TestSecurityGroupsBasicOps-450898973-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:26:33.231685 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8466ffe3-4235-4e79-bca2-5f678c0c33ea tempest-TestSecurityGroupsBasicOps-450898973 tempest-TestSecurityGroupsBasicOps-450898973-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:26:33.232127 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8466ffe3-4235-4e79-bca2-5f678c0c33ea tempest-TestSecurityGroupsBasicOps-450898973 tempest-TestSecurityGroupsBasicOps-450898973-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:26:33.232815 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8466ffe3-4235-4e79-bca2-5f678c0c33ea tempest-TestSecurityGroupsBasicOps-450898973 tempest-TestSecurityGroupsBasicOps-450898973-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:26:33.233299 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8466ffe3-4235-4e79-bca2-5f678c0c33ea tempest-TestSecurityGroupsBasicOps-450898973 tempest-TestSecurityGroupsBasicOps-450898973-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:26:33.233732 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8466ffe3-4235-4e79-bca2-5f678c0c33ea tempest-TestSecurityGroupsBasicOps-450898973 tempest-TestSecurityGroupsBasicOps-450898973-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:26:33.475016 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8466ffe3-4235-4e79-bca2-5f678c0c33ea tempest-TestSecurityGroupsBasicOps-450898973 tempest-TestSecurityGroupsBasicOps-450898973-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f" status: 200 len: 1791 microversion: 2.1 time: 0.253399 Sep 10 12:26:33.475659 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3234/6460] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:26:33 2022] GET /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f => generated 1791 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:26:35.074660 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-87829d05-ead3-45aa-9f76-474d23e54db6 req-eb9cd775-1417-40b2-8556-19ff1cef7275 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc511d41-2a6e-4c17-a3b6-ab88e83ec01f", "tag": "a67b9aed-c2ce-4cd2-9941-02663ed7a73c"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:26:35.085792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-87829d05-ead3-45aa-9f76-474d23e54db6 req-eb9cd775-1417-40b2-8556-19ff1cef7275 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:26:35.086257 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-87829d05-ead3-45aa-9f76-474d23e54db6 req-eb9cd775-1417-40b2-8556-19ff1cef7275 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:26:35.086690 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-87829d05-ead3-45aa-9f76-474d23e54db6 req-eb9cd775-1417-40b2-8556-19ff1cef7275 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:26:35.098480 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-87829d05-ead3-45aa-9f76-474d23e54db6 req-eb9cd775-1417-40b2-8556-19ff1cef7275 service nova] Creating event network-changed:a67b9aed-c2ce-4cd2-9941-02663ed7a73c for instance fc511d41-2a6e-4c17-a3b6-ab88e83ec01f on n-h1-856895-1 Sep 10 12:26:35.104460 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-87829d05-ead3-45aa-9f76-474d23e54db6 req-eb9cd775-1417-40b2-8556-19ff1cef7275 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033477 Sep 10 12:26:35.105337 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3227/6461] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:27:45.832162 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:27:45.833651 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=46 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:27:45.838167 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cff8b2a1-fddd-4181-a65b-247f519c4e6e tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-520494379", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "bdb9cd61-401f-4b25-83a4-55e4c2516b86"}], "key_name": "tempest-TestSecurityGroupsBasicOps-2129620565", "security_groups": []}, "os:scheduler_hints": {"different_host": ["fc511d41-2a6e-4c17-a3b6-ab88e83ec01f"]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:27:45.900196 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-cff8b2a1-fddd-4181-a65b-247f519c4e6e tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] validate_networks() for [('bdb9cd61-401f-4b25-83a4-55e4c2516b86', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:27:46.328799 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-cff8b2a1-fddd-4181-a65b-247f519c4e6e tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:27:46.329352 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-cff8b2a1-fddd-4181-a65b-247f519c4e6e tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:27:46.329841 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-cff8b2a1-fddd-4181-a65b-247f519c4e6e tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:27:46.330260 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-cff8b2a1-fddd-4181-a65b-247f519c4e6e tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:27:46.330682 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-cff8b2a1-fddd-4181-a65b-247f519c4e6e tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:27:46.340226 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cff8b2a1-fddd-4181-a65b-247f519c4e6e tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:27:46.340716 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cff8b2a1-fddd-4181-a65b-247f519c4e6e tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:27:46.341162 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cff8b2a1-fddd-4181-a65b-247f519c4e6e tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:27:46.341898 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cff8b2a1-fddd-4181-a65b-247f519c4e6e tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:27:46.342359 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cff8b2a1-fddd-4181-a65b-247f519c4e6e tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:27:46.342792 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cff8b2a1-fddd-4181-a65b-247f519c4e6e tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:27:46.360585 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-cff8b2a1-fddd-4181-a65b-247f519c4e6e tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Getting quotas for project 19e6efe2d4bb49b7979aa1679df9db03. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:27:46.366174 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-cff8b2a1-fddd-4181-a65b-247f519c4e6e tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Getting quotas for user 26839a721c854ad3b1ca8e86d0d043e4 and project 19e6efe2d4bb49b7979aa1679df9db03. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:27:46.378792 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cff8b2a1-fddd-4181-a65b-247f519c4e6e tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:27:46.381229 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cff8b2a1-fddd-4181-a65b-247f519c4e6e tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] [instance: 85292ed5-ec86-4aa5-9191-a110260f9f93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:27:46.430208 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cff8b2a1-fddd-4181-a65b-247f519c4e6e tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.599778 Sep 10 12:27:46.431041 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3235/6462] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:27:45 2022] POST /compute/v2.1/servers => generated 361 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:27:46.443104 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=5 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:27:46.444262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=46 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:27:46.449881 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7377e22e-4ed8-4fef-ba9a-d9e91153ce83 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:27:46.450610 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7377e22e-4ed8-4fef-ba9a-d9e91153ce83 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] [instance: 85292ed5-ec86-4aa5-9191-a110260f9f93] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:27:46.511892 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7377e22e-4ed8-4fef-ba9a-d9e91153ce83 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26839a721c854ad3b1ca8e86d0d043e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e6efe2d4bb49b7979aa1679df9db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:27:46.519194 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7377e22e-4ed8-4fef-ba9a-d9e91153ce83 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] 10.222.0.23 "GET /compute/v2.1/servers/85292ed5-ec86-4aa5-9191-a110260f9f93" status: 200 len: 1241 microversion: 2.1 time: 0.079794 Sep 10 12:27:46.519827 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3228/6463] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:27:46 2022] GET /compute/v2.1/servers/85292ed5-ec86-4aa5-9191-a110260f9f93 => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:27:47.543651 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-847893de-3048-4230-b244-7b13a59208b5 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:27:47.544406 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-847893de-3048-4230-b244-7b13a59208b5 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] [instance: 85292ed5-ec86-4aa5-9191-a110260f9f93] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:27:47.604068 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-847893de-3048-4230-b244-7b13a59208b5 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26839a721c854ad3b1ca8e86d0d043e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e6efe2d4bb49b7979aa1679df9db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:27:47.626306 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-847893de-3048-4230-b244-7b13a59208b5 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] 10.222.0.23 "GET /compute/v2.1/servers/85292ed5-ec86-4aa5-9191-a110260f9f93" status: 200 len: 1241 microversion: 2.1 time: 0.087497 Sep 10 12:27:47.643340 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3236/6464] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:27:47 2022] GET /compute/v2.1/servers/85292ed5-ec86-4aa5-9191-a110260f9f93 => generated 1241 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:27:48.652301 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9a41a252-38db-4274-a0a0-7372fa416732 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:27:48.652927 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9a41a252-38db-4274-a0a0-7372fa416732 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] [instance: 85292ed5-ec86-4aa5-9191-a110260f9f93] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:27:48.664274 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9a41a252-38db-4274-a0a0-7372fa416732 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:27:48.665524 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9a41a252-38db-4274-a0a0-7372fa416732 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:27:48.665970 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9a41a252-38db-4274-a0a0-7372fa416732 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:27:48.666677 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9a41a252-38db-4274-a0a0-7372fa416732 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:27:48.667139 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9a41a252-38db-4274-a0a0-7372fa416732 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:27:48.667597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9a41a252-38db-4274-a0a0-7372fa416732 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:27:48.745136 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9a41a252-38db-4274-a0a0-7372fa416732 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26839a721c854ad3b1ca8e86d0d043e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e6efe2d4bb49b7979aa1679df9db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:27:48.753553 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9a41a252-38db-4274-a0a0-7372fa416732 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] 10.222.0.23 "GET /compute/v2.1/servers/85292ed5-ec86-4aa5-9191-a110260f9f93" status: 200 len: 1311 microversion: 2.1 time: 0.106089 Sep 10 12:27:48.754148 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3229/6465] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:27:48 2022] GET /compute/v2.1/servers/85292ed5-ec86-4aa5-9191-a110260f9f93 => generated 1311 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:27:49.777475 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c66adefd-a5ee-436d-982c-db01d7e515dc tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:27:49.778106 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c66adefd-a5ee-436d-982c-db01d7e515dc tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] [instance: 85292ed5-ec86-4aa5-9191-a110260f9f93] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:27:49.786045 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c66adefd-a5ee-436d-982c-db01d7e515dc tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:27:49.786794 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c66adefd-a5ee-436d-982c-db01d7e515dc tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:27:49.787488 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c66adefd-a5ee-436d-982c-db01d7e515dc tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:27:49.788204 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c66adefd-a5ee-436d-982c-db01d7e515dc tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:27:49.788804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c66adefd-a5ee-436d-982c-db01d7e515dc tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:27:49.789202 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c66adefd-a5ee-436d-982c-db01d7e515dc tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:27:49.929719 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c66adefd-a5ee-436d-982c-db01d7e515dc tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26839a721c854ad3b1ca8e86d0d043e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e6efe2d4bb49b7979aa1679df9db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:27:49.938341 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c66adefd-a5ee-436d-982c-db01d7e515dc tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] 10.222.0.23 "GET /compute/v2.1/servers/85292ed5-ec86-4aa5-9191-a110260f9f93" status: 200 len: 1299 microversion: 2.1 time: 0.165113 Sep 10 12:27:49.938932 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3237/6466] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:27:49 2022] GET /compute/v2.1/servers/85292ed5-ec86-4aa5-9191-a110260f9f93 => generated 1299 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:27:50.124266 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-1ca3cd5a-170d-4b4b-a3df-3ec5d3e82ba9 req-be1dcc54-e55d-4d93-a9bc-783fc3a4da60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85292ed5-ec86-4aa5-9191-a110260f9f93", "tag": "520b48e5-4ce5-413a-a0ec-26ada836a0ba"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:27:50.140570 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-1ca3cd5a-170d-4b4b-a3df-3ec5d3e82ba9 req-be1dcc54-e55d-4d93-a9bc-783fc3a4da60 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:27:50.141057 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-1ca3cd5a-170d-4b4b-a3df-3ec5d3e82ba9 req-be1dcc54-e55d-4d93-a9bc-783fc3a4da60 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:27:50.141494 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-1ca3cd5a-170d-4b4b-a3df-3ec5d3e82ba9 req-be1dcc54-e55d-4d93-a9bc-783fc3a4da60 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:27:50.154153 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-1ca3cd5a-170d-4b4b-a3df-3ec5d3e82ba9 req-be1dcc54-e55d-4d93-a9bc-783fc3a4da60 service nova] Creating event network-changed:520b48e5-4ce5-413a-a0ec-26ada836a0ba for instance 85292ed5-ec86-4aa5-9191-a110260f9f93 on n-h2-856895-1 Sep 10 12:27:50.159246 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-1ca3cd5a-170d-4b4b-a3df-3ec5d3e82ba9 req-be1dcc54-e55d-4d93-a9bc-783fc3a4da60 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038884 Sep 10 12:27:50.159863 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3230/6467] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:27:50.962469 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0caee7a3-e22c-43b0-822a-68a2c721af8f tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:27:50.963083 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0caee7a3-e22c-43b0-822a-68a2c721af8f tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] [instance: 85292ed5-ec86-4aa5-9191-a110260f9f93] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:27:50.969882 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0caee7a3-e22c-43b0-822a-68a2c721af8f tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:27:50.970362 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0caee7a3-e22c-43b0-822a-68a2c721af8f tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:27:50.970803 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0caee7a3-e22c-43b0-822a-68a2c721af8f tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:27:50.971510 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0caee7a3-e22c-43b0-822a-68a2c721af8f tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:27:50.971964 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0caee7a3-e22c-43b0-822a-68a2c721af8f tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:27:50.972391 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0caee7a3-e22c-43b0-822a-68a2c721af8f tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:27:51.053746 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0caee7a3-e22c-43b0-822a-68a2c721af8f tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26839a721c854ad3b1ca8e86d0d043e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e6efe2d4bb49b7979aa1679df9db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:27:51.062021 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0caee7a3-e22c-43b0-822a-68a2c721af8f tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] 10.222.0.23 "GET /compute/v2.1/servers/85292ed5-ec86-4aa5-9191-a110260f9f93" status: 200 len: 1299 microversion: 2.1 time: 0.104125 Sep 10 12:27:51.062593 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3238/6468] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:27:50 2022] GET /compute/v2.1/servers/85292ed5-ec86-4aa5-9191-a110260f9f93 => generated 1299 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:27:52.086906 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5660a97c-e071-4da8-a1f4-dde8defcfdc4 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:27:52.087600 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5660a97c-e071-4da8-a1f4-dde8defcfdc4 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] [instance: 85292ed5-ec86-4aa5-9191-a110260f9f93] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:27:52.094356 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5660a97c-e071-4da8-a1f4-dde8defcfdc4 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:27:52.094879 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5660a97c-e071-4da8-a1f4-dde8defcfdc4 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:27:52.095446 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5660a97c-e071-4da8-a1f4-dde8defcfdc4 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:27:52.096147 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5660a97c-e071-4da8-a1f4-dde8defcfdc4 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:27:52.096614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5660a97c-e071-4da8-a1f4-dde8defcfdc4 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:27:52.097047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5660a97c-e071-4da8-a1f4-dde8defcfdc4 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:27:52.185890 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5660a97c-e071-4da8-a1f4-dde8defcfdc4 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26839a721c854ad3b1ca8e86d0d043e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e6efe2d4bb49b7979aa1679df9db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:27:52.193977 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5660a97c-e071-4da8-a1f4-dde8defcfdc4 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] 10.222.0.23 "GET /compute/v2.1/servers/85292ed5-ec86-4aa5-9191-a110260f9f93" status: 200 len: 1299 microversion: 2.1 time: 0.112766 Sep 10 12:27:52.194563 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3231/6469] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:27:52 2022] GET /compute/v2.1/servers/85292ed5-ec86-4aa5-9191-a110260f9f93 => generated 1299 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:27:53.217041 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-265bea5a-c0e0-496d-851a-6123bbad8a96 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:27:53.217672 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-265bea5a-c0e0-496d-851a-6123bbad8a96 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] [instance: 85292ed5-ec86-4aa5-9191-a110260f9f93] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:27:53.224529 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-265bea5a-c0e0-496d-851a-6123bbad8a96 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:27:53.225008 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-265bea5a-c0e0-496d-851a-6123bbad8a96 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:27:53.225440 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-265bea5a-c0e0-496d-851a-6123bbad8a96 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:27:53.226122 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-265bea5a-c0e0-496d-851a-6123bbad8a96 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:27:53.226572 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-265bea5a-c0e0-496d-851a-6123bbad8a96 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:27:53.227121 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-265bea5a-c0e0-496d-851a-6123bbad8a96 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:27:53.312061 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-265bea5a-c0e0-496d-851a-6123bbad8a96 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26839a721c854ad3b1ca8e86d0d043e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e6efe2d4bb49b7979aa1679df9db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:27:53.320202 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-265bea5a-c0e0-496d-851a-6123bbad8a96 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] 10.222.0.23 "GET /compute/v2.1/servers/85292ed5-ec86-4aa5-9191-a110260f9f93" status: 200 len: 1299 microversion: 2.1 time: 0.107048 Sep 10 12:27:53.321781 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3239/6470] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:27:53 2022] GET /compute/v2.1/servers/85292ed5-ec86-4aa5-9191-a110260f9f93 => generated 1299 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:27:54.343911 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3a87e183-1b25-4370-9e25-3b7eb3b3d968 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:27:54.344645 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3a87e183-1b25-4370-9e25-3b7eb3b3d968 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] [instance: 85292ed5-ec86-4aa5-9191-a110260f9f93] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:27:54.351554 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a87e183-1b25-4370-9e25-3b7eb3b3d968 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:27:54.352153 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a87e183-1b25-4370-9e25-3b7eb3b3d968 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:27:54.352537 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a87e183-1b25-4370-9e25-3b7eb3b3d968 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:27:54.353226 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a87e183-1b25-4370-9e25-3b7eb3b3d968 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:27:54.353684 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a87e183-1b25-4370-9e25-3b7eb3b3d968 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:27:54.354110 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a87e183-1b25-4370-9e25-3b7eb3b3d968 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:27:54.434411 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3a87e183-1b25-4370-9e25-3b7eb3b3d968 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26839a721c854ad3b1ca8e86d0d043e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e6efe2d4bb49b7979aa1679df9db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:27:54.442089 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3a87e183-1b25-4370-9e25-3b7eb3b3d968 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] 10.222.0.23 "GET /compute/v2.1/servers/85292ed5-ec86-4aa5-9191-a110260f9f93" status: 200 len: 1299 microversion: 2.1 time: 0.102116 Sep 10 12:27:54.442885 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3232/6471] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:27:54 2022] GET /compute/v2.1/servers/85292ed5-ec86-4aa5-9191-a110260f9f93 => generated 1299 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:27:55.467176 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e56198d8-2a8f-49bf-a6eb-9e10e3d79048 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:27:55.467878 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e56198d8-2a8f-49bf-a6eb-9e10e3d79048 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] [instance: 85292ed5-ec86-4aa5-9191-a110260f9f93] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:27:55.474795 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e56198d8-2a8f-49bf-a6eb-9e10e3d79048 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:27:55.475365 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e56198d8-2a8f-49bf-a6eb-9e10e3d79048 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:27:55.475918 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e56198d8-2a8f-49bf-a6eb-9e10e3d79048 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:27:55.476690 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e56198d8-2a8f-49bf-a6eb-9e10e3d79048 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:27:55.477245 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e56198d8-2a8f-49bf-a6eb-9e10e3d79048 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:27:55.477746 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e56198d8-2a8f-49bf-a6eb-9e10e3d79048 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:27:55.527486 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-25dba5d9-ed04-4eb2-97c7-d4d3f6a5a5c8 req-0dcde989-360f-4c0e-85e5-9339a03bd41c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85292ed5-ec86-4aa5-9191-a110260f9f93", "name": "network-vif-plugged", "status": "completed", "tag": "520b48e5-4ce5-413a-a0ec-26ada836a0ba"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:27:55.537030 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-25dba5d9-ed04-4eb2-97c7-d4d3f6a5a5c8 req-0dcde989-360f-4c0e-85e5-9339a03bd41c service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:27:55.537506 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-25dba5d9-ed04-4eb2-97c7-d4d3f6a5a5c8 req-0dcde989-360f-4c0e-85e5-9339a03bd41c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:27:55.537934 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-25dba5d9-ed04-4eb2-97c7-d4d3f6a5a5c8 req-0dcde989-360f-4c0e-85e5-9339a03bd41c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:27:55.549668 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-25dba5d9-ed04-4eb2-97c7-d4d3f6a5a5c8 req-0dcde989-360f-4c0e-85e5-9339a03bd41c service nova] Creating event network-vif-plugged:520b48e5-4ce5-413a-a0ec-26ada836a0ba for instance 85292ed5-ec86-4aa5-9191-a110260f9f93 on n-h2-856895-1 Sep 10 12:27:55.555030 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-25dba5d9-ed04-4eb2-97c7-d4d3f6a5a5c8 req-0dcde989-360f-4c0e-85e5-9339a03bd41c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139465 Sep 10 12:27:55.555674 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3240/6472] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:27:55.573451 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e56198d8-2a8f-49bf-a6eb-9e10e3d79048 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26839a721c854ad3b1ca8e86d0d043e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e6efe2d4bb49b7979aa1679df9db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:27:55.581373 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e56198d8-2a8f-49bf-a6eb-9e10e3d79048 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] 10.222.0.23 "GET /compute/v2.1/servers/85292ed5-ec86-4aa5-9191-a110260f9f93" status: 200 len: 1299 microversion: 2.1 time: 0.119609 Sep 10 12:27:55.582049 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3233/6473] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:27:55 2022] GET /compute/v2.1/servers/85292ed5-ec86-4aa5-9191-a110260f9f93 => generated 1299 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:27:56.605444 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:27:56.610663 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8cd72d65-937a-4956-8ce1-070c7d03b301 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:27:56.611408 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8cd72d65-937a-4956-8ce1-070c7d03b301 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] [instance: 85292ed5-ec86-4aa5-9191-a110260f9f93] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:27:56.618225 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8cd72d65-937a-4956-8ce1-070c7d03b301 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:27:56.618904 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8cd72d65-937a-4956-8ce1-070c7d03b301 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:27:56.620076 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8cd72d65-937a-4956-8ce1-070c7d03b301 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:27:56.620783 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8cd72d65-937a-4956-8ce1-070c7d03b301 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:27:56.621249 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8cd72d65-937a-4956-8ce1-070c7d03b301 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:27:56.621686 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8cd72d65-937a-4956-8ce1-070c7d03b301 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:27:56.706417 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8cd72d65-937a-4956-8ce1-070c7d03b301 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26839a721c854ad3b1ca8e86d0d043e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e6efe2d4bb49b7979aa1679df9db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:27:56.715573 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8cd72d65-937a-4956-8ce1-070c7d03b301 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] 10.222.0.23 "GET /compute/v2.1/servers/85292ed5-ec86-4aa5-9191-a110260f9f93" status: 200 len: 1299 microversion: 2.1 time: 0.111087 Sep 10 12:27:56.716481 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3241/6474] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:27:56 2022] GET /compute/v2.1/servers/85292ed5-ec86-4aa5-9191-a110260f9f93 => generated 1299 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:27:57.738616 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:27:57.740753 n-d-856895-1 devstack@n-api.service[128777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 12:27:57.740945 n-d-856895-1 devstack@n-api.service[128777]: Sat Sep 10 12:27:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/85292ed5-ec86-4aa5-9191-a110260f9f93 (ip 10.222.0.23) !!! Sep 10 12:27:57.750076 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-add042ec-f90a-44b3-a0ef-9a7d3166ed75 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:27:57.750686 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-add042ec-f90a-44b3-a0ef-9a7d3166ed75 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] [instance: 85292ed5-ec86-4aa5-9191-a110260f9f93] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:27:57.760522 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-add042ec-f90a-44b3-a0ef-9a7d3166ed75 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:27:57.762505 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-add042ec-f90a-44b3-a0ef-9a7d3166ed75 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:27:57.762960 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-add042ec-f90a-44b3-a0ef-9a7d3166ed75 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:27:57.763854 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-add042ec-f90a-44b3-a0ef-9a7d3166ed75 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:27:57.764318 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-add042ec-f90a-44b3-a0ef-9a7d3166ed75 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:27:57.764747 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-add042ec-f90a-44b3-a0ef-9a7d3166ed75 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:27:57.858497 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-add042ec-f90a-44b3-a0ef-9a7d3166ed75 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26839a721c854ad3b1ca8e86d0d043e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e6efe2d4bb49b7979aa1679df9db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:27:57.866649 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-add042ec-f90a-44b3-a0ef-9a7d3166ed75 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] 10.222.0.23 "GET /compute/v2.1/servers/85292ed5-ec86-4aa5-9191-a110260f9f93" status: 200 len: 1471 microversion: 2.1 time: 0.130027 Sep 10 12:27:57.867339 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3234/6475] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:27:57 2022] GET /compute/v2.1/servers/85292ed5-ec86-4aa5-9191-a110260f9f93 => generated 1471 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:27:57.889476 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1a03d619-b9ed-4e2b-8f41-d3fd301d1fa8 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:27:57.890158 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1a03d619-b9ed-4e2b-8f41-d3fd301d1fa8 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] [instance: 85292ed5-ec86-4aa5-9191-a110260f9f93] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:27:57.893399 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=8 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:27:57.899125 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a03d619-b9ed-4e2b-8f41-d3fd301d1fa8 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:27:57.899647 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a03d619-b9ed-4e2b-8f41-d3fd301d1fa8 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:27:57.900107 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a03d619-b9ed-4e2b-8f41-d3fd301d1fa8 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:27:57.901374 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a03d619-b9ed-4e2b-8f41-d3fd301d1fa8 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:27:57.901831 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a03d619-b9ed-4e2b-8f41-d3fd301d1fa8 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:27:57.902267 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a03d619-b9ed-4e2b-8f41-d3fd301d1fa8 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:27:57.986309 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1a03d619-b9ed-4e2b-8f41-d3fd301d1fa8 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26839a721c854ad3b1ca8e86d0d043e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e6efe2d4bb49b7979aa1679df9db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:27:57.995210 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1a03d619-b9ed-4e2b-8f41-d3fd301d1fa8 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] 10.222.0.23 "GET /compute/v2.1/servers/85292ed5-ec86-4aa5-9191-a110260f9f93" status: 200 len: 1471 microversion: 2.1 time: 0.109791 Sep 10 12:27:57.995794 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3242/6476] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:27:57 2022] GET /compute/v2.1/servers/85292ed5-ec86-4aa5-9191-a110260f9f93 => generated 1471 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:27:58.020183 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a66790bc-e208-462a-a059-246f1053e589 tempest-TestSecurityGroupsBasicOps-450898973 tempest-TestSecurityGroupsBasicOps-450898973-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:27:58.020831 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a66790bc-e208-462a-a059-246f1053e589 tempest-TestSecurityGroupsBasicOps-450898973 tempest-TestSecurityGroupsBasicOps-450898973-project-admin] [instance: 85292ed5-ec86-4aa5-9191-a110260f9f93] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:27:58.030570 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a66790bc-e208-462a-a059-246f1053e589 tempest-TestSecurityGroupsBasicOps-450898973 tempest-TestSecurityGroupsBasicOps-450898973-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:27:58.031495 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a66790bc-e208-462a-a059-246f1053e589 tempest-TestSecurityGroupsBasicOps-450898973 tempest-TestSecurityGroupsBasicOps-450898973-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:27:58.032301 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a66790bc-e208-462a-a059-246f1053e589 tempest-TestSecurityGroupsBasicOps-450898973 tempest-TestSecurityGroupsBasicOps-450898973-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:27:58.033567 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a66790bc-e208-462a-a059-246f1053e589 tempest-TestSecurityGroupsBasicOps-450898973 tempest-TestSecurityGroupsBasicOps-450898973-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:27:58.034433 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a66790bc-e208-462a-a059-246f1053e589 tempest-TestSecurityGroupsBasicOps-450898973 tempest-TestSecurityGroupsBasicOps-450898973-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:27:58.035270 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a66790bc-e208-462a-a059-246f1053e589 tempest-TestSecurityGroupsBasicOps-450898973 tempest-TestSecurityGroupsBasicOps-450898973-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:27:58.136865 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a66790bc-e208-462a-a059-246f1053e589 tempest-TestSecurityGroupsBasicOps-450898973 tempest-TestSecurityGroupsBasicOps-450898973-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/85292ed5-ec86-4aa5-9191-a110260f9f93" status: 200 len: 1622 microversion: 2.1 time: 0.122740 Sep 10 12:27:58.137468 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3235/6477] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:27:58 2022] GET /compute/v2.1/servers/85292ed5-ec86-4aa5-9191-a110260f9f93 => generated 1622 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:27:58.158867 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d9a4bac5-3d77-4b39-b21a-f6fd9cb8c978 tempest-TestSecurityGroupsBasicOps-450898973 tempest-TestSecurityGroupsBasicOps-450898973-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:27:58.159558 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d9a4bac5-3d77-4b39-b21a-f6fd9cb8c978 tempest-TestSecurityGroupsBasicOps-450898973 tempest-TestSecurityGroupsBasicOps-450898973-project-admin] [instance: fc511d41-2a6e-4c17-a3b6-ab88e83ec01f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:27:58.165482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d9a4bac5-3d77-4b39-b21a-f6fd9cb8c978 tempest-TestSecurityGroupsBasicOps-450898973 tempest-TestSecurityGroupsBasicOps-450898973-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:27:58.166569 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d9a4bac5-3d77-4b39-b21a-f6fd9cb8c978 tempest-TestSecurityGroupsBasicOps-450898973 tempest-TestSecurityGroupsBasicOps-450898973-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:27:58.167032 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d9a4bac5-3d77-4b39-b21a-f6fd9cb8c978 tempest-TestSecurityGroupsBasicOps-450898973 tempest-TestSecurityGroupsBasicOps-450898973-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:27:58.167717 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d9a4bac5-3d77-4b39-b21a-f6fd9cb8c978 tempest-TestSecurityGroupsBasicOps-450898973 tempest-TestSecurityGroupsBasicOps-450898973-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:27:58.168172 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d9a4bac5-3d77-4b39-b21a-f6fd9cb8c978 tempest-TestSecurityGroupsBasicOps-450898973 tempest-TestSecurityGroupsBasicOps-450898973-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:27:58.168600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d9a4bac5-3d77-4b39-b21a-f6fd9cb8c978 tempest-TestSecurityGroupsBasicOps-450898973 tempest-TestSecurityGroupsBasicOps-450898973-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:27:58.304521 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d9a4bac5-3d77-4b39-b21a-f6fd9cb8c978 tempest-TestSecurityGroupsBasicOps-450898973 tempest-TestSecurityGroupsBasicOps-450898973-project-admin] 10.222.0.23 "GET /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f" status: 200 len: 1909 microversion: 2.1 time: 0.149258 Sep 10 12:27:58.305095 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3243/6478] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:27:58 2022] GET /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f => generated 1909 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:27:58.370691 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d68848ca-9bbc-450c-bbad-da008affa736 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:27:58.371211 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d68848ca-9bbc-450c-bbad-da008affa736 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] [instance: 85292ed5-ec86-4aa5-9191-a110260f9f93] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:27:58.377040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d68848ca-9bbc-450c-bbad-da008affa736 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:27:58.377516 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d68848ca-9bbc-450c-bbad-da008affa736 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:27:58.377943 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d68848ca-9bbc-450c-bbad-da008affa736 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:27:58.378620 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d68848ca-9bbc-450c-bbad-da008affa736 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:27:58.379070 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d68848ca-9bbc-450c-bbad-da008affa736 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:27:58.379512 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d68848ca-9bbc-450c-bbad-da008affa736 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:27:58.404566 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d68848ca-9bbc-450c-bbad-da008affa736 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] [instance: 85292ed5-ec86-4aa5-9191-a110260f9f93] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:27:58.477482 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d68848ca-9bbc-450c-bbad-da008affa736 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] 10.222.0.23 "DELETE /compute/v2.1/servers/85292ed5-ec86-4aa5-9191-a110260f9f93" status: 204 len: 0 microversion: 2.1 time: 0.110277 Sep 10 12:27:58.478112 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3236/6479] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:27:58 2022] DELETE /compute/v2.1/servers/85292ed5-ec86-4aa5-9191-a110260f9f93 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:27:58.486379 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1953f835-8511-4a81-a2be-50d699ff6850 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:27:58.486990 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1953f835-8511-4a81-a2be-50d699ff6850 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] [instance: 85292ed5-ec86-4aa5-9191-a110260f9f93] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:27:58.493289 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1953f835-8511-4a81-a2be-50d699ff6850 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:27:58.493710 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1953f835-8511-4a81-a2be-50d699ff6850 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:27:58.494177 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1953f835-8511-4a81-a2be-50d699ff6850 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:27:58.494855 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1953f835-8511-4a81-a2be-50d699ff6850 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:27:58.495353 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1953f835-8511-4a81-a2be-50d699ff6850 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:27:58.495776 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1953f835-8511-4a81-a2be-50d699ff6850 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:27:58.578813 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1953f835-8511-4a81-a2be-50d699ff6850 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26839a721c854ad3b1ca8e86d0d043e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e6efe2d4bb49b7979aa1679df9db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:27:58.586543 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1953f835-8511-4a81-a2be-50d699ff6850 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] 10.222.0.23 "GET /compute/v2.1/servers/85292ed5-ec86-4aa5-9191-a110260f9f93" status: 200 len: 1477 microversion: 2.1 time: 0.104028 Sep 10 12:27:58.587112 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3244/6480] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:27:58 2022] GET /compute/v2.1/servers/85292ed5-ec86-4aa5-9191-a110260f9f93 => generated 1477 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:27:59.610414 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ec020487-21be-4434-9217-2a423b2e3f8a tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:27:59.611113 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ec020487-21be-4434-9217-2a423b2e3f8a tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] [instance: 85292ed5-ec86-4aa5-9191-a110260f9f93] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:27:59.618123 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec020487-21be-4434-9217-2a423b2e3f8a tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:27:59.618604 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec020487-21be-4434-9217-2a423b2e3f8a tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:27:59.619042 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec020487-21be-4434-9217-2a423b2e3f8a tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:27:59.619753 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec020487-21be-4434-9217-2a423b2e3f8a tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:27:59.620208 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec020487-21be-4434-9217-2a423b2e3f8a tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:27:59.620659 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec020487-21be-4434-9217-2a423b2e3f8a tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:27:59.707414 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ec020487-21be-4434-9217-2a423b2e3f8a tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26839a721c854ad3b1ca8e86d0d043e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e6efe2d4bb49b7979aa1679df9db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:27:59.716147 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ec020487-21be-4434-9217-2a423b2e3f8a tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] 10.222.0.23 "GET /compute/v2.1/servers/85292ed5-ec86-4aa5-9191-a110260f9f93" status: 200 len: 1477 microversion: 2.1 time: 0.109980 Sep 10 12:27:59.716722 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3237/6481] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:27:59 2022] GET /compute/v2.1/servers/85292ed5-ec86-4aa5-9191-a110260f9f93 => generated 1477 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:28:00.269598 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-09e0d104-58b1-4f09-942e-dce9ca24abde req-4c8b7baa-c10f-4f5e-b9b1-b3016e502d85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85292ed5-ec86-4aa5-9191-a110260f9f93", "name": "network-vif-deleted", "tag": "520b48e5-4ce5-413a-a0ec-26ada836a0ba"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:28:00.280520 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-09e0d104-58b1-4f09-942e-dce9ca24abde req-4c8b7baa-c10f-4f5e-b9b1-b3016e502d85 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:00.281005 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-09e0d104-58b1-4f09-942e-dce9ca24abde req-4c8b7baa-c10f-4f5e-b9b1-b3016e502d85 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:00.281467 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-09e0d104-58b1-4f09-942e-dce9ca24abde req-4c8b7baa-c10f-4f5e-b9b1-b3016e502d85 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:00.294328 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-09e0d104-58b1-4f09-942e-dce9ca24abde req-4c8b7baa-c10f-4f5e-b9b1-b3016e502d85 service nova] Creating event network-vif-deleted:520b48e5-4ce5-413a-a0ec-26ada836a0ba for instance 85292ed5-ec86-4aa5-9191-a110260f9f93 on n-h2-856895-1 Sep 10 12:28:00.299376 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-09e0d104-58b1-4f09-942e-dce9ca24abde req-4c8b7baa-c10f-4f5e-b9b1-b3016e502d85 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116379 Sep 10 12:28:00.300975 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3245/6482] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:28:00.739582 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c5d8f10f-109c-42cd-9966-aa52d6ddb978 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:28:00.740211 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c5d8f10f-109c-42cd-9966-aa52d6ddb978 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] [instance: 85292ed5-ec86-4aa5-9191-a110260f9f93] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:28:00.747287 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c5d8f10f-109c-42cd-9966-aa52d6ddb978 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:00.747773 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c5d8f10f-109c-42cd-9966-aa52d6ddb978 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:00.748206 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c5d8f10f-109c-42cd-9966-aa52d6ddb978 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:00.748892 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c5d8f10f-109c-42cd-9966-aa52d6ddb978 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:00.749345 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c5d8f10f-109c-42cd-9966-aa52d6ddb978 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:00.749768 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c5d8f10f-109c-42cd-9966-aa52d6ddb978 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:00.763499 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-c5d8f10f-109c-42cd-9966-aa52d6ddb978 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] HTTP exception thrown: Instance 85292ed5-ec86-4aa5-9191-a110260f9f93 could not be found. Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c5d8f10f-109c-42cd-9966-aa52d6ddb978 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Request method failure captured: Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/85292ed5-ec86-4aa5-9191-a110260f9f93 HTTP/1.1 Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHIJhhO98ajP4of9a85yLQsM_EWWrRRPxLNGKCruLS8Heu80fYXVzdMxcmRIZ0kTy4OrpskVvKfLKKvcbd9bWgjvEtL7_Rv6RUbYq-t9Sz5zN5bMLWdPqEKsjtDJYLP0jFMcngofVEiP1Ye8qWhpoxEti9k7EbEAbhc0zNakr6MnoXvM Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 19e6efe2d4bb49b7979aa1679df9db03 Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-389200634 Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/19e6efe2d4bb49b7979aa1679df9db03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/19e6efe2d4bb49b7979aa1679df9db03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_19e6efe2d4bb49b7979aa1679df9db03", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/19e6efe2d4bb49b7979aa1679df9db03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-TestSecurityGroupsBasicOps-389200634 Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 19e6efe2d4bb49b7979aa1679df9db03 Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-389200634 Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-TestSecurityGroupsBasicOps-389200634-project Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 26839a721c854ad3b1ca8e86d0d043e4 Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-TestSecurityGroupsBasicOps-389200634-project Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 85292ed5-ec86-4aa5-9191-a110260f9f93 could not be found. Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '85292ed5-ec86-4aa5-9191-a110260f9f93'} Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85292ed5-ec86-4aa5-9191-a110260f9f93 could not be found. Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85292ed5-ec86-4aa5-9191-a110260f9f93 could not be found. Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:28:00.765145 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:28:00.770972 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:28:00.770972 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:28:00.770972 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:28:00.770972 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:28:00.770972 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:28:00.770972 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85292ed5-ec86-4aa5-9191-a110260f9f93 could not be found. Sep 10 12:28:00.770972 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:28:00.770972 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c5d8f10f-109c-42cd-9966-aa52d6ddb978 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Returning 404 to user: Instance 85292ed5-ec86-4aa5-9191-a110260f9f93 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:28:00.770972 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c5d8f10f-109c-42cd-9966-aa52d6ddb978 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] 10.222.0.23 "GET /compute/v2.1/servers/85292ed5-ec86-4aa5-9191-a110260f9f93" status: 404 len: 111 microversion: 2.1 time: 0.031185 Sep 10 12:28:00.770972 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3238/6483] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:28:00 2022] GET /compute/v2.1/servers/85292ed5-ec86-4aa5-9191-a110260f9f93 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:28:04.740356 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cde7a3be-d266-44eb-8674-36b9686b3d8e tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:28:04.741132 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cde7a3be-d266-44eb-8674-36b9686b3d8e tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] [instance: fc511d41-2a6e-4c17-a3b6-ab88e83ec01f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:28:04.754209 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cde7a3be-d266-44eb-8674-36b9686b3d8e tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:04.754209 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cde7a3be-d266-44eb-8674-36b9686b3d8e tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:04.754571 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cde7a3be-d266-44eb-8674-36b9686b3d8e tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:04.755273 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cde7a3be-d266-44eb-8674-36b9686b3d8e tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:04.755736 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cde7a3be-d266-44eb-8674-36b9686b3d8e tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:04.756169 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cde7a3be-d266-44eb-8674-36b9686b3d8e tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:04.784634 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cde7a3be-d266-44eb-8674-36b9686b3d8e tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] [instance: fc511d41-2a6e-4c17-a3b6-ab88e83ec01f] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:28:04.813749 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-70a2c48e-08dd-4ffb-86f3-a77b60304b05 req-6f82fe58-abe3-4302-bd19-3f6cfa3afdda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc511d41-2a6e-4c17-a3b6-ab88e83ec01f", "tag": "a67b9aed-c2ce-4cd2-9941-02663ed7a73c"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:28:04.823943 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-70a2c48e-08dd-4ffb-86f3-a77b60304b05 req-6f82fe58-abe3-4302-bd19-3f6cfa3afdda service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:04.824892 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-70a2c48e-08dd-4ffb-86f3-a77b60304b05 req-6f82fe58-abe3-4302-bd19-3f6cfa3afdda service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:04.825548 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-70a2c48e-08dd-4ffb-86f3-a77b60304b05 req-6f82fe58-abe3-4302-bd19-3f6cfa3afdda service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:04.842274 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-70a2c48e-08dd-4ffb-86f3-a77b60304b05 req-6f82fe58-abe3-4302-bd19-3f6cfa3afdda service nova] Creating event network-changed:a67b9aed-c2ce-4cd2-9941-02663ed7a73c for instance fc511d41-2a6e-4c17-a3b6-ab88e83ec01f on n-h1-856895-1 Sep 10 12:28:04.848061 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-70a2c48e-08dd-4ffb-86f3-a77b60304b05 req-6f82fe58-abe3-4302-bd19-3f6cfa3afdda service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110909 Sep 10 12:28:04.848920 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3239/6484] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:28:04.878006 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cde7a3be-d266-44eb-8674-36b9686b3d8e tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f" status: 204 len: 0 microversion: 2.1 time: 0.143190 Sep 10 12:28:04.878599 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3246/6485] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:28:04 2022] DELETE /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:28:04.887989 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-33541767-35a7-4e87-8bb3-ee6ac3fa9f66 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:28:04.888666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-33541767-35a7-4e87-8bb3-ee6ac3fa9f66 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] [instance: fc511d41-2a6e-4c17-a3b6-ab88e83ec01f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:28:04.898720 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-33541767-35a7-4e87-8bb3-ee6ac3fa9f66 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:04.899289 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-33541767-35a7-4e87-8bb3-ee6ac3fa9f66 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:04.899877 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-33541767-35a7-4e87-8bb3-ee6ac3fa9f66 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:04.900925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-33541767-35a7-4e87-8bb3-ee6ac3fa9f66 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:04.901477 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-33541767-35a7-4e87-8bb3-ee6ac3fa9f66 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:04.903269 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-33541767-35a7-4e87-8bb3-ee6ac3fa9f66 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:05.058709 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-33541767-35a7-4e87-8bb3-ee6ac3fa9f66 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26839a721c854ad3b1ca8e86d0d043e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e6efe2d4bb49b7979aa1679df9db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:28:05.066627 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-33541767-35a7-4e87-8bb3-ee6ac3fa9f66 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] 10.222.0.23 "GET /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f" status: 200 len: 1764 microversion: 2.1 time: 0.183337 Sep 10 12:28:05.067251 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3240/6486] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:28:04 2022] GET /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f => generated 1764 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:28:06.092444 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-458fbef5-75de-444d-8aed-50d9c1c69eeb tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:28:06.093158 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-458fbef5-75de-444d-8aed-50d9c1c69eeb tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] [instance: fc511d41-2a6e-4c17-a3b6-ab88e83ec01f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:28:06.101054 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-458fbef5-75de-444d-8aed-50d9c1c69eeb tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:06.101824 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-458fbef5-75de-444d-8aed-50d9c1c69eeb tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:06.102276 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-458fbef5-75de-444d-8aed-50d9c1c69eeb tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:06.102979 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-458fbef5-75de-444d-8aed-50d9c1c69eeb tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:06.103462 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-458fbef5-75de-444d-8aed-50d9c1c69eeb tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:06.103893 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-458fbef5-75de-444d-8aed-50d9c1c69eeb tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:06.251003 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-458fbef5-75de-444d-8aed-50d9c1c69eeb tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26839a721c854ad3b1ca8e86d0d043e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e6efe2d4bb49b7979aa1679df9db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:28:06.259341 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-458fbef5-75de-444d-8aed-50d9c1c69eeb tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] 10.222.0.23 "GET /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f" status: 200 len: 1764 microversion: 2.1 time: 0.171469 Sep 10 12:28:06.259929 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3247/6487] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:28:06 2022] GET /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f => generated 1764 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:28:06.996626 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-0e8101ac-1c06-41d0-bc81-7bba12c0bd7c req-71dc02b3-bb1e-4fad-bedf-e7d81902ce9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc511d41-2a6e-4c17-a3b6-ab88e83ec01f", "name": "network-vif-deleted", "tag": "a67b9aed-c2ce-4cd2-9941-02663ed7a73c"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:28:07.006673 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0e8101ac-1c06-41d0-bc81-7bba12c0bd7c req-71dc02b3-bb1e-4fad-bedf-e7d81902ce9a service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:07.007155 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0e8101ac-1c06-41d0-bc81-7bba12c0bd7c req-71dc02b3-bb1e-4fad-bedf-e7d81902ce9a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:07.007616 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0e8101ac-1c06-41d0-bc81-7bba12c0bd7c req-71dc02b3-bb1e-4fad-bedf-e7d81902ce9a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:07.019247 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-0e8101ac-1c06-41d0-bc81-7bba12c0bd7c req-71dc02b3-bb1e-4fad-bedf-e7d81902ce9a service nova] Creating event network-vif-deleted:a67b9aed-c2ce-4cd2-9941-02663ed7a73c for instance fc511d41-2a6e-4c17-a3b6-ab88e83ec01f on n-h1-856895-1 Sep 10 12:28:07.024166 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-0e8101ac-1c06-41d0-bc81-7bba12c0bd7c req-71dc02b3-bb1e-4fad-bedf-e7d81902ce9a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031274 Sep 10 12:28:07.024766 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3241/6488] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:28:07.284321 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1f9b45ce-0b99-468c-be48-bd37ee73d5a9 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:28:07.285728 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1f9b45ce-0b99-468c-be48-bd37ee73d5a9 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] [instance: fc511d41-2a6e-4c17-a3b6-ab88e83ec01f] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:28:07.293897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f9b45ce-0b99-468c-be48-bd37ee73d5a9 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:07.294497 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f9b45ce-0b99-468c-be48-bd37ee73d5a9 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:07.295012 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f9b45ce-0b99-468c-be48-bd37ee73d5a9 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:07.295831 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f9b45ce-0b99-468c-be48-bd37ee73d5a9 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:07.296493 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f9b45ce-0b99-468c-be48-bd37ee73d5a9 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:07.296991 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f9b45ce-0b99-468c-be48-bd37ee73d5a9 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:07.330955 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f9b45ce-0b99-468c-be48-bd37ee73d5a9 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:07.331552 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f9b45ce-0b99-468c-be48-bd37ee73d5a9 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:07.332062 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f9b45ce-0b99-468c-be48-bd37ee73d5a9 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:07.332518 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-1f9b45ce-0b99-468c-be48-bd37ee73d5a9 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lazy-loading 'fault' on Instance uuid fc511d41-2a6e-4c17-a3b6-ab88e83ec01f {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:28:07.377863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1f9b45ce-0b99-468c-be48-bd37ee73d5a9 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26839a721c854ad3b1ca8e86d0d043e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19e6efe2d4bb49b7979aa1679df9db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:28:07.385788 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1f9b45ce-0b99-468c-be48-bd37ee73d5a9 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] 10.222.0.23 "GET /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f" status: 200 len: 1383 microversion: 2.1 time: 0.105721 Sep 10 12:28:07.386827 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3248/6489] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:28:07 2022] GET /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f => generated 1383 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:28:08.410881 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3a978ecc-a4fc-4cd0-b4c7-cc296e8b05a3 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:28:08.411533 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3a978ecc-a4fc-4cd0-b4c7-cc296e8b05a3 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] [instance: fc511d41-2a6e-4c17-a3b6-ab88e83ec01f] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:28:08.418652 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a978ecc-a4fc-4cd0-b4c7-cc296e8b05a3 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:08.419135 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a978ecc-a4fc-4cd0-b4c7-cc296e8b05a3 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:08.419593 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a978ecc-a4fc-4cd0-b4c7-cc296e8b05a3 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:08.420287 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a978ecc-a4fc-4cd0-b4c7-cc296e8b05a3 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:08.420738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a978ecc-a4fc-4cd0-b4c7-cc296e8b05a3 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:08.421162 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a978ecc-a4fc-4cd0-b4c7-cc296e8b05a3 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:08.434558 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-3a978ecc-a4fc-4cd0-b4c7-cc296e8b05a3 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] HTTP exception thrown: Instance fc511d41-2a6e-4c17-a3b6-ab88e83ec01f could not be found. Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3a978ecc-a4fc-4cd0-b4c7-cc296e8b05a3 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Request method failure captured: Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f HTTP/1.1 Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHIJhhO98ajP4of9a85yLQsM_EWWrRRPxLNGKCruLS8Heu80fYXVzdMxcmRIZ0kTy4OrpskVvKfLKKvcbd9bWgjvEtL7_Rv6RUbYq-t9Sz5zN5bMLWdPqEKsjtDJYLP0jFMcngofVEiP1Ye8qWhpoxEti9k7EbEAbhc0zNakr6MnoXvM Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 19e6efe2d4bb49b7979aa1679df9db03 Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-389200634 Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/19e6efe2d4bb49b7979aa1679df9db03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/19e6efe2d4bb49b7979aa1679df9db03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_19e6efe2d4bb49b7979aa1679df9db03", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/19e6efe2d4bb49b7979aa1679df9db03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-TestSecurityGroupsBasicOps-389200634 Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 19e6efe2d4bb49b7979aa1679df9db03 Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-389200634 Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-TestSecurityGroupsBasicOps-389200634-project Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 26839a721c854ad3b1ca8e86d0d043e4 Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-TestSecurityGroupsBasicOps-389200634-project Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance fc511d41-2a6e-4c17-a3b6-ab88e83ec01f could not be found. Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'fc511d41-2a6e-4c17-a3b6-ab88e83ec01f'} Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc511d41-2a6e-4c17-a3b6-ab88e83ec01f could not be found. Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc511d41-2a6e-4c17-a3b6-ab88e83ec01f could not be found. Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:28:08.436186 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:28:08.441889 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:28:08.441889 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:28:08.441889 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:28:08.441889 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:28:08.441889 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:28:08.441889 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc511d41-2a6e-4c17-a3b6-ab88e83ec01f could not be found. Sep 10 12:28:08.441889 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:28:08.441889 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3a978ecc-a4fc-4cd0-b4c7-cc296e8b05a3 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Returning 404 to user: Instance fc511d41-2a6e-4c17-a3b6-ab88e83ec01f could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:28:08.441889 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3a978ecc-a4fc-4cd0-b4c7-cc296e8b05a3 tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] 10.222.0.23 "GET /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f" status: 404 len: 111 microversion: 2.1 time: 0.032062 Sep 10 12:28:08.441889 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3242/6490] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:28:08 2022] GET /compute/v2.1/servers/fc511d41-2a6e-4c17-a3b6-ab88e83ec01f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:28:12.164056 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-62272246-9218-44ba-b1e5-a545b0ed1d9e tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] Calling method '.version_select at 0x7f4072a1a280>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:28:12.185987 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-62272246-9218-44ba-b1e5-a545b0ed1d9e tempest-TestSecurityGroupsBasicOps-389200634 tempest-TestSecurityGroupsBasicOps-389200634-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-2129620565" status: 202 len: 0 microversion: 2.1 time: 0.025956 Sep 10 12:28:12.186576 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3249/6491] 10.222.0.23 () {58 vars in 1278 bytes} [Sat Sep 10 12:28:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-2129620565 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:28:35.114233 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d8bf2e06-36cf-432a-bedc-3ec6c7d51cce tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-55961684", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "478ccdce-4c4a-4785-a46e-a0c199ca383d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "63bc1cec-19c3-45db-83f8-21772e061ea1"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:28:35.126239 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:28:35.127341 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:28:35.404685 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-d8bf2e06-36cf-432a-bedc-3ec6c7d51cce tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] validate_networks() for [('63bc1cec-19c3-45db-83f8-21772e061ea1', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:28:36.237581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d8bf2e06-36cf-432a-bedc-3ec6c7d51cce tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:28:36.238199 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d8bf2e06-36cf-432a-bedc-3ec6c7d51cce tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:28:36.238522 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d8bf2e06-36cf-432a-bedc-3ec6c7d51cce tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:28:36.238941 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d8bf2e06-36cf-432a-bedc-3ec6c7d51cce tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:28:36.239392 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d8bf2e06-36cf-432a-bedc-3ec6c7d51cce tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:28:36.248695 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d8bf2e06-36cf-432a-bedc-3ec6c7d51cce tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:36.249185 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d8bf2e06-36cf-432a-bedc-3ec6c7d51cce tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:36.249631 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d8bf2e06-36cf-432a-bedc-3ec6c7d51cce tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:36.250376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d8bf2e06-36cf-432a-bedc-3ec6c7d51cce tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:36.250845 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d8bf2e06-36cf-432a-bedc-3ec6c7d51cce tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:36.251308 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d8bf2e06-36cf-432a-bedc-3ec6c7d51cce tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:36.268594 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-d8bf2e06-36cf-432a-bedc-3ec6c7d51cce tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Getting quotas for project e27276f18d8045e2a9be7a6c5ed892f7. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:28:36.273886 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-d8bf2e06-36cf-432a-bedc-3ec6c7d51cce tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Getting quotas for user 5f0b168293f943389d72753009c88789 and project e27276f18d8045e2a9be7a6c5ed892f7. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:28:36.334338 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d8bf2e06-36cf-432a-bedc-3ec6c7d51cce tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:28:36.336491 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d8bf2e06-36cf-432a-bedc-3ec6c7d51cce tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 12b19556-704c-4e9a-a7bf-d52ac72fef3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='478ccdce-4c4a-4785-a46e-a0c199ca383d',volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:28:36.482366 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d8bf2e06-36cf-432a-bedc-3ec6c7d51cce tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.372315 Sep 10 12:28:36.486237 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3243/6492] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:28:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1374 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:28:36.492852 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:28:36.495329 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:28:36.502368 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c0ccc2e3-c757-416b-9883-43e7859d6fee tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:28:36.503092 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c0ccc2e3-c757-416b-9883-43e7859d6fee tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 12b19556-704c-4e9a-a7bf-d52ac72fef3e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:28:36.636184 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c0ccc2e3-c757-416b-9883-43e7859d6fee tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:28:36.644059 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c0ccc2e3-c757-416b-9883-43e7859d6fee tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e" status: 200 len: 1055 microversion: 2.1 time: 0.153127 Sep 10 12:28:36.644952 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3250/6493] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:28:36 2022] GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e => generated 1055 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:28:37.668641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-02eb8261-ec80-4f4b-a335-6e2c2a891e1c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:28:37.669236 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-02eb8261-ec80-4f4b-a335-6e2c2a891e1c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 12b19556-704c-4e9a-a7bf-d52ac72fef3e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:28:37.676163 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02eb8261-ec80-4f4b-a335-6e2c2a891e1c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:37.676662 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02eb8261-ec80-4f4b-a335-6e2c2a891e1c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:37.677111 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02eb8261-ec80-4f4b-a335-6e2c2a891e1c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:37.677833 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02eb8261-ec80-4f4b-a335-6e2c2a891e1c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:37.678295 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02eb8261-ec80-4f4b-a335-6e2c2a891e1c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:37.678728 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-02eb8261-ec80-4f4b-a335-6e2c2a891e1c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:37.753775 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-02eb8261-ec80-4f4b-a335-6e2c2a891e1c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:28:37.762354 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-02eb8261-ec80-4f4b-a335-6e2c2a891e1c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e" status: 200 len: 1153 microversion: 2.1 time: 0.098310 Sep 10 12:28:37.763667 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3244/6494] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:28:37 2022] GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e => generated 1153 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:28:38.790680 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-04741d09-b8d4-450d-b094-e2487abb9e41 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:28:38.792398 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-04741d09-b8d4-450d-b094-e2487abb9e41 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 12b19556-704c-4e9a-a7bf-d52ac72fef3e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:28:38.818053 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-04741d09-b8d4-450d-b094-e2487abb9e41 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:38.819148 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-04741d09-b8d4-450d-b094-e2487abb9e41 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:38.819844 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-04741d09-b8d4-450d-b094-e2487abb9e41 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:38.820962 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-04741d09-b8d4-450d-b094-e2487abb9e41 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:38.821533 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-04741d09-b8d4-450d-b094-e2487abb9e41 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:38.822215 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-04741d09-b8d4-450d-b094-e2487abb9e41 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:39.055516 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-04741d09-b8d4-450d-b094-e2487abb9e41 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:28:39.070686 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-04741d09-b8d4-450d-b094-e2487abb9e41 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e" status: 200 len: 1213 microversion: 2.1 time: 0.285168 Sep 10 12:28:39.071992 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3251/6495] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:28:38 2022] GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e => generated 1213 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:28:39.420744 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-098876c1-fefa-46b7-9ac6-6e7ddc5352f1 req-e9c6febb-1fcb-4719-b80a-16426ce457fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12b19556-704c-4e9a-a7bf-d52ac72fef3e", "tag": "deac2192-68fd-4165-917e-014154906718"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:28:39.434546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-098876c1-fefa-46b7-9ac6-6e7ddc5352f1 req-e9c6febb-1fcb-4719-b80a-16426ce457fb service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:39.435195 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-098876c1-fefa-46b7-9ac6-6e7ddc5352f1 req-e9c6febb-1fcb-4719-b80a-16426ce457fb service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:39.435903 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-098876c1-fefa-46b7-9ac6-6e7ddc5352f1 req-e9c6febb-1fcb-4719-b80a-16426ce457fb service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:39.448186 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-098876c1-fefa-46b7-9ac6-6e7ddc5352f1 req-e9c6febb-1fcb-4719-b80a-16426ce457fb service nova] Creating event network-changed:deac2192-68fd-4165-917e-014154906718 for instance 12b19556-704c-4e9a-a7bf-d52ac72fef3e on n-h1-856895-1 Sep 10 12:28:39.454202 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-098876c1-fefa-46b7-9ac6-6e7ddc5352f1 req-e9c6febb-1fcb-4719-b80a-16426ce457fb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037662 Sep 10 12:28:39.455834 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3245/6496] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:28:40.097196 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-129e1d9a-fc68-455d-8a15-8502fdc1b6e5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:28:40.097888 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-129e1d9a-fc68-455d-8a15-8502fdc1b6e5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 12b19556-704c-4e9a-a7bf-d52ac72fef3e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:28:40.105492 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-129e1d9a-fc68-455d-8a15-8502fdc1b6e5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:40.106740 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-129e1d9a-fc68-455d-8a15-8502fdc1b6e5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:40.107212 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-129e1d9a-fc68-455d-8a15-8502fdc1b6e5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:40.107935 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-129e1d9a-fc68-455d-8a15-8502fdc1b6e5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:40.108396 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-129e1d9a-fc68-455d-8a15-8502fdc1b6e5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:40.108838 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-129e1d9a-fc68-455d-8a15-8502fdc1b6e5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:40.322044 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-129e1d9a-fc68-455d-8a15-8502fdc1b6e5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:28:40.331998 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-129e1d9a-fc68-455d-8a15-8502fdc1b6e5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e" status: 200 len: 1213 microversion: 2.1 time: 0.239267 Sep 10 12:28:40.332823 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3252/6497] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:28:40 2022] GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e => generated 1213 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:28:41.358421 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-666dedbe-8771-4989-a8f9-3d51bff58189 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:28:41.359140 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-666dedbe-8771-4989-a8f9-3d51bff58189 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 12b19556-704c-4e9a-a7bf-d52ac72fef3e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:28:41.365583 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-666dedbe-8771-4989-a8f9-3d51bff58189 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:41.366069 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-666dedbe-8771-4989-a8f9-3d51bff58189 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:41.366509 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-666dedbe-8771-4989-a8f9-3d51bff58189 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:41.367226 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-666dedbe-8771-4989-a8f9-3d51bff58189 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:41.367683 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-666dedbe-8771-4989-a8f9-3d51bff58189 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:41.368113 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-666dedbe-8771-4989-a8f9-3d51bff58189 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:41.500581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-666dedbe-8771-4989-a8f9-3d51bff58189 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:28:41.508324 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-666dedbe-8771-4989-a8f9-3d51bff58189 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e" status: 200 len: 1213 microversion: 2.1 time: 0.155907 Sep 10 12:28:41.508912 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3246/6498] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:28:41 2022] GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e => generated 1213 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:28:42.532314 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7a0e5b24-cc05-449c-865f-e544aa7539a1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:28:42.532896 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7a0e5b24-cc05-449c-865f-e544aa7539a1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 12b19556-704c-4e9a-a7bf-d52ac72fef3e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:28:42.539957 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a0e5b24-cc05-449c-865f-e544aa7539a1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:42.540446 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a0e5b24-cc05-449c-865f-e544aa7539a1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:42.540889 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a0e5b24-cc05-449c-865f-e544aa7539a1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:42.541596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a0e5b24-cc05-449c-865f-e544aa7539a1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:42.542056 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a0e5b24-cc05-449c-865f-e544aa7539a1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:42.542488 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a0e5b24-cc05-449c-865f-e544aa7539a1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:42.685004 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7a0e5b24-cc05-449c-865f-e544aa7539a1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:28:42.692923 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7a0e5b24-cc05-449c-865f-e544aa7539a1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e" status: 200 len: 1213 microversion: 2.1 time: 0.165303 Sep 10 12:28:42.693515 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3253/6499] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:28:42 2022] GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e => generated 1213 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:28:43.717700 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e0d539ee-717b-463e-af3b-40dab30a50cb tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:28:43.719513 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e0d539ee-717b-463e-af3b-40dab30a50cb tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 12b19556-704c-4e9a-a7bf-d52ac72fef3e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:28:43.725349 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0d539ee-717b-463e-af3b-40dab30a50cb tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:43.725841 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0d539ee-717b-463e-af3b-40dab30a50cb tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:43.726286 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0d539ee-717b-463e-af3b-40dab30a50cb tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:43.726990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0d539ee-717b-463e-af3b-40dab30a50cb tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:43.727493 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0d539ee-717b-463e-af3b-40dab30a50cb tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:43.727930 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0d539ee-717b-463e-af3b-40dab30a50cb tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:43.857720 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e0d539ee-717b-463e-af3b-40dab30a50cb tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:28:43.865786 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e0d539ee-717b-463e-af3b-40dab30a50cb tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e" status: 200 len: 1201 microversion: 2.1 time: 0.152479 Sep 10 12:28:43.866365 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3247/6500] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:28:43 2022] GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e => generated 1201 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:28:44.889418 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b87d417d-c8b1-447a-9a15-fdc56a5970db tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:28:44.890071 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b87d417d-c8b1-447a-9a15-fdc56a5970db tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 12b19556-704c-4e9a-a7bf-d52ac72fef3e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:28:44.896723 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b87d417d-c8b1-447a-9a15-fdc56a5970db tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:44.897257 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b87d417d-c8b1-447a-9a15-fdc56a5970db tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:44.897746 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b87d417d-c8b1-447a-9a15-fdc56a5970db tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:44.898468 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b87d417d-c8b1-447a-9a15-fdc56a5970db tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:44.898931 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b87d417d-c8b1-447a-9a15-fdc56a5970db tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:44.899392 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b87d417d-c8b1-447a-9a15-fdc56a5970db tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:45.028790 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b87d417d-c8b1-447a-9a15-fdc56a5970db tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:28:45.036893 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b87d417d-c8b1-447a-9a15-fdc56a5970db tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e" status: 200 len: 1201 microversion: 2.1 time: 0.151441 Sep 10 12:28:45.037467 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3254/6501] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:28:44 2022] GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e => generated 1201 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:28:46.061168 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3c2ad0bf-c3ee-468f-a31d-85cda2356593 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:28:46.061798 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3c2ad0bf-c3ee-468f-a31d-85cda2356593 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 12b19556-704c-4e9a-a7bf-d52ac72fef3e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:28:46.068973 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3c2ad0bf-c3ee-468f-a31d-85cda2356593 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:46.069461 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3c2ad0bf-c3ee-468f-a31d-85cda2356593 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:46.069900 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3c2ad0bf-c3ee-468f-a31d-85cda2356593 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:46.070596 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3c2ad0bf-c3ee-468f-a31d-85cda2356593 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:46.071055 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3c2ad0bf-c3ee-468f-a31d-85cda2356593 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:46.071517 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3c2ad0bf-c3ee-468f-a31d-85cda2356593 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:46.207013 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3c2ad0bf-c3ee-468f-a31d-85cda2356593 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:28:46.214638 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3c2ad0bf-c3ee-468f-a31d-85cda2356593 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e" status: 200 len: 1201 microversion: 2.1 time: 0.158527 Sep 10 12:28:46.215239 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3248/6502] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:28:46 2022] GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e => generated 1201 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:28:47.237966 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-73fb5772-3b33-490d-91bb-4f501b9bdd43 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:28:47.238586 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-73fb5772-3b33-490d-91bb-4f501b9bdd43 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 12b19556-704c-4e9a-a7bf-d52ac72fef3e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:28:47.241635 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:28:47.247424 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-73fb5772-3b33-490d-91bb-4f501b9bdd43 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:47.247912 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-73fb5772-3b33-490d-91bb-4f501b9bdd43 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:47.248348 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-73fb5772-3b33-490d-91bb-4f501b9bdd43 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:47.249042 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-73fb5772-3b33-490d-91bb-4f501b9bdd43 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:47.249496 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-73fb5772-3b33-490d-91bb-4f501b9bdd43 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:47.249925 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-73fb5772-3b33-490d-91bb-4f501b9bdd43 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:47.379572 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-73fb5772-3b33-490d-91bb-4f501b9bdd43 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:28:47.387960 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-73fb5772-3b33-490d-91bb-4f501b9bdd43 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e" status: 200 len: 1201 microversion: 2.1 time: 0.153971 Sep 10 12:28:47.388544 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3255/6503] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:28:47 2022] GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e => generated 1201 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:28:48.410374 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-80b44a97-e033-4084-87cc-a64367b9342f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:28:48.410912 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-80b44a97-e033-4084-87cc-a64367b9342f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 12b19556-704c-4e9a-a7bf-d52ac72fef3e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:28:48.412873 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:28:48.413726 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:28:48.420247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-80b44a97-e033-4084-87cc-a64367b9342f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:48.420724 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-80b44a97-e033-4084-87cc-a64367b9342f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:48.421157 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-80b44a97-e033-4084-87cc-a64367b9342f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:48.421847 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-80b44a97-e033-4084-87cc-a64367b9342f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:48.422298 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-80b44a97-e033-4084-87cc-a64367b9342f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:48.422719 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-80b44a97-e033-4084-87cc-a64367b9342f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:48.557214 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-80b44a97-e033-4084-87cc-a64367b9342f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:28:48.564920 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-80b44a97-e033-4084-87cc-a64367b9342f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e" status: 200 len: 1201 microversion: 2.1 time: 0.158498 Sep 10 12:28:48.565507 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3249/6504] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:28:48 2022] GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e => generated 1201 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:28:49.588457 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-582ad68d-74b7-4e57-9d7b-cec6b364d8ee tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:28:49.589021 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-582ad68d-74b7-4e57-9d7b-cec6b364d8ee tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 12b19556-704c-4e9a-a7bf-d52ac72fef3e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:28:49.596382 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-582ad68d-74b7-4e57-9d7b-cec6b364d8ee tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:49.596871 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-582ad68d-74b7-4e57-9d7b-cec6b364d8ee tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:49.597314 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-582ad68d-74b7-4e57-9d7b-cec6b364d8ee tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:49.598010 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-582ad68d-74b7-4e57-9d7b-cec6b364d8ee tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:49.598471 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-582ad68d-74b7-4e57-9d7b-cec6b364d8ee tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:49.598938 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-582ad68d-74b7-4e57-9d7b-cec6b364d8ee tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:49.727933 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-582ad68d-74b7-4e57-9d7b-cec6b364d8ee tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:28:49.737194 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-582ad68d-74b7-4e57-9d7b-cec6b364d8ee tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e" status: 200 len: 1201 microversion: 2.1 time: 0.152604 Sep 10 12:28:49.737789 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3256/6505] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:28:49 2022] GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e => generated 1201 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:28:50.760454 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c860f443-d502-4fce-8db2-64f0b671eabe tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:28:50.761082 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c860f443-d502-4fce-8db2-64f0b671eabe tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 12b19556-704c-4e9a-a7bf-d52ac72fef3e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:28:50.768864 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c860f443-d502-4fce-8db2-64f0b671eabe tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:50.769351 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c860f443-d502-4fce-8db2-64f0b671eabe tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:50.769789 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c860f443-d502-4fce-8db2-64f0b671eabe tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:50.770483 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c860f443-d502-4fce-8db2-64f0b671eabe tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:50.770942 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c860f443-d502-4fce-8db2-64f0b671eabe tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:50.771402 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c860f443-d502-4fce-8db2-64f0b671eabe tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:50.910558 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c860f443-d502-4fce-8db2-64f0b671eabe tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:28:50.918359 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c860f443-d502-4fce-8db2-64f0b671eabe tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e" status: 200 len: 1201 microversion: 2.1 time: 0.161810 Sep 10 12:28:50.918956 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3250/6506] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:28:50 2022] GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e => generated 1201 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:28:51.941343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5f9140db-0cfa-4fad-92f5-f8c049ec4903 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:28:51.941960 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5f9140db-0cfa-4fad-92f5-f8c049ec4903 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 12b19556-704c-4e9a-a7bf-d52ac72fef3e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:28:51.949011 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5f9140db-0cfa-4fad-92f5-f8c049ec4903 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:51.950144 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5f9140db-0cfa-4fad-92f5-f8c049ec4903 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:51.950576 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5f9140db-0cfa-4fad-92f5-f8c049ec4903 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:51.951392 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5f9140db-0cfa-4fad-92f5-f8c049ec4903 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:51.951853 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5f9140db-0cfa-4fad-92f5-f8c049ec4903 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:51.952282 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5f9140db-0cfa-4fad-92f5-f8c049ec4903 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:52.082835 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5f9140db-0cfa-4fad-92f5-f8c049ec4903 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:28:52.090836 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5f9140db-0cfa-4fad-92f5-f8c049ec4903 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e" status: 200 len: 1201 microversion: 2.1 time: 0.153146 Sep 10 12:28:52.091456 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3257/6507] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:28:51 2022] GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e => generated 1201 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:28:53.113931 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3c5ec99f-4d27-457f-a797-7e6c8c01655b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:28:53.114553 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3c5ec99f-4d27-457f-a797-7e6c8c01655b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 12b19556-704c-4e9a-a7bf-d52ac72fef3e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:28:53.121870 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3c5ec99f-4d27-457f-a797-7e6c8c01655b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:53.122467 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3c5ec99f-4d27-457f-a797-7e6c8c01655b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:53.122909 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3c5ec99f-4d27-457f-a797-7e6c8c01655b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:53.123639 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3c5ec99f-4d27-457f-a797-7e6c8c01655b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:53.124096 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3c5ec99f-4d27-457f-a797-7e6c8c01655b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:53.124528 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3c5ec99f-4d27-457f-a797-7e6c8c01655b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:53.254322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3c5ec99f-4d27-457f-a797-7e6c8c01655b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:28:53.262619 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3c5ec99f-4d27-457f-a797-7e6c8c01655b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e" status: 200 len: 1201 microversion: 2.1 time: 0.151969 Sep 10 12:28:53.263212 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3251/6508] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:28:53 2022] GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e => generated 1201 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:28:54.285858 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e05a71ab-4da4-4f4c-adae-0697a47180b3 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:28:54.286469 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e05a71ab-4da4-4f4c-adae-0697a47180b3 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 12b19556-704c-4e9a-a7bf-d52ac72fef3e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:28:54.293991 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e05a71ab-4da4-4f4c-adae-0697a47180b3 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:54.294474 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e05a71ab-4da4-4f4c-adae-0697a47180b3 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:54.294920 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e05a71ab-4da4-4f4c-adae-0697a47180b3 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:54.295633 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e05a71ab-4da4-4f4c-adae-0697a47180b3 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:54.296088 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e05a71ab-4da4-4f4c-adae-0697a47180b3 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:54.296514 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e05a71ab-4da4-4f4c-adae-0697a47180b3 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:54.431104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e05a71ab-4da4-4f4c-adae-0697a47180b3 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:28:54.439768 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e05a71ab-4da4-4f4c-adae-0697a47180b3 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e" status: 200 len: 1201 microversion: 2.1 time: 0.157806 Sep 10 12:28:54.440353 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3258/6509] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:28:54 2022] GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e => generated 1201 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:28:55.001492 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-0f3f96ce-9326-4e24-8e3e-a10200b2d5d0 req-4eb7f58a-5726-4b9b-a472-1b192ae2a62d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12b19556-704c-4e9a-a7bf-d52ac72fef3e", "name": "network-vif-plugged", "status": "completed", "tag": "deac2192-68fd-4165-917e-014154906718"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:28:55.012014 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0f3f96ce-9326-4e24-8e3e-a10200b2d5d0 req-4eb7f58a-5726-4b9b-a472-1b192ae2a62d service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:55.012569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0f3f96ce-9326-4e24-8e3e-a10200b2d5d0 req-4eb7f58a-5726-4b9b-a472-1b192ae2a62d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:55.013051 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0f3f96ce-9326-4e24-8e3e-a10200b2d5d0 req-4eb7f58a-5726-4b9b-a472-1b192ae2a62d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:55.024786 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-0f3f96ce-9326-4e24-8e3e-a10200b2d5d0 req-4eb7f58a-5726-4b9b-a472-1b192ae2a62d service nova] Creating event network-vif-plugged:deac2192-68fd-4165-917e-014154906718 for instance 12b19556-704c-4e9a-a7bf-d52ac72fef3e on n-h1-856895-1 Sep 10 12:28:55.030501 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-0f3f96ce-9326-4e24-8e3e-a10200b2d5d0 req-4eb7f58a-5726-4b9b-a472-1b192ae2a62d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032951 Sep 10 12:28:55.031292 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3252/6510] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:28:55.461674 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6ecd057e-67cc-44b9-abd6-74eefe5b385a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:28:55.462303 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6ecd057e-67cc-44b9-abd6-74eefe5b385a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 12b19556-704c-4e9a-a7bf-d52ac72fef3e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:28:55.470441 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6ecd057e-67cc-44b9-abd6-74eefe5b385a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:55.470927 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6ecd057e-67cc-44b9-abd6-74eefe5b385a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:55.471404 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6ecd057e-67cc-44b9-abd6-74eefe5b385a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:55.472106 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6ecd057e-67cc-44b9-abd6-74eefe5b385a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:55.472573 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6ecd057e-67cc-44b9-abd6-74eefe5b385a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:55.473008 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6ecd057e-67cc-44b9-abd6-74eefe5b385a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:55.604743 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6ecd057e-67cc-44b9-abd6-74eefe5b385a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:28:55.613414 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6ecd057e-67cc-44b9-abd6-74eefe5b385a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e" status: 200 len: 1201 microversion: 2.1 time: 0.155643 Sep 10 12:28:55.613992 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3259/6511] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:28:55 2022] GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e => generated 1201 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:28:56.638637 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d823f6ec-870e-40d4-9a8d-b4db4616f940 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:28:56.639484 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d823f6ec-870e-40d4-9a8d-b4db4616f940 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 12b19556-704c-4e9a-a7bf-d52ac72fef3e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:28:56.645843 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d823f6ec-870e-40d4-9a8d-b4db4616f940 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:56.646337 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d823f6ec-870e-40d4-9a8d-b4db4616f940 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:56.646783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d823f6ec-870e-40d4-9a8d-b4db4616f940 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:56.647517 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d823f6ec-870e-40d4-9a8d-b4db4616f940 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:56.647983 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d823f6ec-870e-40d4-9a8d-b4db4616f940 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:56.648491 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d823f6ec-870e-40d4-9a8d-b4db4616f940 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:56.783872 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d823f6ec-870e-40d4-9a8d-b4db4616f940 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:28:56.792067 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d823f6ec-870e-40d4-9a8d-b4db4616f940 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e" status: 200 len: 1389 microversion: 2.1 time: 0.159524 Sep 10 12:28:56.792641 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3253/6512] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:28:56 2022] GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e => generated 1389 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:28:56.814033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c395beac-5cb6-46a1-aed9-4ac49b7fb3ea tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:28:56.814654 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c395beac-5cb6-46a1-aed9-4ac49b7fb3ea tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 12b19556-704c-4e9a-a7bf-d52ac72fef3e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:28:56.821436 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c395beac-5cb6-46a1-aed9-4ac49b7fb3ea tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:56.821916 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c395beac-5cb6-46a1-aed9-4ac49b7fb3ea tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:56.822352 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c395beac-5cb6-46a1-aed9-4ac49b7fb3ea tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:56.823035 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c395beac-5cb6-46a1-aed9-4ac49b7fb3ea tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:56.823513 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c395beac-5cb6-46a1-aed9-4ac49b7fb3ea tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:56.823938 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c395beac-5cb6-46a1-aed9-4ac49b7fb3ea tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:56.953752 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c395beac-5cb6-46a1-aed9-4ac49b7fb3ea tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:28:56.961636 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c395beac-5cb6-46a1-aed9-4ac49b7fb3ea tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e" status: 200 len: 1389 microversion: 2.1 time: 0.151461 Sep 10 12:28:56.962239 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3260/6513] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:28:56 2022] GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e => generated 1389 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:28:56.985438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-aae0cb47-826f-4efd-845b-868b597272da tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:28:56.986088 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-aae0cb47-826f-4efd-845b-868b597272da tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 12b19556-704c-4e9a-a7bf-d52ac72fef3e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:28:56.992238 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aae0cb47-826f-4efd-845b-868b597272da tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:56.992717 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aae0cb47-826f-4efd-845b-868b597272da tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:56.993149 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aae0cb47-826f-4efd-845b-868b597272da tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:56.993833 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aae0cb47-826f-4efd-845b-868b597272da tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:56.994285 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aae0cb47-826f-4efd-845b-868b597272da tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:56.995112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aae0cb47-826f-4efd-845b-868b597272da tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:57.128003 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-aae0cb47-826f-4efd-845b-868b597272da tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:28:57.135862 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-aae0cb47-826f-4efd-845b-868b597272da tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e" status: 200 len: 1389 microversion: 2.1 time: 0.155268 Sep 10 12:28:57.136623 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3254/6514] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:28:56 2022] GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e => generated 1389 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:28:57.157968 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-43ce1261-2a51-4c95-9b26-c89d979bce0c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:28:57.158399 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-43ce1261-2a51-4c95-9b26-c89d979bce0c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 12b19556-704c-4e9a-a7bf-d52ac72fef3e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:28:57.164776 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-43ce1261-2a51-4c95-9b26-c89d979bce0c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:57.165258 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-43ce1261-2a51-4c95-9b26-c89d979bce0c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:57.165695 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-43ce1261-2a51-4c95-9b26-c89d979bce0c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:57.166380 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-43ce1261-2a51-4c95-9b26-c89d979bce0c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:57.166832 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-43ce1261-2a51-4c95-9b26-c89d979bce0c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:57.167284 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-43ce1261-2a51-4c95-9b26-c89d979bce0c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:57.191767 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-43ce1261-2a51-4c95-9b26-c89d979bce0c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 12b19556-704c-4e9a-a7bf-d52ac72fef3e] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:28:57.267291 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-43ce1261-2a51-4c95-9b26-c89d979bce0c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "DELETE /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e" status: 204 len: 0 microversion: 2.1 time: 0.113310 Sep 10 12:28:57.268000 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3261/6515] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:28:57 2022] DELETE /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:28:57.276428 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-512ef364-5e06-47f6-b0f7-d33b1d7b0aef tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:28:57.277057 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-512ef364-5e06-47f6-b0f7-d33b1d7b0aef tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 12b19556-704c-4e9a-a7bf-d52ac72fef3e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:28:57.283634 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-512ef364-5e06-47f6-b0f7-d33b1d7b0aef tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:57.284110 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-512ef364-5e06-47f6-b0f7-d33b1d7b0aef tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:57.284554 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-512ef364-5e06-47f6-b0f7-d33b1d7b0aef tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:57.285250 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-512ef364-5e06-47f6-b0f7-d33b1d7b0aef tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:57.285711 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-512ef364-5e06-47f6-b0f7-d33b1d7b0aef tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:57.286139 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-512ef364-5e06-47f6-b0f7-d33b1d7b0aef tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:57.417872 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-512ef364-5e06-47f6-b0f7-d33b1d7b0aef tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:28:57.425852 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-512ef364-5e06-47f6-b0f7-d33b1d7b0aef tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e" status: 200 len: 1395 microversion: 2.1 time: 0.153370 Sep 10 12:28:57.426435 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3255/6516] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:28:57 2022] GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e => generated 1395 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:28:58.449800 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dbb4bad2-b9bb-4205-a1c0-2212fc9d066e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:28:58.450436 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-dbb4bad2-b9bb-4205-a1c0-2212fc9d066e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 12b19556-704c-4e9a-a7bf-d52ac72fef3e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:28:58.457595 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dbb4bad2-b9bb-4205-a1c0-2212fc9d066e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:58.458104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dbb4bad2-b9bb-4205-a1c0-2212fc9d066e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:58.458526 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dbb4bad2-b9bb-4205-a1c0-2212fc9d066e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:58.459243 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dbb4bad2-b9bb-4205-a1c0-2212fc9d066e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:58.459702 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dbb4bad2-b9bb-4205-a1c0-2212fc9d066e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:58.460133 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dbb4bad2-b9bb-4205-a1c0-2212fc9d066e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:58.597734 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-dbb4bad2-b9bb-4205-a1c0-2212fc9d066e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:28:58.605689 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-dbb4bad2-b9bb-4205-a1c0-2212fc9d066e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e" status: 200 len: 1395 microversion: 2.1 time: 0.160269 Sep 10 12:28:58.606266 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3262/6517] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:28:58 2022] GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e => generated 1395 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:28:59.547823 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-97120f25-13c6-41e0-a81b-b56bf3c6ab05 req-aecdf284-d474-4926-a31c-feda34e1b337 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12b19556-704c-4e9a-a7bf-d52ac72fef3e", "name": "network-vif-deleted", "tag": "deac2192-68fd-4165-917e-014154906718"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:28:59.563518 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-97120f25-13c6-41e0-a81b-b56bf3c6ab05 req-aecdf284-d474-4926-a31c-feda34e1b337 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:59.564112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-97120f25-13c6-41e0-a81b-b56bf3c6ab05 req-aecdf284-d474-4926-a31c-feda34e1b337 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:59.564608 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-97120f25-13c6-41e0-a81b-b56bf3c6ab05 req-aecdf284-d474-4926-a31c-feda34e1b337 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:59.581518 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-97120f25-13c6-41e0-a81b-b56bf3c6ab05 req-aecdf284-d474-4926-a31c-feda34e1b337 service nova] Creating event network-vif-deleted:deac2192-68fd-4165-917e-014154906718 for instance 12b19556-704c-4e9a-a7bf-d52ac72fef3e on n-h1-856895-1 Sep 10 12:28:59.594497 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-97120f25-13c6-41e0-a81b-b56bf3c6ab05 req-aecdf284-d474-4926-a31c-feda34e1b337 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050889 Sep 10 12:28:59.595138 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3256/6518] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:28:59.630732 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0f29115a-4166-493d-9b11-c044819c6841 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:28:59.632408 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0f29115a-4166-493d-9b11-c044819c6841 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 12b19556-704c-4e9a-a7bf-d52ac72fef3e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:28:59.641121 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f29115a-4166-493d-9b11-c044819c6841 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:59.641756 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f29115a-4166-493d-9b11-c044819c6841 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:59.642272 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f29115a-4166-493d-9b11-c044819c6841 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:59.643071 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f29115a-4166-493d-9b11-c044819c6841 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:28:59.643635 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f29115a-4166-493d-9b11-c044819c6841 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:28:59.644349 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f29115a-4166-493d-9b11-c044819c6841 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:28:59.728371 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0f29115a-4166-493d-9b11-c044819c6841 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:28:59.741434 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0f29115a-4166-493d-9b11-c044819c6841 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e" status: 200 len: 1186 microversion: 2.1 time: 0.115173 Sep 10 12:28:59.742023 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3263/6519] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:28:59 2022] GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e => generated 1186 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:29:00.766729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ea53374a-52c7-40d3-8828-13acb2353a41 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:29:00.767720 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ea53374a-52c7-40d3-8828-13acb2353a41 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 12b19556-704c-4e9a-a7bf-d52ac72fef3e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:29:00.775280 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea53374a-52c7-40d3-8828-13acb2353a41 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:00.775837 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea53374a-52c7-40d3-8828-13acb2353a41 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:00.776338 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea53374a-52c7-40d3-8828-13acb2353a41 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:00.777096 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea53374a-52c7-40d3-8828-13acb2353a41 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:00.777622 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea53374a-52c7-40d3-8828-13acb2353a41 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:00.778119 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea53374a-52c7-40d3-8828-13acb2353a41 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:00.842276 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ea53374a-52c7-40d3-8828-13acb2353a41 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:29:00.850098 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ea53374a-52c7-40d3-8828-13acb2353a41 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e" status: 200 len: 1186 microversion: 2.1 time: 0.088162 Sep 10 12:29:00.850753 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3257/6520] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:29:00 2022] GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e => generated 1186 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:29:01.874565 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-18d61bd3-bd03-45c9-bade-96f07251a125 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:29:01.875183 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-18d61bd3-bd03-45c9-bade-96f07251a125 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 12b19556-704c-4e9a-a7bf-d52ac72fef3e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:29:01.882100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-18d61bd3-bd03-45c9-bade-96f07251a125 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:01.882585 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-18d61bd3-bd03-45c9-bade-96f07251a125 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:01.883018 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-18d61bd3-bd03-45c9-bade-96f07251a125 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:01.883730 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-18d61bd3-bd03-45c9-bade-96f07251a125 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:01.884183 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-18d61bd3-bd03-45c9-bade-96f07251a125 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:01.884606 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-18d61bd3-bd03-45c9-bade-96f07251a125 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:01.949512 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-18d61bd3-bd03-45c9-bade-96f07251a125 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:29:01.958289 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-18d61bd3-bd03-45c9-bade-96f07251a125 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e" status: 200 len: 1186 microversion: 2.1 time: 0.088289 Sep 10 12:29:01.958879 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3264/6521] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:29:01 2022] GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e => generated 1186 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:29:02.982350 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ca9649fc-c699-4df1-a74b-3b71cbd9669b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:29:02.983303 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ca9649fc-c699-4df1-a74b-3b71cbd9669b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 12b19556-704c-4e9a-a7bf-d52ac72fef3e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:29:02.990253 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca9649fc-c699-4df1-a74b-3b71cbd9669b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:02.990814 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca9649fc-c699-4df1-a74b-3b71cbd9669b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:02.991375 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca9649fc-c699-4df1-a74b-3b71cbd9669b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:02.992139 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca9649fc-c699-4df1-a74b-3b71cbd9669b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:02.992597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca9649fc-c699-4df1-a74b-3b71cbd9669b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:02.993022 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ca9649fc-c699-4df1-a74b-3b71cbd9669b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:03.057201 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ca9649fc-c699-4df1-a74b-3b71cbd9669b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:29:03.065768 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ca9649fc-c699-4df1-a74b-3b71cbd9669b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e" status: 200 len: 1186 microversion: 2.1 time: 0.087787 Sep 10 12:29:03.066347 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3258/6522] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:29:02 2022] GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e => generated 1186 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:29:04.089658 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b9d71c56-a2c3-4a2a-a269-1a1702fdee75 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:29:04.090294 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b9d71c56-a2c3-4a2a-a269-1a1702fdee75 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 12b19556-704c-4e9a-a7bf-d52ac72fef3e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:29:04.098051 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9d71c56-a2c3-4a2a-a269-1a1702fdee75 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:04.098594 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9d71c56-a2c3-4a2a-a269-1a1702fdee75 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:04.099060 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9d71c56-a2c3-4a2a-a269-1a1702fdee75 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:04.099801 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9d71c56-a2c3-4a2a-a269-1a1702fdee75 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:04.100303 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9d71c56-a2c3-4a2a-a269-1a1702fdee75 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:04.100813 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9d71c56-a2c3-4a2a-a269-1a1702fdee75 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:04.133011 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9d71c56-a2c3-4a2a-a269-1a1702fdee75 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:04.133493 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9d71c56-a2c3-4a2a-a269-1a1702fdee75 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:04.133991 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9d71c56-a2c3-4a2a-a269-1a1702fdee75 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:04.134354 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-b9d71c56-a2c3-4a2a-a269-1a1702fdee75 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lazy-loading 'fault' on Instance uuid 12b19556-704c-4e9a-a7bf-d52ac72fef3e {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:29:04.137838 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:29:04.180201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b9d71c56-a2c3-4a2a-a269-1a1702fdee75 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:29:04.188281 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b9d71c56-a2c3-4a2a-a269-1a1702fdee75 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e" status: 200 len: 1145 microversion: 2.1 time: 0.103041 Sep 10 12:29:04.189050 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3265/6523] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:29:04 2022] GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e => generated 1145 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:29:05.211898 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c5a2dc1e-bd4f-42ab-be8d-5f61fc2b0485 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:29:05.212729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c5a2dc1e-bd4f-42ab-be8d-5f61fc2b0485 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 12b19556-704c-4e9a-a7bf-d52ac72fef3e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:29:05.215593 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:29:05.223282 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c5a2dc1e-bd4f-42ab-be8d-5f61fc2b0485 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:05.223777 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c5a2dc1e-bd4f-42ab-be8d-5f61fc2b0485 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:05.224216 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c5a2dc1e-bd4f-42ab-be8d-5f61fc2b0485 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:05.224916 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c5a2dc1e-bd4f-42ab-be8d-5f61fc2b0485 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:05.225374 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c5a2dc1e-bd4f-42ab-be8d-5f61fc2b0485 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:05.225806 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c5a2dc1e-bd4f-42ab-be8d-5f61fc2b0485 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:05.228633 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=81 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:29:05.241216 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-c5a2dc1e-bd4f-42ab-be8d-5f61fc2b0485 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] HTTP exception thrown: Instance 12b19556-704c-4e9a-a7bf-d52ac72fef3e could not be found. Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c5a2dc1e-bd4f-42ab-be8d-5f61fc2b0485 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Request method failure captured: Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e HTTP/1.1 Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHILszP5bh-7vS5nFlniigSPwJSgl9gRBzD28JMJ3uXj7KaJ7IKD0MoPbGUyk7NiR2g3O-OhOoEJg5Mrgl8pVom5QsCHuzRwflIP07SHDWyP4-s7StMch63ybX3LIelpp866T-_UOtQoKy1YDkCCnydW84pCURv3Zlf7uIJ_dXgYsc64 Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: e27276f18d8045e2a9be7a6c5ed892f7 Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e27276f18d8045e2a9be7a6c5ed892f7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: e27276f18d8045e2a9be7a6c5ed892f7 Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-TestVolumeBootPattern-1940983644-project Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 5f0b168293f943389d72753009c88789 Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-TestVolumeBootPattern-1940983644-project Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 12b19556-704c-4e9a-a7bf-d52ac72fef3e could not be found. Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '12b19556-704c-4e9a-a7bf-d52ac72fef3e'} Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12b19556-704c-4e9a-a7bf-d52ac72fef3e could not be found. Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12b19556-704c-4e9a-a7bf-d52ac72fef3e could not be found. Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:29:05.242854 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:29:05.248625 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:29:05.248625 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:29:05.248625 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:29:05.248625 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:29:05.248625 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:29:05.248625 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12b19556-704c-4e9a-a7bf-d52ac72fef3e could not be found. Sep 10 12:29:05.248625 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:29:05.248625 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c5a2dc1e-bd4f-42ab-be8d-5f61fc2b0485 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Returning 404 to user: Instance 12b19556-704c-4e9a-a7bf-d52ac72fef3e could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:29:05.248625 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c5a2dc1e-bd4f-42ab-be8d-5f61fc2b0485 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e" status: 404 len: 111 microversion: 2.1 time: 0.036421 Sep 10 12:29:05.248625 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3259/6524] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:29:05 2022] GET /compute/v2.1/servers/12b19556-704c-4e9a-a7bf-d52ac72fef3e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:29:10.177509 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-631b08a7-aa21-491c-8092-ced836c4d6bc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1541343801", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "c2804b89-caec-4c3d-81a9-f81a50961df5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "63bc1cec-19c3-45db-83f8-21772e061ea1"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:29:10.189115 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:29:10.239701 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-631b08a7-aa21-491c-8092-ced836c4d6bc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] validate_networks() for [('63bc1cec-19c3-45db-83f8-21772e061ea1', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:29:10.615547 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-631b08a7-aa21-491c-8092-ced836c4d6bc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:29:10.615983 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-631b08a7-aa21-491c-8092-ced836c4d6bc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:29:10.616467 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-631b08a7-aa21-491c-8092-ced836c4d6bc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:29:10.616886 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-631b08a7-aa21-491c-8092-ced836c4d6bc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:29:10.617311 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-631b08a7-aa21-491c-8092-ced836c4d6bc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:29:10.626200 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-631b08a7-aa21-491c-8092-ced836c4d6bc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:10.626692 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-631b08a7-aa21-491c-8092-ced836c4d6bc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:10.627139 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-631b08a7-aa21-491c-8092-ced836c4d6bc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:10.627914 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-631b08a7-aa21-491c-8092-ced836c4d6bc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:10.628383 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-631b08a7-aa21-491c-8092-ced836c4d6bc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:10.628818 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-631b08a7-aa21-491c-8092-ced836c4d6bc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:10.645881 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-631b08a7-aa21-491c-8092-ced836c4d6bc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Getting quotas for project e27276f18d8045e2a9be7a6c5ed892f7. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:29:10.651125 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-631b08a7-aa21-491c-8092-ced836c4d6bc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Getting quotas for user 5f0b168293f943389d72753009c88789 and project e27276f18d8045e2a9be7a6c5ed892f7. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:29:10.707513 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-631b08a7-aa21-491c-8092-ced836c4d6bc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:29:10.709573 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-631b08a7-aa21-491c-8092-ced836c4d6bc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ed775a7c-2d10-45ee-9760-adf089fb048d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c2804b89-caec-4c3d-81a9-f81a50961df5',volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:29:10.839455 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-631b08a7-aa21-491c-8092-ced836c4d6bc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.665754 Sep 10 12:29:10.840127 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3266/6525] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:29:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:29:10.851861 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e3cc85f0-96a5-4d1d-8924-b78457fb915f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:29:10.852470 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e3cc85f0-96a5-4d1d-8924-b78457fb915f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ed775a7c-2d10-45ee-9760-adf089fb048d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:29:10.912948 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e3cc85f0-96a5-4d1d-8924-b78457fb915f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:29:10.920832 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e3cc85f0-96a5-4d1d-8924-b78457fb915f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d" status: 200 len: 1057 microversion: 2.1 time: 0.072812 Sep 10 12:29:10.921517 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3260/6526] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:29:10 2022] GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d => generated 1057 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:29:11.944128 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e07d4a60-1fd3-471e-b74e-0242ab8c1d24 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:29:11.944967 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e07d4a60-1fd3-471e-b74e-0242ab8c1d24 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ed775a7c-2d10-45ee-9760-adf089fb048d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:29:11.953622 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e07d4a60-1fd3-471e-b74e-0242ab8c1d24 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:11.954157 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e07d4a60-1fd3-471e-b74e-0242ab8c1d24 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:11.954609 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e07d4a60-1fd3-471e-b74e-0242ab8c1d24 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:11.955344 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e07d4a60-1fd3-471e-b74e-0242ab8c1d24 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:11.955970 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e07d4a60-1fd3-471e-b74e-0242ab8c1d24 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:11.956408 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e07d4a60-1fd3-471e-b74e-0242ab8c1d24 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:12.055772 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e07d4a60-1fd3-471e-b74e-0242ab8c1d24 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:29:12.072816 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e07d4a60-1fd3-471e-b74e-0242ab8c1d24 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d" status: 200 len: 1173 microversion: 2.1 time: 0.124564 Sep 10 12:29:12.073473 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3267/6527] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:29:11 2022] GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d => generated 1173 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:29:13.097255 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-100c551a-6400-4b22-9751-922aa4717418 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:29:13.098096 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-100c551a-6400-4b22-9751-922aa4717418 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ed775a7c-2d10-45ee-9760-adf089fb048d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:29:13.106745 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-100c551a-6400-4b22-9751-922aa4717418 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:13.107401 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-100c551a-6400-4b22-9751-922aa4717418 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:13.108723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-100c551a-6400-4b22-9751-922aa4717418 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:13.109651 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-100c551a-6400-4b22-9751-922aa4717418 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:13.110181 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-100c551a-6400-4b22-9751-922aa4717418 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:13.110691 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-100c551a-6400-4b22-9751-922aa4717418 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:13.318218 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-100c551a-6400-4b22-9751-922aa4717418 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:29:13.327487 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-100c551a-6400-4b22-9751-922aa4717418 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d" status: 200 len: 1215 microversion: 2.1 time: 0.234264 Sep 10 12:29:13.339755 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3261/6528] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:29:13 2022] GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d => generated 1215 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:29:13.364473 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-abb7b081-e7b2-466d-a43d-910d1e16abac req-c0f8d557-5d21-4dd0-a949-50755a97ea03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed775a7c-2d10-45ee-9760-adf089fb048d", "tag": "93a260cb-7a6f-43d9-89b1-16a3bbb3bf8c"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:29:13.376788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-abb7b081-e7b2-466d-a43d-910d1e16abac req-c0f8d557-5d21-4dd0-a949-50755a97ea03 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:13.377592 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-abb7b081-e7b2-466d-a43d-910d1e16abac req-c0f8d557-5d21-4dd0-a949-50755a97ea03 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:13.378236 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-abb7b081-e7b2-466d-a43d-910d1e16abac req-c0f8d557-5d21-4dd0-a949-50755a97ea03 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:13.390870 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-abb7b081-e7b2-466d-a43d-910d1e16abac req-c0f8d557-5d21-4dd0-a949-50755a97ea03 service nova] Creating event network-changed:93a260cb-7a6f-43d9-89b1-16a3bbb3bf8c for instance ed775a7c-2d10-45ee-9760-adf089fb048d on n-h1-856895-1 Sep 10 12:29:13.396293 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-abb7b081-e7b2-466d-a43d-910d1e16abac req-c0f8d557-5d21-4dd0-a949-50755a97ea03 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035678 Sep 10 12:29:13.397390 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3268/6529] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:29:14.351279 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-be429ec6-a510-4730-9088-25014661a380 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:29:14.352026 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-be429ec6-a510-4730-9088-25014661a380 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ed775a7c-2d10-45ee-9760-adf089fb048d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:29:14.359069 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be429ec6-a510-4730-9088-25014661a380 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:14.359682 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be429ec6-a510-4730-9088-25014661a380 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:14.360199 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be429ec6-a510-4730-9088-25014661a380 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:14.360983 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be429ec6-a510-4730-9088-25014661a380 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:14.361520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be429ec6-a510-4730-9088-25014661a380 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:14.362032 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be429ec6-a510-4730-9088-25014661a380 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:14.569238 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-be429ec6-a510-4730-9088-25014661a380 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:29:14.577987 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-be429ec6-a510-4730-9088-25014661a380 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d" status: 200 len: 1215 microversion: 2.1 time: 0.230641 Sep 10 12:29:14.578667 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3262/6530] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:29:14 2022] GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d => generated 1215 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:29:15.602868 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dbfc4a50-3079-4a1b-9cae-b422bd9648af tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:29:15.603614 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-dbfc4a50-3079-4a1b-9cae-b422bd9648af tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ed775a7c-2d10-45ee-9760-adf089fb048d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:29:15.610797 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dbfc4a50-3079-4a1b-9cae-b422bd9648af tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:15.611446 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dbfc4a50-3079-4a1b-9cae-b422bd9648af tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:15.611890 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dbfc4a50-3079-4a1b-9cae-b422bd9648af tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:15.612735 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dbfc4a50-3079-4a1b-9cae-b422bd9648af tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:15.613313 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dbfc4a50-3079-4a1b-9cae-b422bd9648af tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:15.613744 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dbfc4a50-3079-4a1b-9cae-b422bd9648af tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:15.749676 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-dbfc4a50-3079-4a1b-9cae-b422bd9648af tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:29:15.757408 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-dbfc4a50-3079-4a1b-9cae-b422bd9648af tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d" status: 200 len: 1215 microversion: 2.1 time: 0.159794 Sep 10 12:29:15.757978 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3269/6531] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:29:15 2022] GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d => generated 1215 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:29:16.781087 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-237367c7-5958-4b9e-a161-7461be85eaf8 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:29:16.781719 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-237367c7-5958-4b9e-a161-7461be85eaf8 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ed775a7c-2d10-45ee-9760-adf089fb048d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:29:16.789041 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-237367c7-5958-4b9e-a161-7461be85eaf8 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:16.789534 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-237367c7-5958-4b9e-a161-7461be85eaf8 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:16.789979 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-237367c7-5958-4b9e-a161-7461be85eaf8 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:16.790697 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-237367c7-5958-4b9e-a161-7461be85eaf8 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:16.791176 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-237367c7-5958-4b9e-a161-7461be85eaf8 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:16.791641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-237367c7-5958-4b9e-a161-7461be85eaf8 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:16.930572 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-237367c7-5958-4b9e-a161-7461be85eaf8 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:29:16.939075 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-237367c7-5958-4b9e-a161-7461be85eaf8 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d" status: 200 len: 1215 microversion: 2.1 time: 0.162380 Sep 10 12:29:16.939713 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3263/6532] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:29:16 2022] GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d => generated 1215 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:29:17.961854 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-20817550-a338-48d5-8752-992d61d41f15 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:29:17.962470 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-20817550-a338-48d5-8752-992d61d41f15 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ed775a7c-2d10-45ee-9760-adf089fb048d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:29:17.969396 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20817550-a338-48d5-8752-992d61d41f15 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:17.969874 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20817550-a338-48d5-8752-992d61d41f15 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:17.970307 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20817550-a338-48d5-8752-992d61d41f15 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:17.970992 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20817550-a338-48d5-8752-992d61d41f15 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:17.971473 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20817550-a338-48d5-8752-992d61d41f15 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:17.971896 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-20817550-a338-48d5-8752-992d61d41f15 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:18.104348 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-20817550-a338-48d5-8752-992d61d41f15 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:29:18.112407 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-20817550-a338-48d5-8752-992d61d41f15 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d" status: 200 len: 1203 microversion: 2.1 time: 0.154431 Sep 10 12:29:18.112980 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3270/6533] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:29:17 2022] GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:29:19.136548 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cbe4e390-dc85-4853-835a-474734afa28b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:29:19.137266 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cbe4e390-dc85-4853-835a-474734afa28b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ed775a7c-2d10-45ee-9760-adf089fb048d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:29:19.144608 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cbe4e390-dc85-4853-835a-474734afa28b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:19.145088 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cbe4e390-dc85-4853-835a-474734afa28b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:19.145521 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cbe4e390-dc85-4853-835a-474734afa28b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:19.146216 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cbe4e390-dc85-4853-835a-474734afa28b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:19.146667 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cbe4e390-dc85-4853-835a-474734afa28b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:19.147090 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cbe4e390-dc85-4853-835a-474734afa28b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:19.275326 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cbe4e390-dc85-4853-835a-474734afa28b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:29:19.283111 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cbe4e390-dc85-4853-835a-474734afa28b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d" status: 200 len: 1203 microversion: 2.1 time: 0.150635 Sep 10 12:29:19.283719 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3264/6534] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:29:19 2022] GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d => generated 1203 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:29:20.306167 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6dec2bc9-e73a-46c6-9f12-8961126bb2be tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:29:20.306781 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6dec2bc9-e73a-46c6-9f12-8961126bb2be tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ed775a7c-2d10-45ee-9760-adf089fb048d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:29:20.314240 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6dec2bc9-e73a-46c6-9f12-8961126bb2be tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:20.314712 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6dec2bc9-e73a-46c6-9f12-8961126bb2be tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:20.315185 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6dec2bc9-e73a-46c6-9f12-8961126bb2be tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:20.315858 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6dec2bc9-e73a-46c6-9f12-8961126bb2be tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:20.316309 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6dec2bc9-e73a-46c6-9f12-8961126bb2be tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:20.316733 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6dec2bc9-e73a-46c6-9f12-8961126bb2be tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:20.447661 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6dec2bc9-e73a-46c6-9f12-8961126bb2be tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:29:20.455692 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6dec2bc9-e73a-46c6-9f12-8961126bb2be tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d" status: 200 len: 1203 microversion: 2.1 time: 0.153316 Sep 10 12:29:20.456891 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3271/6535] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:29:20 2022] GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d => generated 1203 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:29:21.479010 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b5e779f3-f86f-4687-a6a2-0bb1ce84a847 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:29:21.479567 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b5e779f3-f86f-4687-a6a2-0bb1ce84a847 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ed775a7c-2d10-45ee-9760-adf089fb048d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:29:21.482259 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:29:21.487627 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5e779f3-f86f-4687-a6a2-0bb1ce84a847 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:21.488113 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5e779f3-f86f-4687-a6a2-0bb1ce84a847 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:21.488544 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5e779f3-f86f-4687-a6a2-0bb1ce84a847 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:21.489236 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5e779f3-f86f-4687-a6a2-0bb1ce84a847 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:21.489689 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5e779f3-f86f-4687-a6a2-0bb1ce84a847 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:21.490371 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b5e779f3-f86f-4687-a6a2-0bb1ce84a847 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:21.623368 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b5e779f3-f86f-4687-a6a2-0bb1ce84a847 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:29:21.631350 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b5e779f3-f86f-4687-a6a2-0bb1ce84a847 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d" status: 200 len: 1203 microversion: 2.1 time: 0.156297 Sep 10 12:29:21.631973 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3265/6536] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:29:21 2022] GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:29:22.654753 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d42a0884-cd21-42dd-a21e-0b5068c594a7 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:29:22.656323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d42a0884-cd21-42dd-a21e-0b5068c594a7 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ed775a7c-2d10-45ee-9760-adf089fb048d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:29:22.657998 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:29:22.658812 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:29:22.665625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d42a0884-cd21-42dd-a21e-0b5068c594a7 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:22.666106 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d42a0884-cd21-42dd-a21e-0b5068c594a7 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:22.666540 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d42a0884-cd21-42dd-a21e-0b5068c594a7 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:22.667262 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d42a0884-cd21-42dd-a21e-0b5068c594a7 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:22.667715 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d42a0884-cd21-42dd-a21e-0b5068c594a7 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:22.668141 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d42a0884-cd21-42dd-a21e-0b5068c594a7 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:22.801570 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d42a0884-cd21-42dd-a21e-0b5068c594a7 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:29:22.809284 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d42a0884-cd21-42dd-a21e-0b5068c594a7 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d" status: 200 len: 1203 microversion: 2.1 time: 0.158422 Sep 10 12:29:22.809868 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3272/6537] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:29:22 2022] GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d => generated 1203 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:29:23.832470 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2db8f7fa-1df1-4760-8d6d-a553c70be5ae tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:29:23.833036 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2db8f7fa-1df1-4760-8d6d-a553c70be5ae tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ed775a7c-2d10-45ee-9760-adf089fb048d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:29:23.839967 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2db8f7fa-1df1-4760-8d6d-a553c70be5ae tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:23.840453 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2db8f7fa-1df1-4760-8d6d-a553c70be5ae tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:23.840917 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2db8f7fa-1df1-4760-8d6d-a553c70be5ae tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:23.841608 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2db8f7fa-1df1-4760-8d6d-a553c70be5ae tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:23.842061 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2db8f7fa-1df1-4760-8d6d-a553c70be5ae tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:23.842486 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2db8f7fa-1df1-4760-8d6d-a553c70be5ae tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:23.977726 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2db8f7fa-1df1-4760-8d6d-a553c70be5ae tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:29:23.986150 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2db8f7fa-1df1-4760-8d6d-a553c70be5ae tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d" status: 200 len: 1203 microversion: 2.1 time: 0.157993 Sep 10 12:29:23.986731 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3266/6538] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:29:23 2022] GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:29:25.009429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8c74cf7e-516c-4139-a5ca-ec11076d5d03 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:29:25.010074 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8c74cf7e-516c-4139-a5ca-ec11076d5d03 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ed775a7c-2d10-45ee-9760-adf089fb048d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:29:25.017021 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8c74cf7e-516c-4139-a5ca-ec11076d5d03 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:25.017504 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8c74cf7e-516c-4139-a5ca-ec11076d5d03 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:25.017944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8c74cf7e-516c-4139-a5ca-ec11076d5d03 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:25.018752 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8c74cf7e-516c-4139-a5ca-ec11076d5d03 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:25.019240 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8c74cf7e-516c-4139-a5ca-ec11076d5d03 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:25.019672 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8c74cf7e-516c-4139-a5ca-ec11076d5d03 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:25.156161 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8c74cf7e-516c-4139-a5ca-ec11076d5d03 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:29:25.164493 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8c74cf7e-516c-4139-a5ca-ec11076d5d03 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d" status: 200 len: 1203 microversion: 2.1 time: 0.159117 Sep 10 12:29:25.165066 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3273/6539] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:29:25 2022] GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d => generated 1203 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:29:26.186579 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d2d1d626-8283-4f86-b856-b52b5bdb5ef5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:29:26.187529 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d2d1d626-8283-4f86-b856-b52b5bdb5ef5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ed775a7c-2d10-45ee-9760-adf089fb048d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:29:26.194289 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d2d1d626-8283-4f86-b856-b52b5bdb5ef5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:26.194780 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d2d1d626-8283-4f86-b856-b52b5bdb5ef5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:26.195234 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d2d1d626-8283-4f86-b856-b52b5bdb5ef5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:26.195922 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d2d1d626-8283-4f86-b856-b52b5bdb5ef5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:26.196378 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d2d1d626-8283-4f86-b856-b52b5bdb5ef5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:26.196803 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d2d1d626-8283-4f86-b856-b52b5bdb5ef5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:26.335007 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d2d1d626-8283-4f86-b856-b52b5bdb5ef5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:29:26.342660 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d2d1d626-8283-4f86-b856-b52b5bdb5ef5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d" status: 200 len: 1203 microversion: 2.1 time: 0.160123 Sep 10 12:29:26.344023 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3267/6540] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:29:26 2022] GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d => generated 1203 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:29:27.110239 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-f0265be3-d924-4ba3-8467-61a3cd860374 req-4bd485f9-2541-4656-a44c-68d3199b4d46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed775a7c-2d10-45ee-9760-adf089fb048d", "name": "network-vif-plugged", "status": "completed", "tag": "93a260cb-7a6f-43d9-89b1-16a3bbb3bf8c"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:29:27.120732 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f0265be3-d924-4ba3-8467-61a3cd860374 req-4bd485f9-2541-4656-a44c-68d3199b4d46 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:27.121223 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f0265be3-d924-4ba3-8467-61a3cd860374 req-4bd485f9-2541-4656-a44c-68d3199b4d46 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:27.121658 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f0265be3-d924-4ba3-8467-61a3cd860374 req-4bd485f9-2541-4656-a44c-68d3199b4d46 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:27.133579 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-f0265be3-d924-4ba3-8467-61a3cd860374 req-4bd485f9-2541-4656-a44c-68d3199b4d46 service nova] Creating event network-vif-plugged:93a260cb-7a6f-43d9-89b1-16a3bbb3bf8c for instance ed775a7c-2d10-45ee-9760-adf089fb048d on n-h1-856895-1 Sep 10 12:29:27.139120 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-f0265be3-d924-4ba3-8467-61a3cd860374 req-4bd485f9-2541-4656-a44c-68d3199b4d46 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032764 Sep 10 12:29:27.140605 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3274/6541] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:29:27.367542 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e92f83b6-614e-4993-9ca5-b4eddf7dd04f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:29:27.368093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e92f83b6-614e-4993-9ca5-b4eddf7dd04f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ed775a7c-2d10-45ee-9760-adf089fb048d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:29:27.375735 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e92f83b6-614e-4993-9ca5-b4eddf7dd04f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:27.376226 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e92f83b6-614e-4993-9ca5-b4eddf7dd04f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:27.376699 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e92f83b6-614e-4993-9ca5-b4eddf7dd04f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:27.377396 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e92f83b6-614e-4993-9ca5-b4eddf7dd04f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:27.377860 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e92f83b6-614e-4993-9ca5-b4eddf7dd04f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:27.378293 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e92f83b6-614e-4993-9ca5-b4eddf7dd04f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:27.506689 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e92f83b6-614e-4993-9ca5-b4eddf7dd04f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:29:27.514372 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e92f83b6-614e-4993-9ca5-b4eddf7dd04f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d" status: 200 len: 1203 microversion: 2.1 time: 0.151142 Sep 10 12:29:27.515198 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3268/6542] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:29:27 2022] GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d => generated 1203 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:29:28.539198 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6c508957-d225-4bd3-8b2d-b3fdacfb38e2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:29:28.539856 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6c508957-d225-4bd3-8b2d-b3fdacfb38e2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ed775a7c-2d10-45ee-9760-adf089fb048d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:29:28.546716 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6c508957-d225-4bd3-8b2d-b3fdacfb38e2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:28.547320 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6c508957-d225-4bd3-8b2d-b3fdacfb38e2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:28.547762 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6c508957-d225-4bd3-8b2d-b3fdacfb38e2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:28.548445 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6c508957-d225-4bd3-8b2d-b3fdacfb38e2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:28.548898 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6c508957-d225-4bd3-8b2d-b3fdacfb38e2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:28.549324 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6c508957-d225-4bd3-8b2d-b3fdacfb38e2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:28.683009 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6c508957-d225-4bd3-8b2d-b3fdacfb38e2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:29:28.690991 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6c508957-d225-4bd3-8b2d-b3fdacfb38e2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d" status: 200 len: 1203 microversion: 2.1 time: 0.157024 Sep 10 12:29:28.691610 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3275/6543] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:29:28 2022] GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:29:29.714666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2a900089-64f2-45a1-b381-97857defa379 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:29:29.715313 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2a900089-64f2-45a1-b381-97857defa379 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ed775a7c-2d10-45ee-9760-adf089fb048d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:29:29.722305 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a900089-64f2-45a1-b381-97857defa379 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:29.722786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a900089-64f2-45a1-b381-97857defa379 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:29.723260 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a900089-64f2-45a1-b381-97857defa379 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:29.723957 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a900089-64f2-45a1-b381-97857defa379 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:29.724418 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a900089-64f2-45a1-b381-97857defa379 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:29.724847 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a900089-64f2-45a1-b381-97857defa379 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:29.854316 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2a900089-64f2-45a1-b381-97857defa379 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:29:29.862837 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2a900089-64f2-45a1-b381-97857defa379 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d" status: 200 len: 1391 microversion: 2.1 time: 0.152045 Sep 10 12:29:29.863454 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3269/6544] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:29:29 2022] GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d => generated 1391 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:29:29.886580 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-87a8086a-de52-4036-9840-3252ecc22652 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:29:29.887238 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-87a8086a-de52-4036-9840-3252ecc22652 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ed775a7c-2d10-45ee-9760-adf089fb048d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:29:29.894191 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-87a8086a-de52-4036-9840-3252ecc22652 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:29.894683 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-87a8086a-de52-4036-9840-3252ecc22652 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:29.895129 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-87a8086a-de52-4036-9840-3252ecc22652 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:29.895880 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-87a8086a-de52-4036-9840-3252ecc22652 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:29.896346 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-87a8086a-de52-4036-9840-3252ecc22652 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:29.896813 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-87a8086a-de52-4036-9840-3252ecc22652 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:30.029594 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-87a8086a-de52-4036-9840-3252ecc22652 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:29:30.038007 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-87a8086a-de52-4036-9840-3252ecc22652 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d" status: 200 len: 1391 microversion: 2.1 time: 0.155290 Sep 10 12:29:30.038581 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3276/6545] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:29:29 2022] GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:29:30.060374 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a937dff1-4d8b-432b-a2b9-79ba86a95203 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:29:30.060996 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a937dff1-4d8b-432b-a2b9-79ba86a95203 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ed775a7c-2d10-45ee-9760-adf089fb048d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:29:30.067116 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a937dff1-4d8b-432b-a2b9-79ba86a95203 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:30.067635 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a937dff1-4d8b-432b-a2b9-79ba86a95203 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:30.068079 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a937dff1-4d8b-432b-a2b9-79ba86a95203 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:30.068774 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a937dff1-4d8b-432b-a2b9-79ba86a95203 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:30.069236 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a937dff1-4d8b-432b-a2b9-79ba86a95203 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:30.069667 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a937dff1-4d8b-432b-a2b9-79ba86a95203 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:30.200331 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a937dff1-4d8b-432b-a2b9-79ba86a95203 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:29:30.208250 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a937dff1-4d8b-432b-a2b9-79ba86a95203 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d" status: 200 len: 1391 microversion: 2.1 time: 0.151737 Sep 10 12:29:30.208838 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3270/6546] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:29:30 2022] GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d => generated 1391 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:29:30.231217 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-633fcd2f-1ce9-4bab-8cdc-ca9e2d28d2d5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:29:30.231663 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-633fcd2f-1ce9-4bab-8cdc-ca9e2d28d2d5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ed775a7c-2d10-45ee-9760-adf089fb048d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:29:30.238653 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-633fcd2f-1ce9-4bab-8cdc-ca9e2d28d2d5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:30.239146 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-633fcd2f-1ce9-4bab-8cdc-ca9e2d28d2d5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:30.239636 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-633fcd2f-1ce9-4bab-8cdc-ca9e2d28d2d5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:30.240590 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-633fcd2f-1ce9-4bab-8cdc-ca9e2d28d2d5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:30.241049 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-633fcd2f-1ce9-4bab-8cdc-ca9e2d28d2d5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:30.241482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-633fcd2f-1ce9-4bab-8cdc-ca9e2d28d2d5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:30.265536 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-633fcd2f-1ce9-4bab-8cdc-ca9e2d28d2d5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ed775a7c-2d10-45ee-9760-adf089fb048d] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:29:30.340080 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-633fcd2f-1ce9-4bab-8cdc-ca9e2d28d2d5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d" status: 204 len: 0 microversion: 2.1 time: 0.112394 Sep 10 12:29:30.341271 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3277/6547] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:29:30 2022] DELETE /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:29:30.350399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c496baf3-ffcc-4eda-a7d9-b2eb0638d687 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:29:30.351015 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c496baf3-ffcc-4eda-a7d9-b2eb0638d687 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ed775a7c-2d10-45ee-9760-adf089fb048d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:29:30.356957 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c496baf3-ffcc-4eda-a7d9-b2eb0638d687 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:30.357434 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c496baf3-ffcc-4eda-a7d9-b2eb0638d687 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:30.357865 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c496baf3-ffcc-4eda-a7d9-b2eb0638d687 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:30.359429 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c496baf3-ffcc-4eda-a7d9-b2eb0638d687 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:30.359947 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c496baf3-ffcc-4eda-a7d9-b2eb0638d687 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:30.360375 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c496baf3-ffcc-4eda-a7d9-b2eb0638d687 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:30.492042 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c496baf3-ffcc-4eda-a7d9-b2eb0638d687 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:29:30.500398 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c496baf3-ffcc-4eda-a7d9-b2eb0638d687 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d" status: 200 len: 1397 microversion: 2.1 time: 0.154030 Sep 10 12:29:30.500980 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3271/6548] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:29:30 2022] GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d => generated 1397 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:29:31.523633 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c6f8d00c-c2bf-4556-8c57-235dfc42ac7f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:29:31.524261 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c6f8d00c-c2bf-4556-8c57-235dfc42ac7f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ed775a7c-2d10-45ee-9760-adf089fb048d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:29:31.532535 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c6f8d00c-c2bf-4556-8c57-235dfc42ac7f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:31.533018 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c6f8d00c-c2bf-4556-8c57-235dfc42ac7f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:31.533453 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c6f8d00c-c2bf-4556-8c57-235dfc42ac7f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:31.534142 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c6f8d00c-c2bf-4556-8c57-235dfc42ac7f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:31.534599 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c6f8d00c-c2bf-4556-8c57-235dfc42ac7f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:31.535027 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c6f8d00c-c2bf-4556-8c57-235dfc42ac7f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:31.667749 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c6f8d00c-c2bf-4556-8c57-235dfc42ac7f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:29:31.676157 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c6f8d00c-c2bf-4556-8c57-235dfc42ac7f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d" status: 200 len: 1397 microversion: 2.1 time: 0.156904 Sep 10 12:29:31.676734 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3278/6549] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:29:31 2022] GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d => generated 1397 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:29:32.547263 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-20e0132b-26b7-4d96-ae41-283d5a6937b2 req-624ae52c-453b-4fc1-afe2-55612afc98e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed775a7c-2d10-45ee-9760-adf089fb048d", "name": "network-vif-deleted", "tag": "93a260cb-7a6f-43d9-89b1-16a3bbb3bf8c"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:29:32.558489 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-20e0132b-26b7-4d96-ae41-283d5a6937b2 req-624ae52c-453b-4fc1-afe2-55612afc98e4 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:32.559311 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-20e0132b-26b7-4d96-ae41-283d5a6937b2 req-624ae52c-453b-4fc1-afe2-55612afc98e4 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:32.559746 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-20e0132b-26b7-4d96-ae41-283d5a6937b2 req-624ae52c-453b-4fc1-afe2-55612afc98e4 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:32.577142 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-20e0132b-26b7-4d96-ae41-283d5a6937b2 req-624ae52c-453b-4fc1-afe2-55612afc98e4 service nova] Creating event network-vif-deleted:93a260cb-7a6f-43d9-89b1-16a3bbb3bf8c for instance ed775a7c-2d10-45ee-9760-adf089fb048d on n-h1-856895-1 Sep 10 12:29:32.582467 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-20e0132b-26b7-4d96-ae41-283d5a6937b2 req-624ae52c-453b-4fc1-afe2-55612afc98e4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039214 Sep 10 12:29:32.583082 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3272/6550] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:29:32.699684 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5d50b6be-509f-439c-a224-ddf762d8f490 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:29:32.700308 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5d50b6be-509f-439c-a224-ddf762d8f490 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ed775a7c-2d10-45ee-9760-adf089fb048d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:29:32.707598 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5d50b6be-509f-439c-a224-ddf762d8f490 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:32.708027 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5d50b6be-509f-439c-a224-ddf762d8f490 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:32.708471 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5d50b6be-509f-439c-a224-ddf762d8f490 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:32.709176 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5d50b6be-509f-439c-a224-ddf762d8f490 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:32.709636 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5d50b6be-509f-439c-a224-ddf762d8f490 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:32.710070 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5d50b6be-509f-439c-a224-ddf762d8f490 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:32.773310 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5d50b6be-509f-439c-a224-ddf762d8f490 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:29:32.784656 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5d50b6be-509f-439c-a224-ddf762d8f490 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d" status: 200 len: 1188 microversion: 2.1 time: 0.088932 Sep 10 12:29:32.786678 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3279/6551] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:29:32 2022] GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d => generated 1188 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:29:33.809323 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c0785067-d3e8-4cd5-8936-e64764f9a43c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:29:33.809918 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c0785067-d3e8-4cd5-8936-e64764f9a43c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ed775a7c-2d10-45ee-9760-adf089fb048d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:29:33.817220 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c0785067-d3e8-4cd5-8936-e64764f9a43c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:33.817698 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c0785067-d3e8-4cd5-8936-e64764f9a43c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:33.818139 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c0785067-d3e8-4cd5-8936-e64764f9a43c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:33.818824 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c0785067-d3e8-4cd5-8936-e64764f9a43c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:33.819302 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c0785067-d3e8-4cd5-8936-e64764f9a43c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:33.819728 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c0785067-d3e8-4cd5-8936-e64764f9a43c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:33.886025 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c0785067-d3e8-4cd5-8936-e64764f9a43c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:29:33.894849 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c0785067-d3e8-4cd5-8936-e64764f9a43c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d" status: 200 len: 1188 microversion: 2.1 time: 0.090639 Sep 10 12:29:33.895465 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3273/6552] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:29:33 2022] GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d => generated 1188 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:29:34.918038 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a8e3616d-8c4c-4310-8373-2f904d949d30 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:29:34.918682 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a8e3616d-8c4c-4310-8373-2f904d949d30 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ed775a7c-2d10-45ee-9760-adf089fb048d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:29:34.926371 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8e3616d-8c4c-4310-8373-2f904d949d30 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:34.926861 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8e3616d-8c4c-4310-8373-2f904d949d30 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:34.927332 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8e3616d-8c4c-4310-8373-2f904d949d30 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:34.928044 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8e3616d-8c4c-4310-8373-2f904d949d30 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:34.928501 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8e3616d-8c4c-4310-8373-2f904d949d30 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:34.928937 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a8e3616d-8c4c-4310-8373-2f904d949d30 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:34.933461 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:29:34.996201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a8e3616d-8c4c-4310-8373-2f904d949d30 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:29:35.004991 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a8e3616d-8c4c-4310-8373-2f904d949d30 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d" status: 200 len: 1188 microversion: 2.1 time: 0.090810 Sep 10 12:29:35.005688 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3280/6553] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:29:34 2022] GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d => generated 1188 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:29:36.027544 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6b97e177-cc5b-4901-8475-0e12e8a889bd tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:29:36.028164 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6b97e177-cc5b-4901-8475-0e12e8a889bd tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ed775a7c-2d10-45ee-9760-adf089fb048d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:29:36.031612 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=32 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:29:36.036935 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6b97e177-cc5b-4901-8475-0e12e8a889bd tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:36.037421 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6b97e177-cc5b-4901-8475-0e12e8a889bd tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:36.037856 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6b97e177-cc5b-4901-8475-0e12e8a889bd tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:36.038579 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6b97e177-cc5b-4901-8475-0e12e8a889bd tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:36.039034 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6b97e177-cc5b-4901-8475-0e12e8a889bd tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:36.039490 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6b97e177-cc5b-4901-8475-0e12e8a889bd tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:36.043784 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=76 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:29:36.107370 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6b97e177-cc5b-4901-8475-0e12e8a889bd tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:29:36.116654 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6b97e177-cc5b-4901-8475-0e12e8a889bd tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d" status: 200 len: 1188 microversion: 2.1 time: 0.093008 Sep 10 12:29:36.123430 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3274/6554] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:29:36 2022] GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d => generated 1188 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:29:37.140891 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ea909f57-dd6b-4faa-bcef-eba8e738f090 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:29:37.141558 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ea909f57-dd6b-4faa-bcef-eba8e738f090 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ed775a7c-2d10-45ee-9760-adf089fb048d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:29:37.148961 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea909f57-dd6b-4faa-bcef-eba8e738f090 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:37.149496 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea909f57-dd6b-4faa-bcef-eba8e738f090 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:37.149947 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea909f57-dd6b-4faa-bcef-eba8e738f090 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:37.150681 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea909f57-dd6b-4faa-bcef-eba8e738f090 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:37.151256 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea909f57-dd6b-4faa-bcef-eba8e738f090 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:37.151689 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea909f57-dd6b-4faa-bcef-eba8e738f090 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:37.187275 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea909f57-dd6b-4faa-bcef-eba8e738f090 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:37.187770 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea909f57-dd6b-4faa-bcef-eba8e738f090 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:37.188232 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ea909f57-dd6b-4faa-bcef-eba8e738f090 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:37.188720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-ea909f57-dd6b-4faa-bcef-eba8e738f090 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lazy-loading 'fault' on Instance uuid ed775a7c-2d10-45ee-9760-adf089fb048d {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:29:37.229815 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ea909f57-dd6b-4faa-bcef-eba8e738f090 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:29:37.237586 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ea909f57-dd6b-4faa-bcef-eba8e738f090 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d" status: 200 len: 1147 microversion: 2.1 time: 0.101051 Sep 10 12:29:37.238159 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3281/6555] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:29:37 2022] GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d => generated 1147 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:29:38.261573 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c680bda1-62ec-4108-99c3-51fd344556e1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:29:38.262191 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c680bda1-62ec-4108-99c3-51fd344556e1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ed775a7c-2d10-45ee-9760-adf089fb048d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:29:38.270017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c680bda1-62ec-4108-99c3-51fd344556e1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:38.270504 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c680bda1-62ec-4108-99c3-51fd344556e1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:38.270948 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c680bda1-62ec-4108-99c3-51fd344556e1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:38.271669 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c680bda1-62ec-4108-99c3-51fd344556e1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:38.272128 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c680bda1-62ec-4108-99c3-51fd344556e1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:38.272560 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c680bda1-62ec-4108-99c3-51fd344556e1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:38.286425 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-c680bda1-62ec-4108-99c3-51fd344556e1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] HTTP exception thrown: Instance ed775a7c-2d10-45ee-9760-adf089fb048d could not be found. Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c680bda1-62ec-4108-99c3-51fd344556e1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Request method failure captured: Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d HTTP/1.1 Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHILszP5bh-7vS5nFlniigSPwJSgl9gRBzD28JMJ3uXj7KaJ7IKD0MoPbGUyk7NiR2g3O-OhOoEJg5Mrgl8pVom5QsCHuzRwflIP07SHDWyP4-s7StMch63ybX3LIelpp866T-_UOtQoKy1YDkCCnydW84pCURv3Zlf7uIJ_dXgYsc64 Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: e27276f18d8045e2a9be7a6c5ed892f7 Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e27276f18d8045e2a9be7a6c5ed892f7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: e27276f18d8045e2a9be7a6c5ed892f7 Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-TestVolumeBootPattern-1940983644-project Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 5f0b168293f943389d72753009c88789 Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-TestVolumeBootPattern-1940983644-project Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance ed775a7c-2d10-45ee-9760-adf089fb048d could not be found. Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'ed775a7c-2d10-45ee-9760-adf089fb048d'} Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed775a7c-2d10-45ee-9760-adf089fb048d could not be found. Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed775a7c-2d10-45ee-9760-adf089fb048d could not be found. Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:29:38.288097 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:29:38.293390 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:29:38.293390 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:29:38.293390 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:29:38.293390 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:29:38.293390 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:29:38.293390 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed775a7c-2d10-45ee-9760-adf089fb048d could not be found. Sep 10 12:29:38.293390 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:29:38.293390 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c680bda1-62ec-4108-99c3-51fd344556e1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Returning 404 to user: Instance ed775a7c-2d10-45ee-9760-adf089fb048d could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:29:38.293390 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c680bda1-62ec-4108-99c3-51fd344556e1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d" status: 404 len: 111 microversion: 2.1 time: 0.032166 Sep 10 12:29:38.293390 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3275/6556] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:29:38 2022] GET /compute/v2.1/servers/ed775a7c-2d10-45ee-9760-adf089fb048d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:29:59.288080 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fb44a5d9-4209-44e4-81f6-491cbef21577 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1559026311", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "1501a18b-f954-4b61-91ac-66047ba5a920", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "63bc1cec-19c3-45db-83f8-21772e061ea1"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:29:59.299466 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:29:59.300129 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=13 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:29:59.380870 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-fb44a5d9-4209-44e4-81f6-491cbef21577 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] validate_networks() for [('63bc1cec-19c3-45db-83f8-21772e061ea1', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:29:59.747379 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-fb44a5d9-4209-44e4-81f6-491cbef21577 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:29:59.747811 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-fb44a5d9-4209-44e4-81f6-491cbef21577 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:29:59.748891 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-fb44a5d9-4209-44e4-81f6-491cbef21577 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:29:59.749312 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-fb44a5d9-4209-44e4-81f6-491cbef21577 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:29:59.749734 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-fb44a5d9-4209-44e4-81f6-491cbef21577 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:29:59.758857 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fb44a5d9-4209-44e4-81f6-491cbef21577 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:59.759377 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fb44a5d9-4209-44e4-81f6-491cbef21577 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:59.759815 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fb44a5d9-4209-44e4-81f6-491cbef21577 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:59.760537 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fb44a5d9-4209-44e4-81f6-491cbef21577 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:29:59.760993 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fb44a5d9-4209-44e4-81f6-491cbef21577 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:29:59.761418 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fb44a5d9-4209-44e4-81f6-491cbef21577 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:29:59.779138 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-fb44a5d9-4209-44e4-81f6-491cbef21577 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Getting quotas for project e27276f18d8045e2a9be7a6c5ed892f7. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:29:59.785459 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-fb44a5d9-4209-44e4-81f6-491cbef21577 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Getting quotas for user 5f0b168293f943389d72753009c88789 and project e27276f18d8045e2a9be7a6c5ed892f7. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:29:59.798466 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fb44a5d9-4209-44e4-81f6-491cbef21577 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:29:59.800524 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fb44a5d9-4209-44e4-81f6-491cbef21577 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 6fa50a78-eb03-4b1f-836a-23dff43b5bd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='1501a18b-f954-4b61-91ac-66047ba5a920',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:29:59.874626 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fb44a5d9-4209-44e4-81f6-491cbef21577 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.590737 Sep 10 12:29:59.875415 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3282/6557] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:29:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:29:59.886419 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e1f5b5d6-4ec4-4d28-a4ab-434eaef5170b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:29:59.887050 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e1f5b5d6-4ec4-4d28-a4ab-434eaef5170b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 6fa50a78-eb03-4b1f-836a-23dff43b5bd6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:29:59.890428 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:29:59.891085 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=7 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:29:59.945312 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e1f5b5d6-4ec4-4d28-a4ab-434eaef5170b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:29:59.953211 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e1f5b5d6-4ec4-4d28-a4ab-434eaef5170b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6" status: 200 len: 1057 microversion: 2.1 time: 0.070650 Sep 10 12:29:59.953787 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3276/6558] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:29:59 2022] GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6 => generated 1057 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:30:00.976508 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-10ad0bc5-f236-4a39-a130-2c517ce5bb44 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:30:00.977121 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-10ad0bc5-f236-4a39-a130-2c517ce5bb44 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 6fa50a78-eb03-4b1f-836a-23dff43b5bd6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:30:00.986111 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10ad0bc5-f236-4a39-a130-2c517ce5bb44 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:00.986701 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10ad0bc5-f236-4a39-a130-2c517ce5bb44 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:00.987245 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10ad0bc5-f236-4a39-a130-2c517ce5bb44 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:00.988021 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10ad0bc5-f236-4a39-a130-2c517ce5bb44 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:00.988689 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10ad0bc5-f236-4a39-a130-2c517ce5bb44 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:00.989222 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10ad0bc5-f236-4a39-a130-2c517ce5bb44 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:01.067811 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-10ad0bc5-f236-4a39-a130-2c517ce5bb44 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:30:01.075737 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-10ad0bc5-f236-4a39-a130-2c517ce5bb44 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6" status: 200 len: 1117 microversion: 2.1 time: 0.103338 Sep 10 12:30:01.077243 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3283/6559] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:30:00 2022] GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6 => generated 1117 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:30:02.099756 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-64fcf38a-2de3-46c5-8601-5dfbc0a20bad tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:30:02.101092 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-64fcf38a-2de3-46c5-8601-5dfbc0a20bad tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 6fa50a78-eb03-4b1f-836a-23dff43b5bd6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:30:02.109957 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-64fcf38a-2de3-46c5-8601-5dfbc0a20bad tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:02.110681 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-64fcf38a-2de3-46c5-8601-5dfbc0a20bad tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:02.111302 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-64fcf38a-2de3-46c5-8601-5dfbc0a20bad tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:02.112113 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-64fcf38a-2de3-46c5-8601-5dfbc0a20bad tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:02.112644 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-64fcf38a-2de3-46c5-8601-5dfbc0a20bad tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:02.113145 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-64fcf38a-2de3-46c5-8601-5dfbc0a20bad tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:02.366764 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-64fcf38a-2de3-46c5-8601-5dfbc0a20bad tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:30:02.377593 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-64fcf38a-2de3-46c5-8601-5dfbc0a20bad tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6" status: 200 len: 1169 microversion: 2.1 time: 0.281949 Sep 10 12:30:02.383651 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3277/6560] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:30:02 2022] GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6 => generated 1169 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:30:02.712689 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-46a9047c-f67a-49b2-8c0e-ec0e7af92397 req-c1013ca2-f1fb-438e-bd50-a39eab0f9fab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fa50a78-eb03-4b1f-836a-23dff43b5bd6", "tag": "0ba6ad86-d501-44c7-9c56-79dce1be5aa2"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:30:02.724421 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-46a9047c-f67a-49b2-8c0e-ec0e7af92397 req-c1013ca2-f1fb-438e-bd50-a39eab0f9fab service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:02.725170 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-46a9047c-f67a-49b2-8c0e-ec0e7af92397 req-c1013ca2-f1fb-438e-bd50-a39eab0f9fab service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:02.725668 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-46a9047c-f67a-49b2-8c0e-ec0e7af92397 req-c1013ca2-f1fb-438e-bd50-a39eab0f9fab service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:02.738727 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-46a9047c-f67a-49b2-8c0e-ec0e7af92397 req-c1013ca2-f1fb-438e-bd50-a39eab0f9fab service nova] Creating event network-changed:0ba6ad86-d501-44c7-9c56-79dce1be5aa2 for instance 6fa50a78-eb03-4b1f-836a-23dff43b5bd6 on n-h1-856895-1 Sep 10 12:30:02.743961 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-46a9047c-f67a-49b2-8c0e-ec0e7af92397 req-c1013ca2-f1fb-438e-bd50-a39eab0f9fab service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035882 Sep 10 12:30:02.744814 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3284/6561] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:30:03.402163 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-451e949c-36b7-47fd-8665-ae396cf2c8d4 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:30:03.402882 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-451e949c-36b7-47fd-8665-ae396cf2c8d4 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 6fa50a78-eb03-4b1f-836a-23dff43b5bd6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:30:03.410259 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-451e949c-36b7-47fd-8665-ae396cf2c8d4 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:03.410837 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-451e949c-36b7-47fd-8665-ae396cf2c8d4 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:03.411384 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-451e949c-36b7-47fd-8665-ae396cf2c8d4 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:03.412312 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-451e949c-36b7-47fd-8665-ae396cf2c8d4 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:03.412840 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-451e949c-36b7-47fd-8665-ae396cf2c8d4 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:03.413337 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-451e949c-36b7-47fd-8665-ae396cf2c8d4 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:03.614867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-451e949c-36b7-47fd-8665-ae396cf2c8d4 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:30:03.623780 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-451e949c-36b7-47fd-8665-ae396cf2c8d4 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6" status: 200 len: 1169 microversion: 2.1 time: 0.225032 Sep 10 12:30:03.624588 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3278/6562] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:30:03 2022] GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6 => generated 1169 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:30:04.652155 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-63d25335-9119-47f1-aa15-d08c4c44c613 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:30:04.652820 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-63d25335-9119-47f1-aa15-d08c4c44c613 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 6fa50a78-eb03-4b1f-836a-23dff43b5bd6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:30:04.662304 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-63d25335-9119-47f1-aa15-d08c4c44c613 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:04.662926 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-63d25335-9119-47f1-aa15-d08c4c44c613 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:04.663267 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-63d25335-9119-47f1-aa15-d08c4c44c613 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:04.664522 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-63d25335-9119-47f1-aa15-d08c4c44c613 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:04.664522 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-63d25335-9119-47f1-aa15-d08c4c44c613 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:04.664981 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-63d25335-9119-47f1-aa15-d08c4c44c613 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:04.841458 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-63d25335-9119-47f1-aa15-d08c4c44c613 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:30:04.850472 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-63d25335-9119-47f1-aa15-d08c4c44c613 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6" status: 200 len: 1169 microversion: 2.1 time: 0.204799 Sep 10 12:30:04.850688 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3285/6563] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:30:04 2022] GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6 => generated 1169 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:30:05.893127 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c2eaffad-bc43-4da1-8697-a45f279b4064 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:30:05.894850 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c2eaffad-bc43-4da1-8697-a45f279b4064 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 6fa50a78-eb03-4b1f-836a-23dff43b5bd6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:30:05.906791 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c2eaffad-bc43-4da1-8697-a45f279b4064 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:05.907334 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c2eaffad-bc43-4da1-8697-a45f279b4064 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:05.907778 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c2eaffad-bc43-4da1-8697-a45f279b4064 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:05.908790 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c2eaffad-bc43-4da1-8697-a45f279b4064 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:05.909003 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c2eaffad-bc43-4da1-8697-a45f279b4064 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:05.909636 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c2eaffad-bc43-4da1-8697-a45f279b4064 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:06.109671 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c2eaffad-bc43-4da1-8697-a45f279b4064 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:30:06.119665 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c2eaffad-bc43-4da1-8697-a45f279b4064 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6" status: 200 len: 1169 microversion: 2.1 time: 0.234473 Sep 10 12:30:06.127316 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3279/6564] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:30:05 2022] GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6 => generated 1169 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:30:07.145605 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b19a3a38-19ae-4d2c-9f97-a3c2ff095bb6 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:30:07.147399 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b19a3a38-19ae-4d2c-9f97-a3c2ff095bb6 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 6fa50a78-eb03-4b1f-836a-23dff43b5bd6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:30:07.153528 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b19a3a38-19ae-4d2c-9f97-a3c2ff095bb6 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:07.153993 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b19a3a38-19ae-4d2c-9f97-a3c2ff095bb6 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:07.154424 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b19a3a38-19ae-4d2c-9f97-a3c2ff095bb6 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:07.155199 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b19a3a38-19ae-4d2c-9f97-a3c2ff095bb6 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:07.156402 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b19a3a38-19ae-4d2c-9f97-a3c2ff095bb6 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:07.156782 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b19a3a38-19ae-4d2c-9f97-a3c2ff095bb6 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:07.308604 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b19a3a38-19ae-4d2c-9f97-a3c2ff095bb6 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:30:07.319120 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b19a3a38-19ae-4d2c-9f97-a3c2ff095bb6 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6" status: 200 len: 1169 microversion: 2.1 time: 0.180031 Sep 10 12:30:07.326135 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3286/6565] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:30:07 2022] GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6 => generated 1169 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:30:08.344230 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-654f7c43-966f-49b8-a486-3d7f41430d72 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:30:08.344786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-654f7c43-966f-49b8-a486-3d7f41430d72 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 6fa50a78-eb03-4b1f-836a-23dff43b5bd6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:30:08.351534 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-654f7c43-966f-49b8-a486-3d7f41430d72 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:08.352024 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-654f7c43-966f-49b8-a486-3d7f41430d72 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:08.352455 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-654f7c43-966f-49b8-a486-3d7f41430d72 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:08.353157 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-654f7c43-966f-49b8-a486-3d7f41430d72 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:08.353612 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-654f7c43-966f-49b8-a486-3d7f41430d72 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:08.354051 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-654f7c43-966f-49b8-a486-3d7f41430d72 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:08.486610 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-654f7c43-966f-49b8-a486-3d7f41430d72 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:30:08.494839 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-654f7c43-966f-49b8-a486-3d7f41430d72 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6" status: 200 len: 1169 microversion: 2.1 time: 0.154631 Sep 10 12:30:08.495653 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3280/6566] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:30:08 2022] GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6 => generated 1169 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:30:09.518088 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b0660f7d-6a3d-41d8-aff2-ffef55e68f07 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:30:09.518732 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b0660f7d-6a3d-41d8-aff2-ffef55e68f07 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 6fa50a78-eb03-4b1f-836a-23dff43b5bd6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:30:09.525563 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b0660f7d-6a3d-41d8-aff2-ffef55e68f07 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:09.526044 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b0660f7d-6a3d-41d8-aff2-ffef55e68f07 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:09.526482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b0660f7d-6a3d-41d8-aff2-ffef55e68f07 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:09.527198 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b0660f7d-6a3d-41d8-aff2-ffef55e68f07 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:09.527658 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b0660f7d-6a3d-41d8-aff2-ffef55e68f07 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:09.528084 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b0660f7d-6a3d-41d8-aff2-ffef55e68f07 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:09.659796 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b0660f7d-6a3d-41d8-aff2-ffef55e68f07 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:30:09.667519 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b0660f7d-6a3d-41d8-aff2-ffef55e68f07 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6" status: 200 len: 1169 microversion: 2.1 time: 0.153453 Sep 10 12:30:09.668092 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3287/6567] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:30:09 2022] GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6 => generated 1169 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:30:10.692063 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8a4671aa-9d2d-4fa1-824e-224cfd49b566 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:30:10.692883 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8a4671aa-9d2d-4fa1-824e-224cfd49b566 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 6fa50a78-eb03-4b1f-836a-23dff43b5bd6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:30:10.695563 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:30:10.701703 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a4671aa-9d2d-4fa1-824e-224cfd49b566 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:10.702258 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a4671aa-9d2d-4fa1-824e-224cfd49b566 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:10.702831 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a4671aa-9d2d-4fa1-824e-224cfd49b566 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:10.703597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a4671aa-9d2d-4fa1-824e-224cfd49b566 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:10.704062 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a4671aa-9d2d-4fa1-824e-224cfd49b566 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:10.704496 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a4671aa-9d2d-4fa1-824e-224cfd49b566 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:10.844914 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8a4671aa-9d2d-4fa1-824e-224cfd49b566 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:30:10.853204 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8a4671aa-9d2d-4fa1-824e-224cfd49b566 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6" status: 200 len: 1169 microversion: 2.1 time: 0.165177 Sep 10 12:30:10.853816 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3281/6568] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:30:10 2022] GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6 => generated 1169 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:30:11.877625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4d22dfc2-0a3d-453c-a924-2ef384abf239 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:30:11.878267 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4d22dfc2-0a3d-453c-a924-2ef384abf239 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 6fa50a78-eb03-4b1f-836a-23dff43b5bd6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:30:11.880276 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:30:11.880941 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:30:11.887831 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4d22dfc2-0a3d-453c-a924-2ef384abf239 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:11.888316 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4d22dfc2-0a3d-453c-a924-2ef384abf239 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:11.888774 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4d22dfc2-0a3d-453c-a924-2ef384abf239 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:11.889656 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4d22dfc2-0a3d-453c-a924-2ef384abf239 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:11.890114 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4d22dfc2-0a3d-453c-a924-2ef384abf239 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:11.890545 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4d22dfc2-0a3d-453c-a924-2ef384abf239 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:12.024768 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4d22dfc2-0a3d-453c-a924-2ef384abf239 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:30:12.033492 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4d22dfc2-0a3d-453c-a924-2ef384abf239 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6" status: 200 len: 1169 microversion: 2.1 time: 0.160060 Sep 10 12:30:12.035686 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3288/6569] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:30:11 2022] GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6 => generated 1169 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:30:13.057446 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-16380c39-d1ac-4909-8e12-84b78d1536d9 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:30:13.058089 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-16380c39-d1ac-4909-8e12-84b78d1536d9 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 6fa50a78-eb03-4b1f-836a-23dff43b5bd6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:30:13.065781 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-16380c39-d1ac-4909-8e12-84b78d1536d9 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:13.066271 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-16380c39-d1ac-4909-8e12-84b78d1536d9 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:13.066712 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-16380c39-d1ac-4909-8e12-84b78d1536d9 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:13.067447 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-16380c39-d1ac-4909-8e12-84b78d1536d9 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:13.067961 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-16380c39-d1ac-4909-8e12-84b78d1536d9 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:13.068390 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-16380c39-d1ac-4909-8e12-84b78d1536d9 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:13.204156 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-16380c39-d1ac-4909-8e12-84b78d1536d9 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:30:13.211992 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-16380c39-d1ac-4909-8e12-84b78d1536d9 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6" status: 200 len: 1169 microversion: 2.1 time: 0.158531 Sep 10 12:30:13.212598 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3282/6570] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:30:13 2022] GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6 => generated 1169 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:30:14.236260 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-54d674d7-0846-416a-9457-ab85faf7874f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:30:14.236879 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-54d674d7-0846-416a-9457-ab85faf7874f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 6fa50a78-eb03-4b1f-836a-23dff43b5bd6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:30:14.243786 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-54d674d7-0846-416a-9457-ab85faf7874f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:14.244271 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-54d674d7-0846-416a-9457-ab85faf7874f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:14.244708 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-54d674d7-0846-416a-9457-ab85faf7874f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:14.245400 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-54d674d7-0846-416a-9457-ab85faf7874f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:14.245858 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-54d674d7-0846-416a-9457-ab85faf7874f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:14.246287 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-54d674d7-0846-416a-9457-ab85faf7874f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:14.383012 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-54d674d7-0846-416a-9457-ab85faf7874f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:30:14.390965 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-54d674d7-0846-416a-9457-ab85faf7874f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6" status: 200 len: 1169 microversion: 2.1 time: 0.158713 Sep 10 12:30:14.392139 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3289/6571] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:30:14 2022] GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6 => generated 1169 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:30:15.414038 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-aa4c3ccd-eb52-4bdc-911b-e5627bd16a96 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:30:15.414745 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-aa4c3ccd-eb52-4bdc-911b-e5627bd16a96 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 6fa50a78-eb03-4b1f-836a-23dff43b5bd6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:30:15.422479 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa4c3ccd-eb52-4bdc-911b-e5627bd16a96 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:15.423072 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa4c3ccd-eb52-4bdc-911b-e5627bd16a96 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:15.424533 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa4c3ccd-eb52-4bdc-911b-e5627bd16a96 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:15.425255 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa4c3ccd-eb52-4bdc-911b-e5627bd16a96 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:15.425722 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa4c3ccd-eb52-4bdc-911b-e5627bd16a96 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:15.426282 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa4c3ccd-eb52-4bdc-911b-e5627bd16a96 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:15.569877 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-aa4c3ccd-eb52-4bdc-911b-e5627bd16a96 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:30:15.577759 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-aa4c3ccd-eb52-4bdc-911b-e5627bd16a96 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6" status: 200 len: 1215 microversion: 2.1 time: 0.167704 Sep 10 12:30:15.578531 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3283/6572] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:30:15 2022] GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6 => generated 1215 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:30:16.600458 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b1293420-a0fa-4fbf-ada8-3b31f7b7d649 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:30:16.601007 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b1293420-a0fa-4fbf-ada8-3b31f7b7d649 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 6fa50a78-eb03-4b1f-836a-23dff43b5bd6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:30:16.607895 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b1293420-a0fa-4fbf-ada8-3b31f7b7d649 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:16.609227 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b1293420-a0fa-4fbf-ada8-3b31f7b7d649 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:16.609714 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b1293420-a0fa-4fbf-ada8-3b31f7b7d649 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:16.610409 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b1293420-a0fa-4fbf-ada8-3b31f7b7d649 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:16.610870 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b1293420-a0fa-4fbf-ada8-3b31f7b7d649 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:16.611338 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b1293420-a0fa-4fbf-ada8-3b31f7b7d649 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:16.742854 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b1293420-a0fa-4fbf-ada8-3b31f7b7d649 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:30:16.751949 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b1293420-a0fa-4fbf-ada8-3b31f7b7d649 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6" status: 200 len: 1203 microversion: 2.1 time: 0.155412 Sep 10 12:30:16.753004 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3290/6573] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:30:16 2022] GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6 => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:30:17.776428 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-dd9fcf90-5a33-41ec-a8c2-6fd1c2e295e0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:30:17.777054 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-dd9fcf90-5a33-41ec-a8c2-6fd1c2e295e0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 6fa50a78-eb03-4b1f-836a-23dff43b5bd6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:30:17.784047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd9fcf90-5a33-41ec-a8c2-6fd1c2e295e0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:17.784529 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd9fcf90-5a33-41ec-a8c2-6fd1c2e295e0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:17.784967 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd9fcf90-5a33-41ec-a8c2-6fd1c2e295e0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:17.785658 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd9fcf90-5a33-41ec-a8c2-6fd1c2e295e0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:17.786143 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd9fcf90-5a33-41ec-a8c2-6fd1c2e295e0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:17.786572 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd9fcf90-5a33-41ec-a8c2-6fd1c2e295e0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:17.920003 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-dd9fcf90-5a33-41ec-a8c2-6fd1c2e295e0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:30:17.928335 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-dd9fcf90-5a33-41ec-a8c2-6fd1c2e295e0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6" status: 200 len: 1203 microversion: 2.1 time: 0.155829 Sep 10 12:30:17.928915 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3284/6574] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:30:17 2022] GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6 => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:30:18.950110 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d0fa1396-526d-4196-8568-44880008f5d2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:30:18.950754 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d0fa1396-526d-4196-8568-44880008f5d2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 6fa50a78-eb03-4b1f-836a-23dff43b5bd6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:30:18.958462 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d0fa1396-526d-4196-8568-44880008f5d2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:18.958970 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d0fa1396-526d-4196-8568-44880008f5d2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:18.959435 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d0fa1396-526d-4196-8568-44880008f5d2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:18.960121 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d0fa1396-526d-4196-8568-44880008f5d2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:18.960573 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d0fa1396-526d-4196-8568-44880008f5d2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:18.960993 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d0fa1396-526d-4196-8568-44880008f5d2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:19.356908 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d0fa1396-526d-4196-8568-44880008f5d2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:30:19.365069 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d0fa1396-526d-4196-8568-44880008f5d2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6" status: 200 len: 1203 microversion: 2.1 time: 0.418913 Sep 10 12:30:19.365899 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3291/6575] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:30:18 2022] GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6 => generated 1203 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:30:20.388530 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c1bde4ac-dfa1-4a17-bf80-c0ac8a5a62c3 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:30:20.389079 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c1bde4ac-dfa1-4a17-bf80-c0ac8a5a62c3 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 6fa50a78-eb03-4b1f-836a-23dff43b5bd6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:30:20.395978 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1bde4ac-dfa1-4a17-bf80-c0ac8a5a62c3 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:20.396457 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1bde4ac-dfa1-4a17-bf80-c0ac8a5a62c3 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:20.396885 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1bde4ac-dfa1-4a17-bf80-c0ac8a5a62c3 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:20.397566 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1bde4ac-dfa1-4a17-bf80-c0ac8a5a62c3 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:20.398017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1bde4ac-dfa1-4a17-bf80-c0ac8a5a62c3 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:20.398441 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1bde4ac-dfa1-4a17-bf80-c0ac8a5a62c3 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:20.530437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c1bde4ac-dfa1-4a17-bf80-c0ac8a5a62c3 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:30:20.538202 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c1bde4ac-dfa1-4a17-bf80-c0ac8a5a62c3 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6" status: 200 len: 1203 microversion: 2.1 time: 0.153621 Sep 10 12:30:20.538774 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3285/6576] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:30:20 2022] GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6 => generated 1203 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:30:21.561820 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b969e469-948c-401a-994c-5dc88e905da8 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:30:21.562345 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b969e469-948c-401a-994c-5dc88e905da8 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 6fa50a78-eb03-4b1f-836a-23dff43b5bd6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:30:21.569638 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b969e469-948c-401a-994c-5dc88e905da8 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:21.570122 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b969e469-948c-401a-994c-5dc88e905da8 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:21.570554 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b969e469-948c-401a-994c-5dc88e905da8 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:21.571270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b969e469-948c-401a-994c-5dc88e905da8 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:21.571728 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b969e469-948c-401a-994c-5dc88e905da8 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:21.572148 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b969e469-948c-401a-994c-5dc88e905da8 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:21.706949 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b969e469-948c-401a-994c-5dc88e905da8 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:30:21.714819 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b969e469-948c-401a-994c-5dc88e905da8 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6" status: 200 len: 1203 microversion: 2.1 time: 0.157598 Sep 10 12:30:21.715994 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3292/6577] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:30:21 2022] GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6 => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:30:22.739572 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7f2cbb30-a919-40fd-a1c0-e7a840029ae5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:30:22.740191 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7f2cbb30-a919-40fd-a1c0-e7a840029ae5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 6fa50a78-eb03-4b1f-836a-23dff43b5bd6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:30:22.748227 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f2cbb30-a919-40fd-a1c0-e7a840029ae5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:22.748891 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f2cbb30-a919-40fd-a1c0-e7a840029ae5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:22.749475 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f2cbb30-a919-40fd-a1c0-e7a840029ae5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:22.750171 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f2cbb30-a919-40fd-a1c0-e7a840029ae5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:22.750627 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f2cbb30-a919-40fd-a1c0-e7a840029ae5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:22.751053 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f2cbb30-a919-40fd-a1c0-e7a840029ae5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:22.879883 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7f2cbb30-a919-40fd-a1c0-e7a840029ae5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:30:22.887544 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7f2cbb30-a919-40fd-a1c0-e7a840029ae5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6" status: 200 len: 1203 microversion: 2.1 time: 0.152233 Sep 10 12:30:22.888127 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3286/6578] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:30:22 2022] GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6 => generated 1203 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:30:23.910631 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-72933962-bcaa-4716-8288-56f34f710148 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:30:23.911288 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-72933962-bcaa-4716-8288-56f34f710148 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 6fa50a78-eb03-4b1f-836a-23dff43b5bd6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:30:23.918245 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-72933962-bcaa-4716-8288-56f34f710148 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:23.918732 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-72933962-bcaa-4716-8288-56f34f710148 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:23.919193 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-72933962-bcaa-4716-8288-56f34f710148 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:23.919888 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-72933962-bcaa-4716-8288-56f34f710148 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:23.920854 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-72933962-bcaa-4716-8288-56f34f710148 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:23.921346 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-72933962-bcaa-4716-8288-56f34f710148 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:24.053612 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-72933962-bcaa-4716-8288-56f34f710148 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:30:24.061963 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-72933962-bcaa-4716-8288-56f34f710148 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6" status: 200 len: 1203 microversion: 2.1 time: 0.154843 Sep 10 12:30:24.062533 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3293/6579] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:30:23 2022] GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6 => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:30:25.085345 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8c1a6431-8343-48ea-a997-d90f49cd6659 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:30:25.085908 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8c1a6431-8343-48ea-a997-d90f49cd6659 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 6fa50a78-eb03-4b1f-836a-23dff43b5bd6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:30:25.093370 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c1a6431-8343-48ea-a997-d90f49cd6659 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:25.093856 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c1a6431-8343-48ea-a997-d90f49cd6659 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:25.094301 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c1a6431-8343-48ea-a997-d90f49cd6659 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:25.095005 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c1a6431-8343-48ea-a997-d90f49cd6659 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:25.095492 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c1a6431-8343-48ea-a997-d90f49cd6659 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:25.095934 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c1a6431-8343-48ea-a997-d90f49cd6659 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:25.234837 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8c1a6431-8343-48ea-a997-d90f49cd6659 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:30:25.246276 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8c1a6431-8343-48ea-a997-d90f49cd6659 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6" status: 200 len: 1203 microversion: 2.1 time: 0.164519 Sep 10 12:30:25.247449 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3287/6580] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:30:25 2022] GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6 => generated 1203 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:30:26.281734 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-63496874-b9c2-4e74-8b81-4d15fa29ed5e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:30:26.282347 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-63496874-b9c2-4e74-8b81-4d15fa29ed5e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 6fa50a78-eb03-4b1f-836a-23dff43b5bd6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:30:26.289924 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-63496874-b9c2-4e74-8b81-4d15fa29ed5e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:26.290412 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-63496874-b9c2-4e74-8b81-4d15fa29ed5e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:26.290850 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-63496874-b9c2-4e74-8b81-4d15fa29ed5e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:26.291564 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-63496874-b9c2-4e74-8b81-4d15fa29ed5e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:26.292024 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-63496874-b9c2-4e74-8b81-4d15fa29ed5e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:26.292452 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-63496874-b9c2-4e74-8b81-4d15fa29ed5e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:26.760626 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-63496874-b9c2-4e74-8b81-4d15fa29ed5e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:30:26.769797 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-63496874-b9c2-4e74-8b81-4d15fa29ed5e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6" status: 200 len: 1203 microversion: 2.1 time: 0.491790 Sep 10 12:30:26.770372 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3294/6581] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:30:26 2022] GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6 => generated 1203 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:30:27.328249 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-96647b97-55a5-4772-9912-e81ce0ac8e8c req-b829f36a-08b8-48bd-9989-e1b62d4b58cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fa50a78-eb03-4b1f-836a-23dff43b5bd6", "name": "network-vif-plugged", "status": "completed", "tag": "0ba6ad86-d501-44c7-9c56-79dce1be5aa2"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:30:27.338833 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-96647b97-55a5-4772-9912-e81ce0ac8e8c req-b829f36a-08b8-48bd-9989-e1b62d4b58cc service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:27.340365 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-96647b97-55a5-4772-9912-e81ce0ac8e8c req-b829f36a-08b8-48bd-9989-e1b62d4b58cc service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:27.340858 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-96647b97-55a5-4772-9912-e81ce0ac8e8c req-b829f36a-08b8-48bd-9989-e1b62d4b58cc service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:27.353218 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-96647b97-55a5-4772-9912-e81ce0ac8e8c req-b829f36a-08b8-48bd-9989-e1b62d4b58cc service nova] Creating event network-vif-plugged:0ba6ad86-d501-44c7-9c56-79dce1be5aa2 for instance 6fa50a78-eb03-4b1f-836a-23dff43b5bd6 on n-h1-856895-1 Sep 10 12:30:27.359679 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-96647b97-55a5-4772-9912-e81ce0ac8e8c req-b829f36a-08b8-48bd-9989-e1b62d4b58cc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033871 Sep 10 12:30:27.360315 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3288/6582] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:30:27.792567 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2a0096af-98fc-4c17-b073-b429d1fc2a85 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:30:27.793123 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2a0096af-98fc-4c17-b073-b429d1fc2a85 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 6fa50a78-eb03-4b1f-836a-23dff43b5bd6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:30:27.800098 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2a0096af-98fc-4c17-b073-b429d1fc2a85 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:27.800588 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2a0096af-98fc-4c17-b073-b429d1fc2a85 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:27.801038 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2a0096af-98fc-4c17-b073-b429d1fc2a85 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:27.801733 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2a0096af-98fc-4c17-b073-b429d1fc2a85 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:27.802193 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2a0096af-98fc-4c17-b073-b429d1fc2a85 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:27.802625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2a0096af-98fc-4c17-b073-b429d1fc2a85 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:27.933487 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2a0096af-98fc-4c17-b073-b429d1fc2a85 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:30:27.941442 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2a0096af-98fc-4c17-b073-b429d1fc2a85 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6" status: 200 len: 1203 microversion: 2.1 time: 0.152807 Sep 10 12:30:27.942019 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3295/6583] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:30:27 2022] GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6 => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:30:28.965158 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bbb5cba5-ca01-4c71-a7e4-4121d6903f44 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:30:28.965959 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bbb5cba5-ca01-4c71-a7e4-4121d6903f44 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 6fa50a78-eb03-4b1f-836a-23dff43b5bd6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:30:28.973411 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bbb5cba5-ca01-4c71-a7e4-4121d6903f44 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:28.973900 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bbb5cba5-ca01-4c71-a7e4-4121d6903f44 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:28.974341 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bbb5cba5-ca01-4c71-a7e4-4121d6903f44 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:28.975034 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bbb5cba5-ca01-4c71-a7e4-4121d6903f44 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:28.975523 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bbb5cba5-ca01-4c71-a7e4-4121d6903f44 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:28.975956 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bbb5cba5-ca01-4c71-a7e4-4121d6903f44 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:29.106383 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bbb5cba5-ca01-4c71-a7e4-4121d6903f44 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:30:29.114837 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bbb5cba5-ca01-4c71-a7e4-4121d6903f44 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6" status: 200 len: 1390 microversion: 2.1 time: 0.153944 Sep 10 12:30:29.115443 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3289/6584] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:30:28 2022] GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6 => generated 1390 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:30:29.138028 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7ccd12eb-35f5-4b0c-b456-84fd188e5f15 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:30:29.138656 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7ccd12eb-35f5-4b0c-b456-84fd188e5f15 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 6fa50a78-eb03-4b1f-836a-23dff43b5bd6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:30:29.146649 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7ccd12eb-35f5-4b0c-b456-84fd188e5f15 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:29.147131 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7ccd12eb-35f5-4b0c-b456-84fd188e5f15 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:29.147603 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7ccd12eb-35f5-4b0c-b456-84fd188e5f15 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:29.148299 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7ccd12eb-35f5-4b0c-b456-84fd188e5f15 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:29.148754 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7ccd12eb-35f5-4b0c-b456-84fd188e5f15 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:29.149184 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7ccd12eb-35f5-4b0c-b456-84fd188e5f15 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:29.277579 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7ccd12eb-35f5-4b0c-b456-84fd188e5f15 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:30:29.286108 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7ccd12eb-35f5-4b0c-b456-84fd188e5f15 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6" status: 200 len: 1390 microversion: 2.1 time: 0.151971 Sep 10 12:30:29.286685 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3296/6585] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:30:29 2022] GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6 => generated 1390 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:30:29.308230 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-013c0358-0130-4726-a3bd-419790fc9ed5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:30:29.308808 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-013c0358-0130-4726-a3bd-419790fc9ed5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 6fa50a78-eb03-4b1f-836a-23dff43b5bd6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:30:29.314853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-013c0358-0130-4726-a3bd-419790fc9ed5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:29.315374 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-013c0358-0130-4726-a3bd-419790fc9ed5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:29.315814 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-013c0358-0130-4726-a3bd-419790fc9ed5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:29.316509 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-013c0358-0130-4726-a3bd-419790fc9ed5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:29.316962 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-013c0358-0130-4726-a3bd-419790fc9ed5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:29.317391 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-013c0358-0130-4726-a3bd-419790fc9ed5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:29.449037 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-013c0358-0130-4726-a3bd-419790fc9ed5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:30:29.457302 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-013c0358-0130-4726-a3bd-419790fc9ed5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6" status: 200 len: 1390 microversion: 2.1 time: 0.153101 Sep 10 12:30:29.457883 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3290/6586] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:30:29 2022] GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6 => generated 1390 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:30:29.538879 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dcfc4508-f224-4b83-82ae-0f011f43f456 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:30:29.539404 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-dcfc4508-f224-4b83-82ae-0f011f43f456 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 6fa50a78-eb03-4b1f-836a-23dff43b5bd6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:30:29.541249 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:30:29.546898 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dcfc4508-f224-4b83-82ae-0f011f43f456 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:29.547404 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dcfc4508-f224-4b83-82ae-0f011f43f456 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:29.547847 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dcfc4508-f224-4b83-82ae-0f011f43f456 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:29.548532 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dcfc4508-f224-4b83-82ae-0f011f43f456 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:29.548990 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dcfc4508-f224-4b83-82ae-0f011f43f456 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:29.549417 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dcfc4508-f224-4b83-82ae-0f011f43f456 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:29.554013 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=83 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:30:29.577387 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-dcfc4508-f224-4b83-82ae-0f011f43f456 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 6fa50a78-eb03-4b1f-836a-23dff43b5bd6] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:30:29.652443 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-dcfc4508-f224-4b83-82ae-0f011f43f456 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6" status: 204 len: 0 microversion: 2.1 time: 0.117087 Sep 10 12:30:29.653089 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3297/6587] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:30:29 2022] DELETE /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:30:29.661904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2740bf95-935e-4fe7-8027-15932f470378 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:30:29.662526 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2740bf95-935e-4fe7-8027-15932f470378 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 6fa50a78-eb03-4b1f-836a-23dff43b5bd6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:30:29.668592 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2740bf95-935e-4fe7-8027-15932f470378 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:29.669084 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2740bf95-935e-4fe7-8027-15932f470378 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:29.669530 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2740bf95-935e-4fe7-8027-15932f470378 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:29.670988 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2740bf95-935e-4fe7-8027-15932f470378 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:29.671515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2740bf95-935e-4fe7-8027-15932f470378 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:29.671954 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2740bf95-935e-4fe7-8027-15932f470378 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:29.803753 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2740bf95-935e-4fe7-8027-15932f470378 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:30:29.812107 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2740bf95-935e-4fe7-8027-15932f470378 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6" status: 200 len: 1396 microversion: 2.1 time: 0.154096 Sep 10 12:30:29.812688 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3291/6588] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:30:29 2022] GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6 => generated 1396 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:30:30.837017 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bc1b27a2-05df-4ce1-8977-5ef41779441c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:30:30.837718 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bc1b27a2-05df-4ce1-8977-5ef41779441c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 6fa50a78-eb03-4b1f-836a-23dff43b5bd6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:30:30.845058 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc1b27a2-05df-4ce1-8977-5ef41779441c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:30.845536 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc1b27a2-05df-4ce1-8977-5ef41779441c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:30.845971 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc1b27a2-05df-4ce1-8977-5ef41779441c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:30.846656 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc1b27a2-05df-4ce1-8977-5ef41779441c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:30.847107 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc1b27a2-05df-4ce1-8977-5ef41779441c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:30.847559 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc1b27a2-05df-4ce1-8977-5ef41779441c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:30.986845 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bc1b27a2-05df-4ce1-8977-5ef41779441c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:30:30.995362 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bc1b27a2-05df-4ce1-8977-5ef41779441c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6" status: 200 len: 1396 microversion: 2.1 time: 0.162501 Sep 10 12:30:30.995973 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3298/6589] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:30:30 2022] GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6 => generated 1396 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:30:31.859099 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-19fcdcf8-1696-456b-898b-8ed972997f86 req-0ac716d6-c268-46c8-b00a-41e605c32ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fa50a78-eb03-4b1f-836a-23dff43b5bd6", "name": "network-vif-deleted", "tag": "0ba6ad86-d501-44c7-9c56-79dce1be5aa2"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:30:31.867974 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=35 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:30:31.889964 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-19fcdcf8-1696-456b-898b-8ed972997f86 req-0ac716d6-c268-46c8-b00a-41e605c32ae2 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:31.890705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-19fcdcf8-1696-456b-898b-8ed972997f86 req-0ac716d6-c268-46c8-b00a-41e605c32ae2 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:31.891722 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-19fcdcf8-1696-456b-898b-8ed972997f86 req-0ac716d6-c268-46c8-b00a-41e605c32ae2 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:31.898114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=87 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:30:31.910144 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-19fcdcf8-1696-456b-898b-8ed972997f86 req-0ac716d6-c268-46c8-b00a-41e605c32ae2 service nova] Creating event network-vif-deleted:0ba6ad86-d501-44c7-9c56-79dce1be5aa2 for instance 6fa50a78-eb03-4b1f-836a-23dff43b5bd6 on n-h1-856895-1 Sep 10 12:30:31.915653 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-19fcdcf8-1696-456b-898b-8ed972997f86 req-0ac716d6-c268-46c8-b00a-41e605c32ae2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060929 Sep 10 12:30:31.916608 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3292/6590] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:30:32.025762 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-41cba92f-c65f-40e5-8641-396b470c7d46 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:30:32.026510 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-41cba92f-c65f-40e5-8641-396b470c7d46 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 6fa50a78-eb03-4b1f-836a-23dff43b5bd6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:30:32.035481 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41cba92f-c65f-40e5-8641-396b470c7d46 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:32.036083 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41cba92f-c65f-40e5-8641-396b470c7d46 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:32.036602 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41cba92f-c65f-40e5-8641-396b470c7d46 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:32.037404 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41cba92f-c65f-40e5-8641-396b470c7d46 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:32.037946 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41cba92f-c65f-40e5-8641-396b470c7d46 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:32.038437 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41cba92f-c65f-40e5-8641-396b470c7d46 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:32.113475 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-41cba92f-c65f-40e5-8641-396b470c7d46 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:30:32.124203 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-41cba92f-c65f-40e5-8641-396b470c7d46 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6" status: 200 len: 1188 microversion: 2.1 time: 0.107360 Sep 10 12:30:32.124893 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3299/6591] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:30:32 2022] GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6 => generated 1188 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:30:33.149150 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6572ee65-eef4-4576-b30f-f5ca0437e82b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:30:33.149865 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6572ee65-eef4-4576-b30f-f5ca0437e82b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 6fa50a78-eb03-4b1f-836a-23dff43b5bd6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:30:33.156878 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6572ee65-eef4-4576-b30f-f5ca0437e82b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:33.157368 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6572ee65-eef4-4576-b30f-f5ca0437e82b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:33.157830 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6572ee65-eef4-4576-b30f-f5ca0437e82b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:33.158706 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6572ee65-eef4-4576-b30f-f5ca0437e82b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:33.159202 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6572ee65-eef4-4576-b30f-f5ca0437e82b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:33.159625 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6572ee65-eef4-4576-b30f-f5ca0437e82b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:33.224001 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6572ee65-eef4-4576-b30f-f5ca0437e82b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:30:33.232711 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6572ee65-eef4-4576-b30f-f5ca0437e82b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6" status: 200 len: 1188 microversion: 2.1 time: 0.087837 Sep 10 12:30:33.233492 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3293/6592] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:30:33 2022] GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6 => generated 1188 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:30:34.256470 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-27f4e2a8-897a-4ced-aa3e-ecaf432a240d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:30:34.257261 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-27f4e2a8-897a-4ced-aa3e-ecaf432a240d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 6fa50a78-eb03-4b1f-836a-23dff43b5bd6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:30:34.264995 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27f4e2a8-897a-4ced-aa3e-ecaf432a240d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:34.265483 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27f4e2a8-897a-4ced-aa3e-ecaf432a240d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:34.265928 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27f4e2a8-897a-4ced-aa3e-ecaf432a240d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:34.266637 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27f4e2a8-897a-4ced-aa3e-ecaf432a240d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:34.267283 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27f4e2a8-897a-4ced-aa3e-ecaf432a240d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:34.267712 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27f4e2a8-897a-4ced-aa3e-ecaf432a240d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:34.332718 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-27f4e2a8-897a-4ced-aa3e-ecaf432a240d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:30:34.340867 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-27f4e2a8-897a-4ced-aa3e-ecaf432a240d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6" status: 200 len: 1188 microversion: 2.1 time: 0.088449 Sep 10 12:30:34.341443 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3300/6593] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:30:34 2022] GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6 => generated 1188 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:30:35.364899 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-184a80e4-ebd6-4060-9449-2b15c87b6bb7 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:30:35.365420 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-184a80e4-ebd6-4060-9449-2b15c87b6bb7 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 6fa50a78-eb03-4b1f-836a-23dff43b5bd6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:30:35.372597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-184a80e4-ebd6-4060-9449-2b15c87b6bb7 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:35.373834 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-184a80e4-ebd6-4060-9449-2b15c87b6bb7 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:35.374331 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-184a80e4-ebd6-4060-9449-2b15c87b6bb7 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:35.375005 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-184a80e4-ebd6-4060-9449-2b15c87b6bb7 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:35.375488 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-184a80e4-ebd6-4060-9449-2b15c87b6bb7 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:35.375922 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-184a80e4-ebd6-4060-9449-2b15c87b6bb7 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:35.438797 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-184a80e4-ebd6-4060-9449-2b15c87b6bb7 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:30:35.446662 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-184a80e4-ebd6-4060-9449-2b15c87b6bb7 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6" status: 200 len: 1188 microversion: 2.1 time: 0.085800 Sep 10 12:30:35.447292 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3294/6594] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:30:35 2022] GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6 => generated 1188 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:30:36.470804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0b063ce2-78fd-4fe9-a677-9c5a1e9c6979 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:30:36.472421 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0b063ce2-78fd-4fe9-a677-9c5a1e9c6979 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 6fa50a78-eb03-4b1f-836a-23dff43b5bd6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:30:36.479981 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0b063ce2-78fd-4fe9-a677-9c5a1e9c6979 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:36.480555 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0b063ce2-78fd-4fe9-a677-9c5a1e9c6979 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:36.481229 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0b063ce2-78fd-4fe9-a677-9c5a1e9c6979 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:36.482147 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0b063ce2-78fd-4fe9-a677-9c5a1e9c6979 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:36.483242 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0b063ce2-78fd-4fe9-a677-9c5a1e9c6979 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:36.483966 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0b063ce2-78fd-4fe9-a677-9c5a1e9c6979 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:36.522275 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0b063ce2-78fd-4fe9-a677-9c5a1e9c6979 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:36.523091 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0b063ce2-78fd-4fe9-a677-9c5a1e9c6979 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:36.523394 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0b063ce2-78fd-4fe9-a677-9c5a1e9c6979 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:36.523944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-0b063ce2-78fd-4fe9-a677-9c5a1e9c6979 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lazy-loading 'fault' on Instance uuid 6fa50a78-eb03-4b1f-836a-23dff43b5bd6 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:30:36.571107 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0b063ce2-78fd-4fe9-a677-9c5a1e9c6979 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:30:36.579735 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0b063ce2-78fd-4fe9-a677-9c5a1e9c6979 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6" status: 200 len: 1147 microversion: 2.1 time: 0.113714 Sep 10 12:30:36.580423 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3301/6595] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:30:36 2022] GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6 => generated 1147 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:30:37.603047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-29d2d8a4-9219-4fc8-8a3a-2450dbd019bb tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:30:37.603691 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-29d2d8a4-9219-4fc8-8a3a-2450dbd019bb tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 6fa50a78-eb03-4b1f-836a-23dff43b5bd6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:30:37.611473 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29d2d8a4-9219-4fc8-8a3a-2450dbd019bb tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:37.611947 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29d2d8a4-9219-4fc8-8a3a-2450dbd019bb tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:37.612392 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29d2d8a4-9219-4fc8-8a3a-2450dbd019bb tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:37.613149 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29d2d8a4-9219-4fc8-8a3a-2450dbd019bb tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:37.613607 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29d2d8a4-9219-4fc8-8a3a-2450dbd019bb tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:37.614038 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-29d2d8a4-9219-4fc8-8a3a-2450dbd019bb tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:37.628576 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-29d2d8a4-9219-4fc8-8a3a-2450dbd019bb tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] HTTP exception thrown: Instance 6fa50a78-eb03-4b1f-836a-23dff43b5bd6 could not be found. Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-29d2d8a4-9219-4fc8-8a3a-2450dbd019bb tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Request method failure captured: Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6 HTTP/1.1 Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHILszP5bh-7vS5nFlniigSPwJSgl9gRBzD28JMJ3uXj7KaJ7IKD0MoPbGUyk7NiR2g3O-OhOoEJg5Mrgl8pVom5QsCHuzRwflIP07SHDWyP4-s7StMch63ybX3LIelpp866T-_UOtQoKy1YDkCCnydW84pCURv3Zlf7uIJ_dXgYsc64 Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: e27276f18d8045e2a9be7a6c5ed892f7 Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e27276f18d8045e2a9be7a6c5ed892f7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: e27276f18d8045e2a9be7a6c5ed892f7 Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-TestVolumeBootPattern-1940983644-project Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 5f0b168293f943389d72753009c88789 Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-TestVolumeBootPattern-1940983644-project Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 6fa50a78-eb03-4b1f-836a-23dff43b5bd6 could not be found. Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '6fa50a78-eb03-4b1f-836a-23dff43b5bd6'} Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fa50a78-eb03-4b1f-836a-23dff43b5bd6 could not be found. Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fa50a78-eb03-4b1f-836a-23dff43b5bd6 could not be found. Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:30:37.630221 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:30:37.633646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:30:37.633646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:30:37.633646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:30:37.633646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:30:37.633646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:30:37.633646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fa50a78-eb03-4b1f-836a-23dff43b5bd6 could not be found. Sep 10 12:30:37.633646 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:30:37.633646 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-29d2d8a4-9219-4fc8-8a3a-2450dbd019bb tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Returning 404 to user: Instance 6fa50a78-eb03-4b1f-836a-23dff43b5bd6 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:30:37.633646 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-29d2d8a4-9219-4fc8-8a3a-2450dbd019bb tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6" status: 404 len: 111 microversion: 2.1 time: 0.032550 Sep 10 12:30:37.633646 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3295/6596] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:30:37 2022] GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:30:38.720430 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8fcbd727-d935-49f0-bc0c-bcc60f9487c0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:30:38.720802 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8fcbd727-d935-49f0-bc0c-bcc60f9487c0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 6fa50a78-eb03-4b1f-836a-23dff43b5bd6] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:30:38.728866 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8fcbd727-d935-49f0-bc0c-bcc60f9487c0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:38.729719 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8fcbd727-d935-49f0-bc0c-bcc60f9487c0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:38.730513 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8fcbd727-d935-49f0-bc0c-bcc60f9487c0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:38.731418 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8fcbd727-d935-49f0-bc0c-bcc60f9487c0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:38.731878 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8fcbd727-d935-49f0-bc0c-bcc60f9487c0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:38.732311 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8fcbd727-d935-49f0-bc0c-bcc60f9487c0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:38.746727 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-8fcbd727-d935-49f0-bc0c-bcc60f9487c0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] HTTP exception thrown: Instance 6fa50a78-eb03-4b1f-836a-23dff43b5bd6 could not be found. Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8fcbd727-d935-49f0-bc0c-bcc60f9487c0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Request method failure captured: Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6 HTTP/1.1 Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHILszP5bh-7vS5nFlniigSPwJSgl9gRBzD28JMJ3uXj7KaJ7IKD0MoPbGUyk7NiR2g3O-OhOoEJg5Mrgl8pVom5QsCHuzRwflIP07SHDWyP4-s7StMch63ybX3LIelpp866T-_UOtQoKy1YDkCCnydW84pCURv3Zlf7uIJ_dXgYsc64 Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: e27276f18d8045e2a9be7a6c5ed892f7 Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e27276f18d8045e2a9be7a6c5ed892f7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: e27276f18d8045e2a9be7a6c5ed892f7 Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-TestVolumeBootPattern-1940983644-project Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 5f0b168293f943389d72753009c88789 Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-TestVolumeBootPattern-1940983644-project Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 6fa50a78-eb03-4b1f-836a-23dff43b5bd6 could not be found. Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '6fa50a78-eb03-4b1f-836a-23dff43b5bd6'} Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fa50a78-eb03-4b1f-836a-23dff43b5bd6 could not be found. Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:30:38.749011 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:30:38.752566 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fa50a78-eb03-4b1f-836a-23dff43b5bd6 could not be found. Sep 10 12:30:38.752566 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:30:38.752566 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:30:38.752566 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:30:38.752566 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:30:38.752566 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:30:38.752566 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:30:38.752566 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:30:38.752566 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:30:38.752566 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fa50a78-eb03-4b1f-836a-23dff43b5bd6 could not be found. Sep 10 12:30:38.752566 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:30:38.752566 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8fcbd727-d935-49f0-bc0c-bcc60f9487c0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Returning 404 to user: Instance 6fa50a78-eb03-4b1f-836a-23dff43b5bd6 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:30:38.752566 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8fcbd727-d935-49f0-bc0c-bcc60f9487c0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6" status: 404 len: 111 microversion: 2.1 time: 0.034958 Sep 10 12:30:38.752566 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3302/6597] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:30:38 2022] DELETE /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:30:38.759275 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-968132d5-ea98-4adc-b265-a08bdc7fc18b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:30:38.759976 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-968132d5-ea98-4adc-b265-a08bdc7fc18b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 6fa50a78-eb03-4b1f-836a-23dff43b5bd6] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:30:38.768065 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-968132d5-ea98-4adc-b265-a08bdc7fc18b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:38.768623 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-968132d5-ea98-4adc-b265-a08bdc7fc18b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:38.769134 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-968132d5-ea98-4adc-b265-a08bdc7fc18b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:38.769889 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-968132d5-ea98-4adc-b265-a08bdc7fc18b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:38.770429 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-968132d5-ea98-4adc-b265-a08bdc7fc18b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:38.770920 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-968132d5-ea98-4adc-b265-a08bdc7fc18b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:38.787783 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-968132d5-ea98-4adc-b265-a08bdc7fc18b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] HTTP exception thrown: Instance 6fa50a78-eb03-4b1f-836a-23dff43b5bd6 could not be found. Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-968132d5-ea98-4adc-b265-a08bdc7fc18b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Request method failure captured: Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6 HTTP/1.1 Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHILszP5bh-7vS5nFlniigSPwJSgl9gRBzD28JMJ3uXj7KaJ7IKD0MoPbGUyk7NiR2g3O-OhOoEJg5Mrgl8pVom5QsCHuzRwflIP07SHDWyP4-s7StMch63ybX3LIelpp866T-_UOtQoKy1YDkCCnydW84pCURv3Zlf7uIJ_dXgYsc64 Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: e27276f18d8045e2a9be7a6c5ed892f7 Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e27276f18d8045e2a9be7a6c5ed892f7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: e27276f18d8045e2a9be7a6c5ed892f7 Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-TestVolumeBootPattern-1940983644-project Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 5f0b168293f943389d72753009c88789 Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-TestVolumeBootPattern-1940983644-project Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 6fa50a78-eb03-4b1f-836a-23dff43b5bd6 could not be found. Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '6fa50a78-eb03-4b1f-836a-23dff43b5bd6'} Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fa50a78-eb03-4b1f-836a-23dff43b5bd6 could not be found. Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fa50a78-eb03-4b1f-836a-23dff43b5bd6 could not be found. Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:30:38.789333 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:30:38.792986 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:30:38.792986 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:30:38.792986 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:30:38.792986 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:30:38.792986 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:30:38.792986 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fa50a78-eb03-4b1f-836a-23dff43b5bd6 could not be found. Sep 10 12:30:38.792986 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:30:38.792986 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-968132d5-ea98-4adc-b265-a08bdc7fc18b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Returning 404 to user: Instance 6fa50a78-eb03-4b1f-836a-23dff43b5bd6 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:30:38.792986 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-968132d5-ea98-4adc-b265-a08bdc7fc18b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6" status: 404 len: 111 microversion: 2.1 time: 0.035550 Sep 10 12:30:38.792986 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3296/6598] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:30:38 2022] GET /compute/v2.1/servers/6fa50a78-eb03-4b1f-836a-23dff43b5bd6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:30:58.466524 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f6db02ed-c201-4385-823b-11f50d9a42f2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-503138785", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "bf8b0ee9-1362-4534-a2e8-30cd539c0518", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "63bc1cec-19c3-45db-83f8-21772e061ea1"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:30:58.479709 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:30:58.480119 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:30:58.534348 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-f6db02ed-c201-4385-823b-11f50d9a42f2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] validate_networks() for [('63bc1cec-19c3-45db-83f8-21772e061ea1', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:30:58.906347 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-f6db02ed-c201-4385-823b-11f50d9a42f2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:30:58.906772 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-f6db02ed-c201-4385-823b-11f50d9a42f2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:30:58.907284 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-f6db02ed-c201-4385-823b-11f50d9a42f2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:30:58.907701 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-f6db02ed-c201-4385-823b-11f50d9a42f2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:30:58.908117 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-f6db02ed-c201-4385-823b-11f50d9a42f2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:30:58.916909 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f6db02ed-c201-4385-823b-11f50d9a42f2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:58.917388 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f6db02ed-c201-4385-823b-11f50d9a42f2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:58.917826 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f6db02ed-c201-4385-823b-11f50d9a42f2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:58.918549 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f6db02ed-c201-4385-823b-11f50d9a42f2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:30:58.919033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f6db02ed-c201-4385-823b-11f50d9a42f2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:30:58.919488 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f6db02ed-c201-4385-823b-11f50d9a42f2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:30:58.935970 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-f6db02ed-c201-4385-823b-11f50d9a42f2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Getting quotas for project e27276f18d8045e2a9be7a6c5ed892f7. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:30:58.941862 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-f6db02ed-c201-4385-823b-11f50d9a42f2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Getting quotas for user 5f0b168293f943389d72753009c88789 and project e27276f18d8045e2a9be7a6c5ed892f7. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:30:58.999580 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f6db02ed-c201-4385-823b-11f50d9a42f2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:30:59.001653 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f6db02ed-c201-4385-823b-11f50d9a42f2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 1372b1e6-f6cd-42e5-9100-80c7f087ee57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bf8b0ee9-1362-4534-a2e8-30cd539c0518',volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:30:59.134042 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f6db02ed-c201-4385-823b-11f50d9a42f2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.671421 Sep 10 12:30:59.134713 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3303/6599] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:30:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:30:59.146435 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-074b50d1-a28a-41f4-a491-849a51e3133c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:30:59.147138 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-074b50d1-a28a-41f4-a491-849a51e3133c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 1372b1e6-f6cd-42e5-9100-80c7f087ee57] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:30:59.149969 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=9 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:30:59.150630 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=17 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:30:59.204007 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-074b50d1-a28a-41f4-a491-849a51e3133c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:30:59.210867 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-074b50d1-a28a-41f4-a491-849a51e3133c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57" status: 200 len: 1070 microversion: 2.1 time: 0.068308 Sep 10 12:30:59.220004 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3297/6600] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:30:59 2022] GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57 => generated 1070 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:31:00.233865 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c9eed267-7ef0-4a1d-b8a7-da2aaa574547 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:00.235111 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c9eed267-7ef0-4a1d-b8a7-da2aaa574547 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 1372b1e6-f6cd-42e5-9100-80c7f087ee57] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:00.242674 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9eed267-7ef0-4a1d-b8a7-da2aaa574547 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:00.243194 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9eed267-7ef0-4a1d-b8a7-da2aaa574547 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:00.243840 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9eed267-7ef0-4a1d-b8a7-da2aaa574547 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:00.244555 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9eed267-7ef0-4a1d-b8a7-da2aaa574547 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:00.245019 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9eed267-7ef0-4a1d-b8a7-da2aaa574547 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:00.245667 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9eed267-7ef0-4a1d-b8a7-da2aaa574547 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:00.329944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c9eed267-7ef0-4a1d-b8a7-da2aaa574547 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:00.339466 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c9eed267-7ef0-4a1d-b8a7-da2aaa574547 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57" status: 200 len: 1186 microversion: 2.1 time: 0.109616 Sep 10 12:31:00.340226 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3304/6601] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:00 2022] GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57 => generated 1186 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:31:01.362679 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-dcf98d8f-d358-479b-915a-1de92f3274cc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:01.363452 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-dcf98d8f-d358-479b-915a-1de92f3274cc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 1372b1e6-f6cd-42e5-9100-80c7f087ee57] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:01.370964 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dcf98d8f-d358-479b-915a-1de92f3274cc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:01.371709 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dcf98d8f-d358-479b-915a-1de92f3274cc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:01.372146 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dcf98d8f-d358-479b-915a-1de92f3274cc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:01.373103 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dcf98d8f-d358-479b-915a-1de92f3274cc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:01.373868 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dcf98d8f-d358-479b-915a-1de92f3274cc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:01.374668 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dcf98d8f-d358-479b-915a-1de92f3274cc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:01.596403 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-dcf98d8f-d358-479b-915a-1de92f3274cc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:01.604561 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-dcf98d8f-d358-479b-915a-1de92f3274cc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57" status: 200 len: 1228 microversion: 2.1 time: 0.246501 Sep 10 12:31:01.605246 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3298/6602] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:01 2022] GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57 => generated 1228 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:31:01.678258 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-42326e84-290e-4524-b75d-8fe8df9312f6 req-82437dda-9e2b-439b-b2e2-196230503042 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1372b1e6-f6cd-42e5-9100-80c7f087ee57", "tag": "da4923ab-b3ce-48d3-8910-6afc5fd1eea9"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:31:01.689485 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-42326e84-290e-4524-b75d-8fe8df9312f6 req-82437dda-9e2b-439b-b2e2-196230503042 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:01.690334 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-42326e84-290e-4524-b75d-8fe8df9312f6 req-82437dda-9e2b-439b-b2e2-196230503042 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:01.691516 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-42326e84-290e-4524-b75d-8fe8df9312f6 req-82437dda-9e2b-439b-b2e2-196230503042 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:01.705207 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-42326e84-290e-4524-b75d-8fe8df9312f6 req-82437dda-9e2b-439b-b2e2-196230503042 service nova] Creating event network-changed:da4923ab-b3ce-48d3-8910-6afc5fd1eea9 for instance 1372b1e6-f6cd-42e5-9100-80c7f087ee57 on n-h1-856895-1 Sep 10 12:31:01.711462 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-42326e84-290e-4524-b75d-8fe8df9312f6 req-82437dda-9e2b-439b-b2e2-196230503042 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036894 Sep 10 12:31:01.712413 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3305/6603] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:31:02.628785 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5017757b-983e-4711-b18d-bce86f781a2f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:02.629410 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5017757b-983e-4711-b18d-bce86f781a2f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 1372b1e6-f6cd-42e5-9100-80c7f087ee57] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:02.636090 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5017757b-983e-4711-b18d-bce86f781a2f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:02.636515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5017757b-983e-4711-b18d-bce86f781a2f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:02.636961 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5017757b-983e-4711-b18d-bce86f781a2f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:02.637657 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5017757b-983e-4711-b18d-bce86f781a2f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:02.638279 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5017757b-983e-4711-b18d-bce86f781a2f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:02.638717 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5017757b-983e-4711-b18d-bce86f781a2f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:02.782519 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5017757b-983e-4711-b18d-bce86f781a2f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:02.790372 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5017757b-983e-4711-b18d-bce86f781a2f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57" status: 200 len: 1228 microversion: 2.1 time: 0.165756 Sep 10 12:31:02.790964 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3299/6604] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:02 2022] GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57 => generated 1228 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:31:03.816453 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e3060ecb-afe4-4319-a4c6-f4c239f06e50 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:03.817066 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e3060ecb-afe4-4319-a4c6-f4c239f06e50 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 1372b1e6-f6cd-42e5-9100-80c7f087ee57] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:03.824687 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e3060ecb-afe4-4319-a4c6-f4c239f06e50 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:03.825172 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e3060ecb-afe4-4319-a4c6-f4c239f06e50 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:03.825610 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e3060ecb-afe4-4319-a4c6-f4c239f06e50 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:03.826309 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e3060ecb-afe4-4319-a4c6-f4c239f06e50 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:03.827339 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e3060ecb-afe4-4319-a4c6-f4c239f06e50 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:03.827771 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e3060ecb-afe4-4319-a4c6-f4c239f06e50 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:03.964271 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e3060ecb-afe4-4319-a4c6-f4c239f06e50 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:03.972808 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e3060ecb-afe4-4319-a4c6-f4c239f06e50 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57" status: 200 len: 1228 microversion: 2.1 time: 0.162538 Sep 10 12:31:03.973386 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3306/6605] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:03 2022] GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57 => generated 1228 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:31:04.996172 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c273152d-7d9c-4da1-aeb3-d03b127fbe5a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:04.997073 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c273152d-7d9c-4da1-aeb3-d03b127fbe5a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 1372b1e6-f6cd-42e5-9100-80c7f087ee57] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:05.005010 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c273152d-7d9c-4da1-aeb3-d03b127fbe5a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:05.005502 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c273152d-7d9c-4da1-aeb3-d03b127fbe5a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:05.005939 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c273152d-7d9c-4da1-aeb3-d03b127fbe5a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:05.006641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c273152d-7d9c-4da1-aeb3-d03b127fbe5a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:05.007101 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c273152d-7d9c-4da1-aeb3-d03b127fbe5a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:05.007555 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c273152d-7d9c-4da1-aeb3-d03b127fbe5a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:05.147097 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c273152d-7d9c-4da1-aeb3-d03b127fbe5a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:05.156321 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c273152d-7d9c-4da1-aeb3-d03b127fbe5a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57" status: 200 len: 1228 microversion: 2.1 time: 0.163738 Sep 10 12:31:05.156962 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3300/6606] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:04 2022] GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57 => generated 1228 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:31:06.179624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a17ca2f1-1430-4b12-98e2-4d6daaf17670 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:06.180251 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a17ca2f1-1430-4b12-98e2-4d6daaf17670 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 1372b1e6-f6cd-42e5-9100-80c7f087ee57] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:06.187866 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a17ca2f1-1430-4b12-98e2-4d6daaf17670 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:06.188354 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a17ca2f1-1430-4b12-98e2-4d6daaf17670 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:06.188789 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a17ca2f1-1430-4b12-98e2-4d6daaf17670 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:06.189482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a17ca2f1-1430-4b12-98e2-4d6daaf17670 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:06.189937 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a17ca2f1-1430-4b12-98e2-4d6daaf17670 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:06.190366 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a17ca2f1-1430-4b12-98e2-4d6daaf17670 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:06.317139 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a17ca2f1-1430-4b12-98e2-4d6daaf17670 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:06.324869 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a17ca2f1-1430-4b12-98e2-4d6daaf17670 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57" status: 200 len: 1216 microversion: 2.1 time: 0.149143 Sep 10 12:31:06.325441 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3307/6607] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:06 2022] GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57 => generated 1216 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:31:07.348167 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ed9161ff-f16c-454e-a5be-9d7aaabe9db7 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:07.348813 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ed9161ff-f16c-454e-a5be-9d7aaabe9db7 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 1372b1e6-f6cd-42e5-9100-80c7f087ee57] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:07.355664 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ed9161ff-f16c-454e-a5be-9d7aaabe9db7 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:07.356149 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ed9161ff-f16c-454e-a5be-9d7aaabe9db7 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:07.356588 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ed9161ff-f16c-454e-a5be-9d7aaabe9db7 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:07.357276 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ed9161ff-f16c-454e-a5be-9d7aaabe9db7 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:07.357733 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ed9161ff-f16c-454e-a5be-9d7aaabe9db7 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:07.358667 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ed9161ff-f16c-454e-a5be-9d7aaabe9db7 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:07.488678 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ed9161ff-f16c-454e-a5be-9d7aaabe9db7 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:07.496860 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ed9161ff-f16c-454e-a5be-9d7aaabe9db7 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57" status: 200 len: 1216 microversion: 2.1 time: 0.152579 Sep 10 12:31:07.497440 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3301/6608] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:07 2022] GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57 => generated 1216 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:31:08.520960 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e8751f4b-4aec-41d0-8cff-313c533e015c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:08.521576 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e8751f4b-4aec-41d0-8cff-313c533e015c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 1372b1e6-f6cd-42e5-9100-80c7f087ee57] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:08.528419 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e8751f4b-4aec-41d0-8cff-313c533e015c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:08.528907 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e8751f4b-4aec-41d0-8cff-313c533e015c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:08.529400 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e8751f4b-4aec-41d0-8cff-313c533e015c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:08.530130 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e8751f4b-4aec-41d0-8cff-313c533e015c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:08.530578 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e8751f4b-4aec-41d0-8cff-313c533e015c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:08.531010 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e8751f4b-4aec-41d0-8cff-313c533e015c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:08.663306 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e8751f4b-4aec-41d0-8cff-313c533e015c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:08.671236 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e8751f4b-4aec-41d0-8cff-313c533e015c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57" status: 200 len: 1216 microversion: 2.1 time: 0.153962 Sep 10 12:31:08.671803 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3308/6609] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:08 2022] GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57 => generated 1216 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:31:09.694667 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-46ab30cd-b399-4a91-91ee-955759dca04e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:09.695312 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-46ab30cd-b399-4a91-91ee-955759dca04e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 1372b1e6-f6cd-42e5-9100-80c7f087ee57] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:09.698054 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:31:09.704009 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46ab30cd-b399-4a91-91ee-955759dca04e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:09.704496 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46ab30cd-b399-4a91-91ee-955759dca04e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:09.704935 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46ab30cd-b399-4a91-91ee-955759dca04e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:09.705664 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46ab30cd-b399-4a91-91ee-955759dca04e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:09.706123 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46ab30cd-b399-4a91-91ee-955759dca04e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:09.706552 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-46ab30cd-b399-4a91-91ee-955759dca04e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:09.838716 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-46ab30cd-b399-4a91-91ee-955759dca04e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:09.847463 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-46ab30cd-b399-4a91-91ee-955759dca04e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57" status: 200 len: 1216 microversion: 2.1 time: 0.156690 Sep 10 12:31:09.848051 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3302/6610] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:09 2022] GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57 => generated 1216 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:31:10.870934 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c8f569f2-2401-4e71-8b8b-825b7698b345 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:10.871577 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c8f569f2-2401-4e71-8b8b-825b7698b345 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 1372b1e6-f6cd-42e5-9100-80c7f087ee57] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:10.874114 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:31:10.874788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:31:10.881973 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c8f569f2-2401-4e71-8b8b-825b7698b345 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:10.882457 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c8f569f2-2401-4e71-8b8b-825b7698b345 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:10.882892 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c8f569f2-2401-4e71-8b8b-825b7698b345 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:10.883616 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c8f569f2-2401-4e71-8b8b-825b7698b345 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:10.884069 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c8f569f2-2401-4e71-8b8b-825b7698b345 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:10.884497 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c8f569f2-2401-4e71-8b8b-825b7698b345 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:11.021513 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c8f569f2-2401-4e71-8b8b-825b7698b345 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:11.029243 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c8f569f2-2401-4e71-8b8b-825b7698b345 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57" status: 200 len: 1216 microversion: 2.1 time: 0.162241 Sep 10 12:31:11.030392 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3309/6611] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:10 2022] GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57 => generated 1216 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:31:12.052923 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b9b05784-0fd3-4280-b031-62acc4f0ea50 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:12.053543 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b9b05784-0fd3-4280-b031-62acc4f0ea50 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 1372b1e6-f6cd-42e5-9100-80c7f087ee57] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:12.060060 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9b05784-0fd3-4280-b031-62acc4f0ea50 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:12.060543 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9b05784-0fd3-4280-b031-62acc4f0ea50 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:12.061818 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9b05784-0fd3-4280-b031-62acc4f0ea50 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:12.062521 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9b05784-0fd3-4280-b031-62acc4f0ea50 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:12.062980 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9b05784-0fd3-4280-b031-62acc4f0ea50 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:12.063440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9b05784-0fd3-4280-b031-62acc4f0ea50 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:12.194586 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b9b05784-0fd3-4280-b031-62acc4f0ea50 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:12.202430 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b9b05784-0fd3-4280-b031-62acc4f0ea50 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57" status: 200 len: 1216 microversion: 2.1 time: 0.153798 Sep 10 12:31:12.203014 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3303/6612] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:12 2022] GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57 => generated 1216 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:31:13.225032 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c6f02c64-617d-4336-93d1-3223ed0003a7 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:13.225716 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c6f02c64-617d-4336-93d1-3223ed0003a7 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 1372b1e6-f6cd-42e5-9100-80c7f087ee57] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:13.232562 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c6f02c64-617d-4336-93d1-3223ed0003a7 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:13.233301 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c6f02c64-617d-4336-93d1-3223ed0003a7 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:13.233861 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c6f02c64-617d-4336-93d1-3223ed0003a7 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:13.234761 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c6f02c64-617d-4336-93d1-3223ed0003a7 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:13.235310 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c6f02c64-617d-4336-93d1-3223ed0003a7 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:13.235795 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c6f02c64-617d-4336-93d1-3223ed0003a7 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:13.369005 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c6f02c64-617d-4336-93d1-3223ed0003a7 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:13.377420 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c6f02c64-617d-4336-93d1-3223ed0003a7 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57" status: 200 len: 1216 microversion: 2.1 time: 0.156255 Sep 10 12:31:13.378012 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3310/6613] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:13 2022] GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57 => generated 1216 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:31:14.400427 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d10aa19c-e7ae-4a3a-ae54-7f921d4fe187 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:14.401044 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d10aa19c-e7ae-4a3a-ae54-7f921d4fe187 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 1372b1e6-f6cd-42e5-9100-80c7f087ee57] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:14.408947 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d10aa19c-e7ae-4a3a-ae54-7f921d4fe187 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:14.409422 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d10aa19c-e7ae-4a3a-ae54-7f921d4fe187 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:14.409853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d10aa19c-e7ae-4a3a-ae54-7f921d4fe187 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:14.410534 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d10aa19c-e7ae-4a3a-ae54-7f921d4fe187 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:14.410987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d10aa19c-e7ae-4a3a-ae54-7f921d4fe187 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:14.411444 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d10aa19c-e7ae-4a3a-ae54-7f921d4fe187 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:14.543952 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d10aa19c-e7ae-4a3a-ae54-7f921d4fe187 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:14.552591 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d10aa19c-e7ae-4a3a-ae54-7f921d4fe187 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57" status: 200 len: 1216 microversion: 2.1 time: 0.156039 Sep 10 12:31:14.553169 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3304/6614] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:14 2022] GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57 => generated 1216 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:31:15.576362 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-94ae5e35-59a7-4f28-a433-8836f8069ca2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:15.577177 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-94ae5e35-59a7-4f28-a433-8836f8069ca2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 1372b1e6-f6cd-42e5-9100-80c7f087ee57] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:15.583589 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-94ae5e35-59a7-4f28-a433-8836f8069ca2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:15.584078 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-94ae5e35-59a7-4f28-a433-8836f8069ca2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:15.584516 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-94ae5e35-59a7-4f28-a433-8836f8069ca2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:15.585209 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-94ae5e35-59a7-4f28-a433-8836f8069ca2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:15.585659 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-94ae5e35-59a7-4f28-a433-8836f8069ca2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:15.586081 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-94ae5e35-59a7-4f28-a433-8836f8069ca2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:15.623658 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-61419b4b-afa9-4816-81bb-3a1518549a03 req-558a58f8-ef19-42b7-b3d6-8f8650781dcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1372b1e6-f6cd-42e5-9100-80c7f087ee57", "name": "network-vif-plugged", "status": "completed", "tag": "da4923ab-b3ce-48d3-8910-6afc5fd1eea9"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:31:15.634513 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-61419b4b-afa9-4816-81bb-3a1518549a03 req-558a58f8-ef19-42b7-b3d6-8f8650781dcf service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:15.635056 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-61419b4b-afa9-4816-81bb-3a1518549a03 req-558a58f8-ef19-42b7-b3d6-8f8650781dcf service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:15.635699 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-61419b4b-afa9-4816-81bb-3a1518549a03 req-558a58f8-ef19-42b7-b3d6-8f8650781dcf service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:15.647723 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-61419b4b-afa9-4816-81bb-3a1518549a03 req-558a58f8-ef19-42b7-b3d6-8f8650781dcf service nova] Creating event network-vif-plugged:da4923ab-b3ce-48d3-8910-6afc5fd1eea9 for instance 1372b1e6-f6cd-42e5-9100-80c7f087ee57 on n-h1-856895-1 Sep 10 12:31:15.653207 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-61419b4b-afa9-4816-81bb-3a1518549a03 req-558a58f8-ef19-42b7-b3d6-8f8650781dcf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033890 Sep 10 12:31:15.654122 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3305/6615] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:31:15.728883 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-94ae5e35-59a7-4f28-a433-8836f8069ca2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:15.736882 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-94ae5e35-59a7-4f28-a433-8836f8069ca2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57" status: 200 len: 1216 microversion: 2.1 time: 0.164588 Sep 10 12:31:15.737468 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3311/6616] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:15 2022] GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57 => generated 1216 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:31:16.761623 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c6c9e887-2615-4482-a7c0-412cd03b6adb tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:16.762319 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c6c9e887-2615-4482-a7c0-412cd03b6adb tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 1372b1e6-f6cd-42e5-9100-80c7f087ee57] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:16.768657 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c6c9e887-2615-4482-a7c0-412cd03b6adb tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:16.769210 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c6c9e887-2615-4482-a7c0-412cd03b6adb tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:16.769576 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c6c9e887-2615-4482-a7c0-412cd03b6adb tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:16.770269 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c6c9e887-2615-4482-a7c0-412cd03b6adb tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:16.770722 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c6c9e887-2615-4482-a7c0-412cd03b6adb tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:16.771148 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c6c9e887-2615-4482-a7c0-412cd03b6adb tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:16.902744 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c6c9e887-2615-4482-a7c0-412cd03b6adb tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:16.911258 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c6c9e887-2615-4482-a7c0-412cd03b6adb tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57" status: 200 len: 1216 microversion: 2.1 time: 0.154777 Sep 10 12:31:16.911827 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3306/6617] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:16 2022] GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57 => generated 1216 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:31:17.934620 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-57f28c31-0c8a-455f-86c6-ad0507e0248d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:17.935268 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-57f28c31-0c8a-455f-86c6-ad0507e0248d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 1372b1e6-f6cd-42e5-9100-80c7f087ee57] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:17.942847 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-57f28c31-0c8a-455f-86c6-ad0507e0248d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:17.943368 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-57f28c31-0c8a-455f-86c6-ad0507e0248d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:17.943817 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-57f28c31-0c8a-455f-86c6-ad0507e0248d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:17.944514 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-57f28c31-0c8a-455f-86c6-ad0507e0248d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:17.944975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-57f28c31-0c8a-455f-86c6-ad0507e0248d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:17.945405 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-57f28c31-0c8a-455f-86c6-ad0507e0248d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:18.077650 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-57f28c31-0c8a-455f-86c6-ad0507e0248d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:18.085395 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-57f28c31-0c8a-455f-86c6-ad0507e0248d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57" status: 200 len: 1403 microversion: 2.1 time: 0.154735 Sep 10 12:31:18.085962 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3312/6618] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:17 2022] GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57 => generated 1403 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:31:18.108542 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fdeed776-cedd-4d4d-a0ae-684681bcf613 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:18.109100 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fdeed776-cedd-4d4d-a0ae-684681bcf613 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 1372b1e6-f6cd-42e5-9100-80c7f087ee57] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:18.116688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdeed776-cedd-4d4d-a0ae-684681bcf613 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:18.117183 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdeed776-cedd-4d4d-a0ae-684681bcf613 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:18.117627 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdeed776-cedd-4d4d-a0ae-684681bcf613 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:18.118335 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdeed776-cedd-4d4d-a0ae-684681bcf613 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:18.118796 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdeed776-cedd-4d4d-a0ae-684681bcf613 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:18.119249 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fdeed776-cedd-4d4d-a0ae-684681bcf613 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:18.248030 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fdeed776-cedd-4d4d-a0ae-684681bcf613 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:18.256315 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fdeed776-cedd-4d4d-a0ae-684681bcf613 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57" status: 200 len: 1403 microversion: 2.1 time: 0.152300 Sep 10 12:31:18.256902 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3307/6619] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:18 2022] GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57 => generated 1403 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:31:18.279062 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fa5d5db8-cb87-4a6e-a3bd-10998753075e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1200684352"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:31:18.281583 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fa5d5db8-cb87-4a6e-a3bd-10998753075e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 1372b1e6-f6cd-42e5-9100-80c7f087ee57] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:18.287779 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa5d5db8-cb87-4a6e-a3bd-10998753075e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:18.288270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa5d5db8-cb87-4a6e-a3bd-10998753075e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:18.288712 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa5d5db8-cb87-4a6e-a3bd-10998753075e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:18.289409 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa5d5db8-cb87-4a6e-a3bd-10998753075e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:18.289868 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa5d5db8-cb87-4a6e-a3bd-10998753075e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:18.290296 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa5d5db8-cb87-4a6e-a3bd-10998753075e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:18.380923 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.compute.api [None req-fa5d5db8-cb87-4a6e-a3bd-10998753075e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 1372b1e6-f6cd-42e5-9100-80c7f087ee57] Attempting to quiesce instance before volume snapshot. Sep 10 12:31:18.443078 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.compute.api [None req-fa5d5db8-cb87-4a6e-a3bd-10998753075e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 1372b1e6-f6cd-42e5-9100-80c7f087ee57] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Sep 10 12:31:18.510827 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fa5d5db8-cb87-4a6e-a3bd-10998753075e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 1372b1e6-f6cd-42e5-9100-80c7f087ee57] Creating snapshot from volume bf8b0ee9-1362-4534-a2e8-30cd539c0518. {{(pid=128776) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Sep 10 12:31:19.429734 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fa5d5db8-cb87-4a6e-a3bd-10998753075e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "POST /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57/action" status: 202 len: 0 microversion: 2.1 time: 1.154552 Sep 10 12:31:19.435895 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3313/6620] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:31:18 2022] POST /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57/action => generated 0 bytes in 1156 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 10 12:31:20.719121 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c3ddad48-4b2f-43a0-9a2a-15de9d284804 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1871810634", "imageRef": "96045806-80bc-4068-9580-a66a88393848", "flavorRef": "452", "networks": [{"uuid": "63bc1cec-19c3-45db-83f8-21772e061ea1"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:31:20.727597 n-d-856895-1 devstack@n-api.service[128777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 12:31:20.727737 n-d-856895-1 devstack@n-api.service[128777]: Sat Sep 10 12:31:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Sep 10 12:31:20.728768 n-d-856895-1 devstack@n-api.service[128777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 12:31:20.728895 n-d-856895-1 devstack@n-api.service[128777]: Sat Sep 10 12:31:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Sep 10 12:31:20.782566 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-c3ddad48-4b2f-43a0-9a2a-15de9d284804 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] validate_networks() for [('63bc1cec-19c3-45db-83f8-21772e061ea1', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:31:21.156754 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-c3ddad48-4b2f-43a0-9a2a-15de9d284804 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:31:21.157258 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-c3ddad48-4b2f-43a0-9a2a-15de9d284804 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:31:21.157842 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-c3ddad48-4b2f-43a0-9a2a-15de9d284804 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:31:21.158322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-c3ddad48-4b2f-43a0-9a2a-15de9d284804 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:31:21.158867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-c3ddad48-4b2f-43a0-9a2a-15de9d284804 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:31:21.167916 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3ddad48-4b2f-43a0-9a2a-15de9d284804 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:21.168477 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3ddad48-4b2f-43a0-9a2a-15de9d284804 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:21.168984 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3ddad48-4b2f-43a0-9a2a-15de9d284804 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:21.169789 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3ddad48-4b2f-43a0-9a2a-15de9d284804 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:21.170806 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3ddad48-4b2f-43a0-9a2a-15de9d284804 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:21.171481 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3ddad48-4b2f-43a0-9a2a-15de9d284804 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:21.189842 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-c3ddad48-4b2f-43a0-9a2a-15de9d284804 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Getting quotas for project e27276f18d8045e2a9be7a6c5ed892f7. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:31:21.195067 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-c3ddad48-4b2f-43a0-9a2a-15de9d284804 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Getting quotas for user 5f0b168293f943389d72753009c88789 and project e27276f18d8045e2a9be7a6c5ed892f7. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:31:21.207135 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c3ddad48-4b2f-43a0-9a2a-15de9d284804 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:31:21.209744 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c3ddad48-4b2f-43a0-9a2a-15de9d284804 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 09865a41-3828-4a33-bdfe-28bedbfb5ef8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='f73fd712-34c8-420d-9a10-17060629be47',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:31:21.292172 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c3ddad48-4b2f-43a0-9a2a-15de9d284804 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.577280 Sep 10 12:31:21.292848 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3308/6621] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:31:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:31:21.306478 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-29965c44-7af7-4d6e-834c-58a7646c6b80 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:21.307622 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-29965c44-7af7-4d6e-834c-58a7646c6b80 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 09865a41-3828-4a33-bdfe-28bedbfb5ef8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:21.365556 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-29965c44-7af7-4d6e-834c-58a7646c6b80 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:21.373877 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-29965c44-7af7-4d6e-834c-58a7646c6b80 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8" status: 200 len: 1230 microversion: 2.1 time: 0.072100 Sep 10 12:31:21.374689 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3314/6622] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:21 2022] GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8 => generated 1230 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:31:22.397461 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-10de6596-6629-4fe6-a1bb-ffb11c8a0532 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:22.398117 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-10de6596-6629-4fe6-a1bb-ffb11c8a0532 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 09865a41-3828-4a33-bdfe-28bedbfb5ef8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:22.405922 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-10de6596-6629-4fe6-a1bb-ffb11c8a0532 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:22.406410 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-10de6596-6629-4fe6-a1bb-ffb11c8a0532 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:22.406852 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-10de6596-6629-4fe6-a1bb-ffb11c8a0532 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:22.407582 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-10de6596-6629-4fe6-a1bb-ffb11c8a0532 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:22.408039 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-10de6596-6629-4fe6-a1bb-ffb11c8a0532 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:22.408466 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-10de6596-6629-4fe6-a1bb-ffb11c8a0532 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:22.501536 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-10de6596-6629-4fe6-a1bb-ffb11c8a0532 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:22.509377 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-10de6596-6629-4fe6-a1bb-ffb11c8a0532 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8" status: 200 len: 1300 microversion: 2.1 time: 0.116623 Sep 10 12:31:22.510364 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3309/6623] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:22 2022] GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8 => generated 1300 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:31:23.535051 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ff721a8e-7625-4394-a804-cca03ba3bd0b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:23.536271 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ff721a8e-7625-4394-a804-cca03ba3bd0b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 09865a41-3828-4a33-bdfe-28bedbfb5ef8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:23.546971 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff721a8e-7625-4394-a804-cca03ba3bd0b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:23.547683 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff721a8e-7625-4394-a804-cca03ba3bd0b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:23.548948 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff721a8e-7625-4394-a804-cca03ba3bd0b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:23.555752 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff721a8e-7625-4394-a804-cca03ba3bd0b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:23.556467 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff721a8e-7625-4394-a804-cca03ba3bd0b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:23.557082 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff721a8e-7625-4394-a804-cca03ba3bd0b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:23.783010 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ff721a8e-7625-4394-a804-cca03ba3bd0b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:23.791017 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ff721a8e-7625-4394-a804-cca03ba3bd0b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8" status: 200 len: 1342 microversion: 2.1 time: 0.260092 Sep 10 12:31:23.791559 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3315/6624] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:23 2022] GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8 => generated 1342 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:31:24.191364 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-cdf67058-ebec-4f8c-9071-66873094f956 req-c4a4d2e1-7126-4ef9-8535-6feda7b352f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09865a41-3828-4a33-bdfe-28bedbfb5ef8", "tag": "587524e2-758f-47c0-9497-4f1715eb1b0e"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:31:24.204029 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-cdf67058-ebec-4f8c-9071-66873094f956 req-c4a4d2e1-7126-4ef9-8535-6feda7b352f7 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:24.204519 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-cdf67058-ebec-4f8c-9071-66873094f956 req-c4a4d2e1-7126-4ef9-8535-6feda7b352f7 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:24.204955 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-cdf67058-ebec-4f8c-9071-66873094f956 req-c4a4d2e1-7126-4ef9-8535-6feda7b352f7 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:24.222495 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-cdf67058-ebec-4f8c-9071-66873094f956 req-c4a4d2e1-7126-4ef9-8535-6feda7b352f7 service nova] Creating event network-changed:587524e2-758f-47c0-9497-4f1715eb1b0e for instance 09865a41-3828-4a33-bdfe-28bedbfb5ef8 on n-h2-856895-1 Sep 10 12:31:24.228380 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-cdf67058-ebec-4f8c-9071-66873094f956 req-c4a4d2e1-7126-4ef9-8535-6feda7b352f7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040740 Sep 10 12:31:24.229743 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3310/6625] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:31:24.816487 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ded9b014-06fc-4b3e-8726-98e121bd98fc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:24.817235 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ded9b014-06fc-4b3e-8726-98e121bd98fc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 09865a41-3828-4a33-bdfe-28bedbfb5ef8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:24.824588 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ded9b014-06fc-4b3e-8726-98e121bd98fc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:24.825198 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ded9b014-06fc-4b3e-8726-98e121bd98fc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:24.825666 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ded9b014-06fc-4b3e-8726-98e121bd98fc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:24.827226 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ded9b014-06fc-4b3e-8726-98e121bd98fc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:24.827709 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ded9b014-06fc-4b3e-8726-98e121bd98fc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:24.828167 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ded9b014-06fc-4b3e-8726-98e121bd98fc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:25.087130 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ded9b014-06fc-4b3e-8726-98e121bd98fc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:25.096168 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ded9b014-06fc-4b3e-8726-98e121bd98fc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8" status: 200 len: 1342 microversion: 2.1 time: 0.285175 Sep 10 12:31:25.096832 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3316/6626] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:24 2022] GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8 => generated 1342 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:31:26.127071 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e885ab82-4f2a-41c3-a08b-e0d4fa685b09 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:26.128209 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e885ab82-4f2a-41c3-a08b-e0d4fa685b09 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 09865a41-3828-4a33-bdfe-28bedbfb5ef8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:26.134905 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e885ab82-4f2a-41c3-a08b-e0d4fa685b09 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:26.135411 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e885ab82-4f2a-41c3-a08b-e0d4fa685b09 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:26.135853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e885ab82-4f2a-41c3-a08b-e0d4fa685b09 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:26.136715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e885ab82-4f2a-41c3-a08b-e0d4fa685b09 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:26.137321 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e885ab82-4f2a-41c3-a08b-e0d4fa685b09 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:26.137890 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e885ab82-4f2a-41c3-a08b-e0d4fa685b09 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:26.332486 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e885ab82-4f2a-41c3-a08b-e0d4fa685b09 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:26.341175 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e885ab82-4f2a-41c3-a08b-e0d4fa685b09 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8" status: 200 len: 1342 microversion: 2.1 time: 0.223626 Sep 10 12:31:26.342091 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3311/6627] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:26 2022] GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8 => generated 1342 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:31:27.368406 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-67265648-8f35-47cf-aca3-076a1de8ae2e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:27.369356 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-67265648-8f35-47cf-aca3-076a1de8ae2e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 09865a41-3828-4a33-bdfe-28bedbfb5ef8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:27.381777 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67265648-8f35-47cf-aca3-076a1de8ae2e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:27.382444 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67265648-8f35-47cf-aca3-076a1de8ae2e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:27.383096 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67265648-8f35-47cf-aca3-076a1de8ae2e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:27.385457 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67265648-8f35-47cf-aca3-076a1de8ae2e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:27.386404 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67265648-8f35-47cf-aca3-076a1de8ae2e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:27.387144 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67265648-8f35-47cf-aca3-076a1de8ae2e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:27.605196 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-67265648-8f35-47cf-aca3-076a1de8ae2e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:27.614812 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-67265648-8f35-47cf-aca3-076a1de8ae2e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8" status: 200 len: 1342 microversion: 2.1 time: 0.251883 Sep 10 12:31:27.627193 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3317/6628] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:27 2022] GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8 => generated 1342 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:31:28.645927 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8e4a1a85-ed46-4cc3-b25c-610cf7fa47f5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:28.647202 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8e4a1a85-ed46-4cc3-b25c-610cf7fa47f5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 09865a41-3828-4a33-bdfe-28bedbfb5ef8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:28.655516 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e4a1a85-ed46-4cc3-b25c-610cf7fa47f5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:28.656377 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e4a1a85-ed46-4cc3-b25c-610cf7fa47f5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:28.656814 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e4a1a85-ed46-4cc3-b25c-610cf7fa47f5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:28.657546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e4a1a85-ed46-4cc3-b25c-610cf7fa47f5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:28.658104 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e4a1a85-ed46-4cc3-b25c-610cf7fa47f5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:28.658541 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e4a1a85-ed46-4cc3-b25c-610cf7fa47f5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:28.814080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8e4a1a85-ed46-4cc3-b25c-610cf7fa47f5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:28.825278 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8e4a1a85-ed46-4cc3-b25c-610cf7fa47f5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8" status: 200 len: 1342 microversion: 2.1 time: 0.183260 Sep 10 12:31:28.835270 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3312/6629] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:28 2022] GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8 => generated 1342 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:31:29.852506 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f78ba550-2167-4f22-b38e-0fb7a25569af tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:29.853073 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f78ba550-2167-4f22-b38e-0fb7a25569af tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 09865a41-3828-4a33-bdfe-28bedbfb5ef8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:29.856165 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:31:29.862459 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f78ba550-2167-4f22-b38e-0fb7a25569af tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:29.862975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f78ba550-2167-4f22-b38e-0fb7a25569af tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:29.863453 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f78ba550-2167-4f22-b38e-0fb7a25569af tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:29.864309 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f78ba550-2167-4f22-b38e-0fb7a25569af tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:29.864769 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f78ba550-2167-4f22-b38e-0fb7a25569af tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:29.865253 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f78ba550-2167-4f22-b38e-0fb7a25569af tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:29.871048 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:31:30.011061 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f78ba550-2167-4f22-b38e-0fb7a25569af tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:30.019890 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f78ba550-2167-4f22-b38e-0fb7a25569af tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8" status: 200 len: 1342 microversion: 2.1 time: 0.171573 Sep 10 12:31:30.035537 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3318/6630] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:29 2022] GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8 => generated 1342 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:31:31.042736 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bde1b918-f0ce-4509-9e50-90d217edff50 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:31.043319 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bde1b918-f0ce-4509-9e50-90d217edff50 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 09865a41-3828-4a33-bdfe-28bedbfb5ef8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:31.046128 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:31:31.051455 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bde1b918-f0ce-4509-9e50-90d217edff50 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:31.051945 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bde1b918-f0ce-4509-9e50-90d217edff50 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:31.052391 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bde1b918-f0ce-4509-9e50-90d217edff50 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:31.053091 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bde1b918-f0ce-4509-9e50-90d217edff50 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:31.053551 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bde1b918-f0ce-4509-9e50-90d217edff50 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:31.053985 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bde1b918-f0ce-4509-9e50-90d217edff50 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:31.057408 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=79 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:31:31.178141 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:31:31.188155 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bde1b918-f0ce-4509-9e50-90d217edff50 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:31.195688 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bde1b918-f0ce-4509-9e50-90d217edff50 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8" status: 200 len: 1342 microversion: 2.1 time: 0.157011 Sep 10 12:31:31.196266 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3313/6631] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:31 2022] GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8 => generated 1342 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:31:32.220021 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-428e91c1-2f07-4a45-80fe-6ad966d7c635 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:32.220806 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-428e91c1-2f07-4a45-80fe-6ad966d7c635 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 09865a41-3828-4a33-bdfe-28bedbfb5ef8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:32.223600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:31:32.229421 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-428e91c1-2f07-4a45-80fe-6ad966d7c635 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:32.229949 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-428e91c1-2f07-4a45-80fe-6ad966d7c635 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:32.230398 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-428e91c1-2f07-4a45-80fe-6ad966d7c635 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:32.231110 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-428e91c1-2f07-4a45-80fe-6ad966d7c635 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:32.231602 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-428e91c1-2f07-4a45-80fe-6ad966d7c635 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:32.232813 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-428e91c1-2f07-4a45-80fe-6ad966d7c635 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:32.376042 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-428e91c1-2f07-4a45-80fe-6ad966d7c635 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:32.383928 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-428e91c1-2f07-4a45-80fe-6ad966d7c635 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8" status: 200 len: 1342 microversion: 2.1 time: 0.168380 Sep 10 12:31:32.384507 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3319/6632] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:32 2022] GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8 => generated 1342 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:31:33.407078 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5dedddc9-ddf8-4679-8450-e0a9f9961e6a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:33.407689 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5dedddc9-ddf8-4679-8450-e0a9f9961e6a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 09865a41-3828-4a33-bdfe-28bedbfb5ef8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:33.409574 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:31:33.416236 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5dedddc9-ddf8-4679-8450-e0a9f9961e6a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:33.416729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5dedddc9-ddf8-4679-8450-e0a9f9961e6a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:33.417190 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5dedddc9-ddf8-4679-8450-e0a9f9961e6a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:33.418170 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5dedddc9-ddf8-4679-8450-e0a9f9961e6a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:33.418653 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5dedddc9-ddf8-4679-8450-e0a9f9961e6a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:33.419075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5dedddc9-ddf8-4679-8450-e0a9f9961e6a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:33.566177 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5dedddc9-ddf8-4679-8450-e0a9f9961e6a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:33.573949 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5dedddc9-ddf8-4679-8450-e0a9f9961e6a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8" status: 200 len: 1342 microversion: 2.1 time: 0.171125 Sep 10 12:31:33.574520 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3314/6633] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:33 2022] GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8 => generated 1342 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:31:34.596982 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-eb969b7b-71c9-4cc2-bc48-44772af352e6 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:34.597602 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-eb969b7b-71c9-4cc2-bc48-44772af352e6 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 09865a41-3828-4a33-bdfe-28bedbfb5ef8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:34.605259 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eb969b7b-71c9-4cc2-bc48-44772af352e6 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:34.605864 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eb969b7b-71c9-4cc2-bc48-44772af352e6 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:34.606482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eb969b7b-71c9-4cc2-bc48-44772af352e6 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:34.607847 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eb969b7b-71c9-4cc2-bc48-44772af352e6 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:34.608413 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eb969b7b-71c9-4cc2-bc48-44772af352e6 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:34.608863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eb969b7b-71c9-4cc2-bc48-44772af352e6 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:34.744137 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-eb969b7b-71c9-4cc2-bc48-44772af352e6 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:34.752737 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-eb969b7b-71c9-4cc2-bc48-44772af352e6 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8" status: 200 len: 1342 microversion: 2.1 time: 0.159893 Sep 10 12:31:34.753558 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3320/6634] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:34 2022] GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8 => generated 1342 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:31:35.776979 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4b7451fe-4838-4104-af67-8fbe6733ff89 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:35.777597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4b7451fe-4838-4104-af67-8fbe6733ff89 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 09865a41-3828-4a33-bdfe-28bedbfb5ef8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:35.784736 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b7451fe-4838-4104-af67-8fbe6733ff89 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:35.785222 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b7451fe-4838-4104-af67-8fbe6733ff89 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:35.785669 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b7451fe-4838-4104-af67-8fbe6733ff89 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:35.786364 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b7451fe-4838-4104-af67-8fbe6733ff89 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:35.786818 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b7451fe-4838-4104-af67-8fbe6733ff89 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:35.787321 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b7451fe-4838-4104-af67-8fbe6733ff89 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:35.931349 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4b7451fe-4838-4104-af67-8fbe6733ff89 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:35.939526 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4b7451fe-4838-4104-af67-8fbe6733ff89 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8" status: 200 len: 1342 microversion: 2.1 time: 0.166446 Sep 10 12:31:35.940111 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3315/6635] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:35 2022] GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8 => generated 1342 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:31:36.962597 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-652b0c96-9283-4a24-b83e-f9ea99c85548 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:36.963288 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-652b0c96-9283-4a24-b83e-f9ea99c85548 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 09865a41-3828-4a33-bdfe-28bedbfb5ef8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:36.971370 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-652b0c96-9283-4a24-b83e-f9ea99c85548 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:36.971807 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-652b0c96-9283-4a24-b83e-f9ea99c85548 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:36.972289 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-652b0c96-9283-4a24-b83e-f9ea99c85548 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:36.973229 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-652b0c96-9283-4a24-b83e-f9ea99c85548 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:36.973662 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-652b0c96-9283-4a24-b83e-f9ea99c85548 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:36.974104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-652b0c96-9283-4a24-b83e-f9ea99c85548 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:37.112217 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-652b0c96-9283-4a24-b83e-f9ea99c85548 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:37.121486 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-652b0c96-9283-4a24-b83e-f9ea99c85548 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8" status: 200 len: 1376 microversion: 2.1 time: 0.162774 Sep 10 12:31:37.122080 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3321/6636] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:36 2022] GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8 => generated 1376 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:31:38.145090 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9aa57392-5fcf-4d89-93b8-c23683c9bcd9 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:38.145713 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9aa57392-5fcf-4d89-93b8-c23683c9bcd9 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 09865a41-3828-4a33-bdfe-28bedbfb5ef8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:38.152731 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9aa57392-5fcf-4d89-93b8-c23683c9bcd9 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:38.153216 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9aa57392-5fcf-4d89-93b8-c23683c9bcd9 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:38.153697 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9aa57392-5fcf-4d89-93b8-c23683c9bcd9 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:38.154439 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9aa57392-5fcf-4d89-93b8-c23683c9bcd9 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:38.154968 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9aa57392-5fcf-4d89-93b8-c23683c9bcd9 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:38.155436 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9aa57392-5fcf-4d89-93b8-c23683c9bcd9 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:38.297915 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9aa57392-5fcf-4d89-93b8-c23683c9bcd9 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:38.305803 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9aa57392-5fcf-4d89-93b8-c23683c9bcd9 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8" status: 200 len: 1376 microversion: 2.1 time: 0.164741 Sep 10 12:31:38.306386 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3316/6637] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:38 2022] GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8 => generated 1376 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:31:39.330994 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9a885f81-cb28-454f-a875-d1bd80856cc6 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:39.331657 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9a885f81-cb28-454f-a875-d1bd80856cc6 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 09865a41-3828-4a33-bdfe-28bedbfb5ef8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:39.334523 n-d-856895-1 devstack@n-api.service[128776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 12:31:39.334680 n-d-856895-1 devstack@n-api.service[128776]: Sat Sep 10 12:31:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8 (ip 10.222.0.23) !!! Sep 10 12:31:39.341373 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a885f81-cb28-454f-a875-d1bd80856cc6 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:39.342238 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a885f81-cb28-454f-a875-d1bd80856cc6 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:39.342710 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a885f81-cb28-454f-a875-d1bd80856cc6 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:39.343454 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a885f81-cb28-454f-a875-d1bd80856cc6 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:39.343930 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a885f81-cb28-454f-a875-d1bd80856cc6 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:39.344376 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a885f81-cb28-454f-a875-d1bd80856cc6 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:39.479574 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9a885f81-cb28-454f-a875-d1bd80856cc6 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:39.487422 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9a885f81-cb28-454f-a875-d1bd80856cc6 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8" status: 200 len: 1376 microversion: 2.1 time: 0.161142 Sep 10 12:31:39.487998 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3322/6638] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:39 2022] GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8 => generated 1376 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:31:40.511290 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-20406160-b561-4005-8f3d-d7d3102c2670 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:40.511905 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-20406160-b561-4005-8f3d-d7d3102c2670 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 09865a41-3828-4a33-bdfe-28bedbfb5ef8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:40.520943 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-20406160-b561-4005-8f3d-d7d3102c2670 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:40.520943 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-20406160-b561-4005-8f3d-d7d3102c2670 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:40.520943 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-20406160-b561-4005-8f3d-d7d3102c2670 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:40.521343 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-20406160-b561-4005-8f3d-d7d3102c2670 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:40.521807 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-20406160-b561-4005-8f3d-d7d3102c2670 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:40.522239 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-20406160-b561-4005-8f3d-d7d3102c2670 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:40.662356 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-20406160-b561-4005-8f3d-d7d3102c2670 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:40.670680 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-20406160-b561-4005-8f3d-d7d3102c2670 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8" status: 200 len: 1376 microversion: 2.1 time: 0.163673 Sep 10 12:31:40.671368 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3317/6639] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:40 2022] GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8 => generated 1376 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:31:41.694723 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cd6f5d80-2e5e-4729-a13b-e8cbcff22596 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:41.695398 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cd6f5d80-2e5e-4729-a13b-e8cbcff22596 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 09865a41-3828-4a33-bdfe-28bedbfb5ef8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:41.703433 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cd6f5d80-2e5e-4729-a13b-e8cbcff22596 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:41.703996 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cd6f5d80-2e5e-4729-a13b-e8cbcff22596 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:41.704534 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cd6f5d80-2e5e-4729-a13b-e8cbcff22596 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:41.705290 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cd6f5d80-2e5e-4729-a13b-e8cbcff22596 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:41.705768 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cd6f5d80-2e5e-4729-a13b-e8cbcff22596 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:41.706211 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cd6f5d80-2e5e-4729-a13b-e8cbcff22596 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:41.849312 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-cd6f5d80-2e5e-4729-a13b-e8cbcff22596 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:41.857801 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cd6f5d80-2e5e-4729-a13b-e8cbcff22596 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8" status: 200 len: 1376 microversion: 2.1 time: 0.167226 Sep 10 12:31:41.858952 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3323/6640] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:41 2022] GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8 => generated 1376 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:31:42.885435 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-743b762e-b9d4-448c-930e-1532e7864e52 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:42.886297 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-743b762e-b9d4-448c-930e-1532e7864e52 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 09865a41-3828-4a33-bdfe-28bedbfb5ef8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:42.896695 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-743b762e-b9d4-448c-930e-1532e7864e52 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:42.897345 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-743b762e-b9d4-448c-930e-1532e7864e52 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:42.897842 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-743b762e-b9d4-448c-930e-1532e7864e52 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:42.898734 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-743b762e-b9d4-448c-930e-1532e7864e52 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:42.899265 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-743b762e-b9d4-448c-930e-1532e7864e52 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:42.899912 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-743b762e-b9d4-448c-930e-1532e7864e52 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:43.037431 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-743b762e-b9d4-448c-930e-1532e7864e52 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:43.045172 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-743b762e-b9d4-448c-930e-1532e7864e52 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8" status: 200 len: 1376 microversion: 2.1 time: 0.165452 Sep 10 12:31:43.046301 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3318/6641] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:42 2022] GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8 => generated 1376 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:31:44.069608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-984ee3fa-552a-4a8b-a43e-62f7eea8d852 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:44.070249 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-984ee3fa-552a-4a8b-a43e-62f7eea8d852 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 09865a41-3828-4a33-bdfe-28bedbfb5ef8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:44.078329 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-984ee3fa-552a-4a8b-a43e-62f7eea8d852 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:44.078827 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-984ee3fa-552a-4a8b-a43e-62f7eea8d852 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:44.079318 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-984ee3fa-552a-4a8b-a43e-62f7eea8d852 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:44.080025 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-984ee3fa-552a-4a8b-a43e-62f7eea8d852 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:44.080501 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-984ee3fa-552a-4a8b-a43e-62f7eea8d852 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:44.080946 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-984ee3fa-552a-4a8b-a43e-62f7eea8d852 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:44.221422 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-984ee3fa-552a-4a8b-a43e-62f7eea8d852 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:44.229290 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-984ee3fa-552a-4a8b-a43e-62f7eea8d852 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8" status: 200 len: 1376 microversion: 2.1 time: 0.163667 Sep 10 12:31:44.229875 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3324/6642] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:44 2022] GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8 => generated 1376 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:31:45.252928 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6e2c6810-a9e1-4943-84c6-a523b5ba8f32 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:45.253553 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6e2c6810-a9e1-4943-84c6-a523b5ba8f32 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 09865a41-3828-4a33-bdfe-28bedbfb5ef8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:45.260493 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6e2c6810-a9e1-4943-84c6-a523b5ba8f32 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:45.260975 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6e2c6810-a9e1-4943-84c6-a523b5ba8f32 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:45.261432 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6e2c6810-a9e1-4943-84c6-a523b5ba8f32 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:45.262102 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6e2c6810-a9e1-4943-84c6-a523b5ba8f32 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:45.262554 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6e2c6810-a9e1-4943-84c6-a523b5ba8f32 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:45.262978 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6e2c6810-a9e1-4943-84c6-a523b5ba8f32 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:45.399386 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6e2c6810-a9e1-4943-84c6-a523b5ba8f32 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:45.408378 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6e2c6810-a9e1-4943-84c6-a523b5ba8f32 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8" status: 200 len: 1376 microversion: 2.1 time: 0.159436 Sep 10 12:31:45.414095 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3319/6643] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:45 2022] GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8 => generated 1376 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:31:46.432371 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a38a187b-a95c-4812-ad06-bb5ecd41a39b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:46.433008 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a38a187b-a95c-4812-ad06-bb5ecd41a39b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 09865a41-3828-4a33-bdfe-28bedbfb5ef8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:46.440509 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a38a187b-a95c-4812-ad06-bb5ecd41a39b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:46.441116 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a38a187b-a95c-4812-ad06-bb5ecd41a39b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:46.441582 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a38a187b-a95c-4812-ad06-bb5ecd41a39b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:46.442342 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a38a187b-a95c-4812-ad06-bb5ecd41a39b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:46.442921 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a38a187b-a95c-4812-ad06-bb5ecd41a39b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:46.443485 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a38a187b-a95c-4812-ad06-bb5ecd41a39b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:46.540027 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-6c595ef9-7681-41f9-ab11-07b04c734757 req-809b7896-06e8-488c-89c0-8d7de270a408 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09865a41-3828-4a33-bdfe-28bedbfb5ef8", "name": "network-vif-plugged", "status": "completed", "tag": "587524e2-758f-47c0-9497-4f1715eb1b0e"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:31:46.552158 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-6c595ef9-7681-41f9-ab11-07b04c734757 req-809b7896-06e8-488c-89c0-8d7de270a408 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:46.552803 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-6c595ef9-7681-41f9-ab11-07b04c734757 req-809b7896-06e8-488c-89c0-8d7de270a408 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:46.553264 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-6c595ef9-7681-41f9-ab11-07b04c734757 req-809b7896-06e8-488c-89c0-8d7de270a408 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:46.565198 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-6c595ef9-7681-41f9-ab11-07b04c734757 req-809b7896-06e8-488c-89c0-8d7de270a408 service nova] Creating event network-vif-plugged:587524e2-758f-47c0-9497-4f1715eb1b0e for instance 09865a41-3828-4a33-bdfe-28bedbfb5ef8 on n-h2-856895-1 Sep 10 12:31:46.570506 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-6c595ef9-7681-41f9-ab11-07b04c734757 req-809b7896-06e8-488c-89c0-8d7de270a408 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034286 Sep 10 12:31:46.571440 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3320/6644] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:31:46.607082 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a38a187b-a95c-4812-ad06-bb5ecd41a39b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:46.620035 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a38a187b-a95c-4812-ad06-bb5ecd41a39b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8" status: 200 len: 1376 microversion: 2.1 time: 0.191515 Sep 10 12:31:46.620964 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3325/6645] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:46 2022] GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8 => generated 1376 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:31:47.648288 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7cb75071-7cd1-45a0-9b05-92764494b53a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:47.648997 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7cb75071-7cd1-45a0-9b05-92764494b53a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 09865a41-3828-4a33-bdfe-28bedbfb5ef8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:47.656332 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7cb75071-7cd1-45a0-9b05-92764494b53a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:47.656814 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7cb75071-7cd1-45a0-9b05-92764494b53a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:47.657258 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7cb75071-7cd1-45a0-9b05-92764494b53a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:47.658001 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7cb75071-7cd1-45a0-9b05-92764494b53a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:47.658424 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7cb75071-7cd1-45a0-9b05-92764494b53a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:47.658850 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7cb75071-7cd1-45a0-9b05-92764494b53a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:47.805103 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7cb75071-7cd1-45a0-9b05-92764494b53a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:47.818672 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7cb75071-7cd1-45a0-9b05-92764494b53a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8" status: 200 len: 1376 microversion: 2.1 time: 0.175672 Sep 10 12:31:47.819721 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3321/6646] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:47 2022] GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8 => generated 1376 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:31:48.843677 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-13ee75d4-fa64-41af-9d79-388feb7f8a22 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:48.844356 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-13ee75d4-fa64-41af-9d79-388feb7f8a22 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 09865a41-3828-4a33-bdfe-28bedbfb5ef8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:48.853222 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13ee75d4-fa64-41af-9d79-388feb7f8a22 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:48.853895 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13ee75d4-fa64-41af-9d79-388feb7f8a22 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:48.854354 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13ee75d4-fa64-41af-9d79-388feb7f8a22 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:48.855230 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13ee75d4-fa64-41af-9d79-388feb7f8a22 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:48.855715 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13ee75d4-fa64-41af-9d79-388feb7f8a22 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:48.856168 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13ee75d4-fa64-41af-9d79-388feb7f8a22 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:49.001465 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-13ee75d4-fa64-41af-9d79-388feb7f8a22 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:49.011726 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-13ee75d4-fa64-41af-9d79-388feb7f8a22 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8" status: 200 len: 1564 microversion: 2.1 time: 0.172849 Sep 10 12:31:49.012309 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3326/6647] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:48 2022] GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8 => generated 1564 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:31:49.040594 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b4d601ff-a100-48c6-ab56-ee8e7f1a8187 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:49.041230 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b4d601ff-a100-48c6-ab56-ee8e7f1a8187 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 09865a41-3828-4a33-bdfe-28bedbfb5ef8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:49.048649 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b4d601ff-a100-48c6-ab56-ee8e7f1a8187 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:49.049139 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b4d601ff-a100-48c6-ab56-ee8e7f1a8187 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:49.049591 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b4d601ff-a100-48c6-ab56-ee8e7f1a8187 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:49.050301 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b4d601ff-a100-48c6-ab56-ee8e7f1a8187 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:49.050773 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b4d601ff-a100-48c6-ab56-ee8e7f1a8187 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:49.051237 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b4d601ff-a100-48c6-ab56-ee8e7f1a8187 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:49.193978 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b4d601ff-a100-48c6-ab56-ee8e7f1a8187 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:49.203914 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b4d601ff-a100-48c6-ab56-ee8e7f1a8187 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8" status: 200 len: 1564 microversion: 2.1 time: 0.167507 Sep 10 12:31:49.204493 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3322/6648] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:49 2022] GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8 => generated 1564 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:31:49.285700 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3b5b84ec-f442-4e46-8be9-2dc7cf1d1713 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:49.286222 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3b5b84ec-f442-4e46-8be9-2dc7cf1d1713 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 09865a41-3828-4a33-bdfe-28bedbfb5ef8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:49.292693 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3b5b84ec-f442-4e46-8be9-2dc7cf1d1713 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:49.293192 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3b5b84ec-f442-4e46-8be9-2dc7cf1d1713 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:49.293659 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3b5b84ec-f442-4e46-8be9-2dc7cf1d1713 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:49.294342 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3b5b84ec-f442-4e46-8be9-2dc7cf1d1713 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:49.294811 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3b5b84ec-f442-4e46-8be9-2dc7cf1d1713 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:49.295280 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3b5b84ec-f442-4e46-8be9-2dc7cf1d1713 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:49.323526 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3b5b84ec-f442-4e46-8be9-2dc7cf1d1713 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 09865a41-3828-4a33-bdfe-28bedbfb5ef8] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:31:49.400004 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3b5b84ec-f442-4e46-8be9-2dc7cf1d1713 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "DELETE /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8" status: 204 len: 0 microversion: 2.1 time: 0.117720 Sep 10 12:31:49.400620 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3327/6649] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:31:49 2022] DELETE /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:31:49.408862 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-17f5d2e7-cb39-4fe1-831e-5883e8717c6d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:49.409483 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-17f5d2e7-cb39-4fe1-831e-5883e8717c6d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 09865a41-3828-4a33-bdfe-28bedbfb5ef8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:49.415453 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17f5d2e7-cb39-4fe1-831e-5883e8717c6d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:49.415938 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17f5d2e7-cb39-4fe1-831e-5883e8717c6d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:49.416375 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17f5d2e7-cb39-4fe1-831e-5883e8717c6d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:49.417060 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17f5d2e7-cb39-4fe1-831e-5883e8717c6d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:49.417515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17f5d2e7-cb39-4fe1-831e-5883e8717c6d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:49.417942 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17f5d2e7-cb39-4fe1-831e-5883e8717c6d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:49.555114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-17f5d2e7-cb39-4fe1-831e-5883e8717c6d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:49.562931 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-17f5d2e7-cb39-4fe1-831e-5883e8717c6d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8" status: 200 len: 1570 microversion: 2.1 time: 0.158039 Sep 10 12:31:49.563556 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3323/6650] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:49 2022] GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:31:50.586938 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-89f9fa1f-0ee9-47d6-b506-f57936d4c842 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:50.587605 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-89f9fa1f-0ee9-47d6-b506-f57936d4c842 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 09865a41-3828-4a33-bdfe-28bedbfb5ef8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:50.594691 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89f9fa1f-0ee9-47d6-b506-f57936d4c842 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:50.595216 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89f9fa1f-0ee9-47d6-b506-f57936d4c842 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:50.595672 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89f9fa1f-0ee9-47d6-b506-f57936d4c842 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:50.596380 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89f9fa1f-0ee9-47d6-b506-f57936d4c842 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:50.596850 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89f9fa1f-0ee9-47d6-b506-f57936d4c842 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:50.597294 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89f9fa1f-0ee9-47d6-b506-f57936d4c842 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:50.731100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-89f9fa1f-0ee9-47d6-b506-f57936d4c842 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:50.739852 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-89f9fa1f-0ee9-47d6-b506-f57936d4c842 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8" status: 200 len: 1570 microversion: 2.1 time: 0.157351 Sep 10 12:31:50.740427 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3328/6651] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:50 2022] GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:31:51.293116 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-6f6dea46-a888-4130-bbc9-66adccfe5abd req-66c38c4b-9d1c-4d0a-b1f5-cba948e9e784 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09865a41-3828-4a33-bdfe-28bedbfb5ef8", "name": "network-vif-deleted", "tag": "587524e2-758f-47c0-9497-4f1715eb1b0e"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:31:51.308771 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-6f6dea46-a888-4130-bbc9-66adccfe5abd req-66c38c4b-9d1c-4d0a-b1f5-cba948e9e784 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:51.309257 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-6f6dea46-a888-4130-bbc9-66adccfe5abd req-66c38c4b-9d1c-4d0a-b1f5-cba948e9e784 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:51.309695 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-6f6dea46-a888-4130-bbc9-66adccfe5abd req-66c38c4b-9d1c-4d0a-b1f5-cba948e9e784 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:51.323288 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-6f6dea46-a888-4130-bbc9-66adccfe5abd req-66c38c4b-9d1c-4d0a-b1f5-cba948e9e784 service nova] Creating event network-vif-deleted:587524e2-758f-47c0-9497-4f1715eb1b0e for instance 09865a41-3828-4a33-bdfe-28bedbfb5ef8 on n-h2-856895-1 Sep 10 12:31:51.330700 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-6f6dea46-a888-4130-bbc9-66adccfe5abd req-66c38c4b-9d1c-4d0a-b1f5-cba948e9e784 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041972 Sep 10 12:31:51.331531 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3324/6652] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:31:51.763792 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0b7d75e1-2f1f-453c-b860-aac4f45cf47b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:51.764375 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0b7d75e1-2f1f-453c-b860-aac4f45cf47b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 09865a41-3828-4a33-bdfe-28bedbfb5ef8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:51.771817 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0b7d75e1-2f1f-453c-b860-aac4f45cf47b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:51.772314 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0b7d75e1-2f1f-453c-b860-aac4f45cf47b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:51.772763 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0b7d75e1-2f1f-453c-b860-aac4f45cf47b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:51.773464 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0b7d75e1-2f1f-453c-b860-aac4f45cf47b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:51.773934 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0b7d75e1-2f1f-453c-b860-aac4f45cf47b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:51.774375 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0b7d75e1-2f1f-453c-b860-aac4f45cf47b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:51.837964 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0b7d75e1-2f1f-453c-b860-aac4f45cf47b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:51.846584 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0b7d75e1-2f1f-453c-b860-aac4f45cf47b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8" status: 200 len: 1361 microversion: 2.1 time: 0.086840 Sep 10 12:31:51.847172 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3329/6653] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:51 2022] GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8 => generated 1361 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:31:52.870774 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c7922781-6720-457c-a4a5-3d21602f6e11 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:52.871514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c7922781-6720-457c-a4a5-3d21602f6e11 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 09865a41-3828-4a33-bdfe-28bedbfb5ef8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:52.879183 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7922781-6720-457c-a4a5-3d21602f6e11 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:52.879727 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7922781-6720-457c-a4a5-3d21602f6e11 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:52.880166 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7922781-6720-457c-a4a5-3d21602f6e11 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:52.880866 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7922781-6720-457c-a4a5-3d21602f6e11 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:52.881387 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7922781-6720-457c-a4a5-3d21602f6e11 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:52.881825 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7922781-6720-457c-a4a5-3d21602f6e11 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:52.950305 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c7922781-6720-457c-a4a5-3d21602f6e11 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:52.959604 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c7922781-6720-457c-a4a5-3d21602f6e11 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8" status: 200 len: 1361 microversion: 2.1 time: 0.093253 Sep 10 12:31:52.960222 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3325/6654] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:52 2022] GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8 => generated 1361 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:31:53.983020 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3dcfc5ed-ccea-4ec9-a555-e10be21c85c5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:53.984393 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3dcfc5ed-ccea-4ec9-a555-e10be21c85c5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 09865a41-3828-4a33-bdfe-28bedbfb5ef8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:53.991785 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3dcfc5ed-ccea-4ec9-a555-e10be21c85c5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:53.992281 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3dcfc5ed-ccea-4ec9-a555-e10be21c85c5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:53.992729 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3dcfc5ed-ccea-4ec9-a555-e10be21c85c5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:53.993435 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3dcfc5ed-ccea-4ec9-a555-e10be21c85c5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:53.993904 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3dcfc5ed-ccea-4ec9-a555-e10be21c85c5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:53.994343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3dcfc5ed-ccea-4ec9-a555-e10be21c85c5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:54.062922 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3dcfc5ed-ccea-4ec9-a555-e10be21c85c5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:54.071013 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3dcfc5ed-ccea-4ec9-a555-e10be21c85c5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8" status: 200 len: 1361 microversion: 2.1 time: 0.091911 Sep 10 12:31:54.071628 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3330/6655] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:53 2022] GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8 => generated 1361 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:31:55.094096 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2fd14c2b-d3b1-4b8d-86eb-85a7fa2027f2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:55.094728 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2fd14c2b-d3b1-4b8d-86eb-85a7fa2027f2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 09865a41-3828-4a33-bdfe-28bedbfb5ef8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:55.102062 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fd14c2b-d3b1-4b8d-86eb-85a7fa2027f2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:55.102557 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fd14c2b-d3b1-4b8d-86eb-85a7fa2027f2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:55.103002 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fd14c2b-d3b1-4b8d-86eb-85a7fa2027f2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:55.103740 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fd14c2b-d3b1-4b8d-86eb-85a7fa2027f2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:55.104202 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fd14c2b-d3b1-4b8d-86eb-85a7fa2027f2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:55.104635 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fd14c2b-d3b1-4b8d-86eb-85a7fa2027f2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:55.177083 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2fd14c2b-d3b1-4b8d-86eb-85a7fa2027f2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:31:55.185590 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2fd14c2b-d3b1-4b8d-86eb-85a7fa2027f2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8" status: 200 len: 1361 microversion: 2.1 time: 0.095571 Sep 10 12:31:55.186172 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3326/6656] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:55 2022] GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8 => generated 1361 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:31:56.210346 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5b3afe89-a816-4f04-936c-6bbede729673 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:31:56.211023 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5b3afe89-a816-4f04-936c-6bbede729673 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 09865a41-3828-4a33-bdfe-28bedbfb5ef8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:31:56.219972 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b3afe89-a816-4f04-936c-6bbede729673 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:56.220468 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b3afe89-a816-4f04-936c-6bbede729673 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:56.220953 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b3afe89-a816-4f04-936c-6bbede729673 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:56.221660 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b3afe89-a816-4f04-936c-6bbede729673 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:31:56.222135 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b3afe89-a816-4f04-936c-6bbede729673 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:31:56.222582 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b3afe89-a816-4f04-936c-6bbede729673 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:31:56.236473 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-5b3afe89-a816-4f04-936c-6bbede729673 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] HTTP exception thrown: Instance 09865a41-3828-4a33-bdfe-28bedbfb5ef8 could not be found. Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5b3afe89-a816-4f04-936c-6bbede729673 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Request method failure captured: Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8 HTTP/1.1 Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHILszP5bh-7vS5nFlniigSPwJSgl9gRBzD28JMJ3uXj7KaJ7IKD0MoPbGUyk7NiR2g3O-OhOoEJg5Mrgl8pVom5QsCHuzRwflIP07SHDWyP4-s7StMch63ybX3LIelpp866T-_UOtQoKy1YDkCCnydW84pCURv3Zlf7uIJ_dXgYsc64 Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: e27276f18d8045e2a9be7a6c5ed892f7 Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e27276f18d8045e2a9be7a6c5ed892f7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: e27276f18d8045e2a9be7a6c5ed892f7 Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-TestVolumeBootPattern-1940983644-project Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 5f0b168293f943389d72753009c88789 Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-TestVolumeBootPattern-1940983644-project Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 09865a41-3828-4a33-bdfe-28bedbfb5ef8 could not be found. Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '09865a41-3828-4a33-bdfe-28bedbfb5ef8'} Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09865a41-3828-4a33-bdfe-28bedbfb5ef8 could not be found. Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09865a41-3828-4a33-bdfe-28bedbfb5ef8 could not be found. Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:31:56.238191 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:31:56.242862 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:31:56.242862 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:31:56.242862 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:31:56.242862 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:31:56.242862 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:31:56.242862 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09865a41-3828-4a33-bdfe-28bedbfb5ef8 could not be found. Sep 10 12:31:56.242862 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:31:56.242862 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5b3afe89-a816-4f04-936c-6bbede729673 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Returning 404 to user: Instance 09865a41-3828-4a33-bdfe-28bedbfb5ef8 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:31:56.242862 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5b3afe89-a816-4f04-936c-6bbede729673 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8" status: 404 len: 111 microversion: 2.1 time: 0.033839 Sep 10 12:31:56.242862 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3331/6657] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:31:56 2022] GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:32:00.530576 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2ae68255-e7d7-4038-a2b0-fd31a822475d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:32:00.531141 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2ae68255-e7d7-4038-a2b0-fd31a822475d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 1372b1e6-f6cd-42e5-9100-80c7f087ee57] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:32:00.538518 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ae68255-e7d7-4038-a2b0-fd31a822475d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:00.539007 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ae68255-e7d7-4038-a2b0-fd31a822475d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:00.539478 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ae68255-e7d7-4038-a2b0-fd31a822475d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:00.540193 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ae68255-e7d7-4038-a2b0-fd31a822475d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:00.540651 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ae68255-e7d7-4038-a2b0-fd31a822475d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:00.541080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ae68255-e7d7-4038-a2b0-fd31a822475d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:00.566370 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2ae68255-e7d7-4038-a2b0-fd31a822475d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 1372b1e6-f6cd-42e5-9100-80c7f087ee57] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:32:00.641418 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2ae68255-e7d7-4038-a2b0-fd31a822475d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57" status: 204 len: 0 microversion: 2.1 time: 0.114376 Sep 10 12:32:00.642036 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3327/6658] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:32:00 2022] DELETE /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:32:00.650356 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3c3a69a8-10ee-424c-b4fc-2cbe9cb7a984 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:32:00.650974 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3c3a69a8-10ee-424c-b4fc-2cbe9cb7a984 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 1372b1e6-f6cd-42e5-9100-80c7f087ee57] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:32:00.653703 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:32:00.659673 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3c3a69a8-10ee-424c-b4fc-2cbe9cb7a984 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:00.660179 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3c3a69a8-10ee-424c-b4fc-2cbe9cb7a984 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:00.660633 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3c3a69a8-10ee-424c-b4fc-2cbe9cb7a984 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:00.661345 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3c3a69a8-10ee-424c-b4fc-2cbe9cb7a984 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:00.661814 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3c3a69a8-10ee-424c-b4fc-2cbe9cb7a984 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:00.662261 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3c3a69a8-10ee-424c-b4fc-2cbe9cb7a984 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:00.666774 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:32:00.794043 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3c3a69a8-10ee-424c-b4fc-2cbe9cb7a984 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:32:00.802636 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3c3a69a8-10ee-424c-b4fc-2cbe9cb7a984 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57" status: 200 len: 1409 microversion: 2.1 time: 0.156159 Sep 10 12:32:00.803233 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3332/6659] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:32:00 2022] GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57 => generated 1409 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:32:01.826429 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8fa8875a-2212-4ad9-a18c-120ed6cd04d2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:32:01.827194 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8fa8875a-2212-4ad9-a18c-120ed6cd04d2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 1372b1e6-f6cd-42e5-9100-80c7f087ee57] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:32:01.830587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:32:01.836578 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8fa8875a-2212-4ad9-a18c-120ed6cd04d2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:01.837067 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8fa8875a-2212-4ad9-a18c-120ed6cd04d2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:01.837505 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8fa8875a-2212-4ad9-a18c-120ed6cd04d2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:01.838200 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8fa8875a-2212-4ad9-a18c-120ed6cd04d2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:01.838657 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8fa8875a-2212-4ad9-a18c-120ed6cd04d2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:01.839084 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8fa8875a-2212-4ad9-a18c-120ed6cd04d2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:01.843750 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:32:01.975139 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8fa8875a-2212-4ad9-a18c-120ed6cd04d2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:32:01.983023 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8fa8875a-2212-4ad9-a18c-120ed6cd04d2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57" status: 200 len: 1409 microversion: 2.1 time: 0.160845 Sep 10 12:32:01.983792 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3328/6660] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:32:01 2022] GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57 => generated 1409 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:32:02.942480 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-1d8c0d80-bf1a-41ef-881e-58b0203749a2 req-672daaba-7498-4355-b6dc-91ea7e140dbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1372b1e6-f6cd-42e5-9100-80c7f087ee57", "name": "network-vif-deleted", "tag": "da4923ab-b3ce-48d3-8910-6afc5fd1eea9"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:32:02.952979 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-1d8c0d80-bf1a-41ef-881e-58b0203749a2 req-672daaba-7498-4355-b6dc-91ea7e140dbb service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:02.953483 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-1d8c0d80-bf1a-41ef-881e-58b0203749a2 req-672daaba-7498-4355-b6dc-91ea7e140dbb service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:02.953925 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-1d8c0d80-bf1a-41ef-881e-58b0203749a2 req-672daaba-7498-4355-b6dc-91ea7e140dbb service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:02.965443 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-1d8c0d80-bf1a-41ef-881e-58b0203749a2 req-672daaba-7498-4355-b6dc-91ea7e140dbb service nova] Creating event network-vif-deleted:da4923ab-b3ce-48d3-8910-6afc5fd1eea9 for instance 1372b1e6-f6cd-42e5-9100-80c7f087ee57 on n-h1-856895-1 Sep 10 12:32:02.971371 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-1d8c0d80-bf1a-41ef-881e-58b0203749a2 req-672daaba-7498-4355-b6dc-91ea7e140dbb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032657 Sep 10 12:32:02.972182 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3333/6661] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:32:03.006918 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4731e1e6-f2f2-4a7b-b254-7fcbdb00274a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:32:03.007623 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4731e1e6-f2f2-4a7b-b254-7fcbdb00274a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 1372b1e6-f6cd-42e5-9100-80c7f087ee57] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:32:03.014319 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4731e1e6-f2f2-4a7b-b254-7fcbdb00274a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:03.014810 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4731e1e6-f2f2-4a7b-b254-7fcbdb00274a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:03.015309 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4731e1e6-f2f2-4a7b-b254-7fcbdb00274a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:03.016836 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4731e1e6-f2f2-4a7b-b254-7fcbdb00274a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:03.017326 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4731e1e6-f2f2-4a7b-b254-7fcbdb00274a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:03.017767 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4731e1e6-f2f2-4a7b-b254-7fcbdb00274a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:03.091492 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4731e1e6-f2f2-4a7b-b254-7fcbdb00274a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:32:03.100227 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4731e1e6-f2f2-4a7b-b254-7fcbdb00274a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57" status: 200 len: 1201 microversion: 2.1 time: 0.097648 Sep 10 12:32:03.100826 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3329/6662] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:32:03 2022] GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57 => generated 1201 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:32:04.126281 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dfd6dae9-d6f7-43db-8bf2-ba96830a1b87 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:32:04.126907 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-dfd6dae9-d6f7-43db-8bf2-ba96830a1b87 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 1372b1e6-f6cd-42e5-9100-80c7f087ee57] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:32:04.133482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dfd6dae9-d6f7-43db-8bf2-ba96830a1b87 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:04.133991 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dfd6dae9-d6f7-43db-8bf2-ba96830a1b87 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:04.134454 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dfd6dae9-d6f7-43db-8bf2-ba96830a1b87 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:04.135188 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dfd6dae9-d6f7-43db-8bf2-ba96830a1b87 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:04.135674 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dfd6dae9-d6f7-43db-8bf2-ba96830a1b87 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:04.136185 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dfd6dae9-d6f7-43db-8bf2-ba96830a1b87 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:04.202737 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-dfd6dae9-d6f7-43db-8bf2-ba96830a1b87 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:32:04.211414 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-dfd6dae9-d6f7-43db-8bf2-ba96830a1b87 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57" status: 200 len: 1201 microversion: 2.1 time: 0.091048 Sep 10 12:32:04.212005 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3334/6663] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:32:04 2022] GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57 => generated 1201 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:32:05.234712 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4683cf3c-29e3-415e-97f8-9ac8ef28d960 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:32:05.235734 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4683cf3c-29e3-415e-97f8-9ac8ef28d960 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 1372b1e6-f6cd-42e5-9100-80c7f087ee57] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:32:05.243619 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4683cf3c-29e3-415e-97f8-9ac8ef28d960 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:05.244101 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4683cf3c-29e3-415e-97f8-9ac8ef28d960 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:05.244531 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4683cf3c-29e3-415e-97f8-9ac8ef28d960 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:05.245226 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4683cf3c-29e3-415e-97f8-9ac8ef28d960 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:05.245815 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4683cf3c-29e3-415e-97f8-9ac8ef28d960 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:05.246237 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4683cf3c-29e3-415e-97f8-9ac8ef28d960 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:05.317126 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4683cf3c-29e3-415e-97f8-9ac8ef28d960 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:32:05.330526 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4683cf3c-29e3-415e-97f8-9ac8ef28d960 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57" status: 200 len: 1201 microversion: 2.1 time: 0.100258 Sep 10 12:32:05.331192 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3330/6664] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:32:05 2022] GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57 => generated 1201 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:32:06.354030 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bd856857-3152-4830-817a-7a73a4498e86 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:32:06.354702 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bd856857-3152-4830-817a-7a73a4498e86 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 1372b1e6-f6cd-42e5-9100-80c7f087ee57] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:32:06.362000 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd856857-3152-4830-817a-7a73a4498e86 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:06.362527 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd856857-3152-4830-817a-7a73a4498e86 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:06.362967 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd856857-3152-4830-817a-7a73a4498e86 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:06.363718 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd856857-3152-4830-817a-7a73a4498e86 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:06.364192 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd856857-3152-4830-817a-7a73a4498e86 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:06.364647 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd856857-3152-4830-817a-7a73a4498e86 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:06.426863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bd856857-3152-4830-817a-7a73a4498e86 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:32:06.434860 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bd856857-3152-4830-817a-7a73a4498e86 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57" status: 200 len: 1201 microversion: 2.1 time: 0.084837 Sep 10 12:32:06.435462 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3335/6665] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:32:06 2022] GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57 => generated 1201 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:32:07.458456 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-301be47d-a094-4935-85a8-5b97cc0dd380 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:32:07.459072 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-301be47d-a094-4935-85a8-5b97cc0dd380 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 1372b1e6-f6cd-42e5-9100-80c7f087ee57] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:32:07.466402 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-301be47d-a094-4935-85a8-5b97cc0dd380 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:07.466891 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-301be47d-a094-4935-85a8-5b97cc0dd380 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:07.467368 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-301be47d-a094-4935-85a8-5b97cc0dd380 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:07.468095 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-301be47d-a094-4935-85a8-5b97cc0dd380 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:07.469429 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-301be47d-a094-4935-85a8-5b97cc0dd380 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:07.469599 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-301be47d-a094-4935-85a8-5b97cc0dd380 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:07.500811 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-301be47d-a094-4935-85a8-5b97cc0dd380 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:07.501291 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-301be47d-a094-4935-85a8-5b97cc0dd380 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:07.501735 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-301be47d-a094-4935-85a8-5b97cc0dd380 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:07.502189 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-301be47d-a094-4935-85a8-5b97cc0dd380 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lazy-loading 'fault' on Instance uuid 1372b1e6-f6cd-42e5-9100-80c7f087ee57 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:32:07.546544 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-301be47d-a094-4935-85a8-5b97cc0dd380 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:32:07.561205 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-301be47d-a094-4935-85a8-5b97cc0dd380 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57" status: 200 len: 1206 microversion: 2.1 time: 0.106547 Sep 10 12:32:07.561806 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3331/6666] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:32:07 2022] GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57 => generated 1206 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:32:08.584970 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e86c534e-8949-459e-9a54-eef2ffbb85df tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:32:08.585650 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e86c534e-8949-459e-9a54-eef2ffbb85df tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 1372b1e6-f6cd-42e5-9100-80c7f087ee57] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:32:08.592675 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e86c534e-8949-459e-9a54-eef2ffbb85df tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:08.593190 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e86c534e-8949-459e-9a54-eef2ffbb85df tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:08.594193 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e86c534e-8949-459e-9a54-eef2ffbb85df tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:08.594896 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e86c534e-8949-459e-9a54-eef2ffbb85df tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:08.595407 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e86c534e-8949-459e-9a54-eef2ffbb85df tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:08.595859 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e86c534e-8949-459e-9a54-eef2ffbb85df tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:08.610922 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-e86c534e-8949-459e-9a54-eef2ffbb85df tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] HTTP exception thrown: Instance 1372b1e6-f6cd-42e5-9100-80c7f087ee57 could not be found. Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e86c534e-8949-459e-9a54-eef2ffbb85df tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Request method failure captured: Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57 HTTP/1.1 Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHILszP5bh-7vS5nFlniigSPwJSgl9gRBzD28JMJ3uXj7KaJ7IKD0MoPbGUyk7NiR2g3O-OhOoEJg5Mrgl8pVom5QsCHuzRwflIP07SHDWyP4-s7StMch63ybX3LIelpp866T-_UOtQoKy1YDkCCnydW84pCURv3Zlf7uIJ_dXgYsc64 Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: e27276f18d8045e2a9be7a6c5ed892f7 Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e27276f18d8045e2a9be7a6c5ed892f7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: e27276f18d8045e2a9be7a6c5ed892f7 Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-TestVolumeBootPattern-1940983644-project Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 5f0b168293f943389d72753009c88789 Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-TestVolumeBootPattern-1940983644-project Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 1372b1e6-f6cd-42e5-9100-80c7f087ee57 could not be found. Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '1372b1e6-f6cd-42e5-9100-80c7f087ee57'} Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1372b1e6-f6cd-42e5-9100-80c7f087ee57 could not be found. Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1372b1e6-f6cd-42e5-9100-80c7f087ee57 could not be found. Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:32:08.612679 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:32:08.617564 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:32:08.617564 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:32:08.617564 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:32:08.617564 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:32:08.617564 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:32:08.617564 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1372b1e6-f6cd-42e5-9100-80c7f087ee57 could not be found. Sep 10 12:32:08.617564 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:32:08.617564 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e86c534e-8949-459e-9a54-eef2ffbb85df tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Returning 404 to user: Instance 1372b1e6-f6cd-42e5-9100-80c7f087ee57 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:32:08.617564 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e86c534e-8949-459e-9a54-eef2ffbb85df tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57" status: 404 len: 111 microversion: 2.1 time: 0.033198 Sep 10 12:32:08.617564 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3336/6667] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:32:08 2022] GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:32:10.759966 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7d87e246-02da-490e-81c5-134650c9ea6b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:32:10.760467 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7d87e246-02da-490e-81c5-134650c9ea6b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 09865a41-3828-4a33-bdfe-28bedbfb5ef8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:32:10.768172 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d87e246-02da-490e-81c5-134650c9ea6b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:10.768799 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d87e246-02da-490e-81c5-134650c9ea6b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:10.769242 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d87e246-02da-490e-81c5-134650c9ea6b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:10.769940 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d87e246-02da-490e-81c5-134650c9ea6b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:10.770396 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d87e246-02da-490e-81c5-134650c9ea6b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:10.770824 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d87e246-02da-490e-81c5-134650c9ea6b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:10.784533 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-7d87e246-02da-490e-81c5-134650c9ea6b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] HTTP exception thrown: Instance 09865a41-3828-4a33-bdfe-28bedbfb5ef8 could not be found. Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7d87e246-02da-490e-81c5-134650c9ea6b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Request method failure captured: Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8 HTTP/1.1 Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHILszP5bh-7vS5nFlniigSPwJSgl9gRBzD28JMJ3uXj7KaJ7IKD0MoPbGUyk7NiR2g3O-OhOoEJg5Mrgl8pVom5QsCHuzRwflIP07SHDWyP4-s7StMch63ybX3LIelpp866T-_UOtQoKy1YDkCCnydW84pCURv3Zlf7uIJ_dXgYsc64 Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: e27276f18d8045e2a9be7a6c5ed892f7 Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e27276f18d8045e2a9be7a6c5ed892f7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: e27276f18d8045e2a9be7a6c5ed892f7 Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-TestVolumeBootPattern-1940983644-project Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 5f0b168293f943389d72753009c88789 Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-TestVolumeBootPattern-1940983644-project Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 09865a41-3828-4a33-bdfe-28bedbfb5ef8 could not be found. Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '09865a41-3828-4a33-bdfe-28bedbfb5ef8'} Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09865a41-3828-4a33-bdfe-28bedbfb5ef8 could not be found. Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:32:10.786211 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:32:10.790394 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09865a41-3828-4a33-bdfe-28bedbfb5ef8 could not be found. Sep 10 12:32:10.790394 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:32:10.790394 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:32:10.790394 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:32:10.790394 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:32:10.790394 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:32:10.790394 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:32:10.790394 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:32:10.790394 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:32:10.790394 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09865a41-3828-4a33-bdfe-28bedbfb5ef8 could not be found. Sep 10 12:32:10.790394 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:32:10.790394 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7d87e246-02da-490e-81c5-134650c9ea6b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Returning 404 to user: Instance 09865a41-3828-4a33-bdfe-28bedbfb5ef8 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:32:10.790394 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7d87e246-02da-490e-81c5-134650c9ea6b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "DELETE /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8" status: 404 len: 111 microversion: 2.1 time: 0.031669 Sep 10 12:32:10.790394 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3332/6668] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:32:10 2022] DELETE /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:32:10.796641 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4ed3b0f9-462e-4cad-ad74-1ebf48234e40 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:32:10.797279 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4ed3b0f9-462e-4cad-ad74-1ebf48234e40 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 09865a41-3828-4a33-bdfe-28bedbfb5ef8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:32:10.804477 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ed3b0f9-462e-4cad-ad74-1ebf48234e40 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:10.804976 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ed3b0f9-462e-4cad-ad74-1ebf48234e40 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:10.805425 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ed3b0f9-462e-4cad-ad74-1ebf48234e40 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:10.806134 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ed3b0f9-462e-4cad-ad74-1ebf48234e40 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:10.806603 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ed3b0f9-462e-4cad-ad74-1ebf48234e40 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:10.807038 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4ed3b0f9-462e-4cad-ad74-1ebf48234e40 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:10.821494 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-4ed3b0f9-462e-4cad-ad74-1ebf48234e40 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] HTTP exception thrown: Instance 09865a41-3828-4a33-bdfe-28bedbfb5ef8 could not be found. Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4ed3b0f9-462e-4cad-ad74-1ebf48234e40 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Request method failure captured: Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8 HTTP/1.1 Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHILszP5bh-7vS5nFlniigSPwJSgl9gRBzD28JMJ3uXj7KaJ7IKD0MoPbGUyk7NiR2g3O-OhOoEJg5Mrgl8pVom5QsCHuzRwflIP07SHDWyP4-s7StMch63ybX3LIelpp866T-_UOtQoKy1YDkCCnydW84pCURv3Zlf7uIJ_dXgYsc64 Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: e27276f18d8045e2a9be7a6c5ed892f7 Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e27276f18d8045e2a9be7a6c5ed892f7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: e27276f18d8045e2a9be7a6c5ed892f7 Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-TestVolumeBootPattern-1940983644-project Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 5f0b168293f943389d72753009c88789 Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-TestVolumeBootPattern-1940983644-project Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 09865a41-3828-4a33-bdfe-28bedbfb5ef8 could not be found. Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '09865a41-3828-4a33-bdfe-28bedbfb5ef8'} Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09865a41-3828-4a33-bdfe-28bedbfb5ef8 could not be found. Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09865a41-3828-4a33-bdfe-28bedbfb5ef8 could not be found. Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:32:10.823095 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:32:10.826671 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:32:10.826671 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:32:10.826671 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:32:10.826671 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:32:10.826671 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:32:10.826671 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09865a41-3828-4a33-bdfe-28bedbfb5ef8 could not be found. Sep 10 12:32:10.826671 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:32:10.826671 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4ed3b0f9-462e-4cad-ad74-1ebf48234e40 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Returning 404 to user: Instance 09865a41-3828-4a33-bdfe-28bedbfb5ef8 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:32:10.826671 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4ed3b0f9-462e-4cad-ad74-1ebf48234e40 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8" status: 404 len: 111 microversion: 2.1 time: 0.032048 Sep 10 12:32:10.826671 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3337/6669] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:32:10 2022] GET /compute/v2.1/servers/09865a41-3828-4a33-bdfe-28bedbfb5ef8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:32:11.203590 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1113650b-c323-4bbe-87c0-bf9fcee65316 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:32:11.204123 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1113650b-c323-4bbe-87c0-bf9fcee65316 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 1372b1e6-f6cd-42e5-9100-80c7f087ee57] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:32:11.210081 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1113650b-c323-4bbe-87c0-bf9fcee65316 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:11.210561 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1113650b-c323-4bbe-87c0-bf9fcee65316 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:11.211003 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1113650b-c323-4bbe-87c0-bf9fcee65316 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:11.211729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1113650b-c323-4bbe-87c0-bf9fcee65316 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:11.212183 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1113650b-c323-4bbe-87c0-bf9fcee65316 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:11.212610 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1113650b-c323-4bbe-87c0-bf9fcee65316 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:11.226119 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-1113650b-c323-4bbe-87c0-bf9fcee65316 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] HTTP exception thrown: Instance 1372b1e6-f6cd-42e5-9100-80c7f087ee57 could not be found. Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1113650b-c323-4bbe-87c0-bf9fcee65316 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Request method failure captured: Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57 HTTP/1.1 Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHILszP5bh-7vS5nFlniigSPwJSgl9gRBzD28JMJ3uXj7KaJ7IKD0MoPbGUyk7NiR2g3O-OhOoEJg5Mrgl8pVom5QsCHuzRwflIP07SHDWyP4-s7StMch63ybX3LIelpp866T-_UOtQoKy1YDkCCnydW84pCURv3Zlf7uIJ_dXgYsc64 Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: e27276f18d8045e2a9be7a6c5ed892f7 Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e27276f18d8045e2a9be7a6c5ed892f7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: e27276f18d8045e2a9be7a6c5ed892f7 Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-TestVolumeBootPattern-1940983644-project Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 5f0b168293f943389d72753009c88789 Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-TestVolumeBootPattern-1940983644-project Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 1372b1e6-f6cd-42e5-9100-80c7f087ee57 could not be found. Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '1372b1e6-f6cd-42e5-9100-80c7f087ee57'} Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1372b1e6-f6cd-42e5-9100-80c7f087ee57 could not be found. Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:32:11.227691 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:32:11.231312 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1372b1e6-f6cd-42e5-9100-80c7f087ee57 could not be found. Sep 10 12:32:11.231312 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:32:11.231312 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:32:11.231312 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:32:11.231312 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:32:11.231312 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:32:11.231312 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:32:11.231312 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:32:11.231312 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:32:11.231312 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1372b1e6-f6cd-42e5-9100-80c7f087ee57 could not be found. Sep 10 12:32:11.231312 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:32:11.231312 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1113650b-c323-4bbe-87c0-bf9fcee65316 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Returning 404 to user: Instance 1372b1e6-f6cd-42e5-9100-80c7f087ee57 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:32:11.231312 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1113650b-c323-4bbe-87c0-bf9fcee65316 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57" status: 404 len: 111 microversion: 2.1 time: 0.029694 Sep 10 12:32:11.231312 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3333/6670] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:32:11 2022] DELETE /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:32:11.238258 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d9777633-e4f8-4251-94be-c6daf958298d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:32:11.238920 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d9777633-e4f8-4251-94be-c6daf958298d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 1372b1e6-f6cd-42e5-9100-80c7f087ee57] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:32:11.245227 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d9777633-e4f8-4251-94be-c6daf958298d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:11.245723 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d9777633-e4f8-4251-94be-c6daf958298d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:11.246173 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d9777633-e4f8-4251-94be-c6daf958298d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:11.246870 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d9777633-e4f8-4251-94be-c6daf958298d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:11.247373 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d9777633-e4f8-4251-94be-c6daf958298d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:11.247812 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d9777633-e4f8-4251-94be-c6daf958298d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:11.261713 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-d9777633-e4f8-4251-94be-c6daf958298d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] HTTP exception thrown: Instance 1372b1e6-f6cd-42e5-9100-80c7f087ee57 could not be found. Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d9777633-e4f8-4251-94be-c6daf958298d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Request method failure captured: Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57 HTTP/1.1 Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHILszP5bh-7vS5nFlniigSPwJSgl9gRBzD28JMJ3uXj7KaJ7IKD0MoPbGUyk7NiR2g3O-OhOoEJg5Mrgl8pVom5QsCHuzRwflIP07SHDWyP4-s7StMch63ybX3LIelpp866T-_UOtQoKy1YDkCCnydW84pCURv3Zlf7uIJ_dXgYsc64 Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: e27276f18d8045e2a9be7a6c5ed892f7 Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e27276f18d8045e2a9be7a6c5ed892f7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: e27276f18d8045e2a9be7a6c5ed892f7 Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-TestVolumeBootPattern-1940983644-project Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 5f0b168293f943389d72753009c88789 Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-TestVolumeBootPattern-1940983644-project Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 1372b1e6-f6cd-42e5-9100-80c7f087ee57 could not be found. Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '1372b1e6-f6cd-42e5-9100-80c7f087ee57'} Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1372b1e6-f6cd-42e5-9100-80c7f087ee57 could not be found. Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1372b1e6-f6cd-42e5-9100-80c7f087ee57 could not be found. Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:32:11.263235 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:32:11.266591 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:32:11.266591 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:32:11.266591 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:32:11.266591 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:32:11.266591 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:32:11.266591 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1372b1e6-f6cd-42e5-9100-80c7f087ee57 could not be found. Sep 10 12:32:11.266591 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:32:11.266591 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d9777633-e4f8-4251-94be-c6daf958298d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Returning 404 to user: Instance 1372b1e6-f6cd-42e5-9100-80c7f087ee57 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:32:11.266591 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d9777633-e4f8-4251-94be-c6daf958298d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57" status: 404 len: 111 microversion: 2.1 time: 0.030930 Sep 10 12:32:11.266591 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3338/6671] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:32:11 2022] GET /compute/v2.1/servers/1372b1e6-f6cd-42e5-9100-80c7f087ee57 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:32:11.337696 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6a9426c0-c415-418d-9974-66a1bc55d9c9 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Action: 'create', calling method: .version_select at 0x7f4071dbe3a0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1302349969", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1DcQBtcL2TImcmqj0AoRMpdB26OYLeR0E/y3HYSSYQmQMVkBEDbhkJAyqVqk73BTRLzTPQDbaCtzgk5h2q6JAgveMU6W8M+36AgkUX2tvtw7sqXX/CdFkq2zZMoXdhhA=="}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:32:11.353150 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-6a9426c0-c415-418d-9974-66a1bc55d9c9 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Getting quotas for project e27276f18d8045e2a9be7a6c5ed892f7. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:32:11.358202 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-6a9426c0-c415-418d-9974-66a1bc55d9c9 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Getting quotas for user 5f0b168293f943389d72753009c88789 and project e27276f18d8045e2a9be7a6c5ed892f7. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:32:11.386688 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6a9426c0-c415-418d-9974-66a1bc55d9c9 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.052741 Sep 10 12:32:11.387337 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3334/6672] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 12:32:11 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:32:27.608802 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c75d9698-c3d8-4680-b6f1-65c6b387a0dd tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-484970715", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1302349969", "security_groups": [{"name": "tempest-secgroup-smoke-625640396"}], "block_device_mapping_v2": [{"uuid": "98c68380-4a3b-4fab-b8b7-56e0b8494501", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "63bc1cec-19c3-45db-83f8-21772e061ea1"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:32:27.620297 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=13 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:32:27.620978 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=25 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:32:27.725848 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-c75d9698-c3d8-4680-b6f1-65c6b387a0dd tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] validate_networks() for [('63bc1cec-19c3-45db-83f8-21772e061ea1', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:32:28.143565 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-c75d9698-c3d8-4680-b6f1-65c6b387a0dd tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:32:28.144248 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-c75d9698-c3d8-4680-b6f1-65c6b387a0dd tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:32:28.144744 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-c75d9698-c3d8-4680-b6f1-65c6b387a0dd tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:32:28.145174 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-c75d9698-c3d8-4680-b6f1-65c6b387a0dd tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:32:28.145604 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-c75d9698-c3d8-4680-b6f1-65c6b387a0dd tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:32:28.154469 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c75d9698-c3d8-4680-b6f1-65c6b387a0dd tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:28.154960 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c75d9698-c3d8-4680-b6f1-65c6b387a0dd tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:28.155448 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c75d9698-c3d8-4680-b6f1-65c6b387a0dd tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:28.156189 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c75d9698-c3d8-4680-b6f1-65c6b387a0dd tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:28.156658 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c75d9698-c3d8-4680-b6f1-65c6b387a0dd tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:28.157842 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c75d9698-c3d8-4680-b6f1-65c6b387a0dd tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:28.175538 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-c75d9698-c3d8-4680-b6f1-65c6b387a0dd tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Getting quotas for project e27276f18d8045e2a9be7a6c5ed892f7. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:32:28.180925 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-c75d9698-c3d8-4680-b6f1-65c6b387a0dd tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Getting quotas for user 5f0b168293f943389d72753009c88789 and project e27276f18d8045e2a9be7a6c5ed892f7. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:32:28.239061 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c75d9698-c3d8-4680-b6f1-65c6b387a0dd tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:32:28.241338 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c75d9698-c3d8-4680-b6f1-65c6b387a0dd tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: e7c59379-7e4c-4a26-87d4-6074baabf96d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='98c68380-4a3b-4fab-b8b7-56e0b8494501',volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:32:28.377991 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c75d9698-c3d8-4680-b6f1-65c6b387a0dd tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.772998 Sep 10 12:32:28.378696 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3339/6673] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:32:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:32:28.387693 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=29 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:32:28.389035 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=4 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:32:28.389739 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:32:28.395807 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-025eb84b-b7cc-4af7-aad7-14b09a8d854d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:32:28.396447 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-025eb84b-b7cc-4af7-aad7-14b09a8d854d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: e7c59379-7e4c-4a26-87d4-6074baabf96d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:32:28.452948 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-025eb84b-b7cc-4af7-aad7-14b09a8d854d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:32:28.460559 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-025eb84b-b7cc-4af7-aad7-14b09a8d854d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d" status: 200 len: 1094 microversion: 2.1 time: 0.074620 Sep 10 12:32:28.461135 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3335/6674] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:32:28 2022] GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:32:29.486122 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5192d29d-6994-4158-8f31-6652d736569a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:32:29.486808 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5192d29d-6994-4158-8f31-6652d736569a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: e7c59379-7e4c-4a26-87d4-6074baabf96d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:32:29.493354 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5192d29d-6994-4158-8f31-6652d736569a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:29.493870 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5192d29d-6994-4158-8f31-6652d736569a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:29.494340 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5192d29d-6994-4158-8f31-6652d736569a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:29.495059 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5192d29d-6994-4158-8f31-6652d736569a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:29.495871 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5192d29d-6994-4158-8f31-6652d736569a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:29.496002 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5192d29d-6994-4158-8f31-6652d736569a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:29.570028 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5192d29d-6994-4158-8f31-6652d736569a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:32:29.577999 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5192d29d-6994-4158-8f31-6652d736569a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d" status: 200 len: 1210 microversion: 2.1 time: 0.096988 Sep 10 12:32:29.580182 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3340/6675] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:32:29 2022] GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d => generated 1210 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:32:30.602297 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8e4e9625-1eb1-44c3-bd45-e025948d7bff tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:32:30.603045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8e4e9625-1eb1-44c3-bd45-e025948d7bff tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: e7c59379-7e4c-4a26-87d4-6074baabf96d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:32:30.611594 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e4e9625-1eb1-44c3-bd45-e025948d7bff tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:30.612178 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e4e9625-1eb1-44c3-bd45-e025948d7bff tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:30.612838 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e4e9625-1eb1-44c3-bd45-e025948d7bff tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:30.613472 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e4e9625-1eb1-44c3-bd45-e025948d7bff tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:30.614004 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e4e9625-1eb1-44c3-bd45-e025948d7bff tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:30.614638 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e4e9625-1eb1-44c3-bd45-e025948d7bff tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:31.188413 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8e4e9625-1eb1-44c3-bd45-e025948d7bff tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:32:31.197293 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8e4e9625-1eb1-44c3-bd45-e025948d7bff tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d" status: 200 len: 1277 microversion: 2.1 time: 0.599205 Sep 10 12:32:31.197875 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3336/6676] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:32:30 2022] GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d => generated 1277 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:32:31.312554 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-b430ec2e-6c59-42e5-b1cd-e7147743b3ec req-196745ac-7bfa-47ac-8d26-4ae33241e1c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7c59379-7e4c-4a26-87d4-6074baabf96d", "tag": "1a659b8f-81e9-42a7-b561-d3bf74c102d9"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:32:31.327790 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-b430ec2e-6c59-42e5-b1cd-e7147743b3ec req-196745ac-7bfa-47ac-8d26-4ae33241e1c7 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:31.328290 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-b430ec2e-6c59-42e5-b1cd-e7147743b3ec req-196745ac-7bfa-47ac-8d26-4ae33241e1c7 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:31.329508 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-b430ec2e-6c59-42e5-b1cd-e7147743b3ec req-196745ac-7bfa-47ac-8d26-4ae33241e1c7 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:31.341435 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-b430ec2e-6c59-42e5-b1cd-e7147743b3ec req-196745ac-7bfa-47ac-8d26-4ae33241e1c7 service nova] Creating event network-changed:1a659b8f-81e9-42a7-b561-d3bf74c102d9 for instance e7c59379-7e4c-4a26-87d4-6074baabf96d on n-h1-856895-1 Sep 10 12:32:31.348107 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-b430ec2e-6c59-42e5-b1cd-e7147743b3ec req-196745ac-7bfa-47ac-8d26-4ae33241e1c7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045669 Sep 10 12:32:31.349350 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3341/6677] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:32:32.220867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2324903f-bf88-4548-9ad4-c7cc74f2f61c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:32:32.221665 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2324903f-bf88-4548-9ad4-c7cc74f2f61c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: e7c59379-7e4c-4a26-87d4-6074baabf96d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:32:32.229069 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2324903f-bf88-4548-9ad4-c7cc74f2f61c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:32.229675 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2324903f-bf88-4548-9ad4-c7cc74f2f61c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:32.230232 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2324903f-bf88-4548-9ad4-c7cc74f2f61c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:32.231071 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2324903f-bf88-4548-9ad4-c7cc74f2f61c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:32.231658 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2324903f-bf88-4548-9ad4-c7cc74f2f61c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:32.232188 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2324903f-bf88-4548-9ad4-c7cc74f2f61c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:32.395372 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2324903f-bf88-4548-9ad4-c7cc74f2f61c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:32:32.403955 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2324903f-bf88-4548-9ad4-c7cc74f2f61c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d" status: 200 len: 1277 microversion: 2.1 time: 0.187190 Sep 10 12:32:32.404552 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3337/6678] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:32:32 2022] GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d => generated 1277 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:32:33.429962 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-45259557-ba7b-4d2b-89d5-b2b92b8f4d8c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:32:33.430681 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-45259557-ba7b-4d2b-89d5-b2b92b8f4d8c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: e7c59379-7e4c-4a26-87d4-6074baabf96d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:32:33.437049 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-45259557-ba7b-4d2b-89d5-b2b92b8f4d8c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:33.437541 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-45259557-ba7b-4d2b-89d5-b2b92b8f4d8c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:33.438189 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-45259557-ba7b-4d2b-89d5-b2b92b8f4d8c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:33.438995 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-45259557-ba7b-4d2b-89d5-b2b92b8f4d8c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:33.439492 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-45259557-ba7b-4d2b-89d5-b2b92b8f4d8c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:33.439932 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-45259557-ba7b-4d2b-89d5-b2b92b8f4d8c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:33.575925 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-45259557-ba7b-4d2b-89d5-b2b92b8f4d8c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:32:33.584425 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-45259557-ba7b-4d2b-89d5-b2b92b8f4d8c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d" status: 200 len: 1277 microversion: 2.1 time: 0.159537 Sep 10 12:32:33.585028 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3342/6679] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:32:33 2022] GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:32:34.606974 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0552bdaa-32ac-479a-87b7-60820ddee837 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:32:34.607624 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0552bdaa-32ac-479a-87b7-60820ddee837 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: e7c59379-7e4c-4a26-87d4-6074baabf96d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:32:34.615372 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0552bdaa-32ac-479a-87b7-60820ddee837 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:34.615864 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0552bdaa-32ac-479a-87b7-60820ddee837 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:34.616309 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0552bdaa-32ac-479a-87b7-60820ddee837 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:34.617266 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0552bdaa-32ac-479a-87b7-60820ddee837 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:34.617726 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0552bdaa-32ac-479a-87b7-60820ddee837 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:34.618170 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0552bdaa-32ac-479a-87b7-60820ddee837 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:34.757002 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0552bdaa-32ac-479a-87b7-60820ddee837 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:32:34.764818 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0552bdaa-32ac-479a-87b7-60820ddee837 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d" status: 200 len: 1265 microversion: 2.1 time: 0.161804 Sep 10 12:32:34.765429 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3338/6680] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:32:34 2022] GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:32:35.788989 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ceb430a5-aebe-48bd-8b7b-cfdbbc4fde3f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:32:35.789974 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ceb430a5-aebe-48bd-8b7b-cfdbbc4fde3f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: e7c59379-7e4c-4a26-87d4-6074baabf96d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:32:35.796892 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ceb430a5-aebe-48bd-8b7b-cfdbbc4fde3f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:35.798069 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ceb430a5-aebe-48bd-8b7b-cfdbbc4fde3f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:35.798532 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ceb430a5-aebe-48bd-8b7b-cfdbbc4fde3f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:35.799275 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ceb430a5-aebe-48bd-8b7b-cfdbbc4fde3f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:35.799752 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ceb430a5-aebe-48bd-8b7b-cfdbbc4fde3f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:35.800199 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ceb430a5-aebe-48bd-8b7b-cfdbbc4fde3f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:35.930592 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ceb430a5-aebe-48bd-8b7b-cfdbbc4fde3f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:32:35.938376 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ceb430a5-aebe-48bd-8b7b-cfdbbc4fde3f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d" status: 200 len: 1265 microversion: 2.1 time: 0.153381 Sep 10 12:32:35.939027 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3343/6681] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:32:35 2022] GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:32:36.961824 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-69e8fd80-f6fa-4147-9ba3-467c962df9b8 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:32:36.962472 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-69e8fd80-f6fa-4147-9ba3-467c962df9b8 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: e7c59379-7e4c-4a26-87d4-6074baabf96d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:32:36.969353 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-69e8fd80-f6fa-4147-9ba3-467c962df9b8 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:36.969921 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-69e8fd80-f6fa-4147-9ba3-467c962df9b8 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:36.970366 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-69e8fd80-f6fa-4147-9ba3-467c962df9b8 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:36.971062 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-69e8fd80-f6fa-4147-9ba3-467c962df9b8 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:36.971549 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-69e8fd80-f6fa-4147-9ba3-467c962df9b8 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:36.971978 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-69e8fd80-f6fa-4147-9ba3-467c962df9b8 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:37.106420 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-69e8fd80-f6fa-4147-9ba3-467c962df9b8 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:32:37.114257 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-69e8fd80-f6fa-4147-9ba3-467c962df9b8 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d" status: 200 len: 1265 microversion: 2.1 time: 0.156414 Sep 10 12:32:37.114834 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3339/6682] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:32:36 2022] GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:32:38.138005 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-aefc820c-c908-4961-8b0b-47fbb18147dc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:32:38.138644 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-aefc820c-c908-4961-8b0b-47fbb18147dc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: e7c59379-7e4c-4a26-87d4-6074baabf96d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:32:38.145780 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aefc820c-c908-4961-8b0b-47fbb18147dc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:38.146284 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aefc820c-c908-4961-8b0b-47fbb18147dc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:38.146741 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aefc820c-c908-4961-8b0b-47fbb18147dc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:38.147481 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aefc820c-c908-4961-8b0b-47fbb18147dc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:38.147950 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aefc820c-c908-4961-8b0b-47fbb18147dc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:38.148402 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aefc820c-c908-4961-8b0b-47fbb18147dc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:38.166272 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:32:38.187184 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:32:38.281347 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-aefc820c-c908-4961-8b0b-47fbb18147dc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:32:38.289306 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-aefc820c-c908-4961-8b0b-47fbb18147dc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d" status: 200 len: 1265 microversion: 2.1 time: 0.155236 Sep 10 12:32:38.289876 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3344/6683] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:32:38 2022] GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:32:39.312514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-94ea6570-fa3a-4cbe-ab3c-b17f086d3739 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:32:39.314864 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-94ea6570-fa3a-4cbe-ab3c-b17f086d3739 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: e7c59379-7e4c-4a26-87d4-6074baabf96d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:32:39.317605 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:32:39.322991 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94ea6570-fa3a-4cbe-ab3c-b17f086d3739 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:39.323507 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94ea6570-fa3a-4cbe-ab3c-b17f086d3739 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:39.323945 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94ea6570-fa3a-4cbe-ab3c-b17f086d3739 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:39.324631 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94ea6570-fa3a-4cbe-ab3c-b17f086d3739 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:39.325084 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94ea6570-fa3a-4cbe-ab3c-b17f086d3739 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:39.325511 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94ea6570-fa3a-4cbe-ab3c-b17f086d3739 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:39.458924 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-94ea6570-fa3a-4cbe-ab3c-b17f086d3739 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:32:39.466730 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-94ea6570-fa3a-4cbe-ab3c-b17f086d3739 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d" status: 200 len: 1265 microversion: 2.1 time: 0.158147 Sep 10 12:32:39.467339 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3340/6684] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:32:39 2022] GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:32:40.490764 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0c2afd3a-ecc4-454d-8c9e-eaca1e27fc55 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:32:40.491336 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0c2afd3a-ecc4-454d-8c9e-eaca1e27fc55 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: e7c59379-7e4c-4a26-87d4-6074baabf96d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:32:40.498419 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c2afd3a-ecc4-454d-8c9e-eaca1e27fc55 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:40.498913 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c2afd3a-ecc4-454d-8c9e-eaca1e27fc55 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:40.499400 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c2afd3a-ecc4-454d-8c9e-eaca1e27fc55 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:40.500104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c2afd3a-ecc4-454d-8c9e-eaca1e27fc55 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:40.501461 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c2afd3a-ecc4-454d-8c9e-eaca1e27fc55 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:40.501972 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c2afd3a-ecc4-454d-8c9e-eaca1e27fc55 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:40.640993 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0c2afd3a-ecc4-454d-8c9e-eaca1e27fc55 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:32:40.648772 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0c2afd3a-ecc4-454d-8c9e-eaca1e27fc55 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d" status: 200 len: 1265 microversion: 2.1 time: 0.162173 Sep 10 12:32:40.649352 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3345/6685] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:32:40 2022] GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:32:41.672761 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f8ab3b59-655c-4c7d-b261-688ea66e490d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:32:41.673381 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f8ab3b59-655c-4c7d-b261-688ea66e490d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: e7c59379-7e4c-4a26-87d4-6074baabf96d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:32:41.679886 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8ab3b59-655c-4c7d-b261-688ea66e490d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:41.680374 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8ab3b59-655c-4c7d-b261-688ea66e490d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:41.680814 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8ab3b59-655c-4c7d-b261-688ea66e490d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:41.681504 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8ab3b59-655c-4c7d-b261-688ea66e490d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:41.681965 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8ab3b59-655c-4c7d-b261-688ea66e490d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:41.682396 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f8ab3b59-655c-4c7d-b261-688ea66e490d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:41.815758 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f8ab3b59-655c-4c7d-b261-688ea66e490d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:32:41.823485 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f8ab3b59-655c-4c7d-b261-688ea66e490d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d" status: 200 len: 1265 microversion: 2.1 time: 0.154954 Sep 10 12:32:41.824065 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3341/6686] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:32:41 2022] GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:32:42.846915 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-13506981-2613-48bd-a22e-6ed93daea4bb tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:32:42.847474 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-13506981-2613-48bd-a22e-6ed93daea4bb tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: e7c59379-7e4c-4a26-87d4-6074baabf96d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:32:42.854365 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13506981-2613-48bd-a22e-6ed93daea4bb tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:42.854864 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13506981-2613-48bd-a22e-6ed93daea4bb tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:42.855352 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13506981-2613-48bd-a22e-6ed93daea4bb tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:42.856067 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13506981-2613-48bd-a22e-6ed93daea4bb tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:42.856542 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13506981-2613-48bd-a22e-6ed93daea4bb tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:42.856987 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-13506981-2613-48bd-a22e-6ed93daea4bb tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:42.993709 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-13506981-2613-48bd-a22e-6ed93daea4bb tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:32:43.002061 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-13506981-2613-48bd-a22e-6ed93daea4bb tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d" status: 200 len: 1265 microversion: 2.1 time: 0.159810 Sep 10 12:32:43.002648 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3346/6687] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:32:42 2022] GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:32:44.025421 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d7b8bae8-a7d9-4f6c-a41a-16eb10d508dc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:32:44.026167 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d7b8bae8-a7d9-4f6c-a41a-16eb10d508dc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: e7c59379-7e4c-4a26-87d4-6074baabf96d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:32:44.033792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d7b8bae8-a7d9-4f6c-a41a-16eb10d508dc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:44.034285 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d7b8bae8-a7d9-4f6c-a41a-16eb10d508dc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:44.034725 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d7b8bae8-a7d9-4f6c-a41a-16eb10d508dc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:44.035459 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d7b8bae8-a7d9-4f6c-a41a-16eb10d508dc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:44.035921 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d7b8bae8-a7d9-4f6c-a41a-16eb10d508dc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:44.036351 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d7b8bae8-a7d9-4f6c-a41a-16eb10d508dc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:44.112738 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-c147dd43-2db2-49e6-8b75-27b1f8a61467 req-27ae42bf-5e44-40bd-9ae6-bf2a0f7d53b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7c59379-7e4c-4a26-87d4-6074baabf96d", "name": "network-vif-plugged", "status": "completed", "tag": "1a659b8f-81e9-42a7-b561-d3bf74c102d9"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:32:44.124868 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-c147dd43-2db2-49e6-8b75-27b1f8a61467 req-27ae42bf-5e44-40bd-9ae6-bf2a0f7d53b1 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:44.125469 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-c147dd43-2db2-49e6-8b75-27b1f8a61467 req-27ae42bf-5e44-40bd-9ae6-bf2a0f7d53b1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:44.125922 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-c147dd43-2db2-49e6-8b75-27b1f8a61467 req-27ae42bf-5e44-40bd-9ae6-bf2a0f7d53b1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:44.138838 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-c147dd43-2db2-49e6-8b75-27b1f8a61467 req-27ae42bf-5e44-40bd-9ae6-bf2a0f7d53b1 service nova] Creating event network-vif-plugged:1a659b8f-81e9-42a7-b561-d3bf74c102d9 for instance e7c59379-7e4c-4a26-87d4-6074baabf96d on n-h1-856895-1 Sep 10 12:32:44.144683 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-c147dd43-2db2-49e6-8b75-27b1f8a61467 req-27ae42bf-5e44-40bd-9ae6-bf2a0f7d53b1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036538 Sep 10 12:32:44.145487 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3347/6688] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:32:44.181368 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d7b8bae8-a7d9-4f6c-a41a-16eb10d508dc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:32:44.190456 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d7b8bae8-a7d9-4f6c-a41a-16eb10d508dc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d" status: 200 len: 1265 microversion: 2.1 time: 0.168932 Sep 10 12:32:44.191080 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3342/6689] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:32:44 2022] GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:32:45.214655 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a876da1c-21bc-4754-a0a1-a5d49947555e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:32:45.215407 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a876da1c-21bc-4754-a0a1-a5d49947555e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: e7c59379-7e4c-4a26-87d4-6074baabf96d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:32:45.222216 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a876da1c-21bc-4754-a0a1-a5d49947555e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:45.222703 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a876da1c-21bc-4754-a0a1-a5d49947555e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:45.223153 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a876da1c-21bc-4754-a0a1-a5d49947555e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:45.223869 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a876da1c-21bc-4754-a0a1-a5d49947555e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:45.224334 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a876da1c-21bc-4754-a0a1-a5d49947555e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:45.224770 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a876da1c-21bc-4754-a0a1-a5d49947555e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:45.361978 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a876da1c-21bc-4754-a0a1-a5d49947555e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:32:45.370024 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a876da1c-21bc-4754-a0a1-a5d49947555e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d" status: 200 len: 1265 microversion: 2.1 time: 0.160481 Sep 10 12:32:45.370596 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3348/6690] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:32:45 2022] GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:32:46.394006 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9d16ab03-d183-480c-9d04-95bee81a4af2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:32:46.394591 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9d16ab03-d183-480c-9d04-95bee81a4af2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: e7c59379-7e4c-4a26-87d4-6074baabf96d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:32:46.401368 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9d16ab03-d183-480c-9d04-95bee81a4af2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:46.401851 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9d16ab03-d183-480c-9d04-95bee81a4af2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:46.402294 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9d16ab03-d183-480c-9d04-95bee81a4af2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:46.402983 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9d16ab03-d183-480c-9d04-95bee81a4af2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:46.403466 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9d16ab03-d183-480c-9d04-95bee81a4af2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:46.403896 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9d16ab03-d183-480c-9d04-95bee81a4af2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:46.533714 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9d16ab03-d183-480c-9d04-95bee81a4af2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:32:46.541359 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9d16ab03-d183-480c-9d04-95bee81a4af2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d" status: 200 len: 1452 microversion: 2.1 time: 0.151962 Sep 10 12:32:46.541942 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3343/6691] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:32:46 2022] GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:32:46.564150 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-79d079c3-937f-4a07-9952-92ca6ffc5eb0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:32:46.564877 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-79d079c3-937f-4a07-9952-92ca6ffc5eb0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: e7c59379-7e4c-4a26-87d4-6074baabf96d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:32:46.572423 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79d079c3-937f-4a07-9952-92ca6ffc5eb0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:46.572927 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79d079c3-937f-4a07-9952-92ca6ffc5eb0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:46.573388 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79d079c3-937f-4a07-9952-92ca6ffc5eb0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:46.574103 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79d079c3-937f-4a07-9952-92ca6ffc5eb0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:46.574579 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79d079c3-937f-4a07-9952-92ca6ffc5eb0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:46.575030 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-79d079c3-937f-4a07-9952-92ca6ffc5eb0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:46.711387 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-79d079c3-937f-4a07-9952-92ca6ffc5eb0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:32:46.719510 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-79d079c3-937f-4a07-9952-92ca6ffc5eb0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d" status: 200 len: 1452 microversion: 2.1 time: 0.159901 Sep 10 12:32:46.720125 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3349/6692] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:32:46 2022] GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:32:48.300921 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-9a49b942-1929-459b-8810-9442f0a31135 req-83a75745-8065-40ac-bfe9-711d4ba6a212 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7c59379-7e4c-4a26-87d4-6074baabf96d", "tag": "1a659b8f-81e9-42a7-b561-d3bf74c102d9"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:32:48.311713 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-9a49b942-1929-459b-8810-9442f0a31135 req-83a75745-8065-40ac-bfe9-711d4ba6a212 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:32:48.312186 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-9a49b942-1929-459b-8810-9442f0a31135 req-83a75745-8065-40ac-bfe9-711d4ba6a212 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:32:48.313362 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-9a49b942-1929-459b-8810-9442f0a31135 req-83a75745-8065-40ac-bfe9-711d4ba6a212 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:32:48.327502 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-9a49b942-1929-459b-8810-9442f0a31135 req-83a75745-8065-40ac-bfe9-711d4ba6a212 service nova] Creating event network-changed:1a659b8f-81e9-42a7-b561-d3bf74c102d9 for instance e7c59379-7e4c-4a26-87d4-6074baabf96d on n-h1-856895-1 Sep 10 12:32:48.334266 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-9a49b942-1929-459b-8810-9442f0a31135 req-83a75745-8065-40ac-bfe9-711d4ba6a212 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037356 Sep 10 12:32:48.334902 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3344/6693] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:34:45.721884 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:34:45.722682 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=54 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:34:45.724790 n-d-856895-1 devstack@n-api.service[128776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 10 12:34:45.724993 n-d-856895-1 devstack@n-api.service[128776]: Sat Sep 10 12:34:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d (ip 10.222.0.23) !!! Sep 10 12:34:45.785130 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-98650c5f-58f3-44da-846d-b3eb926a1647 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:34:45.785659 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-98650c5f-58f3-44da-846d-b3eb926a1647 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: e7c59379-7e4c-4a26-87d4-6074baabf96d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:34:45.792426 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-98650c5f-58f3-44da-846d-b3eb926a1647 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:34:45.792930 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-98650c5f-58f3-44da-846d-b3eb926a1647 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:34:45.793389 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-98650c5f-58f3-44da-846d-b3eb926a1647 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:34:45.794099 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-98650c5f-58f3-44da-846d-b3eb926a1647 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:34:45.794574 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-98650c5f-58f3-44da-846d-b3eb926a1647 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:34:45.795019 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-98650c5f-58f3-44da-846d-b3eb926a1647 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:34:45.819759 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-98650c5f-58f3-44da-846d-b3eb926a1647 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: e7c59379-7e4c-4a26-87d4-6074baabf96d] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:34:45.893905 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-98650c5f-58f3-44da-846d-b3eb926a1647 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d" status: 204 len: 0 microversion: 2.1 time: 0.174080 Sep 10 12:34:45.894503 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3350/6694] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:34:45 2022] DELETE /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:34:45.901633 n-d-856895-1 devstack@n-api.service[128777]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9df9aef1-f60c-4e89-81ef-a70ffef5e10e] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 10 12:34:45.903600 n-d-856895-1 devstack@n-api.service[128777]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ff629e48-f4d3-4091-a343-d4a4670d06d6] AMQP server on 10.222.0.23:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 10 12:34:45.904324 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=22 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:34:45.905199 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=50 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:34:45.906865 n-d-856895-1 devstack@n-api.service[128777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 10 12:34:45.907047 n-d-856895-1 devstack@n-api.service[128777]: Sat Sep 10 12:34:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d (ip 10.222.0.23) !!! Sep 10 12:34:45.908442 n-d-856895-1 devstack@n-api.service[128777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 10 12:34:45.908546 n-d-856895-1 devstack@n-api.service[128777]: Sat Sep 10 12:34:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d (ip 10.222.0.23) !!! Sep 10 12:34:45.917138 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0d16da9e-5741-4e23-960f-e3ff239ad2bf tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:34:45.917849 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0d16da9e-5741-4e23-960f-e3ff239ad2bf tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: e7c59379-7e4c-4a26-87d4-6074baabf96d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:34:45.931772 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d16da9e-5741-4e23-960f-e3ff239ad2bf tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:34:45.932264 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d16da9e-5741-4e23-960f-e3ff239ad2bf tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:34:45.932703 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d16da9e-5741-4e23-960f-e3ff239ad2bf tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:34:45.933402 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d16da9e-5741-4e23-960f-e3ff239ad2bf tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:34:45.933862 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d16da9e-5741-4e23-960f-e3ff239ad2bf tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:34:45.934291 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d16da9e-5741-4e23-960f-e3ff239ad2bf tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:34:46.114589 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0d16da9e-5741-4e23-960f-e3ff239ad2bf tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:34:46.123021 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0d16da9e-5741-4e23-960f-e3ff239ad2bf tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d" status: 200 len: 1576 microversion: 2.1 time: 0.223331 Sep 10 12:34:46.123658 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3345/6695] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:34:45 2022] GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d => generated 1576 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:34:47.154557 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-832b6361-8045-45b8-ac1b-025a9798412d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:34:47.155380 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-832b6361-8045-45b8-ac1b-025a9798412d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: e7c59379-7e4c-4a26-87d4-6074baabf96d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:34:47.164370 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-832b6361-8045-45b8-ac1b-025a9798412d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:34:47.164862 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-832b6361-8045-45b8-ac1b-025a9798412d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:34:47.165321 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-832b6361-8045-45b8-ac1b-025a9798412d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:34:47.166026 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-832b6361-8045-45b8-ac1b-025a9798412d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:34:47.166494 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-832b6361-8045-45b8-ac1b-025a9798412d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:34:47.166933 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-832b6361-8045-45b8-ac1b-025a9798412d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:34:47.357658 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-832b6361-8045-45b8-ac1b-025a9798412d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:34:47.365607 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-832b6361-8045-45b8-ac1b-025a9798412d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d" status: 200 len: 1576 microversion: 2.1 time: 0.215525 Sep 10 12:34:47.366493 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3351/6696] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:34:47 2022] GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d => generated 1576 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:34:48.390003 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d920c926-d3b2-4a78-b998-5c856789cece tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:34:48.390529 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d920c926-d3b2-4a78-b998-5c856789cece tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: e7c59379-7e4c-4a26-87d4-6074baabf96d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:34:48.401632 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d920c926-d3b2-4a78-b998-5c856789cece tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:34:48.402138 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d920c926-d3b2-4a78-b998-5c856789cece tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:34:48.402581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d920c926-d3b2-4a78-b998-5c856789cece tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:34:48.403328 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d920c926-d3b2-4a78-b998-5c856789cece tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:34:48.403790 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d920c926-d3b2-4a78-b998-5c856789cece tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:34:48.404226 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d920c926-d3b2-4a78-b998-5c856789cece tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:34:48.424853 n-d-856895-1 devstack@n-api.service[128777]: INFO oslo.messaging._drivers.impl_rabbit [-] [ff629e48-f4d3-4091-a343-d4a4670d06d6] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 33128. Sep 10 12:34:48.426415 n-d-856895-1 devstack@n-api.service[128777]: INFO oslo.messaging._drivers.impl_rabbit [-] [9df9aef1-f60c-4e89-81ef-a70ffef5e10e] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 33126. Sep 10 12:34:48.615895 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d920c926-d3b2-4a78-b998-5c856789cece tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:34:48.624295 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d920c926-d3b2-4a78-b998-5c856789cece tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d" status: 200 len: 1576 microversion: 2.1 time: 0.238417 Sep 10 12:34:48.624884 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3346/6697] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:34:48 2022] GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d => generated 1576 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:34:49.040469 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-9ebcf1cd-1456-4f1d-9871-9018f3766112 req-f94c7568-1eb6-4958-b08d-61d98c19d51f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7c59379-7e4c-4a26-87d4-6074baabf96d", "name": "network-vif-deleted", "tag": "1a659b8f-81e9-42a7-b561-d3bf74c102d9"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:34:49.051205 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-9ebcf1cd-1456-4f1d-9871-9018f3766112 req-f94c7568-1eb6-4958-b08d-61d98c19d51f service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:34:49.051865 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-9ebcf1cd-1456-4f1d-9871-9018f3766112 req-f94c7568-1eb6-4958-b08d-61d98c19d51f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:34:49.052166 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-9ebcf1cd-1456-4f1d-9871-9018f3766112 req-f94c7568-1eb6-4958-b08d-61d98c19d51f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:34:49.071188 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-9ebcf1cd-1456-4f1d-9871-9018f3766112 req-f94c7568-1eb6-4958-b08d-61d98c19d51f service nova] Creating event network-vif-deleted:1a659b8f-81e9-42a7-b561-d3bf74c102d9 for instance e7c59379-7e4c-4a26-87d4-6074baabf96d on n-h1-856895-1 Sep 10 12:34:49.078798 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-9ebcf1cd-1456-4f1d-9871-9018f3766112 req-f94c7568-1eb6-4958-b08d-61d98c19d51f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118235 Sep 10 12:34:49.080015 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3352/6698] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:34:49.649201 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-657c342e-e68e-49d7-a9f9-514c6956df3b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:34:49.649831 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-657c342e-e68e-49d7-a9f9-514c6956df3b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: e7c59379-7e4c-4a26-87d4-6074baabf96d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:34:49.656969 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-657c342e-e68e-49d7-a9f9-514c6956df3b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:34:49.657461 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-657c342e-e68e-49d7-a9f9-514c6956df3b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:34:49.657897 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-657c342e-e68e-49d7-a9f9-514c6956df3b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:34:49.658627 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-657c342e-e68e-49d7-a9f9-514c6956df3b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:34:49.659282 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-657c342e-e68e-49d7-a9f9-514c6956df3b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:34:49.659713 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-657c342e-e68e-49d7-a9f9-514c6956df3b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:34:49.729584 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-657c342e-e68e-49d7-a9f9-514c6956df3b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:34:49.737856 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-657c342e-e68e-49d7-a9f9-514c6956df3b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d" status: 200 len: 1225 microversion: 2.1 time: 0.092884 Sep 10 12:34:49.738320 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3347/6699] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:34:49 2022] GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:34:50.762969 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-54483e4e-31a8-4197-98ed-d11eb17c260c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:34:50.763737 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-54483e4e-31a8-4197-98ed-d11eb17c260c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: e7c59379-7e4c-4a26-87d4-6074baabf96d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:34:50.771569 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-54483e4e-31a8-4197-98ed-d11eb17c260c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:34:50.772116 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-54483e4e-31a8-4197-98ed-d11eb17c260c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:34:50.773266 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-54483e4e-31a8-4197-98ed-d11eb17c260c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:34:50.774028 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-54483e4e-31a8-4197-98ed-d11eb17c260c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:34:50.774521 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-54483e4e-31a8-4197-98ed-d11eb17c260c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:34:50.775205 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-54483e4e-31a8-4197-98ed-d11eb17c260c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:34:50.843657 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-54483e4e-31a8-4197-98ed-d11eb17c260c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:34:50.853609 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-54483e4e-31a8-4197-98ed-d11eb17c260c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d" status: 200 len: 1225 microversion: 2.1 time: 0.096109 Sep 10 12:34:50.854464 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3353/6700] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:34:50 2022] GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:34:51.877603 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5e1e3a65-d15a-4ee5-a94b-1cf832ddea14 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:34:51.878118 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5e1e3a65-d15a-4ee5-a94b-1cf832ddea14 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: e7c59379-7e4c-4a26-87d4-6074baabf96d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:34:51.885137 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5e1e3a65-d15a-4ee5-a94b-1cf832ddea14 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:34:51.885618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5e1e3a65-d15a-4ee5-a94b-1cf832ddea14 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:34:51.886056 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5e1e3a65-d15a-4ee5-a94b-1cf832ddea14 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:34:51.886745 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5e1e3a65-d15a-4ee5-a94b-1cf832ddea14 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:34:51.887216 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5e1e3a65-d15a-4ee5-a94b-1cf832ddea14 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:34:51.887642 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5e1e3a65-d15a-4ee5-a94b-1cf832ddea14 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:34:51.950499 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5e1e3a65-d15a-4ee5-a94b-1cf832ddea14 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:34:51.958437 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5e1e3a65-d15a-4ee5-a94b-1cf832ddea14 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d" status: 200 len: 1225 microversion: 2.1 time: 0.084876 Sep 10 12:34:51.959012 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3348/6701] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:34:51 2022] GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:34:52.982452 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-551a36dc-1a63-4189-873b-d409572a76a1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:34:52.983090 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-551a36dc-1a63-4189-873b-d409572a76a1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: e7c59379-7e4c-4a26-87d4-6074baabf96d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:34:52.990186 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-551a36dc-1a63-4189-873b-d409572a76a1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:34:52.990703 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-551a36dc-1a63-4189-873b-d409572a76a1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:34:52.991762 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-551a36dc-1a63-4189-873b-d409572a76a1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:34:52.992924 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-551a36dc-1a63-4189-873b-d409572a76a1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:34:52.993397 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-551a36dc-1a63-4189-873b-d409572a76a1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:34:52.993839 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-551a36dc-1a63-4189-873b-d409572a76a1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:34:53.063438 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-551a36dc-1a63-4189-873b-d409572a76a1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:34:53.071768 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-551a36dc-1a63-4189-873b-d409572a76a1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d" status: 200 len: 1225 microversion: 2.1 time: 0.093237 Sep 10 12:34:53.072355 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3354/6702] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:34:52 2022] GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:34:54.095546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1ecc50b4-b032-449d-9a6a-13b4c95ae411 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:34:54.096171 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1ecc50b4-b032-449d-9a6a-13b4c95ae411 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: e7c59379-7e4c-4a26-87d4-6074baabf96d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:34:54.103214 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ecc50b4-b032-449d-9a6a-13b4c95ae411 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:34:54.103708 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ecc50b4-b032-449d-9a6a-13b4c95ae411 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:34:54.104151 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ecc50b4-b032-449d-9a6a-13b4c95ae411 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:34:54.104851 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ecc50b4-b032-449d-9a6a-13b4c95ae411 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:34:54.105315 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ecc50b4-b032-449d-9a6a-13b4c95ae411 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:34:54.105748 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ecc50b4-b032-449d-9a6a-13b4c95ae411 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:34:54.120208 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-1ecc50b4-b032-449d-9a6a-13b4c95ae411 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] HTTP exception thrown: Instance e7c59379-7e4c-4a26-87d4-6074baabf96d could not be found. Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1ecc50b4-b032-449d-9a6a-13b4c95ae411 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Request method failure captured: Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d HTTP/1.1 Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHILszP5bh-7vS5nFlniigSPwJSgl9gRBzD28JMJ3uXj7KaJ7IKD0MoPbGUyk7NiR2g3O-OhOoEJg5Mrgl8pVom5QsCHuzRwflIP07SHDWyP4-s7StMch63ybX3LIelpp866T-_UOtQoKy1YDkCCnydW84pCURv3Zlf7uIJ_dXgYsc64 Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: e27276f18d8045e2a9be7a6c5ed892f7 Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e27276f18d8045e2a9be7a6c5ed892f7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: e27276f18d8045e2a9be7a6c5ed892f7 Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-TestVolumeBootPattern-1940983644-project Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 5f0b168293f943389d72753009c88789 Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-TestVolumeBootPattern-1940983644-project Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance e7c59379-7e4c-4a26-87d4-6074baabf96d could not be found. Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'e7c59379-7e4c-4a26-87d4-6074baabf96d'} Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7c59379-7e4c-4a26-87d4-6074baabf96d could not be found. Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7c59379-7e4c-4a26-87d4-6074baabf96d could not be found. Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:34:54.121890 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:34:54.126131 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:34:54.126131 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:34:54.126131 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:34:54.126131 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:34:54.126131 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:34:54.126131 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7c59379-7e4c-4a26-87d4-6074baabf96d could not be found. Sep 10 12:34:54.126131 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:34:54.126131 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1ecc50b4-b032-449d-9a6a-13b4c95ae411 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Returning 404 to user: Instance e7c59379-7e4c-4a26-87d4-6074baabf96d could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:34:54.126131 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1ecc50b4-b032-449d-9a6a-13b4c95ae411 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d" status: 404 len: 111 microversion: 2.1 time: 0.031753 Sep 10 12:34:54.126131 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3349/6703] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:34:54 2022] GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:34:54.172628 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-55f8890a-e183-4197-8ebb-c755d6793a09 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1333938712", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1302349969", "security_groups": [{"name": "tempest-secgroup-smoke-625640396"}], "block_device_mapping_v2": [{"uuid": "98c68380-4a3b-4fab-b8b7-56e0b8494501", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "63bc1cec-19c3-45db-83f8-21772e061ea1"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:34:54.290551 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-55f8890a-e183-4197-8ebb-c755d6793a09 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] validate_networks() for [('63bc1cec-19c3-45db-83f8-21772e061ea1', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:34:54.670176 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-55f8890a-e183-4197-8ebb-c755d6793a09 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:34:54.670686 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-55f8890a-e183-4197-8ebb-c755d6793a09 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:34:54.671323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-55f8890a-e183-4197-8ebb-c755d6793a09 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:34:54.671908 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-55f8890a-e183-4197-8ebb-c755d6793a09 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:34:54.672627 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-55f8890a-e183-4197-8ebb-c755d6793a09 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:34:54.684125 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55f8890a-e183-4197-8ebb-c755d6793a09 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:34:54.684624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55f8890a-e183-4197-8ebb-c755d6793a09 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:34:54.685075 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55f8890a-e183-4197-8ebb-c755d6793a09 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:34:54.685814 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55f8890a-e183-4197-8ebb-c755d6793a09 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:34:54.686282 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55f8890a-e183-4197-8ebb-c755d6793a09 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:34:54.686746 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55f8890a-e183-4197-8ebb-c755d6793a09 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:34:54.704404 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-55f8890a-e183-4197-8ebb-c755d6793a09 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Getting quotas for project e27276f18d8045e2a9be7a6c5ed892f7. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:34:54.711152 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-55f8890a-e183-4197-8ebb-c755d6793a09 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Getting quotas for user 5f0b168293f943389d72753009c88789 and project e27276f18d8045e2a9be7a6c5ed892f7. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:34:54.775285 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-55f8890a-e183-4197-8ebb-c755d6793a09 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:34:54.777428 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-55f8890a-e183-4197-8ebb-c755d6793a09 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ab00bcb2-018d-4774-bf6c-1f59d6b01c32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='98c68380-4a3b-4fab-b8b7-56e0b8494501',volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:34:54.908158 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-55f8890a-e183-4197-8ebb-c755d6793a09 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.739620 Sep 10 12:34:54.908859 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3355/6704] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:34:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:34:54.920447 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-52798d62-f400-400b-8487-c1169625583d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:34:54.921061 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-52798d62-f400-400b-8487-c1169625583d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ab00bcb2-018d-4774-bf6c-1f59d6b01c32] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:34:54.976254 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-52798d62-f400-400b-8487-c1169625583d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:34:54.983489 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-52798d62-f400-400b-8487-c1169625583d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32" status: 200 len: 1095 microversion: 2.1 time: 0.066845 Sep 10 12:34:54.984068 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3350/6705] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:34:54 2022] GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32 => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:34:56.007396 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-24ba9d68-e5d9-47ed-b63d-877a215cf0fc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:34:56.008040 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-24ba9d68-e5d9-47ed-b63d-877a215cf0fc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ab00bcb2-018d-4774-bf6c-1f59d6b01c32] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:34:56.014709 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-24ba9d68-e5d9-47ed-b63d-877a215cf0fc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:34:56.015463 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-24ba9d68-e5d9-47ed-b63d-877a215cf0fc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:34:56.016116 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-24ba9d68-e5d9-47ed-b63d-877a215cf0fc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:34:56.017004 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-24ba9d68-e5d9-47ed-b63d-877a215cf0fc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:34:56.017704 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-24ba9d68-e5d9-47ed-b63d-877a215cf0fc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:34:56.018448 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-24ba9d68-e5d9-47ed-b63d-877a215cf0fc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:34:56.097027 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-24ba9d68-e5d9-47ed-b63d-877a215cf0fc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:34:56.105680 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-24ba9d68-e5d9-47ed-b63d-877a215cf0fc tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32" status: 200 len: 1201 microversion: 2.1 time: 0.103573 Sep 10 12:34:56.106462 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3356/6706] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:34:56 2022] GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32 => generated 1201 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:34:57.130290 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-94195205-ba23-4dd7-ac40-df6509293356 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:34:57.132931 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-94195205-ba23-4dd7-ac40-df6509293356 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ab00bcb2-018d-4774-bf6c-1f59d6b01c32] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:34:57.142335 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94195205-ba23-4dd7-ac40-df6509293356 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:34:57.142828 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94195205-ba23-4dd7-ac40-df6509293356 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:34:57.143300 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94195205-ba23-4dd7-ac40-df6509293356 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:34:57.144008 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94195205-ba23-4dd7-ac40-df6509293356 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:34:57.144466 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94195205-ba23-4dd7-ac40-df6509293356 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:34:57.144889 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94195205-ba23-4dd7-ac40-df6509293356 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:34:57.390193 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-94195205-ba23-4dd7-ac40-df6509293356 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:34:57.399218 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-94195205-ba23-4dd7-ac40-df6509293356 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32" status: 200 len: 1278 microversion: 2.1 time: 0.273140 Sep 10 12:34:57.399969 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3351/6707] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:34:57 2022] GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32 => generated 1278 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:34:57.576293 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-efa5d2d8-1f33-4cde-bbd3-76f2439a1595 req-edeb8ca7-2664-4bb2-8034-69ade124ba79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab00bcb2-018d-4774-bf6c-1f59d6b01c32", "tag": "1e0ba526-010b-4bd6-82fc-b554a9a6b006"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:34:57.593250 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-efa5d2d8-1f33-4cde-bbd3-76f2439a1595 req-edeb8ca7-2664-4bb2-8034-69ade124ba79 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:34:57.593752 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-efa5d2d8-1f33-4cde-bbd3-76f2439a1595 req-edeb8ca7-2664-4bb2-8034-69ade124ba79 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:34:57.594207 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-efa5d2d8-1f33-4cde-bbd3-76f2439a1595 req-edeb8ca7-2664-4bb2-8034-69ade124ba79 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:34:57.609827 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-efa5d2d8-1f33-4cde-bbd3-76f2439a1595 req-edeb8ca7-2664-4bb2-8034-69ade124ba79 service nova] Creating event network-changed:1e0ba526-010b-4bd6-82fc-b554a9a6b006 for instance ab00bcb2-018d-4774-bf6c-1f59d6b01c32 on n-h1-856895-1 Sep 10 12:34:57.616507 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-efa5d2d8-1f33-4cde-bbd3-76f2439a1595 req-edeb8ca7-2664-4bb2-8034-69ade124ba79 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050612 Sep 10 12:34:57.617903 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3357/6708] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:34:58.422746 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-dfb0200a-d819-4d27-b325-77fd948cd797 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:34:58.424005 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-dfb0200a-d819-4d27-b325-77fd948cd797 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ab00bcb2-018d-4774-bf6c-1f59d6b01c32] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:34:58.433125 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dfb0200a-d819-4d27-b325-77fd948cd797 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:34:58.433969 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dfb0200a-d819-4d27-b325-77fd948cd797 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:34:58.434731 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dfb0200a-d819-4d27-b325-77fd948cd797 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:34:58.435488 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dfb0200a-d819-4d27-b325-77fd948cd797 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:34:58.436240 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dfb0200a-d819-4d27-b325-77fd948cd797 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:34:58.436834 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dfb0200a-d819-4d27-b325-77fd948cd797 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:34:58.664610 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-dfb0200a-d819-4d27-b325-77fd948cd797 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:34:58.672521 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-dfb0200a-d819-4d27-b325-77fd948cd797 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32" status: 200 len: 1278 microversion: 2.1 time: 0.254353 Sep 10 12:34:58.673112 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3352/6709] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:34:58 2022] GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32 => generated 1278 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:34:59.697337 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2f94362d-9ec3-4132-a8e3-2e2e3035e24d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:34:59.698209 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2f94362d-9ec3-4132-a8e3-2e2e3035e24d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ab00bcb2-018d-4774-bf6c-1f59d6b01c32] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:34:59.704768 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f94362d-9ec3-4132-a8e3-2e2e3035e24d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:34:59.705348 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f94362d-9ec3-4132-a8e3-2e2e3035e24d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:34:59.705899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f94362d-9ec3-4132-a8e3-2e2e3035e24d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:34:59.706682 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f94362d-9ec3-4132-a8e3-2e2e3035e24d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:34:59.707264 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f94362d-9ec3-4132-a8e3-2e2e3035e24d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:34:59.707780 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f94362d-9ec3-4132-a8e3-2e2e3035e24d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:34:59.842024 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2f94362d-9ec3-4132-a8e3-2e2e3035e24d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:34:59.849840 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2f94362d-9ec3-4132-a8e3-2e2e3035e24d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32" status: 200 len: 1278 microversion: 2.1 time: 0.157812 Sep 10 12:34:59.851062 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3358/6710] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:34:59 2022] GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:35:00.873437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-98ca483c-615f-42ea-8da9-f69c26ca0169 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:35:00.874081 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-98ca483c-615f-42ea-8da9-f69c26ca0169 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ab00bcb2-018d-4774-bf6c-1f59d6b01c32] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:35:00.880649 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98ca483c-615f-42ea-8da9-f69c26ca0169 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:35:00.881142 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98ca483c-615f-42ea-8da9-f69c26ca0169 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:35:00.882329 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98ca483c-615f-42ea-8da9-f69c26ca0169 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:35:00.883127 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98ca483c-615f-42ea-8da9-f69c26ca0169 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:35:00.883621 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98ca483c-615f-42ea-8da9-f69c26ca0169 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:35:00.884056 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98ca483c-615f-42ea-8da9-f69c26ca0169 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:35:01.025050 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-98ca483c-615f-42ea-8da9-f69c26ca0169 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:35:01.032928 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-98ca483c-615f-42ea-8da9-f69c26ca0169 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32" status: 200 len: 1278 microversion: 2.1 time: 0.163684 Sep 10 12:35:01.033514 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3353/6711] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:35:00 2022] GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32 => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:35:02.058684 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f71224a7-914b-41d4-98c0-1c40c3de00ba tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:35:02.059420 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f71224a7-914b-41d4-98c0-1c40c3de00ba tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ab00bcb2-018d-4774-bf6c-1f59d6b01c32] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:35:02.065446 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f71224a7-914b-41d4-98c0-1c40c3de00ba tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:35:02.065941 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f71224a7-914b-41d4-98c0-1c40c3de00ba tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:35:02.066395 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f71224a7-914b-41d4-98c0-1c40c3de00ba tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:35:02.067099 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f71224a7-914b-41d4-98c0-1c40c3de00ba tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:35:02.067597 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f71224a7-914b-41d4-98c0-1c40c3de00ba tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:35:02.068043 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f71224a7-914b-41d4-98c0-1c40c3de00ba tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:35:02.199268 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f71224a7-914b-41d4-98c0-1c40c3de00ba tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:35:02.207040 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f71224a7-914b-41d4-98c0-1c40c3de00ba tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32" status: 200 len: 1266 microversion: 2.1 time: 0.153857 Sep 10 12:35:02.207650 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3359/6712] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:35:02 2022] GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:35:03.230204 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7d909ab5-65ee-424a-8465-4b730ec17507 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:35:03.230755 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7d909ab5-65ee-424a-8465-4b730ec17507 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ab00bcb2-018d-4774-bf6c-1f59d6b01c32] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:35:03.237615 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d909ab5-65ee-424a-8465-4b730ec17507 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:35:03.238102 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d909ab5-65ee-424a-8465-4b730ec17507 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:35:03.238545 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d909ab5-65ee-424a-8465-4b730ec17507 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:35:03.239262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d909ab5-65ee-424a-8465-4b730ec17507 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:35:03.239723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d909ab5-65ee-424a-8465-4b730ec17507 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:35:03.240148 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d909ab5-65ee-424a-8465-4b730ec17507 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:35:03.372619 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7d909ab5-65ee-424a-8465-4b730ec17507 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:35:03.380358 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7d909ab5-65ee-424a-8465-4b730ec17507 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32" status: 200 len: 1266 microversion: 2.1 time: 0.154238 Sep 10 12:35:03.380932 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3354/6713] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:35:03 2022] GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:35:04.404038 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-632e2f74-5abb-4bb7-b150-55013e9ac02a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:35:04.404573 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-632e2f74-5abb-4bb7-b150-55013e9ac02a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ab00bcb2-018d-4774-bf6c-1f59d6b01c32] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:35:04.411509 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-632e2f74-5abb-4bb7-b150-55013e9ac02a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:35:04.412007 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-632e2f74-5abb-4bb7-b150-55013e9ac02a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:35:04.412459 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-632e2f74-5abb-4bb7-b150-55013e9ac02a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:35:04.413176 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-632e2f74-5abb-4bb7-b150-55013e9ac02a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:35:04.413632 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-632e2f74-5abb-4bb7-b150-55013e9ac02a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:35:04.414710 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-632e2f74-5abb-4bb7-b150-55013e9ac02a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:35:04.548971 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-632e2f74-5abb-4bb7-b150-55013e9ac02a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:35:04.556869 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-632e2f74-5abb-4bb7-b150-55013e9ac02a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32" status: 200 len: 1266 microversion: 2.1 time: 0.156896 Sep 10 12:35:04.557448 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3360/6714] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:35:04 2022] GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:35:05.580294 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e8952628-cf81-47d8-bdd1-493da705b60e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:35:05.580833 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e8952628-cf81-47d8-bdd1-493da705b60e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ab00bcb2-018d-4774-bf6c-1f59d6b01c32] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:35:05.583483 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:35:05.588918 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e8952628-cf81-47d8-bdd1-493da705b60e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:35:05.589401 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e8952628-cf81-47d8-bdd1-493da705b60e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:35:05.589835 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e8952628-cf81-47d8-bdd1-493da705b60e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:35:05.590523 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e8952628-cf81-47d8-bdd1-493da705b60e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:35:05.590974 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e8952628-cf81-47d8-bdd1-493da705b60e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:35:05.591426 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e8952628-cf81-47d8-bdd1-493da705b60e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:35:05.723393 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e8952628-cf81-47d8-bdd1-493da705b60e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:35:05.731537 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e8952628-cf81-47d8-bdd1-493da705b60e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32" status: 200 len: 1266 microversion: 2.1 time: 0.155186 Sep 10 12:35:05.732110 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3355/6715] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:35:05 2022] GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:35:06.754897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b0f43f15-46a6-4fd6-ad07-57bbfaea1e95 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:35:06.755558 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b0f43f15-46a6-4fd6-ad07-57bbfaea1e95 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ab00bcb2-018d-4774-bf6c-1f59d6b01c32] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:35:06.758258 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:35:06.758972 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:35:06.765735 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b0f43f15-46a6-4fd6-ad07-57bbfaea1e95 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:35:06.766242 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b0f43f15-46a6-4fd6-ad07-57bbfaea1e95 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:35:06.766702 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b0f43f15-46a6-4fd6-ad07-57bbfaea1e95 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:35:06.767448 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b0f43f15-46a6-4fd6-ad07-57bbfaea1e95 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:35:06.767924 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b0f43f15-46a6-4fd6-ad07-57bbfaea1e95 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:35:06.768375 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b0f43f15-46a6-4fd6-ad07-57bbfaea1e95 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:35:06.907425 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b0f43f15-46a6-4fd6-ad07-57bbfaea1e95 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:35:06.914770 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b0f43f15-46a6-4fd6-ad07-57bbfaea1e95 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32" status: 200 len: 1266 microversion: 2.1 time: 0.163860 Sep 10 12:35:06.915399 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3361/6716] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:35:06 2022] GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:35:07.937476 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b0d1f101-1574-4d0a-b985-6cc88afbd46a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:35:07.938121 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b0d1f101-1574-4d0a-b985-6cc88afbd46a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ab00bcb2-018d-4774-bf6c-1f59d6b01c32] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:35:07.945524 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0d1f101-1574-4d0a-b985-6cc88afbd46a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:35:07.946009 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0d1f101-1574-4d0a-b985-6cc88afbd46a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:35:07.946445 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0d1f101-1574-4d0a-b985-6cc88afbd46a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:35:07.947131 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0d1f101-1574-4d0a-b985-6cc88afbd46a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:35:07.947620 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0d1f101-1574-4d0a-b985-6cc88afbd46a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:35:07.948044 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0d1f101-1574-4d0a-b985-6cc88afbd46a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:35:08.087113 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b0d1f101-1574-4d0a-b985-6cc88afbd46a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:35:08.095187 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b0d1f101-1574-4d0a-b985-6cc88afbd46a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32" status: 200 len: 1266 microversion: 2.1 time: 0.161588 Sep 10 12:35:08.095761 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3356/6717] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:35:07 2022] GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:35:09.121563 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1cb2ff0a-6d7b-4fdc-af9a-48a41e6ea774 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:35:09.122168 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1cb2ff0a-6d7b-4fdc-af9a-48a41e6ea774 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ab00bcb2-018d-4774-bf6c-1f59d6b01c32] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:35:09.129094 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1cb2ff0a-6d7b-4fdc-af9a-48a41e6ea774 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:35:09.129604 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1cb2ff0a-6d7b-4fdc-af9a-48a41e6ea774 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:35:09.130073 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1cb2ff0a-6d7b-4fdc-af9a-48a41e6ea774 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:35:09.130878 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1cb2ff0a-6d7b-4fdc-af9a-48a41e6ea774 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:35:09.131543 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1cb2ff0a-6d7b-4fdc-af9a-48a41e6ea774 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:35:09.132052 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1cb2ff0a-6d7b-4fdc-af9a-48a41e6ea774 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:35:09.270667 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1cb2ff0a-6d7b-4fdc-af9a-48a41e6ea774 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:35:09.279112 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1cb2ff0a-6d7b-4fdc-af9a-48a41e6ea774 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32" status: 200 len: 1266 microversion: 2.1 time: 0.161878 Sep 10 12:35:09.279765 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3362/6718] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:35:09 2022] GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:35:10.302210 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-762ecdca-5078-4424-aaa2-472e13b212b0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:35:10.302750 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-762ecdca-5078-4424-aaa2-472e13b212b0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ab00bcb2-018d-4774-bf6c-1f59d6b01c32] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:35:10.310655 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-762ecdca-5078-4424-aaa2-472e13b212b0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:35:10.311154 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-762ecdca-5078-4424-aaa2-472e13b212b0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:35:10.311630 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-762ecdca-5078-4424-aaa2-472e13b212b0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:35:10.312329 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-762ecdca-5078-4424-aaa2-472e13b212b0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:35:10.312790 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-762ecdca-5078-4424-aaa2-472e13b212b0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:35:10.313221 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-762ecdca-5078-4424-aaa2-472e13b212b0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:35:10.446214 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-762ecdca-5078-4424-aaa2-472e13b212b0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:35:10.453915 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-762ecdca-5078-4424-aaa2-472e13b212b0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32" status: 200 len: 1266 microversion: 2.1 time: 0.155754 Sep 10 12:35:10.454484 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3357/6719] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:35:10 2022] GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:35:10.774358 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-00c9f4f6-ad0c-4f3e-8636-78927ac2e3bd req-c7968878-74f8-4fc1-9ceb-cc31198f5966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab00bcb2-018d-4774-bf6c-1f59d6b01c32", "name": "network-vif-plugged", "status": "completed", "tag": "1e0ba526-010b-4bd6-82fc-b554a9a6b006"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:35:10.784156 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-00c9f4f6-ad0c-4f3e-8636-78927ac2e3bd req-c7968878-74f8-4fc1-9ceb-cc31198f5966 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:35:10.784652 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-00c9f4f6-ad0c-4f3e-8636-78927ac2e3bd req-c7968878-74f8-4fc1-9ceb-cc31198f5966 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:35:10.785101 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-00c9f4f6-ad0c-4f3e-8636-78927ac2e3bd req-c7968878-74f8-4fc1-9ceb-cc31198f5966 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:35:10.797709 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-00c9f4f6-ad0c-4f3e-8636-78927ac2e3bd req-c7968878-74f8-4fc1-9ceb-cc31198f5966 service nova] Creating event network-vif-plugged:1e0ba526-010b-4bd6-82fc-b554a9a6b006 for instance ab00bcb2-018d-4774-bf6c-1f59d6b01c32 on n-h1-856895-1 Sep 10 12:35:10.802655 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-00c9f4f6-ad0c-4f3e-8636-78927ac2e3bd req-c7968878-74f8-4fc1-9ceb-cc31198f5966 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098447 Sep 10 12:35:10.803276 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3363/6720] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:35:11.477249 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4289f1aa-a6ad-4b19-8e80-1e2c4e134eca tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:35:11.477781 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4289f1aa-a6ad-4b19-8e80-1e2c4e134eca tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ab00bcb2-018d-4774-bf6c-1f59d6b01c32] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:35:11.484614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4289f1aa-a6ad-4b19-8e80-1e2c4e134eca tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:35:11.485092 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4289f1aa-a6ad-4b19-8e80-1e2c4e134eca tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:35:11.485525 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4289f1aa-a6ad-4b19-8e80-1e2c4e134eca tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:35:11.486206 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4289f1aa-a6ad-4b19-8e80-1e2c4e134eca tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:35:11.486653 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4289f1aa-a6ad-4b19-8e80-1e2c4e134eca tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:35:11.487075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4289f1aa-a6ad-4b19-8e80-1e2c4e134eca tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:35:11.625283 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4289f1aa-a6ad-4b19-8e80-1e2c4e134eca tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:35:11.633853 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4289f1aa-a6ad-4b19-8e80-1e2c4e134eca tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32" status: 200 len: 1266 microversion: 2.1 time: 0.160388 Sep 10 12:35:11.634434 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3358/6721] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:35:11 2022] GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:35:12.658742 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fb2b010c-3ab0-45fb-ab34-ce046c7bbeaf tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:35:12.659497 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fb2b010c-3ab0-45fb-ab34-ce046c7bbeaf tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ab00bcb2-018d-4774-bf6c-1f59d6b01c32] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:35:12.666488 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fb2b010c-3ab0-45fb-ab34-ce046c7bbeaf tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:35:12.666990 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fb2b010c-3ab0-45fb-ab34-ce046c7bbeaf tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:35:12.667480 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fb2b010c-3ab0-45fb-ab34-ce046c7bbeaf tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:35:12.668192 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fb2b010c-3ab0-45fb-ab34-ce046c7bbeaf tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:35:12.668670 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fb2b010c-3ab0-45fb-ab34-ce046c7bbeaf tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:35:12.669119 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fb2b010c-3ab0-45fb-ab34-ce046c7bbeaf tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:35:12.800271 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fb2b010c-3ab0-45fb-ab34-ce046c7bbeaf tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:35:12.808415 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fb2b010c-3ab0-45fb-ab34-ce046c7bbeaf tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32" status: 200 len: 1453 microversion: 2.1 time: 0.154809 Sep 10 12:35:12.809433 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3364/6722] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:35:12 2022] GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32 => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:35:12.831058 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7c4dcb49-c08c-4aad-a2e8-d0e4a6834c26 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:35:12.831694 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7c4dcb49-c08c-4aad-a2e8-d0e4a6834c26 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ab00bcb2-018d-4774-bf6c-1f59d6b01c32] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:35:12.839023 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c4dcb49-c08c-4aad-a2e8-d0e4a6834c26 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:35:12.839523 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c4dcb49-c08c-4aad-a2e8-d0e4a6834c26 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:35:12.839954 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c4dcb49-c08c-4aad-a2e8-d0e4a6834c26 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:35:12.840634 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c4dcb49-c08c-4aad-a2e8-d0e4a6834c26 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:35:12.841091 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c4dcb49-c08c-4aad-a2e8-d0e4a6834c26 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:35:12.841514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c4dcb49-c08c-4aad-a2e8-d0e4a6834c26 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:35:12.977142 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7c4dcb49-c08c-4aad-a2e8-d0e4a6834c26 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:35:12.984870 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7c4dcb49-c08c-4aad-a2e8-d0e4a6834c26 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32" status: 200 len: 1453 microversion: 2.1 time: 0.157689 Sep 10 12:35:12.985438 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3359/6723] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:35:12 2022] GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:35:14.948995 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-5b24e325-f9e7-4cba-9702-bdba7e408a7c req-074f022b-66fc-4a6c-acc8-bb6c2bfd5c2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab00bcb2-018d-4774-bf6c-1f59d6b01c32", "tag": "1e0ba526-010b-4bd6-82fc-b554a9a6b006"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:35:14.960154 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-5b24e325-f9e7-4cba-9702-bdba7e408a7c req-074f022b-66fc-4a6c-acc8-bb6c2bfd5c2c service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:35:14.960735 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-5b24e325-f9e7-4cba-9702-bdba7e408a7c req-074f022b-66fc-4a6c-acc8-bb6c2bfd5c2c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:35:14.961250 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-5b24e325-f9e7-4cba-9702-bdba7e408a7c req-074f022b-66fc-4a6c-acc8-bb6c2bfd5c2c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:35:14.972667 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-5b24e325-f9e7-4cba-9702-bdba7e408a7c req-074f022b-66fc-4a6c-acc8-bb6c2bfd5c2c service nova] Creating event network-changed:1e0ba526-010b-4bd6-82fc-b554a9a6b006 for instance ab00bcb2-018d-4774-bf6c-1f59d6b01c32 on n-h1-856895-1 Sep 10 12:35:14.978232 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-5b24e325-f9e7-4cba-9702-bdba7e408a7c req-074f022b-66fc-4a6c-acc8-bb6c2bfd5c2c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033942 Sep 10 12:35:14.978835 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3365/6724] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:36:53.020501 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=32 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:36:53.021239 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=80 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:36:53.022056 n-d-856895-1 devstack@n-api.service[128777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 12:36:53.022250 n-d-856895-1 devstack@n-api.service[128777]: Sat Sep 10 12:36:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.23) !!! Sep 10 12:36:53.027883 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6f6ff794-594a-4ab7-b5e4-3659e66349b1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1350849988", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1302349969", "security_groups": [{"name": "tempest-secgroup-smoke-625640396"}], "block_device_mapping_v2": [{"uuid": "a0d3502e-b737-496c-a4d8-9955356be5ec", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "63bc1cec-19c3-45db-83f8-21772e061ea1"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:36:53.327476 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-6f6ff794-594a-4ab7-b5e4-3659e66349b1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] validate_networks() for [('63bc1cec-19c3-45db-83f8-21772e061ea1', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:36:53.774718 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-6f6ff794-594a-4ab7-b5e4-3659e66349b1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:36:53.775147 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-6f6ff794-594a-4ab7-b5e4-3659e66349b1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:36:53.775645 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-6f6ff794-594a-4ab7-b5e4-3659e66349b1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:36:53.776059 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-6f6ff794-594a-4ab7-b5e4-3659e66349b1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:36:53.776478 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-6f6ff794-594a-4ab7-b5e4-3659e66349b1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:36:53.785387 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6f6ff794-594a-4ab7-b5e4-3659e66349b1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:36:53.785867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6f6ff794-594a-4ab7-b5e4-3659e66349b1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:36:53.786304 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6f6ff794-594a-4ab7-b5e4-3659e66349b1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:36:53.787035 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6f6ff794-594a-4ab7-b5e4-3659e66349b1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:36:53.787512 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6f6ff794-594a-4ab7-b5e4-3659e66349b1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:36:53.787937 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6f6ff794-594a-4ab7-b5e4-3659e66349b1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:36:53.804796 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-6f6ff794-594a-4ab7-b5e4-3659e66349b1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Getting quotas for project e27276f18d8045e2a9be7a6c5ed892f7. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:36:53.810023 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-6f6ff794-594a-4ab7-b5e4-3659e66349b1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Getting quotas for user 5f0b168293f943389d72753009c88789 and project e27276f18d8045e2a9be7a6c5ed892f7. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:36:53.867251 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6f6ff794-594a-4ab7-b5e4-3659e66349b1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:36:53.869638 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6f6ff794-594a-4ab7-b5e4-3659e66349b1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 603b92fe-0776-4a33-94b2-47fcbc1be375] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a0d3502e-b737-496c-a4d8-9955356be5ec',volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:36:53.997222 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6f6ff794-594a-4ab7-b5e4-3659e66349b1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.978722 Sep 10 12:36:53.997914 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3360/6725] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:36:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:36:54.008603 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:36:54.009567 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:36:54.014883 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4b8934ac-bb92-4c0a-aff8-d46c61d6bc06 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:36:54.015645 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4b8934ac-bb92-4c0a-aff8-d46c61d6bc06 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 603b92fe-0776-4a33-94b2-47fcbc1be375] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:36:54.200213 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4b8934ac-bb92-4c0a-aff8-d46c61d6bc06 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:36:54.207405 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4b8934ac-bb92-4c0a-aff8-d46c61d6bc06 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375" status: 200 len: 1095 microversion: 2.1 time: 0.201001 Sep 10 12:36:54.207984 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3366/6726] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:36:54 2022] GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375 => generated 1095 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:36:55.230944 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-84048ac3-ba69-468f-ba32-5887d14bdf4d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:36:55.231644 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-84048ac3-ba69-468f-ba32-5887d14bdf4d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 603b92fe-0776-4a33-94b2-47fcbc1be375] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:36:55.287260 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-84048ac3-ba69-468f-ba32-5887d14bdf4d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:36:55.294983 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-84048ac3-ba69-468f-ba32-5887d14bdf4d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375" status: 200 len: 1095 microversion: 2.1 time: 0.069077 Sep 10 12:36:55.295650 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3361/6727] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:36:55 2022] GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375 => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:36:56.319461 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6b26ed40-035d-4ca3-b2dd-41ca50dc3204 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:36:56.320211 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6b26ed40-035d-4ca3-b2dd-41ca50dc3204 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 603b92fe-0776-4a33-94b2-47fcbc1be375] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:36:56.328704 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6b26ed40-035d-4ca3-b2dd-41ca50dc3204 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:36:56.329221 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6b26ed40-035d-4ca3-b2dd-41ca50dc3204 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:36:56.329814 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6b26ed40-035d-4ca3-b2dd-41ca50dc3204 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:36:56.330629 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6b26ed40-035d-4ca3-b2dd-41ca50dc3204 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:36:56.331344 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6b26ed40-035d-4ca3-b2dd-41ca50dc3204 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:36:56.332082 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6b26ed40-035d-4ca3-b2dd-41ca50dc3204 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:36:56.411203 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6b26ed40-035d-4ca3-b2dd-41ca50dc3204 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:36:56.421538 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6b26ed40-035d-4ca3-b2dd-41ca50dc3204 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375" status: 200 len: 1211 microversion: 2.1 time: 0.107271 Sep 10 12:36:56.422134 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3367/6728] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:36:56 2022] GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375 => generated 1211 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:36:57.445552 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9f4748ae-1ca7-46e0-8037-6e00152e623f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:36:57.453782 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9f4748ae-1ca7-46e0-8037-6e00152e623f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 603b92fe-0776-4a33-94b2-47fcbc1be375] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:36:57.461520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9f4748ae-1ca7-46e0-8037-6e00152e623f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:36:57.466324 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9f4748ae-1ca7-46e0-8037-6e00152e623f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:36:57.471727 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9f4748ae-1ca7-46e0-8037-6e00152e623f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:36:57.472730 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9f4748ae-1ca7-46e0-8037-6e00152e623f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:36:57.473320 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9f4748ae-1ca7-46e0-8037-6e00152e623f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:36:57.474424 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9f4748ae-1ca7-46e0-8037-6e00152e623f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:36:57.616367 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-975473a1-122d-43e4-8ffc-760147921194 req-25f95f3f-17e9-457a-b50c-268b4bd83ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "603b92fe-0776-4a33-94b2-47fcbc1be375", "tag": "ee8caaa4-4d20-4bf6-8253-0218c25ee618"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:36:57.629969 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-975473a1-122d-43e4-8ffc-760147921194 req-25f95f3f-17e9-457a-b50c-268b4bd83ec7 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:36:57.630739 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-975473a1-122d-43e4-8ffc-760147921194 req-25f95f3f-17e9-457a-b50c-268b4bd83ec7 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:36:57.632041 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-975473a1-122d-43e4-8ffc-760147921194 req-25f95f3f-17e9-457a-b50c-268b4bd83ec7 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:36:57.651514 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-975473a1-122d-43e4-8ffc-760147921194 req-25f95f3f-17e9-457a-b50c-268b4bd83ec7 service nova] Creating event network-changed:ee8caaa4-4d20-4bf6-8253-0218c25ee618 for instance 603b92fe-0776-4a33-94b2-47fcbc1be375 on n-h2-856895-1 Sep 10 12:36:57.657772 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-975473a1-122d-43e4-8ffc-760147921194 req-25f95f3f-17e9-457a-b50c-268b4bd83ec7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047757 Sep 10 12:36:57.658977 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3368/6729] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:36:57.746212 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9f4748ae-1ca7-46e0-8037-6e00152e623f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:36:57.757725 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9f4748ae-1ca7-46e0-8037-6e00152e623f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375" status: 200 len: 1278 microversion: 2.1 time: 0.316029 Sep 10 12:36:57.758733 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3362/6730] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:36:57 2022] GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375 => generated 1278 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:36:58.792395 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fbd27bf6-c660-4f08-b7db-c15bc89d45f1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:36:58.793722 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fbd27bf6-c660-4f08-b7db-c15bc89d45f1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 603b92fe-0776-4a33-94b2-47fcbc1be375] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:36:58.803889 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fbd27bf6-c660-4f08-b7db-c15bc89d45f1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:36:58.804400 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fbd27bf6-c660-4f08-b7db-c15bc89d45f1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:36:58.805763 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fbd27bf6-c660-4f08-b7db-c15bc89d45f1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:36:58.806667 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fbd27bf6-c660-4f08-b7db-c15bc89d45f1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:36:58.807368 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fbd27bf6-c660-4f08-b7db-c15bc89d45f1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:36:58.807984 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fbd27bf6-c660-4f08-b7db-c15bc89d45f1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:36:59.016780 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fbd27bf6-c660-4f08-b7db-c15bc89d45f1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:36:59.025300 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fbd27bf6-c660-4f08-b7db-c15bc89d45f1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375" status: 200 len: 1278 microversion: 2.1 time: 0.248540 Sep 10 12:36:59.025884 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3369/6731] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:36:58 2022] GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375 => generated 1278 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:37:00.048464 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ab5c4bdd-e0b4-40f7-b26e-1053b8a36bcf tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:37:00.049821 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ab5c4bdd-e0b4-40f7-b26e-1053b8a36bcf tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 603b92fe-0776-4a33-94b2-47fcbc1be375] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:37:00.057471 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ab5c4bdd-e0b4-40f7-b26e-1053b8a36bcf tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:37:00.058225 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ab5c4bdd-e0b4-40f7-b26e-1053b8a36bcf tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:37:00.058889 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ab5c4bdd-e0b4-40f7-b26e-1053b8a36bcf tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:37:00.059996 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ab5c4bdd-e0b4-40f7-b26e-1053b8a36bcf tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:37:00.060670 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ab5c4bdd-e0b4-40f7-b26e-1053b8a36bcf tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:37:00.061263 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ab5c4bdd-e0b4-40f7-b26e-1053b8a36bcf tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:37:00.209819 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ab5c4bdd-e0b4-40f7-b26e-1053b8a36bcf tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:37:00.217624 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ab5c4bdd-e0b4-40f7-b26e-1053b8a36bcf tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375" status: 200 len: 1278 microversion: 2.1 time: 0.173077 Sep 10 12:37:00.218209 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3363/6732] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:37:00 2022] GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375 => generated 1278 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:37:01.242669 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ee2a60b2-e106-4c4d-83cc-8db965651752 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:37:01.243673 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ee2a60b2-e106-4c4d-83cc-8db965651752 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 603b92fe-0776-4a33-94b2-47fcbc1be375] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:37:01.250990 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ee2a60b2-e106-4c4d-83cc-8db965651752 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:37:01.251523 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ee2a60b2-e106-4c4d-83cc-8db965651752 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:37:01.252137 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ee2a60b2-e106-4c4d-83cc-8db965651752 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:37:01.253130 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ee2a60b2-e106-4c4d-83cc-8db965651752 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:37:01.253642 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ee2a60b2-e106-4c4d-83cc-8db965651752 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:37:01.254142 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ee2a60b2-e106-4c4d-83cc-8db965651752 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:37:01.417115 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ee2a60b2-e106-4c4d-83cc-8db965651752 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:37:01.426462 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ee2a60b2-e106-4c4d-83cc-8db965651752 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375" status: 200 len: 1266 microversion: 2.1 time: 0.188042 Sep 10 12:37:01.427194 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3370/6733] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:37:01 2022] GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:37:02.451546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f1eb7c68-0ec7-47f4-90e9-29581dd288d3 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:37:02.452321 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f1eb7c68-0ec7-47f4-90e9-29581dd288d3 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 603b92fe-0776-4a33-94b2-47fcbc1be375] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:37:02.459359 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f1eb7c68-0ec7-47f4-90e9-29581dd288d3 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:37:02.459851 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f1eb7c68-0ec7-47f4-90e9-29581dd288d3 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:37:02.460308 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f1eb7c68-0ec7-47f4-90e9-29581dd288d3 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:37:02.460987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f1eb7c68-0ec7-47f4-90e9-29581dd288d3 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:37:02.461448 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f1eb7c68-0ec7-47f4-90e9-29581dd288d3 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:37:02.461881 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f1eb7c68-0ec7-47f4-90e9-29581dd288d3 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:37:02.599030 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f1eb7c68-0ec7-47f4-90e9-29581dd288d3 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:37:02.606692 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f1eb7c68-0ec7-47f4-90e9-29581dd288d3 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375" status: 200 len: 1266 microversion: 2.1 time: 0.159144 Sep 10 12:37:02.607292 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3364/6734] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:37:02 2022] GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:37:03.630883 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b9b38bce-bf2f-4641-bfb0-775ea43b25f6 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:37:03.631596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b9b38bce-bf2f-4641-bfb0-775ea43b25f6 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 603b92fe-0776-4a33-94b2-47fcbc1be375] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:37:03.638390 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9b38bce-bf2f-4641-bfb0-775ea43b25f6 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:37:03.638885 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9b38bce-bf2f-4641-bfb0-775ea43b25f6 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:37:03.639378 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9b38bce-bf2f-4641-bfb0-775ea43b25f6 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:37:03.640087 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9b38bce-bf2f-4641-bfb0-775ea43b25f6 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:37:03.640554 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9b38bce-bf2f-4641-bfb0-775ea43b25f6 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:37:03.640995 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9b38bce-bf2f-4641-bfb0-775ea43b25f6 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:37:03.776374 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b9b38bce-bf2f-4641-bfb0-775ea43b25f6 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:37:03.784308 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b9b38bce-bf2f-4641-bfb0-775ea43b25f6 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375" status: 200 len: 1266 microversion: 2.1 time: 0.158190 Sep 10 12:37:03.784880 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3371/6735] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:37:03 2022] GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:37:04.808115 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-82c9447d-2ccf-4c8e-aed2-4c0e414f7040 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:37:04.808732 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-82c9447d-2ccf-4c8e-aed2-4c0e414f7040 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 603b92fe-0776-4a33-94b2-47fcbc1be375] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:37:04.811412 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:37:04.817503 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82c9447d-2ccf-4c8e-aed2-4c0e414f7040 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:37:04.818003 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82c9447d-2ccf-4c8e-aed2-4c0e414f7040 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:37:04.818507 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82c9447d-2ccf-4c8e-aed2-4c0e414f7040 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:37:04.819219 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82c9447d-2ccf-4c8e-aed2-4c0e414f7040 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:37:04.819677 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82c9447d-2ccf-4c8e-aed2-4c0e414f7040 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:37:04.820106 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82c9447d-2ccf-4c8e-aed2-4c0e414f7040 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:37:04.958434 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-82c9447d-2ccf-4c8e-aed2-4c0e414f7040 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:37:04.966188 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-82c9447d-2ccf-4c8e-aed2-4c0e414f7040 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375" status: 200 len: 1266 microversion: 2.1 time: 0.161997 Sep 10 12:37:04.966782 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3365/6736] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:37:04 2022] GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:37:05.989232 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-43e42a3a-4b69-4594-a348-07426570443b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:37:05.989914 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-43e42a3a-4b69-4594-a348-07426570443b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 603b92fe-0776-4a33-94b2-47fcbc1be375] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:37:05.991992 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:37:05.998393 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-43e42a3a-4b69-4594-a348-07426570443b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:37:05.998896 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-43e42a3a-4b69-4594-a348-07426570443b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:37:05.999399 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-43e42a3a-4b69-4594-a348-07426570443b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:37:06.000113 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-43e42a3a-4b69-4594-a348-07426570443b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:37:06.000587 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-43e42a3a-4b69-4594-a348-07426570443b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:37:06.001034 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-43e42a3a-4b69-4594-a348-07426570443b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:37:06.133765 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-43e42a3a-4b69-4594-a348-07426570443b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:37:06.142518 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-43e42a3a-4b69-4594-a348-07426570443b tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375" status: 200 len: 1266 microversion: 2.1 time: 0.157743 Sep 10 12:37:06.143208 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3372/6737] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:37:05 2022] GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:37:07.166314 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-762d3d9b-d56b-41cb-b6e5-a6ce39456f88 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:37:07.166952 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-762d3d9b-d56b-41cb-b6e5-a6ce39456f88 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 603b92fe-0776-4a33-94b2-47fcbc1be375] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:37:07.168803 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=8 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:37:07.175183 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-762d3d9b-d56b-41cb-b6e5-a6ce39456f88 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:37:07.175662 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-762d3d9b-d56b-41cb-b6e5-a6ce39456f88 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:37:07.176097 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-762d3d9b-d56b-41cb-b6e5-a6ce39456f88 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:37:07.176777 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-762d3d9b-d56b-41cb-b6e5-a6ce39456f88 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:37:07.177231 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-762d3d9b-d56b-41cb-b6e5-a6ce39456f88 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:37:07.177652 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-762d3d9b-d56b-41cb-b6e5-a6ce39456f88 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:37:07.312687 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-762d3d9b-d56b-41cb-b6e5-a6ce39456f88 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:37:07.320487 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-762d3d9b-d56b-41cb-b6e5-a6ce39456f88 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375" status: 200 len: 1266 microversion: 2.1 time: 0.158044 Sep 10 12:37:07.321052 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3366/6738] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:37:07 2022] GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:37:08.349420 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-38a10706-fc07-483c-ad1a-fb5abffc9ae9 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:37:08.350083 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-38a10706-fc07-483c-ad1a-fb5abffc9ae9 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 603b92fe-0776-4a33-94b2-47fcbc1be375] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:37:08.357042 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-38a10706-fc07-483c-ad1a-fb5abffc9ae9 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:37:08.357542 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-38a10706-fc07-483c-ad1a-fb5abffc9ae9 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:37:08.357997 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-38a10706-fc07-483c-ad1a-fb5abffc9ae9 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:37:08.358707 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-38a10706-fc07-483c-ad1a-fb5abffc9ae9 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:37:08.359202 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-38a10706-fc07-483c-ad1a-fb5abffc9ae9 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:37:08.359653 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-38a10706-fc07-483c-ad1a-fb5abffc9ae9 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:37:08.493617 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-38a10706-fc07-483c-ad1a-fb5abffc9ae9 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:37:08.501393 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-38a10706-fc07-483c-ad1a-fb5abffc9ae9 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375" status: 200 len: 1266 microversion: 2.1 time: 0.156099 Sep 10 12:37:08.501970 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3373/6739] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:37:08 2022] GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:37:09.524849 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7a572f0f-0684-4856-8b20-aa02d4ba0bed tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:37:09.525466 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7a572f0f-0684-4856-8b20-aa02d4ba0bed tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 603b92fe-0776-4a33-94b2-47fcbc1be375] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:37:09.534646 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7a572f0f-0684-4856-8b20-aa02d4ba0bed tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:37:09.535126 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7a572f0f-0684-4856-8b20-aa02d4ba0bed tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:37:09.536145 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7a572f0f-0684-4856-8b20-aa02d4ba0bed tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:37:09.537133 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7a572f0f-0684-4856-8b20-aa02d4ba0bed tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:37:09.537588 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7a572f0f-0684-4856-8b20-aa02d4ba0bed tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:37:09.538019 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7a572f0f-0684-4856-8b20-aa02d4ba0bed tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:37:09.672047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7a572f0f-0684-4856-8b20-aa02d4ba0bed tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:37:09.679720 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7a572f0f-0684-4856-8b20-aa02d4ba0bed tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375" status: 200 len: 1266 microversion: 2.1 time: 0.158881 Sep 10 12:37:09.680293 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3367/6740] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:37:09 2022] GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:37:10.702931 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-477961ec-a78a-405c-b924-0c5431afa2df tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:37:10.703608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-477961ec-a78a-405c-b924-0c5431afa2df tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 603b92fe-0776-4a33-94b2-47fcbc1be375] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:37:10.711571 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-477961ec-a78a-405c-b924-0c5431afa2df tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:37:10.712077 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-477961ec-a78a-405c-b924-0c5431afa2df tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:37:10.712669 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-477961ec-a78a-405c-b924-0c5431afa2df tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:37:10.713487 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-477961ec-a78a-405c-b924-0c5431afa2df tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:37:10.714344 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-477961ec-a78a-405c-b924-0c5431afa2df tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:37:10.715046 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-477961ec-a78a-405c-b924-0c5431afa2df tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:37:10.877293 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-477961ec-a78a-405c-b924-0c5431afa2df tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:37:10.885113 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-477961ec-a78a-405c-b924-0c5431afa2df tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375" status: 200 len: 1266 microversion: 2.1 time: 0.186239 Sep 10 12:37:10.885685 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3374/6741] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:37:10 2022] GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:37:11.913211 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4e0984f8-4077-430e-a704-4f7a74cd6276 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:37:11.913926 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4e0984f8-4077-430e-a704-4f7a74cd6276 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 603b92fe-0776-4a33-94b2-47fcbc1be375] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:37:11.920789 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e0984f8-4077-430e-a704-4f7a74cd6276 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:37:11.921268 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e0984f8-4077-430e-a704-4f7a74cd6276 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:37:11.921704 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e0984f8-4077-430e-a704-4f7a74cd6276 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:37:11.922398 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e0984f8-4077-430e-a704-4f7a74cd6276 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:37:11.922899 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e0984f8-4077-430e-a704-4f7a74cd6276 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:37:11.923307 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e0984f8-4077-430e-a704-4f7a74cd6276 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:37:12.077977 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4e0984f8-4077-430e-a704-4f7a74cd6276 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:37:12.086129 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4e0984f8-4077-430e-a704-4f7a74cd6276 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375" status: 200 len: 1266 microversion: 2.1 time: 0.177593 Sep 10 12:37:12.086720 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3368/6742] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:37:11 2022] GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:37:12.158540 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-f4c5c991-8a93-4f5d-aaeb-8a81ac9af0fe req-bdce4ccf-8b02-4f9a-b042-379c0db1f6e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "603b92fe-0776-4a33-94b2-47fcbc1be375", "name": "network-vif-plugged", "status": "completed", "tag": "ee8caaa4-4d20-4bf6-8253-0218c25ee618"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:37:12.170989 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f4c5c991-8a93-4f5d-aaeb-8a81ac9af0fe req-bdce4ccf-8b02-4f9a-b042-379c0db1f6e1 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:37:12.171575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f4c5c991-8a93-4f5d-aaeb-8a81ac9af0fe req-bdce4ccf-8b02-4f9a-b042-379c0db1f6e1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:37:12.172021 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f4c5c991-8a93-4f5d-aaeb-8a81ac9af0fe req-bdce4ccf-8b02-4f9a-b042-379c0db1f6e1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:37:12.183428 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-f4c5c991-8a93-4f5d-aaeb-8a81ac9af0fe req-bdce4ccf-8b02-4f9a-b042-379c0db1f6e1 service nova] Creating event network-vif-plugged:ee8caaa4-4d20-4bf6-8253-0218c25ee618 for instance 603b92fe-0776-4a33-94b2-47fcbc1be375 on n-h2-856895-1 Sep 10 12:37:12.188584 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-f4c5c991-8a93-4f5d-aaeb-8a81ac9af0fe req-bdce4ccf-8b02-4f9a-b042-379c0db1f6e1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098278 Sep 10 12:37:12.189219 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3375/6743] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:37:13.109368 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3b81bb55-890e-4bf6-97b3-446bee2964c0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:37:13.110003 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3b81bb55-890e-4bf6-97b3-446bee2964c0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 603b92fe-0776-4a33-94b2-47fcbc1be375] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:37:13.117768 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3b81bb55-890e-4bf6-97b3-446bee2964c0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:37:13.118578 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3b81bb55-890e-4bf6-97b3-446bee2964c0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:37:13.118948 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3b81bb55-890e-4bf6-97b3-446bee2964c0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:37:13.119668 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3b81bb55-890e-4bf6-97b3-446bee2964c0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:37:13.120121 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3b81bb55-890e-4bf6-97b3-446bee2964c0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:37:13.120545 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3b81bb55-890e-4bf6-97b3-446bee2964c0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:37:13.254623 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3b81bb55-890e-4bf6-97b3-446bee2964c0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:37:13.262533 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3b81bb55-890e-4bf6-97b3-446bee2964c0 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375" status: 200 len: 1266 microversion: 2.1 time: 0.157035 Sep 10 12:37:13.263084 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3369/6744] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:37:13 2022] GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:37:14.286169 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9841d95f-31bb-4922-966b-2d63c2e37f45 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:37:14.286882 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9841d95f-31bb-4922-966b-2d63c2e37f45 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 603b92fe-0776-4a33-94b2-47fcbc1be375] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:37:14.293663 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9841d95f-31bb-4922-966b-2d63c2e37f45 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:37:14.294155 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9841d95f-31bb-4922-966b-2d63c2e37f45 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:37:14.294614 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9841d95f-31bb-4922-966b-2d63c2e37f45 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:37:14.295375 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9841d95f-31bb-4922-966b-2d63c2e37f45 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:37:14.295846 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9841d95f-31bb-4922-966b-2d63c2e37f45 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:37:14.296288 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9841d95f-31bb-4922-966b-2d63c2e37f45 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:37:14.429611 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9841d95f-31bb-4922-966b-2d63c2e37f45 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:37:14.437444 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9841d95f-31bb-4922-966b-2d63c2e37f45 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375" status: 200 len: 1453 microversion: 2.1 time: 0.155902 Sep 10 12:37:14.438035 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3376/6745] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:37:14 2022] GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375 => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:37:14.460919 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b69181df-89fd-4b77-af0c-4af3171319e1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:37:14.461536 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b69181df-89fd-4b77-af0c-4af3171319e1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 603b92fe-0776-4a33-94b2-47fcbc1be375] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:37:14.468355 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b69181df-89fd-4b77-af0c-4af3171319e1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:37:14.468836 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b69181df-89fd-4b77-af0c-4af3171319e1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:37:14.469275 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b69181df-89fd-4b77-af0c-4af3171319e1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:37:14.469964 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b69181df-89fd-4b77-af0c-4af3171319e1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:37:14.470419 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b69181df-89fd-4b77-af0c-4af3171319e1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:37:14.470849 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b69181df-89fd-4b77-af0c-4af3171319e1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:37:14.605268 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b69181df-89fd-4b77-af0c-4af3171319e1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:37:14.612929 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b69181df-89fd-4b77-af0c-4af3171319e1 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375" status: 200 len: 1453 microversion: 2.1 time: 0.156713 Sep 10 12:37:14.613521 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3370/6746] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:37:14 2022] GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:37:16.210930 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-c0bcd70e-7a95-4bb6-a64f-77153700a187 req-29869ef2-f7c1-4dc5-b039-f678eb80c3c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "603b92fe-0776-4a33-94b2-47fcbc1be375", "tag": "ee8caaa4-4d20-4bf6-8253-0218c25ee618"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:37:16.221877 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-c0bcd70e-7a95-4bb6-a64f-77153700a187 req-29869ef2-f7c1-4dc5-b039-f678eb80c3c8 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:37:16.222386 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-c0bcd70e-7a95-4bb6-a64f-77153700a187 req-29869ef2-f7c1-4dc5-b039-f678eb80c3c8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:37:16.223507 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-c0bcd70e-7a95-4bb6-a64f-77153700a187 req-29869ef2-f7c1-4dc5-b039-f678eb80c3c8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:37:16.236328 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-c0bcd70e-7a95-4bb6-a64f-77153700a187 req-29869ef2-f7c1-4dc5-b039-f678eb80c3c8 service nova] Creating event network-changed:ee8caaa4-4d20-4bf6-8253-0218c25ee618 for instance 603b92fe-0776-4a33-94b2-47fcbc1be375 on n-h2-856895-1 Sep 10 12:37:16.242557 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-c0bcd70e-7a95-4bb6-a64f-77153700a187 req-29869ef2-f7c1-4dc5-b039-f678eb80c3c8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035567 Sep 10 12:37:16.243685 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3377/6747] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:38:50.146541 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:38:50.149214 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=56 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:38:50.151686 n-d-856895-1 devstack@n-api.service[128777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 12:38:50.151943 n-d-856895-1 devstack@n-api.service[128777]: Sat Sep 10 12:38:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375 (ip 10.222.0.23) !!! Sep 10 12:38:50.157490 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-738404c0-8b87-43d2-9220-589b500e7564 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:38:50.157997 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-738404c0-8b87-43d2-9220-589b500e7564 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 603b92fe-0776-4a33-94b2-47fcbc1be375] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:38:50.171073 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-738404c0-8b87-43d2-9220-589b500e7564 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:38:50.172029 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-738404c0-8b87-43d2-9220-589b500e7564 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:38:50.172478 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-738404c0-8b87-43d2-9220-589b500e7564 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:38:50.173198 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-738404c0-8b87-43d2-9220-589b500e7564 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:38:50.173656 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-738404c0-8b87-43d2-9220-589b500e7564 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:38:50.174430 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-738404c0-8b87-43d2-9220-589b500e7564 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:38:50.205231 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-738404c0-8b87-43d2-9220-589b500e7564 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 603b92fe-0776-4a33-94b2-47fcbc1be375] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:38:50.300079 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-738404c0-8b87-43d2-9220-589b500e7564 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "DELETE /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375" status: 204 len: 0 microversion: 2.1 time: 0.155800 Sep 10 12:38:50.303770 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3371/6748] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:38:50 2022] DELETE /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:38:50.309420 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=26 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:38:50.310284 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=54 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:38:50.311500 n-d-856895-1 devstack@n-api.service[128776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 12:38:50.311646 n-d-856895-1 devstack@n-api.service[128776]: Sat Sep 10 12:38:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375 (ip 10.222.0.23) !!! Sep 10 12:38:50.312830 n-d-856895-1 devstack@n-api.service[128776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 12:38:50.312982 n-d-856895-1 devstack@n-api.service[128776]: Sat Sep 10 12:38:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375 (ip 10.222.0.23) !!! Sep 10 12:38:50.329081 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-379634a6-64d2-422f-82b6-190b77cda9c3 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:38:50.329882 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-379634a6-64d2-422f-82b6-190b77cda9c3 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 603b92fe-0776-4a33-94b2-47fcbc1be375] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:38:50.341156 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-379634a6-64d2-422f-82b6-190b77cda9c3 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:38:50.341771 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-379634a6-64d2-422f-82b6-190b77cda9c3 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:38:50.342244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-379634a6-64d2-422f-82b6-190b77cda9c3 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:38:50.342981 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-379634a6-64d2-422f-82b6-190b77cda9c3 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:38:50.343800 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-379634a6-64d2-422f-82b6-190b77cda9c3 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:38:50.344317 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-379634a6-64d2-422f-82b6-190b77cda9c3 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:38:50.481705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-4f1e3e35-90e7-45e8-912c-2c4ec8845ab3 req-cd1aed39-5700-4198-bab7-2739448c0639 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "603b92fe-0776-4a33-94b2-47fcbc1be375", "tag": "ee8caaa4-4d20-4bf6-8253-0218c25ee618"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:38:50.490681 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-379634a6-64d2-422f-82b6-190b77cda9c3 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:38:50.498035 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-4f1e3e35-90e7-45e8-912c-2c4ec8845ab3 req-cd1aed39-5700-4198-bab7-2739448c0639 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:38:50.498661 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-4f1e3e35-90e7-45e8-912c-2c4ec8845ab3 req-cd1aed39-5700-4198-bab7-2739448c0639 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:38:50.498923 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-379634a6-64d2-422f-82b6-190b77cda9c3 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375" status: 200 len: 1459 microversion: 2.1 time: 0.193579 Sep 10 12:38:50.499100 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-4f1e3e35-90e7-45e8-912c-2c4ec8845ab3 req-cd1aed39-5700-4198-bab7-2739448c0639 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:38:50.500055 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3378/6749] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:38:50 2022] GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375 => generated 1459 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:38:50.512222 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-4f1e3e35-90e7-45e8-912c-2c4ec8845ab3 req-cd1aed39-5700-4198-bab7-2739448c0639 service nova] Creating event network-changed:ee8caaa4-4d20-4bf6-8253-0218c25ee618 for instance 603b92fe-0776-4a33-94b2-47fcbc1be375 on n-h2-856895-1 Sep 10 12:38:50.517082 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-4f1e3e35-90e7-45e8-912c-2c4ec8845ab3 req-cd1aed39-5700-4198-bab7-2739448c0639 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182344 Sep 10 12:38:50.517685 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3372/6750] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:38:51.524091 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b232ef5c-d41e-4389-82f8-8a2272177b8a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:38:51.524798 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b232ef5c-d41e-4389-82f8-8a2272177b8a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 603b92fe-0776-4a33-94b2-47fcbc1be375] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:38:51.532415 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b232ef5c-d41e-4389-82f8-8a2272177b8a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:38:51.533219 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b232ef5c-d41e-4389-82f8-8a2272177b8a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:38:51.533685 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b232ef5c-d41e-4389-82f8-8a2272177b8a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:38:51.534402 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b232ef5c-d41e-4389-82f8-8a2272177b8a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:38:51.534946 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b232ef5c-d41e-4389-82f8-8a2272177b8a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:38:51.535425 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b232ef5c-d41e-4389-82f8-8a2272177b8a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:38:51.667402 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b232ef5c-d41e-4389-82f8-8a2272177b8a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:38:51.675587 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b232ef5c-d41e-4389-82f8-8a2272177b8a tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375" status: 200 len: 1459 microversion: 2.1 time: 0.156016 Sep 10 12:38:51.676103 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3379/6751] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:38:51 2022] GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375 => generated 1459 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:38:52.381937 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-953ed452-9fa8-4ccd-b8f8-9caa00baa2a4 req-30c41c06-0497-407e-8dec-54c8eb3dca94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "603b92fe-0776-4a33-94b2-47fcbc1be375", "name": "network-vif-deleted", "tag": "ee8caaa4-4d20-4bf6-8253-0218c25ee618"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:38:52.392449 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-953ed452-9fa8-4ccd-b8f8-9caa00baa2a4 req-30c41c06-0497-407e-8dec-54c8eb3dca94 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:38:52.393159 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-953ed452-9fa8-4ccd-b8f8-9caa00baa2a4 req-30c41c06-0497-407e-8dec-54c8eb3dca94 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:38:52.393159 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-953ed452-9fa8-4ccd-b8f8-9caa00baa2a4 req-30c41c06-0497-407e-8dec-54c8eb3dca94 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:38:52.405094 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-953ed452-9fa8-4ccd-b8f8-9caa00baa2a4 req-30c41c06-0497-407e-8dec-54c8eb3dca94 service nova] Creating event network-vif-deleted:ee8caaa4-4d20-4bf6-8253-0218c25ee618 for instance 603b92fe-0776-4a33-94b2-47fcbc1be375 on n-h2-856895-1 Sep 10 12:38:52.410117 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-953ed452-9fa8-4ccd-b8f8-9caa00baa2a4 req-30c41c06-0497-407e-8dec-54c8eb3dca94 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087650 Sep 10 12:38:52.410728 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3373/6752] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:38:52.700640 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-aa18db5c-1420-4f15-b3d3-270ac834f619 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:38:52.701437 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-aa18db5c-1420-4f15-b3d3-270ac834f619 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 603b92fe-0776-4a33-94b2-47fcbc1be375] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:38:52.710964 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aa18db5c-1420-4f15-b3d3-270ac834f619 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:38:52.711532 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aa18db5c-1420-4f15-b3d3-270ac834f619 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:38:52.711992 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aa18db5c-1420-4f15-b3d3-270ac834f619 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:38:52.712717 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aa18db5c-1420-4f15-b3d3-270ac834f619 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:38:52.713808 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aa18db5c-1420-4f15-b3d3-270ac834f619 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:38:52.714444 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aa18db5c-1420-4f15-b3d3-270ac834f619 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:38:52.777717 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-aa18db5c-1420-4f15-b3d3-270ac834f619 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:38:52.785829 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-aa18db5c-1420-4f15-b3d3-270ac834f619 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375" status: 200 len: 1226 microversion: 2.1 time: 0.090274 Sep 10 12:38:52.786356 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3380/6753] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:38:52 2022] GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:38:53.811637 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-acc1531a-0fdc-41f6-87d7-77553c0f89aa tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:38:53.812343 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-acc1531a-0fdc-41f6-87d7-77553c0f89aa tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 603b92fe-0776-4a33-94b2-47fcbc1be375] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:38:53.818958 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-acc1531a-0fdc-41f6-87d7-77553c0f89aa tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:38:53.819474 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-acc1531a-0fdc-41f6-87d7-77553c0f89aa tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:38:53.819908 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-acc1531a-0fdc-41f6-87d7-77553c0f89aa tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:38:53.820605 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-acc1531a-0fdc-41f6-87d7-77553c0f89aa tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:38:53.821057 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-acc1531a-0fdc-41f6-87d7-77553c0f89aa tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:38:53.821482 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-acc1531a-0fdc-41f6-87d7-77553c0f89aa tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:38:53.903345 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-acc1531a-0fdc-41f6-87d7-77553c0f89aa tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:38:53.911700 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-acc1531a-0fdc-41f6-87d7-77553c0f89aa tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375" status: 200 len: 1226 microversion: 2.1 time: 0.105074 Sep 10 12:38:53.912624 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3374/6754] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:38:53 2022] GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375 => generated 1226 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:38:54.936955 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8dbd432a-8629-40f8-83d0-2c399f3631d5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:38:54.937588 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8dbd432a-8629-40f8-83d0-2c399f3631d5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 603b92fe-0776-4a33-94b2-47fcbc1be375] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:38:54.946604 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8dbd432a-8629-40f8-83d0-2c399f3631d5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:38:54.947104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8dbd432a-8629-40f8-83d0-2c399f3631d5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:38:54.947589 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8dbd432a-8629-40f8-83d0-2c399f3631d5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:38:54.948586 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8dbd432a-8629-40f8-83d0-2c399f3631d5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:38:54.949269 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8dbd432a-8629-40f8-83d0-2c399f3631d5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:38:54.949715 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8dbd432a-8629-40f8-83d0-2c399f3631d5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:38:55.020714 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8dbd432a-8629-40f8-83d0-2c399f3631d5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:38:55.030014 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8dbd432a-8629-40f8-83d0-2c399f3631d5 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375" status: 200 len: 1226 microversion: 2.1 time: 0.097785 Sep 10 12:38:55.030592 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3381/6755] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:38:54 2022] GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:38:56.053295 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9c33bb6d-b5bb-4686-b9cb-96da955d0103 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:38:56.053946 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9c33bb6d-b5bb-4686-b9cb-96da955d0103 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 603b92fe-0776-4a33-94b2-47fcbc1be375] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:38:56.061632 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9c33bb6d-b5bb-4686-b9cb-96da955d0103 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:38:56.062137 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9c33bb6d-b5bb-4686-b9cb-96da955d0103 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:38:56.062555 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9c33bb6d-b5bb-4686-b9cb-96da955d0103 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:38:56.063281 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9c33bb6d-b5bb-4686-b9cb-96da955d0103 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:38:56.063739 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9c33bb6d-b5bb-4686-b9cb-96da955d0103 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:38:56.064169 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9c33bb6d-b5bb-4686-b9cb-96da955d0103 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:38:56.126600 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9c33bb6d-b5bb-4686-b9cb-96da955d0103 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:38:56.134571 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9c33bb6d-b5bb-4686-b9cb-96da955d0103 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375" status: 200 len: 1226 microversion: 2.1 time: 0.085136 Sep 10 12:38:56.142207 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3375/6756] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:38:56 2022] GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:38:57.158619 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-28d24b8b-947c-4c79-b7d4-820d161deb02 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:38:57.159288 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-28d24b8b-947c-4c79-b7d4-820d161deb02 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: 603b92fe-0776-4a33-94b2-47fcbc1be375] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:38:57.166150 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28d24b8b-947c-4c79-b7d4-820d161deb02 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:38:57.166646 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28d24b8b-947c-4c79-b7d4-820d161deb02 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:38:57.167430 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28d24b8b-947c-4c79-b7d4-820d161deb02 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:38:57.168141 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28d24b8b-947c-4c79-b7d4-820d161deb02 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:38:57.168614 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28d24b8b-947c-4c79-b7d4-820d161deb02 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:38:57.169058 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28d24b8b-947c-4c79-b7d4-820d161deb02 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:38:57.182478 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-28d24b8b-947c-4c79-b7d4-820d161deb02 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] HTTP exception thrown: Instance 603b92fe-0776-4a33-94b2-47fcbc1be375 could not be found. Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-28d24b8b-947c-4c79-b7d4-820d161deb02 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Request method failure captured: Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375 HTTP/1.1 Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHILszP5bh-7vS5nFlniigSPwJSgl9gRBzD28JMJ3uXj7KaJ7IKD0MoPbGUyk7NiR2g3O-OhOoEJg5Mrgl8pVom5QsCHuzRwflIP07SHDWyP4-s7StMch63ybX3LIelpp866T-_UOtQoKy1YDkCCnydW84pCURv3Zlf7uIJ_dXgYsc64 Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: e27276f18d8045e2a9be7a6c5ed892f7 Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e27276f18d8045e2a9be7a6c5ed892f7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: e27276f18d8045e2a9be7a6c5ed892f7 Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-TestVolumeBootPattern-1940983644-project Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 5f0b168293f943389d72753009c88789 Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-TestVolumeBootPattern-1940983644-project Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 603b92fe-0776-4a33-94b2-47fcbc1be375 could not be found. Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '603b92fe-0776-4a33-94b2-47fcbc1be375'} Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 603b92fe-0776-4a33-94b2-47fcbc1be375 could not be found. Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 603b92fe-0776-4a33-94b2-47fcbc1be375 could not be found. Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:38:57.184384 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:38:57.188240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:38:57.188240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:38:57.188240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:38:57.188240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:38:57.188240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:38:57.188240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 603b92fe-0776-4a33-94b2-47fcbc1be375 could not be found. Sep 10 12:38:57.188240 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:38:57.188240 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-28d24b8b-947c-4c79-b7d4-820d161deb02 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Returning 404 to user: Instance 603b92fe-0776-4a33-94b2-47fcbc1be375 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:38:57.188240 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-28d24b8b-947c-4c79-b7d4-820d161deb02 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375" status: 404 len: 111 microversion: 2.1 time: 0.031203 Sep 10 12:38:57.188240 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3382/6757] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:38:57 2022] GET /compute/v2.1/servers/603b92fe-0776-4a33-94b2-47fcbc1be375 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:39:03.419717 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-516137a7-ff36-4ed3-b921-48cf50e7ee07 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:39:03.420275 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-516137a7-ff36-4ed3-b921-48cf50e7ee07 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ab00bcb2-018d-4774-bf6c-1f59d6b01c32] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:39:03.422908 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-eff9e4a3-8fdf-4040-ac40-c48887bd621e req-82d01d62-9e3e-4ab9-b837-9f5a4dba09e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab00bcb2-018d-4774-bf6c-1f59d6b01c32", "tag": "1e0ba526-010b-4bd6-82fc-b554a9a6b006"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:39:03.427561 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-516137a7-ff36-4ed3-b921-48cf50e7ee07 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:03.428122 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-516137a7-ff36-4ed3-b921-48cf50e7ee07 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:03.428626 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-516137a7-ff36-4ed3-b921-48cf50e7ee07 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:03.429397 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-516137a7-ff36-4ed3-b921-48cf50e7ee07 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:03.429849 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-516137a7-ff36-4ed3-b921-48cf50e7ee07 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:03.430449 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-516137a7-ff36-4ed3-b921-48cf50e7ee07 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:03.433850 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-eff9e4a3-8fdf-4040-ac40-c48887bd621e req-82d01d62-9e3e-4ab9-b837-9f5a4dba09e8 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:03.434360 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-eff9e4a3-8fdf-4040-ac40-c48887bd621e req-82d01d62-9e3e-4ab9-b837-9f5a4dba09e8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:03.434814 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-eff9e4a3-8fdf-4040-ac40-c48887bd621e req-82d01d62-9e3e-4ab9-b837-9f5a4dba09e8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:03.446892 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-eff9e4a3-8fdf-4040-ac40-c48887bd621e req-82d01d62-9e3e-4ab9-b837-9f5a4dba09e8 service nova] Creating event network-changed:1e0ba526-010b-4bd6-82fc-b554a9a6b006 for instance ab00bcb2-018d-4774-bf6c-1f59d6b01c32 on n-h1-856895-1 Sep 10 12:39:03.452377 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-eff9e4a3-8fdf-4040-ac40-c48887bd621e req-82d01d62-9e3e-4ab9-b837-9f5a4dba09e8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034373 Sep 10 12:39:03.453348 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3383/6758] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:39:03.457955 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-516137a7-ff36-4ed3-b921-48cf50e7ee07 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ab00bcb2-018d-4774-bf6c-1f59d6b01c32] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:39:03.545116 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-516137a7-ff36-4ed3-b921-48cf50e7ee07 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32" status: 204 len: 0 microversion: 2.1 time: 0.129075 Sep 10 12:39:03.549946 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3376/6759] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:39:03 2022] DELETE /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:39:03.556427 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-110c0417-6778-4519-8284-c3f0dc100143 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:39:03.557277 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-110c0417-6778-4519-8284-c3f0dc100143 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ab00bcb2-018d-4774-bf6c-1f59d6b01c32] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:39:03.564091 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-110c0417-6778-4519-8284-c3f0dc100143 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:03.564608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-110c0417-6778-4519-8284-c3f0dc100143 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:03.565067 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-110c0417-6778-4519-8284-c3f0dc100143 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:03.565997 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-110c0417-6778-4519-8284-c3f0dc100143 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:03.566482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-110c0417-6778-4519-8284-c3f0dc100143 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:03.566929 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-110c0417-6778-4519-8284-c3f0dc100143 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:03.715885 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-110c0417-6778-4519-8284-c3f0dc100143 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:39:03.723976 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-110c0417-6778-4519-8284-c3f0dc100143 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32" status: 200 len: 1577 microversion: 2.1 time: 0.172624 Sep 10 12:39:03.724580 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3384/6760] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:39:03 2022] GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32 => generated 1577 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:39:04.748818 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-491d4820-c050-4685-bb85-c5bc148d181e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:39:04.749537 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-491d4820-c050-4685-bb85-c5bc148d181e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ab00bcb2-018d-4774-bf6c-1f59d6b01c32] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:39:04.756679 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-491d4820-c050-4685-bb85-c5bc148d181e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:04.757173 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-491d4820-c050-4685-bb85-c5bc148d181e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:04.757612 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-491d4820-c050-4685-bb85-c5bc148d181e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:04.758326 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-491d4820-c050-4685-bb85-c5bc148d181e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:04.758792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-491d4820-c050-4685-bb85-c5bc148d181e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:04.759243 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-491d4820-c050-4685-bb85-c5bc148d181e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:05.194904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-491d4820-c050-4685-bb85-c5bc148d181e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:39:05.202687 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-491d4820-c050-4685-bb85-c5bc148d181e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32" status: 200 len: 1577 microversion: 2.1 time: 0.458174 Sep 10 12:39:05.203283 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3377/6761] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:39:04 2022] GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32 => generated 1577 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:39:05.828033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-22512ff6-28cd-421a-8911-de998c97256e req-4798d84a-8c57-4919-8965-2c89bc210d0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab00bcb2-018d-4774-bf6c-1f59d6b01c32", "name": "network-vif-deleted", "tag": "1e0ba526-010b-4bd6-82fc-b554a9a6b006"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:39:05.840081 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-22512ff6-28cd-421a-8911-de998c97256e req-4798d84a-8c57-4919-8965-2c89bc210d0e service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:05.840598 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-22512ff6-28cd-421a-8911-de998c97256e req-4798d84a-8c57-4919-8965-2c89bc210d0e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:05.841042 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-22512ff6-28cd-421a-8911-de998c97256e req-4798d84a-8c57-4919-8965-2c89bc210d0e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:05.853963 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-22512ff6-28cd-421a-8911-de998c97256e req-4798d84a-8c57-4919-8965-2c89bc210d0e service nova] Creating event network-vif-deleted:1e0ba526-010b-4bd6-82fc-b554a9a6b006 for instance ab00bcb2-018d-4774-bf6c-1f59d6b01c32 on n-h1-856895-1 Sep 10 12:39:05.860636 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-22512ff6-28cd-421a-8911-de998c97256e req-4798d84a-8c57-4919-8965-2c89bc210d0e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035829 Sep 10 12:39:05.861241 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3385/6762] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:39:06.227376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-66d68d55-769f-4764-ba0c-cd4c5db350bd tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:39:06.228108 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-66d68d55-769f-4764-ba0c-cd4c5db350bd tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ab00bcb2-018d-4774-bf6c-1f59d6b01c32] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:39:06.236507 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66d68d55-769f-4764-ba0c-cd4c5db350bd tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:06.237083 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66d68d55-769f-4764-ba0c-cd4c5db350bd tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:06.237715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66d68d55-769f-4764-ba0c-cd4c5db350bd tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:06.238494 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66d68d55-769f-4764-ba0c-cd4c5db350bd tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:06.239040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66d68d55-769f-4764-ba0c-cd4c5db350bd tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:06.239560 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66d68d55-769f-4764-ba0c-cd4c5db350bd tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:06.303448 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-66d68d55-769f-4764-ba0c-cd4c5db350bd tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:39:06.318755 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-66d68d55-769f-4764-ba0c-cd4c5db350bd tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32" status: 200 len: 1226 microversion: 2.1 time: 0.095437 Sep 10 12:39:06.319387 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3378/6763] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:39:06 2022] GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:39:07.342926 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-93a989d2-6ff9-4252-a59f-4290c42d0f0d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:39:07.343738 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-93a989d2-6ff9-4252-a59f-4290c42d0f0d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ab00bcb2-018d-4774-bf6c-1f59d6b01c32] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:39:07.351980 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-93a989d2-6ff9-4252-a59f-4290c42d0f0d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:07.352484 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-93a989d2-6ff9-4252-a59f-4290c42d0f0d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:07.352940 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-93a989d2-6ff9-4252-a59f-4290c42d0f0d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:07.353698 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-93a989d2-6ff9-4252-a59f-4290c42d0f0d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:07.354360 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-93a989d2-6ff9-4252-a59f-4290c42d0f0d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:07.354806 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-93a989d2-6ff9-4252-a59f-4290c42d0f0d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:07.420155 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-93a989d2-6ff9-4252-a59f-4290c42d0f0d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:39:07.428650 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-93a989d2-6ff9-4252-a59f-4290c42d0f0d tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32" status: 200 len: 1226 microversion: 2.1 time: 0.090277 Sep 10 12:39:07.429482 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3386/6764] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:39:07 2022] GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:39:08.452898 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fa67ecb6-669d-4957-a80d-7beda03ef0ed tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:39:08.453524 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fa67ecb6-669d-4957-a80d-7beda03ef0ed tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ab00bcb2-018d-4774-bf6c-1f59d6b01c32] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:39:08.460472 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fa67ecb6-669d-4957-a80d-7beda03ef0ed tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:08.461081 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fa67ecb6-669d-4957-a80d-7beda03ef0ed tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:08.461530 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fa67ecb6-669d-4957-a80d-7beda03ef0ed tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:08.462232 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fa67ecb6-669d-4957-a80d-7beda03ef0ed tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:08.463195 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fa67ecb6-669d-4957-a80d-7beda03ef0ed tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:08.463644 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fa67ecb6-669d-4957-a80d-7beda03ef0ed tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:08.529688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fa67ecb6-669d-4957-a80d-7beda03ef0ed tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:39:08.537638 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fa67ecb6-669d-4957-a80d-7beda03ef0ed tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32" status: 200 len: 1226 microversion: 2.1 time: 0.089146 Sep 10 12:39:08.538221 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3379/6765] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:39:08 2022] GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:39:09.562222 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6510873f-766a-44c3-868f-bea071f9e44e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:39:09.562970 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6510873f-766a-44c3-868f-bea071f9e44e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ab00bcb2-018d-4774-bf6c-1f59d6b01c32] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:39:09.569766 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6510873f-766a-44c3-868f-bea071f9e44e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:09.570451 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6510873f-766a-44c3-868f-bea071f9e44e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:09.570902 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6510873f-766a-44c3-868f-bea071f9e44e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:09.571634 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6510873f-766a-44c3-868f-bea071f9e44e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:09.572100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6510873f-766a-44c3-868f-bea071f9e44e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:09.573161 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6510873f-766a-44c3-868f-bea071f9e44e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:09.636322 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6510873f-766a-44c3-868f-bea071f9e44e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f0b168293f943389d72753009c88789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27276f18d8045e2a9be7a6c5ed892f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:39:09.644219 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6510873f-766a-44c3-868f-bea071f9e44e tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32" status: 200 len: 1226 microversion: 2.1 time: 0.086037 Sep 10 12:39:09.644793 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3387/6766] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:39:09 2022] GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:39:10.668294 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ff669e47-e854-4000-8556-3b84e125dec8 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:39:10.668914 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ff669e47-e854-4000-8556-3b84e125dec8 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: ab00bcb2-018d-4774-bf6c-1f59d6b01c32] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:39:10.675750 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ff669e47-e854-4000-8556-3b84e125dec8 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:10.676232 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ff669e47-e854-4000-8556-3b84e125dec8 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:10.676668 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ff669e47-e854-4000-8556-3b84e125dec8 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:10.677357 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ff669e47-e854-4000-8556-3b84e125dec8 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:10.677815 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ff669e47-e854-4000-8556-3b84e125dec8 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:10.678242 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ff669e47-e854-4000-8556-3b84e125dec8 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:10.692246 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-ff669e47-e854-4000-8556-3b84e125dec8 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] HTTP exception thrown: Instance ab00bcb2-018d-4774-bf6c-1f59d6b01c32 could not be found. Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ff669e47-e854-4000-8556-3b84e125dec8 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Request method failure captured: Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32 HTTP/1.1 Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHILszP5bh-7vS5nFlniigSPwJSgl9gRBzD28JMJ3uXj7KaJ7IKD0MoPbGUyk7NiR2g3O-OhOoEJg5Mrgl8pVom5QsCHuzRwflIP07SHDWyP4-s7StMch63ybX3LIelpp866T-_UOtQoKy1YDkCCnydW84pCURv3Zlf7uIJ_dXgYsc64 Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: e27276f18d8045e2a9be7a6c5ed892f7 Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e27276f18d8045e2a9be7a6c5ed892f7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: e27276f18d8045e2a9be7a6c5ed892f7 Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-TestVolumeBootPattern-1940983644-project Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 5f0b168293f943389d72753009c88789 Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-TestVolumeBootPattern-1940983644-project Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance ab00bcb2-018d-4774-bf6c-1f59d6b01c32 could not be found. Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'ab00bcb2-018d-4774-bf6c-1f59d6b01c32'} Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab00bcb2-018d-4774-bf6c-1f59d6b01c32 could not be found. Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab00bcb2-018d-4774-bf6c-1f59d6b01c32 could not be found. Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:39:10.693876 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:39:10.698369 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:39:10.698369 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:39:10.698369 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:39:10.698369 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:39:10.698369 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:39:10.698369 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab00bcb2-018d-4774-bf6c-1f59d6b01c32 could not be found. Sep 10 12:39:10.698369 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:39:10.698369 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ff669e47-e854-4000-8556-3b84e125dec8 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Returning 404 to user: Instance ab00bcb2-018d-4774-bf6c-1f59d6b01c32 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:39:10.698369 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ff669e47-e854-4000-8556-3b84e125dec8 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32" status: 404 len: 111 microversion: 2.1 time: 0.031490 Sep 10 12:39:10.698369 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3380/6767] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:39:10 2022] GET /compute/v2.1/servers/ab00bcb2-018d-4774-bf6c-1f59d6b01c32 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:39:11.140802 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c52c9194-4cb9-4292-8aa2-4e9637bf7f9f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:39:11.141602 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c52c9194-4cb9-4292-8aa2-4e9637bf7f9f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: e7c59379-7e4c-4a26-87d4-6074baabf96d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:39:11.148785 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c52c9194-4cb9-4292-8aa2-4e9637bf7f9f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:11.149329 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c52c9194-4cb9-4292-8aa2-4e9637bf7f9f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:11.149846 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c52c9194-4cb9-4292-8aa2-4e9637bf7f9f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:11.151610 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c52c9194-4cb9-4292-8aa2-4e9637bf7f9f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:11.152233 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c52c9194-4cb9-4292-8aa2-4e9637bf7f9f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:11.152819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c52c9194-4cb9-4292-8aa2-4e9637bf7f9f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:11.167518 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-c52c9194-4cb9-4292-8aa2-4e9637bf7f9f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] HTTP exception thrown: Instance e7c59379-7e4c-4a26-87d4-6074baabf96d could not be found. Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c52c9194-4cb9-4292-8aa2-4e9637bf7f9f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Request method failure captured: Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d HTTP/1.1 Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHILszP5bh-7vS5nFlniigSPwJSgl9gRBzD28JMJ3uXj7KaJ7IKD0MoPbGUyk7NiR2g3O-OhOoEJg5Mrgl8pVom5QsCHuzRwflIP07SHDWyP4-s7StMch63ybX3LIelpp866T-_UOtQoKy1YDkCCnydW84pCURv3Zlf7uIJ_dXgYsc64 Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: e27276f18d8045e2a9be7a6c5ed892f7 Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e27276f18d8045e2a9be7a6c5ed892f7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: e27276f18d8045e2a9be7a6c5ed892f7 Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-TestVolumeBootPattern-1940983644-project Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 5f0b168293f943389d72753009c88789 Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-TestVolumeBootPattern-1940983644-project Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance e7c59379-7e4c-4a26-87d4-6074baabf96d could not be found. Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'e7c59379-7e4c-4a26-87d4-6074baabf96d'} Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7c59379-7e4c-4a26-87d4-6074baabf96d could not be found. Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:39:11.169287 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:39:11.173031 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7c59379-7e4c-4a26-87d4-6074baabf96d could not be found. Sep 10 12:39:11.173031 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:39:11.173031 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:39:11.173031 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:39:11.173031 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:39:11.173031 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:39:11.173031 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:39:11.173031 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:39:11.173031 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:39:11.173031 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7c59379-7e4c-4a26-87d4-6074baabf96d could not be found. Sep 10 12:39:11.173031 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:39:11.173031 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c52c9194-4cb9-4292-8aa2-4e9637bf7f9f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Returning 404 to user: Instance e7c59379-7e4c-4a26-87d4-6074baabf96d could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:39:11.173031 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c52c9194-4cb9-4292-8aa2-4e9637bf7f9f tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d" status: 404 len: 111 microversion: 2.1 time: 0.034040 Sep 10 12:39:11.174533 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3388/6768] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:39:11 2022] DELETE /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:39:11.179726 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d122696c-a7a6-4eb9-a31d-84178506569c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:39:11.180346 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d122696c-a7a6-4eb9-a31d-84178506569c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] [instance: e7c59379-7e4c-4a26-87d4-6074baabf96d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:39:11.186628 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d122696c-a7a6-4eb9-a31d-84178506569c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:11.187109 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d122696c-a7a6-4eb9-a31d-84178506569c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:11.187573 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d122696c-a7a6-4eb9-a31d-84178506569c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:11.188293 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d122696c-a7a6-4eb9-a31d-84178506569c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:11.188742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d122696c-a7a6-4eb9-a31d-84178506569c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:11.189188 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d122696c-a7a6-4eb9-a31d-84178506569c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:11.202793 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-d122696c-a7a6-4eb9-a31d-84178506569c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] HTTP exception thrown: Instance e7c59379-7e4c-4a26-87d4-6074baabf96d could not be found. Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d122696c-a7a6-4eb9-a31d-84178506569c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Request method failure captured: Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d HTTP/1.1 Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHILszP5bh-7vS5nFlniigSPwJSgl9gRBzD28JMJ3uXj7KaJ7IKD0MoPbGUyk7NiR2g3O-OhOoEJg5Mrgl8pVom5QsCHuzRwflIP07SHDWyP4-s7StMch63ybX3LIelpp866T-_UOtQoKy1YDkCCnydW84pCURv3Zlf7uIJ_dXgYsc64 Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: e27276f18d8045e2a9be7a6c5ed892f7 Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e27276f18d8045e2a9be7a6c5ed892f7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e27276f18d8045e2a9be7a6c5ed892f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: e27276f18d8045e2a9be7a6c5ed892f7 Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-TestVolumeBootPattern-1940983644 Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-TestVolumeBootPattern-1940983644-project Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 5f0b168293f943389d72753009c88789 Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-TestVolumeBootPattern-1940983644-project Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance e7c59379-7e4c-4a26-87d4-6074baabf96d could not be found. Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'e7c59379-7e4c-4a26-87d4-6074baabf96d'} Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7c59379-7e4c-4a26-87d4-6074baabf96d could not be found. Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7c59379-7e4c-4a26-87d4-6074baabf96d could not be found. Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:39:11.204374 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:39:11.210694 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:39:11.210694 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:39:11.210694 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:39:11.210694 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:39:11.210694 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:39:11.210694 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7c59379-7e4c-4a26-87d4-6074baabf96d could not be found. Sep 10 12:39:11.210694 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:39:11.210694 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d122696c-a7a6-4eb9-a31d-84178506569c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Returning 404 to user: Instance e7c59379-7e4c-4a26-87d4-6074baabf96d could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:39:11.210694 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d122696c-a7a6-4eb9-a31d-84178506569c tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d" status: 404 len: 111 microversion: 2.1 time: 0.030104 Sep 10 12:39:11.210694 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3381/6769] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:39:11 2022] GET /compute/v2.1/servers/e7c59379-7e4c-4a26-87d4-6074baabf96d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:39:14.642100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a8daf233-a82b-403e-b3c3-bb6f411065e2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] Calling method '.version_select at 0x7f40733e8160>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:39:14.680339 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a8daf233-a82b-403e-b3c3-bb6f411065e2 tempest-TestVolumeBootPattern-1940983644 tempest-TestVolumeBootPattern-1940983644-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1302349969" status: 202 len: 0 microversion: 2.1 time: 0.043712 Sep 10 12:39:14.681241 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3389/6770] 10.222.0.23 () {58 vars in 1263 bytes} [Sat Sep 10 12:39:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1302349969 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:39:32.597550 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:39:32.598290 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:39:32.708550 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-be628863-0d14-444a-9d2e-753d0bb0f3a8 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-699433271", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:39:32.764067 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-be628863-0d14-444a-9d2e-753d0bb0f3a8 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] validate_networks() for None {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:39:32.956245 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-be628863-0d14-444a-9d2e-753d0bb0f3a8 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:39:32.956668 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-be628863-0d14-444a-9d2e-753d0bb0f3a8 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:39:32.957143 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-be628863-0d14-444a-9d2e-753d0bb0f3a8 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:39:32.957552 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-be628863-0d14-444a-9d2e-753d0bb0f3a8 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:39:32.957962 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-be628863-0d14-444a-9d2e-753d0bb0f3a8 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:39:32.971101 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be628863-0d14-444a-9d2e-753d0bb0f3a8 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:32.971967 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be628863-0d14-444a-9d2e-753d0bb0f3a8 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:32.971967 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be628863-0d14-444a-9d2e-753d0bb0f3a8 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:32.972571 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be628863-0d14-444a-9d2e-753d0bb0f3a8 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:32.972982 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be628863-0d14-444a-9d2e-753d0bb0f3a8 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:32.973493 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-be628863-0d14-444a-9d2e-753d0bb0f3a8 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:32.993491 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-be628863-0d14-444a-9d2e-753d0bb0f3a8 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Getting quotas for project 041038bd112a43f2b36b48ca7bef4739. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:39:32.999247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-be628863-0d14-444a-9d2e-753d0bb0f3a8 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Getting quotas for user 5951f548e4804bc8a912bf36786d6a39 and project 041038bd112a43f2b36b48ca7bef4739. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:39:33.012179 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-be628863-0d14-444a-9d2e-753d0bb0f3a8 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:39:33.014425 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-be628863-0d14-444a-9d2e-753d0bb0f3a8 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] [instance: 82d8df23-6130-4257-9f71-545775fd73e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:39:33.059325 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-be628863-0d14-444a-9d2e-753d0bb0f3a8 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.466768 Sep 10 12:39:33.059980 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3382/6771] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:39:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 468 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:39:33.073338 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dbf165bd-6410-4ca5-aded-7881dce5b0a5 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:39:33.074065 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-dbf165bd-6410-4ca5-aded-7881dce5b0a5 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] [instance: 82d8df23-6130-4257-9f71-545775fd73e8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:39:33.080323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=50 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:39:33.081421 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:39:33.138714 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-dbf165bd-6410-4ca5-aded-7881dce5b0a5 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951f548e4804bc8a912bf36786d6a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041038bd112a43f2b36b48ca7bef4739', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:39:33.148499 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-dbf165bd-6410-4ca5-aded-7881dce5b0a5 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] 10.222.0.23 "GET /compute/v2.1/servers/82d8df23-6130-4257-9f71-545775fd73e8" status: 200 len: 1221 microversion: 2.1 time: 0.079960 Sep 10 12:39:33.149095 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3390/6772] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:39:33 2022] GET /compute/v2.1/servers/82d8df23-6130-4257-9f71-545775fd73e8 => generated 1221 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:39:34.173994 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f750676e-78d8-4228-a65c-c04530b72e23 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:39:34.174745 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f750676e-78d8-4228-a65c-c04530b72e23 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] [instance: 82d8df23-6130-4257-9f71-545775fd73e8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:39:34.181903 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f750676e-78d8-4228-a65c-c04530b72e23 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:34.182399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f750676e-78d8-4228-a65c-c04530b72e23 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:34.182977 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f750676e-78d8-4228-a65c-c04530b72e23 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:34.183896 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f750676e-78d8-4228-a65c-c04530b72e23 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:34.184366 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f750676e-78d8-4228-a65c-c04530b72e23 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:34.184937 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f750676e-78d8-4228-a65c-c04530b72e23 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:34.252575 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f750676e-78d8-4228-a65c-c04530b72e23 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951f548e4804bc8a912bf36786d6a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041038bd112a43f2b36b48ca7bef4739', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:39:34.263149 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f750676e-78d8-4228-a65c-c04530b72e23 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] 10.222.0.23 "GET /compute/v2.1/servers/82d8df23-6130-4257-9f71-545775fd73e8" status: 200 len: 1281 microversion: 2.1 time: 0.094013 Sep 10 12:39:34.263968 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3383/6773] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:39:34 2022] GET /compute/v2.1/servers/82d8df23-6130-4257-9f71-545775fd73e8 => generated 1281 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:39:35.291651 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9a6d6d8f-b655-4b6c-afcb-6e34d8962bec tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:39:35.292899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9a6d6d8f-b655-4b6c-afcb-6e34d8962bec tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] [instance: 82d8df23-6130-4257-9f71-545775fd73e8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:39:35.300792 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a6d6d8f-b655-4b6c-afcb-6e34d8962bec tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:35.301617 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a6d6d8f-b655-4b6c-afcb-6e34d8962bec tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:35.302278 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a6d6d8f-b655-4b6c-afcb-6e34d8962bec tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:35.303202 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a6d6d8f-b655-4b6c-afcb-6e34d8962bec tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:35.303824 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a6d6d8f-b655-4b6c-afcb-6e34d8962bec tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:35.304453 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9a6d6d8f-b655-4b6c-afcb-6e34d8962bec tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:35.454548 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9a6d6d8f-b655-4b6c-afcb-6e34d8962bec tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951f548e4804bc8a912bf36786d6a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041038bd112a43f2b36b48ca7bef4739', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:39:35.463087 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9a6d6d8f-b655-4b6c-afcb-6e34d8962bec tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] 10.222.0.23 "GET /compute/v2.1/servers/82d8df23-6130-4257-9f71-545775fd73e8" status: 200 len: 1321 microversion: 2.1 time: 0.178028 Sep 10 12:39:35.463790 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3391/6774] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:39:35 2022] GET /compute/v2.1/servers/82d8df23-6130-4257-9f71-545775fd73e8 => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:39:35.991469 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-b5904daa-b1ce-4b8e-95b3-272d2db35c97 req-1f9b261b-4251-482c-9e29-4eacf5a170fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82d8df23-6130-4257-9f71-545775fd73e8", "tag": "dda7386e-fb31-477b-bb97-38d021b1baae"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:39:36.003202 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-b5904daa-b1ce-4b8e-95b3-272d2db35c97 req-1f9b261b-4251-482c-9e29-4eacf5a170fe service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:36.003685 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-b5904daa-b1ce-4b8e-95b3-272d2db35c97 req-1f9b261b-4251-482c-9e29-4eacf5a170fe service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:36.005098 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-b5904daa-b1ce-4b8e-95b3-272d2db35c97 req-1f9b261b-4251-482c-9e29-4eacf5a170fe service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:36.016689 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-b5904daa-b1ce-4b8e-95b3-272d2db35c97 req-1f9b261b-4251-482c-9e29-4eacf5a170fe service nova] Creating event network-changed:dda7386e-fb31-477b-bb97-38d021b1baae for instance 82d8df23-6130-4257-9f71-545775fd73e8 on n-h1-856895-1 Sep 10 12:39:36.021798 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-b5904daa-b1ce-4b8e-95b3-272d2db35c97 req-1f9b261b-4251-482c-9e29-4eacf5a170fe service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035569 Sep 10 12:39:36.023407 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3384/6775] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:39:36.486425 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9d48880d-95a3-4516-a0ef-fe3e93bd9a04 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:39:36.487095 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9d48880d-95a3-4516-a0ef-fe3e93bd9a04 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] [instance: 82d8df23-6130-4257-9f71-545775fd73e8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:39:36.496904 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d48880d-95a3-4516-a0ef-fe3e93bd9a04 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:36.497408 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d48880d-95a3-4516-a0ef-fe3e93bd9a04 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:36.497874 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d48880d-95a3-4516-a0ef-fe3e93bd9a04 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:36.498578 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d48880d-95a3-4516-a0ef-fe3e93bd9a04 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:36.499052 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d48880d-95a3-4516-a0ef-fe3e93bd9a04 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:36.499530 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d48880d-95a3-4516-a0ef-fe3e93bd9a04 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:36.628758 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9d48880d-95a3-4516-a0ef-fe3e93bd9a04 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951f548e4804bc8a912bf36786d6a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041038bd112a43f2b36b48ca7bef4739', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:39:36.636968 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9d48880d-95a3-4516-a0ef-fe3e93bd9a04 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] 10.222.0.23 "GET /compute/v2.1/servers/82d8df23-6130-4257-9f71-545775fd73e8" status: 200 len: 1321 microversion: 2.1 time: 0.154476 Sep 10 12:39:36.637537 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3392/6776] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:39:36 2022] GET /compute/v2.1/servers/82d8df23-6130-4257-9f71-545775fd73e8 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:39:37.661398 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-94dfc32d-c822-45a8-9535-9dc3914b9a16 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:39:37.662099 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-94dfc32d-c822-45a8-9535-9dc3914b9a16 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] [instance: 82d8df23-6130-4257-9f71-545775fd73e8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:39:37.670029 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94dfc32d-c822-45a8-9535-9dc3914b9a16 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:37.670510 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94dfc32d-c822-45a8-9535-9dc3914b9a16 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:37.670945 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94dfc32d-c822-45a8-9535-9dc3914b9a16 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:37.671659 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94dfc32d-c822-45a8-9535-9dc3914b9a16 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:37.672109 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94dfc32d-c822-45a8-9535-9dc3914b9a16 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:37.672534 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-94dfc32d-c822-45a8-9535-9dc3914b9a16 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:37.803945 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-94dfc32d-c822-45a8-9535-9dc3914b9a16 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951f548e4804bc8a912bf36786d6a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041038bd112a43f2b36b48ca7bef4739', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:39:37.811633 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-94dfc32d-c822-45a8-9535-9dc3914b9a16 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] 10.222.0.23 "GET /compute/v2.1/servers/82d8df23-6130-4257-9f71-545775fd73e8" status: 200 len: 1321 microversion: 2.1 time: 0.154824 Sep 10 12:39:37.812223 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3385/6777] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:39:37 2022] GET /compute/v2.1/servers/82d8df23-6130-4257-9f71-545775fd73e8 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:39:38.834273 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-84714bd4-13ce-4f0d-94fc-73735a70c2a6 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:39:38.834917 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-84714bd4-13ce-4f0d-94fc-73735a70c2a6 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] [instance: 82d8df23-6130-4257-9f71-545775fd73e8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:39:38.842104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-84714bd4-13ce-4f0d-94fc-73735a70c2a6 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:38.842646 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-84714bd4-13ce-4f0d-94fc-73735a70c2a6 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:38.843107 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-84714bd4-13ce-4f0d-94fc-73735a70c2a6 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:38.843863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-84714bd4-13ce-4f0d-94fc-73735a70c2a6 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:38.844342 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-84714bd4-13ce-4f0d-94fc-73735a70c2a6 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:38.844788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-84714bd4-13ce-4f0d-94fc-73735a70c2a6 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:38.984755 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-84714bd4-13ce-4f0d-94fc-73735a70c2a6 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951f548e4804bc8a912bf36786d6a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041038bd112a43f2b36b48ca7bef4739', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:39:38.992975 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-84714bd4-13ce-4f0d-94fc-73735a70c2a6 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] 10.222.0.23 "GET /compute/v2.1/servers/82d8df23-6130-4257-9f71-545775fd73e8" status: 200 len: 1321 microversion: 2.1 time: 0.162677 Sep 10 12:39:38.994991 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3393/6778] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:39:38 2022] GET /compute/v2.1/servers/82d8df23-6130-4257-9f71-545775fd73e8 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:39:40.017432 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-eef535db-7391-413d-ae64-e87fb061dc98 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:39:40.018043 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-eef535db-7391-413d-ae64-e87fb061dc98 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] [instance: 82d8df23-6130-4257-9f71-545775fd73e8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:39:40.025988 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eef535db-7391-413d-ae64-e87fb061dc98 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:40.026621 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eef535db-7391-413d-ae64-e87fb061dc98 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:40.027028 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eef535db-7391-413d-ae64-e87fb061dc98 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:40.027855 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eef535db-7391-413d-ae64-e87fb061dc98 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:40.028353 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eef535db-7391-413d-ae64-e87fb061dc98 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:40.028951 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eef535db-7391-413d-ae64-e87fb061dc98 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:40.173451 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-eef535db-7391-413d-ae64-e87fb061dc98 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951f548e4804bc8a912bf36786d6a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041038bd112a43f2b36b48ca7bef4739', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:39:40.182078 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-eef535db-7391-413d-ae64-e87fb061dc98 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] 10.222.0.23 "GET /compute/v2.1/servers/82d8df23-6130-4257-9f71-545775fd73e8" status: 200 len: 1321 microversion: 2.1 time: 0.168487 Sep 10 12:39:40.182637 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3386/6779] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:39:40 2022] GET /compute/v2.1/servers/82d8df23-6130-4257-9f71-545775fd73e8 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:39:41.206293 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b12ccb09-ee1a-4866-9291-d4d0483fda9d tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:39:41.206937 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b12ccb09-ee1a-4866-9291-d4d0483fda9d tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] [instance: 82d8df23-6130-4257-9f71-545775fd73e8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:39:41.213874 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b12ccb09-ee1a-4866-9291-d4d0483fda9d tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:41.214374 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b12ccb09-ee1a-4866-9291-d4d0483fda9d tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:41.214835 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b12ccb09-ee1a-4866-9291-d4d0483fda9d tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:41.215578 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b12ccb09-ee1a-4866-9291-d4d0483fda9d tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:41.216056 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b12ccb09-ee1a-4866-9291-d4d0483fda9d tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:41.216732 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b12ccb09-ee1a-4866-9291-d4d0483fda9d tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:41.677399 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b12ccb09-ee1a-4866-9291-d4d0483fda9d tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951f548e4804bc8a912bf36786d6a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041038bd112a43f2b36b48ca7bef4739', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:39:41.685200 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b12ccb09-ee1a-4866-9291-d4d0483fda9d tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] 10.222.0.23 "GET /compute/v2.1/servers/82d8df23-6130-4257-9f71-545775fd73e8" status: 200 len: 1321 microversion: 2.1 time: 0.482820 Sep 10 12:39:41.685780 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3394/6780] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:39:41 2022] GET /compute/v2.1/servers/82d8df23-6130-4257-9f71-545775fd73e8 => generated 1321 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:39:42.185083 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-d4e4017e-094f-469d-a667-c0c36c9d6a62 req-bb1d6d5f-117e-4efc-b9c2-b14369ad9822 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82d8df23-6130-4257-9f71-545775fd73e8", "name": "network-vif-plugged", "status": "completed", "tag": "dda7386e-fb31-477b-bb97-38d021b1baae"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:39:42.195756 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d4e4017e-094f-469d-a667-c0c36c9d6a62 req-bb1d6d5f-117e-4efc-b9c2-b14369ad9822 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:42.196240 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d4e4017e-094f-469d-a667-c0c36c9d6a62 req-bb1d6d5f-117e-4efc-b9c2-b14369ad9822 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:42.197531 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d4e4017e-094f-469d-a667-c0c36c9d6a62 req-bb1d6d5f-117e-4efc-b9c2-b14369ad9822 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:42.208696 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-d4e4017e-094f-469d-a667-c0c36c9d6a62 req-bb1d6d5f-117e-4efc-b9c2-b14369ad9822 service nova] Creating event network-vif-plugged:dda7386e-fb31-477b-bb97-38d021b1baae for instance 82d8df23-6130-4257-9f71-545775fd73e8 on n-h1-856895-1 Sep 10 12:39:42.214858 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-d4e4017e-094f-469d-a667-c0c36c9d6a62 req-bb1d6d5f-117e-4efc-b9c2-b14369ad9822 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034194 Sep 10 12:39:42.215507 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3387/6781] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:39:42.708406 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-224cb31f-6e35-4f7d-8644-20efcfdc4ed6 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:39:42.709050 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-224cb31f-6e35-4f7d-8644-20efcfdc4ed6 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] [instance: 82d8df23-6130-4257-9f71-545775fd73e8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:39:42.716628 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-224cb31f-6e35-4f7d-8644-20efcfdc4ed6 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:42.717129 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-224cb31f-6e35-4f7d-8644-20efcfdc4ed6 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:42.717587 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-224cb31f-6e35-4f7d-8644-20efcfdc4ed6 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:42.718294 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-224cb31f-6e35-4f7d-8644-20efcfdc4ed6 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:42.718770 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-224cb31f-6e35-4f7d-8644-20efcfdc4ed6 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:42.719246 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-224cb31f-6e35-4f7d-8644-20efcfdc4ed6 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:42.851237 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-224cb31f-6e35-4f7d-8644-20efcfdc4ed6 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951f548e4804bc8a912bf36786d6a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041038bd112a43f2b36b48ca7bef4739', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:39:42.859265 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-224cb31f-6e35-4f7d-8644-20efcfdc4ed6 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] 10.222.0.23 "GET /compute/v2.1/servers/82d8df23-6130-4257-9f71-545775fd73e8" status: 200 len: 1321 microversion: 2.1 time: 0.154735 Sep 10 12:39:42.859843 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3395/6782] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:39:42 2022] GET /compute/v2.1/servers/82d8df23-6130-4257-9f71-545775fd73e8 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:39:43.880425 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:39:43.881217 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:39:43.887045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-17129359-b3ba-4375-90f7-5ae65a7225a7 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:39:43.887809 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-17129359-b3ba-4375-90f7-5ae65a7225a7 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] [instance: 82d8df23-6130-4257-9f71-545775fd73e8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:39:43.894538 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17129359-b3ba-4375-90f7-5ae65a7225a7 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:43.895020 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17129359-b3ba-4375-90f7-5ae65a7225a7 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:43.895492 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17129359-b3ba-4375-90f7-5ae65a7225a7 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:43.896185 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17129359-b3ba-4375-90f7-5ae65a7225a7 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:43.896648 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17129359-b3ba-4375-90f7-5ae65a7225a7 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:43.897079 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17129359-b3ba-4375-90f7-5ae65a7225a7 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:44.034957 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-17129359-b3ba-4375-90f7-5ae65a7225a7 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951f548e4804bc8a912bf36786d6a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041038bd112a43f2b36b48ca7bef4739', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:39:44.042677 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-17129359-b3ba-4375-90f7-5ae65a7225a7 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] 10.222.0.23 "GET /compute/v2.1/servers/82d8df23-6130-4257-9f71-545775fd73e8" status: 200 len: 1470 microversion: 2.1 time: 0.163267 Sep 10 12:39:44.043291 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3388/6783] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:39:43 2022] GET /compute/v2.1/servers/82d8df23-6130-4257-9f71-545775fd73e8 => generated 1470 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:39:44.068307 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:39:44.123368 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-74db5df0-9bd7-4a5d-8274-18bedb2b3f90 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Calling method '.version_select at 0x7f40729e7700>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:39:44.190041 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-74db5df0-9bd7-4a5d-8274-18bedb2b3f90 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/3ba0f6189af84fcfb3992410ac6d780f" status: 200 len: 371 microversion: 2.1 time: 0.126331 Sep 10 12:39:44.190629 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3396/6784] 10.222.0.23 () {58 vars in 1242 bytes} [Sat Sep 10 12:39:44 2022] GET /compute/v2.1/os-quota-sets/3ba0f6189af84fcfb3992410ac6d780f => generated 371 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:39:44.202956 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1d0c47fd-238b-41e4-90eb-493f911e9e33 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-231152624", "id": 835060901, "os-flavor-access:is_public": "True"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:39:44.221702 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1d0c47fd-238b-41e4-90eb-493f911e9e33 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.022466 Sep 10 12:39:44.222290 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3389/6785] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:39:44 2022] POST /compute/v2.1/flavors => generated 434 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:39:44.234729 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-83568ec3-335f-4441-877d-3fd7f6c8e650 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "835060901"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:39:44.237138 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-83568ec3-335f-4441-877d-3fd7f6c8e650 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] [instance: 82d8df23-6130-4257-9f71-545775fd73e8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:39:44.243192 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-83568ec3-335f-4441-877d-3fd7f6c8e650 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:44.243708 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-83568ec3-335f-4441-877d-3fd7f6c8e650 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:44.244493 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-83568ec3-335f-4441-877d-3fd7f6c8e650 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:44.245281 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-83568ec3-335f-4441-877d-3fd7f6c8e650 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:44.245762 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-83568ec3-335f-4441-877d-3fd7f6c8e650 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:44.246213 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-83568ec3-335f-4441-877d-3fd7f6c8e650 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:44.471555 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-83568ec3-335f-4441-877d-3fd7f6c8e650 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4d393e4884c84e06a91e32dd4579a635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ba0f6189af84fcfb3992410ac6d780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:39:44.478115 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-83568ec3-335f-4441-877d-3fd7f6c8e650 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] [instance: 82d8df23-6130-4257-9f71-545775fd73e8] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-231152624 {{(pid=128776) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 12:39:44.486554 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-83568ec3-335f-4441-877d-3fd7f6c8e650 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:44.487050 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-83568ec3-335f-4441-877d-3fd7f6c8e650 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:44.487526 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-83568ec3-335f-4441-877d-3fd7f6c8e650 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:44.488263 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-83568ec3-335f-4441-877d-3fd7f6c8e650 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:44.488728 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-83568ec3-335f-4441-877d-3fd7f6c8e650 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:44.489205 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-83568ec3-335f-4441-877d-3fd7f6c8e650 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:44.521005 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-83568ec3-335f-4441-877d-3fd7f6c8e650 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Getting quotas for project 041038bd112a43f2b36b48ca7bef4739. Resources: {'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:39:44.527879 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-83568ec3-335f-4441-877d-3fd7f6c8e650 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Getting quotas for user 5951f548e4804bc8a912bf36786d6a39 and project 041038bd112a43f2b36b48ca7bef4739. Resources: {'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:39:44.542185 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.compute.api [None req-83568ec3-335f-4441-877d-3fd7f6c8e650 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] ram quota exceeded for 3ba0f6189af84fcfb3992410ac6d780f, tried to resize instance. Sep 10 12:39:44.542737 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-83568ec3-335f-4441-877d-3fd7f6c8e650 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-83568ec3-335f-4441-877d-3fd7f6c8e650 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Request method failure captured: Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/servers/82d8df23-6130-4257-9f71-545775fd73e8/action HTTP/1.1 Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 38 Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHIWEC33GuU8Jcer9clV7hpJRtYeSLRwcmPhMRqWfvCPJPT6s2C4Pvy4vveEzzWpP4l8T00teBU9SqQTNbhKh3_-P1J3KunHIeDnTkqEwV4VUvIDUe68xfYnr_bJvnq1v1EQq_ZUUUyu1R8NvL3-5nN_9dEXb7saee14BGDqk5Zy-CvE Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 3ba0f6189af84fcfb3992410ac6d780f Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1813661156 Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,admin,member Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,admin,member Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ba0f6189af84fcfb3992410ac6d780f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ba0f6189af84fcfb3992410ac6d780f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3ba0f6189af84fcfb3992410ac6d780f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3ba0f6189af84fcfb3992410ac6d780f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1813661156 Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 3ba0f6189af84fcfb3992410ac6d780f Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1813661156 Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersAdminNegativeTestJSON-1813661156-project-admin Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 4d393e4884c84e06a91e32dd4579a635 Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1813661156-project-admin Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: {"resize": {"flavorRef": "835060901"}} Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '82d8df23-6130-4257-9f71-545775fd73e8', 'body': {'resize': {'flavorRef': '835060901'}}} Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 12:39:44.545073 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-83568ec3-335f-4441-877d-3fd7f6c8e650 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-83568ec3-335f-4441-877d-3fd7f6c8e650 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/82d8df23-6130-4257-9f71-545775fd73e8/action" status: 403 len: 118 microversion: 2.1 time: 0.315663 Sep 10 12:39:44.553314 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3397/6786] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:39:44 2022] POST /compute/v2.1/servers/82d8df23-6130-4257-9f71-545775fd73e8/action => generated 118 bytes in 317 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:39:44.556507 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-136b4647-1e71-4090-9832-b1164403d9f8 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:39:44.572776 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-136b4647-1e71-4090-9832-b1164403d9f8 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/835060901" status: 202 len: 0 microversion: 2.1 time: 0.020668 Sep 10 12:39:44.573334 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3390/6787] 10.222.0.23 () {58 vars in 1158 bytes} [Sat Sep 10 12:39:44 2022] DELETE /compute/v2.1/flavors/835060901 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:39:44.581562 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f1d61dde-76e5-49ce-ae9b-704ae69d4b0c tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:39:44.602297 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f1d61dde-76e5-49ce-ae9b-704ae69d4b0c tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024452 Sep 10 12:39:44.602854 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3398/6788] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 12:39:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:39:44.624402 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-006ddc4f-2c74-4d4e-9d0b-d5e0afda0511 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Calling method '.version_select at 0x7f4071b2f550>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:39:44.690759 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-006ddc4f-2c74-4d4e-9d0b-d5e0afda0511 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] 10.222.0.23 "GET /compute/v2.1/os-quota-sets/3ba0f6189af84fcfb3992410ac6d780f" status: 200 len: 371 microversion: 2.1 time: 0.069895 Sep 10 12:39:44.691380 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3391/6789] 10.222.0.23 () {58 vars in 1242 bytes} [Sat Sep 10 12:39:44 2022] GET /compute/v2.1/os-quota-sets/3ba0f6189af84fcfb3992410ac6d780f => generated 371 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:39:44.703743 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9b1c2e24-7357-402b-8c4a-56fd65a54a04 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1987946374", "id": 2098710594, "os-flavor-access:is_public": "True"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:39:44.721611 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9b1c2e24-7357-402b-8c4a-56fd65a54a04 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.021588 Sep 10 12:39:44.722184 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3399/6790] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:39:44 2022] POST /compute/v2.1/flavors => generated 437 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:39:44.734382 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0d28d2e5-66f4-4537-8f73-75797480b466 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2098710594"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:39:44.736769 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0d28d2e5-66f4-4537-8f73-75797480b466 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] [instance: 82d8df23-6130-4257-9f71-545775fd73e8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:39:44.742919 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d28d2e5-66f4-4537-8f73-75797480b466 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:44.743443 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d28d2e5-66f4-4537-8f73-75797480b466 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:44.744224 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d28d2e5-66f4-4537-8f73-75797480b466 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:44.745112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d28d2e5-66f4-4537-8f73-75797480b466 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:44.745648 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d28d2e5-66f4-4537-8f73-75797480b466 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:44.746081 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d28d2e5-66f4-4537-8f73-75797480b466 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:44.830783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0d28d2e5-66f4-4537-8f73-75797480b466 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4d393e4884c84e06a91e32dd4579a635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ba0f6189af84fcfb3992410ac6d780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:39:44.836687 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0d28d2e5-66f4-4537-8f73-75797480b466 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] [instance: 82d8df23-6130-4257-9f71-545775fd73e8] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1987946374 {{(pid=128777) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 12:39:44.843896 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d28d2e5-66f4-4537-8f73-75797480b466 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:44.844374 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d28d2e5-66f4-4537-8f73-75797480b466 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:44.844809 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d28d2e5-66f4-4537-8f73-75797480b466 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:44.845527 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d28d2e5-66f4-4537-8f73-75797480b466 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:44.845980 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d28d2e5-66f4-4537-8f73-75797480b466 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:44.846404 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0d28d2e5-66f4-4537-8f73-75797480b466 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:44.866331 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-0d28d2e5-66f4-4537-8f73-75797480b466 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Getting quotas for project 041038bd112a43f2b36b48ca7bef4739. Resources: {'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:39:44.871737 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-0d28d2e5-66f4-4537-8f73-75797480b466 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Getting quotas for user 5951f548e4804bc8a912bf36786d6a39 and project 041038bd112a43f2b36b48ca7bef4739. Resources: {'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:39:44.884565 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.compute.api [None req-0d28d2e5-66f4-4537-8f73-75797480b466 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] cores quota exceeded for 3ba0f6189af84fcfb3992410ac6d780f, tried to resize instance. Sep 10 12:39:44.885714 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-0d28d2e5-66f4-4537-8f73-75797480b466 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0d28d2e5-66f4-4537-8f73-75797480b466 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Request method failure captured: Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers/82d8df23-6130-4257-9f71-545775fd73e8/action HTTP/1.1 Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 39 Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHIWEC33GuU8Jcer9clV7hpJRtYeSLRwcmPhMRqWfvCPJPT6s2C4Pvy4vveEzzWpP4l8T00teBU9SqQTNbhKh3_-P1J3KunHIeDnTkqEwV4VUvIDUe68xfYnr_bJvnq1v1EQq_ZUUUyu1R8NvL3-5nN_9dEXb7saee14BGDqk5Zy-CvE Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 3ba0f6189af84fcfb3992410ac6d780f Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1813661156 Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,admin,member Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,admin,member Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ba0f6189af84fcfb3992410ac6d780f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3ba0f6189af84fcfb3992410ac6d780f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3ba0f6189af84fcfb3992410ac6d780f", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3ba0f6189af84fcfb3992410ac6d780f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1813661156 Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 3ba0f6189af84fcfb3992410ac6d780f Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1813661156 Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersAdminNegativeTestJSON-1813661156-project-admin Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 4d393e4884c84e06a91e32dd4579a635 Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1813661156-project-admin Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: {"resize": {"flavorRef": "2098710594"}} Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '82d8df23-6130-4257-9f71-545775fd73e8', 'body': {'resize': {'flavorRef': '2098710594'}}} Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 12:39:44.887785 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0d28d2e5-66f4-4537-8f73-75797480b466 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0d28d2e5-66f4-4537-8f73-75797480b466 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] 10.222.0.23 "POST /compute/v2.1/servers/82d8df23-6130-4257-9f71-545775fd73e8/action" status: 403 len: 113 microversion: 2.1 time: 0.158662 Sep 10 12:39:44.891998 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3392/6791] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:39:44 2022] POST /compute/v2.1/servers/82d8df23-6130-4257-9f71-545775fd73e8/action => generated 113 bytes in 160 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:39:44.897910 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bb9adbaf-4c25-40d2-968d-beca0ae26ce0 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:39:44.915364 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bb9adbaf-4c25-40d2-968d-beca0ae26ce0 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] 10.222.0.23 "DELETE /compute/v2.1/flavors/2098710594" status: 202 len: 0 microversion: 2.1 time: 0.021053 Sep 10 12:39:44.916007 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3400/6792] 10.222.0.23 () {58 vars in 1161 bytes} [Sat Sep 10 12:39:44 2022] DELETE /compute/v2.1/flavors/2098710594 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:39:44.924264 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3cd0c171-917e-4b9b-84d9-5b0f0f9e8889 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:39:44.944874 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3cd0c171-917e-4b9b-84d9-5b0f0f9e8889 tempest-ServersAdminNegativeTestJSON-1813661156 tempest-ServersAdminNegativeTestJSON-1813661156-project-admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024178 Sep 10 12:39:44.945426 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3393/6793] 10.222.0.23 () {58 vars in 1146 bytes} [Sat Sep 10 12:39:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:39:44.966941 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-35512c26-5440-4f30-9b37-73772207de2e tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:39:44.967485 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-35512c26-5440-4f30-9b37-73772207de2e tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] [instance: 82d8df23-6130-4257-9f71-545775fd73e8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:39:44.973445 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-35512c26-5440-4f30-9b37-73772207de2e tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:44.973947 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-35512c26-5440-4f30-9b37-73772207de2e tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:44.974400 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-35512c26-5440-4f30-9b37-73772207de2e tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:44.975126 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-35512c26-5440-4f30-9b37-73772207de2e tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:44.975607 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-35512c26-5440-4f30-9b37-73772207de2e tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:44.976053 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-35512c26-5440-4f30-9b37-73772207de2e tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:45.001053 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-35512c26-5440-4f30-9b37-73772207de2e tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] [instance: 82d8df23-6130-4257-9f71-545775fd73e8] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:39:45.077910 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-35512c26-5440-4f30-9b37-73772207de2e tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] 10.222.0.23 "DELETE /compute/v2.1/servers/82d8df23-6130-4257-9f71-545775fd73e8" status: 204 len: 0 microversion: 2.1 time: 0.115221 Sep 10 12:39:45.078810 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3401/6794] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:39:44 2022] DELETE /compute/v2.1/servers/82d8df23-6130-4257-9f71-545775fd73e8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:39:45.087296 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a8a57c0a-517b-4754-8d94-9b2490eab67d tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:39:45.088154 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a8a57c0a-517b-4754-8d94-9b2490eab67d tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] [instance: 82d8df23-6130-4257-9f71-545775fd73e8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:39:45.094290 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a8a57c0a-517b-4754-8d94-9b2490eab67d tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:45.094832 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a8a57c0a-517b-4754-8d94-9b2490eab67d tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:45.095316 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a8a57c0a-517b-4754-8d94-9b2490eab67d tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:45.096001 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a8a57c0a-517b-4754-8d94-9b2490eab67d tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:45.096458 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a8a57c0a-517b-4754-8d94-9b2490eab67d tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:45.096885 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a8a57c0a-517b-4754-8d94-9b2490eab67d tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:45.231028 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a8a57c0a-517b-4754-8d94-9b2490eab67d tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951f548e4804bc8a912bf36786d6a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041038bd112a43f2b36b48ca7bef4739', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:39:45.238791 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a8a57c0a-517b-4754-8d94-9b2490eab67d tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] 10.222.0.23 "GET /compute/v2.1/servers/82d8df23-6130-4257-9f71-545775fd73e8" status: 200 len: 1476 microversion: 2.1 time: 0.155808 Sep 10 12:39:45.239396 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3394/6795] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:39:45 2022] GET /compute/v2.1/servers/82d8df23-6130-4257-9f71-545775fd73e8 => generated 1476 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:39:46.263894 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-50f8e280-1a72-435e-9d12-a5b9360047aa tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:39:46.264623 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-50f8e280-1a72-435e-9d12-a5b9360047aa tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] [instance: 82d8df23-6130-4257-9f71-545775fd73e8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:39:46.272328 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50f8e280-1a72-435e-9d12-a5b9360047aa tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:46.272818 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50f8e280-1a72-435e-9d12-a5b9360047aa tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:46.273268 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50f8e280-1a72-435e-9d12-a5b9360047aa tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:46.273962 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50f8e280-1a72-435e-9d12-a5b9360047aa tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:46.274426 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50f8e280-1a72-435e-9d12-a5b9360047aa tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:46.274896 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50f8e280-1a72-435e-9d12-a5b9360047aa tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:46.409854 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-50f8e280-1a72-435e-9d12-a5b9360047aa tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951f548e4804bc8a912bf36786d6a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041038bd112a43f2b36b48ca7bef4739', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:39:46.417616 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-50f8e280-1a72-435e-9d12-a5b9360047aa tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] 10.222.0.23 "GET /compute/v2.1/servers/82d8df23-6130-4257-9f71-545775fd73e8" status: 200 len: 1476 microversion: 2.1 time: 0.158775 Sep 10 12:39:46.418227 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3402/6796] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:39:46 2022] GET /compute/v2.1/servers/82d8df23-6130-4257-9f71-545775fd73e8 => generated 1476 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:39:47.127032 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-047cab22-73b5-47df-b901-3b3d0fce947f req-f56cc3f1-38e9-417b-bffe-03b51da181c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82d8df23-6130-4257-9f71-545775fd73e8", "name": "network-vif-deleted", "tag": "dda7386e-fb31-477b-bb97-38d021b1baae"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:39:47.140844 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-047cab22-73b5-47df-b901-3b3d0fce947f req-f56cc3f1-38e9-417b-bffe-03b51da181c3 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:47.141749 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-047cab22-73b5-47df-b901-3b3d0fce947f req-f56cc3f1-38e9-417b-bffe-03b51da181c3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:47.141749 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-047cab22-73b5-47df-b901-3b3d0fce947f req-f56cc3f1-38e9-417b-bffe-03b51da181c3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:47.155914 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-047cab22-73b5-47df-b901-3b3d0fce947f req-f56cc3f1-38e9-417b-bffe-03b51da181c3 service nova] Creating event network-vif-deleted:dda7386e-fb31-477b-bb97-38d021b1baae for instance 82d8df23-6130-4257-9f71-545775fd73e8 on n-h1-856895-1 Sep 10 12:39:47.161437 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-047cab22-73b5-47df-b901-3b3d0fce947f req-f56cc3f1-38e9-417b-bffe-03b51da181c3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039301 Sep 10 12:39:47.162064 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3395/6797] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:39:47.440129 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f17698c8-0e1e-4f7a-a9d0-4afdc2c824b5 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:39:47.440755 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f17698c8-0e1e-4f7a-a9d0-4afdc2c824b5 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] [instance: 82d8df23-6130-4257-9f71-545775fd73e8] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:39:47.448209 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f17698c8-0e1e-4f7a-a9d0-4afdc2c824b5 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:47.448705 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f17698c8-0e1e-4f7a-a9d0-4afdc2c824b5 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:47.449153 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f17698c8-0e1e-4f7a-a9d0-4afdc2c824b5 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:47.449843 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f17698c8-0e1e-4f7a-a9d0-4afdc2c824b5 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:47.450304 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f17698c8-0e1e-4f7a-a9d0-4afdc2c824b5 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:47.450738 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f17698c8-0e1e-4f7a-a9d0-4afdc2c824b5 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:47.480798 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f17698c8-0e1e-4f7a-a9d0-4afdc2c824b5 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:47.481285 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f17698c8-0e1e-4f7a-a9d0-4afdc2c824b5 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:47.481742 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f17698c8-0e1e-4f7a-a9d0-4afdc2c824b5 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:47.482187 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-f17698c8-0e1e-4f7a-a9d0-4afdc2c824b5 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lazy-loading 'fault' on Instance uuid 82d8df23-6130-4257-9f71-545775fd73e8 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:39:47.526693 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f17698c8-0e1e-4f7a-a9d0-4afdc2c824b5 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5951f548e4804bc8a912bf36786d6a39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041038bd112a43f2b36b48ca7bef4739', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:39:47.534371 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f17698c8-0e1e-4f7a-a9d0-4afdc2c824b5 tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] 10.222.0.23 "GET /compute/v2.1/servers/82d8df23-6130-4257-9f71-545775fd73e8" status: 200 len: 1311 microversion: 2.1 time: 0.098197 Sep 10 12:39:47.535096 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3403/6798] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:39:47 2022] GET /compute/v2.1/servers/82d8df23-6130-4257-9f71-545775fd73e8 => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:39:48.559832 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-710ed70d-7f13-4641-aa5d-3fbf8f4cf10b tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:39:48.560463 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-710ed70d-7f13-4641-aa5d-3fbf8f4cf10b tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] [instance: 82d8df23-6130-4257-9f71-545775fd73e8] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:39:48.566601 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-710ed70d-7f13-4641-aa5d-3fbf8f4cf10b tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:48.567087 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-710ed70d-7f13-4641-aa5d-3fbf8f4cf10b tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:48.567551 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-710ed70d-7f13-4641-aa5d-3fbf8f4cf10b tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:48.568245 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-710ed70d-7f13-4641-aa5d-3fbf8f4cf10b tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:48.568702 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-710ed70d-7f13-4641-aa5d-3fbf8f4cf10b tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:48.569135 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-710ed70d-7f13-4641-aa5d-3fbf8f4cf10b tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:48.582904 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-710ed70d-7f13-4641-aa5d-3fbf8f4cf10b tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] HTTP exception thrown: Instance 82d8df23-6130-4257-9f71-545775fd73e8 could not be found. Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-710ed70d-7f13-4641-aa5d-3fbf8f4cf10b tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Request method failure captured: Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/82d8df23-6130-4257-9f71-545775fd73e8 HTTP/1.1 Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHIWDGjxoATe99NRDO99ILp5nDtzbcJp5YfjzkvzVLJrIZ-mZlwarXrLjaORhZ9CaQq35TRp7VpQNDlPYOX_Duk3SNZEJdKuGgoYGH9Uhy4AFTd9NV1pPiz81YHkzevXVyg6l35m3vPGVZVaMnByVwZFWed-qQoXl0NQhoy8AUEnEHss Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 041038bd112a43f2b36b48ca7bef4739 Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-528320052 Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/041038bd112a43f2b36b48ca7bef4739"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/041038bd112a43f2b36b48ca7bef4739"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_041038bd112a43f2b36b48ca7bef4739", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/041038bd112a43f2b36b48ca7bef4739"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersAdminNegativeTestJSON-528320052 Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 041038bd112a43f2b36b48ca7bef4739 Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-528320052 Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersAdminNegativeTestJSON-528320052-project Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 5951f548e4804bc8a912bf36786d6a39 Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersAdminNegativeTestJSON-528320052-project Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 82d8df23-6130-4257-9f71-545775fd73e8 could not be found. Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '82d8df23-6130-4257-9f71-545775fd73e8'} Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82d8df23-6130-4257-9f71-545775fd73e8 could not be found. Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82d8df23-6130-4257-9f71-545775fd73e8 could not be found. Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:39:48.584567 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:39:48.589754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:39:48.589754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:39:48.589754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:39:48.589754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:39:48.589754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:39:48.589754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:39:48.589754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82d8df23-6130-4257-9f71-545775fd73e8 could not be found. Sep 10 12:39:48.589754 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:39:48.589754 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-710ed70d-7f13-4641-aa5d-3fbf8f4cf10b tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] Returning 404 to user: Instance 82d8df23-6130-4257-9f71-545775fd73e8 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:39:48.589754 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-710ed70d-7f13-4641-aa5d-3fbf8f4cf10b tempest-ServersAdminNegativeTestJSON-528320052 tempest-ServersAdminNegativeTestJSON-528320052-project] 10.222.0.23 "GET /compute/v2.1/servers/82d8df23-6130-4257-9f71-545775fd73e8" status: 404 len: 111 microversion: 2.1 time: 0.031877 Sep 10 12:39:48.589754 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3396/6799] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:39:48 2022] GET /compute/v2.1/servers/82d8df23-6130-4257-9f71-545775fd73e8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:39:54.589708 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:39:54.591196 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:39:54.706564 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ab099934-a2ae-4692-a287-b44432499a1e tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1707733133", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "713cba88-330b-4b61-a3db-18bf27374438"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:39:54.787754 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-ab099934-a2ae-4692-a287-b44432499a1e tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] validate_networks() for [('713cba88-330b-4b61-a3db-18bf27374438', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:39:55.185824 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-ab099934-a2ae-4692-a287-b44432499a1e tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:39:55.186340 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-ab099934-a2ae-4692-a287-b44432499a1e tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:39:55.189596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-ab099934-a2ae-4692-a287-b44432499a1e tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:39:55.190136 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-ab099934-a2ae-4692-a287-b44432499a1e tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:39:55.190687 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-ab099934-a2ae-4692-a287-b44432499a1e tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:39:55.214860 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab099934-a2ae-4692-a287-b44432499a1e tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:55.214860 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab099934-a2ae-4692-a287-b44432499a1e tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:55.214860 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab099934-a2ae-4692-a287-b44432499a1e tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:55.216822 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab099934-a2ae-4692-a287-b44432499a1e tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:55.217507 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab099934-a2ae-4692-a287-b44432499a1e tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:55.217955 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ab099934-a2ae-4692-a287-b44432499a1e tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:55.235567 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-ab099934-a2ae-4692-a287-b44432499a1e tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Getting quotas for project 0c2bbe113f634d599bb84dba54c8b813. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:39:55.243012 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-ab099934-a2ae-4692-a287-b44432499a1e tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Getting quotas for user 94e162d56e4041a1bfce33f69e7c7a15 and project 0c2bbe113f634d599bb84dba54c8b813. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:39:55.256933 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ab099934-a2ae-4692-a287-b44432499a1e tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:39:55.259336 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ab099934-a2ae-4692-a287-b44432499a1e tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:39:55.309069 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ab099934-a2ae-4692-a287-b44432499a1e tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.726433 Sep 10 12:39:55.309741 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3404/6800] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:39:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:39:55.321041 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cecb5e27-ed9d-4940-bd14-64d8c5c4a1e8 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:39:55.322313 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cecb5e27-ed9d-4940-bd14-64d8c5c4a1e8 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:39:55.326108 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:39:55.327336 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:39:55.387064 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cecb5e27-ed9d-4940-bd14-64d8c5c4a1e8 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e162d56e4041a1bfce33f69e7c7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2bbe113f634d599bb84dba54c8b813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:39:55.394644 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cecb5e27-ed9d-4940-bd14-64d8c5c4a1e8 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 200 len: 1215 microversion: 2.1 time: 0.077530 Sep 10 12:39:55.395265 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3397/6801] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:39:55 2022] GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 1215 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:39:56.420121 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-90d4b408-5792-4b0f-b35e-a39bb5f495f8 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:39:56.420950 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-90d4b408-5792-4b0f-b35e-a39bb5f495f8 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:39:56.428517 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90d4b408-5792-4b0f-b35e-a39bb5f495f8 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:56.429106 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90d4b408-5792-4b0f-b35e-a39bb5f495f8 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:56.429629 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90d4b408-5792-4b0f-b35e-a39bb5f495f8 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:56.430334 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90d4b408-5792-4b0f-b35e-a39bb5f495f8 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:56.430843 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90d4b408-5792-4b0f-b35e-a39bb5f495f8 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:56.431821 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90d4b408-5792-4b0f-b35e-a39bb5f495f8 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:56.499608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-90d4b408-5792-4b0f-b35e-a39bb5f495f8 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e162d56e4041a1bfce33f69e7c7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2bbe113f634d599bb84dba54c8b813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:39:56.507443 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-90d4b408-5792-4b0f-b35e-a39bb5f495f8 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 200 len: 1267 microversion: 2.1 time: 0.093549 Sep 10 12:39:56.508012 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3405/6802] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:39:56 2022] GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 1267 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:39:57.531452 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1d442bb2-b76f-48de-801e-bcf3d5330c06 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:39:57.532188 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1d442bb2-b76f-48de-801e-bcf3d5330c06 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:39:57.540271 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d442bb2-b76f-48de-801e-bcf3d5330c06 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:57.541818 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d442bb2-b76f-48de-801e-bcf3d5330c06 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:57.542427 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d442bb2-b76f-48de-801e-bcf3d5330c06 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:57.543393 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d442bb2-b76f-48de-801e-bcf3d5330c06 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:57.544015 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d442bb2-b76f-48de-801e-bcf3d5330c06 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:57.544613 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d442bb2-b76f-48de-801e-bcf3d5330c06 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:57.709255 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1d442bb2-b76f-48de-801e-bcf3d5330c06 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e162d56e4041a1bfce33f69e7c7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2bbe113f634d599bb84dba54c8b813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:39:57.719581 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1d442bb2-b76f-48de-801e-bcf3d5330c06 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 200 len: 1315 microversion: 2.1 time: 0.191158 Sep 10 12:39:57.732481 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3398/6803] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:39:57 2022] GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:39:58.339627 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-d131cd3e-7ebf-40cf-8fc0-bbbd2135b9bc req-e5710bfe-6105-4623-ba99-cb0830ece711 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "827c03b5-4e1d-45de-8c72-9efe6676a22c", "tag": "1206f57c-6898-4248-8fc6-e348ae78b853"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:39:58.353442 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d131cd3e-7ebf-40cf-8fc0-bbbd2135b9bc req-e5710bfe-6105-4623-ba99-cb0830ece711 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:58.354289 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d131cd3e-7ebf-40cf-8fc0-bbbd2135b9bc req-e5710bfe-6105-4623-ba99-cb0830ece711 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:58.354888 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d131cd3e-7ebf-40cf-8fc0-bbbd2135b9bc req-e5710bfe-6105-4623-ba99-cb0830ece711 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:58.369627 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-d131cd3e-7ebf-40cf-8fc0-bbbd2135b9bc req-e5710bfe-6105-4623-ba99-cb0830ece711 service nova] Creating event network-changed:1206f57c-6898-4248-8fc6-e348ae78b853 for instance 827c03b5-4e1d-45de-8c72-9efe6676a22c on n-h1-856895-1 Sep 10 12:39:58.380229 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-d131cd3e-7ebf-40cf-8fc0-bbbd2135b9bc req-e5710bfe-6105-4623-ba99-cb0830ece711 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045776 Sep 10 12:39:58.381120 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3406/6804] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:39:58.743256 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a6adf9e0-3cbc-4d3e-b8ae-38dab44ee262 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:39:58.744896 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a6adf9e0-3cbc-4d3e-b8ae-38dab44ee262 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:39:58.751894 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a6adf9e0-3cbc-4d3e-b8ae-38dab44ee262 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:58.752381 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a6adf9e0-3cbc-4d3e-b8ae-38dab44ee262 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:58.752823 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a6adf9e0-3cbc-4d3e-b8ae-38dab44ee262 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:58.753530 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a6adf9e0-3cbc-4d3e-b8ae-38dab44ee262 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:58.753993 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a6adf9e0-3cbc-4d3e-b8ae-38dab44ee262 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:58.754420 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a6adf9e0-3cbc-4d3e-b8ae-38dab44ee262 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:58.899461 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a6adf9e0-3cbc-4d3e-b8ae-38dab44ee262 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e162d56e4041a1bfce33f69e7c7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2bbe113f634d599bb84dba54c8b813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:39:58.907330 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a6adf9e0-3cbc-4d3e-b8ae-38dab44ee262 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 200 len: 1315 microversion: 2.1 time: 0.168075 Sep 10 12:39:58.907904 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3399/6805] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:39:58 2022] GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:39:59.931409 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1ca732cb-4c85-4149-95f8-42f6b48fb347 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:39:59.932313 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1ca732cb-4c85-4149-95f8-42f6b48fb347 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:39:59.938726 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1ca732cb-4c85-4149-95f8-42f6b48fb347 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:59.939255 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1ca732cb-4c85-4149-95f8-42f6b48fb347 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:59.939704 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1ca732cb-4c85-4149-95f8-42f6b48fb347 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:39:59.940406 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1ca732cb-4c85-4149-95f8-42f6b48fb347 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:39:59.940873 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1ca732cb-4c85-4149-95f8-42f6b48fb347 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:39:59.941306 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1ca732cb-4c85-4149-95f8-42f6b48fb347 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:00.075810 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1ca732cb-4c85-4149-95f8-42f6b48fb347 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e162d56e4041a1bfce33f69e7c7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2bbe113f634d599bb84dba54c8b813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:00.083507 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1ca732cb-4c85-4149-95f8-42f6b48fb347 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 200 len: 1315 microversion: 2.1 time: 0.157190 Sep 10 12:40:00.084085 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3407/6806] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:39:59 2022] GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:40:01.106484 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7ddd56de-9ce4-4384-a701-8c481e9fc384 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:01.107904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7ddd56de-9ce4-4384-a701-8c481e9fc384 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:01.120971 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ddd56de-9ce4-4384-a701-8c481e9fc384 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:01.122052 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ddd56de-9ce4-4384-a701-8c481e9fc384 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:01.122052 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ddd56de-9ce4-4384-a701-8c481e9fc384 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:01.122635 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ddd56de-9ce4-4384-a701-8c481e9fc384 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:01.123103 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ddd56de-9ce4-4384-a701-8c481e9fc384 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:01.123578 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ddd56de-9ce4-4384-a701-8c481e9fc384 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:01.265082 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7ddd56de-9ce4-4384-a701-8c481e9fc384 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e162d56e4041a1bfce33f69e7c7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2bbe113f634d599bb84dba54c8b813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:01.274264 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7ddd56de-9ce4-4384-a701-8c481e9fc384 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 200 len: 1315 microversion: 2.1 time: 0.171957 Sep 10 12:40:01.274853 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3400/6807] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:01 2022] GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:40:02.297923 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-492f07d8-0813-4415-97a3-05e1c0e1602c tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:02.298564 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-492f07d8-0813-4415-97a3-05e1c0e1602c tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:02.305487 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-492f07d8-0813-4415-97a3-05e1c0e1602c tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:02.305992 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-492f07d8-0813-4415-97a3-05e1c0e1602c tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:02.306445 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-492f07d8-0813-4415-97a3-05e1c0e1602c tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:02.307728 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-492f07d8-0813-4415-97a3-05e1c0e1602c tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:02.308201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-492f07d8-0813-4415-97a3-05e1c0e1602c tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:02.308657 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-492f07d8-0813-4415-97a3-05e1c0e1602c tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:02.441503 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-492f07d8-0813-4415-97a3-05e1c0e1602c tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e162d56e4041a1bfce33f69e7c7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2bbe113f634d599bb84dba54c8b813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:02.449954 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-492f07d8-0813-4415-97a3-05e1c0e1602c tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 200 len: 1315 microversion: 2.1 time: 0.156004 Sep 10 12:40:02.450525 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3408/6808] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:02 2022] GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:40:03.472596 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-43abc6e0-3b18-4334-a374-3e3de4d5b92c tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:03.473215 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-43abc6e0-3b18-4334-a374-3e3de4d5b92c tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:03.475904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:40:03.481899 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-43abc6e0-3b18-4334-a374-3e3de4d5b92c tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:03.482428 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-43abc6e0-3b18-4334-a374-3e3de4d5b92c tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:03.482911 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-43abc6e0-3b18-4334-a374-3e3de4d5b92c tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:03.483644 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-43abc6e0-3b18-4334-a374-3e3de4d5b92c tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:03.484107 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-43abc6e0-3b18-4334-a374-3e3de4d5b92c tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:03.484540 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-43abc6e0-3b18-4334-a374-3e3de4d5b92c tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:03.488970 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=72 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:40:03.616291 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-43abc6e0-3b18-4334-a374-3e3de4d5b92c tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e162d56e4041a1bfce33f69e7c7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2bbe113f634d599bb84dba54c8b813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:03.624771 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-43abc6e0-3b18-4334-a374-3e3de4d5b92c tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 200 len: 1315 microversion: 2.1 time: 0.155990 Sep 10 12:40:03.625381 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3401/6809] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:03 2022] GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:40:04.304086 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-9efebcf8-3a0a-473e-99c8-c5093bcd8bfe req-fa65677b-ac38-46e5-b9d6-3f2ecc1fdd7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "827c03b5-4e1d-45de-8c72-9efe6676a22c", "name": "network-vif-plugged", "status": "completed", "tag": "1206f57c-6898-4248-8fc6-e348ae78b853"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:40:04.310871 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:40:04.316731 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-9efebcf8-3a0a-473e-99c8-c5093bcd8bfe req-fa65677b-ac38-46e5-b9d6-3f2ecc1fdd7e service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:04.317225 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-9efebcf8-3a0a-473e-99c8-c5093bcd8bfe req-fa65677b-ac38-46e5-b9d6-3f2ecc1fdd7e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:04.317667 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-9efebcf8-3a0a-473e-99c8-c5093bcd8bfe req-fa65677b-ac38-46e5-b9d6-3f2ecc1fdd7e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:04.321982 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:40:04.330995 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-9efebcf8-3a0a-473e-99c8-c5093bcd8bfe req-fa65677b-ac38-46e5-b9d6-3f2ecc1fdd7e service nova] Creating event network-vif-plugged:1206f57c-6898-4248-8fc6-e348ae78b853 for instance 827c03b5-4e1d-45de-8c72-9efe6676a22c on n-h1-856895-1 Sep 10 12:40:04.336437 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-9efebcf8-3a0a-473e-99c8-c5093bcd8bfe req-fa65677b-ac38-46e5-b9d6-3f2ecc1fdd7e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036095 Sep 10 12:40:04.337189 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3409/6810] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:40:04.647571 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-128b86bd-c45b-41a9-bf57-d0d8aa64c0d1 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:04.648188 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-128b86bd-c45b-41a9-bf57-d0d8aa64c0d1 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:04.655593 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-128b86bd-c45b-41a9-bf57-d0d8aa64c0d1 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:04.656077 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-128b86bd-c45b-41a9-bf57-d0d8aa64c0d1 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:04.656515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-128b86bd-c45b-41a9-bf57-d0d8aa64c0d1 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:04.657214 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-128b86bd-c45b-41a9-bf57-d0d8aa64c0d1 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:04.657670 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-128b86bd-c45b-41a9-bf57-d0d8aa64c0d1 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:04.658102 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-128b86bd-c45b-41a9-bf57-d0d8aa64c0d1 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:04.794613 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-128b86bd-c45b-41a9-bf57-d0d8aa64c0d1 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e162d56e4041a1bfce33f69e7c7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2bbe113f634d599bb84dba54c8b813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:04.802341 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-128b86bd-c45b-41a9-bf57-d0d8aa64c0d1 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 200 len: 1315 microversion: 2.1 time: 0.158749 Sep 10 12:40:04.802929 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3402/6811] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:04 2022] GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:40:05.824502 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:40:05.825181 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:40:05.831088 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c7ceb63f-2b19-4395-9194-6abfade430d2 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:05.831873 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c7ceb63f-2b19-4395-9194-6abfade430d2 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:05.841381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c7ceb63f-2b19-4395-9194-6abfade430d2 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:05.841882 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c7ceb63f-2b19-4395-9194-6abfade430d2 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:05.842343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c7ceb63f-2b19-4395-9194-6abfade430d2 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:05.843059 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c7ceb63f-2b19-4395-9194-6abfade430d2 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:05.843560 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c7ceb63f-2b19-4395-9194-6abfade430d2 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:05.844008 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c7ceb63f-2b19-4395-9194-6abfade430d2 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:05.981616 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c7ceb63f-2b19-4395-9194-6abfade430d2 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e162d56e4041a1bfce33f69e7c7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2bbe113f634d599bb84dba54c8b813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:05.989309 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c7ceb63f-2b19-4395-9194-6abfade430d2 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 200 len: 1315 microversion: 2.1 time: 0.167471 Sep 10 12:40:05.989892 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3410/6812] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:05 2022] GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:40:07.013150 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1c7be088-6dc2-4bfc-842c-058bc2ae6e8b tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:07.013768 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1c7be088-6dc2-4bfc-842c-058bc2ae6e8b tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:07.015722 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:40:07.021880 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c7be088-6dc2-4bfc-842c-058bc2ae6e8b tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:07.022367 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c7be088-6dc2-4bfc-842c-058bc2ae6e8b tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:07.022803 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c7be088-6dc2-4bfc-842c-058bc2ae6e8b tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:07.023526 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c7be088-6dc2-4bfc-842c-058bc2ae6e8b tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:07.023982 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c7be088-6dc2-4bfc-842c-058bc2ae6e8b tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:07.024414 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c7be088-6dc2-4bfc-842c-058bc2ae6e8b tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:07.153253 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1c7be088-6dc2-4bfc-842c-058bc2ae6e8b tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e162d56e4041a1bfce33f69e7c7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2bbe113f634d599bb84dba54c8b813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:07.161236 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1c7be088-6dc2-4bfc-842c-058bc2ae6e8b tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 200 len: 1501 microversion: 2.1 time: 0.152622 Sep 10 12:40:07.161823 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3403/6813] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:07 2022] GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 1501 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:40:07.185070 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4f844b42-a9a0-4723-bac6-7f993a2acb24 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:40:07.187359 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4f844b42-a9a0-4723-bac6-7f993a2acb24 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:07.194153 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f844b42-a9a0-4723-bac6-7f993a2acb24 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:07.194647 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f844b42-a9a0-4723-bac6-7f993a2acb24 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:07.195100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f844b42-a9a0-4723-bac6-7f993a2acb24 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:07.195857 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f844b42-a9a0-4723-bac6-7f993a2acb24 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:07.196320 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f844b42-a9a0-4723-bac6-7f993a2acb24 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:07.196758 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f844b42-a9a0-4723-bac6-7f993a2acb24 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:07.273261 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4f844b42-a9a0-4723-bac6-7f993a2acb24 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '94e162d56e4041a1bfce33f69e7c7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2bbe113f634d599bb84dba54c8b813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:07.278701 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4f844b42-a9a0-4723-bac6-7f993a2acb24 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Old instance type m1.heat2, new instance type m1.heat {{(pid=128776) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 12:40:07.285102 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-4f844b42-a9a0-4723-bac6-7f993a2acb24 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:40:07.285539 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-4f844b42-a9a0-4723-bac6-7f993a2acb24 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:40:07.286025 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-4f844b42-a9a0-4723-bac6-7f993a2acb24 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:40:07.286446 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-4f844b42-a9a0-4723-bac6-7f993a2acb24 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:40:07.286870 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-4f844b42-a9a0-4723-bac6-7f993a2acb24 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:40:07.393526 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4f844b42-a9a0-4723-bac6-7f993a2acb24 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "POST /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c/action" status: 202 len: 0 microversion: 2.1 time: 0.213233 Sep 10 12:40:07.394332 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3411/6814] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:40:07 2022] POST /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:40:07.402618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3eb6e07f-3db4-45a8-a24b-77b4ea1135ee tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:07.403285 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3eb6e07f-3db4-45a8-a24b-77b4ea1135ee tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:07.409422 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3eb6e07f-3db4-45a8-a24b-77b4ea1135ee tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:07.409919 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3eb6e07f-3db4-45a8-a24b-77b4ea1135ee tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:07.410366 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3eb6e07f-3db4-45a8-a24b-77b4ea1135ee tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:07.411074 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3eb6e07f-3db4-45a8-a24b-77b4ea1135ee tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:07.411587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3eb6e07f-3db4-45a8-a24b-77b4ea1135ee tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:07.412025 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3eb6e07f-3db4-45a8-a24b-77b4ea1135ee tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:07.551590 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3eb6e07f-3db4-45a8-a24b-77b4ea1135ee tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e162d56e4041a1bfce33f69e7c7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2bbe113f634d599bb84dba54c8b813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:07.559593 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3eb6e07f-3db4-45a8-a24b-77b4ea1135ee tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 200 len: 1510 microversion: 2.1 time: 0.161147 Sep 10 12:40:07.560188 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3404/6815] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:07 2022] GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:40:08.583896 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bde47867-715e-4ae0-8703-2c7f23460dd6 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:08.584532 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bde47867-715e-4ae0-8703-2c7f23460dd6 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:08.591845 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bde47867-715e-4ae0-8703-2c7f23460dd6 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:08.592336 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bde47867-715e-4ae0-8703-2c7f23460dd6 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:08.592794 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bde47867-715e-4ae0-8703-2c7f23460dd6 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:08.593484 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bde47867-715e-4ae0-8703-2c7f23460dd6 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:08.593956 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bde47867-715e-4ae0-8703-2c7f23460dd6 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:08.594396 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bde47867-715e-4ae0-8703-2c7f23460dd6 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:08.723515 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bde47867-715e-4ae0-8703-2c7f23460dd6 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e162d56e4041a1bfce33f69e7c7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2bbe113f634d599bb84dba54c8b813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:08.732106 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bde47867-715e-4ae0-8703-2c7f23460dd6 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 200 len: 1510 microversion: 2.1 time: 0.153076 Sep 10 12:40:08.732681 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3412/6816] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:08 2022] GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:40:09.755514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-06a1ccae-a1aa-480d-a0cd-49f8ef30d2eb tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:09.756154 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-06a1ccae-a1aa-480d-a0cd-49f8ef30d2eb tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:09.763752 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06a1ccae-a1aa-480d-a0cd-49f8ef30d2eb tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:09.764235 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06a1ccae-a1aa-480d-a0cd-49f8ef30d2eb tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:09.764670 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06a1ccae-a1aa-480d-a0cd-49f8ef30d2eb tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:09.765359 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06a1ccae-a1aa-480d-a0cd-49f8ef30d2eb tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:09.765811 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06a1ccae-a1aa-480d-a0cd-49f8ef30d2eb tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:09.766237 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06a1ccae-a1aa-480d-a0cd-49f8ef30d2eb tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:09.901372 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-06a1ccae-a1aa-480d-a0cd-49f8ef30d2eb tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e162d56e4041a1bfce33f69e7c7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2bbe113f634d599bb84dba54c8b813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:09.909003 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-06a1ccae-a1aa-480d-a0cd-49f8ef30d2eb tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 200 len: 1515 microversion: 2.1 time: 0.157437 Sep 10 12:40:09.909571 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3405/6817] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:09 2022] GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:40:10.933421 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-15112831-8469-49c1-89be-e13791543b91 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:10.934045 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-15112831-8469-49c1-89be-e13791543b91 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:10.941257 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-15112831-8469-49c1-89be-e13791543b91 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:10.941752 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-15112831-8469-49c1-89be-e13791543b91 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:10.942204 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-15112831-8469-49c1-89be-e13791543b91 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:10.942903 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-15112831-8469-49c1-89be-e13791543b91 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:10.943395 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-15112831-8469-49c1-89be-e13791543b91 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:10.943832 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-15112831-8469-49c1-89be-e13791543b91 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:11.075845 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-15112831-8469-49c1-89be-e13791543b91 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e162d56e4041a1bfce33f69e7c7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2bbe113f634d599bb84dba54c8b813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:11.083633 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-15112831-8469-49c1-89be-e13791543b91 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 200 len: 1515 microversion: 2.1 time: 0.155086 Sep 10 12:40:11.084212 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3413/6818] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:10 2022] GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:40:12.106936 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-68ffa5ef-197e-4a0c-b64c-e72f9f7342a0 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:12.107579 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-68ffa5ef-197e-4a0c-b64c-e72f9f7342a0 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:12.114399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-68ffa5ef-197e-4a0c-b64c-e72f9f7342a0 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:12.114919 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-68ffa5ef-197e-4a0c-b64c-e72f9f7342a0 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:12.115484 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-68ffa5ef-197e-4a0c-b64c-e72f9f7342a0 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:12.116197 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-68ffa5ef-197e-4a0c-b64c-e72f9f7342a0 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:12.116660 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-68ffa5ef-197e-4a0c-b64c-e72f9f7342a0 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:12.117089 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-68ffa5ef-197e-4a0c-b64c-e72f9f7342a0 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:12.252574 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-68ffa5ef-197e-4a0c-b64c-e72f9f7342a0 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e162d56e4041a1bfce33f69e7c7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2bbe113f634d599bb84dba54c8b813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:12.261176 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-68ffa5ef-197e-4a0c-b64c-e72f9f7342a0 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 200 len: 1515 microversion: 2.1 time: 0.158279 Sep 10 12:40:12.261747 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3406/6819] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:12 2022] GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:40:13.285585 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-214bcfd1-08c2-4eb6-9a90-ce2a0ce7b3d8 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:13.286113 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-214bcfd1-08c2-4eb6-9a90-ce2a0ce7b3d8 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:13.294554 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-214bcfd1-08c2-4eb6-9a90-ce2a0ce7b3d8 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:13.295049 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-214bcfd1-08c2-4eb6-9a90-ce2a0ce7b3d8 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:13.295525 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-214bcfd1-08c2-4eb6-9a90-ce2a0ce7b3d8 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:13.296234 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-214bcfd1-08c2-4eb6-9a90-ce2a0ce7b3d8 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:13.296700 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-214bcfd1-08c2-4eb6-9a90-ce2a0ce7b3d8 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:13.297136 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-214bcfd1-08c2-4eb6-9a90-ce2a0ce7b3d8 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:13.442265 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-214bcfd1-08c2-4eb6-9a90-ce2a0ce7b3d8 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e162d56e4041a1bfce33f69e7c7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2bbe113f634d599bb84dba54c8b813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:13.450492 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-214bcfd1-08c2-4eb6-9a90-ce2a0ce7b3d8 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 200 len: 1515 microversion: 2.1 time: 0.169040 Sep 10 12:40:13.451091 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3414/6820] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:13 2022] GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:40:14.480503 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0c17b003-6050-4114-8238-06e20a85e0e1 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:14.481046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0c17b003-6050-4114-8238-06e20a85e0e1 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:14.487852 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c17b003-6050-4114-8238-06e20a85e0e1 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:14.488336 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c17b003-6050-4114-8238-06e20a85e0e1 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:14.488768 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c17b003-6050-4114-8238-06e20a85e0e1 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:14.489447 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c17b003-6050-4114-8238-06e20a85e0e1 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:14.489904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c17b003-6050-4114-8238-06e20a85e0e1 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:14.490331 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c17b003-6050-4114-8238-06e20a85e0e1 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:14.617934 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0c17b003-6050-4114-8238-06e20a85e0e1 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e162d56e4041a1bfce33f69e7c7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2bbe113f634d599bb84dba54c8b813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:14.626631 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0c17b003-6050-4114-8238-06e20a85e0e1 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 200 len: 1515 microversion: 2.1 time: 0.150989 Sep 10 12:40:14.627215 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3407/6821] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:14 2022] GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:40:15.649873 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5ba28f56-d7f4-4107-aa85-7a83675b0086 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:15.651015 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5ba28f56-d7f4-4107-aa85-7a83675b0086 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:15.657718 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ba28f56-d7f4-4107-aa85-7a83675b0086 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:15.658211 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ba28f56-d7f4-4107-aa85-7a83675b0086 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:15.658963 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ba28f56-d7f4-4107-aa85-7a83675b0086 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:15.659699 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ba28f56-d7f4-4107-aa85-7a83675b0086 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:15.660172 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ba28f56-d7f4-4107-aa85-7a83675b0086 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:15.660611 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ba28f56-d7f4-4107-aa85-7a83675b0086 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:15.797586 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5ba28f56-d7f4-4107-aa85-7a83675b0086 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e162d56e4041a1bfce33f69e7c7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2bbe113f634d599bb84dba54c8b813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:15.805324 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5ba28f56-d7f4-4107-aa85-7a83675b0086 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 200 len: 1515 microversion: 2.1 time: 0.159382 Sep 10 12:40:15.805906 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3415/6822] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:15 2022] GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:40:16.829259 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4a121c64-f225-45ef-b979-9275fe421085 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:16.829879 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4a121c64-f225-45ef-b979-9275fe421085 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:16.836719 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a121c64-f225-45ef-b979-9275fe421085 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:16.837205 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a121c64-f225-45ef-b979-9275fe421085 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:16.838285 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a121c64-f225-45ef-b979-9275fe421085 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:16.838985 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a121c64-f225-45ef-b979-9275fe421085 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:16.839470 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a121c64-f225-45ef-b979-9275fe421085 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:16.839907 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a121c64-f225-45ef-b979-9275fe421085 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:16.972153 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4a121c64-f225-45ef-b979-9275fe421085 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e162d56e4041a1bfce33f69e7c7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2bbe113f634d599bb84dba54c8b813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:16.979930 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4a121c64-f225-45ef-b979-9275fe421085 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 200 len: 1515 microversion: 2.1 time: 0.154562 Sep 10 12:40:16.980507 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3408/6823] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:16 2022] GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:40:18.003582 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ad2d3aef-4c50-4fc1-a8c5-31f49697582b tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:18.004220 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ad2d3aef-4c50-4fc1-a8c5-31f49697582b tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:18.012533 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad2d3aef-4c50-4fc1-a8c5-31f49697582b tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:18.013036 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad2d3aef-4c50-4fc1-a8c5-31f49697582b tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:18.013488 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad2d3aef-4c50-4fc1-a8c5-31f49697582b tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:18.014198 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad2d3aef-4c50-4fc1-a8c5-31f49697582b tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:18.014663 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad2d3aef-4c50-4fc1-a8c5-31f49697582b tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:18.015108 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad2d3aef-4c50-4fc1-a8c5-31f49697582b tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:18.155941 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ad2d3aef-4c50-4fc1-a8c5-31f49697582b tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e162d56e4041a1bfce33f69e7c7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2bbe113f634d599bb84dba54c8b813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:18.163783 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ad2d3aef-4c50-4fc1-a8c5-31f49697582b tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 200 len: 1515 microversion: 2.1 time: 0.164177 Sep 10 12:40:18.164378 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3416/6824] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:17 2022] GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:40:19.188114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d3b7fa70-1628-4e12-9f79-8985168ea130 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:19.188762 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d3b7fa70-1628-4e12-9f79-8985168ea130 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:19.194820 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3b7fa70-1628-4e12-9f79-8985168ea130 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:19.195335 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3b7fa70-1628-4e12-9f79-8985168ea130 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:19.195767 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3b7fa70-1628-4e12-9f79-8985168ea130 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:19.196446 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3b7fa70-1628-4e12-9f79-8985168ea130 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:19.196895 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3b7fa70-1628-4e12-9f79-8985168ea130 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:19.197316 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3b7fa70-1628-4e12-9f79-8985168ea130 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:19.326501 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d3b7fa70-1628-4e12-9f79-8985168ea130 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e162d56e4041a1bfce33f69e7c7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2bbe113f634d599bb84dba54c8b813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:19.334113 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d3b7fa70-1628-4e12-9f79-8985168ea130 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 200 len: 1515 microversion: 2.1 time: 0.150251 Sep 10 12:40:19.334710 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3409/6825] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:19 2022] GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:40:20.357408 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-02967627-eb10-4459-af4a-7d0c06986425 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:20.358040 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-02967627-eb10-4459-af4a-7d0c06986425 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:20.364980 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02967627-eb10-4459-af4a-7d0c06986425 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:20.365474 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02967627-eb10-4459-af4a-7d0c06986425 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:20.365923 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02967627-eb10-4459-af4a-7d0c06986425 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:20.366621 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02967627-eb10-4459-af4a-7d0c06986425 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:20.367092 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02967627-eb10-4459-af4a-7d0c06986425 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:20.367556 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02967627-eb10-4459-af4a-7d0c06986425 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:20.499093 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-02967627-eb10-4459-af4a-7d0c06986425 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e162d56e4041a1bfce33f69e7c7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2bbe113f634d599bb84dba54c8b813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:20.506965 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-02967627-eb10-4459-af4a-7d0c06986425 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 200 len: 1515 microversion: 2.1 time: 0.153552 Sep 10 12:40:20.507572 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3417/6826] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:20 2022] GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:40:21.531784 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e0369d0e-909f-4bdf-8f13-9bbb0daebe0a tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:21.532397 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e0369d0e-909f-4bdf-8f13-9bbb0daebe0a tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:21.539139 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0369d0e-909f-4bdf-8f13-9bbb0daebe0a tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:21.539647 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0369d0e-909f-4bdf-8f13-9bbb0daebe0a tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:21.540079 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0369d0e-909f-4bdf-8f13-9bbb0daebe0a tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:21.540765 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0369d0e-909f-4bdf-8f13-9bbb0daebe0a tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:21.541213 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0369d0e-909f-4bdf-8f13-9bbb0daebe0a tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:21.542265 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0369d0e-909f-4bdf-8f13-9bbb0daebe0a tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:21.678006 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e0369d0e-909f-4bdf-8f13-9bbb0daebe0a tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e162d56e4041a1bfce33f69e7c7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2bbe113f634d599bb84dba54c8b813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:21.685946 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e0369d0e-909f-4bdf-8f13-9bbb0daebe0a tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 200 len: 1515 microversion: 2.1 time: 0.158074 Sep 10 12:40:21.686527 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3410/6827] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:21 2022] GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:40:22.709527 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7afa430f-ef25-44bb-883e-3d5f243908cc tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:22.710156 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7afa430f-ef25-44bb-883e-3d5f243908cc tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:22.717073 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7afa430f-ef25-44bb-883e-3d5f243908cc tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:22.717570 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7afa430f-ef25-44bb-883e-3d5f243908cc tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:22.718020 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7afa430f-ef25-44bb-883e-3d5f243908cc tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:22.718720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7afa430f-ef25-44bb-883e-3d5f243908cc tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:22.719207 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7afa430f-ef25-44bb-883e-3d5f243908cc tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:22.719649 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7afa430f-ef25-44bb-883e-3d5f243908cc tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:22.850221 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7afa430f-ef25-44bb-883e-3d5f243908cc tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e162d56e4041a1bfce33f69e7c7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2bbe113f634d599bb84dba54c8b813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:22.858620 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7afa430f-ef25-44bb-883e-3d5f243908cc tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 200 len: 1515 microversion: 2.1 time: 0.152967 Sep 10 12:40:22.859425 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3418/6828] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:22 2022] GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:40:23.882578 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-35555b51-de91-4bff-80a0-ec122d56628b tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:23.883218 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-35555b51-de91-4bff-80a0-ec122d56628b tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:23.890678 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-35555b51-de91-4bff-80a0-ec122d56628b tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:23.891177 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-35555b51-de91-4bff-80a0-ec122d56628b tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:23.891619 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-35555b51-de91-4bff-80a0-ec122d56628b tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:23.892306 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-35555b51-de91-4bff-80a0-ec122d56628b tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:23.892780 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-35555b51-de91-4bff-80a0-ec122d56628b tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:23.893203 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-35555b51-de91-4bff-80a0-ec122d56628b tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:24.026646 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-35555b51-de91-4bff-80a0-ec122d56628b tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e162d56e4041a1bfce33f69e7c7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2bbe113f634d599bb84dba54c8b813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:24.034828 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-35555b51-de91-4bff-80a0-ec122d56628b tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 200 len: 1515 microversion: 2.1 time: 0.156158 Sep 10 12:40:24.035417 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3411/6829] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:23 2022] GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:40:25.057901 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bc27552b-5dae-450f-97da-d1c09e723ed4 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:25.058539 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bc27552b-5dae-450f-97da-d1c09e723ed4 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:25.065304 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc27552b-5dae-450f-97da-d1c09e723ed4 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:25.065811 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc27552b-5dae-450f-97da-d1c09e723ed4 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:25.066265 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc27552b-5dae-450f-97da-d1c09e723ed4 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:25.066981 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc27552b-5dae-450f-97da-d1c09e723ed4 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:25.067479 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc27552b-5dae-450f-97da-d1c09e723ed4 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:25.067925 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc27552b-5dae-450f-97da-d1c09e723ed4 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:25.199459 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bc27552b-5dae-450f-97da-d1c09e723ed4 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e162d56e4041a1bfce33f69e7c7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2bbe113f634d599bb84dba54c8b813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:25.207344 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bc27552b-5dae-450f-97da-d1c09e723ed4 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 200 len: 1515 microversion: 2.1 time: 0.153327 Sep 10 12:40:25.208500 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3419/6830] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:25 2022] GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:40:26.231307 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6af502df-d47a-4fd6-85b0-b2c18e4671a5 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:26.231900 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6af502df-d47a-4fd6-85b0-b2c18e4671a5 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:26.238703 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6af502df-d47a-4fd6-85b0-b2c18e4671a5 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:26.239212 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6af502df-d47a-4fd6-85b0-b2c18e4671a5 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:26.239667 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6af502df-d47a-4fd6-85b0-b2c18e4671a5 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:26.240333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6af502df-d47a-4fd6-85b0-b2c18e4671a5 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:26.240783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6af502df-d47a-4fd6-85b0-b2c18e4671a5 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:26.241206 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6af502df-d47a-4fd6-85b0-b2c18e4671a5 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:26.374833 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6af502df-d47a-4fd6-85b0-b2c18e4671a5 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e162d56e4041a1bfce33f69e7c7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2bbe113f634d599bb84dba54c8b813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:26.382886 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6af502df-d47a-4fd6-85b0-b2c18e4671a5 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 200 len: 1515 microversion: 2.1 time: 0.156576 Sep 10 12:40:26.383497 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3412/6831] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:26 2022] GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:40:27.408156 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9549bcd2-d3dc-4ebb-a008-6a517b895a5a tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:27.408777 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9549bcd2-d3dc-4ebb-a008-6a517b895a5a tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:27.416320 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9549bcd2-d3dc-4ebb-a008-6a517b895a5a tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:27.416826 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9549bcd2-d3dc-4ebb-a008-6a517b895a5a tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:27.417895 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9549bcd2-d3dc-4ebb-a008-6a517b895a5a tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:27.418608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9549bcd2-d3dc-4ebb-a008-6a517b895a5a tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:27.419084 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9549bcd2-d3dc-4ebb-a008-6a517b895a5a tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:27.419556 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9549bcd2-d3dc-4ebb-a008-6a517b895a5a tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:27.548688 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9549bcd2-d3dc-4ebb-a008-6a517b895a5a tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e162d56e4041a1bfce33f69e7c7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2bbe113f634d599bb84dba54c8b813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:27.556495 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9549bcd2-d3dc-4ebb-a008-6a517b895a5a tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 200 len: 1515 microversion: 2.1 time: 0.152407 Sep 10 12:40:27.557079 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3420/6832] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:27 2022] GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:40:28.579193 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9620d4d1-68b9-4357-a6d2-16f6638fc15c tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:28.579898 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9620d4d1-68b9-4357-a6d2-16f6638fc15c tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:28.586945 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9620d4d1-68b9-4357-a6d2-16f6638fc15c tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:28.587468 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9620d4d1-68b9-4357-a6d2-16f6638fc15c tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:28.587918 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9620d4d1-68b9-4357-a6d2-16f6638fc15c tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:28.588609 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9620d4d1-68b9-4357-a6d2-16f6638fc15c tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:28.589068 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9620d4d1-68b9-4357-a6d2-16f6638fc15c tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:28.589497 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9620d4d1-68b9-4357-a6d2-16f6638fc15c tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:28.719355 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9620d4d1-68b9-4357-a6d2-16f6638fc15c tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e162d56e4041a1bfce33f69e7c7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2bbe113f634d599bb84dba54c8b813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:28.727064 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9620d4d1-68b9-4357-a6d2-16f6638fc15c tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 200 len: 1515 microversion: 2.1 time: 0.151896 Sep 10 12:40:28.727679 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3413/6833] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:28 2022] GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:40:29.751598 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-36b7c7bd-92e1-4388-8f41-7b05f533a8b6 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:29.752229 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-36b7c7bd-92e1-4388-8f41-7b05f533a8b6 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:29.758706 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-36b7c7bd-92e1-4388-8f41-7b05f533a8b6 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:29.759224 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-36b7c7bd-92e1-4388-8f41-7b05f533a8b6 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:29.759678 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-36b7c7bd-92e1-4388-8f41-7b05f533a8b6 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:29.760373 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-36b7c7bd-92e1-4388-8f41-7b05f533a8b6 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:29.761693 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-36b7c7bd-92e1-4388-8f41-7b05f533a8b6 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:29.762143 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-36b7c7bd-92e1-4388-8f41-7b05f533a8b6 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:29.897206 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-36b7c7bd-92e1-4388-8f41-7b05f533a8b6 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e162d56e4041a1bfce33f69e7c7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2bbe113f634d599bb84dba54c8b813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:29.904886 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-36b7c7bd-92e1-4388-8f41-7b05f533a8b6 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 200 len: 1515 microversion: 2.1 time: 0.157371 Sep 10 12:40:29.905465 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3421/6834] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:29 2022] GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:40:30.928304 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2f7d4ff0-17b4-4649-9ccf-b34d26b03593 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:30.928916 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2f7d4ff0-17b4-4649-9ccf-b34d26b03593 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:30.936989 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f7d4ff0-17b4-4649-9ccf-b34d26b03593 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:30.937473 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f7d4ff0-17b4-4649-9ccf-b34d26b03593 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:30.937904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f7d4ff0-17b4-4649-9ccf-b34d26b03593 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:30.938589 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f7d4ff0-17b4-4649-9ccf-b34d26b03593 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:30.939041 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f7d4ff0-17b4-4649-9ccf-b34d26b03593 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:30.939494 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2f7d4ff0-17b4-4649-9ccf-b34d26b03593 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:31.069794 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2f7d4ff0-17b4-4649-9ccf-b34d26b03593 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e162d56e4041a1bfce33f69e7c7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2bbe113f634d599bb84dba54c8b813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:31.078158 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2f7d4ff0-17b4-4649-9ccf-b34d26b03593 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 200 len: 1515 microversion: 2.1 time: 0.153686 Sep 10 12:40:31.078734 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3414/6835] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:30 2022] GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:40:32.101286 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6af8d34f-4637-4bf4-b72b-29793bddbc8f tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:32.101943 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6af8d34f-4637-4bf4-b72b-29793bddbc8f tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:32.110091 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6af8d34f-4637-4bf4-b72b-29793bddbc8f tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:32.110582 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6af8d34f-4637-4bf4-b72b-29793bddbc8f tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:32.111038 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6af8d34f-4637-4bf4-b72b-29793bddbc8f tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:32.111786 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6af8d34f-4637-4bf4-b72b-29793bddbc8f tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:32.112261 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6af8d34f-4637-4bf4-b72b-29793bddbc8f tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:32.112705 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6af8d34f-4637-4bf4-b72b-29793bddbc8f tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:32.246552 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6af8d34f-4637-4bf4-b72b-29793bddbc8f tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e162d56e4041a1bfce33f69e7c7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2bbe113f634d599bb84dba54c8b813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:32.254326 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6af8d34f-4637-4bf4-b72b-29793bddbc8f tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 200 len: 1515 microversion: 2.1 time: 0.156960 Sep 10 12:40:32.254899 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3422/6836] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:32 2022] GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:40:33.278238 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ff5d6586-3abd-4968-8e23-9ea67520d0ac tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:33.278842 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ff5d6586-3abd-4968-8e23-9ea67520d0ac tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:33.285686 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ff5d6586-3abd-4968-8e23-9ea67520d0ac tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:33.286173 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ff5d6586-3abd-4968-8e23-9ea67520d0ac tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:33.286612 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ff5d6586-3abd-4968-8e23-9ea67520d0ac tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:33.287343 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ff5d6586-3abd-4968-8e23-9ea67520d0ac tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:33.287803 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ff5d6586-3abd-4968-8e23-9ea67520d0ac tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:33.288236 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ff5d6586-3abd-4968-8e23-9ea67520d0ac tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:33.423184 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ff5d6586-3abd-4968-8e23-9ea67520d0ac tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e162d56e4041a1bfce33f69e7c7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2bbe113f634d599bb84dba54c8b813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:33.430805 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ff5d6586-3abd-4968-8e23-9ea67520d0ac tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 200 len: 1515 microversion: 2.1 time: 0.156718 Sep 10 12:40:33.431412 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3415/6837] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:33 2022] GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:40:34.454596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7616e3c9-be82-44b0-b8a3-d82a7f441803 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:34.455197 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7616e3c9-be82-44b0-b8a3-d82a7f441803 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:34.461977 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7616e3c9-be82-44b0-b8a3-d82a7f441803 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:34.462479 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7616e3c9-be82-44b0-b8a3-d82a7f441803 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:34.462935 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7616e3c9-be82-44b0-b8a3-d82a7f441803 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:34.463671 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7616e3c9-be82-44b0-b8a3-d82a7f441803 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:34.464151 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7616e3c9-be82-44b0-b8a3-d82a7f441803 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:34.464599 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7616e3c9-be82-44b0-b8a3-d82a7f441803 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:34.592826 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7616e3c9-be82-44b0-b8a3-d82a7f441803 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e162d56e4041a1bfce33f69e7c7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2bbe113f634d599bb84dba54c8b813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:34.600536 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7616e3c9-be82-44b0-b8a3-d82a7f441803 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 200 len: 1515 microversion: 2.1 time: 0.149985 Sep 10 12:40:34.601115 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3423/6838] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:34 2022] GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:40:35.625855 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7244c851-599f-4355-b435-eaf68a04b06c tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:35.626465 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7244c851-599f-4355-b435-eaf68a04b06c tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:35.628352 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=30 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:40:35.633630 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7244c851-599f-4355-b435-eaf68a04b06c tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:35.634109 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7244c851-599f-4355-b435-eaf68a04b06c tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:35.634539 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7244c851-599f-4355-b435-eaf68a04b06c tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:35.635253 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7244c851-599f-4355-b435-eaf68a04b06c tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:35.635705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7244c851-599f-4355-b435-eaf68a04b06c tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:35.636857 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7244c851-599f-4355-b435-eaf68a04b06c tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:35.639523 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=90 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:40:35.769625 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7244c851-599f-4355-b435-eaf68a04b06c tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e162d56e4041a1bfce33f69e7c7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2bbe113f634d599bb84dba54c8b813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:35.777533 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7244c851-599f-4355-b435-eaf68a04b06c tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 200 len: 1515 microversion: 2.1 time: 0.157093 Sep 10 12:40:35.778113 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3416/6839] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:35 2022] GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:40:36.783589 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-9be8c40d-2437-4f45-a282-b2311c2af459 req-dc906e83-bc1a-42ab-8cb6-2a0325d33d64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "827c03b5-4e1d-45de-8c72-9efe6676a22c", "name": "network-vif-unplugged", "status": "completed", "tag": "1206f57c-6898-4248-8fc6-e348ae78b853"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:40:36.789447 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=34 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:40:36.795988 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-9be8c40d-2437-4f45-a282-b2311c2af459 req-dc906e83-bc1a-42ab-8cb6-2a0325d33d64 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:36.796485 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-9be8c40d-2437-4f45-a282-b2311c2af459 req-dc906e83-bc1a-42ab-8cb6-2a0325d33d64 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:36.797000 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-9be8c40d-2437-4f45-a282-b2311c2af459 req-dc906e83-bc1a-42ab-8cb6-2a0325d33d64 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:36.801679 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:40:36.802867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1648a0ab-6c68-425a-b296-50efd0c28363 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:36.803571 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1648a0ab-6c68-425a-b296-50efd0c28363 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:36.809908 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1648a0ab-6c68-425a-b296-50efd0c28363 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:36.810445 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1648a0ab-6c68-425a-b296-50efd0c28363 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:36.810890 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1648a0ab-6c68-425a-b296-50efd0c28363 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:36.811648 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1648a0ab-6c68-425a-b296-50efd0c28363 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:36.811754 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-9be8c40d-2437-4f45-a282-b2311c2af459 req-dc906e83-bc1a-42ab-8cb6-2a0325d33d64 service nova] Creating event network-vif-unplugged:1206f57c-6898-4248-8fc6-e348ae78b853 for instance 827c03b5-4e1d-45de-8c72-9efe6676a22c on n-h2-856895-1 Sep 10 12:40:36.812114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1648a0ab-6c68-425a-b296-50efd0c28363 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:36.812698 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1648a0ab-6c68-425a-b296-50efd0c28363 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:36.818094 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [req-9be8c40d-2437-4f45-a282-b2311c2af459 req-dc906e83-bc1a-42ab-8cb6-2a0325d33d64 service nova] Instance 827c03b5-4e1d-45de-8c72-9efe6676a22c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856895-1', 'n-h1-856895-1'} {{(pid=128776) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 12:40:36.831679 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-9be8c40d-2437-4f45-a282-b2311c2af459 req-dc906e83-bc1a-42ab-8cb6-2a0325d33d64 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051852 Sep 10 12:40:36.832298 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3424/6840] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:40:36.951941 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1648a0ab-6c68-425a-b296-50efd0c28363 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e162d56e4041a1bfce33f69e7c7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2bbe113f634d599bb84dba54c8b813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:36.959788 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1648a0ab-6c68-425a-b296-50efd0c28363 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 200 len: 1514 microversion: 2.1 time: 0.162518 Sep 10 12:40:36.960301 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3417/6841] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:36 2022] GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:40:37.983958 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-74dfee4d-b39d-447c-923b-3c01616a8493 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:37.984720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-74dfee4d-b39d-447c-923b-3c01616a8493 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:37.991533 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-74dfee4d-b39d-447c-923b-3c01616a8493 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:37.992037 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-74dfee4d-b39d-447c-923b-3c01616a8493 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:37.992496 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-74dfee4d-b39d-447c-923b-3c01616a8493 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:37.993204 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-74dfee4d-b39d-447c-923b-3c01616a8493 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:37.993681 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-74dfee4d-b39d-447c-923b-3c01616a8493 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:37.994400 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-74dfee4d-b39d-447c-923b-3c01616a8493 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:38.131194 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-74dfee4d-b39d-447c-923b-3c01616a8493 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e162d56e4041a1bfce33f69e7c7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2bbe113f634d599bb84dba54c8b813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:38.140089 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-74dfee4d-b39d-447c-923b-3c01616a8493 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 200 len: 1512 microversion: 2.1 time: 0.161258 Sep 10 12:40:38.140666 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3425/6842] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:37 2022] GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:40:38.863983 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-b8500b7c-9d55-4d59-9664-9b2e12f9de9e req-aee8c68d-fecd-417a-9521-6de8afa51a13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "827c03b5-4e1d-45de-8c72-9efe6676a22c", "tag": "1206f57c-6898-4248-8fc6-e348ae78b853"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:40:38.874699 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-b8500b7c-9d55-4d59-9664-9b2e12f9de9e req-aee8c68d-fecd-417a-9521-6de8afa51a13 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:38.875199 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-b8500b7c-9d55-4d59-9664-9b2e12f9de9e req-aee8c68d-fecd-417a-9521-6de8afa51a13 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:38.875635 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-b8500b7c-9d55-4d59-9664-9b2e12f9de9e req-aee8c68d-fecd-417a-9521-6de8afa51a13 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:38.887073 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-b8500b7c-9d55-4d59-9664-9b2e12f9de9e req-aee8c68d-fecd-417a-9521-6de8afa51a13 service nova] Creating event network-changed:1206f57c-6898-4248-8fc6-e348ae78b853 for instance 827c03b5-4e1d-45de-8c72-9efe6676a22c on n-h2-856895-1 Sep 10 12:40:38.892658 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [req-b8500b7c-9d55-4d59-9664-9b2e12f9de9e req-aee8c68d-fecd-417a-9521-6de8afa51a13 service nova] Instance 827c03b5-4e1d-45de-8c72-9efe6676a22c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856895-1', 'n-h1-856895-1'} {{(pid=128777) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 12:40:38.903768 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-b8500b7c-9d55-4d59-9664-9b2e12f9de9e req-aee8c68d-fecd-417a-9521-6de8afa51a13 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042986 Sep 10 12:40:38.904507 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3418/6843] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:40:39.164507 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7723aea8-da6b-4118-bfd6-eadeee6648ae tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:39.165215 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7723aea8-da6b-4118-bfd6-eadeee6648ae tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:39.173305 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7723aea8-da6b-4118-bfd6-eadeee6648ae tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:39.173826 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7723aea8-da6b-4118-bfd6-eadeee6648ae tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:39.174269 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7723aea8-da6b-4118-bfd6-eadeee6648ae tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:39.174986 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7723aea8-da6b-4118-bfd6-eadeee6648ae tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:39.175483 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7723aea8-da6b-4118-bfd6-eadeee6648ae tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:39.176243 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7723aea8-da6b-4118-bfd6-eadeee6648ae tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:39.315847 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7723aea8-da6b-4118-bfd6-eadeee6648ae tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e162d56e4041a1bfce33f69e7c7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2bbe113f634d599bb84dba54c8b813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:39.327385 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7723aea8-da6b-4118-bfd6-eadeee6648ae tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 200 len: 1509 microversion: 2.1 time: 0.166821 Sep 10 12:40:39.327979 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3426/6844] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:39 2022] GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:40:39.350776 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7ad11124-d967-4895-be61-b7711e5865eb tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:39.351395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7ad11124-d967-4895-be61-b7711e5865eb tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:39.357754 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ad11124-d967-4895-be61-b7711e5865eb tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:39.358241 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ad11124-d967-4895-be61-b7711e5865eb tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:39.358681 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ad11124-d967-4895-be61-b7711e5865eb tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:39.359434 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ad11124-d967-4895-be61-b7711e5865eb tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:39.359893 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ad11124-d967-4895-be61-b7711e5865eb tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:39.360323 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ad11124-d967-4895-be61-b7711e5865eb tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:39.388615 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7ad11124-d967-4895-be61-b7711e5865eb tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:40:39.445807 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.compute.api [None req-7ad11124-d967-4895-be61-b7711e5865eb tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Found an unconfirmed migration during delete, id: 16, status: finished Sep 10 12:40:41.381399 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7ad11124-d967-4895-be61-b7711e5865eb tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "DELETE /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 204 len: 0 microversion: 2.1 time: 2.034419 Sep 10 12:40:41.382149 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3419/6845] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:40:39 2022] DELETE /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 0 bytes in 2036 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:40:41.392322 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0acd5764-f863-49f7-a2ce-aaadec7c8d3b tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:41.392954 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0acd5764-f863-49f7-a2ce-aaadec7c8d3b tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:41.398959 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0acd5764-f863-49f7-a2ce-aaadec7c8d3b tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:41.399500 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0acd5764-f863-49f7-a2ce-aaadec7c8d3b tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:41.399960 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0acd5764-f863-49f7-a2ce-aaadec7c8d3b tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:41.400684 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0acd5764-f863-49f7-a2ce-aaadec7c8d3b tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:41.401148 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0acd5764-f863-49f7-a2ce-aaadec7c8d3b tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:41.401585 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0acd5764-f863-49f7-a2ce-aaadec7c8d3b tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:41.537971 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0acd5764-f863-49f7-a2ce-aaadec7c8d3b tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e162d56e4041a1bfce33f69e7c7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2bbe113f634d599bb84dba54c8b813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:41.545835 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0acd5764-f863-49f7-a2ce-aaadec7c8d3b tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 200 len: 1501 microversion: 2.1 time: 0.159423 Sep 10 12:40:41.546411 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3427/6846] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:41 2022] GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 1501 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:40:42.569678 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-14b0c77f-7e9d-47b5-b66a-b6927f4c5f35 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:42.570334 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-14b0c77f-7e9d-47b5-b66a-b6927f4c5f35 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:42.577289 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-14b0c77f-7e9d-47b5-b66a-b6927f4c5f35 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:42.577769 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-14b0c77f-7e9d-47b5-b66a-b6927f4c5f35 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:42.578203 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-14b0c77f-7e9d-47b5-b66a-b6927f4c5f35 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:42.578886 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-14b0c77f-7e9d-47b5-b66a-b6927f4c5f35 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:42.579383 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-14b0c77f-7e9d-47b5-b66a-b6927f4c5f35 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:42.579792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-14b0c77f-7e9d-47b5-b66a-b6927f4c5f35 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:42.714614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-14b0c77f-7e9d-47b5-b66a-b6927f4c5f35 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e162d56e4041a1bfce33f69e7c7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2bbe113f634d599bb84dba54c8b813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:42.723619 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-14b0c77f-7e9d-47b5-b66a-b6927f4c5f35 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 200 len: 1501 microversion: 2.1 time: 0.158183 Sep 10 12:40:42.724787 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3420/6847] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:42 2022] GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 1501 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:40:42.864176 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-6a7107bb-2a13-4b87-83ba-87ae6d48bd22 req-838595ec-6c08-4315-868a-dec4dababce7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "827c03b5-4e1d-45de-8c72-9efe6676a22c", "name": "network-vif-plugged", "status": "completed", "tag": "1206f57c-6898-4248-8fc6-e348ae78b853"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:40:42.878203 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6a7107bb-2a13-4b87-83ba-87ae6d48bd22 req-838595ec-6c08-4315-868a-dec4dababce7 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:42.878898 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6a7107bb-2a13-4b87-83ba-87ae6d48bd22 req-838595ec-6c08-4315-868a-dec4dababce7 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:42.880529 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6a7107bb-2a13-4b87-83ba-87ae6d48bd22 req-838595ec-6c08-4315-868a-dec4dababce7 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:42.896853 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-6a7107bb-2a13-4b87-83ba-87ae6d48bd22 req-838595ec-6c08-4315-868a-dec4dababce7 service nova] Creating event network-vif-plugged:1206f57c-6898-4248-8fc6-e348ae78b853 for instance 827c03b5-4e1d-45de-8c72-9efe6676a22c on n-h2-856895-1 Sep 10 12:40:42.902044 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-6a7107bb-2a13-4b87-83ba-87ae6d48bd22 req-838595ec-6c08-4315-868a-dec4dababce7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041694 Sep 10 12:40:42.904480 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3428/6848] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:40:43.141336 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-1ad44908-4411-4524-894a-9edd02980dd1 req-26203e48-eae8-4f52-8149-02445cc7a452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "827c03b5-4e1d-45de-8c72-9efe6676a22c", "name": "network-vif-deleted", "tag": "1206f57c-6898-4248-8fc6-e348ae78b853"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:40:43.151980 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-1ad44908-4411-4524-894a-9edd02980dd1 req-26203e48-eae8-4f52-8149-02445cc7a452 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:43.160397 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-1ad44908-4411-4524-894a-9edd02980dd1 req-26203e48-eae8-4f52-8149-02445cc7a452 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:43.161843 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-1ad44908-4411-4524-894a-9edd02980dd1 req-26203e48-eae8-4f52-8149-02445cc7a452 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:43.176626 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-1ad44908-4411-4524-894a-9edd02980dd1 req-26203e48-eae8-4f52-8149-02445cc7a452 service nova] Creating event network-vif-deleted:1206f57c-6898-4248-8fc6-e348ae78b853 for instance 827c03b5-4e1d-45de-8c72-9efe6676a22c on n-h2-856895-1 Sep 10 12:40:43.182672 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-1ad44908-4411-4524-894a-9edd02980dd1 req-26203e48-eae8-4f52-8149-02445cc7a452 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046616 Sep 10 12:40:43.183737 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3421/6849] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:40:43.749457 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-674a1206-2094-47f6-92e8-1c33ed2ac90a tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:43.750194 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-674a1206-2094-47f6-92e8-1c33ed2ac90a tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:43.756421 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-674a1206-2094-47f6-92e8-1c33ed2ac90a tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:43.756917 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-674a1206-2094-47f6-92e8-1c33ed2ac90a tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:43.757369 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-674a1206-2094-47f6-92e8-1c33ed2ac90a tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:43.758073 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-674a1206-2094-47f6-92e8-1c33ed2ac90a tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:43.758542 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-674a1206-2094-47f6-92e8-1c33ed2ac90a tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:43.758980 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-674a1206-2094-47f6-92e8-1c33ed2ac90a tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:43.772652 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-674a1206-2094-47f6-92e8-1c33ed2ac90a tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] HTTP exception thrown: Instance 827c03b5-4e1d-45de-8c72-9efe6676a22c could not be found. Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-674a1206-2094-47f6-92e8-1c33ed2ac90a tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Request method failure captured: Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c HTTP/1.1 Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHIWaTSIg-E_0mVuLwzH0cou5cacY2SNLIQSueiYTVyr7avxUmUzfznnaCaU83AbLZddbfeoVHoIsECGqh1kpCJqrlH3ycrHuJDySe1hJl_J24etVyzoPgDck9Wn1Dr9hbu2HNqrEcAKu-A7VxTgT4UXXney2KgknRhr0Tm_NikBh0tg Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 0c2bbe113f634d599bb84dba54c8b813 Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-DeleteServersTestJSON-491340680 Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0c2bbe113f634d599bb84dba54c8b813"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0c2bbe113f634d599bb84dba54c8b813"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0c2bbe113f634d599bb84dba54c8b813", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0c2bbe113f634d599bb84dba54c8b813"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-DeleteServersTestJSON-491340680 Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 0c2bbe113f634d599bb84dba54c8b813 Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-DeleteServersTestJSON-491340680 Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-DeleteServersTestJSON-491340680-project Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 94e162d56e4041a1bfce33f69e7c7a15 Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-DeleteServersTestJSON-491340680-project Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 827c03b5-4e1d-45de-8c72-9efe6676a22c could not be found. Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '827c03b5-4e1d-45de-8c72-9efe6676a22c'} Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 827c03b5-4e1d-45de-8c72-9efe6676a22c could not be found. Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 827c03b5-4e1d-45de-8c72-9efe6676a22c could not be found. Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:40:43.774275 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:40:43.779481 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:40:43.779481 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:40:43.779481 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:40:43.779481 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:40:43.779481 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:40:43.779481 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 827c03b5-4e1d-45de-8c72-9efe6676a22c could not be found. Sep 10 12:40:43.779481 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:40:43.779481 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-674a1206-2094-47f6-92e8-1c33ed2ac90a tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Returning 404 to user: Instance 827c03b5-4e1d-45de-8c72-9efe6676a22c could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:40:43.779481 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-674a1206-2094-47f6-92e8-1c33ed2ac90a tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 404 len: 111 microversion: 2.1 time: 0.030956 Sep 10 12:40:43.779481 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3429/6850] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:43 2022] GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:40:43.792127 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7f2ac41a-b730-48b8-8b18-a8e717dfdc49 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:43.792719 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7f2ac41a-b730-48b8-8b18-a8e717dfdc49 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:43.799749 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f2ac41a-b730-48b8-8b18-a8e717dfdc49 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:43.800241 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f2ac41a-b730-48b8-8b18-a8e717dfdc49 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:43.800688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f2ac41a-b730-48b8-8b18-a8e717dfdc49 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:43.801384 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f2ac41a-b730-48b8-8b18-a8e717dfdc49 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:43.801847 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f2ac41a-b730-48b8-8b18-a8e717dfdc49 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:43.802283 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f2ac41a-b730-48b8-8b18-a8e717dfdc49 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:43.816439 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-7f2ac41a-b730-48b8-8b18-a8e717dfdc49 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] HTTP exception thrown: Instance 827c03b5-4e1d-45de-8c72-9efe6676a22c could not be found. Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7f2ac41a-b730-48b8-8b18-a8e717dfdc49 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Request method failure captured: Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c HTTP/1.1 Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHIWaTSIg-E_0mVuLwzH0cou5cacY2SNLIQSueiYTVyr7avxUmUzfznnaCaU83AbLZddbfeoVHoIsECGqh1kpCJqrlH3ycrHuJDySe1hJl_J24etVyzoPgDck9Wn1Dr9hbu2HNqrEcAKu-A7VxTgT4UXXney2KgknRhr0Tm_NikBh0tg Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 0c2bbe113f634d599bb84dba54c8b813 Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-DeleteServersTestJSON-491340680 Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0c2bbe113f634d599bb84dba54c8b813"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0c2bbe113f634d599bb84dba54c8b813"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0c2bbe113f634d599bb84dba54c8b813", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0c2bbe113f634d599bb84dba54c8b813"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-DeleteServersTestJSON-491340680 Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 0c2bbe113f634d599bb84dba54c8b813 Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-DeleteServersTestJSON-491340680 Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-DeleteServersTestJSON-491340680-project Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 94e162d56e4041a1bfce33f69e7c7a15 Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-DeleteServersTestJSON-491340680-project Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 827c03b5-4e1d-45de-8c72-9efe6676a22c could not be found. Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '827c03b5-4e1d-45de-8c72-9efe6676a22c'} Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 827c03b5-4e1d-45de-8c72-9efe6676a22c could not be found. Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:40:43.818072 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:40:43.822000 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 827c03b5-4e1d-45de-8c72-9efe6676a22c could not be found. Sep 10 12:40:43.822000 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:40:43.822000 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:40:43.822000 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:40:43.822000 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:40:43.822000 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:40:43.822000 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:40:43.822000 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:40:43.822000 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:40:43.822000 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 827c03b5-4e1d-45de-8c72-9efe6676a22c could not be found. Sep 10 12:40:43.822000 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:40:43.822000 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7f2ac41a-b730-48b8-8b18-a8e717dfdc49 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Returning 404 to user: Instance 827c03b5-4e1d-45de-8c72-9efe6676a22c could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:40:43.822000 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7f2ac41a-b730-48b8-8b18-a8e717dfdc49 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "DELETE /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 404 len: 111 microversion: 2.1 time: 0.031622 Sep 10 12:40:43.822000 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3422/6851] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:40:43 2022] DELETE /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:40:43.828713 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bd5e5ec4-9f56-4e24-a994-5871f5ad6a41 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:43.829343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bd5e5ec4-9f56-4e24-a994-5871f5ad6a41 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] [instance: 827c03b5-4e1d-45de-8c72-9efe6676a22c] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:43.835276 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd5e5ec4-9f56-4e24-a994-5871f5ad6a41 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:43.835776 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd5e5ec4-9f56-4e24-a994-5871f5ad6a41 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:43.836231 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd5e5ec4-9f56-4e24-a994-5871f5ad6a41 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:43.836932 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd5e5ec4-9f56-4e24-a994-5871f5ad6a41 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:43.837406 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd5e5ec4-9f56-4e24-a994-5871f5ad6a41 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:43.837850 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd5e5ec4-9f56-4e24-a994-5871f5ad6a41 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:43.851182 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-bd5e5ec4-9f56-4e24-a994-5871f5ad6a41 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] HTTP exception thrown: Instance 827c03b5-4e1d-45de-8c72-9efe6676a22c could not be found. Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bd5e5ec4-9f56-4e24-a994-5871f5ad6a41 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Request method failure captured: Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c HTTP/1.1 Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHIWaTSIg-E_0mVuLwzH0cou5cacY2SNLIQSueiYTVyr7avxUmUzfznnaCaU83AbLZddbfeoVHoIsECGqh1kpCJqrlH3ycrHuJDySe1hJl_J24etVyzoPgDck9Wn1Dr9hbu2HNqrEcAKu-A7VxTgT4UXXney2KgknRhr0Tm_NikBh0tg Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 0c2bbe113f634d599bb84dba54c8b813 Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-DeleteServersTestJSON-491340680 Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0c2bbe113f634d599bb84dba54c8b813"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/0c2bbe113f634d599bb84dba54c8b813"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_0c2bbe113f634d599bb84dba54c8b813", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/0c2bbe113f634d599bb84dba54c8b813"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-DeleteServersTestJSON-491340680 Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 0c2bbe113f634d599bb84dba54c8b813 Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-DeleteServersTestJSON-491340680 Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-DeleteServersTestJSON-491340680-project Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 94e162d56e4041a1bfce33f69e7c7a15 Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-DeleteServersTestJSON-491340680-project Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 827c03b5-4e1d-45de-8c72-9efe6676a22c could not be found. Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '827c03b5-4e1d-45de-8c72-9efe6676a22c'} Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 827c03b5-4e1d-45de-8c72-9efe6676a22c could not be found. Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 827c03b5-4e1d-45de-8c72-9efe6676a22c could not be found. Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:40:43.852719 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:40:43.856646 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:40:43.856646 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:40:43.856646 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:40:43.856646 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:40:43.856646 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:40:43.856646 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 827c03b5-4e1d-45de-8c72-9efe6676a22c could not be found. Sep 10 12:40:43.856646 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:40:43.856646 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bd5e5ec4-9f56-4e24-a994-5871f5ad6a41 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] Returning 404 to user: Instance 827c03b5-4e1d-45de-8c72-9efe6676a22c could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:40:43.856646 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bd5e5ec4-9f56-4e24-a994-5871f5ad6a41 tempest-DeleteServersTestJSON-491340680 tempest-DeleteServersTestJSON-491340680-project] 10.222.0.23 "GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c" status: 404 len: 111 microversion: 2.1 time: 0.030038 Sep 10 12:40:43.856646 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3430/6852] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:43 2022] GET /compute/v2.1/servers/827c03b5-4e1d-45de-8c72-9efe6676a22c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:40:52.521157 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d0b6a9a8-ef38-4119-b019-7e4dd1134f79 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-221737436", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "7911add8-5e56-45d2-a061-06fc138aa44f"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:40:52.579607 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-d0b6a9a8-ef38-4119-b019-7e4dd1134f79 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] validate_networks() for [('7911add8-5e56-45d2-a061-06fc138aa44f', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:40:52.976673 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d0b6a9a8-ef38-4119-b019-7e4dd1134f79 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:40:52.977132 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d0b6a9a8-ef38-4119-b019-7e4dd1134f79 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:40:52.977628 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d0b6a9a8-ef38-4119-b019-7e4dd1134f79 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:40:52.978038 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d0b6a9a8-ef38-4119-b019-7e4dd1134f79 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:40:52.978447 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d0b6a9a8-ef38-4119-b019-7e4dd1134f79 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:40:52.989652 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d0b6a9a8-ef38-4119-b019-7e4dd1134f79 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:52.990135 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d0b6a9a8-ef38-4119-b019-7e4dd1134f79 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:52.990614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d0b6a9a8-ef38-4119-b019-7e4dd1134f79 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:52.991476 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d0b6a9a8-ef38-4119-b019-7e4dd1134f79 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:52.992225 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d0b6a9a8-ef38-4119-b019-7e4dd1134f79 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:52.992603 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d0b6a9a8-ef38-4119-b019-7e4dd1134f79 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:53.009772 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-d0b6a9a8-ef38-4119-b019-7e4dd1134f79 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Getting quotas for project 337922328b16452eac9bd4a9709f4a08. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:40:53.014987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-d0b6a9a8-ef38-4119-b019-7e4dd1134f79 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Getting quotas for user 73f3bffe6eec41a0b3ba4138c17a5d16 and project 337922328b16452eac9bd4a9709f4a08. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:40:53.027030 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d0b6a9a8-ef38-4119-b019-7e4dd1134f79 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:40:53.029961 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d0b6a9a8-ef38-4119-b019-7e4dd1134f79 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:40:53.076639 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d0b6a9a8-ef38-4119-b019-7e4dd1134f79 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.679780 Sep 10 12:40:53.077311 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3423/6853] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:40:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:40:53.089002 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-354a74b9-2b46-485a-99bf-1b818eff2d21 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:53.089643 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-354a74b9-2b46-485a-99bf-1b818eff2d21 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:53.158826 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-354a74b9-2b46-485a-99bf-1b818eff2d21 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:53.166757 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-354a74b9-2b46-485a-99bf-1b818eff2d21 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1217 microversion: 2.1 time: 0.081939 Sep 10 12:40:53.179396 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3431/6854] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:53 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:40:54.192646 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1f2af403-0180-4afd-8169-246eb07d2627 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:54.193878 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1f2af403-0180-4afd-8169-246eb07d2627 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:54.200990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1f2af403-0180-4afd-8169-246eb07d2627 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:54.201734 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1f2af403-0180-4afd-8169-246eb07d2627 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:54.202347 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1f2af403-0180-4afd-8169-246eb07d2627 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:54.203069 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1f2af403-0180-4afd-8169-246eb07d2627 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:54.203737 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1f2af403-0180-4afd-8169-246eb07d2627 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:54.204330 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1f2af403-0180-4afd-8169-246eb07d2627 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:54.271567 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1f2af403-0180-4afd-8169-246eb07d2627 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:54.281175 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1f2af403-0180-4afd-8169-246eb07d2627 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1287 microversion: 2.1 time: 0.094577 Sep 10 12:40:54.281992 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3424/6855] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:54 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1287 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:40:55.305165 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6e980359-5fc6-4eab-a5ab-5c69402c5454 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:55.306807 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6e980359-5fc6-4eab-a5ab-5c69402c5454 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:55.313490 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=27 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:40:55.317201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e980359-5fc6-4eab-a5ab-5c69402c5454 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:55.317800 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e980359-5fc6-4eab-a5ab-5c69402c5454 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:55.318169 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e980359-5fc6-4eab-a5ab-5c69402c5454 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:55.318899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e980359-5fc6-4eab-a5ab-5c69402c5454 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:55.319403 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e980359-5fc6-4eab-a5ab-5c69402c5454 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:55.319846 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e980359-5fc6-4eab-a5ab-5c69402c5454 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:55.474854 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6e980359-5fc6-4eab-a5ab-5c69402c5454 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:55.484621 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6e980359-5fc6-4eab-a5ab-5c69402c5454 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1317 microversion: 2.1 time: 0.183184 Sep 10 12:40:55.485654 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3432/6856] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:55 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:40:55.664897 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-fb0f3f78-1fb0-4347-a646-f31d2513c459 req-fd880e1d-35b5-4413-910c-e6a74a3207f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b718ab2b-fc59-4c03-8c00-d7630efc85b5", "tag": "7b7968a7-7b08-499d-bee3-ba47cb913ee0"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:40:55.688882 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-fb0f3f78-1fb0-4347-a646-f31d2513c459 req-fd880e1d-35b5-4413-910c-e6a74a3207f1 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:55.689867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-fb0f3f78-1fb0-4347-a646-f31d2513c459 req-fd880e1d-35b5-4413-910c-e6a74a3207f1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:55.690532 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-fb0f3f78-1fb0-4347-a646-f31d2513c459 req-fd880e1d-35b5-4413-910c-e6a74a3207f1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:55.708166 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-fb0f3f78-1fb0-4347-a646-f31d2513c459 req-fd880e1d-35b5-4413-910c-e6a74a3207f1 service nova] Creating event network-changed:7b7968a7-7b08-499d-bee3-ba47cb913ee0 for instance b718ab2b-fc59-4c03-8c00-d7630efc85b5 on n-h2-856895-1 Sep 10 12:40:55.713536 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-fb0f3f78-1fb0-4347-a646-f31d2513c459 req-fd880e1d-35b5-4413-910c-e6a74a3207f1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054039 Sep 10 12:40:55.714635 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3425/6857] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:40:56.509964 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c74563e4-a17b-442a-8d52-5da91165b326 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:56.510604 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c74563e4-a17b-442a-8d52-5da91165b326 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:56.517727 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c74563e4-a17b-442a-8d52-5da91165b326 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:56.518233 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c74563e4-a17b-442a-8d52-5da91165b326 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:56.518690 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c74563e4-a17b-442a-8d52-5da91165b326 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:56.519444 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c74563e4-a17b-442a-8d52-5da91165b326 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:56.519922 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c74563e4-a17b-442a-8d52-5da91165b326 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:56.520369 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c74563e4-a17b-442a-8d52-5da91165b326 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:56.653755 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c74563e4-a17b-442a-8d52-5da91165b326 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:56.661585 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c74563e4-a17b-442a-8d52-5da91165b326 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1317 microversion: 2.1 time: 0.155644 Sep 10 12:40:56.662165 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3433/6858] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:56 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:40:57.685390 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8a94adda-1f4a-499e-bcc9-0c1139f346ca tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:57.686092 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8a94adda-1f4a-499e-bcc9-0c1139f346ca tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:57.693195 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a94adda-1f4a-499e-bcc9-0c1139f346ca tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:57.693680 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a94adda-1f4a-499e-bcc9-0c1139f346ca tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:57.694112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a94adda-1f4a-499e-bcc9-0c1139f346ca tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:57.694804 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a94adda-1f4a-499e-bcc9-0c1139f346ca tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:57.695281 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a94adda-1f4a-499e-bcc9-0c1139f346ca tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:57.695709 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8a94adda-1f4a-499e-bcc9-0c1139f346ca tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:57.826853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8a94adda-1f4a-499e-bcc9-0c1139f346ca tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:57.834560 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8a94adda-1f4a-499e-bcc9-0c1139f346ca tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1317 microversion: 2.1 time: 0.154022 Sep 10 12:40:57.835134 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3426/6859] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:57 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:40:58.857048 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-69b08b92-9d6a-4954-bb14-eec7d32bbea2 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:40:58.857739 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-69b08b92-9d6a-4954-bb14-eec7d32bbea2 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:40:58.864355 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-69b08b92-9d6a-4954-bb14-eec7d32bbea2 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:58.864858 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-69b08b92-9d6a-4954-bb14-eec7d32bbea2 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:58.865319 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-69b08b92-9d6a-4954-bb14-eec7d32bbea2 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:58.866039 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-69b08b92-9d6a-4954-bb14-eec7d32bbea2 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:40:58.866521 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-69b08b92-9d6a-4954-bb14-eec7d32bbea2 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:40:58.866968 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-69b08b92-9d6a-4954-bb14-eec7d32bbea2 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:40:59.005897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-69b08b92-9d6a-4954-bb14-eec7d32bbea2 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:40:59.014617 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-69b08b92-9d6a-4954-bb14-eec7d32bbea2 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1317 microversion: 2.1 time: 0.161537 Sep 10 12:40:59.015214 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3434/6860] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:40:58 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:00.038280 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0a912650-7888-4485-9176-2f11d00ed21d tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:00.039017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0a912650-7888-4485-9176-2f11d00ed21d tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:00.046548 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a912650-7888-4485-9176-2f11d00ed21d tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:00.047034 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a912650-7888-4485-9176-2f11d00ed21d tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:00.047513 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a912650-7888-4485-9176-2f11d00ed21d tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:00.048217 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a912650-7888-4485-9176-2f11d00ed21d tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:00.048675 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a912650-7888-4485-9176-2f11d00ed21d tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:00.049105 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0a912650-7888-4485-9176-2f11d00ed21d tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:00.179961 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0a912650-7888-4485-9176-2f11d00ed21d tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:00.188905 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0a912650-7888-4485-9176-2f11d00ed21d tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1317 microversion: 2.1 time: 0.154882 Sep 10 12:41:00.189481 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3427/6861] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:00 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:00.965516 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-6becd2b7-0a38-4c94-b716-f48b5b470e04 req-50cc1ad7-ee91-42a2-b5d6-76a64de971de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b718ab2b-fc59-4c03-8c00-d7630efc85b5", "name": "network-vif-plugged", "status": "completed", "tag": "7b7968a7-7b08-499d-bee3-ba47cb913ee0"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:41:00.978829 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6becd2b7-0a38-4c94-b716-f48b5b470e04 req-50cc1ad7-ee91-42a2-b5d6-76a64de971de service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:00.979625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6becd2b7-0a38-4c94-b716-f48b5b470e04 req-50cc1ad7-ee91-42a2-b5d6-76a64de971de service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:00.980789 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6becd2b7-0a38-4c94-b716-f48b5b470e04 req-50cc1ad7-ee91-42a2-b5d6-76a64de971de service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:00.997067 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-6becd2b7-0a38-4c94-b716-f48b5b470e04 req-50cc1ad7-ee91-42a2-b5d6-76a64de971de service nova] Creating event network-vif-plugged:7b7968a7-7b08-499d-bee3-ba47cb913ee0 for instance b718ab2b-fc59-4c03-8c00-d7630efc85b5 on n-h2-856895-1 Sep 10 12:41:01.003844 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-6becd2b7-0a38-4c94-b716-f48b5b470e04 req-50cc1ad7-ee91-42a2-b5d6-76a64de971de service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045450 Sep 10 12:41:01.006277 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3435/6862] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:41:01.213241 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d4748b30-8feb-4e7f-a640-18b2247cc053 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:01.213865 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d4748b30-8feb-4e7f-a640-18b2247cc053 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:01.221267 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d4748b30-8feb-4e7f-a640-18b2247cc053 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:01.221748 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d4748b30-8feb-4e7f-a640-18b2247cc053 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:01.222182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d4748b30-8feb-4e7f-a640-18b2247cc053 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:01.222875 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d4748b30-8feb-4e7f-a640-18b2247cc053 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:01.223356 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d4748b30-8feb-4e7f-a640-18b2247cc053 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:01.223784 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d4748b30-8feb-4e7f-a640-18b2247cc053 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:01.360117 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d4748b30-8feb-4e7f-a640-18b2247cc053 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:01.367783 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d4748b30-8feb-4e7f-a640-18b2247cc053 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1317 microversion: 2.1 time: 0.158498 Sep 10 12:41:01.368421 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3428/6863] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:01 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:02.393032 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e53a564f-a0f6-41d7-934d-32a08ec6070b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:02.393687 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e53a564f-a0f6-41d7-934d-32a08ec6070b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:02.399863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e53a564f-a0f6-41d7-934d-32a08ec6070b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:02.400359 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e53a564f-a0f6-41d7-934d-32a08ec6070b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:02.400817 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e53a564f-a0f6-41d7-934d-32a08ec6070b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:02.401512 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e53a564f-a0f6-41d7-934d-32a08ec6070b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:02.401981 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e53a564f-a0f6-41d7-934d-32a08ec6070b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:02.403068 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e53a564f-a0f6-41d7-934d-32a08ec6070b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:02.533416 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e53a564f-a0f6-41d7-934d-32a08ec6070b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:02.541459 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e53a564f-a0f6-41d7-934d-32a08ec6070b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1507 microversion: 2.1 time: 0.153499 Sep 10 12:41:02.551210 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3436/6864] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:02 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:02.567771 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8914b11f-abd0-4721-8a19-66eb0a3b6bdc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:02.568398 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8914b11f-abd0-4721-8a19-66eb0a3b6bdc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:02.576786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8914b11f-abd0-4721-8a19-66eb0a3b6bdc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:02.577284 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8914b11f-abd0-4721-8a19-66eb0a3b6bdc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:02.577719 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8914b11f-abd0-4721-8a19-66eb0a3b6bdc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:02.578424 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8914b11f-abd0-4721-8a19-66eb0a3b6bdc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:02.578873 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8914b11f-abd0-4721-8a19-66eb0a3b6bdc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:02.579323 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8914b11f-abd0-4721-8a19-66eb0a3b6bdc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:02.718371 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8914b11f-abd0-4721-8a19-66eb0a3b6bdc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:02.726035 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8914b11f-abd0-4721-8a19-66eb0a3b6bdc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1507 microversion: 2.1 time: 0.162162 Sep 10 12:41:02.726683 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3429/6865] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:02 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:02.749681 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a7e44ff3-ce6a-4cf2-bc8c-a7eb5a02434a tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:41:02.752088 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a7e44ff3-ce6a-4cf2-bc8c-a7eb5a02434a tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:02.757983 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a7e44ff3-ce6a-4cf2-bc8c-a7eb5a02434a tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:02.758480 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a7e44ff3-ce6a-4cf2-bc8c-a7eb5a02434a tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:02.758928 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a7e44ff3-ce6a-4cf2-bc8c-a7eb5a02434a tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:02.759647 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a7e44ff3-ce6a-4cf2-bc8c-a7eb5a02434a tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:02.760108 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a7e44ff3-ce6a-4cf2-bc8c-a7eb5a02434a tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:02.760543 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a7e44ff3-ce6a-4cf2-bc8c-a7eb5a02434a tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:02.825509 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a7e44ff3-ce6a-4cf2-bc8c-a7eb5a02434a tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "PUT /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1079 microversion: 2.1 time: 0.080349 Sep 10 12:41:02.826141 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3437/6866] 10.222.0.23 () {60 vars in 1256 bytes} [Sat Sep 10 12:41:02 2022] PUT /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1079 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:02.844687 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-554d86c6-002b-4944-936f-0c7b03d93f44 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:02.845298 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-554d86c6-002b-4944-936f-0c7b03d93f44 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:02.851212 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-554d86c6-002b-4944-936f-0c7b03d93f44 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:02.851691 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-554d86c6-002b-4944-936f-0c7b03d93f44 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:02.852122 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-554d86c6-002b-4944-936f-0c7b03d93f44 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:02.852800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-554d86c6-002b-4944-936f-0c7b03d93f44 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:02.853251 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-554d86c6-002b-4944-936f-0c7b03d93f44 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:02.853674 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-554d86c6-002b-4944-936f-0c7b03d93f44 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:02.988042 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-554d86c6-002b-4944-936f-0c7b03d93f44 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:02.997488 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-554d86c6-002b-4944-936f-0c7b03d93f44 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1505 microversion: 2.1 time: 0.156569 Sep 10 12:41:02.998085 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3430/6867] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:02 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:03.019485 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b79baa3a-90ce-4ca7-a905-70381f50d619 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:03.020197 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b79baa3a-90ce-4ca7-a905-70381f50d619 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:03.026381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b79baa3a-90ce-4ca7-a905-70381f50d619 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:03.026879 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b79baa3a-90ce-4ca7-a905-70381f50d619 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:03.027511 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b79baa3a-90ce-4ca7-a905-70381f50d619 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:03.028218 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b79baa3a-90ce-4ca7-a905-70381f50d619 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:03.028691 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b79baa3a-90ce-4ca7-a905-70381f50d619 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:03.029139 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b79baa3a-90ce-4ca7-a905-70381f50d619 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:03.159588 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b79baa3a-90ce-4ca7-a905-70381f50d619 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:03.163627 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:41:03.169588 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b79baa3a-90ce-4ca7-a905-70381f50d619 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1505 microversion: 2.1 time: 0.154046 Sep 10 12:41:03.170166 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3438/6868] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:03 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:03.192429 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d94c3cb1-f25f-49e0-95ca-bd6ba8a1ea4d tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:41:03.194638 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d94c3cb1-f25f-49e0-95ca-bd6ba8a1ea4d tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:03.196619 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:41:03.197477 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:41:03.203664 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d94c3cb1-f25f-49e0-95ca-bd6ba8a1ea4d tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:03.204163 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d94c3cb1-f25f-49e0-95ca-bd6ba8a1ea4d tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:03.204607 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d94c3cb1-f25f-49e0-95ca-bd6ba8a1ea4d tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:03.205306 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d94c3cb1-f25f-49e0-95ca-bd6ba8a1ea4d tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:03.205769 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d94c3cb1-f25f-49e0-95ca-bd6ba8a1ea4d tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:03.206199 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d94c3cb1-f25f-49e0-95ca-bd6ba8a1ea4d tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:03.234912 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d94c3cb1-f25f-49e0-95ca-bd6ba8a1ea4d tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:03.240346 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d94c3cb1-f25f-49e0-95ca-bd6ba8a1ea4d tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Old instance type m1.heat2, new instance type m1.heat {{(pid=128777) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 12:41:03.248393 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d94c3cb1-f25f-49e0-95ca-bd6ba8a1ea4d tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:41:03.248822 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d94c3cb1-f25f-49e0-95ca-bd6ba8a1ea4d tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:41:03.249301 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d94c3cb1-f25f-49e0-95ca-bd6ba8a1ea4d tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:41:03.249718 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d94c3cb1-f25f-49e0-95ca-bd6ba8a1ea4d tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:41:03.250137 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-d94c3cb1-f25f-49e0-95ca-bd6ba8a1ea4d tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:41:03.312583 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d94c3cb1-f25f-49e0-95ca-bd6ba8a1ea4d tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "POST /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5/action" status: 202 len: 0 microversion: 2.1 time: 0.124165 Sep 10 12:41:03.313375 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3431/6869] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:41:03 2022] POST /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 12:41:03.321793 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-af2b395b-b9f9-4bb7-9564-35a4a3314cd7 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:03.322629 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-af2b395b-b9f9-4bb7-9564-35a4a3314cd7 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:03.329708 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af2b395b-b9f9-4bb7-9564-35a4a3314cd7 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:03.330220 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af2b395b-b9f9-4bb7-9564-35a4a3314cd7 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:03.330681 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af2b395b-b9f9-4bb7-9564-35a4a3314cd7 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:03.331432 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af2b395b-b9f9-4bb7-9564-35a4a3314cd7 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:03.331909 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af2b395b-b9f9-4bb7-9564-35a4a3314cd7 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:03.332377 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af2b395b-b9f9-4bb7-9564-35a4a3314cd7 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:03.478362 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-af2b395b-b9f9-4bb7-9564-35a4a3314cd7 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:03.493030 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-af2b395b-b9f9-4bb7-9564-35a4a3314cd7 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1516 microversion: 2.1 time: 0.170198 Sep 10 12:41:03.493030 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3439/6870] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:03 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1516 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:41:04.513873 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d411e234-be10-4a66-9acc-e5b0359e6f95 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:04.515231 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d411e234-be10-4a66-9acc-e5b0359e6f95 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:04.522588 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d411e234-be10-4a66-9acc-e5b0359e6f95 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:04.523012 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d411e234-be10-4a66-9acc-e5b0359e6f95 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:04.523481 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d411e234-be10-4a66-9acc-e5b0359e6f95 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:04.524193 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d411e234-be10-4a66-9acc-e5b0359e6f95 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:04.524684 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d411e234-be10-4a66-9acc-e5b0359e6f95 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:04.525121 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d411e234-be10-4a66-9acc-e5b0359e6f95 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:04.527793 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:41:04.666531 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d411e234-be10-4a66-9acc-e5b0359e6f95 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:04.675516 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d411e234-be10-4a66-9acc-e5b0359e6f95 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1516 microversion: 2.1 time: 0.166579 Sep 10 12:41:04.676264 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3432/6871] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:04 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:05.699512 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4f05c31b-0f3c-4f78-b5a9-48df0e9f84c7 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:05.700143 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4f05c31b-0f3c-4f78-b5a9-48df0e9f84c7 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:05.707778 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f05c31b-0f3c-4f78-b5a9-48df0e9f84c7 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:05.708278 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f05c31b-0f3c-4f78-b5a9-48df0e9f84c7 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:05.708735 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f05c31b-0f3c-4f78-b5a9-48df0e9f84c7 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:05.709440 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f05c31b-0f3c-4f78-b5a9-48df0e9f84c7 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:05.709912 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f05c31b-0f3c-4f78-b5a9-48df0e9f84c7 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:05.710357 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f05c31b-0f3c-4f78-b5a9-48df0e9f84c7 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:05.843549 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4f05c31b-0f3c-4f78-b5a9-48df0e9f84c7 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:05.851277 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4f05c31b-0f3c-4f78-b5a9-48df0e9f84c7 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1521 microversion: 2.1 time: 0.155768 Sep 10 12:41:05.851853 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3440/6872] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:05 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:06.875845 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-463b14ed-a411-4118-8fbf-0c7c8e9b504f tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:06.876467 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-463b14ed-a411-4118-8fbf-0c7c8e9b504f tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:06.879249 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:41:06.884632 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-463b14ed-a411-4118-8fbf-0c7c8e9b504f tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:06.885117 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-463b14ed-a411-4118-8fbf-0c7c8e9b504f tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:06.885555 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-463b14ed-a411-4118-8fbf-0c7c8e9b504f tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:06.886276 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-463b14ed-a411-4118-8fbf-0c7c8e9b504f tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:06.886732 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-463b14ed-a411-4118-8fbf-0c7c8e9b504f tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:06.887179 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-463b14ed-a411-4118-8fbf-0c7c8e9b504f tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:07.020072 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-463b14ed-a411-4118-8fbf-0c7c8e9b504f tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:07.027716 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-463b14ed-a411-4118-8fbf-0c7c8e9b504f tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1521 microversion: 2.1 time: 0.156790 Sep 10 12:41:07.028292 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3433/6873] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:06 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:08.051556 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4154e07c-7016-4bec-9245-19a6a1f8c192 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:08.052227 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4154e07c-7016-4bec-9245-19a6a1f8c192 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:08.054922 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=36 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:41:08.060451 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4154e07c-7016-4bec-9245-19a6a1f8c192 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:08.060954 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4154e07c-7016-4bec-9245-19a6a1f8c192 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:08.061430 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4154e07c-7016-4bec-9245-19a6a1f8c192 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:08.062132 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4154e07c-7016-4bec-9245-19a6a1f8c192 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:08.062607 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4154e07c-7016-4bec-9245-19a6a1f8c192 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:08.063055 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4154e07c-7016-4bec-9245-19a6a1f8c192 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:08.192807 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4154e07c-7016-4bec-9245-19a6a1f8c192 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:08.201171 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4154e07c-7016-4bec-9245-19a6a1f8c192 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1521 microversion: 2.1 time: 0.152933 Sep 10 12:41:08.202038 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3441/6874] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:08 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:09.225824 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-97b95a28-f378-4da0-9969-55f141390df8 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:09.226439 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-97b95a28-f378-4da0-9969-55f141390df8 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:09.233463 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-97b95a28-f378-4da0-9969-55f141390df8 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:09.233946 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-97b95a28-f378-4da0-9969-55f141390df8 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:09.234379 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-97b95a28-f378-4da0-9969-55f141390df8 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:09.235097 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-97b95a28-f378-4da0-9969-55f141390df8 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:09.235577 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-97b95a28-f378-4da0-9969-55f141390df8 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:09.236005 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-97b95a28-f378-4da0-9969-55f141390df8 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:09.371582 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-97b95a28-f378-4da0-9969-55f141390df8 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:09.379976 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-97b95a28-f378-4da0-9969-55f141390df8 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1521 microversion: 2.1 time: 0.158036 Sep 10 12:41:09.380544 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3434/6875] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:09 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:10.404769 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a0b6dbae-0cd6-4768-b379-1c325e664ab9 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:10.405317 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a0b6dbae-0cd6-4768-b379-1c325e664ab9 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:10.412274 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a0b6dbae-0cd6-4768-b379-1c325e664ab9 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:10.412773 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a0b6dbae-0cd6-4768-b379-1c325e664ab9 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:10.413229 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a0b6dbae-0cd6-4768-b379-1c325e664ab9 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:10.413938 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a0b6dbae-0cd6-4768-b379-1c325e664ab9 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:10.414408 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a0b6dbae-0cd6-4768-b379-1c325e664ab9 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:10.414851 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a0b6dbae-0cd6-4768-b379-1c325e664ab9 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:10.544775 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a0b6dbae-0cd6-4768-b379-1c325e664ab9 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:10.552529 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a0b6dbae-0cd6-4768-b379-1c325e664ab9 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1521 microversion: 2.1 time: 0.152421 Sep 10 12:41:10.553097 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3442/6876] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:10 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:11.576525 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6a7a0e1f-ff91-4521-bccc-d7dcae7bd254 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:11.577059 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6a7a0e1f-ff91-4521-bccc-d7dcae7bd254 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:11.583866 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6a7a0e1f-ff91-4521-bccc-d7dcae7bd254 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:11.584345 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6a7a0e1f-ff91-4521-bccc-d7dcae7bd254 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:11.584782 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6a7a0e1f-ff91-4521-bccc-d7dcae7bd254 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:11.585469 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6a7a0e1f-ff91-4521-bccc-d7dcae7bd254 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:11.585928 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6a7a0e1f-ff91-4521-bccc-d7dcae7bd254 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:11.586348 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6a7a0e1f-ff91-4521-bccc-d7dcae7bd254 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:11.719667 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6a7a0e1f-ff91-4521-bccc-d7dcae7bd254 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:11.727489 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6a7a0e1f-ff91-4521-bccc-d7dcae7bd254 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1521 microversion: 2.1 time: 0.155977 Sep 10 12:41:11.728066 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3435/6877] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:11 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:12.751154 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-687e0ba8-8fdf-4ee5-a126-75e766f2ee30 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:12.751812 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-687e0ba8-8fdf-4ee5-a126-75e766f2ee30 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:12.758713 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-687e0ba8-8fdf-4ee5-a126-75e766f2ee30 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:12.759242 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-687e0ba8-8fdf-4ee5-a126-75e766f2ee30 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:12.759704 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-687e0ba8-8fdf-4ee5-a126-75e766f2ee30 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:12.760412 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-687e0ba8-8fdf-4ee5-a126-75e766f2ee30 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:12.760882 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-687e0ba8-8fdf-4ee5-a126-75e766f2ee30 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:12.761323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-687e0ba8-8fdf-4ee5-a126-75e766f2ee30 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:12.895091 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-687e0ba8-8fdf-4ee5-a126-75e766f2ee30 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:12.902784 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-687e0ba8-8fdf-4ee5-a126-75e766f2ee30 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1521 microversion: 2.1 time: 0.155760 Sep 10 12:41:12.903445 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3443/6878] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:12 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:13.926199 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6a7141e4-65cc-4eb2-ac60-678287f96781 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:13.926822 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6a7141e4-65cc-4eb2-ac60-678287f96781 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:13.933823 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6a7141e4-65cc-4eb2-ac60-678287f96781 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:13.934311 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6a7141e4-65cc-4eb2-ac60-678287f96781 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:13.935297 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6a7141e4-65cc-4eb2-ac60-678287f96781 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:13.935976 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6a7141e4-65cc-4eb2-ac60-678287f96781 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:13.936433 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6a7141e4-65cc-4eb2-ac60-678287f96781 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:13.936863 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6a7141e4-65cc-4eb2-ac60-678287f96781 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:14.067914 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6a7141e4-65cc-4eb2-ac60-678287f96781 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:14.076318 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6a7141e4-65cc-4eb2-ac60-678287f96781 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1521 microversion: 2.1 time: 0.154007 Sep 10 12:41:14.076895 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3436/6879] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:13 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:41:15.100170 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a2c56b75-051f-49dc-9f27-f4722e4e4927 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:15.100831 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a2c56b75-051f-49dc-9f27-f4722e4e4927 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:15.108035 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2c56b75-051f-49dc-9f27-f4722e4e4927 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:15.108535 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2c56b75-051f-49dc-9f27-f4722e4e4927 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:15.108984 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2c56b75-051f-49dc-9f27-f4722e4e4927 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:15.109690 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2c56b75-051f-49dc-9f27-f4722e4e4927 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:15.110160 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2c56b75-051f-49dc-9f27-f4722e4e4927 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:15.110602 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2c56b75-051f-49dc-9f27-f4722e4e4927 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:15.246338 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a2c56b75-051f-49dc-9f27-f4722e4e4927 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:15.254642 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a2c56b75-051f-49dc-9f27-f4722e4e4927 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1521 microversion: 2.1 time: 0.158940 Sep 10 12:41:15.255225 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3444/6880] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:15 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:16.277128 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-eeb12bb9-b67a-4d43-a936-f306f5697fd0 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:16.277749 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-eeb12bb9-b67a-4d43-a936-f306f5697fd0 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:16.284725 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eeb12bb9-b67a-4d43-a936-f306f5697fd0 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:16.285211 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eeb12bb9-b67a-4d43-a936-f306f5697fd0 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:16.285650 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eeb12bb9-b67a-4d43-a936-f306f5697fd0 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:16.286339 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eeb12bb9-b67a-4d43-a936-f306f5697fd0 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:16.286795 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eeb12bb9-b67a-4d43-a936-f306f5697fd0 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:16.287244 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eeb12bb9-b67a-4d43-a936-f306f5697fd0 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:16.415630 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-eeb12bb9-b67a-4d43-a936-f306f5697fd0 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:16.424079 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-eeb12bb9-b67a-4d43-a936-f306f5697fd0 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1521 microversion: 2.1 time: 0.150845 Sep 10 12:41:16.424653 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3437/6881] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:16 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:17.448087 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-151c6911-ccc4-44b8-9337-6b257a778643 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:17.448647 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-151c6911-ccc4-44b8-9337-6b257a778643 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:17.456162 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-151c6911-ccc4-44b8-9337-6b257a778643 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:17.456676 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-151c6911-ccc4-44b8-9337-6b257a778643 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:17.457117 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-151c6911-ccc4-44b8-9337-6b257a778643 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:17.457819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-151c6911-ccc4-44b8-9337-6b257a778643 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:17.458289 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-151c6911-ccc4-44b8-9337-6b257a778643 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:17.458732 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-151c6911-ccc4-44b8-9337-6b257a778643 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:17.591243 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-151c6911-ccc4-44b8-9337-6b257a778643 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:17.598989 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-151c6911-ccc4-44b8-9337-6b257a778643 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1521 microversion: 2.1 time: 0.154874 Sep 10 12:41:17.599607 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3445/6882] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:17 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:18.622797 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9bfab457-3531-4abc-88a8-f05838d5e0ad tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:18.623362 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9bfab457-3531-4abc-88a8-f05838d5e0ad tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:18.629663 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9bfab457-3531-4abc-88a8-f05838d5e0ad tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:18.630166 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9bfab457-3531-4abc-88a8-f05838d5e0ad tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:18.630615 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9bfab457-3531-4abc-88a8-f05838d5e0ad tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:18.631325 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9bfab457-3531-4abc-88a8-f05838d5e0ad tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:18.631779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9bfab457-3531-4abc-88a8-f05838d5e0ad tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:18.632207 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9bfab457-3531-4abc-88a8-f05838d5e0ad tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:18.762607 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9bfab457-3531-4abc-88a8-f05838d5e0ad tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:18.770879 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9bfab457-3531-4abc-88a8-f05838d5e0ad tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1521 microversion: 2.1 time: 0.152725 Sep 10 12:41:18.771488 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3438/6883] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:18 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:19.795448 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7fa39ac6-8059-4040-82bc-aa11954c6d97 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:19.796257 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7fa39ac6-8059-4040-82bc-aa11954c6d97 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:19.805355 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7fa39ac6-8059-4040-82bc-aa11954c6d97 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:19.805857 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7fa39ac6-8059-4040-82bc-aa11954c6d97 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:19.806311 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7fa39ac6-8059-4040-82bc-aa11954c6d97 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:19.807344 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7fa39ac6-8059-4040-82bc-aa11954c6d97 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:19.807798 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7fa39ac6-8059-4040-82bc-aa11954c6d97 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:19.808242 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7fa39ac6-8059-4040-82bc-aa11954c6d97 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:19.944036 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7fa39ac6-8059-4040-82bc-aa11954c6d97 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:19.952380 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7fa39ac6-8059-4040-82bc-aa11954c6d97 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1521 microversion: 2.1 time: 0.161942 Sep 10 12:41:19.952954 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3446/6884] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:19 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:20.977050 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-370f2c8a-a3e9-465f-bcc0-361d248cec2f tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:20.977575 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-370f2c8a-a3e9-465f-bcc0-361d248cec2f tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:20.984810 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-370f2c8a-a3e9-465f-bcc0-361d248cec2f tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:20.985299 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-370f2c8a-a3e9-465f-bcc0-361d248cec2f tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:20.985742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-370f2c8a-a3e9-465f-bcc0-361d248cec2f tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:20.986438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-370f2c8a-a3e9-465f-bcc0-361d248cec2f tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:20.986903 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-370f2c8a-a3e9-465f-bcc0-361d248cec2f tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:20.987365 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-370f2c8a-a3e9-465f-bcc0-361d248cec2f tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:21.125731 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-370f2c8a-a3e9-465f-bcc0-361d248cec2f tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:21.133902 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-370f2c8a-a3e9-465f-bcc0-361d248cec2f tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1521 microversion: 2.1 time: 0.160782 Sep 10 12:41:21.134775 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3439/6885] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:20 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:22.158472 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-068936e3-d2a2-4687-ab81-d03246f4840c tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:22.159105 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-068936e3-d2a2-4687-ab81-d03246f4840c tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:22.167190 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-068936e3-d2a2-4687-ab81-d03246f4840c tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:22.167704 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-068936e3-d2a2-4687-ab81-d03246f4840c tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:22.168159 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-068936e3-d2a2-4687-ab81-d03246f4840c tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:22.168873 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-068936e3-d2a2-4687-ab81-d03246f4840c tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:22.170000 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-068936e3-d2a2-4687-ab81-d03246f4840c tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:22.170448 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-068936e3-d2a2-4687-ab81-d03246f4840c tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:22.301362 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-068936e3-d2a2-4687-ab81-d03246f4840c tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:22.309113 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-068936e3-d2a2-4687-ab81-d03246f4840c tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1521 microversion: 2.1 time: 0.154588 Sep 10 12:41:22.309713 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3447/6886] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:22 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:23.332492 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7d644ac6-50f0-42be-808b-436ea4f85be5 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:23.333163 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7d644ac6-50f0-42be-808b-436ea4f85be5 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:23.339938 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d644ac6-50f0-42be-808b-436ea4f85be5 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:23.340420 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d644ac6-50f0-42be-808b-436ea4f85be5 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:23.340865 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d644ac6-50f0-42be-808b-436ea4f85be5 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:23.341559 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d644ac6-50f0-42be-808b-436ea4f85be5 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:23.342010 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d644ac6-50f0-42be-808b-436ea4f85be5 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:23.342438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d644ac6-50f0-42be-808b-436ea4f85be5 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:23.476555 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7d644ac6-50f0-42be-808b-436ea4f85be5 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:23.484808 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7d644ac6-50f0-42be-808b-436ea4f85be5 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1521 microversion: 2.1 time: 0.156246 Sep 10 12:41:23.485390 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3440/6887] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:23 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:24.509053 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-668870d9-b922-4b2f-a7a3-7a078460bd48 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:24.509632 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-668870d9-b922-4b2f-a7a3-7a078460bd48 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:24.516571 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-668870d9-b922-4b2f-a7a3-7a078460bd48 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:24.517074 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-668870d9-b922-4b2f-a7a3-7a078460bd48 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:24.517529 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-668870d9-b922-4b2f-a7a3-7a078460bd48 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:24.518242 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-668870d9-b922-4b2f-a7a3-7a078460bd48 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:24.518716 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-668870d9-b922-4b2f-a7a3-7a078460bd48 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:24.519175 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-668870d9-b922-4b2f-a7a3-7a078460bd48 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:24.537751 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:41:24.651705 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-668870d9-b922-4b2f-a7a3-7a078460bd48 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:24.660393 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-668870d9-b922-4b2f-a7a3-7a078460bd48 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1521 microversion: 2.1 time: 0.155362 Sep 10 12:41:24.660962 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3448/6888] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:24 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:25.683520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c1b18591-e6b1-4685-ba8c-e7b17e2f3a8e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:25.684156 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c1b18591-e6b1-4685-ba8c-e7b17e2f3a8e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:25.691662 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1b18591-e6b1-4685-ba8c-e7b17e2f3a8e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:25.692150 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1b18591-e6b1-4685-ba8c-e7b17e2f3a8e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:25.692586 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1b18591-e6b1-4685-ba8c-e7b17e2f3a8e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:25.693280 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1b18591-e6b1-4685-ba8c-e7b17e2f3a8e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:25.693742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1b18591-e6b1-4685-ba8c-e7b17e2f3a8e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:25.694172 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1b18591-e6b1-4685-ba8c-e7b17e2f3a8e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:25.827071 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c1b18591-e6b1-4685-ba8c-e7b17e2f3a8e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:25.834786 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c1b18591-e6b1-4685-ba8c-e7b17e2f3a8e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1521 microversion: 2.1 time: 0.155149 Sep 10 12:41:25.835385 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3441/6889] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:25 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:26.858780 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ded0e324-4848-4986-9445-bb7fe71f5bb4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:26.859434 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ded0e324-4848-4986-9445-bb7fe71f5bb4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:26.866370 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ded0e324-4848-4986-9445-bb7fe71f5bb4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:26.866867 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ded0e324-4848-4986-9445-bb7fe71f5bb4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:26.867353 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ded0e324-4848-4986-9445-bb7fe71f5bb4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:26.868058 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ded0e324-4848-4986-9445-bb7fe71f5bb4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:26.868532 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ded0e324-4848-4986-9445-bb7fe71f5bb4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:26.868973 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ded0e324-4848-4986-9445-bb7fe71f5bb4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:27.002926 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ded0e324-4848-4986-9445-bb7fe71f5bb4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:27.010761 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ded0e324-4848-4986-9445-bb7fe71f5bb4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1521 microversion: 2.1 time: 0.156445 Sep 10 12:41:27.011374 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3449/6890] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:26 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:28.034543 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-dcae2ce4-c964-4965-b056-67b842499aa9 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:28.035180 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-dcae2ce4-c964-4965-b056-67b842499aa9 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:28.041989 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dcae2ce4-c964-4965-b056-67b842499aa9 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:28.042475 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dcae2ce4-c964-4965-b056-67b842499aa9 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:28.042913 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dcae2ce4-c964-4965-b056-67b842499aa9 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:28.043644 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dcae2ce4-c964-4965-b056-67b842499aa9 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:28.044106 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dcae2ce4-c964-4965-b056-67b842499aa9 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:28.044534 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dcae2ce4-c964-4965-b056-67b842499aa9 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:28.174416 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-dcae2ce4-c964-4965-b056-67b842499aa9 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:28.182093 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-dcae2ce4-c964-4965-b056-67b842499aa9 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1521 microversion: 2.1 time: 0.152057 Sep 10 12:41:28.182679 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3442/6891] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:28 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:29.205964 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-32bb806f-2350-4e5f-85a7-82667f51dee9 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:29.206594 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-32bb806f-2350-4e5f-85a7-82667f51dee9 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:29.213274 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-32bb806f-2350-4e5f-85a7-82667f51dee9 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:29.213768 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-32bb806f-2350-4e5f-85a7-82667f51dee9 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:29.214218 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-32bb806f-2350-4e5f-85a7-82667f51dee9 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:29.214919 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-32bb806f-2350-4e5f-85a7-82667f51dee9 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:29.215413 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-32bb806f-2350-4e5f-85a7-82667f51dee9 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:29.215853 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-32bb806f-2350-4e5f-85a7-82667f51dee9 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:29.347749 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-32bb806f-2350-4e5f-85a7-82667f51dee9 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:29.355854 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-32bb806f-2350-4e5f-85a7-82667f51dee9 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1521 microversion: 2.1 time: 0.153970 Sep 10 12:41:29.356432 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3450/6892] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:29 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:30.379471 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-876f162a-0a91-46de-9bba-e9657fc4ed9a tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:30.380103 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-876f162a-0a91-46de-9bba-e9657fc4ed9a tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:30.386989 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-876f162a-0a91-46de-9bba-e9657fc4ed9a tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:30.387453 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-876f162a-0a91-46de-9bba-e9657fc4ed9a tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:30.387890 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-876f162a-0a91-46de-9bba-e9657fc4ed9a tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:30.388581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-876f162a-0a91-46de-9bba-e9657fc4ed9a tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:30.389039 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-876f162a-0a91-46de-9bba-e9657fc4ed9a tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:30.389466 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-876f162a-0a91-46de-9bba-e9657fc4ed9a tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:30.518853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-876f162a-0a91-46de-9bba-e9657fc4ed9a tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:30.526578 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-876f162a-0a91-46de-9bba-e9657fc4ed9a tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1521 microversion: 2.1 time: 0.151034 Sep 10 12:41:30.527185 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3443/6893] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:30 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:31.551595 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a11f6aa1-d76a-4adc-a71a-1055e0481b20 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:31.552150 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a11f6aa1-d76a-4adc-a71a-1055e0481b20 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:31.558174 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a11f6aa1-d76a-4adc-a71a-1055e0481b20 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:31.558674 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a11f6aa1-d76a-4adc-a71a-1055e0481b20 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:31.559130 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a11f6aa1-d76a-4adc-a71a-1055e0481b20 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:31.559861 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a11f6aa1-d76a-4adc-a71a-1055e0481b20 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:31.560335 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a11f6aa1-d76a-4adc-a71a-1055e0481b20 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:31.560781 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a11f6aa1-d76a-4adc-a71a-1055e0481b20 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:31.693503 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a11f6aa1-d76a-4adc-a71a-1055e0481b20 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:31.701220 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a11f6aa1-d76a-4adc-a71a-1055e0481b20 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1521 microversion: 2.1 time: 0.154602 Sep 10 12:41:31.701793 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3451/6894] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:31 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:32.518982 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-0b5837b4-f996-4295-ad0f-9d1cb44875d9 req-252c542f-07b3-45a6-8f0e-5b6121ad5c71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b718ab2b-fc59-4c03-8c00-d7630efc85b5", "name": "network-vif-unplugged", "status": "completed", "tag": "7b7968a7-7b08-499d-bee3-ba47cb913ee0"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:41:32.529708 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0b5837b4-f996-4295-ad0f-9d1cb44875d9 req-252c542f-07b3-45a6-8f0e-5b6121ad5c71 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:32.530193 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0b5837b4-f996-4295-ad0f-9d1cb44875d9 req-252c542f-07b3-45a6-8f0e-5b6121ad5c71 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:32.530628 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0b5837b4-f996-4295-ad0f-9d1cb44875d9 req-252c542f-07b3-45a6-8f0e-5b6121ad5c71 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:32.543219 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-0b5837b4-f996-4295-ad0f-9d1cb44875d9 req-252c542f-07b3-45a6-8f0e-5b6121ad5c71 service nova] Creating event network-vif-unplugged:7b7968a7-7b08-499d-bee3-ba47cb913ee0 for instance b718ab2b-fc59-4c03-8c00-d7630efc85b5 on n-h1-856895-1 Sep 10 12:41:32.549621 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [req-0b5837b4-f996-4295-ad0f-9d1cb44875d9 req-252c542f-07b3-45a6-8f0e-5b6121ad5c71 service nova] Instance b718ab2b-fc59-4c03-8c00-d7630efc85b5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856895-1', 'n-h1-856895-1'} {{(pid=128777) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 12:41:32.564505 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-0b5837b4-f996-4295-ad0f-9d1cb44875d9 req-252c542f-07b3-45a6-8f0e-5b6121ad5c71 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049367 Sep 10 12:41:32.565123 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3444/6895] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:41:32.725346 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2953b539-0adc-403d-b093-f64e5cfb71de tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:32.726070 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2953b539-0adc-403d-b093-f64e5cfb71de tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:32.733012 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2953b539-0adc-403d-b093-f64e5cfb71de tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:32.733530 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2953b539-0adc-403d-b093-f64e5cfb71de tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:32.734083 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2953b539-0adc-403d-b093-f64e5cfb71de tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:32.734975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2953b539-0adc-403d-b093-f64e5cfb71de tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:32.735492 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2953b539-0adc-403d-b093-f64e5cfb71de tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:32.735940 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2953b539-0adc-403d-b093-f64e5cfb71de tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:32.873400 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2953b539-0adc-403d-b093-f64e5cfb71de tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:32.882244 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2953b539-0adc-403d-b093-f64e5cfb71de tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1520 microversion: 2.1 time: 0.160815 Sep 10 12:41:32.883419 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3452/6896] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:32 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:33.907597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-75b7bd9d-7fdc-4052-96ba-4bcfb15cb7f8 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:33.908341 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-75b7bd9d-7fdc-4052-96ba-4bcfb15cb7f8 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:33.914530 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-75b7bd9d-7fdc-4052-96ba-4bcfb15cb7f8 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:33.915017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-75b7bd9d-7fdc-4052-96ba-4bcfb15cb7f8 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:33.915487 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-75b7bd9d-7fdc-4052-96ba-4bcfb15cb7f8 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:33.916181 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-75b7bd9d-7fdc-4052-96ba-4bcfb15cb7f8 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:33.916640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-75b7bd9d-7fdc-4052-96ba-4bcfb15cb7f8 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:33.917071 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-75b7bd9d-7fdc-4052-96ba-4bcfb15cb7f8 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:34.050154 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-75b7bd9d-7fdc-4052-96ba-4bcfb15cb7f8 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:34.057758 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-75b7bd9d-7fdc-4052-96ba-4bcfb15cb7f8 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1518 microversion: 2.1 time: 0.155939 Sep 10 12:41:34.058328 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3445/6897] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:33 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:34.588056 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-bb8bc71c-988c-40aa-bd7c-1b80cc37d3d0 req-33d69f80-9462-478f-9ce4-799ed13aea30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b718ab2b-fc59-4c03-8c00-d7630efc85b5", "tag": "7b7968a7-7b08-499d-bee3-ba47cb913ee0"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:41:34.598330 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-bb8bc71c-988c-40aa-bd7c-1b80cc37d3d0 req-33d69f80-9462-478f-9ce4-799ed13aea30 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:34.598820 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-bb8bc71c-988c-40aa-bd7c-1b80cc37d3d0 req-33d69f80-9462-478f-9ce4-799ed13aea30 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:34.599297 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-bb8bc71c-988c-40aa-bd7c-1b80cc37d3d0 req-33d69f80-9462-478f-9ce4-799ed13aea30 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:34.610658 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-bb8bc71c-988c-40aa-bd7c-1b80cc37d3d0 req-33d69f80-9462-478f-9ce4-799ed13aea30 service nova] Creating event network-changed:7b7968a7-7b08-499d-bee3-ba47cb913ee0 for instance b718ab2b-fc59-4c03-8c00-d7630efc85b5 on n-h1-856895-1 Sep 10 12:41:34.615950 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [req-bb8bc71c-988c-40aa-bd7c-1b80cc37d3d0 req-33d69f80-9462-478f-9ce4-799ed13aea30 service nova] Instance b718ab2b-fc59-4c03-8c00-d7630efc85b5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856895-1', 'n-h1-856895-1'} {{(pid=128776) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 12:41:34.627578 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-bb8bc71c-988c-40aa-bd7c-1b80cc37d3d0 req-33d69f80-9462-478f-9ce4-799ed13aea30 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043203 Sep 10 12:41:34.628163 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3453/6898] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:41:35.081980 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5ced22ef-0b7b-43b9-9443-ed6c42d53de4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:35.082587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5ced22ef-0b7b-43b9-9443-ed6c42d53de4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:35.089504 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ced22ef-0b7b-43b9-9443-ed6c42d53de4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:35.089987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ced22ef-0b7b-43b9-9443-ed6c42d53de4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:35.090520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ced22ef-0b7b-43b9-9443-ed6c42d53de4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:35.091322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ced22ef-0b7b-43b9-9443-ed6c42d53de4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:35.091774 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ced22ef-0b7b-43b9-9443-ed6c42d53de4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:35.092205 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ced22ef-0b7b-43b9-9443-ed6c42d53de4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:35.097569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=82 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:41:35.226392 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5ced22ef-0b7b-43b9-9443-ed6c42d53de4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:35.234152 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5ced22ef-0b7b-43b9-9443-ed6c42d53de4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1518 microversion: 2.1 time: 0.156544 Sep 10 12:41:35.234729 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3446/6899] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:35 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:36.261164 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e2809146-9285-4607-9de3-3721edeff8bc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:36.261809 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e2809146-9285-4607-9de3-3721edeff8bc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:36.269319 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e2809146-9285-4607-9de3-3721edeff8bc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:36.269881 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e2809146-9285-4607-9de3-3721edeff8bc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:36.271111 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e2809146-9285-4607-9de3-3721edeff8bc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:36.272284 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e2809146-9285-4607-9de3-3721edeff8bc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:36.272755 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e2809146-9285-4607-9de3-3721edeff8bc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:36.273200 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e2809146-9285-4607-9de3-3721edeff8bc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:36.415923 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e2809146-9285-4607-9de3-3721edeff8bc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:36.424788 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e2809146-9285-4607-9de3-3721edeff8bc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1518 microversion: 2.1 time: 0.170748 Sep 10 12:41:36.425352 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3454/6900] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:36 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1518 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:37.448888 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5542cf8c-7632-4607-84dc-76d8f4b2f0bf tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:37.449430 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5542cf8c-7632-4607-84dc-76d8f4b2f0bf tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:37.452218 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=28 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:41:37.458210 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5542cf8c-7632-4607-84dc-76d8f4b2f0bf tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:37.458690 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5542cf8c-7632-4607-84dc-76d8f4b2f0bf tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:37.459121 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5542cf8c-7632-4607-84dc-76d8f4b2f0bf tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:37.459832 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5542cf8c-7632-4607-84dc-76d8f4b2f0bf tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:37.460283 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5542cf8c-7632-4607-84dc-76d8f4b2f0bf tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:37.460706 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5542cf8c-7632-4607-84dc-76d8f4b2f0bf tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:37.597408 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5542cf8c-7632-4607-84dc-76d8f4b2f0bf tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:37.605074 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5542cf8c-7632-4607-84dc-76d8f4b2f0bf tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1515 microversion: 2.1 time: 0.160171 Sep 10 12:41:37.605666 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3447/6901] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:37 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:37.635231 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e0b8afbf-0915-4856-b516-d513fb177f12 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:41:37.635771 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e0b8afbf-0915-4856-b516-d513fb177f12 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:37.643028 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e0b8afbf-0915-4856-b516-d513fb177f12 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:37.643549 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e0b8afbf-0915-4856-b516-d513fb177f12 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:37.643995 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e0b8afbf-0915-4856-b516-d513fb177f12 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:37.644686 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e0b8afbf-0915-4856-b516-d513fb177f12 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:37.645200 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e0b8afbf-0915-4856-b516-d513fb177f12 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:37.645635 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e0b8afbf-0915-4856-b516-d513fb177f12 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:37.705606 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e0b8afbf-0915-4856-b516-d513fb177f12 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "POST /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5/action" status: 204 len: 0 microversion: 2.1 time: 0.074068 Sep 10 12:41:37.706175 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3455/6902] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:41:37 2022] POST /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:41:37.714502 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-87095a01-b78e-4942-908d-62bcb318dee3 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:37.715143 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-87095a01-b78e-4942-908d-62bcb318dee3 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:37.722582 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87095a01-b78e-4942-908d-62bcb318dee3 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:37.723106 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87095a01-b78e-4942-908d-62bcb318dee3 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:37.723551 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87095a01-b78e-4942-908d-62bcb318dee3 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:37.724246 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87095a01-b78e-4942-908d-62bcb318dee3 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:37.724739 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87095a01-b78e-4942-908d-62bcb318dee3 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:37.725143 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87095a01-b78e-4942-908d-62bcb318dee3 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:37.860073 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-87095a01-b78e-4942-908d-62bcb318dee3 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:37.867892 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-87095a01-b78e-4942-908d-62bcb318dee3 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1515 microversion: 2.1 time: 0.157362 Sep 10 12:41:37.868481 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3448/6903] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:37 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:38.845878 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-02672266-3672-4cba-9471-54f50bf66c44 req-0235fcec-1d0c-4e70-9a22-2c10dc359207 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b718ab2b-fc59-4c03-8c00-d7630efc85b5", "name": "network-vif-plugged", "status": "completed", "tag": "7b7968a7-7b08-499d-bee3-ba47cb913ee0"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:41:38.852365 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=30 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:41:38.857506 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-02672266-3672-4cba-9471-54f50bf66c44 req-0235fcec-1d0c-4e70-9a22-2c10dc359207 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:38.858006 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-02672266-3672-4cba-9471-54f50bf66c44 req-0235fcec-1d0c-4e70-9a22-2c10dc359207 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:38.858458 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-02672266-3672-4cba-9471-54f50bf66c44 req-0235fcec-1d0c-4e70-9a22-2c10dc359207 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:38.870869 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-02672266-3672-4cba-9471-54f50bf66c44 req-0235fcec-1d0c-4e70-9a22-2c10dc359207 service nova] Creating event network-vif-plugged:7b7968a7-7b08-499d-bee3-ba47cb913ee0 for instance b718ab2b-fc59-4c03-8c00-d7630efc85b5 on n-h1-856895-1 Sep 10 12:41:38.876741 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-02672266-3672-4cba-9471-54f50bf66c44 req-0235fcec-1d0c-4e70-9a22-2c10dc359207 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036566 Sep 10 12:41:38.877354 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3456/6904] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:41:38.893425 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1e2f626d-5d7a-4d0c-8023-332d91adaddc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:38.894532 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1e2f626d-5d7a-4d0c-8023-332d91adaddc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:38.900843 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1e2f626d-5d7a-4d0c-8023-332d91adaddc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:38.901267 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1e2f626d-5d7a-4d0c-8023-332d91adaddc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:38.901909 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1e2f626d-5d7a-4d0c-8023-332d91adaddc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:38.902869 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1e2f626d-5d7a-4d0c-8023-332d91adaddc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:38.903607 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1e2f626d-5d7a-4d0c-8023-332d91adaddc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:38.904064 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1e2f626d-5d7a-4d0c-8023-332d91adaddc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:39.045950 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1e2f626d-5d7a-4d0c-8023-332d91adaddc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:39.054693 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1e2f626d-5d7a-4d0c-8023-332d91adaddc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1507 microversion: 2.1 time: 0.166569 Sep 10 12:41:39.055288 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3449/6905] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:38 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:39.077394 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-421c53c4-4b91-475b-a6a9-e5eb547e91c2 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:39.078134 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-421c53c4-4b91-475b-a6a9-e5eb547e91c2 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:39.084278 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-421c53c4-4b91-475b-a6a9-e5eb547e91c2 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:39.084777 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-421c53c4-4b91-475b-a6a9-e5eb547e91c2 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:39.085233 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-421c53c4-4b91-475b-a6a9-e5eb547e91c2 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:39.085941 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-421c53c4-4b91-475b-a6a9-e5eb547e91c2 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:39.086412 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-421c53c4-4b91-475b-a6a9-e5eb547e91c2 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:39.086859 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-421c53c4-4b91-475b-a6a9-e5eb547e91c2 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:39.219023 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-421c53c4-4b91-475b-a6a9-e5eb547e91c2 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:39.226700 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-421c53c4-4b91-475b-a6a9-e5eb547e91c2 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1507 microversion: 2.1 time: 0.153521 Sep 10 12:41:39.227294 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3457/6906] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:39 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:39.253606 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-69fe883d-bdc8-4216-b385-4dd4391f718b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Action: 'create', calling method: .version_select at 0x7f4071b609d0>, body: {"keypair": {"name": "tempest-keypair-1654345477", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCW0vHp+ISjbZQN4JL/XkBRI0WTKyGZPb1poCiUpBMoBVb7PcZDeCO/LCsdpCEv6/d61YTpWDkCP6zj3UgwVSAmsk2GmJHD61l4XJul68vY1d7VmpKQvtOibzgGPZYmdg=="}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:41:39.269096 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-69fe883d-bdc8-4216-b385-4dd4391f718b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Getting quotas for project 337922328b16452eac9bd4a9709f4a08. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:41:39.274080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-69fe883d-bdc8-4216-b385-4dd4391f718b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Getting quotas for user 73f3bffe6eec41a0b3ba4138c17a5d16 and project 337922328b16452eac9bd4a9709f4a08. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:41:39.302856 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-69fe883d-bdc8-4216-b385-4dd4391f718b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054008 Sep 10 12:41:39.303524 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3450/6907] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 12:41:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:41:40.489585 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-662c5533-fa9d-4500-a8f1-8d8ea3dda7f5 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:40.490254 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-662c5533-fa9d-4500-a8f1-8d8ea3dda7f5 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:40.497425 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-662c5533-fa9d-4500-a8f1-8d8ea3dda7f5 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:40.497929 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-662c5533-fa9d-4500-a8f1-8d8ea3dda7f5 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:40.498387 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-662c5533-fa9d-4500-a8f1-8d8ea3dda7f5 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:40.499100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-662c5533-fa9d-4500-a8f1-8d8ea3dda7f5 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:40.500112 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-662c5533-fa9d-4500-a8f1-8d8ea3dda7f5 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:40.500561 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-662c5533-fa9d-4500-a8f1-8d8ea3dda7f5 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:40.633804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-662c5533-fa9d-4500-a8f1-8d8ea3dda7f5 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:40.642337 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-662c5533-fa9d-4500-a8f1-8d8ea3dda7f5 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 200 len: 1507 microversion: 2.1 time: 0.156744 Sep 10 12:41:40.642910 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3458/6908] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:40 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:41:40.665321 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c7e7a199-1e49-4fbd-97ef-27eb23113a96 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:40.665850 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c7e7a199-1e49-4fbd-97ef-27eb23113a96 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:40.672736 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7e7a199-1e49-4fbd-97ef-27eb23113a96 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:40.673216 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7e7a199-1e49-4fbd-97ef-27eb23113a96 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:40.673655 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7e7a199-1e49-4fbd-97ef-27eb23113a96 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:40.674344 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7e7a199-1e49-4fbd-97ef-27eb23113a96 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:40.674800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7e7a199-1e49-4fbd-97ef-27eb23113a96 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:40.675250 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7e7a199-1e49-4fbd-97ef-27eb23113a96 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:40.699744 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c7e7a199-1e49-4fbd-97ef-27eb23113a96 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:41:40.775763 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c7e7a199-1e49-4fbd-97ef-27eb23113a96 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 204 len: 0 microversion: 2.1 time: 0.115062 Sep 10 12:41:40.776368 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3451/6909] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:41:40 2022] DELETE /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:41:40.830645 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-123a0b17-bdd8-407d-8bfa-8ec4e86081a1 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1343179776", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "7911add8-5e56-45d2-a061-06fc138aa44f"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:41:40.884450 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-123a0b17-bdd8-407d-8bfa-8ec4e86081a1 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] validate_networks() for [('7911add8-5e56-45d2-a061-06fc138aa44f', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:41:41.258346 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-123a0b17-bdd8-407d-8bfa-8ec4e86081a1 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:41:41.258789 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-123a0b17-bdd8-407d-8bfa-8ec4e86081a1 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:41:41.259327 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-123a0b17-bdd8-407d-8bfa-8ec4e86081a1 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:41:41.259760 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-123a0b17-bdd8-407d-8bfa-8ec4e86081a1 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:41:41.260195 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-123a0b17-bdd8-407d-8bfa-8ec4e86081a1 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:41:41.269178 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-123a0b17-bdd8-407d-8bfa-8ec4e86081a1 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:41.269671 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-123a0b17-bdd8-407d-8bfa-8ec4e86081a1 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:41.270122 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-123a0b17-bdd8-407d-8bfa-8ec4e86081a1 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:41.270868 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-123a0b17-bdd8-407d-8bfa-8ec4e86081a1 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:41.271373 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-123a0b17-bdd8-407d-8bfa-8ec4e86081a1 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:41.271818 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-123a0b17-bdd8-407d-8bfa-8ec4e86081a1 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:41.289190 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-123a0b17-bdd8-407d-8bfa-8ec4e86081a1 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Getting quotas for project 337922328b16452eac9bd4a9709f4a08. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:41:41.294599 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-123a0b17-bdd8-407d-8bfa-8ec4e86081a1 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Getting quotas for user 73f3bffe6eec41a0b3ba4138c17a5d16 and project 337922328b16452eac9bd4a9709f4a08. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:41:41.307539 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-123a0b17-bdd8-407d-8bfa-8ec4e86081a1 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:41:41.309861 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-123a0b17-bdd8-407d-8bfa-8ec4e86081a1 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:41:41.354147 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-123a0b17-bdd8-407d-8bfa-8ec4e86081a1 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.528022 Sep 10 12:41:41.354881 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3459/6910] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:41:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:41:41.367582 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-80711ecc-8b16-4a83-a6b6-c55ddd0f0c6a tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:41.368302 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-80711ecc-8b16-4a83-a6b6-c55ddd0f0c6a tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:41.422877 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-80711ecc-8b16-4a83-a6b6-c55ddd0f0c6a tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:41.430111 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-80711ecc-8b16-4a83-a6b6-c55ddd0f0c6a tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1218 microversion: 2.1 time: 0.066855 Sep 10 12:41:41.430704 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3452/6911] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:41 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:42.454206 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b3a4cd2a-792f-48c5-87d4-a0af5f8a78d4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:42.454844 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b3a4cd2a-792f-48c5-87d4-a0af5f8a78d4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:42.461696 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b3a4cd2a-792f-48c5-87d4-a0af5f8a78d4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:42.462202 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b3a4cd2a-792f-48c5-87d4-a0af5f8a78d4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:42.462688 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b3a4cd2a-792f-48c5-87d4-a0af5f8a78d4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:42.463461 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b3a4cd2a-792f-48c5-87d4-a0af5f8a78d4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:42.463936 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b3a4cd2a-792f-48c5-87d4-a0af5f8a78d4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:42.464385 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b3a4cd2a-792f-48c5-87d4-a0af5f8a78d4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:42.525885 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b3a4cd2a-792f-48c5-87d4-a0af5f8a78d4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:42.533658 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b3a4cd2a-792f-48c5-87d4-a0af5f8a78d4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1270 microversion: 2.1 time: 0.084303 Sep 10 12:41:42.534226 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3460/6912] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:42 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1270 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:43.067940 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-8cfab9e0-240a-44bf-b32d-55153d03c0de req-2dbb28f4-87dc-4c80-966e-6f82eb892ef7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b718ab2b-fc59-4c03-8c00-d7630efc85b5", "name": "network-vif-deleted", "tag": "7b7968a7-7b08-499d-bee3-ba47cb913ee0"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:41:43.081033 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8cfab9e0-240a-44bf-b32d-55153d03c0de req-2dbb28f4-87dc-4c80-966e-6f82eb892ef7 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:43.081513 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8cfab9e0-240a-44bf-b32d-55153d03c0de req-2dbb28f4-87dc-4c80-966e-6f82eb892ef7 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:43.081953 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8cfab9e0-240a-44bf-b32d-55153d03c0de req-2dbb28f4-87dc-4c80-966e-6f82eb892ef7 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:43.103811 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-8cfab9e0-240a-44bf-b32d-55153d03c0de req-2dbb28f4-87dc-4c80-966e-6f82eb892ef7 service nova] Creating event network-vif-deleted:7b7968a7-7b08-499d-bee3-ba47cb913ee0 for instance b718ab2b-fc59-4c03-8c00-d7630efc85b5 on n-h1-856895-1 Sep 10 12:41:43.111384 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-8cfab9e0-240a-44bf-b32d-55153d03c0de req-2dbb28f4-87dc-4c80-966e-6f82eb892ef7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047084 Sep 10 12:41:43.114577 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3453/6913] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:41:43.557827 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-285f139e-cf04-4dea-a792-cd7543ba7119 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:43.558813 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-285f139e-cf04-4dea-a792-cd7543ba7119 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:43.565848 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-285f139e-cf04-4dea-a792-cd7543ba7119 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:43.566425 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-285f139e-cf04-4dea-a792-cd7543ba7119 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:43.566948 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-285f139e-cf04-4dea-a792-cd7543ba7119 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:43.568157 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-285f139e-cf04-4dea-a792-cd7543ba7119 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:43.568737 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-285f139e-cf04-4dea-a792-cd7543ba7119 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:43.569245 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-285f139e-cf04-4dea-a792-cd7543ba7119 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:43.639217 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-285f139e-cf04-4dea-a792-cd7543ba7119 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:43.647552 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-285f139e-cf04-4dea-a792-cd7543ba7119 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1276 microversion: 2.1 time: 0.093986 Sep 10 12:41:43.651881 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3461/6914] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:43 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1276 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:44.456068 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-2cbbe2d9-1f00-4671-9d52-a97aab40471c req-83b89266-777b-4a6b-97e7-d7f6045badd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8379fe0-cb24-4cae-825e-e028dd5ad001", "tag": "bae37c88-793c-49c8-a9bf-b9941fbfb095"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:41:44.466789 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-2cbbe2d9-1f00-4671-9d52-a97aab40471c req-83b89266-777b-4a6b-97e7-d7f6045badd8 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:44.467288 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-2cbbe2d9-1f00-4671-9d52-a97aab40471c req-83b89266-777b-4a6b-97e7-d7f6045badd8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:44.467717 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-2cbbe2d9-1f00-4671-9d52-a97aab40471c req-83b89266-777b-4a6b-97e7-d7f6045badd8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:44.478640 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-2cbbe2d9-1f00-4671-9d52-a97aab40471c req-83b89266-777b-4a6b-97e7-d7f6045badd8 service nova] Creating event network-changed:bae37c88-793c-49c8-a9bf-b9941fbfb095 for instance d8379fe0-cb24-4cae-825e-e028dd5ad001 on n-h1-856895-1 Sep 10 12:41:44.483399 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-2cbbe2d9-1f00-4671-9d52-a97aab40471c req-83b89266-777b-4a6b-97e7-d7f6045badd8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035531 Sep 10 12:41:44.484883 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3454/6915] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:41:44.672456 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-89076a42-2e68-45ea-aa30-2d23a05c81f4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:44.673160 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-89076a42-2e68-45ea-aa30-2d23a05c81f4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:44.680108 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89076a42-2e68-45ea-aa30-2d23a05c81f4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:44.680618 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89076a42-2e68-45ea-aa30-2d23a05c81f4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:44.681103 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89076a42-2e68-45ea-aa30-2d23a05c81f4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:44.681884 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89076a42-2e68-45ea-aa30-2d23a05c81f4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:44.682340 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89076a42-2e68-45ea-aa30-2d23a05c81f4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:44.683508 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-89076a42-2e68-45ea-aa30-2d23a05c81f4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:44.902052 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-89076a42-2e68-45ea-aa30-2d23a05c81f4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:44.909954 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-89076a42-2e68-45ea-aa30-2d23a05c81f4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1318 microversion: 2.1 time: 0.241956 Sep 10 12:41:44.910536 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3462/6916] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:44 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:45.933811 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c5efaef3-8f97-4e11-8a56-0c20e0b17bad tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:45.934518 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c5efaef3-8f97-4e11-8a56-0c20e0b17bad tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:45.941207 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c5efaef3-8f97-4e11-8a56-0c20e0b17bad tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:45.941694 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c5efaef3-8f97-4e11-8a56-0c20e0b17bad tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:45.942134 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c5efaef3-8f97-4e11-8a56-0c20e0b17bad tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:45.942826 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c5efaef3-8f97-4e11-8a56-0c20e0b17bad tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:45.943315 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c5efaef3-8f97-4e11-8a56-0c20e0b17bad tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:45.943749 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c5efaef3-8f97-4e11-8a56-0c20e0b17bad tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:46.080150 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c5efaef3-8f97-4e11-8a56-0c20e0b17bad tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:46.087792 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c5efaef3-8f97-4e11-8a56-0c20e0b17bad tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1318 microversion: 2.1 time: 0.159143 Sep 10 12:41:46.088370 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3455/6917] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:45 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:47.111527 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-51a0d359-dd35-4ebd-9601-ac0365d78d1e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:47.112288 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-51a0d359-dd35-4ebd-9601-ac0365d78d1e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:47.119698 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-51a0d359-dd35-4ebd-9601-ac0365d78d1e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:47.120288 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-51a0d359-dd35-4ebd-9601-ac0365d78d1e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:47.120875 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-51a0d359-dd35-4ebd-9601-ac0365d78d1e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:47.121664 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-51a0d359-dd35-4ebd-9601-ac0365d78d1e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:47.122209 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-51a0d359-dd35-4ebd-9601-ac0365d78d1e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:47.122720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-51a0d359-dd35-4ebd-9601-ac0365d78d1e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:47.359657 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-51a0d359-dd35-4ebd-9601-ac0365d78d1e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:47.367433 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-51a0d359-dd35-4ebd-9601-ac0365d78d1e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1318 microversion: 2.1 time: 0.260423 Sep 10 12:41:47.368014 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3463/6918] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:47 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:48.390355 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-66ec4246-02e8-464e-bcb2-ee731379a8fc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:48.390961 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-66ec4246-02e8-464e-bcb2-ee731379a8fc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:48.397737 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66ec4246-02e8-464e-bcb2-ee731379a8fc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:48.398216 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66ec4246-02e8-464e-bcb2-ee731379a8fc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:48.398649 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66ec4246-02e8-464e-bcb2-ee731379a8fc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:48.399360 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66ec4246-02e8-464e-bcb2-ee731379a8fc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:48.399813 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66ec4246-02e8-464e-bcb2-ee731379a8fc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:48.400238 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66ec4246-02e8-464e-bcb2-ee731379a8fc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:48.533751 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-66ec4246-02e8-464e-bcb2-ee731379a8fc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:48.541397 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-66ec4246-02e8-464e-bcb2-ee731379a8fc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1318 microversion: 2.1 time: 0.154984 Sep 10 12:41:48.541975 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3456/6919] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:48 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:48.852638 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-87a05976-c761-40b3-8222-bf52b3d1f652 req-028acccd-70ce-4cd0-9c08-8b769480a8b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8379fe0-cb24-4cae-825e-e028dd5ad001", "name": "network-vif-plugged", "status": "completed", "tag": "bae37c88-793c-49c8-a9bf-b9941fbfb095"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:41:48.865178 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-87a05976-c761-40b3-8222-bf52b3d1f652 req-028acccd-70ce-4cd0-9c08-8b769480a8b0 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:48.865677 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-87a05976-c761-40b3-8222-bf52b3d1f652 req-028acccd-70ce-4cd0-9c08-8b769480a8b0 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:48.866134 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-87a05976-c761-40b3-8222-bf52b3d1f652 req-028acccd-70ce-4cd0-9c08-8b769480a8b0 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:48.878109 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-87a05976-c761-40b3-8222-bf52b3d1f652 req-028acccd-70ce-4cd0-9c08-8b769480a8b0 service nova] Creating event network-vif-plugged:bae37c88-793c-49c8-a9bf-b9941fbfb095 for instance d8379fe0-cb24-4cae-825e-e028dd5ad001 on n-h1-856895-1 Sep 10 12:41:48.883449 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-87a05976-c761-40b3-8222-bf52b3d1f652 req-028acccd-70ce-4cd0-9c08-8b769480a8b0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034595 Sep 10 12:41:48.884050 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3464/6920] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:41:49.564567 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-853ac17f-b29d-44de-b9fa-6ef7241ba882 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:49.565102 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-853ac17f-b29d-44de-b9fa-6ef7241ba882 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:49.571886 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-853ac17f-b29d-44de-b9fa-6ef7241ba882 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:49.572363 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-853ac17f-b29d-44de-b9fa-6ef7241ba882 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:49.572796 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-853ac17f-b29d-44de-b9fa-6ef7241ba882 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:49.573480 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-853ac17f-b29d-44de-b9fa-6ef7241ba882 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:49.573930 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-853ac17f-b29d-44de-b9fa-6ef7241ba882 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:49.574352 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-853ac17f-b29d-44de-b9fa-6ef7241ba882 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:49.703628 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-853ac17f-b29d-44de-b9fa-6ef7241ba882 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:49.711182 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-853ac17f-b29d-44de-b9fa-6ef7241ba882 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1318 microversion: 2.1 time: 0.150656 Sep 10 12:41:49.711760 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3457/6921] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:49 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:50.736196 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-819d8a26-f1d4-4bb4-9069-a55da5a8219b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:50.736910 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-819d8a26-f1d4-4bb4-9069-a55da5a8219b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:50.744016 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-819d8a26-f1d4-4bb4-9069-a55da5a8219b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:50.744775 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-819d8a26-f1d4-4bb4-9069-a55da5a8219b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:50.745223 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-819d8a26-f1d4-4bb4-9069-a55da5a8219b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:50.745919 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-819d8a26-f1d4-4bb4-9069-a55da5a8219b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:50.746383 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-819d8a26-f1d4-4bb4-9069-a55da5a8219b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:50.746819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-819d8a26-f1d4-4bb4-9069-a55da5a8219b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:50.880330 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-819d8a26-f1d4-4bb4-9069-a55da5a8219b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:50.888132 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-819d8a26-f1d4-4bb4-9069-a55da5a8219b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1509 microversion: 2.1 time: 0.157281 Sep 10 12:41:50.888712 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3465/6922] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:50 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:50.910734 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ceb6ffef-2fe8-4e52-959d-dc4d65191abc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:50.911444 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ceb6ffef-2fe8-4e52-959d-dc4d65191abc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:50.918196 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ceb6ffef-2fe8-4e52-959d-dc4d65191abc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:50.918676 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ceb6ffef-2fe8-4e52-959d-dc4d65191abc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:50.919116 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ceb6ffef-2fe8-4e52-959d-dc4d65191abc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:50.919851 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ceb6ffef-2fe8-4e52-959d-dc4d65191abc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:50.920309 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ceb6ffef-2fe8-4e52-959d-dc4d65191abc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:50.920738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ceb6ffef-2fe8-4e52-959d-dc4d65191abc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:51.048914 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ceb6ffef-2fe8-4e52-959d-dc4d65191abc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:51.056611 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ceb6ffef-2fe8-4e52-959d-dc4d65191abc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1509 microversion: 2.1 time: 0.149780 Sep 10 12:41:51.057184 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3458/6923] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:50 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:51.079489 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6aadbd49-3921-48c6-bef8-8847ec69c732 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:41:51.081834 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6aadbd49-3921-48c6-bef8-8847ec69c732 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:51.087797 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6aadbd49-3921-48c6-bef8-8847ec69c732 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:51.088301 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6aadbd49-3921-48c6-bef8-8847ec69c732 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:51.088767 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6aadbd49-3921-48c6-bef8-8847ec69c732 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:51.089478 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6aadbd49-3921-48c6-bef8-8847ec69c732 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:51.089949 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6aadbd49-3921-48c6-bef8-8847ec69c732 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:51.090392 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6aadbd49-3921-48c6-bef8-8847ec69c732 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:51.106711 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:41:51.121363 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6aadbd49-3921-48c6-bef8-8847ec69c732 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:51.127925 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6aadbd49-3921-48c6-bef8-8847ec69c732 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Old instance type m1.heat2, new instance type m1.heat {{(pid=128776) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 12:41:51.135021 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-6aadbd49-3921-48c6-bef8-8847ec69c732 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:41:51.135564 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-6aadbd49-3921-48c6-bef8-8847ec69c732 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:41:51.136396 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-6aadbd49-3921-48c6-bef8-8847ec69c732 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:41:51.136503 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-6aadbd49-3921-48c6-bef8-8847ec69c732 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:41:51.136909 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-6aadbd49-3921-48c6-bef8-8847ec69c732 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:41:51.201037 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6aadbd49-3921-48c6-bef8-8847ec69c732 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "POST /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001/action" status: 202 len: 0 microversion: 2.1 time: 0.125547 Sep 10 12:41:51.201831 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3466/6924] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:41:51 2022] POST /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:41:51.210727 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d904f3ff-a3e1-42b0-94ca-c1edfc4b018e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:51.211582 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d904f3ff-a3e1-42b0-94ca-c1edfc4b018e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:51.217513 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d904f3ff-a3e1-42b0-94ca-c1edfc4b018e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:51.218100 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d904f3ff-a3e1-42b0-94ca-c1edfc4b018e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:51.218587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d904f3ff-a3e1-42b0-94ca-c1edfc4b018e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:51.220011 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d904f3ff-a3e1-42b0-94ca-c1edfc4b018e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:51.220473 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d904f3ff-a3e1-42b0-94ca-c1edfc4b018e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:51.221241 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d904f3ff-a3e1-42b0-94ca-c1edfc4b018e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:51.361746 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d904f3ff-a3e1-42b0-94ca-c1edfc4b018e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:51.369977 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d904f3ff-a3e1-42b0-94ca-c1edfc4b018e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1516 microversion: 2.1 time: 0.162974 Sep 10 12:41:51.370641 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3459/6925] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:51 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:52.390465 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:41:52.392010 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:41:52.397058 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e7b1dfb7-c687-428c-9663-dcb2487fadc9 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:52.397784 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e7b1dfb7-c687-428c-9663-dcb2487fadc9 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:52.405576 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7b1dfb7-c687-428c-9663-dcb2487fadc9 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:52.406077 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7b1dfb7-c687-428c-9663-dcb2487fadc9 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:52.407402 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7b1dfb7-c687-428c-9663-dcb2487fadc9 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:52.408537 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7b1dfb7-c687-428c-9663-dcb2487fadc9 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:52.409237 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7b1dfb7-c687-428c-9663-dcb2487fadc9 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:52.409683 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7b1dfb7-c687-428c-9663-dcb2487fadc9 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:52.636537 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e7b1dfb7-c687-428c-9663-dcb2487fadc9 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:52.644990 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e7b1dfb7-c687-428c-9663-dcb2487fadc9 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1516 microversion: 2.1 time: 0.255240 Sep 10 12:41:52.645498 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3467/6926] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:52 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1516 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:53.668596 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0caebf25-5e75-4fa7-ab4d-4b4b44d4b001 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:53.669233 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0caebf25-5e75-4fa7-ab4d-4b4b44d4b001 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:53.671189 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:41:53.677549 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0caebf25-5e75-4fa7-ab4d-4b4b44d4b001 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:53.678038 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0caebf25-5e75-4fa7-ab4d-4b4b44d4b001 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:53.678509 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0caebf25-5e75-4fa7-ab4d-4b4b44d4b001 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:53.679235 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0caebf25-5e75-4fa7-ab4d-4b4b44d4b001 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:53.679700 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0caebf25-5e75-4fa7-ab4d-4b4b44d4b001 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:53.680134 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0caebf25-5e75-4fa7-ab4d-4b4b44d4b001 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:53.858372 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0caebf25-5e75-4fa7-ab4d-4b4b44d4b001 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:53.866924 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0caebf25-5e75-4fa7-ab4d-4b4b44d4b001 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1521 microversion: 2.1 time: 0.202233 Sep 10 12:41:53.867626 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3460/6927] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:53 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:54.891664 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-14a81b25-1e64-452a-bb30-644c33637068 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:54.892323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-14a81b25-1e64-452a-bb30-644c33637068 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:54.899169 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-14a81b25-1e64-452a-bb30-644c33637068 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:54.899685 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-14a81b25-1e64-452a-bb30-644c33637068 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:54.900132 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-14a81b25-1e64-452a-bb30-644c33637068 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:54.900830 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-14a81b25-1e64-452a-bb30-644c33637068 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:54.901291 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-14a81b25-1e64-452a-bb30-644c33637068 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:54.901726 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-14a81b25-1e64-452a-bb30-644c33637068 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:55.086863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-14a81b25-1e64-452a-bb30-644c33637068 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:55.095244 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-14a81b25-1e64-452a-bb30-644c33637068 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1521 microversion: 2.1 time: 0.206934 Sep 10 12:41:55.095819 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3468/6928] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:54 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:56.118077 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1dc59d12-c6fa-420e-afbb-ef4513173b64 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:56.118604 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1dc59d12-c6fa-420e-afbb-ef4513173b64 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:56.125899 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1dc59d12-c6fa-420e-afbb-ef4513173b64 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:56.126394 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1dc59d12-c6fa-420e-afbb-ef4513173b64 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:56.126830 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1dc59d12-c6fa-420e-afbb-ef4513173b64 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:56.127552 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1dc59d12-c6fa-420e-afbb-ef4513173b64 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:56.128006 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1dc59d12-c6fa-420e-afbb-ef4513173b64 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:56.128437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1dc59d12-c6fa-420e-afbb-ef4513173b64 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:56.263518 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1dc59d12-c6fa-420e-afbb-ef4513173b64 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:56.271418 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1dc59d12-c6fa-420e-afbb-ef4513173b64 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1521 microversion: 2.1 time: 0.157386 Sep 10 12:41:56.271995 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3461/6929] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:56 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:41:57.295435 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e8102cc2-71a3-4d87-851d-2a86a1e2c46e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:57.296065 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e8102cc2-71a3-4d87-851d-2a86a1e2c46e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:57.303142 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e8102cc2-71a3-4d87-851d-2a86a1e2c46e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:57.303656 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e8102cc2-71a3-4d87-851d-2a86a1e2c46e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:57.304104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e8102cc2-71a3-4d87-851d-2a86a1e2c46e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:57.304797 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e8102cc2-71a3-4d87-851d-2a86a1e2c46e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:57.305260 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e8102cc2-71a3-4d87-851d-2a86a1e2c46e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:57.305696 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e8102cc2-71a3-4d87-851d-2a86a1e2c46e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:57.434714 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e8102cc2-71a3-4d87-851d-2a86a1e2c46e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:57.442795 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e8102cc2-71a3-4d87-851d-2a86a1e2c46e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1521 microversion: 2.1 time: 0.151332 Sep 10 12:41:57.443400 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3469/6930] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:57 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:58.467184 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a87dc44b-6b72-4daa-909b-9dafe0a4e4cc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:58.467733 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a87dc44b-6b72-4daa-909b-9dafe0a4e4cc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:58.474639 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a87dc44b-6b72-4daa-909b-9dafe0a4e4cc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:58.475120 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a87dc44b-6b72-4daa-909b-9dafe0a4e4cc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:58.475590 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a87dc44b-6b72-4daa-909b-9dafe0a4e4cc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:58.476275 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a87dc44b-6b72-4daa-909b-9dafe0a4e4cc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:58.476729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a87dc44b-6b72-4daa-909b-9dafe0a4e4cc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:58.477154 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a87dc44b-6b72-4daa-909b-9dafe0a4e4cc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:58.613772 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a87dc44b-6b72-4daa-909b-9dafe0a4e4cc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:58.621803 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a87dc44b-6b72-4daa-909b-9dafe0a4e4cc tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1521 microversion: 2.1 time: 0.158654 Sep 10 12:41:58.622382 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3462/6931] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:58 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:41:59.646411 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7746cca3-7353-436e-8861-56d01764baa4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:41:59.647053 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7746cca3-7353-436e-8861-56d01764baa4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:41:59.653665 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7746cca3-7353-436e-8861-56d01764baa4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:59.654166 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7746cca3-7353-436e-8861-56d01764baa4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:59.654621 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7746cca3-7353-436e-8861-56d01764baa4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:59.655367 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7746cca3-7353-436e-8861-56d01764baa4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:41:59.655838 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7746cca3-7353-436e-8861-56d01764baa4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:41:59.656282 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7746cca3-7353-436e-8861-56d01764baa4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:41:59.786274 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7746cca3-7353-436e-8861-56d01764baa4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:41:59.794095 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7746cca3-7353-436e-8861-56d01764baa4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1521 microversion: 2.1 time: 0.151887 Sep 10 12:41:59.794669 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3470/6932] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:41:59 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:42:00.817540 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6181e32e-2949-497f-81b5-4b4b756d04cb tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:42:00.818151 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6181e32e-2949-497f-81b5-4b4b756d04cb tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:42:00.825334 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6181e32e-2949-497f-81b5-4b4b756d04cb tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:00.825807 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6181e32e-2949-497f-81b5-4b4b756d04cb tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:00.826266 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6181e32e-2949-497f-81b5-4b4b756d04cb tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:00.826954 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6181e32e-2949-497f-81b5-4b4b756d04cb tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:00.827429 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6181e32e-2949-497f-81b5-4b4b756d04cb tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:00.827851 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6181e32e-2949-497f-81b5-4b4b756d04cb tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:00.959679 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6181e32e-2949-497f-81b5-4b4b756d04cb tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:42:00.967432 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6181e32e-2949-497f-81b5-4b4b756d04cb tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1521 microversion: 2.1 time: 0.153804 Sep 10 12:42:00.968018 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3463/6933] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:42:00 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:42:01.991823 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6961533a-32c4-470a-8334-a4675dd417fd tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:42:01.992461 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6961533a-32c4-470a-8334-a4675dd417fd tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:42:01.999756 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6961533a-32c4-470a-8334-a4675dd417fd tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:02.000256 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6961533a-32c4-470a-8334-a4675dd417fd tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:02.001352 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6961533a-32c4-470a-8334-a4675dd417fd tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:02.002061 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6961533a-32c4-470a-8334-a4675dd417fd tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:02.002535 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6961533a-32c4-470a-8334-a4675dd417fd tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:02.002981 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6961533a-32c4-470a-8334-a4675dd417fd tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:02.131962 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6961533a-32c4-470a-8334-a4675dd417fd tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:42:02.139814 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6961533a-32c4-470a-8334-a4675dd417fd tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1521 microversion: 2.1 time: 0.151938 Sep 10 12:42:02.140396 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3471/6934] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:42:01 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:42:03.163592 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-253e6f53-9da5-41a0-8f9d-88b4eacdba46 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:42:03.164222 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-253e6f53-9da5-41a0-8f9d-88b4eacdba46 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:42:03.171016 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-253e6f53-9da5-41a0-8f9d-88b4eacdba46 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:03.171531 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-253e6f53-9da5-41a0-8f9d-88b4eacdba46 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:03.171972 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-253e6f53-9da5-41a0-8f9d-88b4eacdba46 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:03.173177 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-253e6f53-9da5-41a0-8f9d-88b4eacdba46 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:03.173630 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-253e6f53-9da5-41a0-8f9d-88b4eacdba46 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:03.174057 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-253e6f53-9da5-41a0-8f9d-88b4eacdba46 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:03.189183 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:42:03.305412 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-253e6f53-9da5-41a0-8f9d-88b4eacdba46 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:42:03.313766 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-253e6f53-9da5-41a0-8f9d-88b4eacdba46 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1521 microversion: 2.1 time: 0.153479 Sep 10 12:42:03.314354 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3464/6935] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:42:03 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:42:04.336961 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-07b72f86-0d8a-479a-9b09-07a28864f145 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:42:04.337596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-07b72f86-0d8a-479a-9b09-07a28864f145 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:42:04.344712 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-07b72f86-0d8a-479a-9b09-07a28864f145 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:04.345197 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-07b72f86-0d8a-479a-9b09-07a28864f145 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:04.345651 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-07b72f86-0d8a-479a-9b09-07a28864f145 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:04.346359 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-07b72f86-0d8a-479a-9b09-07a28864f145 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:04.346830 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-07b72f86-0d8a-479a-9b09-07a28864f145 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:04.347327 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-07b72f86-0d8a-479a-9b09-07a28864f145 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:04.485112 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-07b72f86-0d8a-479a-9b09-07a28864f145 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:42:04.492851 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-07b72f86-0d8a-479a-9b09-07a28864f145 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1521 microversion: 2.1 time: 0.159847 Sep 10 12:42:04.493428 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3472/6936] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:42:04 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:42:05.517669 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bd9fd98d-3c8a-40eb-9c9e-f55b423ebd7d tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:42:05.518230 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bd9fd98d-3c8a-40eb-9c9e-f55b423ebd7d tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:42:05.525347 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd9fd98d-3c8a-40eb-9c9e-f55b423ebd7d tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:05.525836 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd9fd98d-3c8a-40eb-9c9e-f55b423ebd7d tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:05.526288 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd9fd98d-3c8a-40eb-9c9e-f55b423ebd7d tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:05.526992 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd9fd98d-3c8a-40eb-9c9e-f55b423ebd7d tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:05.527493 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd9fd98d-3c8a-40eb-9c9e-f55b423ebd7d tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:05.527930 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bd9fd98d-3c8a-40eb-9c9e-f55b423ebd7d tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:05.657737 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bd9fd98d-3c8a-40eb-9c9e-f55b423ebd7d tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:42:05.665500 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bd9fd98d-3c8a-40eb-9c9e-f55b423ebd7d tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1521 microversion: 2.1 time: 0.152638 Sep 10 12:42:05.666096 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3465/6937] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:42:05 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:42:06.689707 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fa026bc3-3525-4484-a029-5d0efdad89a7 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:42:06.690357 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fa026bc3-3525-4484-a029-5d0efdad89a7 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:42:06.697087 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa026bc3-3525-4484-a029-5d0efdad89a7 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:06.697578 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa026bc3-3525-4484-a029-5d0efdad89a7 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:06.698026 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa026bc3-3525-4484-a029-5d0efdad89a7 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:06.698724 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa026bc3-3525-4484-a029-5d0efdad89a7 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:06.699209 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa026bc3-3525-4484-a029-5d0efdad89a7 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:06.699646 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa026bc3-3525-4484-a029-5d0efdad89a7 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:06.833688 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fa026bc3-3525-4484-a029-5d0efdad89a7 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:42:06.841421 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fa026bc3-3525-4484-a029-5d0efdad89a7 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1521 microversion: 2.1 time: 0.156321 Sep 10 12:42:06.841997 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3473/6938] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:42:06 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:42:07.864086 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f6ec02a6-2dc4-4f46-92ae-7e7c09dceb02 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:42:07.864699 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f6ec02a6-2dc4-4f46-92ae-7e7c09dceb02 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:42:07.867403 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:42:07.872833 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f6ec02a6-2dc4-4f46-92ae-7e7c09dceb02 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:07.873313 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f6ec02a6-2dc4-4f46-92ae-7e7c09dceb02 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:07.873744 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f6ec02a6-2dc4-4f46-92ae-7e7c09dceb02 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:07.874433 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f6ec02a6-2dc4-4f46-92ae-7e7c09dceb02 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:07.875080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f6ec02a6-2dc4-4f46-92ae-7e7c09dceb02 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:07.875440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f6ec02a6-2dc4-4f46-92ae-7e7c09dceb02 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:08.009314 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f6ec02a6-2dc4-4f46-92ae-7e7c09dceb02 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:42:08.017419 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f6ec02a6-2dc4-4f46-92ae-7e7c09dceb02 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1521 microversion: 2.1 time: 0.157528 Sep 10 12:42:08.017990 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3466/6939] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:42:07 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:42:09.040670 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-38efaef7-2bbe-4590-b9a2-d180f51fba8b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:42:09.041305 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-38efaef7-2bbe-4590-b9a2-d180f51fba8b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:42:09.044111 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:42:09.050750 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-38efaef7-2bbe-4590-b9a2-d180f51fba8b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:09.051290 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-38efaef7-2bbe-4590-b9a2-d180f51fba8b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:09.051782 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-38efaef7-2bbe-4590-b9a2-d180f51fba8b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:09.052497 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-38efaef7-2bbe-4590-b9a2-d180f51fba8b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:09.052972 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-38efaef7-2bbe-4590-b9a2-d180f51fba8b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:09.053419 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-38efaef7-2bbe-4590-b9a2-d180f51fba8b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:09.189707 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-38efaef7-2bbe-4590-b9a2-d180f51fba8b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:42:09.197547 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-38efaef7-2bbe-4590-b9a2-d180f51fba8b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1521 microversion: 2.1 time: 0.160847 Sep 10 12:42:09.198121 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3474/6940] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:42:09 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:42:10.221740 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-100a283e-e48e-45ee-be52-26b53ff8be71 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:42:10.222358 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-100a283e-e48e-45ee-be52-26b53ff8be71 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:42:10.229316 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-100a283e-e48e-45ee-be52-26b53ff8be71 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:10.229794 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-100a283e-e48e-45ee-be52-26b53ff8be71 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:10.230222 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-100a283e-e48e-45ee-be52-26b53ff8be71 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:10.230909 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-100a283e-e48e-45ee-be52-26b53ff8be71 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:10.231393 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-100a283e-e48e-45ee-be52-26b53ff8be71 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:10.231820 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-100a283e-e48e-45ee-be52-26b53ff8be71 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:10.361473 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-100a283e-e48e-45ee-be52-26b53ff8be71 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:42:10.369125 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-100a283e-e48e-45ee-be52-26b53ff8be71 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1521 microversion: 2.1 time: 0.151632 Sep 10 12:42:10.369957 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3467/6941] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:42:10 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:42:11.393315 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d67af648-8d02-4f77-bb98-9616338d901b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:42:11.393913 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d67af648-8d02-4f77-bb98-9616338d901b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:42:11.400713 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d67af648-8d02-4f77-bb98-9616338d901b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:11.401210 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d67af648-8d02-4f77-bb98-9616338d901b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:11.401666 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d67af648-8d02-4f77-bb98-9616338d901b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:11.402372 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d67af648-8d02-4f77-bb98-9616338d901b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:11.402841 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d67af648-8d02-4f77-bb98-9616338d901b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:11.403318 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d67af648-8d02-4f77-bb98-9616338d901b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:11.535003 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d67af648-8d02-4f77-bb98-9616338d901b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:42:11.542735 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d67af648-8d02-4f77-bb98-9616338d901b tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1521 microversion: 2.1 time: 0.154217 Sep 10 12:42:11.543339 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3475/6942] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:42:11 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:42:12.566496 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fe157430-4dc6-4a5b-9abb-dfb9520a869c tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:42:12.567048 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fe157430-4dc6-4a5b-9abb-dfb9520a869c tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:42:12.574317 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fe157430-4dc6-4a5b-9abb-dfb9520a869c tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:12.574805 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fe157430-4dc6-4a5b-9abb-dfb9520a869c tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:12.575270 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fe157430-4dc6-4a5b-9abb-dfb9520a869c tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:12.575962 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fe157430-4dc6-4a5b-9abb-dfb9520a869c tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:12.576416 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fe157430-4dc6-4a5b-9abb-dfb9520a869c tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:12.576839 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fe157430-4dc6-4a5b-9abb-dfb9520a869c tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:12.712535 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fe157430-4dc6-4a5b-9abb-dfb9520a869c tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:42:12.720598 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fe157430-4dc6-4a5b-9abb-dfb9520a869c tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1521 microversion: 2.1 time: 0.158618 Sep 10 12:42:12.721186 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3468/6943] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:42:12 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:42:13.744069 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-213d3e40-2c72-464b-859a-7a8802936755 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:42:13.744955 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-213d3e40-2c72-464b-859a-7a8802936755 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:42:13.747125 n-d-856895-1 devstack@n-api.service[128776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 12:42:13.747292 n-d-856895-1 devstack@n-api.service[128776]: Sat Sep 10 12:42:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 (ip 10.222.0.23) !!! Sep 10 12:42:13.754607 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-213d3e40-2c72-464b-859a-7a8802936755 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:13.755107 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-213d3e40-2c72-464b-859a-7a8802936755 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:13.755588 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-213d3e40-2c72-464b-859a-7a8802936755 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:13.756297 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-213d3e40-2c72-464b-859a-7a8802936755 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:13.756765 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-213d3e40-2c72-464b-859a-7a8802936755 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:13.757206 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-213d3e40-2c72-464b-859a-7a8802936755 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:13.888429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-213d3e40-2c72-464b-859a-7a8802936755 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:42:13.896674 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-213d3e40-2c72-464b-859a-7a8802936755 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1521 microversion: 2.1 time: 0.156542 Sep 10 12:42:13.897253 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3476/6944] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:42:13 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:42:14.920762 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-68402d8a-3a30-433c-8ac9-c442de334faa tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:42:14.921378 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-68402d8a-3a30-433c-8ac9-c442de334faa tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:42:14.928768 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-68402d8a-3a30-433c-8ac9-c442de334faa tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:14.929249 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-68402d8a-3a30-433c-8ac9-c442de334faa tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:14.929681 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-68402d8a-3a30-433c-8ac9-c442de334faa tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:14.930369 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-68402d8a-3a30-433c-8ac9-c442de334faa tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:14.930819 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-68402d8a-3a30-433c-8ac9-c442de334faa tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:14.931272 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-68402d8a-3a30-433c-8ac9-c442de334faa tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:15.067749 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-68402d8a-3a30-433c-8ac9-c442de334faa tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:42:15.075575 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-68402d8a-3a30-433c-8ac9-c442de334faa tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1521 microversion: 2.1 time: 0.158710 Sep 10 12:42:15.076158 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3469/6945] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:42:14 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:42:16.098796 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-efec991e-3197-41ac-9b14-a0e581558e10 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:42:16.099445 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-efec991e-3197-41ac-9b14-a0e581558e10 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:42:16.106132 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-efec991e-3197-41ac-9b14-a0e581558e10 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:16.106627 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-efec991e-3197-41ac-9b14-a0e581558e10 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:16.107076 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-efec991e-3197-41ac-9b14-a0e581558e10 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:16.107796 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-efec991e-3197-41ac-9b14-a0e581558e10 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:16.108261 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-efec991e-3197-41ac-9b14-a0e581558e10 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:16.108699 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-efec991e-3197-41ac-9b14-a0e581558e10 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:16.240464 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-efec991e-3197-41ac-9b14-a0e581558e10 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:42:16.248476 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-efec991e-3197-41ac-9b14-a0e581558e10 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1521 microversion: 2.1 time: 0.153628 Sep 10 12:42:16.249053 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3477/6946] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:42:16 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:42:17.272675 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-18794e05-e598-46c7-af6c-245aae282ed4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:42:17.273316 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-18794e05-e598-46c7-af6c-245aae282ed4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:42:17.280130 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-18794e05-e598-46c7-af6c-245aae282ed4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:17.280601 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-18794e05-e598-46c7-af6c-245aae282ed4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:17.281032 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-18794e05-e598-46c7-af6c-245aae282ed4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:17.282221 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-18794e05-e598-46c7-af6c-245aae282ed4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:17.282667 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-18794e05-e598-46c7-af6c-245aae282ed4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:17.283089 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-18794e05-e598-46c7-af6c-245aae282ed4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:17.412585 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-18794e05-e598-46c7-af6c-245aae282ed4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:42:17.420349 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-18794e05-e598-46c7-af6c-245aae282ed4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1521 microversion: 2.1 time: 0.151618 Sep 10 12:42:17.420923 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3470/6947] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:42:17 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:42:18.444377 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bec2bd3a-711c-459a-a5cf-e8180e8cf7b4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:42:18.444918 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bec2bd3a-711c-459a-a5cf-e8180e8cf7b4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:42:18.451798 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bec2bd3a-711c-459a-a5cf-e8180e8cf7b4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:18.452303 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bec2bd3a-711c-459a-a5cf-e8180e8cf7b4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:18.452760 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bec2bd3a-711c-459a-a5cf-e8180e8cf7b4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:18.453985 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bec2bd3a-711c-459a-a5cf-e8180e8cf7b4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:18.454455 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bec2bd3a-711c-459a-a5cf-e8180e8cf7b4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:18.454898 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bec2bd3a-711c-459a-a5cf-e8180e8cf7b4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:18.591185 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bec2bd3a-711c-459a-a5cf-e8180e8cf7b4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:42:18.599126 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bec2bd3a-711c-459a-a5cf-e8180e8cf7b4 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1521 microversion: 2.1 time: 0.158760 Sep 10 12:42:18.599722 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3478/6948] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:42:18 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:42:19.623248 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1721c2e9-ac4d-43e6-aa83-90b405ed6f27 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:42:19.623804 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1721c2e9-ac4d-43e6-aa83-90b405ed6f27 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:42:19.630906 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1721c2e9-ac4d-43e6-aa83-90b405ed6f27 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:19.631419 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1721c2e9-ac4d-43e6-aa83-90b405ed6f27 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:19.631861 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1721c2e9-ac4d-43e6-aa83-90b405ed6f27 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:19.632565 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1721c2e9-ac4d-43e6-aa83-90b405ed6f27 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:19.633014 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1721c2e9-ac4d-43e6-aa83-90b405ed6f27 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:19.633438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1721c2e9-ac4d-43e6-aa83-90b405ed6f27 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:19.764120 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1721c2e9-ac4d-43e6-aa83-90b405ed6f27 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:42:19.771860 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1721c2e9-ac4d-43e6-aa83-90b405ed6f27 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1521 microversion: 2.1 time: 0.153252 Sep 10 12:42:19.772441 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3471/6949] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:42:19 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:42:20.468247 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-8eed51b6-d91a-490e-99da-76830dc3cfdd req-41b63a32-dae0-46c4-9fd0-d98d43c3ff3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8379fe0-cb24-4cae-825e-e028dd5ad001", "name": "network-vif-unplugged", "status": "completed", "tag": "bae37c88-793c-49c8-a9bf-b9941fbfb095"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:42:20.479916 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-8eed51b6-d91a-490e-99da-76830dc3cfdd req-41b63a32-dae0-46c4-9fd0-d98d43c3ff3d service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:20.480416 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-8eed51b6-d91a-490e-99da-76830dc3cfdd req-41b63a32-dae0-46c4-9fd0-d98d43c3ff3d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:20.480867 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-8eed51b6-d91a-490e-99da-76830dc3cfdd req-41b63a32-dae0-46c4-9fd0-d98d43c3ff3d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:20.494305 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-8eed51b6-d91a-490e-99da-76830dc3cfdd req-41b63a32-dae0-46c4-9fd0-d98d43c3ff3d service nova] Creating event network-vif-unplugged:bae37c88-793c-49c8-a9bf-b9941fbfb095 for instance d8379fe0-cb24-4cae-825e-e028dd5ad001 on n-h2-856895-1 Sep 10 12:42:20.500656 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [req-8eed51b6-d91a-490e-99da-76830dc3cfdd req-41b63a32-dae0-46c4-9fd0-d98d43c3ff3d service nova] Instance d8379fe0-cb24-4cae-825e-e028dd5ad001 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856895-1', 'n-h1-856895-1'} {{(pid=128776) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 12:42:20.512463 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-8eed51b6-d91a-490e-99da-76830dc3cfdd req-41b63a32-dae0-46c4-9fd0-d98d43c3ff3d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048144 Sep 10 12:42:20.513247 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3479/6950] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:42:20.796691 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bb00cda2-1202-455b-9952-7596b5ea9c8c tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:42:20.798971 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bb00cda2-1202-455b-9952-7596b5ea9c8c tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:42:20.806719 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bb00cda2-1202-455b-9952-7596b5ea9c8c tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:20.807426 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bb00cda2-1202-455b-9952-7596b5ea9c8c tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:20.808040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bb00cda2-1202-455b-9952-7596b5ea9c8c tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:20.809129 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bb00cda2-1202-455b-9952-7596b5ea9c8c tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:20.809825 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bb00cda2-1202-455b-9952-7596b5ea9c8c tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:20.810391 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bb00cda2-1202-455b-9952-7596b5ea9c8c tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:20.954986 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bb00cda2-1202-455b-9952-7596b5ea9c8c tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:42:20.963403 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bb00cda2-1202-455b-9952-7596b5ea9c8c tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1520 microversion: 2.1 time: 0.170676 Sep 10 12:42:20.968558 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3472/6951] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:42:20 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:42:21.987882 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-86eee1d6-d649-4df0-9925-bf37f52bc239 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:42:21.988608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-86eee1d6-d649-4df0-9925-bf37f52bc239 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:42:21.996051 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86eee1d6-d649-4df0-9925-bf37f52bc239 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:21.996541 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86eee1d6-d649-4df0-9925-bf37f52bc239 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:21.996996 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86eee1d6-d649-4df0-9925-bf37f52bc239 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:21.997698 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86eee1d6-d649-4df0-9925-bf37f52bc239 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:21.998168 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86eee1d6-d649-4df0-9925-bf37f52bc239 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:21.998613 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-86eee1d6-d649-4df0-9925-bf37f52bc239 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:22.002738 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:42:22.132278 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-86eee1d6-d649-4df0-9925-bf37f52bc239 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:42:22.140278 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-86eee1d6-d649-4df0-9925-bf37f52bc239 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1518 microversion: 2.1 time: 0.156684 Sep 10 12:42:22.141436 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3480/6952] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:42:21 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:42:22.527851 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-e0c2a5c9-a4e1-4777-9c01-80084de6273a req-3d44f761-064a-4f83-a27e-2a2d536b4ef4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8379fe0-cb24-4cae-825e-e028dd5ad001", "tag": "bae37c88-793c-49c8-a9bf-b9941fbfb095"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:42:22.538858 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e0c2a5c9-a4e1-4777-9c01-80084de6273a req-3d44f761-064a-4f83-a27e-2a2d536b4ef4 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:22.539364 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e0c2a5c9-a4e1-4777-9c01-80084de6273a req-3d44f761-064a-4f83-a27e-2a2d536b4ef4 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:22.539789 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e0c2a5c9-a4e1-4777-9c01-80084de6273a req-3d44f761-064a-4f83-a27e-2a2d536b4ef4 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:22.551875 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-e0c2a5c9-a4e1-4777-9c01-80084de6273a req-3d44f761-064a-4f83-a27e-2a2d536b4ef4 service nova] Creating event network-changed:bae37c88-793c-49c8-a9bf-b9941fbfb095 for instance d8379fe0-cb24-4cae-825e-e028dd5ad001 on n-h2-856895-1 Sep 10 12:42:22.557214 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [req-e0c2a5c9-a4e1-4777-9c01-80084de6273a req-3d44f761-064a-4f83-a27e-2a2d536b4ef4 service nova] Instance d8379fe0-cb24-4cae-825e-e028dd5ad001 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856895-1', 'n-h1-856895-1'} {{(pid=128777) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 12:42:22.569459 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-e0c2a5c9-a4e1-4777-9c01-80084de6273a req-3d44f761-064a-4f83-a27e-2a2d536b4ef4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045729 Sep 10 12:42:22.570052 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3473/6953] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:42:23.165736 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cfcecbd0-f602-4544-80f6-f5c9d8119db8 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:42:23.166543 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cfcecbd0-f602-4544-80f6-f5c9d8119db8 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:42:23.174022 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cfcecbd0-f602-4544-80f6-f5c9d8119db8 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:23.174527 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cfcecbd0-f602-4544-80f6-f5c9d8119db8 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:23.174989 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cfcecbd0-f602-4544-80f6-f5c9d8119db8 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:23.175806 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cfcecbd0-f602-4544-80f6-f5c9d8119db8 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:23.176317 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cfcecbd0-f602-4544-80f6-f5c9d8119db8 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:23.176796 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cfcecbd0-f602-4544-80f6-f5c9d8119db8 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:23.321313 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-cfcecbd0-f602-4544-80f6-f5c9d8119db8 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:42:23.329328 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cfcecbd0-f602-4544-80f6-f5c9d8119db8 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1515 microversion: 2.1 time: 0.167473 Sep 10 12:42:23.343547 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3481/6954] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:42:23 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:42:23.353948 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6d15a3ff-09b6-4118-a8d1-a86a6375bf45 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:42:23.354581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6d15a3ff-09b6-4118-a8d1-a86a6375bf45 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:42:23.361390 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d15a3ff-09b6-4118-a8d1-a86a6375bf45 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:23.361879 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d15a3ff-09b6-4118-a8d1-a86a6375bf45 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:23.362322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d15a3ff-09b6-4118-a8d1-a86a6375bf45 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:23.363025 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d15a3ff-09b6-4118-a8d1-a86a6375bf45 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:23.363512 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d15a3ff-09b6-4118-a8d1-a86a6375bf45 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:23.363947 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6d15a3ff-09b6-4118-a8d1-a86a6375bf45 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:23.422705 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6d15a3ff-09b6-4118-a8d1-a86a6375bf45 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "POST /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001/action" status: 204 len: 0 microversion: 2.1 time: 0.072936 Sep 10 12:42:23.423404 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3474/6955] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:42:23 2022] POST /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:42:23.431610 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-293251c0-d975-44a6-85f3-dd2b456b6630 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:42:23.432248 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-293251c0-d975-44a6-85f3-dd2b456b6630 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:42:23.438809 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-293251c0-d975-44a6-85f3-dd2b456b6630 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:23.439350 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-293251c0-d975-44a6-85f3-dd2b456b6630 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:23.439793 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-293251c0-d975-44a6-85f3-dd2b456b6630 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:23.440506 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-293251c0-d975-44a6-85f3-dd2b456b6630 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:23.440970 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-293251c0-d975-44a6-85f3-dd2b456b6630 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:23.441409 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-293251c0-d975-44a6-85f3-dd2b456b6630 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:23.658982 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-293251c0-d975-44a6-85f3-dd2b456b6630 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:42:23.666791 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-293251c0-d975-44a6-85f3-dd2b456b6630 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1515 microversion: 2.1 time: 0.239111 Sep 10 12:42:23.667416 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3482/6956] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:42:23 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1515 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:42:24.691967 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f70a2ee9-704c-40af-9d3e-df1b0539d1b3 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:42:24.692677 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f70a2ee9-704c-40af-9d3e-df1b0539d1b3 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:42:24.698845 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f70a2ee9-704c-40af-9d3e-df1b0539d1b3 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:24.699375 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f70a2ee9-704c-40af-9d3e-df1b0539d1b3 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:24.699991 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f70a2ee9-704c-40af-9d3e-df1b0539d1b3 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:24.700851 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f70a2ee9-704c-40af-9d3e-df1b0539d1b3 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:24.701305 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f70a2ee9-704c-40af-9d3e-df1b0539d1b3 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:24.701733 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f70a2ee9-704c-40af-9d3e-df1b0539d1b3 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:24.836192 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f70a2ee9-704c-40af-9d3e-df1b0539d1b3 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:42:24.843959 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f70a2ee9-704c-40af-9d3e-df1b0539d1b3 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1515 microversion: 2.1 time: 0.157718 Sep 10 12:42:24.844540 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3475/6957] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:42:24 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:42:25.868000 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-81abbeab-6ea3-4a71-8525-d2f9fd63d824 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:42:25.868605 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-81abbeab-6ea3-4a71-8525-d2f9fd63d824 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:42:25.876345 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81abbeab-6ea3-4a71-8525-d2f9fd63d824 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:25.876837 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81abbeab-6ea3-4a71-8525-d2f9fd63d824 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:25.877293 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81abbeab-6ea3-4a71-8525-d2f9fd63d824 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:25.878028 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81abbeab-6ea3-4a71-8525-d2f9fd63d824 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:25.878501 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81abbeab-6ea3-4a71-8525-d2f9fd63d824 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:25.878944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81abbeab-6ea3-4a71-8525-d2f9fd63d824 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:26.009820 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-81abbeab-6ea3-4a71-8525-d2f9fd63d824 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:42:26.017616 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-81abbeab-6ea3-4a71-8525-d2f9fd63d824 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1507 microversion: 2.1 time: 0.153481 Sep 10 12:42:26.018192 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3483/6958] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:42:25 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:42:26.040399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-93d77c98-eefa-4796-b9d9-5d407a388fe3 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:42:26.041045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-93d77c98-eefa-4796-b9d9-5d407a388fe3 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:42:26.048428 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-93d77c98-eefa-4796-b9d9-5d407a388fe3 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:26.048905 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-93d77c98-eefa-4796-b9d9-5d407a388fe3 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:26.049344 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-93d77c98-eefa-4796-b9d9-5d407a388fe3 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:26.050029 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-93d77c98-eefa-4796-b9d9-5d407a388fe3 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:26.050484 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-93d77c98-eefa-4796-b9d9-5d407a388fe3 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:26.050909 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-93d77c98-eefa-4796-b9d9-5d407a388fe3 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:26.180098 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-93d77c98-eefa-4796-b9d9-5d407a388fe3 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:42:26.187842 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-93d77c98-eefa-4796-b9d9-5d407a388fe3 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1507 microversion: 2.1 time: 0.151292 Sep 10 12:42:26.188392 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3476/6959] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:42:26 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:42:26.209822 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-16374de0-e417-40f0-a852-2adc42fffd37 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:42:26.210451 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-16374de0-e417-40f0-a852-2adc42fffd37 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:42:26.216873 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16374de0-e417-40f0-a852-2adc42fffd37 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:26.217367 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16374de0-e417-40f0-a852-2adc42fffd37 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:26.217815 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16374de0-e417-40f0-a852-2adc42fffd37 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:26.219103 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16374de0-e417-40f0-a852-2adc42fffd37 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:26.219649 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16374de0-e417-40f0-a852-2adc42fffd37 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:26.220126 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16374de0-e417-40f0-a852-2adc42fffd37 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:26.347785 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-16374de0-e417-40f0-a852-2adc42fffd37 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:42:26.355821 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-16374de0-e417-40f0-a852-2adc42fffd37 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1507 microversion: 2.1 time: 0.149873 Sep 10 12:42:26.356392 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3484/6960] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:42:26 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:42:26.378534 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3c5b3e29-f1f8-4a83-ad10-157f9d89ff16 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:42:26.378970 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3c5b3e29-f1f8-4a83-ad10-157f9d89ff16 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:42:26.384849 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3c5b3e29-f1f8-4a83-ad10-157f9d89ff16 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:26.385330 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3c5b3e29-f1f8-4a83-ad10-157f9d89ff16 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:26.385765 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3c5b3e29-f1f8-4a83-ad10-157f9d89ff16 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:26.386450 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3c5b3e29-f1f8-4a83-ad10-157f9d89ff16 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:26.386906 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3c5b3e29-f1f8-4a83-ad10-157f9d89ff16 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:26.387371 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3c5b3e29-f1f8-4a83-ad10-157f9d89ff16 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:26.412521 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3c5b3e29-f1f8-4a83-ad10-157f9d89ff16 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:42:26.488706 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3c5b3e29-f1f8-4a83-ad10-157f9d89ff16 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 204 len: 0 microversion: 2.1 time: 0.113546 Sep 10 12:42:26.489457 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3477/6961] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:42:26 2022] DELETE /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:42:26.504297 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9675c702-4d66-4a8b-8209-2e7104172385 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:42:26.504834 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9675c702-4d66-4a8b-8209-2e7104172385 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:42:26.511083 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9675c702-4d66-4a8b-8209-2e7104172385 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:26.511937 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9675c702-4d66-4a8b-8209-2e7104172385 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:26.512407 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9675c702-4d66-4a8b-8209-2e7104172385 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:26.513120 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9675c702-4d66-4a8b-8209-2e7104172385 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:26.513610 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9675c702-4d66-4a8b-8209-2e7104172385 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:26.514038 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9675c702-4d66-4a8b-8209-2e7104172385 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:26.540207 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9675c702-4d66-4a8b-8209-2e7104172385 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:42:26.590818 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.compute.api [None req-9675c702-4d66-4a8b-8209-2e7104172385 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Instance is already in deleting state, ignoring this request Sep 10 12:42:26.591697 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9675c702-4d66-4a8b-8209-2e7104172385 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 204 len: 0 microversion: 2.1 time: 0.091389 Sep 10 12:42:26.592254 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3485/6962] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:42:26 2022] DELETE /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:42:26.601747 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1499d2a9-0d72-42af-803b-1fc4d83808ee tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:42:26.602484 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1499d2a9-0d72-42af-803b-1fc4d83808ee tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:42:26.608452 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1499d2a9-0d72-42af-803b-1fc4d83808ee tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:26.608934 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1499d2a9-0d72-42af-803b-1fc4d83808ee tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:26.609478 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1499d2a9-0d72-42af-803b-1fc4d83808ee tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:26.610271 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1499d2a9-0d72-42af-803b-1fc4d83808ee tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:26.610726 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1499d2a9-0d72-42af-803b-1fc4d83808ee tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:26.611156 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1499d2a9-0d72-42af-803b-1fc4d83808ee tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:26.629473 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:42:26.745278 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1499d2a9-0d72-42af-803b-1fc4d83808ee tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:42:26.753640 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1499d2a9-0d72-42af-803b-1fc4d83808ee tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1513 microversion: 2.1 time: 0.156162 Sep 10 12:42:26.754222 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3478/6963] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:42:26 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:42:27.370980 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-ab629320-7ed7-4e5c-8a5a-8c686fd5db2c req-5ee00dfe-a83b-476a-b5f1-bc1d3535bcca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8379fe0-cb24-4cae-825e-e028dd5ad001", "name": "network-vif-plugged", "status": "completed", "tag": "bae37c88-793c-49c8-a9bf-b9941fbfb095"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:42:27.381148 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ab629320-7ed7-4e5c-8a5a-8c686fd5db2c req-5ee00dfe-a83b-476a-b5f1-bc1d3535bcca service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:27.381652 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ab629320-7ed7-4e5c-8a5a-8c686fd5db2c req-5ee00dfe-a83b-476a-b5f1-bc1d3535bcca service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:27.382098 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ab629320-7ed7-4e5c-8a5a-8c686fd5db2c req-5ee00dfe-a83b-476a-b5f1-bc1d3535bcca service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:27.393336 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-ab629320-7ed7-4e5c-8a5a-8c686fd5db2c req-5ee00dfe-a83b-476a-b5f1-bc1d3535bcca service nova] Creating event network-vif-plugged:bae37c88-793c-49c8-a9bf-b9941fbfb095 for instance d8379fe0-cb24-4cae-825e-e028dd5ad001 on n-h2-856895-1 Sep 10 12:42:27.398459 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-ab629320-7ed7-4e5c-8a5a-8c686fd5db2c req-5ee00dfe-a83b-476a-b5f1-bc1d3535bcca service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090602 Sep 10 12:42:27.399093 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3486/6964] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:42:27.777941 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2fb283ac-c9f7-45a9-855d-1f4abfec80f6 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:42:27.778486 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2fb283ac-c9f7-45a9-855d-1f4abfec80f6 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:42:27.786088 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fb283ac-c9f7-45a9-855d-1f4abfec80f6 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:27.786571 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fb283ac-c9f7-45a9-855d-1f4abfec80f6 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:27.787008 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fb283ac-c9f7-45a9-855d-1f4abfec80f6 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:27.787752 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fb283ac-c9f7-45a9-855d-1f4abfec80f6 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:27.788206 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fb283ac-c9f7-45a9-855d-1f4abfec80f6 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:27.788634 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fb283ac-c9f7-45a9-855d-1f4abfec80f6 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:27.922619 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2fb283ac-c9f7-45a9-855d-1f4abfec80f6 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f3bffe6eec41a0b3ba4138c17a5d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337922328b16452eac9bd4a9709f4a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:42:27.930405 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2fb283ac-c9f7-45a9-855d-1f4abfec80f6 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 200 len: 1513 microversion: 2.1 time: 0.156469 Sep 10 12:42:27.930982 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3479/6965] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:42:27 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:42:28.255136 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-20325066-7cc4-4b8f-adac-1f0ee04bf13f req-a7f1ecce-94b4-415e-b647-4b6681b38a81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8379fe0-cb24-4cae-825e-e028dd5ad001", "name": "network-vif-deleted", "tag": "bae37c88-793c-49c8-a9bf-b9941fbfb095"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:42:28.267469 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-20325066-7cc4-4b8f-adac-1f0ee04bf13f req-a7f1ecce-94b4-415e-b647-4b6681b38a81 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:28.268100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-20325066-7cc4-4b8f-adac-1f0ee04bf13f req-a7f1ecce-94b4-415e-b647-4b6681b38a81 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:28.268629 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-20325066-7cc4-4b8f-adac-1f0ee04bf13f req-a7f1ecce-94b4-415e-b647-4b6681b38a81 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:28.282134 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-20325066-7cc4-4b8f-adac-1f0ee04bf13f req-a7f1ecce-94b4-415e-b647-4b6681b38a81 service nova] Creating event network-vif-deleted:bae37c88-793c-49c8-a9bf-b9941fbfb095 for instance d8379fe0-cb24-4cae-825e-e028dd5ad001 on n-h2-856895-1 Sep 10 12:42:28.287709 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-20325066-7cc4-4b8f-adac-1f0ee04bf13f req-a7f1ecce-94b4-415e-b647-4b6681b38a81 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037213 Sep 10 12:42:28.288625 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3487/6966] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:42:28.953757 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c1983866-e228-4c20-8c19-5a8f8090090f tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:42:28.954384 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c1983866-e228-4c20-8c19-5a8f8090090f tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: d8379fe0-cb24-4cae-825e-e028dd5ad001] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:42:28.961621 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1983866-e228-4c20-8c19-5a8f8090090f tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:28.962112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1983866-e228-4c20-8c19-5a8f8090090f tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:28.962554 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1983866-e228-4c20-8c19-5a8f8090090f tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:28.963305 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1983866-e228-4c20-8c19-5a8f8090090f tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:28.963765 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1983866-e228-4c20-8c19-5a8f8090090f tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:28.964198 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1983866-e228-4c20-8c19-5a8f8090090f tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:28.977387 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-c1983866-e228-4c20-8c19-5a8f8090090f tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] HTTP exception thrown: Instance d8379fe0-cb24-4cae-825e-e028dd5ad001 could not be found. Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c1983866-e228-4c20-8c19-5a8f8090090f tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Request method failure captured: Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 HTTP/1.1 Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHIXUMinXN5noVpYIygzeqhUpN40D9pJad4fxDNj4ZZPxh1ab4Z3N96kt7aqPeUKMwNKaIAWtLzszN8FViQl37V0Nkiy0Zg7mM_GBjP4scox2UhmpPhzXNXxyAReMf3gxiUWrAbrgqSxtBVqxp8EhcMNZo1Mn7HoUWrtHd18hFZBrtLw Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 337922328b16452eac9bd4a9709f4a08 Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2045864862 Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/337922328b16452eac9bd4a9709f4a08"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/337922328b16452eac9bd4a9709f4a08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_337922328b16452eac9bd4a9709f4a08", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/337922328b16452eac9bd4a9709f4a08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServerDiskConfigTestJSON-2045864862 Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 337922328b16452eac9bd4a9709f4a08 Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2045864862 Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServerDiskConfigTestJSON-2045864862-project Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 73f3bffe6eec41a0b3ba4138c17a5d16 Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServerDiskConfigTestJSON-2045864862-project Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance d8379fe0-cb24-4cae-825e-e028dd5ad001 could not be found. Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'd8379fe0-cb24-4cae-825e-e028dd5ad001'} Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8379fe0-cb24-4cae-825e-e028dd5ad001 could not be found. Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8379fe0-cb24-4cae-825e-e028dd5ad001 could not be found. Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:42:28.979015 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:42:28.983194 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:42:28.983194 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:42:28.983194 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:42:28.983194 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:42:28.983194 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:42:28.983194 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8379fe0-cb24-4cae-825e-e028dd5ad001 could not be found. Sep 10 12:42:28.983194 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:42:28.983194 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c1983866-e228-4c20-8c19-5a8f8090090f tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Returning 404 to user: Instance d8379fe0-cb24-4cae-825e-e028dd5ad001 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:42:28.983194 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c1983866-e228-4c20-8c19-5a8f8090090f tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001" status: 404 len: 111 microversion: 2.1 time: 0.030660 Sep 10 12:42:28.983194 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3480/6967] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:42:28 2022] GET /compute/v2.1/servers/d8379fe0-cb24-4cae-825e-e028dd5ad001 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:42:28.990815 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c03f5e37-e298-4188-915b-8243b9d2aa59 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '.version_select at 0x7f407292b280>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:42:29.015849 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c03f5e37-e298-4188-915b-8243b9d2aa59 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1654345477" status: 202 len: 0 microversion: 2.1 time: 0.029611 Sep 10 12:42:29.016627 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3488/6968] 10.222.0.23 () {58 vars in 1221 bytes} [Sat Sep 10 12:42:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1654345477 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 12:42:29.620745 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-71927680-ca80-4ae2-93b3-2a1334ff705e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:42:29.621250 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-71927680-ca80-4ae2-93b3-2a1334ff705e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:42:29.627202 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71927680-ca80-4ae2-93b3-2a1334ff705e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:29.627694 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71927680-ca80-4ae2-93b3-2a1334ff705e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:29.628140 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71927680-ca80-4ae2-93b3-2a1334ff705e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:29.628829 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71927680-ca80-4ae2-93b3-2a1334ff705e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:29.629286 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71927680-ca80-4ae2-93b3-2a1334ff705e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:29.629714 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-71927680-ca80-4ae2-93b3-2a1334ff705e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:29.643536 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-71927680-ca80-4ae2-93b3-2a1334ff705e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] HTTP exception thrown: Instance b718ab2b-fc59-4c03-8c00-d7630efc85b5 could not be found. Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-71927680-ca80-4ae2-93b3-2a1334ff705e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Request method failure captured: Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 HTTP/1.1 Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHIXUMinXN5noVpYIygzeqhUpN40D9pJad4fxDNj4ZZPxh1ab4Z3N96kt7aqPeUKMwNKaIAWtLzszN8FViQl37V0Nkiy0Zg7mM_GBjP4scox2UhmpPhzXNXxyAReMf3gxiUWrAbrgqSxtBVqxp8EhcMNZo1Mn7HoUWrtHd18hFZBrtLw Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 337922328b16452eac9bd4a9709f4a08 Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2045864862 Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/337922328b16452eac9bd4a9709f4a08"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/337922328b16452eac9bd4a9709f4a08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_337922328b16452eac9bd4a9709f4a08", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/337922328b16452eac9bd4a9709f4a08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServerDiskConfigTestJSON-2045864862 Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 337922328b16452eac9bd4a9709f4a08 Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2045864862 Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServerDiskConfigTestJSON-2045864862-project Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 73f3bffe6eec41a0b3ba4138c17a5d16 Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServerDiskConfigTestJSON-2045864862-project Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance b718ab2b-fc59-4c03-8c00-d7630efc85b5 could not be found. Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'b718ab2b-fc59-4c03-8c00-d7630efc85b5'} Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b718ab2b-fc59-4c03-8c00-d7630efc85b5 could not be found. Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:42:29.645100 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:42:29.648833 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b718ab2b-fc59-4c03-8c00-d7630efc85b5 could not be found. Sep 10 12:42:29.648833 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:42:29.648833 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:42:29.648833 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:42:29.648833 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:42:29.648833 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:42:29.648833 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:42:29.648833 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:42:29.648833 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:42:29.648833 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b718ab2b-fc59-4c03-8c00-d7630efc85b5 could not be found. Sep 10 12:42:29.648833 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:42:29.648833 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-71927680-ca80-4ae2-93b3-2a1334ff705e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Returning 404 to user: Instance b718ab2b-fc59-4c03-8c00-d7630efc85b5 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:42:29.648833 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-71927680-ca80-4ae2-93b3-2a1334ff705e tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 404 len: 111 microversion: 2.1 time: 0.029959 Sep 10 12:42:29.648833 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3481/6969] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:42:29 2022] DELETE /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:42:29.655182 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8555a0f4-837f-4ad2-831d-56ba26145e20 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:42:29.656568 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8555a0f4-837f-4ad2-831d-56ba26145e20 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] [instance: b718ab2b-fc59-4c03-8c00-d7630efc85b5] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:42:29.664225 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8555a0f4-837f-4ad2-831d-56ba26145e20 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:29.664730 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8555a0f4-837f-4ad2-831d-56ba26145e20 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:29.665187 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8555a0f4-837f-4ad2-831d-56ba26145e20 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:29.665907 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8555a0f4-837f-4ad2-831d-56ba26145e20 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:29.666381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8555a0f4-837f-4ad2-831d-56ba26145e20 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:29.666831 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8555a0f4-837f-4ad2-831d-56ba26145e20 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:29.681992 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-8555a0f4-837f-4ad2-831d-56ba26145e20 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] HTTP exception thrown: Instance b718ab2b-fc59-4c03-8c00-d7630efc85b5 could not be found. Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8555a0f4-837f-4ad2-831d-56ba26145e20 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Request method failure captured: Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 HTTP/1.1 Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHIXUMinXN5noVpYIygzeqhUpN40D9pJad4fxDNj4ZZPxh1ab4Z3N96kt7aqPeUKMwNKaIAWtLzszN8FViQl37V0Nkiy0Zg7mM_GBjP4scox2UhmpPhzXNXxyAReMf3gxiUWrAbrgqSxtBVqxp8EhcMNZo1Mn7HoUWrtHd18hFZBrtLw Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 337922328b16452eac9bd4a9709f4a08 Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2045864862 Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/337922328b16452eac9bd4a9709f4a08"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/337922328b16452eac9bd4a9709f4a08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_337922328b16452eac9bd4a9709f4a08", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/337922328b16452eac9bd4a9709f4a08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServerDiskConfigTestJSON-2045864862 Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 337922328b16452eac9bd4a9709f4a08 Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2045864862 Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServerDiskConfigTestJSON-2045864862-project Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 73f3bffe6eec41a0b3ba4138c17a5d16 Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServerDiskConfigTestJSON-2045864862-project Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance b718ab2b-fc59-4c03-8c00-d7630efc85b5 could not be found. Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'b718ab2b-fc59-4c03-8c00-d7630efc85b5'} Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b718ab2b-fc59-4c03-8c00-d7630efc85b5 could not be found. Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b718ab2b-fc59-4c03-8c00-d7630efc85b5 could not be found. Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:42:29.683673 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:42:29.688162 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:42:29.688162 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:42:29.688162 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:42:29.688162 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:42:29.688162 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:42:29.688162 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b718ab2b-fc59-4c03-8c00-d7630efc85b5 could not be found. Sep 10 12:42:29.688162 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:42:29.688162 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8555a0f4-837f-4ad2-831d-56ba26145e20 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] Returning 404 to user: Instance b718ab2b-fc59-4c03-8c00-d7630efc85b5 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:42:29.688162 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8555a0f4-837f-4ad2-831d-56ba26145e20 tempest-ServerDiskConfigTestJSON-2045864862 tempest-ServerDiskConfigTestJSON-2045864862-project] 10.222.0.23 "GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5" status: 404 len: 111 microversion: 2.1 time: 0.033867 Sep 10 12:42:29.688162 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3489/6970] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:42:29 2022] GET /compute/v2.1/servers/b718ab2b-fc59-4c03-8c00-d7630efc85b5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:42:37.976375 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-51980176-d31a-4b17-beda-516d74489068 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Action: 'create', calling method: .version_select at 0x7f407263e670>, body: {"keypair": {"name": "tempest-keypair-1213083482", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMv8bRWdc+cokxZjLaJFwVP7TVUxawe+OqP6T2hz63qbUKBK2gyr3SqD0j98YYWTt/SUccIJImW/7/ofS3L6rJbo/Xvp86kLJB0BJJ0Feb1Ef18WhI+kWr7kyqUFFInSg=="}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:42:37.981869 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:42:37.994165 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-51980176-d31a-4b17-beda-516d74489068 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Getting quotas for project e5650f863c8c4cfc99dff86c5cb891de. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:42:38.003392 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-51980176-d31a-4b17-beda-516d74489068 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Getting quotas for user 654c64f49ef84816856aa9227f58a117 and project e5650f863c8c4cfc99dff86c5cb891de. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:42:38.029029 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-51980176-d31a-4b17-beda-516d74489068 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.176051 Sep 10 12:42:38.029652 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3482/6971] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 12:42:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:42:39.377116 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7623f88a-6b18-4dc5-9c61-d279e3ba413e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-973900287", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0c9debbf-f324-4b51-a679-6e561d56780c"}], "security_groups": [{"name": "tempest-securitygroup--451320238"}], "key_name": "tempest-keypair-1213083482", "user_data": "}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:42:39.388308 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:42:39.491306 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-7623f88a-6b18-4dc5-9c61-d279e3ba413e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] validate_networks() for [('0c9debbf-f324-4b51-a679-6e561d56780c', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:42:39.672157 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:42:39.891704 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-7623f88a-6b18-4dc5-9c61-d279e3ba413e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:42:39.892147 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-7623f88a-6b18-4dc5-9c61-d279e3ba413e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:42:39.892644 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-7623f88a-6b18-4dc5-9c61-d279e3ba413e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:42:39.893073 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-7623f88a-6b18-4dc5-9c61-d279e3ba413e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:42:39.893504 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-7623f88a-6b18-4dc5-9c61-d279e3ba413e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:42:39.902621 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7623f88a-6b18-4dc5-9c61-d279e3ba413e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:39.903043 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7623f88a-6b18-4dc5-9c61-d279e3ba413e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:39.903529 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7623f88a-6b18-4dc5-9c61-d279e3ba413e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:39.905877 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7623f88a-6b18-4dc5-9c61-d279e3ba413e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:39.905877 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7623f88a-6b18-4dc5-9c61-d279e3ba413e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:39.905877 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7623f88a-6b18-4dc5-9c61-d279e3ba413e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:39.923430 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-7623f88a-6b18-4dc5-9c61-d279e3ba413e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Getting quotas for project e5650f863c8c4cfc99dff86c5cb891de. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:42:39.928897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-7623f88a-6b18-4dc5-9c61-d279e3ba413e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Getting quotas for user 654c64f49ef84816856aa9227f58a117 and project e5650f863c8c4cfc99dff86c5cb891de. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:42:39.942346 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7623f88a-6b18-4dc5-9c61-d279e3ba413e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:42:39.944763 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7623f88a-6b18-4dc5-9c61-d279e3ba413e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:42:39.993523 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7623f88a-6b18-4dc5-9c61-d279e3ba413e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.622040 Sep 10 12:42:39.994280 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3490/6972] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:42:39 2022] POST /compute/v2.1/servers => generated 408 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:42:40.006729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a614b377-ad0d-4732-88e9-d556f6c98bf6 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:42:40.008183 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a614b377-ad0d-4732-88e9-d556f6c98bf6 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:42:40.014353 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=12 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:42:40.073912 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a614b377-ad0d-4732-88e9-d556f6c98bf6 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:42:40.083120 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a614b377-ad0d-4732-88e9-d556f6c98bf6 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa" status: 200 len: 1238 microversion: 2.1 time: 0.080091 Sep 10 12:42:40.084084 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3483/6973] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:42:40 2022] GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa => generated 1238 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:42:41.107142 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6ae72a72-83b9-4472-ba6e-915660b87f27 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:42:41.108310 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6ae72a72-83b9-4472-ba6e-915660b87f27 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:42:41.119392 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6ae72a72-83b9-4472-ba6e-915660b87f27 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:41.120344 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6ae72a72-83b9-4472-ba6e-915660b87f27 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:41.120906 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6ae72a72-83b9-4472-ba6e-915660b87f27 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:41.121735 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6ae72a72-83b9-4472-ba6e-915660b87f27 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:41.122314 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6ae72a72-83b9-4472-ba6e-915660b87f27 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:41.123271 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6ae72a72-83b9-4472-ba6e-915660b87f27 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:41.238720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6ae72a72-83b9-4472-ba6e-915660b87f27 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:42:41.248827 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6ae72a72-83b9-4472-ba6e-915660b87f27 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa" status: 200 len: 1298 microversion: 2.1 time: 0.146161 Sep 10 12:42:41.250801 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3491/6974] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:42:41 2022] GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa => generated 1298 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:42:42.273889 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-eee469ba-a850-4a10-a7bc-c2db7c69b88e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:42:42.274505 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-eee469ba-a850-4a10-a7bc-c2db7c69b88e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:42:42.282012 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eee469ba-a850-4a10-a7bc-c2db7c69b88e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:42.282501 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eee469ba-a850-4a10-a7bc-c2db7c69b88e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:42.282948 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eee469ba-a850-4a10-a7bc-c2db7c69b88e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:42.283689 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eee469ba-a850-4a10-a7bc-c2db7c69b88e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:42.284150 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eee469ba-a850-4a10-a7bc-c2db7c69b88e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:42.284607 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eee469ba-a850-4a10-a7bc-c2db7c69b88e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:42.418540 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-eee469ba-a850-4a10-a7bc-c2db7c69b88e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:42:42.427274 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-eee469ba-a850-4a10-a7bc-c2db7c69b88e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa" status: 200 len: 1363 microversion: 2.1 time: 0.157259 Sep 10 12:42:42.427867 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3484/6975] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:42:42 2022] GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:42:42.640109 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-3aa78476-49af-4147-807b-a8ef5cbe68aa req-f8b47eed-8d78-4b83-b538-cb8a21532407 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffa59f14-0af0-4c3d-b6b8-75d5c15254fa", "tag": "32155d43-fcc8-483c-85b3-8dabda0195d7"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:42:42.650868 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-3aa78476-49af-4147-807b-a8ef5cbe68aa req-f8b47eed-8d78-4b83-b538-cb8a21532407 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:42.651389 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-3aa78476-49af-4147-807b-a8ef5cbe68aa req-f8b47eed-8d78-4b83-b538-cb8a21532407 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:42.651835 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-3aa78476-49af-4147-807b-a8ef5cbe68aa req-f8b47eed-8d78-4b83-b538-cb8a21532407 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:42.663700 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-3aa78476-49af-4147-807b-a8ef5cbe68aa req-f8b47eed-8d78-4b83-b538-cb8a21532407 service nova] Creating event network-changed:32155d43-fcc8-483c-85b3-8dabda0195d7 for instance ffa59f14-0af0-4c3d-b6b8-75d5c15254fa on n-h2-856895-1 Sep 10 12:42:42.668644 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-3aa78476-49af-4147-807b-a8ef5cbe68aa req-f8b47eed-8d78-4b83-b538-cb8a21532407 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033188 Sep 10 12:42:42.669186 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3492/6976] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:42:43.450985 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d3464959-06cd-4329-a462-42d62dc94fe3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:42:43.451633 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d3464959-06cd-4329-a462-42d62dc94fe3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:42:43.459207 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3464959-06cd-4329-a462-42d62dc94fe3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:43.459702 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3464959-06cd-4329-a462-42d62dc94fe3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:43.460145 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3464959-06cd-4329-a462-42d62dc94fe3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:43.460836 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3464959-06cd-4329-a462-42d62dc94fe3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:43.461295 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3464959-06cd-4329-a462-42d62dc94fe3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:43.461724 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3464959-06cd-4329-a462-42d62dc94fe3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:43.591332 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d3464959-06cd-4329-a462-42d62dc94fe3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:42:43.599382 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d3464959-06cd-4329-a462-42d62dc94fe3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa" status: 200 len: 1363 microversion: 2.1 time: 0.152169 Sep 10 12:42:43.599975 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3485/6977] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:42:43 2022] GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:42:44.623727 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-44d6f068-d716-4182-b7a5-d432c61ac409 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:42:44.625311 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-44d6f068-d716-4182-b7a5-d432c61ac409 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:42:44.631620 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-44d6f068-d716-4182-b7a5-d432c61ac409 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:44.632160 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-44d6f068-d716-4182-b7a5-d432c61ac409 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:44.632649 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-44d6f068-d716-4182-b7a5-d432c61ac409 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:44.633389 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-44d6f068-d716-4182-b7a5-d432c61ac409 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:44.633902 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-44d6f068-d716-4182-b7a5-d432c61ac409 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:44.634384 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-44d6f068-d716-4182-b7a5-d432c61ac409 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:44.769295 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-44d6f068-d716-4182-b7a5-d432c61ac409 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:42:44.777217 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-44d6f068-d716-4182-b7a5-d432c61ac409 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa" status: 200 len: 1363 microversion: 2.1 time: 0.158993 Sep 10 12:42:44.777797 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3493/6978] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:42:44 2022] GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:42:45.800752 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-dd0116d8-b752-4954-b0e4-4e7f115d4f08 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:42:45.801317 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-dd0116d8-b752-4954-b0e4-4e7f115d4f08 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:42:45.808297 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd0116d8-b752-4954-b0e4-4e7f115d4f08 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:45.808782 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd0116d8-b752-4954-b0e4-4e7f115d4f08 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:45.809217 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd0116d8-b752-4954-b0e4-4e7f115d4f08 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:45.809929 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd0116d8-b752-4954-b0e4-4e7f115d4f08 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:45.810381 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd0116d8-b752-4954-b0e4-4e7f115d4f08 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:45.810806 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd0116d8-b752-4954-b0e4-4e7f115d4f08 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:45.942266 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-dd0116d8-b752-4954-b0e4-4e7f115d4f08 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:42:45.949990 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-dd0116d8-b752-4954-b0e4-4e7f115d4f08 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa" status: 200 len: 1363 microversion: 2.1 time: 0.153807 Sep 10 12:42:45.950562 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3486/6979] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:42:45 2022] GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:42:46.973691 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8b1e5bac-c5d7-4076-86e0-d62143148fd5 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:42:46.974357 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8b1e5bac-c5d7-4076-86e0-d62143148fd5 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:42:46.981267 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8b1e5bac-c5d7-4076-86e0-d62143148fd5 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:46.981794 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8b1e5bac-c5d7-4076-86e0-d62143148fd5 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:46.982277 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8b1e5bac-c5d7-4076-86e0-d62143148fd5 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:46.983009 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8b1e5bac-c5d7-4076-86e0-d62143148fd5 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:46.984135 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8b1e5bac-c5d7-4076-86e0-d62143148fd5 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:46.984740 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8b1e5bac-c5d7-4076-86e0-d62143148fd5 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:47.117954 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8b1e5bac-c5d7-4076-86e0-d62143148fd5 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:42:47.126568 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8b1e5bac-c5d7-4076-86e0-d62143148fd5 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa" status: 200 len: 1363 microversion: 2.1 time: 0.156821 Sep 10 12:42:47.127155 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3494/6980] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:42:46 2022] GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:42:47.388204 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-eb8b9432-5543-4c9f-a242-a04ea0d2b882 req-44b01ee7-17fa-4884-95a9-5dd3a49a99ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffa59f14-0af0-4c3d-b6b8-75d5c15254fa", "name": "network-vif-plugged", "status": "completed", "tag": "32155d43-fcc8-483c-85b3-8dabda0195d7"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:42:47.399719 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-eb8b9432-5543-4c9f-a242-a04ea0d2b882 req-44b01ee7-17fa-4884-95a9-5dd3a49a99ad service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:47.400420 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-eb8b9432-5543-4c9f-a242-a04ea0d2b882 req-44b01ee7-17fa-4884-95a9-5dd3a49a99ad service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:47.400862 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-eb8b9432-5543-4c9f-a242-a04ea0d2b882 req-44b01ee7-17fa-4884-95a9-5dd3a49a99ad service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:47.413061 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-eb8b9432-5543-4c9f-a242-a04ea0d2b882 req-44b01ee7-17fa-4884-95a9-5dd3a49a99ad service nova] Creating event network-vif-plugged:32155d43-fcc8-483c-85b3-8dabda0195d7 for instance ffa59f14-0af0-4c3d-b6b8-75d5c15254fa on n-h2-856895-1 Sep 10 12:42:47.418311 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-eb8b9432-5543-4c9f-a242-a04ea0d2b882 req-44b01ee7-17fa-4884-95a9-5dd3a49a99ad service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033736 Sep 10 12:42:47.419193 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3487/6981] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:42:48.149562 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1d6f89e5-15ac-491d-b075-467837340c32 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:42:48.150196 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1d6f89e5-15ac-491d-b075-467837340c32 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:42:48.157249 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1d6f89e5-15ac-491d-b075-467837340c32 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:48.157766 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1d6f89e5-15ac-491d-b075-467837340c32 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:48.158197 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1d6f89e5-15ac-491d-b075-467837340c32 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:48.158908 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1d6f89e5-15ac-491d-b075-467837340c32 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:48.159409 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1d6f89e5-15ac-491d-b075-467837340c32 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:48.159855 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1d6f89e5-15ac-491d-b075-467837340c32 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:48.289442 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1d6f89e5-15ac-491d-b075-467837340c32 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:42:48.297781 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1d6f89e5-15ac-491d-b075-467837340c32 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa" status: 200 len: 1363 microversion: 2.1 time: 0.152098 Sep 10 12:42:48.298370 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3495/6982] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:42:48 2022] GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:42:49.322139 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-491b4262-66dc-44a6-8e9d-2c44e093d746 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:42:49.322839 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-491b4262-66dc-44a6-8e9d-2c44e093d746 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:42:49.329729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-491b4262-66dc-44a6-8e9d-2c44e093d746 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:49.330207 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-491b4262-66dc-44a6-8e9d-2c44e093d746 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:49.330637 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-491b4262-66dc-44a6-8e9d-2c44e093d746 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:49.331354 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-491b4262-66dc-44a6-8e9d-2c44e093d746 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:49.331805 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-491b4262-66dc-44a6-8e9d-2c44e093d746 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:49.332232 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-491b4262-66dc-44a6-8e9d-2c44e093d746 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:49.463746 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-491b4262-66dc-44a6-8e9d-2c44e093d746 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:42:49.472656 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-491b4262-66dc-44a6-8e9d-2c44e093d746 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa" status: 200 len: 1550 microversion: 2.1 time: 0.155058 Sep 10 12:42:49.473375 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3488/6983] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:42:49 2022] GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa => generated 1550 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:42:49.497455 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5b25f7fd-4f5a-4390-96c2-d8cc6c1201a8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:42:49.497953 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5b25f7fd-4f5a-4390-96c2-d8cc6c1201a8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:42:49.505049 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b25f7fd-4f5a-4390-96c2-d8cc6c1201a8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:49.505541 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b25f7fd-4f5a-4390-96c2-d8cc6c1201a8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:49.505989 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b25f7fd-4f5a-4390-96c2-d8cc6c1201a8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:49.506681 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b25f7fd-4f5a-4390-96c2-d8cc6c1201a8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:49.507146 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b25f7fd-4f5a-4390-96c2-d8cc6c1201a8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:49.507602 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5b25f7fd-4f5a-4390-96c2-d8cc6c1201a8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:49.592053 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5b25f7fd-4f5a-4390-96c2-d8cc6c1201a8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098758 Sep 10 12:42:49.593213 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3496/6984] 10.222.0.23 () {58 vars in 1275 bytes} [Sat Sep 10 12:42:49 2022] GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:42:50.520991 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-ad2cc779-d941-470d-b24f-128789c2c060 req-017c7b86-9f49-4d6b-b864-3044a45b6a1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffa59f14-0af0-4c3d-b6b8-75d5c15254fa", "tag": "32155d43-fcc8-483c-85b3-8dabda0195d7"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:42:50.525768 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:42:50.532624 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-ad2cc779-d941-470d-b24f-128789c2c060 req-017c7b86-9f49-4d6b-b864-3044a45b6a1b service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:42:50.533093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-ad2cc779-d941-470d-b24f-128789c2c060 req-017c7b86-9f49-4d6b-b864-3044a45b6a1b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:42:50.533523 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-ad2cc779-d941-470d-b24f-128789c2c060 req-017c7b86-9f49-4d6b-b864-3044a45b6a1b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:42:50.544683 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-ad2cc779-d941-470d-b24f-128789c2c060 req-017c7b86-9f49-4d6b-b864-3044a45b6a1b service nova] Creating event network-changed:32155d43-fcc8-483c-85b3-8dabda0195d7 for instance ffa59f14-0af0-4c3d-b6b8-75d5c15254fa on n-h2-856895-1 Sep 10 12:42:50.550359 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-ad2cc779-d941-470d-b24f-128789c2c060 req-017c7b86-9f49-4d6b-b864-3044a45b6a1b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032988 Sep 10 12:42:50.552136 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3489/6985] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:43:20.051824 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:43:20.052627 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:43:20.054572 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:43:20.055269 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=32 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:43:20.059744 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0f98a6aa-2b1c-447d-bb78-4c0d0fc04c19 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:43:20.060939 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0f98a6aa-2b1c-447d-bb78-4c0d0fc04c19 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:43:20.069335 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f98a6aa-2b1c-447d-bb78-4c0d0fc04c19 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:20.069836 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f98a6aa-2b1c-447d-bb78-4c0d0fc04c19 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:20.070297 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f98a6aa-2b1c-447d-bb78-4c0d0fc04c19 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:20.071002 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f98a6aa-2b1c-447d-bb78-4c0d0fc04c19 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:20.071500 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f98a6aa-2b1c-447d-bb78-4c0d0fc04c19 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:20.071945 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f98a6aa-2b1c-447d-bb78-4c0d0fc04c19 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:20.208424 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0f98a6aa-2b1c-447d-bb78-4c0d0fc04c19 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:43:20.216253 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0f98a6aa-2b1c-447d-bb78-4c0d0fc04c19 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa" status: 200 len: 1669 microversion: 2.1 time: 0.165350 Sep 10 12:43:20.217366 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3497/6986] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:43:20 2022] GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa => generated 1669 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:43:20.238976 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:43:20.239866 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=28 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:43:20.244301 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f87930d0-e05e-478c-a9a9-d445017665fa tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:43:20.245295 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f87930d0-e05e-478c-a9a9-d445017665fa tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:43:20.253003 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f87930d0-e05e-478c-a9a9-d445017665fa tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:20.253481 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f87930d0-e05e-478c-a9a9-d445017665fa tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:20.253912 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f87930d0-e05e-478c-a9a9-d445017665fa tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:20.254590 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f87930d0-e05e-478c-a9a9-d445017665fa tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:20.255041 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f87930d0-e05e-478c-a9a9-d445017665fa tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:20.255497 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f87930d0-e05e-478c-a9a9-d445017665fa tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:20.387910 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f87930d0-e05e-478c-a9a9-d445017665fa tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:43:20.396268 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f87930d0-e05e-478c-a9a9-d445017665fa tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa" status: 200 len: 1669 microversion: 2.1 time: 0.159737 Sep 10 12:43:20.396850 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3490/6987] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:43:20 2022] GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa => generated 1669 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:43:20.418989 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4b9a8cf1-25aa-4821-a278-2acc484c5ae9 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:43:20.419658 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4b9a8cf1-25aa-4821-a278-2acc484c5ae9 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:43:20.425645 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b9a8cf1-25aa-4821-a278-2acc484c5ae9 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:20.426141 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b9a8cf1-25aa-4821-a278-2acc484c5ae9 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:20.426593 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b9a8cf1-25aa-4821-a278-2acc484c5ae9 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:20.427329 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b9a8cf1-25aa-4821-a278-2acc484c5ae9 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:20.427799 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b9a8cf1-25aa-4821-a278-2acc484c5ae9 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:20.428244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b9a8cf1-25aa-4821-a278-2acc484c5ae9 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:20.556553 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4b9a8cf1-25aa-4821-a278-2acc484c5ae9 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:43:20.565531 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4b9a8cf1-25aa-4821-a278-2acc484c5ae9 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa" status: 200 len: 1669 microversion: 2.1 time: 0.150422 Sep 10 12:43:20.566113 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3498/6988] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:43:20 2022] GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa => generated 1669 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:43:20.587983 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-245de430-0994-42e3-96e4-6d96a71ef621 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:43:20.590117 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-245de430-0994-42e3-96e4-6d96a71ef621 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:43:20.596079 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-245de430-0994-42e3-96e4-6d96a71ef621 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:20.596555 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-245de430-0994-42e3-96e4-6d96a71ef621 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:20.596984 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-245de430-0994-42e3-96e4-6d96a71ef621 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:20.597662 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-245de430-0994-42e3-96e4-6d96a71ef621 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:20.598113 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-245de430-0994-42e3-96e4-6d96a71ef621 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:20.598534 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-245de430-0994-42e3-96e4-6d96a71ef621 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:20.627823 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-245de430-0994-42e3-96e4-6d96a71ef621 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:43:20.633128 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-245de430-0994-42e3-96e4-6d96a71ef621 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Old instance type m1.heat2, new instance type m1.heat {{(pid=128777) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 12:43:20.640225 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-245de430-0994-42e3-96e4-6d96a71ef621 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:43:20.640644 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-245de430-0994-42e3-96e4-6d96a71ef621 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:43:20.641116 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-245de430-0994-42e3-96e4-6d96a71ef621 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:43:20.641524 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-245de430-0994-42e3-96e4-6d96a71ef621 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:43:20.641934 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-245de430-0994-42e3-96e4-6d96a71ef621 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:43:20.705685 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-245de430-0994-42e3-96e4-6d96a71ef621 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "POST /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa/action" status: 202 len: 0 microversion: 2.1 time: 0.121649 Sep 10 12:43:20.706299 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3491/6989] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:43:20 2022] POST /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:43:20.714574 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bbdcc42f-a1ac-4a7c-a0f3-522882e9cf5b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:43:20.715234 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bbdcc42f-a1ac-4a7c-a0f3-522882e9cf5b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:43:20.721803 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bbdcc42f-a1ac-4a7c-a0f3-522882e9cf5b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:20.722287 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bbdcc42f-a1ac-4a7c-a0f3-522882e9cf5b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:20.722770 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bbdcc42f-a1ac-4a7c-a0f3-522882e9cf5b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:20.723459 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bbdcc42f-a1ac-4a7c-a0f3-522882e9cf5b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:20.723924 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bbdcc42f-a1ac-4a7c-a0f3-522882e9cf5b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:20.724363 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bbdcc42f-a1ac-4a7c-a0f3-522882e9cf5b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:20.875350 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bbdcc42f-a1ac-4a7c-a0f3-522882e9cf5b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:43:20.883721 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bbdcc42f-a1ac-4a7c-a0f3-522882e9cf5b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa" status: 200 len: 1678 microversion: 2.1 time: 0.172911 Sep 10 12:43:20.885112 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3499/6990] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:43:20 2022] GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:43:21.909765 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-621aec38-45e8-4ef1-bd7b-481427634375 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:43:21.910528 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-621aec38-45e8-4ef1-bd7b-481427634375 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:43:21.917498 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-621aec38-45e8-4ef1-bd7b-481427634375 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:21.917986 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-621aec38-45e8-4ef1-bd7b-481427634375 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:21.918432 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-621aec38-45e8-4ef1-bd7b-481427634375 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:21.919131 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-621aec38-45e8-4ef1-bd7b-481427634375 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:21.919616 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-621aec38-45e8-4ef1-bd7b-481427634375 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:21.920182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-621aec38-45e8-4ef1-bd7b-481427634375 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:22.069337 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-621aec38-45e8-4ef1-bd7b-481427634375 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:43:22.077938 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-621aec38-45e8-4ef1-bd7b-481427634375 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa" status: 200 len: 1678 microversion: 2.1 time: 0.174237 Sep 10 12:43:22.078521 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3492/6991] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:43:21 2022] GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:43:23.102217 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fd9e2c01-1ce8-44c0-b948-1a63107f6ed2 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:43:23.102846 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fd9e2c01-1ce8-44c0-b948-1a63107f6ed2 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:43:23.109934 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fd9e2c01-1ce8-44c0-b948-1a63107f6ed2 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:23.110426 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fd9e2c01-1ce8-44c0-b948-1a63107f6ed2 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:23.110877 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fd9e2c01-1ce8-44c0-b948-1a63107f6ed2 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:23.111606 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fd9e2c01-1ce8-44c0-b948-1a63107f6ed2 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:23.112075 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fd9e2c01-1ce8-44c0-b948-1a63107f6ed2 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:23.112600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fd9e2c01-1ce8-44c0-b948-1a63107f6ed2 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:23.247555 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fd9e2c01-1ce8-44c0-b948-1a63107f6ed2 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:43:23.255141 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fd9e2c01-1ce8-44c0-b948-1a63107f6ed2 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa" status: 200 len: 1683 microversion: 2.1 time: 0.156896 Sep 10 12:43:23.255743 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3500/6992] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:43:23 2022] GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:43:24.277967 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d1704f59-3259-4379-a74b-c5072dc9384b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:43:24.278614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d1704f59-3259-4379-a74b-c5072dc9384b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:43:24.286327 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1704f59-3259-4379-a74b-c5072dc9384b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:24.286817 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1704f59-3259-4379-a74b-c5072dc9384b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:24.287285 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1704f59-3259-4379-a74b-c5072dc9384b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:24.287996 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1704f59-3259-4379-a74b-c5072dc9384b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:24.288450 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1704f59-3259-4379-a74b-c5072dc9384b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:24.288900 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1704f59-3259-4379-a74b-c5072dc9384b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:24.416694 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d1704f59-3259-4379-a74b-c5072dc9384b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:43:24.424920 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d1704f59-3259-4379-a74b-c5072dc9384b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa" status: 200 len: 1683 microversion: 2.1 time: 0.150891 Sep 10 12:43:24.425490 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3493/6993] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:43:24 2022] GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:43:25.448740 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-28fc482f-36bf-41fa-b3d6-cc1b5c433cb7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:43:25.449367 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-28fc482f-36bf-41fa-b3d6-cc1b5c433cb7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:43:25.456437 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28fc482f-36bf-41fa-b3d6-cc1b5c433cb7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:25.456932 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28fc482f-36bf-41fa-b3d6-cc1b5c433cb7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:25.457376 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28fc482f-36bf-41fa-b3d6-cc1b5c433cb7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:25.458068 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28fc482f-36bf-41fa-b3d6-cc1b5c433cb7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:25.458530 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28fc482f-36bf-41fa-b3d6-cc1b5c433cb7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:25.458963 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28fc482f-36bf-41fa-b3d6-cc1b5c433cb7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:25.589782 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-28fc482f-36bf-41fa-b3d6-cc1b5c433cb7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:43:25.598170 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-28fc482f-36bf-41fa-b3d6-cc1b5c433cb7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa" status: 200 len: 1683 microversion: 2.1 time: 0.153317 Sep 10 12:43:25.598744 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3501/6994] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:43:25 2022] GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:43:26.622593 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-30514b79-cfa2-432a-8a15-eba45ab08717 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:43:26.623130 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-30514b79-cfa2-432a-8a15-eba45ab08717 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:43:26.630647 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30514b79-cfa2-432a-8a15-eba45ab08717 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:26.631130 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30514b79-cfa2-432a-8a15-eba45ab08717 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:26.631596 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30514b79-cfa2-432a-8a15-eba45ab08717 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:26.632284 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30514b79-cfa2-432a-8a15-eba45ab08717 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:26.632741 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30514b79-cfa2-432a-8a15-eba45ab08717 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:26.633172 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-30514b79-cfa2-432a-8a15-eba45ab08717 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:26.764173 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-30514b79-cfa2-432a-8a15-eba45ab08717 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:43:26.771855 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-30514b79-cfa2-432a-8a15-eba45ab08717 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa" status: 200 len: 1683 microversion: 2.1 time: 0.153618 Sep 10 12:43:26.772431 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3494/6995] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:43:26 2022] GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:43:27.796731 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f583aa24-68a8-48b7-9326-7105b4fb5586 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:43:27.797423 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f583aa24-68a8-48b7-9326-7105b4fb5586 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:43:27.804254 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f583aa24-68a8-48b7-9326-7105b4fb5586 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:27.804753 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f583aa24-68a8-48b7-9326-7105b4fb5586 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:27.805209 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f583aa24-68a8-48b7-9326-7105b4fb5586 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:27.805913 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f583aa24-68a8-48b7-9326-7105b4fb5586 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:27.806384 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f583aa24-68a8-48b7-9326-7105b4fb5586 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:27.806827 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f583aa24-68a8-48b7-9326-7105b4fb5586 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:27.935869 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f583aa24-68a8-48b7-9326-7105b4fb5586 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:43:27.944391 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f583aa24-68a8-48b7-9326-7105b4fb5586 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa" status: 200 len: 1683 microversion: 2.1 time: 0.152285 Sep 10 12:43:27.944967 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3502/6996] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:43:27 2022] GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:43:28.968348 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b2426e5c-d622-40ed-809a-c7e8e0e38829 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:43:28.968952 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b2426e5c-d622-40ed-809a-c7e8e0e38829 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:43:28.975760 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b2426e5c-d622-40ed-809a-c7e8e0e38829 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:28.976245 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b2426e5c-d622-40ed-809a-c7e8e0e38829 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:28.976678 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b2426e5c-d622-40ed-809a-c7e8e0e38829 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:28.977366 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b2426e5c-d622-40ed-809a-c7e8e0e38829 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:28.977819 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b2426e5c-d622-40ed-809a-c7e8e0e38829 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:28.978245 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b2426e5c-d622-40ed-809a-c7e8e0e38829 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:29.113176 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b2426e5c-d622-40ed-809a-c7e8e0e38829 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:43:29.121226 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b2426e5c-d622-40ed-809a-c7e8e0e38829 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa" status: 200 len: 1683 microversion: 2.1 time: 0.156806 Sep 10 12:43:29.121801 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3495/6997] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:43:28 2022] GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:43:30.145406 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fa10dcbf-0bce-49c1-be02-d1b7532c118f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:43:30.146045 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fa10dcbf-0bce-49c1-be02-d1b7532c118f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:43:30.153096 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa10dcbf-0bce-49c1-be02-d1b7532c118f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:30.153599 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa10dcbf-0bce-49c1-be02-d1b7532c118f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:30.154061 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa10dcbf-0bce-49c1-be02-d1b7532c118f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:30.154824 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa10dcbf-0bce-49c1-be02-d1b7532c118f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:30.155443 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa10dcbf-0bce-49c1-be02-d1b7532c118f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:30.155897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa10dcbf-0bce-49c1-be02-d1b7532c118f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:30.287338 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fa10dcbf-0bce-49c1-be02-d1b7532c118f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:43:30.295111 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fa10dcbf-0bce-49c1-be02-d1b7532c118f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa" status: 200 len: 1683 microversion: 2.1 time: 0.153665 Sep 10 12:43:30.295759 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3503/6998] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:43:30 2022] GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:43:31.318505 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d67c25dc-e5d4-4034-85f1-3580cf3638ac tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:43:31.319153 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d67c25dc-e5d4-4034-85f1-3580cf3638ac tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:43:31.326104 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d67c25dc-e5d4-4034-85f1-3580cf3638ac tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:31.326585 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d67c25dc-e5d4-4034-85f1-3580cf3638ac tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:31.327073 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d67c25dc-e5d4-4034-85f1-3580cf3638ac tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:31.327793 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d67c25dc-e5d4-4034-85f1-3580cf3638ac tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:31.328251 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d67c25dc-e5d4-4034-85f1-3580cf3638ac tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:31.329029 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d67c25dc-e5d4-4034-85f1-3580cf3638ac tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:31.464542 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d67c25dc-e5d4-4034-85f1-3580cf3638ac tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:43:31.472293 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d67c25dc-e5d4-4034-85f1-3580cf3638ac tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa" status: 200 len: 1683 microversion: 2.1 time: 0.157672 Sep 10 12:43:31.472861 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3496/6999] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:43:31 2022] GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:43:32.495865 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1473d665-3ac2-41f7-a68d-6dc7dda85f90 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:43:32.496428 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1473d665-3ac2-41f7-a68d-6dc7dda85f90 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:43:32.503563 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1473d665-3ac2-41f7-a68d-6dc7dda85f90 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:32.504054 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1473d665-3ac2-41f7-a68d-6dc7dda85f90 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:32.504500 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1473d665-3ac2-41f7-a68d-6dc7dda85f90 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:32.505200 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1473d665-3ac2-41f7-a68d-6dc7dda85f90 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:32.505663 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1473d665-3ac2-41f7-a68d-6dc7dda85f90 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:32.506099 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1473d665-3ac2-41f7-a68d-6dc7dda85f90 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:32.640997 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1473d665-3ac2-41f7-a68d-6dc7dda85f90 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:43:32.649022 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1473d665-3ac2-41f7-a68d-6dc7dda85f90 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa" status: 200 len: 1683 microversion: 2.1 time: 0.157325 Sep 10 12:43:32.649608 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3504/7000] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:43:32 2022] GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:43:33.673991 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-eb07e8c3-c1d5-4b08-a2b1-affbf889b5a3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:43:33.674608 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-eb07e8c3-c1d5-4b08-a2b1-affbf889b5a3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:43:33.681494 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb07e8c3-c1d5-4b08-a2b1-affbf889b5a3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:33.681976 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb07e8c3-c1d5-4b08-a2b1-affbf889b5a3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:33.682416 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb07e8c3-c1d5-4b08-a2b1-affbf889b5a3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:33.683102 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb07e8c3-c1d5-4b08-a2b1-affbf889b5a3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:33.683583 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb07e8c3-c1d5-4b08-a2b1-affbf889b5a3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:33.684011 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eb07e8c3-c1d5-4b08-a2b1-affbf889b5a3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:33.813760 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-eb07e8c3-c1d5-4b08-a2b1-affbf889b5a3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:43:33.821380 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-eb07e8c3-c1d5-4b08-a2b1-affbf889b5a3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa" status: 200 len: 1683 microversion: 2.1 time: 0.151412 Sep 10 12:43:33.821959 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3497/7001] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:43:33 2022] GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:43:34.846365 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d87856bb-950e-457d-834e-d7ac68101646 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:43:34.847065 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d87856bb-950e-457d-834e-d7ac68101646 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:43:34.854768 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d87856bb-950e-457d-834e-d7ac68101646 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:34.855320 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d87856bb-950e-457d-834e-d7ac68101646 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:34.855788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d87856bb-950e-457d-834e-d7ac68101646 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:34.856520 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d87856bb-950e-457d-834e-d7ac68101646 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:34.857001 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d87856bb-950e-457d-834e-d7ac68101646 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:34.857455 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d87856bb-950e-457d-834e-d7ac68101646 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:35.254770 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d87856bb-950e-457d-834e-d7ac68101646 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:43:35.262488 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d87856bb-950e-457d-834e-d7ac68101646 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa" status: 200 len: 1682 microversion: 2.1 time: 0.420759 Sep 10 12:43:35.263069 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3505/7002] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:43:34 2022] GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa => generated 1682 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:43:35.339326 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-f9a6a371-e7f1-4d5f-a595-e04f3a763247 req-4535c5c9-a7da-47fe-9119-f224f23ab637 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffa59f14-0af0-4c3d-b6b8-75d5c15254fa", "name": "network-vif-unplugged", "status": "completed", "tag": "32155d43-fcc8-483c-85b3-8dabda0195d7"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:43:35.349573 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-f9a6a371-e7f1-4d5f-a595-e04f3a763247 req-4535c5c9-a7da-47fe-9119-f224f23ab637 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:35.350081 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-f9a6a371-e7f1-4d5f-a595-e04f3a763247 req-4535c5c9-a7da-47fe-9119-f224f23ab637 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:35.350502 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-f9a6a371-e7f1-4d5f-a595-e04f3a763247 req-4535c5c9-a7da-47fe-9119-f224f23ab637 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:35.362927 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-f9a6a371-e7f1-4d5f-a595-e04f3a763247 req-4535c5c9-a7da-47fe-9119-f224f23ab637 service nova] Creating event network-vif-unplugged:32155d43-fcc8-483c-85b3-8dabda0195d7 for instance ffa59f14-0af0-4c3d-b6b8-75d5c15254fa on n-h1-856895-1 Sep 10 12:43:35.368347 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [req-f9a6a371-e7f1-4d5f-a595-e04f3a763247 req-4535c5c9-a7da-47fe-9119-f224f23ab637 service nova] Instance ffa59f14-0af0-4c3d-b6b8-75d5c15254fa is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856895-1', 'n-h1-856895-1'} {{(pid=128777) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 12:43:35.380512 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-f9a6a371-e7f1-4d5f-a595-e04f3a763247 req-4535c5c9-a7da-47fe-9119-f224f23ab637 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044872 Sep 10 12:43:35.381140 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3498/7003] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:43:36.287029 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-37b42613-790d-462d-89a4-790965fffa15 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:43:36.287853 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-37b42613-790d-462d-89a4-790965fffa15 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:43:36.294701 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-37b42613-790d-462d-89a4-790965fffa15 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:36.295236 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-37b42613-790d-462d-89a4-790965fffa15 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:36.296216 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-37b42613-790d-462d-89a4-790965fffa15 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:36.297015 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-37b42613-790d-462d-89a4-790965fffa15 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:36.297495 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-37b42613-790d-462d-89a4-790965fffa15 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:36.297942 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-37b42613-790d-462d-89a4-790965fffa15 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:36.439205 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-37b42613-790d-462d-89a4-790965fffa15 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:43:36.447310 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-37b42613-790d-462d-89a4-790965fffa15 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa" status: 200 len: 1682 microversion: 2.1 time: 0.164330 Sep 10 12:43:36.447886 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3506/7004] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:43:36 2022] GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:43:37.399100 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-b825d737-b825-4e11-a44f-ec2ea9abb5aa req-44d50688-c40f-47dd-a5e2-5a04839d5811 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffa59f14-0af0-4c3d-b6b8-75d5c15254fa", "tag": "32155d43-fcc8-483c-85b3-8dabda0195d7"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:43:37.409005 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-b825d737-b825-4e11-a44f-ec2ea9abb5aa req-44d50688-c40f-47dd-a5e2-5a04839d5811 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:37.409476 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-b825d737-b825-4e11-a44f-ec2ea9abb5aa req-44d50688-c40f-47dd-a5e2-5a04839d5811 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:37.409908 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-b825d737-b825-4e11-a44f-ec2ea9abb5aa req-44d50688-c40f-47dd-a5e2-5a04839d5811 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:37.421950 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-b825d737-b825-4e11-a44f-ec2ea9abb5aa req-44d50688-c40f-47dd-a5e2-5a04839d5811 service nova] Creating event network-changed:32155d43-fcc8-483c-85b3-8dabda0195d7 for instance ffa59f14-0af0-4c3d-b6b8-75d5c15254fa on n-h1-856895-1 Sep 10 12:43:37.427144 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [req-b825d737-b825-4e11-a44f-ec2ea9abb5aa req-44d50688-c40f-47dd-a5e2-5a04839d5811 service nova] Instance ffa59f14-0af0-4c3d-b6b8-75d5c15254fa is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856895-1', 'n-h1-856895-1'} {{(pid=128777) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 12:43:37.437588 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-b825d737-b825-4e11-a44f-ec2ea9abb5aa req-44d50688-c40f-47dd-a5e2-5a04839d5811 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043355 Sep 10 12:43:37.438175 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3499/7005] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:43:37.471654 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0239d283-c136-4484-94e3-9d3ceff225b7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:43:37.472305 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0239d283-c136-4484-94e3-9d3ceff225b7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:43:37.479155 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0239d283-c136-4484-94e3-9d3ceff225b7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:37.479709 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0239d283-c136-4484-94e3-9d3ceff225b7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:37.480158 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0239d283-c136-4484-94e3-9d3ceff225b7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:37.480875 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0239d283-c136-4484-94e3-9d3ceff225b7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:37.481352 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0239d283-c136-4484-94e3-9d3ceff225b7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:37.481800 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0239d283-c136-4484-94e3-9d3ceff225b7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:37.621362 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0239d283-c136-4484-94e3-9d3ceff225b7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:43:37.630437 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0239d283-c136-4484-94e3-9d3ceff225b7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa" status: 200 len: 1680 microversion: 2.1 time: 0.163210 Sep 10 12:43:37.631030 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3507/7006] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:43:37 2022] GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:43:38.656166 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-164a48ab-e7e3-4512-b42c-d1b5eb1e112a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:43:38.656742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-164a48ab-e7e3-4512-b42c-d1b5eb1e112a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:43:38.662726 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-164a48ab-e7e3-4512-b42c-d1b5eb1e112a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:38.663241 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-164a48ab-e7e3-4512-b42c-d1b5eb1e112a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:38.663682 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-164a48ab-e7e3-4512-b42c-d1b5eb1e112a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:38.664367 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-164a48ab-e7e3-4512-b42c-d1b5eb1e112a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:38.664822 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-164a48ab-e7e3-4512-b42c-d1b5eb1e112a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:38.665249 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-164a48ab-e7e3-4512-b42c-d1b5eb1e112a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:38.806247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-164a48ab-e7e3-4512-b42c-d1b5eb1e112a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:43:38.814352 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-164a48ab-e7e3-4512-b42c-d1b5eb1e112a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa" status: 200 len: 1680 microversion: 2.1 time: 0.164224 Sep 10 12:43:38.814929 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3500/7007] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:43:38 2022] GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:43:39.838042 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b94673e0-06d1-4e73-910d-5d8f5ee54d8c tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:43:39.838588 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b94673e0-06d1-4e73-910d-5d8f5ee54d8c tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:43:39.845989 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b94673e0-06d1-4e73-910d-5d8f5ee54d8c tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:39.846488 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b94673e0-06d1-4e73-910d-5d8f5ee54d8c tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:39.846945 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b94673e0-06d1-4e73-910d-5d8f5ee54d8c tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:39.847677 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b94673e0-06d1-4e73-910d-5d8f5ee54d8c tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:39.848150 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b94673e0-06d1-4e73-910d-5d8f5ee54d8c tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:39.848593 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b94673e0-06d1-4e73-910d-5d8f5ee54d8c tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:39.980018 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b94673e0-06d1-4e73-910d-5d8f5ee54d8c tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:43:39.987829 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b94673e0-06d1-4e73-910d-5d8f5ee54d8c tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa" status: 200 len: 1677 microversion: 2.1 time: 0.153774 Sep 10 12:43:39.988405 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3508/7008] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:43:39 2022] GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:43:40.010859 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ba4ee0bb-d2c6-47cc-90d8-f44473c16960 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:43:40.011421 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ba4ee0bb-d2c6-47cc-90d8-f44473c16960 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:43:40.018859 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba4ee0bb-d2c6-47cc-90d8-f44473c16960 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:40.019400 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba4ee0bb-d2c6-47cc-90d8-f44473c16960 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:40.019834 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba4ee0bb-d2c6-47cc-90d8-f44473c16960 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:40.020516 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba4ee0bb-d2c6-47cc-90d8-f44473c16960 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:40.021022 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba4ee0bb-d2c6-47cc-90d8-f44473c16960 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:40.027044 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba4ee0bb-d2c6-47cc-90d8-f44473c16960 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:40.086942 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ba4ee0bb-d2c6-47cc-90d8-f44473c16960 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "POST /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa/action" status: 204 len: 0 microversion: 2.1 time: 0.079778 Sep 10 12:43:40.087635 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3501/7009] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:43:40 2022] POST /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:43:40.096392 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-23739498-f176-472f-8a67-a53fa0529966 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:43:40.096962 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-23739498-f176-472f-8a67-a53fa0529966 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:43:40.102919 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-23739498-f176-472f-8a67-a53fa0529966 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:40.103587 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-23739498-f176-472f-8a67-a53fa0529966 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:40.103910 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-23739498-f176-472f-8a67-a53fa0529966 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:40.104624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-23739498-f176-472f-8a67-a53fa0529966 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:40.105090 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-23739498-f176-472f-8a67-a53fa0529966 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:40.105548 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-23739498-f176-472f-8a67-a53fa0529966 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:40.243764 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-23739498-f176-472f-8a67-a53fa0529966 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:43:40.252466 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-23739498-f176-472f-8a67-a53fa0529966 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa" status: 200 len: 1677 microversion: 2.1 time: 0.160575 Sep 10 12:43:40.253275 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3509/7010] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:43:40 2022] GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:43:41.277823 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7b9f8de3-26bb-4534-bbac-d5ac0c187fb6 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:43:41.278719 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7b9f8de3-26bb-4534-bbac-d5ac0c187fb6 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:43:41.286623 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b9f8de3-26bb-4534-bbac-d5ac0c187fb6 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:41.287114 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b9f8de3-26bb-4534-bbac-d5ac0c187fb6 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:41.287612 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b9f8de3-26bb-4534-bbac-d5ac0c187fb6 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:41.288350 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b9f8de3-26bb-4534-bbac-d5ac0c187fb6 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:41.288835 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b9f8de3-26bb-4534-bbac-d5ac0c187fb6 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:41.289884 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b9f8de3-26bb-4534-bbac-d5ac0c187fb6 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:41.433467 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7b9f8de3-26bb-4534-bbac-d5ac0c187fb6 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:43:41.442452 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7b9f8de3-26bb-4534-bbac-d5ac0c187fb6 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa" status: 200 len: 1669 microversion: 2.1 time: 0.169714 Sep 10 12:43:41.443046 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3502/7011] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:43:41 2022] GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa => generated 1669 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:43:41.466602 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ffa1d275-4df2-4fb1-a5c2-c32fe2bd358a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:43:41.467277 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ffa1d275-4df2-4fb1-a5c2-c32fe2bd358a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:43:41.474783 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ffa1d275-4df2-4fb1-a5c2-c32fe2bd358a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:41.475309 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ffa1d275-4df2-4fb1-a5c2-c32fe2bd358a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:41.475767 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ffa1d275-4df2-4fb1-a5c2-c32fe2bd358a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:41.476464 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ffa1d275-4df2-4fb1-a5c2-c32fe2bd358a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:41.476930 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ffa1d275-4df2-4fb1-a5c2-c32fe2bd358a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:41.477366 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ffa1d275-4df2-4fb1-a5c2-c32fe2bd358a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:41.610113 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ffa1d275-4df2-4fb1-a5c2-c32fe2bd358a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:43:41.618087 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ffa1d275-4df2-4fb1-a5c2-c32fe2bd358a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa" status: 200 len: 1669 microversion: 2.1 time: 0.155672 Sep 10 12:43:41.618668 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3510/7012] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:43:41 2022] GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:43:41.645317 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-39de1f18-45fd-4e23-bae4-bbecea984867 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:43:41.645933 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-39de1f18-45fd-4e23-bae4-bbecea984867 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:43:41.651892 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-39de1f18-45fd-4e23-bae4-bbecea984867 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:41.652371 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-39de1f18-45fd-4e23-bae4-bbecea984867 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:41.652810 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-39de1f18-45fd-4e23-bae4-bbecea984867 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:41.653499 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-39de1f18-45fd-4e23-bae4-bbecea984867 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:41.653960 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-39de1f18-45fd-4e23-bae4-bbecea984867 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:41.654387 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-39de1f18-45fd-4e23-bae4-bbecea984867 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:41.794792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-39de1f18-45fd-4e23-bae4-bbecea984867 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:43:41.802583 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-39de1f18-45fd-4e23-bae4-bbecea984867 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa" status: 200 len: 1669 microversion: 2.1 time: 0.161093 Sep 10 12:43:41.803193 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3503/7013] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:43:41 2022] GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa => generated 1669 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:43:41.825493 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4d133dcd-79eb-435b-a088-881d616d2be0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:43:41.826037 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4d133dcd-79eb-435b-a088-881d616d2be0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:43:41.832658 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4d133dcd-79eb-435b-a088-881d616d2be0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:41.833162 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4d133dcd-79eb-435b-a088-881d616d2be0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:41.833611 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4d133dcd-79eb-435b-a088-881d616d2be0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:41.834323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4d133dcd-79eb-435b-a088-881d616d2be0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:41.834793 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4d133dcd-79eb-435b-a088-881d616d2be0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:41.835379 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4d133dcd-79eb-435b-a088-881d616d2be0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:41.860611 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4d133dcd-79eb-435b-a088-881d616d2be0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:43:41.911581 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:43:41.942537 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4d133dcd-79eb-435b-a088-881d616d2be0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa" status: 204 len: 0 microversion: 2.1 time: 0.120582 Sep 10 12:43:41.946421 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3511/7014] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:43:41 2022] DELETE /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:43:41.953121 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8341ccbb-7d3c-413f-b2d6-ff8896556df8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:43:41.953934 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8341ccbb-7d3c-413f-b2d6-ff8896556df8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:43:41.960317 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8341ccbb-7d3c-413f-b2d6-ff8896556df8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:41.960800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8341ccbb-7d3c-413f-b2d6-ff8896556df8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:41.961233 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8341ccbb-7d3c-413f-b2d6-ff8896556df8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:41.961926 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8341ccbb-7d3c-413f-b2d6-ff8896556df8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:41.962374 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8341ccbb-7d3c-413f-b2d6-ff8896556df8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:41.962792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8341ccbb-7d3c-413f-b2d6-ff8896556df8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:42.360560 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8341ccbb-7d3c-413f-b2d6-ff8896556df8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:43:42.362930 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:43:42.370665 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8341ccbb-7d3c-413f-b2d6-ff8896556df8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa" status: 200 len: 1675 microversion: 2.1 time: 0.422862 Sep 10 12:43:42.371252 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3504/7015] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:43:41 2022] GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa => generated 1675 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:43:43.334031 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-ef7f761e-dbcb-4513-98bb-02972f244b80 req-cef708e7-b226-45bd-a115-0c35e455e3e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffa59f14-0af0-4c3d-b6b8-75d5c15254fa", "name": "network-vif-plugged", "status": "completed", "tag": "32155d43-fcc8-483c-85b3-8dabda0195d7"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:43:43.344512 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ef7f761e-dbcb-4513-98bb-02972f244b80 req-cef708e7-b226-45bd-a115-0c35e455e3e1 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:43.345008 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ef7f761e-dbcb-4513-98bb-02972f244b80 req-cef708e7-b226-45bd-a115-0c35e455e3e1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:43.345482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ef7f761e-dbcb-4513-98bb-02972f244b80 req-cef708e7-b226-45bd-a115-0c35e455e3e1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:43.357440 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-ef7f761e-dbcb-4513-98bb-02972f244b80 req-cef708e7-b226-45bd-a115-0c35e455e3e1 service nova] Creating event network-vif-plugged:32155d43-fcc8-483c-85b3-8dabda0195d7 for instance ffa59f14-0af0-4c3d-b6b8-75d5c15254fa on n-h1-856895-1 Sep 10 12:43:43.363461 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-ef7f761e-dbcb-4513-98bb-02972f244b80 req-cef708e7-b226-45bd-a115-0c35e455e3e1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033245 Sep 10 12:43:43.364630 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3512/7016] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:43:43.396239 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-03aad4a0-3aba-42d7-bebb-1bccf0683741 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:43:43.396859 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-03aad4a0-3aba-42d7-bebb-1bccf0683741 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:43:43.404806 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03aad4a0-3aba-42d7-bebb-1bccf0683741 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:43.405296 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03aad4a0-3aba-42d7-bebb-1bccf0683741 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:43.405844 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03aad4a0-3aba-42d7-bebb-1bccf0683741 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:43.406551 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03aad4a0-3aba-42d7-bebb-1bccf0683741 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:43.407009 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03aad4a0-3aba-42d7-bebb-1bccf0683741 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:43.407475 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-03aad4a0-3aba-42d7-bebb-1bccf0683741 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:43.549946 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-03aad4a0-3aba-42d7-bebb-1bccf0683741 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:43:43.557602 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-03aad4a0-3aba-42d7-bebb-1bccf0683741 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa" status: 200 len: 1675 microversion: 2.1 time: 0.166874 Sep 10 12:43:43.558169 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3505/7017] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:43:43 2022] GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa => generated 1675 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:43:44.371638 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-ac923f16-2313-49e0-98f2-b4ded00e9d13 req-29ee1b99-317c-4413-be37-ed2cc528e4e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffa59f14-0af0-4c3d-b6b8-75d5c15254fa", "name": "network-vif-deleted", "tag": "32155d43-fcc8-483c-85b3-8dabda0195d7"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:43:44.381956 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ac923f16-2313-49e0-98f2-b4ded00e9d13 req-29ee1b99-317c-4413-be37-ed2cc528e4e6 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:44.382456 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ac923f16-2313-49e0-98f2-b4ded00e9d13 req-29ee1b99-317c-4413-be37-ed2cc528e4e6 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:44.382952 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ac923f16-2313-49e0-98f2-b4ded00e9d13 req-29ee1b99-317c-4413-be37-ed2cc528e4e6 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:44.394445 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-ac923f16-2313-49e0-98f2-b4ded00e9d13 req-29ee1b99-317c-4413-be37-ed2cc528e4e6 service nova] Creating event network-vif-deleted:32155d43-fcc8-483c-85b3-8dabda0195d7 for instance ffa59f14-0af0-4c3d-b6b8-75d5c15254fa on n-h1-856895-1 Sep 10 12:43:44.399941 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-ac923f16-2313-49e0-98f2-b4ded00e9d13 req-29ee1b99-317c-4413-be37-ed2cc528e4e6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032952 Sep 10 12:43:44.400763 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3513/7018] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:43:44.582806 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7f8011dd-6ef4-40ff-9b3d-0e3fded9ff14 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:43:44.584286 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7f8011dd-6ef4-40ff-9b3d-0e3fded9ff14 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:43:44.591744 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f8011dd-6ef4-40ff-9b3d-0e3fded9ff14 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:44.592556 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f8011dd-6ef4-40ff-9b3d-0e3fded9ff14 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:44.593289 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f8011dd-6ef4-40ff-9b3d-0e3fded9ff14 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:44.594322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f8011dd-6ef4-40ff-9b3d-0e3fded9ff14 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:44.594792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f8011dd-6ef4-40ff-9b3d-0e3fded9ff14 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:44.595250 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f8011dd-6ef4-40ff-9b3d-0e3fded9ff14 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:44.630287 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f8011dd-6ef4-40ff-9b3d-0e3fded9ff14 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:44.631050 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f8011dd-6ef4-40ff-9b3d-0e3fded9ff14 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:44.631518 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7f8011dd-6ef4-40ff-9b3d-0e3fded9ff14 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:44.631989 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-7f8011dd-6ef4-40ff-9b3d-0e3fded9ff14 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lazy-loading 'fault' on Instance uuid ffa59f14-0af0-4c3d-b6b8-75d5c15254fa {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:43:44.678137 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7f8011dd-6ef4-40ff-9b3d-0e3fded9ff14 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:43:44.685353 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7f8011dd-6ef4-40ff-9b3d-0e3fded9ff14 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa" status: 200 len: 1328 microversion: 2.1 time: 0.107032 Sep 10 12:43:44.685929 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3506/7019] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:43:44 2022] GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa => generated 1328 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:43:45.710641 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-04f20461-cc4a-4db9-aa59-ae966e304df0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:43:45.711408 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-04f20461-cc4a-4db9-aa59-ae966e304df0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:43:45.717677 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-04f20461-cc4a-4db9-aa59-ae966e304df0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:45.718113 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-04f20461-cc4a-4db9-aa59-ae966e304df0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:45.718563 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-04f20461-cc4a-4db9-aa59-ae966e304df0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:45.719291 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-04f20461-cc4a-4db9-aa59-ae966e304df0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:45.719760 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-04f20461-cc4a-4db9-aa59-ae966e304df0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:45.720199 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-04f20461-cc4a-4db9-aa59-ae966e304df0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:45.733531 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-04f20461-cc4a-4db9-aa59-ae966e304df0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] HTTP exception thrown: Instance ffa59f14-0af0-4c3d-b6b8-75d5c15254fa could not be found. Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-04f20461-cc4a-4db9-aa59-ae966e304df0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Request method failure captured: Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa HTTP/1.1 Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHIY9pEcRxalGK0PRpWwJTPeIAmQdSVovGoKpjRHBadvNmS2zGA_1an-TV7fdcpLow3fAP0-09VXHTMTC_3vkf2uc1w0SzWzU41k8Z5jw87gxtxl3CjHwSJsSu8lEyMnyoe3KziUpq4KmRSdH5R3eKqmRJRunRX8W6B-IBvqRpO11xPw Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: e5650f863c8c4cfc99dff86c5cb891de Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e5650f863c8c4cfc99dff86c5cb891de", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: e5650f863c8c4cfc99dff86c5cb891de Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServerActionsTestJSON-1025860466-project Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 654c64f49ef84816856aa9227f58a117 Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServerActionsTestJSON-1025860466-project Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance ffa59f14-0af0-4c3d-b6b8-75d5c15254fa could not be found. Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'ffa59f14-0af0-4c3d-b6b8-75d5c15254fa'} Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffa59f14-0af0-4c3d-b6b8-75d5c15254fa could not be found. Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffa59f14-0af0-4c3d-b6b8-75d5c15254fa could not be found. Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:43:45.735200 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:43:45.739850 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:43:45.739850 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:43:45.739850 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:43:45.739850 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:43:45.739850 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:43:45.739850 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffa59f14-0af0-4c3d-b6b8-75d5c15254fa could not be found. Sep 10 12:43:45.739850 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:43:45.739850 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-04f20461-cc4a-4db9-aa59-ae966e304df0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Returning 404 to user: Instance ffa59f14-0af0-4c3d-b6b8-75d5c15254fa could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:43:45.739850 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-04f20461-cc4a-4db9-aa59-ae966e304df0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa" status: 404 len: 111 microversion: 2.1 time: 0.031127 Sep 10 12:43:45.739850 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3514/7020] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:43:45 2022] GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:43:45.748364 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-af54ecd6-5f67-4f6e-8d12-e69de8dfda06 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:43:45.749499 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-af54ecd6-5f67-4f6e-8d12-e69de8dfda06 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:43:45.756317 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-af54ecd6-5f67-4f6e-8d12-e69de8dfda06 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:45.756802 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-af54ecd6-5f67-4f6e-8d12-e69de8dfda06 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:45.757243 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-af54ecd6-5f67-4f6e-8d12-e69de8dfda06 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:45.757936 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-af54ecd6-5f67-4f6e-8d12-e69de8dfda06 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:45.758394 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-af54ecd6-5f67-4f6e-8d12-e69de8dfda06 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:45.758822 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-af54ecd6-5f67-4f6e-8d12-e69de8dfda06 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:45.772841 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-af54ecd6-5f67-4f6e-8d12-e69de8dfda06 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] HTTP exception thrown: Instance ffa59f14-0af0-4c3d-b6b8-75d5c15254fa could not be found. Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-af54ecd6-5f67-4f6e-8d12-e69de8dfda06 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Request method failure captured: Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa HTTP/1.1 Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHIY9pEcRxalGK0PRpWwJTPeIAmQdSVovGoKpjRHBadvNmS2zGA_1an-TV7fdcpLow3fAP0-09VXHTMTC_3vkf2uc1w0SzWzU41k8Z5jw87gxtxl3CjHwSJsSu8lEyMnyoe3KziUpq4KmRSdH5R3eKqmRJRunRX8W6B-IBvqRpO11xPw Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: e5650f863c8c4cfc99dff86c5cb891de Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e5650f863c8c4cfc99dff86c5cb891de", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: e5650f863c8c4cfc99dff86c5cb891de Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServerActionsTestJSON-1025860466-project Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 654c64f49ef84816856aa9227f58a117 Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServerActionsTestJSON-1025860466-project Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance ffa59f14-0af0-4c3d-b6b8-75d5c15254fa could not be found. Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'ffa59f14-0af0-4c3d-b6b8-75d5c15254fa'} Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffa59f14-0af0-4c3d-b6b8-75d5c15254fa could not be found. Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffa59f14-0af0-4c3d-b6b8-75d5c15254fa could not be found. Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:43:45.774500 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:43:45.778849 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:43:45.778849 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:43:45.778849 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:43:45.778849 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:43:45.778849 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:43:45.778849 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffa59f14-0af0-4c3d-b6b8-75d5c15254fa could not be found. Sep 10 12:43:45.778849 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:43:45.778849 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-af54ecd6-5f67-4f6e-8d12-e69de8dfda06 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Returning 404 to user: Instance ffa59f14-0af0-4c3d-b6b8-75d5c15254fa could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:43:45.778849 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-af54ecd6-5f67-4f6e-8d12-e69de8dfda06 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa" status: 404 len: 111 microversion: 2.1 time: 0.031735 Sep 10 12:43:45.778849 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3507/7021] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:43:45 2022] GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:43:45.824144 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d48990d2-822e-4a32-8c87-6b6eb0d3afca tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1559122960", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "0c9debbf-f324-4b51-a679-6e561d56780c"}], "security_groups": [{"name": "tempest-securitygroup--451320238"}], "key_name": "tempest-keypair-1213083482", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:43:45.928947 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-d48990d2-822e-4a32-8c87-6b6eb0d3afca tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] validate_networks() for [('0c9debbf-f324-4b51-a679-6e561d56780c', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:43:46.299499 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-d48990d2-822e-4a32-8c87-6b6eb0d3afca tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:43:46.299960 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-d48990d2-822e-4a32-8c87-6b6eb0d3afca tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:43:46.300451 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-d48990d2-822e-4a32-8c87-6b6eb0d3afca tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:43:46.300876 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-d48990d2-822e-4a32-8c87-6b6eb0d3afca tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:43:46.301302 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-d48990d2-822e-4a32-8c87-6b6eb0d3afca tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:43:46.310452 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d48990d2-822e-4a32-8c87-6b6eb0d3afca tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:46.310950 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d48990d2-822e-4a32-8c87-6b6eb0d3afca tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:46.311435 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d48990d2-822e-4a32-8c87-6b6eb0d3afca tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:46.312185 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d48990d2-822e-4a32-8c87-6b6eb0d3afca tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:46.312652 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d48990d2-822e-4a32-8c87-6b6eb0d3afca tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:46.313093 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d48990d2-822e-4a32-8c87-6b6eb0d3afca tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:46.329772 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-d48990d2-822e-4a32-8c87-6b6eb0d3afca tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Getting quotas for project e5650f863c8c4cfc99dff86c5cb891de. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:43:46.335044 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-d48990d2-822e-4a32-8c87-6b6eb0d3afca tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Getting quotas for user 654c64f49ef84816856aa9227f58a117 and project e5650f863c8c4cfc99dff86c5cb891de. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:43:46.348090 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d48990d2-822e-4a32-8c87-6b6eb0d3afca tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:43:46.350422 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d48990d2-822e-4a32-8c87-6b6eb0d3afca tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:43:46.401266 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d48990d2-822e-4a32-8c87-6b6eb0d3afca tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.580910 Sep 10 12:43:46.401914 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3515/7022] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:43:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:43:46.414416 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-46500e6f-7398-4a85-8fc1-4dd18506a0d8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:43:46.415128 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-46500e6f-7398-4a85-8fc1-4dd18506a0d8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:43:46.469880 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-46500e6f-7398-4a85-8fc1-4dd18506a0d8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:43:46.476912 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-46500e6f-7398-4a85-8fc1-4dd18506a0d8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 200 len: 1239 microversion: 2.1 time: 0.066728 Sep 10 12:43:46.477477 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3508/7023] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:43:46 2022] GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 1239 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:43:47.502516 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bc9e2301-7807-4f84-85b8-deffb890fbad tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:43:47.503190 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bc9e2301-7807-4f84-85b8-deffb890fbad tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:43:47.510092 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc9e2301-7807-4f84-85b8-deffb890fbad tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:47.510591 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc9e2301-7807-4f84-85b8-deffb890fbad tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:47.511042 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc9e2301-7807-4f84-85b8-deffb890fbad tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:47.511795 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc9e2301-7807-4f84-85b8-deffb890fbad tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:47.512270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc9e2301-7807-4f84-85b8-deffb890fbad tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:47.512711 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc9e2301-7807-4f84-85b8-deffb890fbad tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:47.577304 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bc9e2301-7807-4f84-85b8-deffb890fbad tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:43:47.585236 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bc9e2301-7807-4f84-85b8-deffb890fbad tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 200 len: 1297 microversion: 2.1 time: 0.087699 Sep 10 12:43:47.585811 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3516/7024] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:43:47 2022] GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 1297 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:43:48.609454 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-da90b64f-66cc-47bf-b672-9c3164ea5e99 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:43:48.610077 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-da90b64f-66cc-47bf-b672-9c3164ea5e99 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:43:48.617067 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-da90b64f-66cc-47bf-b672-9c3164ea5e99 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:48.617552 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-da90b64f-66cc-47bf-b672-9c3164ea5e99 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:48.618112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-da90b64f-66cc-47bf-b672-9c3164ea5e99 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:48.618671 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-da90b64f-66cc-47bf-b672-9c3164ea5e99 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:48.619128 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-da90b64f-66cc-47bf-b672-9c3164ea5e99 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:48.619578 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-da90b64f-66cc-47bf-b672-9c3164ea5e99 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:48.754635 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-da90b64f-66cc-47bf-b672-9c3164ea5e99 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:43:48.763794 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-da90b64f-66cc-47bf-b672-9c3164ea5e99 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 200 len: 1364 microversion: 2.1 time: 0.158619 Sep 10 12:43:48.765133 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3509/7025] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:43:48 2022] GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:43:48.768283 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-38fb4d69-8a9f-45cd-8e7a-7f37f1402caf req-a37fbcbe-3f1c-478b-b7a6-a8f30efb8d96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84bb01bc-39dd-45dd-8435-5d7578628f38", "tag": "f62cb61f-1b87-474f-a16c-e4a57eac6d8e"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:43:48.780955 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-38fb4d69-8a9f-45cd-8e7a-7f37f1402caf req-a37fbcbe-3f1c-478b-b7a6-a8f30efb8d96 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:48.781593 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-38fb4d69-8a9f-45cd-8e7a-7f37f1402caf req-a37fbcbe-3f1c-478b-b7a6-a8f30efb8d96 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:48.782113 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-38fb4d69-8a9f-45cd-8e7a-7f37f1402caf req-a37fbcbe-3f1c-478b-b7a6-a8f30efb8d96 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:48.794360 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-38fb4d69-8a9f-45cd-8e7a-7f37f1402caf req-a37fbcbe-3f1c-478b-b7a6-a8f30efb8d96 service nova] Creating event network-changed:f62cb61f-1b87-474f-a16c-e4a57eac6d8e for instance 84bb01bc-39dd-45dd-8435-5d7578628f38 on n-h2-856895-1 Sep 10 12:43:48.800069 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-38fb4d69-8a9f-45cd-8e7a-7f37f1402caf req-a37fbcbe-3f1c-478b-b7a6-a8f30efb8d96 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039309 Sep 10 12:43:48.800756 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3517/7026] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:43:49.790048 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a0b7aa40-b9d4-45ab-a9c5-ac6e7fc38757 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:43:49.790673 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a0b7aa40-b9d4-45ab-a9c5-ac6e7fc38757 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:43:49.797910 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a0b7aa40-b9d4-45ab-a9c5-ac6e7fc38757 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:49.798400 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a0b7aa40-b9d4-45ab-a9c5-ac6e7fc38757 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:49.798845 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a0b7aa40-b9d4-45ab-a9c5-ac6e7fc38757 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:49.799569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a0b7aa40-b9d4-45ab-a9c5-ac6e7fc38757 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:49.800033 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a0b7aa40-b9d4-45ab-a9c5-ac6e7fc38757 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:49.800459 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a0b7aa40-b9d4-45ab-a9c5-ac6e7fc38757 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:49.930225 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a0b7aa40-b9d4-45ab-a9c5-ac6e7fc38757 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:43:49.938010 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a0b7aa40-b9d4-45ab-a9c5-ac6e7fc38757 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 200 len: 1364 microversion: 2.1 time: 0.151899 Sep 10 12:43:49.938579 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3510/7027] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:43:49 2022] GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:43:50.963861 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a419383a-a6c0-473b-842b-d41bfbf22a39 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:43:50.964586 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a419383a-a6c0-473b-842b-d41bfbf22a39 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:43:50.966567 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:43:50.972660 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a419383a-a6c0-473b-842b-d41bfbf22a39 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:50.973163 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a419383a-a6c0-473b-842b-d41bfbf22a39 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:50.973624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a419383a-a6c0-473b-842b-d41bfbf22a39 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:50.974332 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a419383a-a6c0-473b-842b-d41bfbf22a39 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:50.974800 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a419383a-a6c0-473b-842b-d41bfbf22a39 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:50.975271 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a419383a-a6c0-473b-842b-d41bfbf22a39 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:51.110196 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a419383a-a6c0-473b-842b-d41bfbf22a39 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:43:51.118334 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a419383a-a6c0-473b-842b-d41bfbf22a39 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 200 len: 1364 microversion: 2.1 time: 0.159630 Sep 10 12:43:51.118928 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3518/7028] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:43:50 2022] GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:43:52.143221 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fcb8209c-0bb0-45b6-8e07-7cf73aa74a5e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:43:52.143849 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fcb8209c-0bb0-45b6-8e07-7cf73aa74a5e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:43:52.146637 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=51 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:43:52.151947 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fcb8209c-0bb0-45b6-8e07-7cf73aa74a5e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:52.152435 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fcb8209c-0bb0-45b6-8e07-7cf73aa74a5e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:52.152873 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fcb8209c-0bb0-45b6-8e07-7cf73aa74a5e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:52.153565 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fcb8209c-0bb0-45b6-8e07-7cf73aa74a5e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:52.154020 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fcb8209c-0bb0-45b6-8e07-7cf73aa74a5e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:52.154448 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fcb8209c-0bb0-45b6-8e07-7cf73aa74a5e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:52.290791 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fcb8209c-0bb0-45b6-8e07-7cf73aa74a5e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:43:52.299327 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fcb8209c-0bb0-45b6-8e07-7cf73aa74a5e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 200 len: 1364 microversion: 2.1 time: 0.160561 Sep 10 12:43:52.299917 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3511/7029] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:43:52 2022] GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:43:53.324426 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5489f847-ce42-46af-a486-1f3b9a7abe01 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:43:53.325062 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5489f847-ce42-46af-a486-1f3b9a7abe01 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:43:53.332365 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5489f847-ce42-46af-a486-1f3b9a7abe01 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:53.332867 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5489f847-ce42-46af-a486-1f3b9a7abe01 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:53.333324 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5489f847-ce42-46af-a486-1f3b9a7abe01 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:53.334034 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5489f847-ce42-46af-a486-1f3b9a7abe01 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:53.334512 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5489f847-ce42-46af-a486-1f3b9a7abe01 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:53.334963 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5489f847-ce42-46af-a486-1f3b9a7abe01 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:53.468835 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5489f847-ce42-46af-a486-1f3b9a7abe01 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:43:53.476616 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5489f847-ce42-46af-a486-1f3b9a7abe01 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 200 len: 1364 microversion: 2.1 time: 0.156100 Sep 10 12:43:53.477187 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3519/7030] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:43:53 2022] GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:43:53.751349 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-0f28a622-753d-4220-a4f6-bf438a1e0f57 req-c8bc6015-14b2-4ba8-af76-cb96fa54901b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84bb01bc-39dd-45dd-8435-5d7578628f38", "name": "network-vif-plugged", "status": "completed", "tag": "f62cb61f-1b87-474f-a16c-e4a57eac6d8e"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:43:53.765290 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0f28a622-753d-4220-a4f6-bf438a1e0f57 req-c8bc6015-14b2-4ba8-af76-cb96fa54901b service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:53.765779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0f28a622-753d-4220-a4f6-bf438a1e0f57 req-c8bc6015-14b2-4ba8-af76-cb96fa54901b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:53.766219 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0f28a622-753d-4220-a4f6-bf438a1e0f57 req-c8bc6015-14b2-4ba8-af76-cb96fa54901b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:53.777650 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-0f28a622-753d-4220-a4f6-bf438a1e0f57 req-c8bc6015-14b2-4ba8-af76-cb96fa54901b service nova] Creating event network-vif-plugged:f62cb61f-1b87-474f-a16c-e4a57eac6d8e for instance 84bb01bc-39dd-45dd-8435-5d7578628f38 on n-h2-856895-1 Sep 10 12:43:53.783697 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-0f28a622-753d-4220-a4f6-bf438a1e0f57 req-c8bc6015-14b2-4ba8-af76-cb96fa54901b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036892 Sep 10 12:43:53.784308 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3512/7031] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:43:54.501052 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2f2a20fb-6f7b-4461-a321-5f36fbb95d3b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:43:54.501600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2f2a20fb-6f7b-4461-a321-5f36fbb95d3b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:43:54.508940 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f2a20fb-6f7b-4461-a321-5f36fbb95d3b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:54.509436 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f2a20fb-6f7b-4461-a321-5f36fbb95d3b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:54.509896 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f2a20fb-6f7b-4461-a321-5f36fbb95d3b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:54.510600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f2a20fb-6f7b-4461-a321-5f36fbb95d3b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:54.511074 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f2a20fb-6f7b-4461-a321-5f36fbb95d3b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:54.511543 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f2a20fb-6f7b-4461-a321-5f36fbb95d3b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:54.654217 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2f2a20fb-6f7b-4461-a321-5f36fbb95d3b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:43:54.662412 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2f2a20fb-6f7b-4461-a321-5f36fbb95d3b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 200 len: 1364 microversion: 2.1 time: 0.166072 Sep 10 12:43:54.662984 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3520/7032] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:43:54 2022] GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:43:55.685792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7a110123-cf9d-43ef-ab81-a9d7f251c235 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:43:55.686535 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7a110123-cf9d-43ef-ab81-a9d7f251c235 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:43:55.694077 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7a110123-cf9d-43ef-ab81-a9d7f251c235 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:55.694567 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7a110123-cf9d-43ef-ab81-a9d7f251c235 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:55.695008 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7a110123-cf9d-43ef-ab81-a9d7f251c235 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:55.695732 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7a110123-cf9d-43ef-ab81-a9d7f251c235 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:55.696191 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7a110123-cf9d-43ef-ab81-a9d7f251c235 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:55.696622 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7a110123-cf9d-43ef-ab81-a9d7f251c235 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:55.825628 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7a110123-cf9d-43ef-ab81-a9d7f251c235 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:43:55.833460 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7a110123-cf9d-43ef-ab81-a9d7f251c235 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 200 len: 1551 microversion: 2.1 time: 0.151970 Sep 10 12:43:55.834029 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3513/7033] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:43:55 2022] GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 1551 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:43:55.856429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c0782132-fd13-4e79-a0b0-656a1fbb8dd7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:43:55.856922 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c0782132-fd13-4e79-a0b0-656a1fbb8dd7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:43:55.864619 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0782132-fd13-4e79-a0b0-656a1fbb8dd7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:55.865116 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0782132-fd13-4e79-a0b0-656a1fbb8dd7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:55.865570 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0782132-fd13-4e79-a0b0-656a1fbb8dd7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:55.866303 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0782132-fd13-4e79-a0b0-656a1fbb8dd7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:55.866771 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0782132-fd13-4e79-a0b0-656a1fbb8dd7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:55.867228 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0782132-fd13-4e79-a0b0-656a1fbb8dd7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:55.945052 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c0782132-fd13-4e79-a0b0-656a1fbb8dd7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092404 Sep 10 12:43:55.945662 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3521/7034] 10.222.0.23 () {58 vars in 1275 bytes} [Sat Sep 10 12:43:55 2022] GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:43:56.898583 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:43:56.955679 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-5f2d31b9-7391-45ee-aee3-96940689afad req-fff1a20b-3100-484a-a013-c72974748a00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84bb01bc-39dd-45dd-8435-5d7578628f38", "tag": "f62cb61f-1b87-474f-a16c-e4a57eac6d8e"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:43:56.965435 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-5f2d31b9-7391-45ee-aee3-96940689afad req-fff1a20b-3100-484a-a013-c72974748a00 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:43:56.965925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-5f2d31b9-7391-45ee-aee3-96940689afad req-fff1a20b-3100-484a-a013-c72974748a00 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:43:56.966365 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-5f2d31b9-7391-45ee-aee3-96940689afad req-fff1a20b-3100-484a-a013-c72974748a00 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:43:56.978348 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-5f2d31b9-7391-45ee-aee3-96940689afad req-fff1a20b-3100-484a-a013-c72974748a00 service nova] Creating event network-changed:f62cb61f-1b87-474f-a16c-e4a57eac6d8e for instance 84bb01bc-39dd-45dd-8435-5d7578628f38 on n-h2-856895-1 Sep 10 12:43:56.983649 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-5f2d31b9-7391-45ee-aee3-96940689afad req-fff1a20b-3100-484a-a013-c72974748a00 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089489 Sep 10 12:43:56.985098 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3514/7035] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:44:29.866114 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:44:29.867103 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:44:29.869336 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=7 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:44:29.870237 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=38 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:44:29.875050 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2bc5936f-4272-469b-869f-cde635a8fb5f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:44:29.883334 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2bc5936f-4272-469b-869f-cde635a8fb5f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:29.883832 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2bc5936f-4272-469b-869f-cde635a8fb5f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:29.884282 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2bc5936f-4272-469b-869f-cde635a8fb5f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:29.908846 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2bc5936f-4272-469b-869f-cde635a8fb5f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Going to try to stop instance {{(pid=128776) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 10 12:44:29.950754 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2bc5936f-4272-469b-869f-cde635a8fb5f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "POST /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38/action" status: 202 len: 0 microversion: 2.1 time: 0.085047 Sep 10 12:44:29.951394 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3522/7036] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:44:29 2022] POST /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:44:29.958928 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=7 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:44:29.959784 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=45 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:44:29.964312 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e0afeead-35ef-4a3e-bb9d-8219a68b69d0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:44:29.965110 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e0afeead-35ef-4a3e-bb9d-8219a68b69d0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:44:29.972883 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0afeead-35ef-4a3e-bb9d-8219a68b69d0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:29.973373 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0afeead-35ef-4a3e-bb9d-8219a68b69d0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:29.973810 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0afeead-35ef-4a3e-bb9d-8219a68b69d0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:29.974512 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0afeead-35ef-4a3e-bb9d-8219a68b69d0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:29.974970 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0afeead-35ef-4a3e-bb9d-8219a68b69d0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:29.975422 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0afeead-35ef-4a3e-bb9d-8219a68b69d0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:30.108686 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e0afeead-35ef-4a3e-bb9d-8219a68b69d0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:44:30.116786 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e0afeead-35ef-4a3e-bb9d-8219a68b69d0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 200 len: 1680 microversion: 2.1 time: 0.160705 Sep 10 12:44:30.117298 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3515/7037] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:44:29 2022] GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:44:31.141006 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cb4c0467-9ed1-45ab-8517-61a939098f2c tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:44:31.141723 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cb4c0467-9ed1-45ab-8517-61a939098f2c tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:44:31.149773 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb4c0467-9ed1-45ab-8517-61a939098f2c tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:31.150263 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb4c0467-9ed1-45ab-8517-61a939098f2c tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:31.150711 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb4c0467-9ed1-45ab-8517-61a939098f2c tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:31.151432 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb4c0467-9ed1-45ab-8517-61a939098f2c tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:31.151900 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb4c0467-9ed1-45ab-8517-61a939098f2c tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:31.152337 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cb4c0467-9ed1-45ab-8517-61a939098f2c tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:31.286483 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-cb4c0467-9ed1-45ab-8517-61a939098f2c tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:44:31.294509 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cb4c0467-9ed1-45ab-8517-61a939098f2c tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 200 len: 1680 microversion: 2.1 time: 0.157777 Sep 10 12:44:31.295093 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3523/7038] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:44:31 2022] GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:44:32.317959 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4835144d-6420-47a4-8094-ad140850ca02 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:44:32.318573 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4835144d-6420-47a4-8094-ad140850ca02 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:44:32.325380 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4835144d-6420-47a4-8094-ad140850ca02 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:32.325863 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4835144d-6420-47a4-8094-ad140850ca02 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:32.326299 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4835144d-6420-47a4-8094-ad140850ca02 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:32.326985 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4835144d-6420-47a4-8094-ad140850ca02 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:32.327480 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4835144d-6420-47a4-8094-ad140850ca02 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:32.327905 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4835144d-6420-47a4-8094-ad140850ca02 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:32.455634 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4835144d-6420-47a4-8094-ad140850ca02 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:44:32.463967 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4835144d-6420-47a4-8094-ad140850ca02 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 200 len: 1680 microversion: 2.1 time: 0.149938 Sep 10 12:44:32.464543 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3516/7039] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:44:32 2022] GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:44:33.488068 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-119d7e63-da50-4ecc-a775-591f8551bdc7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:44:33.488813 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-119d7e63-da50-4ecc-a775-591f8551bdc7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:44:33.495889 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-119d7e63-da50-4ecc-a775-591f8551bdc7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:33.496414 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-119d7e63-da50-4ecc-a775-591f8551bdc7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:33.496868 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-119d7e63-da50-4ecc-a775-591f8551bdc7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:33.497578 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-119d7e63-da50-4ecc-a775-591f8551bdc7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:33.498047 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-119d7e63-da50-4ecc-a775-591f8551bdc7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:33.498489 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-119d7e63-da50-4ecc-a775-591f8551bdc7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:33.628607 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-119d7e63-da50-4ecc-a775-591f8551bdc7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:44:33.636893 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-119d7e63-da50-4ecc-a775-591f8551bdc7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 200 len: 1680 microversion: 2.1 time: 0.152833 Sep 10 12:44:33.637471 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3524/7040] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:44:33 2022] GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:44:34.662357 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2e3f4be5-05e9-4e8f-9137-c8085d805954 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:44:34.662975 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2e3f4be5-05e9-4e8f-9137-c8085d805954 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:44:34.669800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2e3f4be5-05e9-4e8f-9137-c8085d805954 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:34.670281 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2e3f4be5-05e9-4e8f-9137-c8085d805954 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:34.670718 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2e3f4be5-05e9-4e8f-9137-c8085d805954 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:34.671454 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2e3f4be5-05e9-4e8f-9137-c8085d805954 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:34.671912 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2e3f4be5-05e9-4e8f-9137-c8085d805954 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:34.672337 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2e3f4be5-05e9-4e8f-9137-c8085d805954 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:34.806040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2e3f4be5-05e9-4e8f-9137-c8085d805954 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:44:34.813824 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2e3f4be5-05e9-4e8f-9137-c8085d805954 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 200 len: 1680 microversion: 2.1 time: 0.155901 Sep 10 12:44:34.814405 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3517/7041] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:44:34 2022] GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:44:35.837988 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-af23778f-a80b-4f92-b2f1-1cc0f6ed95b8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:44:35.838627 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-af23778f-a80b-4f92-b2f1-1cc0f6ed95b8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:44:35.845486 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af23778f-a80b-4f92-b2f1-1cc0f6ed95b8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:35.845988 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af23778f-a80b-4f92-b2f1-1cc0f6ed95b8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:35.846445 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af23778f-a80b-4f92-b2f1-1cc0f6ed95b8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:35.847152 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af23778f-a80b-4f92-b2f1-1cc0f6ed95b8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:35.847651 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af23778f-a80b-4f92-b2f1-1cc0f6ed95b8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:35.848610 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-af23778f-a80b-4f92-b2f1-1cc0f6ed95b8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:35.979952 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-af23778f-a80b-4f92-b2f1-1cc0f6ed95b8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:44:35.987722 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-af23778f-a80b-4f92-b2f1-1cc0f6ed95b8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 200 len: 1680 microversion: 2.1 time: 0.153719 Sep 10 12:44:35.988318 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3525/7042] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:44:35 2022] GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:44:37.011704 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ddcb41a6-4a39-4482-b4a4-8741f1e08b64 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:44:37.012334 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ddcb41a6-4a39-4482-b4a4-8741f1e08b64 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:44:37.019411 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ddcb41a6-4a39-4482-b4a4-8741f1e08b64 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:37.019963 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ddcb41a6-4a39-4482-b4a4-8741f1e08b64 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:37.020647 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ddcb41a6-4a39-4482-b4a4-8741f1e08b64 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:37.021547 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ddcb41a6-4a39-4482-b4a4-8741f1e08b64 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:37.022011 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ddcb41a6-4a39-4482-b4a4-8741f1e08b64 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:37.022445 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ddcb41a6-4a39-4482-b4a4-8741f1e08b64 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:37.156441 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ddcb41a6-4a39-4482-b4a4-8741f1e08b64 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:44:37.164670 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ddcb41a6-4a39-4482-b4a4-8741f1e08b64 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 200 len: 1680 microversion: 2.1 time: 0.156925 Sep 10 12:44:37.165266 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3518/7043] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:44:37 2022] GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:44:38.189705 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b258fa62-548a-4174-8100-b50c02708c7e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:44:38.190343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b258fa62-548a-4174-8100-b50c02708c7e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:44:38.197145 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b258fa62-548a-4174-8100-b50c02708c7e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:38.197643 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b258fa62-548a-4174-8100-b50c02708c7e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:38.198099 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b258fa62-548a-4174-8100-b50c02708c7e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:38.198804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b258fa62-548a-4174-8100-b50c02708c7e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:38.199303 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b258fa62-548a-4174-8100-b50c02708c7e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:38.199751 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b258fa62-548a-4174-8100-b50c02708c7e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:38.327734 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b258fa62-548a-4174-8100-b50c02708c7e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:44:38.336435 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b258fa62-548a-4174-8100-b50c02708c7e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 200 len: 1680 microversion: 2.1 time: 0.150747 Sep 10 12:44:38.337118 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3526/7044] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:44:38 2022] GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:44:39.360900 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c7d00108-2250-4b9e-b2ef-9407f7775074 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:44:39.361533 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c7d00108-2250-4b9e-b2ef-9407f7775074 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:44:39.369191 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7d00108-2250-4b9e-b2ef-9407f7775074 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:39.369608 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7d00108-2250-4b9e-b2ef-9407f7775074 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:39.370312 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7d00108-2250-4b9e-b2ef-9407f7775074 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:39.371012 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7d00108-2250-4b9e-b2ef-9407f7775074 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:39.371511 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7d00108-2250-4b9e-b2ef-9407f7775074 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:39.371949 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7d00108-2250-4b9e-b2ef-9407f7775074 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:39.503615 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c7d00108-2250-4b9e-b2ef-9407f7775074 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:44:39.511600 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c7d00108-2250-4b9e-b2ef-9407f7775074 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 200 len: 1680 microversion: 2.1 time: 0.155004 Sep 10 12:44:39.512180 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3519/7045] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:44:39 2022] GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:44:40.534424 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d8a9ae52-5e91-44b5-b960-2ca1828c6701 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:44:40.534963 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d8a9ae52-5e91-44b5-b960-2ca1828c6701 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:44:40.542547 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d8a9ae52-5e91-44b5-b960-2ca1828c6701 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:40.543035 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d8a9ae52-5e91-44b5-b960-2ca1828c6701 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:40.543513 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d8a9ae52-5e91-44b5-b960-2ca1828c6701 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:40.544210 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d8a9ae52-5e91-44b5-b960-2ca1828c6701 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:40.544676 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d8a9ae52-5e91-44b5-b960-2ca1828c6701 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:40.545115 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d8a9ae52-5e91-44b5-b960-2ca1828c6701 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:40.673166 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d8a9ae52-5e91-44b5-b960-2ca1828c6701 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:44:40.681284 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d8a9ae52-5e91-44b5-b960-2ca1828c6701 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 200 len: 1680 microversion: 2.1 time: 0.150748 Sep 10 12:44:40.681865 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3527/7046] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:44:40 2022] GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:44:41.704599 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-65f6383c-7acb-45ad-93c0-be4c71a2fabf tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:44:41.705219 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-65f6383c-7acb-45ad-93c0-be4c71a2fabf tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:44:41.712798 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-65f6383c-7acb-45ad-93c0-be4c71a2fabf tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:41.713280 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-65f6383c-7acb-45ad-93c0-be4c71a2fabf tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:41.713716 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-65f6383c-7acb-45ad-93c0-be4c71a2fabf tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:41.714430 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-65f6383c-7acb-45ad-93c0-be4c71a2fabf tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:41.714882 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-65f6383c-7acb-45ad-93c0-be4c71a2fabf tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:41.715333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-65f6383c-7acb-45ad-93c0-be4c71a2fabf tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:41.859086 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-65f6383c-7acb-45ad-93c0-be4c71a2fabf tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:44:41.867968 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-65f6383c-7acb-45ad-93c0-be4c71a2fabf tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 200 len: 1680 microversion: 2.1 time: 0.167264 Sep 10 12:44:41.868548 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3520/7047] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:44:41 2022] GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:44:42.891875 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a24066fc-abb5-4257-902d-1b0115332fe7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:44:42.892536 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a24066fc-abb5-4257-902d-1b0115332fe7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:44:42.899461 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a24066fc-abb5-4257-902d-1b0115332fe7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:42.899959 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a24066fc-abb5-4257-902d-1b0115332fe7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:42.900428 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a24066fc-abb5-4257-902d-1b0115332fe7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:42.901107 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a24066fc-abb5-4257-902d-1b0115332fe7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:42.901570 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a24066fc-abb5-4257-902d-1b0115332fe7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:42.902006 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a24066fc-abb5-4257-902d-1b0115332fe7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:43.365086 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a24066fc-abb5-4257-902d-1b0115332fe7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:44:43.372640 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a24066fc-abb5-4257-902d-1b0115332fe7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 200 len: 1680 microversion: 2.1 time: 0.484706 Sep 10 12:44:43.373223 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3528/7048] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:44:42 2022] GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 1680 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:44:44.398017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5fc48ceb-1952-425a-847c-202d00b1247a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:44:44.398546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5fc48ceb-1952-425a-847c-202d00b1247a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:44:44.405519 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5fc48ceb-1952-425a-847c-202d00b1247a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:44.406042 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5fc48ceb-1952-425a-847c-202d00b1247a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:44.406484 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5fc48ceb-1952-425a-847c-202d00b1247a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:44.407190 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5fc48ceb-1952-425a-847c-202d00b1247a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:44.407656 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5fc48ceb-1952-425a-847c-202d00b1247a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:44.408086 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5fc48ceb-1952-425a-847c-202d00b1247a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:44.535421 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5fc48ceb-1952-425a-847c-202d00b1247a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:44:44.544360 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5fc48ceb-1952-425a-847c-202d00b1247a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 200 len: 1680 microversion: 2.1 time: 0.151351 Sep 10 12:44:44.544920 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3521/7049] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:44:44 2022] GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:44:45.568146 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0337fad7-1518-48c2-bcab-6d1ba39f7dfd tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:44:45.568708 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0337fad7-1518-48c2-bcab-6d1ba39f7dfd tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:44:45.575191 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0337fad7-1518-48c2-bcab-6d1ba39f7dfd tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:45.575688 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0337fad7-1518-48c2-bcab-6d1ba39f7dfd tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:45.576140 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0337fad7-1518-48c2-bcab-6d1ba39f7dfd tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:45.576839 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0337fad7-1518-48c2-bcab-6d1ba39f7dfd tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:45.577307 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0337fad7-1518-48c2-bcab-6d1ba39f7dfd tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:45.577752 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0337fad7-1518-48c2-bcab-6d1ba39f7dfd tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:45.708944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0337fad7-1518-48c2-bcab-6d1ba39f7dfd tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:44:45.716639 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0337fad7-1518-48c2-bcab-6d1ba39f7dfd tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 200 len: 1657 microversion: 2.1 time: 0.152824 Sep 10 12:44:45.717217 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3529/7050] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:44:45 2022] GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 1657 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:44:45.740309 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5d366f74-47b3-4b75-a663-45fdbbb6795a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:44:45.742625 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5d366f74-47b3-4b75-a663-45fdbbb6795a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:44:45.750057 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d366f74-47b3-4b75-a663-45fdbbb6795a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:45.750540 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d366f74-47b3-4b75-a663-45fdbbb6795a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:45.750978 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d366f74-47b3-4b75-a663-45fdbbb6795a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:45.751696 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d366f74-47b3-4b75-a663-45fdbbb6795a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:45.752150 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d366f74-47b3-4b75-a663-45fdbbb6795a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:45.752572 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d366f74-47b3-4b75-a663-45fdbbb6795a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:45.780377 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5d366f74-47b3-4b75-a663-45fdbbb6795a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:44:45.786421 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5d366f74-47b3-4b75-a663-45fdbbb6795a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Old instance type m1.heat2, new instance type m1.heat {{(pid=128777) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 12:44:45.793239 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-5d366f74-47b3-4b75-a663-45fdbbb6795a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:44:45.793662 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-5d366f74-47b3-4b75-a663-45fdbbb6795a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:44:45.794138 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-5d366f74-47b3-4b75-a663-45fdbbb6795a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:44:45.794549 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-5d366f74-47b3-4b75-a663-45fdbbb6795a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:44:45.794967 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-5d366f74-47b3-4b75-a663-45fdbbb6795a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:44:45.856893 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5d366f74-47b3-4b75-a663-45fdbbb6795a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "POST /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38/action" status: 202 len: 0 microversion: 2.1 time: 0.120826 Sep 10 12:44:45.857436 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3522/7051] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:44:45 2022] POST /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:44:45.865623 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1bbccd92-e70d-439e-a946-057cfc816b18 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:44:45.866331 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1bbccd92-e70d-439e-a946-057cfc816b18 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:44:45.872609 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1bbccd92-e70d-439e-a946-057cfc816b18 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:45.873106 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1bbccd92-e70d-439e-a946-057cfc816b18 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:45.873749 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1bbccd92-e70d-439e-a946-057cfc816b18 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:45.874458 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1bbccd92-e70d-439e-a946-057cfc816b18 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:45.874934 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1bbccd92-e70d-439e-a946-057cfc816b18 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:45.875417 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1bbccd92-e70d-439e-a946-057cfc816b18 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:46.008083 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1bbccd92-e70d-439e-a946-057cfc816b18 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:44:46.016408 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1bbccd92-e70d-439e-a946-057cfc816b18 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 200 len: 1680 microversion: 2.1 time: 0.154643 Sep 10 12:44:46.016986 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3530/7052] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:44:45 2022] GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:44:47.042583 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2d857937-9a6b-46cf-84d2-d749c066f51d tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:44:47.043109 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2d857937-9a6b-46cf-84d2-d749c066f51d tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:44:47.049986 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2d857937-9a6b-46cf-84d2-d749c066f51d tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:47.050475 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2d857937-9a6b-46cf-84d2-d749c066f51d tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:47.051591 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2d857937-9a6b-46cf-84d2-d749c066f51d tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:47.052285 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2d857937-9a6b-46cf-84d2-d749c066f51d tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:47.052768 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2d857937-9a6b-46cf-84d2-d749c066f51d tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:47.053203 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2d857937-9a6b-46cf-84d2-d749c066f51d tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:47.196001 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2d857937-9a6b-46cf-84d2-d749c066f51d tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:44:47.204126 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2d857937-9a6b-46cf-84d2-d749c066f51d tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 200 len: 1680 microversion: 2.1 time: 0.166538 Sep 10 12:44:47.204702 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3523/7053] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:44:47 2022] GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:44:48.228678 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-660cc5fe-1698-4ab6-ae88-29f055cf3a91 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:44:48.229309 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-660cc5fe-1698-4ab6-ae88-29f055cf3a91 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:44:48.236165 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-660cc5fe-1698-4ab6-ae88-29f055cf3a91 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:48.236665 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-660cc5fe-1698-4ab6-ae88-29f055cf3a91 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:48.237116 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-660cc5fe-1698-4ab6-ae88-29f055cf3a91 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:48.237819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-660cc5fe-1698-4ab6-ae88-29f055cf3a91 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:48.238803 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-660cc5fe-1698-4ab6-ae88-29f055cf3a91 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:48.239262 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-660cc5fe-1698-4ab6-ae88-29f055cf3a91 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:48.369409 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-660cc5fe-1698-4ab6-ae88-29f055cf3a91 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:44:48.377440 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-660cc5fe-1698-4ab6-ae88-29f055cf3a91 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 200 len: 1685 microversion: 2.1 time: 0.152710 Sep 10 12:44:48.378004 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3531/7054] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:44:48 2022] GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:44:49.402125 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-55917a09-c134-48ff-a437-b63fbdc3fb64 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:44:49.402660 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-55917a09-c134-48ff-a437-b63fbdc3fb64 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:44:49.408604 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-55917a09-c134-48ff-a437-b63fbdc3fb64 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:49.409094 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-55917a09-c134-48ff-a437-b63fbdc3fb64 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:49.409536 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-55917a09-c134-48ff-a437-b63fbdc3fb64 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:49.410271 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-55917a09-c134-48ff-a437-b63fbdc3fb64 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:49.410760 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-55917a09-c134-48ff-a437-b63fbdc3fb64 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:49.411247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-55917a09-c134-48ff-a437-b63fbdc3fb64 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:49.548968 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-55917a09-c134-48ff-a437-b63fbdc3fb64 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:44:49.558475 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-55917a09-c134-48ff-a437-b63fbdc3fb64 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 200 len: 1685 microversion: 2.1 time: 0.160679 Sep 10 12:44:49.559060 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3524/7055] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:44:49 2022] GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 1685 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:44:50.002342 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-8400b959-572e-40c2-a220-add04ee36941 req-943e75b7-1b9e-44cb-8125-902bf999f5a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84bb01bc-39dd-45dd-8435-5d7578628f38", "name": "network-vif-unplugged", "status": "completed", "tag": "f62cb61f-1b87-474f-a16c-e4a57eac6d8e"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:44:50.013185 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-8400b959-572e-40c2-a220-add04ee36941 req-943e75b7-1b9e-44cb-8125-902bf999f5a5 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:50.013788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-8400b959-572e-40c2-a220-add04ee36941 req-943e75b7-1b9e-44cb-8125-902bf999f5a5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:50.014378 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-8400b959-572e-40c2-a220-add04ee36941 req-943e75b7-1b9e-44cb-8125-902bf999f5a5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:50.027425 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-8400b959-572e-40c2-a220-add04ee36941 req-943e75b7-1b9e-44cb-8125-902bf999f5a5 service nova] Creating event network-vif-unplugged:f62cb61f-1b87-474f-a16c-e4a57eac6d8e for instance 84bb01bc-39dd-45dd-8435-5d7578628f38 on n-h1-856895-1 Sep 10 12:44:50.032864 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [req-8400b959-572e-40c2-a220-add04ee36941 req-943e75b7-1b9e-44cb-8125-902bf999f5a5 service nova] Instance 84bb01bc-39dd-45dd-8435-5d7578628f38 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856895-1', 'n-h1-856895-1'} {{(pid=128776) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 12:44:50.045353 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-8400b959-572e-40c2-a220-add04ee36941 req-943e75b7-1b9e-44cb-8125-902bf999f5a5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047061 Sep 10 12:44:50.046279 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3532/7056] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:44:50.584593 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-34e7ebba-6f0b-4f5e-9188-b4e5db4209e3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:44:50.585264 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-34e7ebba-6f0b-4f5e-9188-b4e5db4209e3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:44:50.592235 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-34e7ebba-6f0b-4f5e-9188-b4e5db4209e3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:50.592737 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-34e7ebba-6f0b-4f5e-9188-b4e5db4209e3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:50.593210 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-34e7ebba-6f0b-4f5e-9188-b4e5db4209e3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:50.593927 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-34e7ebba-6f0b-4f5e-9188-b4e5db4209e3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:50.594392 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-34e7ebba-6f0b-4f5e-9188-b4e5db4209e3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:50.594828 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-34e7ebba-6f0b-4f5e-9188-b4e5db4209e3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:50.809138 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-34e7ebba-6f0b-4f5e-9188-b4e5db4209e3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:44:50.817614 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-34e7ebba-6f0b-4f5e-9188-b4e5db4209e3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 200 len: 1684 microversion: 2.1 time: 0.238353 Sep 10 12:44:50.818204 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3525/7057] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:44:50 2022] GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 1684 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:44:51.842156 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2bfdba7e-3912-4e14-b8e7-00518d302843 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:44:51.842848 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2bfdba7e-3912-4e14-b8e7-00518d302843 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:44:51.850618 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2bfdba7e-3912-4e14-b8e7-00518d302843 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:51.851118 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2bfdba7e-3912-4e14-b8e7-00518d302843 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:51.851599 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2bfdba7e-3912-4e14-b8e7-00518d302843 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:51.852313 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2bfdba7e-3912-4e14-b8e7-00518d302843 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:51.852791 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2bfdba7e-3912-4e14-b8e7-00518d302843 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:51.853235 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2bfdba7e-3912-4e14-b8e7-00518d302843 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:51.984811 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2bfdba7e-3912-4e14-b8e7-00518d302843 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:44:51.993510 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2bfdba7e-3912-4e14-b8e7-00518d302843 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 200 len: 1682 microversion: 2.1 time: 0.155695 Sep 10 12:44:51.994092 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3533/7058] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:44:51 2022] GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:44:52.085958 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-01d1b11a-042a-4e70-9d01-cfaa3b1f8680 req-8d0c4ab2-ad25-470d-b6a9-f7c6db0c55ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84bb01bc-39dd-45dd-8435-5d7578628f38", "tag": "f62cb61f-1b87-474f-a16c-e4a57eac6d8e"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:44:52.096333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-01d1b11a-042a-4e70-9d01-cfaa3b1f8680 req-8d0c4ab2-ad25-470d-b6a9-f7c6db0c55ec service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:52.096754 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-01d1b11a-042a-4e70-9d01-cfaa3b1f8680 req-8d0c4ab2-ad25-470d-b6a9-f7c6db0c55ec service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:52.097184 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-01d1b11a-042a-4e70-9d01-cfaa3b1f8680 req-8d0c4ab2-ad25-470d-b6a9-f7c6db0c55ec service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:52.109554 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-01d1b11a-042a-4e70-9d01-cfaa3b1f8680 req-8d0c4ab2-ad25-470d-b6a9-f7c6db0c55ec service nova] Creating event network-changed:f62cb61f-1b87-474f-a16c-e4a57eac6d8e for instance 84bb01bc-39dd-45dd-8435-5d7578628f38 on n-h1-856895-1 Sep 10 12:44:52.116165 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [req-01d1b11a-042a-4e70-9d01-cfaa3b1f8680 req-8d0c4ab2-ad25-470d-b6a9-f7c6db0c55ec service nova] Instance 84bb01bc-39dd-45dd-8435-5d7578628f38 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856895-1', 'n-h1-856895-1'} {{(pid=128777) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 12:44:52.127535 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-01d1b11a-042a-4e70-9d01-cfaa3b1f8680 req-8d0c4ab2-ad25-470d-b6a9-f7c6db0c55ec service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045485 Sep 10 12:44:52.128143 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3526/7059] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:44:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:44:53.019912 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2682e775-a5fd-4ea7-88bd-c155c4955209 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:44:53.020708 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2682e775-a5fd-4ea7-88bd-c155c4955209 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:44:53.027737 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2682e775-a5fd-4ea7-88bd-c155c4955209 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:53.028243 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2682e775-a5fd-4ea7-88bd-c155c4955209 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:53.028700 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2682e775-a5fd-4ea7-88bd-c155c4955209 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:53.029412 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2682e775-a5fd-4ea7-88bd-c155c4955209 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:53.029885 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2682e775-a5fd-4ea7-88bd-c155c4955209 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:53.030347 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2682e775-a5fd-4ea7-88bd-c155c4955209 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:53.165380 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2682e775-a5fd-4ea7-88bd-c155c4955209 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:44:53.173121 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2682e775-a5fd-4ea7-88bd-c155c4955209 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 200 len: 1682 microversion: 2.1 time: 0.157980 Sep 10 12:44:53.173702 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3534/7060] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:44:53 2022] GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:44:54.201954 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4a654234-c328-402d-99e5-a8a98e1e869b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:44:54.202723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4a654234-c328-402d-99e5-a8a98e1e869b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:44:54.209478 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a654234-c328-402d-99e5-a8a98e1e869b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:54.209969 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a654234-c328-402d-99e5-a8a98e1e869b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:54.210416 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a654234-c328-402d-99e5-a8a98e1e869b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:54.211115 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a654234-c328-402d-99e5-a8a98e1e869b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:54.211611 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a654234-c328-402d-99e5-a8a98e1e869b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:54.212045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a654234-c328-402d-99e5-a8a98e1e869b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:54.348809 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4a654234-c328-402d-99e5-a8a98e1e869b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:44:54.356580 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4a654234-c328-402d-99e5-a8a98e1e869b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 200 len: 1678 microversion: 2.1 time: 0.160032 Sep 10 12:44:54.357157 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3527/7061] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:44:54 2022] GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:44:54.379930 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9721f764-2d0c-4faf-b6cf-8f5359e3fc46 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:44:54.380477 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9721f764-2d0c-4faf-b6cf-8f5359e3fc46 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:44:54.387306 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9721f764-2d0c-4faf-b6cf-8f5359e3fc46 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:54.387760 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9721f764-2d0c-4faf-b6cf-8f5359e3fc46 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:54.388216 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9721f764-2d0c-4faf-b6cf-8f5359e3fc46 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:54.388946 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9721f764-2d0c-4faf-b6cf-8f5359e3fc46 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:54.389419 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9721f764-2d0c-4faf-b6cf-8f5359e3fc46 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:54.389857 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9721f764-2d0c-4faf-b6cf-8f5359e3fc46 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:54.448514 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9721f764-2d0c-4faf-b6cf-8f5359e3fc46 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "POST /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38/action" status: 204 len: 0 microversion: 2.1 time: 0.072841 Sep 10 12:44:54.449203 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3535/7062] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:44:54 2022] POST /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:44:54.458469 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-dd140dfe-bceb-4e05-b06c-84e1b6405b4e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:44:54.459112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-dd140dfe-bceb-4e05-b06c-84e1b6405b4e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:44:54.465033 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd140dfe-bceb-4e05-b06c-84e1b6405b4e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:54.465578 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd140dfe-bceb-4e05-b06c-84e1b6405b4e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:54.466212 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd140dfe-bceb-4e05-b06c-84e1b6405b4e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:54.467316 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd140dfe-bceb-4e05-b06c-84e1b6405b4e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:54.467899 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd140dfe-bceb-4e05-b06c-84e1b6405b4e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:54.468335 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd140dfe-bceb-4e05-b06c-84e1b6405b4e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:54.603629 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-dd140dfe-bceb-4e05-b06c-84e1b6405b4e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:44:54.611379 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-dd140dfe-bceb-4e05-b06c-84e1b6405b4e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 200 len: 1678 microversion: 2.1 time: 0.157862 Sep 10 12:44:54.611954 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3528/7063] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:44:54 2022] GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:44:55.636545 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4baae7d6-0eb4-4533-af25-3bca086831fe tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:44:55.637903 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4baae7d6-0eb4-4533-af25-3bca086831fe tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:44:55.644323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4baae7d6-0eb4-4533-af25-3bca086831fe tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:55.644888 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4baae7d6-0eb4-4533-af25-3bca086831fe tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:55.646169 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4baae7d6-0eb4-4533-af25-3bca086831fe tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:55.646953 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4baae7d6-0eb4-4533-af25-3bca086831fe tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:55.647520 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4baae7d6-0eb4-4533-af25-3bca086831fe tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:55.648034 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4baae7d6-0eb4-4533-af25-3bca086831fe tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:55.803182 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4baae7d6-0eb4-4533-af25-3bca086831fe tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:44:55.805549 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:44:55.813464 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4baae7d6-0eb4-4533-af25-3bca086831fe tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 200 len: 1657 microversion: 2.1 time: 0.182012 Sep 10 12:44:55.814053 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3536/7064] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:44:55 2022] GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 1657 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:44:55.836015 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-dd98ada8-cc43-496e-b93d-6e280c190410 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:44:55.836638 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-dd98ada8-cc43-496e-b93d-6e280c190410 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:44:55.843482 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd98ada8-cc43-496e-b93d-6e280c190410 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:55.843969 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd98ada8-cc43-496e-b93d-6e280c190410 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:55.844407 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd98ada8-cc43-496e-b93d-6e280c190410 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:55.845105 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd98ada8-cc43-496e-b93d-6e280c190410 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:55.845565 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd98ada8-cc43-496e-b93d-6e280c190410 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:55.845998 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-dd98ada8-cc43-496e-b93d-6e280c190410 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:55.976626 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-dd98ada8-cc43-496e-b93d-6e280c190410 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:44:55.984653 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-dd98ada8-cc43-496e-b93d-6e280c190410 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 200 len: 1657 microversion: 2.1 time: 0.152616 Sep 10 12:44:55.985237 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3529/7065] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:44:55 2022] GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 1657 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:44:56.008164 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-52704014-ea9d-4c60-ab86-28bc66d806d2 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:44:56.015350 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52704014-ea9d-4c60-ab86-28bc66d806d2 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:56.015854 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52704014-ea9d-4c60-ab86-28bc66d806d2 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:56.016309 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52704014-ea9d-4c60-ab86-28bc66d806d2 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:56.039350 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-52704014-ea9d-4c60-ab86-28bc66d806d2 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Going to try to start instance {{(pid=128776) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 10 12:44:56.082846 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-52704014-ea9d-4c60-ab86-28bc66d806d2 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "POST /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38/action" status: 202 len: 0 microversion: 2.1 time: 0.078843 Sep 10 12:44:56.083870 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3537/7066] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:44:56 2022] POST /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:44:56.092197 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4da8c4cb-7af3-4b66-87d3-2ed9d022a4a3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:44:56.093136 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4da8c4cb-7af3-4b66-87d3-2ed9d022a4a3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:44:56.100399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4da8c4cb-7af3-4b66-87d3-2ed9d022a4a3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:56.101338 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4da8c4cb-7af3-4b66-87d3-2ed9d022a4a3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:56.101984 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4da8c4cb-7af3-4b66-87d3-2ed9d022a4a3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:56.102881 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4da8c4cb-7af3-4b66-87d3-2ed9d022a4a3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:56.103530 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4da8c4cb-7af3-4b66-87d3-2ed9d022a4a3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:56.103969 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4da8c4cb-7af3-4b66-87d3-2ed9d022a4a3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:56.124689 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:44:56.288441 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4da8c4cb-7af3-4b66-87d3-2ed9d022a4a3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:44:56.296474 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4da8c4cb-7af3-4b66-87d3-2ed9d022a4a3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 200 len: 1666 microversion: 2.1 time: 0.208413 Sep 10 12:44:56.297001 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3530/7067] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:44:56 2022] GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 1666 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:44:57.325381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0e2e2150-8cb9-4b13-b597-6aa71ba88da0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:44:57.326237 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0e2e2150-8cb9-4b13-b597-6aa71ba88da0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:44:57.332482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e2e2150-8cb9-4b13-b597-6aa71ba88da0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:57.332989 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e2e2150-8cb9-4b13-b597-6aa71ba88da0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:57.333476 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e2e2150-8cb9-4b13-b597-6aa71ba88da0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:57.334149 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e2e2150-8cb9-4b13-b597-6aa71ba88da0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:57.335271 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e2e2150-8cb9-4b13-b597-6aa71ba88da0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:57.336123 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0e2e2150-8cb9-4b13-b597-6aa71ba88da0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:57.472016 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0e2e2150-8cb9-4b13-b597-6aa71ba88da0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:44:57.479855 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0e2e2150-8cb9-4b13-b597-6aa71ba88da0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 200 len: 1670 microversion: 2.1 time: 0.162106 Sep 10 12:44:57.480434 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3538/7068] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:44:57 2022] GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 1670 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:44:57.502984 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0ad78e53-e9dd-46c4-bcf7-abe1ad6be470 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:44:57.503517 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0ad78e53-e9dd-46c4-bcf7-abe1ad6be470 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:44:57.511077 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ad78e53-e9dd-46c4-bcf7-abe1ad6be470 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:57.511599 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ad78e53-e9dd-46c4-bcf7-abe1ad6be470 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:57.512040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ad78e53-e9dd-46c4-bcf7-abe1ad6be470 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:57.512809 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ad78e53-e9dd-46c4-bcf7-abe1ad6be470 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:57.513276 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ad78e53-e9dd-46c4-bcf7-abe1ad6be470 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:57.513777 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ad78e53-e9dd-46c4-bcf7-abe1ad6be470 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:57.542585 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0ad78e53-e9dd-46c4-bcf7-abe1ad6be470 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:44:57.618373 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0ad78e53-e9dd-46c4-bcf7-abe1ad6be470 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "DELETE /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 204 len: 0 microversion: 2.1 time: 0.118961 Sep 10 12:44:57.618986 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3531/7069] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:44:57 2022] DELETE /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:44:57.629118 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cca84c7b-e17b-4604-970a-f24e3e3b7fe4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:44:57.629936 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cca84c7b-e17b-4604-970a-f24e3e3b7fe4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:44:57.640100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cca84c7b-e17b-4604-970a-f24e3e3b7fe4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:57.640694 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cca84c7b-e17b-4604-970a-f24e3e3b7fe4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:57.641256 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cca84c7b-e17b-4604-970a-f24e3e3b7fe4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:57.642128 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cca84c7b-e17b-4604-970a-f24e3e3b7fe4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:57.642684 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cca84c7b-e17b-4604-970a-f24e3e3b7fe4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:57.643136 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cca84c7b-e17b-4604-970a-f24e3e3b7fe4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:57.710182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-ff35732f-cfd9-4d60-a2e6-7b46458961c3 req-0e5b4375-1818-4943-8505-57fb1f7ebd51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84bb01bc-39dd-45dd-8435-5d7578628f38", "name": "network-vif-plugged", "status": "completed", "tag": "f62cb61f-1b87-474f-a16c-e4a57eac6d8e"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:44:57.720137 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-ff35732f-cfd9-4d60-a2e6-7b46458961c3 req-0e5b4375-1818-4943-8505-57fb1f7ebd51 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:57.720629 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-ff35732f-cfd9-4d60-a2e6-7b46458961c3 req-0e5b4375-1818-4943-8505-57fb1f7ebd51 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:57.721132 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-ff35732f-cfd9-4d60-a2e6-7b46458961c3 req-0e5b4375-1818-4943-8505-57fb1f7ebd51 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:57.740055 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-ff35732f-cfd9-4d60-a2e6-7b46458961c3 req-0e5b4375-1818-4943-8505-57fb1f7ebd51 service nova] Creating event network-vif-plugged:f62cb61f-1b87-474f-a16c-e4a57eac6d8e for instance 84bb01bc-39dd-45dd-8435-5d7578628f38 on n-h1-856895-1 Sep 10 12:44:57.746455 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-ff35732f-cfd9-4d60-a2e6-7b46458961c3 req-0e5b4375-1818-4943-8505-57fb1f7ebd51 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040619 Sep 10 12:44:57.747072 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3532/7070] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:44:57.778391 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-cca84c7b-e17b-4604-970a-f24e3e3b7fe4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:44:57.786523 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cca84c7b-e17b-4604-970a-f24e3e3b7fe4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 200 len: 1676 microversion: 2.1 time: 0.162203 Sep 10 12:44:57.787097 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3539/7071] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:44:57 2022] GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:44:58.810545 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cbe9d4e7-2d84-4160-be6f-d9e15f6d7996 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:44:58.811281 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cbe9d4e7-2d84-4160-be6f-d9e15f6d7996 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:44:58.818292 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cbe9d4e7-2d84-4160-be6f-d9e15f6d7996 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:58.819302 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cbe9d4e7-2d84-4160-be6f-d9e15f6d7996 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:58.819970 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cbe9d4e7-2d84-4160-be6f-d9e15f6d7996 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:58.820669 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cbe9d4e7-2d84-4160-be6f-d9e15f6d7996 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:58.821133 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cbe9d4e7-2d84-4160-be6f-d9e15f6d7996 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:58.821561 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cbe9d4e7-2d84-4160-be6f-d9e15f6d7996 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:44:58.957619 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cbe9d4e7-2d84-4160-be6f-d9e15f6d7996 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:44:58.966121 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cbe9d4e7-2d84-4160-be6f-d9e15f6d7996 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 200 len: 1676 microversion: 2.1 time: 0.159834 Sep 10 12:44:58.966691 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3533/7072] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:44:58 2022] GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:44:59.990227 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d8db28d0-2ca3-4b10-b53c-93971d4f1872 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:44:59.990913 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d8db28d0-2ca3-4b10-b53c-93971d4f1872 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:44:59.993500 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=37 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:44:59.998928 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d8db28d0-2ca3-4b10-b53c-93971d4f1872 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:44:59.999464 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d8db28d0-2ca3-4b10-b53c-93971d4f1872 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:44:59.999915 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d8db28d0-2ca3-4b10-b53c-93971d4f1872 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:45:00.000627 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d8db28d0-2ca3-4b10-b53c-93971d4f1872 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:45:00.001093 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d8db28d0-2ca3-4b10-b53c-93971d4f1872 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:45:00.001534 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d8db28d0-2ca3-4b10-b53c-93971d4f1872 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:45:00.081447 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d8db28d0-2ca3-4b10-b53c-93971d4f1872 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:45:00.089763 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d8db28d0-2ca3-4b10-b53c-93971d4f1872 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 200 len: 1609 microversion: 2.1 time: 0.103594 Sep 10 12:45:00.090547 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3540/7073] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:44:59 2022] GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 1609 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:45:00.119871 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-732c6f28-4f16-445c-a902-38f7a8c1dac4 req-a55527a2-20a7-4db2-84a5-beb49b945eee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84bb01bc-39dd-45dd-8435-5d7578628f38", "name": "network-vif-deleted", "tag": "f62cb61f-1b87-474f-a16c-e4a57eac6d8e"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:45:00.127583 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:45:00.137115 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-732c6f28-4f16-445c-a902-38f7a8c1dac4 req-a55527a2-20a7-4db2-84a5-beb49b945eee service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:45:00.137653 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-732c6f28-4f16-445c-a902-38f7a8c1dac4 req-a55527a2-20a7-4db2-84a5-beb49b945eee service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:45:00.138865 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-732c6f28-4f16-445c-a902-38f7a8c1dac4 req-a55527a2-20a7-4db2-84a5-beb49b945eee service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:45:00.151832 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-732c6f28-4f16-445c-a902-38f7a8c1dac4 req-a55527a2-20a7-4db2-84a5-beb49b945eee service nova] Creating event network-vif-deleted:f62cb61f-1b87-474f-a16c-e4a57eac6d8e for instance 84bb01bc-39dd-45dd-8435-5d7578628f38 on n-h1-856895-1 Sep 10 12:45:00.157147 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-732c6f28-4f16-445c-a902-38f7a8c1dac4 req-a55527a2-20a7-4db2-84a5-beb49b945eee service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041439 Sep 10 12:45:00.157978 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3534/7074] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:45:01.114092 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f265b8f3-cbee-4d45-aa7a-ccdafcc6f9d4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:45:01.114722 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f265b8f3-cbee-4d45-aa7a-ccdafcc6f9d4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:45:01.123564 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f265b8f3-cbee-4d45-aa7a-ccdafcc6f9d4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:45:01.124087 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f265b8f3-cbee-4d45-aa7a-ccdafcc6f9d4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:45:01.124542 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f265b8f3-cbee-4d45-aa7a-ccdafcc6f9d4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:45:01.125293 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f265b8f3-cbee-4d45-aa7a-ccdafcc6f9d4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:45:01.125765 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f265b8f3-cbee-4d45-aa7a-ccdafcc6f9d4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:45:01.126207 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f265b8f3-cbee-4d45-aa7a-ccdafcc6f9d4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:45:01.140171 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-f265b8f3-cbee-4d45-aa7a-ccdafcc6f9d4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] HTTP exception thrown: Instance 84bb01bc-39dd-45dd-8435-5d7578628f38 could not be found. Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f265b8f3-cbee-4d45-aa7a-ccdafcc6f9d4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Request method failure captured: Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 HTTP/1.1 Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHIY9pEcRxalGK0PRpWwJTPeIAmQdSVovGoKpjRHBadvNmS2zGA_1an-TV7fdcpLow3fAP0-09VXHTMTC_3vkf2uc1w0SzWzU41k8Z5jw87gxtxl3CjHwSJsSu8lEyMnyoe3KziUpq4KmRSdH5R3eKqmRJRunRX8W6B-IBvqRpO11xPw Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: e5650f863c8c4cfc99dff86c5cb891de Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e5650f863c8c4cfc99dff86c5cb891de", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: e5650f863c8c4cfc99dff86c5cb891de Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServerActionsTestJSON-1025860466-project Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 654c64f49ef84816856aa9227f58a117 Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServerActionsTestJSON-1025860466-project Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 84bb01bc-39dd-45dd-8435-5d7578628f38 could not be found. Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '84bb01bc-39dd-45dd-8435-5d7578628f38'} Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84bb01bc-39dd-45dd-8435-5d7578628f38 could not be found. Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84bb01bc-39dd-45dd-8435-5d7578628f38 could not be found. Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:45:01.141878 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:45:01.146348 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:45:01.146348 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:45:01.146348 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:45:01.146348 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:45:01.146348 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:45:01.146348 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84bb01bc-39dd-45dd-8435-5d7578628f38 could not be found. Sep 10 12:45:01.146348 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:45:01.146348 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f265b8f3-cbee-4d45-aa7a-ccdafcc6f9d4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Returning 404 to user: Instance 84bb01bc-39dd-45dd-8435-5d7578628f38 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:45:01.146348 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f265b8f3-cbee-4d45-aa7a-ccdafcc6f9d4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 404 len: 111 microversion: 2.1 time: 0.033236 Sep 10 12:45:01.146348 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3541/7075] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:45:01 2022] GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:45:01.160617 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5c4310f6-569c-418b-8e4b-8dd7c250a16e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:45:01.161331 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5c4310f6-569c-418b-8e4b-8dd7c250a16e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:45:01.168429 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c4310f6-569c-418b-8e4b-8dd7c250a16e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:45:01.168994 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c4310f6-569c-418b-8e4b-8dd7c250a16e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:45:01.169508 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c4310f6-569c-418b-8e4b-8dd7c250a16e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:45:01.170458 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c4310f6-569c-418b-8e4b-8dd7c250a16e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:45:01.170851 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c4310f6-569c-418b-8e4b-8dd7c250a16e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:45:01.171523 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c4310f6-569c-418b-8e4b-8dd7c250a16e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:45:01.187121 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-5c4310f6-569c-418b-8e4b-8dd7c250a16e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] HTTP exception thrown: Instance 84bb01bc-39dd-45dd-8435-5d7578628f38 could not be found. Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5c4310f6-569c-418b-8e4b-8dd7c250a16e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Request method failure captured: Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 HTTP/1.1 Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHIY9pEcRxalGK0PRpWwJTPeIAmQdSVovGoKpjRHBadvNmS2zGA_1an-TV7fdcpLow3fAP0-09VXHTMTC_3vkf2uc1w0SzWzU41k8Z5jw87gxtxl3CjHwSJsSu8lEyMnyoe3KziUpq4KmRSdH5R3eKqmRJRunRX8W6B-IBvqRpO11xPw Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: e5650f863c8c4cfc99dff86c5cb891de Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e5650f863c8c4cfc99dff86c5cb891de", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: e5650f863c8c4cfc99dff86c5cb891de Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServerActionsTestJSON-1025860466-project Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 654c64f49ef84816856aa9227f58a117 Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServerActionsTestJSON-1025860466-project Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 84bb01bc-39dd-45dd-8435-5d7578628f38 could not be found. Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '84bb01bc-39dd-45dd-8435-5d7578628f38'} Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84bb01bc-39dd-45dd-8435-5d7578628f38 could not be found. Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84bb01bc-39dd-45dd-8435-5d7578628f38 could not be found. Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:45:01.188846 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:45:01.201589 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:45:01.201589 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:45:01.201589 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:45:01.201589 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:45:01.201589 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:45:01.201589 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84bb01bc-39dd-45dd-8435-5d7578628f38 could not be found. Sep 10 12:45:01.201589 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:45:01.201589 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5c4310f6-569c-418b-8e4b-8dd7c250a16e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Returning 404 to user: Instance 84bb01bc-39dd-45dd-8435-5d7578628f38 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:45:01.201589 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5c4310f6-569c-418b-8e4b-8dd7c250a16e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 404 len: 111 microversion: 2.1 time: 0.034954 Sep 10 12:45:01.201589 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3535/7076] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:45:01 2022] GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:45:01.242930 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a50135d8-9752-462b-ac92-bcb2a65154ac tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2012157104", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "0c9debbf-f324-4b51-a679-6e561d56780c"}], "security_groups": [{"name": "tempest-securitygroup--451320238"}], "key_name": "tempest-keypair-1213083482", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:45:01.352891 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-a50135d8-9752-462b-ac92-bcb2a65154ac tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] validate_networks() for [('0c9debbf-f324-4b51-a679-6e561d56780c', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:45:02.114598 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-a50135d8-9752-462b-ac92-bcb2a65154ac tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:45:02.115206 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-a50135d8-9752-462b-ac92-bcb2a65154ac tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:45:02.115659 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-a50135d8-9752-462b-ac92-bcb2a65154ac tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:45:02.116858 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-a50135d8-9752-462b-ac92-bcb2a65154ac tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:45:02.117416 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-a50135d8-9752-462b-ac92-bcb2a65154ac tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:45:02.128022 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a50135d8-9752-462b-ac92-bcb2a65154ac tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:45:02.128549 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a50135d8-9752-462b-ac92-bcb2a65154ac tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:45:02.129010 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a50135d8-9752-462b-ac92-bcb2a65154ac tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:45:02.129764 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a50135d8-9752-462b-ac92-bcb2a65154ac tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:45:02.130440 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a50135d8-9752-462b-ac92-bcb2a65154ac tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:45:02.130897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a50135d8-9752-462b-ac92-bcb2a65154ac tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:45:02.149606 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-a50135d8-9752-462b-ac92-bcb2a65154ac tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Getting quotas for project e5650f863c8c4cfc99dff86c5cb891de. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:45:02.155242 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-a50135d8-9752-462b-ac92-bcb2a65154ac tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Getting quotas for user 654c64f49ef84816856aa9227f58a117 and project e5650f863c8c4cfc99dff86c5cb891de. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:45:02.169116 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a50135d8-9752-462b-ac92-bcb2a65154ac tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:45:02.171524 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a50135d8-9752-462b-ac92-bcb2a65154ac tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:45:02.219011 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a50135d8-9752-462b-ac92-bcb2a65154ac tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.980657 Sep 10 12:45:02.219776 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3542/7077] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:45:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 10 12:45:02.231895 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fd207c95-b44f-40fd-979d-80e5566a2a8a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:45:02.232551 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fd207c95-b44f-40fd-979d-80e5566a2a8a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:45:02.289555 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fd207c95-b44f-40fd-979d-80e5566a2a8a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:45:02.297994 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fd207c95-b44f-40fd-979d-80e5566a2a8a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 200 len: 1239 microversion: 2.1 time: 0.069918 Sep 10 12:45:02.303374 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3536/7078] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:45:02 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 1239 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:45:03.322773 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dcd721be-4b03-4f0b-ad3b-1be2a789ecd3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:45:03.323399 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-dcd721be-4b03-4f0b-ad3b-1be2a789ecd3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:45:03.348855 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dcd721be-4b03-4f0b-ad3b-1be2a789ecd3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:45:03.349385 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dcd721be-4b03-4f0b-ad3b-1be2a789ecd3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:45:03.349848 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dcd721be-4b03-4f0b-ad3b-1be2a789ecd3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:45:03.351098 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dcd721be-4b03-4f0b-ad3b-1be2a789ecd3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:45:03.351779 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dcd721be-4b03-4f0b-ad3b-1be2a789ecd3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:45:03.352235 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dcd721be-4b03-4f0b-ad3b-1be2a789ecd3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:45:03.436952 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-dcd721be-4b03-4f0b-ad3b-1be2a789ecd3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:45:03.444767 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-dcd721be-4b03-4f0b-ad3b-1be2a789ecd3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 200 len: 1309 microversion: 2.1 time: 0.126118 Sep 10 12:45:03.445336 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3543/7079] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:45:03 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 1309 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:45:04.468731 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0ddb5030-6adc-4e74-888c-bf77b652a7d1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:45:04.469381 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0ddb5030-6adc-4e74-888c-bf77b652a7d1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:45:04.477211 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ddb5030-6adc-4e74-888c-bf77b652a7d1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:45:04.477708 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ddb5030-6adc-4e74-888c-bf77b652a7d1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:45:04.478158 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ddb5030-6adc-4e74-888c-bf77b652a7d1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:45:04.478929 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ddb5030-6adc-4e74-888c-bf77b652a7d1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:45:04.479418 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ddb5030-6adc-4e74-888c-bf77b652a7d1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:45:04.479855 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ddb5030-6adc-4e74-888c-bf77b652a7d1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:45:04.681057 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0ddb5030-6adc-4e74-888c-bf77b652a7d1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:45:04.688752 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0ddb5030-6adc-4e74-888c-bf77b652a7d1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 200 len: 1364 microversion: 2.1 time: 0.223924 Sep 10 12:45:04.689317 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3537/7080] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:45:04 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 1364 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:45:04.770735 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-9aa88779-c4c2-4d7b-898a-78e364757909 req-85cd9aaf-882b-46f1-9f50-eef98d03eb1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924", "tag": "74441f67-56fb-4575-ae3a-6aba261a3293"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:45:04.782786 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-9aa88779-c4c2-4d7b-898a-78e364757909 req-85cd9aaf-882b-46f1-9f50-eef98d03eb1a service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:45:04.783648 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-9aa88779-c4c2-4d7b-898a-78e364757909 req-85cd9aaf-882b-46f1-9f50-eef98d03eb1a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:45:04.784170 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-9aa88779-c4c2-4d7b-898a-78e364757909 req-85cd9aaf-882b-46f1-9f50-eef98d03eb1a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:45:04.798159 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-9aa88779-c4c2-4d7b-898a-78e364757909 req-85cd9aaf-882b-46f1-9f50-eef98d03eb1a service nova] Creating event network-changed:74441f67-56fb-4575-ae3a-6aba261a3293 for instance 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 on n-h1-856895-1 Sep 10 12:45:04.803757 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-9aa88779-c4c2-4d7b-898a-78e364757909 req-85cd9aaf-882b-46f1-9f50-eef98d03eb1a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036672 Sep 10 12:45:04.805232 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3544/7081] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:45:05.712620 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d2dbc782-16d8-403e-aca6-341a0a3aba67 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:45:05.713278 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d2dbc782-16d8-403e-aca6-341a0a3aba67 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:45:05.720155 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d2dbc782-16d8-403e-aca6-341a0a3aba67 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:45:05.720649 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d2dbc782-16d8-403e-aca6-341a0a3aba67 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:45:05.721096 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d2dbc782-16d8-403e-aca6-341a0a3aba67 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:45:05.721833 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d2dbc782-16d8-403e-aca6-341a0a3aba67 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:45:05.722296 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d2dbc782-16d8-403e-aca6-341a0a3aba67 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:45:05.722731 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d2dbc782-16d8-403e-aca6-341a0a3aba67 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:45:05.859135 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d2dbc782-16d8-403e-aca6-341a0a3aba67 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:45:05.866796 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d2dbc782-16d8-403e-aca6-341a0a3aba67 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 200 len: 1364 microversion: 2.1 time: 0.158223 Sep 10 12:45:05.867425 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3538/7082] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:45:05 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:45:06.892112 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3140bc26-4e60-454e-88e6-934ea1d5da4b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:45:06.892860 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3140bc26-4e60-454e-88e6-934ea1d5da4b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:45:06.899993 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3140bc26-4e60-454e-88e6-934ea1d5da4b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:45:06.900492 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3140bc26-4e60-454e-88e6-934ea1d5da4b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:45:06.900943 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3140bc26-4e60-454e-88e6-934ea1d5da4b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:45:06.901635 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3140bc26-4e60-454e-88e6-934ea1d5da4b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:45:06.902098 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3140bc26-4e60-454e-88e6-934ea1d5da4b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:45:06.902534 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3140bc26-4e60-454e-88e6-934ea1d5da4b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:45:07.033821 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3140bc26-4e60-454e-88e6-934ea1d5da4b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:45:07.041753 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3140bc26-4e60-454e-88e6-934ea1d5da4b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 200 len: 1364 microversion: 2.1 time: 0.154789 Sep 10 12:45:07.042341 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3545/7083] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:45:06 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:45:08.065849 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a4834620-ffa2-4f31-8b17-6bf39cf1c078 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:45:08.066470 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a4834620-ffa2-4f31-8b17-6bf39cf1c078 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:45:08.073813 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a4834620-ffa2-4f31-8b17-6bf39cf1c078 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:45:08.074283 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a4834620-ffa2-4f31-8b17-6bf39cf1c078 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:45:08.074719 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a4834620-ffa2-4f31-8b17-6bf39cf1c078 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:45:08.075430 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a4834620-ffa2-4f31-8b17-6bf39cf1c078 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:45:08.075887 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a4834620-ffa2-4f31-8b17-6bf39cf1c078 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:45:08.076315 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a4834620-ffa2-4f31-8b17-6bf39cf1c078 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:45:08.212023 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a4834620-ffa2-4f31-8b17-6bf39cf1c078 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:45:08.219780 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a4834620-ffa2-4f31-8b17-6bf39cf1c078 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 200 len: 1364 microversion: 2.1 time: 0.157915 Sep 10 12:45:08.220349 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3539/7084] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:45:08 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:45:09.244051 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a281205b-2bd8-4cf2-89ff-9ab2fdb34817 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:45:09.244698 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a281205b-2bd8-4cf2-89ff-9ab2fdb34817 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:45:09.252056 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a281205b-2bd8-4cf2-89ff-9ab2fdb34817 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:45:09.252554 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a281205b-2bd8-4cf2-89ff-9ab2fdb34817 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:45:09.253003 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a281205b-2bd8-4cf2-89ff-9ab2fdb34817 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:45:09.253707 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a281205b-2bd8-4cf2-89ff-9ab2fdb34817 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:45:09.254209 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a281205b-2bd8-4cf2-89ff-9ab2fdb34817 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:45:09.254650 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a281205b-2bd8-4cf2-89ff-9ab2fdb34817 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:45:09.383372 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a281205b-2bd8-4cf2-89ff-9ab2fdb34817 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:45:09.391202 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a281205b-2bd8-4cf2-89ff-9ab2fdb34817 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 200 len: 1364 microversion: 2.1 time: 0.151629 Sep 10 12:45:09.391718 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3546/7085] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:45:09 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:45:10.415642 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3455c3e4-b7bc-4363-8c9e-153636e0bc2e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:45:10.416268 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3455c3e4-b7bc-4363-8c9e-153636e0bc2e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:45:10.423274 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3455c3e4-b7bc-4363-8c9e-153636e0bc2e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:45:10.423760 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3455c3e4-b7bc-4363-8c9e-153636e0bc2e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:45:10.424197 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3455c3e4-b7bc-4363-8c9e-153636e0bc2e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:45:10.424889 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3455c3e4-b7bc-4363-8c9e-153636e0bc2e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:45:10.425341 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3455c3e4-b7bc-4363-8c9e-153636e0bc2e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:45:10.425763 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3455c3e4-b7bc-4363-8c9e-153636e0bc2e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:45:10.556247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3455c3e4-b7bc-4363-8c9e-153636e0bc2e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:45:10.563966 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3455c3e4-b7bc-4363-8c9e-153636e0bc2e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 200 len: 1364 microversion: 2.1 time: 0.152751 Sep 10 12:45:10.564548 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3540/7086] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:45:10 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:45:11.587983 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e520eb2f-d491-4226-bb94-1eb93cf2a156 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:45:11.588621 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e520eb2f-d491-4226-bb94-1eb93cf2a156 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:45:11.595513 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e520eb2f-d491-4226-bb94-1eb93cf2a156 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:45:11.596013 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e520eb2f-d491-4226-bb94-1eb93cf2a156 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:45:11.596470 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e520eb2f-d491-4226-bb94-1eb93cf2a156 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:45:11.597182 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e520eb2f-d491-4226-bb94-1eb93cf2a156 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:45:11.597653 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e520eb2f-d491-4226-bb94-1eb93cf2a156 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:45:11.598098 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e520eb2f-d491-4226-bb94-1eb93cf2a156 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:45:11.737419 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e520eb2f-d491-4226-bb94-1eb93cf2a156 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:45:11.739856 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-d7d0159b-ceb4-41f1-a983-d491467f8fb9 req-b0f9887a-2dcf-45a9-9536-e2e28c22f20a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924", "name": "network-vif-plugged", "status": "completed", "tag": "74441f67-56fb-4575-ae3a-6aba261a3293"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:45:11.746859 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e520eb2f-d491-4226-bb94-1eb93cf2a156 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 200 len: 1364 microversion: 2.1 time: 0.162657 Sep 10 12:45:11.747517 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3547/7087] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:45:11 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:45:11.751787 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d7d0159b-ceb4-41f1-a983-d491467f8fb9 req-b0f9887a-2dcf-45a9-9536-e2e28c22f20a service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:45:11.753320 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d7d0159b-ceb4-41f1-a983-d491467f8fb9 req-b0f9887a-2dcf-45a9-9536-e2e28c22f20a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:45:11.753800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d7d0159b-ceb4-41f1-a983-d491467f8fb9 req-b0f9887a-2dcf-45a9-9536-e2e28c22f20a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:45:11.766697 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-d7d0159b-ceb4-41f1-a983-d491467f8fb9 req-b0f9887a-2dcf-45a9-9536-e2e28c22f20a service nova] Creating event network-vif-plugged:74441f67-56fb-4575-ae3a-6aba261a3293 for instance 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 on n-h1-856895-1 Sep 10 12:45:11.772333 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-d7d0159b-ceb4-41f1-a983-d491467f8fb9 req-b0f9887a-2dcf-45a9-9536-e2e28c22f20a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036588 Sep 10 12:45:11.773917 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3541/7088] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:45:12.771989 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c6bc4d9f-0f08-4254-89ec-9142903dc56a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:45:12.772653 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c6bc4d9f-0f08-4254-89ec-9142903dc56a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:45:12.774848 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:45:12.775631 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:45:12.782241 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c6bc4d9f-0f08-4254-89ec-9142903dc56a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:45:12.782739 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c6bc4d9f-0f08-4254-89ec-9142903dc56a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:45:12.783224 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c6bc4d9f-0f08-4254-89ec-9142903dc56a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:45:12.783940 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c6bc4d9f-0f08-4254-89ec-9142903dc56a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:45:12.784413 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c6bc4d9f-0f08-4254-89ec-9142903dc56a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:45:12.784856 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c6bc4d9f-0f08-4254-89ec-9142903dc56a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:45:12.918659 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c6bc4d9f-0f08-4254-89ec-9142903dc56a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:45:12.926935 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c6bc4d9f-0f08-4254-89ec-9142903dc56a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 200 len: 1364 microversion: 2.1 time: 0.158870 Sep 10 12:45:12.927559 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3548/7089] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:45:12 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:45:13.950788 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-676a0b02-8b49-42d7-8673-d7a57a1ea52f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:45:13.951529 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-676a0b02-8b49-42d7-8673-d7a57a1ea52f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:45:13.953572 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:45:13.959880 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-676a0b02-8b49-42d7-8673-d7a57a1ea52f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:45:13.960937 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-676a0b02-8b49-42d7-8673-d7a57a1ea52f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:45:13.961444 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-676a0b02-8b49-42d7-8673-d7a57a1ea52f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:45:13.962131 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-676a0b02-8b49-42d7-8673-d7a57a1ea52f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:45:13.962584 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-676a0b02-8b49-42d7-8673-d7a57a1ea52f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:45:13.963011 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-676a0b02-8b49-42d7-8673-d7a57a1ea52f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:45:14.093505 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-676a0b02-8b49-42d7-8673-d7a57a1ea52f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:45:14.101416 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-676a0b02-8b49-42d7-8673-d7a57a1ea52f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 200 len: 1552 microversion: 2.1 time: 0.154918 Sep 10 12:45:14.101991 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3542/7090] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:45:13 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 1552 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:45:14.125116 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6c32b828-0c8b-4908-87d3-c3edec98a8ac tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:45:14.125644 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6c32b828-0c8b-4908-87d3-c3edec98a8ac tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:45:14.133028 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6c32b828-0c8b-4908-87d3-c3edec98a8ac tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:45:14.133528 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6c32b828-0c8b-4908-87d3-c3edec98a8ac tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:45:14.133977 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6c32b828-0c8b-4908-87d3-c3edec98a8ac tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:45:14.134685 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6c32b828-0c8b-4908-87d3-c3edec98a8ac tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:45:14.135151 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6c32b828-0c8b-4908-87d3-c3edec98a8ac tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:45:14.136095 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6c32b828-0c8b-4908-87d3-c3edec98a8ac tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:45:14.214436 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6c32b828-0c8b-4908-87d3-c3edec98a8ac tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093400 Sep 10 12:45:14.215037 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3549/7091] 10.222.0.23 () {58 vars in 1275 bytes} [Sat Sep 10 12:45:14 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:45:15.395479 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-28c26248-22a0-4aa1-a2a6-1b80560ce09b req-3da6977d-6301-407e-9e45-2f3657e4f71b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924", "tag": "74441f67-56fb-4575-ae3a-6aba261a3293"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:45:15.406014 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-28c26248-22a0-4aa1-a2a6-1b80560ce09b req-3da6977d-6301-407e-9e45-2f3657e4f71b service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:45:15.406501 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-28c26248-22a0-4aa1-a2a6-1b80560ce09b req-3da6977d-6301-407e-9e45-2f3657e4f71b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:45:15.406937 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-28c26248-22a0-4aa1-a2a6-1b80560ce09b req-3da6977d-6301-407e-9e45-2f3657e4f71b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:45:15.418357 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-28c26248-22a0-4aa1-a2a6-1b80560ce09b req-3da6977d-6301-407e-9e45-2f3657e4f71b service nova] Creating event network-changed:74441f67-56fb-4575-ae3a-6aba261a3293 for instance 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 on n-h1-856895-1 Sep 10 12:45:15.423382 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-28c26248-22a0-4aa1-a2a6-1b80560ce09b req-3da6977d-6301-407e-9e45-2f3657e4f71b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031731 Sep 10 12:45:15.424286 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3543/7092] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:46:27.388333 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:46:27.389046 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:46:27.390405 n-d-856895-1 devstack@n-api.service[128776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 12:46:27.390566 n-d-856895-1 devstack@n-api.service[128776]: Sat Sep 10 12:46:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924/action (ip 10.222.0.23) !!! Sep 10 12:46:27.402537 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f4dd4e53-3476-41f5-b725-7a770c01713f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:46:27.404865 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f4dd4e53-3476-41f5-b725-7a770c01713f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:46:27.414717 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4dd4e53-3476-41f5-b725-7a770c01713f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:27.415384 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4dd4e53-3476-41f5-b725-7a770c01713f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:27.415843 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4dd4e53-3476-41f5-b725-7a770c01713f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:27.416569 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4dd4e53-3476-41f5-b725-7a770c01713f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:27.417038 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4dd4e53-3476-41f5-b725-7a770c01713f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:27.417477 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4dd4e53-3476-41f5-b725-7a770c01713f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:27.445649 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f4dd4e53-3476-41f5-b725-7a770c01713f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:46:27.451060 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f4dd4e53-3476-41f5-b725-7a770c01713f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Old instance type m1.heat2, new instance type m1.heat {{(pid=128776) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 12:46:27.457503 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-f4dd4e53-3476-41f5-b725-7a770c01713f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:46:27.457935 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-f4dd4e53-3476-41f5-b725-7a770c01713f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:46:27.458418 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-f4dd4e53-3476-41f5-b725-7a770c01713f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:46:27.458839 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-f4dd4e53-3476-41f5-b725-7a770c01713f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:46:27.459294 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-f4dd4e53-3476-41f5-b725-7a770c01713f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:46:27.524252 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f4dd4e53-3476-41f5-b725-7a770c01713f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "POST /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924/action" status: 202 len: 0 microversion: 2.1 time: 0.138885 Sep 10 12:46:27.524863 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3550/7093] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:46:27 2022] POST /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:46:27.532247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=21 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:46:27.532993 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:46:27.534399 n-d-856895-1 devstack@n-api.service[128777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 12:46:27.534766 n-d-856895-1 devstack@n-api.service[128777]: Sat Sep 10 12:46:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 (ip 10.222.0.23) !!! Sep 10 12:46:27.541331 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b3c284f0-c885-4a3e-86fa-520a604eba49 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:46:27.542051 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b3c284f0-c885-4a3e-86fa-520a604eba49 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:46:27.550954 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b3c284f0-c885-4a3e-86fa-520a604eba49 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:27.551456 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b3c284f0-c885-4a3e-86fa-520a604eba49 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:27.552013 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b3c284f0-c885-4a3e-86fa-520a604eba49 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:27.552719 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b3c284f0-c885-4a3e-86fa-520a604eba49 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:27.553187 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b3c284f0-c885-4a3e-86fa-520a604eba49 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:27.553614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b3c284f0-c885-4a3e-86fa-520a604eba49 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:27.698200 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b3c284f0-c885-4a3e-86fa-520a604eba49 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:46:27.706229 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b3c284f0-c885-4a3e-86fa-520a604eba49 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 200 len: 1680 microversion: 2.1 time: 0.176880 Sep 10 12:46:27.706816 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3544/7094] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:46:27 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:46:28.730912 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2a7ba7cd-7142-4594-974a-3ca503391b7f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:46:28.731565 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2a7ba7cd-7142-4594-974a-3ca503391b7f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:46:28.741039 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2a7ba7cd-7142-4594-974a-3ca503391b7f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:28.741537 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2a7ba7cd-7142-4594-974a-3ca503391b7f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:28.743201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2a7ba7cd-7142-4594-974a-3ca503391b7f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:28.743920 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2a7ba7cd-7142-4594-974a-3ca503391b7f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:28.744396 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2a7ba7cd-7142-4594-974a-3ca503391b7f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:28.744843 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2a7ba7cd-7142-4594-974a-3ca503391b7f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:28.877278 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2a7ba7cd-7142-4594-974a-3ca503391b7f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:46:28.886016 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2a7ba7cd-7142-4594-974a-3ca503391b7f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 200 len: 1680 microversion: 2.1 time: 0.160423 Sep 10 12:46:28.886604 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3551/7095] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:46:28 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:46:29.911748 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-48ea6983-6182-4306-8e0f-9f4c0bfba9d5 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:46:29.912375 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-48ea6983-6182-4306-8e0f-9f4c0bfba9d5 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:46:29.919455 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48ea6983-6182-4306-8e0f-9f4c0bfba9d5 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:29.919949 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48ea6983-6182-4306-8e0f-9f4c0bfba9d5 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:29.920397 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48ea6983-6182-4306-8e0f-9f4c0bfba9d5 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:29.921099 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48ea6983-6182-4306-8e0f-9f4c0bfba9d5 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:29.921568 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48ea6983-6182-4306-8e0f-9f4c0bfba9d5 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:29.922002 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48ea6983-6182-4306-8e0f-9f4c0bfba9d5 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:30.059266 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-48ea6983-6182-4306-8e0f-9f4c0bfba9d5 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:46:30.067872 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-48ea6983-6182-4306-8e0f-9f4c0bfba9d5 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 200 len: 1685 microversion: 2.1 time: 0.160179 Sep 10 12:46:30.068478 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3545/7096] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:46:29 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:46:31.092879 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9b3b475b-04e8-461f-a916-ddd52d9625e6 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:46:31.093543 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9b3b475b-04e8-461f-a916-ddd52d9625e6 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:46:31.100347 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9b3b475b-04e8-461f-a916-ddd52d9625e6 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:31.100848 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9b3b475b-04e8-461f-a916-ddd52d9625e6 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:31.101954 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9b3b475b-04e8-461f-a916-ddd52d9625e6 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:31.102768 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9b3b475b-04e8-461f-a916-ddd52d9625e6 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:31.103273 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9b3b475b-04e8-461f-a916-ddd52d9625e6 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:31.103722 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9b3b475b-04e8-461f-a916-ddd52d9625e6 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:31.233677 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9b3b475b-04e8-461f-a916-ddd52d9625e6 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:46:31.241355 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9b3b475b-04e8-461f-a916-ddd52d9625e6 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 200 len: 1685 microversion: 2.1 time: 0.152430 Sep 10 12:46:31.241932 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3552/7097] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:46:31 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:46:32.264399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fad4d5bd-6a59-4e26-85f2-38c5978e880e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:46:32.265019 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fad4d5bd-6a59-4e26-85f2-38c5978e880e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:46:32.271757 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fad4d5bd-6a59-4e26-85f2-38c5978e880e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:32.272239 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fad4d5bd-6a59-4e26-85f2-38c5978e880e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:32.272677 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fad4d5bd-6a59-4e26-85f2-38c5978e880e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:32.273457 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fad4d5bd-6a59-4e26-85f2-38c5978e880e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:32.274009 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fad4d5bd-6a59-4e26-85f2-38c5978e880e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:32.274442 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fad4d5bd-6a59-4e26-85f2-38c5978e880e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:32.403374 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fad4d5bd-6a59-4e26-85f2-38c5978e880e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:46:32.411156 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fad4d5bd-6a59-4e26-85f2-38c5978e880e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 200 len: 1685 microversion: 2.1 time: 0.150684 Sep 10 12:46:32.411757 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3546/7098] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:46:32 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 1685 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:46:33.435902 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c0f0d5f9-5423-44ae-a944-54c41e138ee3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:46:33.436500 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c0f0d5f9-5423-44ae-a944-54c41e138ee3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:46:33.443685 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0f0d5f9-5423-44ae-a944-54c41e138ee3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:33.444177 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0f0d5f9-5423-44ae-a944-54c41e138ee3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:33.444643 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0f0d5f9-5423-44ae-a944-54c41e138ee3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:33.446072 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0f0d5f9-5423-44ae-a944-54c41e138ee3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:33.446548 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0f0d5f9-5423-44ae-a944-54c41e138ee3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:33.446999 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0f0d5f9-5423-44ae-a944-54c41e138ee3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:33.579606 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c0f0d5f9-5423-44ae-a944-54c41e138ee3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:46:33.587349 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c0f0d5f9-5423-44ae-a944-54c41e138ee3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 200 len: 1685 microversion: 2.1 time: 0.155416 Sep 10 12:46:33.587929 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3553/7099] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:46:33 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:46:34.611389 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0ba36fa2-aa9e-4892-a687-98ca92a50356 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:46:34.611928 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0ba36fa2-aa9e-4892-a687-98ca92a50356 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:46:34.619721 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ba36fa2-aa9e-4892-a687-98ca92a50356 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:34.620459 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ba36fa2-aa9e-4892-a687-98ca92a50356 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:34.620899 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ba36fa2-aa9e-4892-a687-98ca92a50356 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:34.621587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ba36fa2-aa9e-4892-a687-98ca92a50356 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:34.622040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ba36fa2-aa9e-4892-a687-98ca92a50356 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:34.622467 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ba36fa2-aa9e-4892-a687-98ca92a50356 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:34.753393 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0ba36fa2-aa9e-4892-a687-98ca92a50356 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:46:34.761784 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0ba36fa2-aa9e-4892-a687-98ca92a50356 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 200 len: 1685 microversion: 2.1 time: 0.154568 Sep 10 12:46:34.762360 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3547/7100] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:46:34 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:46:35.786021 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e2b947b5-bfd9-45f6-b9d1-e427b2b134e6 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:46:35.786649 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e2b947b5-bfd9-45f6-b9d1-e427b2b134e6 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:46:35.794391 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e2b947b5-bfd9-45f6-b9d1-e427b2b134e6 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:35.794893 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e2b947b5-bfd9-45f6-b9d1-e427b2b134e6 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:35.795374 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e2b947b5-bfd9-45f6-b9d1-e427b2b134e6 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:35.796083 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e2b947b5-bfd9-45f6-b9d1-e427b2b134e6 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:35.796557 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e2b947b5-bfd9-45f6-b9d1-e427b2b134e6 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:35.797002 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e2b947b5-bfd9-45f6-b9d1-e427b2b134e6 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:35.927788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e2b947b5-bfd9-45f6-b9d1-e427b2b134e6 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:46:35.935631 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e2b947b5-bfd9-45f6-b9d1-e427b2b134e6 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 200 len: 1685 microversion: 2.1 time: 0.153509 Sep 10 12:46:35.936214 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3554/7101] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:46:35 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:46:36.959817 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7733574d-8517-4f6a-8958-8c7d33aaddb4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:46:36.960476 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7733574d-8517-4f6a-8958-8c7d33aaddb4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:46:36.967354 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7733574d-8517-4f6a-8958-8c7d33aaddb4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:36.967843 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7733574d-8517-4f6a-8958-8c7d33aaddb4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:36.968286 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7733574d-8517-4f6a-8958-8c7d33aaddb4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:36.968982 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7733574d-8517-4f6a-8958-8c7d33aaddb4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:36.969445 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7733574d-8517-4f6a-8958-8c7d33aaddb4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:36.969877 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7733574d-8517-4f6a-8958-8c7d33aaddb4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:37.099067 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7733574d-8517-4f6a-8958-8c7d33aaddb4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:46:37.106848 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7733574d-8517-4f6a-8958-8c7d33aaddb4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 200 len: 1685 microversion: 2.1 time: 0.151008 Sep 10 12:46:37.107450 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3548/7102] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:46:36 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 1685 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:46:38.131250 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1bbab3d8-3cf9-4631-b841-2dd95277c3cf tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:46:38.131904 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1bbab3d8-3cf9-4631-b841-2dd95277c3cf tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:46:38.139040 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1bbab3d8-3cf9-4631-b841-2dd95277c3cf tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:38.139568 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1bbab3d8-3cf9-4631-b841-2dd95277c3cf tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:38.140022 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1bbab3d8-3cf9-4631-b841-2dd95277c3cf tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:38.140733 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1bbab3d8-3cf9-4631-b841-2dd95277c3cf tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:38.141202 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1bbab3d8-3cf9-4631-b841-2dd95277c3cf tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:38.141932 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1bbab3d8-3cf9-4631-b841-2dd95277c3cf tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:38.273576 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1bbab3d8-3cf9-4631-b841-2dd95277c3cf tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:46:38.281342 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1bbab3d8-3cf9-4631-b841-2dd95277c3cf tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 200 len: 1685 microversion: 2.1 time: 0.154186 Sep 10 12:46:38.281915 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3555/7103] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:46:38 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:46:39.305986 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-90e0ea40-54cd-48a8-a39d-dc86c2d673ff tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:46:39.306615 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-90e0ea40-54cd-48a8-a39d-dc86c2d673ff tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:46:39.313940 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-90e0ea40-54cd-48a8-a39d-dc86c2d673ff tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:39.314428 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-90e0ea40-54cd-48a8-a39d-dc86c2d673ff tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:39.314876 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-90e0ea40-54cd-48a8-a39d-dc86c2d673ff tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:39.315619 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-90e0ea40-54cd-48a8-a39d-dc86c2d673ff tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:39.316087 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-90e0ea40-54cd-48a8-a39d-dc86c2d673ff tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:39.316526 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-90e0ea40-54cd-48a8-a39d-dc86c2d673ff tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:39.455544 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-90e0ea40-54cd-48a8-a39d-dc86c2d673ff tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:46:39.463891 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-90e0ea40-54cd-48a8-a39d-dc86c2d673ff tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 200 len: 1685 microversion: 2.1 time: 0.162045 Sep 10 12:46:39.464470 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3549/7104] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:46:39 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 1685 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:46:40.488087 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c344e777-e7c1-46ea-8e4e-de13690b6247 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:46:40.488671 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c344e777-e7c1-46ea-8e4e-de13690b6247 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:46:40.496497 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c344e777-e7c1-46ea-8e4e-de13690b6247 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:40.496996 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c344e777-e7c1-46ea-8e4e-de13690b6247 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:40.497456 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c344e777-e7c1-46ea-8e4e-de13690b6247 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:40.498155 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c344e777-e7c1-46ea-8e4e-de13690b6247 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:40.498627 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c344e777-e7c1-46ea-8e4e-de13690b6247 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:40.499069 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c344e777-e7c1-46ea-8e4e-de13690b6247 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:40.626752 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c344e777-e7c1-46ea-8e4e-de13690b6247 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:46:40.634576 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c344e777-e7c1-46ea-8e4e-de13690b6247 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 200 len: 1685 microversion: 2.1 time: 0.150664 Sep 10 12:46:40.635179 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3556/7105] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:46:40 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 1685 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:46:41.658476 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1b0965bd-2541-4e84-81cf-0d999cf73c61 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:46:41.659040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1b0965bd-2541-4e84-81cf-0d999cf73c61 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:46:41.665953 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b0965bd-2541-4e84-81cf-0d999cf73c61 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:41.666442 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b0965bd-2541-4e84-81cf-0d999cf73c61 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:41.666895 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b0965bd-2541-4e84-81cf-0d999cf73c61 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:41.667633 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b0965bd-2541-4e84-81cf-0d999cf73c61 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:41.668099 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b0965bd-2541-4e84-81cf-0d999cf73c61 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:41.668536 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b0965bd-2541-4e84-81cf-0d999cf73c61 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:41.801986 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1b0965bd-2541-4e84-81cf-0d999cf73c61 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:46:41.810398 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1b0965bd-2541-4e84-81cf-0d999cf73c61 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 200 len: 1685 microversion: 2.1 time: 0.155984 Sep 10 12:46:41.810983 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3550/7106] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:46:41 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:46:42.834050 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-71d6ed73-2fdc-4224-9574-99845d92d813 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:46:42.834676 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-71d6ed73-2fdc-4224-9574-99845d92d813 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:46:42.842103 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-71d6ed73-2fdc-4224-9574-99845d92d813 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:42.842596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-71d6ed73-2fdc-4224-9574-99845d92d813 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:42.843042 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-71d6ed73-2fdc-4224-9574-99845d92d813 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:42.843766 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-71d6ed73-2fdc-4224-9574-99845d92d813 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:42.844231 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-71d6ed73-2fdc-4224-9574-99845d92d813 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:42.844668 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-71d6ed73-2fdc-4224-9574-99845d92d813 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:42.979731 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-71d6ed73-2fdc-4224-9574-99845d92d813 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:46:42.987502 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-71d6ed73-2fdc-4224-9574-99845d92d813 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 200 len: 1685 microversion: 2.1 time: 0.157373 Sep 10 12:46:42.988083 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3557/7107] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:46:42 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:46:44.012516 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5c569323-9b85-4b00-b0bc-22ba42801c08 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:46:44.013141 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5c569323-9b85-4b00-b0bc-22ba42801c08 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:46:44.020047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c569323-9b85-4b00-b0bc-22ba42801c08 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:44.020534 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c569323-9b85-4b00-b0bc-22ba42801c08 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:44.020969 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c569323-9b85-4b00-b0bc-22ba42801c08 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:44.021666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c569323-9b85-4b00-b0bc-22ba42801c08 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:44.022127 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c569323-9b85-4b00-b0bc-22ba42801c08 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:44.022555 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5c569323-9b85-4b00-b0bc-22ba42801c08 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:44.158207 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5c569323-9b85-4b00-b0bc-22ba42801c08 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:46:44.166927 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5c569323-9b85-4b00-b0bc-22ba42801c08 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 200 len: 1685 microversion: 2.1 time: 0.159073 Sep 10 12:46:44.167566 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3551/7108] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:46:44 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 1685 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:46:45.191834 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-381fc32a-3ed5-4ed2-8971-b56914185efb tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:46:45.192495 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-381fc32a-3ed5-4ed2-8971-b56914185efb tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:46:45.200138 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-381fc32a-3ed5-4ed2-8971-b56914185efb tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:45.200657 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-381fc32a-3ed5-4ed2-8971-b56914185efb tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:45.201089 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-381fc32a-3ed5-4ed2-8971-b56914185efb tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:45.201798 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-381fc32a-3ed5-4ed2-8971-b56914185efb tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:45.202266 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-381fc32a-3ed5-4ed2-8971-b56914185efb tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:45.202722 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-381fc32a-3ed5-4ed2-8971-b56914185efb tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:45.334179 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-381fc32a-3ed5-4ed2-8971-b56914185efb tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:46:45.342091 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-381fc32a-3ed5-4ed2-8971-b56914185efb tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 200 len: 1685 microversion: 2.1 time: 0.154540 Sep 10 12:46:45.342675 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3558/7109] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:46:45 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:46:46.365359 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2a784b46-0976-43e9-a1b3-288177fadfe9 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:46:46.365994 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2a784b46-0976-43e9-a1b3-288177fadfe9 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:46:46.373152 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a784b46-0976-43e9-a1b3-288177fadfe9 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:46.373641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a784b46-0976-43e9-a1b3-288177fadfe9 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:46.374085 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a784b46-0976-43e9-a1b3-288177fadfe9 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:46.374780 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a784b46-0976-43e9-a1b3-288177fadfe9 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:46.375278 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a784b46-0976-43e9-a1b3-288177fadfe9 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:46.375707 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a784b46-0976-43e9-a1b3-288177fadfe9 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:46.554254 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2a784b46-0976-43e9-a1b3-288177fadfe9 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:46:46.563606 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2a784b46-0976-43e9-a1b3-288177fadfe9 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 200 len: 1685 microversion: 2.1 time: 0.202081 Sep 10 12:46:46.564198 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3552/7110] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:46:46 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 1685 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:46:47.168251 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-567758d7-247c-4032-bc69-1f1f33d91e56 req-61215ffa-1e85-45f8-aa85-0c741c3a8566 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924", "name": "network-vif-unplugged", "status": "completed", "tag": "74441f67-56fb-4575-ae3a-6aba261a3293"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:46:47.177871 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-567758d7-247c-4032-bc69-1f1f33d91e56 req-61215ffa-1e85-45f8-aa85-0c741c3a8566 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:47.178367 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-567758d7-247c-4032-bc69-1f1f33d91e56 req-61215ffa-1e85-45f8-aa85-0c741c3a8566 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:47.178817 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-567758d7-247c-4032-bc69-1f1f33d91e56 req-61215ffa-1e85-45f8-aa85-0c741c3a8566 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:47.191865 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-567758d7-247c-4032-bc69-1f1f33d91e56 req-61215ffa-1e85-45f8-aa85-0c741c3a8566 service nova] Creating event network-vif-unplugged:74441f67-56fb-4575-ae3a-6aba261a3293 for instance 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 on n-h2-856895-1 Sep 10 12:46:47.197367 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [req-567758d7-247c-4032-bc69-1f1f33d91e56 req-61215ffa-1e85-45f8-aa85-0c741c3a8566 service nova] Instance 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856895-1', 'n-h1-856895-1'} {{(pid=128776) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 12:46:47.209099 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-567758d7-247c-4032-bc69-1f1f33d91e56 req-61215ffa-1e85-45f8-aa85-0c741c3a8566 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106494 Sep 10 12:46:47.209723 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3559/7111] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:46:47.588169 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f03751fa-4376-4abf-82e2-a3b64a4f363d tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:46:47.588909 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f03751fa-4376-4abf-82e2-a3b64a4f363d tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:46:47.595851 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f03751fa-4376-4abf-82e2-a3b64a4f363d tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:47.596348 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f03751fa-4376-4abf-82e2-a3b64a4f363d tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:47.596798 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f03751fa-4376-4abf-82e2-a3b64a4f363d tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:47.597512 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f03751fa-4376-4abf-82e2-a3b64a4f363d tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:47.597977 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f03751fa-4376-4abf-82e2-a3b64a4f363d tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:47.598412 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f03751fa-4376-4abf-82e2-a3b64a4f363d tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:47.732286 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f03751fa-4376-4abf-82e2-a3b64a4f363d tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:46:47.740320 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f03751fa-4376-4abf-82e2-a3b64a4f363d tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 200 len: 1684 microversion: 2.1 time: 0.156081 Sep 10 12:46:47.740905 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3553/7112] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:46:47 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:46:48.767245 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fc311114-58f3-40cf-bbe7-bc5d47ce4934 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:46:48.767975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fc311114-58f3-40cf-bbe7-bc5d47ce4934 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:46:48.774171 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc311114-58f3-40cf-bbe7-bc5d47ce4934 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:48.774666 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc311114-58f3-40cf-bbe7-bc5d47ce4934 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:48.775123 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc311114-58f3-40cf-bbe7-bc5d47ce4934 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:48.775849 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc311114-58f3-40cf-bbe7-bc5d47ce4934 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:48.776396 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc311114-58f3-40cf-bbe7-bc5d47ce4934 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:48.776933 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc311114-58f3-40cf-bbe7-bc5d47ce4934 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:48.913140 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fc311114-58f3-40cf-bbe7-bc5d47ce4934 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:46:48.922067 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fc311114-58f3-40cf-bbe7-bc5d47ce4934 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 200 len: 1682 microversion: 2.1 time: 0.160217 Sep 10 12:46:48.922639 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3560/7113] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:46:48 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:46:49.224862 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-1e657d71-cf0b-4348-be0e-8238ab0c2327 req-bd85d424-c943-4573-bb98-9f62860c14e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924", "tag": "74441f67-56fb-4575-ae3a-6aba261a3293"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:46:49.236001 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-1e657d71-cf0b-4348-be0e-8238ab0c2327 req-bd85d424-c943-4573-bb98-9f62860c14e9 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:49.236480 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-1e657d71-cf0b-4348-be0e-8238ab0c2327 req-bd85d424-c943-4573-bb98-9f62860c14e9 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:49.236906 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-1e657d71-cf0b-4348-be0e-8238ab0c2327 req-bd85d424-c943-4573-bb98-9f62860c14e9 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:49.249011 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-1e657d71-cf0b-4348-be0e-8238ab0c2327 req-bd85d424-c943-4573-bb98-9f62860c14e9 service nova] Creating event network-changed:74441f67-56fb-4575-ae3a-6aba261a3293 for instance 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 on n-h2-856895-1 Sep 10 12:46:49.254279 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [req-1e657d71-cf0b-4348-be0e-8238ab0c2327 req-bd85d424-c943-4573-bb98-9f62860c14e9 service nova] Instance 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856895-1', 'n-h1-856895-1'} {{(pid=128777) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 12:46:49.265837 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-1e657d71-cf0b-4348-be0e-8238ab0c2327 req-bd85d424-c943-4573-bb98-9f62860c14e9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044837 Sep 10 12:46:49.266429 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3554/7114] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:46:49.946439 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-94f25cf1-76fa-41dc-b900-d65b1d6c0ed2 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:46:49.947020 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-94f25cf1-76fa-41dc-b900-d65b1d6c0ed2 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:46:49.955377 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-94f25cf1-76fa-41dc-b900-d65b1d6c0ed2 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:49.955908 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-94f25cf1-76fa-41dc-b900-d65b1d6c0ed2 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:49.956363 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-94f25cf1-76fa-41dc-b900-d65b1d6c0ed2 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:49.957405 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-94f25cf1-76fa-41dc-b900-d65b1d6c0ed2 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:49.957883 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-94f25cf1-76fa-41dc-b900-d65b1d6c0ed2 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:49.958490 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-94f25cf1-76fa-41dc-b900-d65b1d6c0ed2 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:50.097597 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-94f25cf1-76fa-41dc-b900-d65b1d6c0ed2 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:46:50.106220 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-94f25cf1-76fa-41dc-b900-d65b1d6c0ed2 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 200 len: 1679 microversion: 2.1 time: 0.164149 Sep 10 12:46:50.106932 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3561/7115] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:46:49 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:46:50.131154 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-510cdccc-58ab-4670-9069-6147b9edd1e0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:46:50.131899 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-510cdccc-58ab-4670-9069-6147b9edd1e0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:46:50.138641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-510cdccc-58ab-4670-9069-6147b9edd1e0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:50.139127 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-510cdccc-58ab-4670-9069-6147b9edd1e0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:50.139592 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-510cdccc-58ab-4670-9069-6147b9edd1e0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:50.140289 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-510cdccc-58ab-4670-9069-6147b9edd1e0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:50.140745 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-510cdccc-58ab-4670-9069-6147b9edd1e0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:50.141169 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-510cdccc-58ab-4670-9069-6147b9edd1e0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:50.191275 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-510cdccc-58ab-4670-9069-6147b9edd1e0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:50.191866 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-510cdccc-58ab-4670-9069-6147b9edd1e0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:50.192308 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-510cdccc-58ab-4670-9069-6147b9edd1e0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:50.193036 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-510cdccc-58ab-4670-9069-6147b9edd1e0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:50.193489 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-510cdccc-58ab-4670-9069-6147b9edd1e0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:50.193911 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-510cdccc-58ab-4670-9069-6147b9edd1e0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:50.215794 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-510cdccc-58ab-4670-9069-6147b9edd1e0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Getting quotas for project e5650f863c8c4cfc99dff86c5cb891de. Resources: {'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:46:50.221087 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-510cdccc-58ab-4670-9069-6147b9edd1e0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Getting quotas for user 654c64f49ef84816856aa9227f58a117 and project e5650f863c8c4cfc99dff86c5cb891de. Resources: {'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:46:50.324805 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-510cdccc-58ab-4670-9069-6147b9edd1e0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "POST /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924/action" status: 202 len: 0 microversion: 2.1 time: 0.196932 Sep 10 12:46:50.325857 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3555/7116] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:46:50 2022] POST /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:46:50.335156 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a159b960-02b9-4a43-a329-699f7dfb40f5 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:46:50.335962 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a159b960-02b9-4a43-a329-699f7dfb40f5 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:46:50.343725 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a159b960-02b9-4a43-a329-699f7dfb40f5 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:50.344468 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a159b960-02b9-4a43-a329-699f7dfb40f5 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:50.345028 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a159b960-02b9-4a43-a329-699f7dfb40f5 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:50.345869 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a159b960-02b9-4a43-a329-699f7dfb40f5 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:50.346472 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a159b960-02b9-4a43-a329-699f7dfb40f5 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:50.346930 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a159b960-02b9-4a43-a329-699f7dfb40f5 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:50.487027 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a159b960-02b9-4a43-a329-699f7dfb40f5 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:46:50.496380 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a159b960-02b9-4a43-a329-699f7dfb40f5 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 200 len: 1678 microversion: 2.1 time: 0.166157 Sep 10 12:46:50.497161 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3562/7117] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:46:50 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:46:51.522660 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-80068131-9f01-40be-999f-746c8f359c85 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:46:51.523408 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-80068131-9f01-40be-999f-746c8f359c85 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:46:51.531384 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-80068131-9f01-40be-999f-746c8f359c85 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:51.531868 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-80068131-9f01-40be-999f-746c8f359c85 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:51.532305 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-80068131-9f01-40be-999f-746c8f359c85 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:51.532994 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-80068131-9f01-40be-999f-746c8f359c85 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:51.533449 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-80068131-9f01-40be-999f-746c8f359c85 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:51.533883 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-80068131-9f01-40be-999f-746c8f359c85 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:51.665838 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-80068131-9f01-40be-999f-746c8f359c85 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:46:51.673939 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-80068131-9f01-40be-999f-746c8f359c85 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 200 len: 1678 microversion: 2.1 time: 0.157011 Sep 10 12:46:51.674510 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3556/7118] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:46:51 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:46:52.608110 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-8f64ac88-e2f2-4bf7-928f-d733bdb1c80c req-c614afc9-202d-4c0e-bb67-bafa9d462940 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924", "name": "network-vif-plugged", "status": "completed", "tag": "74441f67-56fb-4575-ae3a-6aba261a3293"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:46:52.618720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-8f64ac88-e2f2-4bf7-928f-d733bdb1c80c req-c614afc9-202d-4c0e-bb67-bafa9d462940 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:52.619519 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-8f64ac88-e2f2-4bf7-928f-d733bdb1c80c req-c614afc9-202d-4c0e-bb67-bafa9d462940 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:52.619992 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-8f64ac88-e2f2-4bf7-928f-d733bdb1c80c req-c614afc9-202d-4c0e-bb67-bafa9d462940 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:52.633956 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-8f64ac88-e2f2-4bf7-928f-d733bdb1c80c req-c614afc9-202d-4c0e-bb67-bafa9d462940 service nova] Creating event network-vif-plugged:74441f67-56fb-4575-ae3a-6aba261a3293 for instance 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 on n-h2-856895-1 Sep 10 12:46:52.639741 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [req-8f64ac88-e2f2-4bf7-928f-d733bdb1c80c req-c614afc9-202d-4c0e-bb67-bafa9d462940 service nova] Instance 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856895-1', 'n-h1-856895-1'} {{(pid=128776) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 12:46:52.651110 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-8f64ac88-e2f2-4bf7-928f-d733bdb1c80c req-c614afc9-202d-4c0e-bb67-bafa9d462940 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047457 Sep 10 12:46:52.651973 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3563/7119] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:46:52.698358 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0001cbf5-fd15-4702-9c59-5e76aa81827d tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:46:52.700234 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0001cbf5-fd15-4702-9c59-5e76aa81827d tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:46:52.707235 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0001cbf5-fd15-4702-9c59-5e76aa81827d tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:52.707834 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0001cbf5-fd15-4702-9c59-5e76aa81827d tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:52.708823 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0001cbf5-fd15-4702-9c59-5e76aa81827d tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:52.709589 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0001cbf5-fd15-4702-9c59-5e76aa81827d tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:52.710072 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0001cbf5-fd15-4702-9c59-5e76aa81827d tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:52.710546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0001cbf5-fd15-4702-9c59-5e76aa81827d tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:52.860295 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0001cbf5-fd15-4702-9c59-5e76aa81827d tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:46:52.863838 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:46:52.868899 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0001cbf5-fd15-4702-9c59-5e76aa81827d tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 200 len: 1678 microversion: 2.1 time: 0.175228 Sep 10 12:46:52.869477 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3557/7120] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:46:52 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:46:53.391854 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-ae065ad7-c8ef-4532-a137-37b3c39e693e req-98cea1b6-5af7-477d-8716-2a9d1e421d28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924", "name": "network-vif-unplugged", "status": "completed", "tag": "74441f67-56fb-4575-ae3a-6aba261a3293"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:46:53.413365 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ae065ad7-c8ef-4532-a137-37b3c39e693e req-98cea1b6-5af7-477d-8716-2a9d1e421d28 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:53.413859 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ae065ad7-c8ef-4532-a137-37b3c39e693e req-98cea1b6-5af7-477d-8716-2a9d1e421d28 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:53.414305 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ae065ad7-c8ef-4532-a137-37b3c39e693e req-98cea1b6-5af7-477d-8716-2a9d1e421d28 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:53.434278 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-ae065ad7-c8ef-4532-a137-37b3c39e693e req-98cea1b6-5af7-477d-8716-2a9d1e421d28 service nova] Creating event network-vif-unplugged:74441f67-56fb-4575-ae3a-6aba261a3293 for instance 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 on n-h1-856895-1 Sep 10 12:46:53.439971 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [req-ae065ad7-c8ef-4532-a137-37b3c39e693e req-98cea1b6-5af7-477d-8716-2a9d1e421d28 service nova] Instance 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856895-1', 'n-h1-856895-1'} {{(pid=128776) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 12:46:53.452547 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-ae065ad7-c8ef-4532-a137-37b3c39e693e req-98cea1b6-5af7-477d-8716-2a9d1e421d28 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066158 Sep 10 12:46:53.453356 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3564/7121] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:46:53.895013 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-96ad1652-aa99-4acc-8b42-2befd365e66d tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:46:53.895806 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-96ad1652-aa99-4acc-8b42-2befd365e66d tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:46:53.905115 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-96ad1652-aa99-4acc-8b42-2befd365e66d tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:53.905617 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-96ad1652-aa99-4acc-8b42-2befd365e66d tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:53.906062 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-96ad1652-aa99-4acc-8b42-2befd365e66d tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:53.906780 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-96ad1652-aa99-4acc-8b42-2befd365e66d tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:53.907275 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-96ad1652-aa99-4acc-8b42-2befd365e66d tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:53.907710 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-96ad1652-aa99-4acc-8b42-2befd365e66d tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:54.378789 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-96ad1652-aa99-4acc-8b42-2befd365e66d tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:46:54.387390 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-96ad1652-aa99-4acc-8b42-2befd365e66d tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 200 len: 1678 microversion: 2.1 time: 0.496542 Sep 10 12:46:54.388146 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3558/7122] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:46:53 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 1678 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:46:55.411502 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-db380dac-7de8-4125-8eec-7e65df8face5 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:46:55.412221 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-db380dac-7de8-4125-8eec-7e65df8face5 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:46:55.419728 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-db380dac-7de8-4125-8eec-7e65df8face5 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:55.420227 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-db380dac-7de8-4125-8eec-7e65df8face5 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:55.420681 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-db380dac-7de8-4125-8eec-7e65df8face5 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:55.421414 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-db380dac-7de8-4125-8eec-7e65df8face5 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:55.421912 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-db380dac-7de8-4125-8eec-7e65df8face5 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:55.422352 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-db380dac-7de8-4125-8eec-7e65df8face5 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:55.475234 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-7fd1e1b2-ff39-4ad8-8e6a-b894a73766ce req-e4a7b523-db93-4151-a214-a51c9b2ffb94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924", "tag": "74441f67-56fb-4575-ae3a-6aba261a3293"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:46:55.485771 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-7fd1e1b2-ff39-4ad8-8e6a-b894a73766ce req-e4a7b523-db93-4151-a214-a51c9b2ffb94 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:55.486251 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-7fd1e1b2-ff39-4ad8-8e6a-b894a73766ce req-e4a7b523-db93-4151-a214-a51c9b2ffb94 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:55.486759 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-7fd1e1b2-ff39-4ad8-8e6a-b894a73766ce req-e4a7b523-db93-4151-a214-a51c9b2ffb94 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:55.498809 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-7fd1e1b2-ff39-4ad8-8e6a-b894a73766ce req-e4a7b523-db93-4151-a214-a51c9b2ffb94 service nova] Creating event network-changed:74441f67-56fb-4575-ae3a-6aba261a3293 for instance 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 on n-h1-856895-1 Sep 10 12:46:55.504433 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [req-7fd1e1b2-ff39-4ad8-8e6a-b894a73766ce req-e4a7b523-db93-4151-a214-a51c9b2ffb94 service nova] Instance 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856895-1', 'n-h1-856895-1'} {{(pid=128777) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 12:46:55.516193 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-7fd1e1b2-ff39-4ad8-8e6a-b894a73766ce req-e4a7b523-db93-4151-a214-a51c9b2ffb94 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044739 Sep 10 12:46:55.516807 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3559/7123] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:46:55.622849 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-db380dac-7de8-4125-8eec-7e65df8face5 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:46:55.630793 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-db380dac-7de8-4125-8eec-7e65df8face5 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 200 len: 1678 microversion: 2.1 time: 0.223522 Sep 10 12:46:55.631403 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3565/7124] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:46:55 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 1678 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:46:56.656181 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-172a2ab9-583d-4575-a683-ed21341de0b7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:46:56.656887 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-172a2ab9-583d-4575-a683-ed21341de0b7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:46:56.663042 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-172a2ab9-583d-4575-a683-ed21341de0b7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:56.663561 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-172a2ab9-583d-4575-a683-ed21341de0b7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:56.664000 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-172a2ab9-583d-4575-a683-ed21341de0b7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:56.664689 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-172a2ab9-583d-4575-a683-ed21341de0b7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:56.665144 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-172a2ab9-583d-4575-a683-ed21341de0b7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:56.665570 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-172a2ab9-583d-4575-a683-ed21341de0b7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:56.799668 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-172a2ab9-583d-4575-a683-ed21341de0b7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:46:56.807420 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-172a2ab9-583d-4575-a683-ed21341de0b7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 200 len: 1678 microversion: 2.1 time: 0.156977 Sep 10 12:46:56.808155 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3560/7125] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:46:56 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:46:57.831394 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7ef8a989-6167-4445-b7e6-6bac4877e83b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:46:57.832026 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7ef8a989-6167-4445-b7e6-6bac4877e83b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:46:57.835095 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=37 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:46:57.840997 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7ef8a989-6167-4445-b7e6-6bac4877e83b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:57.841524 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7ef8a989-6167-4445-b7e6-6bac4877e83b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:57.841989 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7ef8a989-6167-4445-b7e6-6bac4877e83b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:57.842683 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7ef8a989-6167-4445-b7e6-6bac4877e83b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:57.843191 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7ef8a989-6167-4445-b7e6-6bac4877e83b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:57.843666 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7ef8a989-6167-4445-b7e6-6bac4877e83b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:57.848418 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:46:57.982685 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7ef8a989-6167-4445-b7e6-6bac4877e83b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:46:57.990490 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7ef8a989-6167-4445-b7e6-6bac4877e83b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 200 len: 1671 microversion: 2.1 time: 0.163071 Sep 10 12:46:57.991093 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3566/7126] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:46:57 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 1671 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:46:58.014584 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f67da992-6797-47c9-8506-60d93b969bab tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:46:58.015235 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f67da992-6797-47c9-8506-60d93b969bab tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:46:58.018019 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:46:58.023440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f67da992-6797-47c9-8506-60d93b969bab tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:58.023929 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f67da992-6797-47c9-8506-60d93b969bab tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:58.024374 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f67da992-6797-47c9-8506-60d93b969bab tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:58.025075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f67da992-6797-47c9-8506-60d93b969bab tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:58.025540 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f67da992-6797-47c9-8506-60d93b969bab tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:58.025972 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f67da992-6797-47c9-8506-60d93b969bab tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:58.156687 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f67da992-6797-47c9-8506-60d93b969bab tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:46:58.164416 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f67da992-6797-47c9-8506-60d93b969bab tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 200 len: 1671 microversion: 2.1 time: 0.154349 Sep 10 12:46:58.165000 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3561/7127] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:46:58 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:46:58.188125 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d0c7c86d-1a18-45a1-9590-350c3d78f791 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:46:58.188703 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d0c7c86d-1a18-45a1-9590-350c3d78f791 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:46:58.194615 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d0c7c86d-1a18-45a1-9590-350c3d78f791 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:58.195125 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d0c7c86d-1a18-45a1-9590-350c3d78f791 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:58.195615 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d0c7c86d-1a18-45a1-9590-350c3d78f791 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:58.196331 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d0c7c86d-1a18-45a1-9590-350c3d78f791 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:58.196811 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d0c7c86d-1a18-45a1-9590-350c3d78f791 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:58.197266 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d0c7c86d-1a18-45a1-9590-350c3d78f791 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:58.329420 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d0c7c86d-1a18-45a1-9590-350c3d78f791 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:46:58.337321 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d0c7c86d-1a18-45a1-9590-350c3d78f791 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 200 len: 1671 microversion: 2.1 time: 0.153726 Sep 10 12:46:58.337942 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3567/7128] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:46:58 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:46:58.360725 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5ac31b00-4a72-4a82-b46f-96e97c07e399 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:46:58.361234 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5ac31b00-4a72-4a82-b46f-96e97c07e399 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:46:58.367435 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ac31b00-4a72-4a82-b46f-96e97c07e399 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:58.367933 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ac31b00-4a72-4a82-b46f-96e97c07e399 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:58.368380 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ac31b00-4a72-4a82-b46f-96e97c07e399 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:58.369228 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ac31b00-4a72-4a82-b46f-96e97c07e399 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:58.369644 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ac31b00-4a72-4a82-b46f-96e97c07e399 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:58.370528 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5ac31b00-4a72-4a82-b46f-96e97c07e399 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:58.396874 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5ac31b00-4a72-4a82-b46f-96e97c07e399 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:46:58.472942 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5ac31b00-4a72-4a82-b46f-96e97c07e399 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 204 len: 0 microversion: 2.1 time: 0.115809 Sep 10 12:46:58.473939 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3562/7129] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:46:58 2022] DELETE /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 12:46:58.482561 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e482a70b-18cb-41d7-a1a1-8150f07aa08e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:46:58.483216 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e482a70b-18cb-41d7-a1a1-8150f07aa08e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:46:58.489158 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e482a70b-18cb-41d7-a1a1-8150f07aa08e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:58.489661 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e482a70b-18cb-41d7-a1a1-8150f07aa08e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:58.490122 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e482a70b-18cb-41d7-a1a1-8150f07aa08e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:58.490827 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e482a70b-18cb-41d7-a1a1-8150f07aa08e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:58.491340 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e482a70b-18cb-41d7-a1a1-8150f07aa08e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:58.491787 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e482a70b-18cb-41d7-a1a1-8150f07aa08e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:58.619497 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e482a70b-18cb-41d7-a1a1-8150f07aa08e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:46:58.628044 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e482a70b-18cb-41d7-a1a1-8150f07aa08e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 200 len: 1677 microversion: 2.1 time: 0.149503 Sep 10 12:46:58.628618 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3568/7130] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:46:58 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:46:59.653047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2fac5d28-1d04-4d3a-a600-c520572b383b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:46:59.653684 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2fac5d28-1d04-4d3a-a600-c520572b383b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:46:59.660515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fac5d28-1d04-4d3a-a600-c520572b383b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:59.661004 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fac5d28-1d04-4d3a-a600-c520572b383b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:59.661448 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fac5d28-1d04-4d3a-a600-c520572b383b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:59.662144 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fac5d28-1d04-4d3a-a600-c520572b383b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:46:59.662662 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fac5d28-1d04-4d3a-a600-c520572b383b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:46:59.663095 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2fac5d28-1d04-4d3a-a600-c520572b383b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:46:59.798315 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2fac5d28-1d04-4d3a-a600-c520572b383b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:46:59.806275 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2fac5d28-1d04-4d3a-a600-c520572b383b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 200 len: 1677 microversion: 2.1 time: 0.158015 Sep 10 12:46:59.806858 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3563/7131] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:46:59 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:47:00.344556 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-60a72411-24f2-46de-95fe-f55e9251090f req-4b3f040b-e278-4588-a8e9-a177a43fe43f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924", "name": "network-vif-plugged", "status": "completed", "tag": "74441f67-56fb-4575-ae3a-6aba261a3293"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:47:00.356185 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-60a72411-24f2-46de-95fe-f55e9251090f req-4b3f040b-e278-4588-a8e9-a177a43fe43f service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:47:00.357045 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-60a72411-24f2-46de-95fe-f55e9251090f req-4b3f040b-e278-4588-a8e9-a177a43fe43f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:47:00.357631 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-60a72411-24f2-46de-95fe-f55e9251090f req-4b3f040b-e278-4588-a8e9-a177a43fe43f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:47:00.369485 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-60a72411-24f2-46de-95fe-f55e9251090f req-4b3f040b-e278-4588-a8e9-a177a43fe43f service nova] Creating event network-vif-plugged:74441f67-56fb-4575-ae3a-6aba261a3293 for instance 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 on n-h1-856895-1 Sep 10 12:47:00.375009 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-60a72411-24f2-46de-95fe-f55e9251090f req-4b3f040b-e278-4588-a8e9-a177a43fe43f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034286 Sep 10 12:47:00.375819 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3569/7132] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:47:00.830841 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7ccfbe13-d9e9-4cb9-a999-60c070945de9 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:47:00.831743 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7ccfbe13-d9e9-4cb9-a999-60c070945de9 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:47:00.833865 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:47:00.842328 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ccfbe13-d9e9-4cb9-a999-60c070945de9 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:47:00.843241 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ccfbe13-d9e9-4cb9-a999-60c070945de9 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:47:00.843879 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ccfbe13-d9e9-4cb9-a999-60c070945de9 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:47:00.844785 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ccfbe13-d9e9-4cb9-a999-60c070945de9 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:47:00.845246 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ccfbe13-d9e9-4cb9-a999-60c070945de9 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:47:00.845855 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7ccfbe13-d9e9-4cb9-a999-60c070945de9 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:47:00.930305 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7ccfbe13-d9e9-4cb9-a999-60c070945de9 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:47:00.939690 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7ccfbe13-d9e9-4cb9-a999-60c070945de9 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 200 len: 1610 microversion: 2.1 time: 0.112670 Sep 10 12:47:00.940303 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3564/7133] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:47:00 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 1610 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:47:01.132729 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-c66c1b14-aefb-4d67-a5f2-ce06cc2c6dc3 req-5868776a-290d-4355-8a42-53091c1ab635 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924", "name": "network-vif-deleted", "tag": "74441f67-56fb-4575-ae3a-6aba261a3293"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:47:01.147425 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-c66c1b14-aefb-4d67-a5f2-ce06cc2c6dc3 req-5868776a-290d-4355-8a42-53091c1ab635 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:47:01.148314 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-c66c1b14-aefb-4d67-a5f2-ce06cc2c6dc3 req-5868776a-290d-4355-8a42-53091c1ab635 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:47:01.148755 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-c66c1b14-aefb-4d67-a5f2-ce06cc2c6dc3 req-5868776a-290d-4355-8a42-53091c1ab635 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:47:01.160636 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-c66c1b14-aefb-4d67-a5f2-ce06cc2c6dc3 req-5868776a-290d-4355-8a42-53091c1ab635 service nova] Creating event network-vif-deleted:74441f67-56fb-4575-ae3a-6aba261a3293 for instance 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 on n-h1-856895-1 Sep 10 12:47:01.165756 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-c66c1b14-aefb-4d67-a5f2-ce06cc2c6dc3 req-5868776a-290d-4355-8a42-53091c1ab635 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037360 Sep 10 12:47:01.166379 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3570/7134] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:47:01.963453 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7870a2c8-e4ee-4f30-98ee-23cb9d962872 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:47:01.964112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7870a2c8-e4ee-4f30-98ee-23cb9d962872 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:47:01.971949 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7870a2c8-e4ee-4f30-98ee-23cb9d962872 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:47:01.972449 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7870a2c8-e4ee-4f30-98ee-23cb9d962872 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:47:01.973008 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7870a2c8-e4ee-4f30-98ee-23cb9d962872 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:47:01.973729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7870a2c8-e4ee-4f30-98ee-23cb9d962872 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:47:01.974193 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7870a2c8-e4ee-4f30-98ee-23cb9d962872 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:47:01.974633 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7870a2c8-e4ee-4f30-98ee-23cb9d962872 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:47:01.989075 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-7870a2c8-e4ee-4f30-98ee-23cb9d962872 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] HTTP exception thrown: Instance 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 could not be found. Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7870a2c8-e4ee-4f30-98ee-23cb9d962872 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Request method failure captured: Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 HTTP/1.1 Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHIY9pEcRxalGK0PRpWwJTPeIAmQdSVovGoKpjRHBadvNmS2zGA_1an-TV7fdcpLow3fAP0-09VXHTMTC_3vkf2uc1w0SzWzU41k8Z5jw87gxtxl3CjHwSJsSu8lEyMnyoe3KziUpq4KmRSdH5R3eKqmRJRunRX8W6B-IBvqRpO11xPw Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: e5650f863c8c4cfc99dff86c5cb891de Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e5650f863c8c4cfc99dff86c5cb891de", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: e5650f863c8c4cfc99dff86c5cb891de Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServerActionsTestJSON-1025860466-project Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 654c64f49ef84816856aa9227f58a117 Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServerActionsTestJSON-1025860466-project Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 could not be found. Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924'} Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 could not be found. Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 could not be found. Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:47:01.990799 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:47:01.995795 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:47:01.995795 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:47:01.995795 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:47:01.995795 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:47:01.995795 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:47:01.995795 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 could not be found. Sep 10 12:47:01.995795 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:47:01.995795 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7870a2c8-e4ee-4f30-98ee-23cb9d962872 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Returning 404 to user: Instance 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:47:01.995795 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7870a2c8-e4ee-4f30-98ee-23cb9d962872 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 404 len: 111 microversion: 2.1 time: 0.032909 Sep 10 12:47:01.997774 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3565/7135] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:47:01 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:47:02.012482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3256e60e-7a62-43c5-be24-c1fdd110035e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:47:02.013201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3256e60e-7a62-43c5-be24-c1fdd110035e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:47:02.019536 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3256e60e-7a62-43c5-be24-c1fdd110035e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:47:02.020026 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3256e60e-7a62-43c5-be24-c1fdd110035e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:47:02.020472 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3256e60e-7a62-43c5-be24-c1fdd110035e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:47:02.021177 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3256e60e-7a62-43c5-be24-c1fdd110035e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:47:02.021640 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3256e60e-7a62-43c5-be24-c1fdd110035e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:47:02.022077 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3256e60e-7a62-43c5-be24-c1fdd110035e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:47:02.036703 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-3256e60e-7a62-43c5-be24-c1fdd110035e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] HTTP exception thrown: Instance 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 could not be found. Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3256e60e-7a62-43c5-be24-c1fdd110035e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Request method failure captured: Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 HTTP/1.1 Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHIY9pEcRxalGK0PRpWwJTPeIAmQdSVovGoKpjRHBadvNmS2zGA_1an-TV7fdcpLow3fAP0-09VXHTMTC_3vkf2uc1w0SzWzU41k8Z5jw87gxtxl3CjHwSJsSu8lEyMnyoe3KziUpq4KmRSdH5R3eKqmRJRunRX8W6B-IBvqRpO11xPw Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: e5650f863c8c4cfc99dff86c5cb891de Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e5650f863c8c4cfc99dff86c5cb891de", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: e5650f863c8c4cfc99dff86c5cb891de Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServerActionsTestJSON-1025860466-project Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 654c64f49ef84816856aa9227f58a117 Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServerActionsTestJSON-1025860466-project Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 could not be found. Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924'} Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 could not be found. Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 could not be found. Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:47:02.038400 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:47:02.044025 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:47:02.044025 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:47:02.044025 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:47:02.044025 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:47:02.044025 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:47:02.044025 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 could not be found. Sep 10 12:47:02.044025 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:47:02.044025 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3256e60e-7a62-43c5-be24-c1fdd110035e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Returning 404 to user: Instance 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:47:02.044025 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3256e60e-7a62-43c5-be24-c1fdd110035e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 404 len: 111 microversion: 2.1 time: 0.033488 Sep 10 12:47:02.044025 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3571/7136] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:47:02 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:47:02.092044 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ce77f91b-0ad1-4020-8fb3-f19a21474e6e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-197493625", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "0c9debbf-f324-4b51-a679-6e561d56780c"}], "security_groups": [{"name": "tempest-securitygroup--451320238"}], "key_name": "tempest-keypair-1213083482", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:47:02.207520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-ce77f91b-0ad1-4020-8fb3-f19a21474e6e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] validate_networks() for [('0c9debbf-f324-4b51-a679-6e561d56780c', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:47:02.645697 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-ce77f91b-0ad1-4020-8fb3-f19a21474e6e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:47:02.646134 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-ce77f91b-0ad1-4020-8fb3-f19a21474e6e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:47:02.646631 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-ce77f91b-0ad1-4020-8fb3-f19a21474e6e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:47:02.647073 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-ce77f91b-0ad1-4020-8fb3-f19a21474e6e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:47:02.647565 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-ce77f91b-0ad1-4020-8fb3-f19a21474e6e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:47:02.657111 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ce77f91b-0ad1-4020-8fb3-f19a21474e6e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:47:02.657602 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ce77f91b-0ad1-4020-8fb3-f19a21474e6e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:47:02.658043 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ce77f91b-0ad1-4020-8fb3-f19a21474e6e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:47:02.658784 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ce77f91b-0ad1-4020-8fb3-f19a21474e6e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:47:02.659273 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ce77f91b-0ad1-4020-8fb3-f19a21474e6e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:47:02.659709 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ce77f91b-0ad1-4020-8fb3-f19a21474e6e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:47:02.677086 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-ce77f91b-0ad1-4020-8fb3-f19a21474e6e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Getting quotas for project e5650f863c8c4cfc99dff86c5cb891de. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:47:02.682553 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-ce77f91b-0ad1-4020-8fb3-f19a21474e6e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Getting quotas for user 654c64f49ef84816856aa9227f58a117 and project e5650f863c8c4cfc99dff86c5cb891de. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:47:02.695533 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ce77f91b-0ad1-4020-8fb3-f19a21474e6e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:47:02.697876 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ce77f91b-0ad1-4020-8fb3-f19a21474e6e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:47:02.747926 n-d-856895-1 devstack@n-api.service[128777]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ce77f91b-0ad1-4020-8fb3-f19a21474e6e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [0d5c13ae-d458-4ac4-b347-adfca3c710c8] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 10 12:47:03.755851 n-d-856895-1 devstack@n-api.service[128777]: INFO oslo.messaging._drivers.impl_rabbit [None req-ce77f91b-0ad1-4020-8fb3-f19a21474e6e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [0d5c13ae-d458-4ac4-b347-adfca3c710c8] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 35008. Sep 10 12:47:03.759703 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ce77f91b-0ad1-4020-8fb3-f19a21474e6e tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.672699 Sep 10 12:47:03.760472 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3566/7137] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:47:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 1674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:47:03.772035 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7edd8fc5-739d-4ae7-b43c-1074544601a0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:47:03.772661 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7edd8fc5-739d-4ae7-b43c-1074544601a0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:47:03.829588 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7edd8fc5-739d-4ae7-b43c-1074544601a0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:47:03.837614 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7edd8fc5-739d-4ae7-b43c-1074544601a0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1238 microversion: 2.1 time: 0.069322 Sep 10 12:47:03.838376 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3572/7138] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:47:03 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1238 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:47:04.862871 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b8acd1fb-7f39-4258-bf1e-137e1770d751 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:47:04.863530 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b8acd1fb-7f39-4258-bf1e-137e1770d751 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:47:04.869919 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b8acd1fb-7f39-4258-bf1e-137e1770d751 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:47:04.871301 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b8acd1fb-7f39-4258-bf1e-137e1770d751 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:47:04.871792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b8acd1fb-7f39-4258-bf1e-137e1770d751 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:47:04.872454 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b8acd1fb-7f39-4258-bf1e-137e1770d751 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:47:04.872916 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b8acd1fb-7f39-4258-bf1e-137e1770d751 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:47:04.873346 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b8acd1fb-7f39-4258-bf1e-137e1770d751 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:47:04.949374 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b8acd1fb-7f39-4258-bf1e-137e1770d751 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:47:04.958171 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b8acd1fb-7f39-4258-bf1e-137e1770d751 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1308 microversion: 2.1 time: 0.100083 Sep 10 12:47:04.958773 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3567/7139] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:47:04 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1308 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:47:05.982530 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cdc012b6-3676-4f82-a2d7-87bb49ec2abc tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:47:05.983217 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cdc012b6-3676-4f82-a2d7-87bb49ec2abc tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:47:05.990087 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cdc012b6-3676-4f82-a2d7-87bb49ec2abc tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:47:05.990583 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cdc012b6-3676-4f82-a2d7-87bb49ec2abc tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:47:05.991034 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cdc012b6-3676-4f82-a2d7-87bb49ec2abc tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:47:05.991777 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cdc012b6-3676-4f82-a2d7-87bb49ec2abc tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:47:05.992243 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cdc012b6-3676-4f82-a2d7-87bb49ec2abc tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:47:05.992681 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cdc012b6-3676-4f82-a2d7-87bb49ec2abc tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:47:06.439479 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-cdc012b6-3676-4f82-a2d7-87bb49ec2abc tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:47:06.447091 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cdc012b6-3676-4f82-a2d7-87bb49ec2abc tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1363 microversion: 2.1 time: 0.469076 Sep 10 12:47:06.447698 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3573/7140] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:47:05 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1363 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:47:06.535603 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-d53b229a-c319-4afc-a24e-30ae1d400cc3 req-4ae1b955-e797-42df-88d8-ba6fccf8019e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9406dbbe-f48c-4474-8cb6-98621f9f4d5e", "tag": "04c7e2cb-eb1d-478b-a32f-66f51ec8509f"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:47:06.548532 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d53b229a-c319-4afc-a24e-30ae1d400cc3 req-4ae1b955-e797-42df-88d8-ba6fccf8019e service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:47:06.549271 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d53b229a-c319-4afc-a24e-30ae1d400cc3 req-4ae1b955-e797-42df-88d8-ba6fccf8019e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:47:06.549713 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d53b229a-c319-4afc-a24e-30ae1d400cc3 req-4ae1b955-e797-42df-88d8-ba6fccf8019e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:47:06.561598 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-d53b229a-c319-4afc-a24e-30ae1d400cc3 req-4ae1b955-e797-42df-88d8-ba6fccf8019e service nova] Creating event network-changed:04c7e2cb-eb1d-478b-a32f-66f51ec8509f for instance 9406dbbe-f48c-4474-8cb6-98621f9f4d5e on n-h1-856895-1 Sep 10 12:47:06.566505 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-d53b229a-c319-4afc-a24e-30ae1d400cc3 req-4ae1b955-e797-42df-88d8-ba6fccf8019e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034782 Sep 10 12:47:06.567106 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3568/7141] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:47:07.471546 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-791aeea9-7282-42cb-9014-ec0154330477 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:47:07.472176 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-791aeea9-7282-42cb-9014-ec0154330477 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:47:07.478915 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-791aeea9-7282-42cb-9014-ec0154330477 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:47:07.479441 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-791aeea9-7282-42cb-9014-ec0154330477 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:47:07.480015 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-791aeea9-7282-42cb-9014-ec0154330477 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:47:07.480733 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-791aeea9-7282-42cb-9014-ec0154330477 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:47:07.481203 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-791aeea9-7282-42cb-9014-ec0154330477 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:47:07.481646 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-791aeea9-7282-42cb-9014-ec0154330477 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:47:07.614705 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-791aeea9-7282-42cb-9014-ec0154330477 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:47:07.623333 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-791aeea9-7282-42cb-9014-ec0154330477 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1363 microversion: 2.1 time: 0.155678 Sep 10 12:47:07.623906 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3574/7142] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:47:07 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:47:08.649243 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b1025a8d-68c8-4b88-b132-1a4fc935ccd3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:47:08.649965 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b1025a8d-68c8-4b88-b132-1a4fc935ccd3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:47:08.656317 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1025a8d-68c8-4b88-b132-1a4fc935ccd3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:47:08.656806 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1025a8d-68c8-4b88-b132-1a4fc935ccd3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:47:08.657250 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1025a8d-68c8-4b88-b132-1a4fc935ccd3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:47:08.657939 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1025a8d-68c8-4b88-b132-1a4fc935ccd3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:47:08.658401 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1025a8d-68c8-4b88-b132-1a4fc935ccd3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:47:08.658835 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1025a8d-68c8-4b88-b132-1a4fc935ccd3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:47:08.790366 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b1025a8d-68c8-4b88-b132-1a4fc935ccd3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:47:08.798789 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b1025a8d-68c8-4b88-b132-1a4fc935ccd3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1363 microversion: 2.1 time: 0.154762 Sep 10 12:47:08.799419 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3569/7143] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:47:08 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:47:09.821998 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fe958419-f933-44c6-a106-688392de8184 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:47:09.822561 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fe958419-f933-44c6-a106-688392de8184 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:47:09.829521 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe958419-f933-44c6-a106-688392de8184 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:47:09.830023 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe958419-f933-44c6-a106-688392de8184 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:47:09.830487 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe958419-f933-44c6-a106-688392de8184 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:47:09.831215 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe958419-f933-44c6-a106-688392de8184 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:47:09.831695 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe958419-f933-44c6-a106-688392de8184 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:47:09.832142 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe958419-f933-44c6-a106-688392de8184 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:47:09.959754 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fe958419-f933-44c6-a106-688392de8184 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:47:09.968160 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fe958419-f933-44c6-a106-688392de8184 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1363 microversion: 2.1 time: 0.150194 Sep 10 12:47:09.968728 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3575/7144] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:47:09 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:47:10.992800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0abc78a8-2f9a-45e0-889c-a46059192b3a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:47:10.993415 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0abc78a8-2f9a-45e0-889c-a46059192b3a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:47:11.001141 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0abc78a8-2f9a-45e0-889c-a46059192b3a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:47:11.001619 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0abc78a8-2f9a-45e0-889c-a46059192b3a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:47:11.002056 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0abc78a8-2f9a-45e0-889c-a46059192b3a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:47:11.002744 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0abc78a8-2f9a-45e0-889c-a46059192b3a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:47:11.003216 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0abc78a8-2f9a-45e0-889c-a46059192b3a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:47:11.003643 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0abc78a8-2f9a-45e0-889c-a46059192b3a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:47:11.142846 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0abc78a8-2f9a-45e0-889c-a46059192b3a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:47:11.150563 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0abc78a8-2f9a-45e0-889c-a46059192b3a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1363 microversion: 2.1 time: 0.161670 Sep 10 12:47:11.151148 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3570/7145] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:47:10 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:47:12.173422 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dc30f9f2-7fa4-4c62-a6c5-ab8436542897 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:47:12.174087 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-dc30f9f2-7fa4-4c62-a6c5-ab8436542897 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:47:12.181247 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dc30f9f2-7fa4-4c62-a6c5-ab8436542897 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:47:12.181751 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dc30f9f2-7fa4-4c62-a6c5-ab8436542897 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:47:12.182201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dc30f9f2-7fa4-4c62-a6c5-ab8436542897 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:47:12.183494 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dc30f9f2-7fa4-4c62-a6c5-ab8436542897 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:47:12.184055 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dc30f9f2-7fa4-4c62-a6c5-ab8436542897 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:47:12.184499 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dc30f9f2-7fa4-4c62-a6c5-ab8436542897 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:47:12.318755 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-dc30f9f2-7fa4-4c62-a6c5-ab8436542897 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:47:12.328986 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-dc30f9f2-7fa4-4c62-a6c5-ab8436542897 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1363 microversion: 2.1 time: 0.159458 Sep 10 12:47:12.329802 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3576/7146] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:47:12 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:47:12.424423 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-c7bc06cf-2a96-44d8-bd25-a569adc1f5bf req-0d06d51f-7437-4ef2-ba50-a8ba5cd13f16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9406dbbe-f48c-4474-8cb6-98621f9f4d5e", "name": "network-vif-plugged", "status": "completed", "tag": "04c7e2cb-eb1d-478b-a32f-66f51ec8509f"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:47:12.436558 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-c7bc06cf-2a96-44d8-bd25-a569adc1f5bf req-0d06d51f-7437-4ef2-ba50-a8ba5cd13f16 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:47:12.437040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-c7bc06cf-2a96-44d8-bd25-a569adc1f5bf req-0d06d51f-7437-4ef2-ba50-a8ba5cd13f16 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:47:12.437484 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-c7bc06cf-2a96-44d8-bd25-a569adc1f5bf req-0d06d51f-7437-4ef2-ba50-a8ba5cd13f16 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:47:12.450242 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-c7bc06cf-2a96-44d8-bd25-a569adc1f5bf req-0d06d51f-7437-4ef2-ba50-a8ba5cd13f16 service nova] Creating event network-vif-plugged:04c7e2cb-eb1d-478b-a32f-66f51ec8509f for instance 9406dbbe-f48c-4474-8cb6-98621f9f4d5e on n-h1-856895-1 Sep 10 12:47:12.455457 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-c7bc06cf-2a96-44d8-bd25-a569adc1f5bf req-0d06d51f-7437-4ef2-ba50-a8ba5cd13f16 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034766 Sep 10 12:47:12.456158 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3571/7147] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:47:13.352831 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6533a518-6125-46f8-a0a2-0ef4887de246 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:47:13.353486 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6533a518-6125-46f8-a0a2-0ef4887de246 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:47:13.360547 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6533a518-6125-46f8-a0a2-0ef4887de246 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:47:13.361044 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6533a518-6125-46f8-a0a2-0ef4887de246 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:47:13.361498 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6533a518-6125-46f8-a0a2-0ef4887de246 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:47:13.362195 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6533a518-6125-46f8-a0a2-0ef4887de246 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:47:13.362662 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6533a518-6125-46f8-a0a2-0ef4887de246 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:47:13.363117 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6533a518-6125-46f8-a0a2-0ef4887de246 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:47:13.492234 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6533a518-6125-46f8-a0a2-0ef4887de246 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:47:13.500274 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6533a518-6125-46f8-a0a2-0ef4887de246 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1363 microversion: 2.1 time: 0.151385 Sep 10 12:47:13.500854 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3577/7148] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:47:13 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:47:14.521883 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:47:14.522719 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:47:14.528546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9f905df5-d15a-4d6c-abc2-2d872abe9f02 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:47:14.529247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9f905df5-d15a-4d6c-abc2-2d872abe9f02 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:47:14.536276 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9f905df5-d15a-4d6c-abc2-2d872abe9f02 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:47:14.536757 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9f905df5-d15a-4d6c-abc2-2d872abe9f02 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:47:14.537193 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9f905df5-d15a-4d6c-abc2-2d872abe9f02 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:47:14.537882 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9f905df5-d15a-4d6c-abc2-2d872abe9f02 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:47:14.538334 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9f905df5-d15a-4d6c-abc2-2d872abe9f02 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:47:14.538761 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9f905df5-d15a-4d6c-abc2-2d872abe9f02 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:47:14.668718 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9f905df5-d15a-4d6c-abc2-2d872abe9f02 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:47:14.676424 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9f905df5-d15a-4d6c-abc2-2d872abe9f02 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1551 microversion: 2.1 time: 0.155485 Sep 10 12:47:14.676999 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3572/7149] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:47:14 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1551 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:47:14.700223 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ecffaa51-402b-44fb-b8ac-624adb03d8d1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:47:14.700732 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ecffaa51-402b-44fb-b8ac-624adb03d8d1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:47:14.702802 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:47:14.708652 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ecffaa51-402b-44fb-b8ac-624adb03d8d1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:47:14.709143 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ecffaa51-402b-44fb-b8ac-624adb03d8d1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:47:14.709594 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ecffaa51-402b-44fb-b8ac-624adb03d8d1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:47:14.710286 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ecffaa51-402b-44fb-b8ac-624adb03d8d1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:47:14.710752 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ecffaa51-402b-44fb-b8ac-624adb03d8d1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:47:14.711212 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ecffaa51-402b-44fb-b8ac-624adb03d8d1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:47:14.796617 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ecffaa51-402b-44fb-b8ac-624adb03d8d1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100363 Sep 10 12:47:14.797223 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3578/7150] 10.222.0.23 () {58 vars in 1275 bytes} [Sat Sep 10 12:47:14 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:47:15.733970 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-b0e4cd8a-e9a9-4d7e-8f9d-11e0a3c0441d req-348f9319-5339-4b20-b8c7-9acd76b68539 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9406dbbe-f48c-4474-8cb6-98621f9f4d5e", "tag": "04c7e2cb-eb1d-478b-a32f-66f51ec8509f"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:47:15.744503 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-b0e4cd8a-e9a9-4d7e-8f9d-11e0a3c0441d req-348f9319-5339-4b20-b8c7-9acd76b68539 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:47:15.745017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-b0e4cd8a-e9a9-4d7e-8f9d-11e0a3c0441d req-348f9319-5339-4b20-b8c7-9acd76b68539 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:47:15.746406 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-b0e4cd8a-e9a9-4d7e-8f9d-11e0a3c0441d req-348f9319-5339-4b20-b8c7-9acd76b68539 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:47:15.757808 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-b0e4cd8a-e9a9-4d7e-8f9d-11e0a3c0441d req-348f9319-5339-4b20-b8c7-9acd76b68539 service nova] Creating event network-changed:04c7e2cb-eb1d-478b-a32f-66f51ec8509f for instance 9406dbbe-f48c-4474-8cb6-98621f9f4d5e on n-h1-856895-1 Sep 10 12:47:15.763281 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-b0e4cd8a-e9a9-4d7e-8f9d-11e0a3c0441d req-348f9319-5339-4b20-b8c7-9acd76b68539 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033848 Sep 10 12:47:15.763889 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3573/7151] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:48:31.638743 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=27 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:48:31.639523 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=57 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:48:31.645423 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b8acbf27-a0b7-42ea-a2ae-e59185f7de3b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:48:31.646060 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b8acbf27-a0b7-42ea-a2ae-e59185f7de3b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:48:31.653317 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8acbf27-a0b7-42ea-a2ae-e59185f7de3b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:48:31.653819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8acbf27-a0b7-42ea-a2ae-e59185f7de3b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:48:31.654280 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8acbf27-a0b7-42ea-a2ae-e59185f7de3b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:48:31.654990 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8acbf27-a0b7-42ea-a2ae-e59185f7de3b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:48:31.655507 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8acbf27-a0b7-42ea-a2ae-e59185f7de3b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:48:31.655958 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b8acbf27-a0b7-42ea-a2ae-e59185f7de3b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:48:31.791376 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b8acbf27-a0b7-42ea-a2ae-e59185f7de3b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:48:31.799858 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b8acbf27-a0b7-42ea-a2ae-e59185f7de3b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1670 microversion: 2.1 time: 0.163669 Sep 10 12:48:31.800436 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3579/7152] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:48:31 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1670 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:48:31.822302 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:48:31.823051 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:48:31.830162 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-14c42f53-e565-4cdc-9ee0-cb058203d3f4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5586c309-fd48-4411-bef8-4ce3a0ab3828"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:48:31.832708 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-14c42f53-e565-4cdc-9ee0-cb058203d3f4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:48:31.841854 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-14c42f53-e565-4cdc-9ee0-cb058203d3f4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:48:31.842347 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-14c42f53-e565-4cdc-9ee0-cb058203d3f4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:48:31.842791 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-14c42f53-e565-4cdc-9ee0-cb058203d3f4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:48:31.843519 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-14c42f53-e565-4cdc-9ee0-cb058203d3f4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:48:31.843983 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-14c42f53-e565-4cdc-9ee0-cb058203d3f4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:48:31.844416 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-14c42f53-e565-4cdc-9ee0-cb058203d3f4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:48:32.120368 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-14c42f53-e565-4cdc-9ee0-cb058203d3f4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "POST /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301042 Sep 10 12:48:32.121243 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3574/7153] 10.222.0.23 () {60 vars in 1323 bytes} [Sat Sep 10 12:48:31 2022] POST /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:48:42.842990 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4e8a5cf6-188c-4e2b-ac7d-9bb28d44241b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:48:42.845321 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4e8a5cf6-188c-4e2b-ac7d-9bb28d44241b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:48:42.848136 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:48:42.848805 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:48:42.854852 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e8a5cf6-188c-4e2b-ac7d-9bb28d44241b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:48:42.855391 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e8a5cf6-188c-4e2b-ac7d-9bb28d44241b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:48:42.855849 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e8a5cf6-188c-4e2b-ac7d-9bb28d44241b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:48:42.856561 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e8a5cf6-188c-4e2b-ac7d-9bb28d44241b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:48:42.857066 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e8a5cf6-188c-4e2b-ac7d-9bb28d44241b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:48:42.857509 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4e8a5cf6-188c-4e2b-ac7d-9bb28d44241b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:48:42.889615 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4e8a5cf6-188c-4e2b-ac7d-9bb28d44241b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:48:42.895006 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4e8a5cf6-188c-4e2b-ac7d-9bb28d44241b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Old instance type m1.heat2, new instance type m1.heat {{(pid=128776) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 12:48:42.901991 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-4e8a5cf6-188c-4e2b-ac7d-9bb28d44241b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:48:42.902428 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-4e8a5cf6-188c-4e2b-ac7d-9bb28d44241b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:48:42.902919 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-4e8a5cf6-188c-4e2b-ac7d-9bb28d44241b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:48:42.903382 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-4e8a5cf6-188c-4e2b-ac7d-9bb28d44241b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:48:42.903831 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-4e8a5cf6-188c-4e2b-ac7d-9bb28d44241b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:48:42.966867 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4e8a5cf6-188c-4e2b-ac7d-9bb28d44241b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "POST /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e/action" status: 202 len: 0 microversion: 2.1 time: 0.128047 Sep 10 12:48:42.967564 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3580/7154] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:48:42 2022] POST /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:48:42.973841 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:48:42.974845 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:48:42.980030 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-98ba29a1-977a-4a4c-acb4-8ec1f833d4e7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:48:42.980904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-98ba29a1-977a-4a4c-acb4-8ec1f833d4e7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:48:42.988509 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98ba29a1-977a-4a4c-acb4-8ec1f833d4e7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:48:42.989104 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98ba29a1-977a-4a4c-acb4-8ec1f833d4e7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:48:42.989563 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98ba29a1-977a-4a4c-acb4-8ec1f833d4e7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:48:42.990418 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98ba29a1-977a-4a4c-acb4-8ec1f833d4e7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:48:42.990884 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98ba29a1-977a-4a4c-acb4-8ec1f833d4e7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:48:42.991370 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98ba29a1-977a-4a4c-acb4-8ec1f833d4e7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:48:43.140323 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-98ba29a1-977a-4a4c-acb4-8ec1f833d4e7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:48:43.148600 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-98ba29a1-977a-4a4c-acb4-8ec1f833d4e7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1725 microversion: 2.1 time: 0.176669 Sep 10 12:48:43.153483 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3575/7155] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:48:42 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:48:44.174410 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b9d17eeb-9c5d-41f6-895e-4dc522741c37 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:48:44.174991 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b9d17eeb-9c5d-41f6-895e-4dc522741c37 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:48:44.183465 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9d17eeb-9c5d-41f6-895e-4dc522741c37 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:48:44.184042 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9d17eeb-9c5d-41f6-895e-4dc522741c37 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:48:44.184698 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9d17eeb-9c5d-41f6-895e-4dc522741c37 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:48:44.185551 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9d17eeb-9c5d-41f6-895e-4dc522741c37 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:48:44.186059 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9d17eeb-9c5d-41f6-895e-4dc522741c37 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:48:44.186537 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9d17eeb-9c5d-41f6-895e-4dc522741c37 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:48:44.656263 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b9d17eeb-9c5d-41f6-895e-4dc522741c37 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:48:44.664648 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b9d17eeb-9c5d-41f6-895e-4dc522741c37 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1725 microversion: 2.1 time: 0.495507 Sep 10 12:48:44.665230 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3581/7156] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:48:44 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1725 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:48:45.689438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e770ae7a-fc65-4990-ad15-f4dbca0c279c tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:48:45.690059 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e770ae7a-fc65-4990-ad15-f4dbca0c279c tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:48:45.696897 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e770ae7a-fc65-4990-ad15-f4dbca0c279c tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:48:45.697389 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e770ae7a-fc65-4990-ad15-f4dbca0c279c tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:48:45.697827 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e770ae7a-fc65-4990-ad15-f4dbca0c279c tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:48:45.698521 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e770ae7a-fc65-4990-ad15-f4dbca0c279c tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:48:45.699120 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e770ae7a-fc65-4990-ad15-f4dbca0c279c tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:48:45.699582 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e770ae7a-fc65-4990-ad15-f4dbca0c279c tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:48:45.828898 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e770ae7a-fc65-4990-ad15-f4dbca0c279c tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:48:45.837142 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e770ae7a-fc65-4990-ad15-f4dbca0c279c tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1730 microversion: 2.1 time: 0.151774 Sep 10 12:48:45.837713 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3576/7157] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:48:45 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:48:46.860641 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4fda392d-add1-49df-b48d-c87a9dd8b9ce tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:48:46.861278 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4fda392d-add1-49df-b48d-c87a9dd8b9ce tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:48:46.868772 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fda392d-add1-49df-b48d-c87a9dd8b9ce tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:48:46.869278 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fda392d-add1-49df-b48d-c87a9dd8b9ce tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:48:46.869740 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fda392d-add1-49df-b48d-c87a9dd8b9ce tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:48:46.870454 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fda392d-add1-49df-b48d-c87a9dd8b9ce tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:48:46.871232 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fda392d-add1-49df-b48d-c87a9dd8b9ce tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:48:46.871684 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fda392d-add1-49df-b48d-c87a9dd8b9ce tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:48:47.002855 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4fda392d-add1-49df-b48d-c87a9dd8b9ce tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:48:47.011110 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4fda392d-add1-49df-b48d-c87a9dd8b9ce tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1730 microversion: 2.1 time: 0.154456 Sep 10 12:48:47.012339 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3582/7158] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:48:46 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:48:48.035774 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-82ded7d7-ac01-4b03-b203-a792522f6fda tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:48:48.036396 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-82ded7d7-ac01-4b03-b203-a792522f6fda tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:48:48.043224 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82ded7d7-ac01-4b03-b203-a792522f6fda tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:48:48.043723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82ded7d7-ac01-4b03-b203-a792522f6fda tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:48:48.044305 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82ded7d7-ac01-4b03-b203-a792522f6fda tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:48:48.045006 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82ded7d7-ac01-4b03-b203-a792522f6fda tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:48:48.045468 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82ded7d7-ac01-4b03-b203-a792522f6fda tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:48:48.045904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82ded7d7-ac01-4b03-b203-a792522f6fda tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:48:48.178876 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-82ded7d7-ac01-4b03-b203-a792522f6fda tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:48:48.187760 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-82ded7d7-ac01-4b03-b203-a792522f6fda tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1730 microversion: 2.1 time: 0.155928 Sep 10 12:48:48.188350 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3577/7159] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:48:48 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:48:49.211001 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-97347a8a-82db-4bad-8114-ca9cf5632f0b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:48:49.211652 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-97347a8a-82db-4bad-8114-ca9cf5632f0b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:48:49.219384 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-97347a8a-82db-4bad-8114-ca9cf5632f0b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:48:49.219890 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-97347a8a-82db-4bad-8114-ca9cf5632f0b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:48:49.220340 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-97347a8a-82db-4bad-8114-ca9cf5632f0b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:48:49.221051 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-97347a8a-82db-4bad-8114-ca9cf5632f0b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:48:49.221519 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-97347a8a-82db-4bad-8114-ca9cf5632f0b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:48:49.221963 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-97347a8a-82db-4bad-8114-ca9cf5632f0b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:48:49.357639 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-97347a8a-82db-4bad-8114-ca9cf5632f0b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:48:49.365881 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-97347a8a-82db-4bad-8114-ca9cf5632f0b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1730 microversion: 2.1 time: 0.158807 Sep 10 12:48:49.366462 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3583/7160] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:48:49 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:48:50.390702 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-627cc420-6eda-49f1-9859-ac5be2017883 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:48:50.391271 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-627cc420-6eda-49f1-9859-ac5be2017883 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:48:50.397700 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-627cc420-6eda-49f1-9859-ac5be2017883 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:48:50.398188 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-627cc420-6eda-49f1-9859-ac5be2017883 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:48:50.398632 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-627cc420-6eda-49f1-9859-ac5be2017883 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:48:50.399357 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-627cc420-6eda-49f1-9859-ac5be2017883 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:48:50.399818 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-627cc420-6eda-49f1-9859-ac5be2017883 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:48:50.400249 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-627cc420-6eda-49f1-9859-ac5be2017883 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:48:50.529849 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-627cc420-6eda-49f1-9859-ac5be2017883 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:48:50.537980 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-627cc420-6eda-49f1-9859-ac5be2017883 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1730 microversion: 2.1 time: 0.152220 Sep 10 12:48:50.538551 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3578/7161] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:48:50 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:48:51.563018 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6baf436d-f794-40a6-926a-0b3c5993f170 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:48:51.563673 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6baf436d-f794-40a6-926a-0b3c5993f170 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:48:51.570438 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6baf436d-f794-40a6-926a-0b3c5993f170 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:48:51.570928 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6baf436d-f794-40a6-926a-0b3c5993f170 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:48:51.571429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6baf436d-f794-40a6-926a-0b3c5993f170 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:48:51.572123 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6baf436d-f794-40a6-926a-0b3c5993f170 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:48:51.572588 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6baf436d-f794-40a6-926a-0b3c5993f170 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:48:51.573023 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6baf436d-f794-40a6-926a-0b3c5993f170 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:48:51.702226 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6baf436d-f794-40a6-926a-0b3c5993f170 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:48:51.710603 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6baf436d-f794-40a6-926a-0b3c5993f170 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1730 microversion: 2.1 time: 0.152113 Sep 10 12:48:51.711205 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3584/7162] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:48:51 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:48:52.735491 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8e48df2e-8211-41d0-95e3-3e8dcb4d0ee9 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:48:52.736119 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8e48df2e-8211-41d0-95e3-3e8dcb4d0ee9 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:48:52.743009 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e48df2e-8211-41d0-95e3-3e8dcb4d0ee9 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:48:52.743528 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e48df2e-8211-41d0-95e3-3e8dcb4d0ee9 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:48:52.743972 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e48df2e-8211-41d0-95e3-3e8dcb4d0ee9 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:48:52.744668 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e48df2e-8211-41d0-95e3-3e8dcb4d0ee9 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:48:52.745127 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e48df2e-8211-41d0-95e3-3e8dcb4d0ee9 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:48:52.745818 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e48df2e-8211-41d0-95e3-3e8dcb4d0ee9 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:48:52.880147 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8e48df2e-8211-41d0-95e3-3e8dcb4d0ee9 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:48:52.889085 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8e48df2e-8211-41d0-95e3-3e8dcb4d0ee9 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1730 microversion: 2.1 time: 0.158263 Sep 10 12:48:52.889668 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3579/7163] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:48:52 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:48:53.912659 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bdade8c8-4a9a-449e-98c2-10156f1b0fae tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:48:53.913322 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bdade8c8-4a9a-449e-98c2-10156f1b0fae tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:48:53.920306 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bdade8c8-4a9a-449e-98c2-10156f1b0fae tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:48:53.920798 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bdade8c8-4a9a-449e-98c2-10156f1b0fae tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:48:53.921248 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bdade8c8-4a9a-449e-98c2-10156f1b0fae tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:48:53.921949 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bdade8c8-4a9a-449e-98c2-10156f1b0fae tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:48:53.922414 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bdade8c8-4a9a-449e-98c2-10156f1b0fae tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:48:53.922855 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bdade8c8-4a9a-449e-98c2-10156f1b0fae tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:48:54.055679 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bdade8c8-4a9a-449e-98c2-10156f1b0fae tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:48:54.064492 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bdade8c8-4a9a-449e-98c2-10156f1b0fae tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1730 microversion: 2.1 time: 0.155744 Sep 10 12:48:54.065057 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3585/7164] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:48:53 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:48:55.087898 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-54a3e215-c7dd-4949-8b7d-fbae9f262d35 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:48:55.088531 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-54a3e215-c7dd-4949-8b7d-fbae9f262d35 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:48:55.095556 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54a3e215-c7dd-4949-8b7d-fbae9f262d35 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:48:55.096056 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54a3e215-c7dd-4949-8b7d-fbae9f262d35 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:48:55.096503 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54a3e215-c7dd-4949-8b7d-fbae9f262d35 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:48:55.097209 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54a3e215-c7dd-4949-8b7d-fbae9f262d35 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:48:55.097676 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54a3e215-c7dd-4949-8b7d-fbae9f262d35 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:48:55.098115 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54a3e215-c7dd-4949-8b7d-fbae9f262d35 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:48:55.237169 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-54a3e215-c7dd-4949-8b7d-fbae9f262d35 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:48:55.245800 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-54a3e215-c7dd-4949-8b7d-fbae9f262d35 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1730 microversion: 2.1 time: 0.161664 Sep 10 12:48:55.246396 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3580/7165] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:48:55 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:48:56.269909 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f35f9433-b008-49a8-b8a9-b462fa5fa713 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:48:56.270532 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f35f9433-b008-49a8-b8a9-b462fa5fa713 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:48:56.277322 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f35f9433-b008-49a8-b8a9-b462fa5fa713 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:48:56.277817 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f35f9433-b008-49a8-b8a9-b462fa5fa713 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:48:56.278268 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f35f9433-b008-49a8-b8a9-b462fa5fa713 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:48:56.279798 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f35f9433-b008-49a8-b8a9-b462fa5fa713 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:48:56.280273 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f35f9433-b008-49a8-b8a9-b462fa5fa713 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:48:56.280715 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f35f9433-b008-49a8-b8a9-b462fa5fa713 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:48:56.411482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f35f9433-b008-49a8-b8a9-b462fa5fa713 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:48:56.420800 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f35f9433-b008-49a8-b8a9-b462fa5fa713 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1730 microversion: 2.1 time: 0.154474 Sep 10 12:48:56.421376 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3586/7166] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:48:56 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:48:57.444982 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c3bb1949-79bc-4d51-825f-1de4d018f53a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:48:57.445561 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c3bb1949-79bc-4d51-825f-1de4d018f53a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:48:57.452797 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3bb1949-79bc-4d51-825f-1de4d018f53a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:48:57.453283 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3bb1949-79bc-4d51-825f-1de4d018f53a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:48:57.453724 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3bb1949-79bc-4d51-825f-1de4d018f53a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:48:57.454421 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3bb1949-79bc-4d51-825f-1de4d018f53a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:48:57.454882 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3bb1949-79bc-4d51-825f-1de4d018f53a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:48:57.455345 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c3bb1949-79bc-4d51-825f-1de4d018f53a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:48:57.582664 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c3bb1949-79bc-4d51-825f-1de4d018f53a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:48:57.591063 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c3bb1949-79bc-4d51-825f-1de4d018f53a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1730 microversion: 2.1 time: 0.150029 Sep 10 12:48:57.591750 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3581/7167] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:48:57 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:48:58.614827 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c08b4b99-8675-42ee-ac91-b6c99f1330bc tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:48:58.615403 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c08b4b99-8675-42ee-ac91-b6c99f1330bc tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:48:58.622131 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c08b4b99-8675-42ee-ac91-b6c99f1330bc tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:48:58.622700 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c08b4b99-8675-42ee-ac91-b6c99f1330bc tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:48:58.623153 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c08b4b99-8675-42ee-ac91-b6c99f1330bc tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:48:58.623914 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c08b4b99-8675-42ee-ac91-b6c99f1330bc tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:48:58.624380 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c08b4b99-8675-42ee-ac91-b6c99f1330bc tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:48:58.624818 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c08b4b99-8675-42ee-ac91-b6c99f1330bc tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:48:58.757165 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c08b4b99-8675-42ee-ac91-b6c99f1330bc tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:48:58.765719 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c08b4b99-8675-42ee-ac91-b6c99f1330bc tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1730 microversion: 2.1 time: 0.155048 Sep 10 12:48:58.766300 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3587/7168] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:48:58 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:48:59.790009 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-00d49ec5-4938-4da3-94e9-5cc64e31defb tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:48:59.790537 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-00d49ec5-4938-4da3-94e9-5cc64e31defb tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:48:59.797614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-00d49ec5-4938-4da3-94e9-5cc64e31defb tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:48:59.798098 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-00d49ec5-4938-4da3-94e9-5cc64e31defb tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:48:59.798537 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-00d49ec5-4938-4da3-94e9-5cc64e31defb tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:48:59.799261 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-00d49ec5-4938-4da3-94e9-5cc64e31defb tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:48:59.799725 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-00d49ec5-4938-4da3-94e9-5cc64e31defb tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:48:59.800158 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-00d49ec5-4938-4da3-94e9-5cc64e31defb tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:48:59.928648 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-00d49ec5-4938-4da3-94e9-5cc64e31defb tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:48:59.937624 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-00d49ec5-4938-4da3-94e9-5cc64e31defb tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1730 microversion: 2.1 time: 0.151653 Sep 10 12:48:59.938212 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3582/7169] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:48:59 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:00.962176 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b08ba6fe-6dbc-4997-9589-28e6756acc46 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:00.962841 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b08ba6fe-6dbc-4997-9589-28e6756acc46 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:00.970390 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b08ba6fe-6dbc-4997-9589-28e6756acc46 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:00.970888 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b08ba6fe-6dbc-4997-9589-28e6756acc46 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:00.971369 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b08ba6fe-6dbc-4997-9589-28e6756acc46 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:00.972069 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b08ba6fe-6dbc-4997-9589-28e6756acc46 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:00.972534 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b08ba6fe-6dbc-4997-9589-28e6756acc46 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:00.972995 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b08ba6fe-6dbc-4997-9589-28e6756acc46 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:01.108690 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b08ba6fe-6dbc-4997-9589-28e6756acc46 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:01.117507 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b08ba6fe-6dbc-4997-9589-28e6756acc46 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1730 microversion: 2.1 time: 0.159212 Sep 10 12:49:01.118099 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3588/7170] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:00 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:49:02.141417 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-113ea481-54ba-446e-8ac2-cb202acd5245 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:02.142077 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-113ea481-54ba-446e-8ac2-cb202acd5245 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:02.148963 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-113ea481-54ba-446e-8ac2-cb202acd5245 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:02.149454 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-113ea481-54ba-446e-8ac2-cb202acd5245 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:02.149899 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-113ea481-54ba-446e-8ac2-cb202acd5245 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:02.150598 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-113ea481-54ba-446e-8ac2-cb202acd5245 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:02.151058 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-113ea481-54ba-446e-8ac2-cb202acd5245 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:02.151516 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-113ea481-54ba-446e-8ac2-cb202acd5245 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:02.286520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-113ea481-54ba-446e-8ac2-cb202acd5245 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:02.295478 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-113ea481-54ba-446e-8ac2-cb202acd5245 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1730 microversion: 2.1 time: 0.158102 Sep 10 12:49:02.296073 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3583/7171] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:02 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:03.319896 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f113576e-bcb0-4488-8bec-0ce6a3a6806b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:03.320553 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f113576e-bcb0-4488-8bec-0ce6a3a6806b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:03.327472 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f113576e-bcb0-4488-8bec-0ce6a3a6806b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:03.327971 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f113576e-bcb0-4488-8bec-0ce6a3a6806b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:03.328420 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f113576e-bcb0-4488-8bec-0ce6a3a6806b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:03.329116 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f113576e-bcb0-4488-8bec-0ce6a3a6806b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:03.329580 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f113576e-bcb0-4488-8bec-0ce6a3a6806b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:03.330015 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f113576e-bcb0-4488-8bec-0ce6a3a6806b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:03.463484 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f113576e-bcb0-4488-8bec-0ce6a3a6806b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:03.472046 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f113576e-bcb0-4488-8bec-0ce6a3a6806b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1730 microversion: 2.1 time: 0.156015 Sep 10 12:49:03.472615 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3589/7172] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:03 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:04.496029 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a888dce9-cc43-4ef7-ae6a-7c2e508bc524 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:04.496563 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a888dce9-cc43-4ef7-ae6a-7c2e508bc524 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:04.503860 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a888dce9-cc43-4ef7-ae6a-7c2e508bc524 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:04.504348 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a888dce9-cc43-4ef7-ae6a-7c2e508bc524 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:04.504782 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a888dce9-cc43-4ef7-ae6a-7c2e508bc524 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:04.505471 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a888dce9-cc43-4ef7-ae6a-7c2e508bc524 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:04.505922 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a888dce9-cc43-4ef7-ae6a-7c2e508bc524 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:04.506344 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a888dce9-cc43-4ef7-ae6a-7c2e508bc524 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:04.635568 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a888dce9-cc43-4ef7-ae6a-7c2e508bc524 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:04.644575 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a888dce9-cc43-4ef7-ae6a-7c2e508bc524 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1730 microversion: 2.1 time: 0.152846 Sep 10 12:49:04.645151 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3584/7173] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:04 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:05.667833 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2170d43b-d4df-4818-9f38-79967034dfb3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:05.668472 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2170d43b-d4df-4818-9f38-79967034dfb3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:05.675806 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2170d43b-d4df-4818-9f38-79967034dfb3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:05.676309 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2170d43b-d4df-4818-9f38-79967034dfb3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:05.676767 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2170d43b-d4df-4818-9f38-79967034dfb3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:05.677479 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2170d43b-d4df-4818-9f38-79967034dfb3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:05.677955 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2170d43b-d4df-4818-9f38-79967034dfb3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:05.678406 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2170d43b-d4df-4818-9f38-79967034dfb3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:05.807586 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2170d43b-d4df-4818-9f38-79967034dfb3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:05.816587 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2170d43b-d4df-4818-9f38-79967034dfb3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1730 microversion: 2.1 time: 0.152653 Sep 10 12:49:05.817167 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3590/7174] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:05 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:06.841355 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2109104e-8996-4529-a0b2-131ec52a9f15 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:06.841978 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2109104e-8996-4529-a0b2-131ec52a9f15 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:06.849171 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2109104e-8996-4529-a0b2-131ec52a9f15 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:06.849658 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2109104e-8996-4529-a0b2-131ec52a9f15 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:06.850104 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2109104e-8996-4529-a0b2-131ec52a9f15 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:06.850803 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2109104e-8996-4529-a0b2-131ec52a9f15 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:06.851292 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2109104e-8996-4529-a0b2-131ec52a9f15 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:06.851911 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2109104e-8996-4529-a0b2-131ec52a9f15 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:06.985883 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2109104e-8996-4529-a0b2-131ec52a9f15 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:06.994207 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2109104e-8996-4529-a0b2-131ec52a9f15 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1730 microversion: 2.1 time: 0.157312 Sep 10 12:49:06.994792 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3585/7175] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:06 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:08.018229 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6594eb4a-1d87-4061-acf6-23c589964ed8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:08.019001 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6594eb4a-1d87-4061-acf6-23c589964ed8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:08.025975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6594eb4a-1d87-4061-acf6-23c589964ed8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:08.026546 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6594eb4a-1d87-4061-acf6-23c589964ed8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:08.027069 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6594eb4a-1d87-4061-acf6-23c589964ed8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:08.027880 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6594eb4a-1d87-4061-acf6-23c589964ed8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:08.028445 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6594eb4a-1d87-4061-acf6-23c589964ed8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:08.028895 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6594eb4a-1d87-4061-acf6-23c589964ed8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:08.170862 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6594eb4a-1d87-4061-acf6-23c589964ed8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:08.179479 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6594eb4a-1d87-4061-acf6-23c589964ed8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1730 microversion: 2.1 time: 0.165163 Sep 10 12:49:08.180065 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3591/7176] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:08 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:09.203623 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f971d6cf-343c-400d-a044-2d733c37f8dd tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:09.204247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f971d6cf-343c-400d-a044-2d733c37f8dd tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:09.211378 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f971d6cf-343c-400d-a044-2d733c37f8dd tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:09.211873 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f971d6cf-343c-400d-a044-2d733c37f8dd tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:09.212315 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f971d6cf-343c-400d-a044-2d733c37f8dd tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:09.213015 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f971d6cf-343c-400d-a044-2d733c37f8dd tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:09.213474 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f971d6cf-343c-400d-a044-2d733c37f8dd tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:09.213908 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f971d6cf-343c-400d-a044-2d733c37f8dd tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:09.352376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f971d6cf-343c-400d-a044-2d733c37f8dd tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:09.365219 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f971d6cf-343c-400d-a044-2d733c37f8dd tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1730 microversion: 2.1 time: 0.166108 Sep 10 12:49:09.365996 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3586/7177] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:09 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:09.812908 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-e4914d71-f604-4ebc-8393-21b20324e11c req-0ad7a2ff-53f9-442f-a6e8-4e5b4b6ea24f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9406dbbe-f48c-4474-8cb6-98621f9f4d5e", "name": "network-vif-unplugged", "status": "completed", "tag": "04c7e2cb-eb1d-478b-a32f-66f51ec8509f"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:49:09.823417 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e4914d71-f604-4ebc-8393-21b20324e11c req-0ad7a2ff-53f9-442f-a6e8-4e5b4b6ea24f service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:09.823984 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e4914d71-f604-4ebc-8393-21b20324e11c req-0ad7a2ff-53f9-442f-a6e8-4e5b4b6ea24f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:09.824567 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e4914d71-f604-4ebc-8393-21b20324e11c req-0ad7a2ff-53f9-442f-a6e8-4e5b4b6ea24f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:09.837433 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-e4914d71-f604-4ebc-8393-21b20324e11c req-0ad7a2ff-53f9-442f-a6e8-4e5b4b6ea24f service nova] Creating event network-vif-unplugged:04c7e2cb-eb1d-478b-a32f-66f51ec8509f for instance 9406dbbe-f48c-4474-8cb6-98621f9f4d5e on n-h2-856895-1 Sep 10 12:49:09.844062 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [req-e4914d71-f604-4ebc-8393-21b20324e11c req-0ad7a2ff-53f9-442f-a6e8-4e5b4b6ea24f service nova] Instance 9406dbbe-f48c-4474-8cb6-98621f9f4d5e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856895-1', 'n-h1-856895-1'} {{(pid=128776) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 12:49:09.856129 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-e4914d71-f604-4ebc-8393-21b20324e11c req-0ad7a2ff-53f9-442f-a6e8-4e5b4b6ea24f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047705 Sep 10 12:49:09.858019 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3592/7178] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:49:10.390988 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0c554c52-a0f5-4791-afce-59e65e6df790 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:10.391569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0c554c52-a0f5-4791-afce-59e65e6df790 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:10.398451 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c554c52-a0f5-4791-afce-59e65e6df790 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:10.398930 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c554c52-a0f5-4791-afce-59e65e6df790 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:10.399415 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c554c52-a0f5-4791-afce-59e65e6df790 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:10.400110 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c554c52-a0f5-4791-afce-59e65e6df790 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:10.400560 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c554c52-a0f5-4791-afce-59e65e6df790 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:10.400982 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c554c52-a0f5-4791-afce-59e65e6df790 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:10.535951 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0c554c52-a0f5-4791-afce-59e65e6df790 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:10.544753 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0c554c52-a0f5-4791-afce-59e65e6df790 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1729 microversion: 2.1 time: 0.158504 Sep 10 12:49:10.545361 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3587/7179] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:10 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:11.570283 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4073b8bf-6c0f-49c2-8e35-2d185457d43b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:11.570931 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4073b8bf-6c0f-49c2-8e35-2d185457d43b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:11.578824 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4073b8bf-6c0f-49c2-8e35-2d185457d43b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:11.579370 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4073b8bf-6c0f-49c2-8e35-2d185457d43b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:11.579839 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4073b8bf-6c0f-49c2-8e35-2d185457d43b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:11.580555 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4073b8bf-6c0f-49c2-8e35-2d185457d43b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:11.581029 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4073b8bf-6c0f-49c2-8e35-2d185457d43b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:11.581478 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4073b8bf-6c0f-49c2-8e35-2d185457d43b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:11.717967 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4073b8bf-6c0f-49c2-8e35-2d185457d43b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:11.726402 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4073b8bf-6c0f-49c2-8e35-2d185457d43b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1727 microversion: 2.1 time: 0.160541 Sep 10 12:49:11.726986 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3593/7180] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:11 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:11.892900 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-0fec989c-1a98-4459-a766-53b977a84a12 req-245fce67-294c-49b7-87df-2f8e41cd6d5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9406dbbe-f48c-4474-8cb6-98621f9f4d5e", "tag": "04c7e2cb-eb1d-478b-a32f-66f51ec8509f"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:49:11.903922 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0fec989c-1a98-4459-a766-53b977a84a12 req-245fce67-294c-49b7-87df-2f8e41cd6d5a service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:11.904409 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0fec989c-1a98-4459-a766-53b977a84a12 req-245fce67-294c-49b7-87df-2f8e41cd6d5a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:11.904844 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0fec989c-1a98-4459-a766-53b977a84a12 req-245fce67-294c-49b7-87df-2f8e41cd6d5a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:11.916632 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-0fec989c-1a98-4459-a766-53b977a84a12 req-245fce67-294c-49b7-87df-2f8e41cd6d5a service nova] Creating event network-changed:04c7e2cb-eb1d-478b-a32f-66f51ec8509f for instance 9406dbbe-f48c-4474-8cb6-98621f9f4d5e on n-h2-856895-1 Sep 10 12:49:11.922821 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [req-0fec989c-1a98-4459-a766-53b977a84a12 req-245fce67-294c-49b7-87df-2f8e41cd6d5a service nova] Instance 9406dbbe-f48c-4474-8cb6-98621f9f4d5e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856895-1', 'n-h1-856895-1'} {{(pid=128777) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 12:49:11.934061 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-0fec989c-1a98-4459-a766-53b977a84a12 req-245fce67-294c-49b7-87df-2f8e41cd6d5a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044941 Sep 10 12:49:11.934714 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3588/7181] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:49:12.751516 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-331c1da0-8ea6-40fa-922a-ba6e4545d7ed tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:12.752148 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-331c1da0-8ea6-40fa-922a-ba6e4545d7ed tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:12.759054 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-331c1da0-8ea6-40fa-922a-ba6e4545d7ed tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:12.759582 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-331c1da0-8ea6-40fa-922a-ba6e4545d7ed tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:12.760036 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-331c1da0-8ea6-40fa-922a-ba6e4545d7ed tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:12.760819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-331c1da0-8ea6-40fa-922a-ba6e4545d7ed tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:12.761286 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-331c1da0-8ea6-40fa-922a-ba6e4545d7ed tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:12.761719 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-331c1da0-8ea6-40fa-922a-ba6e4545d7ed tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:12.894379 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-331c1da0-8ea6-40fa-922a-ba6e4545d7ed tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:12.896788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:49:12.906018 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-331c1da0-8ea6-40fa-922a-ba6e4545d7ed tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1727 microversion: 2.1 time: 0.158678 Sep 10 12:49:12.906608 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3594/7182] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:12 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:13.930600 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c2b651a7-e206-420b-94ec-c62404f82e75 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:13.931346 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c2b651a7-e206-420b-94ec-c62404f82e75 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:13.934819 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=29 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:49:13.940470 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c2b651a7-e206-420b-94ec-c62404f82e75 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:13.940966 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c2b651a7-e206-420b-94ec-c62404f82e75 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:13.941412 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c2b651a7-e206-420b-94ec-c62404f82e75 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:13.942120 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c2b651a7-e206-420b-94ec-c62404f82e75 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:13.942585 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c2b651a7-e206-420b-94ec-c62404f82e75 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:13.943024 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c2b651a7-e206-420b-94ec-c62404f82e75 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:13.947259 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=83 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:49:14.087119 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c2b651a7-e206-420b-94ec-c62404f82e75 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:14.096032 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c2b651a7-e206-420b-94ec-c62404f82e75 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1727 microversion: 2.1 time: 0.169704 Sep 10 12:49:14.096932 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3589/7183] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:13 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:15.122424 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cd958262-0fd5-4a7b-bbcb-51e39a0f8554 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:15.122993 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cd958262-0fd5-4a7b-bbcb-51e39a0f8554 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:15.125471 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=35 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:49:15.131578 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cd958262-0fd5-4a7b-bbcb-51e39a0f8554 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:15.132039 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cd958262-0fd5-4a7b-bbcb-51e39a0f8554 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:15.132495 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cd958262-0fd5-4a7b-bbcb-51e39a0f8554 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:15.133216 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cd958262-0fd5-4a7b-bbcb-51e39a0f8554 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:15.133693 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cd958262-0fd5-4a7b-bbcb-51e39a0f8554 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:15.134137 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cd958262-0fd5-4a7b-bbcb-51e39a0f8554 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:15.268987 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-cd958262-0fd5-4a7b-bbcb-51e39a0f8554 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:15.277443 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cd958262-0fd5-4a7b-bbcb-51e39a0f8554 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1727 microversion: 2.1 time: 0.160519 Sep 10 12:49:15.278065 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3595/7184] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:15 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:16.301939 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cb93e398-6d9c-4bcd-9686-f35ddefc18d1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:16.302471 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cb93e398-6d9c-4bcd-9686-f35ddefc18d1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:16.310080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb93e398-6d9c-4bcd-9686-f35ddefc18d1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:16.310779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb93e398-6d9c-4bcd-9686-f35ddefc18d1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:16.311241 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb93e398-6d9c-4bcd-9686-f35ddefc18d1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:16.311935 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb93e398-6d9c-4bcd-9686-f35ddefc18d1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:16.312391 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb93e398-6d9c-4bcd-9686-f35ddefc18d1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:16.312811 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb93e398-6d9c-4bcd-9686-f35ddefc18d1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:16.446887 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cb93e398-6d9c-4bcd-9686-f35ddefc18d1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:16.455104 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cb93e398-6d9c-4bcd-9686-f35ddefc18d1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1727 microversion: 2.1 time: 0.157186 Sep 10 12:49:16.455703 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3590/7185] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:16 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:17.478927 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a1d52463-7c15-413c-b9be-0825ac3576c3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:17.479588 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a1d52463-7c15-413c-b9be-0825ac3576c3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:17.486540 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a1d52463-7c15-413c-b9be-0825ac3576c3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:17.487034 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a1d52463-7c15-413c-b9be-0825ac3576c3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:17.487508 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a1d52463-7c15-413c-b9be-0825ac3576c3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:17.488204 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a1d52463-7c15-413c-b9be-0825ac3576c3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:17.488670 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a1d52463-7c15-413c-b9be-0825ac3576c3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:17.489106 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a1d52463-7c15-413c-b9be-0825ac3576c3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:17.618898 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a1d52463-7c15-413c-b9be-0825ac3576c3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:17.628321 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a1d52463-7c15-413c-b9be-0825ac3576c3 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1727 microversion: 2.1 time: 0.153285 Sep 10 12:49:17.628901 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3596/7186] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:17 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:18.651771 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3dc0258c-54a5-4820-91a3-5fe07c0b6da8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:18.652398 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3dc0258c-54a5-4820-91a3-5fe07c0b6da8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:18.659350 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3dc0258c-54a5-4820-91a3-5fe07c0b6da8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:18.659837 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3dc0258c-54a5-4820-91a3-5fe07c0b6da8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:18.660279 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3dc0258c-54a5-4820-91a3-5fe07c0b6da8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:18.660977 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3dc0258c-54a5-4820-91a3-5fe07c0b6da8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:18.661438 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3dc0258c-54a5-4820-91a3-5fe07c0b6da8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:18.661869 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3dc0258c-54a5-4820-91a3-5fe07c0b6da8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:18.791346 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3dc0258c-54a5-4820-91a3-5fe07c0b6da8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:18.800443 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3dc0258c-54a5-4820-91a3-5fe07c0b6da8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1727 microversion: 2.1 time: 0.152824 Sep 10 12:49:18.801031 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3591/7187] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:18 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:19.824195 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b2f6d84e-a2e0-4d19-8914-20f46b6667f0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:19.824743 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b2f6d84e-a2e0-4d19-8914-20f46b6667f0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:19.831940 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2f6d84e-a2e0-4d19-8914-20f46b6667f0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:19.832436 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2f6d84e-a2e0-4d19-8914-20f46b6667f0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:19.832883 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2f6d84e-a2e0-4d19-8914-20f46b6667f0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:19.833597 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2f6d84e-a2e0-4d19-8914-20f46b6667f0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:19.834073 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2f6d84e-a2e0-4d19-8914-20f46b6667f0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:19.834514 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b2f6d84e-a2e0-4d19-8914-20f46b6667f0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:19.969072 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b2f6d84e-a2e0-4d19-8914-20f46b6667f0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:19.977379 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b2f6d84e-a2e0-4d19-8914-20f46b6667f0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1727 microversion: 2.1 time: 0.157160 Sep 10 12:49:19.977960 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3597/7188] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:19 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:21.003066 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d7b6c640-0640-4e2a-8745-98ad25753528 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:21.003753 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d7b6c640-0640-4e2a-8745-98ad25753528 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:21.010535 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d7b6c640-0640-4e2a-8745-98ad25753528 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:21.011025 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d7b6c640-0640-4e2a-8745-98ad25753528 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:21.011503 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d7b6c640-0640-4e2a-8745-98ad25753528 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:21.012840 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d7b6c640-0640-4e2a-8745-98ad25753528 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:21.013303 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d7b6c640-0640-4e2a-8745-98ad25753528 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:21.013735 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d7b6c640-0640-4e2a-8745-98ad25753528 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:21.148134 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d7b6c640-0640-4e2a-8745-98ad25753528 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:21.156493 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d7b6c640-0640-4e2a-8745-98ad25753528 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1727 microversion: 2.1 time: 0.157599 Sep 10 12:49:21.157282 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3592/7189] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:20 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:22.180573 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0aba70fd-de76-4657-a4b1-c4776a83f776 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:22.181209 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0aba70fd-de76-4657-a4b1-c4776a83f776 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:22.189080 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0aba70fd-de76-4657-a4b1-c4776a83f776 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:22.189615 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0aba70fd-de76-4657-a4b1-c4776a83f776 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:22.190071 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0aba70fd-de76-4657-a4b1-c4776a83f776 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:22.190786 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0aba70fd-de76-4657-a4b1-c4776a83f776 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:22.191295 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0aba70fd-de76-4657-a4b1-c4776a83f776 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:22.191769 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0aba70fd-de76-4657-a4b1-c4776a83f776 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:22.353148 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0aba70fd-de76-4657-a4b1-c4776a83f776 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:22.362659 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0aba70fd-de76-4657-a4b1-c4776a83f776 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1727 microversion: 2.1 time: 0.186438 Sep 10 12:49:22.363275 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3598/7190] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:22 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1727 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:23.390457 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a61eee4e-db9f-4a34-892e-58113efea034 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:23.391262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a61eee4e-db9f-4a34-892e-58113efea034 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:23.399101 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a61eee4e-db9f-4a34-892e-58113efea034 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:23.399612 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a61eee4e-db9f-4a34-892e-58113efea034 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:23.400051 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a61eee4e-db9f-4a34-892e-58113efea034 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:23.400746 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a61eee4e-db9f-4a34-892e-58113efea034 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:23.401201 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a61eee4e-db9f-4a34-892e-58113efea034 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:23.401631 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a61eee4e-db9f-4a34-892e-58113efea034 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:23.540355 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a61eee4e-db9f-4a34-892e-58113efea034 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:23.549736 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a61eee4e-db9f-4a34-892e-58113efea034 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1724 microversion: 2.1 time: 0.165208 Sep 10 12:49:23.550326 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3593/7191] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:23 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:23.572632 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-aa75d2fe-14c5-4c36-b9c9-bdeb2c8c3415 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:49:23.573177 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-aa75d2fe-14c5-4c36-b9c9-bdeb2c8c3415 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:23.580759 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aa75d2fe-14c5-4c36-b9c9-bdeb2c8c3415 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:23.581261 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aa75d2fe-14c5-4c36-b9c9-bdeb2c8c3415 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:23.581720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aa75d2fe-14c5-4c36-b9c9-bdeb2c8c3415 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:23.582429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aa75d2fe-14c5-4c36-b9c9-bdeb2c8c3415 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:23.582902 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aa75d2fe-14c5-4c36-b9c9-bdeb2c8c3415 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:23.583382 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aa75d2fe-14c5-4c36-b9c9-bdeb2c8c3415 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:23.621844 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aa75d2fe-14c5-4c36-b9c9-bdeb2c8c3415 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:23.622342 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aa75d2fe-14c5-4c36-b9c9-bdeb2c8c3415 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:23.622799 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aa75d2fe-14c5-4c36-b9c9-bdeb2c8c3415 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:23.623575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aa75d2fe-14c5-4c36-b9c9-bdeb2c8c3415 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:23.624051 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aa75d2fe-14c5-4c36-b9c9-bdeb2c8c3415 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:23.624497 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-aa75d2fe-14c5-4c36-b9c9-bdeb2c8c3415 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:23.645804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-aa75d2fe-14c5-4c36-b9c9-bdeb2c8c3415 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Getting quotas for project e5650f863c8c4cfc99dff86c5cb891de. Resources: {'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:49:23.653297 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-aa75d2fe-14c5-4c36-b9c9-bdeb2c8c3415 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Getting quotas for user 654c64f49ef84816856aa9227f58a117 and project e5650f863c8c4cfc99dff86c5cb891de. Resources: {'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:49:23.759274 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-aa75d2fe-14c5-4c36-b9c9-bdeb2c8c3415 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "POST /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e/action" status: 202 len: 0 microversion: 2.1 time: 0.190165 Sep 10 12:49:23.759892 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3599/7192] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:49:23 2022] POST /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:49:23.768801 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-61b1db62-2a1e-406d-96f1-88ebbc94794a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:23.769663 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-61b1db62-2a1e-406d-96f1-88ebbc94794a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:23.775913 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61b1db62-2a1e-406d-96f1-88ebbc94794a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:23.776410 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61b1db62-2a1e-406d-96f1-88ebbc94794a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:23.776853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61b1db62-2a1e-406d-96f1-88ebbc94794a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:23.778180 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61b1db62-2a1e-406d-96f1-88ebbc94794a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:23.778708 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61b1db62-2a1e-406d-96f1-88ebbc94794a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:23.779277 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61b1db62-2a1e-406d-96f1-88ebbc94794a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:23.915883 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-61b1db62-2a1e-406d-96f1-88ebbc94794a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:23.924209 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-61b1db62-2a1e-406d-96f1-88ebbc94794a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1723 microversion: 2.1 time: 0.159538 Sep 10 12:49:23.924791 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3594/7193] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:23 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:24.949275 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4190f319-8400-45a8-9a25-dbb05a35d7ff tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:24.950784 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4190f319-8400-45a8-9a25-dbb05a35d7ff tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:24.958665 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4190f319-8400-45a8-9a25-dbb05a35d7ff tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:24.959170 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4190f319-8400-45a8-9a25-dbb05a35d7ff tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:24.959627 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4190f319-8400-45a8-9a25-dbb05a35d7ff tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:24.960329 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4190f319-8400-45a8-9a25-dbb05a35d7ff tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:24.960799 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4190f319-8400-45a8-9a25-dbb05a35d7ff tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:24.961237 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4190f319-8400-45a8-9a25-dbb05a35d7ff tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:25.092729 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4190f319-8400-45a8-9a25-dbb05a35d7ff tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:25.100988 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4190f319-8400-45a8-9a25-dbb05a35d7ff tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1723 microversion: 2.1 time: 0.156394 Sep 10 12:49:25.101563 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3600/7194] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:24 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:49:25.473479 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-0096ba04-ff30-49ce-bbf6-5b1ba746d896 req-80675f4a-cbe5-464e-b438-0cc178b80563 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9406dbbe-f48c-4474-8cb6-98621f9f4d5e", "name": "network-vif-plugged", "status": "completed", "tag": "04c7e2cb-eb1d-478b-a32f-66f51ec8509f"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:49:25.484194 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0096ba04-ff30-49ce-bbf6-5b1ba746d896 req-80675f4a-cbe5-464e-b438-0cc178b80563 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:25.484681 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0096ba04-ff30-49ce-bbf6-5b1ba746d896 req-80675f4a-cbe5-464e-b438-0cc178b80563 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:25.485124 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-0096ba04-ff30-49ce-bbf6-5b1ba746d896 req-80675f4a-cbe5-464e-b438-0cc178b80563 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:25.497238 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-0096ba04-ff30-49ce-bbf6-5b1ba746d896 req-80675f4a-cbe5-464e-b438-0cc178b80563 service nova] Creating event network-vif-plugged:04c7e2cb-eb1d-478b-a32f-66f51ec8509f for instance 9406dbbe-f48c-4474-8cb6-98621f9f4d5e on n-h2-856895-1 Sep 10 12:49:25.502546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [req-0096ba04-ff30-49ce-bbf6-5b1ba746d896 req-80675f4a-cbe5-464e-b438-0cc178b80563 service nova] Instance 9406dbbe-f48c-4474-8cb6-98621f9f4d5e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856895-1', 'n-h1-856895-1'} {{(pid=128777) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 12:49:25.513577 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-0096ba04-ff30-49ce-bbf6-5b1ba746d896 req-80675f4a-cbe5-464e-b438-0cc178b80563 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132346 Sep 10 12:49:25.514173 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3595/7195] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:49:26.125153 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6b9cde4a-a69e-4ddd-bc7c-d28dabd3e06c tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:26.125859 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6b9cde4a-a69e-4ddd-bc7c-d28dabd3e06c tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:26.133097 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6b9cde4a-a69e-4ddd-bc7c-d28dabd3e06c tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:26.133611 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6b9cde4a-a69e-4ddd-bc7c-d28dabd3e06c tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:26.134072 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6b9cde4a-a69e-4ddd-bc7c-d28dabd3e06c tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:26.134790 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6b9cde4a-a69e-4ddd-bc7c-d28dabd3e06c tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:26.135293 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6b9cde4a-a69e-4ddd-bc7c-d28dabd3e06c tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:26.135743 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6b9cde4a-a69e-4ddd-bc7c-d28dabd3e06c tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:26.274788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6b9cde4a-a69e-4ddd-bc7c-d28dabd3e06c tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:26.284636 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6b9cde4a-a69e-4ddd-bc7c-d28dabd3e06c tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1723 microversion: 2.1 time: 0.163814 Sep 10 12:49:26.285158 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3601/7196] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:26 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:27.309903 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b97e2c36-0910-4945-acde-7444a47e2a51 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:27.310534 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b97e2c36-0910-4945-acde-7444a47e2a51 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:27.316763 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b97e2c36-0910-4945-acde-7444a47e2a51 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:27.317246 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b97e2c36-0910-4945-acde-7444a47e2a51 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:27.317682 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b97e2c36-0910-4945-acde-7444a47e2a51 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:27.318375 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b97e2c36-0910-4945-acde-7444a47e2a51 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:27.318838 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b97e2c36-0910-4945-acde-7444a47e2a51 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:27.319292 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b97e2c36-0910-4945-acde-7444a47e2a51 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:27.461599 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b97e2c36-0910-4945-acde-7444a47e2a51 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:27.470747 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b97e2c36-0910-4945-acde-7444a47e2a51 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1723 microversion: 2.1 time: 0.166182 Sep 10 12:49:27.471354 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3596/7197] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:27 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:28.495055 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4f750c0d-cfcf-45e4-ac96-e15960e72026 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:28.496700 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4f750c0d-cfcf-45e4-ac96-e15960e72026 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:28.504047 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f750c0d-cfcf-45e4-ac96-e15960e72026 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:28.504553 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f750c0d-cfcf-45e4-ac96-e15960e72026 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:28.505016 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f750c0d-cfcf-45e4-ac96-e15960e72026 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:28.505729 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f750c0d-cfcf-45e4-ac96-e15960e72026 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:28.506240 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f750c0d-cfcf-45e4-ac96-e15960e72026 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:28.506686 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f750c0d-cfcf-45e4-ac96-e15960e72026 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:28.700382 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4f750c0d-cfcf-45e4-ac96-e15960e72026 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:28.708689 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4f750c0d-cfcf-45e4-ac96-e15960e72026 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1723 microversion: 2.1 time: 0.217541 Sep 10 12:49:28.709269 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3602/7198] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:28 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:29.061881 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-b9163de1-be2f-43fb-8d0e-28b9f5d56ff7 req-b290afd5-2ac0-4ff7-84aa-20316f452795 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9406dbbe-f48c-4474-8cb6-98621f9f4d5e", "name": "network-vif-unplugged", "status": "completed", "tag": "04c7e2cb-eb1d-478b-a32f-66f51ec8509f"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:49:29.071349 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-b9163de1-be2f-43fb-8d0e-28b9f5d56ff7 req-b290afd5-2ac0-4ff7-84aa-20316f452795 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:29.071791 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-b9163de1-be2f-43fb-8d0e-28b9f5d56ff7 req-b290afd5-2ac0-4ff7-84aa-20316f452795 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:29.072224 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-b9163de1-be2f-43fb-8d0e-28b9f5d56ff7 req-b290afd5-2ac0-4ff7-84aa-20316f452795 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:29.085282 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-b9163de1-be2f-43fb-8d0e-28b9f5d56ff7 req-b290afd5-2ac0-4ff7-84aa-20316f452795 service nova] Creating event network-vif-unplugged:04c7e2cb-eb1d-478b-a32f-66f51ec8509f for instance 9406dbbe-f48c-4474-8cb6-98621f9f4d5e on n-h1-856895-1 Sep 10 12:49:29.091449 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [req-b9163de1-be2f-43fb-8d0e-28b9f5d56ff7 req-b290afd5-2ac0-4ff7-84aa-20316f452795 service nova] Instance 9406dbbe-f48c-4474-8cb6-98621f9f4d5e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856895-1', 'n-h1-856895-1'} {{(pid=128777) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 12:49:29.103056 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-b9163de1-be2f-43fb-8d0e-28b9f5d56ff7 req-b290afd5-2ac0-4ff7-84aa-20316f452795 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097457 Sep 10 12:49:29.103709 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3597/7199] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:49:29.733087 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e1bc5729-33d9-450c-a50c-ce74359869ee tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:29.733713 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e1bc5729-33d9-450c-a50c-ce74359869ee tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:29.740555 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e1bc5729-33d9-450c-a50c-ce74359869ee tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:29.741054 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e1bc5729-33d9-450c-a50c-ce74359869ee tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:29.741636 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e1bc5729-33d9-450c-a50c-ce74359869ee tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:29.742197 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e1bc5729-33d9-450c-a50c-ce74359869ee tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:29.742660 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e1bc5729-33d9-450c-a50c-ce74359869ee tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:29.743100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e1bc5729-33d9-450c-a50c-ce74359869ee tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:29.957391 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e1bc5729-33d9-450c-a50c-ce74359869ee tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:29.965793 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e1bc5729-33d9-450c-a50c-ce74359869ee tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1723 microversion: 2.1 time: 0.237089 Sep 10 12:49:29.966377 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3603/7200] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:29 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:30.990172 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b4803f83-809d-40a5-98c1-0a6426a22c92 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:30.990890 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b4803f83-809d-40a5-98c1-0a6426a22c92 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:30.999059 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b4803f83-809d-40a5-98c1-0a6426a22c92 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:30.999576 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b4803f83-809d-40a5-98c1-0a6426a22c92 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:31.000025 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b4803f83-809d-40a5-98c1-0a6426a22c92 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:31.000725 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b4803f83-809d-40a5-98c1-0a6426a22c92 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:31.001190 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b4803f83-809d-40a5-98c1-0a6426a22c92 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:31.001624 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b4803f83-809d-40a5-98c1-0a6426a22c92 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:31.122404 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-32b47283-dbc7-4615-a4a3-74c8c27af71a req-4d0d4c12-cc76-415f-a6a4-a402bd77b296 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9406dbbe-f48c-4474-8cb6-98621f9f4d5e", "tag": "04c7e2cb-eb1d-478b-a32f-66f51ec8509f"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:49:31.138738 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-32b47283-dbc7-4615-a4a3-74c8c27af71a req-4d0d4c12-cc76-415f-a6a4-a402bd77b296 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:31.139379 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-32b47283-dbc7-4615-a4a3-74c8c27af71a req-4d0d4c12-cc76-415f-a6a4-a402bd77b296 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:31.139991 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-32b47283-dbc7-4615-a4a3-74c8c27af71a req-4d0d4c12-cc76-415f-a6a4-a402bd77b296 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:31.147515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b4803f83-809d-40a5-98c1-0a6426a22c92 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:31.152555 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-32b47283-dbc7-4615-a4a3-74c8c27af71a req-4d0d4c12-cc76-415f-a6a4-a402bd77b296 service nova] Creating event network-changed:04c7e2cb-eb1d-478b-a32f-66f51ec8509f for instance 9406dbbe-f48c-4474-8cb6-98621f9f4d5e on n-h1-856895-1 Sep 10 12:49:31.157128 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b4803f83-809d-40a5-98c1-0a6426a22c92 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1723 microversion: 2.1 time: 0.171263 Sep 10 12:49:31.157925 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3598/7201] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:30 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:31.163960 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [req-32b47283-dbc7-4615-a4a3-74c8c27af71a req-4d0d4c12-cc76-415f-a6a4-a402bd77b296 service nova] Instance 9406dbbe-f48c-4474-8cb6-98621f9f4d5e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856895-1', 'n-h1-856895-1'} {{(pid=128776) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 12:49:31.170122 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-32b47283-dbc7-4615-a4a3-74c8c27af71a req-4d0d4c12-cc76-415f-a6a4-a402bd77b296 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052331 Sep 10 12:49:31.170791 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3604/7202] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:49:32.182233 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-42d7dff8-2255-42d6-a806-a835cf9d6060 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:32.182852 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-42d7dff8-2255-42d6-a806-a835cf9d6060 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:32.191199 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-42d7dff8-2255-42d6-a806-a835cf9d6060 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:32.191690 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-42d7dff8-2255-42d6-a806-a835cf9d6060 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:32.192160 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-42d7dff8-2255-42d6-a806-a835cf9d6060 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:32.192862 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-42d7dff8-2255-42d6-a806-a835cf9d6060 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:32.193318 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-42d7dff8-2255-42d6-a806-a835cf9d6060 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:32.193767 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-42d7dff8-2255-42d6-a806-a835cf9d6060 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:32.336289 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-42d7dff8-2255-42d6-a806-a835cf9d6060 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:32.345435 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-42d7dff8-2255-42d6-a806-a835cf9d6060 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1723 microversion: 2.1 time: 0.167033 Sep 10 12:49:32.346042 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3599/7203] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:32 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:33.370592 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-01d6e889-6817-4b3b-a3f1-630db487380b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:33.372139 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-01d6e889-6817-4b3b-a3f1-630db487380b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:33.378531 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01d6e889-6817-4b3b-a3f1-630db487380b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:33.378977 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01d6e889-6817-4b3b-a3f1-630db487380b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:33.379457 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01d6e889-6817-4b3b-a3f1-630db487380b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:33.380159 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01d6e889-6817-4b3b-a3f1-630db487380b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:33.380626 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01d6e889-6817-4b3b-a3f1-630db487380b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:33.381065 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01d6e889-6817-4b3b-a3f1-630db487380b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:33.517686 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-01d6e889-6817-4b3b-a3f1-630db487380b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:33.526091 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-01d6e889-6817-4b3b-a3f1-630db487380b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1723 microversion: 2.1 time: 0.160722 Sep 10 12:49:33.526678 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3605/7204] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:33 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:34.550267 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2a76355c-32c5-465c-a6c9-6ef373bb3e4f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:34.550894 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2a76355c-32c5-465c-a6c9-6ef373bb3e4f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:34.557887 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a76355c-32c5-465c-a6c9-6ef373bb3e4f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:34.558536 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a76355c-32c5-465c-a6c9-6ef373bb3e4f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:34.559087 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a76355c-32c5-465c-a6c9-6ef373bb3e4f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:34.559835 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a76355c-32c5-465c-a6c9-6ef373bb3e4f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:34.560294 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a76355c-32c5-465c-a6c9-6ef373bb3e4f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:34.560731 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a76355c-32c5-465c-a6c9-6ef373bb3e4f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:34.702392 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2a76355c-32c5-465c-a6c9-6ef373bb3e4f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:34.711131 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2a76355c-32c5-465c-a6c9-6ef373bb3e4f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1723 microversion: 2.1 time: 0.164817 Sep 10 12:49:34.711763 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3600/7205] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:34 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:35.735935 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-693e2f2d-2c9c-436b-8fed-c7a353417d79 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:35.736471 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-693e2f2d-2c9c-436b-8fed-c7a353417d79 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:35.738480 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:49:35.744532 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-693e2f2d-2c9c-436b-8fed-c7a353417d79 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:35.745027 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-693e2f2d-2c9c-436b-8fed-c7a353417d79 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:35.745475 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-693e2f2d-2c9c-436b-8fed-c7a353417d79 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:35.747418 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-693e2f2d-2c9c-436b-8fed-c7a353417d79 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:35.747894 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-693e2f2d-2c9c-436b-8fed-c7a353417d79 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:35.748336 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-693e2f2d-2c9c-436b-8fed-c7a353417d79 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:35.878321 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-693e2f2d-2c9c-436b-8fed-c7a353417d79 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:35.886626 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-693e2f2d-2c9c-436b-8fed-c7a353417d79 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1723 microversion: 2.1 time: 0.154585 Sep 10 12:49:35.887331 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3606/7206] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:35 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:36.909905 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8f2f904a-bfea-4506-b65a-c723fc0652f1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:36.910535 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8f2f904a-bfea-4506-b65a-c723fc0652f1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:36.917357 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8f2f904a-bfea-4506-b65a-c723fc0652f1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:36.917867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8f2f904a-bfea-4506-b65a-c723fc0652f1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:36.918306 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8f2f904a-bfea-4506-b65a-c723fc0652f1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:36.918989 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8f2f904a-bfea-4506-b65a-c723fc0652f1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:36.919471 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8f2f904a-bfea-4506-b65a-c723fc0652f1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:36.919899 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8f2f904a-bfea-4506-b65a-c723fc0652f1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:37.052242 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8f2f904a-bfea-4506-b65a-c723fc0652f1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:37.061144 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8f2f904a-bfea-4506-b65a-c723fc0652f1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1723 microversion: 2.1 time: 0.155190 Sep 10 12:49:37.061729 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3601/7207] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:36 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:38.085418 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-17bbf7aa-c66e-4764-88fc-ab8097a29e34 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:38.086049 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-17bbf7aa-c66e-4764-88fc-ab8097a29e34 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:38.093656 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17bbf7aa-c66e-4764-88fc-ab8097a29e34 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:38.094151 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17bbf7aa-c66e-4764-88fc-ab8097a29e34 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:38.094599 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17bbf7aa-c66e-4764-88fc-ab8097a29e34 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:38.095323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17bbf7aa-c66e-4764-88fc-ab8097a29e34 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:38.095789 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17bbf7aa-c66e-4764-88fc-ab8097a29e34 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:38.096226 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17bbf7aa-c66e-4764-88fc-ab8097a29e34 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:38.231671 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-17bbf7aa-c66e-4764-88fc-ab8097a29e34 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:38.239886 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-17bbf7aa-c66e-4764-88fc-ab8097a29e34 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1723 microversion: 2.1 time: 0.158420 Sep 10 12:49:38.240462 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3607/7208] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:38 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:39.264159 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a867a01f-8ac3-4c90-b65d-978fd71c4550 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:39.264783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a867a01f-8ac3-4c90-b65d-978fd71c4550 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:39.271755 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a867a01f-8ac3-4c90-b65d-978fd71c4550 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:39.272242 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a867a01f-8ac3-4c90-b65d-978fd71c4550 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:39.272685 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a867a01f-8ac3-4c90-b65d-978fd71c4550 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:39.273381 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a867a01f-8ac3-4c90-b65d-978fd71c4550 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:39.273850 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a867a01f-8ac3-4c90-b65d-978fd71c4550 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:39.274277 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a867a01f-8ac3-4c90-b65d-978fd71c4550 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:39.403943 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a867a01f-8ac3-4c90-b65d-978fd71c4550 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:39.412200 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a867a01f-8ac3-4c90-b65d-978fd71c4550 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1723 microversion: 2.1 time: 0.152063 Sep 10 12:49:39.412783 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3602/7209] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:39 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:40.435780 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0ce10105-a457-4ed0-8e03-5924e080e547 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:40.436507 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0ce10105-a457-4ed0-8e03-5924e080e547 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:40.443424 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ce10105-a457-4ed0-8e03-5924e080e547 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:40.443924 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ce10105-a457-4ed0-8e03-5924e080e547 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:40.444379 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ce10105-a457-4ed0-8e03-5924e080e547 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:40.445079 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ce10105-a457-4ed0-8e03-5924e080e547 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:40.445549 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ce10105-a457-4ed0-8e03-5924e080e547 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:40.446045 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ce10105-a457-4ed0-8e03-5924e080e547 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:40.578264 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0ce10105-a457-4ed0-8e03-5924e080e547 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:40.580541 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:49:40.588135 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0ce10105-a457-4ed0-8e03-5924e080e547 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1723 microversion: 2.1 time: 0.156393 Sep 10 12:49:40.588721 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3608/7210] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:40 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:41.612258 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-44f05175-00e5-43af-b27c-afa3f8c06210 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:41.612885 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-44f05175-00e5-43af-b27c-afa3f8c06210 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:41.619803 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-44f05175-00e5-43af-b27c-afa3f8c06210 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:41.620294 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-44f05175-00e5-43af-b27c-afa3f8c06210 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:41.621006 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-44f05175-00e5-43af-b27c-afa3f8c06210 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:41.621707 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-44f05175-00e5-43af-b27c-afa3f8c06210 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:41.622170 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-44f05175-00e5-43af-b27c-afa3f8c06210 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:41.622603 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-44f05175-00e5-43af-b27c-afa3f8c06210 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:41.763140 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-44f05175-00e5-43af-b27c-afa3f8c06210 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:41.771510 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-44f05175-00e5-43af-b27c-afa3f8c06210 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1723 microversion: 2.1 time: 0.164005 Sep 10 12:49:41.772108 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3603/7211] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:41 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:42.795621 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-010e8849-dbef-4931-b6ec-2a01c42bea1f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:42.796329 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-010e8849-dbef-4931-b6ec-2a01c42bea1f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:42.804228 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-010e8849-dbef-4931-b6ec-2a01c42bea1f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:42.804732 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-010e8849-dbef-4931-b6ec-2a01c42bea1f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:42.805165 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-010e8849-dbef-4931-b6ec-2a01c42bea1f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:42.805859 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-010e8849-dbef-4931-b6ec-2a01c42bea1f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:42.806330 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-010e8849-dbef-4931-b6ec-2a01c42bea1f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:42.806768 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-010e8849-dbef-4931-b6ec-2a01c42bea1f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:42.943500 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-010e8849-dbef-4931-b6ec-2a01c42bea1f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:42.952548 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-010e8849-dbef-4931-b6ec-2a01c42bea1f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1723 microversion: 2.1 time: 0.161310 Sep 10 12:49:42.953130 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3609/7212] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:42 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:43.976395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a199cf76-8dcb-427c-8963-0ae974b84737 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:43.977011 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a199cf76-8dcb-427c-8963-0ae974b84737 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:43.979906 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=30 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:49:43.985923 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a199cf76-8dcb-427c-8963-0ae974b84737 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:43.986408 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a199cf76-8dcb-427c-8963-0ae974b84737 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:43.986847 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a199cf76-8dcb-427c-8963-0ae974b84737 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:43.987625 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a199cf76-8dcb-427c-8963-0ae974b84737 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:43.988081 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a199cf76-8dcb-427c-8963-0ae974b84737 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:43.988510 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a199cf76-8dcb-427c-8963-0ae974b84737 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:43.992583 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=86 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:49:44.119023 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a199cf76-8dcb-427c-8963-0ae974b84737 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:44.127582 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a199cf76-8dcb-427c-8963-0ae974b84737 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1716 microversion: 2.1 time: 0.155098 Sep 10 12:49:44.128160 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3604/7213] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:43 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:44.150361 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-07e2f2ec-2713-4dc7-96c9-f52218beaf14 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:44.150998 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-07e2f2ec-2713-4dc7-96c9-f52218beaf14 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:44.158504 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-07e2f2ec-2713-4dc7-96c9-f52218beaf14 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:44.159006 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-07e2f2ec-2713-4dc7-96c9-f52218beaf14 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:44.159487 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-07e2f2ec-2713-4dc7-96c9-f52218beaf14 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:44.160204 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-07e2f2ec-2713-4dc7-96c9-f52218beaf14 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:44.160674 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-07e2f2ec-2713-4dc7-96c9-f52218beaf14 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:44.161120 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-07e2f2ec-2713-4dc7-96c9-f52218beaf14 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:44.292110 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-07e2f2ec-2713-4dc7-96c9-f52218beaf14 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:44.301508 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-07e2f2ec-2713-4dc7-96c9-f52218beaf14 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1716 microversion: 2.1 time: 0.155226 Sep 10 12:49:44.302089 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3610/7214] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:44 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:44.324220 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-af9a7b28-7162-4147-bf8f-c53b021d6938 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:44.324996 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-af9a7b28-7162-4147-bf8f-c53b021d6938 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:44.331484 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-af9a7b28-7162-4147-bf8f-c53b021d6938 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:44.331963 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-af9a7b28-7162-4147-bf8f-c53b021d6938 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:44.332403 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-af9a7b28-7162-4147-bf8f-c53b021d6938 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:44.333097 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-af9a7b28-7162-4147-bf8f-c53b021d6938 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:44.333549 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-af9a7b28-7162-4147-bf8f-c53b021d6938 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:44.333971 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-af9a7b28-7162-4147-bf8f-c53b021d6938 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:44.468461 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-af9a7b28-7162-4147-bf8f-c53b021d6938 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:44.476963 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-af9a7b28-7162-4147-bf8f-c53b021d6938 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1716 microversion: 2.1 time: 0.156520 Sep 10 12:49:44.477560 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3605/7215] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:44 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1716 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:44.555724 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-66e961a8-2b0e-4bb2-9c0b-6bfbe80ac42a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:44.556147 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-66e961a8-2b0e-4bb2-9c0b-6bfbe80ac42a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:44.562607 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-66e961a8-2b0e-4bb2-9c0b-6bfbe80ac42a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:44.563095 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-66e961a8-2b0e-4bb2-9c0b-6bfbe80ac42a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:44.563573 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-66e961a8-2b0e-4bb2-9c0b-6bfbe80ac42a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:44.564262 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-66e961a8-2b0e-4bb2-9c0b-6bfbe80ac42a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:44.564726 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-66e961a8-2b0e-4bb2-9c0b-6bfbe80ac42a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:44.565160 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-66e961a8-2b0e-4bb2-9c0b-6bfbe80ac42a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:44.590346 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-66e961a8-2b0e-4bb2-9c0b-6bfbe80ac42a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:49:44.666776 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-66e961a8-2b0e-4bb2-9c0b-6bfbe80ac42a tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 204 len: 0 microversion: 2.1 time: 0.114808 Sep 10 12:49:44.667405 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3611/7216] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:49:44 2022] DELETE /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:49:44.676096 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-98bd22df-82ab-4791-9eb1-670b795f9734 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:44.676746 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-98bd22df-82ab-4791-9eb1-670b795f9734 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:44.682792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98bd22df-82ab-4791-9eb1-670b795f9734 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:44.683312 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98bd22df-82ab-4791-9eb1-670b795f9734 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:44.683758 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98bd22df-82ab-4791-9eb1-670b795f9734 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:44.684460 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98bd22df-82ab-4791-9eb1-670b795f9734 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:44.684923 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98bd22df-82ab-4791-9eb1-670b795f9734 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:44.685377 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-98bd22df-82ab-4791-9eb1-670b795f9734 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:44.815403 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-98bd22df-82ab-4791-9eb1-670b795f9734 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:44.823785 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-98bd22df-82ab-4791-9eb1-670b795f9734 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1722 microversion: 2.1 time: 0.151549 Sep 10 12:49:44.824367 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3606/7217] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:44 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:45.067592 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-1f18dd39-4081-4aad-869e-ad91c8b24c58 req-607ebcaa-5de8-40d2-a1ad-3d7e27f3b837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9406dbbe-f48c-4474-8cb6-98621f9f4d5e", "name": "network-vif-plugged", "status": "completed", "tag": "04c7e2cb-eb1d-478b-a32f-66f51ec8509f"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:49:45.077033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-1f18dd39-4081-4aad-869e-ad91c8b24c58 req-607ebcaa-5de8-40d2-a1ad-3d7e27f3b837 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:45.077611 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-1f18dd39-4081-4aad-869e-ad91c8b24c58 req-607ebcaa-5de8-40d2-a1ad-3d7e27f3b837 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:45.078690 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-1f18dd39-4081-4aad-869e-ad91c8b24c58 req-607ebcaa-5de8-40d2-a1ad-3d7e27f3b837 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:45.090124 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-1f18dd39-4081-4aad-869e-ad91c8b24c58 req-607ebcaa-5de8-40d2-a1ad-3d7e27f3b837 service nova] Creating event network-vif-plugged:04c7e2cb-eb1d-478b-a32f-66f51ec8509f for instance 9406dbbe-f48c-4474-8cb6-98621f9f4d5e on n-h1-856895-1 Sep 10 12:49:45.095180 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-1f18dd39-4081-4aad-869e-ad91c8b24c58 req-607ebcaa-5de8-40d2-a1ad-3d7e27f3b837 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032714 Sep 10 12:49:45.095903 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3612/7218] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:49:45.849291 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3f85644d-a98f-4b9a-9862-2d99bc3e4001 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:45.849945 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3f85644d-a98f-4b9a-9862-2d99bc3e4001 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:45.856670 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3f85644d-a98f-4b9a-9862-2d99bc3e4001 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:45.857157 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3f85644d-a98f-4b9a-9862-2d99bc3e4001 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:45.857601 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3f85644d-a98f-4b9a-9862-2d99bc3e4001 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:45.858299 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3f85644d-a98f-4b9a-9862-2d99bc3e4001 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:45.858763 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3f85644d-a98f-4b9a-9862-2d99bc3e4001 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:45.859909 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3f85644d-a98f-4b9a-9862-2d99bc3e4001 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:45.992142 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3f85644d-a98f-4b9a-9862-2d99bc3e4001 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:46.000919 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3f85644d-a98f-4b9a-9862-2d99bc3e4001 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1722 microversion: 2.1 time: 0.155637 Sep 10 12:49:46.001505 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3607/7219] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:45 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:47.026823 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-84f73974-cb51-49dc-982f-0adb501752d8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:47.027580 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-84f73974-cb51-49dc-982f-0adb501752d8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:47.029621 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:49:47.035692 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-84f73974-cb51-49dc-982f-0adb501752d8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:47.036283 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-84f73974-cb51-49dc-982f-0adb501752d8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:47.036652 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-84f73974-cb51-49dc-982f-0adb501752d8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:47.037389 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-84f73974-cb51-49dc-982f-0adb501752d8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:47.037847 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-84f73974-cb51-49dc-982f-0adb501752d8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:47.038291 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-84f73974-cb51-49dc-982f-0adb501752d8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:47.123743 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-84f73974-cb51-49dc-982f-0adb501752d8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:47.138860 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-84f73974-cb51-49dc-982f-0adb501752d8 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1655 microversion: 2.1 time: 0.116919 Sep 10 12:49:47.143402 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3613/7220] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:47 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1655 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:47.352176 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-f9e4ea2b-901c-4cea-8f6f-d65f2386e4e5 req-49eb464a-9a48-4bcf-ba36-179238832a1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9406dbbe-f48c-4474-8cb6-98621f9f4d5e", "name": "network-vif-deleted", "tag": "04c7e2cb-eb1d-478b-a32f-66f51ec8509f"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:49:47.364099 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-f9e4ea2b-901c-4cea-8f6f-d65f2386e4e5 req-49eb464a-9a48-4bcf-ba36-179238832a1d service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:47.364592 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-f9e4ea2b-901c-4cea-8f6f-d65f2386e4e5 req-49eb464a-9a48-4bcf-ba36-179238832a1d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:47.365045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-f9e4ea2b-901c-4cea-8f6f-d65f2386e4e5 req-49eb464a-9a48-4bcf-ba36-179238832a1d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:47.382799 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-f9e4ea2b-901c-4cea-8f6f-d65f2386e4e5 req-49eb464a-9a48-4bcf-ba36-179238832a1d service nova] Creating event network-vif-deleted:04c7e2cb-eb1d-478b-a32f-66f51ec8509f for instance 9406dbbe-f48c-4474-8cb6-98621f9f4d5e on n-h1-856895-1 Sep 10 12:49:47.388112 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-f9e4ea2b-901c-4cea-8f6f-d65f2386e4e5 req-49eb464a-9a48-4bcf-ba36-179238832a1d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039795 Sep 10 12:49:47.388729 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3608/7221] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:49:48.163339 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-559bb847-ba40-4d06-9c10-cbd3630ed6d1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:48.163976 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-559bb847-ba40-4d06-9c10-cbd3630ed6d1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:48.171260 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-559bb847-ba40-4d06-9c10-cbd3630ed6d1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:48.171844 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-559bb847-ba40-4d06-9c10-cbd3630ed6d1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:48.172904 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-559bb847-ba40-4d06-9c10-cbd3630ed6d1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:48.173664 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-559bb847-ba40-4d06-9c10-cbd3630ed6d1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:48.174148 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-559bb847-ba40-4d06-9c10-cbd3630ed6d1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:48.174596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-559bb847-ba40-4d06-9c10-cbd3630ed6d1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:48.252315 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-559bb847-ba40-4d06-9c10-cbd3630ed6d1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:48.261743 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-559bb847-ba40-4d06-9c10-cbd3630ed6d1 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1369 microversion: 2.1 time: 0.102561 Sep 10 12:49:48.262495 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3614/7222] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:48 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:49.287489 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ee163ae6-90d0-4cba-bb51-7f39706bcb03 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:49.288184 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ee163ae6-90d0-4cba-bb51-7f39706bcb03 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:49.294366 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee163ae6-90d0-4cba-bb51-7f39706bcb03 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:49.294852 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee163ae6-90d0-4cba-bb51-7f39706bcb03 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:49.295324 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee163ae6-90d0-4cba-bb51-7f39706bcb03 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:49.296069 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee163ae6-90d0-4cba-bb51-7f39706bcb03 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:49.296981 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee163ae6-90d0-4cba-bb51-7f39706bcb03 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:49.297643 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee163ae6-90d0-4cba-bb51-7f39706bcb03 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:49.362871 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ee163ae6-90d0-4cba-bb51-7f39706bcb03 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:49.371694 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ee163ae6-90d0-4cba-bb51-7f39706bcb03 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1369 microversion: 2.1 time: 0.089693 Sep 10 12:49:49.372282 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3609/7223] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:49 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:50.395999 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-92364a56-1620-4fe5-857e-d444cb805413 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:50.396526 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-92364a56-1620-4fe5-857e-d444cb805413 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:50.403402 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-92364a56-1620-4fe5-857e-d444cb805413 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:50.403896 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-92364a56-1620-4fe5-857e-d444cb805413 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:50.404340 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-92364a56-1620-4fe5-857e-d444cb805413 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:50.405036 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-92364a56-1620-4fe5-857e-d444cb805413 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:50.405499 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-92364a56-1620-4fe5-857e-d444cb805413 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:50.406499 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-92364a56-1620-4fe5-857e-d444cb805413 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:50.471715 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-92364a56-1620-4fe5-857e-d444cb805413 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:50.480041 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-92364a56-1620-4fe5-857e-d444cb805413 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1369 microversion: 2.1 time: 0.088086 Sep 10 12:49:50.480618 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3615/7224] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:50 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:49:51.504262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-abb5a51b-26fa-400e-a11b-9ae12ec3a4b4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:51.504894 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-abb5a51b-26fa-400e-a11b-9ae12ec3a4b4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:51.511753 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-abb5a51b-26fa-400e-a11b-9ae12ec3a4b4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:51.512250 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-abb5a51b-26fa-400e-a11b-9ae12ec3a4b4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:51.512696 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-abb5a51b-26fa-400e-a11b-9ae12ec3a4b4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:51.513408 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-abb5a51b-26fa-400e-a11b-9ae12ec3a4b4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:51.513871 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-abb5a51b-26fa-400e-a11b-9ae12ec3a4b4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:51.514312 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-abb5a51b-26fa-400e-a11b-9ae12ec3a4b4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:51.588171 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-abb5a51b-26fa-400e-a11b-9ae12ec3a4b4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c64f49ef84816856aa9227f58a117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5650f863c8c4cfc99dff86c5cb891de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:49:51.599592 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-abb5a51b-26fa-400e-a11b-9ae12ec3a4b4 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 200 len: 1369 microversion: 2.1 time: 0.098395 Sep 10 12:49:51.600188 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3610/7225] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:51 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:49:52.623607 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-55bd43fa-38d1-4662-89dc-e44397df488f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:52.624139 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-55bd43fa-38d1-4662-89dc-e44397df488f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:52.631477 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55bd43fa-38d1-4662-89dc-e44397df488f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:52.631976 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55bd43fa-38d1-4662-89dc-e44397df488f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:52.632428 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55bd43fa-38d1-4662-89dc-e44397df488f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:52.633148 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55bd43fa-38d1-4662-89dc-e44397df488f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:52.633600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55bd43fa-38d1-4662-89dc-e44397df488f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:52.634041 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-55bd43fa-38d1-4662-89dc-e44397df488f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:52.648001 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-55bd43fa-38d1-4662-89dc-e44397df488f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] HTTP exception thrown: Instance 9406dbbe-f48c-4474-8cb6-98621f9f4d5e could not be found. Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-55bd43fa-38d1-4662-89dc-e44397df488f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Request method failure captured: Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e HTTP/1.1 Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHIY9pEcRxalGK0PRpWwJTPeIAmQdSVovGoKpjRHBadvNmS2zGA_1an-TV7fdcpLow3fAP0-09VXHTMTC_3vkf2uc1w0SzWzU41k8Z5jw87gxtxl3CjHwSJsSu8lEyMnyoe3KziUpq4KmRSdH5R3eKqmRJRunRX8W6B-IBvqRpO11xPw Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: e5650f863c8c4cfc99dff86c5cb891de Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e5650f863c8c4cfc99dff86c5cb891de", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: e5650f863c8c4cfc99dff86c5cb891de Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServerActionsTestJSON-1025860466-project Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 654c64f49ef84816856aa9227f58a117 Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServerActionsTestJSON-1025860466-project Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 9406dbbe-f48c-4474-8cb6-98621f9f4d5e could not be found. Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '9406dbbe-f48c-4474-8cb6-98621f9f4d5e'} Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9406dbbe-f48c-4474-8cb6-98621f9f4d5e could not be found. Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9406dbbe-f48c-4474-8cb6-98621f9f4d5e could not be found. Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:49:52.649662 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:49:52.654701 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:49:52.654701 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:49:52.654701 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:49:52.654701 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:49:52.654701 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:49:52.654701 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9406dbbe-f48c-4474-8cb6-98621f9f4d5e could not be found. Sep 10 12:49:52.654701 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:49:52.654701 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-55bd43fa-38d1-4662-89dc-e44397df488f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Returning 404 to user: Instance 9406dbbe-f48c-4474-8cb6-98621f9f4d5e could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:49:52.654701 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-55bd43fa-38d1-4662-89dc-e44397df488f tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 404 len: 111 microversion: 2.1 time: 0.031811 Sep 10 12:49:52.654701 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3616/7226] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:52 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:49:52.712021 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cb4911b3-14d2-46f6-9dff-b4488ff1774b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:52.714232 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cb4911b3-14d2-46f6-9dff-b4488ff1774b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:52.721168 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb4911b3-14d2-46f6-9dff-b4488ff1774b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:52.721655 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb4911b3-14d2-46f6-9dff-b4488ff1774b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:52.722093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb4911b3-14d2-46f6-9dff-b4488ff1774b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:52.722780 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb4911b3-14d2-46f6-9dff-b4488ff1774b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:52.723266 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb4911b3-14d2-46f6-9dff-b4488ff1774b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:52.723692 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb4911b3-14d2-46f6-9dff-b4488ff1774b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:52.736695 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-cb4911b3-14d2-46f6-9dff-b4488ff1774b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] HTTP exception thrown: Instance 9406dbbe-f48c-4474-8cb6-98621f9f4d5e could not be found. Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cb4911b3-14d2-46f6-9dff-b4488ff1774b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Request method failure captured: Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e/os-volume_attachments HTTP/1.1 Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHIY9pEcRxalGK0PRpWwJTPeIAmQdSVovGoKpjRHBadvNmS2zGA_1an-TV7fdcpLow3fAP0-09VXHTMTC_3vkf2uc1w0SzWzU41k8Z5jw87gxtxl3CjHwSJsSu8lEyMnyoe3KziUpq4KmRSdH5R3eKqmRJRunRX8W6B-IBvqRpO11xPw Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: e5650f863c8c4cfc99dff86c5cb891de Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e5650f863c8c4cfc99dff86c5cb891de", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: e5650f863c8c4cfc99dff86c5cb891de Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServerActionsTestJSON-1025860466-project Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 654c64f49ef84816856aa9227f58a117 Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServerActionsTestJSON-1025860466-project Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 9406dbbe-f48c-4474-8cb6-98621f9f4d5e could not be found. Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'server_id': '9406dbbe-f48c-4474-8cb6-98621f9f4d5e'} Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9406dbbe-f48c-4474-8cb6-98621f9f4d5e could not be found. Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:49:52.738372 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:49:52.742791 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9406dbbe-f48c-4474-8cb6-98621f9f4d5e could not be found. Sep 10 12:49:52.742791 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:49:52.742791 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:49:52.742791 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:49:52.742791 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:49:52.742791 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:49:52.742791 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:49:52.742791 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:49:52.742791 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:49:52.742791 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9406dbbe-f48c-4474-8cb6-98621f9f4d5e could not be found. Sep 10 12:49:52.742791 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:49:52.742791 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cb4911b3-14d2-46f6-9dff-b4488ff1774b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Returning 404 to user: Instance 9406dbbe-f48c-4474-8cb6-98621f9f4d5e could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:49:52.742791 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cb4911b3-14d2-46f6-9dff-b4488ff1774b tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031859 Sep 10 12:49:52.742791 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3611/7227] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:49:52 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:49:56.066185 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-261116d9-2295-42a9-a7a7-b032c707edd7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:56.066697 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-261116d9-2295-42a9-a7a7-b032c707edd7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:56.073611 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-261116d9-2295-42a9-a7a7-b032c707edd7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:56.074103 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-261116d9-2295-42a9-a7a7-b032c707edd7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:56.074551 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-261116d9-2295-42a9-a7a7-b032c707edd7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:56.075280 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-261116d9-2295-42a9-a7a7-b032c707edd7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:56.075744 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-261116d9-2295-42a9-a7a7-b032c707edd7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:56.076180 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-261116d9-2295-42a9-a7a7-b032c707edd7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:56.090447 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-261116d9-2295-42a9-a7a7-b032c707edd7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] HTTP exception thrown: Instance 9406dbbe-f48c-4474-8cb6-98621f9f4d5e could not be found. Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-261116d9-2295-42a9-a7a7-b032c707edd7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Request method failure captured: Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e HTTP/1.1 Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHIY9pEcRxalGK0PRpWwJTPeIAmQdSVovGoKpjRHBadvNmS2zGA_1an-TV7fdcpLow3fAP0-09VXHTMTC_3vkf2uc1w0SzWzU41k8Z5jw87gxtxl3CjHwSJsSu8lEyMnyoe3KziUpq4KmRSdH5R3eKqmRJRunRX8W6B-IBvqRpO11xPw Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: e5650f863c8c4cfc99dff86c5cb891de Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e5650f863c8c4cfc99dff86c5cb891de", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: e5650f863c8c4cfc99dff86c5cb891de Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServerActionsTestJSON-1025860466-project Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 654c64f49ef84816856aa9227f58a117 Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServerActionsTestJSON-1025860466-project Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 9406dbbe-f48c-4474-8cb6-98621f9f4d5e could not be found. Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '9406dbbe-f48c-4474-8cb6-98621f9f4d5e'} Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9406dbbe-f48c-4474-8cb6-98621f9f4d5e could not be found. Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:49:56.092055 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:49:56.096274 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9406dbbe-f48c-4474-8cb6-98621f9f4d5e could not be found. Sep 10 12:49:56.096274 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:49:56.096274 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:49:56.096274 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:49:56.096274 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:49:56.096274 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:49:56.096274 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:49:56.096274 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:49:56.096274 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:49:56.096274 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9406dbbe-f48c-4474-8cb6-98621f9f4d5e could not be found. Sep 10 12:49:56.096274 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:49:56.096274 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-261116d9-2295-42a9-a7a7-b032c707edd7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Returning 404 to user: Instance 9406dbbe-f48c-4474-8cb6-98621f9f4d5e could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:49:56.096274 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-261116d9-2295-42a9-a7a7-b032c707edd7 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 404 len: 111 microversion: 2.1 time: 0.032090 Sep 10 12:49:56.096274 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3617/7228] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:49:56 2022] DELETE /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:49:56.102724 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9330ad8a-cb25-4fc3-921c-add424111041 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:56.103395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9330ad8a-cb25-4fc3-921c-add424111041 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 9406dbbe-f48c-4474-8cb6-98621f9f4d5e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:56.110666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9330ad8a-cb25-4fc3-921c-add424111041 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:56.111157 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9330ad8a-cb25-4fc3-921c-add424111041 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:56.111618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9330ad8a-cb25-4fc3-921c-add424111041 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:56.112336 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9330ad8a-cb25-4fc3-921c-add424111041 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:56.112798 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9330ad8a-cb25-4fc3-921c-add424111041 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:56.113227 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9330ad8a-cb25-4fc3-921c-add424111041 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:56.129500 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-9330ad8a-cb25-4fc3-921c-add424111041 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] HTTP exception thrown: Instance 9406dbbe-f48c-4474-8cb6-98621f9f4d5e could not be found. Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9330ad8a-cb25-4fc3-921c-add424111041 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Request method failure captured: Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e HTTP/1.1 Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHIY9pEcRxalGK0PRpWwJTPeIAmQdSVovGoKpjRHBadvNmS2zGA_1an-TV7fdcpLow3fAP0-09VXHTMTC_3vkf2uc1w0SzWzU41k8Z5jw87gxtxl3CjHwSJsSu8lEyMnyoe3KziUpq4KmRSdH5R3eKqmRJRunRX8W6B-IBvqRpO11xPw Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: e5650f863c8c4cfc99dff86c5cb891de Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e5650f863c8c4cfc99dff86c5cb891de", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: e5650f863c8c4cfc99dff86c5cb891de Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServerActionsTestJSON-1025860466-project Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 654c64f49ef84816856aa9227f58a117 Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServerActionsTestJSON-1025860466-project Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 9406dbbe-f48c-4474-8cb6-98621f9f4d5e could not be found. Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '9406dbbe-f48c-4474-8cb6-98621f9f4d5e'} Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9406dbbe-f48c-4474-8cb6-98621f9f4d5e could not be found. Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9406dbbe-f48c-4474-8cb6-98621f9f4d5e could not be found. Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:49:56.131432 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:49:56.135210 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:49:56.135210 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:49:56.135210 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:49:56.135210 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:49:56.135210 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:49:56.135210 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9406dbbe-f48c-4474-8cb6-98621f9f4d5e could not be found. Sep 10 12:49:56.135210 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:49:56.135210 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9330ad8a-cb25-4fc3-921c-add424111041 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Returning 404 to user: Instance 9406dbbe-f48c-4474-8cb6-98621f9f4d5e could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:49:56.135210 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9330ad8a-cb25-4fc3-921c-add424111041 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e" status: 404 len: 111 microversion: 2.1 time: 0.034022 Sep 10 12:49:56.137059 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3612/7229] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:56 2022] GET /compute/v2.1/servers/9406dbbe-f48c-4474-8cb6-98621f9f4d5e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:49:56.142821 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8e88b72f-ba7f-40cf-9de6-2159791c2538 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:56.143370 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8e88b72f-ba7f-40cf-9de6-2159791c2538 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:56.149598 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e88b72f-ba7f-40cf-9de6-2159791c2538 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:56.150107 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e88b72f-ba7f-40cf-9de6-2159791c2538 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:56.150556 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e88b72f-ba7f-40cf-9de6-2159791c2538 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:56.151307 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e88b72f-ba7f-40cf-9de6-2159791c2538 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:56.151776 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e88b72f-ba7f-40cf-9de6-2159791c2538 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:56.152210 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8e88b72f-ba7f-40cf-9de6-2159791c2538 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:56.169367 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-8e88b72f-ba7f-40cf-9de6-2159791c2538 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] HTTP exception thrown: Instance 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 could not be found. Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8e88b72f-ba7f-40cf-9de6-2159791c2538 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Request method failure captured: Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 HTTP/1.1 Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHIY9pEcRxalGK0PRpWwJTPeIAmQdSVovGoKpjRHBadvNmS2zGA_1an-TV7fdcpLow3fAP0-09VXHTMTC_3vkf2uc1w0SzWzU41k8Z5jw87gxtxl3CjHwSJsSu8lEyMnyoe3KziUpq4KmRSdH5R3eKqmRJRunRX8W6B-IBvqRpO11xPw Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: e5650f863c8c4cfc99dff86c5cb891de Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e5650f863c8c4cfc99dff86c5cb891de", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: e5650f863c8c4cfc99dff86c5cb891de Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServerActionsTestJSON-1025860466-project Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 654c64f49ef84816856aa9227f58a117 Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServerActionsTestJSON-1025860466-project Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 could not be found. Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924'} Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 could not be found. Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:49:56.170932 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:49:56.174851 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 could not be found. Sep 10 12:49:56.174851 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:49:56.174851 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:49:56.174851 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:49:56.174851 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:49:56.174851 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:49:56.174851 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:49:56.174851 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:49:56.174851 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:49:56.174851 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 could not be found. Sep 10 12:49:56.174851 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:49:56.174851 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8e88b72f-ba7f-40cf-9de6-2159791c2538 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Returning 404 to user: Instance 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:49:56.174851 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8e88b72f-ba7f-40cf-9de6-2159791c2538 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 404 len: 111 microversion: 2.1 time: 0.034424 Sep 10 12:49:56.174851 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3618/7230] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:49:56 2022] DELETE /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:49:56.181205 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-66fe148b-7f8b-4aa8-a546-557e583618e0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:56.181981 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-66fe148b-7f8b-4aa8-a546-557e583618e0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:56.188701 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66fe148b-7f8b-4aa8-a546-557e583618e0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:56.189305 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66fe148b-7f8b-4aa8-a546-557e583618e0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:56.189752 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66fe148b-7f8b-4aa8-a546-557e583618e0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:56.190462 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66fe148b-7f8b-4aa8-a546-557e583618e0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:56.191055 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66fe148b-7f8b-4aa8-a546-557e583618e0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:56.191881 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66fe148b-7f8b-4aa8-a546-557e583618e0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:56.206106 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-66fe148b-7f8b-4aa8-a546-557e583618e0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] HTTP exception thrown: Instance 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 could not be found. Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-66fe148b-7f8b-4aa8-a546-557e583618e0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Request method failure captured: Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 HTTP/1.1 Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHIY9pEcRxalGK0PRpWwJTPeIAmQdSVovGoKpjRHBadvNmS2zGA_1an-TV7fdcpLow3fAP0-09VXHTMTC_3vkf2uc1w0SzWzU41k8Z5jw87gxtxl3CjHwSJsSu8lEyMnyoe3KziUpq4KmRSdH5R3eKqmRJRunRX8W6B-IBvqRpO11xPw Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: e5650f863c8c4cfc99dff86c5cb891de Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e5650f863c8c4cfc99dff86c5cb891de", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: e5650f863c8c4cfc99dff86c5cb891de Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServerActionsTestJSON-1025860466-project Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 654c64f49ef84816856aa9227f58a117 Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServerActionsTestJSON-1025860466-project Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 could not be found. Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924'} Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 could not be found. Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 could not be found. Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:49:56.207705 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:49:56.212424 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:49:56.212424 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:49:56.212424 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:49:56.212424 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:49:56.212424 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:49:56.212424 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 could not be found. Sep 10 12:49:56.212424 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:49:56.212424 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-66fe148b-7f8b-4aa8-a546-557e583618e0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Returning 404 to user: Instance 8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:49:56.212424 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-66fe148b-7f8b-4aa8-a546-557e583618e0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924" status: 404 len: 111 microversion: 2.1 time: 0.031901 Sep 10 12:49:56.213121 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3613/7231] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:56 2022] GET /compute/v2.1/servers/8fa958e8-95c1-4d0f-aa3a-6fe3cb0f5924 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 12:49:56.218071 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1ebf231a-e98c-45f8-b4b4-8fc77fde0115 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:56.218712 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1ebf231a-e98c-45f8-b4b4-8fc77fde0115 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:56.225097 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1ebf231a-e98c-45f8-b4b4-8fc77fde0115 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:56.225694 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1ebf231a-e98c-45f8-b4b4-8fc77fde0115 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:56.226218 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1ebf231a-e98c-45f8-b4b4-8fc77fde0115 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:56.226998 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1ebf231a-e98c-45f8-b4b4-8fc77fde0115 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:56.227677 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1ebf231a-e98c-45f8-b4b4-8fc77fde0115 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:56.228205 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1ebf231a-e98c-45f8-b4b4-8fc77fde0115 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:56.242507 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-1ebf231a-e98c-45f8-b4b4-8fc77fde0115 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] HTTP exception thrown: Instance 84bb01bc-39dd-45dd-8435-5d7578628f38 could not be found. Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1ebf231a-e98c-45f8-b4b4-8fc77fde0115 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Request method failure captured: Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 HTTP/1.1 Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHIY9pEcRxalGK0PRpWwJTPeIAmQdSVovGoKpjRHBadvNmS2zGA_1an-TV7fdcpLow3fAP0-09VXHTMTC_3vkf2uc1w0SzWzU41k8Z5jw87gxtxl3CjHwSJsSu8lEyMnyoe3KziUpq4KmRSdH5R3eKqmRJRunRX8W6B-IBvqRpO11xPw Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: e5650f863c8c4cfc99dff86c5cb891de Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e5650f863c8c4cfc99dff86c5cb891de", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: e5650f863c8c4cfc99dff86c5cb891de Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServerActionsTestJSON-1025860466-project Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 654c64f49ef84816856aa9227f58a117 Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServerActionsTestJSON-1025860466-project Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 84bb01bc-39dd-45dd-8435-5d7578628f38 could not be found. Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '84bb01bc-39dd-45dd-8435-5d7578628f38'} Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84bb01bc-39dd-45dd-8435-5d7578628f38 could not be found. Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:49:56.244241 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:49:56.248871 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84bb01bc-39dd-45dd-8435-5d7578628f38 could not be found. Sep 10 12:49:56.248871 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:49:56.248871 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:49:56.248871 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:49:56.248871 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:49:56.248871 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:49:56.248871 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:49:56.248871 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:49:56.248871 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:49:56.248871 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84bb01bc-39dd-45dd-8435-5d7578628f38 could not be found. Sep 10 12:49:56.248871 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:49:56.248871 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1ebf231a-e98c-45f8-b4b4-8fc77fde0115 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Returning 404 to user: Instance 84bb01bc-39dd-45dd-8435-5d7578628f38 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:49:56.248871 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1ebf231a-e98c-45f8-b4b4-8fc77fde0115 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "DELETE /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 404 len: 111 microversion: 2.1 time: 0.033648 Sep 10 12:49:56.250659 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3619/7232] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:49:56 2022] DELETE /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:49:56.258231 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f02c7a3e-afd8-40f1-a971-9eb0afa0bbca tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:56.258976 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f02c7a3e-afd8-40f1-a971-9eb0afa0bbca tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: 84bb01bc-39dd-45dd-8435-5d7578628f38] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:56.265697 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f02c7a3e-afd8-40f1-a971-9eb0afa0bbca tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:56.266372 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f02c7a3e-afd8-40f1-a971-9eb0afa0bbca tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:56.266888 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f02c7a3e-afd8-40f1-a971-9eb0afa0bbca tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:56.267979 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f02c7a3e-afd8-40f1-a971-9eb0afa0bbca tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:56.268521 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f02c7a3e-afd8-40f1-a971-9eb0afa0bbca tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:56.269020 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f02c7a3e-afd8-40f1-a971-9eb0afa0bbca tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:56.283000 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-f02c7a3e-afd8-40f1-a971-9eb0afa0bbca tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] HTTP exception thrown: Instance 84bb01bc-39dd-45dd-8435-5d7578628f38 could not be found. Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f02c7a3e-afd8-40f1-a971-9eb0afa0bbca tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Request method failure captured: Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 HTTP/1.1 Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHIY9pEcRxalGK0PRpWwJTPeIAmQdSVovGoKpjRHBadvNmS2zGA_1an-TV7fdcpLow3fAP0-09VXHTMTC_3vkf2uc1w0SzWzU41k8Z5jw87gxtxl3CjHwSJsSu8lEyMnyoe3KziUpq4KmRSdH5R3eKqmRJRunRX8W6B-IBvqRpO11xPw Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: e5650f863c8c4cfc99dff86c5cb891de Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e5650f863c8c4cfc99dff86c5cb891de", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: e5650f863c8c4cfc99dff86c5cb891de Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServerActionsTestJSON-1025860466-project Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 654c64f49ef84816856aa9227f58a117 Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServerActionsTestJSON-1025860466-project Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 84bb01bc-39dd-45dd-8435-5d7578628f38 could not be found. Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '84bb01bc-39dd-45dd-8435-5d7578628f38'} Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84bb01bc-39dd-45dd-8435-5d7578628f38 could not be found. Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84bb01bc-39dd-45dd-8435-5d7578628f38 could not be found. Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:49:56.284665 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:49:56.289334 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:49:56.289334 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:49:56.289334 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:49:56.289334 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:49:56.289334 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:49:56.289334 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84bb01bc-39dd-45dd-8435-5d7578628f38 could not be found. Sep 10 12:49:56.289334 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:49:56.289334 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f02c7a3e-afd8-40f1-a971-9eb0afa0bbca tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Returning 404 to user: Instance 84bb01bc-39dd-45dd-8435-5d7578628f38 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:49:56.289334 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f02c7a3e-afd8-40f1-a971-9eb0afa0bbca tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38" status: 404 len: 111 microversion: 2.1 time: 0.033112 Sep 10 12:49:56.289334 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3614/7233] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:56 2022] GET /compute/v2.1/servers/84bb01bc-39dd-45dd-8435-5d7578628f38 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:49:56.296225 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-889f0a1d-d05c-4516-83ca-97005147b353 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:56.296989 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-889f0a1d-d05c-4516-83ca-97005147b353 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:56.303257 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-889f0a1d-d05c-4516-83ca-97005147b353 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:56.303826 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-889f0a1d-d05c-4516-83ca-97005147b353 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:56.304343 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-889f0a1d-d05c-4516-83ca-97005147b353 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:56.305104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-889f0a1d-d05c-4516-83ca-97005147b353 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:56.305652 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-889f0a1d-d05c-4516-83ca-97005147b353 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:56.306154 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-889f0a1d-d05c-4516-83ca-97005147b353 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:56.320863 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-889f0a1d-d05c-4516-83ca-97005147b353 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] HTTP exception thrown: Instance ffa59f14-0af0-4c3d-b6b8-75d5c15254fa could not be found. Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-889f0a1d-d05c-4516-83ca-97005147b353 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Request method failure captured: Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa HTTP/1.1 Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHIY9pEcRxalGK0PRpWwJTPeIAmQdSVovGoKpjRHBadvNmS2zGA_1an-TV7fdcpLow3fAP0-09VXHTMTC_3vkf2uc1w0SzWzU41k8Z5jw87gxtxl3CjHwSJsSu8lEyMnyoe3KziUpq4KmRSdH5R3eKqmRJRunRX8W6B-IBvqRpO11xPw Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: e5650f863c8c4cfc99dff86c5cb891de Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e5650f863c8c4cfc99dff86c5cb891de", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: e5650f863c8c4cfc99dff86c5cb891de Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServerActionsTestJSON-1025860466-project Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 654c64f49ef84816856aa9227f58a117 Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServerActionsTestJSON-1025860466-project Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance ffa59f14-0af0-4c3d-b6b8-75d5c15254fa could not be found. Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'ffa59f14-0af0-4c3d-b6b8-75d5c15254fa'} Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffa59f14-0af0-4c3d-b6b8-75d5c15254fa could not be found. Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:49:56.322533 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:49:56.327151 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffa59f14-0af0-4c3d-b6b8-75d5c15254fa could not be found. Sep 10 12:49:56.327151 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:49:56.327151 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:49:56.327151 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:49:56.327151 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:49:56.327151 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:49:56.327151 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:49:56.327151 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:49:56.327151 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:49:56.327151 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffa59f14-0af0-4c3d-b6b8-75d5c15254fa could not be found. Sep 10 12:49:56.327151 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:49:56.327151 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-889f0a1d-d05c-4516-83ca-97005147b353 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Returning 404 to user: Instance ffa59f14-0af0-4c3d-b6b8-75d5c15254fa could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:49:56.327151 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-889f0a1d-d05c-4516-83ca-97005147b353 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa" status: 404 len: 111 microversion: 2.1 time: 0.032916 Sep 10 12:49:56.329152 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3620/7234] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:49:56 2022] DELETE /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 12:49:56.336013 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3d4baf85-6bb1-4373-847d-ab59529c7ca0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:56.336645 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3d4baf85-6bb1-4373-847d-ab59529c7ca0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [instance: ffa59f14-0af0-4c3d-b6b8-75d5c15254fa] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:49:56.342858 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d4baf85-6bb1-4373-847d-ab59529c7ca0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:56.343684 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d4baf85-6bb1-4373-847d-ab59529c7ca0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:56.344140 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d4baf85-6bb1-4373-847d-ab59529c7ca0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:56.344852 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d4baf85-6bb1-4373-847d-ab59529c7ca0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:49:56.345319 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d4baf85-6bb1-4373-847d-ab59529c7ca0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:49:56.345756 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d4baf85-6bb1-4373-847d-ab59529c7ca0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:49:56.359788 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-3d4baf85-6bb1-4373-847d-ab59529c7ca0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] HTTP exception thrown: Instance ffa59f14-0af0-4c3d-b6b8-75d5c15254fa could not be found. Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3d4baf85-6bb1-4373-847d-ab59529c7ca0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Request method failure captured: Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa HTTP/1.1 Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHIY9pEcRxalGK0PRpWwJTPeIAmQdSVovGoKpjRHBadvNmS2zGA_1an-TV7fdcpLow3fAP0-09VXHTMTC_3vkf2uc1w0SzWzU41k8Z5jw87gxtxl3CjHwSJsSu8lEyMnyoe3KziUpq4KmRSdH5R3eKqmRJRunRX8W6B-IBvqRpO11xPw Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: e5650f863c8c4cfc99dff86c5cb891de Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e5650f863c8c4cfc99dff86c5cb891de", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e5650f863c8c4cfc99dff86c5cb891de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: e5650f863c8c4cfc99dff86c5cb891de Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServerActionsTestJSON-1025860466 Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServerActionsTestJSON-1025860466-project Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 654c64f49ef84816856aa9227f58a117 Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServerActionsTestJSON-1025860466-project Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance ffa59f14-0af0-4c3d-b6b8-75d5c15254fa could not be found. Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'ffa59f14-0af0-4c3d-b6b8-75d5c15254fa'} Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffa59f14-0af0-4c3d-b6b8-75d5c15254fa could not be found. Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffa59f14-0af0-4c3d-b6b8-75d5c15254fa could not be found. Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:49:56.361357 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:49:56.365240 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:49:56.365240 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:49:56.365240 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:49:56.365240 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:49:56.365240 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:49:56.365240 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffa59f14-0af0-4c3d-b6b8-75d5c15254fa could not be found. Sep 10 12:49:56.365240 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:49:56.365240 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3d4baf85-6bb1-4373-847d-ab59529c7ca0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Returning 404 to user: Instance ffa59f14-0af0-4c3d-b6b8-75d5c15254fa could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:49:56.365240 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3d4baf85-6bb1-4373-847d-ab59529c7ca0 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa" status: 404 len: 111 microversion: 2.1 time: 0.030695 Sep 10 12:49:56.365240 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3615/7235] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:49:56 2022] GET /compute/v2.1/servers/ffa59f14-0af0-4c3d-b6b8-75d5c15254fa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:49:56.371952 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-21017ac9-899f-4675-8a6b-615f6f0fa006 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] Calling method '.version_select at 0x7f4073772160>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:49:56.377183 n-d-856895-1 devstack@n-api.service[128776]: ERROR oslo.messaging._drivers.impl_rabbit [None req-21017ac9-899f-4675-8a6b-615f6f0fa006 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [191798a7-2c5e-4d74-b865-4708090abecb] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 10 12:49:57.383999 n-d-856895-1 devstack@n-api.service[128776]: INFO oslo.messaging._drivers.impl_rabbit [None req-21017ac9-899f-4675-8a6b-615f6f0fa006 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] [191798a7-2c5e-4d74-b865-4708090abecb] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 35336. Sep 10 12:49:57.406911 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-21017ac9-899f-4675-8a6b-615f6f0fa006 tempest-ServerActionsTestJSON-1025860466 tempest-ServerActionsTestJSON-1025860466-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1213083482" status: 202 len: 0 microversion: 2.1 time: 1.038892 Sep 10 12:49:57.407453 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3621/7236] 10.222.0.23 () {58 vars in 1221 bytes} [Sat Sep 10 12:49:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1213083482 => generated 0 bytes in 1040 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:50:06.835694 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=23 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:50:06.837086 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=47 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:50:06.955310 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e41715ea-f960-44fe-a574-3f9083abcdd5 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1546541267", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "03e39d9a-b02e-4871-b48d-5df3c693b6c9"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:50:07.012973 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-e41715ea-f960-44fe-a574-3f9083abcdd5 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] validate_networks() for [('03e39d9a-b02e-4871-b48d-5df3c693b6c9', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:50:07.402318 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-e41715ea-f960-44fe-a574-3f9083abcdd5 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:50:07.402753 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-e41715ea-f960-44fe-a574-3f9083abcdd5 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:50:07.403292 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-e41715ea-f960-44fe-a574-3f9083abcdd5 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:50:07.403744 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-e41715ea-f960-44fe-a574-3f9083abcdd5 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:50:07.404165 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-e41715ea-f960-44fe-a574-3f9083abcdd5 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:50:07.413427 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e41715ea-f960-44fe-a574-3f9083abcdd5 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:07.413914 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e41715ea-f960-44fe-a574-3f9083abcdd5 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:07.414361 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e41715ea-f960-44fe-a574-3f9083abcdd5 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:07.415095 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e41715ea-f960-44fe-a574-3f9083abcdd5 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:07.415592 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e41715ea-f960-44fe-a574-3f9083abcdd5 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:07.416025 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e41715ea-f960-44fe-a574-3f9083abcdd5 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:07.432707 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-e41715ea-f960-44fe-a574-3f9083abcdd5 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Getting quotas for project 419520115d134a2e8bc0695fd87b6e13. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:50:07.438746 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-e41715ea-f960-44fe-a574-3f9083abcdd5 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Getting quotas for user 08cb3fde20d74b0a9127c3a062d89714 and project 419520115d134a2e8bc0695fd87b6e13. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:50:07.451102 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e41715ea-f960-44fe-a574-3f9083abcdd5 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:50:07.454061 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e41715ea-f960-44fe-a574-3f9083abcdd5 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [instance: fcf10137-3a7d-4815-9fde-2ad127d4fc59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:50:07.497779 n-d-856895-1 devstack@n-api.service[128777]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e41715ea-f960-44fe-a574-3f9083abcdd5 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [0d5c13ae-d458-4ac4-b347-adfca3c710c8] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 10 12:50:08.506871 n-d-856895-1 devstack@n-api.service[128777]: INFO oslo.messaging._drivers.impl_rabbit [None req-e41715ea-f960-44fe-a574-3f9083abcdd5 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [0d5c13ae-d458-4ac4-b347-adfca3c710c8] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 35420. Sep 10 12:50:08.511541 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e41715ea-f960-44fe-a574-3f9083abcdd5 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.681442 Sep 10 12:50:08.519391 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3616/7237] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:50:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:50:08.522255 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:50:08.523623 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:50:08.528594 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bba59e01-84a2-46e2-8877-5309e0f95c70 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:50:08.531276 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bba59e01-84a2-46e2-8877-5309e0f95c70 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [instance: fcf10137-3a7d-4815-9fde-2ad127d4fc59] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:50:08.597423 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bba59e01-84a2-46e2-8877-5309e0f95c70 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cb3fde20d74b0a9127c3a062d89714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419520115d134a2e8bc0695fd87b6e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:50:08.606053 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bba59e01-84a2-46e2-8877-5309e0f95c70 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] 10.222.0.23 "GET /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59" status: 200 len: 1217 microversion: 2.1 time: 0.085704 Sep 10 12:50:08.606823 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3622/7238] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:50:08 2022] GET /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:50:09.634031 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-47b7cfc1-8a67-4534-9de0-009d94cb66d0 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:50:09.634677 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-47b7cfc1-8a67-4534-9de0-009d94cb66d0 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [instance: fcf10137-3a7d-4815-9fde-2ad127d4fc59] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:50:09.647619 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47b7cfc1-8a67-4534-9de0-009d94cb66d0 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:09.648316 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47b7cfc1-8a67-4534-9de0-009d94cb66d0 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:09.648988 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47b7cfc1-8a67-4534-9de0-009d94cb66d0 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:09.650380 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47b7cfc1-8a67-4534-9de0-009d94cb66d0 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:09.650793 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47b7cfc1-8a67-4534-9de0-009d94cb66d0 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:09.651354 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47b7cfc1-8a67-4534-9de0-009d94cb66d0 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:10.075839 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-47b7cfc1-8a67-4534-9de0-009d94cb66d0 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cb3fde20d74b0a9127c3a062d89714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419520115d134a2e8bc0695fd87b6e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:50:10.086919 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-47b7cfc1-8a67-4534-9de0-009d94cb66d0 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] 10.222.0.23 "GET /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59" status: 200 len: 1277 microversion: 2.1 time: 0.460017 Sep 10 12:50:10.095678 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3617/7239] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:50:09 2022] GET /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59 => generated 1277 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:50:11.110696 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bdec29f7-91af-40e5-8e5e-030c7221cb9c tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:50:11.111976 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bdec29f7-91af-40e5-8e5e-030c7221cb9c tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [instance: fcf10137-3a7d-4815-9fde-2ad127d4fc59] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:50:11.119716 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bdec29f7-91af-40e5-8e5e-030c7221cb9c tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:11.120347 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bdec29f7-91af-40e5-8e5e-030c7221cb9c tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:11.121195 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bdec29f7-91af-40e5-8e5e-030c7221cb9c tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:11.122185 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bdec29f7-91af-40e5-8e5e-030c7221cb9c tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:11.122609 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bdec29f7-91af-40e5-8e5e-030c7221cb9c tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:11.123262 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bdec29f7-91af-40e5-8e5e-030c7221cb9c tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:11.362493 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bdec29f7-91af-40e5-8e5e-030c7221cb9c tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cb3fde20d74b0a9127c3a062d89714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419520115d134a2e8bc0695fd87b6e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:50:11.370245 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bdec29f7-91af-40e5-8e5e-030c7221cb9c tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] 10.222.0.23 "GET /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59" status: 200 len: 1317 microversion: 2.1 time: 0.263836 Sep 10 12:50:11.371087 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3623/7240] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:50:11 2022] GET /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59 => generated 1317 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:50:11.529552 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-14ebf9b8-bb4a-4e86-b41c-501236326e59 req-08113844-c59b-409a-aeb0-b8e1e43ecfac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcf10137-3a7d-4815-9fde-2ad127d4fc59", "tag": "7c461eef-470d-4aa8-bd3f-dbd0d430bb72"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:50:11.540727 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-14ebf9b8-bb4a-4e86-b41c-501236326e59 req-08113844-c59b-409a-aeb0-b8e1e43ecfac service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:11.541521 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-14ebf9b8-bb4a-4e86-b41c-501236326e59 req-08113844-c59b-409a-aeb0-b8e1e43ecfac service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:11.542144 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-14ebf9b8-bb4a-4e86-b41c-501236326e59 req-08113844-c59b-409a-aeb0-b8e1e43ecfac service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:11.556781 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-14ebf9b8-bb4a-4e86-b41c-501236326e59 req-08113844-c59b-409a-aeb0-b8e1e43ecfac service nova] Creating event network-changed:7c461eef-470d-4aa8-bd3f-dbd0d430bb72 for instance fcf10137-3a7d-4815-9fde-2ad127d4fc59 on n-h1-856895-1 Sep 10 12:50:11.563509 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-14ebf9b8-bb4a-4e86-b41c-501236326e59 req-08113844-c59b-409a-aeb0-b8e1e43ecfac service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037159 Sep 10 12:50:11.564438 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3618/7241] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:50:12.395679 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c1ca17a7-62d3-4696-bc60-66d6967ca68e tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:50:12.396346 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c1ca17a7-62d3-4696-bc60-66d6967ca68e tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [instance: fcf10137-3a7d-4815-9fde-2ad127d4fc59] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:50:12.403780 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1ca17a7-62d3-4696-bc60-66d6967ca68e tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:12.404283 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1ca17a7-62d3-4696-bc60-66d6967ca68e tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:12.404741 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1ca17a7-62d3-4696-bc60-66d6967ca68e tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:12.406094 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1ca17a7-62d3-4696-bc60-66d6967ca68e tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:12.406571 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1ca17a7-62d3-4696-bc60-66d6967ca68e tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:12.407018 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1ca17a7-62d3-4696-bc60-66d6967ca68e tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:12.535492 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c1ca17a7-62d3-4696-bc60-66d6967ca68e tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cb3fde20d74b0a9127c3a062d89714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419520115d134a2e8bc0695fd87b6e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:50:12.543302 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c1ca17a7-62d3-4696-bc60-66d6967ca68e tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] 10.222.0.23 "GET /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59" status: 200 len: 1317 microversion: 2.1 time: 0.151594 Sep 10 12:50:12.543839 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3624/7242] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:50:12 2022] GET /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:50:13.564765 n-d-856895-1 devstack@n-api.service[128777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 12:50:13.565269 n-d-856895-1 devstack@n-api.service[128777]: Sat Sep 10 12:50:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59 (ip 10.222.0.23) !!! Sep 10 12:50:13.570491 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e0b263d9-7a2b-4774-b4f0-2a4cca3b349f tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:50:13.571224 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e0b263d9-7a2b-4774-b4f0-2a4cca3b349f tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [instance: fcf10137-3a7d-4815-9fde-2ad127d4fc59] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:50:13.582370 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0b263d9-7a2b-4774-b4f0-2a4cca3b349f tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:13.582859 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0b263d9-7a2b-4774-b4f0-2a4cca3b349f tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:13.583327 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0b263d9-7a2b-4774-b4f0-2a4cca3b349f tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:13.584026 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0b263d9-7a2b-4774-b4f0-2a4cca3b349f tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:13.584481 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0b263d9-7a2b-4774-b4f0-2a4cca3b349f tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:13.584959 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e0b263d9-7a2b-4774-b4f0-2a4cca3b349f tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:13.723036 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e0b263d9-7a2b-4774-b4f0-2a4cca3b349f tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cb3fde20d74b0a9127c3a062d89714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419520115d134a2e8bc0695fd87b6e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:50:13.730731 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e0b263d9-7a2b-4774-b4f0-2a4cca3b349f tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] 10.222.0.23 "GET /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59" status: 200 len: 1317 microversion: 2.1 time: 0.167499 Sep 10 12:50:13.731343 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3619/7243] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:50:13 2022] GET /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:50:14.754120 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dc3ec615-7ad7-4a6f-abdc-af610c66481b tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:50:14.754756 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-dc3ec615-7ad7-4a6f-abdc-af610c66481b tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [instance: fcf10137-3a7d-4815-9fde-2ad127d4fc59] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:50:14.761165 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dc3ec615-7ad7-4a6f-abdc-af610c66481b tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:14.761660 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dc3ec615-7ad7-4a6f-abdc-af610c66481b tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:14.762109 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dc3ec615-7ad7-4a6f-abdc-af610c66481b tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:14.762807 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dc3ec615-7ad7-4a6f-abdc-af610c66481b tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:14.763296 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dc3ec615-7ad7-4a6f-abdc-af610c66481b tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:14.763742 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dc3ec615-7ad7-4a6f-abdc-af610c66481b tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:14.892950 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-dc3ec615-7ad7-4a6f-abdc-af610c66481b tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cb3fde20d74b0a9127c3a062d89714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419520115d134a2e8bc0695fd87b6e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:50:14.901425 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-dc3ec615-7ad7-4a6f-abdc-af610c66481b tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] 10.222.0.23 "GET /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59" status: 200 len: 1317 microversion: 2.1 time: 0.151316 Sep 10 12:50:14.902007 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3625/7244] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:50:14 2022] GET /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:50:15.924916 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8e7192f7-e8c5-42ca-bc1e-8e8e568af705 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:50:15.925542 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8e7192f7-e8c5-42ca-bc1e-8e8e568af705 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [instance: fcf10137-3a7d-4815-9fde-2ad127d4fc59] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:50:15.932387 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e7192f7-e8c5-42ca-bc1e-8e8e568af705 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:15.932874 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e7192f7-e8c5-42ca-bc1e-8e8e568af705 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:15.933313 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e7192f7-e8c5-42ca-bc1e-8e8e568af705 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:15.934020 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e7192f7-e8c5-42ca-bc1e-8e8e568af705 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:15.934482 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e7192f7-e8c5-42ca-bc1e-8e8e568af705 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:15.934916 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8e7192f7-e8c5-42ca-bc1e-8e8e568af705 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:16.068039 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8e7192f7-e8c5-42ca-bc1e-8e8e568af705 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cb3fde20d74b0a9127c3a062d89714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419520115d134a2e8bc0695fd87b6e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:50:16.075703 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8e7192f7-e8c5-42ca-bc1e-8e8e568af705 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] 10.222.0.23 "GET /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59" status: 200 len: 1317 microversion: 2.1 time: 0.155421 Sep 10 12:50:16.076282 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3620/7245] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:50:15 2022] GET /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:50:17.099469 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-78280886-3146-49b0-aa63-6b1ab0f08c80 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:50:17.100123 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-78280886-3146-49b0-aa63-6b1ab0f08c80 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [instance: fcf10137-3a7d-4815-9fde-2ad127d4fc59] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:50:17.106989 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-78280886-3146-49b0-aa63-6b1ab0f08c80 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:17.107511 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-78280886-3146-49b0-aa63-6b1ab0f08c80 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:17.108695 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-78280886-3146-49b0-aa63-6b1ab0f08c80 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:17.109612 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-78280886-3146-49b0-aa63-6b1ab0f08c80 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:17.110087 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-78280886-3146-49b0-aa63-6b1ab0f08c80 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:17.110563 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-78280886-3146-49b0-aa63-6b1ab0f08c80 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:17.248344 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-78280886-3146-49b0-aa63-6b1ab0f08c80 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cb3fde20d74b0a9127c3a062d89714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419520115d134a2e8bc0695fd87b6e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:50:17.256016 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-78280886-3146-49b0-aa63-6b1ab0f08c80 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] 10.222.0.23 "GET /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59" status: 200 len: 1317 microversion: 2.1 time: 0.160396 Sep 10 12:50:17.256792 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3626/7246] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:50:17 2022] GET /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:50:17.332087 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-2d10b437-5b68-42b9-99a7-6b43b186fe6e req-8bc07ce3-1d51-4bb3-8654-5d26e5161f20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcf10137-3a7d-4815-9fde-2ad127d4fc59", "name": "network-vif-plugged", "status": "completed", "tag": "7c461eef-470d-4aa8-bd3f-dbd0d430bb72"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:50:17.344971 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-2d10b437-5b68-42b9-99a7-6b43b186fe6e req-8bc07ce3-1d51-4bb3-8654-5d26e5161f20 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:17.345458 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-2d10b437-5b68-42b9-99a7-6b43b186fe6e req-8bc07ce3-1d51-4bb3-8654-5d26e5161f20 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:17.345897 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-2d10b437-5b68-42b9-99a7-6b43b186fe6e req-8bc07ce3-1d51-4bb3-8654-5d26e5161f20 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:17.356969 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-2d10b437-5b68-42b9-99a7-6b43b186fe6e req-8bc07ce3-1d51-4bb3-8654-5d26e5161f20 service nova] Creating event network-vif-plugged:7c461eef-470d-4aa8-bd3f-dbd0d430bb72 for instance fcf10137-3a7d-4815-9fde-2ad127d4fc59 on n-h1-856895-1 Sep 10 12:50:17.362870 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-2d10b437-5b68-42b9-99a7-6b43b186fe6e req-8bc07ce3-1d51-4bb3-8654-5d26e5161f20 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035013 Sep 10 12:50:17.363711 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3621/7247] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:50:18.278989 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5aa0d66a-c43f-4210-a4a0-c9e74b8ce93d tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:50:18.279676 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5aa0d66a-c43f-4210-a4a0-c9e74b8ce93d tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [instance: fcf10137-3a7d-4815-9fde-2ad127d4fc59] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:50:18.286633 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5aa0d66a-c43f-4210-a4a0-c9e74b8ce93d tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:18.287129 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5aa0d66a-c43f-4210-a4a0-c9e74b8ce93d tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:18.287614 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5aa0d66a-c43f-4210-a4a0-c9e74b8ce93d tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:18.288319 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5aa0d66a-c43f-4210-a4a0-c9e74b8ce93d tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:18.288793 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5aa0d66a-c43f-4210-a4a0-c9e74b8ce93d tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:18.289231 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5aa0d66a-c43f-4210-a4a0-c9e74b8ce93d tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:18.426083 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5aa0d66a-c43f-4210-a4a0-c9e74b8ce93d tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cb3fde20d74b0a9127c3a062d89714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419520115d134a2e8bc0695fd87b6e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:50:18.433844 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5aa0d66a-c43f-4210-a4a0-c9e74b8ce93d tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] 10.222.0.23 "GET /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59" status: 200 len: 1317 microversion: 2.1 time: 0.158795 Sep 10 12:50:18.434416 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3627/7248] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:50:18 2022] GET /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:50:19.459435 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5dfade27-6926-43f3-abbe-56abe5f03770 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:50:19.460143 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5dfade27-6926-43f3-abbe-56abe5f03770 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [instance: fcf10137-3a7d-4815-9fde-2ad127d4fc59] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:50:19.462090 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:50:19.462938 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:50:19.469168 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5dfade27-6926-43f3-abbe-56abe5f03770 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:19.469656 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5dfade27-6926-43f3-abbe-56abe5f03770 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:19.470099 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5dfade27-6926-43f3-abbe-56abe5f03770 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:19.470793 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5dfade27-6926-43f3-abbe-56abe5f03770 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:19.471281 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5dfade27-6926-43f3-abbe-56abe5f03770 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:19.471714 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5dfade27-6926-43f3-abbe-56abe5f03770 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:19.601117 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5dfade27-6926-43f3-abbe-56abe5f03770 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cb3fde20d74b0a9127c3a062d89714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419520115d134a2e8bc0695fd87b6e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:50:19.608972 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5dfade27-6926-43f3-abbe-56abe5f03770 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] 10.222.0.23 "GET /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59" status: 200 len: 1505 microversion: 2.1 time: 0.154124 Sep 10 12:50:19.609560 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3622/7249] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:50:19 2022] GET /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:50:19.673233 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ad34d2dc-f74e-4cdc-8192-831a33e14a1a tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1247724261", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "03e39d9a-b02e-4871-b48d-5df3c693b6c9"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:50:19.682430 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:50:19.728686 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-ad34d2dc-f74e-4cdc-8192-831a33e14a1a tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] validate_networks() for [('03e39d9a-b02e-4871-b48d-5df3c693b6c9', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:50:20.146553 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-ad34d2dc-f74e-4cdc-8192-831a33e14a1a tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:50:20.147032 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-ad34d2dc-f74e-4cdc-8192-831a33e14a1a tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:50:20.147580 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-ad34d2dc-f74e-4cdc-8192-831a33e14a1a tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:50:20.148016 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-ad34d2dc-f74e-4cdc-8192-831a33e14a1a tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:50:20.148455 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-ad34d2dc-f74e-4cdc-8192-831a33e14a1a tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:50:20.158238 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad34d2dc-f74e-4cdc-8192-831a33e14a1a tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:20.158742 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad34d2dc-f74e-4cdc-8192-831a33e14a1a tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:20.159235 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad34d2dc-f74e-4cdc-8192-831a33e14a1a tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:20.159992 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad34d2dc-f74e-4cdc-8192-831a33e14a1a tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:20.160468 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad34d2dc-f74e-4cdc-8192-831a33e14a1a tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:20.160915 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad34d2dc-f74e-4cdc-8192-831a33e14a1a tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:20.178366 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-ad34d2dc-f74e-4cdc-8192-831a33e14a1a tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Getting quotas for project 419520115d134a2e8bc0695fd87b6e13. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:50:20.184152 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-ad34d2dc-f74e-4cdc-8192-831a33e14a1a tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Getting quotas for user 08cb3fde20d74b0a9127c3a062d89714 and project 419520115d134a2e8bc0695fd87b6e13. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:50:20.196964 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ad34d2dc-f74e-4cdc-8192-831a33e14a1a tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:50:20.199326 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ad34d2dc-f74e-4cdc-8192-831a33e14a1a tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [instance: c5843401-3df6-4da5-a7c3-2e0f2a42e515] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:50:20.247145 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ad34d2dc-f74e-4cdc-8192-831a33e14a1a tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.577798 Sep 10 12:50:20.247840 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3628/7250] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:50:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:50:20.259110 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3b7637c0-abdf-4bfe-9058-928868fe28ac tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:50:20.259764 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3b7637c0-abdf-4bfe-9058-928868fe28ac tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [instance: c5843401-3df6-4da5-a7c3-2e0f2a42e515] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:50:20.317251 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3b7637c0-abdf-4bfe-9058-928868fe28ac tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cb3fde20d74b0a9127c3a062d89714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419520115d134a2e8bc0695fd87b6e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:50:20.324237 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3b7637c0-abdf-4bfe-9058-928868fe28ac tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] 10.222.0.23 "GET /compute/v2.1/servers/c5843401-3df6-4da5-a7c3-2e0f2a42e515" status: 200 len: 1217 microversion: 2.1 time: 0.069034 Sep 10 12:50:20.324814 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3623/7251] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:50:20 2022] GET /compute/v2.1/servers/c5843401-3df6-4da5-a7c3-2e0f2a42e515 => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:50:21.348255 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f38056df-00ef-4f66-b6aa-85a3bf1ad072 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:50:21.348891 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f38056df-00ef-4f66-b6aa-85a3bf1ad072 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [instance: c5843401-3df6-4da5-a7c3-2e0f2a42e515] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:50:21.357282 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f38056df-00ef-4f66-b6aa-85a3bf1ad072 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:21.358317 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f38056df-00ef-4f66-b6aa-85a3bf1ad072 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:21.359555 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f38056df-00ef-4f66-b6aa-85a3bf1ad072 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:21.360693 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f38056df-00ef-4f66-b6aa-85a3bf1ad072 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:21.361177 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f38056df-00ef-4f66-b6aa-85a3bf1ad072 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:21.361650 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f38056df-00ef-4f66-b6aa-85a3bf1ad072 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:21.427784 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f38056df-00ef-4f66-b6aa-85a3bf1ad072 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cb3fde20d74b0a9127c3a062d89714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419520115d134a2e8bc0695fd87b6e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:50:21.436733 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f38056df-00ef-4f66-b6aa-85a3bf1ad072 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] 10.222.0.23 "GET /compute/v2.1/servers/c5843401-3df6-4da5-a7c3-2e0f2a42e515" status: 200 len: 1275 microversion: 2.1 time: 0.091748 Sep 10 12:50:21.451208 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3629/7252] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:50:21 2022] GET /compute/v2.1/servers/c5843401-3df6-4da5-a7c3-2e0f2a42e515 => generated 1275 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:50:22.462155 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-008b9874-936b-40fa-90e1-49c3e9f83075 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:50:22.463098 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-008b9874-936b-40fa-90e1-49c3e9f83075 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [instance: c5843401-3df6-4da5-a7c3-2e0f2a42e515] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:50:22.473001 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-008b9874-936b-40fa-90e1-49c3e9f83075 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:22.473533 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-008b9874-936b-40fa-90e1-49c3e9f83075 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:22.473975 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-008b9874-936b-40fa-90e1-49c3e9f83075 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:22.474685 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-008b9874-936b-40fa-90e1-49c3e9f83075 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:22.475153 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-008b9874-936b-40fa-90e1-49c3e9f83075 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:22.475614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-008b9874-936b-40fa-90e1-49c3e9f83075 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:22.622229 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-008b9874-936b-40fa-90e1-49c3e9f83075 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cb3fde20d74b0a9127c3a062d89714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419520115d134a2e8bc0695fd87b6e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:50:22.630525 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-008b9874-936b-40fa-90e1-49c3e9f83075 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] 10.222.0.23 "GET /compute/v2.1/servers/c5843401-3df6-4da5-a7c3-2e0f2a42e515" status: 200 len: 1317 microversion: 2.1 time: 0.172667 Sep 10 12:50:22.631123 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3624/7253] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:50:22 2022] GET /compute/v2.1/servers/c5843401-3df6-4da5-a7c3-2e0f2a42e515 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:50:22.679549 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-10e171b9-552d-4789-8df6-c6ab90e63ae0 req-8e114d86-d9d9-435d-9385-810802d663db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5843401-3df6-4da5-a7c3-2e0f2a42e515", "tag": "d5c66d11-3618-4d68-a67d-32c3ca16e77a"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:50:22.691383 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-10e171b9-552d-4789-8df6-c6ab90e63ae0 req-8e114d86-d9d9-435d-9385-810802d663db service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:22.691884 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-10e171b9-552d-4789-8df6-c6ab90e63ae0 req-8e114d86-d9d9-435d-9385-810802d663db service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:22.692509 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-10e171b9-552d-4789-8df6-c6ab90e63ae0 req-8e114d86-d9d9-435d-9385-810802d663db service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:22.713628 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-10e171b9-552d-4789-8df6-c6ab90e63ae0 req-8e114d86-d9d9-435d-9385-810802d663db service nova] Creating event network-changed:d5c66d11-3618-4d68-a67d-32c3ca16e77a for instance c5843401-3df6-4da5-a7c3-2e0f2a42e515 on n-h2-856895-1 Sep 10 12:50:22.719231 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-10e171b9-552d-4789-8df6-c6ab90e63ae0 req-8e114d86-d9d9-435d-9385-810802d663db service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043446 Sep 10 12:50:22.720145 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3630/7254] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:50:23.655910 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-01749638-cb9d-4f8f-83f1-0939bab80208 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:50:23.656531 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-01749638-cb9d-4f8f-83f1-0939bab80208 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [instance: c5843401-3df6-4da5-a7c3-2e0f2a42e515] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:50:23.663388 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-01749638-cb9d-4f8f-83f1-0939bab80208 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:23.663869 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-01749638-cb9d-4f8f-83f1-0939bab80208 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:23.664308 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-01749638-cb9d-4f8f-83f1-0939bab80208 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:23.665105 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-01749638-cb9d-4f8f-83f1-0939bab80208 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:23.665561 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-01749638-cb9d-4f8f-83f1-0939bab80208 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:23.665986 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-01749638-cb9d-4f8f-83f1-0939bab80208 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:23.800004 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-01749638-cb9d-4f8f-83f1-0939bab80208 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cb3fde20d74b0a9127c3a062d89714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419520115d134a2e8bc0695fd87b6e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:50:23.807816 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-01749638-cb9d-4f8f-83f1-0939bab80208 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] 10.222.0.23 "GET /compute/v2.1/servers/c5843401-3df6-4da5-a7c3-2e0f2a42e515" status: 200 len: 1317 microversion: 2.1 time: 0.155912 Sep 10 12:50:23.808402 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3625/7255] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:50:23 2022] GET /compute/v2.1/servers/c5843401-3df6-4da5-a7c3-2e0f2a42e515 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:50:24.833221 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-67c4fa7f-7d6c-4067-a64b-68481b1056aa tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:50:24.833941 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-67c4fa7f-7d6c-4067-a64b-68481b1056aa tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [instance: c5843401-3df6-4da5-a7c3-2e0f2a42e515] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:50:24.840142 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67c4fa7f-7d6c-4067-a64b-68481b1056aa tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:24.840711 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67c4fa7f-7d6c-4067-a64b-68481b1056aa tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:24.841161 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67c4fa7f-7d6c-4067-a64b-68481b1056aa tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:24.841859 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67c4fa7f-7d6c-4067-a64b-68481b1056aa tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:24.842355 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67c4fa7f-7d6c-4067-a64b-68481b1056aa tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:24.842882 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67c4fa7f-7d6c-4067-a64b-68481b1056aa tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:24.981672 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-67c4fa7f-7d6c-4067-a64b-68481b1056aa tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cb3fde20d74b0a9127c3a062d89714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419520115d134a2e8bc0695fd87b6e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:50:24.989910 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-67c4fa7f-7d6c-4067-a64b-68481b1056aa tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] 10.222.0.23 "GET /compute/v2.1/servers/c5843401-3df6-4da5-a7c3-2e0f2a42e515" status: 200 len: 1317 microversion: 2.1 time: 0.161823 Sep 10 12:50:24.990491 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3631/7256] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:50:24 2022] GET /compute/v2.1/servers/c5843401-3df6-4da5-a7c3-2e0f2a42e515 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:50:26.013635 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0c29efbf-c5a0-4c96-b45e-f65d3f021d41 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:50:26.014710 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0c29efbf-c5a0-4c96-b45e-f65d3f021d41 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [instance: c5843401-3df6-4da5-a7c3-2e0f2a42e515] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:50:26.021530 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c29efbf-c5a0-4c96-b45e-f65d3f021d41 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:26.022021 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c29efbf-c5a0-4c96-b45e-f65d3f021d41 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:26.022469 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c29efbf-c5a0-4c96-b45e-f65d3f021d41 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:26.023186 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c29efbf-c5a0-4c96-b45e-f65d3f021d41 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:26.023657 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c29efbf-c5a0-4c96-b45e-f65d3f021d41 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:26.024087 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0c29efbf-c5a0-4c96-b45e-f65d3f021d41 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:26.156043 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0c29efbf-c5a0-4c96-b45e-f65d3f021d41 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cb3fde20d74b0a9127c3a062d89714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419520115d134a2e8bc0695fd87b6e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:50:26.163695 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0c29efbf-c5a0-4c96-b45e-f65d3f021d41 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] 10.222.0.23 "GET /compute/v2.1/servers/c5843401-3df6-4da5-a7c3-2e0f2a42e515" status: 200 len: 1317 microversion: 2.1 time: 0.154089 Sep 10 12:50:26.164266 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3626/7257] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:50:26 2022] GET /compute/v2.1/servers/c5843401-3df6-4da5-a7c3-2e0f2a42e515 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:50:27.186303 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0fd4d0bf-da01-4483-8c1a-8c063106b329 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:50:27.186936 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0fd4d0bf-da01-4483-8c1a-8c063106b329 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [instance: c5843401-3df6-4da5-a7c3-2e0f2a42e515] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:50:27.193809 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0fd4d0bf-da01-4483-8c1a-8c063106b329 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:27.194297 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0fd4d0bf-da01-4483-8c1a-8c063106b329 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:27.194742 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0fd4d0bf-da01-4483-8c1a-8c063106b329 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:27.195467 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0fd4d0bf-da01-4483-8c1a-8c063106b329 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:27.195931 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0fd4d0bf-da01-4483-8c1a-8c063106b329 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:27.196366 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0fd4d0bf-da01-4483-8c1a-8c063106b329 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:27.340110 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0fd4d0bf-da01-4483-8c1a-8c063106b329 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cb3fde20d74b0a9127c3a062d89714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419520115d134a2e8bc0695fd87b6e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:50:27.348551 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0fd4d0bf-da01-4483-8c1a-8c063106b329 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] 10.222.0.23 "GET /compute/v2.1/servers/c5843401-3df6-4da5-a7c3-2e0f2a42e515" status: 200 len: 1317 microversion: 2.1 time: 0.166132 Sep 10 12:50:27.349126 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3632/7258] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:50:27 2022] GET /compute/v2.1/servers/c5843401-3df6-4da5-a7c3-2e0f2a42e515 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:50:27.597104 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-8e2f2f85-343d-4ac3-8b24-1050e9b9aa5a req-a6a90b27-e8ff-4eb0-9973-7dc0d89617b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5843401-3df6-4da5-a7c3-2e0f2a42e515", "name": "network-vif-plugged", "status": "completed", "tag": "d5c66d11-3618-4d68-a67d-32c3ca16e77a"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:50:27.607551 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8e2f2f85-343d-4ac3-8b24-1050e9b9aa5a req-a6a90b27-e8ff-4eb0-9973-7dc0d89617b5 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:27.608868 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8e2f2f85-343d-4ac3-8b24-1050e9b9aa5a req-a6a90b27-e8ff-4eb0-9973-7dc0d89617b5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:27.609390 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8e2f2f85-343d-4ac3-8b24-1050e9b9aa5a req-a6a90b27-e8ff-4eb0-9973-7dc0d89617b5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:27.621143 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-8e2f2f85-343d-4ac3-8b24-1050e9b9aa5a req-a6a90b27-e8ff-4eb0-9973-7dc0d89617b5 service nova] Creating event network-vif-plugged:d5c66d11-3618-4d68-a67d-32c3ca16e77a for instance c5843401-3df6-4da5-a7c3-2e0f2a42e515 on n-h2-856895-1 Sep 10 12:50:27.626104 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-8e2f2f85-343d-4ac3-8b24-1050e9b9aa5a req-a6a90b27-e8ff-4eb0-9973-7dc0d89617b5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032817 Sep 10 12:50:27.626715 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3627/7259] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:50:28.371386 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-41bf38d5-1f1a-44dc-b12d-94bb759461ad tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:50:28.372025 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-41bf38d5-1f1a-44dc-b12d-94bb759461ad tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [instance: c5843401-3df6-4da5-a7c3-2e0f2a42e515] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:50:28.379657 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41bf38d5-1f1a-44dc-b12d-94bb759461ad tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:28.380165 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41bf38d5-1f1a-44dc-b12d-94bb759461ad tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:28.380623 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41bf38d5-1f1a-44dc-b12d-94bb759461ad tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:28.381331 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41bf38d5-1f1a-44dc-b12d-94bb759461ad tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:28.381806 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41bf38d5-1f1a-44dc-b12d-94bb759461ad tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:28.382250 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41bf38d5-1f1a-44dc-b12d-94bb759461ad tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:28.521852 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-41bf38d5-1f1a-44dc-b12d-94bb759461ad tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cb3fde20d74b0a9127c3a062d89714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419520115d134a2e8bc0695fd87b6e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:50:28.529658 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-41bf38d5-1f1a-44dc-b12d-94bb759461ad tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] 10.222.0.23 "GET /compute/v2.1/servers/c5843401-3df6-4da5-a7c3-2e0f2a42e515" status: 200 len: 1317 microversion: 2.1 time: 0.162573 Sep 10 12:50:28.530241 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3633/7260] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:50:28 2022] GET /compute/v2.1/servers/c5843401-3df6-4da5-a7c3-2e0f2a42e515 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:50:29.553794 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ec052931-593e-4c86-9c93-4453b3a58d25 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:50:29.554491 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ec052931-593e-4c86-9c93-4453b3a58d25 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [instance: c5843401-3df6-4da5-a7c3-2e0f2a42e515] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:50:29.561033 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec052931-593e-4c86-9c93-4453b3a58d25 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:29.561523 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec052931-593e-4c86-9c93-4453b3a58d25 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:29.561961 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec052931-593e-4c86-9c93-4453b3a58d25 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:29.562686 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec052931-593e-4c86-9c93-4453b3a58d25 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:29.563204 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec052931-593e-4c86-9c93-4453b3a58d25 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:29.563642 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec052931-593e-4c86-9c93-4453b3a58d25 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:29.698785 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ec052931-593e-4c86-9c93-4453b3a58d25 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cb3fde20d74b0a9127c3a062d89714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419520115d134a2e8bc0695fd87b6e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:50:29.707772 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ec052931-593e-4c86-9c93-4453b3a58d25 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] 10.222.0.23 "GET /compute/v2.1/servers/c5843401-3df6-4da5-a7c3-2e0f2a42e515" status: 200 len: 1505 microversion: 2.1 time: 0.159076 Sep 10 12:50:29.708353 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3628/7261] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:50:29 2022] GET /compute/v2.1/servers/c5843401-3df6-4da5-a7c3-2e0f2a42e515 => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:50:29.731641 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e185d545-9a36-4411-a84e-dd911c520f0f tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:50:29.732183 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e185d545-9a36-4411-a84e-dd911c520f0f tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [instance: c5843401-3df6-4da5-a7c3-2e0f2a42e515] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:50:29.739348 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e185d545-9a36-4411-a84e-dd911c520f0f tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:29.739846 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e185d545-9a36-4411-a84e-dd911c520f0f tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:29.740299 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e185d545-9a36-4411-a84e-dd911c520f0f tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:29.741004 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e185d545-9a36-4411-a84e-dd911c520f0f tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:29.741477 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e185d545-9a36-4411-a84e-dd911c520f0f tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:29.741916 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e185d545-9a36-4411-a84e-dd911c520f0f tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:29.770754 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e185d545-9a36-4411-a84e-dd911c520f0f tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [instance: c5843401-3df6-4da5-a7c3-2e0f2a42e515] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:50:29.844515 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e185d545-9a36-4411-a84e-dd911c520f0f tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c5843401-3df6-4da5-a7c3-2e0f2a42e515" status: 204 len: 0 microversion: 2.1 time: 0.116427 Sep 10 12:50:29.845043 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3634/7262] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:50:29 2022] DELETE /compute/v2.1/servers/c5843401-3df6-4da5-a7c3-2e0f2a42e515 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:50:29.853602 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-99f0127b-20ad-45d3-aa1d-0062da6714db tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:50:29.854222 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-99f0127b-20ad-45d3-aa1d-0062da6714db tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [instance: c5843401-3df6-4da5-a7c3-2e0f2a42e515] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:50:29.860252 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99f0127b-20ad-45d3-aa1d-0062da6714db tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:29.860737 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99f0127b-20ad-45d3-aa1d-0062da6714db tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:29.861180 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99f0127b-20ad-45d3-aa1d-0062da6714db tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:29.861867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99f0127b-20ad-45d3-aa1d-0062da6714db tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:29.862326 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99f0127b-20ad-45d3-aa1d-0062da6714db tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:29.862854 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99f0127b-20ad-45d3-aa1d-0062da6714db tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:29.999743 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-99f0127b-20ad-45d3-aa1d-0062da6714db tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cb3fde20d74b0a9127c3a062d89714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419520115d134a2e8bc0695fd87b6e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:50:30.007464 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-99f0127b-20ad-45d3-aa1d-0062da6714db tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] 10.222.0.23 "GET /compute/v2.1/servers/c5843401-3df6-4da5-a7c3-2e0f2a42e515" status: 200 len: 1511 microversion: 2.1 time: 0.157811 Sep 10 12:50:30.008047 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3629/7263] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:50:29 2022] GET /compute/v2.1/servers/c5843401-3df6-4da5-a7c3-2e0f2a42e515 => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:50:31.031832 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9d061e49-223f-4b77-aae6-73d29de587e1 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:50:31.032559 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9d061e49-223f-4b77-aae6-73d29de587e1 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [instance: c5843401-3df6-4da5-a7c3-2e0f2a42e515] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:50:31.034568 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:50:31.035313 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:50:31.042474 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d061e49-223f-4b77-aae6-73d29de587e1 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:31.042977 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d061e49-223f-4b77-aae6-73d29de587e1 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:31.043454 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d061e49-223f-4b77-aae6-73d29de587e1 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:31.044167 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d061e49-223f-4b77-aae6-73d29de587e1 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:31.044642 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d061e49-223f-4b77-aae6-73d29de587e1 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:31.045093 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d061e49-223f-4b77-aae6-73d29de587e1 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:31.183729 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9d061e49-223f-4b77-aae6-73d29de587e1 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cb3fde20d74b0a9127c3a062d89714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419520115d134a2e8bc0695fd87b6e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:50:31.192431 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9d061e49-223f-4b77-aae6-73d29de587e1 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] 10.222.0.23 "GET /compute/v2.1/servers/c5843401-3df6-4da5-a7c3-2e0f2a42e515" status: 200 len: 1511 microversion: 2.1 time: 0.164971 Sep 10 12:50:31.193021 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3635/7264] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:50:31 2022] GET /compute/v2.1/servers/c5843401-3df6-4da5-a7c3-2e0f2a42e515 => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:50:31.565068 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-72b06a16-bd17-4555-b2cb-8942777611c4 req-a8710b43-cb0e-43a6-88b2-8911479837e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5843401-3df6-4da5-a7c3-2e0f2a42e515", "name": "network-vif-deleted", "tag": "d5c66d11-3618-4d68-a67d-32c3ca16e77a"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:50:31.575204 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:50:31.579554 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-72b06a16-bd17-4555-b2cb-8942777611c4 req-a8710b43-cb0e-43a6-88b2-8911479837e2 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:31.580517 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-72b06a16-bd17-4555-b2cb-8942777611c4 req-a8710b43-cb0e-43a6-88b2-8911479837e2 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:31.580964 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-72b06a16-bd17-4555-b2cb-8942777611c4 req-a8710b43-cb0e-43a6-88b2-8911479837e2 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:31.595153 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-72b06a16-bd17-4555-b2cb-8942777611c4 req-a8710b43-cb0e-43a6-88b2-8911479837e2 service nova] Creating event network-vif-deleted:d5c66d11-3618-4d68-a67d-32c3ca16e77a for instance c5843401-3df6-4da5-a7c3-2e0f2a42e515 on n-h2-856895-1 Sep 10 12:50:31.600681 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-72b06a16-bd17-4555-b2cb-8942777611c4 req-a8710b43-cb0e-43a6-88b2-8911479837e2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040556 Sep 10 12:50:31.601310 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3630/7265] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:50:32.216003 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2e2cbade-dac2-4b4c-b113-7e3e48de36db tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:50:32.216552 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2e2cbade-dac2-4b4c-b113-7e3e48de36db tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [instance: c5843401-3df6-4da5-a7c3-2e0f2a42e515] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:50:32.223938 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e2cbade-dac2-4b4c-b113-7e3e48de36db tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:32.224437 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e2cbade-dac2-4b4c-b113-7e3e48de36db tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:32.224889 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e2cbade-dac2-4b4c-b113-7e3e48de36db tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:32.225594 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e2cbade-dac2-4b4c-b113-7e3e48de36db tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:32.226063 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e2cbade-dac2-4b4c-b113-7e3e48de36db tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:32.226504 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e2cbade-dac2-4b4c-b113-7e3e48de36db tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:32.240356 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-2e2cbade-dac2-4b4c-b113-7e3e48de36db tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] HTTP exception thrown: Instance c5843401-3df6-4da5-a7c3-2e0f2a42e515 could not be found. Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2e2cbade-dac2-4b4c-b113-7e3e48de36db tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Request method failure captured: Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/c5843401-3df6-4da5-a7c3-2e0f2a42e515 HTTP/1.1 Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHIf-oh5Py1dVOfjCuAY14rprNHJ9xwyr_uLe-CQ8uCB_Xn1qMbluvFZQuvpTdBVw7zAg71o2q5ZwT0emaFYPADmhYipVHdYpwmTwJeo7MDpKqKaEFjMfCoeEPPhucslupkFK4LSX719SzlqGAN7GILVSaKVbeSOdt76jgEoyskfPl-c Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 419520115d134a2e8bc0695fd87b6e13 Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersNegativeTestJSON-1309076862 Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/419520115d134a2e8bc0695fd87b6e13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/419520115d134a2e8bc0695fd87b6e13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_419520115d134a2e8bc0695fd87b6e13", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/419520115d134a2e8bc0695fd87b6e13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersNegativeTestJSON-1309076862 Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 419520115d134a2e8bc0695fd87b6e13 Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1309076862 Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersNegativeTestJSON-1309076862-project Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 08cb3fde20d74b0a9127c3a062d89714 Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersNegativeTestJSON-1309076862-project Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance c5843401-3df6-4da5-a7c3-2e0f2a42e515 could not be found. Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'c5843401-3df6-4da5-a7c3-2e0f2a42e515'} Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5843401-3df6-4da5-a7c3-2e0f2a42e515 could not be found. Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5843401-3df6-4da5-a7c3-2e0f2a42e515 could not be found. Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:50:32.242004 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:50:32.247055 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:50:32.247055 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:50:32.247055 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:50:32.247055 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:50:32.247055 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:50:32.247055 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5843401-3df6-4da5-a7c3-2e0f2a42e515 could not be found. Sep 10 12:50:32.247055 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:50:32.247055 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2e2cbade-dac2-4b4c-b113-7e3e48de36db tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Returning 404 to user: Instance c5843401-3df6-4da5-a7c3-2e0f2a42e515 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:50:32.247055 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2e2cbade-dac2-4b4c-b113-7e3e48de36db tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] 10.222.0.23 "GET /compute/v2.1/servers/c5843401-3df6-4da5-a7c3-2e0f2a42e515" status: 404 len: 111 microversion: 2.1 time: 0.031511 Sep 10 12:50:32.247055 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3636/7266] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:50:32 2022] GET /compute/v2.1/servers/c5843401-3df6-4da5-a7c3-2e0f2a42e515 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:50:32.253498 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-de72d6bc-5704-4262-9aca-aa60cacee19a tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:50:32.254318 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-de72d6bc-5704-4262-9aca-aa60cacee19a tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [instance: fcf10137-3a7d-4815-9fde-2ad127d4fc59] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:50:32.260520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-de72d6bc-5704-4262-9aca-aa60cacee19a tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:32.261003 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-de72d6bc-5704-4262-9aca-aa60cacee19a tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:32.261446 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-de72d6bc-5704-4262-9aca-aa60cacee19a tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:32.262136 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-de72d6bc-5704-4262-9aca-aa60cacee19a tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:32.262594 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-de72d6bc-5704-4262-9aca-aa60cacee19a tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:32.263052 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-de72d6bc-5704-4262-9aca-aa60cacee19a tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:32.392952 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-de72d6bc-5704-4262-9aca-aa60cacee19a tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cb3fde20d74b0a9127c3a062d89714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419520115d134a2e8bc0695fd87b6e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:50:32.400772 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-de72d6bc-5704-4262-9aca-aa60cacee19a tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] 10.222.0.23 "GET /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59" status: 200 len: 1505 microversion: 2.1 time: 0.151577 Sep 10 12:50:32.401360 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3631/7267] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:50:32 2022] GET /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:50:32.424486 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2ed78f2d-815e-47fd-b54a-9782b27bccff tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:50:32.426934 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2ed78f2d-815e-47fd-b54a-9782b27bccff tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [instance: a51ca2a4-8f98-4c6e-a194-1c8b68b0fd68] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:50:32.432483 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-2ed78f2d-815e-47fd-b54a-9782b27bccff tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] HTTP exception thrown: Instance a51ca2a4-8f98-4c6e-a194-1c8b68b0fd68 could not be found. Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2ed78f2d-815e-47fd-b54a-9782b27bccff tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Request method failure captured: Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/servers/a51ca2a4-8f98-4c6e-a194-1c8b68b0fd68/action HTTP/1.1 Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 32 Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHIf-oh5Py1dVOfjCuAY14rprNHJ9xwyr_uLe-CQ8uCB_Xn1qMbluvFZQuvpTdBVw7zAg71o2q5ZwT0emaFYPADmhYipVHdYpwmTwJeo7MDpKqKaEFjMfCoeEPPhucslupkFK4LSX719SzlqGAN7GILVSaKVbeSOdt76jgEoyskfPl-c Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 419520115d134a2e8bc0695fd87b6e13 Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersNegativeTestJSON-1309076862 Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/419520115d134a2e8bc0695fd87b6e13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/419520115d134a2e8bc0695fd87b6e13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_419520115d134a2e8bc0695fd87b6e13", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/419520115d134a2e8bc0695fd87b6e13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersNegativeTestJSON-1309076862 Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 419520115d134a2e8bc0695fd87b6e13 Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1309076862 Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersNegativeTestJSON-1309076862-project Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 08cb3fde20d74b0a9127c3a062d89714 Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersNegativeTestJSON-1309076862-project Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: {"resize": {"flavorRef": "452"}} Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance a51ca2a4-8f98-4c6e-a194-1c8b68b0fd68 could not be found. Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'a51ca2a4-8f98-4c6e-a194-1c8b68b0fd68', 'body': {'resize': {'flavorRef': '452'}}} Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a51ca2a4-8f98-4c6e-a194-1c8b68b0fd68 could not be found. Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:50:32.434027 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:50:32.438926 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a51ca2a4-8f98-4c6e-a194-1c8b68b0fd68 could not be found. Sep 10 12:50:32.438926 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:50:32.438926 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:50:32.438926 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:50:32.438926 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:50:32.438926 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:50:32.438926 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:50:32.438926 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:50:32.438926 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:50:32.438926 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a51ca2a4-8f98-4c6e-a194-1c8b68b0fd68 could not be found. Sep 10 12:50:32.438926 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:50:32.438926 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2ed78f2d-815e-47fd-b54a-9782b27bccff tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Returning 404 to user: Instance a51ca2a4-8f98-4c6e-a194-1c8b68b0fd68 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:50:32.438926 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2ed78f2d-815e-47fd-b54a-9782b27bccff tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] 10.222.0.23 "POST /compute/v2.1/servers/a51ca2a4-8f98-4c6e-a194-1c8b68b0fd68/action" status: 404 len: 111 microversion: 2.1 time: 0.015447 Sep 10 12:50:32.438926 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3637/7268] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:50:32 2022] POST /compute/v2.1/servers/a51ca2a4-8f98-4c6e-a194-1c8b68b0fd68/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:50:32.444305 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-67b2c0f1-4507-4bd8-a177-7993f08a26fe tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:50:32.444957 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-67b2c0f1-4507-4bd8-a177-7993f08a26fe tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [instance: fcf10137-3a7d-4815-9fde-2ad127d4fc59] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:50:32.450894 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-67b2c0f1-4507-4bd8-a177-7993f08a26fe tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:32.451419 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-67b2c0f1-4507-4bd8-a177-7993f08a26fe tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:32.451865 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-67b2c0f1-4507-4bd8-a177-7993f08a26fe tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:32.452555 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-67b2c0f1-4507-4bd8-a177-7993f08a26fe tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:32.453519 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-67b2c0f1-4507-4bd8-a177-7993f08a26fe tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:32.454161 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-67b2c0f1-4507-4bd8-a177-7993f08a26fe tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:32.583285 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-67b2c0f1-4507-4bd8-a177-7993f08a26fe tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cb3fde20d74b0a9127c3a062d89714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419520115d134a2e8bc0695fd87b6e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:50:32.591075 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-67b2c0f1-4507-4bd8-a177-7993f08a26fe tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] 10.222.0.23 "GET /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59" status: 200 len: 1505 microversion: 2.1 time: 0.150690 Sep 10 12:50:32.591687 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3632/7269] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:50:32 2022] GET /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:50:32.614861 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9ca59395-349b-4629-b882-469c56f37ee7 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:50:32.615792 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9ca59395-349b-4629-b882-469c56f37ee7 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [instance: fcf10137-3a7d-4815-9fde-2ad127d4fc59] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:50:32.623697 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ca59395-349b-4629-b882-469c56f37ee7 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:32.624215 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ca59395-349b-4629-b882-469c56f37ee7 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:32.624738 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ca59395-349b-4629-b882-469c56f37ee7 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:32.625642 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ca59395-349b-4629-b882-469c56f37ee7 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:32.626197 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ca59395-349b-4629-b882-469c56f37ee7 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:32.626688 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9ca59395-349b-4629-b882-469c56f37ee7 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:32.759781 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9ca59395-349b-4629-b882-469c56f37ee7 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cb3fde20d74b0a9127c3a062d89714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419520115d134a2e8bc0695fd87b6e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:50:32.768218 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9ca59395-349b-4629-b882-469c56f37ee7 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] 10.222.0.23 "GET /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59" status: 200 len: 1505 microversion: 2.1 time: 0.157248 Sep 10 12:50:32.768786 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3638/7270] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:50:32 2022] GET /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:50:32.791525 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bc28b17f-2e49-4635-bdb4-7d235ca0f257 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "d9ec09d1-3e99-47c7-91bd-8f303622f215"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:50:32.793722 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bc28b17f-2e49-4635-bdb4-7d235ca0f257 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [instance: fcf10137-3a7d-4815-9fde-2ad127d4fc59] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:50:32.799736 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bc28b17f-2e49-4635-bdb4-7d235ca0f257 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:32.800226 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bc28b17f-2e49-4635-bdb4-7d235ca0f257 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:32.800667 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bc28b17f-2e49-4635-bdb4-7d235ca0f257 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:32.801361 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bc28b17f-2e49-4635-bdb4-7d235ca0f257 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:32.801824 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bc28b17f-2e49-4635-bdb4-7d235ca0f257 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:32.802259 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bc28b17f-2e49-4635-bdb4-7d235ca0f257 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:32.842402 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bc28b17f-2e49-4635-bdb4-7d235ca0f257 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '08cb3fde20d74b0a9127c3a062d89714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419520115d134a2e8bc0695fd87b6e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:50:32.847547 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-bc28b17f-2e49-4635-bdb4-7d235ca0f257 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] HTTP exception thrown: Flavor d9ec09d1-3e99-47c7-91bd-8f303622f215 could not be found. Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bc28b17f-2e49-4635-bdb4-7d235ca0f257 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Request method failure captured: Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: request: POST /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59/action HTTP/1.1 Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 65 Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHIf-oh5Py1dVOfjCuAY14rprNHJ9xwyr_uLe-CQ8uCB_Xn1qMbluvFZQuvpTdBVw7zAg71o2q5ZwT0emaFYPADmhYipVHdYpwmTwJeo7MDpKqKaEFjMfCoeEPPhucslupkFK4LSX719SzlqGAN7GILVSaKVbeSOdt76jgEoyskfPl-c Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 419520115d134a2e8bc0695fd87b6e13 Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersNegativeTestJSON-1309076862 Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/419520115d134a2e8bc0695fd87b6e13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/419520115d134a2e8bc0695fd87b6e13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_419520115d134a2e8bc0695fd87b6e13", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/419520115d134a2e8bc0695fd87b6e13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersNegativeTestJSON-1309076862 Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 419520115d134a2e8bc0695fd87b6e13 Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1309076862 Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersNegativeTestJSON-1309076862-project Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 08cb3fde20d74b0a9127c3a062d89714 Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersNegativeTestJSON-1309076862-project Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: {"resize": {"flavorRef": "d9ec09d1-3e99-47c7-91bd-8f303622f215"}} Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: exception: Flavor d9ec09d1-3e99-47c7-91bd-8f303622f215 could not be found. Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'fcf10137-3a7d-4815-9fde-2ad127d4fc59', 'body': {'resize': {'flavorRef': 'd9ec09d1-3e99-47c7-91bd-8f303622f215'}}} Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:50:32.849842 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 10 12:50:32.853615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 10 12:50:32.853615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor d9ec09d1-3e99-47c7-91bd-8f303622f215 could not be found. Sep 10 12:50:32.853615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:50:32.853615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:50:32.853615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:50:32.853615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:50:32.853615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:50:32.853615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:50:32.853615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:50:32.853615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:50:32.853615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:50:32.853615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:50:32.853615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 10 12:50:32.853615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 10 12:50:32.853615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 10 12:50:32.853615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 10 12:50:32.853615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Sep 10 12:50:32.853615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 10 12:50:32.853615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor d9ec09d1-3e99-47c7-91bd-8f303622f215 could not be found. Sep 10 12:50:32.853615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:50:32.853615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:50:32.853615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:50:32.853615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:50:32.853615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:50:32.853615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:50:32.853615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:50:32.853615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:50:32.853615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor d9ec09d1-3e99-47c7-91bd-8f303622f215 could not be found. Sep 10 12:50:32.853615 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:50:32.853615 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bc28b17f-2e49-4635-bdb4-7d235ca0f257 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Returning 400 to user: Flavor d9ec09d1-3e99-47c7-91bd-8f303622f215 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:50:32.853615 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bc28b17f-2e49-4635-bdb4-7d235ca0f257 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] 10.222.0.23 "POST /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59/action" status: 400 len: 107 microversion: 2.1 time: 0.064587 Sep 10 12:50:32.853615 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3633/7271] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:50:32 2022] POST /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59/action => generated 107 bytes in 66 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 12:50:32.860302 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f15b1ed7-1359-42d8-bdce-3f6057254066 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:50:32.860938 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f15b1ed7-1359-42d8-bdce-3f6057254066 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [instance: fcf10137-3a7d-4815-9fde-2ad127d4fc59] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:50:32.866908 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f15b1ed7-1359-42d8-bdce-3f6057254066 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:32.867454 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f15b1ed7-1359-42d8-bdce-3f6057254066 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:32.867909 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f15b1ed7-1359-42d8-bdce-3f6057254066 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:32.868619 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f15b1ed7-1359-42d8-bdce-3f6057254066 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:32.869090 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f15b1ed7-1359-42d8-bdce-3f6057254066 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:32.869535 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f15b1ed7-1359-42d8-bdce-3f6057254066 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:32.999072 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f15b1ed7-1359-42d8-bdce-3f6057254066 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cb3fde20d74b0a9127c3a062d89714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419520115d134a2e8bc0695fd87b6e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:50:33.007843 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f15b1ed7-1359-42d8-bdce-3f6057254066 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] 10.222.0.23 "GET /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59" status: 200 len: 1505 microversion: 2.1 time: 0.151117 Sep 10 12:50:33.008426 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3639/7272] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:50:32 2022] GET /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:50:33.032879 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6326cadc-0173-419c-a2df-3bb87e0b45e3 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:50:33.033497 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6326cadc-0173-419c-a2df-3bb87e0b45e3 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [instance: fcf10137-3a7d-4815-9fde-2ad127d4fc59] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:50:33.039907 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6326cadc-0173-419c-a2df-3bb87e0b45e3 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:33.040389 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6326cadc-0173-419c-a2df-3bb87e0b45e3 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:33.040826 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6326cadc-0173-419c-a2df-3bb87e0b45e3 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:33.041581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6326cadc-0173-419c-a2df-3bb87e0b45e3 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:33.041993 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6326cadc-0173-419c-a2df-3bb87e0b45e3 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:33.042448 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6326cadc-0173-419c-a2df-3bb87e0b45e3 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:33.179533 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6326cadc-0173-419c-a2df-3bb87e0b45e3 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cb3fde20d74b0a9127c3a062d89714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419520115d134a2e8bc0695fd87b6e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:50:33.187976 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6326cadc-0173-419c-a2df-3bb87e0b45e3 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] 10.222.0.23 "GET /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59" status: 200 len: 1505 microversion: 2.1 time: 0.158880 Sep 10 12:50:33.188544 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3634/7273] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:50:33 2022] GET /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59 => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:50:33.211513 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-81ceb8b5-6d89-4f09-8b29-13b7ef7b6edf tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-81ceb8b5-6d89-4f09-8b29-13b7ef7b6edf tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Request method failure captured: Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: request: POST /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59/action HTTP/1.1 Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 29 Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHIf-oh5Py1dVOfjCuAY14rprNHJ9xwyr_uLe-CQ8uCB_Xn1qMbluvFZQuvpTdBVw7zAg71o2q5ZwT0emaFYPADmhYipVHdYpwmTwJeo7MDpKqKaEFjMfCoeEPPhucslupkFK4LSX719SzlqGAN7GILVSaKVbeSOdt76jgEoyskfPl-c Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 419520115d134a2e8bc0695fd87b6e13 Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersNegativeTestJSON-1309076862 Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/419520115d134a2e8bc0695fd87b6e13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/419520115d134a2e8bc0695fd87b6e13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_419520115d134a2e8bc0695fd87b6e13", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/419520115d134a2e8bc0695fd87b6e13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersNegativeTestJSON-1309076862 Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 419520115d134a2e8bc0695fd87b6e13 Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1309076862 Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersNegativeTestJSON-1309076862-project Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 08cb3fde20d74b0a9127c3a062d89714 Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersNegativeTestJSON-1309076862-project Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: {"resize": {"flavorRef": ""}} Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'fcf10137-3a7d-4815-9fde-2ad127d4fc59', 'body': {'resize': {'flavorRef': ''}}} Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise error Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi On instance['resize']: Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi '' Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:50:33.215087 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:50:33.219971 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:50:33.219971 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:50:33.219971 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:50:33.219971 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:50:33.219971 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 10 12:50:33.219971 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 10 12:50:33.219971 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 10 12:50:33.219971 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:50:33.219971 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-81ceb8b5-6d89-4f09-8b29-13b7ef7b6edf tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:50:33.219971 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-81ceb8b5-6d89-4f09-8b29-13b7ef7b6edf tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] 10.222.0.23 "POST /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59/action" status: 400 len: 113 microversion: 2.1 time: 0.010043 Sep 10 12:50:33.219971 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3640/7274] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:50:33 2022] POST /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 10 12:50:33.225089 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7fb8648e-07dc-410e-813f-fe3184d5ffdc tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:50:33.225716 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7fb8648e-07dc-410e-813f-fe3184d5ffdc tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [instance: fcf10137-3a7d-4815-9fde-2ad127d4fc59] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:50:33.231718 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7fb8648e-07dc-410e-813f-fe3184d5ffdc tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:33.232207 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7fb8648e-07dc-410e-813f-fe3184d5ffdc tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:33.232651 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7fb8648e-07dc-410e-813f-fe3184d5ffdc tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:33.233348 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7fb8648e-07dc-410e-813f-fe3184d5ffdc tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:33.233809 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7fb8648e-07dc-410e-813f-fe3184d5ffdc tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:33.234801 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7fb8648e-07dc-410e-813f-fe3184d5ffdc tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:33.363121 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7fb8648e-07dc-410e-813f-fe3184d5ffdc tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cb3fde20d74b0a9127c3a062d89714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419520115d134a2e8bc0695fd87b6e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:50:33.371051 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7fb8648e-07dc-410e-813f-fe3184d5ffdc tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] 10.222.0.23 "GET /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59" status: 200 len: 1505 microversion: 2.1 time: 0.149537 Sep 10 12:50:33.371656 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3635/7275] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:50:33 2022] GET /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59 => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:50:33.398868 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ead0243c-3e36-4e7b-a102-9fece64ce841 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:50:33.399399 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ead0243c-3e36-4e7b-a102-9fece64ce841 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [instance: c5843401-3df6-4da5-a7c3-2e0f2a42e515] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:50:33.406800 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ead0243c-3e36-4e7b-a102-9fece64ce841 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:33.407326 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ead0243c-3e36-4e7b-a102-9fece64ce841 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:33.407777 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ead0243c-3e36-4e7b-a102-9fece64ce841 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:33.408481 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ead0243c-3e36-4e7b-a102-9fece64ce841 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:33.408944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ead0243c-3e36-4e7b-a102-9fece64ce841 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:33.409382 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ead0243c-3e36-4e7b-a102-9fece64ce841 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:33.423151 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-ead0243c-3e36-4e7b-a102-9fece64ce841 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] HTTP exception thrown: Instance c5843401-3df6-4da5-a7c3-2e0f2a42e515 could not be found. Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ead0243c-3e36-4e7b-a102-9fece64ce841 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Request method failure captured: Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/servers/c5843401-3df6-4da5-a7c3-2e0f2a42e515 HTTP/1.1 Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHIf-oh5Py1dVOfjCuAY14rprNHJ9xwyr_uLe-CQ8uCB_Xn1qMbluvFZQuvpTdBVw7zAg71o2q5ZwT0emaFYPADmhYipVHdYpwmTwJeo7MDpKqKaEFjMfCoeEPPhucslupkFK4LSX719SzlqGAN7GILVSaKVbeSOdt76jgEoyskfPl-c Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 419520115d134a2e8bc0695fd87b6e13 Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-ServersNegativeTestJSON-1309076862 Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/419520115d134a2e8bc0695fd87b6e13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/419520115d134a2e8bc0695fd87b6e13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_419520115d134a2e8bc0695fd87b6e13", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/419520115d134a2e8bc0695fd87b6e13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-ServersNegativeTestJSON-1309076862 Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 419520115d134a2e8bc0695fd87b6e13 Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1309076862 Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-ServersNegativeTestJSON-1309076862-project Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 08cb3fde20d74b0a9127c3a062d89714 Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-ServersNegativeTestJSON-1309076862-project Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance c5843401-3df6-4da5-a7c3-2e0f2a42e515 could not be found. Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'c5843401-3df6-4da5-a7c3-2e0f2a42e515'} Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5843401-3df6-4da5-a7c3-2e0f2a42e515 could not be found. Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:50:33.424737 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:50:33.429039 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5843401-3df6-4da5-a7c3-2e0f2a42e515 could not be found. Sep 10 12:50:33.429039 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:50:33.429039 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:50:33.429039 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:50:33.429039 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:50:33.429039 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:50:33.429039 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:50:33.429039 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:50:33.429039 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:50:33.429039 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5843401-3df6-4da5-a7c3-2e0f2a42e515 could not be found. Sep 10 12:50:33.429039 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:50:33.429039 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ead0243c-3e36-4e7b-a102-9fece64ce841 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Returning 404 to user: Instance c5843401-3df6-4da5-a7c3-2e0f2a42e515 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:50:33.429039 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ead0243c-3e36-4e7b-a102-9fece64ce841 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c5843401-3df6-4da5-a7c3-2e0f2a42e515" status: 404 len: 111 microversion: 2.1 time: 0.032070 Sep 10 12:50:33.429039 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3641/7276] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:50:33 2022] DELETE /compute/v2.1/servers/c5843401-3df6-4da5-a7c3-2e0f2a42e515 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:50:33.435308 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e6eee68f-b910-41fe-957a-f7f7b5304cee tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:50:33.435922 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e6eee68f-b910-41fe-957a-f7f7b5304cee tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [instance: c5843401-3df6-4da5-a7c3-2e0f2a42e515] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:50:33.443140 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e6eee68f-b910-41fe-957a-f7f7b5304cee tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:33.443654 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e6eee68f-b910-41fe-957a-f7f7b5304cee tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:33.444086 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e6eee68f-b910-41fe-957a-f7f7b5304cee tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:33.444773 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e6eee68f-b910-41fe-957a-f7f7b5304cee tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:33.445226 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e6eee68f-b910-41fe-957a-f7f7b5304cee tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:33.445651 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e6eee68f-b910-41fe-957a-f7f7b5304cee tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:33.459570 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-e6eee68f-b910-41fe-957a-f7f7b5304cee tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] HTTP exception thrown: Instance c5843401-3df6-4da5-a7c3-2e0f2a42e515 could not be found. Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e6eee68f-b910-41fe-957a-f7f7b5304cee tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Request method failure captured: Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/c5843401-3df6-4da5-a7c3-2e0f2a42e515 HTTP/1.1 Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHIf-oh5Py1dVOfjCuAY14rprNHJ9xwyr_uLe-CQ8uCB_Xn1qMbluvFZQuvpTdBVw7zAg71o2q5ZwT0emaFYPADmhYipVHdYpwmTwJeo7MDpKqKaEFjMfCoeEPPhucslupkFK4LSX719SzlqGAN7GILVSaKVbeSOdt76jgEoyskfPl-c Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 419520115d134a2e8bc0695fd87b6e13 Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersNegativeTestJSON-1309076862 Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/419520115d134a2e8bc0695fd87b6e13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/419520115d134a2e8bc0695fd87b6e13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_419520115d134a2e8bc0695fd87b6e13", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/419520115d134a2e8bc0695fd87b6e13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersNegativeTestJSON-1309076862 Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 419520115d134a2e8bc0695fd87b6e13 Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1309076862 Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersNegativeTestJSON-1309076862-project Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 08cb3fde20d74b0a9127c3a062d89714 Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersNegativeTestJSON-1309076862-project Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance c5843401-3df6-4da5-a7c3-2e0f2a42e515 could not be found. Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'c5843401-3df6-4da5-a7c3-2e0f2a42e515'} Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5843401-3df6-4da5-a7c3-2e0f2a42e515 could not be found. Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5843401-3df6-4da5-a7c3-2e0f2a42e515 could not be found. Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:50:33.461092 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:50:33.465998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:50:33.465998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:50:33.465998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:50:33.465998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:50:33.465998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:50:33.465998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5843401-3df6-4da5-a7c3-2e0f2a42e515 could not be found. Sep 10 12:50:33.465998 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:50:33.465998 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e6eee68f-b910-41fe-957a-f7f7b5304cee tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Returning 404 to user: Instance c5843401-3df6-4da5-a7c3-2e0f2a42e515 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:50:33.465998 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e6eee68f-b910-41fe-957a-f7f7b5304cee tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] 10.222.0.23 "GET /compute/v2.1/servers/c5843401-3df6-4da5-a7c3-2e0f2a42e515" status: 404 len: 111 microversion: 2.1 time: 0.031060 Sep 10 12:50:33.465998 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3636/7277] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:50:33 2022] GET /compute/v2.1/servers/c5843401-3df6-4da5-a7c3-2e0f2a42e515 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:50:33.471743 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-200eed85-88fb-427d-b8eb-68b4847f68a9 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:50:33.472264 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-200eed85-88fb-427d-b8eb-68b4847f68a9 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [instance: fcf10137-3a7d-4815-9fde-2ad127d4fc59] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:50:33.478161 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-200eed85-88fb-427d-b8eb-68b4847f68a9 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:33.478660 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-200eed85-88fb-427d-b8eb-68b4847f68a9 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:33.479133 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-200eed85-88fb-427d-b8eb-68b4847f68a9 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:33.479860 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-200eed85-88fb-427d-b8eb-68b4847f68a9 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:33.480330 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-200eed85-88fb-427d-b8eb-68b4847f68a9 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:33.480772 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-200eed85-88fb-427d-b8eb-68b4847f68a9 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:33.499157 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:50:33.510391 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-200eed85-88fb-427d-b8eb-68b4847f68a9 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [instance: fcf10137-3a7d-4815-9fde-2ad127d4fc59] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:50:33.590154 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-200eed85-88fb-427d-b8eb-68b4847f68a9 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59" status: 204 len: 0 microversion: 2.1 time: 0.121300 Sep 10 12:50:33.590370 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3642/7278] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:50:33 2022] DELETE /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:50:33.598907 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-77ff388a-b05d-44d0-bb09-531656ab5246 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:50:33.599640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-77ff388a-b05d-44d0-bb09-531656ab5246 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [instance: fcf10137-3a7d-4815-9fde-2ad127d4fc59] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:50:33.606518 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-77ff388a-b05d-44d0-bb09-531656ab5246 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:33.607003 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-77ff388a-b05d-44d0-bb09-531656ab5246 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:33.607481 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-77ff388a-b05d-44d0-bb09-531656ab5246 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:33.608182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-77ff388a-b05d-44d0-bb09-531656ab5246 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:33.608644 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-77ff388a-b05d-44d0-bb09-531656ab5246 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:33.609696 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-77ff388a-b05d-44d0-bb09-531656ab5246 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:33.740873 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-77ff388a-b05d-44d0-bb09-531656ab5246 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cb3fde20d74b0a9127c3a062d89714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419520115d134a2e8bc0695fd87b6e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:50:33.744457 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=100 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:50:33.749902 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-77ff388a-b05d-44d0-bb09-531656ab5246 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] 10.222.0.23 "GET /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59" status: 200 len: 1511 microversion: 2.1 time: 0.154757 Sep 10 12:50:33.750476 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3637/7279] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:50:33 2022] GET /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:50:34.774296 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1522ea39-730c-47c4-a2c1-75a0fa3d7bec tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:50:34.775063 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1522ea39-730c-47c4-a2c1-75a0fa3d7bec tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [instance: fcf10137-3a7d-4815-9fde-2ad127d4fc59] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:50:34.782838 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1522ea39-730c-47c4-a2c1-75a0fa3d7bec tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:34.783396 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1522ea39-730c-47c4-a2c1-75a0fa3d7bec tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:34.783861 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1522ea39-730c-47c4-a2c1-75a0fa3d7bec tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:34.784600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1522ea39-730c-47c4-a2c1-75a0fa3d7bec tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:34.785081 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1522ea39-730c-47c4-a2c1-75a0fa3d7bec tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:34.785717 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1522ea39-730c-47c4-a2c1-75a0fa3d7bec tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:34.925880 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1522ea39-730c-47c4-a2c1-75a0fa3d7bec tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cb3fde20d74b0a9127c3a062d89714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419520115d134a2e8bc0695fd87b6e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:50:34.933786 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1522ea39-730c-47c4-a2c1-75a0fa3d7bec tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] 10.222.0.23 "GET /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59" status: 200 len: 1511 microversion: 2.1 time: 0.164001 Sep 10 12:50:34.934367 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3643/7280] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:50:34 2022] GET /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59 => generated 1511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:50:35.831762 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-b52f9e77-657d-4b53-bf41-1861782323c5 req-6b1079be-d62b-4f9d-92a3-656bd828e038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcf10137-3a7d-4815-9fde-2ad127d4fc59", "name": "network-vif-deleted", "tag": "7c461eef-470d-4aa8-bd3f-dbd0d430bb72"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:50:35.845617 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-b52f9e77-657d-4b53-bf41-1861782323c5 req-6b1079be-d62b-4f9d-92a3-656bd828e038 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:35.846100 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-b52f9e77-657d-4b53-bf41-1861782323c5 req-6b1079be-d62b-4f9d-92a3-656bd828e038 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:35.846539 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-b52f9e77-657d-4b53-bf41-1861782323c5 req-6b1079be-d62b-4f9d-92a3-656bd828e038 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:35.859562 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-b52f9e77-657d-4b53-bf41-1861782323c5 req-6b1079be-d62b-4f9d-92a3-656bd828e038 service nova] Creating event network-vif-deleted:7c461eef-470d-4aa8-bd3f-dbd0d430bb72 for instance fcf10137-3a7d-4815-9fde-2ad127d4fc59 on n-h1-856895-1 Sep 10 12:50:35.865452 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-b52f9e77-657d-4b53-bf41-1861782323c5 req-6b1079be-d62b-4f9d-92a3-656bd828e038 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038306 Sep 10 12:50:35.866062 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3638/7281] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:50:35.958877 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-db4eeac4-2513-449f-9649-d5505dd21559 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:50:35.959700 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-db4eeac4-2513-449f-9649-d5505dd21559 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [instance: fcf10137-3a7d-4815-9fde-2ad127d4fc59] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:50:35.967086 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-db4eeac4-2513-449f-9649-d5505dd21559 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:35.967762 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-db4eeac4-2513-449f-9649-d5505dd21559 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:35.968323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-db4eeac4-2513-449f-9649-d5505dd21559 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:35.969143 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-db4eeac4-2513-449f-9649-d5505dd21559 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:35.969694 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-db4eeac4-2513-449f-9649-d5505dd21559 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:35.970327 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-db4eeac4-2513-449f-9649-d5505dd21559 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:36.007005 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-db4eeac4-2513-449f-9649-d5505dd21559 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:36.007548 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-db4eeac4-2513-449f-9649-d5505dd21559 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:36.008007 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-db4eeac4-2513-449f-9649-d5505dd21559 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:36.008486 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-db4eeac4-2513-449f-9649-d5505dd21559 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lazy-loading 'fault' on Instance uuid fcf10137-3a7d-4815-9fde-2ad127d4fc59 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:50:36.054599 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-db4eeac4-2513-449f-9649-d5505dd21559 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08cb3fde20d74b0a9127c3a062d89714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419520115d134a2e8bc0695fd87b6e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:50:36.063445 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-db4eeac4-2513-449f-9649-d5505dd21559 tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] 10.222.0.23 "GET /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59" status: 200 len: 1307 microversion: 2.1 time: 0.108465 Sep 10 12:50:36.064022 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3644/7282] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:50:35 2022] GET /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59 => generated 1307 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:50:37.088569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a4c78668-d22d-46f8-a212-698d6850d6be tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:50:37.089286 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a4c78668-d22d-46f8-a212-698d6850d6be tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] [instance: fcf10137-3a7d-4815-9fde-2ad127d4fc59] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:50:37.091330 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:50:37.098398 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a4c78668-d22d-46f8-a212-698d6850d6be tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:37.098891 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a4c78668-d22d-46f8-a212-698d6850d6be tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:37.099366 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a4c78668-d22d-46f8-a212-698d6850d6be tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:37.100072 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a4c78668-d22d-46f8-a212-698d6850d6be tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:50:37.100533 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a4c78668-d22d-46f8-a212-698d6850d6be tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:50:37.100969 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a4c78668-d22d-46f8-a212-698d6850d6be tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:50:37.115327 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-a4c78668-d22d-46f8-a212-698d6850d6be tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] HTTP exception thrown: Instance fcf10137-3a7d-4815-9fde-2ad127d4fc59 could not be found. Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a4c78668-d22d-46f8-a212-698d6850d6be tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Request method failure captured: Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59 HTTP/1.1 Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHIf-oh5Py1dVOfjCuAY14rprNHJ9xwyr_uLe-CQ8uCB_Xn1qMbluvFZQuvpTdBVw7zAg71o2q5ZwT0emaFYPADmhYipVHdYpwmTwJeo7MDpKqKaEFjMfCoeEPPhucslupkFK4LSX719SzlqGAN7GILVSaKVbeSOdt76jgEoyskfPl-c Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 419520115d134a2e8bc0695fd87b6e13 Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-ServersNegativeTestJSON-1309076862 Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/419520115d134a2e8bc0695fd87b6e13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/419520115d134a2e8bc0695fd87b6e13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_419520115d134a2e8bc0695fd87b6e13", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/419520115d134a2e8bc0695fd87b6e13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-ServersNegativeTestJSON-1309076862 Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 419520115d134a2e8bc0695fd87b6e13 Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1309076862 Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-ServersNegativeTestJSON-1309076862-project Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 08cb3fde20d74b0a9127c3a062d89714 Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-ServersNegativeTestJSON-1309076862-project Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance fcf10137-3a7d-4815-9fde-2ad127d4fc59 could not be found. Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'fcf10137-3a7d-4815-9fde-2ad127d4fc59'} Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcf10137-3a7d-4815-9fde-2ad127d4fc59 could not be found. Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcf10137-3a7d-4815-9fde-2ad127d4fc59 could not be found. Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:50:37.117002 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:50:37.121654 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:50:37.121654 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:50:37.121654 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:50:37.121654 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:50:37.121654 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:50:37.121654 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcf10137-3a7d-4815-9fde-2ad127d4fc59 could not be found. Sep 10 12:50:37.121654 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:50:37.121654 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a4c78668-d22d-46f8-a212-698d6850d6be tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] Returning 404 to user: Instance fcf10137-3a7d-4815-9fde-2ad127d4fc59 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:50:37.121654 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a4c78668-d22d-46f8-a212-698d6850d6be tempest-ServersNegativeTestJSON-1309076862 tempest-ServersNegativeTestJSON-1309076862-project] 10.222.0.23 "GET /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59" status: 404 len: 111 microversion: 2.1 time: 0.035037 Sep 10 12:50:37.121654 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3639/7283] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:50:37 2022] GET /compute/v2.1/servers/fcf10137-3a7d-4815-9fde-2ad127d4fc59 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:51:08.088379 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:51:08.090175 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:51:08.301159 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-35c05b2f-41ae-4b6d-bfc5-05cbda608604 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Action: 'create', calling method: .version_select at 0x7f4072183a60>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1131947986", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKA05E58GcfZDDWOBd5MQEu8XlvN9heA7lMl4YlhXXolE3r8bVr+qu4cx2TCbCEj8zrrxPqpravcObcdhhLxiwSTKhQx/NMaYJAy5EW/CI6Qe87MlvFx18ywkz+MjtR82w=="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:51:08.320268 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-35c05b2f-41ae-4b6d-bfc5-05cbda608604 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Getting quotas for project debdc9ab2fa940aebf524f6dd64f1e4a. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:51:08.325449 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-35c05b2f-41ae-4b6d-bfc5-05cbda608604 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Getting quotas for user 87d192ed06fc4bc996702c2b97ae9002 and project debdc9ab2fa940aebf524f6dd64f1e4a. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:51:08.352240 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-35c05b2f-41ae-4b6d-bfc5-05cbda608604 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.269116 Sep 10 12:51:08.352891 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3645/7284] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 12:51:08 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:51:08.406771 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-10608044-9d54-41c0-a212-1f0b01541502 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1170521459", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1131947986", "networks": [{"uuid": "a94f5c34-7c6c-4591-8764-3abe39a847e3"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:51:08.433063 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:51:08.433063 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=4 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:51:08.493221 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-10608044-9d54-41c0-a212-1f0b01541502 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] validate_networks() for [('a94f5c34-7c6c-4591-8764-3abe39a847e3', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:51:08.923010 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-10608044-9d54-41c0-a212-1f0b01541502 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:51:08.923463 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-10608044-9d54-41c0-a212-1f0b01541502 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:51:08.923939 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-10608044-9d54-41c0-a212-1f0b01541502 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:51:08.924350 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-10608044-9d54-41c0-a212-1f0b01541502 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:51:08.924762 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-10608044-9d54-41c0-a212-1f0b01541502 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:51:08.933478 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-10608044-9d54-41c0-a212-1f0b01541502 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:08.933957 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-10608044-9d54-41c0-a212-1f0b01541502 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:08.934395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-10608044-9d54-41c0-a212-1f0b01541502 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:08.935115 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-10608044-9d54-41c0-a212-1f0b01541502 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:08.935600 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-10608044-9d54-41c0-a212-1f0b01541502 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:08.936571 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-10608044-9d54-41c0-a212-1f0b01541502 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:08.954124 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-10608044-9d54-41c0-a212-1f0b01541502 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Getting quotas for project debdc9ab2fa940aebf524f6dd64f1e4a. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:51:08.959249 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-10608044-9d54-41c0-a212-1f0b01541502 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Getting quotas for user 87d192ed06fc4bc996702c2b97ae9002 and project debdc9ab2fa940aebf524f6dd64f1e4a. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:51:08.971461 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-10608044-9d54-41c0-a212-1f0b01541502 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:51:08.973757 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-10608044-9d54-41c0-a212-1f0b01541502 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 7ad8b068-76f1-468f-8b3e-692a2bfa38c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:51:09.022886 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-10608044-9d54-41c0-a212-1f0b01541502 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.620204 Sep 10 12:51:09.023576 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3640/7285] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:51:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:51:09.034520 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b51dd76f-0db8-4456-842e-32845728b625 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:51:09.035180 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b51dd76f-0db8-4456-842e-32845728b625 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 7ad8b068-76f1-468f-8b3e-692a2bfa38c4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:51:09.098829 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b51dd76f-0db8-4456-842e-32845728b625 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d192ed06fc4bc996702c2b97ae9002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdc9ab2fa940aebf524f6dd64f1e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:51:09.106834 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b51dd76f-0db8-4456-842e-32845728b625 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4" status: 200 len: 1263 microversion: 2.1 time: 0.076114 Sep 10 12:51:09.107507 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3646/7286] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:51:09 2022] GET /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4 => generated 1263 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:51:10.132482 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e1cfee29-3193-4d88-b3cb-7e45f1b529ed tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:51:10.133808 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e1cfee29-3193-4d88-b3cb-7e45f1b529ed tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 7ad8b068-76f1-468f-8b3e-692a2bfa38c4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:51:10.142955 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e1cfee29-3193-4d88-b3cb-7e45f1b529ed tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:10.143759 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e1cfee29-3193-4d88-b3cb-7e45f1b529ed tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:10.144416 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e1cfee29-3193-4d88-b3cb-7e45f1b529ed tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:10.145337 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e1cfee29-3193-4d88-b3cb-7e45f1b529ed tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:10.146004 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e1cfee29-3193-4d88-b3cb-7e45f1b529ed tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:10.146659 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e1cfee29-3193-4d88-b3cb-7e45f1b529ed tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:10.234677 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e1cfee29-3193-4d88-b3cb-7e45f1b529ed tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d192ed06fc4bc996702c2b97ae9002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdc9ab2fa940aebf524f6dd64f1e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:51:10.243489 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e1cfee29-3193-4d88-b3cb-7e45f1b529ed tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4" status: 200 len: 1323 microversion: 2.1 time: 0.114812 Sep 10 12:51:10.244735 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3641/7287] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:51:10 2022] GET /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4 => generated 1323 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:51:11.268815 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a9d9f67a-0e6e-4565-a430-978308c2beda tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:51:11.270663 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a9d9f67a-0e6e-4565-a430-978308c2beda tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 7ad8b068-76f1-468f-8b3e-692a2bfa38c4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:51:11.279357 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9d9f67a-0e6e-4565-a430-978308c2beda tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:11.280438 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9d9f67a-0e6e-4565-a430-978308c2beda tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:11.280905 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9d9f67a-0e6e-4565-a430-978308c2beda tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:11.281793 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9d9f67a-0e6e-4565-a430-978308c2beda tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:11.282282 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9d9f67a-0e6e-4565-a430-978308c2beda tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:11.282876 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a9d9f67a-0e6e-4565-a430-978308c2beda tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:11.510437 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a9d9f67a-0e6e-4565-a430-978308c2beda tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d192ed06fc4bc996702c2b97ae9002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdc9ab2fa940aebf524f6dd64f1e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:51:11.520137 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a9d9f67a-0e6e-4565-a430-978308c2beda tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4" status: 200 len: 1363 microversion: 2.1 time: 0.255467 Sep 10 12:51:11.521476 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3647/7288] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:51:11 2022] GET /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4 => generated 1363 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:51:11.650651 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-4378cc1c-cb0e-4f83-857e-457e56cb1f62 req-e0c1f77c-9893-4f52-b840-bc3df3c7d122 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ad8b068-76f1-468f-8b3e-692a2bfa38c4", "tag": "1b761f7f-cebc-4851-96b9-52eda924dbe1"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:51:11.675294 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-4378cc1c-cb0e-4f83-857e-457e56cb1f62 req-e0c1f77c-9893-4f52-b840-bc3df3c7d122 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:11.676169 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-4378cc1c-cb0e-4f83-857e-457e56cb1f62 req-e0c1f77c-9893-4f52-b840-bc3df3c7d122 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:11.679547 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-4378cc1c-cb0e-4f83-857e-457e56cb1f62 req-e0c1f77c-9893-4f52-b840-bc3df3c7d122 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:11.700666 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-4378cc1c-cb0e-4f83-857e-457e56cb1f62 req-e0c1f77c-9893-4f52-b840-bc3df3c7d122 service nova] Creating event network-changed:1b761f7f-cebc-4851-96b9-52eda924dbe1 for instance 7ad8b068-76f1-468f-8b3e-692a2bfa38c4 on n-h1-856895-1 Sep 10 12:51:11.707754 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-4378cc1c-cb0e-4f83-857e-457e56cb1f62 req-e0c1f77c-9893-4f52-b840-bc3df3c7d122 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060828 Sep 10 12:51:11.709216 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3642/7289] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:51:12.545201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7f77a06f-d407-447d-9b6a-183772a6e1dc tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:51:12.545837 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7f77a06f-d407-447d-9b6a-183772a6e1dc tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 7ad8b068-76f1-468f-8b3e-692a2bfa38c4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:51:12.553171 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f77a06f-d407-447d-9b6a-183772a6e1dc tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:12.553704 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f77a06f-d407-447d-9b6a-183772a6e1dc tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:12.554184 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f77a06f-d407-447d-9b6a-183772a6e1dc tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:12.554909 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f77a06f-d407-447d-9b6a-183772a6e1dc tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:12.555418 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f77a06f-d407-447d-9b6a-183772a6e1dc tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:12.555872 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f77a06f-d407-447d-9b6a-183772a6e1dc tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:12.700676 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7f77a06f-d407-447d-9b6a-183772a6e1dc tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d192ed06fc4bc996702c2b97ae9002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdc9ab2fa940aebf524f6dd64f1e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:51:12.709598 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7f77a06f-d407-447d-9b6a-183772a6e1dc tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4" status: 200 len: 1363 microversion: 2.1 time: 0.168312 Sep 10 12:51:12.710183 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3648/7290] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:51:12 2022] GET /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:51:13.734814 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7a13cdc9-0b50-4d63-ae39-e5cbea019f7f tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:51:13.735313 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7a13cdc9-0b50-4d63-ae39-e5cbea019f7f tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 7ad8b068-76f1-468f-8b3e-692a2bfa38c4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:51:13.742477 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7a13cdc9-0b50-4d63-ae39-e5cbea019f7f tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:13.742974 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7a13cdc9-0b50-4d63-ae39-e5cbea019f7f tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:13.743637 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7a13cdc9-0b50-4d63-ae39-e5cbea019f7f tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:13.744344 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7a13cdc9-0b50-4d63-ae39-e5cbea019f7f tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:13.744800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7a13cdc9-0b50-4d63-ae39-e5cbea019f7f tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:13.745231 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7a13cdc9-0b50-4d63-ae39-e5cbea019f7f tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:13.887120 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7a13cdc9-0b50-4d63-ae39-e5cbea019f7f tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d192ed06fc4bc996702c2b97ae9002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdc9ab2fa940aebf524f6dd64f1e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:51:13.897050 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7a13cdc9-0b50-4d63-ae39-e5cbea019f7f tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4" status: 200 len: 1363 microversion: 2.1 time: 0.167214 Sep 10 12:51:13.897749 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3643/7291] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:51:13 2022] GET /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:51:14.921751 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d4730fc8-6818-4bf1-84ed-e956226ba462 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:51:14.922385 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d4730fc8-6818-4bf1-84ed-e956226ba462 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 7ad8b068-76f1-468f-8b3e-692a2bfa38c4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:51:14.929167 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d4730fc8-6818-4bf1-84ed-e956226ba462 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:14.929666 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d4730fc8-6818-4bf1-84ed-e956226ba462 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:14.930120 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d4730fc8-6818-4bf1-84ed-e956226ba462 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:14.930822 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d4730fc8-6818-4bf1-84ed-e956226ba462 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:14.931319 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d4730fc8-6818-4bf1-84ed-e956226ba462 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:14.931765 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d4730fc8-6818-4bf1-84ed-e956226ba462 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:15.065456 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d4730fc8-6818-4bf1-84ed-e956226ba462 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d192ed06fc4bc996702c2b97ae9002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdc9ab2fa940aebf524f6dd64f1e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:51:15.073125 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d4730fc8-6818-4bf1-84ed-e956226ba462 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4" status: 200 len: 1363 microversion: 2.1 time: 0.155950 Sep 10 12:51:15.073697 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3649/7292] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:51:14 2022] GET /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:51:16.096194 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-48dd909a-e4ee-4f3d-881d-cf16d256d34e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:51:16.096838 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-48dd909a-e4ee-4f3d-881d-cf16d256d34e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 7ad8b068-76f1-468f-8b3e-692a2bfa38c4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:51:16.103669 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48dd909a-e4ee-4f3d-881d-cf16d256d34e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:16.104150 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48dd909a-e4ee-4f3d-881d-cf16d256d34e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:16.104586 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48dd909a-e4ee-4f3d-881d-cf16d256d34e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:16.105272 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48dd909a-e4ee-4f3d-881d-cf16d256d34e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:16.105720 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48dd909a-e4ee-4f3d-881d-cf16d256d34e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:16.106142 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48dd909a-e4ee-4f3d-881d-cf16d256d34e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:16.239994 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-48dd909a-e4ee-4f3d-881d-cf16d256d34e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d192ed06fc4bc996702c2b97ae9002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdc9ab2fa940aebf524f6dd64f1e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:51:16.247896 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-48dd909a-e4ee-4f3d-881d-cf16d256d34e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4" status: 200 len: 1363 microversion: 2.1 time: 0.155772 Sep 10 12:51:16.248467 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3644/7293] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:51:16 2022] GET /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:51:17.272058 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1f63d148-11ae-430b-85b0-9412b47c4981 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:51:17.272690 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1f63d148-11ae-430b-85b0-9412b47c4981 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 7ad8b068-76f1-468f-8b3e-692a2bfa38c4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:51:17.279552 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f63d148-11ae-430b-85b0-9412b47c4981 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:17.280051 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f63d148-11ae-430b-85b0-9412b47c4981 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:17.280507 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f63d148-11ae-430b-85b0-9412b47c4981 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:17.281203 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f63d148-11ae-430b-85b0-9412b47c4981 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:17.281669 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f63d148-11ae-430b-85b0-9412b47c4981 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:17.282109 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f63d148-11ae-430b-85b0-9412b47c4981 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:17.603990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-7c3a0d47-ccb9-44b0-a5b9-0a610d73ae3e req-e3b01c9c-f442-410c-bfb3-eacefcf28534 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ad8b068-76f1-468f-8b3e-692a2bfa38c4", "name": "network-vif-plugged", "status": "completed", "tag": "1b761f7f-cebc-4851-96b9-52eda924dbe1"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:51:17.617731 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-7c3a0d47-ccb9-44b0-a5b9-0a610d73ae3e req-e3b01c9c-f442-410c-bfb3-eacefcf28534 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:17.618242 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-7c3a0d47-ccb9-44b0-a5b9-0a610d73ae3e req-e3b01c9c-f442-410c-bfb3-eacefcf28534 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:17.618671 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-7c3a0d47-ccb9-44b0-a5b9-0a610d73ae3e req-e3b01c9c-f442-410c-bfb3-eacefcf28534 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:17.633144 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-7c3a0d47-ccb9-44b0-a5b9-0a610d73ae3e req-e3b01c9c-f442-410c-bfb3-eacefcf28534 service nova] Creating event network-vif-plugged:1b761f7f-cebc-4851-96b9-52eda924dbe1 for instance 7ad8b068-76f1-468f-8b3e-692a2bfa38c4 on n-h1-856895-1 Sep 10 12:51:17.638283 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-7c3a0d47-ccb9-44b0-a5b9-0a610d73ae3e req-e3b01c9c-f442-410c-bfb3-eacefcf28534 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038372 Sep 10 12:51:17.638939 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3645/7294] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:51:17.701489 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1f63d148-11ae-430b-85b0-9412b47c4981 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d192ed06fc4bc996702c2b97ae9002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdc9ab2fa940aebf524f6dd64f1e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:51:17.709844 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1f63d148-11ae-430b-85b0-9412b47c4981 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4" status: 200 len: 1363 microversion: 2.1 time: 0.441648 Sep 10 12:51:17.710442 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3650/7295] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:51:17 2022] GET /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4 => generated 1363 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:51:18.734369 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f95991b0-dc45-41bd-b398-809cb64518df tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:51:18.735073 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f95991b0-dc45-41bd-b398-809cb64518df tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 7ad8b068-76f1-468f-8b3e-692a2bfa38c4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:51:18.741264 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f95991b0-dc45-41bd-b398-809cb64518df tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:18.741741 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f95991b0-dc45-41bd-b398-809cb64518df tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:18.742176 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f95991b0-dc45-41bd-b398-809cb64518df tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:18.742863 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f95991b0-dc45-41bd-b398-809cb64518df tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:18.743349 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f95991b0-dc45-41bd-b398-809cb64518df tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:18.743784 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f95991b0-dc45-41bd-b398-809cb64518df tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:18.877925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f95991b0-dc45-41bd-b398-809cb64518df tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d192ed06fc4bc996702c2b97ae9002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdc9ab2fa940aebf524f6dd64f1e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:51:18.886016 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f95991b0-dc45-41bd-b398-809cb64518df tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4" status: 200 len: 1363 microversion: 2.1 time: 0.157471 Sep 10 12:51:18.886603 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3646/7296] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:51:18 2022] GET /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:51:19.911345 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-70f31be9-69a0-4185-beb2-2ccc31817a87 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:51:19.911900 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-70f31be9-69a0-4185-beb2-2ccc31817a87 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 7ad8b068-76f1-468f-8b3e-692a2bfa38c4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:51:19.914673 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:51:19.920076 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-70f31be9-69a0-4185-beb2-2ccc31817a87 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:19.920570 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-70f31be9-69a0-4185-beb2-2ccc31817a87 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:19.921352 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-70f31be9-69a0-4185-beb2-2ccc31817a87 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:19.922164 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-70f31be9-69a0-4185-beb2-2ccc31817a87 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:19.922635 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-70f31be9-69a0-4185-beb2-2ccc31817a87 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:19.923080 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-70f31be9-69a0-4185-beb2-2ccc31817a87 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:20.052151 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-70f31be9-69a0-4185-beb2-2ccc31817a87 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d192ed06fc4bc996702c2b97ae9002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdc9ab2fa940aebf524f6dd64f1e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:51:20.059870 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-70f31be9-69a0-4185-beb2-2ccc31817a87 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4" status: 200 len: 1555 microversion: 2.1 time: 0.152510 Sep 10 12:51:20.060437 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3651/7297] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:51:19 2022] GET /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:51:20.083371 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5afe582f-8232-49c9-9870-cb3da0fbf57e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:51:20.084472 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5afe582f-8232-49c9-9870-cb3da0fbf57e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 7ad8b068-76f1-468f-8b3e-692a2bfa38c4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:51:20.086281 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:51:20.086997 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:51:20.094045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5afe582f-8232-49c9-9870-cb3da0fbf57e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:20.094535 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5afe582f-8232-49c9-9870-cb3da0fbf57e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:20.094978 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5afe582f-8232-49c9-9870-cb3da0fbf57e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:20.095733 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5afe582f-8232-49c9-9870-cb3da0fbf57e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:20.096199 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5afe582f-8232-49c9-9870-cb3da0fbf57e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:20.096633 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5afe582f-8232-49c9-9870-cb3da0fbf57e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:20.230160 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5afe582f-8232-49c9-9870-cb3da0fbf57e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d192ed06fc4bc996702c2b97ae9002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdc9ab2fa940aebf524f6dd64f1e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:51:20.237898 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5afe582f-8232-49c9-9870-cb3da0fbf57e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4" status: 200 len: 1555 microversion: 2.1 time: 0.158643 Sep 10 12:51:20.238476 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3647/7298] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:51:20 2022] GET /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4 => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:51:21.841128 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a4f86bc5-f7e5-49ec-8691-83d594979668 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0dac1b20-3b96-4069-8243-504f99f56d56"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:51:21.843872 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a4f86bc5-f7e5-49ec-8691-83d594979668 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 7ad8b068-76f1-468f-8b3e-692a2bfa38c4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:51:21.850658 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a4f86bc5-f7e5-49ec-8691-83d594979668 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:21.851155 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a4f86bc5-f7e5-49ec-8691-83d594979668 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:21.851631 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a4f86bc5-f7e5-49ec-8691-83d594979668 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:21.852330 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a4f86bc5-f7e5-49ec-8691-83d594979668 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:21.852793 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a4f86bc5-f7e5-49ec-8691-83d594979668 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:21.853228 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a4f86bc5-f7e5-49ec-8691-83d594979668 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:22.129306 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a4f86bc5-f7e5-49ec-8691-83d594979668 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "POST /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292065 Sep 10 12:51:22.130215 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3652/7299] 10.222.0.23 () {60 vars in 1323 bytes} [Sat Sep 10 12:51:21 2022] POST /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:51:32.856029 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3450c464-a243-4f5c-b2aa-eb01b0a0b0c9 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:51:32.856519 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3450c464-a243-4f5c-b2aa-eb01b0a0b0c9 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 7ad8b068-76f1-468f-8b3e-692a2bfa38c4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:51:32.859384 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:51:32.860146 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=36 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:51:32.866633 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3450c464-a243-4f5c-b2aa-eb01b0a0b0c9 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:32.867111 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3450c464-a243-4f5c-b2aa-eb01b0a0b0c9 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:32.867576 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3450c464-a243-4f5c-b2aa-eb01b0a0b0c9 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:32.868269 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3450c464-a243-4f5c-b2aa-eb01b0a0b0c9 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:32.868721 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3450c464-a243-4f5c-b2aa-eb01b0a0b0c9 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:32.869144 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3450c464-a243-4f5c-b2aa-eb01b0a0b0c9 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:32.949672 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-3450c464-a243-4f5c-b2aa-eb01b0a0b0c9 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lazy-loading 'services' on Instance uuid 7ad8b068-76f1-468f-8b3e-692a2bfa38c4 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:51:33.021473 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3450c464-a243-4f5c-b2aa-eb01b0a0b0c9 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4/os-volume_attachments/0dac1b20-3b96-4069-8243-504f99f56d56" status: 202 len: 0 microversion: 2.1 time: 0.169158 Sep 10 12:51:33.022075 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3648/7300] 10.222.0.23 () {58 vars in 1416 bytes} [Sat Sep 10 12:51:32 2022] DELETE /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4/os-volume_attachments/0dac1b20-3b96-4069-8243-504f99f56d56 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:51:33.028740 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:51:33.029588 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:51:33.034398 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c509eda8-f815-4191-b6af-618b736a719b tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:51:33.036823 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c509eda8-f815-4191-b6af-618b736a719b tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 7ad8b068-76f1-468f-8b3e-692a2bfa38c4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:51:33.045548 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c509eda8-f815-4191-b6af-618b736a719b tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:33.046199 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c509eda8-f815-4191-b6af-618b736a719b tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:33.046691 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c509eda8-f815-4191-b6af-618b736a719b tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:33.047446 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c509eda8-f815-4191-b6af-618b736a719b tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:33.047923 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c509eda8-f815-4191-b6af-618b736a719b tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:33.048367 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c509eda8-f815-4191-b6af-618b736a719b tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:33.083196 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c509eda8-f815-4191-b6af-618b736a719b tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056440 Sep 10 12:51:33.083765 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3653/7301] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:51:33 2022] GET /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:51:34.096997 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e7a9b054-1b99-45cc-938c-deaf3d98c890 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:51:34.099470 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e7a9b054-1b99-45cc-938c-deaf3d98c890 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 7ad8b068-76f1-468f-8b3e-692a2bfa38c4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:51:34.106416 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e7a9b054-1b99-45cc-938c-deaf3d98c890 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:34.106901 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e7a9b054-1b99-45cc-938c-deaf3d98c890 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:34.107373 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e7a9b054-1b99-45cc-938c-deaf3d98c890 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:34.108862 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e7a9b054-1b99-45cc-938c-deaf3d98c890 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:34.109409 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e7a9b054-1b99-45cc-938c-deaf3d98c890 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:34.109841 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e7a9b054-1b99-45cc-938c-deaf3d98c890 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:34.144528 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e7a9b054-1b99-45cc-938c-deaf3d98c890 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052735 Sep 10 12:51:34.145119 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3649/7302] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:51:34 2022] GET /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:51:35.161209 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-adf03848-2ecd-4929-98c0-2d59cbdd7b07 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:51:35.163482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-adf03848-2ecd-4929-98c0-2d59cbdd7b07 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 7ad8b068-76f1-468f-8b3e-692a2bfa38c4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:51:35.170680 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-adf03848-2ecd-4929-98c0-2d59cbdd7b07 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:35.171199 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-adf03848-2ecd-4929-98c0-2d59cbdd7b07 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:35.171646 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-adf03848-2ecd-4929-98c0-2d59cbdd7b07 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:35.172348 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-adf03848-2ecd-4929-98c0-2d59cbdd7b07 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:35.172811 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-adf03848-2ecd-4929-98c0-2d59cbdd7b07 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:35.173245 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-adf03848-2ecd-4929-98c0-2d59cbdd7b07 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:35.205929 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-adf03848-2ecd-4929-98c0-2d59cbdd7b07 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048754 Sep 10 12:51:35.206533 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3654/7303] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:51:35 2022] GET /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:51:36.220040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-23709347-6a1c-4053-952b-dae658bdec4c tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:51:36.222241 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-23709347-6a1c-4053-952b-dae658bdec4c tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 7ad8b068-76f1-468f-8b3e-692a2bfa38c4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:51:36.229120 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-23709347-6a1c-4053-952b-dae658bdec4c tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:36.229602 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-23709347-6a1c-4053-952b-dae658bdec4c tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:36.230036 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-23709347-6a1c-4053-952b-dae658bdec4c tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:36.230723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-23709347-6a1c-4053-952b-dae658bdec4c tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:36.231186 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-23709347-6a1c-4053-952b-dae658bdec4c tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:36.231615 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-23709347-6a1c-4053-952b-dae658bdec4c tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:36.261596 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-23709347-6a1c-4053-952b-dae658bdec4c tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047261 Sep 10 12:51:36.262164 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3650/7304] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:51:36 2022] GET /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:51:37.274679 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d94501a8-c962-495e-b3bc-ee2a6a62ba23 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:51:37.276907 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d94501a8-c962-495e-b3bc-ee2a6a62ba23 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 7ad8b068-76f1-468f-8b3e-692a2bfa38c4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:51:37.283932 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d94501a8-c962-495e-b3bc-ee2a6a62ba23 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:37.284432 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d94501a8-c962-495e-b3bc-ee2a6a62ba23 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:37.284887 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d94501a8-c962-495e-b3bc-ee2a6a62ba23 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:37.285590 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d94501a8-c962-495e-b3bc-ee2a6a62ba23 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:37.286059 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d94501a8-c962-495e-b3bc-ee2a6a62ba23 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:37.286502 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d94501a8-c962-495e-b3bc-ee2a6a62ba23 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:37.320339 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d94501a8-c962-495e-b3bc-ee2a6a62ba23 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049682 Sep 10 12:51:37.320926 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3655/7305] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:51:37 2022] GET /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:51:38.333010 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-20e3993d-7c58-4e7d-964e-cb25ab7819c2 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:51:38.335239 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-20e3993d-7c58-4e7d-964e-cb25ab7819c2 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 7ad8b068-76f1-468f-8b3e-692a2bfa38c4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:51:38.342898 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-20e3993d-7c58-4e7d-964e-cb25ab7819c2 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:38.343418 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-20e3993d-7c58-4e7d-964e-cb25ab7819c2 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:38.343859 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-20e3993d-7c58-4e7d-964e-cb25ab7819c2 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:38.344739 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-20e3993d-7c58-4e7d-964e-cb25ab7819c2 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:38.345203 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-20e3993d-7c58-4e7d-964e-cb25ab7819c2 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:38.345635 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-20e3993d-7c58-4e7d-964e-cb25ab7819c2 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:38.375950 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-20e3993d-7c58-4e7d-964e-cb25ab7819c2 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047029 Sep 10 12:51:38.376510 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3651/7306] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:51:38 2022] GET /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 12:51:38.387653 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-74808586-0bac-47f9-b6a4-3c5f302ad2f9 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:51:38.388166 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-74808586-0bac-47f9-b6a4-3c5f302ad2f9 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 7ad8b068-76f1-468f-8b3e-692a2bfa38c4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:51:38.395811 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-74808586-0bac-47f9-b6a4-3c5f302ad2f9 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:38.396316 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-74808586-0bac-47f9-b6a4-3c5f302ad2f9 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:38.396777 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-74808586-0bac-47f9-b6a4-3c5f302ad2f9 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:38.397489 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-74808586-0bac-47f9-b6a4-3c5f302ad2f9 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:38.397969 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-74808586-0bac-47f9-b6a4-3c5f302ad2f9 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:38.398416 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-74808586-0bac-47f9-b6a4-3c5f302ad2f9 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:38.485036 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-74808586-0bac-47f9-b6a4-3c5f302ad2f9 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] HTTP exception thrown: Instance 7ad8b068-76f1-468f-8b3e-692a2bfa38c4 is not attached to volume 0dac1b20-3b96-4069-8243-504f99f56d56 Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-74808586-0bac-47f9-b6a4-3c5f302ad2f9 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Request method failure captured: Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4/os-volume_attachments/0dac1b20-3b96-4069-8243-504f99f56d56 HTTP/1.1 Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHIg2lA99kXJHZmn3V11jnZckTd_Fv7-dDoFLYj2MtEF6Gmq3wEKwN-EavOSJGtJMLIghL5rxI_wupJV3H0Kww6tqY4XNw_zrC01ZD3QAaMxBIJLY9TatAaSR1jZn7PvVbiK81icNxpoQHLMaHnnfD4wa-LEVjOW-miQEyBguqcQcLcI Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: debdc9ab2fa940aebf524f6dd64f1e4a Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1050941532 Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/debdc9ab2fa940aebf524f6dd64f1e4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/debdc9ab2fa940aebf524f6dd64f1e4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_debdc9ab2fa940aebf524f6dd64f1e4a", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/debdc9ab2fa940aebf524f6dd64f1e4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-TestEncryptedCinderVolumes-1050941532 Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: debdc9ab2fa940aebf524f6dd64f1e4a Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1050941532 Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-TestEncryptedCinderVolumes-1050941532-project Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 87d192ed06fc4bc996702c2b97ae9002 Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-TestEncryptedCinderVolumes-1050941532-project Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 7ad8b068-76f1-468f-8b3e-692a2bfa38c4 is not attached to volume 0dac1b20-3b96-4069-8243-504f99f56d56 Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'server_id': '7ad8b068-76f1-468f-8b3e-692a2bfa38c4', 'id': '0dac1b20-3b96-4069-8243-504f99f56d56'} Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0dac1b20-3b96-4069-8243-504f99f56d56. Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ad8b068-76f1-468f-8b3e-692a2bfa38c4 is not attached to volume 0dac1b20-3b96-4069-8243-504f99f56d56 Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:51:38.493925 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:51:38.498710 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:51:38.498710 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:51:38.498710 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ad8b068-76f1-468f-8b3e-692a2bfa38c4 is not attached to volume 0dac1b20-3b96-4069-8243-504f99f56d56 Sep 10 12:51:38.498710 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:51:38.498710 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-74808586-0bac-47f9-b6a4-3c5f302ad2f9 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Returning 404 to user: Instance 7ad8b068-76f1-468f-8b3e-692a2bfa38c4 is not attached to volume 0dac1b20-3b96-4069-8243-504f99f56d56 {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:51:38.498710 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-74808586-0bac-47f9-b6a4-3c5f302ad2f9 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4/os-volume_attachments/0dac1b20-3b96-4069-8243-504f99f56d56" status: 404 len: 154 microversion: 2.1 time: 0.111970 Sep 10 12:51:38.498710 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3656/7307] 10.222.0.23 () {58 vars in 1416 bytes} [Sat Sep 10 12:51:38 2022] DELETE /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4/os-volume_attachments/0dac1b20-3b96-4069-8243-504f99f56d56 => generated 154 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:51:41.841154 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e40d7112-cbfb-4c21-bd01-84285013aa26 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:51:41.841693 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e40d7112-cbfb-4c21-bd01-84285013aa26 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 7ad8b068-76f1-468f-8b3e-692a2bfa38c4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:51:41.849604 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e40d7112-cbfb-4c21-bd01-84285013aa26 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:41.850102 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e40d7112-cbfb-4c21-bd01-84285013aa26 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:41.850549 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e40d7112-cbfb-4c21-bd01-84285013aa26 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:41.851322 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e40d7112-cbfb-4c21-bd01-84285013aa26 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:41.851770 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e40d7112-cbfb-4c21-bd01-84285013aa26 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:41.852202 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e40d7112-cbfb-4c21-bd01-84285013aa26 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:41.880273 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e40d7112-cbfb-4c21-bd01-84285013aa26 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 7ad8b068-76f1-468f-8b3e-692a2bfa38c4] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:51:41.963553 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e40d7112-cbfb-4c21-bd01-84285013aa26 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4" status: 204 len: 0 microversion: 2.1 time: 0.125858 Sep 10 12:51:41.967725 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3652/7308] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:51:41 2022] DELETE /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:51:41.972896 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a6d15815-b0aa-47a0-b16b-0f984a2b5768 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:51:41.973533 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a6d15815-b0aa-47a0-b16b-0f984a2b5768 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 7ad8b068-76f1-468f-8b3e-692a2bfa38c4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:51:41.981299 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6d15815-b0aa-47a0-b16b-0f984a2b5768 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:41.981947 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6d15815-b0aa-47a0-b16b-0f984a2b5768 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:41.983023 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6d15815-b0aa-47a0-b16b-0f984a2b5768 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:41.983918 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6d15815-b0aa-47a0-b16b-0f984a2b5768 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:41.984390 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6d15815-b0aa-47a0-b16b-0f984a2b5768 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:41.984831 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a6d15815-b0aa-47a0-b16b-0f984a2b5768 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:42.118303 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a6d15815-b0aa-47a0-b16b-0f984a2b5768 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d192ed06fc4bc996702c2b97ae9002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdc9ab2fa940aebf524f6dd64f1e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:51:42.127579 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a6d15815-b0aa-47a0-b16b-0f984a2b5768 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4" status: 200 len: 1561 microversion: 2.1 time: 0.158467 Sep 10 12:51:42.128157 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3657/7309] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:51:41 2022] GET /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:51:43.151818 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f5ca20c2-212a-40dd-9a26-7fca4294406d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:51:43.152527 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f5ca20c2-212a-40dd-9a26-7fca4294406d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 7ad8b068-76f1-468f-8b3e-692a2bfa38c4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:51:43.159443 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f5ca20c2-212a-40dd-9a26-7fca4294406d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:43.159923 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f5ca20c2-212a-40dd-9a26-7fca4294406d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:43.160361 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f5ca20c2-212a-40dd-9a26-7fca4294406d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:43.161048 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f5ca20c2-212a-40dd-9a26-7fca4294406d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:43.161501 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f5ca20c2-212a-40dd-9a26-7fca4294406d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:43.161925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f5ca20c2-212a-40dd-9a26-7fca4294406d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:43.293903 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f5ca20c2-212a-40dd-9a26-7fca4294406d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d192ed06fc4bc996702c2b97ae9002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdc9ab2fa940aebf524f6dd64f1e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:51:43.302193 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f5ca20c2-212a-40dd-9a26-7fca4294406d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4" status: 200 len: 1561 microversion: 2.1 time: 0.154711 Sep 10 12:51:43.302773 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3653/7310] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:51:43 2022] GET /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:51:44.160475 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-1e60ebd8-593e-454b-931b-91e5a306b386 req-378b47ba-286c-4143-a09a-c54f3b3ce741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ad8b068-76f1-468f-8b3e-692a2bfa38c4", "name": "network-vif-deleted", "tag": "1b761f7f-cebc-4851-96b9-52eda924dbe1"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:51:44.172530 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-1e60ebd8-593e-454b-931b-91e5a306b386 req-378b47ba-286c-4143-a09a-c54f3b3ce741 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:44.173041 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-1e60ebd8-593e-454b-931b-91e5a306b386 req-378b47ba-286c-4143-a09a-c54f3b3ce741 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:44.173490 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-1e60ebd8-593e-454b-931b-91e5a306b386 req-378b47ba-286c-4143-a09a-c54f3b3ce741 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:44.186643 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-1e60ebd8-593e-454b-931b-91e5a306b386 req-378b47ba-286c-4143-a09a-c54f3b3ce741 service nova] Creating event network-vif-deleted:1b761f7f-cebc-4851-96b9-52eda924dbe1 for instance 7ad8b068-76f1-468f-8b3e-692a2bfa38c4 on n-h1-856895-1 Sep 10 12:51:44.192728 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-1e60ebd8-593e-454b-931b-91e5a306b386 req-378b47ba-286c-4143-a09a-c54f3b3ce741 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035932 Sep 10 12:51:44.193435 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3658/7311] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:51:44.326825 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5d3a6a5f-2280-4843-97ec-0ced7699e637 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:51:44.327395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5d3a6a5f-2280-4843-97ec-0ced7699e637 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 7ad8b068-76f1-468f-8b3e-692a2bfa38c4] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:51:44.334609 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d3a6a5f-2280-4843-97ec-0ced7699e637 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:44.335092 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d3a6a5f-2280-4843-97ec-0ced7699e637 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:44.335563 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d3a6a5f-2280-4843-97ec-0ced7699e637 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:44.336261 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d3a6a5f-2280-4843-97ec-0ced7699e637 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:44.336716 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d3a6a5f-2280-4843-97ec-0ced7699e637 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:44.337137 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d3a6a5f-2280-4843-97ec-0ced7699e637 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:44.369867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d3a6a5f-2280-4843-97ec-0ced7699e637 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:44.370209 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d3a6a5f-2280-4843-97ec-0ced7699e637 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:44.370710 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5d3a6a5f-2280-4843-97ec-0ced7699e637 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:44.371407 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-5d3a6a5f-2280-4843-97ec-0ced7699e637 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lazy-loading 'fault' on Instance uuid 7ad8b068-76f1-468f-8b3e-692a2bfa38c4 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:51:44.413363 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5d3a6a5f-2280-4843-97ec-0ced7699e637 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d192ed06fc4bc996702c2b97ae9002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdc9ab2fa940aebf524f6dd64f1e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:51:44.422063 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5d3a6a5f-2280-4843-97ec-0ced7699e637 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4" status: 200 len: 1353 microversion: 2.1 time: 0.100197 Sep 10 12:51:44.422641 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3654/7312] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:51:44 2022] GET /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4 => generated 1353 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:51:45.447392 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dc46289d-9dec-42c4-bcd6-796d5510a00c tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:51:45.448029 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-dc46289d-9dec-42c4-bcd6-796d5510a00c tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 7ad8b068-76f1-468f-8b3e-692a2bfa38c4] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:51:45.455689 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dc46289d-9dec-42c4-bcd6-796d5510a00c tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:45.456178 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dc46289d-9dec-42c4-bcd6-796d5510a00c tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:45.456625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dc46289d-9dec-42c4-bcd6-796d5510a00c tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:45.457318 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dc46289d-9dec-42c4-bcd6-796d5510a00c tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:45.457781 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dc46289d-9dec-42c4-bcd6-796d5510a00c tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:45.458218 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-dc46289d-9dec-42c4-bcd6-796d5510a00c tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:45.472394 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-dc46289d-9dec-42c4-bcd6-796d5510a00c tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] HTTP exception thrown: Instance 7ad8b068-76f1-468f-8b3e-692a2bfa38c4 could not be found. Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dc46289d-9dec-42c4-bcd6-796d5510a00c tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Request method failure captured: Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4 HTTP/1.1 Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHIg2lA99kXJHZmn3V11jnZckTd_Fv7-dDoFLYj2MtEF6Gmq3wEKwN-EavOSJGtJMLIghL5rxI_wupJV3H0Kww6tqY4XNw_zrC01ZD3QAaMxBIJLY9TatAaSR1jZn7PvVbiK81icNxpoQHLMaHnnfD4wa-LEVjOW-miQEyBguqcQcLcI Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: debdc9ab2fa940aebf524f6dd64f1e4a Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1050941532 Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/debdc9ab2fa940aebf524f6dd64f1e4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/debdc9ab2fa940aebf524f6dd64f1e4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_debdc9ab2fa940aebf524f6dd64f1e4a", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/debdc9ab2fa940aebf524f6dd64f1e4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-TestEncryptedCinderVolumes-1050941532 Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: debdc9ab2fa940aebf524f6dd64f1e4a Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1050941532 Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-TestEncryptedCinderVolumes-1050941532-project Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 87d192ed06fc4bc996702c2b97ae9002 Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-TestEncryptedCinderVolumes-1050941532-project Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 7ad8b068-76f1-468f-8b3e-692a2bfa38c4 could not be found. Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '7ad8b068-76f1-468f-8b3e-692a2bfa38c4'} Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ad8b068-76f1-468f-8b3e-692a2bfa38c4 could not be found. Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ad8b068-76f1-468f-8b3e-692a2bfa38c4 could not be found. Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:51:45.474014 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:51:45.478471 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:51:45.478471 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:51:45.478471 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:51:45.478471 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:51:45.478471 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:51:45.478471 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:51:45.478471 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ad8b068-76f1-468f-8b3e-692a2bfa38c4 could not be found. Sep 10 12:51:45.478471 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:51:45.478471 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-dc46289d-9dec-42c4-bcd6-796d5510a00c tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Returning 404 to user: Instance 7ad8b068-76f1-468f-8b3e-692a2bfa38c4 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:51:45.478471 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-dc46289d-9dec-42c4-bcd6-796d5510a00c tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4" status: 404 len: 111 microversion: 2.1 time: 0.033213 Sep 10 12:51:45.478471 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3659/7313] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:51:45 2022] GET /compute/v2.1/servers/7ad8b068-76f1-468f-8b3e-692a2bfa38c4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:51:45.484563 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3542bdb7-2c71-49d2-853a-2f6e3c215c6f tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '.version_select at 0x7f4071e3b310>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:51:45.509084 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3542bdb7-2c71-49d2-853a-2f6e3c215c6f tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1131947986" status: 202 len: 0 microversion: 2.1 time: 0.028769 Sep 10 12:51:45.509687 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3655/7314] 10.222.0.23 () {58 vars in 1278 bytes} [Sat Sep 10 12:51:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1131947986 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 12:51:45.528230 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-129b33f9-a1dc-4b92-82c2-76110a1d0fe3 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Action: 'create', calling method: .version_select at 0x7f40723e3280>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1106353932", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3orExBcZCA8rt9D3aZfXCDktXZd+uIYHbY20Pua5kvq3DlJXYiDYt5siedrN0FMMeycELj+ZoZCoXoAUYj6mzuDh+DDilr1/6y1BTxTFxX46jaXVRBF/TcDu93d2PwbA=="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:51:45.543493 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-129b33f9-a1dc-4b92-82c2-76110a1d0fe3 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Getting quotas for project debdc9ab2fa940aebf524f6dd64f1e4a. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:51:45.548773 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-129b33f9-a1dc-4b92-82c2-76110a1d0fe3 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Getting quotas for user 87d192ed06fc4bc996702c2b97ae9002 and project debdc9ab2fa940aebf524f6dd64f1e4a. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:51:45.573105 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-129b33f9-a1dc-4b92-82c2-76110a1d0fe3 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.048991 Sep 10 12:51:45.573700 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3660/7315] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 12:51:45 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:51:45.626272 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7b37fb6a-1657-4e7a-8df9-7b6828a51e9e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1217917228", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1106353932", "networks": [{"uuid": "a94f5c34-7c6c-4591-8764-3abe39a847e3"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:51:45.681181 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-7b37fb6a-1657-4e7a-8df9-7b6828a51e9e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] validate_networks() for [('a94f5c34-7c6c-4591-8764-3abe39a847e3', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:51:46.059154 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-7b37fb6a-1657-4e7a-8df9-7b6828a51e9e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:51:46.059602 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-7b37fb6a-1657-4e7a-8df9-7b6828a51e9e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:51:46.060074 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-7b37fb6a-1657-4e7a-8df9-7b6828a51e9e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:51:46.060681 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-7b37fb6a-1657-4e7a-8df9-7b6828a51e9e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:51:46.061101 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-7b37fb6a-1657-4e7a-8df9-7b6828a51e9e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:51:46.069869 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b37fb6a-1657-4e7a-8df9-7b6828a51e9e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:46.070373 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b37fb6a-1657-4e7a-8df9-7b6828a51e9e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:46.070808 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b37fb6a-1657-4e7a-8df9-7b6828a51e9e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:46.071564 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b37fb6a-1657-4e7a-8df9-7b6828a51e9e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:46.072018 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b37fb6a-1657-4e7a-8df9-7b6828a51e9e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:46.072440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7b37fb6a-1657-4e7a-8df9-7b6828a51e9e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:46.093755 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-7b37fb6a-1657-4e7a-8df9-7b6828a51e9e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Getting quotas for project debdc9ab2fa940aebf524f6dd64f1e4a. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:51:46.098898 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-7b37fb6a-1657-4e7a-8df9-7b6828a51e9e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Getting quotas for user 87d192ed06fc4bc996702c2b97ae9002 and project debdc9ab2fa940aebf524f6dd64f1e4a. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:51:46.110892 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7b37fb6a-1657-4e7a-8df9-7b6828a51e9e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:51:46.113254 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7b37fb6a-1657-4e7a-8df9-7b6828a51e9e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 570bf0bf-5872-4232-b70d-4a22b7ff2ffa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:51:46.160927 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7b37fb6a-1657-4e7a-8df9-7b6828a51e9e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.538816 Sep 10 12:51:46.161808 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3656/7316] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:51:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:51:46.172778 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c563fffd-cc3d-4674-acf5-0f8eced6880a tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:51:46.173421 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c563fffd-cc3d-4674-acf5-0f8eced6880a tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 570bf0bf-5872-4232-b70d-4a22b7ff2ffa] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:51:46.230568 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c563fffd-cc3d-4674-acf5-0f8eced6880a tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d192ed06fc4bc996702c2b97ae9002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdc9ab2fa940aebf524f6dd64f1e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:51:46.237905 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c563fffd-cc3d-4674-acf5-0f8eced6880a tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa" status: 200 len: 1263 microversion: 2.1 time: 0.068970 Sep 10 12:51:46.238493 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3661/7317] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:51:46 2022] GET /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa => generated 1263 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:51:47.262744 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-93662e06-b9dd-4c6a-8c34-2cbf09c31c00 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:51:47.263415 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-93662e06-b9dd-4c6a-8c34-2cbf09c31c00 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 570bf0bf-5872-4232-b70d-4a22b7ff2ffa] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:51:47.270209 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-93662e06-b9dd-4c6a-8c34-2cbf09c31c00 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:47.270776 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-93662e06-b9dd-4c6a-8c34-2cbf09c31c00 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:47.271253 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-93662e06-b9dd-4c6a-8c34-2cbf09c31c00 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:47.271955 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-93662e06-b9dd-4c6a-8c34-2cbf09c31c00 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:47.272453 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-93662e06-b9dd-4c6a-8c34-2cbf09c31c00 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:47.272888 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-93662e06-b9dd-4c6a-8c34-2cbf09c31c00 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:47.358823 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-93662e06-b9dd-4c6a-8c34-2cbf09c31c00 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d192ed06fc4bc996702c2b97ae9002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdc9ab2fa940aebf524f6dd64f1e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:51:47.367882 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-93662e06-b9dd-4c6a-8c34-2cbf09c31c00 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa" status: 200 len: 1315 microversion: 2.1 time: 0.109979 Sep 10 12:51:47.368844 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3657/7318] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:51:47 2022] GET /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa => generated 1315 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:51:48.393450 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-96916b83-9d01-4fc3-b5b7-71a5b345100a tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:51:48.394266 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-96916b83-9d01-4fc3-b5b7-71a5b345100a tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 570bf0bf-5872-4232-b70d-4a22b7ff2ffa] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:51:48.401136 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-96916b83-9d01-4fc3-b5b7-71a5b345100a tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:48.401713 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-96916b83-9d01-4fc3-b5b7-71a5b345100a tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:48.402237 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-96916b83-9d01-4fc3-b5b7-71a5b345100a tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:48.403017 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-96916b83-9d01-4fc3-b5b7-71a5b345100a tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:48.403592 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-96916b83-9d01-4fc3-b5b7-71a5b345100a tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:48.404750 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-96916b83-9d01-4fc3-b5b7-71a5b345100a tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:48.618532 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-96916b83-9d01-4fc3-b5b7-71a5b345100a tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d192ed06fc4bc996702c2b97ae9002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdc9ab2fa940aebf524f6dd64f1e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:51:48.627795 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-96916b83-9d01-4fc3-b5b7-71a5b345100a tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa" status: 200 len: 1363 microversion: 2.1 time: 0.238221 Sep 10 12:51:48.628392 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3662/7319] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:51:48 2022] GET /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa => generated 1363 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:51:48.844539 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-dfd9e4bb-2362-43af-96f7-55008960f4fe req-9db4648e-4e7b-4583-9ee6-0b9df5290dbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "570bf0bf-5872-4232-b70d-4a22b7ff2ffa", "tag": "09e55b5f-cb50-4894-9e92-ec9743a85a0c"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:51:48.854737 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-dfd9e4bb-2362-43af-96f7-55008960f4fe req-9db4648e-4e7b-4583-9ee6-0b9df5290dbe service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:48.855329 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-dfd9e4bb-2362-43af-96f7-55008960f4fe req-9db4648e-4e7b-4583-9ee6-0b9df5290dbe service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:48.855834 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-dfd9e4bb-2362-43af-96f7-55008960f4fe req-9db4648e-4e7b-4583-9ee6-0b9df5290dbe service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:48.868006 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-dfd9e4bb-2362-43af-96f7-55008960f4fe req-9db4648e-4e7b-4583-9ee6-0b9df5290dbe service nova] Creating event network-changed:09e55b5f-cb50-4894-9e92-ec9743a85a0c for instance 570bf0bf-5872-4232-b70d-4a22b7ff2ffa on n-h1-856895-1 Sep 10 12:51:48.877832 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-dfd9e4bb-2362-43af-96f7-55008960f4fe req-9db4648e-4e7b-4583-9ee6-0b9df5290dbe service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037973 Sep 10 12:51:48.878460 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3658/7320] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:51:49.650780 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1646cda5-1227-446a-9c0e-6bce852b7576 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:51:49.651477 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1646cda5-1227-446a-9c0e-6bce852b7576 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 570bf0bf-5872-4232-b70d-4a22b7ff2ffa] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:51:49.658362 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1646cda5-1227-446a-9c0e-6bce852b7576 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:49.658858 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1646cda5-1227-446a-9c0e-6bce852b7576 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:49.659340 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1646cda5-1227-446a-9c0e-6bce852b7576 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:49.660047 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1646cda5-1227-446a-9c0e-6bce852b7576 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:49.660516 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1646cda5-1227-446a-9c0e-6bce852b7576 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:49.660956 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1646cda5-1227-446a-9c0e-6bce852b7576 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:49.793263 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1646cda5-1227-446a-9c0e-6bce852b7576 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d192ed06fc4bc996702c2b97ae9002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdc9ab2fa940aebf524f6dd64f1e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:51:49.801473 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1646cda5-1227-446a-9c0e-6bce852b7576 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa" status: 200 len: 1363 microversion: 2.1 time: 0.154581 Sep 10 12:51:49.802109 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3663/7321] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:51:49 2022] GET /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:51:50.827984 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1d71b02f-7974-49ef-95bc-3262b8b59ba0 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:51:50.828688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1d71b02f-7974-49ef-95bc-3262b8b59ba0 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 570bf0bf-5872-4232-b70d-4a22b7ff2ffa] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:51:50.834842 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d71b02f-7974-49ef-95bc-3262b8b59ba0 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:50.835356 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d71b02f-7974-49ef-95bc-3262b8b59ba0 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:50.835790 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d71b02f-7974-49ef-95bc-3262b8b59ba0 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:50.836474 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d71b02f-7974-49ef-95bc-3262b8b59ba0 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:50.836926 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d71b02f-7974-49ef-95bc-3262b8b59ba0 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:50.837351 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d71b02f-7974-49ef-95bc-3262b8b59ba0 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:50.971377 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1d71b02f-7974-49ef-95bc-3262b8b59ba0 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d192ed06fc4bc996702c2b97ae9002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdc9ab2fa940aebf524f6dd64f1e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:51:50.979850 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1d71b02f-7974-49ef-95bc-3262b8b59ba0 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa" status: 200 len: 1363 microversion: 2.1 time: 0.158212 Sep 10 12:51:50.980434 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3659/7322] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:51:50 2022] GET /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:51:52.002430 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-da9e6ad2-1abf-45c9-ab59-a8419b18972d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:51:52.003024 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-da9e6ad2-1abf-45c9-ab59-a8419b18972d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 570bf0bf-5872-4232-b70d-4a22b7ff2ffa] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:51:52.009888 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da9e6ad2-1abf-45c9-ab59-a8419b18972d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:52.010420 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da9e6ad2-1abf-45c9-ab59-a8419b18972d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:52.010874 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da9e6ad2-1abf-45c9-ab59-a8419b18972d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:52.011616 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da9e6ad2-1abf-45c9-ab59-a8419b18972d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:52.012089 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da9e6ad2-1abf-45c9-ab59-a8419b18972d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:52.012539 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da9e6ad2-1abf-45c9-ab59-a8419b18972d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:52.144488 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-da9e6ad2-1abf-45c9-ab59-a8419b18972d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d192ed06fc4bc996702c2b97ae9002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdc9ab2fa940aebf524f6dd64f1e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:51:52.152153 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-da9e6ad2-1abf-45c9-ab59-a8419b18972d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa" status: 200 len: 1363 microversion: 2.1 time: 0.153867 Sep 10 12:51:52.152718 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3664/7323] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:51:51 2022] GET /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:51:53.175641 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d00ff19a-09a5-43d1-a51d-b124b91f6acc tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:51:53.176933 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d00ff19a-09a5-43d1-a51d-b124b91f6acc tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 570bf0bf-5872-4232-b70d-4a22b7ff2ffa] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:51:53.184104 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d00ff19a-09a5-43d1-a51d-b124b91f6acc tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:53.184612 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d00ff19a-09a5-43d1-a51d-b124b91f6acc tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:53.185055 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d00ff19a-09a5-43d1-a51d-b124b91f6acc tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:53.185831 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d00ff19a-09a5-43d1-a51d-b124b91f6acc tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:53.186285 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d00ff19a-09a5-43d1-a51d-b124b91f6acc tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:53.186713 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d00ff19a-09a5-43d1-a51d-b124b91f6acc tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:53.320783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d00ff19a-09a5-43d1-a51d-b124b91f6acc tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d192ed06fc4bc996702c2b97ae9002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdc9ab2fa940aebf524f6dd64f1e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:51:53.328735 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d00ff19a-09a5-43d1-a51d-b124b91f6acc tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa" status: 200 len: 1363 microversion: 2.1 time: 0.157027 Sep 10 12:51:53.329328 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3660/7324] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:51:53 2022] GET /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:51:53.834852 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-19cd30d0-3079-403d-8620-4af1c757ed33 req-5409512e-d46e-472f-ba47-efe4a4b46aad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "570bf0bf-5872-4232-b70d-4a22b7ff2ffa", "name": "network-vif-plugged", "status": "completed", "tag": "09e55b5f-cb50-4894-9e92-ec9743a85a0c"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:51:53.845973 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-19cd30d0-3079-403d-8620-4af1c757ed33 req-5409512e-d46e-472f-ba47-efe4a4b46aad service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:53.846340 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-19cd30d0-3079-403d-8620-4af1c757ed33 req-5409512e-d46e-472f-ba47-efe4a4b46aad service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:53.846817 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-19cd30d0-3079-403d-8620-4af1c757ed33 req-5409512e-d46e-472f-ba47-efe4a4b46aad service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:53.858460 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-19cd30d0-3079-403d-8620-4af1c757ed33 req-5409512e-d46e-472f-ba47-efe4a4b46aad service nova] Creating event network-vif-plugged:09e55b5f-cb50-4894-9e92-ec9743a85a0c for instance 570bf0bf-5872-4232-b70d-4a22b7ff2ffa on n-h1-856895-1 Sep 10 12:51:53.863441 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-19cd30d0-3079-403d-8620-4af1c757ed33 req-5409512e-d46e-472f-ba47-efe4a4b46aad service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032259 Sep 10 12:51:53.864045 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3665/7325] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:51:54.352654 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c11a7e98-3317-416b-8a5d-bb6eb622343a tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:51:54.353268 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c11a7e98-3317-416b-8a5d-bb6eb622343a tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 570bf0bf-5872-4232-b70d-4a22b7ff2ffa] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:51:54.361361 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c11a7e98-3317-416b-8a5d-bb6eb622343a tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:54.361839 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c11a7e98-3317-416b-8a5d-bb6eb622343a tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:54.362275 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c11a7e98-3317-416b-8a5d-bb6eb622343a tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:54.362965 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c11a7e98-3317-416b-8a5d-bb6eb622343a tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:54.363444 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c11a7e98-3317-416b-8a5d-bb6eb622343a tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:54.363872 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c11a7e98-3317-416b-8a5d-bb6eb622343a tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:54.549538 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c11a7e98-3317-416b-8a5d-bb6eb622343a tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d192ed06fc4bc996702c2b97ae9002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdc9ab2fa940aebf524f6dd64f1e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:51:54.557776 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c11a7e98-3317-416b-8a5d-bb6eb622343a tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa" status: 200 len: 1363 microversion: 2.1 time: 0.209038 Sep 10 12:51:54.558355 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3661/7326] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:51:54 2022] GET /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:51:55.582814 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4fb5b0eb-37a5-4572-a8ed-9c48cf86da68 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:51:55.583561 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4fb5b0eb-37a5-4572-a8ed-9c48cf86da68 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 570bf0bf-5872-4232-b70d-4a22b7ff2ffa] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:51:55.589749 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fb5b0eb-37a5-4572-a8ed-9c48cf86da68 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:55.590241 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fb5b0eb-37a5-4572-a8ed-9c48cf86da68 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:55.590696 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fb5b0eb-37a5-4572-a8ed-9c48cf86da68 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:55.591950 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fb5b0eb-37a5-4572-a8ed-9c48cf86da68 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:55.592748 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fb5b0eb-37a5-4572-a8ed-9c48cf86da68 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:55.593195 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fb5b0eb-37a5-4572-a8ed-9c48cf86da68 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:55.775312 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4fb5b0eb-37a5-4572-a8ed-9c48cf86da68 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d192ed06fc4bc996702c2b97ae9002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdc9ab2fa940aebf524f6dd64f1e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:51:55.784087 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4fb5b0eb-37a5-4572-a8ed-9c48cf86da68 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa" status: 200 len: 1555 microversion: 2.1 time: 0.206499 Sep 10 12:51:55.784647 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3666/7327] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:51:55 2022] GET /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa => generated 1555 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:51:55.806654 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7996b4fb-cc7d-4cc9-a462-06e86bbe9338 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:51:55.807317 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7996b4fb-cc7d-4cc9-a462-06e86bbe9338 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 570bf0bf-5872-4232-b70d-4a22b7ff2ffa] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:51:55.814359 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7996b4fb-cc7d-4cc9-a462-06e86bbe9338 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:55.814852 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7996b4fb-cc7d-4cc9-a462-06e86bbe9338 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:55.815332 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7996b4fb-cc7d-4cc9-a462-06e86bbe9338 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:55.816036 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7996b4fb-cc7d-4cc9-a462-06e86bbe9338 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:55.816500 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7996b4fb-cc7d-4cc9-a462-06e86bbe9338 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:55.816936 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7996b4fb-cc7d-4cc9-a462-06e86bbe9338 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:55.944830 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7996b4fb-cc7d-4cc9-a462-06e86bbe9338 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d192ed06fc4bc996702c2b97ae9002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdc9ab2fa940aebf524f6dd64f1e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:51:55.953199 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7996b4fb-cc7d-4cc9-a462-06e86bbe9338 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa" status: 200 len: 1555 microversion: 2.1 time: 0.150549 Sep 10 12:51:55.953784 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3662/7328] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:51:55 2022] GET /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:51:57.447169 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6cbda381-a112-46db-8be2-9719cabd4bd0 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ebb515a4-b1b4-4877-9527-866b0772ca26"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:51:57.449917 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6cbda381-a112-46db-8be2-9719cabd4bd0 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 570bf0bf-5872-4232-b70d-4a22b7ff2ffa] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:51:57.452555 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:51:57.458522 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6cbda381-a112-46db-8be2-9719cabd4bd0 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:57.459022 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6cbda381-a112-46db-8be2-9719cabd4bd0 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:57.459502 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6cbda381-a112-46db-8be2-9719cabd4bd0 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:57.460214 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6cbda381-a112-46db-8be2-9719cabd4bd0 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:51:57.460683 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6cbda381-a112-46db-8be2-9719cabd4bd0 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:51:57.461127 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6cbda381-a112-46db-8be2-9719cabd4bd0 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:51:57.715639 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6cbda381-a112-46db-8be2-9719cabd4bd0 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "POST /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272307 Sep 10 12:51:57.716262 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3667/7329] 10.222.0.23 () {60 vars in 1323 bytes} [Sat Sep 10 12:51:57 2022] POST /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:52:09.493837 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-47b9e80c-066e-4a41-8663-0ee1e2b8aaee tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:52:09.494427 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-47b9e80c-066e-4a41-8663-0ee1e2b8aaee tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 570bf0bf-5872-4232-b70d-4a22b7ff2ffa] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:52:09.496704 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:52:09.497365 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:52:09.499905 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:52:09.500713 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:52:09.508367 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47b9e80c-066e-4a41-8663-0ee1e2b8aaee tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:09.508938 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47b9e80c-066e-4a41-8663-0ee1e2b8aaee tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:09.509385 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47b9e80c-066e-4a41-8663-0ee1e2b8aaee tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:09.510084 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47b9e80c-066e-4a41-8663-0ee1e2b8aaee tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:09.510545 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47b9e80c-066e-4a41-8663-0ee1e2b8aaee tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:09.510975 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47b9e80c-066e-4a41-8663-0ee1e2b8aaee tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:09.598738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-47b9e80c-066e-4a41-8663-0ee1e2b8aaee tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lazy-loading 'services' on Instance uuid 570bf0bf-5872-4232-b70d-4a22b7ff2ffa {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:52:09.668249 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-47b9e80c-066e-4a41-8663-0ee1e2b8aaee tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "DELETE /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa/os-volume_attachments/ebb515a4-b1b4-4877-9527-866b0772ca26" status: 202 len: 0 microversion: 2.1 time: 0.178222 Sep 10 12:52:09.668866 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3663/7330] 10.222.0.23 () {58 vars in 1416 bytes} [Sat Sep 10 12:52:09 2022] DELETE /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa/os-volume_attachments/ebb515a4-b1b4-4877-9527-866b0772ca26 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:52:09.675798 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:52:09.676724 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:52:09.681031 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-52bf8ad0-5bf2-4f87-a784-65815a4bec05 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:52:09.683479 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-52bf8ad0-5bf2-4f87-a784-65815a4bec05 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 570bf0bf-5872-4232-b70d-4a22b7ff2ffa] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:52:09.693806 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52bf8ad0-5bf2-4f87-a784-65815a4bec05 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:09.694312 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52bf8ad0-5bf2-4f87-a784-65815a4bec05 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:09.694764 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52bf8ad0-5bf2-4f87-a784-65815a4bec05 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:09.695519 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52bf8ad0-5bf2-4f87-a784-65815a4bec05 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:09.695990 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52bf8ad0-5bf2-4f87-a784-65815a4bec05 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:09.696435 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-52bf8ad0-5bf2-4f87-a784-65815a4bec05 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:09.729093 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-52bf8ad0-5bf2-4f87-a784-65815a4bec05 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055207 Sep 10 12:52:09.729653 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3668/7331] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:52:09 2022] GET /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:52:10.743554 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-51ef16b3-c9e6-4706-88dd-dd0f66428190 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:52:10.745959 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-51ef16b3-c9e6-4706-88dd-dd0f66428190 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 570bf0bf-5872-4232-b70d-4a22b7ff2ffa] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:52:10.753312 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-51ef16b3-c9e6-4706-88dd-dd0f66428190 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:10.753808 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-51ef16b3-c9e6-4706-88dd-dd0f66428190 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:10.754256 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-51ef16b3-c9e6-4706-88dd-dd0f66428190 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:10.755000 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-51ef16b3-c9e6-4706-88dd-dd0f66428190 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:10.755488 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-51ef16b3-c9e6-4706-88dd-dd0f66428190 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:10.755922 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-51ef16b3-c9e6-4706-88dd-dd0f66428190 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:10.786954 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-51ef16b3-c9e6-4706-88dd-dd0f66428190 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048704 Sep 10 12:52:10.787756 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3664/7332] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:52:10 2022] GET /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:52:11.800414 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-35aa7bbf-d430-42a3-ac77-caa42a148880 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:52:11.802714 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-35aa7bbf-d430-42a3-ac77-caa42a148880 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 570bf0bf-5872-4232-b70d-4a22b7ff2ffa] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:52:11.810219 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-35aa7bbf-d430-42a3-ac77-caa42a148880 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:11.810746 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-35aa7bbf-d430-42a3-ac77-caa42a148880 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:11.811359 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-35aa7bbf-d430-42a3-ac77-caa42a148880 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:11.812099 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-35aa7bbf-d430-42a3-ac77-caa42a148880 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:11.812576 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-35aa7bbf-d430-42a3-ac77-caa42a148880 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:11.813052 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-35aa7bbf-d430-42a3-ac77-caa42a148880 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:11.849036 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-35aa7bbf-d430-42a3-ac77-caa42a148880 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053239 Sep 10 12:52:11.849555 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3669/7333] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:52:11 2022] GET /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:52:12.862348 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fa14c891-3a38-4318-8212-871314544392 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:52:12.864653 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fa14c891-3a38-4318-8212-871314544392 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 570bf0bf-5872-4232-b70d-4a22b7ff2ffa] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:52:12.871934 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fa14c891-3a38-4318-8212-871314544392 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:12.872364 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fa14c891-3a38-4318-8212-871314544392 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:12.872835 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fa14c891-3a38-4318-8212-871314544392 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:12.873645 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fa14c891-3a38-4318-8212-871314544392 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:12.874103 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fa14c891-3a38-4318-8212-871314544392 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:12.874532 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fa14c891-3a38-4318-8212-871314544392 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:12.905155 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fa14c891-3a38-4318-8212-871314544392 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046831 Sep 10 12:52:12.905741 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3665/7334] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:52:12 2022] GET /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:52:13.917327 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bfa4d323-57ea-4475-b81c-4901c3d9b998 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:52:13.919518 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bfa4d323-57ea-4475-b81c-4901c3d9b998 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 570bf0bf-5872-4232-b70d-4a22b7ff2ffa] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:52:13.926409 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bfa4d323-57ea-4475-b81c-4901c3d9b998 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:13.926905 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bfa4d323-57ea-4475-b81c-4901c3d9b998 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:13.927390 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bfa4d323-57ea-4475-b81c-4901c3d9b998 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:13.928100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bfa4d323-57ea-4475-b81c-4901c3d9b998 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:13.928572 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bfa4d323-57ea-4475-b81c-4901c3d9b998 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:13.929018 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bfa4d323-57ea-4475-b81c-4901c3d9b998 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:13.958862 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bfa4d323-57ea-4475-b81c-4901c3d9b998 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045462 Sep 10 12:52:13.959787 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3670/7335] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:52:13 2022] GET /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:52:14.971113 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3ad3584f-4bee-4ab1-ab16-a32cd5f52092 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:52:14.973341 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3ad3584f-4bee-4ab1-ab16-a32cd5f52092 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 570bf0bf-5872-4232-b70d-4a22b7ff2ffa] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:52:14.980129 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3ad3584f-4bee-4ab1-ab16-a32cd5f52092 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:14.980617 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3ad3584f-4bee-4ab1-ab16-a32cd5f52092 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:14.981057 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3ad3584f-4bee-4ab1-ab16-a32cd5f52092 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:14.981749 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3ad3584f-4bee-4ab1-ab16-a32cd5f52092 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:14.982205 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3ad3584f-4bee-4ab1-ab16-a32cd5f52092 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:14.982723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3ad3584f-4bee-4ab1-ab16-a32cd5f52092 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:15.012349 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3ad3584f-4bee-4ab1-ab16-a32cd5f52092 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045421 Sep 10 12:52:15.012907 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3666/7336] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:52:14 2022] GET /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 12:52:15.024255 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5411c5c4-0f26-4836-9b4c-8c9dea6b2dbc tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:52:15.025049 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5411c5c4-0f26-4836-9b4c-8c9dea6b2dbc tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 570bf0bf-5872-4232-b70d-4a22b7ff2ffa] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:52:15.032022 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5411c5c4-0f26-4836-9b4c-8c9dea6b2dbc tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:15.032513 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5411c5c4-0f26-4836-9b4c-8c9dea6b2dbc tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:15.032961 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5411c5c4-0f26-4836-9b4c-8c9dea6b2dbc tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:15.033652 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5411c5c4-0f26-4836-9b4c-8c9dea6b2dbc tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:15.034112 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5411c5c4-0f26-4836-9b4c-8c9dea6b2dbc tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:15.034545 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5411c5c4-0f26-4836-9b4c-8c9dea6b2dbc tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:15.110118 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-5411c5c4-0f26-4836-9b4c-8c9dea6b2dbc tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] HTTP exception thrown: Instance 570bf0bf-5872-4232-b70d-4a22b7ff2ffa is not attached to volume ebb515a4-b1b4-4877-9527-866b0772ca26 Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5411c5c4-0f26-4836-9b4c-8c9dea6b2dbc tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Request method failure captured: Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa/os-volume_attachments/ebb515a4-b1b4-4877-9527-866b0772ca26 HTTP/1.1 Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHIg2lA99kXJHZmn3V11jnZckTd_Fv7-dDoFLYj2MtEF6Gmq3wEKwN-EavOSJGtJMLIghL5rxI_wupJV3H0Kww6tqY4XNw_zrC01ZD3QAaMxBIJLY9TatAaSR1jZn7PvVbiK81icNxpoQHLMaHnnfD4wa-LEVjOW-miQEyBguqcQcLcI Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: debdc9ab2fa940aebf524f6dd64f1e4a Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1050941532 Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/debdc9ab2fa940aebf524f6dd64f1e4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/debdc9ab2fa940aebf524f6dd64f1e4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_debdc9ab2fa940aebf524f6dd64f1e4a", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/debdc9ab2fa940aebf524f6dd64f1e4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-TestEncryptedCinderVolumes-1050941532 Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: debdc9ab2fa940aebf524f6dd64f1e4a Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1050941532 Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-TestEncryptedCinderVolumes-1050941532-project Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 87d192ed06fc4bc996702c2b97ae9002 Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-TestEncryptedCinderVolumes-1050941532-project Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 570bf0bf-5872-4232-b70d-4a22b7ff2ffa is not attached to volume ebb515a4-b1b4-4877-9527-866b0772ca26 Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'server_id': '570bf0bf-5872-4232-b70d-4a22b7ff2ffa', 'id': 'ebb515a4-b1b4-4877-9527-866b0772ca26'} Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ebb515a4-b1b4-4877-9527-866b0772ca26. Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 570bf0bf-5872-4232-b70d-4a22b7ff2ffa is not attached to volume ebb515a4-b1b4-4877-9527-866b0772ca26 Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:52:15.111777 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:52:15.116173 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:52:15.116173 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:52:15.116173 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 570bf0bf-5872-4232-b70d-4a22b7ff2ffa is not attached to volume ebb515a4-b1b4-4877-9527-866b0772ca26 Sep 10 12:52:15.116173 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:52:15.116173 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5411c5c4-0f26-4836-9b4c-8c9dea6b2dbc tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Returning 404 to user: Instance 570bf0bf-5872-4232-b70d-4a22b7ff2ffa is not attached to volume ebb515a4-b1b4-4877-9527-866b0772ca26 {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:52:15.116173 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5411c5c4-0f26-4836-9b4c-8c9dea6b2dbc tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "DELETE /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa/os-volume_attachments/ebb515a4-b1b4-4877-9527-866b0772ca26" status: 404 len: 154 microversion: 2.1 time: 0.093084 Sep 10 12:52:15.116173 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3671/7337] 10.222.0.23 () {58 vars in 1416 bytes} [Sat Sep 10 12:52:15 2022] DELETE /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa/os-volume_attachments/ebb515a4-b1b4-4877-9527-866b0772ca26 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:52:18.466231 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-84bed193-3c44-4e43-8f73-6b1c1a0b3989 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:52:18.467398 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-84bed193-3c44-4e43-8f73-6b1c1a0b3989 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 570bf0bf-5872-4232-b70d-4a22b7ff2ffa] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:52:18.473940 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-84bed193-3c44-4e43-8f73-6b1c1a0b3989 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:18.474436 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-84bed193-3c44-4e43-8f73-6b1c1a0b3989 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:18.474880 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-84bed193-3c44-4e43-8f73-6b1c1a0b3989 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:18.475629 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-84bed193-3c44-4e43-8f73-6b1c1a0b3989 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:18.476092 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-84bed193-3c44-4e43-8f73-6b1c1a0b3989 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:18.476527 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-84bed193-3c44-4e43-8f73-6b1c1a0b3989 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:18.505068 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-84bed193-3c44-4e43-8f73-6b1c1a0b3989 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 570bf0bf-5872-4232-b70d-4a22b7ff2ffa] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:52:18.585039 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-84bed193-3c44-4e43-8f73-6b1c1a0b3989 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "DELETE /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa" status: 204 len: 0 microversion: 2.1 time: 0.122741 Sep 10 12:52:18.585993 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3667/7338] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:52:18 2022] DELETE /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:52:18.594944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c1b62d3b-416e-45e5-93e9-307062480bc1 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:52:18.595615 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c1b62d3b-416e-45e5-93e9-307062480bc1 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 570bf0bf-5872-4232-b70d-4a22b7ff2ffa] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:52:18.602184 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1b62d3b-416e-45e5-93e9-307062480bc1 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:18.602684 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1b62d3b-416e-45e5-93e9-307062480bc1 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:18.603137 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1b62d3b-416e-45e5-93e9-307062480bc1 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:18.603875 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1b62d3b-416e-45e5-93e9-307062480bc1 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:18.604339 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1b62d3b-416e-45e5-93e9-307062480bc1 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:18.604778 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c1b62d3b-416e-45e5-93e9-307062480bc1 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:18.738023 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c1b62d3b-416e-45e5-93e9-307062480bc1 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d192ed06fc4bc996702c2b97ae9002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdc9ab2fa940aebf524f6dd64f1e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:52:18.746308 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c1b62d3b-416e-45e5-93e9-307062480bc1 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa" status: 200 len: 1561 microversion: 2.1 time: 0.155576 Sep 10 12:52:18.746769 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3672/7339] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:52:18 2022] GET /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:52:19.770354 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-60467445-ea98-4701-a315-5f4c533250db tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:52:19.771092 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-60467445-ea98-4701-a315-5f4c533250db tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 570bf0bf-5872-4232-b70d-4a22b7ff2ffa] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:52:19.778056 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-60467445-ea98-4701-a315-5f4c533250db tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:19.778539 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-60467445-ea98-4701-a315-5f4c533250db tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:19.778998 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-60467445-ea98-4701-a315-5f4c533250db tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:19.779861 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-60467445-ea98-4701-a315-5f4c533250db tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:19.780323 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-60467445-ea98-4701-a315-5f4c533250db tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:19.780754 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-60467445-ea98-4701-a315-5f4c533250db tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:19.917740 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-60467445-ea98-4701-a315-5f4c533250db tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d192ed06fc4bc996702c2b97ae9002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdc9ab2fa940aebf524f6dd64f1e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:52:19.926945 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-60467445-ea98-4701-a315-5f4c533250db tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa" status: 200 len: 1561 microversion: 2.1 time: 0.160837 Sep 10 12:52:19.927574 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3668/7340] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:52:19 2022] GET /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:52:20.951915 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b7c4aed2-9609-4e18-b9ac-6fbff70444b7 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:52:20.952741 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b7c4aed2-9609-4e18-b9ac-6fbff70444b7 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 570bf0bf-5872-4232-b70d-4a22b7ff2ffa] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:52:20.959836 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7c4aed2-9609-4e18-b9ac-6fbff70444b7 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:20.960340 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7c4aed2-9609-4e18-b9ac-6fbff70444b7 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:20.960833 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7c4aed2-9609-4e18-b9ac-6fbff70444b7 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:20.961549 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7c4aed2-9609-4e18-b9ac-6fbff70444b7 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:20.962018 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7c4aed2-9609-4e18-b9ac-6fbff70444b7 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:20.962462 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b7c4aed2-9609-4e18-b9ac-6fbff70444b7 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:21.051141 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b7c4aed2-9609-4e18-b9ac-6fbff70444b7 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d192ed06fc4bc996702c2b97ae9002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdc9ab2fa940aebf524f6dd64f1e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:52:21.059067 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b7c4aed2-9609-4e18-b9ac-6fbff70444b7 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa" status: 200 len: 1519 microversion: 2.1 time: 0.111828 Sep 10 12:52:21.059909 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3673/7341] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:52:20 2022] GET /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa => generated 1519 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:52:21.103645 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-5c47a348-1c08-48e4-90ec-ee0e82d0a4b2 req-780d9537-7e48-4260-9f2c-85085fb53bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "570bf0bf-5872-4232-b70d-4a22b7ff2ffa", "name": "network-vif-deleted", "tag": "09e55b5f-cb50-4894-9e92-ec9743a85a0c"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:52:21.120195 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-5c47a348-1c08-48e4-90ec-ee0e82d0a4b2 req-780d9537-7e48-4260-9f2c-85085fb53bb3 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:21.120683 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-5c47a348-1c08-48e4-90ec-ee0e82d0a4b2 req-780d9537-7e48-4260-9f2c-85085fb53bb3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:21.121382 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-5c47a348-1c08-48e4-90ec-ee0e82d0a4b2 req-780d9537-7e48-4260-9f2c-85085fb53bb3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:21.133376 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-5c47a348-1c08-48e4-90ec-ee0e82d0a4b2 req-780d9537-7e48-4260-9f2c-85085fb53bb3 service nova] Creating event network-vif-deleted:09e55b5f-cb50-4894-9e92-ec9743a85a0c for instance 570bf0bf-5872-4232-b70d-4a22b7ff2ffa on n-h1-856895-1 Sep 10 12:52:21.143632 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-5c47a348-1c08-48e4-90ec-ee0e82d0a4b2 req-780d9537-7e48-4260-9f2c-85085fb53bb3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043746 Sep 10 12:52:21.144363 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3669/7342] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:52:22.083423 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-947e86ff-6ba4-44b2-a6ad-369a6d058473 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:52:22.084058 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-947e86ff-6ba4-44b2-a6ad-369a6d058473 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: 570bf0bf-5872-4232-b70d-4a22b7ff2ffa] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:52:22.090947 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-947e86ff-6ba4-44b2-a6ad-369a6d058473 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:22.091554 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-947e86ff-6ba4-44b2-a6ad-369a6d058473 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:22.092077 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-947e86ff-6ba4-44b2-a6ad-369a6d058473 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:22.092782 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-947e86ff-6ba4-44b2-a6ad-369a6d058473 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:22.093250 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-947e86ff-6ba4-44b2-a6ad-369a6d058473 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:22.093694 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-947e86ff-6ba4-44b2-a6ad-369a6d058473 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:22.106930 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-947e86ff-6ba4-44b2-a6ad-369a6d058473 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] HTTP exception thrown: Instance 570bf0bf-5872-4232-b70d-4a22b7ff2ffa could not be found. Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-947e86ff-6ba4-44b2-a6ad-369a6d058473 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Request method failure captured: Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa HTTP/1.1 Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHIg2lA99kXJHZmn3V11jnZckTd_Fv7-dDoFLYj2MtEF6Gmq3wEKwN-EavOSJGtJMLIghL5rxI_wupJV3H0Kww6tqY4XNw_zrC01ZD3QAaMxBIJLY9TatAaSR1jZn7PvVbiK81icNxpoQHLMaHnnfD4wa-LEVjOW-miQEyBguqcQcLcI Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: debdc9ab2fa940aebf524f6dd64f1e4a Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1050941532 Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/debdc9ab2fa940aebf524f6dd64f1e4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/debdc9ab2fa940aebf524f6dd64f1e4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_debdc9ab2fa940aebf524f6dd64f1e4a", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/debdc9ab2fa940aebf524f6dd64f1e4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-TestEncryptedCinderVolumes-1050941532 Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: debdc9ab2fa940aebf524f6dd64f1e4a Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1050941532 Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-TestEncryptedCinderVolumes-1050941532-project Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 87d192ed06fc4bc996702c2b97ae9002 Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-TestEncryptedCinderVolumes-1050941532-project Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 570bf0bf-5872-4232-b70d-4a22b7ff2ffa could not be found. Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '570bf0bf-5872-4232-b70d-4a22b7ff2ffa'} Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 570bf0bf-5872-4232-b70d-4a22b7ff2ffa could not be found. Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 570bf0bf-5872-4232-b70d-4a22b7ff2ffa could not be found. Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:52:22.109242 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:52:22.113899 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:52:22.113899 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:52:22.113899 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:52:22.113899 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:52:22.113899 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:52:22.113899 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:52:22.113899 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 570bf0bf-5872-4232-b70d-4a22b7ff2ffa could not be found. Sep 10 12:52:22.113899 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:52:22.113899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-947e86ff-6ba4-44b2-a6ad-369a6d058473 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Returning 404 to user: Instance 570bf0bf-5872-4232-b70d-4a22b7ff2ffa could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:52:22.113899 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-947e86ff-6ba4-44b2-a6ad-369a6d058473 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa" status: 404 len: 111 microversion: 2.1 time: 0.031279 Sep 10 12:52:22.113899 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3674/7343] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:52:22 2022] GET /compute/v2.1/servers/570bf0bf-5872-4232-b70d-4a22b7ff2ffa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:52:22.121324 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2d9b2b51-6974-4248-8c56-0b6b03ab5a8d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '.version_select at 0x7f4073e6d670>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:52:22.142210 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2d9b2b51-6974-4248-8c56-0b6b03ab5a8d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1106353932" status: 202 len: 0 microversion: 2.1 time: 0.026103 Sep 10 12:52:22.142884 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3670/7344] 10.222.0.23 () {58 vars in 1278 bytes} [Sat Sep 10 12:52:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1106353932 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:52:22.160217 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c2422fdf-4415-4315-a146-9ac0aabfe029 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Action: 'create', calling method: .version_select at 0x7f406072c280>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-800422210", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKl2x/GtgGbbfekt5R60gDpwPm/nrHsxKtXu1GRYwIAAgulTzZ8V65jZncAEARlsbWPoSNjr8wjWODL09khsQ6ihcXnGR9dAjBpUQeVUZYCuZnud7MHZJm/Qaa8l9zCiUw=="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:52:22.177525 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-c2422fdf-4415-4315-a146-9ac0aabfe029 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Getting quotas for project debdc9ab2fa940aebf524f6dd64f1e4a. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:52:22.183404 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-c2422fdf-4415-4315-a146-9ac0aabfe029 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Getting quotas for user 87d192ed06fc4bc996702c2b97ae9002 and project debdc9ab2fa940aebf524f6dd64f1e4a. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:52:22.207569 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c2422fdf-4415-4315-a146-9ac0aabfe029 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.051246 Sep 10 12:52:22.208160 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3675/7345] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 12:52:22 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:52:22.259080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b1954697-e8e3-4316-931f-a3e16ec126e9 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1068413439", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-800422210", "networks": [{"uuid": "a94f5c34-7c6c-4591-8764-3abe39a847e3"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:52:22.312500 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-b1954697-e8e3-4316-931f-a3e16ec126e9 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] validate_networks() for [('a94f5c34-7c6c-4591-8764-3abe39a847e3', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:52:22.727333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-b1954697-e8e3-4316-931f-a3e16ec126e9 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:52:22.727768 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-b1954697-e8e3-4316-931f-a3e16ec126e9 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:52:22.728255 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-b1954697-e8e3-4316-931f-a3e16ec126e9 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:52:22.728675 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-b1954697-e8e3-4316-931f-a3e16ec126e9 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:52:22.729099 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-b1954697-e8e3-4316-931f-a3e16ec126e9 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:52:22.738378 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1954697-e8e3-4316-931f-a3e16ec126e9 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:22.738861 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1954697-e8e3-4316-931f-a3e16ec126e9 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:22.739338 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1954697-e8e3-4316-931f-a3e16ec126e9 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:22.740072 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1954697-e8e3-4316-931f-a3e16ec126e9 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:22.740532 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1954697-e8e3-4316-931f-a3e16ec126e9 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:22.740960 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b1954697-e8e3-4316-931f-a3e16ec126e9 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:22.758755 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-b1954697-e8e3-4316-931f-a3e16ec126e9 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Getting quotas for project debdc9ab2fa940aebf524f6dd64f1e4a. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:52:22.764767 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-b1954697-e8e3-4316-931f-a3e16ec126e9 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Getting quotas for user 87d192ed06fc4bc996702c2b97ae9002 and project debdc9ab2fa940aebf524f6dd64f1e4a. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:52:22.777006 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b1954697-e8e3-4316-931f-a3e16ec126e9 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:52:22.780027 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b1954697-e8e3-4316-931f-a3e16ec126e9 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: f12a283a-5605-4df8-a569-2880dbfdfb80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:52:22.826831 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b1954697-e8e3-4316-931f-a3e16ec126e9 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.571148 Sep 10 12:52:22.827520 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3671/7346] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:52:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:52:22.838691 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-079b8af3-24d5-4a4d-8d06-fb6539e74e3b tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:52:22.839362 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-079b8af3-24d5-4a4d-8d06-fb6539e74e3b tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: f12a283a-5605-4df8-a569-2880dbfdfb80] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:52:22.906577 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-079b8af3-24d5-4a4d-8d06-fb6539e74e3b tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d192ed06fc4bc996702c2b97ae9002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdc9ab2fa940aebf524f6dd64f1e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:52:22.913580 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-079b8af3-24d5-4a4d-8d06-fb6539e74e3b tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80" status: 200 len: 1262 microversion: 2.1 time: 0.078765 Sep 10 12:52:22.914142 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3676/7347] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:52:22 2022] GET /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80 => generated 1262 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:52:23.939139 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-57dedb6c-d765-4570-a8f9-7251d691804e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:52:23.939857 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-57dedb6c-d765-4570-a8f9-7251d691804e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: f12a283a-5605-4df8-a569-2880dbfdfb80] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:52:23.946356 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57dedb6c-d765-4570-a8f9-7251d691804e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:23.946848 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57dedb6c-d765-4570-a8f9-7251d691804e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:23.947315 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57dedb6c-d765-4570-a8f9-7251d691804e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:23.948236 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57dedb6c-d765-4570-a8f9-7251d691804e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:23.948858 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57dedb6c-d765-4570-a8f9-7251d691804e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:23.949516 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57dedb6c-d765-4570-a8f9-7251d691804e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:24.032294 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-57dedb6c-d765-4570-a8f9-7251d691804e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d192ed06fc4bc996702c2b97ae9002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdc9ab2fa940aebf524f6dd64f1e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:52:24.040279 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-57dedb6c-d765-4570-a8f9-7251d691804e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80" status: 200 len: 1332 microversion: 2.1 time: 0.106726 Sep 10 12:52:24.040960 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3672/7348] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:52:23 2022] GET /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80 => generated 1332 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:52:25.065190 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ee776a53-a207-420a-95a9-9f8bacdfde51 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:52:25.066558 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ee776a53-a207-420a-95a9-9f8bacdfde51 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: f12a283a-5605-4df8-a569-2880dbfdfb80] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:52:25.073968 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ee776a53-a207-420a-95a9-9f8bacdfde51 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:25.074372 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ee776a53-a207-420a-95a9-9f8bacdfde51 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:25.074814 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ee776a53-a207-420a-95a9-9f8bacdfde51 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:25.076407 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ee776a53-a207-420a-95a9-9f8bacdfde51 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:25.077726 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ee776a53-a207-420a-95a9-9f8bacdfde51 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:25.078176 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ee776a53-a207-420a-95a9-9f8bacdfde51 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:25.323345 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ee776a53-a207-420a-95a9-9f8bacdfde51 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d192ed06fc4bc996702c2b97ae9002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdc9ab2fa940aebf524f6dd64f1e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:52:25.332125 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ee776a53-a207-420a-95a9-9f8bacdfde51 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80" status: 200 len: 1362 microversion: 2.1 time: 0.271668 Sep 10 12:52:25.332714 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3677/7349] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:52:25 2022] GET /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80 => generated 1362 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:52:25.484861 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-d574ef6a-50c5-4b62-8311-a041d2169559 req-17906609-16d7-42e2-8b6e-db48c1cdae6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f12a283a-5605-4df8-a569-2880dbfdfb80", "tag": "e718a980-1df7-4e9f-ac1c-db3086e50e90"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:52:25.496388 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d574ef6a-50c5-4b62-8311-a041d2169559 req-17906609-16d7-42e2-8b6e-db48c1cdae6f service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:25.497098 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d574ef6a-50c5-4b62-8311-a041d2169559 req-17906609-16d7-42e2-8b6e-db48c1cdae6f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:25.497684 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d574ef6a-50c5-4b62-8311-a041d2169559 req-17906609-16d7-42e2-8b6e-db48c1cdae6f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:25.510649 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-d574ef6a-50c5-4b62-8311-a041d2169559 req-17906609-16d7-42e2-8b6e-db48c1cdae6f service nova] Creating event network-changed:e718a980-1df7-4e9f-ac1c-db3086e50e90 for instance f12a283a-5605-4df8-a569-2880dbfdfb80 on n-h1-856895-1 Sep 10 12:52:25.516740 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-d574ef6a-50c5-4b62-8311-a041d2169559 req-17906609-16d7-42e2-8b6e-db48c1cdae6f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036589 Sep 10 12:52:25.517356 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3673/7350] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:52:26.355240 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-81388d51-3145-4dfb-9ea7-45e40d8bf18d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:52:26.355872 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-81388d51-3145-4dfb-9ea7-45e40d8bf18d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: f12a283a-5605-4df8-a569-2880dbfdfb80] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:52:26.363641 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81388d51-3145-4dfb-9ea7-45e40d8bf18d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:26.364176 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81388d51-3145-4dfb-9ea7-45e40d8bf18d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:26.364673 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81388d51-3145-4dfb-9ea7-45e40d8bf18d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:26.365415 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81388d51-3145-4dfb-9ea7-45e40d8bf18d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:26.365926 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81388d51-3145-4dfb-9ea7-45e40d8bf18d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:26.366405 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-81388d51-3145-4dfb-9ea7-45e40d8bf18d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:26.499314 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-81388d51-3145-4dfb-9ea7-45e40d8bf18d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d192ed06fc4bc996702c2b97ae9002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdc9ab2fa940aebf524f6dd64f1e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:52:26.507131 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-81388d51-3145-4dfb-9ea7-45e40d8bf18d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80" status: 200 len: 1362 microversion: 2.1 time: 0.155786 Sep 10 12:52:26.507856 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3678/7351] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:52:26 2022] GET /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:52:27.532489 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7c099080-7c52-455c-bda6-507112ce72c7 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:52:27.533117 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7c099080-7c52-455c-bda6-507112ce72c7 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: f12a283a-5605-4df8-a569-2880dbfdfb80] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:52:27.539356 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c099080-7c52-455c-bda6-507112ce72c7 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:27.539842 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c099080-7c52-455c-bda6-507112ce72c7 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:27.540284 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c099080-7c52-455c-bda6-507112ce72c7 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:27.540987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c099080-7c52-455c-bda6-507112ce72c7 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:27.541451 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c099080-7c52-455c-bda6-507112ce72c7 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:27.541880 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c099080-7c52-455c-bda6-507112ce72c7 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:27.677566 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7c099080-7c52-455c-bda6-507112ce72c7 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d192ed06fc4bc996702c2b97ae9002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdc9ab2fa940aebf524f6dd64f1e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:52:27.686930 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7c099080-7c52-455c-bda6-507112ce72c7 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80" status: 200 len: 1362 microversion: 2.1 time: 0.160218 Sep 10 12:52:27.687588 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3674/7352] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:52:27 2022] GET /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:52:28.710852 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-70c2f8b2-a5e6-4f6a-a5d7-48d102630526 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:52:28.711445 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-70c2f8b2-a5e6-4f6a-a5d7-48d102630526 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: f12a283a-5605-4df8-a569-2880dbfdfb80] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:52:28.718135 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-70c2f8b2-a5e6-4f6a-a5d7-48d102630526 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:28.718630 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-70c2f8b2-a5e6-4f6a-a5d7-48d102630526 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:28.719080 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-70c2f8b2-a5e6-4f6a-a5d7-48d102630526 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:28.719806 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-70c2f8b2-a5e6-4f6a-a5d7-48d102630526 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:28.720275 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-70c2f8b2-a5e6-4f6a-a5d7-48d102630526 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:28.720716 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-70c2f8b2-a5e6-4f6a-a5d7-48d102630526 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:28.848815 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-70c2f8b2-a5e6-4f6a-a5d7-48d102630526 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d192ed06fc4bc996702c2b97ae9002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdc9ab2fa940aebf524f6dd64f1e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:52:28.856526 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-70c2f8b2-a5e6-4f6a-a5d7-48d102630526 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80" status: 200 len: 1362 microversion: 2.1 time: 0.149720 Sep 10 12:52:28.857702 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3679/7353] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:52:28 2022] GET /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:52:29.880483 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-90e5c9a8-6d2b-4885-b65b-9f0520ab335c tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:52:29.881007 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-90e5c9a8-6d2b-4885-b65b-9f0520ab335c tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: f12a283a-5605-4df8-a569-2880dbfdfb80] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:52:29.888982 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-90e5c9a8-6d2b-4885-b65b-9f0520ab335c tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:29.889780 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-90e5c9a8-6d2b-4885-b65b-9f0520ab335c tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:29.890230 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-90e5c9a8-6d2b-4885-b65b-9f0520ab335c tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:29.890939 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-90e5c9a8-6d2b-4885-b65b-9f0520ab335c tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:29.891426 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-90e5c9a8-6d2b-4885-b65b-9f0520ab335c tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:29.891862 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-90e5c9a8-6d2b-4885-b65b-9f0520ab335c tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:29.936653 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-f8891c56-9a3c-46a3-9e65-eae650594b96 req-ba0ec48c-a7cd-48f3-9d6c-9aeb6472d9bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f12a283a-5605-4df8-a569-2880dbfdfb80", "name": "network-vif-plugged", "status": "completed", "tag": "e718a980-1df7-4e9f-ac1c-db3086e50e90"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:52:29.948373 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f8891c56-9a3c-46a3-9e65-eae650594b96 req-ba0ec48c-a7cd-48f3-9d6c-9aeb6472d9bf service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:29.948964 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f8891c56-9a3c-46a3-9e65-eae650594b96 req-ba0ec48c-a7cd-48f3-9d6c-9aeb6472d9bf service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:29.949491 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f8891c56-9a3c-46a3-9e65-eae650594b96 req-ba0ec48c-a7cd-48f3-9d6c-9aeb6472d9bf service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:29.962337 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-f8891c56-9a3c-46a3-9e65-eae650594b96 req-ba0ec48c-a7cd-48f3-9d6c-9aeb6472d9bf service nova] Creating event network-vif-plugged:e718a980-1df7-4e9f-ac1c-db3086e50e90 for instance f12a283a-5605-4df8-a569-2880dbfdfb80 on n-h1-856895-1 Sep 10 12:52:29.968428 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-f8891c56-9a3c-46a3-9e65-eae650594b96 req-ba0ec48c-a7cd-48f3-9d6c-9aeb6472d9bf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036539 Sep 10 12:52:29.969338 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3680/7354] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:52:30.030493 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-90e5c9a8-6d2b-4885-b65b-9f0520ab335c tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d192ed06fc4bc996702c2b97ae9002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdc9ab2fa940aebf524f6dd64f1e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:52:30.039147 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-90e5c9a8-6d2b-4885-b65b-9f0520ab335c tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80" status: 200 len: 1362 microversion: 2.1 time: 0.162467 Sep 10 12:52:30.039758 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3675/7355] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:52:29 2022] GET /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:52:31.063590 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a074f224-f615-46dd-830b-8eb1d4dc175e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:52:31.064309 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a074f224-f615-46dd-830b-8eb1d4dc175e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: f12a283a-5605-4df8-a569-2880dbfdfb80] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:52:31.071032 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a074f224-f615-46dd-830b-8eb1d4dc175e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:31.071556 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a074f224-f615-46dd-830b-8eb1d4dc175e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:31.072002 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a074f224-f615-46dd-830b-8eb1d4dc175e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:31.072701 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a074f224-f615-46dd-830b-8eb1d4dc175e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:31.073166 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a074f224-f615-46dd-830b-8eb1d4dc175e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:31.073605 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a074f224-f615-46dd-830b-8eb1d4dc175e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:31.209388 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a074f224-f615-46dd-830b-8eb1d4dc175e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d192ed06fc4bc996702c2b97ae9002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdc9ab2fa940aebf524f6dd64f1e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:52:31.218197 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a074f224-f615-46dd-830b-8eb1d4dc175e tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80" status: 200 len: 1362 microversion: 2.1 time: 0.159699 Sep 10 12:52:31.218914 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3681/7356] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:52:31 2022] GET /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:52:32.242928 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-162a8946-e0c3-4f0d-befc-7829fbb2e1f5 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:52:32.243583 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-162a8946-e0c3-4f0d-befc-7829fbb2e1f5 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: f12a283a-5605-4df8-a569-2880dbfdfb80] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:52:32.251256 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-162a8946-e0c3-4f0d-befc-7829fbb2e1f5 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:32.251741 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-162a8946-e0c3-4f0d-befc-7829fbb2e1f5 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:32.252176 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-162a8946-e0c3-4f0d-befc-7829fbb2e1f5 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:32.252867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-162a8946-e0c3-4f0d-befc-7829fbb2e1f5 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:32.253315 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-162a8946-e0c3-4f0d-befc-7829fbb2e1f5 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:32.253741 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-162a8946-e0c3-4f0d-befc-7829fbb2e1f5 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:32.389875 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-162a8946-e0c3-4f0d-befc-7829fbb2e1f5 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d192ed06fc4bc996702c2b97ae9002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdc9ab2fa940aebf524f6dd64f1e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:52:32.397660 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-162a8946-e0c3-4f0d-befc-7829fbb2e1f5 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80" status: 200 len: 1554 microversion: 2.1 time: 0.158620 Sep 10 12:52:32.398247 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3676/7357] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:52:32 2022] GET /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:52:32.421957 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-11039deb-5285-4bcf-a5ed-19e71581778a tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:52:32.422596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-11039deb-5285-4bcf-a5ed-19e71581778a tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: f12a283a-5605-4df8-a569-2880dbfdfb80] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:52:32.429553 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-11039deb-5285-4bcf-a5ed-19e71581778a tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:32.430058 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-11039deb-5285-4bcf-a5ed-19e71581778a tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:32.430514 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-11039deb-5285-4bcf-a5ed-19e71581778a tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:32.431255 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-11039deb-5285-4bcf-a5ed-19e71581778a tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:32.431728 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-11039deb-5285-4bcf-a5ed-19e71581778a tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:32.432174 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-11039deb-5285-4bcf-a5ed-19e71581778a tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:32.562944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-11039deb-5285-4bcf-a5ed-19e71581778a tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d192ed06fc4bc996702c2b97ae9002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdc9ab2fa940aebf524f6dd64f1e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:52:32.570689 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-11039deb-5285-4bcf-a5ed-19e71581778a tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80" status: 200 len: 1554 microversion: 2.1 time: 0.153527 Sep 10 12:52:32.571284 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3682/7358] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:52:32 2022] GET /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:52:34.070384 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cb2e6196-fb5e-4a4b-9893-f979e56a0892 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "651792cc-5b43-480d-8313-1e6b6106e5cd"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:52:34.072865 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cb2e6196-fb5e-4a4b-9893-f979e56a0892 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: f12a283a-5605-4df8-a569-2880dbfdfb80] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:52:34.074821 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:52:34.075506 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:52:34.083552 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb2e6196-fb5e-4a4b-9893-f979e56a0892 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:34.084047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb2e6196-fb5e-4a4b-9893-f979e56a0892 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:34.084485 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb2e6196-fb5e-4a4b-9893-f979e56a0892 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:34.085188 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb2e6196-fb5e-4a4b-9893-f979e56a0892 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:34.085644 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb2e6196-fb5e-4a4b-9893-f979e56a0892 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:34.086076 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb2e6196-fb5e-4a4b-9893-f979e56a0892 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:34.353397 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cb2e6196-fb5e-4a4b-9893-f979e56a0892 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "POST /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286731 Sep 10 12:52:34.354105 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3677/7359] 10.222.0.23 () {60 vars in 1323 bytes} [Sat Sep 10 12:52:34 2022] POST /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:52:45.070483 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-de4ea09e-8640-49b9-acfe-f943b1d0aa50 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:52:45.071032 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-de4ea09e-8640-49b9-acfe-f943b1d0aa50 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: f12a283a-5605-4df8-a569-2880dbfdfb80] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:52:45.073180 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:52:45.074511 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:52:45.075352 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=70 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:52:45.082787 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de4ea09e-8640-49b9-acfe-f943b1d0aa50 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:45.083317 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de4ea09e-8640-49b9-acfe-f943b1d0aa50 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:45.083776 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de4ea09e-8640-49b9-acfe-f943b1d0aa50 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:45.084487 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de4ea09e-8640-49b9-acfe-f943b1d0aa50 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:45.084956 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de4ea09e-8640-49b9-acfe-f943b1d0aa50 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:45.085401 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-de4ea09e-8640-49b9-acfe-f943b1d0aa50 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:45.168056 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-de4ea09e-8640-49b9-acfe-f943b1d0aa50 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lazy-loading 'services' on Instance uuid f12a283a-5605-4df8-a569-2880dbfdfb80 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:52:45.238298 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-de4ea09e-8640-49b9-acfe-f943b1d0aa50 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80/os-volume_attachments/651792cc-5b43-480d-8313-1e6b6106e5cd" status: 202 len: 0 microversion: 2.1 time: 0.171327 Sep 10 12:52:45.238834 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3683/7360] 10.222.0.23 () {58 vars in 1416 bytes} [Sat Sep 10 12:52:45 2022] DELETE /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80/os-volume_attachments/651792cc-5b43-480d-8313-1e6b6106e5cd => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:52:45.245547 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:52:45.246725 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:52:45.252026 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-68643fee-88da-4d95-bd3c-ea614e8863b3 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:52:45.254836 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-68643fee-88da-4d95-bd3c-ea614e8863b3 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: f12a283a-5605-4df8-a569-2880dbfdfb80] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:52:45.264328 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-68643fee-88da-4d95-bd3c-ea614e8863b3 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:45.264855 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-68643fee-88da-4d95-bd3c-ea614e8863b3 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:45.265292 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-68643fee-88da-4d95-bd3c-ea614e8863b3 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:45.265987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-68643fee-88da-4d95-bd3c-ea614e8863b3 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:45.266439 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-68643fee-88da-4d95-bd3c-ea614e8863b3 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:45.266862 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-68643fee-88da-4d95-bd3c-ea614e8863b3 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:45.303840 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-68643fee-88da-4d95-bd3c-ea614e8863b3 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060023 Sep 10 12:52:45.304414 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3678/7361] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:52:45 2022] GET /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:52:46.316555 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e14d226c-0772-4917-bfc8-68ec03f3cbfa tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:52:46.318901 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e14d226c-0772-4917-bfc8-68ec03f3cbfa tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: f12a283a-5605-4df8-a569-2880dbfdfb80] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:52:46.326259 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e14d226c-0772-4917-bfc8-68ec03f3cbfa tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:46.326944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e14d226c-0772-4917-bfc8-68ec03f3cbfa tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:46.327439 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e14d226c-0772-4917-bfc8-68ec03f3cbfa tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:46.328160 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e14d226c-0772-4917-bfc8-68ec03f3cbfa tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:46.328636 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e14d226c-0772-4917-bfc8-68ec03f3cbfa tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:46.329085 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e14d226c-0772-4917-bfc8-68ec03f3cbfa tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:46.362764 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e14d226c-0772-4917-bfc8-68ec03f3cbfa tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050669 Sep 10 12:52:46.363360 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3684/7362] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:52:46 2022] GET /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:52:47.375905 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-54bdcf12-47a7-4f44-aee1-beb4af95c03a tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:52:47.378130 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-54bdcf12-47a7-4f44-aee1-beb4af95c03a tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: f12a283a-5605-4df8-a569-2880dbfdfb80] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:52:47.385149 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54bdcf12-47a7-4f44-aee1-beb4af95c03a tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:47.385576 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54bdcf12-47a7-4f44-aee1-beb4af95c03a tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:47.386016 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54bdcf12-47a7-4f44-aee1-beb4af95c03a tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:47.386731 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54bdcf12-47a7-4f44-aee1-beb4af95c03a tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:47.387311 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54bdcf12-47a7-4f44-aee1-beb4af95c03a tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:47.387751 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-54bdcf12-47a7-4f44-aee1-beb4af95c03a tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:47.420576 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-54bdcf12-47a7-4f44-aee1-beb4af95c03a tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049176 Sep 10 12:52:47.421169 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3679/7363] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:52:47 2022] GET /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:52:48.433180 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e6d59880-391c-43fb-825e-5ea1653b51dc tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:52:48.436503 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e6d59880-391c-43fb-825e-5ea1653b51dc tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: f12a283a-5605-4df8-a569-2880dbfdfb80] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:52:48.443346 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6d59880-391c-43fb-825e-5ea1653b51dc tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:48.443840 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6d59880-391c-43fb-825e-5ea1653b51dc tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:48.444289 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6d59880-391c-43fb-825e-5ea1653b51dc tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:48.444994 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6d59880-391c-43fb-825e-5ea1653b51dc tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:48.445458 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6d59880-391c-43fb-825e-5ea1653b51dc tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:48.445891 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6d59880-391c-43fb-825e-5ea1653b51dc tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:48.477013 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e6d59880-391c-43fb-825e-5ea1653b51dc tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047878 Sep 10 12:52:48.477575 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3685/7364] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:52:48 2022] GET /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:52:49.489830 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-76f20c46-ceef-4d11-aa2b-af254e8cc2ed tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:52:49.492125 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-76f20c46-ceef-4d11-aa2b-af254e8cc2ed tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: f12a283a-5605-4df8-a569-2880dbfdfb80] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:52:49.499418 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-76f20c46-ceef-4d11-aa2b-af254e8cc2ed tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:49.499904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-76f20c46-ceef-4d11-aa2b-af254e8cc2ed tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:49.500348 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-76f20c46-ceef-4d11-aa2b-af254e8cc2ed tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:49.501048 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-76f20c46-ceef-4d11-aa2b-af254e8cc2ed tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:49.501505 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-76f20c46-ceef-4d11-aa2b-af254e8cc2ed tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:49.501945 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-76f20c46-ceef-4d11-aa2b-af254e8cc2ed tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:49.532402 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-76f20c46-ceef-4d11-aa2b-af254e8cc2ed tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046734 Sep 10 12:52:49.532986 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3680/7365] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:52:49 2022] GET /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:52:50.545409 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a86ff02e-7ad1-4028-ae76-d8ff7b20eb33 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:52:50.547539 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a86ff02e-7ad1-4028-ae76-d8ff7b20eb33 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: f12a283a-5605-4df8-a569-2880dbfdfb80] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:52:50.554237 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a86ff02e-7ad1-4028-ae76-d8ff7b20eb33 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:50.554730 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a86ff02e-7ad1-4028-ae76-d8ff7b20eb33 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:50.555200 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a86ff02e-7ad1-4028-ae76-d8ff7b20eb33 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:50.555901 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a86ff02e-7ad1-4028-ae76-d8ff7b20eb33 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:50.556367 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a86ff02e-7ad1-4028-ae76-d8ff7b20eb33 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:50.556801 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a86ff02e-7ad1-4028-ae76-d8ff7b20eb33 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:50.585941 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a86ff02e-7ad1-4028-ae76-d8ff7b20eb33 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044959 Sep 10 12:52:50.586491 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3686/7366] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:52:50 2022] GET /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 12:52:50.598068 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ae8fd4bf-a87e-43b6-992f-59d52a2bb0ec tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:52:50.598577 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ae8fd4bf-a87e-43b6-992f-59d52a2bb0ec tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: f12a283a-5605-4df8-a569-2880dbfdfb80] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:52:50.605357 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae8fd4bf-a87e-43b6-992f-59d52a2bb0ec tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:50.605847 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae8fd4bf-a87e-43b6-992f-59d52a2bb0ec tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:50.606289 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae8fd4bf-a87e-43b6-992f-59d52a2bb0ec tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:50.606984 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae8fd4bf-a87e-43b6-992f-59d52a2bb0ec tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:50.607497 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae8fd4bf-a87e-43b6-992f-59d52a2bb0ec tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:50.607929 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ae8fd4bf-a87e-43b6-992f-59d52a2bb0ec tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:50.682753 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-ae8fd4bf-a87e-43b6-992f-59d52a2bb0ec tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] HTTP exception thrown: Instance f12a283a-5605-4df8-a569-2880dbfdfb80 is not attached to volume 651792cc-5b43-480d-8313-1e6b6106e5cd Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ae8fd4bf-a87e-43b6-992f-59d52a2bb0ec tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Request method failure captured: Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: request: DELETE /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80/os-volume_attachments/651792cc-5b43-480d-8313-1e6b6106e5cd HTTP/1.1 Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHIg2lA99kXJHZmn3V11jnZckTd_Fv7-dDoFLYj2MtEF6Gmq3wEKwN-EavOSJGtJMLIghL5rxI_wupJV3H0Kww6tqY4XNw_zrC01ZD3QAaMxBIJLY9TatAaSR1jZn7PvVbiK81icNxpoQHLMaHnnfD4wa-LEVjOW-miQEyBguqcQcLcI Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: debdc9ab2fa940aebf524f6dd64f1e4a Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1050941532 Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/debdc9ab2fa940aebf524f6dd64f1e4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/debdc9ab2fa940aebf524f6dd64f1e4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_debdc9ab2fa940aebf524f6dd64f1e4a", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/debdc9ab2fa940aebf524f6dd64f1e4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-TestEncryptedCinderVolumes-1050941532 Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: debdc9ab2fa940aebf524f6dd64f1e4a Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1050941532 Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-TestEncryptedCinderVolumes-1050941532-project Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 87d192ed06fc4bc996702c2b97ae9002 Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-TestEncryptedCinderVolumes-1050941532-project Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance f12a283a-5605-4df8-a569-2880dbfdfb80 is not attached to volume 651792cc-5b43-480d-8313-1e6b6106e5cd Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'server_id': 'f12a283a-5605-4df8-a569-2880dbfdfb80', 'id': '651792cc-5b43-480d-8313-1e6b6106e5cd'} Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 651792cc-5b43-480d-8313-1e6b6106e5cd. Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f12a283a-5605-4df8-a569-2880dbfdfb80 is not attached to volume 651792cc-5b43-480d-8313-1e6b6106e5cd Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:52:50.684716 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:52:50.689862 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:52:50.689862 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:52:50.689862 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f12a283a-5605-4df8-a569-2880dbfdfb80 is not attached to volume 651792cc-5b43-480d-8313-1e6b6106e5cd Sep 10 12:52:50.689862 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:52:50.689862 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ae8fd4bf-a87e-43b6-992f-59d52a2bb0ec tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Returning 404 to user: Instance f12a283a-5605-4df8-a569-2880dbfdfb80 is not attached to volume 651792cc-5b43-480d-8313-1e6b6106e5cd {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:52:50.689862 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ae8fd4bf-a87e-43b6-992f-59d52a2bb0ec tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80/os-volume_attachments/651792cc-5b43-480d-8313-1e6b6106e5cd" status: 404 len: 154 microversion: 2.1 time: 0.092842 Sep 10 12:52:50.689862 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3681/7367] 10.222.0.23 () {58 vars in 1416 bytes} [Sat Sep 10 12:52:50 2022] DELETE /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80/os-volume_attachments/651792cc-5b43-480d-8313-1e6b6106e5cd => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:52:54.032865 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ad295550-bcfd-4007-8b25-63670497af41 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:52:54.033466 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ad295550-bcfd-4007-8b25-63670497af41 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: f12a283a-5605-4df8-a569-2880dbfdfb80] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:52:54.040522 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad295550-bcfd-4007-8b25-63670497af41 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:54.041033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad295550-bcfd-4007-8b25-63670497af41 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:54.041490 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad295550-bcfd-4007-8b25-63670497af41 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:54.042206 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad295550-bcfd-4007-8b25-63670497af41 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:54.042675 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad295550-bcfd-4007-8b25-63670497af41 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:54.043115 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ad295550-bcfd-4007-8b25-63670497af41 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:54.070339 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ad295550-bcfd-4007-8b25-63670497af41 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: f12a283a-5605-4df8-a569-2880dbfdfb80] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:52:54.153271 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ad295550-bcfd-4007-8b25-63670497af41 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80" status: 204 len: 0 microversion: 2.1 time: 0.124673 Sep 10 12:52:54.155222 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3687/7368] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:52:54 2022] DELETE /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 12:52:54.163365 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d7e066e3-75de-451a-8d0b-70fe8c9b8d5f tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:52:54.164017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d7e066e3-75de-451a-8d0b-70fe8c9b8d5f tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: f12a283a-5605-4df8-a569-2880dbfdfb80] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:52:54.174715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d7e066e3-75de-451a-8d0b-70fe8c9b8d5f tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:54.175236 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d7e066e3-75de-451a-8d0b-70fe8c9b8d5f tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:54.175684 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d7e066e3-75de-451a-8d0b-70fe8c9b8d5f tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:54.176394 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d7e066e3-75de-451a-8d0b-70fe8c9b8d5f tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:54.176857 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d7e066e3-75de-451a-8d0b-70fe8c9b8d5f tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:54.177295 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d7e066e3-75de-451a-8d0b-70fe8c9b8d5f tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:54.323238 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d7e066e3-75de-451a-8d0b-70fe8c9b8d5f tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d192ed06fc4bc996702c2b97ae9002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdc9ab2fa940aebf524f6dd64f1e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:52:54.332299 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d7e066e3-75de-451a-8d0b-70fe8c9b8d5f tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80" status: 200 len: 1560 microversion: 2.1 time: 0.172865 Sep 10 12:52:54.332890 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3682/7369] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:52:54 2022] GET /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:52:55.357180 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-25c3e0b7-0f9a-4137-848d-74b9cf68ae59 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:52:55.357817 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-25c3e0b7-0f9a-4137-848d-74b9cf68ae59 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: f12a283a-5605-4df8-a569-2880dbfdfb80] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:52:55.364917 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-25c3e0b7-0f9a-4137-848d-74b9cf68ae59 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:55.365413 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-25c3e0b7-0f9a-4137-848d-74b9cf68ae59 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:55.365864 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-25c3e0b7-0f9a-4137-848d-74b9cf68ae59 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:55.366568 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-25c3e0b7-0f9a-4137-848d-74b9cf68ae59 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:55.367041 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-25c3e0b7-0f9a-4137-848d-74b9cf68ae59 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:55.367509 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-25c3e0b7-0f9a-4137-848d-74b9cf68ae59 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:55.497471 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-25c3e0b7-0f9a-4137-848d-74b9cf68ae59 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d192ed06fc4bc996702c2b97ae9002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdc9ab2fa940aebf524f6dd64f1e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:52:55.505910 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-25c3e0b7-0f9a-4137-848d-74b9cf68ae59 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80" status: 200 len: 1560 microversion: 2.1 time: 0.153062 Sep 10 12:52:55.506486 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3688/7370] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:52:55 2022] GET /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:52:56.358844 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-fbc604b6-ed97-4128-be53-927dcb8792ad req-03ee444d-0f0f-4459-8b99-25c4d22886d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f12a283a-5605-4df8-a569-2880dbfdfb80", "name": "network-vif-deleted", "tag": "e718a980-1df7-4e9f-ac1c-db3086e50e90"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:52:56.376282 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-fbc604b6-ed97-4128-be53-927dcb8792ad req-03ee444d-0f0f-4459-8b99-25c4d22886d5 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:56.376758 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-fbc604b6-ed97-4128-be53-927dcb8792ad req-03ee444d-0f0f-4459-8b99-25c4d22886d5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:56.377182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-fbc604b6-ed97-4128-be53-927dcb8792ad req-03ee444d-0f0f-4459-8b99-25c4d22886d5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:56.390467 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-fbc604b6-ed97-4128-be53-927dcb8792ad req-03ee444d-0f0f-4459-8b99-25c4d22886d5 service nova] Creating event network-vif-deleted:e718a980-1df7-4e9f-ac1c-db3086e50e90 for instance f12a283a-5605-4df8-a569-2880dbfdfb80 on n-h1-856895-1 Sep 10 12:52:56.398301 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-fbc604b6-ed97-4128-be53-927dcb8792ad req-03ee444d-0f0f-4459-8b99-25c4d22886d5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046127 Sep 10 12:52:56.402269 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3683/7371] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:52:56.529851 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a64339e1-18ef-480d-a345-82f001fe4a2d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:52:56.531136 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a64339e1-18ef-480d-a345-82f001fe4a2d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: f12a283a-5605-4df8-a569-2880dbfdfb80] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:52:56.538590 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a64339e1-18ef-480d-a345-82f001fe4a2d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:56.539118 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a64339e1-18ef-480d-a345-82f001fe4a2d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:56.539616 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a64339e1-18ef-480d-a345-82f001fe4a2d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:56.540328 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a64339e1-18ef-480d-a345-82f001fe4a2d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:56.540800 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a64339e1-18ef-480d-a345-82f001fe4a2d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:56.541246 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a64339e1-18ef-480d-a345-82f001fe4a2d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:56.579039 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a64339e1-18ef-480d-a345-82f001fe4a2d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:56.579623 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a64339e1-18ef-480d-a345-82f001fe4a2d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:56.580076 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a64339e1-18ef-480d-a345-82f001fe4a2d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:56.580539 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-a64339e1-18ef-480d-a345-82f001fe4a2d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lazy-loading 'fault' on Instance uuid f12a283a-5605-4df8-a569-2880dbfdfb80 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:52:56.623871 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a64339e1-18ef-480d-a345-82f001fe4a2d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d192ed06fc4bc996702c2b97ae9002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debdc9ab2fa940aebf524f6dd64f1e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:52:56.631625 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a64339e1-18ef-480d-a345-82f001fe4a2d tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80" status: 200 len: 1352 microversion: 2.1 time: 0.105742 Sep 10 12:52:56.632205 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3689/7372] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:52:56 2022] GET /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80 => generated 1352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:52:57.657547 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fff2feb2-9ca7-4dff-a87b-193caeb427f5 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:52:57.658402 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fff2feb2-9ca7-4dff-a87b-193caeb427f5 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] [instance: f12a283a-5605-4df8-a569-2880dbfdfb80] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:52:57.664965 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fff2feb2-9ca7-4dff-a87b-193caeb427f5 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:57.665447 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fff2feb2-9ca7-4dff-a87b-193caeb427f5 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:57.665884 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fff2feb2-9ca7-4dff-a87b-193caeb427f5 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:57.666577 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fff2feb2-9ca7-4dff-a87b-193caeb427f5 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:52:57.667033 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fff2feb2-9ca7-4dff-a87b-193caeb427f5 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:52:57.667492 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fff2feb2-9ca7-4dff-a87b-193caeb427f5 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:52:57.681300 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-fff2feb2-9ca7-4dff-a87b-193caeb427f5 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] HTTP exception thrown: Instance f12a283a-5605-4df8-a569-2880dbfdfb80 could not be found. Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fff2feb2-9ca7-4dff-a87b-193caeb427f5 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Request method failure captured: Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80 HTTP/1.1 Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHIg2lA99kXJHZmn3V11jnZckTd_Fv7-dDoFLYj2MtEF6Gmq3wEKwN-EavOSJGtJMLIghL5rxI_wupJV3H0Kww6tqY4XNw_zrC01ZD3QAaMxBIJLY9TatAaSR1jZn7PvVbiK81icNxpoQHLMaHnnfD4wa-LEVjOW-miQEyBguqcQcLcI Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: debdc9ab2fa940aebf524f6dd64f1e4a Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1050941532 Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/debdc9ab2fa940aebf524f6dd64f1e4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/debdc9ab2fa940aebf524f6dd64f1e4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_debdc9ab2fa940aebf524f6dd64f1e4a", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/debdc9ab2fa940aebf524f6dd64f1e4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-TestEncryptedCinderVolumes-1050941532 Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: debdc9ab2fa940aebf524f6dd64f1e4a Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1050941532 Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-TestEncryptedCinderVolumes-1050941532-project Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 87d192ed06fc4bc996702c2b97ae9002 Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-TestEncryptedCinderVolumes-1050941532-project Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance f12a283a-5605-4df8-a569-2880dbfdfb80 could not be found. Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'f12a283a-5605-4df8-a569-2880dbfdfb80'} Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f12a283a-5605-4df8-a569-2880dbfdfb80 could not be found. Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f12a283a-5605-4df8-a569-2880dbfdfb80 could not be found. Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:52:57.682949 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:52:57.687862 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:52:57.687862 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:52:57.687862 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:52:57.687862 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:52:57.687862 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:52:57.687862 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:52:57.687862 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f12a283a-5605-4df8-a569-2880dbfdfb80 could not be found. Sep 10 12:52:57.687862 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 12:52:57.687862 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fff2feb2-9ca7-4dff-a87b-193caeb427f5 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Returning 404 to user: Instance f12a283a-5605-4df8-a569-2880dbfdfb80 could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:52:57.687862 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fff2feb2-9ca7-4dff-a87b-193caeb427f5 tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "GET /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80" status: 404 len: 111 microversion: 2.1 time: 0.032608 Sep 10 12:52:57.687862 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3684/7373] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:52:57 2022] GET /compute/v2.1/servers/f12a283a-5605-4df8-a569-2880dbfdfb80 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:52:57.693176 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-04c45f84-3a7a-4b2e-ac2f-7f40b6ef89df tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] Calling method '.version_select at 0x7f40607331f0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:52:57.712667 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-04c45f84-3a7a-4b2e-ac2f-7f40b6ef89df tempest-TestEncryptedCinderVolumes-1050941532 tempest-TestEncryptedCinderVolumes-1050941532-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-800422210" status: 202 len: 0 microversion: 2.1 time: 0.023170 Sep 10 12:52:57.713219 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3690/7374] 10.222.0.23 () {58 vars in 1275 bytes} [Sat Sep 10 12:52:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-800422210 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:53:24.699796 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-36f1ebc9-91f8-4085-ba80-e8aab655f30d tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Action: 'create', calling method: .version_select at 0x7f4073e15700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2014499474", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK7zWf4U68A+iQ1RCx/mPjbIirnse8Q2umawEjjnWPaqQ8s3s3eLXFINzYBTUsqP5unxvRlhNfdYq5KrljfBRFvzBcrtetlpRtI5E5PZktj0b/6fkkpKbjEr4wY5f34uIQ=="}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:53:24.705276 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=14 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:53:24.705975 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=34 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:53:24.718725 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-36f1ebc9-91f8-4085-ba80-e8aab655f30d tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Getting quotas for project 31812e3dc2ce4af2a2a8c931bb99946a. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:53:24.723962 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-36f1ebc9-91f8-4085-ba80-e8aab655f30d tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Getting quotas for user 6e40e6a5c7eb4760b3f39c382a1bbc28 and project 31812e3dc2ce4af2a2a8c931bb99946a. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:53:24.747743 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-36f1ebc9-91f8-4085-ba80-e8aab655f30d tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.052178 Sep 10 12:53:24.748421 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3685/7375] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 12:53:24 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:53:24.797396 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:53:24.798651 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:53:24.803016 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-95c364ae-cb60-4da1-ac2a-29093f1864af tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1056647262", "imageRef": "ba981ff4-2bf8-4f89-a4cc-e395157b412b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2014499474", "networks": [{"uuid": "fc442826-1799-4b76-a9e7-0282220cf1fb"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:53:24.858589 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-95c364ae-cb60-4da1-ac2a-29093f1864af tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] validate_networks() for [('fc442826-1799-4b76-a9e7-0282220cf1fb', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:53:25.241690 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-95c364ae-cb60-4da1-ac2a-29093f1864af tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:53:25.242127 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-95c364ae-cb60-4da1-ac2a-29093f1864af tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:53:25.242638 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-95c364ae-cb60-4da1-ac2a-29093f1864af tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:53:25.243060 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-95c364ae-cb60-4da1-ac2a-29093f1864af tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:53:25.243508 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-95c364ae-cb60-4da1-ac2a-29093f1864af tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:53:25.252690 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-95c364ae-cb60-4da1-ac2a-29093f1864af tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:25.253179 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-95c364ae-cb60-4da1-ac2a-29093f1864af tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:25.253626 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-95c364ae-cb60-4da1-ac2a-29093f1864af tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:25.254368 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-95c364ae-cb60-4da1-ac2a-29093f1864af tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:25.254819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-95c364ae-cb60-4da1-ac2a-29093f1864af tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:25.255288 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-95c364ae-cb60-4da1-ac2a-29093f1864af tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:25.271500 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-95c364ae-cb60-4da1-ac2a-29093f1864af tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Getting quotas for project 31812e3dc2ce4af2a2a8c931bb99946a. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:53:25.276632 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-95c364ae-cb60-4da1-ac2a-29093f1864af tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Getting quotas for user 6e40e6a5c7eb4760b3f39c382a1bbc28 and project 31812e3dc2ce4af2a2a8c931bb99946a. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:53:25.289135 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-95c364ae-cb60-4da1-ac2a-29093f1864af tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:53:25.291386 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-95c364ae-cb60-4da1-ac2a-29093f1864af tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ba981ff4-2bf8-4f89-a4cc-e395157b412b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:53:25.334519 n-d-856895-1 devstack@n-api.service[128776]: ERROR oslo.messaging._drivers.impl_rabbit [None req-95c364ae-cb60-4da1-ac2a-29093f1864af tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [3546e893-383c-408c-b52a-b9224010d84e] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 10 12:53:26.343506 n-d-856895-1 devstack@n-api.service[128776]: INFO oslo.messaging._drivers.impl_rabbit [None req-95c364ae-cb60-4da1-ac2a-29093f1864af tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [3546e893-383c-408c-b52a-b9224010d84e] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 36394. Sep 10 12:53:26.348201 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-95c364ae-cb60-4da1-ac2a-29093f1864af tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.553634 Sep 10 12:53:26.355494 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3691/7376] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:53:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:53:26.361732 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-11ff9d4a-30e0-46ea-8d89-43c90723e921 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:53:26.362391 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-11ff9d4a-30e0-46ea-8d89-43c90723e921 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:53:26.430897 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-11ff9d4a-30e0-46ea-8d89-43c90723e921 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:53:26.441475 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-11ff9d4a-30e0-46ea-8d89-43c90723e921 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57" status: 200 len: 1259 microversion: 2.1 time: 0.084775 Sep 10 12:53:26.442174 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3686/7377] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:53:26 2022] GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 => generated 1259 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:53:27.467925 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e6a01be8-23ec-45ca-abf8-384d9325f924 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:53:27.470237 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e6a01be8-23ec-45ca-abf8-384d9325f924 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:53:27.475936 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6a01be8-23ec-45ca-abf8-384d9325f924 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:27.476435 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6a01be8-23ec-45ca-abf8-384d9325f924 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:27.476879 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6a01be8-23ec-45ca-abf8-384d9325f924 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:27.477579 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6a01be8-23ec-45ca-abf8-384d9325f924 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:27.478046 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6a01be8-23ec-45ca-abf8-384d9325f924 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:27.478485 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e6a01be8-23ec-45ca-abf8-384d9325f924 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:27.554587 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e6a01be8-23ec-45ca-abf8-384d9325f924 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:53:27.562927 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e6a01be8-23ec-45ca-abf8-384d9325f924 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57" status: 200 len: 1319 microversion: 2.1 time: 0.100425 Sep 10 12:53:27.563615 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3692/7378] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:53:27 2022] GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 => generated 1319 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:53:28.587514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9920776a-cd8f-40e7-a9d7-416b30b3e19d tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:53:28.588151 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9920776a-cd8f-40e7-a9d7-416b30b3e19d tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:53:28.595478 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9920776a-cd8f-40e7-a9d7-416b30b3e19d tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:28.595977 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9920776a-cd8f-40e7-a9d7-416b30b3e19d tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:28.596430 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9920776a-cd8f-40e7-a9d7-416b30b3e19d tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:28.597147 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9920776a-cd8f-40e7-a9d7-416b30b3e19d tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:28.597612 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9920776a-cd8f-40e7-a9d7-416b30b3e19d tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:28.598051 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9920776a-cd8f-40e7-a9d7-416b30b3e19d tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:28.756499 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9920776a-cd8f-40e7-a9d7-416b30b3e19d tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:53:28.765052 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9920776a-cd8f-40e7-a9d7-416b30b3e19d tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57" status: 200 len: 1359 microversion: 2.1 time: 0.181576 Sep 10 12:53:28.765646 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3687/7379] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:53:28 2022] GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:53:29.789112 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0ca8c89d-aed0-4392-acc3-303a8859aae5 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:53:29.790025 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0ca8c89d-aed0-4392-acc3-303a8859aae5 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:53:29.798316 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ca8c89d-aed0-4392-acc3-303a8859aae5 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:29.798817 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ca8c89d-aed0-4392-acc3-303a8859aae5 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:29.799300 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ca8c89d-aed0-4392-acc3-303a8859aae5 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:29.800014 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ca8c89d-aed0-4392-acc3-303a8859aae5 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:29.800476 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ca8c89d-aed0-4392-acc3-303a8859aae5 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:29.801199 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0ca8c89d-aed0-4392-acc3-303a8859aae5 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:29.941296 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0ca8c89d-aed0-4392-acc3-303a8859aae5 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:53:29.952919 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0ca8c89d-aed0-4392-acc3-303a8859aae5 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57" status: 200 len: 1359 microversion: 2.1 time: 0.167151 Sep 10 12:53:29.972103 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3693/7380] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:53:29 2022] GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:53:30.979548 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fadbebdd-74f1-485b-bd97-47df73f6715f tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:53:30.980212 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fadbebdd-74f1-485b-bd97-47df73f6715f tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:53:30.987439 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fadbebdd-74f1-485b-bd97-47df73f6715f tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:30.988271 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fadbebdd-74f1-485b-bd97-47df73f6715f tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:30.989145 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fadbebdd-74f1-485b-bd97-47df73f6715f tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:30.990170 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fadbebdd-74f1-485b-bd97-47df73f6715f tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:30.990842 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fadbebdd-74f1-485b-bd97-47df73f6715f tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:30.991503 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fadbebdd-74f1-485b-bd97-47df73f6715f tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:31.130773 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fadbebdd-74f1-485b-bd97-47df73f6715f tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:53:31.141244 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fadbebdd-74f1-485b-bd97-47df73f6715f tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57" status: 200 len: 1359 microversion: 2.1 time: 0.165472 Sep 10 12:53:31.153760 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3688/7381] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:53:30 2022] GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:53:32.166008 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-41ed0bdc-8962-4499-9d57-3246d58c64f0 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:53:32.166711 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-41ed0bdc-8962-4499-9d57-3246d58c64f0 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:53:32.173761 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41ed0bdc-8962-4499-9d57-3246d58c64f0 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:32.174268 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41ed0bdc-8962-4499-9d57-3246d58c64f0 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:32.174725 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41ed0bdc-8962-4499-9d57-3246d58c64f0 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:32.175474 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41ed0bdc-8962-4499-9d57-3246d58c64f0 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:32.175948 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41ed0bdc-8962-4499-9d57-3246d58c64f0 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:32.176397 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41ed0bdc-8962-4499-9d57-3246d58c64f0 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:32.319533 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-41ed0bdc-8962-4499-9d57-3246d58c64f0 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:53:32.331701 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-41ed0bdc-8962-4499-9d57-3246d58c64f0 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57" status: 200 len: 1359 microversion: 2.1 time: 0.169491 Sep 10 12:53:32.332299 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3694/7382] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:53:32 2022] GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:53:33.357574 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fbb961fb-6415-4bf5-9e1e-13f8aba2113b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:53:33.358347 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fbb961fb-6415-4bf5-9e1e-13f8aba2113b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:53:33.365444 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fbb961fb-6415-4bf5-9e1e-13f8aba2113b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:33.365926 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fbb961fb-6415-4bf5-9e1e-13f8aba2113b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:33.366373 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fbb961fb-6415-4bf5-9e1e-13f8aba2113b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:33.367089 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fbb961fb-6415-4bf5-9e1e-13f8aba2113b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:33.367582 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fbb961fb-6415-4bf5-9e1e-13f8aba2113b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:33.368056 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fbb961fb-6415-4bf5-9e1e-13f8aba2113b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:33.511679 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fbb961fb-6415-4bf5-9e1e-13f8aba2113b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:53:33.520598 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fbb961fb-6415-4bf5-9e1e-13f8aba2113b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57" status: 200 len: 1359 microversion: 2.1 time: 0.167658 Sep 10 12:53:33.528534 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3689/7383] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:53:33 2022] GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:53:34.545674 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4671e396-e5f4-40c0-813e-8d9eb31e4cc6 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:53:34.546374 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4671e396-e5f4-40c0-813e-8d9eb31e4cc6 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:53:34.553707 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4671e396-e5f4-40c0-813e-8d9eb31e4cc6 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:34.554213 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4671e396-e5f4-40c0-813e-8d9eb31e4cc6 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:34.554671 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4671e396-e5f4-40c0-813e-8d9eb31e4cc6 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:34.555423 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4671e396-e5f4-40c0-813e-8d9eb31e4cc6 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:34.555893 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4671e396-e5f4-40c0-813e-8d9eb31e4cc6 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:34.556336 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4671e396-e5f4-40c0-813e-8d9eb31e4cc6 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:34.698071 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4671e396-e5f4-40c0-813e-8d9eb31e4cc6 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:53:34.708411 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4671e396-e5f4-40c0-813e-8d9eb31e4cc6 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57" status: 200 len: 1359 microversion: 2.1 time: 0.167120 Sep 10 12:53:34.712628 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3695/7384] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:53:34 2022] GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:53:35.732603 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-88ff1d22-b135-4a36-9b3d-c395c7b32991 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:53:35.733773 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-88ff1d22-b135-4a36-9b3d-c395c7b32991 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:53:35.741573 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-88ff1d22-b135-4a36-9b3d-c395c7b32991 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:35.742058 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-88ff1d22-b135-4a36-9b3d-c395c7b32991 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:35.742492 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-88ff1d22-b135-4a36-9b3d-c395c7b32991 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:35.743205 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-88ff1d22-b135-4a36-9b3d-c395c7b32991 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:35.743662 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-88ff1d22-b135-4a36-9b3d-c395c7b32991 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:35.744088 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-88ff1d22-b135-4a36-9b3d-c395c7b32991 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:35.880788 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-88ff1d22-b135-4a36-9b3d-c395c7b32991 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:53:35.888471 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-88ff1d22-b135-4a36-9b3d-c395c7b32991 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57" status: 200 len: 1359 microversion: 2.1 time: 0.160359 Sep 10 12:53:35.889085 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3690/7385] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:53:35 2022] GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:53:36.911497 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8379cce9-c2c2-4752-9c69-102302c1d470 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:53:36.912130 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8379cce9-c2c2-4752-9c69-102302c1d470 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:53:36.914027 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:53:36.914702 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:53:36.921717 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8379cce9-c2c2-4752-9c69-102302c1d470 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:36.922216 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8379cce9-c2c2-4752-9c69-102302c1d470 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:36.922675 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8379cce9-c2c2-4752-9c69-102302c1d470 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:36.923405 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8379cce9-c2c2-4752-9c69-102302c1d470 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:36.923876 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8379cce9-c2c2-4752-9c69-102302c1d470 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:36.924318 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8379cce9-c2c2-4752-9c69-102302c1d470 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:37.058839 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8379cce9-c2c2-4752-9c69-102302c1d470 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:53:37.067315 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8379cce9-c2c2-4752-9c69-102302c1d470 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57" status: 200 len: 1359 microversion: 2.1 time: 0.159734 Sep 10 12:53:37.067904 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3696/7386] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:53:36 2022] GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:53:38.090612 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d6718aaa-bfe4-43af-b81d-20fe3697b3ef tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:53:38.091273 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d6718aaa-bfe4-43af-b81d-20fe3697b3ef tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:53:38.093812 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:53:38.100080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d6718aaa-bfe4-43af-b81d-20fe3697b3ef tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:38.100572 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d6718aaa-bfe4-43af-b81d-20fe3697b3ef tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:38.101015 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d6718aaa-bfe4-43af-b81d-20fe3697b3ef tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:38.101716 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d6718aaa-bfe4-43af-b81d-20fe3697b3ef tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:38.102182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d6718aaa-bfe4-43af-b81d-20fe3697b3ef tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:38.102603 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d6718aaa-bfe4-43af-b81d-20fe3697b3ef tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:38.375775 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d6718aaa-bfe4-43af-b81d-20fe3697b3ef tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:53:38.383586 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d6718aaa-bfe4-43af-b81d-20fe3697b3ef tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57" status: 200 len: 1359 microversion: 2.1 time: 0.296865 Sep 10 12:53:38.384158 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3691/7387] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:53:38 2022] GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 => generated 1359 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:53:38.785270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-97666601-b754-445f-b76a-5ef64d603153 req-a26e2ca6-04a0-4c81-ae15-64bdac958ed4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57", "tag": "5dce328f-1831-4128-b24a-ac5d9aa79259"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:53:38.797169 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-97666601-b754-445f-b76a-5ef64d603153 req-a26e2ca6-04a0-4c81-ae15-64bdac958ed4 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:38.797657 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-97666601-b754-445f-b76a-5ef64d603153 req-a26e2ca6-04a0-4c81-ae15-64bdac958ed4 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:38.798102 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-97666601-b754-445f-b76a-5ef64d603153 req-a26e2ca6-04a0-4c81-ae15-64bdac958ed4 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:38.809594 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-97666601-b754-445f-b76a-5ef64d603153 req-a26e2ca6-04a0-4c81-ae15-64bdac958ed4 service nova] Creating event network-changed:5dce328f-1831-4128-b24a-ac5d9aa79259 for instance cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 on n-h1-856895-1 Sep 10 12:53:38.815352 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-97666601-b754-445f-b76a-5ef64d603153 req-a26e2ca6-04a0-4c81-ae15-64bdac958ed4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033481 Sep 10 12:53:38.816184 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3697/7388] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:53:39.407840 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1c9715d5-af02-401d-9f95-8dfa130977c1 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:53:39.408447 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1c9715d5-af02-401d-9f95-8dfa130977c1 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:53:39.415295 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c9715d5-af02-401d-9f95-8dfa130977c1 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:39.415783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c9715d5-af02-401d-9f95-8dfa130977c1 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:39.416224 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c9715d5-af02-401d-9f95-8dfa130977c1 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:39.416926 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c9715d5-af02-401d-9f95-8dfa130977c1 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:39.417386 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c9715d5-af02-401d-9f95-8dfa130977c1 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:39.417815 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c9715d5-af02-401d-9f95-8dfa130977c1 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:39.553525 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1c9715d5-af02-401d-9f95-8dfa130977c1 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:53:39.561277 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1c9715d5-af02-401d-9f95-8dfa130977c1 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57" status: 200 len: 1359 microversion: 2.1 time: 0.157976 Sep 10 12:53:39.561865 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3692/7389] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:53:39 2022] GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:53:40.586228 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c46c243e-bd39-4eba-a6e1-f3a27e8129c0 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:53:40.586864 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c46c243e-bd39-4eba-a6e1-f3a27e8129c0 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:53:40.593377 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c46c243e-bd39-4eba-a6e1-f3a27e8129c0 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:40.593873 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c46c243e-bd39-4eba-a6e1-f3a27e8129c0 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:40.594325 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c46c243e-bd39-4eba-a6e1-f3a27e8129c0 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:40.595029 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c46c243e-bd39-4eba-a6e1-f3a27e8129c0 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:40.595534 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c46c243e-bd39-4eba-a6e1-f3a27e8129c0 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:40.595980 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c46c243e-bd39-4eba-a6e1-f3a27e8129c0 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:40.723690 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c46c243e-bd39-4eba-a6e1-f3a27e8129c0 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:53:40.731702 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c46c243e-bd39-4eba-a6e1-f3a27e8129c0 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57" status: 200 len: 1359 microversion: 2.1 time: 0.150720 Sep 10 12:53:40.732812 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3698/7390] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:53:40 2022] GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:53:41.756020 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-87c8fef6-5c77-4d41-b499-2ac1f6114930 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:53:41.756636 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-87c8fef6-5c77-4d41-b499-2ac1f6114930 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:53:41.765060 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87c8fef6-5c77-4d41-b499-2ac1f6114930 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:41.765547 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87c8fef6-5c77-4d41-b499-2ac1f6114930 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:41.765983 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87c8fef6-5c77-4d41-b499-2ac1f6114930 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:41.766682 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87c8fef6-5c77-4d41-b499-2ac1f6114930 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:41.767139 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87c8fef6-5c77-4d41-b499-2ac1f6114930 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:41.767589 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87c8fef6-5c77-4d41-b499-2ac1f6114930 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:41.928598 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-87c8fef6-5c77-4d41-b499-2ac1f6114930 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:53:41.938118 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-87c8fef6-5c77-4d41-b499-2ac1f6114930 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57" status: 200 len: 1359 microversion: 2.1 time: 0.186094 Sep 10 12:53:41.938713 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3693/7391] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:53:41 2022] GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:53:42.962102 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-59209fbf-a815-4450-8a9f-ad3ec9bb28c0 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:53:42.962659 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-59209fbf-a815-4450-8a9f-ad3ec9bb28c0 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:53:42.970168 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-59209fbf-a815-4450-8a9f-ad3ec9bb28c0 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:42.970671 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-59209fbf-a815-4450-8a9f-ad3ec9bb28c0 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:42.971122 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-59209fbf-a815-4450-8a9f-ad3ec9bb28c0 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:42.971849 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-59209fbf-a815-4450-8a9f-ad3ec9bb28c0 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:42.972321 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-59209fbf-a815-4450-8a9f-ad3ec9bb28c0 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:42.972766 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-59209fbf-a815-4450-8a9f-ad3ec9bb28c0 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:43.102677 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-59209fbf-a815-4450-8a9f-ad3ec9bb28c0 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:53:43.110558 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-59209fbf-a815-4450-8a9f-ad3ec9bb28c0 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57" status: 200 len: 1359 microversion: 2.1 time: 0.152550 Sep 10 12:53:43.111137 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3699/7392] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:53:42 2022] GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:53:44.133974 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1d452297-53fc-47e0-b792-5a68de3d3802 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:53:44.134661 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1d452297-53fc-47e0-b792-5a68de3d3802 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:53:44.142063 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d452297-53fc-47e0-b792-5a68de3d3802 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:44.142547 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d452297-53fc-47e0-b792-5a68de3d3802 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:44.142981 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d452297-53fc-47e0-b792-5a68de3d3802 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:44.143713 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d452297-53fc-47e0-b792-5a68de3d3802 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:44.144175 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d452297-53fc-47e0-b792-5a68de3d3802 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:44.144622 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1d452297-53fc-47e0-b792-5a68de3d3802 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:44.280147 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-eb79b9eb-4e05-4641-b064-90f7ebbbb3bf req-c77e2898-1323-48ca-98bc-965fbb56bebf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57", "name": "network-vif-plugged", "status": "completed", "tag": "5dce328f-1831-4128-b24a-ac5d9aa79259"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:53:44.290054 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1d452297-53fc-47e0-b792-5a68de3d3802 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:53:44.298111 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-eb79b9eb-4e05-4641-b064-90f7ebbbb3bf req-c77e2898-1323-48ca-98bc-965fbb56bebf service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:44.298610 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-eb79b9eb-4e05-4641-b064-90f7ebbbb3bf req-c77e2898-1323-48ca-98bc-965fbb56bebf service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:44.299070 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-eb79b9eb-4e05-4641-b064-90f7ebbbb3bf req-c77e2898-1323-48ca-98bc-965fbb56bebf service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:44.299293 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1d452297-53fc-47e0-b792-5a68de3d3802 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57" status: 200 len: 1359 microversion: 2.1 time: 0.168957 Sep 10 12:53:44.300018 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3694/7393] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:53:44 2022] GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:53:44.317215 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-eb79b9eb-4e05-4641-b064-90f7ebbbb3bf req-c77e2898-1323-48ca-98bc-965fbb56bebf service nova] Creating event network-vif-plugged:5dce328f-1831-4128-b24a-ac5d9aa79259 for instance cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 on n-h1-856895-1 Sep 10 12:53:44.322351 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-eb79b9eb-4e05-4641-b064-90f7ebbbb3bf req-c77e2898-1323-48ca-98bc-965fbb56bebf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047226 Sep 10 12:53:44.322966 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3700/7394] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:53:45.324270 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-12beb12f-8f78-4a0d-b783-cb2c630b7f01 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:53:45.330900 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-12beb12f-8f78-4a0d-b783-cb2c630b7f01 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:53:45.332896 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-12beb12f-8f78-4a0d-b783-cb2c630b7f01 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:45.333393 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-12beb12f-8f78-4a0d-b783-cb2c630b7f01 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:45.333894 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-12beb12f-8f78-4a0d-b783-cb2c630b7f01 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:45.334604 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-12beb12f-8f78-4a0d-b783-cb2c630b7f01 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:45.335075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-12beb12f-8f78-4a0d-b783-cb2c630b7f01 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:45.335539 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-12beb12f-8f78-4a0d-b783-cb2c630b7f01 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:45.468666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-12beb12f-8f78-4a0d-b783-cb2c630b7f01 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:53:45.476410 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-12beb12f-8f78-4a0d-b783-cb2c630b7f01 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57" status: 200 len: 1359 microversion: 2.1 time: 0.156275 Sep 10 12:53:45.477020 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3695/7395] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:53:45 2022] GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:53:46.501754 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7a856a17-8953-40e2-bf6a-79723b115612 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:53:46.502404 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7a856a17-8953-40e2-bf6a-79723b115612 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:53:46.508761 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a856a17-8953-40e2-bf6a-79723b115612 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:46.509259 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a856a17-8953-40e2-bf6a-79723b115612 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:46.509710 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a856a17-8953-40e2-bf6a-79723b115612 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:46.510412 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a856a17-8953-40e2-bf6a-79723b115612 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:46.510885 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a856a17-8953-40e2-bf6a-79723b115612 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:46.511358 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7a856a17-8953-40e2-bf6a-79723b115612 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:46.642327 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7a856a17-8953-40e2-bf6a-79723b115612 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:53:46.650053 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7a856a17-8953-40e2-bf6a-79723b115612 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57" status: 200 len: 1549 microversion: 2.1 time: 0.153932 Sep 10 12:53:46.650615 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3701/7396] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:53:46 2022] GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:53:46.672660 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-22670a15-639a-47da-a4bb-d274a6f71789 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:53:46.673282 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-22670a15-639a-47da-a4bb-d274a6f71789 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:53:46.680339 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-22670a15-639a-47da-a4bb-d274a6f71789 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:46.680826 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-22670a15-639a-47da-a4bb-d274a6f71789 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:46.681270 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-22670a15-639a-47da-a4bb-d274a6f71789 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:46.681964 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-22670a15-639a-47da-a4bb-d274a6f71789 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:46.682422 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-22670a15-639a-47da-a4bb-d274a6f71789 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:46.682849 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-22670a15-639a-47da-a4bb-d274a6f71789 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:46.815132 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-22670a15-639a-47da-a4bb-d274a6f71789 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:53:46.822847 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-22670a15-639a-47da-a4bb-d274a6f71789 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57" status: 200 len: 1549 microversion: 2.1 time: 0.154210 Sep 10 12:53:46.823455 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3696/7397] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:53:46 2022] GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:53:46.846027 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fb96ea73-4bca-4567-ae39-17cdfdea2c2b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:53:46.850665 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fb96ea73-4bca-4567-ae39-17cdfdea2c2b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:53:46.851450 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fb96ea73-4bca-4567-ae39-17cdfdea2c2b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Searching by: {'deleted': False, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a'} {{(pid=128776) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 12:53:46.856718 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fb96ea73-4bca-4567-ae39-17cdfdea2c2b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:46.857253 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fb96ea73-4bca-4567-ae39-17cdfdea2c2b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:46.857741 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fb96ea73-4bca-4567-ae39-17cdfdea2c2b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:46.858476 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fb96ea73-4bca-4567-ae39-17cdfdea2c2b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:46.858935 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fb96ea73-4bca-4567-ae39-17cdfdea2c2b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:46.859405 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fb96ea73-4bca-4567-ae39-17cdfdea2c2b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:46.882361 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.multi_cell_list [None req-fb96ea73-4bca-4567-ae39-17cdfdea2c2b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128776) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 12:53:46.908889 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fb96ea73-4bca-4567-ae39-17cdfdea2c2b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.066631 Sep 10 12:53:46.909460 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3702/7398] 10.222.0.23 () {58 vars in 1125 bytes} [Sat Sep 10 12:53:46 2022] GET /compute/v2.1/servers => generated 343 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:53:46.921043 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-24740e28-c7af-43e0-8f46-ad01420fe463 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:53:46.921672 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-24740e28-c7af-43e0-8f46-ad01420fe463 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:53:46.927657 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-24740e28-c7af-43e0-8f46-ad01420fe463 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:46.928141 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-24740e28-c7af-43e0-8f46-ad01420fe463 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:46.928581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-24740e28-c7af-43e0-8f46-ad01420fe463 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:46.929273 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-24740e28-c7af-43e0-8f46-ad01420fe463 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:46.929727 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-24740e28-c7af-43e0-8f46-ad01420fe463 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:46.930155 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-24740e28-c7af-43e0-8f46-ad01420fe463 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:47.062430 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-24740e28-c7af-43e0-8f46-ad01420fe463 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:53:47.070293 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-24740e28-c7af-43e0-8f46-ad01420fe463 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57" status: 200 len: 1549 microversion: 2.1 time: 0.153266 Sep 10 12:53:47.070875 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3697/7399] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:53:46 2022] GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:53:48.627171 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0a76284b-1ca3-44f5-8540-b0b62bdc2678 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ec4e3a0-c440-4f07-9380-35f3240fa89e"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:53:48.629546 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0a76284b-1ca3-44f5-8540-b0b62bdc2678 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:53:48.636449 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0a76284b-1ca3-44f5-8540-b0b62bdc2678 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:48.636949 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0a76284b-1ca3-44f5-8540-b0b62bdc2678 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:48.637404 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0a76284b-1ca3-44f5-8540-b0b62bdc2678 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:48.638252 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0a76284b-1ca3-44f5-8540-b0b62bdc2678 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:53:48.638731 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0a76284b-1ca3-44f5-8540-b0b62bdc2678 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:53:48.639190 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0a76284b-1ca3-44f5-8540-b0b62bdc2678 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:53:48.909454 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0a76284b-1ca3-44f5-8540-b0b62bdc2678 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "POST /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285715 Sep 10 12:53:48.910302 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3703/7400] 10.222.0.23 () {60 vars in 1323 bytes} [Sat Sep 10 12:53:48 2022] POST /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:54:01.954736 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4e97d5c7-a4e9-4949-a8c4-deaa5d1a6f1e tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:54:01.955416 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4e97d5c7-a4e9-4949-a8c4-deaa5d1a6f1e tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:54:01.957643 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:54:01.958416 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=66 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:54:01.964924 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e97d5c7-a4e9-4949-a8c4-deaa5d1a6f1e tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:54:01.965419 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e97d5c7-a4e9-4949-a8c4-deaa5d1a6f1e tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:54:01.966357 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e97d5c7-a4e9-4949-a8c4-deaa5d1a6f1e tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:54:01.967077 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e97d5c7-a4e9-4949-a8c4-deaa5d1a6f1e tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:54:01.967569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e97d5c7-a4e9-4949-a8c4-deaa5d1a6f1e tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:54:01.968005 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e97d5c7-a4e9-4949-a8c4-deaa5d1a6f1e tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:54:02.097837 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4e97d5c7-a4e9-4949-a8c4-deaa5d1a6f1e tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:54:02.106107 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4e97d5c7-a4e9-4949-a8c4-deaa5d1a6f1e tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57" status: 200 len: 1595 microversion: 2.1 time: 0.156429 Sep 10 12:54:02.107437 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3698/7401] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:54:01 2022] GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 => generated 1595 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:54:03.815701 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:54:03.817012 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:54:03.817603 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:54:03.966105 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-79ab4589-7c5b-4271-a9f2-b643604a1adc req-6d300c77-356e-43b5-bef6-954d632f7147 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57", "tag": "5dce328f-1831-4128-b24a-ac5d9aa79259"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:54:03.991449 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-79ab4589-7c5b-4271-a9f2-b643604a1adc req-6d300c77-356e-43b5-bef6-954d632f7147 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:54:03.992162 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-79ab4589-7c5b-4271-a9f2-b643604a1adc req-6d300c77-356e-43b5-bef6-954d632f7147 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:54:03.992709 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-79ab4589-7c5b-4271-a9f2-b643604a1adc req-6d300c77-356e-43b5-bef6-954d632f7147 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:54:04.006065 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-79ab4589-7c5b-4271-a9f2-b643604a1adc req-6d300c77-356e-43b5-bef6-954d632f7147 service nova] Creating event network-changed:5dce328f-1831-4128-b24a-ac5d9aa79259 for instance cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 on n-h1-856895-1 Sep 10 12:54:04.011535 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-79ab4589-7c5b-4271-a9f2-b643604a1adc req-6d300c77-356e-43b5-bef6-954d632f7147 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.205086 Sep 10 12:54:04.012600 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3704/7402] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:54:05.021109 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2bd0dc18-3e5b-4b59-a528-f30b3078b921 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-474041464"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:54:05.021660 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2bd0dc18-3e5b-4b59-a528-f30b3078b921 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:54:05.029040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2bd0dc18-3e5b-4b59-a528-f30b3078b921 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:54:05.029528 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2bd0dc18-3e5b-4b59-a528-f30b3078b921 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:54:05.029966 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2bd0dc18-3e5b-4b59-a528-f30b3078b921 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:54:05.030665 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2bd0dc18-3e5b-4b59-a528-f30b3078b921 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:54:05.031123 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2bd0dc18-3e5b-4b59-a528-f30b3078b921 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:54:05.031578 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2bd0dc18-3e5b-4b59-a528-f30b3078b921 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:54:05.163293 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.network.security_group_api [None req-2bd0dc18-3e5b-4b59-a528-f30b3078b921 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Adding security group 87af6468-04e1-4875-bc93-180c30ecbe8a to port 5dce328f-1831-4128-b24a-ac5d9aa79259 Sep 10 12:54:05.484399 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2bd0dc18-3e5b-4b59-a528-f30b3078b921 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "POST /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57/action" status: 202 len: 0 microversion: 2.1 time: 0.467234 Sep 10 12:54:05.485110 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3699/7403] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:54:05 2022] POST /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57/action => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:54:05.493742 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-366f3e7a-4f94-4577-9a2d-1c75df670032 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:54:05.494634 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-366f3e7a-4f94-4577-9a2d-1c75df670032 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:54:05.496111 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-9c2e5073-9197-46f1-ac6f-7f953b2b77fb req-f1cc3af9-4758-414c-a25d-67e331f04ffd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57", "tag": "5dce328f-1831-4128-b24a-ac5d9aa79259"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:54:05.506595 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-366f3e7a-4f94-4577-9a2d-1c75df670032 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:54:05.507115 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-366f3e7a-4f94-4577-9a2d-1c75df670032 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:54:05.507602 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-366f3e7a-4f94-4577-9a2d-1c75df670032 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:54:05.508323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-366f3e7a-4f94-4577-9a2d-1c75df670032 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:54:05.508786 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-366f3e7a-4f94-4577-9a2d-1c75df670032 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:54:05.509422 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-366f3e7a-4f94-4577-9a2d-1c75df670032 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:54:05.511456 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-9c2e5073-9197-46f1-ac6f-7f953b2b77fb req-f1cc3af9-4758-414c-a25d-67e331f04ffd service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:54:05.511967 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-9c2e5073-9197-46f1-ac6f-7f953b2b77fb req-f1cc3af9-4758-414c-a25d-67e331f04ffd service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:54:05.512409 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-9c2e5073-9197-46f1-ac6f-7f953b2b77fb req-f1cc3af9-4758-414c-a25d-67e331f04ffd service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:54:05.535682 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-9c2e5073-9197-46f1-ac6f-7f953b2b77fb req-f1cc3af9-4758-414c-a25d-67e331f04ffd service nova] Creating event network-changed:5dce328f-1831-4128-b24a-ac5d9aa79259 for instance cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 on n-h1-856895-1 Sep 10 12:54:05.545712 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-9c2e5073-9197-46f1-ac6f-7f953b2b77fb req-f1cc3af9-4758-414c-a25d-67e331f04ffd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053218 Sep 10 12:54:05.546332 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3700/7404] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:54:05.776225 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-366f3e7a-4f94-4577-9a2d-1c75df670032 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:54:05.785547 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-366f3e7a-4f94-4577-9a2d-1c75df670032 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57" status: 200 len: 1760 microversion: 2.1 time: 0.295938 Sep 10 12:54:05.793810 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3705/7405] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:54:05 2022] GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 => generated 1760 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:56:17.334026 n-d-856895-1 devstack@n-api.service[128777]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9df9aef1-f60c-4e89-81ef-a70ffef5e10e] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 10 12:56:17.334833 n-d-856895-1 devstack@n-api.service[128777]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ff629e48-f4d3-4091-a343-d4a4670d06d6] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 10 12:56:17.335411 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:56:17.336466 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=12 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:56:17.337228 n-d-856895-1 devstack@n-api.service[128777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 12:56:17.337381 n-d-856895-1 devstack@n-api.service[128777]: Sat Sep 10 12:56:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57/action (ip 10.222.0.23) !!! Sep 10 12:56:17.339527 n-d-856895-1 devstack@n-api.service[128777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 12:56:17.339647 n-d-856895-1 devstack@n-api.service[128777]: Sat Sep 10 12:56:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57/action (ip 10.222.0.23) !!! Sep 10 12:56:17.348580 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7c86c68d-05f9-47de-a6eb-e5e0b32f232a tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:56:17.350851 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7c86c68d-05f9-47de-a6eb-e5e0b32f232a tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:56:17.364382 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c86c68d-05f9-47de-a6eb-e5e0b32f232a tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:56:17.364867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c86c68d-05f9-47de-a6eb-e5e0b32f232a tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:56:17.365303 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c86c68d-05f9-47de-a6eb-e5e0b32f232a tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:56:17.365997 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c86c68d-05f9-47de-a6eb-e5e0b32f232a tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:56:17.366452 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c86c68d-05f9-47de-a6eb-e5e0b32f232a tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:56:17.367523 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c86c68d-05f9-47de-a6eb-e5e0b32f232a tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:56:17.438574 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7c86c68d-05f9-47de-a6eb-e5e0b32f232a tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "POST /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57/action" status: 202 len: 0 microversion: 2.1 time: 0.105996 Sep 10 12:56:17.439185 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3701/7406] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:56:17 2022] POST /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:56:17.445467 n-d-856895-1 devstack@n-api.service[128776]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8e1e649-5477-464a-a830-120923e99a14] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 10 12:56:17.446642 n-d-856895-1 devstack@n-api.service[128776]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f7df2fea-8ccb-440d-aacb-6daa54c00e88] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 10 12:56:17.447133 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=4 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:56:17.448026 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=8 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:56:17.448852 n-d-856895-1 devstack@n-api.service[128776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 10 12:56:17.448997 n-d-856895-1 devstack@n-api.service[128776]: Sat Sep 10 12:56:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 (ip 10.222.0.23) !!! Sep 10 12:56:17.450595 n-d-856895-1 devstack@n-api.service[128776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 10 12:56:17.451517 n-d-856895-1 devstack@n-api.service[128776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 12:56:17.451656 n-d-856895-1 devstack@n-api.service[128776]: Sat Sep 10 12:56:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 (ip 10.222.0.23) !!! Sep 10 12:56:17.456358 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ccabba07-0795-4fa3-835c-f17a210b4198 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:56:17.456993 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ccabba07-0795-4fa3-835c-f17a210b4198 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:56:17.467906 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ccabba07-0795-4fa3-835c-f17a210b4198 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:56:17.468401 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ccabba07-0795-4fa3-835c-f17a210b4198 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:56:17.468849 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ccabba07-0795-4fa3-835c-f17a210b4198 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:56:17.469554 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ccabba07-0795-4fa3-835c-f17a210b4198 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:56:17.470022 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ccabba07-0795-4fa3-835c-f17a210b4198 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:56:17.470460 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ccabba07-0795-4fa3-835c-f17a210b4198 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:56:17.708131 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ccabba07-0795-4fa3-835c-f17a210b4198 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:56:17.716536 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ccabba07-0795-4fa3-835c-f17a210b4198 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57" status: 200 len: 1762 microversion: 2.1 time: 0.273145 Sep 10 12:56:17.717118 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3706/7407] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:56:17 2022] GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 => generated 1762 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:56:18.744257 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a5712b2f-6a30-40d3-9a43-ad375accdbf2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:56:18.744972 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a5712b2f-6a30-40d3-9a43-ad375accdbf2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:56:18.759919 n-d-856895-1 devstack@n-api.service[128777]: INFO oslo.messaging._drivers.impl_rabbit [-] [ff629e48-f4d3-4091-a343-d4a4670d06d6] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 36636. Sep 10 12:56:18.762116 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5712b2f-6a30-40d3-9a43-ad375accdbf2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:56:18.762605 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5712b2f-6a30-40d3-9a43-ad375accdbf2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:56:18.763041 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5712b2f-6a30-40d3-9a43-ad375accdbf2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:56:18.763775 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5712b2f-6a30-40d3-9a43-ad375accdbf2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:56:18.764233 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5712b2f-6a30-40d3-9a43-ad375accdbf2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:56:18.764657 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a5712b2f-6a30-40d3-9a43-ad375accdbf2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:56:18.769308 n-d-856895-1 devstack@n-api.service[128777]: INFO oslo.messaging._drivers.impl_rabbit [-] [9df9aef1-f60c-4e89-81ef-a70ffef5e10e] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 36634. Sep 10 12:56:18.915788 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a5712b2f-6a30-40d3-9a43-ad375accdbf2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:56:18.924379 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a5712b2f-6a30-40d3-9a43-ad375accdbf2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57" status: 200 len: 1760 microversion: 2.1 time: 0.187633 Sep 10 12:56:18.924947 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3702/7408] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:56:18 2022] GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 => generated 1760 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:57:50.446457 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:57:50.447175 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:57:50.451549 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c9bcb06f-4a75-4d9b-848e-bdcb973285c7 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-474041464"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:57:50.452095 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c9bcb06f-4a75-4d9b-848e-bdcb973285c7 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:57:50.461957 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9bcb06f-4a75-4d9b-848e-bdcb973285c7 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:57:50.462453 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9bcb06f-4a75-4d9b-848e-bdcb973285c7 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:57:50.462904 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9bcb06f-4a75-4d9b-848e-bdcb973285c7 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:57:50.463625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9bcb06f-4a75-4d9b-848e-bdcb973285c7 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:57:50.464087 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9bcb06f-4a75-4d9b-848e-bdcb973285c7 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:57:50.464525 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9bcb06f-4a75-4d9b-848e-bdcb973285c7 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:57:50.468066 n-d-856895-1 devstack@n-api.service[128776]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8e1e649-5477-464a-a830-120923e99a14] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 36674. Sep 10 12:57:50.470909 n-d-856895-1 devstack@n-api.service[128776]: INFO oslo.messaging._drivers.impl_rabbit [-] [f7df2fea-8ccb-440d-aacb-6daa54c00e88] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 36676. Sep 10 12:57:50.673333 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.network.security_group_api [None req-c9bcb06f-4a75-4d9b-848e-bdcb973285c7 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Removing security group 87af6468-04e1-4875-bc93-180c30ecbe8a from port 5dce328f-1831-4128-b24a-ac5d9aa79259 Sep 10 12:57:50.976963 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c9bcb06f-4a75-4d9b-848e-bdcb973285c7 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "POST /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57/action" status: 202 len: 0 microversion: 2.1 time: 0.532979 Sep 10 12:57:50.977737 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3707/7409] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:57:50 2022] POST /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57/action => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:57:50.984730 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=4 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:57:50.985603 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:57:51.072672 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-b28ad644-fbb8-412c-b639-2c25f4068d00 req-bbba0b02-c293-4f2b-a2ed-55b9ff34a5dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57", "tag": "5dce328f-1831-4128-b24a-ac5d9aa79259"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:57:51.082897 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-b28ad644-fbb8-412c-b639-2c25f4068d00 req-bbba0b02-c293-4f2b-a2ed-55b9ff34a5dd service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:57:51.083270 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-b28ad644-fbb8-412c-b639-2c25f4068d00 req-bbba0b02-c293-4f2b-a2ed-55b9ff34a5dd service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:57:51.083715 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-b28ad644-fbb8-412c-b639-2c25f4068d00 req-bbba0b02-c293-4f2b-a2ed-55b9ff34a5dd service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:57:51.095211 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-b28ad644-fbb8-412c-b639-2c25f4068d00 req-bbba0b02-c293-4f2b-a2ed-55b9ff34a5dd service nova] Creating event network-changed:5dce328f-1831-4128-b24a-ac5d9aa79259 for instance cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 on n-h1-856895-1 Sep 10 12:57:51.101247 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-b28ad644-fbb8-412c-b639-2c25f4068d00 req-bbba0b02-c293-4f2b-a2ed-55b9ff34a5dd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120182 Sep 10 12:57:51.102248 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3703/7410] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:57:52.458778 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5ff86d23-c32e-4f77-a1fc-d9575488c5b7 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:57:52.459328 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5ff86d23-c32e-4f77-a1fc-d9575488c5b7 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:57:52.465362 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ff86d23-c32e-4f77-a1fc-d9575488c5b7 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:57:52.465897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ff86d23-c32e-4f77-a1fc-d9575488c5b7 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:57:52.466389 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ff86d23-c32e-4f77-a1fc-d9575488c5b7 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:57:52.467125 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ff86d23-c32e-4f77-a1fc-d9575488c5b7 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:57:52.467621 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ff86d23-c32e-4f77-a1fc-d9575488c5b7 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:57:52.468071 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5ff86d23-c32e-4f77-a1fc-d9575488c5b7 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:57:52.550519 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-5ff86d23-c32e-4f77-a1fc-d9575488c5b7 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lazy-loading 'services' on Instance uuid cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:57:52.623459 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5ff86d23-c32e-4f77-a1fc-d9575488c5b7 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57/os-volume_attachments/9ec4e3a0-c440-4f07-9380-35f3240fa89e" status: 202 len: 0 microversion: 2.1 time: 0.169974 Sep 10 12:57:52.624065 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3708/7411] 10.222.0.23 () {58 vars in 1416 bytes} [Sat Sep 10 12:57:52 2022] DELETE /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57/os-volume_attachments/9ec4e3a0-c440-4f07-9380-35f3240fa89e => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:57:52.633597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-25b55940-1f7b-4db4-8f60-44105964f76d tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:57:52.635928 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-25b55940-1f7b-4db4-8f60-44105964f76d tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:57:52.644249 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25b55940-1f7b-4db4-8f60-44105964f76d tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:57:52.644670 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25b55940-1f7b-4db4-8f60-44105964f76d tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:57:52.645362 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25b55940-1f7b-4db4-8f60-44105964f76d tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:57:52.646081 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25b55940-1f7b-4db4-8f60-44105964f76d tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:57:52.646548 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25b55940-1f7b-4db4-8f60-44105964f76d tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:57:52.647147 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-25b55940-1f7b-4db4-8f60-44105964f76d tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:57:52.682463 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-25b55940-1f7b-4db4-8f60-44105964f76d tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053249 Sep 10 12:57:52.683053 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3704/7412] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:57:52 2022] GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:57:53.118438 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-96df4d5b-3396-424b-a02b-36d9f1f18d7f req-81d29198-ba27-4215-8073-45fe25fbda23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57", "tag": "5dce328f-1831-4128-b24a-ac5d9aa79259"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:57:53.129858 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-96df4d5b-3396-424b-a02b-36d9f1f18d7f req-81d29198-ba27-4215-8073-45fe25fbda23 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:57:53.130802 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-96df4d5b-3396-424b-a02b-36d9f1f18d7f req-81d29198-ba27-4215-8073-45fe25fbda23 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:57:53.131379 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-96df4d5b-3396-424b-a02b-36d9f1f18d7f req-81d29198-ba27-4215-8073-45fe25fbda23 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:57:53.143367 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-96df4d5b-3396-424b-a02b-36d9f1f18d7f req-81d29198-ba27-4215-8073-45fe25fbda23 service nova] Creating event network-changed:5dce328f-1831-4128-b24a-ac5d9aa79259 for instance cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 on n-h1-856895-1 Sep 10 12:57:53.148984 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-96df4d5b-3396-424b-a02b-36d9f1f18d7f req-81d29198-ba27-4215-8073-45fe25fbda23 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034902 Sep 10 12:57:53.149763 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3709/7413] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:57:53.696177 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c83c8283-d747-4ef6-8797-4b9b101049db tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:57:53.698562 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c83c8283-d747-4ef6-8797-4b9b101049db tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:57:53.705806 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c83c8283-d747-4ef6-8797-4b9b101049db tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:57:53.706235 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c83c8283-d747-4ef6-8797-4b9b101049db tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:57:53.706678 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c83c8283-d747-4ef6-8797-4b9b101049db tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:57:53.708038 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c83c8283-d747-4ef6-8797-4b9b101049db tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:57:53.708707 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c83c8283-d747-4ef6-8797-4b9b101049db tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:57:53.709138 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c83c8283-d747-4ef6-8797-4b9b101049db tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:57:53.740268 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c83c8283-d747-4ef6-8797-4b9b101049db tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048405 Sep 10 12:57:53.740748 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3705/7414] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:57:53 2022] GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:57:54.755684 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-50ee6f1a-6232-4357-8727-c0032c5565de tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:57:54.758018 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-50ee6f1a-6232-4357-8727-c0032c5565de tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:57:54.764467 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50ee6f1a-6232-4357-8727-c0032c5565de tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:57:54.764968 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50ee6f1a-6232-4357-8727-c0032c5565de tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:57:54.765421 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50ee6f1a-6232-4357-8727-c0032c5565de tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:57:54.766140 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50ee6f1a-6232-4357-8727-c0032c5565de tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:57:54.766622 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50ee6f1a-6232-4357-8727-c0032c5565de tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:57:54.767056 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50ee6f1a-6232-4357-8727-c0032c5565de tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:57:54.804770 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-50ee6f1a-6232-4357-8727-c0032c5565de tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055490 Sep 10 12:57:54.809879 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3710/7415] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:57:54 2022] GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:57:55.818371 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f04d6a27-117f-454b-bad7-9fb00582ae96 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:57:55.820691 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f04d6a27-117f-454b-bad7-9fb00582ae96 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:57:55.827753 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f04d6a27-117f-454b-bad7-9fb00582ae96 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:57:55.828287 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f04d6a27-117f-454b-bad7-9fb00582ae96 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:57:55.828787 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f04d6a27-117f-454b-bad7-9fb00582ae96 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:57:55.829501 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f04d6a27-117f-454b-bad7-9fb00582ae96 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:57:55.829963 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f04d6a27-117f-454b-bad7-9fb00582ae96 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:57:55.830396 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f04d6a27-117f-454b-bad7-9fb00582ae96 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:57:55.860784 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f04d6a27-117f-454b-bad7-9fb00582ae96 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046865 Sep 10 12:57:55.861264 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3706/7416] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:57:55 2022] GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:57:56.873496 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-027fc817-f5c9-46fb-94b8-e10e8d895dc2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:57:56.875741 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-027fc817-f5c9-46fb-94b8-e10e8d895dc2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:57:56.884195 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-027fc817-f5c9-46fb-94b8-e10e8d895dc2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:57:56.884684 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-027fc817-f5c9-46fb-94b8-e10e8d895dc2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:57:56.885134 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-027fc817-f5c9-46fb-94b8-e10e8d895dc2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:57:56.885831 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-027fc817-f5c9-46fb-94b8-e10e8d895dc2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:57:56.886296 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-027fc817-f5c9-46fb-94b8-e10e8d895dc2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:57:56.886729 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-027fc817-f5c9-46fb-94b8-e10e8d895dc2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:57:57.192961 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-027fc817-f5c9-46fb-94b8-e10e8d895dc2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.323302 Sep 10 12:57:57.193535 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3711/7417] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:57:56 2022] GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57/os-volume_attachments => generated 197 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:57:58.205626 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e361bb70-aab6-4212-9687-6df2b3c07f97 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:57:58.208663 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e361bb70-aab6-4212-9687-6df2b3c07f97 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:57:58.217140 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e361bb70-aab6-4212-9687-6df2b3c07f97 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:57:58.217624 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e361bb70-aab6-4212-9687-6df2b3c07f97 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:57:58.218064 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e361bb70-aab6-4212-9687-6df2b3c07f97 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:57:58.218760 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e361bb70-aab6-4212-9687-6df2b3c07f97 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:57:58.219241 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e361bb70-aab6-4212-9687-6df2b3c07f97 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:57:58.219676 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e361bb70-aab6-4212-9687-6df2b3c07f97 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:57:58.247847 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e361bb70-aab6-4212-9687-6df2b3c07f97 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046195 Sep 10 12:57:58.248417 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3707/7418] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:57:58 2022] GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 12:57:58.259873 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-27fe34af-8954-459e-9734-ab3c88e22d83 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:57:58.260371 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-27fe34af-8954-459e-9734-ab3c88e22d83 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:57:58.267854 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27fe34af-8954-459e-9734-ab3c88e22d83 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:57:58.268353 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27fe34af-8954-459e-9734-ab3c88e22d83 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:57:58.268807 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27fe34af-8954-459e-9734-ab3c88e22d83 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:57:58.269507 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27fe34af-8954-459e-9734-ab3c88e22d83 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:57:58.270682 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27fe34af-8954-459e-9734-ab3c88e22d83 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:57:58.271125 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-27fe34af-8954-459e-9734-ab3c88e22d83 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:57:58.345564 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-27fe34af-8954-459e-9734-ab3c88e22d83 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] HTTP exception thrown: Instance cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 is not attached to volume 9ec4e3a0-c440-4f07-9380-35f3240fa89e Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-27fe34af-8954-459e-9734-ab3c88e22d83 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Request method failure captured: Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57/os-volume_attachments/9ec4e3a0-c440-4f07-9380-35f3240fa89e HTTP/1.1 Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHIi1Qk0bksgLkDc0FUxb-TEKzrp0reUCImmwkPDUOvkRoYxAv2k14oyAGA3Sv14TlYkxTv-dUFISqZQu5qvFeOiBy9enkNZ2ewCstHQZ5gnISiMMSKg-GLAdzrnrw1Ioco649H6Jpzp5Ue8j9e9OHVQJxgEVsjnHi3eD-TbEqGmo3E0 Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 31812e3dc2ce4af2a2a8c931bb99946a Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-TestMinimumBasicScenario-951454077 Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31812e3dc2ce4af2a2a8c931bb99946a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31812e3dc2ce4af2a2a8c931bb99946a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_31812e3dc2ce4af2a2a8c931bb99946a", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/31812e3dc2ce4af2a2a8c931bb99946a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-TestMinimumBasicScenario-951454077 Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 31812e3dc2ce4af2a2a8c931bb99946a Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-TestMinimumBasicScenario-951454077 Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-TestMinimumBasicScenario-951454077-project Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 6e40e6a5c7eb4760b3f39c382a1bbc28 Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-TestMinimumBasicScenario-951454077-project Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 is not attached to volume 9ec4e3a0-c440-4f07-9380-35f3240fa89e Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'server_id': 'cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57', 'id': '9ec4e3a0-c440-4f07-9380-35f3240fa89e'} Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9ec4e3a0-c440-4f07-9380-35f3240fa89e. Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 is not attached to volume 9ec4e3a0-c440-4f07-9380-35f3240fa89e Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:57:58.347295 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:57:58.351795 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:57:58.351795 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:57:58.351795 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 is not attached to volume 9ec4e3a0-c440-4f07-9380-35f3240fa89e Sep 10 12:57:58.351795 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:57:58.351795 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-27fe34af-8954-459e-9734-ab3c88e22d83 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Returning 404 to user: Instance cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 is not attached to volume 9ec4e3a0-c440-4f07-9380-35f3240fa89e {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:57:58.351795 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-27fe34af-8954-459e-9734-ab3c88e22d83 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57/os-volume_attachments/9ec4e3a0-c440-4f07-9380-35f3240fa89e" status: 404 len: 154 microversion: 2.1 time: 0.093087 Sep 10 12:57:58.351795 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3712/7419] 10.222.0.23 () {58 vars in 1416 bytes} [Sat Sep 10 12:57:58 2022] DELETE /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57/os-volume_attachments/9ec4e3a0-c440-4f07-9380-35f3240fa89e => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:58:01.603442 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-48a139c0-d37d-4a41-9566-332893bba14f tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:58:01.603934 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-48a139c0-d37d-4a41-9566-332893bba14f tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:58:01.610821 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48a139c0-d37d-4a41-9566-332893bba14f tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:01.611343 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48a139c0-d37d-4a41-9566-332893bba14f tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:01.611786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48a139c0-d37d-4a41-9566-332893bba14f tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:01.612481 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48a139c0-d37d-4a41-9566-332893bba14f tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:01.612940 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48a139c0-d37d-4a41-9566-332893bba14f tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:01.613883 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-48a139c0-d37d-4a41-9566-332893bba14f tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:01.638990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-48a139c0-d37d-4a41-9566-332893bba14f tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 12:58:01.718769 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-48a139c0-d37d-4a41-9566-332893bba14f tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57" status: 204 len: 0 microversion: 2.1 time: 0.118969 Sep 10 12:58:01.720460 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3708/7420] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 12:58:01 2022] DELETE /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 10 12:58:01.730129 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2bc0040f-07ee-4f7f-a40c-21f141200473 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:58:01.730881 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2bc0040f-07ee-4f7f-a40c-21f141200473 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:58:01.740402 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2bc0040f-07ee-4f7f-a40c-21f141200473 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:01.740940 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2bc0040f-07ee-4f7f-a40c-21f141200473 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:01.741644 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2bc0040f-07ee-4f7f-a40c-21f141200473 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:01.742451 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2bc0040f-07ee-4f7f-a40c-21f141200473 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:01.743221 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2bc0040f-07ee-4f7f-a40c-21f141200473 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:01.744313 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2bc0040f-07ee-4f7f-a40c-21f141200473 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:01.879965 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2bc0040f-07ee-4f7f-a40c-21f141200473 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:58:01.887741 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2bc0040f-07ee-4f7f-a40c-21f141200473 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57" status: 200 len: 1555 microversion: 2.1 time: 0.161968 Sep 10 12:58:01.888312 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3713/7421] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:58:01 2022] GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:58:02.912498 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-938d2a8b-bc0e-4c6b-bca6-5e9519e744b7 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:58:02.913234 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-938d2a8b-bc0e-4c6b-bca6-5e9519e744b7 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:58:02.920792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-938d2a8b-bc0e-4c6b-bca6-5e9519e744b7 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:02.921280 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-938d2a8b-bc0e-4c6b-bca6-5e9519e744b7 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:02.921722 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-938d2a8b-bc0e-4c6b-bca6-5e9519e744b7 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:02.922418 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-938d2a8b-bc0e-4c6b-bca6-5e9519e744b7 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:02.922875 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-938d2a8b-bc0e-4c6b-bca6-5e9519e744b7 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:02.923337 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-938d2a8b-bc0e-4c6b-bca6-5e9519e744b7 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:03.100155 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-938d2a8b-bc0e-4c6b-bca6-5e9519e744b7 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:58:03.108177 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-938d2a8b-bc0e-4c6b-bca6-5e9519e744b7 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57" status: 200 len: 1555 microversion: 2.1 time: 0.200495 Sep 10 12:58:03.109168 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3709/7422] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:58:02 2022] GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 => generated 1555 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:58:04.132450 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-412c21b6-5c9f-4f22-affb-331bee0791aa tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:58:04.133098 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-412c21b6-5c9f-4f22-affb-331bee0791aa tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:58:04.140852 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-412c21b6-5c9f-4f22-affb-331bee0791aa tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:04.141362 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-412c21b6-5c9f-4f22-affb-331bee0791aa tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:04.141818 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-412c21b6-5c9f-4f22-affb-331bee0791aa tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:04.142537 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-412c21b6-5c9f-4f22-affb-331bee0791aa tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:04.143003 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-412c21b6-5c9f-4f22-affb-331bee0791aa tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:04.143491 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-412c21b6-5c9f-4f22-affb-331bee0791aa tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:04.268182 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-412c21b6-5c9f-4f22-affb-331bee0791aa tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:58:04.276359 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-412c21b6-5c9f-4f22-affb-331bee0791aa tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57" status: 200 len: 1513 microversion: 2.1 time: 0.148185 Sep 10 12:58:04.276938 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3714/7423] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:58:04 2022] GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:58:04.300195 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-e3e1b739-6ca3-40bb-a9f8-a72fcddfbe1d req-e07a05c7-8c9d-4f45-a717-60ea368000e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57", "name": "network-vif-deleted", "tag": "5dce328f-1831-4128-b24a-ac5d9aa79259"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:58:04.311321 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e3e1b739-6ca3-40bb-a9f8-a72fcddfbe1d req-e07a05c7-8c9d-4f45-a717-60ea368000e2 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:04.311816 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e3e1b739-6ca3-40bb-a9f8-a72fcddfbe1d req-e07a05c7-8c9d-4f45-a717-60ea368000e2 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:04.312252 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-e3e1b739-6ca3-40bb-a9f8-a72fcddfbe1d req-e07a05c7-8c9d-4f45-a717-60ea368000e2 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:04.323687 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-e3e1b739-6ca3-40bb-a9f8-a72fcddfbe1d req-e07a05c7-8c9d-4f45-a717-60ea368000e2 service nova] Creating event network-vif-deleted:5dce328f-1831-4128-b24a-ac5d9aa79259 for instance cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 on n-h1-856895-1 Sep 10 12:58:04.328910 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-e3e1b739-6ca3-40bb-a9f8-a72fcddfbe1d req-e07a05c7-8c9d-4f45-a717-60ea368000e2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032438 Sep 10 12:58:04.329679 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3710/7424] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:58:05.301906 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0cdb9560-3351-48b7-a7de-2e7818550fb2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:58:05.302539 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0cdb9560-3351-48b7-a7de-2e7818550fb2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:58:05.309738 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0cdb9560-3351-48b7-a7de-2e7818550fb2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:05.310283 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0cdb9560-3351-48b7-a7de-2e7818550fb2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:05.310767 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0cdb9560-3351-48b7-a7de-2e7818550fb2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:05.311512 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0cdb9560-3351-48b7-a7de-2e7818550fb2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:05.311987 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0cdb9560-3351-48b7-a7de-2e7818550fb2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:05.312433 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0cdb9560-3351-48b7-a7de-2e7818550fb2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:05.325778 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-0cdb9560-3351-48b7-a7de-2e7818550fb2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] HTTP exception thrown: Instance cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 could not be found. Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0cdb9560-3351-48b7-a7de-2e7818550fb2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Request method failure captured: Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 HTTP/1.1 Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHIi1Qk0bksgLkDc0FUxb-TEKzrp0reUCImmwkPDUOvkRoYxAv2k14oyAGA3Sv14TlYkxTv-dUFISqZQu5qvFeOiBy9enkNZ2ewCstHQZ5gnISiMMSKg-GLAdzrnrw1Ioco649H6Jpzp5Ue8j9e9OHVQJxgEVsjnHi3eD-TbEqGmo3E0 Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 31812e3dc2ce4af2a2a8c931bb99946a Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-TestMinimumBasicScenario-951454077 Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31812e3dc2ce4af2a2a8c931bb99946a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31812e3dc2ce4af2a2a8c931bb99946a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_31812e3dc2ce4af2a2a8c931bb99946a", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/31812e3dc2ce4af2a2a8c931bb99946a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-TestMinimumBasicScenario-951454077 Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 31812e3dc2ce4af2a2a8c931bb99946a Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-TestMinimumBasicScenario-951454077 Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-TestMinimumBasicScenario-951454077-project Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 6e40e6a5c7eb4760b3f39c382a1bbc28 Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-TestMinimumBasicScenario-951454077-project Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 could not be found. Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57'} Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 could not be found. Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 could not be found. Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:58:05.327381 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:58:05.332841 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:58:05.332841 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:58:05.332841 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:58:05.332841 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:58:05.332841 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:58:05.332841 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 could not be found. Sep 10 12:58:05.332841 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:58:05.332841 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0cdb9560-3351-48b7-a7de-2e7818550fb2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Returning 404 to user: Instance cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:58:05.332841 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0cdb9560-3351-48b7-a7de-2e7818550fb2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57" status: 404 len: 111 microversion: 2.1 time: 0.030985 Sep 10 12:58:05.332841 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3715/7425] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:58:05 2022] GET /compute/v2.1/servers/cca02bd9-8be7-44cf-b3b7-0bef8f0b2c57 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 12:58:05.339898 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3ee0e271-e164-4c15-bcde-36dca9874981 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '.version_select at 0x7f4078061af0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:58:05.364260 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3ee0e271-e164-4c15-bcde-36dca9874981 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2014499474" status: 202 len: 0 microversion: 2.1 time: 0.029037 Sep 10 12:58:05.367675 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3711/7426] 10.222.0.23 () {58 vars in 1272 bytes} [Sat Sep 10 12:58:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2014499474 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:58:14.707496 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-838a2c8b-e882-46df-bed9-684e6790d98e tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Action: 'create', calling method: .version_select at 0x7f40606d6d30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-106983883", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1ZyZsEONVlM1hT8xSUjmpPO+jThrG3hDFHoy9aeQTtyQflldKcBbdXWjuWx0XxDgFTAvJNxtE4bW7o268zjnFibEvP3GuM7C+o/3ljA4+7+ZYeq5x2oPRpwFOlKunL6w=="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:58:14.723857 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-838a2c8b-e882-46df-bed9-684e6790d98e tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Getting quotas for project 31812e3dc2ce4af2a2a8c931bb99946a. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:58:14.728955 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-838a2c8b-e882-46df-bed9-684e6790d98e tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Getting quotas for user 6e40e6a5c7eb4760b3f39c382a1bbc28 and project 31812e3dc2ce4af2a2a8c931bb99946a. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:58:14.756152 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-838a2c8b-e882-46df-bed9-684e6790d98e tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.100345 Sep 10 12:58:14.756816 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3716/7427] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 12:58:14 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:58:14.805210 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:58:14.810284 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bcadab05-41cf-4348-810c-15ec7dfdc832 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-492214926", "imageRef": "96882562-ca19-4a23-b8f4-f07c6d4c3a1f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-106983883", "networks": [{"uuid": "fc442826-1799-4b76-a9e7-0282220cf1fb"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:58:14.862429 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-bcadab05-41cf-4348-810c-15ec7dfdc832 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] validate_networks() for [('fc442826-1799-4b76-a9e7-0282220cf1fb', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 12:58:15.273332 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-bcadab05-41cf-4348-810c-15ec7dfdc832 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 12:58:15.273760 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-bcadab05-41cf-4348-810c-15ec7dfdc832 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 12:58:15.274242 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-bcadab05-41cf-4348-810c-15ec7dfdc832 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 12:58:15.274659 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-bcadab05-41cf-4348-810c-15ec7dfdc832 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 12:58:15.275077 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-bcadab05-41cf-4348-810c-15ec7dfdc832 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 12:58:15.284084 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bcadab05-41cf-4348-810c-15ec7dfdc832 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:15.284571 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bcadab05-41cf-4348-810c-15ec7dfdc832 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:15.285039 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bcadab05-41cf-4348-810c-15ec7dfdc832 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:15.285769 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bcadab05-41cf-4348-810c-15ec7dfdc832 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:15.286218 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bcadab05-41cf-4348-810c-15ec7dfdc832 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:15.286640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bcadab05-41cf-4348-810c-15ec7dfdc832 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:15.306934 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-bcadab05-41cf-4348-810c-15ec7dfdc832 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Getting quotas for project 31812e3dc2ce4af2a2a8c931bb99946a. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 12:58:15.312245 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-bcadab05-41cf-4348-810c-15ec7dfdc832 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Getting quotas for user 6e40e6a5c7eb4760b3f39c382a1bbc28 and project 31812e3dc2ce4af2a2a8c931bb99946a. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 12:58:15.324968 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bcadab05-41cf-4348-810c-15ec7dfdc832 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 12:58:15.327248 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bcadab05-41cf-4348-810c-15ec7dfdc832 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='96882562-ca19-4a23-b8f4-f07c6d4c3a1f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 12:58:15.374381 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bcadab05-41cf-4348-810c-15ec7dfdc832 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.570974 Sep 10 12:58:15.375054 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3712/7428] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 12:58:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 12:58:15.384185 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:58:15.388304 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4ed49a9e-17eb-4783-850a-731b617385f1 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:58:15.388954 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4ed49a9e-17eb-4783-850a-731b617385f1 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:58:15.453883 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4ed49a9e-17eb-4783-850a-731b617385f1 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:58:15.461669 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4ed49a9e-17eb-4783-850a-731b617385f1 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df" status: 200 len: 1257 microversion: 2.1 time: 0.078449 Sep 10 12:58:15.462255 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3717/7429] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:58:15 2022] GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df => generated 1257 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:58:16.485823 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-10a6ecea-2be0-47a2-ac7e-962913e41649 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:58:16.487193 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-10a6ecea-2be0-47a2-ac7e-962913e41649 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:58:16.494014 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-10a6ecea-2be0-47a2-ac7e-962913e41649 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:16.494511 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-10a6ecea-2be0-47a2-ac7e-962913e41649 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:16.495146 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-10a6ecea-2be0-47a2-ac7e-962913e41649 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:16.496430 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-10a6ecea-2be0-47a2-ac7e-962913e41649 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:16.497065 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-10a6ecea-2be0-47a2-ac7e-962913e41649 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:16.497507 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-10a6ecea-2be0-47a2-ac7e-962913e41649 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:16.564624 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-10a6ecea-2be0-47a2-ac7e-962913e41649 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:58:16.575372 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-10a6ecea-2be0-47a2-ac7e-962913e41649 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df" status: 200 len: 1327 microversion: 2.1 time: 0.094268 Sep 10 12:58:16.576509 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3713/7430] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:58:16 2022] GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df => generated 1327 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:58:17.601783 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7f55a951-faae-48f0-878c-27cff149e4cc tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:58:17.603140 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7f55a951-faae-48f0-878c-27cff149e4cc tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:58:17.610875 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f55a951-faae-48f0-878c-27cff149e4cc tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:17.611416 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f55a951-faae-48f0-878c-27cff149e4cc tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:17.611878 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f55a951-faae-48f0-878c-27cff149e4cc tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:17.612654 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f55a951-faae-48f0-878c-27cff149e4cc tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:17.613699 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f55a951-faae-48f0-878c-27cff149e4cc tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:17.614153 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7f55a951-faae-48f0-878c-27cff149e4cc tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:17.750287 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7f55a951-faae-48f0-878c-27cff149e4cc tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:58:17.759410 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7f55a951-faae-48f0-878c-27cff149e4cc tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df" status: 200 len: 1357 microversion: 2.1 time: 0.163225 Sep 10 12:58:17.760006 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3718/7431] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:58:17 2022] GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:58:18.784253 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d85c598a-c897-4f9b-b206-bdc1c56176b6 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:58:18.785739 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d85c598a-c897-4f9b-b206-bdc1c56176b6 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:58:18.792559 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d85c598a-c897-4f9b-b206-bdc1c56176b6 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:18.793053 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d85c598a-c897-4f9b-b206-bdc1c56176b6 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:18.793494 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d85c598a-c897-4f9b-b206-bdc1c56176b6 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:18.794202 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d85c598a-c897-4f9b-b206-bdc1c56176b6 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:18.794661 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d85c598a-c897-4f9b-b206-bdc1c56176b6 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:18.795093 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d85c598a-c897-4f9b-b206-bdc1c56176b6 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:18.938853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d85c598a-c897-4f9b-b206-bdc1c56176b6 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:58:18.947415 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d85c598a-c897-4f9b-b206-bdc1c56176b6 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df" status: 200 len: 1357 microversion: 2.1 time: 0.167496 Sep 10 12:58:18.948146 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3714/7432] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:58:18 2022] GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:58:19.971531 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1dc01cb1-f4e0-4c88-a46d-dccba64e5575 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:58:19.972242 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1dc01cb1-f4e0-4c88-a46d-dccba64e5575 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:58:19.979963 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1dc01cb1-f4e0-4c88-a46d-dccba64e5575 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:19.980470 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1dc01cb1-f4e0-4c88-a46d-dccba64e5575 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:19.980923 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1dc01cb1-f4e0-4c88-a46d-dccba64e5575 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:19.981833 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1dc01cb1-f4e0-4c88-a46d-dccba64e5575 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:19.982469 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1dc01cb1-f4e0-4c88-a46d-dccba64e5575 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:19.983095 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1dc01cb1-f4e0-4c88-a46d-dccba64e5575 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:20.183239 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1dc01cb1-f4e0-4c88-a46d-dccba64e5575 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:58:20.191497 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1dc01cb1-f4e0-4c88-a46d-dccba64e5575 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df" status: 200 len: 1357 microversion: 2.1 time: 0.223815 Sep 10 12:58:20.192099 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3719/7433] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:58:19 2022] GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df => generated 1357 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:58:21.216076 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2a5a98e1-420c-49b4-a5d7-21995a7a83e3 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:58:21.216711 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2a5a98e1-420c-49b4-a5d7-21995a7a83e3 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:58:21.219420 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:58:21.225948 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a5a98e1-420c-49b4-a5d7-21995a7a83e3 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:21.226534 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a5a98e1-420c-49b4-a5d7-21995a7a83e3 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:21.226976 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a5a98e1-420c-49b4-a5d7-21995a7a83e3 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:21.227750 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a5a98e1-420c-49b4-a5d7-21995a7a83e3 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:21.228303 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a5a98e1-420c-49b4-a5d7-21995a7a83e3 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:21.228734 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2a5a98e1-420c-49b4-a5d7-21995a7a83e3 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:21.397293 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2a5a98e1-420c-49b4-a5d7-21995a7a83e3 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:58:21.405651 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2a5a98e1-420c-49b4-a5d7-21995a7a83e3 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df" status: 200 len: 1357 microversion: 2.1 time: 0.193416 Sep 10 12:58:21.406507 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3715/7434] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:58:21 2022] GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df => generated 1357 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:58:22.430455 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-821e06d9-f3b4-4456-b0d8-a38fa0779acb tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:58:22.432077 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-821e06d9-f3b4-4456-b0d8-a38fa0779acb tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:58:22.438649 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:58:22.440258 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-821e06d9-f3b4-4456-b0d8-a38fa0779acb tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:22.441046 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-821e06d9-f3b4-4456-b0d8-a38fa0779acb tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:22.441604 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-821e06d9-f3b4-4456-b0d8-a38fa0779acb tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:22.442500 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-821e06d9-f3b4-4456-b0d8-a38fa0779acb tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:22.443054 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-821e06d9-f3b4-4456-b0d8-a38fa0779acb tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:22.443671 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-821e06d9-f3b4-4456-b0d8-a38fa0779acb tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:22.596385 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-821e06d9-f3b4-4456-b0d8-a38fa0779acb tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:58:22.605918 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-821e06d9-f3b4-4456-b0d8-a38fa0779acb tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df" status: 200 len: 1357 microversion: 2.1 time: 0.180106 Sep 10 12:58:22.606851 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3720/7435] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:58:22 2022] GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df => generated 1357 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:58:23.629539 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b33cfcfe-1554-4b14-920d-5e9482123f07 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:58:23.630206 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b33cfcfe-1554-4b14-920d-5e9482123f07 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:58:23.637005 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b33cfcfe-1554-4b14-920d-5e9482123f07 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:23.637499 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b33cfcfe-1554-4b14-920d-5e9482123f07 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:23.637937 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b33cfcfe-1554-4b14-920d-5e9482123f07 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:23.638643 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b33cfcfe-1554-4b14-920d-5e9482123f07 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:23.639115 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b33cfcfe-1554-4b14-920d-5e9482123f07 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:23.639564 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b33cfcfe-1554-4b14-920d-5e9482123f07 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:23.793387 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b33cfcfe-1554-4b14-920d-5e9482123f07 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:58:23.804070 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b33cfcfe-1554-4b14-920d-5e9482123f07 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df" status: 200 len: 1357 microversion: 2.1 time: 0.178729 Sep 10 12:58:23.805007 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3716/7436] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:58:23 2022] GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df => generated 1357 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:58:24.829352 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-49096bce-2011-4cb7-9de7-74f3acf6ec56 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:58:24.830009 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-49096bce-2011-4cb7-9de7-74f3acf6ec56 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:58:24.837086 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-49096bce-2011-4cb7-9de7-74f3acf6ec56 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:24.837581 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-49096bce-2011-4cb7-9de7-74f3acf6ec56 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:24.838034 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-49096bce-2011-4cb7-9de7-74f3acf6ec56 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:24.838738 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-49096bce-2011-4cb7-9de7-74f3acf6ec56 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:24.839411 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-49096bce-2011-4cb7-9de7-74f3acf6ec56 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:24.839856 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-49096bce-2011-4cb7-9de7-74f3acf6ec56 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:24.974668 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-49096bce-2011-4cb7-9de7-74f3acf6ec56 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:58:24.982342 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-49096bce-2011-4cb7-9de7-74f3acf6ec56 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df" status: 200 len: 1357 microversion: 2.1 time: 0.156922 Sep 10 12:58:24.983006 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3721/7437] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:58:24 2022] GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:58:25.433880 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-f7620907-35ae-48c0-b75d-21032b32bd45 req-ae749fcb-42a2-4f7e-a8ba-42129d1de65c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed6d8cd8-d88c-446f-8914-4c2af93a02df", "tag": "4cc25c6b-3e1d-442c-bcb1-ba1ff9b5c1b1"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:58:25.440152 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:58:25.440961 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:58:25.448754 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-f7620907-35ae-48c0-b75d-21032b32bd45 req-ae749fcb-42a2-4f7e-a8ba-42129d1de65c service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:25.449244 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-f7620907-35ae-48c0-b75d-21032b32bd45 req-ae749fcb-42a2-4f7e-a8ba-42129d1de65c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:25.449723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-f7620907-35ae-48c0-b75d-21032b32bd45 req-ae749fcb-42a2-4f7e-a8ba-42129d1de65c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:25.462098 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-f7620907-35ae-48c0-b75d-21032b32bd45 req-ae749fcb-42a2-4f7e-a8ba-42129d1de65c service nova] Creating event network-changed:4cc25c6b-3e1d-442c-bcb1-ba1ff9b5c1b1 for instance ed6d8cd8-d88c-446f-8914-4c2af93a02df on n-h2-856895-1 Sep 10 12:58:25.467300 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-f7620907-35ae-48c0-b75d-21032b32bd45 req-ae749fcb-42a2-4f7e-a8ba-42129d1de65c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037366 Sep 10 12:58:25.467964 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3717/7438] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:58:26.007075 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ee97bb42-b3fe-4b36-9cb6-7213a01ca686 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:58:26.007740 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ee97bb42-b3fe-4b36-9cb6-7213a01ca686 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:58:26.009815 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:58:26.017729 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ee97bb42-b3fe-4b36-9cb6-7213a01ca686 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:26.018145 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ee97bb42-b3fe-4b36-9cb6-7213a01ca686 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:26.018608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ee97bb42-b3fe-4b36-9cb6-7213a01ca686 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:26.019462 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ee97bb42-b3fe-4b36-9cb6-7213a01ca686 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:26.020915 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ee97bb42-b3fe-4b36-9cb6-7213a01ca686 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:26.021809 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ee97bb42-b3fe-4b36-9cb6-7213a01ca686 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:26.156797 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ee97bb42-b3fe-4b36-9cb6-7213a01ca686 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:58:26.165148 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ee97bb42-b3fe-4b36-9cb6-7213a01ca686 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df" status: 200 len: 1357 microversion: 2.1 time: 0.163121 Sep 10 12:58:26.166070 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3722/7439] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:58:26 2022] GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:58:27.191231 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3a527037-cfb9-4436-ba31-6bc14a4503ba tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:58:27.192468 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3a527037-cfb9-4436-ba31-6bc14a4503ba tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:58:27.198624 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a527037-cfb9-4436-ba31-6bc14a4503ba tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:27.199207 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a527037-cfb9-4436-ba31-6bc14a4503ba tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:27.199620 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a527037-cfb9-4436-ba31-6bc14a4503ba tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:27.200568 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a527037-cfb9-4436-ba31-6bc14a4503ba tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:27.201087 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a527037-cfb9-4436-ba31-6bc14a4503ba tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:27.201565 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3a527037-cfb9-4436-ba31-6bc14a4503ba tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:27.341302 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3a527037-cfb9-4436-ba31-6bc14a4503ba tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:58:27.349091 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3a527037-cfb9-4436-ba31-6bc14a4503ba tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df" status: 200 len: 1357 microversion: 2.1 time: 0.163017 Sep 10 12:58:27.349735 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3718/7440] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:58:27 2022] GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:58:28.372417 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bcc31f66-692c-44e1-8c88-0cf326ef1444 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:58:28.373146 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bcc31f66-692c-44e1-8c88-0cf326ef1444 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:58:28.380713 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bcc31f66-692c-44e1-8c88-0cf326ef1444 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:28.381223 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bcc31f66-692c-44e1-8c88-0cf326ef1444 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:28.381683 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bcc31f66-692c-44e1-8c88-0cf326ef1444 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:28.382404 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bcc31f66-692c-44e1-8c88-0cf326ef1444 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:28.382875 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bcc31f66-692c-44e1-8c88-0cf326ef1444 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:28.383353 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bcc31f66-692c-44e1-8c88-0cf326ef1444 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:28.511656 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bcc31f66-692c-44e1-8c88-0cf326ef1444 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:58:28.519304 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bcc31f66-692c-44e1-8c88-0cf326ef1444 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df" status: 200 len: 1357 microversion: 2.1 time: 0.150807 Sep 10 12:58:28.520365 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3723/7441] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:58:28 2022] GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:58:29.542853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-40d67db8-ae88-4df3-8867-c9c07f1590c5 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:58:29.543504 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-40d67db8-ae88-4df3-8867-c9c07f1590c5 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:58:29.550526 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40d67db8-ae88-4df3-8867-c9c07f1590c5 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:29.551672 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40d67db8-ae88-4df3-8867-c9c07f1590c5 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:29.552236 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40d67db8-ae88-4df3-8867-c9c07f1590c5 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:29.552949 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40d67db8-ae88-4df3-8867-c9c07f1590c5 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:29.553408 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40d67db8-ae88-4df3-8867-c9c07f1590c5 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:29.553840 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-40d67db8-ae88-4df3-8867-c9c07f1590c5 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:29.705021 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-40d67db8-ae88-4df3-8867-c9c07f1590c5 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:58:29.714295 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-40d67db8-ae88-4df3-8867-c9c07f1590c5 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df" status: 200 len: 1357 microversion: 2.1 time: 0.175516 Sep 10 12:58:29.714895 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3719/7442] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:58:29 2022] GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:58:30.740743 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-842e7603-7f61-4dcd-8a19-bf40aa682d33 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:58:30.741404 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-842e7603-7f61-4dcd-8a19-bf40aa682d33 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:58:30.748331 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-842e7603-7f61-4dcd-8a19-bf40aa682d33 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:30.748827 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-842e7603-7f61-4dcd-8a19-bf40aa682d33 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:30.749280 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-842e7603-7f61-4dcd-8a19-bf40aa682d33 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:30.749990 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-842e7603-7f61-4dcd-8a19-bf40aa682d33 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:30.750459 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-842e7603-7f61-4dcd-8a19-bf40aa682d33 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:30.750900 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-842e7603-7f61-4dcd-8a19-bf40aa682d33 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:30.880772 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-842e7603-7f61-4dcd-8a19-bf40aa682d33 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:58:30.888440 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-842e7603-7f61-4dcd-8a19-bf40aa682d33 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df" status: 200 len: 1357 microversion: 2.1 time: 0.152404 Sep 10 12:58:30.889013 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3724/7443] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:58:30 2022] GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:58:31.912195 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-32d652bf-d388-4957-b0c6-71b7a5268b08 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:58:31.912815 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-32d652bf-d388-4957-b0c6-71b7a5268b08 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:58:31.919814 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32d652bf-d388-4957-b0c6-71b7a5268b08 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:31.920303 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32d652bf-d388-4957-b0c6-71b7a5268b08 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:31.920742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32d652bf-d388-4957-b0c6-71b7a5268b08 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:31.921447 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32d652bf-d388-4957-b0c6-71b7a5268b08 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:31.921904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32d652bf-d388-4957-b0c6-71b7a5268b08 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:31.922332 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-32d652bf-d388-4957-b0c6-71b7a5268b08 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:32.062125 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-32d652bf-d388-4957-b0c6-71b7a5268b08 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:58:32.070190 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-32d652bf-d388-4957-b0c6-71b7a5268b08 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df" status: 200 len: 1357 microversion: 2.1 time: 0.162683 Sep 10 12:58:32.070678 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-f1fcf35d-5369-4b99-af94-744effd7dcfe req-060f268c-f303-4fbf-81d9-d86a5c0b4e19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed6d8cd8-d88c-446f-8914-4c2af93a02df", "name": "network-vif-plugged", "status": "completed", "tag": "4cc25c6b-3e1d-442c-bcb1-ba1ff9b5c1b1"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:58:32.071135 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3720/7444] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:58:31 2022] GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:58:32.080472 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f1fcf35d-5369-4b99-af94-744effd7dcfe req-060f268c-f303-4fbf-81d9-d86a5c0b4e19 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:32.080965 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f1fcf35d-5369-4b99-af94-744effd7dcfe req-060f268c-f303-4fbf-81d9-d86a5c0b4e19 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:32.081417 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-f1fcf35d-5369-4b99-af94-744effd7dcfe req-060f268c-f303-4fbf-81d9-d86a5c0b4e19 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:32.095243 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-f1fcf35d-5369-4b99-af94-744effd7dcfe req-060f268c-f303-4fbf-81d9-d86a5c0b4e19 service nova] Creating event network-vif-plugged:4cc25c6b-3e1d-442c-bcb1-ba1ff9b5c1b1 for instance ed6d8cd8-d88c-446f-8914-4c2af93a02df on n-h2-856895-1 Sep 10 12:58:32.101179 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-f1fcf35d-5369-4b99-af94-744effd7dcfe req-060f268c-f303-4fbf-81d9-d86a5c0b4e19 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111937 Sep 10 12:58:32.101777 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3725/7445] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:58:33.093581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ff9a41b2-f4d1-4544-98d8-a4e198c50c1b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:58:33.094208 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ff9a41b2-f4d1-4544-98d8-a4e198c50c1b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:58:33.101672 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ff9a41b2-f4d1-4544-98d8-a4e198c50c1b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:33.102163 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ff9a41b2-f4d1-4544-98d8-a4e198c50c1b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:33.102608 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ff9a41b2-f4d1-4544-98d8-a4e198c50c1b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:33.103342 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ff9a41b2-f4d1-4544-98d8-a4e198c50c1b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:33.103809 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ff9a41b2-f4d1-4544-98d8-a4e198c50c1b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:33.104245 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ff9a41b2-f4d1-4544-98d8-a4e198c50c1b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:33.245326 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ff9a41b2-f4d1-4544-98d8-a4e198c50c1b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:58:33.253163 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ff9a41b2-f4d1-4544-98d8-a4e198c50c1b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df" status: 200 len: 1357 microversion: 2.1 time: 0.163588 Sep 10 12:58:33.253744 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3721/7446] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:58:33 2022] GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:58:34.279134 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-956e8ea3-f00a-4305-bbae-866e507c99fb tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:58:34.280004 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-956e8ea3-f00a-4305-bbae-866e507c99fb tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:58:34.286335 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-956e8ea3-f00a-4305-bbae-866e507c99fb tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:34.286833 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-956e8ea3-f00a-4305-bbae-866e507c99fb tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:34.287313 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-956e8ea3-f00a-4305-bbae-866e507c99fb tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:34.288016 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-956e8ea3-f00a-4305-bbae-866e507c99fb tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:34.288482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-956e8ea3-f00a-4305-bbae-866e507c99fb tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:34.288956 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-956e8ea3-f00a-4305-bbae-866e507c99fb tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:34.419067 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-956e8ea3-f00a-4305-bbae-866e507c99fb tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:58:34.427386 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-956e8ea3-f00a-4305-bbae-866e507c99fb tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df" status: 200 len: 1547 microversion: 2.1 time: 0.153321 Sep 10 12:58:34.427959 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3726/7447] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:58:34 2022] GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:58:34.450375 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b0a66f9c-38ed-48d8-b5ba-e32282bc0740 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:58:34.451006 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b0a66f9c-38ed-48d8-b5ba-e32282bc0740 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:58:34.457927 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0a66f9c-38ed-48d8-b5ba-e32282bc0740 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:34.458420 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0a66f9c-38ed-48d8-b5ba-e32282bc0740 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:34.458863 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0a66f9c-38ed-48d8-b5ba-e32282bc0740 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:34.459591 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0a66f9c-38ed-48d8-b5ba-e32282bc0740 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:34.460059 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0a66f9c-38ed-48d8-b5ba-e32282bc0740 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:34.460492 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b0a66f9c-38ed-48d8-b5ba-e32282bc0740 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:34.592168 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b0a66f9c-38ed-48d8-b5ba-e32282bc0740 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:58:34.600014 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b0a66f9c-38ed-48d8-b5ba-e32282bc0740 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df" status: 200 len: 1547 microversion: 2.1 time: 0.153678 Sep 10 12:58:34.600586 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3722/7448] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:58:34 2022] GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:58:34.623712 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e4d04c2e-7e32-4be0-aea9-b7a4364e3451 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:58:34.628546 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e4d04c2e-7e32-4be0-aea9-b7a4364e3451 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:58:34.630160 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e4d04c2e-7e32-4be0-aea9-b7a4364e3451 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Searching by: {'deleted': False, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a'} {{(pid=128776) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 10 12:58:34.635553 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4d04c2e-7e32-4be0-aea9-b7a4364e3451 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:34.636047 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4d04c2e-7e32-4be0-aea9-b7a4364e3451 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:34.636498 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4d04c2e-7e32-4be0-aea9-b7a4364e3451 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:34.637262 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4d04c2e-7e32-4be0-aea9-b7a4364e3451 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:34.637762 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4d04c2e-7e32-4be0-aea9-b7a4364e3451 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:34.638204 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e4d04c2e-7e32-4be0-aea9-b7a4364e3451 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:34.661160 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.multi_cell_list [None req-e4d04c2e-7e32-4be0-aea9-b7a4364e3451 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128776) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 10 12:58:34.687619 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e4d04c2e-7e32-4be0-aea9-b7a4364e3451 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.067657 Sep 10 12:58:34.688136 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3727/7449] 10.222.0.23 () {58 vars in 1125 bytes} [Sat Sep 10 12:58:34 2022] GET /compute/v2.1/servers => generated 342 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:58:34.700462 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f1134e39-cf89-4d41-ba92-16ef711c737e tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:58:34.701090 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f1134e39-cf89-4d41-ba92-16ef711c737e tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:58:34.707101 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f1134e39-cf89-4d41-ba92-16ef711c737e tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:34.707683 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f1134e39-cf89-4d41-ba92-16ef711c737e tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:34.708233 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f1134e39-cf89-4d41-ba92-16ef711c737e tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:34.708938 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f1134e39-cf89-4d41-ba92-16ef711c737e tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:34.709404 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f1134e39-cf89-4d41-ba92-16ef711c737e tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:34.709843 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f1134e39-cf89-4d41-ba92-16ef711c737e tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:34.842543 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f1134e39-cf89-4d41-ba92-16ef711c737e tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:58:34.851429 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f1134e39-cf89-4d41-ba92-16ef711c737e tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df" status: 200 len: 1547 microversion: 2.1 time: 0.154739 Sep 10 12:58:34.853025 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3723/7450] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:58:34 2022] GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:58:36.381521 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7444628b-49c8-4136-82eb-ed5a4c08ea03 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e30e08b-6d9b-43f7-bb29-8a849d8c1764"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:58:36.384004 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7444628b-49c8-4136-82eb-ed5a4c08ea03 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:58:36.390826 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7444628b-49c8-4136-82eb-ed5a4c08ea03 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:36.391372 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7444628b-49c8-4136-82eb-ed5a4c08ea03 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:36.391829 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7444628b-49c8-4136-82eb-ed5a4c08ea03 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:36.392534 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7444628b-49c8-4136-82eb-ed5a4c08ea03 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:36.393006 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7444628b-49c8-4136-82eb-ed5a4c08ea03 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:36.393448 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7444628b-49c8-4136-82eb-ed5a4c08ea03 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:36.625812 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7444628b-49c8-4136-82eb-ed5a4c08ea03 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "POST /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.248712 Sep 10 12:58:36.626431 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3728/7451] 10.222.0.23 () {60 vars in 1323 bytes} [Sat Sep 10 12:58:36 2022] POST /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df/os-volume_attachments => generated 194 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:58:47.397433 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e1c10e2f-7d9b-4524-a5e7-5b1515964daa tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:58:47.397996 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e1c10e2f-7d9b-4524-a5e7-5b1515964daa tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:58:47.400970 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=17 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:58:47.401625 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=64 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:58:47.407576 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e1c10e2f-7d9b-4524-a5e7-5b1515964daa tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:47.408061 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e1c10e2f-7d9b-4524-a5e7-5b1515964daa tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:47.408502 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e1c10e2f-7d9b-4524-a5e7-5b1515964daa tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:47.409201 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e1c10e2f-7d9b-4524-a5e7-5b1515964daa tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:47.409955 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e1c10e2f-7d9b-4524-a5e7-5b1515964daa tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:47.410395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e1c10e2f-7d9b-4524-a5e7-5b1515964daa tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:47.541549 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e1c10e2f-7d9b-4524-a5e7-5b1515964daa tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:58:47.549743 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e1c10e2f-7d9b-4524-a5e7-5b1515964daa tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df" status: 200 len: 1593 microversion: 2.1 time: 0.156376 Sep 10 12:58:47.550320 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3724/7452] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:58:47 2022] GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df => generated 1593 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:58:49.150303 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-9cbbe464-8031-49be-910c-b312804f53d5 req-388459fe-d2b2-484c-94ac-f45f1c019441 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed6d8cd8-d88c-446f-8914-4c2af93a02df", "tag": "4cc25c6b-3e1d-442c-bcb1-ba1ff9b5c1b1"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:58:49.156652 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:58:49.157494 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=17 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:58:49.158373 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:58:49.167275 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-9cbbe464-8031-49be-910c-b312804f53d5 req-388459fe-d2b2-484c-94ac-f45f1c019441 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:49.167871 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-9cbbe464-8031-49be-910c-b312804f53d5 req-388459fe-d2b2-484c-94ac-f45f1c019441 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:49.168423 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-9cbbe464-8031-49be-910c-b312804f53d5 req-388459fe-d2b2-484c-94ac-f45f1c019441 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:49.182830 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-9cbbe464-8031-49be-910c-b312804f53d5 req-388459fe-d2b2-484c-94ac-f45f1c019441 service nova] Creating event network-changed:4cc25c6b-3e1d-442c-bcb1-ba1ff9b5c1b1 for instance ed6d8cd8-d88c-446f-8914-4c2af93a02df on n-h2-856895-1 Sep 10 12:58:49.188211 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-9cbbe464-8031-49be-910c-b312804f53d5 req-388459fe-d2b2-484c-94ac-f45f1c019441 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042129 Sep 10 12:58:49.188840 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3729/7453] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:58:50.257816 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5cb4929c-dbb0-461c-9d47-ad1d502614e8 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1738957513"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:58:50.261368 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5cb4929c-dbb0-461c-9d47-ad1d502614e8 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:58:50.268024 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5cb4929c-dbb0-461c-9d47-ad1d502614e8 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:50.268776 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5cb4929c-dbb0-461c-9d47-ad1d502614e8 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:50.269217 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5cb4929c-dbb0-461c-9d47-ad1d502614e8 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:50.270472 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5cb4929c-dbb0-461c-9d47-ad1d502614e8 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:50.271108 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5cb4929c-dbb0-461c-9d47-ad1d502614e8 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:50.271654 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5cb4929c-dbb0-461c-9d47-ad1d502614e8 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:50.404002 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.network.security_group_api [None req-5cb4929c-dbb0-461c-9d47-ad1d502614e8 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Adding security group 7d921c8a-c755-4993-9465-d88a2e0c4a37 to port 4cc25c6b-3e1d-442c-bcb1-ba1ff9b5c1b1 Sep 10 12:58:50.718494 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5cb4929c-dbb0-461c-9d47-ad1d502614e8 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "POST /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df/action" status: 202 len: 0 microversion: 2.1 time: 0.464998 Sep 10 12:58:50.719140 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3725/7454] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:58:50 2022] POST /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df/action => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:58:50.729467 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-843023e2-52e5-46b2-ada2-8edcaf23f408 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:58:50.731041 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-843023e2-52e5-46b2-ada2-8edcaf23f408 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:58:50.738857 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-843023e2-52e5-46b2-ada2-8edcaf23f408 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:50.739672 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-843023e2-52e5-46b2-ada2-8edcaf23f408 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:50.740135 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-843023e2-52e5-46b2-ada2-8edcaf23f408 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:50.740858 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-843023e2-52e5-46b2-ada2-8edcaf23f408 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:50.741354 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-843023e2-52e5-46b2-ada2-8edcaf23f408 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:50.741803 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-843023e2-52e5-46b2-ada2-8edcaf23f408 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:50.899194 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-843023e2-52e5-46b2-ada2-8edcaf23f408 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:58:50.907666 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-843023e2-52e5-46b2-ada2-8edcaf23f408 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df" status: 200 len: 1759 microversion: 2.1 time: 0.183749 Sep 10 12:58:50.908249 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3730/7455] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:58:50 2022] GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df => generated 1759 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:58:51.202961 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-9832a30a-ca4d-406c-8b5a-df14ee1f70d0 req-f4fef5c3-a496-4c83-825a-5b26f0ebe142 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed6d8cd8-d88c-446f-8914-4c2af93a02df", "tag": "4cc25c6b-3e1d-442c-bcb1-ba1ff9b5c1b1"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:58:51.213060 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-9832a30a-ca4d-406c-8b5a-df14ee1f70d0 req-f4fef5c3-a496-4c83-825a-5b26f0ebe142 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:58:51.213542 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-9832a30a-ca4d-406c-8b5a-df14ee1f70d0 req-f4fef5c3-a496-4c83-825a-5b26f0ebe142 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:58:51.213972 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-9832a30a-ca4d-406c-8b5a-df14ee1f70d0 req-f4fef5c3-a496-4c83-825a-5b26f0ebe142 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:58:51.226251 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-9832a30a-ca4d-406c-8b5a-df14ee1f70d0 req-f4fef5c3-a496-4c83-825a-5b26f0ebe142 service nova] Creating event network-changed:4cc25c6b-3e1d-442c-bcb1-ba1ff9b5c1b1 for instance ed6d8cd8-d88c-446f-8914-4c2af93a02df on n-h2-856895-1 Sep 10 12:58:51.231842 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-9832a30a-ca4d-406c-8b5a-df14ee1f70d0 req-f4fef5c3-a496-4c83-825a-5b26f0ebe142 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032637 Sep 10 12:58:51.232589 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3726/7456] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:59:05.884811 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-03e73e5d-8e6b-4ce7-8fc7-6a9a711b17e0 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:59:05.887042 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-03e73e5d-8e6b-4ce7-8fc7-6a9a711b17e0 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:59:05.890072 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=4 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:59:05.890926 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=8 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:59:05.898160 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-03e73e5d-8e6b-4ce7-8fc7-6a9a711b17e0 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:05.898585 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-03e73e5d-8e6b-4ce7-8fc7-6a9a711b17e0 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:05.899045 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-03e73e5d-8e6b-4ce7-8fc7-6a9a711b17e0 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:05.899791 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-03e73e5d-8e6b-4ce7-8fc7-6a9a711b17e0 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:05.900270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-03e73e5d-8e6b-4ce7-8fc7-6a9a711b17e0 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:05.900715 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-03e73e5d-8e6b-4ce7-8fc7-6a9a711b17e0 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:05.977182 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-03e73e5d-8e6b-4ce7-8fc7-6a9a711b17e0 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "POST /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df/action" status: 202 len: 0 microversion: 2.1 time: 0.096803 Sep 10 12:59:05.978076 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3731/7457] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:59:05 2022] POST /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:59:05.986917 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-544571cd-aa1e-42d1-a466-e69ef673f399 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:59:05.995336 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-544571cd-aa1e-42d1-a466-e69ef673f399 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:59:05.997940 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:59:05.998563 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=12 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:59:06.005060 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-544571cd-aa1e-42d1-a466-e69ef673f399 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:06.005561 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-544571cd-aa1e-42d1-a466-e69ef673f399 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:06.006602 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-544571cd-aa1e-42d1-a466-e69ef673f399 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:06.007429 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-544571cd-aa1e-42d1-a466-e69ef673f399 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:06.007894 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-544571cd-aa1e-42d1-a466-e69ef673f399 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:06.009204 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-544571cd-aa1e-42d1-a466-e69ef673f399 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:06.162349 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-544571cd-aa1e-42d1-a466-e69ef673f399 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:59:06.170985 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-544571cd-aa1e-42d1-a466-e69ef673f399 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df" status: 200 len: 1751 microversion: 2.1 time: 0.188364 Sep 10 12:59:06.171625 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3727/7458] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:59:05 2022] GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df => generated 1751 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:59:07.196607 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6fa2fc87-7a15-4abb-8355-bab4f7521353 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:59:07.197321 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6fa2fc87-7a15-4abb-8355-bab4f7521353 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:59:07.203513 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6fa2fc87-7a15-4abb-8355-bab4f7521353 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:07.204005 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6fa2fc87-7a15-4abb-8355-bab4f7521353 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:07.204450 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6fa2fc87-7a15-4abb-8355-bab4f7521353 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:07.205147 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6fa2fc87-7a15-4abb-8355-bab4f7521353 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:07.205609 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6fa2fc87-7a15-4abb-8355-bab4f7521353 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:07.206046 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6fa2fc87-7a15-4abb-8355-bab4f7521353 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:07.353594 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6fa2fc87-7a15-4abb-8355-bab4f7521353 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:59:07.361973 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6fa2fc87-7a15-4abb-8355-bab4f7521353 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df" status: 200 len: 1756 microversion: 2.1 time: 0.170927 Sep 10 12:59:07.362552 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3732/7459] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:59:07 2022] GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:59:08.386706 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ef3277b5-3e3c-4754-b899-58fcac04d373 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:59:08.387273 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ef3277b5-3e3c-4754-b899-58fcac04d373 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:59:08.397755 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ef3277b5-3e3c-4754-b899-58fcac04d373 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:08.398373 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ef3277b5-3e3c-4754-b899-58fcac04d373 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:08.398833 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ef3277b5-3e3c-4754-b899-58fcac04d373 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:08.399576 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ef3277b5-3e3c-4754-b899-58fcac04d373 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:08.400043 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ef3277b5-3e3c-4754-b899-58fcac04d373 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:08.400477 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ef3277b5-3e3c-4754-b899-58fcac04d373 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:08.544096 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ef3277b5-3e3c-4754-b899-58fcac04d373 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:59:08.552505 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ef3277b5-3e3c-4754-b899-58fcac04d373 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df" status: 200 len: 1756 microversion: 2.1 time: 0.169806 Sep 10 12:59:08.553350 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3728/7460] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:59:08 2022] GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:59:09.576597 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a1dffbfe-4de2-4da3-b951-a81ef909d053 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:59:09.577232 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a1dffbfe-4de2-4da3-b951-a81ef909d053 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:59:09.584919 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a1dffbfe-4de2-4da3-b951-a81ef909d053 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:09.585426 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a1dffbfe-4de2-4da3-b951-a81ef909d053 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:09.585891 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a1dffbfe-4de2-4da3-b951-a81ef909d053 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:09.586589 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a1dffbfe-4de2-4da3-b951-a81ef909d053 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:09.587063 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a1dffbfe-4de2-4da3-b951-a81ef909d053 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:09.587532 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a1dffbfe-4de2-4da3-b951-a81ef909d053 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:09.734358 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a1dffbfe-4de2-4da3-b951-a81ef909d053 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:59:09.742797 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a1dffbfe-4de2-4da3-b951-a81ef909d053 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df" status: 200 len: 1756 microversion: 2.1 time: 0.170127 Sep 10 12:59:09.743409 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3733/7461] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:59:09 2022] GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:59:10.766408 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ebcfd466-733c-47d9-a713-6c8049cdf206 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:59:10.766976 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ebcfd466-733c-47d9-a713-6c8049cdf206 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:59:10.774334 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ebcfd466-733c-47d9-a713-6c8049cdf206 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:10.774870 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ebcfd466-733c-47d9-a713-6c8049cdf206 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:10.775334 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ebcfd466-733c-47d9-a713-6c8049cdf206 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:10.776026 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ebcfd466-733c-47d9-a713-6c8049cdf206 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:10.776479 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ebcfd466-733c-47d9-a713-6c8049cdf206 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:10.776905 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ebcfd466-733c-47d9-a713-6c8049cdf206 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:10.923346 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ebcfd466-733c-47d9-a713-6c8049cdf206 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:59:10.931707 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ebcfd466-733c-47d9-a713-6c8049cdf206 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df" status: 200 len: 1756 microversion: 2.1 time: 0.169317 Sep 10 12:59:10.932290 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3729/7462] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:59:10 2022] GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:59:11.956029 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-60ced6e9-f847-467d-b996-ce77e52be1c3 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:59:11.956687 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-60ced6e9-f847-467d-b996-ce77e52be1c3 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:59:11.963607 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60ced6e9-f847-467d-b996-ce77e52be1c3 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:11.964100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60ced6e9-f847-467d-b996-ce77e52be1c3 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:11.964544 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60ced6e9-f847-467d-b996-ce77e52be1c3 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:11.965241 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60ced6e9-f847-467d-b996-ce77e52be1c3 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:11.965704 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60ced6e9-f847-467d-b996-ce77e52be1c3 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:11.966141 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-60ced6e9-f847-467d-b996-ce77e52be1c3 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:12.111081 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-60ced6e9-f847-467d-b996-ce77e52be1c3 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:59:12.120747 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-60ced6e9-f847-467d-b996-ce77e52be1c3 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df" status: 200 len: 1756 microversion: 2.1 time: 0.168532 Sep 10 12:59:12.121337 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3734/7463] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:59:11 2022] GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:59:13.145264 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ff91b55e-8870-4fff-b959-c51733f2ffb9 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:59:13.145892 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ff91b55e-8870-4fff-b959-c51733f2ffb9 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:59:13.153433 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ff91b55e-8870-4fff-b959-c51733f2ffb9 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:13.154183 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ff91b55e-8870-4fff-b959-c51733f2ffb9 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:13.154779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ff91b55e-8870-4fff-b959-c51733f2ffb9 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:13.155522 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ff91b55e-8870-4fff-b959-c51733f2ffb9 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:13.155987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ff91b55e-8870-4fff-b959-c51733f2ffb9 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:13.156422 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ff91b55e-8870-4fff-b959-c51733f2ffb9 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:13.303611 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ff91b55e-8870-4fff-b959-c51733f2ffb9 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:59:13.311892 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ff91b55e-8870-4fff-b959-c51733f2ffb9 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df" status: 200 len: 1756 microversion: 2.1 time: 0.170601 Sep 10 12:59:13.312465 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3730/7464] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:59:13 2022] GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:59:14.336128 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2233f50b-8f70-42ea-b3a3-fdbc4e53e9e2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:59:14.336759 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2233f50b-8f70-42ea-b3a3-fdbc4e53e9e2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:59:14.343577 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2233f50b-8f70-42ea-b3a3-fdbc4e53e9e2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:14.344070 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2233f50b-8f70-42ea-b3a3-fdbc4e53e9e2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:14.344539 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2233f50b-8f70-42ea-b3a3-fdbc4e53e9e2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:14.345238 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2233f50b-8f70-42ea-b3a3-fdbc4e53e9e2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:14.345703 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2233f50b-8f70-42ea-b3a3-fdbc4e53e9e2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:14.346140 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2233f50b-8f70-42ea-b3a3-fdbc4e53e9e2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:14.490947 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2233f50b-8f70-42ea-b3a3-fdbc4e53e9e2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:59:14.499596 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2233f50b-8f70-42ea-b3a3-fdbc4e53e9e2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df" status: 200 len: 1756 microversion: 2.1 time: 0.167919 Sep 10 12:59:14.500188 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3735/7465] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:59:14 2022] GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 12:59:15.524670 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-88c3886d-bae1-4a95-9607-eb9513bbf8cb tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:59:15.525297 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-88c3886d-bae1-4a95-9607-eb9513bbf8cb tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:59:15.532149 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-88c3886d-bae1-4a95-9607-eb9513bbf8cb tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:15.532638 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-88c3886d-bae1-4a95-9607-eb9513bbf8cb tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:15.533077 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-88c3886d-bae1-4a95-9607-eb9513bbf8cb tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:15.533771 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-88c3886d-bae1-4a95-9607-eb9513bbf8cb tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:15.534227 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-88c3886d-bae1-4a95-9607-eb9513bbf8cb tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:15.534656 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-88c3886d-bae1-4a95-9607-eb9513bbf8cb tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:15.680061 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-88c3886d-bae1-4a95-9607-eb9513bbf8cb tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:59:15.688258 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-88c3886d-bae1-4a95-9607-eb9513bbf8cb tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df" status: 200 len: 1756 microversion: 2.1 time: 0.168289 Sep 10 12:59:15.688861 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3731/7466] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:59:15 2022] GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:59:16.713803 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f18aea75-edc6-4343-aaff-00fd5998cd26 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:59:16.714446 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f18aea75-edc6-4343-aaff-00fd5998cd26 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:59:16.721496 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f18aea75-edc6-4343-aaff-00fd5998cd26 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:16.721996 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f18aea75-edc6-4343-aaff-00fd5998cd26 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:16.722454 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f18aea75-edc6-4343-aaff-00fd5998cd26 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:16.723178 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f18aea75-edc6-4343-aaff-00fd5998cd26 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:16.723661 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f18aea75-edc6-4343-aaff-00fd5998cd26 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:16.724108 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f18aea75-edc6-4343-aaff-00fd5998cd26 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:16.868722 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f18aea75-edc6-4343-aaff-00fd5998cd26 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:59:16.877137 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f18aea75-edc6-4343-aaff-00fd5998cd26 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df" status: 200 len: 1756 microversion: 2.1 time: 0.167352 Sep 10 12:59:16.877720 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3736/7467] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:59:16 2022] GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:59:17.902091 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0af43abb-2423-4050-9c3d-2420b4dff283 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:59:17.902720 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0af43abb-2423-4050-9c3d-2420b4dff283 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:59:17.909872 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0af43abb-2423-4050-9c3d-2420b4dff283 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:17.910362 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0af43abb-2423-4050-9c3d-2420b4dff283 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:17.910808 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0af43abb-2423-4050-9c3d-2420b4dff283 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:17.911570 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0af43abb-2423-4050-9c3d-2420b4dff283 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:17.912698 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0af43abb-2423-4050-9c3d-2420b4dff283 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:17.913133 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0af43abb-2423-4050-9c3d-2420b4dff283 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:18.064224 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0af43abb-2423-4050-9c3d-2420b4dff283 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 12:59:18.072647 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0af43abb-2423-4050-9c3d-2420b4dff283 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df" status: 200 len: 1759 microversion: 2.1 time: 0.174483 Sep 10 12:59:18.073167 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3732/7468] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 12:59:17 2022] GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df => generated 1759 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 12:59:50.338334 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f7117359-b297-4919-8beb-b685e1dac988 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1738957513"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:59:50.338938 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f7117359-b297-4919-8beb-b685e1dac988 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:59:50.341247 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=12 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:59:50.341932 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:59:50.342961 n-d-856895-1 devstack@n-api.service[128776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 12:59:50.343101 n-d-856895-1 devstack@n-api.service[128776]: Sat Sep 10 12:59:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df/action (ip 10.222.0.23) !!! Sep 10 12:59:50.357627 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f7117359-b297-4919-8beb-b685e1dac988 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:50.358130 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f7117359-b297-4919-8beb-b685e1dac988 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:50.358592 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f7117359-b297-4919-8beb-b685e1dac988 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:50.359344 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f7117359-b297-4919-8beb-b685e1dac988 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:50.359819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f7117359-b297-4919-8beb-b685e1dac988 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:50.360262 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f7117359-b297-4919-8beb-b685e1dac988 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:50.495778 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.network.security_group_api [None req-f7117359-b297-4919-8beb-b685e1dac988 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Removing security group 7d921c8a-c755-4993-9465-d88a2e0c4a37 from port 4cc25c6b-3e1d-442c-bcb1-ba1ff9b5c1b1 Sep 10 12:59:50.800913 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f7117359-b297-4919-8beb-b685e1dac988 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "POST /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df/action" status: 202 len: 0 microversion: 2.1 time: 0.467144 Sep 10 12:59:50.801694 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3737/7469] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 12:59:50 2022] POST /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df/action => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:59:50.830123 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-1675593e-10f1-4c61-909b-f9f0def9f3c6 req-c0007671-1449-4436-b7a3-2a5c6fae294f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed6d8cd8-d88c-446f-8914-4c2af93a02df", "tag": "4cc25c6b-3e1d-442c-bcb1-ba1ff9b5c1b1"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:59:50.835744 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=12 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:59:50.836568 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=36 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 12:59:50.857991 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-1675593e-10f1-4c61-909b-f9f0def9f3c6 req-c0007671-1449-4436-b7a3-2a5c6fae294f service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:50.858484 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-1675593e-10f1-4c61-909b-f9f0def9f3c6 req-c0007671-1449-4436-b7a3-2a5c6fae294f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:50.858921 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-1675593e-10f1-4c61-909b-f9f0def9f3c6 req-c0007671-1449-4436-b7a3-2a5c6fae294f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:50.889171 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-1675593e-10f1-4c61-909b-f9f0def9f3c6 req-c0007671-1449-4436-b7a3-2a5c6fae294f service nova] Creating event network-changed:4cc25c6b-3e1d-442c-bcb1-ba1ff9b5c1b1 for instance ed6d8cd8-d88c-446f-8914-4c2af93a02df on n-h2-856895-1 Sep 10 12:59:50.895197 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-1675593e-10f1-4c61-909b-f9f0def9f3c6 req-c0007671-1449-4436-b7a3-2a5c6fae294f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068993 Sep 10 12:59:50.895917 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3733/7470] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:59:52.222255 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2f1d9f0d-2956-42ac-b372-dc48ba7de9b2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:59:52.222853 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2f1d9f0d-2956-42ac-b372-dc48ba7de9b2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:59:52.229119 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f1d9f0d-2956-42ac-b372-dc48ba7de9b2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:52.229691 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f1d9f0d-2956-42ac-b372-dc48ba7de9b2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:52.230214 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f1d9f0d-2956-42ac-b372-dc48ba7de9b2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:52.230983 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f1d9f0d-2956-42ac-b372-dc48ba7de9b2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:52.231489 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f1d9f0d-2956-42ac-b372-dc48ba7de9b2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:52.231944 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f1d9f0d-2956-42ac-b372-dc48ba7de9b2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:52.317461 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-2f1d9f0d-2956-42ac-b372-dc48ba7de9b2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lazy-loading 'services' on Instance uuid ed6d8cd8-d88c-446f-8914-4c2af93a02df {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 12:59:52.393570 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2f1d9f0d-2956-42ac-b372-dc48ba7de9b2 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df/os-volume_attachments/6e30e08b-6d9b-43f7-bb29-8a849d8c1764" status: 202 len: 0 microversion: 2.1 time: 0.176206 Sep 10 12:59:52.397599 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3738/7471] 10.222.0.23 () {58 vars in 1416 bytes} [Sat Sep 10 12:59:52 2022] DELETE /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df/os-volume_attachments/6e30e08b-6d9b-43f7-bb29-8a849d8c1764 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 12:59:52.404379 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-82be400d-98ba-4e50-a222-7db8690ed2ad tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:59:52.406879 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-82be400d-98ba-4e50-a222-7db8690ed2ad tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:59:52.413739 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82be400d-98ba-4e50-a222-7db8690ed2ad tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:52.414289 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82be400d-98ba-4e50-a222-7db8690ed2ad tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:52.414996 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82be400d-98ba-4e50-a222-7db8690ed2ad tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:52.415986 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82be400d-98ba-4e50-a222-7db8690ed2ad tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:52.416440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82be400d-98ba-4e50-a222-7db8690ed2ad tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:52.417057 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-82be400d-98ba-4e50-a222-7db8690ed2ad tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:52.455187 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-82be400d-98ba-4e50-a222-7db8690ed2ad tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056287 Sep 10 12:59:52.455786 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3734/7472] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:59:52 2022] GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 12:59:52.912219 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-afb44cc8-4bdc-4f9b-b8d1-e30e86fa4fc8 req-5551f08b-2feb-413b-8073-0ac0b1b47974 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed6d8cd8-d88c-446f-8914-4c2af93a02df", "tag": "4cc25c6b-3e1d-442c-bcb1-ba1ff9b5c1b1"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 12:59:52.923096 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-afb44cc8-4bdc-4f9b-b8d1-e30e86fa4fc8 req-5551f08b-2feb-413b-8073-0ac0b1b47974 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:52.923648 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-afb44cc8-4bdc-4f9b-b8d1-e30e86fa4fc8 req-5551f08b-2feb-413b-8073-0ac0b1b47974 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:52.924104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-afb44cc8-4bdc-4f9b-b8d1-e30e86fa4fc8 req-5551f08b-2feb-413b-8073-0ac0b1b47974 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:52.936896 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-afb44cc8-4bdc-4f9b-b8d1-e30e86fa4fc8 req-5551f08b-2feb-413b-8073-0ac0b1b47974 service nova] Creating event network-changed:4cc25c6b-3e1d-442c-bcb1-ba1ff9b5c1b1 for instance ed6d8cd8-d88c-446f-8914-4c2af93a02df on n-h2-856895-1 Sep 10 12:59:52.941986 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-afb44cc8-4bdc-4f9b-b8d1-e30e86fa4fc8 req-5551f08b-2feb-413b-8073-0ac0b1b47974 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033775 Sep 10 12:59:52.942696 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3739/7473] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 12:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:59:53.468607 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a546bee8-9bca-439e-b73b-401dc5bd36a4 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:59:53.470817 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a546bee8-9bca-439e-b73b-401dc5bd36a4 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:59:53.478395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a546bee8-9bca-439e-b73b-401dc5bd36a4 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:53.479170 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a546bee8-9bca-439e-b73b-401dc5bd36a4 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:53.479626 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a546bee8-9bca-439e-b73b-401dc5bd36a4 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:53.480336 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a546bee8-9bca-439e-b73b-401dc5bd36a4 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:53.480795 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a546bee8-9bca-439e-b73b-401dc5bd36a4 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:53.481220 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a546bee8-9bca-439e-b73b-401dc5bd36a4 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:53.514433 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a546bee8-9bca-439e-b73b-401dc5bd36a4 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049824 Sep 10 12:59:53.515024 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3735/7474] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:59:53 2022] GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:59:54.528348 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7d71caf6-020d-4214-83f3-6ef68553791b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:59:54.530948 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7d71caf6-020d-4214-83f3-6ef68553791b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:59:54.537329 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d71caf6-020d-4214-83f3-6ef68553791b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:54.537899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d71caf6-020d-4214-83f3-6ef68553791b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:54.538422 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d71caf6-020d-4214-83f3-6ef68553791b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:54.539223 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d71caf6-020d-4214-83f3-6ef68553791b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:54.539764 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d71caf6-020d-4214-83f3-6ef68553791b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:54.540396 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7d71caf6-020d-4214-83f3-6ef68553791b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:54.570431 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7d71caf6-020d-4214-83f3-6ef68553791b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047556 Sep 10 12:59:54.571007 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3740/7475] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:59:54 2022] GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:59:55.583915 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fc5f4522-4f5d-4763-8400-8abf5e4baee6 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:59:55.586040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fc5f4522-4f5d-4763-8400-8abf5e4baee6 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:59:55.593898 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc5f4522-4f5d-4763-8400-8abf5e4baee6 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:55.594378 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc5f4522-4f5d-4763-8400-8abf5e4baee6 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:55.594814 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc5f4522-4f5d-4763-8400-8abf5e4baee6 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:55.595532 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc5f4522-4f5d-4763-8400-8abf5e4baee6 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:55.595987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc5f4522-4f5d-4763-8400-8abf5e4baee6 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:55.596411 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc5f4522-4f5d-4763-8400-8abf5e4baee6 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:55.627036 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fc5f4522-4f5d-4763-8400-8abf5e4baee6 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047285 Sep 10 12:59:55.627639 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3736/7476] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:59:55 2022] GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:59:56.639624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4f00d0ea-3f90-4e19-887d-596ccccda8ab tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:59:56.641904 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4f00d0ea-3f90-4e19-887d-596ccccda8ab tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:59:56.648985 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f00d0ea-3f90-4e19-887d-596ccccda8ab tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:56.649529 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f00d0ea-3f90-4e19-887d-596ccccda8ab tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:56.650197 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f00d0ea-3f90-4e19-887d-596ccccda8ab tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:56.650911 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f00d0ea-3f90-4e19-887d-596ccccda8ab tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:56.651417 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f00d0ea-3f90-4e19-887d-596ccccda8ab tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:56.651870 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4f00d0ea-3f90-4e19-887d-596ccccda8ab tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:56.682864 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4f00d0ea-3f90-4e19-887d-596ccccda8ab tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047195 Sep 10 12:59:56.683546 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3741/7477] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:59:56 2022] GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 12:59:57.695661 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c408278f-860f-4c84-a124-eb6209eef45b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:59:57.697939 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c408278f-860f-4c84-a124-eb6209eef45b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:59:57.704752 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c408278f-860f-4c84-a124-eb6209eef45b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:57.705242 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c408278f-860f-4c84-a124-eb6209eef45b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:57.705676 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c408278f-860f-4c84-a124-eb6209eef45b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:57.706367 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c408278f-860f-4c84-a124-eb6209eef45b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:57.706823 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c408278f-860f-4c84-a124-eb6209eef45b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:57.707278 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c408278f-860f-4c84-a124-eb6209eef45b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:57.736256 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c408278f-860f-4c84-a124-eb6209eef45b tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044753 Sep 10 12:59:57.736816 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3737/7478] 10.222.0.23 () {58 vars in 1302 bytes} [Sat Sep 10 12:59:57 2022] GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 10 12:59:57.747684 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0d03e778-5eb1-4013-be14-7345caf20e5a tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 12:59:57.748202 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0d03e778-5eb1-4013-be14-7345caf20e5a tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 12:59:57.755034 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0d03e778-5eb1-4013-be14-7345caf20e5a tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:57.755576 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0d03e778-5eb1-4013-be14-7345caf20e5a tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:57.756301 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0d03e778-5eb1-4013-be14-7345caf20e5a tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:57.757013 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0d03e778-5eb1-4013-be14-7345caf20e5a tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 12:59:57.757486 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0d03e778-5eb1-4013-be14-7345caf20e5a tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 12:59:57.757930 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0d03e778-5eb1-4013-be14-7345caf20e5a tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 12:59:57.832836 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-0d03e778-5eb1-4013-be14-7345caf20e5a tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] HTTP exception thrown: Instance ed6d8cd8-d88c-446f-8914-4c2af93a02df is not attached to volume 6e30e08b-6d9b-43f7-bb29-8a849d8c1764 Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0d03e778-5eb1-4013-be14-7345caf20e5a tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Request method failure captured: Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: request: DELETE /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df/os-volume_attachments/6e30e08b-6d9b-43f7-bb29-8a849d8c1764 HTTP/1.1 Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHIi1Qk0bksgLkDc0FUxb-TEKzrp0reUCImmwkPDUOvkRoYxAv2k14oyAGA3Sv14TlYkxTv-dUFISqZQu5qvFeOiBy9enkNZ2ewCstHQZ5gnISiMMSKg-GLAdzrnrw1Ioco649H6Jpzp5Ue8j9e9OHVQJxgEVsjnHi3eD-TbEqGmo3E0 Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 31812e3dc2ce4af2a2a8c931bb99946a Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-TestMinimumBasicScenario-951454077 Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31812e3dc2ce4af2a2a8c931bb99946a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31812e3dc2ce4af2a2a8c931bb99946a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_31812e3dc2ce4af2a2a8c931bb99946a", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/31812e3dc2ce4af2a2a8c931bb99946a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-TestMinimumBasicScenario-951454077 Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 31812e3dc2ce4af2a2a8c931bb99946a Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-TestMinimumBasicScenario-951454077 Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-TestMinimumBasicScenario-951454077-project Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 6e40e6a5c7eb4760b3f39c382a1bbc28 Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-TestMinimumBasicScenario-951454077-project Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance ed6d8cd8-d88c-446f-8914-4c2af93a02df is not attached to volume 6e30e08b-6d9b-43f7-bb29-8a849d8c1764 Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'server_id': 'ed6d8cd8-d88c-446f-8914-4c2af93a02df', 'id': '6e30e08b-6d9b-43f7-bb29-8a849d8c1764'} Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6e30e08b-6d9b-43f7-bb29-8a849d8c1764. Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed6d8cd8-d88c-446f-8914-4c2af93a02df is not attached to volume 6e30e08b-6d9b-43f7-bb29-8a849d8c1764 Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 12:59:57.834466 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 12:59:57.840022 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 12:59:57.840022 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 12:59:57.840022 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed6d8cd8-d88c-446f-8914-4c2af93a02df is not attached to volume 6e30e08b-6d9b-43f7-bb29-8a849d8c1764 Sep 10 12:59:57.840022 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 12:59:57.840022 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0d03e778-5eb1-4013-be14-7345caf20e5a tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Returning 404 to user: Instance ed6d8cd8-d88c-446f-8914-4c2af93a02df is not attached to volume 6e30e08b-6d9b-43f7-bb29-8a849d8c1764 {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 12:59:57.840022 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0d03e778-5eb1-4013-be14-7345caf20e5a tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df/os-volume_attachments/6e30e08b-6d9b-43f7-bb29-8a849d8c1764" status: 404 len: 154 microversion: 2.1 time: 0.092650 Sep 10 12:59:57.840022 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3742/7479] 10.222.0.23 () {58 vars in 1416 bytes} [Sat Sep 10 12:59:57 2022] DELETE /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df/os-volume_attachments/6e30e08b-6d9b-43f7-bb29-8a849d8c1764 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 13:00:01.092043 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ee06459a-07cc-406f-a973-ca980e4b285e tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:00:01.092553 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ee06459a-07cc-406f-a973-ca980e4b285e tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:00:01.098437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee06459a-07cc-406f-a973-ca980e4b285e tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:00:01.098920 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee06459a-07cc-406f-a973-ca980e4b285e tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:00:01.099394 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee06459a-07cc-406f-a973-ca980e4b285e tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:00:01.100086 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee06459a-07cc-406f-a973-ca980e4b285e tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:00:01.100574 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee06459a-07cc-406f-a973-ca980e4b285e tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:00:01.100997 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee06459a-07cc-406f-a973-ca980e4b285e tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:00:01.129617 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ee06459a-07cc-406f-a973-ca980e4b285e tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 13:00:01.213128 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ee06459a-07cc-406f-a973-ca980e4b285e tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df" status: 204 len: 0 microversion: 2.1 time: 0.125861 Sep 10 13:00:01.213993 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3738/7480] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 13:00:01 2022] DELETE /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 13:00:01.222106 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-29afe243-36e3-4366-b17b-e5149ebaf041 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:00:01.222837 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-29afe243-36e3-4366-b17b-e5149ebaf041 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:00:01.231498 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-29afe243-36e3-4366-b17b-e5149ebaf041 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:00:01.232029 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-29afe243-36e3-4366-b17b-e5149ebaf041 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:00:01.232502 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-29afe243-36e3-4366-b17b-e5149ebaf041 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:00:01.233214 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-29afe243-36e3-4366-b17b-e5149ebaf041 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:00:01.233682 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-29afe243-36e3-4366-b17b-e5149ebaf041 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:00:01.234119 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-29afe243-36e3-4366-b17b-e5149ebaf041 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:00:01.367637 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-29afe243-36e3-4366-b17b-e5149ebaf041 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:00:01.375970 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-29afe243-36e3-4366-b17b-e5149ebaf041 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df" status: 200 len: 1553 microversion: 2.1 time: 0.157779 Sep 10 13:00:01.376645 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3743/7481] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:00:01 2022] GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:00:02.400576 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2b697600-0b08-40bf-9030-205c3b1393ef tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:00:02.401204 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2b697600-0b08-40bf-9030-205c3b1393ef tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:00:02.408728 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b697600-0b08-40bf-9030-205c3b1393ef tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:00:02.409218 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b697600-0b08-40bf-9030-205c3b1393ef tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:00:02.409658 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b697600-0b08-40bf-9030-205c3b1393ef tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:00:02.410354 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b697600-0b08-40bf-9030-205c3b1393ef tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:00:02.410811 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b697600-0b08-40bf-9030-205c3b1393ef tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:00:02.411265 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2b697600-0b08-40bf-9030-205c3b1393ef tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:00:02.544412 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2b697600-0b08-40bf-9030-205c3b1393ef tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:00:02.552319 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2b697600-0b08-40bf-9030-205c3b1393ef tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df" status: 200 len: 1553 microversion: 2.1 time: 0.156289 Sep 10 13:00:02.552911 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3739/7482] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:00:02 2022] GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:00:03.510919 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-934200bf-509c-4f91-9ceb-e209eed5bec6 req-a4a42819-e488-42c8-abf2-91f79e47c1e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed6d8cd8-d88c-446f-8914-4c2af93a02df", "name": "network-vif-deleted", "tag": "4cc25c6b-3e1d-442c-bcb1-ba1ff9b5c1b1"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:00:03.520884 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-934200bf-509c-4f91-9ceb-e209eed5bec6 req-a4a42819-e488-42c8-abf2-91f79e47c1e7 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:00:03.521383 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-934200bf-509c-4f91-9ceb-e209eed5bec6 req-a4a42819-e488-42c8-abf2-91f79e47c1e7 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:00:03.521828 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-934200bf-509c-4f91-9ceb-e209eed5bec6 req-a4a42819-e488-42c8-abf2-91f79e47c1e7 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:00:03.534320 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-934200bf-509c-4f91-9ceb-e209eed5bec6 req-a4a42819-e488-42c8-abf2-91f79e47c1e7 service nova] Creating event network-vif-deleted:4cc25c6b-3e1d-442c-bcb1-ba1ff9b5c1b1 for instance ed6d8cd8-d88c-446f-8914-4c2af93a02df on n-h2-856895-1 Sep 10 13:00:03.539469 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-934200bf-509c-4f91-9ceb-e209eed5bec6 req-a4a42819-e488-42c8-abf2-91f79e47c1e7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103153 Sep 10 13:00:03.540926 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3744/7483] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:00:03.577650 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-924bdae5-fca2-4000-873e-cf308313e463 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:00:03.578269 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-924bdae5-fca2-4000-873e-cf308313e463 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:00:03.585009 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-924bdae5-fca2-4000-873e-cf308313e463 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:00:03.585498 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-924bdae5-fca2-4000-873e-cf308313e463 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:00:03.585936 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-924bdae5-fca2-4000-873e-cf308313e463 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:00:03.586631 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-924bdae5-fca2-4000-873e-cf308313e463 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:00:03.587662 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-924bdae5-fca2-4000-873e-cf308313e463 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:00:03.588277 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-924bdae5-fca2-4000-873e-cf308313e463 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:00:03.619949 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-924bdae5-fca2-4000-873e-cf308313e463 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:00:03.620435 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-924bdae5-fca2-4000-873e-cf308313e463 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:00:03.620877 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-924bdae5-fca2-4000-873e-cf308313e463 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:00:03.621326 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-924bdae5-fca2-4000-873e-cf308313e463 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lazy-loading 'fault' on Instance uuid ed6d8cd8-d88c-446f-8914-4c2af93a02df {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 13:00:03.661981 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-924bdae5-fca2-4000-873e-cf308313e463 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e40e6a5c7eb4760b3f39c382a1bbc28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31812e3dc2ce4af2a2a8c931bb99946a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:00:03.670379 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-924bdae5-fca2-4000-873e-cf308313e463 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df" status: 200 len: 1347 microversion: 2.1 time: 0.096616 Sep 10 13:00:03.670956 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3740/7484] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:00:03 2022] GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df => generated 1347 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:00:04.696614 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-484adbd0-4d46-421d-9eec-f528874dcc40 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:00:04.697411 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-484adbd0-4d46-421d-9eec-f528874dcc40 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] [instance: ed6d8cd8-d88c-446f-8914-4c2af93a02df] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:00:04.703761 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-484adbd0-4d46-421d-9eec-f528874dcc40 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:00:04.704310 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-484adbd0-4d46-421d-9eec-f528874dcc40 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:00:04.704763 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-484adbd0-4d46-421d-9eec-f528874dcc40 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:00:04.705466 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-484adbd0-4d46-421d-9eec-f528874dcc40 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:00:04.705932 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-484adbd0-4d46-421d-9eec-f528874dcc40 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:00:04.706373 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-484adbd0-4d46-421d-9eec-f528874dcc40 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:00:04.722446 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-484adbd0-4d46-421d-9eec-f528874dcc40 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] HTTP exception thrown: Instance ed6d8cd8-d88c-446f-8914-4c2af93a02df could not be found. Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-484adbd0-4d46-421d-9eec-f528874dcc40 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Request method failure captured: Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df HTTP/1.1 Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHIi1Qk0bksgLkDc0FUxb-TEKzrp0reUCImmwkPDUOvkRoYxAv2k14oyAGA3Sv14TlYkxTv-dUFISqZQu5qvFeOiBy9enkNZ2ewCstHQZ5gnISiMMSKg-GLAdzrnrw1Ioco649H6Jpzp5Ue8j9e9OHVQJxgEVsjnHi3eD-TbEqGmo3E0 Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 31812e3dc2ce4af2a2a8c931bb99946a Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-TestMinimumBasicScenario-951454077 Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31812e3dc2ce4af2a2a8c931bb99946a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/31812e3dc2ce4af2a2a8c931bb99946a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_31812e3dc2ce4af2a2a8c931bb99946a", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/31812e3dc2ce4af2a2a8c931bb99946a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-TestMinimumBasicScenario-951454077 Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 31812e3dc2ce4af2a2a8c931bb99946a Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-TestMinimumBasicScenario-951454077 Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-TestMinimumBasicScenario-951454077-project Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 6e40e6a5c7eb4760b3f39c382a1bbc28 Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-TestMinimumBasicScenario-951454077-project Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance ed6d8cd8-d88c-446f-8914-4c2af93a02df could not be found. Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'ed6d8cd8-d88c-446f-8914-4c2af93a02df'} Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed6d8cd8-d88c-446f-8914-4c2af93a02df could not be found. Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed6d8cd8-d88c-446f-8914-4c2af93a02df could not be found. Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 13:00:04.724131 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 13:00:04.729504 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 13:00:04.729504 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 13:00:04.729504 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 13:00:04.729504 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 13:00:04.729504 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 13:00:04.729504 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed6d8cd8-d88c-446f-8914-4c2af93a02df could not be found. Sep 10 13:00:04.729504 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 13:00:04.729504 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-484adbd0-4d46-421d-9eec-f528874dcc40 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Returning 404 to user: Instance ed6d8cd8-d88c-446f-8914-4c2af93a02df could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 13:00:04.729504 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-484adbd0-4d46-421d-9eec-f528874dcc40 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df" status: 404 len: 111 microversion: 2.1 time: 0.034182 Sep 10 13:00:04.729504 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3745/7485] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:00:04 2022] GET /compute/v2.1/servers/ed6d8cd8-d88c-446f-8914-4c2af93a02df => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 13:00:04.735026 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e798d514-3bd1-423d-a812-e54b3fdcfac8 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] Calling method '.version_select at 0x7f407325c0d0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:00:04.755656 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e798d514-3bd1-423d-a812-e54b3fdcfac8 tempest-TestMinimumBasicScenario-951454077 tempest-TestMinimumBasicScenario-951454077-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-106983883" status: 202 len: 0 microversion: 2.1 time: 0.024414 Sep 10 13:00:04.756518 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3741/7486] 10.222.0.23 () {58 vars in 1269 bytes} [Sat Sep 10 13:00:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-106983883 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 13:00:14.085751 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-02138d9e-6f44-4431-b531-d1808f133b4b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Action: 'create', calling method: .version_select at 0x7f4060702940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-881793719", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNuAtaSiU/abyuLN9uuk+tjv57ziTWiSLAa6J/wh6V6rBAIb39ZZfyNYqUq50WGX1A2SkrDIKMLDYDRzHIT3DJ/Cy1r95niD41F7YYG4sctuchza5MO2cNDflNYYXTJvWw=="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:00:14.101673 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-02138d9e-6f44-4431-b531-d1808f133b4b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Getting quotas for project b0e733e9474c4814b77eddbf547e3a54. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 13:00:14.108406 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-02138d9e-6f44-4431-b531-d1808f133b4b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Getting quotas for user f75e338a6cb34d11a42b65da1eca4f83 and project b0e733e9474c4814b77eddbf547e3a54. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 13:00:14.132948 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-02138d9e-6f44-4431-b531-d1808f133b4b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.225548 Sep 10 13:00:14.133578 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3746/7487] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 13:00:13 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:00:19.941876 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:00:19.949815 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:00:19.959610 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9467d331-f21c-474c-86a6-2659fa92ac2e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1864402924", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "b4f3f033-74b1-4b4d-bc05-8d346f62b44c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-881793719", "security_groups": [{"name": "tempest-secgroup-smoke-300533304"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:00:20.105269 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-9467d331-f21c-474c-86a6-2659fa92ac2e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] validate_networks() for [('b4f3f033-74b1-4b4d-bc05-8d346f62b44c', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 13:00:20.588597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-9467d331-f21c-474c-86a6-2659fa92ac2e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 13:00:20.589558 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-9467d331-f21c-474c-86a6-2659fa92ac2e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 13:00:20.590471 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-9467d331-f21c-474c-86a6-2659fa92ac2e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 13:00:20.591230 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-9467d331-f21c-474c-86a6-2659fa92ac2e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 13:00:20.592049 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-9467d331-f21c-474c-86a6-2659fa92ac2e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 13:00:20.608136 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9467d331-f21c-474c-86a6-2659fa92ac2e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:00:20.609006 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9467d331-f21c-474c-86a6-2659fa92ac2e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:00:20.609756 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9467d331-f21c-474c-86a6-2659fa92ac2e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:00:20.610941 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9467d331-f21c-474c-86a6-2659fa92ac2e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:00:20.611675 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9467d331-f21c-474c-86a6-2659fa92ac2e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:00:20.612326 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9467d331-f21c-474c-86a6-2659fa92ac2e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:00:20.642905 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-9467d331-f21c-474c-86a6-2659fa92ac2e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Getting quotas for project b0e733e9474c4814b77eddbf547e3a54. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 13:00:20.651326 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-9467d331-f21c-474c-86a6-2659fa92ac2e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Getting quotas for user f75e338a6cb34d11a42b65da1eca4f83 and project b0e733e9474c4814b77eddbf547e3a54. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 13:00:20.667440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9467d331-f21c-474c-86a6-2659fa92ac2e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 13:00:20.670700 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9467d331-f21c-474c-86a6-2659fa92ac2e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: ecb89774-cfc0-4309-b701-11d4fe35b568] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 13:00:20.722787 n-d-856895-1 devstack@n-api.service[128777]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9467d331-f21c-474c-86a6-2659fa92ac2e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [0d5c13ae-d458-4ac4-b347-adfca3c710c8] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 10 13:00:21.743883 n-d-856895-1 devstack@n-api.service[128777]: INFO oslo.messaging._drivers.impl_rabbit [None req-9467d331-f21c-474c-86a6-2659fa92ac2e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [0d5c13ae-d458-4ac4-b347-adfca3c710c8] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 37302. Sep 10 13:00:21.769441 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9467d331-f21c-474c-86a6-2659fa92ac2e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.825699 Sep 10 13:00:21.770522 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3742/7488] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 13:00:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 1832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 13:00:21.783669 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-73f1317f-8360-40ba-9ca7-f21983598165 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:00:21.785149 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-73f1317f-8360-40ba-9ca7-f21983598165 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: ecb89774-cfc0-4309-b701-11d4fe35b568] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:00:21.787292 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:00:21.789633 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:00:21.905156 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-73f1317f-8360-40ba-9ca7-f21983598165 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:00:21.914008 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-73f1317f-8360-40ba-9ca7-f21983598165 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568" status: 200 len: 1266 microversion: 2.1 time: 0.134013 Sep 10 13:00:21.916049 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3747/7489] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:00:21 2022] GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568 => generated 1266 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:00:22.940363 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e937ee72-f9c0-4a44-aa2d-db86665fd216 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:00:22.940995 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e937ee72-f9c0-4a44-aa2d-db86665fd216 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: ecb89774-cfc0-4309-b701-11d4fe35b568] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:00:22.949110 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e937ee72-f9c0-4a44-aa2d-db86665fd216 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:00:22.949606 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e937ee72-f9c0-4a44-aa2d-db86665fd216 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:00:22.950048 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e937ee72-f9c0-4a44-aa2d-db86665fd216 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:00:22.950759 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e937ee72-f9c0-4a44-aa2d-db86665fd216 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:00:22.951242 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e937ee72-f9c0-4a44-aa2d-db86665fd216 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:00:22.951677 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e937ee72-f9c0-4a44-aa2d-db86665fd216 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:00:23.018425 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e937ee72-f9c0-4a44-aa2d-db86665fd216 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:00:23.026534 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e937ee72-f9c0-4a44-aa2d-db86665fd216 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568" status: 200 len: 1318 microversion: 2.1 time: 0.091094 Sep 10 13:00:23.027114 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3743/7490] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:00:22 2022] GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568 => generated 1318 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:00:24.049244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ec049187-2ee3-444a-bef3-2162f2e6f751 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:00:24.050156 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ec049187-2ee3-444a-bef3-2162f2e6f751 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: ecb89774-cfc0-4309-b701-11d4fe35b568] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:00:24.058072 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec049187-2ee3-444a-bef3-2162f2e6f751 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:00:24.058667 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec049187-2ee3-444a-bef3-2162f2e6f751 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:00:24.059387 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec049187-2ee3-444a-bef3-2162f2e6f751 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:00:24.060476 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec049187-2ee3-444a-bef3-2162f2e6f751 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:00:24.061153 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec049187-2ee3-444a-bef3-2162f2e6f751 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:00:24.061828 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ec049187-2ee3-444a-bef3-2162f2e6f751 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:00:24.294320 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ec049187-2ee3-444a-bef3-2162f2e6f751 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:00:24.302390 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ec049187-2ee3-444a-bef3-2162f2e6f751 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568" status: 200 len: 1391 microversion: 2.1 time: 0.257030 Sep 10 13:00:24.303023 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3748/7491] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:00:24 2022] GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568 => generated 1391 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:00:24.645878 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-22b280de-ac98-46fb-8fdd-2756da8bebd7 req-bd54ee57-345a-4c2a-a713-64f04c6903c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecb89774-cfc0-4309-b701-11d4fe35b568", "tag": "17f3fb5b-8ab3-4be2-b0c9-7b8b86094b4d"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:00:24.659673 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-22b280de-ac98-46fb-8fdd-2756da8bebd7 req-bd54ee57-345a-4c2a-a713-64f04c6903c8 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:00:24.660110 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-22b280de-ac98-46fb-8fdd-2756da8bebd7 req-bd54ee57-345a-4c2a-a713-64f04c6903c8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:00:24.660545 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-22b280de-ac98-46fb-8fdd-2756da8bebd7 req-bd54ee57-345a-4c2a-a713-64f04c6903c8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:00:24.672777 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-22b280de-ac98-46fb-8fdd-2756da8bebd7 req-bd54ee57-345a-4c2a-a713-64f04c6903c8 service nova] Creating event network-changed:17f3fb5b-8ab3-4be2-b0c9-7b8b86094b4d for instance ecb89774-cfc0-4309-b701-11d4fe35b568 on n-h1-856895-1 Sep 10 13:00:24.678408 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-22b280de-ac98-46fb-8fdd-2756da8bebd7 req-bd54ee57-345a-4c2a-a713-64f04c6903c8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037004 Sep 10 13:00:24.679209 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3744/7492] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:00:25.326682 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f06b53e8-ae15-411b-b789-9eafe9d96616 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:00:25.327255 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f06b53e8-ae15-411b-b789-9eafe9d96616 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: ecb89774-cfc0-4309-b701-11d4fe35b568] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:00:25.334627 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f06b53e8-ae15-411b-b789-9eafe9d96616 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:00:25.334756 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f06b53e8-ae15-411b-b789-9eafe9d96616 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:00:25.335110 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f06b53e8-ae15-411b-b789-9eafe9d96616 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:00:25.335933 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f06b53e8-ae15-411b-b789-9eafe9d96616 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:00:25.336471 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f06b53e8-ae15-411b-b789-9eafe9d96616 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:00:25.337184 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f06b53e8-ae15-411b-b789-9eafe9d96616 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:00:25.468615 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f06b53e8-ae15-411b-b789-9eafe9d96616 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:00:25.476476 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f06b53e8-ae15-411b-b789-9eafe9d96616 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568" status: 200 len: 1391 microversion: 2.1 time: 0.153826 Sep 10 13:00:25.477073 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3749/7493] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:00:25 2022] GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:00:26.503317 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e1e5c1f2-c425-4358-86f7-a4426b7a7b45 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:00:26.503946 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e1e5c1f2-c425-4358-86f7-a4426b7a7b45 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: ecb89774-cfc0-4309-b701-11d4fe35b568] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:00:26.510548 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e1e5c1f2-c425-4358-86f7-a4426b7a7b45 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:00:26.511024 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e1e5c1f2-c425-4358-86f7-a4426b7a7b45 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:00:26.511484 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e1e5c1f2-c425-4358-86f7-a4426b7a7b45 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:00:26.512166 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e1e5c1f2-c425-4358-86f7-a4426b7a7b45 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:00:26.512620 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e1e5c1f2-c425-4358-86f7-a4426b7a7b45 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:00:26.513040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e1e5c1f2-c425-4358-86f7-a4426b7a7b45 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:00:26.643903 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e1e5c1f2-c425-4358-86f7-a4426b7a7b45 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:00:26.651717 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e1e5c1f2-c425-4358-86f7-a4426b7a7b45 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568" status: 200 len: 1391 microversion: 2.1 time: 0.153642 Sep 10 13:00:26.652295 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3745/7494] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:00:26 2022] GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:00:27.675892 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0f7924c3-a48b-4695-b7a2-a8c02c849566 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:00:27.676466 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0f7924c3-a48b-4695-b7a2-a8c02c849566 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: ecb89774-cfc0-4309-b701-11d4fe35b568] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:00:27.683966 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f7924c3-a48b-4695-b7a2-a8c02c849566 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:00:27.684493 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f7924c3-a48b-4695-b7a2-a8c02c849566 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:00:27.684978 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f7924c3-a48b-4695-b7a2-a8c02c849566 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:00:27.685701 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f7924c3-a48b-4695-b7a2-a8c02c849566 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:00:27.686175 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f7924c3-a48b-4695-b7a2-a8c02c849566 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:00:27.686623 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0f7924c3-a48b-4695-b7a2-a8c02c849566 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:00:27.820076 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0f7924c3-a48b-4695-b7a2-a8c02c849566 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:00:27.828569 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0f7924c3-a48b-4695-b7a2-a8c02c849566 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568" status: 200 len: 1391 microversion: 2.1 time: 0.156765 Sep 10 13:00:27.829149 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3750/7495] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:00:27 2022] GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:00:28.852691 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-88f9a1bc-00c7-4f10-84f0-ec4b572acc20 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:00:28.853280 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-88f9a1bc-00c7-4f10-84f0-ec4b572acc20 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: ecb89774-cfc0-4309-b701-11d4fe35b568] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:00:28.860140 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-88f9a1bc-00c7-4f10-84f0-ec4b572acc20 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:00:28.860618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-88f9a1bc-00c7-4f10-84f0-ec4b572acc20 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:00:28.861049 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-88f9a1bc-00c7-4f10-84f0-ec4b572acc20 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:00:28.861732 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-88f9a1bc-00c7-4f10-84f0-ec4b572acc20 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:00:28.862189 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-88f9a1bc-00c7-4f10-84f0-ec4b572acc20 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:00:28.862607 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-88f9a1bc-00c7-4f10-84f0-ec4b572acc20 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:00:28.994907 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-88f9a1bc-00c7-4f10-84f0-ec4b572acc20 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:00:29.002742 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-88f9a1bc-00c7-4f10-84f0-ec4b572acc20 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568" status: 200 len: 1391 microversion: 2.1 time: 0.154296 Sep 10 13:00:29.003405 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3746/7496] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:00:28 2022] GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:00:30.027303 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-67954b0b-b2cc-48b6-aa40-968660ec51bf tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:00:30.027942 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-67954b0b-b2cc-48b6-aa40-968660ec51bf tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: ecb89774-cfc0-4309-b701-11d4fe35b568] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:00:30.034783 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67954b0b-b2cc-48b6-aa40-968660ec51bf tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:00:30.035326 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67954b0b-b2cc-48b6-aa40-968660ec51bf tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:00:30.035783 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67954b0b-b2cc-48b6-aa40-968660ec51bf tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:00:30.036487 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67954b0b-b2cc-48b6-aa40-968660ec51bf tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:00:30.036959 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67954b0b-b2cc-48b6-aa40-968660ec51bf tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:00:30.037405 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-67954b0b-b2cc-48b6-aa40-968660ec51bf tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:00:30.480608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-67954b0b-b2cc-48b6-aa40-968660ec51bf tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:00:30.488774 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-67954b0b-b2cc-48b6-aa40-968660ec51bf tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568" status: 200 len: 1391 microversion: 2.1 time: 0.465913 Sep 10 13:00:30.489631 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3751/7497] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:00:30 2022] GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568 => generated 1391 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:00:31.514436 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cb54c16a-0575-4628-9c2b-566cd361f5fe tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:00:31.515058 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cb54c16a-0575-4628-9c2b-566cd361f5fe tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: ecb89774-cfc0-4309-b701-11d4fe35b568] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:00:31.517845 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:00:31.518512 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:00:31.525011 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb54c16a-0575-4628-9c2b-566cd361f5fe tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:00:31.525616 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb54c16a-0575-4628-9c2b-566cd361f5fe tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:00:31.526059 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb54c16a-0575-4628-9c2b-566cd361f5fe tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:00:31.526822 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb54c16a-0575-4628-9c2b-566cd361f5fe tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:00:31.527304 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb54c16a-0575-4628-9c2b-566cd361f5fe tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:00:31.527731 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cb54c16a-0575-4628-9c2b-566cd361f5fe tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:00:31.658591 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cb54c16a-0575-4628-9c2b-566cd361f5fe tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:00:31.666616 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cb54c16a-0575-4628-9c2b-566cd361f5fe tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568" status: 200 len: 1391 microversion: 2.1 time: 0.156286 Sep 10 13:00:31.667215 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3747/7498] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:00:31 2022] GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:00:32.456447 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-893a147e-4e25-4476-9d0e-89186a6107c2 req-1decce7a-6bf6-4790-9937-a3c62c045bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecb89774-cfc0-4309-b701-11d4fe35b568", "name": "network-vif-plugged", "status": "completed", "tag": "17f3fb5b-8ab3-4be2-b0c9-7b8b86094b4d"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:00:32.463750 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:00:32.470633 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-893a147e-4e25-4476-9d0e-89186a6107c2 req-1decce7a-6bf6-4790-9937-a3c62c045bc8 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:00:32.471231 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-893a147e-4e25-4476-9d0e-89186a6107c2 req-1decce7a-6bf6-4790-9937-a3c62c045bc8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:00:32.471750 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-893a147e-4e25-4476-9d0e-89186a6107c2 req-1decce7a-6bf6-4790-9937-a3c62c045bc8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:00:32.484554 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-893a147e-4e25-4476-9d0e-89186a6107c2 req-1decce7a-6bf6-4790-9937-a3c62c045bc8 service nova] Creating event network-vif-plugged:17f3fb5b-8ab3-4be2-b0c9-7b8b86094b4d for instance ecb89774-cfc0-4309-b701-11d4fe35b568 on n-h1-856895-1 Sep 10 13:00:32.490530 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-893a147e-4e25-4476-9d0e-89186a6107c2 req-1decce7a-6bf6-4790-9937-a3c62c045bc8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038058 Sep 10 13:00:32.492217 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3752/7499] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:00:32.690830 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ac75cfbf-17d1-4101-b097-63d24dd29f13 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:00:32.692606 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ac75cfbf-17d1-4101-b097-63d24dd29f13 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: ecb89774-cfc0-4309-b701-11d4fe35b568] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:00:32.701774 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac75cfbf-17d1-4101-b097-63d24dd29f13 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:00:32.702266 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac75cfbf-17d1-4101-b097-63d24dd29f13 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:00:32.702704 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac75cfbf-17d1-4101-b097-63d24dd29f13 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:00:32.703444 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac75cfbf-17d1-4101-b097-63d24dd29f13 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:00:32.703900 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac75cfbf-17d1-4101-b097-63d24dd29f13 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:00:32.704353 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ac75cfbf-17d1-4101-b097-63d24dd29f13 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:00:32.903423 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ac75cfbf-17d1-4101-b097-63d24dd29f13 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:00:32.911149 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ac75cfbf-17d1-4101-b097-63d24dd29f13 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568" status: 200 len: 1391 microversion: 2.1 time: 0.225088 Sep 10 13:00:32.911750 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3748/7500] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:00:32 2022] GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568 => generated 1391 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:00:33.941385 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1139f477-ca57-4b0e-af7c-ed6d8e0bff3c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:00:33.942102 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1139f477-ca57-4b0e-af7c-ed6d8e0bff3c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: ecb89774-cfc0-4309-b701-11d4fe35b568] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:00:33.948996 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1139f477-ca57-4b0e-af7c-ed6d8e0bff3c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:00:33.949510 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1139f477-ca57-4b0e-af7c-ed6d8e0bff3c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:00:33.949946 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1139f477-ca57-4b0e-af7c-ed6d8e0bff3c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:00:33.950645 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1139f477-ca57-4b0e-af7c-ed6d8e0bff3c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:00:33.951110 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1139f477-ca57-4b0e-af7c-ed6d8e0bff3c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:00:33.951580 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1139f477-ca57-4b0e-af7c-ed6d8e0bff3c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:00:34.094849 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1139f477-ca57-4b0e-af7c-ed6d8e0bff3c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:00:34.103284 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1139f477-ca57-4b0e-af7c-ed6d8e0bff3c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568" status: 200 len: 1391 microversion: 2.1 time: 0.166969 Sep 10 13:00:34.103872 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3753/7501] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:00:33 2022] GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:00:35.126038 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-933b9f0b-278a-41ad-bc32-fde68a946c97 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:00:35.126583 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-933b9f0b-278a-41ad-bc32-fde68a946c97 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: ecb89774-cfc0-4309-b701-11d4fe35b568] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:00:35.133992 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-933b9f0b-278a-41ad-bc32-fde68a946c97 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:00:35.134487 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-933b9f0b-278a-41ad-bc32-fde68a946c97 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:00:35.134928 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-933b9f0b-278a-41ad-bc32-fde68a946c97 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:00:35.135658 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-933b9f0b-278a-41ad-bc32-fde68a946c97 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:00:35.136485 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-933b9f0b-278a-41ad-bc32-fde68a946c97 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:00:35.136593 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-933b9f0b-278a-41ad-bc32-fde68a946c97 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:00:35.272001 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-933b9f0b-278a-41ad-bc32-fde68a946c97 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:00:35.279847 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-933b9f0b-278a-41ad-bc32-fde68a946c97 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568" status: 200 len: 1563 microversion: 2.1 time: 0.157823 Sep 10 13:00:35.280449 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3749/7502] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:00:35 2022] GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:00:35.301934 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-335f3b59-f8df-4e3f-8c01-ac9765edc45a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:00:35.302568 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-335f3b59-f8df-4e3f-8c01-ac9765edc45a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: ecb89774-cfc0-4309-b701-11d4fe35b568] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:00:35.310069 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-335f3b59-f8df-4e3f-8c01-ac9765edc45a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:00:35.310605 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-335f3b59-f8df-4e3f-8c01-ac9765edc45a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:00:35.311062 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-335f3b59-f8df-4e3f-8c01-ac9765edc45a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:00:35.311797 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-335f3b59-f8df-4e3f-8c01-ac9765edc45a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:00:35.312270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-335f3b59-f8df-4e3f-8c01-ac9765edc45a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:00:35.312717 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-335f3b59-f8df-4e3f-8c01-ac9765edc45a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:00:35.443901 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-335f3b59-f8df-4e3f-8c01-ac9765edc45a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:00:35.452141 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-335f3b59-f8df-4e3f-8c01-ac9765edc45a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568" status: 200 len: 1563 microversion: 2.1 time: 0.154032 Sep 10 13:00:35.452719 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3754/7503] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:00:35 2022] GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:00:37.056337 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-4d19dd39-85a6-4ed4-ae1b-1061b1e6eeed req-81e0ff8d-e0a5-4818-8bc4-304d3925508b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecb89774-cfc0-4309-b701-11d4fe35b568", "tag": "17f3fb5b-8ab3-4be2-b0c9-7b8b86094b4d"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:00:37.060574 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c7f8fffb-008a-45a5-83b1-dd86ae561042 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:00:37.061203 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c7f8fffb-008a-45a5-83b1-dd86ae561042 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: ecb89774-cfc0-4309-b701-11d4fe35b568] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:00:37.067968 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-4d19dd39-85a6-4ed4-ae1b-1061b1e6eeed req-81e0ff8d-e0a5-4818-8bc4-304d3925508b service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:00:37.068472 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-4d19dd39-85a6-4ed4-ae1b-1061b1e6eeed req-81e0ff8d-e0a5-4818-8bc4-304d3925508b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:00:37.068835 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7f8fffb-008a-45a5-83b1-dd86ae561042 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:00:37.068977 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-4d19dd39-85a6-4ed4-ae1b-1061b1e6eeed req-81e0ff8d-e0a5-4818-8bc4-304d3925508b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:00:37.069332 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7f8fffb-008a-45a5-83b1-dd86ae561042 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:00:37.069779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7f8fffb-008a-45a5-83b1-dd86ae561042 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:00:37.071000 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7f8fffb-008a-45a5-83b1-dd86ae561042 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:00:37.071500 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7f8fffb-008a-45a5-83b1-dd86ae561042 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:00:37.072119 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c7f8fffb-008a-45a5-83b1-dd86ae561042 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:00:37.080968 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-4d19dd39-85a6-4ed4-ae1b-1061b1e6eeed req-81e0ff8d-e0a5-4818-8bc4-304d3925508b service nova] Creating event network-changed:17f3fb5b-8ab3-4be2-b0c9-7b8b86094b4d for instance ecb89774-cfc0-4309-b701-11d4fe35b568 on n-h1-856895-1 Sep 10 13:00:37.086303 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-4d19dd39-85a6-4ed4-ae1b-1061b1e6eeed req-81e0ff8d-e0a5-4818-8bc4-304d3925508b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034244 Sep 10 13:00:37.090623 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3755/7504] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:00:37.309587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c7f8fffb-008a-45a5-83b1-dd86ae561042 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:00:37.317567 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c7f8fffb-008a-45a5-83b1-dd86ae561042 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568" status: 200 len: 1563 microversion: 2.1 time: 0.269819 Sep 10 13:00:37.318356 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3750/7505] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:00:37 2022] GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568 => generated 1563 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:01:10.640481 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=19 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:01:10.641236 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=40 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:01:10.645573 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0c05f9b9-3965-4986-a1f1-315a2308cb63 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:01:10.647874 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0c05f9b9-3965-4986-a1f1-315a2308cb63 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: ecb89774-cfc0-4309-b701-11d4fe35b568] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:01:10.654785 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c05f9b9-3965-4986-a1f1-315a2308cb63 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:01:10.655329 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c05f9b9-3965-4986-a1f1-315a2308cb63 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:01:10.655787 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c05f9b9-3965-4986-a1f1-315a2308cb63 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:01:10.656488 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c05f9b9-3965-4986-a1f1-315a2308cb63 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:01:10.656945 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c05f9b9-3965-4986-a1f1-315a2308cb63 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:01:10.657380 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0c05f9b9-3965-4986-a1f1-315a2308cb63 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:01:10.722446 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0c05f9b9-3965-4986-a1f1-315a2308cb63 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "POST /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568/action" status: 200 len: 24571 microversion: 2.1 time: 0.084534 Sep 10 13:01:10.723079 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3756/7506] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 13:01:10 2022] POST /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568/action => generated 24571 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 10 13:01:41.149459 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:01:41.150219 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=46 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:01:41.155361 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-760c8033-2cd6-456f-bdb0-e176864430b4 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:01:41.155902 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-760c8033-2cd6-456f-bdb0-e176864430b4 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: ecb89774-cfc0-4309-b701-11d4fe35b568] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:01:41.163354 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-760c8033-2cd6-456f-bdb0-e176864430b4 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:01:41.163843 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-760c8033-2cd6-456f-bdb0-e176864430b4 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:01:41.164288 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-760c8033-2cd6-456f-bdb0-e176864430b4 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:01:41.164986 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-760c8033-2cd6-456f-bdb0-e176864430b4 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:01:41.165449 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-760c8033-2cd6-456f-bdb0-e176864430b4 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:01:41.165879 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-760c8033-2cd6-456f-bdb0-e176864430b4 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:01:41.232021 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-760c8033-2cd6-456f-bdb0-e176864430b4 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "POST /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568/action" status: 202 len: 0 microversion: 2.1 time: 0.084272 Sep 10 13:01:41.232934 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3751/7507] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 13:01:41 2022] POST /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 13:01:41.242600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bd5a91e3-696a-40b7-87d8-d661a81371f2 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:01:41.243360 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bd5a91e3-696a-40b7-87d8-d661a81371f2 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: ecb89774-cfc0-4309-b701-11d4fe35b568] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:01:41.246126 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:01:41.246966 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=4 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:01:41.254520 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd5a91e3-696a-40b7-87d8-d661a81371f2 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:01:41.255041 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd5a91e3-696a-40b7-87d8-d661a81371f2 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:01:41.255498 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd5a91e3-696a-40b7-87d8-d661a81371f2 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:01:41.256212 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd5a91e3-696a-40b7-87d8-d661a81371f2 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:01:41.256689 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd5a91e3-696a-40b7-87d8-d661a81371f2 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:01:41.257132 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd5a91e3-696a-40b7-87d8-d661a81371f2 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:01:41.393469 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bd5a91e3-696a-40b7-87d8-d661a81371f2 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:01:41.401734 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bd5a91e3-696a-40b7-87d8-d661a81371f2 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568" status: 200 len: 1687 microversion: 2.1 time: 0.163212 Sep 10 13:01:41.402147 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3757/7508] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:01:41 2022] GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568 => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:01:42.427680 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5117535b-9c44-4e44-a4c2-5e8e912d8a97 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:01:42.428392 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5117535b-9c44-4e44-a4c2-5e8e912d8a97 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: ecb89774-cfc0-4309-b701-11d4fe35b568] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:01:42.434527 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5117535b-9c44-4e44-a4c2-5e8e912d8a97 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:01:42.435012 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5117535b-9c44-4e44-a4c2-5e8e912d8a97 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:01:42.435477 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5117535b-9c44-4e44-a4c2-5e8e912d8a97 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:01:42.436287 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5117535b-9c44-4e44-a4c2-5e8e912d8a97 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:01:42.436822 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5117535b-9c44-4e44-a4c2-5e8e912d8a97 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:01:42.437088 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5117535b-9c44-4e44-a4c2-5e8e912d8a97 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:01:42.572153 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5117535b-9c44-4e44-a4c2-5e8e912d8a97 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:01:42.581156 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5117535b-9c44-4e44-a4c2-5e8e912d8a97 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568" status: 200 len: 1667 microversion: 2.1 time: 0.158755 Sep 10 13:01:42.581719 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3752/7509] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:01:42 2022] GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568 => generated 1667 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:01:43.680124 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-819dcf62-bf10-40cf-a934-d14d4e7cdea5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:01:43.682331 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-819dcf62-bf10-40cf-a934-d14d4e7cdea5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: ecb89774-cfc0-4309-b701-11d4fe35b568] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:01:43.690603 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-819dcf62-bf10-40cf-a934-d14d4e7cdea5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:01:43.691094 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-819dcf62-bf10-40cf-a934-d14d4e7cdea5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:01:43.691593 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-819dcf62-bf10-40cf-a934-d14d4e7cdea5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:01:43.692318 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-819dcf62-bf10-40cf-a934-d14d4e7cdea5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:01:43.692784 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-819dcf62-bf10-40cf-a934-d14d4e7cdea5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:01:43.693222 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-819dcf62-bf10-40cf-a934-d14d4e7cdea5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:01:43.758860 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-819dcf62-bf10-40cf-a934-d14d4e7cdea5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "POST /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568/action" status: 200 len: 32644 microversion: 2.1 time: 0.082565 Sep 10 13:01:43.759508 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3758/7510] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 13:01:43 2022] POST /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568/action => generated 32644 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 13:01:43.771935 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a6c58fb8-3a02-4787-a163-ef9871fcfde6 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:01:43.772458 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a6c58fb8-3a02-4787-a163-ef9871fcfde6 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: ecb89774-cfc0-4309-b701-11d4fe35b568] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:01:43.779361 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a6c58fb8-3a02-4787-a163-ef9871fcfde6 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:01:43.779898 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a6c58fb8-3a02-4787-a163-ef9871fcfde6 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:01:43.780514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a6c58fb8-3a02-4787-a163-ef9871fcfde6 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:01:43.781240 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a6c58fb8-3a02-4787-a163-ef9871fcfde6 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:01:43.781696 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a6c58fb8-3a02-4787-a163-ef9871fcfde6 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:01:43.782126 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a6c58fb8-3a02-4787-a163-ef9871fcfde6 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:01:43.846836 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a6c58fb8-3a02-4787-a163-ef9871fcfde6 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "POST /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568/action" status: 202 len: 0 microversion: 2.1 time: 0.078574 Sep 10 13:01:43.847425 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3753/7511] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 13:01:43 2022] POST /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 13:01:43.856793 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8dd1cf9d-3301-4a7d-adc5-59ab14ae341b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:01:43.857513 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8dd1cf9d-3301-4a7d-adc5-59ab14ae341b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: ecb89774-cfc0-4309-b701-11d4fe35b568] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:01:43.866490 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8dd1cf9d-3301-4a7d-adc5-59ab14ae341b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:01:43.867002 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8dd1cf9d-3301-4a7d-adc5-59ab14ae341b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:01:43.867732 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8dd1cf9d-3301-4a7d-adc5-59ab14ae341b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:01:43.868448 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8dd1cf9d-3301-4a7d-adc5-59ab14ae341b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:01:43.868921 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8dd1cf9d-3301-4a7d-adc5-59ab14ae341b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:01:43.869365 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8dd1cf9d-3301-4a7d-adc5-59ab14ae341b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:01:44.005518 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8dd1cf9d-3301-4a7d-adc5-59ab14ae341b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:01:44.013730 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8dd1cf9d-3301-4a7d-adc5-59ab14ae341b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568" status: 200 len: 1674 microversion: 2.1 time: 0.161286 Sep 10 13:01:44.014582 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3759/7512] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:01:43 2022] GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:01:45.039356 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bf4b175e-134b-4bb3-93cd-79e49fe08bad tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:01:45.040063 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bf4b175e-134b-4bb3-93cd-79e49fe08bad tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: ecb89774-cfc0-4309-b701-11d4fe35b568] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:01:45.046944 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bf4b175e-134b-4bb3-93cd-79e49fe08bad tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:01:45.047460 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bf4b175e-134b-4bb3-93cd-79e49fe08bad tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:01:45.047901 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bf4b175e-134b-4bb3-93cd-79e49fe08bad tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:01:45.048598 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bf4b175e-134b-4bb3-93cd-79e49fe08bad tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:01:45.049053 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bf4b175e-134b-4bb3-93cd-79e49fe08bad tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:01:45.049483 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bf4b175e-134b-4bb3-93cd-79e49fe08bad tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:01:45.187266 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bf4b175e-134b-4bb3-93cd-79e49fe08bad tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:01:45.194975 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bf4b175e-134b-4bb3-93cd-79e49fe08bad tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568" status: 200 len: 1682 microversion: 2.1 time: 0.160839 Sep 10 13:01:45.195590 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3754/7513] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:01:45 2022] GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:01:45.292000 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2458efd2-b636-4b2a-aa1e-76442fc9428d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:01:45.294231 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2458efd2-b636-4b2a-aa1e-76442fc9428d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: ecb89774-cfc0-4309-b701-11d4fe35b568] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:01:45.305386 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2458efd2-b636-4b2a-aa1e-76442fc9428d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:01:45.305895 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2458efd2-b636-4b2a-aa1e-76442fc9428d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:01:45.306357 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2458efd2-b636-4b2a-aa1e-76442fc9428d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:01:45.307137 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2458efd2-b636-4b2a-aa1e-76442fc9428d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:01:45.307636 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2458efd2-b636-4b2a-aa1e-76442fc9428d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:01:45.308081 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2458efd2-b636-4b2a-aa1e-76442fc9428d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:01:45.369246 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2458efd2-b636-4b2a-aa1e-76442fc9428d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "POST /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568/action" status: 200 len: 37737 microversion: 2.1 time: 0.081190 Sep 10 13:01:45.370284 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3760/7514] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 13:01:45 2022] POST /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568/action => generated 37737 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 13:01:46.378920 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-88d4bb2b-b08f-4cce-94f0-3193a29481a5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:01:46.379555 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-88d4bb2b-b08f-4cce-94f0-3193a29481a5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: ecb89774-cfc0-4309-b701-11d4fe35b568] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:01:46.385178 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-759b21eb-9dca-4ea9-bdd6-f6b41a70a615 req-d0eeb8ea-e4dd-4c91-ab43-279545ce15fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecb89774-cfc0-4309-b701-11d4fe35b568", "tag": "17f3fb5b-8ab3-4be2-b0c9-7b8b86094b4d"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:01:46.386921 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-88d4bb2b-b08f-4cce-94f0-3193a29481a5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:01:46.387443 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-88d4bb2b-b08f-4cce-94f0-3193a29481a5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:01:46.387887 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-88d4bb2b-b08f-4cce-94f0-3193a29481a5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:01:46.388588 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-88d4bb2b-b08f-4cce-94f0-3193a29481a5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:01:46.389805 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-88d4bb2b-b08f-4cce-94f0-3193a29481a5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:01:46.390239 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-88d4bb2b-b08f-4cce-94f0-3193a29481a5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:01:46.397136 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-759b21eb-9dca-4ea9-bdd6-f6b41a70a615 req-d0eeb8ea-e4dd-4c91-ab43-279545ce15fd service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:01:46.397636 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-759b21eb-9dca-4ea9-bdd6-f6b41a70a615 req-d0eeb8ea-e4dd-4c91-ab43-279545ce15fd service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:01:46.398087 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-759b21eb-9dca-4ea9-bdd6-f6b41a70a615 req-d0eeb8ea-e4dd-4c91-ab43-279545ce15fd service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:01:46.410151 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-759b21eb-9dca-4ea9-bdd6-f6b41a70a615 req-d0eeb8ea-e4dd-4c91-ab43-279545ce15fd service nova] Creating event network-changed:17f3fb5b-8ab3-4be2-b0c9-7b8b86094b4d for instance ecb89774-cfc0-4309-b701-11d4fe35b568 on n-h1-856895-1 Sep 10 13:01:46.417351 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-759b21eb-9dca-4ea9-bdd6-f6b41a70a615 req-d0eeb8ea-e4dd-4c91-ab43-279545ce15fd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034243 Sep 10 13:01:46.417351 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3761/7515] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:01:46.423699 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-88d4bb2b-b08f-4cce-94f0-3193a29481a5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: ecb89774-cfc0-4309-b701-11d4fe35b568] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 13:01:46.508949 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-88d4bb2b-b08f-4cce-94f0-3193a29481a5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568" status: 204 len: 0 microversion: 2.1 time: 0.133684 Sep 10 13:01:46.510060 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3755/7516] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 13:01:46 2022] DELETE /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 13:01:46.519726 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-460a39c5-4c45-4c4c-8180-8636bde836ff tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:01:46.520536 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-460a39c5-4c45-4c4c-8180-8636bde836ff tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: ecb89774-cfc0-4309-b701-11d4fe35b568] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:01:46.526964 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-460a39c5-4c45-4c4c-8180-8636bde836ff tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:01:46.527494 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-460a39c5-4c45-4c4c-8180-8636bde836ff tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:01:46.527951 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-460a39c5-4c45-4c4c-8180-8636bde836ff tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:01:46.528666 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-460a39c5-4c45-4c4c-8180-8636bde836ff tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:01:46.529139 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-460a39c5-4c45-4c4c-8180-8636bde836ff tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:01:46.529585 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-460a39c5-4c45-4c4c-8180-8636bde836ff tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:01:46.668178 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-460a39c5-4c45-4c4c-8180-8636bde836ff tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:01:46.676764 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-460a39c5-4c45-4c4c-8180-8636bde836ff tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568" status: 200 len: 1688 microversion: 2.1 time: 0.161443 Sep 10 13:01:46.677338 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3762/7517] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:01:46 2022] GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568 => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:01:47.702718 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2ffdaceb-1a72-4350-b970-ad399752c8d5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:01:47.703473 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2ffdaceb-1a72-4350-b970-ad399752c8d5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: ecb89774-cfc0-4309-b701-11d4fe35b568] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:01:47.710222 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ffdaceb-1a72-4350-b970-ad399752c8d5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:01:47.710712 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ffdaceb-1a72-4350-b970-ad399752c8d5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:01:47.711155 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ffdaceb-1a72-4350-b970-ad399752c8d5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:01:47.711872 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ffdaceb-1a72-4350-b970-ad399752c8d5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:01:47.712328 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ffdaceb-1a72-4350-b970-ad399752c8d5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:01:47.712757 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2ffdaceb-1a72-4350-b970-ad399752c8d5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:01:48.204344 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2ffdaceb-1a72-4350-b970-ad399752c8d5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:01:48.213635 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2ffdaceb-1a72-4350-b970-ad399752c8d5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568" status: 200 len: 1688 microversion: 2.1 time: 0.515664 Sep 10 13:01:48.214373 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3756/7518] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:01:47 2022] GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568 => generated 1688 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:01:48.791740 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-0baefbbe-f005-4c86-8a65-d3f88cba126b req-92ac4fc3-fd19-4f40-b96e-58358cda4023 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecb89774-cfc0-4309-b701-11d4fe35b568", "name": "network-vif-deleted", "tag": "17f3fb5b-8ab3-4be2-b0c9-7b8b86094b4d"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:01:48.803446 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-0baefbbe-f005-4c86-8a65-d3f88cba126b req-92ac4fc3-fd19-4f40-b96e-58358cda4023 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:01:48.803942 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-0baefbbe-f005-4c86-8a65-d3f88cba126b req-92ac4fc3-fd19-4f40-b96e-58358cda4023 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:01:48.804396 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-0baefbbe-f005-4c86-8a65-d3f88cba126b req-92ac4fc3-fd19-4f40-b96e-58358cda4023 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:01:48.816047 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-0baefbbe-f005-4c86-8a65-d3f88cba126b req-92ac4fc3-fd19-4f40-b96e-58358cda4023 service nova] Creating event network-vif-deleted:17f3fb5b-8ab3-4be2-b0c9-7b8b86094b4d for instance ecb89774-cfc0-4309-b701-11d4fe35b568 on n-h1-856895-1 Sep 10 13:01:48.821594 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-0baefbbe-f005-4c86-8a65-d3f88cba126b req-92ac4fc3-fd19-4f40-b96e-58358cda4023 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033481 Sep 10 13:01:48.822225 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3763/7519] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:01:49.237570 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8338f279-3ac7-4ddf-8a2a-b8357f413a23 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:01:49.238197 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8338f279-3ac7-4ddf-8a2a-b8357f413a23 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: ecb89774-cfc0-4309-b701-11d4fe35b568] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:01:49.244325 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8338f279-3ac7-4ddf-8a2a-b8357f413a23 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:01:49.244813 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8338f279-3ac7-4ddf-8a2a-b8357f413a23 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:01:49.245257 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8338f279-3ac7-4ddf-8a2a-b8357f413a23 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:01:49.245963 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8338f279-3ac7-4ddf-8a2a-b8357f413a23 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:01:49.246428 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8338f279-3ac7-4ddf-8a2a-b8357f413a23 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:01:49.246862 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8338f279-3ac7-4ddf-8a2a-b8357f413a23 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:01:49.281336 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8338f279-3ac7-4ddf-8a2a-b8357f413a23 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:01:49.281831 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8338f279-3ac7-4ddf-8a2a-b8357f413a23 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:01:49.282273 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8338f279-3ac7-4ddf-8a2a-b8357f413a23 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:01:49.282749 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-8338f279-3ac7-4ddf-8a2a-b8357f413a23 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lazy-loading 'fault' on Instance uuid ecb89774-cfc0-4309-b701-11d4fe35b568 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 13:01:49.327529 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8338f279-3ac7-4ddf-8a2a-b8357f413a23 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:01:49.335815 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8338f279-3ac7-4ddf-8a2a-b8357f413a23 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568" status: 200 len: 1356 microversion: 2.1 time: 0.102984 Sep 10 13:01:49.336589 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3757/7520] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:01:49 2022] GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568 => generated 1356 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:01:50.361636 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ce9d87d6-1383-4d57-b8e1-b94e22365639 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:01:50.362274 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ce9d87d6-1383-4d57-b8e1-b94e22365639 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: ecb89774-cfc0-4309-b701-11d4fe35b568] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:01:50.368520 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ce9d87d6-1383-4d57-b8e1-b94e22365639 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:01:50.369022 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ce9d87d6-1383-4d57-b8e1-b94e22365639 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:01:50.369478 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ce9d87d6-1383-4d57-b8e1-b94e22365639 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:01:50.370189 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ce9d87d6-1383-4d57-b8e1-b94e22365639 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:01:50.370662 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ce9d87d6-1383-4d57-b8e1-b94e22365639 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:01:50.371106 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ce9d87d6-1383-4d57-b8e1-b94e22365639 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:01:50.385182 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-ce9d87d6-1383-4d57-b8e1-b94e22365639 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] HTTP exception thrown: Instance ecb89774-cfc0-4309-b701-11d4fe35b568 could not be found. Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ce9d87d6-1383-4d57-b8e1-b94e22365639 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Request method failure captured: Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568 HTTP/1.1 Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHIpdJSi4DFbBHL8V-ThkqWs5qsENn9f44fAjCGfIVt2JLbU_2M84czNkA_1xJt3KrfjUCCFS4TMpry236FRO_1OwbSaFPzXSs5yvfKc4BHVhFUvMQ81nyQLxn8rwKBj8fhkryGWzH2_U6bC_TMfY-qfd78V0LzaRSLPr8smJqhI8tXU Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: b0e733e9474c4814b77eddbf547e3a54 Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1010290636 Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b0e733e9474c4814b77eddbf547e3a54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b0e733e9474c4814b77eddbf547e3a54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b0e733e9474c4814b77eddbf547e3a54", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b0e733e9474c4814b77eddbf547e3a54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1010290636 Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: b0e733e9474c4814b77eddbf547e3a54 Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1010290636 Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-TestNetworkAdvancedServerOps-1010290636-project Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: f75e338a6cb34d11a42b65da1eca4f83 Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1010290636-project Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance ecb89774-cfc0-4309-b701-11d4fe35b568 could not be found. Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'ecb89774-cfc0-4309-b701-11d4fe35b568'} Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecb89774-cfc0-4309-b701-11d4fe35b568 could not be found. Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecb89774-cfc0-4309-b701-11d4fe35b568 could not be found. Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 13:01:50.386827 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 13:01:50.393329 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 13:01:50.393329 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 13:01:50.393329 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 13:01:50.393329 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 13:01:50.393329 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 13:01:50.393329 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 13:01:50.393329 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecb89774-cfc0-4309-b701-11d4fe35b568 could not be found. Sep 10 13:01:50.393329 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 13:01:50.393329 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ce9d87d6-1383-4d57-b8e1-b94e22365639 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Returning 404 to user: Instance ecb89774-cfc0-4309-b701-11d4fe35b568 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 13:01:50.393329 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ce9d87d6-1383-4d57-b8e1-b94e22365639 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568" status: 404 len: 111 microversion: 2.1 time: 0.032125 Sep 10 13:01:50.393329 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3764/7521] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:01:50 2022] GET /compute/v2.1/servers/ecb89774-cfc0-4309-b701-11d4fe35b568 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 13:01:53.693862 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7f434576-0004-4ea1-808b-567a367f0aeb tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '.version_select at 0x7f4073244160>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:01:53.728174 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7f434576-0004-4ea1-808b-567a367f0aeb tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-881793719" status: 202 len: 0 microversion: 2.1 time: 0.038013 Sep 10 13:01:53.728846 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3758/7522] 10.222.0.23 () {58 vars in 1281 bytes} [Sat Sep 10 13:01:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-881793719 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 13:01:53.756307 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6791771a-22be-4c76-9d23-92276dcfb548 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Action: 'create', calling method: .version_select at 0x7f4073678820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1659061573", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAXmn8KivghMU/+qXz/TA3nj9JMc/KjNleBzOvBxrMcxkuxaUBT0l5xnphfFOBtSvzj7x6F2CHYrWDn3HVgDaByGOn4CmnjazzfCeXDdzkRN9peitdaqPpPC7zTFbGF0A=="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:01:53.774045 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-6791771a-22be-4c76-9d23-92276dcfb548 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Getting quotas for project b0e733e9474c4814b77eddbf547e3a54. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 13:01:53.781410 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-6791771a-22be-4c76-9d23-92276dcfb548 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Getting quotas for user f75e338a6cb34d11a42b65da1eca4f83 and project b0e733e9474c4814b77eddbf547e3a54. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 13:01:53.806552 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6791771a-22be-4c76-9d23-92276dcfb548 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.054098 Sep 10 13:01:53.807187 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3765/7523] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 13:01:53 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:01:59.429183 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:01:59.433639 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-66e55066-0327-454a-b991-9b75aa0263fd tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1205405788", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "46803420-820d-475d-9c12-70e2729da7a7"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1659061573", "security_groups": [{"name": "tempest-secgroup-smoke-819990082"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:01:59.549782 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-66e55066-0327-454a-b991-9b75aa0263fd tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] validate_networks() for [('46803420-820d-475d-9c12-70e2729da7a7', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 13:01:59.990501 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-66e55066-0327-454a-b991-9b75aa0263fd tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 13:01:59.990950 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-66e55066-0327-454a-b991-9b75aa0263fd tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 13:01:59.991580 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-66e55066-0327-454a-b991-9b75aa0263fd tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 13:01:59.992026 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-66e55066-0327-454a-b991-9b75aa0263fd tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 13:01:59.992444 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-66e55066-0327-454a-b991-9b75aa0263fd tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 13:02:00.002198 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66e55066-0327-454a-b991-9b75aa0263fd tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:00.002683 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66e55066-0327-454a-b991-9b75aa0263fd tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:00.003360 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66e55066-0327-454a-b991-9b75aa0263fd tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:00.004134 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66e55066-0327-454a-b991-9b75aa0263fd tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:00.004574 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66e55066-0327-454a-b991-9b75aa0263fd tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:00.004995 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-66e55066-0327-454a-b991-9b75aa0263fd tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:00.028400 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-66e55066-0327-454a-b991-9b75aa0263fd tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Getting quotas for project b0e733e9474c4814b77eddbf547e3a54. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 13:02:00.034790 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-66e55066-0327-454a-b991-9b75aa0263fd tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Getting quotas for user f75e338a6cb34d11a42b65da1eca4f83 and project b0e733e9474c4814b77eddbf547e3a54. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 13:02:00.048241 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-66e55066-0327-454a-b991-9b75aa0263fd tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 13:02:00.050621 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-66e55066-0327-454a-b991-9b75aa0263fd tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 9b3e14ae-4728-4603-8fbb-7327bba5ffb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 13:02:00.099829 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-66e55066-0327-454a-b991-9b75aa0263fd tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.672363 Sep 10 13:02:00.100831 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3759/7524] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 13:01:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 13:02:00.112771 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4ab4fe57-602a-4f7d-859d-68e6147d22da tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:02:00.114101 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4ab4fe57-602a-4f7d-859d-68e6147d22da tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 9b3e14ae-4728-4603-8fbb-7327bba5ffb7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:02:00.180791 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4ab4fe57-602a-4f7d-859d-68e6147d22da tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:02:00.189220 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4ab4fe57-602a-4f7d-859d-68e6147d22da tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7" status: 200 len: 1267 microversion: 2.1 time: 0.080400 Sep 10 13:02:00.189809 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3766/7525] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:02:00 2022] GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7 => generated 1267 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:02:01.214025 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-403b20fc-5f28-4d27-adf3-260936e0363a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:02:01.215303 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-403b20fc-5f28-4d27-adf3-260936e0363a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 9b3e14ae-4728-4603-8fbb-7327bba5ffb7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:02:01.224978 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-403b20fc-5f28-4d27-adf3-260936e0363a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:01.225763 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-403b20fc-5f28-4d27-adf3-260936e0363a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:01.226393 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-403b20fc-5f28-4d27-adf3-260936e0363a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:01.227410 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-403b20fc-5f28-4d27-adf3-260936e0363a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:01.227899 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-403b20fc-5f28-4d27-adf3-260936e0363a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:01.228311 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-403b20fc-5f28-4d27-adf3-260936e0363a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:01.300764 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-403b20fc-5f28-4d27-adf3-260936e0363a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:02:01.309702 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-403b20fc-5f28-4d27-adf3-260936e0363a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7" status: 200 len: 1337 microversion: 2.1 time: 0.100510 Sep 10 13:02:01.310735 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3760/7526] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:02:01 2022] GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7 => generated 1337 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:02:02.333734 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-28a8732d-70de-4b24-8925-86b6cf06a08c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:02:02.334383 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-28a8732d-70de-4b24-8925-86b6cf06a08c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 9b3e14ae-4728-4603-8fbb-7327bba5ffb7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:02:02.337558 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=32 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:02:02.343443 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28a8732d-70de-4b24-8925-86b6cf06a08c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:02.344244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28a8732d-70de-4b24-8925-86b6cf06a08c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:02.345111 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28a8732d-70de-4b24-8925-86b6cf06a08c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:02.346026 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28a8732d-70de-4b24-8925-86b6cf06a08c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:02.346672 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28a8732d-70de-4b24-8925-86b6cf06a08c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:02.347339 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-28a8732d-70de-4b24-8925-86b6cf06a08c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:02.515237 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-28a8732d-70de-4b24-8925-86b6cf06a08c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:02:02.527272 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-28a8732d-70de-4b24-8925-86b6cf06a08c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7" status: 200 len: 1392 microversion: 2.1 time: 0.197292 Sep 10 13:02:02.528425 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3767/7527] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:02:02 2022] GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7 => generated 1392 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:02:02.724651 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-58239f50-a0c2-4a3a-bc84-129d74604990 req-2e6d6d52-13ab-4f14-ba5c-f4398cceb5aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b3e14ae-4728-4603-8fbb-7327bba5ffb7", "tag": "40d84eef-df26-481d-9b45-b577aca964b3"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:02:02.743546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-58239f50-a0c2-4a3a-bc84-129d74604990 req-2e6d6d52-13ab-4f14-ba5c-f4398cceb5aa service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:02.744050 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-58239f50-a0c2-4a3a-bc84-129d74604990 req-2e6d6d52-13ab-4f14-ba5c-f4398cceb5aa service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:02.744493 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-58239f50-a0c2-4a3a-bc84-129d74604990 req-2e6d6d52-13ab-4f14-ba5c-f4398cceb5aa service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:02.760219 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-58239f50-a0c2-4a3a-bc84-129d74604990 req-2e6d6d52-13ab-4f14-ba5c-f4398cceb5aa service nova] Creating event network-changed:40d84eef-df26-481d-9b45-b577aca964b3 for instance 9b3e14ae-4728-4603-8fbb-7327bba5ffb7 on n-h2-856895-1 Sep 10 13:02:02.766799 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-58239f50-a0c2-4a3a-bc84-129d74604990 req-2e6d6d52-13ab-4f14-ba5c-f4398cceb5aa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050199 Sep 10 13:02:02.767453 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3761/7528] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:02:03.552540 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fc202efb-3e9c-468e-835e-edcbce0e8a71 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:02:03.553102 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fc202efb-3e9c-468e-835e-edcbce0e8a71 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 9b3e14ae-4728-4603-8fbb-7327bba5ffb7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:02:03.559865 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc202efb-3e9c-468e-835e-edcbce0e8a71 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:03.560362 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc202efb-3e9c-468e-835e-edcbce0e8a71 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:03.561732 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc202efb-3e9c-468e-835e-edcbce0e8a71 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:03.562468 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc202efb-3e9c-468e-835e-edcbce0e8a71 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:03.562939 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc202efb-3e9c-468e-835e-edcbce0e8a71 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:03.563404 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc202efb-3e9c-468e-835e-edcbce0e8a71 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:03.696370 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fc202efb-3e9c-468e-835e-edcbce0e8a71 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:02:03.704521 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fc202efb-3e9c-468e-835e-edcbce0e8a71 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7" status: 200 len: 1392 microversion: 2.1 time: 0.156155 Sep 10 13:02:03.705096 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3768/7529] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:02:03 2022] GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:02:04.729182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6df272ce-5f50-476d-aa7f-856a06e9bfbc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:02:04.729970 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6df272ce-5f50-476d-aa7f-856a06e9bfbc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 9b3e14ae-4728-4603-8fbb-7327bba5ffb7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:02:04.736762 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6df272ce-5f50-476d-aa7f-856a06e9bfbc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:04.737248 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6df272ce-5f50-476d-aa7f-856a06e9bfbc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:04.737685 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6df272ce-5f50-476d-aa7f-856a06e9bfbc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:04.738376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6df272ce-5f50-476d-aa7f-856a06e9bfbc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:04.738837 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6df272ce-5f50-476d-aa7f-856a06e9bfbc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:04.739298 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6df272ce-5f50-476d-aa7f-856a06e9bfbc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:04.877859 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6df272ce-5f50-476d-aa7f-856a06e9bfbc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:02:04.885817 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6df272ce-5f50-476d-aa7f-856a06e9bfbc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7" status: 200 len: 1392 microversion: 2.1 time: 0.161764 Sep 10 13:02:04.886394 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3762/7530] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:02:04 2022] GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 13:02:05.909796 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7973d14b-6502-49f3-a385-40b291f7ee9f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:02:05.910440 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7973d14b-6502-49f3-a385-40b291f7ee9f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 9b3e14ae-4728-4603-8fbb-7327bba5ffb7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:02:05.917494 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7973d14b-6502-49f3-a385-40b291f7ee9f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:05.917997 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7973d14b-6502-49f3-a385-40b291f7ee9f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:05.918457 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7973d14b-6502-49f3-a385-40b291f7ee9f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:05.919185 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7973d14b-6502-49f3-a385-40b291f7ee9f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:05.919675 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7973d14b-6502-49f3-a385-40b291f7ee9f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:05.920184 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7973d14b-6502-49f3-a385-40b291f7ee9f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:06.054465 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7973d14b-6502-49f3-a385-40b291f7ee9f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:02:06.064111 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7973d14b-6502-49f3-a385-40b291f7ee9f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7" status: 200 len: 1392 microversion: 2.1 time: 0.158186 Sep 10 13:02:06.064714 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3769/7531] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:02:05 2022] GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:02:07.088573 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5e5b61f0-3c69-477e-b341-d75fd6f1595b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:02:07.089143 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5e5b61f0-3c69-477e-b341-d75fd6f1595b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 9b3e14ae-4728-4603-8fbb-7327bba5ffb7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:02:07.096012 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5e5b61f0-3c69-477e-b341-d75fd6f1595b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:07.096490 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5e5b61f0-3c69-477e-b341-d75fd6f1595b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:07.096925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5e5b61f0-3c69-477e-b341-d75fd6f1595b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:07.097609 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5e5b61f0-3c69-477e-b341-d75fd6f1595b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:07.098060 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5e5b61f0-3c69-477e-b341-d75fd6f1595b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:07.098480 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5e5b61f0-3c69-477e-b341-d75fd6f1595b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:07.237642 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5e5b61f0-3c69-477e-b341-d75fd6f1595b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:02:07.245451 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5e5b61f0-3c69-477e-b341-d75fd6f1595b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7" status: 200 len: 1392 microversion: 2.1 time: 0.160805 Sep 10 13:02:07.246049 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3763/7532] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:02:07 2022] GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:02:08.270332 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bc7d2576-f5e7-4e71-9cd6-10a7e0cba8c5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:02:08.270969 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bc7d2576-f5e7-4e71-9cd6-10a7e0cba8c5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 9b3e14ae-4728-4603-8fbb-7327bba5ffb7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:02:08.277883 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc7d2576-f5e7-4e71-9cd6-10a7e0cba8c5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:08.278381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc7d2576-f5e7-4e71-9cd6-10a7e0cba8c5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:08.278839 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc7d2576-f5e7-4e71-9cd6-10a7e0cba8c5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:08.279575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc7d2576-f5e7-4e71-9cd6-10a7e0cba8c5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:08.280048 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc7d2576-f5e7-4e71-9cd6-10a7e0cba8c5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:08.280536 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc7d2576-f5e7-4e71-9cd6-10a7e0cba8c5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:08.419073 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bc7d2576-f5e7-4e71-9cd6-10a7e0cba8c5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:02:08.427039 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bc7d2576-f5e7-4e71-9cd6-10a7e0cba8c5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7" status: 200 len: 1392 microversion: 2.1 time: 0.160679 Sep 10 13:02:08.427644 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3770/7533] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:02:08 2022] GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:02:09.008669 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-a150735b-f048-400d-b656-367dfce7f2d2 req-0a279377-e1d7-46d4-943c-162d540f34de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b3e14ae-4728-4603-8fbb-7327bba5ffb7", "name": "network-vif-plugged", "status": "completed", "tag": "40d84eef-df26-481d-9b45-b577aca964b3"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:02:09.019317 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a150735b-f048-400d-b656-367dfce7f2d2 req-0a279377-e1d7-46d4-943c-162d540f34de service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:09.019879 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a150735b-f048-400d-b656-367dfce7f2d2 req-0a279377-e1d7-46d4-943c-162d540f34de service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:09.020317 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a150735b-f048-400d-b656-367dfce7f2d2 req-0a279377-e1d7-46d4-943c-162d540f34de service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:09.032475 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-a150735b-f048-400d-b656-367dfce7f2d2 req-0a279377-e1d7-46d4-943c-162d540f34de service nova] Creating event network-vif-plugged:40d84eef-df26-481d-9b45-b577aca964b3 for instance 9b3e14ae-4728-4603-8fbb-7327bba5ffb7 on n-h2-856895-1 Sep 10 13:02:09.037516 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-a150735b-f048-400d-b656-367dfce7f2d2 req-0a279377-e1d7-46d4-943c-162d540f34de service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032833 Sep 10 13:02:09.038684 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3764/7534] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 13:02:09.450576 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0131fc42-89c8-48b8-a7e8-7dc50fec9cdc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:02:09.451225 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0131fc42-89c8-48b8-a7e8-7dc50fec9cdc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 9b3e14ae-4728-4603-8fbb-7327bba5ffb7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:02:09.459124 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0131fc42-89c8-48b8-a7e8-7dc50fec9cdc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:09.459652 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0131fc42-89c8-48b8-a7e8-7dc50fec9cdc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:09.460104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0131fc42-89c8-48b8-a7e8-7dc50fec9cdc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:09.460805 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0131fc42-89c8-48b8-a7e8-7dc50fec9cdc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:09.461272 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0131fc42-89c8-48b8-a7e8-7dc50fec9cdc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:09.461712 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0131fc42-89c8-48b8-a7e8-7dc50fec9cdc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:09.595808 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0131fc42-89c8-48b8-a7e8-7dc50fec9cdc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:02:09.603391 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0131fc42-89c8-48b8-a7e8-7dc50fec9cdc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7" status: 200 len: 1392 microversion: 2.1 time: 0.156701 Sep 10 13:02:09.603961 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3771/7535] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:02:09 2022] GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:02:10.624213 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:02:10.624985 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:02:10.629030 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5e939e36-384d-4ec7-8862-18e942ef6731 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:02:10.629741 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5e939e36-384d-4ec7-8862-18e942ef6731 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 9b3e14ae-4728-4603-8fbb-7327bba5ffb7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:02:10.637065 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5e939e36-384d-4ec7-8862-18e942ef6731 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:10.637546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5e939e36-384d-4ec7-8862-18e942ef6731 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:10.637993 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5e939e36-384d-4ec7-8862-18e942ef6731 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:10.638685 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5e939e36-384d-4ec7-8862-18e942ef6731 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:10.639144 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5e939e36-384d-4ec7-8862-18e942ef6731 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:10.639614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5e939e36-384d-4ec7-8862-18e942ef6731 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:10.775770 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5e939e36-384d-4ec7-8862-18e942ef6731 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:02:10.784246 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5e939e36-384d-4ec7-8862-18e942ef6731 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7" status: 200 len: 1564 microversion: 2.1 time: 0.161870 Sep 10 13:02:10.784834 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3765/7536] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:02:10 2022] GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7 => generated 1564 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:02:10.807235 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-090c2df2-b5a7-48b5-b7d7-fec21b6da447 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:02:10.807868 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-090c2df2-b5a7-48b5-b7d7-fec21b6da447 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 9b3e14ae-4728-4603-8fbb-7327bba5ffb7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:02:10.809774 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:02:10.816637 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-090c2df2-b5a7-48b5-b7d7-fec21b6da447 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:10.817141 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-090c2df2-b5a7-48b5-b7d7-fec21b6da447 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:10.817597 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-090c2df2-b5a7-48b5-b7d7-fec21b6da447 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:10.818306 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-090c2df2-b5a7-48b5-b7d7-fec21b6da447 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:10.818776 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-090c2df2-b5a7-48b5-b7d7-fec21b6da447 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:10.819270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-090c2df2-b5a7-48b5-b7d7-fec21b6da447 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:10.954753 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-090c2df2-b5a7-48b5-b7d7-fec21b6da447 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:02:10.962537 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-090c2df2-b5a7-48b5-b7d7-fec21b6da447 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7" status: 200 len: 1564 microversion: 2.1 time: 0.159196 Sep 10 13:02:10.963116 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3772/7537] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:02:10 2022] GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7 => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:02:12.568169 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-d10337fb-fabc-4c15-8ee1-adcf60b64507 req-b96de914-3fc1-45ab-9eb9-8d450753c428 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b3e14ae-4728-4603-8fbb-7327bba5ffb7", "tag": "40d84eef-df26-481d-9b45-b577aca964b3"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:02:12.574111 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3223cc59-5519-41d3-a4e8-cdcc2a96beb9 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:02:12.574740 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3223cc59-5519-41d3-a4e8-cdcc2a96beb9 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 9b3e14ae-4728-4603-8fbb-7327bba5ffb7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:02:12.579869 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:02:12.583067 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:02:12.588773 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3223cc59-5519-41d3-a4e8-cdcc2a96beb9 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:12.593885 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d10337fb-fabc-4c15-8ee1-adcf60b64507 req-b96de914-3fc1-45ab-9eb9-8d450753c428 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:12.594426 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d10337fb-fabc-4c15-8ee1-adcf60b64507 req-b96de914-3fc1-45ab-9eb9-8d450753c428 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:12.594876 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d10337fb-fabc-4c15-8ee1-adcf60b64507 req-b96de914-3fc1-45ab-9eb9-8d450753c428 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:12.599768 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3223cc59-5519-41d3-a4e8-cdcc2a96beb9 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:12.600226 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3223cc59-5519-41d3-a4e8-cdcc2a96beb9 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:12.600956 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3223cc59-5519-41d3-a4e8-cdcc2a96beb9 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:12.601413 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3223cc59-5519-41d3-a4e8-cdcc2a96beb9 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:12.601846 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3223cc59-5519-41d3-a4e8-cdcc2a96beb9 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:12.614472 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-d10337fb-fabc-4c15-8ee1-adcf60b64507 req-b96de914-3fc1-45ab-9eb9-8d450753c428 service nova] Creating event network-changed:40d84eef-df26-481d-9b45-b577aca964b3 for instance 9b3e14ae-4728-4603-8fbb-7327bba5ffb7 on n-h2-856895-1 Sep 10 13:02:12.619882 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-d10337fb-fabc-4c15-8ee1-adcf60b64507 req-b96de914-3fc1-45ab-9eb9-8d450753c428 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055434 Sep 10 13:02:12.621049 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3773/7538] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:02:12.753589 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3223cc59-5519-41d3-a4e8-cdcc2a96beb9 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:02:12.762339 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3223cc59-5519-41d3-a4e8-cdcc2a96beb9 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7" status: 200 len: 1564 microversion: 2.1 time: 0.200651 Sep 10 13:02:12.763222 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3766/7539] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:02:12 2022] GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7 => generated 1564 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:02:36.018757 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=38 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:02:36.019554 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:02:36.024081 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7fc792df-eebf-43da-b857-fbe8b6283ba2 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:02:36.026434 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7fc792df-eebf-43da-b857-fbe8b6283ba2 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 9b3e14ae-4728-4603-8fbb-7327bba5ffb7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:02:36.034112 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7fc792df-eebf-43da-b857-fbe8b6283ba2 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:36.034615 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7fc792df-eebf-43da-b857-fbe8b6283ba2 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:36.035078 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7fc792df-eebf-43da-b857-fbe8b6283ba2 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:36.035818 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7fc792df-eebf-43da-b857-fbe8b6283ba2 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:36.036297 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7fc792df-eebf-43da-b857-fbe8b6283ba2 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:36.036745 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7fc792df-eebf-43da-b857-fbe8b6283ba2 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:36.091401 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7fc792df-eebf-43da-b857-fbe8b6283ba2 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "POST /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7/action" status: 200 len: 24569 microversion: 2.1 time: 0.074387 Sep 10 13:02:36.091994 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3774/7540] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 13:02:36 2022] POST /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7/action => generated 24569 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 13:02:42.512404 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1b568bec-3307-4554-b2db-28edf7afb482 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:02:42.514711 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1b568bec-3307-4554-b2db-28edf7afb482 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 9b3e14ae-4728-4603-8fbb-7327bba5ffb7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:02:42.517400 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:02:42.518045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=36 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:02:42.524608 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b568bec-3307-4554-b2db-28edf7afb482 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:42.525102 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b568bec-3307-4554-b2db-28edf7afb482 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:42.525538 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b568bec-3307-4554-b2db-28edf7afb482 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:42.526272 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b568bec-3307-4554-b2db-28edf7afb482 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:42.526726 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b568bec-3307-4554-b2db-28edf7afb482 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:42.527150 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b568bec-3307-4554-b2db-28edf7afb482 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:42.604928 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1b568bec-3307-4554-b2db-28edf7afb482 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "POST /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7/action" status: 202 len: 0 microversion: 2.1 time: 0.096520 Sep 10 13:02:42.605690 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3767/7541] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 13:02:42 2022] POST /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 13:02:42.615529 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-667e0591-029a-4e4c-b9e1-a8493a9beb0e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:02:42.616282 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-667e0591-029a-4e4c-b9e1-a8493a9beb0e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 9b3e14ae-4728-4603-8fbb-7327bba5ffb7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:02:42.623837 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-667e0591-029a-4e4c-b9e1-a8493a9beb0e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:42.624335 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-667e0591-029a-4e4c-b9e1-a8493a9beb0e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:42.624804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-667e0591-029a-4e4c-b9e1-a8493a9beb0e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:42.625637 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-667e0591-029a-4e4c-b9e1-a8493a9beb0e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:42.626150 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-667e0591-029a-4e4c-b9e1-a8493a9beb0e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:42.626788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-667e0591-029a-4e4c-b9e1-a8493a9beb0e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:42.769765 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-667e0591-029a-4e4c-b9e1-a8493a9beb0e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:02:42.777562 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-667e0591-029a-4e4c-b9e1-a8493a9beb0e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7" status: 200 len: 1675 microversion: 2.1 time: 0.167360 Sep 10 13:02:42.778155 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3775/7542] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:02:42 2022] GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7 => generated 1675 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:02:43.802927 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a9316c55-8673-4886-b058-a63f1a4ab929 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:02:43.803688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a9316c55-8673-4886-b058-a63f1a4ab929 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 9b3e14ae-4728-4603-8fbb-7327bba5ffb7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:02:43.809867 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9316c55-8673-4886-b058-a63f1a4ab929 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:43.810356 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9316c55-8673-4886-b058-a63f1a4ab929 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:43.811064 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9316c55-8673-4886-b058-a63f1a4ab929 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:43.811796 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9316c55-8673-4886-b058-a63f1a4ab929 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:43.812254 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9316c55-8673-4886-b058-a63f1a4ab929 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:43.812687 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a9316c55-8673-4886-b058-a63f1a4ab929 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:43.947668 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a9316c55-8673-4886-b058-a63f1a4ab929 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:02:43.956352 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a9316c55-8673-4886-b058-a63f1a4ab929 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7" status: 200 len: 1680 microversion: 2.1 time: 0.159400 Sep 10 13:02:43.956927 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3768/7543] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:02:43 2022] GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:02:44.980907 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5aa20435-f46d-4b33-9dcc-3a491ee12b01 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:02:44.981548 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5aa20435-f46d-4b33-9dcc-3a491ee12b01 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 9b3e14ae-4728-4603-8fbb-7327bba5ffb7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:02:44.989201 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5aa20435-f46d-4b33-9dcc-3a491ee12b01 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:44.989706 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5aa20435-f46d-4b33-9dcc-3a491ee12b01 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:44.990168 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5aa20435-f46d-4b33-9dcc-3a491ee12b01 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:44.990880 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5aa20435-f46d-4b33-9dcc-3a491ee12b01 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:44.991387 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5aa20435-f46d-4b33-9dcc-3a491ee12b01 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:44.991840 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5aa20435-f46d-4b33-9dcc-3a491ee12b01 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:45.122838 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5aa20435-f46d-4b33-9dcc-3a491ee12b01 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:02:45.131191 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5aa20435-f46d-4b33-9dcc-3a491ee12b01 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7" status: 200 len: 1680 microversion: 2.1 time: 0.154170 Sep 10 13:02:45.131869 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3776/7544] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:02:44 2022] GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:02:46.155046 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0640a675-4cbd-40b4-a70b-7b0de548dac8 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:02:46.155669 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0640a675-4cbd-40b4-a70b-7b0de548dac8 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 9b3e14ae-4728-4603-8fbb-7327bba5ffb7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:02:46.163000 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0640a675-4cbd-40b4-a70b-7b0de548dac8 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:46.163535 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0640a675-4cbd-40b4-a70b-7b0de548dac8 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:46.163974 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0640a675-4cbd-40b4-a70b-7b0de548dac8 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:46.164658 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0640a675-4cbd-40b4-a70b-7b0de548dac8 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:46.165110 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0640a675-4cbd-40b4-a70b-7b0de548dac8 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:46.165531 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0640a675-4cbd-40b4-a70b-7b0de548dac8 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:46.301362 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0640a675-4cbd-40b4-a70b-7b0de548dac8 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:02:46.309173 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0640a675-4cbd-40b4-a70b-7b0de548dac8 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7" status: 200 len: 1680 microversion: 2.1 time: 0.158050 Sep 10 13:02:46.309782 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3769/7545] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:02:46 2022] GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:02:47.334368 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-59d0a6c5-fc82-4ea1-b298-91312e1ae0a6 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:02:47.334997 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-59d0a6c5-fc82-4ea1-b298-91312e1ae0a6 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 9b3e14ae-4728-4603-8fbb-7327bba5ffb7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:02:47.342157 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-59d0a6c5-fc82-4ea1-b298-91312e1ae0a6 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:47.342654 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-59d0a6c5-fc82-4ea1-b298-91312e1ae0a6 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:47.343104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-59d0a6c5-fc82-4ea1-b298-91312e1ae0a6 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:47.343832 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-59d0a6c5-fc82-4ea1-b298-91312e1ae0a6 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:47.344295 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-59d0a6c5-fc82-4ea1-b298-91312e1ae0a6 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:47.345269 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-59d0a6c5-fc82-4ea1-b298-91312e1ae0a6 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:47.482524 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-59d0a6c5-fc82-4ea1-b298-91312e1ae0a6 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:02:47.491121 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-59d0a6c5-fc82-4ea1-b298-91312e1ae0a6 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7" status: 200 len: 1680 microversion: 2.1 time: 0.160903 Sep 10 13:02:47.491754 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3777/7546] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:02:47 2022] GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:02:48.514112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bfaf4081-8193-445c-a264-6a0c2a605eec tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:02:48.514729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bfaf4081-8193-445c-a264-6a0c2a605eec tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 9b3e14ae-4728-4603-8fbb-7327bba5ffb7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:02:48.522062 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bfaf4081-8193-445c-a264-6a0c2a605eec tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:48.522576 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bfaf4081-8193-445c-a264-6a0c2a605eec tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:48.523013 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bfaf4081-8193-445c-a264-6a0c2a605eec tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:48.523730 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bfaf4081-8193-445c-a264-6a0c2a605eec tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:48.524181 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bfaf4081-8193-445c-a264-6a0c2a605eec tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:48.524608 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bfaf4081-8193-445c-a264-6a0c2a605eec tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:48.656931 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bfaf4081-8193-445c-a264-6a0c2a605eec tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:02:48.665828 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bfaf4081-8193-445c-a264-6a0c2a605eec tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7" status: 200 len: 1680 microversion: 2.1 time: 0.155649 Sep 10 13:02:48.666400 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3770/7547] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:02:48 2022] GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:02:49.689931 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-05ae49c8-c4f3-4ff7-a4bf-6f1b87055d68 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:02:49.690568 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-05ae49c8-c4f3-4ff7-a4bf-6f1b87055d68 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 9b3e14ae-4728-4603-8fbb-7327bba5ffb7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:02:49.697524 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05ae49c8-c4f3-4ff7-a4bf-6f1b87055d68 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:49.698023 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05ae49c8-c4f3-4ff7-a4bf-6f1b87055d68 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:49.698482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05ae49c8-c4f3-4ff7-a4bf-6f1b87055d68 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:49.699208 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05ae49c8-c4f3-4ff7-a4bf-6f1b87055d68 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:49.699685 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05ae49c8-c4f3-4ff7-a4bf-6f1b87055d68 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:49.700133 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-05ae49c8-c4f3-4ff7-a4bf-6f1b87055d68 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:49.886149 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-05ae49c8-c4f3-4ff7-a4bf-6f1b87055d68 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:02:49.895152 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-05ae49c8-c4f3-4ff7-a4bf-6f1b87055d68 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7" status: 200 len: 1680 microversion: 2.1 time: 0.208760 Sep 10 13:02:49.899248 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3778/7548] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:02:49 2022] GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7 => generated 1680 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:02:50.919667 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3c509ccf-ba9c-4a67-b304-8ed889ce85b6 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:02:50.920311 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3c509ccf-ba9c-4a67-b304-8ed889ce85b6 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 9b3e14ae-4728-4603-8fbb-7327bba5ffb7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:02:50.927195 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3c509ccf-ba9c-4a67-b304-8ed889ce85b6 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:50.927686 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3c509ccf-ba9c-4a67-b304-8ed889ce85b6 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:50.928119 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3c509ccf-ba9c-4a67-b304-8ed889ce85b6 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:50.928810 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3c509ccf-ba9c-4a67-b304-8ed889ce85b6 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:50.929262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3c509ccf-ba9c-4a67-b304-8ed889ce85b6 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:50.929686 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3c509ccf-ba9c-4a67-b304-8ed889ce85b6 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:51.059889 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3c509ccf-ba9c-4a67-b304-8ed889ce85b6 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:02:51.069005 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3c509ccf-ba9c-4a67-b304-8ed889ce85b6 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7" status: 200 len: 1680 microversion: 2.1 time: 0.153043 Sep 10 13:02:51.069606 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3771/7549] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:02:50 2022] GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:02:52.093068 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ca3c4d05-9619-45f2-8e68-0dc2cd59923f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:02:52.093704 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ca3c4d05-9619-45f2-8e68-0dc2cd59923f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 9b3e14ae-4728-4603-8fbb-7327bba5ffb7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:02:52.101017 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca3c4d05-9619-45f2-8e68-0dc2cd59923f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:52.101516 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca3c4d05-9619-45f2-8e68-0dc2cd59923f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:52.101972 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca3c4d05-9619-45f2-8e68-0dc2cd59923f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:52.102679 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca3c4d05-9619-45f2-8e68-0dc2cd59923f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:52.103151 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca3c4d05-9619-45f2-8e68-0dc2cd59923f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:52.103624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ca3c4d05-9619-45f2-8e68-0dc2cd59923f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:52.238144 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ca3c4d05-9619-45f2-8e68-0dc2cd59923f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:02:52.246003 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ca3c4d05-9619-45f2-8e68-0dc2cd59923f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7" status: 200 len: 1680 microversion: 2.1 time: 0.156894 Sep 10 13:02:52.246584 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3779/7550] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:02:52 2022] GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:02:53.270211 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2d260dea-98e8-43e8-8c7b-91c1385274a3 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:02:53.270858 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2d260dea-98e8-43e8-8c7b-91c1385274a3 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 9b3e14ae-4728-4603-8fbb-7327bba5ffb7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:02:53.277846 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2d260dea-98e8-43e8-8c7b-91c1385274a3 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:53.278336 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2d260dea-98e8-43e8-8c7b-91c1385274a3 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:53.278774 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2d260dea-98e8-43e8-8c7b-91c1385274a3 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:53.279490 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2d260dea-98e8-43e8-8c7b-91c1385274a3 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:53.279949 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2d260dea-98e8-43e8-8c7b-91c1385274a3 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:53.280384 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2d260dea-98e8-43e8-8c7b-91c1385274a3 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:53.413307 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2d260dea-98e8-43e8-8c7b-91c1385274a3 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:02:53.420966 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2d260dea-98e8-43e8-8c7b-91c1385274a3 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7" status: 200 len: 1680 microversion: 2.1 time: 0.154763 Sep 10 13:02:53.421533 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3772/7551] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:02:53 2022] GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:02:54.445594 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5a6a723c-d8ef-415e-9ce4-870655da1907 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:02:54.446148 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5a6a723c-d8ef-415e-9ce4-870655da1907 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 9b3e14ae-4728-4603-8fbb-7327bba5ffb7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:02:54.452992 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5a6a723c-d8ef-415e-9ce4-870655da1907 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:54.453495 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5a6a723c-d8ef-415e-9ce4-870655da1907 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:54.453956 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5a6a723c-d8ef-415e-9ce4-870655da1907 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:54.454668 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5a6a723c-d8ef-415e-9ce4-870655da1907 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:02:54.455134 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5a6a723c-d8ef-415e-9ce4-870655da1907 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:02:54.455608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5a6a723c-d8ef-415e-9ce4-870655da1907 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:02:54.585700 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5a6a723c-d8ef-415e-9ce4-870655da1907 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:02:54.593448 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5a6a723c-d8ef-415e-9ce4-870655da1907 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7" status: 200 len: 1683 microversion: 2.1 time: 0.151941 Sep 10 13:02:54.594016 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3780/7552] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:02:54 2022] GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:03:18.789685 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9703594d-181e-42b5-bafb-fd723557bcfc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:03:18.792031 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9703594d-181e-42b5-bafb-fd723557bcfc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 9b3e14ae-4728-4603-8fbb-7327bba5ffb7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:03:18.794349 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=12 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:03:18.795011 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:03:18.801711 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9703594d-181e-42b5-bafb-fd723557bcfc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:03:18.802201 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9703594d-181e-42b5-bafb-fd723557bcfc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:03:18.802637 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9703594d-181e-42b5-bafb-fd723557bcfc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:03:18.803376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9703594d-181e-42b5-bafb-fd723557bcfc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:03:18.803835 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9703594d-181e-42b5-bafb-fd723557bcfc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:03:18.804262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9703594d-181e-42b5-bafb-fd723557bcfc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:03:18.857510 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9703594d-181e-42b5-bafb-fd723557bcfc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "POST /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7/action" status: 200 len: 69199 microversion: 2.1 time: 0.071851 Sep 10 13:03:18.858095 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3773/7553] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 13:03:18 2022] POST /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7/action => generated 69199 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 13:03:26.181705 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d9b46943-bab6-4d1b-adc6-4341a9d69458 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:03:26.182231 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d9b46943-bab6-4d1b-adc6-4341a9d69458 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 9b3e14ae-4728-4603-8fbb-7327bba5ffb7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:03:26.184800 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=14 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:03:26.185680 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=40 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:03:26.187692 n-d-856895-1 devstack@n-api.service[128776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 13:03:26.187692 n-d-856895-1 devstack@n-api.service[128776]: Sat Sep 10 13:03:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7 (ip 10.222.0.23) !!! Sep 10 13:03:26.203955 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d9b46943-bab6-4d1b-adc6-4341a9d69458 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:03:26.204632 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d9b46943-bab6-4d1b-adc6-4341a9d69458 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:03:26.205103 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d9b46943-bab6-4d1b-adc6-4341a9d69458 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:03:26.205888 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d9b46943-bab6-4d1b-adc6-4341a9d69458 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:03:26.206553 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d9b46943-bab6-4d1b-adc6-4341a9d69458 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:03:26.207074 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d9b46943-bab6-4d1b-adc6-4341a9d69458 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:03:26.238421 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d9b46943-bab6-4d1b-adc6-4341a9d69458 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 9b3e14ae-4728-4603-8fbb-7327bba5ffb7] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 13:03:26.256207 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-a8abe299-3ccc-484c-bda4-72db7a0a69f7 req-a6ecc343-fd21-40ab-b0c4-8181e2d4cdce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b3e14ae-4728-4603-8fbb-7327bba5ffb7", "tag": "40d84eef-df26-481d-9b45-b577aca964b3"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:03:26.266419 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a8abe299-3ccc-484c-bda4-72db7a0a69f7 req-a6ecc343-fd21-40ab-b0c4-8181e2d4cdce service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:03:26.266984 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a8abe299-3ccc-484c-bda4-72db7a0a69f7 req-a6ecc343-fd21-40ab-b0c4-8181e2d4cdce service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:03:26.267953 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-a8abe299-3ccc-484c-bda4-72db7a0a69f7 req-a6ecc343-fd21-40ab-b0c4-8181e2d4cdce service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:03:26.279944 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-a8abe299-3ccc-484c-bda4-72db7a0a69f7 req-a6ecc343-fd21-40ab-b0c4-8181e2d4cdce service nova] Creating event network-changed:40d84eef-df26-481d-9b45-b577aca964b3 for instance 9b3e14ae-4728-4603-8fbb-7327bba5ffb7 on n-h2-856895-1 Sep 10 13:03:26.285162 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-a8abe299-3ccc-484c-bda4-72db7a0a69f7 req-a6ecc343-fd21-40ab-b0c4-8181e2d4cdce service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105385 Sep 10 13:03:26.285788 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3774/7554] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:03:26.323427 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d9b46943-bab6-4d1b-adc6-4341a9d69458 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7" status: 204 len: 0 microversion: 2.1 time: 0.145438 Sep 10 13:03:26.323810 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3781/7555] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 13:03:26 2022] DELETE /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 13:03:26.339713 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1696f442-ec7a-410f-9000-4baa9ee697c9 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:03:26.340437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1696f442-ec7a-410f-9000-4baa9ee697c9 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 9b3e14ae-4728-4603-8fbb-7327bba5ffb7] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:03:26.347662 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1696f442-ec7a-410f-9000-4baa9ee697c9 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:03:26.348230 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1696f442-ec7a-410f-9000-4baa9ee697c9 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:03:26.348794 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1696f442-ec7a-410f-9000-4baa9ee697c9 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:03:26.349626 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1696f442-ec7a-410f-9000-4baa9ee697c9 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:03:26.350269 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1696f442-ec7a-410f-9000-4baa9ee697c9 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:03:26.350882 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1696f442-ec7a-410f-9000-4baa9ee697c9 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:03:26.554225 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1696f442-ec7a-410f-9000-4baa9ee697c9 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:03:26.562102 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1696f442-ec7a-410f-9000-4baa9ee697c9 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7" status: 200 len: 1689 microversion: 2.1 time: 0.228659 Sep 10 13:03:26.562706 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3775/7556] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:03:26 2022] GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7 => generated 1689 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:03:27.588551 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5e95904e-b279-49b4-8067-7f5305b0ebaa tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:03:27.589311 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5e95904e-b279-49b4-8067-7f5305b0ebaa tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 9b3e14ae-4728-4603-8fbb-7327bba5ffb7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:03:27.596119 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5e95904e-b279-49b4-8067-7f5305b0ebaa tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:03:27.597310 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5e95904e-b279-49b4-8067-7f5305b0ebaa tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:03:27.597833 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5e95904e-b279-49b4-8067-7f5305b0ebaa tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:03:27.598548 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5e95904e-b279-49b4-8067-7f5305b0ebaa tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:03:27.599026 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5e95904e-b279-49b4-8067-7f5305b0ebaa tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:03:27.599499 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5e95904e-b279-49b4-8067-7f5305b0ebaa tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:03:27.737970 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5e95904e-b279-49b4-8067-7f5305b0ebaa tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:03:27.745860 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5e95904e-b279-49b4-8067-7f5305b0ebaa tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7" status: 200 len: 1689 microversion: 2.1 time: 0.161605 Sep 10 13:03:27.746438 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3782/7557] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:03:27 2022] GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:03:28.301648 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-5e1d3159-e3ed-40a0-ba75-0b1dd6cf6676 req-09d3b598-54f5-469e-913c-7aa3ede72ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b3e14ae-4728-4603-8fbb-7327bba5ffb7", "name": "network-vif-deleted", "tag": "40d84eef-df26-481d-9b45-b577aca964b3"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:03:28.312292 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-5e1d3159-e3ed-40a0-ba75-0b1dd6cf6676 req-09d3b598-54f5-469e-913c-7aa3ede72ed8 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:03:28.312805 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-5e1d3159-e3ed-40a0-ba75-0b1dd6cf6676 req-09d3b598-54f5-469e-913c-7aa3ede72ed8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:03:28.313244 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-5e1d3159-e3ed-40a0-ba75-0b1dd6cf6676 req-09d3b598-54f5-469e-913c-7aa3ede72ed8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:03:28.326547 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-5e1d3159-e3ed-40a0-ba75-0b1dd6cf6676 req-09d3b598-54f5-469e-913c-7aa3ede72ed8 service nova] Creating event network-vif-deleted:40d84eef-df26-481d-9b45-b577aca964b3 for instance 9b3e14ae-4728-4603-8fbb-7327bba5ffb7 on n-h2-856895-1 Sep 10 13:03:28.333701 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-5e1d3159-e3ed-40a0-ba75-0b1dd6cf6676 req-09d3b598-54f5-469e-913c-7aa3ede72ed8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035950 Sep 10 13:03:28.334333 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3776/7558] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:03:28.771941 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cf00962c-fceb-4100-aac2-ca8f33908d07 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:03:28.772599 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-cf00962c-fceb-4100-aac2-ca8f33908d07 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 9b3e14ae-4728-4603-8fbb-7327bba5ffb7] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:03:28.779885 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cf00962c-fceb-4100-aac2-ca8f33908d07 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:03:28.780319 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cf00962c-fceb-4100-aac2-ca8f33908d07 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:03:28.780771 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cf00962c-fceb-4100-aac2-ca8f33908d07 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:03:28.781511 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cf00962c-fceb-4100-aac2-ca8f33908d07 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:03:28.781982 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cf00962c-fceb-4100-aac2-ca8f33908d07 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:03:28.782423 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-cf00962c-fceb-4100-aac2-ca8f33908d07 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:03:28.796371 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-cf00962c-fceb-4100-aac2-ca8f33908d07 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] HTTP exception thrown: Instance 9b3e14ae-4728-4603-8fbb-7327bba5ffb7 could not be found. Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cf00962c-fceb-4100-aac2-ca8f33908d07 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Request method failure captured: Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7 HTTP/1.1 Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHIpdJSi4DFbBHL8V-ThkqWs5qsENn9f44fAjCGfIVt2JLbU_2M84czNkA_1xJt3KrfjUCCFS4TMpry236FRO_1OwbSaFPzXSs5yvfKc4BHVhFUvMQ81nyQLxn8rwKBj8fhkryGWzH2_U6bC_TMfY-qfd78V0LzaRSLPr8smJqhI8tXU Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: b0e733e9474c4814b77eddbf547e3a54 Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1010290636 Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b0e733e9474c4814b77eddbf547e3a54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b0e733e9474c4814b77eddbf547e3a54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b0e733e9474c4814b77eddbf547e3a54", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b0e733e9474c4814b77eddbf547e3a54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1010290636 Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: b0e733e9474c4814b77eddbf547e3a54 Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1010290636 Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-TestNetworkAdvancedServerOps-1010290636-project Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: f75e338a6cb34d11a42b65da1eca4f83 Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1010290636-project Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 9b3e14ae-4728-4603-8fbb-7327bba5ffb7 could not be found. Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '9b3e14ae-4728-4603-8fbb-7327bba5ffb7'} Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b3e14ae-4728-4603-8fbb-7327bba5ffb7 could not be found. Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b3e14ae-4728-4603-8fbb-7327bba5ffb7 could not be found. Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 13:03:28.798042 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 13:03:28.802664 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 13:03:28.802664 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 13:03:28.802664 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 13:03:28.802664 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 13:03:28.802664 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 13:03:28.802664 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 13:03:28.802664 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b3e14ae-4728-4603-8fbb-7327bba5ffb7 could not be found. Sep 10 13:03:28.802664 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 13:03:28.802664 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cf00962c-fceb-4100-aac2-ca8f33908d07 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Returning 404 to user: Instance 9b3e14ae-4728-4603-8fbb-7327bba5ffb7 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 13:03:28.802664 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cf00962c-fceb-4100-aac2-ca8f33908d07 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7" status: 404 len: 111 microversion: 2.1 time: 0.032240 Sep 10 13:03:28.802664 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3783/7559] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:03:28 2022] GET /compute/v2.1/servers/9b3e14ae-4728-4603-8fbb-7327bba5ffb7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 13:03:31.805469 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2847f40b-ddf0-4ca0-9823-ed409cc00bbf tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '.version_select at 0x7f4073681ee0>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:03:31.828869 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2847f40b-ddf0-4ca0-9823-ed409cc00bbf tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1659061573" status: 202 len: 0 microversion: 2.1 time: 0.029083 Sep 10 13:03:31.829682 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3777/7560] 10.222.0.23 () {58 vars in 1284 bytes} [Sat Sep 10 13:03:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1659061573 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 13:03:31.858701 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-622ca352-771c-425b-be0c-4d202ad69664 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Action: 'create', calling method: .version_select at 0x7f40721e85e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1437076532", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7rsmLLbUoRyeN478myFF4z6B71MNUSBMYdLhShU/0M6xf08jbTOE2lam1MmJcTp7qdqRjyL9Y0LP1iFKU4a7XXV4GvDzRlG5rwf+d0seSGFICqSIOQa23hgnpqw2NAkQ=="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:03:31.874895 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-622ca352-771c-425b-be0c-4d202ad69664 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Getting quotas for project b0e733e9474c4814b77eddbf547e3a54. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 13:03:31.881068 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-622ca352-771c-425b-be0c-4d202ad69664 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Getting quotas for user f75e338a6cb34d11a42b65da1eca4f83 and project b0e733e9474c4814b77eddbf547e3a54. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 13:03:31.905600 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-622ca352-771c-425b-be0c-4d202ad69664 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050912 Sep 10 13:03:31.906216 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3784/7561] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 13:03:31 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 13:03:37.981747 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c24b3531-0b20-47a6-9e1b-d6905d894a2d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-294798384", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "1516258d-b7e4-40dc-8525-5c336ed6a1ab"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1437076532", "security_groups": [{"name": "tempest-secgroup-smoke-1354292104"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:03:38.109573 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-c24b3531-0b20-47a6-9e1b-d6905d894a2d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] validate_networks() for [('1516258d-b7e4-40dc-8525-5c336ed6a1ab', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 13:03:38.318461 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=14 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:03:38.621990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-c24b3531-0b20-47a6-9e1b-d6905d894a2d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 13:03:38.622395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-c24b3531-0b20-47a6-9e1b-d6905d894a2d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 13:03:38.622904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-c24b3531-0b20-47a6-9e1b-d6905d894a2d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 13:03:38.623353 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-c24b3531-0b20-47a6-9e1b-d6905d894a2d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 13:03:38.623770 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-c24b3531-0b20-47a6-9e1b-d6905d894a2d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 13:03:38.634253 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c24b3531-0b20-47a6-9e1b-d6905d894a2d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:03:38.635319 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c24b3531-0b20-47a6-9e1b-d6905d894a2d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:03:38.635758 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c24b3531-0b20-47a6-9e1b-d6905d894a2d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:03:38.636489 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c24b3531-0b20-47a6-9e1b-d6905d894a2d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:03:38.636942 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c24b3531-0b20-47a6-9e1b-d6905d894a2d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:03:38.637362 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c24b3531-0b20-47a6-9e1b-d6905d894a2d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:03:38.660587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-c24b3531-0b20-47a6-9e1b-d6905d894a2d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Getting quotas for project b0e733e9474c4814b77eddbf547e3a54. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 13:03:38.667789 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-c24b3531-0b20-47a6-9e1b-d6905d894a2d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Getting quotas for user f75e338a6cb34d11a42b65da1eca4f83 and project b0e733e9474c4814b77eddbf547e3a54. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 13:03:38.683714 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c24b3531-0b20-47a6-9e1b-d6905d894a2d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 13:03:38.686570 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c24b3531-0b20-47a6-9e1b-d6905d894a2d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 13:03:38.742996 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c24b3531-0b20-47a6-9e1b-d6905d894a2d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.767313 Sep 10 13:03:38.744856 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3778/7562] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 13:03:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 13:03:38.756048 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4c6de51c-5d0e-44cb-beec-e83a7b86c541 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:03:38.757433 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4c6de51c-5d0e-44cb-beec-e83a7b86c541 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:03:38.795842 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:03:38.863013 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4c6de51c-5d0e-44cb-beec-e83a7b86c541 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:03:38.871205 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4c6de51c-5d0e-44cb-beec-e83a7b86c541 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d" status: 200 len: 1266 microversion: 2.1 time: 0.119420 Sep 10 13:03:38.887511 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3785/7563] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:03:38 2022] GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d => generated 1266 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:03:39.895354 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0df5d9d2-11d7-4e14-9fb6-8fee28842774 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:03:39.896573 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0df5d9d2-11d7-4e14-9fb6-8fee28842774 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:03:39.903377 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0df5d9d2-11d7-4e14-9fb6-8fee28842774 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:03:39.903861 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0df5d9d2-11d7-4e14-9fb6-8fee28842774 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:03:39.904300 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0df5d9d2-11d7-4e14-9fb6-8fee28842774 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:03:39.905004 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0df5d9d2-11d7-4e14-9fb6-8fee28842774 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:03:39.905462 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0df5d9d2-11d7-4e14-9fb6-8fee28842774 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:03:39.905892 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0df5d9d2-11d7-4e14-9fb6-8fee28842774 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:03:40.014075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0df5d9d2-11d7-4e14-9fb6-8fee28842774 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:03:40.028438 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0df5d9d2-11d7-4e14-9fb6-8fee28842774 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d" status: 200 len: 1326 microversion: 2.1 time: 0.138203 Sep 10 13:03:40.029449 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3779/7564] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:03:39 2022] GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d => generated 1326 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:03:41.056903 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8d18aaea-0c2a-4e23-9a26-b7f3edc4aa2c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:03:41.057596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8d18aaea-0c2a-4e23-9a26-b7f3edc4aa2c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:03:41.068909 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8d18aaea-0c2a-4e23-9a26-b7f3edc4aa2c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:03:41.069608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8d18aaea-0c2a-4e23-9a26-b7f3edc4aa2c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:03:41.070195 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8d18aaea-0c2a-4e23-9a26-b7f3edc4aa2c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:03:41.071047 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8d18aaea-0c2a-4e23-9a26-b7f3edc4aa2c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:03:41.071633 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8d18aaea-0c2a-4e23-9a26-b7f3edc4aa2c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:03:41.072282 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8d18aaea-0c2a-4e23-9a26-b7f3edc4aa2c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:03:41.233416 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8d18aaea-0c2a-4e23-9a26-b7f3edc4aa2c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:03:41.242520 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8d18aaea-0c2a-4e23-9a26-b7f3edc4aa2c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d" status: 200 len: 1392 microversion: 2.1 time: 0.189381 Sep 10 13:03:41.243019 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3786/7565] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:03:41 2022] GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d => generated 1392 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:03:41.594709 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-8bdeec41-56fe-4aa6-a541-9c5203cba702 req-33d03d2f-6f4c-4175-92cd-ee89e965fdad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b5b5bd1-3c78-4f7f-838d-e2849eb1806d", "tag": "198f9ccc-ba25-413b-a4fb-7dba9b8c54bf"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:03:41.606430 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8bdeec41-56fe-4aa6-a541-9c5203cba702 req-33d03d2f-6f4c-4175-92cd-ee89e965fdad service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:03:41.607215 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8bdeec41-56fe-4aa6-a541-9c5203cba702 req-33d03d2f-6f4c-4175-92cd-ee89e965fdad service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:03:41.607835 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8bdeec41-56fe-4aa6-a541-9c5203cba702 req-33d03d2f-6f4c-4175-92cd-ee89e965fdad service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:03:41.619980 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-8bdeec41-56fe-4aa6-a541-9c5203cba702 req-33d03d2f-6f4c-4175-92cd-ee89e965fdad service nova] Creating event network-changed:198f9ccc-ba25-413b-a4fb-7dba9b8c54bf for instance 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d on n-h1-856895-1 Sep 10 13:03:41.625024 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-8bdeec41-56fe-4aa6-a541-9c5203cba702 req-33d03d2f-6f4c-4175-92cd-ee89e965fdad service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034111 Sep 10 13:03:41.625786 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3780/7566] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:03:42.266352 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2e69e5c5-8f82-478c-90dc-d249c635614b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:03:42.266985 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2e69e5c5-8f82-478c-90dc-d249c635614b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:03:42.274990 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e69e5c5-8f82-478c-90dc-d249c635614b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:03:42.275533 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e69e5c5-8f82-478c-90dc-d249c635614b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:03:42.275993 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e69e5c5-8f82-478c-90dc-d249c635614b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:03:42.276712 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e69e5c5-8f82-478c-90dc-d249c635614b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:03:42.277182 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e69e5c5-8f82-478c-90dc-d249c635614b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:03:42.277628 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2e69e5c5-8f82-478c-90dc-d249c635614b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:03:42.413776 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2e69e5c5-8f82-478c-90dc-d249c635614b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:03:42.421496 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2e69e5c5-8f82-478c-90dc-d249c635614b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d" status: 200 len: 1392 microversion: 2.1 time: 0.159078 Sep 10 13:03:42.422077 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3787/7567] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:03:42 2022] GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:03:43.446311 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fc7f8b2d-3ea6-4503-8487-67d31647bf11 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:03:43.447020 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fc7f8b2d-3ea6-4503-8487-67d31647bf11 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:03:43.453289 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc7f8b2d-3ea6-4503-8487-67d31647bf11 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:03:43.453773 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc7f8b2d-3ea6-4503-8487-67d31647bf11 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:03:43.454213 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc7f8b2d-3ea6-4503-8487-67d31647bf11 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:03:43.454907 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc7f8b2d-3ea6-4503-8487-67d31647bf11 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:03:43.456056 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc7f8b2d-3ea6-4503-8487-67d31647bf11 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:03:43.456505 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fc7f8b2d-3ea6-4503-8487-67d31647bf11 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:03:43.589366 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fc7f8b2d-3ea6-4503-8487-67d31647bf11 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:03:43.597267 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fc7f8b2d-3ea6-4503-8487-67d31647bf11 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d" status: 200 len: 1392 microversion: 2.1 time: 0.156085 Sep 10 13:03:43.597866 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3781/7568] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:03:43 2022] GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:03:44.623841 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a88d57cd-b320-4551-b015-333574523145 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:03:44.623841 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a88d57cd-b320-4551-b015-333574523145 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:03:44.628537 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a88d57cd-b320-4551-b015-333574523145 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:03:44.629034 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a88d57cd-b320-4551-b015-333574523145 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:03:44.629486 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a88d57cd-b320-4551-b015-333574523145 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:03:44.630194 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a88d57cd-b320-4551-b015-333574523145 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:03:44.630664 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a88d57cd-b320-4551-b015-333574523145 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:03:44.631105 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a88d57cd-b320-4551-b015-333574523145 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:03:44.766181 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a88d57cd-b320-4551-b015-333574523145 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:03:44.774109 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a88d57cd-b320-4551-b015-333574523145 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d" status: 200 len: 1392 microversion: 2.1 time: 0.157492 Sep 10 13:03:44.774688 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3788/7569] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:03:44 2022] GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:03:45.798023 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1ca9a3d1-b988-410c-8713-af4b77afb655 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:03:45.798871 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1ca9a3d1-b988-410c-8713-af4b77afb655 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:03:45.807327 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ca9a3d1-b988-410c-8713-af4b77afb655 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:03:45.807815 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ca9a3d1-b988-410c-8713-af4b77afb655 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:03:45.808254 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ca9a3d1-b988-410c-8713-af4b77afb655 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:03:45.809884 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ca9a3d1-b988-410c-8713-af4b77afb655 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:03:45.810343 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ca9a3d1-b988-410c-8713-af4b77afb655 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:03:45.810775 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1ca9a3d1-b988-410c-8713-af4b77afb655 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:03:45.952358 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1ca9a3d1-b988-410c-8713-af4b77afb655 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:03:45.960831 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1ca9a3d1-b988-410c-8713-af4b77afb655 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d" status: 200 len: 1392 microversion: 2.1 time: 0.166833 Sep 10 13:03:45.961618 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3782/7570] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:03:45 2022] GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:03:46.984955 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b0dfab67-c355-404b-92f2-f50bec6cc7d7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:03:46.985585 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b0dfab67-c355-404b-92f2-f50bec6cc7d7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:03:46.992988 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b0dfab67-c355-404b-92f2-f50bec6cc7d7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:03:46.993482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b0dfab67-c355-404b-92f2-f50bec6cc7d7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:03:46.993936 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b0dfab67-c355-404b-92f2-f50bec6cc7d7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:03:46.994639 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b0dfab67-c355-404b-92f2-f50bec6cc7d7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:03:46.995109 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b0dfab67-c355-404b-92f2-f50bec6cc7d7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:03:46.995573 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b0dfab67-c355-404b-92f2-f50bec6cc7d7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:03:47.129712 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b0dfab67-c355-404b-92f2-f50bec6cc7d7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:03:47.138082 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b0dfab67-c355-404b-92f2-f50bec6cc7d7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d" status: 200 len: 1392 microversion: 2.1 time: 0.157021 Sep 10 13:03:47.138691 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3789/7571] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:03:46 2022] GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:03:47.525164 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-c80bb977-6f6a-4bc4-9cd6-b701b390553e req-ec78badd-fd22-41c2-a433-a63fdc0f9be3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b5b5bd1-3c78-4f7f-838d-e2849eb1806d", "name": "network-vif-plugged", "status": "completed", "tag": "198f9ccc-ba25-413b-a4fb-7dba9b8c54bf"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:03:47.535397 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-c80bb977-6f6a-4bc4-9cd6-b701b390553e req-ec78badd-fd22-41c2-a433-a63fdc0f9be3 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:03:47.535908 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-c80bb977-6f6a-4bc4-9cd6-b701b390553e req-ec78badd-fd22-41c2-a433-a63fdc0f9be3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:03:47.536337 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-c80bb977-6f6a-4bc4-9cd6-b701b390553e req-ec78badd-fd22-41c2-a433-a63fdc0f9be3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:03:47.547224 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-c80bb977-6f6a-4bc4-9cd6-b701b390553e req-ec78badd-fd22-41c2-a433-a63fdc0f9be3 service nova] Creating event network-vif-plugged:198f9ccc-ba25-413b-a4fb-7dba9b8c54bf for instance 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d on n-h1-856895-1 Sep 10 13:03:47.552269 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-c80bb977-6f6a-4bc4-9cd6-b701b390553e req-ec78badd-fd22-41c2-a433-a63fdc0f9be3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091580 Sep 10 13:03:47.552847 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3783/7572] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:03:48.160976 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a0bdd407-5589-407f-8a73-59d6b5fc7434 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:03:48.161618 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a0bdd407-5589-407f-8a73-59d6b5fc7434 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:03:48.168538 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a0bdd407-5589-407f-8a73-59d6b5fc7434 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:03:48.169069 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a0bdd407-5589-407f-8a73-59d6b5fc7434 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:03:48.169534 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a0bdd407-5589-407f-8a73-59d6b5fc7434 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:03:48.170231 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a0bdd407-5589-407f-8a73-59d6b5fc7434 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:03:48.170749 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a0bdd407-5589-407f-8a73-59d6b5fc7434 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:03:48.171203 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a0bdd407-5589-407f-8a73-59d6b5fc7434 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:03:48.306048 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a0bdd407-5589-407f-8a73-59d6b5fc7434 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:03:48.313846 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a0bdd407-5589-407f-8a73-59d6b5fc7434 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d" status: 200 len: 1392 microversion: 2.1 time: 0.156794 Sep 10 13:03:48.314421 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3790/7573] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:03:48 2022] GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:03:49.336238 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:03:49.337030 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:03:49.341098 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4322c913-b846-416d-8186-1549167a0912 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:03:49.341805 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4322c913-b846-416d-8186-1549167a0912 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:03:49.343598 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:03:49.350801 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4322c913-b846-416d-8186-1549167a0912 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:03:49.351308 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4322c913-b846-416d-8186-1549167a0912 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:03:49.351752 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4322c913-b846-416d-8186-1549167a0912 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:03:49.352446 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4322c913-b846-416d-8186-1549167a0912 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:03:49.352910 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4322c913-b846-416d-8186-1549167a0912 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:03:49.353335 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4322c913-b846-416d-8186-1549167a0912 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:03:49.484528 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4322c913-b846-416d-8186-1549167a0912 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:03:49.492326 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4322c913-b846-416d-8186-1549167a0912 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d" status: 200 len: 1565 microversion: 2.1 time: 0.157996 Sep 10 13:03:49.492907 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3784/7574] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:03:49 2022] GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:03:49.515512 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f4d8a627-437f-4a98-9208-c39434cdea88 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:03:49.516149 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f4d8a627-437f-4a98-9208-c39434cdea88 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:03:49.518242 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:03:49.524284 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4d8a627-437f-4a98-9208-c39434cdea88 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:03:49.527883 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4d8a627-437f-4a98-9208-c39434cdea88 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:03:49.527883 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4d8a627-437f-4a98-9208-c39434cdea88 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:03:49.527883 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4d8a627-437f-4a98-9208-c39434cdea88 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:03:49.527883 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4d8a627-437f-4a98-9208-c39434cdea88 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:03:49.527883 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4d8a627-437f-4a98-9208-c39434cdea88 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:03:49.658247 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f4d8a627-437f-4a98-9208-c39434cdea88 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:03:49.666744 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f4d8a627-437f-4a98-9208-c39434cdea88 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d" status: 200 len: 1565 microversion: 2.1 time: 0.155224 Sep 10 13:03:49.667345 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3791/7575] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:03:49 2022] GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 13:03:51.555884 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cd13facd-1dc4-41d1-b0d4-0d31f58828a5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:03:51.557278 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-cd13facd-1dc4-41d1-b0d4-0d31f58828a5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:03:51.557906 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-4386cf12-3449-4ffa-9385-b8e2b9a578c7 req-abdbbec9-4b4d-425d-accf-d1381bbec09a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b5b5bd1-3c78-4f7f-838d-e2849eb1806d", "tag": "198f9ccc-ba25-413b-a4fb-7dba9b8c54bf"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:03:51.564821 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd13facd-1dc4-41d1-b0d4-0d31f58828a5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:03:51.565542 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd13facd-1dc4-41d1-b0d4-0d31f58828a5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:03:51.565985 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd13facd-1dc4-41d1-b0d4-0d31f58828a5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:03:51.567085 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd13facd-1dc4-41d1-b0d4-0d31f58828a5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:03:51.567695 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd13facd-1dc4-41d1-b0d4-0d31f58828a5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:03:51.568518 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-4386cf12-3449-4ffa-9385-b8e2b9a578c7 req-abdbbec9-4b4d-425d-accf-d1381bbec09a service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:03:51.568648 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-cd13facd-1dc4-41d1-b0d4-0d31f58828a5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:03:51.569019 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-4386cf12-3449-4ffa-9385-b8e2b9a578c7 req-abdbbec9-4b4d-425d-accf-d1381bbec09a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:03:51.569473 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-4386cf12-3449-4ffa-9385-b8e2b9a578c7 req-abdbbec9-4b4d-425d-accf-d1381bbec09a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:03:51.581536 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-4386cf12-3449-4ffa-9385-b8e2b9a578c7 req-abdbbec9-4b4d-425d-accf-d1381bbec09a service nova] Creating event network-changed:198f9ccc-ba25-413b-a4fb-7dba9b8c54bf for instance 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d on n-h1-856895-1 Sep 10 13:03:51.586701 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-4386cf12-3449-4ffa-9385-b8e2b9a578c7 req-abdbbec9-4b4d-425d-accf-d1381bbec09a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032760 Sep 10 13:03:51.590326 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3792/7576] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:03:51.716357 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-cd13facd-1dc4-41d1-b0d4-0d31f58828a5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:03:51.725686 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cd13facd-1dc4-41d1-b0d4-0d31f58828a5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d" status: 200 len: 1565 microversion: 2.1 time: 0.174371 Sep 10 13:03:51.726306 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3785/7577] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:03:51 2022] GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d => generated 1565 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:04:25.010467 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-da1abd81-5508-4e93-b82a-585f398eafc4 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:04:25.012811 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-da1abd81-5508-4e93-b82a-585f398eafc4 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:04:25.015040 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:04:25.015753 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=38 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:04:25.023578 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da1abd81-5508-4e93-b82a-585f398eafc4 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:04:25.024075 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da1abd81-5508-4e93-b82a-585f398eafc4 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:04:25.024531 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da1abd81-5508-4e93-b82a-585f398eafc4 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:04:25.025235 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da1abd81-5508-4e93-b82a-585f398eafc4 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:04:25.025715 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da1abd81-5508-4e93-b82a-585f398eafc4 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:04:25.026139 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-da1abd81-5508-4e93-b82a-585f398eafc4 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:04:25.093718 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-da1abd81-5508-4e93-b82a-585f398eafc4 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "POST /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d/action" status: 200 len: 24562 microversion: 2.1 time: 0.087858 Sep 10 13:04:25.094581 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3793/7578] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 13:04:25 2022] POST /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d/action => generated 24562 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 13:04:55.307048 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:04:55.307853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=36 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:04:55.312059 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1066d144-5ecb-4002-b651-8d81602d0ed0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:04:55.314255 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1066d144-5ecb-4002-b651-8d81602d0ed0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:04:55.321573 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1066d144-5ecb-4002-b651-8d81602d0ed0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:04:55.322056 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1066d144-5ecb-4002-b651-8d81602d0ed0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:04:55.322487 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1066d144-5ecb-4002-b651-8d81602d0ed0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:04:55.323188 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1066d144-5ecb-4002-b651-8d81602d0ed0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:04:55.323649 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1066d144-5ecb-4002-b651-8d81602d0ed0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:04:55.324080 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1066d144-5ecb-4002-b651-8d81602d0ed0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:04:55.364573 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1066d144-5ecb-4002-b651-8d81602d0ed0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:04:55.370735 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1066d144-5ecb-4002-b651-8d81602d0ed0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d] Old instance type m1.heat2, new instance type m1.heat {{(pid=128777) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 10 13:04:55.377410 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-1066d144-5ecb-4002-b651-8d81602d0ed0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 13:04:55.377837 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-1066d144-5ecb-4002-b651-8d81602d0ed0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 13:04:55.378314 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-1066d144-5ecb-4002-b651-8d81602d0ed0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 13:04:55.378728 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-1066d144-5ecb-4002-b651-8d81602d0ed0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 13:04:55.379143 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-1066d144-5ecb-4002-b651-8d81602d0ed0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 13:04:55.445316 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1066d144-5ecb-4002-b651-8d81602d0ed0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "POST /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d/action" status: 202 len: 0 microversion: 2.1 time: 0.140018 Sep 10 13:04:55.445935 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3786/7579] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 13:04:55 2022] POST /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 13:04:55.454891 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-56f37492-b811-48f7-beca-eef72a6f1bbd tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:04:55.455680 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-56f37492-b811-48f7-beca-eef72a6f1bbd tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:04:55.458870 n-d-856895-1 devstack@n-api.service[128776]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8e1e649-5477-464a-a830-120923e99a14] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 10 13:04:55.460005 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:04:55.460596 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=4 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:04:55.466788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-56f37492-b811-48f7-beca-eef72a6f1bbd tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:04:55.467315 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-56f37492-b811-48f7-beca-eef72a6f1bbd tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:04:55.467773 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-56f37492-b811-48f7-beca-eef72a6f1bbd tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:04:55.468491 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-56f37492-b811-48f7-beca-eef72a6f1bbd tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:04:55.468997 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-56f37492-b811-48f7-beca-eef72a6f1bbd tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:04:55.469424 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-56f37492-b811-48f7-beca-eef72a6f1bbd tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:04:55.621477 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-56f37492-b811-48f7-beca-eef72a6f1bbd tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:04:55.631069 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-56f37492-b811-48f7-beca-eef72a6f1bbd tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d" status: 200 len: 1693 microversion: 2.1 time: 0.180467 Sep 10 13:04:55.631683 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3794/7580] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:04:55 2022] GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d => generated 1693 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 13:04:56.656655 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-97458ffd-16e7-4162-b889-8fbef2d37e3f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:04:56.657376 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-97458ffd-16e7-4162-b889-8fbef2d37e3f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:04:56.665528 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-97458ffd-16e7-4162-b889-8fbef2d37e3f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:04:56.666138 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-97458ffd-16e7-4162-b889-8fbef2d37e3f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:04:56.666580 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-97458ffd-16e7-4162-b889-8fbef2d37e3f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:04:56.667465 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-97458ffd-16e7-4162-b889-8fbef2d37e3f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:04:56.667934 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-97458ffd-16e7-4162-b889-8fbef2d37e3f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:04:56.668367 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-97458ffd-16e7-4162-b889-8fbef2d37e3f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:04:56.804868 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-97458ffd-16e7-4162-b889-8fbef2d37e3f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:04:56.812579 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-97458ffd-16e7-4162-b889-8fbef2d37e3f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d" status: 200 len: 1693 microversion: 2.1 time: 0.161180 Sep 10 13:04:56.813147 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3787/7581] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:04:56 2022] GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:04:57.838954 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ccdb1bfe-44c3-4a7d-8ea8-fd6d6c2723da tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:04:57.839603 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ccdb1bfe-44c3-4a7d-8ea8-fd6d6c2723da tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:04:57.851191 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ccdb1bfe-44c3-4a7d-8ea8-fd6d6c2723da tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:04:57.851736 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ccdb1bfe-44c3-4a7d-8ea8-fd6d6c2723da tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:04:57.852199 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ccdb1bfe-44c3-4a7d-8ea8-fd6d6c2723da tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:04:57.852918 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ccdb1bfe-44c3-4a7d-8ea8-fd6d6c2723da tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:04:57.853428 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ccdb1bfe-44c3-4a7d-8ea8-fd6d6c2723da tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:04:57.853898 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ccdb1bfe-44c3-4a7d-8ea8-fd6d6c2723da tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:04:57.858196 n-d-856895-1 devstack@n-api.service[128776]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8e1e649-5477-464a-a830-120923e99a14] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 37790. Sep 10 13:04:57.991723 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ccdb1bfe-44c3-4a7d-8ea8-fd6d6c2723da tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:04:57.999705 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ccdb1bfe-44c3-4a7d-8ea8-fd6d6c2723da tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d" status: 200 len: 1698 microversion: 2.1 time: 0.164904 Sep 10 13:04:58.000286 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3795/7582] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:04:57 2022] GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d => generated 1698 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:04:59.026003 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9f86985a-b774-4fbb-9546-63a694fdb4e8 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:04:59.026630 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9f86985a-b774-4fbb-9546-63a694fdb4e8 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:04:59.033415 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9f86985a-b774-4fbb-9546-63a694fdb4e8 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:04:59.033902 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9f86985a-b774-4fbb-9546-63a694fdb4e8 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:04:59.034331 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9f86985a-b774-4fbb-9546-63a694fdb4e8 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:04:59.035018 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9f86985a-b774-4fbb-9546-63a694fdb4e8 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:04:59.035698 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9f86985a-b774-4fbb-9546-63a694fdb4e8 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:04:59.036163 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9f86985a-b774-4fbb-9546-63a694fdb4e8 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:04:59.168845 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9f86985a-b774-4fbb-9546-63a694fdb4e8 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:04:59.176637 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9f86985a-b774-4fbb-9546-63a694fdb4e8 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d" status: 200 len: 1698 microversion: 2.1 time: 0.154787 Sep 10 13:04:59.177210 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3788/7583] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:04:59 2022] GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d => generated 1698 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 13:05:00.200928 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1f814a22-7902-443e-84ca-175cee7ec214 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:05:00.201542 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1f814a22-7902-443e-84ca-175cee7ec214 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:05:00.209484 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f814a22-7902-443e-84ca-175cee7ec214 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:00.209979 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f814a22-7902-443e-84ca-175cee7ec214 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:00.210433 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f814a22-7902-443e-84ca-175cee7ec214 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:00.211134 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f814a22-7902-443e-84ca-175cee7ec214 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:00.211628 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f814a22-7902-443e-84ca-175cee7ec214 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:00.212069 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1f814a22-7902-443e-84ca-175cee7ec214 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:00.352707 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1f814a22-7902-443e-84ca-175cee7ec214 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:05:00.360588 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1f814a22-7902-443e-84ca-175cee7ec214 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d" status: 200 len: 1698 microversion: 2.1 time: 0.163645 Sep 10 13:05:00.361158 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3796/7584] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:05:00 2022] GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d => generated 1698 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:05:01.384953 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ffc5dc7b-d90e-47cb-9aa9-e7a966a90cda tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:05:01.385837 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ffc5dc7b-d90e-47cb-9aa9-e7a966a90cda tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:05:01.392757 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ffc5dc7b-d90e-47cb-9aa9-e7a966a90cda tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:01.393187 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ffc5dc7b-d90e-47cb-9aa9-e7a966a90cda tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:01.393625 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ffc5dc7b-d90e-47cb-9aa9-e7a966a90cda tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:01.394347 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ffc5dc7b-d90e-47cb-9aa9-e7a966a90cda tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:01.394856 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ffc5dc7b-d90e-47cb-9aa9-e7a966a90cda tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:01.395566 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ffc5dc7b-d90e-47cb-9aa9-e7a966a90cda tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:01.526016 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ffc5dc7b-d90e-47cb-9aa9-e7a966a90cda tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:05:01.533668 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ffc5dc7b-d90e-47cb-9aa9-e7a966a90cda tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d" status: 200 len: 1698 microversion: 2.1 time: 0.152679 Sep 10 13:05:01.534443 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3789/7585] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:05:01 2022] GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d => generated 1698 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:05:02.558256 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a26103f4-722f-4b94-8496-34b2f355b9bb tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:05:02.558895 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a26103f4-722f-4b94-8496-34b2f355b9bb tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:05:02.566146 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a26103f4-722f-4b94-8496-34b2f355b9bb tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:02.567246 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a26103f4-722f-4b94-8496-34b2f355b9bb tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:02.567753 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a26103f4-722f-4b94-8496-34b2f355b9bb tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:02.568470 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a26103f4-722f-4b94-8496-34b2f355b9bb tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:02.568947 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a26103f4-722f-4b94-8496-34b2f355b9bb tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:02.569392 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a26103f4-722f-4b94-8496-34b2f355b9bb tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:02.701916 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a26103f4-722f-4b94-8496-34b2f355b9bb tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:05:02.710075 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a26103f4-722f-4b94-8496-34b2f355b9bb tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d" status: 200 len: 1698 microversion: 2.1 time: 0.155859 Sep 10 13:05:02.710653 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3797/7586] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:05:02 2022] GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d => generated 1698 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:05:03.734238 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-16928897-5060-4a6c-a328-1c9c4895f8c7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:05:03.734857 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-16928897-5060-4a6c-a328-1c9c4895f8c7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:05:03.741754 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-16928897-5060-4a6c-a328-1c9c4895f8c7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:03.742243 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-16928897-5060-4a6c-a328-1c9c4895f8c7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:03.742687 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-16928897-5060-4a6c-a328-1c9c4895f8c7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:03.743412 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-16928897-5060-4a6c-a328-1c9c4895f8c7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:03.743870 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-16928897-5060-4a6c-a328-1c9c4895f8c7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:03.744302 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-16928897-5060-4a6c-a328-1c9c4895f8c7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:03.880965 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-16928897-5060-4a6c-a328-1c9c4895f8c7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:05:03.888954 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-16928897-5060-4a6c-a328-1c9c4895f8c7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d" status: 200 len: 1698 microversion: 2.1 time: 0.158725 Sep 10 13:05:03.889524 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3790/7587] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:05:03 2022] GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d => generated 1698 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:05:04.915186 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a51d8147-fd05-4e0f-9460-eb1dd08c76db tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:05:04.915849 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a51d8147-fd05-4e0f-9460-eb1dd08c76db tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:05:04.922655 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a51d8147-fd05-4e0f-9460-eb1dd08c76db tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:04.923152 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a51d8147-fd05-4e0f-9460-eb1dd08c76db tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:04.923629 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a51d8147-fd05-4e0f-9460-eb1dd08c76db tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:04.924332 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a51d8147-fd05-4e0f-9460-eb1dd08c76db tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:04.925064 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a51d8147-fd05-4e0f-9460-eb1dd08c76db tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:04.925509 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a51d8147-fd05-4e0f-9460-eb1dd08c76db tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:05.058556 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a51d8147-fd05-4e0f-9460-eb1dd08c76db tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:05:05.066306 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a51d8147-fd05-4e0f-9460-eb1dd08c76db tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d" status: 200 len: 1698 microversion: 2.1 time: 0.157424 Sep 10 13:05:05.066922 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3798/7588] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:05:04 2022] GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d => generated 1698 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:05:06.090069 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-bc3ab2ae-e14e-45e8-bc9e-8ca138cb554f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:05:06.090695 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-bc3ab2ae-e14e-45e8-bc9e-8ca138cb554f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:05:06.097683 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bc3ab2ae-e14e-45e8-bc9e-8ca138cb554f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:06.098238 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bc3ab2ae-e14e-45e8-bc9e-8ca138cb554f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:06.098674 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bc3ab2ae-e14e-45e8-bc9e-8ca138cb554f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:06.099394 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bc3ab2ae-e14e-45e8-bc9e-8ca138cb554f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:06.099849 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bc3ab2ae-e14e-45e8-bc9e-8ca138cb554f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:06.100272 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-bc3ab2ae-e14e-45e8-bc9e-8ca138cb554f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:06.240497 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-bc3ab2ae-e14e-45e8-bc9e-8ca138cb554f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:05:06.248537 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-bc3ab2ae-e14e-45e8-bc9e-8ca138cb554f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d" status: 200 len: 1698 microversion: 2.1 time: 0.162339 Sep 10 13:05:06.249081 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3791/7589] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:05:06 2022] GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d => generated 1698 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:05:07.275849 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-16fc0c7d-3cfd-4eaf-97af-767ab1226cc5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:05:07.276660 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-16fc0c7d-3cfd-4eaf-97af-767ab1226cc5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:05:07.284847 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16fc0c7d-3cfd-4eaf-97af-767ab1226cc5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:07.285363 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16fc0c7d-3cfd-4eaf-97af-767ab1226cc5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:07.288202 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16fc0c7d-3cfd-4eaf-97af-767ab1226cc5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:07.289032 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16fc0c7d-3cfd-4eaf-97af-767ab1226cc5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:07.289526 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16fc0c7d-3cfd-4eaf-97af-767ab1226cc5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:07.289989 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-16fc0c7d-3cfd-4eaf-97af-767ab1226cc5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:07.432069 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-16fc0c7d-3cfd-4eaf-97af-767ab1226cc5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:05:07.439911 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-16fc0c7d-3cfd-4eaf-97af-767ab1226cc5 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d" status: 200 len: 1698 microversion: 2.1 time: 0.168379 Sep 10 13:05:07.440482 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3799/7590] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:05:07 2022] GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d => generated 1698 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:05:08.463565 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4ef2c2d0-bdaa-4a8e-ba68-6c46e3d8e58c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:05:08.464182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4ef2c2d0-bdaa-4a8e-ba68-6c46e3d8e58c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:05:08.470986 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ef2c2d0-bdaa-4a8e-ba68-6c46e3d8e58c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:08.471492 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ef2c2d0-bdaa-4a8e-ba68-6c46e3d8e58c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:08.471928 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ef2c2d0-bdaa-4a8e-ba68-6c46e3d8e58c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:08.472617 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ef2c2d0-bdaa-4a8e-ba68-6c46e3d8e58c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:08.473068 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ef2c2d0-bdaa-4a8e-ba68-6c46e3d8e58c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:08.473491 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4ef2c2d0-bdaa-4a8e-ba68-6c46e3d8e58c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:08.609695 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4ef2c2d0-bdaa-4a8e-ba68-6c46e3d8e58c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:05:08.618855 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4ef2c2d0-bdaa-4a8e-ba68-6c46e3d8e58c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d" status: 200 len: 1698 microversion: 2.1 time: 0.159055 Sep 10 13:05:08.620583 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3792/7591] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:05:08 2022] GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d => generated 1698 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:05:09.642329 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bd236bbb-a283-4257-aff5-e9c1434c391d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:05:09.642975 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bd236bbb-a283-4257-aff5-e9c1434c391d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:05:09.650148 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd236bbb-a283-4257-aff5-e9c1434c391d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:09.650659 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd236bbb-a283-4257-aff5-e9c1434c391d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:09.651120 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd236bbb-a283-4257-aff5-e9c1434c391d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:09.651878 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd236bbb-a283-4257-aff5-e9c1434c391d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:09.652356 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd236bbb-a283-4257-aff5-e9c1434c391d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:09.652806 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bd236bbb-a283-4257-aff5-e9c1434c391d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:09.857374 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bd236bbb-a283-4257-aff5-e9c1434c391d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:05:09.865712 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bd236bbb-a283-4257-aff5-e9c1434c391d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d" status: 200 len: 1698 microversion: 2.1 time: 0.226895 Sep 10 13:05:09.866042 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3800/7592] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:05:09 2022] GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d => generated 1698 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:05:10.170325 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-d6d84ed8-f9c6-4d0e-9e50-e3c195ecfa55 req-3ac6389a-04e1-40ff-ac97-8e1d79e74111 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b5b5bd1-3c78-4f7f-838d-e2849eb1806d", "name": "network-vif-unplugged", "status": "completed", "tag": "198f9ccc-ba25-413b-a4fb-7dba9b8c54bf"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:05:10.181354 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d6d84ed8-f9c6-4d0e-9e50-e3c195ecfa55 req-3ac6389a-04e1-40ff-ac97-8e1d79e74111 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:10.182076 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d6d84ed8-f9c6-4d0e-9e50-e3c195ecfa55 req-3ac6389a-04e1-40ff-ac97-8e1d79e74111 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:10.182480 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d6d84ed8-f9c6-4d0e-9e50-e3c195ecfa55 req-3ac6389a-04e1-40ff-ac97-8e1d79e74111 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:10.195902 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-d6d84ed8-f9c6-4d0e-9e50-e3c195ecfa55 req-3ac6389a-04e1-40ff-ac97-8e1d79e74111 service nova] Creating event network-vif-unplugged:198f9ccc-ba25-413b-a4fb-7dba9b8c54bf for instance 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d on n-h2-856895-1 Sep 10 13:05:10.201549 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [req-d6d84ed8-f9c6-4d0e-9e50-e3c195ecfa55 req-3ac6389a-04e1-40ff-ac97-8e1d79e74111 service nova] Instance 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856895-1', 'n-h1-856895-1'} {{(pid=128777) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 13:05:10.214583 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-d6d84ed8-f9c6-4d0e-9e50-e3c195ecfa55 req-3ac6389a-04e1-40ff-ac97-8e1d79e74111 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049198 Sep 10 13:05:10.215297 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3793/7593] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:05:10.889773 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-540a3772-a2bc-43be-a21d-d231a90e692b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:05:10.890406 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-540a3772-a2bc-43be-a21d-d231a90e692b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:05:10.898043 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-540a3772-a2bc-43be-a21d-d231a90e692b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:10.898550 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-540a3772-a2bc-43be-a21d-d231a90e692b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:10.899012 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-540a3772-a2bc-43be-a21d-d231a90e692b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:10.899756 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-540a3772-a2bc-43be-a21d-d231a90e692b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:10.900234 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-540a3772-a2bc-43be-a21d-d231a90e692b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:10.900692 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-540a3772-a2bc-43be-a21d-d231a90e692b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:11.115741 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-540a3772-a2bc-43be-a21d-d231a90e692b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:05:11.123896 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-540a3772-a2bc-43be-a21d-d231a90e692b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d" status: 200 len: 1697 microversion: 2.1 time: 0.238357 Sep 10 13:05:11.124476 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3801/7594] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:05:10 2022] GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d => generated 1697 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:05:12.149963 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ab816eff-dfee-4c30-8d01-10a28896e042 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:05:12.150675 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ab816eff-dfee-4c30-8d01-10a28896e042 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:05:12.156954 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ab816eff-dfee-4c30-8d01-10a28896e042 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:12.157435 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ab816eff-dfee-4c30-8d01-10a28896e042 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:12.157873 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ab816eff-dfee-4c30-8d01-10a28896e042 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:12.158566 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ab816eff-dfee-4c30-8d01-10a28896e042 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:12.159028 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ab816eff-dfee-4c30-8d01-10a28896e042 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:12.159489 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ab816eff-dfee-4c30-8d01-10a28896e042 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:12.232533 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-063a7940-12b3-4468-8b3b-f20c24f242c7 req-71b70477-c23f-4778-a561-3f26f8152496 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b5b5bd1-3c78-4f7f-838d-e2849eb1806d", "tag": "198f9ccc-ba25-413b-a4fb-7dba9b8c54bf"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:05:12.243526 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-063a7940-12b3-4468-8b3b-f20c24f242c7 req-71b70477-c23f-4778-a561-3f26f8152496 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:12.244029 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-063a7940-12b3-4468-8b3b-f20c24f242c7 req-71b70477-c23f-4778-a561-3f26f8152496 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:12.244623 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-063a7940-12b3-4468-8b3b-f20c24f242c7 req-71b70477-c23f-4778-a561-3f26f8152496 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:12.260495 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-063a7940-12b3-4468-8b3b-f20c24f242c7 req-71b70477-c23f-4778-a561-3f26f8152496 service nova] Creating event network-changed:198f9ccc-ba25-413b-a4fb-7dba9b8c54bf for instance 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d on n-h2-856895-1 Sep 10 13:05:12.266390 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [req-063a7940-12b3-4468-8b3b-f20c24f242c7 req-71b70477-c23f-4778-a561-3f26f8152496 service nova] Instance 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-856895-1', 'n-h1-856895-1'} {{(pid=128776) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 10 13:05:12.278221 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-063a7940-12b3-4468-8b3b-f20c24f242c7 req-71b70477-c23f-4778-a561-3f26f8152496 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049298 Sep 10 13:05:12.278889 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3802/7595] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 13:05:12.301212 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ab816eff-dfee-4c30-8d01-10a28896e042 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:05:12.309492 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ab816eff-dfee-4c30-8d01-10a28896e042 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d" status: 200 len: 1695 microversion: 2.1 time: 0.164838 Sep 10 13:05:12.310096 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3794/7596] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:05:12 2022] GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d => generated 1695 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:05:13.334178 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5501211f-2cae-48cd-9533-261499ecf6d3 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:05:13.335415 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5501211f-2cae-48cd-9533-261499ecf6d3 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:05:13.343751 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5501211f-2cae-48cd-9533-261499ecf6d3 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:13.344190 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5501211f-2cae-48cd-9533-261499ecf6d3 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:13.344662 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5501211f-2cae-48cd-9533-261499ecf6d3 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:13.345419 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5501211f-2cae-48cd-9533-261499ecf6d3 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:13.345901 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5501211f-2cae-48cd-9533-261499ecf6d3 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:13.346352 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5501211f-2cae-48cd-9533-261499ecf6d3 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:13.481026 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5501211f-2cae-48cd-9533-261499ecf6d3 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:05:13.489089 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5501211f-2cae-48cd-9533-261499ecf6d3 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d" status: 200 len: 1692 microversion: 2.1 time: 0.159473 Sep 10 13:05:13.490312 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3803/7597] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:05:13 2022] GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:05:13.512766 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-61f081ea-004e-4b00-8ad2-75fd16125c38 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:05:13.513287 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-61f081ea-004e-4b00-8ad2-75fd16125c38 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:05:13.520105 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61f081ea-004e-4b00-8ad2-75fd16125c38 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:13.520599 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61f081ea-004e-4b00-8ad2-75fd16125c38 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:13.521215 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61f081ea-004e-4b00-8ad2-75fd16125c38 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:13.522095 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61f081ea-004e-4b00-8ad2-75fd16125c38 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:13.522556 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61f081ea-004e-4b00-8ad2-75fd16125c38 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:13.522995 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-61f081ea-004e-4b00-8ad2-75fd16125c38 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:13.579560 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-61f081ea-004e-4b00-8ad2-75fd16125c38 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "POST /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d/action" status: 204 len: 0 microversion: 2.1 time: 0.070667 Sep 10 13:05:13.580196 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3795/7598] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 13:05:13 2022] POST /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d/action => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 13:05:13.641790 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-09c934df-cb57-4c67-b170-6c85bf25fcdd tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:05:13.642430 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-09c934df-cb57-4c67-b170-6c85bf25fcdd tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:05:13.649606 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-09c934df-cb57-4c67-b170-6c85bf25fcdd tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:13.650114 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-09c934df-cb57-4c67-b170-6c85bf25fcdd tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:13.650570 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-09c934df-cb57-4c67-b170-6c85bf25fcdd tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:13.651320 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-09c934df-cb57-4c67-b170-6c85bf25fcdd tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:13.651795 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-09c934df-cb57-4c67-b170-6c85bf25fcdd tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:13.652250 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-09c934df-cb57-4c67-b170-6c85bf25fcdd tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:13.801368 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-09c934df-cb57-4c67-b170-6c85bf25fcdd tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:05:13.809385 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-09c934df-cb57-4c67-b170-6c85bf25fcdd tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d" status: 200 len: 1692 microversion: 2.1 time: 0.224075 Sep 10 13:05:13.809962 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3804/7599] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:05:13 2022] GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d => generated 1692 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:05:13.832541 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3ea4284a-4733-4d3d-a468-2befa686b5a7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:05:13.833242 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3ea4284a-4733-4d3d-a468-2befa686b5a7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:05:13.840824 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3ea4284a-4733-4d3d-a468-2befa686b5a7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:13.841309 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3ea4284a-4733-4d3d-a468-2befa686b5a7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:13.841747 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3ea4284a-4733-4d3d-a468-2befa686b5a7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:13.842442 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3ea4284a-4733-4d3d-a468-2befa686b5a7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:13.842892 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3ea4284a-4733-4d3d-a468-2befa686b5a7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:13.843346 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3ea4284a-4733-4d3d-a468-2befa686b5a7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:13.978428 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3ea4284a-4733-4d3d-a468-2befa686b5a7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:05:13.986198 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3ea4284a-4733-4d3d-a468-2befa686b5a7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d" status: 200 len: 1692 microversion: 2.1 time: 0.157909 Sep 10 13:05:13.986780 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3796/7600] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:05:13 2022] GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:05:15.011033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-478c32ed-8762-4811-82ab-cbd29a082eb7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:05:15.011727 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-478c32ed-8762-4811-82ab-cbd29a082eb7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:05:15.018731 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-478c32ed-8762-4811-82ab-cbd29a082eb7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:15.019190 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-478c32ed-8762-4811-82ab-cbd29a082eb7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:15.019645 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-478c32ed-8762-4811-82ab-cbd29a082eb7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:15.020364 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-478c32ed-8762-4811-82ab-cbd29a082eb7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:15.020895 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-478c32ed-8762-4811-82ab-cbd29a082eb7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:15.021920 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-478c32ed-8762-4811-82ab-cbd29a082eb7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:15.169464 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-478c32ed-8762-4811-82ab-cbd29a082eb7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:05:15.177788 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-478c32ed-8762-4811-82ab-cbd29a082eb7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d" status: 200 len: 1692 microversion: 2.1 time: 0.170957 Sep 10 13:05:15.185292 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3805/7601] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:05:15 2022] GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d => generated 1692 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:05:16.202005 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8decb0bf-858d-459a-bb66-7030fa76f295 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:05:16.202627 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8decb0bf-858d-459a-bb66-7030fa76f295 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:05:16.209761 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8decb0bf-858d-459a-bb66-7030fa76f295 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:16.210245 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8decb0bf-858d-459a-bb66-7030fa76f295 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:16.210684 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8decb0bf-858d-459a-bb66-7030fa76f295 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:16.211412 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8decb0bf-858d-459a-bb66-7030fa76f295 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:16.211871 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8decb0bf-858d-459a-bb66-7030fa76f295 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:16.212302 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8decb0bf-858d-459a-bb66-7030fa76f295 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:16.350656 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8decb0bf-858d-459a-bb66-7030fa76f295 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:05:16.358578 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8decb0bf-858d-459a-bb66-7030fa76f295 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d" status: 200 len: 1684 microversion: 2.1 time: 0.160335 Sep 10 13:05:16.359379 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3797/7602] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:05:16 2022] GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d => generated 1684 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:05:17.984806 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-3f777930-c315-43eb-9ecf-eaf89e009a69 req-71473f84-742d-47d0-8389-1ac6807e7a5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b5b5bd1-3c78-4f7f-838d-e2849eb1806d", "name": "network-vif-plugged", "status": "completed", "tag": "198f9ccc-ba25-413b-a4fb-7dba9b8c54bf"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:05:17.996506 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-3f777930-c315-43eb-9ecf-eaf89e009a69 req-71473f84-742d-47d0-8389-1ac6807e7a5c service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:17.997002 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-3f777930-c315-43eb-9ecf-eaf89e009a69 req-71473f84-742d-47d0-8389-1ac6807e7a5c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:17.997450 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-3f777930-c315-43eb-9ecf-eaf89e009a69 req-71473f84-742d-47d0-8389-1ac6807e7a5c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:18.010304 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-3f777930-c315-43eb-9ecf-eaf89e009a69 req-71473f84-742d-47d0-8389-1ac6807e7a5c service nova] Creating event network-vif-plugged:198f9ccc-ba25-413b-a4fb-7dba9b8c54bf for instance 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d on n-h2-856895-1 Sep 10 13:05:18.015806 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-3f777930-c315-43eb-9ecf-eaf89e009a69 req-71473f84-742d-47d0-8389-1ac6807e7a5c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034896 Sep 10 13:05:18.016569 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3806/7603] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:05:38.538740 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a81fc539-ebd5-44a2-bc9c-cfc2cc0f5623 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:05:38.540947 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a81fc539-ebd5-44a2-bc9c-cfc2cc0f5623 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:05:38.543413 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=28 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:05:38.544084 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:05:38.550267 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a81fc539-ebd5-44a2-bc9c-cfc2cc0f5623 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:38.550759 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a81fc539-ebd5-44a2-bc9c-cfc2cc0f5623 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:38.551252 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a81fc539-ebd5-44a2-bc9c-cfc2cc0f5623 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:38.551953 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a81fc539-ebd5-44a2-bc9c-cfc2cc0f5623 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:38.553138 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a81fc539-ebd5-44a2-bc9c-cfc2cc0f5623 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:38.553575 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a81fc539-ebd5-44a2-bc9c-cfc2cc0f5623 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:38.615435 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a81fc539-ebd5-44a2-bc9c-cfc2cc0f5623 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "POST /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d/action" status: 200 len: 24580 microversion: 2.1 time: 0.080162 Sep 10 13:05:38.616176 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3798/7604] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 13:05:38 2022] POST /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d/action => generated 24580 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 13:05:46.002464 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-427fd616-9806-4c17-aa49-8f52c5118b1f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:05:46.003216 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-427fd616-9806-4c17-aa49-8f52c5118b1f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:05:46.004095 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-cfba948f-a9a5-46c6-81d9-0abe66f7d2f2 req-dca5f3c6-33da-4569-b924-948b92d5ef3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b5b5bd1-3c78-4f7f-838d-e2849eb1806d", "tag": "198f9ccc-ba25-413b-a4fb-7dba9b8c54bf"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:05:46.006148 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=26 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:05:46.006896 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=72 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:05:46.014913 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-427fd616-9806-4c17-aa49-8f52c5118b1f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:46.015109 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-427fd616-9806-4c17-aa49-8f52c5118b1f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:46.015670 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-427fd616-9806-4c17-aa49-8f52c5118b1f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:46.016901 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-427fd616-9806-4c17-aa49-8f52c5118b1f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:46.017020 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-427fd616-9806-4c17-aa49-8f52c5118b1f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:46.017487 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-427fd616-9806-4c17-aa49-8f52c5118b1f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:46.026830 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-cfba948f-a9a5-46c6-81d9-0abe66f7d2f2 req-dca5f3c6-33da-4569-b924-948b92d5ef3b service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:46.028613 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-cfba948f-a9a5-46c6-81d9-0abe66f7d2f2 req-dca5f3c6-33da-4569-b924-948b92d5ef3b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:46.029068 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-cfba948f-a9a5-46c6-81d9-0abe66f7d2f2 req-dca5f3c6-33da-4569-b924-948b92d5ef3b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:46.042264 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-cfba948f-a9a5-46c6-81d9-0abe66f7d2f2 req-dca5f3c6-33da-4569-b924-948b92d5ef3b service nova] Creating event network-changed:198f9ccc-ba25-413b-a4fb-7dba9b8c54bf for instance 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d on n-h2-856895-1 Sep 10 13:05:46.046665 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-427fd616-9806-4c17-aa49-8f52c5118b1f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 13:05:46.047720 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-cfba948f-a9a5-46c6-81d9-0abe66f7d2f2 req-dca5f3c6-33da-4569-b924-948b92d5ef3b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047705 Sep 10 13:05:46.048505 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3799/7605] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:05:46.139409 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-427fd616-9806-4c17-aa49-8f52c5118b1f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d" status: 204 len: 0 microversion: 2.1 time: 0.139949 Sep 10 13:05:46.140435 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3807/7606] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 13:05:45 2022] DELETE /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 13:05:46.150331 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-abfdaa53-cdad-4de7-abd7-d2bb9a8662c3 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:05:46.151040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-abfdaa53-cdad-4de7-abd7-d2bb9a8662c3 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:05:46.157444 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-abfdaa53-cdad-4de7-abd7-d2bb9a8662c3 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:46.157934 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-abfdaa53-cdad-4de7-abd7-d2bb9a8662c3 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:46.158378 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-abfdaa53-cdad-4de7-abd7-d2bb9a8662c3 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:46.159074 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-abfdaa53-cdad-4de7-abd7-d2bb9a8662c3 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:46.159564 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-abfdaa53-cdad-4de7-abd7-d2bb9a8662c3 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:46.159996 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-abfdaa53-cdad-4de7-abd7-d2bb9a8662c3 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:46.324609 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-abfdaa53-cdad-4de7-abd7-d2bb9a8662c3 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:05:46.333063 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-abfdaa53-cdad-4de7-abd7-d2bb9a8662c3 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d" status: 200 len: 1690 microversion: 2.1 time: 0.188206 Sep 10 13:05:46.333657 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3800/7607] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:05:46 2022] GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d => generated 1690 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:05:47.359801 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e7298479-ed13-4421-99ba-ce7e99eaf342 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:05:47.361194 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e7298479-ed13-4421-99ba-ce7e99eaf342 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:05:47.368190 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7298479-ed13-4421-99ba-ce7e99eaf342 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:47.368687 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7298479-ed13-4421-99ba-ce7e99eaf342 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:47.369138 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7298479-ed13-4421-99ba-ce7e99eaf342 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:47.369838 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7298479-ed13-4421-99ba-ce7e99eaf342 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:47.370307 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7298479-ed13-4421-99ba-ce7e99eaf342 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:47.370865 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e7298479-ed13-4421-99ba-ce7e99eaf342 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:47.576966 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e7298479-ed13-4421-99ba-ce7e99eaf342 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:05:47.586306 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e7298479-ed13-4421-99ba-ce7e99eaf342 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d" status: 200 len: 1690 microversion: 2.1 time: 0.230824 Sep 10 13:05:47.586895 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3808/7608] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:05:47 2022] GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d => generated 1690 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:05:47.937502 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-d5f3dfd1-d03d-478f-8fd4-9d6a345a407d req-0e37ad94-6783-4ee6-bbb4-536399dd1f6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b5b5bd1-3c78-4f7f-838d-e2849eb1806d", "name": "network-vif-deleted", "tag": "198f9ccc-ba25-413b-a4fb-7dba9b8c54bf"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:05:47.947677 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d5f3dfd1-d03d-478f-8fd4-9d6a345a407d req-0e37ad94-6783-4ee6-bbb4-536399dd1f6a service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:47.948160 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d5f3dfd1-d03d-478f-8fd4-9d6a345a407d req-0e37ad94-6783-4ee6-bbb4-536399dd1f6a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:47.948595 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-d5f3dfd1-d03d-478f-8fd4-9d6a345a407d req-0e37ad94-6783-4ee6-bbb4-536399dd1f6a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:47.960285 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-d5f3dfd1-d03d-478f-8fd4-9d6a345a407d req-0e37ad94-6783-4ee6-bbb4-536399dd1f6a service nova] Creating event network-vif-deleted:198f9ccc-ba25-413b-a4fb-7dba9b8c54bf for instance 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d on n-h2-856895-1 Sep 10 13:05:47.965321 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-d5f3dfd1-d03d-478f-8fd4-9d6a345a407d req-0e37ad94-6783-4ee6-bbb4-536399dd1f6a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085891 Sep 10 13:05:47.965946 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3801/7609] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:05:48.610859 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bdd3ca67-576a-4161-bf8b-1e48a6179652 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:05:48.611449 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bdd3ca67-576a-4161-bf8b-1e48a6179652 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:05:48.618910 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bdd3ca67-576a-4161-bf8b-1e48a6179652 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:48.619503 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bdd3ca67-576a-4161-bf8b-1e48a6179652 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:48.619955 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bdd3ca67-576a-4161-bf8b-1e48a6179652 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:48.620653 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bdd3ca67-576a-4161-bf8b-1e48a6179652 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:48.621143 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bdd3ca67-576a-4161-bf8b-1e48a6179652 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:48.621582 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bdd3ca67-576a-4161-bf8b-1e48a6179652 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:48.637805 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-bdd3ca67-576a-4161-bf8b-1e48a6179652 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] HTTP exception thrown: Instance 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d could not be found. Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bdd3ca67-576a-4161-bf8b-1e48a6179652 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Request method failure captured: Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d HTTP/1.1 Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHIpdJSi4DFbBHL8V-ThkqWs5qsENn9f44fAjCGfIVt2JLbU_2M84czNkA_1xJt3KrfjUCCFS4TMpry236FRO_1OwbSaFPzXSs5yvfKc4BHVhFUvMQ81nyQLxn8rwKBj8fhkryGWzH2_U6bC_TMfY-qfd78V0LzaRSLPr8smJqhI8tXU Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: b0e733e9474c4814b77eddbf547e3a54 Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1010290636 Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b0e733e9474c4814b77eddbf547e3a54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b0e733e9474c4814b77eddbf547e3a54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b0e733e9474c4814b77eddbf547e3a54", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b0e733e9474c4814b77eddbf547e3a54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1010290636 Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: b0e733e9474c4814b77eddbf547e3a54 Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1010290636 Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-TestNetworkAdvancedServerOps-1010290636-project Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: f75e338a6cb34d11a42b65da1eca4f83 Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1010290636-project Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d could not be found. Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '4b5b5bd1-3c78-4f7f-838d-e2849eb1806d'} Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d could not be found. Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d could not be found. Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 13:05:48.639508 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 13:05:48.643752 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 13:05:48.643752 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 13:05:48.643752 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 13:05:48.643752 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 13:05:48.643752 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 13:05:48.643752 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 13:05:48.643752 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d could not be found. Sep 10 13:05:48.643752 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 13:05:48.643752 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bdd3ca67-576a-4161-bf8b-1e48a6179652 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Returning 404 to user: Instance 4b5b5bd1-3c78-4f7f-838d-e2849eb1806d could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 13:05:48.643752 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bdd3ca67-576a-4161-bf8b-1e48a6179652 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d" status: 404 len: 111 microversion: 2.1 time: 0.034142 Sep 10 13:05:48.643752 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3809/7610] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:05:48 2022] GET /compute/v2.1/servers/4b5b5bd1-3c78-4f7f-838d-e2849eb1806d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 13:05:51.930317 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-35c1d7a5-3c6d-4efe-85db-5b0767ec5b3d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '.version_select at 0x7f4071f29e50>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:05:51.957451 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-35c1d7a5-3c6d-4efe-85db-5b0767ec5b3d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1437076532" status: 202 len: 0 microversion: 2.1 time: 0.032537 Sep 10 13:05:51.959223 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3802/7611] 10.222.0.23 () {58 vars in 1284 bytes} [Sat Sep 10 13:05:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1437076532 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 10 13:05:51.983239 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bf81d163-ff9c-41cd-809f-94ab6b1a820e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Action: 'create', calling method: .version_select at 0x7f407222b790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-911566074", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJbeAsNTkgQMgbmHYn32RjobyreixSzGf9g8Mu2rJVM5wQyO7HDJiRrHdixFvECtKjpE8JygbeCdEPNFNYnZrep1de9y9QTy6J7FAlzUvEWs2Cj+TRjhuRgGhOWl7T6BKg=="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:05:52.000178 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-bf81d163-ff9c-41cd-809f-94ab6b1a820e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Getting quotas for project b0e733e9474c4814b77eddbf547e3a54. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 13:05:52.007151 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-bf81d163-ff9c-41cd-809f-94ab6b1a820e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Getting quotas for user f75e338a6cb34d11a42b65da1eca4f83 and project b0e733e9474c4814b77eddbf547e3a54. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 13:05:52.031920 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bf81d163-ff9c-41cd-809f-94ab6b1a820e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.053006 Sep 10 13:05:52.032830 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3810/7612] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 13:05:51 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:05:57.685430 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c716d856-584d-4c38-9b84-1248a6e56eda tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1964930185", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "b4729cc0-d77f-49de-a735-f3c348a90755"}], "key_name": "tempest-TestNetworkAdvancedServerOps-911566074", "security_groups": [{"name": "tempest-secgroup-smoke-1414886042"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:05:57.814637 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-c716d856-584d-4c38-9b84-1248a6e56eda tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] validate_networks() for [('b4729cc0-d77f-49de-a735-f3c348a90755', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 13:05:57.953790 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=14 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:05:58.224990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-c716d856-584d-4c38-9b84-1248a6e56eda tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 13:05:58.225414 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-c716d856-584d-4c38-9b84-1248a6e56eda tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 13:05:58.225892 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-c716d856-584d-4c38-9b84-1248a6e56eda tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 13:05:58.226310 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-c716d856-584d-4c38-9b84-1248a6e56eda tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 13:05:58.226980 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-c716d856-584d-4c38-9b84-1248a6e56eda tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 13:05:58.236044 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c716d856-584d-4c38-9b84-1248a6e56eda tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:58.236530 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c716d856-584d-4c38-9b84-1248a6e56eda tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:58.237018 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c716d856-584d-4c38-9b84-1248a6e56eda tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:58.237932 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c716d856-584d-4c38-9b84-1248a6e56eda tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:58.238389 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c716d856-584d-4c38-9b84-1248a6e56eda tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:58.238816 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c716d856-584d-4c38-9b84-1248a6e56eda tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:58.257593 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-c716d856-584d-4c38-9b84-1248a6e56eda tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Getting quotas for project b0e733e9474c4814b77eddbf547e3a54. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 13:05:58.263287 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-c716d856-584d-4c38-9b84-1248a6e56eda tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Getting quotas for user f75e338a6cb34d11a42b65da1eca4f83 and project b0e733e9474c4814b77eddbf547e3a54. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 13:05:58.276204 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c716d856-584d-4c38-9b84-1248a6e56eda tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 13:05:58.278753 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c716d856-584d-4c38-9b84-1248a6e56eda tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 13:05:58.326357 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c716d856-584d-4c38-9b84-1248a6e56eda tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.645769 Sep 10 13:05:58.333396 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3803/7613] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 13:05:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 13:05:58.340158 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7a51124d-5f10-455f-8e46-0d0e48a7219f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:05:58.340885 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7a51124d-5f10-455f-8e46-0d0e48a7219f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:05:58.420356 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7a51124d-5f10-455f-8e46-0d0e48a7219f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:05:58.428459 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7a51124d-5f10-455f-8e46-0d0e48a7219f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0" status: 200 len: 1266 microversion: 2.1 time: 0.093569 Sep 10 13:05:58.429187 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3811/7614] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:05:58 2022] GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:05:59.452660 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ea453562-4998-4dbd-a7e8-ffc31055487e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:05:59.453943 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ea453562-4998-4dbd-a7e8-ffc31055487e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:05:59.462200 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea453562-4998-4dbd-a7e8-ffc31055487e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:59.462930 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea453562-4998-4dbd-a7e8-ffc31055487e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:59.463626 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea453562-4998-4dbd-a7e8-ffc31055487e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:59.464618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea453562-4998-4dbd-a7e8-ffc31055487e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:05:59.465081 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea453562-4998-4dbd-a7e8-ffc31055487e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:05:59.465582 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea453562-4998-4dbd-a7e8-ffc31055487e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:05:59.533091 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ea453562-4998-4dbd-a7e8-ffc31055487e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:05:59.541833 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ea453562-4998-4dbd-a7e8-ffc31055487e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0" status: 200 len: 1326 microversion: 2.1 time: 0.093946 Sep 10 13:05:59.542802 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3804/7615] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:05:59 2022] GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 => generated 1326 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:06:00.566220 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5e61f5a9-1c59-43fd-9e20-309f2b1bf368 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:06:00.567457 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5e61f5a9-1c59-43fd-9e20-309f2b1bf368 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:06:00.570188 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:06:00.577879 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5e61f5a9-1c59-43fd-9e20-309f2b1bf368 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:06:00.578403 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5e61f5a9-1c59-43fd-9e20-309f2b1bf368 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:06:00.578868 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5e61f5a9-1c59-43fd-9e20-309f2b1bf368 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:06:00.579639 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5e61f5a9-1c59-43fd-9e20-309f2b1bf368 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:06:00.580122 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5e61f5a9-1c59-43fd-9e20-309f2b1bf368 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:06:00.580575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5e61f5a9-1c59-43fd-9e20-309f2b1bf368 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:06:00.749588 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5e61f5a9-1c59-43fd-9e20-309f2b1bf368 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:06:00.758230 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5e61f5a9-1c59-43fd-9e20-309f2b1bf368 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0" status: 200 len: 1392 microversion: 2.1 time: 0.195913 Sep 10 13:06:00.759184 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3812/7616] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:06:00 2022] GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 => generated 1392 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:06:01.071467 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-c64d5ef2-251d-48ea-bcf5-c8a96ce9f70f req-4d244698-a8f6-453f-b4ae-8561c01cb0bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76180e91-c6a4-49dc-9d6c-79e5d42fd7a0", "tag": "6cda492a-9e13-4ab0-9034-19ab01336804"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:06:01.083059 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-c64d5ef2-251d-48ea-bcf5-c8a96ce9f70f req-4d244698-a8f6-453f-b4ae-8561c01cb0bc service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:06:01.083807 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-c64d5ef2-251d-48ea-bcf5-c8a96ce9f70f req-4d244698-a8f6-453f-b4ae-8561c01cb0bc service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:06:01.084213 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-c64d5ef2-251d-48ea-bcf5-c8a96ce9f70f req-4d244698-a8f6-453f-b4ae-8561c01cb0bc service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:06:01.095548 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-c64d5ef2-251d-48ea-bcf5-c8a96ce9f70f req-4d244698-a8f6-453f-b4ae-8561c01cb0bc service nova] Creating event network-changed:6cda492a-9e13-4ab0-9034-19ab01336804 for instance 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 on n-h1-856895-1 Sep 10 13:06:01.101871 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-c64d5ef2-251d-48ea-bcf5-c8a96ce9f70f req-4d244698-a8f6-453f-b4ae-8561c01cb0bc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035947 Sep 10 13:06:01.102942 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3805/7617] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:06:01.782125 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9b99e774-560b-4ab0-af2f-9864d2182a2c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:06:01.782716 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9b99e774-560b-4ab0-af2f-9864d2182a2c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:06:01.790601 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9b99e774-560b-4ab0-af2f-9864d2182a2c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:06:01.791103 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9b99e774-560b-4ab0-af2f-9864d2182a2c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:06:01.791591 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9b99e774-560b-4ab0-af2f-9864d2182a2c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:06:01.792299 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9b99e774-560b-4ab0-af2f-9864d2182a2c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:06:01.792771 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9b99e774-560b-4ab0-af2f-9864d2182a2c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:06:01.793244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9b99e774-560b-4ab0-af2f-9864d2182a2c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:06:01.929571 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9b99e774-560b-4ab0-af2f-9864d2182a2c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:06:01.937422 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9b99e774-560b-4ab0-af2f-9864d2182a2c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0" status: 200 len: 1392 microversion: 2.1 time: 0.159385 Sep 10 13:06:01.938001 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3813/7618] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:06:01 2022] GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:06:02.961883 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d3436e5d-e3dc-4f87-85b7-a154e6587c92 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:06:02.962590 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d3436e5d-e3dc-4f87-85b7-a154e6587c92 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:06:02.968769 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3436e5d-e3dc-4f87-85b7-a154e6587c92 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:06:02.969256 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3436e5d-e3dc-4f87-85b7-a154e6587c92 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:06:02.969695 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3436e5d-e3dc-4f87-85b7-a154e6587c92 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:06:02.970388 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3436e5d-e3dc-4f87-85b7-a154e6587c92 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:06:02.970845 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3436e5d-e3dc-4f87-85b7-a154e6587c92 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:06:02.971315 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3436e5d-e3dc-4f87-85b7-a154e6587c92 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:06:03.115077 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d3436e5d-e3dc-4f87-85b7-a154e6587c92 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:06:03.123182 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d3436e5d-e3dc-4f87-85b7-a154e6587c92 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0" status: 200 len: 1392 microversion: 2.1 time: 0.166417 Sep 10 13:06:03.123745 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3806/7619] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:06:02 2022] GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:06:04.146434 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-eeff81e2-728f-48a7-9be9-3440b96503c7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:06:04.147075 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-eeff81e2-728f-48a7-9be9-3440b96503c7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:06:04.154093 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eeff81e2-728f-48a7-9be9-3440b96503c7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:06:04.154600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eeff81e2-728f-48a7-9be9-3440b96503c7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:06:04.155061 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eeff81e2-728f-48a7-9be9-3440b96503c7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:06:04.155801 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eeff81e2-728f-48a7-9be9-3440b96503c7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:06:04.156278 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eeff81e2-728f-48a7-9be9-3440b96503c7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:06:04.156729 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-eeff81e2-728f-48a7-9be9-3440b96503c7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:06:04.288772 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-eeff81e2-728f-48a7-9be9-3440b96503c7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:06:04.296483 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-eeff81e2-728f-48a7-9be9-3440b96503c7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0" status: 200 len: 1392 microversion: 2.1 time: 0.154305 Sep 10 13:06:04.297065 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3814/7620] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:06:04 2022] GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:06:05.320734 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-06c498a7-15f4-4324-9433-fb446860c428 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:06:05.321294 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-06c498a7-15f4-4324-9433-fb446860c428 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:06:05.328089 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06c498a7-15f4-4324-9433-fb446860c428 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:06:05.328574 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06c498a7-15f4-4324-9433-fb446860c428 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:06:05.329016 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06c498a7-15f4-4324-9433-fb446860c428 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:06:05.329704 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06c498a7-15f4-4324-9433-fb446860c428 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:06:05.330163 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06c498a7-15f4-4324-9433-fb446860c428 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:06:05.330589 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-06c498a7-15f4-4324-9433-fb446860c428 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:06:05.468915 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-06c498a7-15f4-4324-9433-fb446860c428 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:06:05.477340 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-06c498a7-15f4-4324-9433-fb446860c428 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0" status: 200 len: 1392 microversion: 2.1 time: 0.161256 Sep 10 13:06:05.477920 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3807/7621] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:06:05 2022] GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:06:06.500375 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6455c255-d921-4528-9533-cfdb385a1a3b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:06:06.501023 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6455c255-d921-4528-9533-cfdb385a1a3b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:06:06.508372 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6455c255-d921-4528-9533-cfdb385a1a3b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:06:06.508878 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6455c255-d921-4528-9533-cfdb385a1a3b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:06:06.509334 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6455c255-d921-4528-9533-cfdb385a1a3b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:06:06.510054 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6455c255-d921-4528-9533-cfdb385a1a3b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:06:06.510530 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6455c255-d921-4528-9533-cfdb385a1a3b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:06:06.510974 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6455c255-d921-4528-9533-cfdb385a1a3b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:06:06.645427 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6455c255-d921-4528-9533-cfdb385a1a3b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:06:06.653258 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6455c255-d921-4528-9533-cfdb385a1a3b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0" status: 200 len: 1392 microversion: 2.1 time: 0.156847 Sep 10 13:06:06.653847 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3815/7622] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:06:06 2022] GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:06:07.676621 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1b8b3c0b-cbfe-4055-b137-2ce33c77038f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:06:07.677970 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1b8b3c0b-cbfe-4055-b137-2ce33c77038f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:06:07.684833 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b8b3c0b-cbfe-4055-b137-2ce33c77038f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:06:07.685333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b8b3c0b-cbfe-4055-b137-2ce33c77038f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:06:07.685778 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b8b3c0b-cbfe-4055-b137-2ce33c77038f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:06:07.686480 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b8b3c0b-cbfe-4055-b137-2ce33c77038f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:06:07.686940 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b8b3c0b-cbfe-4055-b137-2ce33c77038f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:06:07.687404 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b8b3c0b-cbfe-4055-b137-2ce33c77038f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:06:07.826596 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1b8b3c0b-cbfe-4055-b137-2ce33c77038f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:06:07.834710 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1b8b3c0b-cbfe-4055-b137-2ce33c77038f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0" status: 200 len: 1392 microversion: 2.1 time: 0.161981 Sep 10 13:06:07.835311 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3808/7623] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:06:07 2022] GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:06:08.077704 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-e768d631-2772-4df6-b469-9fc9f4dda33c req-89511e30-a1ca-4bf7-8511-7551a7526ad3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76180e91-c6a4-49dc-9d6c-79e5d42fd7a0", "name": "network-vif-plugged", "status": "completed", "tag": "6cda492a-9e13-4ab0-9034-19ab01336804"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:06:08.089056 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e768d631-2772-4df6-b469-9fc9f4dda33c req-89511e30-a1ca-4bf7-8511-7551a7526ad3 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:06:08.089447 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e768d631-2772-4df6-b469-9fc9f4dda33c req-89511e30-a1ca-4bf7-8511-7551a7526ad3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:06:08.089895 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e768d631-2772-4df6-b469-9fc9f4dda33c req-89511e30-a1ca-4bf7-8511-7551a7526ad3 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:06:08.102157 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-e768d631-2772-4df6-b469-9fc9f4dda33c req-89511e30-a1ca-4bf7-8511-7551a7526ad3 service nova] Creating event network-vif-plugged:6cda492a-9e13-4ab0-9034-19ab01336804 for instance 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 on n-h1-856895-1 Sep 10 13:06:08.107381 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-e768d631-2772-4df6-b469-9fc9f4dda33c req-89511e30-a1ca-4bf7-8511-7551a7526ad3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033365 Sep 10 13:06:08.107989 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3816/7624] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:06:08.858321 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e38fd033-3b77-4283-b9ae-b17f167cc4db tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:06:08.858938 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e38fd033-3b77-4283-b9ae-b17f167cc4db tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:06:08.860952 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:06:08.861679 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:06:08.863116 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:06:08.869650 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e38fd033-3b77-4283-b9ae-b17f167cc4db tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:06:08.870142 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e38fd033-3b77-4283-b9ae-b17f167cc4db tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:06:08.870602 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e38fd033-3b77-4283-b9ae-b17f167cc4db tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:06:08.871310 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e38fd033-3b77-4283-b9ae-b17f167cc4db tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:06:08.871767 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e38fd033-3b77-4283-b9ae-b17f167cc4db tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:06:08.872198 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e38fd033-3b77-4283-b9ae-b17f167cc4db tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:06:09.006729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e38fd033-3b77-4283-b9ae-b17f167cc4db tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:06:09.014744 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e38fd033-3b77-4283-b9ae-b17f167cc4db tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0" status: 200 len: 1392 microversion: 2.1 time: 0.160348 Sep 10 13:06:09.015345 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3809/7625] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:06:08 2022] GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:06:10.035379 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:06:10.041730 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-886eaf1d-adbb-4291-b5bb-f50bb7f6864a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:06:10.042469 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-886eaf1d-adbb-4291-b5bb-f50bb7f6864a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:06:10.049039 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-886eaf1d-adbb-4291-b5bb-f50bb7f6864a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:06:10.049547 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-886eaf1d-adbb-4291-b5bb-f50bb7f6864a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:06:10.050009 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-886eaf1d-adbb-4291-b5bb-f50bb7f6864a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:06:10.050706 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-886eaf1d-adbb-4291-b5bb-f50bb7f6864a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:06:10.051227 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-886eaf1d-adbb-4291-b5bb-f50bb7f6864a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:06:10.051682 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-886eaf1d-adbb-4291-b5bb-f50bb7f6864a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:06:10.195241 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-886eaf1d-adbb-4291-b5bb-f50bb7f6864a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:06:10.203008 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-886eaf1d-adbb-4291-b5bb-f50bb7f6864a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0" status: 200 len: 1563 microversion: 2.1 time: 0.168696 Sep 10 13:06:10.203631 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3817/7626] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:06:10 2022] GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 => generated 1563 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:06:10.227034 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7238231a-ad19-408c-b3c2-ded413d6e899 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:06:10.227696 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7238231a-ad19-408c-b3c2-ded413d6e899 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:06:10.234592 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7238231a-ad19-408c-b3c2-ded413d6e899 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:06:10.235075 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7238231a-ad19-408c-b3c2-ded413d6e899 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:06:10.235565 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7238231a-ad19-408c-b3c2-ded413d6e899 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:06:10.236244 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7238231a-ad19-408c-b3c2-ded413d6e899 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:06:10.236702 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7238231a-ad19-408c-b3c2-ded413d6e899 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:06:10.237135 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7238231a-ad19-408c-b3c2-ded413d6e899 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:06:10.369751 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7238231a-ad19-408c-b3c2-ded413d6e899 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:06:10.377442 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7238231a-ad19-408c-b3c2-ded413d6e899 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0" status: 200 len: 1563 microversion: 2.1 time: 0.155060 Sep 10 13:06:10.378024 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3810/7627] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:06:10 2022] GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:06:11.980781 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0fb5869c-e812-419c-9136-cb98330d13f0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:06:11.982074 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0fb5869c-e812-419c-9136-cb98330d13f0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:06:11.982464 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-9af03daa-ce88-4c72-91d3-27f7c465fb74 req-91df492c-7219-46c3-b677-22d4b2978bfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76180e91-c6a4-49dc-9d6c-79e5d42fd7a0", "tag": "6cda492a-9e13-4ab0-9034-19ab01336804"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:06:11.989463 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0fb5869c-e812-419c-9136-cb98330d13f0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:06:11.990873 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0fb5869c-e812-419c-9136-cb98330d13f0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:06:11.991437 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0fb5869c-e812-419c-9136-cb98330d13f0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:06:11.992242 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0fb5869c-e812-419c-9136-cb98330d13f0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:06:11.992926 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0fb5869c-e812-419c-9136-cb98330d13f0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:06:11.993376 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0fb5869c-e812-419c-9136-cb98330d13f0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:06:11.994082 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-9af03daa-ce88-4c72-91d3-27f7c465fb74 req-91df492c-7219-46c3-b677-22d4b2978bfa service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:06:11.994573 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-9af03daa-ce88-4c72-91d3-27f7c465fb74 req-91df492c-7219-46c3-b677-22d4b2978bfa service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:06:11.995009 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-9af03daa-ce88-4c72-91d3-27f7c465fb74 req-91df492c-7219-46c3-b677-22d4b2978bfa service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:06:12.007096 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-9af03daa-ce88-4c72-91d3-27f7c465fb74 req-91df492c-7219-46c3-b677-22d4b2978bfa service nova] Creating event network-changed:6cda492a-9e13-4ab0-9034-19ab01336804 for instance 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 on n-h1-856895-1 Sep 10 13:06:12.012754 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-9af03daa-ce88-4c72-91d3-27f7c465fb74 req-91df492c-7219-46c3-b677-22d4b2978bfa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034053 Sep 10 13:06:12.013709 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3811/7628] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 13:06:12.148750 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0fb5869c-e812-419c-9136-cb98330d13f0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:06:12.157224 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0fb5869c-e812-419c-9136-cb98330d13f0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0" status: 200 len: 1563 microversion: 2.1 time: 0.180722 Sep 10 13:06:12.157821 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3818/7629] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:06:11 2022] GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 => generated 1563 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:06:43.480447 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=5 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:06:43.481105 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=42 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:06:43.485269 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-52dcd273-9a58-4cf0-bec0-0fc20d050589 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:06:43.487534 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-52dcd273-9a58-4cf0-bec0-0fc20d050589 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:06:43.495248 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-52dcd273-9a58-4cf0-bec0-0fc20d050589 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:06:43.495733 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-52dcd273-9a58-4cf0-bec0-0fc20d050589 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:06:43.496166 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-52dcd273-9a58-4cf0-bec0-0fc20d050589 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:06:43.496854 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-52dcd273-9a58-4cf0-bec0-0fc20d050589 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:06:43.497303 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-52dcd273-9a58-4cf0-bec0-0fc20d050589 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:06:43.497727 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-52dcd273-9a58-4cf0-bec0-0fc20d050589 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:06:43.564755 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-52dcd273-9a58-4cf0-bec0-0fc20d050589 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "POST /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0/action" status: 200 len: 24572 microversion: 2.1 time: 0.086338 Sep 10 13:06:43.565411 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3812/7630] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 13:06:43 2022] POST /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0/action => generated 24572 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 13:07:13.993287 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:07:13.994115 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=38 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:07:13.994945 n-d-856895-1 devstack@n-api.service[128776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 13:07:13.995096 n-d-856895-1 devstack@n-api.service[128776]: Sat Sep 10 13:07:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0/action (ip 10.222.0.23) !!! Sep 10 13:07:14.000239 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-abc136c4-053d-4b3c-bc1d-3fcdfb1f8b69 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:07:14.010090 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-abc136c4-053d-4b3c-bc1d-3fcdfb1f8b69 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:07:14.010586 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-abc136c4-053d-4b3c-bc1d-3fcdfb1f8b69 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:07:14.011039 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-abc136c4-053d-4b3c-bc1d-3fcdfb1f8b69 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:07:14.034051 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-abc136c4-053d-4b3c-bc1d-3fcdfb1f8b69 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0] Going to try to stop instance {{(pid=128776) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 10 13:07:14.074877 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-abc136c4-053d-4b3c-bc1d-3fcdfb1f8b69 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "POST /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0/action" status: 202 len: 0 microversion: 2.1 time: 0.083395 Sep 10 13:07:14.075528 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3819/7631] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 13:07:13 2022] POST /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 13:07:14.085533 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d3396cf5-bc77-4769-8a33-e6408da058ec tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:07:14.086367 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d3396cf5-bc77-4769-8a33-e6408da058ec tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:07:14.089713 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:07:14.090362 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=4 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:07:14.101213 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3396cf5-bc77-4769-8a33-e6408da058ec tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:07:14.101703 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3396cf5-bc77-4769-8a33-e6408da058ec tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:07:14.102143 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3396cf5-bc77-4769-8a33-e6408da058ec tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:07:14.102844 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3396cf5-bc77-4769-8a33-e6408da058ec tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:07:14.103347 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3396cf5-bc77-4769-8a33-e6408da058ec tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:07:14.103758 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d3396cf5-bc77-4769-8a33-e6408da058ec tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:07:14.240995 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d3396cf5-bc77-4769-8a33-e6408da058ec tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:07:14.248881 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d3396cf5-bc77-4769-8a33-e6408da058ec tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0" status: 200 len: 1692 microversion: 2.1 time: 0.168546 Sep 10 13:07:14.249387 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3813/7632] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:07:14 2022] GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 13:07:15.276985 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f244049d-8ea9-42c7-a040-14634b00581b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:07:15.277695 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f244049d-8ea9-42c7-a040-14634b00581b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:07:15.283880 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f244049d-8ea9-42c7-a040-14634b00581b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:07:15.284382 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f244049d-8ea9-42c7-a040-14634b00581b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:07:15.284833 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f244049d-8ea9-42c7-a040-14634b00581b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:07:15.285537 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f244049d-8ea9-42c7-a040-14634b00581b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:07:15.286042 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f244049d-8ea9-42c7-a040-14634b00581b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:07:15.286476 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f244049d-8ea9-42c7-a040-14634b00581b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:07:15.431537 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f244049d-8ea9-42c7-a040-14634b00581b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:07:15.439363 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f244049d-8ea9-42c7-a040-14634b00581b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0" status: 200 len: 1692 microversion: 2.1 time: 0.168319 Sep 10 13:07:15.439957 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3820/7633] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:07:15 2022] GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:07:16.463540 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7032e912-4222-492c-9380-42b521ca1410 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:07:16.464182 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7032e912-4222-492c-9380-42b521ca1410 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:07:16.471043 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7032e912-4222-492c-9380-42b521ca1410 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:07:16.471553 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7032e912-4222-492c-9380-42b521ca1410 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:07:16.471989 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7032e912-4222-492c-9380-42b521ca1410 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:07:16.472677 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7032e912-4222-492c-9380-42b521ca1410 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:07:16.473128 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7032e912-4222-492c-9380-42b521ca1410 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:07:16.473555 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7032e912-4222-492c-9380-42b521ca1410 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:07:16.606100 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7032e912-4222-492c-9380-42b521ca1410 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:07:16.613822 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7032e912-4222-492c-9380-42b521ca1410 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0" status: 200 len: 1692 microversion: 2.1 time: 0.154238 Sep 10 13:07:16.614400 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3814/7634] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:07:16 2022] GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 13:07:17.637806 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fb2a52b6-f9e2-4983-a282-a0dd6e9bfbfc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:07:17.638442 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fb2a52b6-f9e2-4983-a282-a0dd6e9bfbfc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:07:17.645368 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fb2a52b6-f9e2-4983-a282-a0dd6e9bfbfc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:07:17.645891 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fb2a52b6-f9e2-4983-a282-a0dd6e9bfbfc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:07:17.646406 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fb2a52b6-f9e2-4983-a282-a0dd6e9bfbfc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:07:17.647140 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fb2a52b6-f9e2-4983-a282-a0dd6e9bfbfc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:07:17.647635 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fb2a52b6-f9e2-4983-a282-a0dd6e9bfbfc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:07:17.648078 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fb2a52b6-f9e2-4983-a282-a0dd6e9bfbfc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:07:17.783458 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fb2a52b6-f9e2-4983-a282-a0dd6e9bfbfc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:07:17.791811 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fb2a52b6-f9e2-4983-a282-a0dd6e9bfbfc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0" status: 200 len: 1692 microversion: 2.1 time: 0.158212 Sep 10 13:07:17.792398 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3821/7635] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:07:17 2022] GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:07:18.816425 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-827746d7-7605-44ac-b3fc-8fd3f31ca8fc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:07:18.817043 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-827746d7-7605-44ac-b3fc-8fd3f31ca8fc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:07:18.823914 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-827746d7-7605-44ac-b3fc-8fd3f31ca8fc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:07:18.824398 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-827746d7-7605-44ac-b3fc-8fd3f31ca8fc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:07:18.824838 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-827746d7-7605-44ac-b3fc-8fd3f31ca8fc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:07:18.825529 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-827746d7-7605-44ac-b3fc-8fd3f31ca8fc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:07:18.825989 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-827746d7-7605-44ac-b3fc-8fd3f31ca8fc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:07:18.826421 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-827746d7-7605-44ac-b3fc-8fd3f31ca8fc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:07:18.956310 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-827746d7-7605-44ac-b3fc-8fd3f31ca8fc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:07:18.964733 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-827746d7-7605-44ac-b3fc-8fd3f31ca8fc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0" status: 200 len: 1692 microversion: 2.1 time: 0.152389 Sep 10 13:07:18.965315 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3815/7636] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:07:18 2022] GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:07:19.988429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fe6b7dc3-7064-4143-a37b-b42ce147ca2b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:07:19.989059 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fe6b7dc3-7064-4143-a37b-b42ce147ca2b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:07:19.996051 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe6b7dc3-7064-4143-a37b-b42ce147ca2b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:07:19.996546 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe6b7dc3-7064-4143-a37b-b42ce147ca2b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:07:19.996998 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe6b7dc3-7064-4143-a37b-b42ce147ca2b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:07:19.997703 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe6b7dc3-7064-4143-a37b-b42ce147ca2b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:07:19.998180 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe6b7dc3-7064-4143-a37b-b42ce147ca2b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:07:19.998624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fe6b7dc3-7064-4143-a37b-b42ce147ca2b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:07:20.129009 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fe6b7dc3-7064-4143-a37b-b42ce147ca2b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:07:20.137745 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fe6b7dc3-7064-4143-a37b-b42ce147ca2b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0" status: 200 len: 1692 microversion: 2.1 time: 0.153006 Sep 10 13:07:20.138320 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3822/7637] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:07:19 2022] GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:07:21.162147 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4403d5d2-3370-4f8c-bbd3-7ec3cf4bfe97 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:07:21.162870 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4403d5d2-3370-4f8c-bbd3-7ec3cf4bfe97 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:07:21.169843 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4403d5d2-3370-4f8c-bbd3-7ec3cf4bfe97 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:07:21.170335 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4403d5d2-3370-4f8c-bbd3-7ec3cf4bfe97 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:07:21.170774 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4403d5d2-3370-4f8c-bbd3-7ec3cf4bfe97 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:07:21.171509 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4403d5d2-3370-4f8c-bbd3-7ec3cf4bfe97 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:07:21.171980 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4403d5d2-3370-4f8c-bbd3-7ec3cf4bfe97 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:07:21.172413 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4403d5d2-3370-4f8c-bbd3-7ec3cf4bfe97 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:07:21.313474 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4403d5d2-3370-4f8c-bbd3-7ec3cf4bfe97 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:07:21.322674 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4403d5d2-3370-4f8c-bbd3-7ec3cf4bfe97 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0" status: 200 len: 1692 microversion: 2.1 time: 0.164551 Sep 10 13:07:21.323516 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3816/7638] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:07:21 2022] GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:07:22.346469 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5effa7c0-d69f-4237-a11b-569ea875aece tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:07:22.346989 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5effa7c0-d69f-4237-a11b-569ea875aece tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:07:22.354448 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5effa7c0-d69f-4237-a11b-569ea875aece tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:07:22.354939 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5effa7c0-d69f-4237-a11b-569ea875aece tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:07:22.355412 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5effa7c0-d69f-4237-a11b-569ea875aece tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:07:22.356473 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5effa7c0-d69f-4237-a11b-569ea875aece tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:07:22.356941 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5effa7c0-d69f-4237-a11b-569ea875aece tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:07:22.357377 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5effa7c0-d69f-4237-a11b-569ea875aece tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:07:22.497567 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5effa7c0-d69f-4237-a11b-569ea875aece tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:07:22.505735 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5effa7c0-d69f-4237-a11b-569ea875aece tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0" status: 200 len: 1692 microversion: 2.1 time: 0.163392 Sep 10 13:07:22.506320 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3823/7639] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:07:22 2022] GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:07:23.530035 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f6390c5e-2bb3-42bc-b4ca-be10ab6da10d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:07:23.530580 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f6390c5e-2bb3-42bc-b4ca-be10ab6da10d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:07:23.538163 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f6390c5e-2bb3-42bc-b4ca-be10ab6da10d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:07:23.538640 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f6390c5e-2bb3-42bc-b4ca-be10ab6da10d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:07:23.539076 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f6390c5e-2bb3-42bc-b4ca-be10ab6da10d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:07:23.539793 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f6390c5e-2bb3-42bc-b4ca-be10ab6da10d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:07:23.540245 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f6390c5e-2bb3-42bc-b4ca-be10ab6da10d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:07:23.540670 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f6390c5e-2bb3-42bc-b4ca-be10ab6da10d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:07:23.677642 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f6390c5e-2bb3-42bc-b4ca-be10ab6da10d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:07:23.685426 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f6390c5e-2bb3-42bc-b4ca-be10ab6da10d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0" status: 200 len: 1692 microversion: 2.1 time: 0.159402 Sep 10 13:07:23.686008 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3817/7640] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:07:23 2022] GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:07:24.710914 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1a3f6e62-49ce-4aa1-a5c5-2144524d1ea0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:07:24.711694 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1a3f6e62-49ce-4aa1-a5c5-2144524d1ea0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:07:24.718761 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a3f6e62-49ce-4aa1-a5c5-2144524d1ea0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:07:24.719323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a3f6e62-49ce-4aa1-a5c5-2144524d1ea0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:07:24.719782 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a3f6e62-49ce-4aa1-a5c5-2144524d1ea0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:07:24.720496 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a3f6e62-49ce-4aa1-a5c5-2144524d1ea0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:07:24.720971 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a3f6e62-49ce-4aa1-a5c5-2144524d1ea0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:07:24.721413 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1a3f6e62-49ce-4aa1-a5c5-2144524d1ea0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:07:24.857295 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1a3f6e62-49ce-4aa1-a5c5-2144524d1ea0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:07:24.866226 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1a3f6e62-49ce-4aa1-a5c5-2144524d1ea0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0" status: 200 len: 1669 microversion: 2.1 time: 0.159924 Sep 10 13:07:24.866802 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3824/7641] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:07:24 2022] GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 => generated 1669 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:07:25.964051 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-eeddccb5-90ed-4361-996e-0df83d4a14b0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:07:25.966262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-eeddccb5-90ed-4361-996e-0df83d4a14b0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:07:25.973215 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eeddccb5-90ed-4361-996e-0df83d4a14b0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:07:25.974238 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eeddccb5-90ed-4361-996e-0df83d4a14b0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:07:25.974667 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eeddccb5-90ed-4361-996e-0df83d4a14b0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:07:25.975395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eeddccb5-90ed-4361-996e-0df83d4a14b0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:07:25.975852 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eeddccb5-90ed-4361-996e-0df83d4a14b0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:07:25.976281 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-eeddccb5-90ed-4361-996e-0df83d4a14b0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:07:26.037082 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-eeddccb5-90ed-4361-996e-0df83d4a14b0 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "POST /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0/action" status: 200 len: 38440 microversion: 2.1 time: 0.076257 Sep 10 13:07:26.037883 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3818/7642] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 13:07:25 2022] POST /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0/action => generated 38440 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 10 13:07:26.049848 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-617ad463-1142-4133-bb71-fc4288035f9f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:07:26.057517 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-617ad463-1142-4133-bb71-fc4288035f9f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:07:26.058024 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-617ad463-1142-4133-bb71-fc4288035f9f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:07:26.058486 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-617ad463-1142-4133-bb71-fc4288035f9f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:07:26.081142 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-617ad463-1142-4133-bb71-fc4288035f9f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0] Going to try to start instance {{(pid=128776) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 10 13:07:26.123336 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-617ad463-1142-4133-bb71-fc4288035f9f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "POST /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0/action" status: 202 len: 0 microversion: 2.1 time: 0.077135 Sep 10 13:07:26.123986 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3825/7643] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 13:07:26 2022] POST /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 13:07:26.133679 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b55680b6-2cec-4492-a4a3-94a9ff8581da tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:07:26.134368 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b55680b6-2cec-4492-a4a3-94a9ff8581da tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:07:26.142732 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b55680b6-2cec-4492-a4a3-94a9ff8581da tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:07:26.143249 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b55680b6-2cec-4492-a4a3-94a9ff8581da tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:07:26.143686 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b55680b6-2cec-4492-a4a3-94a9ff8581da tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:07:26.144386 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b55680b6-2cec-4492-a4a3-94a9ff8581da tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:07:26.145293 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b55680b6-2cec-4492-a4a3-94a9ff8581da tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:07:26.145751 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b55680b6-2cec-4492-a4a3-94a9ff8581da tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:07:26.293377 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b55680b6-2cec-4492-a4a3-94a9ff8581da tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:07:26.301448 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b55680b6-2cec-4492-a4a3-94a9ff8581da tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0" status: 200 len: 1678 microversion: 2.1 time: 0.172578 Sep 10 13:07:26.302752 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3819/7644] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:07:26 2022] GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:07:27.327376 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-965e4ee1-6144-41bb-a588-30b1c901d00b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:07:27.328018 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-965e4ee1-6144-41bb-a588-30b1c901d00b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:07:27.335019 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-965e4ee1-6144-41bb-a588-30b1c901d00b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:07:27.335545 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-965e4ee1-6144-41bb-a588-30b1c901d00b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:07:27.336001 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-965e4ee1-6144-41bb-a588-30b1c901d00b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:07:27.336710 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-965e4ee1-6144-41bb-a588-30b1c901d00b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:07:27.337181 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-965e4ee1-6144-41bb-a588-30b1c901d00b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:07:27.337626 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-965e4ee1-6144-41bb-a588-30b1c901d00b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:07:27.473284 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-965e4ee1-6144-41bb-a588-30b1c901d00b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:07:27.481837 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-965e4ee1-6144-41bb-a588-30b1c901d00b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0" status: 200 len: 1678 microversion: 2.1 time: 0.159675 Sep 10 13:07:27.482391 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3826/7645] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:07:27 2022] GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:07:28.505893 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6793c3b5-ac36-4c21-ae67-641096cdc3ea tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:07:28.506507 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6793c3b5-ac36-4c21-ae67-641096cdc3ea tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:07:28.513585 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6793c3b5-ac36-4c21-ae67-641096cdc3ea tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:07:28.514065 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6793c3b5-ac36-4c21-ae67-641096cdc3ea tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:07:28.514499 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6793c3b5-ac36-4c21-ae67-641096cdc3ea tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:07:28.515204 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6793c3b5-ac36-4c21-ae67-641096cdc3ea tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:07:28.515659 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6793c3b5-ac36-4c21-ae67-641096cdc3ea tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:07:28.516085 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6793c3b5-ac36-4c21-ae67-641096cdc3ea tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:07:28.650244 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6793c3b5-ac36-4c21-ae67-641096cdc3ea tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:07:28.657931 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6793c3b5-ac36-4c21-ae67-641096cdc3ea tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0" status: 200 len: 1682 microversion: 2.1 time: 0.156380 Sep 10 13:07:28.658504 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3820/7646] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:07:28 2022] GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:07:58.873560 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6cc021ad-495f-409e-baa8-49567d08a2af tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:07:58.875867 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6cc021ad-495f-409e-baa8-49567d08a2af tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:07:58.878238 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=16 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:07:58.878918 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:07:58.885269 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6cc021ad-495f-409e-baa8-49567d08a2af tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:07:58.885772 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6cc021ad-495f-409e-baa8-49567d08a2af tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:07:58.886228 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6cc021ad-495f-409e-baa8-49567d08a2af tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:07:58.886935 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6cc021ad-495f-409e-baa8-49567d08a2af tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:07:58.887442 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6cc021ad-495f-409e-baa8-49567d08a2af tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:07:58.888138 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6cc021ad-495f-409e-baa8-49567d08a2af tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:07:58.958147 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6cc021ad-495f-409e-baa8-49567d08a2af tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "POST /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0/action" status: 200 len: 63000 microversion: 2.1 time: 0.088560 Sep 10 13:07:58.959058 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3827/7647] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 13:07:58 2022] POST /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0/action => generated 63000 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 13:08:16.300371 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-467d895a-d907-4e6f-8649-250dfaca952b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:08:16.300968 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-467d895a-d907-4e6f-8649-250dfaca952b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:08:16.302593 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-935ad396-c403-45f1-9291-75ad85f2951f req-b480f13f-f890-4dd8-b2ce-36b1380c8b09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76180e91-c6a4-49dc-9d6c-79e5d42fd7a0", "tag": "6cda492a-9e13-4ab0-9034-19ab01336804"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:08:16.304019 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=16 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:08:16.304895 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=46 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:08:16.311639 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:08:16.311877 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-467d895a-d907-4e6f-8649-250dfaca952b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:08:16.312612 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-467d895a-d907-4e6f-8649-250dfaca952b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:08:16.313051 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=4 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:08:16.313191 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-467d895a-d907-4e6f-8649-250dfaca952b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:08:16.313873 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-467d895a-d907-4e6f-8649-250dfaca952b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:08:16.314458 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-467d895a-d907-4e6f-8649-250dfaca952b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:08:16.314964 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-467d895a-d907-4e6f-8649-250dfaca952b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:08:16.320027 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-935ad396-c403-45f1-9291-75ad85f2951f req-b480f13f-f890-4dd8-b2ce-36b1380c8b09 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:08:16.320522 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-935ad396-c403-45f1-9291-75ad85f2951f req-b480f13f-f890-4dd8-b2ce-36b1380c8b09 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:08:16.320966 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-935ad396-c403-45f1-9291-75ad85f2951f req-b480f13f-f890-4dd8-b2ce-36b1380c8b09 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:08:16.332417 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-935ad396-c403-45f1-9291-75ad85f2951f req-b480f13f-f890-4dd8-b2ce-36b1380c8b09 service nova] Creating event network-changed:6cda492a-9e13-4ab0-9034-19ab01336804 for instance 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 on n-h1-856895-1 Sep 10 13:08:16.339018 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-935ad396-c403-45f1-9291-75ad85f2951f req-b480f13f-f890-4dd8-b2ce-36b1380c8b09 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041225 Sep 10 13:08:16.339663 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3828/7648] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:08:16.343157 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-467d895a-d907-4e6f-8649-250dfaca952b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 13:08:16.436840 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-467d895a-d907-4e6f-8649-250dfaca952b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "DELETE /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0" status: 204 len: 0 microversion: 2.1 time: 0.141295 Sep 10 13:08:16.441248 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3821/7649] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 13:08:16 2022] DELETE /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 13:08:16.447298 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f4314169-e771-4dd4-8260-28af3c45bdb1 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:08:16.448020 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f4314169-e771-4dd4-8260-28af3c45bdb1 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:08:16.454589 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4314169-e771-4dd4-8260-28af3c45bdb1 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:08:16.455926 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4314169-e771-4dd4-8260-28af3c45bdb1 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:08:16.455926 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4314169-e771-4dd4-8260-28af3c45bdb1 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:08:16.456268 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4314169-e771-4dd4-8260-28af3c45bdb1 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:08:16.456736 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4314169-e771-4dd4-8260-28af3c45bdb1 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:08:16.457178 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f4314169-e771-4dd4-8260-28af3c45bdb1 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:08:16.675005 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f4314169-e771-4dd4-8260-28af3c45bdb1 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:08:16.683425 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f4314169-e771-4dd4-8260-28af3c45bdb1 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0" status: 200 len: 1688 microversion: 2.1 time: 0.240887 Sep 10 13:08:16.684092 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3829/7650] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:08:16 2022] GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 => generated 1688 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 13:08:17.710733 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a70a2354-9f58-4912-af41-3cc556904f38 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:08:17.711491 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a70a2354-9f58-4912-af41-3cc556904f38 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:08:17.718265 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a70a2354-9f58-4912-af41-3cc556904f38 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:08:17.718757 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a70a2354-9f58-4912-af41-3cc556904f38 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:08:17.719228 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a70a2354-9f58-4912-af41-3cc556904f38 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:08:17.719937 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a70a2354-9f58-4912-af41-3cc556904f38 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:08:17.720401 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a70a2354-9f58-4912-af41-3cc556904f38 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:08:17.720836 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a70a2354-9f58-4912-af41-3cc556904f38 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:08:17.855112 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a70a2354-9f58-4912-af41-3cc556904f38 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:08:17.862911 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a70a2354-9f58-4912-af41-3cc556904f38 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0" status: 200 len: 1688 microversion: 2.1 time: 0.156984 Sep 10 13:08:17.863542 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3822/7651] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:08:17 2022] GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:08:18.640622 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-840c26ad-724b-4ad2-878f-2968b47a6363 req-e529c95f-761b-4ee8-9989-919e5a480651 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76180e91-c6a4-49dc-9d6c-79e5d42fd7a0", "name": "network-vif-deleted", "tag": "6cda492a-9e13-4ab0-9034-19ab01336804"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:08:18.655771 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-840c26ad-724b-4ad2-878f-2968b47a6363 req-e529c95f-761b-4ee8-9989-919e5a480651 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:08:18.656293 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-840c26ad-724b-4ad2-878f-2968b47a6363 req-e529c95f-761b-4ee8-9989-919e5a480651 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:08:18.656742 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-840c26ad-724b-4ad2-878f-2968b47a6363 req-e529c95f-761b-4ee8-9989-919e5a480651 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:08:18.668869 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-840c26ad-724b-4ad2-878f-2968b47a6363 req-e529c95f-761b-4ee8-9989-919e5a480651 service nova] Creating event network-vif-deleted:6cda492a-9e13-4ab0-9034-19ab01336804 for instance 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 on n-h1-856895-1 Sep 10 13:08:18.674211 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-840c26ad-724b-4ad2-878f-2968b47a6363 req-e529c95f-761b-4ee8-9989-919e5a480651 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037734 Sep 10 13:08:18.675047 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3830/7652] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:08:18.887240 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-357c9072-fb87-4a1c-a454-24c808563512 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:08:18.888130 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-357c9072-fb87-4a1c-a454-24c808563512 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:08:18.894504 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-357c9072-fb87-4a1c-a454-24c808563512 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:08:18.894992 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-357c9072-fb87-4a1c-a454-24c808563512 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:08:18.896088 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-357c9072-fb87-4a1c-a454-24c808563512 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:08:18.896789 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-357c9072-fb87-4a1c-a454-24c808563512 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:08:18.897254 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-357c9072-fb87-4a1c-a454-24c808563512 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:08:18.897687 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-357c9072-fb87-4a1c-a454-24c808563512 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:08:18.930853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-357c9072-fb87-4a1c-a454-24c808563512 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:08:18.931391 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-357c9072-fb87-4a1c-a454-24c808563512 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:08:18.931905 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-357c9072-fb87-4a1c-a454-24c808563512 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:08:18.932381 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-357c9072-fb87-4a1c-a454-24c808563512 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lazy-loading 'fault' on Instance uuid 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 13:08:18.976592 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-357c9072-fb87-4a1c-a454-24c808563512 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:08:18.986588 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-357c9072-fb87-4a1c-a454-24c808563512 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0" status: 200 len: 1356 microversion: 2.1 time: 0.102881 Sep 10 13:08:18.987146 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3823/7653] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:08:18 2022] GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 => generated 1356 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:08:20.011710 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f66ebf4d-8db3-4585-abc5-59e40aac14b9 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:08:20.012440 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f66ebf4d-8db3-4585-abc5-59e40aac14b9 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:08:20.018919 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f66ebf4d-8db3-4585-abc5-59e40aac14b9 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:08:20.019429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f66ebf4d-8db3-4585-abc5-59e40aac14b9 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:08:20.019893 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f66ebf4d-8db3-4585-abc5-59e40aac14b9 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:08:20.021089 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f66ebf4d-8db3-4585-abc5-59e40aac14b9 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:08:20.021560 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f66ebf4d-8db3-4585-abc5-59e40aac14b9 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:08:20.022011 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f66ebf4d-8db3-4585-abc5-59e40aac14b9 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:08:20.038378 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-f66ebf4d-8db3-4585-abc5-59e40aac14b9 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] HTTP exception thrown: Instance 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 could not be found. Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f66ebf4d-8db3-4585-abc5-59e40aac14b9 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Request method failure captured: Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 HTTP/1.1 Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHIpdJSi4DFbBHL8V-ThkqWs5qsENn9f44fAjCGfIVt2JLbU_2M84czNkA_1xJt3KrfjUCCFS4TMpry236FRO_1OwbSaFPzXSs5yvfKc4BHVhFUvMQ81nyQLxn8rwKBj8fhkryGWzH2_U6bC_TMfY-qfd78V0LzaRSLPr8smJqhI8tXU Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: b0e733e9474c4814b77eddbf547e3a54 Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1010290636 Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b0e733e9474c4814b77eddbf547e3a54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b0e733e9474c4814b77eddbf547e3a54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b0e733e9474c4814b77eddbf547e3a54", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b0e733e9474c4814b77eddbf547e3a54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1010290636 Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: b0e733e9474c4814b77eddbf547e3a54 Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1010290636 Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-TestNetworkAdvancedServerOps-1010290636-project Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: f75e338a6cb34d11a42b65da1eca4f83 Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1010290636-project Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 could not be found. Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '76180e91-c6a4-49dc-9d6c-79e5d42fd7a0'} Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 could not be found. Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 could not be found. Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 13:08:20.040062 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 13:08:20.045189 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 13:08:20.045189 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 13:08:20.045189 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 13:08:20.045189 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 13:08:20.045189 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 13:08:20.045189 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 13:08:20.045189 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 could not be found. Sep 10 13:08:20.045189 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 13:08:20.045189 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f66ebf4d-8db3-4585-abc5-59e40aac14b9 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Returning 404 to user: Instance 76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 13:08:20.045189 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f66ebf4d-8db3-4585-abc5-59e40aac14b9 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0" status: 404 len: 111 microversion: 2.1 time: 0.034992 Sep 10 13:08:20.045189 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3831/7654] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:08:20 2022] GET /compute/v2.1/servers/76180e91-c6a4-49dc-9d6c-79e5d42fd7a0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 10 13:08:23.488286 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-314d67be-b2f1-4ee1-953d-d8756fa8059f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '.version_select at 0x7f4071b32f70>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:08:23.493832 n-d-856895-1 devstack@n-api.service[128777]: ERROR oslo.messaging._drivers.impl_rabbit [None req-314d67be-b2f1-4ee1-953d-d8756fa8059f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [d8176aba-d45a-4571-89f5-c08f8cc142e0] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 10 13:08:24.500827 n-d-856895-1 devstack@n-api.service[128777]: INFO oslo.messaging._drivers.impl_rabbit [None req-314d67be-b2f1-4ee1-953d-d8756fa8059f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [d8176aba-d45a-4571-89f5-c08f8cc142e0] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 38106. Sep 10 13:08:24.521714 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-314d67be-b2f1-4ee1-953d-d8756fa8059f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-911566074" status: 202 len: 0 microversion: 2.1 time: 1.037343 Sep 10 13:08:24.522310 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3824/7655] 10.222.0.23 () {58 vars in 1281 bytes} [Sat Sep 10 13:08:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-911566074 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 13:08:24.554858 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a1e57283-f5ac-49db-9034-58d0ff894dc4 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Action: 'create', calling method: .version_select at 0x7f4072c78430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-57715380", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOimhZEJJO3JSWm4OAZCiCsLmEa1Yfdh56t9A3Epm+X/mu/62y2ZvYCdceemPaVzFq6Gj2Zyh05uAPpY19W8tcaA2964a5AjL3TWiUetsoySk2YUHmjqPSoV3gzlK9DjQ=="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:08:24.572219 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-a1e57283-f5ac-49db-9034-58d0ff894dc4 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Getting quotas for project b0e733e9474c4814b77eddbf547e3a54. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 13:08:24.578176 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-a1e57283-f5ac-49db-9034-58d0ff894dc4 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Getting quotas for user f75e338a6cb34d11a42b65da1eca4f83 and project b0e733e9474c4814b77eddbf547e3a54. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 13:08:24.592086 n-d-856895-1 devstack@n-api.service[128776]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a1e57283-f5ac-49db-9034-58d0ff894dc4 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [191798a7-2c5e-4d74-b865-4708090abecb] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 10 13:08:25.599434 n-d-856895-1 devstack@n-api.service[128776]: INFO oslo.messaging._drivers.impl_rabbit [None req-a1e57283-f5ac-49db-9034-58d0ff894dc4 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [191798a7-2c5e-4d74-b865-4708090abecb] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 38110. Sep 10 13:08:25.619425 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a1e57283-f5ac-49db-9034-58d0ff894dc4 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 1.068998 Sep 10 13:08:25.620033 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3832/7656] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 13:08:24 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:08:31.045866 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:08:31.050327 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-aed92310-3ce2-41f6-8f1f-b41194792d2e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-300600171", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "networks": [{"uuid": "8e136cbb-0f1a-40a0-89e7-551a727024f3"}], "key_name": "tempest-TestNetworkAdvancedServerOps-57715380", "security_groups": [{"name": "tempest-secgroup-smoke-2117390000"}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:08:31.309787 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-aed92310-3ce2-41f6-8f1f-b41194792d2e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] validate_networks() for [('8e136cbb-0f1a-40a0-89e7-551a727024f3', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 13:08:31.742578 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-aed92310-3ce2-41f6-8f1f-b41194792d2e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 13:08:31.743003 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-aed92310-3ce2-41f6-8f1f-b41194792d2e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 13:08:31.743512 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-aed92310-3ce2-41f6-8f1f-b41194792d2e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 13:08:31.743926 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-aed92310-3ce2-41f6-8f1f-b41194792d2e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 13:08:31.744351 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-aed92310-3ce2-41f6-8f1f-b41194792d2e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 13:08:31.754337 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aed92310-3ce2-41f6-8f1f-b41194792d2e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:08:31.755427 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aed92310-3ce2-41f6-8f1f-b41194792d2e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:08:31.755873 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aed92310-3ce2-41f6-8f1f-b41194792d2e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:08:31.756611 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aed92310-3ce2-41f6-8f1f-b41194792d2e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:08:31.757071 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aed92310-3ce2-41f6-8f1f-b41194792d2e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:08:31.757536 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aed92310-3ce2-41f6-8f1f-b41194792d2e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:08:31.778375 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-aed92310-3ce2-41f6-8f1f-b41194792d2e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Getting quotas for project b0e733e9474c4814b77eddbf547e3a54. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 13:08:31.783975 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-aed92310-3ce2-41f6-8f1f-b41194792d2e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Getting quotas for user f75e338a6cb34d11a42b65da1eca4f83 and project b0e733e9474c4814b77eddbf547e3a54. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 13:08:31.797368 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-aed92310-3ce2-41f6-8f1f-b41194792d2e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 13:08:31.799723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-aed92310-3ce2-41f6-8f1f-b41194792d2e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: f1cdd411-b927-4057-a0ec-d5f16869561e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 13:08:31.849541 n-d-856895-1 devstack@n-api.service[128777]: ERROR oslo.messaging._drivers.impl_rabbit [None req-aed92310-3ce2-41f6-8f1f-b41194792d2e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [0d5c13ae-d458-4ac4-b347-adfca3c710c8] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 10 13:08:32.858429 n-d-856895-1 devstack@n-api.service[128777]: INFO oslo.messaging._drivers.impl_rabbit [None req-aed92310-3ce2-41f6-8f1f-b41194792d2e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [0d5c13ae-d458-4ac4-b347-adfca3c710c8] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 38158. Sep 10 13:08:32.864860 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-aed92310-3ce2-41f6-8f1f-b41194792d2e tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.820205 Sep 10 13:08:32.865735 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3825/7657] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 13:08:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 1822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 13:08:32.877693 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3c619744-4629-48ad-b8da-a9e004edfcdd tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:08:32.878474 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3c619744-4629-48ad-b8da-a9e004edfcdd tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: f1cdd411-b927-4057-a0ec-d5f16869561e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:08:32.882448 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=12 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:08:32.945756 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3c619744-4629-48ad-b8da-a9e004edfcdd tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:08:32.953901 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3c619744-4629-48ad-b8da-a9e004edfcdd tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e" status: 200 len: 1264 microversion: 2.1 time: 0.080411 Sep 10 13:08:32.954829 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3833/7658] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:08:32 2022] GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e => generated 1264 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:08:33.979448 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-17ba92ca-89db-4304-af96-490141a2553d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:08:33.980242 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-17ba92ca-89db-4304-af96-490141a2553d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: f1cdd411-b927-4057-a0ec-d5f16869561e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:08:33.986469 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17ba92ca-89db-4304-af96-490141a2553d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:08:33.986964 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17ba92ca-89db-4304-af96-490141a2553d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:08:33.987446 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17ba92ca-89db-4304-af96-490141a2553d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:08:33.988242 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17ba92ca-89db-4304-af96-490141a2553d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:08:33.988738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17ba92ca-89db-4304-af96-490141a2553d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:08:33.990132 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-17ba92ca-89db-4304-af96-490141a2553d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:08:34.091031 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-17ba92ca-89db-4304-af96-490141a2553d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:08:34.103934 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-17ba92ca-89db-4304-af96-490141a2553d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e" status: 200 len: 1324 microversion: 2.1 time: 0.129226 Sep 10 13:08:34.105237 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3826/7659] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:08:33 2022] GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e => generated 1324 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:08:35.128277 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2563e759-d838-4ebc-ba3c-16918a25b713 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:08:35.128976 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2563e759-d838-4ebc-ba3c-16918a25b713 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: f1cdd411-b927-4057-a0ec-d5f16869561e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:08:35.137778 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2563e759-d838-4ebc-ba3c-16918a25b713 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:08:35.138558 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2563e759-d838-4ebc-ba3c-16918a25b713 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:08:35.139261 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2563e759-d838-4ebc-ba3c-16918a25b713 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:08:35.139997 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2563e759-d838-4ebc-ba3c-16918a25b713 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:08:35.140783 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2563e759-d838-4ebc-ba3c-16918a25b713 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:08:35.141397 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2563e759-d838-4ebc-ba3c-16918a25b713 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:08:35.396941 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2563e759-d838-4ebc-ba3c-16918a25b713 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:08:35.405393 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2563e759-d838-4ebc-ba3c-16918a25b713 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e" status: 200 len: 1390 microversion: 2.1 time: 0.281178 Sep 10 13:08:35.406036 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3834/7660] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:08:35 2022] GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e => generated 1390 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:08:35.940189 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-30c58a6c-82a0-4265-8616-8ee0a0377740 req-98f5cf0b-dfd9-4d38-bf9f-d0567cd4d0a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1cdd411-b927-4057-a0ec-d5f16869561e", "tag": "95fe7fe1-41e0-4879-b187-3af35553cdf6"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:08:35.950550 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-30c58a6c-82a0-4265-8616-8ee0a0377740 req-98f5cf0b-dfd9-4d38-bf9f-d0567cd4d0a4 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:08:35.951024 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-30c58a6c-82a0-4265-8616-8ee0a0377740 req-98f5cf0b-dfd9-4d38-bf9f-d0567cd4d0a4 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:08:35.952250 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-30c58a6c-82a0-4265-8616-8ee0a0377740 req-98f5cf0b-dfd9-4d38-bf9f-d0567cd4d0a4 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:08:35.964432 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-30c58a6c-82a0-4265-8616-8ee0a0377740 req-98f5cf0b-dfd9-4d38-bf9f-d0567cd4d0a4 service nova] Creating event network-changed:95fe7fe1-41e0-4879-b187-3af35553cdf6 for instance f1cdd411-b927-4057-a0ec-d5f16869561e on n-h1-856895-1 Sep 10 13:08:35.969709 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-30c58a6c-82a0-4265-8616-8ee0a0377740 req-98f5cf0b-dfd9-4d38-bf9f-d0567cd4d0a4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100979 Sep 10 13:08:35.970314 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3827/7661] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:08:36.429916 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-44b6e916-996c-404f-b877-8001079435dc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:08:36.430545 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-44b6e916-996c-404f-b877-8001079435dc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: f1cdd411-b927-4057-a0ec-d5f16869561e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:08:36.437458 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-44b6e916-996c-404f-b877-8001079435dc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:08:36.437955 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-44b6e916-996c-404f-b877-8001079435dc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:08:36.438405 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-44b6e916-996c-404f-b877-8001079435dc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:08:36.439107 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-44b6e916-996c-404f-b877-8001079435dc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:08:36.439600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-44b6e916-996c-404f-b877-8001079435dc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:08:36.440044 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-44b6e916-996c-404f-b877-8001079435dc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:08:36.578442 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-44b6e916-996c-404f-b877-8001079435dc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:08:36.586753 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-44b6e916-996c-404f-b877-8001079435dc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e" status: 200 len: 1390 microversion: 2.1 time: 0.161411 Sep 10 13:08:36.587388 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3835/7662] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:08:36 2022] GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:08:37.611415 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e608b2a1-d5f3-4980-9423-723788b60e2c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:08:37.612129 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e608b2a1-d5f3-4980-9423-723788b60e2c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: f1cdd411-b927-4057-a0ec-d5f16869561e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:08:37.618973 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e608b2a1-d5f3-4980-9423-723788b60e2c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:08:37.619484 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e608b2a1-d5f3-4980-9423-723788b60e2c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:08:37.619925 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e608b2a1-d5f3-4980-9423-723788b60e2c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:08:37.620617 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e608b2a1-d5f3-4980-9423-723788b60e2c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:08:37.621074 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e608b2a1-d5f3-4980-9423-723788b60e2c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:08:37.621502 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e608b2a1-d5f3-4980-9423-723788b60e2c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:08:37.757200 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e608b2a1-d5f3-4980-9423-723788b60e2c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:08:37.765182 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e608b2a1-d5f3-4980-9423-723788b60e2c tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e" status: 200 len: 1390 microversion: 2.1 time: 0.159032 Sep 10 13:08:37.765761 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3828/7663] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:08:37 2022] GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:08:38.788523 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9d4b6ce3-0238-49c0-a1ca-9a1848aca566 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:08:38.789271 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9d4b6ce3-0238-49c0-a1ca-9a1848aca566 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: f1cdd411-b927-4057-a0ec-d5f16869561e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:08:38.796256 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d4b6ce3-0238-49c0-a1ca-9a1848aca566 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:08:38.796759 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d4b6ce3-0238-49c0-a1ca-9a1848aca566 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:08:38.797216 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d4b6ce3-0238-49c0-a1ca-9a1848aca566 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:08:38.797928 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d4b6ce3-0238-49c0-a1ca-9a1848aca566 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:08:38.798402 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d4b6ce3-0238-49c0-a1ca-9a1848aca566 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:08:38.798880 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9d4b6ce3-0238-49c0-a1ca-9a1848aca566 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:08:38.946091 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9d4b6ce3-0238-49c0-a1ca-9a1848aca566 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:08:38.953852 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9d4b6ce3-0238-49c0-a1ca-9a1848aca566 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e" status: 200 len: 1390 microversion: 2.1 time: 0.169403 Sep 10 13:08:38.954427 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3836/7664] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:08:38 2022] GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e => generated 1390 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:08:39.977846 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f2ecf623-f45a-4ac4-b1a4-0313216334fa tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:08:39.978401 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f2ecf623-f45a-4ac4-b1a4-0313216334fa tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: f1cdd411-b927-4057-a0ec-d5f16869561e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:08:39.985362 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f2ecf623-f45a-4ac4-b1a4-0313216334fa tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:08:39.985845 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f2ecf623-f45a-4ac4-b1a4-0313216334fa tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:08:39.986281 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f2ecf623-f45a-4ac4-b1a4-0313216334fa tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:08:39.986973 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f2ecf623-f45a-4ac4-b1a4-0313216334fa tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:08:39.987461 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f2ecf623-f45a-4ac4-b1a4-0313216334fa tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:08:39.987894 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f2ecf623-f45a-4ac4-b1a4-0313216334fa tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:08:40.120214 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f2ecf623-f45a-4ac4-b1a4-0313216334fa tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:08:40.127943 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f2ecf623-f45a-4ac4-b1a4-0313216334fa tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e" status: 200 len: 1390 microversion: 2.1 time: 0.154776 Sep 10 13:08:40.128523 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3829/7665] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:08:39 2022] GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:08:41.153330 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3a04c86d-2bda-4701-9e1f-0cc3596b1260 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:08:41.153992 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3a04c86d-2bda-4701-9e1f-0cc3596b1260 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: f1cdd411-b927-4057-a0ec-d5f16869561e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:08:41.162058 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3a04c86d-2bda-4701-9e1f-0cc3596b1260 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:08:41.162556 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3a04c86d-2bda-4701-9e1f-0cc3596b1260 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:08:41.163010 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3a04c86d-2bda-4701-9e1f-0cc3596b1260 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:08:41.163751 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3a04c86d-2bda-4701-9e1f-0cc3596b1260 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:08:41.164224 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3a04c86d-2bda-4701-9e1f-0cc3596b1260 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:08:41.164667 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3a04c86d-2bda-4701-9e1f-0cc3596b1260 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:08:41.303274 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3a04c86d-2bda-4701-9e1f-0cc3596b1260 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:08:41.311371 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3a04c86d-2bda-4701-9e1f-0cc3596b1260 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e" status: 200 len: 1390 microversion: 2.1 time: 0.162998 Sep 10 13:08:41.311960 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3837/7666] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:08:41 2022] GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e => generated 1390 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:08:42.335457 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-461f8127-69d4-4faf-8195-2e9aca26176d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:08:42.336215 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-461f8127-69d4-4faf-8195-2e9aca26176d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: f1cdd411-b927-4057-a0ec-d5f16869561e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:08:42.338883 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:08:42.339738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:08:42.345904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-461f8127-69d4-4faf-8195-2e9aca26176d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:08:42.346399 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-461f8127-69d4-4faf-8195-2e9aca26176d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:08:42.346843 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-461f8127-69d4-4faf-8195-2e9aca26176d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:08:42.347651 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-461f8127-69d4-4faf-8195-2e9aca26176d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:08:42.348644 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-461f8127-69d4-4faf-8195-2e9aca26176d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:08:42.349079 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-461f8127-69d4-4faf-8195-2e9aca26176d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:08:42.488317 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-461f8127-69d4-4faf-8195-2e9aca26176d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:08:42.500618 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-461f8127-69d4-4faf-8195-2e9aca26176d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e" status: 200 len: 1390 microversion: 2.1 time: 0.168830 Sep 10 13:08:42.501377 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3830/7667] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:08:42 2022] GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e => generated 1390 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:08:42.880428 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-4baf9a64-eeb2-4385-8204-bf1e02cb25b7 req-3960dd0b-b0f3-4920-a554-82ed6aebc6be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1cdd411-b927-4057-a0ec-d5f16869561e", "name": "network-vif-plugged", "status": "completed", "tag": "95fe7fe1-41e0-4879-b187-3af35553cdf6"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:08:42.891345 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-4baf9a64-eeb2-4385-8204-bf1e02cb25b7 req-3960dd0b-b0f3-4920-a554-82ed6aebc6be service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:08:42.891850 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-4baf9a64-eeb2-4385-8204-bf1e02cb25b7 req-3960dd0b-b0f3-4920-a554-82ed6aebc6be service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:08:42.892500 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-4baf9a64-eeb2-4385-8204-bf1e02cb25b7 req-3960dd0b-b0f3-4920-a554-82ed6aebc6be service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:08:42.904451 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-4baf9a64-eeb2-4385-8204-bf1e02cb25b7 req-3960dd0b-b0f3-4920-a554-82ed6aebc6be service nova] Creating event network-vif-plugged:95fe7fe1-41e0-4879-b187-3af35553cdf6 for instance f1cdd411-b927-4057-a0ec-d5f16869561e on n-h1-856895-1 Sep 10 13:08:42.909536 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-4baf9a64-eeb2-4385-8204-bf1e02cb25b7 req-3960dd0b-b0f3-4920-a554-82ed6aebc6be service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033640 Sep 10 13:08:42.910335 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3838/7668] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:08:43.533145 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c44eb5b1-a678-444a-9e7b-0b7e16659a41 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:08:43.533714 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c44eb5b1-a678-444a-9e7b-0b7e16659a41 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: f1cdd411-b927-4057-a0ec-d5f16869561e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:08:43.541063 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c44eb5b1-a678-444a-9e7b-0b7e16659a41 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:08:43.541546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c44eb5b1-a678-444a-9e7b-0b7e16659a41 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:08:43.541980 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c44eb5b1-a678-444a-9e7b-0b7e16659a41 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:08:43.542670 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c44eb5b1-a678-444a-9e7b-0b7e16659a41 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:08:43.543122 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c44eb5b1-a678-444a-9e7b-0b7e16659a41 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:08:43.543575 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c44eb5b1-a678-444a-9e7b-0b7e16659a41 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:08:43.678708 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c44eb5b1-a678-444a-9e7b-0b7e16659a41 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:08:43.686725 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c44eb5b1-a678-444a-9e7b-0b7e16659a41 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e" status: 200 len: 1390 microversion: 2.1 time: 0.157690 Sep 10 13:08:43.687350 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3831/7669] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:08:43 2022] GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:08:44.706849 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:08:44.712996 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e55a27e8-bf92-4fb2-b1e1-7417f0597e0b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:08:44.713723 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e55a27e8-bf92-4fb2-b1e1-7417f0597e0b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: f1cdd411-b927-4057-a0ec-d5f16869561e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:08:44.720237 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e55a27e8-bf92-4fb2-b1e1-7417f0597e0b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:08:44.720737 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e55a27e8-bf92-4fb2-b1e1-7417f0597e0b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:08:44.721195 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e55a27e8-bf92-4fb2-b1e1-7417f0597e0b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:08:44.721899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e55a27e8-bf92-4fb2-b1e1-7417f0597e0b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:08:44.722378 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e55a27e8-bf92-4fb2-b1e1-7417f0597e0b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:08:44.723614 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e55a27e8-bf92-4fb2-b1e1-7417f0597e0b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:08:44.858488 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e55a27e8-bf92-4fb2-b1e1-7417f0597e0b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:08:44.866838 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e55a27e8-bf92-4fb2-b1e1-7417f0597e0b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e" status: 200 len: 1562 microversion: 2.1 time: 0.160961 Sep 10 13:08:44.867467 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3839/7670] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:08:44 2022] GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e => generated 1562 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:08:44.890280 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9400974d-8177-4261-89af-fda430c7b041 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:08:44.890895 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9400974d-8177-4261-89af-fda430c7b041 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: f1cdd411-b927-4057-a0ec-d5f16869561e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:08:44.897908 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9400974d-8177-4261-89af-fda430c7b041 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:08:44.898410 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9400974d-8177-4261-89af-fda430c7b041 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:08:44.898829 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9400974d-8177-4261-89af-fda430c7b041 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:08:44.899554 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9400974d-8177-4261-89af-fda430c7b041 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:08:44.900035 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9400974d-8177-4261-89af-fda430c7b041 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:08:44.900463 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9400974d-8177-4261-89af-fda430c7b041 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:08:45.035860 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9400974d-8177-4261-89af-fda430c7b041 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:08:45.043599 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9400974d-8177-4261-89af-fda430c7b041 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e" status: 200 len: 1562 microversion: 2.1 time: 0.157546 Sep 10 13:08:45.044173 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3832/7671] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:08:44 2022] GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:08:46.626555 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-10fd795d-029b-4e82-a909-ee575e694bbc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:08:46.627212 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-10fd795d-029b-4e82-a909-ee575e694bbc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: f1cdd411-b927-4057-a0ec-d5f16869561e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:08:46.630165 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:08:46.636238 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-487b80b9-b8d5-4d20-89ea-87a11af1dbed req-d9fe4617-9e0c-400e-80d9-acd73fe94fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1cdd411-b927-4057-a0ec-d5f16869561e", "tag": "95fe7fe1-41e0-4879-b187-3af35553cdf6"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:08:46.642063 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:08:46.653510 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-487b80b9-b8d5-4d20-89ea-87a11af1dbed req-d9fe4617-9e0c-400e-80d9-acd73fe94fb5 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:08:46.653997 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-487b80b9-b8d5-4d20-89ea-87a11af1dbed req-d9fe4617-9e0c-400e-80d9-acd73fe94fb5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:08:46.654429 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-487b80b9-b8d5-4d20-89ea-87a11af1dbed req-d9fe4617-9e0c-400e-80d9-acd73fe94fb5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:08:46.663927 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10fd795d-029b-4e82-a909-ee575e694bbc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:08:46.664534 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10fd795d-029b-4e82-a909-ee575e694bbc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:08:46.665029 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10fd795d-029b-4e82-a909-ee575e694bbc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:08:46.665758 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10fd795d-029b-4e82-a909-ee575e694bbc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:08:46.666235 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10fd795d-029b-4e82-a909-ee575e694bbc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:08:46.666681 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-10fd795d-029b-4e82-a909-ee575e694bbc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:08:46.670524 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-487b80b9-b8d5-4d20-89ea-87a11af1dbed req-d9fe4617-9e0c-400e-80d9-acd73fe94fb5 service nova] Creating event network-changed:95fe7fe1-41e0-4879-b187-3af35553cdf6 for instance f1cdd411-b927-4057-a0ec-d5f16869561e on n-h1-856895-1 Sep 10 13:08:46.676652 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-487b80b9-b8d5-4d20-89ea-87a11af1dbed req-d9fe4617-9e0c-400e-80d9-acd73fe94fb5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043281 Sep 10 13:08:46.677615 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3833/7672] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:08:46.886551 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-10fd795d-029b-4e82-a909-ee575e694bbc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:08:46.896066 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-10fd795d-029b-4e82-a909-ee575e694bbc tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e" status: 200 len: 1562 microversion: 2.1 time: 0.273368 Sep 10 13:08:46.896790 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3840/7673] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:08:46 2022] GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e => generated 1562 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:09:18.174617 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=42 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:09:18.179992 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ea48e949-9107-432e-a466-86b1c2d1e9a7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:09:18.182196 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ea48e949-9107-432e-a466-86b1c2d1e9a7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: f1cdd411-b927-4057-a0ec-d5f16869561e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:09:18.189515 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea48e949-9107-432e-a466-86b1c2d1e9a7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:09:18.190007 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea48e949-9107-432e-a466-86b1c2d1e9a7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:09:18.190455 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea48e949-9107-432e-a466-86b1c2d1e9a7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:09:18.191151 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea48e949-9107-432e-a466-86b1c2d1e9a7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:09:18.191757 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea48e949-9107-432e-a466-86b1c2d1e9a7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:09:18.192199 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ea48e949-9107-432e-a466-86b1c2d1e9a7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:09:18.258755 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ea48e949-9107-432e-a466-86b1c2d1e9a7 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "POST /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e/action" status: 200 len: 24575 microversion: 2.1 time: 0.086471 Sep 10 13:09:18.259448 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3834/7674] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 13:09:18 2022] POST /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e/action => generated 24575 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 13:09:48.484400 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:09:48.485090 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=38 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:09:48.489304 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-41153b17-8b3c-4d57-a8fb-d855f5e44f5a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:09:48.489779 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-41153b17-8b3c-4d57-a8fb-d855f5e44f5a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: f1cdd411-b927-4057-a0ec-d5f16869561e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:09:48.496848 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41153b17-8b3c-4d57-a8fb-d855f5e44f5a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:09:48.497351 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41153b17-8b3c-4d57-a8fb-d855f5e44f5a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:09:48.497807 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41153b17-8b3c-4d57-a8fb-d855f5e44f5a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:09:48.498516 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41153b17-8b3c-4d57-a8fb-d855f5e44f5a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:09:48.498991 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41153b17-8b3c-4d57-a8fb-d855f5e44f5a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:09:48.499472 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-41153b17-8b3c-4d57-a8fb-d855f5e44f5a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:09:48.522643 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-41153b17-8b3c-4d57-a8fb-d855f5e44f5a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lazy-loading 'flavor' on Instance uuid f1cdd411-b927-4057-a0ec-d5f16869561e {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 13:09:48.587477 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-41153b17-8b3c-4d57-a8fb-d855f5e44f5a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "POST /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e/action" status: 202 len: 0 microversion: 2.1 time: 0.105566 Sep 10 13:09:48.588277 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3841/7675] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 13:09:48 2022] POST /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 13:09:48.598308 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1c8ced60-e28b-4018-9645-b341d3f52171 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:09:48.599668 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1c8ced60-e28b-4018-9645-b341d3f52171 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: f1cdd411-b927-4057-a0ec-d5f16869561e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:09:48.602244 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:09:48.603120 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=4 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:09:48.609145 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c8ced60-e28b-4018-9645-b341d3f52171 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:09:48.609980 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c8ced60-e28b-4018-9645-b341d3f52171 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:09:48.610425 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c8ced60-e28b-4018-9645-b341d3f52171 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:09:48.611122 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c8ced60-e28b-4018-9645-b341d3f52171 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:09:48.611597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c8ced60-e28b-4018-9645-b341d3f52171 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:09:48.612024 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1c8ced60-e28b-4018-9645-b341d3f52171 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:09:48.747123 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1c8ced60-e28b-4018-9645-b341d3f52171 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:09:48.755575 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1c8ced60-e28b-4018-9645-b341d3f52171 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e" status: 200 len: 1689 microversion: 2.1 time: 0.161096 Sep 10 13:09:48.756162 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3835/7676] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:09:48 2022] GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:09:49.783339 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8709136c-7037-4d06-b0ec-d20d83a9789a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:09:49.784058 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8709136c-7037-4d06-b0ec-d20d83a9789a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: f1cdd411-b927-4057-a0ec-d5f16869561e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:09:49.791421 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8709136c-7037-4d06-b0ec-d20d83a9789a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:09:49.791914 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8709136c-7037-4d06-b0ec-d20d83a9789a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:09:49.792361 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8709136c-7037-4d06-b0ec-d20d83a9789a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:09:49.793091 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8709136c-7037-4d06-b0ec-d20d83a9789a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:09:49.793558 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8709136c-7037-4d06-b0ec-d20d83a9789a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:09:49.793993 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8709136c-7037-4d06-b0ec-d20d83a9789a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:09:49.940693 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8709136c-7037-4d06-b0ec-d20d83a9789a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:09:49.949076 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8709136c-7037-4d06-b0ec-d20d83a9789a tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e" status: 200 len: 1689 microversion: 2.1 time: 0.171141 Sep 10 13:09:49.949648 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3842/7677] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:09:49 2022] GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:09:50.973859 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d1fa453e-bd6e-403d-8bf1-ace0f557a276 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:09:50.974471 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d1fa453e-bd6e-403d-8bf1-ace0f557a276 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: f1cdd411-b927-4057-a0ec-d5f16869561e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:09:50.980840 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1fa453e-bd6e-403d-8bf1-ace0f557a276 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:09:50.981324 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1fa453e-bd6e-403d-8bf1-ace0f557a276 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:09:50.981762 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1fa453e-bd6e-403d-8bf1-ace0f557a276 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:09:50.982451 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1fa453e-bd6e-403d-8bf1-ace0f557a276 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:09:50.982909 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1fa453e-bd6e-403d-8bf1-ace0f557a276 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:09:50.983368 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d1fa453e-bd6e-403d-8bf1-ace0f557a276 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:09:51.113425 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d1fa453e-bd6e-403d-8bf1-ace0f557a276 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:09:51.121803 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d1fa453e-bd6e-403d-8bf1-ace0f557a276 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e" status: 200 len: 1672 microversion: 2.1 time: 0.152395 Sep 10 13:09:51.122379 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3836/7678] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:09:50 2022] GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:09:52.220289 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7dfb7e86-2f38-4b56-b775-e628d0dd1d14 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:09:52.222645 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7dfb7e86-2f38-4b56-b775-e628d0dd1d14 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: f1cdd411-b927-4057-a0ec-d5f16869561e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:09:52.229184 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7dfb7e86-2f38-4b56-b775-e628d0dd1d14 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:09:52.229682 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7dfb7e86-2f38-4b56-b775-e628d0dd1d14 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:09:52.230140 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7dfb7e86-2f38-4b56-b775-e628d0dd1d14 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:09:52.230840 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7dfb7e86-2f38-4b56-b775-e628d0dd1d14 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:09:52.231336 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7dfb7e86-2f38-4b56-b775-e628d0dd1d14 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:09:52.231775 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7dfb7e86-2f38-4b56-b775-e628d0dd1d14 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:09:52.292847 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7dfb7e86-2f38-4b56-b775-e628d0dd1d14 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "POST /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e/action" status: 200 len: 38379 microversion: 2.1 time: 0.076574 Sep 10 13:09:52.293487 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3843/7679] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 13:09:52 2022] POST /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e/action => generated 38379 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 13:09:52.305936 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-78274904-a222-45ab-ae04-1aae0723266f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:09:52.306466 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-78274904-a222-45ab-ae04-1aae0723266f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: f1cdd411-b927-4057-a0ec-d5f16869561e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:09:52.313544 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78274904-a222-45ab-ae04-1aae0723266f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:09:52.314031 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78274904-a222-45ab-ae04-1aae0723266f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:09:52.314464 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78274904-a222-45ab-ae04-1aae0723266f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:09:52.315143 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78274904-a222-45ab-ae04-1aae0723266f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:09:52.315624 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78274904-a222-45ab-ae04-1aae0723266f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:09:52.316047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-78274904-a222-45ab-ae04-1aae0723266f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:09:52.381255 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-78274904-a222-45ab-ae04-1aae0723266f tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "POST /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e/action" status: 202 len: 0 microversion: 2.1 time: 0.079630 Sep 10 13:09:52.381900 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3837/7680] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 13:09:52 2022] POST /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 13:09:52.391964 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e19193ac-71e3-451c-8937-c1544ccd234b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:09:52.392684 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e19193ac-71e3-451c-8937-c1544ccd234b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: f1cdd411-b927-4057-a0ec-d5f16869561e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:09:52.401582 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e19193ac-71e3-451c-8937-c1544ccd234b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:09:52.402129 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e19193ac-71e3-451c-8937-c1544ccd234b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:09:52.402613 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e19193ac-71e3-451c-8937-c1544ccd234b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:09:52.403928 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e19193ac-71e3-451c-8937-c1544ccd234b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:09:52.404241 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e19193ac-71e3-451c-8937-c1544ccd234b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:09:52.405026 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e19193ac-71e3-451c-8937-c1544ccd234b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:09:52.621835 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e19193ac-71e3-451c-8937-c1544ccd234b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:09:52.629702 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e19193ac-71e3-451c-8937-c1544ccd234b tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e" status: 200 len: 1678 microversion: 2.1 time: 0.242412 Sep 10 13:09:52.630439 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3844/7681] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:09:52 2022] GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e => generated 1678 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:09:53.654755 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-db4e79bc-8a0d-4fbe-97a1-92f6a77c86e6 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:09:53.655514 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-db4e79bc-8a0d-4fbe-97a1-92f6a77c86e6 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: f1cdd411-b927-4057-a0ec-d5f16869561e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:09:53.662084 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db4e79bc-8a0d-4fbe-97a1-92f6a77c86e6 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:09:53.662569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db4e79bc-8a0d-4fbe-97a1-92f6a77c86e6 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:09:53.663011 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db4e79bc-8a0d-4fbe-97a1-92f6a77c86e6 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:09:53.663737 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db4e79bc-8a0d-4fbe-97a1-92f6a77c86e6 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:09:53.664199 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db4e79bc-8a0d-4fbe-97a1-92f6a77c86e6 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:09:53.664626 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-db4e79bc-8a0d-4fbe-97a1-92f6a77c86e6 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:09:53.806689 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-db4e79bc-8a0d-4fbe-97a1-92f6a77c86e6 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:09:53.814438 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-db4e79bc-8a0d-4fbe-97a1-92f6a77c86e6 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e" status: 200 len: 1678 microversion: 2.1 time: 0.164803 Sep 10 13:09:53.815015 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3838/7682] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:09:53 2022] GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:09:54.838388 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-97a81387-37f0-477b-94a2-2fec59951c77 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:09:54.840013 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-97a81387-37f0-477b-94a2-2fec59951c77 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: f1cdd411-b927-4057-a0ec-d5f16869561e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:09:54.847315 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-97a81387-37f0-477b-94a2-2fec59951c77 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:09:54.847823 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-97a81387-37f0-477b-94a2-2fec59951c77 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:09:54.848800 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-97a81387-37f0-477b-94a2-2fec59951c77 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:09:54.849558 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-97a81387-37f0-477b-94a2-2fec59951c77 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:09:54.850658 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-97a81387-37f0-477b-94a2-2fec59951c77 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:09:54.850658 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-97a81387-37f0-477b-94a2-2fec59951c77 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:09:54.987372 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-97a81387-37f0-477b-94a2-2fec59951c77 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:09:54.996159 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-97a81387-37f0-477b-94a2-2fec59951c77 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e" status: 200 len: 1681 microversion: 2.1 time: 0.161912 Sep 10 13:09:54.996721 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3845/7683] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:09:54 2022] GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:09:55.095300 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-040ecf0f-67c6-4491-9258-8c12abe91881 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:09:55.097480 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-040ecf0f-67c6-4491-9258-8c12abe91881 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: f1cdd411-b927-4057-a0ec-d5f16869561e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:09:55.105144 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-040ecf0f-67c6-4491-9258-8c12abe91881 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:09:55.105621 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-040ecf0f-67c6-4491-9258-8c12abe91881 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:09:55.106058 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-040ecf0f-67c6-4491-9258-8c12abe91881 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:09:55.106738 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-040ecf0f-67c6-4491-9258-8c12abe91881 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:09:55.107247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-040ecf0f-67c6-4491-9258-8c12abe91881 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:09:55.107637 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-040ecf0f-67c6-4491-9258-8c12abe91881 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:09:55.170033 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-040ecf0f-67c6-4491-9258-8c12abe91881 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "POST /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e/action" status: 200 len: 38379 microversion: 2.1 time: 0.078497 Sep 10 13:09:55.170818 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3839/7684] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 13:09:55 2022] POST /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e/action => generated 38379 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 10 13:09:56.158943 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-17b58dce-d5b9-4008-85c9-7d3ca44c4290 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:09:56.159532 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-17b58dce-d5b9-4008-85c9-7d3ca44c4290 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: f1cdd411-b927-4057-a0ec-d5f16869561e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:09:56.168639 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-8c40cc9f-4a68-4064-ab45-0490e5d63922 req-72f63ad7-c078-4f6a-b081-f0157298b7c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1cdd411-b927-4057-a0ec-d5f16869561e", "tag": "95fe7fe1-41e0-4879-b187-3af35553cdf6"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:09:56.174509 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17b58dce-d5b9-4008-85c9-7d3ca44c4290 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:09:56.175016 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17b58dce-d5b9-4008-85c9-7d3ca44c4290 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:09:56.175501 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17b58dce-d5b9-4008-85c9-7d3ca44c4290 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:09:56.176221 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17b58dce-d5b9-4008-85c9-7d3ca44c4290 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:09:56.177247 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17b58dce-d5b9-4008-85c9-7d3ca44c4290 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:09:56.177693 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-17b58dce-d5b9-4008-85c9-7d3ca44c4290 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:09:56.179782 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8c40cc9f-4a68-4064-ab45-0490e5d63922 req-72f63ad7-c078-4f6a-b081-f0157298b7c6 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:09:56.180459 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8c40cc9f-4a68-4064-ab45-0490e5d63922 req-72f63ad7-c078-4f6a-b081-f0157298b7c6 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:09:56.181059 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8c40cc9f-4a68-4064-ab45-0490e5d63922 req-72f63ad7-c078-4f6a-b081-f0157298b7c6 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:09:56.197710 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-8c40cc9f-4a68-4064-ab45-0490e5d63922 req-72f63ad7-c078-4f6a-b081-f0157298b7c6 service nova] Creating event network-changed:95fe7fe1-41e0-4879-b187-3af35553cdf6 for instance f1cdd411-b927-4057-a0ec-d5f16869561e on n-h1-856895-1 Sep 10 13:09:56.202920 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-8c40cc9f-4a68-4064-ab45-0490e5d63922 req-72f63ad7-c078-4f6a-b081-f0157298b7c6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038052 Sep 10 13:09:56.203582 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3840/7685] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:09:56.208750 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-17b58dce-d5b9-4008-85c9-7d3ca44c4290 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: f1cdd411-b927-4057-a0ec-d5f16869561e] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 13:09:56.292305 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-17b58dce-d5b9-4008-85c9-7d3ca44c4290 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e" status: 204 len: 0 microversion: 2.1 time: 0.136621 Sep 10 13:09:56.293649 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3846/7686] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 13:09:56 2022] DELETE /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 13:09:56.304187 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-559a1326-b4d2-4591-870c-12c60f1f2b53 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:09:56.304895 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-559a1326-b4d2-4591-870c-12c60f1f2b53 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: f1cdd411-b927-4057-a0ec-d5f16869561e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:09:56.311770 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-559a1326-b4d2-4591-870c-12c60f1f2b53 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:09:56.312350 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-559a1326-b4d2-4591-870c-12c60f1f2b53 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:09:56.312862 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-559a1326-b4d2-4591-870c-12c60f1f2b53 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:09:56.313576 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-559a1326-b4d2-4591-870c-12c60f1f2b53 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:09:56.314035 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-559a1326-b4d2-4591-870c-12c60f1f2b53 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:09:56.314466 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-559a1326-b4d2-4591-870c-12c60f1f2b53 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:09:56.456003 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-559a1326-b4d2-4591-870c-12c60f1f2b53 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:09:56.464213 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-559a1326-b4d2-4591-870c-12c60f1f2b53 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e" status: 200 len: 1687 microversion: 2.1 time: 0.165786 Sep 10 13:09:56.464809 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3841/7687] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:09:56 2022] GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:09:57.491389 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9f606ebf-6985-42e2-baac-8ffb8bee3698 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:09:57.492024 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9f606ebf-6985-42e2-baac-8ffb8bee3698 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: f1cdd411-b927-4057-a0ec-d5f16869561e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:09:57.498816 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9f606ebf-6985-42e2-baac-8ffb8bee3698 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:09:57.499344 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9f606ebf-6985-42e2-baac-8ffb8bee3698 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:09:57.499796 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9f606ebf-6985-42e2-baac-8ffb8bee3698 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:09:57.500494 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9f606ebf-6985-42e2-baac-8ffb8bee3698 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:09:57.500961 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9f606ebf-6985-42e2-baac-8ffb8bee3698 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:09:57.501400 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9f606ebf-6985-42e2-baac-8ffb8bee3698 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:09:57.699571 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9f606ebf-6985-42e2-baac-8ffb8bee3698 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:09:57.707402 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9f606ebf-6985-42e2-baac-8ffb8bee3698 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e" status: 200 len: 1687 microversion: 2.1 time: 0.221150 Sep 10 13:09:57.708022 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3847/7688] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:09:57 2022] GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e => generated 1687 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:09:58.535069 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-67cee1fe-ff95-40a2-88bb-3aaee9aa47a4 req-117dda48-a7b4-4a8e-a56f-3cbe44506fca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1cdd411-b927-4057-a0ec-d5f16869561e", "name": "network-vif-deleted", "tag": "95fe7fe1-41e0-4879-b187-3af35553cdf6"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:09:58.546392 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-67cee1fe-ff95-40a2-88bb-3aaee9aa47a4 req-117dda48-a7b4-4a8e-a56f-3cbe44506fca service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:09:58.546811 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-67cee1fe-ff95-40a2-88bb-3aaee9aa47a4 req-117dda48-a7b4-4a8e-a56f-3cbe44506fca service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:09:58.547284 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-67cee1fe-ff95-40a2-88bb-3aaee9aa47a4 req-117dda48-a7b4-4a8e-a56f-3cbe44506fca service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:09:58.559300 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-67cee1fe-ff95-40a2-88bb-3aaee9aa47a4 req-117dda48-a7b4-4a8e-a56f-3cbe44506fca service nova] Creating event network-vif-deleted:95fe7fe1-41e0-4879-b187-3af35553cdf6 for instance f1cdd411-b927-4057-a0ec-d5f16869561e on n-h1-856895-1 Sep 10 13:09:58.564710 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-67cee1fe-ff95-40a2-88bb-3aaee9aa47a4 req-117dda48-a7b4-4a8e-a56f-3cbe44506fca service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033338 Sep 10 13:09:58.565581 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3842/7689] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:09:58.731348 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5de926cb-8161-4b9d-83fd-3345ec54701d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:09:58.731930 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5de926cb-8161-4b9d-83fd-3345ec54701d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: f1cdd411-b927-4057-a0ec-d5f16869561e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:09:58.738477 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5de926cb-8161-4b9d-83fd-3345ec54701d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:09:58.739780 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5de926cb-8161-4b9d-83fd-3345ec54701d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:09:58.740297 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5de926cb-8161-4b9d-83fd-3345ec54701d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:09:58.741033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5de926cb-8161-4b9d-83fd-3345ec54701d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:09:58.741502 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5de926cb-8161-4b9d-83fd-3345ec54701d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:09:58.741945 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5de926cb-8161-4b9d-83fd-3345ec54701d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:09:58.773980 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5de926cb-8161-4b9d-83fd-3345ec54701d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:09:58.774476 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5de926cb-8161-4b9d-83fd-3345ec54701d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:09:58.774930 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5de926cb-8161-4b9d-83fd-3345ec54701d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:09:58.775417 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-5de926cb-8161-4b9d-83fd-3345ec54701d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lazy-loading 'fault' on Instance uuid f1cdd411-b927-4057-a0ec-d5f16869561e {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 13:09:58.822573 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5de926cb-8161-4b9d-83fd-3345ec54701d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75e338a6cb34d11a42b65da1eca4f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e733e9474c4814b77eddbf547e3a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:09:58.830990 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5de926cb-8161-4b9d-83fd-3345ec54701d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e" status: 200 len: 1354 microversion: 2.1 time: 0.103803 Sep 10 13:09:58.831600 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3848/7690] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:09:58 2022] GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e => generated 1354 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:09:59.856693 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8b82ee0a-f00f-427b-948b-ba69fe20f77d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:09:59.857406 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8b82ee0a-f00f-427b-948b-ba69fe20f77d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] [instance: f1cdd411-b927-4057-a0ec-d5f16869561e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:09:59.863614 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b82ee0a-f00f-427b-948b-ba69fe20f77d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:09:59.864669 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b82ee0a-f00f-427b-948b-ba69fe20f77d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:09:59.865111 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b82ee0a-f00f-427b-948b-ba69fe20f77d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:09:59.865800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b82ee0a-f00f-427b-948b-ba69fe20f77d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:09:59.866259 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b82ee0a-f00f-427b-948b-ba69fe20f77d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:09:59.866687 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b82ee0a-f00f-427b-948b-ba69fe20f77d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:09:59.880437 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-8b82ee0a-f00f-427b-948b-ba69fe20f77d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] HTTP exception thrown: Instance f1cdd411-b927-4057-a0ec-d5f16869561e could not be found. Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8b82ee0a-f00f-427b-948b-ba69fe20f77d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Request method failure captured: Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e HTTP/1.1 Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHIpdJSi4DFbBHL8V-ThkqWs5qsENn9f44fAjCGfIVt2JLbU_2M84czNkA_1xJt3KrfjUCCFS4TMpry236FRO_1OwbSaFPzXSs5yvfKc4BHVhFUvMQ81nyQLxn8rwKBj8fhkryGWzH2_U6bC_TMfY-qfd78V0LzaRSLPr8smJqhI8tXU Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: b0e733e9474c4814b77eddbf547e3a54 Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1010290636 Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b0e733e9474c4814b77eddbf547e3a54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b0e733e9474c4814b77eddbf547e3a54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b0e733e9474c4814b77eddbf547e3a54", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b0e733e9474c4814b77eddbf547e3a54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1010290636 Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: b0e733e9474c4814b77eddbf547e3a54 Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1010290636 Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-TestNetworkAdvancedServerOps-1010290636-project Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: f75e338a6cb34d11a42b65da1eca4f83 Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1010290636-project Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance f1cdd411-b927-4057-a0ec-d5f16869561e could not be found. Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'f1cdd411-b927-4057-a0ec-d5f16869561e'} Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1cdd411-b927-4057-a0ec-d5f16869561e could not be found. Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1cdd411-b927-4057-a0ec-d5f16869561e could not be found. Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 13:09:59.882059 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 13:09:59.886753 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 13:09:59.886753 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 13:09:59.886753 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 13:09:59.886753 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 13:09:59.886753 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 13:09:59.886753 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 13:09:59.886753 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1cdd411-b927-4057-a0ec-d5f16869561e could not be found. Sep 10 13:09:59.886753 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 13:09:59.886753 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8b82ee0a-f00f-427b-948b-ba69fe20f77d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Returning 404 to user: Instance f1cdd411-b927-4057-a0ec-d5f16869561e could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 13:09:59.886753 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8b82ee0a-f00f-427b-948b-ba69fe20f77d tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e" status: 404 len: 111 microversion: 2.1 time: 0.032093 Sep 10 13:09:59.886753 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3843/7691] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:09:59 2022] GET /compute/v2.1/servers/f1cdd411-b927-4057-a0ec-d5f16869561e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 13:10:03.432204 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6d4f2621-68fc-4879-b650-8f16fe58e309 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] Calling method '.version_select at 0x7f4072cab550>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:10:03.453838 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6d4f2621-68fc-4879-b650-8f16fe58e309 tempest-TestNetworkAdvancedServerOps-1010290636 tempest-TestNetworkAdvancedServerOps-1010290636-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-57715380" status: 202 len: 0 microversion: 2.1 time: 0.025930 Sep 10 13:10:03.454555 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3849/7692] 10.222.0.23 () {58 vars in 1278 bytes} [Sat Sep 10 13:10:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-57715380 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 13:10:14.372053 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=18 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:10:14.372904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:10:14.591598 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5bc0e243-95e2-495a-a29f-0f16630fe5d3 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Action: 'create', calling method: .version_select at 0x7f4071b06700>, body: {"keypair": {"name": "tempest-TestShelveInstance-821132416", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdRdIhCrkh+87RqiJ8KeLLa7gOPEYuktf/Ku4IzDOWIFkoutHMiGg894L+/kGMZHk8DMDJSexVLnQbL2D+k/YOkUKf0oLLJTL1ItZwRLvrq0NvPOvwCBb6eFFRN+cxFrQ=="}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:10:14.609223 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-5bc0e243-95e2-495a-a29f-0f16630fe5d3 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Getting quotas for project 85beefd475294c0581b222a74f700236. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 13:10:14.617031 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-5bc0e243-95e2-495a-a29f-0f16630fe5d3 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Getting quotas for user da2e2041df59456d80ea0a6bd8b384bd and project 85beefd475294c0581b222a74f700236. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 13:10:14.649209 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5bc0e243-95e2-495a-a29f-0f16630fe5d3 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.283581 Sep 10 13:10:14.656295 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3844/7693] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 13:10:14 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:10:15.624794 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:10:15.625565 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:10:15.630456 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-95ed6ab0-121b-4123-9ef6-16a6231a0470 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1694396276", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-821132416", "security_groups": [{"name": "tempest-secgroup-smoke-407166014"}], "networks": [{"uuid": "035af43a-756e-4566-9d78-c55b9b539179"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:10:15.741060 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-95ed6ab0-121b-4123-9ef6-16a6231a0470 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] validate_networks() for [('035af43a-756e-4566-9d78-c55b9b539179', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 13:10:16.243698 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-95ed6ab0-121b-4123-9ef6-16a6231a0470 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 13:10:16.244432 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-95ed6ab0-121b-4123-9ef6-16a6231a0470 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 13:10:16.245861 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-95ed6ab0-121b-4123-9ef6-16a6231a0470 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 13:10:16.246328 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-95ed6ab0-121b-4123-9ef6-16a6231a0470 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 13:10:16.246950 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-95ed6ab0-121b-4123-9ef6-16a6231a0470 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 13:10:16.259465 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-95ed6ab0-121b-4123-9ef6-16a6231a0470 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:10:16.260261 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-95ed6ab0-121b-4123-9ef6-16a6231a0470 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:10:16.260722 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-95ed6ab0-121b-4123-9ef6-16a6231a0470 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:10:16.261484 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-95ed6ab0-121b-4123-9ef6-16a6231a0470 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:10:16.261958 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-95ed6ab0-121b-4123-9ef6-16a6231a0470 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:10:16.262597 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-95ed6ab0-121b-4123-9ef6-16a6231a0470 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:10:16.282914 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-95ed6ab0-121b-4123-9ef6-16a6231a0470 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Getting quotas for project 85beefd475294c0581b222a74f700236. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 13:10:16.289031 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-95ed6ab0-121b-4123-9ef6-16a6231a0470 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Getting quotas for user da2e2041df59456d80ea0a6bd8b384bd and project 85beefd475294c0581b222a74f700236. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 13:10:16.301534 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-95ed6ab0-121b-4123-9ef6-16a6231a0470 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 13:10:16.303955 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-95ed6ab0-121b-4123-9ef6-16a6231a0470 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 13:10:16.349997 n-d-856895-1 devstack@n-api.service[128776]: ERROR oslo.messaging._drivers.impl_rabbit [None req-95ed6ab0-121b-4123-9ef6-16a6231a0470 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [3546e893-383c-408c-b52a-b9224010d84e] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 10 13:10:17.357970 n-d-856895-1 devstack@n-api.service[128776]: INFO oslo.messaging._drivers.impl_rabbit [None req-95ed6ab0-121b-4123-9ef6-16a6231a0470 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [3546e893-383c-408c-b52a-b9224010d84e] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 38404. Sep 10 13:10:17.361990 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-95ed6ab0-121b-4123-9ef6-16a6231a0470 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.739062 Sep 10 13:10:17.369972 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3850/7694] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 13:10:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 1747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 13:10:17.374813 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6cebebbb-6d53-44c1-b6a7-71a19571fa4f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:10:17.375761 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6cebebbb-6d53-44c1-b6a7-71a19571fa4f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:10:17.495187 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6cebebbb-6d53-44c1-b6a7-71a19571fa4f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:10:17.502393 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6cebebbb-6d53-44c1-b6a7-71a19571fa4f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1246 microversion: 2.1 time: 0.131920 Sep 10 13:10:17.503215 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3845/7695] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:10:17 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1246 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 13:10:18.528038 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c385a084-d165-4a05-b19b-9c3d2afacdd4 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:10:18.528854 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c385a084-d165-4a05-b19b-9c3d2afacdd4 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:10:18.538721 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c385a084-d165-4a05-b19b-9c3d2afacdd4 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:10:18.539259 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c385a084-d165-4a05-b19b-9c3d2afacdd4 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:10:18.539712 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c385a084-d165-4a05-b19b-9c3d2afacdd4 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:10:18.540473 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c385a084-d165-4a05-b19b-9c3d2afacdd4 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:10:18.541318 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c385a084-d165-4a05-b19b-9c3d2afacdd4 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:10:18.541962 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c385a084-d165-4a05-b19b-9c3d2afacdd4 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:10:18.615535 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c385a084-d165-4a05-b19b-9c3d2afacdd4 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:10:18.623559 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c385a084-d165-4a05-b19b-9c3d2afacdd4 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1316 microversion: 2.1 time: 0.100785 Sep 10 13:10:18.624236 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3851/7696] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:10:18 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1316 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:10:19.648329 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c96b8551-e8cc-4301-8fbb-5ffffc6f03de tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:10:19.649048 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c96b8551-e8cc-4301-8fbb-5ffffc6f03de tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:10:19.656961 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c96b8551-e8cc-4301-8fbb-5ffffc6f03de tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:10:19.657453 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c96b8551-e8cc-4301-8fbb-5ffffc6f03de tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:10:19.657896 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c96b8551-e8cc-4301-8fbb-5ffffc6f03de tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:10:19.658590 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c96b8551-e8cc-4301-8fbb-5ffffc6f03de tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:10:19.659057 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c96b8551-e8cc-4301-8fbb-5ffffc6f03de tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:10:19.659510 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c96b8551-e8cc-4301-8fbb-5ffffc6f03de tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:10:19.797259 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c96b8551-e8cc-4301-8fbb-5ffffc6f03de tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:10:19.805137 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c96b8551-e8cc-4301-8fbb-5ffffc6f03de tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1371 microversion: 2.1 time: 0.160890 Sep 10 13:10:19.805748 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3846/7697] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:10:19 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:10:19.951965 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-e9a5a9b4-a71e-452c-880e-f380a62ef2d0 req-870ccc70-e462-40e2-a0f3-e7417145efad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53767d25-7062-4d84-bcb8-f0210e6ec50a", "tag": "e333acbe-93c9-4c2a-a5d1-b4598ab67ea5"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:10:19.967822 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e9a5a9b4-a71e-452c-880e-f380a62ef2d0 req-870ccc70-e462-40e2-a0f3-e7417145efad service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:10:19.968328 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e9a5a9b4-a71e-452c-880e-f380a62ef2d0 req-870ccc70-e462-40e2-a0f3-e7417145efad service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:10:19.968991 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e9a5a9b4-a71e-452c-880e-f380a62ef2d0 req-870ccc70-e462-40e2-a0f3-e7417145efad service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:10:19.990827 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-e9a5a9b4-a71e-452c-880e-f380a62ef2d0 req-870ccc70-e462-40e2-a0f3-e7417145efad service nova] Creating event network-changed:e333acbe-93c9-4c2a-a5d1-b4598ab67ea5 for instance 53767d25-7062-4d84-bcb8-f0210e6ec50a on n-h2-856895-1 Sep 10 13:10:19.997453 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-e9a5a9b4-a71e-452c-880e-f380a62ef2d0 req-870ccc70-e462-40e2-a0f3-e7417145efad service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048588 Sep 10 13:10:19.998041 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3852/7698] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:10:20.829089 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e1d322a2-668d-455a-bb0f-abd5a93f9a99 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:10:20.829644 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e1d322a2-668d-455a-bb0f-abd5a93f9a99 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:10:20.837473 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e1d322a2-668d-455a-bb0f-abd5a93f9a99 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:10:20.837951 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e1d322a2-668d-455a-bb0f-abd5a93f9a99 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:10:20.838383 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e1d322a2-668d-455a-bb0f-abd5a93f9a99 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:10:20.839070 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e1d322a2-668d-455a-bb0f-abd5a93f9a99 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:10:20.839546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e1d322a2-668d-455a-bb0f-abd5a93f9a99 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:10:20.839998 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e1d322a2-668d-455a-bb0f-abd5a93f9a99 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:10:20.976468 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e1d322a2-668d-455a-bb0f-abd5a93f9a99 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:10:20.984362 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e1d322a2-668d-455a-bb0f-abd5a93f9a99 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1371 microversion: 2.1 time: 0.159279 Sep 10 13:10:20.984946 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3847/7699] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:10:20 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:10:22.009180 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-219ccaf9-2d33-4b4a-9959-23f175c85704 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:10:22.009897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-219ccaf9-2d33-4b4a-9959-23f175c85704 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:10:22.017196 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-219ccaf9-2d33-4b4a-9959-23f175c85704 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:10:22.017694 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-219ccaf9-2d33-4b4a-9959-23f175c85704 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:10:22.018142 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-219ccaf9-2d33-4b4a-9959-23f175c85704 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:10:22.018842 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-219ccaf9-2d33-4b4a-9959-23f175c85704 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:10:22.019391 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-219ccaf9-2d33-4b4a-9959-23f175c85704 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:10:22.021026 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-219ccaf9-2d33-4b4a-9959-23f175c85704 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:10:22.162699 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-219ccaf9-2d33-4b4a-9959-23f175c85704 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:10:22.170612 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-219ccaf9-2d33-4b4a-9959-23f175c85704 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1371 microversion: 2.1 time: 0.166772 Sep 10 13:10:22.171214 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3853/7700] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:10:22 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:10:23.194546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ad34b7d4-0509-44b7-9710-2d9368e7a651 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:10:23.195174 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ad34b7d4-0509-44b7-9710-2d9368e7a651 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:10:23.202133 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ad34b7d4-0509-44b7-9710-2d9368e7a651 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:10:23.202616 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ad34b7d4-0509-44b7-9710-2d9368e7a651 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:10:23.203056 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ad34b7d4-0509-44b7-9710-2d9368e7a651 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:10:23.203772 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ad34b7d4-0509-44b7-9710-2d9368e7a651 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:10:23.204226 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ad34b7d4-0509-44b7-9710-2d9368e7a651 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:10:23.204653 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ad34b7d4-0509-44b7-9710-2d9368e7a651 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:10:23.337252 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ad34b7d4-0509-44b7-9710-2d9368e7a651 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:10:23.344995 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ad34b7d4-0509-44b7-9710-2d9368e7a651 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1371 microversion: 2.1 time: 0.155014 Sep 10 13:10:23.345595 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3848/7701] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:10:23 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:10:24.368711 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-9248c5ee-b866-447d-b744-7a6b2082cfdb tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:10:24.369284 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-9248c5ee-b866-447d-b744-7a6b2082cfdb tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:10:24.376200 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9248c5ee-b866-447d-b744-7a6b2082cfdb tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:10:24.376703 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9248c5ee-b866-447d-b744-7a6b2082cfdb tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:10:24.377160 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9248c5ee-b866-447d-b744-7a6b2082cfdb tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:10:24.377868 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9248c5ee-b866-447d-b744-7a6b2082cfdb tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:10:24.378344 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9248c5ee-b866-447d-b744-7a6b2082cfdb tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:10:24.378797 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-9248c5ee-b866-447d-b744-7a6b2082cfdb tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:10:24.514238 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-9248c5ee-b866-447d-b744-7a6b2082cfdb tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:10:24.522213 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-9248c5ee-b866-447d-b744-7a6b2082cfdb tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1371 microversion: 2.1 time: 0.158112 Sep 10 13:10:24.523069 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3854/7702] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:10:24 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:10:25.545435 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7d07165f-3f40-4f23-8dd4-248a8dfbb431 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:10:25.546052 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7d07165f-3f40-4f23-8dd4-248a8dfbb431 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:10:25.553846 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d07165f-3f40-4f23-8dd4-248a8dfbb431 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:10:25.554320 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d07165f-3f40-4f23-8dd4-248a8dfbb431 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:10:25.554758 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d07165f-3f40-4f23-8dd4-248a8dfbb431 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:10:25.555490 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d07165f-3f40-4f23-8dd4-248a8dfbb431 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:10:25.555948 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d07165f-3f40-4f23-8dd4-248a8dfbb431 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:10:25.556373 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7d07165f-3f40-4f23-8dd4-248a8dfbb431 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:10:25.708855 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7d07165f-3f40-4f23-8dd4-248a8dfbb431 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:10:25.714025 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-6f6bbcf8-9422-46f1-aff2-8000370361d4 req-abaf7862-3dcb-4429-9ac6-2b18c2d6e32a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53767d25-7062-4d84-bcb8-f0210e6ec50a", "name": "network-vif-plugged", "status": "completed", "tag": "e333acbe-93c9-4c2a-a5d1-b4598ab67ea5"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:10:25.717390 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7d07165f-3f40-4f23-8dd4-248a8dfbb431 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1371 microversion: 2.1 time: 0.175745 Sep 10 13:10:25.717998 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3849/7703] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:10:25 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:10:25.723892 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6f6bbcf8-9422-46f1-aff2-8000370361d4 req-abaf7862-3dcb-4429-9ac6-2b18c2d6e32a service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:10:25.724398 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6f6bbcf8-9422-46f1-aff2-8000370361d4 req-abaf7862-3dcb-4429-9ac6-2b18c2d6e32a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:10:25.724855 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6f6bbcf8-9422-46f1-aff2-8000370361d4 req-abaf7862-3dcb-4429-9ac6-2b18c2d6e32a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:10:25.736118 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-6f6bbcf8-9422-46f1-aff2-8000370361d4 req-abaf7862-3dcb-4429-9ac6-2b18c2d6e32a service nova] Creating event network-vif-plugged:e333acbe-93c9-4c2a-a5d1-b4598ab67ea5 for instance 53767d25-7062-4d84-bcb8-f0210e6ec50a on n-h2-856895-1 Sep 10 13:10:25.741193 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-6f6bbcf8-9422-46f1-aff2-8000370361d4 req-abaf7862-3dcb-4429-9ac6-2b18c2d6e32a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102411 Sep 10 13:10:25.741789 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3855/7704] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 13:10:26.740669 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-267c3625-827f-4023-a2b1-8928658e7422 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:10:26.741281 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-267c3625-827f-4023-a2b1-8928658e7422 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:10:26.748146 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-267c3625-827f-4023-a2b1-8928658e7422 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:10:26.748632 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-267c3625-827f-4023-a2b1-8928658e7422 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:10:26.749072 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-267c3625-827f-4023-a2b1-8928658e7422 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:10:26.749762 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-267c3625-827f-4023-a2b1-8928658e7422 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:10:26.750217 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-267c3625-827f-4023-a2b1-8928658e7422 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:10:26.750646 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-267c3625-827f-4023-a2b1-8928658e7422 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:10:26.887982 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-267c3625-827f-4023-a2b1-8928658e7422 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:10:26.896570 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-267c3625-827f-4023-a2b1-8928658e7422 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1371 microversion: 2.1 time: 0.159825 Sep 10 13:10:26.897160 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3850/7705] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:10:26 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:10:27.922589 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7656e3e9-caa9-4c32-9eb6-f5b69e111c65 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:10:27.923416 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7656e3e9-caa9-4c32-9eb6-f5b69e111c65 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:10:27.925428 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:10:27.926115 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:10:27.934321 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7656e3e9-caa9-4c32-9eb6-f5b69e111c65 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:10:27.934826 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7656e3e9-caa9-4c32-9eb6-f5b69e111c65 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:10:27.935308 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7656e3e9-caa9-4c32-9eb6-f5b69e111c65 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:10:27.936027 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7656e3e9-caa9-4c32-9eb6-f5b69e111c65 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:10:27.936514 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7656e3e9-caa9-4c32-9eb6-f5b69e111c65 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:10:27.936966 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7656e3e9-caa9-4c32-9eb6-f5b69e111c65 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:10:28.077432 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7656e3e9-caa9-4c32-9eb6-f5b69e111c65 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:10:28.085540 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7656e3e9-caa9-4c32-9eb6-f5b69e111c65 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1556 microversion: 2.1 time: 0.167422 Sep 10 13:10:28.086112 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3856/7706] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:10:27 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1556 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:10:28.107878 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ee996d1c-a01d-4294-97c5-b82b45abb87e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:10:28.108497 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ee996d1c-a01d-4294-97c5-b82b45abb87e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:10:28.110360 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:10:28.117194 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee996d1c-a01d-4294-97c5-b82b45abb87e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:10:28.117688 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee996d1c-a01d-4294-97c5-b82b45abb87e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:10:28.118155 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee996d1c-a01d-4294-97c5-b82b45abb87e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:10:28.118859 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee996d1c-a01d-4294-97c5-b82b45abb87e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:10:28.119350 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee996d1c-a01d-4294-97c5-b82b45abb87e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:10:28.119785 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ee996d1c-a01d-4294-97c5-b82b45abb87e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:10:28.252470 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ee996d1c-a01d-4294-97c5-b82b45abb87e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:10:28.260333 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ee996d1c-a01d-4294-97c5-b82b45abb87e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1556 microversion: 2.1 time: 0.156365 Sep 10 13:10:28.260908 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3851/7707] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:10:28 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:10:30.194171 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-ac56ae35-5466-40f6-b1f0-34b27baccd32 req-637b7e3d-68c0-4276-88ca-9dba834744b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53767d25-7062-4d84-bcb8-f0210e6ec50a", "tag": "e333acbe-93c9-4c2a-a5d1-b4598ab67ea5"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:10:30.205134 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ac56ae35-5466-40f6-b1f0-34b27baccd32 req-637b7e3d-68c0-4276-88ca-9dba834744b9 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:10:30.205885 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ac56ae35-5466-40f6-b1f0-34b27baccd32 req-637b7e3d-68c0-4276-88ca-9dba834744b9 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:10:30.206340 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-ac56ae35-5466-40f6-b1f0-34b27baccd32 req-637b7e3d-68c0-4276-88ca-9dba834744b9 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:10:30.218085 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-ac56ae35-5466-40f6-b1f0-34b27baccd32 req-637b7e3d-68c0-4276-88ca-9dba834744b9 service nova] Creating event network-changed:e333acbe-93c9-4c2a-a5d1-b4598ab67ea5 for instance 53767d25-7062-4d84-bcb8-f0210e6ec50a on n-h2-856895-1 Sep 10 13:10:30.223267 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-ac56ae35-5466-40f6-b1f0-34b27baccd32 req-637b7e3d-68c0-4276-88ca-9dba834744b9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032903 Sep 10 13:10:30.224476 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3857/7708] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:12:25.414067 n-d-856895-1 devstack@n-api.service[128777]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ff629e48-f4d3-4091-a343-d4a4670d06d6] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 10 13:12:25.414900 n-d-856895-1 devstack@n-api.service[128777]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9df9aef1-f60c-4e89-81ef-a70ffef5e10e] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 10 13:12:25.415694 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:12:25.416509 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=36 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:12:25.418220 n-d-856895-1 devstack@n-api.service[128777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 10 13:12:25.418422 n-d-856895-1 devstack@n-api.service[128777]: Sat Sep 10 13:12:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a/action (ip 10.222.0.23) !!! Sep 10 13:12:25.419349 n-d-856895-1 devstack@n-api.service[128777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 13:12:25.419506 n-d-856895-1 devstack@n-api.service[128777]: Sat Sep 10 13:12:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a/action (ip 10.222.0.23) !!! Sep 10 13:12:25.424585 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d635cd8c-3129-4014-8c39-c2ae8d7ed501 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:12:25.425120 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d635cd8c-3129-4014-8c39-c2ae8d7ed501 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:12:25.434669 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d635cd8c-3129-4014-8c39-c2ae8d7ed501 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:25.435157 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d635cd8c-3129-4014-8c39-c2ae8d7ed501 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:25.435617 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d635cd8c-3129-4014-8c39-c2ae8d7ed501 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:25.436306 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d635cd8c-3129-4014-8c39-c2ae8d7ed501 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:25.436783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d635cd8c-3129-4014-8c39-c2ae8d7ed501 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:25.437211 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d635cd8c-3129-4014-8c39-c2ae8d7ed501 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:25.461835 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-d635cd8c-3129-4014-8c39-c2ae8d7ed501 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lazy-loading 'flavor' on Instance uuid 53767d25-7062-4d84-bcb8-f0210e6ec50a {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 13:12:25.654423 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d635cd8c-3129-4014-8c39-c2ae8d7ed501 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "POST /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a/action" status: 202 len: 0 microversion: 2.1 time: 0.241933 Sep 10 13:12:25.655033 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3852/7709] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 13:12:25 2022] POST /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 13:12:25.661545 n-d-856895-1 devstack@n-api.service[128776]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8e1e649-5477-464a-a830-120923e99a14] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 10 13:12:25.662644 n-d-856895-1 devstack@n-api.service[128776]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f7df2fea-8ccb-440d-aacb-6daa54c00e88] AMQP server on 10.222.0.23:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 10 13:12:25.663361 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:12:25.664418 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=32 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:12:25.665313 n-d-856895-1 devstack@n-api.service[128776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 10 13:12:25.665461 n-d-856895-1 devstack@n-api.service[128776]: Sat Sep 10 13:12:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a (ip 10.222.0.23) !!! Sep 10 13:12:25.673028 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-494c73f9-6cf6-4803-b407-92a380a4265b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:12:25.673882 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-494c73f9-6cf6-4803-b407-92a380a4265b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:12:25.683988 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-494c73f9-6cf6-4803-b407-92a380a4265b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:25.684461 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-494c73f9-6cf6-4803-b407-92a380a4265b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:25.684914 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-494c73f9-6cf6-4803-b407-92a380a4265b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:25.685634 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-494c73f9-6cf6-4803-b407-92a380a4265b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:25.686111 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-494c73f9-6cf6-4803-b407-92a380a4265b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:25.686556 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-494c73f9-6cf6-4803-b407-92a380a4265b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:25.822563 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-494c73f9-6cf6-4803-b407-92a380a4265b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:12:25.831029 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-494c73f9-6cf6-4803-b407-92a380a4265b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1681 microversion: 2.1 time: 0.171442 Sep 10 13:12:25.831629 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3858/7710] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:12:25 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:12:26.857944 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d7eb7fc5-d566-4e84-be18-e0d13167822e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:12:26.858646 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d7eb7fc5-d566-4e84-be18-e0d13167822e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:12:26.867986 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d7eb7fc5-d566-4e84-be18-e0d13167822e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:26.868468 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d7eb7fc5-d566-4e84-be18-e0d13167822e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:26.868904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d7eb7fc5-d566-4e84-be18-e0d13167822e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:26.869590 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d7eb7fc5-d566-4e84-be18-e0d13167822e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:26.870045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d7eb7fc5-d566-4e84-be18-e0d13167822e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:26.870498 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d7eb7fc5-d566-4e84-be18-e0d13167822e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:26.874618 n-d-856895-1 devstack@n-api.service[128777]: INFO oslo.messaging._drivers.impl_rabbit [-] [9df9aef1-f60c-4e89-81ef-a70ffef5e10e] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 38510. Sep 10 13:12:26.876697 n-d-856895-1 devstack@n-api.service[128777]: INFO oslo.messaging._drivers.impl_rabbit [-] [ff629e48-f4d3-4091-a343-d4a4670d06d6] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 38508. Sep 10 13:12:27.009130 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d7eb7fc5-d566-4e84-be18-e0d13167822e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:12:27.017925 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d7eb7fc5-d566-4e84-be18-e0d13167822e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1681 microversion: 2.1 time: 0.166638 Sep 10 13:12:27.018509 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3853/7711] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:12:26 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:12:28.041948 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8940fd6b-04e7-4adf-9932-275ef51560fb tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:12:28.043297 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8940fd6b-04e7-4adf-9932-275ef51560fb tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:12:28.054536 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8940fd6b-04e7-4adf-9932-275ef51560fb tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:28.055038 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8940fd6b-04e7-4adf-9932-275ef51560fb tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:28.055518 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8940fd6b-04e7-4adf-9932-275ef51560fb tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:28.056230 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8940fd6b-04e7-4adf-9932-275ef51560fb tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:28.056703 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8940fd6b-04e7-4adf-9932-275ef51560fb tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:28.057146 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8940fd6b-04e7-4adf-9932-275ef51560fb tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:28.061506 n-d-856895-1 devstack@n-api.service[128776]: INFO oslo.messaging._drivers.impl_rabbit [-] [f7df2fea-8ccb-440d-aacb-6daa54c00e88] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 38516. Sep 10 13:12:28.064481 n-d-856895-1 devstack@n-api.service[128776]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8e1e649-5477-464a-a830-120923e99a14] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 38514. Sep 10 13:12:28.192182 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8940fd6b-04e7-4adf-9932-275ef51560fb tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:12:28.200847 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8940fd6b-04e7-4adf-9932-275ef51560fb tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1681 microversion: 2.1 time: 0.162871 Sep 10 13:12:28.201434 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3859/7712] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:12:28 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:12:29.225039 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2d07b9bd-1cec-4620-bbe7-746e4056a8e7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:12:29.225657 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2d07b9bd-1cec-4620-bbe7-746e4056a8e7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:12:29.233016 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2d07b9bd-1cec-4620-bbe7-746e4056a8e7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:29.233505 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2d07b9bd-1cec-4620-bbe7-746e4056a8e7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:29.233943 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2d07b9bd-1cec-4620-bbe7-746e4056a8e7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:29.234652 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2d07b9bd-1cec-4620-bbe7-746e4056a8e7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:29.235104 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2d07b9bd-1cec-4620-bbe7-746e4056a8e7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:29.235565 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2d07b9bd-1cec-4620-bbe7-746e4056a8e7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:29.375199 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2d07b9bd-1cec-4620-bbe7-746e4056a8e7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:12:29.383102 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2d07b9bd-1cec-4620-bbe7-746e4056a8e7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1681 microversion: 2.1 time: 0.162068 Sep 10 13:12:29.383803 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3854/7713] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:12:29 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:12:30.408203 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-305d4c5e-787e-4f34-b1bd-c5808c8cdcce tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:12:30.409023 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-305d4c5e-787e-4f34-b1bd-c5808c8cdcce tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:12:30.415890 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-305d4c5e-787e-4f34-b1bd-c5808c8cdcce tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:30.416385 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-305d4c5e-787e-4f34-b1bd-c5808c8cdcce tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:30.416834 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-305d4c5e-787e-4f34-b1bd-c5808c8cdcce tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:30.417533 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-305d4c5e-787e-4f34-b1bd-c5808c8cdcce tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:30.418000 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-305d4c5e-787e-4f34-b1bd-c5808c8cdcce tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:30.418438 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-305d4c5e-787e-4f34-b1bd-c5808c8cdcce tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:30.552647 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-305d4c5e-787e-4f34-b1bd-c5808c8cdcce tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:12:30.560873 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-305d4c5e-787e-4f34-b1bd-c5808c8cdcce tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1681 microversion: 2.1 time: 0.157413 Sep 10 13:12:30.561453 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3860/7714] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:12:30 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:12:31.585045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b7143dcd-6110-4537-b307-3e4650828489 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:12:31.585602 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b7143dcd-6110-4537-b307-3e4650828489 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:12:31.593137 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b7143dcd-6110-4537-b307-3e4650828489 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:31.593623 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b7143dcd-6110-4537-b307-3e4650828489 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:31.594059 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b7143dcd-6110-4537-b307-3e4650828489 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:31.594749 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b7143dcd-6110-4537-b307-3e4650828489 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:31.595232 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b7143dcd-6110-4537-b307-3e4650828489 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:31.595664 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b7143dcd-6110-4537-b307-3e4650828489 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:31.729506 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b7143dcd-6110-4537-b307-3e4650828489 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:12:31.737223 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b7143dcd-6110-4537-b307-3e4650828489 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1681 microversion: 2.1 time: 0.156195 Sep 10 13:12:31.737809 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3855/7715] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:12:31 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:12:32.760913 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b9074c5c-4c14-4466-8b6a-d1637bff2e78 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:12:32.761536 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b9074c5c-4c14-4466-8b6a-d1637bff2e78 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:12:32.768992 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9074c5c-4c14-4466-8b6a-d1637bff2e78 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:32.769482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9074c5c-4c14-4466-8b6a-d1637bff2e78 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:32.769931 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9074c5c-4c14-4466-8b6a-d1637bff2e78 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:32.770627 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9074c5c-4c14-4466-8b6a-d1637bff2e78 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:32.771100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9074c5c-4c14-4466-8b6a-d1637bff2e78 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:32.771568 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b9074c5c-4c14-4466-8b6a-d1637bff2e78 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:32.908283 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b9074c5c-4c14-4466-8b6a-d1637bff2e78 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:12:32.916046 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b9074c5c-4c14-4466-8b6a-d1637bff2e78 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1681 microversion: 2.1 time: 0.159099 Sep 10 13:12:32.916628 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3861/7716] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:12:32 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:12:33.940691 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fe703840-4388-43d1-8dfc-6807f0b81a8e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:12:33.941306 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fe703840-4388-43d1-8dfc-6807f0b81a8e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:12:33.948084 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fe703840-4388-43d1-8dfc-6807f0b81a8e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:33.948561 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fe703840-4388-43d1-8dfc-6807f0b81a8e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:33.949027 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fe703840-4388-43d1-8dfc-6807f0b81a8e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:33.949705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fe703840-4388-43d1-8dfc-6807f0b81a8e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:33.950157 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fe703840-4388-43d1-8dfc-6807f0b81a8e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:33.950577 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fe703840-4388-43d1-8dfc-6807f0b81a8e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:34.081901 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fe703840-4388-43d1-8dfc-6807f0b81a8e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:12:34.089589 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fe703840-4388-43d1-8dfc-6807f0b81a8e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1681 microversion: 2.1 time: 0.152794 Sep 10 13:12:34.090166 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3856/7717] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:12:33 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:12:35.112360 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f99bcd98-ec5f-42bb-a367-9917c907b57b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:12:35.112885 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f99bcd98-ec5f-42bb-a367-9917c907b57b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:12:35.119920 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f99bcd98-ec5f-42bb-a367-9917c907b57b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:35.120421 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f99bcd98-ec5f-42bb-a367-9917c907b57b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:35.120873 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f99bcd98-ec5f-42bb-a367-9917c907b57b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:35.121582 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f99bcd98-ec5f-42bb-a367-9917c907b57b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:35.122054 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f99bcd98-ec5f-42bb-a367-9917c907b57b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:35.122536 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f99bcd98-ec5f-42bb-a367-9917c907b57b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:35.258649 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f99bcd98-ec5f-42bb-a367-9917c907b57b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:12:35.267530 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f99bcd98-ec5f-42bb-a367-9917c907b57b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1681 microversion: 2.1 time: 0.159215 Sep 10 13:12:35.268119 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3862/7718] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:12:35 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:12:36.291602 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b8a31c05-f293-4c49-9690-fe0231bcf01e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:12:36.292225 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b8a31c05-f293-4c49-9690-fe0231bcf01e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:12:36.299942 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b8a31c05-f293-4c49-9690-fe0231bcf01e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:36.300435 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b8a31c05-f293-4c49-9690-fe0231bcf01e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:36.300877 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b8a31c05-f293-4c49-9690-fe0231bcf01e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:36.301575 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b8a31c05-f293-4c49-9690-fe0231bcf01e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:36.302036 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b8a31c05-f293-4c49-9690-fe0231bcf01e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:36.302466 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b8a31c05-f293-4c49-9690-fe0231bcf01e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:36.433593 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-b8a31c05-f293-4c49-9690-fe0231bcf01e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:12:36.441356 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b8a31c05-f293-4c49-9690-fe0231bcf01e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1702 microversion: 2.1 time: 0.153777 Sep 10 13:12:36.441934 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3857/7719] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:12:36 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1702 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:12:37.465734 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-416ef562-b0fc-47cb-9caf-39e0d092a0f4 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:12:37.466268 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-416ef562-b0fc-47cb-9caf-39e0d092a0f4 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:12:37.473804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-416ef562-b0fc-47cb-9caf-39e0d092a0f4 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:37.474306 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-416ef562-b0fc-47cb-9caf-39e0d092a0f4 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:37.474763 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-416ef562-b0fc-47cb-9caf-39e0d092a0f4 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:37.475507 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-416ef562-b0fc-47cb-9caf-39e0d092a0f4 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:37.475982 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-416ef562-b0fc-47cb-9caf-39e0d092a0f4 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:37.476429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-416ef562-b0fc-47cb-9caf-39e0d092a0f4 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:37.611875 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-416ef562-b0fc-47cb-9caf-39e0d092a0f4 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:12:37.619648 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-416ef562-b0fc-47cb-9caf-39e0d092a0f4 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1702 microversion: 2.1 time: 0.157946 Sep 10 13:12:37.620224 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3863/7720] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:12:37 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1702 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:12:38.644933 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3cc5a1a5-7922-4617-bff1-4f25bd81bd6f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:12:38.646863 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3cc5a1a5-7922-4617-bff1-4f25bd81bd6f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:12:38.655254 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3cc5a1a5-7922-4617-bff1-4f25bd81bd6f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:38.656253 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3cc5a1a5-7922-4617-bff1-4f25bd81bd6f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:38.656866 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3cc5a1a5-7922-4617-bff1-4f25bd81bd6f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:38.657769 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3cc5a1a5-7922-4617-bff1-4f25bd81bd6f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:38.658400 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3cc5a1a5-7922-4617-bff1-4f25bd81bd6f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:38.658837 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3cc5a1a5-7922-4617-bff1-4f25bd81bd6f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:38.802341 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3cc5a1a5-7922-4617-bff1-4f25bd81bd6f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:12:38.811111 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3cc5a1a5-7922-4617-bff1-4f25bd81bd6f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1697 microversion: 2.1 time: 0.171039 Sep 10 13:12:38.812739 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3858/7721] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:12:38 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1697 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:12:39.836863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-152f7364-7a01-4184-bd56-de05639152f0 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:12:39.838210 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-152f7364-7a01-4184-bd56-de05639152f0 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:12:39.845639 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-152f7364-7a01-4184-bd56-de05639152f0 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:39.846453 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-152f7364-7a01-4184-bd56-de05639152f0 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:39.846918 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-152f7364-7a01-4184-bd56-de05639152f0 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:39.847705 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-152f7364-7a01-4184-bd56-de05639152f0 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:39.848182 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-152f7364-7a01-4184-bd56-de05639152f0 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:39.848627 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-152f7364-7a01-4184-bd56-de05639152f0 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:39.992178 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-152f7364-7a01-4184-bd56-de05639152f0 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:12:40.001270 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-152f7364-7a01-4184-bd56-de05639152f0 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1697 microversion: 2.1 time: 0.168369 Sep 10 13:12:40.002223 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3864/7722] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:12:39 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1697 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:12:40.292590 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-22ab425d-4312-467f-a1eb-fbff5daf290a req-0a61dcd1-85dc-4c4b-86f2-8cda4f24393c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53767d25-7062-4d84-bcb8-f0210e6ec50a", "name": "network-vif-plugged", "status": "completed", "tag": "e333acbe-93c9-4c2a-a5d1-b4598ab67ea5"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:12:40.305530 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-22ab425d-4312-467f-a1eb-fbff5daf290a req-0a61dcd1-85dc-4c4b-86f2-8cda4f24393c service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:40.306296 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-22ab425d-4312-467f-a1eb-fbff5daf290a req-0a61dcd1-85dc-4c4b-86f2-8cda4f24393c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:40.306974 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-22ab425d-4312-467f-a1eb-fbff5daf290a req-0a61dcd1-85dc-4c4b-86f2-8cda4f24393c service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:40.322477 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-22ab425d-4312-467f-a1eb-fbff5daf290a req-0a61dcd1-85dc-4c4b-86f2-8cda4f24393c service nova] Creating event network-vif-plugged:e333acbe-93c9-4c2a-a5d1-b4598ab67ea5 for instance 53767d25-7062-4d84-bcb8-f0210e6ec50a on n-h2-856895-1 Sep 10 13:12:40.328642 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-22ab425d-4312-467f-a1eb-fbff5daf290a req-0a61dcd1-85dc-4c4b-86f2-8cda4f24393c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040191 Sep 10 13:12:40.329530 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3859/7723] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:12:41.025371 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c31e2374-82ae-4248-8992-f8de20def935 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:12:41.026029 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c31e2374-82ae-4248-8992-f8de20def935 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:12:41.033897 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c31e2374-82ae-4248-8992-f8de20def935 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:41.034407 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c31e2374-82ae-4248-8992-f8de20def935 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:41.034865 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c31e2374-82ae-4248-8992-f8de20def935 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:41.035717 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c31e2374-82ae-4248-8992-f8de20def935 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:41.038907 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c31e2374-82ae-4248-8992-f8de20def935 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:41.039501 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c31e2374-82ae-4248-8992-f8de20def935 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:41.205941 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c31e2374-82ae-4248-8992-f8de20def935 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:12:41.214423 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c31e2374-82ae-4248-8992-f8de20def935 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1697 microversion: 2.1 time: 0.192889 Sep 10 13:12:41.215345 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3865/7724] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:12:41 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1697 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:12:42.239731 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ec372d3b-97c3-41e2-b016-d1b31d7bb2f0 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:12:42.240608 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ec372d3b-97c3-41e2-b016-d1b31d7bb2f0 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:12:42.247928 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec372d3b-97c3-41e2-b016-d1b31d7bb2f0 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:42.248418 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec372d3b-97c3-41e2-b016-d1b31d7bb2f0 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:42.248852 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec372d3b-97c3-41e2-b016-d1b31d7bb2f0 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:42.250302 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec372d3b-97c3-41e2-b016-d1b31d7bb2f0 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:42.250792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec372d3b-97c3-41e2-b016-d1b31d7bb2f0 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:42.251350 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec372d3b-97c3-41e2-b016-d1b31d7bb2f0 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:42.398932 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ec372d3b-97c3-41e2-b016-d1b31d7bb2f0 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:12:42.407963 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ec372d3b-97c3-41e2-b016-d1b31d7bb2f0 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1697 microversion: 2.1 time: 0.172406 Sep 10 13:12:42.408556 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3860/7725] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:12:42 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1697 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:12:43.439535 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-b41c0450-d3dd-4954-8151-7753443f4e72 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:12:43.440851 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-b41c0450-d3dd-4954-8151-7753443f4e72 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:12:43.453612 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b41c0450-d3dd-4954-8151-7753443f4e72 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:43.454053 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b41c0450-d3dd-4954-8151-7753443f4e72 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:43.454515 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b41c0450-d3dd-4954-8151-7753443f4e72 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:43.455284 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b41c0450-d3dd-4954-8151-7753443f4e72 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:43.455756 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b41c0450-d3dd-4954-8151-7753443f4e72 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:43.456199 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-b41c0450-d3dd-4954-8151-7753443f4e72 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:43.629841 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-b41c0450-d3dd-4954-8151-7753443f4e72 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:12:43.631968 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-b41c0450-d3dd-4954-8151-7753443f4e72 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1697 microversion: 2.1 time: 0.197226 Sep 10 13:12:43.632806 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3866/7726] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:12:43 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1697 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:12:44.660048 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ed391180-829a-4cb9-a1b9-83f17ac65131 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:12:44.661638 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ed391180-829a-4cb9-a1b9-83f17ac65131 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:12:44.669213 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ed391180-829a-4cb9-a1b9-83f17ac65131 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:44.670041 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ed391180-829a-4cb9-a1b9-83f17ac65131 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:44.670687 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ed391180-829a-4cb9-a1b9-83f17ac65131 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:44.671902 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ed391180-829a-4cb9-a1b9-83f17ac65131 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:44.672372 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ed391180-829a-4cb9-a1b9-83f17ac65131 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:44.672799 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ed391180-829a-4cb9-a1b9-83f17ac65131 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:44.833302 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ed391180-829a-4cb9-a1b9-83f17ac65131 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:12:44.841447 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ed391180-829a-4cb9-a1b9-83f17ac65131 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1697 microversion: 2.1 time: 0.186136 Sep 10 13:12:44.842068 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3861/7727] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:12:44 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1697 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:12:45.870521 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c9363982-2bfa-479f-bf51-0bf71d4597fc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:12:45.871860 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c9363982-2bfa-479f-bf51-0bf71d4597fc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:12:45.879143 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9363982-2bfa-479f-bf51-0bf71d4597fc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:45.879680 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9363982-2bfa-479f-bf51-0bf71d4597fc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:45.880140 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9363982-2bfa-479f-bf51-0bf71d4597fc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:45.880863 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9363982-2bfa-479f-bf51-0bf71d4597fc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:45.881336 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9363982-2bfa-479f-bf51-0bf71d4597fc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:45.881782 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c9363982-2bfa-479f-bf51-0bf71d4597fc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:46.034046 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c9363982-2bfa-479f-bf51-0bf71d4597fc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:12:46.042748 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c9363982-2bfa-479f-bf51-0bf71d4597fc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1697 microversion: 2.1 time: 0.176207 Sep 10 13:12:46.043398 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3867/7728] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:12:45 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1697 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:12:47.067877 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f52f40df-651d-43aa-beec-16122a9256ca tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:12:47.068542 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f52f40df-651d-43aa-beec-16122a9256ca tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:12:47.075610 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f52f40df-651d-43aa-beec-16122a9256ca tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:47.076101 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f52f40df-651d-43aa-beec-16122a9256ca tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:47.076551 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f52f40df-651d-43aa-beec-16122a9256ca tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:47.077345 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f52f40df-651d-43aa-beec-16122a9256ca tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:47.077812 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f52f40df-651d-43aa-beec-16122a9256ca tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:47.078251 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f52f40df-651d-43aa-beec-16122a9256ca tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:47.222155 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f52f40df-651d-43aa-beec-16122a9256ca tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:12:47.229974 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f52f40df-651d-43aa-beec-16122a9256ca tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1697 microversion: 2.1 time: 0.165986 Sep 10 13:12:47.230542 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3862/7729] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:12:47 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1697 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:12:48.254510 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4b60b7d7-a344-4e3d-a59d-dcef9f02dc7a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:12:48.255148 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4b60b7d7-a344-4e3d-a59d-dcef9f02dc7a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:12:48.262147 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b60b7d7-a344-4e3d-a59d-dcef9f02dc7a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:48.262648 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b60b7d7-a344-4e3d-a59d-dcef9f02dc7a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:48.263109 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b60b7d7-a344-4e3d-a59d-dcef9f02dc7a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:48.263850 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b60b7d7-a344-4e3d-a59d-dcef9f02dc7a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:48.264321 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b60b7d7-a344-4e3d-a59d-dcef9f02dc7a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:48.266053 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4b60b7d7-a344-4e3d-a59d-dcef9f02dc7a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:48.398559 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4b60b7d7-a344-4e3d-a59d-dcef9f02dc7a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:12:48.406673 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4b60b7d7-a344-4e3d-a59d-dcef9f02dc7a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1679 microversion: 2.1 time: 0.156084 Sep 10 13:12:48.407281 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3868/7730] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:12:48 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:12:49.430856 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2dd88cea-c2b7-4e31-bffe-654b9d8daf59 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:12:49.431499 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2dd88cea-c2b7-4e31-bffe-654b9d8daf59 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:12:49.438924 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2dd88cea-c2b7-4e31-bffe-654b9d8daf59 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:49.439436 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2dd88cea-c2b7-4e31-bffe-654b9d8daf59 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:49.439873 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2dd88cea-c2b7-4e31-bffe-654b9d8daf59 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:49.440573 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2dd88cea-c2b7-4e31-bffe-654b9d8daf59 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:49.441027 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2dd88cea-c2b7-4e31-bffe-654b9d8daf59 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:49.441452 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2dd88cea-c2b7-4e31-bffe-654b9d8daf59 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:49.584983 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2dd88cea-c2b7-4e31-bffe-654b9d8daf59 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:12:49.592686 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2dd88cea-c2b7-4e31-bffe-654b9d8daf59 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1679 microversion: 2.1 time: 0.165781 Sep 10 13:12:49.593301 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3863/7731] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:12:49 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:12:50.294362 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-e23ae888-8ff8-4648-a832-d0de37279cbc req-3a7d905d-0402-40fa-a01f-3907fa6424ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53767d25-7062-4d84-bcb8-f0210e6ec50a", "name": "network-vif-unplugged", "status": "completed", "tag": "e333acbe-93c9-4c2a-a5d1-b4598ab67ea5"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:12:50.306482 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e23ae888-8ff8-4648-a832-d0de37279cbc req-3a7d905d-0402-40fa-a01f-3907fa6424ee service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:50.307054 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e23ae888-8ff8-4648-a832-d0de37279cbc req-3a7d905d-0402-40fa-a01f-3907fa6424ee service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:50.307930 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-e23ae888-8ff8-4648-a832-d0de37279cbc req-3a7d905d-0402-40fa-a01f-3907fa6424ee service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:50.320429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.compute.server_external_events [req-e23ae888-8ff8-4648-a832-d0de37279cbc req-3a7d905d-0402-40fa-a01f-3907fa6424ee service nova] Unable to find a host for instance 53767d25-7062-4d84-bcb8-f0210e6ec50a. Dropping event network-vif-unplugged {{(pid=128776) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 10 13:12:50.321331 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-e23ae888-8ff8-4648-a832-d0de37279cbc req-3a7d905d-0402-40fa-a01f-3907fa6424ee service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030967 Sep 10 13:12:50.322132 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3869/7732] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 10 13:12:50.616795 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4c235b72-ba4b-40d0-9b72-b9a0a50a5d60 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:12:50.617353 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4c235b72-ba4b-40d0-9b72-b9a0a50a5d60 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:12:50.624387 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4c235b72-ba4b-40d0-9b72-b9a0a50a5d60 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:50.624870 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4c235b72-ba4b-40d0-9b72-b9a0a50a5d60 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:50.625342 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4c235b72-ba4b-40d0-9b72-b9a0a50a5d60 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:50.626045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4c235b72-ba4b-40d0-9b72-b9a0a50a5d60 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:50.626498 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4c235b72-ba4b-40d0-9b72-b9a0a50a5d60 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:50.626928 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4c235b72-ba4b-40d0-9b72-b9a0a50a5d60 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:50.755769 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4c235b72-ba4b-40d0-9b72-b9a0a50a5d60 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:12:50.763597 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4c235b72-ba4b-40d0-9b72-b9a0a50a5d60 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1622 microversion: 2.1 time: 0.150689 Sep 10 13:12:50.764170 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3864/7733] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:12:50 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1622 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:12:50.787422 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8145ba35-32cf-438f-b8a2-629e1f881ebc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:12:50.788042 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8145ba35-32cf-438f-b8a2-629e1f881ebc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:12:50.794036 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8145ba35-32cf-438f-b8a2-629e1f881ebc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:50.794534 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8145ba35-32cf-438f-b8a2-629e1f881ebc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:50.795009 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8145ba35-32cf-438f-b8a2-629e1f881ebc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:50.795757 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8145ba35-32cf-438f-b8a2-629e1f881ebc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:50.796234 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8145ba35-32cf-438f-b8a2-629e1f881ebc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:50.796679 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8145ba35-32cf-438f-b8a2-629e1f881ebc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:50.837513 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8145ba35-32cf-438f-b8a2-629e1f881ebc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128776) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 10 13:12:50.904211 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8145ba35-32cf-438f-b8a2-629e1f881ebc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "POST /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a/action" status: 202 len: 0 microversion: 2.1 time: 0.120683 Sep 10 13:12:50.907967 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3870/7734] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 13:12:50 2022] POST /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 13:12:50.913170 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5b052b01-0458-4e00-888d-2de107db871f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:12:50.913792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5b052b01-0458-4e00-888d-2de107db871f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:12:50.919762 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5b052b01-0458-4e00-888d-2de107db871f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:50.920248 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5b052b01-0458-4e00-888d-2de107db871f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:50.920685 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5b052b01-0458-4e00-888d-2de107db871f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:50.921375 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5b052b01-0458-4e00-888d-2de107db871f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:50.921828 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5b052b01-0458-4e00-888d-2de107db871f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:50.922315 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5b052b01-0458-4e00-888d-2de107db871f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:51.070284 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5b052b01-0458-4e00-888d-2de107db871f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:12:51.078093 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5b052b01-0458-4e00-888d-2de107db871f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1630 microversion: 2.1 time: 0.168795 Sep 10 13:12:51.078652 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3865/7735] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:12:50 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1630 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:12:52.101873 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2d618034-0f87-437d-8dea-25368640b41f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:12:52.102460 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2d618034-0f87-437d-8dea-25368640b41f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:12:52.108525 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d618034-0f87-437d-8dea-25368640b41f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:52.109024 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d618034-0f87-437d-8dea-25368640b41f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:52.109480 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d618034-0f87-437d-8dea-25368640b41f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:52.110237 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d618034-0f87-437d-8dea-25368640b41f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:52.110712 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d618034-0f87-437d-8dea-25368640b41f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:52.111182 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2d618034-0f87-437d-8dea-25368640b41f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:52.246623 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2d618034-0f87-437d-8dea-25368640b41f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:12:52.255091 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2d618034-0f87-437d-8dea-25368640b41f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1688 microversion: 2.1 time: 0.158072 Sep 10 13:12:52.255702 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3871/7736] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:12:52 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:12:53.161179 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-86cb11e8-c6c1-4708-999e-5a5ceb3f8e3f req-7dad0c5e-18e9-4e00-9bb8-9b541f1ac8fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53767d25-7062-4d84-bcb8-f0210e6ec50a", "tag": "e333acbe-93c9-4c2a-a5d1-b4598ab67ea5"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:12:53.170668 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-86cb11e8-c6c1-4708-999e-5a5ceb3f8e3f req-7dad0c5e-18e9-4e00-9bb8-9b541f1ac8fe service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:53.171065 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-86cb11e8-c6c1-4708-999e-5a5ceb3f8e3f req-7dad0c5e-18e9-4e00-9bb8-9b541f1ac8fe service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:53.171526 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-86cb11e8-c6c1-4708-999e-5a5ceb3f8e3f req-7dad0c5e-18e9-4e00-9bb8-9b541f1ac8fe service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:53.184230 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-86cb11e8-c6c1-4708-999e-5a5ceb3f8e3f req-7dad0c5e-18e9-4e00-9bb8-9b541f1ac8fe service nova] Creating event network-changed:e333acbe-93c9-4c2a-a5d1-b4598ab67ea5 for instance 53767d25-7062-4d84-bcb8-f0210e6ec50a on n-h1-856895-1 Sep 10 13:12:53.189270 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-86cb11e8-c6c1-4708-999e-5a5ceb3f8e3f req-7dad0c5e-18e9-4e00-9bb8-9b541f1ac8fe service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099781 Sep 10 13:12:53.189905 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3866/7737] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:12:53.280340 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fc43a24d-42a4-4664-8231-92967d798f03 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:12:53.280993 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fc43a24d-42a4-4664-8231-92967d798f03 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:12:53.288539 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc43a24d-42a4-4664-8231-92967d798f03 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:53.289040 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc43a24d-42a4-4664-8231-92967d798f03 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:53.289490 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc43a24d-42a4-4664-8231-92967d798f03 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:53.290196 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc43a24d-42a4-4664-8231-92967d798f03 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:53.290664 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc43a24d-42a4-4664-8231-92967d798f03 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:53.291102 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fc43a24d-42a4-4664-8231-92967d798f03 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:53.432883 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-fc43a24d-42a4-4664-8231-92967d798f03 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:12:53.440830 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fc43a24d-42a4-4664-8231-92967d798f03 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1688 microversion: 2.1 time: 0.164377 Sep 10 13:12:53.441430 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3872/7738] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:12:53 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:12:54.466471 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-138f097e-4139-4a9d-a04a-0493a0cb371e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:12:54.467251 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-138f097e-4139-4a9d-a04a-0493a0cb371e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:12:54.474567 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-138f097e-4139-4a9d-a04a-0493a0cb371e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:54.475382 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-138f097e-4139-4a9d-a04a-0493a0cb371e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:54.476033 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-138f097e-4139-4a9d-a04a-0493a0cb371e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:54.476940 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-138f097e-4139-4a9d-a04a-0493a0cb371e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:54.477642 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-138f097e-4139-4a9d-a04a-0493a0cb371e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:54.478017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-138f097e-4139-4a9d-a04a-0493a0cb371e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:54.622017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-138f097e-4139-4a9d-a04a-0493a0cb371e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:12:54.626372 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:12:54.634199 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-138f097e-4139-4a9d-a04a-0493a0cb371e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1688 microversion: 2.1 time: 0.172707 Sep 10 13:12:54.634933 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3867/7739] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:12:54 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1688 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:12:55.661165 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d5d81d63-c167-4d4e-9bc1-3f0318ed0f5c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:12:55.661846 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d5d81d63-c167-4d4e-9bc1-3f0318ed0f5c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:12:55.669164 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d5d81d63-c167-4d4e-9bc1-3f0318ed0f5c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:55.670065 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d5d81d63-c167-4d4e-9bc1-3f0318ed0f5c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:55.670761 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d5d81d63-c167-4d4e-9bc1-3f0318ed0f5c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:55.671766 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d5d81d63-c167-4d4e-9bc1-3f0318ed0f5c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:55.672514 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d5d81d63-c167-4d4e-9bc1-3f0318ed0f5c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:55.673188 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d5d81d63-c167-4d4e-9bc1-3f0318ed0f5c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:55.689357 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:12:55.823880 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d5d81d63-c167-4d4e-9bc1-3f0318ed0f5c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:12:55.832653 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d5d81d63-c167-4d4e-9bc1-3f0318ed0f5c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1688 microversion: 2.1 time: 0.176158 Sep 10 13:12:55.833439 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3873/7740] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:12:55 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1688 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:12:56.857894 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-edaeb837-c4bd-46cf-b111-a91e10a3475e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:12:56.858855 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-edaeb837-c4bd-46cf-b111-a91e10a3475e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:12:56.864633 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=33 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:12:56.871497 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-edaeb837-c4bd-46cf-b111-a91e10a3475e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:56.871982 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-edaeb837-c4bd-46cf-b111-a91e10a3475e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:56.873570 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-edaeb837-c4bd-46cf-b111-a91e10a3475e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:56.874289 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-edaeb837-c4bd-46cf-b111-a91e10a3475e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:56.874743 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-edaeb837-c4bd-46cf-b111-a91e10a3475e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:56.875300 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-edaeb837-c4bd-46cf-b111-a91e10a3475e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:57.039896 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-edaeb837-c4bd-46cf-b111-a91e10a3475e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:12:57.048538 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-edaeb837-c4bd-46cf-b111-a91e10a3475e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1688 microversion: 2.1 time: 0.195993 Sep 10 13:12:57.049143 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3868/7741] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:12:56 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1688 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:12:58.072807 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d4ba0f37-1a1f-41b2-b2db-877a0ee2fa26 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:12:58.073521 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d4ba0f37-1a1f-41b2-b2db-877a0ee2fa26 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:12:58.075651 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:12:58.082369 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d4ba0f37-1a1f-41b2-b2db-877a0ee2fa26 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:58.082919 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d4ba0f37-1a1f-41b2-b2db-877a0ee2fa26 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:58.083387 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d4ba0f37-1a1f-41b2-b2db-877a0ee2fa26 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:58.084104 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d4ba0f37-1a1f-41b2-b2db-877a0ee2fa26 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:58.084577 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d4ba0f37-1a1f-41b2-b2db-877a0ee2fa26 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:58.085026 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d4ba0f37-1a1f-41b2-b2db-877a0ee2fa26 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:58.230330 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d4ba0f37-1a1f-41b2-b2db-877a0ee2fa26 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:12:58.246864 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d4ba0f37-1a1f-41b2-b2db-877a0ee2fa26 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1688 microversion: 2.1 time: 0.178054 Sep 10 13:12:58.251310 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3874/7742] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:12:58 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1688 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:12:59.275134 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d27d4755-6227-443b-837d-f9531fe0dab7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:12:59.275793 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d27d4755-6227-443b-837d-f9531fe0dab7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:12:59.284350 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d27d4755-6227-443b-837d-f9531fe0dab7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:59.284840 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d27d4755-6227-443b-837d-f9531fe0dab7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:59.285271 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d27d4755-6227-443b-837d-f9531fe0dab7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:59.285972 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d27d4755-6227-443b-837d-f9531fe0dab7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:12:59.286501 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d27d4755-6227-443b-837d-f9531fe0dab7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:12:59.286934 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d27d4755-6227-443b-837d-f9531fe0dab7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:12:59.433224 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d27d4755-6227-443b-837d-f9531fe0dab7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:12:59.441350 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d27d4755-6227-443b-837d-f9531fe0dab7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1688 microversion: 2.1 time: 0.170067 Sep 10 13:12:59.442161 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3869/7743] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:12:59 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1688 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:13:00.466280 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ff4971de-3a5c-46b5-92e9-b4b656d41f2a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:13:00.466917 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ff4971de-3a5c-46b5-92e9-b4b656d41f2a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:13:00.474875 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff4971de-3a5c-46b5-92e9-b4b656d41f2a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:13:00.475530 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff4971de-3a5c-46b5-92e9-b4b656d41f2a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:13:00.476052 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff4971de-3a5c-46b5-92e9-b4b656d41f2a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:13:00.477016 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff4971de-3a5c-46b5-92e9-b4b656d41f2a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:13:00.477568 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff4971de-3a5c-46b5-92e9-b4b656d41f2a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:13:00.478078 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ff4971de-3a5c-46b5-92e9-b4b656d41f2a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:13:00.646226 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ff4971de-3a5c-46b5-92e9-b4b656d41f2a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:13:00.654751 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ff4971de-3a5c-46b5-92e9-b4b656d41f2a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1688 microversion: 2.1 time: 0.192471 Sep 10 13:13:00.655379 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3875/7744] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:13:00 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1688 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:13:01.679609 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c1d62be6-a0b7-40d7-a625-c76c1868ed20 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:13:01.680264 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c1d62be6-a0b7-40d7-a625-c76c1868ed20 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:13:01.688196 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1d62be6-a0b7-40d7-a625-c76c1868ed20 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:13:01.688826 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1d62be6-a0b7-40d7-a625-c76c1868ed20 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:13:01.689398 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1d62be6-a0b7-40d7-a625-c76c1868ed20 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:13:01.690132 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1d62be6-a0b7-40d7-a625-c76c1868ed20 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:13:01.690616 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1d62be6-a0b7-40d7-a625-c76c1868ed20 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:13:01.691050 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c1d62be6-a0b7-40d7-a625-c76c1868ed20 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:13:01.828023 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c1d62be6-a0b7-40d7-a625-c76c1868ed20 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:13:01.836374 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c1d62be6-a0b7-40d7-a625-c76c1868ed20 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1688 microversion: 2.1 time: 0.160812 Sep 10 13:13:01.836946 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3870/7745] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:13:01 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:13:02.860577 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7e45ea6a-8f10-47dc-a279-a33ba8025575 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:13:02.861242 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7e45ea6a-8f10-47dc-a279-a33ba8025575 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:13:02.868203 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7e45ea6a-8f10-47dc-a279-a33ba8025575 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:13:02.868703 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7e45ea6a-8f10-47dc-a279-a33ba8025575 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:13:02.869158 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7e45ea6a-8f10-47dc-a279-a33ba8025575 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:13:02.869868 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7e45ea6a-8f10-47dc-a279-a33ba8025575 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:13:02.870344 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7e45ea6a-8f10-47dc-a279-a33ba8025575 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:13:02.870792 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7e45ea6a-8f10-47dc-a279-a33ba8025575 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:13:03.004945 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7e45ea6a-8f10-47dc-a279-a33ba8025575 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:13:03.012790 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7e45ea6a-8f10-47dc-a279-a33ba8025575 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1688 microversion: 2.1 time: 0.156222 Sep 10 13:13:03.013364 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3876/7746] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:13:02 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:13:04.036982 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-140ed8e1-2e03-4013-9685-dffb98560d61 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:13:04.037597 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-140ed8e1-2e03-4013-9685-dffb98560d61 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:13:04.044595 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-140ed8e1-2e03-4013-9685-dffb98560d61 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:13:04.045081 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-140ed8e1-2e03-4013-9685-dffb98560d61 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:13:04.045521 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-140ed8e1-2e03-4013-9685-dffb98560d61 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:13:04.046212 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-140ed8e1-2e03-4013-9685-dffb98560d61 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:13:04.046669 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-140ed8e1-2e03-4013-9685-dffb98560d61 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:13:04.047099 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-140ed8e1-2e03-4013-9685-dffb98560d61 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:13:04.184137 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-140ed8e1-2e03-4013-9685-dffb98560d61 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:13:04.192378 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-140ed8e1-2e03-4013-9685-dffb98560d61 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1688 microversion: 2.1 time: 0.159321 Sep 10 13:13:04.192957 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3871/7747] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:13:04 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 13:13:05.215481 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-ce3803fa-337d-401d-8b5f-034357c4f12e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:13:05.216117 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-ce3803fa-337d-401d-8b5f-034357c4f12e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:13:05.223416 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ce3803fa-337d-401d-8b5f-034357c4f12e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:13:05.223919 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ce3803fa-337d-401d-8b5f-034357c4f12e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:13:05.224374 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ce3803fa-337d-401d-8b5f-034357c4f12e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:13:05.225086 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ce3803fa-337d-401d-8b5f-034357c4f12e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:13:05.225556 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ce3803fa-337d-401d-8b5f-034357c4f12e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:13:05.225996 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-ce3803fa-337d-401d-8b5f-034357c4f12e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:13:05.360679 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-ce3803fa-337d-401d-8b5f-034357c4f12e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:13:05.368423 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-ce3803fa-337d-401d-8b5f-034357c4f12e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1688 microversion: 2.1 time: 0.156893 Sep 10 13:13:05.369000 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3877/7748] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:13:05 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:13:06.394184 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-89c262a7-b49a-4767-87ee-305cad815bbf tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:13:06.394733 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-89c262a7-b49a-4767-87ee-305cad815bbf tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:13:06.401495 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-89c262a7-b49a-4767-87ee-305cad815bbf tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:13:06.401975 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-89c262a7-b49a-4767-87ee-305cad815bbf tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:13:06.402409 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-89c262a7-b49a-4767-87ee-305cad815bbf tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:13:06.403092 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-89c262a7-b49a-4767-87ee-305cad815bbf tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:13:06.403567 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-89c262a7-b49a-4767-87ee-305cad815bbf tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:13:06.403993 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-89c262a7-b49a-4767-87ee-305cad815bbf tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:13:06.535919 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-89c262a7-b49a-4767-87ee-305cad815bbf tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:13:06.543817 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-89c262a7-b49a-4767-87ee-305cad815bbf tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1688 microversion: 2.1 time: 0.154939 Sep 10 13:13:06.544394 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3872/7749] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:13:06 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:13:07.568307 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-90cdd7d2-9f82-4cc6-9594-592a0394b678 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:13:07.568869 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-90cdd7d2-9f82-4cc6-9594-592a0394b678 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:13:07.575721 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90cdd7d2-9f82-4cc6-9594-592a0394b678 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:13:07.576198 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90cdd7d2-9f82-4cc6-9594-592a0394b678 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:13:07.576643 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90cdd7d2-9f82-4cc6-9594-592a0394b678 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:13:07.577347 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90cdd7d2-9f82-4cc6-9594-592a0394b678 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:13:07.577813 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90cdd7d2-9f82-4cc6-9594-592a0394b678 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:13:07.578386 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-90cdd7d2-9f82-4cc6-9594-592a0394b678 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:13:07.715613 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-90cdd7d2-9f82-4cc6-9594-592a0394b678 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:13:07.723505 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-90cdd7d2-9f82-4cc6-9594-592a0394b678 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1688 microversion: 2.1 time: 0.159329 Sep 10 13:13:07.724090 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3878/7750] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:13:07 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:13:08.747530 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-33229ab2-4da9-42e8-a6dd-cc274f8c6a26 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:13:08.748077 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-33229ab2-4da9-42e8-a6dd-cc274f8c6a26 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:13:08.755466 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-33229ab2-4da9-42e8-a6dd-cc274f8c6a26 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:13:08.755950 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-33229ab2-4da9-42e8-a6dd-cc274f8c6a26 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:13:08.756383 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-33229ab2-4da9-42e8-a6dd-cc274f8c6a26 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:13:08.757066 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-33229ab2-4da9-42e8-a6dd-cc274f8c6a26 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:13:08.757517 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-33229ab2-4da9-42e8-a6dd-cc274f8c6a26 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:13:08.757938 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-33229ab2-4da9-42e8-a6dd-cc274f8c6a26 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:13:08.889945 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-33229ab2-4da9-42e8-a6dd-cc274f8c6a26 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:13:08.898929 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-33229ab2-4da9-42e8-a6dd-cc274f8c6a26 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1688 microversion: 2.1 time: 0.155467 Sep 10 13:13:08.899531 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3873/7751] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:13:08 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:13:09.922612 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-232597b2-8b42-4a01-a55e-77deb2ad21f2 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:13:09.923275 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-232597b2-8b42-4a01-a55e-77deb2ad21f2 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:13:09.930900 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-232597b2-8b42-4a01-a55e-77deb2ad21f2 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:13:09.931441 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-232597b2-8b42-4a01-a55e-77deb2ad21f2 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:13:09.931900 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-232597b2-8b42-4a01-a55e-77deb2ad21f2 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:13:09.932623 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-232597b2-8b42-4a01-a55e-77deb2ad21f2 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:13:09.933093 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-232597b2-8b42-4a01-a55e-77deb2ad21f2 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:13:09.933559 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-232597b2-8b42-4a01-a55e-77deb2ad21f2 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:13:10.045501 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-41b76fa8-8ff7-406e-82ad-231a9c21275a req-030da5c4-eace-44dd-bbb0-121f075879ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53767d25-7062-4d84-bcb8-f0210e6ec50a", "name": "network-vif-plugged", "status": "completed", "tag": "e333acbe-93c9-4c2a-a5d1-b4598ab67ea5"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:13:10.057707 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-41b76fa8-8ff7-406e-82ad-231a9c21275a req-030da5c4-eace-44dd-bbb0-121f075879ac service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:13:10.058499 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-41b76fa8-8ff7-406e-82ad-231a9c21275a req-030da5c4-eace-44dd-bbb0-121f075879ac service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:13:10.059195 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-41b76fa8-8ff7-406e-82ad-231a9c21275a req-030da5c4-eace-44dd-bbb0-121f075879ac service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:13:10.073214 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-232597b2-8b42-4a01-a55e-77deb2ad21f2 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:13:10.075041 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-41b76fa8-8ff7-406e-82ad-231a9c21275a req-030da5c4-eace-44dd-bbb0-121f075879ac service nova] Creating event network-vif-plugged:e333acbe-93c9-4c2a-a5d1-b4598ab67ea5 for instance 53767d25-7062-4d84-bcb8-f0210e6ec50a on n-h1-856895-1 Sep 10 13:13:10.081959 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-41b76fa8-8ff7-406e-82ad-231a9c21275a req-030da5c4-eace-44dd-bbb0-121f075879ac service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040195 Sep 10 13:13:10.082871 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3874/7752] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 13:13:10.084929 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-232597b2-8b42-4a01-a55e-77deb2ad21f2 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1688 microversion: 2.1 time: 0.166247 Sep 10 13:13:10.085791 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3879/7753] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:13:09 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:13:11.110757 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2cdd17f1-173d-453c-9eb8-8cedf17fcceb tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:13:11.111491 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2cdd17f1-173d-453c-9eb8-8cedf17fcceb tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:13:11.117803 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2cdd17f1-173d-453c-9eb8-8cedf17fcceb tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:13:11.118288 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2cdd17f1-173d-453c-9eb8-8cedf17fcceb tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:13:11.118723 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2cdd17f1-173d-453c-9eb8-8cedf17fcceb tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:13:11.119442 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2cdd17f1-173d-453c-9eb8-8cedf17fcceb tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:13:11.119895 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2cdd17f1-173d-453c-9eb8-8cedf17fcceb tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:13:11.120317 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2cdd17f1-173d-453c-9eb8-8cedf17fcceb tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:13:11.253960 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2cdd17f1-173d-453c-9eb8-8cedf17fcceb tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:13:11.261691 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2cdd17f1-173d-453c-9eb8-8cedf17fcceb tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1688 microversion: 2.1 time: 0.156722 Sep 10 13:13:11.262266 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3875/7754] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:13:11 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:13:12.285749 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-26ff2316-5646-46d2-a239-dda100ca8a24 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:13:12.286377 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-26ff2316-5646-46d2-a239-dda100ca8a24 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:13:12.293386 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-26ff2316-5646-46d2-a239-dda100ca8a24 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:13:12.293880 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-26ff2316-5646-46d2-a239-dda100ca8a24 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:13:12.294329 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-26ff2316-5646-46d2-a239-dda100ca8a24 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:13:12.295033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-26ff2316-5646-46d2-a239-dda100ca8a24 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:13:12.295529 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-26ff2316-5646-46d2-a239-dda100ca8a24 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:13:12.295973 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-26ff2316-5646-46d2-a239-dda100ca8a24 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:13:12.434974 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-26ff2316-5646-46d2-a239-dda100ca8a24 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:13:12.442891 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-26ff2316-5646-46d2-a239-dda100ca8a24 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1675 microversion: 2.1 time: 0.161166 Sep 10 13:13:12.443497 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3880/7755] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:13:12 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:14:49.945395 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=15 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:14:49.946341 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=44 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:14:49.948749 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=13 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:14:49.949524 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=45 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:14:49.950346 n-d-856895-1 devstack@n-api.service[128776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 13:14:49.950568 n-d-856895-1 devstack@n-api.service[128776]: Sat Sep 10 13:14:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.23) !!! Sep 10 13:14:49.954414 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-28cb213e-49bf-4a74-8c7b-d55d09aefa0b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:14:49.954893 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-28cb213e-49bf-4a74-8c7b-d55d09aefa0b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:14:49.969863 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28cb213e-49bf-4a74-8c7b-d55d09aefa0b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:14:49.970373 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28cb213e-49bf-4a74-8c7b-d55d09aefa0b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:14:49.970803 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28cb213e-49bf-4a74-8c7b-d55d09aefa0b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:14:49.971547 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28cb213e-49bf-4a74-8c7b-d55d09aefa0b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:14:49.972004 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28cb213e-49bf-4a74-8c7b-d55d09aefa0b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:14:49.972437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-28cb213e-49bf-4a74-8c7b-d55d09aefa0b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:14:50.000611 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-28cb213e-49bf-4a74-8c7b-d55d09aefa0b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 13:14:50.023319 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-fe4461eb-949a-4caf-a8a0-7572a462b25b req-023ab472-c686-48ff-8c35-ef1d48c56c8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53767d25-7062-4d84-bcb8-f0210e6ec50a", "tag": "e333acbe-93c9-4c2a-a5d1-b4598ab67ea5"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:14:50.033575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-fe4461eb-949a-4caf-a8a0-7572a462b25b req-023ab472-c686-48ff-8c35-ef1d48c56c8d service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:14:50.034084 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-fe4461eb-949a-4caf-a8a0-7572a462b25b req-023ab472-c686-48ff-8c35-ef1d48c56c8d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:14:50.034552 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-fe4461eb-949a-4caf-a8a0-7572a462b25b req-023ab472-c686-48ff-8c35-ef1d48c56c8d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:14:50.046763 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-fe4461eb-949a-4caf-a8a0-7572a462b25b req-023ab472-c686-48ff-8c35-ef1d48c56c8d service nova] Creating event network-changed:e333acbe-93c9-4c2a-a5d1-b4598ab67ea5 for instance 53767d25-7062-4d84-bcb8-f0210e6ec50a on n-h1-856895-1 Sep 10 13:14:50.052975 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-fe4461eb-949a-4caf-a8a0-7572a462b25b req-023ab472-c686-48ff-8c35-ef1d48c56c8d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106120 Sep 10 13:14:50.053895 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3881/7756] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:14:50.084099 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-28cb213e-49bf-4a74-8c7b-d55d09aefa0b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "DELETE /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 204 len: 0 microversion: 2.1 time: 0.140559 Sep 10 13:14:50.084704 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3876/7757] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 13:14:49 2022] DELETE /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 13:14:50.095125 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1764709e-f66a-4914-938a-23179afc317c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:14:50.103527 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1764709e-f66a-4914-938a-23179afc317c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:14:50.135930 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1764709e-f66a-4914-938a-23179afc317c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:14:50.136876 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1764709e-f66a-4914-938a-23179afc317c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:14:50.137159 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1764709e-f66a-4914-938a-23179afc317c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:14:50.137967 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1764709e-f66a-4914-938a-23179afc317c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:14:50.139301 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1764709e-f66a-4914-938a-23179afc317c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:14:50.139917 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1764709e-f66a-4914-938a-23179afc317c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:14:50.337931 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1764709e-f66a-4914-938a-23179afc317c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:14:50.346541 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1764709e-f66a-4914-938a-23179afc317c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1681 microversion: 2.1 time: 0.255774 Sep 10 13:14:50.347125 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3882/7758] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:14:50 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1681 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:14:51.371854 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f6b80b9f-da35-4e71-a510-3556e856e241 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:14:51.373201 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f6b80b9f-da35-4e71-a510-3556e856e241 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:14:51.384626 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f6b80b9f-da35-4e71-a510-3556e856e241 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:14:51.385119 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f6b80b9f-da35-4e71-a510-3556e856e241 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:14:51.385554 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f6b80b9f-da35-4e71-a510-3556e856e241 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:14:51.386252 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f6b80b9f-da35-4e71-a510-3556e856e241 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:14:51.386710 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f6b80b9f-da35-4e71-a510-3556e856e241 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:14:51.387267 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f6b80b9f-da35-4e71-a510-3556e856e241 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:14:51.574800 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f6b80b9f-da35-4e71-a510-3556e856e241 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:14:51.583084 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f6b80b9f-da35-4e71-a510-3556e856e241 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1681 microversion: 2.1 time: 0.215544 Sep 10 13:14:51.583685 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3877/7759] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:14:51 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1681 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:14:52.228244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-7b3426d6-3a77-4c51-9f80-515ef5c5fff3 req-415af1df-36d9-4487-afe4-8e5a3300ad26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53767d25-7062-4d84-bcb8-f0210e6ec50a", "name": "network-vif-deleted", "tag": "e333acbe-93c9-4c2a-a5d1-b4598ab67ea5"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:14:52.241877 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-7b3426d6-3a77-4c51-9f80-515ef5c5fff3 req-415af1df-36d9-4487-afe4-8e5a3300ad26 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:14:52.242382 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-7b3426d6-3a77-4c51-9f80-515ef5c5fff3 req-415af1df-36d9-4487-afe4-8e5a3300ad26 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:14:52.242836 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-7b3426d6-3a77-4c51-9f80-515ef5c5fff3 req-415af1df-36d9-4487-afe4-8e5a3300ad26 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:14:52.255245 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-7b3426d6-3a77-4c51-9f80-515ef5c5fff3 req-415af1df-36d9-4487-afe4-8e5a3300ad26 service nova] Creating event network-vif-deleted:e333acbe-93c9-4c2a-a5d1-b4598ab67ea5 for instance 53767d25-7062-4d84-bcb8-f0210e6ec50a on n-h1-856895-1 Sep 10 13:14:52.260259 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-7b3426d6-3a77-4c51-9f80-515ef5c5fff3 req-415af1df-36d9-4487-afe4-8e5a3300ad26 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035710 Sep 10 13:14:52.260855 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3883/7760] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:14:52.608193 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ec375d55-000a-41ee-988b-b6ffca0cdfb7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:14:52.608850 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ec375d55-000a-41ee-988b-b6ffca0cdfb7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:14:52.616052 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec375d55-000a-41ee-988b-b6ffca0cdfb7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:14:52.616541 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec375d55-000a-41ee-988b-b6ffca0cdfb7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:14:52.616972 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec375d55-000a-41ee-988b-b6ffca0cdfb7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:14:52.617670 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec375d55-000a-41ee-988b-b6ffca0cdfb7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:14:52.618121 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec375d55-000a-41ee-988b-b6ffca0cdfb7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:14:52.618546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec375d55-000a-41ee-988b-b6ffca0cdfb7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:14:52.653468 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec375d55-000a-41ee-988b-b6ffca0cdfb7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:14:52.653971 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec375d55-000a-41ee-988b-b6ffca0cdfb7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:14:52.654404 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ec375d55-000a-41ee-988b-b6ffca0cdfb7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:14:52.654854 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-ec375d55-000a-41ee-988b-b6ffca0cdfb7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lazy-loading 'fault' on Instance uuid 53767d25-7062-4d84-bcb8-f0210e6ec50a {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 13:14:52.698474 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ec375d55-000a-41ee-988b-b6ffca0cdfb7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:14:52.708214 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ec375d55-000a-41ee-988b-b6ffca0cdfb7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 200 len: 1336 microversion: 2.1 time: 0.104305 Sep 10 13:14:52.708802 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3878/7761] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:14:52 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 1336 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:14:53.733674 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fa7416f2-d5ab-4d3e-ba9c-dbf63a95ff3c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:14:53.734394 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-fa7416f2-d5ab-4d3e-ba9c-dbf63a95ff3c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 53767d25-7062-4d84-bcb8-f0210e6ec50a] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:14:53.740625 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa7416f2-d5ab-4d3e-ba9c-dbf63a95ff3c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:14:53.741099 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa7416f2-d5ab-4d3e-ba9c-dbf63a95ff3c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:14:53.741553 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa7416f2-d5ab-4d3e-ba9c-dbf63a95ff3c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:14:53.742257 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa7416f2-d5ab-4d3e-ba9c-dbf63a95ff3c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:14:53.742723 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa7416f2-d5ab-4d3e-ba9c-dbf63a95ff3c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:14:53.743187 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-fa7416f2-d5ab-4d3e-ba9c-dbf63a95ff3c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:14:53.756606 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-fa7416f2-d5ab-4d3e-ba9c-dbf63a95ff3c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] HTTP exception thrown: Instance 53767d25-7062-4d84-bcb8-f0210e6ec50a could not be found. Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fa7416f2-d5ab-4d3e-ba9c-dbf63a95ff3c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Request method failure captured: Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a HTTP/1.1 Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHIyx08eUlRvO5hlhBGEmrI0cL-28zmFuLb0huTx7RNf5PPYn6dsFCSUWgwz0IlPqNlxY7llgDLYJw2Nx0UkzgIeF11U5CKjT8HUYV0_80OOCvuJ0ExncWSFS52G-Akn7xhaE4USU6HiLcv-H6veCOFTkQ9jZvPz678ENrRIxhAmDX7E Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: 85beefd475294c0581b222a74f700236 Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-TestShelveInstance-66494582 Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/85beefd475294c0581b222a74f700236"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/85beefd475294c0581b222a74f700236"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_85beefd475294c0581b222a74f700236", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/85beefd475294c0581b222a74f700236"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-TestShelveInstance-66494582 Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: 85beefd475294c0581b222a74f700236 Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-TestShelveInstance-66494582 Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-TestShelveInstance-66494582-project Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: da2e2041df59456d80ea0a6bd8b384bd Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-TestShelveInstance-66494582-project Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance 53767d25-7062-4d84-bcb8-f0210e6ec50a could not be found. Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': '53767d25-7062-4d84-bcb8-f0210e6ec50a'} Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53767d25-7062-4d84-bcb8-f0210e6ec50a could not be found. Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53767d25-7062-4d84-bcb8-f0210e6ec50a could not be found. Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 13:14:53.758299 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 13:14:53.763600 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 13:14:53.763600 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 13:14:53.763600 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 13:14:53.763600 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 13:14:53.763600 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 13:14:53.763600 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53767d25-7062-4d84-bcb8-f0210e6ec50a could not be found. Sep 10 13:14:53.763600 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 13:14:53.763600 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-fa7416f2-d5ab-4d3e-ba9c-dbf63a95ff3c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Returning 404 to user: Instance 53767d25-7062-4d84-bcb8-f0210e6ec50a could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 13:14:53.763600 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-fa7416f2-d5ab-4d3e-ba9c-dbf63a95ff3c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a" status: 404 len: 111 microversion: 2.1 time: 0.031379 Sep 10 13:14:53.763600 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3884/7762] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:14:53 2022] GET /compute/v2.1/servers/53767d25-7062-4d84-bcb8-f0210e6ec50a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 13:14:53.928225 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-cad4d1b3-069c-4213-96b9-0fb902629660 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '.version_select at 0x7f4071b32c10>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:14:53.954956 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-cad4d1b3-069c-4213-96b9-0fb902629660 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-821132416" status: 202 len: 0 microversion: 2.1 time: 0.030533 Sep 10 13:14:53.955649 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3879/7763] 10.222.0.23 () {58 vars in 1251 bytes} [Sat Sep 10 13:14:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-821132416 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 13:14:53.980279 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1869bb71-8981-49f2-88bb-fad424087fcd tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Action: 'create', calling method: .version_select at 0x7f40733f6e50>, body: {"keypair": {"name": "tempest-TestShelveInstance-59845812", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwccm3Jl0lgliysNeh/NMl+bNOETjXjZoRd6hAFSyurb1p/DPW4pDqcXRnzxX1glOAGpJCZGAsdIfBEp32YmNkAerzdpPD9sRr24Q0r2rzN+fCE3VOM9V2sojz+mdSppQ=="}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:14:53.996165 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-1869bb71-8981-49f2-88bb-fad424087fcd tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Getting quotas for project 85beefd475294c0581b222a74f700236. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 13:14:54.002790 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-1869bb71-8981-49f2-88bb-fad424087fcd tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Getting quotas for user da2e2041df59456d80ea0a6bd8b384bd and project 85beefd475294c0581b222a74f700236. Resources: {'key_pairs'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 13:14:54.031990 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1869bb71-8981-49f2-88bb-fad424087fcd tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.055672 Sep 10 13:14:54.032594 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3885/7764] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 13:14:53 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:15:10.219397 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-59976c01-0280-4e08-b052-da0fca725abc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1112366800", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-59845812", "security_groups": [{"name": "tempest-secgroup-smoke-1272427030"}], "networks": [{"uuid": "035af43a-756e-4566-9d78-c55b9b539179"}], "block_device_mapping_v2": [{"uuid": "960a9e99-eae2-4500-9425-c44cd54aec6a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:15:10.231001 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:15:10.231661 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:15:10.335025 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.network.neutron [None req-59976c01-0280-4e08-b052-da0fca725abc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] validate_networks() for [('035af43a-756e-4566-9d78-c55b9b539179', None, None, None, None, None)] {{(pid=128777) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 13:15:10.752437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-59976c01-0280-4e08-b052-da0fca725abc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Flavor limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 13:15:10.752864 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-59976c01-0280-4e08-b052-da0fca725abc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Image limits 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 13:15:10.753338 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-59976c01-0280-4e08-b052-da0fca725abc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Flavor pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 13:15:10.753779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-59976c01-0280-4e08-b052-da0fca725abc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Image pref 0:0:0 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 13:15:10.754191 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.virt.hardware [None req-59976c01-0280-4e08-b052-da0fca725abc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 13:15:10.763045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59976c01-0280-4e08-b052-da0fca725abc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:15:10.763618 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59976c01-0280-4e08-b052-da0fca725abc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:15:10.764053 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59976c01-0280-4e08-b052-da0fca725abc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:15:10.764779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59976c01-0280-4e08-b052-da0fca725abc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:15:10.766160 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59976c01-0280-4e08-b052-da0fca725abc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:15:10.766857 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-59976c01-0280-4e08-b052-da0fca725abc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:15:10.783814 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-59976c01-0280-4e08-b052-da0fca725abc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Getting quotas for project 85beefd475294c0581b222a74f700236. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 13:15:10.789083 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-59976c01-0280-4e08-b052-da0fca725abc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Getting quotas for user da2e2041df59456d80ea0a6bd8b384bd and project 85beefd475294c0581b222a74f700236. Resources: {'instances', 'ram', 'cores'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 13:15:10.847471 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-59976c01-0280-4e08-b052-da0fca725abc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Going to run 1 instances... {{(pid=128777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 13:15:10.849778 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-59976c01-0280-4e08-b052-da0fca725abc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='960a9e99-eae2-4500-9425-c44cd54aec6a',volume_size=None,volume_type=None)] {{(pid=128777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 13:15:10.978298 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-59976c01-0280-4e08-b052-da0fca725abc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.764322 Sep 10 13:15:10.978961 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3880/7765] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 13:15:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 13:15:10.989815 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=12 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:15:10.990771 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=4 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:15:10.991510 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:15:10.995888 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d649f757-1197-4fd4-a9ae-c108cff6d06d tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:15:10.996531 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d649f757-1197-4fd4-a9ae-c108cff6d06d tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:15:11.054405 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d649f757-1197-4fd4-a9ae-c108cff6d06d tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:15:11.061504 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d649f757-1197-4fd4-a9ae-c108cff6d06d tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1087 microversion: 2.1 time: 0.073787 Sep 10 13:15:11.063198 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3886/7766] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:15:10 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1087 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 13:15:12.087895 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-a419a8fb-0c2b-4f4a-8874-68a1e0673cfa tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:15:12.089666 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-a419a8fb-0c2b-4f4a-8874-68a1e0673cfa tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:15:12.096265 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a419a8fb-0c2b-4f4a-8874-68a1e0673cfa tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:15:12.096757 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a419a8fb-0c2b-4f4a-8874-68a1e0673cfa tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:15:12.097194 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a419a8fb-0c2b-4f4a-8874-68a1e0673cfa tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:15:12.098229 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a419a8fb-0c2b-4f4a-8874-68a1e0673cfa tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:15:12.098690 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a419a8fb-0c2b-4f4a-8874-68a1e0673cfa tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:15:12.099118 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-a419a8fb-0c2b-4f4a-8874-68a1e0673cfa tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:15:12.183746 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-a419a8fb-0c2b-4f4a-8874-68a1e0673cfa tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:15:12.192347 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-a419a8fb-0c2b-4f4a-8874-68a1e0673cfa tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1203 microversion: 2.1 time: 0.109650 Sep 10 13:15:12.199586 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3881/7767] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:15:12 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1203 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:15:13.275132 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-06020bc5-6a43-42b3-92fa-2d3344204a7a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:15:13.275800 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-06020bc5-6a43-42b3-92fa-2d3344204a7a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:15:13.284411 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-06020bc5-6a43-42b3-92fa-2d3344204a7a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:15:13.285196 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-06020bc5-6a43-42b3-92fa-2d3344204a7a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:15:13.285659 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-06020bc5-6a43-42b3-92fa-2d3344204a7a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:15:13.286382 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-06020bc5-6a43-42b3-92fa-2d3344204a7a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:15:13.286859 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-06020bc5-6a43-42b3-92fa-2d3344204a7a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:15:13.287337 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-06020bc5-6a43-42b3-92fa-2d3344204a7a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:15:13.430313 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-06020bc5-6a43-42b3-92fa-2d3344204a7a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:15:13.439556 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-06020bc5-6a43-42b3-92fa-2d3344204a7a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1271 microversion: 2.1 time: 0.225410 Sep 10 13:15:13.440929 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3887/7768] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:15:13 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1271 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:15:13.478288 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-52958b3a-cc98-4057-a9fa-a4ae15860bf1 req-6e9811b0-cabf-45db-b824-4c82168a6445 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c19d476-fd8c-4883-b4fa-0090567ba91d", "tag": "d99b1fb6-ef7f-492e-96cd-70fa2b0bd2c4"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:15:13.492592 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-52958b3a-cc98-4057-a9fa-a4ae15860bf1 req-6e9811b0-cabf-45db-b824-4c82168a6445 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:15:13.493315 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-52958b3a-cc98-4057-a9fa-a4ae15860bf1 req-6e9811b0-cabf-45db-b824-4c82168a6445 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:15:13.493821 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-52958b3a-cc98-4057-a9fa-a4ae15860bf1 req-6e9811b0-cabf-45db-b824-4c82168a6445 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:15:13.508531 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-52958b3a-cc98-4057-a9fa-a4ae15860bf1 req-6e9811b0-cabf-45db-b824-4c82168a6445 service nova] Creating event network-changed:d99b1fb6-ef7f-492e-96cd-70fa2b0bd2c4 for instance 7c19d476-fd8c-4883-b4fa-0090567ba91d on n-h2-856895-1 Sep 10 13:15:13.513864 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-52958b3a-cc98-4057-a9fa-a4ae15860bf1 req-6e9811b0-cabf-45db-b824-4c82168a6445 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039551 Sep 10 13:15:13.514576 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3882/7769] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:15:14.465095 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7bc345ac-d7f3-4391-80bf-48ce56b7a8ad tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:15:14.465722 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7bc345ac-d7f3-4391-80bf-48ce56b7a8ad tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:15:14.474247 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7bc345ac-d7f3-4391-80bf-48ce56b7a8ad tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:15:14.474758 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7bc345ac-d7f3-4391-80bf-48ce56b7a8ad tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:15:14.475244 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7bc345ac-d7f3-4391-80bf-48ce56b7a8ad tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:15:14.475974 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7bc345ac-d7f3-4391-80bf-48ce56b7a8ad tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:15:14.476446 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7bc345ac-d7f3-4391-80bf-48ce56b7a8ad tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:15:14.477051 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7bc345ac-d7f3-4391-80bf-48ce56b7a8ad tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:15:14.614685 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7bc345ac-d7f3-4391-80bf-48ce56b7a8ad tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:15:14.622516 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7bc345ac-d7f3-4391-80bf-48ce56b7a8ad tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1271 microversion: 2.1 time: 0.161436 Sep 10 13:15:14.623125 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3888/7770] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:15:14 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1271 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:15:15.646335 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-aa9a2afc-8e6a-4392-a7c6-ce22d33ea799 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:15:15.647039 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-aa9a2afc-8e6a-4392-a7c6-ce22d33ea799 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:15:15.654023 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa9a2afc-8e6a-4392-a7c6-ce22d33ea799 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:15:15.654510 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa9a2afc-8e6a-4392-a7c6-ce22d33ea799 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:15:15.654944 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa9a2afc-8e6a-4392-a7c6-ce22d33ea799 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:15:15.655653 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa9a2afc-8e6a-4392-a7c6-ce22d33ea799 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:15:15.656104 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa9a2afc-8e6a-4392-a7c6-ce22d33ea799 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:15:15.656525 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-aa9a2afc-8e6a-4392-a7c6-ce22d33ea799 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:15:15.792782 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-aa9a2afc-8e6a-4392-a7c6-ce22d33ea799 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:15:15.801586 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-aa9a2afc-8e6a-4392-a7c6-ce22d33ea799 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1271 microversion: 2.1 time: 0.159828 Sep 10 13:15:15.802168 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3883/7771] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:15:15 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1271 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:15:16.824481 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3b889202-468e-4e59-b1b1-e1c9fd9c7217 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:15:16.825532 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3b889202-468e-4e59-b1b1-e1c9fd9c7217 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:15:16.832361 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3b889202-468e-4e59-b1b1-e1c9fd9c7217 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:15:16.832874 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3b889202-468e-4e59-b1b1-e1c9fd9c7217 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:15:16.833337 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3b889202-468e-4e59-b1b1-e1c9fd9c7217 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:15:16.834063 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3b889202-468e-4e59-b1b1-e1c9fd9c7217 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:15:16.834542 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3b889202-468e-4e59-b1b1-e1c9fd9c7217 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:15:16.835000 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3b889202-468e-4e59-b1b1-e1c9fd9c7217 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:15:16.975229 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3b889202-468e-4e59-b1b1-e1c9fd9c7217 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:15:16.983184 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3b889202-468e-4e59-b1b1-e1c9fd9c7217 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1271 microversion: 2.1 time: 0.162634 Sep 10 13:15:16.983779 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3889/7772] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:15:16 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:15:18.008065 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-2c7987de-689f-40db-aeaa-0091bae46a2f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:15:18.008687 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-2c7987de-689f-40db-aeaa-0091bae46a2f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:15:18.015500 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c7987de-689f-40db-aeaa-0091bae46a2f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:15:18.015991 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c7987de-689f-40db-aeaa-0091bae46a2f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:15:18.016433 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c7987de-689f-40db-aeaa-0091bae46a2f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:15:18.018057 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c7987de-689f-40db-aeaa-0091bae46a2f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:15:18.018521 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c7987de-689f-40db-aeaa-0091bae46a2f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:15:18.018954 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-2c7987de-689f-40db-aeaa-0091bae46a2f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:15:18.451874 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-2c7987de-689f-40db-aeaa-0091bae46a2f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:15:18.460413 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-2c7987de-689f-40db-aeaa-0091bae46a2f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1259 microversion: 2.1 time: 0.456309 Sep 10 13:15:18.460991 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3884/7773] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:15:18 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1259 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:15:19.483411 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-3b565b79-6764-4571-837d-7eb365c916ec tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:15:19.484069 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-3b565b79-6764-4571-837d-7eb365c916ec tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:15:19.490882 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3b565b79-6764-4571-837d-7eb365c916ec tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:15:19.491418 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3b565b79-6764-4571-837d-7eb365c916ec tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:15:19.491873 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3b565b79-6764-4571-837d-7eb365c916ec tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:15:19.492571 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3b565b79-6764-4571-837d-7eb365c916ec tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:15:19.493038 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3b565b79-6764-4571-837d-7eb365c916ec tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:15:19.493478 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-3b565b79-6764-4571-837d-7eb365c916ec tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:15:19.625305 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-3b565b79-6764-4571-837d-7eb365c916ec tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:15:19.633604 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-3b565b79-6764-4571-837d-7eb365c916ec tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1259 microversion: 2.1 time: 0.154213 Sep 10 13:15:19.634178 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3890/7774] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:15:19 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:15:20.658705 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f411f617-5c53-4f73-a49b-7bae6ff840b8 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:15:20.659342 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f411f617-5c53-4f73-a49b-7bae6ff840b8 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:15:20.666097 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f411f617-5c53-4f73-a49b-7bae6ff840b8 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:15:20.666574 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f411f617-5c53-4f73-a49b-7bae6ff840b8 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:15:20.667038 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f411f617-5c53-4f73-a49b-7bae6ff840b8 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:15:20.667749 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f411f617-5c53-4f73-a49b-7bae6ff840b8 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:15:20.668204 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f411f617-5c53-4f73-a49b-7bae6ff840b8 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:15:20.668627 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f411f617-5c53-4f73-a49b-7bae6ff840b8 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:15:20.774473 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:15:20.796403 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:15:20.803890 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f411f617-5c53-4f73-a49b-7bae6ff840b8 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:15:20.812800 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f411f617-5c53-4f73-a49b-7bae6ff840b8 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1259 microversion: 2.1 time: 0.158647 Sep 10 13:15:20.813392 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3885/7775] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:15:20 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:15:21.835381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-a2e23907-30d3-4c25-b31a-2c65c20220f6 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:15:21.835951 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-a2e23907-30d3-4c25-b31a-2c65c20220f6 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:15:21.838646 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:15:21.844418 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2e23907-30d3-4c25-b31a-2c65c20220f6 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:15:21.845522 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2e23907-30d3-4c25-b31a-2c65c20220f6 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:15:21.845978 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2e23907-30d3-4c25-b31a-2c65c20220f6 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:15:21.846709 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2e23907-30d3-4c25-b31a-2c65c20220f6 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:15:21.847200 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2e23907-30d3-4c25-b31a-2c65c20220f6 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:15:21.847652 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-a2e23907-30d3-4c25-b31a-2c65c20220f6 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:15:21.984934 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-a2e23907-30d3-4c25-b31a-2c65c20220f6 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:15:21.993752 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-a2e23907-30d3-4c25-b31a-2c65c20220f6 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1259 microversion: 2.1 time: 0.162391 Sep 10 13:15:21.994331 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3891/7776] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:15:21 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:15:23.016482 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f371af70-50a9-45b8-aeef-673fb7ffcc3e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:15:23.017456 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f371af70-50a9-45b8-aeef-673fb7ffcc3e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:15:23.024353 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f371af70-50a9-45b8-aeef-673fb7ffcc3e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:15:23.024858 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f371af70-50a9-45b8-aeef-673fb7ffcc3e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:15:23.025290 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f371af70-50a9-45b8-aeef-673fb7ffcc3e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:15:23.025987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f371af70-50a9-45b8-aeef-673fb7ffcc3e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:15:23.026450 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f371af70-50a9-45b8-aeef-673fb7ffcc3e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:15:23.026883 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f371af70-50a9-45b8-aeef-673fb7ffcc3e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:15:23.160427 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f371af70-50a9-45b8-aeef-673fb7ffcc3e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:15:23.168181 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f371af70-50a9-45b8-aeef-673fb7ffcc3e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1259 microversion: 2.1 time: 0.155783 Sep 10 13:15:23.168757 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3886/7777] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:15:23 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:15:24.192458 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6e47bbd6-7992-4290-9ac9-715182a6ddbc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:15:24.193121 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6e47bbd6-7992-4290-9ac9-715182a6ddbc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:15:24.200090 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e47bbd6-7992-4290-9ac9-715182a6ddbc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:15:24.200588 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e47bbd6-7992-4290-9ac9-715182a6ddbc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:15:24.201040 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e47bbd6-7992-4290-9ac9-715182a6ddbc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:15:24.201748 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e47bbd6-7992-4290-9ac9-715182a6ddbc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:15:24.202215 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e47bbd6-7992-4290-9ac9-715182a6ddbc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:15:24.202659 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6e47bbd6-7992-4290-9ac9-715182a6ddbc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:15:24.338293 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6e47bbd6-7992-4290-9ac9-715182a6ddbc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:15:24.346350 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6e47bbd6-7992-4290-9ac9-715182a6ddbc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1259 microversion: 2.1 time: 0.158302 Sep 10 13:15:24.347717 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3892/7778] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:15:24 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:15:25.369853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-63a60625-2320-473c-8d78-97351a97d021 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:15:25.370463 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-63a60625-2320-473c-8d78-97351a97d021 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:15:25.378814 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-63a60625-2320-473c-8d78-97351a97d021 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:15:25.379324 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-63a60625-2320-473c-8d78-97351a97d021 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:15:25.379763 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-63a60625-2320-473c-8d78-97351a97d021 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:15:25.380455 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-63a60625-2320-473c-8d78-97351a97d021 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:15:25.380909 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-63a60625-2320-473c-8d78-97351a97d021 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:15:25.381382 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-63a60625-2320-473c-8d78-97351a97d021 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:15:25.514005 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-63a60625-2320-473c-8d78-97351a97d021 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:15:25.522435 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-63a60625-2320-473c-8d78-97351a97d021 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1259 microversion: 2.1 time: 0.156467 Sep 10 13:15:25.523014 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3887/7779] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:15:25 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:15:26.545605 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-044622c0-045a-41cb-baec-983075fb9fce tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:15:26.546182 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-044622c0-045a-41cb-baec-983075fb9fce tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:15:26.553024 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-044622c0-045a-41cb-baec-983075fb9fce tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:15:26.553544 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-044622c0-045a-41cb-baec-983075fb9fce tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:15:26.553996 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-044622c0-045a-41cb-baec-983075fb9fce tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:15:26.554695 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-044622c0-045a-41cb-baec-983075fb9fce tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:15:26.555182 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-044622c0-045a-41cb-baec-983075fb9fce tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:15:26.555619 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-044622c0-045a-41cb-baec-983075fb9fce tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:15:26.693819 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-044622c0-045a-41cb-baec-983075fb9fce tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:15:26.701495 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-044622c0-045a-41cb-baec-983075fb9fce tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1259 microversion: 2.1 time: 0.159948 Sep 10 13:15:26.702079 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3893/7780] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:15:26 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 13:15:27.109492 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-de783099-2b74-4009-b682-b2fe280548fd req-363f7604-68a9-4dba-9ca7-3cece13fdc8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c19d476-fd8c-4883-b4fa-0090567ba91d", "name": "network-vif-plugged", "status": "completed", "tag": "d99b1fb6-ef7f-492e-96cd-70fa2b0bd2c4"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:15:27.119430 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-de783099-2b74-4009-b682-b2fe280548fd req-363f7604-68a9-4dba-9ca7-3cece13fdc8e service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:15:27.119905 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-de783099-2b74-4009-b682-b2fe280548fd req-363f7604-68a9-4dba-9ca7-3cece13fdc8e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:15:27.120396 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-de783099-2b74-4009-b682-b2fe280548fd req-363f7604-68a9-4dba-9ca7-3cece13fdc8e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:15:27.136773 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-de783099-2b74-4009-b682-b2fe280548fd req-363f7604-68a9-4dba-9ca7-3cece13fdc8e service nova] Creating event network-vif-plugged:d99b1fb6-ef7f-492e-96cd-70fa2b0bd2c4 for instance 7c19d476-fd8c-4883-b4fa-0090567ba91d on n-h2-856895-1 Sep 10 13:15:27.142892 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-de783099-2b74-4009-b682-b2fe280548fd req-363f7604-68a9-4dba-9ca7-3cece13fdc8e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086682 Sep 10 13:15:27.143748 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3888/7781] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:15:27.725663 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f7994eaa-0a74-4598-b4ae-465e9ca60523 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:15:27.726293 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f7994eaa-0a74-4598-b4ae-465e9ca60523 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:15:27.733144 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f7994eaa-0a74-4598-b4ae-465e9ca60523 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:15:27.733649 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f7994eaa-0a74-4598-b4ae-465e9ca60523 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:15:27.734103 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f7994eaa-0a74-4598-b4ae-465e9ca60523 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:15:27.734806 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f7994eaa-0a74-4598-b4ae-465e9ca60523 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:15:27.735871 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f7994eaa-0a74-4598-b4ae-465e9ca60523 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:15:27.736319 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f7994eaa-0a74-4598-b4ae-465e9ca60523 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:15:27.867066 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f7994eaa-0a74-4598-b4ae-465e9ca60523 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:15:27.874874 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f7994eaa-0a74-4598-b4ae-465e9ca60523 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1259 microversion: 2.1 time: 0.153194 Sep 10 13:15:27.875480 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3894/7782] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:15:27 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:15:28.899548 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-1b895288-29df-409f-9b40-b57b7a45b768 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:15:28.900253 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-1b895288-29df-409f-9b40-b57b7a45b768 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:15:28.907371 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b895288-29df-409f-9b40-b57b7a45b768 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:15:28.907874 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b895288-29df-409f-9b40-b57b7a45b768 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:15:28.908308 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b895288-29df-409f-9b40-b57b7a45b768 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:15:28.908996 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b895288-29df-409f-9b40-b57b7a45b768 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:15:28.909447 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b895288-29df-409f-9b40-b57b7a45b768 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:15:28.909868 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-1b895288-29df-409f-9b40-b57b7a45b768 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:15:29.043803 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-1b895288-29df-409f-9b40-b57b7a45b768 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:15:29.052143 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-1b895288-29df-409f-9b40-b57b7a45b768 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1443 microversion: 2.1 time: 0.157771 Sep 10 13:15:29.052713 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3889/7783] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:15:28 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1443 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:15:29.075370 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-39fc5038-38ff-4bdf-b7c0-036202872349 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:15:29.076000 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-39fc5038-38ff-4bdf-b7c0-036202872349 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:15:29.082735 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-39fc5038-38ff-4bdf-b7c0-036202872349 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:15:29.083263 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-39fc5038-38ff-4bdf-b7c0-036202872349 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:15:29.083715 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-39fc5038-38ff-4bdf-b7c0-036202872349 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:15:29.084414 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-39fc5038-38ff-4bdf-b7c0-036202872349 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:15:29.084885 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-39fc5038-38ff-4bdf-b7c0-036202872349 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:15:29.085327 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-39fc5038-38ff-4bdf-b7c0-036202872349 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:15:29.221569 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-39fc5038-38ff-4bdf-b7c0-036202872349 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:15:29.229353 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-39fc5038-38ff-4bdf-b7c0-036202872349 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1443 microversion: 2.1 time: 0.157870 Sep 10 13:15:29.229935 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3895/7784] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:15:29 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1443 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:15:30.879994 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-6990b4f5-28bf-4599-a33b-f613a88b457c req-da7fb979-f13d-41e0-971f-3317e4134bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c19d476-fd8c-4883-b4fa-0090567ba91d", "tag": "d99b1fb6-ef7f-492e-96cd-70fa2b0bd2c4"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:15:30.892793 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-6990b4f5-28bf-4599-a33b-f613a88b457c req-da7fb979-f13d-41e0-971f-3317e4134bb1 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:15:30.893271 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-6990b4f5-28bf-4599-a33b-f613a88b457c req-da7fb979-f13d-41e0-971f-3317e4134bb1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:15:30.893702 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-6990b4f5-28bf-4599-a33b-f613a88b457c req-da7fb979-f13d-41e0-971f-3317e4134bb1 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:15:30.904634 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-6990b4f5-28bf-4599-a33b-f613a88b457c req-da7fb979-f13d-41e0-971f-3317e4134bb1 service nova] Creating event network-changed:d99b1fb6-ef7f-492e-96cd-70fa2b0bd2c4 for instance 7c19d476-fd8c-4883-b4fa-0090567ba91d on n-h2-856895-1 Sep 10 13:15:30.910589 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-6990b4f5-28bf-4599-a33b-f613a88b457c req-da7fb979-f13d-41e0-971f-3317e4134bb1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036206 Sep 10 13:15:30.911481 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3890/7785] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:17:26.152646 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=22 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:17:26.153449 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=54 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:17:26.154312 n-d-856895-1 devstack@n-api.service[128776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 13:17:26.154446 n-d-856895-1 devstack@n-api.service[128776]: Sat Sep 10 13:17:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d/action (ip 10.222.0.23) !!! Sep 10 13:17:26.156708 n-d-856895-1 devstack@n-api.service[128776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 10 13:17:26.156886 n-d-856895-1 devstack@n-api.service[128776]: Sat Sep 10 13:17:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d/action (ip 10.222.0.23) !!! Sep 10 13:17:26.162348 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-50302ea0-3ef9-4615-b9a6-3ff5747e6f4f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:17:26.162902 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-50302ea0-3ef9-4615-b9a6-3ff5747e6f4f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:17:26.171573 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50302ea0-3ef9-4615-b9a6-3ff5747e6f4f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:26.172073 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50302ea0-3ef9-4615-b9a6-3ff5747e6f4f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:26.172528 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50302ea0-3ef9-4615-b9a6-3ff5747e6f4f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:26.173238 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50302ea0-3ef9-4615-b9a6-3ff5747e6f4f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:26.173711 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50302ea0-3ef9-4615-b9a6-3ff5747e6f4f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:26.174158 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-50302ea0-3ef9-4615-b9a6-3ff5747e6f4f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:26.199688 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-50302ea0-3ef9-4615-b9a6-3ff5747e6f4f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lazy-loading 'flavor' on Instance uuid 7c19d476-fd8c-4883-b4fa-0090567ba91d {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 13:17:26.273520 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-50302ea0-3ef9-4615-b9a6-3ff5747e6f4f tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "POST /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d/action" status: 202 len: 0 microversion: 2.1 time: 0.122543 Sep 10 13:17:26.274180 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3896/7786] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 13:17:26 2022] POST /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 13:17:26.282547 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:17:26.283902 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=50 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:17:26.285168 n-d-856895-1 devstack@n-api.service[128777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 10 13:17:26.285336 n-d-856895-1 devstack@n-api.service[128777]: Sat Sep 10 13:17:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d (ip 10.222.0.23) !!! Sep 10 13:17:26.286637 n-d-856895-1 devstack@n-api.service[128777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 10 13:17:26.286637 n-d-856895-1 devstack@n-api.service[128777]: Sat Sep 10 13:17:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d (ip 10.222.0.23) !!! Sep 10 13:17:26.292733 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-338bcff7-45c4-410d-a7c4-78c87b3de69c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:17:26.293443 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-338bcff7-45c4-410d-a7c4-78c87b3de69c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:17:26.303929 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-338bcff7-45c4-410d-a7c4-78c87b3de69c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:26.304445 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-338bcff7-45c4-410d-a7c4-78c87b3de69c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:26.304883 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-338bcff7-45c4-410d-a7c4-78c87b3de69c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:26.305622 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-338bcff7-45c4-410d-a7c4-78c87b3de69c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:26.306066 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-338bcff7-45c4-410d-a7c4-78c87b3de69c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:26.306520 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-338bcff7-45c4-410d-a7c4-78c87b3de69c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:26.444109 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-338bcff7-45c4-410d-a7c4-78c87b3de69c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:17:26.452432 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-338bcff7-45c4-410d-a7c4-78c87b3de69c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1567 microversion: 2.1 time: 0.173027 Sep 10 13:17:26.453017 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3891/7787] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:17:26 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:17:27.479248 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4d7419ab-aafc-476d-9c53-212569c78462 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:17:27.480146 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4d7419ab-aafc-476d-9c53-212569c78462 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:17:27.486608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4d7419ab-aafc-476d-9c53-212569c78462 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:27.487121 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4d7419ab-aafc-476d-9c53-212569c78462 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:27.487616 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4d7419ab-aafc-476d-9c53-212569c78462 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:27.488335 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4d7419ab-aafc-476d-9c53-212569c78462 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:27.488828 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4d7419ab-aafc-476d-9c53-212569c78462 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:27.489296 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4d7419ab-aafc-476d-9c53-212569c78462 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:27.627050 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4d7419ab-aafc-476d-9c53-212569c78462 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:17:27.634927 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4d7419ab-aafc-476d-9c53-212569c78462 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1567 microversion: 2.1 time: 0.161314 Sep 10 13:17:27.635583 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3897/7788] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:17:27 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:17:28.659949 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-99fde41b-25b5-4ff9-b28b-bfdc0363182e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:17:28.660569 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-99fde41b-25b5-4ff9-b28b-bfdc0363182e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:17:28.667346 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99fde41b-25b5-4ff9-b28b-bfdc0363182e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:28.667786 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99fde41b-25b5-4ff9-b28b-bfdc0363182e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:28.668223 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99fde41b-25b5-4ff9-b28b-bfdc0363182e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:28.668909 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99fde41b-25b5-4ff9-b28b-bfdc0363182e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:28.669360 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99fde41b-25b5-4ff9-b28b-bfdc0363182e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:28.669785 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99fde41b-25b5-4ff9-b28b-bfdc0363182e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:28.799581 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-99fde41b-25b5-4ff9-b28b-bfdc0363182e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:17:28.807251 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-99fde41b-25b5-4ff9-b28b-bfdc0363182e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1567 microversion: 2.1 time: 0.151369 Sep 10 13:17:28.808525 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3892/7789] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:17:28 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:17:29.832157 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-504085dc-6917-43ef-badd-963135e1b521 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:17:29.832768 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-504085dc-6917-43ef-badd-963135e1b521 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:17:29.839926 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-504085dc-6917-43ef-badd-963135e1b521 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:29.840430 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-504085dc-6917-43ef-badd-963135e1b521 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:29.840882 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-504085dc-6917-43ef-badd-963135e1b521 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:29.841584 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-504085dc-6917-43ef-badd-963135e1b521 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:29.842051 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-504085dc-6917-43ef-badd-963135e1b521 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:29.842492 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-504085dc-6917-43ef-badd-963135e1b521 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:29.973253 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-504085dc-6917-43ef-badd-963135e1b521 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:17:29.981499 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-504085dc-6917-43ef-badd-963135e1b521 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1567 microversion: 2.1 time: 0.153543 Sep 10 13:17:29.982078 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3898/7790] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:17:29 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 13:17:31.005333 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-47fa4376-9412-466f-96be-a46b1f3641cc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:17:31.005951 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-47fa4376-9412-466f-96be-a46b1f3641cc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:17:31.012751 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47fa4376-9412-466f-96be-a46b1f3641cc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:31.013229 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47fa4376-9412-466f-96be-a46b1f3641cc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:31.013661 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47fa4376-9412-466f-96be-a46b1f3641cc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:31.014347 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47fa4376-9412-466f-96be-a46b1f3641cc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:31.014801 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47fa4376-9412-466f-96be-a46b1f3641cc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:31.015250 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-47fa4376-9412-466f-96be-a46b1f3641cc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:31.151809 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-47fa4376-9412-466f-96be-a46b1f3641cc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:17:31.159610 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-47fa4376-9412-466f-96be-a46b1f3641cc tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1567 microversion: 2.1 time: 0.158201 Sep 10 13:17:31.160186 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3893/7791] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:17:31 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:17:32.183157 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c07f8c55-e195-44a2-a405-cd508a536aa6 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:17:32.183815 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c07f8c55-e195-44a2-a405-cd508a536aa6 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:17:32.190802 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c07f8c55-e195-44a2-a405-cd508a536aa6 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:32.191342 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c07f8c55-e195-44a2-a405-cd508a536aa6 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:32.191804 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c07f8c55-e195-44a2-a405-cd508a536aa6 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:32.192513 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c07f8c55-e195-44a2-a405-cd508a536aa6 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:32.192987 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c07f8c55-e195-44a2-a405-cd508a536aa6 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:32.193430 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c07f8c55-e195-44a2-a405-cd508a536aa6 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:32.325617 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c07f8c55-e195-44a2-a405-cd508a536aa6 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:17:32.333564 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c07f8c55-e195-44a2-a405-cd508a536aa6 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1567 microversion: 2.1 time: 0.154533 Sep 10 13:17:32.334137 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3899/7792] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:17:32 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:17:33.358421 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-fa10ee63-2431-4438-b243-e2b429ec6082 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:17:33.358974 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-fa10ee63-2431-4438-b243-e2b429ec6082 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:17:33.365801 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fa10ee63-2431-4438-b243-e2b429ec6082 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:33.366290 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fa10ee63-2431-4438-b243-e2b429ec6082 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:33.366731 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fa10ee63-2431-4438-b243-e2b429ec6082 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:33.367454 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fa10ee63-2431-4438-b243-e2b429ec6082 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:33.367909 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fa10ee63-2431-4438-b243-e2b429ec6082 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:33.368339 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-fa10ee63-2431-4438-b243-e2b429ec6082 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:33.503420 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-fa10ee63-2431-4438-b243-e2b429ec6082 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:17:33.511426 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-fa10ee63-2431-4438-b243-e2b429ec6082 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1567 microversion: 2.1 time: 0.157631 Sep 10 13:17:33.512030 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3894/7793] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:17:33 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:17:34.535389 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c4fe6669-e423-40a7-a3b2-c83a3eb0d01a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:17:34.536030 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c4fe6669-e423-40a7-a3b2-c83a3eb0d01a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:17:34.543710 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c4fe6669-e423-40a7-a3b2-c83a3eb0d01a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:34.544324 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c4fe6669-e423-40a7-a3b2-c83a3eb0d01a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:34.544789 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c4fe6669-e423-40a7-a3b2-c83a3eb0d01a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:34.545518 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c4fe6669-e423-40a7-a3b2-c83a3eb0d01a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:34.545995 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c4fe6669-e423-40a7-a3b2-c83a3eb0d01a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:34.546444 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c4fe6669-e423-40a7-a3b2-c83a3eb0d01a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:34.682945 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c4fe6669-e423-40a7-a3b2-c83a3eb0d01a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:17:34.690905 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c4fe6669-e423-40a7-a3b2-c83a3eb0d01a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1567 microversion: 2.1 time: 0.159538 Sep 10 13:17:34.691512 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3900/7794] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:17:34 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:17:35.714991 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-d35fe28f-b2e2-45cc-9a4d-a55341548116 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:17:35.715639 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-d35fe28f-b2e2-45cc-9a4d-a55341548116 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:17:35.722396 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d35fe28f-b2e2-45cc-9a4d-a55341548116 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:35.722880 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d35fe28f-b2e2-45cc-9a4d-a55341548116 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:35.723347 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d35fe28f-b2e2-45cc-9a4d-a55341548116 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:35.724040 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d35fe28f-b2e2-45cc-9a4d-a55341548116 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:35.724589 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d35fe28f-b2e2-45cc-9a4d-a55341548116 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:35.724987 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-d35fe28f-b2e2-45cc-9a4d-a55341548116 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:35.863575 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-d35fe28f-b2e2-45cc-9a4d-a55341548116 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:17:35.871858 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-d35fe28f-b2e2-45cc-9a4d-a55341548116 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1567 microversion: 2.1 time: 0.161381 Sep 10 13:17:35.872471 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3895/7795] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:17:35 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:17:36.895833 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-001ba701-4f82-4c2b-ae75-d33685a440b1 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:17:36.896462 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-001ba701-4f82-4c2b-ae75-d33685a440b1 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:17:36.903788 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-001ba701-4f82-4c2b-ae75-d33685a440b1 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:36.904293 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-001ba701-4f82-4c2b-ae75-d33685a440b1 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:36.904743 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-001ba701-4f82-4c2b-ae75-d33685a440b1 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:36.905450 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-001ba701-4f82-4c2b-ae75-d33685a440b1 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:36.905916 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-001ba701-4f82-4c2b-ae75-d33685a440b1 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:36.906354 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-001ba701-4f82-4c2b-ae75-d33685a440b1 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:37.042784 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-001ba701-4f82-4c2b-ae75-d33685a440b1 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:17:37.050684 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-001ba701-4f82-4c2b-ae75-d33685a440b1 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1567 microversion: 2.1 time: 0.159055 Sep 10 13:17:37.051272 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3901/7796] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:17:36 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:17:38.075553 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9a45985c-4c95-417d-9723-b5f7c2785d7d tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:17:38.076252 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9a45985c-4c95-417d-9723-b5f7c2785d7d tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:17:38.083099 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9a45985c-4c95-417d-9723-b5f7c2785d7d tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:38.083621 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9a45985c-4c95-417d-9723-b5f7c2785d7d tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:38.084064 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9a45985c-4c95-417d-9723-b5f7c2785d7d tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:38.084750 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9a45985c-4c95-417d-9723-b5f7c2785d7d tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:38.085209 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9a45985c-4c95-417d-9723-b5f7c2785d7d tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:38.085639 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9a45985c-4c95-417d-9723-b5f7c2785d7d tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:38.219714 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9a45985c-4c95-417d-9723-b5f7c2785d7d tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:17:38.227533 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9a45985c-4c95-417d-9723-b5f7c2785d7d tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1567 microversion: 2.1 time: 0.156090 Sep 10 13:17:38.228122 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3896/7797] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:17:38 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:17:39.251195 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-bc8e15cd-2726-450e-b566-05683e771578 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:17:39.251898 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-bc8e15cd-2726-450e-b566-05683e771578 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:17:39.259128 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc8e15cd-2726-450e-b566-05683e771578 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:39.259666 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc8e15cd-2726-450e-b566-05683e771578 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:39.260668 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc8e15cd-2726-450e-b566-05683e771578 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:39.261707 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc8e15cd-2726-450e-b566-05683e771578 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:39.262194 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc8e15cd-2726-450e-b566-05683e771578 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:39.262647 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-bc8e15cd-2726-450e-b566-05683e771578 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:39.406774 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-bc8e15cd-2726-450e-b566-05683e771578 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:17:39.414777 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-bc8e15cd-2726-450e-b566-05683e771578 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1567 microversion: 2.1 time: 0.167677 Sep 10 13:17:39.415391 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3902/7798] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:17:39 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:17:40.439916 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-9e461357-d1d7-41a0-b150-08daf01db682 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:17:40.440564 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-9e461357-d1d7-41a0-b150-08daf01db682 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:17:40.447428 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9e461357-d1d7-41a0-b150-08daf01db682 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:40.448769 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9e461357-d1d7-41a0-b150-08daf01db682 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:40.449214 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9e461357-d1d7-41a0-b150-08daf01db682 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:40.449918 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9e461357-d1d7-41a0-b150-08daf01db682 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:40.450378 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9e461357-d1d7-41a0-b150-08daf01db682 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:40.450812 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-9e461357-d1d7-41a0-b150-08daf01db682 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:40.588631 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-9e461357-d1d7-41a0-b150-08daf01db682 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:17:40.596652 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-9e461357-d1d7-41a0-b150-08daf01db682 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1568 microversion: 2.1 time: 0.161497 Sep 10 13:17:40.597254 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3897/7799] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:17:40 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:17:40.624585 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-31cf54ea-5988-41ca-a6cb-136d605b40d7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:17:40.625127 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-31cf54ea-5988-41ca-a6cb-136d605b40d7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:17:40.632140 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-31cf54ea-5988-41ca-a6cb-136d605b40d7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:40.633107 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-31cf54ea-5988-41ca-a6cb-136d605b40d7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:40.633710 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-31cf54ea-5988-41ca-a6cb-136d605b40d7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:40.634809 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-31cf54ea-5988-41ca-a6cb-136d605b40d7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:40.635474 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-31cf54ea-5988-41ca-a6cb-136d605b40d7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:40.636208 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-31cf54ea-5988-41ca-a6cb-136d605b40d7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:40.666090 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-31cf54ea-5988-41ca-a6cb-136d605b40d7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128776) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 10 13:17:40.732792 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-31cf54ea-5988-41ca-a6cb-136d605b40d7 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "POST /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d/action" status: 202 len: 0 microversion: 2.1 time: 0.113337 Sep 10 13:17:40.733419 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3903/7800] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 13:17:40 2022] POST /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 13:17:40.741426 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-3d3182d1-6137-4325-a44c-6c20d0276b2c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:17:40.742205 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-3d3182d1-6137-4325-a44c-6c20d0276b2c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:17:40.749048 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d3182d1-6137-4325-a44c-6c20d0276b2c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:40.749545 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d3182d1-6137-4325-a44c-6c20d0276b2c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:40.749985 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d3182d1-6137-4325-a44c-6c20d0276b2c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:40.750686 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d3182d1-6137-4325-a44c-6c20d0276b2c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:40.751150 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d3182d1-6137-4325-a44c-6c20d0276b2c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:40.751617 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-3d3182d1-6137-4325-a44c-6c20d0276b2c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:40.906255 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-3d3182d1-6137-4325-a44c-6c20d0276b2c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:17:40.913969 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-3d3182d1-6137-4325-a44c-6c20d0276b2c tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1516 microversion: 2.1 time: 0.176386 Sep 10 13:17:40.914555 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3898/7801] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:17:40 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1516 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 13:17:41.548505 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-d53807c1-d04e-4026-a1a0-04a8628b0482 req-ade34dad-7eeb-457b-8d46-8d5678be0700 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c19d476-fd8c-4883-b4fa-0090567ba91d", "name": "network-vif-unplugged", "status": "completed", "tag": "d99b1fb6-ef7f-492e-96cd-70fa2b0bd2c4"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:17:41.558958 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d53807c1-d04e-4026-a1a0-04a8628b0482 req-ade34dad-7eeb-457b-8d46-8d5678be0700 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:41.559490 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d53807c1-d04e-4026-a1a0-04a8628b0482 req-ade34dad-7eeb-457b-8d46-8d5678be0700 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:41.559981 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d53807c1-d04e-4026-a1a0-04a8628b0482 req-ade34dad-7eeb-457b-8d46-8d5678be0700 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:41.571481 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.compute.server_external_events [req-d53807c1-d04e-4026-a1a0-04a8628b0482 req-ade34dad-7eeb-457b-8d46-8d5678be0700 service nova] Unable to find a host for instance 7c19d476-fd8c-4883-b4fa-0090567ba91d. Dropping event network-vif-unplugged {{(pid=128776) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 10 13:17:41.572385 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-d53807c1-d04e-4026-a1a0-04a8628b0482 req-ade34dad-7eeb-457b-8d46-8d5678be0700 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027892 Sep 10 13:17:41.573657 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3904/7802] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 10 13:17:41.937843 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4b20f767-aaf2-4b37-8cef-2da1df18c6d4 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:17:41.938467 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4b20f767-aaf2-4b37-8cef-2da1df18c6d4 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:17:41.945361 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b20f767-aaf2-4b37-8cef-2da1df18c6d4 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:41.945845 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b20f767-aaf2-4b37-8cef-2da1df18c6d4 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:41.946285 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b20f767-aaf2-4b37-8cef-2da1df18c6d4 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:41.946981 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b20f767-aaf2-4b37-8cef-2da1df18c6d4 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:41.947997 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b20f767-aaf2-4b37-8cef-2da1df18c6d4 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:41.948526 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4b20f767-aaf2-4b37-8cef-2da1df18c6d4 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:42.082496 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4b20f767-aaf2-4b37-8cef-2da1df18c6d4 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:17:42.091421 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4b20f767-aaf2-4b37-8cef-2da1df18c6d4 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1516 microversion: 2.1 time: 0.157466 Sep 10 13:17:42.092006 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3899/7803] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:17:41 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:17:43.114385 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-005ef781-721e-486a-a249-5b4aee35a302 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:17:43.115116 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-005ef781-721e-486a-a249-5b4aee35a302 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:17:43.122682 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-005ef781-721e-486a-a249-5b4aee35a302 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:43.123470 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-005ef781-721e-486a-a249-5b4aee35a302 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:43.123687 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-005ef781-721e-486a-a249-5b4aee35a302 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:43.124372 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-005ef781-721e-486a-a249-5b4aee35a302 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:43.124842 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-005ef781-721e-486a-a249-5b4aee35a302 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:43.125290 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-005ef781-721e-486a-a249-5b4aee35a302 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:43.265478 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-005ef781-721e-486a-a249-5b4aee35a302 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:17:43.273483 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-005ef781-721e-486a-a249-5b4aee35a302 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1516 microversion: 2.1 time: 0.162990 Sep 10 13:17:43.274060 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3905/7804] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:17:43 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:17:44.297587 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-239c722f-0a8a-4d47-8ad5-eef1dee7342b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:17:44.298215 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-239c722f-0a8a-4d47-8ad5-eef1dee7342b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:17:44.305262 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-239c722f-0a8a-4d47-8ad5-eef1dee7342b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:44.305743 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-239c722f-0a8a-4d47-8ad5-eef1dee7342b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:44.306177 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-239c722f-0a8a-4d47-8ad5-eef1dee7342b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:44.307525 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-239c722f-0a8a-4d47-8ad5-eef1dee7342b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:44.307989 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-239c722f-0a8a-4d47-8ad5-eef1dee7342b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:44.308440 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-239c722f-0a8a-4d47-8ad5-eef1dee7342b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:44.442659 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-239c722f-0a8a-4d47-8ad5-eef1dee7342b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:17:44.450733 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-239c722f-0a8a-4d47-8ad5-eef1dee7342b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1516 microversion: 2.1 time: 0.157075 Sep 10 13:17:44.451339 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3900/7805] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:17:44 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:17:45.475131 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-0246953b-9103-4548-ba15-1e47f38afe61 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:17:45.476242 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-0246953b-9103-4548-ba15-1e47f38afe61 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:17:45.484236 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0246953b-9103-4548-ba15-1e47f38afe61 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:45.484815 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0246953b-9103-4548-ba15-1e47f38afe61 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:45.485268 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0246953b-9103-4548-ba15-1e47f38afe61 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:45.486331 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0246953b-9103-4548-ba15-1e47f38afe61 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:45.486806 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0246953b-9103-4548-ba15-1e47f38afe61 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:45.487265 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-0246953b-9103-4548-ba15-1e47f38afe61 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:45.627147 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-0246953b-9103-4548-ba15-1e47f38afe61 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:17:45.636452 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-0246953b-9103-4548-ba15-1e47f38afe61 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1518 microversion: 2.1 time: 0.164946 Sep 10 13:17:45.636980 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3906/7806] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:17:45 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:17:46.661214 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-96df9691-a7cd-49af-a4ab-d213baa62258 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:17:46.661831 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-96df9691-a7cd-49af-a4ab-d213baa62258 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:17:46.669563 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-96df9691-a7cd-49af-a4ab-d213baa62258 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:46.670055 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-96df9691-a7cd-49af-a4ab-d213baa62258 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:46.670841 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-96df9691-a7cd-49af-a4ab-d213baa62258 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:46.671580 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-96df9691-a7cd-49af-a4ab-d213baa62258 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:46.672033 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-96df9691-a7cd-49af-a4ab-d213baa62258 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:46.672455 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-96df9691-a7cd-49af-a4ab-d213baa62258 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:46.807475 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-96df9691-a7cd-49af-a4ab-d213baa62258 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:17:46.816369 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-96df9691-a7cd-49af-a4ab-d213baa62258 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1518 microversion: 2.1 time: 0.158969 Sep 10 13:17:46.817181 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3901/7807] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:17:46 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:17:47.840058 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-def6dae2-b92c-4a8f-9e93-113eea9ae128 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:17:47.840698 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-def6dae2-b92c-4a8f-9e93-113eea9ae128 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:17:47.848009 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-def6dae2-b92c-4a8f-9e93-113eea9ae128 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:47.848513 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-def6dae2-b92c-4a8f-9e93-113eea9ae128 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:47.848991 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-def6dae2-b92c-4a8f-9e93-113eea9ae128 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:47.849760 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-def6dae2-b92c-4a8f-9e93-113eea9ae128 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:47.850238 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-def6dae2-b92c-4a8f-9e93-113eea9ae128 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:47.850688 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-def6dae2-b92c-4a8f-9e93-113eea9ae128 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:47.989789 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-def6dae2-b92c-4a8f-9e93-113eea9ae128 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:17:47.998355 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-def6dae2-b92c-4a8f-9e93-113eea9ae128 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1518 microversion: 2.1 time: 0.162429 Sep 10 13:17:47.998941 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3907/7808] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:17:47 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:17:49.022153 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-87631ff0-5385-4948-b369-ce593a065142 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:17:49.022771 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-87631ff0-5385-4948-b369-ce593a065142 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:17:49.030505 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87631ff0-5385-4948-b369-ce593a065142 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:49.030988 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87631ff0-5385-4948-b369-ce593a065142 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:49.031464 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87631ff0-5385-4948-b369-ce593a065142 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:49.032159 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87631ff0-5385-4948-b369-ce593a065142 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:49.032611 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87631ff0-5385-4948-b369-ce593a065142 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:49.033034 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-87631ff0-5385-4948-b369-ce593a065142 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:49.199038 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-87631ff0-5385-4948-b369-ce593a065142 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:17:49.207458 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-87631ff0-5385-4948-b369-ce593a065142 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1518 microversion: 2.1 time: 0.189368 Sep 10 13:17:49.208070 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3902/7809] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:17:49 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1518 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:17:50.238563 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-227e5245-63d5-4e4d-8453-f3518301c0c8 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:17:50.239691 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-227e5245-63d5-4e4d-8453-f3518301c0c8 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:17:50.247899 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-227e5245-63d5-4e4d-8453-f3518301c0c8 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:50.248414 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-227e5245-63d5-4e4d-8453-f3518301c0c8 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:50.248876 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-227e5245-63d5-4e4d-8453-f3518301c0c8 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:50.249605 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-227e5245-63d5-4e4d-8453-f3518301c0c8 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:50.250082 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-227e5245-63d5-4e4d-8453-f3518301c0c8 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:50.250534 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-227e5245-63d5-4e4d-8453-f3518301c0c8 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:50.391821 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-227e5245-63d5-4e4d-8453-f3518301c0c8 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:17:50.401534 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-227e5245-63d5-4e4d-8453-f3518301c0c8 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1518 microversion: 2.1 time: 0.167045 Sep 10 13:17:50.402215 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3908/7810] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:17:50 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:17:51.425583 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-627d3514-39c8-4c8c-8312-49866ea7b6b6 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:17:51.426209 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-627d3514-39c8-4c8c-8312-49866ea7b6b6 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:17:51.433690 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-627d3514-39c8-4c8c-8312-49866ea7b6b6 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:51.434179 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-627d3514-39c8-4c8c-8312-49866ea7b6b6 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:51.434619 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-627d3514-39c8-4c8c-8312-49866ea7b6b6 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:51.435355 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-627d3514-39c8-4c8c-8312-49866ea7b6b6 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:51.435817 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-627d3514-39c8-4c8c-8312-49866ea7b6b6 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:51.436251 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-627d3514-39c8-4c8c-8312-49866ea7b6b6 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:51.944023 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-627d3514-39c8-4c8c-8312-49866ea7b6b6 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:17:51.951938 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-627d3514-39c8-4c8c-8312-49866ea7b6b6 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1574 microversion: 2.1 time: 0.530345 Sep 10 13:17:51.956723 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3903/7811] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:17:51 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1574 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:17:52.001081 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-74c35578-7e2a-4527-878b-58f49c755370 req-739964b5-1e4d-4388-b0bd-6a2221b303ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c19d476-fd8c-4883-b4fa-0090567ba91d", "tag": "d99b1fb6-ef7f-492e-96cd-70fa2b0bd2c4"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:17:52.012683 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-74c35578-7e2a-4527-878b-58f49c755370 req-739964b5-1e4d-4388-b0bd-6a2221b303ea service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:52.013194 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-74c35578-7e2a-4527-878b-58f49c755370 req-739964b5-1e4d-4388-b0bd-6a2221b303ea service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:52.013643 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-74c35578-7e2a-4527-878b-58f49c755370 req-739964b5-1e4d-4388-b0bd-6a2221b303ea service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:52.025263 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-74c35578-7e2a-4527-878b-58f49c755370 req-739964b5-1e4d-4388-b0bd-6a2221b303ea service nova] Creating event network-changed:d99b1fb6-ef7f-492e-96cd-70fa2b0bd2c4 for instance 7c19d476-fd8c-4883-b4fa-0090567ba91d on n-h1-856895-1 Sep 10 13:17:52.030504 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-74c35578-7e2a-4527-878b-58f49c755370 req-739964b5-1e4d-4388-b0bd-6a2221b303ea service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033326 Sep 10 13:17:52.031118 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3909/7812] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:17:52.976788 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-99994388-8d69-4873-bec0-be56932bfe1a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:17:52.977426 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-99994388-8d69-4873-bec0-be56932bfe1a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:17:52.984535 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99994388-8d69-4873-bec0-be56932bfe1a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:52.985014 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99994388-8d69-4873-bec0-be56932bfe1a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:52.985448 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99994388-8d69-4873-bec0-be56932bfe1a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:52.986135 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99994388-8d69-4873-bec0-be56932bfe1a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:52.986584 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99994388-8d69-4873-bec0-be56932bfe1a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:52.987006 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-99994388-8d69-4873-bec0-be56932bfe1a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:53.124187 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-99994388-8d69-4873-bec0-be56932bfe1a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:17:53.132472 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-99994388-8d69-4873-bec0-be56932bfe1a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1574 microversion: 2.1 time: 0.159564 Sep 10 13:17:53.133054 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3904/7813] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:17:52 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:17:54.159321 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-360e1916-e524-4f42-85eb-1afa41400b30 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:17:54.160179 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-360e1916-e524-4f42-85eb-1afa41400b30 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:17:54.166536 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-360e1916-e524-4f42-85eb-1afa41400b30 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:54.167241 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-360e1916-e524-4f42-85eb-1afa41400b30 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:54.167703 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-360e1916-e524-4f42-85eb-1afa41400b30 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:54.168425 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-360e1916-e524-4f42-85eb-1afa41400b30 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:54.168900 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-360e1916-e524-4f42-85eb-1afa41400b30 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:54.169346 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-360e1916-e524-4f42-85eb-1afa41400b30 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:54.301538 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-360e1916-e524-4f42-85eb-1afa41400b30 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:17:54.305134 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:17:54.310876 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-360e1916-e524-4f42-85eb-1afa41400b30 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1574 microversion: 2.1 time: 0.156759 Sep 10 13:17:54.311495 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3910/7814] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:17:54 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:17:55.334792 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8b7103a8-741b-4266-ab91-237fd7b341f8 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:17:55.335467 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8b7103a8-741b-4266-ab91-237fd7b341f8 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:17:55.343155 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b7103a8-741b-4266-ab91-237fd7b341f8 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:55.343683 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b7103a8-741b-4266-ab91-237fd7b341f8 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:55.344188 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b7103a8-741b-4266-ab91-237fd7b341f8 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:55.344894 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b7103a8-741b-4266-ab91-237fd7b341f8 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:55.345351 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b7103a8-741b-4266-ab91-237fd7b341f8 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:55.345780 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8b7103a8-741b-4266-ab91-237fd7b341f8 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:55.482553 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8b7103a8-741b-4266-ab91-237fd7b341f8 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:17:55.490469 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8b7103a8-741b-4266-ab91-237fd7b341f8 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1574 microversion: 2.1 time: 0.159619 Sep 10 13:17:55.491040 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3905/7815] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:17:55 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:17:56.515307 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-68e8297e-2ca0-491c-a613-bed72a278e09 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:17:56.515941 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-68e8297e-2ca0-491c-a613-bed72a278e09 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:17:56.518884 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:17:56.525544 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-68e8297e-2ca0-491c-a613-bed72a278e09 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:56.526094 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-68e8297e-2ca0-491c-a613-bed72a278e09 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:56.526551 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-68e8297e-2ca0-491c-a613-bed72a278e09 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:56.527304 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-68e8297e-2ca0-491c-a613-bed72a278e09 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:56.527779 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-68e8297e-2ca0-491c-a613-bed72a278e09 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:56.528228 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-68e8297e-2ca0-491c-a613-bed72a278e09 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:56.659592 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-68e8297e-2ca0-491c-a613-bed72a278e09 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:17:56.668076 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-68e8297e-2ca0-491c-a613-bed72a278e09 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1574 microversion: 2.1 time: 0.157620 Sep 10 13:17:56.668653 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3911/7816] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:17:56 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:17:57.691509 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-792392b3-f87a-4eec-b509-51316cab20f6 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:17:57.692129 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-792392b3-f87a-4eec-b509-51316cab20f6 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:17:57.694284 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=31 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:17:57.699642 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-792392b3-f87a-4eec-b509-51316cab20f6 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:57.700127 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-792392b3-f87a-4eec-b509-51316cab20f6 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:57.700567 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-792392b3-f87a-4eec-b509-51316cab20f6 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:57.701255 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-792392b3-f87a-4eec-b509-51316cab20f6 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:57.701711 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-792392b3-f87a-4eec-b509-51316cab20f6 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:57.702136 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-792392b3-f87a-4eec-b509-51316cab20f6 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:57.706033 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=91 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:17:57.834831 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-792392b3-f87a-4eec-b509-51316cab20f6 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:17:57.843789 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-792392b3-f87a-4eec-b509-51316cab20f6 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1574 microversion: 2.1 time: 0.156200 Sep 10 13:17:57.844369 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3906/7817] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:17:57 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:17:58.867382 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e329abba-fa09-4de3-be9a-f9c41737a829 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:17:58.868042 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e329abba-fa09-4de3-be9a-f9c41737a829 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:17:58.875060 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e329abba-fa09-4de3-be9a-f9c41737a829 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:58.875584 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e329abba-fa09-4de3-be9a-f9c41737a829 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:58.876033 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e329abba-fa09-4de3-be9a-f9c41737a829 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:58.876731 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e329abba-fa09-4de3-be9a-f9c41737a829 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:17:58.877197 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e329abba-fa09-4de3-be9a-f9c41737a829 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:17:58.877635 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e329abba-fa09-4de3-be9a-f9c41737a829 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:17:59.009209 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e329abba-fa09-4de3-be9a-f9c41737a829 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:17:59.018016 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e329abba-fa09-4de3-be9a-f9c41737a829 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1574 microversion: 2.1 time: 0.154581 Sep 10 13:17:59.018600 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3912/7818] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:17:58 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:18:00.041761 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-22501733-174a-4bfe-bc4d-089c1b6b3e92 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:18:00.042488 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-22501733-174a-4bfe-bc4d-089c1b6b3e92 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:18:00.049717 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-22501733-174a-4bfe-bc4d-089c1b6b3e92 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:18:00.050207 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-22501733-174a-4bfe-bc4d-089c1b6b3e92 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:18:00.050649 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-22501733-174a-4bfe-bc4d-089c1b6b3e92 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:18:00.051385 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-22501733-174a-4bfe-bc4d-089c1b6b3e92 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:18:00.051843 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-22501733-174a-4bfe-bc4d-089c1b6b3e92 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:18:00.052273 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-22501733-174a-4bfe-bc4d-089c1b6b3e92 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:18:00.184445 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-22501733-174a-4bfe-bc4d-089c1b6b3e92 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:18:00.192254 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-22501733-174a-4bfe-bc4d-089c1b6b3e92 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1574 microversion: 2.1 time: 0.154461 Sep 10 13:18:00.192829 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3907/7819] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:18:00 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:18:01.216647 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2f4055e5-26be-4c50-b9c6-15aeaf43ebaa tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:18:01.217284 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2f4055e5-26be-4c50-b9c6-15aeaf43ebaa tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:18:01.224180 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f4055e5-26be-4c50-b9c6-15aeaf43ebaa tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:18:01.224681 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f4055e5-26be-4c50-b9c6-15aeaf43ebaa tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:18:01.225137 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f4055e5-26be-4c50-b9c6-15aeaf43ebaa tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:18:01.225850 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f4055e5-26be-4c50-b9c6-15aeaf43ebaa tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:18:01.226324 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f4055e5-26be-4c50-b9c6-15aeaf43ebaa tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:18:01.226770 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2f4055e5-26be-4c50-b9c6-15aeaf43ebaa tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:18:01.366268 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2f4055e5-26be-4c50-b9c6-15aeaf43ebaa tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:18:01.374337 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2f4055e5-26be-4c50-b9c6-15aeaf43ebaa tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1574 microversion: 2.1 time: 0.162212 Sep 10 13:18:01.374897 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3913/7820] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:18:01 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:18:02.398214 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0ec21b54-4aaa-476b-a033-847abd55ebbe tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:18:02.398765 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0ec21b54-4aaa-476b-a033-847abd55ebbe tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:18:02.405598 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ec21b54-4aaa-476b-a033-847abd55ebbe tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:18:02.406159 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ec21b54-4aaa-476b-a033-847abd55ebbe tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:18:02.406606 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ec21b54-4aaa-476b-a033-847abd55ebbe tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:18:02.407328 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ec21b54-4aaa-476b-a033-847abd55ebbe tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:18:02.407787 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ec21b54-4aaa-476b-a033-847abd55ebbe tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:18:02.408213 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ec21b54-4aaa-476b-a033-847abd55ebbe tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:18:02.543543 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0ec21b54-4aaa-476b-a033-847abd55ebbe tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:18:02.551267 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0ec21b54-4aaa-476b-a033-847abd55ebbe tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1574 microversion: 2.1 time: 0.157021 Sep 10 13:18:02.551851 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3908/7821] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:18:02 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:18:03.576212 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5385a530-d7b8-4018-802d-bcce9df1fb2d tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:18:03.576795 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5385a530-d7b8-4018-802d-bcce9df1fb2d tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:18:03.583755 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5385a530-d7b8-4018-802d-bcce9df1fb2d tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:18:03.584254 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5385a530-d7b8-4018-802d-bcce9df1fb2d tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:18:03.584739 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5385a530-d7b8-4018-802d-bcce9df1fb2d tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:18:03.585443 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5385a530-d7b8-4018-802d-bcce9df1fb2d tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:18:03.585916 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5385a530-d7b8-4018-802d-bcce9df1fb2d tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:18:03.586360 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5385a530-d7b8-4018-802d-bcce9df1fb2d tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:18:03.730506 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5385a530-d7b8-4018-802d-bcce9df1fb2d tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:18:03.738845 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5385a530-d7b8-4018-802d-bcce9df1fb2d tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1574 microversion: 2.1 time: 0.167243 Sep 10 13:18:03.739480 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3914/7822] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:18:03 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:18:03.889591 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-ef2c1583-a187-4db8-a8ff-559f75f50bca req-906b2c9b-4476-40c9-afc1-f2b95e457355 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c19d476-fd8c-4883-b4fa-0090567ba91d", "name": "network-vif-plugged", "status": "completed", "tag": "d99b1fb6-ef7f-492e-96cd-70fa2b0bd2c4"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:18:03.900169 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-ef2c1583-a187-4db8-a8ff-559f75f50bca req-906b2c9b-4476-40c9-afc1-f2b95e457355 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:18:03.901239 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-ef2c1583-a187-4db8-a8ff-559f75f50bca req-906b2c9b-4476-40c9-afc1-f2b95e457355 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:18:03.901814 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-ef2c1583-a187-4db8-a8ff-559f75f50bca req-906b2c9b-4476-40c9-afc1-f2b95e457355 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:18:03.913816 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-ef2c1583-a187-4db8-a8ff-559f75f50bca req-906b2c9b-4476-40c9-afc1-f2b95e457355 service nova] Creating event network-vif-plugged:d99b1fb6-ef7f-492e-96cd-70fa2b0bd2c4 for instance 7c19d476-fd8c-4883-b4fa-0090567ba91d on n-h1-856895-1 Sep 10 13:18:03.917357 n-d-856895-1 devstack@n-api.service[128777]: ERROR oslo.messaging._drivers.impl_rabbit [req-ef2c1583-a187-4db8-a8ff-559f75f50bca req-906b2c9b-4476-40c9-afc1-f2b95e457355 service nova] [f4871d25-d0f9-4a6a-8e4b-050baa151141] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 10 13:18:04.763090 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e09abef2-39f3-45b9-99d2-991ef5bcb2cb tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:18:04.763700 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e09abef2-39f3-45b9-99d2-991ef5bcb2cb tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:18:04.770815 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e09abef2-39f3-45b9-99d2-991ef5bcb2cb tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:18:04.771351 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e09abef2-39f3-45b9-99d2-991ef5bcb2cb tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:18:04.771807 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e09abef2-39f3-45b9-99d2-991ef5bcb2cb tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:18:04.772513 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e09abef2-39f3-45b9-99d2-991ef5bcb2cb tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:18:04.772980 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e09abef2-39f3-45b9-99d2-991ef5bcb2cb tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:18:04.773419 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e09abef2-39f3-45b9-99d2-991ef5bcb2cb tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:18:04.905040 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e09abef2-39f3-45b9-99d2-991ef5bcb2cb tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:18:04.913753 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e09abef2-39f3-45b9-99d2-991ef5bcb2cb tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1574 microversion: 2.1 time: 0.154685 Sep 10 13:18:04.914338 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3915/7823] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:18:04 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 13:18:04.925361 n-d-856895-1 devstack@n-api.service[128777]: INFO oslo.messaging._drivers.impl_rabbit [req-ef2c1583-a187-4db8-a8ff-559f75f50bca req-906b2c9b-4476-40c9-afc1-f2b95e457355 service nova] [f4871d25-d0f9-4a6a-8e4b-050baa151141] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 39166. Sep 10 13:18:04.929157 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-ef2c1583-a187-4db8-a8ff-559f75f50bca req-906b2c9b-4476-40c9-afc1-f2b95e457355 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.043490 Sep 10 13:18:04.929769 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3909/7824] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:18:05.938389 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f760222d-970e-4198-b30f-328c29f07416 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:18:05.939036 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f760222d-970e-4198-b30f-328c29f07416 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:18:05.945962 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f760222d-970e-4198-b30f-328c29f07416 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:18:05.946461 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f760222d-970e-4198-b30f-328c29f07416 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:18:05.946914 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f760222d-970e-4198-b30f-328c29f07416 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:18:05.947642 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f760222d-970e-4198-b30f-328c29f07416 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:18:05.948115 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f760222d-970e-4198-b30f-328c29f07416 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:18:05.948561 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f760222d-970e-4198-b30f-328c29f07416 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:18:06.084425 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f760222d-970e-4198-b30f-328c29f07416 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:18:06.092381 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f760222d-970e-4198-b30f-328c29f07416 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1574 microversion: 2.1 time: 0.157976 Sep 10 13:18:06.092962 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3916/7825] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:18:05 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:18:07.117924 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-397502e5-0d58-459e-b438-30b0c91cb274 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:18:07.118625 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-397502e5-0d58-459e-b438-30b0c91cb274 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:18:07.125539 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-397502e5-0d58-459e-b438-30b0c91cb274 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:18:07.126017 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-397502e5-0d58-459e-b438-30b0c91cb274 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:18:07.126449 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-397502e5-0d58-459e-b438-30b0c91cb274 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:18:07.127138 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-397502e5-0d58-459e-b438-30b0c91cb274 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:18:07.127610 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-397502e5-0d58-459e-b438-30b0c91cb274 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:18:07.128038 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-397502e5-0d58-459e-b438-30b0c91cb274 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:18:07.260568 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-397502e5-0d58-459e-b438-30b0c91cb274 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:18:07.269171 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-397502e5-0d58-459e-b438-30b0c91cb274 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1561 microversion: 2.1 time: 0.156402 Sep 10 13:18:07.269754 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3910/7826] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:18:07 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:19:20.793230 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=9 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:19:20.794891 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=11 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:19:20.796341 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=25 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:19:20.798494 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=36 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:19:20.804208 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-479f880f-3084-4bd9-b64b-48de10e512e1 req-90c1d708-92ce-43ad-88c9-bd2873b35718 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c19d476-fd8c-4883-b4fa-0090567ba91d", "tag": "d99b1fb6-ef7f-492e-96cd-70fa2b0bd2c4"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:19:20.808795 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d8fcec6f-7ae7-4569-b13d-4146f1409e3e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:19:20.809323 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d8fcec6f-7ae7-4569-b13d-4146f1409e3e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:19:20.823764 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d8fcec6f-7ae7-4569-b13d-4146f1409e3e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:19:20.827770 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d8fcec6f-7ae7-4569-b13d-4146f1409e3e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:19:20.828448 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d8fcec6f-7ae7-4569-b13d-4146f1409e3e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:19:20.829961 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d8fcec6f-7ae7-4569-b13d-4146f1409e3e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:19:20.831236 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-479f880f-3084-4bd9-b64b-48de10e512e1 req-90c1d708-92ce-43ad-88c9-bd2873b35718 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:19:20.831963 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-479f880f-3084-4bd9-b64b-48de10e512e1 req-90c1d708-92ce-43ad-88c9-bd2873b35718 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:19:20.832406 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-479f880f-3084-4bd9-b64b-48de10e512e1 req-90c1d708-92ce-43ad-88c9-bd2873b35718 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:19:20.835878 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d8fcec6f-7ae7-4569-b13d-4146f1409e3e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:19:20.842247 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d8fcec6f-7ae7-4569-b13d-4146f1409e3e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:19:20.851348 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-479f880f-3084-4bd9-b64b-48de10e512e1 req-90c1d708-92ce-43ad-88c9-bd2873b35718 service nova] Creating event network-changed:d99b1fb6-ef7f-492e-96cd-70fa2b0bd2c4 for instance 7c19d476-fd8c-4883-b4fa-0090567ba91d on n-h1-856895-1 Sep 10 13:19:20.857098 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-479f880f-3084-4bd9-b64b-48de10e512e1 req-90c1d708-92ce-43ad-88c9-bd2873b35718 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065658 Sep 10 13:19:20.858153 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3911/7827] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:19:20.872435 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d8fcec6f-7ae7-4569-b13d-4146f1409e3e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Going to try to terminate instance {{(pid=128776) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 13:19:20.971709 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d8fcec6f-7ae7-4569-b13d-4146f1409e3e tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 204 len: 0 microversion: 2.1 time: 0.183020 Sep 10 13:19:20.972450 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3917/7828] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 13:19:20 2022] DELETE /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 13:19:20.981228 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-c55544ad-6a70-4ee3-9507-d2fbdd87b796 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:19:20.981935 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-c55544ad-6a70-4ee3-9507-d2fbdd87b796 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:19:20.988563 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c55544ad-6a70-4ee3-9507-d2fbdd87b796 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:19:20.989310 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c55544ad-6a70-4ee3-9507-d2fbdd87b796 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:19:20.989948 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c55544ad-6a70-4ee3-9507-d2fbdd87b796 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:19:20.990853 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c55544ad-6a70-4ee3-9507-d2fbdd87b796 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:19:20.991755 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c55544ad-6a70-4ee3-9507-d2fbdd87b796 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:19:20.992358 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-c55544ad-6a70-4ee3-9507-d2fbdd87b796 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:19:21.133929 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-c55544ad-6a70-4ee3-9507-d2fbdd87b796 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:19:21.142326 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-c55544ad-6a70-4ee3-9507-d2fbdd87b796 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1567 microversion: 2.1 time: 0.164804 Sep 10 13:19:21.143094 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3912/7829] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:19:20 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 13:19:22.168113 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-4fc685d4-6832-44da-8c30-03e023edb263 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:19:22.168846 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-4fc685d4-6832-44da-8c30-03e023edb263 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:19:22.176017 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fc685d4-6832-44da-8c30-03e023edb263 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:19:22.176522 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fc685d4-6832-44da-8c30-03e023edb263 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:19:22.176978 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fc685d4-6832-44da-8c30-03e023edb263 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:19:22.177695 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fc685d4-6832-44da-8c30-03e023edb263 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:19:22.178169 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fc685d4-6832-44da-8c30-03e023edb263 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:19:22.178616 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-4fc685d4-6832-44da-8c30-03e023edb263 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:19:22.347495 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-4fc685d4-6832-44da-8c30-03e023edb263 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:19:22.356065 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-4fc685d4-6832-44da-8c30-03e023edb263 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1567 microversion: 2.1 time: 0.192339 Sep 10 13:19:22.356654 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3918/7830] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:19:22 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1567 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:19:23.215011 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-fd2d1b93-23d4-41e0-bb2c-b8fede3f329a req-abc5c5c3-0701-4abd-8b00-2b6f6e2ffe6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c19d476-fd8c-4883-b4fa-0090567ba91d", "name": "network-vif-deleted", "tag": "d99b1fb6-ef7f-492e-96cd-70fa2b0bd2c4"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:19:23.228850 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-fd2d1b93-23d4-41e0-bb2c-b8fede3f329a req-abc5c5c3-0701-4abd-8b00-2b6f6e2ffe6b service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:19:23.229317 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-fd2d1b93-23d4-41e0-bb2c-b8fede3f329a req-abc5c5c3-0701-4abd-8b00-2b6f6e2ffe6b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:19:23.229742 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-fd2d1b93-23d4-41e0-bb2c-b8fede3f329a req-abc5c5c3-0701-4abd-8b00-2b6f6e2ffe6b service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:19:23.242085 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-fd2d1b93-23d4-41e0-bb2c-b8fede3f329a req-abc5c5c3-0701-4abd-8b00-2b6f6e2ffe6b service nova] Creating event network-vif-deleted:d99b1fb6-ef7f-492e-96cd-70fa2b0bd2c4 for instance 7c19d476-fd8c-4883-b4fa-0090567ba91d on n-h1-856895-1 Sep 10 13:19:23.248369 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-fd2d1b93-23d4-41e0-bb2c-b8fede3f329a req-abc5c5c3-0701-4abd-8b00-2b6f6e2ffe6b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037161 Sep 10 13:19:23.248969 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3913/7831] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:19:23.380525 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-6542510c-3750-49ce-8efe-990742e9381a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:19:23.381149 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-6542510c-3750-49ce-8efe-990742e9381a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:19:23.388370 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6542510c-3750-49ce-8efe-990742e9381a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:19:23.389037 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6542510c-3750-49ce-8efe-990742e9381a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:19:23.389493 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6542510c-3750-49ce-8efe-990742e9381a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:19:23.390204 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6542510c-3750-49ce-8efe-990742e9381a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:19:23.390668 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6542510c-3750-49ce-8efe-990742e9381a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:19:23.391107 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-6542510c-3750-49ce-8efe-990742e9381a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:19:23.459079 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-6542510c-3750-49ce-8efe-990742e9381a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:19:23.467105 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-6542510c-3750-49ce-8efe-990742e9381a tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1218 microversion: 2.1 time: 0.090388 Sep 10 13:19:23.467654 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3919/7832] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:19:23 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:19:24.491247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e4ebcb10-9af7-4cc6-897d-bef830171c06 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:19:24.491965 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e4ebcb10-9af7-4cc6-897d-bef830171c06 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:19:24.499679 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e4ebcb10-9af7-4cc6-897d-bef830171c06 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:19:24.500163 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e4ebcb10-9af7-4cc6-897d-bef830171c06 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:19:24.500664 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e4ebcb10-9af7-4cc6-897d-bef830171c06 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:19:24.501403 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e4ebcb10-9af7-4cc6-897d-bef830171c06 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:19:24.501864 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e4ebcb10-9af7-4cc6-897d-bef830171c06 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:19:24.502293 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e4ebcb10-9af7-4cc6-897d-bef830171c06 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:19:24.565536 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e4ebcb10-9af7-4cc6-897d-bef830171c06 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:19:24.573604 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e4ebcb10-9af7-4cc6-897d-bef830171c06 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1218 microversion: 2.1 time: 0.086708 Sep 10 13:19:24.574187 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3914/7833] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:19:24 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:19:25.598260 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-02009384-a4a8-4721-94a6-b594f029f70b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:19:25.598827 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-02009384-a4a8-4721-94a6-b594f029f70b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:19:25.606148 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02009384-a4a8-4721-94a6-b594f029f70b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:19:25.606690 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02009384-a4a8-4721-94a6-b594f029f70b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:19:25.607153 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02009384-a4a8-4721-94a6-b594f029f70b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:19:25.607953 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02009384-a4a8-4721-94a6-b594f029f70b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:19:25.608433 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02009384-a4a8-4721-94a6-b594f029f70b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:19:25.608892 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-02009384-a4a8-4721-94a6-b594f029f70b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:19:25.678306 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-02009384-a4a8-4721-94a6-b594f029f70b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:19:25.686430 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-02009384-a4a8-4721-94a6-b594f029f70b tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1218 microversion: 2.1 time: 0.092678 Sep 10 13:19:25.687240 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3920/7834] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:19:25 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:19:26.709904 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-57a3f1f8-84c6-472d-bdb0-aacd832e6936 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:19:26.710524 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-57a3f1f8-84c6-472d-bdb0-aacd832e6936 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:19:26.717308 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57a3f1f8-84c6-472d-bdb0-aacd832e6936 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:19:26.717788 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57a3f1f8-84c6-472d-bdb0-aacd832e6936 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:19:26.718221 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57a3f1f8-84c6-472d-bdb0-aacd832e6936 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:19:26.718905 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57a3f1f8-84c6-472d-bdb0-aacd832e6936 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:19:26.719389 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57a3f1f8-84c6-472d-bdb0-aacd832e6936 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:19:26.719810 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-57a3f1f8-84c6-472d-bdb0-aacd832e6936 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:19:26.783398 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-57a3f1f8-84c6-472d-bdb0-aacd832e6936 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:19:26.791310 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-57a3f1f8-84c6-472d-bdb0-aacd832e6936 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1218 microversion: 2.1 time: 0.085362 Sep 10 13:19:26.792072 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3915/7835] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:19:26 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:19:27.814465 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c2690b3b-ef2b-43ba-b71d-3236f75997a1 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:19:27.815099 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c2690b3b-ef2b-43ba-b71d-3236f75997a1 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:19:27.822733 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c2690b3b-ef2b-43ba-b71d-3236f75997a1 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:19:27.823381 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c2690b3b-ef2b-43ba-b71d-3236f75997a1 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:19:27.824043 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c2690b3b-ef2b-43ba-b71d-3236f75997a1 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:19:27.824772 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c2690b3b-ef2b-43ba-b71d-3236f75997a1 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:19:27.825247 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c2690b3b-ef2b-43ba-b71d-3236f75997a1 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:19:27.825693 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c2690b3b-ef2b-43ba-b71d-3236f75997a1 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:19:27.862062 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c2690b3b-ef2b-43ba-b71d-3236f75997a1 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:19:27.862563 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c2690b3b-ef2b-43ba-b71d-3236f75997a1 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:19:27.863020 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c2690b3b-ef2b-43ba-b71d-3236f75997a1 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:19:27.863513 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.objects.instance [None req-c2690b3b-ef2b-43ba-b71d-3236f75997a1 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lazy-loading 'fault' on Instance uuid 7c19d476-fd8c-4883-b4fa-0090567ba91d {{(pid=128776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 13:19:27.908830 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c2690b3b-ef2b-43ba-b71d-3236f75997a1 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2e2041df59456d80ea0a6bd8b384bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85beefd475294c0581b222a74f700236', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:19:27.916320 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c2690b3b-ef2b-43ba-b71d-3236f75997a1 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 200 len: 1177 microversion: 2.1 time: 0.106061 Sep 10 13:19:27.916926 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3921/7836] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:19:27 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 1177 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:19:28.941134 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b9f85186-b622-4e8b-9eb6-92d3d62f64b3 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:19:28.941828 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-b9f85186-b622-4e8b-9eb6-92d3d62f64b3 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] [instance: 7c19d476-fd8c-4883-b4fa-0090567ba91d] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:19:28.948115 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9f85186-b622-4e8b-9eb6-92d3d62f64b3 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:19:28.948604 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9f85186-b622-4e8b-9eb6-92d3d62f64b3 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:19:28.949047 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9f85186-b622-4e8b-9eb6-92d3d62f64b3 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:19:28.949746 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9f85186-b622-4e8b-9eb6-92d3d62f64b3 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:19:28.950205 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9f85186-b622-4e8b-9eb6-92d3d62f64b3 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:19:28.950637 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-b9f85186-b622-4e8b-9eb6-92d3d62f64b3 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:19:28.967315 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-b9f85186-b622-4e8b-9eb6-92d3d62f64b3 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] HTTP exception thrown: Instance 7c19d476-fd8c-4883-b4fa-0090567ba91d could not be found. Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b9f85186-b622-4e8b-9eb6-92d3d62f64b3 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Request method failure captured: Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d HTTP/1.1 Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHIyx08eUlRvO5hlhBGEmrI0cL-28zmFuLb0huTx7RNf5PPYn6dsFCSUWgwz0IlPqNlxY7llgDLYJw2Nx0UkzgIeF11U5CKjT8HUYV0_80OOCvuJ0ExncWSFS52G-Akn7xhaE4USU6HiLcv-H6veCOFTkQ9jZvPz678ENrRIxhAmDX7E Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: 85beefd475294c0581b222a74f700236 Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-TestShelveInstance-66494582 Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/85beefd475294c0581b222a74f700236"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/85beefd475294c0581b222a74f700236"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_85beefd475294c0581b222a74f700236", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/85beefd475294c0581b222a74f700236"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-TestShelveInstance-66494582 Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: 85beefd475294c0581b222a74f700236 Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-TestShelveInstance-66494582 Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-TestShelveInstance-66494582-project Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: da2e2041df59456d80ea0a6bd8b384bd Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-TestShelveInstance-66494582-project Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance 7c19d476-fd8c-4883-b4fa-0090567ba91d could not be found. Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': '7c19d476-fd8c-4883-b4fa-0090567ba91d'} Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c19d476-fd8c-4883-b4fa-0090567ba91d could not be found. Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c19d476-fd8c-4883-b4fa-0090567ba91d could not be found. Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 13:19:28.969011 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 13:19:28.974454 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 13:19:28.974454 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 13:19:28.974454 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 13:19:28.974454 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 13:19:28.974454 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 13:19:28.974454 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c19d476-fd8c-4883-b4fa-0090567ba91d could not be found. Sep 10 13:19:28.974454 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 13:19:28.974454 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-b9f85186-b622-4e8b-9eb6-92d3d62f64b3 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Returning 404 to user: Instance 7c19d476-fd8c-4883-b4fa-0090567ba91d could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 13:19:28.974454 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-b9f85186-b622-4e8b-9eb6-92d3d62f64b3 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d" status: 404 len: 111 microversion: 2.1 time: 0.034245 Sep 10 13:19:28.974454 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3916/7837] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:19:28 2022] GET /compute/v2.1/servers/7c19d476-fd8c-4883-b4fa-0090567ba91d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 13:19:29.150901 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-adeb8f1e-6747-4fda-ac78-9fa8666d2e85 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] Calling method '.version_select at 0x7f40734def70>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:19:29.177740 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-adeb8f1e-6747-4fda-ac78-9fa8666d2e85 tempest-TestShelveInstance-66494582 tempest-TestShelveInstance-66494582-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-59845812" status: 202 len: 0 microversion: 2.1 time: 0.030861 Sep 10 13:19:29.178837 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3922/7838] 10.222.0.23 () {58 vars in 1248 bytes} [Sat Sep 10 13:19:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-59845812 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 10 13:19:46.350032 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=12 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:19:46.353729 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=24 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:19:46.610226 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-802a425e-2289-4967-af44-8c1594af8171 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Action: 'create', calling method: .version_select at 0x7f4071d53f70>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1927341340", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkiqz6lZyEJH1tqCvYy+jKKZr2EvYMXjRJQb2r3zN7TjGCMQt3cxM1GF89h3gy+KmNzmrksi1OqycE6t5QCUI2L7uqataymQldMFQw1P9waoxxq5Dgd3CRdO7HCMHhzfA=="}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:19:46.635076 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-802a425e-2289-4967-af44-8c1594af8171 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Getting quotas for project c174a564e3a8471590397f96e291e5c7. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 13:19:46.643647 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.quota [None req-802a425e-2289-4967-af44-8c1594af8171 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Getting quotas for user 8fb57ec276644725a782481a03ca1962 and project c174a564e3a8471590397f96e291e5c7. Resources: {'key_pairs'} {{(pid=128777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 13:19:46.695524 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-802a425e-2289-4967-af44-8c1594af8171 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.355018 Sep 10 13:19:46.696964 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3917/7839] 10.222.0.23 () {60 vars in 1159 bytes} [Sat Sep 10 13:19:46 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:19:47.711590 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:19:47.712360 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:19:47.716991 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-566f013d-03ab-422a-abb6-695181ad40c9 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-194877943", "imageRef": "c23d4d62-7ab9-4623-9273-7f44582aa2e1", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1927341340", "security_groups": [{"name": "tempest-secgroup-smoke-238718227"}], "networks": [{"uuid": "caa0cd3d-5f91-4e0f-b77f-326ef3b2a99b"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:19:47.826237 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-566f013d-03ab-422a-abb6-695181ad40c9 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] validate_networks() for [('caa0cd3d-5f91-4e0f-b77f-326ef3b2a99b', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 13:19:48.309502 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-566f013d-03ab-422a-abb6-695181ad40c9 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 13:19:48.309980 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-566f013d-03ab-422a-abb6-695181ad40c9 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 13:19:48.310508 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-566f013d-03ab-422a-abb6-695181ad40c9 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 13:19:48.310940 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-566f013d-03ab-422a-abb6-695181ad40c9 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 13:19:48.311411 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-566f013d-03ab-422a-abb6-695181ad40c9 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 13:19:48.321840 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-566f013d-03ab-422a-abb6-695181ad40c9 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:19:48.321840 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-566f013d-03ab-422a-abb6-695181ad40c9 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:19:48.322538 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-566f013d-03ab-422a-abb6-695181ad40c9 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:19:48.323399 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-566f013d-03ab-422a-abb6-695181ad40c9 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:19:48.323954 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-566f013d-03ab-422a-abb6-695181ad40c9 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:19:48.324475 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-566f013d-03ab-422a-abb6-695181ad40c9 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:19:48.343200 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-566f013d-03ab-422a-abb6-695181ad40c9 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Getting quotas for project c174a564e3a8471590397f96e291e5c7. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 13:19:48.349886 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-566f013d-03ab-422a-abb6-695181ad40c9 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Getting quotas for user 8fb57ec276644725a782481a03ca1962 and project c174a564e3a8471590397f96e291e5c7. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 13:19:48.363241 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-566f013d-03ab-422a-abb6-695181ad40c9 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 13:19:48.365623 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-566f013d-03ab-422a-abb6-695181ad40c9 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: ce0c8431-ebfc-42ff-abc9-112981ca093e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c23d4d62-7ab9-4623-9273-7f44582aa2e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 13:19:48.414753 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-566f013d-03ab-422a-abb6-695181ad40c9 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.704382 Sep 10 13:19:48.415443 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3923/7840] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 13:19:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 13:19:48.427774 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-33dc3474-a68a-485b-b3cf-09c84f03a09e tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:19:48.428402 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-33dc3474-a68a-485b-b3cf-09c84f03a09e tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: ce0c8431-ebfc-42ff-abc9-112981ca093e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:19:48.487337 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-33dc3474-a68a-485b-b3cf-09c84f03a09e tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb57ec276644725a782481a03ca1962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c174a564e3a8471590397f96e291e5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:19:48.495772 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-33dc3474-a68a-485b-b3cf-09c84f03a09e tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "GET /compute/v2.1/servers/ce0c8431-ebfc-42ff-abc9-112981ca093e" status: 200 len: 1248 microversion: 2.1 time: 0.072469 Sep 10 13:19:48.496687 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3918/7841] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:19:48 2022] GET /compute/v2.1/servers/ce0c8431-ebfc-42ff-abc9-112981ca093e => generated 1248 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 13:19:49.522354 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-f057dfc2-6fa5-420a-a5aa-53ad56420221 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:19:49.523852 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-f057dfc2-6fa5-420a-a5aa-53ad56420221 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: ce0c8431-ebfc-42ff-abc9-112981ca093e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:19:49.530755 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f057dfc2-6fa5-420a-a5aa-53ad56420221 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:19:49.532057 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f057dfc2-6fa5-420a-a5aa-53ad56420221 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:19:49.532560 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f057dfc2-6fa5-420a-a5aa-53ad56420221 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:19:49.533524 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f057dfc2-6fa5-420a-a5aa-53ad56420221 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:19:49.534136 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f057dfc2-6fa5-420a-a5aa-53ad56420221 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:19:49.534802 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-f057dfc2-6fa5-420a-a5aa-53ad56420221 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:19:49.644699 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-f057dfc2-6fa5-420a-a5aa-53ad56420221 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb57ec276644725a782481a03ca1962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c174a564e3a8471590397f96e291e5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:19:49.664922 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-f057dfc2-6fa5-420a-a5aa-53ad56420221 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "GET /compute/v2.1/servers/ce0c8431-ebfc-42ff-abc9-112981ca093e" status: 200 len: 1308 microversion: 2.1 time: 0.143668 Sep 10 13:19:49.667104 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3924/7842] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:19:49 2022] GET /compute/v2.1/servers/ce0c8431-ebfc-42ff-abc9-112981ca093e => generated 1308 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:19:50.690370 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5672783d-0fe7-4cf3-84ea-107cfc96ae41 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:19:50.691145 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5672783d-0fe7-4cf3-84ea-107cfc96ae41 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: ce0c8431-ebfc-42ff-abc9-112981ca093e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:19:50.701109 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5672783d-0fe7-4cf3-84ea-107cfc96ae41 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:19:50.701611 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5672783d-0fe7-4cf3-84ea-107cfc96ae41 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:19:50.702060 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5672783d-0fe7-4cf3-84ea-107cfc96ae41 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:19:50.702777 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5672783d-0fe7-4cf3-84ea-107cfc96ae41 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:19:50.703859 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5672783d-0fe7-4cf3-84ea-107cfc96ae41 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:19:50.704326 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-5672783d-0fe7-4cf3-84ea-107cfc96ae41 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:19:51.244238 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5672783d-0fe7-4cf3-84ea-107cfc96ae41 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb57ec276644725a782481a03ca1962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c174a564e3a8471590397f96e291e5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:19:51.252562 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5672783d-0fe7-4cf3-84ea-107cfc96ae41 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "GET /compute/v2.1/servers/ce0c8431-ebfc-42ff-abc9-112981ca093e" status: 200 len: 1373 microversion: 2.1 time: 0.567426 Sep 10 13:19:51.253149 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3919/7843] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:19:50 2022] GET /compute/v2.1/servers/ce0c8431-ebfc-42ff-abc9-112981ca093e => generated 1373 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:19:51.671288 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-3338fbb3-0611-4423-84ef-ffbb9614ceed req-f4723612-8faf-4f93-b4ad-d920e3b0983d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce0c8431-ebfc-42ff-abc9-112981ca093e", "tag": "06fbfad4-2c2e-4fdb-99f8-f6834f2228ef"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:19:51.681567 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-3338fbb3-0611-4423-84ef-ffbb9614ceed req-f4723612-8faf-4f93-b4ad-d920e3b0983d service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:19:51.682063 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-3338fbb3-0611-4423-84ef-ffbb9614ceed req-f4723612-8faf-4f93-b4ad-d920e3b0983d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:19:51.682519 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-3338fbb3-0611-4423-84ef-ffbb9614ceed req-f4723612-8faf-4f93-b4ad-d920e3b0983d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:19:51.694813 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-3338fbb3-0611-4423-84ef-ffbb9614ceed req-f4723612-8faf-4f93-b4ad-d920e3b0983d service nova] Creating event network-changed:06fbfad4-2c2e-4fdb-99f8-f6834f2228ef for instance ce0c8431-ebfc-42ff-abc9-112981ca093e on n-h1-856895-1 Sep 10 13:19:51.699824 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-3338fbb3-0611-4423-84ef-ffbb9614ceed req-f4723612-8faf-4f93-b4ad-d920e3b0983d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104795 Sep 10 13:19:51.700422 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3925/7844] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 13:19:52.276854 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6393d168-b6f7-45a4-a08d-4a44fcf3bcf8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:19:52.277585 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6393d168-b6f7-45a4-a08d-4a44fcf3bcf8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: ce0c8431-ebfc-42ff-abc9-112981ca093e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:19:52.284785 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6393d168-b6f7-45a4-a08d-4a44fcf3bcf8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:19:52.285389 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6393d168-b6f7-45a4-a08d-4a44fcf3bcf8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:19:52.285906 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6393d168-b6f7-45a4-a08d-4a44fcf3bcf8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:19:52.286692 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6393d168-b6f7-45a4-a08d-4a44fcf3bcf8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:19:52.287251 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6393d168-b6f7-45a4-a08d-4a44fcf3bcf8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:19:52.287762 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6393d168-b6f7-45a4-a08d-4a44fcf3bcf8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:19:52.429309 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-6393d168-b6f7-45a4-a08d-4a44fcf3bcf8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb57ec276644725a782481a03ca1962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c174a564e3a8471590397f96e291e5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:19:52.437042 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6393d168-b6f7-45a4-a08d-4a44fcf3bcf8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "GET /compute/v2.1/servers/ce0c8431-ebfc-42ff-abc9-112981ca093e" status: 200 len: 1373 microversion: 2.1 time: 0.164336 Sep 10 13:19:52.438141 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3920/7845] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:19:52 2022] GET /compute/v2.1/servers/ce0c8431-ebfc-42ff-abc9-112981ca093e => generated 1373 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:19:53.464112 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-7086432a-83e0-4128-bc3d-4f97e20314b2 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:19:53.464853 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-7086432a-83e0-4128-bc3d-4f97e20314b2 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: ce0c8431-ebfc-42ff-abc9-112981ca093e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:19:53.472585 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7086432a-83e0-4128-bc3d-4f97e20314b2 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:19:53.473100 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7086432a-83e0-4128-bc3d-4f97e20314b2 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:19:53.473566 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7086432a-83e0-4128-bc3d-4f97e20314b2 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:19:53.474292 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7086432a-83e0-4128-bc3d-4f97e20314b2 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:19:53.474767 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7086432a-83e0-4128-bc3d-4f97e20314b2 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:19:53.475248 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-7086432a-83e0-4128-bc3d-4f97e20314b2 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:19:53.681839 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-7086432a-83e0-4128-bc3d-4f97e20314b2 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb57ec276644725a782481a03ca1962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c174a564e3a8471590397f96e291e5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:19:53.689951 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-7086432a-83e0-4128-bc3d-4f97e20314b2 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "GET /compute/v2.1/servers/ce0c8431-ebfc-42ff-abc9-112981ca093e" status: 200 len: 1373 microversion: 2.1 time: 0.232600 Sep 10 13:19:53.690541 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3926/7846] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:19:53 2022] GET /compute/v2.1/servers/ce0c8431-ebfc-42ff-abc9-112981ca093e => generated 1373 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:19:54.715273 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8546a3c1-3f63-438c-a0e5-a4743442aac4 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:19:54.715890 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8546a3c1-3f63-438c-a0e5-a4743442aac4 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: ce0c8431-ebfc-42ff-abc9-112981ca093e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:19:54.723340 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8546a3c1-3f63-438c-a0e5-a4743442aac4 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:19:54.723340 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8546a3c1-3f63-438c-a0e5-a4743442aac4 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:19:54.723761 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8546a3c1-3f63-438c-a0e5-a4743442aac4 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:19:54.724463 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8546a3c1-3f63-438c-a0e5-a4743442aac4 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:19:54.724922 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8546a3c1-3f63-438c-a0e5-a4743442aac4 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:19:54.725352 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8546a3c1-3f63-438c-a0e5-a4743442aac4 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:19:54.875699 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8546a3c1-3f63-438c-a0e5-a4743442aac4 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb57ec276644725a782481a03ca1962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c174a564e3a8471590397f96e291e5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:19:54.884864 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8546a3c1-3f63-438c-a0e5-a4743442aac4 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "GET /compute/v2.1/servers/ce0c8431-ebfc-42ff-abc9-112981ca093e" status: 200 len: 1373 microversion: 2.1 time: 0.173456 Sep 10 13:19:54.885602 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3921/7847] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:19:54 2022] GET /compute/v2.1/servers/ce0c8431-ebfc-42ff-abc9-112981ca093e => generated 1373 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:19:55.909311 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-2ccb6cb1-72d3-4a16-a298-cead9bda71e8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:19:55.909883 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-2ccb6cb1-72d3-4a16-a298-cead9bda71e8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: ce0c8431-ebfc-42ff-abc9-112981ca093e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:19:55.916799 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2ccb6cb1-72d3-4a16-a298-cead9bda71e8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:19:55.917299 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2ccb6cb1-72d3-4a16-a298-cead9bda71e8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:19:55.917752 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2ccb6cb1-72d3-4a16-a298-cead9bda71e8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:19:55.918460 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2ccb6cb1-72d3-4a16-a298-cead9bda71e8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:19:55.918931 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2ccb6cb1-72d3-4a16-a298-cead9bda71e8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:19:55.919399 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-2ccb6cb1-72d3-4a16-a298-cead9bda71e8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:19:56.059536 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-2ccb6cb1-72d3-4a16-a298-cead9bda71e8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb57ec276644725a782481a03ca1962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c174a564e3a8471590397f96e291e5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:19:56.068989 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-2ccb6cb1-72d3-4a16-a298-cead9bda71e8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "GET /compute/v2.1/servers/ce0c8431-ebfc-42ff-abc9-112981ca093e" status: 200 len: 1373 microversion: 2.1 time: 0.164089 Sep 10 13:19:56.069568 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3927/7848] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:19:55 2022] GET /compute/v2.1/servers/ce0c8431-ebfc-42ff-abc9-112981ca093e => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:19:56.291407 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-2c7340ed-226c-49f0-b4bc-8835d5d5d95f req-9fa88c29-7907-49e3-bcbd-2a24227b3ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce0c8431-ebfc-42ff-abc9-112981ca093e", "name": "network-vif-plugged", "status": "completed", "tag": "06fbfad4-2c2e-4fdb-99f8-f6834f2228ef"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:19:56.302150 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-2c7340ed-226c-49f0-b4bc-8835d5d5d95f req-9fa88c29-7907-49e3-bcbd-2a24227b3ee2 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:19:56.302646 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-2c7340ed-226c-49f0-b4bc-8835d5d5d95f req-9fa88c29-7907-49e3-bcbd-2a24227b3ee2 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:19:56.303050 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-2c7340ed-226c-49f0-b4bc-8835d5d5d95f req-9fa88c29-7907-49e3-bcbd-2a24227b3ee2 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:19:56.314905 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-2c7340ed-226c-49f0-b4bc-8835d5d5d95f req-9fa88c29-7907-49e3-bcbd-2a24227b3ee2 service nova] Creating event network-vif-plugged:06fbfad4-2c2e-4fdb-99f8-f6834f2228ef for instance ce0c8431-ebfc-42ff-abc9-112981ca093e on n-h1-856895-1 Sep 10 13:19:56.319925 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-2c7340ed-226c-49f0-b4bc-8835d5d5d95f req-9fa88c29-7907-49e3-bcbd-2a24227b3ee2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032304 Sep 10 13:19:56.320526 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3922/7849] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:19:57.092035 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-e1c98737-2e61-4ccf-adbc-c2e8c7a4c91c tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:19:57.092661 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-e1c98737-2e61-4ccf-adbc-c2e8c7a4c91c tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: ce0c8431-ebfc-42ff-abc9-112981ca093e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:19:57.100683 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e1c98737-2e61-4ccf-adbc-c2e8c7a4c91c tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:19:57.101155 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e1c98737-2e61-4ccf-adbc-c2e8c7a4c91c tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:19:57.101606 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e1c98737-2e61-4ccf-adbc-c2e8c7a4c91c tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:19:57.102310 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e1c98737-2e61-4ccf-adbc-c2e8c7a4c91c tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:19:57.102777 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e1c98737-2e61-4ccf-adbc-c2e8c7a4c91c tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:19:57.103240 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-e1c98737-2e61-4ccf-adbc-c2e8c7a4c91c tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:19:57.237760 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-e1c98737-2e61-4ccf-adbc-c2e8c7a4c91c tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb57ec276644725a782481a03ca1962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c174a564e3a8471590397f96e291e5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:19:57.245412 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-e1c98737-2e61-4ccf-adbc-c2e8c7a4c91c tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "GET /compute/v2.1/servers/ce0c8431-ebfc-42ff-abc9-112981ca093e" status: 200 len: 1373 microversion: 2.1 time: 0.157317 Sep 10 13:19:57.246003 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3928/7850] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:19:57 2022] GET /compute/v2.1/servers/ce0c8431-ebfc-42ff-abc9-112981ca093e => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:19:58.271658 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-607bcf48-8f70-4e0c-b36a-cfe461fe8388 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:19:58.272552 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-607bcf48-8f70-4e0c-b36a-cfe461fe8388 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: ce0c8431-ebfc-42ff-abc9-112981ca093e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:19:58.278731 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-607bcf48-8f70-4e0c-b36a-cfe461fe8388 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:19:58.279237 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-607bcf48-8f70-4e0c-b36a-cfe461fe8388 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:19:58.279678 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-607bcf48-8f70-4e0c-b36a-cfe461fe8388 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:19:58.280366 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-607bcf48-8f70-4e0c-b36a-cfe461fe8388 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:19:58.281458 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-607bcf48-8f70-4e0c-b36a-cfe461fe8388 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:19:58.282102 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-607bcf48-8f70-4e0c-b36a-cfe461fe8388 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:19:58.414263 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-607bcf48-8f70-4e0c-b36a-cfe461fe8388 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb57ec276644725a782481a03ca1962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c174a564e3a8471590397f96e291e5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:19:58.422228 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-607bcf48-8f70-4e0c-b36a-cfe461fe8388 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "GET /compute/v2.1/servers/ce0c8431-ebfc-42ff-abc9-112981ca093e" status: 200 len: 1558 microversion: 2.1 time: 0.156796 Sep 10 13:19:58.422803 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3923/7851] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:19:58 2022] GET /compute/v2.1/servers/ce0c8431-ebfc-42ff-abc9-112981ca093e => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:19:58.444486 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-c0a11dbd-4a68-4d60-b5e4-7007cbf32f51 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:19:58.445129 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-c0a11dbd-4a68-4d60-b5e4-7007cbf32f51 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: ce0c8431-ebfc-42ff-abc9-112981ca093e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:19:58.447319 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:19:58.448017 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=6 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:19:58.454642 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0a11dbd-4a68-4d60-b5e4-7007cbf32f51 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:19:58.455149 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0a11dbd-4a68-4d60-b5e4-7007cbf32f51 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:19:58.455661 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0a11dbd-4a68-4d60-b5e4-7007cbf32f51 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:19:58.456379 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0a11dbd-4a68-4d60-b5e4-7007cbf32f51 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:19:58.456858 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0a11dbd-4a68-4d60-b5e4-7007cbf32f51 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:19:58.457309 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-c0a11dbd-4a68-4d60-b5e4-7007cbf32f51 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:19:58.588640 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-c0a11dbd-4a68-4d60-b5e4-7007cbf32f51 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb57ec276644725a782481a03ca1962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c174a564e3a8471590397f96e291e5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:19:58.597194 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-c0a11dbd-4a68-4d60-b5e4-7007cbf32f51 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "GET /compute/v2.1/servers/ce0c8431-ebfc-42ff-abc9-112981ca093e" status: 200 len: 1558 microversion: 2.1 time: 0.156792 Sep 10 13:19:58.597778 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3929/7852] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:19:58 2022] GET /compute/v2.1/servers/ce0c8431-ebfc-42ff-abc9-112981ca093e => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:20:00.231173 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-8b9fa825-174c-4d8d-8780-8fd41a10943e req-e885e73b-8f4d-4030-8d66-9515bda5ea9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce0c8431-ebfc-42ff-abc9-112981ca093e", "tag": "06fbfad4-2c2e-4fdb-99f8-f6834f2228ef"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:20:00.236922 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=6 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:20:00.244304 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8b9fa825-174c-4d8d-8780-8fd41a10943e req-e885e73b-8f4d-4030-8d66-9515bda5ea9a service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:20:00.244781 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8b9fa825-174c-4d8d-8780-8fd41a10943e req-e885e73b-8f4d-4030-8d66-9515bda5ea9a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:20:00.245210 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8b9fa825-174c-4d8d-8780-8fd41a10943e req-e885e73b-8f4d-4030-8d66-9515bda5ea9a service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:20:00.258016 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-8b9fa825-174c-4d8d-8780-8fd41a10943e req-e885e73b-8f4d-4030-8d66-9515bda5ea9a service nova] Creating event network-changed:06fbfad4-2c2e-4fdb-99f8-f6834f2228ef for instance ce0c8431-ebfc-42ff-abc9-112981ca093e on n-h1-856895-1 Sep 10 13:20:00.263601 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-8b9fa825-174c-4d8d-8780-8fd41a10943e req-e885e73b-8f4d-4030-8d66-9515bda5ea9a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036422 Sep 10 13:20:00.264345 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3924/7853] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:22:26.442169 n-d-856895-1 devstack@n-api.service[128776]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8e1e649-5477-464a-a830-120923e99a14] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 10 13:22:26.443239 n-d-856895-1 devstack@n-api.service[128776]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f7df2fea-8ccb-440d-aacb-6daa54c00e88] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 10 13:22:26.443707 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:22:26.444590 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=34 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:22:26.445987 n-d-856895-1 devstack@n-api.service[128776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 10 13:22:26.446134 n-d-856895-1 devstack@n-api.service[128776]: Sat Sep 10 13:22:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ce0c8431-ebfc-42ff-abc9-112981ca093e/action (ip 10.222.0.23) !!! Sep 10 13:22:26.447995 n-d-856895-1 devstack@n-api.service[128776]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 10 13:22:26.448123 n-d-856895-1 devstack@n-api.service[128776]: Sat Sep 10 13:22:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ce0c8431-ebfc-42ff-abc9-112981ca093e/action (ip 10.222.0.23) !!! Sep 10 13:22:26.453030 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-433d7ccb-771e-4d6c-822b-88de059a5469 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-864624933"}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:22:26.455396 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-433d7ccb-771e-4d6c-822b-88de059a5469 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: ce0c8431-ebfc-42ff-abc9-112981ca093e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:22:26.474643 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-433d7ccb-771e-4d6c-822b-88de059a5469 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:22:26.475180 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-433d7ccb-771e-4d6c-822b-88de059a5469 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:22:26.475634 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-433d7ccb-771e-4d6c-822b-88de059a5469 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:22:26.476353 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-433d7ccb-771e-4d6c-822b-88de059a5469 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:22:26.476856 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-433d7ccb-771e-4d6c-822b-88de059a5469 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:22:26.477298 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-433d7ccb-771e-4d6c-822b-88de059a5469 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:22:26.685014 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-433d7ccb-771e-4d6c-822b-88de059a5469 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "POST /compute/v2.1/servers/ce0c8431-ebfc-42ff-abc9-112981ca093e/action" status: 202 len: 0 microversion: 2.1 time: 0.245051 Sep 10 13:22:26.685715 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3930/7854] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 13:22:26 2022] POST /compute/v2.1/servers/ce0c8431-ebfc-42ff-abc9-112981ca093e/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 10 13:22:35.116882 n-d-856895-1 devstack@n-api.service[128777]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9df9aef1-f60c-4e89-81ef-a70ffef5e10e] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 10 13:22:35.117698 n-d-856895-1 devstack@n-api.service[128777]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ff629e48-f4d3-4091-a343-d4a4670d06d6] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 10 13:22:35.118255 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:22:35.119506 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=28 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:22:35.120843 n-d-856895-1 devstack@n-api.service[128777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 10 13:22:35.121260 n-d-856895-1 devstack@n-api.service[128777]: Sat Sep 10 13:22:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.23) !!! Sep 10 13:22:35.122760 n-d-856895-1 devstack@n-api.service[128777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 10 13:22:35.123048 n-d-856895-1 devstack@n-api.service[128777]: Sat Sep 10 13:22:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.23) !!! Sep 10 13:22:35.124555 n-d-856895-1 devstack@n-api.service[128777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 10 13:22:35.130259 n-d-856895-1 devstack@n-api.service[128777]: Sat Sep 10 13:22:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.23) !!! Sep 10 13:22:35.267437 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-467b8c80-3642-456e-aed9-0be0c25d0fa4 req-3c22b5b4-75e5-4ac3-8660-48875ebca3df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce0c8431-ebfc-42ff-abc9-112981ca093e", "name": "network-vif-plugged", "status": "completed", "tag": "06fbfad4-2c2e-4fdb-99f8-f6834f2228ef"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:22:35.282231 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-467b8c80-3642-456e-aed9-0be0c25d0fa4 req-3c22b5b4-75e5-4ac3-8660-48875ebca3df service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:22:35.282978 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-467b8c80-3642-456e-aed9-0be0c25d0fa4 req-3c22b5b4-75e5-4ac3-8660-48875ebca3df service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:22:35.283789 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-467b8c80-3642-456e-aed9-0be0c25d0fa4 req-3c22b5b4-75e5-4ac3-8660-48875ebca3df service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:22:35.296208 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-467b8c80-3642-456e-aed9-0be0c25d0fa4 req-3c22b5b4-75e5-4ac3-8660-48875ebca3df service nova] Creating event network-vif-plugged:06fbfad4-2c2e-4fdb-99f8-f6834f2228ef for instance ce0c8431-ebfc-42ff-abc9-112981ca093e on n-h1-856895-1 Sep 10 13:22:35.305329 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-467b8c80-3642-456e-aed9-0be0c25d0fa4 req-3c22b5b4-75e5-4ac3-8660-48875ebca3df service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191091 Sep 10 13:22:35.306117 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3925/7855] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:22:45.345703 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:22:45.346519 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:22:45.351793 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-11d51407-2e1b-4f8c-b4d1-ae01752a5530 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1594348116", "imageRef": "0fc563c8-3ac6-46b4-83b1-4c4f3b0868a0", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1927341340", "security_groups": [{"name": "tempest-secgroup-smoke-238718227"}], "networks": [{"uuid": "caa0cd3d-5f91-4e0f-b77f-326ef3b2a99b"}]}} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:22:45.377274 n-d-856895-1 devstack@n-api.service[128776]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8e1e649-5477-464a-a830-120923e99a14] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 39610. Sep 10 13:22:45.378087 n-d-856895-1 devstack@n-api.service[128776]: INFO oslo.messaging._drivers.impl_rabbit [-] [f7df2fea-8ccb-440d-aacb-6daa54c00e88] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 39612. Sep 10 13:22:45.465921 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.network.neutron [None req-11d51407-2e1b-4f8c-b4d1-ae01752a5530 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] validate_networks() for [('caa0cd3d-5f91-4e0f-b77f-326ef3b2a99b', None, None, None, None, None)] {{(pid=128776) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 10 13:22:45.851985 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-11d51407-2e1b-4f8c-b4d1-ae01752a5530 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Flavor limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 10 13:22:45.852422 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-11d51407-2e1b-4f8c-b4d1-ae01752a5530 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Image limits 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 10 13:22:45.852909 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-11d51407-2e1b-4f8c-b4d1-ae01752a5530 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Flavor pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 10 13:22:45.853331 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-11d51407-2e1b-4f8c-b4d1-ae01752a5530 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Image pref 0:0:0 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 10 13:22:45.853757 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.virt.hardware [None req-11d51407-2e1b-4f8c-b4d1-ae01752a5530 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 10 13:22:45.862784 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-11d51407-2e1b-4f8c-b4d1-ae01752a5530 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:22:45.863940 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-11d51407-2e1b-4f8c-b4d1-ae01752a5530 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:22:45.864403 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-11d51407-2e1b-4f8c-b4d1-ae01752a5530 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:22:45.865183 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-11d51407-2e1b-4f8c-b4d1-ae01752a5530 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:22:45.865749 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-11d51407-2e1b-4f8c-b4d1-ae01752a5530 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:22:45.866224 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-11d51407-2e1b-4f8c-b4d1-ae01752a5530 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:22:45.883727 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-11d51407-2e1b-4f8c-b4d1-ae01752a5530 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Getting quotas for project c174a564e3a8471590397f96e291e5c7. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 10 13:22:45.888953 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.quota [None req-11d51407-2e1b-4f8c-b4d1-ae01752a5530 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Getting quotas for user 8fb57ec276644725a782481a03ca1962 and project c174a564e3a8471590397f96e291e5c7. Resources: {'instances', 'ram', 'cores'} {{(pid=128776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 10 13:22:45.901556 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-11d51407-2e1b-4f8c-b4d1-ae01752a5530 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Going to run 1 instances... {{(pid=128776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 10 13:22:45.904097 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-11d51407-2e1b-4f8c-b4d1-ae01752a5530 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: c7c23ab4-d32e-4ddf-ac12-ede9201c2b97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0fc563c8-3ac6-46b4-83b1-4c4f3b0868a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 10 13:22:45.952912 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-11d51407-2e1b-4f8c-b4d1-ae01752a5530 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.609360 Sep 10 13:22:45.953578 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3931/7856] 10.222.0.23 () {60 vars in 1147 bytes} [Sat Sep 10 13:22:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 10 13:22:45.965488 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:22:45.966425 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:22:45.974991 n-d-856895-1 devstack@n-api.service[128777]: INFO oslo.messaging._drivers.impl_rabbit [-] [9df9aef1-f60c-4e89-81ef-a70ffef5e10e] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 39624. Sep 10 13:22:45.979805 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-11775351-6a68-4abd-bc55-516986c183ca tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:22:45.980526 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-11775351-6a68-4abd-bc55-516986c183ca tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: c7c23ab4-d32e-4ddf-ac12-ede9201c2b97] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:22:45.990411 n-d-856895-1 devstack@n-api.service[128777]: INFO oslo.messaging._drivers.impl_rabbit [-] [ff629e48-f4d3-4091-a343-d4a4670d06d6] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 39626. Sep 10 13:22:46.042639 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-11775351-6a68-4abd-bc55-516986c183ca tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb57ec276644725a782481a03ca1962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c174a564e3a8471590397f96e291e5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:22:46.049511 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-11775351-6a68-4abd-bc55-516986c183ca tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97" status: 200 len: 1249 microversion: 2.1 time: 0.087690 Sep 10 13:22:46.050094 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3926/7857] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:22:45 2022] GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97 => generated 1249 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:22:47.073934 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-81588b9b-5cd5-4b78-8918-e24d76deba0c tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:22:47.075233 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-81588b9b-5cd5-4b78-8918-e24d76deba0c tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: c7c23ab4-d32e-4ddf-ac12-ede9201c2b97] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:22:47.145929 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-45aca9ed-9579-4971-8ecb-6672a6a5d127 req-4bd3ca9d-ce6f-4a2a-b9ea-47ac4d992d2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce0c8431-ebfc-42ff-abc9-112981ca093e", "name": "network-vif-unplugged", "status": "completed", "tag": "06fbfad4-2c2e-4fdb-99f8-f6834f2228ef"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:22:47.150810 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-81588b9b-5cd5-4b78-8918-e24d76deba0c tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb57ec276644725a782481a03ca1962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c174a564e3a8471590397f96e291e5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:22:47.159492 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-45aca9ed-9579-4971-8ecb-6672a6a5d127 req-4bd3ca9d-ce6f-4a2a-b9ea-47ac4d992d2d service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:22:47.160093 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-81588b9b-5cd5-4b78-8918-e24d76deba0c tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97" status: 200 len: 1249 microversion: 2.1 time: 0.090825 Sep 10 13:22:47.160328 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-45aca9ed-9579-4971-8ecb-6672a6a5d127 req-4bd3ca9d-ce6f-4a2a-b9ea-47ac4d992d2d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:22:47.160735 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-45aca9ed-9579-4971-8ecb-6672a6a5d127 req-4bd3ca9d-ce6f-4a2a-b9ea-47ac4d992d2d service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:22:47.161004 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3932/7858] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:22:47 2022] GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97 => generated 1249 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:22:47.171922 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-45aca9ed-9579-4971-8ecb-6672a6a5d127 req-4bd3ca9d-ce6f-4a2a-b9ea-47ac4d992d2d service nova] Creating event network-vif-unplugged:06fbfad4-2c2e-4fdb-99f8-f6834f2228ef for instance ce0c8431-ebfc-42ff-abc9-112981ca093e on n-h1-856895-1 Sep 10 13:22:47.177219 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-45aca9ed-9579-4971-8ecb-6672a6a5d127 req-4bd3ca9d-ce6f-4a2a-b9ea-47ac4d992d2d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036461 Sep 10 13:22:47.177825 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3927/7859] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 13:22:48.182424 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-536c1764-1d60-429d-bb97-c79836407d97 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:22:48.183089 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-536c1764-1d60-429d-bb97-c79836407d97 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: c7c23ab4-d32e-4ddf-ac12-ede9201c2b97] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:22:48.237947 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-536c1764-1d60-429d-bb97-c79836407d97 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb57ec276644725a782481a03ca1962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c174a564e3a8471590397f96e291e5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:22:48.245702 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-536c1764-1d60-429d-bb97-c79836407d97 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97" status: 200 len: 1249 microversion: 2.1 time: 0.067225 Sep 10 13:22:48.246279 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3933/7860] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:22:48 2022] GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97 => generated 1249 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:22:49.271155 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-5061b19b-939a-48ee-8349-34b044b10884 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:22:49.271875 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-5061b19b-939a-48ee-8349-34b044b10884 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: c7c23ab4-d32e-4ddf-ac12-ede9201c2b97] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:22:49.326281 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-5061b19b-939a-48ee-8349-34b044b10884 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb57ec276644725a782481a03ca1962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c174a564e3a8471590397f96e291e5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:22:49.333408 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-5061b19b-939a-48ee-8349-34b044b10884 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97" status: 200 len: 1249 microversion: 2.1 time: 0.067879 Sep 10 13:22:49.334070 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3928/7861] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:22:49 2022] GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97 => generated 1249 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:22:50.357096 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-1ba82be8-210c-469a-a995-101e6f3f14c5 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:22:50.357654 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-1ba82be8-210c-469a-a995-101e6f3f14c5 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: c7c23ab4-d32e-4ddf-ac12-ede9201c2b97] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:22:50.366688 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1ba82be8-210c-469a-a995-101e6f3f14c5 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:22:50.367292 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1ba82be8-210c-469a-a995-101e6f3f14c5 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:22:50.367748 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1ba82be8-210c-469a-a995-101e6f3f14c5 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:22:50.368461 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1ba82be8-210c-469a-a995-101e6f3f14c5 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:22:50.368932 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1ba82be8-210c-469a-a995-101e6f3f14c5 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:22:50.369377 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-1ba82be8-210c-469a-a995-101e6f3f14c5 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:22:50.434954 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-1ba82be8-210c-469a-a995-101e6f3f14c5 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb57ec276644725a782481a03ca1962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c174a564e3a8471590397f96e291e5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:22:50.443239 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-1ba82be8-210c-469a-a995-101e6f3f14c5 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97" status: 200 len: 1253 microversion: 2.1 time: 0.090135 Sep 10 13:22:50.443807 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3934/7862] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:22:50 2022] GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97 => generated 1253 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:22:51.466000 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-ba7a70a5-50b0-4c53-b2d7-7b17a6fb2ead tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:22:51.466612 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-ba7a70a5-50b0-4c53-b2d7-7b17a6fb2ead tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: c7c23ab4-d32e-4ddf-ac12-ede9201c2b97] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:22:51.480446 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba7a70a5-50b0-4c53-b2d7-7b17a6fb2ead tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:22:51.482891 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba7a70a5-50b0-4c53-b2d7-7b17a6fb2ead tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:22:51.483822 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba7a70a5-50b0-4c53-b2d7-7b17a6fb2ead tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:22:51.485568 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba7a70a5-50b0-4c53-b2d7-7b17a6fb2ead tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:22:51.487465 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba7a70a5-50b0-4c53-b2d7-7b17a6fb2ead tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:22:51.490446 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-ba7a70a5-50b0-4c53-b2d7-7b17a6fb2ead tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:22:51.592822 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-ba7a70a5-50b0-4c53-b2d7-7b17a6fb2ead tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb57ec276644725a782481a03ca1962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c174a564e3a8471590397f96e291e5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:22:51.602313 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-ba7a70a5-50b0-4c53-b2d7-7b17a6fb2ead tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97" status: 200 len: 1307 microversion: 2.1 time: 0.140179 Sep 10 13:22:51.615820 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3929/7863] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:22:51 2022] GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97 => generated 1307 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:22:52.625836 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-01978319-19a0-456b-b95d-b0fc1c134a0d tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:22:52.626461 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-01978319-19a0-456b-b95d-b0fc1c134a0d tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: c7c23ab4-d32e-4ddf-ac12-ede9201c2b97] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:22:52.634960 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01978319-19a0-456b-b95d-b0fc1c134a0d tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:22:52.635608 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01978319-19a0-456b-b95d-b0fc1c134a0d tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:22:52.636085 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01978319-19a0-456b-b95d-b0fc1c134a0d tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:22:52.637003 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01978319-19a0-456b-b95d-b0fc1c134a0d tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:22:52.637793 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01978319-19a0-456b-b95d-b0fc1c134a0d tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:22:52.638432 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-01978319-19a0-456b-b95d-b0fc1c134a0d tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:22:52.787998 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-01978319-19a0-456b-b95d-b0fc1c134a0d tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb57ec276644725a782481a03ca1962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c174a564e3a8471590397f96e291e5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:22:52.796730 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-01978319-19a0-456b-b95d-b0fc1c134a0d tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97" status: 200 len: 1374 microversion: 2.1 time: 0.174660 Sep 10 13:22:52.808558 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3935/7864] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:22:52 2022] GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97 => generated 1374 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:22:53.823745 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-afeff818-2bbf-44f0-9df2-d245c90d6f5a tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:22:53.824521 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-afeff818-2bbf-44f0-9df2-d245c90d6f5a tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: c7c23ab4-d32e-4ddf-ac12-ede9201c2b97] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:22:53.833545 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-afeff818-2bbf-44f0-9df2-d245c90d6f5a tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:22:53.834045 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-afeff818-2bbf-44f0-9df2-d245c90d6f5a tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:22:53.834486 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-afeff818-2bbf-44f0-9df2-d245c90d6f5a tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:22:53.835300 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-afeff818-2bbf-44f0-9df2-d245c90d6f5a tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:22:53.835764 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-afeff818-2bbf-44f0-9df2-d245c90d6f5a tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:22:53.836196 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-afeff818-2bbf-44f0-9df2-d245c90d6f5a tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:22:53.999645 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-afeff818-2bbf-44f0-9df2-d245c90d6f5a tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb57ec276644725a782481a03ca1962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c174a564e3a8471590397f96e291e5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:22:54.008350 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-afeff818-2bbf-44f0-9df2-d245c90d6f5a tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97" status: 200 len: 1374 microversion: 2.1 time: 0.189321 Sep 10 13:22:54.008951 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3930/7865] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:22:53 2022] GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97 => generated 1374 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:22:55.034731 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-8322c67e-40d0-4763-bb07-a9477605f55d tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:22:55.036981 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-8322c67e-40d0-4763-bb07-a9477605f55d tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: c7c23ab4-d32e-4ddf-ac12-ede9201c2b97] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:22:55.046940 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8322c67e-40d0-4763-bb07-a9477605f55d tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:22:55.047878 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8322c67e-40d0-4763-bb07-a9477605f55d tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:22:55.048602 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8322c67e-40d0-4763-bb07-a9477605f55d tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:22:55.049594 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8322c67e-40d0-4763-bb07-a9477605f55d tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:22:55.050297 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8322c67e-40d0-4763-bb07-a9477605f55d tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:22:55.051611 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-8322c67e-40d0-4763-bb07-a9477605f55d tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:22:55.216449 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-8322c67e-40d0-4763-bb07-a9477605f55d tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb57ec276644725a782481a03ca1962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c174a564e3a8471590397f96e291e5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:22:55.228867 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-8322c67e-40d0-4763-bb07-a9477605f55d tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97" status: 200 len: 1374 microversion: 2.1 time: 0.199089 Sep 10 13:22:55.229472 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3936/7866] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:22:55 2022] GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97 => generated 1374 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:22:56.260263 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-7c0f2147-186c-4352-adc7-145379a4a0cb tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:22:56.260901 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-7c0f2147-186c-4352-adc7-145379a4a0cb tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: c7c23ab4-d32e-4ddf-ac12-ede9201c2b97] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:22:56.268610 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c0f2147-186c-4352-adc7-145379a4a0cb tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:22:56.269206 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c0f2147-186c-4352-adc7-145379a4a0cb tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:22:56.270239 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c0f2147-186c-4352-adc7-145379a4a0cb tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:22:56.271043 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c0f2147-186c-4352-adc7-145379a4a0cb tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:22:56.271595 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c0f2147-186c-4352-adc7-145379a4a0cb tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:22:56.272094 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-7c0f2147-186c-4352-adc7-145379a4a0cb tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:22:56.419460 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-7c0f2147-186c-4352-adc7-145379a4a0cb tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb57ec276644725a782481a03ca1962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c174a564e3a8471590397f96e291e5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:22:56.427585 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-7c0f2147-186c-4352-adc7-145379a4a0cb tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97" status: 200 len: 1374 microversion: 2.1 time: 0.171224 Sep 10 13:22:56.428181 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3931/7867] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:22:56 2022] GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97 => generated 1374 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:22:57.452174 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-999b0f13-e05f-4ce5-813b-9781144066f6 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:22:57.452937 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-999b0f13-e05f-4ce5-813b-9781144066f6 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: c7c23ab4-d32e-4ddf-ac12-ede9201c2b97] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:22:57.454670 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=2 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:22:57.462271 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-999b0f13-e05f-4ce5-813b-9781144066f6 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:22:57.462782 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-999b0f13-e05f-4ce5-813b-9781144066f6 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:22:57.463270 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-999b0f13-e05f-4ce5-813b-9781144066f6 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:22:57.464025 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-999b0f13-e05f-4ce5-813b-9781144066f6 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:22:57.464911 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-999b0f13-e05f-4ce5-813b-9781144066f6 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:22:57.464911 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-999b0f13-e05f-4ce5-813b-9781144066f6 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:22:57.611306 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-999b0f13-e05f-4ce5-813b-9781144066f6 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb57ec276644725a782481a03ca1962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c174a564e3a8471590397f96e291e5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:22:57.621442 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-999b0f13-e05f-4ce5-813b-9781144066f6 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97" status: 200 len: 1374 microversion: 2.1 time: 0.174139 Sep 10 13:22:57.622259 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3937/7868] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:22:57 2022] GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97 => generated 1374 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:22:58.649517 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-55544502-f546-480c-b7c8-2ba627424bdf tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:22:58.650187 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-55544502-f546-480c-b7c8-2ba627424bdf tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: c7c23ab4-d32e-4ddf-ac12-ede9201c2b97] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:22:58.657446 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-55544502-f546-480c-b7c8-2ba627424bdf tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:22:58.657858 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-55544502-f546-480c-b7c8-2ba627424bdf tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:22:58.658290 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-55544502-f546-480c-b7c8-2ba627424bdf tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:22:58.658990 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-55544502-f546-480c-b7c8-2ba627424bdf tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:22:58.659612 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-55544502-f546-480c-b7c8-2ba627424bdf tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:22:58.660036 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-55544502-f546-480c-b7c8-2ba627424bdf tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:22:58.814828 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-55544502-f546-480c-b7c8-2ba627424bdf tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb57ec276644725a782481a03ca1962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c174a564e3a8471590397f96e291e5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:22:58.823442 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-55544502-f546-480c-b7c8-2ba627424bdf tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97" status: 200 len: 1374 microversion: 2.1 time: 0.181030 Sep 10 13:22:58.824270 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3932/7869] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:22:58 2022] GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97 => generated 1374 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:22:59.847241 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-5e233237-ebb7-4b28-a51d-148b29384c35 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:22:59.848525 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-5e233237-ebb7-4b28-a51d-148b29384c35 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: c7c23ab4-d32e-4ddf-ac12-ede9201c2b97] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:22:59.850345 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell0:SELECT=10 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:22:59.856792 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5e233237-ebb7-4b28-a51d-148b29384c35 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:22:59.857302 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5e233237-ebb7-4b28-a51d-148b29384c35 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:22:59.857759 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5e233237-ebb7-4b28-a51d-148b29384c35 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:22:59.858478 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5e233237-ebb7-4b28-a51d-148b29384c35 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:22:59.858955 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5e233237-ebb7-4b28-a51d-148b29384c35 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:22:59.859429 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-5e233237-ebb7-4b28-a51d-148b29384c35 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:23:00.000039 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-5e233237-ebb7-4b28-a51d-148b29384c35 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb57ec276644725a782481a03ca1962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c174a564e3a8471590397f96e291e5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:23:00.007734 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-5e233237-ebb7-4b28-a51d-148b29384c35 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97" status: 200 len: 1374 microversion: 2.1 time: 0.164492 Sep 10 13:23:00.008307 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3938/7870] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:22:59 2022] GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97 => generated 1374 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:23:00.440173 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell0:SELECT=4 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:23:00.500006 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [req-8e0efab2-48b4-4c0a-bcd6-2f9f5657bf63 req-c75dbbb9-89ea-488e-89c0-d1aa40af24d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7c23ab4-d32e-4ddf-ac12-ede9201c2b97", "tag": "114c5699-843c-44ee-9e68-a73b0ed9cc70"}]} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:23:00.510668 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8e0efab2-48b4-4c0a-bcd6-2f9f5657bf63 req-c75dbbb9-89ea-488e-89c0-d1aa40af24d5 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:23:00.511054 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8e0efab2-48b4-4c0a-bcd6-2f9f5657bf63 req-c75dbbb9-89ea-488e-89c0-d1aa40af24d5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:23:00.511510 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [req-8e0efab2-48b4-4c0a-bcd6-2f9f5657bf63 req-c75dbbb9-89ea-488e-89c0-d1aa40af24d5 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:23:00.523535 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.compute.server_external_events [req-8e0efab2-48b4-4c0a-bcd6-2f9f5657bf63 req-c75dbbb9-89ea-488e-89c0-d1aa40af24d5 service nova] Creating event network-changed:114c5699-843c-44ee-9e68-a73b0ed9cc70 for instance c7c23ab4-d32e-4ddf-ac12-ede9201c2b97 on n-h2-856895-1 Sep 10 13:23:00.528475 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [req-8e0efab2-48b4-4c0a-bcd6-2f9f5657bf63 req-c75dbbb9-89ea-488e-89c0-d1aa40af24d5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093516 Sep 10 13:23:00.529086 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3933/7871] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:23:01.031589 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d9e6585c-bab7-4c0b-8343-04d5db4d3db8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:23:01.032170 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d9e6585c-bab7-4c0b-8343-04d5db4d3db8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: c7c23ab4-d32e-4ddf-ac12-ede9201c2b97] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:23:01.039428 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d9e6585c-bab7-4c0b-8343-04d5db4d3db8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:23:01.039931 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d9e6585c-bab7-4c0b-8343-04d5db4d3db8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:23:01.040412 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d9e6585c-bab7-4c0b-8343-04d5db4d3db8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:23:01.041123 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d9e6585c-bab7-4c0b-8343-04d5db4d3db8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:23:01.041602 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d9e6585c-bab7-4c0b-8343-04d5db4d3db8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:23:01.042048 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d9e6585c-bab7-4c0b-8343-04d5db4d3db8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:23:01.175582 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d9e6585c-bab7-4c0b-8343-04d5db4d3db8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb57ec276644725a782481a03ca1962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c174a564e3a8471590397f96e291e5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:23:01.183964 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d9e6585c-bab7-4c0b-8343-04d5db4d3db8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97" status: 200 len: 1374 microversion: 2.1 time: 0.156429 Sep 10 13:23:01.184544 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3939/7872] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:23:01 2022] GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97 => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:23:02.209610 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-75d055ac-000a-4e9b-bff7-5ac7eb1a8351 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:23:02.210318 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-75d055ac-000a-4e9b-bff7-5ac7eb1a8351 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: c7c23ab4-d32e-4ddf-ac12-ede9201c2b97] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:23:02.216503 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-75d055ac-000a-4e9b-bff7-5ac7eb1a8351 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:23:02.216993 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-75d055ac-000a-4e9b-bff7-5ac7eb1a8351 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:23:02.217433 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-75d055ac-000a-4e9b-bff7-5ac7eb1a8351 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:23:02.218123 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-75d055ac-000a-4e9b-bff7-5ac7eb1a8351 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:23:02.218577 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-75d055ac-000a-4e9b-bff7-5ac7eb1a8351 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:23:02.219004 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-75d055ac-000a-4e9b-bff7-5ac7eb1a8351 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:23:02.355098 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-75d055ac-000a-4e9b-bff7-5ac7eb1a8351 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb57ec276644725a782481a03ca1962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c174a564e3a8471590397f96e291e5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:23:02.363435 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-75d055ac-000a-4e9b-bff7-5ac7eb1a8351 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97" status: 200 len: 1374 microversion: 2.1 time: 0.159471 Sep 10 13:23:02.364199 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3934/7873] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:23:02 2022] GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97 => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:23:03.387424 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-872bdf2a-3a5b-4971-a8d5-69ad1eb1b3b8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:23:03.388063 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-872bdf2a-3a5b-4971-a8d5-69ad1eb1b3b8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: c7c23ab4-d32e-4ddf-ac12-ede9201c2b97] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:23:03.395377 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-872bdf2a-3a5b-4971-a8d5-69ad1eb1b3b8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:23:03.395880 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-872bdf2a-3a5b-4971-a8d5-69ad1eb1b3b8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:23:03.396334 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-872bdf2a-3a5b-4971-a8d5-69ad1eb1b3b8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:23:03.397047 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-872bdf2a-3a5b-4971-a8d5-69ad1eb1b3b8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:23:03.397520 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-872bdf2a-3a5b-4971-a8d5-69ad1eb1b3b8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:23:03.397962 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-872bdf2a-3a5b-4971-a8d5-69ad1eb1b3b8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:23:03.536988 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-872bdf2a-3a5b-4971-a8d5-69ad1eb1b3b8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb57ec276644725a782481a03ca1962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c174a564e3a8471590397f96e291e5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:23:03.545468 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-872bdf2a-3a5b-4971-a8d5-69ad1eb1b3b8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97" status: 200 len: 1374 microversion: 2.1 time: 0.161997 Sep 10 13:23:03.546064 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3940/7874] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:23:03 2022] GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97 => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:23:04.568962 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-e1372aff-0e8b-402e-8811-877ce979eba8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:23:04.569510 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-e1372aff-0e8b-402e-8811-877ce979eba8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: c7c23ab4-d32e-4ddf-ac12-ede9201c2b97] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:23:04.576296 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e1372aff-0e8b-402e-8811-877ce979eba8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:23:04.576783 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e1372aff-0e8b-402e-8811-877ce979eba8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:23:04.577221 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e1372aff-0e8b-402e-8811-877ce979eba8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:23:04.577914 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e1372aff-0e8b-402e-8811-877ce979eba8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:23:04.578369 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e1372aff-0e8b-402e-8811-877ce979eba8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:23:04.578799 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-e1372aff-0e8b-402e-8811-877ce979eba8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:23:04.710453 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-e1372aff-0e8b-402e-8811-877ce979eba8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb57ec276644725a782481a03ca1962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c174a564e3a8471590397f96e291e5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:23:04.718168 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-e1372aff-0e8b-402e-8811-877ce979eba8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97" status: 200 len: 1374 microversion: 2.1 time: 0.153237 Sep 10 13:23:04.718743 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3935/7875] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:23:04 2022] GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97 => generated 1374 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:23:05.212073 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-9b9b3810-d05e-45d9-810f-ed067fbb079a req-d3aa55b7-3e4e-4f62-8b9e-edafa379e6d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7c23ab4-d32e-4ddf-ac12-ede9201c2b97", "name": "network-vif-plugged", "status": "completed", "tag": "114c5699-843c-44ee-9e68-a73b0ed9cc70"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:23:05.223484 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-9b9b3810-d05e-45d9-810f-ed067fbb079a req-d3aa55b7-3e4e-4f62-8b9e-edafa379e6d8 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:23:05.223998 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-9b9b3810-d05e-45d9-810f-ed067fbb079a req-d3aa55b7-3e4e-4f62-8b9e-edafa379e6d8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:23:05.224461 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-9b9b3810-d05e-45d9-810f-ed067fbb079a req-d3aa55b7-3e4e-4f62-8b9e-edafa379e6d8 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:23:05.236129 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-9b9b3810-d05e-45d9-810f-ed067fbb079a req-d3aa55b7-3e4e-4f62-8b9e-edafa379e6d8 service nova] Creating event network-vif-plugged:114c5699-843c-44ee-9e68-a73b0ed9cc70 for instance c7c23ab4-d32e-4ddf-ac12-ede9201c2b97 on n-h2-856895-1 Sep 10 13:23:05.241527 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-9b9b3810-d05e-45d9-810f-ed067fbb079a req-d3aa55b7-3e4e-4f62-8b9e-edafa379e6d8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033842 Sep 10 13:23:05.242352 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3941/7876] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:23:05.742286 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0be3e19a-b618-44f3-bef4-9451fe04b3e8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:23:05.742913 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0be3e19a-b618-44f3-bef4-9451fe04b3e8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: c7c23ab4-d32e-4ddf-ac12-ede9201c2b97] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:23:05.749779 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0be3e19a-b618-44f3-bef4-9451fe04b3e8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:23:05.750261 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0be3e19a-b618-44f3-bef4-9451fe04b3e8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:23:05.750695 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0be3e19a-b618-44f3-bef4-9451fe04b3e8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:23:05.751411 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0be3e19a-b618-44f3-bef4-9451fe04b3e8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:23:05.751870 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0be3e19a-b618-44f3-bef4-9451fe04b3e8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:23:05.752295 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0be3e19a-b618-44f3-bef4-9451fe04b3e8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:23:05.890348 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0be3e19a-b618-44f3-bef4-9451fe04b3e8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb57ec276644725a782481a03ca1962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c174a564e3a8471590397f96e291e5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:23:05.898470 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0be3e19a-b618-44f3-bef4-9451fe04b3e8 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97" status: 200 len: 1374 microversion: 2.1 time: 0.160773 Sep 10 13:23:05.899050 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3936/7877] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:23:05 2022] GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97 => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:23:06.923496 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-189b659c-452b-4ad8-84e3-b3d636ad8f8d tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:23:06.924224 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-189b659c-452b-4ad8-84e3-b3d636ad8f8d tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: c7c23ab4-d32e-4ddf-ac12-ede9201c2b97] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:23:06.930579 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-189b659c-452b-4ad8-84e3-b3d636ad8f8d tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:23:06.931076 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-189b659c-452b-4ad8-84e3-b3d636ad8f8d tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:23:06.931568 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-189b659c-452b-4ad8-84e3-b3d636ad8f8d tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:23:06.932275 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-189b659c-452b-4ad8-84e3-b3d636ad8f8d tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:23:06.932750 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-189b659c-452b-4ad8-84e3-b3d636ad8f8d tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:23:06.933194 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-189b659c-452b-4ad8-84e3-b3d636ad8f8d tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:23:07.067651 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-189b659c-452b-4ad8-84e3-b3d636ad8f8d tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb57ec276644725a782481a03ca1962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c174a564e3a8471590397f96e291e5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:23:07.075535 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-189b659c-452b-4ad8-84e3-b3d636ad8f8d tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97" status: 200 len: 1558 microversion: 2.1 time: 0.157305 Sep 10 13:23:07.076130 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3942/7878] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:23:06 2022] GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:23:07.098133 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-f2b97f01-5656-4aac-804f-6c341a11f99c tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:23:07.098752 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-f2b97f01-5656-4aac-804f-6c341a11f99c tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: c7c23ab4-d32e-4ddf-ac12-ede9201c2b97] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:23:07.105610 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f2b97f01-5656-4aac-804f-6c341a11f99c tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:23:07.106118 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f2b97f01-5656-4aac-804f-6c341a11f99c tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:23:07.106546 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f2b97f01-5656-4aac-804f-6c341a11f99c tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:23:07.107273 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f2b97f01-5656-4aac-804f-6c341a11f99c tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:23:07.107735 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f2b97f01-5656-4aac-804f-6c341a11f99c tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:23:07.108168 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-f2b97f01-5656-4aac-804f-6c341a11f99c tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:23:07.243714 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-f2b97f01-5656-4aac-804f-6c341a11f99c tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb57ec276644725a782481a03ca1962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c174a564e3a8471590397f96e291e5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:23:07.251340 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-f2b97f01-5656-4aac-804f-6c341a11f99c tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97" status: 200 len: 1558 microversion: 2.1 time: 0.157163 Sep 10 13:23:07.251911 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3937/7879] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:23:07 2022] GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:23:08.853444 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-391a1720-42bc-49e5-a22a-03e2d62f993c req-c4f14329-2ed7-491c-85ca-a11414e292f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7c23ab4-d32e-4ddf-ac12-ede9201c2b97", "tag": "114c5699-843c-44ee-9e68-a73b0ed9cc70"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:23:08.864796 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-391a1720-42bc-49e5-a22a-03e2d62f993c req-c4f14329-2ed7-491c-85ca-a11414e292f6 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:23:08.865292 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-391a1720-42bc-49e5-a22a-03e2d62f993c req-c4f14329-2ed7-491c-85ca-a11414e292f6 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:23:08.865737 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-391a1720-42bc-49e5-a22a-03e2d62f993c req-c4f14329-2ed7-491c-85ca-a11414e292f6 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:23:08.876949 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-391a1720-42bc-49e5-a22a-03e2d62f993c req-c4f14329-2ed7-491c-85ca-a11414e292f6 service nova] Creating event network-changed:114c5699-843c-44ee-9e68-a73b0ed9cc70 for instance c7c23ab4-d32e-4ddf-ac12-ede9201c2b97 on n-h2-856895-1 Sep 10 13:23:08.882469 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-391a1720-42bc-49e5-a22a-03e2d62f993c req-c4f14329-2ed7-491c-85ca-a11414e292f6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032783 Sep 10 13:23:08.883068 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3943/7880] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:24:47.716620 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=30 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:24:47.717427 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=52 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:24:47.768470 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-493f6472-b41c-4b98-900f-c0064e2064f7 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-919101415"}} {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:24:47.772596 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-493f6472-b41c-4b98-900f-c0064e2064f7 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: c7c23ab4-d32e-4ddf-ac12-ede9201c2b97] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:24:47.778481 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-493f6472-b41c-4b98-900f-c0064e2064f7 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:24:47.778963 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-493f6472-b41c-4b98-900f-c0064e2064f7 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:24:47.779482 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-493f6472-b41c-4b98-900f-c0064e2064f7 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:24:47.780168 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-493f6472-b41c-4b98-900f-c0064e2064f7 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:24:47.780620 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-493f6472-b41c-4b98-900f-c0064e2064f7 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:24:47.781042 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-493f6472-b41c-4b98-900f-c0064e2064f7 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:24:47.980338 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-493f6472-b41c-4b98-900f-c0064e2064f7 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "POST /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97/action" status: 202 len: 0 microversion: 2.1 time: 0.265629 Sep 10 13:24:47.980907 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3938/7881] 10.222.0.23 () {60 vars in 1278 bytes} [Sat Sep 10 13:24:47 2022] POST /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 10 13:24:51.703858 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:24:51.705720 n-d-856895-1 devstack@n-api.service[128776]: DEBUG dbcounter [-] [128776] Writing DB stats nova_cell1:SELECT=54 {{(pid=128776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:24:51.720779 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-6558c604-e888-4e1b-b5cb-10715b0dfbdb req-8b58c94f-b763-40f5-a7ef-ef32da1d93cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7c23ab4-d32e-4ddf-ac12-ede9201c2b97", "name": "network-vif-plugged", "status": "completed", "tag": "114c5699-843c-44ee-9e68-a73b0ed9cc70"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:24:51.756017 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6558c604-e888-4e1b-b5cb-10715b0dfbdb req-8b58c94f-b763-40f5-a7ef-ef32da1d93cc service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:24:51.757475 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6558c604-e888-4e1b-b5cb-10715b0dfbdb req-8b58c94f-b763-40f5-a7ef-ef32da1d93cc service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:24:51.758279 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-6558c604-e888-4e1b-b5cb-10715b0dfbdb req-8b58c94f-b763-40f5-a7ef-ef32da1d93cc service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:24:51.774882 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-6558c604-e888-4e1b-b5cb-10715b0dfbdb req-8b58c94f-b763-40f5-a7ef-ef32da1d93cc service nova] Creating event network-vif-plugged:114c5699-843c-44ee-9e68-a73b0ed9cc70 for instance c7c23ab4-d32e-4ddf-ac12-ede9201c2b97 on n-h2-856895-1 Sep 10 13:24:51.790855 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-6558c604-e888-4e1b-b5cb-10715b0dfbdb req-8b58c94f-b763-40f5-a7ef-ef32da1d93cc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089844 Sep 10 13:24:51.791898 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3944/7882] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:25:01.627308 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_api:SELECT=2 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:25:01.628097 n-d-856895-1 devstack@n-api.service[128777]: DEBUG dbcounter [-] [128777] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 10 13:25:01.632921 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-00b9ef94-b937-447d-99f7-7d823d82025b tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:25:01.633547 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-00b9ef94-b937-447d-99f7-7d823d82025b tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: c7c23ab4-d32e-4ddf-ac12-ede9201c2b97] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:25:01.633985 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-d4c31be0-fc41-4487-bbd4-ef5bda3736a8 req-5864bea2-6002-45f0-95f2-ea57594b5b2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7c23ab4-d32e-4ddf-ac12-ede9201c2b97", "tag": "114c5699-843c-44ee-9e68-a73b0ed9cc70"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:25:01.641577 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-00b9ef94-b937-447d-99f7-7d823d82025b tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:25:01.642068 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-00b9ef94-b937-447d-99f7-7d823d82025b tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:25:01.642753 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-00b9ef94-b937-447d-99f7-7d823d82025b tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:25:01.643486 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-00b9ef94-b937-447d-99f7-7d823d82025b tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:25:01.643948 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-00b9ef94-b937-447d-99f7-7d823d82025b tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:25:01.644385 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d4c31be0-fc41-4487-bbd4-ef5bda3736a8 req-5864bea2-6002-45f0-95f2-ea57594b5b2e service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:25:01.644548 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-00b9ef94-b937-447d-99f7-7d823d82025b tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:25:01.645258 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d4c31be0-fc41-4487-bbd4-ef5bda3736a8 req-5864bea2-6002-45f0-95f2-ea57594b5b2e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:25:01.645987 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-d4c31be0-fc41-4487-bbd4-ef5bda3736a8 req-5864bea2-6002-45f0-95f2-ea57594b5b2e service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:25:01.657968 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-d4c31be0-fc41-4487-bbd4-ef5bda3736a8 req-5864bea2-6002-45f0-95f2-ea57594b5b2e service nova] Creating event network-changed:114c5699-843c-44ee-9e68-a73b0ed9cc70 for instance c7c23ab4-d32e-4ddf-ac12-ede9201c2b97 on n-h2-856895-1 Sep 10 13:25:01.664336 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-d4c31be0-fc41-4487-bbd4-ef5bda3736a8 req-5864bea2-6002-45f0-95f2-ea57594b5b2e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036821 Sep 10 13:25:01.665529 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3945/7883] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:25:01.674483 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-00b9ef94-b937-447d-99f7-7d823d82025b tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: c7c23ab4-d32e-4ddf-ac12-ede9201c2b97] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 13:25:01.763893 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-00b9ef94-b937-447d-99f7-7d823d82025b tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97" status: 204 len: 0 microversion: 2.1 time: 0.138541 Sep 10 13:25:01.765718 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3939/7884] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 13:25:01 2022] DELETE /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 13:25:01.776026 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-d8ddcb0a-88cc-4ac3-9519-89e89c928e01 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:25:01.776757 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-d8ddcb0a-88cc-4ac3-9519-89e89c928e01 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: c7c23ab4-d32e-4ddf-ac12-ede9201c2b97] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:25:01.783087 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d8ddcb0a-88cc-4ac3-9519-89e89c928e01 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:25:01.783642 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d8ddcb0a-88cc-4ac3-9519-89e89c928e01 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:25:01.784102 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d8ddcb0a-88cc-4ac3-9519-89e89c928e01 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:25:01.784828 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d8ddcb0a-88cc-4ac3-9519-89e89c928e01 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:25:01.785308 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d8ddcb0a-88cc-4ac3-9519-89e89c928e01 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:25:01.785758 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-d8ddcb0a-88cc-4ac3-9519-89e89c928e01 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:25:01.978522 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-d8ddcb0a-88cc-4ac3-9519-89e89c928e01 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb57ec276644725a782481a03ca1962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c174a564e3a8471590397f96e291e5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:25:01.986494 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-d8ddcb0a-88cc-4ac3-9519-89e89c928e01 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97" status: 200 len: 1682 microversion: 2.1 time: 0.216546 Sep 10 13:25:01.987084 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3946/7885] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:25:01 2022] GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97 => generated 1682 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:25:03.010502 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4a2997dd-fe53-41a7-a52a-fed99e6b0f94 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:25:03.011230 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4a2997dd-fe53-41a7-a52a-fed99e6b0f94 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: c7c23ab4-d32e-4ddf-ac12-ede9201c2b97] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:25:03.017948 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a2997dd-fe53-41a7-a52a-fed99e6b0f94 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:25:03.018427 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a2997dd-fe53-41a7-a52a-fed99e6b0f94 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:25:03.018887 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a2997dd-fe53-41a7-a52a-fed99e6b0f94 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:25:03.019585 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a2997dd-fe53-41a7-a52a-fed99e6b0f94 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:25:03.020036 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a2997dd-fe53-41a7-a52a-fed99e6b0f94 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:25:03.020781 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4a2997dd-fe53-41a7-a52a-fed99e6b0f94 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:25:03.216573 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-4a2997dd-fe53-41a7-a52a-fed99e6b0f94 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb57ec276644725a782481a03ca1962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c174a564e3a8471590397f96e291e5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:25:03.224742 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4a2997dd-fe53-41a7-a52a-fed99e6b0f94 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97" status: 200 len: 1682 microversion: 2.1 time: 0.218558 Sep 10 13:25:03.225349 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3940/7886] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:25:03 2022] GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97 => generated 1682 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:25:03.834444 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-fcf46544-4340-467d-9ff9-61fb3cba8ee2 req-9e2b0b37-0826-4238-92b3-d7fc61022288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7c23ab4-d32e-4ddf-ac12-ede9201c2b97", "name": "network-vif-deleted", "tag": "114c5699-843c-44ee-9e68-a73b0ed9cc70"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:25:03.844128 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-fcf46544-4340-467d-9ff9-61fb3cba8ee2 req-9e2b0b37-0826-4238-92b3-d7fc61022288 service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:25:03.844624 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-fcf46544-4340-467d-9ff9-61fb3cba8ee2 req-9e2b0b37-0826-4238-92b3-d7fc61022288 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:25:03.845074 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-fcf46544-4340-467d-9ff9-61fb3cba8ee2 req-9e2b0b37-0826-4238-92b3-d7fc61022288 service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:25:03.856619 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-fcf46544-4340-467d-9ff9-61fb3cba8ee2 req-9e2b0b37-0826-4238-92b3-d7fc61022288 service nova] Creating event network-vif-deleted:114c5699-843c-44ee-9e68-a73b0ed9cc70 for instance c7c23ab4-d32e-4ddf-ac12-ede9201c2b97 on n-h2-856895-1 Sep 10 13:25:03.861511 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-fcf46544-4340-467d-9ff9-61fb3cba8ee2 req-9e2b0b37-0826-4238-92b3-d7fc61022288 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081370 Sep 10 13:25:03.862109 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3947/7887] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 13:25:04.247831 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-8c026b0b-54f4-41a0-b7fa-1f95751ed709 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:25:04.248719 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-8c026b0b-54f4-41a0-b7fa-1f95751ed709 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: c7c23ab4-d32e-4ddf-ac12-ede9201c2b97] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:25:04.255928 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c026b0b-54f4-41a0-b7fa-1f95751ed709 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:25:04.256417 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c026b0b-54f4-41a0-b7fa-1f95751ed709 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:25:04.257247 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c026b0b-54f4-41a0-b7fa-1f95751ed709 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:25:04.257566 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c026b0b-54f4-41a0-b7fa-1f95751ed709 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:25:04.258153 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c026b0b-54f4-41a0-b7fa-1f95751ed709 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:25:04.258593 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c026b0b-54f4-41a0-b7fa-1f95751ed709 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:25:04.295928 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c026b0b-54f4-41a0-b7fa-1f95751ed709 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:25:04.296465 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c026b0b-54f4-41a0-b7fa-1f95751ed709 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:25:04.296855 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-8c026b0b-54f4-41a0-b7fa-1f95751ed709 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:25:04.297306 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.objects.instance [None req-8c026b0b-54f4-41a0-b7fa-1f95751ed709 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lazy-loading 'fault' on Instance uuid c7c23ab4-d32e-4ddf-ac12-ede9201c2b97 {{(pid=128777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 10 13:25:04.341746 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-8c026b0b-54f4-41a0-b7fa-1f95751ed709 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb57ec276644725a782481a03ca1962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c174a564e3a8471590397f96e291e5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:25:04.349117 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-8c026b0b-54f4-41a0-b7fa-1f95751ed709 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97" status: 200 len: 1339 microversion: 2.1 time: 0.105260 Sep 10 13:25:04.349701 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3941/7888] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:25:04 2022] GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97 => generated 1339 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:25:05.374480 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-35dbe35c-9ed3-4c30-8c3f-f5e0e4ad6332 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:25:05.375251 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-35dbe35c-9ed3-4c30-8c3f-f5e0e4ad6332 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: c7c23ab4-d32e-4ddf-ac12-ede9201c2b97] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:25:05.381529 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-35dbe35c-9ed3-4c30-8c3f-f5e0e4ad6332 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:25:05.382161 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-35dbe35c-9ed3-4c30-8c3f-f5e0e4ad6332 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:25:05.382641 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-35dbe35c-9ed3-4c30-8c3f-f5e0e4ad6332 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:25:05.383368 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-35dbe35c-9ed3-4c30-8c3f-f5e0e4ad6332 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:25:05.383836 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-35dbe35c-9ed3-4c30-8c3f-f5e0e4ad6332 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:25:05.384273 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-35dbe35c-9ed3-4c30-8c3f-f5e0e4ad6332 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:25:05.397757 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.wsgi [None req-35dbe35c-9ed3-4c30-8c3f-f5e0e4ad6332 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] HTTP exception thrown: Instance c7c23ab4-d32e-4ddf-ac12-ede9201c2b97 could not be found. Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-35dbe35c-9ed3-4c30-8c3f-f5e0e4ad6332 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Request method failure captured: Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: request: GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97 HTTP/1.1 Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: Accept: application/json Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: Accept-Encoding: identity Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: Connection: close Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: Content-Length: 0 Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: Content-Type: application/json Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: Host: 10.222.0.23 Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: Openstack-System-Scope: None Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: User-Agent: python-urllib3/1.26.12 Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: X-Auth-Token: gAAAAABjHI7t1oReBlg9R3HWVGWa30ZtFr9LNeAssWY6T6UOvIEGHs3vMKlFiCdxqGARJy8VutrqyjtvqInPVdugAkTpUwB1ut9dPAEV-bCDFbm0TQwj-HnVPzlSsY6oyhjDL3J3eEkRrPTudGLll1TVWM7GJjDI1PXXeGY4qP1UbBf5tv51C-w Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Id: None Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: X-Domain-Name: None Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: X-Identity-Status: Confirmed Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: X-Is-Admin-Project: True Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Id: default Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Domain-Name: Default Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Id: c174a564e3a8471590397f96e291e5c7 Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: X-Project-Name: tempest-TestSnapshotPattern-2061645142 Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: X-Role: reader,member Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: X-Roles: reader,member Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c174a564e3a8471590397f96e291e5c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c174a564e3a8471590397f96e291e5c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c174a564e3a8471590397f96e291e5c7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c174a564e3a8471590397f96e291e5c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant: tempest-TestSnapshotPattern-2061645142 Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Id: c174a564e3a8471590397f96e291e5c7 Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: X-Tenant-Name: tempest-TestSnapshotPattern-2061645142 Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: X-User: tempest-TestSnapshotPattern-2061645142-project Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Id: default Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: X-User-Domain-Name: Default Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: X-User-Id: 8fb57ec276644725a782481a03ca1962 Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: X-User-Name: tempest-TestSnapshotPattern-2061645142-project Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: method: > Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: exception: Instance c7c23ab4-d32e-4ddf-ac12-ede9201c2b97 could not be found. Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: action_args: {'id': 'c7c23ab4-d32e-4ddf-ac12-ede9201c2b97'} Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7c23ab4-d32e-4ddf-ac12-ede9201c2b97 could not be found. Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7c23ab4-d32e-4ddf-ac12-ede9201c2b97 could not be found. Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 13:25:05.399382 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 13:25:05.404834 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 13:25:05.404834 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 13:25:05.404834 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 13:25:05.404834 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 13:25:05.404834 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 13:25:05.404834 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7c23ab4-d32e-4ddf-ac12-ede9201c2b97 could not be found. Sep 10 13:25:05.404834 n-d-856895-1 devstack@n-api.service[128776]: ERROR nova.api.openstack.wsgi Sep 10 13:25:05.404834 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-35dbe35c-9ed3-4c30-8c3f-f5e0e4ad6332 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Returning 404 to user: Instance c7c23ab4-d32e-4ddf-ac12-ede9201c2b97 could not be found. {{(pid=128776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 13:25:05.404834 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-35dbe35c-9ed3-4c30-8c3f-f5e0e4ad6332 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97" status: 404 len: 111 microversion: 2.1 time: 0.031410 Sep 10 13:25:05.404834 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3948/7889] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:25:05 2022] GET /compute/v2.1/servers/c7c23ab4-d32e-4ddf-ac12-ede9201c2b97 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 13:25:06.731311 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-6e989728-ae17-4c62-b263-3d47f3c9fec0 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:25:06.731825 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6e989728-ae17-4c62-b263-3d47f3c9fec0 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: ce0c8431-ebfc-42ff-abc9-112981ca093e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:25:06.733312 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-5a7be218-98c9-4875-9828-ea680ed2ec1c req-470bcb3f-429e-4274-9bb0-f264e861c3db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce0c8431-ebfc-42ff-abc9-112981ca093e", "tag": "06fbfad4-2c2e-4fdb-99f8-f6834f2228ef"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:25:06.738927 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6e989728-ae17-4c62-b263-3d47f3c9fec0 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:25:06.739454 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6e989728-ae17-4c62-b263-3d47f3c9fec0 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:25:06.739892 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6e989728-ae17-4c62-b263-3d47f3c9fec0 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:25:06.740617 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6e989728-ae17-4c62-b263-3d47f3c9fec0 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:25:06.741435 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6e989728-ae17-4c62-b263-3d47f3c9fec0 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:25:06.742106 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-6e989728-ae17-4c62-b263-3d47f3c9fec0 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:25:06.745896 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-5a7be218-98c9-4875-9828-ea680ed2ec1c req-470bcb3f-429e-4274-9bb0-f264e861c3db service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:25:06.746459 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-5a7be218-98c9-4875-9828-ea680ed2ec1c req-470bcb3f-429e-4274-9bb0-f264e861c3db service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:25:06.747083 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-5a7be218-98c9-4875-9828-ea680ed2ec1c req-470bcb3f-429e-4274-9bb0-f264e861c3db service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:25:06.759330 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-5a7be218-98c9-4875-9828-ea680ed2ec1c req-470bcb3f-429e-4274-9bb0-f264e861c3db service nova] Creating event network-changed:06fbfad4-2c2e-4fdb-99f8-f6834f2228ef for instance ce0c8431-ebfc-42ff-abc9-112981ca093e on n-h1-856895-1 Sep 10 13:25:06.765748 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-5a7be218-98c9-4875-9828-ea680ed2ec1c req-470bcb3f-429e-4274-9bb0-f264e861c3db service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035772 Sep 10 13:25:06.766943 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3949/7890] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 10 13:25:06.771470 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-6e989728-ae17-4c62-b263-3d47f3c9fec0 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: ce0c8431-ebfc-42ff-abc9-112981ca093e] Going to try to terminate instance {{(pid=128777) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 10 13:25:06.867979 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-6e989728-ae17-4c62-b263-3d47f3c9fec0 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ce0c8431-ebfc-42ff-abc9-112981ca093e" status: 204 len: 0 microversion: 2.1 time: 0.137950 Sep 10 13:25:06.869662 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3942/7891] 10.222.0.23 () {58 vars in 1239 bytes} [Sat Sep 10 13:25:06 2022] DELETE /compute/v2.1/servers/ce0c8431-ebfc-42ff-abc9-112981ca093e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 10 13:25:06.878140 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-857c9040-8697-48b2-942e-5299490667f9 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Calling method '>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:25:06.879054 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.compute.api [None req-857c9040-8697-48b2-942e-5299490667f9 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: ce0c8431-ebfc-42ff-abc9-112981ca093e] Fetching instance by UUID {{(pid=128776) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:25:06.886037 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-857c9040-8697-48b2-942e-5299490667f9 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:25:06.886696 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-857c9040-8697-48b2-942e-5299490667f9 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:25:06.887273 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-857c9040-8697-48b2-942e-5299490667f9 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:25:06.888081 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-857c9040-8697-48b2-942e-5299490667f9 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:25:06.888771 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-857c9040-8697-48b2-942e-5299490667f9 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:25:06.889423 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [None req-857c9040-8697-48b2-942e-5299490667f9 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:25:07.032610 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.policy [None req-857c9040-8697-48b2-942e-5299490667f9 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb57ec276644725a782481a03ca1962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c174a564e3a8471590397f96e291e5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128776) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:25:07.040727 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-857c9040-8697-48b2-942e-5299490667f9 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "GET /compute/v2.1/servers/ce0c8431-ebfc-42ff-abc9-112981ca093e" status: 200 len: 1683 microversion: 2.1 time: 0.166852 Sep 10 13:25:07.041319 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3950/7892] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:25:06 2022] GET /compute/v2.1/servers/ce0c8431-ebfc-42ff-abc9-112981ca093e => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 10 13:25:08.065060 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-0ab73f62-519f-4f4d-8ba3-5e37cca1e4e4 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:25:08.065880 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-0ab73f62-519f-4f4d-8ba3-5e37cca1e4e4 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: ce0c8431-ebfc-42ff-abc9-112981ca093e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:25:08.073468 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ab73f62-519f-4f4d-8ba3-5e37cca1e4e4 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:25:08.073896 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ab73f62-519f-4f4d-8ba3-5e37cca1e4e4 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:25:08.074324 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ab73f62-519f-4f4d-8ba3-5e37cca1e4e4 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:25:08.074997 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ab73f62-519f-4f4d-8ba3-5e37cca1e4e4 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:25:08.075752 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ab73f62-519f-4f4d-8ba3-5e37cca1e4e4 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:25:08.076005 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-0ab73f62-519f-4f4d-8ba3-5e37cca1e4e4 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:25:08.219078 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.policy [None req-0ab73f62-519f-4f4d-8ba3-5e37cca1e4e4 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb57ec276644725a782481a03ca1962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c174a564e3a8471590397f96e291e5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128777) authorize /opt/stack/nova/nova/policy.py:199}} Sep 10 13:25:08.227370 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-0ab73f62-519f-4f4d-8ba3-5e37cca1e4e4 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "GET /compute/v2.1/servers/ce0c8431-ebfc-42ff-abc9-112981ca093e" status: 200 len: 1564 microversion: 2.1 time: 0.166588 Sep 10 13:25:08.227967 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3943/7893] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:25:08 2022] GET /compute/v2.1/servers/ce0c8431-ebfc-42ff-abc9-112981ca093e => generated 1564 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 10 13:25:08.237991 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [req-7b05678c-32df-420a-aa2d-a8c4a5916b73 req-8377fe3d-15f0-430f-9915-e153f42c424f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce0c8431-ebfc-42ff-abc9-112981ca093e", "name": "network-vif-deleted", "tag": "06fbfad4-2c2e-4fdb-99f8-f6834f2228ef"}]} {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 10 13:25:08.249626 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-7b05678c-32df-420a-aa2d-a8c4a5916b73 req-8377fe3d-15f0-430f-9915-e153f42c424f service nova] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:25:08.250124 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-7b05678c-32df-420a-aa2d-a8c4a5916b73 req-8377fe3d-15f0-430f-9915-e153f42c424f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:25:08.250575 n-d-856895-1 devstack@n-api.service[128776]: DEBUG oslo_concurrency.lockutils [req-7b05678c-32df-420a-aa2d-a8c4a5916b73 req-8377fe3d-15f0-430f-9915-e153f42c424f service nova] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:25:08.263122 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.compute.server_external_events [req-7b05678c-32df-420a-aa2d-a8c4a5916b73 req-8377fe3d-15f0-430f-9915-e153f42c424f service nova] Creating event network-vif-deleted:06fbfad4-2c2e-4fdb-99f8-f6834f2228ef for instance ce0c8431-ebfc-42ff-abc9-112981ca093e on n-h1-856895-1 Sep 10 13:25:08.269095 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [req-7b05678c-32df-420a-aa2d-a8c4a5916b73 req-8377fe3d-15f0-430f-9915-e153f42c424f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037077 Sep 10 13:25:08.269715 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3951/7894] 10.222.0.23 () {64 vars in 1317 bytes} [Sat Sep 10 13:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 10 13:25:09.252148 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4e91d72f-74de-4a5c-860d-84f46ccc3919 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Calling method '>' {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:25:09.252758 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.compute.api [None req-4e91d72f-74de-4a5c-860d-84f46ccc3919 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] [instance: ce0c8431-ebfc-42ff-abc9-112981ca093e] Fetching instance by UUID {{(pid=128777) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 10 13:25:09.259941 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e91d72f-74de-4a5c-860d-84f46ccc3919 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:25:09.260419 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e91d72f-74de-4a5c-860d-84f46ccc3919 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:25:09.260850 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e91d72f-74de-4a5c-860d-84f46ccc3919 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:25:09.261531 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e91d72f-74de-4a5c-860d-84f46ccc3919 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Acquiring lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 10 13:25:09.261980 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e91d72f-74de-4a5c-860d-84f46ccc3919 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 10 13:25:09.262401 n-d-856895-1 devstack@n-api.service[128777]: DEBUG oslo_concurrency.lockutils [None req-4e91d72f-74de-4a5c-860d-84f46ccc3919 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Lock "d31511aa-3734-4d55-9c57-4a88c62d4dfd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 10 13:25:09.276481 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.wsgi [None req-4e91d72f-74de-4a5c-860d-84f46ccc3919 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] HTTP exception thrown: Instance ce0c8431-ebfc-42ff-abc9-112981ca093e could not be found. Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4e91d72f-74de-4a5c-860d-84f46ccc3919 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Request method failure captured: Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: request: GET /compute/v2.1/servers/ce0c8431-ebfc-42ff-abc9-112981ca093e HTTP/1.1 Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: Accept: application/json Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: Accept-Encoding: identity Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: Connection: close Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: Content-Length: 0 Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: Content-Type: application/json Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: Host: 10.222.0.23 Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: Openstack-System-Scope: None Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: User-Agent: python-urllib3/1.26.12 Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: X-Auth-Token: gAAAAABjHI7t1oReBlg9R3HWVGWa30ZtFr9LNeAssWY6T6UOvIEGHs3vMKlFiCdxqGARJy8VutrqyjtvqInPVdugAkTpUwB1ut9dPAEV-bCDFbm0TQwj-HnVPzlSsY6oyhjDL3J3eEkRrPTudGLll1TVWM7GJjDI1PXXeGY4qP1UbBf5tv51C-w Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Id: None Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: X-Domain-Name: None Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: X-Identity-Status: Confirmed Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: X-Is-Admin-Project: True Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Id: default Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Domain-Name: Default Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Id: c174a564e3a8471590397f96e291e5c7 Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: X-Project-Name: tempest-TestSnapshotPattern-2061645142 Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: X-Role: reader,member Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: X-Roles: reader,member Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c174a564e3a8471590397f96e291e5c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/c174a564e3a8471590397f96e291e5c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:8080/v1/AUTH_c174a564e3a8471590397f96e291e5c7", "adminURL": "http://10.222.0.23:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/c174a564e3a8471590397f96e291e5c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}] Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant: tempest-TestSnapshotPattern-2061645142 Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Id: c174a564e3a8471590397f96e291e5c7 Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: X-Tenant-Name: tempest-TestSnapshotPattern-2061645142 Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: X-User: tempest-TestSnapshotPattern-2061645142-project Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Id: default Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: X-User-Domain-Name: Default Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: X-User-Id: 8fb57ec276644725a782481a03ca1962 Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: X-User-Name: tempest-TestSnapshotPattern-2061645142-project Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: method: > Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: exception: Instance ce0c8431-ebfc-42ff-abc9-112981ca093e could not be found. Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: action_args: {'id': 'ce0c8431-ebfc-42ff-abc9-112981ca093e'} Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: {{(pid=128777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce0c8431-ebfc-42ff-abc9-112981ca093e could not be found. Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce0c8431-ebfc-42ff-abc9-112981ca093e could not be found. Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 10 13:25:09.278096 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 13:25:09.283418 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 10 13:25:09.283418 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 10 13:25:09.283418 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 10 13:25:09.283418 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 10 13:25:09.283418 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 10 13:25:09.283418 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce0c8431-ebfc-42ff-abc9-112981ca093e could not be found. Sep 10 13:25:09.283418 n-d-856895-1 devstack@n-api.service[128777]: ERROR nova.api.openstack.wsgi Sep 10 13:25:09.283418 n-d-856895-1 devstack@n-api.service[128777]: DEBUG nova.api.openstack.wsgi [None req-4e91d72f-74de-4a5c-860d-84f46ccc3919 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Returning 404 to user: Instance ce0c8431-ebfc-42ff-abc9-112981ca093e could not be found. {{(pid=128777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 10 13:25:09.283418 n-d-856895-1 devstack@n-api.service[128777]: INFO nova.api.openstack.requestlog [None req-4e91d72f-74de-4a5c-860d-84f46ccc3919 tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "GET /compute/v2.1/servers/ce0c8431-ebfc-42ff-abc9-112981ca093e" status: 404 len: 111 microversion: 2.1 time: 0.031227 Sep 10 13:25:09.283418 n-d-856895-1 devstack@n-api.service[128777]: [pid: 128777|app: 0|req: 3944/7895] 10.222.0.23 () {58 vars in 1236 bytes} [Sat Sep 10 13:25:09 2022] GET /compute/v2.1/servers/ce0c8431-ebfc-42ff-abc9-112981ca093e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 10 13:25:09.442594 n-d-856895-1 devstack@n-api.service[128776]: DEBUG nova.api.openstack.wsgi [None req-cd47f577-571b-4378-b61d-94681422695e tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] Calling method '.version_select at 0x7f407357f8b0>' {{(pid=128776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 10 13:25:09.470562 n-d-856895-1 devstack@n-api.service[128776]: INFO nova.api.openstack.requestlog [None req-cd47f577-571b-4378-b61d-94681422695e tempest-TestSnapshotPattern-2061645142 tempest-TestSnapshotPattern-2061645142-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1927341340" status: 202 len: 0 microversion: 2.1 time: 0.032274 Sep 10 13:25:09.471153 n-d-856895-1 devstack@n-api.service[128776]: [pid: 128776|app: 0|req: 3952/7896] 10.222.0.23 () {58 vars in 1257 bytes} [Sat Sep 10 13:25:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1927341340 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)